2025-10-10T14:30:54.483919Z :BasicWriteSession INFO: Random seed for debugging is 1760106654483914
2025-10-10T14:30:54.581594Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600520103248932:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.581676Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:54.585435Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.586184Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600517151652042:2159];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.586318Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b44/r3tmp/tmpkW60RL/pdisk_1.dat
2025-10-10T14:30:54.587974Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.625410Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:54.626159Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:54.628647Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 3824, node 1
2025-10-10T14:30:54.644643Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b44/r3tmp/yandexjvm3i2.tmp
2025-10-10T14:30:54.644655Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b44/r3tmp/yandexjvm3i2.tmp
2025-10-10T14:30:54.644739Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b44/r3tmp/yandexjvm3i2.tmp
2025-10-10T14:30:54.644791Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:54.649358Z INFO: TTestServer started on Port 21391 GrpcPort 3824
TClient is connected to server localhost:21391
PQClient connected to localhost:3824
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:54.683386Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.683418Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.685014Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:54.688085Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.688116Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.688136Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:30:54.689069Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:30:54.689352Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:30:54.778180Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.839249Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.989435Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600517151652223:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.989520Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NjBmOTE3YzYtNjkzM2VmOC03YTI5NjZjZS00ZGE3MDIzZg==, ActorId: [2:7559600517151652221:2288], ActorState: ExecuteState, TraceId: 01k778gb7bcvbpjbt5pcbdcfzr, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.989814Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.989999Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.990169Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600520103249741:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.990250Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=OTE2Y2EyYjAtNjk3ZDZmYWYtN2ViNDBhZWYtNWJkZTkwY2M=, ActorId: [1:7559600520103249735:2316], ActorState: ExecuteState, TraceId: 01k778gb76dhdetb3jpz3jwz8x, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.990334Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:55.012897Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:55.033176Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3824", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:55.076289Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gba83x97k3pddprqxcb7, Database: , SessionId: ydb://session/3?node_id=1&id=NGE4ZmNiOTQtOGVhMDAyMS1iNGU1Nzg1Ny00NjJlZTYzYQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600524398217408:2876] 
2025-10-10T14:30:55.583727Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:55.587808Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:59.581947Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600520103248932:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.581976Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:30:59.586022Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600517151652042:2159];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.586049Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:00.170450Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3824
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.185483Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3824
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:00.190471Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600545873054399:3173] connected; active server actors: 1
2025-10-10T14:31:00.190577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:00.190646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:00.190882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:00.193517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:00.193946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:00.193993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:00.194002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.194019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:00.194096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600545873054398:3172], now have 1 active actors on pipe
2025-10-10T14:31:00.194106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600545873054422:2437], now have 1 active actors on pipe
2025-10-10T14:31:00.194151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:00.194244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.195008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.196074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600545873054457:3219], now have 1 active actors on pipe
2025-10-10T14:31:00.196122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.196809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.196982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.197012Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.197061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.197122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600542921456548:2381]
2025-10-10T14:31:00.197693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.197700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:00.197704Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600542921456548:2381]
2025-10-10T14:31:00.197708Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.197901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.197910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.197940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.197947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:00.197950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.197951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.197954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.197955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.197960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.198033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.198062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.198721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.198745Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660242, TxId 281474976720677
2025-10-10T14:31:00.198752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.198753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.198770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.198815Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.199206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.199280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.199292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.199294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.199295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.199301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.199389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:00.199409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.199449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.200241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.200263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.200618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.202956Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778ggax3qjdjmbdfjdbge2r, Database: , SessionId: ydb://session/3?node_id=1&id=MjRiNzRiN2EtMzNiNDllZWQtOGI2N2EzYmMtN2ZjMzM2OTU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660242
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660242
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3824
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.207855Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.298224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.298241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.298243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.398565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.398579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.398581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.498930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.498944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.498946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.599271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.599287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.599289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.699623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.699634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.699637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3824
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.708910Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.799986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.800002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.800006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.900333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.900347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.900350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.000670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.000685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.000688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.101046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.101059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.101060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.201385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.201399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.201401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3824
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.210347Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:01.211567Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:01.211765Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:01.211770Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3824
2025-10-10T14:31:01.212228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.212239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:01.213316Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.213541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.213574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:54832
2025-10-10T14:31:01.213583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54832 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.213585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.213906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:01.213955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.213960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.213962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.213967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600550168021922:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.214372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600550168021922:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.233327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600550168021922:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.233419Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600550168021954:2471] connected; active server actors: 1
2025-10-10T14:31:01.233444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600550168021922:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:01.233454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600550168021922:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.233511Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600550168021954:2471] disconnected; active server actors: 1
2025-10-10T14:31:01.233518Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600550168021954:2471] disconnected no session
2025-10-10T14:31:01.247940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600550168021922:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.247956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600550168021922:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:01.247960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600550168021922:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.247969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.248274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600550168021972:2471], now have 1 active actors on pipe
2025-10-10T14:31:01.248319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.248423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.248438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.248470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|f179488a-d0704138-35a5a0c2-cc9a82c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:01.248485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.248497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.248500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.248512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.248525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.248542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.248686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.248693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.248705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.248779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|f179488a-d0704138-35a5a0c2-cc9a82c_0
2025-10-10T14:31:01.249024Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661249 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.249063Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|f179488a-d0704138-35a5a0c2-cc9a82c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:01.249167Z :INFO: [] MessageGroupId [src] SessionId [src|f179488a-d0704138-35a5a0c2-cc9a82c_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:01.249175Z :INFO: [] MessageGroupId [src] SessionId [src|f179488a-d0704138-35a5a0c2-cc9a82c_0] Write session will now close
2025-10-10T14:31:01.249185Z :DEBUG: [] MessageGroupId [src] SessionId [src|f179488a-d0704138-35a5a0c2-cc9a82c_0] Write session: aborting
2025-10-10T14:31:01.249318Z :INFO: [] MessageGroupId [src] SessionId [src|f179488a-d0704138-35a5a0c2-cc9a82c_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:01.249322Z :DEBUG: [] MessageGroupId [src] SessionId [src|f179488a-d0704138-35a5a0c2-cc9a82c_0] Write session: destroy
2025-10-10T14:31:01.249461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|f179488a-d0704138-35a5a0c2-cc9a82c_0 grpc read done: success: 0 data: 
2025-10-10T14:31:01.249468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|f179488a-d0704138-35a5a0c2-cc9a82c_0 grpc read failed
2025-10-10T14:31:01.249473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|f179488a-d0704138-35a5a0c2-cc9a82c_0 grpc closed
2025-10-10T14:31:01.249478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|f179488a-d0704138-35a5a0c2-cc9a82c_0 is DEAD
2025-10-10T14:31:01.249702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:01.249794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600550168021972:2471] destroyed
2025-10-10T14:31:01.249806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:01.249812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.249813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.249814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
Got new write session event: ReadyToAcceptEvent
Got new write session event: ReadyToAcceptEvent
2025-10-10T14:31:01.301759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.301783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.301786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:01.302683Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:3824" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:3824" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:3824" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T14:31:01.304688Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:01.304917Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:31:01.358314Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:31:01.358478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.358495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:31:01.359779Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:01.359928Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:31:01.360077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:01.360125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:57334
2025-10-10T14:31:01.360131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:57334 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:31:01.360142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.360585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T14:31:01.360617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.360621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.360623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.360628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600550168021979:2484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.361117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600550168021979:2484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.362872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600550168021979:2484] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.362933Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600550168021999:2484] connected; active server actors: 1
2025-10-10T14:31:01.362953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600550168021979:2484] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T14:31:01.362960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600550168021979:2484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.363001Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600550168021999:2484] disconnected; active server actors: 1
2025-10-10T14:31:01.363008Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600550168021999:2484] disconnected no session
2025-10-10T14:31:01.365276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600550168021979:2484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.365286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600550168021979:2484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:01.365289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600550168021979:2484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.365294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.365505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600550168022011:2484], now have 1 active actors on pipe
2025-10-10T14:31:01.365543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.365587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.365599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.365623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e419819-8f312568-3bec24aa-e1e32a70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:01.365638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.365650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.365653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.365665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.365684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.365704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.365827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.365833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.365842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.365901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|7e419819-8f312568-3bec24aa-e1e32a70_0
2025-10-10T14:31:01.366177Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:01.366191Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661366 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.366212Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|7e419819-8f312568-3bec24aa-e1e32a70_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T14:31:01.366314Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-10T14:31:01.366541Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:01.366554Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T14:31:01.366775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|7e419819-8f312568-3bec24aa-e1e32a70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.366854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.366978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.366987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.367002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:01.367077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.367164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.367172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.367270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 96 offset: -1
2025-10-10T14:31:01.367280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.367291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.367302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.367307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.367332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T14:31:01.367380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 170 count 1 nextOffset 1 batches 1
2025-10-10T14:31:01.367392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.367444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 158 WTime 1760106661367
2025-10-10T14:31:01.367469Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.367485Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 158
2025-10-10T14:31:01.368232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 158 actorID [2:7559600542921456532:2381]
2025-10-10T14:31:01.368259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.368270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 158
2025-10-10T14:31:01.368289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 103 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.368303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T14:31:01.368352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:01.368366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:01.368370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.368373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.368375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.368383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.368393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:31:01.368436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:31:01.368474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 158 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:31:01.368483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:01.368477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.368496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 158 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.368513Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T14:31:01.368517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:31:01.368530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.368551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 138 from pos 0 cbcount 1
2025-10-10T14:31:01.368567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661367 queuesize 0 startOffset 0
2025-10-10T14:31:01.368653Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:31:01.368786Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:31:01.368791Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T14:31:01.368795Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session: acknoledged message 1
Got new write session event: AcksEvent: { seqNo : 1, State : EES_WRITTEN, offset : 0, partitionId : 0 } write stat: Write time 0.001000s minimal time in partition queue 0.000000s maximal time in partition queue 0.000000s partition quoted time 0.000000s topic quoted time 0.000000s
2025-10-10T14:31:01.368943Z :INFO: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:31:01.368947Z :INFO: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:31:01.368968Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:31:01.369080Z :INFO: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:01.369084Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7e419819-8f312568-3bec24aa-e1e32a70_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:31:01.369253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|7e419819-8f312568-3bec24aa-e1e32a70_0 grpc read done: success: 0 data: 
2025-10-10T14:31:01.369261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|7e419819-8f312568-3bec24aa-e1e32a70_0 grpc read failed
2025-10-10T14:31:01.369269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|7e419819-8f312568-3bec24aa-e1e32a70_0 grpc closed
2025-10-10T14:31:01.369272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|7e419819-8f312568-3bec24aa-e1e32a70_0 is DEAD
2025-10-10T14:31:01.369554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:01.369664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600550168022011:2484] destroyed
2025-10-10T14:31:01.369681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:01.369688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.369690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.369692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.402108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.402122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.402125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.502433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.502447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.502450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.854330Z :CloseWriteSessionImmediately INFO: Random seed for debugging is 1760106661854325
2025-10-10T14:31:01.905579Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559600549106958054:2086];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:01.905624Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:01.907130Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559600547048980934:2147];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:01.907195Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b44/r3tmp/tmpWtHl4d/pdisk_1.dat
2025-10-10T14:31:01.907855Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:01.908369Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:01.909463Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:01.910042Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:01.921901Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:01.924824Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [4:7559600547048980814:2073] 1760106661906589 != 1760106661906586
2025-10-10T14:31:01.925653Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:01.925670Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:01.926811Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:31:01.927066Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 7305, node 3
2025-10-10T14:31:01.933742Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b44/r3tmp/yandex9XGpp5.tmp
2025-10-10T14:31:01.933749Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b44/r3tmp/yandex9XGpp5.tmp
2025-10-10T14:31:01.933800Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b44/r3tmp/yandex9XGpp5.tmp
2025-10-10T14:31:01.933837Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:31:01.937008Z INFO: TTestServer started on Port 8531 GrpcPort 7305
TClient is connected to server localhost:8531
PQClient connected to localhost:7305
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:31:01.950881Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:31:02.007456Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:02.007488Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:02.008936Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:31:02.082098Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:02.087441Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:02.250124Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [4:7559600551343948440:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:02.250225Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=NTBjYzE5Ny0yNjI0ZDhmMy05OGQzYzA3Yi0xOTFhOTFlNw==, ActorId: [4:7559600551343948438:2288], ActorState: ExecuteState, TraceId: 01k778gjb69h639skg2pca10mg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:02.250377Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:02.262594Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [3:7559600553401926226:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:02.263068Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=ZjlhMmIxZTctYjYzZmM5YjctMzJkMDRlM2YtOGJkM2Q5Mjg=, ActorId: [3:7559600553401926223:2316], ActorState: ExecuteState, TraceId: 01k778gjbk0deayzb5h49az2wt, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:02.263170Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:02.264808Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:02.280106Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:02.301438Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:7305", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:31:02.335773Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k778gjdbd91pn70e30c7ccm7, Database: , SessionId: ydb://session/3?node_id=3&id=NzdiYjEzN2YtZDNiODI3NDQtNTkzZGY0YjQtOWNkODg4ZWE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559600553401926659:2924] 
2025-10-10T14:31:02.907361Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:02.908908Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:06.906083Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559600549106958054:2086];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:06.906113Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:06.907108Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559600547048980934:2147];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:06.907133Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:07.442833Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:7305
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:07.455646Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:7305
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:07.459850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:07.460042Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559600574876763711:3250] connected; active server actors: 1
2025-10-10T14:31:07.460204Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:07.460319Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:07.460327Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:07.460395Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:07.460414Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.460428Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:07.460452Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600574876763709:3249], now have 1 active actors on pipe
2025-10-10T14:31:07.460593Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-10T14:31:07.460615Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:07.460605Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.460617Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7559600572818785347:2370], now have 1 active actors on pipe
2025-10-10T14:31:07.461293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.465584Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600574876763778:3302], now have 1 active actors on pipe
2025-10-10T14:31:07.465649Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.466136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.466277Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:07.466296Z node 3 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:07.466344Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:07.466381Z node 3 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7559600574876763791:2447]
2025-10-10T14:31:07.466991Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.467003Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.467008Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7559600574876763791:2447]
2025-10-10T14:31:07.467014Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:07.467265Z node 3 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:07.467277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.467292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.467300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.467303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:07.467305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.467306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.467307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:07.467316Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.467375Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.467405Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:07.467958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.467989Z node 3 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106667515, TxId 281474976715677
2025-10-10T14:31:07.467997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.467999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.468018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.468055Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:07.468334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:07.468375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:07.468387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.468389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.468391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.468395Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:07.468479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:07.468500Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.468538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.469209Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.469230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:07.469483Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:07.475152Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k778gqe3d0msdmjwc3eerjth, Database: , SessionId: ydb://session/3?node_id=3&id=NGYyNzZlY2EtNTU4YmQxYi1kNjE3NjhmMC0xMDMzZWMxNg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1760106667515
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1760106667515
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:7305
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:07.479470Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:07.567624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.567643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.567646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.667973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.667992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.667995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.768305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.768317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.768319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.868675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.868693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.868696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.969007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.969023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.969027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:7305
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:07.980477Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:08.069376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.069391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.069394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.169718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.169738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.169741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.270069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.270084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.270086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.370430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.370451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.370454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.470741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.470753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.470755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:7305
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:08.481760Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:08.482649Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:08.482830Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:08.482833Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:7305
2025-10-10T14:31:08.483068Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:08.483153Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.483172Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:08.483311Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:08.483335Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:53674
2025-10-10T14:31:08.483340Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53674 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.483342Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.483604Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:08.483625Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.483630Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.483631Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.483635Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600579171731285:2485] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.484053Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600579171731285:2485] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.498066Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600579171731285:2485] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:08.498202Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579171731316:2485] connected; active server actors: 1
2025-10-10T14:31:08.498316Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600579171731285:2485] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:08.498325Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600579171731285:2485] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.498407Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579171731316:2485] disconnected; active server actors: 1
2025-10-10T14:31:08.498415Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600579171731316:2485] disconnected no session
2025-10-10T14:31:08.512293Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600579171731285:2485] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.512309Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600579171731285:2485] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:08.512312Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600579171731285:2485] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.512320Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.512447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:08.512463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600579171731331:2485], now have 1 active actors on pipe
2025-10-10T14:31:08.512473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.512478Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.512501Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|4304867a-5b2ee84-739deb4c-3a160ac4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:08.512512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.512518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.512520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.512537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.512550Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.512565Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.512597Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.512600Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.512608Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.512635Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|4304867a-5b2ee84-739deb4c-3a160ac4_0
2025-10-10T14:31:08.512967Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106668512 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:08.512995Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|4304867a-5b2ee84-739deb4c-3a160ac4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.513082Z :INFO: [] MessageGroupId [src] SessionId [src|4304867a-5b2ee84-739deb4c-3a160ac4_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:08.513090Z :INFO: [] MessageGroupId [src] SessionId [src|4304867a-5b2ee84-739deb4c-3a160ac4_0] Write session will now close
2025-10-10T14:31:08.513094Z :DEBUG: [] MessageGroupId [src] SessionId [src|4304867a-5b2ee84-739deb4c-3a160ac4_0] Write session: aborting
2025-10-10T14:31:08.513202Z :INFO: [] MessageGroupId [src] SessionId [src|4304867a-5b2ee84-739deb4c-3a160ac4_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:08.513206Z :DEBUG: [] MessageGroupId [src] SessionId [src|4304867a-5b2ee84-739deb4c-3a160ac4_0] Write session: destroy
2025-10-10T14:31:08.513311Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|4304867a-5b2ee84-739deb4c-3a160ac4_0 grpc read done: success: 0 data: 
2025-10-10T14:31:08.513319Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|4304867a-5b2ee84-739deb4c-3a160ac4_0 grpc read failed
2025-10-10T14:31:08.513325Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|4304867a-5b2ee84-739deb4c-3a160ac4_0 grpc closed
2025-10-10T14:31:08.513338Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|4304867a-5b2ee84-739deb4c-3a160ac4_0 is DEAD
2025-10-10T14:31:08.513552Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:08.513588Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600579171731331:2485] destroyed
2025-10-10T14:31:08.513601Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:08.513609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.513611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.513613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:31:08.571134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.571151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.571154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.671503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.671521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.671524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.771827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.771843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.771846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.872201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.872217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.872221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:30:59.485621Z :FallbackToSingleDb INFO: Random seed for debugging is 1760106659485616
2025-10-10T14:30:59.567979Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600541153188579:2156];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.568014Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:59.571044Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:59.571688Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600541760328533:2156];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.571743Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b23/r3tmp/tmp18t87p/pdisk_1.dat
2025-10-10T14:30:59.573071Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:59.596283Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:59.597484Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:59.599172Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 26273, node 1
2025-10-10T14:30:59.611304Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b23/r3tmp/yandexIhWTyc.tmp
2025-10-10T14:30:59.611313Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b23/r3tmp/yandexIhWTyc.tmp
2025-10-10T14:30:59.611372Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b23/r3tmp/yandexIhWTyc.tmp
2025-10-10T14:30:59.611403Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:59.615033Z INFO: TTestServer started on Port 22267 GrpcPort 26273
TClient is connected to server localhost:22267
PQClient connected to localhost:26273
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:59.669198Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:59.669230Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:59.670630Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:59.673066Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:30:59.673358Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:59.673377Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:59.674404Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
waiting...
2025-10-10T14:30:59.674574Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
2025-10-10T14:30:59.833828Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:59.848540Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:59.910753Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600541153189384:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:59.911030Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600541760328718:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:59.911103Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=M2QxNmQyY2ItZjg1MGVlYmEtMzJhNmNlZDgtNTYwNTIyMGY=, ActorId: [2:7559600541760328716:2288], ActorState: ExecuteState, TraceId: 01k778gg0y7xjfgnzzdj7shbd6, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:59.911349Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=MzVjYTc1NmUtZmRjZjAzNTAtZDNiMDUyY2MtYjE2ODJlZTk=, ActorId: [1:7559600541153189381:2316], ActorState: ExecuteState, TraceId: 01k778gg1k0eqr2fhen2r5e9nz, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:59.911528Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:59.911528Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:59.916961Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:59.935452Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:59.954225Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:26273", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:59.989394Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gg41dxw59pb0xbnh8sht, Database: , SessionId: ydb://session/3?node_id=1&id=YzQzZmUxMjgtMWJhNzM1NWQtYTkzOGIzOTgtZWI5YTA3MDc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600541153189761:2883] 
2025-10-10T14:31:00.570166Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:00.572730Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:04.568364Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600541153188579:2156];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:04.568390Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:04.571963Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600541760328533:2156];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:04.571999Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:05.109017Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:26273
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:05.127385Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:26273
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:05.133250Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600566922994048:3179] connected; active server actors: 1
2025-10-10T14:31:05.133364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:05.133506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:05.133812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:05.136495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:05.137124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:05.137168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:05.137175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.137187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:05.137281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600566922994045:3177], now have 1 active actors on pipe
2025-10-10T14:31:05.137292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600566922994068:2437], now have 1 active actors on pipe
2025-10-10T14:31:05.137377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:05.137475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:05.138482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:05.140160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600566922994104:3224], now have 1 active actors on pipe
2025-10-10T14:31:05.140268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:05.141036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:05.141243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:05.141276Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:05.141353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:05.141416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600567530133042:2381]
2025-10-10T14:31:05.142053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:05.142060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:05.142064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600567530133042:2381]
2025-10-10T14:31:05.142069Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:05.142349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:05.142358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.142381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.142386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:05.142388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:05.142390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.142391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.142392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:05.142401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:05.142506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:05.142529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:05.143347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:05.143378Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106665184, TxId 281474976720677
2025-10-10T14:31:05.143387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.143389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.143420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.143473Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:05.143998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:05.144052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:05.144063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.144069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.144070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.144074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:05.144171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:05.144190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.144226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:05.145190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:05.145213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:05.145373Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gn5c9gfjm25z1wy3m3bt, Database: , SessionId: ydb://session/3?node_id=1&id=NzE4OGFlZDAtMzMxNWNmOGEtZGZlN2M1NDktZDY5Njk5YQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T14:31:05.145654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106665184
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106665184
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:26273
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:05.150653Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:05.242652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.242665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.242667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.343014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.343025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.343027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.443382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.443394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.443397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.543744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.543755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.543757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.644087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.644100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.644102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:26273
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:05.651802Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:05.744439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.744450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.744452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.844817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.844830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.844832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.945144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.945160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.945162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.045511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.045523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.045525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.145811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.145822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.145824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:26273
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:06.153562Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:06.154721Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:06.154951Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:06.154957Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:26273
2025-10-10T14:31:06.155424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:06.155443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:06.156734Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:06.156945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:06.157004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:49040
2025-10-10T14:31:06.157015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49040 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:06.157020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:06.157492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:06.157546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:06.157552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:06.157554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:06.157559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600571217961565:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:06.158160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600571217961565:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:06.178801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600571217961565:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:06.178864Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600571217961596:2471] connected; active server actors: 1
2025-10-10T14:31:06.178885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600571217961565:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:06.178890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600571217961565:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:06.178943Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600571217961596:2471] disconnected; active server actors: 1
2025-10-10T14:31:06.178949Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600571217961596:2471] disconnected no session
2025-10-10T14:31:06.191573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600571217961565:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:06.191588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600571217961565:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:06.191590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600571217961565:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:06.191597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:06.191849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:06.191842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600571217961614:2471], now have 1 active actors on pipe
2025-10-10T14:31:06.191931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.191945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.191985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|e39438e8-38354871-58ab6d28-59262a8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:06.192001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.192012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.192015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:06.192030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.192048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:06.192073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.192261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.192269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.192285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.192379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|e39438e8-38354871-58ab6d28-59262a8e_0
2025-10-10T14:31:06.192666Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106666192 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:06.192708Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|e39438e8-38354871-58ab6d28-59262a8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:06.192853Z :INFO: [] MessageGroupId [src] SessionId [src|e39438e8-38354871-58ab6d28-59262a8e_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:06.192862Z :INFO: [] MessageGroupId [src] SessionId [src|e39438e8-38354871-58ab6d28-59262a8e_0] Write session will now close
2025-10-10T14:31:06.192868Z :DEBUG: [] MessageGroupId [src] SessionId [src|e39438e8-38354871-58ab6d28-59262a8e_0] Write session: aborting
2025-10-10T14:31:06.192990Z :INFO: [] MessageGroupId [src] SessionId [src|e39438e8-38354871-58ab6d28-59262a8e_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:06.192994Z :DEBUG: [] MessageGroupId [src] SessionId [src|e39438e8-38354871-58ab6d28-59262a8e_0] Write session: destroy
2025-10-10T14:31:06.193111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|e39438e8-38354871-58ab6d28-59262a8e_0 grpc read done: success: 0 data: 
2025-10-10T14:31:06.193126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|e39438e8-38354871-58ab6d28-59262a8e_0 grpc read failed
2025-10-10T14:31:06.193135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|e39438e8-38354871-58ab6d28-59262a8e_0 grpc closed
2025-10-10T14:31:06.193141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|e39438e8-38354871-58ab6d28-59262a8e_0 is DEAD
2025-10-10T14:31:06.193464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:06.193601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600571217961614:2471] destroyed
2025-10-10T14:31:06.193616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:06.193622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.193624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.193626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:31:06.195916Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-10T14:31:06.195946Z :INFO: [/Root] [] [8a9ca571-b15bb783-c901d069-fa591da5] Open read subsessions to databases: { name: , endpoint: localhost:26273, path: /Root }
2025-10-10T14:31:06.195986Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Starting read session
2025-10-10T14:31:06.195989Z :DEBUG: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Starting single session
2025-10-10T14:31:06.196142Z :DEBUG: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:06.196145Z :DEBUG: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:06.196148Z :DEBUG: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:06.197021Z :DEBUG: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] [] Successfully connected. Initializing session
2025-10-10T14:31:06.197134Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:06.197143Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:31:06.198615Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:06.198677Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 read init: from# ipv6:[::1]:49064, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:06.198754Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 auth for : user
2025-10-10T14:31:06.198899Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 Handle describe topics response
2025-10-10T14:31:06.198924Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 auth is DEAD
2025-10-10T14:31:06.198940Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:06.199161Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:06.199235Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600571217961622:2484] connected; active server actors: 1
2025-10-10T14:31:06.199262Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] [] Got InitResponse. ReadSessionId: shared/user_1_1_11055602088136784051_v1
2025-10-10T14:31:06.199260Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600571217961622:2484] session shared/user_1_1_11055602088136784051_v1
2025-10-10T14:31:06.199274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:31:06.199270Z :DEBUG: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:06.199284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:31:06.199292Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_11055602088136784051_v1" (Sender=[1:7559600571217961619:2484], Pipe=[1:7559600571217961622:2484], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:06.199295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:06.199305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:31:06.199313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_11055602088136784051_v1" (Sender=[1:7559600571217961619:2484], Pipe=[1:7559600571217961622:2484], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:06.199338Z :DEBUG: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:06.199321Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_11055602088136784051_v1" sender [1:7559600571217961619:2484] lock partition 0 for ReadingSession "shared/user_1_1_11055602088136784051_v1" (Sender=[1:7559600571217961619:2484], Pipe=[1:7559600571217961622:2484], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:31:06.199333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:31:06.199336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000026s
2025-10-10T14:31:06.199533Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_11055602088136784051_v1" ClientId: "user" PipeClient { RawX1: 7559600571217961622 RawX2: 4503603922340276 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:06.199550Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:31:06.199567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:06.199612Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 got read request: guid# d48f546e-20f2b2b4-aef37f7e-9cd4be9a
2025-10-10T14:31:06.199725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600571217961625:2487], now have 1 active actors on pipe
2025-10-10T14:31:06.199788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559600571217961625:2487]
2025-10-10T14:31:06.199870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.199881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.199894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_11055602088136784051_v1 on pipe: [1:7559600571217961625:2487]
2025-10-10T14:31:06.199919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.199928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.199930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:06.199934Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_11055602088136784051_v1:1 with generation 1
2025-10-10T14:31:06.199968Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_11055602088136784051_v1
2025-10-10T14:31:06.199975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.200006Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:06.200916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:06.200945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:06.200954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.200961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.200963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.200968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:06.200978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:06.201081Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106666193 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:06.201094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:31:06.201123Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name:  Database path: /Root Database id:  CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:31:06.201446Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-10T14:31:06.201526Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Closing read session. Close timeout: 0.010000s
2025-10-10T14:31:06.201533Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:31:06.201538Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 5 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:06.201745Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:06.201751Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:31:06.201755Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 5 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:06.201760Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:06.201762Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:31:06.201765Z :INFO: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 5 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:06.201789Z :NOTICE: [/Root] [/Root] [6ecb788-d69c1336-ce791eca-9a0753c0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:06.201792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_11055602088136784051_v1
2025-10-10T14:31:06.201810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600571217961625:2487] destroyed
2025-10-10T14:31:06.201821Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_11055602088136784051_v1
2025-10-10T14:31:06.201628Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:31:06.201643Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:31:06.201652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:31:06.201657Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:31:06.201715Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 grpc closed
2025-10-10T14:31:06.201731Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_11055602088136784051_v1 is DEAD
2025-10-10T14:31:06.201937Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600571217961622:2484] disconnected; active server actors: 1
2025-10-10T14:31:06.201939Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600571217961622:2484] client user disconnected session shared/user_1_1_11055602088136784051_v1
2025-10-10T14:31:06.246207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.246219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.246221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.346564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.346585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.346587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.661175Z :FallbackToSingleDbAfterBadRequest INFO: Random seed for debugging is 1760106666661169
2025-10-10T14:31:06.709760Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559600567947131527:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:06.709835Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:06.710821Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559600569053760046:2077];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:06.711049Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b23/r3tmp/tmpOy8RZK/pdisk_1.dat
2025-10-10T14:31:06.712413Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:06.712815Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:06.713088Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:06.713133Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:06.726545Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:06.730550Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:06.730570Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:06.731909Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:31:06.732117Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 26430, node 3
2025-10-10T14:31:06.738297Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b23/r3tmp/yandexT3TJ7x.tmp
2025-10-10T14:31:06.738308Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b23/r3tmp/yandexT3TJ7x.tmp
2025-10-10T14:31:06.738370Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b23/r3tmp/yandexT3TJ7x.tmp
2025-10-10T14:31:06.738418Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:31:06.741079Z INFO: TTestServer started on Port 29133 GrpcPort 26430
TClient is connected to server localhost:29133
PQClient connected to localhost:26430
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:31:06.753155Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:31:06.811632Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:06.811657Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:06.813180Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:31:06.884159Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:06.895713Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:07.018637Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [3:7559600572242099635:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:07.019326Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=ODhkYTI1OGItYzgyM2M5MDQtN2VlOTA3ZmUtODdjODFiYzM=, ActorId: [3:7559600572242099632:2316], ActorState: ExecuteState, TraceId: 01k778gq067nh562eb4wm59b3j, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:07.019431Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:07.022413Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:07.036112Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:07.046382Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [4:7559600573348727664:2291], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:07.046451Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=MzdkZTZhZTMtODhmZDk0ZmItNGYzOTAzYTYtMjQ3NTU4MTg=, ActorId: [4:7559600573348727660:2290], ActorState: ExecuteState, TraceId: 01k778gq12e3vh8s45aanp1r30, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:07.046556Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:07.056986Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:26430", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:31:07.096701Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k778gq2029hxn73r2t9qfqhg, Database: , SessionId: ydb://session/3?node_id=3&id=ZDc4NjE3YmEtMjk1OTI2Ny0yNjUxNzA2NS1hMDU4YjhjMg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559600572242100067:2930] 
2025-10-10T14:31:07.712014Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:07.712549Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:11.709732Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559600567947131527:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:11.709764Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:11.710793Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559600569053760046:2077];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:11.710832Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:12.224376Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:26430
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:12.236708Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:26430
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:12.241482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:12.241758Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559600593716937121:3258] connected; active server actors: 1
2025-10-10T14:31:12.241798Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:12.241835Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:12.241847Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.241857Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:12.241876Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600593716937120:3257], now have 1 active actors on pipe
2025-10-10T14:31:12.241893Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:12.241958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:12.241970Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:12.242201Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7559600594823564533:2371], now have 1 active actors on pipe
2025-10-10T14:31:12.242230Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-10T14:31:12.242342Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:12.242626Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:12.246756Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600593716937191:3313], now have 1 active actors on pipe
2025-10-10T14:31:12.246803Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:12.247321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:12.247439Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:12.247450Z node 3 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:12.247487Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:12.247532Z node 3 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7559600593716937203:2449]
2025-10-10T14:31:12.248007Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:12.248016Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:12.248021Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7559600593716937203:2449]
2025-10-10T14:31:12.248028Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:12.248223Z node 3 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:12.248231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.248242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.248247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:12.248249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:12.248250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.248251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.248253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:12.248257Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:12.248315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:12.248337Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:12.248961Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:12.248987Z node 3 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106672296, TxId 281474976715677
2025-10-10T14:31:12.248995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.248996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.249010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.249034Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:12.249344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:12.249361Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-10T14:31:12.249385Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:12.249394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.249397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.249398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.249401Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:12.249475Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:12.249488Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.249522Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:12.250123Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:12.250140Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:12.250411Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:12.256305Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k778gw3g6bm0s1tdtx1jg7fd, Database: , SessionId: ydb://session/3?node_id=3&id=OTVjODU3ZDktYzdlM2U5MDItNGNhYTA0ZmEtMTk5ZGNiZTc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1760106672296
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1760106672296
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:26430
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:12.261487Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:12.348246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.348265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.348269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.448608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.448626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.448629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.548936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.548955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.548958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.649263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.649285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.649288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.749623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.749642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.749644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:26430
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:12.762559Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:12.849991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.850009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.850014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.950384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.950405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.950409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.050676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.050696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.050699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.151046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.151061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.151064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.251362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.251375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.251376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:26430
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:13.263833Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:13.264821Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:13.265027Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:13.265032Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:26430
2025-10-10T14:31:13.265275Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:13.265416Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:13.265433Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:13.265567Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:13.265599Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:41728
2025-10-10T14:31:13.265603Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41728 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:13.265606Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:13.265945Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:13.265970Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:13.265977Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:13.265979Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:13.265984Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600598011904692:2485] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:13.266524Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600598011904692:2485] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:13.282452Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600598011904692:2485] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:13.282555Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600598011904723:2485] connected; active server actors: 1
2025-10-10T14:31:13.282621Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600598011904692:2485] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:13.282629Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600598011904692:2485] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:13.282695Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600598011904723:2485] disconnected; active server actors: 1
2025-10-10T14:31:13.282700Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600598011904723:2485] disconnected no session
2025-10-10T14:31:13.296480Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600598011904692:2485] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:13.296496Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600598011904692:2485] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:13.296499Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600598011904692:2485] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:13.296508Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:13.296652Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:13.296672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600598011904737:2485], now have 1 active actors on pipe
2025-10-10T14:31:13.296680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.296686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.296712Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|1e5627b1-65859934-8a972e87-a7040f42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:13.296728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.296735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.296738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:13.296750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.296767Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:13.296788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.296830Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.296837Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.296847Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.296870Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|1e5627b1-65859934-8a972e87-a7040f42_0
2025-10-10T14:31:13.297213Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106673297 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:13.297240Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|1e5627b1-65859934-8a972e87-a7040f42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:13.297326Z :INFO: [] MessageGroupId [src] SessionId [src|1e5627b1-65859934-8a972e87-a7040f42_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:13.297352Z :INFO: [] MessageGroupId [src] SessionId [src|1e5627b1-65859934-8a972e87-a7040f42_0] Write session will now close
2025-10-10T14:31:13.297357Z :DEBUG: [] MessageGroupId [src] SessionId [src|1e5627b1-65859934-8a972e87-a7040f42_0] Write session: aborting
2025-10-10T14:31:13.297479Z :INFO: [] MessageGroupId [src] SessionId [src|1e5627b1-65859934-8a972e87-a7040f42_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:13.297483Z :DEBUG: [] MessageGroupId [src] SessionId [src|1e5627b1-65859934-8a972e87-a7040f42_0] Write session: destroy
2025-10-10T14:31:13.297612Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|1e5627b1-65859934-8a972e87-a7040f42_0 grpc read done: success: 0 data: 
2025-10-10T14:31:13.297619Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|1e5627b1-65859934-8a972e87-a7040f42_0 grpc read failed
2025-10-10T14:31:13.297626Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|1e5627b1-65859934-8a972e87-a7040f42_0 grpc closed
2025-10-10T14:31:13.297630Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|1e5627b1-65859934-8a972e87-a7040f42_0 is DEAD
PORTS 26430 2906
2025-10-10T14:31:13.297864Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:13.297906Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600598011904737:2485] destroyed
2025-10-10T14:31:13.297919Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:13.297923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.297925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.297927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:31:13.351771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.351789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.351792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.452094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.452109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.452112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.552451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.552466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.552468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.652814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.652831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.652834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.753148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.753164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.753167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.853516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.853533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.853536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.953830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.953849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.953852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.054211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.054228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.054230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.154576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.154597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.154601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.254918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.254939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.254942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:14.300781Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-10T14:31:14.300802Z :INFO: [/Root] [] [8de08a1a-f13a8061-e1151298-f9c83c50] Open read subsessions to databases: { name: , endpoint: localhost:2906, path: /Root }
2025-10-10T14:31:14.300845Z :INFO: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Starting read session
2025-10-10T14:31:14.300850Z :DEBUG: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Starting single session
2025-10-10T14:31:14.301049Z :DEBUG: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:14.301053Z :DEBUG: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:14.301056Z :DEBUG: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:14.301092Z :ERROR: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] [] Got error. Status: CLIENT_CALL_UNIMPLEMENTED. Description: <main>: Error: GRpc error: (12):  <main>: Error: Grpc error response on endpoint localhost:2906 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:2906. 
2025-10-10T14:31:14.301097Z :DEBUG: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:14.301098Z :DEBUG: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:14.301124Z :INFO: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] [] Closing session to cluster: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:2906" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:2906     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:2906. " }
2025-10-10T14:31:14.301198Z :NOTICE: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:14.301209Z :DEBUG: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] [] Abort session to cluster
Got new read session event: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:2906" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:2906     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:2906. " }
2025-10-10T14:31:14.301233Z :INFO: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Closing read session. Close timeout: 0.010000s
2025-10-10T14:31:14.301241Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:14.301246Z :INFO: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:14.301250Z :INFO: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:14.301251Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:14.301253Z :INFO: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:14.301256Z :INFO: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:14.301258Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:31:14.301263Z :INFO: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:14.301265Z :NOTICE: [/Root] [/Root] [b140203-ea3bb86c-3ce4df41-c14ca54b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:14.355274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.355292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.355296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.455619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.455634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.455636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:30:54.328463Z :GetAllStartPartitionSessions INFO: Random seed for debugging is 1760106654328458
2025-10-10T14:30:54.403286Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600516802546333:2087];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.403651Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:54.406471Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.406886Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600519089640590:2160];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.406932Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b56/r3tmp/tmpZ247sf/pdisk_1.dat
2025-10-10T14:30:54.408140Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.436624Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:54.443351Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:30:54.445610Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 19085, node 1
2025-10-10T14:30:54.458207Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b56/r3tmp/yandexWJb9um.tmp
2025-10-10T14:30:54.458218Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b56/r3tmp/yandexWJb9um.tmp
2025-10-10T14:30:54.458288Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b56/r3tmp/yandexWJb9um.tmp
2025-10-10T14:30:54.458330Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:54.462284Z INFO: TTestServer started on Port 15853 GrpcPort 19085
TClient is connected to server localhost:15853
PQClient connected to localhost:19085
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:54.505377Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.505405Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.507593Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:54.508700Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.508721Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.509843Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:30:54.510081Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:30:54.510130Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:30:54.665593Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.718077Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.813035Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600516802547216:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.813077Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.813128Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=YTlmZTUxNTEtYTBmOGQ3ZjYtNWIwOThjMGUtYzJkN2M1YWQ=, ActorId: [1:7559600516802547213:2316], ActorState: ExecuteState, TraceId: 01k778gb177cjfm7ppr5ty9p7p, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.813598Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.813785Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600519089640770:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.813851Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=YjllZTYzYTItMjk1MDA0ODQtZjJhMDliNTktYWZhMWJjN2I=, ActorId: [2:7559600519089640768:2288], ActorState: ExecuteState, TraceId: 01k778gb2nccav47fky0nn3zzh, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.813962Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.837304Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.856990Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:19085", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:54.902169Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gb4sbs77rtnqsp83etfx, Database: , SessionId: ydb://session/3?node_id=1&id=ZmE3NTliOTQtZDQ2YzkxY2MtNjIwZjc2YWQtZTRhMjkyYjY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600516802547596:2893] 
2025-10-10T14:30:55.404846Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:55.407933Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:59.403583Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600516802546333:2087];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.403629Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:30:59.407155Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600519089640590:2160];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.407179Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:30:59.998576Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 5 partitions
CallPersQueueGRPC request to localhost:19085
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.013658Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:19085
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 5
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:00.019112Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600542572351882:3187] connected; active server actors: 1
2025-10-10T14:31:00.019218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [1, 2, 3, 4, 0]
2025-10-10T14:31:00.019351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:00.019697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) (1, 72075186224037892) (2, 72075186224037892) (3, 72075186224037892) (4, 72075186224037892) 
2025-10-10T14:31:00.021868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:00.022389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:00.022429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:00.022439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.022448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:00.022533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542572351881:3186], now have 1 active actors on pipe
2025-10-10T14:31:00.022544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542572351900:2438], now have 1 active actors on pipe
2025-10-10T14:31:00.022574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:00.022747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.023618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.024698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600542572351936:3231], now have 1 active actors on pipe
2025-10-10T14:31:00.024788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.025569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.026138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.026159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.026162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.026165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.026168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.026184Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.026191Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][2][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.026194Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][3][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.026196Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.026198Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][4][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.026295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.026366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [2:7559600544859445092:2381]
2025-10-10T14:31:00.027104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.027113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:1:Initializer] Initializing completed.
2025-10-10T14:31:00.027118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 1 generation 1 [2:7559600544859445092:2381]
2025-10-10T14:31:00.027125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.027448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.027457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.027478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.027486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-10T14:31:00.027489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-10T14:31:00.027491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.027492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.027494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-10T14:31:00.027500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.027533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.027574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][2][StateInit] bootstrapping 2 [2:7559600544859445093:2381]
2025-10-10T14:31:00.028045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.028057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:2:Initializer] Initializing completed.
2025-10-10T14:31:00.028060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][2][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 2 generation 1 [2:7559600544859445093:2381]
2025-10-10T14:31:00.028064Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][2][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 2 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.028327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][2][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.028339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.028353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.028358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-10T14:31:00.028361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-10T14:31:00.028363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.028364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.028365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-10T14:31:00.028370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.028402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.028446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][3][StateInit] bootstrapping 3 [2:7559600544859445094:2381]
2025-10-10T14:31:00.028924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.028936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:3:Initializer] Initializing completed.
2025-10-10T14:31:00.028943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][3][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 3 generation 1 [2:7559600544859445094:2381]
2025-10-10T14:31:00.028947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][3][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 3 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.029143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][3][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.029151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.029163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.029165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-10T14:31:00.029166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-10T14:31:00.029167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.029168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.029169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-10T14:31:00.029173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.029199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.029223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][4][StateInit] bootstrapping 4 [2:7559600544859445095:2381]
2025-10-10T14:31:00.029579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.029586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:4:Initializer] Initializing completed.
2025-10-10T14:31:00.029588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][4][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 4 generation 1 [2:7559600544859445095:2381]
2025-10-10T14:31:00.029590Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][4][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 4 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.029716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][4][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.029722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.029731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.029733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-10T14:31:00.029736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-10T14:31:00.029737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.029738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.029738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-10T14:31:00.029741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.029764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.029788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600544859445096:2381]
2025-10-10T14:31:00.030091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.030096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:00.030098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600544859445096:2381]
2025-10-10T14:31:00.030100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.030224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.030230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.030237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.030238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:00.030240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.030241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.030243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.030244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.030246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.030323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.030359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.030382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.030417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.030453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.030468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.031144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.031168Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660074, TxId 281474976720677
2025-10-10T14:31:00.031174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.031233Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660074, TxId 281474976720677
2025-10-10T14:31:00.031235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.031255Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][2][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660074, TxId 281474976720677
2025-10-10T14:31:00.031256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.031273Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][3][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660074, TxId 281474976720677
2025-10-10T14:31:00.031275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.031293Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][4][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660074, TxId 281474976720677
2025-10-10T14:31:00.031296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.031328Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.031337Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.031339Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.031342Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.031345Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.031770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.031826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.031835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.031837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.031843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.031902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.031941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.031946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.031954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.031957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.031959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.031980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.031984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.031985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.031985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.031986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.031988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.032006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.032007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.032007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.032008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.032009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.032011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.032025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.032026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.032026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.032027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.032028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.032106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 5 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 2 PartitionIds: 3 PartitionIds: 4 PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:00.032118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.032144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.032882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.032898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.033309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.035871Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gg5h7bxt3hvt5cs2614z, Database: , SessionId: ydb://session/3?node_id=1&id=MjA4YmZjNzEtZGE1NzE4YWEtYTIxMzNkNmItZmNlOGIzMjM=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660074
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660074
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 2
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 3
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 4
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 5
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 5
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:19085
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.040900Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.127560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.127573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.127576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.128551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.128557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.128559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.129074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.129084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.129086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.130086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.130091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.130100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.130595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.130601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.130602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.227911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.227932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.227936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.228903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.228911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.228913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.229412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.229419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.229421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.230450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.230456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.230458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.230947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.230954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.230956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.328258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.328271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.328274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.329252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.329258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.329260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.329763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.329768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.329773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.330788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.330796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.330797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.331321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.331328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.331330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.428603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.428615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.428617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.429610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.429616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.429617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.430113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.430119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.430121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.431155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.431162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.431164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.431633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.431637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.431638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.528961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.528972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.528977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.529966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.529974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.529975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.530467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.530472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.530474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.531494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.531500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.531500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.532003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.532008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.532009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:19085
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.541870Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.629319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.629339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.629343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.630325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.630339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.630342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.630834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.630845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.630847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.631850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.631856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.631859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.632371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.632380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.632381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.729673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.729687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.729689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.730676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.730685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.730687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.731173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.731179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.731180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.732196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.732201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.732203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.732706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.732711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.732712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.830018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.830030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.830032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.831033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.831041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.831046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.831495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.831500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.831501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.832595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.832600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.832602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.833069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.833076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.833078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.930373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.930383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.930385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:00.931375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.931385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.931387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:00.931883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.931891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.931894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:00.932909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.932915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.932917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:00.933415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.933422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.933423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.030712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.030722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.030723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.031733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.031753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.031754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.032234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.032241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.032243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.033258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.033265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.033267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.033776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.033784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.033786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:19085
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.043087Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 5
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:01.043992Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:01.044188Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:01.044192Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:19085
2025-10-10T14:31:01.044573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.044585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:01.046236Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.046414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.046445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:38558
2025-10-10T14:31:01.046451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38558 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.046453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.046775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:01.046816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.046821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.046822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.046825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600546867319400:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.047186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600546867319400:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.068613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600546867319400:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.068697Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546867319432:2471] connected; active server actors: 1
2025-10-10T14:31:01.068715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600546867319400:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 4 from PQRB for SourceId=src
2025-10-10T14:31:01.068722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600546867319400:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.068765Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546867319432:2471] disconnected; active server actors: 1
2025-10-10T14:31:01.068775Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600546867319432:2471] disconnected no session
2025-10-10T14:31:01.085136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600546867319400:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.085151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600546867319400:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=4, SeqNo=(NULL)
2025-10-10T14:31:01.085154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600546867319400:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.085160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 4 expectedGeneration: (NULL)
2025-10-10T14:31:01.085353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600546867319450:2471], now have 1 active actors on pipe
2025-10-10T14:31:01.085401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=4) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.085482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.085496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-10T14:31:01.085526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0 generated for partition 4 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:01.085541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.085550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.085556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-10T14:31:01.085566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.085584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][4][StateIdle] TPartition::ReplyOwnerOk. Partition: 4
2025-10-10T14:31:01.085600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.085750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.085760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-10T14:31:01.085778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.085839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 4 MaxSeqNo: 0 sessionId: src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0
2025-10-10T14:31:01.086070Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661086 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.086093Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0" topic: "test-topic" cluster: "dc1" partition_id: 4 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:01.086180Z :INFO: [] MessageGroupId [src] SessionId [src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:01.086190Z :INFO: [] MessageGroupId [src] SessionId [src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0] Write session will now close
2025-10-10T14:31:01.086195Z :DEBUG: [] MessageGroupId [src] SessionId [src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0] Write session: aborting
2025-10-10T14:31:01.086302Z :INFO: [] MessageGroupId [src] SessionId [src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:01.086307Z :DEBUG: [] MessageGroupId [src] SessionId [src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0] Write session: destroy
2025-10-10T14:31:01.086423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0 grpc read done: success: 0 data: 
2025-10-10T14:31:01.086432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0 grpc read failed
2025-10-10T14:31:01.086437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0 grpc closed
2025-10-10T14:31:01.086442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|f1660701-4a1bee69-9ff74d7e-8c1a2b76_0 is DEAD
2025-10-10T14:31:01.086604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=4) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:01.086684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600546867319450:2471] destroyed
2025-10-10T14:31:01.086697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][4][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:01.086703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.086705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.086707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
Session was created
2025-10-10T14:31:01.131083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.131096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.131099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.132047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.132059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.132061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.132593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.132602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.132604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.133666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.133675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.133676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.134130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.134139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.134145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.231421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.231432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.231435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.232442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.232451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.232453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.232934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.232939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.232941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.233962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.233969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.233971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.234482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.234489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.234490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.331779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.331789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.331792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.332774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.332781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.332782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.333285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.333290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.333293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.334329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.334340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.334342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.334832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.334839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.334840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.432138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.432161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.432163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.433132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.433139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.433141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.433639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.433646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.433649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.434682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.434694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.434695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.435183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.435192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.435193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.532487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.532503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.532509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.533482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.533496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.533497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.533988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.533996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.533998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.535033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.535047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.535048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.535527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.535536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.535537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.632841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.632859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.632861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.633832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.633842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.633843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.634344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.634351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.634353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.635382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.635390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.635396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.635879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.635886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.635888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.733193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.733214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.733216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.734185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.734193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.734195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.734696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.734701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.734702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.735738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.735744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.735745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.736229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.736235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.736237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.833555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.833570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.833572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.834549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.834559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.834562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.835049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.835055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.835056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.836073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.836080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.836081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.836600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.836610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.836611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.933896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.933908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.933910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:01.934894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.934903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.934904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:01.935423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.935434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.935435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:01.936443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.936453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.936456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:01.936935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.936942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.936943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.034225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.034238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.034240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:02.035241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.035249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.035251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:02.035714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.035722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.035725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:02.036801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.036812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.036813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:02.037305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.037312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.037313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:02.089376Z :INFO: [/Root] [] [b520ff35-bac17a14-6c4069e5-d3cc1c68] Open read subsessions to databases: { name: dc1, endpoint: localhost:19085, path: /Root }, { name: dc2, endpoint: localhost:19085, path: /Root }
2025-10-10T14:31:02.091269Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Starting read session
2025-10-10T14:31:02.091278Z :DEBUG: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Starting single session
2025-10-10T14:31:02.091499Z :DEBUG: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:02.091505Z :DEBUG: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:02.091510Z :DEBUG: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:02.091962Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Starting read session
2025-10-10T14:31:02.091968Z :DEBUG: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Starting single session
2025-10-10T14:31:02.091982Z :DEBUG: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:02.091984Z :DEBUG: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:02.091986Z :DEBUG: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:02.134601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.134615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.134619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:02.135608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.135622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.135624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:02.136108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.136114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.136116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:02.137124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.137132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.137134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:02.137644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.137651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.137653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.150168Z :DEBUG: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] Successfully connected. Initializing session
2025-10-10T14:31:02.150167Z :DEBUG: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] Successfully connected. Initializing session
2025-10-10T14:31:02.150382Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:02.150396Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:31:02.150435Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:02.150436Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-10T14:31:02.151772Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:02.151794Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:02.151838Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 read init: from# ipv6:[::1]:55966, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:02.151849Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 read init: from# ipv6:[::1]:55966, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:02.151913Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 auth for : user
2025-10-10T14:31:02.151923Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 auth for : user
2025-10-10T14:31:02.152092Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 Handle describe topics response
2025-10-10T14:31:02.152101Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 Handle describe topics response
2025-10-10T14:31:02.152114Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 auth is DEAD
2025-10-10T14:31:02.152124Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 auth is DEAD
2025-10-10T14:31:02.152128Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:02.152147Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:02.152331Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:02.152383Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:02.152442Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600551162286818:2496] connected; active server actors: 1
2025-10-10T14:31:02.152464Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600551162286818:2496] session shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.152489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:31:02.152506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:31:02.152515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 1
2025-10-10T14:31:02.152519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-10-10T14:31:02.152522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 2
2025-10-10T14:31:02.152526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=3 (Status=Free, Partitions=[2])
2025-10-10T14:31:02.152529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 3
2025-10-10T14:31:02.152542Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] Got InitResponse. ReadSessionId: shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.152532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=4 (Status=Free, Partitions=[3])
2025-10-10T14:31:02.152554Z :DEBUG: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:02.152534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 4
2025-10-10T14:31:02.152538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=5 (Status=Free, Partitions=[4])
2025-10-10T14:31:02.152552Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_18383960915274775377_v1" (Sender=[1:7559600551162286812:2496], Pipe=[1:7559600551162286818:2496], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:02.152556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:02.152568Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] Got InitResponse. ReadSessionId: shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.152583Z :DEBUG: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:02.152564Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600551162286819:2497] connected; active server actors: 1
2025-10-10T14:31:02.152568Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600551162286819:2497] session shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.152572Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:02.152583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=5 [5 (4), 4 (3), 3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-10T14:31:02.152592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=5 (Status=Free, Partitions=[4]) for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:02.152605Z :DEBUG: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:02.152612Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 5 status Active partitions [4] session "shared/user_1_2_14429129026888266215_v1" sender [1:7559600551162286813:2497] lock partition 4 for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:31:02.152635Z :DEBUG: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:02.152631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_1_18383960915274775377_v1" (Sender=[1:7559600551162286812:2496], Pipe=[1:7559600551162286818:2496], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:02.152642Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_1_18383960915274775377_v1" sender [1:7559600551162286812:2496] lock partition 3 for ReadingSession "shared/user_1_1_18383960915274775377_v1" (Sender=[1:7559600551162286812:2496], Pipe=[1:7559600551162286818:2496], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-10T14:31:02.152648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=1)
2025-10-10T14:31:02.152653Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_2_14429129026888266215_v1" sender [1:7559600551162286813:2497] lock partition 2 for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=2) generation 1 step 3
2025-10-10T14:31:02.152659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_1_18383960915274775377_v1" (Sender=[1:7559600551162286812:2496], Pipe=[1:7559600551162286818:2496], Partitions=[], ActiveFamilyCount=1)
2025-10-10T14:31:02.152669Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_18383960915274775377_v1" sender [1:7559600551162286812:2496] lock partition 1 for ReadingSession "shared/user_1_1_18383960915274775377_v1" (Sender=[1:7559600551162286812:2496], Pipe=[1:7559600551162286818:2496], Partitions=[], ActiveFamilyCount=2) generation 1 step 4
2025-10-10T14:31:02.152674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=2)
2025-10-10T14:31:02.152679Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_14429129026888266215_v1" sender [1:7559600551162286813:2497] lock partition 0 for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=3) generation 1 step 5
2025-10-10T14:31:02.152685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-10T14:31:02.152691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000105s
2025-10-10T14:31:02.152860Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 assign: record# { Partition: 4 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_2_14429129026888266215_v1" ClientId: "user" PipeClient { RawX1: 7559600551162286819 RawX2: 4503603922340289 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:02.152886Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_2_14429129026888266215_v1" ClientId: "user" PipeClient { RawX1: 7559600551162286819 RawX2: 4503603922340289 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:02.152887Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 assign: record# { Partition: 3 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_1_18383960915274775377_v1" ClientId: "user" PipeClient { RawX1: 7559600551162286818 RawX2: 4503603922340288 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:02.152904Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_2_14429129026888266215_v1" ClientId: "user" PipeClient { RawX1: 7559600551162286819 RawX2: 4503603922340289 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:02.152916Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_1_18383960915274775377_v1" ClientId: "user" PipeClient { RawX1: 7559600551162286818 RawX2: 4503603922340288 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:02.152918Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:31:02.152925Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:31:02.152943Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 got read request: guid# 164527ac-eb5178f1-a6aa115b-480a2315
2025-10-10T14:31:02.152972Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 got read request: guid# 49db849c-c10f035b-55e7a215-4919d6aa
2025-10-10T14:31:02.152980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1)
2025-10-10T14:31:02.152992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1)
2025-10-10T14:31:02.153000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2)
2025-10-10T14:31:02.153001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2)
2025-10-10T14:31:02.153006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3)
2025-10-10T14:31:02.153177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600551162286829:2504], now have 1 active actors on pipe
2025-10-10T14:31:02.153197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600551162286830:2505], now have 1 active actors on pipe
2025-10-10T14:31:02.153210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559600551162286830:2505]
2025-10-10T14:31:02.153221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559600551162286829:2504]
2025-10-10T14:31:02.153223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559600551162286831:2506]
2025-10-10T14:31:02.153201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600551162286831:2506], now have 1 active actors on pipe
2025-10-10T14:31:02.153232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559600551162286828:2503]
2025-10-10T14:31:02.153205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600551162286828:2503], now have 1 active actors on pipe
2025-10-10T14:31:02.153209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600551162286827:2502], now have 1 active actors on pipe
2025-10-10T14:31:02.153272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559600551162286827:2502]
2025-10-10T14:31:02.153373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.153385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-10T14:31:02.153399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_18383960915274775377_v1 on pipe: [1:7559600551162286830:2505]
2025-10-10T14:31:02.153423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.153429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-10-10T14:31:02.153440Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_18383960915274775377_v1:2 with generation 1
2025-10-10T14:31:02.153443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_14429129026888266215_v1 on pipe: [1:7559600551162286829:2504]
2025-10-10T14:31:02.153451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.153453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.153457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_14429129026888266215_v1 on pipe: [1:7559600551162286831:2506]
2025-10-10T14:31:02.153460Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_14429129026888266215_v1:2 with generation 1
2025-10-10T14:31:02.153464Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_14429129026888266215_v1:3 with generation 1
2025-10-10T14:31:02.153464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.153467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-10-10T14:31:02.153472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_18383960915274775377_v1 on pipe: [1:7559600551162286828:2503]
2025-10-10T14:31:02.153475Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_18383960915274775377_v1:1 with generation 1
2025-10-10T14:31:02.153480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.153483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-10T14:31:02.153487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_14429129026888266215_v1 on pipe: [1:7559600551162286827:2502]
2025-10-10T14:31:02.153490Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_14429129026888266215_v1:1 with generation 1
2025-10-10T14:31:02.153502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.153514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.153520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-10T14:31:02.153554Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.153560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:02.153593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.153599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.153601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-10T14:31:02.153610Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user session is set to 0 (startOffset 0) session shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.153615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:02.153630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.153637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.153639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.153648Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.153654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.153667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.153674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.153676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-10T14:31:02.153683Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user session is set to 0 (startOffset 0) session shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.153686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:02.153700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.153706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.153708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-10T14:31:02.153716Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user session is set to 0 (startOffset 0) session shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.153722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:02.153735Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:02.153747Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:02.153755Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:02.153758Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:02.153766Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:02.155003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:02.155047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:02.155058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.155067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.155069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:31:02.155087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-10T14:31:02.155099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:02.155113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:02.155120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.155121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.155123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:31:02.155126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-10T14:31:02.155129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:02.155141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:02.155146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.155147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.155148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.155150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:02.155153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:02.155165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:02.155172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.155174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.155175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:31:02.155178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-10T14:31:02.155182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:02.155196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:02.155203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.155205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.155206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:31:02.155209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-10T14:31:02.155229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:02.155249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:02.155259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:02.155265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:02.155276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:02.155329Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106662135 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:02.155329Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106662134 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:02.155338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:31:02.155343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:31:02.155354Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106662137 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:02.155356Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 sending to client partition status
2025-10-10T14:31:02.155356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:31:02.155364Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106662136 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:02.155366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:31:02.155373Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106662137 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:02.155375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:31:02.155387Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 sending to client partition status
2025-10-10T14:31:02.155424Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 sending to client partition status
2025-10-10T14:31:02.155433Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 sending to client partition status
2025-10-10T14:31:02.155448Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 1 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:31:02.155690Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 1. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 2 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:31:02.155752Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 2. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 3 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:31:02.155771Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 3. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:31:02.155781Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-10T14:31:02.155852Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
Got new read session event: 2025-10-10T14:31:02.155889Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2), readOffset# 0, commitOffset# (empty maybe)
StartPartitionSession { Partition session id: 3 Topic: "test-topic" Partition: 4 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:31:02.155908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:31:02.155913Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:31:02.155915Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] [] Confirm partition stream create. Partition stream id: 3. Cluster: "-". Topic: "test-topic". Partition: 4. Read offset: (NULL)
2025-10-10T14:31:02.155929Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-10-10T14:31:02.155939Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:31:02.155948Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:31:02.155958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:31:02.155960Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:31:02.155972Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:31:02.155984Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 3 } }
2025-10-10T14:31:02.155984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:31:02.156002Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:31:02.156010Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:31:02.156016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:31:02.156021Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Closing read session. Close timeout: 0.010000s
2025-10-10T14:31:02.156020Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:31:02.156036Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-10-10T14:31:02.156043Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Counters: { Errors: 0 CurrentSessionLifetimeMs: 64 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.156078Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:31:02.156136Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:31:02.156153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:31:02.156156Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:31:02.156303Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Closing read session. Close timeout: 0.010000s
2025-10-10T14:31:02.156312Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:4:3:0:0 -:test-topic:0:2:0:0 -:test-topic:2:1:0:0
2025-10-10T14:31:02.156316Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 64 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.156294Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:31:02.156303Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 grpc read failed
2025-10-10T14:31:02.156307Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 grpc closed
2025-10-10T14:31:02.156318Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_18383960915274775377_v1 is DEAD
2025-10-10T14:31:02.156421Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:02.156426Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-10-10T14:31:02.156429Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Counters: { Errors: 0 CurrentSessionLifetimeMs: 65 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.156432Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:02.156435Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:4:3:0:0 -:test-topic:0:2:0:0 -:test-topic:2:1:0:0
2025-10-10T14:31:02.156438Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 64 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.156443Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:02.156446Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:4:3:0:0 -:test-topic:0:2:0:0 -:test-topic:2:1:0:0
2025-10-10T14:31:02.156449Z :INFO: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 64 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.156464Z :NOTICE: [/Root] [/Root] [1ce61dd6-f37c6c74-cc2923d8-f5196ecb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:02.156485Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Closing read session. Close timeout: 0.000000s
2025-10-10T14:31:02.156450Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600551162286818:2496] disconnected; active server actors: 1
2025-10-10T14:31:02.156460Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600551162286818:2496] client user disconnected session shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.156476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:02.156490Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:1:1:0:0
2025-10-10T14:31:02.156526Z :INFO: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Counters: { Errors: 0 CurrentSessionLifetimeMs: 65 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:02.156531Z :NOTICE: [/Root] [/Root] [87482312-f563753a-c80ffa82-f2cea557] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:02.156491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=5, UnradableFamilies=2 [2 (1), 4 (3), ], RequireBalancing=0 []
2025-10-10T14:31:02.156502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=3)
2025-10-10T14:31:02.156511Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_2_14429129026888266215_v1" sender [1:7559600551162286813:2497] lock partition 3 for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=4) generation 1 step 6
2025-10-10T14:31:02.156520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=4)
2025-10-10T14:31:02.156558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.156524Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_2_14429129026888266215_v1" sender [1:7559600551162286813:2497] lock partition 1 for ReadingSession "shared/user_1_2_14429129026888266215_v1" (Sender=[1:7559600551162286813:2497], Pipe=[1:7559600551162286819:2497], Partitions=[], ActiveFamilyCount=5) generation 1 step 7
2025-10-10T14:31:02.156573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600551162286830:2505] destroyed
2025-10-10T14:31:02.156578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.156528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=1, desiredFamilyCount=5, allowPlusOne=0
2025-10-10T14:31:02.156580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600551162286828:2503] destroyed
2025-10-10T14:31:02.156533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000039s
2025-10-10T14:31:02.156589Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.156582Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 assign: record# { Partition: 3 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_2_14429129026888266215_v1" ClientId: "user" PipeClient { RawX1: 7559600551162286819 RawX2: 4503603922340289 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:02.156594Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_18383960915274775377_v1
2025-10-10T14:31:02.156597Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:31:02.156599Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 grpc read failed
2025-10-10T14:31:02.156603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:4)
2025-10-10T14:31:02.156619Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_2_14429129026888266215_v1" ClientId: "user" PipeClient { RawX1: 7559600551162286819 RawX2: 4503603922340289 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:02.156622Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 grpc closed
2025-10-10T14:31:02.156625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:5)
2025-10-10T14:31:02.156629Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_14429129026888266215_v1 is DEAD
2025-10-10T14:31:02.156720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.156729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600551162286831:2506] destroyed
2025-10-10T14:31:02.156731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.156733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600551162286829:2504] destroyed
2025-10-10T14:31:02.156734Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.156736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.156737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600551162286827:2502] destroyed
2025-10-10T14:31:02.156755Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.156758Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.156870Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600551162286819:2497] disconnected; active server actors: 1
2025-10-10T14:31:02.156877Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600551162286819:2497] client user disconnected session shared/user_1_2_14429129026888266215_v1
2025-10-10T14:31:02.491233Z :PreferredDatabaseNoFallback INFO: Random seed for debugging is 1760106662491227
2025-10-10T14:31:02.544949Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559600553231893992:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:02.544978Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:02.546318Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559600552890074112:2145];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:02.546348Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:31:02.546487Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:02.546649Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b56/r3tmp/tmpGweaMg/pdisk_1.dat
2025-10-10T14:31:02.547906Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:31:02.547982Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:31:02.558999Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:02.561568Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [4:7559600552890073996:2073] 1760106662545583 != 1760106662545580
2025-10-10T14:31:02.562511Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:02.562533Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:02.563624Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:31:02.563790Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 13593, node 3
2025-10-10T14:31:02.569075Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b56/r3tmp/yandexundqDP.tmp
2025-10-10T14:31:02.569083Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b56/r3tmp/yandexundqDP.tmp
2025-10-10T14:31:02.569125Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b56/r3tmp/yandexundqDP.tmp
2025-10-10T14:31:02.569174Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:31:02.571494Z INFO: TTestServer started on Port 26135 GrpcPort 13593
TClient is connected to server localhost:26135
PQClient connected to localhost:13593
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:31:02.646259Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:31:02.646288Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:31:02.647697Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:31:02.647903Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:31:02.734474Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:02.774999Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:31:02.877200Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [4:7559600552890074329:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:02.877310Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=4&id=ZTZhMzZmNDYtZmQ1NmEzNDItZDU1Mjc4NmItZjQzZDJiZTY=, ActorId: [4:7559600552890074327:2288], ActorState: ExecuteState, TraceId: 01k778gjysd2ad47q5fa8pbmf8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:02.877495Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:02.889345Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [3:7559600553231894794:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:31:02.889826Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=OGI5OGFiZDctMzE5MWFkN2YtZWJlNjY5Ny0yZGU1ZGMw, ActorId: [3:7559600553231894791:2316], ActorState: ExecuteState, TraceId: 01k778gjz52yhsznfafahbdjp8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:31:02.889919Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:31:02.890673Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:02.904400Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:31:02.923570Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:13593", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:31:02.954595Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gk0r3x3q5dx2rzj7ap96, Database: , SessionId: ydb://session/3?node_id=3&id=M2EyZGY2MWQtYWE0MmFiZTYtNzFiZTI5MjQtMjY4ZjYwZTk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559600553231895216:2910] 
2025-10-10T14:31:03.546170Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:03.547723Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:31:07.544863Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559600553231893992:2152];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:07.544901Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:31:07.546424Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559600552890074112:2145];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:31:07.546460Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:08.058029Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:13593
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:08.068955Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13593
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:08.073859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.073931Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559600579001699547:3218] connected; active server actors: 1
2025-10-10T14:31:08.074268Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:08.074357Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:08.074401Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.074436Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:08.074447Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.074458Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:08.074508Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600579001699546:3217], now have 1 active actors on pipe
2025-10-10T14:31:08.074660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.074669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7559600578659878531:2370], now have 1 active actors on pipe
2025-10-10T14:31:08.074675Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-10T14:31:08.074698Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:08.075456Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.076501Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600579001699614:3270], now have 1 active actors on pipe
2025-10-10T14:31:08.076547Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.077458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.077596Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.077606Z node 3 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:08.077642Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.077678Z node 3 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7559600579001699626:2447]
2025-10-10T14:31:08.078157Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.078164Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.078167Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7559600579001699626:2447]
2025-10-10T14:31:08.078170Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:08.078337Z node 3 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:08.078345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.078364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.078369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.078372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:08.078373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.078374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.078374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:08.078379Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.078423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.078449Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:08.078983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.079009Z node 3 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106668124, TxId 281474976720677
2025-10-10T14:31:08.079022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.079026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.079042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.079070Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:08.079350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:08.079413Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-10T14:31:08.079457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:08.079466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.079471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.079472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.079476Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:08.079545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:08.079561Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.079594Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.080227Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.080240Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:08.080580Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:08.088573Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gr187r1ectedm17gr32m, Database: , SessionId: ydb://session/3?node_id=3&id=ZWRmNDEwMjQtZGJmMmNlNzctMmNkNGI1ZTEtZDBkNWRlZTg=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106668124
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106668124
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:13593
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:08.093362Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:08.178766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.178781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.178785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.279110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.279124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.279126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.379459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.379473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.379475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.479822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.479835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.479838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.580162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.580175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.580178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13593
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:08.594425Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:08.680529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.680545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.680548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.780869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.780881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.780884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.881212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.881224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.881225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.981584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.981599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.981600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.081913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.081924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.081926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13593
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:09.095866Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:09.096902Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:09.097135Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:09.097140Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:13593
2025-10-10T14:31:09.097450Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:09.097579Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.097591Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:09.097661Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:09.097684Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:44386
2025-10-10T14:31:09.097687Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:44386 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.097690Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.098039Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:09.098066Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.098073Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.098074Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.098077Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600583296667112:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.098647Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600583296667112:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.116997Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559600583296667112:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:09.117120Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600583296667151:2481] connected; active server actors: 1
2025-10-10T14:31:09.117243Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559600583296667112:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:09.117256Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559600583296667112:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.117358Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600583296667151:2481] disconnected; active server actors: 1
2025-10-10T14:31:09.117366Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559600583296667151:2481] disconnected no session
2025-10-10T14:31:09.134745Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559600583296667112:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.134760Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559600583296667112:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:09.134762Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559600583296667112:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.134768Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.134886Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:31:09.134901Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559600583296667166:2481], now have 1 active actors on pipe
2025-10-10T14:31:09.134907Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.134913Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.134941Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|3e6676bb-860e5d0c-df0097d4-20c75421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:09.134962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.134972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.134973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.134983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.134995Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.135012Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.135055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.135064Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.135075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.135099Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|3e6676bb-860e5d0c-df0097d4-20c75421_0
2025-10-10T14:31:09.135398Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106669135 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:09.135427Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|3e6676bb-860e5d0c-df0097d4-20c75421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.135534Z :INFO: [] MessageGroupId [src] SessionId [src|3e6676bb-860e5d0c-df0097d4-20c75421_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:09.135546Z :INFO: [] MessageGroupId [src] SessionId [src|3e6676bb-860e5d0c-df0097d4-20c75421_0] Write session will now close
2025-10-10T14:31:09.135555Z :DEBUG: [] MessageGroupId [src] SessionId [src|3e6676bb-860e5d0c-df0097d4-20c75421_0] Write session: aborting
2025-10-10T14:31:09.135695Z :INFO: [] MessageGroupId [src] SessionId [src|3e6676bb-860e5d0c-df0097d4-20c75421_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:09.135701Z :DEBUG: [] MessageGroupId [src] SessionId [src|3e6676bb-860e5d0c-df0097d4-20c75421_0] Write session: destroy
2025-10-10T14:31:09.135826Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|3e6676bb-860e5d0c-df0097d4-20c75421_0 grpc read done: success: 0 data: 
2025-10-10T14:31:09.135834Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|3e6676bb-860e5d0c-df0097d4-20c75421_0 grpc read failed
2025-10-10T14:31:09.135839Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|3e6676bb-860e5d0c-df0097d4-20c75421_0 grpc closed
2025-10-10T14:31:09.135845Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|3e6676bb-860e5d0c-df0097d4-20c75421_0 is DEAD
2025-10-10T14:31:09.136044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:09.136086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559600583296667166:2481] destroyed
2025-10-10T14:31:09.136096Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:09.136102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.136104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.136105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
2025-10-10T14:31:09.182299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.182316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.182320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
=== Session was created, waiting for retries
>>> Ready to answer: ok
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-10-10T14:31:09.189347Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:09.282637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.282651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.282654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.382983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.382997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.383009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.483333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.483346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.483360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.583706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.583722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.583725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.684057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.684075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.684078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.784394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.784408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.784411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.884722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.884748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.884751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.985100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.985119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.985122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.085440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.085452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.085454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.185800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.185813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.185816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.286157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.286172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.286175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.386505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.386526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.386529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.486842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.486857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.486859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.587214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.587226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.587228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.687535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.687547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.687550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.787891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.787904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.787906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.888245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.888259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.888262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.988614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.988626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.988629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.088963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.088975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.088978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.189324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.189351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.189353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:11.190504Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:11.289670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.289686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.289691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.390042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.390061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.390064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.490388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.490402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.490405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.590728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.590743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.590746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.691080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.691094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.691097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.791408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.791423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.791425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.891772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.891786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.891789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.992129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.992152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.992155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.092485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.092500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.092502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.192837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.192852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.192855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.293187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.293203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.293206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.393536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.393553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.393556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.493901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.493916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.493920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.594259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.594273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.594275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.694594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.694610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.694614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.794934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.794948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.794950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.895305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.895320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.895323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:12.944011852 2323398 chttp2_transport.cc:1143]             ipv4:127.0.0.1:18475: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:31:12.995686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.995703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.995707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.078640Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:13.096210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.096224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.096226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
=== In the next federation discovery response dc2 will be available
2025-10-10T14:31:13.191488Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:13.196373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.196389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.196392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.296730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.296746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.296748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.397078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.397092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.397095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.497408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.497423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.497425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.597784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.597800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.597802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.698135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.698150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.698159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.798488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.798504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.798507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.898835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.898849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.898852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.999172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.999186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.999188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.099528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.099550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.099552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.199881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.199895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.199897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.300217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.300232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.300235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.400567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.400587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.400589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.500927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.500942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.500944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.601287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.601301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.601304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.701636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.701649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.701651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.801992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.802007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.802010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.902347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.902360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.902362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.002709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.002723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.002725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.103051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.103067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.103069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:15.192521Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:15.203406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.203420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.203422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.303726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.303738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.303740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.404081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.404107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.404109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.504454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.504467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.504470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.604807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.604820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.604822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.705159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.705180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.705182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.805516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.805531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.805534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.905886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.905913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.905915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.006219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.006234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.006236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.106568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.106581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.106584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.206935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.206952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.206956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.307276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.307289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.307292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.407595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.407613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.407617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.507982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.507997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.508000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.608336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.608349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.608353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.708682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.708699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.708702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.809066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.809086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.809089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.909394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.909409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.909411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.009739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.009755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.009758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.110107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.110122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.110126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:17.193509Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:17.210435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.210456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.210459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.310791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.310805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.310808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.411146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.411159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.411161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.511497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.511515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.511518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.555006Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:31:17.555018Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:17.611852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.611869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.611872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.712218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.712234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.712237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.812573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.812591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.812595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.912907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.912922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.912926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.013264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.013282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.013284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.078807Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:18.113622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.113639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.113641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.213967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.213981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.213984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.314283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.314299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.314301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.414672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.414685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.414688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.515041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.515053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.515055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.615365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.615380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.615382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.715727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.715749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.715751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.816087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.816105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.816109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.916453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.916470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.916472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.016798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.016812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.016815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.117143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.117157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.117159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:19.141001112 2325302 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:18475: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
Test retry state: get retry delay
2025-10-10T14:31:19.194506Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:19.217491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.217505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.217507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.317855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.317870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.317872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.418138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.418156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.418158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.518550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.518573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.518576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.618879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.618895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.618897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.719239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.719251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.719254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.819597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.819619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.819621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.919933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.919945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.919947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.020303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.020318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.020320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.120653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.120669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.120672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.221011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.221026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.221029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.321370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.321383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.321387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.421714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.421728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.421731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.522040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.522055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.522057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.622370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.622390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.622393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.722768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.722784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.722787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.823110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.823128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.823131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.923461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.923474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.923477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.023837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.023851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.023853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.124175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.124192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.124194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:21.195484Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:21.224533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.224548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.224550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.324887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.324904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.324906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.425235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.425251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.425255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.525586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.525603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.525605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.625931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.625948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.625952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.726297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.726316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.726319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.826659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.826678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.826680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.926999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.927015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.927017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.027360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.027379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.027382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.127697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.127714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.127717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.228048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.228064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.228067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.328406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.328421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.328424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.428728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.428744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.428747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.529100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.529115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.529117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.629458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.629476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.629478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.729786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.729803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.729806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.830174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.830192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.830195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.930488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.930501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.930504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.030867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.030881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.030884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.079042Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:23.131216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.131230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.131232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:23.196453Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:23.231554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.231569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.231572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.331921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.331940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.331942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.432264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.432277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.432280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.532616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.532638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.532640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.632963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.632975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.632977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.733322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.733347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.733349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.833651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.833664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.833667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.934023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.934038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.934041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.034377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.034390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.034399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.134724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.134740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.134743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.235074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.235088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.235091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.335431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.335447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.335450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.435727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.435739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.435741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.536128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.536143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.536146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.636491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.636506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.636509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.736848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.736861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.736863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.837180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.837208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.837212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.937567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.937586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.937590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.037910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.037923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.037926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.138216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.138231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.138234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:25.197475Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:25.238615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.238631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.238634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.338971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.338987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.338990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.439309Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.439325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.439328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.539623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.539639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.539642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.640024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.640041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.640043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.740369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.740385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.740388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.840735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.840750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.840752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.941080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.941096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.941100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.041414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.041432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.041436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.141788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.141804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.141807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.242145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.242182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.242185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.342490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.342508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.342510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.442822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.442838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.442841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.543183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.543202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.543205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.643529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.643546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.643549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.743886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.743903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.743905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.844230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.844247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.844249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.944529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.944543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.944546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.044949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.044963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.044966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.145288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.145302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.145305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:27.198504Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:27.245651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.245667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.245670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.346005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.346021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.346024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.446338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.446352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.446355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.546705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.546717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.546719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.647054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.647072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.647075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.747499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.747529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.747532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.847761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.847781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.847784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.948092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.948113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.948117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.048480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.048494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.048497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.079290Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:28.148784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.148800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.148802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.249161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.249175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.249177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.349530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.349546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.349549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.449873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.449888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.449891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.550272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.550291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.550295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.650604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.650621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.650624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.750934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.750949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.750952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.851328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.851382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.851385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.951616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.951631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.951633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.051983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.051998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.051999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.152356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.152378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.152381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:29.199502Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:29.252650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.252669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.252672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.353046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.353062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.353065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.453386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.453408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.453411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.553720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.553734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.553736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.654087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.654107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.654110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.754423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.754442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.754445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.854786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.854809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.854811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.955152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.955169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.955172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.055502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.055518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.055521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.155862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.155879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.155882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.256178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.256193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.256196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.356562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.356587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.356589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.456904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.456923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.456926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.557230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.557244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.557247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.657614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.657628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.657631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.757920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.757942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.757945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.858312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.858326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.858328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.958674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.958691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.958693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.059031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.059045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.059048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.159372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.159388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.159390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:31.200512Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:31.259713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.259727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.259730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.360082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.360098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.360100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.460426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.460445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.460449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.560725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.560743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.560746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.661139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.661155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.661157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.761476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.761495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.761497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.861833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.861849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.861851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.962168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.962182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.962185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.062532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.062548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.062551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.162886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.162911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.162914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.263250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.263266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.263268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.363598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.363613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.363616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.463952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.463979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.463982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.564269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.564282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.564284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.664668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.664684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.664688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.764996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.765011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.765014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.865374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.865391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.865402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.965669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.965684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.965687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.066046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.066064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.066067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.079376Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:33.166429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.166447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.166459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:33.201489Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:33.266773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.266792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.266795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.367138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.367161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.367176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.467460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.467479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.467484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.567809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.567825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.567829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.668188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.668205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.668207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.768507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.768523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.768526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.868881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.868898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.868901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.969218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.969232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.969234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.069532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.069549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.069552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.169948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.169964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.169966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.270226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.270241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.270243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.370662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.370680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.370683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.470997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.471014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.471016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.571322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.571336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.571351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.671690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.671704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.671716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.772028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.772043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.772047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.872380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.872415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.872419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.972741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.972756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.972759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.073110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.073131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.073133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.173473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.173491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.173495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:35.202481Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:35.273795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.273813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.273816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.374170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.374188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.374191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.474521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.474540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.474544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.574889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.574910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.574914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.675235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.675253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.675257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.775560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.775575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.775577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.875914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.875932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.875934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.976268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.976285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.976288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.076575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.076592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.076596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.176973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.176991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.176993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.277359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.277377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.277380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.377682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.377699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.377702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.478019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.478033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.478035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.578363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.578377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.578379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.678736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.678756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.678759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.779080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.779099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.779102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.879442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.879459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.879463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.979785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.979804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.979807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.080130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.080145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.080147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.180505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.180521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.180524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:37.203501Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:31:37.280845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.280862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.280866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.381196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.381212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.381214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.481540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.481558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.481562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.581900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.581918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.581921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.682258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.682277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.682280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.782592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.782616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.782619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.882979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.882997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.883000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.983324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.983340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.983344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.074422Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:31:38.074468Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:31:38.074709Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:31:38.074987Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:31:38.075221Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:31:38.075357Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-10T14:31:38.079609Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:38.083642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.083657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.083659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.184031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.184049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.184052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.284367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.284385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.284388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.384744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.384764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.384768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.485075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.485091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.485093Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.585423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.585441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.585445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.685792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.685810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.685813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.786154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.786169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.786172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.886448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.886462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.886465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.986825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.986842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.986846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.087183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.087199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.087202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:31:39.145276132 2323398 chttp2_transport.cc:1143]             ipv4:127.0.0.1:18475: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-10T14:31:39.187499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.187517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.187520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:31:39.204501Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
=== Waiting for repair
>>> Ready to answer: ok
2025-10-10T14:31:39.287896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.287913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.287916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.388242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.388272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.388276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.488603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.488625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.488628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.588941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.588957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.588959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.689298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.689315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.689317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.789637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.789652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.789655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.890007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.890029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.890033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.990360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.990376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.990379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.090715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.090732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.090735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.191049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.191064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.191067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.291413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.291429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.291432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.391762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.391776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.391777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.492118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.492132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.492135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.592462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.592475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.592477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.692809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.692825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.692828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.793179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.793193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.793195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.893494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.893514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.893518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.993887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.993905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.993908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.094216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.094231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.094233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.194571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.194588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.194591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
=== Closing the session
2025-10-10T14:31:41.205565Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:13593" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:13593" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:13593" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T14:31:41.207896Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:31:41.208157Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:31:41.209385Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:31:41.209444Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.209573Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:31:41.209697Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:41.209711Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:31:41.209841Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.209873Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54614
2025-10-10T14:31:41.209877Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:54614 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:31:41.209879Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:41.210225Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T14:31:41.210259Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:31:41.210270Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session will now close
2025-10-10T14:31:41.210267Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:41.210288Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:31:41.210272Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:41.210274Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:41.210278Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559600720735623288:2987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:41.210432Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:41.210440Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: CANCELLED, Details: , InternalError: 0
2025-10-10T14:31:41.210454Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106701210 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:41.210458Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session is aborting and will not restart
2025-10-10T14:31:41.210490Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:31:41.210716Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId:  grpc closed
2025-10-10T14:31:41.210723Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId:  is DEAD
2025-10-10T14:31:41.210933Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559600720735623288:2987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:41.211142Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2843: SessionId: ydb://session/3?node_id=3&id=YTJhNjdjODEtOGUxZGI2YWMtZmM4N2E2NmItZjM3MmMxMTM=, ActorId: [3:7559600720735623289:2989], ActorState: ExecuteState, TraceId: 01k778hrcv7v33ese1phe56snd, Create QueryResponse for error on request, msg: 
2025-10-10T14:31:41.294944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.294961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.294965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.395285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.395302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.395305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:30:54.416988Z :PropagateSessionClosed INFO: Random seed for debugging is 1760106654416984
2025-10-10T14:30:54.516631Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559600518719684488:2161];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.516651Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:30:54.520454Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.520727Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559600517937476840:2082];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:54.520750Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/z96o/002b55/r3tmp/tmpbZmhgD/pdisk_1.dat
2025-10-10T14:30:54.523273Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:30:54.560487Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:54.560866Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:30:54.563649Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 15287, node 1
2025-10-10T14:30:54.581015Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/z96o/002b55/r3tmp/yandexJdwsg2.tmp
2025-10-10T14:30:54.581027Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/z96o/002b55/r3tmp/yandexJdwsg2.tmp
2025-10-10T14:30:54.581094Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/z96o/002b55/r3tmp/yandexJdwsg2.tmp
2025-10-10T14:30:54.581137Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:30:54.584688Z INFO: TTestServer started on Port 6118 GrpcPort 15287
TClient is connected to server localhost:6118
PQClient connected to localhost:15287
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:30:54.617955Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.617987Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.619681Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:30:54.623171Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:30:54.623295Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:30:54.623317Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:30:54.624245Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:30:54.624490Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:30:54.717104Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.756952Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:30:54.927818Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.928077Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7559600517937477105:2289], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.928180Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=MTFlOGU0MjgtYWI1YzFmMzQtOGIzMTBlZWItZDNmYzJhNGU=, ActorId: [2:7559600517937477103:2288], ActorState: ExecuteState, TraceId: 01k778gb5v5gr65fsx0b4wdb7c, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.928529Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7559600518719685290:2318], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:30:54.928606Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=YWU3YzMwNzUtODRmZGRkYzktMWIwNjk0MGMtYjUwMGUxNmM=, ActorId: [1:7559600518719685287:2316], ActorState: ExecuteState, TraceId: 01k778gb5cb3svmxj6gddmxky3, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:30:54.928686Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.928688Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:30:54.951285Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:30:54.971035Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:15287", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:30:55.010036Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k778gb8b0jax1p4282tk6fa0, Database: , SessionId: ydb://session/3?node_id=1&id=YjhjYTljODItZjJjMTIzYzAtMzA3MzRmMS1hN2Y4MDc2Nw==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559600523014652965:2887] 
2025-10-10T14:30:55.518368Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:55.522990Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:30:59.516591Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559600518719684488:2161];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.516623Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:30:59.521182Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559600517937476840:2082];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:30:59.521215Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:31:00.109547Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:15287
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.124878Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:15287
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:31:00.130778Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559600544489489952:3179] connected; active server actors: 1
2025-10-10T14:31:00.130874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:31:00.131028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:31:00.131273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:31:00.132855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:00.133365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:00.133420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:31:00.133433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.133443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:31:00.133512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600544489489975:2438], now have 1 active actors on pipe
2025-10-10T14:31:00.133523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600544489489951:3178], now have 1 active actors on pipe
2025-10-10T14:31:00.133589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:31:00.133638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.134505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.135896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600544489490010:3226], now have 1 active actors on pipe
2025-10-10T14:31:00.135990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.136871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.137055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:00.137084Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:31:00.137132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:00.137188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600543707281428:2381]
2025-10-10T14:31:00.137734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:00.137744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:00.137749Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559600543707281428:2381]
2025-10-10T14:31:00.137753Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:31:00.137977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:31:00.137988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.138010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.138017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:00.138019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.138020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.138021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.138022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:31:00.138030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:00.138117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.138143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.138986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.139017Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760106660179, TxId 281474976720677
2025-10-10T14:31:00.139021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.139023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.139049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.139095Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:00.139510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:00.139569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:00.139583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.139585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.139587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.139591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:00.139678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:31:00.139697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:00.139732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.140545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.140562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:31:00.140939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:31:00.144085Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k778gg913ep41ssfcaexc6dr, Database: , SessionId: ydb://session/3?node_id=1&id=OTdiYTEzZjYtYzUwMTllNmItNTU5OGU5NWUtM2JkMjRhZWY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660179
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1760106660179
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:15287
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.149686Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.238010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.238025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.238028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.338369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.338382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.338384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.438707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.438728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.438731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.539056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.539079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.539080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.639408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.639422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.639425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:15287
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:00.650775Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:31:00.739772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.739787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.739789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.840120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.840142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.840144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:00.940465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:00.940479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:00.940482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.040850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.040868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.040871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.141148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.141164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.141166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:15287
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:31:01.152170Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:31:01.153457Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:31:01.153649Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:31:01.153653Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:01.154084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.154101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:31:01.156255Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.156477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:31:01.156524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:40780
2025-10-10T14:31:01.156535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40780 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.156539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.156957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:31:01.157010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.157017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.157019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.157022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600548784457475:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.157544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600548784457475:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.176660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600548784457475:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.176710Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457507:2471] connected; active server actors: 1
2025-10-10T14:31:01.176724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600548784457475:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:31:01.176729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600548784457475:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.176783Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457507:2471] disconnected; active server actors: 1
2025-10-10T14:31:01.176794Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457507:2471] disconnected no session
2025-10-10T14:31:01.190626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600548784457475:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.190642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600548784457475:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:01.190644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600548784457475:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.190650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.190871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600548784457525:2471], now have 1 active actors on pipe
2025-10-10T14:31:01.190897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.190944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.190954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.190983Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|177acbaf-664b080d-1ab4b168-ca7a89a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:31:01.191006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.191012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.191015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.191025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.191039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.191056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.191191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.191198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.191211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.191293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|177acbaf-664b080d-1ab4b168-ca7a89a2_0
2025-10-10T14:31:01.191594Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661191 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.191621Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|177acbaf-664b080d-1ab4b168-ca7a89a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:01.191717Z :INFO: [] MessageGroupId [src] SessionId [src|177acbaf-664b080d-1ab4b168-ca7a89a2_0] Write session: close. Timeout = 0 ms
2025-10-10T14:31:01.191725Z :INFO: [] MessageGroupId [src] SessionId [src|177acbaf-664b080d-1ab4b168-ca7a89a2_0] Write session will now close
2025-10-10T14:31:01.191730Z :DEBUG: [] MessageGroupId [src] SessionId [src|177acbaf-664b080d-1ab4b168-ca7a89a2_0] Write session: aborting
2025-10-10T14:31:01.191845Z :INFO: [] MessageGroupId [src] SessionId [src|177acbaf-664b080d-1ab4b168-ca7a89a2_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:31:01.191849Z :DEBUG: [] MessageGroupId [src] SessionId [src|177acbaf-664b080d-1ab4b168-ca7a89a2_0] Write session: destroy
2025-10-10T14:31:01.191940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|177acbaf-664b080d-1ab4b168-ca7a89a2_0 grpc read done: success: 0 data: 
2025-10-10T14:31:01.191949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|177acbaf-664b080d-1ab4b168-ca7a89a2_0 grpc read failed
2025-10-10T14:31:01.191954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|177acbaf-664b080d-1ab4b168-ca7a89a2_0 grpc closed
2025-10-10T14:31:01.191957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|177acbaf-664b080d-1ab4b168-ca7a89a2_0 is DEAD
2025-10-10T14:31:01.192147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:31:01.192250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559600548784457525:2471] destroyed
2025-10-10T14:31:01.192263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:31:01.192268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.192270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.192271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:31:01.241530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.241545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.241547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:31:01.245122Z :INFO: [/Root] [] [107bab1c-63e3920c-56646a93-6a8a2d8] Open read subsessions to databases: { name: dc1, endpoint: localhost:15287, path: /Root }, { name: dc2, endpoint: localhost:15287, path: /Invalid }
2025-10-10T14:31:01.246726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-10T14:31:01.246732Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Starting read session
2025-10-10T14:31:01.246767Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Starting single session
2025-10-10T14:31:01.246846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-10T14:31:01.246870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:01.246980Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:01.246986Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:01.246989Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:01.248199Z :INFO: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Starting read session
2025-10-10T14:31:01.248205Z :DEBUG: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Starting single session
2025-10-10T14:31:01.248244Z :DEBUG: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:01.248247Z :DEBUG: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:01.248250Z :DEBUG: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:31:01.248269Z :ERROR: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. 
2025-10-10T14:31:01.248273Z :DEBUG: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:01.248274Z :DEBUG: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:01.248308Z :INFO: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.290136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:01.290193Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:31:01.290313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.290323Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:01.290335Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:31:01.290337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:31:01.290495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:01.290540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:01.290550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.290554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.290973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T14:31:01.291004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.291009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.291011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.291016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600548784457542:2491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.291548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600548784457542:2491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.291866Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:01.291920Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:01.291972Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 auth for : user
2025-10-10T14:31:01.292044Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Handle describe topics response
2025-10-10T14:31:01.292059Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 auth is DEAD
2025-10-10T14:31:01.292061Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:01.292295Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:01.292391Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457552:2490] connected; active server actors: 1
2025-10-10T14:31:01.292402Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600548784457552:2490] session shared/user_1_1_9932294251438491411_v1
2025-10-10T14:31:01.292408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:31:01.292415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:31:01.292422Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_9932294251438491411_v1" (Sender=[1:7559600548784457539:2490], Pipe=[1:7559600548784457552:2490], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:01.292424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:01.292429Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_1_9932294251438491411_v1
2025-10-10T14:31:01.292432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:31:01.292441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_9932294251438491411_v1" (Sender=[1:7559600548784457539:2490], Pipe=[1:7559600548784457552:2490], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:01.292446Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:01.292448Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_9932294251438491411_v1" sender [1:7559600548784457539:2490] lock partition 0 for ReadingSession "shared/user_1_1_9932294251438491411_v1" (Sender=[1:7559600548784457539:2490], Pipe=[1:7559600548784457552:2490], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:31:01.292456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:31:01.292460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-10T14:31:01.292529Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.292649Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_9932294251438491411_v1" ClientId: "user" PipeClient { RawX1: 7559600548784457552 RawX2: 4503603922340282 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:01.292661Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:31:01.292720Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# ade88856-fcbd4176-808f7f8e-bcd6cd0
2025-10-10T14:31:01.292744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:01.292881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559600548784457565:2497]
2025-10-10T14:31:01.292870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600548784457565:2497], now have 1 active actors on pipe
2025-10-10T14:31:01.292934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.292939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.292948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_9932294251438491411_v1 on pipe: [1:7559600548784457565:2497]
2025-10-10T14:31:01.292971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.292977Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_9932294251438491411_v1:1 with generation 1
2025-10-10T14:31:01.292980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.292981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.293009Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_9932294251438491411_v1
2025-10-10T14:31:01.293014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.293043Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.293293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559600548784457542:2491] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:31:01.293356Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457568:2491] connected; active server actors: 1
2025-10-10T14:31:01.293371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559600548784457542:2491] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T14:31:01.293374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600548784457542:2491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.293412Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457568:2491] disconnected; active server actors: 1
2025-10-10T14:31:01.293417Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457568:2491] disconnected no session
2025-10-10T14:31:01.293734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.293759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.293770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.293771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.293773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.293777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.293785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:01.293870Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760106661241 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:01.293881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:31:01.293894Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 sending to client partition status
2025-10-10T14:31:01.295236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600548784457542:2491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.295248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600548784457542:2491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:31:01.295251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600548784457542:2491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.295256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.295382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600548784457581:2491], now have 1 active actors on pipe
2025-10-10T14:31:01.295410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:31:01.295460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.295468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.295484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:01.295490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.295492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.295494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.295501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.295511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.295518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.295628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.295633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.295642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.295690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0
2025-10-10T14:31:01.295865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760106661295 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:31:01.295905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:01.298268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 1 to 1
2025-10-10T14:31:01.300468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.300479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:31:01.303718Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-10T14:31:01.304661Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:31:01.304734Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:31:01.304751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:31:01.304759Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:31:01.305059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.307366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.307484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.307498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.307537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:01.307618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.308336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 2 to 2
2025-10-10T14:31:01.310609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.310619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-10T14:31:01.311011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.311025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.311665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:01.312197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:01.312858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:01.312894Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:01.312906Z :DEBUG: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.312927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:01.313003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-10T14:31:01.313013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-10T14:31:01.313039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.313068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.313085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.313092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:01.313124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T14:31:01.313144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-10T14:31:01.313153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-10T14:31:01.313156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-10T14:31:01.313160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-10T14:31:01.314759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-10T14:31:01.314777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.314850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1760106661314
2025-10-10T14:31:01.315626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.317038Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.317053Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-10T14:31:01.317984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.318085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.318094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.318113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-10T14:31:01.318164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.318402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 3 to 3
2025-10-10T14:31:01.320294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.320308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.320363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-10T14:31:01.320652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.320660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-10T14:31:01.320907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-10T14:31:01.321478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-10T14:31:01.321645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-10T14:31:01.321681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-10T14:31:01.321687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-10T14:31:01.321718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.321736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.322532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.322560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.322568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T14:31:01.322574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.322579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.322588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T14:31:01.322591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.322598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-10T14:31:01.322604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.322609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-10T14:31:01.322610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.322614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-10T14:31:01.322619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.322623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-10T14:31:01.322663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:01.322672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:01.322675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.322684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.322695Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:01.322686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
>>> Got event: 2025-10-10T14:31:01.322701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T14:31:01.322709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.322711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-10T14:31:01.322713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-10T14:31:01.322715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-10T14:31:01.322731Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-10T14:31:01.322742Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-10T14:31:01.322768Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-10T14:31:01.322771Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:01.322782Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# 9ba14f23-8ec9e898-1186c0d4-f9e09d58, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.322824Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 9ba14f23-8ec9e898-1186c0d4-f9e09d58
2025-10-10T14:31:01.323361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-10T14:31:01.323378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.323481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1760106661323
2025-10-10T14:31:01.324675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.324951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.325739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.325771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:31:01.325805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.325812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.325824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.325826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.325830Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.325841Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-10T14:31:01.325840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.325889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:31:01.325901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:31:01.325904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:01.325908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-10T14:31:01.325942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.325948Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T14:31:01.325957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:31:01.325966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:31:01.325974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-10T14:31:01.325983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.325986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.326014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.326162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:01.326334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.326559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.326904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.326981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 4 to 4
2025-10-10T14:31:01.327004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T14:31:01.327027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.327038Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-10T14:31:01.327049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:01.327063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.327072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.327222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:01.327275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.327283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-10T14:31:01.327828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.327962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.328095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.328146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T14:31:01.330078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.330091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.330164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-10T14:31:01.330275Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.330682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-10T14:31:01.330739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-10T14:31:01.330795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-10T14:31:01.330827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-10T14:31:01.330836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-10T14:31:01.330863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.330893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.330911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.330995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 9 }
2025-10-10T14:31:01.331006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 1
2025-10-10T14:31:01.332431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.332490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 5 to 5
2025-10-10T14:31:01.333529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.333549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.333561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.333567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.333570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T14:31:01.333572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T14:31:01.333575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.333578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-10T14:31:01.333579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.333583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-10T14:31:01.333585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.333588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-10T14:31:01.333592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.333596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-10T14:31:01.333638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.333652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.333655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:01.333676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T14:31:01.333687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-10T14:31:01.333693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-10T14:31:01.333696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-10T14:31:01.333699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-10T14:31:01.333802Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661312 CreateTimestampMS: 1760106661295 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-10T14:31:01.334178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.334187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-10T14:31:01.334276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.334381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-10T14:31:01.334400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.334508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1760106661334
2025-10-10T14:31:01.335575Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.336075Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-10T14:31:01.336090Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 9ba14f23-8ec9e898-1186c0d4-f9e09d58 has messages 1
2025-10-10T14:31:01.336133Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# 9ba14f23-8ec9e898-1186c0d4-f9e09d58, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-10T14:31:01.336146Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# 9ba14f23-8ec9e898-1186c0d4-f9e09d58
2025-10-10T14:31:01.336555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.336587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-10T14:31:01.336612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.336619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.336631Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.336641Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-10-10T14:31:01.336688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-10T14:31:01.336677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.336749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.337353Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 0
2025-10-10T14:31:01.337405Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-10T14:31:01.337411Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-10T14:31:01.337420Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1760106661312, sizeLag# 2253219
2025-10-10T14:31:01.337421Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:01.337860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 6 to 6
2025-10-10T14:31:01.338163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.338170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-10T14:31:01.338399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.338643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.340002Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-10T14:31:01.340108Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-10T14:31:01.340132Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 2252976 to budget
2025-10-10T14:31:01.340625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.340639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.340723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-10T14:31:01.340931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-10T14:31:01.340944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 2
2025-10-10T14:31:01.341088Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-10T14:31:01.341101Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.341108Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-10T14:31:01.341162Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.341169Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.341251Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-10T14:31:01.341308Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# 70feb27a-7a0a335-d6b7bde4-2a1a401a
2025-10-10T14:31:01.341322Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# d0b4c296-6a53b817-8f758c86-97da7ac3, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.341316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-10T14:31:01.341360Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid d0b4c296-6a53b817-8f758c86-97da7ac3
2025-10-10T14:31:01.341393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-10T14:31:01.341447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-10T14:31:01.341488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-10T14:31:01.341495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-10T14:31:01.341519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.341524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.341552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.341558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.341573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.341597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.341724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-10T14:31:01.341744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 2 max time lag 0ms effective offset 1
2025-10-10T14:31:01.341764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 2
2025-10-10T14:31:01.341769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-10T14:31:01.341778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.341787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.341789Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-10T14:31:01.341806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.341811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.342099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-10T14:31:01.295000Z WriteTime: 2025-10-10T14:31:01.312000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:37328", "server": "ipv6:[::1]:37328", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.342475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.343102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.343243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.343479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.343693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.343821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T14:31:01.343853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.344624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.344638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.344723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-10T14:31:01.344773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-10T14:31:01.344875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-10T14:31:01.345431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-10T14:31:01.345466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-10T14:31:01.345472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-10T14:31:01.345492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.345500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.345517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:01.345541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.345554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.345571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T14:31:01.345572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.346637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 7 to 7
2025-10-10T14:31:01.347165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.347173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-10T14:31:01.349245Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.349759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.349789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.349796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.349804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-10T14:31:01.349807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.349810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-10T14:31:01.349812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.349815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-10T14:31:01.349817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.349820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-10T14:31:01.349826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.349829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-10T14:31:01.349855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.349869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.349871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:31:01.349889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-10T14:31:01.349902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-10T14:31:01.349907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-10T14:31:01.349909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-10T14:31:01.349912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-10T14:31:01.350411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-10T14:31:01.350428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-10T14:31:01.350433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-10T14:31:01.350439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-10T14:31:01.350441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-10T14:31:01.350444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-10T14:31:01.351095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 4506426 count 2 nextOffset 5 batches 9
2025-10-10T14:31:01.351110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.351198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,2 HeadOffset 3 endOffset 3 curOffset 5 d0000000000_00000000000000000003_00000_0000000002_00008? size 4506416 WTime 1760106661351
2025-10-10T14:31:01.351570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 8 to 8
2025-10-10T14:31:01.351615Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661322 CreateTimestampMS: 1760106661306 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-10T14:31:01.353525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.353535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-10T14:31:01.353716Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-10T14:31:01.353735Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid d0b4c296-6a53b817-8f758c86-97da7ac3 has messages 1
2025-10-10T14:31:01.353787Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# d0b4c296-6a53b817-8f758c86-97da7ac3, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-10T14:31:01.353802Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# d0b4c296-6a53b817-8f758c86-97da7ac3
2025-10-10T14:31:01.354559Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.355715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.355751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-10T14:31:01.355779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-10T14:31:01.355799Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.355812Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 2 size 4506416
2025-10-10T14:31:01.355859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.355881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.355938Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 0
2025-10-10T14:31:01.355986Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-10T14:31:01.355995Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-10T14:31:01.356004Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1760106661322, sizeLag# 2253219
2025-10-10T14:31:01.356006Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:01.356725Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-10T14:31:01.356830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 9 to 9
2025-10-10T14:31:01.356852Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-10T14:31:01.356880Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 2252978 to budget
2025-10-10T14:31:01.357094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.357099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-10T14:31:01.357646Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-10T14:31:01.357658Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.357663Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-10T14:31:01.357690Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.357697Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.357958Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-10T14:31:01.358025Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# 4b1bec96-3a7e3612-37cf923b-3649fbb7
2025-10-10T14:31:01.358049Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# 5f703e33-7cf1f46d-56e5735c-a3958795, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.358074Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 5f703e33-7cf1f46d-56e5735c-a3958795
2025-10-10T14:31:01.358467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.358487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.359093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-10T14:31:01.359389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.359631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-10T14:31:01.360132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 3 }
2025-10-10T14:31:01.360147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 3
2025-10-10T14:31:01.360152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-10T14:31:01.360679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-10T14:31:01.360728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-10T14:31:01.360736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-10T14:31:01.360776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.360784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-10T14:31:01.306000Z WriteTime: 2025-10-10T14:31:01.322000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:37328", "logtype": "unknown", "server": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.360799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.360824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.360849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 3 max time lag 0ms effective offset 2
2025-10-10T14:31:01.360874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 3
2025-10-10T14:31:01.360880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-10T14:31:01.360890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.360902Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-10T14:31:01.360916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.360926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.361726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.361944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:01.362515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.362670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.362816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.362934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T14:31:01.362981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.362989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.363005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-10T14:31:01.363405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 10 to 10
2025-10-10T14:31:01.363697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.363706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-10T14:31:01.363739Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.368002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-10T14:31:01.368066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 2 size 4506416 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.368082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.368097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.368101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-10T14:31:01.368104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-10T14:31:01.368119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-10T14:31:01.368124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-10T14:31:01.368129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-10T14:31:01.368137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-10T14:31:01.368146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-10T14:31:01.368152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-10T14:31:01.368159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-10T14:31:01.368170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-10T14:31:01.368176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.368184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-10T14:31:01.368217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.368227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.368232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:01.368244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-10T14:31:01.368253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-10T14:31:01.368259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-10T14:31:01.368260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-10T14:31:01.368263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-10T14:31:01.368657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-10T14:31:01.368672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.368762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00004? size 2253219 WTime 1760106661368
2025-10-10T14:31:01.368927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.369041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-10T14:31:01.369052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-10T14:31:01.369054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-10T14:31:01.369055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000002_00008?
2025-10-10T14:31:01.369057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 11266073 bytes
2025-10-10T14:31:01.369075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-10T14:31:01.369096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-10T14:31:01.369100Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.369108Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 2253219
2025-10-10T14:31:01.369118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:31:01.369122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-10T14:31:01.369130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-10T14:31:01.369140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 11 to 11
2025-10-10T14:31:01.369146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-10T14:31:01.369158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000002_00008?
2025-10-10T14:31:01.369166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:31:01.369194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.369200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.369202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.369206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.369213Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-10T14:31:01.369230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.369235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.369237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.369239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.369249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.369253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-10T14:31:01.369255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.369434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T14:31:01.369481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.369490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-10T14:31:01.369531Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.369589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-10T14:31:01.369746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-10T14:31:01.369809Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661333 CreateTimestampMS: 1760106661316 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-10-10T14:31:01.369903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-10T14:31:01.370000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-10T14:31:01.370080Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-10-10T14:31:01.370094Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 5f703e33-7cf1f46d-56e5735c-a3958795 has messages 1
2025-10-10T14:31:01.370151Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# 5f703e33-7cf1f46d-56e5735c-a3958795, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-10T14:31:01.370161Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# 5f703e33-7cf1f46d-56e5735c-a3958795
2025-10-10T14:31:01.370187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.370207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.370538Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 0
2025-10-10T14:31:01.370702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.370757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-10T14:31:01.370775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-10T14:31:01.370778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.370934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T14:31:01.371002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.371182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-10T14:31:01.371532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-10T14:31:01.371685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-10T14:31:01.371764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-10T14:31:01.371878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 12 to 12
2025-10-10T14:31:01.372177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.372183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-10T14:31:01.372293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-10T14:31:01.372309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-10T14:31:01.372310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.372338Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-10T14:31:01.372341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 8 }
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.372353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 4
2025-10-10T14:31:01.372573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 4 }
2025-10-10T14:31:01.372576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 5
2025-10-10T14:31:01.372933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T14:31:01.373575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-10T14:31:01.374180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-10T14:31:01.374341Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-10T14:31:01.374418Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-10T14:31:01.374440Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 2252978 to budget
2025-10-10T14:31:01.374764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-10T14:31:01.374823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-10T14:31:01.376309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 13 to 13
2025-10-10T14:31:01.376359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-10T14:31:01.376371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000003_00000_0000000002_00008?
2025-10-10T14:31:01.376372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.376522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-10T14:31:01.376667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-10T14:31:01.376818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-10T14:31:01.377406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-10T14:31:01.378410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.378417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-10T14:31:01.380448Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-10T14:31:01.380461Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.380467Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-10T14:31:01.380560Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.380566Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.380722Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-10T14:31:01.380810Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# f0e7945-641dc459-561ec105-f9e158ab
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-10T14:31:01.316000Z WriteTime: 2025-10-10T14:31:01.333000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:37328", "logtype": "unknown", "server": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.383618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 14 to 14
2025-10-10T14:31:01.383894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.383901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-10T14:31:01.383925Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.385965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 15 to 15
2025-10-10T14:31:01.386670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-10T14:31:01.387325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-10T14:31:01.387343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1760106661386
2025-10-10T14:31:01.387464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-10T14:31:01.387476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-10T14:31:01.387615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-10T14:31:01.387758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-10T14:31:01.387908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-10T14:31:01.387995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-10T14:31:01.388045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.388053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-10T14:31:01.388058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528015[B] reached maximum (20971520[B])
2025-10-10T14:31:01.388079Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.388476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 3 PackedSize 2970341 count 2 nextOffset 5 batches 6
2025-10-10T14:31:01.388547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,2 HeadOffset 0 endOffset 0 curOffset 5 d0000000000_00000000000000000003_00003_0000000002_00005| size 2970331 WTime 1760106661388
2025-10-10T14:31:01.389828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.389841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.389911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-10T14:31:01.389978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-10T14:31:01.390035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-10T14:31:01.390085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-10T14:31:01.390113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-10T14:31:01.390121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-10T14:31:01.390143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.390148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.390170Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.390183Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-10T14:31:01.390190Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 2 size 2970331
2025-10-10T14:31:01.390213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.390238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.390345Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-10T14:31:01.390356Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 5
2025-10-10T14:31:01.390375Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 5, WTime# 1760106661333, sizeLag# 4506416
2025-10-10T14:31:01.390377Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:01.390390Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# 711707aa-984dd779-2a4bc09a-9cf174ac, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.390410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-10T14:31:01.390411Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 711707aa-984dd779-2a4bc09a-9cf174ac
2025-10-10T14:31:01.390470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.390556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.390564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.390591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 2 size 524288 endOffset 5 max time lag 0ms effective offset 3
2025-10-10T14:31:01.390612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 4506416 count 2 last offset 3, current partition end offset: 5
2025-10-10T14:31:01.390617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-10T14:31:01.390628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 1 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.390639Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-10T14:31:01.390655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.390656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.390911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 2 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:01.391060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.391254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.391839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.392042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.392066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 2 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:01.392253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.392446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.392600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.392676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 2 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T14:31:01.392992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.394474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.394486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.394552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-10T14:31:01.394609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-10T14:31:01.395132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-10T14:31:01.395639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-10T14:31:01.395680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-10T14:31:01.395688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-10T14:31:01.395716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-10T14:31:01.395743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 2253219 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.395766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.395768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.395776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.395784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T14:31:01.395796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.400362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.400388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.400395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.400401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-10T14:31:01.400405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.400408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-10T14:31:01.400411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.400415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-10T14:31:01.400416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.400419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-10T14:31:01.400426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.400431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-10T14:31:01.400705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.400722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.400724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:31:01.400743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-10T14:31:01.400754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-10T14:31:01.400757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-10T14:31:01.400760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-10T14:31:01.400763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-10T14:31:01.401181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 2253229 count 1 nextOffset 7 batches 5
2025-10-10T14:31:01.401200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-10T14:31:01.401205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-10T14:31:01.401207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-10T14:31:01.401209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-10T14:31:01.401214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-10T14:31:01.401761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 4506426 count 2 nextOffset 8 batches 9
2025-10-10T14:31:01.401778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.401854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,2 HeadOffset 6 endOffset 6 curOffset 8 d0000000000_00000000000000000006_00000_0000000002_00008? size 4506416 WTime 1760106661401
2025-10-10T14:31:01.404581Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661349 CreateTimestampMS: 1760106661324 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661350 CreateTimestampMS: 1760106661332 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 198 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 3 }
2025-10-10T14:31:01.405977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.406046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-10T14:31:01.406071Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.406087Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 2 size 4506416
2025-10-10T14:31:01.406099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-10T14:31:01.406137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.406160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.406878Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 5
2025-10-10T14:31:01.406892Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid 711707aa-984dd779-2a4bc09a-9cf174ac has messages 1
2025-10-10T14:31:01.406946Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# 711707aa-984dd779-2a4bc09a-9cf174ac, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505940
2025-10-10T14:31:01.406964Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# 711707aa-984dd779-2a4bc09a-9cf174ac
2025-10-10T14:31:01.406964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.406973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 2 size 2970331 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.406990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.406991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:01.406994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T14:31:01.406995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 2 parts 5 suffix '124' size 2970331
2025-10-10T14:31:01.407366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 32 queued_in_partition_duration_ms: 7 }
2025-10-10T14:31:01.407380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 6
2025-10-10T14:31:01.407386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275214[B]
2025-10-10T14:31:01.407519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.407532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.407639Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-10T14:31:01.407651Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-10-10T14:31:01.407854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 16 to 16
2025-10-10T14:31:01.407938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.408144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.408151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-10T14:31:01.408287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.408300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.408357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-10T14:31:01.408522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.408667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-10T14:31:01.408721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-10T14:31:01.408762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528016[B] reached maximum (20971520[B])
2025-10-10T14:31:01.408761Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 0
2025-10-10T14:31:01.408769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-10T14:31:01.408802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-10T14:31:01.408808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-10T14:31:01.408810Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1760106661350, sizeLag# 2253219
2025-10-10T14:31:01.408814Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:31:01.408821Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-10T14:31:01.408826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.408832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.408838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.408852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.408864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-10T14:31:01.408945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.410846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.410858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.410922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-10T14:31:01.410964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-10T14:31:01.411010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-10T14:31:01.411067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-10T14:31:01.411117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-10T14:31:01.411123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-10T14:31:01.411149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.411164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.411229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.411949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 2 size 4506416 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.411966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.411982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-10T14:31:01.411983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.411989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.411997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-10T14:31:01.412000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-10T14:31:01.412007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-10T14:31:01.412014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-10T14:31:01.412025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-10T14:31:01.412034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-10T14:31:01.412040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-10T14:31:01.412045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-10T14:31:01.412050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-10T14:31:01.412055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.412059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-10T14:31:01.412097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.412109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.412110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:31:01.412127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-10T14:31:01.412137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-10T14:31:01.412140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-10T14:31:01.412142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-10T14:31:01.412144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-10T14:31:01.412583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2253229 count 1 nextOffset 9 batches 5
2025-10-10T14:31:01.412603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-10T14:31:01.412609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-10T14:31:01.412613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-10T14:31:01.412615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-10T14:31:01.412618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-10T14:31:01.413086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4506426 count 2 nextOffset 10 batches 9
2025-10-10T14:31:01.413101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.413174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 8,2 HeadOffset 8 endOffset 8 curOffset 10 d0000000000_00000000000000000008_00000_0000000002_00008? size 4506416 WTime 1760106661412
2025-10-10T14:31:01.413297Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 4505940, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981652
2025-10-10T14:31:01.413409Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-10T14:31:01.413435Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 4505940 to budget
2025-10-10T14:31:01.413423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.417226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.417257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-10T14:31:01.417287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-10T14:31:01.417304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.417311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.417320Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.417347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.417368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.417347Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 2 size 4506416
2025-10-10T14:31:01.417354Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-10T14:31:01.417355Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-10T14:31:01.417357Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-10-10T14:31:01.417358Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000002_00008?(+) to d0000000000_00000000000000000003_00000_0000000002_00008?(+)
2025-10-10T14:31:01.417401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-10T14:31:01.417518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.417575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 10 }
2025-10-10T14:31:01.417588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 7
2025-10-10T14:31:01.417593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275215[B]
2025-10-10T14:31:01.417686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 5 }
2025-10-10T14:31:01.417710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 8
2025-10-10T14:31:01.418561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 17 to 17
2025-10-10T14:31:01.418888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.418898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-10T14:31:01.419076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.419353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.419823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.419832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.419983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-10T14:31:01.420035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-10T14:31:01.420088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-10T14:31:01.420153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-10T14:31:01.420201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-10T14:31:01.420210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-10T14:31:01.420247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.420253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.420261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.420276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.420286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-10T14:31:01.420356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.420432Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-10T14:31:01.420449Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.420499Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-10T14:31:01.420521Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-10T14:31:01.324000Z WriteTime: 2025-10-10T14:31:01.349000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:37328", "logtype": "unknown", "server": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.421807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.422138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.422150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.422228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-10T14:31:01.422382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-10T14:31:01.422437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-10T14:31:01.422494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-10T14:31:01.422537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-10T14:31:01.422543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-10T14:31:01.422569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.422584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.423404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.423414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.423419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.423423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 2 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.423428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 2 size 4506416 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.423451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.423472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.423472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T14:31:01.423482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T14:31:01.423491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T14:31:01.423492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-10T14:31:01.423495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-10T14:31:01.423498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-10T14:31:01.423500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-10T14:31:01.423503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-10T14:31:01.423505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-10T14:31:01.423515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-10T14:31:01.423520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-10T14:31:01.423526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-10T14:31:01.423532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-10T14:31:01.423537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-10T14:31:01.423544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.423547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-10T14:31:01.423582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.423593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.423595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:31:01.423611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-10T14:31:01.423621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-10T14:31:01.423624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-10T14:31:01.423626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-10T14:31:01.423628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-10T14:31:01.423908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.424249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 18 to 18
2025-10-10T14:31:01.424252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 2253230 count 1 nextOffset 11 batches 5
2025-10-10T14:31:01.424272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-10T14:31:01.424278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-10T14:31:01.424280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-10T14:31:01.424282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-10T14:31:01.424285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-10T14:31:01.424543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.424550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-10T14:31:01.424555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528018[B] reached maximum (20971520[B])
2025-10-10T14:31:01.424584Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.424764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 4506428 count 2 nextOffset 12 batches 9
2025-10-10T14:31:01.424779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.424850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,2 HeadOffset 10 endOffset 10 curOffset 12 d0000000000_00000000000000000010_00000_0000000002_00008? size 4506418 WTime 1760106661424
2025-10-10T14:31:01.427233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00004?
2025-10-10T14:31:01.427242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000002_00008?
2025-10-10T14:31:01.427244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000002_00008?
2025-10-10T14:31:01.427247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 11266051 bytes
2025-10-10T14:31:01.427271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-10T14:31:01.427290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-10T14:31:01.427356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.427374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.427372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.427378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.427385Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.427394Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 2 size 4506418
2025-10-10T14:31:01.427399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:01.427401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00004?
2025-10-10T14:31:01.427407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000002_00008?
2025-10-10T14:31:01.427412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000002_00008?
2025-10-10T14:31:01.427420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:01.427464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.427472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.427475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.427480Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-10T14:31:01.427499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.427502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.427503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-10T14:31:01.427505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.427517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.427526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000005_00000_0000000001_00004?
2025-10-10T14:31:01.427528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.427551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.427579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 3 }
2025-10-10T14:31:01.427591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 9
2025-10-10T14:31:01.427598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275217[B]
2025-10-10T14:31:01.427680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-10T14:31:01.427677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-10T14:31:01.427697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 10
2025-10-10T14:31:01.427837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-10T14:31:01.427950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 19 to 19
2025-10-10T14:31:01.427987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-10T14:31:01.428138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-10T14:31:01.428209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-10T14:31:01.428268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.428285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-10T14:31:01.428727Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (4-4)
2025-10-10T14:31:01.428739Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.428748Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505940, ReadSizeServerDelta = -3981652
2025-10-10T14:31:01.428819Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.428826Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.428919Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505940 } }
2025-10-10T14:31:01.428951Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# d2917ffe-effbd4e0-9586f066-b02e524b
2025-10-10T14:31:01.428966Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# a589826b-4b58f7a7-aa154495-3465a431, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.428993Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid a589826b-4b58f7a7-aa154495-3465a431
2025-10-10T14:31:01.429013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.429303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.429603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-10T14:31:01.429617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000006_00000_0000000002_00008?
2025-10-10T14:31:01.429619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.430205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-10T14:31:01.430347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-10T14:31:01.430491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-10T14:31:01.430629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-10T14:31:01.430822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-10T14:31:01.332000Z WriteTime: 2025-10-10T14:31:01.350000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:37328", "logtype": "unknown", "server": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.431555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 4506426 count 2 nextOffset 7 batches 9
2025-10-10T14:31:01.431570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-10T14:31:01.431702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-10T14:31:01.434005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 20 to 20
2025-10-10T14:31:01.434272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.434279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-10T14:31:01.434285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.434316Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.435984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-10T14:31:01.436122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-10T14:31:01.436259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-10T14:31:01.436329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-10T14:31:01.436342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1760106661436
2025-10-10T14:31:01.436635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-10T14:31:01.436655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000008_00000_0000000002_00008?
2025-10-10T14:31:01.436657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.436793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-10T14:31:01.436932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-10T14:31:01.437064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-10T14:31:01.437204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-10T14:31:01.437418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-10T14:31:01.437871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-10-10T14:31:01.437885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-10T14:31:01.438025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-10T14:31:01.438164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-10T14:31:01.438307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-10T14:31:01.438361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-10T14:31:01.438933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 6247592 count 3 nextOffset 10 batches 12
2025-10-10T14:31:01.438999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 3 endOffset 5 curOffset 10 d0000000000_00000000000000000007_00001_0000000003_00011| size 6247582 WTime 1760106661438
2025-10-10T14:31:01.442097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.442114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.442185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-10T14:31:01.442238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-10T14:31:01.442299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-10T14:31:01.442359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-10T14:31:01.442415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-10T14:31:01.442425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-10T14:31:01.442459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.442464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.442475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.442476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.442495Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.442510Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-10T14:31:01.442517Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 6247582
2025-10-10T14:31:01.442524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.442547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.442714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-10T14:31:01.442744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 5 count 1 size 524288 endOffset 10 max time lag 0ms effective offset 5
2025-10-10T14:31:01.442765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 2253219 count 1 last offset 5, current partition end offset: 10
2025-10-10T14:31:01.442774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-10T14:31:01.442785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.442794Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-10T14:31:01.442808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.442825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.442869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.443438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:01.444051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.444448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.444685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.444724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.445283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.445411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T14:31:01.445499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.446187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.446200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.446266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-10T14:31:01.446743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-10T14:31:01.447217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-10T14:31:01.447678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-10T14:31:01.447719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-10T14:31:01.447725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-10T14:31:01.447751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.447754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.447771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-10-10T14:31:01.447800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 2 size 4506418 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.447818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.447842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.447852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.449032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.449056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.449064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-10T14:31:01.449085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-10T14:31:01.449089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-10T14:31:01.449093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-10T14:31:01.449101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-10T14:31:01.449106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-10T14:31:01.449113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-10T14:31:01.449117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-10T14:31:01.449125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-10T14:31:01.449130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.449132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-10T14:31:01.449168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.449182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.449184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:31:01.449201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-10T14:31:01.449211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-10T14:31:01.449214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-10T14:31:01.449216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-10T14:31:01.449219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-10T14:31:01.449646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 2253230 count 1 nextOffset 13 batches 5
2025-10-10T14:31:01.449665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-10T14:31:01.449669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-10T14:31:01.449672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-10T14:31:01.449675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-10T14:31:01.449677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-10T14:31:01.450229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 4506428 count 2 nextOffset 14 batches 9
2025-10-10T14:31:01.450246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.450332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 12,2 HeadOffset 12 endOffset 12 curOffset 14 d0000000000_00000000000000000012_00000_0000000002_00008? size 4506418 WTime 1760106661449
2025-10-10T14:31:01.450680Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661367 CreateTimestampMS: 1760106661337 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 6759745 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 5 }
2025-10-10T14:31:01.450925Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 10
2025-10-10T14:31:01.450943Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 6 ReadGuid a589826b-4b58f7a7-aa154495-3465a431 has messages 1
2025-10-10T14:31:01.450970Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 10, WTime# 1760106661367, sizeLag# 6759745
2025-10-10T14:31:01.450979Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:31:01.450993Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# a589826b-4b58f7a7-aa154495-3465a431, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-10T14:31:01.451005Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# a589826b-4b58f7a7-aa154495-3465a431
2025-10-10T14:31:01.451831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.451868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-10T14:31:01.451900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-10T14:31:01.451920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-10T14:31:01.451937Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.451954Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 2 size 4506418
2025-10-10T14:31:01.451997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.452018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.452024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.452218Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 1
2025-10-10T14:31:01.452771Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-10T14:31:01.452849Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-10T14:31:01.452869Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 2252978 to budget
2025-10-10T14:31:01.453507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.453811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.454047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.454059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.454151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-10T14:31:01.454206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-10T14:31:01.454265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-10T14:31:01.454321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-10T14:31:01.454347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 3 }
2025-10-10T14:31:01.454359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 11
2025-10-10T14:31:01.454364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.454364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-10T14:31:01.454370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-10T14:31:01.454395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.454402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.454412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.454440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.454454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 2 }
2025-10-10T14:31:01.454469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 12
2025-10-10T14:31:01.454455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-10T14:31:01.454522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.454804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 21 to 21
2025-10-10T14:31:01.455277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.455286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-10T14:31:01.455571Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-10-10T14:31:01.455587Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.455602Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-10T14:31:01.455634Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.455642Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.455829Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-10T14:31:01.455881Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# dc14f263-afa1c4a1-598ccde4-b1da3836
2025-10-10T14:31:01.455897Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# 78401872-bee4521b-c3e399a9-817b053, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.455915Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid 78401872-bee4521b-c3e399a9-817b053
2025-10-10T14:31:01.456445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.456462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.456527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-10T14:31:01.456583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-10T14:31:01.456636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-10T14:31:01.456702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-10T14:31:01.456747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-10T14:31:01.456754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-10T14:31:01.456784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.456790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.456813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.456832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.456982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 6 count 4 size 524288 endOffset 12 max time lag 0ms effective offset 6
2025-10-10T14:31:01.457012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 4506416 count 2 last offset 6, current partition end offset: 12
2025-10-10T14:31:01.457019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-10T14:31:01.457031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 1 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.457043Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-10T14:31:01.457059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.457064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.457221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.457316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 2 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:01.457488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.457638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.457790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.457953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.458039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 2 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:01.458212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-10T14:31:01.337000Z WriteTime: 2025-10-10T14:31:01.367000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:37328", "_ip": "ipv6:[::1]:37328", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.458780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.458929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.459020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 2 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T14:31:01.459057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.459065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.459127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-10-10T14:31:01.459157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.459162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6247582 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.459188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:01.459197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-10T14:31:01.459207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-10T14:31:01.460535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 22 to 22
2025-10-10T14:31:01.460644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-10T14:31:01.460661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.460665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T14:31:01.460832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.460839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-10T14:31:01.460846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.460879Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.461648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.461658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.461670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T14:31:01.461673Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.462378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.462772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 2 size 4506418 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.462789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.462802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 2 parts 5 suffix '124' size 2970331
2025-10-10T14:31:01.462806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-10T14:31:01.462807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.462809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.462814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-10T14:31:01.462827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-10T14:31:01.462832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-10T14:31:01.462836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-10T14:31:01.462843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-10T14:31:01.462848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-10T14:31:01.462851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-10T14:31:01.462855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-10T14:31:01.462859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-10T14:31:01.462863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.462866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-10T14:31:01.462895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.462912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.462918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:31:01.462940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-10T14:31:01.462955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-10T14:31:01.462958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-10T14:31:01.462961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-10T14:31:01.462966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-10T14:31:01.463352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 2253230 count 1 nextOffset 15 batches 5
2025-10-10T14:31:01.463369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-10T14:31:01.463373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-10T14:31:01.463375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-10T14:31:01.463377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-10T14:31:01.463379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-10T14:31:01.464005Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 12 Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661400 CreateTimestampMS: 1760106661344 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661400 CreateTimestampMS: 1760106661351 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 9013030 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 12 StartOffset: 0 } Cookie: 6 }
2025-10-10T14:31:01.464153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 4506428 count 2 nextOffset 16 batches 9
2025-10-10T14:31:01.464172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.464212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.464265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,2 HeadOffset 14 endOffset 14 curOffset 16 d0000000000_00000000000000000014_00000_0000000002_00008? size 4506418 WTime 1760106661464
2025-10-10T14:31:01.464613Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 12
2025-10-10T14:31:01.464629Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 12 ReadOffset 8 ReadGuid 78401872-bee4521b-c3e399a9-817b053 has messages 1
2025-10-10T14:31:01.464658Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 12, WTime# 1760106661400, sizeLag# 9013030
2025-10-10T14:31:01.464667Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:31:01.464677Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# 78401872-bee4521b-c3e399a9-817b053, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505820
2025-10-10T14:31:01.464684Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# 78401872-bee4521b-c3e399a9-817b053
2025-10-10T14:31:01.464691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.466548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000002_00008?
2025-10-10T14:31:01.466559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000012_00000_0000000002_00008?
2025-10-10T14:31:01.466562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012836 bytes
2025-10-10T14:31:01.466584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 2970331 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T14:31:01.466587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 8 size 4506416 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.466591Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.466623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-10T14:31:01.466654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-10T14:31:01.466715Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 1
2025-10-10T14:31:01.466735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.466755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.467221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 6 }
2025-10-10T14:31:01.467235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 13
2025-10-10T14:31:01.467242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.467346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 1 }
2025-10-10T14:31:01.467357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 14
2025-10-10T14:31:01.467390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.467402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.467502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-10T14:31:01.467557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-10T14:31:01.467623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-10T14:31:01.467688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 23 to 23
2025-10-10T14:31:01.467695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-10T14:31:01.467753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-10T14:31:01.467761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-10T14:31:01.467787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.467795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.467804Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.467822Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 2 size 4506418
2025-10-10T14:31:01.467835Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00004?(+) to d0000000000_00000000000000000005_00000_0000000001_00004?(+)
2025-10-10T14:31:01.467838Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000002_00008?(+) to d0000000000_00000000000000000006_00000_0000000002_00008?(+)
2025-10-10T14:31:01.467842Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000002_00008?(+) to d0000000000_00000000000000000008_00000_0000000002_00008?(+)
2025-10-10T14:31:01.467845Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000002_00005|(+) to d0000000000_00000000000000000003_00003_0000000002_00005|(+)
2025-10-10T14:31:01.467856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-10T14:31:01.467860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000002_00008?
2025-10-10T14:31:01.467870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000012_00000_0000000002_00008?
2025-10-10T14:31:01.467881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-10T14:31:01.467885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.467908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.467986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.467995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-10T14:31:01.467968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.467974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.467984Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-10T14:31:01.468010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-10T14:31:01.468012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.468017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.468035Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.468037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.468047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00000_0000000002_00008?
2025-10-10T14:31:01.468049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.468098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.468215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-10T14:31:01.468299Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 4505820, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981532
2025-10-10T14:31:01.468391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-10T14:31:01.468408Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-10T14:31:01.468433Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 4505820 to budget
2025-10-10T14:31:01.468576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-10T14:31:01.468750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-10T14:31:01.468970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-10T14:31:01.469878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.470268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.470469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 24 to 24
2025-10-10T14:31:01.470768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.470776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-10T14:31:01.470782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.471316Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-10-10T14:31:01.471328Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.471369Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-10T14:31:01.471385Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.472139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295579
2025-10-10T14:31:01.472160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295579 WTime 1760106661471
2025-10-10T14:31:01.472174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-10T14:31:01.472180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-10T14:31:01.344000Z WriteTime: 2025-10-10T14:31:01.400000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:37328", "logtype": "unknown", "server": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.472318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-10T14:31:01.472450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-10T14:31:01.472602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-10T14:31:01.472694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-10T14:31:01.473425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-10T14:31:01.473438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000012_00000_0000000002_00008?
2025-10-10T14:31:01.473440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.473577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-10T14:31:01.473716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-10T14:31:01.473853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-10T14:31:01.474005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-10T14:31:01.474202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-10T14:31:01.474828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-10-10T14:31:01.474843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-10T14:31:01.474986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-10T14:31:01.475148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-10T14:31:01.475288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-10T14:31:01.475349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-10T14:31:01.476244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 6964712 count 4 nextOffset 14 batches 13
2025-10-10T14:31:01.476310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,4 HeadOffset 7 endOffset 10 curOffset 14 d0000000000_00000000000000000010_00004_0000000004_00012| size 6964702 WTime 1760106661475
2025-10-10T14:31:01.478129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.478144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.478217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-10T14:31:01.478267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-10T14:31:01.478319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-10T14:31:01.478369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-10T14:31:01.478393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-10T14:31:01.478399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-10T14:31:01.478420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.478425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.478446Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.478460Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295579
2025-10-10T14:31:01.478467Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 6964702
2025-10-10T14:31:01.478476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.478499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.478669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-10T14:31:01.478731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.479282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.479292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 2 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.479299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 2 size 4506418 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.479306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.479317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T14:31:01.479321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.479326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-10T14:31:01.479332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-10T14:31:01.479336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.479339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-10T14:31:01.479340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-10T14:31:01.479343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-10T14:31:01.479351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-10T14:31:01.479358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-10T14:31:01.479362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-10T14:31:01.479366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-10T14:31:01.479369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-10T14:31:01.479373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.479375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-10T14:31:01.479406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.479421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.479427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:31:01.479444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-10T14:31:01.479456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-10T14:31:01.479462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-10T14:31:01.479464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-10T14:31:01.479466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-10T14:31:01.479871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2253230 count 1 nextOffset 17 batches 5
2025-10-10T14:31:01.479888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-10T14:31:01.479892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-10T14:31:01.479894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-10T14:31:01.479896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-10T14:31:01.479898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-10T14:31:01.480314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.480424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4506428 count 2 nextOffset 18 batches 9
2025-10-10T14:31:01.480441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.480516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 16,2 HeadOffset 16 endOffset 16 curOffset 18 d0000000000_00000000000000000016_00000_0000000002_00008? size 4506418 WTime 1760106661480
2025-10-10T14:31:01.480607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.484779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.484829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-10T14:31:01.484852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-10T14:31:01.484921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.484947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.485173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 8 }
2025-10-10T14:31:01.485186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 15
2025-10-10T14:31:01.485191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.485251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 6 }
2025-10-10T14:31:01.485254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 16
2025-10-10T14:31:01.485626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 25 to 25
2025-10-10T14:31:01.485669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.485680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.485750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-10T14:31:01.485810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-10T14:31:01.485873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-10T14:31:01.485937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.485937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-10T14:31:01.485948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-10T14:31:01.485966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-10T14:31:01.485972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-10T14:31:01.485998Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.486075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.486084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.486093Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.486105Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 2 size 4506418
2025-10-10T14:31:01.486114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.486132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.486176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-10T14:31:01.486229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.487762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.488082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.488241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.488258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.488501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-10T14:31:01.488557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-10T14:31:01.488613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-10T14:31:01.488683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 26 to 26
2025-10-10T14:31:01.488671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-10T14:31:01.488717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-10T14:31:01.488723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-10T14:31:01.488742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.488747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.488753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.488767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.488777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-10T14:31:01.488873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.488977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.488983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-10T14:31:01.488988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.489589Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (7-7)
2025-10-10T14:31:01.489604Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.489613Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505820, ReadSizeServerDelta = -3981532
2025-10-10T14:31:01.489700Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.489709Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.489830Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505820 } }
2025-10-10T14:31:01.489866Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# 122138a2-449d2e77-8cc1799e-56b92526
2025-10-10T14:31:01.489890Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# 7e45728a-75b4a92c-4f5de2f9-3e3d77be, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.489922Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 12 ClientCommitOffset 0 committedOffset 0 Guid 7e45728a-75b4a92c-4f5de2f9-3e3d77be
2025-10-10T14:31:01.490086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.490095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.490434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-10T14:31:01.351000Z WriteTime: 2025-10-10T14:31:01.400000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:37328", "logtype": "unknown", "server": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.490750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.490759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.490741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.490861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-10T14:31:01.490910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-10T14:31:01.490958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-10T14:31:01.491006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-10T14:31:01.491049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-10T14:31:01.491058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-10T14:31:01.491076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 4 size 524288 endOffset 16 max time lag 0ms effective offset 8
2025-10-10T14:31:01.491085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 0 blobs, size 0 count 0 last offset 8, current partition end offset: 16
2025-10-10T14:31:01.491530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. All data is from uncompacted head.
2025-10-10T14:31:01.491541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-10-10T14:31:01.491569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.491574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.491579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.491594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.491608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-10T14:31:01.492884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-10T14:31:01.492903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-10T14:31:01.492906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.492925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 8
2025-10-10T14:31:01.492931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 0 blobs, size 0 count 0 last offset 8, current partition end offset: 16
2025-10-10T14:31:01.492981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.493425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. All data is from uncompacted head.
2025-10-10T14:31:01.493435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-10-10T14:31:01.493476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 8
2025-10-10T14:31:01.494629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.495140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.495268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.495280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 6964702 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.495297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.495300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T14:31:01.495309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-10T14:31:01.495314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-10T14:31:01.495317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-10T14:31:01.495320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-10T14:31:01.496438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.496449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.496462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 6247582 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.496465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.496469Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.496934Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661411 CreateTimestampMS: 1760106661356 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 13314169 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 8 }
2025-10-10T14:31:01.497197Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 16
2025-10-10T14:31:01.497216Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 9 ReadGuid 7e45728a-75b4a92c-4f5de2f9-3e3d77be has messages 1
2025-10-10T14:31:01.497228Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 16, WTime# 1760106661411, sizeLag# 13314169
2025-10-10T14:31:01.497232Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:31:01.497244Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# 7e45728a-75b4a92c-4f5de2f9-3e3d77be, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-10T14:31:01.497251Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# 7e45728a-75b4a92c-4f5de2f9-3e3d77be
2025-10-10T14:31:01.497291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.497305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.497400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-10T14:31:01.497562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-10T14:31:01.497623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-10T14:31:01.497672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-10T14:31:01.497711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-10T14:31:01.497720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-10T14:31:01.497745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.497752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.497771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.497791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.497919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-10T14:31:01.498045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.498392Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 1
2025-10-10T14:31:01.498600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 2 size 4506418 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.498620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.498632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.498640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.498647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-10T14:31:01.498663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-10T14:31:01.498669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-10T14:31:01.498677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-10T14:31:01.498693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-10T14:31:01.498708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-10T14:31:01.498719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-10T14:31:01.498729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-10T14:31:01.498735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-10T14:31:01.498744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.498748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-10T14:31:01.498787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.498808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.498814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-10T14:31:01.498835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-10T14:31:01.498849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-10T14:31:01.498856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-10T14:31:01.498859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-10T14:31:01.498863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-10T14:31:01.499037Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-10T14:31:01.499125Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-10T14:31:01.499150Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 2252978 to budget
2025-10-10T14:31:01.499321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-10T14:31:01.499343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-10T14:31:01.499350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-10T14:31:01.499357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-10T14:31:01.499360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-10T14:31:01.499364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-10T14:31:01.499560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.499833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.499954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-10T14:31:01.499974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-10T14:31:01.499984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-10T14:31:01.499988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-10T14:31:01.499992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-10T14:31:01.499996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-10T14:31:01.501014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-10T14:31:01.501033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-10T14:31:01.501039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-10T14:31:01.501042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-10T14:31:01.501046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-10T14:31:01.503612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015? size 8295638
2025-10-10T14:31:01.503627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-10T14:31:01.503637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015? new key d0000000000_00000000000000000018_00000_0000000003_00015? size 8295638 WTime 1760106661503
2025-10-10T14:31:01.504113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-10T14:31:01.504124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.504202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,1 HeadOffset 18 endOffset 18 curOffset 22 d0000000000_00000000000000000021_00003_0000000001_00001? size 717135 WTime 1760106661504
2025-10-10T14:31:01.504305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000002_00008?
2025-10-10T14:31:01.504312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000002_00008?
2025-10-10T14:31:01.504315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012836 bytes
2025-10-10T14:31:01.504353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-10T14:31:01.504383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-10T14:31:01.504441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.504467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.504702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 11 }
2025-10-10T14:31:01.504715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 17
2025-10-10T14:31:01.504732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.504794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 1 }
2025-10-10T14:31:01.504797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 18
2025-10-10T14:31:01.505120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 27 to 27
2025-10-10T14:31:01.505190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.505203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.505274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-10T14:31:01.505345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-10T14:31:01.505407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-10T14:31:01.505444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.505453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-10T14:31:01.505468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-10T14:31:01.505491Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-10T14:31:01.505504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-10T14:31:01.505512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.505540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.505547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.505555Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.505572Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-10-10T14:31:01.505583Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 1 size 717135
2025-10-10T14:31:01.505589Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000002_00008?(+) to d0000000000_00000000000000000010_00000_0000000002_00008?(+)
2025-10-10T14:31:01.505595Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000012_00000_0000000002_00008?(+) to d0000000000_00000000000000000012_00000_0000000002_00008?(+)
2025-10-10T14:31:01.505597Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000003_00011|(+) to d0000000000_00000000000000000007_00001_0000000003_00011|(+)
2025-10-10T14:31:01.505606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-10T14:31:01.505613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000002_00008?
2025-10-10T14:31:01.505622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000002_00008?
2025-10-10T14:31:01.505638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-10T14:31:01.505645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.505660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.505724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.505731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.505742Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-10T14:31:01.505842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.505769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-10T14:31:01.505777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.505781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.505802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.505806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000014_00000_0000000002_00008?
2025-10-10T14:31:01.505808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.505966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-10T14:31:01.506124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-10T14:31:01.506276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-10T14:31:01.507376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.507635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.508305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 28 to 28
2025-10-10T14:31:01.508727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.508739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-10T14:31:01.508746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.509082Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-10-10T14:31:01.509100Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.509111Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-10T14:31:01.509197Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.509205Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.509303Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-10T14:31:01.509382Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# 21e029a2-68fe1df7-1fd40cef-514c0d33
2025-10-10T14:31:01.509408Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# 53c49eeb-2249d519-8fa270b4-3c60b00d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.509431Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid 53c49eeb-2249d519-8fa270b4-3c60b00d
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-10T14:31:01.356000Z WriteTime: 2025-10-10T14:31:01.411000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:37328", "server": "ipv6:[::1]:37328", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.512839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988738
2025-10-10T14:31:01.512993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-10T14:31:01.513218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-10T14:31:01.513240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988738 WTime 1760106661512
2025-10-10T14:31:01.513462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-10T14:31:01.513474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-10T14:31:01.513617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-10T14:31:01.513756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-10T14:31:01.513899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-10T14:31:01.513992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-10T14:31:01.514475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-10T14:31:01.514492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000016_00000_0000000002_00008?
2025-10-10T14:31:01.514494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.514633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-10T14:31:01.514775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-10T14:31:01.514922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-10T14:31:01.515073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-10T14:31:01.515277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-10T14:31:01.515776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 5735568 count 3 nextOffset 17 batches 11
2025-10-10T14:31:01.515789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-10T14:31:01.515934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-10T14:31:01.516077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-10T14:31:01.516222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-10T14:31:01.516274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-10T14:31:01.516738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 7988766 count 4 nextOffset 18 batches 15
2025-10-10T14:31:01.516827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,4 HeadOffset 10 endOffset 14 curOffset 18 d0000000000_00000000000000000014_00002_0000000004_00014| size 7988756 WTime 1760106661516
2025-10-10T14:31:01.519985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.520000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.520073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-10T14:31:01.520129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-10T14:31:01.520185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-10T14:31:01.520238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-10T14:31:01.520267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-10T14:31:01.520276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-10T14:31:01.520304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.520312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.520348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.520356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.520376Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.520395Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988738
2025-10-10T14:31:01.520409Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988756
2025-10-10T14:31:01.520422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.520447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.520679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-10T14:31:01.520719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 9 count 8 size 524288 endOffset 18 max time lag 0ms effective offset 9
2025-10-10T14:31:01.520742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 0 count 1 last offset 7, current partition end offset: 18
2025-10-10T14:31:01.520764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.521301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-10T14:31:01.521326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295579 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.521354Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-10T14:31:01.521371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-10-10T14:31:01.521383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:01.522589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.523040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 1 size 717094 from pos 1 cbcount 2
2025-10-10T14:31:01.523096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.523363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.523867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.524008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.524081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T14:31:01.525169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-10T14:31:01.526038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.526051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.526120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-10T14:31:01.526177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-10T14:31:01.526228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-10T14:31:01.526286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-10T14:31:01.526329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-10T14:31:01.526335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-10T14:31:01.526353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.526359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.526381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-10-10T14:31:01.526414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 10 count 2 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.526420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 12 count 2 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.526425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.526428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 717135 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.526440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.526459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.526463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.526475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.526486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:31:01.526489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:31:01.528589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.528614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.528625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-10T14:31:01.528634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-10T14:31:01.528638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-10T14:31:01.528643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-10T14:31:01.528650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-10T14:31:01.528656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-10T14:31:01.528663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-10T14:31:01.528667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-10T14:31:01.528671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-10T14:31:01.528676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-10T14:31:01.528680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-10T14:31:01.528684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-10T14:31:01.528693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-10T14:31:01.528698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-10T14:31:01.528702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-10T14:31:01.528706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-10T14:31:01.528711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-10T14:31:01.528715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-10T14:31:01.528720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-10T14:31:01.528724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.528726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-10T14:31:01.528749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.528760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.528762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:31:01.528777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-10T14:31:01.528784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-10T14:31:01.528786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-10T14:31:01.528789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-10T14:31:01.528791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-10T14:31:01.529184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-10T14:31:01.529199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-10T14:31:01.529204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-10T14:31:01.529210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-10T14:31:01.529212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-10T14:31:01.529215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-10T14:31:01.529724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-10-10T14:31:01.529740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-10T14:31:01.529744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-10T14:31:01.529746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-10T14:31:01.529748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-10T14:31:01.529752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-10T14:31:01.530397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-10-10T14:31:01.530414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.530523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 22,3 HeadOffset 22 endOffset 22 curOffset 25 d0000000000_00000000000000000022_00000_0000000003_00012? size 6759616 WTime 1760106661530
2025-10-10T14:31:01.531789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.531829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-10T14:31:01.531853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-10T14:31:01.531858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.531885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-10T14:31:01.531906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-10T14:31:01.531935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-10T14:31:01.531954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-10T14:31:01.531975Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.531988Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 3 size 6759616
2025-10-10T14:31:01.531996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.532033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.532043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.532050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.532058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.532071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 1 size 26214400 endOffset 22 max time lag 0ms effective offset 10
2025-10-10T14:31:01.532080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 0 blobs, size 0 count 0 last offset 10, current partition end offset: 22
2025-10-10T14:31:01.532558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. All data is from uncompacted head.
2025-10-10T14:31:01.532569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-10-10T14:31:01.532596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 9
2025-10-10T14:31:01.533525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 12 }
2025-10-10T14:31:01.533545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 19
2025-10-10T14:31:01.533551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.533962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 29 to 29
2025-10-10T14:31:01.534036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.534222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.534230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-10T14:31:01.534373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.535224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.535267Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.535348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 10 }
2025-10-10T14:31:01.535357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 20
2025-10-10T14:31:01.535362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.535430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 8 }
2025-10-10T14:31:01.535434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 21
2025-10-10T14:31:01.535458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 3 }
2025-10-10T14:31:01.535461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 22
2025-10-10T14:31:01.536678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.536696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.536778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-10T14:31:01.536791Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 22 Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760106661412 CreateTimestampMS: 1760106661363 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760106661423 CreateTimestampMS: 1760106661367 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 21609806 RealReadOffset: 10 WaitQuotaTimeMs: 0 EndOffset: 22 StartOffset: 0 } Cookie: 9 }
2025-10-10T14:31:01.536854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-10T14:31:01.536960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-10T14:31:01.537055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-10T14:31:01.537105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-10T14:31:01.537117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-10T14:31:01.537151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.537159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.537171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.537192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.537290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.537302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988756 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.537365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-10T14:31:01.537370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-10T14:31:01.537377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.537382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-10T14:31:01.537390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.537391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.537395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T14:31:01.537399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '124' size 7988756
2025-10-10T14:31:01.537487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.537690Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 11 endOffset 22
2025-10-10T14:31:01.537719Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 22 ReadOffset 11 ReadGuid 53c49eeb-2249d519-8fa270b4-3c60b00d has messages 1
2025-10-10T14:31:01.537756Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 11, endOffset# 22, WTime# 1760106661423, sizeLag# 21609806
2025-10-10T14:31:01.537767Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:31:01.537793Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# 53c49eeb-2249d519-8fa270b4-3c60b00d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505941
2025-10-10T14:31:01.537809Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# 53c49eeb-2249d519-8fa270b4-3c60b00d
2025-10-10T14:31:01.539161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.539179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000018_00000_0000000003_00015?
2025-10-10T14:31:01.539200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 30 to 30
2025-10-10T14:31:01.539184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000021_00003_0000000001_00001?
2025-10-10T14:31:01.539187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes
2025-10-10T14:31:01.539208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 4506418 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T14:31:01.539212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 6964702 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.539216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 16 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.539224Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.539205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.539527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.539537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-10T14:31:01.539754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.540495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.540515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.540553Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.540775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-10T14:31:01.540868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-10T14:31:01.540934Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 1
2025-10-10T14:31:01.540950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-10T14:31:01.541026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-10T14:31:01.541079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-10T14:31:01.541088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-10T14:31:01.541107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-10T14:31:01.541113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000018_00000_0000000003_00015?
2025-10-10T14:31:01.541129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000021_00003_0000000001_00001?
2025-10-10T14:31:01.541147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-10T14:31:01.541203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.541210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.541216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.541232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.541244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 18 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.541250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 21 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.541263Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-10T14:31:01.541285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '63'
2025-10-10T14:31:01.541297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '63'
2025-10-10T14:31:01.541429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.541442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000018_00000_0000000003_00015?
2025-10-10T14:31:01.541444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.541633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-10T14:31:01.542270Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 4505941, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981653
2025-10-10T14:31:01.542347Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-10T14:31:01.542361Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 4505941 to budget
2025-10-10T14:31:01.542732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988756
2025-10-10T14:31:01.542891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-10T14:31:01.543051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-10T14:31:01.543201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-10T14:31:01.543222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 31 to 31
2025-10-10T14:31:01.543411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-10T14:31:01.543428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988756 WTime 1760106661543
2025-10-10T14:31:01.543515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.543521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-10T14:31:01.543799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-10T14:31:01.543815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-10T14:31:01.543951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-10T14:31:01.543991Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (9-9)
2025-10-10T14:31:01.544002Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T14:31:01.544047Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-10-10T14:31:01.544072Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.544094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-10T14:31:01.544238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-10T14:31:01.544538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-10T14:31:01.363000Z WriteTime: 2025-10-10T14:31:01.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:37328", "logtype": "unknown", "_ip": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.545046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-10T14:31:01.545060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-10T14:31:01.545193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-10T14:31:01.545348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-10T14:31:01.545488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-10T14:31:01.545549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-10T14:31:01.546002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-10T14:31:01.546406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-10T14:31:01.546414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-10T14:31:01.546416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-10T14:31:01.546421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000021_00003_0000000001_00001?
2025-10-10T14:31:01.546423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.546551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-10T14:31:01.547393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 32 to 32
2025-10-10T14:31:01.549702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.549713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-10T14:31:01.549720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.549747Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.550581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295638
2025-10-10T14:31:01.550668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-10T14:31:01.550679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295638 WTime 1760106661550
2025-10-10T14:31:01.550782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-10T14:31:01.550838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,1 HeadOffset 14 endOffset 18 curOffset 22 d0000000000_00000000000000000021_00003_0000000001_00001| size 717135 WTime 1760106661550
2025-10-10T14:31:01.550985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-10T14:31:01.551068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.551076Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.551085Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988756
2025-10-10T14:31:01.551096Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-10-10T14:31:01.551102Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 1 size 717135
2025-10-10T14:31:01.551116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 3 size 6759616 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.551132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.551161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.551165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-10T14:31:01.551171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.551184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.551195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-10T14:31:01.551223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-10T14:31:01.551241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-10T14:31:01.551255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-10T14:31:01.551275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-10T14:31:01.551288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-10T14:31:01.551301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-10T14:31:01.551314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-10T14:31:01.551326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-10T14:31:01.551334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-10T14:31:01.551341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-10T14:31:01.551359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-10T14:31:01.551366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-10T14:31:01.551372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-10T14:31:01.551381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.551385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-10T14:31:01.551434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.551458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.551465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:31:01.551485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-10T14:31:01.551500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-10T14:31:01.551511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-10T14:31:01.551515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-10T14:31:01.551523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-10T14:31:01.552166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 2253230 count 1 nextOffset 26 batches 5
2025-10-10T14:31:01.552191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-10T14:31:01.552196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-10T14:31:01.552199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-10T14:31:01.552202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-10T14:31:01.552204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-10T14:31:01.552728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 4506428 count 2 nextOffset 27 batches 9
2025-10-10T14:31:01.552747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.552830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 25 endOffset 25 curOffset 27 d0000000000_00000000000000000025_00000_0000000002_00008? size 4506418 WTime 1760106661552
2025-10-10T14:31:01.553095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.553728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.556063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.556117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.556124Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.556151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-10T14:31:01.556188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-10T14:31:01.556204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-10T14:31:01.556284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.556315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.556327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.556566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 23 }
2025-10-10T14:31:01.556581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 23
2025-10-10T14:31:01.556598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.556693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 8 }
2025-10-10T14:31:01.556705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 24
2025-10-10T14:31:01.557133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.557146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.557201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 33 to 33
2025-10-10T14:31:01.557216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-10T14:31:01.557275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-10T14:31:01.557356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-10T14:31:01.557429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-10T14:31:01.557470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-10T14:31:01.557477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-10T14:31:01.557498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.557505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.557511Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.557523Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 2 size 4506418
2025-10-10T14:31:01.557531Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00000_0000000002_00008?(+) to d0000000000_00000000000000000014_00000_0000000002_00008?(+)
2025-10-10T14:31:01.557534Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000002_00008?(+) to d0000000000_00000000000000000016_00000_0000000002_00008?(+)
2025-10-10T14:31:01.557535Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00004_0000000004_00012|(+) to d0000000000_00000000000000000010_00004_0000000004_00012|(+)
2025-10-10T14:31:01.557542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.557563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.557613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-10T14:31:01.557629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.557640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-10T14:31:01.557706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.558052Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (10-10)
2025-10-10T14:31:01.558070Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-10T14:31:01.558082Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505941, ReadSizeServerDelta = -3981653
2025-10-10T14:31:01.558183Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.558198Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.558300Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505941 } }
2025-10-10T14:31:01.558390Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# 2bdc02c5-3218ddb5-651260a4-62563066
2025-10-10T14:31:01.558410Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# d865c8b6-9e5c67e2-d4f93c15-727d15e7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 13, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.558426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 3 }
2025-10-10T14:31:01.558425Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 13 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 11 EndOffset 22 ClientCommitOffset 0 committedOffset 0 Guid d865c8b6-9e5c67e2-d4f93c15-727d15e7
2025-10-10T14:31:01.558445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 25
2025-10-10T14:31:01.558580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.558591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.558624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 11 count 13 size 524288 endOffset 25 max time lag 0ms effective offset 11
2025-10-10T14:31:01.558645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 0 count 3 last offset 10, current partition end offset: 25
2025-10-10T14:31:01.558962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-10T14:31:01.558982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 4 count 4 parts_count 14 source 1 size 7988738 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.558995Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 14. All 1 blobs are from cache.
2025-10-10T14:31:01.559017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0'
2025-10-10T14:31:01.559022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-10T14:31:01.367000Z WriteTime: 2025-10-10T14:31:01.423000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:37328", "server": "ipv6:[::1]:37328", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.559332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 1 cbcount 2
2025-10-10T14:31:01.559493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.559560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.559785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.559992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.560198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-10T14:31:01.560005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.560330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.560459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.560604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.560818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-10T14:31:01.560965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.561112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.561258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.561482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-10T14:31:01.561775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-10T14:31:01.562567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.562580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.562643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-10T14:31:01.562695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-10-10T14:31:01.562749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-10T14:31:01.562803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-10T14:31:01.562847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-10T14:31:01.562853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-10T14:31:01.562869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.562875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.562895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 11
2025-10-10T14:31:01.562914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.562931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.563049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 34 to 34
2025-10-10T14:31:01.563645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.563656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-10T14:31:01.563698Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.565198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-10T14:31:01.567666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 35 to 35
2025-10-10T14:31:01.567809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.568126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.568137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-10T14:31:01.568145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.568186Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.569600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.569939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.570403Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 25 Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760106661424 CreateTimestampMS: 1760106661371 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760106661448 CreateTimestampMS: 1760106661374 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760106661449 CreateTimestampMS: 1760106661383 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 9525067 RealReadOffset: 13 WaitQuotaTimeMs: 0 EndOffset: 25 StartOffset: 0 } Cookie: 11 }
2025-10-10T14:31:01.571962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.571986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.572097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-10T14:31:01.572177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-10T14:31:01.572272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-10T14:31:01.572356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-10-10T14:31:01.572411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-10T14:31:01.572421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-10T14:31:01.572448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.572458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.572487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.572515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.572762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-10T14:31:01.572832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.573364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988756 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.573378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.573383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 717135 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.573433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '124' size 7988756
2025-10-10T14:31:01.573437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 4506418 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.573447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.573449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-10T14:31:01.573450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T14:31:01.573455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:31:01.573458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-10T14:31:01.573462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-10-10T14:31:01.573475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:31:01.573482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.573486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.573715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.573728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.573734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.573752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.573763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573743Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 14 endOffset 25
2025-10-10T14:31:01.573762Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 25 ReadOffset 14 ReadGuid d865c8b6-9e5c67e2-d4f93c15-727d15e7 has messages 1
2025-10-10T14:31:01.573773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-10T14:31:01.573780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-10T14:31:01.573786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-10T14:31:01.573793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-10T14:31:01.573803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-10T14:31:01.573804Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 14, endOffset# 25, WTime# 1760106661449, sizeLag# 9525067
2025-10-10T14:31:01.573810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573811Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:31:01.573814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-10T14:31:01.573815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-10T14:31:01.573821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573823Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# d865c8b6-9e5c67e2-d4f93c15-727d15e7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6758905
2025-10-10T14:31:01.573824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-10T14:31:01.573835Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# d865c8b6-9e5c67e2-d4f93c15-727d15e7
2025-10-10T14:31:01.573826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-10T14:31:01.573832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.573835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-10T14:31:01.573868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.573893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.573900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:31:01.573936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-10T14:31:01.573954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-10T14:31:01.573963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-10T14:31:01.573967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-10T14:31:01.573970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-10T14:31:01.574541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.574758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-10T14:31:01.574792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-10T14:31:01.574805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-10T14:31:01.574810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-10T14:31:01.574820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-10T14:31:01.574824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-10T14:31:01.574976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.575224Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 1
2025-10-10T14:31:01.575471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 4506428 count 2 nextOffset 29 batches 9
2025-10-10T14:31:01.575488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-10T14:31:01.575494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-10T14:31:01.575497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-10T14:31:01.575499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-10T14:31:01.575501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-10T14:31:01.575960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 6759626 count 3 nextOffset 30 batches 13
2025-10-10T14:31:01.575972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.576054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 27,3 HeadOffset 27 endOffset 27 curOffset 30 d0000000000_00000000000000000027_00000_0000000003_00012? size 6759616 WTime 1760106661575
2025-10-10T14:31:01.576840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000003_00012?
2025-10-10T14:31:01.576849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-10T14:31:01.576851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes
2025-10-10T14:31:01.576865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 8
2025-10-10T14:31:01.576868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988756 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T14:31:01.576872Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.576884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 717135 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.576886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 6759616 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.576887Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.576908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-10T14:31:01.576936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-10T14:31:01.577036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.577062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.577640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 14 }
2025-10-10T14:31:01.577655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 26
2025-10-10T14:31:01.577661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.577749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 10 }
2025-10-10T14:31:01.577759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 27
2025-10-10T14:31:01.578096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 36 to 36
2025-10-10T14:31:01.578390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.578407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-10T14:31:01.578448Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.578959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.578972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.579044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-10T14:31:01.579101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-10T14:31:01.579155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-10T14:31:01.579208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-10T14:31:01.579245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-10T14:31:01.579251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-10T14:31:01.579268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.579273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.579278Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.579291Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 3 size 6759616
2025-10-10T14:31:01.579300Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000003_00015?(+) to d0000000000_00000000000000000018_00000_0000000003_00015?(+)
2025-10-10T14:31:01.579302Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000001_00001?(+) to d0000000000_00000000000000000021_00003_0000000001_00001?(+)
2025-10-10T14:31:01.579304Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00002_0000000004_00014|(+) to d0000000000_00000000000000000014_00002_0000000004_00014|(+)
2025-10-10T14:31:01.579310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-10T14:31:01.579315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000003_00012?
2025-10-10T14:31:01.579321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-10T14:31:01.579330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-10T14:31:01.579360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.579379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.579423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 22 partno 0 count 3 parts_count 12 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.579431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.579441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 2 from KV
2025-10-10T14:31:01.579447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-10T14:31:01.579468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63'
2025-10-10T14:31:01.579484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 22 partno 0 count 3 parts_count 12
2025-10-10T14:31:01.579554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.580201Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 6758905, now ReadSizeBudget = 0, ReadSizeServerDelta = -6234617
2025-10-10T14:31:01.580276Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-10-10T14:31:01.580301Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 6758905 to budget
2025-10-10T14:31:01.580851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 37 to 37
2025-10-10T14:31:01.581178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.581184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-10T14:31:01.581187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.581688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.581989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.582141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.582159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.582226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-10T14:31:01.582294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-10T14:31:01.582356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-10T14:31:01.582438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-10T14:31:01.582483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-10T14:31:01.582491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-10T14:31:01.582512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.582517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.582524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.582547Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (11-11)
2025-10-10T14:31:01.582540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.582552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-10T14:31:01.582567Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-10T14:31:01.582613Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (12-12)
2025-10-10T14:31:01.582645Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.582623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-10T14:31:01.371000Z WriteTime: 2025-10-10T14:31:01.424000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:37328", "_ip": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.584359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.584821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.584925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.584941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.585015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-10T14:31:01.585069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-10T14:31:01.585121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-10-10T14:31:01.585177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-10T14:31:01.585221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-10T14:31:01.585227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-10T14:31:01.585244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.585252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.585259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.585276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.585287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-10T14:31:01.585367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.586871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.587460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.587482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.587503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.587557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-10T14:31:01.587618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-10T14:31:01.587674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-10T14:31:01.587726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-10T14:31:01.587768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-10T14:31:01.587775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-10T14:31:01.587791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.587798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.587806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.587826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.587838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-10T14:31:01.587902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.589224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.589519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.589993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.590006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.590067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-10T14:31:01.590115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-10T14:31:01.590176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-10-10T14:31:01.590230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-10T14:31:01.590331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-10T14:31:01.590337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-10T14:31:01.590353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.590355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.590361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.590376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.590388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-10T14:31:01.590447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.591868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.592279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.594176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.594189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.594251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-10T14:31:01.594299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-10T14:31:01.594362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-10T14:31:01.594419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-10T14:31:01.594457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-10T14:31:01.594463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-10T14:31:01.594544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.594550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.594562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-10T14:31:01.594567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:01.594576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 22 count 3 size 6759616 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.594623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.594629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-10T14:31:01.594635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.594638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.594663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 3 size 6759616 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.594677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.594680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-10T14:31:01.594684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.594689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000022_00000_0000000003_00012?
2025-10-10T14:31:01.594691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.594996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-10T14:31:01.595141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-10T14:31:01.595286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-10T14:31:01.595430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-10T14:31:01.595632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-10T14:31:01.595992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-10T14:31:01.596005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-10T14:31:01.596131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-10T14:31:01.596266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-10T14:31:01.596402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-10T14:31:01.596616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-10T14:31:01.597113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-10-10T14:31:01.597129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-10T14:31:01.597263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-10T14:31:01.597430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-10T14:31:01.597578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-10T14:31:01.597641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-10T14:31:01.598201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-10-10T14:31:01.598216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-10T14:31:01.598219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.598346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-10T14:31:01.598488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-10T14:31:01.600089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988782
2025-10-10T14:31:01.600229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-10T14:31:01.600370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-10T14:31:01.600570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-10T14:31:01.600588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988782 WTime 1760106661600
2025-10-10T14:31:01.600872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-10T14:31:01.600885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-10T14:31:01.601026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-10T14:31:01.601177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-10T14:31:01.601347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-10T14:31:01.601417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-10T14:31:01.601872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-10T14:31:01.601971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 21 endOffset 22 curOffset 27 d0000000000_00000000000000000025_00001_0000000002_00007| size 3994387 WTime 1760106661601
2025-10-10T14:31:01.605089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.605100Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.605112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.605131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.605143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-10T14:31:01.605164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-10T14:31:01.605171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-10T14:31:01.605179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-10T14:31:01.605193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-10T14:31:01.605201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-10T14:31:01.605207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-10T14:31:01.605214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-10T14:31:01.605224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-10T14:31:01.605234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-10T14:31:01.605248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-10T14:31:01.605253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-10T14:31:01.605262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-10T14:31:01.605267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-10T14:31:01.605272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.605276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-10T14:31:01.605317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.605353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.605358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (30)
2025-10-10T14:31:01.605375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-10T14:31:01.605387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-10T14:31:01.605394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-10T14:31:01.605397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-10T14:31:01.605400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-10T14:31:01.605781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 2253230 count 1 nextOffset 31 batches 5
2025-10-10T14:31:01.605801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-10T14:31:01.605806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-10T14:31:01.605809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-10T14:31:01.605813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-10T14:31:01.605815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-10T14:31:01.606324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 4506428 count 2 nextOffset 32 batches 9
2025-10-10T14:31:01.606341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-10T14:31:01.606348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-10T14:31:01.606355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-10T14:31:01.606357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-10T14:31:01.606360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-10T14:31:01.606995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 6759626 count 3 nextOffset 33 batches 13
2025-10-10T14:31:01.607011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-10T14:31:01.607016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-10T14:31:01.607019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-10T14:31:01.607022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-10T14:31:01.612746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 34 partNo 3 result is x0000000000_00000000000000000030_00000_0000000003_00015? size 8295638
2025-10-10T14:31:01.612763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-10T14:31:01.612774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000030_00000_0000000003_00015? new key d0000000000_00000000000000000030_00000_0000000003_00015? size 8295638 WTime 1760106661612
2025-10-10T14:31:01.613217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 1 NewHead: Offset 33 PartNo 3 PackedSize 717145 count 1 nextOffset 34 batches 2
2025-10-10T14:31:01.613233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-10T14:31:01.613237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-10T14:31:01.613241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-10T14:31:01.613244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-10T14:31:01.613250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-10T14:31:01.613775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 3 PackedSize 2970343 count 2 nextOffset 35 batches 6
2025-10-10T14:31:01.613793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-10T14:31:01.613798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-10T14:31:01.613801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-10T14:31:01.613811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-10T14:31:01.613814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-10T14:31:01.614305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 3 PackedSize 5223541 count 3 nextOffset 36 batches 10
2025-10-10T14:31:01.614322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.614425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 33,3 HeadOffset 30 endOffset 30 curOffset 36 d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531 WTime 1760106661614
2025-10-10T14:31:01.615395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.615438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-10T14:31:01.615467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988756 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.615474Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.615563Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.615576Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988782
2025-10-10T14:31:01.615582Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 2 size 3994387
2025-10-10T14:31:01.615556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.615604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-10T14:31:01.615633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-10T14:31:01.615655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-10T14:31:01.615668Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.615682Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 3 size 8295638
2025-10-10T14:31:01.615695Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 3 count 3 size 5223531
2025-10-10T14:31:01.616578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.616595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.616599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.616865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 16 }
2025-10-10T14:31:01.616878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 28
2025-10-10T14:31:01.616884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.616968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 12 }
2025-10-10T14:31:01.616972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 29
2025-10-10T14:31:01.617304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 38 to 38
2025-10-10T14:31:01.617638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.617648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-10T14:31:01.617792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.617809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.617878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-10T14:31:01.617953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-10T14:31:01.618009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-10T14:31:01.618068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-10T14:31:01.618112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-10T14:31:01.618120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-10T14:31:01.618137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.618160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.618670Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.619265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.619343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 3 }
2025-10-10T14:31:01.619357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 30
2025-10-10T14:31:01.619511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.619613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.619623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.619639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-10T14:31:01.619684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.620683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 39 to 39
2025-10-10T14:31:01.620980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.620987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-10T14:31:01.621682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.621700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.621857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-10T14:31:01.621970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-10T14:31:01.622097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-10T14:31:01.622174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-10T14:31:01.622229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-10T14:31:01.622241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-10T14:31:01.622271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.622284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.622322Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (12-12)
2025-10-10T14:31:01.622341Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-10T14:31:01.622380Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (13-13)
2025-10-10T14:31:01.622396Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.622701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.622969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.623121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.623136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.623159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-10T14:31:01.623209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.623564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988782 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.623575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 3994387 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.623590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.623592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T14:31:01.623616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-10T14:31:01.623627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-10-10T14:31:01.623631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-10T14:31:01.374000Z WriteTime: 2025-10-10T14:31:01.448000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:37328", "_ip": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.624236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.624247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:31:01.624259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.624263Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.625140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.625154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.625218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-10T14:31:01.625268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-10T14:31:01.625318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-10T14:31:01.625394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-10-10T14:31:01.625424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-10T14:31:01.625429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-10T14:31:01.625442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.625460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.626385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 40 to 40
2025-10-10T14:31:01.626667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.626675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-10T14:31:01.627630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.627666Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.628266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.628528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.628676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.628687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.628705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-10T14:31:01.628773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.629488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 3 size 8295638 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.629500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.629513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.629528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-10-10T14:31:01.629529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 13517466 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.629532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:31:01.629535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.629541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:31:01.629543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-10T14:31:01.629544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:01.629547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-10T14:31:01.629553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-10T14:31:01.629559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-10T14:31:01.629568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-10T14:31:01.629574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-10T14:31:01.629582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-10T14:31:01.629589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-10T14:31:01.629595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-10T14:31:01.629601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-10T14:31:01.629612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-10T14:31:01.629617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-10T14:31:01.629623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-10T14:31:01.629628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-10T14:31:01.629634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-10T14:31:01.629639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-10T14:31:01.629644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-10T14:31:01.629649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-10T14:31:01.629661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-10T14:31:01.629668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-10T14:31:01.629676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-10T14:31:01.629689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-10T14:31:01.629695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-10T14:31:01.629705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-10T14:31:01.629711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-10T14:31:01.629717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-10T14:31:01.629723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-10T14:31:01.629730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-10T14:31:01.629736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-10T14:31:01.629741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.629747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-10T14:31:01.629795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.629814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.629817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:31:01.629841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-10T14:31:01.629855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-10T14:31:01.629862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-10T14:31:01.629865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-10T14:31:01.629868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-10T14:31:01.630285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-10-10T14:31:01.630305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-10T14:31:01.630314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-10T14:31:01.630317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-10T14:31:01.630320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-10T14:31:01.630323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-10T14:31:01.630860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-10-10T14:31:01.630877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-10T14:31:01.630883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-10T14:31:01.630890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-10T14:31:01.630893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-10T14:31:01.630895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-10T14:31:01.631419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 6759626 count 3 nextOffset 39 batches 13
2025-10-10T14:31:01.631433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.631530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,3 HeadOffset 36 endOffset 36 curOffset 39 d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616 WTime 1760106661631
2025-10-10T14:31:01.632362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-10T14:31:01.632370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000003_00015?
2025-10-10T14:31:01.632372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 15055254 bytes
2025-10-10T14:31:01.632399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 4506418 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T14:31:01.632407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 6759616 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.632409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 717135 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.632413Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.632432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-10T14:31:01.632456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-10T14:31:01.632471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-10T14:31:01.632482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-10T14:31:01.632492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-10T14:31:01.632505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-10T14:31:01.632538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.632565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.632572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.632580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.632587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.632596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.632925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 26 }
2025-10-10T14:31:01.632939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 31
2025-10-10T14:31:01.632943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.633205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.633218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.633276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 41 to 41
2025-10-10T14:31:01.633288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-10T14:31:01.633374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-10T14:31:01.633448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-10T14:31:01.633510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-10T14:31:01.633547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-10T14:31:01.633554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-10T14:31:01.633571Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.633591Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 3 size 6759616
2025-10-10T14:31:01.633600Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000003_00012?(+) to d0000000000_00000000000000000022_00000_0000000003_00012?(+)
2025-10-10T14:31:01.633606Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000002_00008?(+) to d0000000000_00000000000000000025_00000_0000000002_00008?(+)
2025-10-10T14:31:01.633609Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000001_00001|(+) to d0000000000_00000000000000000021_00003_0000000001_00001|(+)
2025-10-10T14:31:01.633616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-10T14:31:01.633623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-10T14:31:01.633627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.633636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:01.633633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000003_00015?
2025-10-10T14:31:01.633649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-10T14:31:01.633657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.633678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.633736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.633744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.633754Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-10T14:31:01.633779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63'
2025-10-10T14:31:01.633789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 3 parts 15 suffix '63'
2025-10-10T14:31:01.633804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.633814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-10T14:31:01.633821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.633994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-10T14:31:01.634176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-10T14:31:01.634340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-10T14:31:01.634504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-10T14:31:01.634695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.634706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-10T14:31:01.635107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-10T14:31:01.635121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-10T14:31:01.635243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.635287Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (13-13)
2025-10-10T14:31:01.635316Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-10T14:31:01.635327Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In ContinueReadingDataImpl, ReadSizeBudget = 6758905, ReadSizeServerDelta = -6234617
2025-10-10T14:31:01.635395Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:31:01.635403Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:31:01.635264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-10T14:31:01.635417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-10T14:31:01.635524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.635528Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 grpc read done: success# 1, data# { read_request { bytes_size: 6758905 } }
2025-10-10T14:31:01.635584Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 got read request: guid# 1374dc58-20067960-11583f3c-41ad43d1
2025-10-10T14:31:01.635575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-10T14:31:01.635607Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 performing read request: guid# 313ccab8-f2845f3-3e7235f6-a6215f08, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 13, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:31:01.635651Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 13 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 14 EndOffset 25 ClientCommitOffset 0 committedOffset 0 Guid 313ccab8-f2845f3-3e7235f6-a6215f08
2025-10-10T14:31:01.635802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-10T14:31:01.635850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 23 }
2025-10-10T14:31:01.635861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 32
2025-10-10T14:31:01.635867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.635942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 20 }
2025-10-10T14:31:01.635945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 33
2025-10-10T14:31:01.635985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 18 }
2025-10-10T14:31:01.635988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 34
2025-10-10T14:31:01.636009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 23 }
2025-10-10T14:31:01.636012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 35
2025-10-10T14:31:01.636044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 19 }
2025-10-10T14:31:01.636050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 36
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-10T14:31:01.383000Z WriteTime: 2025-10-10T14:31:01.449000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:37328", "logtype": "unknown", "_ip": "ipv6:[::1]:37328" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T14:31:01.637313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295604
2025-10-10T14:31:01.637347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295604 WTime 1760106661637
2025-10-10T14:31:01.637369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
2025-10-10T14:31:01.637380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-10T14:31:01.637522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-10T14:31:01.637672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-10T14:31:01.637827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-10T14:31:01.637908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-10T14:31:01.638386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 2458316 count 2 nextOffset 30 batches 5
2025-10-10T14:31:01.638403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00000_0000000003_00015?
2025-10-10T14:31:01.638404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.638522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-10T14:31:01.638654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-10T14:31:01.638784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-10T14:31:01.638920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-10T14:31:01.639100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-10T14:31:01.639331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 42 to 42
2025-10-10T14:31:01.639584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 4711514 count 3 nextOffset 31 batches 9
2025-10-10T14:31:01.639599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-10T14:31:01.639637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.639645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-10T14:31:01.639728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-10T14:31:01.639860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-10T14:31:01.639998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-10T14:31:01.640176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-10T14:31:01.640686Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-10T14:31:01.640683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 6964712 count 4 nextOffset 32 batches 13
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }2025-10-10T14:31:01.640698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-10T14:31:01.640820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-10T14:31:01.640953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-10T14:31:01.642239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 33 partNo 2 result is x0000000000_00000000000000000028_00004_0000000004_00014 size 7988738
2025-10-10T14:31:01.642369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-10T14:31:01.642422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-10T14:31:01.642436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00004_0000000004_00014 new key d0000000000_00000000000000000028_00004_0000000004_00014 size 7988738 WTime 1760106661642
2025-10-10T14:31:01.642636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 2 PackedSize 1229172 count 1 nextOffset 33 batches 3
2025-10-10T14:31:01.643028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-10T14:31:01.643040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-10T14:31:01.643042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-10T14:31:01.643103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,1 HeadOffset 25 endOffset 27 curOffset 33 d0000000000_00000000000000000032_00002_0000000001_00002| size 1229162 WTime 1760106661642
2025-10-10T14:31:01.643189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 43 to 43
2025-10-10T14:31:01.643292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.643303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.643327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.643335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.643358Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.643374Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295604
2025-10-10T14:31:01.643383Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 7988738
2025-10-10T14:31:01.643387Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 1 size 1229162
2025-10-10T14:31:01.643484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.643494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-10T14:31:01.643592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-10T14:31:01.643628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 13 size 524288 endOffset 36 max time lag 0ms effective offset 14
2025-10-10T14:31:01.643656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 2 blobs, size 7988756 count 4 last offset 14, current partition end offset: 36
2025-10-10T14:31:01.643667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-10-10T14:31:01.643676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.643683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.643687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 15. Have to read 2 of 2 from KV
2025-10-10T14:31:01.643703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.643780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-10T14:31:01.643789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-10T14:31:01.644464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.644493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.644509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-10-10T14:31:01.644511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.644515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.644518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-10T14:31:01.644532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 1, Offset: 36 is stored on disk
2025-10-10T14:31:01.644539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 2, Offset: 36 is stored on disk
2025-10-10T14:31:01.644546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 3, Offset: 36 is stored on disk
2025-10-10T14:31:01.644562Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:31:01.644559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
>>> Got event: 2025-10-10T14:31:01.644572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 4, Offset: 36 is stored on disk
2025-10-10T14:31:01.644574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.644579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-10T14:31:01.644583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 1, Offset: 37 is stored on disk
2025-10-10T14:31:01.644594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 2, Offset: 37 is stored on disk
2025-10-10T14:31:01.644601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 3, Offset: 37 is stored on disk
2025-10-10T14:31:01.644609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 4, Offset: 37 is stored on disk
2025-10-10T14:31:01.644621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-10T14:31:01.644628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 1, Offset: 38 is stored on disk
2025-10-10T14:31:01.644641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 2, Offset: 38 is stored on disk
2025-10-10T14:31:01.644656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 3, Offset: 38 is stored on disk
2025-10-10T14:31:01.644667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.644673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 4, Offset: 38 is stored on disk
2025-10-10T14:31:01.644717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.644735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.644742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:31:01.644761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-10T14:31:01.644776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-10T14:31:01.644783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-10T14:31:01.644786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-10T14:31:01.644794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-10T14:31:01.645397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 0 PackedSize 2253230 count 1 nextOffset 40 batches 5
2025-10-10T14:31:01.645425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.645458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.645564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 39,1 HeadOffset 39 endOffset 39 curOffset 40 d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220 WTime 1760106661645
2025-10-10T14:31:01.645781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.646062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.646086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988782 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.646093Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.646119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-10-10T14:31:01.646144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 38
2025-10-10T14:31:01.646154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 39
2025-10-10T14:31:01.646197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.646217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.646228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.646407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 11 }
2025-10-10T14:31:01.646421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 37
2025-10-10T14:31:01.646489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 8 }
2025-10-10T14:31:01.646493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 38
2025-10-10T14:31:01.646516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 5 }
2025-10-10T14:31:01.646520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 39
2025-10-10T14:31:01.646860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.646872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.646937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-10T14:31:01.646986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-10T14:31:01.647035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-10T14:31:01.647091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-10T14:31:01.647142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-10T14:31:01.647151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-10T14:31:01.647177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.647186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.647201Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.647220Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 0 count 1 size 2253220
2025-10-10T14:31:01.647234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.647263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.647322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-10T14:31:01.647383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 44 to 44
2025-10-10T14:31:01.647397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.647691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.647698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-10T14:31:01.648654Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.649112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.649571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.649612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.649624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.649699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-10T14:31:01.649752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-10T14:31:01.649802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-10T14:31:01.649855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-10T14:31:01.649900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-10T14:31:01.649911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-10T14:31:01.649947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.649954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.649961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.649975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.649987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-10-10T14:31:01.650067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.651138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.651486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.651745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.651938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 45 to 45
2025-10-10T14:31:01.652200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.652216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.652368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.652366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-10T14:31:01.652378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-10T14:31:01.652449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-10T14:31:01.652516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-10T14:31:01.652576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-10T14:31:01.652629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-10T14:31:01.652636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-10T14:31:01.652655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.652661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.652668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.652684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.652696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-10T14:31:01.652753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.653469Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.653940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.654215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.654594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.654613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.654687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 87 size: 511959
2025-10-10T14:31:01.654749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 87 size: 511959
2025-10-10T14:31:01.654813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 87 size: 511959
2025-10-10T14:31:01.654874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 87 size: 511959
2025-10-10T14:31:01.654922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size: 205040
2025-10-10T14:31:01.654932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size 205040 offset: -1
2025-10-10T14:31:01.654959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.654967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.654983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.654999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.655010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 45
2025-10-10T14:31:01.655085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.655924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 46 to 46
2025-10-10T14:31:01.656214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.656222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-10T14:31:01.657053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.657067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.657149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size: 511959
2025-10-10T14:31:01.657216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 89 size: 511959
2025-10-10T14:31:01.657285Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.657284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 89 size: 511959
2025-10-10T14:31:01.657374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 89 size: 511959
2025-10-10T14:31:01.657422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size: 205040
2025-10-10T14:31:01.657430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size 205040 offset: -1
2025-10-10T14:31:01.657446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.657467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.657757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.658191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.658314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.658327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.658342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-10-10T14:31:01.658405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.659904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 47 to 47
2025-10-10T14:31:01.660188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.660195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-10T14:31:01.660645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.660662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.660821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size: 511959
2025-10-10T14:31:01.660892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 91 size: 511959
2025-10-10T14:31:01.660966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 91 size: 511959
2025-10-10T14:31:01.661035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 91 size: 511959
2025-10-10T14:31:01.661092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size: 205040
2025-10-10T14:31:01.661100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size 205040 offset: -1
2025-10-10T14:31:01.661116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.661133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.661270Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.661654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.661903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.662032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.662045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.662060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-10T14:31:01.662135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.664131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.664146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.664227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size: 511959
2025-10-10T14:31:01.664280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 93 size: 511959
2025-10-10T14:31:01.664335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 93 size: 511959
2025-10-10T14:31:01.664413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 93 size: 511959
2025-10-10T14:31:01.664466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size: 205040
2025-10-10T14:31:01.664475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size 205040 offset: -1
2025-10-10T14:31:01.664491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.664507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.664733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 48 to 48
2025-10-10T14:31:01.665018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.665027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-10T14:31:01.666133Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.666588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.667403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.667492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.667507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.667526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-10-10T14:31:01.667584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.668354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 49 to 49
2025-10-10T14:31:01.668632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.668638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-10T14:31:01.669672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.669661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.669677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.669701Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.669739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 95 size: 511959
2025-10-10T14:31:01.669795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 95 size: 511959
2025-10-10T14:31:01.669874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 95 size: 511959
2025-10-10T14:31:01.669949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 95 size: 511959
2025-10-10T14:31:01.670001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size: 205040
2025-10-10T14:31:01.670010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size 205040 offset: -1
2025-10-10T14:31:01.670046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.670064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.670170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.670837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.675556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.675574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.675590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-10T14:31:01.675595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:01.675598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:01.675605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.675608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988756 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.675654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-10T14:31:01.675667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:01.675671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-10T14:31:01.675676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.675678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-10T14:31:01.675816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-10T14:31:01.678278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-10T14:31:01.678474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.678628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.678839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-10T14:31:01.679000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.679154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.679304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.679526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-10T14:31:01.679684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.679836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.679991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.680220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 16 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-10T14:31:01.680371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.680532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.680685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:01.680877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 17 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-10T14:31:01.680937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 33 size 5223531 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.680945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 3994387 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.680956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 6759616 cause it's been evicted from L2. Actual L1 size: 4
2025-10-10T14:31:01.680961Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.680983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 49
2025-10-10T14:31:01.681096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 14
2025-10-10T14:31:01.681081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.681126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.681141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295604 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.681145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 7988738 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.681151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 1 size 1229162 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.681167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:01.681178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:31:01.681184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-10T14:31:01.681187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.681189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-10T14:31:01.681193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-10T14:31:01.681195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 1 parts 2 suffix '124' size 1229162
2025-10-10T14:31:01.684393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.684411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.684418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.684424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-10T14:31:01.684427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.684430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 1, Offset: 39 is stored on disk
2025-10-10T14:31:01.684431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.684434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 2, Offset: 39 is stored on disk
2025-10-10T14:31:01.684442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.684445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 3, Offset: 39 is stored on disk
2025-10-10T14:31:01.684449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:31:01.684452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 4, Offset: 39 is stored on disk
2025-10-10T14:31:01.684479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.684506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.684510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (40)
2025-10-10T14:31:01.684530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:31:01.684542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:31:01.684548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:31:01.684551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:31:01.684554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:31:01.684931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:31:01.684950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:31:01.684955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:31:01.684958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:31:01.684960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:31:01.684962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:31:01.685462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:31:01.685476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:31:01.685481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:31:01.685483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:31:01.685486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:31:01.685489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:31:01.686214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:31:01.686230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:31:01.686234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:31:01.686237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:31:01.686239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:31:01.687491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:31:01.687505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:31:01.687514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760106661687
2025-10-10T14:31:01.687619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:31:01.687628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:31:01.687630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:31:01.687632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:31:01.687634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:31:01.687637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:31:01.688193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:31:01.688209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:31:01.688213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:31:01.688215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:31:01.688218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:31:01.688220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:31:01.688663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:31:01.688675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:31:01.688679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:31:01.688682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:31:01.688684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:31:01.688687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:31:01.689367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:31:01.689382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:31:01.689386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:31:01.690508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:31:01.690522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:31:01.690528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:31:01.690530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:31:01.690538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760106661690
2025-10-10T14:31:01.690564Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 39 Result { Offset: 14 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 15 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760106661462 CreateTimestampMS: 1760106661385 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 16 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760106661463 CreateTimestampMS: 1760106661407 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 17 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760106661479 CreateTimestampMS: 1760106661417 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 18 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760106661479 CreateTimestampMS: 1760106661423 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 18025961 RealReadOffset: 17 WaitQuotaTimeMs: 0 EndOffset: 39 StartOffset: 0 } Cookie: 14 }
2025-10-10T14:31:01.690820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:31:01.690833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.690927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,1 HeadOffset 40 endOffset 40 curOffset 48 d0000000000_00000000000000000047_00001_0000000001_00003? size 1741189 WTime 1760106661690
2025-10-10T14:31:01.691141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.691172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.691178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T14:31:01.691388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.691397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.691400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:01.691401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:01.691403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:01.691414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 36 size 6759616 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T14:31:01.691418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.691420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T14:31:01.691423Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.691655Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 18 endOffset 39
2025-10-10T14:31:01.691679Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 39 ReadOffset 18 ReadGuid 313ccab8-f2845f3-3e7235f6-a6215f08 has messages 1
2025-10-10T14:31:01.691709Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 18, endOffset# 39, WTime# 1760106661479, sizeLag# 18025961
2025-10-10T14:31:01.691720Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:31:01.691737Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 read done: guid# 313ccab8-f2845f3-3e7235f6-a6215f08, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011748
2025-10-10T14:31:01.691751Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 response to read: guid# 313ccab8-f2845f3-3e7235f6-a6215f08
2025-10-10T14:31:01.692291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.692303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.692374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size: 511959
2025-10-10T14:31:01.692429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 97 size: 511959
2025-10-10T14:31:01.692483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 97 size: 511959
2025-10-10T14:31:01.692562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 97 size: 511959
2025-10-10T14:31:01.692603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size: 205040
2025-10-10T14:31:01.692609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size 205040 offset: -1
2025-10-10T14:31:01.692642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-10-10T14:31:01.692659Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.692672Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:31:01.692679Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:31:01.692683Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 1 size 1741189
2025-10-10T14:31:01.692692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:01.692697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.692703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:01.692709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:01.692721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:01.692737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.692753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.692770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.692814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.692819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.692823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 39 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-10T14:31:01.000000Z
2025-10-10T14:31:01.692831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 3 from KV
2025-10-10T14:31:01.692852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63'
2025-10-10T14:31:01.692863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:01.692866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:01.693103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 39 queued_in_partition_duration_ms: 11 }
2025-10-10T14:31:01.693117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: acknoledged message 40
2025-10-10T14:31:01.693123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T14:31:01.693551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write 1 messages with Id from 50 to 50
2025-10-10T14:31:01.693990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: try to update token
2025-10-10T14:31:01.694001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-10T14:31:01.694970Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 Process answer. Aval parts: 1
2025-10-10T14:31:01.695787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T14:31:01.695831Z :NOTICE: [/Invalid] [/Invalid] [4784c39e-44e0711c-b5cdc739-5093f94c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:15287" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:15287. " }
2025-10-10T14:31:01.697524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.697811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.698035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.698053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.698085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 50
2025-10-10T14:31:01.698193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:01.699048Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got ReadResponse, serverBytesSize = 9011748, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487460
2025-10-10T14:31:01.699130Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (14-14)
2025-10-10T14:31:01.699143Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Returning serverBytesSize = 9011748 to budget
2025-10-10T14:31:01.700593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.700608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.700706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 99 size: 511959
2025-10-10T14:31:01.700758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 99 size: 511959
2025-10-10T14:31:01.700814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 99 size: 511959
2025-10-10T14:31:01.700926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 99 size: 511959
2025-10-10T14:31:01.700974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size: 205040
2025-10-10T14:31:01.700984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size 205040 offset: -1
2025-10-10T14:31:01.701002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:31:01.701027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:01.714030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 3 from KV. Status 1
2025-10-10T14:31:01.714044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:01.714047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:01.714056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.714061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600543707281412:2381]
2025-10-10T14:31:01.714101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:01.714108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.714115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-10T14:31:01.714118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.714120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.714122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.714257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-10T14:31:01.714464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-10T14:31:01.714843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 3 PackedSize 2253230 count 1 nextOffset 34 batches 5
2025-10-10T14:31:01.714868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:01.855195Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+2223 (0x2492D92F)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+981 (0x249331E5)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:01.855796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988756 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T14:31:01.855810Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T14:31:01.856081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_9932294251438491411_v1
2025-10-10T14:31:01.856103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:01.856120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600548784457565:2497]
2025-10-10T14:31:01.856098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:01.856100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:01.856132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856138Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_9932294251438491411_v1
2025-10-10T14:31:01.856140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: error at write: Disconnected sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0
2025-10-10T14:31:01.856152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:01.856316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0 is DEAD
2025-10-10T14:31:01.856443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:01.856452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session will restart in 0.009982s
2025-10-10T14:31:01.856473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: Do CDS request
2025-10-10T14:31:01.856478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:01.862202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:01.862521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:01.862688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:01.862697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:01.862706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:01.862751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:01.862787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600548002249057:2413]
2025-10-10T14:31:01.863224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:01.863495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:01.863527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:01.863815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:01.863873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:01.863879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:01.863880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:01.863881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:01.863882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:01.863883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:01.863884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:01.863885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000002_00007|
2025-10-10T14:31:01.863887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:01.863888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:01.863889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:01.863890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-10T14:31:01.863891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000030_00000_0000000003_00015?
2025-10-10T14:31:01.863892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.863893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[14]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:01.863894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[15]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:01.863899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:01.863909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:01.863913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:01.863918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:01.863922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:01.863926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:01.863931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:01.863935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000002_00007|
2025-10-10T14:31:01.863939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:574: replace key d0000000000_00000000000000000025_00001_0000000002_00007| to d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:01.863943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:01.863947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:01.863951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:603: ignore key d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-10T14:31:01.863955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:603: ignore key d0000000000_00000000000000000030_00000_0000000003_00015?
2025-10-10T14:31:01.863959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.863963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:01.863966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:01.863977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:01.863988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:01.863997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:01.864006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:01.864014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:01.864019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:01.864028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:01.864036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:01.864043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:01.864052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:01.864056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:01.864061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:01.864066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:01.864071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:01.864076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000002_00007|
2025-10-10T14:31:01.864081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000025_00001_0000000002_00007| will be deleted
2025-10-10T14:31:01.864085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:01.864090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:01.864096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-10T14:31:01.864102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000027_00000_0000000003_00012? will be deleted
2025-10-10T14:31:01.864105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:01.864110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:01.864115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000003_00015?
2025-10-10T14:31:01.864119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000030_00000_0000000003_00015? will be deleted
2025-10-10T14:31:01.864122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:01.864127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:01.864132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.864138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.864142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:01.864148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:01.864153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:01.864158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:01.864196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:01.866328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:01.866682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:01.866690Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:01.866691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:01.866694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:01.866699Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7559600548002249057:2413]
2025-10-10T14:31:01.866705Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:01.866716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:01.866718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.866720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.866721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.866741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:01.866753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:01.866763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:01.866794Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:01.866804Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00000_0000000003_00015?(+) to d0000000000_00000000000000000030_00000_0000000003_00015?(+)
2025-10-10T14:31:01.866809Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000003_00012?(+) to d0000000000_00000000000000000027_00000_0000000003_00012?(+)
2025-10-10T14:31:01.866810Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00001_0000000002_00007|(+) to d0000000000_00000000000000000025_00001_0000000002_00007|(+)
2025-10-10T14:31:01.866831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.866836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:01.866837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:01.866838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:01.866899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:01.866904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.866909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:01.866915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:01.866927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:01.866948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600548002249052:2413]
2025-10-10T14:31:01.866953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600548002249052:2413]
2025-10-10T14:31:01.866955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600548002249052:2413]
2025-10-10T14:31:01.866965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:01.866980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:01.866989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:01.866997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:01.866998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:01.866999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:01.867000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:01.867088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600548002249052:2413]
2025-10-10T14:31:01.867097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:01.867106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:01.867854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:01.867896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600548784457694:2438], now have 1 active actors on pipe
2025-10-10T14:31:01.867884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:01.867896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-10T14:31:01.867942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-10T14:31:01.868057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:01.868087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:01.868094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:01.868097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:01.868114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:01.868133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:01.868146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.868152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.868153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.868159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:01.868424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-10T14:31:01.868447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:01.868449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:01.868450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:01.868454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600548784457722:2500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:01.868884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600548784457722:2500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:01.870321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600548784457722:2500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:01.874584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600548784457722:2500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:01.874599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600548784457722:2500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:01.874602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600548784457722:2500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:01.874608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:01.874815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600548784457752:2500], now have 1 active actors on pipe
2025-10-10T14:31:01.874902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-10T14:31:01.874943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.874953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.874975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:01.874987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:01.874992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:01.874995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:01.875007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:01.875020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:01.875037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.875181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:01.875189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:01.875201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:01.875255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 40 sessionId: src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0
2025-10-10T14:31:01.875578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6030954-2b094968-fdc8b2e0-cc241e07_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:01.878757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0] Write session: try to update token
2025-10-10T14:31:01.878776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:01.887692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:01.887721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:01.887725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:01.887728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:01.887738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600548002249052:2413]
2025-10-10T14:31:01.887742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600548002249052:2413]
2025-10-10T14:31:01.887749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600548002249052:2413]
2025-10-10T14:31:01.887794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:01.887805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:01.887806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:01.887809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:01.887815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:01.887818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:01.888001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:01.906486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:01.911065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:01.956290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600548784457756:2497]
2025-10-10T14:31:01.956519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7559600548784457756:2497]
2025-10-10T14:31:02.000184Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:02.000420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.000430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.000445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600548784457756:2497], now have 1 active actors on pipe
2025-10-10T14:31:02.000612Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:02.000616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:02.000631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:02.000688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600548784457756:2497]
2025-10-10T14:31:02.000708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:02.000742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: error at write: Disconnected sessionId: src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0
2025-10-10T14:31:02.000918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0 is DEAD
2025-10-10T14:31:02.001020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:02.001029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0] Write session will restart in 0.008841s
2025-10-10T14:31:02.001048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0] Write session: Do CDS request
2025-10-10T14:31:02.001056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:02.006482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:02.006794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:02.006962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:02.006971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:02.006981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:02.007024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:02.007066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600552297216418:2416]
2025-10-10T14:31:02.007673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:02.007880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:02.007912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:02.008191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:02.008243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.008244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.008247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.008249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.008250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.008251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.008252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.008253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.008254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.008255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.008256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.008257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.008258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.008263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.008273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.008276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.008280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.008284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.008288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.008292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.008296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.008300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.008304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.008308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.008312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.008318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.008323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.008333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.008340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.008346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.008354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.008359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.008367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.008373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.008381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.008386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.008394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.008398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.008401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.008406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.008410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.008415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.008421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.008426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.008433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.008438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.008444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.008449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.008457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.008462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.008471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.008476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.008515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:02.010525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:02.010911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.010950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:02.010960Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:02.010963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:02.010966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:02.010972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3 [2:7559600552297216418:2416]
2025-10-10T14:31:02.010982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:02.010962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.010997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:02.010976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-10T14:31:02.011005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.011009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.011013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.011026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:02.011033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:02.011043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:02.011094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.011100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.011102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.011103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:02.011096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.011132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:02.011141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:02.011145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.011159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:02.011166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.011176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.011189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.011209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:02.011231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425055:2438], now have 1 active actors on pipe
2025-10-10T14:31:02.011217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3
2025-10-10T14:31:02.011241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600552297216413:2416]
2025-10-10T14:31:02.011244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600552297216413:2416]
2025-10-10T14:31:02.011245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600552297216413:2416]
2025-10-10T14:31:02.011253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:02.011265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:02.011266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:02.011269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:02.011270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:02.011285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:02.011292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:02.011319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600552297216413:2416]
2025-10-10T14:31:02.011330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:02.011349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:02.011527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-10T14:31:02.011557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.011560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.011562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.011566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600553079425092:2505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.012037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600553079425092:2505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.013466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600553079425092:2505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.018464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600553079425092:2505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.018478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600553079425092:2505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:02.018482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600553079425092:2505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.018489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.018719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425123:2505], now have 1 active actors on pipe
2025-10-10T14:31:02.018748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3
2025-10-10T14:31:02.018810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.018822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.018847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:02.018860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.018869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.018874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.018886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.018900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.018919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.019052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.019060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.019072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.019160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0
2025-10-10T14:31:02.019452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c62863db-bd242e9b-c0bd2878-20b5c061_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.043507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:02.043521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.043524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:02.043526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:02.043533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600552297216413:2416]
2025-10-10T14:31:02.043538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600552297216413:2416]
2025-10-10T14:31:02.043541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600552297216413:2416]
2025-10-10T14:31:02.043593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:02.043608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:02.043611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:02.044646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:02.044663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.044665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:02.044824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:02.045490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0] Write session: try to update token
2025-10-10T14:31:02.045508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:02.064907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.076084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.100675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600553079425126:2497]
2025-10-10T14:31:02.100902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3, pipe: [1:7559600553079425126:2497]
2025-10-10T14:31:02.154031Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:02.154235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:02.154242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.154249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600552297216413:2416]
2025-10-10T14:31:02.154294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-10T14:31:02.154297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.154302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.154306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:02.154312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425126:2497], now have 1 active actors on pipe
2025-10-10T14:31:02.154454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:02.154493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600553079425126:2497]
2025-10-10T14:31:02.154529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:02.154559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.154645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0
2025-10-10T14:31:02.154787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0 is DEAD
2025-10-10T14:31:02.154926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:02.154933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0] Write session will restart in 0.009313s
2025-10-10T14:31:02.154958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0] Write session: Do CDS request
2025-10-10T14:31:02.154964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:02.160703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:02.161015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:02.161186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:02.161196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:02.161206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:02.161241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:02.161295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600552297216500:2425]
2025-10-10T14:31:02.161765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:02.162024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:02.162055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:02.162347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:02.162398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.162404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.162405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.162406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.162407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.162408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.162410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.162411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.162413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.162415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.162416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.162417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.162417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.162422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.162432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.162436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.162440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.162444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.162448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.162451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.162455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.162459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.162463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.162466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.162470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.162474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.162479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.162486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.162498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.162501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.162504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.162508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.162510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.162513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.162516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.162519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.162522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.162525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.162529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.162534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.162537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.162539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.162542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.162545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.162549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.162552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.162558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.162561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.162564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.162567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.162570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.162573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.162596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:02.164763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:02.165103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:02.165112Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:02.165113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:02.165116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:02.165120Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 4 [2:7559600552297216500:2425]
2025-10-10T14:31:02.165128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:02.165142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:02.165147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.165149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.165151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.165161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:02.165170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:02.165181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:02.165226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.165233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.165234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.165236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:02.165298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:02.165306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.165316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.165346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.165366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:02.165386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600552297216495:2425]
2025-10-10T14:31:02.165392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600552297216495:2425]
2025-10-10T14:31:02.165394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600552297216495:2425]
2025-10-10T14:31:02.165407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:02.165419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:02.165430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:02.165434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:02.165435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:02.165437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:02.165439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:02.165458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600552297216495:2425]
2025-10-10T14:31:02.165468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:02.165472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:02.165760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.165814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.165828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-10T14:31:02.165923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.165954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:02.165957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:02.165961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.166270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-10T14:31:02.166292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.166295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.166296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.166300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600553079425169:2515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.166727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600553079425169:2515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.166837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425141:2438], now have 1 active actors on pipe
2025-10-10T14:31:02.166891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 4
2025-10-10T14:31:02.168148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600553079425169:2515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.173685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600553079425169:2515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.173696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600553079425169:2515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:02.173699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600553079425169:2515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.173708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.174084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425198:2515], now have 1 active actors on pipe
2025-10-10T14:31:02.174106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 4
2025-10-10T14:31:02.174148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.174159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.174189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59bf4539-80a9095a-781ec69e-9f547901_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:02.174202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.174211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.174214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.174225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.174243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.174260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.174357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.174366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.174383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.174460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 40 sessionId: src_id|59bf4539-80a9095a-781ec69e-9f547901_0
2025-10-10T14:31:02.174749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc2c755c-9d3a273b-86421d4f-5b829ba1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|59bf4539-80a9095a-781ec69e-9f547901_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.176312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:02.176329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.176336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600552297216495:2425]
2025-10-10T14:31:02.176365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:02.176373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:02.176560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:02.176721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:02.176880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:02.177036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:02.177248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:02.177282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:02.178147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59bf4539-80a9095a-781ec69e-9f547901_0] Write session: try to update token
2025-10-10T14:31:02.178159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59bf4539-80a9095a-781ec69e-9f547901_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:02.192971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:02.192988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.192990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:02.192992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:02.193000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600552297216495:2425]
2025-10-10T14:31:02.193004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600552297216495:2425]
2025-10-10T14:31:02.193008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600552297216495:2425]
2025-10-10T14:31:02.193041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:02.193045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:02.193049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:02.193053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:02.193059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.193062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:02.193227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:02.194692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: src_id|59bf4539-80a9095a-781ec69e-9f547901_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.197678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.247469Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:17:0
2025-10-10T14:31:02.247496Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:31:02.254787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600553079425213:2497]
2025-10-10T14:31:02.255021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 4, pipe: [1:7559600553079425213:2497]
2025-10-10T14:31:02.298736Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:02.298983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.298997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.299016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425213:2497], now have 1 active actors on pipe
2025-10-10T14:31:02.299202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:02.299229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:02.299250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:02.299264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:02.299284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600553079425213:2497]
2025-10-10T14:31:02.299328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: error at write: Disconnected sessionId: src_id|59bf4539-80a9095a-781ec69e-9f547901_0
2025-10-10T14:31:02.299442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: src_id|59bf4539-80a9095a-781ec69e-9f547901_0 is DEAD
2025-10-10T14:31:02.299548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bf4539-80a9095a-781ec69e-9f547901_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:02.299555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bf4539-80a9095a-781ec69e-9f547901_0] Write session will restart in 0.009558s
2025-10-10T14:31:02.299579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bf4539-80a9095a-781ec69e-9f547901_0] Write session: Do CDS request
2025-10-10T14:31:02.299584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bf4539-80a9095a-781ec69e-9f547901_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:02.304820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:02.305108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:02.305241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:02.305251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:02.305259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:02.305295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:02.305349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600552297216584:2434]
2025-10-10T14:31:02.305732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:02.305928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:02.305966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:02.306170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:02.306208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.306213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.306214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.306215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.306216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.306217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.306218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.306218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.306219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.306219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.306220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.306220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.306221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.306225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.306232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.306235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.306237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.306239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.306241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.306245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.306247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.306250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.306252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.306254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.306256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.306258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.306262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.306267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.306271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.306274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.306276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.306279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.306284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.306287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.306289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.306292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.306294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.306297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.306299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.306302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.306305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.306307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.306310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.306314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.306316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.306319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.306321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.306324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.306327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.306330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.306332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.306335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.306357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:02.308354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:02.308702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:02.308713Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:02.308715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:02.308719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:02.308725Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 5 [2:7559600552297216584:2434]
2025-10-10T14:31:02.308735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:02.308750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:02.308755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.308757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.308758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.308768Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:02.308773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:02.308782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:02.308816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.308821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.308823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.308825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:02.308870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:02.308876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.308883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.308888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.308898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:02.308917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600552297216579:2434]
2025-10-10T14:31:02.308923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600552297216579:2434]
2025-10-10T14:31:02.308925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600552297216579:2434]
2025-10-10T14:31:02.308936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:02.308949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:02.308951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:02.308962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:02.308964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:02.308964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:02.308966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:02.308982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600552297216579:2434]
2025-10-10T14:31:02.308984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:02.308986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:02.309789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59bf4539-80a9095a-781ec69e-9f547901_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.309820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.309831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-10T14:31:02.309963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.309985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:02.309989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:02.309992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.310318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-10T14:31:02.310341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.310347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.310348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.310352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600553079425244:2522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.310818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600553079425244:2522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.311230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425215:2438], now have 1 active actors on pipe
2025-10-10T14:31:02.311266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 5
2025-10-10T14:31:02.312748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600553079425244:2522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.318229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600553079425244:2522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.318241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600553079425244:2522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:02.318244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600553079425244:2522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.318251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.318459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425274:2522], now have 1 active actors on pipe
2025-10-10T14:31:02.318496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 5
2025-10-10T14:31:02.318544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.318555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.318580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:02.318595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.318604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.318607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.318619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.318639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.318654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.318776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.318783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.318794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.318886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 40 sessionId: src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0
2025-10-10T14:31:02.319182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59bf4539-80a9095a-781ec69e-9f547901_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.322324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0] Write session: try to update token
2025-10-10T14:31:02.322342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:02.327270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:02.327296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.327299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:02.327301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:02.327309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600552297216579:2434]
2025-10-10T14:31:02.327316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600552297216579:2434]
2025-10-10T14:31:02.327320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600552297216579:2434]
2025-10-10T14:31:02.327375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:02.327377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:02.327385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.327386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:02.327387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:02.327390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:02.327550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:02.354284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.358964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.399651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600553079425277:2497]
2025-10-10T14:31:02.399927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 5, pipe: [1:7559600553079425277:2497]
2025-10-10T14:31:02.445851Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:02.446159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.446174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.446190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425277:2497], now have 1 active actors on pipe
2025-10-10T14:31:02.446368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:02.446432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600553079425277:2497]
2025-10-10T14:31:02.446451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:02.446456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:02.446523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0
2025-10-10T14:31:02.446664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0 is DEAD
2025-10-10T14:31:02.446810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:02.446818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0] Write session will restart in 0.005004s
2025-10-10T14:31:02.446834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0] Write session: Do CDS request
2025-10-10T14:31:02.446841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:02.452115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:02.452488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:02.452657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:02.452666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:02.452675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:02.452716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:02.452760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600552297216645:2436]
2025-10-10T14:31:02.452769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.452845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.452861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-10T14:31:02.452959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.452982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:02.452989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:02.452992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.453317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-10T14:31:02.453349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:02.453351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.453352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.453353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.453356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600553079425300:2526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.453583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:02.453617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:02.453827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600553079425300:2526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.453899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:02.453953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.453958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.453959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.453960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.453961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.453963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.453964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.453965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.453966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.453967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.453968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.453969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.453970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.453974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.453985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.453988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.453992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.453996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.454000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.454005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.454008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.454011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.454015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.454022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.454025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.454029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.454035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.454046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.454055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.454061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.454065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.454070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.454075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.454083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.454092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.454099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.454107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.454111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.454116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.454124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.454131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.454136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.454144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.454149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.454156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.454161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.454167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.454175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.454183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.454188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.454196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.454204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.454229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:02.455500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600553079425300:2526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.456175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:02.456891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:02.456901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:02.456902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:02.456904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:02.456909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 6 [2:7559600552297216645:2436]
2025-10-10T14:31:02.456917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:02.456928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:02.456929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.456931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.456932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.456942Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:02.456946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:02.456951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:02.457000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.457006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.457008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.457010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:02.457063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:02.457069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.457076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.457082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.457092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:02.457105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600552297216640:2436]
2025-10-10T14:31:02.457109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600552297216640:2436]
2025-10-10T14:31:02.457112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600552297216640:2436]
2025-10-10T14:31:02.457120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:02.457130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:02.457132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:02.457136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:02.457138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:02.457140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:02.457142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:02.457157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600552297216640:2436]
2025-10-10T14:31:02.457159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:02.457160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:02.457529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600553079425300:2526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.457540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600553079425300:2526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:02.457554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600553079425300:2526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.457560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.457815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425335:2526], now have 1 active actors on pipe
2025-10-10T14:31:02.457839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 6
2025-10-10T14:31:02.457878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.457886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.457908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:02.457920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.457924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.457927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.457958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.457972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.457988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.458103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.458111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.458119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425278:2438], now have 1 active actors on pipe
2025-10-10T14:31:02.458127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.458131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 6
2025-10-10T14:31:02.458184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 40 sessionId: src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0
2025-10-10T14:31:02.458424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5467c4a7-f175a26c-3c21ca43-fde8d674_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.470621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0] Write session: try to update token
2025-10-10T14:31:02.470643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:02.474958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:02.474976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.474978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:02.474979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:02.474986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600552297216640:2436]
2025-10-10T14:31:02.474992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600552297216640:2436]
2025-10-10T14:31:02.474996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600552297216640:2436]
2025-10-10T14:31:02.475036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:02.475042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:02.475044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:02.475046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:02.475051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.475054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:02.475275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:02.491466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.494030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.546642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600553079425349:2497]
2025-10-10T14:31:02.546893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 6, pipe: [1:7559600553079425349:2497]
2025-10-10T14:31:02.578344Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:02.578614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.578625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.578642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425349:2497], now have 1 active actors on pipe
2025-10-10T14:31:02.578843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:02.578910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:02.578928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:02.578931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:02.578964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600553079425349:2497]
2025-10-10T14:31:02.578987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 7 reason: error at write: Disconnected sessionId: src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0
2025-10-10T14:31:02.579151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0 is DEAD
2025-10-10T14:31:02.579312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:02.579321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0] Write session will restart in 0.006509s
2025-10-10T14:31:02.579339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0] Write session: Do CDS request
2025-10-10T14:31:02.579343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:02.585069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:02.585424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:02.585591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:02.585600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:02.585609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:02.585645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:02.585678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600552297216711:2440]
2025-10-10T14:31:02.586083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:02.586378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:02.586416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:02.586666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:02.586706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.586710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.586711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.586711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.586712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.586713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.586713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.586714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.586714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.586715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.586716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.586716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.586717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.586720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.586728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.586730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.586733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.586735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.586738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.586740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.586742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.586744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.586746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.586748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.586750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.586752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.586757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.586762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.586766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.586770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.586773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.586777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.586779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.586811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.586784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.586787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.586790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.586793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.586796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.586799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.586802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.586806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.586809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.586812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.586814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.586817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.586820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.586823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.586826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.586828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.586832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.586835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.586838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.586859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:02.586878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.586891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-10T14:31:02.587011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.587033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:02.587040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:02.587043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.587388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-10T14:31:02.587416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.587422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.587424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.587429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600553079425380:2532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.587923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600553079425380:2532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.589111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:02.589503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:02.589513Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:02.589516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:02.589520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:02.589525Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 7 [2:7559600552297216711:2440]
2025-10-10T14:31:02.589536Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:02.589550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:02.589557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.589560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.589561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.589574Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:02.589583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:02.589593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:02.589640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.589647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.589649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.589651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:02.589717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:02.589724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.589735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.589751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.589771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:02.589791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600552297216706:2440]
2025-10-10T14:31:02.589797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600552297216706:2440]
2025-10-10T14:31:02.589799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600552297216706:2440]
2025-10-10T14:31:02.589814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:02.589829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:02.589822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600553079425380:2532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.589828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:02.589833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:02.589835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:02.589849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:02.589851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:02.589871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600552297216706:2440]
2025-10-10T14:31:02.589882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:02.589889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:02.590345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425350:2438], now have 1 active actors on pipe
2025-10-10T14:31:02.590379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 7
2025-10-10T14:31:02.594898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600553079425380:2532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.594911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600553079425380:2532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:02.594915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600553079425380:2532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.594924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.595151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425414:2532], now have 1 active actors on pipe
2025-10-10T14:31:02.595259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 7
2025-10-10T14:31:02.595360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.595369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.595390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34700940-baaf540-e00e69ce-1e31ab46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:02.595401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.595405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.595411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.595419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.595430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.595445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.595615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.595621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.595631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.595746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 40 sessionId: src_id|34700940-baaf540-e00e69ce-1e31ab46_0
2025-10-10T14:31:02.596150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7fbd1-54610b78-1f1a89c0-45f585f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34700940-baaf540-e00e69ce-1e31ab46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.599402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34700940-baaf540-e00e69ce-1e31ab46_0] Write session: try to update token
2025-10-10T14:31:02.599419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34700940-baaf540-e00e69ce-1e31ab46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:02.608594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:02.608616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.608618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:02.608620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:02.608632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600552297216706:2440]
2025-10-10T14:31:02.608636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600552297216706:2440]
2025-10-10T14:31:02.608642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600552297216706:2440]
2025-10-10T14:31:02.608694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:02.608698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:02.608706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.608707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:02.608708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:02.608712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:02.608943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:02.619008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: src_id|34700940-baaf540-e00e69ce-1e31ab46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.621620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.679247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600553079425418:2497]
2025-10-10T14:31:02.679493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 7, pipe: [1:7559600553079425418:2497]
2025-10-10T14:31:02.716519Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:02.716792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.716804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.716820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425418:2497], now have 1 active actors on pipe
2025-10-10T14:31:02.717025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:02.717035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:02.717049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:02.717074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600553079425418:2497]
2025-10-10T14:31:02.717094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:02.717121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 8 reason: error at write: Disconnected sessionId: src_id|34700940-baaf540-e00e69ce-1e31ab46_0
2025-10-10T14:31:02.717357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: src_id|34700940-baaf540-e00e69ce-1e31ab46_0 is DEAD
2025-10-10T14:31:02.717546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34700940-baaf540-e00e69ce-1e31ab46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:02.717558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34700940-baaf540-e00e69ce-1e31ab46_0] Write session will restart in 0.009354s
2025-10-10T14:31:02.717582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34700940-baaf540-e00e69ce-1e31ab46_0] Write session: Do CDS request
2025-10-10T14:31:02.717589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34700940-baaf540-e00e69ce-1e31ab46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:02.723348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:02.723681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:02.723835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:02.723845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:02.723853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:02.723894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:02.723934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600552297216774:2442]
2025-10-10T14:31:02.724488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:02.724750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:02.724783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:02.725051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:02.725102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.725107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.725108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.725110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.725111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.725112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.725113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.725114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.725115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.725117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.725118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.725119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.725120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.725125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.725135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.725139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.725145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.725147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.725149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.725151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.725153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.725155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.725157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.725159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.725161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.725163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.725168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.725173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.725179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.725182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.725186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.725191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.725197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.725201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.725207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.725213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.725217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.725222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.725227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.725232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.725236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.725242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.725251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.725257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.725265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.725270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.725279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.725285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.725293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.725298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.725303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.725312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.725365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:02.727587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:02.727835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34700940-baaf540-e00e69ce-1e31ab46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.727953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.727965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-10T14:31:02.727992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:02.728003Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:02.728005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:02.728008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:02.728014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 8 [2:7559600552297216774:2442]
2025-10-10T14:31:02.728025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:02.728040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:02.728047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.728050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.728052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.728065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:02.728077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:02.728082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:02.728109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.728133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.728139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.728141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.728140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:02.728151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:02.728144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:02.728155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.728205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:02.728213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.728223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.728238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.728258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:02.728277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600552297216769:2442]
2025-10-10T14:31:02.728283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600552297216769:2442]
2025-10-10T14:31:02.728285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600552297216769:2442]
2025-10-10T14:31:02.728298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:02.728312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:02.728314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:02.728316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:02.728317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:02.728328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:02.728331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:02.728351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600552297216769:2442]
2025-10-10T14:31:02.728362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:02.728368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:02.728593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-10T14:31:02.728629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.728635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.728636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.728640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600553079425449:2536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.729042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425419:2438], now have 1 active actors on pipe
2025-10-10T14:31:02.729056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 8
2025-10-10T14:31:02.729110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600553079425449:2536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.731229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600553079425449:2536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.736793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600553079425449:2536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.736811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600553079425449:2536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:02.736814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600553079425449:2536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.736826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.737071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425481:2536], now have 1 active actors on pipe
2025-10-10T14:31:02.737112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 8
2025-10-10T14:31:02.737156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.737172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.737193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3490f048-b6972f91-94987c32-be6538fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:02.737206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.737211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.737213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.737222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.737235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.737248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.737463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.737474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.737496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.737604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 40 sessionId: src_id|3490f048-b6972f91-94987c32-be6538fa_0
2025-10-10T14:31:02.737988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34700940-baaf540-e00e69ce-1e31ab46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3490f048-b6972f91-94987c32-be6538fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.740987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3490f048-b6972f91-94987c32-be6538fa_0] Write session: try to update token
2025-10-10T14:31:02.741005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3490f048-b6972f91-94987c32-be6538fa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:02.741784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:02.741795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.741800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600552297216769:2442]
2025-10-10T14:31:02.741844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:02.741851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:02.742078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:02.742308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:02.742504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:02.742787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:02.743054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:02.743101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:02.755684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:02.755700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.755702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:02.755704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:02.755712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600552297216769:2442]
2025-10-10T14:31:02.755715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600552297216769:2442]
2025-10-10T14:31:02.755720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600552297216769:2442]
2025-10-10T14:31:02.755763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:02.755766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:02.755769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.755771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:02.755775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:02.755781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:02.755917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:02.758666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: src_id|3490f048-b6972f91-94987c32-be6538fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.761291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.817469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600553079425485:2497]
2025-10-10T14:31:02.817664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 8, pipe: [1:7559600553079425485:2497]
2025-10-10T14:31:02.864186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:02.864431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.864441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.864457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425485:2497], now have 1 active actors on pipe
2025-10-10T14:31:02.864658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:02.864731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:02.864742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:02.864800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600553079425485:2497]
2025-10-10T14:31:02.864802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 9 reason: error at write: Disconnected sessionId: src_id|3490f048-b6972f91-94987c32-be6538fa_0
2025-10-10T14:31:02.864828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:02.864973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: src_id|3490f048-b6972f91-94987c32-be6538fa_0 is DEAD
2025-10-10T14:31:02.865120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490f048-b6972f91-94987c32-be6538fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:02.865130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490f048-b6972f91-94987c32-be6538fa_0] Write session will restart in 0.009747s
2025-10-10T14:31:02.865148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490f048-b6972f91-94987c32-be6538fa_0] Write session: Do CDS request
2025-10-10T14:31:02.865155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490f048-b6972f91-94987c32-be6538fa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:02.871137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:02.871575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:02.871726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:02.871733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:02.871740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:02.871778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:02.871812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600552297216838:2444]
2025-10-10T14:31:02.872234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:02.872459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:02.872498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:02.872758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:02.872794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.872801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.872802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.872802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.872803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.872804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.872804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.872805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.872806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.872807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.872807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.872808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.872809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.872812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.872819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.872821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.872823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.872825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.872827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.872828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.872831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.872833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.872835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.872837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.872839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.872841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.872846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.872851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:02.872855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.872859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:02.872861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.872864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:02.872869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.872872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:02.872874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.872878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:02.872880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.872884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:02.872887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.872891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:02.872894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.872897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:02.872899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.872903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:02.872905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.872908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:02.872913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.872916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.872918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.872921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.872923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.872926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.872945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:02.875052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:02.875505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:02.875516Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:02.875518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:02.875522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:02.875527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 9 [2:7559600552297216838:2444]
2025-10-10T14:31:02.875539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:02.875558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:02.875564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.875569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.875574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.875591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:02.875601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:02.875607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:02.875660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.875668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.875670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.875672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:02.875731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:02.875739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.875750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:02.875761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:02.875782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:02.875796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3490f048-b6972f91-94987c32-be6538fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.875800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600552297216833:2444]
2025-10-10T14:31:02.875806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600552297216833:2444]
2025-10-10T14:31:02.875808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600552297216833:2444]
2025-10-10T14:31:02.875819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:02.875830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:02.875832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:02.875834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:02.875834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:02.875848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:02.875842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:02.875856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:02.875857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-10T14:31:02.875877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600552297216833:2444]
2025-10-10T14:31:02.875884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:02.875889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:02.876046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:02.876082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:02.876092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:02.876098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:02.876506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425486:2438], now have 1 active actors on pipe
2025-10-10T14:31:02.876540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-10T14:31:02.876575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 9
2025-10-10T14:31:02.876581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:02.876583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:02.876584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:02.876589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600553079425518:2540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:02.877125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600553079425518:2540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:02.879350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600553079425518:2540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:02.885863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600553079425518:2540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:02.885883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600553079425518:2540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:02.885886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600553079425518:2540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:02.885898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:02.886242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425549:2540], now have 1 active actors on pipe
2025-10-10T14:31:02.886266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 9
2025-10-10T14:31:02.886308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.886325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.886376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82366b47-11a26b3-14c1f457-9ce99851_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:02.886392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:02.886398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:02.886401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:02.886415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:02.886430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:02.886449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.886673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:02.886685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:02.886714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:02.886810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 40 sessionId: src_id|82366b47-11a26b3-14c1f457-9ce99851_0
2025-10-10T14:31:02.887118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3490f048-b6972f91-94987c32-be6538fa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82366b47-11a26b3-14c1f457-9ce99851_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:02.889730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82366b47-11a26b3-14c1f457-9ce99851_0] Write session: try to update token
2025-10-10T14:31:02.889755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82366b47-11a26b3-14c1f457-9ce99851_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:02.894187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:02.894201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:02.894208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:02.894210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:02.894220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600552297216833:2444]
2025-10-10T14:31:02.894224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600552297216833:2444]
2025-10-10T14:31:02.894228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600552297216833:2444]
2025-10-10T14:31:02.894279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:02.894289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:02.894291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:02.894309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:02.894317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:02.894320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:02.894449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:02.903953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: src_id|82366b47-11a26b3-14c1f457-9ce99851_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:02.906570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:02.964925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600553079425553:2497]
2025-10-10T14:31:02.965162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 9, pipe: [1:7559600553079425553:2497]
2025-10-10T14:31:03.002218Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:03.002500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.002512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.002528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600553079425553:2497], now have 1 active actors on pipe
2025-10-10T14:31:03.002718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:03.002779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:03.002792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:03.002813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600553079425553:2497]
2025-10-10T14:31:03.002849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:03.002875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 10 reason: error at write: Disconnected sessionId: src_id|82366b47-11a26b3-14c1f457-9ce99851_0
2025-10-10T14:31:03.003108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: src_id|82366b47-11a26b3-14c1f457-9ce99851_0 is DEAD
2025-10-10T14:31:03.003280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82366b47-11a26b3-14c1f457-9ce99851_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:03.003289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82366b47-11a26b3-14c1f457-9ce99851_0] Write session will restart in 0.009817s
2025-10-10T14:31:03.003317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82366b47-11a26b3-14c1f457-9ce99851_0] Write session: Do CDS request
2025-10-10T14:31:03.003323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82366b47-11a26b3-14c1f457-9ce99851_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:03.010029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:03.010443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:03.010601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:03.010610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:03.010620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:03.010656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:03.010687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600556592184198:2446]
2025-10-10T14:31:03.011108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:03.011373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:03.011415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:03.011720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:03.011770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.011774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.011775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.011776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.011776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.011777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.011778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.011778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.011779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.011780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.011781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.011781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.011782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.011785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.011792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.011794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.011797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.011799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.011801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.011803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.011805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.011807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.011809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.011811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.011813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.011815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.011821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.011826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.011831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.011834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.011837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.011842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.011846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.011851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.011857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.011862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.011866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.011869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.011872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.011875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.011877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.011880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.011883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.011886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.011888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.011891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.011894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.011896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.011899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.011902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.011906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.011911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.011947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:03.014224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:03.014594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:03.014604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:03.014606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:03.014609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:03.014615Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 10 [2:7559600556592184198:2446]
2025-10-10T14:31:03.014626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:03.014640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:03.014646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.014649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.014650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.014664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:03.014674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:03.014683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:03.014734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.014740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.014742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.014744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:03.014800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:03.014806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.014816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.014832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.014852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:03.014872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374392850:2438], now have 1 active actors on pipe
2025-10-10T14:31:03.014882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600556592184193:2446]
2025-10-10T14:31:03.014888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600556592184193:2446]
2025-10-10T14:31:03.014890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600556592184193:2446]
2025-10-10T14:31:03.014901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:03.014909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:03.014877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 10
2025-10-10T14:31:03.014911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:03.014912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:03.014916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:03.014928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:03.014931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:03.014961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600556592184193:2446]
2025-10-10T14:31:03.014974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:03.014992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:03.015012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82366b47-11a26b3-14c1f457-9ce99851_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.015066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:03.015076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 11
2025-10-10T14:31:03.015238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.015282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 11 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:03.015293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=11 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:03.015298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:03.015678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 11 sessionId:  describe result for acl check
2025-10-10T14:31:03.015715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:03.015717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:03.015719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:03.015724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600557374392897:2545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:03.016213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600557374392897:2545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:03.017733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600557374392897:2545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:03.023631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600557374392897:2545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:03.023645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600557374392897:2545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:03.023648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600557374392897:2545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:03.023656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 11 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:03.023903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374392926:2545], now have 1 active actors on pipe
2025-10-10T14:31:03.023961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 10
2025-10-10T14:31:03.024007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.024018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.024041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:03.024054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.024063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.024069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:03.024080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.024098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:03.024112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.024245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.024252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.024265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.024351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 11 partition: 0 MaxSeqNo: 40 sessionId: src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0
2025-10-10T14:31:03.024702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82366b47-11a26b3-14c1f457-9ce99851_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:03.027149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0] Write session: try to update token
2025-10-10T14:31:03.027165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:03.033615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:03.033631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.033634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:03.033635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:03.033642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600556592184193:2446]
2025-10-10T14:31:03.033645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600556592184193:2446]
2025-10-10T14:31:03.033650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600556592184193:2446]
2025-10-10T14:31:03.033689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:03.033695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:03.033698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.033700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:03.033701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:03.033706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:03.033957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:03.041106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId: src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:03.043791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:03.103198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600557374392929:2497]
2025-10-10T14:31:03.103452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 10, pipe: [1:7559600557374392929:2497]
2025-10-10T14:31:03.142058Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:03.142326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.142339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.142355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374392929:2497], now have 1 active actors on pipe
2025-10-10T14:31:03.142546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:03.142573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600557374392929:2497]
2025-10-10T14:31:03.142575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:03.142581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:03.142612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:03.142668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 11 reason: error at write: Disconnected sessionId: src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0
2025-10-10T14:31:03.142831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 11 sessionId: src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0 is DEAD
2025-10-10T14:31:03.142970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:03.142984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0] Write session will restart in 0.008423s
2025-10-10T14:31:03.143019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0] Write session: Do CDS request
2025-10-10T14:31:03.143027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:03.148463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:03.148804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:03.148956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:03.148965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:03.148974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:03.149016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:03.149057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600556592184276:2449]
2025-10-10T14:31:03.149622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:03.149900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:03.149956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:03.150282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:03.150346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.150352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.150353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.150354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.150355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.150356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.150357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.150359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.150359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.150361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.150362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.150363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.150364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.150369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.150380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.150383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.150386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.150390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.150393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.150399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.150403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.150406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.150410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.150414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.150418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.150421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.150427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.150434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.150441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.150446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.150449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.150453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.150456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.150459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.150462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.150466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.150468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.150472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.150475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.150478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.150481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.150484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.150487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.150490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.150493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.150496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.150499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.150502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.150504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.150508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.150511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.150514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.150535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:03.152831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.152907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:03.152923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 12
2025-10-10T14:31:03.152936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:03.153039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.153076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 12 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:03.153082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=12 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:03.153087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:03.153513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 12 sessionId:  describe result for acl check
2025-10-10T14:31:03.153509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:03.153519Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:03.153522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:03.153525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:03.153532Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 11 [2:7559600556592184276:2449]
2025-10-10T14:31:03.153545Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:03.153546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:03.153559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:03.153562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.153552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:03.153565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.153553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:03.153570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.153557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600557374392962:2549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:03.153583Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:03.153593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:03.153600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:03.153664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.153671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.153673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.153675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:03.153731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:03.153739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.153750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.153765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.153786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:03.153806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600556592184270:2449]
2025-10-10T14:31:03.153812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600556592184270:2449]
2025-10-10T14:31:03.153814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600556592184270:2449]
2025-10-10T14:31:03.153827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:03.153835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:03.153842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:03.153842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:03.153844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:03.153857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:03.153864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:03.153883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600556592184270:2449]
2025-10-10T14:31:03.153896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:03.153918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:03.153992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600557374392962:2549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:03.154473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374392931:2438], now have 1 active actors on pipe
2025-10-10T14:31:03.154519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 11
2025-10-10T14:31:03.156040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600557374392962:2549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:03.161561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600557374392962:2549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:03.161575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600557374392962:2549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:03.161578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600557374392962:2549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:03.161585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 12 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:03.161816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374392996:2549], now have 1 active actors on pipe
2025-10-10T14:31:03.161865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 11
2025-10-10T14:31:03.161924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.161935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.161968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:03.161981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.161989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.161991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:03.162003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.162015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:03.162032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.162242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.162249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.162261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.162358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 12 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0
2025-10-10T14:31:03.162743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342ac73c-a64eecf8-d219e0da-f56c1afc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:03.165827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0] Write session: try to update token
2025-10-10T14:31:03.165841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:03.172979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:03.173002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.173005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:03.173007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:03.173017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600556592184270:2449]
2025-10-10T14:31:03.173025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600556592184270:2449]
2025-10-10T14:31:03.173029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600556592184270:2449]
2025-10-10T14:31:03.173069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:03.173077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:03.173080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:03.173084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:03.173086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.173088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:03.173290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:03.181372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId: src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:03.183950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:03.242952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600557374393023:2497]
2025-10-10T14:31:03.243210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 11, pipe: [1:7559600557374393023:2497]
2025-10-10T14:31:03.278769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:03.279047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.279061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.279082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393023:2497], now have 1 active actors on pipe
2025-10-10T14:31:03.279271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:03.279358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:03.279389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:03.279419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600557374393023:2497]
2025-10-10T14:31:03.279473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 12 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0
2025-10-10T14:31:03.279630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 12 sessionId: src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0 is DEAD
2025-10-10T14:31:03.279791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:03.279805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0] Write session will restart in 0.006838s
2025-10-10T14:31:03.279842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0] Write session: Do CDS request
2025-10-10T14:31:03.279849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:03.286448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:03.286764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:03.286932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:03.286944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:03.286956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:03.287008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:03.287049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600556592184380:2464]
2025-10-10T14:31:03.287538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:03.287753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:03.287783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:03.287853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.287923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:03.287944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 13
2025-10-10T14:31:03.288055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:03.288108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.288115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.288115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.288117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.288118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.288119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.288120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.288121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.288123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.288124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.288147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 13 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:03.288125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.288126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.288157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=13 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:03.288127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.288128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.288162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:03.288136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.288148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.288152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.288156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.288160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.288164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.288168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.288173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.288177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.288181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.288185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.288189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.288192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.288199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.288207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.288214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.288220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.288225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.288230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.288235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.288240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.288250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.288255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.288264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.288269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.288279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.288286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.288307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.288317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.288322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.288332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.288337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.288342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.288353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.288358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.288368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.288374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.288384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.288389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.288433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:03.288587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 13 sessionId:  describe result for acl check
2025-10-10T14:31:03.288626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:03.288633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:03.288635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:03.288642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600557374393055:2562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:03.289263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600557374393055:2562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:03.290671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:03.291079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:03.291091Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:03.291094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:03.291098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:03.291103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 12 [2:7559600556592184380:2464]
2025-10-10T14:31:03.291116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:03.291135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:03.291143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.291147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.291149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.291164Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:03.291177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:03.291185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:03.291245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.291253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.291255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.291258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:03.291327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:03.291336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.291347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.291363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.291380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:03.291407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393024:2438], now have 1 active actors on pipe
2025-10-10T14:31:03.291420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600556592184375:2464]
2025-10-10T14:31:03.291428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600556592184375:2464]
2025-10-10T14:31:03.291430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600556592184375:2464]
2025-10-10T14:31:03.291405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 12
2025-10-10T14:31:03.291441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:03.291449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:03.291452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:03.291454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:03.291460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:03.291477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:03.291486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:03.291520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600556592184375:2464]
2025-10-10T14:31:03.291532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:03.291543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:03.292169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600557374393055:2562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:03.297873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600557374393055:2562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:03.297882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600557374393055:2562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:03.297885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600557374393055:2562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:03.297891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 13 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:03.298127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393091:2562], now have 1 active actors on pipe
2025-10-10T14:31:03.298184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 12
2025-10-10T14:31:03.298231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.298258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.298298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:03.298315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.298326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.298329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:03.298345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.298362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:03.298386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.298540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.298548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.298563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.298648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 13 partition: 0 MaxSeqNo: 40 sessionId: src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0
2025-10-10T14:31:03.299008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef4c0167-e439a9b-7dd19f93-7a4d079b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:03.301772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Write session: try to update token
2025-10-10T14:31:03.301788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:03.305366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:03.305382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.305394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600556592184375:2464]
2025-10-10T14:31:03.305441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:03.305447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:03.305657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:03.305798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:03.306074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:03.306207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:03.306409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:03.306448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:03.315553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId: src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:03.320222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:03.324537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.324560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.324583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:03.324587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.324590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:03.324592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:03.324601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600556592184375:2464]
2025-10-10T14:31:03.324606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600556592184375:2464]
2025-10-10T14:31:03.324610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600556592184375:2464]
2025-10-10T14:31:03.324679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:03.324682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:03.324689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:03.324694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:03.324694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.324697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:03.324853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:03.379610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600557374393094:2497]
2025-10-10T14:31:03.379955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 12, pipe: [1:7559600557374393094:2497]
2025-10-10T14:31:03.434499Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:03.434764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:03.434807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393094:2497], now have 1 active actors on pipe
2025-10-10T14:31:03.434918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:03.435041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600557374393094:2497]
2025-10-10T14:31:03.435067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:03.441270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:03.441661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:03.441836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:03.441850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:03.441862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:03.441907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:03.441961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600556592184448:2466]
2025-10-10T14:31:03.442573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:03.442806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:03.442848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:03.443155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:03.443212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.443220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.443222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.443223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.443224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.443226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.443227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.443228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.443230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.443232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.443233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.443234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.443236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.443240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.443255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.443259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.443264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.443268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.443273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.443277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.443281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.443286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.443291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.443296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.443300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.443304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.443314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.443324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.443330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.443336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.443341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.443347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.443351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.443356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.443365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.443371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.443375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.443387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.443392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.443398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.443409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.443415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.443420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.443426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.443436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.443442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.443447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.443453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.443463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.443469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.443474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.443479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.443518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:03.445671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:03.446148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:03.446161Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:03.446164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:03.446167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:03.446175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 13 [2:7559600556592184448:2466]
2025-10-10T14:31:03.446186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:03.446203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:03.446213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.446217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.446220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.446238Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:03.446254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:03.446261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:03.446316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.446326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.446328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.446330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:03.446393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:03.446401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.446413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.446425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.446443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:03.446468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600556592184443:2466]
2025-10-10T14:31:03.446476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600556592184443:2466]
2025-10-10T14:31:03.446479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600556592184443:2466]
2025-10-10T14:31:03.446491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:03.446500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:03.446502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:03.446504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:03.446514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:03.446530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:03.446538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:03.446560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600556592184443:2466]
2025-10-10T14:31:03.446573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:03.446578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:03.446871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393095:2438], now have 1 active actors on pipe
2025-10-10T14:31:03.446891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 13
2025-10-10T14:31:03.449610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:03.449626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:03.449653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 13 reason: error at write: Disconnected sessionId: src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0
2025-10-10T14:31:03.449862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 13 sessionId: src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0 is DEAD
2025-10-10T14:31:03.449990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:03.449999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Write session will restart in 0.006193s
2025-10-10T14:31:03.450017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Write session: Do CDS request
2025-10-10T14:31:03.450022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:03.457802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.457901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:03.457919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 14
2025-10-10T14:31:03.458096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.458133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 14 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:03.458144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=14 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:03.458148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:03.458560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 14 sessionId:  describe result for acl check
2025-10-10T14:31:03.458591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:03.458596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:03.458598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:03.458602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600557374393134:2566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:03.459119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600557374393134:2566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:03.460623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600557374393134:2566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:03.463735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:03.463755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.463759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:03.463761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:03.463771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600556592184443:2466]
2025-10-10T14:31:03.463777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600556592184443:2466]
2025-10-10T14:31:03.463780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600556592184443:2466]
2025-10-10T14:31:03.463828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:03.463830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:03.463837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:03.463841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:03.463844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.463847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:03.463972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:03.466312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600557374393134:2566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:03.466321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600557374393134:2566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:03.466323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600557374393134:2566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:03.466328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 14 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:03.466600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 13
2025-10-10T14:31:03.535274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600557374393174:2497]
2025-10-10T14:31:03.535539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 13, pipe: [1:7559600557374393174:2497]
2025-10-10T14:31:03.581607Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:03.581858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393166:2566], now have 1 active actors on pipe
2025-10-10T14:31:03.581895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.581909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.581969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393174:2497], now have 1 active actors on pipe
2025-10-10T14:31:03.582217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:03.582198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:03.582200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600557374393174:2497]
2025-10-10T14:31:03.582219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:03.582236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 14 reason: pipe to partition's 0 tablet is dead #2 sessionId: 
2025-10-10T14:31:03.582511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 14 sessionId:  is DEAD
2025-10-10T14:31:03.582691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:31:03.582699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Write session will restart in 0.019745s
2025-10-10T14:31:03.582741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Write session: Do CDS request
2025-10-10T14:31:03.582750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:03.589736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:03.590167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:03.590347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:03.590359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:03.590371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:03.590418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:03.590463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600556592184521:2470]
2025-10-10T14:31:03.591091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:03.591374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:03.591422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:03.591747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:03.591805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.591814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.591815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.591817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.591818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.591820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.591821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.591823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.591827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.591828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.591830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.591831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.591833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.591839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.591853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.591863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.591868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.591872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.591883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.591888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.591892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.591897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.591901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.591906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.591910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.591915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.591924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.591938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.591950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.591957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.591968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.591975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.591985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.591991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.592002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.592008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.592015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.592026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.592037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.592044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.592053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.592059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.592068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.592074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.592083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.592088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.592092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.592097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.592102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.592107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.592119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.592124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.592173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:03.594492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:03.594818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:03.594834Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:03.594837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:03.594841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:03.594848Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 14 [2:7559600556592184521:2470]
2025-10-10T14:31:03.594861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:03.594887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:03.594896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.594900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.594902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.594919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:03.594932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:03.594946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:03.595018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.595026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.595029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.595031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:03.595105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:03.595114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.595127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.595152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.595171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:03.595164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 14
2025-10-10T14:31:03.595202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393178:2438], now have 1 active actors on pipe
2025-10-10T14:31:03.595217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600556592184516:2470]
2025-10-10T14:31:03.595220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600556592184516:2470]
2025-10-10T14:31:03.595222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600556592184516:2470]
2025-10-10T14:31:03.595237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:03.595251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:03.595254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:03.595255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:03.595264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:03.595284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:03.595293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:03.595318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600556592184516:2470]
2025-10-10T14:31:03.595332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:03.595337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:03.603784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.603916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:03.603933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 15
2025-10-10T14:31:03.604054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.604077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 15 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:03.604090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=15 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:03.604093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:03.604498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 15 sessionId:  describe result for acl check
2025-10-10T14:31:03.604533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:03.604538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:03.604547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:03.604551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600557374393217:2572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:03.605025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600557374393217:2572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:03.606375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:03.606395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.606405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600556592184516:2470]
2025-10-10T14:31:03.606440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:03.606456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:03.606634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:03.606657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600557374393217:2572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:03.606816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:03.606954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:03.607130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:03.607319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:03.607365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:03.611632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600557374393217:2572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:03.611642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600557374393217:2572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:03.611645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600557374393217:2572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:03.611651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 15 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:03.611890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393248:2572], now have 1 active actors on pipe
2025-10-10T14:31:03.611919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 14
2025-10-10T14:31:03.612011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.612027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.612069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:03.612089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.612100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.612104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:03.612124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.612149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:03.612172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.612368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.612379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.612395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.612491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 15 partition: 0 MaxSeqNo: 40 sessionId: src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0
2025-10-10T14:31:03.612790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7dc582f-686501d0-fe530df0-1832dc0d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:03.615795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0] Write session: try to update token
2025-10-10T14:31:03.615809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:03.624175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:03.624192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.624197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:03.624199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:03.624211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600556592184516:2470]
2025-10-10T14:31:03.624218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600556592184516:2470]
2025-10-10T14:31:03.624223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600556592184516:2470]
2025-10-10T14:31:03.624265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:03.624272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:03.624278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:03.624282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:03.624282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.624285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:03.624425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:03.633659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId: src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:03.636496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:03.682269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600557374393250:2497]
2025-10-10T14:31:03.682588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 14, pipe: [1:7559600557374393250:2497]
2025-10-10T14:31:03.740731Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:03.741465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.741489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.741512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393250:2497], now have 1 active actors on pipe
2025-10-10T14:31:03.741784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:03.741818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:03.741828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:03.741875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600557374393250:2497]
2025-10-10T14:31:03.741902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 15 reason: error at write: Disconnected sessionId: src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0
2025-10-10T14:31:03.742089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 15 sessionId: src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0 is DEAD
2025-10-10T14:31:03.742204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:03.742332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:03.742338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0] Write session will restart in 0.005319s
2025-10-10T14:31:03.742379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0] Write session: Do CDS request
2025-10-10T14:31:03.742384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:03.748768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.748811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:03.748833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 16
2025-10-10T14:31:03.748977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.749000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 16 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:03.749008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=16 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:03.749011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:03.749017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:03.749497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 16 sessionId:  describe result for acl check
2025-10-10T14:31:03.749524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:03.749528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:03.749530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:03.749535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600557374393282:2576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:03.749577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:03.749773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:03.749782Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:03.749792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:03.749835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:03.749887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600556592184591:2472]
2025-10-10T14:31:03.750022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600557374393282:2576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:03.750381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:03.750684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:03.750748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:03.751036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:03.751092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.751098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.751099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.751099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.751100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.751101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.751102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.751102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.751103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.751104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.751105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.751105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.751106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.751110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.751117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.751119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.751122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.751124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.751126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.751131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.751135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.751138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.751142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.751146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.751149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.751152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.751167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.751172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.751176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.751179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.751182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.751185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.751188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.751191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.751194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.751197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.751199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.751202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.751205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.751208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.751211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.751214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.751217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.751220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.751222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.751226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.751228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.751232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.751234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.751237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.751240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.751243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.751264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:03.752327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600557374393282:2576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:03.753981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:03.754327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:03.754338Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:03.754340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:03.754344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:03.754350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 15 [2:7559600556592184591:2472]
2025-10-10T14:31:03.754362Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:03.754377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:03.754380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.754383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.754384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.754394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:03.754403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:03.754407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:03.754451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.754456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.754457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.754459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:03.754469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600557374393282:2576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:03.754479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600557374393282:2576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:03.754481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600557374393282:2576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:03.754485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 16 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:03.754513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:03.754518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.754524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.754530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.754540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:03.754557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393251:2438], now have 1 active actors on pipe
2025-10-10T14:31:03.754565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600556592184586:2472]
2025-10-10T14:31:03.754567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600556592184586:2472]
2025-10-10T14:31:03.754568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600556592184586:2472]
2025-10-10T14:31:03.754577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:03.754588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:03.754594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:03.754596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:03.754597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:03.754599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:03.754601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:03.754602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 15
2025-10-10T14:31:03.754618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600556592184586:2472]
2025-10-10T14:31:03.754622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:03.754625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:03.754642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393316:2576], now have 1 active actors on pipe
2025-10-10T14:31:03.754692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 15
2025-10-10T14:31:03.754747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.754757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.754778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd84107d-7e437f4-4e518f87-b6c41271_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:03.754787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.754793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.754795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:03.754802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.754815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:03.754828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.754942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.754947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.754963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.755028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 16 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd84107d-7e437f4-4e518f87-b6c41271_0
2025-10-10T14:31:03.755300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a8b5bd-c845dcb7-450e819c-1583a21b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd84107d-7e437f4-4e518f87-b6c41271_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:03.758274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd84107d-7e437f4-4e518f87-b6c41271_0] Write session: try to update token
2025-10-10T14:31:03.758288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd84107d-7e437f4-4e518f87-b6c41271_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:03.776451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:03.776470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.776473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:03.776475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:03.776485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600556592184586:2472]
2025-10-10T14:31:03.776493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600556592184586:2472]
2025-10-10T14:31:03.776497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600556592184586:2472]
2025-10-10T14:31:03.776539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:03.776545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:03.776546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:03.776550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:03.776555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.776557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:03.776755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:03.776866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId: src_id|bd84107d-7e437f4-4e518f87-b6c41271_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:03.779359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:03.842011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600557374393324:2497]
2025-10-10T14:31:03.842327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 15, pipe: [1:7559600557374393324:2497]
2025-10-10T14:31:03.880637Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:03.880936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.880950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.880990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393324:2497], now have 1 active actors on pipe
2025-10-10T14:31:03.881285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:03.881298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:03.881316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:03.881317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600557374393324:2497]
2025-10-10T14:31:03.881346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:03.881393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 16 reason: error at write: Disconnected sessionId: src_id|bd84107d-7e437f4-4e518f87-b6c41271_0
2025-10-10T14:31:03.881581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 16 sessionId: src_id|bd84107d-7e437f4-4e518f87-b6c41271_0 is DEAD
2025-10-10T14:31:03.881710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd84107d-7e437f4-4e518f87-b6c41271_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:03.881719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd84107d-7e437f4-4e518f87-b6c41271_0] Write session will restart in 0.005340s
2025-10-10T14:31:03.881738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd84107d-7e437f4-4e518f87-b6c41271_0] Write session: Do CDS request
2025-10-10T14:31:03.881746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd84107d-7e437f4-4e518f87-b6c41271_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:03.887883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd84107d-7e437f4-4e518f87-b6c41271_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.888007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:03.888020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 17
2025-10-10T14:31:03.888137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:03.888176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 17 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:03.888186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=17 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:03.888190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:03.888589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 17 sessionId:  describe result for acl check
2025-10-10T14:31:03.888623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:03.888629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:03.888631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:03.888637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600557374393354:2580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:03.889134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600557374393354:2580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:03.889854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:03.890415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:03.890584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:03.890591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:03.890599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:03.890639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:03.890686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600556592184662:2474]
2025-10-10T14:31:03.890963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600557374393354:2580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:03.891099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:03.891379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:03.891427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:03.891680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:03.891730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.891734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.891735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.891736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.891736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.891737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.891738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.891739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.891739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.891751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.891752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.891752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.891754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.891758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.891765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.891768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.891772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.891776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.891780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.891783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.891787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.891791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.891796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.891798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.891800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.891802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.891808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.891812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:03.891816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.891820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:03.891823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.891826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:03.891828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.891831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:03.891834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.891837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:03.891840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.891843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:03.891846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.891849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:03.891853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.891856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:03.891860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.891863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:03.891865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.891868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:03.891870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.891873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.891876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.891879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.891881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.891886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.891929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:03.898781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:03.898826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600557374393354:2580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:03.898855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600557374393354:2580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:03.898861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600557374393354:2580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:03.898873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 17 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:03.899166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:03.899177Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:03.899179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:03.899183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:03.899190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 16 [2:7559600556592184662:2474]
2025-10-10T14:31:03.899202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:03.899221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:03.899226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.899228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.899230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.899249Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:03.899259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:03.899264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:03.899337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.899346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.899347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.899349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:03.899428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:03.899435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.899447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:03.899456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:03.899466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:03.899482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393391:2580], now have 1 active actors on pipe
2025-10-10T14:31:03.899485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393325:2438], now have 1 active actors on pipe
2025-10-10T14:31:03.899507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600556592184657:2474]
2025-10-10T14:31:03.899508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600556592184657:2474]
2025-10-10T14:31:03.899509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600556592184657:2474]
2025-10-10T14:31:03.899515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 16
2025-10-10T14:31:03.899526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:03.899533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 16
2025-10-10T14:31:03.899538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:03.899541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:03.899545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:03.899546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:03.899560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:03.899564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:03.899615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.899629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.899641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600556592184657:2474]
2025-10-10T14:31:03.899650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:03.899658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:03.899684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:03.899694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:03.899697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:03.899707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:03.899714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:03.899724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:03.899747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.899914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:03.899925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:03.899940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:03.900022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 17 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0
2025-10-10T14:31:03.900416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd84107d-7e437f4-4e518f87-b6c41271_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:03.906421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0] Write session: try to update token
2025-10-10T14:31:03.906436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:03.922181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId: src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:03.922819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:03.922841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:03.922843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:03.922845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:03.922853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600556592184657:2474]
2025-10-10T14:31:03.922857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600556592184657:2474]
2025-10-10T14:31:03.922862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600556592184657:2474]
2025-10-10T14:31:03.922907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:03.922916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:03.922919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:03.922919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:03.922927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:03.922931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:03.923139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:03.924639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:03.981264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600557374393399:2497]
2025-10-10T14:31:03.981545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 16, pipe: [1:7559600557374393399:2497]
2025-10-10T14:31:04.032362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:04.032626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.032640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.032672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600557374393399:2497], now have 1 active actors on pipe
2025-10-10T14:31:04.032912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:04.032938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600557374393399:2497]
2025-10-10T14:31:04.032953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:04.032978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:04.033059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 17 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0
2025-10-10T14:31:04.033238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 17 sessionId: src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0 is DEAD
2025-10-10T14:31:04.033443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:04.033455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0] Write session will restart in 0.009976s
2025-10-10T14:31:04.033474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0] Write session: Do CDS request
2025-10-10T14:31:04.033479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:04.040050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:04.040420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:04.040564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:04.040574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:04.040581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:04.040613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:04.040682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600560887152042:2477]
2025-10-10T14:31:04.041091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:04.041416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:04.041451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:04.041861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:04.041999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.042008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.042009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.042010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.042010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.042012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.042013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.042014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.042015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.042016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.042017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.042019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.042020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.042026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.042036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.042040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.042043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.042047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.042051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.042055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.042058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.042062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.042066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.042070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.042073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.042077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.042091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.042099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.042106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.042113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.042118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.042123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.042127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.042132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.042137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.042142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.042146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.042151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.042156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.042161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.042166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.042171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.042176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.042181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.042186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.042190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.042195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.042201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.042206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.042211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.042218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.042223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.042259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:04.044956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.045056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:04.045069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 18
2025-10-10T14:31:04.045250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.045292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 18 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:04.045303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=18 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:04.045308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:04.045715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 18 sessionId:  describe result for acl check
2025-10-10T14:31:04.045744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:04.045750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:04.045752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:04.045771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600561669360746:2585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:04.046236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600561669360746:2585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:04.046478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:04.046905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:04.046919Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:04.046921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:04.046925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:04.046933Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 17 [2:7559600560887152042:2477]
2025-10-10T14:31:04.046942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:04.046955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:04.046958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.046963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.046964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.046976Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:04.046980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:04.046985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:04.047033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.047040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.047042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.047044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:04.047090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:04.047099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.047109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.047119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.047134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:04.047151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360708:2438], now have 1 active actors on pipe
2025-10-10T14:31:04.047161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600560887152037:2477]
2025-10-10T14:31:04.047168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600560887152037:2477]
2025-10-10T14:31:04.047170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600560887152037:2477]
2025-10-10T14:31:04.047161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 17
2025-10-10T14:31:04.047180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:04.047189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:04.047198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:04.047199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:04.047200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:04.047202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:04.047204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:04.047222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600560887152037:2477]
2025-10-10T14:31:04.047229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:04.047245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:04.048810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600561669360746:2585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:04.056374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600561669360746:2585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:04.056386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600561669360746:2585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:04.056390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600561669360746:2585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:04.056396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 18 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:04.056635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360779:2585], now have 1 active actors on pipe
2025-10-10T14:31:04.056690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 17
2025-10-10T14:31:04.056745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.056755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.056782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:04.056805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.056809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.056811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:04.056821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.056835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:04.056853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.056994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.057000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.057009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.057073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 18 partition: 0 MaxSeqNo: 40 sessionId: src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0
2025-10-10T14:31:04.057472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b537233-95b67a2d-5db0f633-fa21ee7c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:04.060668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0] Write session: try to update token
2025-10-10T14:31:04.060681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:04.062778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:04.062797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.062806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600560887152037:2477]
2025-10-10T14:31:04.062843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:04.062851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:04.063035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:04.063182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:04.063357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:04.063497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:04.063738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:04.063775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:04.078764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId: src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:04.081212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:04.081405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.081429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.081466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:04.081562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:04.088895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:04.088911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.088914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:04.088916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:04.088930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600560887152037:2477]
2025-10-10T14:31:04.088934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600560887152037:2477]
2025-10-10T14:31:04.088937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600560887152037:2477]
2025-10-10T14:31:04.088985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:04.088984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:04.088989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:04.088993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:04.088996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.088999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:04.089146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:04.133298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600561669360783:2497]
2025-10-10T14:31:04.133593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 17, pipe: [1:7559600561669360783:2497]
2025-10-10T14:31:04.198894Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:04.207056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.207085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.207276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.207340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.207406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.207476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.207532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.207541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.207614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.207678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.207770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.207876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.207927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.207932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.208036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.208096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.208161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.208250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.208371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.208376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.208445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.208509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.208574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.208639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.208758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.208764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.208832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.208892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.208964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.209045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.209173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.209179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.209247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.209307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.209393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.209473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.209531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.209538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.209616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.209731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.209806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.209878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.209933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.209940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.210065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.210129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.210199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.210311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.210366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.210373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.210452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.210526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.210598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.210665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.210721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.210726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.210796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:04.210854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:04.210918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:04.211012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:04.211069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:04.211073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:04.211132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360783:2497], now have 1 active actors on pipe
2025-10-10T14:31:04.211381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:04.211386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:04.211390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:04.211417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 18 reason: error at write: Disconnected sessionId: src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0
2025-10-10T14:31:04.211435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600561669360783:2497]
2025-10-10T14:31:04.211616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 18 sessionId: src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0 is DEAD
2025-10-10T14:31:04.211799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:04.211810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0] Write session will restart in 0.005574s
2025-10-10T14:31:04.211848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0] Write session: Do CDS request
2025-10-10T14:31:04.211852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:04.211862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:04.218070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:04.218470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:04.218644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:04.218653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:04.218663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:04.218709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:04.218759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600560887152115:2479]
2025-10-10T14:31:04.218768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.218832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:04.218845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 19
2025-10-10T14:31:04.218927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.218952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 19 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:04.218955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=19 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:04.218958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:04.219289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 19 sessionId:  describe result for acl check
2025-10-10T14:31:04.219321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:04.219326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:04.219332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:04.219336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600561669360819:2589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:04.219360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:04.219597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:04.219635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:04.219777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600561669360819:2589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:04.219944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:04.220002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.220008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.220009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.220010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.220011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.220013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.220014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.220015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.220016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.220018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.220019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.220020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.220021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.220026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.220037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.220041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.220047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.220051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.220055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.220059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.220063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.220067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.220075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.220079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.220086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.220090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.220100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.220110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.220120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.220128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.220137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.220142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.220150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.220156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.220160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.220166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.220174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.220180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.220190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.220199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.220203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.220212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.220220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.220225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.220234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.220239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.220243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.220249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.220254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.220263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.220272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.220277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.220317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:04.221743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600561669360819:2589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:04.223033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:04.223379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:04.223388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:04.223391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:04.223394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:04.223399Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 18 [2:7559600560887152115:2479]
2025-10-10T14:31:04.223414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:04.223431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:04.223438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.223441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.223444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.223457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:04.223463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:04.223474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:04.223526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.223532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.223534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.223539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:04.223618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:04.223625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.223636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.223650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.223670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:04.223692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360784:2438], now have 1 active actors on pipe
2025-10-10T14:31:04.223669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 18
2025-10-10T14:31:04.223703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600560887152110:2479]
2025-10-10T14:31:04.223710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600560887152110:2479]
2025-10-10T14:31:04.223713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600560887152110:2479]
2025-10-10T14:31:04.223727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:04.223739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:04.223742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:04.223749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:04.223751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:04.223755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:04.223758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:04.223784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600560887152110:2479]
2025-10-10T14:31:04.223796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:04.223801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:04.223878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600561669360819:2589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:04.223888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600561669360819:2589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:04.223891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600561669360819:2589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:04.223896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 19 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:04.224082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360854:2589], now have 1 active actors on pipe
2025-10-10T14:31:04.224109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 18
2025-10-10T14:31:04.224169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.224181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.224203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:04.224213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.224217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.224219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:04.224227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.224240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:04.224254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.224401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.224406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.224416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.224486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 19 partition: 0 MaxSeqNo: 40 sessionId: src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0
2025-10-10T14:31:04.224708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f397f10-2fab4f98-bc189e3d-ba6b5d66_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:04.231395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0] Write session: try to update token
2025-10-10T14:31:04.231409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:04.245711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId: src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:04.256149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:04.256167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.256173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:04.256175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:04.256187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600560887152110:2479]
2025-10-10T14:31:04.256195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600560887152110:2479]
2025-10-10T14:31:04.256199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600560887152110:2479]
2025-10-10T14:31:04.256239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:04.256246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:04.256251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:04.256253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.256254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:04.256255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:04.256357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:04.256392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:04.311483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600561669360885:2497]
2025-10-10T14:31:04.311707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 18, pipe: [1:7559600561669360885:2497]
2025-10-10T14:31:04.360759Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:04.360993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.361009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.361048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360885:2497], now have 1 active actors on pipe
2025-10-10T14:31:04.361308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:04.361358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:04.361388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:04.361421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600561669360885:2497]
2025-10-10T14:31:04.361466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 19 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0
2025-10-10T14:31:04.361685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 19 sessionId: src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0 is DEAD
2025-10-10T14:31:04.361840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:04.361852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0] Write session will restart in 0.008843s
2025-10-10T14:31:04.361873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0] Write session: Do CDS request
2025-10-10T14:31:04.361878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:04.367641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:04.368058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:04.368199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:04.368208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:04.368214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:04.368243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:04.368272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600560887152227:2494]
2025-10-10T14:31:04.368667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:04.368900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:04.368924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:04.369158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:04.369203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.369207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.369208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.369208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.369209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.369210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.369210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.369211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.369212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.369213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.369213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.369214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.369215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.369218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.369226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.369228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.369231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.369233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.369235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.369238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.369240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.369242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.369244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.369247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.369249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.369251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.369256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.369261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.369265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.369269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.369271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.369274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.369277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.369280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.369283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.369286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.369290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.369293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.369296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.369299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.369301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.369304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.369307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.369311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.369313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.369317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.369319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.369322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.369325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.369338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.369341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.369344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.369365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:04.371834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.371953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:04.371965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 20
2025-10-10T14:31:04.372142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.372177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 20 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:04.372187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=20 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:04.372191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:04.372579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:04.372645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 20 sessionId:  describe result for acl check
2025-10-10T14:31:04.372677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:04.372684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:04.372686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:04.372693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600561669360925:2602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:04.373256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600561669360925:2602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:04.373895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:04.373904Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:04.373905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:04.373909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:04.373913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 19 [2:7559600560887152227:2494]
2025-10-10T14:31:04.373930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:04.373943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:04.373948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.373950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.373951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.373976Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:04.373984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:04.373989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:04.374032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.374036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.374038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.374039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:04.374087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:04.374094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.374101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.374107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.374117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:04.374131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360886:2438], now have 1 active actors on pipe
2025-10-10T14:31:04.374144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600560887152220:2494]
2025-10-10T14:31:04.374149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600560887152220:2494]
2025-10-10T14:31:04.374150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600560887152220:2494]
2025-10-10T14:31:04.374161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:04.374173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:04.374185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:04.374185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:04.374190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:04.374190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:04.374179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 19
2025-10-10T14:31:04.374192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:04.374208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600560887152220:2494]
2025-10-10T14:31:04.374211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:04.374215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:04.375401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600561669360925:2602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:04.383047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600561669360925:2602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:04.383059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600561669360925:2602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:04.383062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600561669360925:2602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:04.383085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 20 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:04.383322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360959:2602], now have 1 active actors on pipe
2025-10-10T14:31:04.383370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 19
2025-10-10T14:31:04.383417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.383424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.383454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:04.383465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.383469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.383471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:04.383480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.383492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:04.383507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.383682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.383688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.383698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.383787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 20 partition: 0 MaxSeqNo: 40 sessionId: src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0
2025-10-10T14:31:04.384143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd19f2-852ae2bc-9f99d31e-10eec07c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:04.387054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0] Write session: try to update token
2025-10-10T14:31:04.387067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:04.397447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:04.397463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.397465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:04.397470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:04.397478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600560887152220:2494]
2025-10-10T14:31:04.397482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600560887152220:2494]
2025-10-10T14:31:04.397485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600560887152220:2494]
2025-10-10T14:31:04.397525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:04.397527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:04.397532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.397533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:04.397534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:04.397538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:04.397688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:04.403474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId: src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:04.406265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:04.461530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600561669360962:2497]
2025-10-10T14:31:04.461761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 19, pipe: [1:7559600561669360962:2497]
2025-10-10T14:31:04.501426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:04.502384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.502395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.502411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360962:2497], now have 1 active actors on pipe
2025-10-10T14:31:04.502646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:04.502656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:04.502682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:04.502667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600561669360962:2497]
2025-10-10T14:31:04.502684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:04.502751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 20 reason: error at write: Disconnected sessionId: src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0
2025-10-10T14:31:04.502984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 20 sessionId: src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0 is DEAD
2025-10-10T14:31:04.503136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:04.503150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0] Write session will restart in 0.007409s
2025-10-10T14:31:04.503175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0] Write session: Do CDS request
2025-10-10T14:31:04.503185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:04.509553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:04.509852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:04.509988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:04.509996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:04.510004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:04.510038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:04.510099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600560887152302:2496]
2025-10-10T14:31:04.510521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:04.510755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:04.510784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:04.511004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:04.511042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.511046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.511047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.511048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.511049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.511049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.511050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.511051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.511051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.511052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.511053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.511054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.511055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.511058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.511065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.511068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.511070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.511072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.511075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.511077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.511079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.511085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.511087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.511089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.511091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.511093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.511108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.511115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.511120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.511126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.511133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.511136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.511139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.511142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.511144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.511147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.511150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.511153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.511155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.511158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.511161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.511164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.511167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.511170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.511172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.511175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.511178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.511181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.511184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.511186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.511189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.511192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.511214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:04.511866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.511943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:04.511954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 21
2025-10-10T14:31:04.512122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.512161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 21 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:04.512169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=21 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:04.512173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:04.512514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 21 sessionId:  describe result for acl check
2025-10-10T14:31:04.512541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:04.512545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:04.512547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:04.512551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600561669361006:2606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:04.512999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600561669361006:2606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:04.513353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:04.513707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:04.513718Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:04.513720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:04.513724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:04.513729Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 20 [2:7559600560887152302:2496]
2025-10-10T14:31:04.513738Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:04.513750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:04.513751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.513753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.513755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.513766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:04.513771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:04.513776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:04.513819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.513825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.513826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.513828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:04.513884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:04.513890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.513899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.513907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.513918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:04.513935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669360965:2438], now have 1 active actors on pipe
2025-10-10T14:31:04.513945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600560887152297:2496]
2025-10-10T14:31:04.513946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600560887152297:2496]
2025-10-10T14:31:04.513948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600560887152297:2496]
2025-10-10T14:31:04.513964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:04.513974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:04.513976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:04.513980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:04.513987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:04.513989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:04.513971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 20
2025-10-10T14:31:04.513993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:04.514007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600560887152297:2496]
2025-10-10T14:31:04.514009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:04.514012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:04.515169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600561669361006:2606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:04.521120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600561669361006:2606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:04.521135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600561669361006:2606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:04.521140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600561669361006:2606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:04.521155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 21 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:04.521367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361046:2606], now have 1 active actors on pipe
2025-10-10T14:31:04.521403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 20
2025-10-10T14:31:04.521471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.521481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.521505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:04.521519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.521523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.521525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:04.521537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.521550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:04.521568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.521730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.521737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.521747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.521840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 21 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0
2025-10-10T14:31:04.522270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35d60f25-51baf1ad-b63d67c7-6eea2920_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:04.525480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0] Write session: try to update token
2025-10-10T14:31:04.525496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:04.535545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:04.535565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.535568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:04.535571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:04.535581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600560887152297:2496]
2025-10-10T14:31:04.535586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600560887152297:2496]
2025-10-10T14:31:04.535591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600560887152297:2496]
2025-10-10T14:31:04.535647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:04.535646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:04.535655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:04.535659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:04.535661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.535664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:04.535846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:04.543107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId: src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:04.545732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:04.602827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600561669361059:2497]
2025-10-10T14:31:04.603180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 20, pipe: [1:7559600561669361059:2497]
2025-10-10T14:31:04.645320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:04.646017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.646037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.646058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361059:2497], now have 1 active actors on pipe
2025-10-10T14:31:04.646336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:04.646336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:04.646349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:04.646360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:04.646420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600561669361059:2497]
2025-10-10T14:31:04.646423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 21 reason: error at write: Disconnected sessionId: src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0
2025-10-10T14:31:04.646658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 21 sessionId: src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0 is DEAD
2025-10-10T14:31:04.646796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:04.646806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0] Write session will restart in 0.007301s
2025-10-10T14:31:04.646831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0] Write session: Do CDS request
2025-10-10T14:31:04.646838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:04.653932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:04.654355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:04.654508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:04.654518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:04.654525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:04.654560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:04.654601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600560887152382:2500]
2025-10-10T14:31:04.654957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.655004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:04.655083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:04.655101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 22
2025-10-10T14:31:04.655227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.655252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 22 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:04.655266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=22 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:04.655270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:04.655286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:04.655338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:04.655677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:04.655699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 22 sessionId:  describe result for acl check
2025-10-10T14:31:04.655737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:04.655743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:04.655747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.655745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:04.655754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.655751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600561669361100:2612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:04.655755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.655756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.655757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.655761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.655762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.655763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.655765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.655766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.655767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.655768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.655769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.655773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.655783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.655787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.655790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.655794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.655797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.655801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.655804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.655807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.655811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.655815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.655818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.655822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.655829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.655836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.655848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.655853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.655863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.655869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.655873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.655878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.655887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.655892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.655897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.655906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.655911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.655915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.655919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.655923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.655928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.655932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.655936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.655940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.655945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.655955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.655959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.655969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.655976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.655986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.656019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:04.656299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600561669361100:2612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:04.658613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600561669361100:2612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:04.658847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:04.659255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:04.659267Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:04.659269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:04.659273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:04.659278Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 21 [2:7559600560887152382:2500]
2025-10-10T14:31:04.659290Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:04.659310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:04.659319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.659322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.659329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.659343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:04.659354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:04.659366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:04.659425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.659432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.659434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.659436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:04.659508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:04.659516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.659527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.659542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.659563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:04.659585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361061:2438], now have 1 active actors on pipe
2025-10-10T14:31:04.659597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600560887152377:2500]
2025-10-10T14:31:04.659604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600560887152377:2500]
2025-10-10T14:31:04.659606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600560887152377:2500]
2025-10-10T14:31:04.659591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 21
2025-10-10T14:31:04.659617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:04.659630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:04.659633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:04.659642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:04.659644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:04.659648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:04.659651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:04.659678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600560887152377:2500]
2025-10-10T14:31:04.659691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:04.659699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:04.665929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600561669361100:2612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:04.665943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600561669361100:2612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:04.665947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600561669361100:2612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:04.665965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 22 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:04.666220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361136:2612], now have 1 active actors on pipe
2025-10-10T14:31:04.666275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 21
2025-10-10T14:31:04.666374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.666389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.666419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:04.666429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.666440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.666450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:04.666466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.666481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:04.666505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.666711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.666721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.666738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.666849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 22 partition: 0 MaxSeqNo: 40 sessionId: src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0
2025-10-10T14:31:04.667284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4f1b0-9d05c842-572e68fc-eb0cdfcf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:04.670478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0] Write session: try to update token
2025-10-10T14:31:04.670495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:04.672821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:04.672838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.672848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600560887152377:2500]
2025-10-10T14:31:04.672888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:04.672898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:04.673098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:04.673270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:04.673505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:04.673660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:04.673885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:04.673936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:04.687464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId: src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:04.690001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:04.690305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.690331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.690353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:04.690356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.690359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:04.690362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:04.690370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600560887152377:2500]
2025-10-10T14:31:04.690374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600560887152377:2500]
2025-10-10T14:31:04.690378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600560887152377:2500]
2025-10-10T14:31:04.690416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:04.690433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:04.690437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:04.690438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:04.690445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.690447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:04.690592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:04.746703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600561669361139:2497]
2025-10-10T14:31:04.746920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 21, pipe: [1:7559600561669361139:2497]
2025-10-10T14:31:04.794131Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:04.794385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:04.794421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361139:2497], now have 1 active actors on pipe
2025-10-10T14:31:04.794547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:04.794635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:04.794700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600561669361139:2497]
2025-10-10T14:31:04.801708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:04.801999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:04.802159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:04.802168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:04.802175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:04.802209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:04.802243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600560887152458:2502]
2025-10-10T14:31:04.802657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:04.802894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:04.802925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:04.803148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:04.803197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.803202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.803203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.803204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.803204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.803205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.803206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.803207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.803208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.803211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.803212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.803212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.803213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.803217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.803224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.803226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.803228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.803230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.803233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.803235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.803237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.803239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.803241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.803243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.803245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.803247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.803252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.803257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.803261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.803264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.803267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.803269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.803272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.803275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.803278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.803281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.803284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.803289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.803291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.803294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.803298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.803300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.803303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.803306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.803309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.803312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.803314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.803317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.803320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.803323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.803327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.803330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.803353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:04.805627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:04.805994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:04.806005Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:04.806007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:04.806011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:04.806017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 22 [2:7559600560887152458:2502]
2025-10-10T14:31:04.806029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:04.806048Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:04.806054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.806057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.806060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.806074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:04.806084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:04.806091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:04.806149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.806155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.806157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.806160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:04.806230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:04.806237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.806247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.806262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.806282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:04.806253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:04.806302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600560887152453:2502]
2025-10-10T14:31:04.806266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:04.806308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600560887152453:2502]
2025-10-10T14:31:04.806311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600560887152453:2502]
2025-10-10T14:31:04.806293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 22 reason: error at write: Disconnected sessionId: src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0
2025-10-10T14:31:04.806326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:04.806339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:04.806350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:04.806359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:04.806363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:04.806367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:04.806370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:04.806381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600560887152453:2502]
2025-10-10T14:31:04.806385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:04.806388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:04.806474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 22 sessionId: src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0 is DEAD
2025-10-10T14:31:04.806636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:04.806648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0] Write session will restart in 0.005597s
2025-10-10T14:31:04.806666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0] Write session: Do CDS request
2025-10-10T14:31:04.806671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:04.809002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361140:2438], now have 1 active actors on pipe
2025-10-10T14:31:04.809017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 22
2025-10-10T14:31:04.813833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.813942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:04.813956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 23
2025-10-10T14:31:04.814123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.814162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 23 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:04.814172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=23 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:04.814177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:04.814668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 23 sessionId:  describe result for acl check
2025-10-10T14:31:04.814707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:04.814715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:04.814717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:04.814724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600561669361188:2616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:04.815292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600561669361188:2616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:04.817244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600561669361188:2616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:04.822734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600561669361188:2616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:04.822749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600561669361188:2616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:04.822752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600561669361188:2616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:04.822762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 23 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:04.823028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361217:2616], now have 1 active actors on pipe
2025-10-10T14:31:04.823054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 22
2025-10-10T14:31:04.823148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.823163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.823194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce9b51f-67473258-72fe84df-35670d85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:04.823212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.823224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.823227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:04.823242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.823260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:04.823290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.823492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.823504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.823520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.823597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 23 partition: 0 MaxSeqNo: 40 sessionId: src_id|ce9b51f-67473258-72fe84df-35670d85_0
2025-10-10T14:31:04.823998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8314ee38-43760265-fbee3b14-4f7ccf91_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ce9b51f-67473258-72fe84df-35670d85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:04.827172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9b51f-67473258-72fe84df-35670d85_0] Write session: try to update token
2025-10-10T14:31:04.827192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9b51f-67473258-72fe84df-35670d85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:04.830548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:04.830568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.830571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:04.830573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:04.830581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600560887152453:2502]
2025-10-10T14:31:04.830586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600560887152453:2502]
2025-10-10T14:31:04.830590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600560887152453:2502]
2025-10-10T14:31:04.830626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:04.830629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:04.830635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.830637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:04.830637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:04.830644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:04.830791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:04.844451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId: src_id|ce9b51f-67473258-72fe84df-35670d85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:04.847100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:04.894654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600561669361220:2497]
2025-10-10T14:31:04.894936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 22, pipe: [1:7559600561669361220:2497]
2025-10-10T14:31:04.935447Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:04.935740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.935752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.935770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361220:2497], now have 1 active actors on pipe
2025-10-10T14:31:04.935934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:04.935990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:04.935992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:04.936002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:04.936039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600561669361220:2497]
2025-10-10T14:31:04.936084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 23 reason: error at write: Disconnected sessionId: src_id|ce9b51f-67473258-72fe84df-35670d85_0
2025-10-10T14:31:04.936279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 23 sessionId: src_id|ce9b51f-67473258-72fe84df-35670d85_0 is DEAD
2025-10-10T14:31:04.936411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9b51f-67473258-72fe84df-35670d85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:04.936432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9b51f-67473258-72fe84df-35670d85_0] Write session will restart in 0.007525s
2025-10-10T14:31:04.936457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9b51f-67473258-72fe84df-35670d85_0] Write session: Do CDS request
2025-10-10T14:31:04.936463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9b51f-67473258-72fe84df-35670d85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:04.943089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:04.943666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:04.943828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:04.943836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:04.943845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:04.943889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:04.943927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600560887152536:2504]
2025-10-10T14:31:04.944501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:04.944789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:04.944823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9b51f-67473258-72fe84df-35670d85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.944827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:04.944972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:04.944985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 24
2025-10-10T14:31:04.945109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:04.945162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.945140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:04.945167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 24 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:04.945168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.945170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=24 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:04.945174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:04.945169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.945170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.945171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.945172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.945174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.945175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.945176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.945177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.945179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.945180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.945181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.945186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.945195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.945199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.945203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.945207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.945211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.945214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.945218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.945221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.945225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.945229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.945234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.945238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.945244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.945252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:04.945257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.945263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:04.945266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.945271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:04.945275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.945279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:04.945284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.945288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:04.945292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.945297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:04.945302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.945306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:04.945310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.945315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:04.945320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.945325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:04.945342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.945347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:04.945352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.945358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.945362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.945367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.945372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.945376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.945412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:04.945574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 24 sessionId:  describe result for acl check
2025-10-10T14:31:04.945617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:04.945624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:04.945626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:04.945632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600561669361262:2620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:04.946181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600561669361262:2620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:04.947624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:04.947979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:04.947991Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:04.947996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:04.947999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:04.948005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 23 [2:7559600560887152536:2504]
2025-10-10T14:31:04.948017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:04.948033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:04.948040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.948043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.948046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.948059Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:04.948069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:04.948075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:04.948129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.948135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.948137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.948139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:04.948211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:04.948218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.948228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:04.948203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600561669361262:2620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:04.948241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:04.948260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:04.948279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361221:2438], now have 1 active actors on pipe
2025-10-10T14:31:04.948285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600560887152531:2504]
2025-10-10T14:31:04.948288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600560887152531:2504]
2025-10-10T14:31:04.948290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600560887152531:2504]
2025-10-10T14:31:04.948306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:04.948318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:04.948327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 23
2025-10-10T14:31:04.948327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:04.948336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:04.948339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:04.948339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:04.948340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:04.948358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600560887152531:2504]
2025-10-10T14:31:04.948362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:04.948364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:04.955578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600561669361262:2620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:04.955605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600561669361262:2620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:04.955608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600561669361262:2620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:04.955617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 24 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:04.955898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600561669361298:2620], now have 1 active actors on pipe
2025-10-10T14:31:04.955940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 23
2025-10-10T14:31:04.955999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.956011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.956038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:04.956050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:04.956061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:04.956064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:04.956076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:04.956092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:04.956115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.956288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:04.956296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:04.956308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:04.956381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 24 partition: 0 MaxSeqNo: 40 sessionId: src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0
2025-10-10T14:31:04.956709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9b51f-67473258-72fe84df-35670d85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:04.959387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0] Write session: try to update token
2025-10-10T14:31:04.959402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:04.972124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:04.972145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:04.972147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:04.972149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:04.972156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600560887152531:2504]
2025-10-10T14:31:04.972159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600560887152531:2504]
2025-10-10T14:31:04.972163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600560887152531:2504]
2025-10-10T14:31:04.972205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:04.972204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:04.972209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:04.972211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:04.972213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:04.972213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:04.972353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:04.974515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId: src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:04.977166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1010 14:31:04.999082056 2322774 chttp2_transport.cc:1143]             ipv4:127.0.0.1:7170: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:31:05.035937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600565964328613:2497]
2025-10-10T14:31:05.036261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 23, pipe: [1:7559600565964328613:2497]
2025-10-10T14:31:05.080895Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:05.081211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.081223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.081256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328613:2497], now have 1 active actors on pipe
2025-10-10T14:31:05.081495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:05.081572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600565964328613:2497]
2025-10-10T14:31:05.081588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:05.081612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:05.081698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 24 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0
2025-10-10T14:31:05.081869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 24 sessionId: src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0 is DEAD
2025-10-10T14:31:05.082072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:05.082082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0] Write session will restart in 0.005339s
2025-10-10T14:31:05.082100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0] Write session: Do CDS request
2025-10-10T14:31:05.082105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:05.088717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.088835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:05.088847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 25
2025-10-10T14:31:05.088940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.088961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 25 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:05.088968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=25 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:05.088972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:05.089063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:05.089390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 25 sessionId:  describe result for acl check
2025-10-10T14:31:05.089432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:05.089439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:05.089441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:05.089447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600565964328654:2626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:05.089573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:05.089759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.089772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:05.089791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:05.089847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:05.089895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600565182119924:2508]
2025-10-10T14:31:05.089952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600565964328654:2626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:05.090465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:05.090765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:05.090815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:05.091111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:05.091185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.091191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.091192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.091194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.091194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.091195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.091196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.091197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.091199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.091200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.091201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.091202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.091203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.091209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.091220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.091224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.091228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.091232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.091236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.091240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.091244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.091247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.091251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.091255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.091259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.091263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.091269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.091276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.091282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.091287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.091291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.091295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.091300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.091305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.091310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.091315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.091319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.091327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.091336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.091341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.091350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.091359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.091363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.091368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.091373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.091378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.091387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.091393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.091402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.091411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.091419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.091423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.091460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:05.091717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600565964328654:2626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:05.093642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:05.093801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600565964328654:2626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:05.093814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600565964328654:2626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:05.093816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600565964328654:2626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:05.093832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 25 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:05.094085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:05.094096Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:05.094098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:05.094101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:05.094106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 24 [2:7559600565182119924:2508]
2025-10-10T14:31:05.094117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:05.094129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:05.094131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.094132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.094134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.094142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:05.094150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:05.094159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:05.094207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.094212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.094213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.094214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:05.094264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:05.094270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.094276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.094285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.094298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:05.094319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328614:2438], now have 1 active actors on pipe
2025-10-10T14:31:05.094327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328688:2626], now have 1 active actors on pipe
2025-10-10T14:31:05.094333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600565182119919:2508]
2025-10-10T14:31:05.094340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600565182119919:2508]
2025-10-10T14:31:05.094341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600565182119919:2508]
2025-10-10T14:31:05.094355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:05.094365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:05.094377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:05.094382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:05.094376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 24
2025-10-10T14:31:05.094384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:05.094391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 24
2025-10-10T14:31:05.094397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600565182119919:2508]
2025-10-10T14:31:05.094397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:05.094398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:05.094399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:05.094406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:05.094425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.094431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.094448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:05.094456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.094458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.094463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:05.094470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.094480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:05.094495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.094667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.094675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.094688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.094783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 25 partition: 0 MaxSeqNo: 40 sessionId: src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0
2025-10-10T14:31:05.095164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51b86efb-3578fd5f-10d2d829-3aa50ac0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:05.098124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0] Write session: try to update token
2025-10-10T14:31:05.098136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:05.105521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:05.105544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.105556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600565182119919:2508]
2025-10-10T14:31:05.105620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:05.105625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:05.105991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:05.106203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.106449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.106779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.107153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:05.107200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:05.114678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId: src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:05.117669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:05.117875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.117901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.117950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:05.118079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:05.122932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:05.122952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.122955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:05.122957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:05.122967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600565182119919:2508]
2025-10-10T14:31:05.122971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600565182119919:2508]
2025-10-10T14:31:05.122975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600565182119919:2508]
2025-10-10T14:31:05.123032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:05.123039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:05.123048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.123048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:05.123053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:05.123054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:05.123207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:05.181893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600565964328697:2497]
2025-10-10T14:31:05.182158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 24, pipe: [1:7559600565964328697:2497]
2025-10-10T14:31:05.228566Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:05.236551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.236578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.236751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.236818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.236885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.236950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.237002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.237010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.237079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.237166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.237234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.237299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.237374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.237381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.237486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.237578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.237677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.237758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.237817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.237823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.237928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.238004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.238072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.238138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.238189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.238194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.238267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.238327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.238392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.238456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.238506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.238511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.238582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.238644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.238709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.238779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.238825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.238830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.238901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.238959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.239024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.239092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.239191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.239197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.239267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.239329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.239395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.239459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.239510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.239514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.239582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.239642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.239704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.239767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.239828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.239833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.239902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.239966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.240052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.240117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.240168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.240173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.240235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328697:2497], now have 1 active actors on pipe
2025-10-10T14:31:05.240498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:05.240508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600565964328697:2497]
2025-10-10T14:31:05.240539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:05.240542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:05.240576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 25 reason: error at write: Disconnected sessionId: src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0
2025-10-10T14:31:05.240817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 25 sessionId: src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0 is DEAD
2025-10-10T14:31:05.240948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:05.240960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0] Write session will restart in 0.007473s
2025-10-10T14:31:05.240983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0] Write session: Do CDS request
2025-10-10T14:31:05.240990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:05.240996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:05.247137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:05.247518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:05.247694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.247703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:05.247712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:05.247760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:05.247805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600565182120004:2510]
2025-10-10T14:31:05.248234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:05.248508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:05.248548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:05.248773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:05.248820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.248824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.248825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.248826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.248827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.248827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.248828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.248828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.248829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.248829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.248830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.248831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.248832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.248835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.248842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.248844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.248846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.248848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.248850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.248852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.248853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.248855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.248857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.248859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.248861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.248863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.248867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.248872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.248875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.248878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.248881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.248884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.248888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.248891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.248896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.248899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.248901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.248905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.248908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.248910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.248912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.248915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.248917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.248920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.248923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.248925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.248928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.248931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.248934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.248937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.248940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.248943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.248963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:05.249829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.249888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:05.249901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 26
2025-10-10T14:31:05.250017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.250039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 26 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:05.250044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=26 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:05.250047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:05.250501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 26 sessionId:  describe result for acl check
2025-10-10T14:31:05.250554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:05.250560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:05.250562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:05.250568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600565964328743:2630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:05.251074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600565964328743:2630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:05.251168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:05.251555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:05.251570Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:05.251572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:05.251576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:05.251582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 25 [2:7559600565182120004:2510]
2025-10-10T14:31:05.251593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:05.251610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:05.251616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.251619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.251622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.251635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:05.251646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:05.251656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:05.251712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.251718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.251720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.251722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:05.251780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:05.251787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.251794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.251800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.251808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:05.251821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600565182119999:2510]
2025-10-10T14:31:05.251830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600565182119999:2510]
2025-10-10T14:31:05.251837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600565182119999:2510]
2025-10-10T14:31:05.251854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:05.251865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:05.251874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:05.251879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:05.251883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:05.251887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:05.251888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:05.251896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600565182119999:2510]
2025-10-10T14:31:05.251899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:05.251901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:05.252144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328698:2438], now have 1 active actors on pipe
2025-10-10T14:31:05.252147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 25
2025-10-10T14:31:05.252688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600565964328743:2630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:05.257889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600565964328743:2630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:05.257904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600565964328743:2630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:05.257907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600565964328743:2630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:05.257916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 26 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:05.258179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328777:2630], now have 1 active actors on pipe
2025-10-10T14:31:05.258225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 25
2025-10-10T14:31:05.258283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.258295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.258321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:05.258335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.258340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.258343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:05.258355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.258373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:05.258392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.258533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.258542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.258555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.258628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 26 partition: 0 MaxSeqNo: 40 sessionId: src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0
2025-10-10T14:31:05.258991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19783745-d1bc98d8-28cbae74-64cc21fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:05.261930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0] Write session: try to update token
2025-10-10T14:31:05.261945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:05.270633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:05.270649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.270652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:05.270653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:05.270659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600565182119999:2510]
2025-10-10T14:31:05.270662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600565182119999:2510]
2025-10-10T14:31:05.270665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600565182119999:2510]
2025-10-10T14:31:05.270701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:05.270702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:05.270706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:05.270709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:05.270710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.270712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:05.270871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:05.278567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId: src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:05.281397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:05.340626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600565964328805:2497]
2025-10-10T14:31:05.340929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 25, pipe: [1:7559600565964328805:2497]
2025-10-10T14:31:05.377780Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:05.378289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.378305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.378326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328805:2497], now have 1 active actors on pipe
2025-10-10T14:31:05.378593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:05.378615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600565964328805:2497]
2025-10-10T14:31:05.378615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:05.378621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:05.378651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:05.378699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 26 reason: error at write: Disconnected sessionId: src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0
2025-10-10T14:31:05.378930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 26 sessionId: src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0 is DEAD
2025-10-10T14:31:05.379067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:05.379078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0] Write session will restart in 0.008989s
2025-10-10T14:31:05.379095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0] Write session: Do CDS request
2025-10-10T14:31:05.379101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:05.385711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:05.386130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:05.386312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.386322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:05.386330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:05.386373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:05.386413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600565182120123:2525]
2025-10-10T14:31:05.386999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:05.387313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:05.387356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:05.387648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:05.387697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.387702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.387703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.387704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.387705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.387707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.387708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.387709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.387711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.387712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.387713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.387714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.387715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.387720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.387730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.387734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.387738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.387742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.387746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.387749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.387753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.387756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.387760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.387764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.387767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.387771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.387778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.387789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.387799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.387804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.387813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.387818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.387822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.387831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.387839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.387848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.387856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.387863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.387871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.387881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.387888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.387893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.387902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.387910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.387917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.387922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.387931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.387935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.387941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.387950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.387958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.387963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.388003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:05.388832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.388936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:05.388948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 27
2025-10-10T14:31:05.389179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.389210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 27 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:05.389215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=27 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:05.389219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:05.389656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 27 sessionId:  describe result for acl check
2025-10-10T14:31:05.389694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:05.389700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:05.389702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:05.389709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600565964328852:2643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:05.390223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:05.390296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600565964328852:2643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:05.390579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:05.390590Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:05.390592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:05.390595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:05.390601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 26 [2:7559600565182120123:2525]
2025-10-10T14:31:05.390613Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:05.390627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:05.390634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.390636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.390638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.390650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:05.390660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:05.390671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:05.390723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.390729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.390732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.390734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:05.390802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:05.390809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.390819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.390834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.390852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:05.390850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 26
2025-10-10T14:31:05.390871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328806:2438], now have 1 active actors on pipe
2025-10-10T14:31:05.390882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600565182120118:2525]
2025-10-10T14:31:05.390889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600565182120118:2525]
2025-10-10T14:31:05.390891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600565182120118:2525]
2025-10-10T14:31:05.390903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:05.390915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:05.390916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:05.390919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:05.390921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:05.390936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:05.390939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:05.390959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600565182120118:2525]
2025-10-10T14:31:05.390969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:05.390972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:05.392176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600565964328852:2643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:05.397202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600565964328852:2643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:05.397215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600565964328852:2643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:05.397219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600565964328852:2643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:05.397228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 27 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:05.397484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328886:2643], now have 1 active actors on pipe
2025-10-10T14:31:05.397542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 26
2025-10-10T14:31:05.397597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.397608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.397632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4bb7798-49fae691-4c2757a6-54559742_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:05.397646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.397651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.397654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:05.397666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.397682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:05.397705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.397881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.397889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.397902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.398006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 27 partition: 0 MaxSeqNo: 40 sessionId: src_id|a4bb7798-49fae691-4c2757a6-54559742_0
2025-10-10T14:31:05.398383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68c00dd-3e02d2af-d454c5aa-9a931f53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a4bb7798-49fae691-4c2757a6-54559742_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:05.401549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4bb7798-49fae691-4c2757a6-54559742_0] Write session: try to update token
2025-10-10T14:31:05.401570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4bb7798-49fae691-4c2757a6-54559742_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:05.401783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:05.401798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.401806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600565182120118:2525]
2025-10-10T14:31:05.401849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:05.401861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:05.402053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:05.402211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.402364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.402525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.402754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:05.402790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:05.417926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId: src_id|a4bb7798-49fae691-4c2757a6-54559742_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:05.419714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:05.419735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.419738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:05.419740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:05.419752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600565182120118:2525]
2025-10-10T14:31:05.419756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600565182120118:2525]
2025-10-10T14:31:05.419761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600565182120118:2525]
2025-10-10T14:31:05.419799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:05.419804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:05.419809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:05.419810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:05.419818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.419821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:05.420002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:05.420747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:05.478856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600565964328890:2497]
2025-10-10T14:31:05.479151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 26, pipe: [1:7559600565964328890:2497]
2025-10-10T14:31:05.526402Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:05.527521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.527536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.527551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328890:2497], now have 1 active actors on pipe
2025-10-10T14:31:05.527713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:05.527717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:05.527757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:05.527762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:05.527773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600565964328890:2497]
2025-10-10T14:31:05.527841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 27 reason: error at write: Disconnected sessionId: src_id|a4bb7798-49fae691-4c2757a6-54559742_0
2025-10-10T14:31:05.528064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 27 sessionId: src_id|a4bb7798-49fae691-4c2757a6-54559742_0 is DEAD
2025-10-10T14:31:05.528211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4bb7798-49fae691-4c2757a6-54559742_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:05.528219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4bb7798-49fae691-4c2757a6-54559742_0] Write session will restart in 0.007614s
2025-10-10T14:31:05.528237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4bb7798-49fae691-4c2757a6-54559742_0] Write session: Do CDS request
2025-10-10T14:31:05.528246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4bb7798-49fae691-4c2757a6-54559742_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:05.534391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:05.534875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:05.535032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.535043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:05.535052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:05.535092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:05.535136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600565182120209:2529]
2025-10-10T14:31:05.535738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:05.535999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:05.536036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:05.536337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:05.536388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.536394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.536396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.536397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.536398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.536399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.536400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.536401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.536402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.536404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.536405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.536406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.536407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.536412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.536423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.536427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.536431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.536435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.536439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.536443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.536447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.536450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.536454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.536458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.536461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.536465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.536473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.536484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.536493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.536499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.536508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.536513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.536521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.536526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.536535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.536541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.536549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.536554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.536561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.536567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.536576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.536581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.536590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.536597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.536604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.536609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.536617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.536622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.536630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.536635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.536644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.536650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.536692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:05.536821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4bb7798-49fae691-4c2757a6-54559742_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.536952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:05.536966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 28
2025-10-10T14:31:05.537144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.537173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 28 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:05.537180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=28 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:05.537184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:05.537709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 28 sessionId:  describe result for acl check
2025-10-10T14:31:05.537745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:05.537751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:05.537752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:05.537757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600565964328949:2649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:05.538260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600565964328949:2649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:05.540166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:05.540571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600565964328949:2649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:05.540641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:05.540652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:05.540654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:05.540658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:05.540664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 27 [2:7559600565182120209:2529]
2025-10-10T14:31:05.540675Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:05.540690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:05.540697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.540701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.540703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.540717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:05.540728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:05.540741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:05.540792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.540799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.540802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.540804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:05.540877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:05.540884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.540895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.540911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.540930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:05.540952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328902:2438], now have 1 active actors on pipe
2025-10-10T14:31:05.540963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600565182120204:2529]
2025-10-10T14:31:05.540969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600565182120204:2529]
2025-10-10T14:31:05.540971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600565182120204:2529]
2025-10-10T14:31:05.540985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:05.541000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:05.541001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:05.541005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:05.541007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:05.541017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:05.541004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 27
2025-10-10T14:31:05.541020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:05.541043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600565182120204:2529]
2025-10-10T14:31:05.541050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:05.541054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:05.545849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600565964328949:2649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:05.545861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600565964328949:2649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:05.545864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600565964328949:2649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:05.545869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 28 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:05.546133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328983:2649], now have 1 active actors on pipe
2025-10-10T14:31:05.546163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 27
2025-10-10T14:31:05.546259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.546270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.546290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:05.546302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.546308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.546309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:05.546322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.546337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:05.546353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.546509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.546515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.546524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.546615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 28 partition: 0 MaxSeqNo: 40 sessionId: src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0
2025-10-10T14:31:05.546920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4bb7798-49fae691-4c2757a6-54559742_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:05.549872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0] Write session: try to update token
2025-10-10T14:31:05.549885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:05.551849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:05.551865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.551874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600565182120204:2529]
2025-10-10T14:31:05.551909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:05.551923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:05.552079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:05.552223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.552373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.552513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.552721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:05.552759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:05.565443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId: src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:05.568054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:05.569226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.569249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.569269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:05.569272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.569275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:05.569278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:05.569286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600565182120204:2529]
2025-10-10T14:31:05.569295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600565182120204:2529]
2025-10-10T14:31:05.569299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600565182120204:2529]
2025-10-10T14:31:05.569357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:05.569372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:05.569374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:05.569375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:05.569385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.569388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:05.569538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:05.627856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600565964328989:2497]
2025-10-10T14:31:05.628172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 27, pipe: [1:7559600565964328989:2497]
2025-10-10T14:31:05.676869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:05.677114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:05.677147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328989:2497], now have 1 active actors on pipe
2025-10-10T14:31:05.677292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:05.677351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:05.677402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600565964328989:2497]
2025-10-10T14:31:05.677421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:05.677425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:05.677501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 28 reason: error at write: Disconnected sessionId: src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0
2025-10-10T14:31:05.677677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 28 sessionId: src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0 is DEAD
2025-10-10T14:31:05.677829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:05.677841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0] Write session will restart in 0.009842s
2025-10-10T14:31:05.677865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0] Write session: Do CDS request
2025-10-10T14:31:05.677872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:05.685008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:05.685428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:05.685585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.685596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:05.685605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:05.685646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:05.685687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600565182120291:2531]
2025-10-10T14:31:05.686301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:05.686573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:05.686608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:05.686900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:05.686949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.686955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.686956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.686957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.686958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.686959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.686960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.686961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.686962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.686964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.686965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.686966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.686967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.686971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.686982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.686986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.686990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.686993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.686997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.687001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.687004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.687008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.687017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.687025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.687028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.687036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.687043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.687055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.687061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.687070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.687079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.687088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.687096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.687105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.687113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.687123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.687131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.687140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.687149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.687154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.687158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.687166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.687176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.687186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.687194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.687202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.687210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.687219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.687226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.687231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.687239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.687247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.687288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:05.688776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.688908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:05.688922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 29
2025-10-10T14:31:05.689111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.689146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 29 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:05.689157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=29 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:05.689162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:05.689402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:05.689727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 29 sessionId:  describe result for acl check
2025-10-10T14:31:05.689754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:05.689765Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:05.689760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:05.689767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:05.689770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:05.689768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:05.689770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:05.689776Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 28 [2:7559600565182120291:2531]
2025-10-10T14:31:05.689776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600565964329040:2653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:05.689787Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:05.689803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:05.689809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.689812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.689814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.689827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:05.689840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:05.689850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:05.689896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.689903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.689905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.689908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:05.689989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:05.689996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.690007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.690022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.690043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:05.690065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964328991:2438], now have 1 active actors on pipe
2025-10-10T14:31:05.690076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600565182120286:2531]
2025-10-10T14:31:05.690082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600565182120286:2531]
2025-10-10T14:31:05.690085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600565182120286:2531]
2025-10-10T14:31:05.690098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:05.690090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 28
2025-10-10T14:31:05.690114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:05.690123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:05.690126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:05.690128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:05.690133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:05.690140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:05.690166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600565182120286:2531]
2025-10-10T14:31:05.690180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:05.690210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:05.690405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600565964329040:2653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:05.692185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600565964329040:2653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:05.697419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600565964329040:2653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:05.697431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600565964329040:2653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:05.697434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600565964329040:2653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:05.697440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 29 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:05.697660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964329073:2653], now have 1 active actors on pipe
2025-10-10T14:31:05.697711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 28
2025-10-10T14:31:05.697793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.697805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.697832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:05.697845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.697852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.697860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:05.697870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.697886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:05.697906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.698113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.698125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.698138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.698229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 29 partition: 0 MaxSeqNo: 40 sessionId: src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0
2025-10-10T14:31:05.698543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad876cc-fced1ec3-afed9bed-ee4ca1ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:05.701669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0] Write session: try to update token
2025-10-10T14:31:05.701756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:05.708974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:05.708999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.709002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:05.709004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:05.709014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600565182120286:2531]
2025-10-10T14:31:05.709021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600565182120286:2531]
2025-10-10T14:31:05.709025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600565182120286:2531]
2025-10-10T14:31:05.709073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:05.709081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:05.709087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.709088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:05.709090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:05.709092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:05.709264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:05.716242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId: src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:05.718663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:05.777374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600565964329076:2497]
2025-10-10T14:31:05.777667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 28, pipe: [1:7559600565964329076:2497]
2025-10-10T14:31:05.815852Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:05.816137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.816150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.816184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964329076:2497], now have 1 active actors on pipe
2025-10-10T14:31:05.816416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:05.816423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:05.816465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:05.816469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:05.816474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600565964329076:2497]
2025-10-10T14:31:05.816559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 29 reason: error at write: Disconnected sessionId: src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0
2025-10-10T14:31:05.816779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 29 sessionId: src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0 is DEAD
2025-10-10T14:31:05.816949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:05.816961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0] Write session will restart in 0.005423s
2025-10-10T14:31:05.816996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0] Write session: Do CDS request
2025-10-10T14:31:05.817005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:05.823084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:05.823446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:05.823615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.823626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:05.823635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:05.823677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:05.823721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600565182120375:2533]
2025-10-10T14:31:05.823869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.823919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:05.823939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 30
2025-10-10T14:31:05.824048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.824072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 30 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:05.824079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=30 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:05.824082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:05.824364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:05.824447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 30 sessionId:  describe result for acl check
2025-10-10T14:31:05.824482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:05.824486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:05.824488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:05.824492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600565964329123:2657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:05.824679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:05.824724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:05.824919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600565964329123:2657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:05.825048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:05.825104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.825112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.825113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.825114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.825115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.825116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.825118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.825118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.825120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.825121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.825123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.825124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.825125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.825129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.825141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.825145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.825148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.825152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.825156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.825160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.825163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.825167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.825171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.825175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.825178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.825182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.825189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.825197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.825209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.825215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.825221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.825228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.825233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.825238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.825243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.825253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.825258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.825268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.825272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.825277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.825282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.825286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.825291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.825297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.825302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.825310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.825314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.825322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.825326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.825355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.825359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.825365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.825411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:05.826701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600565964329123:2657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:05.827568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:05.827930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:05.827946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:05.827948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:05.827951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:05.827956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 29 [2:7559600565182120375:2533]
2025-10-10T14:31:05.827966Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:05.827980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:05.827989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.827992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.827994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.828007Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:05.828013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:05.828018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:05.828075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.828085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.828087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.828090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:05.828159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 29
2025-10-10T14:31:05.828206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:05.828214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.828227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.828243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.828265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:05.828283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964329078:2438], now have 1 active actors on pipe
2025-10-10T14:31:05.828301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600565182120370:2533]
2025-10-10T14:31:05.828306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600565182120370:2533]
2025-10-10T14:31:05.828308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600565182120370:2533]
2025-10-10T14:31:05.828322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:05.828335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:05.828340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:05.828343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:05.828344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:05.828355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:05.828358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:05.828378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600565182120370:2533]
2025-10-10T14:31:05.828393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:05.828422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:05.830140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600565964329123:2657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:05.830150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600565964329123:2657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:05.830153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600565964329123:2657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:05.830157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 30 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:05.830334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964329161:2657], now have 1 active actors on pipe
2025-10-10T14:31:05.830371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 29
2025-10-10T14:31:05.830425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.830436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.830460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:05.830473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.830478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.830480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:05.830491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.830506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:05.830527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.830703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.830713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.830728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.830813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 30 partition: 0 MaxSeqNo: 40 sessionId: src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0
2025-10-10T14:31:05.831058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58eb75-f7e33bb4-4001b24b-cfbc5e53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:05.833847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0] Write session: try to update token
2025-10-10T14:31:05.833861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:05.839147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:05.839169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.839181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600565182120370:2533]
2025-10-10T14:31:05.839227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:05.839233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:05.839416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:05.839566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.839713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.839861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.840085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:05.840128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:05.848301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId: src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:05.850647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:05.850873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.850893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.850921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:05.851020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:05.856161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:05.856180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.856184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:05.856186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:05.856196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600565182120370:2533]
2025-10-10T14:31:05.856200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600565182120370:2533]
2025-10-10T14:31:05.856205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600565182120370:2533]
2025-10-10T14:31:05.856255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:05.856257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:05.856262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:05.856265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:05.856268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.856271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:05.856425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:05.916607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600565964329164:2497]
2025-10-10T14:31:05.916866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 29, pipe: [1:7559600565964329164:2497]
2025-10-10T14:31:05.965889Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:05.972711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.972732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.972880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.972934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.972997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.973057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.973104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.973118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.973182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.973234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.973290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.973452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.973498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.973504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.973563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.973621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.973735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.973820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.973864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.973871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.973944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.974022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.974083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.974140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.974177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.974188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.974246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.974300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.974354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.974410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.974451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.974458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.974515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.974571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.974630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.974687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.974731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.974736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.974795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.974853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.974909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.974964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.975056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.975064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.975129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.975189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.975245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.975300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.975342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.975348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.975408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.975460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.975522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.975584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.975644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.975646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.975706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:05.975759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:05.975814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:05.975868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:05.975915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:05.975923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:05.975963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964329164:2497], now have 1 active actors on pipe
2025-10-10T14:31:05.976187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:05.976198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600565964329164:2497]
2025-10-10T14:31:05.976226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:05.976229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:05.976269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 30 reason: error at write: Disconnected sessionId: src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0
2025-10-10T14:31:05.976485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 30 sessionId: src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0 is DEAD
2025-10-10T14:31:05.976603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:05.976614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0] Write session will restart in 0.007602s
2025-10-10T14:31:05.976639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0] Write session: Do CDS request
2025-10-10T14:31:05.976659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:05.976663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:05.983670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:05.984064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:05.984222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:05.984232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:05.984243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:05.984290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:05.984328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600565182120459:2535]
2025-10-10T14:31:05.984798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:05.985000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:05.985036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:05.985303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:05.985365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.985371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.985372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.985373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.985374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.985375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.985376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.985377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.985378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.985379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.985380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.985380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.985382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.985387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.985399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.985403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.985407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.985411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.985419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.985423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.985427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.985430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.985434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.985438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.985442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.985446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.985453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.985465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:05.985472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.985481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:05.985487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.985496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:05.985500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.985506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:05.985515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.985520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:05.985526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.985531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:05.985535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.985540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:05.985544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.985549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:05.985553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.985558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:05.985562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.985566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:05.985569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.985571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.985573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.985576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.985579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.985582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.985612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:05.985840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.985900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:05.985917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 31
2025-10-10T14:31:05.986036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:05.986062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 31 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:05.986071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=31 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:05.986075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:05.986450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 31 sessionId:  describe result for acl check
2025-10-10T14:31:05.986482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:05.986488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:05.986490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:05.986495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600565964329219:2661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:05.986893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600565964329219:2661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:05.987785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:05.988076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:05.988087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:05.988088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:05.988091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:05.988095Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 30 [2:7559600565182120459:2535]
2025-10-10T14:31:05.988103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:05.988116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:05.988118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.988120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.988121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.988125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600565964329219:2661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:05.988135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:05.988144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:05.988150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:05.988197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.988205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.988206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.988208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:05.988254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:05.988259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:05.988266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:05.988276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:05.988287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:05.988311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964329169:2438], now have 1 active actors on pipe
2025-10-10T14:31:05.988324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600565182120454:2535]
2025-10-10T14:31:05.988330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600565182120454:2535]
2025-10-10T14:31:05.988334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600565182120454:2535]
2025-10-10T14:31:05.988332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 30
2025-10-10T14:31:05.988346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:05.988349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:05.988351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:05.988353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:05.988360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:05.988370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:05.988372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:05.988397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600565182120454:2535]
2025-10-10T14:31:05.988403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:05.988407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:05.993030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600565964329219:2661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:05.993039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600565964329219:2661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:05.993042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600565964329219:2661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:05.993048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 31 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:05.993280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600565964329250:2661], now have 1 active actors on pipe
2025-10-10T14:31:05.993300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 30
2025-10-10T14:31:05.993371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.993383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.993425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:05.993440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:05.993446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:05.993453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:05.993466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:05.993485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:05.993509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.993668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:05.993678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:05.993698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:05.993786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 31 partition: 0 MaxSeqNo: 40 sessionId: src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0
2025-10-10T14:31:05.994101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f9c88b-79eb0acd-d803f0b9-6c295763_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:05.996633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0] Write session: try to update token
2025-10-10T14:31:05.996650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:05.999012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:05.999023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:05.999031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600565182120454:2535]
2025-10-10T14:31:05.999063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:05.999067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:05.999224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:05.999345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.999459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.999614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:05.999777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:05.999809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:06.010167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId: src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:06.012798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:06.012992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.013012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.013047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:06.013116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:06.016151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:06.016168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.016170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:06.016174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:06.016182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600565182120454:2535]
2025-10-10T14:31:06.016185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600565182120454:2535]
2025-10-10T14:31:06.016188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600565182120454:2535]
2025-10-10T14:31:06.016223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:06.016226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:06.016233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:06.016233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.016235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:06.016236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:06.016364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:06.076362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600570259296561:2497]
2025-10-10T14:31:06.076618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 30, pipe: [1:7559600570259296561:2497]
2025-10-10T14:31:06.118870Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:06.125389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.125412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.125550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.125606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.125665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.125727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.125778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.125788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.125855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.125910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.125965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.126036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.126077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.126082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.126192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.126247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.126331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.126388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.126429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.126434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.126493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.126578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.126642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.126703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.126749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.126755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.126814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.126871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.126935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.126991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.127028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.127034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.127092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.127146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.127200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.127254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.127293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.127298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.127354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.127409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.127465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.127595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.127635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.127641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.127700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.127754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.127810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.127864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.127906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.127911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.127972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.128030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.128084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.128138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.128175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.128180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.128264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.128315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.128369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.128422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.128468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.128473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.128509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296561:2497], now have 1 active actors on pipe
2025-10-10T14:31:06.128743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:06.128767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:06.128771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:06.128801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 31 reason: error at write: Disconnected sessionId: src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0
2025-10-10T14:31:06.128801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600570259296561:2497]
2025-10-10T14:31:06.129088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:06.129202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:06.129209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0] Write session will restart in 0.008148s
2025-10-10T14:31:06.129186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 31 sessionId: src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0 is DEAD
2025-10-10T14:31:06.129228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0] Write session: Do CDS request
2025-10-10T14:31:06.129233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:06.135309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:06.135681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:06.135856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:06.135870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:06.135880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:06.135929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:06.135968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600569477087853:2538]
2025-10-10T14:31:06.136565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:06.136816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:06.136861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:06.137199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:06.137253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.137261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.137262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.137264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.137265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.137266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.137267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.137268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.137270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.137271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.137272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.137273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.137275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.137280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.137292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.137296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.137301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.137305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.137310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.137313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.137317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.137322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.137326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.137346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.137350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.137354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.137362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.137370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.137377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.137383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.137388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.137393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.137398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.137404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.137408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.137414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.137418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.137424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.137434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.137439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.137444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.137450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.137454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.137466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.137470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.137476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.137486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.137491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.137496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.137501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.137507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.137512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.137558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:06.138750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.138857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:06.138868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 32
2025-10-10T14:31:06.138988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.139029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 32 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:06.139038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=32 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:06.139043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:06.139462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 32 sessionId:  describe result for acl check
2025-10-10T14:31:06.139502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:06.139508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:06.139510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:06.139515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600570259296615:2666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:06.139717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:06.140023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600570259296615:2666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:06.140023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:06.140036Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:06.140039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:06.140043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:06.140048Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 31 [2:7559600569477087853:2538]
2025-10-10T14:31:06.140059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:06.140075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:06.140078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.140081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.140083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.140099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:06.140107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:06.140115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:06.140174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.140183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.140185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.140188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:06.140248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:06.140257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.140267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.140279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.140303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:06.140327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600569477087848:2538]
2025-10-10T14:31:06.140334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600569477087848:2538]
2025-10-10T14:31:06.140336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600569477087848:2538]
2025-10-10T14:31:06.140349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:06.140361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:06.140362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:06.140370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:06.140373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:06.140377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:06.140381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:06.140400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600569477087848:2538]
2025-10-10T14:31:06.140409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:06.140410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:06.140424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296563:2438], now have 1 active actors on pipe
2025-10-10T14:31:06.140469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 31
2025-10-10T14:31:06.142053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600570259296615:2666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:06.147544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600570259296615:2666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:06.147558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600570259296615:2666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:06.147561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600570259296615:2666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:06.147570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 32 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:06.147870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 31
2025-10-10T14:31:06.147839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296649:2666], now have 1 active actors on pipe
2025-10-10T14:31:06.147938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.147949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.147977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ced40a8a-db70d786-6285c825-31077916_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:06.147994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.148008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.148014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:06.148024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.148036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:06.148053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.148197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.148205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.148215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.148268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 32 partition: 0 MaxSeqNo: 40 sessionId: src_id|ced40a8a-db70d786-6285c825-31077916_0
2025-10-10T14:31:06.148595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8867b057-ea193a28-34775dfb-60e4b9c1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ced40a8a-db70d786-6285c825-31077916_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:06.151152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced40a8a-db70d786-6285c825-31077916_0] Write session: try to update token
2025-10-10T14:31:06.151169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced40a8a-db70d786-6285c825-31077916_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:06.158949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:06.158974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.158979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:06.158982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:06.158990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600569477087848:2538]
2025-10-10T14:31:06.158999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600569477087848:2538]
2025-10-10T14:31:06.159004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600569477087848:2538]
2025-10-10T14:31:06.159047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:06.159054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:06.159057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:06.159059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:06.159066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.159068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:06.159268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:06.166233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: src_id|ced40a8a-db70d786-6285c825-31077916_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:06.168915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:06.228945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600570259296652:2497]
2025-10-10T14:31:06.229219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 31, pipe: [1:7559600570259296652:2497]
2025-10-10T14:31:06.264233Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:06.264474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.264489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.264508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296652:2497], now have 1 active actors on pipe
2025-10-10T14:31:06.264678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:06.264731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:06.264775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:06.264778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:06.264816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600570259296652:2497]
2025-10-10T14:31:06.264831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 32 reason: error at write: Disconnected sessionId: src_id|ced40a8a-db70d786-6285c825-31077916_0
2025-10-10T14:31:06.265026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 32 sessionId: src_id|ced40a8a-db70d786-6285c825-31077916_0 is DEAD
2025-10-10T14:31:06.265171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced40a8a-db70d786-6285c825-31077916_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:06.265181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced40a8a-db70d786-6285c825-31077916_0] Write session will restart in 0.005779s
2025-10-10T14:31:06.265207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced40a8a-db70d786-6285c825-31077916_0] Write session: Do CDS request
2025-10-10T14:31:06.265211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced40a8a-db70d786-6285c825-31077916_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:06.271863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced40a8a-db70d786-6285c825-31077916_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.271968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:06.271981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 33
2025-10-10T14:31:06.272131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.272177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 33 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:06.272187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=33 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:06.272191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:06.272576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 33 sessionId:  describe result for acl check
2025-10-10T14:31:06.272576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:06.272612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:06.272615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:06.272617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:06.272623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600570259296703:2672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:06.273027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:06.273156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600570259296703:2672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:06.273186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:06.273200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:06.273212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:06.273266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:06.273307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600569477087940:2540]
2025-10-10T14:31:06.273893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:06.274166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:06.274209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:06.274492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:06.274557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.274566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.274567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.274568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.274569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.274570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.274571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.274572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.274573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.274574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.274576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.274577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.274578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.274582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.274593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.274596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.274600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.274603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.274608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.274611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.274615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.274619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.274623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.274626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.274630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.274633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.274641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.274649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.274655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.274661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.274665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.274669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.274673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.274677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.274681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.274685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.274689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.274693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.274697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.274701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.274705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.274709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.274714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.274718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.274722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.274726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.274731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.274735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.274739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.274743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.274747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.274751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.274786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:06.275378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600570259296703:2672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:06.276966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:06.277301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:06.277315Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:06.277317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:06.277322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:06.277327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 32 [2:7559600569477087940:2540]
2025-10-10T14:31:06.277350Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:06.277364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:06.277366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.277368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.277370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.277382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:06.277393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:06.277399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:06.277448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.277456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.277458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.277460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:06.277534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:06.277543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.277554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.277564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.277584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:06.277612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296656:2438], now have 1 active actors on pipe
2025-10-10T14:31:06.277625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600569477087935:2540]
2025-10-10T14:31:06.277627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600569477087935:2540]
2025-10-10T14:31:06.277629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600569477087935:2540]
2025-10-10T14:31:06.277625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 32
2025-10-10T14:31:06.277639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:06.277654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:06.277659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:06.277665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:06.277668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:06.277673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:06.277676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:06.277679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600570259296703:2672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:06.277691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600570259296703:2672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:06.277694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600570259296703:2672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:06.277702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 33 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:06.277704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600569477087935:2540]
2025-10-10T14:31:06.277720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:06.277732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:06.277884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296738:2672], now have 1 active actors on pipe
2025-10-10T14:31:06.277905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 32
2025-10-10T14:31:06.277961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.277982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.278005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:06.278017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.278020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.278022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:06.278030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.278044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:06.278060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.278207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.278215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.278225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.278310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 33 partition: 0 MaxSeqNo: 40 sessionId: src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0
2025-10-10T14:31:06.278652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced40a8a-db70d786-6285c825-31077916_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:06.281354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0] Write session: try to update token
2025-10-10T14:31:06.281375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:06.296047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId: src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:06.296749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:06.296771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.296775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:06.296777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:06.296786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600569477087935:2540]
2025-10-10T14:31:06.296791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600569477087935:2540]
2025-10-10T14:31:06.296794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600569477087935:2540]
2025-10-10T14:31:06.296833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:06.296839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:06.296841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.296843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:06.296847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:06.296851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:06.296964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:06.298599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:06.365117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600570259296770:2497]
2025-10-10T14:31:06.365391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 32, pipe: [1:7559600570259296770:2497]
2025-10-10T14:31:06.404686Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:06.404900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.404914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.404951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296770:2497], now have 1 active actors on pipe
2025-10-10T14:31:06.405132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:06.405224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:06.405237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:06.405242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600570259296770:2497]
2025-10-10T14:31:06.405263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:06.405299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 33 reason: error at write: Disconnected sessionId: src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0
2025-10-10T14:31:06.405552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 33 sessionId: src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0 is DEAD
2025-10-10T14:31:06.405730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:06.405743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0] Write session will restart in 0.008479s
2025-10-10T14:31:06.405769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0] Write session: Do CDS request
2025-10-10T14:31:06.405775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:06.412213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:06.412564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:06.412734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:06.412746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:06.412756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:06.412806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:06.412848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600569477088066:2555]
2025-10-10T14:31:06.413394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:06.413612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:06.413641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:06.413851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:06.413894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.413900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.413900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.413901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.413901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.413902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.413903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.413903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.413904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.413904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.413905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.413906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.413906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.413910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.413918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.413920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.413923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.413925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.413927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.413929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.413932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.413934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.413936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.413938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.413941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.413943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.413947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.413953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.413957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.413960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.413963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.413966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.413969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.413972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.413986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.413991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.413993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.413996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.413999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.414003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.414005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.414009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.414011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.414015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.414018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.414021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.414023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.414026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.414030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.414034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.414037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.414040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.414076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:06.415854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.415930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:06.415944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 34
2025-10-10T14:31:06.416069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.416092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 34 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:06.416097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=34 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:06.416100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:06.416159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:06.416404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 34 sessionId:  describe result for acl check
2025-10-10T14:31:06.416428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:06.416429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:06.416430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:06.416434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600570259296824:2685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:06.416478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:06.416490Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:06.416491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:06.416494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:06.416498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 33 [2:7559600569477088066:2555]
2025-10-10T14:31:06.416506Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:06.416519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:06.416526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.416528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.416530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.416541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:06.416553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:06.416559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:06.416599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.416605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.416606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.416608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:06.416654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:06.416660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.416667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.416674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.416684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:06.416701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600569477088061:2555]
2025-10-10T14:31:06.416706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600569477088061:2555]
2025-10-10T14:31:06.416708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600569477088061:2555]
2025-10-10T14:31:06.416718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:06.416727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:06.416735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:06.416738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:06.416740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:06.416740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:06.416742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:06.416759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600569477088061:2555]
2025-10-10T14:31:06.416767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:06.416768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:06.416831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600570259296824:2685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:06.416895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296771:2438], now have 1 active actors on pipe
2025-10-10T14:31:06.416910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 33
2025-10-10T14:31:06.418542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600570259296824:2685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:06.422765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600570259296824:2685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:06.422779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600570259296824:2685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:06.422782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600570259296824:2685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:06.422790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 34 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:06.422997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296858:2685], now have 1 active actors on pipe
2025-10-10T14:31:06.423055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 33
2025-10-10T14:31:06.423098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.423110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.423141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28d70a42-c417b9dc-df260fca-3270756e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:06.423158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.423168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.423171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:06.423185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.423206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:06.423223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.423390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.423398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.423414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.423521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 34 partition: 0 MaxSeqNo: 40 sessionId: src_id|28d70a42-c417b9dc-df260fca-3270756e_0
2025-10-10T14:31:06.423877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa4d07a-c063a50c-b0e3320f-dcf01d87_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28d70a42-c417b9dc-df260fca-3270756e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:06.426683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d70a42-c417b9dc-df260fca-3270756e_0] Write session: try to update token
2025-10-10T14:31:06.426703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d70a42-c417b9dc-df260fca-3270756e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:06.435112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:06.435131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.435133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:06.435134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:06.435144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600569477088061:2555]
2025-10-10T14:31:06.435147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600569477088061:2555]
2025-10-10T14:31:06.435150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600569477088061:2555]
2025-10-10T14:31:06.435190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:06.435191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:06.435195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.435197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:06.435197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:06.435200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:06.435326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:06.441016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId: src_id|28d70a42-c417b9dc-df260fca-3270756e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:06.443601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:06.505399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600570259296862:2497]
2025-10-10T14:31:06.505815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 33, pipe: [1:7559600570259296862:2497]
2025-10-10T14:31:06.542323Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:06.542575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.542589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.542609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296862:2497], now have 1 active actors on pipe
2025-10-10T14:31:06.542804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:06.542833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:06.542847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:06.542884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600570259296862:2497]
2025-10-10T14:31:06.542905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:06.542913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 34 reason: error at write: Disconnected sessionId: src_id|28d70a42-c417b9dc-df260fca-3270756e_0
2025-10-10T14:31:06.543110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 34 sessionId: src_id|28d70a42-c417b9dc-df260fca-3270756e_0 is DEAD
2025-10-10T14:31:06.543268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d70a42-c417b9dc-df260fca-3270756e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:06.543278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d70a42-c417b9dc-df260fca-3270756e_0] Write session will restart in 0.005220s
2025-10-10T14:31:06.543296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d70a42-c417b9dc-df260fca-3270756e_0] Write session: Do CDS request
2025-10-10T14:31:06.543303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d70a42-c417b9dc-df260fca-3270756e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:06.549758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d70a42-c417b9dc-df260fca-3270756e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.549744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:06.549847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:06.549860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 35
2025-10-10T14:31:06.550018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.550051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 35 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:06.550058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=35 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:06.550062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:06.550160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:06.550298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:06.550309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:06.550320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:06.550359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:06.550389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600569477088159:2559]
2025-10-10T14:31:06.550432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 35 sessionId:  describe result for acl check
2025-10-10T14:31:06.550461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:06.550466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:06.550468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:06.550472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600570259296920:2691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:06.550795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:06.550874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600570259296920:2691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:06.551089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:06.551133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:06.551414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:06.551465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.551471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.551472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.551473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.551474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.551475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.551476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.551478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.551479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.551480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.551481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.551482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.551483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.551488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.551499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.551502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.551506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.551510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.551515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.551519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.551522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.551526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.551531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.551535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.551538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.551547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.551553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.551568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.551579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.551585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.551598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.551603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.551608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.551613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.551617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.551622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.551631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.551637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.551642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.551651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.551655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.551660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.551669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.551678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.551683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.551692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.551696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.551705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.551713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.551719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.551723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.551729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.551774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:06.552696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600570259296920:2691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:06.553808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:06.554123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:06.554136Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:06.554139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:06.554142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:06.554148Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 34 [2:7559600569477088159:2559]
2025-10-10T14:31:06.554164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:06.554183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:06.554187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.554191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.554193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.554210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:06.554221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:06.554229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:06.554283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.554291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.554293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.554296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:06.554369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:06.554376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.554388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.554401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.554423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:06.554430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 34
2025-10-10T14:31:06.554448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296870:2438], now have 1 active actors on pipe
2025-10-10T14:31:06.554463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600569477088154:2559]
2025-10-10T14:31:06.554469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600569477088154:2559]
2025-10-10T14:31:06.554471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600569477088154:2559]
2025-10-10T14:31:06.554484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:06.554495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:06.554502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:06.554505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:06.554507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:06.554520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:06.554524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:06.554554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600569477088154:2559]
2025-10-10T14:31:06.554565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:06.554571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:06.555654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600570259296920:2691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:06.555665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600570259296920:2691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:06.555668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600570259296920:2691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:06.555674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 35 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:06.555861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296958:2691], now have 1 active actors on pipe
2025-10-10T14:31:06.555897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 34
2025-10-10T14:31:06.555968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.555979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.556012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|901619e-2446f2aa-9df478b8-f5c082b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:06.556027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.556031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.556033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:06.556046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.556058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:06.556077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.556237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.556246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.556261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.556337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 35 partition: 0 MaxSeqNo: 40 sessionId: src_id|901619e-2446f2aa-9df478b8-f5c082b4_0
2025-10-10T14:31:06.556636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d70a42-c417b9dc-df260fca-3270756e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|901619e-2446f2aa-9df478b8-f5c082b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:06.559219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901619e-2446f2aa-9df478b8-f5c082b4_0] Write session: try to update token
2025-10-10T14:31:06.559234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901619e-2446f2aa-9df478b8-f5c082b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:06.565235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:06.565252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.565261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600569477088154:2559]
2025-10-10T14:31:06.565305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:06.565316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:06.565489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:06.565627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:06.565768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:06.565909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:06.566204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:06.566244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:06.573130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId: src_id|901619e-2446f2aa-9df478b8-f5c082b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:06.575556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:06.575750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.575782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.575823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:06.575898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:06.582188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:06.582206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.582210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:06.582212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:06.582222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600569477088154:2559]
2025-10-10T14:31:06.582228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600569477088154:2559]
2025-10-10T14:31:06.582231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600569477088154:2559]
2025-10-10T14:31:06.582273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:06.582274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:06.582282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.582284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:06.582284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:06.582287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:06.582414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:06.643134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600570259296965:2497]
2025-10-10T14:31:06.643370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 34, pipe: [1:7559600570259296965:2497]
2025-10-10T14:31:06.687625Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:06.694037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.694057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.694234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.694301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.694362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.694423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.694466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.694475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.694538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.694591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.694655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.694721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.694762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.694768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.694827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.694884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.694943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.695001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.695048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.695053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.695112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.695171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.695232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.695291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.695332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.695340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.695401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.695462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.695525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.695586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.695632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.695642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.695720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.695781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.695844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.695908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.695950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.695957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.696019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.696074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.696138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.696199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.696250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.696257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.696321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.696384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.696493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.696554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.696594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.696599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.696660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.696714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.696769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.696847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.696893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.696898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.696991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.697047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.697108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.697172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.697267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.697273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.697314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296965:2497], now have 1 active actors on pipe
2025-10-10T14:31:06.697553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:06.697554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600570259296965:2497]
2025-10-10T14:31:06.697563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:06.697569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:06.697588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 35 reason: error at write: Disconnected sessionId: src_id|901619e-2446f2aa-9df478b8-f5c082b4_0
2025-10-10T14:31:06.697775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 35 sessionId: src_id|901619e-2446f2aa-9df478b8-f5c082b4_0 is DEAD
2025-10-10T14:31:06.697947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901619e-2446f2aa-9df478b8-f5c082b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:06.697953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901619e-2446f2aa-9df478b8-f5c082b4_0] Write session will restart in 0.005829s
2025-10-10T14:31:06.697972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901619e-2446f2aa-9df478b8-f5c082b4_0] Write session: Do CDS request
2025-10-10T14:31:06.697986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901619e-2446f2aa-9df478b8-f5c082b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:06.698007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:06.704767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901619e-2446f2aa-9df478b8-f5c082b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.704839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:06.704851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 36
2025-10-10T14:31:06.704996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.704992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:06.705033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 36 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:06.705045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=36 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:06.705049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:06.705452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:06.705450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 36 sessionId:  describe result for acl check
2025-10-10T14:31:06.705482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:06.705489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:06.705491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:06.705497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600570259297017:2695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:06.705605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:06.705614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:06.705623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:06.705664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:06.705699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600569477088249:2561]
2025-10-10T14:31:06.705929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600570259297017:2695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:06.706087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:06.706384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:06.706429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:06.706660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:06.706706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.706710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.706711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.706712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.706712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.706713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.706713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.706714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.706715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.706715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.706716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.706716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.706717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.706721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.706728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.706730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.706732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.706735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.706737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.706739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.706742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.706744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.706746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.706749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.706751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.706753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.706759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.706764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.706769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.706772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.706775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.706778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.706781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.706784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.706787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.706791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.706794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.706797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.706799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.706802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.706805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.706808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.706810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.706814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.706816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.706819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.706821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.706825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.706827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.706830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.706833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.706836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.706870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:06.707969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600570259297017:2695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:06.709021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:06.709322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:06.709349Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:06.709356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:06.709359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:06.709364Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 35 [2:7559600569477088249:2561]
2025-10-10T14:31:06.709374Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:06.709392Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:06.709401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.709406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.709408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.709422Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:06.709428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:06.709438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:06.709484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.709490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.709492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.709494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:06.709558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:06.709567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.709578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.709586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.709594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:06.709614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259296966:2438], now have 1 active actors on pipe
2025-10-10T14:31:06.709625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600569477088244:2561]
2025-10-10T14:31:06.709627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600569477088244:2561]
2025-10-10T14:31:06.709628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600569477088244:2561]
2025-10-10T14:31:06.709637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:06.709645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:06.709647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:06.709648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:06.709650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:06.709657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:06.709625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 35
2025-10-10T14:31:06.709658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:06.709678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600569477088244:2561]
2025-10-10T14:31:06.709687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:06.709693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:06.710188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600570259297017:2695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:06.710198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600570259297017:2695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:06.710201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600570259297017:2695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:06.710206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 36 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:06.710394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259297053:2695], now have 1 active actors on pipe
2025-10-10T14:31:06.710441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 35
2025-10-10T14:31:06.710503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.710516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.710543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:06.710557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.710562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.710564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:06.710572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.710581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:06.710596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.710737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.710746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.710761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.710820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 36 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0
2025-10-10T14:31:06.711065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901619e-2446f2aa-9df478b8-f5c082b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:06.713461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0] Write session: try to update token
2025-10-10T14:31:06.713472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:06.720207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:06.720224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.720234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600569477088244:2561]
2025-10-10T14:31:06.720272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:06.720281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:06.720458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:06.720603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:06.720745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:06.720895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:06.721078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:06.721118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:06.728079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId: src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:06.730445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:06.730632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.730653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.730694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:06.730781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:06.737024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:06.737040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.737042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:06.737044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:06.737058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600569477088244:2561]
2025-10-10T14:31:06.737061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600569477088244:2561]
2025-10-10T14:31:06.737065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600569477088244:2561]
2025-10-10T14:31:06.737107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:06.737108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:06.737115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.737117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:06.737120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:06.737123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:06.737248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:06.797765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600570259297058:2497]
2025-10-10T14:31:06.798042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 35, pipe: [1:7559600570259297058:2497]
2025-10-10T14:31:06.841287Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:06.847970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.847999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.848151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.848213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.848279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.848336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.848377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.848385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.848449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.848507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.848563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.848621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.848664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.848671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.848755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.848811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.848867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.848926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.848969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.848975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.849032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.849087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.849144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.849201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.849242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.849249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.849308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.849376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.849433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.849493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.849533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.849539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.849598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.849653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.849708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.849779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.849831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.849839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.849904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.849959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.850029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.850085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.850124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.850129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.850188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.850246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.850307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.850369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.850408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.850414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.850471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.850522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.850578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.850633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.850677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.850682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.850737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:06.850804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:06.850879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:06.851352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:06.851409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:06.851414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:06.851454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259297058:2497], now have 1 active actors on pipe
2025-10-10T14:31:06.851703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600570259297058:2497]
2025-10-10T14:31:06.851711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:06.851753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:06.851756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:06.851781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 36 reason: error at write: Disconnected sessionId: src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0
2025-10-10T14:31:06.851963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 36 sessionId: src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0 is DEAD
2025-10-10T14:31:06.852047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:06.852092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:06.852103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0] Write session will restart in 0.006582s
2025-10-10T14:31:06.852127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0] Write session: Do CDS request
2025-10-10T14:31:06.852133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:06.859510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:06.859839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.859946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:06.859954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:06.859967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 37
2025-10-10T14:31:06.860078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.860103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 37 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:06.860110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=37 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:06.860101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:06.860110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:06.860113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:06.860122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:06.860167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:06.860201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600569477088340:2563]
2025-10-10T14:31:06.860466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 37 sessionId:  describe result for acl check
2025-10-10T14:31:06.860502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:06.860508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:06.860510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:06.860517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600570259297112:2699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:06.860579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:06.860867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:06.860905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:06.860909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600570259297112:2699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:06.861191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:06.861244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.861250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.861251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.861252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.861254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.861255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.861256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.861257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.861258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.861259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.861260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.861261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.861262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.861267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.861278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.861281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.861285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.861289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.861293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.861297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.861300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.861304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.861308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.861312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.861316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.861320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.861327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.861350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.861356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.861362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.861367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.861373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.861381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.861386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.861394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.861401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.861409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.861414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.861418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.861427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.861431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.861436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.861441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.861448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.861452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.861460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.861463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.861465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.861468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.861471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.861474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.861477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.861498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:06.862353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600570259297112:2699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:06.863501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:06.863795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:06.863807Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:06.863809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:06.863812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:06.863817Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 36 [2:7559600569477088340:2563]
2025-10-10T14:31:06.863829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:06.863844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:06.863849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.863854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.863856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.863869Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:06.863881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:06.863888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:06.863936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.863942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.863944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.863947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:06.864006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:06.864012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.864019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.864025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.864035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:06.864054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259297060:2438], now have 1 active actors on pipe
2025-10-10T14:31:06.864063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600569477088335:2563]
2025-10-10T14:31:06.864065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600569477088335:2563]
2025-10-10T14:31:06.864066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600569477088335:2563]
2025-10-10T14:31:06.864077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:06.864089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:06.864092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:06.864095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:06.864097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:06.864100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:06.864102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:06.864116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600569477088335:2563]
2025-10-10T14:31:06.864123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:06.864115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 36
2025-10-10T14:31:06.864137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:06.868277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600570259297112:2699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:06.868288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600570259297112:2699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:06.868290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600570259297112:2699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:06.868297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 37 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:06.868512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259297150:2699], now have 1 active actors on pipe
2025-10-10T14:31:06.868555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 36
2025-10-10T14:31:06.868613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.868625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.868655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:06.868670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:06.868675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:06.868677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:06.868690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:06.868705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:06.868727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.868883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.868892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.868906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:06.868999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 37 partition: 0 MaxSeqNo: 40 sessionId: src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0
2025-10-10T14:31:06.869351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1327a73-5eea4717-42f2fd02-9c0b9d29_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:06.871857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0] Write session: try to update token
2025-10-10T14:31:06.871872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:06.882223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:06.882245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:06.882249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:06.882251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:06.882261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600569477088335:2563]
2025-10-10T14:31:06.882266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600569477088335:2563]
2025-10-10T14:31:06.882272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600569477088335:2563]
2025-10-10T14:31:06.882318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:06.882330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:06.882331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:06.882334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:06.882337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.882340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:06.882482Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:06.885397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId: src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:06.888032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:06.951883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600570259297153:2497]
2025-10-10T14:31:06.952064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 36, pipe: [1:7559600570259297153:2497]
2025-10-10T14:31:06.987137Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:06.987407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:06.987421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:06.987465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259297153:2497], now have 1 active actors on pipe
2025-10-10T14:31:06.987712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:06.987713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:06.987724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:06.987727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:06.987780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600570259297153:2497]
2025-10-10T14:31:06.987799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 37 reason: error at write: Disconnected sessionId: src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0
2025-10-10T14:31:06.987975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 37 sessionId: src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0 is DEAD
2025-10-10T14:31:06.988129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:06.988136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0] Write session will restart in 0.007472s
2025-10-10T14:31:06.988155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0] Write session: Do CDS request
2025-10-10T14:31:06.988160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:06.995369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:06.995832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:06.995991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:06.996000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:06.996009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:06.996046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:06.996085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600569477088430:2565]
2025-10-10T14:31:06.996578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:06.996827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.996834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:06.996868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:06.996881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:06.996892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 38
2025-10-10T14:31:06.997053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:06.997077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 38 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:06.997081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=38 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:06.997091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:06.997144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:06.997206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.997212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.997213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.997214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.997215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.997216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.997217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.997218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.997219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.997220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.997222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.997223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.997224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.997229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.997242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.997246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.997250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.997253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.997257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.997261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.997265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.997269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.997273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.997277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.997281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.997285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.997292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.997300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:06.997307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.997312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:06.997317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.997322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:06.997347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.997356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:06.997361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.997367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:06.997375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.997381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:06.997386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.997395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:06.997393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 38 sessionId:  describe result for acl check
2025-10-10T14:31:06.997400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.997410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:06.997415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.997416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:06.997420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:06.997421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:06.997422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:06.997428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.997434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:06.997438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.997426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600570259297210:2703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:06.997443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:06.997448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.997453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:06.997458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.997464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:06.997505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:06.997807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600570259297210:2703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:06.999666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:06.999707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600570259297210:2703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:06.999992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:07.000003Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:07.000004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.000007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.000012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 37 [2:7559600569477088430:2565]
2025-10-10T14:31:07.000023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:07.000038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:07.000046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.000049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.000051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.000064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:07.000069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.000076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:07.000116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.000121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.000122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.000124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:07.000166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:07.000171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.000178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.000184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.000193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:07.000211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600570259297155:2438], now have 1 active actors on pipe
2025-10-10T14:31:07.000220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600569477088425:2565]
2025-10-10T14:31:07.000222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600569477088425:2565]
2025-10-10T14:31:07.000223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600569477088425:2565]
2025-10-10T14:31:07.000231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:07.000238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 37
2025-10-10T14:31:07.000245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:07.000253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:07.000256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:07.000258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:07.000264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:07.000267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:07.000292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600569477088425:2565]
2025-10-10T14:31:07.000301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:07.000326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:07.004450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600570259297210:2703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:07.004463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600570259297210:2703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:07.004467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600570259297210:2703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:07.004475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 38 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:07.004713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264542:2703], now have 1 active actors on pipe
2025-10-10T14:31:07.004752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 37
2025-10-10T14:31:07.004822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.004835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.004865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:07.004880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.004889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.004892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.004905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.004923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:07.004943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.005110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.005118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.005132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.005233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 38 partition: 0 MaxSeqNo: 40 sessionId: src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0
2025-10-10T14:31:07.005563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df8be2ca-7cc5316c-6362dce6-91d750ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:07.008179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0] Write session: try to update token
2025-10-10T14:31:07.008197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:07.018227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:07.018256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.018260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:07.018262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:07.018272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600569477088425:2565]
2025-10-10T14:31:07.018277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600569477088425:2565]
2025-10-10T14:31:07.018282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600569477088425:2565]
2025-10-10T14:31:07.018338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:07.018339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:07.018346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:07.018349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.018351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:07.018351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:07.018512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:07.023275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId: src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:07.025865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:07.088067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600574554264557:2497]
2025-10-10T14:31:07.088349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 37, pipe: [1:7559600574554264557:2497]
2025-10-10T14:31:07.131665Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:07.132228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.132240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.132272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264557:2497], now have 1 active actors on pipe
2025-10-10T14:31:07.132488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:07.132517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600574554264557:2497]
2025-10-10T14:31:07.132527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:07.132560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:07.132561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:07.132624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 38 reason: error at write: Disconnected sessionId: src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0
2025-10-10T14:31:07.132765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 38 sessionId: src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0 is DEAD
2025-10-10T14:31:07.132916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:07.132926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0] Write session will restart in 0.009533s
2025-10-10T14:31:07.132946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0] Write session: Do CDS request
2025-10-10T14:31:07.132953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:07.139588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:07.140057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:07.140214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.140231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:07.140243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:07.140284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:07.140314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600573772055831:2568]
2025-10-10T14:31:07.140707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:07.140917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:07.140957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:07.141177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:07.141225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.141231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.141232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.141233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.141234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.141235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.141236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.141237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.141238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.141239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.141241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.141243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.141244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.141249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.141261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.141265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.141270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.141274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.141279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.141283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.141287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.141291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.141295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.141299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.141304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.141308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.141314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.141323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.141351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.141361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.141368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.141377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.141382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.141389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.141394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.141403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.141408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.141415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.141420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.141426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.141432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.141437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.141446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.141452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.141460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.141466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.141474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.141480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.141484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.141494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.141498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.141506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.141549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:07.143752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.143765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:07.143832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:07.143845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 39
2025-10-10T14:31:07.143944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.143975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 39 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:07.143986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=39 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:07.143990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:07.144071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:07.144092Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:07.144095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.144098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.144104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 38 [2:7559600573772055831:2568]
2025-10-10T14:31:07.144115Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:07.144131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:07.144136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.144140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.144143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.144163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:07.144174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.144183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:07.144231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.144237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.144239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.144241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:07.144297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:07.144304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.144315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.144328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.144350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:07.144372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600573772055826:2568]
2025-10-10T14:31:07.144378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600573772055826:2568]
2025-10-10T14:31:07.144380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600573772055826:2568]
2025-10-10T14:31:07.144393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:07.144411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:07.144414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:07.144417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:07.144419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:07.144430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:07.144434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:07.144453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600573772055826:2568]
2025-10-10T14:31:07.144460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:07.144448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 39 sessionId:  describe result for acl check
2025-10-10T14:31:07.144467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:07.144476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264558:2438], now have 1 active actors on pipe
2025-10-10T14:31:07.144481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:07.144487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:07.144490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:07.144495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600574554264618:2708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:07.144508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 38
2025-10-10T14:31:07.144964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600574554264618:2708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:07.146625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600574554264618:2708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:07.152039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600574554264618:2708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:07.152050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600574554264618:2708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:07.152054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600574554264618:2708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:07.152062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 39 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:07.152288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264651:2708], now have 1 active actors on pipe
2025-10-10T14:31:07.152331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 38
2025-10-10T14:31:07.152385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.152395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.152426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:07.152442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.152451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.152454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.152470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.152489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:07.152506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.152653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.152658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.152670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.152754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 39 partition: 0 MaxSeqNo: 40 sessionId: src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0
2025-10-10T14:31:07.153053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d0f68-52a0fcec-5032a64e-bd7ec526_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:07.155521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0] Write session: try to update token
2025-10-10T14:31:07.155535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:07.163509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:07.163532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.163535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:07.163537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:07.163546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600573772055826:2568]
2025-10-10T14:31:07.163550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600573772055826:2568]
2025-10-10T14:31:07.163553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600573772055826:2568]
2025-10-10T14:31:07.163600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:07.163601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:07.163607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:07.163610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:07.163615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.163618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:07.163770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:07.169294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId: src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:07.171689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:07.232449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600574554264654:2497]
2025-10-10T14:31:07.232706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 38, pipe: [1:7559600574554264654:2497]
2025-10-10T14:31:07.267961Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:07.268299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.268311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.268329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264654:2497], now have 1 active actors on pipe
2025-10-10T14:31:07.268477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:07.268544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:07.268590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:07.268634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600574554264654:2497]
2025-10-10T14:31:07.268669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 39 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0
2025-10-10T14:31:07.268847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 39 sessionId: src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0 is DEAD
2025-10-10T14:31:07.269018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:07.269034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0] Write session will restart in 0.007507s
2025-10-10T14:31:07.269054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0] Write session: Do CDS request
2025-10-10T14:31:07.269058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:07.275267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:07.275709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:07.275970Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.275991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:07.276010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:07.276084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:07.276149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600573772055925:2570]
2025-10-10T14:31:07.276837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:07.277129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:07.277164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:07.277399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:07.277436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.277441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.277442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.277443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.277443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.277444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.277444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.277445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.277446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.277446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.277447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.277448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.277448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.277452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.277461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.277463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.277465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.277467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.277469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.277471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.277473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.277475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.277478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.277480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.277482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.277484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.277489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.277495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.277499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.277504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.277507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.277510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.277512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.277515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.277518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.277521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.277523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.277526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.277529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.277532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.277534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.277537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.277540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.277543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.277545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.277548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.277550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.277553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.277556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.277559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.277562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.277564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.277586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:07.277829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.277902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:07.277916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 40
2025-10-10T14:31:07.278093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.278132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 40 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:07.278138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=40 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:07.278147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:07.278531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 40 sessionId:  describe result for acl check
2025-10-10T14:31:07.278564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:07.278571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:07.278573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:07.278578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600574554264714:2712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:07.279100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600574554264714:2712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:07.279790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:07.280150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:07.280165Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:07.280167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.280171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.280177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 39 [2:7559600573772055925:2570]
2025-10-10T14:31:07.280189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:07.280208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:07.280217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.280220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.280223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.280243Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:07.280251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.280263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:07.280319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.280326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.280328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.280331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:07.280396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:07.280404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.280415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.280424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.280438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:07.280464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264655:2438], now have 1 active actors on pipe
2025-10-10T14:31:07.280477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600573772055920:2570]
2025-10-10T14:31:07.280479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600573772055920:2570]
2025-10-10T14:31:07.280481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600573772055920:2570]
2025-10-10T14:31:07.280493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:07.280503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:07.280505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:07.280506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:07.280512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:07.280527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:07.280535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:07.280497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 39
2025-10-10T14:31:07.280569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600573772055920:2570]
2025-10-10T14:31:07.280580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:07.280597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:07.281068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600574554264714:2712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:07.286198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600574554264714:2712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:07.286214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600574554264714:2712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:07.286218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600574554264714:2712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:07.286227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 40 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:07.286485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264748:2712], now have 1 active actors on pipe
2025-10-10T14:31:07.286626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 39
2025-10-10T14:31:07.286693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.286718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.286748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:07.286764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.286769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.286770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.286782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.286798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:07.286823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.286984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.286990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.287001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.287101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 40 partition: 0 MaxSeqNo: 40 sessionId: src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0
2025-10-10T14:31:07.287464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66e0b6a-4f0909bb-4509f16c-2805acfe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:07.290057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0] Write session: try to update token
2025-10-10T14:31:07.290077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:07.298792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:07.298812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.298816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:07.298818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:07.298828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600573772055920:2570]
2025-10-10T14:31:07.298832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600573772055920:2570]
2025-10-10T14:31:07.298835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600573772055920:2570]
2025-10-10T14:31:07.298871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:07.298874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:07.298876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.298878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:07.298880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:07.298883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:07.299012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:07.304426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId: src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:07.306994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:07.368649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600574554264765:2497]
2025-10-10T14:31:07.368922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 39, pipe: [1:7559600574554264765:2497]
2025-10-10T14:31:07.404576Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:07.404793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.404810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.404847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264765:2497], now have 1 active actors on pipe
2025-10-10T14:31:07.405097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:07.405098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600574554264765:2497]
2025-10-10T14:31:07.405117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:07.405120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:07.405187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 40 reason: error at write: Disconnected sessionId: src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0
2025-10-10T14:31:07.405406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 40 sessionId: src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0 is DEAD
2025-10-10T14:31:07.405540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:07.405552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0] Write session will restart in 0.008660s
2025-10-10T14:31:07.405582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0] Write session: Do CDS request
2025-10-10T14:31:07.405588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:07.406431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:07.413073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:07.413620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:07.413770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.413777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:07.413786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:07.413823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:07.413853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600573772056057:2585]
2025-10-10T14:31:07.414255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:07.414580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:07.414631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:07.414878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:07.414917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.414921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.414922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.414923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.414923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.414924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.414925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.414925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.414926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.414926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.414927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.414928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.414929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.414933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.414940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.414942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.414945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.414947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.414949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.414951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.414953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.414955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.414957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.414960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.414962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.414971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.414977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.414983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.414987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.414991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.414993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.414996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.414999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.415002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.415005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.415008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.415011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.415014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.415017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.415020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.415023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.415026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.415029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.415032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.415035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.415038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.415042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.415046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.415050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.415056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.415066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.415070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.415103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:07.415902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.415955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:07.415970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 41
2025-10-10T14:31:07.416125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.416163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 41 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:07.416173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=41 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:07.416177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:07.416500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 41 sessionId:  describe result for acl check
2025-10-10T14:31:07.416544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:07.416549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:07.416550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:07.416554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600574554264837:2725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:07.417015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600574554264837:2725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:07.417386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:07.417742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:07.417754Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:07.417757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.417761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.417767Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 40 [2:7559600573772056057:2585]
2025-10-10T14:31:07.417780Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:07.417793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:07.417795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.417799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.417801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.417812Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:07.417817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.417825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:07.417870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.417875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.417876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.417878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:07.417929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:07.417934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.417942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.417948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.417962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:07.417978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600573772056052:2585]
2025-10-10T14:31:07.417994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600573772056052:2585]
2025-10-10T14:31:07.417996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600573772056052:2585]
2025-10-10T14:31:07.418004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:07.418012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:07.418017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264777:2438], now have 1 active actors on pipe
2025-10-10T14:31:07.418021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:07.418022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:07.418023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:07.418032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:07.418034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:07.418056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600573772056052:2585]
2025-10-10T14:31:07.418063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:07.418054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 40
2025-10-10T14:31:07.418076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:07.419618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600574554264837:2725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:07.425280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600574554264837:2725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:07.425296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600574554264837:2725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:07.425299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600574554264837:2725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:07.425309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 41 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:07.425627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264871:2725], now have 1 active actors on pipe
2025-10-10T14:31:07.425682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 40
2025-10-10T14:31:07.425732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.425747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.425784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:07.425800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.425810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.425813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.425829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.425846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:07.425865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.426079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.426087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.426101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.426203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 41 partition: 0 MaxSeqNo: 40 sessionId: src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0
2025-10-10T14:31:07.426581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1288c9bb-7337e2e-dfb2e646-bc4d9373_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:07.429166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:07.429189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.429199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600573772056052:2585]
2025-10-10T14:31:07.429250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0] Write session: try to update token
2025-10-10T14:31:07.429265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:07.429243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:07.429248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:07.429434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:07.429580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.429720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.429866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.430208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:07.430252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:07.443414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId: src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:07.445852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:07.446634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.446660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.446683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:07.446686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.446689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:07.446692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:07.446702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600573772056052:2585]
2025-10-10T14:31:07.446707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600573772056052:2585]
2025-10-10T14:31:07.446710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600573772056052:2585]
2025-10-10T14:31:07.446744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:07.446754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:07.446757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:07.446765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:07.446772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.446781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:07.446908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:07.505384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600574554264875:2497]
2025-10-10T14:31:07.505622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 40, pipe: [1:7559600574554264875:2497]
2025-10-10T14:31:07.549671Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:07.549877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:07.549916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264875:2497], now have 1 active actors on pipe
2025-10-10T14:31:07.550019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:07.550091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:07.550113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:07.550116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:07.550141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600574554264875:2497]
2025-10-10T14:31:07.550193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 41 reason: error at write: Disconnected sessionId: src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0
2025-10-10T14:31:07.550364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 41 sessionId: src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0 is DEAD
2025-10-10T14:31:07.550533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:07.550544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0] Write session will restart in 0.007646s
2025-10-10T14:31:07.550569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0] Write session: Do CDS request
2025-10-10T14:31:07.550576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:07.557124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:07.557699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:07.557847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.557859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:07.557869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:07.557912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:07.557961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600573772056156:2589]
2025-10-10T14:31:07.558490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:07.558748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:07.558786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:07.559088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:07.559149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.559155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.559156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.559157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.559158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.559159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.559160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.559161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.559162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.559163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.559164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.559166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.559167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.559172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.559182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.559184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.559187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.559188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.559191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.559193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.559195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.559197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.559199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.559201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.559203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.559205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.559211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.559216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.559221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.559224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.559227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.559230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.559233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.559236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.559239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.559242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.559245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.559248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.559250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.559253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.559256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.559259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.559261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.559265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.559267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.559270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.559273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.559276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.559278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.559281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.559284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.559287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.559316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:07.559848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.559945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:07.559958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 42
2025-10-10T14:31:07.560065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.560094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 42 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:07.560107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=42 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:07.560111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:07.560530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 42 sessionId:  describe result for acl check
2025-10-10T14:31:07.560562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:07.560564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:07.560566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:07.560572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600574554264944:2731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:07.561102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600574554264944:2731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:07.561518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:07.561826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:07.561840Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:07.561842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.561846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.561851Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 41 [2:7559600573772056156:2589]
2025-10-10T14:31:07.561863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:07.561879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:07.561882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.561885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.561893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.561909Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:07.561922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.561934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:07.561996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.562003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.562004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.562008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:07.562078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:07.562086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.562096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.562106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.562128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:07.562148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264883:2438], now have 1 active actors on pipe
2025-10-10T14:31:07.562159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600573772056151:2589]
2025-10-10T14:31:07.562166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600573772056151:2589]
2025-10-10T14:31:07.562168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600573772056151:2589]
2025-10-10T14:31:07.562181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:07.562167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 41
2025-10-10T14:31:07.562195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:07.562196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:07.562199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:07.562202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:07.562215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:07.562218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:07.562238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600573772056151:2589]
2025-10-10T14:31:07.562246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:07.562247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:07.563021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600574554264944:2731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:07.568768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600574554264944:2731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:07.568782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600574554264944:2731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:07.568786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600574554264944:2731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:07.568794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 42 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:07.569028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264979:2731], now have 1 active actors on pipe
2025-10-10T14:31:07.569080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 41
2025-10-10T14:31:07.569146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.569157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.569194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5660331e-638769d4-7b040a49-2c629da9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:07.569207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.569216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.569219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.569231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.569248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:07.569267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.569433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.569441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.569456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.569529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 42 partition: 0 MaxSeqNo: 40 sessionId: src_id|5660331e-638769d4-7b040a49-2c629da9_0
2025-10-10T14:31:07.569851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea464b6-e7b19da4-e04fd8c7-fa980cb0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5660331e-638769d4-7b040a49-2c629da9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:07.572353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5660331e-638769d4-7b040a49-2c629da9_0] Write session: try to update token
2025-10-10T14:31:07.572371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5660331e-638769d4-7b040a49-2c629da9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:07.573049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:07.573062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.573071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600573772056151:2589]
2025-10-10T14:31:07.573116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:07.573138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:07.573283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:07.573437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.573569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.573702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.573883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:07.573918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:07.586277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId: src_id|5660331e-638769d4-7b040a49-2c629da9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:07.588732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:07.590176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.590201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.590227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:07.590234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.590238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:07.590240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:07.590248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600573772056151:2589]
2025-10-10T14:31:07.590253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600573772056151:2589]
2025-10-10T14:31:07.590256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600573772056151:2589]
2025-10-10T14:31:07.590307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:07.590315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:07.590320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:07.590322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.590324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:07.590324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:07.590459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:07.650258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600574554264986:2497]
2025-10-10T14:31:07.650501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 41, pipe: [1:7559600574554264986:2497]
2025-10-10T14:31:07.696296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:07.696512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:07.696548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264986:2497], now have 1 active actors on pipe
2025-10-10T14:31:07.696655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:07.696707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600574554264986:2497]
2025-10-10T14:31:07.696727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:07.696745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:07.696749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:07.696845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 42 reason: error at write: Disconnected sessionId: src_id|5660331e-638769d4-7b040a49-2c629da9_0
2025-10-10T14:31:07.697011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 42 sessionId: src_id|5660331e-638769d4-7b040a49-2c629da9_0 is DEAD
2025-10-10T14:31:07.697162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5660331e-638769d4-7b040a49-2c629da9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:07.697174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5660331e-638769d4-7b040a49-2c629da9_0] Write session will restart in 0.009018s
2025-10-10T14:31:07.697199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5660331e-638769d4-7b040a49-2c629da9_0] Write session: Do CDS request
2025-10-10T14:31:07.697205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5660331e-638769d4-7b040a49-2c629da9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:07.704410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:07.704835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:07.704992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.705001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:07.705010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:07.705048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:07.705078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600573772056253:2591]
2025-10-10T14:31:07.705466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:07.705695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:07.705736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:07.706050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:07.706122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.706129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.706130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.706131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.706132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.706133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.706134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.706135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.706136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.706137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.706138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.706140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.706141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.706146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.706160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.706163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.706167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.706171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.706174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.706178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.706182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.706185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.706189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.706193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.706203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.706209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.706216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.706230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.706242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.706253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.706258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.706263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.706268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.706278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.706287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.706291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.706293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.706296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.706299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.706302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.706305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.706307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.706310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.706315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.706318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.706321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.706323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.706326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.706329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.706332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.706334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.706337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.706373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:07.707844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5660331e-638769d4-7b040a49-2c629da9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.707934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:07.707947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 43
2025-10-10T14:31:07.708055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.708081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 43 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:07.708085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=43 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:07.708091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:07.708416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 43 sessionId:  describe result for acl check
2025-10-10T14:31:07.708442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:07.708443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:07.708444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:07.708449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600574554265049:2735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:07.708550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:07.708858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600574554265049:2735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:07.708858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:07.708874Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:07.708876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.708880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.708885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 42 [2:7559600573772056253:2591]
2025-10-10T14:31:07.708897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:07.708916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:07.708923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.708926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.708928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.708943Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:07.708955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.708966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:07.709019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.709027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.709029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.709031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:07.709091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:07.709099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.709111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.709123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.709144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:07.709135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 42
2025-10-10T14:31:07.709170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554264987:2438], now have 1 active actors on pipe
2025-10-10T14:31:07.709182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600573772056248:2591]
2025-10-10T14:31:07.709184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600573772056248:2591]
2025-10-10T14:31:07.709186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600573772056248:2591]
2025-10-10T14:31:07.709199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:07.709212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:07.709220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:07.709222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:07.709224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:07.709237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:07.709242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:07.709262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600573772056248:2591]
2025-10-10T14:31:07.709274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:07.709279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:07.711090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600574554265049:2735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:07.717026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600574554265049:2735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:07.717039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600574554265049:2735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:07.717042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600574554265049:2735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:07.717051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 43 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:07.717300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554265083:2735], now have 1 active actors on pipe
2025-10-10T14:31:07.717366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 42
2025-10-10T14:31:07.717425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.717439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.717476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:07.717493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.717504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.717510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.717524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.717546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:07.717572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.717735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.717744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.717760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.717828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 43 partition: 0 MaxSeqNo: 40 sessionId: src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0
2025-10-10T14:31:07.718195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5660331e-638769d4-7b040a49-2c629da9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:07.720234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:07.720248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.720255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600573772056248:2591]
2025-10-10T14:31:07.720291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:07.720302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:07.720451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:07.720579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.720711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.720783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0] Write session: try to update token
2025-10-10T14:31:07.720797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:07.720833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.721009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:07.721041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:07.735153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId: src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:07.737703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:07.737831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:07.737850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.737852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:07.737853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:07.737862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600573772056248:2591]
2025-10-10T14:31:07.737865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600573772056248:2591]
2025-10-10T14:31:07.737868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600573772056248:2591]
2025-10-10T14:31:07.737902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:07.737912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.737914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:07.737918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:07.737922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.737942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:07.737965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.737972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:07.738109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:07.796673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600574554265086:2497]
2025-10-10T14:31:07.796968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 42, pipe: [1:7559600574554265086:2497]
2025-10-10T14:31:07.842539Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:07.842845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554265086:2497], now have 1 active actors on pipe
2025-10-10T14:31:07.843024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:07.843064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:07.843102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600574554265086:2497]
2025-10-10T14:31:07.843113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:07.843194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 43 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0
2025-10-10T14:31:07.843419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 43 sessionId: src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0 is DEAD
2025-10-10T14:31:07.843610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:07.843624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0] Write session will restart in 0.005157s
2025-10-10T14:31:07.843649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0] Write session: Do CDS request
2025-10-10T14:31:07.843655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:07.849846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.849955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:07.849968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 44
2025-10-10T14:31:07.850102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:07.850137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 44 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:07.850148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=44 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:07.850152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:07.850597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 44 sessionId:  describe result for acl check
2025-10-10T14:31:07.850636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:07.850642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:07.850643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:07.850650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600574554265145:2739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:07.851071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:07.851200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600574554265145:2739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:07.851457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:07.851594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:07.851602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:07.851611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:07.851661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:07.851691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600573772056350:2593]
2025-10-10T14:31:07.852067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:07.852350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:07.852396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:07.852654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:07.852699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.852704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.852704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.852705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.852706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.852706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.852707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.852708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.852708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.852709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.852709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.852710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.852711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.852715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.852731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.852734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.852736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.852738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.852741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.852743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.852745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.852748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.852750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.852753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.852755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.852757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.852762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.852770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:07.852777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.852782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:07.852787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.852792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:07.852794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.852798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:07.852800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.852803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:07.852806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.852809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:07.852812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.852816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:07.852818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.852822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:07.852825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.852828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:07.852830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.852833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:07.852836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.852841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.852844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.852847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.852849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.852852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.852875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:07.853473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600574554265145:2739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:07.855020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:07.855335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:07.855356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:07.855359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:07.855363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:07.855369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 43 [2:7559600573772056350:2593]
2025-10-10T14:31:07.855384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:07.855407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:07.855410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.855414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.855416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.855433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:07.855444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:07.855453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:07.855503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.855509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.855511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.855514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:07.855590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:07.855599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.855611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:07.855623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:07.855641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:07.855627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600574554265145:2739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:07.855640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600574554265145:2739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:07.855644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600574554265145:2739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:07.855652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 44 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:07.855667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554265088:2438], now have 1 active actors on pipe
2025-10-10T14:31:07.855679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600573772056345:2593]
2025-10-10T14:31:07.855681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600573772056345:2593]
2025-10-10T14:31:07.855683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600573772056345:2593]
2025-10-10T14:31:07.855681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 43
2025-10-10T14:31:07.855698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:07.855716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:07.855717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:07.855721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:07.855722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:07.855737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:07.855744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:07.855778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600573772056345:2593]
2025-10-10T14:31:07.855787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:07.855791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:07.855860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554265181:2739], now have 1 active actors on pipe
2025-10-10T14:31:07.855919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 43
2025-10-10T14:31:07.855974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.855986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.856011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:07.856021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:07.856035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:07.856040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:07.856051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:07.856065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:07.856087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.856251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.856257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.856269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:07.856341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 44 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0
2025-10-10T14:31:07.856666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45bdd283-d2cfe9a6-7be9abba-742a12d9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:07.859260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0] Write session: try to update token
2025-10-10T14:31:07.859279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:07.866786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:07.866809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.866822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600573772056345:2593]
2025-10-10T14:31:07.866867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:07.866895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:07.867194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:07.867398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.867599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.867746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:07.868107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:07.868172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:07.873616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId: src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:07.876163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:07.876388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.876411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.876455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:07.876536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:07.884539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:07.884562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:07.884566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:07.884568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:07.884579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600573772056345:2593]
2025-10-10T14:31:07.884583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600573772056345:2593]
2025-10-10T14:31:07.884587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600573772056345:2593]
2025-10-10T14:31:07.884626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:07.884638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:07.884645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:07.884663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:07.884682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:07.884688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:07.884782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:07.943061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600574554265188:2497]
2025-10-10T14:31:07.943332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 43, pipe: [1:7559600574554265188:2497]
2025-10-10T14:31:07.991179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:07.997919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:07.997946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:07.998124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:07.998188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:07.998260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:07.998323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:07.998372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:07.998381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:07.998452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:07.998512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:07.998582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:07.998645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:07.998691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:07.998697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:07.998755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:07.998811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:07.998867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:07.998922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:07.998964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:07.998970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:07.999030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:07.999085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:07.999141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:07.999212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:07.999259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:07.999267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:07.999336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:07.999398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:07.999471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:07.999543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:07.999590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:07.999598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:07.999666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:07.999722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:07.999784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:07.999852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:07.999906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:07.999912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:07.999975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.000034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.000097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.000159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.000200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.000206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.000272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.000332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.000398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.000466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.000510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.000517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.000585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.000643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.000704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.000763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.000807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.000814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.000877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.000938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.001002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.001062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.001104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.001110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.001157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600574554265188:2497], now have 1 active actors on pipe
2025-10-10T14:31:08.001362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:08.001375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:08.001391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:08.001408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 44 reason: error at write: Disconnected sessionId: src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0
2025-10-10T14:31:08.001452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600574554265188:2497]
2025-10-10T14:31:08.001620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 44 sessionId: src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0 is DEAD
2025-10-10T14:31:08.001775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:08.001786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0] Write session will restart in 0.008616s
2025-10-10T14:31:08.001811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0] Write session: Do CDS request
2025-10-10T14:31:08.001815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:08.001948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:08.009178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.009713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.009888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.009898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:08.009910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.009961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.010011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600578067023743:2595]
2025-10-10T14:31:08.010618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:08.010890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:08.010934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:08.011234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:08.011289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.011296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.011298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.011299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.011300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.011301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.011302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.011303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.011305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.011306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.011307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.011308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.011309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.011314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.011328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.011333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.011337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.011341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.011345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.011349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.011353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.011357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.011361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.011365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.011369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.011373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.011381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.011389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.011396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.011402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.011406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.011413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.011417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.011422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.011426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.011430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.011435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.011440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.011445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.011450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.011455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.011460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.011466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.011471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.011480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.011485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.011493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.011499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.011507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.011512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.011520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.011525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.011569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:08.011905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.011940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.011955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 45
2025-10-10T14:31:08.012117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.012148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 45 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:08.012156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=45 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.012161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.012675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 45 sessionId:  describe result for acl check
2025-10-10T14:31:08.012707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.012709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.012712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.012718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600578849232550:2743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.013174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600578849232550:2743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.013767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:08.014098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:08.014109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:08.014111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.014115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.014121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 44 [2:7559600578067023743:2595]
2025-10-10T14:31:08.014132Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:08.014152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:08.014156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.014159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.014162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.014180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:08.014191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.014199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:08.014250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.014259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.014261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.014264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:08.014332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:08.014339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.014352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.014364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.014387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:08.014412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232486:2438], now have 1 active actors on pipe
2025-10-10T14:31:08.014423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600578067023738:2595]
2025-10-10T14:31:08.014406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 44
2025-10-10T14:31:08.014430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600578067023738:2595]
2025-10-10T14:31:08.014432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600578067023738:2595]
2025-10-10T14:31:08.014446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:08.014462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:08.014465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:08.014472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:08.014474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:08.014480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:08.014483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:08.014512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600578067023738:2595]
2025-10-10T14:31:08.014523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:08.014532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:08.015076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600578849232550:2743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.020462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600578849232550:2743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.020476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600578849232550:2743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:08.020480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600578849232550:2743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.020489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 45 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.020729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232596:2743], now have 1 active actors on pipe
2025-10-10T14:31:08.020776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 44
2025-10-10T14:31:08.020846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.020857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.020887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:08.020902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.020911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.020913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.020926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.020957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.020980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.021158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.021167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.021182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.021277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 45 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0
2025-10-10T14:31:08.021682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb5aabf-ce501c2-9ac19b03-9e0eb8e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.024176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0] Write session: try to update token
2025-10-10T14:31:08.024195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:08.032780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:08.032800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.032803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:08.032806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:08.032817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600578067023738:2595]
2025-10-10T14:31:08.032822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600578067023738:2595]
2025-10-10T14:31:08.032826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600578067023738:2595]
2025-10-10T14:31:08.032877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:08.032880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:08.032886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:08.032891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:08.032893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.032895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:08.033029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:08.039546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId: src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:08.042143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:08.101824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600578849232599:2497]
2025-10-10T14:31:08.102078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 44, pipe: [1:7559600578849232599:2497]
2025-10-10T14:31:08.139811Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:08.140158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.140171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.140192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232599:2497], now have 1 active actors on pipe
2025-10-10T14:31:08.140352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:08.140405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:08.140416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:08.140443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600578849232599:2497]
2025-10-10T14:31:08.140464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:08.140491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 45 reason: error at write: Disconnected sessionId: src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0
2025-10-10T14:31:08.140647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 45 sessionId: src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0 is DEAD
2025-10-10T14:31:08.140822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:08.140834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0] Write session will restart in 0.007975s
2025-10-10T14:31:08.140859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0] Write session: Do CDS request
2025-10-10T14:31:08.140866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:08.148503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.148870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.149044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.149054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:08.149063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.149108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.149138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600578067023854:2598]
2025-10-10T14:31:08.149596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:08.149870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.149891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:08.149946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:08.149938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.149948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 46
2025-10-10T14:31:08.150139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.150162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 46 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:08.150169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=46 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.150172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.150227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:08.150271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.150276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.150276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.150277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.150278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.150279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.150279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.150280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.150281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.150281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.150282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.150282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.150283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.150287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.150295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.150297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.150300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.150302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.150304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.150306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.150309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.150311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.150313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.150315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.150318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.150320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.150325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.150330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.150335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.150339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.150341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.150344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.150347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.150350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.150352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.150356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.150358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.150361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.150364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.150367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.150369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.150372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.150375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.150378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.150381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.150385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.150387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.150390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.150393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.150396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.150399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.150402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.150425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:08.150633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 46 sessionId:  describe result for acl check
2025-10-10T14:31:08.150668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.150676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.150678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.150683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600578849232665:2748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.151190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600578849232665:2748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.152286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600578849232665:2748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.152556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:08.152882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:08.152890Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:08.152891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.152894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.152898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 45 [2:7559600578067023854:2598]
2025-10-10T14:31:08.152906Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:08.152918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:08.152925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.152927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.152928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.152941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:08.152947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.152954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:08.152994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.152999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.153000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.153002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:08.153054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:08.153061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.153071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.153082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.153100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:08.153120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232601:2438], now have 1 active actors on pipe
2025-10-10T14:31:08.153129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600578067023849:2598]
2025-10-10T14:31:08.153131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600578067023849:2598]
2025-10-10T14:31:08.153132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600578067023849:2598]
2025-10-10T14:31:08.153142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:08.153155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:08.153163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:08.153166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:08.153168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:08.153169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:08.153172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:08.153191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600578067023849:2598]
2025-10-10T14:31:08.153185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 45
2025-10-10T14:31:08.153196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:08.153220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:08.157938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600578849232665:2748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.157951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600578849232665:2748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:08.157958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600578849232665:2748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.157966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 46 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.158200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232700:2748], now have 1 active actors on pipe
2025-10-10T14:31:08.158246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 45
2025-10-10T14:31:08.158310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.158321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.158354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:08.158370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.158389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.158391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.158404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.158425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.158447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.158632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.158641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.158656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.158756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 46 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0
2025-10-10T14:31:08.159130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef288a5c-5dcd9b1e-1aba8877-3d7d4f20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.161671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0] Write session: try to update token
2025-10-10T14:31:08.161687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:08.163959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:08.163974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.163985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600578067023849:2598]
2025-10-10T14:31:08.164029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:08.164033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:08.164232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:08.164380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.164516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.164650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.164839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:08.164876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:08.176481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId: src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:08.179053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:08.179243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.179263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.179305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:08.179382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:08.181566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:08.181578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.181580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:08.181582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:08.181590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600578067023849:2598]
2025-10-10T14:31:08.181596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600578067023849:2598]
2025-10-10T14:31:08.181599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600578067023849:2598]
2025-10-10T14:31:08.181637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:08.181637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:08.181643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:08.181645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.181646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:08.181647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:08.181777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:08.240567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600578849232703:2497]
2025-10-10T14:31:08.240793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 45, pipe: [1:7559600578849232703:2497]
2025-10-10T14:31:08.286421Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:08.293451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.293468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.293607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.293662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.293723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.293794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.294206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.294214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.294277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.294329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.294384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.294442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.294481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.294487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.294544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.294596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.294650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.294706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.294744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.294751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.294808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.294864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.294918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.294972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.295010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.295015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.295072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.295127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.295181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.295233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.295271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.295277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.295334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.295385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.295440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.295516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.295575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.295581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.295636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.295685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.295745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.295800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.295838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.295844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.295902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.295954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.296006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.296058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.296096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.296102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.296156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.296206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.296257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.296311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.296350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.296355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.296409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.296459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.296511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.296566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.296605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.296610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.296639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232703:2497], now have 1 active actors on pipe
2025-10-10T14:31:08.296908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:08.296920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:08.296920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600578849232703:2497]
2025-10-10T14:31:08.296938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:08.296945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 46 reason: error at write: Disconnected sessionId: src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0
2025-10-10T14:31:08.296965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:08.297076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 46 sessionId: src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0 is DEAD
2025-10-10T14:31:08.297217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:08.297227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0] Write session will restart in 0.009647s
2025-10-10T14:31:08.297249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0] Write session: Do CDS request
2025-10-10T14:31:08.297255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:08.304735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.305173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.305351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.305361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:08.305371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.305423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.305459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600578067023954:2600]
2025-10-10T14:31:08.306059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:08.306284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:08.306322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:08.306620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:08.306670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.306679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.306680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.306681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.306682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.306683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.306684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.306685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.306686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.306687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.306688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.306689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.306691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.306695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.306707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.306711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.306715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.306719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.306723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.306727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.306731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.306734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.306738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.306742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.306746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.306750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.306757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.306765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.306770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.306776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.306780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.306787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.306795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.306800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.306809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.306818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.306822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.306831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.306840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.306849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.306857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.306863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.306871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.306876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.306884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.306890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.306898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.306907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.306911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.306917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.306925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.306933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.306976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:08.307727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.307811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.307823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 47
2025-10-10T14:31:08.307935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.307958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 47 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:08.307965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=47 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.307968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.308338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 47 sessionId:  describe result for acl check
2025-10-10T14:31:08.308366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.308372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.308373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.308379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600578849232771:2752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.308893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600578849232771:2752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.309083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:08.309400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:08.309413Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:08.309414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.309417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.309423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 46 [2:7559600578067023954:2600]
2025-10-10T14:31:08.309433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:08.309449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:08.309452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.309455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.309457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.309467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:08.309474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.309487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:08.309534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.309541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.309543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.309545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:08.309599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:08.309607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.309618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.309630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.309652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:08.309674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232704:2438], now have 1 active actors on pipe
2025-10-10T14:31:08.309683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 46
2025-10-10T14:31:08.309683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600578067023949:2600]
2025-10-10T14:31:08.309686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600578067023949:2600]
2025-10-10T14:31:08.309688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600578067023949:2600]
2025-10-10T14:31:08.309701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:08.309712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:08.309713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:08.309715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:08.309717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:08.309729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:08.309732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:08.309756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600578067023949:2600]
2025-10-10T14:31:08.309767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:08.309779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:08.310842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600578849232771:2752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.316592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600578849232771:2752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.316606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600578849232771:2752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:08.316609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600578849232771:2752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.316617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 47 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.316843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232805:2752], now have 1 active actors on pipe
2025-10-10T14:31:08.316873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 46
2025-10-10T14:31:08.316946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.316957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.316986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35209285-627b83a3-4eab16f-8059fab0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:08.316999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.317007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.317010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.317026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.317043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.317060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.317208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.317213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.317226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.317289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 47 partition: 0 MaxSeqNo: 40 sessionId: src_id|35209285-627b83a3-4eab16f-8059fab0_0
2025-10-10T14:31:08.317536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4b1d2f5-e2c43383-bf314420-ad12643b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35209285-627b83a3-4eab16f-8059fab0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.320041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35209285-627b83a3-4eab16f-8059fab0_0] Write session: try to update token
2025-10-10T14:31:08.320055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35209285-627b83a3-4eab16f-8059fab0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:08.320300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:08.320315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.320323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600578067023949:2600]
2025-10-10T14:31:08.320360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:08.320395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:08.320530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:08.320663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.320791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.320921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.321091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:08.321122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:08.334421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId: src_id|35209285-627b83a3-4eab16f-8059fab0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:08.337008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:08.337283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:08.337303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.337306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:08.337308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:08.337318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600578067023949:2600]
2025-10-10T14:31:08.337321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600578067023949:2600]
2025-10-10T14:31:08.337325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600578067023949:2600]
2025-10-10T14:31:08.337384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:08.337395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.337396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:08.337400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:08.337404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.337424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:08.337431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.337433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:08.337563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:08.397232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600578849232821:2497]
2025-10-10T14:31:08.397441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 46, pipe: [1:7559600578849232821:2497]
2025-10-10T14:31:08.444362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:08.444627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232821:2497], now have 1 active actors on pipe
2025-10-10T14:31:08.444839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:08.444866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:08.444881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:08.444908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600578849232821:2497]
2025-10-10T14:31:08.444926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:08.444939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 47 reason: error at write: Disconnected sessionId: src_id|35209285-627b83a3-4eab16f-8059fab0_0
2025-10-10T14:31:08.445148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 47 sessionId: src_id|35209285-627b83a3-4eab16f-8059fab0_0 is DEAD
2025-10-10T14:31:08.445298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35209285-627b83a3-4eab16f-8059fab0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:08.445309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35209285-627b83a3-4eab16f-8059fab0_0] Write session will restart in 0.009907s
2025-10-10T14:31:08.445344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35209285-627b83a3-4eab16f-8059fab0_0] Write session: Do CDS request
2025-10-10T14:31:08.445350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35209285-627b83a3-4eab16f-8059fab0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:08.452396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.452851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.453024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.453035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:08.453046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.453092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.453128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600578067024094:2615]
2025-10-10T14:31:08.453742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:08.454019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:08.454057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:08.454359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:08.454406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.454412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.454413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.454414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.454416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.454417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.454418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.454419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.454420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.454421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.454422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.454423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.454424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.454429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.454441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.454445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.454449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.454453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.454457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.454461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.454465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.454469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.454473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.454477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.454481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.454485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.454491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.454499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.454506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.454511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.454515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.454520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.454525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.454528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.454532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.454537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.454544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.454549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.454554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.454561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.454564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.454567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.454570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.454573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.454575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.454578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.454581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.454584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.454586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.454589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.454591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.454594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.454616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:08.456693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:08.456808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35209285-627b83a3-4eab16f-8059fab0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.456869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.456883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 48
2025-10-10T14:31:08.456987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.457017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 48 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:08.457010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:08.457021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=48 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.457025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.457019Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:08.457021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.457024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.457029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 47 [2:7559600578067024094:2615]
2025-10-10T14:31:08.457039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:08.457057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:08.457060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.457063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.457065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.457078Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:08.457086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.457094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:08.457147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.457153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.457156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.457158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:08.457214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:08.457222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.457232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.457243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.457260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:08.457285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232833:2438], now have 1 active actors on pipe
2025-10-10T14:31:08.457297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600578067024089:2615]
2025-10-10T14:31:08.457299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600578067024089:2615]
2025-10-10T14:31:08.457301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600578067024089:2615]
2025-10-10T14:31:08.457313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:08.457312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 47
2025-10-10T14:31:08.457344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:08.457344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:08.457347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:08.457348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:08.457365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:08.457371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:08.457397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600578067024089:2615]
2025-10-10T14:31:08.457407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:08.457420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 48 sessionId:  describe result for acl check
2025-10-10T14:31:08.457424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:08.457456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.457462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.457464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.457470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600578849232901:2765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.457990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600578849232901:2765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.460048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600578849232901:2765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.465948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600578849232901:2765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.465962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600578849232901:2765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:08.465966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600578849232901:2765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.465973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 48 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.466209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232934:2765], now have 1 active actors on pipe
2025-10-10T14:31:08.466266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 47
2025-10-10T14:31:08.466346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.466357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.466389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9efbcde9-458f2f83-a8101be6-594a5194_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:08.466406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.466412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.466415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.466430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.466451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.466474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.466625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.466633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.466647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.466732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 48 partition: 0 MaxSeqNo: 40 sessionId: src_id|9efbcde9-458f2f83-a8101be6-594a5194_0
2025-10-10T14:31:08.467086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35209285-627b83a3-4eab16f-8059fab0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9efbcde9-458f2f83-a8101be6-594a5194_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.467890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:08.467900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.467909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600578067024089:2615]
2025-10-10T14:31:08.467948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:08.467954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:08.468147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:08.468280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.468412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.468546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.468722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:08.468758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:08.469597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efbcde9-458f2f83-a8101be6-594a5194_0] Write session: try to update token
2025-10-10T14:31:08.469610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efbcde9-458f2f83-a8101be6-594a5194_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:08.483596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId: src_id|9efbcde9-458f2f83-a8101be6-594a5194_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:08.484792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:08.484808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.484811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:08.484813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:08.484827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600578067024089:2615]
2025-10-10T14:31:08.484831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600578067024089:2615]
2025-10-10T14:31:08.484834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600578067024089:2615]
2025-10-10T14:31:08.484881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:08.484888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.484890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:08.484889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:08.484895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:08.484899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:08.485026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:08.486042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:08.545224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600578849232945:2497]
2025-10-10T14:31:08.545531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 47, pipe: [1:7559600578849232945:2497]
2025-10-10T14:31:08.589128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:08.589451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.589467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.589490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232945:2497], now have 1 active actors on pipe
2025-10-10T14:31:08.589666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:08.589718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600578849232945:2497]
2025-10-10T14:31:08.589734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:08.589747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:08.590045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 48 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9efbcde9-458f2f83-a8101be6-594a5194_0
2025-10-10T14:31:08.590254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 48 sessionId: src_id|9efbcde9-458f2f83-a8101be6-594a5194_0 is DEAD
2025-10-10T14:31:08.590419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efbcde9-458f2f83-a8101be6-594a5194_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:08.590432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efbcde9-458f2f83-a8101be6-594a5194_0] Write session will restart in 0.006060s
2025-10-10T14:31:08.590462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efbcde9-458f2f83-a8101be6-594a5194_0] Write session: Do CDS request
2025-10-10T14:31:08.590468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efbcde9-458f2f83-a8101be6-594a5194_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:08.597407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.597839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efbcde9-458f2f83-a8101be6-594a5194_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.597874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.597889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 49
2025-10-10T14:31:08.597938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.598066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.598099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 49 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:08.598110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=49 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.598113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.598126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.598137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:08.598148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.598197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.598236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600578067024201:2619]
2025-10-10T14:31:08.598565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 49 sessionId:  describe result for acl check
2025-10-10T14:31:08.598599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.598606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.598608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.598614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600578849233013:2771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.598773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:08.599095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:08.599140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:08.599146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600578849233013:2771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.599452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:08.599504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.599510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.599511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.599513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.599514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.599515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.599516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.599517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.599518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.599519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.599520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.599522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.599523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.599529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.599542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.599546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.599551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.599555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.599559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.599563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.599567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.599571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.599575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.599579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.599583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.599587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.599594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.599602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.599609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.599615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.599620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.599625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.599629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.599635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.599639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.599644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.599648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.599654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.599660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.599669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.599673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.599678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.599687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.599694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.599699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.599704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.599709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.599714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.599718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.599727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.599732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.599737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.599778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:08.600784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600578849233013:2771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.601982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:08.602307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:08.602319Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:08.602321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.602325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.602330Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 48 [2:7559600578067024201:2619]
2025-10-10T14:31:08.602338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:08.602350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:08.602352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.602354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.602355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.602366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:08.602371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.602376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:08.602418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.602426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.602428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.602431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:08.602495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:08.602502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.602509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.602516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.602525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:08.602540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849232949:2438], now have 1 active actors on pipe
2025-10-10T14:31:08.602547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600578067024196:2619]
2025-10-10T14:31:08.602551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600578067024196:2619]
2025-10-10T14:31:08.602553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600578067024196:2619]
2025-10-10T14:31:08.602562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:08.602574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:08.602588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:08.602591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:08.602593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:08.602593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:08.602596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:08.602603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 48
2025-10-10T14:31:08.602618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600578067024196:2619]
2025-10-10T14:31:08.602629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:08.602631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:08.603150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600578849233013:2771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.603170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600578849233013:2771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:08.603174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600578849233013:2771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.603182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 49 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.603380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849233049:2771], now have 1 active actors on pipe
2025-10-10T14:31:08.603412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 48
2025-10-10T14:31:08.603489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.603499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.603527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|671648f3-97c61d16-443967ee-ed165a24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:08.603540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.603544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.603546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.603559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.603570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.603587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.603715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.603723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.603738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.603825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 49 partition: 0 MaxSeqNo: 40 sessionId: src_id|671648f3-97c61d16-443967ee-ed165a24_0
2025-10-10T14:31:08.604085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efbcde9-458f2f83-a8101be6-594a5194_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|671648f3-97c61d16-443967ee-ed165a24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.606447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671648f3-97c61d16-443967ee-ed165a24_0] Write session: try to update token
2025-10-10T14:31:08.606461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671648f3-97c61d16-443967ee-ed165a24_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:08.613258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:08.613274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.613284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600578067024196:2619]
2025-10-10T14:31:08.613321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:08.613348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:08.613497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:08.613628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.613763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.613895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.614098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:08.614137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:08.620545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId: src_id|671648f3-97c61d16-443967ee-ed165a24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:08.622878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:08.623076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.623098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.623136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:08.623210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:08.630138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:08.630152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.630155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:08.630157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:08.630167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600578067024196:2619]
2025-10-10T14:31:08.630170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600578067024196:2619]
2025-10-10T14:31:08.630174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600578067024196:2619]
2025-10-10T14:31:08.630220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:08.630227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.630226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:08.630230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:08.630233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:08.630237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:08.630350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:08.690119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600578849233055:2497]
2025-10-10T14:31:08.690350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 48, pipe: [1:7559600578849233055:2497]
2025-10-10T14:31:08.735241Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:08.741672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.741692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.741842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.741898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.741952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.742018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.742059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.742066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.742127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.742181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.742233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.742291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.742329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.742334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.742389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.742443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.742502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.742558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.742595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.742600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.742665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.742726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.742778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.742830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.742869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.742875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.742932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.742984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.743037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.743094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.743130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.743135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.743190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.743241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.743294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.743347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.743384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.743389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.743449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.743512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.743569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.743625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.743663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.743668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.743722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.743773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.743828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.743884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.743924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.743930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.743985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.744037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.744089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.744142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.744178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.744183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.744235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:08.744293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:08.744364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:08.744427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:08.744464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:08.744470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:08.744503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849233055:2497], now have 1 active actors on pipe
2025-10-10T14:31:08.744772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:08.744778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600578849233055:2497]
2025-10-10T14:31:08.744813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:08.744815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:08.744846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 49 reason: error at write: Disconnected sessionId: src_id|671648f3-97c61d16-443967ee-ed165a24_0
2025-10-10T14:31:08.745073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:08.745073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 49 sessionId: src_id|671648f3-97c61d16-443967ee-ed165a24_0 is DEAD
2025-10-10T14:31:08.745252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671648f3-97c61d16-443967ee-ed165a24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:08.745264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671648f3-97c61d16-443967ee-ed165a24_0] Write session will restart in 0.007073s
2025-10-10T14:31:08.745296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671648f3-97c61d16-443967ee-ed165a24_0] Write session: Do CDS request
2025-10-10T14:31:08.745302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671648f3-97c61d16-443967ee-ed165a24_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:08.751985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.752359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.752545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.752554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:08.752563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.752607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.752638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600578067024304:2621]
2025-10-10T14:31:08.753028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:08.753252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:08.753283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:08.753526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:08.753582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.753588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.753590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.753591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.753592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.753593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.753594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.753595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.753596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.753597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.753598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.753599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.753601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.753607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.753620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.753625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.753629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.753633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.753637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.753641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.753645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.753649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.753653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.753657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.753661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.753667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.753674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.753681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.753686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.753693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.753696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.753699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.753701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.753705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.753709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.753712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.753714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.753717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.753720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.753723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.753725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.753728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.753731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.753734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.753736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.753739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.753742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.753744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.753747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.753750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.753753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.753756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.753779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:08.753827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671648f3-97c61d16-443967ee-ed165a24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.753876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.753890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 50
2025-10-10T14:31:08.754024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.754054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 50 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:08.754064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=50 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.754073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.754451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 50 sessionId:  describe result for acl check
2025-10-10T14:31:08.754488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.754496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.754498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.754504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600578849233125:2775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.755057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600578849233125:2775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.755943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:08.756245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:08.756256Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:08.756258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.756261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.756266Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 49 [2:7559600578067024304:2621]
2025-10-10T14:31:08.756277Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:08.756292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:08.756300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.756303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.756306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.756321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:08.756334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.756341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:08.756388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.756395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.756397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.756400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:08.756457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:08.756465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.756475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.756488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.756510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:08.756535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600578067024299:2621]
2025-10-10T14:31:08.756542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600578067024299:2621]
2025-10-10T14:31:08.756544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600578067024299:2621]
2025-10-10T14:31:08.756556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:08.756565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:08.756568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:08.756572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:08.756575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:08.756584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:08.756587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:08.756608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600578067024299:2621]
2025-10-10T14:31:08.756618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:08.756638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:08.756797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849233056:2438], now have 1 active actors on pipe
2025-10-10T14:31:08.756828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 49
2025-10-10T14:31:08.757233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600578849233125:2775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.762978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600578849233125:2775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.762994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600578849233125:2775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:08.762999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600578849233125:2775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.763007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 50 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.763213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849233159:2775], now have 1 active actors on pipe
2025-10-10T14:31:08.763273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 49
2025-10-10T14:31:08.763369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.763382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.763414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:08.763429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.763439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.763445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.763459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.763480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.763501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.763705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.763714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.763729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.763841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 50 partition: 0 MaxSeqNo: 40 sessionId: src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0
2025-10-10T14:31:08.764176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671648f3-97c61d16-443967ee-ed165a24_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.766713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0] Write session: try to update token
2025-10-10T14:31:08.766728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:08.767298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:08.767309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.767318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600578067024299:2621]
2025-10-10T14:31:08.767356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:08.767361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:08.767516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:08.767639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.767772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.767911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:08.768089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:08.768126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:08.781066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId: src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:08.783560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:08.784716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.784741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.784766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:08.784769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.784772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:08.784775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:08.784785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600578067024299:2621]
2025-10-10T14:31:08.784789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600578067024299:2621]
2025-10-10T14:31:08.784793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600578067024299:2621]
2025-10-10T14:31:08.784842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:08.784848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:08.784856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.784856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:08.784858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:08.784863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:08.784978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:08.844722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600578849233163:2497]
2025-10-10T14:31:08.844994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 49, pipe: [1:7559600578849233163:2497]
2025-10-10T14:31:08.891057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:08.891363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:08.891402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849233163:2497], now have 1 active actors on pipe
2025-10-10T14:31:08.891523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:08.891560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600578849233163:2497]
2025-10-10T14:31:08.891580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:08.891620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:08.891633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:08.891714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 50 reason: error at write: Disconnected sessionId: src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0
2025-10-10T14:31:08.891910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 50 sessionId: src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0 is DEAD
2025-10-10T14:31:08.892095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:08.892106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0] Write session will restart in 0.005422s
2025-10-10T14:31:08.892124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0] Write session: Do CDS request
2025-10-10T14:31:08.892130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:08.898817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.898921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:08.898929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:08.898936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 51
2025-10-10T14:31:08.899064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:08.899097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 51 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:08.899107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=51 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:08.899111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:08.899356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:08.899497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:08.899506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:08.899515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:08.899552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:08.899539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 51 sessionId:  describe result for acl check
2025-10-10T14:31:08.899575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:08.899577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:08.899579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:08.899585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600578849233230:2779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:08.899587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600578067024409:2623]
2025-10-10T14:31:08.899998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:08.900123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600578849233230:2779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:08.900308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:08.900351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:08.900662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:08.900712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.900718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.900719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.900720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.900721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.900722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.900723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.900724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.900725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.900727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.900728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.900729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.900730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.900736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.900748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.900752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.900756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.900760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.900764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.900770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.900774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.900777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.900783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.900788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.900791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.900795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.900803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.900813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:08.900824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.900832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:08.900836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.900843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:08.900847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.900856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:08.900861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.900870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:08.900874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.900880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:08.900885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.900894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:08.900900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.900905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:08.900910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.900919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:08.900923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.900929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:08.900933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.900938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.900944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.900949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.900954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.900958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.901001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:08.901782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600578849233230:2779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:08.903119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:08.903409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:08.903420Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:08.903421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:08.903424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:08.903428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 50 [2:7559600578067024409:2623]
2025-10-10T14:31:08.903435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:08.903448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:08.903451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.903453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.903454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.903463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:08.903475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:08.903483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:08.903529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.903534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.903535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.903537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:08.903595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:08.903603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.903615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:08.903627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:08.903644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:08.903669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849233164:2438], now have 1 active actors on pipe
2025-10-10T14:31:08.903681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600578067024404:2623]
2025-10-10T14:31:08.903683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600578067024404:2623]
2025-10-10T14:31:08.903685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600578067024404:2623]
2025-10-10T14:31:08.903697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:08.903711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:08.903716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:08.903719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:08.903721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:08.903705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 50
2025-10-10T14:31:08.903732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:08.903739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:08.903763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600578067024404:2623]
2025-10-10T14:31:08.903771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:08.903784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:08.904148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600578849233230:2779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:08.904164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600578849233230:2779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:08.904167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600578849233230:2779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:08.904172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 51 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:08.904338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849233266:2779], now have 1 active actors on pipe
2025-10-10T14:31:08.904385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 50
2025-10-10T14:31:08.904446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.904456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.904485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:08.904496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:08.904500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:08.904506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:08.904517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:08.904528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:08.904545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.904682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:08.904689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:08.904703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:08.904767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 51 partition: 0 MaxSeqNo: 40 sessionId: src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0
2025-10-10T14:31:08.905056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fa0d5e-bd0c9c8b-8a3e1305-a76c0ee7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:08.907546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0] Write session: try to update token
2025-10-10T14:31:08.907560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:08.921446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:08.921460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:08.921464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:08.921465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:08.921475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600578067024404:2623]
2025-10-10T14:31:08.921481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600578067024404:2623]
2025-10-10T14:31:08.921486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600578067024404:2623]
2025-10-10T14:31:08.921520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:08.921525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:08.921528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:08.921528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:08.921535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:08.921538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:08.921544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId: src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:08.921700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:08.923968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:08.991699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600578849233272:2497]
2025-10-10T14:31:08.991956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 50, pipe: [1:7559600578849233272:2497]
2025-10-10T14:31:09.025731Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:09.025913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.025923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.025959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600578849233272:2497], now have 1 active actors on pipe
2025-10-10T14:31:09.026150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:09.026137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:09.026152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:09.026157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600578849233272:2497]
2025-10-10T14:31:09.026175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:09.026209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 51 reason: error at write: Disconnected sessionId: src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0
2025-10-10T14:31:09.026450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 51 sessionId: src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0 is DEAD
2025-10-10T14:31:09.026561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:09.026573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0] Write session will restart in 0.008282s
2025-10-10T14:31:09.026596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0] Write session: Do CDS request
2025-10-10T14:31:09.026603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:09.033402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:09.033857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:09.034032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:09.034042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:09.034053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:09.034104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:09.034143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600582361991823:2626]
2025-10-10T14:31:09.034746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:09.034995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:09.035034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:09.035337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:09.035387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.035393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.035394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.035395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.035396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.035397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.035398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.035400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.035401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.035402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.035403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.035404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.035405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.035411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.035424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.035428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.035432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.035436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.035440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.035444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.035448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.035452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.035456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.035460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.035463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.035467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.035474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.035487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.035498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.035508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.035514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.035523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.035527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.035537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.035543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.035550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.035557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.035564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.035574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.035580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.035584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.035593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.035600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.035609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.035613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.035622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.035631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.035638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.035642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.035651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.035658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.035666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.035703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:09.035857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.035945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.035959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 52
2025-10-10T14:31:09.036077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.036105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 52 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:09.036117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=52 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.036121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.036501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 52 sessionId:  describe result for acl check
2025-10-10T14:31:09.036531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.036538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.036539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.036544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600583144200652:2784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.037052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600583144200652:2784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.037881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:09.038263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:09.038274Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:09.038276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:09.038279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:09.038284Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 51 [2:7559600582361991823:2626]
2025-10-10T14:31:09.038295Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:09.038316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:09.038323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.038327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.038329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.038346Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:09.038357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:09.038368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:09.038419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.038426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.038428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.038431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:09.038492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:09.038499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.038510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.038526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.038545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:09.038570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200581:2438], now have 1 active actors on pipe
2025-10-10T14:31:09.038560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 51
2025-10-10T14:31:09.038582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600582361991818:2626]
2025-10-10T14:31:09.038588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600582361991818:2626]
2025-10-10T14:31:09.038589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600582361991818:2626]
2025-10-10T14:31:09.038598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:09.038606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:09.038614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:09.038616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:09.038616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:09.038631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:09.038638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:09.038663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600582361991818:2626]
2025-10-10T14:31:09.038671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:09.038678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:09.039255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600583144200652:2784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.045143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600583144200652:2784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.045157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600583144200652:2784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:09.045161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600583144200652:2784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.045171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 52 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.045426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200686:2784], now have 1 active actors on pipe
2025-10-10T14:31:09.045479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 51
2025-10-10T14:31:09.045537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.045551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.045588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:09.045607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.045617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.045624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.045639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.045663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.045682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.045858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.045878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.045899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.045994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 52 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0
2025-10-10T14:31:09.046376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c630ff5-22491df1-a3ab8c53-9f5ebb98_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.049031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0] Write session: try to update token
2025-10-10T14:31:09.049048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:09.053418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:09.053430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.053439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600582361991818:2626]
2025-10-10T14:31:09.053481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:09.053488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:09.053641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:09.053779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.053904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.054069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.054256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:09.054294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:09.063603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId: src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:09.066078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:09.066514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.066536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.066558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:09.066562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.066565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:09.066567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:09.066575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600582361991818:2626]
2025-10-10T14:31:09.066579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600582361991818:2626]
2025-10-10T14:31:09.066583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600582361991818:2626]
2025-10-10T14:31:09.066614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:09.066619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:09.066622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:09.066636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:09.066642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.066644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:09.066769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:09.126353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600583144200689:2497]
2025-10-10T14:31:09.126597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 51, pipe: [1:7559600583144200689:2497]
2025-10-10T14:31:09.181955Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:09.182233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:09.182262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200689:2497], now have 1 active actors on pipe
2025-10-10T14:31:09.182389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:09.182401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:09.182451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600583144200689:2497]
2025-10-10T14:31:09.182488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:09.182492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:09.182566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 52 reason: error at write: Disconnected sessionId: src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0
2025-10-10T14:31:09.182744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 52 sessionId: src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0 is DEAD
2025-10-10T14:31:09.182905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:09.182917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0] Write session will restart in 0.009206s
2025-10-10T14:31:09.182940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0] Write session: Do CDS request
2025-10-10T14:31:09.182950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:09.190367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:09.190802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:09.190976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:09.190985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:09.190995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:09.191040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:09.191084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600582361991930:2628]
2025-10-10T14:31:09.191496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:09.191750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:09.191783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:09.192036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:09.192080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.192086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.192087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.192088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.192089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.192090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.192091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.192093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.192094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.192095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.192096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.192097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.192098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.192103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.192116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.192120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.192122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.192132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.192134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.192137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.192139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.192141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.192144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.192146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.192148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.192150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.192156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.192164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.192171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.192177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.192181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.192186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.192191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.192196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.192201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.192207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.192214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.192217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.192220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.192224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.192226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.192229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.192232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.192235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.192237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.192240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.192243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.192246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.192249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.192252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.192254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.192257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.192279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:09.193848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.193930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.193945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 53
2025-10-10T14:31:09.194160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.194207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 53 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:09.194218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=53 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.194223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.194517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:09.194628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 53 sessionId:  describe result for acl check
2025-10-10T14:31:09.194660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.194668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.194671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.194677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600583144200764:2788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.194819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:09.194830Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:09.194833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:09.194836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:09.194842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 52 [2:7559600582361991930:2628]
2025-10-10T14:31:09.194853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:09.194873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:09.194881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.194884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.194887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.194907Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:09.194919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:09.194930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:09.194992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.194999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.195001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.195004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:09.195065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:09.195076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.195088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.195100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.195118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:09.195145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200691:2438], now have 1 active actors on pipe
2025-10-10T14:31:09.195157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600582361991925:2628]
2025-10-10T14:31:09.195159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600582361991925:2628]
2025-10-10T14:31:09.195161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600582361991925:2628]
2025-10-10T14:31:09.195174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:09.195171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 52
2025-10-10T14:31:09.195196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:09.195205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:09.195210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:09.195209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600583144200764:2788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.195213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:09.195216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:09.195220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:09.195247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600582361991925:2628]
2025-10-10T14:31:09.195259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:09.195274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:09.197252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600583144200764:2788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.202919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600583144200764:2788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.202932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600583144200764:2788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:09.202935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600583144200764:2788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.202943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 53 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.203148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200797:2788], now have 1 active actors on pipe
2025-10-10T14:31:09.203221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 52
2025-10-10T14:31:09.203289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.203304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.203335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:09.203349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.203359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.203361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.203375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.203395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.203412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.203555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.203562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.203575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.203666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 53 partition: 0 MaxSeqNo: 40 sessionId: src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0
2025-10-10T14:31:09.203954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc4aa9-ec1153df-eeb7591f-b6ad35c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.206524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0] Write session: try to update token
2025-10-10T14:31:09.206537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:09.213285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:09.213298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.213300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:09.213301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:09.213308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600582361991925:2628]
2025-10-10T14:31:09.213312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600582361991925:2628]
2025-10-10T14:31:09.213315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600582361991925:2628]
2025-10-10T14:31:09.213369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:09.213375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:09.213375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:09.213383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.213383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:09.213385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:09.213508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:09.220565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId: src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:09.223310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:09.282525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600583144200800:2497]
2025-10-10T14:31:09.282803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 52, pipe: [1:7559600583144200800:2497]
2025-10-10T14:31:09.318344Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:09.318677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.318688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.318708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200800:2497], now have 1 active actors on pipe
2025-10-10T14:31:09.318883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:09.318951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600583144200800:2497]
2025-10-10T14:31:09.318973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:09.318974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:09.319049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 53 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0
2025-10-10T14:31:09.319232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 53 sessionId: src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0 is DEAD
2025-10-10T14:31:09.319390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:09.319401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0] Write session will restart in 0.008240s
2025-10-10T14:31:09.319430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0] Write session: Do CDS request
2025-10-10T14:31:09.319435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:09.326893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:09.327313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:09.327467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:09.327479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:09.327489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:09.327532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:09.327567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600582361992037:2630]
2025-10-10T14:31:09.328081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:09.328353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:09.328395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:09.328674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:09.328731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.328737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.328738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.328739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.328741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.328742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.328743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.328744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.328745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.328746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.328747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.328748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.328749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.328754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.328766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.328803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.328770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.328774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.328778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.328782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.328786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.328790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.328794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.328798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.328802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.328805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.328808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.328816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.328824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.328830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.328835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.328839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.328844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.328848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.328854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.328860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.328865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.328870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.328875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.328880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.328885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.328889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.328899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.328904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.328911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.328876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.328915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.328898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 54
2025-10-10T14:31:09.328921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.328925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.328930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.328934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.328939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.328945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.328950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.328988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:09.329025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.329051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 54 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:09.329058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=54 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.329061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.329364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 54 sessionId:  describe result for acl check
2025-10-10T14:31:09.329388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.329393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.329395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.329398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600583144200875:2792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.329808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600583144200875:2792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.331029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:09.331307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:09.331318Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:09.331320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:09.331324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:09.331329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 53 [2:7559600582361992037:2630]
2025-10-10T14:31:09.331339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:09.331354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:09.331360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.331362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.331363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.331374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:09.331380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:09.331385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:09.331423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.331428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.331429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.331431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:09.331474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:09.331480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.331486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.331492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.331502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:09.331520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200802:2438], now have 1 active actors on pipe
2025-10-10T14:31:09.331529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600582361992032:2630]
2025-10-10T14:31:09.331531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600582361992032:2630]
2025-10-10T14:31:09.331532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600582361992032:2630]
2025-10-10T14:31:09.331544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:09.331558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:09.331563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:09.331567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:09.331569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:09.331569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:09.331570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:09.331584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600582361992032:2630]
2025-10-10T14:31:09.331587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:09.331572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 53
2025-10-10T14:31:09.331596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:09.331843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600583144200875:2792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.338018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600583144200875:2792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.338033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600583144200875:2792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:09.338036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600583144200875:2792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.338044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 54 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.338275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200909:2792], now have 1 active actors on pipe
2025-10-10T14:31:09.338312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 53
2025-10-10T14:31:09.338365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.338376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.338406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:09.338423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.338428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.338431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.338445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.338462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.338484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.338654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.338663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.338678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.338776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 54 partition: 0 MaxSeqNo: 40 sessionId: src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0
2025-10-10T14:31:09.339111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13f1e2a-6ca055db-540cd4ee-70d277da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.341677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0] Write session: try to update token
2025-10-10T14:31:09.341693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:09.342376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:09.342392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.342403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600582361992032:2630]
2025-10-10T14:31:09.342446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:09.342463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:09.342619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:09.342760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.342898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.343079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.343275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:09.343314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:09.355878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId: src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:09.358573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:09.359599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.359623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.359646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:09.359650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.359653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:09.359655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:09.359664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600582361992032:2630]
2025-10-10T14:31:09.359667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600582361992032:2630]
2025-10-10T14:31:09.359670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600582361992032:2630]
2025-10-10T14:31:09.359701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:09.359711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:09.359714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:09.359715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:09.359720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.359722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:09.359836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:09.419204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600583144200912:2497]
2025-10-10T14:31:09.419476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 53, pipe: [1:7559600583144200912:2497]
2025-10-10T14:31:09.463825Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:09.464049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:09.464079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200912:2497], now have 1 active actors on pipe
2025-10-10T14:31:09.464193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:09.473094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:09.473482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:09.473661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:09.473674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:09.473684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:09.473729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:09.473767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600582361992163:2638]
2025-10-10T14:31:09.474354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:09.474664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:09.474705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:09.474919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:09.474931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:09.474952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 54 reason: error at write: Disconnected sessionId: src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0
2025-10-10T14:31:09.475007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:09.475073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.475095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 54 sessionId: src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0 is DEAD
2025-10-10T14:31:09.475081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.475082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.475084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.475085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.475086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.475087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.475087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.475088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.475089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.475090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.475091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.475092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.475098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.475109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.475114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.475118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.475122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.475126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.475130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.475133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.475137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.475141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.475146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.475150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.475154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.475161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.475169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.475176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.475186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.475195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.475200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.475204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.475214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.475225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:09.475221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:09.475222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.475227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.475238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0] Write session will restart in 0.005910s
2025-10-10T14:31:09.475231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.475236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.475241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.475246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.475250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.475256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.475254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600583144200912:2497]
2025-10-10T14:31:09.475261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.475266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.475275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0] Write session: Do CDS request
2025-10-10T14:31:09.475269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.475274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.475277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.475282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:09.475282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.475291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.475297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.475305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.475310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.475353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:09.479920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:09.480213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:09.480224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:09.480226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:09.480230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:09.480235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 54 [2:7559600582361992163:2638]
2025-10-10T14:31:09.480246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:09.480261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:09.480263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.480271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.480274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.480290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:09.480301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:09.480313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:09.480364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.480374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.480376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.480378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:09.480432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:09.480438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.480450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.480466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.480488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:09.480512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144200996:2438], now have 1 active actors on pipe
2025-10-10T14:31:09.480523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600582361992158:2638]
2025-10-10T14:31:09.480529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600582361992158:2638]
2025-10-10T14:31:09.480531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600582361992158:2638]
2025-10-10T14:31:09.480544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:09.480555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:09.480561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:09.480562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:09.480537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 54
2025-10-10T14:31:09.480563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:09.480577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:09.480580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:09.480608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600582361992158:2638]
2025-10-10T14:31:09.480616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:09.480638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:09.481797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.481860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.481869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 55
2025-10-10T14:31:09.481989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.482030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 55 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:09.482038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=55 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.482042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.482365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 55 sessionId:  describe result for acl check
2025-10-10T14:31:09.482391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.482394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.482403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.482407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600583144201018:2805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.482794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600583144201018:2805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.484085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600583144201018:2805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.489763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600583144201018:2805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.489772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600583144201018:2805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:09.489775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600583144201018:2805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.489780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 55 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.490002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201044:2805], now have 1 active actors on pipe
2025-10-10T14:31:09.490042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 54
2025-10-10T14:31:09.490097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.490110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.490140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:09.490155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.490159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.490162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.490176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.490191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.490207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.490348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.490356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.490372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.490473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 55 partition: 0 MaxSeqNo: 40 sessionId: src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0
2025-10-10T14:31:09.490775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b92c4a-c34bd74f-9fd96532-10c486aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.493304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0] Write session: try to update token
2025-10-10T14:31:09.493321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:09.498264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:09.498278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.498283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:09.498285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:09.498293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600582361992158:2638]
2025-10-10T14:31:09.498297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600582361992158:2638]
2025-10-10T14:31:09.498301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600582361992158:2638]
2025-10-10T14:31:09.498347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:09.498349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:09.498354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:09.498358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:09.498358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.498361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:09.498493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:09.508322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId: src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:09.510906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:09.558950Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:31:09.558969Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:31:09.575378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600583144201056:2497]
2025-10-10T14:31:09.575571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 54, pipe: [1:7559600583144201056:2497]
2025-10-10T14:31:09.601526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:09.601824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.601836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.601856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201056:2497], now have 1 active actors on pipe
2025-10-10T14:31:09.602004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:09.602050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:09.602066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:09.602103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600583144201056:2497]
2025-10-10T14:31:09.602144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 55 reason: status is not ok: tablet will be restarted right now sessionId: src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0
2025-10-10T14:31:09.602372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 55 sessionId: src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0 is DEAD
2025-10-10T14:31:09.602477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:09.602487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0] Write session will restart in 0.006179s
2025-10-10T14:31:09.602506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0] Write session: Do CDS request
2025-10-10T14:31:09.602510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:09.609718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.609834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.609848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 56
2025-10-10T14:31:09.609975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.610018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 56 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:09.610028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=56 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.610032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.610004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:09.610398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 56 sessionId:  describe result for acl check
2025-10-10T14:31:09.610435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.610441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.610434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:09.610443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.610449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600583144201133:2811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.610585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:09.610595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:09.610605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:09.610655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:09.610693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600582361992298:2649]
2025-10-10T14:31:09.610968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600583144201133:2811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.611262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:09.611517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:09.611559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:09.611851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:09.611913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.611919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.611920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.611921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.611922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.611923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.611924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.611925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.611926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.611927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.611928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.611929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.611930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.611936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.611948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.611951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.611955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.611959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.611962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.611966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.611974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.611977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.611985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.611989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.611993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.611996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.612003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.612012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.612023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.612032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.612037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.612046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.612054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.612060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.612069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.612073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.612082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.612089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.612097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.612106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.612110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.612119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.612123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.612132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.612136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.612144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.612154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.612159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.612167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.612173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.612181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.612187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.612231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:09.612952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600583144201133:2811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.614273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:09.614663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:09.614675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:09.614677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:09.614681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:09.614686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 55 [2:7559600582361992298:2649]
2025-10-10T14:31:09.614699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:09.614715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:09.614722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.614725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.614726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.614740Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:09.614751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:09.614762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:09.614819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.614826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.614828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.614830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:09.614890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:09.614899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.614911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.614923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.614940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:09.614962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201062:2438], now have 1 active actors on pipe
2025-10-10T14:31:09.614973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600582361992293:2649]
2025-10-10T14:31:09.614976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600582361992293:2649]
2025-10-10T14:31:09.614980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600582361992293:2649]
2025-10-10T14:31:09.614978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 55
2025-10-10T14:31:09.614989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:09.615006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:09.615017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:09.615020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:09.615022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:09.615028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:09.615031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:09.615057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600582361992293:2649]
2025-10-10T14:31:09.615064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:09.615078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:09.615292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600583144201133:2811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.615311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600583144201133:2811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:09.615314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600583144201133:2811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.615320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 56 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.615492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201169:2811], now have 1 active actors on pipe
2025-10-10T14:31:09.615517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 55
2025-10-10T14:31:09.615567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.615577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.615609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:09.615620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.615624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.615626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.615638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.615652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.615672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.615801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.615809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.615824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.615904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 56 partition: 0 MaxSeqNo: 40 sessionId: src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0
2025-10-10T14:31:09.616203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|136235a1-dd2dbe98-b5ea5506-ad61eb48_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.618626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0] Write session: try to update token
2025-10-10T14:31:09.618640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:09.633042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:09.633057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.633060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:09.633062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:09.633072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600582361992293:2649]
2025-10-10T14:31:09.633077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600582361992293:2649]
2025-10-10T14:31:09.633084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600582361992293:2649]
2025-10-10T14:31:09.633118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:09.633126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:09.633128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:09.633132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:09.633132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.633135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:09.633259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:09.635358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId: src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:09.638055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:09.702357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600583144201175:2497]
2025-10-10T14:31:09.702702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 55, pipe: [1:7559600583144201175:2497]
2025-10-10T14:31:09.738508Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:09.738751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.738765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.738802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201175:2497], now have 1 active actors on pipe
2025-10-10T14:31:09.738961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:09.739060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:09.739071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600583144201175:2497]
2025-10-10T14:31:09.739077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:09.739088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:09.739141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 56 reason: error at write: Disconnected sessionId: src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0
2025-10-10T14:31:09.739363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 56 sessionId: src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0 is DEAD
2025-10-10T14:31:09.739496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:09.739506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0] Write session will restart in 0.007337s
2025-10-10T14:31:09.739529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0] Write session: Do CDS request
2025-10-10T14:31:09.739535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:09.747231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:09.747660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:09.747772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.747818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:09.747830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:09.747840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:09.747886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:09.747884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.747897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 57
2025-10-10T14:31:09.747922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600582361992408:2651]
2025-10-10T14:31:09.748012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.748035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 57 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:09.748039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=57 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.748042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.748336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 57 sessionId:  describe result for acl check
2025-10-10T14:31:09.748364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.748365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.748367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.748372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600583144201248:2815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.748515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:09.748766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:09.748805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:09.748830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600583144201248:2815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.749117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:09.749171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.749177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.749178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.749179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.749180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.749181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.749182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.749183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.749184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.749185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.749187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.749188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.749189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.749193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.749205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.749209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.749213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.749217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.749221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.749225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.749229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.749233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.749237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.749240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.749244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.749248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.749259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.749271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.749281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.749287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.749291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.749300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.749305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.749314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.749318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.749325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.749344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.749353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.749357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.749366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.749370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.749379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.749384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.749392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.749401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.749406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.749414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.749419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.749427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.749434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.749439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.749445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.749486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:09.750765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600583144201248:2815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.751562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:09.751842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:09.751853Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:09.751855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:09.751858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:09.751863Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 56 [2:7559600582361992408:2651]
2025-10-10T14:31:09.751874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:09.751894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:09.751899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.751901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.751903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.751912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:09.751920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:09.751926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:09.751966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.751970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.751971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.751973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:09.752031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:09.752038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.752049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.752068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.752078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:09.752094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201176:2438], now have 1 active actors on pipe
2025-10-10T14:31:09.752106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600582361992403:2651]
2025-10-10T14:31:09.752112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600582361992403:2651]
2025-10-10T14:31:09.752115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600582361992403:2651]
2025-10-10T14:31:09.752126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:09.752140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:09.752131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 56
2025-10-10T14:31:09.752143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:09.752148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:09.752150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:09.752159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:09.752163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:09.752188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600582361992403:2651]
2025-10-10T14:31:09.752201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:09.752208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:09.756609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600583144201248:2815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.756635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600583144201248:2815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:09.756639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600583144201248:2815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.756647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 57 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.756877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201286:2815], now have 1 active actors on pipe
2025-10-10T14:31:09.756914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 56
2025-10-10T14:31:09.756975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.756987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.757017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:09.757029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.757038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.757040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.757053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.757071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.757090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.757261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.757269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.757284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.757396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 57 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0
2025-10-10T14:31:09.757717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bab8d34e-7e159607-19fd9922-3f98f44b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.760031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0] Write session: try to update token
2025-10-10T14:31:09.760044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:09.770616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:09.770633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.770636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:09.770638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:09.770648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600582361992403:2651]
2025-10-10T14:31:09.770652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600582361992403:2651]
2025-10-10T14:31:09.770656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600582361992403:2651]
2025-10-10T14:31:09.770696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:09.770703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:09.770709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:09.770710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.770712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:09.770713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:09.770851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:09.774027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId: src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:09.776480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:09.839044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600583144201290:2497]
2025-10-10T14:31:09.839293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 56, pipe: [1:7559600583144201290:2497]
2025-10-10T14:31:09.877898Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:09.878203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.878214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.878249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201290:2497], now have 1 active actors on pipe
2025-10-10T14:31:09.878494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:09.878506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:09.878506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600583144201290:2497]
2025-10-10T14:31:09.878532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:09.878569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 57 reason: error at write: Disconnected sessionId: src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0
2025-10-10T14:31:09.878576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:09.878779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 57 sessionId: src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0 is DEAD
2025-10-10T14:31:09.878895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:09.878904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0] Write session will restart in 0.008939s
2025-10-10T14:31:09.878923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0] Write session: Do CDS request
2025-10-10T14:31:09.878927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:09.886951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:09.887339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:09.887502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:09.887512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:09.887524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:09.887588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:09.887625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600582361992520:2653]
2025-10-10T14:31:09.888059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:09.888283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:09.888322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:09.888560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:09.888604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.888609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.888610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.888610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.888611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.888612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.888612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.888613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.888613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.888614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.888615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.888615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.888616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.888619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.888628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.888630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.888632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.888634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.888636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.888638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.888640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.888642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.888645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.888646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.888648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.888650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.888656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.888662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:09.888666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.888669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:09.888672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.888675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:09.888677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.888681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:09.888684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.888689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:09.888695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.888699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:09.888703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.888708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:09.888712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.888718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:09.888721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.888726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:09.888731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.888735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:09.888738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.888741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.888744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.888747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.888751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.888756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.888792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:09.888805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.888871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:09.888885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 58
2025-10-10T14:31:09.889033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:09.889064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 58 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:09.889074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=58 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:09.889078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:09.889442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 58 sessionId:  describe result for acl check
2025-10-10T14:31:09.889471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:09.889479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:09.889480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:09.889484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600583144201368:2819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:09.889907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600583144201368:2819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:09.890948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:09.891338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:09.891349Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:09.891351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:09.891355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:09.891360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 57 [2:7559600582361992520:2653]
2025-10-10T14:31:09.891372Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:09.891388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:09.891392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.891395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.891397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.891412Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:09.891423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:09.891431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:09.891483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.891489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.891490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.891492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:09.891553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:09.891560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.891573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:09.891586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:09.891607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:09.891633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201291:2438], now have 1 active actors on pipe
2025-10-10T14:31:09.891645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600582361992515:2653]
2025-10-10T14:31:09.891647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600582361992515:2653]
2025-10-10T14:31:09.891649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600582361992515:2653]
2025-10-10T14:31:09.891651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 57
2025-10-10T14:31:09.891661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:09.891679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:09.891686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:09.891689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:09.891692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:09.891699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:09.891702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:09.891731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600582361992515:2653]
2025-10-10T14:31:09.891741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:09.891759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:09.892142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600583144201368:2819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:09.897995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600583144201368:2819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:09.898016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600583144201368:2819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:09.898019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600583144201368:2819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:09.898025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 58 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:09.898249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201402:2819], now have 1 active actors on pipe
2025-10-10T14:31:09.898312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 57
2025-10-10T14:31:09.898385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.898396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.898426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:09.898442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:09.898453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:09.898457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:09.898472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:09.898488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:09.898511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.898659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.898667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.898682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:09.898757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 58 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0
2025-10-10T14:31:09.899060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0370a3a-2d4c08c6-cc9d07a3-710853d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:09.901465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0] Write session: try to update token
2025-10-10T14:31:09.901479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:09.912025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:09.912038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.912049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600582361992515:2653]
2025-10-10T14:31:09.912098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:09.912098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:09.912279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:09.912419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.912552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.912685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:09.912885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:09.912925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:09.915393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId: src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:09.917866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:09.918065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:09.918080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:09.918109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:09.918208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:09.919774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:09.919790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:09.919793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:09.919795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:09.919804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600582361992515:2653]
2025-10-10T14:31:09.919808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600582361992515:2653]
2025-10-10T14:31:09.919811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600582361992515:2653]
2025-10-10T14:31:09.919856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:09.919867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:09.919869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:09.919873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:09.919879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:09.919884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:09.919981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:09.979245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600583144201413:2497]
2025-10-10T14:31:09.979423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 57, pipe: [1:7559600583144201413:2497]
2025-10-10T14:31:10.025491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:10.032172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.032191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.032333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.032387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.032443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.032500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.032543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.032554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.032617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.032676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.032734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.032927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.033014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.033021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.033222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.033279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.033350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.033404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.033443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.033448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.033505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.033561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.033632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.033693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.033738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.033743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.033800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.033853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.033908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.033962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.034021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.034031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.034097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.034158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.034215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.034271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.034311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.034316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.034372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.034427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.034500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.034562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.034602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.034608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.034712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.035436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.036121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.037230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.037279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.037284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.037353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.037412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.037471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.037526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.037564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.037570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.037627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:10.037680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:10.037733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:10.037790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:10.037830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:10.037835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:10.037889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600583144201413:2497], now have 1 active actors on pipe
2025-10-10T14:31:10.038147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:10.038150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600583144201413:2497]
2025-10-10T14:31:10.038159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:10.038166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:10.038186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 58 reason: error at write: Disconnected sessionId: src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0
2025-10-10T14:31:10.038385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 58 sessionId: src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0 is DEAD
2025-10-10T14:31:10.038496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:10.038503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0] Write session will restart in 0.005649s
2025-10-10T14:31:10.038520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0] Write session: Do CDS request
2025-10-10T14:31:10.038524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:10.038780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:10.044801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.044915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:10.044928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 59
2025-10-10T14:31:10.045066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.045101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 59 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:10.045111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=59 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:10.045115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:10.045496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 59 sessionId:  describe result for acl check
2025-10-10T14:31:10.045524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:10.045529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:10.045532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:10.045536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600587439168793:2824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:10.045959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600587439168793:2824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:10.046614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:10.047109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:10.047278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:10.047289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:10.047300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:10.047352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:10.047416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600586656959945:2657]
2025-10-10T14:31:10.047778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600587439168793:2824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:10.047857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:10.048154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:10.048200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:10.048486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:10.048554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.048562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.048563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.048564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.048565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.048566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.048567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.048568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.048569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.048570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.048571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.048572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.048573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.048578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.048589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.048592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.048596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.048599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.048602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.048606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.048609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.048612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.048616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.048619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.048622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.048625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.048632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.048640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.048646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.048651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.048654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.048659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.048663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.048667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.048671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.048675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.048680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.048684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.048688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.048692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.048695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.048700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.048704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.048708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.048712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.048717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.048721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.048726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.048730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.048735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.048739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.048743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.048780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:10.050912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600587439168793:2824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:10.050924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600587439168793:2824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:10.050928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600587439168793:2824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:10.050935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 59 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:10.050956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:10.051251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:10.051262Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:10.051265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:10.051268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:10.051274Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 58 [2:7559600586656959945:2657]
2025-10-10T14:31:10.051286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:10.051301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:10.051304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.051307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.051309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.051323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:10.051332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:10.051340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:10.051387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.051394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.051396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.051399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:10.051463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:10.051470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.051480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.051493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.051515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:10.051543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439168830:2824], now have 1 active actors on pipe
2025-10-10T14:31:10.051547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439168722:2438], now have 1 active actors on pipe
2025-10-10T14:31:10.051554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600586656959940:2657]
2025-10-10T14:31:10.051557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600586656959940:2657]
2025-10-10T14:31:10.051559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600586656959940:2657]
2025-10-10T14:31:10.051573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:10.051570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 58
2025-10-10T14:31:10.051590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:10.051579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 58
2025-10-10T14:31:10.051595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:10.051599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:10.051601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:10.051610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:10.051613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:10.051643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.051652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.051666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600586656959940:2657]
2025-10-10T14:31:10.051679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:10.051694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:10.051714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:10.051721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.051723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.051725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:10.051734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.051744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:10.051766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.051945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.051954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.051968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.052070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 59 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0
2025-10-10T14:31:10.052391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0193e6-9a58a207-e55d0dc7-13221280_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:10.054946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0] Write session: try to update token
2025-10-10T14:31:10.054960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:10.070092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:10.070108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:10.070111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:10.070113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:10.070122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600586656959940:2657]
2025-10-10T14:31:10.070126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600586656959940:2657]
2025-10-10T14:31:10.070131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600586656959940:2657]
2025-10-10T14:31:10.070181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:10.070194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.070196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:10.070195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:10.070203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:10.070207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:10.070328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:10.070984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId: src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:10.073668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:10.138066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600587439168839:2497]
2025-10-10T14:31:10.138377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 58, pipe: [1:7559600587439168839:2497]
2025-10-10T14:31:10.175955Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:10.176274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.176288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.176327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439168839:2497], now have 1 active actors on pipe
2025-10-10T14:31:10.176590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:10.176595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:10.176599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:10.176660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600587439168839:2497]
2025-10-10T14:31:10.176667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 59 reason: error at write: Disconnected sessionId: src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0
2025-10-10T14:31:10.177023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:10.177038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0] Write session will restart in 0.006416s
2025-10-10T14:31:10.177070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0] Write session: Do CDS request
2025-10-10T14:31:10.177085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:10.176885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 59 sessionId: src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0 is DEAD
2025-10-10T14:31:10.177210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:10.184900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.185005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:10.185017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 60
2025-10-10T14:31:10.185133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.185162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 60 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:10.185180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=60 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:10.185184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:10.185677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 60 sessionId:  describe result for acl check
2025-10-10T14:31:10.185713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:10.185719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:10.185723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:10.185729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600587439168913:2829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:10.186195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600587439168913:2829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:10.186753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:10.187503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:10.187679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:10.187692Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:10.187703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:10.187760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:10.187803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600586656960059:2659]
2025-10-10T14:31:10.188249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600587439168913:2829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:10.188334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:10.188584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:10.188631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:10.188921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:10.188992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.189000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.189001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.189002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.189003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.189005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.189006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.189007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.189008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.189009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.189010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.189011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.189012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.189017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.189027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.189031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.189034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.189037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.189041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.189044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.189048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.189051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.189055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.189058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.189061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.189064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.189071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.189079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.189084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.189089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.189093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.189097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.189101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.189106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.189110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.189114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.189119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.189124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.189128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.189133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.189137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.189141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.189146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.189150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.189153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.189158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.189163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.189167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.189171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.189176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.189179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.189184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.189223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:10.191289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600587439168913:2829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:10.191300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600587439168913:2829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:10.191302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600587439168913:2829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:10.191309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 60 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:10.191351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:10.191627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:10.191636Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:10.191637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:10.191640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:10.191645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 59 [2:7559600586656960059:2659]
2025-10-10T14:31:10.191653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:10.191665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:10.191667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.191669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.191670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.191681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:10.191686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:10.191694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:10.191730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.191734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.191735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.191737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:10.191791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:10.191798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.191805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.191812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.191822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:10.191842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439168950:2829], now have 1 active actors on pipe
2025-10-10T14:31:10.191849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439168841:2438], now have 1 active actors on pipe
2025-10-10T14:31:10.191857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600586656960054:2659]
2025-10-10T14:31:10.191859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600586656960054:2659]
2025-10-10T14:31:10.191861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600586656960054:2659]
2025-10-10T14:31:10.191876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:10.191888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:10.191904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:10.191904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:10.191907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:10.191909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:10.191912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:10.191928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600586656960054:2659]
2025-10-10T14:31:10.191931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:10.191927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 59
2025-10-10T14:31:10.191935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 59
2025-10-10T14:31:10.191938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:10.191953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.191957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.191984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:10.191994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.191997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.191999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:10.192007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.192016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:10.192026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.192162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.192167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.192178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.192298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 60 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0
2025-10-10T14:31:10.192663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1941cb3-cf40d20e-1036bf81-20b3c2b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:10.195340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0] Write session: try to update token
2025-10-10T14:31:10.195357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:10.210168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId: src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:10.211493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:10.211515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:10.211518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:10.211519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:10.211530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600586656960054:2659]
2025-10-10T14:31:10.211535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600586656960054:2659]
2025-10-10T14:31:10.211540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600586656960054:2659]
2025-10-10T14:31:10.211589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:10.211600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:10.211602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:10.211604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:10.211610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.211612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:10.211819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:10.213283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:10.276822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600587439168957:2497]
2025-10-10T14:31:10.277104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 59, pipe: [1:7559600587439168957:2497]
2025-10-10T14:31:10.321928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:10.322231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.322243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.322280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439168957:2497], now have 1 active actors on pipe
2025-10-10T14:31:10.322439Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:10.322500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:10.322503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600587439168957:2497]
2025-10-10T14:31:10.322511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:10.322519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:10.322569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 60 reason: error at write: Disconnected sessionId: src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0
2025-10-10T14:31:10.322761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 60 sessionId: src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0 is DEAD
2025-10-10T14:31:10.322913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:10.322925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0] Write session will restart in 0.006350s
2025-10-10T14:31:10.322952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0] Write session: Do CDS request
2025-10-10T14:31:10.322962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:10.330775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.330847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:10.330859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 61
2025-10-10T14:31:10.331001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.331037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 61 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:10.331042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=61 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:10.331046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:10.331163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:10.331410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 61 sessionId:  describe result for acl check
2025-10-10T14:31:10.331445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:10.331449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:10.331450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:10.331456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600587439169035:2833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:10.331573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:10.331740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:10.331751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:10.331763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:10.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:10.331854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600586656960174:2661]
2025-10-10T14:31:10.331849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600587439169035:2833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:10.332450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:10.332717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:10.332764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:10.333084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:10.333152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.333158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.333159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.333160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.333162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.333163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.333164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.333165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.333166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.333167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.333169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.333170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.333171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.333177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.333189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.333194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.333198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.333202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.333207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.333211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.333214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.333219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.333224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.333228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.333232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.333237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.333243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.333252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.333258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.333263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.333272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.333277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.333281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.333287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.333294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.333301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.333305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.333310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.333315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.333324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.333347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.333356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.333360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.333366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.333377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.333383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.333388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.333394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.333400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.333405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.333410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.333418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.333462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:10.333906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600587439169035:2833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:10.335698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:10.336009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:10.336026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:10.336028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:10.336031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:10.336037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 60 [2:7559600586656960174:2661]
2025-10-10T14:31:10.336048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:10.336064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:10.336067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.336070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.336072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.336089Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:10.336101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:10.336109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:10.336166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.336158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600587439169035:2833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:10.336172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.336171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600587439169035:2833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:10.336174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.336177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:10.336175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600587439169035:2833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:10.336182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 61 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:10.336242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:10.336251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.336264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.336277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.336295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:10.336300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 60
2025-10-10T14:31:10.336315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439168959:2438], now have 1 active actors on pipe
2025-10-10T14:31:10.336328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600586656960169:2661]
2025-10-10T14:31:10.336330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600586656960169:2661]
2025-10-10T14:31:10.336332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600586656960169:2661]
2025-10-10T14:31:10.336340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:10.336349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:10.336353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:10.336356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:10.336358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:10.336369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:10.336372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:10.336385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169069:2833], now have 1 active actors on pipe
2025-10-10T14:31:10.336392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 60
2025-10-10T14:31:10.336406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600586656960169:2661]
2025-10-10T14:31:10.336415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:10.336427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:10.336442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.336451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.336482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:10.336494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.336498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.336500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:10.336511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.336522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:10.336535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.336692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.336702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.336719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.336786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 61 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0
2025-10-10T14:31:10.337076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1e3f8fe-84a245b8-45efe3d1-4887c8d9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:10.339601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0] Write session: try to update token
2025-10-10T14:31:10.339616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:10.354240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId: src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:10.354642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:10.354658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:10.354661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:10.354662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:10.354672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600586656960169:2661]
2025-10-10T14:31:10.354675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600586656960169:2661]
2025-10-10T14:31:10.354680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600586656960169:2661]
2025-10-10T14:31:10.354718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:10.354724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.354726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:10.354841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:10.354913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:10.354923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:10.354928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:10.356573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:10.422742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600587439169076:2497]
2025-10-10T14:31:10.422971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 60, pipe: [1:7559600587439169076:2497]
2025-10-10T14:31:10.458572Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:10.458904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.458920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.458964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169076:2497], now have 1 active actors on pipe
2025-10-10T14:31:10.459151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:10.459189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:10.459194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:10.459197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:10.459235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600587439169076:2497]
2025-10-10T14:31:10.459261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 61 reason: error at write: Disconnected sessionId: src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0
2025-10-10T14:31:10.459466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 61 sessionId: src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0 is DEAD
2025-10-10T14:31:10.459602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:10.459611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0] Write session will restart in 0.009758s
2025-10-10T14:31:10.459630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0] Write session: Do CDS request
2025-10-10T14:31:10.459636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:10.467321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:10.467778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:10.467941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:10.467952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:10.467962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:10.468006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:10.468045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600586656960289:2663]
2025-10-10T14:31:10.468644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:10.468898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:10.468940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:10.469253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:10.469303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.469309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.469310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.469312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.469313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.469314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.469315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.469317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.469318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.469319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.469320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.469321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.469322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.469341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.469355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.469359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.469363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.469367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.469371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.469375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.469379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.469383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.469389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.469393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.469396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.469400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.469408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.469416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.469426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.469436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.469440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.469445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.469454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.469459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.469464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.469471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.469475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.469485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.469492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.469502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.469511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.469521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.469526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.469535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.469540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.469545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.469549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.469560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.469564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.469573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.469582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.469587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.469632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:10.470809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.470908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:10.470921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 62
2025-10-10T14:31:10.471060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.471096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 62 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:10.471104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=62 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:10.471107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:10.471506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 62 sessionId:  describe result for acl check
2025-10-10T14:31:10.471543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:10.471545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:10.471546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:10.471552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600587439169159:2837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:10.471796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:10.472115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600587439169159:2837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:10.472189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:10.472201Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:10.472204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:10.472207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:10.472213Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 61 [2:7559600586656960289:2663]
2025-10-10T14:31:10.472225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:10.472241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:10.472248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.472251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.472254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.472270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:10.472281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:10.472290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:10.472343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.472351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.472353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.472355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:10.472416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:10.472422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.472433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.472444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.472467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:10.472493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169077:2438], now have 1 active actors on pipe
2025-10-10T14:31:10.472505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600586656960284:2663]
2025-10-10T14:31:10.472512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600586656960284:2663]
2025-10-10T14:31:10.472514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600586656960284:2663]
2025-10-10T14:31:10.472520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 61
2025-10-10T14:31:10.472527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:10.472542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:10.472544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:10.472550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:10.472552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:10.472560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:10.472563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:10.472594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600586656960284:2663]
2025-10-10T14:31:10.472606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:10.472616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:10.474177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600587439169159:2837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:10.479936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600587439169159:2837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:10.479950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600587439169159:2837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:10.479955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600587439169159:2837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:10.479963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 62 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:10.480292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 61
2025-10-10T14:31:10.480291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169194:2837], now have 1 active actors on pipe
2025-10-10T14:31:10.480361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.480372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.480402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:10.480421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.480427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.480430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:10.480443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.480461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:10.480480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.480620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.480630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.480647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.480702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 62 partition: 0 MaxSeqNo: 40 sessionId: src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0
2025-10-10T14:31:10.481040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9b3b9a-a6321858-c8d1928d-3fa8a1fc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:10.483654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0] Write session: try to update token
2025-10-10T14:31:10.483671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:10.490570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:10.490585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:10.490587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:10.490588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:10.490595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600586656960284:2663]
2025-10-10T14:31:10.490598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600586656960284:2663]
2025-10-10T14:31:10.490603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600586656960284:2663]
2025-10-10T14:31:10.490637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:10.490643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.490644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:10.490650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:10.490657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:10.490662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:10.490758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:10.497578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:10.500039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:10.559429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600587439169231:2497]
2025-10-10T14:31:10.559714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 61, pipe: [1:7559600587439169231:2497]
2025-10-10T14:31:10.593664Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:10.594134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.594146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.594166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169231:2497], now have 1 active actors on pipe
2025-10-10T14:31:10.594361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:10.594413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:10.594459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:10.594545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 62 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0
2025-10-10T14:31:10.594690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600587439169231:2497]
2025-10-10T14:31:10.594757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 62 sessionId: src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0 is DEAD
2025-10-10T14:31:10.594887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:10.594897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0] Write session will restart in 0.006449s
2025-10-10T14:31:10.594920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0] Write session: Do CDS request
2025-10-10T14:31:10.594926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:10.601935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:10.602379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:10.602606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:10.602622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:10.602636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:10.602704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:10.602754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600586656960447:2680]
2025-10-10T14:31:10.602803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.602825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:10.602837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 63
2025-10-10T14:31:10.603034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.603057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 63 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:10.603065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=63 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:10.603068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:10.603399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 63 sessionId:  describe result for acl check
2025-10-10T14:31:10.603404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:10.603429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:10.603434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:10.603436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:10.603440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600587439169313:2852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:10.603673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:10.603721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:10.603868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600587439169313:2852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:10.603972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:10.604021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.604025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.604026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.604027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.604027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.604028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.604028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.604029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.604030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.604030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.604031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.604032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.604032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.604035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.604043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.604045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.604048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.604050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.604052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.604054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.604056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.604059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.604061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.604063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.604065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.604067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.604073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.604079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.604084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.604088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.604090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.604093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.604096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.604099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.604102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.604105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.604108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.604111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.604114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.604117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.604120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.604123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.604125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.604128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.604132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.604135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.604138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.604142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.604144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.604147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.604152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.604154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.604177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:10.605876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600587439169313:2852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:10.606393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:10.606910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:10.606923Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:10.606925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:10.606928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:10.606934Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 62 [2:7559600586656960447:2680]
2025-10-10T14:31:10.606945Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:10.606965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:10.606976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.606981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.606984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.607004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:10.607019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:10.607034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:10.607111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.607123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.607126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.607128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:10.607198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:10.607206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.607219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.607231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.607250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:10.607262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 62
2025-10-10T14:31:10.607277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169235:2438], now have 1 active actors on pipe
2025-10-10T14:31:10.607290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600586656960442:2680]
2025-10-10T14:31:10.607292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600586656960442:2680]
2025-10-10T14:31:10.607294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600586656960442:2680]
2025-10-10T14:31:10.607308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:10.607318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:10.607320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:10.607321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:10.607329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:10.607346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:10.607354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:10.607392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600586656960442:2680]
2025-10-10T14:31:10.607410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:10.607412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:10.608194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600587439169313:2852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:10.608209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600587439169313:2852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:10.608212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600587439169313:2852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:10.608220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 63 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:10.608396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169351:2852], now have 1 active actors on pipe
2025-10-10T14:31:10.608415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 62
2025-10-10T14:31:10.608471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.608480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.608501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8eb47a42-67d99794-d0922138-fea832d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:10.608512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.608515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.608517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:10.608526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.608539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:10.608552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.608737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.608744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.608756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.608830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 63 partition: 0 MaxSeqNo: 40 sessionId: src_id|8eb47a42-67d99794-d0922138-fea832d1_0
2025-10-10T14:31:10.609140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b86a8a-b1038856-4120aab6-e16e33fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8eb47a42-67d99794-d0922138-fea832d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:10.611599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb47a42-67d99794-d0922138-fea832d1_0] Write session: try to update token
2025-10-10T14:31:10.611616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb47a42-67d99794-d0922138-fea832d1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:10.624991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId: src_id|8eb47a42-67d99794-d0922138-fea832d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:10.625234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:10.625253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:10.625256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:10.625258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:10.625268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600586656960442:2680]
2025-10-10T14:31:10.625272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600586656960442:2680]
2025-10-10T14:31:10.625275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600586656960442:2680]
2025-10-10T14:31:10.625308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:10.625314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:10.625316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:10.625321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:10.625350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.625352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:10.625560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:10.627394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:10.695104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600587439169355:2497]
2025-10-10T14:31:10.695343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 62, pipe: [1:7559600587439169355:2497]
2025-10-10T14:31:10.728790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:10.728996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.729009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.729047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169355:2497], now have 1 active actors on pipe
2025-10-10T14:31:10.729248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:10.729249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:10.729261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:10.729291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600587439169355:2497]
2025-10-10T14:31:10.729347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 63 reason: error at write: Disconnected sessionId: src_id|8eb47a42-67d99794-d0922138-fea832d1_0
2025-10-10T14:31:10.729527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 63 sessionId: src_id|8eb47a42-67d99794-d0922138-fea832d1_0 is DEAD
2025-10-10T14:31:10.729697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb47a42-67d99794-d0922138-fea832d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:10.729710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb47a42-67d99794-d0922138-fea832d1_0] Write session will restart in 0.007974s
2025-10-10T14:31:10.729735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb47a42-67d99794-d0922138-fea832d1_0] Write session: Do CDS request
2025-10-10T14:31:10.729742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb47a42-67d99794-d0922138-fea832d1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:10.730082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:10.737509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:10.737890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:10.738043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:10.738054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:10.738066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:10.738117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:10.738157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600586656960565:2682]
2025-10-10T14:31:10.738556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:10.738789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:10.738821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:10.738844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb47a42-67d99794-d0922138-fea832d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.738919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:10.738931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 64
2025-10-10T14:31:10.739040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:10.739080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.739085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.739071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.739086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.739086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.739087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.739088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.739088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.739089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.739105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 64 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:10.739090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.739112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=64 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:10.739116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:10.739090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.739091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.739091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.739092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.739096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.739105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.739107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.739111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.739115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.739119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.739123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.739127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.739130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.739135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.739139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.739142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.739145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.739151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.739156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.739161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.739164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.739167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.739170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.739172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.739175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.739177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.739180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.739183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.739186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.739189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.739192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.739195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.739198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.739201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.739204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.739206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.739210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.739212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.739215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.739218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.739221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.739224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.739227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.739251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:10.739455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 64 sessionId:  describe result for acl check
2025-10-10T14:31:10.739481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:10.739482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:10.739483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:10.739488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600587439169439:2856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:10.739918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600587439169439:2856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:10.741420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:10.741741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:10.741749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:10.741751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:10.741753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:10.741758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 63 [2:7559600586656960565:2682]
2025-10-10T14:31:10.741767Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:10.741779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:10.741784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.741786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.741788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.741800Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:10.741805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:10.741816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:10.741858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.741863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.741864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.741866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:10.741923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:10.741930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.741938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.741944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.741954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:10.741959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600587439169439:2856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:10.741971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169356:2438], now have 1 active actors on pipe
2025-10-10T14:31:10.741982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600586656960559:2682]
2025-10-10T14:31:10.741983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600586656960559:2682]
2025-10-10T14:31:10.741998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600586656960559:2682]
2025-10-10T14:31:10.741994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 63
2025-10-10T14:31:10.742010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:10.742029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:10.742031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:10.742032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:10.742039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:10.742055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:10.742058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:10.742085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600586656960559:2682]
2025-10-10T14:31:10.742095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:10.742100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:10.746402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600587439169439:2856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:10.746415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600587439169439:2856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:10.746418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600587439169439:2856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:10.746427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 64 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:10.746629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169473:2856], now have 1 active actors on pipe
2025-10-10T14:31:10.746673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 63
2025-10-10T14:31:10.746707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.746716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.746746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:10.746758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.746766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.746767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:10.746778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.746790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:10.746807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.746977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.746983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.747002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.747073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 64 partition: 0 MaxSeqNo: 40 sessionId: src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0
2025-10-10T14:31:10.747373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eb47a42-67d99794-d0922138-fea832d1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:10.749871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0] Write session: try to update token
2025-10-10T14:31:10.749888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:10.760083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:10.760100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:10.760102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:10.760104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:10.760113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600586656960559:2682]
2025-10-10T14:31:10.760118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600586656960559:2682]
2025-10-10T14:31:10.760121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600586656960559:2682]
2025-10-10T14:31:10.760168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:10.760179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.760180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:10.760201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:10.760212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:10.760215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:10.760304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:10.763168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId: src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:10.765594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:10.829260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600587439169477:2497]
2025-10-10T14:31:10.829560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 63, pipe: [1:7559600587439169477:2497]
2025-10-10T14:31:10.865525Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:10.865737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.865750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.865787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169477:2497], now have 1 active actors on pipe
2025-10-10T14:31:10.865956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:10.866064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:10.866065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600587439169477:2497]
2025-10-10T14:31:10.866076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:10.866086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:10.866222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 64 reason: error at write: Disconnected sessionId: src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0
2025-10-10T14:31:10.866416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 64 sessionId: src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0 is DEAD
2025-10-10T14:31:10.866582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:10.866593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0] Write session will restart in 0.005468s
2025-10-10T14:31:10.866618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0] Write session: Do CDS request
2025-10-10T14:31:10.866625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:10.872828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.872939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:10.872950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 65
2025-10-10T14:31:10.873072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:10.873107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 65 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:10.873117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=65 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:10.873121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:10.873509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 65 sessionId:  describe result for acl check
2025-10-10T14:31:10.873534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:10.873539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:10.873540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:10.873544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600587439169555:2860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:10.873935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600587439169555:2860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:10.874404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:10.875117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:10.875290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:10.875301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:10.875312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:10.875365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:10.875403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600586656960684:2684]
2025-10-10T14:31:10.875408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600587439169555:2860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:10.875993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:10.876246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:10.876281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:10.876585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:10.876651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.876656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.876658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.876659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.876660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.876661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.876662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.876663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.876665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.876666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.876667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.876668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.876669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.876674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.876686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.876690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.876694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.876698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.876702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.876706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.876710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.876713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.876718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.876726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.876730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.876738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.876745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.876757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:10.876767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.876773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:10.876778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.876783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:10.876791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.876796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:10.876806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.876814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:10.876821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.876830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:10.876838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.876843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:10.876851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.876856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:10.876865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.876870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:10.876878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.876883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:10.876887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.876896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.876900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.876907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.876914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.876919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.876958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:10.877344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600587439169555:2860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:10.877355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600587439169555:2860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:10.877359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600587439169555:2860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:10.877365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 65 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:10.879077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:10.879386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:10.879394Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:10.879396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:10.879398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:10.879403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 64 [2:7559600586656960684:2684]
2025-10-10T14:31:10.879411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:10.879424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:10.879432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.879435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.879437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.879452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:10.879463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:10.879475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:10.879525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.879531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.879532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.879534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:10.879581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:10.879586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.879594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:10.879601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:10.879611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:10.879630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169478:2438], now have 1 active actors on pipe
2025-10-10T14:31:10.879636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169591:2860], now have 1 active actors on pipe
2025-10-10T14:31:10.879641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600586656960679:2684]
2025-10-10T14:31:10.879644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600586656960679:2684]
2025-10-10T14:31:10.879645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600586656960679:2684]
2025-10-10T14:31:10.879655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:10.879652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 64
2025-10-10T14:31:10.879662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 64
2025-10-10T14:31:10.879667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:10.879681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:10.879686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:10.879690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:10.879690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:10.879693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:10.879724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.879731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.879743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600586656960679:2684]
2025-10-10T14:31:10.879752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:10.879770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:10.879774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:10.879779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:10.879782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:10.879783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:10.879791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:10.879799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:10.879828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.879968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:10.879973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:10.879985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:10.880055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 65 partition: 0 MaxSeqNo: 40 sessionId: src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0
2025-10-10T14:31:10.880332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11858e79-c81d455e-c253b8cc-33e6b17c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:10.882932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0] Write session: try to update token
2025-10-10T14:31:10.882948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:10.896462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId: src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:10.898693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:10.898710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:10.898713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:10.898715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:10.898724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600586656960679:2684]
2025-10-10T14:31:10.898729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600586656960679:2684]
2025-10-10T14:31:10.898733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600586656960679:2684]
2025-10-10T14:31:10.898779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:10.898780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:10.898787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:10.898790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:10.898790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:10.898792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:10.898833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:10.898917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:10.966459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600587439169599:2497]
2025-10-10T14:31:10.966748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 64, pipe: [1:7559600587439169599:2497]
2025-10-10T14:31:11.003253Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:11.003468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.003483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.003532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600587439169599:2497], now have 1 active actors on pipe
2025-10-10T14:31:11.003730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:11.003742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:11.003751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:11.003748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:11.003794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600587439169599:2497]
2025-10-10T14:31:11.003800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 65 reason: error at write: Disconnected sessionId: src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0
2025-10-10T14:31:11.003974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 65 sessionId: src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0 is DEAD
2025-10-10T14:31:11.004135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:11.004147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0] Write session will restart in 0.008850s
2025-10-10T14:31:11.004172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0] Write session: Do CDS request
2025-10-10T14:31:11.004179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:11.012259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:11.012624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:11.012762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:11.012770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:11.012779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:11.012812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:11.012843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600590951928100:2686]
2025-10-10T14:31:11.013259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:11.013516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:11.013557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:11.013752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.013844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:11.013863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:11.013876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 66
2025-10-10T14:31:11.013899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.013904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.013905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.013906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.013907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.013907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.013908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.013909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.013909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.013910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.013911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.013911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.013912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.013916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.013925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.013927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.013930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.013932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.013934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.013936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.013939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.013941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.013943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.013945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.013947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.013949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.013955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.013961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.013968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.013973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.013977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.013982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.013986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.013990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.014011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.014045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 66 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:11.013995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.014000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.014050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=66 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:11.014005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.014010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.014053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:11.014014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.014038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.014042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.014047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.014050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.014054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.014058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.014062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.014068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.014073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.014077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.014083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.014088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.014093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.014125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:11.014391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 66 sessionId:  describe result for acl check
2025-10-10T14:31:11.014416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:11.014420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:11.014421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:11.014425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600591734136982:2864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:11.014875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600591734136982:2864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:11.016214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:11.016516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:11.016524Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:11.016526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:11.016528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:11.016533Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 65 [2:7559600590951928100:2686]
2025-10-10T14:31:11.016541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:11.016554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:11.016555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.016558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.016559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.016569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:11.016574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:11.016580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:11.016621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.016626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.016627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.016629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:11.016691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:11.016697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.016704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.016718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.016729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:11.016749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734136897:2438], now have 1 active actors on pipe
2025-10-10T14:31:11.016758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600590951928095:2686]
2025-10-10T14:31:11.016760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600590951928095:2686]
2025-10-10T14:31:11.016761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600590951928095:2686]
2025-10-10T14:31:11.016765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600591734136982:2864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:11.016770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:11.016782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:11.016788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:11.016791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:11.016792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:11.016793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:11.016794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:11.016811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600590951928095:2686]
2025-10-10T14:31:11.016817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:11.016819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:11.016826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 65
2025-10-10T14:31:11.021539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600591734136982:2864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:11.021551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600591734136982:2864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:11.021555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600591734136982:2864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:11.021563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 66 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:11.021794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137016:2864], now have 1 active actors on pipe
2025-10-10T14:31:11.021838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 65
2025-10-10T14:31:11.021893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.021902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.021927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1546634b-d2276c77-b7697868-5d3969b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:11.021940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.021945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.021946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:11.021957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.021974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:11.021992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.022173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.022186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.022209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.022308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 66 partition: 0 MaxSeqNo: 40 sessionId: src_id|1546634b-d2276c77-b7697868-5d3969b1_0
2025-10-10T14:31:11.022671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf02297-4d2ba33a-f158acde-96b3c6b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1546634b-d2276c77-b7697868-5d3969b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:11.025324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1546634b-d2276c77-b7697868-5d3969b1_0] Write session: try to update token
2025-10-10T14:31:11.025364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1546634b-d2276c77-b7697868-5d3969b1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:11.030855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:11.030868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.030876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600590951928095:2686]
2025-10-10T14:31:11.030920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:11.030937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:11.031078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:11.031232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.031365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.031499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.031683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:11.031717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:11.039097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId: src_id|1546634b-d2276c77-b7697868-5d3969b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:11.041415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:11.041625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.041643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.041683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:11.041760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:11.045110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:11.045125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.045127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:11.045128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:11.045138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600590951928095:2686]
2025-10-10T14:31:11.045141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600590951928095:2686]
2025-10-10T14:31:11.045147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600590951928095:2686]
2025-10-10T14:31:11.045185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:11.045195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.045196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:11.045204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:11.045211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:11.045216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:11.045354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:11.104208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600591734137031:2497]
2025-10-10T14:31:11.104497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 65, pipe: [1:7559600591734137031:2497]
2025-10-10T14:31:11.149078Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:11.156000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.156021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.156191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.156256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.156314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.156379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.156421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.156428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.156491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.156546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.156604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.156667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.156714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.156722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.156790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.156852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.156913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.156973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.157015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.157021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.157080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.157137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.157208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.157276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.157316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.157321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.157400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.157464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.157528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.157583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.157624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.157629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.157690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.157745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.157804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.157863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.157904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.157909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.157968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.158038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.158102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.158161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.158211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.158216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.158281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.158336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.158391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.158448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.158492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.158499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.158560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.158614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.158672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.158734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.158773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.158778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.158837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.158890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.158944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.158999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.159038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.159044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.159084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137031:2497], now have 1 active actors on pipe
2025-10-10T14:31:11.159330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:11.159345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:11.159358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600591734137031:2497]
2025-10-10T14:31:11.159374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 66 reason: error at write: Disconnected sessionId: src_id|1546634b-d2276c77-b7697868-5d3969b1_0
2025-10-10T14:31:11.159384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:11.159593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 66 sessionId: src_id|1546634b-d2276c77-b7697868-5d3969b1_0 is DEAD
2025-10-10T14:31:11.159729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546634b-d2276c77-b7697868-5d3969b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:11.159742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546634b-d2276c77-b7697868-5d3969b1_0] Write session will restart in 0.009062s
2025-10-10T14:31:11.159768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546634b-d2276c77-b7697868-5d3969b1_0] Write session: Do CDS request
2025-10-10T14:31:11.159775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546634b-d2276c77-b7697868-5d3969b1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:11.159902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:11.169264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:11.169711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:11.169849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1546634b-d2276c77-b7697868-5d3969b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.169884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:11.169895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:11.169905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:11.169947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:11.169937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:11.169959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 67
2025-10-10T14:31:11.169988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600590951928233:2689]
2025-10-10T14:31:11.170067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.170104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 67 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:11.170115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=67 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:11.170120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:11.170435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:11.170444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 67 sessionId:  describe result for acl check
2025-10-10T14:31:11.170474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:11.170480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:11.170482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:11.170486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600591734137115:2869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:11.170682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:11.170730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:11.170941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600591734137115:2869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:11.170981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:11.171026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.171032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.171033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.171034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.171034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.171035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.171036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.171037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.171037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.171038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.171038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.171039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.171039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.171043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.171051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.171053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.171056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.171058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.171061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.171063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.171065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.171067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.171070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.171072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.171074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.171077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.171082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.171087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.171093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.171096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.171098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.171102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.171104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.171107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.171110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.171113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.171115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.171118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.171122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.171125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.171128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.171131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.171134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.171136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.171139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.171142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.171145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.171149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.171152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.171155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.171157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.171160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.171183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:11.173404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:11.173613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600591734137115:2869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:11.173726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:11.173737Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:11.173739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:11.173742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:11.173748Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 66 [2:7559600590951928233:2689]
2025-10-10T14:31:11.173769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:11.173786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:11.173793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.173797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.173800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.173816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:11.173827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:11.173835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:11.173894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.173901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.173903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.173905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:11.173972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:11.173980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.173991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.174005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.174037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:11.174064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137033:2438], now have 1 active actors on pipe
2025-10-10T14:31:11.174075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600590951928228:2689]
2025-10-10T14:31:11.174078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600590951928228:2689]
2025-10-10T14:31:11.174080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600590951928228:2689]
2025-10-10T14:31:11.174076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 66
2025-10-10T14:31:11.174094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:11.174112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:11.174114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:11.174117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:11.174119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:11.174126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:11.174129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:11.174162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600590951928228:2689]
2025-10-10T14:31:11.174170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:11.174184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:11.179070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600591734137115:2869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:11.179086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600591734137115:2869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:11.179089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600591734137115:2869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:11.179098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 67 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:11.179347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137153:2869], now have 1 active actors on pipe
2025-10-10T14:31:11.179396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 66
2025-10-10T14:31:11.179441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.179470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.179509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:11.179528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.179539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.179542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:11.179558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.179581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:11.179606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.179757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.179768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.179785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.179867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 67 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0
2025-10-10T14:31:11.180247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546634b-d2276c77-b7697868-5d3969b1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:11.182862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0] Write session: try to update token
2025-10-10T14:31:11.182886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:11.185403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:11.185419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.185429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600590951928228:2689]
2025-10-10T14:31:11.185469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:11.185478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:11.185652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:11.185802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.185943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.186131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.186324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:11.186370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:11.197284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId: src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0 grpc read done: success: 1 data:  write_request[data omitted]
E1010 14:31:11.198877233 2322774 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:7170: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:31:11.199650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:11.199898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.199924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.199966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:11.200037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:11.202571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:11.202588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.202591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:11.202593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:11.202604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600590951928228:2689]
2025-10-10T14:31:11.202608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600590951928228:2689]
2025-10-10T14:31:11.202612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600590951928228:2689]
2025-10-10T14:31:11.202657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:11.202662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:11.202669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.202670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:11.202671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:11.202674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:11.202819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:11.259311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600591734137159:2497]
2025-10-10T14:31:11.259540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 66, pipe: [1:7559600591734137159:2497]
2025-10-10T14:31:11.308236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:11.314981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.315004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.315156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.315223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.315285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.315342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.315383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.315390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.315449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.315505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.315564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.315634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.315683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.315691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.315759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.315822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.315890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.315947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.315993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.315999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.316058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.316114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.316169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.316227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.316274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.316284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.316349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.316405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.316517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.316572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.316610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.316616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.316673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.316731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.316786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.316842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.316883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.316888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.316943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.316995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.317050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.317106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.317145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.317150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.317206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.317258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.317318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.317397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.317436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.317441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.317498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.317553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.317609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.317665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.317703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.317708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.317765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.317817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.317870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.317923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.317968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.317976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.318021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137159:2497], now have 1 active actors on pipe
2025-10-10T14:31:11.318260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:11.318264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600591734137159:2497]
2025-10-10T14:31:11.318292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:11.318295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:11.318335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 67 reason: error at write: Disconnected sessionId: src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0
2025-10-10T14:31:11.318537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 67 sessionId: src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0 is DEAD
2025-10-10T14:31:11.318688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:11.318700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0] Write session will restart in 0.007282s
2025-10-10T14:31:11.318725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0] Write session: Do CDS request
2025-10-10T14:31:11.318732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:11.318734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:11.326934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.326990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:11.327003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 68
2025-10-10T14:31:11.327202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.327247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 68 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:11.327251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=68 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:11.327254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:11.327683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 68 sessionId:  describe result for acl check
2025-10-10T14:31:11.327723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:11.327725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:11.327727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:11.327733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600591734137243:2875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:11.327811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:11.328202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600591734137243:2875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:11.328447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:11.328628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:11.328639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:11.328651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:11.328702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:11.328741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600590951928355:2691]
2025-10-10T14:31:11.329270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:11.329556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:11.329587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:11.329837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:11.329875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.329879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.329880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.329881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.329881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.329882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.329883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.329884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.329884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.329885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.329886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.329886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.329887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.329890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.329897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.329900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.329902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.329904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.329907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.329909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.329911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.329914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.329916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.329918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.329921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.329923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.329928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.329933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.329938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.329941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.329943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.329947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.329950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.329954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.329958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.329963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.329967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.329971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.329976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.329981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.329987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.329990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.329993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.329996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.329998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.330001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.330006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.330011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.330015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.330020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.330035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.330039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.330064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:11.330509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600591734137243:2875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:11.332100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:11.332391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:11.332402Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:11.332405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:11.332408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:11.332413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 67 [2:7559600590951928355:2691]
2025-10-10T14:31:11.332423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:11.332442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:11.332449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.332452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.332454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.332468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:11.332479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:11.332485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:11.332536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.332542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.332544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.332547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:11.332525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600591734137243:2875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:11.332538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600591734137243:2875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:11.332541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600591734137243:2875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:11.332547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 68 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:11.332621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:11.332628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.332639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.332655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.332676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:11.332678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 67
2025-10-10T14:31:11.332704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137161:2438], now have 1 active actors on pipe
2025-10-10T14:31:11.332716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600590951928350:2691]
2025-10-10T14:31:11.332722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600590951928350:2691]
2025-10-10T14:31:11.332724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600590951928350:2691]
2025-10-10T14:31:11.332737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 67
2025-10-10T14:31:11.332736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:11.332750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:11.332755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137278:2875], now have 1 active actors on pipe
2025-10-10T14:31:11.332757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:11.332759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:11.332760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:11.332770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:11.332773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:11.332802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.332812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.332826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600590951928350:2691]
2025-10-10T14:31:11.332838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:11.332854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:11.332865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d14edd48-8e24d342-d750029-ff39f241_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:11.332877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.332881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.332883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:11.332892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.332905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:11.332930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.333040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.333048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.333064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.333168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 68 partition: 0 MaxSeqNo: 40 sessionId: src_id|d14edd48-8e24d342-d750029-ff39f241_0
2025-10-10T14:31:11.333455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf015c95-32927550-9c7e1a6f-f03019d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d14edd48-8e24d342-d750029-ff39f241_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:11.335884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d14edd48-8e24d342-d750029-ff39f241_0] Write session: try to update token
2025-10-10T14:31:11.335898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d14edd48-8e24d342-d750029-ff39f241_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:11.350753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId: src_id|d14edd48-8e24d342-d750029-ff39f241_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:11.351029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:11.351048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.351052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:11.351054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:11.351063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600590951928350:2691]
2025-10-10T14:31:11.351066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600590951928350:2691]
2025-10-10T14:31:11.351069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600590951928350:2691]
2025-10-10T14:31:11.351107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:11.351113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.351115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:11.351115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:11.351121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:11.351126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:11.351237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:11.353101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:11.418556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600591734137285:2497]
2025-10-10T14:31:11.418838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 67, pipe: [1:7559600591734137285:2497]
2025-10-10T14:31:11.454626Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:11.454976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.454994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.455037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137285:2497], now have 1 active actors on pipe
2025-10-10T14:31:11.455193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:11.455258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600591734137285:2497]
2025-10-10T14:31:11.455262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:11.455288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:11.455336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 68 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d14edd48-8e24d342-d750029-ff39f241_0
2025-10-10T14:31:11.455547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 68 sessionId: src_id|d14edd48-8e24d342-d750029-ff39f241_0 is DEAD
2025-10-10T14:31:11.455700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d14edd48-8e24d342-d750029-ff39f241_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:11.455711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d14edd48-8e24d342-d750029-ff39f241_0] Write session will restart in 0.007906s
2025-10-10T14:31:11.455736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d14edd48-8e24d342-d750029-ff39f241_0] Write session: Do CDS request
2025-10-10T14:31:11.455743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d14edd48-8e24d342-d750029-ff39f241_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:11.463382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:11.463855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:11.464040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:11.464054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:11.464068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:11.464128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:11.464173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600590951928478:2693]
2025-10-10T14:31:11.464760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:11.464799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d14edd48-8e24d342-d750029-ff39f241_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.464835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:11.464848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 69
2025-10-10T14:31:11.465024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.465061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 69 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:11.465071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=69 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:11.465080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:11.465093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:11.465144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:11.465483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:11.465495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 69 sessionId:  describe result for acl check
2025-10-10T14:31:11.465528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:11.465533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:11.465535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:11.465541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600591734137372:2879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:11.465554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.465561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.465562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.465563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.465564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.465565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.465566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.465567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.465568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.465570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.465571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.465572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.465573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.465579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.465593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.465597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.465601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.465606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.465610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.465614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.465622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.465626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.465635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.465644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.465648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.465656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.465663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.465677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.465688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.465698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.465703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.465708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.465717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.465727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.465737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.465747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.465755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.465765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.465774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.465784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.465792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.465799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.465809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.465814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.465822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.465832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.465837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.465846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.465854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.465863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.465872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.465878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.465925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:11.466071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600591734137372:2879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:11.468041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600591734137372:2879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:11.468119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:11.468425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:11.468440Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:11.468442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:11.468446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:11.468451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 68 [2:7559600590951928478:2693]
2025-10-10T14:31:11.468463Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:11.468484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:11.468492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.468495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.468497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.468510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:11.468523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:11.468532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:11.468587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.468594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.468596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.468599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:11.468661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:11.468669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.468683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.468701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.468719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:11.468740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137286:2438], now have 1 active actors on pipe
2025-10-10T14:31:11.468752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600590951928473:2693]
2025-10-10T14:31:11.468754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600590951928473:2693]
2025-10-10T14:31:11.468757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600590951928473:2693]
2025-10-10T14:31:11.468755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 68
2025-10-10T14:31:11.468772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:11.468790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:11.468790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:11.468794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:11.468796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:11.468811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:11.468814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:11.468839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600590951928473:2693]
2025-10-10T14:31:11.468851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:11.468871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:11.473474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600591734137372:2879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:11.473488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600591734137372:2879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:11.473492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600591734137372:2879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:11.473500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 69 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:11.473763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137407:2879], now have 1 active actors on pipe
2025-10-10T14:31:11.473792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 68
2025-10-10T14:31:11.473840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.473852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.473884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:11.473899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.473904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.473906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:11.473919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.473938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:11.473958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.474121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.474132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.474150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.474223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 69 partition: 0 MaxSeqNo: 40 sessionId: src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0
2025-10-10T14:31:11.474527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d14edd48-8e24d342-d750029-ff39f241_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:11.477144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0] Write session: try to update token
2025-10-10T14:31:11.477162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:11.479463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:11.479481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.479491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600590951928473:2693]
2025-10-10T14:31:11.479535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:11.479541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:11.479713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:11.479862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.480010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.480151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.480338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:11.480378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:11.491249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId: src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:11.493524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:11.493724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.493748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.493791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:11.493894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:11.496270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:11.496290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.496293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:11.496295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:11.496306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600590951928473:2693]
2025-10-10T14:31:11.496311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600590951928473:2693]
2025-10-10T14:31:11.496314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600590951928473:2693]
2025-10-10T14:31:11.496361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:11.496364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:11.496371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:11.496373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.496375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:11.496376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:11.496502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:11.555242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600591734137446:2497]
2025-10-10T14:31:11.555385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 68, pipe: [1:7559600591734137446:2497]
2025-10-10T14:31:11.615440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:11.623341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.623368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.623537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.623612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.623676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.623735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.623784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.623793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.623859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.623921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.623984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.624049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.624090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.624098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.624161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.624223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.624288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.624348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.624721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.624736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.624803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.624869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.624932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.624991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.625035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.625043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.625109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.625171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.625239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.625300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.625360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.625368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.625437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.625497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.625564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.625633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.625679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.625686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.625748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.625809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.625875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.625936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.625981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.625988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.626066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.626126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.626183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.626241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.626285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.626293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.626353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.626408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.626467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.626622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.626664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.626671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.626733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.626792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.626850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.626913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.626959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.626971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.627028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137446:2497], now have 1 active actors on pipe
2025-10-10T14:31:11.627244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:11.627269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:11.627299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 69 reason: error at write: Disconnected sessionId: src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0
2025-10-10T14:31:11.627402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:11.627523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 69 sessionId: src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0 is DEAD
2025-10-10T14:31:11.627641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600591734137446:2497]
2025-10-10T14:31:11.627664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:11.627679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:11.627689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0] Write session will restart in 0.007767s
2025-10-10T14:31:11.627707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0] Write session: Do CDS request
2025-10-10T14:31:11.627712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:11.635153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:11.635578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:11.635753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:11.635765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:11.635776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:11.635832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:11.635874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600590951928642:2709]
2025-10-10T14:31:11.636447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:11.636764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:11.636817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:11.636902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.636941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:11.636958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 70
2025-10-10T14:31:11.637123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:11.637152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.637191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 70 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:11.637187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.637194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.637202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=70 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:11.637195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.637210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:11.637196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.637198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.637199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.637200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.637201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.637203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.637204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.637205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.637206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.637207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.637214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.637226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.637230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.637234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.637238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.637241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.637245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.637249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.637253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.637257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.637261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.637264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.637268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.637277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.637285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.637291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.637296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.637302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.637310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.637314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.637320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.637327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.637351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.637358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.637363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.637368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.637375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.637378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.637383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.637388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.637399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.637403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.637408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.637413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.637424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.637428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.637433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.637438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.637444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.637485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:11.637635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 70 sessionId:  describe result for acl check
2025-10-10T14:31:11.637671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:11.637678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:11.637680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:11.637686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600591734137538:2894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:11.638231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600591734137538:2894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:11.639603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:11.639901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:11.639911Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:11.639913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:11.639916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:11.639922Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 69 [2:7559600590951928642:2709]
2025-10-10T14:31:11.639932Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:11.639945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:11.639948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.639950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.639952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.639966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:11.639973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:11.639979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:11.639981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600591734137538:2894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:11.640025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.640032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.640033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.640035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:11.640081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:11.640087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.640096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.640107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.640128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:11.640153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137450:2438], now have 1 active actors on pipe
2025-10-10T14:31:11.640165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600590951928637:2709]
2025-10-10T14:31:11.640171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600590951928637:2709]
2025-10-10T14:31:11.640173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600590951928637:2709]
2025-10-10T14:31:11.640185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:11.640201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:11.640203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:11.640206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:11.640207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:11.640220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:11.640227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:11.640212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 69
2025-10-10T14:31:11.640246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600590951928637:2709]
2025-10-10T14:31:11.640255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:11.640259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:11.644821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600591734137538:2894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:11.644835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600591734137538:2894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:11.644838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600591734137538:2894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:11.644846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 70 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:11.645112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137573:2894], now have 1 active actors on pipe
2025-10-10T14:31:11.645127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 69
2025-10-10T14:31:11.645200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.645211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.645246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:11.645264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.645270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.645272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:11.645285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.645299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:11.645315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.645441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.645449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.645463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.645510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 70 partition: 0 MaxSeqNo: 40 sessionId: src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0
2025-10-10T14:31:11.645821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5a21209-4f5b3108-b49e4257-1a87bd33_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:11.648536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0] Write session: try to update token
2025-10-10T14:31:11.648556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:11.650841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:11.650854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.650863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600590951928637:2709]
2025-10-10T14:31:11.650908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:11.650911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:11.651078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:11.651224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.651378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.651530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:11.651720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:11.651763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:11.662295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId: src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:11.664682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:11.664882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.664903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.664943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:11.665040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:11.667796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:11.667817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.667820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:11.667821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:11.667833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600590951928637:2709]
2025-10-10T14:31:11.667838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600590951928637:2709]
2025-10-10T14:31:11.667842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600590951928637:2709]
2025-10-10T14:31:11.667883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:11.667893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:11.667893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:11.667896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:11.667900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.667903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:11.668081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:11.727804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600591734137577:2497]
2025-10-10T14:31:11.728038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 69, pipe: [1:7559600591734137577:2497]
2025-10-10T14:31:11.777292Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:11.787192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.787222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.787421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.787500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.787577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.787653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.787717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.787728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.787811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.787884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.787959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.788036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.788094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.788104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.788183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.788251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.788329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.788401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.788462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.788471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.788549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.788628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.788706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.788780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.788839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.788848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.788926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.788995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.789072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.789146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.789202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.789211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.789289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.789376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.789451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.789528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.789594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.789603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.789678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.789754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.789829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.789901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.789965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.789975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.790063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.790135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.790209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.790282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.790339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.790347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.790423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.790491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.790562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.790636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.790696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.790705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.790784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:11.790858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:11.790935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:11.791015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:11.791070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:11.791079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:11.791144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137577:2497], now have 1 active actors on pipe
2025-10-10T14:31:11.791351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:11.791406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:11.791411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:11.791438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 70 reason: error at write: Disconnected sessionId: src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0
2025-10-10T14:31:11.791493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600591734137577:2497]
2025-10-10T14:31:11.791639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 70 sessionId: src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0 is DEAD
2025-10-10T14:31:11.791757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:11.791767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0] Write session will restart in 0.007765s
2025-10-10T14:31:11.791797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0] Write session: Do CDS request
2025-10-10T14:31:11.791802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:11.792284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:11.799718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:11.800092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:11.800216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:11.800225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:11.800231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:11.800258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:11.800293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600590951928766:2711]
2025-10-10T14:31:11.800660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:11.800840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.800895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:11.800922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:11.800947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:11.800957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 71
2025-10-10T14:31:11.801083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.801109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:11.801118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 71 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:11.801126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=71 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:11.801129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:11.801143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.801148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.801149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.801149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.801150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.801151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.801151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.801152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.801152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.801153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.801154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.801154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.801155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.801158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.801166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.801169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.801171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.801173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.801175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.801177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.801179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.801181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.801184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.801186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.801188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.801190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.801194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.801199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.801203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.801205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.801208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.801211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.801213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.801216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.801218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.801221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.801224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.801226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.801229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.801232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.801235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.801238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.801240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.801243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.801246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.801249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.801252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.801255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.801259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.801262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.801264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.801267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.801286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:11.801574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 71 sessionId:  describe result for acl check
2025-10-10T14:31:11.801612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:11.801619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:11.801621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:11.801627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600591734137668:2898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:11.802188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600591734137668:2898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:11.803495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:11.803893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:11.803902Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:11.803903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:11.803906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:11.803910Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 70 [2:7559600590951928766:2711]
2025-10-10T14:31:11.803918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:11.803928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:11.803930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.803933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.803934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.803943Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:11.803947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:11.803952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:11.803987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.803995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.803996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.803998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:11.804022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600591734137668:2898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:11.804042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:11.804049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.804055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.804061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.804070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:11.804081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600590951928761:2711]
2025-10-10T14:31:11.804087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600590951928761:2711]
2025-10-10T14:31:11.804088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600590951928761:2711]
2025-10-10T14:31:11.804095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:11.804104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:11.804107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:11.804111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:11.804112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:11.804113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:11.804113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:11.804119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137578:2438], now have 1 active actors on pipe
2025-10-10T14:31:11.804135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600590951928761:2711]
2025-10-10T14:31:11.804147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:11.804154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:11.804143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 70
2025-10-10T14:31:11.808442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600591734137668:2898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:11.808453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600591734137668:2898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:11.808456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600591734137668:2898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:11.808462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 71 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:11.808676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137702:2898], now have 1 active actors on pipe
2025-10-10T14:31:11.808732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 70
2025-10-10T14:31:11.808791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.808801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.808820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|734957fa-52b4390a-299af161-bbf57bf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:11.808833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.808841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.808843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:11.808853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.808863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:11.808875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.809008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.809014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.809023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.809098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 71 partition: 0 MaxSeqNo: 40 sessionId: src_id|734957fa-52b4390a-299af161-bbf57bf4_0
2025-10-10T14:31:11.809399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de5f4ba-7dba49bb-2ba37f23-a8411e6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|734957fa-52b4390a-299af161-bbf57bf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:11.811940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734957fa-52b4390a-299af161-bbf57bf4_0] Write session: try to update token
2025-10-10T14:31:11.811953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734957fa-52b4390a-299af161-bbf57bf4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:11.822440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:11.822458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.822460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:11.822463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:11.822471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600590951928761:2711]
2025-10-10T14:31:11.822480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600590951928761:2711]
2025-10-10T14:31:11.822485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600590951928761:2711]
2025-10-10T14:31:11.822533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:11.822540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.822542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:11.822558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:11.822574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:11.822578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:11.822695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:11.825399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId: src_id|734957fa-52b4390a-299af161-bbf57bf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:11.827709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:11.891618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600591734137706:2497]
2025-10-10T14:31:11.891901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 70, pipe: [1:7559600591734137706:2497]
2025-10-10T14:31:11.924653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:11.924927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.924940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.924976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137706:2497], now have 1 active actors on pipe
2025-10-10T14:31:11.925160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:11.925199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:11.925209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:11.925232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600591734137706:2497]
2025-10-10T14:31:11.925250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:11.925269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 71 reason: error at write: Disconnected sessionId: src_id|734957fa-52b4390a-299af161-bbf57bf4_0
2025-10-10T14:31:11.925438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 71 sessionId: src_id|734957fa-52b4390a-299af161-bbf57bf4_0 is DEAD
2025-10-10T14:31:11.925566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734957fa-52b4390a-299af161-bbf57bf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:11.925576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734957fa-52b4390a-299af161-bbf57bf4_0] Write session will restart in 0.009858s
2025-10-10T14:31:11.925593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734957fa-52b4390a-299af161-bbf57bf4_0] Write session: Do CDS request
2025-10-10T14:31:11.925598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734957fa-52b4390a-299af161-bbf57bf4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:11.933111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:11.933618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:11.933762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:11.933769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:11.933776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:11.933812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:11.933840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600590951928891:2713]
2025-10-10T14:31:11.934255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:11.934533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:11.934561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:11.934761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:11.934810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.934815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.934815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.934816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.934817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.934817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.934818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.934819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.934819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.934820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.934820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.934821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.934821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.934825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.934833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.934836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.934838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.934840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.934843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.934845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.934847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.934849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.934852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.934854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.934856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.934858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.934864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.934869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:11.934873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.934877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:11.934879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.934882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:11.934885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.934888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:11.934891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.934895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:11.934898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.934901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:11.934903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.934906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:11.934909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.934912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:11.934915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.934918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:11.934920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.934923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:11.934925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.934928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.934931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.934934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.934938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.934941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.934963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:11.936730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734957fa-52b4390a-299af161-bbf57bf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.936837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:11.936847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 72
2025-10-10T14:31:11.936952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:11.936976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 72 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:11.936984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=72 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:11.936987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:11.937012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:11.937298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:11.937306Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:11.937307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:11.937309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:11.937314Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 71 [2:7559600590951928891:2713]
2025-10-10T14:31:11.937321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:11.937345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:11.937346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.937348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.937350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.937359Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:11.937368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:11.937374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:11.937392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 72 sessionId:  describe result for acl check
2025-10-10T14:31:11.937411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.937415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.937417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.937418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:11.937422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:11.937427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:11.937428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:11.937432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600591734137799:2902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:11.937463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:11.937469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.937476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:11.937483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:11.937493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:11.937507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600590951928886:2713]
2025-10-10T14:31:11.937509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600590951928886:2713]
2025-10-10T14:31:11.937510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600590951928886:2713]
2025-10-10T14:31:11.937516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:11.937526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:11.937526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:11.937529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:11.937531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:11.937536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:11.937538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:11.937545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137707:2438], now have 1 active actors on pipe
2025-10-10T14:31:11.937558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600590951928886:2713]
2025-10-10T14:31:11.937564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:11.937576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:11.937576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 71
2025-10-10T14:31:11.937845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600591734137799:2902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:11.939296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600591734137799:2902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:11.944520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600591734137799:2902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:11.944533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600591734137799:2902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:11.944536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600591734137799:2902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:11.944543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 72 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:11.944760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600591734137832:2902], now have 1 active actors on pipe
2025-10-10T14:31:11.944816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 71
2025-10-10T14:31:11.944890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.944900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.944925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:11.944936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:11.944950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:11.944952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:11.944962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:11.944975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:11.944991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.945182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:11.945187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:11.945197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:11.945278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 72 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0
2025-10-10T14:31:11.945565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734957fa-52b4390a-299af161-bbf57bf4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:11.948040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0] Write session: try to update token
2025-10-10T14:31:11.948053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:11.955238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:11.955256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:11.955258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:11.955259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:11.955266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600590951928886:2713]
2025-10-10T14:31:11.955269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600590951928886:2713]
2025-10-10T14:31:11.955271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600590951928886:2713]
2025-10-10T14:31:11.955306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:11.955312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:11.955314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:11.955315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:11.955322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:11.955326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:11.955436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:11.962107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId: src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:11.964413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:12.025272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600596029105132:2497]
2025-10-10T14:31:12.025549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 71, pipe: [1:7559600596029105132:2497]
2025-10-10T14:31:12.054831Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:12.055149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.055165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.055186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105132:2497], now have 1 active actors on pipe
2025-10-10T14:31:12.055429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:12.055478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:12.055518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600596029105132:2497]
2025-10-10T14:31:12.055526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:12.055618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 72 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0
2025-10-10T14:31:12.055787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 72 sessionId: src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0 is DEAD
2025-10-10T14:31:12.055934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:12.055944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0] Write session will restart in 0.008152s
2025-10-10T14:31:12.055969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0] Write session: Do CDS request
2025-10-10T14:31:12.055974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:12.064614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:12.064790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.064906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:12.064917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 73
2025-10-10T14:31:12.065013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.065038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 73 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:12.065046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=73 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:12.065049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:12.065138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:12.065276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.065286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:12.065293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:12.065326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:12.065380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600595246896326:2716]
2025-10-10T14:31:12.065466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 73 sessionId:  describe result for acl check
2025-10-10T14:31:12.065496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:12.065501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:12.065503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:12.065508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600596029105233:2907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:12.065847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:12.065963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600596029105233:2907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:12.066184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:12.066236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:12.066536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:12.066604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.066614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.066615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.066615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.066616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.066617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.066618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.066619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.066620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.066621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.066622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.066623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.066624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.066629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.066640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.066644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.066647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.066650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.066653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.066657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.066661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.066665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.066669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.066673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.066677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.066681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.066688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.066696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.066702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.066706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.066711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.066716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.066721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.066726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.066731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.066735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.066747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.066753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.066764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.066768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.066772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.066777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.066781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.066785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.066789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.066799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.066805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.066815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.066819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.066825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.066831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.066836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.066875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:12.067999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600596029105233:2907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:12.069156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:12.069477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:12.069486Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:12.069489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:12.069493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:12.069499Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 72 [2:7559600595246896326:2716]
2025-10-10T14:31:12.069508Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:12.069524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:12.069529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.069531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.069533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.069547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:12.069554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:12.069562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:12.069618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.069623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.069624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.069626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:12.069678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:12.069684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.069691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.069697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.069707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:12.069728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600595246896321:2716]
2025-10-10T14:31:12.069732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600595246896321:2716]
2025-10-10T14:31:12.069734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600595246896321:2716]
2025-10-10T14:31:12.069740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:12.069751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:12.069756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105145:2438], now have 1 active actors on pipe
2025-10-10T14:31:12.069760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:12.069761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:12.069763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:12.069770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:12.069772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:12.069797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600595246896321:2716]
2025-10-10T14:31:12.069803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:12.069789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 72
2025-10-10T14:31:12.069812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:12.071006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600596029105233:2907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:12.071016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600596029105233:2907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:12.071019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600596029105233:2907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:12.071024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 73 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:12.071297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105271:2907], now have 1 active actors on pipe
2025-10-10T14:31:12.071348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 72
2025-10-10T14:31:12.071406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.071417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.071440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1d6576f-f2667575-9602f439-483f44ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:12.071451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.071455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.071457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:12.071465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.071475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:12.071494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.071657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.071663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.071674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.071740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 73 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1d6576f-f2667575-9602f439-483f44ef_0
2025-10-10T14:31:12.072000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7a8691-70a10784-25acdf46-bdf7aa20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1d6576f-f2667575-9602f439-483f44ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:12.074441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6576f-f2667575-9602f439-483f44ef_0] Write session: try to update token
2025-10-10T14:31:12.074454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6576f-f2667575-9602f439-483f44ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:12.087369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId: src_id|a1d6576f-f2667575-9602f439-483f44ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:12.088522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:12.088541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.088545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:12.088547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:12.088555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600595246896321:2716]
2025-10-10T14:31:12.088559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600595246896321:2716]
2025-10-10T14:31:12.088561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600595246896321:2716]
2025-10-10T14:31:12.088598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:12.088604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.088606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:12.088606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:12.088612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:12.088617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:12.088722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:12.089945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:12.155814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600596029105275:2497]
2025-10-10T14:31:12.156045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 72, pipe: [1:7559600596029105275:2497]
2025-10-10T14:31:12.203768Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:12.204172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.204187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.204233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105275:2497], now have 1 active actors on pipe
2025-10-10T14:31:12.204464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:12.204472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:12.204478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600596029105275:2497]
2025-10-10T14:31:12.204504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:12.204506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:12.204571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 73 reason: error at write: Disconnected sessionId: src_id|a1d6576f-f2667575-9602f439-483f44ef_0
2025-10-10T14:31:12.204750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 73 sessionId: src_id|a1d6576f-f2667575-9602f439-483f44ef_0 is DEAD
2025-10-10T14:31:12.204889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6576f-f2667575-9602f439-483f44ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:12.204900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6576f-f2667575-9602f439-483f44ef_0] Write session will restart in 0.006330s
2025-10-10T14:31:12.204924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6576f-f2667575-9602f439-483f44ef_0] Write session: Do CDS request
2025-10-10T14:31:12.204930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6576f-f2667575-9602f439-483f44ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:12.212819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6576f-f2667575-9602f439-483f44ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.213188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:12.213200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 74
2025-10-10T14:31:12.213365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.213419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 74 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:12.213430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=74 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:12.213434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:12.213471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:12.213843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 74 sessionId:  describe result for acl check
2025-10-10T14:31:12.213870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:12.213875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:12.213876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:12.213882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600596029105365:2911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:12.214008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:12.214150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.214160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:12.214169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:12.214203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:12.214238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600595246896454:2718]
2025-10-10T14:31:12.214313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600596029105365:2911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:12.215001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:12.215222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:12.215250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:12.215488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:12.215537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.215542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.215543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.215543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.215544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.215545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.215545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.215546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.215546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.215547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.215548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.215548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.215549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.215553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.215560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.215562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.215564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.215566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.215568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.215570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.215572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.215574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.215577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.215579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.215580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.215582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.215588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.215593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.215598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.215602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.215604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.215608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.215610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.215613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.215616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.215619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.215621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.215625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.215627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.215631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.215634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.215637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.215642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.215645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.215648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.215651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.215653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.215656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.215659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.215662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.215665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.215668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.215695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:12.215780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600596029105365:2911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:12.217723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600596029105365:2911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:12.217733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600596029105365:2911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:12.217721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:12.217736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600596029105365:2911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:12.217741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 74 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:12.218138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:12.218146Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:12.218148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:12.218150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:12.218155Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 73 [2:7559600595246896454:2718]
2025-10-10T14:31:12.218163Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:12.218175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:12.218180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.218182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.218183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.218194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:12.218199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:12.218209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:12.218248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.218252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.218254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.218255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:12.218315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:12.218321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.218333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.218349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.218364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:12.218385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105276:2438], now have 1 active actors on pipe
2025-10-10T14:31:12.218392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105399:2911], now have 1 active actors on pipe
2025-10-10T14:31:12.218397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600595246896449:2718]
2025-10-10T14:31:12.218399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600595246896449:2718]
2025-10-10T14:31:12.218400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600595246896449:2718]
2025-10-10T14:31:12.218411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:12.218428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:12.218415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 73
2025-10-10T14:31:12.218417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 73
2025-10-10T14:31:12.218437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:12.218439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:12.218441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:12.218448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:12.218450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:12.218461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600595246896449:2718]
2025-10-10T14:31:12.218462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:12.218465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:12.218478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.218485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.218521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:12.218530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.218533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.218534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:12.218542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.218554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:12.218567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.218681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.218689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.218707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.219969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 74 partition: 0 MaxSeqNo: 40 sessionId: src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0
2025-10-10T14:31:12.220284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1d6576f-f2667575-9602f439-483f44ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:12.222860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0] Write session: try to update token
2025-10-10T14:31:12.222875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:12.236814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:12.236834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.236838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:12.236840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:12.236850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600595246896449:2718]
2025-10-10T14:31:12.236855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600595246896449:2718]
2025-10-10T14:31:12.236863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600595246896449:2718]
2025-10-10T14:31:12.236908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:12.236913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:12.236918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:12.236921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.236923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:12.236923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:12.236903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId: src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:12.237091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:12.239555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:12.304835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600596029105406:2497]
2025-10-10T14:31:12.305114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 73, pipe: [1:7559600596029105406:2497]
2025-10-10T14:31:12.348922Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:12.349181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.349194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.349234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105406:2497], now have 1 active actors on pipe
2025-10-10T14:31:12.349419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:12.349539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:12.349549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600596029105406:2497]
2025-10-10T14:31:12.349576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:12.349655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 74 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0
2025-10-10T14:31:12.349875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 74 sessionId: src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0 is DEAD
2025-10-10T14:31:12.350021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:12.350052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0] Write session will restart in 0.008400s
2025-10-10T14:31:12.350078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0] Write session: Do CDS request
2025-10-10T14:31:12.350085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:12.357902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:12.358444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:12.358593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.358601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:12.358611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:12.358655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:12.358692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600595246896583:2720]
2025-10-10T14:31:12.359118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:12.359353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:12.359381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:12.359602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:12.359644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.359649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.359650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.359650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.359651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.359651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.359652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.359653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.359653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.359654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.359654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.359655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.359655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.359659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.359667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.359670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.359672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.359674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.359677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.359679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.359681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.359683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.359685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.359687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.359689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.359691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.359698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.359703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.359708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.359711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.359713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.359716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.359719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.359722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.359725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.359728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.359731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.359734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.359736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.359739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.359742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.359745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.359748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.359751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.359754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.359757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.359759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.359763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.359770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.359773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.359778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.359784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.359806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:12.359915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.360025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:12.360037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 75
2025-10-10T14:31:12.360156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.360181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 75 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:12.360189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=75 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:12.360194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:12.360581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 75 sessionId:  describe result for acl check
2025-10-10T14:31:12.360615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:12.360623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:12.360625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:12.360631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600596029105502:2915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:12.361082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600596029105502:2915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:12.361880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:12.362214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:12.362224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:12.362226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:12.362228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:12.362232Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 74 [2:7559600595246896583:2720]
2025-10-10T14:31:12.362240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:12.362253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:12.362254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.362257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.362258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.362269Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:12.362275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:12.362281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:12.362330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.362335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.362336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.362338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:12.362386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:12.362391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.362398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.362405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.362421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:12.362445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105408:2438], now have 1 active actors on pipe
2025-10-10T14:31:12.362456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600595246896578:2720]
2025-10-10T14:31:12.362457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600595246896578:2720]
2025-10-10T14:31:12.362459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600595246896578:2720]
2025-10-10T14:31:12.362468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:12.362484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:12.362487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:12.362490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:12.362491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:12.362494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:12.362496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:12.362514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600595246896578:2720]
2025-10-10T14:31:12.362516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:12.362518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:12.362512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 74
2025-10-10T14:31:12.362975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600596029105502:2915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:12.368935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600596029105502:2915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:12.368949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600596029105502:2915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:12.368952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600596029105502:2915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:12.368960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 75 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:12.369213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105536:2915], now have 1 active actors on pipe
2025-10-10T14:31:12.369289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 74
2025-10-10T14:31:12.369353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.369365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.369397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:12.369412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.369421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.369423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:12.369435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.369453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:12.369472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.369650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.369658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.369672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.369753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 75 partition: 0 MaxSeqNo: 40 sessionId: src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0
2025-10-10T14:31:12.370140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a281e8b7-cd56afa3-f0f2d3d-ea14b3cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:12.373061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0] Write session: try to update token
2025-10-10T14:31:12.373079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:12.378980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:12.378995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.379004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600595246896578:2720]
2025-10-10T14:31:12.379053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:12.379059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:12.379216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:12.379347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:12.379488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:12.379624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:12.379809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:12.379847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:12.387684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId: src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:12.390290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:12.390973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.390998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.391023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:12.391027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.391030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:12.391039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:12.391049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600595246896578:2720]
2025-10-10T14:31:12.391058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600595246896578:2720]
2025-10-10T14:31:12.391062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600595246896578:2720]
2025-10-10T14:31:12.391105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:12.391121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:12.391125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:12.391125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:12.391132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.391135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:12.391271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:12.449747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600596029105539:2497]
2025-10-10T14:31:12.450058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 74, pipe: [1:7559600596029105539:2497]
2025-10-10T14:31:12.496276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:12.496667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:12.496708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105539:2497], now have 1 active actors on pipe
2025-10-10T14:31:12.496807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:12.496892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600596029105539:2497]
2025-10-10T14:31:12.496927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:12.506342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:12.506356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:12.506384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 75 reason: error at write: Disconnected sessionId: src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0
2025-10-10T14:31:12.506534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 75 sessionId: src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0 is DEAD
2025-10-10T14:31:12.506663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:12.506673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0] Write session will restart in 0.005868s
2025-10-10T14:31:12.506691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0] Write session: Do CDS request
2025-10-10T14:31:12.506706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:12.510790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:12.511492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:12.511691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.511704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:12.511716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:12.511768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:12.511815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600595246896714:2722]
2025-10-10T14:31:12.512294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:12.512566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:12.512610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:12.512921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:12.512983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.512990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.512991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.512992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.512994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.512995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.512996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.512998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.512999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.513001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.513002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.513003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.513004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.513010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.513023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.513028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.513033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.513037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.513041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.513045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.513049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.513053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.513058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.513062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.513066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.513070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.513077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.513086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.513093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.513099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.513103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.513109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.513114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.513119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.513124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.513131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.513135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.513140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.513145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.513151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.513155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.513160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.513164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.513170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.513175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.513181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.513190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.513195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.513204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.513210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.513214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.513219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.513265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:12.513813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.513945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:12.513962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 76
2025-10-10T14:31:12.514086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.514112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 76 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:12.514120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=76 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:12.514124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:12.514444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 76 sessionId:  describe result for acl check
2025-10-10T14:31:12.514470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:12.514476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:12.514477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:12.514481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600596029105637:2919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:12.515102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600596029105637:2919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:12.515650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:12.515965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:12.515977Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:12.515979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:12.515981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:12.515986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 75 [2:7559600595246896714:2722]
2025-10-10T14:31:12.515994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:12.516011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:12.516019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.516022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.516024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.516041Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:12.516048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:12.516059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:12.516108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.516115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.516117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.516120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:12.516188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:12.516196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.516208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.516221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.516244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:12.516270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105541:2438], now have 1 active actors on pipe
2025-10-10T14:31:12.516279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 75
2025-10-10T14:31:12.516286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600595246896709:2722]
2025-10-10T14:31:12.516288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600595246896709:2722]
2025-10-10T14:31:12.516290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600595246896709:2722]
2025-10-10T14:31:12.516307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:12.516322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:12.516330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:12.516338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:12.516340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:12.516345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:12.516348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:12.516373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600595246896709:2722]
2025-10-10T14:31:12.516382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:12.516390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:12.517255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600596029105637:2919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:12.522682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600596029105637:2919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:12.522697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600596029105637:2919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:12.522701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600596029105637:2919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:12.522710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 76 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:12.522936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105675:2919], now have 1 active actors on pipe
2025-10-10T14:31:12.522984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 75
2025-10-10T14:31:12.523055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.523071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.523105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:12.523121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.523131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.523135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:12.523149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.523167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:12.523186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.523402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.523408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.523420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.523510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 76 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0
2025-10-10T14:31:12.523901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34399515-ff153e7e-daddc29a-7bc0a1fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:12.526485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0] Write session: try to update token
2025-10-10T14:31:12.526501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:12.536346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:12.536369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.536372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:12.536374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:12.536385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600595246896709:2722]
2025-10-10T14:31:12.536390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600595246896709:2722]
2025-10-10T14:31:12.536393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600595246896709:2722]
2025-10-10T14:31:12.536451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:12.536451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:12.536458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:12.536461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:12.536465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.536467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:12.536642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:12.542628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId: src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:12.545155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:12.597222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600596029105706:2497]
2025-10-10T14:31:12.597513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 75, pipe: [1:7559600596029105706:2497]
2025-10-10T14:31:12.642899Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:12.643291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.643303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.643325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105706:2497], now have 1 active actors on pipe
2025-10-10T14:31:12.643496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:12.643543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600596029105706:2497]
2025-10-10T14:31:12.643577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:12.643971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:12.644042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 76 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0
2025-10-10T14:31:12.644259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 76 sessionId: src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0 is DEAD
2025-10-10T14:31:12.644416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:12.644423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0] Write session will restart in 0.008993s
2025-10-10T14:31:12.644442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0] Write session: Do CDS request
2025-10-10T14:31:12.644447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:12.651902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:12.652378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:12.652506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.652515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:12.652523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:12.652555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:12.652587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600595246896885:2738]
2025-10-10T14:31:12.652974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:12.653183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:12.653209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:12.653429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:12.653466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.653470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.653471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.653472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.653472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.653473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.653474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.653474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.653475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.653475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.653476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.653476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.653477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.653480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.653489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.653491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.653494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.653496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.653498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.653500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.653503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.653505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.653507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.653510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.653512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.653514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.653519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.653525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.653530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.653533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.653536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.653539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.653541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.653544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.653547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.653550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.653553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.653556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.653558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.653561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.653564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.653567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.653569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.653572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.653576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.653579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.653581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.653585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.653587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.653590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.653592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.653595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.653617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:12.654812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.654883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:12.654897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 77
2025-10-10T14:31:12.655031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.655065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 77 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:12.655077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=77 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:12.655082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:12.655413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 77 sessionId:  describe result for acl check
2025-10-10T14:31:12.655438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:12.655443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:12.655445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:12.655449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600596029105806:2934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:12.655703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:12.655876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600596029105806:2934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:12.656128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:12.656140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:12.656142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:12.656145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:12.656151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 76 [2:7559600595246896885:2738]
2025-10-10T14:31:12.656162Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:12.656177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:12.656180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.656184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.656186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.656201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:12.656213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:12.656221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:12.656276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.656283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.656285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.656287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:12.656348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:12.656355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.656367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.656380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.656402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:12.656426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105708:2438], now have 1 active actors on pipe
2025-10-10T14:31:12.656437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600595246896880:2738]
2025-10-10T14:31:12.656441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600595246896880:2738]
2025-10-10T14:31:12.656443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600595246896880:2738]
2025-10-10T14:31:12.656450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:12.656446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 76
2025-10-10T14:31:12.656463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:12.656465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:12.656475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:12.656476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:12.656479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:12.656482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:12.656515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600595246896880:2738]
2025-10-10T14:31:12.656522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:12.656531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:12.657920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600596029105806:2934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:12.664073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600596029105806:2934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:12.664085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600596029105806:2934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:12.664088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600596029105806:2934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:12.664095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 77 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:12.664323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105839:2934], now have 1 active actors on pipe
2025-10-10T14:31:12.664368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 76
2025-10-10T14:31:12.664425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.664438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.664469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:12.664485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.664492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.664500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:12.664515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.664536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:12.664559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.664741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.664750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.664766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.664847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 77 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0
2025-10-10T14:31:12.665198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5d9548-2c879d75-46320d1-6c3dc0a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:12.667732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0] Write session: try to update token
2025-10-10T14:31:12.667747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:12.668722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:12.668735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.668744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600595246896880:2738]
2025-10-10T14:31:12.668783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:12.668790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:12.668962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:12.669110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:12.669259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:12.669427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:12.669633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:12.669673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:12.681362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId: src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:12.684002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:12.684170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:12.684189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.684193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:12.684198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:12.684209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600595246896880:2738]
2025-10-10T14:31:12.684213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600595246896880:2738]
2025-10-10T14:31:12.684216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600595246896880:2738]
2025-10-10T14:31:12.684245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:12.684249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:12.684253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:12.684269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.684278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.684300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:12.684312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.684315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:12.684442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:12.743643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600596029105842:2497]
2025-10-10T14:31:12.743915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 76, pipe: [1:7559600596029105842:2497]
2025-10-10T14:31:12.790440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:12.790674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105842:2497], now have 1 active actors on pipe
2025-10-10T14:31:12.790874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:12.790891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600596029105842:2497]
2025-10-10T14:31:12.790901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:12.790913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:12.790915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:12.790974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 77 reason: error at write: Disconnected sessionId: src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0
2025-10-10T14:31:12.791174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 77 sessionId: src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0 is DEAD
2025-10-10T14:31:12.791318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:12.791336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0] Write session will restart in 0.005241s
2025-10-10T14:31:12.791359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0] Write session: Do CDS request
2025-10-10T14:31:12.791363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:12.797859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.797955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:12.797971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 78
2025-10-10T14:31:12.798116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.798155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 78 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:12.798162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=78 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:12.798171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:12.798614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 78 sessionId:  describe result for acl check
2025-10-10T14:31:12.798649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:12.798655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:12.798657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:12.798663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600596029105933:2938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:12.799217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600596029105933:2938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:12.799470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:12.799937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:12.800062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.800071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:12.800079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:12.800112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:12.800145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600595246897016:2740]
2025-10-10T14:31:12.800542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:12.800784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:12.800829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:12.801068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:12.801107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.801112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.801112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.801113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.801114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.801114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.801115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.801115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.801116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.801117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.801117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.801118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.801119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.801123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.801131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.801133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.801136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.801138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.801140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.801143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.801145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.801147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.801150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.801152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.801154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.801156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.801162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.801168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.801172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.801176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.801179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.801182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.801185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.801188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.801191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.801194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.801197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.801200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.801202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.801206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.801208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.801211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.801214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.801217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.801219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.801223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.801225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.801229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.801231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.801234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.801238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.801241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.801263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:12.801289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600596029105933:2938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:12.803359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:12.803499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600596029105933:2938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:12.803509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600596029105933:2938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:12.803512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600596029105933:2938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:12.803518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 78 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:12.803655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:12.803663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:12.803665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:12.803667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:12.803672Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 77 [2:7559600595246897016:2740]
2025-10-10T14:31:12.803680Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:12.803692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:12.803694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.803696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.803697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.803709Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:12.803714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:12.803724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:12.803763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.803769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.803770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.803771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:12.803839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:12.803845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.803851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.803858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.803867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:12.803889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105843:2438], now have 1 active actors on pipe
2025-10-10T14:31:12.803895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105970:2938], now have 1 active actors on pipe
2025-10-10T14:31:12.803900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600595246897011:2740]
2025-10-10T14:31:12.803902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600595246897011:2740]
2025-10-10T14:31:12.803903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600595246897011:2740]
2025-10-10T14:31:12.803917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:12.803912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 77
2025-10-10T14:31:12.803913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 77
2025-10-10T14:31:12.803928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:12.803943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:12.803945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:12.803944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:12.803948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:12.803952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:12.803990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.804000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.804015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600595246897011:2740]
2025-10-10T14:31:12.804027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:12.804040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:12.804056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:12.804061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.804064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.804065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:12.804074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.804082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:12.804099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.804231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.804236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.804248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.804345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 78 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0
2025-10-10T14:31:12.804685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b6c7597-f2a9ce05-c590f37d-5ecc2ced_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:12.807296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0] Write session: try to update token
2025-10-10T14:31:12.807311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:12.821623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId: src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:12.822882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:12.822901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.822905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:12.822907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:12.822917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600595246897011:2740]
2025-10-10T14:31:12.822922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600595246897011:2740]
2025-10-10T14:31:12.822926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600595246897011:2740]
2025-10-10T14:31:12.822970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:12.822974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:12.822983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.822985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:12.822993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:12.823000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:12.823162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:12.824184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:12.891087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600596029105978:2497]
2025-10-10T14:31:12.891344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 77, pipe: [1:7559600596029105978:2497]
2025-10-10T14:31:12.928945Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:12.929299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.929315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.929376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105978:2497], now have 1 active actors on pipe
2025-10-10T14:31:12.929596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:12.929607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600596029105978:2497]
2025-10-10T14:31:12.929726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:12.929735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:12.929797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 78 reason: error at write: Disconnected sessionId: src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0
2025-10-10T14:31:12.930012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 78 sessionId: src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0 is DEAD
2025-10-10T14:31:12.930193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:12.930205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0] Write session will restart in 0.007578s
2025-10-10T14:31:12.930230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0] Write session: Do CDS request
2025-10-10T14:31:12.930236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:12.930572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:12.937924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:12.938392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:12.938559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:12.938571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:12.938585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:12.938637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:12.938676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600595246897148:2742]
2025-10-10T14:31:12.938866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.938887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:12.938900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 79
2025-10-10T14:31:12.939080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:12.939108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 79 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:12.939118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=79 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:12.939126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:12.939144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:12.939372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:12.939411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:12.939467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 79 sessionId:  describe result for acl check
2025-10-10T14:31:12.939493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:12.939499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:12.939500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:12.939504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600596029106075:2942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:12.939713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:12.939770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.939776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.939777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.939778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.939779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.939780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.939781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.939782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.939783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.939784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.939785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.939786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.939787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.939792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.939804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.939808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.939812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.939816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.939820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.939824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.939827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.939831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.939835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.939839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.939843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.939846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.939857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.939869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:12.939879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.939888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:12.939894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.939897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:12.939900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.939903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:12.939907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.939910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:12.939912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.939915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:12.939917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.939922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:12.939924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.939927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:12.939929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.939932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:12.939938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.939941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:12.939943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.939935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600596029106075:2942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:12.939946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.939949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.939951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.939954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.939961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.939985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:12.942112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:12.942108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600596029106075:2942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:12.942433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:12.942445Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:12.942447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:12.942450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:12.942455Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 78 [2:7559600595246897148:2742]
2025-10-10T14:31:12.942467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:12.942486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:12.942492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.942495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.942497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.942510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:12.942522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:12.942533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:12.942577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.942583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.942585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.942587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:12.942648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:12.942654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.942664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:12.942680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:12.942701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:12.942724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029105979:2438], now have 1 active actors on pipe
2025-10-10T14:31:12.942706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 78
2025-10-10T14:31:12.942735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600595246897143:2742]
2025-10-10T14:31:12.942741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600595246897143:2742]
2025-10-10T14:31:12.942745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600595246897143:2742]
2025-10-10T14:31:12.942758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:12.942766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:12.942768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:12.942769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:12.942775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:12.942795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:12.942803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:12.942827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600595246897143:2742]
2025-10-10T14:31:12.942838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:12.942850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:12.947125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600596029106075:2942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:12.947135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600596029106075:2942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:12.947138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600596029106075:2942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:12.947144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 79 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:12.947321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600596029106111:2942], now have 1 active actors on pipe
2025-10-10T14:31:12.947364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 78
2025-10-10T14:31:12.947418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.947428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.947458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:12.947473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:12.947482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:12.947484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:12.947497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:12.947515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:12.947533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.947700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:12.947711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:12.947725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:12.947804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 79 partition: 0 MaxSeqNo: 40 sessionId: src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0
2025-10-10T14:31:12.948073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ef11331-60ebf3ea-74af9d9e-6412da2d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:12.950905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0] Write session: try to update token
2025-10-10T14:31:12.950926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:12.961033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:12.961051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:12.961054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:12.961056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:12.961067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600595246897143:2742]
2025-10-10T14:31:12.961071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600595246897143:2742]
2025-10-10T14:31:12.961076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600595246897143:2742]
2025-10-10T14:31:12.961119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:12.961121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:12.961128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:12.961130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:12.961131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:12.961134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:12.961267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:12.964491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId: src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:12.966994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:13.029803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600600324073423:2497]
2025-10-10T14:31:13.029967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 78, pipe: [1:7559600600324073423:2497]
2025-10-10T14:31:13.066460Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:13.066768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.066781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.066824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073423:2497], now have 1 active actors on pipe
2025-10-10T14:31:13.067019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:13.067171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:13.067186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600600324073423:2497]
2025-10-10T14:31:13.067206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:13.067286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 79 reason: status is not ok: tablet will be restarted right now sessionId: src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0
2025-10-10T14:31:13.067463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 79 sessionId: src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0 is DEAD
2025-10-10T14:31:13.067634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:13.067644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0] Write session will restart in 0.007421s
2025-10-10T14:31:13.067664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0] Write session: Do CDS request
2025-10-10T14:31:13.067669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:13.075795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.075984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:13.075999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 80
2025-10-10T14:31:13.076006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:13.076102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.076136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 80 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:13.076147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=80 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:13.076151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:13.076507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 80 sessionId:  describe result for acl check
2025-10-10T14:31:13.076522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:13.076537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:13.076541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:13.076542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:13.076547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600600324073519:2947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:13.076678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:13.076689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:13.076700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:13.076751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:13.076789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600599541864591:2745]
2025-10-10T14:31:13.076988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600600324073519:2947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:13.077395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:13.077694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:13.077734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:13.078051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:13.078102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.078108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.078109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.078110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.078111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.078112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.078113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.078114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.078115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.078116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.078118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.078119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.078120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.078125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.078137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.078141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.078145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.078149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.078153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.078159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.078163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.078171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.078175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.078179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.078183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.078186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.078195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.078203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.078214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.078224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.078232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.078237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.078246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.078251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.078259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.078264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.078272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.078276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.078284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.078288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.078296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.078300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.078308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.078312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.078321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.078325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.078333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.078338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.078345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.078350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.078358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.078362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.078399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:13.078842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600600324073519:2947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:13.080542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:13.080849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:13.080860Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:13.080862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:13.080865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:13.080871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 79 [2:7559600599541864591:2745]
2025-10-10T14:31:13.080883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:13.080904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:13.080912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.080915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.080917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.080932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:13.080944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:13.080955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:13.081004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.081011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.081013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.081015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:13.081073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:13.081081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.081065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600600324073519:2947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:13.081091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.081081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600600324073519:2947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:13.081085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600600324073519:2947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:13.081105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.081092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 80 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:13.081121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:13.081142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073424:2438], now have 1 active actors on pipe
2025-10-10T14:31:13.081155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600599541864586:2745]
2025-10-10T14:31:13.081157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600599541864586:2745]
2025-10-10T14:31:13.081159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600599541864586:2745]
2025-10-10T14:31:13.081171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:13.081187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:13.081189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:13.081192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:13.081194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:13.081202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 79
2025-10-10T14:31:13.081207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:13.081214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:13.081235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600599541864586:2745]
2025-10-10T14:31:13.081244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:13.081245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:13.081273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 79
2025-10-10T14:31:13.081254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073553:2947], now have 1 active actors on pipe
2025-10-10T14:31:13.081357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.081366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.081393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:13.081406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.081414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.081416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:13.081426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.081437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:13.081454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.081615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.081624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.081637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.081706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 80 partition: 0 MaxSeqNo: 40 sessionId: src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0
2025-10-10T14:31:13.081994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80efeb2f-1d183f2b-d8badb41-ff8181b1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:13.084355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0] Write session: try to update token
2025-10-10T14:31:13.084368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:13.092603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:13.092620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.092630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600599541864586:2745]
2025-10-10T14:31:13.092666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:13.092678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:13.092847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:13.092992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:13.093131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:13.093268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:13.093473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:13.093513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:13.097830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId: src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:13.100143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:13.100332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.100346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.100375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:13.100452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:13.108878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:13.108892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.108895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:13.108896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:13.108906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600599541864586:2745]
2025-10-10T14:31:13.108910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600599541864586:2745]
2025-10-10T14:31:13.108913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600599541864586:2745]
2025-10-10T14:31:13.108950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:13.108954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:13.108959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.108960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:13.108961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:13.108963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:13.109082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:13.167565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600600324073562:2497]
2025-10-10T14:31:13.167781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 79, pipe: [1:7559600600324073562:2497]
2025-10-10T14:31:13.215309Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:13.222112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.222133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.222294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.222348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.222413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.222475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.222518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.222528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.222590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.222650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.222712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.222770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.222816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.222821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.222880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.222932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.222991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.223047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.223086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.223092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.223151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.223207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.223261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.223325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.223371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.223379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.223445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.223507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.223561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.223631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.223674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.223679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.223749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.223814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.223885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.223948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.223993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.224002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.224075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.224143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.224208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.224273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.224319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.224326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.224385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.224443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.224510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.224572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.224613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.224619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.224676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.224727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.224786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.224844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.224888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.224893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.224962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.225014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.225066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.225119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.225158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.225165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.225201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073562:2497], now have 1 active actors on pipe
2025-10-10T14:31:13.225403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600600324073562:2497]
2025-10-10T14:31:13.225404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:13.225431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:13.225433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:13.225458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 80 reason: error at write: Disconnected sessionId: src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0
2025-10-10T14:31:13.225631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 80 sessionId: src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0 is DEAD
2025-10-10T14:31:13.225765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:13.225777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0] Write session will restart in 0.007746s
2025-10-10T14:31:13.225808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0] Write session: Do CDS request
2025-10-10T14:31:13.225815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:13.225948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:13.234782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:13.234829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.234907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:13.234921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 81
2025-10-10T14:31:13.235033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.235066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 81 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:13.235076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=81 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:13.235080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:13.235278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:13.235421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:13.235432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:13.235444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:13.235439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 81 sessionId:  describe result for acl check
2025-10-10T14:31:13.235474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:13.235478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:13.235479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:13.235483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600600324073659:2951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:13.235496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:13.235528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600599541864726:2747]
2025-10-10T14:31:13.235873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600600324073659:2951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:13.236011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:13.236283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:13.236325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:13.236554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:13.236590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.236595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.236596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.236596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.236597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.236598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.236598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.236599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.236600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.236600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.236601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.236601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.236602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.236605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.236613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.236615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.236617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.236619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.236622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.236624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.236626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.236628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.236630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.236632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.236634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.236636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.236641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.236646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.236653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.236659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.236662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.236667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.236671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.236675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.236679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.236684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.236688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.236698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.236702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.236712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.236717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.236721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.236725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.236734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.236743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.236748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.236756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.236760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.236765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.236770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.236774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.236778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.236814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:13.238199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600600324073659:2951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:13.238905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:13.239298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:13.239310Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:13.239312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:13.239316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:13.239321Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 80 [2:7559600599541864726:2747]
2025-10-10T14:31:13.239333Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:13.239344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:13.239349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.239351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.239353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.239363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:13.239372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:13.239378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:13.239424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.239434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.239436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.239438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:13.239500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:13.239507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.239518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.239533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.239553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:13.239580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073563:2438], now have 1 active actors on pipe
2025-10-10T14:31:13.239588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600599541864721:2747]
2025-10-10T14:31:13.239590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600599541864721:2747]
2025-10-10T14:31:13.239592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600599541864721:2747]
2025-10-10T14:31:13.239606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:13.239620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:13.239627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:13.239630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:13.239632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:13.239636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:13.239620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 80
2025-10-10T14:31:13.239639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:13.239659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600599541864721:2747]
2025-10-10T14:31:13.239672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:13.239683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:13.240833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600600324073659:2951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:13.240843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600600324073659:2951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:13.240846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600600324073659:2951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:13.240851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 81 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:13.241003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073696:2951], now have 1 active actors on pipe
2025-10-10T14:31:13.241048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 80
2025-10-10T14:31:13.241131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.241141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.241170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:13.241184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.241189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.241192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:13.241203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.241215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:13.241234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.241389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.241396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.241410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.241497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 81 partition: 0 MaxSeqNo: 40 sessionId: src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0
2025-10-10T14:31:13.241774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e4b4f7-52d57d9f-24ade23-83d77f2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:13.244177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0] Write session: try to update token
2025-10-10T14:31:13.244189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:13.253659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:13.253676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.253685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600599541864721:2747]
2025-10-10T14:31:13.253732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:13.253735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:13.253902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:13.254036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:13.254178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:13.254316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:13.254498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:13.254531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:13.257318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId: src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:13.259756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:13.259947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.259968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.260009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:13.260086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:13.267491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:13.267506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.267508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:13.267512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:13.267522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600599541864721:2747]
2025-10-10T14:31:13.267526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600599541864721:2747]
2025-10-10T14:31:13.267529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600599541864721:2747]
2025-10-10T14:31:13.267564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:13.267575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:13.267575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:13.267579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:13.267582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.267583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:13.267718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:13.325779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600600324073701:2497]
2025-10-10T14:31:13.326005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 80, pipe: [1:7559600600324073701:2497]
2025-10-10T14:31:13.373834Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:13.380609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.380634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.380787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.380843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.380907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.380964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.381007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.381018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.381079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.381138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.381198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.381259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.381304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.381310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.381397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.381464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.381523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.381581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.381621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.381627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.381688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.381744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.381799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.381862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.381906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.381915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.381983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.382036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.382102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.382159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.382206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.382212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.382270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.382323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.382379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.382443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.382484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.382497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.382572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.382628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.382686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.382742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.382782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.382790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.382849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.382903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.382960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.383017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.383057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.383062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.383119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.383172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.383231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.383298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.383348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.383357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.383416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:13.383470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:13.383526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:13.383593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:13.383638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:13.383644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:13.383682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073701:2497], now have 1 active actors on pipe
2025-10-10T14:31:13.383970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600600324073701:2497]
2025-10-10T14:31:13.383975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:13.383977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:13.384001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 81 reason: error at write: Disconnected sessionId: src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0
2025-10-10T14:31:13.384001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:13.384213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 81 sessionId: src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0 is DEAD
2025-10-10T14:31:13.384344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:13.384350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0] Write session will restart in 0.007298s
2025-10-10T14:31:13.384380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0] Write session: Do CDS request
2025-10-10T14:31:13.384385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:13.384486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:13.392563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:13.392785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.393046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:13.393059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 82
2025-10-10T14:31:13.393143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:13.393167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.393199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 82 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:13.393208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=82 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:13.393211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:13.393306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:13.393316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:13.393343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:13.393400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:13.393439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600599541864862:2749]
2025-10-10T14:31:13.393535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 82 sessionId:  describe result for acl check
2025-10-10T14:31:13.393560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:13.393566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:13.393568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:13.393572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600600324073799:2955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:13.393979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600600324073799:2955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:13.394019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:13.394301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:13.394341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:13.394646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:13.394693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.394699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.394700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.394701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.394702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.394703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.394704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.394705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.394706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.394708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.394709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.394710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.394711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.394717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.394728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.394732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.394736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.394740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.394742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.394744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.394746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.394748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.394750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.394752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.394754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.394756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.394761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.394769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.394775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.394780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.394785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.394794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.394803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.394808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.394813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.394818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.394827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.394832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.394840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.394845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.394849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.394854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.394863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.394868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.394876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.394881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.394889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.394894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.394903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.394912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.394918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.394927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.394967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:13.395867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600600324073799:2955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:13.396971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:13.397284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:13.397295Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:13.397298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:13.397301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:13.397307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 81 [2:7559600599541864862:2749]
2025-10-10T14:31:13.397318Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:13.397353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:13.397356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.397358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.397360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.397371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:13.397383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:13.397390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:13.397443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.397450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.397452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.397455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:13.397515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:13.397522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.397534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.397550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.397571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:13.397580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 81
2025-10-10T14:31:13.397597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073702:2438], now have 1 active actors on pipe
2025-10-10T14:31:13.397607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600599541864857:2749]
2025-10-10T14:31:13.397614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600599541864857:2749]
2025-10-10T14:31:13.397616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600599541864857:2749]
2025-10-10T14:31:13.397628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:13.397646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:13.397647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:13.397650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:13.397651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:13.397666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:13.397673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:13.397698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600599541864857:2749]
2025-10-10T14:31:13.397708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:13.397719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:13.397961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600600324073799:2955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:13.397978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600600324073799:2955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:13.397981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600600324073799:2955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:13.397986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 82 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:13.398169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073835:2955], now have 1 active actors on pipe
2025-10-10T14:31:13.398206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 81
2025-10-10T14:31:13.398265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.398275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.398303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:13.398317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.398320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.398322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:13.398333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.398344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:13.398357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.398524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.398532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.398547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.398629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 82 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0
2025-10-10T14:31:13.398930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36bea4-877ef4c5-4904eb2e-8db00493_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:13.401387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0] Write session: try to update token
2025-10-10T14:31:13.401400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:13.414794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId: src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:13.416025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:13.416045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.416048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:13.416051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:13.416061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600599541864857:2749]
2025-10-10T14:31:13.416065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600599541864857:2749]
2025-10-10T14:31:13.416069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600599541864857:2749]
2025-10-10T14:31:13.416104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:13.416114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:13.416117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:13.416118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:13.416125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.416130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:13.416271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:13.417257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:13.483921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600600324073841:2497]
2025-10-10T14:31:13.484135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 81, pipe: [1:7559600600324073841:2497]
2025-10-10T14:31:13.521060Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:13.521302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.521314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.521370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073841:2497], now have 1 active actors on pipe
2025-10-10T14:31:13.521613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:13.521626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600600324073841:2497]
2025-10-10T14:31:13.521651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:13.521654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:13.521687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:13.521714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 82 reason: error at write: Disconnected sessionId: src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0
2025-10-10T14:31:13.521915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 82 sessionId: src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0 is DEAD
2025-10-10T14:31:13.522092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:13.522103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0] Write session will restart in 0.006621s
2025-10-10T14:31:13.522129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0] Write session: Do CDS request
2025-10-10T14:31:13.522136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:13.529777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.529848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:13.529859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 83
2025-10-10T14:31:13.530009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.530064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 83 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:13.530076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=83 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:13.530081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:13.530505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 83 sessionId:  describe result for acl check
2025-10-10T14:31:13.530541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:13.530547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:13.530548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:13.530555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600600324073944:2961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:13.531113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600600324073944:2961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:13.531212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:13.531828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:13.531986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:13.531996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:13.532006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:13.532045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:13.532077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600599541864999:2751]
2025-10-10T14:31:13.532478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:13.532714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:13.532751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:13.532832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600600324073944:2961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:13.532980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:13.533022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.533026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.533027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.533028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.533028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.533029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.533030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.533031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.533032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.533032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.533033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.533033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.533034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.533037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.533045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.533048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.533050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.533052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.533062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.533064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.533067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.533069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.533072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.533074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.533076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.533078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.533083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.533088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.533096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.533100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.533102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.533105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.533108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.533111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.533113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.533117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.533119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.533126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.533129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.533132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.533134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.533138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.533140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.533143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.533146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.533149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.533152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.533155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.533157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.533160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.533163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.533167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.533198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:13.535312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600600324073944:2961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:13.535322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600600324073944:2961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:13.535325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600600324073944:2961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:13.535331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 83 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:13.535423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:13.535723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:13.535733Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:13.535736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:13.535738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:13.535743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 82 [2:7559600599541864999:2751]
2025-10-10T14:31:13.535750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:13.535762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:13.535767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.535769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.535770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.535784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:13.535796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:13.535807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:13.535850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.535857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.535858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.535860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:13.535908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:13.535914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.535920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.535927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.535940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:13.535958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600599541864994:2751]
2025-10-10T14:31:13.535963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600599541864994:2751]
2025-10-10T14:31:13.535964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600599541864994:2751]
2025-10-10T14:31:13.535972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:13.535982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073981:2961], now have 1 active actors on pipe
2025-10-10T14:31:13.535988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324073845:2438], now have 1 active actors on pipe
2025-10-10T14:31:13.535988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:13.535990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:13.535992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:13.535994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:13.536004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:13.536006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:13.536020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 82
2025-10-10T14:31:13.536024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600599541864994:2751]
2025-10-10T14:31:13.536030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:13.536042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:13.536059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.536068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.536066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 82
2025-10-10T14:31:13.536095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|449d3610-b54c6f30-783da91d-550faf44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:13.536107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.536110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.536111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:13.536119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.536127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:13.536138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.536268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.536273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.536285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.536371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 83 partition: 0 MaxSeqNo: 40 sessionId: src_id|449d3610-b54c6f30-783da91d-550faf44_0
2025-10-10T14:31:13.536660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c4d60a5-daa7bfcb-d79f13bc-8ed32922_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|449d3610-b54c6f30-783da91d-550faf44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:13.539241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|449d3610-b54c6f30-783da91d-550faf44_0] Write session: try to update token
2025-10-10T14:31:13.539259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|449d3610-b54c6f30-783da91d-550faf44_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:13.552693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId: src_id|449d3610-b54c6f30-783da91d-550faf44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:13.554513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:13.554533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.554537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:13.554538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:13.554546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600599541864994:2751]
2025-10-10T14:31:13.554549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600599541864994:2751]
2025-10-10T14:31:13.554552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600599541864994:2751]
2025-10-10T14:31:13.554590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:13.554599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.554601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:13.554603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:13.554612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:13.554616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:13.554734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:13.555304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:13.621680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600600324074004:2497]
2025-10-10T14:31:13.621981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 82, pipe: [1:7559600600324074004:2497]
2025-10-10T14:31:13.659582Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:13.659922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.659938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.659987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074004:2497], now have 1 active actors on pipe
2025-10-10T14:31:13.660180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:13.660190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:13.660212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:13.660215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:13.660247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600600324074004:2497]
2025-10-10T14:31:13.660269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 83 reason: error at write: Disconnected sessionId: src_id|449d3610-b54c6f30-783da91d-550faf44_0
2025-10-10T14:31:13.660495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 83 sessionId: src_id|449d3610-b54c6f30-783da91d-550faf44_0 is DEAD
2025-10-10T14:31:13.660619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449d3610-b54c6f30-783da91d-550faf44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:13.660630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449d3610-b54c6f30-783da91d-550faf44_0] Write session will restart in 0.005440s
2025-10-10T14:31:13.660655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449d3610-b54c6f30-783da91d-550faf44_0] Write session: Do CDS request
2025-10-10T14:31:13.660661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449d3610-b54c6f30-783da91d-550faf44_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:13.666797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|449d3610-b54c6f30-783da91d-550faf44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.666854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:13.666865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 84
2025-10-10T14:31:13.667018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.667056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 84 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:13.667060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=84 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:13.667063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:13.667498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 84 sessionId:  describe result for acl check
2025-10-10T14:31:13.667544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:13.667550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:13.667551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:13.667558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600600324074067:2974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:13.668141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600600324074067:2974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:13.669731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:13.670232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600600324074067:2974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:13.670393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:13.670558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:13.670568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:13.670577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:13.670618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:13.670647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600599541865176:2767]
2025-10-10T14:31:13.671061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:13.671332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:13.671364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:13.671585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:13.671623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.671628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.671628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.671629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.671629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.671630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.671631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.671631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.671632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.671632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.671633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.671634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.671634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.671638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.671645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.671648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.671650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.671652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.671654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.671656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.671658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.671660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.671663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.671665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.671667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.671669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.671673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.671679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.671683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.671687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.671689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.671693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.671695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.671698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.671701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.671704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.671706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.671710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.671712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.671716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.671719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.671722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.671725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.671729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.671731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.671734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.671737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.671740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.671742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.671745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.671748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.671751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.671773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:13.672360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600600324074067:2974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:13.672373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600600324074067:2974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:13.672376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600600324074067:2974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:13.672384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 84 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:13.673913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:13.674234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:13.674245Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:13.674247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:13.674250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:13.674255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 83 [2:7559600599541865176:2767]
2025-10-10T14:31:13.674267Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:13.674288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:13.674293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.674295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.674297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.674310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:13.674318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:13.674324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:13.674366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.674371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.674372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.674374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:13.674421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:13.674427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.674433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.674453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.674467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:13.674484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074150:2974], now have 1 active actors on pipe
2025-10-10T14:31:13.674486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074017:2438], now have 1 active actors on pipe
2025-10-10T14:31:13.674492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600599541865171:2767]
2025-10-10T14:31:13.674494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600599541865171:2767]
2025-10-10T14:31:13.674495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600599541865171:2767]
2025-10-10T14:31:13.674504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:13.674514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:13.674524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:13.674524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:13.674535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 83
2025-10-10T14:31:13.674526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:13.674528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:13.674536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 83
2025-10-10T14:31:13.674531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:13.674550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600599541865171:2767]
2025-10-10T14:31:13.674552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:13.674567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:13.674576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.674578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.674600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90c2e547-a89a3801-e22bd894-92e30166_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:13.674617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.674623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.674625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:13.674632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.674644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:13.674661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.674776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.674782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.674794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.674869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 84 partition: 0 MaxSeqNo: 40 sessionId: src_id|90c2e547-a89a3801-e22bd894-92e30166_0
2025-10-10T14:31:13.675190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449d3610-b54c6f30-783da91d-550faf44_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90c2e547-a89a3801-e22bd894-92e30166_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:13.677806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c2e547-a89a3801-e22bd894-92e30166_0] Write session: try to update token
2025-10-10T14:31:13.677823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c2e547-a89a3801-e22bd894-92e30166_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:13.691857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId: src_id|90c2e547-a89a3801-e22bd894-92e30166_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:13.693182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:13.693203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.693207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:13.693209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:13.693219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600599541865171:2767]
2025-10-10T14:31:13.693223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600599541865171:2767]
2025-10-10T14:31:13.693227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600599541865171:2767]
2025-10-10T14:31:13.693277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:13.693291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.693291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:13.693297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:13.693298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:13.693301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:13.693460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:13.694473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:13.760448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600600324074157:2497]
2025-10-10T14:31:13.760750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 83, pipe: [1:7559600600324074157:2497]
2025-10-10T14:31:13.795473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:13.795841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.795854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.795892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074157:2497], now have 1 active actors on pipe
2025-10-10T14:31:13.796085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:13.796095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:13.796108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:13.796163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 84 reason: error at write: Disconnected sessionId: src_id|90c2e547-a89a3801-e22bd894-92e30166_0
2025-10-10T14:31:13.796346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 84 sessionId: src_id|90c2e547-a89a3801-e22bd894-92e30166_0 is DEAD
2025-10-10T14:31:13.796379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600600324074157:2497]
2025-10-10T14:31:13.796407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:13.796519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c2e547-a89a3801-e22bd894-92e30166_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:13.796530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c2e547-a89a3801-e22bd894-92e30166_0] Write session will restart in 0.005811s
2025-10-10T14:31:13.796554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c2e547-a89a3801-e22bd894-92e30166_0] Write session: Do CDS request
2025-10-10T14:31:13.796564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c2e547-a89a3801-e22bd894-92e30166_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:13.803877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c2e547-a89a3801-e22bd894-92e30166_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.803899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:13.803910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 85
2025-10-10T14:31:13.804085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.804119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 85 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:13.804126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=85 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:13.804129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:13.804607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 85 sessionId:  describe result for acl check
2025-10-10T14:31:13.804656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:13.804664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:13.804666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:13.804672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600600324074233:2978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:13.805288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600600324074233:2978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:13.806193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:13.806862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:13.807034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:13.807043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:13.807051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:13.807093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:13.807126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600599541865313:2769]
2025-10-10T14:31:13.807419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600600324074233:2978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:13.807517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:13.807730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:13.807758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:13.807969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:13.808008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.808013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.808014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.808014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.808015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.808016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.808016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.808017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.808018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.808018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.808019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.808020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.808020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.808024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.808031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.808034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.808036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.808038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.808041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.808043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.808045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.808048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.808050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.808053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.808055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.808057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.808062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.808067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.808072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.808075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.808077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.808081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.808083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.808086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.808089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.808092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.808094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.808098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.808100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.808103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.808106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.808109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.808111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.808114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.808117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.808120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.808123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.808126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.808129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.808132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.808134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.808137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.808159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:13.810174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600600324074233:2978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:13.810187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600600324074233:2978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:13.810191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600600324074233:2978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:13.810198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 85 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:13.810193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:13.810580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:13.810590Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:13.810591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:13.810594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:13.810598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 84 [2:7559600599541865313:2769]
2025-10-10T14:31:13.810607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:13.810618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:13.810623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.810626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.810627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.810639Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:13.810648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:13.810654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:13.810693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.810698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.810699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.810701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:13.810764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:13.810771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.810778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.810784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.810794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:13.810813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074292:2978], now have 1 active actors on pipe
2025-10-10T14:31:13.810829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074158:2438], now have 1 active actors on pipe
2025-10-10T14:31:13.810836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600599541865308:2769]
2025-10-10T14:31:13.810844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600599541865308:2769]
2025-10-10T14:31:13.810846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600599541865308:2769]
2025-10-10T14:31:13.810859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:13.810864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 84
2025-10-10T14:31:13.810866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 84
2025-10-10T14:31:13.810867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:13.810870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:13.810875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:13.810880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:13.810882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:13.810883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:13.810910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600599541865308:2769]
2025-10-10T14:31:13.810916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:13.810917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:13.810937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.810944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.810980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df5a37ce-435501d0-143d305c-9fea61f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:13.810992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.810997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.810999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:13.811006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.811027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:13.811045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.811161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.811168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.811182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.811249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 85 partition: 0 MaxSeqNo: 40 sessionId: src_id|df5a37ce-435501d0-143d305c-9fea61f8_0
2025-10-10T14:31:13.811531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c2e547-a89a3801-e22bd894-92e30166_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df5a37ce-435501d0-143d305c-9fea61f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:13.814151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a37ce-435501d0-143d305c-9fea61f8_0] Write session: try to update token
2025-10-10T14:31:13.814168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a37ce-435501d0-143d305c-9fea61f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:13.828235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId: src_id|df5a37ce-435501d0-143d305c-9fea61f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:13.829123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:13.829139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.829141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:13.829142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:13.829150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600599541865308:2769]
2025-10-10T14:31:13.829152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600599541865308:2769]
2025-10-10T14:31:13.829155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600599541865308:2769]
2025-10-10T14:31:13.829193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:13.829195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:13.829198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.829200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:13.829201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:13.829203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:13.829318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:13.830815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:13.896655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600600324074300:2497]
2025-10-10T14:31:13.896885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 84, pipe: [1:7559600600324074300:2497]
2025-10-10T14:31:13.932464Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:13.932730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.932743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.932787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074300:2497], now have 1 active actors on pipe
2025-10-10T14:31:13.932928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:13.932983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600600324074300:2497]
2025-10-10T14:31:13.933010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:13.933017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:13.933100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 85 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df5a37ce-435501d0-143d305c-9fea61f8_0
2025-10-10T14:31:13.933314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 85 sessionId: src_id|df5a37ce-435501d0-143d305c-9fea61f8_0 is DEAD
2025-10-10T14:31:13.933488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a37ce-435501d0-143d305c-9fea61f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:13.933499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a37ce-435501d0-143d305c-9fea61f8_0] Write session will restart in 0.005077s
2025-10-10T14:31:13.933525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a37ce-435501d0-143d305c-9fea61f8_0] Write session: Do CDS request
2025-10-10T14:31:13.933531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a37ce-435501d0-143d305c-9fea61f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:13.939855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a37ce-435501d0-143d305c-9fea61f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.939930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:13.939949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 86
2025-10-10T14:31:13.940060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:13.940094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 86 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:13.940101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=86 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:13.940105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:13.940564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 86 sessionId:  describe result for acl check
2025-10-10T14:31:13.940594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:13.940600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:13.940601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:13.940606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600600324074348:2982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:13.941021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600600324074348:2982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:13.942712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:13.943007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600600324074348:2982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:13.943293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:13.943437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:13.943446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:13.943455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:13.943498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:13.943538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600599541865452:2771]
2025-10-10T14:31:13.943949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:13.944187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:13.944235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:13.944472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:13.944508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.944513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.944513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.944514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.944514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.944515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.944515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.944516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.944517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.944517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.944518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.944518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.944519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.944523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.944538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.944541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.944543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.944545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.944548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.944550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.944552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.944555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.944557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.944560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.944562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.944564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.944569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.944575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:13.944579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.944583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:13.944588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.944602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:13.944611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.944617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:13.944620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.944623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:13.944626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.944633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:13.944636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.944639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:13.944641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.944644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:13.944647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.944650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:13.944656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.944659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:13.944663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.944672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.944680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.944684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.944690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.944695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.944735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:13.945205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600600324074348:2982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:13.945218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600600324074348:2982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:13.945221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600600324074348:2982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:13.945228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 86 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:13.946777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:13.947109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:13.947119Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:13.947120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:13.947123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:13.947127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 85 [2:7559600599541865452:2771]
2025-10-10T14:31:13.947136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:13.947150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:13.947153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.947156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.947158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.947170Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:13.947181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:13.947187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:13.947223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.947228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.947229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.947231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:13.947282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:13.947290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.947301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:13.947307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:13.947317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:13.947336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074301:2438], now have 1 active actors on pipe
2025-10-10T14:31:13.947342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600600324074436:2982], now have 1 active actors on pipe
2025-10-10T14:31:13.947347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600599541865447:2771]
2025-10-10T14:31:13.947348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600599541865447:2771]
2025-10-10T14:31:13.947349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600599541865447:2771]
2025-10-10T14:31:13.947361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:13.947370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:13.947359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 85
2025-10-10T14:31:13.947383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:13.947382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:13.947385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:13.947387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:13.947393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 85
2025-10-10T14:31:13.947388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:13.947410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600599541865447:2771]
2025-10-10T14:31:13.947416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:13.947419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:13.947426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.947432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.947466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11601cf6-f1882ae-88bad0c1-b0100681_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:13.947475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:13.947477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:13.947488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:13.947496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:13.947504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:13.947522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.947625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:13.947630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:13.947641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:13.947684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 86 partition: 0 MaxSeqNo: 40 sessionId: src_id|11601cf6-f1882ae-88bad0c1-b0100681_0
2025-10-10T14:31:13.947980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5a37ce-435501d0-143d305c-9fea61f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|11601cf6-f1882ae-88bad0c1-b0100681_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:13.950577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11601cf6-f1882ae-88bad0c1-b0100681_0] Write session: try to update token
2025-10-10T14:31:13.950597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11601cf6-f1882ae-88bad0c1-b0100681_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:13.968430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:13.968448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:13.968450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:13.968451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:13.968459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600599541865447:2771]
2025-10-10T14:31:13.968465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600599541865447:2771]
2025-10-10T14:31:13.968470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600599541865447:2771]
2025-10-10T14:31:13.968507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:13.968513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:13.968514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:13.968518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:13.968528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:13.968534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:13.969243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:13.969405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId: src_id|11601cf6-f1882ae-88bad0c1-b0100681_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:13.971905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:14.033349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600604619041752:2497]
2025-10-10T14:31:14.033527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 85, pipe: [1:7559600604619041752:2497]
2025-10-10T14:31:14.072365Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:14.072644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.072658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.072696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619041752:2497], now have 1 active actors on pipe
2025-10-10T14:31:14.072891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:14.072967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600604619041752:2497]
2025-10-10T14:31:14.072979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:14.073010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:14.073091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 86 reason: status is not ok: tablet will be restarted right now sessionId: src_id|11601cf6-f1882ae-88bad0c1-b0100681_0
2025-10-10T14:31:14.073285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 86 sessionId: src_id|11601cf6-f1882ae-88bad0c1-b0100681_0 is DEAD
2025-10-10T14:31:14.073462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11601cf6-f1882ae-88bad0c1-b0100681_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:14.073480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11601cf6-f1882ae-88bad0c1-b0100681_0] Write session will restart in 0.005553s
2025-10-10T14:31:14.073500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11601cf6-f1882ae-88bad0c1-b0100681_0] Write session: Do CDS request
2025-10-10T14:31:14.073507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11601cf6-f1882ae-88bad0c1-b0100681_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:14.079846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11601cf6-f1882ae-88bad0c1-b0100681_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.079906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:14.079918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 87
2025-10-10T14:31:14.080082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.080125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 87 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:14.080135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=87 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:14.080140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:14.080555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 87 sessionId:  describe result for acl check
2025-10-10T14:31:14.080603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:14.080611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:14.080612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:14.080619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600604619041819:2987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:14.081135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600604619041819:2987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:14.082325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:14.083063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:14.083211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:14.083220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:14.083228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:14.083265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:14.083303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600603836832900:2774]
2025-10-10T14:31:14.083341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600604619041819:2987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:14.083730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:14.083973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:14.084017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:14.084265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:14.084317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.084322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.084322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.084323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.084324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.084324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.084325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.084326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.084326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.084327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.084328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.084328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.084329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.084333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.084341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.084343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.084346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.084348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.084350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.084353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.084355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.084357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.084360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.084362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.084365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.084367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.084372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.084377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.084383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.084389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.084398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.084403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.084412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.084418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.084421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.084426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.084428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.084431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.084436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.084439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.084445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.084448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.084452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.084457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.084467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.084473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.084475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.084478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.084481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.084484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.084486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.084489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.084511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:14.086607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600604619041819:2987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:14.086621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600604619041819:2987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:14.086624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600604619041819:2987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:14.086632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 87 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:14.087812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:14.088597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:14.088607Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:14.088609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:14.088611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:14.088617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 86 [2:7559600603836832900:2774]
2025-10-10T14:31:14.088627Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:14.088643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:14.088648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.088650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.088652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.088664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:14.088669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:14.088676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:14.088719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.088724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.088725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.088727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:14.088773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:14.088780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.088787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.088794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.088803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:14.088820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619041753:2438], now have 1 active actors on pipe
2025-10-10T14:31:14.088827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619041889:2987], now have 1 active actors on pipe
2025-10-10T14:31:14.088832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600603836832895:2774]
2025-10-10T14:31:14.088834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600603836832895:2774]
2025-10-10T14:31:14.088835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600603836832895:2774]
2025-10-10T14:31:14.088846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:14.088854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:14.088856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:14.088857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:14.088863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:14.088869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 86
2025-10-10T14:31:14.088877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:14.088887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:14.088906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 86
2025-10-10T14:31:14.088913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600603836832895:2774]
2025-10-10T14:31:14.088926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:14.088927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:14.088955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.088962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.088989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ada2542-44551bc5-cec40003-f1b1f02c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:14.088998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.089005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.089006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:14.089016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.089024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:14.089041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.089168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.089175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.089185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.089268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 87 partition: 0 MaxSeqNo: 40 sessionId: src_id|ada2542-44551bc5-cec40003-f1b1f02c_0
2025-10-10T14:31:14.089594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11601cf6-f1882ae-88bad0c1-b0100681_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ada2542-44551bc5-cec40003-f1b1f02c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:14.098619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada2542-44551bc5-cec40003-f1b1f02c_0] Write session: try to update token
2025-10-10T14:31:14.098638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada2542-44551bc5-cec40003-f1b1f02c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:14.106601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:14.106617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.106619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:14.106620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:14.106628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600603836832895:2774]
2025-10-10T14:31:14.106631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600603836832895:2774]
2025-10-10T14:31:14.106635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600603836832895:2774]
2025-10-10T14:31:14.106672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:14.106682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.106685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:14.106687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:14.106700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:14.106705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:14.106800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:14.121941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId: src_id|ada2542-44551bc5-cec40003-f1b1f02c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:14.124235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:14.173117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600604619041897:2497]
2025-10-10T14:31:14.173393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 86, pipe: [1:7559600604619041897:2497]
2025-10-10T14:31:14.208255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:14.208563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.208575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.208595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619041897:2497], now have 1 active actors on pipe
2025-10-10T14:31:14.208756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:14.208848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600604619041897:2497]
2025-10-10T14:31:14.208877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:14.208878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:14.208963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 87 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ada2542-44551bc5-cec40003-f1b1f02c_0
2025-10-10T14:31:14.209159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 87 sessionId: src_id|ada2542-44551bc5-cec40003-f1b1f02c_0 is DEAD
2025-10-10T14:31:14.209366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada2542-44551bc5-cec40003-f1b1f02c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:14.209376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada2542-44551bc5-cec40003-f1b1f02c_0] Write session will restart in 0.007348s
2025-10-10T14:31:14.209401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada2542-44551bc5-cec40003-f1b1f02c_0] Write session: Do CDS request
2025-10-10T14:31:14.209405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada2542-44551bc5-cec40003-f1b1f02c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:14.217839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada2542-44551bc5-cec40003-f1b1f02c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.217988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:14.217998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 88
2025-10-10T14:31:14.218150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.218181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 88 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:14.218188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=88 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:14.218191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:14.218558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:14.218616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 88 sessionId:  describe result for acl check
2025-10-10T14:31:14.218656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:14.218663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:14.218665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:14.218671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600604619042000:2991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:14.219042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:14.219172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:14.219181Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:14.219199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:14.219212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600604619042000:2991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:14.219235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:14.219265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600603836833041:2776]
2025-10-10T14:31:14.219642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:14.219870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:14.219896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:14.220124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:14.220158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.220163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.220163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.220164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.220165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.220166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.220166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.220167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.220167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.220168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.220169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.220169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.220170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.220173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.220180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.220183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.220185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.220187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.220189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.220191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.220193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.220195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.220197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.220199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.220201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.220203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.220208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.220213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.220217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.220220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.220223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.220226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.220229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.220231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.220234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.220237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.220240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.220243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.220245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.220248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.220251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.220253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.220256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.220259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.220261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.220264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.220267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.220270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.220273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.220276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.220278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.220281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.220302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:14.220981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600604619042000:2991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:14.222550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:14.223138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:14.223148Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:14.223149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:14.223152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:14.223165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 87 [2:7559600603836833041:2776]
2025-10-10T14:31:14.223173Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:14.223189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:14.223194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.223197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.223198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.223208Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:14.223214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:14.223220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:14.223268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.223273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.223274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.223276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:14.223327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:14.223332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.223339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.223330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600604619042000:2991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:14.223348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.223342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600604619042000:2991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:14.223346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600604619042000:2991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:14.223361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:14.223353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 88 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:14.223381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619041898:2438], now have 1 active actors on pipe
2025-10-10T14:31:14.223386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600603836833036:2776]
2025-10-10T14:31:14.223391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600603836833036:2776]
2025-10-10T14:31:14.223392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600603836833036:2776]
2025-10-10T14:31:14.223402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:14.223412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:14.223412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:14.223415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:14.223416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:14.223424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:14.223426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:14.223444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600603836833036:2776]
2025-10-10T14:31:14.223452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:14.223456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:14.223463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 87
2025-10-10T14:31:14.223540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042035:2991], now have 1 active actors on pipe
2025-10-10T14:31:14.223607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 87
2025-10-10T14:31:14.223635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.223643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.223664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:14.223669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.223672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.223673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:14.223680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.223688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:14.223698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.223784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.223789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.223799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.223860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 88 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0
2025-10-10T14:31:14.224141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada2542-44551bc5-cec40003-f1b1f02c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:14.226595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0] Write session: try to update token
2025-10-10T14:31:14.226609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:14.240031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:14.240048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.240058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600603836833036:2776]
2025-10-10T14:31:14.240100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:14.240115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:14.240255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:14.240381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.240524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.240664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.240913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId: src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:14.240990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:14.241025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:14.243249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:14.243416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.243429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.243456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:14.243516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:14.251563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:14.251578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.251581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:14.251582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:14.251589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600603836833036:2776]
2025-10-10T14:31:14.251592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600603836833036:2776]
2025-10-10T14:31:14.251595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600603836833036:2776]
2025-10-10T14:31:14.251632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:14.251633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:14.251638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.251639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:14.251639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:14.251642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:14.251759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:14.308812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600604619042042:2497]
2025-10-10T14:31:14.309037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 87, pipe: [1:7559600604619042042:2497]
2025-10-10T14:31:14.354168Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:14.360630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.360653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.360804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.360861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.360953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.361042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.361158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.361166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.361257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.361363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.361460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.361553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.361592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.361598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.361690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.361745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.361802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.361891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.361931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.361943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.362035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.362137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.362222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.362309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.362428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.362442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.362630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.362689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.362745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.362827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.362930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.362937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.363020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.363075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.363130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.363187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.363301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.363309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.363365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.363418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.363475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.363536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.363587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.363592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.363649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.363703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.363760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.363851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.363922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.363927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.363986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.364040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.364126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.364182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.364237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.364243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.364300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.364353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.364409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.364559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.364602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.364610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.364667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042042:2497], now have 1 active actors on pipe
2025-10-10T14:31:14.364882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600604619042042:2497]
2025-10-10T14:31:14.364915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:14.365182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:14.365190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:14.365215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 88 reason: error at write: Disconnected sessionId: src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0
2025-10-10T14:31:14.365396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:14.365402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 88 sessionId: src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0 is DEAD
2025-10-10T14:31:14.365574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:14.365583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0] Write session will restart in 0.007774s
2025-10-10T14:31:14.365602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0] Write session: Do CDS request
2025-10-10T14:31:14.365607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:14.373919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:14.374494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:14.374647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:14.374655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:14.374663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:14.374711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:14.374741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600603836833183:2778]
2025-10-10T14:31:14.374894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.374950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:14.374969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 89
2025-10-10T14:31:14.375109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:14.375115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.375147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 89 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:14.375162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=89 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:14.375171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:14.375373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:14.375408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:14.375622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:14.375623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 89 sessionId:  describe result for acl check
2025-10-10T14:31:14.375657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.375658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:14.375661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.375664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:14.375662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.375662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.375663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.375663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.375666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:14.375671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600604619042150:2995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:14.375664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.375665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.375665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.375666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.375667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.375667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.375668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.375671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.375679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.375681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.375684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.375686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.375688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.375690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.375693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.375695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.375697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.375699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.375701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.375703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.375708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.375714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.375718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.375721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.375724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.375727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.375729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.375732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.375734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.375737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.375739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.375743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.375746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.375749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.375752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.375755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.375757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.375760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.375763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.375765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.375768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.375770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.375773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.375785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.375788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.375790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.375812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:14.376183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600604619042150:2995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:14.378473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600604619042150:2995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:14.378793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:14.379141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:14.379150Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:14.379151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:14.379153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:14.379159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 88 [2:7559600603836833183:2778]
2025-10-10T14:31:14.379168Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:14.379183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:14.379188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.379191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.379192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.379205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:14.379214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:14.379221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:14.379265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.379270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.379271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.379273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:14.379323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:14.379328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.379335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.379341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.379354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:14.379375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042044:2438], now have 1 active actors on pipe
2025-10-10T14:31:14.379384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600603836833178:2778]
2025-10-10T14:31:14.379385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600603836833178:2778]
2025-10-10T14:31:14.379386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600603836833178:2778]
2025-10-10T14:31:14.379398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:14.379411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:14.379414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:14.379418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:14.379420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:14.379429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:14.379436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:14.379408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 88
2025-10-10T14:31:14.379468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600603836833178:2778]
2025-10-10T14:31:14.379477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:14.379481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:14.383650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600604619042150:2995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:14.383661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600604619042150:2995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:14.383664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600604619042150:2995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:14.383671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 89 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:14.383850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042186:2995], now have 1 active actors on pipe
2025-10-10T14:31:14.383909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 88
2025-10-10T14:31:14.383954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.383962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.383985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:14.383997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.384005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.384006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:14.384016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.384033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:14.384051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.384171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.384176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.384187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.384253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 89 partition: 0 MaxSeqNo: 40 sessionId: src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0
2025-10-10T14:31:14.384603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c518860-e89c26f9-76c7d74a-40b852dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:14.387161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0] Write session: try to update token
2025-10-10T14:31:14.387175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:14.397204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:14.397219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.397221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:14.397223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:14.397230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600603836833178:2778]
2025-10-10T14:31:14.397233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600603836833178:2778]
2025-10-10T14:31:14.397236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600603836833178:2778]
2025-10-10T14:31:14.397271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:14.397274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:14.397278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.397281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:14.397281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:14.397285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:14.397581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:14.401540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId: src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:14.403799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:14.464963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600604619042189:2497]
2025-10-10T14:31:14.465250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 88, pipe: [1:7559600604619042189:2497]
2025-10-10T14:31:14.500064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:14.500274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.500288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.500325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042189:2497], now have 1 active actors on pipe
2025-10-10T14:31:14.500495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:14.500537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600604619042189:2497]
2025-10-10T14:31:14.500548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:14.500670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:14.500745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 89 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0
2025-10-10T14:31:14.500939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 89 sessionId: src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0 is DEAD
2025-10-10T14:31:14.501074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:14.501083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0] Write session will restart in 0.008590s
2025-10-10T14:31:14.501102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0] Write session: Do CDS request
2025-10-10T14:31:14.501107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:14.510395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:14.510869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.510978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:14.510968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:14.510982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 90
2025-10-10T14:31:14.511102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.511127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 90 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:14.511131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=90 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:14.511130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:14.511136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:14.511147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:14.511159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:14.511193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:14.511233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600603836833326:2780]
2025-10-10T14:31:14.511493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 90 sessionId:  describe result for acl check
2025-10-10T14:31:14.511525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:14.511530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:14.511532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:14.511537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600604619042298:2999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:14.511625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:14.511889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:14.511917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:14.511991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600604619042298:2999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:14.512126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:14.512161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.512166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.512167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.512167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.512168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.512169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.512169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.512170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.512171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.512171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.512172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.512173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.512173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.512177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.512186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.512189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.512191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.512194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.512197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.512199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.512201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.512203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.512206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.512209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.512211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.512213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.512218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.512224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.512228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.512232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.512235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.512238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.512240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.512244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.512246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.512249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.512252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.512255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.512258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.512261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.512263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.512267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.512270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.512273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.512275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.512278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.512281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.512284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.512286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.512289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.512298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.512301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.512322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:14.513737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600604619042298:2999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:14.514459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:14.514755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:14.514764Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:14.514765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:14.514768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:14.514772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 89 [2:7559600603836833326:2780]
2025-10-10T14:31:14.514781Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:14.514797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:14.514803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.514805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.514806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.514817Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:14.514825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:14.514835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:14.514878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.514882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.514884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.514885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:14.514939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:14.514945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.514952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.514967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.514977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:14.514992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042192:2438], now have 1 active actors on pipe
2025-10-10T14:31:14.514998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600603836833321:2780]
2025-10-10T14:31:14.515000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600603836833321:2780]
2025-10-10T14:31:14.515001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600603836833321:2780]
2025-10-10T14:31:14.515010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:14.515030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:14.515034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:14.515037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:14.515039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:14.515044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:14.515047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:14.515030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 89
2025-10-10T14:31:14.515071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600603836833321:2780]
2025-10-10T14:31:14.515080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:14.515084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:14.519774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600604619042298:2999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:14.519787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600604619042298:2999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:14.519790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600604619042298:2999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:14.519798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 90 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:14.519995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042339:2999], now have 1 active actors on pipe
2025-10-10T14:31:14.520060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 89
2025-10-10T14:31:14.520116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.520125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.520153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:14.520167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.520178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.520185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:14.520197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.520211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:14.520227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.520354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.520360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.520371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.520442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 90 partition: 0 MaxSeqNo: 40 sessionId: src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0
2025-10-10T14:31:14.520796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1767e222-7a2e2cb3-c2c60c25-34f5b92c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:14.523175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0] Write session: try to update token
2025-10-10T14:31:14.523189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:14.525798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:14.525810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.525817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600603836833321:2780]
2025-10-10T14:31:14.525845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:14.525848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:14.526007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:14.526138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.526256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.526421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.526690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:14.526723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:14.539575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId: src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:14.542067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:14.542336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.542384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.542437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:14.542519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:14.546282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:14.546294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.546298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:14.546302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:14.546315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600603836833321:2780]
2025-10-10T14:31:14.546318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600603836833321:2780]
2025-10-10T14:31:14.546328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600603836833321:2780]
2025-10-10T14:31:14.546381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:14.546386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:14.546396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.546401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:14.546435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:14.546445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:14.546602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:14.600643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600604619042352:2497]
2025-10-10T14:31:14.600865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 89, pipe: [1:7559600604619042352:2497]
2025-10-10T14:31:14.649126Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:14.655646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.655667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.655815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.655870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.655929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.655989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.656049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.656057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.656119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.656175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.656237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.656339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.656378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.656385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.656444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.656498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.656596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.656685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.656725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.656731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.656791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.656850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.657038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.657229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.657269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.657279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.657356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.657422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.657624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.657911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.658067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.658078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.658342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.658593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.658662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.658742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.658797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.658806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.658893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.658960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.659033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.659106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.659184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.659192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.659426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.659648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.659816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.659884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.659952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.659959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.660028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.660208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.660276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.660342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.660394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.660401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.660514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.660580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.660648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.660827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.660882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.660888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.660950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042352:2497], now have 1 active actors on pipe
2025-10-10T14:31:14.661149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:14.661200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600604619042352:2497]
2025-10-10T14:31:14.661239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:14.661246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:14.661278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 90 reason: error at write: Disconnected sessionId: src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0
2025-10-10T14:31:14.661509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 90 sessionId: src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0 is DEAD
2025-10-10T14:31:14.661660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:14.661671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0] Write session will restart in 0.009560s
2025-10-10T14:31:14.661702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0] Write session: Do CDS request
2025-10-10T14:31:14.661708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:14.662187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:14.670939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:14.671517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:14.671683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:14.671693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:14.671701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:14.671739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:14.671773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600603836833486:2789]
2025-10-10T14:31:14.672182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:14.672387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:14.672414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:14.672633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:14.672670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.672675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.672676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.672676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.672677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.672678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.672678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.672679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.672680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.672680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.672681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.672681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.672682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.672685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.672693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.672695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.672698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.672700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.672702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.672704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.672706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.672708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.672710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.672712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.672714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.672716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.672721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.672725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.672730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.672733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.672736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.672739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.672742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.672745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.672748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.672751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.672753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.672756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.672759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.672762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.672764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.672767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.672770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.672773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.672775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.672803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.672778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.672781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.672784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.672786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.672789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.672792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.672795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.672814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:14.672979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:14.672993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 91
2025-10-10T14:31:14.673085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.673107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 91 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:14.673114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=91 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:14.673117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:14.673488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 91 sessionId:  describe result for acl check
2025-10-10T14:31:14.673514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:14.673519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:14.673520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:14.673524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600604619042482:3011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:14.674019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600604619042482:3011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:14.675464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:14.675572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600604619042482:3011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:14.675943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:14.675955Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:14.675956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:14.675958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:14.675962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 90 [2:7559600603836833486:2789]
2025-10-10T14:31:14.675970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:14.675979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:14.675981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.675983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.675985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.675994Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:14.675999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:14.676003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:14.676038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.676044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.676046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.676047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:14.676091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:14.676097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.676104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.676110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.676123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:14.676139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042367:2438], now have 1 active actors on pipe
2025-10-10T14:31:14.676148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600603836833481:2789]
2025-10-10T14:31:14.676150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600603836833481:2789]
2025-10-10T14:31:14.676152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600603836833481:2789]
2025-10-10T14:31:14.676160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:14.676172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:14.676173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:14.676176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:14.676178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:14.676185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:14.676187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:14.676203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600603836833481:2789]
2025-10-10T14:31:14.676206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:14.676208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:14.676405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 90
2025-10-10T14:31:14.681871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600604619042482:3011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:14.681882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600604619042482:3011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:14.681884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600604619042482:3011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:14.681890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 91 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:14.682101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042522:3011], now have 1 active actors on pipe
2025-10-10T14:31:14.682160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 90
2025-10-10T14:31:14.682215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.682224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.682244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:14.682256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.682260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.682261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:14.682268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.682282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:14.682292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.682428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.682433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.682451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.682531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 91 partition: 0 MaxSeqNo: 40 sessionId: src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0
2025-10-10T14:31:14.682806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d1abec1-cc6b4724-8f55a74-35eae8a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:14.685451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0] Write session: try to update token
2025-10-10T14:31:14.685467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:14.688812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:14.688825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.688831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600603836833481:2789]
2025-10-10T14:31:14.688864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:14.688879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:14.689034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:14.689171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.689309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.689461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:14.689665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:14.689697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:14.701782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId: src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:14.704147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:14.704690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.704710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.704737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:14.704819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:14.707811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:14.707823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.707826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:14.707827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:14.707835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600603836833481:2789]
2025-10-10T14:31:14.707839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600603836833481:2789]
2025-10-10T14:31:14.707842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600603836833481:2789]
2025-10-10T14:31:14.707880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:14.707891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.707893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:14.707892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:14.707908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:14.707911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:14.708031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:14.761399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600604619042525:2497]
2025-10-10T14:31:14.761643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 90, pipe: [1:7559600604619042525:2497]
2025-10-10T14:31:14.808203Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:14.816605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.816630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.816805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.816869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.816936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.817005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.817058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.817067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.817139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.817205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.817314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.817438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.817494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.817500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.817572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.817641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.817711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.817785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.817843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.817851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.817923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.818028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.818127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.818199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.818251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.818259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.818329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.818427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.818526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.818590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.818639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.818646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.818718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.818819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.818919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.818985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.819050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.819056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.819124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.819185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.819252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.819318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.819441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.819447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.819518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.819581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.819647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.819713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.819777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.819785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.819861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.819924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.819985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.820049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.820111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.820118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.820185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:14.820244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:14.820306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:14.820371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:14.820428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:14.820438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:14.820497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042525:2497], now have 1 active actors on pipe
2025-10-10T14:31:14.820715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:14.820725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:14.820743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600604619042525:2497]
2025-10-10T14:31:14.820754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 91 reason: error at write: Disconnected sessionId: src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0
2025-10-10T14:31:14.820764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:14.820929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 91 sessionId: src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0 is DEAD
2025-10-10T14:31:14.821072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:14.821081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0] Write session will restart in 0.005182s
2025-10-10T14:31:14.821099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0] Write session: Do CDS request
2025-10-10T14:31:14.821104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:14.821384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:14.827773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.827855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:14.827866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 92
2025-10-10T14:31:14.827961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.827994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 92 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:14.828004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=92 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:14.828007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:14.828320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 92 sessionId:  describe result for acl check
2025-10-10T14:31:14.828343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:14.828348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:14.828349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:14.828353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600604619042581:3018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:14.828760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600604619042581:3018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:14.830182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:14.830730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:14.830872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:14.830884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:14.830890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:14.830921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:14.830954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600603836833657:2798]
2025-10-10T14:31:14.831162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600604619042581:3018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:14.831324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:14.831553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:14.831578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:14.831764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:14.831800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.831805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.831806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.831806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.831807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.831808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.831808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.831809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.831809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.831810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.831810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.831811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.831812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.831814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.831821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.831824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.831825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.831827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.831829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.831831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.831833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.831835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.831837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.831839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.831840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.831842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.831847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.831851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.831855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.831859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.831861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.831865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.831867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.831872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.831874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.831877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.831879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.831882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.831886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.831889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.831891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.831894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.831896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.831899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.831901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.831904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.831906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.831909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.831911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.831914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.831917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.831919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.831939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:14.834168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600604619042581:3018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:14.834178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600604619042581:3018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:14.834180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600604619042581:3018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:14.834187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 92 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:14.834233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:14.834560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:14.834570Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:14.834571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:14.834574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:14.834577Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 91 [2:7559600603836833657:2798]
2025-10-10T14:31:14.834585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:14.834595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:14.834597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.834598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.834599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.834606Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:14.834611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:14.834616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:14.834648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.834654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.834655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.834657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:14.834713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:14.834722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.834728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.834733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.834742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:14.834754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042527:2438], now have 1 active actors on pipe
2025-10-10T14:31:14.834758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042668:3018], now have 1 active actors on pipe
2025-10-10T14:31:14.834763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600603836833652:2798]
2025-10-10T14:31:14.834765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600603836833652:2798]
2025-10-10T14:31:14.834766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600603836833652:2798]
2025-10-10T14:31:14.834779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:14.834787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:14.834795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:14.834797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:14.834790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 91
2025-10-10T14:31:14.834802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:14.834804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 91
2025-10-10T14:31:14.834805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:14.834807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:14.834812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600603836833652:2798]
2025-10-10T14:31:14.834815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:14.834826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:14.834840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.834843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.834861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:14.834870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.834872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.834874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:14.834880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.834887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:14.834894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.835008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.835013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.835022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.835096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 92 partition: 0 MaxSeqNo: 40 sessionId: src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0
2025-10-10T14:31:14.835357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6a04ce-e2382838-20ebf2c2-f19f48f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:14.837913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0] Write session: try to update token
2025-10-10T14:31:14.837929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:14.851105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId: src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:14.853400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:14.854153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.854181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.854202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:14.854204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:14.854206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:14.854208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:14.854214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600603836833652:2798]
2025-10-10T14:31:14.854218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600603836833652:2798]
2025-10-10T14:31:14.854221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600603836833652:2798]
2025-10-10T14:31:14.854269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:14.854284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:14.854285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:14.854290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:14.854293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.854295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:14.854437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:14.920611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600604619042675:2497]
2025-10-10T14:31:14.920862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 91, pipe: [1:7559600604619042675:2497]
2025-10-10T14:31:14.958071Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:14.958390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:14.958444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042675:2497], now have 1 active actors on pipe
2025-10-10T14:31:14.958522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:14.958628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600604619042675:2497]
2025-10-10T14:31:14.958650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:14.967530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:14.967544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:14.967567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 92 reason: error at write: Disconnected sessionId: src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0
2025-10-10T14:31:14.967713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 92 sessionId: src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0 is DEAD
2025-10-10T14:31:14.967846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:14.967856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0] Write session will restart in 0.006575s
2025-10-10T14:31:14.967873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0] Write session: Do CDS request
2025-10-10T14:31:14.967877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:14.973377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:14.973953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:14.974158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:14.974169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:14.974179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:14.974231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:14.974273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600603836833804:2800]
2025-10-10T14:31:14.974863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:14.975179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:14.975219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:14.975433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:14.975471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.975478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.975479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.975479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.975480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.975481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.975481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.975482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.975483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.975483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.975484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.975485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.975485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.975489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.975496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.975499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.975501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.975503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.975506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.975508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.975519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.975522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.975524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.975526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.975528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.975530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.975536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.975540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:14.975545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.975549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:14.975551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.975554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:14.975557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.975561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:14.975564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.975567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:14.975570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.975573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:14.975576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.975579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:14.975582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.975586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:14.975589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.975591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:14.975594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.975597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:14.975600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.975603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.975605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.975610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.975612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.975615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.975636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:14.975849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.976068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:14.976080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 93
2025-10-10T14:31:14.976201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:14.976249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 93 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:14.976259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=93 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:14.976264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:14.976733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 93 sessionId:  describe result for acl check
2025-10-10T14:31:14.976794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:14.976805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:14.976807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:14.976835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600604619042789:3022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:14.977470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600604619042789:3022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:14.978499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:14.978886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:14.978901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:14.978904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:14.978907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:14.978913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 92 [2:7559600603836833804:2800]
2025-10-10T14:31:14.978924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:14.978937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:14.978945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.978947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.978949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.978958Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:14.978963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:14.978968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:14.979014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.979022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.979024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.979027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:14.979094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:14.979103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:14.979115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:14.979128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:14.979137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:14.979150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042676:2438], now have 1 active actors on pipe
2025-10-10T14:31:14.979161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600603836833799:2800]
2025-10-10T14:31:14.979163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600603836833799:2800]
2025-10-10T14:31:14.979165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600603836833799:2800]
2025-10-10T14:31:14.979177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:14.979191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:14.979183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 92
2025-10-10T14:31:14.979197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:14.979201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:14.979202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:14.979204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:14.979206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:14.979229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600603836833799:2800]
2025-10-10T14:31:14.979240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:14.979260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:14.979617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600604619042789:3022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:14.986545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600604619042789:3022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:14.986557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600604619042789:3022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:14.986560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600604619042789:3022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:14.986577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 93 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:14.986825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600604619042823:3022], now have 1 active actors on pipe
2025-10-10T14:31:14.986874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 92
2025-10-10T14:31:14.986923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.986932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.986955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:14.986966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:14.986972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:14.986975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:14.986992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:14.987017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:14.987033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.987180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:14.987189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:14.987203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:14.987289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 93 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0
2025-10-10T14:31:14.987647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbaa880-f02a9a13-5b6d07c9-7cf0df91_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:14.990287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0] Write session: try to update token
2025-10-10T14:31:14.990305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:15.002899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:15.002922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.002926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:15.002928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:15.002938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600603836833799:2800]
2025-10-10T14:31:15.002942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600603836833799:2800]
2025-10-10T14:31:15.002947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600603836833799:2800]
2025-10-10T14:31:15.002996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:15.003000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:15.003006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:15.003007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.003010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:15.003010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:15.003219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:15.005423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId: src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:15.007758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:15.058893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600608914010134:2497]
2025-10-10T14:31:15.059180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 92, pipe: [1:7559600608914010134:2497]
2025-10-10T14:31:15.111526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:15.112040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.112053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.112087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010134:2497], now have 1 active actors on pipe
2025-10-10T14:31:15.112329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:15.112335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:15.112363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600608914010134:2497]
2025-10-10T14:31:15.112386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:15.112389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:15.112458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 93 reason: error at write: Disconnected sessionId: src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0
2025-10-10T14:31:15.112634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 93 sessionId: src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0 is DEAD
2025-10-10T14:31:15.112813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:15.112826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0] Write session will restart in 0.005907s
2025-10-10T14:31:15.112855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0] Write session: Do CDS request
2025-10-10T14:31:15.112865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:15.119826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.119910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:15.119922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 94
2025-10-10T14:31:15.120043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.120075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 94 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:15.120083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=94 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:15.120086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:15.120526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 94 sessionId:  describe result for acl check
2025-10-10T14:31:15.120563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:15.120569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:15.120571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:15.120577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600608914010230:3027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:15.121121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600608914010230:3027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:15.122210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:15.122722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:15.122904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:15.122915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:15.122926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:15.122971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:15.123018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600608131801259:2803]
2025-10-10T14:31:15.123252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600608914010230:3027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:15.123558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:15.123874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:15.123910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:15.124197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:15.124259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.124267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.124268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.124269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.124270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.124272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.124273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.124275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.124276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.124277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.124278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.124280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.124281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.124287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.124299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.124303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.124306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.124310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.124314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.124318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.124322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.124327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.124331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.124335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.124339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.124343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.124350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.124357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.124363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.124368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.124372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.124377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.124387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.124396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.124407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.124415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.124420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.124429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.124434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.124438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.124447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.124457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.124467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.124477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.124486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.124495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.124503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.124513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.124521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.124530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.124539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.124547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.124591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:15.127296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600608914010230:3027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:15.127310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600608914010230:3027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:15.127314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600608914010230:3027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:15.127322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 94 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:15.127419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:15.128004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:15.128015Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:15.128019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:15.128023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:15.128029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 93 [2:7559600608131801259:2803]
2025-10-10T14:31:15.128041Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:15.128062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:15.128068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.128071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.128074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.128089Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:15.128100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:15.128110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:15.128164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.128171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.128174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.128176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:15.128247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:15.128254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.128264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.128279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.128299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:15.128322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010281:3027], now have 1 active actors on pipe
2025-10-10T14:31:15.128330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010135:2438], now have 1 active actors on pipe
2025-10-10T14:31:15.128324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 93
2025-10-10T14:31:15.128336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600608131801254:2803]
2025-10-10T14:31:15.128324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 93
2025-10-10T14:31:15.128344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600608131801254:2803]
2025-10-10T14:31:15.128346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600608131801254:2803]
2025-10-10T14:31:15.128355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:15.128371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:15.128370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:15.128373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:15.128374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:15.128390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:15.128393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:15.128436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.128444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.128455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600608131801254:2803]
2025-10-10T14:31:15.128468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:15.128484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:15.128501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:15.128507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.128511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.128518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:15.128527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.128539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:15.128562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.128713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.128718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.128730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.128819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 94 partition: 0 MaxSeqNo: 40 sessionId: src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0
2025-10-10T14:31:15.129134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1693a84-cf9c63eb-b6871e5a-642ed9f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:15.131737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0] Write session: try to update token
2025-10-10T14:31:15.131754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:15.145668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId: src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:15.148168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:15.148394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.148421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.148456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:15.148556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:15.152260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:15.152279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.152281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:15.152283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:15.152294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600608131801254:2803]
2025-10-10T14:31:15.152298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600608131801254:2803]
2025-10-10T14:31:15.152302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600608131801254:2803]
2025-10-10T14:31:15.152344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:15.152351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:15.152361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.152361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:15.152363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:15.152368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:15.152520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:15.212490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600608914010288:2497]
2025-10-10T14:31:15.212747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 93, pipe: [1:7559600608914010288:2497]
2025-10-10T14:31:15.261890Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:15.270537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.270567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.270748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.270818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.270919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.270991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.271045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.271052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.271126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.271190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.271290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.271390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.271829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.271837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.271910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.271978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.272042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.272110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.272162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.272169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.272241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.272306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.272376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.272452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.272503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.272508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.272578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.272640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.272704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.272769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.272824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.272829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.272900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.272962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.273025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.273092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.273215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.273220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.273289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.273370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.273447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.273513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.273655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.273660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.273732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.273796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.273858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.273924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.273975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.273980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.274051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.274126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.274191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.274256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.274309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.274315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.274384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.274447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.274514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.274578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.274629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.274634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.274693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010288:2497], now have 1 active actors on pipe
2025-10-10T14:31:15.274980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600608914010288:2497]
2025-10-10T14:31:15.275002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:15.275025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:15.275027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:15.275054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 94 reason: error at write: Disconnected sessionId: src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0
2025-10-10T14:31:15.275240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 94 sessionId: src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0 is DEAD
2025-10-10T14:31:15.275393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:15.275405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0] Write session will restart in 0.009531s
2025-10-10T14:31:15.275452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0] Write session: Do CDS request
2025-10-10T14:31:15.275459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:15.275567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:15.285094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:15.285687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:15.285845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.285855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:15.285865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:15.285875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:15.285924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:15.285969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600608131801408:2805]
2025-10-10T14:31:15.285952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:15.285966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 95
2025-10-10T14:31:15.286076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.286103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 95 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:15.286107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=95 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:15.286110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:15.286543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 95 sessionId:  describe result for acl check
2025-10-10T14:31:15.286593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:15.286592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:15.286601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:15.286608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:15.286616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600608914010400:3031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:15.286872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:15.286914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:15.287199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:15.287258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.287264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.287265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.287266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.287268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.287269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.287270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.287272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.287273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.287273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.287274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.287275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.287276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.287281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.287292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.287296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.287300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.287303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.287307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.287311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.287315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.287319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.287323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.287327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.287335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.287340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.287350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.287361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.287368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.287378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.287386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.287392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.287401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.287411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.287417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.287426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.287430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.287437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.287446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.287455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.287463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.287472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.287480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.287489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.287498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.287507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.287515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.287520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.287528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.287533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.287538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.287547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.287589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:15.287702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600608914010400:3031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:15.289782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600608914010400:3031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:15.290033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:15.290413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:15.290425Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:15.290427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:15.290432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:15.290438Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 94 [2:7559600608131801408:2805]
2025-10-10T14:31:15.290450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:15.290471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:15.290477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.290481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.290483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.290496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:15.290502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:15.290508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:15.290559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.290566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.290568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.290570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:15.290637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:15.290644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.290656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.290671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.290692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:15.290695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 94
2025-10-10T14:31:15.290716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010289:2438], now have 1 active actors on pipe
2025-10-10T14:31:15.290727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600608131801403:2805]
2025-10-10T14:31:15.290729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600608131801403:2805]
2025-10-10T14:31:15.290732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600608131801403:2805]
2025-10-10T14:31:15.290749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:15.290765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:15.290767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:15.290778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:15.290779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:15.290783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:15.290785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:15.290805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600608131801403:2805]
2025-10-10T14:31:15.290819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:15.290824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:15.296953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600608914010400:3031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:15.296968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600608914010400:3031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:15.296972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600608914010400:3031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:15.296980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 95 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:15.297259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 94
2025-10-10T14:31:15.297234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010438:3031], now have 1 active actors on pipe
2025-10-10T14:31:15.297322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.297349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.297377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:15.297391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.297396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.297399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:15.297412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.297430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:15.297450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.297591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.297599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.297611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.297673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 95 partition: 0 MaxSeqNo: 40 sessionId: src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0
2025-10-10T14:31:15.298035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d20049-81e8d702-350d01a7-ff8e34c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:15.300521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0] Write session: try to update token
2025-10-10T14:31:15.300537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:15.303772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:15.303790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.303798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600608131801403:2805]
2025-10-10T14:31:15.303846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:15.303848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:15.304032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:15.304185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.304336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.304488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.304716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:15.304755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:15.314226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId: src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:15.316417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:15.316606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.316628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.316663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:15.316732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:15.321284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:15.321299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.321303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:15.321306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:15.321316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600608131801403:2805]
2025-10-10T14:31:15.321320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600608131801403:2805]
2025-10-10T14:31:15.321325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600608131801403:2805]
2025-10-10T14:31:15.321376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:15.321387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:15.321393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:15.321396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:15.321397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.321400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:15.321553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:15.375289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600608914010441:2497]
2025-10-10T14:31:15.375497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 94, pipe: [1:7559600608914010441:2497]
2025-10-10T14:31:15.429119Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:15.438052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.438094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.438267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.438347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.438419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.438487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.438545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.438554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.438627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.438691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.438759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.438830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.438885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.438891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.438964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.439031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.439130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.439205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.439269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.439278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.439351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.439418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.439486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.439555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.439609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.439616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.439687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.439758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.439831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.439909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.439966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.439973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.440049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.440114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.440184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.440252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.440320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.440330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.440401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.440470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.440540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.440612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.440668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.440675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.440746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.440810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.440878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.440946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.441022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.441030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.441099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.441170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.441238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.441304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.441375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.441384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.441452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.441521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.441594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.441660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.441729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.441736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.441788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010441:2497], now have 1 active actors on pipe
2025-10-10T14:31:15.442021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600608914010441:2497]
2025-10-10T14:31:15.442038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:15.442043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:15.442046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:15.442086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 95 reason: error at write: Disconnected sessionId: src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0
2025-10-10T14:31:15.442287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 95 sessionId: src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0 is DEAD
2025-10-10T14:31:15.442385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:15.442396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0] Write session will restart in 0.008169s
2025-10-10T14:31:15.442423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0] Write session: Do CDS request
2025-10-10T14:31:15.442428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:15.442751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:15.451765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.451869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:15.451881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 96
2025-10-10T14:31:15.452020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.452055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 96 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:15.452062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=96 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:15.452065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:15.452264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:15.452506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 96 sessionId:  describe result for acl check
2025-10-10T14:31:15.452545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:15.452549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:15.452551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:15.452555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600608914010554:3035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:15.452870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:15.452972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600608914010554:3035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:15.453040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:15.453051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:15.453060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:15.453100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:15.453149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600608131801558:2807]
2025-10-10T14:31:15.453610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:15.453916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:15.453957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:15.454273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:15.454326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.454334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.454335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.454336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.454337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.454338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.454339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.454341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.454342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.454343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.454344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.454345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.454347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.454352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.454363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.454367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.454371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.454375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.454379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.454382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.454386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.454390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.454395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.454399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.454403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.454407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.454412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.454420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.454427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.454433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.454437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.454442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.454449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.454454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.454459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.454464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.454468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.454473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.454478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.454486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.454491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.454501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.454506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.454511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.454520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.454526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.454530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.454535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.454545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.454551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.454558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.454563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.454607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:15.454979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600608914010554:3035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:15.456843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:15.457130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600608914010554:3035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:15.457142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600608914010554:3035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:15.457145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600608914010554:3035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:15.457152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 96 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:15.457202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:15.457217Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:15.457219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:15.457223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:15.457228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 95 [2:7559600608131801558:2807]
2025-10-10T14:31:15.457239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:15.457250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:15.457251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.457253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.457254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.457263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:15.457268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:15.457273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:15.457319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.457342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.457344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.457346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:15.457407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:15.457416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.457427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.457439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.457462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:15.457478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010588:3035], now have 1 active actors on pipe
2025-10-10T14:31:15.457486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010442:2438], now have 1 active actors on pipe
2025-10-10T14:31:15.457491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600608131801553:2807]
2025-10-10T14:31:15.457493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600608131801553:2807]
2025-10-10T14:31:15.457494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600608131801553:2807]
2025-10-10T14:31:15.457507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:15.457498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 95
2025-10-10T14:31:15.457515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:15.457529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:15.457531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:15.457533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:15.457536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:15.457538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:15.457552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600608131801553:2807]
2025-10-10T14:31:15.457559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:15.457563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:15.457644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 95
2025-10-10T14:31:15.457692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.457703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.457723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d91e50a-d11087f0-1be5712e-2737f26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:15.457734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.457738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.457740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:15.457746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.457753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:15.457764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.457907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.457915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.457925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.458002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 96 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d91e50a-d11087f0-1be5712e-2737f26_0
2025-10-10T14:31:15.458289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20824b6f-76a0391d-c7f4f312-4a390aec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d91e50a-d11087f0-1be5712e-2737f26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:15.460839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d91e50a-d11087f0-1be5712e-2737f26_0] Write session: try to update token
2025-10-10T14:31:15.460855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d91e50a-d11087f0-1be5712e-2737f26_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:15.468663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:15.468683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.468690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600608131801553:2807]
2025-10-10T14:31:15.468733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:15.468734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:15.468921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:15.469080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.469240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.469409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.469640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:15.469681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:15.475228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId: src_id|7d91e50a-d11087f0-1be5712e-2737f26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:15.477608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:15.477782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.477799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.477821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:15.477934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:15.485784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:15.485802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.485804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:15.485806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:15.485812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600608131801553:2807]
2025-10-10T14:31:15.485816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600608131801553:2807]
2025-10-10T14:31:15.485821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600608131801553:2807]
2025-10-10T14:31:15.485870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:15.485877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:15.485881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.485883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:15.485884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:15.485888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:15.486020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:15.542198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600608914010602:2497]
2025-10-10T14:31:15.542444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 95, pipe: [1:7559600608914010602:2497]
2025-10-10T14:31:15.589819Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:15.598214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.598238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.598426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.598502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.598565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.598633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.598696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.598705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.598778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.598839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.598932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.599001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.599056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.599063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.599133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.599199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.599277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.599343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.599397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.599404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.599472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.599534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.599595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.599669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.599727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.599736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.599804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.599862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.599928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.599993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.600044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.600054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.600119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.600179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.600247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.600326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.600378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.600384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.600452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.600511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.600579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.600646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.600699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.600706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.600775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.600838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.600911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.600976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.601027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.601033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.601099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.601271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.601355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.601419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.601471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.601477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.601543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.601605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.601670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.601740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.601790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.601796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.601850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010602:2497], now have 1 active actors on pipe
2025-10-10T14:31:15.602107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600608914010602:2497]
2025-10-10T14:31:15.602112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:15.602128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:15.602133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:15.602158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 96 reason: error at write: Disconnected sessionId: src_id|7d91e50a-d11087f0-1be5712e-2737f26_0
2025-10-10T14:31:15.602381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 96 sessionId: src_id|7d91e50a-d11087f0-1be5712e-2737f26_0 is DEAD
2025-10-10T14:31:15.602543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d91e50a-d11087f0-1be5712e-2737f26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:15.602554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d91e50a-d11087f0-1be5712e-2737f26_0] Write session will restart in 0.008913s
2025-10-10T14:31:15.602582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d91e50a-d11087f0-1be5712e-2737f26_0] Write session: Do CDS request
2025-10-10T14:31:15.602587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d91e50a-d11087f0-1be5712e-2737f26_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:15.602621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:15.612718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:15.612886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d91e50a-d11087f0-1be5712e-2737f26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.613007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:15.613021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 97
2025-10-10T14:31:15.613173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.613202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 97 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:15.613212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=97 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:15.613216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:15.613271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:15.613455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:15.613466Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:15.613474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:15.613512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:15.613554Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600608131801711:2810]
2025-10-10T14:31:15.613607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 97 sessionId:  describe result for acl check
2025-10-10T14:31:15.613638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:15.613643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:15.613644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:15.613648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600608914010718:3041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:15.614048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:15.614106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600608914010718:3041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:15.614293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:15.614325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:15.614537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:15.614578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.614584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.614584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.614585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.614585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.614586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.614587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.614587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.614588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.614588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.614589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.614590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.614590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.614594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.614601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.614603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.614605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.614607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.614609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.614611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.614613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.614615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.614617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.614619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.614620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.614622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.614628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.614632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.614636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.614640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.614643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.614646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.614648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.614652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.614654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.614657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.614659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.614662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.614665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.614667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.614670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.614672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.614675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.614677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.614680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.614682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.614685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.614688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.614690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.614693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.614696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.614698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.614717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:15.616658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600608914010718:3041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:15.616765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:15.617098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:15.617109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:15.617111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:15.617113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:15.617117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 96 [2:7559600608131801711:2810]
2025-10-10T14:31:15.617125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:15.617135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:15.617137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.617138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.617140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.617149Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:15.617153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:15.617158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:15.617194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.617202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.617203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.617205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:15.617255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:15.617262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.617269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.617276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.617284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:15.617296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010606:2438], now have 1 active actors on pipe
2025-10-10T14:31:15.617305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600608131801706:2810]
2025-10-10T14:31:15.617307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600608131801706:2810]
2025-10-10T14:31:15.617308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600608131801706:2810]
2025-10-10T14:31:15.617319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:15.617343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:15.617354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:15.617356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:15.617359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:15.617367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:15.617371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 96
2025-10-10T14:31:15.617369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:15.617374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600608131801706:2810]
2025-10-10T14:31:15.617377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:15.617380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:15.622486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600608914010718:3041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:15.622500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600608914010718:3041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:15.622504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600608914010718:3041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:15.622512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 97 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:15.622784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 96
2025-10-10T14:31:15.622769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010757:3041], now have 1 active actors on pipe
2025-10-10T14:31:15.622849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.622859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.622881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:15.622896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.622901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.622903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:15.622913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.622924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:15.622942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.623131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.623137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.623148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.623262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 97 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0
2025-10-10T14:31:15.623596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d91e50a-d11087f0-1be5712e-2737f26_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:15.626260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0] Write session: try to update token
2025-10-10T14:31:15.626278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:15.631332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:15.631350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.631355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600608131801706:2810]
2025-10-10T14:31:15.631388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:15.631392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:15.631572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:15.631729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.631880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.632035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.632260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:15.632297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:15.639513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId: src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:15.641812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:15.641994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.642014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.642038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:15.642147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:15.648837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:15.648852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.648855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:15.648858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:15.648866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600608131801706:2810]
2025-10-10T14:31:15.648871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600608131801706:2810]
2025-10-10T14:31:15.648875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600608131801706:2810]
2025-10-10T14:31:15.648921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:15.648929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:15.648933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.648935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:15.648950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:15.648955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:15.649080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:15.702477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600608914010773:2497]
2025-10-10T14:31:15.702715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 96, pipe: [1:7559600608914010773:2497]
2025-10-10T14:31:15.749803Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:15.758503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.758528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.758704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.758768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.758834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.758902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.758961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.758973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.759059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.759120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.759188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.759303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.759358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.759366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.759445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.759546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.759661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.759727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.759777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.759782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.759853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.759916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.759980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.760046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.760105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.760114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.760198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.760299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.760363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.760440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.760491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.760497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.760569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.760632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.760720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.760787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.760841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.760847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.760916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.760979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.761045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.761107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.761161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.761168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.761243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.761314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.761404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.761477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.761535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.761543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.761617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.761679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.761750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.761828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.761880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.761888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.761968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:15.762034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:15.762107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:15.762173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:15.762225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:15.762230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:15.762283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010773:2497], now have 1 active actors on pipe
2025-10-10T14:31:15.762540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:15.762574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600608914010773:2497]
2025-10-10T14:31:15.762586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:15.762588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:15.762614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 97 reason: error at write: Disconnected sessionId: src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0
2025-10-10T14:31:15.762811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 97 sessionId: src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0 is DEAD
2025-10-10T14:31:15.762967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:15.762980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0] Write session will restart in 0.006276s
2025-10-10T14:31:15.763010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0] Write session: Do CDS request
2025-10-10T14:31:15.763016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:15.763059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:15.770771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.770850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:15.770862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 98
2025-10-10T14:31:15.770976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.771002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 98 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:15.771010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=98 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:15.771013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:15.771444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 98 sessionId:  describe result for acl check
2025-10-10T14:31:15.771480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:15.771487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:15.771488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:15.771494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600608914010895:3054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:15.772047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600608914010895:3054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:15.772288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:15.772906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:15.773043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:15.773051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:15.773058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:15.773091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:15.773130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600608131801901:2825]
2025-10-10T14:31:15.773725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:15.773842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600608914010895:3054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:15.773967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:15.774014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:15.774328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:15.774386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.774392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.774393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.774393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.774394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.774395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.774396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.774397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.774398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.774399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.774400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.774401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.774402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.774407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.774418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.774422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.774425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.774428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.774431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.774434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.774437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.774441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.774444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.774447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.774450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.774454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.774461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.774469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.774474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.774480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.774484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.774489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.774493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.774499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.774503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.774507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.774511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.774516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.774526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.774531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.774540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.774545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.774553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.774558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.774561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.774566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.774570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.774579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.774583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.774588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.774597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.774601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.774638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:15.776646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600608914010895:3054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:15.776659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600608914010895:3054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:15.776663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600608914010895:3054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:15.776671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 98 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:15.776737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:15.777090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:15.777101Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:15.777102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:15.777104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:15.777108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 97 [2:7559600608131801901:2825]
2025-10-10T14:31:15.777119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:15.777129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:15.777130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.777132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.777133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.777142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:15.777149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:15.777154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:15.777190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.777195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.777196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.777197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:15.777247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:15.777253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.777259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.777266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.777276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:15.777292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010932:3054], now have 1 active actors on pipe
2025-10-10T14:31:15.777298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010785:2438], now have 1 active actors on pipe
2025-10-10T14:31:15.777304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600608131801896:2825]
2025-10-10T14:31:15.777306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600608131801896:2825]
2025-10-10T14:31:15.777308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600608131801896:2825]
2025-10-10T14:31:15.777323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:15.777324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 97
2025-10-10T14:31:15.777346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:15.777350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:15.777359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:15.777360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:15.777361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:15.777362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:15.777369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 97
2025-10-10T14:31:15.777388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.777398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.777408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600608131801896:2825]
2025-10-10T14:31:15.777416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:15.777438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:15.777441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:15.777446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.777448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.777450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:15.777456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.777464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:15.777480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.777625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.777632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.777641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.777717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 98 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0
2025-10-10T14:31:15.778009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b7dc646-24f4b1aa-2a0cfb01-4520d6c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:15.780458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0] Write session: try to update token
2025-10-10T14:31:15.780472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:15.793641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId: src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:15.795954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:15.797282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.797308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.797326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:15.797344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.797348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:15.797350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:15.797358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600608131801896:2825]
2025-10-10T14:31:15.797362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600608131801896:2825]
2025-10-10T14:31:15.797368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600608131801896:2825]
2025-10-10T14:31:15.797421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:15.797433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:15.797440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.797441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:15.797443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:15.797445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:15.797594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:15.862725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600608914010940:2497]
2025-10-10T14:31:15.862980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 97, pipe: [1:7559600608914010940:2497]
2025-10-10T14:31:15.905653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:15.906357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:15.906422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010940:2497], now have 1 active actors on pipe
2025-10-10T14:31:15.906491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:15.906623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600608914010940:2497]
2025-10-10T14:31:15.906658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:15.915197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:15.915211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:15.915230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 98 reason: error at write: Disconnected sessionId: src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0
2025-10-10T14:31:15.915359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 98 sessionId: src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0 is DEAD
2025-10-10T14:31:15.915494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:15.915500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0] Write session will restart in 0.008688s
2025-10-10T14:31:15.915518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0] Write session: Do CDS request
2025-10-10T14:31:15.915523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:15.920451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:15.920993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:15.921122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:15.921133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:15.921142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:15.921178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:15.921221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600608131802055:2827]
2025-10-10T14:31:15.921598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:15.921805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:15.921832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:15.922028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:15.922078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.922080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.922081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.922082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.922083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.922084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.922085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.922085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.922086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.922087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.922088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.922088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.922089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.922092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.922100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.922103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.922105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.922107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.922109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.922111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.922113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.922115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.922117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.922119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.922121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.922123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.922130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.922135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:15.922139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.922143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:15.922146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.922149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:15.922151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.922154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:15.922157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.922160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:15.922162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.922165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:15.922169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.922173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:15.922175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.922178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:15.922180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.922183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:15.922186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.922189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:15.922191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.922194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.922197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.922200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.922202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.922205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.922230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:15.924277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:15.924690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:15.924709Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:15.924710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:15.924713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:15.924718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 98 [2:7559600608131802055:2827]
2025-10-10T14:31:15.924727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:15.924741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:15.924749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.924761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.924762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.924775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:15.924785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:15.924792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:15.924833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.924841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.924843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.924844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:15.924908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:15.924914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.924922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:15.924929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:15.924939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:15.924961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914010941:2438], now have 1 active actors on pipe
2025-10-10T14:31:15.924967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600608131802050:2827]
2025-10-10T14:31:15.924973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600608131802050:2827]
2025-10-10T14:31:15.924974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600608131802050:2827]
2025-10-10T14:31:15.924985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:15.924994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:15.925002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:15.925005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:15.925008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:15.925009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:15.925011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:15.925030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600608131802050:2827]
2025-10-10T14:31:15.925039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:15.925046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:15.925223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 98
2025-10-10T14:31:15.925837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.925908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:15.925919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 99
2025-10-10T14:31:15.926049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:15.926087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 99 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:15.926095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=99 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:15.926107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:15.926430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 99 sessionId:  describe result for acl check
2025-10-10T14:31:15.926455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:15.926461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:15.926463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:15.926468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600608914011064:3058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:15.926889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600608914011064:3058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:15.928787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600608914011064:3058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:15.933913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600608914011064:3058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:15.933925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600608914011064:3058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:15.933928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600608914011064:3058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:15.933934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 99 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:15.934137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600608914011093:3058], now have 1 active actors on pipe
2025-10-10T14:31:15.934164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 98
2025-10-10T14:31:15.934225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.934241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.934272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:15.934289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:15.934294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:15.934296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:15.934306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:15.934319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:15.934333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.934466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:15.934474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:15.934485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:15.934546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 99 partition: 0 MaxSeqNo: 40 sessionId: src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0
2025-10-10T14:31:15.934841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b611e2-e900d7e9-a191cde3-ac8f6fd4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:15.935338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:15.935352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.935359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600608131802050:2827]
2025-10-10T14:31:15.935388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:15.935390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:15.935562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:15.935728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.935867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.936022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:15.936194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:15.936229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:15.937375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0] Write session: try to update token
2025-10-10T14:31:15.937389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:15.950304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId: src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:15.952443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:15.952462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:15.952464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:15.952465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:15.952473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600608131802050:2827]
2025-10-10T14:31:15.952476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600608131802050:2827]
2025-10-10T14:31:15.952479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600608131802050:2827]
2025-10-10T14:31:15.952516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:15.952519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:15.952521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:15.952523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:15.952524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:15.952527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:15.952639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:15.952756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:16.006602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600613208978393:2497]
2025-10-10T14:31:16.006818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 98, pipe: [1:7559600613208978393:2497]
2025-10-10T14:31:16.057113Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:16.057409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.057428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.057449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978393:2497], now have 1 active actors on pipe
2025-10-10T14:31:16.057650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:16.057663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:16.057675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600613208978393:2497]
2025-10-10T14:31:16.057701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:16.057774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 99 reason: status is not ok: tablet will be restarted right now sessionId: src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0
2025-10-10T14:31:16.057992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 99 sessionId: src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0 is DEAD
2025-10-10T14:31:16.058153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:16.058164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0] Write session will restart in 0.005195s
2025-10-10T14:31:16.058183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0] Write session: Do CDS request
2025-10-10T14:31:16.058188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:16.064701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.064872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:16.064885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 100
2025-10-10T14:31:16.065021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.065054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:16.065063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:16.065066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:16.065515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 100 sessionId:  describe result for acl check
2025-10-10T14:31:16.065547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:16.065554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:16.065556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:16.065562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600613208978460:3063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:16.066108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600613208978460:3063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:16.067760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:16.067830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600613208978460:3063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:16.068322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:16.068479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:16.068490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:16.068498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:16.068535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:16.068582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600612426769516:2830]
2025-10-10T14:31:16.068966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:16.069184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:16.069215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:16.069419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:16.069456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.069462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.069463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.069463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.069464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.069465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.069465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.069466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.069466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.069467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.069468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.069468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.069469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.069473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.069481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.069483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.069486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.069488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.069491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.069493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.069495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.069497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.069500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.069502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.069504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.069506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.069511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.069516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.069521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.069524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.069527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.069530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.069532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.069535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.069538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.069541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.069543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.069547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.069550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.069553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.069555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.069558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.069561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.069564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.069567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.069569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.069583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.069588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.069592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.069597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.069603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.069608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.069630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:16.070017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600613208978460:3063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:16.070027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600613208978460:3063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:16.070030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600613208978460:3063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:16.070035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:16.071579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:16.071959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:16.071967Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:16.071969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:16.071971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:16.071975Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 99 [2:7559600612426769516:2830]
2025-10-10T14:31:16.071984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:16.071996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:16.072003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.072005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.072007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.072027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:16.072037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:16.072042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:16.072082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.072088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.072089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.072091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:16.072150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:16.072158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.072181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.072187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.072196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:16.072212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978406:2438], now have 1 active actors on pipe
2025-10-10T14:31:16.072215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978555:3063], now have 1 active actors on pipe
2025-10-10T14:31:16.072220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600612426769511:2830]
2025-10-10T14:31:16.072223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600612426769511:2830]
2025-10-10T14:31:16.072224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600612426769511:2830]
2025-10-10T14:31:16.072233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:16.072246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:16.072237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 99
2025-10-10T14:31:16.072260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:16.072246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 99
2025-10-10T14:31:16.072262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:16.072265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:16.072265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:16.072267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:16.072300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.072306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.072316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600612426769511:2830]
2025-10-10T14:31:16.072322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:16.072332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:16.072349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:16.072357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.072360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.072361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:16.072369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.072381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:16.072400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.072549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.072556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.072567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.072648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 100 partition: 0 MaxSeqNo: 40 sessionId: src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0
2025-10-10T14:31:16.072988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|428e5f9d-b9176c67-dcd24639-c8c361ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:16.075566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0] Write session: try to update token
2025-10-10T14:31:16.075581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:16.089796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId: src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:16.090874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:16.090895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:16.090898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:16.090900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:16.090909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600612426769511:2830]
2025-10-10T14:31:16.090914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600612426769511:2830]
2025-10-10T14:31:16.090918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600612426769511:2830]
2025-10-10T14:31:16.090955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:16.090960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:16.090962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:16.090966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:16.090974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.090977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:16.091101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:16.092277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:16.157657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600613208978563:2497]
2025-10-10T14:31:16.157898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 99, pipe: [1:7559600613208978563:2497]
2025-10-10T14:31:16.193611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:16.193899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.193915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.193961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978563:2497], now have 1 active actors on pipe
2025-10-10T14:31:16.194151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:16.194214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600613208978563:2497]
2025-10-10T14:31:16.194215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:16.194249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:16.194323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 100 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0
2025-10-10T14:31:16.194543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 100 sessionId: src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0 is DEAD
2025-10-10T14:31:16.194658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:16.194673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0] Write session will restart in 0.009045s
2025-10-10T14:31:16.194691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0] Write session: Do CDS request
2025-10-10T14:31:16.194695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:16.203518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:16.204029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:16.204193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:16.204205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:16.204215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:16.204275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:16.204319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600612426769671:2832]
2025-10-10T14:31:16.204770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.204851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:16.204864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 101
2025-10-10T14:31:16.204886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:16.204993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.205022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:16.205032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:16.205035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:16.205122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:16.205163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:16.205427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:16.205463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 101 sessionId:  describe result for acl check
2025-10-10T14:31:16.205479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.205485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.205486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.205494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:16.205487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.205488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.205498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:16.205489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.205491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.205492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.205500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:16.205493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.205504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600613208978682:3067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:16.205494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.205495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.205496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.205496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.205502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.205515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.205520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.205524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.205529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.205533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.205537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.205542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.205545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.205550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.205554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.205558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.205562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.205569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.205578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.205590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.205596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.205606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.205612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.205615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.205621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.205629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.205634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.205640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.205646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.205652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.205659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.205666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.205672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.205677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.205684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.205689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.205698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.205703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.205710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.205715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.205724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.205729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.205738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.205778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:16.205916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600613208978682:3067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:16.207800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:16.208002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600613208978682:3067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:16.208214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:16.208224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:16.208225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:16.208229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:16.208235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 100 [2:7559600612426769671:2832]
2025-10-10T14:31:16.208246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:16.208262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:16.208271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.208274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.208276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.208290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:16.208303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:16.208312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:16.208358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.208365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.208367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.208369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:16.208436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:16.208444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.208456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.208470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.208490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:16.208514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600612426769666:2832]
2025-10-10T14:31:16.208520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600612426769666:2832]
2025-10-10T14:31:16.208522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600612426769666:2832]
2025-10-10T14:31:16.208536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:16.208554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:16.208574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:16.208574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:16.208577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:16.208579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:16.208580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:16.208601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600612426769666:2832]
2025-10-10T14:31:16.208608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:16.208630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:16.208676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978564:2438], now have 1 active actors on pipe
2025-10-10T14:31:16.208705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 100
2025-10-10T14:31:16.212815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600613208978682:3067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:16.212825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600613208978682:3067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:16.212828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600613208978682:3067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:16.212834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:16.213032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978718:3067], now have 1 active actors on pipe
2025-10-10T14:31:16.213101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 100
2025-10-10T14:31:16.213151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.213169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.213203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:16.213226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.213235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.213238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:16.213252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.213272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:16.213299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.213465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.213471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.213485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.213573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 101 partition: 0 MaxSeqNo: 40 sessionId: src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0
2025-10-10T14:31:16.213866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b4e682-30a25a62-ce6ec91a-33d4c48a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:16.216339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0] Write session: try to update token
2025-10-10T14:31:16.216355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:16.226316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:16.226334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:16.226337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:16.226340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:16.226349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600612426769666:2832]
2025-10-10T14:31:16.226354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600612426769666:2832]
2025-10-10T14:31:16.226358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600612426769666:2832]
2025-10-10T14:31:16.226402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:16.226404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:16.226407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:16.226412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:16.226412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.226415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:16.226544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:16.229060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId: src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:16.231393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:16.294339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 18 EndOffset 39 InitDone 1 WaitForData 0, pipe: [1:7559600613208978725:2497]
2025-10-10T14:31:16.294607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 100, pipe: [1:7559600613208978725:2497]
2025-10-10T14:31:16.328359Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:16.328695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.328713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.328761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978725:2497], now have 1 active actors on pipe
2025-10-10T14:31:16.328924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:16.328993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:16.329018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600613208978725:2497]
2025-10-10T14:31:16.329037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:16.329039Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:31:16.329099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 101 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0
2025-10-10T14:31:16.329163Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_9932294251438491411_v1 is DEAD
2025-10-10T14:31:16.329183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 101 sessionId: src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0 is DEAD
2025-10-10T14:31:16.329284Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457552:2490] disconnected; active server actors: 1
2025-10-10T14:31:16.329292Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600548784457552:2490] client user disconnected session shared/user_1_1_9932294251438491411_v1
2025-10-10T14:31:16.329486Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:31:16.329487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:16.329524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0] Write session will restart in 0.006183s
2025-10-10T14:31:16.329550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0] Write session: Do CDS request
2025-10-10T14:31:16.329555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:16.329661Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 9011748, ReadSizeServerDelta = -8487460
2025-10-10T14:31:16.329666Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:16.329684Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.008854s
2025-10-10T14:31:16.336806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.336896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:16.336923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 102
2025-10-10T14:31:16.337046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.337082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:16.337092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:16.337096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:16.337503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 102 sessionId:  describe result for acl check
2025-10-10T14:31:16.337540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:16.337542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:16.337544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:16.337550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600613208978817:3073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:16.338126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600613208978817:3073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:16.339053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:16.339657Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:31:16.339725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:16.339792Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:16.339801Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-10T14:31:16.339899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:16.339912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:16.339924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:16.339955Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:16.339986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:16.340004Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:16.340028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600612426769826:2834]
2025-10-10T14:31:16.340081Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 auth for : user
2025-10-10T14:31:16.340197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600613208978817:3073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:16.340259Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 Handle describe topics response
2025-10-10T14:31:16.340282Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 auth is DEAD
2025-10-10T14:31:16.340302Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:16.340575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:16.340582Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:16.340645Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_2_8230090722560249550_v1
2025-10-10T14:31:16.340670Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600613208978867:3077] connected; active server actors: 1
2025-10-10T14:31:16.340681Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600613208978867:3077] session shared/user_1_2_8230090722560249550_v1
2025-10-10T14:31:16.340688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:31:16.340698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:31:16.340706Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_8230090722560249550_v1" (Sender=[1:7559600613208978862:3077], Pipe=[1:7559600613208978867:3077], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:16.340708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:16.340717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:31:16.340723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_8230090722560249550_v1" (Sender=[1:7559600613208978862:3077], Pipe=[1:7559600613208978867:3077], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:16.340732Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_8230090722560249550_v1" sender [1:7559600613208978862:3077] lock partition 0 for ReadingSession "shared/user_1_2_8230090722560249550_v1" (Sender=[1:7559600613208978862:3077], Pipe=[1:7559600613208978867:3077], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-10T14:31:16.340738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:31:16.340741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-10T14:31:16.340851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:16.340899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:16.340915Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_8230090722560249550_v1" ClientId: "user" PipeClient { RawX1: 7559600613208978867 RawX2: 4503603922340869 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:16.340936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:16.341143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:16.341202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.341208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.341208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.341209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.341210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.341210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.341211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.341212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.341212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.341213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.341214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.341214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.341215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.341220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.341228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.341230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.341233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.341235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.341237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.341240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.341242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.341244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.341246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.341249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.341251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.341253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.341259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.341264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.341270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.341277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.341280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.341283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.341286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.341289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.341292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.341295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.341298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.341305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.341308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.341311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.341314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.341317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.341321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.341327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.341347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.341358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.341366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.341371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.341378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.341381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.341384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.341387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.341413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:16.343619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600613208978817:3073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:16.343630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:16.343633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600613208978817:3073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:16.343637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600613208978817:3073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:16.343647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:16.344206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:16.344219Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:16.344221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:16.344223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:16.344228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 101 [2:7559600612426769826:2834]
2025-10-10T14:31:16.344236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:16.344250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:16.344252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.344254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.344255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.344268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:16.344273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:16.344279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:16.344320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.344326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.344328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.344329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:16.344386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:16.344392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.344400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.344407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.344417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:16.344439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978876:3080], now have 1 active actors on pipe
2025-10-10T14:31:16.344445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978726:2438], now have 1 active actors on pipe
2025-10-10T14:31:16.344447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978884:3073], now have 1 active actors on pipe
2025-10-10T14:31:16.344455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600612426769821:2834]
2025-10-10T14:31:16.344457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600612426769821:2834]
2025-10-10T14:31:16.344458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600612426769821:2834]
2025-10-10T14:31:16.344470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:16.344480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:16.344482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:16.344492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:16.344496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:16.344507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:16.344515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:16.344508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 101
2025-10-10T14:31:16.344539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600612426769821:2834]
2025-10-10T14:31:16.344546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:16.344509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 101, pipe: [1:7559600613208978876:3080]
2025-10-10T14:31:16.344549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:16.344525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 101
2025-10-10T14:31:16.344563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.344572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.344582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_8230090722560249550_v1 on pipe: [1:7559600613208978876:3080]
2025-10-10T14:31:16.344607Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_8230090722560249550_v1:1 with generation 101
2025-10-10T14:31:16.344618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.344619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.344627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.344631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.344632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:16.344646Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_8230090722560249550_v1
2025-10-10T14:31:16.344653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.344691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:16.344701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:16.344706Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:16.348536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:16.348568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:16.348579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.348586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.348593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:16.348606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.348621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:16.348632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:16.348647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:16.348667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.348799Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106676343 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:16.348817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:31:16.348852Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 sending to client partition status
2025-10-10T14:31:16.348853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.348869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.348895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.348994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 102 partition: 0 MaxSeqNo: 40 sessionId: src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0
2025-10-10T14:31:16.349292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3891984e-df2b689c-c029c30a-1ba1cbaf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:16.351770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0] Write session: try to update token
2025-10-10T14:31:16.351786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:16.363471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:16.363496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:16.363500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:16.363502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:16.363511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600612426769821:2834]
2025-10-10T14:31:16.363517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600612426769821:2834]
2025-10-10T14:31:16.363520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600612426769821:2834]
2025-10-10T14:31:16.363561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:16.363567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.363569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:16.363563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:16.363577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:16.363581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:16.363687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:16.364939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId: src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:16.367429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:16.467965Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:16.468195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.468208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.468387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_8230090722560249550_v1
2025-10-10T14:31:16.468402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:16.468424Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_8230090722560249550_v1
2025-10-10T14:31:16.468514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:16.468529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600613208978876:3080]
2025-10-10T14:31:16.468553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:16.468628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 102 reason: status is not ok: tablet will be restarted right now sessionId: src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0
2025-10-10T14:31:16.468847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 102 sessionId: src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0 is DEAD
2025-10-10T14:31:16.469007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:16.469019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0] Write session will restart in 0.008938s
2025-10-10T14:31:16.469044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0] Write session: Do CDS request
2025-10-10T14:31:16.469054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:16.478852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.478928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:16.478942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 103
2025-10-10T14:31:16.479080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.479117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:16.479129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:16.479133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:16.479548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 103 sessionId:  describe result for acl check
2025-10-10T14:31:16.479582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:16.479588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:16.479589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:16.479594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600613208979008:3081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:16.480117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600613208979008:3081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:16.480128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:16.480849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:16.481013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:16.481024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:16.481036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:16.481108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:16.481145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600612426769986:2836]
2025-10-10T14:31:16.481739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:16.481893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600613208979008:3081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:16.481980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:16.482020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:16.482336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:16.482389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.482395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.482396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.482397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.482398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.482399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.482400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.482401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.482402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.482404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.482405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.482406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.482407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.482412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.482424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.482428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.482432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.482436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.482440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.482444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.482448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.482451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.482456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.482460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.482464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.482468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.482474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.482482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.482488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.482494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.482502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.482507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.482512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.482522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.482527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.482532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.482541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.482546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.482551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.482560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.482564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.482569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.482574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.482580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.482585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.482594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.482599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.482604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.482613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.482618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.482622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.482629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.482669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:16.484694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600613208979008:3081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:16.484706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600613208979008:3081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:16.484719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600613208979008:3081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:16.484725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:16.484754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:16.485134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:16.485146Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:16.485148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:16.485152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:16.485157Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 102 [2:7559600612426769986:2836]
2025-10-10T14:31:16.485168Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:16.485184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:16.485192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.485196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.485198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.485212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:16.485221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:16.485227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:16.485274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.485279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.485280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.485282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:16.485356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:16.485363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.485372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.485378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.485392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:16.485411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208978893:2438], now have 1 active actors on pipe
2025-10-10T14:31:16.485418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979045:3081], now have 1 active actors on pipe
2025-10-10T14:31:16.485423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600612426769980:2836]
2025-10-10T14:31:16.485425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600612426769980:2836]
2025-10-10T14:31:16.485426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600612426769980:2836]
2025-10-10T14:31:16.485431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:16.485441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:16.485420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 102
2025-10-10T14:31:16.485447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:16.485450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:16.485428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 102
2025-10-10T14:31:16.485451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:16.485454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:16.485456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:16.485529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.485535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.485546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600612426769980:2836]
2025-10-10T14:31:16.485552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:16.485560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:16.485573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:16.485579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.485581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.485583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:16.485593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.485606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:16.485625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.485767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.485774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.485789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.485898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 103 partition: 0 MaxSeqNo: 40 sessionId: src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0
2025-10-10T14:31:16.486199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add2dd53-65839ea-c7589e2d-91c9cd8f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:16.488741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0] Write session: try to update token
2025-10-10T14:31:16.488756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:16.502455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId: src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:16.504155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:16.504174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:16.504177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:16.504178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:16.504188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600612426769980:2836]
2025-10-10T14:31:16.504192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600612426769980:2836]
2025-10-10T14:31:16.504200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600612426769980:2836]
2025-10-10T14:31:16.504237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:16.504246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:16.504250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:16.504250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:16.504257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.504259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:16.504403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:16.504909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:16.568788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600613208979063:3080]
2025-10-10T14:31:16.569115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 102, pipe: [1:7559600613208979063:3080]
2025-10-10T14:31:16.609049Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:16.609276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.609290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.609343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979063:3080], now have 1 active actors on pipe
2025-10-10T14:31:16.609516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:16.609614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:16.609633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:16.609637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:16.609660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600613208979063:3080]
2025-10-10T14:31:16.609691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 103 reason: error at write: Disconnected sessionId: src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0
2025-10-10T14:31:16.609848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 103 sessionId: src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0 is DEAD
2025-10-10T14:31:16.609987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:16.609995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0] Write session will restart in 0.009756s
2025-10-10T14:31:16.610020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0] Write session: Do CDS request
2025-10-10T14:31:16.610027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:16.620135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:16.620707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:16.620881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.620881Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:16.620893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:16.620905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:16.620959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:16.620999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600612426770145:2839]
2025-10-10T14:31:16.620975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:16.620989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 104
2025-10-10T14:31:16.621120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.621150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:16.621157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:16.621160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:16.621594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:16.621602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 104 sessionId:  describe result for acl check
2025-10-10T14:31:16.621634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:16.621642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:16.621643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:16.621647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600613208979188:3087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:16.621845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:16.621885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:16.622073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600613208979188:3087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:16.622195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:16.622234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.622239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.622240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.622240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.622241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.622241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.622242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.622243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.622243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.622244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.622244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.622245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.622246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.622249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.622256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.622258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.622261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.622263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.622265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.622266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.622268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.622270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.622272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.622274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.622276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.622278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.622283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.622288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.622293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.622296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.622299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.622302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.622306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.622309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.622312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.622315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.622317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.622320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.622324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.622329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.622333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.622338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.622342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.622347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.622351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.622356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.622361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.622366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.622368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.622371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.622373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.622376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.622397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:16.623696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600613208979188:3087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:16.624417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:16.624828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:16.624840Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:16.624842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:16.624845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:16.624850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 103 [2:7559600612426770145:2839]
2025-10-10T14:31:16.624860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:16.624879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:16.624886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.624889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.624891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.624906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:16.624918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:16.624926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:16.624978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.624985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.624987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.624990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:16.625050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:16.625057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.625068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.625080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.625102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:16.625125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979067:2438], now have 1 active actors on pipe
2025-10-10T14:31:16.625136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600612426770140:2839]
2025-10-10T14:31:16.625139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600612426770140:2839]
2025-10-10T14:31:16.625141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600612426770140:2839]
2025-10-10T14:31:16.625153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:16.625164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:16.625166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:16.625167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:16.625170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:16.625161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 103
2025-10-10T14:31:16.625187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:16.625194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:16.625219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600612426770140:2839]
2025-10-10T14:31:16.625229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:16.625234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:16.629214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600613208979188:3087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:16.629226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600613208979188:3087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:16.629229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600613208979188:3087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:16.629237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:16.629456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979225:3087], now have 1 active actors on pipe
2025-10-10T14:31:16.629500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 103
2025-10-10T14:31:16.629552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.629562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.629592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:16.629606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.629610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.629612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:16.629624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.629639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:16.629658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.629811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.629819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.629833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.629914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 104 partition: 0 MaxSeqNo: 40 sessionId: src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0
2025-10-10T14:31:16.630196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99d24a46-46ce9a33-ee32959b-e95b9c2c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:16.632825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0] Write session: try to update token
2025-10-10T14:31:16.632845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:16.649860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId: src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:16.652207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:16.652233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:16.652236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:16.652240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:16.652251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600612426770140:2839]
2025-10-10T14:31:16.652258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600612426770140:2839]
2025-10-10T14:31:16.652263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600612426770140:2839]
2025-10-10T14:31:16.652320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:16.652323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:16.652329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.652329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:16.652331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:16.652334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:16.652346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:16.652466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:16.709584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600613208979228:3080]
2025-10-10T14:31:16.709873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 103, pipe: [1:7559600613208979228:3080]
2025-10-10T14:31:16.757098Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:16.757375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.757387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.757424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979228:3080], now have 1 active actors on pipe
2025-10-10T14:31:16.757607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:16.757797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600613208979228:3080]
2025-10-10T14:31:16.757835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:16.757880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:16.757957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 104 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0
2025-10-10T14:31:16.758177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 104 sessionId: src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0 is DEAD
2025-10-10T14:31:16.758306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:16.758317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0] Write session will restart in 0.008031s
2025-10-10T14:31:16.758350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0] Write session: Do CDS request
2025-10-10T14:31:16.758358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:16.767794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.767922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:16.767935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 105
2025-10-10T14:31:16.768042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.768075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:16.768084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:16.768088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:16.768511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 105 sessionId:  describe result for acl check
2025-10-10T14:31:16.768552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:16.768559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:16.768560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:16.768566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600613208979375:3100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:16.768606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:16.769080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600613208979375:3100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:16.769102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:16.769258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:16.769269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:16.769281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:16.769326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:16.769385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600612426770342:2847]
2025-10-10T14:31:16.769949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:16.770236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:16.770280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:16.770503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600613208979375:3100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:16.770595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:16.770649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.770655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.770656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.770657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.770658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.770660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.770661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.770662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.770663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.770664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.770665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.770666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.770667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.770673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.770684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.770688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.770692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.770696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.770701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.770705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.770709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.770713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.770717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.770720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.770724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.770728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.770734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.770743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.770755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.770761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.770769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.770776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.770783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.770788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.770792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.770802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.770806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.770811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.770816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.770825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.770830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.770838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.770844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.770850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.770855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.770860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.770869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.770873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.770878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.770887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.770891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.770896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.770935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:16.773555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600613208979375:3100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:16.773568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600613208979375:3100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:16.773571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600613208979375:3100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:16.773578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:16.773580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:16.773944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:16.773958Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:16.773960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:16.773964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:16.773968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 104 [2:7559600612426770342:2847]
2025-10-10T14:31:16.773979Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:16.773993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:16.774001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.774004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.774006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.774021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:16.774029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:16.774036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:16.774104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.774110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.774112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.774114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:16.774178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:16.774185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.774198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.774213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.774235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:16.774259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979242:2438], now have 1 active actors on pipe
2025-10-10T14:31:16.774266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979407:3100], now have 1 active actors on pipe
2025-10-10T14:31:16.774274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600612426770337:2847]
2025-10-10T14:31:16.774276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600612426770337:2847]
2025-10-10T14:31:16.774278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600612426770337:2847]
2025-10-10T14:31:16.774271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 104
2025-10-10T14:31:16.774278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 104
2025-10-10T14:31:16.774291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:16.774309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:16.774314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:16.774317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:16.774319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:16.774329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:16.774336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:16.774371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.774380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.774402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600612426770337:2847]
2025-10-10T14:31:16.774415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:16.774443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:16.774447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:16.774454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.774457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.774459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:16.774469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.774479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:16.774503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.774669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.774678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.774693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.774779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 105 partition: 0 MaxSeqNo: 40 sessionId: src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0
2025-10-10T14:31:16.775064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4afb2982-7ee39974-c57fb565-76b6cba3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:16.777396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0] Write session: try to update token
2025-10-10T14:31:16.777407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:16.790505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId: src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:16.792868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:16.793081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.793098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.793132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:16.793219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:16.796460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:16.796473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:16.796476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:16.796478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:16.796485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600612426770337:2847]
2025-10-10T14:31:16.796488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600612426770337:2847]
2025-10-10T14:31:16.796490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600612426770337:2847]
2025-10-10T14:31:16.796528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:16.796533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.796534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:16.796535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:16.796542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:16.796546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:16.796670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:16.858009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600613208979415:3080]
2025-10-10T14:31:16.858489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 104, pipe: [1:7559600613208979415:3080]
2025-10-10T14:31:16.904589Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:16.912671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.912699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.912872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.912932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.912994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.913062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.913105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.913113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.913183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.913243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.913306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.913381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.913423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.913429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.913495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.913548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.913602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.913658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.913700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.913708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.913779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.913855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.913916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.913978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.914019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.914024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.914090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.914149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.914209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.914269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.914317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.914323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.914380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.914441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.914509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.914570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.914610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.914616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.914681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.914742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.914805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.914862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.914906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.914913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.914974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.915030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.915087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.915150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.915194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.915202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.915265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.915326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.915385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.915445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.915499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.915506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.915566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:16.915625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:16.915687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:16.915746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:16.915787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:16.915794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:16.915849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979415:3080], now have 1 active actors on pipe
2025-10-10T14:31:16.916100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:16.916106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600613208979415:3080]
2025-10-10T14:31:16.916136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:16.916139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:16.916170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 105 reason: error at write: Disconnected sessionId: src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0
2025-10-10T14:31:16.916478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 105 sessionId: src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0 is DEAD
2025-10-10T14:31:16.916560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:16.916572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0] Write session will restart in 0.007502s
2025-10-10T14:31:16.916598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0] Write session: Do CDS request
2025-10-10T14:31:16.916604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:16.916765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:16.924800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.924906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:16.924922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 106
2025-10-10T14:31:16.925033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:16.925067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:16.925076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:16.925080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:16.925524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 106 sessionId:  describe result for acl check
2025-10-10T14:31:16.925559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:16.925566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:16.925568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:16.925574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600613208979496:3104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:16.926528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600613208979496:3104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:16.927862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:16.928636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:16.928810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:16.928821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:16.928833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:16.928815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600613208979496:3104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:16.928876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:16.928907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600612426770503:2856]
2025-10-10T14:31:16.929308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:16.929569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:16.929605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:16.929861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:16.929903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.929908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.929909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.929909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.929910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.929911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.929911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.929912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.929912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.929913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.929914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.929914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.929915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.929919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.929927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.929929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.929932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.929934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.929936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.929938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.929941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.929943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.929945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.929947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.929949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.929951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.929956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.929962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:16.929967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.929970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:16.929973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.929976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:16.929979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.929982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:16.929985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.929988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:16.929990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.929994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:16.929996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.929999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:16.930003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.930006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:16.930008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.930012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:16.930014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.930017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:16.930020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.930023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.930025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.930028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.930031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.930034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.930058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:16.932160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600613208979496:3104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:16.932181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:16.932173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600613208979496:3104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:16.932177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600613208979496:3104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:16.932185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:16.932620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:16.932633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:16.932635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:16.932638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:16.932645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 105 [2:7559600612426770503:2856]
2025-10-10T14:31:16.932660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:16.932675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:16.932680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.932682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.932683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.932693Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:16.932698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:16.932704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:16.932743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.932748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.932749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.932751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:16.932799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:16.932805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.932811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:16.932821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:16.932834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:16.932855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979416:2438], now have 1 active actors on pipe
2025-10-10T14:31:16.932861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600613208979571:3104], now have 1 active actors on pipe
2025-10-10T14:31:16.932866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600612426770498:2856]
2025-10-10T14:31:16.932868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600612426770498:2856]
2025-10-10T14:31:16.932869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600612426770498:2856]
2025-10-10T14:31:16.932881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:16.932899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:16.932887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 105
2025-10-10T14:31:16.932914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:16.932916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:16.932887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 105
2025-10-10T14:31:16.932918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:16.932922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:16.932924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:16.932947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.932954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.932966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600612426770498:2856]
2025-10-10T14:31:16.932975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:16.932979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:16.932996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:16.933005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:16.933007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:16.933012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:16.933020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:16.933038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:16.933056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.933215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.933228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.933254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:16.933367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 106 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0
2025-10-10T14:31:16.933699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7549791b-e2cd67ee-51e50a1d-2f81fcb7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:16.936305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0] Write session: try to update token
2025-10-10T14:31:16.936322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:16.949421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId: src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:16.952050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:16.952498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:16.952520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:16.952545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:16.952551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:16.952554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:16.952556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:16.952563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600612426770498:2856]
2025-10-10T14:31:16.952568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600612426770498:2856]
2025-10-10T14:31:16.952572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600612426770498:2856]
2025-10-10T14:31:16.952611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:16.952620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:16.952623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:16.952626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:16.952633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:16.952636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:16.952760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:17.016260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600617503946875:3080]
2025-10-10T14:31:17.016470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 105, pipe: [1:7559600617503946875:3080]
2025-10-10T14:31:17.056030Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:17.056230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:17.056282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503946875:3080], now have 1 active actors on pipe
2025-10-10T14:31:17.056377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:17.056478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600617503946875:3080]
2025-10-10T14:31:17.056501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:17.065166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:17.065180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:17.065200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 106 reason: error at write: Disconnected sessionId: src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0
2025-10-10T14:31:17.065355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 106 sessionId: src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0 is DEAD
2025-10-10T14:31:17.065493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:17.065503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0] Write session will restart in 0.009501s
2025-10-10T14:31:17.065524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0] Write session: Do CDS request
2025-10-10T14:31:17.065530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:17.069689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:17.070256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:17.070399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:17.070408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:17.070417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:17.070451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:17.070484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600616721737972:2859]
2025-10-10T14:31:17.070888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:17.071120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:17.071164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:17.071401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:17.071438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.071442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.071443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.071443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.071444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.071445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.071445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.071446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.071446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.071447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.071448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.071448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.071449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.071453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.071461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.071464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.071466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.071468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.071470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.071472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.071474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.071476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.071479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.071481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.071483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.071485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.071492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.071497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.071501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.071505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.071507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.071510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.071513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.071516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.071518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.071521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.071524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.071527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.071530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.071533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.071535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.071538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.071542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.071545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.071548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.071551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.071553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.071556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.071559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.071562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.071564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.071567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.071589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:17.073640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:17.073923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:17.073932Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:17.073934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:17.073936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:17.073941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 106 [2:7559600616721737972:2859]
2025-10-10T14:31:17.073950Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:17.073961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:17.073963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.073965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.073966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.073979Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:17.073984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:17.073992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:17.074030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.074035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.074036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.074038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:17.074109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:17.074116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.074123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.074142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.074152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:17.074168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503946888:2438], now have 1 active actors on pipe
2025-10-10T14:31:17.074177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600616721737967:2859]
2025-10-10T14:31:17.074183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600616721737967:2859]
2025-10-10T14:31:17.074184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600616721737967:2859]
2025-10-10T14:31:17.074194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:17.074204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:17.074208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:17.074210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:17.074211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:17.074217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:17.074219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:17.074237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600616721737967:2859]
2025-10-10T14:31:17.074210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 106
2025-10-10T14:31:17.074243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:17.074244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:17.075835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.075919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:17.075929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 107
2025-10-10T14:31:17.076061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.076093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:17.076103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:17.076107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:17.076519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 107 sessionId:  describe result for acl check
2025-10-10T14:31:17.076554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:17.076562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:17.076563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:17.076567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600617503947019:3109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:17.077110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600617503947019:3109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:17.079280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600617503947019:3109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:17.085088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600617503947019:3109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:17.085102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600617503947019:3109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:17.085106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600617503947019:3109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:17.085113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:17.085309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947048:3109], now have 1 active actors on pipe
2025-10-10T14:31:17.085370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 106
2025-10-10T14:31:17.085410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.085419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.085445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:17.085459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.085464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.085470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:17.085482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.085501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:17.085519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.085660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.085668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.085682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.085769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 107 partition: 0 MaxSeqNo: 40 sessionId: src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0
2025-10-10T14:31:17.086114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb516c79-54ce8255-8b9188c6-2ad7abec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:17.088673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0] Write session: try to update token
2025-10-10T14:31:17.088688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:17.091867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:17.091880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:17.091882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:17.091884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:17.091892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600616721737967:2859]
2025-10-10T14:31:17.091895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600616721737967:2859]
2025-10-10T14:31:17.091898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600616721737967:2859]
2025-10-10T14:31:17.091928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:17.091932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:17.091932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:17.091935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:17.091937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.091940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:17.092060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:17.102570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId: src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:17.104912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:17.156586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600617503947052:3080]
2025-10-10T14:31:17.156828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 106, pipe: [1:7559600617503947052:3080]
2025-10-10T14:31:17.194522Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:17.194757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.194767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.194787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947052:3080], now have 1 active actors on pipe
2025-10-10T14:31:17.194939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:17.195030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:17.195042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600617503947052:3080]
2025-10-10T14:31:17.195066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:17.195141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 107 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0
2025-10-10T14:31:17.195316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 107 sessionId: src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0 is DEAD
2025-10-10T14:31:17.195496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:17.195507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0] Write session will restart in 0.008782s
2025-10-10T14:31:17.195530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0] Write session: Do CDS request
2025-10-10T14:31:17.195536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:17.204634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:17.205185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:17.205348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:17.205356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:17.205365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:17.205402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:17.205437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600616721738133:2861]
2025-10-10T14:31:17.205762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.205800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:17.205832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:17.205846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 108
2025-10-10T14:31:17.205951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.205979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:17.205989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:17.205994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:17.206008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:17.206033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:17.206245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:17.206280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.206284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.206285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.206286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.206286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.206287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.206288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.206288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.206289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.206289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.206290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.206291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.206291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.206295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.206304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.206306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.206309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.206311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.206314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.206316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.206318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.206320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.206323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.206325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.206327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.206330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.206337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.206342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.206346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.206350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.206352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.206355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.206358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.206361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.206364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.206367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.206369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.206372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.206375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.206378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.206380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.206383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.206386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.206389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.206393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.206396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.206399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.206402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.206404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.206407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.206410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.206412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.206387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 108 sessionId:  describe result for acl check
2025-10-10T14:31:17.206415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:17.206417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:17.206419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:17.206424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600617503947178:3113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:17.206433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:17.206974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600617503947178:3113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:17.208473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:17.208788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:17.208798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:17.208800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:17.208802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:17.208808Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 107 [2:7559600616721738133:2861]
2025-10-10T14:31:17.208816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:17.208829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:17.208831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.208833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.208835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.208848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:17.208854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:17.208872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:17.208922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.208927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.208928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.208930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:17.208976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:17.208982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.208989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.208995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.209012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:17.209032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947053:2438], now have 1 active actors on pipe
2025-10-10T14:31:17.209042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600616721738128:2861]
2025-10-10T14:31:17.209044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600616721738128:2861]
2025-10-10T14:31:17.209045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600616721738128:2861]
2025-10-10T14:31:17.209054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:17.209066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:17.209066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:17.209068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:17.209069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:17.209076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:17.209078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:17.209067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 107
2025-10-10T14:31:17.209097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600616721738128:2861]
2025-10-10T14:31:17.209104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:17.209109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600617503947178:3113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:17.209105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:17.213534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600617503947178:3113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:17.213545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600617503947178:3113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:17.213548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600617503947178:3113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:17.213554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:17.213737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947213:3113], now have 1 active actors on pipe
2025-10-10T14:31:17.213781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 107
2025-10-10T14:31:17.213824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.213832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.213857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:17.213879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.213883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.213884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:17.213894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.213905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:17.213923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.214064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.214070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.214087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.214163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 108 partition: 0 MaxSeqNo: 40 sessionId: src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0
2025-10-10T14:31:17.214481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c61b9ec8-b20b878c-25b4f2dc-c9921884_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:17.217033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0] Write session: try to update token
2025-10-10T14:31:17.217051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:17.228756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:17.228772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:17.228774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:17.228775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:17.228783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600616721738128:2861]
2025-10-10T14:31:17.228786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600616721738128:2861]
2025-10-10T14:31:17.228789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600616721738128:2861]
2025-10-10T14:31:17.228825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:17.228831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.228833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:17.228840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:17.228845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:17.228848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:17.228950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:17.230612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId: src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:17.233023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:17.295311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600617503947218:3080]
2025-10-10T14:31:17.295559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 107, pipe: [1:7559600617503947218:3080]
2025-10-10T14:31:17.330434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:17.330713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.330724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.330761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947218:3080], now have 1 active actors on pipe
2025-10-10T14:31:17.330909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:17.330990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:17.330995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600617503947218:3080]
2025-10-10T14:31:17.331014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:17.331083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 108 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0
2025-10-10T14:31:17.331278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 108 sessionId: src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0 is DEAD
2025-10-10T14:31:17.331414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:17.331424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0] Write session will restart in 0.008483s
2025-10-10T14:31:17.331442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0] Write session: Do CDS request
2025-10-10T14:31:17.331447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:17.340834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:17.340872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.340965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:17.340979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 109
2025-10-10T14:31:17.341086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.341120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:17.341130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:17.341133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:17.341462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:17.341572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 109 sessionId:  describe result for acl check
2025-10-10T14:31:17.341602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:17.341604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:17.341605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:17.341609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600617503947343:3117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:17.341612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:17.341621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:17.341629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:17.341664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:17.341703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600616721738295:2863]
2025-10-10T14:31:17.342103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:17.342135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600617503947343:3117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:17.342332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:17.342360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:17.342583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:17.342619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.342624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.342624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.342625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.342626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.342626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.342627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.342628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.342628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.342629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.342629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.342630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.342631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.342634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.342642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.342644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.342647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.342649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.342651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.342653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.342655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.342658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.342660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.342662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.342664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.342666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.342670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.342677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.342683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.342686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.342688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.342691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.342694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.342697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.342700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.342703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.342705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.342708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.342714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.342719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.342723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.342727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.342731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.342736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.342740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.342745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.342749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.342753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.342755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.342758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.342761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.342764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.342784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:17.344157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600617503947343:3117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:17.345025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:17.345322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:17.345347Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:17.345348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:17.345351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:17.345355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 108 [2:7559600616721738295:2863]
2025-10-10T14:31:17.345363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:17.345375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:17.345376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.345379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.345380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.345391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:17.345401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:17.345407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:17.345453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.345459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.345461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.345462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:17.345505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:17.345510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.345517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.345524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.345533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:17.345548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600616721738290:2863]
2025-10-10T14:31:17.345553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600616721738290:2863]
2025-10-10T14:31:17.345554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600616721738290:2863]
2025-10-10T14:31:17.345561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:17.345571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947219:2438], now have 1 active actors on pipe
2025-10-10T14:31:17.345572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:17.345576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:17.345578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:17.345582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:17.345598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:17.345605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:17.345627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600616721738290:2863]
2025-10-10T14:31:17.345638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:17.345657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 108
2025-10-10T14:31:17.345665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:17.350946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600617503947343:3117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:17.350957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600617503947343:3117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:17.350960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600617503947343:3117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:17.350967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:17.351160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947381:3117], now have 1 active actors on pipe
2025-10-10T14:31:17.351221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 108
2025-10-10T14:31:17.351282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.351291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.351315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:17.351329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.351338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.351341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:17.351357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.351376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:17.351393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.351592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.351598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.351609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.351695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 109 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0
2025-10-10T14:31:17.352047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ccc69b-73f5c291-686c2c54-d2876ffc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:17.354634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0] Write session: try to update token
2025-10-10T14:31:17.354651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:17.366864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:17.366879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:17.366881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:17.366883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:17.366890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600616721738290:2863]
2025-10-10T14:31:17.366894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600616721738290:2863]
2025-10-10T14:31:17.366897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600616721738290:2863]
2025-10-10T14:31:17.366934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:17.366940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.366942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:17.366949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:17.366955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:17.366958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:17.367068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:17.368137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId: src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:17.370638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:17.430983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600617503947384:3080]
2025-10-10T14:31:17.431285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 108, pipe: [1:7559600617503947384:3080]
2025-10-10T14:31:17.468629Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:17.469031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.469043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.469080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947384:3080], now have 1 active actors on pipe
2025-10-10T14:31:17.469239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:17.469322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:17.469359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600617503947384:3080]
2025-10-10T14:31:17.469393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:17.469457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0
2025-10-10T14:31:17.469617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 109 sessionId: src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0 is DEAD
2025-10-10T14:31:17.469736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:17.469746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0] Write session will restart in 0.009941s
2025-10-10T14:31:17.469763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0] Write session: Do CDS request
2025-10-10T14:31:17.469768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:17.479385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:17.479947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:17.480081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:17.480091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:17.480099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:17.480133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:17.480163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600616721738458:2865]
2025-10-10T14:31:17.480543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:17.480750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:17.480778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:17.480831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.480946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:17.480962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 110
2025-10-10T14:31:17.480981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:17.481016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.481020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.481021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.481021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.481022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.481022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.481023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.481023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.481024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.481024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.481025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.481026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.481026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.481055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.481030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.481039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.481041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.481044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.481046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.481049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.481051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.481053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.481055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.481058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.481060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.481062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.481064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.481083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:17.481070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.481092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:17.481076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.481080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.481083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.481096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:17.481086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.481089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.481091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.481094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.481097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.481100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.481103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.481106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.481109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.481112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.481114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.481117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.481120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.481123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.481126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.481129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.481132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.481135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.481137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.481140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.481143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.481149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.481171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:17.481481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 110 sessionId:  describe result for acl check
2025-10-10T14:31:17.481513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:17.481517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:17.481519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:17.481525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600617503947516:3121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:17.482039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600617503947516:3121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:17.483159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:17.483448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:17.483457Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:17.483459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:17.483461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:17.483465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 109 [2:7559600616721738458:2865]
2025-10-10T14:31:17.483473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:17.483484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:17.483489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.483491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.483493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.483505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:17.483510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:17.483515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:17.483556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.483562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.483563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.483565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:17.483614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:17.483621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.483632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.483643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.483652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:17.483682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947386:2438], now have 1 active actors on pipe
2025-10-10T14:31:17.483691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600616721738453:2865]
2025-10-10T14:31:17.483692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600616721738453:2865]
2025-10-10T14:31:17.483694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600616721738453:2865]
2025-10-10T14:31:17.483689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 109
2025-10-10T14:31:17.483705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:17.483718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:17.483722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:17.483730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:17.483732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:17.483736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:17.483738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:17.483758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600616721738453:2865]
2025-10-10T14:31:17.483766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:17.483774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:17.483878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600617503947516:3121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:17.488271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600617503947516:3121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:17.488281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600617503947516:3121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:17.488293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600617503947516:3121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:17.488298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:17.488496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947549:3121], now have 1 active actors on pipe
2025-10-10T14:31:17.488568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 109
2025-10-10T14:31:17.488642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.488654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.488679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:17.488692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.488699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.488701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:17.488710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.488729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:17.488744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.488932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.488937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.488948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.489027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 110 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0
2025-10-10T14:31:17.489356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b04df5a-9f9f3a47-29c2dd7e-af98e8f7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:17.491949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0] Write session: try to update token
2025-10-10T14:31:17.491964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:17.498975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:17.498986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:17.498994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600616721738453:2865]
2025-10-10T14:31:17.499034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:17.499049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:17.499190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:17.499313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:17.499465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:17.499586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:17.499758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:17.499790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:17.505596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId: src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:17.508058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:17.508246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.508273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.508306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:17.508399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:17.511844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:17.511857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:17.511860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:17.511861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:17.511869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600616721738453:2865]
2025-10-10T14:31:17.511872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600616721738453:2865]
2025-10-10T14:31:17.511874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600616721738453:2865]
2025-10-10T14:31:17.511908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:17.511915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.511915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:17.511917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:17.511920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:17.511924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:17.512033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:17.569736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600617503947563:3080]
2025-10-10T14:31:17.570047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 109, pipe: [1:7559600617503947563:3080]
2025-10-10T14:31:17.613534Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:17.620206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.620226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.620377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.620435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.620494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.620549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.620589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.620598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.620657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.620709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.620765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.620826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.620867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.620872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.620931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.620983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.621040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.621095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.621135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.621140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.621199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.621256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.621313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.621386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.621435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.621441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.621500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.621552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.621605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.621659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.621698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.621704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.621761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.621812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.621866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.621923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.621961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.621969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.622025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.622079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.622145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.622201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.622242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.622248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.622305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.622356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.622409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.622468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.622517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.622520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.622581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.622636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.622705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.622762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.622800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.622806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.622862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:17.622913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:17.622968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:17.623023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:17.623064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:17.623069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:17.623108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947563:3080], now have 1 active actors on pipe
2025-10-10T14:31:17.623349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:17.623365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:17.623369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:17.623394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 110 reason: error at write: Disconnected sessionId: src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0
2025-10-10T14:31:17.623397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600617503947563:3080]
2025-10-10T14:31:17.623576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 110 sessionId: src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0 is DEAD
2025-10-10T14:31:17.623717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:17.623729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0] Write session will restart in 0.005907s
2025-10-10T14:31:17.623754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0] Write session: Do CDS request
2025-10-10T14:31:17.623760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:17.623891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:17.630753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.630947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:17.630961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 111
2025-10-10T14:31:17.631076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.631109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:17.631119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:17.631123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:17.631569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 111 sessionId:  describe result for acl check
2025-10-10T14:31:17.631601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:17.631605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:17.631607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:17.631611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600617503947625:3127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:17.632126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600617503947625:3127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:17.634028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:17.634563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600617503947625:3127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:17.634612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:17.634734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:17.634743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:17.634752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:17.634783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:17.634814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600616721738625:2868]
2025-10-10T14:31:17.635180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:17.635421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:17.635452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:17.635660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:17.635693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.635698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.635698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.635699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.635700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.635700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.635701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.635701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.635702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.635703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.635703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.635704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.635704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.635708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.635716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.635718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.635720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.635722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.635724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.635726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.635728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.635731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.635733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.635735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.635737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.635739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.635743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.635749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.635753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.635757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.635759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.635762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.635765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.635768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.635771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.635774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.635776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.635779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.635782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.635785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.635787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.635791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.635793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.635796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.635799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.635801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.635804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.635807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.635810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.635813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.635819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.635822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.635843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:17.637856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600617503947625:3127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:17.637868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600617503947625:3127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:17.637870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600617503947625:3127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:17.637876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:17.637934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:17.638223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:17.638232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:17.638234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:17.638236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:17.638241Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 110 [2:7559600616721738625:2868]
2025-10-10T14:31:17.638248Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:17.638258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:17.638263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.638265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.638267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.638276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:17.638284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:17.638290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:17.638326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.638332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.638333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.638335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:17.638378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:17.638384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.638390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.638399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.638414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:17.638429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947728:3127], now have 1 active actors on pipe
2025-10-10T14:31:17.638435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947568:2438], now have 1 active actors on pipe
2025-10-10T14:31:17.638440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600616721738620:2868]
2025-10-10T14:31:17.638441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600616721738620:2868]
2025-10-10T14:31:17.638443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600616721738620:2868]
2025-10-10T14:31:17.638448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:17.638457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:17.638458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:17.638461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:17.638463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:17.638473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:17.638476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:17.638481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 110
2025-10-10T14:31:17.638495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600616721738620:2868]
2025-10-10T14:31:17.638492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 110
2025-10-10T14:31:17.638502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:17.638521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:17.638527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.638529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.638554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:17.638564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.638566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.638567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:17.638574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.638582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:17.638595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.638720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.638725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.638736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.638829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 111 partition: 0 MaxSeqNo: 40 sessionId: src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0
2025-10-10T14:31:17.639086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf5619db-7c2dbfc8-57d47143-e25d05d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:17.642891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0] Write session: try to update token
2025-10-10T14:31:17.642908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:17.657542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:17.657556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:17.657558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:17.657559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:17.657566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600616721738620:2868]
2025-10-10T14:31:17.657570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600616721738620:2868]
2025-10-10T14:31:17.657572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600616721738620:2868]
2025-10-10T14:31:17.657607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:17.657612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.657613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:17.657625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:17.657630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:17.657634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:17.657739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:17.659786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId: src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:17.662430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:17.723336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600617503947735:3080]
2025-10-10T14:31:17.723599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 110, pipe: [1:7559600617503947735:3080]
2025-10-10T14:31:17.760649Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:17.761077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.761092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.761130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947735:3080], now have 1 active actors on pipe
2025-10-10T14:31:17.761303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:17.761400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:17.761405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:17.761415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:17.761450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600617503947735:3080]
2025-10-10T14:31:17.761479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 111 reason: error at write: Disconnected sessionId: src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0
2025-10-10T14:31:17.761723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 111 sessionId: src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0 is DEAD
2025-10-10T14:31:17.761848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:17.761859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0] Write session will restart in 0.006339s
2025-10-10T14:31:17.761882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0] Write session: Do CDS request
2025-10-10T14:31:17.761892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:17.769800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.769874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:17.769886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 112
2025-10-10T14:31:17.770026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.770062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:17.770081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:17.770085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:17.770398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 112 sessionId:  describe result for acl check
2025-10-10T14:31:17.770422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:17.770423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:17.770426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:17.770429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600617503947873:3137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:17.770741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600617503947873:3137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:17.771241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:17.771991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:17.772119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:17.772129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:17.772139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:17.772193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:17.772235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600616721738804:2870]
2025-10-10T14:31:17.772618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:17.772732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600617503947873:3137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:17.772821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:17.772853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:17.773075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:17.773112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.773117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.773117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.773118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.773118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.773119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.773120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.773120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.773121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.773121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.773122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.773123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.773123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.773127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.773134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.773136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.773138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.773140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.773142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.773144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.773146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.773148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.773150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.773152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.773154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.773155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.773160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.773166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.773172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.773178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.773182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.773187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.773191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.773196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.773199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.773202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.773204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.773207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.773210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.773212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.773223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.773226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.773230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.773239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.773243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.773246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.773249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.773251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.773254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.773257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.773259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.773262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.773282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:17.775348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600617503947873:3137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:17.775359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600617503947873:3137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:17.775362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600617503947873:3137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:17.775367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:17.775419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:17.775708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:17.775717Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:17.775718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:17.775721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:17.775724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 111 [2:7559600616721738804:2870]
2025-10-10T14:31:17.775732Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:17.775747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:17.775750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.775753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.775756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.775770Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:17.775779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:17.775785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:17.775831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.775836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.775837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.775839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:17.775886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:17.775893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.775904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.775920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.775934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:17.775951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947909:3137], now have 1 active actors on pipe
2025-10-10T14:31:17.775953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947736:2438], now have 1 active actors on pipe
2025-10-10T14:31:17.775958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600616721738799:2870]
2025-10-10T14:31:17.775959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600616721738799:2870]
2025-10-10T14:31:17.775960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600616721738799:2870]
2025-10-10T14:31:17.775971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:17.775981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:17.775990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:17.775978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 111
2025-10-10T14:31:17.775992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:17.775994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:17.775999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:17.776001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:17.776015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600616721738799:2870]
2025-10-10T14:31:17.776018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:17.776010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 111
2025-10-10T14:31:17.776027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:17.776041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.776044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.776083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:17.776093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.776096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.776098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:17.776106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.776114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:17.776136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.776252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.776262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.776281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.776363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 112 partition: 0 MaxSeqNo: 40 sessionId: src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0
2025-10-10T14:31:17.776671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb2500a-6313882c-7e414ce5-8499bf58_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:17.779214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0] Write session: try to update token
2025-10-10T14:31:17.779231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:17.792984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId: src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:17.794383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:17.794397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:17.794399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:17.794400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:17.794408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600616721738799:2870]
2025-10-10T14:31:17.794411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600616721738799:2870]
2025-10-10T14:31:17.794414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600616721738799:2870]
2025-10-10T14:31:17.794452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:17.794457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:17.794460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:17.794473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:17.794479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.794482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:17.794623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:17.795401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:17.861579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600617503947929:3080]
2025-10-10T14:31:17.861852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 111, pipe: [1:7559600617503947929:3080]
2025-10-10T14:31:17.897588Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:17.897976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.897991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.898031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947929:3080], now have 1 active actors on pipe
2025-10-10T14:31:17.898175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:17.898282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:17.898284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600617503947929:3080]
2025-10-10T14:31:17.898305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:17.898373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 112 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0
2025-10-10T14:31:17.898562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 112 sessionId: src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0 is DEAD
2025-10-10T14:31:17.898689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:17.898699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0] Write session will restart in 0.006115s
2025-10-10T14:31:17.898718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0] Write session: Do CDS request
2025-10-10T14:31:17.898722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:17.905696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.905780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:17.905794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 113
2025-10-10T14:31:17.905895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:17.905928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:17.905937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:17.905940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:17.906395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 113 sessionId:  describe result for acl check
2025-10-10T14:31:17.906423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:17.906429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:17.906430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:17.906435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600617503947988:3144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:17.906921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600617503947988:3144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:17.908983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:17.909147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600617503947988:3144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:17.909545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:17.909720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:17.909733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:17.909746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:17.909798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:17.909827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600616721738996:2885]
2025-10-10T14:31:17.910236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:17.910447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:17.910475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:17.910700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:17.910738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.910743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.910744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.910745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.910747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.910748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.910749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.910750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.910751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.910752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.910753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.910754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.910756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.910761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.910770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.910772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.910774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.910776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.910779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.910781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.910782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.910784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.910787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.910789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.910790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.910792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.910797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.910803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:17.910807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.910810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:17.910812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.910815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:17.910818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.910821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:17.910824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.910827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:17.910829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.910837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:17.910839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.910842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:17.910845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.910848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:17.910851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.910857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:17.910860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.910863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:17.910865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.910869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.910872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.910875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.910877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.910880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.910902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:17.911255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600617503947988:3144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:17.911279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600617503947988:3144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:17.911283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600617503947988:3144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:17.911290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:17.912927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:17.913207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:17.913216Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:17.913217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:17.913220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:17.913224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 112 [2:7559600616721738996:2885]
2025-10-10T14:31:17.913232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:17.913242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:17.913244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.913245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.913246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.913255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:17.913261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:17.913266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:17.913311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.913318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.913320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.913323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:17.913386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:17.913393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.913400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:17.913406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:17.913416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:17.913432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503947930:2438], now have 1 active actors on pipe
2025-10-10T14:31:17.913434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503948092:3144], now have 1 active actors on pipe
2025-10-10T14:31:17.913439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600616721738991:2885]
2025-10-10T14:31:17.913441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600616721738991:2885]
2025-10-10T14:31:17.913442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600616721738991:2885]
2025-10-10T14:31:17.913452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:17.913463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:17.913467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:17.913469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:17.913471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:17.913476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:17.913478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:17.913503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600616721738991:2885]
2025-10-10T14:31:17.913511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:17.913515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:17.913520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 112
2025-10-10T14:31:17.913523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 112
2025-10-10T14:31:17.913606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.913613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.913634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:17.913642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:17.913645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:17.913647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:17.913654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:17.913662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:17.913675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.913789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:17.913794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:17.913807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:17.913884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 113 partition: 0 MaxSeqNo: 40 sessionId: src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0
2025-10-10T14:31:17.914188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f21930-5ae74fce-5dbc7e58-ab76faab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:17.916627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0] Write session: try to update token
2025-10-10T14:31:17.916639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:17.929958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId: src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:17.931686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:17.931703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:17.931707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:17.931709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:17.931718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600616721738991:2885]
2025-10-10T14:31:17.931722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600616721738991:2885]
2025-10-10T14:31:17.931725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600616721738991:2885]
2025-10-10T14:31:17.931768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:17.931770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:17.931777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:17.931780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:17.931780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:17.931784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:17.931957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:17.932447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:17.998270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600617503948100:3080]
2025-10-10T14:31:17.998497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 112, pipe: [1:7559600617503948100:3080]
2025-10-10T14:31:18.039066Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:18.039407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.039421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.039456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600617503948100:3080], now have 1 active actors on pipe
2025-10-10T14:31:18.039587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:18.039620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:18.039636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:18.039699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 113 reason: error at write: Disconnected sessionId: src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0
2025-10-10T14:31:18.039911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 113 sessionId: src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0 is DEAD
2025-10-10T14:31:18.040019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:18.040033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600617503948100:3080]
2025-10-10T14:31:18.040051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:18.040062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0] Write session will restart in 0.006636s
2025-10-10T14:31:18.040086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0] Write session: Do CDS request
2025-10-10T14:31:18.040091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:18.047830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.047991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:18.048004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 114
2025-10-10T14:31:18.048129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.048170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:18.048180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:18.048184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:18.048557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 114 sessionId:  describe result for acl check
2025-10-10T14:31:18.048585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:18.048590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:18.048591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:18.048596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600621798915501:3149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:18.048990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600621798915501:3149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:18.050263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:18.050692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600621798915501:3149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:18.050793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:18.050928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:18.050937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:18.050946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:18.050983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:18.051024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600621016706472:2888]
2025-10-10T14:31:18.051403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:18.051691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:18.051718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:18.051936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:18.051988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.051994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.051995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.051997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.051998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.051999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.052000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.052001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.052002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.052003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.052004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.052006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.052007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.052012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.052025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.052027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.052029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.052032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.052034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.052036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.052038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.052040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.052042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.052044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.052046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.052048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.052053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.052058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.052063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.052066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.052069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.052072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.052075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.052078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.052081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.052084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.052086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.052089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.052092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.052095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.052097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.052100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.052103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.052106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.052108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.052111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.052114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.052117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.052119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.052122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.052125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.052127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.052149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:18.054072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600621798915501:3149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:18.054084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600621798915501:3149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:18.054086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600621798915501:3149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:18.054102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:18.054252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:18.054761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:18.054770Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:18.054771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:18.054774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:18.054778Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 113 [2:7559600621016706472:2888]
2025-10-10T14:31:18.054786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:18.054797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:18.054799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.054801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.054802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.054814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:18.054822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:18.054828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:18.054868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.054873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.054874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.054876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:18.054932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:18.054938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.054945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.054951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.054961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:18.054976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915409:2438], now have 1 active actors on pipe
2025-10-10T14:31:18.054982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915572:3149], now have 1 active actors on pipe
2025-10-10T14:31:18.054988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600621016706467:2888]
2025-10-10T14:31:18.054990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600621016706467:2888]
2025-10-10T14:31:18.054991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600621016706467:2888]
2025-10-10T14:31:18.055002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:18.055014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:18.055023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:18.055024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:18.055026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:18.055026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:18.055028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:18.055042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600621016706467:2888]
2025-10-10T14:31:18.055047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:18.055049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:18.055047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 113
2025-10-10T14:31:18.055099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 113
2025-10-10T14:31:18.055140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.055147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.055168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:18.055175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.055177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.055179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:18.055186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.055193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:18.055203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.055348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.055354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.055365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.055447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 114 partition: 0 MaxSeqNo: 40 sessionId: src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0
2025-10-10T14:31:18.055753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ec6c8f-dbc35c5a-1a56e6bd-80038ff9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:18.058103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0] Write session: try to update token
2025-10-10T14:31:18.058119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:18.071112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId: src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:18.073133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:18.073149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.073152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:18.073153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:18.073160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600621016706467:2888]
2025-10-10T14:31:18.073163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600621016706467:2888]
2025-10-10T14:31:18.073166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600621016706467:2888]
2025-10-10T14:31:18.073206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:18.073209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:18.073212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.073214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:18.073214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:18.073217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:18.073378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:18.073529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:18.140105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600621798915580:3080]
2025-10-10T14:31:18.140360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 113, pipe: [1:7559600621798915580:3080]
2025-10-10T14:31:18.174634Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:18.174841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.174853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.174890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915580:3080], now have 1 active actors on pipe
2025-10-10T14:31:18.175033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:18.175101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:18.175109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600621798915580:3080]
2025-10-10T14:31:18.175130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:18.175194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 114 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0
2025-10-10T14:31:18.175360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 114 sessionId: src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0 is DEAD
2025-10-10T14:31:18.175505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:18.175513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0] Write session will restart in 0.009398s
2025-10-10T14:31:18.175537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0] Write session: Do CDS request
2025-10-10T14:31:18.175542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:18.185121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:18.185720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.185783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:18.185798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 115
2025-10-10T14:31:18.185798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:18.185922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.185962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:18.185970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:18.185954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:18.185961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:18.185965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:18.185979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:18.186028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:18.186058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600621016706641:2890]
2025-10-10T14:31:18.186363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 115 sessionId:  describe result for acl check
2025-10-10T14:31:18.186398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:18.186404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:18.186406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:18.186411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600621798915711:3153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:18.186806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:18.186882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600621798915711:3153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:18.187028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:18.187060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:18.187326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:18.187359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.187364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.187364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.187365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.187366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.187366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.187367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.187368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.187368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.187369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.187369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.187370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.187371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.187374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.187382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.187384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.187386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.187388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.187390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.187392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.187394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.187396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.187399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.187401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.187403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.187404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.187409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.187415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.187419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.187423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.187425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.187428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.187431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.187434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.187437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.187440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.187442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.187445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.187448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.187451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.187453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.187456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.187459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.187462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.187464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.187467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.187470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.187475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.187480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.187485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.187493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.187497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.187530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:18.188903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600621798915711:3153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:18.189561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:18.189836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:18.189843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:18.189844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:18.189847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:18.189851Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 114 [2:7559600621016706641:2890]
2025-10-10T14:31:18.189859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:18.189871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:18.189876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.189878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.189880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.189895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:18.189907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:18.189919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:18.189965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.189979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.189983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.189985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:18.190043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:18.190049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.190056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.190066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.190080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:18.190111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915581:2438], now have 1 active actors on pipe
2025-10-10T14:31:18.190117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600621016706636:2890]
2025-10-10T14:31:18.190122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600621016706636:2890]
2025-10-10T14:31:18.190124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600621016706636:2890]
2025-10-10T14:31:18.190134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:18.190131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 114
2025-10-10T14:31:18.190143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:18.190151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:18.190153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:18.190154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:18.190156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:18.190158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:18.190181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600621016706636:2890]
2025-10-10T14:31:18.190188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:18.190193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:18.194786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600621798915711:3153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:18.194796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600621798915711:3153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:18.194799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600621798915711:3153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:18.194805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:18.194979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915749:3153], now have 1 active actors on pipe
2025-10-10T14:31:18.195021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 114
2025-10-10T14:31:18.195068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.195076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.195102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0105664-187476d9-ab44f058-533fa227_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:18.195113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.195117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.195119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:18.195130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.195141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:18.195154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.195286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.195292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.195302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.195377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 115 partition: 0 MaxSeqNo: 40 sessionId: src_id|c0105664-187476d9-ab44f058-533fa227_0
2025-10-10T14:31:18.195691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f990a2-b9bfdb6f-84006c19-e720931f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c0105664-187476d9-ab44f058-533fa227_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:18.198143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0105664-187476d9-ab44f058-533fa227_0] Write session: try to update token
2025-10-10T14:31:18.198159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0105664-187476d9-ab44f058-533fa227_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:18.200668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:18.200680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.200687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600621016706636:2890]
2025-10-10T14:31:18.200722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:18.200730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:18.200892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:18.201015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.201132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.201251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.201444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:18.201473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:18.211181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId: src_id|c0105664-187476d9-ab44f058-533fa227_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:18.213430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:18.213606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.213626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.213677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:18.213754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:18.217433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:18.217445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.217448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:18.217449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:18.217456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600621016706636:2890]
2025-10-10T14:31:18.217459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600621016706636:2890]
2025-10-10T14:31:18.217461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600621016706636:2890]
2025-10-10T14:31:18.217497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:18.217500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:18.217505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:18.217506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.217508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:18.217510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:18.217627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:18.275282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600621798915752:3080]
2025-10-10T14:31:18.275519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 114, pipe: [1:7559600621798915752:3080]
2025-10-10T14:31:18.320662Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:18.326977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.326999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.327148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.327203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.327264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.327320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.327360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.327367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.327443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.327497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.327555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.327613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.327653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.327659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.327716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.327771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.327832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.327897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.327935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.327940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.328017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.328071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.328123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.328178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.328216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.328221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.328275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.328328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.328381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.328484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.328521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.328526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.328581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.328633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.328686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.328740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.328779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.328785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.328840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.328890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.328944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.329020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.329058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.329064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.329118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.329168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.329258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.329312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.329371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.329378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.329446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.329505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.329560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.329611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.329647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.329652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.329713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.329777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.329830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.329897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.329947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.329952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.329987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915752:3080], now have 1 active actors on pipe
2025-10-10T14:31:18.330235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600621798915752:3080]
2025-10-10T14:31:18.330251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:18.330255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:18.330263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:18.330280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 115 reason: error at write: Disconnected sessionId: src_id|c0105664-187476d9-ab44f058-533fa227_0
2025-10-10T14:31:18.330483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 115 sessionId: src_id|c0105664-187476d9-ab44f058-533fa227_0 is DEAD
2025-10-10T14:31:18.330626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0105664-187476d9-ab44f058-533fa227_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:18.330636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0105664-187476d9-ab44f058-533fa227_0] Write session will restart in 0.005172s
2025-10-10T14:31:18.330655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0105664-187476d9-ab44f058-533fa227_0] Write session: Do CDS request
2025-10-10T14:31:18.330639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:18.330660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0105664-187476d9-ab44f058-533fa227_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:18.336731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0105664-187476d9-ab44f058-533fa227_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.336787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:18.336796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 116
2025-10-10T14:31:18.336929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.336954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:18.336962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:18.336965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:18.337288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 116 sessionId:  describe result for acl check
2025-10-10T14:31:18.337311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:18.337316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:18.337320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:18.337323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600621798915782:3157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:18.337781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600621798915782:3157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:18.340552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600621798915782:3157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:18.341944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:18.342569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:18.342711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:18.342720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:18.342728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:18.342767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:18.342803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600621016706811:2892]
2025-10-10T14:31:18.343201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:18.343342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600621798915782:3157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:18.343355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600621798915782:3157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:18.343358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600621798915782:3157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:18.343365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:18.343396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:18.343435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:18.343710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:18.343755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.343759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.343760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.343761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.343761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.343762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.343762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.343763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.343764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.343765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.343765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.343766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.343766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.343769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.343777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.343780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.343782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.343784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.343786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.343788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.343790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.343792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.343794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.343796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.343798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.343800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.343805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.343811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.343815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.343818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.343821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.343824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.343826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.343830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.343832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.343835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.343837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.343840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.343843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.343846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.343848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.343852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.343854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.343857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.343859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.343863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.343865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.343869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.343871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.343874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.343878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.343881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.343902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:18.345930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:18.346229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:18.346240Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:18.346242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:18.346245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:18.346251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 115 [2:7559600621016706811:2892]
2025-10-10T14:31:18.346262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:18.346275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:18.346280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.346282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.346284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.346295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:18.346303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:18.346309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:18.346349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.346353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.346354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.346356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:18.346402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:18.346407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.346414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.346420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.346432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:18.346449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915754:2438], now have 1 active actors on pipe
2025-10-10T14:31:18.346456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600621016706805:2892]
2025-10-10T14:31:18.346460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600621016706805:2892]
2025-10-10T14:31:18.346461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600621016706805:2892]
2025-10-10T14:31:18.346470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:18.346475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915917:3157], now have 1 active actors on pipe
2025-10-10T14:31:18.346480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:18.346483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:18.346484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:18.346484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:18.346493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:18.346498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:18.346515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600621016706805:2892]
2025-10-10T14:31:18.346526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:18.346529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:18.346519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 115
2025-10-10T14:31:18.346524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 115
2025-10-10T14:31:18.346566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.346572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.346602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:18.346612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.346614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.346615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:18.346623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.346631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:18.346640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.346768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.346773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.346784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.346888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 116 partition: 0 MaxSeqNo: 40 sessionId: src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0
2025-10-10T14:31:18.347165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0105664-187476d9-ab44f058-533fa227_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:18.349642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0] Write session: try to update token
2025-10-10T14:31:18.349654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:18.362742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId: src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:18.364449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:18.364464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.364466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:18.364467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:18.364475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600621016706805:2892]
2025-10-10T14:31:18.364478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600621016706805:2892]
2025-10-10T14:31:18.364480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600621016706805:2892]
2025-10-10T14:31:18.364514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:18.364518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:18.364519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:18.364522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:18.364524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.364526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:18.364645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:18.365129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:18.430415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600621798915926:3080]
2025-10-10T14:31:18.430668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 115, pipe: [1:7559600621798915926:3080]
2025-10-10T14:31:18.465782Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:18.466203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.466215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.466248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915926:3080], now have 1 active actors on pipe
2025-10-10T14:31:18.466396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:18.466452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:18.466459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:18.466463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:18.466495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600621798915926:3080]
2025-10-10T14:31:18.466523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 116 reason: error at write: Disconnected sessionId: src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0
2025-10-10T14:31:18.466730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 116 sessionId: src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0 is DEAD
2025-10-10T14:31:18.466848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:18.466854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0] Write session will restart in 0.006466s
2025-10-10T14:31:18.466871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0] Write session: Do CDS request
2025-10-10T14:31:18.466879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:18.474812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.474909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:18.474921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 117
2025-10-10T14:31:18.475073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.475108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:18.475116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:18.475118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:18.475656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 117 sessionId:  describe result for acl check
2025-10-10T14:31:18.475690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:18.475694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:18.475696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:18.475703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600621798916057:3161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:18.476204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600621798916057:3161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:18.476272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:18.476759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:18.476882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:18.476890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:18.476898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:18.476946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:18.476975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600621016706980:2894]
2025-10-10T14:31:18.477384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:18.477612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:18.477647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:18.477858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:18.477892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.477896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.477897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.477898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.477898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.477899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.477899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.477900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.477901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.477901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.477902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.477903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.477903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.477907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.477914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.477917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.477919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.477921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.477923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.477925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.477927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.477929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.477931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.477933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.477935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.477937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.477941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.477947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.477951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.477954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.477957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.477960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.477962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.477965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.477968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.477971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.477974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.477977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.477981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.477984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.477986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.477989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.477991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.477994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.477997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.478000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.478002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.478005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.478007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.478010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.478017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.478020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.478055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:18.478089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600621798916057:3161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:18.480124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:18.480415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:18.480424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:18.480425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:18.480428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:18.480432Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 116 [2:7559600621016706980:2894]
2025-10-10T14:31:18.480440Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:18.480451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:18.480457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.480459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.480460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.480472Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:18.480477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:18.480483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:18.480476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600621798916057:3161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:18.480488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600621798916057:3161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:18.480491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600621798916057:3161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:18.480497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:18.480521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.480525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.480526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.480527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:18.480572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:18.480578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.480585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.480591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.480600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:18.480616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798915928:2438], now have 1 active actors on pipe
2025-10-10T14:31:18.480621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600621016706975:2894]
2025-10-10T14:31:18.480623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600621016706975:2894]
2025-10-10T14:31:18.480624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600621016706975:2894]
2025-10-10T14:31:18.480631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:18.480642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:18.480652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:18.480654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:18.480655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:18.480656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:18.480656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:18.480676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600621016706975:2894]
2025-10-10T14:31:18.480684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:18.480688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:18.480676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 116
2025-10-10T14:31:18.480706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916094:3161], now have 1 active actors on pipe
2025-10-10T14:31:18.480762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 116
2025-10-10T14:31:18.480796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.480803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.480823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:18.480833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.480835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.480836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:18.480845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.480853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:18.480871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.480988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.480992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.481003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.481083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 117 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0
2025-10-10T14:31:18.481327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e472cd7b-3655c435-5cea6766-b55bf2ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:18.483746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0] Write session: try to update token
2025-10-10T14:31:18.483759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:18.496479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId: src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:18.498774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:18.498778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:18.498789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.498790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:18.498792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:18.498798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600621016706975:2894]
2025-10-10T14:31:18.498801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600621016706975:2894]
2025-10-10T14:31:18.498804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600621016706975:2894]
2025-10-10T14:31:18.498835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:18.498837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:18.498840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:18.498843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.498843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:18.498844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:18.498957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:18.566578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600621798916108:3080]
2025-10-10T14:31:18.566776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 116, pipe: [1:7559600621798916108:3080]
2025-10-10T14:31:18.598510Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:18.598723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.598735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.598773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916108:3080], now have 1 active actors on pipe
2025-10-10T14:31:18.598945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:18.599029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:18.599030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:18.599033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:18.599073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600621798916108:3080]
2025-10-10T14:31:18.599092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 117 reason: error at write: Disconnected sessionId: src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0
2025-10-10T14:31:18.599285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 117 sessionId: src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0 is DEAD
2025-10-10T14:31:18.599450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:18.599466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0] Write session will restart in 0.008727s
2025-10-10T14:31:18.599484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0] Write session: Do CDS request
2025-10-10T14:31:18.599489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:18.609349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:18.609756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.609855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:18.609874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 118
2025-10-10T14:31:18.609965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:18.609991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.610020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:18.610025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:18.610029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:18.610131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:18.610140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:18.610149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:18.610187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:18.610220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600621016707154:2897]
2025-10-10T14:31:18.610333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 118 sessionId:  describe result for acl check
2025-10-10T14:31:18.610370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:18.610376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:18.610377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:18.610381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600621798916245:3167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:18.610613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:18.610817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600621798916245:3167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:18.610830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:18.610867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:18.611076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:18.611118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.611124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.611125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.611126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.611128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.611129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.611130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.611131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.611131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.611132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.611133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.611133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.611134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.611137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.611144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.611147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.611149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.611151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.611153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.611155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.611157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.611159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.611161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.611163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.611165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.611167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.611172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.611177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.611181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.611185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.611187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.611190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.611193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.611196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.611199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.611202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.611204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.611207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.611210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.611213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.611215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.611219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.611222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.611225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.611228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.611231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.611233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.611236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.611239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.611242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.611245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.611249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.611270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:18.612238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600621798916245:3167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:18.613251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:18.613571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:18.613583Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:18.613585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:18.613588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:18.613593Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 117 [2:7559600621016707154:2897]
2025-10-10T14:31:18.613604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:18.613617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:18.613623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.613626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.613627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.613639Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:18.613644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:18.613651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:18.613708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.613713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.613715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.613716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:18.613760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:18.613766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.613773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.613782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.613796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:18.613813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916112:2438], now have 1 active actors on pipe
2025-10-10T14:31:18.613822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600621016707149:2897]
2025-10-10T14:31:18.613827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600621016707149:2897]
2025-10-10T14:31:18.613828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600621016707149:2897]
2025-10-10T14:31:18.613840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:18.613852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:18.613839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 117
2025-10-10T14:31:18.613866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:18.613867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:18.613871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:18.613871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:18.613873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:18.613885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600621016707149:2897]
2025-10-10T14:31:18.613890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:18.613893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:18.614117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600621798916245:3167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:18.614127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600621798916245:3167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:18.614130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600621798916245:3167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:18.614135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:18.614276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916281:3167], now have 1 active actors on pipe
2025-10-10T14:31:18.614333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 117
2025-10-10T14:31:18.614366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.614373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.614394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|199dffde-9cbe7370-f049ed01-e56f385e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:18.614403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.614406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.614408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:18.614415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.614424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:18.614444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.614609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.614615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.614626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.614689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 118 partition: 0 MaxSeqNo: 40 sessionId: src_id|199dffde-9cbe7370-f049ed01-e56f385e_0
2025-10-10T14:31:18.614951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8b6ab6-28b0c7a9-2fb60da5-10e4b972_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|199dffde-9cbe7370-f049ed01-e56f385e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:18.617448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199dffde-9cbe7370-f049ed01-e56f385e_0] Write session: try to update token
2025-10-10T14:31:18.617460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199dffde-9cbe7370-f049ed01-e56f385e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:18.624303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:18.624331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.624338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600621016707149:2897]
2025-10-10T14:31:18.624377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:18.624377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:18.624555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:18.624685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.624811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.624947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.625116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:18.625148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:18.630523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId: src_id|199dffde-9cbe7370-f049ed01-e56f385e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:18.632843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:18.633004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.633022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.633068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:18.633136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:18.641666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:18.641683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.641686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:18.641687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:18.641703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600621016707149:2897]
2025-10-10T14:31:18.641707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600621016707149:2897]
2025-10-10T14:31:18.641710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600621016707149:2897]
2025-10-10T14:31:18.641755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:18.641766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:18.641768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.641770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:18.641773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:18.641777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:18.641909Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:18.699187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600621798916287:3080]
2025-10-10T14:31:18.699404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 117, pipe: [1:7559600621798916287:3080]
2025-10-10T14:31:18.744526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:18.753180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.753204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.753385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.753450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.753520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.753591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.753650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.753658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.753727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.753790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.753855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.753927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.753978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.753986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.754123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.754190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.754255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.754338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.754384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.754393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.754468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.754523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.754585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.754641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.754682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.754688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.754745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.754808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.754871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.754934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.754974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.754979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.755038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.755091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.755145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.755203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.755243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.755250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.755308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.755360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.755418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.755471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.755511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.755519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.755575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.755632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.755689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.755746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.755787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.755794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.755856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.755910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.755966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.756023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.756064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.756070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.756149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.756205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.756262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.756315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.756428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.756436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.756489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916287:3080], now have 1 active actors on pipe
2025-10-10T14:31:18.756721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600621798916287:3080]
2025-10-10T14:31:18.756755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:18.756757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:18.756773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:18.756784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 118 reason: error at write: Disconnected sessionId: src_id|199dffde-9cbe7370-f049ed01-e56f385e_0
2025-10-10T14:31:18.757198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 118 sessionId: src_id|199dffde-9cbe7370-f049ed01-e56f385e_0 is DEAD
2025-10-10T14:31:18.757296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199dffde-9cbe7370-f049ed01-e56f385e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:18.757304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199dffde-9cbe7370-f049ed01-e56f385e_0] Write session will restart in 0.008543s
2025-10-10T14:31:18.757322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199dffde-9cbe7370-f049ed01-e56f385e_0] Write session: Do CDS request
2025-10-10T14:31:18.757327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199dffde-9cbe7370-f049ed01-e56f385e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:18.757453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:18.766763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199dffde-9cbe7370-f049ed01-e56f385e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.766836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:18.766848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 119
2025-10-10T14:31:18.766988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.767019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:18.767029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:18.767032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:18.767080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:18.767416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 119 sessionId:  describe result for acl check
2025-10-10T14:31:18.767446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:18.767449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:18.767450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:18.767454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600621798916422:3171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:18.767747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:18.767895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:18.767903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:18.767912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:18.767904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600621798916422:3171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:18.767951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:18.767980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600621016707327:2899]
2025-10-10T14:31:18.768373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:18.768628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:18.768656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:18.768861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:18.768894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.768899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.768899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.768900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.768901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.768901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.768902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.768902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.768903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.768904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.768904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.768905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.768906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.768909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.768916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.768919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.768921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.768923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.768926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.768928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.768930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.768932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.768935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.768937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.768939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.768941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.768946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.768951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.768957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.768960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.768963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.768966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.768968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.768971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.768974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.768977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.768979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.768982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.768985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.768988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.768990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.768993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.768996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.768999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.769001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.769004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.769007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.769010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.769012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.769015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.769018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.769021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.769046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:18.769965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600621798916422:3171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:18.771127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:18.771424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:18.771433Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:18.771435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:18.771437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:18.771441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 118 [2:7559600621016707327:2899]
2025-10-10T14:31:18.771449Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:18.771462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:18.771467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.771469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.771470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.771480Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:18.771488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:18.771495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:18.771535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.771540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.771541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.771543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:18.771590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:18.771598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.771608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.771619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.771628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:18.771645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916288:2438], now have 1 active actors on pipe
2025-10-10T14:31:18.771654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600621016707322:2899]
2025-10-10T14:31:18.771659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600621016707322:2899]
2025-10-10T14:31:18.771660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600621016707322:2899]
2025-10-10T14:31:18.771669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:18.771678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:18.771685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:18.771686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:18.771687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:18.771696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:18.771698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:18.771714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600621016707322:2899]
2025-10-10T14:31:18.771720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:18.771722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:18.771705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 118
2025-10-10T14:31:18.776447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600621798916422:3171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:18.776460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600621798916422:3171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:18.776464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600621798916422:3171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:18.776473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:18.776682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916460:3171], now have 1 active actors on pipe
2025-10-10T14:31:18.776754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 118
2025-10-10T14:31:18.776806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.776815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.776838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:18.776850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.776867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.776872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:18.776881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.776893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:18.776911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.777080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.777086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.777098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.777176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 119 partition: 0 MaxSeqNo: 40 sessionId: src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0
2025-10-10T14:31:18.777488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199dffde-9cbe7370-f049ed01-e56f385e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:18.780074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0] Write session: try to update token
2025-10-10T14:31:18.780088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:18.783011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:18.783032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.783039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600621016707322:2899]
2025-10-10T14:31:18.783077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:18.783090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:18.783256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:18.783379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.783506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.783627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:18.783805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:18.783835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:18.793043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId: src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:18.795422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:18.795627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.795645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.795679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:18.795750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:18.800002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:18.800013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.800015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:18.800017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:18.800025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600621016707322:2899]
2025-10-10T14:31:18.800028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600621016707322:2899]
2025-10-10T14:31:18.800031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600621016707322:2899]
2025-10-10T14:31:18.800068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:18.800071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:18.800075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:18.800078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:18.800078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.800080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:18.800243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:18.856882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600621798916488:3080]
2025-10-10T14:31:18.857080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 118, pipe: [1:7559600621798916488:3080]
2025-10-10T14:31:18.906649Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:18.916527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.916552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.916748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.916817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.916896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.916978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.917039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.917049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.917135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.917209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.917286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.917380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.917441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.917450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.917532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.917604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.917690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.917770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.917828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.917839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.917923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.917997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.918074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.918162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.918221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.918228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.918313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.918384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.918458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.918538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.918595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.918603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.918695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.918773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.918848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.918927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.919083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.919091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.919170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.919243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.919320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.919394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.919454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.919462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.919540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.919613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.919692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.919767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.919823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.919831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.919906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.919981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.920056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.920130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.920188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.920198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.920278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:18.920352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:18.920431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:18.920507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:18.920568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:18.920577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:18.920649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916488:3080], now have 1 active actors on pipe
2025-10-10T14:31:18.920882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:18.920893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:18.920898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:18.920922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 119 reason: error at write: Disconnected sessionId: src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0
2025-10-10T14:31:18.920935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600621798916488:3080]
2025-10-10T14:31:18.921132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 119 sessionId: src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0 is DEAD
2025-10-10T14:31:18.921234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:18.921244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0] Write session will restart in 0.006274s
2025-10-10T14:31:18.921270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0] Write session: Do CDS request
2025-10-10T14:31:18.921275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:18.922065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:18.928812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.928911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:18.928926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 120
2025-10-10T14:31:18.929082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:18.929118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:18.929126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:18.929130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:18.929606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 120 sessionId:  describe result for acl check
2025-10-10T14:31:18.929639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:18.929644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:18.929646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:18.929651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600621798916545:3184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:18.930128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600621798916545:3184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:18.932379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600621798916545:3184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:18.932970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:18.933606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:18.933789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:18.933799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:18.933810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:18.933854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:18.933900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600621016707540:2914]
2025-10-10T14:31:18.934494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:18.934710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600621798916545:3184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:18.934721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600621798916545:3184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:18.934723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600621798916545:3184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:18.934729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:18.934781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:18.934818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:18.935111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:18.935163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.935168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.935169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.935170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.935171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.935173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.935174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.935175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.935176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.935177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.935179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.935180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.935181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.935186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.935197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.935200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.935204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.935207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.935211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.935214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.935218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.935222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.935225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.935233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.935237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.935241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.935247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.935259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:18.935269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.935278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:18.935282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.935291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:18.935295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.935301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:18.935309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.935318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:18.935326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.935335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:18.935343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.935351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:18.935359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.935368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:18.935376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.935381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:18.935390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.935395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:18.935404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.935408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.935415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.935425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.935432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.935442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.935481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:18.937694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:18.938065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:18.938077Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:18.938079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:18.938083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:18.938088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 119 [2:7559600621016707540:2914]
2025-10-10T14:31:18.938114Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:18.938133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:18.938139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.938141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.938144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.938154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:18.938160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:18.938168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:18.938220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.938227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.938228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.938231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:18.938294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:18.938302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.938312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:18.938323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:18.938337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:18.938354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916656:3184], now have 1 active actors on pipe
2025-10-10T14:31:18.938362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600621798916489:2438], now have 1 active actors on pipe
2025-10-10T14:31:18.938369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600621016707535:2914]
2025-10-10T14:31:18.938375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600621016707535:2914]
2025-10-10T14:31:18.938377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600621016707535:2914]
2025-10-10T14:31:18.938390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:18.938398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:18.938400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:18.938402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:18.938405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:18.938419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:18.938425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:18.938403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 119
2025-10-10T14:31:18.938405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 119
2025-10-10T14:31:18.938446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600621016707535:2914]
2025-10-10T14:31:18.938456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:18.938460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:18.938475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.938483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.938526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65d4c26e-87691ee-5515fa2c-81c49320_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:18.938535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:18.938539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:18.938541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:18.938550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:18.938562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:18.938580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.938731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:18.938737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:18.938749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:18.938836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 120 partition: 0 MaxSeqNo: 40 sessionId: src_id|65d4c26e-87691ee-5515fa2c-81c49320_0
2025-10-10T14:31:18.939154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5786f456-51e6c76f-bee9f4f9-287bafad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65d4c26e-87691ee-5515fa2c-81c49320_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:18.941703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d4c26e-87691ee-5515fa2c-81c49320_0] Write session: try to update token
2025-10-10T14:31:18.941724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d4c26e-87691ee-5515fa2c-81c49320_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:18.956805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:18.956824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:18.956826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:18.956827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:18.956836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600621016707535:2914]
2025-10-10T14:31:18.956839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600621016707535:2914]
2025-10-10T14:31:18.956843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600621016707535:2914]
2025-10-10T14:31:18.956887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:18.956893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:18.956893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:18.956897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:18.956900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:18.956902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:18.957046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:18.957050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId: src_id|65d4c26e-87691ee-5515fa2c-81c49320_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:18.959527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:19.021254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600626093883962:3080]
2025-10-10T14:31:19.021542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 119, pipe: [1:7559600626093883962:3080]
2025-10-10T14:31:19.065841Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:19.066469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.066485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.066521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093883962:3080], now have 1 active actors on pipe
2025-10-10T14:31:19.066701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:19.066771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600626093883962:3080]
2025-10-10T14:31:19.066784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:19.066788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:19.066798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:19.066854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 120 reason: error at write: Disconnected sessionId: src_id|65d4c26e-87691ee-5515fa2c-81c49320_0
2025-10-10T14:31:19.067024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 120 sessionId: src_id|65d4c26e-87691ee-5515fa2c-81c49320_0 is DEAD
2025-10-10T14:31:19.067154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d4c26e-87691ee-5515fa2c-81c49320_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:19.067164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d4c26e-87691ee-5515fa2c-81c49320_0] Write session will restart in 0.007207s
2025-10-10T14:31:19.067184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d4c26e-87691ee-5515fa2c-81c49320_0] Write session: Do CDS request
2025-10-10T14:31:19.067189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d4c26e-87691ee-5515fa2c-81c49320_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:19.075846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d4c26e-87691ee-5515fa2c-81c49320_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.076035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:19.076063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 121
2025-10-10T14:31:19.076204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.076240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:19.076244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:19.076248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:19.076614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 121 sessionId:  describe result for acl check
2025-10-10T14:31:19.076647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:19.076648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:19.076650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:19.076654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600626093884055:3189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:19.077088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600626093884055:3189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:19.078918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600626093884055:3189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:19.079307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:19.080026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:19.080192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:19.080202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:19.080211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:19.080254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:19.080297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600625311675023:2917]
2025-10-10T14:31:19.080734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:19.080937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:19.080981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:19.081096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600626093884055:3189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:19.081109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600626093884055:3189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:19.081113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600626093884055:3189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:19.081119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:19.081234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:19.081288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.081293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.081294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.081294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.081295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.081295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.081296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.081297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.081298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.081299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.081299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.081300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.081300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.081304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.081311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.081313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.081315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.081318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.081320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.081322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.081324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.081326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.081347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.081350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.081354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.081357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.081364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.081372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.081378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.081383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.081387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.081392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.081400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.081405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.081413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.081422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.081426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.081432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.081437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.081442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.081450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.081454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.081463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.081473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.081481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.081487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.081495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.081500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.081508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.081513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.081521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.081531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.081575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:19.083834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:19.084163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:19.084185Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:19.084188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:19.084192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:19.084198Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 120 [2:7559600625311675023:2917]
2025-10-10T14:31:19.084212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:19.084229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:19.084237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.084241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.084243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.084261Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:19.084273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:19.084281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:19.084339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.084348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.084350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.084352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:19.084420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:19.084428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.084440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.084458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.084479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:19.084507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884143:3189], now have 1 active actors on pipe
2025-10-10T14:31:19.084518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093883975:2438], now have 1 active actors on pipe
2025-10-10T14:31:19.084536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600625311675018:2917]
2025-10-10T14:31:19.084545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600625311675018:2917]
2025-10-10T14:31:19.084514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 120
2025-10-10T14:31:19.084520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 120
2025-10-10T14:31:19.084547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600625311675018:2917]
2025-10-10T14:31:19.084558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:19.084572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:19.084571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:19.084574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:19.084575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:19.084590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:19.084599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:19.084616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.084626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.084667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600625311675018:2917]
2025-10-10T14:31:19.084680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:19.084683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:19.084698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f00f7760-f023adca-4731466b-5d18ce1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:19.084711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.084720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.084723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:19.084735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.084750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:19.084790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.084943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.084951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.084965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.085042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 121 partition: 0 MaxSeqNo: 40 sessionId: src_id|f00f7760-f023adca-4731466b-5d18ce1a_0
2025-10-10T14:31:19.085368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d4c26e-87691ee-5515fa2c-81c49320_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f00f7760-f023adca-4731466b-5d18ce1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:19.088196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f00f7760-f023adca-4731466b-5d18ce1a_0] Write session: try to update token
2025-10-10T14:31:19.088213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f00f7760-f023adca-4731466b-5d18ce1a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:19.101878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId: src_id|f00f7760-f023adca-4731466b-5d18ce1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:19.103300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:19.103316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.103318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:19.103319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:19.103327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600625311675018:2917]
2025-10-10T14:31:19.103331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600625311675018:2917]
2025-10-10T14:31:19.103334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600625311675018:2917]
2025-10-10T14:31:19.103367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:19.103373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:19.103373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:19.103376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:19.103379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.103381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:19.103513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:19.104512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:19.167186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600626093884153:3080]
2025-10-10T14:31:19.167454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 120, pipe: [1:7559600626093884153:3080]
2025-10-10T14:31:19.207463Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:19.207870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.207887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.207929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884153:3080], now have 1 active actors on pipe
2025-10-10T14:31:19.208100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:19.208169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600626093884153:3080]
2025-10-10T14:31:19.208182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:19.208185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:19.208196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:19.208241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 121 reason: error at write: Disconnected sessionId: src_id|f00f7760-f023adca-4731466b-5d18ce1a_0
2025-10-10T14:31:19.208426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 121 sessionId: src_id|f00f7760-f023adca-4731466b-5d18ce1a_0 is DEAD
2025-10-10T14:31:19.208614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00f7760-f023adca-4731466b-5d18ce1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:19.208624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00f7760-f023adca-4731466b-5d18ce1a_0] Write session will restart in 0.008493s
2025-10-10T14:31:19.208644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00f7760-f023adca-4731466b-5d18ce1a_0] Write session: Do CDS request
2025-10-10T14:31:19.208652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00f7760-f023adca-4731466b-5d18ce1a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:19.217806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f00f7760-f023adca-4731466b-5d18ce1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.217840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:19.217852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 122
2025-10-10T14:31:19.218029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.218056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:19.218064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:19.218067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:19.218528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 122 sessionId:  describe result for acl check
2025-10-10T14:31:19.218556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:19.218562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:19.218563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:19.218568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600626093884288:3193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:19.219006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600626093884288:3193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:19.219580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:19.220296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:19.220464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:19.220477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:19.220486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:19.220535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:19.220565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600625311675200:2919]
2025-10-10T14:31:19.220948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:19.221150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:19.221180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:19.221174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600626093884288:3193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:19.221398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:19.221437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.221445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.221446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.221447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.221448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.221449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.221450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.221451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.221452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.221453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.221454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.221456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.221457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.221462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.221474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.221478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.221482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.221485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.221487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.221489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.221491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.221493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.221496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.221498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.221500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.221502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.221507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.221513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.221517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.221520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.221523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.221526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.221529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.221532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.221535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.221538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.221541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.221544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.221547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.221550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.221552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.221555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.221558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.221561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.221565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.221568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.221571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.221574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.221576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.221579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.221582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.221585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.221606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:19.223543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600626093884288:3193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:19.223555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600626093884288:3193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:19.223558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600626093884288:3193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:19.223564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:19.223589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:19.223874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:19.223886Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:19.223887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:19.223890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:19.223894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 121 [2:7559600625311675200:2919]
2025-10-10T14:31:19.223901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:19.223911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:19.223913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.223915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.223916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.223926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:19.223932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:19.223937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:19.223974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.223981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.223983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.223984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:19.224040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:19.224049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.224056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.224063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.224073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:19.224088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884325:3193], now have 1 active actors on pipe
2025-10-10T14:31:19.224096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884154:2438], now have 1 active actors on pipe
2025-10-10T14:31:19.224101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600625311675194:2919]
2025-10-10T14:31:19.224102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600625311675194:2919]
2025-10-10T14:31:19.224104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600625311675194:2919]
2025-10-10T14:31:19.224114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:19.224125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:19.224128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 121
2025-10-10T14:31:19.224128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:19.224131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 121
2025-10-10T14:31:19.224130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:19.224132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:19.224140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:19.224142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:19.224167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600625311675194:2919]
2025-10-10T14:31:19.224169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:19.224170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:19.224183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.224191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.224225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47980406-fee8a679-baa8ba59-c75d286b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:19.224236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.224238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.224240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:19.224247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.224255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:19.224266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.224405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.224412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.224424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.224516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 122 partition: 0 MaxSeqNo: 40 sessionId: src_id|47980406-fee8a679-baa8ba59-c75d286b_0
2025-10-10T14:31:19.224785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00f7760-f023adca-4731466b-5d18ce1a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47980406-fee8a679-baa8ba59-c75d286b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:19.227233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47980406-fee8a679-baa8ba59-c75d286b_0] Write session: try to update token
2025-10-10T14:31:19.227248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47980406-fee8a679-baa8ba59-c75d286b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:19.240731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId: src_id|47980406-fee8a679-baa8ba59-c75d286b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:19.242473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:19.242489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.242491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:19.242493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:19.242501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600625311675194:2919]
2025-10-10T14:31:19.242503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600625311675194:2919]
2025-10-10T14:31:19.242508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600625311675194:2919]
2025-10-10T14:31:19.242546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:19.242545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:19.242550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:19.242551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.242553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:19.242553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:19.242671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:19.243129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:19.308484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600626093884333:3080]
2025-10-10T14:31:19.308780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 121, pipe: [1:7559600626093884333:3080]
2025-10-10T14:31:19.345692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:19.345930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.345944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.345984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884333:3080], now have 1 active actors on pipe
2025-10-10T14:31:19.346145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:19.346260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600626093884333:3080]
2025-10-10T14:31:19.346259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:19.346284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:19.346338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 122 reason: status is not ok: tablet will be restarted right now sessionId: src_id|47980406-fee8a679-baa8ba59-c75d286b_0
2025-10-10T14:31:19.346507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 122 sessionId: src_id|47980406-fee8a679-baa8ba59-c75d286b_0 is DEAD
2025-10-10T14:31:19.346674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47980406-fee8a679-baa8ba59-c75d286b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:19.346687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47980406-fee8a679-baa8ba59-c75d286b_0] Write session will restart in 0.005580s
2025-10-10T14:31:19.346712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47980406-fee8a679-baa8ba59-c75d286b_0] Write session: Do CDS request
2025-10-10T14:31:19.346718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47980406-fee8a679-baa8ba59-c75d286b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:19.353724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47980406-fee8a679-baa8ba59-c75d286b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.353818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:19.353832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 123
2025-10-10T14:31:19.353936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.353964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:19.353979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:19.353985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:19.354380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 123 sessionId:  describe result for acl check
2025-10-10T14:31:19.354417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:19.354420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:19.354430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:19.354437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600626093884367:3197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:19.354985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600626093884367:3197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:19.357054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600626093884367:3197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:19.358423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:19.359174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:19.359315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:19.359324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:19.359332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:19.359363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600626093884367:3197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:19.359375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600626093884367:3197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:19.359365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:19.359405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600625311675377:2921]
2025-10-10T14:31:19.359379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600626093884367:3197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:19.359387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:19.359785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:19.359987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:19.360015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:19.360210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:19.360245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.360251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.360252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.360252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.360253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.360254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.360254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.360255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.360255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.360256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.360257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.360257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.360258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.360262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.360270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.360273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.360275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.360277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.360280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.360282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.360284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.360286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.360289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.360291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.360294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.360296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.360300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.360305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.360310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.360313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.360316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.360319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.360323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.360326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.360329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.360332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.360334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.360338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.360340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.360343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.360346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.360349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.360352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.360355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.360358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.360361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.360363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.360366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.360369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.360372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.360375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.360378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.360399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:19.362403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:19.362700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:19.362719Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:19.362720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:19.362723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:19.362727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 122 [2:7559600625311675377:2921]
2025-10-10T14:31:19.362735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:19.362756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:19.362758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.362759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.362761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.362771Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:19.362776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:19.362782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:19.362816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.362823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.362825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.362827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:19.362871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:19.362878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.362885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.362891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.362901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:19.362915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884502:3197], now have 1 active actors on pipe
2025-10-10T14:31:19.362922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884334:2438], now have 1 active actors on pipe
2025-10-10T14:31:19.362928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600625311675372:2921]
2025-10-10T14:31:19.362929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600625311675372:2921]
2025-10-10T14:31:19.362931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600625311675372:2921]
2025-10-10T14:31:19.362942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:19.362953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:19.362965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:19.362970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:19.362970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:19.362974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:19.362976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:19.362985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600625311675372:2921]
2025-10-10T14:31:19.362987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:19.362989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:19.362986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 122
2025-10-10T14:31:19.363008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 122
2025-10-10T14:31:19.363048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.363056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.363085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:19.363095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.363098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.363099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:19.363107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.363114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:19.363124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.363253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.363267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.363296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.363374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 123 partition: 0 MaxSeqNo: 40 sessionId: src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0
2025-10-10T14:31:19.363655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47980406-fee8a679-baa8ba59-c75d286b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:19.369795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0] Write session: try to update token
2025-10-10T14:31:19.369815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:19.380922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:19.380940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.380942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:19.380943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:19.380951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600625311675372:2921]
2025-10-10T14:31:19.380955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600625311675372:2921]
2025-10-10T14:31:19.380958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600625311675372:2921]
2025-10-10T14:31:19.380994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:19.380997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:19.381000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.381002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:19.381002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:19.381008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:19.381115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:19.384393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId: src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:19.393207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:19.446209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600626093884513:3080]
2025-10-10T14:31:19.446522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 122, pipe: [1:7559600626093884513:3080]
2025-10-10T14:31:19.483536Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:19.483788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.483801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.483820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884513:3080], now have 1 active actors on pipe
2025-10-10T14:31:19.483976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:19.484104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600626093884513:3080]
2025-10-10T14:31:19.484136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:19.484135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:19.484139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:19.484195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 123 reason: error at write: Disconnected sessionId: src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0
2025-10-10T14:31:19.484392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 123 sessionId: src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0 is DEAD
2025-10-10T14:31:19.484544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:19.484556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0] Write session will restart in 0.007886s
2025-10-10T14:31:19.484582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0] Write session: Do CDS request
2025-10-10T14:31:19.484607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:19.493865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.493954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:19.493972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 124
2025-10-10T14:31:19.494070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.494098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:19.494102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:19.494116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:19.494449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 124 sessionId:  describe result for acl check
2025-10-10T14:31:19.494476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:19.494477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:19.494478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:19.494482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600626093884646:3201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:19.494893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600626093884646:3201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:19.495588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:19.496349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:19.496533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:19.496545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:19.496557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:19.496623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600626093884646:3201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:19.496604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:19.496659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600625311675553:2923]
2025-10-10T14:31:19.497273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:19.497511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:19.497555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:19.497875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:19.497928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.497935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.497936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.497938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.497939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.497940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.497941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.497942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.497944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.497945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.497947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.497948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.497949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.497954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.497966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.497970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.497975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.497978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.497983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.497987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.497991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.497995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.498000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.498004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.498007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.498010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.498017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.498026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.498033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.498039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.498043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.498048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.498054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.498059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.498064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.498069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.498074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.498079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.498084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.498089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.498093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.498099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.498115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.498121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.498125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.498131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.498135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.498141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.498153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.498159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.498163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.498168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.498213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:19.500236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600626093884646:3201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:19.500249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600626093884646:3201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:19.500252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600626093884646:3201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:19.500260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:19.500309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:19.500635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:19.500647Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:19.500649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:19.500652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:19.500658Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 123 [2:7559600625311675553:2923]
2025-10-10T14:31:19.500668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:19.500686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:19.500689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.500692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.500694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.500710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:19.500724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:19.500731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:19.500782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.500792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.500794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.500797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:19.500861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:19.500870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.500880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.500893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.500910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:19.500939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884515:2438], now have 1 active actors on pipe
2025-10-10T14:31:19.500958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884688:3201], now have 1 active actors on pipe
2025-10-10T14:31:19.500965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600625311675547:2923]
2025-10-10T14:31:19.500968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600625311675547:2923]
2025-10-10T14:31:19.500970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600625311675547:2923]
2025-10-10T14:31:19.500962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 123
2025-10-10T14:31:19.500969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 123
2025-10-10T14:31:19.500984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:19.500998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:19.501013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:19.501016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:19.501018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:19.501020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:19.501022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:19.501054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.501064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.501083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600625311675547:2923]
2025-10-10T14:31:19.501095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:19.501105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:19.501121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:19.501135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.501138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.501141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:19.501152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.501176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:19.501203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.501343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.501351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.501365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.501446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 124 partition: 0 MaxSeqNo: 40 sessionId: src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0
2025-10-10T14:31:19.501803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40db2214-6e4c0bc5-cd00ff76-edc5c940_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:19.504239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0] Write session: try to update token
2025-10-10T14:31:19.504255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:19.518077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId: src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:19.519290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:19.519308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.519311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:19.519313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:19.519323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600625311675547:2923]
2025-10-10T14:31:19.519327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600625311675547:2923]
2025-10-10T14:31:19.519332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600625311675547:2923]
2025-10-10T14:31:19.519365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:19.519369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:19.519373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:19.519373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:19.519381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.519383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:19.519515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:19.521235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:19.584445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600626093884702:3080]
2025-10-10T14:31:19.584696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 123, pipe: [1:7559600626093884702:3080]
2025-10-10T14:31:19.624547Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:19.624880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.624897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.624943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884702:3080], now have 1 active actors on pipe
2025-10-10T14:31:19.625179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:19.625199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600626093884702:3080]
2025-10-10T14:31:19.625216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:19.625220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:19.625229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:19.625282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 124 reason: error at write: Disconnected sessionId: src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0
2025-10-10T14:31:19.625505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 124 sessionId: src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0 is DEAD
2025-10-10T14:31:19.625623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:19.625633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0] Write session will restart in 0.007618s
2025-10-10T14:31:19.625651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0] Write session: Do CDS request
2025-10-10T14:31:19.625656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:19.634715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.634824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:19.634834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 125
2025-10-10T14:31:19.634942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.634966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:19.634973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:19.634977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:19.635367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 125 sessionId:  describe result for acl check
2025-10-10T14:31:19.635392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:19.635393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:19.635394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:19.635398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600626093884825:3207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:19.635997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600626093884825:3207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:19.636827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:19.637556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:19.637722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:19.637735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:19.637747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:19.637795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:19.637837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600625311675734:2926]
2025-10-10T14:31:19.638004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600626093884825:3207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:19.638478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:19.638724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:19.638769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:19.639092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:19.639143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.639151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.639152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.639153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.639154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.639155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.639157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.639158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.639159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.639161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.639162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.639163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.639165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.639170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.639182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.639186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.639191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.639195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.639200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.639205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.639209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.639213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.639218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.639223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.639227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.639231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.639239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.639247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.639254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.639259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.639264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.639270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.639275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.639284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.639291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.639297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.639308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.639314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.639324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.639329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.639334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.639345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.639350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.639356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.639367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.639372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.639383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.639389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.639393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.639405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.639412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.639423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.639466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:19.641498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600626093884825:3207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:19.641510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600626093884825:3207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:19.641514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600626093884825:3207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:19.641522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:19.641552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:19.641853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:19.641864Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:19.641866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:19.641869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:19.641873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 124 [2:7559600625311675734:2926]
2025-10-10T14:31:19.641881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:19.641893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:19.641894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.641897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.641899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.641912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:19.641919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:19.641928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:19.641979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.641987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.641988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.641989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:19.642046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:19.642053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.642060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.642066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.642075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:19.642091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884707:2438], now have 1 active actors on pipe
2025-10-10T14:31:19.642097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884881:3207], now have 1 active actors on pipe
2025-10-10T14:31:19.642103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600625311675728:2926]
2025-10-10T14:31:19.642117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600625311675728:2926]
2025-10-10T14:31:19.642119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600625311675728:2926]
2025-10-10T14:31:19.642129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:19.642142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:19.642152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:19.642154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:19.642158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:19.642162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:19.642164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:19.642171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600625311675728:2926]
2025-10-10T14:31:19.642165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 124
2025-10-10T14:31:19.642177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:19.642173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 124
2025-10-10T14:31:19.642187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:19.642215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.642222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.642242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45a9876e-d85fcdac-d4b8a095-18394988_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:19.642259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.642265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.642266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:19.642274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.642285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:19.642298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.642396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.642401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.642412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.642488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 125 partition: 0 MaxSeqNo: 40 sessionId: src_id|45a9876e-d85fcdac-d4b8a095-18394988_0
2025-10-10T14:31:19.642780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a00fec-8b3d158a-4027927f-dee208ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45a9876e-d85fcdac-d4b8a095-18394988_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:19.645281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a9876e-d85fcdac-d4b8a095-18394988_0] Write session: try to update token
2025-10-10T14:31:19.645296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a9876e-d85fcdac-d4b8a095-18394988_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:19.652983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:19.652999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.653008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600625311675728:2926]
2025-10-10T14:31:19.653044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:19.653080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:19.653226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:19.653371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.653492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.653621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.653790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:19.653826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:19.658606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId: src_id|45a9876e-d85fcdac-d4b8a095-18394988_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:19.661040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:19.661442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.661464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.661497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:19.661573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:19.672353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:19.672364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.672366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:19.672368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:19.672377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600625311675728:2926]
2025-10-10T14:31:19.672380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600625311675728:2926]
2025-10-10T14:31:19.672382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600625311675728:2926]
2025-10-10T14:31:19.672416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:19.672422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.672423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:19.672434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:19.672447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:19.672451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:19.672540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:19.725256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600626093884888:3080]
2025-10-10T14:31:19.725561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 124, pipe: [1:7559600626093884888:3080]
2025-10-10T14:31:19.773763Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:19.780145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.780163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.780313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.780372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.780427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.780479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.780518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.780529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.780586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.780639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.780734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.780793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.780833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.780842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.780903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.780957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.781012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.781067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.781104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.781110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.781169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.781227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.781277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.781351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.781585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.781592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.781648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.781699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.781755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.781812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.781853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.781859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.781920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.781972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.782025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.782078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.782129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.782134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.782191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.782246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.782305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.782364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.782407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.782412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.782467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.782519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.782569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.782621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.782730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.782736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.782788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.782842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.782901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.782954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.782995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.782999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.783052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.783102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.783155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.783207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.783244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.783251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.783289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884888:3080], now have 1 active actors on pipe
2025-10-10T14:31:19.783576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:19.783587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600626093884888:3080]
2025-10-10T14:31:19.783618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:19.783621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:19.783652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 125 reason: error at write: Disconnected sessionId: src_id|45a9876e-d85fcdac-d4b8a095-18394988_0
2025-10-10T14:31:19.783910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:19.783984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 125 sessionId: src_id|45a9876e-d85fcdac-d4b8a095-18394988_0 is DEAD
2025-10-10T14:31:19.784189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a9876e-d85fcdac-d4b8a095-18394988_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:19.784202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a9876e-d85fcdac-d4b8a095-18394988_0] Write session will restart in 0.005105s
2025-10-10T14:31:19.784223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a9876e-d85fcdac-d4b8a095-18394988_0] Write session: Do CDS request
2025-10-10T14:31:19.784237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a9876e-d85fcdac-d4b8a095-18394988_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:19.790750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a9876e-d85fcdac-d4b8a095-18394988_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.790849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:19.790861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 126
2025-10-10T14:31:19.790958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.790990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:19.790999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:19.791002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:19.791436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 126 sessionId:  describe result for acl check
2025-10-10T14:31:19.791469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:19.791471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:19.791473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:19.791479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600626093884940:3211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:19.791984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600626093884940:3211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:19.794621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:19.794910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600626093884940:3211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:19.794969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:19.795102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:19.795111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:19.795119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:19.795156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:19.795194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600625311675913:2928]
2025-10-10T14:31:19.795550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:19.795792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:19.795821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:19.796015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:19.796048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.796053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.796054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.796055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.796056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.796058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.796059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.796060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.796061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.796062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.796063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.796064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.796065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.796070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.796082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.796087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.796093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.796095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.796097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.796099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.796101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.796103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.796105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.796107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.796109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.796111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.796117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.796121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.796129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.796133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.796136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.796139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.796141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.796144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.796147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.796150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.796153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.796156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.796158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.796165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.796167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.796170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.796173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.796176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.796185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.796190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.796199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.796206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.796213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.796216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.796219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.796222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.796243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:19.798132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600626093884940:3211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:19.798143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600626093884940:3211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:19.798147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600626093884940:3211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:19.798153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:19.798211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:19.798493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:19.798500Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:19.798501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:19.798503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:19.798509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 125 [2:7559600625311675913:2928]
2025-10-10T14:31:19.798516Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:19.798526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:19.798528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.798530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.798531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.798542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:19.798550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:19.798555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:19.798590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.798595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.798596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.798598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:19.798645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:19.798651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.798657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.798666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.798676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:19.798694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093884889:2438], now have 1 active actors on pipe
2025-10-10T14:31:19.798700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093885065:3211], now have 1 active actors on pipe
2025-10-10T14:31:19.798705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600625311675908:2928]
2025-10-10T14:31:19.798706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600625311675908:2928]
2025-10-10T14:31:19.798707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600625311675908:2928]
2025-10-10T14:31:19.798715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:19.798724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:19.798727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:19.798730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:19.798731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:19.798738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:19.798741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:19.798753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 125
2025-10-10T14:31:19.798759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600625311675908:2928]
2025-10-10T14:31:19.798771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 125
2025-10-10T14:31:19.798773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:19.798781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:19.798804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.798811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.798831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f257893e-ff00cdda-8236453b-e60cef39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:19.798843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.798845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.798846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:19.798853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.798861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:19.798870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.799043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.799050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.799062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.799140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 126 partition: 0 MaxSeqNo: 40 sessionId: src_id|f257893e-ff00cdda-8236453b-e60cef39_0
2025-10-10T14:31:19.799419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a9876e-d85fcdac-d4b8a095-18394988_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f257893e-ff00cdda-8236453b-e60cef39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:19.801809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f257893e-ff00cdda-8236453b-e60cef39_0] Write session: try to update token
2025-10-10T14:31:19.801821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f257893e-ff00cdda-8236453b-e60cef39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:19.809411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:19.809423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.809431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600625311675908:2928]
2025-10-10T14:31:19.809471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:19.809479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:19.809623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:19.809746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.809865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.809990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.810168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:19.810201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:19.815052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId: src_id|f257893e-ff00cdda-8236453b-e60cef39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:19.817488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:19.817673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.817691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.817723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:19.817791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:19.826237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:19.826251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.826254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:19.826255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:19.826262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600625311675908:2928]
2025-10-10T14:31:19.826264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600625311675908:2928]
2025-10-10T14:31:19.826267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600625311675908:2928]
2025-10-10T14:31:19.826302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:19.826308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.826309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:19.826310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:19.826317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:19.826321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:19.826428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:19.883943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600626093885096:3080]
2025-10-10T14:31:19.884126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 125, pipe: [1:7559600626093885096:3080]
2025-10-10T14:31:19.927947Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:19.934303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.934324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.934468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.934525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.934580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.934636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.934679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.934691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.934753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.934807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.934862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.934922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.934961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.934967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.935032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.935086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.935141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.935196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.935233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.935239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.935295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.935349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.935403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.935473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.935516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.935522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.935579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.935632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.935685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.935739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.935777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.935782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.935838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.935889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.935943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.935997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.936036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.936042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.936109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.936174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.936238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.936291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.936329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.936334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.936388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.936442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.936499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.936553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.936592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.936598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.936651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.936704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.936757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.936809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.936847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.936852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.936905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:19.936956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:19.937010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:19.937063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:19.937102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:19.937107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:19.937146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093885096:3080], now have 1 active actors on pipe
2025-10-10T14:31:19.937414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:19.937459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:19.937464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:19.937477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600626093885096:3080]
2025-10-10T14:31:19.937489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 126 reason: error at write: Disconnected sessionId: src_id|f257893e-ff00cdda-8236453b-e60cef39_0
2025-10-10T14:31:19.937663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 126 sessionId: src_id|f257893e-ff00cdda-8236453b-e60cef39_0 is DEAD
2025-10-10T14:31:19.937817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257893e-ff00cdda-8236453b-e60cef39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:19.937826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257893e-ff00cdda-8236453b-e60cef39_0] Write session will restart in 0.009868s
2025-10-10T14:31:19.937828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:19.937845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257893e-ff00cdda-8236453b-e60cef39_0] Write session: Do CDS request
2025-10-10T14:31:19.937852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257893e-ff00cdda-8236453b-e60cef39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:19.948820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f257893e-ff00cdda-8236453b-e60cef39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.948930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:19.948948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 127
2025-10-10T14:31:19.949096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:19.949123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:19.949130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:19.949142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:19.949376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:19.949514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 127 sessionId:  describe result for acl check
2025-10-10T14:31:19.949542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:19.949546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:19.949548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:19.949551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600626093885241:3224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:19.949973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600626093885241:3224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:19.950038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:19.950237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:19.950251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:19.950267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:19.950332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:19.950371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600625311676132:2943]
2025-10-10T14:31:19.950912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:19.951391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:19.951447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:19.951706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:19.951750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.951755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.951756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.951756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.951757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.951757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.951758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.951759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.951760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.951761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.951761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.951762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.951762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.951767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.951775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.951778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.951780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.951782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.951785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.951787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.951789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.951791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.951794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.951796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.951798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.951800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.951815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.951822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:19.951827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.951832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:19.951835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.951838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:19.951840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.951844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:19.951846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.951849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:19.951852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.951855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:19.951857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.951861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:19.951863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.951866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:19.951869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.951872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:19.951874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.951877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:19.951880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.951883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.951885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.951888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.951891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.951894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.951915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:19.952651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600626093885241:3224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:19.954240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:19.954529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:19.954541Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:19.954542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:19.954545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:19.954549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 126 [2:7559600625311676132:2943]
2025-10-10T14:31:19.954557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:19.954569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:19.954571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.954573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.954575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.954587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:19.954593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:19.954598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:19.954638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.954644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.954645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.954647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:19.954705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:19.954713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.954725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:19.954731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:19.954744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:19.954763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093885098:2438], now have 1 active actors on pipe
2025-10-10T14:31:19.954772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600625311676127:2943]
2025-10-10T14:31:19.954774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600625311676127:2943]
2025-10-10T14:31:19.954775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600625311676127:2943]
2025-10-10T14:31:19.954784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:19.954797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:19.954799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:19.954802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:19.954803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:19.954810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:19.954792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 126
2025-10-10T14:31:19.954813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:19.954830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600625311676127:2943]
2025-10-10T14:31:19.954836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:19.954838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:19.955227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600626093885241:3224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:19.955239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600626093885241:3224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:19.955242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600626093885241:3224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:19.955248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:19.955410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600626093885276:3224], now have 1 active actors on pipe
2025-10-10T14:31:19.955451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 126
2025-10-10T14:31:19.955489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.955510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.955540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:19.955553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:19.955561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:19.955564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:19.955584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:19.955600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:19.955618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.955748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.955755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.955768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:19.955842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 127 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0
2025-10-10T14:31:19.956165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f257893e-ff00cdda-8236453b-e60cef39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:19.958681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0] Write session: try to update token
2025-10-10T14:31:19.958694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:19.965792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:19.965809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.965823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600625311676127:2943]
2025-10-10T14:31:19.965869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:19.965874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:19.966050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:19.966196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.966330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.966468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:19.966644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:19.966688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:19.972689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId: src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:19.975137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:19.975333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:19.975352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:19.975391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:19.975476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:19.983339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:19.983355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:19.983359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:19.983360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:19.983370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600625311676127:2943]
2025-10-10T14:31:19.983375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600625311676127:2943]
2025-10-10T14:31:19.983378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600625311676127:2943]
2025-10-10T14:31:19.983423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:19.983422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:19.983427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:19.983431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:19.983434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:19.983437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:19.983570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:20.037551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600630388852578:3080]
2025-10-10T14:31:20.037849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 126, pipe: [1:7559600630388852578:3080]
2025-10-10T14:31:20.088173Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:20.094958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.094981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.095132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.095187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.095245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.095305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.095357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.095365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.095425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.095479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.095535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.095592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.095632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.095638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.095696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.095748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.095804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.095861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.095903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.095909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.095967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.096022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.096076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.096129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.096167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.096172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.096229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.096282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.096337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.096398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.096447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.096457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.096521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.096574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.096628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.096684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.096724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.096730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.096786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.096838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.096893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.096950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.097068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.097078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.097134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.097187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.097243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.097299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.097354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.097360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.097453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.097505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.097561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.097615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.097653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.097659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.097716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.097769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.097824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.097879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.097918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.097923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.097962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388852578:3080], now have 1 active actors on pipe
2025-10-10T14:31:20.098229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600630388852578:3080]
2025-10-10T14:31:20.098236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:20.098241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:20.098265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:20.098273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 127 reason: error at write: Disconnected sessionId: src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0
2025-10-10T14:31:20.098487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 127 sessionId: src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0 is DEAD
2025-10-10T14:31:20.098556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:20.098641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:20.098654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0] Write session will restart in 0.007859s
2025-10-10T14:31:20.098678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0] Write session: Do CDS request
2025-10-10T14:31:20.098684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:20.107794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.107871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:20.107886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 128
2025-10-10T14:31:20.108026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.108062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:20.108075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:20.108079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:20.108531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 128 sessionId:  describe result for acl check
2025-10-10T14:31:20.108562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:20.108568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:20.108571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:20.108577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600630388852731:3229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:20.109090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600630388852731:3229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:20.109539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:20.110336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:20.110510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:20.110521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:20.110533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:20.110581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:20.110611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600629606643621:2946]
2025-10-10T14:31:20.111012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:20.111268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:20.111301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:20.111339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600630388852731:3229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:20.111517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:20.111554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.111560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.111561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.111561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.111562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.111563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.111563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.111564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.111564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.111565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.111566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.111566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.111567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.111571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.111583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.111586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.111591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.111595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.111599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.111603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.111607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.111611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.111613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.111615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.111617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.111619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.111624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.111630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.111634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.111637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.111641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.111644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.111647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.111650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.111653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.111656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.111659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.111662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.111665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.111668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.111670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.111673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.111676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.111679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.111681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.111684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.111688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.111696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.111698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.111701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.111704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.111710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.111732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:20.113747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600630388852731:3229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:20.113762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600630388852731:3229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:20.113765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600630388852731:3229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:20.113773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:20.113853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:20.114168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:20.114179Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:20.114181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:20.114184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:20.114189Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 127 [2:7559600629606643621:2946]
2025-10-10T14:31:20.114201Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:20.114216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:20.114223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.114227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.114229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.114243Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:20.114256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:20.114269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:20.114319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.114326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.114327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.114330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:20.114391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:20.114398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.114409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.114426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.114448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:20.114475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388852591:2438], now have 1 active actors on pipe
2025-10-10T14:31:20.114478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388852768:3229], now have 1 active actors on pipe
2025-10-10T14:31:20.114477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 127
2025-10-10T14:31:20.114485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600629606643615:2946]
2025-10-10T14:31:20.114491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 127
2025-10-10T14:31:20.114491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600629606643615:2946]
2025-10-10T14:31:20.114493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600629606643615:2946]
2025-10-10T14:31:20.114501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:20.114514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:20.114518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:20.114521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:20.114522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:20.114534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:20.114537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:20.114558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.114567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.114598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600629606643615:2946]
2025-10-10T14:31:20.114610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:20.114626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:20.114631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:20.114638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.114642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.114644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:20.114654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.114668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:20.114703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.114842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.114850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.114867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.114947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 128 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0
2025-10-10T14:31:20.115217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe20bec8-fbc0cc48-7f271d7-313bbdeb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:20.117604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0] Write session: try to update token
2025-10-10T14:31:20.117622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:20.131277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId: src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:20.133725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:20.133802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:20.133819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:20.133822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:20.133823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:20.133831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600629606643615:2946]
2025-10-10T14:31:20.133836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600629606643615:2946]
2025-10-10T14:31:20.133840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600629606643615:2946]
2025-10-10T14:31:20.133863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:20.133867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:20.133869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:20.133890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.133905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.133930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:20.133941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.133949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:20.134072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:20.198335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600630388852776:3080]
2025-10-10T14:31:20.198619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 127, pipe: [1:7559600630388852776:3080]
2025-10-10T14:31:20.239143Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:20.239419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388852776:3080], now have 1 active actors on pipe
2025-10-10T14:31:20.239636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:20.239671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:20.239678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:20.239685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:20.239724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600630388852776:3080]
2025-10-10T14:31:20.239755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 128 reason: error at write: Disconnected sessionId: src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0
2025-10-10T14:31:20.240056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 128 sessionId: src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0 is DEAD
2025-10-10T14:31:20.240221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:20.240230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0] Write session will restart in 0.006341s
2025-10-10T14:31:20.240248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0] Write session: Do CDS request
2025-10-10T14:31:20.240252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:20.247739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.247814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:20.247836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 129
2025-10-10T14:31:20.247964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.248008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:20.248018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:20.248022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:20.248444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 129 sessionId:  describe result for acl check
2025-10-10T14:31:20.248479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:20.248487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:20.248489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:20.248495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600630388852832:3233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:20.249020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600630388852832:3233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:20.251246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600630388852832:3233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:20.251613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:20.252219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:20.252376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:20.252399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:20.252411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:20.252454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:20.252490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600629606643803:2948]
2025-10-10T14:31:20.252898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:20.253135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:20.253168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:20.253398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:20.253443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.253449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.253449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.253450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.253451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.253452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.253452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.253453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.253454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.253454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.253455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.253455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.253456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.253459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.253467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.253469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.253471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.253474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.253476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.253478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.253480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.253481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.253484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.253486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.253487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.253489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.253496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.253501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.253505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.253508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.253513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.253516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.253518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.253522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.253524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.253528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.253533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.253538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.253543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.253548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.253552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.253557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.253561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.253568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.253571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.253575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.253578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.253576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600630388852832:3233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:20.253589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600630388852832:3233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:20.253592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600630388852832:3233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:20.253599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:20.253581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.253583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.253586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.253588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.253591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.253610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:20.255653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:20.255977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:20.255988Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:20.255989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:20.255991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:20.255996Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 128 [2:7559600629606643803:2948]
2025-10-10T14:31:20.256003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:20.256013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:20.256019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.256020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.256022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.256032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:20.256041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:20.256046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:20.256084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.256089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.256091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.256093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:20.256143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:20.256149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.256156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.256162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.256171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:20.256188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600629606643797:2948]
2025-10-10T14:31:20.256194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600629606643797:2948]
2025-10-10T14:31:20.256196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600629606643797:2948]
2025-10-10T14:31:20.256204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:20.256213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388852953:3233], now have 1 active actors on pipe
2025-10-10T14:31:20.256215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:20.256218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388852777:2438], now have 1 active actors on pipe
2025-10-10T14:31:20.256218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:20.256220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:20.256222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:20.256230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:20.256236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:20.256254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600629606643797:2948]
2025-10-10T14:31:20.256265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:20.256287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:20.256280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 128
2025-10-10T14:31:20.256286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 128
2025-10-10T14:31:20.256356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.256364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.256385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:20.256394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.256397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.256399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:20.256405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.256417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:20.256427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.256604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.256614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.256623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.256722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 129 partition: 0 MaxSeqNo: 40 sessionId: src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0
2025-10-10T14:31:20.256962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa585ec9-1cb289f9-ba517e6f-884a2b94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:20.259422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0] Write session: try to update token
2025-10-10T14:31:20.259437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:20.272854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId: src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:20.275342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:20.275494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:20.275513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:20.275515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:20.275517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:20.275526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600629606643797:2948]
2025-10-10T14:31:20.275532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600629606643797:2948]
2025-10-10T14:31:20.275536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600629606643797:2948]
2025-10-10T14:31:20.275587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.275589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:20.275596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:20.275598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.275600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:20.275613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:20.275619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.275621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:20.275760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:20.339659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600630388852963:3080]
2025-10-10T14:31:20.339846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 128, pipe: [1:7559600630388852963:3080]
2025-10-10T14:31:20.379061Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:20.379360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388852963:3080], now have 1 active actors on pipe
2025-10-10T14:31:20.379608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600630388852963:3080]
2025-10-10T14:31:20.379617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:20.379622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:20.379638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:20.379666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:20.379687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 129 reason: error at write: Disconnected sessionId: src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0
2025-10-10T14:31:20.379907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 129 sessionId: src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0 is DEAD
2025-10-10T14:31:20.380121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:20.380132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0] Write session will restart in 0.006530s
2025-10-10T14:31:20.380151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0] Write session: Do CDS request
2025-10-10T14:31:20.380155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:20.387872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.387965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:20.387978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 130
2025-10-10T14:31:20.388105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.388139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:20.388148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:20.388152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:20.388572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 130 sessionId:  describe result for acl check
2025-10-10T14:31:20.388609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:20.388611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:20.388612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:20.388618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600630388853039:3237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:20.389154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600630388853039:3237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:20.391228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600630388853039:3237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:20.391228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:20.391817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:20.391947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:20.391955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:20.391964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:20.391996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:20.392028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600629606643986:2950]
2025-10-10T14:31:20.392387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:20.392595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:20.392621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:20.392810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:20.392842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.392846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.392847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.392848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.392848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.392849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.392849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.392850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.392851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.392851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.392852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.392852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.392853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.392856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.392865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.392867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.392870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.392872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.392874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.392876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.392878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.392880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.392882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.392884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.392885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.392887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.392892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.392897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.392902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.392905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.392908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.392912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.392914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.392917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.392921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.392924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.392926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.392929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.392932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.392934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.392937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.392939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.392942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.392945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.392947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.392950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.392952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.392955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.392958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.392960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.392963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.392966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.392986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:20.393299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600630388853039:3237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:20.393311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600630388853039:3237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:20.393314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600630388853039:3237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:20.393320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:20.395002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:20.395306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:20.395314Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:20.395316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:20.395319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:20.395324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 129 [2:7559600629606643986:2950]
2025-10-10T14:31:20.395332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:20.395344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:20.395346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.395348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.395350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.395362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:20.395370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:20.395376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:20.395426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.395433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.395435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.395437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:20.395492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:20.395498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.395506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.395512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.395522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:20.395544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853143:3237], now have 1 active actors on pipe
2025-10-10T14:31:20.395549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388852964:2438], now have 1 active actors on pipe
2025-10-10T14:31:20.395554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600629606643980:2950]
2025-10-10T14:31:20.395558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600629606643980:2950]
2025-10-10T14:31:20.395560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600629606643980:2950]
2025-10-10T14:31:20.395570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:20.395582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:20.395587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:20.395589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:20.395591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:20.395594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:20.395604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:20.395611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 129
2025-10-10T14:31:20.395618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 129
2025-10-10T14:31:20.395624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600629606643980:2950]
2025-10-10T14:31:20.395633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:20.395646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:20.395662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.395668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.395690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:20.395700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.395702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.395704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:20.395712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.395720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:20.395731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.395884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.395889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.395900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.395992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 130 partition: 0 MaxSeqNo: 40 sessionId: src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0
2025-10-10T14:31:20.396268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c621b56b-4b8f2715-286b3d28-8e36d536_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:20.398729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0] Write session: try to update token
2025-10-10T14:31:20.398745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:20.413043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId: src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:20.413957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:20.413974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:20.413977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:20.413978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:20.413985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600629606643980:2950]
2025-10-10T14:31:20.413988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600629606643980:2950]
2025-10-10T14:31:20.413992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600629606643980:2950]
2025-10-10T14:31:20.414030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:20.414040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.414042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:20.414052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:20.414060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:20.414074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:20.414179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:20.415515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:20.479939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600630388853151:3080]
2025-10-10T14:31:20.480236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 129, pipe: [1:7559600630388853151:3080]
2025-10-10T14:31:20.518867Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:20.519077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.519091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.519139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853151:3080], now have 1 active actors on pipe
2025-10-10T14:31:20.519329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:20.519351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:20.519359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600630388853151:3080]
2025-10-10T14:31:20.519391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:20.519411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:20.519470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 130 reason: error at write: Disconnected sessionId: src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0
2025-10-10T14:31:20.519678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 130 sessionId: src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0 is DEAD
2025-10-10T14:31:20.519807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:20.519816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0] Write session will restart in 0.008133s
2025-10-10T14:31:20.519835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0] Write session: Do CDS request
2025-10-10T14:31:20.519851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:20.528805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.528854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:20.528867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 131
2025-10-10T14:31:20.529276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.529325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:20.529348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:20.529352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:20.529801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 131 sessionId:  describe result for acl check
2025-10-10T14:31:20.529838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:20.529840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:20.529842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:20.529848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600630388853247:3243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:20.530415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600630388853247:3243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:20.532154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:20.532495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600630388853247:3243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:20.532866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:20.533051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:20.533062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:20.533073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:20.533121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:20.533160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600629606644170:2952]
2025-10-10T14:31:20.533801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:20.534069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:20.534123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:20.534454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:20.534526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.534533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.534534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.534535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.534537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.534538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.534539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.534540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.534542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.534543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.534544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.534545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.534546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.534552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.534565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.534569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.534574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.534578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.534583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.534587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.534592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.534596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.534601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.534605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.534610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.534614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.534621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.534630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.534636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.534643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.534647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.534652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.534657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.534663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.534672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.534678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.534684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.534690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.534699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.534709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.534715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.534721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.534726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.534732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.534736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.534742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.534747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.534757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.534762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.534768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.534777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.534784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.534827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:20.534852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600630388853247:3243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:20.534866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600630388853247:3243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:20.534869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600630388853247:3243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:20.534877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:20.537041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:20.537363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:20.537374Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:20.537376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:20.537380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:20.537386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 130 [2:7559600629606644170:2952]
2025-10-10T14:31:20.537397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:20.537417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:20.537425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.537429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.537435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.537451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:20.537465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:20.537472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:20.537528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.537535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.537537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.537540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:20.537605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:20.537613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.537623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.537637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.537661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:20.537685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853152:2438], now have 1 active actors on pipe
2025-10-10T14:31:20.537695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853337:3243], now have 1 active actors on pipe
2025-10-10T14:31:20.537702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600629606644165:2952]
2025-10-10T14:31:20.537704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600629606644165:2952]
2025-10-10T14:31:20.537707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600629606644165:2952]
2025-10-10T14:31:20.537719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:20.537732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:20.537748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 130
2025-10-10T14:31:20.537749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 130
2025-10-10T14:31:20.537743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:20.537748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:20.537751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:20.537752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:20.537754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:20.537771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600629606644165:2952]
2025-10-10T14:31:20.537775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:20.537776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:20.537808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.537813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.537850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:20.537861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.537865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.537867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:20.537878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.537893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:20.537910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.538083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.538095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.538129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.538236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 131 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0
2025-10-10T14:31:20.538576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47454ce0-48b156f9-358fa9d-c7a183fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:20.541299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0] Write session: try to update token
2025-10-10T14:31:20.541312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:20.548425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:20.548444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:20.548455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600629606644165:2952]
2025-10-10T14:31:20.548501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:20.548510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:20.548670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:20.548815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:20.548944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:20.549078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:20.549262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:20.549302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:20.555862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId: src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:20.558270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:20.558446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.558467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.558509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:20.558582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:20.565709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:20.565723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:20.565726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:20.565727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:20.565735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600629606644165:2952]
2025-10-10T14:31:20.565738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600629606644165:2952]
2025-10-10T14:31:20.565741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600629606644165:2952]
2025-10-10T14:31:20.565778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:20.565784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.565788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:20.565792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:20.565798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:20.565802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:20.565920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:20.619738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600630388853349:3080]
2025-10-10T14:31:20.619986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 130, pipe: [1:7559600630388853349:3080]
2025-10-10T14:31:20.669248Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:20.675721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.675742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.675884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.675936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.675992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.676049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.676095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.676103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.676161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.676213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.676267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.676334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.676381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.676386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.676440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.676492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.676558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.676614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.676653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.676658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.676714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.676765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.676820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.676874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.676924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.676932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.676989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.677040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.677096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.677148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.677235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.677242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.677299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.677369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.677424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.677477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.677516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.677523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.677592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.677644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.677700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.677753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.677792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.677797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.677853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.677905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.677958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.678011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.678093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.678099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.678163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.678214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.678270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.678324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.678362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.678367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.678427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:20.678491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:20.678545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:20.678600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:20.678639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:20.678645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:20.678679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853349:3080], now have 1 active actors on pipe
2025-10-10T14:31:20.678885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:20.678896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600630388853349:3080]
2025-10-10T14:31:20.678923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:20.678925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:20.678955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 131 reason: error at write: Disconnected sessionId: src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0
2025-10-10T14:31:20.679149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 131 sessionId: src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0 is DEAD
2025-10-10T14:31:20.679263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:20.679275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0] Write session will restart in 0.008488s
2025-10-10T14:31:20.679298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0] Write session: Do CDS request
2025-10-10T14:31:20.679305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:20.679390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:20.688864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.689240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:20.689257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 132
2025-10-10T14:31:20.689401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.689439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:20.689454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:20.689459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:20.689831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 132 sessionId:  describe result for acl check
2025-10-10T14:31:20.689875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:20.689881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:20.689883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:20.689889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600630388853495:3247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:20.690413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600630388853495:3247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:20.690829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:20.691858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:20.692048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:20.692059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:20.692070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:20.692119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:20.692160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600629606644357:2955]
2025-10-10T14:31:20.692670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600630388853495:3247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:20.692748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:20.693028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:20.693065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:20.693373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:20.693426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.693432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.693434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.693435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.693436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.693437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.693438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.693439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.693441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.693442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.693444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.693445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.693446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.693452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.693463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.693467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.693471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.693475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.693479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.693483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.693486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.693489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.693493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.693499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.693507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.693511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.693518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.693531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.693541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.693547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.693556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.693565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.693573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.693580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.693588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.693597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.693605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.693610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.693619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.693623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.693628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.693633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.693638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.693647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.693655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.693664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.693672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.693680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.693684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.693692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.693701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.693710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.693752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:20.695929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600630388853495:3247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:20.695940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600630388853495:3247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:20.695943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600630388853495:3247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:20.695949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:20.695971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:20.696272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:20.696283Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:20.696285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:20.696289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:20.696294Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 131 [2:7559600629606644357:2955]
2025-10-10T14:31:20.696304Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:20.696325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:20.696332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.696336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.696338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.696354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:20.696367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:20.696378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:20.696431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.696437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.696439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.696442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:20.696499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:20.696508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.696519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.696530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.696551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:20.696576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853351:2438], now have 1 active actors on pipe
2025-10-10T14:31:20.696583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853532:3247], now have 1 active actors on pipe
2025-10-10T14:31:20.696589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600629606644352:2955]
2025-10-10T14:31:20.696592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600629606644352:2955]
2025-10-10T14:31:20.696594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600629606644352:2955]
2025-10-10T14:31:20.696607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:20.696597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 131
2025-10-10T14:31:20.696600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 131
2025-10-10T14:31:20.696623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:20.696624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:20.696627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:20.696628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:20.696643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:20.696649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:20.696683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.696691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.696705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600629606644352:2955]
2025-10-10T14:31:20.696716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:20.696726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:20.696748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:20.696760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.696767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.696769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:20.696780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.696794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:20.696813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.696928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.696935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.696948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.697029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 132 partition: 0 MaxSeqNo: 40 sessionId: src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0
2025-10-10T14:31:20.697389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9780e1-74b4f582-b15b2b84-c9b14773_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:20.699740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0] Write session: try to update token
2025-10-10T14:31:20.699754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:20.713084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId: src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:20.714332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:20.714347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:20.714350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:20.714352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:20.714362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600629606644352:2955]
2025-10-10T14:31:20.714366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600629606644352:2955]
2025-10-10T14:31:20.714370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600629606644352:2955]
2025-10-10T14:31:20.714406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:20.714415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:20.714423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.714423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:20.714425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:20.714426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:20.714563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:20.715577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:20.778955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600630388853539:3080]
2025-10-10T14:31:20.779239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 131, pipe: [1:7559600630388853539:3080]
2025-10-10T14:31:20.822303Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:20.822509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.822521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.822560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853539:3080], now have 1 active actors on pipe
2025-10-10T14:31:20.822770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:20.822777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600630388853539:3080]
2025-10-10T14:31:20.822807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:20.822809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:20.822848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:20.822861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 132 reason: error at write: Disconnected sessionId: src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0
2025-10-10T14:31:20.823042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 132 sessionId: src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0 is DEAD
2025-10-10T14:31:20.823217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:20.823232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0] Write session will restart in 0.009944s
2025-10-10T14:31:20.823255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0] Write session: Do CDS request
2025-10-10T14:31:20.823265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:20.834750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:20.834869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.834919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:20.834934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 133
2025-10-10T14:31:20.835073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.835109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:20.835120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:20.835124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:20.835501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:20.835578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 133 sessionId:  describe result for acl check
2025-10-10T14:31:20.835618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:20.835624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:20.835628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:20.835634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600630388853690:3251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:20.835649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:20.835658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:20.835668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:20.835712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:20.835751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600629606644542:2957]
2025-10-10T14:31:20.836186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600630388853690:3251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:20.836237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:20.836536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:20.836573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:20.836850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:20.836892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.836897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.836898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.836898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.836899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.836899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.836900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.836901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.836901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.836902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.836903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.836903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.836904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.836908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.836916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.836918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.836920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.836922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.836924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.836926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.836928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.836931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.836933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.836935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.836937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.836939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.836944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.836950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.836957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.836962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.836966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.836972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.836976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.836982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.836986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.836992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.836996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.837001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.837006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.837011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.837015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.837020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.837026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.837031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.837035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.837040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.837044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.837050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.837054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.837060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.837062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.837065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.837088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:20.838010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600630388853690:3251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:20.839131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:20.839436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:20.839449Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:20.839451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:20.839455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:20.839460Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 132 [2:7559600629606644542:2957]
2025-10-10T14:31:20.839471Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:20.839486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:20.839489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.839492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.839494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.839510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:20.839522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:20.839530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:20.839581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.839587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.839589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.839592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:20.839655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:20.839665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.839677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.839689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.839706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:20.839731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853541:2438], now have 1 active actors on pipe
2025-10-10T14:31:20.839743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600629606644537:2957]
2025-10-10T14:31:20.839746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600629606644537:2957]
2025-10-10T14:31:20.839748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600629606644537:2957]
2025-10-10T14:31:20.839746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 132
2025-10-10T14:31:20.839760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:20.839776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:20.839778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:20.839780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:20.839782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:20.839793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:20.839796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:20.839821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600629606644537:2957]
2025-10-10T14:31:20.839832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:20.839843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:20.841040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600630388853690:3251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:20.841060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600630388853690:3251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:20.841063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600630388853690:3251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:20.841069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:20.841241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853727:3251], now have 1 active actors on pipe
2025-10-10T14:31:20.841260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 132
2025-10-10T14:31:20.841356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.841368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.841398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:20.841413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.841417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.841419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:20.841432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.841445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:20.841460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.841615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.841623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.841640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.841750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 133 partition: 0 MaxSeqNo: 40 sessionId: src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0
2025-10-10T14:31:20.842091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d90bebec-9a4b76ac-5a0a3cc6-d5716fc2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:20.844695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0] Write session: try to update token
2025-10-10T14:31:20.844715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:20.857747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:20.857765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:20.857767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:20.857769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:20.857778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600629606644537:2957]
2025-10-10T14:31:20.857781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600629606644537:2957]
2025-10-10T14:31:20.857783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600629606644537:2957]
2025-10-10T14:31:20.857830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:20.857834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:20.857837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.857839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:20.857840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:20.857843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:20.857961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:20.858110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId: src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:20.860475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:20.922805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600630388853754:3080]
2025-10-10T14:31:20.922965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 132, pipe: [1:7559600630388853754:3080]
2025-10-10T14:31:20.962277Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:20.962511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.962522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.962559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853754:3080], now have 1 active actors on pipe
2025-10-10T14:31:20.962711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:20.962728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:20.962754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600630388853754:3080]
2025-10-10T14:31:20.962769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:20.962849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 133 reason: status is not ok: tablet will be restarted right now sessionId: src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0
2025-10-10T14:31:20.963034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 133 sessionId: src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0 is DEAD
2025-10-10T14:31:20.963186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:20.963197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0] Write session will restart in 0.008394s
2025-10-10T14:31:20.963242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0] Write session: Do CDS request
2025-10-10T14:31:20.963248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:20.972902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.972948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:20.972963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 134
2025-10-10T14:31:20.973149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:20.973185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:20.973191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:20.973195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:20.973659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 134 sessionId:  describe result for acl check
2025-10-10T14:31:20.973694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:20.973698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:20.973700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:20.973706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600630388853899:3264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:20.974288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600630388853899:3264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:20.974841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:20.975418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:20.975555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:20.975564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:20.975572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:20.975605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:20.975634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600629606644768:2972]
2025-10-10T14:31:20.976000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:20.976203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:20.976235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:20.976328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600630388853899:3264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:20.976431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:20.976463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.976468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.976468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.976469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.976469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.976470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.976471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.976471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.976472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.976472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.976473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.976474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.976474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.976478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.976484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.976487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.976489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.976491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.976493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.976496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.976498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.976500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.976502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.976504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.976506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.976508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.976514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.976523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:20.976529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.976534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:20.976538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.976542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:20.976546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.976550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:20.976555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.976560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:20.976562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.976566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:20.976569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.976571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:20.976574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.976577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:20.976579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.976582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:20.976584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.976587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:20.976589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.976592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.976595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.976597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.976600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.976603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.976623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:20.978600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600630388853899:3264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:20.978611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600630388853899:3264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:20.978614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600630388853899:3264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:20.978619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:20.978659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:20.979067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:20.979077Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:20.979079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:20.979082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:20.979087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 133 [2:7559600629606644768:2972]
2025-10-10T14:31:20.979097Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:20.979113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:20.979121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.979123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.979124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.979138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:20.979145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:20.979154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:20.979201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.979208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.979210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.979212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:20.979268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:20.979276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.979287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:20.979303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:20.979324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:20.979352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853756:2438], now have 1 active actors on pipe
2025-10-10T14:31:20.979359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600630388853939:3264], now have 1 active actors on pipe
2025-10-10T14:31:20.979348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 133
2025-10-10T14:31:20.979351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 133
2025-10-10T14:31:20.979366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600629606644763:2972]
2025-10-10T14:31:20.979372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600629606644763:2972]
2025-10-10T14:31:20.979374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600629606644763:2972]
2025-10-10T14:31:20.979383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:20.979399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:20.979403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:20.979406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:20.979408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:20.979416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:20.979418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:20.979435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.979445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.979476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600629606644763:2972]
2025-10-10T14:31:20.979485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:20.979488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:20.979505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:20.979517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:20.979524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:20.979527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:20.979536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:20.979549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:20.979579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.979721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:20.979731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:20.979746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:20.979823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 134 partition: 0 MaxSeqNo: 40 sessionId: src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0
2025-10-10T14:31:20.980127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26b0b3ae-2016437b-7865b74c-ea2ab124_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:20.982625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0] Write session: try to update token
2025-10-10T14:31:20.982640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:20.996278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId: src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:20.997839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:20.997857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:20.997861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:20.997863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:20.997872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600629606644763:2972]
2025-10-10T14:31:20.997875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600629606644763:2972]
2025-10-10T14:31:20.997879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600629606644763:2972]
2025-10-10T14:31:20.997928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:20.997928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:20.997934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:20.997938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:20.997940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:20.997942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:20.998078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:20.998744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:21.063118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600634683821254:3080]
2025-10-10T14:31:21.063390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 133, pipe: [1:7559600634683821254:3080]
2025-10-10T14:31:21.103506Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:21.103911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.103922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.103958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821254:3080], now have 1 active actors on pipe
2025-10-10T14:31:21.104128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:21.104189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:21.104201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:21.104204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:21.104248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600634683821254:3080]
2025-10-10T14:31:21.104255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 134 reason: error at write: Disconnected sessionId: src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0
2025-10-10T14:31:21.104455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 134 sessionId: src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0 is DEAD
2025-10-10T14:31:21.104599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:21.104611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0] Write session will restart in 0.007529s
2025-10-10T14:31:21.104636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0] Write session: Do CDS request
2025-10-10T14:31:21.104645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:21.113780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.113813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:21.113825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 135
2025-10-10T14:31:21.114010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.114039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:21.114047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:21.114051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:21.114399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 135 sessionId:  describe result for acl check
2025-10-10T14:31:21.114422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:21.114427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:21.114428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:21.114433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600634683821376:3269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:21.114841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600634683821376:3269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:21.116089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:21.116591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600634683821376:3269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:21.117008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:21.117175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:21.117187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:21.117199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:21.117246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:21.117284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600633901612265:2975]
2025-10-10T14:31:21.117879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:21.118218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:21.118261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:21.118574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:21.118621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.118627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.118628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.118629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.118630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.118632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.118633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.118634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.118635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.118636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.118637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.118638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.118639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.118645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.118657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.118661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.118665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.118669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.118673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.118677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.118681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.118685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.118689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.118693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.118697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.118700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.118707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.118715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.118725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.118735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.118739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.118744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.118753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.118760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.118769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.118776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.118784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.118790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.118798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.118808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.118813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.118820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.118829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.118834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.118842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.118847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.118856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.118865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.118873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.118878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.118883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.118888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.118932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:21.118934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600634683821376:3269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:21.118947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600634683821376:3269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:21.118950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600634683821376:3269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:21.118957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:21.121094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:21.121406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:21.121417Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:21.121419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:21.121422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:21.121427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 134 [2:7559600633901612265:2975]
2025-10-10T14:31:21.121438Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:21.121454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:21.121460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.121464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.121466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.121481Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:21.121499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:21.121506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:21.121555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.121562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.121564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.121566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:21.121624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:21.121633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.121644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.121660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.121682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:21.121707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821437:3269], now have 1 active actors on pipe
2025-10-10T14:31:21.121719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821255:2438], now have 1 active actors on pipe
2025-10-10T14:31:21.121725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600633901612260:2975]
2025-10-10T14:31:21.121728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600633901612260:2975]
2025-10-10T14:31:21.121730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600633901612260:2975]
2025-10-10T14:31:21.121726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 134
2025-10-10T14:31:21.121744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:21.121730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 134
2025-10-10T14:31:21.121757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:21.121759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:21.121762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:21.121764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:21.121773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:21.121776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:21.121809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.121819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.121833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600633901612260:2975]
2025-10-10T14:31:21.121841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:21.121863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:21.121877Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:21.121884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.121888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.121889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:21.121901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.121911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:21.121932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.122080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.122089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.122104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.122190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 135 partition: 0 MaxSeqNo: 40 sessionId: src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0
2025-10-10T14:31:21.122521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cab2e8-8ac02f48-86b1db00-a5f0e48_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:21.125134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0] Write session: try to update token
2025-10-10T14:31:21.125154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:21.139008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId: src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:21.140300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:21.140323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:21.140326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:21.140329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:21.140338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600633901612260:2975]
2025-10-10T14:31:21.140343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600633901612260:2975]
2025-10-10T14:31:21.140347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600633901612260:2975]
2025-10-10T14:31:21.140397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:21.140409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.140411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:21.140423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:21.140442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:21.140447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:21.140545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:21.141373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:21.204404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600634683821447:3080]
2025-10-10T14:31:21.204718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 134, pipe: [1:7559600634683821447:3080]
2025-10-10T14:31:21.243852Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:21.244274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.244286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.244326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821447:3080], now have 1 active actors on pipe
2025-10-10T14:31:21.244512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:21.244584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600634683821447:3080]
2025-10-10T14:31:21.244590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:21.244611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:21.244660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 135 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0
2025-10-10T14:31:21.244883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 135 sessionId: src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0 is DEAD
2025-10-10T14:31:21.245010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:21.245017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0] Write session will restart in 0.009362s
2025-10-10T14:31:21.245036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0] Write session: Do CDS request
2025-10-10T14:31:21.245041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:21.255714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:21.255726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 136
2025-10-10T14:31:21.255751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.255930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.255956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:21.255963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:21.255966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:21.256297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 136 sessionId:  describe result for acl check
2025-10-10T14:31:21.256328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:21.256333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:21.256340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:21.256344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600634683821609:3275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:21.256506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:21.256767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600634683821609:3275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:21.257126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:21.257299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:21.257311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:21.257322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:21.257391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:21.257429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600633901612455:2977]
2025-10-10T14:31:21.257997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:21.258290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:21.258330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:21.258636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:21.258684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.258690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.258691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.258692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.258693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.258694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.258696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.258697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.258698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.258699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.258700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.258701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.258702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.258707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.258718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.258723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.258727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.258730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.258734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.258738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.258742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.258746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.258750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.258754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.258757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.258761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.258768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.258776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.258786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.258797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.258802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.258807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.258811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.258818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.258822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.258830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.258838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.258843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.258848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.258857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.258863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.258868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.258872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.258859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600634683821609:3275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:21.258878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.258886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.258892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.258899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.258904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.258912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.258917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.258921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.258926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.258970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:21.261091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:21.261219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600634683821609:3275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:21.261230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600634683821609:3275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:21.261233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600634683821609:3275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:21.261239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:21.261568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:21.261580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:21.261582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:21.261586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:21.261591Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 135 [2:7559600633901612455:2977]
2025-10-10T14:31:21.261602Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:21.261619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:21.261626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.261629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.261632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.261647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:21.261659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:21.261669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:21.261724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.261730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.261733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.261735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:21.261800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:21.261807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.261819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.261835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.261859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:21.261885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821448:2438], now have 1 active actors on pipe
2025-10-10T14:31:21.261893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821643:3275], now have 1 active actors on pipe
2025-10-10T14:31:21.261892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 135
2025-10-10T14:31:21.261900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600633901612450:2977]
2025-10-10T14:31:21.261906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 135
2025-10-10T14:31:21.261906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600633901612450:2977]
2025-10-10T14:31:21.261909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600633901612450:2977]
2025-10-10T14:31:21.261917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:21.261934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:21.261935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:21.261941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:21.261943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:21.261950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:21.261953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:21.261973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.261982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.262010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600633901612450:2977]
2025-10-10T14:31:21.262022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:21.262038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:21.262044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:21.262052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.262055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.262057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:21.262067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.262078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:21.262112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.262235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.262242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.262256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.262320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 136 partition: 0 MaxSeqNo: 40 sessionId: src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0
2025-10-10T14:31:21.262598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c05f33-4379d9fe-7a1654bc-558260c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:21.265017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0] Write session: try to update token
2025-10-10T14:31:21.265032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:21.273113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:21.273131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:21.273141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600633901612450:2977]
2025-10-10T14:31:21.273181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:21.273189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:21.273381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:21.273527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:21.273689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:21.273822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:21.274076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:21.274118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:21.278785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId: src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:21.281262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:21.281504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.281527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.281572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:21.281649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:21.290736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:21.290762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:21.290765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:21.290767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:21.290780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600633901612450:2977]
2025-10-10T14:31:21.290785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600633901612450:2977]
2025-10-10T14:31:21.290789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600633901612450:2977]
2025-10-10T14:31:21.290836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:21.290839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:21.290846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.290849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:21.290849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:21.290854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:21.291001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:21.344706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600634683821651:3080]
2025-10-10T14:31:21.344950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 135, pipe: [1:7559600634683821651:3080]
2025-10-10T14:31:21.396561Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:21.403148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.403166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.403314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.403368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.403421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.403485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.403706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.403717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.403776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.403824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.403877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.403930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.403975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.403981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.404035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.404112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.404173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.404233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.404271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.404277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.404331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.404380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.404442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.404499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.404547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.404553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.404605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.404670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.404729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.404785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.404822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.404827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.404882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.404932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.404993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.405048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.405083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.405088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.405146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.405200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.405263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.405321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.405369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.405374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.405427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.405475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.405535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.405588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.405624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.405628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.405688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.405740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.405792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.405841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.405876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.405883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.405934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:21.405983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:21.406042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:21.406094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:21.406141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:21.406146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:21.406187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821651:3080], now have 1 active actors on pipe
2025-10-10T14:31:21.406382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:21.406408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600634683821651:3080]
2025-10-10T14:31:21.406437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:21.406443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:21.406470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 136 reason: error at write: Disconnected sessionId: src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0
2025-10-10T14:31:21.406583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:21.406676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 136 sessionId: src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0 is DEAD
2025-10-10T14:31:21.406808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:21.406819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0] Write session will restart in 0.007054s
2025-10-10T14:31:21.406844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0] Write session: Do CDS request
2025-10-10T14:31:21.406852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:21.414874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.414931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:21.414954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 137
2025-10-10T14:31:21.415105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.415148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:21.415158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:21.415162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:21.415641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 137 sessionId:  describe result for acl check
2025-10-10T14:31:21.415678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:21.415684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:21.415686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:21.415692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600634683821736:3279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:21.416262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600634683821736:3279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:21.417875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:21.418584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:21.418591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600634683821736:3279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:21.418767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:21.418778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:21.418790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:21.418840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:21.418879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600633901612645:2979]
2025-10-10T14:31:21.419457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:21.419677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:21.419722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:21.420031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:21.420083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.420089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.420090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.420091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.420093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.420094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.420095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.420096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.420097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.420098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.420099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.420100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.420101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.420107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.420119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.420123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.420128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.420135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.420140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.420148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.420152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.420160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.420164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.420172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.420177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.420185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.420191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.420203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.420214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.420225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.420233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.420238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.420246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.420251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.420260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.420267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.420275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.420280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.420288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.420296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.420304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.420309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.420317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.420322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.420330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.420336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.420345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.420354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.420362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.420368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.420376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.420383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.420427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:21.420999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600634683821736:3279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:21.421010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600634683821736:3279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:21.421013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600634683821736:3279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:21.421018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:21.422498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:21.422797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:21.422810Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:21.422812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:21.422815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:21.422821Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 136 [2:7559600633901612645:2979]
2025-10-10T14:31:21.422832Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:21.422851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:21.422854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.422857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.422860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.422874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:21.422884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:21.422896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:21.422951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.422958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.422959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.422961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:21.423025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:21.423032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.423044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.423060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.423081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:21.423106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821838:3279], now have 1 active actors on pipe
2025-10-10T14:31:21.423114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821652:2438], now have 1 active actors on pipe
2025-10-10T14:31:21.423121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600633901612639:2979]
2025-10-10T14:31:21.423127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600633901612639:2979]
2025-10-10T14:31:21.423129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600633901612639:2979]
2025-10-10T14:31:21.423142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:21.423160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:21.423144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 136
2025-10-10T14:31:21.423165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:21.423168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:21.423171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:21.423180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:21.423184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:21.423146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 136
2025-10-10T14:31:21.423213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.423222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.423239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600633901612639:2979]
2025-10-10T14:31:21.423250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:21.423272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:21.423282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:21.423289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.423297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.423299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:21.423309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.423323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:21.423351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.423500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.423509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.423525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.423640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 137 partition: 0 MaxSeqNo: 40 sessionId: src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0
2025-10-10T14:31:21.423928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69f8b84-8bcabb4c-72429829-6f6d7b97_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:21.426537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0] Write session: try to update token
2025-10-10T14:31:21.426553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:21.440175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId: src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:21.441679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:21.441695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:21.441697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:21.441699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:21.441705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600633901612639:2979]
2025-10-10T14:31:21.441709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600633901612639:2979]
2025-10-10T14:31:21.441713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600633901612639:2979]
2025-10-10T14:31:21.441756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:21.441766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:21.441767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:21.441770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:21.441773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.441775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:21.441901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:21.442605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:21.506499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600634683821846:3080]
2025-10-10T14:31:21.506658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 136, pipe: [1:7559600634683821846:3080]
2025-10-10T14:31:21.547036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:21.547441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.547456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.547502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821846:3080], now have 1 active actors on pipe
2025-10-10T14:31:21.547711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:21.547720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:21.547733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:21.547756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600634683821846:3080]
2025-10-10T14:31:21.547775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:21.547801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 137 reason: error at write: Disconnected sessionId: src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0
2025-10-10T14:31:21.548024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 137 sessionId: src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0 is DEAD
2025-10-10T14:31:21.548197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:21.548209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0] Write session will restart in 0.006243s
2025-10-10T14:31:21.548236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0] Write session: Do CDS request
2025-10-10T14:31:21.548246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:21.555887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.555931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:21.555943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 138
2025-10-10T14:31:21.556113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.556150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:21.556158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:21.556162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:21.556539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 138 sessionId:  describe result for acl check
2025-10-10T14:31:21.556573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:21.556580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:21.556582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:21.556590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600634683821902:3285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:21.557011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600634683821902:3285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:21.559631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600634683821902:3285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:21.560474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:21.561259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:21.561454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600634683821902:3285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:21.561467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600634683821902:3285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:21.561471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600634683821902:3285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:21.561481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:21.561473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:21.561488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:21.561503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:21.561565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:21.561608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600633901612839:2981]
2025-10-10T14:31:21.562211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:21.562528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:21.562581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:21.562904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:21.562971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.562978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.562980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.562981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.562983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.562984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.562985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.562986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.562987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.562988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.562990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.562991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.562992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.562997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.563011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.563015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.563024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.563033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.563038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.563046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.563051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.563059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.563068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.563075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.563083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.563092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.563099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.563113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.563124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.563135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.563144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.563149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.563154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.563164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.563173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.563183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.563191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.563202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.563211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.563221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.563230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.563240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.563249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.563260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.563268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.563274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.563279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.563289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.563298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.563308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.563319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.563329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.563373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:21.565505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:21.565894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:21.565912Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:21.565914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:21.565917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:21.565923Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 137 [2:7559600633901612839:2981]
2025-10-10T14:31:21.565934Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:21.565949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:21.565959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.565962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.565964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.565980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:21.565992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:21.566004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:21.566170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.566179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.566181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.566184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:21.566258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:21.566266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.566277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.566295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.566314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:21.566342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822037:3285], now have 1 active actors on pipe
2025-10-10T14:31:21.566346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683821854:2438], now have 1 active actors on pipe
2025-10-10T14:31:21.566354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600633901612834:2981]
2025-10-10T14:31:21.566362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600633901612834:2981]
2025-10-10T14:31:21.566364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600633901612834:2981]
2025-10-10T14:31:21.566364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 137
2025-10-10T14:31:21.566378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:21.566393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 137
2025-10-10T14:31:21.566394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:21.566396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:21.566404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:21.566406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:21.566414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:21.566417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:21.566438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600633901612834:2981]
2025-10-10T14:31:21.566450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:21.566455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:21.566471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.566481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.566537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|378831df-53d222ec-3b14cc19-9615a6e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:21.566551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.566561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.566563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:21.566575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.566591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:21.566612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.566747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.566758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.566775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.566864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 138 partition: 0 MaxSeqNo: 40 sessionId: src_id|378831df-53d222ec-3b14cc19-9615a6e2_0
2025-10-10T14:31:21.567203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80ee2bf4-8bf0764c-ed76a7ba-96bbfdb4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|378831df-53d222ec-3b14cc19-9615a6e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:21.569828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378831df-53d222ec-3b14cc19-9615a6e2_0] Write session: try to update token
2025-10-10T14:31:21.569843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378831df-53d222ec-3b14cc19-9615a6e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:21.583132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId: src_id|378831df-53d222ec-3b14cc19-9615a6e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:21.585076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:21.585098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:21.585101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:21.585103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:21.585113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600633901612834:2981]
2025-10-10T14:31:21.585117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600633901612834:2981]
2025-10-10T14:31:21.585121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600633901612834:2981]
2025-10-10T14:31:21.585169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:21.585170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:21.585176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:21.585180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.585180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:21.585183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:21.585325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:21.585596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:21.647764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600634683822052:3080]
2025-10-10T14:31:21.648009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 137, pipe: [1:7559600634683822052:3080]
2025-10-10T14:31:21.689258Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:21.689600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.689613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.689651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822052:3080], now have 1 active actors on pipe
2025-10-10T14:31:21.689848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:21.689853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:21.689856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:21.689911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 138 reason: error at write: Disconnected sessionId: src_id|378831df-53d222ec-3b14cc19-9615a6e2_0
2025-10-10T14:31:21.689990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600634683822052:3080]
2025-10-10T14:31:21.690040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:21.690103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 138 sessionId: src_id|378831df-53d222ec-3b14cc19-9615a6e2_0 is DEAD
2025-10-10T14:31:21.690283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378831df-53d222ec-3b14cc19-9615a6e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:21.690289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378831df-53d222ec-3b14cc19-9615a6e2_0] Write session will restart in 0.008660s
2025-10-10T14:31:21.690311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378831df-53d222ec-3b14cc19-9615a6e2_0] Write session: Do CDS request
2025-10-10T14:31:21.690318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378831df-53d222ec-3b14cc19-9615a6e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:21.699879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|378831df-53d222ec-3b14cc19-9615a6e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.699913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:21.699926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 139
2025-10-10T14:31:21.700073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.700110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:21.700131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:21.700135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:21.700492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 139 sessionId:  describe result for acl check
2025-10-10T14:31:21.700519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:21.700521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:21.700522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:21.700526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600634683822189:3289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:21.700959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600634683822189:3289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:21.701912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:21.702784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:21.702955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:21.702965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:21.702975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:21.703020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:21.703017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600634683822189:3289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:21.703060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600633901613032:2984]
2025-10-10T14:31:21.703570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:21.703839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:21.703872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:21.704074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:21.704108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.704109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.704110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.704110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.704111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.704111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.704112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.704113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.704113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.704114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.704114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.704115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.704116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.704119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.704127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.704129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.704132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.704134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.704136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.704138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.704140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.704143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.704145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.704147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.704149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.704151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.704156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.704161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.704166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.704169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.704172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.704175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.704178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.704181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.704184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.704187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.704189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.704192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.704195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.704198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.704200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.704203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.704206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.704208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.704211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.704214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.704216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.704219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.704221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.704225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.704228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.704233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.704266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:21.706275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600634683822189:3289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:21.706290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600634683822189:3289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:21.706293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600634683822189:3289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:21.706301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:21.706345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:21.706728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:21.706744Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:21.706746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:21.706749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:21.706755Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 138 [2:7559600633901613032:2984]
2025-10-10T14:31:21.706766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:21.706782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:21.706784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.706788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.706790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.706807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:21.706815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:21.706827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:21.706882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.706888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.706890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.706893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:21.706950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:21.706957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.706967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.706978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.706993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:21.707019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822053:2438], now have 1 active actors on pipe
2025-10-10T14:31:21.707026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822241:3289], now have 1 active actors on pipe
2025-10-10T14:31:21.707033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600633901613027:2984]
2025-10-10T14:31:21.707039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600633901613027:2984]
2025-10-10T14:31:21.707041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600633901613027:2984]
2025-10-10T14:31:21.707055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:21.707049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 138
2025-10-10T14:31:21.707071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:21.707068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 138
2025-10-10T14:31:21.707071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:21.707074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:21.707076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:21.707091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:21.707095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:21.707127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.707135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.707150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600633901613027:2984]
2025-10-10T14:31:21.707161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:21.707170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:21.707189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:21.707196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.707199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.707202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:21.707213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.707228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:21.707253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.707407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.707415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.707429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.707544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 139 partition: 0 MaxSeqNo: 40 sessionId: src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0
2025-10-10T14:31:21.707864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|378831df-53d222ec-3b14cc19-9615a6e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:21.710337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0] Write session: try to update token
2025-10-10T14:31:21.710353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:21.724198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId: src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:21.725326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:21.725362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:21.725365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:21.725367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:21.725376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600633901613027:2984]
2025-10-10T14:31:21.725380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600633901613027:2984]
2025-10-10T14:31:21.725384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600633901613027:2984]
2025-10-10T14:31:21.725430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:21.725432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:21.725440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.725443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:21.725443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:21.725450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:21.725577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:21.726736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:21.790146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600634683822248:3080]
2025-10-10T14:31:21.790376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 138, pipe: [1:7559600634683822248:3080]
2025-10-10T14:31:21.829983Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:21.830403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.830417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.830455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822248:3080], now have 1 active actors on pipe
2025-10-10T14:31:21.830688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:21.830683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:21.830723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600634683822248:3080]
2025-10-10T14:31:21.830736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:21.830738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:21.830788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 139 reason: error at write: Disconnected sessionId: src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0
2025-10-10T14:31:21.830959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 139 sessionId: src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0 is DEAD
2025-10-10T14:31:21.831121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:21.831132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0] Write session will restart in 0.009830s
2025-10-10T14:31:21.831158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0] Write session: Do CDS request
2025-10-10T14:31:21.831168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:21.841945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.842019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:21.842035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 140
2025-10-10T14:31:21.842163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.842213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:21.842224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:21.842228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:21.842637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 140 sessionId:  describe result for acl check
2025-10-10T14:31:21.842671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:21.842676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:21.842678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:21.842683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600634683822403:3293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:21.843218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600634683822403:3293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:21.843774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:21.844703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:21.844880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:21.844895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:21.844908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:21.844963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:21.845022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600633901613226:2986]
2025-10-10T14:31:21.845424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600634683822403:3293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:21.845641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:21.845890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:21.845932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:21.846199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:21.846254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.846260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.846261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.846263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.846264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.846265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.846267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.846268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.846269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.846271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.846272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.846273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.846274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.846280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.846292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.846296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.846300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.846303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.846305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.846307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.846309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.846312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.846314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.846316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.846318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.846320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.846325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.846330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.846335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.846338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.846345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.846348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.846351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.846354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.846360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.846364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.846368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.846371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.846374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.846380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.846383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.846390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.846392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.846395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.846398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.846401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.846404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.846409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.846413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.846422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.846431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.846441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.846485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:21.848632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600634683822403:3293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:21.848645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600634683822403:3293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:21.848648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600634683822403:3293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:21.848654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:21.848664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:21.848953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:21.848964Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:21.848967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:21.848970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:21.848976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 139 [2:7559600633901613226:2986]
2025-10-10T14:31:21.848988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:21.849003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:21.849010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.849013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.849015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.849028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:21.849040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:21.849052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:21.849106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.849112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.849114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.849116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:21.849182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:21.849189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.849201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.849214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.849232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:21.849257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822250:2438], now have 1 active actors on pipe
2025-10-10T14:31:21.849253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 139
2025-10-10T14:31:21.849265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822439:3293], now have 1 active actors on pipe
2025-10-10T14:31:21.849257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 139
2025-10-10T14:31:21.849274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600633901613221:2986]
2025-10-10T14:31:21.849281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600633901613221:2986]
2025-10-10T14:31:21.849283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600633901613221:2986]
2025-10-10T14:31:21.849298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:21.849317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:21.849316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:21.849321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:21.849322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:21.849353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:21.849361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:21.849409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.849419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.849432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600633901613221:2986]
2025-10-10T14:31:21.849445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:21.849462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:21.849481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78df605f-d85990de-b0124234-c473279b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:21.849493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.849502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.849509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:21.849522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.849539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:21.849565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.849701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.849709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.849724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.849807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 140 partition: 0 MaxSeqNo: 40 sessionId: src_id|78df605f-d85990de-b0124234-c473279b_0
2025-10-10T14:31:21.850199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3e236-a9231e5d-19f453b0-5230e3b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78df605f-d85990de-b0124234-c473279b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:21.852943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78df605f-d85990de-b0124234-c473279b_0] Write session: try to update token
2025-10-10T14:31:21.852963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78df605f-d85990de-b0124234-c473279b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:21.866935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId: src_id|78df605f-d85990de-b0124234-c473279b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:21.867938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:21.867956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:21.867958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:21.867959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:21.867966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600633901613221:2986]
2025-10-10T14:31:21.867969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600633901613221:2986]
2025-10-10T14:31:21.867971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600633901613221:2986]
2025-10-10T14:31:21.868011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:21.868012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:21.868017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.868017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:21.868019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:21.868020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:21.868146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:21.869559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:21.930936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600634683822459:3080]
2025-10-10T14:31:21.931166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 139, pipe: [1:7559600634683822459:3080]
2025-10-10T14:31:21.975521Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:21.975726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.975738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.975776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822459:3080], now have 1 active actors on pipe
2025-10-10T14:31:21.975978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:21.976005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:21.976016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:21.976021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:21.976061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600634683822459:3080]
2025-10-10T14:31:21.976084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 140 reason: error at write: Disconnected sessionId: src_id|78df605f-d85990de-b0124234-c473279b_0
2025-10-10T14:31:21.976309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 140 sessionId: src_id|78df605f-d85990de-b0124234-c473279b_0 is DEAD
2025-10-10T14:31:21.976454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78df605f-d85990de-b0124234-c473279b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:21.976466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78df605f-d85990de-b0124234-c473279b_0] Write session will restart in 0.007286s
2025-10-10T14:31:21.976492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78df605f-d85990de-b0124234-c473279b_0] Write session: Do CDS request
2025-10-10T14:31:21.976498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78df605f-d85990de-b0124234-c473279b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:21.984932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78df605f-d85990de-b0124234-c473279b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.984951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:21.984964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 141
2025-10-10T14:31:21.985233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:21.985275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:21.985283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:21.985287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:21.985795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 141 sessionId:  describe result for acl check
2025-10-10T14:31:21.985841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:21.985848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:21.985849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:21.985856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600634683822540:3306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:21.986421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600634683822540:3306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:21.989024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600634683822540:3306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:21.989406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:21.990721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:21.990938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:21.990948Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:21.990961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:21.991014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:21.991057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600633901613458:3001]
2025-10-10T14:31:21.991493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600634683822540:3306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:21.991510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600634683822540:3306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:21.991514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600634683822540:3306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:21.991522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:21.991705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:21.991958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:21.992003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:21.992313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:21.992366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.992373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.992374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.992375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.992376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.992378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.992379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.992380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.992382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.992383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.992384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.992385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.992387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.992392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.992404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.992409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.992413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.992422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.992426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.992434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.992438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.992446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.992451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.992459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.992463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.992471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.992477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.992490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:21.992497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.992505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:21.992513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.992519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:21.992527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.992533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:21.992537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.992542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:21.992546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.992551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:21.992556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.992561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:21.992568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.992577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:21.992581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.992589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:21.992598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.992607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:21.992616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.992621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.992625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.992630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.992639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.992649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.992691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:21.995383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:21.995814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:21.995827Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:21.995829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:21.995833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:21.995839Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 140 [2:7559600633901613458:3001]
2025-10-10T14:31:21.995851Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:21.995866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:21.995874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.995877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.995879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.995894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:21.995907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:21.995914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:21.995971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.995979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.995980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.995983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:21.996045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:21.996052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:21.996064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:21.996081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:21.996103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:21.996128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822658:3306], now have 1 active actors on pipe
2025-10-10T14:31:21.996136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600634683822472:2438], now have 1 active actors on pipe
2025-10-10T14:31:21.996143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600633901613453:3001]
2025-10-10T14:31:21.996146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600633901613453:3001]
2025-10-10T14:31:21.996148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600633901613453:3001]
2025-10-10T14:31:21.996160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:21.996177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:21.996183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:21.996187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:21.996189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:21.996198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:21.996201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:21.996222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600633901613453:3001]
2025-10-10T14:31:21.996225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:21.996227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:21.996185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 140
2025-10-10T14:31:21.996185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 140
2025-10-10T14:31:21.996246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.996255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.996300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:21.996312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:21.996319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:21.996321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:21.996332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:21.996347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:21.996366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.996520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:21.996529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:21.996544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:21.996630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 141 partition: 0 MaxSeqNo: 40 sessionId: src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0
2025-10-10T14:31:21.997037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78df605f-d85990de-b0124234-c473279b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:21.999709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0] Write session: try to update token
2025-10-10T14:31:21.999726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:22.014496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId: src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:22.014570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:22.014589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:22.014592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:22.014594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:22.014603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600633901613453:3001]
2025-10-10T14:31:22.014607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600633901613453:3001]
2025-10-10T14:31:22.014614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600633901613453:3001]
2025-10-10T14:31:22.014665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:22.014676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.014683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:22.014709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:22.014720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:22.014724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:22.014822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:22.017201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:22.076364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600638978789977:3080]
2025-10-10T14:31:22.076702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 140, pipe: [1:7559600638978789977:3080]
2025-10-10T14:31:22.124079Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:22.124595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.124611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.124654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978789977:3080], now have 1 active actors on pipe
2025-10-10T14:31:22.124857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:22.124859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:22.124876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600638978789977:3080]
2025-10-10T14:31:22.124905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:22.124907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:22.124963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 141 reason: error at write: Disconnected sessionId: src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0
2025-10-10T14:31:22.125167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 141 sessionId: src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0 is DEAD
2025-10-10T14:31:22.125319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:22.125327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0] Write session will restart in 0.009054s
2025-10-10T14:31:22.125377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0] Write session: Do CDS request
2025-10-10T14:31:22.125387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:22.135899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.135964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:22.135978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 142
2025-10-10T14:31:22.136149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.136190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:22.136201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:22.136205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:22.136647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 142 sessionId:  describe result for acl check
2025-10-10T14:31:22.136686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:22.136692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:22.136694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:22.136717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600638978790097:3311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:22.137244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600638978790097:3311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:22.138820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:22.139360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600638978790097:3311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:22.139715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:22.139922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:22.139935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:22.139948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:22.140005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:22.140045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600638196580962:3004]
2025-10-10T14:31:22.140651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:22.140930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:22.140982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:22.141293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:22.141384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.141391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.141393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.141394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.141395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.141396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.141398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.141399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.141400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.141401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.141402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.141403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.141404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.141410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.141423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.141427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.141431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.141435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.141438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.141442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.141445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.141449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.141453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.141456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.141460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.141463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.141471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.141479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.141485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.141491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.141495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.141500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.141504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.141509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.141513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.141518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.141522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.141527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.141532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.141536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.141540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.141545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.141549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.141555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.141559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.141564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.141576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.141581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.141591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.141597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.141601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.141605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.141637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:22.141958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600638978790097:3311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:22.141973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600638978790097:3311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:22.141977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600638978790097:3311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:22.141985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:22.143835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:22.144159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:22.144178Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:22.144181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:22.144185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:22.144191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 141 [2:7559600638196580962:3004]
2025-10-10T14:31:22.144203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:22.144228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:22.144236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.144240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.144242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.144260Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:22.144271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:22.144282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:22.144344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.144351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.144353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.144356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:22.144425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:22.144433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.144446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.144462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.144484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:22.144511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978789978:2438], now have 1 active actors on pipe
2025-10-10T14:31:22.144519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790170:3311], now have 1 active actors on pipe
2025-10-10T14:31:22.144527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600638196580957:3004]
2025-10-10T14:31:22.144535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600638196580957:3004]
2025-10-10T14:31:22.144537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600638196580957:3004]
2025-10-10T14:31:22.144551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:22.144569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:22.144568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:22.144571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:22.144555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 141
2025-10-10T14:31:22.144573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:22.144559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 141
2025-10-10T14:31:22.144591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:22.144594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:22.144617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600638196580957:3004]
2025-10-10T14:31:22.144631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:22.144638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:22.144648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.144653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.144704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:22.144717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.144726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.144728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:22.144740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.144752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:22.144771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.144898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.144908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.144925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.145019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 142 partition: 0 MaxSeqNo: 40 sessionId: src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0
2025-10-10T14:31:22.145380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f56205a-f7c8dc4d-43eea552-c0f3cc81_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:22.148036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0] Write session: try to update token
2025-10-10T14:31:22.148056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:22.162373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId: src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:22.163682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:22.163700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:22.163702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:22.163704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:22.163711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600638196580957:3004]
2025-10-10T14:31:22.163715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600638196580957:3004]
2025-10-10T14:31:22.163717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600638196580957:3004]
2025-10-10T14:31:22.163757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:22.163766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.163766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:22.163768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:22.163775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:22.163779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:22.163904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:22.165001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:22.224831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600638978790177:3080]
2025-10-10T14:31:22.225064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 141, pipe: [1:7559600638978790177:3080]
2025-10-10T14:31:22.265946Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:22.266479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.266491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.266529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790177:3080], now have 1 active actors on pipe
2025-10-10T14:31:22.266687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:22.266752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:22.266774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600638978790177:3080]
2025-10-10T14:31:22.266797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:22.266881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 142 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0
2025-10-10T14:31:22.267103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 142 sessionId: src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0 is DEAD
2025-10-10T14:31:22.267276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:22.267287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0] Write session will restart in 0.005722s
2025-10-10T14:31:22.267310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0] Write session: Do CDS request
2025-10-10T14:31:22.267316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:22.273889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.273980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:22.273995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 143
2025-10-10T14:31:22.274121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.274161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:22.274169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:22.274172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:22.274535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 143 sessionId:  describe result for acl check
2025-10-10T14:31:22.274573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:22.274581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:22.274584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:22.274590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600638978790194:3315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:22.275120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600638978790194:3315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:22.278121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600638978790194:3315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:22.280018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:22.280991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:22.281190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:22.281206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:22.281216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:22.281265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:22.281269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600638978790194:3315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:22.281285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600638978790194:3315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:22.281296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600638196581159:3006]
2025-10-10T14:31:22.281289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600638978790194:3315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:22.281298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:22.281690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:22.281901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:22.281929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:22.282224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:22.282312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.282319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.282320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.282321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.282321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.282323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.282324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.282325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.282326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.282327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.282328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.282329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.282330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.282336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.282350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.282354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.282358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.282362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.282367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.282372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.282376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.282379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.282384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.282388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.282392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.282396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.282405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.282414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.282421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.282426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.282430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.282440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.282449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.282458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.282468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.282477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.282481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.282490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.282498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.282501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.282512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.282515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.282517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.282520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.282523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.282526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.282529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.282532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.282535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.282538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.282544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.282547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.282584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:22.284844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:22.285388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:22.285398Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:22.285400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:22.285413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:22.285418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 142 [2:7559600638196581159:3006]
2025-10-10T14:31:22.285427Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:22.285441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:22.285446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.285448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.285450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.285465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:22.285474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:22.285480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:22.285529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.285534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.285535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.285537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:22.285588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:22.285595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.285603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.285613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.285622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:22.285644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790178:2438], now have 1 active actors on pipe
2025-10-10T14:31:22.285649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790366:3315], now have 1 active actors on pipe
2025-10-10T14:31:22.285655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600638196581154:3006]
2025-10-10T14:31:22.285660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600638196581154:3006]
2025-10-10T14:31:22.285661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600638196581154:3006]
2025-10-10T14:31:22.285670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:22.285681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:22.285690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:22.285693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:22.285696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:22.285699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:22.285701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:22.285722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600638196581154:3006]
2025-10-10T14:31:22.285727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:22.285713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 142
2025-10-10T14:31:22.285719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 142
2025-10-10T14:31:22.285738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:22.285757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.285760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.285800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:22.285812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.285818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.285819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:22.285827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.285838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:22.285854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.285999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.286005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.286017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.286096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 143 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0
2025-10-10T14:31:22.286481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a3a820-7debdaba-1b916a2-5dec0f0e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:22.289025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0] Write session: try to update token
2025-10-10T14:31:22.289041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:22.302964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId: src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:22.304089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:22.304105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:22.304107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:22.304109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:22.304116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600638196581154:3006]
2025-10-10T14:31:22.304119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600638196581154:3006]
2025-10-10T14:31:22.304122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600638196581154:3006]
2025-10-10T14:31:22.304158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:22.304168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.304169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:22.304175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:22.304181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:22.304184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:22.304300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:22.305471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:22.367171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600638978790378:3080]
2025-10-10T14:31:22.367390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 142, pipe: [1:7559600638978790378:3080]
2025-10-10T14:31:22.408729Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:22.409043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.409056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.409092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790378:3080], now have 1 active actors on pipe
2025-10-10T14:31:22.409254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:22.409274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600638978790378:3080]
2025-10-10T14:31:22.409295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:22.409302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:22.409383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 143 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0
2025-10-10T14:31:22.409548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 143 sessionId: src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0 is DEAD
2025-10-10T14:31:22.409712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:22.409718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0] Write session will restart in 0.007550s
2025-10-10T14:31:22.409736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0] Write session: Do CDS request
2025-10-10T14:31:22.409741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:22.418799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.418879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:22.418896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 144
2025-10-10T14:31:22.419025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.419058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:22.419065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:22.419068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:22.419463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 144 sessionId:  describe result for acl check
2025-10-10T14:31:22.419497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:22.419504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:22.419506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:22.419512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600638978790535:3319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:22.420033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600638978790535:3319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:22.420539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:22.421349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:22.421519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:22.421529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:22.421539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:22.421584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:22.421612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600638196581357:3008]
2025-10-10T14:31:22.421769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600638978790535:3319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:22.422021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:22.422235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:22.422274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:22.422482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:22.422527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.422532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.422533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.422534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.422534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.422535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.422535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.422536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.422537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.422537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.422538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.422538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.422539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.422543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.422550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.422552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.422555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.422557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.422559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.422561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.422563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.422565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.422567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.422569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.422571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.422573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.422578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.422584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.422589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.422592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.422595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.422598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.422600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.422603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.422606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.422609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.422611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.422614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.422617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.422620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.422623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.422626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.422628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.422631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.422634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.422637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.422645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.422648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.422650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.422657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.422660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.422662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.422687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:22.424720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600638978790535:3319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:22.424731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600638978790535:3319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:22.424740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600638978790535:3319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:22.424747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:22.424856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:22.425154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:22.425163Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:22.425165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:22.425167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:22.425172Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 143 [2:7559600638196581357:3008]
2025-10-10T14:31:22.425179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:22.425193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:22.425198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.425201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.425202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.425215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:22.425222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:22.425231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:22.425271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.425276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.425278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.425279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:22.425360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:22.425368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.425377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.425383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.425397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:22.425421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790572:3319], now have 1 active actors on pipe
2025-10-10T14:31:22.425424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790379:2438], now have 1 active actors on pipe
2025-10-10T14:31:22.425430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600638196581351:3008]
2025-10-10T14:31:22.425433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600638196581351:3008]
2025-10-10T14:31:22.425436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600638196581351:3008]
2025-10-10T14:31:22.425429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 143
2025-10-10T14:31:22.425436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 143
2025-10-10T14:31:22.425462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:22.425481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:22.425484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:22.425485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:22.425486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:22.425500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:22.425505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:22.425535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.425542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.425554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600638196581351:3008]
2025-10-10T14:31:22.425562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:22.425576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:22.425590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:22.425598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.425604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.425607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:22.425618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.425632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:22.425650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.425777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.425784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.425797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.425899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 144 partition: 0 MaxSeqNo: 40 sessionId: src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0
2025-10-10T14:31:22.426203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b041ca-607f0344-bb0d17e4-21e805ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:22.428628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0] Write session: try to update token
2025-10-10T14:31:22.428643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:22.442463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId: src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:22.444778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:22.444796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:22.444799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:22.444801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:22.444810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600638196581351:3008]
2025-10-10T14:31:22.444815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600638196581351:3008]
2025-10-10T14:31:22.444819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600638196581351:3008]
2025-10-10T14:31:22.444860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:22.444872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:22.444878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:22.444881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:22.444889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.444865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:22.444892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:22.445033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:22.509497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600638978790580:3080]
2025-10-10T14:31:22.509702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 143, pipe: [1:7559600638978790580:3080]
2025-10-10T14:31:22.561040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:22.561512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.561529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.561572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790580:3080], now have 1 active actors on pipe
2025-10-10T14:31:22.561730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:22.561793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600638978790580:3080]
2025-10-10T14:31:22.561799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:22.561826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:22.561912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 144 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0
2025-10-10T14:31:22.562103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 144 sessionId: src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0 is DEAD
2025-10-10T14:31:22.562271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:22.562282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0] Write session will restart in 0.009262s
2025-10-10T14:31:22.562310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0] Write session: Do CDS request
2025-10-10T14:31:22.562314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:22.572846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.572931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:22.572945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 145
2025-10-10T14:31:22.573075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.573103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:22.573111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:22.573114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:22.573500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 145 sessionId:  describe result for acl check
2025-10-10T14:31:22.573533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:22.573539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:22.573541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:22.573548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600638978790750:3325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:22.573993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600638978790750:3325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:22.574657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:22.575622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:22.575627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600638978790750:3325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:22.575818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:22.575829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:22.575840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:22.575888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:22.575926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600638196581557:3011]
2025-10-10T14:31:22.576502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:22.576718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:22.576754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:22.577041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:22.577093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.577099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.577100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.577101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.577102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.577104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.577105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.577106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.577107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.577108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.577109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.577110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.577111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.577117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.577128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.577133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.577137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.577141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.577145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.577148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.577152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.577156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.577160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.577164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.577168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.577171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.577177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.577185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.577191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.577196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.577200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.577205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.577211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.577216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.577226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.577231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.577239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.577244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.577248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.577253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.577256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.577262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.577270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.577274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.577278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.577283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.577291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.577296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.577300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.577307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.577311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.577319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.577370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:22.577538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600638978790750:3325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:22.577552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600638978790750:3325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:22.577555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600638978790750:3325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:22.577562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:22.579451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:22.579814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:22.579825Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:22.579828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:22.579831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:22.579836Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 144 [2:7559600638196581557:3011]
2025-10-10T14:31:22.579846Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:22.579863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:22.579869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.579871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.579873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.579884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:22.579891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:22.579898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:22.579944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.579949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.579950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.579952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:22.580012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:22.580019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.580030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.580037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.580046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:22.580063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790592:2438], now have 1 active actors on pipe
2025-10-10T14:31:22.580069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790786:3325], now have 1 active actors on pipe
2025-10-10T14:31:22.580074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600638196581552:3011]
2025-10-10T14:31:22.580077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600638196581552:3011]
2025-10-10T14:31:22.580078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600638196581552:3011]
2025-10-10T14:31:22.580088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:22.580103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:22.580108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:22.580105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 144
2025-10-10T14:31:22.580111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:22.580118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 144
2025-10-10T14:31:22.580112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:22.580124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:22.580127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:22.580149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600638196581552:3011]
2025-10-10T14:31:22.580155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:22.580156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:22.580167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.580175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.580223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:22.580235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.580238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.580239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:22.580247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.580255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:22.580269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.580418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.580424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.580436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.580521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 145 partition: 0 MaxSeqNo: 40 sessionId: src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0
2025-10-10T14:31:22.580845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb78ff4-e08b9371-fb6b8b1c-b47b4091_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:22.583319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0] Write session: try to update token
2025-10-10T14:31:22.583334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:22.596545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId: src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:22.598835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:22.598851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:22.598853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:22.598855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:22.598863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600638196581552:3011]
2025-10-10T14:31:22.598867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600638196581552:3011]
2025-10-10T14:31:22.598871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600638196581552:3011]
2025-10-10T14:31:22.598914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:22.598917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:22.598922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.598924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:22.598927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:22.598931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:22.599046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:22.599248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:22.662080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600638978790797:3080]
2025-10-10T14:31:22.662335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 144, pipe: [1:7559600638978790797:3080]
2025-10-10T14:31:22.714251Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:22.714608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.714623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.714666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790797:3080], now have 1 active actors on pipe
2025-10-10T14:31:22.714866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:22.714882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:22.714913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600638978790797:3080]
2025-10-10T14:31:22.714936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:22.715021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 145 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0
2025-10-10T14:31:22.715241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 145 sessionId: src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0 is DEAD
2025-10-10T14:31:22.715431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:22.715442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0] Write session will restart in 0.006979s
2025-10-10T14:31:22.715468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0] Write session: Do CDS request
2025-10-10T14:31:22.715475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:22.723853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.723912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:22.723924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 146
2025-10-10T14:31:22.724084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.724114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:22.724126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:22.724130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:22.724463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 146 sessionId:  describe result for acl check
2025-10-10T14:31:22.724489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:22.724496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:22.724497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:22.724501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600638978790881:3329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:22.724933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600638978790881:3329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:22.727153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600638978790881:3329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:22.727775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:22.728738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:22.728939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:22.728949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:22.728960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:22.729007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:22.729045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600638196581757:3013]
2025-10-10T14:31:22.729668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:22.729692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600638978790881:3329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:22.729705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600638978790881:3329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:22.729708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600638978790881:3329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:22.729716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:22.729941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:22.729978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:22.730293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:22.730343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.730349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.730350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.730351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.730353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.730354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.730355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.730356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.730357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.730358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.730359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.730360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.730362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.730366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.730379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.730383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.730387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.730391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.730395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.730398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.730402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.730406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.730410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.730414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.730418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.730421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.730428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.730437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.730443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.730448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.730452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.730457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.730462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.730471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.730475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.730481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.730484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.730489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.730498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.730503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.730507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.730516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.730520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.730525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.730534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.730539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.730543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.730548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.730556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.730561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.730566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.730571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.730613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:22.732763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:22.733279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:22.733290Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:22.733292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:22.733296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:22.733301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 145 [2:7559600638196581757:3013]
2025-10-10T14:31:22.733322Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:22.733353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:22.733356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.733358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.733360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.733373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:22.733382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:22.733392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:22.733449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.733455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.733457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.733460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:22.733519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:22.733527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.733538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.733550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.733566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:22.733589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600638196581752:3013]
2025-10-10T14:31:22.733606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600638196581752:3013]
2025-10-10T14:31:22.733613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600638196581752:3013]
2025-10-10T14:31:22.733623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:22.733632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:22.733635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:22.733636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:22.733640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790798:2438], now have 1 active actors on pipe
2025-10-10T14:31:22.733646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:22.733663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:22.733670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:22.733676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978790989:3329], now have 1 active actors on pipe
2025-10-10T14:31:22.733700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600638196581752:3013]
2025-10-10T14:31:22.733685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 145
2025-10-10T14:31:22.733707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:22.733693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 145
2025-10-10T14:31:22.733725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:22.733737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.733744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.733779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:22.733790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.733795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.733799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:22.733811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.733824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:22.733838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.733980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.733986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.733999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.734079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 146 partition: 0 MaxSeqNo: 40 sessionId: src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0
2025-10-10T14:31:22.734463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92f7e5bc-523e4fc1-dc3556a3-e61d1d56_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:22.737080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0] Write session: try to update token
2025-10-10T14:31:22.737097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:22.751129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId: src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:22.752193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:22.752206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:22.752208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:22.752210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:22.752217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600638196581752:3013]
2025-10-10T14:31:22.752220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600638196581752:3013]
2025-10-10T14:31:22.752223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600638196581752:3013]
2025-10-10T14:31:22.752260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:22.752265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.752267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:22.752267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:22.752272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:22.752275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:22.752393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:22.753402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:22.815153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600638978791001:3080]
2025-10-10T14:31:22.815393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 145, pipe: [1:7559600638978791001:3080]
2025-10-10T14:31:22.855955Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:22.856161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.856172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.856211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978791001:3080], now have 1 active actors on pipe
2025-10-10T14:31:22.856377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:22.856416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600638978791001:3080]
2025-10-10T14:31:22.856442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:22.856446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:22.856532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 146 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0
2025-10-10T14:31:22.856738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 146 sessionId: src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0 is DEAD
2025-10-10T14:31:22.856889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:22.856900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0] Write session will restart in 0.009615s
2025-10-10T14:31:22.856924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0] Write session: Do CDS request
2025-10-10T14:31:22.856930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:22.867828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.867915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:22.867930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 147
2025-10-10T14:31:22.868056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:22.868112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:22.868122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:22.868126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:22.868218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:22.868562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 147 sessionId:  describe result for acl check
2025-10-10T14:31:22.868596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:22.868602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:22.868604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:22.868609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600638978791165:3333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:22.869001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:22.869113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600638978791165:3333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:22.869186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:22.869199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:22.869210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:22.869260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:22.869300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600638196581958:3015]
2025-10-10T14:31:22.869920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:22.870234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:22.870276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:22.870601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:22.870650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.870656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.870657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.870658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.870659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.870660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.870661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.870662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.870663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.870665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.870666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.870667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.870668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.870673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.870685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.870689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.870693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.870697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.870701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.870705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.870709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.870713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.870717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.870721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.870724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.870728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.870735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.870743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:22.870750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.870755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:22.870760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.870765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:22.870770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.870778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:22.870783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.870792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:22.870797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.870802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:22.870806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.870816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:22.870821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.870826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:22.870833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.870838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:22.870844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.870849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:22.870854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.870861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.870865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.870872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.870881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.870886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.870925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:22.871177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600638978791165:3333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:22.872987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:22.873324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:22.873358Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:22.873361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:22.873364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:22.873369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 146 [2:7559600638196581958:3015]
2025-10-10T14:31:22.873381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:22.873395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:22.873400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.873403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.873406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.873420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:22.873427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:22.873438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:22.873542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600638978791165:3333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:22.873554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600638978791165:3333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:22.873558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600638978791165:3333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:22.873565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:22.873636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.873644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.873646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.873648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:22.873714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:22.873721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.873733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:22.873749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:22.873772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:22.873798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978791002:2438], now have 1 active actors on pipe
2025-10-10T14:31:22.873797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 146
2025-10-10T14:31:22.873817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 146
2025-10-10T14:31:22.873808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978791197:3333], now have 1 active actors on pipe
2025-10-10T14:31:22.873816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600638196581953:3015]
2025-10-10T14:31:22.873818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600638196581953:3015]
2025-10-10T14:31:22.873820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600638196581953:3015]
2025-10-10T14:31:22.873828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:22.873842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:22.873844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:22.873847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:22.873848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:22.873859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:22.873862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:22.873883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.873892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.873923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600638196581953:3015]
2025-10-10T14:31:22.873934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:22.873943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:22.873952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28330847-2de1100b-11c38f0b-45af3ecf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:22.873959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:22.873962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:22.873964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:22.873975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:22.873987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:22.874026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.874163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.874175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.874197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:22.874268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 147 partition: 0 MaxSeqNo: 40 sessionId: src_id|28330847-2de1100b-11c38f0b-45af3ecf_0
2025-10-10T14:31:22.874557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ad2f96-920646bc-a2a846f8-16dd535f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28330847-2de1100b-11c38f0b-45af3ecf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:22.876986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28330847-2de1100b-11c38f0b-45af3ecf_0] Write session: try to update token
2025-10-10T14:31:22.876999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28330847-2de1100b-11c38f0b-45af3ecf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:22.889854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId: src_id|28330847-2de1100b-11c38f0b-45af3ecf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:22.892137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:22.892534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:22.892561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:22.892585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:22.892588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:22.892592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:22.892594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:22.892602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600638196581953:3015]
2025-10-10T14:31:22.892608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600638196581953:3015]
2025-10-10T14:31:22.892612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600638196581953:3015]
2025-10-10T14:31:22.892651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:22.892663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:22.892667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:22.892669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:22.892676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:22.892679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:22.892819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:22.956481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600638978791205:3080]
2025-10-10T14:31:22.956782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 146, pipe: [1:7559600638978791205:3080]
2025-10-10T14:31:22.995612Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:22.995858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:22.995910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978791205:3080], now have 1 active actors on pipe
2025-10-10T14:31:22.995973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:22.996329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:22.997717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600638978791205:3080]
2025-10-10T14:31:23.004184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:23.004195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:23.004214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 147 reason: error at write: Disconnected sessionId: src_id|28330847-2de1100b-11c38f0b-45af3ecf_0
2025-10-10T14:31:23.004342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 147 sessionId: src_id|28330847-2de1100b-11c38f0b-45af3ecf_0 is DEAD
2025-10-10T14:31:23.004474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28330847-2de1100b-11c38f0b-45af3ecf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:23.004486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28330847-2de1100b-11c38f0b-45af3ecf_0] Write session will restart in 0.009167s
2025-10-10T14:31:23.004511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28330847-2de1100b-11c38f0b-45af3ecf_0] Write session: Do CDS request
2025-10-10T14:31:23.004517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28330847-2de1100b-11c38f0b-45af3ecf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:23.012452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:23.013405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:23.013618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:23.013629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:23.013640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:23.013703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:23.013743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600642491549494:3028]
2025-10-10T14:31:23.014368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:23.014665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:23.014722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:23.014871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28330847-2de1100b-11c38f0b-45af3ecf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.014979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:23.014994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 148
2025-10-10T14:31:23.015051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:23.015102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.015098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.015108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.015109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.015110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.015112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.015113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.015133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:23.015144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:23.015114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.015147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:23.015115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.015117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.015118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.015119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.015120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.015121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.015127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.015139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.015143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.015147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.015151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.015155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.015159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.015163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.015166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.015183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.015187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.015191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.015194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.015202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.015210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.015217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.015223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.015229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.015234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.015239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.015249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.015254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.015259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.015263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.015272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.015277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.015286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.015290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.015295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.015303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.015309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.015314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.015319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.015328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.015347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.015355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.015359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.015364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.015368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.015412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:23.015487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 148 sessionId:  describe result for acl check
2025-10-10T14:31:23.015517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:23.015519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:23.015520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:23.015524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600643273758695:3346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:23.015903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600643273758695:3346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:23.017578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:23.017711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600643273758695:3346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:23.017869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:23.017880Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:23.017883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:23.017886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:23.017892Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 147 [2:7559600642491549494:3028]
2025-10-10T14:31:23.017903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:23.017920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:23.017928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.017931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.017934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.017950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:23.017963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:23.017974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:23.018025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.018031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.018033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.018035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:23.018180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 147
2025-10-10T14:31:23.018259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:23.018267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.018279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.018295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.018317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:23.018343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600638978791220:2438], now have 1 active actors on pipe
2025-10-10T14:31:23.018357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600642491549489:3028]
2025-10-10T14:31:23.018363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600642491549489:3028]
2025-10-10T14:31:23.018365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600642491549489:3028]
2025-10-10T14:31:23.018381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:23.018398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:23.018397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:23.018401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:23.018402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:23.018419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:23.018422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:23.018451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600642491549489:3028]
2025-10-10T14:31:23.018460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:23.018465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:23.023209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600643273758695:3346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:23.023220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600643273758695:3346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:23.023223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600643273758695:3346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:23.023233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:23.023441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273758727:3346], now have 1 active actors on pipe
2025-10-10T14:31:23.023493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 147
2025-10-10T14:31:23.023535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.023545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.023577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:23.023603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.023614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.023616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:23.023630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.023650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:23.023679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.023835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.023842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.023856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.023945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 148 partition: 0 MaxSeqNo: 40 sessionId: src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0
2025-10-10T14:31:23.024262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28330847-2de1100b-11c38f0b-45af3ecf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:23.026801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0] Write session: try to update token
2025-10-10T14:31:23.026818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:23.029391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:23.029403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.029412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600642491549489:3028]
2025-10-10T14:31:23.029444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:23.029454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:23.029623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:23.029766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:23.029906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:23.030045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:23.030241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:23.030279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:23.040464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId: src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:23.042886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:23.043079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.043100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.043140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:23.043214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:23.046463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:23.046478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.046481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:23.046482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:23.046489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600642491549489:3028]
2025-10-10T14:31:23.046491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600642491549489:3028]
2025-10-10T14:31:23.046494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600642491549489:3028]
2025-10-10T14:31:23.046533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:23.046537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:23.046542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.046544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:23.046544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:23.046550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:23.046655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:23.097810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600643273758742:3080]
2025-10-10T14:31:23.098005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 147, pipe: [1:7559600643273758742:3080]
2025-10-10T14:31:23.148096Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:23.154819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.154850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.154999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.155056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.155114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.155175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.155217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.155226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.155297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.155352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.155426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.155486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.155533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.155541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.155604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.155665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.155725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.155781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.155821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.155827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.155891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.155950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.156006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.156062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.156101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.156107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.156172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.156227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.156280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.156332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.156371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.156377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.156439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.156490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.156545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.156598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.156637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.156642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.156703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.156755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.156810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.156864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.156904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.156912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.156974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.157025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.157080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.157135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.157346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.157353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.157408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.157465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.157520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.157586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.157622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.157627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.157687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:23.157744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:23.157795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:23.157856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:23.157901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:23.157909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:23.157955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273758742:3080], now have 1 active actors on pipe
2025-10-10T14:31:23.158184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600643273758742:3080]
2025-10-10T14:31:23.158200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:23.158203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:23.158210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:23.158227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 148 reason: error at write: Disconnected sessionId: src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0
2025-10-10T14:31:23.158422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 148 sessionId: src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0 is DEAD
2025-10-10T14:31:23.158520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:23.158579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:23.158591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0] Write session will restart in 0.008068s
2025-10-10T14:31:23.158615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0] Write session: Do CDS request
2025-10-10T14:31:23.158622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:23.167928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.168168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:23.168180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 149
2025-10-10T14:31:23.168274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.168307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:23.168315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:23.168318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:23.168685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 149 sessionId:  describe result for acl check
2025-10-10T14:31:23.168714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:23.168726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:23.168727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:23.168732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600643273758854:3351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:23.169151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600643273758854:3351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:23.171197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:23.171555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600643273758854:3351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:23.172001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:23.172192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:23.172202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:23.172214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:23.172268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:23.172319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600642491549708:3033]
2025-10-10T14:31:23.172870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:23.173124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:23.173168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:23.173450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:23.173502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.173507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.173508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.173509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.173511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.173512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.173513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.173513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.173514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.173515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.173515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.173516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.173517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.173521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.173529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.173531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.173533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.173535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.173538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.173540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.173541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.173543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.173546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.173548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.173550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.173552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.173557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.173562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.173566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.173569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.173572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.173575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.173578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.173581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.173584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.173587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.173589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.173592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.173595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.173598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.173601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.173604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.173606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.173609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.173612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.173615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.173617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.173621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.173623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.173626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.173629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.173632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.173655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:23.174125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600643273758854:3351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:23.174139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600643273758854:3351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:23.174150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600643273758854:3351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:23.174157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:23.175741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:23.176036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:23.176048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:23.176050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:23.176054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:23.176059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 148 [2:7559600642491549708:3033]
2025-10-10T14:31:23.176075Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:23.176100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:23.176102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.176105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.176107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.176120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:23.176133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:23.176146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:23.176197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.176203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.176204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.176207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:23.176271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:23.176278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.176289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.176306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.176328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:23.176353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273758943:3351], now have 1 active actors on pipe
2025-10-10T14:31:23.176361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273758744:2438], now have 1 active actors on pipe
2025-10-10T14:31:23.176368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600642491549703:3033]
2025-10-10T14:31:23.176370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600642491549703:3033]
2025-10-10T14:31:23.176372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600642491549703:3033]
2025-10-10T14:31:23.176381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:23.176366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 148
2025-10-10T14:31:23.176367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 148
2025-10-10T14:31:23.176395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:23.176397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:23.176400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:23.176402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:23.176416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:23.176419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:23.176454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.176464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.176482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600642491549703:3033]
2025-10-10T14:31:23.176492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:23.176503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:23.176526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:23.176537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.176545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.176547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:23.176561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.176575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:23.176749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.176928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.176940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.176959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.177050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 149 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0
2025-10-10T14:31:23.177373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|287d3d72-fbd9d893-bc1389b6-631e2e52_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:23.179814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0] Write session: try to update token
2025-10-10T14:31:23.179829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:23.193271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId: src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:23.195122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:23.195142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.195146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:23.195148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:23.195156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600642491549703:3033]
2025-10-10T14:31:23.195160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600642491549703:3033]
2025-10-10T14:31:23.195164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600642491549703:3033]
2025-10-10T14:31:23.195211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:23.195214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:23.195222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.195224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:23.195226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:23.195230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:23.195366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:23.195664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:23.258510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600643273758950:3080]
2025-10-10T14:31:23.258727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 148, pipe: [1:7559600643273758950:3080]
2025-10-10T14:31:23.297116Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:23.297455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.297467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.297503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273758950:3080], now have 1 active actors on pipe
2025-10-10T14:31:23.297638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:23.297700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:23.297711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:23.297734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:23.297770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600643273758950:3080]
2025-10-10T14:31:23.297775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 149 reason: error at write: Disconnected sessionId: src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0
2025-10-10T14:31:23.297941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 149 sessionId: src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0 is DEAD
2025-10-10T14:31:23.298096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:23.298105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0] Write session will restart in 0.008408s
2025-10-10T14:31:23.298123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0] Write session: Do CDS request
2025-10-10T14:31:23.298135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:23.307820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.307872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:23.307883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 150
2025-10-10T14:31:23.307997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.308027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:23.308032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:23.308036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:23.308443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 150 sessionId:  describe result for acl check
2025-10-10T14:31:23.308475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:23.308480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:23.308481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:23.308486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600643273759096:3355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:23.308935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600643273759096:3355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:23.309892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:23.310693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:23.310827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:23.310835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:23.310844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:23.310880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:23.310911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600642491549912:3035]
2025-10-10T14:31:23.311031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600643273759096:3355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:23.311286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:23.311487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:23.311518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:23.311741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:23.311781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.311786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.311786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.311787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.311787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.311788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.311789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.311789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.311790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.311791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.311791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.311792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.311793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.311797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.311804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.311807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.311809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.311811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.311813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.311816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.311818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.311820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.311822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.311824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.311827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.311829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.311833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.311839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.311843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.311846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.311849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.311852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.311854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.311857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.311860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.311863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.311865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.311869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.311872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.311875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.311877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.311880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.311886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.311889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.311891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.311895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.311897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.311900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.311903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.311909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.311912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.311915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.311935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:23.313882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600643273759096:3355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:23.313894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600643273759096:3355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:23.313897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600643273759096:3355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:23.313904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:23.313957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:23.314316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:23.314326Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:23.314327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:23.314330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:23.314334Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 149 [2:7559600642491549912:3035]
2025-10-10T14:31:23.314342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:23.314353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:23.314354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.314356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.314358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.314369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:23.314378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:23.314387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:23.314424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.314428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.314429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.314431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:23.314477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:23.314491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.314501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.314508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.314522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:23.314546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273758952:2438], now have 1 active actors on pipe
2025-10-10T14:31:23.314555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759151:3355], now have 1 active actors on pipe
2025-10-10T14:31:23.314562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600642491549907:3035]
2025-10-10T14:31:23.314564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600642491549907:3035]
2025-10-10T14:31:23.314566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600642491549907:3035]
2025-10-10T14:31:23.314578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:23.314571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 149
2025-10-10T14:31:23.314590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:23.314593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:23.314595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:23.314596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:23.314576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 149
2025-10-10T14:31:23.314611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:23.314617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:23.314645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.314651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.314661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600642491549907:3035]
2025-10-10T14:31:23.314669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:23.314674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:23.314691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:23.314700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.314702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.314704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:23.314711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.314719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:23.314732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.314846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.314852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.314866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.314952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 150 partition: 0 MaxSeqNo: 40 sessionId: src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0
2025-10-10T14:31:23.315266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c57905-79a5b91b-26d896bb-ead8948a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:23.317714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0] Write session: try to update token
2025-10-10T14:31:23.317728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:23.330984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId: src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:23.332944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:23.332959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.332961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:23.332962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:23.332970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600642491549907:3035]
2025-10-10T14:31:23.332973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600642491549907:3035]
2025-10-10T14:31:23.332975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600642491549907:3035]
2025-10-10T14:31:23.333013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:23.333013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:23.333018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:23.333018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.333020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:23.333021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:23.333137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:23.333488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:23.397838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600643273759158:3080]
2025-10-10T14:31:23.398079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 149, pipe: [1:7559600643273759158:3080]
2025-10-10T14:31:23.435418Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:23.435627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.435639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.435679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759158:3080], now have 1 active actors on pipe
2025-10-10T14:31:23.435845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:23.435913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:23.435932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:23.435960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600643273759158:3080]
2025-10-10T14:31:23.436012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 150 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0
2025-10-10T14:31:23.436190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 150 sessionId: src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0 is DEAD
2025-10-10T14:31:23.436352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:23.436360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0] Write session will restart in 0.005953s
2025-10-10T14:31:23.436385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0] Write session: Do CDS request
2025-10-10T14:31:23.436391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:23.443852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.443963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:23.443983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 151
2025-10-10T14:31:23.444124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.444166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:23.444177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:23.444182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:23.444623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 151 sessionId:  describe result for acl check
2025-10-10T14:31:23.444654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:23.444661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:23.444662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:23.444669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600643273759229:3359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:23.445190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600643273759229:3359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:23.447465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600643273759229:3359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:23.447866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:23.448644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:23.448819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:23.448831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:23.448842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:23.448893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:23.448930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600642491550117:3037]
2025-10-10T14:31:23.449516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600643273759229:3359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:23.449527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600643273759229:3359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:23.449539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:23.449529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600643273759229:3359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:23.449535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:23.449747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:23.449784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:23.450085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:23.450136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.450142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.450150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.450151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.450152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.450153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.450155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.450156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.450157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.450158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.450159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.450160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.450161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.450166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.450179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.450183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.450187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.450191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.450195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.450199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.450208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.450211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.450220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.450228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.450232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.450240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.450246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.450258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.450270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.450279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.450287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.450297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.450306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.450312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.450321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.450331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.450339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.450348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.450356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.450365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.450370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.450379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.450388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.450400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.450404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.450414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.450419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.450429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.450437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.450446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.450454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.450460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.450503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:23.452554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:23.452862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:23.452871Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:23.452873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:23.452877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:23.452883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 150 [2:7559600642491550117:3037]
2025-10-10T14:31:23.452894Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:23.452913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:23.452917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.452920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.452922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.452935Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:23.452942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:23.452949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:23.452997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.452999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.453001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.453004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:23.453074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:23.453082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.453093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.453109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.453131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:23.453140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 150
2025-10-10T14:31:23.453162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 150
2025-10-10T14:31:23.453152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759159:2438], now have 1 active actors on pipe
2025-10-10T14:31:23.453162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759355:3359], now have 1 active actors on pipe
2025-10-10T14:31:23.453169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600642491550112:3037]
2025-10-10T14:31:23.453171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600642491550112:3037]
2025-10-10T14:31:23.453173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600642491550112:3037]
2025-10-10T14:31:23.453181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:23.453189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:23.453191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:23.453192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:23.453202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:23.453218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:23.453221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:23.453241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.453251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.453279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600642491550112:3037]
2025-10-10T14:31:23.453290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:23.453294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:23.453312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8d90fb7-fe7f394-962296db-348ad43d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:23.453322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.453360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.453367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:23.453377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.453392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:23.453424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.453537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.453544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.453558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.453607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 151 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8d90fb7-fe7f394-962296db-348ad43d_0
2025-10-10T14:31:23.454017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d2020f-3551feeb-554e6497-bf329cdc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8d90fb7-fe7f394-962296db-348ad43d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:23.456528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d90fb7-fe7f394-962296db-348ad43d_0] Write session: try to update token
2025-10-10T14:31:23.456547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d90fb7-fe7f394-962296db-348ad43d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:23.470245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId: src_id|c8d90fb7-fe7f394-962296db-348ad43d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:23.471495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:23.471512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.471514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:23.471516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:23.471524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600642491550112:3037]
2025-10-10T14:31:23.471527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600642491550112:3037]
2025-10-10T14:31:23.471529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600642491550112:3037]
2025-10-10T14:31:23.471566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:23.471568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:23.471572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.471573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:23.471574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:23.471577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:23.471701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:23.472966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:23.536035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600643273759378:3080]
2025-10-10T14:31:23.536240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 150, pipe: [1:7559600643273759378:3080]
2025-10-10T14:31:23.575221Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:23.575633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.575646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.575682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759378:3080], now have 1 active actors on pipe
2025-10-10T14:31:23.575887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:23.575899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:23.575902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:23.575932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600643273759378:3080]
2025-10-10T14:31:23.575886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:23.575965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 151 reason: error at write: Disconnected sessionId: src_id|c8d90fb7-fe7f394-962296db-348ad43d_0
2025-10-10T14:31:23.576136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 151 sessionId: src_id|c8d90fb7-fe7f394-962296db-348ad43d_0 is DEAD
2025-10-10T14:31:23.576263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d90fb7-fe7f394-962296db-348ad43d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:23.576273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d90fb7-fe7f394-962296db-348ad43d_0] Write session will restart in 0.005565s
2025-10-10T14:31:23.576291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d90fb7-fe7f394-962296db-348ad43d_0] Write session: Do CDS request
2025-10-10T14:31:23.576299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d90fb7-fe7f394-962296db-348ad43d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:23.582724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d90fb7-fe7f394-962296db-348ad43d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.582823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:23.582834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 152
2025-10-10T14:31:23.582951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.582979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:23.582993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:23.583000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:23.583321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 152 sessionId:  describe result for acl check
2025-10-10T14:31:23.583347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:23.583352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:23.583353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:23.583357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600643273759398:3365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:23.583791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600643273759398:3365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:23.585816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600643273759398:3365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:23.588230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600643273759398:3365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:23.588244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600643273759398:3365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:23.588246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600643273759398:3365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:23.588255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:23.588253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:23.589095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:23.589276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:23.589285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:23.589294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:23.589350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:23.589379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600642491550326:3040]
2025-10-10T14:31:23.589795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:23.590053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:23.590082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:23.590312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:23.590354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.590359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.590360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.590361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.590361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.590362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.590363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.590363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.590364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.590365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.590365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.590366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.590366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.590370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.590387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.590389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.590392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.590394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.590396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.590398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.590401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.590403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.590405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.590408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.590410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.590412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.590417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.590422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.590429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.590434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.590439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.590443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.590448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.590453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.590460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.590463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.590467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.590470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.590472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.590475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.590478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.590482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.590485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.590491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.590494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.590497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.590500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.590504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.590507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.590513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.590516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.590519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.590541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:23.592568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:23.592897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:23.592909Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:23.592911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:23.592914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:23.592919Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 151 [2:7559600642491550326:3040]
2025-10-10T14:31:23.592930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:23.592949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:23.592954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.592956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.592957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.592969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:23.592977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:23.592983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:23.593034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.593039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.593040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.593042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:23.593090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:23.593095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.593102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.593111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.593124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:23.593144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759575:3365], now have 1 active actors on pipe
2025-10-10T14:31:23.593150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759379:2438], now have 1 active actors on pipe
2025-10-10T14:31:23.593155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600642491550319:3040]
2025-10-10T14:31:23.593161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600642491550319:3040]
2025-10-10T14:31:23.593162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600642491550319:3040]
2025-10-10T14:31:23.593172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:23.593184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:23.593196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:23.593196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:23.593200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:23.593202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:23.593202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:23.593207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 151
2025-10-10T14:31:23.593219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600642491550319:3040]
2025-10-10T14:31:23.593227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:23.593214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 151
2025-10-10T14:31:23.593234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:23.593248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.593252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.593394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:23.593405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.593408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.593410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:23.593418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.593427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:23.593448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.593600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.593611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.593632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.593705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 152 partition: 0 MaxSeqNo: 40 sessionId: src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0
2025-10-10T14:31:23.594029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d90fb7-fe7f394-962296db-348ad43d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:23.596439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0] Write session: try to update token
2025-10-10T14:31:23.596453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:23.610095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId: src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:23.611426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:23.611442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.611446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:23.611448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:23.611457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600642491550319:3040]
2025-10-10T14:31:23.611462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600642491550319:3040]
2025-10-10T14:31:23.611466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600642491550319:3040]
2025-10-10T14:31:23.611513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:23.611515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:23.611521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:23.611524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.611525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:23.611527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:23.611681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:23.612483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:23.676347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600643273759591:3080]
2025-10-10T14:31:23.676530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 151, pipe: [1:7559600643273759591:3080]
2025-10-10T14:31:23.718000Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:23.718298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.718311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.718348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759591:3080], now have 1 active actors on pipe
2025-10-10T14:31:23.718529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:23.718568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:23.718579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:23.718605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600643273759591:3080]
2025-10-10T14:31:23.718621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:23.718635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 152 reason: error at write: Disconnected sessionId: src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0
2025-10-10T14:31:23.718835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 152 sessionId: src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0 is DEAD
2025-10-10T14:31:23.718974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:23.718984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0] Write session will restart in 0.007238s
2025-10-10T14:31:23.719002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0] Write session: Do CDS request
2025-10-10T14:31:23.719007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:23.727721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.727838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:23.727853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 153
2025-10-10T14:31:23.727978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.728005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:23.728009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:23.728012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:23.728405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 153 sessionId:  describe result for acl check
2025-10-10T14:31:23.728440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:23.728446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:23.728448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:23.728454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600643273759701:3369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:23.729009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600643273759701:3369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:23.730730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600643273759701:3369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:23.730731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:23.731606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:23.731791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:23.731802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:23.731814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:23.731861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:23.731898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600642491550531:3042]
2025-10-10T14:31:23.732387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:23.732610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:23.732605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600643273759701:3369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:23.732628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600643273759701:3369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:23.732640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:23.732631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600643273759701:3369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:23.732636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:23.732898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:23.732947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.732953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.732954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.732955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.732956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.732957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.732958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.732960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.732961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.732962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.732963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.732964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.732965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.732970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.732982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.732986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.732990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.732994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.733002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.733006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.733015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.733019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.733023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.733031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.733035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.733043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.733049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.733061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.733072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.733077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.733081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.733091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.733095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.733100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.733104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.733114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.733122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.733127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.733135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.733141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.733147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.733153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.733161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.733167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.733175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.733182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.733191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.733195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.733203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.733208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.733216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.733221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.733264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:23.735418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:23.735927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:23.735938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:23.735940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:23.735943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:23.735948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 152 [2:7559600642491550531:3042]
2025-10-10T14:31:23.735958Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:23.735972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:23.735979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.735982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.735984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.735997Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:23.736008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:23.736015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:23.736060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.736067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.736069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.736071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:23.736136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:23.736143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.736153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.736169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.736189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:23.736213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759592:2438], now have 1 active actors on pipe
2025-10-10T14:31:23.736220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759792:3369], now have 1 active actors on pipe
2025-10-10T14:31:23.736228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600642491550526:3042]
2025-10-10T14:31:23.736230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600642491550526:3042]
2025-10-10T14:31:23.736232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600642491550526:3042]
2025-10-10T14:31:23.736245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:23.736224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 152
2025-10-10T14:31:23.736256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 152
2025-10-10T14:31:23.736256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:23.736264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:23.736265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:23.736267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:23.736280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:23.736287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:23.736324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.736332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.736347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600642491550526:3042]
2025-10-10T14:31:23.736358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:23.736375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:23.736389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7ff0e30-71266296-76892c70-a927a44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:23.736400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.736403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.736406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:23.736416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.736430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:23.736452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.736590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.736610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.736634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.736725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 153 partition: 0 MaxSeqNo: 40 sessionId: src_id|b7ff0e30-71266296-76892c70-a927a44_0
2025-10-10T14:31:23.737057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acba477d-2ddce760-82ee2c14-6e1cd1ab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b7ff0e30-71266296-76892c70-a927a44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:23.739623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ff0e30-71266296-76892c70-a927a44_0] Write session: try to update token
2025-10-10T14:31:23.739642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ff0e30-71266296-76892c70-a927a44_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:23.753142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId: src_id|b7ff0e30-71266296-76892c70-a927a44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:23.755126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:23.755144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.755148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:23.755150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:23.755159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600642491550526:3042]
2025-10-10T14:31:23.755163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600642491550526:3042]
2025-10-10T14:31:23.755167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600642491550526:3042]
2025-10-10T14:31:23.755216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:23.755220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:23.755225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:23.755228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.755229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:23.755230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:23.755362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:23.755564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:23.818683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600643273759802:3080]
2025-10-10T14:31:23.818907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 152, pipe: [1:7559600643273759802:3080]
2025-10-10T14:31:23.869554Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:23.869918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.869933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.869978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759802:3080], now have 1 active actors on pipe
2025-10-10T14:31:23.870198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:23.870242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600643273759802:3080]
2025-10-10T14:31:23.870263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:23.870271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:23.870274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:23.870326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 153 reason: error at write: Disconnected sessionId: src_id|b7ff0e30-71266296-76892c70-a927a44_0
2025-10-10T14:31:23.870505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 153 sessionId: src_id|b7ff0e30-71266296-76892c70-a927a44_0 is DEAD
2025-10-10T14:31:23.870640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ff0e30-71266296-76892c70-a927a44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:23.870651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ff0e30-71266296-76892c70-a927a44_0] Write session will restart in 0.009891s
2025-10-10T14:31:23.870675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ff0e30-71266296-76892c70-a927a44_0] Write session: Do CDS request
2025-10-10T14:31:23.870685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ff0e30-71266296-76892c70-a927a44_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:23.881813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ff0e30-71266296-76892c70-a927a44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.881873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:23.881885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 154
2025-10-10T14:31:23.882044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:23.882088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:23.882098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:23.882107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:23.882530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 154 sessionId:  describe result for acl check
2025-10-10T14:31:23.882561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:23.882566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:23.882568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:23.882572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600643273759972:3373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:23.882700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:23.883116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600643273759972:3373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:23.883543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:23.883703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:23.883713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:23.883725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:23.883774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:23.883818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600642491550739:3044]
2025-10-10T14:31:23.884374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:23.884607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:23.884639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:23.884933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:23.884981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.884987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.884988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.884989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.884991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.884992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.884993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.884993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.884995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.884996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.884997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.884997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.884998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.885003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.885016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.885020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.885024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.885028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.885032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.885035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.885044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.885048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.885056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.885060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.885064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.885072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.885078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.885092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:23.885102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.885100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600643273759972:3373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:23.885111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:23.885119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.885125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:23.885133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.885138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:23.885146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.885151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:23.885159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.885164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:23.885170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.885175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:23.885179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.885184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:23.885189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.885195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:23.885199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.885208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:23.885216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.885226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.885234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.885241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.885250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.885259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.885301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:23.887319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600643273759972:3373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:23.887330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600643273759972:3373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:23.887334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600643273759972:3373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:23.887341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:23.887450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:23.887762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:23.887774Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:23.887776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:23.887779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:23.887784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 153 [2:7559600642491550739:3044]
2025-10-10T14:31:23.887795Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:23.887811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:23.887819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.887823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.887829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.887844Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:23.887855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:23.887863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:23.887922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.887929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.887931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.887933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:23.888057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:23.888066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.888077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:23.888093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:23.888101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 153
2025-10-10T14:31:23.888102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 153
2025-10-10T14:31:23.888115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:23.888141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273760006:3373], now have 1 active actors on pipe
2025-10-10T14:31:23.888149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273759803:2438], now have 1 active actors on pipe
2025-10-10T14:31:23.888158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600642491550734:3044]
2025-10-10T14:31:23.888164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600642491550734:3044]
2025-10-10T14:31:23.888166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600642491550734:3044]
2025-10-10T14:31:23.888179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:23.888192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:23.888193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:23.888196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:23.888197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:23.888213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:23.888220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:23.888236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.888244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.888281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600642491550734:3044]
2025-10-10T14:31:23.888297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:23.888310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:23.888319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68fcb992-d52ddcf7-170ada04-4992f223_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:23.888332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:23.888339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:23.888341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:23.888351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:23.888365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:23.888397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.888562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.888569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.888583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:23.888654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 154 partition: 0 MaxSeqNo: 40 sessionId: src_id|68fcb992-d52ddcf7-170ada04-4992f223_0
2025-10-10T14:31:23.888936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ff0e30-71266296-76892c70-a927a44_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68fcb992-d52ddcf7-170ada04-4992f223_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:23.891435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68fcb992-d52ddcf7-170ada04-4992f223_0] Write session: try to update token
2025-10-10T14:31:23.891449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68fcb992-d52ddcf7-170ada04-4992f223_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:23.899491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:23.899509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.899517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600642491550734:3044]
2025-10-10T14:31:23.899557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:23.899578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:23.899715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:23.899839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:23.899963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:23.900079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:23.900256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:23.900289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:23.904548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId: src_id|68fcb992-d52ddcf7-170ada04-4992f223_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:23.906920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:23.907082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:23.907100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:23.907139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:23.907231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:23.916618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:23.916632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:23.916634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:23.916635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:23.916643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600642491550734:3044]
2025-10-10T14:31:23.916646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600642491550734:3044]
2025-10-10T14:31:23.916649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600642491550734:3044]
2025-10-10T14:31:23.916684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:23.916690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:23.916691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:23.916695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:23.916700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:23.916703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:23.916822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:23.970236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600643273760014:3080]
2025-10-10T14:31:23.970455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 153, pipe: [1:7559600643273760014:3080]
2025-10-10T14:31:24.020778Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:24.027554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.027575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.027720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.027774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.027834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.027897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.027942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.027949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.028011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.028067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.028131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.028192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.028231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.028237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.028295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.028352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.028419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.028479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.028519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.028525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.028585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.028647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.028704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.028760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.028797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.028803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.028863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.028922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.028977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.029033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.029073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.029079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.029141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.029196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.029249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.029304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.029357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.029364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.029427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.029480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.029537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.029591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.029632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.029639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.029702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.029756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.029811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.029864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.029909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.029917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.029975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.030036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.030095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.030162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.030204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.030210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.030268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:24.030321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:24.030375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:24.030435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:24.030553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:24.030560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:24.030595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600643273760014:3080], now have 1 active actors on pipe
2025-10-10T14:31:24.030792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600643273760014:3080]
2025-10-10T14:31:24.030884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:24.030890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:24.030913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 154 reason: error at write: Disconnected sessionId: src_id|68fcb992-d52ddcf7-170ada04-4992f223_0
2025-10-10T14:31:24.031107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 154 sessionId: src_id|68fcb992-d52ddcf7-170ada04-4992f223_0 is DEAD
2025-10-10T14:31:24.031254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:24.031293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fcb992-d52ddcf7-170ada04-4992f223_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:24.031302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fcb992-d52ddcf7-170ada04-4992f223_0] Write session will restart in 0.008333s
2025-10-10T14:31:24.031326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fcb992-d52ddcf7-170ada04-4992f223_0] Write session: Do CDS request
2025-10-10T14:31:24.031333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fcb992-d52ddcf7-170ada04-4992f223_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:24.031366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:24.040875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68fcb992-d52ddcf7-170ada04-4992f223_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.040938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:24.040951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 155
2025-10-10T14:31:24.041092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.041129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:24.041136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:24.041139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:24.041579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 155 sessionId:  describe result for acl check
2025-10-10T14:31:24.041608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:24.041613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:24.041614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:24.041619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600647568727444:3383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:24.042036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600647568727444:3383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:24.043799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:24.044449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600647568727444:3383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:24.044811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:24.044995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:24.045009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:24.045021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:24.045079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:24.045115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600646786518257:3052]
2025-10-10T14:31:24.045690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:24.045988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:24.046036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:24.046355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:24.046416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.046421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.046422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.046423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.046424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.046425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.046426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.046427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.046429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.046430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.046431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.046432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.046433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.046439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.046450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.046454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.046458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.046462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.046466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.046470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.046473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.046477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.046480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.046483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.046486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.046490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.046496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.046504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.046510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.046515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.046520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.046530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.046538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.046548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.046556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.046544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600647568727444:3383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:24.046565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.046555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600647568727444:3383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:24.046570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.046575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.046558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600647568727444:3383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:24.046579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.046563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:24.046583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.046586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.046590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.046594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.046598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.046601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.046606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.046615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.046619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.046627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.046631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.046635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.046639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.046672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:24.048741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:24.049161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:24.049173Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:24.049174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:24.049177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:24.049182Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 154 [2:7559600646786518257:3052]
2025-10-10T14:31:24.049190Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:24.049203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:24.049205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.049207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.049208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.049222Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:24.049227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:24.049235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:24.049274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.049280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.049281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.049282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:24.049351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:24.049357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.049364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.049371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.049385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:24.049402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727535:3383], now have 1 active actors on pipe
2025-10-10T14:31:24.049416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727324:2438], now have 1 active actors on pipe
2025-10-10T14:31:24.049425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600646786518252:3052]
2025-10-10T14:31:24.049427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600646786518252:3052]
2025-10-10T14:31:24.049428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600646786518252:3052]
2025-10-10T14:31:24.049438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:24.049451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:24.049453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:24.049456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:24.049457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:24.049447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 154
2025-10-10T14:31:24.049450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 154
2025-10-10T14:31:24.049464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:24.049466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:24.049485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600646786518252:3052]
2025-10-10T14:31:24.049487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:24.049489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:24.049500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.049506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.049544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|770f6a75-e723cd52-112e1fca-e299bff0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:24.049553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.049557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.049558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:24.049565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.049577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:24.049593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.049690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.049695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.049706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.049770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 155 partition: 0 MaxSeqNo: 40 sessionId: src_id|770f6a75-e723cd52-112e1fca-e299bff0_0
2025-10-10T14:31:24.050107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68fcb992-d52ddcf7-170ada04-4992f223_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|770f6a75-e723cd52-112e1fca-e299bff0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:24.052632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|770f6a75-e723cd52-112e1fca-e299bff0_0] Write session: try to update token
2025-10-10T14:31:24.052653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|770f6a75-e723cd52-112e1fca-e299bff0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:24.066061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId: src_id|770f6a75-e723cd52-112e1fca-e299bff0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:24.067826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:24.067842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:24.067845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:24.067846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:24.067852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600646786518252:3052]
2025-10-10T14:31:24.067856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600646786518252:3052]
2025-10-10T14:31:24.067859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600646786518252:3052]
2025-10-10T14:31:24.067895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:24.067901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.067903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:24.067902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:24.067909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:24.067913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:24.068022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:24.068554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:24.131037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600647568727557:3080]
2025-10-10T14:31:24.131296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 154, pipe: [1:7559600647568727557:3080]
2025-10-10T14:31:24.170907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:24.171284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.171295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.171333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727557:3080], now have 1 active actors on pipe
2025-10-10T14:31:24.171523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:24.171543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:24.171538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:24.171543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:24.171587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600647568727557:3080]
2025-10-10T14:31:24.171600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 155 reason: error at write: Disconnected sessionId: src_id|770f6a75-e723cd52-112e1fca-e299bff0_0
2025-10-10T14:31:24.171796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 155 sessionId: src_id|770f6a75-e723cd52-112e1fca-e299bff0_0 is DEAD
2025-10-10T14:31:24.171934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|770f6a75-e723cd52-112e1fca-e299bff0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:24.171945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|770f6a75-e723cd52-112e1fca-e299bff0_0] Write session will restart in 0.009537s
2025-10-10T14:31:24.171969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|770f6a75-e723cd52-112e1fca-e299bff0_0] Write session: Do CDS request
2025-10-10T14:31:24.171979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|770f6a75-e723cd52-112e1fca-e299bff0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:24.182879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|770f6a75-e723cd52-112e1fca-e299bff0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.182952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:24.182968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 156
2025-10-10T14:31:24.183129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.183172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:24.183176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:24.183179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:24.183529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 156 sessionId:  describe result for acl check
2025-10-10T14:31:24.183556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:24.183561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:24.183565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:24.183569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600647568727728:3391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:24.184017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600647568727728:3391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:24.184760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:24.185857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:24.186064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:24.186080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:24.186091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:24.186146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:24.186195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600646786518503:3062]
2025-10-10T14:31:24.186364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600647568727728:3391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:24.186769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:24.187017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:24.187049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:24.187282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:24.187332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.187339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.187340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.187341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.187342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.187343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.187344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.187346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.187347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.187348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.187349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.187350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.187351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.187357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.187369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.187374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.187378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.187383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.187387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.187391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.187394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.187398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.187408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.187412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.187416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.187420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.187426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.187435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.187446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.187456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.187465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.187475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.187484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.187493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.187503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.187512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.187521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.187530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.187539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.187548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.187552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.187562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.187566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.187572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.187576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.187582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.187588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.187593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.187602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.187611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.187616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.187625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.187665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:24.189587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600647568727728:3391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:24.189600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600647568727728:3391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:24.189603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600647568727728:3391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:24.189611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:24.189822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:24.190271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:24.190280Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:24.190282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:24.190284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:24.190289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 155 [2:7559600646786518503:3062]
2025-10-10T14:31:24.190297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:24.190311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:24.190316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.190318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.190320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.190332Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:24.190340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:24.190345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:24.190389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.190394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.190395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.190397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:24.190445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:24.190450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.190457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.190463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.190476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:24.190492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727559:2438], now have 1 active actors on pipe
2025-10-10T14:31:24.190499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727764:3391], now have 1 active actors on pipe
2025-10-10T14:31:24.190507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600646786518498:3062]
2025-10-10T14:31:24.190513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600646786518498:3062]
2025-10-10T14:31:24.190514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600646786518498:3062]
2025-10-10T14:31:24.190526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:24.190543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:24.190544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:24.190547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:24.190549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:24.190561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:24.190564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:24.190553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 155
2025-10-10T14:31:24.190584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600646786518498:3062]
2025-10-10T14:31:24.190568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 155
2025-10-10T14:31:24.190591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:24.190593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:24.190610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.190621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.190668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:24.190681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.190689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.190691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:24.190700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.190712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:24.190729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.190877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.190886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.190901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.191002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 156 partition: 0 MaxSeqNo: 40 sessionId: src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0
2025-10-10T14:31:24.191331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|770f6a75-e723cd52-112e1fca-e299bff0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:24.193823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0] Write session: try to update token
2025-10-10T14:31:24.193837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:24.207064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId: src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:24.208571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:24.208589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:24.208592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:24.208594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:24.208603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600646786518498:3062]
2025-10-10T14:31:24.208607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600646786518498:3062]
2025-10-10T14:31:24.208611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600646786518498:3062]
2025-10-10T14:31:24.208653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:24.208658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:24.208666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.208667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:24.208668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:24.208671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:24.208812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:24.209485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:24.271838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600647568727771:3080]
2025-10-10T14:31:24.272132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 155, pipe: [1:7559600647568727771:3080]
2025-10-10T14:31:24.311639Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:24.312027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.312048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.312093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727771:3080], now have 1 active actors on pipe
2025-10-10T14:31:24.312258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:24.312334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:24.312356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600647568727771:3080]
2025-10-10T14:31:24.312379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:24.312450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 156 reason: status is not ok: tablet will be restarted right now sessionId: src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0
2025-10-10T14:31:24.312653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 156 sessionId: src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0 is DEAD
2025-10-10T14:31:24.312804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:24.312814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0] Write session will restart in 0.006743s
2025-10-10T14:31:24.312833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0] Write session: Do CDS request
2025-10-10T14:31:24.312837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:24.320784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.320886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:24.320901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 157
2025-10-10T14:31:24.321036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.321071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:24.321082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:24.321089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:24.321543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 157 sessionId:  describe result for acl check
2025-10-10T14:31:24.321576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:24.321582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:24.321584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:24.321591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600647568727838:3395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:24.322106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600647568727838:3395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:24.324525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600647568727838:3395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:24.325413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:24.326233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:24.326404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:24.326412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:24.326424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:24.326474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:24.326512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600647568727838:3395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:24.326523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600647568727838:3395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:24.326527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600647568727838:3395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:24.326533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:24.326515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600646786518714:3064]
2025-10-10T14:31:24.327022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:24.327269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:24.327309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:24.327574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:24.327624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.327631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.327632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.327633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.327634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.327635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.327636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.327637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.327638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.327639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.327641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.327642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.327643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.327648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.327660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.327664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.327668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.327672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.327676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.327680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.327684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.327688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.327692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.327696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.327700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.327704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.327710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.327718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.327724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.327729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.327738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.327744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.327748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.327757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.327766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.327770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.327774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.327778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.327786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.327791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.327799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.327803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.327811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.327818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.327826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.327830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.327838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.327845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.327853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.327857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.327866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.327871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.327910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:24.330079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:24.330433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:24.330446Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:24.330447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:24.330450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:24.330455Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 156 [2:7559600646786518714:3064]
2025-10-10T14:31:24.330462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:24.330474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:24.330477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.330480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.330483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.330498Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:24.330509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:24.330517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:24.330570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.330576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.330578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.330580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:24.330636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:24.330643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.330654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.330670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.330692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:24.330716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727975:3395], now have 1 active actors on pipe
2025-10-10T14:31:24.330724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727773:2438], now have 1 active actors on pipe
2025-10-10T14:31:24.330730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600646786518709:3064]
2025-10-10T14:31:24.330736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600646786518709:3064]
2025-10-10T14:31:24.330738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600646786518709:3064]
2025-10-10T14:31:24.330751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:24.330748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 156
2025-10-10T14:31:24.330768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:24.330777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:24.330780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:24.330782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:24.330792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:24.330795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:24.330824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.330833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.330849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600646786518709:3064]
2025-10-10T14:31:24.330860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:24.330875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:24.330881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 156
2025-10-10T14:31:24.330890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:24.330896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.330898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.330900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:24.330907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.330915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:24.330935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.331053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.331060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.331073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.331155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 157 partition: 0 MaxSeqNo: 40 sessionId: src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0
2025-10-10T14:31:24.331421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596a5ae0-906546c1-d8a92512-3098cdc4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:24.333900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0] Write session: try to update token
2025-10-10T14:31:24.333914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:24.347313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId: src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:24.350110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:24.350133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:24.350136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:24.350138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:24.350149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600646786518709:3064]
2025-10-10T14:31:24.350166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600646786518709:3064]
2025-10-10T14:31:24.350170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600646786518709:3064]
2025-10-10T14:31:24.350224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:24.350235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:24.350239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.350242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:24.350244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:24.350249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:24.350424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:24.350778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:24.412616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600647568727986:3080]
2025-10-10T14:31:24.412887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 156, pipe: [1:7559600647568727986:3080]
2025-10-10T14:31:24.451540Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:24.451928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.451941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.451979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727986:3080], now have 1 active actors on pipe
2025-10-10T14:31:24.452159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:24.452251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600647568727986:3080]
2025-10-10T14:31:24.452280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:24.452285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:24.452362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 157 reason: status is not ok: tablet will be restarted right now sessionId: src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0
2025-10-10T14:31:24.452553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 157 sessionId: src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0 is DEAD
2025-10-10T14:31:24.452695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:24.452701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0] Write session will restart in 0.007261s
2025-10-10T14:31:24.452728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0] Write session: Do CDS request
2025-10-10T14:31:24.452733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:24.460841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.460910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:24.460923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 158
2025-10-10T14:31:24.461082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.461116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:24.461126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:24.461129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:24.461667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 158 sessionId:  describe result for acl check
2025-10-10T14:31:24.461703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:24.461709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:24.461710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:24.461714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600647568728061:3399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:24.462274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600647568728061:3399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:24.464316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600647568728061:3399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:24.464964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:24.465861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:24.466023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:24.466033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:24.466042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:24.466093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:24.466129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600646786518926:3066]
2025-10-10T14:31:24.466266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600647568728061:3399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:24.466279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600647568728061:3399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:24.466283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600647568728061:3399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:24.466289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:24.466626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:24.466871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:24.466906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:24.467134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:24.467187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.467193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.467194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.467195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.467196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.467198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.467199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.467200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.467201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.467202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.467203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.467204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.467206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.467210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.467223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.467228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.467235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.467239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.467246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.467250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.467253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.467256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.467260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.467267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.467271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.467275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.467286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.467299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.467309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.467319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.467327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.467332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.467343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.467348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.467353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.467358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.467362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.467367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.467372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.467377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.467381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.467387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.467392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.467397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.467401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.467406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.467411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.467415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.467420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.467430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.467434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.467439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.467486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:24.469566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:24.470015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:24.470026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:24.470028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:24.470031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:24.470036Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 157 [2:7559600646786518926:3066]
2025-10-10T14:31:24.470047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:24.470062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:24.470069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.470072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.470074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.470088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:24.470095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:24.470103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:24.470165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.470172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.470174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.470176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:24.470241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:24.470248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.470260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.470276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.470298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:24.470321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728191:3399], now have 1 active actors on pipe
2025-10-10T14:31:24.470329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568727987:2438], now have 1 active actors on pipe
2025-10-10T14:31:24.470335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600646786518921:3066]
2025-10-10T14:31:24.470337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600646786518921:3066]
2025-10-10T14:31:24.470339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600646786518921:3066]
2025-10-10T14:31:24.470352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:24.470342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 157
2025-10-10T14:31:24.470368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:24.470371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:24.470354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 157
2025-10-10T14:31:24.470374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:24.470375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:24.470389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:24.470392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:24.470420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.470428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.470445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600646786518921:3066]
2025-10-10T14:31:24.470456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:24.470474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:24.470487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:24.470500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.470510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.470512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:24.470523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.470538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:24.470562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.470677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.470684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.470698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.470802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 158 partition: 0 MaxSeqNo: 40 sessionId: src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0
2025-10-10T14:31:24.471100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|751c0d3d-e1b6928e-808ef4e-abbc149b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:24.473777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0] Write session: try to update token
2025-10-10T14:31:24.473798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:24.486973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId: src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:24.488687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:24.488701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:24.488703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:24.488705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:24.488711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600646786518921:3066]
2025-10-10T14:31:24.488716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600646786518921:3066]
2025-10-10T14:31:24.488718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600646786518921:3066]
2025-10-10T14:31:24.488757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:24.488763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.488765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:24.488770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:24.488783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:24.488787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:24.488882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:24.489403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:24.552376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600647568728211:3080]
2025-10-10T14:31:24.552602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 157, pipe: [1:7559600647568728211:3080]
2025-10-10T14:31:24.591105Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:24.591405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.591418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.591452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728211:3080], now have 1 active actors on pipe
2025-10-10T14:31:24.591596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:24.591661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600647568728211:3080]
2025-10-10T14:31:24.591664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:24.591690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:24.591754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 158 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0
2025-10-10T14:31:24.591957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 158 sessionId: src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0 is DEAD
2025-10-10T14:31:24.592165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:24.592178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0] Write session will restart in 0.006425s
2025-10-10T14:31:24.592203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0] Write session: Do CDS request
2025-10-10T14:31:24.592210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:24.600040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.600111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:24.600127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 159
2025-10-10T14:31:24.600276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.600320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:24.600344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:24.600353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:24.600832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 159 sessionId:  describe result for acl check
2025-10-10T14:31:24.600870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:24.600874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:24.600875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:24.600883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600647568728298:3405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:24.601425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600647568728298:3405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:24.603551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600647568728298:3405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:24.604968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:24.605928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:24.606018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600647568728298:3405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:24.606032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600647568728298:3405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:24.606035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600647568728298:3405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:24.606042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:24.606101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:24.606113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:24.606125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:24.606189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:24.606229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600646786519142:3069]
2025-10-10T14:31:24.606733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:24.607019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:24.607059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:24.607345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:24.607400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.607405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.607406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.607407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.607408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.607409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.607410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.607411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.607412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.607413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.607414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.607416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.607417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.607422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.607433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.607436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.607440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.607443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.607447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.607450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.607454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.607458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.607463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.607466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.607470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.607474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.607481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.607490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.607501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.607506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.607510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.607515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.607519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.607523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.607528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.607532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.607536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.607543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.607548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.607553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.607561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.607567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.607571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.607577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.607581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.607586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.607590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.607596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.607601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.607606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.607612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.607617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.607656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:24.609788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:24.610079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:24.610090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:24.610092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:24.610096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:24.610102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 158 [2:7559600646786519142:3069]
2025-10-10T14:31:24.610113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:24.610124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:24.610129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.610131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.610133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.610145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:24.610164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:24.610171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:24.610214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.610219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.610220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.610222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:24.610268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:24.610276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.610282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.610288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.610297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:24.610313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600646786519137:3069]
2025-10-10T14:31:24.610318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600646786519137:3069]
2025-10-10T14:31:24.610320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600646786519137:3069]
2025-10-10T14:31:24.610327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:24.610334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:24.610336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728435:3405], now have 1 active actors on pipe
2025-10-10T14:31:24.610341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:24.610341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728220:2438], now have 1 active actors on pipe
2025-10-10T14:31:24.610342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:24.610345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:24.610354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:24.610356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:24.610373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600646786519137:3069]
2025-10-10T14:31:24.610385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:24.610398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:24.610400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 158
2025-10-10T14:31:24.610403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 158
2025-10-10T14:31:24.610592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.610602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.610636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:24.610650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.610657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.610659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:24.610670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.610684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:24.610703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.610830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.610837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.610849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.610908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 159 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0
2025-10-10T14:31:24.611286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeef1f6e-3ddae4da-c00dad1e-97bf93c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:24.614022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0] Write session: try to update token
2025-10-10T14:31:24.614037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:24.626666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId: src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:24.628309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:24.628324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:24.628327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:24.628329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:24.628338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600646786519137:3069]
2025-10-10T14:31:24.628343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600646786519137:3069]
2025-10-10T14:31:24.628346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600646786519137:3069]
2025-10-10T14:31:24.628390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:24.628405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.628407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:24.628525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:24.628538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:24.628541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:24.628575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:24.628980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:24.691606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600647568728447:3080]
2025-10-10T14:31:24.691813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 158, pipe: [1:7559600647568728447:3080]
2025-10-10T14:31:24.732358Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:24.732687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.732704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.732739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728447:3080], now have 1 active actors on pipe
2025-10-10T14:31:24.732985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600647568728447:3080]
2025-10-10T14:31:24.733000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:24.733011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:24.733076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 159 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0
2025-10-10T14:31:24.732937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:24.733307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 159 sessionId: src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0 is DEAD
2025-10-10T14:31:24.733468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:24.733478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0] Write session will restart in 0.008390s
2025-10-10T14:31:24.733497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0] Write session: Do CDS request
2025-10-10T14:31:24.733502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:24.742815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.742904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:24.742916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 160
2025-10-10T14:31:24.743030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.743056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:24.743064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:24.743067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:24.743399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 160 sessionId:  describe result for acl check
2025-10-10T14:31:24.743426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:24.743428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:24.743429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:24.743434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600647568728550:3409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:24.743868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600647568728550:3409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:24.745939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600647568728550:3409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:24.746645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:24.747545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:24.747710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:24.747721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:24.747733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:24.747783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:24.747822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600646786519355:3071]
2025-10-10T14:31:24.747924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600647568728550:3409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:24.747935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600647568728550:3409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:24.747938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600647568728550:3409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:24.747944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:24.748346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:24.748606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:24.748638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:24.748880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:24.748919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.748924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.748925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.748926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.748927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.748928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.748929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.748930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.748931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.748932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.748933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.748935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.748936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.748941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.748953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.748957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.748961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.748965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.748970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.748974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.748978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.748980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.748982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.748984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.748986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.748988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.748993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.748998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.749003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.749008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.749012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.749017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.749021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.749025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.749030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.749035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.749039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.749045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.749050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.749054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.749059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.749064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.749068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.749073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.749078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.749083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.749087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.749094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.749097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.749100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.749103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.749106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.749127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:24.751303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:24.751599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:24.751609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:24.751612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:24.751616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:24.751621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 159 [2:7559600646786519355:3071]
2025-10-10T14:31:24.751631Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:24.751646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:24.751653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.751656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.751658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.751673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:24.751685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:24.751697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:24.751747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.751754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.751756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.751758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:24.751817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:24.751822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.751832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.751848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.751869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:24.751893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728653:3409], now have 1 active actors on pipe
2025-10-10T14:31:24.751901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728448:2438], now have 1 active actors on pipe
2025-10-10T14:31:24.751907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600646786519350:3071]
2025-10-10T14:31:24.751913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600646786519350:3071]
2025-10-10T14:31:24.751915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600646786519350:3071]
2025-10-10T14:31:24.751928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:24.751947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:24.751941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 159
2025-10-10T14:31:24.751958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:24.751965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:24.751945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 159
2025-10-10T14:31:24.751966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:24.751967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:24.751970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:24.752000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.752009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.752026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600646786519350:3071]
2025-10-10T14:31:24.752037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:24.752059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:24.752063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:24.752071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.752074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.752076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:24.752087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.752097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:24.752118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.752249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.752258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.752272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.752357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 160 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0
2025-10-10T14:31:24.752671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a67f09-4d80f594-e6e1bb08-3088c242_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:24.755012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0] Write session: try to update token
2025-10-10T14:31:24.755025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:24.768144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId: src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:24.770460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:24.770676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:24.770694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:24.770698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:24.770699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:24.770709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600646786519350:3071]
2025-10-10T14:31:24.770713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600646786519350:3071]
2025-10-10T14:31:24.770716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600646786519350:3071]
2025-10-10T14:31:24.770764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:24.770771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.770775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:24.770779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:24.770780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.770801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:24.770809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.770815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:24.770938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:24.832961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600647568728665:3080]
2025-10-10T14:31:24.833207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 159, pipe: [1:7559600647568728665:3080]
2025-10-10T14:31:24.876635Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:24.877023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728665:3080], now have 1 active actors on pipe
2025-10-10T14:31:24.877211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:24.877275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:24.877299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600647568728665:3080]
2025-10-10T14:31:24.877317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:24.877418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 160 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0
2025-10-10T14:31:24.877598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 160 sessionId: src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0 is DEAD
2025-10-10T14:31:24.877758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:24.877767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0] Write session will restart in 0.008320s
2025-10-10T14:31:24.877785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0] Write session: Do CDS request
2025-10-10T14:31:24.877790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:24.886772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.886831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:24.886843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 161
2025-10-10T14:31:24.886951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:24.886983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:24.886991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:24.886993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:24.887440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 161 sessionId:  describe result for acl check
2025-10-10T14:31:24.887474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:24.887481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:24.887483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:24.887490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600647568728746:3413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:24.887993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600647568728746:3413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:24.890065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600647568728746:3413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:24.890814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:24.891493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:24.891650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:24.891660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:24.891671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:24.891716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:24.891721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600647568728746:3413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:24.891733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600647568728746:3413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:24.891736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600647568728746:3413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:24.891752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600646786519570:3073]
2025-10-10T14:31:24.891741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:24.892318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:24.892562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:24.892601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:24.892894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:24.892938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.892944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.892945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.892946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.892947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.892948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.892949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.892950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.892951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.892952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.892953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.892954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.892955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.892961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.892973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.892977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.892981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.892985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.892989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.892993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.892997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.893000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.893004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.893008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.893014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.893018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.893023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.893036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:24.893046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.893053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:24.893057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.893064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:24.893068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.893074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:24.893078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.893085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:24.893089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.893097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:24.893102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.893112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:24.893116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.893125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:24.893129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.893136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:24.893140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.893146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:24.893149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.893155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.893158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.893162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.893169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.893175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.893208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:24.895282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:24.895731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:24.895742Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:24.895744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:24.895747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:24.895752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 160 [2:7559600646786519570:3073]
2025-10-10T14:31:24.895763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:24.895778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:24.895785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.895788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.895790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.895805Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:24.895816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:24.895823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:24.895876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.895882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.895884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.895886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:24.895947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:24.895954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.895966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:24.895982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:24.896003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:24.896022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728666:2438], now have 1 active actors on pipe
2025-10-10T14:31:24.896029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728872:3413], now have 1 active actors on pipe
2025-10-10T14:31:24.896036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600646786519565:3073]
2025-10-10T14:31:24.896038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600646786519565:3073]
2025-10-10T14:31:24.896040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600646786519565:3073]
2025-10-10T14:31:24.896052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:24.896034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 160
2025-10-10T14:31:24.896066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:24.896050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 160
2025-10-10T14:31:24.896069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:24.896075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:24.896076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:24.896085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:24.896087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:24.896120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.896128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.896142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600646786519565:3073]
2025-10-10T14:31:24.896153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:24.896166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:24.896182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:24.896193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:24.896196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:24.896198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:24.896208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:24.896221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:24.896244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.896414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.896422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.896437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:24.896516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 161 partition: 0 MaxSeqNo: 40 sessionId: src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0
2025-10-10T14:31:24.896759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c8f121a-fa9a00ba-47cd5022-a224c219_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:24.899187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0] Write session: try to update token
2025-10-10T14:31:24.899200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:24.912328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId: src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:24.914803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:24.915102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:24.915126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:24.915150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:24.915153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:24.915157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:24.915159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:24.915167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600646786519565:3073]
2025-10-10T14:31:24.915171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600646786519565:3073]
2025-10-10T14:31:24.915175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600646786519565:3073]
2025-10-10T14:31:24.915220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:24.915230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:24.915231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:24.915235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:24.915236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:24.915239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:24.915361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:24.977355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600647568728888:3080]
2025-10-10T14:31:24.977604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 160, pipe: [1:7559600647568728888:3080]
2025-10-10T14:31:25.019106Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:25.019442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:25.019497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600647568728888:3080], now have 1 active actors on pipe
2025-10-10T14:31:25.019587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:25.019643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:25.019678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:25.019684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:25.019704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600647568728888:3080]
2025-10-10T14:31:25.019755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 161 reason: error at write: Disconnected sessionId: src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0
2025-10-10T14:31:25.019906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 161 sessionId: src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0 is DEAD
2025-10-10T14:31:25.020031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:25.020040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0] Write session will restart in 0.006434s
2025-10-10T14:31:25.020059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0] Write session: Do CDS request
2025-10-10T14:31:25.020063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:25.027777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.027850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:25.027863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 162
2025-10-10T14:31:25.027987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.028035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:25.028044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:25.028056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:25.028475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 162 sessionId:  describe result for acl check
2025-10-10T14:31:25.028508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:25.028514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:25.028515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:25.028519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600651863696243:3417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:25.028936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600651863696243:3417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:25.031349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600651863696243:3417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:25.033256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:25.034223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:25.034348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600651863696243:3417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:25.034359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600651863696243:3417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:25.034362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600651863696243:3417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:25.034368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:25.034391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:25.034402Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:25.034415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:25.034467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:25.034506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600651081487085:3075]
2025-10-10T14:31:25.035105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:25.035368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:25.035399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:25.035629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:25.035671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.035676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.035676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.035677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.035678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.035678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.035679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.035680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.035680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.035681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.035682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.035682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.035683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.035687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.035695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.035698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.035702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.035706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.035710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.035714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.035717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.035721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.035725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.035729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.035731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.035735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.035742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.035752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.035757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.035761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.035763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.035766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.035769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.035772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.035775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.035778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.035781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.035785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.035788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.035791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.035793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.035796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.035799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.035802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.035804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.035807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.035811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.035816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.035821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.035825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.035831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.035836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.035864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:25.038047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:25.038524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:25.038536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:25.038538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:25.038541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:25.038547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 161 [2:7559600651081487085:3075]
2025-10-10T14:31:25.038557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:25.038572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:25.038578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.038581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.038583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.038595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:25.038606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:25.038618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:25.038671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.038678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.038679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.038681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:25.038746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:25.038754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.038764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.038775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.038796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:25.038820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696186:2438], now have 1 active actors on pipe
2025-10-10T14:31:25.038828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696393:3417], now have 1 active actors on pipe
2025-10-10T14:31:25.038835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600651081487080:3075]
2025-10-10T14:31:25.038839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600651081487080:3075]
2025-10-10T14:31:25.038842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600651081487080:3075]
2025-10-10T14:31:25.038856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:25.038863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 161
2025-10-10T14:31:25.038878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 161
2025-10-10T14:31:25.038872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:25.038873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:25.038881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:25.038882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:25.038890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:25.038893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:25.038923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.038934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.038949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600651081487080:3075]
2025-10-10T14:31:25.038960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:25.038968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:25.038993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f46d7422-701248cb-32de0387-838a6e6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:25.039004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.039008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.039010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:25.039020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.039034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:25.039059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.039197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.039206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.039221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.039304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 162 partition: 0 MaxSeqNo: 40 sessionId: src_id|f46d7422-701248cb-32de0387-838a6e6d_0
2025-10-10T14:31:25.039630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc01a2d-4b43b05b-efb56bda-b3fe6fc3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f46d7422-701248cb-32de0387-838a6e6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:25.042266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f46d7422-701248cb-32de0387-838a6e6d_0] Write session: try to update token
2025-10-10T14:31:25.042284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f46d7422-701248cb-32de0387-838a6e6d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:25.056136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId: src_id|f46d7422-701248cb-32de0387-838a6e6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:25.057618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:25.057633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:25.057636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:25.057637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:25.057645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600651081487080:3075]
2025-10-10T14:31:25.057649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600651081487080:3075]
2025-10-10T14:31:25.057652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600651081487080:3075]
2025-10-10T14:31:25.057685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:25.057690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:25.057692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:25.057704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:25.057711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.057713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:25.057843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:25.058565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:25.119665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600651863696440:3080]
2025-10-10T14:31:25.119888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 161, pipe: [1:7559600651863696440:3080]
2025-10-10T14:31:25.162158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:25.162438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.162449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.162488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696440:3080], now have 1 active actors on pipe
2025-10-10T14:31:25.162663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:25.162738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:25.162747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600651863696440:3080]
2025-10-10T14:31:25.162749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:25.162773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:25.162804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 162 reason: error at write: Disconnected sessionId: src_id|f46d7422-701248cb-32de0387-838a6e6d_0
2025-10-10T14:31:25.162990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 162 sessionId: src_id|f46d7422-701248cb-32de0387-838a6e6d_0 is DEAD
2025-10-10T14:31:25.163174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46d7422-701248cb-32de0387-838a6e6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:25.163183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46d7422-701248cb-32de0387-838a6e6d_0] Write session will restart in 0.007153s
2025-10-10T14:31:25.163201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46d7422-701248cb-32de0387-838a6e6d_0] Write session: Do CDS request
2025-10-10T14:31:25.163206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46d7422-701248cb-32de0387-838a6e6d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:25.171816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f46d7422-701248cb-32de0387-838a6e6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.171878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:25.171891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 163
2025-10-10T14:31:25.172057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.172084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:25.172092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:25.172095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:25.172652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 163 sessionId:  describe result for acl check
2025-10-10T14:31:25.172682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:25.172687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:25.172688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:25.172692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600651863696514:3431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:25.173111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600651863696514:3431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:25.175590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600651863696514:3431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:25.177179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:25.177363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600651863696514:3431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:25.177372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600651863696514:3431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:25.177374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600651863696514:3431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:25.177380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:25.177999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:25.178142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:25.178151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:25.178170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:25.178212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:25.178244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600651081487353:3091]
2025-10-10T14:31:25.178764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:25.179000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:25.179037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:25.179296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:25.179354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.179359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.179360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.179361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.179362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.179363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.179364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.179365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.179366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.179368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.179368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.179369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.179370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.179375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.179387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.179391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.179395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.179399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.179402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.179406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.179409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.179413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.179417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.179421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.179425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.179429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.179436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.179444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.179452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.179457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.179464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.179469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.179474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.179483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.179487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.179491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.179498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.179503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.179506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.179513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.179517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.179523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.179528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.179534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.179539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.179544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.179548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.179556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.179560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.179564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.179567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.179572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.179610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:25.181750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:25.182222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:25.182233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:25.182235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:25.182238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:25.182243Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 162 [2:7559600651081487353:3091]
2025-10-10T14:31:25.182254Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:25.182269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:25.182272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.182275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.182277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.182291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:25.182303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:25.182311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:25.182364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.182371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.182372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.182375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:25.182432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:25.182442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.182453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.182464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.182481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:25.182507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696650:3431], now have 1 active actors on pipe
2025-10-10T14:31:25.182515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696442:2438], now have 1 active actors on pipe
2025-10-10T14:31:25.182522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600651081487347:3091]
2025-10-10T14:31:25.182528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600651081487347:3091]
2025-10-10T14:31:25.182529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600651081487347:3091]
2025-10-10T14:31:25.182534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 162
2025-10-10T14:31:25.182539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 162
2025-10-10T14:31:25.182542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:25.182559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:25.182561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:25.182564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:25.182566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:25.182575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:25.182578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:25.182612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.182621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.182636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600651081487347:3091]
2025-10-10T14:31:25.182648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:25.182674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:25.182678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5eb07a95-b5402323-5c204030-bb3e4899_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:25.182685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.182689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.182692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:25.182705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.182721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:25.182746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.182894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.182901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.182914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.182994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 163 partition: 0 MaxSeqNo: 40 sessionId: src_id|5eb07a95-b5402323-5c204030-bb3e4899_0
2025-10-10T14:31:25.183323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f46d7422-701248cb-32de0387-838a6e6d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5eb07a95-b5402323-5c204030-bb3e4899_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:25.185776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb07a95-b5402323-5c204030-bb3e4899_0] Write session: try to update token
2025-10-10T14:31:25.185802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb07a95-b5402323-5c204030-bb3e4899_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:25.198596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId: src_id|5eb07a95-b5402323-5c204030-bb3e4899_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:25.200922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:25.200925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:25.200944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:25.200947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:25.200949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:25.200958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600651081487347:3091]
2025-10-10T14:31:25.200962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600651081487347:3091]
2025-10-10T14:31:25.200965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600651081487347:3091]
2025-10-10T14:31:25.201011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:25.201016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:25.201021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:25.201024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.201025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:25.201026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:25.201151Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:25.263038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600651863696661:3080]
2025-10-10T14:31:25.263330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 162, pipe: [1:7559600651863696661:3080]
2025-10-10T14:31:25.307075Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:25.307285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.307297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.307334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696661:3080], now have 1 active actors on pipe
2025-10-10T14:31:25.307506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:25.307565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:25.307575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:25.307595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600651863696661:3080]
2025-10-10T14:31:25.307611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:25.307626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 163 reason: error at write: Disconnected sessionId: src_id|5eb07a95-b5402323-5c204030-bb3e4899_0
2025-10-10T14:31:25.307805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 163 sessionId: src_id|5eb07a95-b5402323-5c204030-bb3e4899_0 is DEAD
2025-10-10T14:31:25.307935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb07a95-b5402323-5c204030-bb3e4899_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:25.307944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb07a95-b5402323-5c204030-bb3e4899_0] Write session will restart in 0.005098s
2025-10-10T14:31:25.307963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb07a95-b5402323-5c204030-bb3e4899_0] Write session: Do CDS request
2025-10-10T14:31:25.307970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb07a95-b5402323-5c204030-bb3e4899_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:25.313770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb07a95-b5402323-5c204030-bb3e4899_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.313835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:25.313846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 164
2025-10-10T14:31:25.313984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.314030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:25.314038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:25.314041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:25.314436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 164 sessionId:  describe result for acl check
2025-10-10T14:31:25.314471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:25.314480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:25.314482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:25.314488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600651863696686:3435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:25.314940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600651863696686:3435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:25.317348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600651863696686:3435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:25.319983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600651863696686:3435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:25.319995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600651863696686:3435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:25.319997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600651863696686:3435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:25.320002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:25.321300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:25.321952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:25.322105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:25.322116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:25.322127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:25.322180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:25.322315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600651081487571:3093]
2025-10-10T14:31:25.322881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:25.323156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:25.323197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:25.323492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:25.323540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.323546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.323547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.323548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.323549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.323550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.323552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.323553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.323554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.323555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.323556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.323557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.323558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.323563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.323575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.323579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.323583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.323587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.323591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.323595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.323598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.323602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.323606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.323610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.323613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.323617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.323623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.323631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.323643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.323649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.323657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.323662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.323666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.323675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.323683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.323689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.323697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.323702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.323706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.323711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.323716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.323721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.323730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.323735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.323739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.323748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.323752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.323757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.323765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.323770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.323774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.323778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.323820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:25.325861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:25.326261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:25.326273Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:25.326275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:25.326278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:25.326283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 163 [2:7559600651081487571:3093]
2025-10-10T14:31:25.326294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:25.326309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:25.326312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.326315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.326317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.326333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:25.326341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:25.326347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:25.326399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.326405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.326407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.326409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:25.326466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:25.326474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.326485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.326497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.326519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:25.326540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696864:3435], now have 1 active actors on pipe
2025-10-10T14:31:25.326548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696663:2438], now have 1 active actors on pipe
2025-10-10T14:31:25.326555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600651081487566:3093]
2025-10-10T14:31:25.326557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600651081487566:3093]
2025-10-10T14:31:25.326560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600651081487566:3093]
2025-10-10T14:31:25.326573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:25.326558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 163
2025-10-10T14:31:25.326589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:25.326572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 163
2025-10-10T14:31:25.326590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:25.326593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:25.326596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:25.326606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:25.326609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:25.326693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.326703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.326716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600651081487566:3093]
2025-10-10T14:31:25.326724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:25.326734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:25.326752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:25.326761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.326764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.326766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:25.326776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.326788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:25.326808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.326953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.326961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.326977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.327052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 164 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0
2025-10-10T14:31:25.327342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eb07a95-b5402323-5c204030-bb3e4899_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:25.329751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0] Write session: try to update token
2025-10-10T14:31:25.329765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:25.342672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId: src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:25.344473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:25.344492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:25.344495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:25.344497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:25.344506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600651081487566:3093]
2025-10-10T14:31:25.344510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600651081487566:3093]
2025-10-10T14:31:25.344516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600651081487566:3093]
2025-10-10T14:31:25.344564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:25.344565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:25.344571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:25.344575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:25.344576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.344578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:25.344713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:25.344969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:25.407919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600651863696884:3080]
2025-10-10T14:31:25.408208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 163, pipe: [1:7559600651863696884:3080]
2025-10-10T14:31:25.448268Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:25.448477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.448489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.448526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696884:3080], now have 1 active actors on pipe
2025-10-10T14:31:25.448704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:25.448755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:25.448767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:25.448767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600651863696884:3080]
2025-10-10T14:31:25.448785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:25.448833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 164 reason: error at write: Disconnected sessionId: src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0
2025-10-10T14:31:25.449021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 164 sessionId: src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0 is DEAD
2025-10-10T14:31:25.449205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:25.449217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0] Write session will restart in 0.007917s
2025-10-10T14:31:25.449241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0] Write session: Do CDS request
2025-10-10T14:31:25.449247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:25.458801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.458883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:25.458894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 165
2025-10-10T14:31:25.459033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.459071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:25.459079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:25.459083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:25.459407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 165 sessionId:  describe result for acl check
2025-10-10T14:31:25.459436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:25.459440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:25.459442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:25.459446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600651863696998:3439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:25.459847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600651863696998:3439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:25.461847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600651863696998:3439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:25.461909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:25.462832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:25.462984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:25.462993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:25.463004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:25.463048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:25.463089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600651081487788:3095]
2025-10-10T14:31:25.463665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:25.463712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600651863696998:3439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:25.463725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600651863696998:3439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:25.463728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600651863696998:3439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:25.463734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:25.463922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:25.463959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:25.464257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:25.464305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.464311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.464313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.464314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.464315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.464316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.464317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.464318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.464320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.464321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.464322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.464323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.464324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.464330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.464341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.464346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.464350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.464354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.464358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.464362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.464365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.464369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.464374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.464382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.464386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.464394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.464400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.464413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.464424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.464433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.464441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.464447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.464455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.464460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.464469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.464475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.464483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.464488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.464497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.464502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.464510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.464515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.464524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.464531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.464540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.464549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.464557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.464564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.464567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.464573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.464581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.464586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.464629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:25.466657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:25.467053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:25.467065Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:25.467066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:25.467069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:25.467072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 164 [2:7559600651081487788:3095]
2025-10-10T14:31:25.467080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:25.467095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:25.467102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.467104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.467106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.467120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:25.467131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:25.467138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:25.467178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.467186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.467188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.467190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:25.467238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:25.467244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.467251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.467257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.467266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:25.467286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863696885:2438], now have 1 active actors on pipe
2025-10-10T14:31:25.467288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697097:3439], now have 1 active actors on pipe
2025-10-10T14:31:25.467293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600651081487783:3095]
2025-10-10T14:31:25.467295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600651081487783:3095]
2025-10-10T14:31:25.467297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600651081487783:3095]
2025-10-10T14:31:25.467308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:25.467321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:25.467331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:25.467334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:25.467336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:25.467338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:25.467340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:25.467335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 164
2025-10-10T14:31:25.467335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 164
2025-10-10T14:31:25.467359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600651081487783:3095]
2025-10-10T14:31:25.467367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:25.467368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:25.467386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.467393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.467428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:25.467437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.467440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.467441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:25.467449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.467456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:25.467469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.467599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.467606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.467619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.467677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 165 partition: 0 MaxSeqNo: 40 sessionId: src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0
2025-10-10T14:31:25.467937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0cfc52f-40d767f7-6f67e09-70214bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:25.470592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0] Write session: try to update token
2025-10-10T14:31:25.470607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:25.483608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId: src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:25.485478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:25.485493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:25.485496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:25.485498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:25.485508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600651081487783:3095]
2025-10-10T14:31:25.485512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600651081487783:3095]
2025-10-10T14:31:25.485516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600651081487783:3095]
2025-10-10T14:31:25.485562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:25.485569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:25.485573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.485574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:25.485575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:25.485579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:25.485707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:25.485956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:25.548737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600651863697114:3080]
2025-10-10T14:31:25.549007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 164, pipe: [1:7559600651863697114:3080]
2025-10-10T14:31:25.589514Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:25.589830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.589841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.589877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697114:3080], now have 1 active actors on pipe
2025-10-10T14:31:25.590068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:25.590112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:25.590179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600651863697114:3080]
2025-10-10T14:31:25.590181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:25.590245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 165 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0
2025-10-10T14:31:25.590401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 165 sessionId: src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0 is DEAD
2025-10-10T14:31:25.590545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:25.590554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0] Write session will restart in 0.005614s
2025-10-10T14:31:25.590577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0] Write session: Do CDS request
2025-10-10T14:31:25.590585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:25.597760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.597828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:25.597839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 166
2025-10-10T14:31:25.597995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.598022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:25.598026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:25.598029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:25.598421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 166 sessionId:  describe result for acl check
2025-10-10T14:31:25.598445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:25.598450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:25.598451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:25.598456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600651863697152:3445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:25.598912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600651863697152:3445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:25.601229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600651863697152:3445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:25.603627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600651863697152:3445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:25.603638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600651863697152:3445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:25.603641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600651863697152:3445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:25.603647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:25.604027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:25.604974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:25.605145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:25.605156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:25.605168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:25.605212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:25.605249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600651081488010:3098]
2025-10-10T14:31:25.605762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:25.606029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:25.606062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:25.606300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:25.606350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.606355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.606356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.606357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.606357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.606358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.606358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.606359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.606360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.606360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.606361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.606361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.606362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.606366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.606375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.606377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.606380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.606383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.606387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.606391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.606394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.606397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.606402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.606406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.606410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.606414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.606421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.606427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.606432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.606435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.606438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.606441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.606443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.606446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.606450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.606454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.606456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.606459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.606462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.606465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.606467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.606470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.606473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.606476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.606478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.606481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.606485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.606490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.606493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.606498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.606503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.606509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.606539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:25.608699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:25.609083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:25.609096Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:25.609098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:25.609102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:25.609108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 165 [2:7559600651081488010:3098]
2025-10-10T14:31:25.609119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:25.609134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:25.609137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.609140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.609142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.609157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:25.609165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:25.609190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:25.609237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.609244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.609246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.609248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:25.609305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:25.609311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.609318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.609325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.609350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:25.609365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600651081488005:3098]
2025-10-10T14:31:25.609370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600651081488005:3098]
2025-10-10T14:31:25.609371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600651081488005:3098]
2025-10-10T14:31:25.609378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:25.609387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:25.609388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697115:2438], now have 1 active actors on pipe
2025-10-10T14:31:25.609390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:25.609391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697328:3445], now have 1 active actors on pipe
2025-10-10T14:31:25.609392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:25.609397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:25.609407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:25.609409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:25.609424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600651081488005:3098]
2025-10-10T14:31:25.609432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:25.609452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:25.609449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 165
2025-10-10T14:31:25.609468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 165
2025-10-10T14:31:25.609558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.609569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.609603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43287a6f-663b515a-39327aad-39ae295b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:25.609615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.609618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.609619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:25.609627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.609636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:25.609653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.609816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.609823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.609834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.609922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 166 partition: 0 MaxSeqNo: 40 sessionId: src_id|43287a6f-663b515a-39327aad-39ae295b_0
2025-10-10T14:31:25.610300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48bb69c-d4fe513c-9e258ce0-d524b17e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43287a6f-663b515a-39327aad-39ae295b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:25.612807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43287a6f-663b515a-39327aad-39ae295b_0] Write session: try to update token
2025-10-10T14:31:25.612821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43287a6f-663b515a-39327aad-39ae295b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:25.620183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:25.620200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:25.620211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600651081488005:3098]
2025-10-10T14:31:25.620255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:25.620266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:25.620433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:25.620574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:25.620711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:25.620972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:25.621154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:25.621197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:25.626139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId: src_id|43287a6f-663b515a-39327aad-39ae295b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:25.628365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:25.628544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.628564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.628602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:25.628683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:25.637288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:25.637307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:25.637309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:25.637311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:25.637320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600651081488005:3098]
2025-10-10T14:31:25.637324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600651081488005:3098]
2025-10-10T14:31:25.637326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600651081488005:3098]
2025-10-10T14:31:25.637389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:25.637394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:25.637396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.637398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:25.637399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:25.637403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:25.637522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:25.690550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600651863697341:3080]
2025-10-10T14:31:25.690810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 165, pipe: [1:7559600651863697341:3080]
2025-10-10T14:31:25.738971Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:25.745554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.745574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.745716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.745770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.745829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.745886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.745928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.745938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.746004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.746059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.746112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.746181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.746221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.746226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.746290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.746354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.746410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.746469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.746512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.746518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.746576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.746637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.746699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.746756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.746793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.746799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.746855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.746906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.746961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.747022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.747061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.747066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.747123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.747174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.747228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.747283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.747380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.747386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.747441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.747496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.747554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.747609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.747645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.747650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.747705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.747761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.747824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.747876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.747913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.747918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.747973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.748031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.748086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.748140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.748176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.748181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.748235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:25.748284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:25.748338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:25.748389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:25.748441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:25.748446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:25.748482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697341:3080], now have 1 active actors on pipe
2025-10-10T14:31:25.748789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:25.748804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600651863697341:3080]
2025-10-10T14:31:25.748830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:25.748832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:25.748859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 166 reason: error at write: Disconnected sessionId: src_id|43287a6f-663b515a-39327aad-39ae295b_0
2025-10-10T14:31:25.749069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 166 sessionId: src_id|43287a6f-663b515a-39327aad-39ae295b_0 is DEAD
2025-10-10T14:31:25.749218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43287a6f-663b515a-39327aad-39ae295b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:25.749231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43287a6f-663b515a-39327aad-39ae295b_0] Write session will restart in 0.009600s
2025-10-10T14:31:25.749267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43287a6f-663b515a-39327aad-39ae295b_0] Write session: Do CDS request
2025-10-10T14:31:25.749274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43287a6f-663b515a-39327aad-39ae295b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:25.749343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:25.759793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43287a6f-663b515a-39327aad-39ae295b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.759854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:25.759874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 167
2025-10-10T14:31:25.760018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.760051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:25.760060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:25.760066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:25.760389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 167 sessionId:  describe result for acl check
2025-10-10T14:31:25.760415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:25.760419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:25.760420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:25.760425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600651863697461:3449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:25.760931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600651863697461:3449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:25.762737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:25.763326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600651863697461:3449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:25.763586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:25.763764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:25.763777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:25.763789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:25.763848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:25.763888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600651081488231:3100]
2025-10-10T14:31:25.764424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:25.764680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:25.764710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:25.764927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:25.764964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.764968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.764969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.764969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.764970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.764971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.764971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.764972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.764973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.764973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.764974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.764975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.764975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.764979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.764986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.764988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.764990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.764992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.764995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.764997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.764999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.765001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.765003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.765005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.765007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.765009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.765013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.765019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.765023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.765027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.765029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.765032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.765035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.765038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.765041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.765043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.765046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.765049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.765052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.765055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.765057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.765060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.765063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.765066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.765069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.765072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.765074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.765077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.765080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.765084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.765086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.765089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.765113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:25.767072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600651863697461:3449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:25.767084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600651863697461:3449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:25.767087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600651863697461:3449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:25.767092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:25.767195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:25.767552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:25.767563Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:25.767564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:25.767566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:25.767570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 166 [2:7559600651081488231:3100]
2025-10-10T14:31:25.767579Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:25.767589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:25.767591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.767593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.767594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.767604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:25.767609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:25.767616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:25.767652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.767657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.767658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.767660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:25.767704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:25.767710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.767717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.767723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.767733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:25.767748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600651081488226:3100]
2025-10-10T14:31:25.767753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600651081488226:3100]
2025-10-10T14:31:25.767755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600651081488226:3100]
2025-10-10T14:31:25.767761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:25.767771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697342:2438], now have 1 active actors on pipe
2025-10-10T14:31:25.767770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:25.767773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697558:3449], now have 1 active actors on pipe
2025-10-10T14:31:25.767773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:25.767776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:25.767780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:25.767794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:25.767797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:25.767816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600651081488226:3100]
2025-10-10T14:31:25.767827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:25.767835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 166
2025-10-10T14:31:25.767839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 166
2025-10-10T14:31:25.767856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:25.767911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.767921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.767947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:25.767956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.767959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.767960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:25.767969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.767977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:25.767991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.768131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.768138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.768150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.768218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 167 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0
2025-10-10T14:31:25.768519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43287a6f-663b515a-39327aad-39ae295b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:25.771172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0] Write session: try to update token
2025-10-10T14:31:25.771189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:25.784998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId: src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:25.786988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:25.787012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:25.787016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:25.787017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:25.787027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600651081488226:3100]
2025-10-10T14:31:25.787032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600651081488226:3100]
2025-10-10T14:31:25.787036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600651081488226:3100]
2025-10-10T14:31:25.787086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:25.787091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:25.787093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:25.787097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:25.787100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.787102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:25.787283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:25.788183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:25.848750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600651863697566:3080]
2025-10-10T14:31:25.849044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 166, pipe: [1:7559600651863697566:3080]
2025-10-10T14:31:25.889481Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:25.889788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.889801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.889842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697566:3080], now have 1 active actors on pipe
2025-10-10T14:31:25.890070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:25.890091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600651863697566:3080]
2025-10-10T14:31:25.890097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:25.890122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:25.890192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 167 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0
2025-10-10T14:31:25.890369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 167 sessionId: src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0 is DEAD
2025-10-10T14:31:25.890536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:25.890546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0] Write session will restart in 0.008730s
2025-10-10T14:31:25.890564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0] Write session: Do CDS request
2025-10-10T14:31:25.890568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:25.900846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.901079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:25.901091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 168
2025-10-10T14:31:25.901218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:25.901245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:25.901250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:25.901255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:25.901624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 168 sessionId:  describe result for acl check
2025-10-10T14:31:25.901657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:25.901662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:25.901664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:25.901669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600651863697710:3453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:25.902086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600651863697710:3453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:25.903390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:25.903765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600651863697710:3453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:25.904300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:25.904468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:25.904481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:25.904493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:25.904545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:25.904584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600651081488453:3102]
2025-10-10T14:31:25.905168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:25.905498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:25.905549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:25.905882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:25.905947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.905954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.905955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.905957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.905958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.905959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.905960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.905961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.905962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.905964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.905965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.905966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.905967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.905973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.905985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.905989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.905993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.905997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.906002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.906005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.906009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.906018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.906023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.906027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.906035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.906039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.906046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.906060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:25.906069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.906079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:25.906058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600651863697710:3453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:25.906089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.906070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600651863697710:3453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:25.906073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600651863697710:3453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:25.906078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:25.906096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:25.906105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.906110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:25.906118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.906123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:25.906131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.906136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:25.906145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.906150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:25.906159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.906164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:25.906187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.906192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:25.906197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.906202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:25.906206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.906212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.906217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.906222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.906226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.906231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.906271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:25.908449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:25.908764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:25.908778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:25.908780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:25.908784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:25.908790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 167 [2:7559600651081488453:3102]
2025-10-10T14:31:25.908801Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:25.908821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:25.908828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.908831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.908833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.908850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:25.908863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:25.908875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:25.908931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.908942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.908944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.908946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:25.909113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 167
2025-10-10T14:31:25.909114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 167
2025-10-10T14:31:25.909136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:25.909147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.909160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:25.909178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:25.909196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:25.909217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697567:2438], now have 1 active actors on pipe
2025-10-10T14:31:25.909228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697782:3453], now have 1 active actors on pipe
2025-10-10T14:31:25.909246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.909256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.909274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600651081488448:3102]
2025-10-10T14:31:25.909281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600651081488448:3102]
2025-10-10T14:31:25.909283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600651081488448:3102]
2025-10-10T14:31:25.909298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:25.909311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:25.909316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:25.909320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:25.909322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:25.909350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:25.909358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:25.909377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:25.909389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:25.909397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:25.909400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:25.909410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:25.909423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:25.909449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600651081488448:3102]
2025-10-10T14:31:25.909462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:25.909471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:25.909479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.909625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:25.909637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:25.909657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:25.909720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 168 partition: 0 MaxSeqNo: 40 sessionId: src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0
2025-10-10T14:31:25.909991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee9ddb5-3cf540d5-1b068a49-737ecad7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:25.912712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0] Write session: try to update token
2025-10-10T14:31:25.912731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:25.926504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId: src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:25.926856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:25.926875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:25.926878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:25.926880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:25.926890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600651081488448:3102]
2025-10-10T14:31:25.926895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600651081488448:3102]
2025-10-10T14:31:25.926899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600651081488448:3102]
2025-10-10T14:31:25.926947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:25.926951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:25.926956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:25.926958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:25.926961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:25.926961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:25.927090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:25.928974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:25.990058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600651863697792:3080]
2025-10-10T14:31:25.990314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 167, pipe: [1:7559600651863697792:3080]
2025-10-10T14:31:26.032713Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:26.033038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.033053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.033100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600651863697792:3080], now have 1 active actors on pipe
2025-10-10T14:31:26.033259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:26.033322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:26.033349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600651863697792:3080]
2025-10-10T14:31:26.033369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:26.033447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 168 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0
2025-10-10T14:31:26.033629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 168 sessionId: src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0 is DEAD
2025-10-10T14:31:26.033752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:26.033761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0] Write session will restart in 0.006969s
2025-10-10T14:31:26.033779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0] Write session: Do CDS request
2025-10-10T14:31:26.033783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:26.041778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.041896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:26.041915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 169
2025-10-10T14:31:26.042058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.042094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:26.042105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:26.042109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:26.042552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 169 sessionId:  describe result for acl check
2025-10-10T14:31:26.042592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:26.042593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:26.042594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:26.042599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600656158665134:3457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:26.043094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600656158665134:3457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:26.045564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600656158665134:3457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:26.047910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600656158665134:3457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:26.047922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600656158665134:3457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:26.047925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600656158665134:3457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:26.047931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:26.048022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:26.048959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:26.049135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:26.049145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:26.049154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:26.049191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:26.049220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600655376455973:3104]
2025-10-10T14:31:26.049721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:26.050022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:26.050065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:26.050332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:26.050386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.050391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.050392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.050393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.050394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.050396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.050397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.050398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.050399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.050400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.050401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.050402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.050403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.050409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.050424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.050428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.050432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.050436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.050441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.050444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.050448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.050452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.050456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.050460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.050464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.050468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.050475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.050483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.050490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.050495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.050501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.050507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.050511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.050516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.050521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.050526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.050530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.050543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.050547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.050553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.050562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.050567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.050571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.050581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.050586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.050595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.050600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.050605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.050614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.050619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.050628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.050633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.050678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:26.053033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:26.053432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:26.053441Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:26.053443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:26.053447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:26.053452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 168 [2:7559600655376455973:3104]
2025-10-10T14:31:26.053465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:26.053483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:26.053486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.053489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.053492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.053509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:26.053515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:26.053528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:26.053586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.053595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.053597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.053599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:26.053668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:26.053675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.053687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.053702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.053712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:26.053733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665302:3457], now have 1 active actors on pipe
2025-10-10T14:31:26.053739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665089:2438], now have 1 active actors on pipe
2025-10-10T14:31:26.053746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600655376455967:3104]
2025-10-10T14:31:26.053747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600655376455967:3104]
2025-10-10T14:31:26.053749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600655376455967:3104]
2025-10-10T14:31:26.053758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:26.053772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:26.053781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:26.053784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:26.053785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:26.053786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:26.053787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:26.053805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600655376455967:3104]
2025-10-10T14:31:26.053811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:26.053813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:26.053813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 168
2025-10-10T14:31:26.053867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 168
2025-10-10T14:31:26.053983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.053990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.054013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:26.054023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.054026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.054027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:26.054035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.054050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:26.054062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.054237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.054246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.054260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.054338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 169 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0
2025-10-10T14:31:26.054748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aff33a5-ae8abf19-a0c62860-3846eb5b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:26.057872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0] Write session: try to update token
2025-10-10T14:31:26.057890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:26.071913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:26.071934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:26.071936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:26.071938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:26.071946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600655376455967:3104]
2025-10-10T14:31:26.071950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600655376455967:3104]
2025-10-10T14:31:26.071953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600655376455967:3104]
2025-10-10T14:31:26.071993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:26.072001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.072004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:26.072007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:26.072015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:26.072019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:26.072150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:26.072425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId: src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:26.074847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:26.133393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600656158665350:3080]
2025-10-10T14:31:26.133636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 168, pipe: [1:7559600656158665350:3080]
2025-10-10T14:31:26.174779Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:26.175009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.175023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.175062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665350:3080], now have 1 active actors on pipe
2025-10-10T14:31:26.175266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:26.175292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:26.175307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600656158665350:3080]
2025-10-10T14:31:26.175311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:26.175326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:26.175369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 169 reason: error at write: Disconnected sessionId: src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0
2025-10-10T14:31:26.175538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 169 sessionId: src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0 is DEAD
2025-10-10T14:31:26.175697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:26.175707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0] Write session will restart in 0.005023s
2025-10-10T14:31:26.175734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0] Write session: Do CDS request
2025-10-10T14:31:26.175739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:26.181802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.181879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:26.181892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 170
2025-10-10T14:31:26.182006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.182034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:26.182041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:26.182045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:26.182517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 170 sessionId:  describe result for acl check
2025-10-10T14:31:26.182544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:26.182549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:26.182550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:26.182554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600656158665367:3471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:26.183049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600656158665367:3471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:26.185930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600656158665367:3471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:26.188926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600656158665367:3471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:26.188939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600656158665367:3471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:26.188942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600656158665367:3471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:26.188949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:26.190031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:26.191029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:26.191196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:26.191206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:26.191217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:26.191263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:26.191304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600655376456246:3120]
2025-10-10T14:31:26.191880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:26.192141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:26.192178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:26.192482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:26.192534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.192540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.192541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.192542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.192543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.192544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.192545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.192546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.192547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.192548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.192549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.192550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.192552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.192556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.192569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.192574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.192577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.192581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.192584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.192587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.192591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.192594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.192598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.192601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.192605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.192608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.192615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.192623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.192629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.192635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.192639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.192644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.192648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.192653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.192658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.192667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.192672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.192677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.192682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.192691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.192696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.192705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.192710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.192720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.192724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.192729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.192736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.192741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.192744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.192748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.192756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.192760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.192797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:26.195089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:26.195505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:26.195516Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:26.195519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:26.195522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:26.195527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 169 [2:7559600655376456246:3120]
2025-10-10T14:31:26.195538Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:26.195555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:26.195558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.195562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.195564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.195579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:26.195591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:26.195604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:26.195658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.195667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.195669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.195671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:26.195736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:26.195743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.195754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.195772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.195788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:26.195815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665352:2438], now have 1 active actors on pipe
2025-10-10T14:31:26.195823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665564:3471], now have 1 active actors on pipe
2025-10-10T14:31:26.195831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600655376456241:3120]
2025-10-10T14:31:26.195838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600655376456241:3120]
2025-10-10T14:31:26.195840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600655376456241:3120]
2025-10-10T14:31:26.195853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:26.195872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:26.195853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 169
2025-10-10T14:31:26.195881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:26.195890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:26.195892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:26.195892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:26.195894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:26.195896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 169
2025-10-10T14:31:26.195924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600655376456241:3120]
2025-10-10T14:31:26.195934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:26.195941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:26.195952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.195960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.196008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:26.196019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.196027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.196029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:26.196041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.196056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:26.196074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.196273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.196283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.196300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.196394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 170 partition: 0 MaxSeqNo: 40 sessionId: src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0
2025-10-10T14:31:26.196761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ce3efaf-5adf2f0c-6e2a7487-90a082a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:26.199614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0] Write session: try to update token
2025-10-10T14:31:26.199631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:26.213117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId: src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:26.214208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:26.214226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:26.214229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:26.214231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:26.214239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600655376456241:3120]
2025-10-10T14:31:26.214242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600655376456241:3120]
2025-10-10T14:31:26.214245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600655376456241:3120]
2025-10-10T14:31:26.214287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:26.214288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:26.214293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:26.214295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:26.214297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.214298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:26.214428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:26.215594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:26.275270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600656158665581:3080]
2025-10-10T14:31:26.275531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 169, pipe: [1:7559600656158665581:3080]
2025-10-10T14:31:26.318987Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:26.319525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.319538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.319576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665581:3080], now have 1 active actors on pipe
2025-10-10T14:31:26.319742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:26.319825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600656158665581:3080]
2025-10-10T14:31:26.319831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:26.319868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:26.319941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0
2025-10-10T14:31:26.320125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 170 sessionId: src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0 is DEAD
2025-10-10T14:31:26.320413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:26.320419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0] Write session will restart in 0.005083s
2025-10-10T14:31:26.320437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0] Write session: Do CDS request
2025-10-10T14:31:26.320442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:26.326784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.326868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:26.326881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 171
2025-10-10T14:31:26.326976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.327002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:26.327009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:26.327012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:26.327406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 171 sessionId:  describe result for acl check
2025-10-10T14:31:26.327443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:26.327449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:26.327451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:26.327457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600656158665601:3477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:26.328012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600656158665601:3477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:26.330414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600656158665601:3477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:26.333121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600656158665601:3477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:26.333135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600656158665601:3477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:26.333138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600656158665601:3477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:26.333146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:26.333679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:26.334701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:26.334918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:26.334932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:26.334945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:26.335003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:26.335045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600655376456470:3122]
2025-10-10T14:31:26.335563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:26.335802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:26.335832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:26.336056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:26.336096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.336100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.336101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.336102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.336103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.336103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.336104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.336105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.336105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.336106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.336107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.336108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.336109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.336114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.336126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.336130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.336134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.336137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.336141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.336144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.336147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.336150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.336154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.336158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.336161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.336165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.336172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.336181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.336191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.336196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.336200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.336204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.336209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.336214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.336223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.336228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.336233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.336237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.336241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.336244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.336246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.336249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.336251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.336254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.336256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.336259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.336263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.336266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.336268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.336271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.336274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.336276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.336299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:26.338349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:26.338732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:26.338744Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:26.338747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:26.338751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:26.338756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 170 [2:7559600655376456470:3122]
2025-10-10T14:31:26.338767Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:26.338789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:26.338792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.338795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.338798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.338812Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:26.338825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:26.338832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:26.338886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.338892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.338894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.338896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:26.338947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:26.338954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.338961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.338967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.338977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:26.338994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665583:2438], now have 1 active actors on pipe
2025-10-10T14:31:26.339006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665797:3477], now have 1 active actors on pipe
2025-10-10T14:31:26.339013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600655376456465:3122]
2025-10-10T14:31:26.339015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600655376456465:3122]
2025-10-10T14:31:26.339017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600655376456465:3122]
2025-10-10T14:31:26.339030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:26.339043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:26.339046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:26.339049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:26.339051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:26.339058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:26.339061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:26.339080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600655376456465:3122]
2025-10-10T14:31:26.339083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:26.339084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:26.339041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 170
2025-10-10T14:31:26.339058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 170
2025-10-10T14:31:26.339107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.339115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.339277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:26.339288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.339291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.339293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:26.339300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.339309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:26.339328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.339492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.339499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.339514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.339596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 171 partition: 0 MaxSeqNo: 40 sessionId: src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0
2025-10-10T14:31:26.339956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91430ed6-e94bdd06-c45644c4-67f47db6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:26.342519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0] Write session: try to update token
2025-10-10T14:31:26.342535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:26.356044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId: src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:26.357285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:26.357299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:26.357302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:26.357303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:26.357311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600655376456465:3122]
2025-10-10T14:31:26.357314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600655376456465:3122]
2025-10-10T14:31:26.357319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600655376456465:3122]
2025-10-10T14:31:26.357370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:26.357372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:26.357378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.357379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:26.357382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:26.357389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:26.357498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:26.358592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:26.420167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600656158665810:3080]
2025-10-10T14:31:26.420438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 170, pipe: [1:7559600656158665810:3080]
2025-10-10T14:31:26.459321Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:26.459652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.459664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.459704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665810:3080], now have 1 active actors on pipe
2025-10-10T14:31:26.459913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:26.459926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:26.459938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600656158665810:3080]
2025-10-10T14:31:26.459970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:26.459975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 171 reason: error at write: Disconnected sessionId: src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0
2025-10-10T14:31:26.460165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 171 sessionId: src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0 is DEAD
2025-10-10T14:31:26.460187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:26.460312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:26.460318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0] Write session will restart in 0.006979s
2025-10-10T14:31:26.460338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0] Write session: Do CDS request
2025-10-10T14:31:26.460352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:26.468796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.468865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:26.468879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 172
2025-10-10T14:31:26.468983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.469017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:26.469027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:26.469031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:26.469487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 172 sessionId:  describe result for acl check
2025-10-10T14:31:26.469518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:26.469525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:26.469527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:26.469533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600656158665868:3481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:26.470101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600656158665868:3481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:26.472714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600656158665868:3481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:26.474321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:26.475200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:26.475324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600656158665868:3481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:26.475336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600656158665868:3481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:26.475340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600656158665868:3481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:26.475347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:26.475423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:26.475437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:26.475449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:26.475502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:26.475543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600655376456693:3124]
2025-10-10T14:31:26.476135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:26.476397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:26.476438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:26.476748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:26.476795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.476801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.476802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.476803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.476804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.476805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.476807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.476808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.476809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.476810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.476812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.476813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.476814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.476820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.476832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.476837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.476841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.476845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.476849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.476853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.476861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.476865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.476874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.476878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.476885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.476890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.476897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.476909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.476920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.476930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.476936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.476942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.476951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.476961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.476970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.476975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.476983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.476988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.476996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.477002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.477005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.477010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.477015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.477020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.477025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.477029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.477035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.477041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.477050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.477055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.477059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.477064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.477106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:26.479415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:26.479710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:26.479722Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:26.479724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:26.479727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:26.479734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 171 [2:7559600655376456693:3124]
2025-10-10T14:31:26.479745Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:26.479763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:26.479770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.479774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.479776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.479793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:26.479804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:26.479816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:26.479871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.479878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.479879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.479882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:26.479946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:26.479952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.479959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.479969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.479982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:26.480003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158665811:2438], now have 1 active actors on pipe
2025-10-10T14:31:26.480009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666029:3481], now have 1 active actors on pipe
2025-10-10T14:31:26.480014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600655376456688:3124]
2025-10-10T14:31:26.480019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600655376456688:3124]
2025-10-10T14:31:26.480021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600655376456688:3124]
2025-10-10T14:31:26.480034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:26.480050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:26.480054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:26.480058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:26.480060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:26.480070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:26.480079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:26.480042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 171
2025-10-10T14:31:26.480056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 171
2025-10-10T14:31:26.480119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.480128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.480143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600655376456688:3124]
2025-10-10T14:31:26.480155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:26.480175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:26.480191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44400918-2837bb32-483fa095-eae926c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:26.480203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.480210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.480212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:26.480223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.480236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:26.480261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.480372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.480380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.480393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.480473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 172 partition: 0 MaxSeqNo: 40 sessionId: src_id|44400918-2837bb32-483fa095-eae926c0_0
2025-10-10T14:31:26.480805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a6a274d-16aa0ec7-5c54e181-46df3da1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44400918-2837bb32-483fa095-eae926c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:26.483241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44400918-2837bb32-483fa095-eae926c0_0] Write session: try to update token
2025-10-10T14:31:26.483255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44400918-2837bb32-483fa095-eae926c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:26.496303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId: src_id|44400918-2837bb32-483fa095-eae926c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:26.498683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:26.498700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:26.498703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:26.498705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:26.498714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600655376456688:3124]
2025-10-10T14:31:26.498719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600655376456688:3124]
2025-10-10T14:31:26.498723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600655376456688:3124]
2025-10-10T14:31:26.498753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:26.498773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:26.498774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:26.498780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:26.498781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.498783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:26.498783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:26.498913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:26.559927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600656158666047:3080]
2025-10-10T14:31:26.560144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 171, pipe: [1:7559600656158666047:3080]
2025-10-10T14:31:26.604262Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:26.604616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.604629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.604665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666047:3080], now have 1 active actors on pipe
2025-10-10T14:31:26.604860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:26.604866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:26.604886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:26.604891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:26.604903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600656158666047:3080]
2025-10-10T14:31:26.604981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 172 reason: error at write: Disconnected sessionId: src_id|44400918-2837bb32-483fa095-eae926c0_0
2025-10-10T14:31:26.605178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 172 sessionId: src_id|44400918-2837bb32-483fa095-eae926c0_0 is DEAD
2025-10-10T14:31:26.605309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44400918-2837bb32-483fa095-eae926c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:26.605318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44400918-2837bb32-483fa095-eae926c0_0] Write session will restart in 0.005042s
2025-10-10T14:31:26.605356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44400918-2837bb32-483fa095-eae926c0_0] Write session: Do CDS request
2025-10-10T14:31:26.605366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44400918-2837bb32-483fa095-eae926c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:26.611771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44400918-2837bb32-483fa095-eae926c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.611852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:26.611864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 173
2025-10-10T14:31:26.611978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.612006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:26.612014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:26.612017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:26.612402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 173 sessionId:  describe result for acl check
2025-10-10T14:31:26.612448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:26.612458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:26.612462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:26.612468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600656158666066:3487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:26.613046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600656158666066:3487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:26.615472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600656158666066:3487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:26.618078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600656158666066:3487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:26.618093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600656158666066:3487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:26.618097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600656158666066:3487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:26.618105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:26.619631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:26.620477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:26.620636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:26.620646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:26.620655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:26.620693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:26.620728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600655376456922:3127]
2025-10-10T14:31:26.621160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:26.621407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:26.621441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:26.621649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:26.621683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.621687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.621688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.621689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.621689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.621690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.621691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.621691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.621692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.621693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.621693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.621694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.621695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.621698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.621707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.621710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.621712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.621714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.621717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.621719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.621721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.621724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.621726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.621728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.621731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.621733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.621739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.621745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.621749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.621753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.621755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.621758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.621761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.621764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.621766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.621769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.621772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.621775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.621777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.621781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.621784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.621786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.621789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.621792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.621795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.621798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.621800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.621803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.621805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.621808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.621811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.621815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.621852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:26.623962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:26.624429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:26.624444Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:26.624447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:26.624450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:26.624457Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 172 [2:7559600655376456922:3127]
2025-10-10T14:31:26.624467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:26.624487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:26.624495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.624498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.624501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.624517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:26.624529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:26.624541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:26.624598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.624608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.624610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.624612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:26.624675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:26.624683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.624694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.624708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.624729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:26.624755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666051:2438], now have 1 active actors on pipe
2025-10-10T14:31:26.624763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666246:3487], now have 1 active actors on pipe
2025-10-10T14:31:26.624770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600655376456917:3127]
2025-10-10T14:31:26.624763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 172
2025-10-10T14:31:26.624777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600655376456917:3127]
2025-10-10T14:31:26.624782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 172
2025-10-10T14:31:26.624778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600655376456917:3127]
2025-10-10T14:31:26.624795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:26.624803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:26.624806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:26.624808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:26.624809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:26.624826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:26.624833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:26.624870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.624879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.624893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600655376456917:3127]
2025-10-10T14:31:26.624905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:26.624915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:26.624938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:26.624952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.624959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.624962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:26.624972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.624988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:26.625021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.625161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.625171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.625189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.625260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 173 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0
2025-10-10T14:31:26.625590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44400918-2837bb32-483fa095-eae926c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:26.628217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0] Write session: try to update token
2025-10-10T14:31:26.628232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:26.641709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId: src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:26.643373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:26.643392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:26.643396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:26.643398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:26.643407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600655376456917:3127]
2025-10-10T14:31:26.643412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600655376456917:3127]
2025-10-10T14:31:26.643415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600655376456917:3127]
2025-10-10T14:31:26.643464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:26.643468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:26.643475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.643478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:26.643481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:26.643485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:26.643608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:26.644233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:26.704828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600656158666281:3080]
2025-10-10T14:31:26.705084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 172, pipe: [1:7559600656158666281:3080]
2025-10-10T14:31:26.747560Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:26.747873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.747886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.747924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666281:3080], now have 1 active actors on pipe
2025-10-10T14:31:26.748090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:26.748160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600656158666281:3080]
2025-10-10T14:31:26.748189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:26.748189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:26.748191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:26.748247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 173 reason: error at write: Disconnected sessionId: src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0
2025-10-10T14:31:26.748443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 173 sessionId: src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0 is DEAD
2025-10-10T14:31:26.748602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:26.748625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0] Write session will restart in 0.009628s
2025-10-10T14:31:26.748650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0] Write session: Do CDS request
2025-10-10T14:31:26.748657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:26.759852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.759926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:26.759949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 174
2025-10-10T14:31:26.760075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.760108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:26.760118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:26.760121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:26.760687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 174 sessionId:  describe result for acl check
2025-10-10T14:31:26.760728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:26.760735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:26.760737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:26.760743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600656158666411:3491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:26.761297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600656158666411:3491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:26.762953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:26.763167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600656158666411:3491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:26.763918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:26.764089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:26.764102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:26.764113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:26.764167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:26.764206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600655376457148:3129]
2025-10-10T14:31:26.764644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:26.764905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:26.764945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:26.765265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:26.765267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600656158666411:3491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:26.765282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600656158666411:3491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:26.765286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600656158666411:3491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:26.765292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:26.765349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.765355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.765356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.765357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.765358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.765359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.765359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.765360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.765361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.765362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.765363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.765364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.765365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.765370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.765380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.765383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.765386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.765389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.765393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.765396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.765399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.765402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.765406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.765409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.765412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.765415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.765422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.765430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.765436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.765441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.765444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.765449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.765454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.765459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.765463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.765468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.765473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.765478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.765482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.765487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.765491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.765500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.765504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.765511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.765515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.765522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.765526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.765533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.765537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.765541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.765547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.765550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.765573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:26.767584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:26.768018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:26.768031Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:26.768033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:26.768036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:26.768041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 173 [2:7559600655376457148:3129]
2025-10-10T14:31:26.768051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:26.768065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:26.768072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.768075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.768077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.768090Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:26.768103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:26.768111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:26.768158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.768164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.768165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.768168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:26.768221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:26.768229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.768239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.768252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.768272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:26.768292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666282:2438], now have 1 active actors on pipe
2025-10-10T14:31:26.768299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666503:3491], now have 1 active actors on pipe
2025-10-10T14:31:26.768306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600655376457143:3129]
2025-10-10T14:31:26.768311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600655376457143:3129]
2025-10-10T14:31:26.768313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600655376457143:3129]
2025-10-10T14:31:26.768326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:26.768342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:26.768349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:26.768352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:26.768354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:26.768361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:26.768363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:26.768356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 173
2025-10-10T14:31:26.768370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 173
2025-10-10T14:31:26.768382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600655376457143:3129]
2025-10-10T14:31:26.768388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:26.768390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:26.768411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.768417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.768443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:26.768452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.768454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.768455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:26.768463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.768471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:26.768492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.768621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.768628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.768640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.768727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 174 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0
2025-10-10T14:31:26.769017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8df47b-675c6a53-27e79014-1cfdbaa7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:26.771679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0] Write session: try to update token
2025-10-10T14:31:26.771693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:26.785777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId: src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:26.786539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:26.786566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:26.786569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:26.786571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:26.786581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600655376457143:3129]
2025-10-10T14:31:26.786586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600655376457143:3129]
2025-10-10T14:31:26.786590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600655376457143:3129]
2025-10-10T14:31:26.786636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:26.786646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:26.786651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:26.786655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.786656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:26.786657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:26.786839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:26.788630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:26.848160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600656158666513:3080]
2025-10-10T14:31:26.848449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 173, pipe: [1:7559600656158666513:3080]
2025-10-10T14:31:26.894223Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:26.894628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.894642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.894680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666513:3080], now have 1 active actors on pipe
2025-10-10T14:31:26.894856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:26.894892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:26.894926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600656158666513:3080]
2025-10-10T14:31:26.894942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:26.895011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 174 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0
2025-10-10T14:31:26.895217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 174 sessionId: src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0 is DEAD
2025-10-10T14:31:26.895371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:26.895381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0] Write session will restart in 0.005819s
2025-10-10T14:31:26.895400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0] Write session: Do CDS request
2025-10-10T14:31:26.895406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:26.902726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.902845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:26.902855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 175
2025-10-10T14:31:26.902965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:26.903010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:26.903018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:26.903021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:26.903391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 175 sessionId:  describe result for acl check
2025-10-10T14:31:26.903415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:26.903420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:26.903421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:26.903425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600656158666547:3495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:26.903874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600656158666547:3495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:26.906058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600656158666547:3495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:26.908599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600656158666547:3495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:26.908612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600656158666547:3495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:26.908615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600656158666547:3495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:26.908622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:26.909566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:26.910406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:26.910544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:26.910556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:26.910567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:26.910611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:26.910642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600655376457377:3131]
2025-10-10T14:31:26.911000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:26.911258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:26.911296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:26.911513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:26.911550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.911556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.911557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.911557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.911558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.911558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.911559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.911560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.911560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.911561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.911561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.911562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.911562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.911566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.911574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.911576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.911579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.911581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.911583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.911586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.911588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.911590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.911593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.911595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.911597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.911599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.911604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.911610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:26.911614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.911618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:26.911620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.911624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:26.911626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.911629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:26.911632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.911635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:26.911637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.911641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:26.911644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.911647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:26.911649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.911652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:26.911655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.911658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:26.911660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.911663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:26.911665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.911669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.911672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.911675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.911677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.911680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.911717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:26.913744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:26.914089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:26.914103Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:26.914105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:26.914108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:26.914114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 174 [2:7559600655376457377:3131]
2025-10-10T14:31:26.914125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:26.914144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:26.914151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.914154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.914156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.914172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:26.914195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:26.914207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:26.914259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.914264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.914265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.914267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:26.914327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:26.914335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.914346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:26.914361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:26.914382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:26.914401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666731:3495], now have 1 active actors on pipe
2025-10-10T14:31:26.914409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666514:2438], now have 1 active actors on pipe
2025-10-10T14:31:26.914415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600655376457372:3131]
2025-10-10T14:31:26.914422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600655376457372:3131]
2025-10-10T14:31:26.914423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600655376457372:3131]
2025-10-10T14:31:26.914437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:26.914455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:26.914439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 174
2025-10-10T14:31:26.914456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:26.914454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 174
2025-10-10T14:31:26.914459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:26.914461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:26.914477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:26.914480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:26.914512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.914521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.914539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600655376457372:3131]
2025-10-10T14:31:26.914551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:26.914572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:26.914582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:26.914592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:26.914600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:26.914603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:26.914613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:26.914628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:26.914763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.914951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:26.914960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:26.914977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:26.915068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 175 partition: 0 MaxSeqNo: 40 sessionId: src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0
2025-10-10T14:31:26.915342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0155d1e-b8e40878-49c16c7d-890b94bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:26.917766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0] Write session: try to update token
2025-10-10T14:31:26.917781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:26.930473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId: src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:26.931947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:26.931969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:26.931972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:26.931974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:26.931984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600655376457372:3131]
2025-10-10T14:31:26.931988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600655376457372:3131]
2025-10-10T14:31:26.931992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600655376457372:3131]
2025-10-10T14:31:26.932032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:26.932041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:26.932043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:26.932042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:26.932048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:26.932052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:26.932162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:26.932777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:26.995145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600656158666746:3080]
2025-10-10T14:31:26.995433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 174, pipe: [1:7559600656158666746:3080]
2025-10-10T14:31:27.037705Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:27.038046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.038059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.038098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600656158666746:3080], now have 1 active actors on pipe
2025-10-10T14:31:27.038283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:27.038326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:27.038326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600656158666746:3080]
2025-10-10T14:31:27.038342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:27.038347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:27.038413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 175 reason: error at write: Disconnected sessionId: src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0
2025-10-10T14:31:27.038619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 175 sessionId: src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0 is DEAD
2025-10-10T14:31:27.038775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:27.038786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0] Write session will restart in 0.005761s
2025-10-10T14:31:27.038806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0] Write session: Do CDS request
2025-10-10T14:31:27.038814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:27.045859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.045925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:27.045940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 176
2025-10-10T14:31:27.046052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.046084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:27.046095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:27.046099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:27.046521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 176 sessionId:  describe result for acl check
2025-10-10T14:31:27.046553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:27.046557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:27.046560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:27.046564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600660453634058:3499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:27.047055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600660453634058:3499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:27.049983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600660453634058:3499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:27.052701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600660453634058:3499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:27.052716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600660453634058:3499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:27.052720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600660453634058:3499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:27.052728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:27.054235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:27.055409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:27.055578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:27.055589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:27.055600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:27.055647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:27.055685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600659671424902:3133]
2025-10-10T14:31:27.056265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:27.056543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:27.056584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:27.056891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:27.056942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.056948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.056950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.056951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.056952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.056953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.056954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.056956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.056957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.056958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.056959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.056961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.056962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.056968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.056981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.056985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.056989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.056993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.056997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.057001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.057005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.057009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.057013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.057017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.057027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.057031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.057039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.057048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.057059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.057064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.057069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.057075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.057083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.057088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.057093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.057103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.057111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.057117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.057126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.057131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.057135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.057141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.057149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.057154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.057159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.057168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.057174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.057183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.057187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.057192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.057196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.057202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.057241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:27.059438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:27.059983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:27.059998Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:27.060000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:27.060004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:27.060009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 175 [2:7559600659671424902:3133]
2025-10-10T14:31:27.060020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:27.060037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:27.060046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.060049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.060056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.060072Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:27.060086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:27.060097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:27.060153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.060159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.060160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.060163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:27.060225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:27.060232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.060243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.060259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.060281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:27.060306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634255:3499], now have 1 active actors on pipe
2025-10-10T14:31:27.060313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634043:2438], now have 1 active actors on pipe
2025-10-10T14:31:27.060320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600659671424897:3133]
2025-10-10T14:31:27.060322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600659671424897:3133]
2025-10-10T14:31:27.060324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600659671424897:3133]
2025-10-10T14:31:27.060338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:27.060328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 175
2025-10-10T14:31:27.060351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:27.060355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:27.060358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:27.060360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:27.060371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:27.060374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:27.060400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600659671424897:3133]
2025-10-10T14:31:27.060407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:27.060408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:27.060387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 175
2025-10-10T14:31:27.060436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.060445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.060475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|966b5bab-ce464a42-f2f77482-d294efd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:27.060486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.060490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.060492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:27.060503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.060517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:27.060534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.060653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.060661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.060676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.060751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 176 partition: 0 MaxSeqNo: 40 sessionId: src_id|966b5bab-ce464a42-f2f77482-d294efd0_0
2025-10-10T14:31:27.061093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75368a0-6d97fdee-d5e82c51-f3967e16_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|966b5bab-ce464a42-f2f77482-d294efd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:27.063560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|966b5bab-ce464a42-f2f77482-d294efd0_0] Write session: try to update token
2025-10-10T14:31:27.063574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|966b5bab-ce464a42-f2f77482-d294efd0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:27.076809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId: src_id|966b5bab-ce464a42-f2f77482-d294efd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:27.078595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:27.078616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:27.078619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:27.078621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:27.078631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600659671424897:3133]
2025-10-10T14:31:27.078636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600659671424897:3133]
2025-10-10T14:31:27.078639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600659671424897:3133]
2025-10-10T14:31:27.078680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:27.078684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:27.078689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:27.078689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.078691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:27.078692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:27.078821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:27.079356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:27.138490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600660453634301:3080]
2025-10-10T14:31:27.138795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 175, pipe: [1:7559600660453634301:3080]
2025-10-10T14:31:27.183482Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:27.183859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.183872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.183911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634301:3080], now have 1 active actors on pipe
2025-10-10T14:31:27.184091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:27.184164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600660453634301:3080]
2025-10-10T14:31:27.184176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:27.184180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:27.184190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:27.184244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 176 reason: error at write: Disconnected sessionId: src_id|966b5bab-ce464a42-f2f77482-d294efd0_0
2025-10-10T14:31:27.184458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 176 sessionId: src_id|966b5bab-ce464a42-f2f77482-d294efd0_0 is DEAD
2025-10-10T14:31:27.184636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|966b5bab-ce464a42-f2f77482-d294efd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:27.184647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|966b5bab-ce464a42-f2f77482-d294efd0_0] Write session will restart in 0.006138s
2025-10-10T14:31:27.184672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|966b5bab-ce464a42-f2f77482-d294efd0_0] Write session: Do CDS request
2025-10-10T14:31:27.184678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|966b5bab-ce464a42-f2f77482-d294efd0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:27.191785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|966b5bab-ce464a42-f2f77482-d294efd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.191885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:27.191901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 177
2025-10-10T14:31:27.192010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.192045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:27.192056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:27.192061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:27.192500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 177 sessionId:  describe result for acl check
2025-10-10T14:31:27.192537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:27.192544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:27.192545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:27.192551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600660453634337:3513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:27.193048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600660453634337:3513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:27.195670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600660453634337:3513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:27.198590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600660453634337:3513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:27.198603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600660453634337:3513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:27.198606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600660453634337:3513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:27.198614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:27.199411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:27.200309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:27.200477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:27.200487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:27.200496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:27.200538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:27.200568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600659671425183:3149]
2025-10-10T14:31:27.200952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:27.201180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:27.201210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:27.201421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:27.201456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.201460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.201461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.201462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.201462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.201463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.201464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.201464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.201465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.201465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.201466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.201467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.201467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.201471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.201479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.201482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.201484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.201486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.201489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.201491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.201493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.201495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.201498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.201500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.201502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.201505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.201509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.201514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.201520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.201523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.201526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.201528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.201531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.201534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.201537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.201540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.201543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.201545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.201548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.201551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.201554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.201557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.201559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.201566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.201569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.201572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.201575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.201578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.201584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.201587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.201589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.201592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.201615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:27.203685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:27.204147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:27.204164Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:27.204166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:27.204170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:27.204175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 176 [2:7559600659671425183:3149]
2025-10-10T14:31:27.204191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:27.204210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:27.204218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.204221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.204224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.204242Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:27.204254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:27.204261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:27.204318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.204325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.204327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.204329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:27.204392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:27.204399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.204412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.204423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.204446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:27.204471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634532:3513], now have 1 active actors on pipe
2025-10-10T14:31:27.204478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634313:2438], now have 1 active actors on pipe
2025-10-10T14:31:27.204486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600659671425178:3149]
2025-10-10T14:31:27.204488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600659671425178:3149]
2025-10-10T14:31:27.204490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600659671425178:3149]
2025-10-10T14:31:27.204499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 176
2025-10-10T14:31:27.204507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 176
2025-10-10T14:31:27.204505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:27.204525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:27.204540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:27.204541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:27.204544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:27.204549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:27.204551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:27.204567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600659671425178:3149]
2025-10-10T14:31:27.204576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:27.204578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:27.204603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.204612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.204654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|116b5251-7befffb-2b3376bf-aa5dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:27.204666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.204674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.204676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:27.204691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.204706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:27.204733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.204878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.204888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.204905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.204978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 177 partition: 0 MaxSeqNo: 40 sessionId: src_id|116b5251-7befffb-2b3376bf-aa5dec_0
2025-10-10T14:31:27.205318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|966b5bab-ce464a42-f2f77482-d294efd0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|116b5251-7befffb-2b3376bf-aa5dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:27.207828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116b5251-7befffb-2b3376bf-aa5dec_0] Write session: try to update token
2025-10-10T14:31:27.207842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116b5251-7befffb-2b3376bf-aa5dec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:27.220885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId: src_id|116b5251-7befffb-2b3376bf-aa5dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:27.222775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:27.222794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:27.222797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:27.222799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:27.222810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600659671425178:3149]
2025-10-10T14:31:27.222814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600659671425178:3149]
2025-10-10T14:31:27.222818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600659671425178:3149]
2025-10-10T14:31:27.222866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:27.222868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:27.222873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:27.222877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:27.222880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.222882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:27.223019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:27.223387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:27.284417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600660453634546:3080]
2025-10-10T14:31:27.284681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 176, pipe: [1:7559600660453634546:3080]
2025-10-10T14:31:27.326740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:27.327175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.327189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.327226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634546:3080], now have 1 active actors on pipe
2025-10-10T14:31:27.327374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:27.327406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600660453634546:3080]
2025-10-10T14:31:27.327420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:27.327423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:27.327433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:27.327484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 177 reason: error at write: Disconnected sessionId: src_id|116b5251-7befffb-2b3376bf-aa5dec_0
2025-10-10T14:31:27.327699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 177 sessionId: src_id|116b5251-7befffb-2b3376bf-aa5dec_0 is DEAD
2025-10-10T14:31:27.327847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116b5251-7befffb-2b3376bf-aa5dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:27.327858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116b5251-7befffb-2b3376bf-aa5dec_0] Write session will restart in 0.007382s
2025-10-10T14:31:27.327889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116b5251-7befffb-2b3376bf-aa5dec_0] Write session: Do CDS request
2025-10-10T14:31:27.327897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116b5251-7befffb-2b3376bf-aa5dec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:27.336784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116b5251-7befffb-2b3376bf-aa5dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.336892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:27.336905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 178
2025-10-10T14:31:27.337026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.337061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:27.337072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:27.337081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:27.337542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 178 sessionId:  describe result for acl check
2025-10-10T14:31:27.337579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:27.337586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:27.337588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:27.337595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600660453634641:3517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:27.338140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600660453634641:3517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:27.340348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600660453634641:3517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:27.341275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:27.342330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:27.342519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:27.342530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:27.342543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:27.342594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:27.342634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600659671425414:3151]
2025-10-10T14:31:27.342764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600660453634641:3517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:27.342776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600660453634641:3517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:27.342779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600660453634641:3517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:27.342785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:27.343227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:27.343515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:27.343561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:27.343871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:27.343925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.343930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.343931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.343933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.343934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.343935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.343936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.343937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.343938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.343940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.343941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.343942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.343943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.343949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.343962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.343966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.343970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.343974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.343978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.343982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.343985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.343989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.343993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.343997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.344001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.344005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.344012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.344021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.344027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.344032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.344036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.344042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.344053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.344058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.344062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.344072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.344076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.344086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.344090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.344096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.344100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.344104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.344113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.344118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.344122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.344132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.344137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.344147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.344151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.344156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.344165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.344170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.344211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:27.346292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:27.346677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:27.346689Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:27.346692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:27.346695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:27.346700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 177 [2:7559600659671425414:3151]
2025-10-10T14:31:27.346712Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:27.346731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:27.346740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.346743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.346746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.346760Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:27.346767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:27.346774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:27.346826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.346832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.346834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.346836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:27.346898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:27.346905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.346911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.346918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.346927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:27.346945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634548:2438], now have 1 active actors on pipe
2025-10-10T14:31:27.346953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634770:3517], now have 1 active actors on pipe
2025-10-10T14:31:27.346961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600659671425409:3151]
2025-10-10T14:31:27.346963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600659671425409:3151]
2025-10-10T14:31:27.346965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600659671425409:3151]
2025-10-10T14:31:27.346978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:27.346992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:27.346999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:27.347002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:27.347004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:27.347006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:27.347008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:27.347009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 177
2025-10-10T14:31:27.347024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600659671425409:3151]
2025-10-10T14:31:27.347032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:27.347017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 177
2025-10-10T14:31:27.347041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:27.347061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.347068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.347095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:27.347109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.347112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.347113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:27.347122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.347131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:27.347147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.347300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.347310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.347326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.347412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 178 partition: 0 MaxSeqNo: 40 sessionId: src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0
2025-10-10T14:31:27.347773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116b5251-7befffb-2b3376bf-aa5dec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:27.350312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0] Write session: try to update token
2025-10-10T14:31:27.350328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:27.363887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId: src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:27.366349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:27.366369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:27.366372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:27.366374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:27.366384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600659671425409:3151]
2025-10-10T14:31:27.366389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600659671425409:3151]
2025-10-10T14:31:27.366393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600659671425409:3151]
2025-10-10T14:31:27.366442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:27.366442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:27.366448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:27.366452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:27.366453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.366456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:27.366453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:27.366590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:27.427773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600660453634782:3080]
2025-10-10T14:31:27.428044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 177, pipe: [1:7559600660453634782:3080]
2025-10-10T14:31:27.474025Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:27.474632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.474649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.474696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634782:3080], now have 1 active actors on pipe
2025-10-10T14:31:27.474909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:27.474967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:27.474988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:27.475015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600660453634782:3080]
2025-10-10T14:31:27.475051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 178 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0
2025-10-10T14:31:27.475242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 178 sessionId: src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0 is DEAD
2025-10-10T14:31:27.475372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:27.475383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0] Write session will restart in 0.007368s
2025-10-10T14:31:27.475414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0] Write session: Do CDS request
2025-10-10T14:31:27.475419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:27.483799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.483872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:27.483885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 179
2025-10-10T14:31:27.484037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.484069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:27.484077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:27.484080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:27.484523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 179 sessionId:  describe result for acl check
2025-10-10T14:31:27.484558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:27.484566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:27.484568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:27.484574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600660453634838:3521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:27.485140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600660453634838:3521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:27.487323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600660453634838:3521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:27.489584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:27.489667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600660453634838:3521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:27.489681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600660453634838:3521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:27.489683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600660453634838:3521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:27.489689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:27.490790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:27.490969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:27.490980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:27.490991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:27.491041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:27.491079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600659671425648:3153]
2025-10-10T14:31:27.491510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:27.491843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:27.491893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:27.492172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:27.492226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.492231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.492232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.492233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.492234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.492235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.492237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.492238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.492239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.492240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.492241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.492242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.492243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.492248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.492262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.492266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.492270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.492274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.492279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.492282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.492286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.492290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.492297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.492305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.492309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.492317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.492324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.492333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.492338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.492341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.492347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.492351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.492353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.492356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.492360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.492366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.492368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.492371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.492374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.492377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.492383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.492386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.492388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.492391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.492393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.492398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.492400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.492403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.492407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.492410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.492413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.492417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.492439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:27.494642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:27.495091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:27.495104Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:27.495106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:27.495109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:27.495115Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 178 [2:7559600659671425648:3153]
2025-10-10T14:31:27.495127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:27.495143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:27.495153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.495156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.495158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.495172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:27.495179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:27.495186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:27.495238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.495245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.495246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.495249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:27.495312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:27.495320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.495330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.495341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.495361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:27.495390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635008:3521], now have 1 active actors on pipe
2025-10-10T14:31:27.495394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453634784:2438], now have 1 active actors on pipe
2025-10-10T14:31:27.495401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600659671425641:3153]
2025-10-10T14:31:27.495404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600659671425641:3153]
2025-10-10T14:31:27.495411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600659671425641:3153]
2025-10-10T14:31:27.495424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:27.495442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:27.495452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:27.495455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:27.495457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:27.495463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:27.495468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:27.495458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 178
2025-10-10T14:31:27.495465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 178
2025-10-10T14:31:27.495489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600659671425641:3153]
2025-10-10T14:31:27.495497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:27.495499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:27.495514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.495524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.495574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54c1b657-d0764789-2b791f33-f060517d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:27.495585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.495589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.495591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:27.495601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.495617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:27.495640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.495777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.495787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.495800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.495907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 179 partition: 0 MaxSeqNo: 40 sessionId: src_id|54c1b657-d0764789-2b791f33-f060517d_0
2025-10-10T14:31:27.496241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5137f7-228cf6de-5654ccda-a4c9f865_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|54c1b657-d0764789-2b791f33-f060517d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:27.498775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c1b657-d0764789-2b791f33-f060517d_0] Write session: try to update token
2025-10-10T14:31:27.498792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c1b657-d0764789-2b791f33-f060517d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:27.511993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId: src_id|54c1b657-d0764789-2b791f33-f060517d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:27.513662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:27.513684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:27.513687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:27.513689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:27.513698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600659671425641:3153]
2025-10-10T14:31:27.513702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600659671425641:3153]
2025-10-10T14:31:27.513707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600659671425641:3153]
2025-10-10T14:31:27.513757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:27.513764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.513766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:27.513775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:27.513795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:27.513800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:27.513896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:27.514413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:27.575231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600660453635026:3080]
2025-10-10T14:31:27.575522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 178, pipe: [1:7559600660453635026:3080]
2025-10-10T14:31:27.618487Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:27.618856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.618869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.618906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635026:3080], now have 1 active actors on pipe
2025-10-10T14:31:27.619090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:27.619121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600660453635026:3080]
2025-10-10T14:31:27.619138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:27.619152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:27.619226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 179 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54c1b657-d0764789-2b791f33-f060517d_0
2025-10-10T14:31:27.619400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 179 sessionId: src_id|54c1b657-d0764789-2b791f33-f060517d_0 is DEAD
2025-10-10T14:31:27.619579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c1b657-d0764789-2b791f33-f060517d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:27.619589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c1b657-d0764789-2b791f33-f060517d_0] Write session will restart in 0.008984s
2025-10-10T14:31:27.619616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c1b657-d0764789-2b791f33-f060517d_0] Write session: Do CDS request
2025-10-10T14:31:27.619622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c1b657-d0764789-2b791f33-f060517d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:27.629886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c1b657-d0764789-2b791f33-f060517d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.629931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:27.629946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 180
2025-10-10T14:31:27.630109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.630141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:27.630153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:27.630160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:27.630575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 180 sessionId:  describe result for acl check
2025-10-10T14:31:27.630602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:27.630603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:27.630605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:27.630623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600660453635164:3527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:27.631069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600660453635164:3527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:27.632788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:27.632875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600660453635164:3527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:27.633691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:27.633878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:27.633890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:27.633902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:27.633957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:27.633996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600659671425881:3156]
2025-10-10T14:31:27.634595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:27.634835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:27.634878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:27.635069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600660453635164:3527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:27.635080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600660453635164:3527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:27.635083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600660453635164:3527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:27.635087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:27.635180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:27.635232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.635238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.635239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.635240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.635242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.635243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.635244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.635245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.635247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.635248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.635249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.635250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.635251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.635257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.635269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.635273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.635278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.635286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.635290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.635298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.635307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.635311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.635315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.635320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.635324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.635328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.635334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.635348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.635358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.635364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.635368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.635374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.635383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.635388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.635393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.635398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.635402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.635407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.635412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.635418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.635422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.635426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.635435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.635444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.635452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.635458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.635466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.635475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.635481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.635486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.635490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.635495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.635540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:27.637519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:27.637968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:27.637981Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:27.637983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:27.637986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:27.637991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 179 [2:7559600659671425881:3156]
2025-10-10T14:31:27.638001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:27.638019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:27.638027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.638030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.638032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.638048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:27.638059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:27.638070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:27.638124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.638130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.638132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.638135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:27.638205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:27.638214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.638225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.638242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.638263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:27.638286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635257:3527], now have 1 active actors on pipe
2025-10-10T14:31:27.638294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635030:2438], now have 1 active actors on pipe
2025-10-10T14:31:27.638301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600659671425876:3156]
2025-10-10T14:31:27.638307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600659671425876:3156]
2025-10-10T14:31:27.638309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600659671425876:3156]
2025-10-10T14:31:27.638323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:27.638299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 179
2025-10-10T14:31:27.638306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 179
2025-10-10T14:31:27.638335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:27.638342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:27.638343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:27.638344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:27.638358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:27.638361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:27.638395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.638405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.638423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600659671425876:3156]
2025-10-10T14:31:27.638435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:27.638456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:27.638464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:27.638471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.638479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.638481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:27.638491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.638506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:27.638529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.638695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.638702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.638717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.638803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 180 partition: 0 MaxSeqNo: 40 sessionId: src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0
2025-10-10T14:31:27.639046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c1b657-d0764789-2b791f33-f060517d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:27.641508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0] Write session: try to update token
2025-10-10T14:31:27.641522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:27.654768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId: src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:27.656305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:27.656325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:27.656328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:27.656331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:27.656341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600659671425876:3156]
2025-10-10T14:31:27.656345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600659671425876:3156]
2025-10-10T14:31:27.656349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600659671425876:3156]
2025-10-10T14:31:27.656399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:27.656413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.656419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:27.656548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:27.656573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:27.656585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:27.656589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:27.657207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:27.719129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600660453635267:3080]
2025-10-10T14:31:27.719413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 179, pipe: [1:7559600660453635267:3080]
2025-10-10T14:31:27.758956Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:27.759384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.759395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.759433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635267:3080], now have 1 active actors on pipe
2025-10-10T14:31:27.759633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:27.759699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600660453635267:3080]
2025-10-10T14:31:27.759703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:27.759737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:27.759797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 180 reason: status is not ok: tablet will be restarted right now sessionId: src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0
2025-10-10T14:31:27.759989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 180 sessionId: src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0 is DEAD
2025-10-10T14:31:27.760131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:27.760143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0] Write session will restart in 0.007082s
2025-10-10T14:31:27.760183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0] Write session: Do CDS request
2025-10-10T14:31:27.760190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:27.768844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.768908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:27.768936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 181
2025-10-10T14:31:27.769106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.769141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:27.769150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:27.769156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:27.769631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 181 sessionId:  describe result for acl check
2025-10-10T14:31:27.769665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:27.769671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:27.769673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:27.769677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600660453635350:3531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:27.770198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600660453635350:3531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:27.772548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600660453635350:3531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:27.773911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:27.774757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:27.774833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600660453635350:3531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:27.774844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600660453635350:3531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:27.774847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600660453635350:3531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:27.774853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:27.774937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:27.774950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:27.774962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:27.775017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:27.775054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600659671426116:3158]
2025-10-10T14:31:27.775583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:27.775816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:27.775861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:27.776170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:27.776219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.776225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.776227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.776228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.776229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.776230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.776231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.776232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.776234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.776235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.776236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.776237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.776238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.776243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.776255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.776259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.776263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.776267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.776269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.776271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.776273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.776275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.776278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.776280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.776282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.776284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.776290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.776298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.776305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.776316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.776325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.776335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.776344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.776353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.776362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.776371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.776374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.776384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.776393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.776400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.776408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.776417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.776422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.776431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.776439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.776448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.776456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.776466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.776470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.776474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.776485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.776493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.776536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:27.778560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:27.778992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:27.779004Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:27.779006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:27.779010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:27.779014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 180 [2:7559600659671426116:3158]
2025-10-10T14:31:27.779025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:27.779044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:27.779049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.779051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.779053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.779063Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:27.779073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:27.779079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:27.779129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.779136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.779138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.779140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:27.779198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:27.779206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.779217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.779233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.779253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:27.779278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635268:2438], now have 1 active actors on pipe
2025-10-10T14:31:27.779288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635494:3531], now have 1 active actors on pipe
2025-10-10T14:31:27.779295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600659671426111:3158]
2025-10-10T14:31:27.779297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600659671426111:3158]
2025-10-10T14:31:27.779308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 180
2025-10-10T14:31:27.779299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600659671426111:3158]
2025-10-10T14:31:27.779319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 180
2025-10-10T14:31:27.779313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:27.779326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:27.779335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:27.779338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:27.779340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:27.779341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:27.779344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:27.779375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.779380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.779394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600659671426111:3158]
2025-10-10T14:31:27.779406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:27.779419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:27.779436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:27.779443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.779446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.779449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:27.779460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.779470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:27.779597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.779746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.779755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.779770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.779850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 181 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0
2025-10-10T14:31:27.780160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afc9abb4-1dc6bd11-27cd3383-3e2a821e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:27.782535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0] Write session: try to update token
2025-10-10T14:31:27.782549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:27.795588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId: src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:27.797130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:27.797145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:27.797147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:27.797149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:27.797157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600659671426111:3158]
2025-10-10T14:31:27.797160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600659671426111:3158]
2025-10-10T14:31:27.797163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600659671426111:3158]
2025-10-10T14:31:27.797202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:27.797204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:27.797209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:27.797212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:27.797216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.797217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:27.797352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:27.797908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:27.859919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600660453635506:3080]
2025-10-10T14:31:27.860156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 180, pipe: [1:7559600660453635506:3080]
2025-10-10T14:31:27.899629Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:27.899884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.899902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.899942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635506:3080], now have 1 active actors on pipe
2025-10-10T14:31:27.900109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:27.900156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:27.900205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:27.900210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600660453635506:3080]
2025-10-10T14:31:27.900273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 181 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0
2025-10-10T14:31:27.900462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 181 sessionId: src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0 is DEAD
2025-10-10T14:31:27.900595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:27.900604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0] Write session will restart in 0.007478s
2025-10-10T14:31:27.900622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0] Write session: Do CDS request
2025-10-10T14:31:27.900627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:27.908712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.908776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:27.908788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 182
2025-10-10T14:31:27.908891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:27.908942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:27.908952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:27.908956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:27.909344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 182 sessionId:  describe result for acl check
2025-10-10T14:31:27.909375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:27.909380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:27.909382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:27.909387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600660453635566:3535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:27.909782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600660453635566:3535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:27.912392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600660453635566:3535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:27.914539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600660453635566:3535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:27.914549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600660453635566:3535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:27.914551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600660453635566:3535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:27.914556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:27.914584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:27.915334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:27.915498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:27.915509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:27.915520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:27.915558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:27.915587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600659671426353:3160]
2025-10-10T14:31:27.915960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:27.916166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:27.916204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:27.916603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:27.916658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.916663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.916664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.916664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.916665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.916665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.916666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.916666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.916667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.916668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.916668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.916669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.916669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.916672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.916680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.916683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.916685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.916687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.916689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.916692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.916694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.916696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.916698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.916701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.916703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.916705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.916709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.916715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:27.916719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.916722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:27.916724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.916727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:27.916730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.916733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:27.916736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.916739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:27.916741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.916744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:27.916747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.916750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:27.916752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.916755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:27.916758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.916761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:27.916764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.916767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:27.916774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.916776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.916779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.916782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.916786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.916794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.916834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:27.918739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:27.919012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:27.919024Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:27.919026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:27.919029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:27.919034Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 181 [2:7559600659671426353:3160]
2025-10-10T14:31:27.919041Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:27.919052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:27.919053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.919056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.919057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.919068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:27.919073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:27.919083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:27.919117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.919122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.919124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.919125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:27.919167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:27.919174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.919184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:27.919200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:27.919218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:27.919237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635507:2438], now have 1 active actors on pipe
2025-10-10T14:31:27.919243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600660453635733:3535], now have 1 active actors on pipe
2025-10-10T14:31:27.919247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600659671426347:3160]
2025-10-10T14:31:27.919249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600659671426347:3160]
2025-10-10T14:31:27.919250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600659671426347:3160]
2025-10-10T14:31:27.919261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:27.919254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 181
2025-10-10T14:31:27.919274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:27.919276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:27.919278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:27.919279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:27.919284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:27.919286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:27.919286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 181
2025-10-10T14:31:27.919305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600659671426347:3160]
2025-10-10T14:31:27.919310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:27.919311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:27.919320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.919327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.919358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:27.919366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:27.919369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:27.919370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:27.919377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:27.919385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:27.919400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.919506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:27.919513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:27.919526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:27.919593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 182 partition: 0 MaxSeqNo: 40 sessionId: src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0
2025-10-10T14:31:27.919814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f92e0-46ac3aac-cdb6dbe7-416428b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:27.922209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0] Write session: try to update token
2025-10-10T14:31:27.922223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:27.935382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId: src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:27.937466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:27.937481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:27.937483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:27.937484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:27.937491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600659671426347:3160]
2025-10-10T14:31:27.937494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600659671426347:3160]
2025-10-10T14:31:27.937496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600659671426347:3160]
2025-10-10T14:31:27.937529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:27.937534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:27.937539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:27.937540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:27.937541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:27.937542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:27.937656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:27.937667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:28.000182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600664748603042:3080]
2025-10-10T14:31:28.000377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 181, pipe: [1:7559600664748603042:3080]
2025-10-10T14:31:28.039035Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:28.039318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.039333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.039372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603042:3080], now have 1 active actors on pipe
2025-10-10T14:31:28.039532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:28.039603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:28.039621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600664748603042:3080]
2025-10-10T14:31:28.039640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:28.039702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 182 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0
2025-10-10T14:31:28.039887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 182 sessionId: src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0 is DEAD
2025-10-10T14:31:28.040027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:28.040034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0] Write session will restart in 0.008865s
2025-10-10T14:31:28.040053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0] Write session: Do CDS request
2025-10-10T14:31:28.040057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:28.049833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.049908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:28.049923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 183
2025-10-10T14:31:28.050083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.050137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:28.050145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:28.050148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:28.050569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 183 sessionId:  describe result for acl check
2025-10-10T14:31:28.050601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:28.050606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:28.050608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:28.050615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600664748603137:3539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:28.051170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600664748603137:3539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:28.053540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600664748603137:3539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:28.054682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:28.055672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:28.055836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:28.055850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:28.055862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:28.055881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600664748603137:3539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:28.055905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600664748603137:3539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:28.055922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:28.055908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600664748603137:3539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:28.055915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:28.055965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600663966393885:3162]
2025-10-10T14:31:28.056418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:28.056648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:28.056681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:28.056915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:28.056955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.056961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.056961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.056962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.056963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.056963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.056964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.056965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.056965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.056966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.056966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.056967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.056968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.056972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.056980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.056982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.056984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.056986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.056989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.056991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.056993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.056995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.056997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.056999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.057001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.057003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.057008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.057013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.057018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.057021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.057023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.057026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.057029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.057032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.057035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.057037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.057040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.057043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.057046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.057049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.057051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.057054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.057057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.057061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.057063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.057066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.057073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.057076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.057079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.057082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.057084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.057088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.057114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:28.059225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:28.059635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:28.059649Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:28.059650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:28.059654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:28.059659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 182 [2:7559600663966393885:3162]
2025-10-10T14:31:28.059670Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:28.059685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:28.059693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.059696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.059703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.059718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:28.059730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:28.059741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:28.059793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.059799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.059801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.059803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:28.059867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:28.059876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.059888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.059901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.059922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:28.059947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603271:3539], now have 1 active actors on pipe
2025-10-10T14:31:28.059951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603043:2438], now have 1 active actors on pipe
2025-10-10T14:31:28.059958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600663966393880:3162]
2025-10-10T14:31:28.059960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600663966393880:3162]
2025-10-10T14:31:28.059963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600663966393880:3162]
2025-10-10T14:31:28.059975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:28.059969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 182
2025-10-10T14:31:28.059992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:28.059970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 182
2025-10-10T14:31:28.059992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:28.059993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:28.059994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:28.060013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:28.060020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:28.060051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.060057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.060068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600663966393880:3162]
2025-10-10T14:31:28.060077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:28.060081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:28.060100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:28.060109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.060113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.060115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:28.060123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.060135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:28.060150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.060263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.060271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.060284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.060355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 183 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0
2025-10-10T14:31:28.060655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfef5b7-46f67e2a-af90a7d2-9eb3a0ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:28.063132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0] Write session: try to update token
2025-10-10T14:31:28.063148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:28.076097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId: src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:28.078228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:28.078244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.078247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:28.078248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:28.078254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600663966393880:3162]
2025-10-10T14:31:28.078257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600663966393880:3162]
2025-10-10T14:31:28.078260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600663966393880:3162]
2025-10-10T14:31:28.078298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:28.078307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.078306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:28.078308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:28.078312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:28.078317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:28.078430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:28.078544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:28.139965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600664748603295:3080]
2025-10-10T14:31:28.140178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 182, pipe: [1:7559600664748603295:3080]
2025-10-10T14:31:28.181213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:28.181470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.181483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.181520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603295:3080], now have 1 active actors on pipe
2025-10-10T14:31:28.181700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:28.181728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600664748603295:3080]
2025-10-10T14:31:28.181761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:28.181824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 183 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0
2025-10-10T14:31:28.181986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 183 sessionId: src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0 is DEAD
2025-10-10T14:31:28.182136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:28.182150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0] Write session will restart in 0.009914s
2025-10-10T14:31:28.182147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:28.182176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0] Write session: Do CDS request
2025-10-10T14:31:28.182183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:28.192812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.192936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:28.192949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 184
2025-10-10T14:31:28.193344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.193377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:28.193384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:28.193387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:28.193749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 184 sessionId:  describe result for acl check
2025-10-10T14:31:28.193779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:28.193785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:28.193786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:28.193790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600664748603426:3553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:28.194124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600664748603426:3553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:28.195820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600664748603426:3553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:28.196850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:28.197793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:28.197924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:28.197933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:28.197943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:28.197990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:28.198025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600663966394173:3171]
2025-10-10T14:31:28.198020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600664748603426:3553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:28.198030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600664748603426:3553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:28.198032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600664748603426:3553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:28.198038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:28.198417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:28.198628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:28.198660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:28.198874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:28.198909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.198914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.198915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.198915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.198916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.198916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.198917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.198918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.198918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.198919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.198919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.198920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.198920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.198924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.198931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.198933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.198935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.198937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.198940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.198942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.198944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.198945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.198948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.198949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.198952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.198954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.198959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.198967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.198973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.198977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.198981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.198987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.198991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.198995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.198999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.199004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.199008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.199017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.199020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.199025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.199027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.199030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.199032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.199039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.199041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.199044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.199047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.199050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.199052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.199055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.199058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.199061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.199085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:28.201037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:28.201428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:28.201439Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:28.201440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:28.201443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:28.201447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 183 [2:7559600663966394173:3171]
2025-10-10T14:31:28.201455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:28.201466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:28.201471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.201473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.201474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.201484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:28.201493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:28.201499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:28.201549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.201556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.201558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.201560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:28.201605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:28.201611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.201618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.201624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.201637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:28.201655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603309:2438], now have 1 active actors on pipe
2025-10-10T14:31:28.201664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600663966394168:3171]
2025-10-10T14:31:28.201666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600663966394168:3171]
2025-10-10T14:31:28.201667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600663966394168:3171]
2025-10-10T14:31:28.201676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:28.201682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603548:3553], now have 1 active actors on pipe
2025-10-10T14:31:28.201687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:28.201692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:28.201695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:28.201696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:28.201700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:28.201702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:28.201700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 183
2025-10-10T14:31:28.201718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600663966394168:3171]
2025-10-10T14:31:28.201703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 183
2025-10-10T14:31:28.201726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:28.201728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:28.201752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.201761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.201798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:28.201808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.201810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.201811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:28.201820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.201827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:28.201842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.201965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.201974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.201989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.202059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 184 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0
2025-10-10T14:31:28.202407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4471d96-d43cd734-88d6d99d-d297db6c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:28.204901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0] Write session: try to update token
2025-10-10T14:31:28.204916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:28.218100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId: src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:28.218952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:28.218971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.218973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:28.218974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:28.218982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600663966394168:3171]
2025-10-10T14:31:28.218985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600663966394168:3171]
2025-10-10T14:31:28.218988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600663966394168:3171]
2025-10-10T14:31:28.219021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:28.219026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:28.219032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.219033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:28.219033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:28.219045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:28.219153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:28.220518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:28.281758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600664748603559:3080]
2025-10-10T14:31:28.282011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 183, pipe: [1:7559600664748603559:3080]
2025-10-10T14:31:28.320390Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:28.320819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.320835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.320874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603559:3080], now have 1 active actors on pipe
2025-10-10T14:31:28.321020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:28.321114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600664748603559:3080]
2025-10-10T14:31:28.321116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:28.321204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:28.321283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0
2025-10-10T14:31:28.321488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 184 sessionId: src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0 is DEAD
2025-10-10T14:31:28.321632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:28.321641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0] Write session will restart in 0.009473s
2025-10-10T14:31:28.321670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0] Write session: Do CDS request
2025-10-10T14:31:28.321675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:28.331820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.331902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:28.331915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 185
2025-10-10T14:31:28.332026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.332053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:28.332060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:28.332063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:28.332497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 185 sessionId:  describe result for acl check
2025-10-10T14:31:28.332532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:28.332541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:28.332543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:28.332549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600664748603702:3557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:28.332968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600664748603702:3557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:28.334593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:28.334719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600664748603702:3557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:28.335349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:28.335522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:28.335535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:28.335547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:28.335607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:28.335644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600663966394412:3180]
2025-10-10T14:31:28.336201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:28.336430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:28.336466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600664748603702:3557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:28.336484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600664748603702:3557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:28.336487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600664748603702:3557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:28.336493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:28.336487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:28.336794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:28.336861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.336870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.336871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.336872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.336873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.336874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.336876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.336877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.336878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.336879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.336880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.336881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.336882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.336887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.336899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.336903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.336907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.336910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.336914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.336918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.336922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.336926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.336930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.336934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.336938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.336942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.336950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.336959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.336965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.336976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.336984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.336994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.337003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.337012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.337021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.337030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.337039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.337048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.337053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.337063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.337067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.337076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.337080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.337090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.337098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.337108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.337117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.337126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.337136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.337145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.337154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.337163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.337208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:28.339200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:28.339593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:28.339606Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:28.339607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:28.339611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:28.339616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 184 [2:7559600663966394412:3180]
2025-10-10T14:31:28.339626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:28.339645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:28.339652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.339655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.339657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.339672Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:28.339684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:28.339694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:28.339748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.339754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.339756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.339759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:28.339814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:28.339822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.339833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.339844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.339861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:28.339885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603561:2438], now have 1 active actors on pipe
2025-10-10T14:31:28.339893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603793:3557], now have 1 active actors on pipe
2025-10-10T14:31:28.339901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600663966394407:3180]
2025-10-10T14:31:28.339903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600663966394407:3180]
2025-10-10T14:31:28.339905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600663966394407:3180]
2025-10-10T14:31:28.339913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:28.339920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:28.339893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 184
2025-10-10T14:31:28.339922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:28.339895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 184
2025-10-10T14:31:28.339923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:28.339931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:28.339947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:28.339955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:28.339971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.339981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.340013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600663966394407:3180]
2025-10-10T14:31:28.340026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:28.340040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:28.340048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be07808f-94ab700-d12e9438-34d7524a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:28.340055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.340063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.340065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:28.340075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.340090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:28.340123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.340267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.340279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.340296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.340373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 185 partition: 0 MaxSeqNo: 40 sessionId: src_id|be07808f-94ab700-d12e9438-34d7524a_0
2025-10-10T14:31:28.340640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc837ea3-192cee2-ff5feef1-9ad3e25c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be07808f-94ab700-d12e9438-34d7524a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:28.343084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be07808f-94ab700-d12e9438-34d7524a_0] Write session: try to update token
2025-10-10T14:31:28.343102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be07808f-94ab700-d12e9438-34d7524a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:28.356616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId: src_id|be07808f-94ab700-d12e9438-34d7524a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:28.357775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:28.357793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.357795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:28.357796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:28.357805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600663966394407:3180]
2025-10-10T14:31:28.357808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600663966394407:3180]
2025-10-10T14:31:28.357811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600663966394407:3180]
2025-10-10T14:31:28.357845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:28.357850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:28.357850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:28.357855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.357856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:28.357857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:28.357983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:28.358909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:28.421029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600664748603802:3080]
2025-10-10T14:31:28.421281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 184, pipe: [1:7559600664748603802:3080]
2025-10-10T14:31:28.460037Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:28.460445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.460458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.460494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603802:3080], now have 1 active actors on pipe
2025-10-10T14:31:28.460628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:28.460718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:28.460751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600664748603802:3080]
2025-10-10T14:31:28.460766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:28.460839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 185 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be07808f-94ab700-d12e9438-34d7524a_0
2025-10-10T14:31:28.461025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 185 sessionId: src_id|be07808f-94ab700-d12e9438-34d7524a_0 is DEAD
2025-10-10T14:31:28.461181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be07808f-94ab700-d12e9438-34d7524a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:28.461193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be07808f-94ab700-d12e9438-34d7524a_0] Write session will restart in 0.008043s
2025-10-10T14:31:28.461219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be07808f-94ab700-d12e9438-34d7524a_0] Write session: Do CDS request
2025-10-10T14:31:28.461225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be07808f-94ab700-d12e9438-34d7524a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:28.470805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be07808f-94ab700-d12e9438-34d7524a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.470846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:28.470858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 186
2025-10-10T14:31:28.471019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.471047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:28.471052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:28.471055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:28.471396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 186 sessionId:  describe result for acl check
2025-10-10T14:31:28.471429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:28.471430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:28.471431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:28.471435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600664748603945:3561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:28.471908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600664748603945:3561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:28.473534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600664748603945:3561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:28.473583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:28.474443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:28.474613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:28.474625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:28.474636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:28.474687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:28.474726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600663966394650:3182]
2025-10-10T14:31:28.475135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:28.475362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:28.475392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:28.475604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:28.475643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.475646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.475647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.475647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.475648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.475649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.475649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.475650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.475650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.475651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.475652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.475652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.475653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.475656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.475664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.475667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.475669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.475671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.475673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.475675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.475677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.475679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.475681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.475683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.475686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.475688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.475693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.475698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.475702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.475706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.475709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.475705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600664748603945:3561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:28.475712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.475717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600664748603945:3561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:28.475714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.475719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600664748603945:3561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:28.475717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.475724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:28.475720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.475724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.475727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.475730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.475732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.475735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.475737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.475741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.475743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.475746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.475749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.475752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.475754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.475757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.475759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.475762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.475766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.475769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.475789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:28.477778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:28.478084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:28.478093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:28.478095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:28.478097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:28.478101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 185 [2:7559600663966394650:3182]
2025-10-10T14:31:28.478109Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:28.478123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:28.478130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.478132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.478134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.478146Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:28.478157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:28.478167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:28.478225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.478232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.478234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.478236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:28.478293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:28.478300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.478310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.478326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.478345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:28.478367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604037:3561], now have 1 active actors on pipe
2025-10-10T14:31:28.478374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748603803:2438], now have 1 active actors on pipe
2025-10-10T14:31:28.478381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600663966394645:3182]
2025-10-10T14:31:28.478387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600663966394645:3182]
2025-10-10T14:31:28.478390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600663966394645:3182]
2025-10-10T14:31:28.478401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:28.478399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 185
2025-10-10T14:31:28.478402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 185
2025-10-10T14:31:28.478411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:28.478414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:28.478416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:28.478418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:28.478433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:28.478436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:28.478464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.478473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.478491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600663966394645:3182]
2025-10-10T14:31:28.478501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:28.478507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:28.478528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:28.478539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.478547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.478551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:28.478560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.478574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:28.478597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.478695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.478703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.478718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.478796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 186 partition: 0 MaxSeqNo: 40 sessionId: src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0
2025-10-10T14:31:28.479058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be07808f-94ab700-d12e9438-34d7524a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:28.481636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0] Write session: try to update token
2025-10-10T14:31:28.481651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:28.495110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId: src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:28.496170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:28.496189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.496192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:28.496194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:28.496204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600663966394645:3182]
2025-10-10T14:31:28.496208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600663966394645:3182]
2025-10-10T14:31:28.496211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600663966394645:3182]
2025-10-10T14:31:28.496255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:28.496256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:28.496260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:28.496263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:28.496267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.496270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:28.496401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:28.497369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:28.560820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600664748604057:3080]
2025-10-10T14:31:28.561035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 185, pipe: [1:7559600664748604057:3080]
2025-10-10T14:31:28.600863Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:28.601085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.601096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.601133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604057:3080], now have 1 active actors on pipe
2025-10-10T14:31:28.601352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600664748604057:3080]
2025-10-10T14:31:28.601381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:28.601363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:28.601366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:28.601377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:28.601428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 186 reason: error at write: Disconnected sessionId: src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0
2025-10-10T14:31:28.601614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 186 sessionId: src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0 is DEAD
2025-10-10T14:31:28.601794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:28.601805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0] Write session will restart in 0.008625s
2025-10-10T14:31:28.601829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0] Write session: Do CDS request
2025-10-10T14:31:28.601836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:28.611843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.611912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:28.611927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 187
2025-10-10T14:31:28.612046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.612089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:28.612100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:28.612108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:28.612631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 187 sessionId:  describe result for acl check
2025-10-10T14:31:28.612663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:28.612668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:28.612669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:28.612674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600664748604155:3567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:28.613120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600664748604155:3567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:28.615635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600664748604155:3567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:28.616291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:28.617177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:28.617350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:28.617361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:28.617373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:28.617426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:28.617464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600663966394893:3185]
2025-10-10T14:31:28.617640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600664748604155:3567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:28.617651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600664748604155:3567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:28.617654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600664748604155:3567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:28.617660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:28.618049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:28.618262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:28.618300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:28.618593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:28.618642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.618648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.618650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.618651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.618652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.618653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.618654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.618655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.618656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.618657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.618658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.618659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.618661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.618666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.618678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.618682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.618686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.618690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.618694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.618698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.618702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.618709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.618714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.618722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.618726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.618735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.618742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.618754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.618765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.618775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.618779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.618788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.618793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.618802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.618807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.618812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.618820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.618829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.618839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.618848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.618856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.618865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.618874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.618883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.618891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.618900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.618909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.618918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.618926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.618935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.618944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.618953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.618997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:28.621068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:28.621562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:28.621574Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:28.621576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:28.621579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:28.621584Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 186 [2:7559600663966394893:3185]
2025-10-10T14:31:28.621595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:28.621613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:28.621620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.621624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.621630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.621645Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:28.621657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:28.621666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:28.621721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.621727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.621729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.621731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:28.621793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:28.621801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.621812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.621825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.621842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:28.621872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 186
2025-10-10T14:31:28.621868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604061:2438], now have 1 active actors on pipe
2025-10-10T14:31:28.621880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 186
2025-10-10T14:31:28.621879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604293:3567], now have 1 active actors on pipe
2025-10-10T14:31:28.621886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600663966394888:3185]
2025-10-10T14:31:28.621888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600663966394888:3185]
2025-10-10T14:31:28.621890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600663966394888:3185]
2025-10-10T14:31:28.621897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:28.621911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:28.621910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:28.621913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:28.621914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:28.621927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:28.621930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:28.621946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.621951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.621985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600663966394888:3185]
2025-10-10T14:31:28.621997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:28.622000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:28.622014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:28.622026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.622033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.622035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:28.622045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.622057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:28.622095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.622210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.622220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.622235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.622332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 187 partition: 0 MaxSeqNo: 40 sessionId: src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0
2025-10-10T14:31:28.622626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|484ca6d8-2ec7bf62-9dc7a378-61700012_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:28.625240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0] Write session: try to update token
2025-10-10T14:31:28.625254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:28.638145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId: src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:28.638626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:28.638643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.638651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600663966394888:3185]
2025-10-10T14:31:28.638695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:28.638694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:28.638857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:28.638986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:28.639123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:28.639253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:28.639428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:28.639460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:28.640678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:28.640845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.640859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.640890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:28.640967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:28.649662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:28.649678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.649680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:28.649681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:28.649690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600663966394888:3185]
2025-10-10T14:31:28.649693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600663966394888:3185]
2025-10-10T14:31:28.649696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600663966394888:3185]
2025-10-10T14:31:28.649729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:28.649741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.649741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:28.649742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:28.649746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:28.649750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:28.649871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:28.701620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600664748604305:3080]
2025-10-10T14:31:28.701848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 186, pipe: [1:7559600664748604305:3080]
2025-10-10T14:31:28.755404Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:28.763172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.763199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.763365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.763431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.763495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.763563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.763609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.763619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.763688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.763751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.763820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.763888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.763932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.763940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.764006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.764070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.764138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.764203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.764246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.764258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.764325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.764390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.764455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.764519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.764564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.764571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.764638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.764700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.764767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.764834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.764881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.764891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.764954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.765020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.765084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.765153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.765199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.765207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.765274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.765352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.765418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.765484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.765529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.765537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.765601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.765664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.765730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.765793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.765837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.765845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.765909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.765967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.766026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.766089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.766135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.766143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.766218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.766279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.766340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.766401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.766445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.766452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.766508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604305:3080], now have 1 active actors on pipe
2025-10-10T14:31:28.766722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600664748604305:3080]
2025-10-10T14:31:28.766755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:28.766762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:28.766766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:28.766791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 187 reason: error at write: Disconnected sessionId: src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0
2025-10-10T14:31:28.766970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 187 sessionId: src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0 is DEAD
2025-10-10T14:31:28.767124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:28.767135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0] Write session will restart in 0.006931s
2025-10-10T14:31:28.767160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0] Write session: Do CDS request
2025-10-10T14:31:28.767165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:28.767512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:28.774785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.774873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:28.774885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 188
2025-10-10T14:31:28.775019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.775046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:28.775051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:28.775055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:28.775401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 188 sessionId:  describe result for acl check
2025-10-10T14:31:28.775431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:28.775438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:28.775440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:28.775444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600664748604338:3571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:28.775883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600664748604338:3571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:28.778576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600664748604338:3571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:28.781095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600664748604338:3571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:28.781109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600664748604338:3571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:28.781112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600664748604338:3571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:28.781119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:28.782609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:28.783842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:28.783994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:28.784003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:28.784012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:28.784047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:28.784169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600663966395136:3187]
2025-10-10T14:31:28.784564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:28.784829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:28.784875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:28.785136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:28.785190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.785196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.785197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.785198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.785200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.785201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.785202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.785203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.785204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.785205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.785207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.785208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.785209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.785214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.785226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.785230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.785234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.785238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.785242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.785246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.785250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.785254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.785259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.785263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.785267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.785271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.785277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.785282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.785286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.785290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.785292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.785296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.785300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.785303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.785306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.785309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.785311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.785315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.785317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.785320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.785323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.785326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.785344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.785350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.785354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.785360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.785365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.785370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.785372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.785376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.785379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.785382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.785404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:28.787552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:28.787850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:28.787862Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:28.787864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:28.787868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:28.787874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 187 [2:7559600663966395136:3187]
2025-10-10T14:31:28.787885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:28.787904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:28.787911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.787914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.787916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.787932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:28.787943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:28.787950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:28.787994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.788001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.788003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.788005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:28.788064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:28.788070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.788082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.788094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.788114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:28.788138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604522:3571], now have 1 active actors on pipe
2025-10-10T14:31:28.788147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604306:2438], now have 1 active actors on pipe
2025-10-10T14:31:28.788155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600663966395131:3187]
2025-10-10T14:31:28.788157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600663966395131:3187]
2025-10-10T14:31:28.788159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600663966395131:3187]
2025-10-10T14:31:28.788174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:28.788187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:28.788202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:28.788206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:28.788209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:28.788206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 187
2025-10-10T14:31:28.788209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:28.788215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 187
2025-10-10T14:31:28.788211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:28.788228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600663966395131:3187]
2025-10-10T14:31:28.788231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:28.788245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:28.788263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.788273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.788302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:28.788314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.788318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.788322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:28.788333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.788348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:28.788366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.788514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.788524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.788540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.788622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 188 partition: 0 MaxSeqNo: 40 sessionId: src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0
2025-10-10T14:31:28.789002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|facf93da-ba0cf9d2-deb1da06-fa2d7039_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:28.791549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0] Write session: try to update token
2025-10-10T14:31:28.791570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:28.798928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:28.798950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.798961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600663966395131:3187]
2025-10-10T14:31:28.799007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:28.799009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:28.799188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:28.799320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:28.799457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:28.799597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:28.799774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:28.799814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:28.805218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId: src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:28.807771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:28.808008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.808029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.808069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:28.808170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:28.815675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:28.815693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.815696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:28.815698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:28.815708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600663966395131:3187]
2025-10-10T14:31:28.815712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600663966395131:3187]
2025-10-10T14:31:28.815716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600663966395131:3187]
2025-10-10T14:31:28.815756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:28.815761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:28.815762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:28.815765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:28.815770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.815772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:28.815896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:28.867017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600664748604551:3080]
2025-10-10T14:31:28.867298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 187, pipe: [1:7559600664748604551:3080]
2025-10-10T14:31:28.919985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:28.926626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.926649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.926789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.926841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.926907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.926977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.927021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.927031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.927100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.927157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.927209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.927264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.927303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.927307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.927364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.927415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.927469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.927524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.927563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.927569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.927622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.927673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.927726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.927780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.927818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.927824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.927879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.927929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.927981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.928035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.928073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.928078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.928130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.928181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.928242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.928305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.928342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.928349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.928404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.928453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.928506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.928559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.928596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.928601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.928654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.928704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.928755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.928809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.928848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.928854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.928906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.928956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.929007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.929062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.929108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.929115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.929171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:28.929221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:28.929272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:28.929324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:28.929373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:28.929378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:28.929413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604551:3080], now have 1 active actors on pipe
2025-10-10T14:31:28.929655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600664748604551:3080]
2025-10-10T14:31:28.929663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:28.929667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:28.929683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:28.929692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 188 reason: error at write: Disconnected sessionId: src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0
2025-10-10T14:31:28.929874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 188 sessionId: src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0 is DEAD
2025-10-10T14:31:28.930040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:28.930049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0] Write session will restart in 0.007664s
2025-10-10T14:31:28.930072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0] Write session: Do CDS request
2025-10-10T14:31:28.930079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:28.930060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:28.938775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.938858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:28.938870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 189
2025-10-10T14:31:28.938980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:28.939005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:28.939012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:28.939017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:28.939457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 189 sessionId:  describe result for acl check
2025-10-10T14:31:28.939493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:28.939504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:28.939505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:28.939510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600664748604610:3575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:28.939938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600664748604610:3575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:28.942932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600664748604610:3575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:28.944534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:28.945521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:28.945678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600664748604610:3575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:28.945683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:28.945690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600664748604610:3575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:28.945692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600664748604610:3575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:28.945697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:28.945697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:28.945709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:28.945753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:28.945791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600663966395378:3189]
2025-10-10T14:31:28.946302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:28.946538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:28.946568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:28.946761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:28.946792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.946796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.946797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.946798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.946798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.946799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.946800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.946800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.946801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.946801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.946802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.946802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.946803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.946807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.946814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.946816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.946819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.946821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.946823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.946824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.946826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.946828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.946830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.946832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.946834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.946836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.946840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.946846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:28.946852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.946857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:28.946862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.946866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:28.946870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.946874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:28.946879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.946887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:28.946890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.946893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:28.946895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.946898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:28.946901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.946904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:28.946906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.946909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:28.946918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.946926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:28.946934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.946938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.946947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.946955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.946963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.946971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.947009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:28.949048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:28.949374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:28.949386Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:28.949387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:28.949391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:28.949395Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 188 [2:7559600663966395378:3189]
2025-10-10T14:31:28.949405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:28.949421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:28.949429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.949431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.949433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.949448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:28.949459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:28.949470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:28.949521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.949528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.949529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.949532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:28.949588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:28.949594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.949604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:28.949618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:28.949637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:28.949661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604786:3575], now have 1 active actors on pipe
2025-10-10T14:31:28.949669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600664748604552:2438], now have 1 active actors on pipe
2025-10-10T14:31:28.949675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600663966395373:3189]
2025-10-10T14:31:28.949681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600663966395373:3189]
2025-10-10T14:31:28.949683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600663966395373:3189]
2025-10-10T14:31:28.949696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:28.949683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 188
2025-10-10T14:31:28.949683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 188
2025-10-10T14:31:28.949711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:28.949711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:28.949713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:28.949714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:28.949732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:28.949735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:28.949765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.949775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.949797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600663966395373:3189]
2025-10-10T14:31:28.949809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:28.949812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:28.949836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:28.949849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:28.949857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:28.949859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:28.949870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:28.949887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:28.949909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.950044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:28.950053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:28.950069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:28.950145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 189 partition: 0 MaxSeqNo: 40 sessionId: src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0
2025-10-10T14:31:28.950496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99fcf738-e4bda8ea-da6d31f-e4aa6c4a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:28.953010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0] Write session: try to update token
2025-10-10T14:31:28.953025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:28.966428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId: src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:28.968204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:28.968226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:28.968229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:28.968231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:28.968240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600663966395373:3189]
2025-10-10T14:31:28.968245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600663966395373:3189]
2025-10-10T14:31:28.968249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600663966395373:3189]
2025-10-10T14:31:28.968289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:28.968294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:28.968299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:28.968302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:28.968303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:28.968304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:28.968440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:28.968814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:29.029775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600669043572094:3080]
2025-10-10T14:31:29.030040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 188, pipe: [1:7559600669043572094:3080]
2025-10-10T14:31:29.074310Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:29.074712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.074727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.074772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572094:3080], now have 1 active actors on pipe
2025-10-10T14:31:29.074942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:29.074984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:29.075029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600669043572094:3080]
2025-10-10T14:31:29.075049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:29.075129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 189 reason: status is not ok: tablet will be restarted right now sessionId: src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0
2025-10-10T14:31:29.075329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 189 sessionId: src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0 is DEAD
2025-10-10T14:31:29.075513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:29.075525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0] Write session will restart in 0.008405s
2025-10-10T14:31:29.075549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0] Write session: Do CDS request
2025-10-10T14:31:29.075556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:29.084924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.085006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:29.085020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 190
2025-10-10T14:31:29.085153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.085200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:29.085211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:29.085219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:29.085724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 190 sessionId:  describe result for acl check
2025-10-10T14:31:29.085762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:29.085768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:29.085771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:29.085777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600669043572181:3580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:29.086349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600669043572181:3580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:29.089023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600669043572181:3580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:29.090951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:29.091996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:29.092182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:29.092194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:29.092205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:29.092261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:29.092303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600668261362930:3192]
2025-10-10T14:31:29.092324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600669043572181:3580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:29.092338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600669043572181:3580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:29.092342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600669043572181:3580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:29.092349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:29.092907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:29.093160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:29.093201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:29.093530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:29.093586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.093594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.093595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.093596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.093597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.093598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.093599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.093601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.093602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.093603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.093604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.093605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.093606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.093611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.093624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.093628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.093632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.093636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.093640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.093644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.093648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.093651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.093655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.093659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.093663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.093667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.093675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.093684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.093691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.093697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.093701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.093706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.093712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.093717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.093722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.093732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.093743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.093752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.093761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.093766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.093774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.093779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.093788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.093793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.093798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.093803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.093810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.093819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.093827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.093837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.093848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.093857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.093904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:29.096156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:29.096448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:29.096458Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:29.096460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:29.096463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:29.096468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 189 [2:7559600668261362930:3192]
2025-10-10T14:31:29.096479Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:29.096495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:29.096502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.096505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.096507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.096521Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:29.096532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:29.096542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:29.096586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.096592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.096593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.096595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:29.096649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:29.096657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.096668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.096685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.096708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:29.096734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572107:2438], now have 1 active actors on pipe
2025-10-10T14:31:29.096743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572342:3580], now have 1 active actors on pipe
2025-10-10T14:31:29.096750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600668261362925:3192]
2025-10-10T14:31:29.096755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600668261362925:3192]
2025-10-10T14:31:29.096756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600668261362925:3192]
2025-10-10T14:31:29.096766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:29.096782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:29.096786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:29.096792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:29.096793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:29.096802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:29.096805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:29.096775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 189
2025-10-10T14:31:29.096831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600668261362925:3192]
2025-10-10T14:31:29.096786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 189
2025-10-10T14:31:29.096843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:29.096846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:29.096857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.096866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.096911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:29.096923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.096926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.096929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:29.096940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.096950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:29.096970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.097115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.097124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.097139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.097214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 190 partition: 0 MaxSeqNo: 40 sessionId: src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0
2025-10-10T14:31:29.097584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839f5e31-7d0b3c8c-7267d00f-a80bb58a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:29.100116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0] Write session: try to update token
2025-10-10T14:31:29.100131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:29.113998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId: src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:29.114867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:29.114887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:29.114890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:29.114892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:29.114901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600668261362925:3192]
2025-10-10T14:31:29.114905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600668261362925:3192]
2025-10-10T14:31:29.114910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600668261362925:3192]
2025-10-10T14:31:29.114950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:29.114962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:29.114963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:29.114967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:29.114970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.114972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:29.115102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:29.116521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:29.175239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600669043572354:3080]
2025-10-10T14:31:29.175502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 189, pipe: [1:7559600669043572354:3080]
2025-10-10T14:31:29.222621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:29.223106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.223116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.223151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572354:3080], now have 1 active actors on pipe
2025-10-10T14:31:29.223301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:29.223384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:29.223427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600669043572354:3080]
2025-10-10T14:31:29.223441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:29.223518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0
2025-10-10T14:31:29.223685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 190 sessionId: src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0 is DEAD
2025-10-10T14:31:29.223814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:29.223825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0] Write session will restart in 0.009142s
2025-10-10T14:31:29.223848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0] Write session: Do CDS request
2025-10-10T14:31:29.223854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:29.233806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.233903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:29.233917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 191
2025-10-10T14:31:29.234031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.234064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:29.234069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:29.234073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:29.234517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 191 sessionId:  describe result for acl check
2025-10-10T14:31:29.234554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:29.234560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:29.234562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:29.234567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600669043572477:3593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:29.235076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600669043572477:3593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:29.237180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600669043572477:3593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:29.239082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:29.240269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600669043572477:3593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:29.240280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600669043572477:3593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:29.240273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:29.240283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600669043572477:3593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:29.240288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:29.240452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:29.240462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:29.240474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:29.240523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:29.240562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600668261363213:3200]
2025-10-10T14:31:29.241140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:29.241424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:29.241463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:29.241767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:29.241819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.241825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.241826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.241827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.241828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.241830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.241831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.241832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.241833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.241834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.241835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.241836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.241837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.241843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.241854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.241858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.241866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.241870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.241874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.241878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.241882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.241888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.241892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.241900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.241904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.241912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.241918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.241931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.241943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.241952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.241957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.241966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.241970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.241979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.241983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.241992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.241996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.242006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.242015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.242020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.242025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.242035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.242041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.242046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.242054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.242060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.242068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.242073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.242081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.242086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.242090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.242096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.242141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:29.244246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:29.244817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:29.244828Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:29.244831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:29.244834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:29.244839Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 190 [2:7559600668261363213:3200]
2025-10-10T14:31:29.244850Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:29.244865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:29.244875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.244878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.244881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.244896Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:29.244902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:29.244909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:29.244956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.244963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.244964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.244967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:29.245042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:29.245050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.245061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.245077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.245098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:29.245133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 190
2025-10-10T14:31:29.245122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572368:2438], now have 1 active actors on pipe
2025-10-10T14:31:29.245133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 190
2025-10-10T14:31:29.245131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572615:3593], now have 1 active actors on pipe
2025-10-10T14:31:29.245138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600668261363208:3200]
2025-10-10T14:31:29.245140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600668261363208:3200]
2025-10-10T14:31:29.245142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600668261363208:3200]
2025-10-10T14:31:29.245156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:29.245169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:29.245182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:29.245185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:29.245186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:29.245188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:29.245188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:29.245220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.245229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.245244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600668261363208:3200]
2025-10-10T14:31:29.245253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:29.245273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:29.245282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:29.245290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.245294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.245296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:29.245306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.245321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:29.245357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.245508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.245515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.245530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.245620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 191 partition: 0 MaxSeqNo: 40 sessionId: src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0
2025-10-10T14:31:29.245924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12939c5-acb935f7-912b5d71-85a4bf93_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:29.248409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0] Write session: try to update token
2025-10-10T14:31:29.248424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:29.261999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId: src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:29.263468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:29.263484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:29.263487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:29.263490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:29.263499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600668261363208:3200]
2025-10-10T14:31:29.263503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600668261363208:3200]
2025-10-10T14:31:29.263509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600668261363208:3200]
2025-10-10T14:31:29.263556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:29.263559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:29.263567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.263568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:29.263569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:29.263572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:29.263715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:29.264429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:29.323689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600669043572627:3080]
2025-10-10T14:31:29.323962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 190, pipe: [1:7559600669043572627:3080]
2025-10-10T14:31:29.367569Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:29.368058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.368070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.368109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572627:3080], now have 1 active actors on pipe
2025-10-10T14:31:29.368277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:29.368372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:29.368391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:29.368399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:29.368442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 191 reason: error at write: Disconnected sessionId: src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0
2025-10-10T14:31:29.368446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600669043572627:3080]
2025-10-10T14:31:29.368617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 191 sessionId: src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0 is DEAD
2025-10-10T14:31:29.368773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:29.368793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0] Write session will restart in 0.005778s
2025-10-10T14:31:29.368819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0] Write session: Do CDS request
2025-10-10T14:31:29.368828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:29.375812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.375868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:29.375879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 192
2025-10-10T14:31:29.376013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.376052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:29.376059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:29.376063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:29.376411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 192 sessionId:  describe result for acl check
2025-10-10T14:31:29.376449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:29.376455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:29.376456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:29.376461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600669043572648:3597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:29.376947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600669043572648:3597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:29.379471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600669043572648:3597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:29.381758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600669043572648:3597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:29.381770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600669043572648:3597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:29.381774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600669043572648:3597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:29.381780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:29.383218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:29.384233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:29.384370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:29.384379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:29.384388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:29.384424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:29.384452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600668261363460:3209]
2025-10-10T14:31:29.384868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:29.385100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:29.385135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:29.385408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:29.385449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.385453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.385454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.385455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.385456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.385457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.385457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.385458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.385458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.385459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.385460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.385460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.385461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.385464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.385472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.385475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.385477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.385479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.385481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.385483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.385486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.385487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.385490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.385492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.385494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.385495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.385501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.385506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.385511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.385514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.385516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.385519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.385521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.385524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.385526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.385529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.385532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.385534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.385537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.385540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.385543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.385547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.385553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.385556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.385558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.385562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.385566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.385571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.385575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.385580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.385588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.385594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.385620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:29.387665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:29.388163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:29.388175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:29.388178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:29.388181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:29.388187Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 191 [2:7559600668261363460:3209]
2025-10-10T14:31:29.388199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:29.388214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:29.388221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.388224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.388226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.388241Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:29.388252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:29.388259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:29.388314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.388320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.388322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.388325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:29.388387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:29.388394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.388406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.388422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.388444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:29.388467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572628:2438], now have 1 active actors on pipe
2025-10-10T14:31:29.388474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572834:3597], now have 1 active actors on pipe
2025-10-10T14:31:29.388481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600668261363455:3209]
2025-10-10T14:31:29.388483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600668261363455:3209]
2025-10-10T14:31:29.388485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600668261363455:3209]
2025-10-10T14:31:29.388499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:29.388507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:29.388510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:29.388512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:29.388516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:29.388516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 191
2025-10-10T14:31:29.388519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 191
2025-10-10T14:31:29.388532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:29.388539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:29.388570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.388579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.388593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600668261363455:3209]
2025-10-10T14:31:29.388604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:29.388608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:29.388635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:29.388646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.388653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.388656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:29.388666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.388680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:29.388707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.388837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.388845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.388858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.388945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 192 partition: 0 MaxSeqNo: 40 sessionId: src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0
2025-10-10T14:31:29.389284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c853bb-963bfdf3-bbb565d8-45889a71_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:29.391763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0] Write session: try to update token
2025-10-10T14:31:29.391777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:29.404822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId: src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:29.406576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:29.406591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:29.406595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:29.406597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:29.406605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600668261363455:3209]
2025-10-10T14:31:29.406609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600668261363455:3209]
2025-10-10T14:31:29.406613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600668261363455:3209]
2025-10-10T14:31:29.406652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:29.406660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:29.406663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:29.406666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:29.406668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.406670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:29.406801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:29.407161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:29.468624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600669043572876:3080]
2025-10-10T14:31:29.468889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 191, pipe: [1:7559600669043572876:3080]
2025-10-10T14:31:29.511245Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:29.511454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.511468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.511505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572876:3080], now have 1 active actors on pipe
2025-10-10T14:31:29.511658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:29.511697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600669043572876:3080]
2025-10-10T14:31:29.511711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:29.511725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:29.511797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 192 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0
2025-10-10T14:31:29.511971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 192 sessionId: src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0 is DEAD
2025-10-10T14:31:29.512145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:29.512157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0] Write session will restart in 0.007198s
2025-10-10T14:31:29.512179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0] Write session: Do CDS request
2025-10-10T14:31:29.512186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:29.520790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.520856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:29.520870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 193
2025-10-10T14:31:29.521019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.521060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:29.521068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:29.521072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:29.521481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 193 sessionId:  describe result for acl check
2025-10-10T14:31:29.521514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:29.521519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:29.521521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:29.521526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600669043572927:3601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:29.521984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600669043572927:3601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:29.524638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600669043572927:3601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:29.527017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600669043572927:3601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:29.527030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600669043572927:3601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:29.527034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600669043572927:3601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:29.527040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:29.527437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:29.528610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:29.528818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:29.528829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:29.528841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:29.528894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:29.528938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600668261363707:3211]
2025-10-10T14:31:29.529523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:29.529788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:29.529822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:29.530029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:29.530075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.530082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.530083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.530084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.530085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.530087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.530088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.530089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.530090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.530091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.530093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.530094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.530095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.530101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.530110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.530112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.530116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.530120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.530123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.530127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.530130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.530133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.530138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.530141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.530145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.530149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.530156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.530168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.530178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.530185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.530187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.530191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.530197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.530201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.530214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.530219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.530222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.530228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.530233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.530238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.530246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.530251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.530261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.530271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.530277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.530282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.530291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.530298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.530306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.530313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.530323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.530332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.530370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:29.532562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:29.532865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:29.532877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:29.532880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:29.532886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:29.532891Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 192 [2:7559600668261363707:3211]
2025-10-10T14:31:29.532903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:29.532917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:29.532921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.532926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.532932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.532947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:29.532959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:29.532969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:29.533025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.533031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.533033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.533036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:29.533098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:29.533109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.533120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.533133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.533151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:29.533175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043572878:2438], now have 1 active actors on pipe
2025-10-10T14:31:29.533182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573118:3601], now have 1 active actors on pipe
2025-10-10T14:31:29.533192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600668261363702:3211]
2025-10-10T14:31:29.533194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600668261363702:3211]
2025-10-10T14:31:29.533196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600668261363702:3211]
2025-10-10T14:31:29.533209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:29.533195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 192
2025-10-10T14:31:29.533223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 192
2025-10-10T14:31:29.533227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:29.533232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:29.533235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:29.533236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:29.533247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:29.533250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:29.533283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.533293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.533306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600668261363702:3211]
2025-10-10T14:31:29.533315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:29.533348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:29.533358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:29.533366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.533374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.533376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:29.533386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.533398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:29.533424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.533595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.533605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.533620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.533722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 193 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0
2025-10-10T14:31:29.534063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7acc95d7-13a98a3c-c9487d23-a00cdf50_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:29.536631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0] Write session: try to update token
2025-10-10T14:31:29.536646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:29.550078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId: src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:29.552564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:29.552865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.552885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.552908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:29.552916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:29.552918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:29.552920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:29.552928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600668261363702:3211]
2025-10-10T14:31:29.552937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600668261363702:3211]
2025-10-10T14:31:29.552940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600668261363702:3211]
2025-10-10T14:31:29.552978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:29.552988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:29.552992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:29.552999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:29.553010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.553017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:29.553150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:29.611977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600669043573139:3080]
2025-10-10T14:31:29.612228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 192, pipe: [1:7559600669043573139:3080]
2025-10-10T14:31:29.656269Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:29.656624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:29.656680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573139:3080], now have 1 active actors on pipe
2025-10-10T14:31:29.656767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:29.656896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:29.656944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600669043573139:3080]
2025-10-10T14:31:29.666852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:29.666866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:29.666892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 193 reason: error at write: Disconnected sessionId: src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0
2025-10-10T14:31:29.667041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 193 sessionId: src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0 is DEAD
2025-10-10T14:31:29.667206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:29.667219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0] Write session will restart in 0.007056s
2025-10-10T14:31:29.667243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0] Write session: Do CDS request
2025-10-10T14:31:29.667250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:29.675630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:29.675810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.675899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:29.675912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 194
2025-10-10T14:31:29.676024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.676052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:29.676059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:29.676063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:29.676458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 194 sessionId:  describe result for acl check
2025-10-10T14:31:29.676495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:29.676502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:29.676504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:29.676510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600669043573351:3607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:29.676715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:29.676875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:29.676885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:29.676898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:29.676947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:29.676989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600668261363956:3214]
2025-10-10T14:31:29.677070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600669043573351:3607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:29.677582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:29.677871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:29.677914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:29.678221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:29.678275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.678281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.678282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.678283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.678284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.678285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.678287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.678287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.678289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.678290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.678291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.678292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.678293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.678299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.678310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.678315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.678319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.678323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.678327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.678330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.678334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.678338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.678342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.678346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.678350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.678354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.678360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.678372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.678384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.678393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.678401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.678405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.678413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.678417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.678421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.678427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.678435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.678444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.678453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.678462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.678469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.678474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.678483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.678490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.678499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.678507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.678515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.678523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.678535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.678544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.678552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.678556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.678599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:29.678841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600669043573351:3607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:29.680764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:29.681030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600669043573351:3607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:29.681041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600669043573351:3607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:29.681045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600669043573351:3607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:29.681051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:29.681269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:29.681282Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:29.681284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:29.681287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:29.681293Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 193 [2:7559600668261363956:3214]
2025-10-10T14:31:29.681305Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:29.681319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:29.681321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.681323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.681325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.681350Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:29.681357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:29.681364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:29.681412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.681418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.681420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.681423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:29.681487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:29.681494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.681505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.681521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.681541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:29.681566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573384:3607], now have 1 active actors on pipe
2025-10-10T14:31:29.681573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573141:2438], now have 1 active actors on pipe
2025-10-10T14:31:29.681582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600668261363951:3214]
2025-10-10T14:31:29.681588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600668261363951:3214]
2025-10-10T14:31:29.681590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600668261363951:3214]
2025-10-10T14:31:29.681593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 193
2025-10-10T14:31:29.681602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:29.681599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 193
2025-10-10T14:31:29.681619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:29.681624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:29.681628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:29.681629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:29.681637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:29.681642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:29.681674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.681682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.681701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600668261363951:3214]
2025-10-10T14:31:29.681713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:29.681726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:29.681741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:29.681752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.681757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.681763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:29.681775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.681791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:29.681820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.681929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.681937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.681952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.682031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 194 partition: 0 MaxSeqNo: 40 sessionId: src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0
2025-10-10T14:31:29.682284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4e32c10-bf522d5-54e98a49-6a08b2a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:29.684985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0] Write session: try to update token
2025-10-10T14:31:29.685000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:29.698578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId: src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:29.699722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:29.699737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:29.699741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:29.699743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:29.699752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600668261363951:3214]
2025-10-10T14:31:29.699756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600668261363951:3214]
2025-10-10T14:31:29.699760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600668261363951:3214]
2025-10-10T14:31:29.699808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:29.699821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.699823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:29.699825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:29.699831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:29.699835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:29.699954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:29.700888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:29.756861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600669043573391:3080]
2025-10-10T14:31:29.757094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 193, pipe: [1:7559600669043573391:3080]
2025-10-10T14:31:29.803610Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:29.803955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.803968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.804004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573391:3080], now have 1 active actors on pipe
2025-10-10T14:31:29.804182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:29.804280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:29.804295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:29.804301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:29.804340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600669043573391:3080]
2025-10-10T14:31:29.804366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 194 reason: error at write: Disconnected sessionId: src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0
2025-10-10T14:31:29.804623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 194 sessionId: src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0 is DEAD
2025-10-10T14:31:29.804751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:29.804762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0] Write session will restart in 0.005414s
2025-10-10T14:31:29.804785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0] Write session: Do CDS request
2025-10-10T14:31:29.804794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:29.811891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.811964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:29.811977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 195
2025-10-10T14:31:29.812145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.812172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:29.812181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:29.812185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:29.812556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 195 sessionId:  describe result for acl check
2025-10-10T14:31:29.812582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:29.812588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:29.812589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:29.812594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600669043573408:3611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:29.813043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600669043573408:3611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:29.815792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600669043573408:3611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:29.818914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600669043573408:3611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:29.818927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600669043573408:3611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:29.818931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600669043573408:3611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:29.818940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:29.821793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:29.822965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:29.823193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:29.823204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:29.823216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:29.823271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:29.823312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600668261364204:3216]
2025-10-10T14:31:29.823918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:29.824245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:29.824293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:29.824610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:29.824662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.824672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.824673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.824674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.824675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.824676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.824677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.824679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.824679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.824680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.824681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.824682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.824683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.824689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.824700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.824704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.824708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.824712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.824716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.824719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.824723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.824727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.824731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.824734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.824738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.824742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.824750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.824758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.824765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.824771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.824775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.824780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.824785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.824790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.824795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.824800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.824804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.824810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.824814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.824819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.824823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.824828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.824833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.824838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.824850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.824855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.824863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.824867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.824871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.824876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.824879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.824884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.824922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:29.827093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:29.827956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:29.827967Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:29.827969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:29.827973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:29.827979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 194 [2:7559600668261364204:3216]
2025-10-10T14:31:29.827990Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:29.828010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:29.828013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.828017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.828019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.828036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:29.828048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:29.828055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:29.828114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.828120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.828122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.828124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:29.828189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:29.828197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.828209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.828221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.828233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:29.828251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573392:2438], now have 1 active actors on pipe
2025-10-10T14:31:29.828259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573561:3611], now have 1 active actors on pipe
2025-10-10T14:31:29.828268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600668261364199:3216]
2025-10-10T14:31:29.828271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600668261364199:3216]
2025-10-10T14:31:29.828273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600668261364199:3216]
2025-10-10T14:31:29.828285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:29.828295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:29.828305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:29.828304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:29.828307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:29.828308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:29.828310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:29.828328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600668261364199:3216]
2025-10-10T14:31:29.828331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:29.828323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 194
2025-10-10T14:31:29.828341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:29.828324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 194
2025-10-10T14:31:29.828364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.828371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.828400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:29.828409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.828411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.828413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:29.828421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.828429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:29.828441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.828575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.828585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.828601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.828696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 195 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0
2025-10-10T14:31:29.829066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df6925c9-a524f2a9-2dd4020-b0789a79_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:29.831614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0] Write session: try to update token
2025-10-10T14:31:29.831630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:29.845353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId: src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:29.846544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:29.846564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:29.846567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:29.846570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:29.846579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600668261364199:3216]
2025-10-10T14:31:29.846584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600668261364199:3216]
2025-10-10T14:31:29.846587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600668261364199:3216]
2025-10-10T14:31:29.846637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:29.846650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.846652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:29.846793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:29.847126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:29.847139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:29.847142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:29.847884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:29.904290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600669043573644:3080]
2025-10-10T14:31:29.904582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 194, pipe: [1:7559600669043573644:3080]
2025-10-10T14:31:29.960653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:29.960904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.960921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.960966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573644:3080], now have 1 active actors on pipe
2025-10-10T14:31:29.961151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:29.961177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:29.961187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600669043573644:3080]
2025-10-10T14:31:29.961193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:29.961196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:29.961251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 195 reason: error at write: Disconnected sessionId: src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0
2025-10-10T14:31:29.961460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 195 sessionId: src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0 is DEAD
2025-10-10T14:31:29.961599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:29.961611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0] Write session will restart in 0.008282s
2025-10-10T14:31:29.961645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0] Write session: Do CDS request
2025-10-10T14:31:29.961654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:29.970817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.970880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:29.970895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 196
2025-10-10T14:31:29.971018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:29.971054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:29.971064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:29.971071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:29.971532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 196 sessionId:  describe result for acl check
2025-10-10T14:31:29.971567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:29.971573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:29.971575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:29.971581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600669043573701:3615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:29.972059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600669043573701:3615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:29.974654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600669043573701:3615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:29.977120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600669043573701:3615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:29.977133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600669043573701:3615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:29.977115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:29.977137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600669043573701:3615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:29.977143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:29.978226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:29.978506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:29.978517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:29.978530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:29.978587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:29.978624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600668261364454:3218]
2025-10-10T14:31:29.979195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:29.979432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:29.979474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:29.979777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:29.979825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.979831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.979832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.979833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.979834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.979836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.979837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.979838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.979839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.979840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.979841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.979842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.979843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.979849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.979861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.979865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.979869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.979873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.979877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.979881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.979889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.979893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.979897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.979905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.979909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.979913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.979921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.979929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:29.979935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.979945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:29.979953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.979958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:29.979966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.979971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:29.979979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.979988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:29.979998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.980006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:29.980016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.980024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:29.980033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.980041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:29.980050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.980059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:29.980066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.980073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:29.980081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.980086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.980094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.980100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.980108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.980118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.980162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:29.982378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:29.982810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:29.982821Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:29.982823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:29.982826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:29.982832Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 195 [2:7559600668261364454:3218]
2025-10-10T14:31:29.982843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:29.982860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:29.982867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.982869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.982871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.982884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:29.982895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:29.982908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:29.982963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.982969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.982971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.982973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:29.983034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:29.983041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:29.983052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:29.983070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:29.983088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:29.983109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573886:3615], now have 1 active actors on pipe
2025-10-10T14:31:29.983117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600669043573648:2438], now have 1 active actors on pipe
2025-10-10T14:31:29.983124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600668261364448:3218]
2025-10-10T14:31:29.983131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600668261364448:3218]
2025-10-10T14:31:29.983133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600668261364448:3218]
2025-10-10T14:31:29.983148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:29.983164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:29.983166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:29.983152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 195
2025-10-10T14:31:29.983172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:29.983182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:29.983183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:29.983185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:29.983212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600668261364448:3218]
2025-10-10T14:31:29.983220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:29.983200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 195
2025-10-10T14:31:29.983227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:29.983247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.983255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.983291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:29.983302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:29.983310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:29.983312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:29.983323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:29.983337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:29.983356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.983504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:29.983514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:29.983530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:29.983627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 196 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0
2025-10-10T14:31:29.983974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7b82-860ee021-ffcde74e-83c3174d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:29.986557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0] Write session: try to update token
2025-10-10T14:31:29.986577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:30.000855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId: src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:30.001683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:30.001698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:30.001701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:30.001703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:30.001713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600668261364448:3218]
2025-10-10T14:31:30.001717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600668261364448:3218]
2025-10-10T14:31:30.001721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600668261364448:3218]
2025-10-10T14:31:30.001766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:30.001770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:30.001777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:30.001780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:30.001781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.001784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:30.001913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:30.003668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:30.061505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600673338541194:3080]
2025-10-10T14:31:30.061788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 195, pipe: [1:7559600673338541194:3080]
2025-10-10T14:31:30.108140Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:30.108479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.108493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.108533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541194:3080], now have 1 active actors on pipe
2025-10-10T14:31:30.108685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:30.108758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600673338541194:3080]
2025-10-10T14:31:30.108762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:30.108766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:30.108784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:30.108828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 196 reason: error at write: Disconnected sessionId: src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0
2025-10-10T14:31:30.109026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 196 sessionId: src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0 is DEAD
2025-10-10T14:31:30.109207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:30.109220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0] Write session will restart in 0.008170s
2025-10-10T14:31:30.109244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0] Write session: Do CDS request
2025-10-10T14:31:30.109254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:30.118794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.118852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:30.118878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 197
2025-10-10T14:31:30.119018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.119051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:30.119061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:30.119065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:30.119417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 197 sessionId:  describe result for acl check
2025-10-10T14:31:30.119448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:30.119455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:30.119457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:30.119461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600673338541276:3620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:30.119912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600673338541276:3620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:30.122681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600673338541276:3620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:30.125113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600673338541276:3620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:30.125127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600673338541276:3620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:30.125130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600673338541276:3620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:30.125137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:30.125278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:30.125682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:30.125849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:30.125861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:30.125871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:30.125915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:30.125954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600672556332013:3221]
2025-10-10T14:31:30.126556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:30.126857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:30.126896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:30.127205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:30.127263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.127269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.127270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.127271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.127272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.127273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.127274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.127275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.127277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.127278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.127279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.127280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.127281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.127287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.127299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.127303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.127307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.127311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.127315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.127319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.127323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.127327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.127332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.127335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.127339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.127348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.127355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.127364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.127374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.127380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.127388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.127393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.127397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.127403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.127411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.127416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.127421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.127426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.127430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.127436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.127444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.127449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.127457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.127467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.127471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.127476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.127482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.127487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.127493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.127499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.127504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.127512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.127536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:30.129639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:30.130117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:30.130129Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:30.130131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:30.130134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:30.130140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 196 [2:7559600672556332013:3221]
2025-10-10T14:31:30.130152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:30.130167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:30.130175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.130178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.130180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.130196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:30.130207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:30.130227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:30.130274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.130281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.130283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.130285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:30.130350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:30.130357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.130369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.130387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.130405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:30.130425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541207:2438], now have 1 active actors on pipe
2025-10-10T14:31:30.130434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541452:3620], now have 1 active actors on pipe
2025-10-10T14:31:30.130440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600672556332007:3221]
2025-10-10T14:31:30.130443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600672556332007:3221]
2025-10-10T14:31:30.130444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600672556332007:3221]
2025-10-10T14:31:30.130459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:30.130479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:30.130477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:30.130482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:30.130484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:30.130462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 196
2025-10-10T14:31:30.130483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 196
2025-10-10T14:31:30.130500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:30.130507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:30.130542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.130550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.130565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600672556332007:3221]
2025-10-10T14:31:30.130577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:30.130593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:30.130610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:30.130622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.130629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.130632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:30.130641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.130656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:30.130677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.130825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.130833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.130847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.130957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 197 partition: 0 MaxSeqNo: 40 sessionId: src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0
2025-10-10T14:31:30.131102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:31:30.131116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:31:30.131302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb96256b-7a57cef0-5a74288e-4ad308b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:30.131306Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:31:30.131528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:31:30.131655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:31:30.131705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-10T14:31:30.133826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0] Write session: try to update token
2025-10-10T14:31:30.133841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:30.146709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId: src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:30.148246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:30.148262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:30.148264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:30.148265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:30.148273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600672556332007:3221]
2025-10-10T14:31:30.148276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600672556332007:3221]
2025-10-10T14:31:30.148279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600672556332007:3221]
2025-10-10T14:31:30.148328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:30.148329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:30.148335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:30.148335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.148338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:30.148339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:30.148470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:30.149457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:30.208978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600673338541469:3080]
2025-10-10T14:31:30.209344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 196, pipe: [1:7559600673338541469:3080]
2025-10-10T14:31:30.251283Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:30.251677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.251691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.251728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541469:3080], now have 1 active actors on pipe
2025-10-10T14:31:30.251870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:30.251942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:30.251997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600673338541469:3080]
2025-10-10T14:31:30.252017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:30.252094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 197 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0
2025-10-10T14:31:30.252278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 197 sessionId: src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0 is DEAD
2025-10-10T14:31:30.252462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:30.252473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0] Write session will restart in 0.005599s
2025-10-10T14:31:30.252497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0] Write session: Do CDS request
2025-10-10T14:31:30.252503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:30.258839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.258934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:30.258951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 198
2025-10-10T14:31:30.259078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.259104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:30.259111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:30.259114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:30.259442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 198 sessionId:  describe result for acl check
2025-10-10T14:31:30.259471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:30.259476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:30.259478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:30.259483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600673338541501:3630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:30.259894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600673338541501:3630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:30.262753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600673338541501:3630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:30.266135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600673338541501:3630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:30.266146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600673338541501:3630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:30.266149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600673338541501:3630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:30.266155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:30.268597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:30.269839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:30.270018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:30.270029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:30.270039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:30.270087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:30.270184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600672556332297:3230]
2025-10-10T14:31:30.270753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:30.271035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:30.271068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:30.271339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:30.271380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.271385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.271385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.271386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.271387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.271387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.271388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.271389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.271389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.271390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.271390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.271391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.271391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.271395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.271403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.271406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.271410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.271414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.271418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.271421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.271425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.271429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.271433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.271437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.271441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.271444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.271452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.271466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.271478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.271487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.271496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.271501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.271505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.271510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.271519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.271527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.271531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.271541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.271546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.271555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.271561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.271566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.271571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.271576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.271580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.271589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.271598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.271603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.271613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.271620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.271631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.271636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.271677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:30.273931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:30.274398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:30.274410Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:30.274412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:30.274416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:30.274422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 197 [2:7559600672556332297:3230]
2025-10-10T14:31:30.274434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:30.274451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:30.274454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.274458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.274461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.274476Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:30.274491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:30.274499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:30.274559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.274565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.274566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.274569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:30.274641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:30.274649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.274660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.274676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.274698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:30.274725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541486:2438], now have 1 active actors on pipe
2025-10-10T14:31:30.274733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541681:3630], now have 1 active actors on pipe
2025-10-10T14:31:30.274740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600672556332292:3230]
2025-10-10T14:31:30.274746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600672556332292:3230]
2025-10-10T14:31:30.274748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600672556332292:3230]
2025-10-10T14:31:30.274760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:30.274778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:30.274781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:30.274781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:30.274782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:30.274797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:30.274800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:30.274822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600672556332292:3230]
2025-10-10T14:31:30.274828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:30.274831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:30.274805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 197
2025-10-10T14:31:30.274849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 197
2025-10-10T14:31:30.274976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.274987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.275019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:30.275031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.275035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.275037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:30.275047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.275058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:30.275073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.275276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.275285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.275303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.275399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 198 partition: 0 MaxSeqNo: 40 sessionId: src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0
2025-10-10T14:31:30.275780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df9f6e67-dd03d11b-47ac6ba5-7140afc1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:30.278502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0] Write session: try to update token
2025-10-10T14:31:30.278522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:30.292792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId: src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:30.294065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:30.294081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:30.294085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:30.294087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:30.294096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600672556332292:3230]
2025-10-10T14:31:30.294102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600672556332292:3230]
2025-10-10T14:31:30.294106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600672556332292:3230]
2025-10-10T14:31:30.294156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:30.294158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:30.294166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:30.294168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.294169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:30.294170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:30.294318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:30.295560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:30.352343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600673338541752:3080]
2025-10-10T14:31:30.352663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 197, pipe: [1:7559600673338541752:3080]
2025-10-10T14:31:30.400254Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:30.400507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.400519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.400562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541752:3080], now have 1 active actors on pipe
2025-10-10T14:31:30.400751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:30.400789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:30.400802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600673338541752:3080]
2025-10-10T14:31:30.400825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:30.400897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 198 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0
2025-10-10T14:31:30.401102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 198 sessionId: src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0 is DEAD
2025-10-10T14:31:30.401229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:30.401239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0] Write session will restart in 0.008724s
2025-10-10T14:31:30.401258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0] Write session: Do CDS request
2025-10-10T14:31:30.401262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:30.410850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.410879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:30.410893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 199
2025-10-10T14:31:30.411090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.411128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:30.411137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:30.411141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:30.411569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 199 sessionId:  describe result for acl check
2025-10-10T14:31:30.411601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:30.411606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:30.411607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:30.411611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600673338541829:3637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:30.412047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600673338541829:3637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:30.414871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600673338541829:3637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:30.416751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:30.417813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:30.417843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600673338541829:3637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:30.417854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600673338541829:3637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:30.417857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600673338541829:3637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:30.417871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:30.417973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:30.417983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:30.417994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:30.418045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:30.418085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600672556332556:3239]
2025-10-10T14:31:30.418649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:30.418914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:30.418951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:30.419248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:30.419287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.419291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.419292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.419292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.419293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.419293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.419294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.419294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.419295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.419296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.419296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.419297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.419297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.419301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.419309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.419311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.419313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.419316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.419318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.419322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.419326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.419329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.419333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.419337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.419340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.419344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.419351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.419356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.419361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.419364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.419367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.419374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.419376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.419379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.419382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.419391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.419394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.419404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.419408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.419412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.419415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.419424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.419432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.419437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.419444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.419447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.419451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.419453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.419456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.419459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.419461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.419464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.419489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:30.421610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:30.422031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:30.422043Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:30.422045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:30.422048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:30.422053Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 198 [2:7559600672556332556:3239]
2025-10-10T14:31:30.422063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:30.422077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:30.422084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.422087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.422089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.422105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:30.422116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:30.422127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:30.422178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.422185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.422187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.422189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:30.422261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:30.422268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.422278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.422288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.422308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:30.422331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541997:3637], now have 1 active actors on pipe
2025-10-10T14:31:30.422338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338541753:2438], now have 1 active actors on pipe
2025-10-10T14:31:30.422345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600672556332551:3239]
2025-10-10T14:31:30.422351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600672556332551:3239]
2025-10-10T14:31:30.422352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600672556332551:3239]
2025-10-10T14:31:30.422365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:30.422360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 198
2025-10-10T14:31:30.422380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:30.422387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:30.422390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:30.422391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:30.422400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:30.422402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:30.422423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 198
2025-10-10T14:31:30.422434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.422442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.422456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600672556332551:3239]
2025-10-10T14:31:30.422462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:30.422484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:30.422494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47dd3269-adae4240-a621ec34-2c623822_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:30.422502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.422505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.422507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:30.422516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.422526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:30.422553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.422682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.422689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.422702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.422811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 199 partition: 0 MaxSeqNo: 40 sessionId: src_id|47dd3269-adae4240-a621ec34-2c623822_0
2025-10-10T14:31:30.423098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7151cafc-2f508a59-60889f6d-e3c3e8bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47dd3269-adae4240-a621ec34-2c623822_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:30.425572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47dd3269-adae4240-a621ec34-2c623822_0] Write session: try to update token
2025-10-10T14:31:30.425586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47dd3269-adae4240-a621ec34-2c623822_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:30.439323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId: src_id|47dd3269-adae4240-a621ec34-2c623822_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:30.441259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:30.441276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:30.441278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:30.441279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:30.441287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600672556332551:3239]
2025-10-10T14:31:30.441291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600672556332551:3239]
2025-10-10T14:31:30.441293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600672556332551:3239]
2025-10-10T14:31:30.441349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:30.441357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.441362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:30.441372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:30.441380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:30.441384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:30.441488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:30.442079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:30.500760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600673338542009:3080]
2025-10-10T14:31:30.500997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 198, pipe: [1:7559600673338542009:3080]
2025-10-10T14:31:30.544365Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:30.544675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.544690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.544738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542009:3080], now have 1 active actors on pipe
2025-10-10T14:31:30.544875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:30.544945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600673338542009:3080]
2025-10-10T14:31:30.544967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:30.544979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:30.545057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 199 reason: status is not ok: tablet will be restarted right now sessionId: src_id|47dd3269-adae4240-a621ec34-2c623822_0
2025-10-10T14:31:30.545279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 199 sessionId: src_id|47dd3269-adae4240-a621ec34-2c623822_0 is DEAD
2025-10-10T14:31:30.545444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47dd3269-adae4240-a621ec34-2c623822_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:30.545456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47dd3269-adae4240-a621ec34-2c623822_0] Write session will restart in 0.006447s
2025-10-10T14:31:30.545475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47dd3269-adae4240-a621ec34-2c623822_0] Write session: Do CDS request
2025-10-10T14:31:30.545481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47dd3269-adae4240-a621ec34-2c623822_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:30.552861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47dd3269-adae4240-a621ec34-2c623822_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.552898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:30.552914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 200
2025-10-10T14:31:30.553078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.553114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:30.553124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:30.553128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:30.553557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 200 sessionId:  describe result for acl check
2025-10-10T14:31:30.553595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:30.553600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:30.553601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:30.553617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600673338542057:3643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:30.554062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600673338542057:3643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:30.556623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600673338542057:3643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:30.559458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600673338542057:3643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:30.559469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600673338542057:3643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:30.559471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600673338542057:3643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:30.559478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:30.560415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:30.561324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:30.561553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:30.561563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:30.561572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:30.561615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:30.561646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600672556332813:3241]
2025-10-10T14:31:30.562048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:30.562352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:30.562406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:30.562725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:30.562779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.562785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.562787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.562788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.562789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.562790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.562791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.562792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.562793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.562795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.562796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.562797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.562798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.562804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.562817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.562821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.562825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.562829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.562833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.562837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.562843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.562848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.562857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.562861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.562868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.562873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.562880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.562892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.562903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.562913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.562922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.562931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.562939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.562945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.562953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.562959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.562967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.562973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.562982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.562990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.562994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.563003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.563012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.563021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.563029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.563039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.563047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.563053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.563062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.563071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.563080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.563089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.563131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:30.565256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:30.565702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:30.565713Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:30.565715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:30.565718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:30.565724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 199 [2:7559600672556332813:3241]
2025-10-10T14:31:30.565734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:30.565750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:30.565757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.565761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.565763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.565777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:30.565789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:30.565800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:30.565854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.565862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.565863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.565866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:30.565927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:30.565936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.565947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.565959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.565977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:30.566001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542017:2438], now have 1 active actors on pipe
2025-10-10T14:31:30.566009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542259:3643], now have 1 active actors on pipe
2025-10-10T14:31:30.566016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600672556332806:3241]
2025-10-10T14:31:30.566022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600672556332806:3241]
2025-10-10T14:31:30.566024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600672556332806:3241]
2025-10-10T14:31:30.566037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:30.566053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:30.566053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 199
2025-10-10T14:31:30.566061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 199
2025-10-10T14:31:30.566069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:30.566072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:30.566075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:30.566077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:30.566080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:30.566095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600672556332806:3241]
2025-10-10T14:31:30.566097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:30.566102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:30.566126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.566135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.566165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:30.566177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.566180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.566182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:30.566192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.566206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:30.566236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.566406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.566414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.566428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.566531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 200 partition: 0 MaxSeqNo: 40 sessionId: src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0
2025-10-10T14:31:30.566855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47dd3269-adae4240-a621ec34-2c623822_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:30.569438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0] Write session: try to update token
2025-10-10T14:31:30.569456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:30.583132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId: src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:30.584132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:30.584147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:30.584150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:30.584152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:30.584161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600672556332806:3241]
2025-10-10T14:31:30.584165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600672556332806:3241]
2025-10-10T14:31:30.584168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600672556332806:3241]
2025-10-10T14:31:30.584200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:30.584209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:30.584211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:30.584212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:30.584218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.584220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:30.584357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:30.585772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:30.645194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600673338542277:3080]
2025-10-10T14:31:30.645494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 199, pipe: [1:7559600673338542277:3080]
2025-10-10T14:31:30.699746Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:30.700102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.700116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.700161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542277:3080], now have 1 active actors on pipe
2025-10-10T14:31:30.700348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:30.700376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:30.700377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:30.700391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:30.700425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600673338542277:3080]
2025-10-10T14:31:30.700456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 200 reason: error at write: Disconnected sessionId: src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0
2025-10-10T14:31:30.700673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 200 sessionId: src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0 is DEAD
2025-10-10T14:31:30.700801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:30.700813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0] Write session will restart in 0.008518s
2025-10-10T14:31:30.700838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0] Write session: Do CDS request
2025-10-10T14:31:30.700849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:30.710716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.710846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:30.710861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 201
2025-10-10T14:31:30.711025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.711063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:30.711074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:30.711080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:30.711578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 201 sessionId:  describe result for acl check
2025-10-10T14:31:30.711610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:30.711617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:30.711619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:30.711624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600673338542368:3647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:30.712181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600673338542368:3647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:30.714615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600673338542368:3647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:30.716381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:30.717424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:30.717543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600673338542368:3647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:30.717558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600673338542368:3647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:30.717562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600673338542368:3647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:30.717571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:30.717626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:30.717634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:30.717647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:30.717705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:30.717747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600672556333067:3244]
2025-10-10T14:31:30.718342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:30.718578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:30.718617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:30.719076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:30.719136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.719143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.719144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.719145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.719146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.719147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.719149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.719150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.719151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.719152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.719153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.719154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.719155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.719160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.719173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.719177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.719181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.719184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.719187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.719191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.719195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.719199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.719204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.719208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.719212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.719216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.719223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.719232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.719238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.719244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.719249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.719254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.719263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.719269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.719277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.719284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.719293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.719300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.719305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.719314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.719318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.719327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.719338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.719347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.719355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.719360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.719369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.719378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.719386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.719392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.719399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.719404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.719446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:30.721614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:30.721930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:30.721943Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:30.721946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:30.721950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:30.721956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 200 [2:7559600672556333067:3244]
2025-10-10T14:31:30.721968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:30.721987Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:30.721994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.721997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.721999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.722015Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:30.722028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:30.722039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:30.722096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.722102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.722104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.722106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:30.722167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:30.722174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.722185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.722202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.722233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:30.722266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 200
2025-10-10T14:31:30.722259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542278:2438], now have 1 active actors on pipe
2025-10-10T14:31:30.722272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542524:3647], now have 1 active actors on pipe
2025-10-10T14:31:30.722279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600672556333062:3244]
2025-10-10T14:31:30.722282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600672556333062:3244]
2025-10-10T14:31:30.722293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 200
2025-10-10T14:31:30.722284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600672556333062:3244]
2025-10-10T14:31:30.722291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:30.722304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:30.722316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:30.722318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:30.722319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:30.722320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:30.722323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:30.722358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.722367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.722381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600672556333062:3244]
2025-10-10T14:31:30.722388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:30.722392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:30.722421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:30.722433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.722438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.722440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:30.722451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.722461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:30.722482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.722646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.722653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.722668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.722767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 201 partition: 0 MaxSeqNo: 40 sessionId: src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0
2025-10-10T14:31:30.723097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68bae14f-7db3f46-c850d48e-6c9a9b2c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:30.725519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0] Write session: try to update token
2025-10-10T14:31:30.725533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:30.738592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId: src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:30.741033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:30.741051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:30.741054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:30.741056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:30.741068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600672556333062:3244]
2025-10-10T14:31:30.741073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600672556333062:3244]
2025-10-10T14:31:30.741077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600672556333062:3244]
2025-10-10T14:31:30.741122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:30.741124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:30.741129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:30.741130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.741132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:30.741132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:30.741265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:30.741268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:30.800845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600673338542536:3080]
2025-10-10T14:31:30.801129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 200, pipe: [1:7559600673338542536:3080]
2025-10-10T14:31:30.848119Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:30.848639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.848653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.848693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542536:3080], now have 1 active actors on pipe
2025-10-10T14:31:30.848880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:30.848886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:30.848862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:30.848889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:30.848934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600673338542536:3080]
2025-10-10T14:31:30.848946Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:31:30.848954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 201 reason: error at write: Disconnected sessionId: src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0
2025-10-10T14:31:30.849047Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_8230090722560249550_v1 is DEAD
2025-10-10T14:31:30.849053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 201 sessionId: src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0 is DEAD
2025-10-10T14:31:30.849155Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600613208978867:3077] disconnected; active server actors: 1
2025-10-10T14:31:30.849163Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600613208978867:3077] client user disconnected session shared/user_1_2_8230090722560249550_v1
2025-10-10T14:31:30.849373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:30.849386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0] Write session will restart in 0.008011s
2025-10-10T14:31:30.849372Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:31:30.849409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0] Write session: Do CDS request
2025-10-10T14:31:30.849414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:30.849483Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:30.849487Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:30.849491Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009293s
2025-10-10T14:31:30.858787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.858848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:30.858860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 202
2025-10-10T14:31:30.858990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:30.859026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:30.859033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:30.859037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:30.859397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 202 sessionId:  describe result for acl check
2025-10-10T14:31:30.859432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:30.859439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:30.859441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:30.859446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600673338542607:3651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:30.859570Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:31:30.859686Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:30.859695Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-10T14:31:30.859814Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:30.859872Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:30.859951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600673338542607:3651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:30.859967Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 auth for : user
2025-10-10T14:31:30.860205Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 Handle describe topics response
2025-10-10T14:31:30.860228Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 auth is DEAD
2025-10-10T14:31:30.860246Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:30.860499Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:30.860554Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_3_14124424596769502290_v1
2025-10-10T14:31:30.860736Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600673338542648:3653] connected; active server actors: 1
2025-10-10T14:31:30.860749Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600673338542648:3653] session shared/user_1_3_14124424596769502290_v1
2025-10-10T14:31:30.860757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:31:30.860768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:31:30.860773Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_3_14124424596769502290_v1" (Sender=[1:7559600673338542615:3653], Pipe=[1:7559600673338542648:3653], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:30.860776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:30.860785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:31:30.860795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_14124424596769502290_v1" (Sender=[1:7559600673338542615:3653], Pipe=[1:7559600673338542648:3653], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:30.860805Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_3_14124424596769502290_v1" sender [1:7559600673338542615:3653] lock partition 0 for ReadingSession "shared/user_1_3_14124424596769502290_v1" (Sender=[1:7559600673338542615:3653], Pipe=[1:7559600673338542648:3653], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-10T14:31:30.860815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:31:30.860823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000032s
2025-10-10T14:31:30.860991Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_3_14124424596769502290_v1" ClientId: "user" PipeClient { RawX1: 7559600673338542648 RawX2: 4503603922341445 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:30.861011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:30.862473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600673338542607:3651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:30.864817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600673338542607:3651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:30.864827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600673338542607:3651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:30.864830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600673338542607:3651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:30.864835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:30.864857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:30.865895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:30.866061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:30.866071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:30.866083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:30.866130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:30.866168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600672556333325:3246]
2025-10-10T14:31:30.866740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:30.866955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:30.866991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:30.867283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:30.867332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.867338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.867339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.867340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.867341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.867342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.867343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.867345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.867346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.867347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.867348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.867349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.867350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.867355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.867368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.867372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.867375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.867379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.867383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.867387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.867391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.867394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.867398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.867402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.867406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.867409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.867415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.867425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:30.867431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.867437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:30.867440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.867445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:30.867449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.867454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:30.867459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.867463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:30.867467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.867472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:30.867477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.867481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:30.867485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.867490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:30.867494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.867503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:30.867508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.867512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:30.867517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.867524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.867528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.867533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.867536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.867540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.867579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:30.869583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:30.870206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:30.870227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:30.870229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:30.870232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:30.870237Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 201 [2:7559600672556333325:3246]
2025-10-10T14:31:30.870249Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:30.870267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:30.870270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.870273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.870275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.870291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:30.870303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:30.870310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:30.870363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.870369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.870371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.870373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:30.870434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:30.870441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.870452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:30.870464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:30.870485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:30.870508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542537:2438], now have 1 active actors on pipe
2025-10-10T14:31:30.870516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542669:3658], now have 1 active actors on pipe
2025-10-10T14:31:30.870518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542790:3651], now have 1 active actors on pipe
2025-10-10T14:31:30.870526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600672556333319:3246]
2025-10-10T14:31:30.870528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600672556333319:3246]
2025-10-10T14:31:30.870530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600672556333319:3246]
2025-10-10T14:31:30.870543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:30.870549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 201
2025-10-10T14:31:30.870551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:30.870555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:30.870555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 201, pipe: [1:7559600673338542669:3658]
2025-10-10T14:31:30.870556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:30.870576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 201
2025-10-10T14:31:30.870562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:30.870578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:30.870580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:30.870615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.870624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.870639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_3_14124424596769502290_v1 on pipe: [1:7559600673338542669:3658]
2025-10-10T14:31:30.870659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600672556333319:3246]
2025-10-10T14:31:30.870669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:30.870673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:30.870675Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_14124424596769502290_v1:1 with generation 201
2025-10-10T14:31:30.870679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.870681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.870698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.870705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.870707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:30.870723Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_3_14124424596769502290_v1
2025-10-10T14:31:30.870729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.870767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:30.870777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:31:30.870785Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:30.874742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:30.874766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:30.874774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:30.874783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:30.874785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:30.874797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:30.874812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:30.874822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:30.874837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:30.874852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.874968Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106690869 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:30.874982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:31:30.875012Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 sending to client partition status
2025-10-10T14:31:30.875027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.875036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.875053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:30.875156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 202 partition: 0 MaxSeqNo: 40 sessionId: src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0
2025-10-10T14:31:30.875480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|433a246e-11b8d915-c9d83b1e-fdd0badc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:30.877993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0] Write session: try to update token
2025-10-10T14:31:30.878007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:30.888750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:30.888767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:30.888770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:30.888772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:30.888782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600672556333319:3246]
2025-10-10T14:31:30.888787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600672556333319:3246]
2025-10-10T14:31:30.888791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600672556333319:3246]
2025-10-10T14:31:30.888834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:30.888840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:30.888846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:30.888846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:30.888849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:30.888850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:30.888979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:30.891554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId: src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:30.894200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:30.995001Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:30.995327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:30.995340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:30.995533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_14124424596769502290_v1
2025-10-10T14:31:30.995553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:30.995567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:30.995583Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_14124424596769502290_v1
2025-10-10T14:31:30.995579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:30.995582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:30.995626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600673338542669:3658]
2025-10-10T14:31:30.995654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 202 reason: error at write: Disconnected sessionId: src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0
2025-10-10T14:31:30.995868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 202 sessionId: src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0 is DEAD
2025-10-10T14:31:30.995995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:30.996005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0] Write session will restart in 0.008230s
2025-10-10T14:31:30.996035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0] Write session: Do CDS request
2025-10-10T14:31:30.996039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:31.005893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.005977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:31.005992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 203
2025-10-10T14:31:31.006111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.006159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:31.006171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:31.006175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:31.006596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 203 sessionId:  describe result for acl check
2025-10-10T14:31:31.006633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:31.006640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:31.006642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:31.006648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600677633510187:3659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:31.007186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600677633510187:3659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:31.009777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600677633510187:3659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:31.011700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:31.012961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:31.013034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600677633510187:3659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:31.013047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600677633510187:3659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:31.013050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600677633510187:3659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:31.013056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:31.013141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:31.013155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:31.013167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:31.013218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:31.013260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600676851300879:3248]
2025-10-10T14:31:31.013887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:31.014179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:31.014227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:31.014528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:31.014582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.014588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.014589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.014590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.014591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.014592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.014593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.014595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.014596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.014597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.014598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.014599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.014600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.014606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.014619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.014623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.014628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.014632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.014636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.014640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.014644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.014648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.014653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.014656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.014661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.014670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.014677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.014690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.014700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.014710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.014718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.014723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.014732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.014741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.014751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.014761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.014765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.014770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.014779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.014784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.014788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.014797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.014806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.014815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.014820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.014827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.014831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.014837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.014841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.014847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.014851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.014860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.014900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:31.017157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:31.017717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:31.017729Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:31.017731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:31.017735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:31.017741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 202 [2:7559600676851300879:3248]
2025-10-10T14:31:31.017754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:31.017770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:31.017779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.017783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.017787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.017804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:31.017815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:31.017827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:31.017887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.017895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.017897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.017899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:31.017965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:31.017973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.017984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.017997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.018019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:31.018046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510348:3659], now have 1 active actors on pipe
2025-10-10T14:31:31.018054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600673338542804:2438], now have 1 active actors on pipe
2025-10-10T14:31:31.018062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600676851300874:3248]
2025-10-10T14:31:31.018070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600676851300874:3248]
2025-10-10T14:31:31.018072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600676851300874:3248]
2025-10-10T14:31:31.018090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:31.018104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:31.018111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:31.018118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:31.018119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:31.018122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:31.018122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:31.018126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 202
2025-10-10T14:31:31.018144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600676851300874:3248]
2025-10-10T14:31:31.018168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 202
2025-10-10T14:31:31.018155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:31.018156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:31.018179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.018184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.018217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8da822e1-fb48a298-5c905df0-2849c864_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:31.018239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.018247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.018249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:31.018262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.018273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:31.018306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.018446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.018458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.018473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.018549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 203 partition: 0 MaxSeqNo: 40 sessionId: src_id|8da822e1-fb48a298-5c905df0-2849c864_0
2025-10-10T14:31:31.018902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc1211a-c3c249f0-58bbc7c9-425a9d0f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8da822e1-fb48a298-5c905df0-2849c864_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:31.021401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8da822e1-fb48a298-5c905df0-2849c864_0] Write session: try to update token
2025-10-10T14:31:31.021418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8da822e1-fb48a298-5c905df0-2849c864_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:31.035370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId: src_id|8da822e1-fb48a298-5c905df0-2849c864_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:31.036203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:31.036219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:31.036223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:31.036225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:31.036234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600676851300874:3248]
2025-10-10T14:31:31.036239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600676851300874:3248]
2025-10-10T14:31:31.036243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600676851300874:3248]
2025-10-10T14:31:31.036295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:31.036305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.036314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:31.036329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:31.036340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:31.036343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:31.036452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:31.038317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:31.095760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600677633510371:3658]
2025-10-10T14:31:31.096002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 202, pipe: [1:7559600677633510371:3658]
2025-10-10T14:31:31.141521Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:31.141896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.141911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.141949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510371:3658], now have 1 active actors on pipe
2025-10-10T14:31:31.142111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:31.142194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:31.142196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:31.142209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:31.142262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600677633510371:3658]
2025-10-10T14:31:31.142273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 203 reason: error at write: Disconnected sessionId: src_id|8da822e1-fb48a298-5c905df0-2849c864_0
2025-10-10T14:31:31.142424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 203 sessionId: src_id|8da822e1-fb48a298-5c905df0-2849c864_0 is DEAD
2025-10-10T14:31:31.142547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da822e1-fb48a298-5c905df0-2849c864_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:31.142556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da822e1-fb48a298-5c905df0-2849c864_0] Write session will restart in 0.009112s
2025-10-10T14:31:31.142575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da822e1-fb48a298-5c905df0-2849c864_0] Write session: Do CDS request
2025-10-10T14:31:31.142581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da822e1-fb48a298-5c905df0-2849c864_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:31.152802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8da822e1-fb48a298-5c905df0-2849c864_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.152894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:31.152912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 204
2025-10-10T14:31:31.153031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.153068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:31.153078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:31.153082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:31.153568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 204 sessionId:  describe result for acl check
2025-10-10T14:31:31.153605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:31.153611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:31.153613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:31.153619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600677633510468:3664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:31.154131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600677633510468:3664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:31.156663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600677633510468:3664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:31.158147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:31.159205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:31.159327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600677633510468:3664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:31.159338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600677633510468:3664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:31.159341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600677633510468:3664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:31.159347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:31.159375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:31.159386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:31.159397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:31.159449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:31.159487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600676851301147:3251]
2025-10-10T14:31:31.160079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:31.160359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:31.160398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:31.160690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:31.160752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.160758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.160760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.160761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.160762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.160763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.160764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.160765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.160766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.160767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.160769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.160770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.160771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.160776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.160790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.160794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.160799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.160803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.160807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.160811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.160814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.160818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.160823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.160827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.160831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.160835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.160842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.160850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.160856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.160865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.160875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.160884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.160892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.160899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.160909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.160918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.160926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.160931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.160939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.160944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.160952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.160959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.160967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.160973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.160981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.160987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.160996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.161001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.161009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.161013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.161023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.161032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.161070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:31.163258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:31.163732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:31.163744Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:31.163747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:31.163750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:31.163755Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 203 [2:7559600676851301147:3251]
2025-10-10T14:31:31.163766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:31.163782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:31.163789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.163792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.163794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.163809Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:31.163820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:31.163831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:31.163881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.163887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.163889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.163892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:31.163954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:31.163961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.163973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.163988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.164010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:31.164034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510622:3664], now have 1 active actors on pipe
2025-10-10T14:31:31.164042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510373:2438], now have 1 active actors on pipe
2025-10-10T14:31:31.164048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600676851301142:3251]
2025-10-10T14:31:31.164055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600676851301142:3251]
2025-10-10T14:31:31.164057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600676851301142:3251]
2025-10-10T14:31:31.164062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 203
2025-10-10T14:31:31.164069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 203
2025-10-10T14:31:31.164070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:31.164089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:31.164097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:31.164101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:31.164102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:31.164105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:31.164108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:31.164137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.164146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.164161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600676851301142:3251]
2025-10-10T14:31:31.164173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:31.164180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:31.164202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:31.164214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.164221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.164223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:31.164234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.164249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:31.164276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.164393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.164400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.164415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.164509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 204 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0
2025-10-10T14:31:31.164846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da822e1-fb48a298-5c905df0-2849c864_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:31.167337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0] Write session: try to update token
2025-10-10T14:31:31.167351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:31.180787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId: src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:31.182103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:31.182118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:31.182121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:31.182122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:31.182129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600676851301142:3251]
2025-10-10T14:31:31.182133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600676851301142:3251]
2025-10-10T14:31:31.182135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600676851301142:3251]
2025-10-10T14:31:31.182172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:31.182178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.182184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:31.182186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:31.182191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:31.182194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:31.182329Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:31.183556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:31.242204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600677633510633:3658]
2025-10-10T14:31:31.242531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 203, pipe: [1:7559600677633510633:3658]
2025-10-10T14:31:31.284860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:31.285273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.285285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.285323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510633:3658], now have 1 active actors on pipe
2025-10-10T14:31:31.285511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:31.285605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600677633510633:3658]
2025-10-10T14:31:31.285634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:31.285706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 204 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0
2025-10-10T14:31:31.285898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 204 sessionId: src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0 is DEAD
2025-10-10T14:31:31.286038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:31.286056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0] Write session will restart in 0.008583s
2025-10-10T14:31:31.286061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:31.286081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0] Write session: Do CDS request
2025-10-10T14:31:31.286089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:31.295864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.295997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:31.296014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 205
2025-10-10T14:31:31.296105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.296132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:31.296139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:31.296142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:31.296750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 205 sessionId:  describe result for acl check
2025-10-10T14:31:31.296784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:31.296786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:31.296788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:31.296793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600677633510693:3676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:31.297353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600677633510693:3676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:31.300167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600677633510693:3676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:31.303362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600677633510693:3676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:31.303378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600677633510693:3676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:31.303381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600677633510693:3676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:31.303388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:31.306235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:31.307259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:31.307434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:31.307444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:31.307455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:31.307503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:31.307542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600676851301420:3259]
2025-10-10T14:31:31.308137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:31.308384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:31.308426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:31.308740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:31.308791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.308797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.308798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.308799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.308800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.308801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.308803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.308804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.308805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.308806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.308807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.308808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.308809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.308814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.308826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.308831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.308835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.308838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.308842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.308847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.308851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.308855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.308859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.308863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.308867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.308871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.308878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.308887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.308893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.308898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.308903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.308908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.308912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.308916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.308921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.308931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.308934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.308940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.308944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.308950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.308958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.308963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.308968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.308978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.308983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.308992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.308997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.309002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.309010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.309015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.309020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.309025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.309059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:31.311137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:31.311448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:31.311458Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:31.311459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:31.311461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:31.311465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 204 [2:7559600676851301420:3259]
2025-10-10T14:31:31.311473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:31.311483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:31.311485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.311488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.311489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.311500Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:31.311506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:31.311512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:31.311550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.311556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.311557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.311558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:31.311707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:31.311714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.311722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.311729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.311740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:31.311742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 204
2025-10-10T14:31:31.311765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510651:2438], now have 1 active actors on pipe
2025-10-10T14:31:31.311773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510841:3676], now have 1 active actors on pipe
2025-10-10T14:31:31.311778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 204
2025-10-10T14:31:31.311781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600676851301415:3259]
2025-10-10T14:31:31.311783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600676851301415:3259]
2025-10-10T14:31:31.311785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600676851301415:3259]
2025-10-10T14:31:31.311794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:31.311800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:31.311803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:31.311804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:31.311807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:31.311823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:31.311827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:31.311845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.311852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.311879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600676851301415:3259]
2025-10-10T14:31:31.311891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:31.311901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:31.311914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26f36d90-3e869d96-95e6e782-a42a982d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:31.311925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.311929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.311936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:31.311945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.311956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:31.311983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.312190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.312199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.312216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.312291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 205 partition: 0 MaxSeqNo: 40 sessionId: src_id|26f36d90-3e869d96-95e6e782-a42a982d_0
2025-10-10T14:31:31.312622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e4dd58a-baa7627b-6b688125-da14d6c5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26f36d90-3e869d96-95e6e782-a42a982d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:31.315047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26f36d90-3e869d96-95e6e782-a42a982d_0] Write session: try to update token
2025-10-10T14:31:31.315061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26f36d90-3e869d96-95e6e782-a42a982d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:31.328254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId: src_id|26f36d90-3e869d96-95e6e782-a42a982d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:31.330036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:31.330051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:31.330055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:31.330057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:31.330066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600676851301415:3259]
2025-10-10T14:31:31.330070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600676851301415:3259]
2025-10-10T14:31:31.330074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600676851301415:3259]
2025-10-10T14:31:31.330110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:31.330115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:31.330118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:31.330122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:31.330130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.330133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:31.330290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:31.330780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:31.385546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600677633510923:3658]
2025-10-10T14:31:31.385815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 204, pipe: [1:7559600677633510923:3658]
2025-10-10T14:31:31.435349Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:31.435662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.435675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.435711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510923:3658], now have 1 active actors on pipe
2025-10-10T14:31:31.435887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:31.435957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:31.435957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:31.436006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600677633510923:3658]
2025-10-10T14:31:31.436029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 205 reason: status is not ok: tablet will be restarted right now sessionId: src_id|26f36d90-3e869d96-95e6e782-a42a982d_0
2025-10-10T14:31:31.436197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 205 sessionId: src_id|26f36d90-3e869d96-95e6e782-a42a982d_0 is DEAD
2025-10-10T14:31:31.436351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f36d90-3e869d96-95e6e782-a42a982d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:31.436357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f36d90-3e869d96-95e6e782-a42a982d_0] Write session will restart in 0.009058s
2025-10-10T14:31:31.436376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f36d90-3e869d96-95e6e782-a42a982d_0] Write session: Do CDS request
2025-10-10T14:31:31.436380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f36d90-3e869d96-95e6e782-a42a982d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:31.446844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26f36d90-3e869d96-95e6e782-a42a982d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.446889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:31.446907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 206
2025-10-10T14:31:31.447093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.447131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:31.447141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:31.447145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:31.447550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 206 sessionId:  describe result for acl check
2025-10-10T14:31:31.447585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:31.447586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:31.447587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:31.447592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600677633511052:3683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:31.448013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600677633511052:3683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:31.451113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600677633511052:3683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:31.451357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:31.452498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:31.452675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:31.452686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:31.452699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:31.452755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:31.452815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600676851301704:3268]
2025-10-10T14:31:31.453257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:31.453519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:31.453560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:31.453760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600677633511052:3683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:31.453777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600677633511052:3683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:31.453781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600677633511052:3683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:31.453790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:31.453853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:31.453917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.453925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.453926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.453927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.453928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.453929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.453930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.453932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.453932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.453933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.453934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.453935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.453937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.453942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.453956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.453960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.453964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.453968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.453972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.453976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.453980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.453984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.453989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.453992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.453996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.453998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.454004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.454010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.454015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.454018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.454020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.454023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.454026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.454029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.454032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.454035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.454038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.454041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.454043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.454046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.454049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.454052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.454054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.454057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.454061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.454064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.454067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.454070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.454073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.454076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.454078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.454081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.454105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:31.456319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:31.456922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:31.456935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:31.456937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:31.456941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:31.456947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 205 [2:7559600676851301704:3268]
2025-10-10T14:31:31.456960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:31.456980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:31.456987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.456990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.456992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.457013Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:31.457025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:31.457036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:31.457096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.457103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.457105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.457107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:31.457177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:31.457187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.457197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.457208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.457224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:31.457247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511178:3683], now have 1 active actors on pipe
2025-10-10T14:31:31.457255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633510924:2438], now have 1 active actors on pipe
2025-10-10T14:31:31.457262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600676851301699:3268]
2025-10-10T14:31:31.457264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600676851301699:3268]
2025-10-10T14:31:31.457267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600676851301699:3268]
2025-10-10T14:31:31.457279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:31.457288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:31.457295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:31.457295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:31.457297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:31.457311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:31.457320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:31.457315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 205
2025-10-10T14:31:31.457318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 205
2025-10-10T14:31:31.457360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600676851301699:3268]
2025-10-10T14:31:31.457369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:31.457370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:31.457385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.457394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.457444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:31.457460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.457465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.457467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:31.457479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.457490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:31.457517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.457639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.457649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.457664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.457748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 206 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0
2025-10-10T14:31:31.458129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26f36d90-3e869d96-95e6e782-a42a982d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:31.460686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0] Write session: try to update token
2025-10-10T14:31:31.460702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:31.474454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId: src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:31.475778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:31.475797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:31.475799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:31.475800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:31.475808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600676851301699:3268]
2025-10-10T14:31:31.475811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600676851301699:3268]
2025-10-10T14:31:31.475815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600676851301699:3268]
2025-10-10T14:31:31.475853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:31.475859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.475859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:31.475861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:31.475867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:31.475870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:31.475982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:31.477058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:31.536082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600677633511194:3658]
2025-10-10T14:31:31.536416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 205, pipe: [1:7559600677633511194:3658]
2025-10-10T14:31:31.579921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:31.580312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.580333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.580384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511194:3658], now have 1 active actors on pipe
2025-10-10T14:31:31.580583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:31.580626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:31.580628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600677633511194:3658]
2025-10-10T14:31:31.580641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:31.580644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:31.580701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 206 reason: error at write: Disconnected sessionId: src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0
2025-10-10T14:31:31.580912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 206 sessionId: src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0 is DEAD
2025-10-10T14:31:31.581067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:31.581077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0] Write session will restart in 0.006346s
2025-10-10T14:31:31.581096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0] Write session: Do CDS request
2025-10-10T14:31:31.581101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:31.588830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.588914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:31.588929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 207
2025-10-10T14:31:31.589036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.589067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:31.589073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:31.589076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:31.589489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 207 sessionId:  describe result for acl check
2025-10-10T14:31:31.589521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:31.589525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:31.589527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:31.589532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600677633511233:3689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:31.590066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600677633511233:3689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:31.592672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600677633511233:3689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:31.595266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600677633511233:3689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:31.595286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600677633511233:3689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:31.595290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600677633511233:3689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:31.595297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:31.596597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:31.597627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:31.597760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:31.597769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:31.597777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:31.597816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:31.597853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600676851301968:3271]
2025-10-10T14:31:31.598278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:31.598516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:31.598557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:31.598779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:31.598814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.598819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.598819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.598820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.598820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.598821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.598821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.598822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.598823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.598823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.598824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.598824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.598825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.598829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.598841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.598845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.598849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.598853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.598857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.598860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.598862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.598864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.598866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.598868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.598870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.598872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.598877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.598883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.598887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.598891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.598893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.598896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.598899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.598901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.598904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.598907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.598909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.598912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.598915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.598918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.598920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.598923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.598925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.598928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.598931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.598934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.598940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.598943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.598946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.598949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.598951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.598956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.598996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:31.601042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:31.601532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:31.601543Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:31.601545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:31.601549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:31.601554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 206 [2:7559600676851301968:3271]
2025-10-10T14:31:31.601566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:31.601583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:31.601586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.601589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.601592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.601607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:31.601618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:31.601630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:31.601690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.601696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.601697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.601700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:31.601760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:31.601768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.601778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.601789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.601806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:31.601831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511442:3689], now have 1 active actors on pipe
2025-10-10T14:31:31.601839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511195:2438], now have 1 active actors on pipe
2025-10-10T14:31:31.601846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600676851301963:3271]
2025-10-10T14:31:31.601852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600676851301963:3271]
2025-10-10T14:31:31.601854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600676851301963:3271]
2025-10-10T14:31:31.601867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:31.601884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:31.601867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 206
2025-10-10T14:31:31.601881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 206
2025-10-10T14:31:31.601895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:31.601902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:31.601904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:31.601904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:31.601906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:31.601943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.601953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.601968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600676851301963:3271]
2025-10-10T14:31:31.601978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:31.601989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:31.602008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:31.602020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.602028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.602029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:31.602040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.602054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:31.602079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.602199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.602207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.602221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.602319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 207 partition: 0 MaxSeqNo: 40 sessionId: src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0
2025-10-10T14:31:31.602683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f3cf90b-4d54230b-5385f60f-d078a4ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:31.605227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0] Write session: try to update token
2025-10-10T14:31:31.605243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:31.619206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId: src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:31.620449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:31.620466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:31.620469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:31.620471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:31.620480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600676851301963:3271]
2025-10-10T14:31:31.620484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600676851301963:3271]
2025-10-10T14:31:31.620488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600676851301963:3271]
2025-10-10T14:31:31.620532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:31.620533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:31.620538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:31.620542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:31.620544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.620546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:31.620676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:31.621686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:31.680932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600677633511463:3658]
2025-10-10T14:31:31.681177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 206, pipe: [1:7559600677633511463:3658]
2025-10-10T14:31:31.723310Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:31.723819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.723831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.723877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511463:3658], now have 1 active actors on pipe
2025-10-10T14:31:31.724078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:31.724084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:31.724102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:31.724116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:31.724152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600677633511463:3658]
2025-10-10T14:31:31.724163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 207 reason: error at write: Disconnected sessionId: src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0
2025-10-10T14:31:31.724368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 207 sessionId: src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0 is DEAD
2025-10-10T14:31:31.724575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:31.724586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0] Write session will restart in 0.008392s
2025-10-10T14:31:31.724611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0] Write session: Do CDS request
2025-10-10T14:31:31.724623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:31.733769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.733883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:31.733901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 208
2025-10-10T14:31:31.734053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.734089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:31.734097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:31.734100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:31.734629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 208 sessionId:  describe result for acl check
2025-10-10T14:31:31.734662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:31.734664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:31.734666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:31.734672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600677633511550:3693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:31.735188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600677633511550:3693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:31.737281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600677633511550:3693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:31.739688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:31.739784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600677633511550:3693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:31.739796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600677633511550:3693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:31.739800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600677633511550:3693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:31.739806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:31.740710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:31.740877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:31.740887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:31.740899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:31.740951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:31.740991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600676851302230:3273]
2025-10-10T14:31:31.741601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:31.741836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:31.741874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:31.742178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:31.742238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.742244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.742245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.742246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.742248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.742249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.742250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.742251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.742252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.742253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.742255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.742256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.742257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.742263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.742276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.742280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.742284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.742289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.742293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.742297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.742301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.742307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.742311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.742319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.742323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.742327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.742334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.742346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.742356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.742366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.742371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.742380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.742385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.742390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.742395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.742401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.742410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.742415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.742427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.742432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.742437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.742442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.742447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.742452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.742456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.742462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.742467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.742473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.742477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.742484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.742492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.742498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.742538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:31.744587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:31.744902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:31.744914Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:31.744916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:31.744920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:31.744926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 207 [2:7559600676851302230:3273]
2025-10-10T14:31:31.744938Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:31.744957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:31.744964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.744969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.744973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.744990Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:31.745002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:31.745013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:31.745067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.745075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.745077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.745080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:31.745146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:31.745154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.745165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.745178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.745200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:31.745227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511717:3693], now have 1 active actors on pipe
2025-10-10T14:31:31.745235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511464:2438], now have 1 active actors on pipe
2025-10-10T14:31:31.745243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600676851302224:3273]
2025-10-10T14:31:31.745245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600676851302224:3273]
2025-10-10T14:31:31.745248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600676851302224:3273]
2025-10-10T14:31:31.745261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:31.745246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 207
2025-10-10T14:31:31.745252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 207
2025-10-10T14:31:31.745275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:31.745293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:31.745297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:31.745300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:31.745301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:31.745303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:31.745352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.745361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.745377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600676851302224:3273]
2025-10-10T14:31:31.745389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:31.745410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:31.745424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6775d46-e808b346-a19b59f6-80628f96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:31.745436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.745440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.745443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:31.745454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.745469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:31.745496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.745653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.745662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.745678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.745789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 208 partition: 0 MaxSeqNo: 40 sessionId: src_id|6775d46-e808b346-a19b59f6-80628f96_0
2025-10-10T14:31:31.746185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200d3be-fddaaac7-5e7982bd-36982b58_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6775d46-e808b346-a19b59f6-80628f96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:31.748731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6775d46-e808b346-a19b59f6-80628f96_0] Write session: try to update token
2025-10-10T14:31:31.748747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6775d46-e808b346-a19b59f6-80628f96_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:31.761728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId: src_id|6775d46-e808b346-a19b59f6-80628f96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:31.763499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:31.763514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:31.763518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:31.763519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:31.763528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600676851302224:3273]
2025-10-10T14:31:31.763532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600676851302224:3273]
2025-10-10T14:31:31.763535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600676851302224:3273]
2025-10-10T14:31:31.763576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:31.763579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:31.763586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:31.763586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.763589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:31.763590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:31.763716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:31.764280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:31.824332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600677633511729:3658]
2025-10-10T14:31:31.824595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 207, pipe: [1:7559600677633511729:3658]
2025-10-10T14:31:31.866745Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:31.867143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.867155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.867193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511729:3658], now have 1 active actors on pipe
2025-10-10T14:31:31.867370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:31.867400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:31.867415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:31.867416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600677633511729:3658]
2025-10-10T14:31:31.867434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:31.867476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 208 reason: error at write: Disconnected sessionId: src_id|6775d46-e808b346-a19b59f6-80628f96_0
2025-10-10T14:31:31.867658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 208 sessionId: src_id|6775d46-e808b346-a19b59f6-80628f96_0 is DEAD
2025-10-10T14:31:31.867818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6775d46-e808b346-a19b59f6-80628f96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:31.867828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6775d46-e808b346-a19b59f6-80628f96_0] Write session will restart in 0.008385s
2025-10-10T14:31:31.867853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6775d46-e808b346-a19b59f6-80628f96_0] Write session: Do CDS request
2025-10-10T14:31:31.867858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6775d46-e808b346-a19b59f6-80628f96_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:31.877713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6775d46-e808b346-a19b59f6-80628f96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.877822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:31.877839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 209
2025-10-10T14:31:31.877959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:31.878009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:31.878019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:31.878023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:31.878445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 209 sessionId:  describe result for acl check
2025-10-10T14:31:31.878474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:31.878480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:31.878481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:31.878488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600677633511827:3697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:31.879011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600677633511827:3697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:31.881519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600677633511827:3697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:31.883542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:31.884619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:31.884707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600677633511827:3697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:31.884718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600677633511827:3697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:31.884721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600677633511827:3697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:31.884727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:31.884781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:31.884792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:31.884802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:31.884850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:31.884891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600676851302492:3275]
2025-10-10T14:31:31.885924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:31.886182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:31.886224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:31.886570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:31.886640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.886646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.886648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.886649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.886650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.886651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.886653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.886654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.886655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.886656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.886657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.886658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.886659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.886664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.886676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.886680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.886684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.886688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.886692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.886695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.886704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.886707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.886711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.886718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.886723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.886731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.886738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.886751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:31.886761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.886766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:31.886775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.886780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:31.886788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.886793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:31.886801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.886806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:31.886813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.886817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:31.886821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.886826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:31.886829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.886834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:31.886842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.886846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:31.886854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.886860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:31.886868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.886873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.886881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.886885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.886888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.886893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.886932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:31.889164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:31.889544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:31.889555Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:31.889557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:31.889560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:31.889565Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 208 [2:7559600676851302492:3275]
2025-10-10T14:31:31.889577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:31.889594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:31.889599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.889601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.889602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.889610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:31.889619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:31.889629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:31.889671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.889678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.889679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.889682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:31.889737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:31.889743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.889750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:31.889756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:31.889778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:31.889802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511730:2438], now have 1 active actors on pipe
2025-10-10T14:31:31.889809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511984:3697], now have 1 active actors on pipe
2025-10-10T14:31:31.889814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600676851302487:3275]
2025-10-10T14:31:31.889815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600676851302487:3275]
2025-10-10T14:31:31.889817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600676851302487:3275]
2025-10-10T14:31:31.889826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:31.889839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:31.889845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:31.889848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:31.889850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:31.889859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:31.889866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:31.889856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 208
2025-10-10T14:31:31.889883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 208
2025-10-10T14:31:31.889884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600676851302487:3275]
2025-10-10T14:31:31.889891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:31.889893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:31.889916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.889925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.890092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:31.890103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:31.890107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:31.890109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:31.890119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:31.890129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:31.890150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.890320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:31.890327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:31.890342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:31.890439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 209 partition: 0 MaxSeqNo: 40 sessionId: src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0
2025-10-10T14:31:31.890767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6775d46-e808b346-a19b59f6-80628f96_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:31.893174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0] Write session: try to update token
2025-10-10T14:31:31.893187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:31.906352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId: src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:31.908611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:31.908630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:31.908633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:31.908635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:31.908643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600676851302487:3275]
2025-10-10T14:31:31.908649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600676851302487:3275]
2025-10-10T14:31:31.908653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600676851302487:3275]
2025-10-10T14:31:31.908697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:31.908700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:31.908706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:31.908708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:31.908709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:31.908710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:31.908707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:31.908833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:31.967683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600677633511996:3658]
2025-10-10T14:31:31.967944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 208, pipe: [1:7559600677633511996:3658]
2025-10-10T14:31:32.013194Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:32.013621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.013638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.013677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600677633511996:3658], now have 1 active actors on pipe
2025-10-10T14:31:32.013842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:32.013911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:32.013940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600677633511996:3658]
2025-10-10T14:31:32.013961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:32.014035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 209 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0
2025-10-10T14:31:32.014265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 209 sessionId: src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0 is DEAD
2025-10-10T14:31:32.014388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:32.014398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0] Write session will restart in 0.007454s
2025-10-10T14:31:32.014415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0] Write session: Do CDS request
2025-10-10T14:31:32.014420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:32.022875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.022945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:32.022960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 210
2025-10-10T14:31:32.023117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.023153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:32.023164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:32.023171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:32.023559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 210 sessionId:  describe result for acl check
2025-10-10T14:31:32.023591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:32.023598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:32.023600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:32.023605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600681928479353:3701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:32.024163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600681928479353:3701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:32.026996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600681928479353:3701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:32.029208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600681928479353:3701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:32.029221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600681928479353:3701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:32.029223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600681928479353:3701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:32.029230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:32.030111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:32.031256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:32.031420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:32.031430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:32.031439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:32.031481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:32.031509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600681146270054:3277]
2025-10-10T14:31:32.031885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:32.032122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:32.032148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:32.032365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:32.032405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.032411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.032411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.032412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.032413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.032414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.032414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.032415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.032415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.032416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.032416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.032417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.032418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.032421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.032429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.032431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.032434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.032436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.032438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.032440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.032442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.032444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.032446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.032448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.032450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.032452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.032457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.032462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.032466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.032470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.032472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.032475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.032478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.032481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.032483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.032486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.032489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.032492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.032495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.032498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.032501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.032504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.032506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.032510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.032514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.032518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.032520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.032523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.032526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.032529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.032531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.032534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.032556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:32.034730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:32.035361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:32.035374Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:32.035376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:32.035380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:32.035387Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 209 [2:7559600681146270054:3277]
2025-10-10T14:31:32.035400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:32.035422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:32.035432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.035436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.035438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.035455Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:32.035462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:32.035469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:32.035524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.035532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.035534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.035536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:32.035596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:32.035602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.035613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.035626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.035648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:32.035673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928479545:3701], now have 1 active actors on pipe
2025-10-10T14:31:32.035680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928479293:2438], now have 1 active actors on pipe
2025-10-10T14:31:32.035687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600681146270049:3277]
2025-10-10T14:31:32.035694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600681146270049:3277]
2025-10-10T14:31:32.035696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600681146270049:3277]
2025-10-10T14:31:32.035709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:32.035726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:32.035726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:32.035727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 209
2025-10-10T14:31:32.035746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:32.035746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:32.035735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 209
2025-10-10T14:31:32.035748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:32.035748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:32.035770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600681146270049:3277]
2025-10-10T14:31:32.035773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:32.035775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:32.035789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.035799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.035849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4513090d-b529fa9b-3db3068-d2f6e82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:32.035860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.035866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.035868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:32.035880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.035890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:32.035912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.036053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.036062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.036084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.036197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 210 partition: 0 MaxSeqNo: 40 sessionId: src_id|4513090d-b529fa9b-3db3068-d2f6e82_0
2025-10-10T14:31:32.036548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c94b-ba9c4b36-50c015b9-cb7d8f86_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4513090d-b529fa9b-3db3068-d2f6e82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:32.039170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4513090d-b529fa9b-3db3068-d2f6e82_0] Write session: try to update token
2025-10-10T14:31:32.039186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4513090d-b529fa9b-3db3068-d2f6e82_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:32.053139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId: src_id|4513090d-b529fa9b-3db3068-d2f6e82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:32.054567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:32.054589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.054592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:32.054594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:32.054604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600681146270049:3277]
2025-10-10T14:31:32.054610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600681146270049:3277]
2025-10-10T14:31:32.054614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600681146270049:3277]
2025-10-10T14:31:32.054668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:32.054672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:32.054678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:32.054684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:32.054685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.054688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:32.054846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:32.055787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:32.114114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600681928479571:3658]
2025-10-10T14:31:32.114408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 209, pipe: [1:7559600681928479571:3658]
2025-10-10T14:31:32.159137Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:32.159362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.159375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.159413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928479571:3658], now have 1 active actors on pipe
2025-10-10T14:31:32.159631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:32.159662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:32.159678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:32.159701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600681928479571:3658]
2025-10-10T14:31:32.159718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:32.159735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 210 reason: error at write: Disconnected sessionId: src_id|4513090d-b529fa9b-3db3068-d2f6e82_0
2025-10-10T14:31:32.159921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 210 sessionId: src_id|4513090d-b529fa9b-3db3068-d2f6e82_0 is DEAD
2025-10-10T14:31:32.160071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4513090d-b529fa9b-3db3068-d2f6e82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:32.160083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4513090d-b529fa9b-3db3068-d2f6e82_0] Write session will restart in 0.005153s
2025-10-10T14:31:32.160106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4513090d-b529fa9b-3db3068-d2f6e82_0] Write session: Do CDS request
2025-10-10T14:31:32.160112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4513090d-b529fa9b-3db3068-d2f6e82_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:32.166828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4513090d-b529fa9b-3db3068-d2f6e82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.166871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:32.166883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 211
2025-10-10T14:31:32.167042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.167076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:32.167087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:32.167091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:32.167474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 211 sessionId:  describe result for acl check
2025-10-10T14:31:32.167505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:32.167513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:32.167515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:32.167520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600681928479588:3706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:32.168043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600681928479588:3706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:32.170775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600681928479588:3706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:32.173970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600681928479588:3706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:32.173983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600681928479588:3706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:32.173985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600681928479588:3706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:32.173993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:32.176517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:32.177586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:32.177753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:32.177763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:32.177775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:32.177821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:32.177859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600681146270331:3280]
2025-10-10T14:31:32.178313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:32.178568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:32.178640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:32.178957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:32.179002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.179008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.179009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.179009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.179010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.179010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.179011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.179012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.179012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.179013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.179014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.179014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.179015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.179019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.179028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.179030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.179032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.179034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.179036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.179038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.179040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.179042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.179044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.179046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.179048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.179050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.179055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.179060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.179065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.179068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.179070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.179073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.179076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.179079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.179082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.179085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.179087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.179090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.179093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.179096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.179098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.179101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.179104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.179107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.179110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.179113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.179116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.179119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.179122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.179125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.179127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.179130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.179151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:32.181248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:32.181615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:32.181625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:32.181627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:32.181630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:32.181634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 210 [2:7559600681146270331:3280]
2025-10-10T14:31:32.181642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:32.181654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:32.181659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.181661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.181662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.181687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:32.181696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:32.181706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:32.181748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.181754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.181755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.181756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:32.181802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:32.181808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.181815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.181825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.181838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:32.181854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928479573:2438], now have 1 active actors on pipe
2025-10-10T14:31:32.181859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928479755:3706], now have 1 active actors on pipe
2025-10-10T14:31:32.181865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600681146270326:3280]
2025-10-10T14:31:32.181867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600681146270326:3280]
2025-10-10T14:31:32.181869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600681146270326:3280]
2025-10-10T14:31:32.181875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:32.181884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:32.181884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:32.181887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:32.181889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:32.181907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:32.181913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:32.181918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 210
2025-10-10T14:31:32.181941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 210
2025-10-10T14:31:32.181932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600681146270326:3280]
2025-10-10T14:31:32.181939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:32.181949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:32.181963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.181966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.181995Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94c5bab-f569edad-52daf436-f6e71d63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:32.182005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.182007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.182009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:32.182016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.182028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:32.182044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.182173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.182193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.182212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.182326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 211 partition: 0 MaxSeqNo: 40 sessionId: src_id|94c5bab-f569edad-52daf436-f6e71d63_0
2025-10-10T14:31:32.182691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4513090d-b529fa9b-3db3068-d2f6e82_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94c5bab-f569edad-52daf436-f6e71d63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:32.185740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c5bab-f569edad-52daf436-f6e71d63_0] Write session: try to update token
2025-10-10T14:31:32.185757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c5bab-f569edad-52daf436-f6e71d63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:32.199494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId: src_id|94c5bab-f569edad-52daf436-f6e71d63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:32.200961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:32.200984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.200986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:32.200987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:32.200995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600681146270326:3280]
2025-10-10T14:31:32.200999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600681146270326:3280]
2025-10-10T14:31:32.201003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600681146270326:3280]
2025-10-10T14:31:32.201051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:32.201063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.201065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:32.201066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:32.201074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:32.201078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:32.201221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:32.202005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:32.260036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600681928479840:3658]
2025-10-10T14:31:32.260290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 210, pipe: [1:7559600681928479840:3658]
2025-10-10T14:31:32.304264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:32.304770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.304783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.304817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928479840:3658], now have 1 active actors on pipe
2025-10-10T14:31:32.305003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:32.305077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600681928479840:3658]
2025-10-10T14:31:32.305077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:32.305082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:32.305110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:32.305139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 211 reason: error at write: Disconnected sessionId: src_id|94c5bab-f569edad-52daf436-f6e71d63_0
2025-10-10T14:31:32.305306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 211 sessionId: src_id|94c5bab-f569edad-52daf436-f6e71d63_0 is DEAD
2025-10-10T14:31:32.305487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c5bab-f569edad-52daf436-f6e71d63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:32.305498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c5bab-f569edad-52daf436-f6e71d63_0] Write session will restart in 0.007510s
2025-10-10T14:31:32.305522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c5bab-f569edad-52daf436-f6e71d63_0] Write session: Do CDS request
2025-10-10T14:31:32.305531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c5bab-f569edad-52daf436-f6e71d63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:32.313839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c5bab-f569edad-52daf436-f6e71d63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.313899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:32.313913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 212
2025-10-10T14:31:32.314059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.314085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:32.314089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:32.314092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:32.314744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 212 sessionId:  describe result for acl check
2025-10-10T14:31:32.314784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:32.314789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:32.314790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:32.314795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600681928479867:3710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:32.315249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600681928479867:3710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:32.318626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600681928479867:3710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:32.321850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600681928479867:3710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:32.321867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600681928479867:3710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:32.321872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600681928479867:3710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:32.321880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:32.323183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:32.324855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:32.325096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:32.325108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:32.325121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:32.325187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:32.325216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600681146270608:3282]
2025-10-10T14:31:32.325604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:32.325867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:32.325896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:32.326110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:32.326153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.326158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.326159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.326159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.326160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.326161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.326162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.326162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.326163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.326163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.326164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.326165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.326165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.326169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.326176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.326179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.326181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.326183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.326186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.326188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.326190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.326193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.326195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.326197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.326200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.326202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.326209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.326214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.326219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.326222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.326225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.326228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.326231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.326246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.326250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.326253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.326256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.326259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.326262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.326265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.326267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.326271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.326274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.326276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.326279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.326282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.326287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.326292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.326296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.326300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.326304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.326309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.326352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:32.328400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:32.328868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:32.328877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:32.328878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:32.328881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:32.328885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 211 [2:7559600681146270608:3282]
2025-10-10T14:31:32.328893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:32.328904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:32.328906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.328908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.328910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.328921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:32.328927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:32.328934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:32.328972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.328977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.328978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.328979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:32.329032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:32.329039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.329050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.329061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.329074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:32.329092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480106:3710], now have 1 active actors on pipe
2025-10-10T14:31:32.329097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928479842:2438], now have 1 active actors on pipe
2025-10-10T14:31:32.329103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600681146270603:3282]
2025-10-10T14:31:32.329108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600681146270603:3282]
2025-10-10T14:31:32.329109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600681146270603:3282]
2025-10-10T14:31:32.329118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:32.329128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:32.329138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:32.329138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:32.329140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:32.329141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:32.329143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:32.329154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600681146270603:3282]
2025-10-10T14:31:32.329156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:32.329158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:32.329167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 211
2025-10-10T14:31:32.329204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.329206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 211
2025-10-10T14:31:32.329211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.329236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:32.329245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.329247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.329249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:32.329257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.329264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:32.329279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.329455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.329464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.329479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.329569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 212 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0
2025-10-10T14:31:32.329956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c5bab-f569edad-52daf436-f6e71d63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:32.332552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0] Write session: try to update token
2025-10-10T14:31:32.332567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:32.347121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId: src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:32.347829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:32.347850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.347852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:32.347854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:32.347862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600681146270603:3282]
2025-10-10T14:31:32.347866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600681146270603:3282]
2025-10-10T14:31:32.347869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600681146270603:3282]
2025-10-10T14:31:32.347915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:32.347922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.347928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:32.347932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:32.347952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:32.347955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:32.348100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:32.349768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:32.405449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600681928480134:3658]
2025-10-10T14:31:32.405705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 211, pipe: [1:7559600681928480134:3658]
2025-10-10T14:31:32.453021Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:32.453294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.453307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.453358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480134:3658], now have 1 active actors on pipe
2025-10-10T14:31:32.453584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:32.453582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600681928480134:3658]
2025-10-10T14:31:32.453607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:32.453610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:32.453611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:32.453678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 212 reason: error at write: Disconnected sessionId: src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0
2025-10-10T14:31:32.453907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 212 sessionId: src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0 is DEAD
2025-10-10T14:31:32.454106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:32.454117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0] Write session will restart in 0.008998s
2025-10-10T14:31:32.454143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0] Write session: Do CDS request
2025-10-10T14:31:32.454149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:32.463838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.464215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:32.464231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 213
2025-10-10T14:31:32.464347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.464384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:32.464395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:32.464400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:32.464792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 213 sessionId:  describe result for acl check
2025-10-10T14:31:32.464828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:32.464836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:32.464838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:32.464844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600681928480204:3723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:32.465384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600681928480204:3723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:32.467581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600681928480204:3723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:32.470061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600681928480204:3723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:32.470076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600681928480204:3723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:32.470080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600681928480204:3723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:32.470088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:32.470895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:32.471949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:32.472109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:32.472124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:32.472136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:32.472189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:32.472228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600681146270899:3297]
2025-10-10T14:31:32.472749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:32.472998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:32.473038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:32.473307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:32.473369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.473375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.473376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.473377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.473379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.473380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.473381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.473382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.473383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.473385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.473386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.473387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.473388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.473393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.473406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.473411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.473415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.473423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.473427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.473436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.473440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.473448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.473452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.473456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.473460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.473464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.473470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.473478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.473484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.473493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.473500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.473505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.473514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.473524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.473528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.473538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.473542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.473547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.473556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.473561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.473570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.473575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.473580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.473588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.473593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.473602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.473610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.473615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.473624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.473633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.473641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.473647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.473681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:32.475867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:32.476421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:32.476435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:32.476438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:32.476441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:32.476446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 212 [2:7559600681146270899:3297]
2025-10-10T14:31:32.476458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:32.476473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:32.476480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.476484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.476486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.476502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:32.476514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:32.476525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:32.476579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.476585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.476587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.476589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:32.476653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:32.476660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.476671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.476687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.476706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:32.476730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480391:3723], now have 1 active actors on pipe
2025-10-10T14:31:32.476738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480136:2438], now have 1 active actors on pipe
2025-10-10T14:31:32.476744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600681146270894:3297]
2025-10-10T14:31:32.476750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600681146270894:3297]
2025-10-10T14:31:32.476753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600681146270894:3297]
2025-10-10T14:31:32.476766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:32.476746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 212
2025-10-10T14:31:32.476748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 212
2025-10-10T14:31:32.476776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:32.476784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:32.476785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:32.476787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:32.476800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:32.476807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:32.476842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.476851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.476868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600681146270894:3297]
2025-10-10T14:31:32.476883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:32.476906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:32.476910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:32.476917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.476920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.476926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:32.476936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.476947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:32.476973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.477087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.477096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.477112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.477203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 213 partition: 0 MaxSeqNo: 40 sessionId: src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0
2025-10-10T14:31:32.477545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb5b0b3d-eb0b32f3-f595dfe4-d1142eec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:32.480369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0] Write session: try to update token
2025-10-10T14:31:32.480387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:32.494652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId: src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:32.495777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:32.495795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.495798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:32.495800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:32.495811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600681146270894:3297]
2025-10-10T14:31:32.495815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600681146270894:3297]
2025-10-10T14:31:32.495818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600681146270894:3297]
2025-10-10T14:31:32.495859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:32.495866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:32.495871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:32.495873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.495876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:32.495876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:32.496022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:32.497154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:32.553921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600681928480412:3658]
2025-10-10T14:31:32.554146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 212, pipe: [1:7559600681928480412:3658]
2025-10-10T14:31:32.601668Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:32.602049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.602062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.602101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480412:3658], now have 1 active actors on pipe
2025-10-10T14:31:32.602283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:32.602325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:32.602358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600681928480412:3658]
2025-10-10T14:31:32.602374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:32.602451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0
2025-10-10T14:31:32.602640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 213 sessionId: src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0 is DEAD
2025-10-10T14:31:32.602783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:32.602796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0] Write session will restart in 0.005179s
2025-10-10T14:31:32.602820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0] Write session: Do CDS request
2025-10-10T14:31:32.602826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:32.608836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.608960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:32.608975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 214
2025-10-10T14:31:32.609087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.609121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:32.609132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:32.609136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:32.609559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 214 sessionId:  describe result for acl check
2025-10-10T14:31:32.609594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:32.609601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:32.609603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:32.609610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600681928480430:3729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:32.610138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600681928480430:3729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:32.612875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600681928480430:3729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:32.616481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600681928480430:3729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:32.616498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600681928480430:3729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:32.616501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600681928480430:3729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:32.616510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:32.619222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:32.620496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:32.620690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:32.620701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:32.620713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:32.620758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:32.620789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600681146271168:3300]
2025-10-10T14:31:32.621164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:32.621419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:32.621448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:32.621665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:32.621710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.621716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.621716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.621717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.621718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.621719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.621719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.621720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.621720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.621721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.621722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.621722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.621723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.621726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.621735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.621738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.621740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.621742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.621745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.621747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.621749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.621751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.621754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.621756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.621758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.621761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.621766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.621772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.621776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.621779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.621782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.621785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.621788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.621791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.621793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.621796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.621799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.621802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.621805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.621808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.621811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.621814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.621817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.621820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.621822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.621825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.621828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.621831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.621833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.621837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.621840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.621844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.621865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:32.624004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:32.624647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:32.624661Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:32.624662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:32.624666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:32.624672Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 213 [2:7559600681146271168:3300]
2025-10-10T14:31:32.624684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:32.624701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:32.624708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.624712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.624714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.624730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:32.624742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:32.624749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:32.624806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.624813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.624815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.624818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:32.624872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:32.624880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.624888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.624894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.624904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:32.624918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600681146271163:3300]
2025-10-10T14:31:32.624923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600681146271163:3300]
2025-10-10T14:31:32.624924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600681146271163:3300]
2025-10-10T14:31:32.624932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:32.624939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:32.624941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:32.624943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:32.624945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480416:2438], now have 1 active actors on pipe
2025-10-10T14:31:32.624948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480596:3729], now have 1 active actors on pipe
2025-10-10T14:31:32.624955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:32.624969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:32.624972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:32.624995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600681146271163:3300]
2025-10-10T14:31:32.625007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:32.625015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:32.625041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 213
2025-10-10T14:31:32.625047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 213
2025-10-10T14:31:32.625139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.625150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.625181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:32.625195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.625203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.625205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:32.625217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.625233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:32.625251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.625468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.625477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.625492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.625596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 214 partition: 0 MaxSeqNo: 40 sessionId: src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0
2025-10-10T14:31:32.626001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59ea3485-54c614a2-600ca801-6fcaa02c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:32.628654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0] Write session: try to update token
2025-10-10T14:31:32.628673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:32.641707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:32.641726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.641738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600681146271163:3300]
2025-10-10T14:31:32.641787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:32.641795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:32.642063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId: src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:32.642174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:32.642333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:32.642479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:32.642622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:32.642816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:32.642858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:32.644669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:32.644917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.644937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.644978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:32.645078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:32.652831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:32.652850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.652853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:32.652855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:32.652867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600681146271163:3300]
2025-10-10T14:31:32.652871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600681146271163:3300]
2025-10-10T14:31:32.652875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600681146271163:3300]
2025-10-10T14:31:32.652918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:32.652921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:32.652924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:32.652928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.652928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:32.652930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:32.653064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:32.702407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600681928480687:3658]
2025-10-10T14:31:32.702749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 213, pipe: [1:7559600681928480687:3658]
2025-10-10T14:31:32.758189Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:32.764751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.764775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.764918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.764977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.765044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.765112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.765158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.765167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.765239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.765312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.765401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.765473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.765514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.765520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.765579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.765637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.765707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.765768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.765807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.765812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.765870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.765924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.765980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.766036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.766075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.766081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.766148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.766212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.766286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.766341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.766393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.766399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.766457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.766513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.766570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.766625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.766664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.766669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.766728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.766783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.766843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.766903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.766943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.766950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.767009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.767064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.767120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.767179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.767220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.767225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.767283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.767337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.767394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.767452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.767504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.767512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.767572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:32.767626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:32.767682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:32.767750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:32.767795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:32.767801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:32.767841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480687:3658], now have 1 active actors on pipe
2025-10-10T14:31:32.768091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:32.768115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:32.768118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:32.768150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 214 reason: error at write: Disconnected sessionId: src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0
2025-10-10T14:31:32.768154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600681928480687:3658]
2025-10-10T14:31:32.768370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 214 sessionId: src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0 is DEAD
2025-10-10T14:31:32.768484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:32.768491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0] Write session will restart in 0.005720s
2025-10-10T14:31:32.768515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0] Write session: Do CDS request
2025-10-10T14:31:32.768521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:32.768574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:32.775840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.775962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:32.775977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 215
2025-10-10T14:31:32.776086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.776122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:32.776149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:32.776154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:32.776618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 215 sessionId:  describe result for acl check
2025-10-10T14:31:32.776663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:32.776670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:32.776672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:32.776679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600681928480719:3733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:32.777220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600681928480719:3733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:32.779878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600681928480719:3733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:32.783017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600681928480719:3733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:32.783030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600681928480719:3733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:32.783034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600681928480719:3733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:32.783042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:32.784898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:32.786167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:32.786390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:32.786398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:32.786407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:32.786448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:32.786480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600681146271436:3302]
2025-10-10T14:31:32.786861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:32.787102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:32.787128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:32.787324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:32.787363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.787369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.787370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.787371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.787372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.787374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.787374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.787375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.787377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.787378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.787379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.787380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.787381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.787386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.787399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.787402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.787406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.787410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.787413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.787417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.787421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.787425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.787430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.787437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.787439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.787441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.787447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.787456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.787464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.787468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.787470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.787475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.787479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.787483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.787492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.787497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.787504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.787509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.787517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.787527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.787535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.787553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.787559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.787562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.787564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.787568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.787573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.787576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.787580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.787584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.787589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.787592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.787613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:32.789762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:32.790228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:32.790247Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:32.790249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:32.790252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:32.790257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 214 [2:7559600681146271436:3302]
2025-10-10T14:31:32.790268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:32.790299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:32.790307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.790310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.790312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.790325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:32.790337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:32.790344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:32.790398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.790404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.790407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.790409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:32.790474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:32.790482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.790494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.790506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.790522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:32.790542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600681146271431:3302]
2025-10-10T14:31:32.790548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600681146271431:3302]
2025-10-10T14:31:32.790550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600681146271431:3302]
2025-10-10T14:31:32.790565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:32.790577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:32.790582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480914:3733], now have 1 active actors on pipe
2025-10-10T14:31:32.790586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480688:2438], now have 1 active actors on pipe
2025-10-10T14:31:32.790586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:32.790588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:32.790594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:32.790611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:32.790619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:32.790619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 214
2025-10-10T14:31:32.790639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600681146271431:3302]
2025-10-10T14:31:32.790627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 214
2025-10-10T14:31:32.790645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:32.790662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:32.790673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.790678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.790717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84ce9a16-f85be294-51b38e8-40349b87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:32.790729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.790736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.790739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:32.790749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.790762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:32.790779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.790962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.790975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.791000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.791103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 215 partition: 0 MaxSeqNo: 40 sessionId: src_id|84ce9a16-f85be294-51b38e8-40349b87_0
2025-10-10T14:31:32.791481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56677b91-43774f33-cbace52a-ab5c9f3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84ce9a16-f85be294-51b38e8-40349b87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:32.794124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce9a16-f85be294-51b38e8-40349b87_0] Write session: try to update token
2025-10-10T14:31:32.794145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce9a16-f85be294-51b38e8-40349b87_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:32.808240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId: src_id|84ce9a16-f85be294-51b38e8-40349b87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:32.808500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:32.808517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.808518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:32.808520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:32.808528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600681146271431:3302]
2025-10-10T14:31:32.808531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600681146271431:3302]
2025-10-10T14:31:32.808534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600681146271431:3302]
2025-10-10T14:31:32.808571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:32.808577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.808579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:32.808582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:32.808588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:32.808592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:32.808710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:32.810867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:32.868305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600681928480960:3658]
2025-10-10T14:31:32.868563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 214, pipe: [1:7559600681928480960:3658]
2025-10-10T14:31:32.911138Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:32.911468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.911480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.911526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480960:3658], now have 1 active actors on pipe
2025-10-10T14:31:32.911820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:32.911872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:32.911877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:32.911896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600681928480960:3658]
2025-10-10T14:31:32.911936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 215 reason: error at write: Disconnected sessionId: src_id|84ce9a16-f85be294-51b38e8-40349b87_0
2025-10-10T14:31:32.911914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:32.912110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 215 sessionId: src_id|84ce9a16-f85be294-51b38e8-40349b87_0 is DEAD
2025-10-10T14:31:32.912266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce9a16-f85be294-51b38e8-40349b87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:32.912278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce9a16-f85be294-51b38e8-40349b87_0] Write session will restart in 0.009806s
2025-10-10T14:31:32.912302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce9a16-f85be294-51b38e8-40349b87_0] Write session: Do CDS request
2025-10-10T14:31:32.912312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce9a16-f85be294-51b38e8-40349b87_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:32.922895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce9a16-f85be294-51b38e8-40349b87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.922989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:32.923005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 216
2025-10-10T14:31:32.923126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:32.923152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:32.923160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:32.923163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:32.923609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 216 sessionId:  describe result for acl check
2025-10-10T14:31:32.923650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:32.923652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:32.923654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:32.923660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600681928481065:3737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:32.924097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600681928481065:3737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:32.925890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600681928481065:3737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:32.928009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:32.928137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600681928481065:3737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:32.928150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600681928481065:3737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:32.928153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600681928481065:3737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:32.928160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:32.928964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:32.929118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:32.929126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:32.929136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:32.929172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:32.929199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600681146271705:3304]
2025-10-10T14:31:32.929565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:32.929794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:32.929821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:32.930011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:32.930047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.930051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.930051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.930052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.930053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.930053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.930054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.930054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.930055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.930056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.930056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.930057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.930057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.930061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.930068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.930070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.930073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.930075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.930077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.930079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.930081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.930083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.930086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.930088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.930090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.930092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.930097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.930102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:32.930106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.930109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:32.930117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.930121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:32.930123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.930126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:32.930128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.930131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:32.930133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.930137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:32.930140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.930143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:32.930145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.930149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:32.930154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.930159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:32.930162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.930168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:32.930171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.930176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.930180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.930185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.930188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.930193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.930218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:32.932277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:32.932576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:32.932586Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:32.932587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:32.932590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:32.932594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 215 [2:7559600681146271705:3304]
2025-10-10T14:31:32.932601Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:32.932613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:32.932614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.932617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.932618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.932629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:32.932636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:32.932642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:32.932689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.932694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.932695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.932696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:32.932743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:32.932748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.932754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:32.932760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:32.932769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:32.932785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600681146271699:3304]
2025-10-10T14:31:32.932790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600681146271699:3304]
2025-10-10T14:31:32.932791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600681146271699:3304]
2025-10-10T14:31:32.932797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:32.932807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928480961:2438], now have 1 active actors on pipe
2025-10-10T14:31:32.932807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:32.932810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:32.932812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:32.932813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:32.932822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:32.932825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:32.932828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600681928481222:3737], now have 1 active actors on pipe
2025-10-10T14:31:32.932847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600681146271699:3304]
2025-10-10T14:31:32.932856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:32.932874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:32.932889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 215
2025-10-10T14:31:32.932912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 215
2025-10-10T14:31:32.932979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.932988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.933013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:32.933022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:32.933025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:32.933026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:32.933035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:32.933048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:32.933062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.933234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.933241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.933253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:32.933347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 216 partition: 0 MaxSeqNo: 40 sessionId: src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0
2025-10-10T14:31:32.933718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ce9a16-f85be294-51b38e8-40349b87_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:32.936383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0] Write session: try to update token
2025-10-10T14:31:32.936402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:32.943391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:32.943409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.943419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600681146271699:3304]
2025-10-10T14:31:32.943459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:32.943469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:32.943639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:32.943776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:32.943910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:32.944050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:32.944237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:32.944275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:32.950546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId: src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:32.953134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:32.953286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:32.953307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:32.953356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:32.953428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:32.960502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:32.960518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:32.960520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:32.960522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:32.960530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600681146271699:3304]
2025-10-10T14:31:32.960533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600681146271699:3304]
2025-10-10T14:31:32.960535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600681146271699:3304]
2025-10-10T14:31:32.960571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:32.960576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:32.960578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:32.960577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:32.960596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:32.960601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:32.960700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:33.012167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600686223448530:3658]
2025-10-10T14:31:33.012395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 215, pipe: [1:7559600686223448530:3658]
2025-10-10T14:31:33.064402Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:33.071296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.071317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.071458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.071514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.071571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.071638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.071683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.071690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.071753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.071809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.071866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.071930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.071969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.071975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.072037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.072095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.072160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.072215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.072250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.072257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.072315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.072374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.072431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.072489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.072527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.072533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.072589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.072650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.072713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.072766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.072805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.072812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.072872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.072931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.072984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.073039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.073079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.073084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.073147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.073201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.073258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.073313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.073372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.073379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.073447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.073500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.073555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.073610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.073657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.073665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.073722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.073780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.073836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.073891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.073933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.073941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.073999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.074052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.074105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.074163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.074208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.074214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.074291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223448530:3658], now have 1 active actors on pipe
2025-10-10T14:31:33.074456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:33.074484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:33.074487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:33.074504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600686223448530:3658]
2025-10-10T14:31:33.074513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 216 reason: error at write: Disconnected sessionId: src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0
2025-10-10T14:31:33.074744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 216 sessionId: src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0 is DEAD
2025-10-10T14:31:33.074886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:33.074907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0] Write session will restart in 0.008167s
2025-10-10T14:31:33.074932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0] Write session: Do CDS request
2025-10-10T14:31:33.074939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:33.075255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:33.083843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.083977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:33.083994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 217
2025-10-10T14:31:33.084105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.084139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:33.084150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:33.084154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:33.084616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 217 sessionId:  describe result for acl check
2025-10-10T14:31:33.084652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:33.084658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:33.084661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:33.084667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600686223448603:3742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:33.085205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600686223448603:3742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:33.087991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600686223448603:3742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:33.090593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600686223448603:3742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:33.090607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600686223448603:3742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:33.090610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600686223448603:3742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:33.090617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:33.091228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:33.092288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:33.092439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:33.092448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:33.092456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:33.092494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:33.092536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600685441239283:3307]
2025-10-10T14:31:33.092952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:33.093214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:33.093252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:33.093498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:33.093536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.093542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.093542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.093543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.093544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.093544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.093545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.093546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.093546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.093547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.093547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.093548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.093549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.093553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.093564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.093568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.093573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.093577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.093580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.093583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.093587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.093592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.093596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.093599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.093603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.093607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.093613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.093620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.093626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.093632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.093642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.093647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.093655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.093659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.093662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.093665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.093667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.093671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.093673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.093676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.093679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.093682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.093684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.093688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.093690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.093693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.093695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.093699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.093702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.093705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.093708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.093711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.093732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:33.095831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:33.096125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:33.096136Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:33.096138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:33.096141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:33.096147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 216 [2:7559600685441239283:3307]
2025-10-10T14:31:33.096156Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:33.096169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:33.096170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.096172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.096174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.096183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:33.096194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:33.096205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:33.096260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.096267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.096268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.096271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:33.096331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:33.096341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.096351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.096362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.096377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:33.096402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223448802:3742], now have 1 active actors on pipe
2025-10-10T14:31:33.096410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223448543:2438], now have 1 active actors on pipe
2025-10-10T14:31:33.096417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600685441239278:3307]
2025-10-10T14:31:33.096419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600685441239278:3307]
2025-10-10T14:31:33.096422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600685441239278:3307]
2025-10-10T14:31:33.096434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:33.096444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:33.096447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:33.096448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:33.096448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:33.096466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:33.096469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:33.096460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 216
2025-10-10T14:31:33.096461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 216
2025-10-10T14:31:33.096488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600685441239278:3307]
2025-10-10T14:31:33.096499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:33.096500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:33.096516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.096520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.096568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:33.096579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.096583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.096585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:33.096595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.096610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:33.096631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.096784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.096792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.096806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.096884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 217 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0
2025-10-10T14:31:33.097252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483d45f5-98a35baa-be7a6a93-6dcfa3b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:33.100016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0] Write session: try to update token
2025-10-10T14:31:33.100035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:33.113442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId: src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:33.114624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:33.114638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:33.114641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:33.114642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:33.114650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600685441239278:3307]
2025-10-10T14:31:33.114653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600685441239278:3307]
2025-10-10T14:31:33.114655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600685441239278:3307]
2025-10-10T14:31:33.114702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:33.114704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:33.114710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:33.114713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.114715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:33.114716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:33.114844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:33.115884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:33.174469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600686223448817:3658]
2025-10-10T14:31:33.174796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 216, pipe: [1:7559600686223448817:3658]
2025-10-10T14:31:33.218733Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:33.219329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.219343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.219380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223448817:3658], now have 1 active actors on pipe
2025-10-10T14:31:33.219540Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:33.219613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:33.219619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600686223448817:3658]
2025-10-10T14:31:33.219629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:33.219641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:33.219707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 217 reason: error at write: Disconnected sessionId: src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0
2025-10-10T14:31:33.219904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 217 sessionId: src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0 is DEAD
2025-10-10T14:31:33.220115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:33.220127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0] Write session will restart in 0.007546s
2025-10-10T14:31:33.220152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0] Write session: Do CDS request
2025-10-10T14:31:33.220161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:33.228865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.228913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:33.228927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 218
2025-10-10T14:31:33.229095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.229131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:33.229141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:33.229145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:33.229708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 218 sessionId:  describe result for acl check
2025-10-10T14:31:33.229744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:33.229751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:33.229753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:33.229760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600686223448867:3746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:33.230196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600686223448867:3746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:33.232410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600686223448867:3746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:33.235239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600686223448867:3746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:33.235253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600686223448867:3746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:33.235257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600686223448867:3746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:33.235265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:33.237074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:33.238222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:33.238412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:33.238422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:33.238433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:33.238479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:33.238514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600685441239554:3309]
2025-10-10T14:31:33.239124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:33.239394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:33.239430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:33.239732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:33.239784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.239790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.239791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.239792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.239793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.239795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.239796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.239797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.239798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.239800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.239801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.239802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.239803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.239808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.239821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.239825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.239829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.239833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.239837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.239841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.239844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.239848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.239851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.239855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.239859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.239867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.239874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.239886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.239896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.239906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.239914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.239919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.239927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.239932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.239941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.239951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.239959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.239964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.239973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.239982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.239990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.239999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.240008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.240017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.240026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.240034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.240039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.240048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.240052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.240057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.240061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.240070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.240113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:33.242280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:33.242574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:33.242589Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:33.242591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:33.242595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:33.242600Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 217 [2:7559600685441239554:3309]
2025-10-10T14:31:33.242620Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:33.242636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:33.242644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.242647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.242650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.242666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:33.242679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:33.242688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:33.242742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.242749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.242751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.242754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:33.242828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:33.242835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.242846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.242858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.242880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:33.242906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223448818:2438], now have 1 active actors on pipe
2025-10-10T14:31:33.242915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449045:3746], now have 1 active actors on pipe
2025-10-10T14:31:33.242929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600685441239549:3309]
2025-10-10T14:31:33.242937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600685441239549:3309]
2025-10-10T14:31:33.242939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600685441239549:3309]
2025-10-10T14:31:33.242928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 217
2025-10-10T14:31:33.242949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:33.242965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:33.242965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 217
2025-10-10T14:31:33.242966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:33.242973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:33.242974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:33.242982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:33.242985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:33.243019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.243029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.243043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600685441239549:3309]
2025-10-10T14:31:33.243055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:33.243073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:33.243088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:33.243100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.243107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.243110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:33.243121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.243134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:33.243158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.243286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.243293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.243308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.243411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 218 partition: 0 MaxSeqNo: 40 sessionId: src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0
2025-10-10T14:31:33.243802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8cc86f-2d0458ad-6d5dbc81-308b7da5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:33.246620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0] Write session: try to update token
2025-10-10T14:31:33.246640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:33.260418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId: src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:33.261381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:33.261399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:33.261403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:33.261406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:33.261415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600685441239549:3309]
2025-10-10T14:31:33.261419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600685441239549:3309]
2025-10-10T14:31:33.261424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600685441239549:3309]
2025-10-10T14:31:33.261472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:33.261474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:33.261481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.261484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:33.261484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:33.261487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:33.261611Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:33.262972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:33.319873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600686223449093:3658]
2025-10-10T14:31:33.320140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 217, pipe: [1:7559600686223449093:3658]
2025-10-10T14:31:33.374731Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:33.375068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.375081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.375116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449093:3658], now have 1 active actors on pipe
2025-10-10T14:31:33.375322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600686223449093:3658]
2025-10-10T14:31:33.375363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:33.375402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:33.375411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:33.375461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 218 reason: error at write: Disconnected sessionId: src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0
2025-10-10T14:31:33.375660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 218 sessionId: src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0 is DEAD
2025-10-10T14:31:33.375741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:33.375771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:33.375778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0] Write session will restart in 0.006169s
2025-10-10T14:31:33.375800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0] Write session: Do CDS request
2025-10-10T14:31:33.375806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:33.382818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.382936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:33.382948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 219
2025-10-10T14:31:33.383045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.383076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:33.383083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:33.383086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:33.383412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 219 sessionId:  describe result for acl check
2025-10-10T14:31:33.383442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:33.383447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:33.383448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:33.383452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600686223449132:3756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:33.383867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600686223449132:3756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:33.386112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600686223449132:3756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:33.388763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600686223449132:3756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:33.388780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600686223449132:3756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:33.388783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600686223449132:3756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:33.388789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:33.391321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:33.392411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:33.392555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:33.392565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:33.392574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:33.392614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:33.392644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600685441239839:3317]
2025-10-10T14:31:33.393045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:33.393283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:33.393315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:33.393554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:33.393594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.393599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.393600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.393601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.393601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.393602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.393603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.393603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.393604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.393604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.393605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.393606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.393606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.393610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.393617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.393619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.393621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.393624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.393626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.393628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.393630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.393632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.393635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.393637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.393640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.393642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.393646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.393651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.393655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.393659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.393661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.393664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.393667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.393670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.393672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.393675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.393677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.393681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.393683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.393686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.393688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.393691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.393694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.393698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.393700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.393703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.393705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.393708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.393710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.393713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.393716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.393719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.393740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:33.395854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:33.396342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:33.396354Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:33.396356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:33.396359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:33.396364Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 218 [2:7559600685441239839:3317]
2025-10-10T14:31:33.396375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:33.396392Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:33.396399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.396401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.396403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.396411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:33.396420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:33.396426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:33.396466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.396470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.396472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.396473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:33.396525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:33.396533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.396543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.396560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.396582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:33.396605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600685441239834:3317]
2025-10-10T14:31:33.396613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600685441239834:3317]
2025-10-10T14:31:33.396615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600685441239834:3317]
2025-10-10T14:31:33.396624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:33.396636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:33.396640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:33.396645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:33.396647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:33.396655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:33.396663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:33.396674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449299:3756], now have 1 active actors on pipe
2025-10-10T14:31:33.396697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449107:2438], now have 1 active actors on pipe
2025-10-10T14:31:33.396705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600685441239834:3317]
2025-10-10T14:31:33.396712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:33.396706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 218
2025-10-10T14:31:33.396737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:33.396729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 218
2025-10-10T14:31:33.396805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.396814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.396837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:33.396846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.396852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.396854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:33.396861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.396869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:33.396883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.397004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.397012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.397023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.397099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 219 partition: 0 MaxSeqNo: 40 sessionId: src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0
2025-10-10T14:31:33.397460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31244547-36fa3286-31cf2ae6-76bc57e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:33.399998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0] Write session: try to update token
2025-10-10T14:31:33.400011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:33.407260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:33.407279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:33.407290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600685441239834:3317]
2025-10-10T14:31:33.407334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:33.407338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:33.407498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:33.407631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:33.407760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:33.407891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:33.408068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:33.408105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:33.413132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId: src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:33.415589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:33.415797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.415814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.415852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:33.415933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:33.423784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:33.423801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:33.423803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:33.423805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:33.423815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600685441239834:3317]
2025-10-10T14:31:33.423820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600685441239834:3317]
2025-10-10T14:31:33.423823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600685441239834:3317]
2025-10-10T14:31:33.423864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:33.423870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:33.423875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:33.423877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.423878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:33.423879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:33.424001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:33.475533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600686223449394:3658]
2025-10-10T14:31:33.475788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 218, pipe: [1:7559600686223449394:3658]
2025-10-10T14:31:33.532490Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:33.540218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.540240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.540390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.540450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.540509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.540578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.541067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.541080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.541147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.541216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.541278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.541363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.541402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.541408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.541468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.541522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.541596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.541655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.541695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.541703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.541763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.541832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.541890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.541949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.541988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.541993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.542060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.542120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.542178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.542237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.542291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.542298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.542364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.542419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.542483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.542549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.542596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.542603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.542672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.542738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.542810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.542880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.542925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.542933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.543000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.543067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.543130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.543194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.543241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.543248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.543320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.543382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.543438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.543493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.543533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.543538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.543598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:33.543654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:33.543713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:33.543771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:33.543811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:33.543818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:33.543875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449394:3658], now have 1 active actors on pipe
2025-10-10T14:31:33.544144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600686223449394:3658]
2025-10-10T14:31:33.544149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:33.544154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:33.544176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:33.544188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 219 reason: error at write: Disconnected sessionId: src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0
2025-10-10T14:31:33.544329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:33.544412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 219 sessionId: src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0 is DEAD
2025-10-10T14:31:33.544583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:33.544593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0] Write session will restart in 0.006826s
2025-10-10T14:31:33.544612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0] Write session: Do CDS request
2025-10-10T14:31:33.544617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:33.552807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.552892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:33.552907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 220
2025-10-10T14:31:33.553063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.553101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:33.553113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:33.553118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:33.553574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 220 sessionId:  describe result for acl check
2025-10-10T14:31:33.553616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:33.553623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:33.553625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:33.553631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600686223449428:3765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:33.554182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600686223449428:3765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:33.557094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600686223449428:3765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:33.559897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600686223449428:3765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:33.559911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600686223449428:3765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:33.559915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600686223449428:3765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:33.559922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:33.561951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:33.563070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:33.563260Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:33.563272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:33.563284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:33.563339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:33.563378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600685441240140:3326]
2025-10-10T14:31:33.563963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:33.564212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:33.564256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:33.564566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:33.564616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.564621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.564622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.564623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.564624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.564625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.564626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.564627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.564628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.564629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.564630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.564632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.564633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.564638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.564651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.564655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.564659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.564663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.564667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.564670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.564674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.564678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.564683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.564687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.564691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.564694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.564702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.564710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.564716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.564721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.564726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.564731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.564740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.564745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.564751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.564756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.564760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.564766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.564770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.564775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.564779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.564789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.564795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.564805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.564809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.564814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.564822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.564827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.564831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.564840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.564844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.564849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.564892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:33.567080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:33.567449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:33.567460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:33.567461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:33.567464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:33.567469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 219 [2:7559600685441240140:3326]
2025-10-10T14:31:33.567477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:33.567489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:33.567491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.567493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.567494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.567506Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:33.567511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:33.567518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:33.567567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.567574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.567576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.567578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:33.567635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:33.567643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.567651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.567661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.567675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:33.567699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449402:2438], now have 1 active actors on pipe
2025-10-10T14:31:33.567707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449620:3765], now have 1 active actors on pipe
2025-10-10T14:31:33.567714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600685441240133:3326]
2025-10-10T14:31:33.567716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600685441240133:3326]
2025-10-10T14:31:33.567718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600685441240133:3326]
2025-10-10T14:31:33.567731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:33.567746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:33.567749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:33.567755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:33.567757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:33.567764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:33.567767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:33.567769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 219
2025-10-10T14:31:33.567786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600685441240133:3326]
2025-10-10T14:31:33.567770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 219
2025-10-10T14:31:33.567793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:33.567796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:33.567818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.567825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.567989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:33.568002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.568005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.568007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:33.568018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.568028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:33.568054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.568225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.568234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.568248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.568333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 220 partition: 0 MaxSeqNo: 40 sessionId: src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0
2025-10-10T14:31:33.568711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377c4f76-f42afabb-7d6a6055-8133cf19_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:33.571313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0] Write session: try to update token
2025-10-10T14:31:33.571332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:33.584775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId: src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:33.586615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:33.586632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:33.586636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:33.586638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:33.586647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600685441240133:3326]
2025-10-10T14:31:33.586651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600685441240133:3326]
2025-10-10T14:31:33.586655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600685441240133:3326]
2025-10-10T14:31:33.586703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:33.586708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:33.586714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:33.586718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:33.586720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.586723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:33.586853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:33.587379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:33.644486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600686223449683:3658]
2025-10-10T14:31:33.644750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 219, pipe: [1:7559600686223449683:3658]
2025-10-10T14:31:33.690407Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:33.690775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.690787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.690828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449683:3658], now have 1 active actors on pipe
2025-10-10T14:31:33.690992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:33.691086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:33.691106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:33.691116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:33.691165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600686223449683:3658]
2025-10-10T14:31:33.691185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 220 reason: error at write: Disconnected sessionId: src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0
2025-10-10T14:31:33.691388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 220 sessionId: src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0 is DEAD
2025-10-10T14:31:33.691509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:33.691518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0] Write session will restart in 0.009323s
2025-10-10T14:31:33.691536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0] Write session: Do CDS request
2025-10-10T14:31:33.691541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:33.701845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.701927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:33.701954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 221
2025-10-10T14:31:33.702073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.702102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:33.702117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:33.702126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:33.702485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 221 sessionId:  describe result for acl check
2025-10-10T14:31:33.702511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:33.702516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:33.702517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:33.702521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600686223449771:3769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:33.702959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600686223449771:3769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:33.705004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600686223449771:3769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:33.707511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600686223449771:3769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:33.707526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600686223449771:3769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:33.707529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600686223449771:3769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:33.707536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:33.707567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:33.708680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:33.708865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:33.708876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:33.708888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:33.708941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:33.708981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600685441240415:3329]
2025-10-10T14:31:33.709448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:33.709734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:33.709770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:33.710234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:33.710310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.710316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.710317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.710318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.710319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.710320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.710321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.710322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.710323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.710324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.710325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.710326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.710327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.710333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.710346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.710350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.710353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.710357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.710360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.710365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.710368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.710372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.710377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.710381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.710385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.710389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.710395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.710404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.710411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.710416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.710420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.710425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.710430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.710435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.710439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.710449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.710453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.710458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.710463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.710470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.710474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.710479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.710484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.710491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.710495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.710500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.710504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.710509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.710515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.710520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.710526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.710530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.710566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:33.712699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:33.713112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:33.713124Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:33.713127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:33.713130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:33.713135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 220 [2:7559600685441240415:3329]
2025-10-10T14:31:33.713145Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:33.713162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:33.713165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.713168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.713169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.713182Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:33.713196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:33.713204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:33.713251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.713257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.713259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.713262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:33.713324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:33.713346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.713356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.713371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.713392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:33.713417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449684:2438], now have 1 active actors on pipe
2025-10-10T14:31:33.713425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449949:3769], now have 1 active actors on pipe
2025-10-10T14:31:33.713431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600685441240409:3329]
2025-10-10T14:31:33.713433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600685441240409:3329]
2025-10-10T14:31:33.713435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600685441240409:3329]
2025-10-10T14:31:33.713447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:33.713463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:33.713468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:33.713471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:33.713475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:33.713483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:33.713486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:33.713504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600685441240409:3329]
2025-10-10T14:31:33.713511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:33.713497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 220
2025-10-10T14:31:33.713504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 220
2025-10-10T14:31:33.713530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:33.713542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.713547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.713578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6280db70-59054068-e2859bca-a0dae1ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:33.713591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.713596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.713598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:33.713610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.713624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:33.713640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.713796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.713802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.713815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.713902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 221 partition: 0 MaxSeqNo: 40 sessionId: src_id|6280db70-59054068-e2859bca-a0dae1ca_0
2025-10-10T14:31:33.714243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f347bdb4-364e01a4-4c1bf22a-a24a8aed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6280db70-59054068-e2859bca-a0dae1ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:33.716719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6280db70-59054068-e2859bca-a0dae1ca_0] Write session: try to update token
2025-10-10T14:31:33.716737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6280db70-59054068-e2859bca-a0dae1ca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:33.729783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId: src_id|6280db70-59054068-e2859bca-a0dae1ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:33.732066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:33.732086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:33.732089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:33.732091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:33.732099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600685441240409:3329]
2025-10-10T14:31:33.732104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600685441240409:3329]
2025-10-10T14:31:33.732108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600685441240409:3329]
2025-10-10T14:31:33.732135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:33.732142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:33.732145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:33.732148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:33.732155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.732157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:33.732283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:33.732343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:33.791418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600686223449962:3658]
2025-10-10T14:31:33.791635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 220, pipe: [1:7559600686223449962:3658]
2025-10-10T14:31:33.835978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:33.836267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.836280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.836318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449962:3658], now have 1 active actors on pipe
2025-10-10T14:31:33.836466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:33.836550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600686223449962:3658]
2025-10-10T14:31:33.836555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:33.836587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:33.836672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 221 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6280db70-59054068-e2859bca-a0dae1ca_0
2025-10-10T14:31:33.836903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 221 sessionId: src_id|6280db70-59054068-e2859bca-a0dae1ca_0 is DEAD
2025-10-10T14:31:33.837076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6280db70-59054068-e2859bca-a0dae1ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:33.837086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6280db70-59054068-e2859bca-a0dae1ca_0] Write session will restart in 0.008654s
2025-10-10T14:31:33.837105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6280db70-59054068-e2859bca-a0dae1ca_0] Write session: Do CDS request
2025-10-10T14:31:33.837111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6280db70-59054068-e2859bca-a0dae1ca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:33.846806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6280db70-59054068-e2859bca-a0dae1ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.846900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:33.846917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 222
2025-10-10T14:31:33.847011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:33.847044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:33.847054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:33.847058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:33.847636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 222 sessionId:  describe result for acl check
2025-10-10T14:31:33.847671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:33.847679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:33.847681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:33.847687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600686223450026:3773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:33.848268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600686223450026:3773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:33.850623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600686223450026:3773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:33.853208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600686223450026:3773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:33.853222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600686223450026:3773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:33.853226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600686223450026:3773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:33.853235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:33.854195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:33.855492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:33.855663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:33.855673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:33.855684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:33.855733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:33.855772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600685441240691:3331]
2025-10-10T14:31:33.856346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:33.856613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:33.856651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:33.856934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:33.856987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.856995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.856996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.856997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.856998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.856999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.857000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.857001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.857002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.857004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.857005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.857006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.857007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.857012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.857024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.857028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.857032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.857037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.857041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.857045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.857049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.857053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.857057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.857061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.857065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.857069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.857076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.857086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:33.857092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.857097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:33.857101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.857107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:33.857111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.857117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:33.857122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.857127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:33.857133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.857139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:33.857145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.857150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:33.857154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.857161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:33.857168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.857174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:33.857206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.857210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:33.857215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.857220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.857225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.857231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.857240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.857245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.857285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:33.859418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:33.859737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:33.859749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:33.859751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:33.859755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:33.859760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 221 [2:7559600685441240691:3331]
2025-10-10T14:31:33.859770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:33.859786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:33.859789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.859792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.859794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.859809Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:33.859821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:33.859828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:33.860080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.860089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.860091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.860094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:33.860157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:33.860164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.860176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:33.860189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:33.860209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:33.860233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223450227:3773], now have 1 active actors on pipe
2025-10-10T14:31:33.860241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223449963:2438], now have 1 active actors on pipe
2025-10-10T14:31:33.860248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600685441240686:3331]
2025-10-10T14:31:33.860252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600685441240686:3331]
2025-10-10T14:31:33.860253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600685441240686:3331]
2025-10-10T14:31:33.860266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:33.860269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 221
2025-10-10T14:31:33.860274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 221
2025-10-10T14:31:33.860285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:33.860290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:33.860293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:33.860295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:33.860305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:33.860308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:33.860333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600685441240686:3331]
2025-10-10T14:31:33.860344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:33.860352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:33.860357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.860362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.860407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:33.860420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:33.860424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:33.860426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:33.860436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:33.860447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:33.860463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.860616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.860624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.860639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:33.860727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 222 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0
2025-10-10T14:31:33.861069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6280db70-59054068-e2859bca-a0dae1ca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:33.863530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0] Write session: try to update token
2025-10-10T14:31:33.863545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:33.876778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId: src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:33.878578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:33.878597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:33.878600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:33.878602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:33.878612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600685441240686:3331]
2025-10-10T14:31:33.878617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600685441240686:3331]
2025-10-10T14:31:33.878621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600685441240686:3331]
2025-10-10T14:31:33.878666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:33.878666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:33.878672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:33.878676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:33.878688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:33.878690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:33.878820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:33.879390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:33.936886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600686223450241:3658]
2025-10-10T14:31:33.937148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 221, pipe: [1:7559600686223450241:3658]
2025-10-10T14:31:33.991040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:33.991725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:33.991739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:33.991785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223450241:3658], now have 1 active actors on pipe
2025-10-10T14:31:33.992048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:33.992092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:33.992111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:33.992118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:33.992161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600686223450241:3658]
2025-10-10T14:31:33.992197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 222 reason: error at write: Disconnected sessionId: src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0
2025-10-10T14:31:33.992415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 222 sessionId: src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0 is DEAD
2025-10-10T14:31:33.992554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:33.992572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0] Write session will restart in 0.009321s
2025-10-10T14:31:33.992600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0] Write session: Do CDS request
2025-10-10T14:31:33.992608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:34.002815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.002994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:34.003008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 223
2025-10-10T14:31:34.003139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.003174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:34.003184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:34.003188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:34.003835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 223 sessionId:  describe result for acl check
2025-10-10T14:31:34.003870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:34.003877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:34.003879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:34.003885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600690518417611:3777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:34.004369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600690518417611:3777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:34.006688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600690518417611:3777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:34.009469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600690518417611:3777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:34.009485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600690518417611:3777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:34.009489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600690518417611:3777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:34.009496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:34.010763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:34.011954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:34.012152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:34.012163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:34.012175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:34.012220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:34.012264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600689736208264:3333]
2025-10-10T14:31:34.012851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:34.013107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:34.013152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:34.013472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:34.013528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.013535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.013536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.013537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.013538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.013540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.013541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.013542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.013543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.013544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.013545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.013547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.013548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.013553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.013565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.013569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.013573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.013577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.013582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.013585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.013589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.013598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.013602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.013610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.013614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.013622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.013629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.013637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.013648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.013657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.013667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.013676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.013685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.013690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.013695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.013704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.013712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.013719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.013728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.013737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.013745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.013754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.013761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.013770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.013778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.013784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.013793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.013803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.013812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.013822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.013831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.013840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.013883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:34.016849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:34.017859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:34.017872Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:34.017873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:34.017876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:34.017881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 222 [2:7559600689736208264:3333]
2025-10-10T14:31:34.017890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:34.017904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:34.017906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.017907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.017909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.017921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:34.017926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:34.017932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:34.017980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.017989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.017991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.017994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:34.018090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:34.018103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.018119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.018139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.018163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:34.018192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600686223450243:2438], now have 1 active actors on pipe
2025-10-10T14:31:34.018201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518417804:3777], now have 1 active actors on pipe
2025-10-10T14:31:34.018208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600689736208259:3333]
2025-10-10T14:31:34.018211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600689736208259:3333]
2025-10-10T14:31:34.018213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600689736208259:3333]
2025-10-10T14:31:34.018228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:34.018247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:34.018259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:34.018266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:34.018268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:34.018276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:34.018280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:34.018269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 222
2025-10-10T14:31:34.018270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 222
2025-10-10T14:31:34.018309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600689736208259:3333]
2025-10-10T14:31:34.018323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:34.018330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:34.018356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.018366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.018668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:34.018693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.018704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.018707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:34.018722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.018739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:34.018779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.019019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.019031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.019052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.019152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 223 partition: 0 MaxSeqNo: 40 sessionId: src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0
2025-10-10T14:31:34.019525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1f593cd-58c8d5e5-a762b1ea-77400298_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:34.028997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0] Write session: try to update token
2025-10-10T14:31:34.029015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:34.036818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:34.036838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:34.036841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:34.036843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:34.036853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600689736208259:3333]
2025-10-10T14:31:34.036858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600689736208259:3333]
2025-10-10T14:31:34.036862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600689736208259:3333]
2025-10-10T14:31:34.036907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:34.036910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:34.036913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:34.036919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:34.036919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.036922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:34.037467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:34.052091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId: src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:34.054712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:34.092486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600690518417830:3658]
2025-10-10T14:31:34.092766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 222, pipe: [1:7559600690518417830:3658]
2025-10-10T14:31:34.140578Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:34.140954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.140966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.140987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518417830:3658], now have 1 active actors on pipe
2025-10-10T14:31:34.141188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:34.141254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600690518417830:3658]
2025-10-10T14:31:34.141346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:34.141380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:34.141393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:34.141452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 223 reason: error at write: Disconnected sessionId: src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0
2025-10-10T14:31:34.141639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 223 sessionId: src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0 is DEAD
2025-10-10T14:31:34.141771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:34.141793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0] Write session will restart in 0.009436s
2025-10-10T14:31:34.141834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0] Write session: Do CDS request
2025-10-10T14:31:34.141842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:34.152806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.152925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:34.152947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 224
2025-10-10T14:31:34.153114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.153153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:34.153164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:34.153168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:34.153664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 224 sessionId:  describe result for acl check
2025-10-10T14:31:34.153702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:34.153704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:34.153706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:34.153713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600690518417898:3782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:34.154235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600690518417898:3782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:34.157385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600690518417898:3782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:34.160217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600690518417898:3782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:34.160232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600690518417898:3782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:34.160236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600690518417898:3782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:34.160244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:34.160419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:34.161622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:34.161806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:34.161816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:34.161827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:34.161883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:34.161957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600689736208553:3336]
2025-10-10T14:31:34.162527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:34.162815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:34.162857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:34.163152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:34.163204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.163210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.163211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.163212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.163213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.163214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.163215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.163217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.163218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.163219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.163220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.163221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.163222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.163227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.163239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.163243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.163247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.163251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.163255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.163258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.163263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.163266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.163270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.163274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.163278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.163281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.163288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.163296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.163302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.163307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.163311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.163316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.163321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.163326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.163331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.163336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.163340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.163345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.163351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.163360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.163364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.163370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.163378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.163383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.163389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.163399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.163403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.163412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.163416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.163421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.163429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.163434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.163472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:34.165643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:34.166270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:34.166281Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:34.166282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:34.166286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:34.166291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 223 [2:7559600689736208553:3336]
2025-10-10T14:31:34.166305Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:34.166322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:34.166330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.166333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.166336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.166351Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:34.166364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:34.166372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:34.166429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.166436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.166438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.166440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:34.166502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:34.166510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.166521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.166533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.166554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:34.166578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518417832:2438], now have 1 active actors on pipe
2025-10-10T14:31:34.166585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418100:3782], now have 1 active actors on pipe
2025-10-10T14:31:34.166593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600689736208547:3336]
2025-10-10T14:31:34.166599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600689736208547:3336]
2025-10-10T14:31:34.166601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600689736208547:3336]
2025-10-10T14:31:34.166614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:34.166631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:34.166631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:34.166634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:34.166636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:34.166651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:34.166655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:34.166677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600689736208547:3336]
2025-10-10T14:31:34.166685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:34.166665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 223
2025-10-10T14:31:34.166686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:34.166668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 223
2025-10-10T14:31:34.166711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.166720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.166756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:34.166768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.166775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.166778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:34.166788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.166802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:34.166827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.166963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.166971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.166988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.167084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 224 partition: 0 MaxSeqNo: 40 sessionId: src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0
2025-10-10T14:31:34.167456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e184352b-beb485df-8a2e4c03-7d4f5c47_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:34.169888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0] Write session: try to update token
2025-10-10T14:31:34.169902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:34.185619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:34.185640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:34.185643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:34.185644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:34.185652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600689736208547:3336]
2025-10-10T14:31:34.185656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600689736208547:3336]
2025-10-10T14:31:34.185659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600689736208547:3336]
2025-10-10T14:31:34.185700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:34.185706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.185707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:34.185720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:34.185727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:34.185731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:34.186041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:34.186589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId: src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:34.189381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:34.241488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600690518418112:3658]
2025-10-10T14:31:34.241733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 223, pipe: [1:7559600690518418112:3658]
2025-10-10T14:31:34.289368Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:34.289765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.289777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.289815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418112:3658], now have 1 active actors on pipe
2025-10-10T14:31:34.289983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:34.290048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600690518418112:3658]
2025-10-10T14:31:34.290060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:34.290084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:34.290087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:34.290167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 224 reason: error at write: Disconnected sessionId: src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0
2025-10-10T14:31:34.290401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 224 sessionId: src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0 is DEAD
2025-10-10T14:31:34.290579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:34.290595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0] Write session will restart in 0.007907s
2025-10-10T14:31:34.290628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0] Write session: Do CDS request
2025-10-10T14:31:34.290635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:34.300844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.301056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:34.301074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 225
2025-10-10T14:31:34.301222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.301259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:34.301271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:34.301279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:34.301872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 225 sessionId:  describe result for acl check
2025-10-10T14:31:34.301914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:34.301920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:34.301922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:34.301929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600690518418192:3786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:34.302492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600690518418192:3786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:34.305176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600690518418192:3786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:34.307746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600690518418192:3786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:34.307760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600690518418192:3786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:34.307763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600690518418192:3786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:34.307770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:34.308571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:34.309782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:34.309933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:34.309944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:34.309952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:34.309988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:34.310017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600689736208832:3338]
2025-10-10T14:31:34.310406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:34.310660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:34.310700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:34.310978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:34.311029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.311033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.311034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.311034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.311035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.311036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.311036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.311037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.311037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.311038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.311039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.311039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.311040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.311044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.311052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.311054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.311056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.311058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.311061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.311063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.311065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.311067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.311069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.311071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.311073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.311075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.311080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.311085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.311089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.311092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.311095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.311098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.311101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.311108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.311110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.311113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.311116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.311119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.311121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.311124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.311127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.311130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.311134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.311140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.311142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.311145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.311148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.311152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.311154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.311157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.311161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.311164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.311185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:34.313208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:34.313794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:34.313806Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:34.313808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:34.313811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:34.313816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 224 [2:7559600689736208832:3338]
2025-10-10T14:31:34.313827Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:34.313848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:34.313851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.313854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.313856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.313867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:34.313872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:34.313880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:34.313929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.313936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.313938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.313940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:34.314002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:34.314009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.314019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.314028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.314048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:34.314071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418381:3786], now have 1 active actors on pipe
2025-10-10T14:31:34.314081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418114:2438], now have 1 active actors on pipe
2025-10-10T14:31:34.314088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600689736208827:3338]
2025-10-10T14:31:34.314090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600689736208827:3338]
2025-10-10T14:31:34.314092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600689736208827:3338]
2025-10-10T14:31:34.314104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:34.314116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:34.314119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:34.314123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:34.314125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:34.314132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:34.314134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:34.314133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 224
2025-10-10T14:31:34.314136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 224
2025-10-10T14:31:34.314156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600689736208827:3338]
2025-10-10T14:31:34.314163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:34.314165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:34.314178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.314183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.314229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5de7b4b5-f391e7bf-9007225-4276e256_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:34.314240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.314248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.314250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:34.314271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.314286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:34.314304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.314444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.314451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.314465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.314563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 225 partition: 0 MaxSeqNo: 40 sessionId: src_id|5de7b4b5-f391e7bf-9007225-4276e256_0
2025-10-10T14:31:34.314906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72a3f009-bc1ab881-494ed27d-8bb2b80d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5de7b4b5-f391e7bf-9007225-4276e256_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:34.317445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5de7b4b5-f391e7bf-9007225-4276e256_0] Write session: try to update token
2025-10-10T14:31:34.317458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5de7b4b5-f391e7bf-9007225-4276e256_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:34.331205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId: src_id|5de7b4b5-f391e7bf-9007225-4276e256_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:34.331932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:34.331953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:34.331956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:34.331958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:34.331967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600689736208827:3338]
2025-10-10T14:31:34.331971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600689736208827:3338]
2025-10-10T14:31:34.331975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600689736208827:3338]
2025-10-10T14:31:34.332021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:34.332028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:34.332032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.332033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:34.332034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:34.332037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:34.332236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:34.333836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:34.390471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600690518418395:3658]
2025-10-10T14:31:34.390809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 224, pipe: [1:7559600690518418395:3658]
2025-10-10T14:31:34.440371Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:34.440768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.440781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.440816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418395:3658], now have 1 active actors on pipe
2025-10-10T14:31:34.440999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:34.441003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600690518418395:3658]
2025-10-10T14:31:34.441040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:34.441042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:34.441106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 225 reason: error at write: Disconnected sessionId: src_id|5de7b4b5-f391e7bf-9007225-4276e256_0
2025-10-10T14:31:34.441369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 225 sessionId: src_id|5de7b4b5-f391e7bf-9007225-4276e256_0 is DEAD
2025-10-10T14:31:34.441556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:34.441568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de7b4b5-f391e7bf-9007225-4276e256_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:34.441577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de7b4b5-f391e7bf-9007225-4276e256_0] Write session will restart in 0.007805s
2025-10-10T14:31:34.441608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de7b4b5-f391e7bf-9007225-4276e256_0] Write session: Do CDS request
2025-10-10T14:31:34.441618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de7b4b5-f391e7bf-9007225-4276e256_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:34.450883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5de7b4b5-f391e7bf-9007225-4276e256_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.450949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:34.450966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 226
2025-10-10T14:31:34.451091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.451126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:34.451135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:34.451143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:34.451670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 226 sessionId:  describe result for acl check
2025-10-10T14:31:34.451715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:34.451723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:34.451725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:34.451732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600690518418449:3796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:34.452401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600690518418449:3796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:34.455507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600690518418449:3796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:34.458565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600690518418449:3796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:34.458578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600690518418449:3796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:34.458582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600690518418449:3796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:34.458589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:34.460624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:34.462079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:34.462280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:34.462292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:34.462302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:34.462340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:34.462372Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600689736209143:3346]
2025-10-10T14:31:34.462897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:34.463168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:34.463210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:34.463451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:34.463502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.463509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.463509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.463510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.463511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.463511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.463512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.463513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.463513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.463514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.463515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.463515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.463516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.463520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.463527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.463529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.463532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.463534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.463536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.463540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.463544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.463547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.463551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.463554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.463558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.463561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.463568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.463578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.463584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.463590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.463592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.463595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.463598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.463601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.463604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.463607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.463609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.463612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.463616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.463619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.463625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.463629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.463632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.463635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.463638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.463641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.463643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.463649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.463652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.463655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.463661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.463664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.463686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:34.466387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:34.466761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:34.466774Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:34.466775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:34.466779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:34.466785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 225 [2:7559600689736209143:3346]
2025-10-10T14:31:34.466797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:34.466813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:34.466816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.466819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.466824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.466837Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:34.466846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:34.466852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:34.466895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.466900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.466901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.466903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:34.466952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:34.466958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.466965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.466971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.466985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:34.467003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600689736209138:3346]
2025-10-10T14:31:34.467006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600689736209138:3346]
2025-10-10T14:31:34.467008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600689736209138:3346]
2025-10-10T14:31:34.467018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:34.467028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:34.467030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:34.467033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:34.467035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418409:2438], now have 1 active actors on pipe
2025-10-10T14:31:34.467039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418644:3796], now have 1 active actors on pipe
2025-10-10T14:31:34.467047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:34.467059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:34.467064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:34.467080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600689736209138:3346]
2025-10-10T14:31:34.467090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:34.467083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 225
2025-10-10T14:31:34.467087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 225
2025-10-10T14:31:34.467110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:34.467174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.467181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.467203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f918809a-b86a826f-234854a2-172ed149_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:34.467211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.467215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.467216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:34.467223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.467232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:34.467246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.467426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.467434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.467446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.467527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 226 partition: 0 MaxSeqNo: 40 sessionId: src_id|f918809a-b86a826f-234854a2-172ed149_0
2025-10-10T14:31:34.467911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5de7b4b5-f391e7bf-9007225-4276e256_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f918809a-b86a826f-234854a2-172ed149_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:34.470330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f918809a-b86a826f-234854a2-172ed149_0] Write session: try to update token
2025-10-10T14:31:34.470351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f918809a-b86a826f-234854a2-172ed149_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:34.486080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId: src_id|f918809a-b86a826f-234854a2-172ed149_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:34.488610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:34.489187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.489208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.489229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:34.489233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:34.489235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:34.489236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:34.489242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600689736209138:3346]
2025-10-10T14:31:34.489249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600689736209138:3346]
2025-10-10T14:31:34.489254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600689736209138:3346]
2025-10-10T14:31:34.489307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:34.489308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:34.489313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:34.489318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:34.489320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.489322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:34.489460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:34.540989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600690518418715:3658]
2025-10-10T14:31:34.541196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 225, pipe: [1:7559600690518418715:3658]
2025-10-10T14:31:34.593220Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:34.593480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:34.593531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418715:3658], now have 1 active actors on pipe
2025-10-10T14:31:34.593633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:34.593732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:34.593791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600690518418715:3658]
2025-10-10T14:31:34.611235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:34.611248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:34.611270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 226 reason: error at write: Disconnected sessionId: src_id|f918809a-b86a826f-234854a2-172ed149_0
2025-10-10T14:31:34.611404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 226 sessionId: src_id|f918809a-b86a826f-234854a2-172ed149_0 is DEAD
2025-10-10T14:31:34.611558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f918809a-b86a826f-234854a2-172ed149_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:34.611572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f918809a-b86a826f-234854a2-172ed149_0] Write session will restart in 0.005722s
2025-10-10T14:31:34.611597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f918809a-b86a826f-234854a2-172ed149_0] Write session: Do CDS request
2025-10-10T14:31:34.611604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f918809a-b86a826f-234854a2-172ed149_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:34.616336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:34.617660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:34.617823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:34.617830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:34.617839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:34.617873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:34.617912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600689736209433:3356]
2025-10-10T14:31:34.618336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:34.618606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:34.618635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:34.618789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f918809a-b86a826f-234854a2-172ed149_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.618837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:34.618871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.618876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.618876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.618877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.618877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.618878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.618879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.618879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.618880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.618880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.618881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.618882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.618882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.618886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.618895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.618897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.618900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.618902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.618904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.618920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:34.618906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.618934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 227
2025-10-10T14:31:34.618909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.618911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.618913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.618915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.618917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.618920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.618926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.618931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.618935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.618939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.618942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.618945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.618948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.618951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.618954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.618957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.618959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.618962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.618965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.618968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.618970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.618973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.618977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.618980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.618983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.618986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.618990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.618993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.618995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.618998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.619000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.619003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.619024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:34.619073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.619103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:34.619115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:34.619118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:34.619491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 227 sessionId:  describe result for acl check
2025-10-10T14:31:34.619530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:34.619537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:34.619539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:34.619545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600690518418969:3805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:34.620114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600690518418969:3805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:34.621545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:34.621960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:34.621979Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:34.621980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:34.621983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:34.621986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 226 [2:7559600689736209433:3356]
2025-10-10T14:31:34.621994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:34.622006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:34.622008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.622010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.622011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.622022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:34.622027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:34.622034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:34.622162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.622168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.622169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.622170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:34.622217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:34.622222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.622229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.622235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.622249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:34.622280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600689736209428:3356]
2025-10-10T14:31:34.622282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600689736209428:3356]
2025-10-10T14:31:34.622283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600689736209428:3356]
2025-10-10T14:31:34.622293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:34.622303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:34.622309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518418719:2438], now have 1 active actors on pipe
2025-10-10T14:31:34.622312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:34.622313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:34.622316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:34.622325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:34.622327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:34.622343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600689736209428:3356]
2025-10-10T14:31:34.622345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:34.622352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:34.622343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 226
2025-10-10T14:31:34.622631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600690518418969:3805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:34.627440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600690518418969:3805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:34.627456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600690518418969:3805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:34.627461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600690518418969:3805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:34.627469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:34.627683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518419003:3805], now have 1 active actors on pipe
2025-10-10T14:31:34.627737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 226
2025-10-10T14:31:34.627792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.627809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.627836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:34.627845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.627850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.627852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:34.627861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.627886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:34.627903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.628063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.628070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.628083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.628160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 227 partition: 0 MaxSeqNo: 40 sessionId: src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0
2025-10-10T14:31:34.628451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f918809a-b86a826f-234854a2-172ed149_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:34.631072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0] Write session: try to update token
2025-10-10T14:31:34.631086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:34.644093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:34.644111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:34.644113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:34.644115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:34.644123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600689736209428:3356]
2025-10-10T14:31:34.644127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600689736209428:3356]
2025-10-10T14:31:34.644129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600689736209428:3356]
2025-10-10T14:31:34.644170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:34.644177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.644178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:34.644178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:34.644185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:34.644191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:34.644306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:34.644608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId: src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:34.647256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:34.694094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600690518419007:3658]
2025-10-10T14:31:34.694456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 226, pipe: [1:7559600690518419007:3658]
2025-10-10T14:31:34.747185Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:34.747572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.747587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.747626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518419007:3658], now have 1 active actors on pipe
2025-10-10T14:31:34.747839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:34.747909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:34.747929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600690518419007:3658]
2025-10-10T14:31:34.747961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:34.748033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0
2025-10-10T14:31:34.748266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 227 sessionId: src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0 is DEAD
2025-10-10T14:31:34.748442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:34.748456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0] Write session will restart in 0.008959s
2025-10-10T14:31:34.748483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0] Write session: Do CDS request
2025-10-10T14:31:34.748491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:34.758918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.758996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:34.759015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 228
2025-10-10T14:31:34.759161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.759199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:34.759207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:34.759211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:34.759740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 228 sessionId:  describe result for acl check
2025-10-10T14:31:34.759772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:34.759778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:34.759780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:34.759785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600690518419053:3809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:34.760494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600690518419053:3809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:34.763445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600690518419053:3809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:34.766686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600690518419053:3809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:34.766700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600690518419053:3809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:34.766703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600690518419053:3809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:34.766712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:34.768488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:34.769771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:34.769933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:34.769940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:34.770183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:34.770237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:34.770282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600689736209721:3358]
2025-10-10T14:31:34.770636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:34.770865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:34.770897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:34.771139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:34.771175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.771179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.771180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.771181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.771181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.771182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.771182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.771183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.771184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.771184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.771185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.771186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.771186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.771190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.771198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.771201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.771203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.771205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.771208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.771210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.771212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.771214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.771218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.771220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.771222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.771224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.771229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.771234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.771239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.771242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.771244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.771247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.771250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.771252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.771255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.771258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.771261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.771264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.771267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.771270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.771272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.771275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.771278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.771281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.771283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.771286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.771289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.771291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.771294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.771297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.771300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.771303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.771326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:34.773764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:34.774317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:34.774325Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:34.774327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:34.774329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:34.774333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 227 [2:7559600689736209721:3358]
2025-10-10T14:31:34.774340Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:34.774351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:34.774352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.774354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.774355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.774366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:34.774371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:34.774377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:34.774430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.774436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.774437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.774438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:34.774482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:34.774487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.774493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.774499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.774509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:34.774526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518419250:3809], now have 1 active actors on pipe
2025-10-10T14:31:34.774533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518419008:2438], now have 1 active actors on pipe
2025-10-10T14:31:34.774541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600689736209711:3358]
2025-10-10T14:31:34.774543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600689736209711:3358]
2025-10-10T14:31:34.774544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600689736209711:3358]
2025-10-10T14:31:34.774559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:34.774568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:34.774570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:34.774571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:34.774576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:34.774591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:34.774597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:34.774616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600689736209711:3358]
2025-10-10T14:31:34.774623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:34.774606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 227
2025-10-10T14:31:34.774607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 227
2025-10-10T14:31:34.774634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:34.774649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.774658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.774685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:34.774695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.774697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.774699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:34.774707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.774719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:34.774733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.774891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.774897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.774909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.775003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 228 partition: 0 MaxSeqNo: 40 sessionId: src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0
2025-10-10T14:31:34.775339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f6dbfb-1a0c176f-8fad4178-7bb00cbb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:34.780861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0] Write session: try to update token
2025-10-10T14:31:34.780876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:34.794711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId: src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:34.797023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:34.797141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:34.797158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:34.797160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:34.797161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:34.797169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600689736209711:3358]
2025-10-10T14:31:34.797172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600689736209711:3358]
2025-10-10T14:31:34.797175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600689736209711:3358]
2025-10-10T14:31:34.797204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:34.797208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:34.797211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:34.797219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.797226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.797245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:34.797251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.797252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:34.797478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:34.848169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600690518419295:3658]
2025-10-10T14:31:34.848437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 227, pipe: [1:7559600690518419295:3658]
2025-10-10T14:31:34.899039Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:34.899526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518419295:3658], now have 1 active actors on pipe
2025-10-10T14:31:34.899685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:34.899764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:34.899774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:34.899776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:34.899822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600690518419295:3658]
2025-10-10T14:31:34.899841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 228 reason: error at write: Disconnected sessionId: src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0
2025-10-10T14:31:34.900042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 228 sessionId: src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0 is DEAD
2025-10-10T14:31:34.900179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:34.900190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0] Write session will restart in 0.006710s
2025-10-10T14:31:34.900214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0] Write session: Do CDS request
2025-10-10T14:31:34.900220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:34.905948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:34.907339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:34.907525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:34.907536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:34.907547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:34.907599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:34.907644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600689736209781:3360]
2025-10-10T14:31:34.907845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.907911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:34.907920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 229
2025-10-10T14:31:34.908068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:34.908075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:34.908105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:34.908115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:34.908120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:34.908322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:34.908356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:34.908508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 229 sessionId:  describe result for acl check
2025-10-10T14:31:34.908537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:34.908544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:34.908545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:34.908551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600690518419317:3813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:34.908589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:34.908632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.908637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.908638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.908638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.908639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.908640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.908641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.908642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.908643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.908643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.908646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.908646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.908647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.908651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.908659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.908661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.908664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.908666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.908668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.908670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.908673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.908675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.908677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.908679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.908682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.908684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.908691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.908696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:34.908700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.908704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:34.908707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.908710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:34.908712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.908716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:34.908720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.908723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:34.908726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.908729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:34.908732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.908736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:34.908738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.908742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:34.908745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.908748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:34.908750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.908753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:34.908756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.908759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.908761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.908764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.908767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.908770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.908793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:34.909089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600690518419317:3813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:34.910976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600690518419317:3813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:34.911388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:34.911746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:34.911755Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:34.911756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:34.911759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:34.911764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 228 [2:7559600689736209781:3360]
2025-10-10T14:31:34.911772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:34.911784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:34.911786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.911788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.911791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.911802Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:34.911807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:34.911813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:34.911853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.911859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.911861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.911863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:34.911908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:34.911915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.911922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:34.911928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:34.911938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:34.911953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518419296:2438], now have 1 active actors on pipe
2025-10-10T14:31:34.911962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600689736209776:3360]
2025-10-10T14:31:34.911963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600689736209776:3360]
2025-10-10T14:31:34.911964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600689736209776:3360]
2025-10-10T14:31:34.911974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:34.911983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:34.911985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:34.911988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:34.911989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:34.911992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:34.911994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:34.911989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 228
2025-10-10T14:31:34.912011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600689736209776:3360]
2025-10-10T14:31:34.912017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:34.912018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:34.917677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600690518419317:3813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:34.917689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600690518419317:3813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:34.917693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600690518419317:3813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:34.917701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:34.917908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600690518419353:3813], now have 1 active actors on pipe
2025-10-10T14:31:34.917957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 228
2025-10-10T14:31:34.918002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.918015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.918049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:34.918061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:34.918081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:34.918085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:34.918097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:34.918112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:34.918128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.918273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.918279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.918291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:34.918357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 229 partition: 0 MaxSeqNo: 40 sessionId: src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0
2025-10-10T14:31:34.918680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9654320a-6ebee635-9a4cb7c0-c2673cfe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:34.921175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0] Write session: try to update token
2025-10-10T14:31:34.921188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:34.927152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:34.927166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:34.927174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600689736209776:3360]
2025-10-10T14:31:34.927212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:34.927218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:34.927368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:34.927496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:34.927659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:34.927812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:34.928030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:34.928066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:34.934190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId: src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:34.936674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:34.936870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:34.936889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:34.936921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:34.937013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:34.947123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:34.947141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:34.947144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:34.947146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:34.947159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600689736209776:3360]
2025-10-10T14:31:34.947163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600689736209776:3360]
2025-10-10T14:31:34.947166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600689736209776:3360]
2025-10-10T14:31:34.947213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:34.947226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:34.947229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:34.947230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:34.947235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:34.947238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:34.947400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:35.000265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600694813386653:3658]
2025-10-10T14:31:35.000469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 228, pipe: [1:7559600694813386653:3658]
2025-10-10T14:31:35.049942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:35.056881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.056908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.057088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.057157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.057225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.057294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.057363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.057373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.057445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.057554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.057619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.057691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.057788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.057796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.057899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.057963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.058063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.058163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.058208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.058215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.058329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.058432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.058535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.058632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.058676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.058682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.058783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.058882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.058947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.059011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.059141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.059148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.059251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.059331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.059414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.059475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.059519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.059526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.059591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.059651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.059714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.059775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.059835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.059842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.059908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.059967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.060033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.060095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.060138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.060145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.060210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.060268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.060327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.060388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.060449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.060455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.060521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.060581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.060669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.060734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.060792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.060798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.060856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386653:3658], now have 1 active actors on pipe
2025-10-10T14:31:35.061115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:35.061124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600694813386653:3658]
2025-10-10T14:31:35.061157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:35.061160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:35.061188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 229 reason: error at write: Disconnected sessionId: src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0
2025-10-10T14:31:35.061486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 229 sessionId: src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0 is DEAD
2025-10-10T14:31:35.061657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:35.061669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0] Write session will restart in 0.009163s
2025-10-10T14:31:35.061694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0] Write session: Do CDS request
2025-10-10T14:31:35.061700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:35.061682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:35.067567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:35.068727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:35.068920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:35.068938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:35.068947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:35.068994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:35.069026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600694031177135:3362]
2025-10-10T14:31:35.069512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:35.069782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:35.069826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:35.070088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:35.070131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.070136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.070137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.070137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.070138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.070139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.070139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.070140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.070140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.070141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.070142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.070142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.070143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.070147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.070154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.070157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.070159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.070161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.070164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.070167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.070170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.070173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.070177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.070181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.070184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.070188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.070195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.070204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.070208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.070212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.070215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.070218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.070220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.070223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.070226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.070230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.070233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.070236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.070238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.070242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.070244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.070247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.070249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.070252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.070255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.070257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.070271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.070274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.070277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.070280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.070283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.070286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.070308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:35.071897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.072001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:35.072018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 230
2025-10-10T14:31:35.072145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.072171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:35.072177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:35.072183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:35.072670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 230 sessionId:  describe result for acl check
2025-10-10T14:31:35.072704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:35.072710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:35.072712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:35.072717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600694813386678:3817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:35.072837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:35.073271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600694813386678:3817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:35.073308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:35.073321Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:35.073323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:35.073327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:35.073348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 229 [2:7559600694031177135:3362]
2025-10-10T14:31:35.073361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:35.073382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:35.073385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.073388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.073390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.073405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:35.073417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:35.073427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:35.073482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.073489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.073491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.073494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:35.073554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:35.073562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.073574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.073586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.073608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:35.073634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386654:2438], now have 1 active actors on pipe
2025-10-10T14:31:35.073646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600694031177130:3362]
2025-10-10T14:31:35.073649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600694031177130:3362]
2025-10-10T14:31:35.073652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600694031177130:3362]
2025-10-10T14:31:35.073650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 229
2025-10-10T14:31:35.073659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:35.073670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:35.073675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:35.073677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:35.073678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:35.073692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:35.073695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:35.073726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600694031177130:3362]
2025-10-10T14:31:35.073734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:35.073736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:35.074775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600694813386678:3817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:35.081562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600694813386678:3817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:35.081573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600694813386678:3817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:35.081578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600694813386678:3817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:35.081586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:35.081814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386723:3817], now have 1 active actors on pipe
2025-10-10T14:31:35.081905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 229
2025-10-10T14:31:35.081981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.081998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.082035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1ffb505-12adf039-52eb4172-ff012276_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:35.082047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.082068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.082076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:35.082092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.082112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:35.082150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.082306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.082327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.082355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.082441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 230 partition: 0 MaxSeqNo: 40 sessionId: src_id|c1ffb505-12adf039-52eb4172-ff012276_0
2025-10-10T14:31:35.082819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684a8a2c-e036acd1-942c7ccc-ffb747a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c1ffb505-12adf039-52eb4172-ff012276_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:35.085274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ffb505-12adf039-52eb4172-ff012276_0] Write session: try to update token
2025-10-10T14:31:35.085294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ffb505-12adf039-52eb4172-ff012276_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:35.092112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:35.092131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.092144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600694031177130:3362]
2025-10-10T14:31:35.092196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:35.092211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:35.092360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:35.092516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.092657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.092801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.093015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:35.093060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:35.099102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId: src_id|c1ffb505-12adf039-52eb4172-ff012276_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:35.101531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:35.101977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.101994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.102028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:35.102080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:35.103840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:35.103854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.103856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:35.103858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:35.103865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600694031177130:3362]
2025-10-10T14:31:35.103867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600694031177130:3362]
2025-10-10T14:31:35.103870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600694031177130:3362]
2025-10-10T14:31:35.103904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:35.103911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.103920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:35.103920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:35.103927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:35.103932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:35.104051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:35.161552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600694813386727:3658]
2025-10-10T14:31:35.161823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 229, pipe: [1:7559600694813386727:3658]
2025-10-10T14:31:35.209985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:35.217146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.217167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.217316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.217393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.217455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.217522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.217568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.217582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.217651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.217705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.217763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.217863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.218008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.218017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.218086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.218150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.218210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.218284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.218326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.218334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.218420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.218485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.218549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.218615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.218657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.218665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.218729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.218784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.218848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.218935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.218979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.218989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.219090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.219173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.219232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.219350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.219469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.219477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.219602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.219662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.219726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.219796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.219838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.219845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.219906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.219964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.220033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.220098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.220245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.220251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.220310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.220377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.220438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.220499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.220546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.220552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.220617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.220674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.220764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.220823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.220865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.220873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.220924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386727:3658], now have 1 active actors on pipe
2025-10-10T14:31:35.221134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:35.221175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600694813386727:3658]
2025-10-10T14:31:35.221185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:35.221190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:35.221220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 230 reason: error at write: Disconnected sessionId: src_id|c1ffb505-12adf039-52eb4172-ff012276_0
2025-10-10T14:31:35.221469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 230 sessionId: src_id|c1ffb505-12adf039-52eb4172-ff012276_0 is DEAD
2025-10-10T14:31:35.221566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:35.221602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ffb505-12adf039-52eb4172-ff012276_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:35.221613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ffb505-12adf039-52eb4172-ff012276_0] Write session will restart in 0.005150s
2025-10-10T14:31:35.221638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ffb505-12adf039-52eb4172-ff012276_0] Write session: Do CDS request
2025-10-10T14:31:35.221644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ffb505-12adf039-52eb4172-ff012276_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:35.227863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ffb505-12adf039-52eb4172-ff012276_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.227866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:35.228188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:35.228203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 231
2025-10-10T14:31:35.228348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.228381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:35.228391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:35.228395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:35.228809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 231 sessionId:  describe result for acl check
2025-10-10T14:31:35.228849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:35.228855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:35.228857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:35.228864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600694813386748:3822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:35.229425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600694813386748:3822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:35.229421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:35.229590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:35.229604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:35.229615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:35.229667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:35.229707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600694031177205:3365]
2025-10-10T14:31:35.230084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:35.230384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:35.230427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:35.230657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:35.230705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.230710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.230711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.230711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.230712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.230713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.230713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.230715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.230716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.230716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.230717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.230718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.230718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.230722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.230729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.230732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.230734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.230736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.230738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.230740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.230743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.230745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.230747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.230749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.230751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.230753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.230758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.230763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.230767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.230772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.230775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.230777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.230780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.230783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.230786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.230789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.230791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.230795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.230797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.230801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.230803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.230806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.230808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.230811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.230813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.230816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.230819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.230822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.230824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.230827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.230830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.230833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.230854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:35.231758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600694813386748:3822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:35.233326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:35.233678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:35.233687Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:35.233689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:35.233691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:35.233696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 230 [2:7559600694031177205:3365]
2025-10-10T14:31:35.233704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:35.233718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:35.233723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.233725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.233727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.233738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:35.233748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:35.233755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:35.233803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600694813386748:3822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:35.233821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.233816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600694813386748:3822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:35.233820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600694813386748:3822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:35.233828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:35.233827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.233828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.233830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:35.233885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:35.233892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.233900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.233907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.233918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:35.233946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386728:2438], now have 1 active actors on pipe
2025-10-10T14:31:35.233955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600694031177200:3365]
2025-10-10T14:31:35.233957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600694031177200:3365]
2025-10-10T14:31:35.233958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600694031177200:3365]
2025-10-10T14:31:35.233950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 230
2025-10-10T14:31:35.233967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:35.233977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:35.233983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:35.233986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:35.233986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:35.233988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:35.233988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:35.234016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600694031177200:3365]
2025-10-10T14:31:35.234025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:35.234025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:35.234029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386781:3822], now have 1 active actors on pipe
2025-10-10T14:31:35.234059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 230
2025-10-10T14:31:35.234092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.234101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.234130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c343d481-cc443255-71d36378-cd744fa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:35.234142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.234146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.234152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:35.234162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.234175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:35.234189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.234326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.234334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.234347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.234423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 231 partition: 0 MaxSeqNo: 40 sessionId: src_id|c343d481-cc443255-71d36378-cd744fa0_0
2025-10-10T14:31:35.234762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1ffb505-12adf039-52eb4172-ff012276_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c343d481-cc443255-71d36378-cd744fa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:35.237366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c343d481-cc443255-71d36378-cd744fa0_0] Write session: try to update token
2025-10-10T14:31:35.237384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c343d481-cc443255-71d36378-cd744fa0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:35.253463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId: src_id|c343d481-cc443255-71d36378-cd744fa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:35.253511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:35.253526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.253528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:35.253530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:35.253538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600694031177200:3365]
2025-10-10T14:31:35.253541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600694031177200:3365]
2025-10-10T14:31:35.253548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600694031177200:3365]
2025-10-10T14:31:35.253584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:35.253592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.253592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:35.253596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:35.253599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:35.253603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:35.253749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:35.256092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:35.321282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600694813386790:3658]
2025-10-10T14:31:35.321550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 230, pipe: [1:7559600694813386790:3658]
2025-10-10T14:31:35.355489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:35.355741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.355754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.355796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386790:3658], now have 1 active actors on pipe
2025-10-10T14:31:35.356054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:35.356070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:35.356075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:35.356100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600694813386790:3658]
2025-10-10T14:31:35.356152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 231 reason: error at write: Disconnected sessionId: src_id|c343d481-cc443255-71d36378-cd744fa0_0
2025-10-10T14:31:35.356213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:35.356389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 231 sessionId: src_id|c343d481-cc443255-71d36378-cd744fa0_0 is DEAD
2025-10-10T14:31:35.356552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c343d481-cc443255-71d36378-cd744fa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:35.356562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c343d481-cc443255-71d36378-cd744fa0_0] Write session will restart in 0.007883s
2025-10-10T14:31:35.356580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c343d481-cc443255-71d36378-cd744fa0_0] Write session: Do CDS request
2025-10-10T14:31:35.356588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c343d481-cc443255-71d36378-cd744fa0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:35.362018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:35.363267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:35.363454Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:35.363463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:35.363481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:35.363529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:35.363566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600694031177265:3367]
2025-10-10T14:31:35.363999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:35.364234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:35.364263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:35.364502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:35.364545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.364550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.364551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.364551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.364552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.364553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.364554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.364554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.364556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.364557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.364558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.364558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.364559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.364563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.364572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.364574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.364577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.364579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.364581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.364583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.364586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.364588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.364591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.364593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.364596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.364598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.364604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.364609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.364614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.364624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.364630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.364633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.364636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.364639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.364643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.364646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.364649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.364655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.364658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.364661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.364666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.364672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.364675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.364678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.364683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.364686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.364691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.364694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.364697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.364700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.364706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.364709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.364731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:35.365836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c343d481-cc443255-71d36378-cd744fa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.365898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:35.365910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 232
2025-10-10T14:31:35.366060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.366090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:35.366099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:35.366105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:35.366538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 232 sessionId:  describe result for acl check
2025-10-10T14:31:35.366572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:35.366577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:35.366579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:35.366585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600694813386816:3826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:35.366880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:35.367152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600694813386816:3826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:35.367182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:35.367191Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:35.367193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:35.367195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:35.367200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 231 [2:7559600694031177265:3367]
2025-10-10T14:31:35.367208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:35.367219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:35.367221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.367223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.367225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.367237Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:35.367246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:35.367253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:35.367299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.367304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.367308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.367310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:35.367358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:35.367365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.367372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.367378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.367387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:35.367402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600694031177260:3367]
2025-10-10T14:31:35.367403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600694031177260:3367]
2025-10-10T14:31:35.367405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600694031177260:3367]
2025-10-10T14:31:35.367411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:35.367419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:35.367421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:35.367423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:35.367425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:35.367432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:35.367434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:35.367450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600694031177260:3367]
2025-10-10T14:31:35.367460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:35.367472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:35.367985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386791:2438], now have 1 active actors on pipe
2025-10-10T14:31:35.368015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 231
2025-10-10T14:31:35.369190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600694813386816:3826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:35.374613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600694813386816:3826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:35.374628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600694813386816:3826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:35.374631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600694813386816:3826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:35.374640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:35.374888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386850:3826], now have 1 active actors on pipe
2025-10-10T14:31:35.374921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 231
2025-10-10T14:31:35.374997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.375015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.375043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:35.375057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.375061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.375062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:35.375073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.375093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:35.375107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.375250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.375256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.375266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.375333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 232 partition: 0 MaxSeqNo: 40 sessionId: src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0
2025-10-10T14:31:35.375664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c343d481-cc443255-71d36378-cd744fa0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:35.378228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0] Write session: try to update token
2025-10-10T14:31:35.378246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:35.379722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:35.379735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.379742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600694031177260:3367]
2025-10-10T14:31:35.379778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:35.379787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:35.379936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:35.380063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.380199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.380352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.380529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:35.380560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:35.393701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId: src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:35.396318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:35.396334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.396337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:35.396338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:35.396346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600694031177260:3367]
2025-10-10T14:31:35.396349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600694031177260:3367]
2025-10-10T14:31:35.396351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600694031177260:3367]
2025-10-10T14:31:35.396386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:35.396391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.396393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:35.396397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:35.396404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:35.396408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:35.396514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:35.396662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:35.456396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600694813386853:3658]
2025-10-10T14:31:35.456619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 231, pipe: [1:7559600694813386853:3658]
2025-10-10T14:31:35.498256Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:35.498489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.498501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.498519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386853:3658], now have 1 active actors on pipe
2025-10-10T14:31:35.498677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:35.498731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600694813386853:3658]
2025-10-10T14:31:35.498758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:35.498824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 232 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0
2025-10-10T14:31:35.499021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 232 sessionId: src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0 is DEAD
2025-10-10T14:31:35.499143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:35.499155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0] Write session will restart in 0.006575s
2025-10-10T14:31:35.499174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0] Write session: Do CDS request
2025-10-10T14:31:35.499179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:35.499171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:35.504429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:35.505824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:35.505985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:35.505993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:35.506002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:35.506036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:35.506068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600694031177365:3377]
2025-10-10T14:31:35.506483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:35.506777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:35.506831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.506826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:35.506914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:35.506926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 233
2025-10-10T14:31:35.507059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.507076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:35.507088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:35.507098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:35.507103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:35.507120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.507128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.507129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.507130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.507131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.507133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.507134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.507135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.507136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.507137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.507138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.507139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.507140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.507146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.507157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.507161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.507177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.507181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.507185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.507188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.507190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.507192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.507194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.507196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.507198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.507200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.507207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.507216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.507224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.507230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.507248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.507254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.507262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.507268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.507273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.507280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.507282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.507286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.507291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.507295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.507298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.507301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.507303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.507307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.507309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.507312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.507315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.507318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.507321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.507324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.507327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.507330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.507351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:35.507449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 233 sessionId:  describe result for acl check
2025-10-10T14:31:35.507490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:35.507497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:35.507498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:35.507502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600694813386906:3839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:35.507962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600694813386906:3839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:35.509546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:35.510148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:35.510159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:35.510161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:35.510164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:35.510169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 232 [2:7559600694031177365:3377]
2025-10-10T14:31:35.510191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:35.510212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:35.510219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.510222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.510225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.510241Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:35.510224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600694813386906:3839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:35.510248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:35.510260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:35.510328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.510335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.510336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.510338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:35.510387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:35.510392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.510400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.510411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.510430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:35.510455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386872:2438], now have 1 active actors on pipe
2025-10-10T14:31:35.510467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600694031177360:3377]
2025-10-10T14:31:35.510473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600694031177360:3377]
2025-10-10T14:31:35.510475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600694031177360:3377]
2025-10-10T14:31:35.510488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:35.510499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 232
2025-10-10T14:31:35.510505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:35.510512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:35.510516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:35.510518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:35.510525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:35.510532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:35.510559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600694031177360:3377]
2025-10-10T14:31:35.510566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:35.510573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:35.515335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600694813386906:3839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:35.515346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600694813386906:3839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:35.515348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600694813386906:3839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:35.515361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:35.515562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386938:3839], now have 1 active actors on pipe
2025-10-10T14:31:35.515622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 232
2025-10-10T14:31:35.515685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.515700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.515724Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|591378c0-65c09dc8-d805aaea-7caa737a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:35.515736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.515740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.515743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:35.515754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.515770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:35.515793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.515951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.515957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.515968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.516063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 233 partition: 0 MaxSeqNo: 40 sessionId: src_id|591378c0-65c09dc8-d805aaea-7caa737a_0
2025-10-10T14:31:35.516366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be1bf1a-38b003ae-402c37b5-80444e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|591378c0-65c09dc8-d805aaea-7caa737a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:35.518812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591378c0-65c09dc8-d805aaea-7caa737a_0] Write session: try to update token
2025-10-10T14:31:35.518825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591378c0-65c09dc8-d805aaea-7caa737a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:35.522529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:35.522544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.522551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600694031177360:3377]
2025-10-10T14:31:35.522588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:35.522588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:35.522756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:35.522890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.523028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.523150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.523325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:35.523359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:35.533562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId: src_id|591378c0-65c09dc8-d805aaea-7caa737a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:35.536109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:35.536289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.536312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.536346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:35.536420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:35.540489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:35.540501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.540504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:35.540505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:35.540513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600694031177360:3377]
2025-10-10T14:31:35.540515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600694031177360:3377]
2025-10-10T14:31:35.540518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600694031177360:3377]
2025-10-10T14:31:35.540564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:35.540576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:35.540583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:35.540927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:35.540939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.540940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:35.541071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:35.598799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600694813386955:3658]
2025-10-10T14:31:35.599081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 232, pipe: [1:7559600694813386955:3658]
2025-10-10T14:31:35.643511Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:35.649953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.649975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.650127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.650185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.650238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.650303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.650542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.650554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.650614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.650700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.650754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.650974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.651025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.651031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.651089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.651176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.651236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.651289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.651329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.651333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.651403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.651485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.651537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.651590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.651651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.651658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.651718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.651767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.651829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.651882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.651924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.651929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.651988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.652046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.652103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.652157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.652195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.652200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.652260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.652320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.652383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.652445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.652491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.652500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.652560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.652612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.652667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.652724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.652764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.652769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.652827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.652879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.652934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.653024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.653131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.653136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.653193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.653245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.653318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.653396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.653450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.653455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.653496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386955:3658], now have 1 active actors on pipe
2025-10-10T14:31:35.653791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:35.653807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600694813386955:3658]
2025-10-10T14:31:35.653843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:35.653851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:35.653883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 233 reason: error at write: Disconnected sessionId: src_id|591378c0-65c09dc8-d805aaea-7caa737a_0
2025-10-10T14:31:35.653902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:35.654138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 233 sessionId: src_id|591378c0-65c09dc8-d805aaea-7caa737a_0 is DEAD
2025-10-10T14:31:35.654263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591378c0-65c09dc8-d805aaea-7caa737a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:35.654284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591378c0-65c09dc8-d805aaea-7caa737a_0] Write session will restart in 0.005731s
2025-10-10T14:31:35.654310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591378c0-65c09dc8-d805aaea-7caa737a_0] Write session: Do CDS request
2025-10-10T14:31:35.654317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591378c0-65c09dc8-d805aaea-7caa737a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:35.660879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591378c0-65c09dc8-d805aaea-7caa737a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.660853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:35.661011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:35.661023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 234
2025-10-10T14:31:35.661166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.661201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:35.661211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:35.661214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:35.661909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 234 sessionId:  describe result for acl check
2025-10-10T14:31:35.661944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:35.661950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:35.661954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:35.661960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600694813386980:3845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:35.662170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:35.662334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:35.662347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:35.662357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:35.662401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:35.662432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600694031177427:3385]
2025-10-10T14:31:35.662765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600694813386980:3845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:35.662812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:35.663103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:35.663158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:35.663460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:35.663524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.663531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.663532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.663533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.663534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.663537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.663538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.663539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.663540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.663541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.663542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.663543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.663544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.663550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.663559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.663563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.663567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.663569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.663573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.663576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.663579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.663582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.663585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.663588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.663592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.663595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.663601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.663610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.663621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.663630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.663633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.663641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.663645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.663654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.663658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.663662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.663666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.663670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.663675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.663679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.663683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.663687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.663691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.663697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.663700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.663705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.663708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.663712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.663716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.663720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.663723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.663727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.663772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:35.665029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600694813386980:3845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:35.666093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:35.666453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:35.666464Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:35.666466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:35.666468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:35.666473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 233 [2:7559600694031177427:3385]
2025-10-10T14:31:35.666480Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:35.666493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:35.666496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.666498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.666499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.666512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:35.666517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:35.666525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:35.666563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.666569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.666570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.666571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:35.666616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:35.666621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.666628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.666634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.666657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:35.666675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813386957:2438], now have 1 active actors on pipe
2025-10-10T14:31:35.666687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600694031177422:3385]
2025-10-10T14:31:35.666693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600694031177422:3385]
2025-10-10T14:31:35.666695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600694031177422:3385]
2025-10-10T14:31:35.666708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:35.666724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:35.666731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:35.666735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:35.666736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:35.666756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:35.666764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:35.666745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 233
2025-10-10T14:31:35.666783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600694031177422:3385]
2025-10-10T14:31:35.666794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:35.666806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:35.667959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600694813386980:3845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:35.667972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600694813386980:3845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:35.667975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600694813386980:3845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:35.667983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:35.668177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813387018:3845], now have 1 active actors on pipe
2025-10-10T14:31:35.668232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 233
2025-10-10T14:31:35.668291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.668310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.668334Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75d11183-bdb15e6b-458c923c-95131a76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:35.668343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.668347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.668351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:35.668360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.668371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:35.668384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.668562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.668576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.668599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.668680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 234 partition: 0 MaxSeqNo: 40 sessionId: src_id|75d11183-bdb15e6b-458c923c-95131a76_0
2025-10-10T14:31:35.669032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591378c0-65c09dc8-d805aaea-7caa737a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75d11183-bdb15e6b-458c923c-95131a76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:35.671418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d11183-bdb15e6b-458c923c-95131a76_0] Write session: try to update token
2025-10-10T14:31:35.671433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d11183-bdb15e6b-458c923c-95131a76_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:35.678905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:35.678926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.678937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600694031177422:3385]
2025-10-10T14:31:35.678987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:35.678990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:35.679170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:35.679338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.679481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.679624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.679820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:35.679869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:35.684768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId: src_id|75d11183-bdb15e6b-458c923c-95131a76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:35.687225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:35.687454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.687476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.687520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:35.687637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:35.695729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:35.695746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.695748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:35.695750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:35.695768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600694031177422:3385]
2025-10-10T14:31:35.695771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600694031177422:3385]
2025-10-10T14:31:35.695774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600694031177422:3385]
2025-10-10T14:31:35.695811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:35.695814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:35.695821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.695822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:35.695835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:35.695839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:35.695954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:35.753938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600694813387021:3658]
2025-10-10T14:31:35.754176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 233, pipe: [1:7559600694813387021:3658]
2025-10-10T14:31:35.796147Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:35.802464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.802487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.802654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.802724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.802787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.802848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.802889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.802899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.802969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.803031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.803089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.803146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.803186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.803191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.803250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.803306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.803397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.803453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.803496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.803503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.803560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.803613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.803666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.803731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.803770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.803776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.803834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.803887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.803942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.804018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.804057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.804062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.804119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.804171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.804227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.804313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.804351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.804356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.804414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.804467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.804524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.804577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.804630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.804634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.804689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.804754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.804813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.804880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.804934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.804939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.804994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.805046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.805104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.805160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.805198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.805202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.805258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:35.805308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:35.805375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:35.805429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:35.805467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:35.805472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:35.805513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813387021:3658], now have 1 active actors on pipe
2025-10-10T14:31:35.805763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600694813387021:3658]
2025-10-10T14:31:35.805770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:35.805774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:35.805788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:35.805805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 234 reason: error at write: Disconnected sessionId: src_id|75d11183-bdb15e6b-458c923c-95131a76_0
2025-10-10T14:31:35.806023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 234 sessionId: src_id|75d11183-bdb15e6b-458c923c-95131a76_0 is DEAD
2025-10-10T14:31:35.806163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d11183-bdb15e6b-458c923c-95131a76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:35.806172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d11183-bdb15e6b-458c923c-95131a76_0] Write session will restart in 0.005316s
2025-10-10T14:31:35.806191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d11183-bdb15e6b-458c923c-95131a76_0] Write session: Do CDS request
2025-10-10T14:31:35.806171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:35.806195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d11183-bdb15e6b-458c923c-95131a76_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:35.811805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:35.812169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:35.812342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:35.812353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:35.812365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:35.812417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:35.812453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600694031177490:3387]
2025-10-10T14:31:35.812838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:35.812864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d11183-bdb15e6b-458c923c-95131a76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.813045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:35.813056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 235
2025-10-10T14:31:35.813153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.813181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:35.813190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:35.813196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:35.813419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:35.813477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:35.813729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:35.813764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 235 sessionId:  describe result for acl check
2025-10-10T14:31:35.813772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.813776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.813777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.813778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.813778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.813779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.813780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.813793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:35.813781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.813781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.813799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:35.813782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.813801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:35.813782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.813784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.813785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.813806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600694813387049:3849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:35.813789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.813798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.813800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.813803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.813805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.813808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.813811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.813813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.813815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.813818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.813820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.813822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.813824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.813829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.813837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.813844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.813849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.813854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.813858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.813862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.813873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.813880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.813883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.813886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.813889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.813895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.813898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.813900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.813906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.813909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.813913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.813915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.813918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.813924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.813927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.813929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.813932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.813935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.813941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.813963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:35.814327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600694813387049:3849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:35.816114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:35.816346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600694813387049:3849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:35.816413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:35.816426Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:35.816428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:35.816432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:35.816436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 234 [2:7559600694031177490:3387]
2025-10-10T14:31:35.816443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:35.816456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:35.816460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.816462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.816463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.816474Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:35.816481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:35.816487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:35.816531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.816536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.816539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.816540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:35.816584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:35.816589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.816596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.816603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.816613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:35.816630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600694031177485:3387]
2025-10-10T14:31:35.816635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600694031177485:3387]
2025-10-10T14:31:35.816636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600694031177485:3387]
2025-10-10T14:31:35.816645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:35.816657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:35.816661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:35.816664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:35.816667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:35.816675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:35.816680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:35.816702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600694031177485:3387]
2025-10-10T14:31:35.816710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:35.816714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:35.817533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813387023:2438], now have 1 active actors on pipe
2025-10-10T14:31:35.817579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 234
2025-10-10T14:31:35.820934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600694813387049:3849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:35.820952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600694813387049:3849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:35.820955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600694813387049:3849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:35.820962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:35.821164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813387085:3849], now have 1 active actors on pipe
2025-10-10T14:31:35.821220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 234
2025-10-10T14:31:35.821271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.821294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.821323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:35.821344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.821348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.821352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:35.821362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.821378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:35.821400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.821548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.821554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.821566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.821641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 235 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0
2025-10-10T14:31:35.822036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d11183-bdb15e6b-458c923c-95131a76_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:35.824984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0] Write session: try to update token
2025-10-10T14:31:35.824998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:35.834803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:35.834821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.834823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:35.834824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:35.834832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600694031177485:3387]
2025-10-10T14:31:35.834838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600694031177485:3387]
2025-10-10T14:31:35.834840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600694031177485:3387]
2025-10-10T14:31:35.834877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:35.834885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.834884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:35.834886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:35.834890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:35.834895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:35.835019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:35.838942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId: src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:35.841409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:35.905942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600694813387088:3658]
2025-10-10T14:31:35.906181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 234, pipe: [1:7559600694813387088:3658]
2025-10-10T14:31:35.936866Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:35.937124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.937137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.937174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813387088:3658], now have 1 active actors on pipe
2025-10-10T14:31:35.937360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:35.937427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:35.937432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600694813387088:3658]
2025-10-10T14:31:35.937437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:35.937452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:35.937497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 235 reason: error at write: Disconnected sessionId: src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0
2025-10-10T14:31:35.937678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 235 sessionId: src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0 is DEAD
2025-10-10T14:31:35.937816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:35.937824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0] Write session will restart in 0.008741s
2025-10-10T14:31:35.937842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0] Write session: Do CDS request
2025-10-10T14:31:35.937847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:35.944107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:35.945423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:35.945589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:35.945600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:35.945609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:35.945651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:35.945683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600694031177554:3389]
2025-10-10T14:31:35.946174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:35.946477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:35.946511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:35.946739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:35.946782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.946787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.946788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.946789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.946790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.946790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.946791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.946791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.946792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.946793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.946793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.946794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.946795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.946798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.946807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.946812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.946815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.946817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.946819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.946821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.946823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.946825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.946828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.946830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.946832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.946833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.946840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.946845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:35.946849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.946852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:35.946856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.946859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:35.946862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.946865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:35.946867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.946871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:35.946873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.946877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:35.946880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.946883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:35.946886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.946889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:35.946891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.946895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:35.946897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.946900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:35.946903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.946906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.946909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.946912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.946916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.946918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.946940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:35.947806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.947892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:35.947904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 236
2025-10-10T14:31:35.948045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:35.948080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:35.948090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:35.948098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:35.948487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 236 sessionId:  describe result for acl check
2025-10-10T14:31:35.948519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:35.948523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:35.948525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:35.948529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600694813387118:3853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:35.949022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600694813387118:3853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:35.949151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:35.949472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:35.949483Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:35.949484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:35.949487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:35.949492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 235 [2:7559600694031177554:3389]
2025-10-10T14:31:35.949501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:35.949516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:35.949517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.949519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.949521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.949536Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:35.949548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:35.949554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:35.949604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.949610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.949613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.949616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:35.949692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:35.949700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.949712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:35.949728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:35.949747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:35.949759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 235
2025-10-10T14:31:35.949781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813387089:2438], now have 1 active actors on pipe
2025-10-10T14:31:35.949793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600694031177549:3389]
2025-10-10T14:31:35.949800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600694031177549:3389]
2025-10-10T14:31:35.949802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600694031177549:3389]
2025-10-10T14:31:35.949815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:35.949824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:35.949830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:35.949834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:35.949836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:35.949847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:35.949849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:35.949880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600694031177549:3389]
2025-10-10T14:31:35.949891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:35.949898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:35.951181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600694813387118:3853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:35.956938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600694813387118:3853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:35.956950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600694813387118:3853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:35.956953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600694813387118:3853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:35.956961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:35.957176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600694813387152:3853], now have 1 active actors on pipe
2025-10-10T14:31:35.957222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 235
2025-10-10T14:31:35.957267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.957281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.957310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:35.957344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:35.957352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:35.957354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:35.957366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:35.957385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:35.957405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.957530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.957536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.957548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:35.957607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 236 partition: 0 MaxSeqNo: 40 sessionId: src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0
2025-10-10T14:31:35.957977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d7fe561-d0fdab42-7ff20460-586bf611_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:35.960625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0] Write session: try to update token
2025-10-10T14:31:35.960643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:35.961382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:35.961394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.961403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600694031177549:3389]
2025-10-10T14:31:35.961441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:35.961445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:35.961599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:35.961729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.961853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.961978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:35.962147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:35.962188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:35.974658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId: src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:35.977059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:35.978653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:35.978677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:35.978696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:35.978701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:35.978702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:35.978706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:35.978714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600694031177549:3389]
2025-10-10T14:31:35.978716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600694031177549:3389]
2025-10-10T14:31:35.978719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600694031177549:3389]
2025-10-10T14:31:35.978763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:35.978772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:35.978774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:35.978778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:35.978791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:35.978795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:35.978915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:36.037596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600699108354452:3658]
2025-10-10T14:31:36.037938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 235, pipe: [1:7559600699108354452:3658]
2025-10-10T14:31:36.082239Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:36.082440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:36.082471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354452:3658], now have 1 active actors on pipe
2025-10-10T14:31:36.082563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:36.082636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600699108354452:3658]
2025-10-10T14:31:36.082673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:36.089275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:36.090503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:36.090666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:36.090675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:36.090684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:36.090723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:36.090751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600698326144927:3392]
2025-10-10T14:31:36.091152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:36.091411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:36.091454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:36.091710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:36.091756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.091761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.091762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.091762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.091763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.091764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.091765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.091766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.091767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.091768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.091768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.091769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.091770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.091774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.091781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.091784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.091786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.091788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.091791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.091793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.091795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.091797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.091800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.091802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.091804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.091806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.091812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.091818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.091822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.091825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.091829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.091834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.091836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.091840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.091842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.091853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.091862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.091867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.091870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.091872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.091874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.091877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.091879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.091882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.091884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.091887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.091889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.091892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.091894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.091897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.091900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.091902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.091931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:36.093841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:36.093853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:36.093875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 236 reason: error at write: Disconnected sessionId: src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0
2025-10-10T14:31:36.094050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 236 sessionId: src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0 is DEAD
2025-10-10T14:31:36.094170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:36.094180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0] Write session will restart in 0.007319s
2025-10-10T14:31:36.094202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0] Write session: Do CDS request
2025-10-10T14:31:36.094208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:36.098552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:36.098844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:36.098853Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:36.098854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:36.098857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:36.098862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 236 [2:7559600698326144927:3392]
2025-10-10T14:31:36.098873Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:36.098886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:36.098891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.098893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.098896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.098913Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:36.098922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:36.098931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:36.098970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.098975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.098976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.098978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:36.099027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:36.099033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.099040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.099046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.099056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:36.099076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600698326144922:3392]
2025-10-10T14:31:36.099080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600698326144922:3392]
2025-10-10T14:31:36.099082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600698326144922:3392]
2025-10-10T14:31:36.099088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:36.099098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:36.099098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:36.099101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:36.099103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:36.099113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:36.099115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:36.099131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354465:2438], now have 1 active actors on pipe
2025-10-10T14:31:36.099159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600698326144922:3392]
2025-10-10T14:31:36.099166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:36.099178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:36.099181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 236
2025-10-10T14:31:36.102880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.102985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:36.102996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 237
2025-10-10T14:31:36.103126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.103168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:36.103179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:36.103184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:36.103620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 237 sessionId:  describe result for acl check
2025-10-10T14:31:36.103648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:36.103652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:36.103654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:36.103658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600699108354500:3858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:36.104109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600699108354500:3858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:36.106690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600699108354500:3858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:36.109288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600699108354500:3858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:36.109307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600699108354500:3858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:36.109310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600699108354500:3858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:36.109318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:36.109588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 236
2025-10-10T14:31:36.110029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354531:3858], now have 1 active actors on pipe
2025-10-10T14:31:36.110058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.110065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.110083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:36.110091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.110100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600698326144922:3392]
2025-10-10T14:31:36.110139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:36.110149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:36.110159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.110163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.110165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:36.110175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.110188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:36.110200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:36.110360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:36.110486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.110604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.110723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.110891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:36.110925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.110944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:36.111126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.111133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.111146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.111232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 237 partition: 0 MaxSeqNo: 40 sessionId: src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0
2025-10-10T14:31:36.111596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a9555a5-21b1ab81-2178a6e9-e4b895e3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:36.114066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0] Write session: try to update token
2025-10-10T14:31:36.114082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:36.127055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:36.127072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.127074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:36.127076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:36.127084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600698326144922:3392]
2025-10-10T14:31:36.127087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600698326144922:3392]
2025-10-10T14:31:36.127090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600698326144922:3392]
2025-10-10T14:31:36.127128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:36.127137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.127142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:36.127142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:36.127148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:36.127153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:36.127254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:36.127784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId: src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:36.130106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:36.182977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600699108354533:3658]
2025-10-10T14:31:36.183202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 236, pipe: [1:7559600699108354533:3658]
2025-10-10T14:31:36.233163Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:36.233473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.233489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.233513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354533:3658], now have 1 active actors on pipe
2025-10-10T14:31:36.233691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:36.233754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:36.233766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:36.233775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:36.233819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600699108354533:3658]
2025-10-10T14:31:36.233838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 237 reason: error at write: Disconnected sessionId: src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0
2025-10-10T14:31:36.234035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 237 sessionId: src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0 is DEAD
2025-10-10T14:31:36.234162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:36.234174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0] Write session will restart in 0.007657s
2025-10-10T14:31:36.234198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0] Write session: Do CDS request
2025-10-10T14:31:36.234204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:36.240512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:36.242006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:36.242167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:36.242176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:36.242192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:36.242235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:36.242270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600698326144993:3394]
2025-10-10T14:31:36.242715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:36.242828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.242838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:36.242849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 238
2025-10-10T14:31:36.242977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:36.243011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:36.243017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.243052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:36.243061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:36.243065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:36.243232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:36.243273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.243278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.243278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.243279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.243280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.243280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.243281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.243281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.243282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.243283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.243283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.243284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.243285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.243288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.243296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.243298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.243302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.243304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.243307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.243309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.243311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.243314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.243316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.243318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.243321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.243323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.243328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.243334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.243339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.243342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.243345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.243348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.243350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.243353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.243356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.243359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.243361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.243365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.243368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.243371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.243374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.243377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.243394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.243400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.243404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.243408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.243412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.243418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.243422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.243443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 238 sessionId:  describe result for acl check
2025-10-10T14:31:36.243428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.243432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.243447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.243473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:36.243479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:36.243481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:36.243480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:36.243486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600699108354563:3862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:36.243932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600699108354563:3862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:36.245466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600699108354563:3862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:36.245720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:36.246011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:36.246024Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:36.246026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:36.246030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:36.246035Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 237 [2:7559600698326144993:3394]
2025-10-10T14:31:36.246047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:36.246067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:36.246074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.246078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.246080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.246095Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:36.246108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:36.246114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:36.246166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.246174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.246175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.246179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:36.246238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:36.246254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.246267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.246289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.246320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:36.246346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354534:2438], now have 1 active actors on pipe
2025-10-10T14:31:36.246357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600698326144988:3394]
2025-10-10T14:31:36.246364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600698326144988:3394]
2025-10-10T14:31:36.246349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 237
2025-10-10T14:31:36.246366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600698326144988:3394]
2025-10-10T14:31:36.246376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:36.246393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:36.246403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:36.246405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:36.246407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:36.246416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:36.246420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:36.246447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600698326144988:3394]
2025-10-10T14:31:36.246455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:36.246498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:36.251133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600699108354563:3862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:36.251146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600699108354563:3862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:36.251150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600699108354563:3862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:36.251159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:36.251443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354599:3862], now have 1 active actors on pipe
2025-10-10T14:31:36.251482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 237
2025-10-10T14:31:36.251541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.251554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.251578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:36.251596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.251602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.251605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:36.251620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.251637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:36.251664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.251812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.251820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.251837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.251911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 238 partition: 0 MaxSeqNo: 40 sessionId: src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0
2025-10-10T14:31:36.252227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99939c6f-9fd383c-a9712a0c-ec7430e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:36.254881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0] Write session: try to update token
2025-10-10T14:31:36.254898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:36.264963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:36.264980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.264984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:36.264986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:36.264997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600698326144988:3394]
2025-10-10T14:31:36.265001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600698326144988:3394]
2025-10-10T14:31:36.265005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600698326144988:3394]
2025-10-10T14:31:36.265054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:36.265060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:36.265065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.265066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:36.265067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:36.265071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:36.265195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:36.268978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId: src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:36.271347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:36.334007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600699108354606:3658]
2025-10-10T14:31:36.334207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 237, pipe: [1:7559600699108354606:3658]
2025-10-10T14:31:36.370118Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:36.370445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.370462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.370501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354606:3658], now have 1 active actors on pipe
2025-10-10T14:31:36.370754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:36.370765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:36.370772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600699108354606:3658]
2025-10-10T14:31:36.370793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:36.370823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 238 reason: error at write: Disconnected sessionId: src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0
2025-10-10T14:31:36.370722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:36.371022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 238 sessionId: src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0 is DEAD
2025-10-10T14:31:36.371158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:36.371168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0] Write session will restart in 0.009064s
2025-10-10T14:31:36.371187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0] Write session: Do CDS request
2025-10-10T14:31:36.371195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:36.377481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:36.378670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:36.378839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:36.378851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:36.378862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:36.378911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:36.378945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600698326145059:3396]
2025-10-10T14:31:36.379552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:36.379821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:36.379864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:36.380166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:36.380217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.380224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.380225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.380226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.380227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.380228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.380230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.380231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.380232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.380234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.380235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.380236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.380237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.380242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.380255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.380260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.380264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.380268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.380272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.380276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.380280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.380288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.380292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.380296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.380303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.380305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.380311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.380320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.380329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.380335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.380338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.380341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.380347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.380350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.380353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.380359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.380363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.380366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.380371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.380374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.380376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.380379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.380382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.380384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.380387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.380389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.380392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.380394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.380400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.380403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.380405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.380408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.380434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:36.381915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.381937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:36.381950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 239
2025-10-10T14:31:36.382121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.382154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:36.382165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:36.382169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:36.382580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 239 sessionId:  describe result for acl check
2025-10-10T14:31:36.382628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:36.382629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:36.382631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:36.382637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600699108354639:3868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:36.382646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:36.383016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:36.383031Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:36.383033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:36.383038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:36.383045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 238 [2:7559600698326145059:3396]
2025-10-10T14:31:36.383061Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:36.383081Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:36.383088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.383092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.383094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.383109Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:36.383122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:36.383129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:36.383234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.383241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.383243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.383245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:36.383285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600699108354639:3868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:36.383316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:36.383325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.383337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.383347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.383363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:36.383380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 238
2025-10-10T14:31:36.383385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354607:2438], now have 1 active actors on pipe
2025-10-10T14:31:36.383398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600698326145054:3396]
2025-10-10T14:31:36.383400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600698326145054:3396]
2025-10-10T14:31:36.383402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600698326145054:3396]
2025-10-10T14:31:36.383410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:36.383418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:36.383425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:36.383427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:36.383428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:36.383441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:36.383450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:36.383486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600698326145054:3396]
2025-10-10T14:31:36.383498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:36.383513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:36.384817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600699108354639:3868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:36.390105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600699108354639:3868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:36.390116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600699108354639:3868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:36.390119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600699108354639:3868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:36.390132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:36.390346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354673:3868], now have 1 active actors on pipe
2025-10-10T14:31:36.390398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 238
2025-10-10T14:31:36.390445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.390456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.390492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56837f6-b4df2a03-3afb5660-c09683d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:36.390509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.390519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.390521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:36.390537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.390557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:36.390581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.390729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.390738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.390753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.390818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 239 partition: 0 MaxSeqNo: 40 sessionId: src_id|56837f6-b4df2a03-3afb5660-c09683d_0
2025-10-10T14:31:36.391157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafa6c7e-dd1093db-4c24d7f0-511c9b58_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56837f6-b4df2a03-3afb5660-c09683d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:36.393734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56837f6-b4df2a03-3afb5660-c09683d_0] Write session: try to update token
2025-10-10T14:31:36.393748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56837f6-b4df2a03-3afb5660-c09683d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:36.394641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:36.394657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.394667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600698326145054:3396]
2025-10-10T14:31:36.394703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:36.394715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:36.394893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:36.395039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.395177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.395316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.395510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:36.395547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:36.407358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId: src_id|56837f6-b4df2a03-3afb5660-c09683d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:36.409631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:36.409804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.409829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.409868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:36.409964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:36.412594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:36.412611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.412614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:36.412616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:36.412625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600698326145054:3396]
2025-10-10T14:31:36.412631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600698326145054:3396]
2025-10-10T14:31:36.412634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600698326145054:3396]
2025-10-10T14:31:36.412677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:36.412679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:36.412686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.412690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:36.412690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:36.412693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:36.412817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:36.470724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600699108354677:3658]
2025-10-10T14:31:36.470991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 238, pipe: [1:7559600699108354677:3658]
2025-10-10T14:31:36.519050Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:36.525490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.525510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.525664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.525719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.525775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.525835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.525874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.525881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.525941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.525995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.526050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.526112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.526153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.526159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.526225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.526296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.526354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.526414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.526453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.526458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.526520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.526575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.526636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.526693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.526733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.526738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.526797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.526849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.526906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.526973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.527019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.527027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.527086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.527138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.527190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.527245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.527285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.527290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.527350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.527418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.527477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.527531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.527572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.527577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.527636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.527692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.527754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.527808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.527864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.527870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.527927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.527978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.528033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.528088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.528129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.528137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.528194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.528247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.528300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.528355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.528394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.528399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.528435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354677:3658], now have 1 active actors on pipe
2025-10-10T14:31:36.528697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600699108354677:3658]
2025-10-10T14:31:36.528730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:36.528732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:36.528758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 239 reason: error at write: Disconnected sessionId: src_id|56837f6-b4df2a03-3afb5660-c09683d_0
2025-10-10T14:31:36.528974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 239 sessionId: src_id|56837f6-b4df2a03-3afb5660-c09683d_0 is DEAD
2025-10-10T14:31:36.529106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56837f6-b4df2a03-3afb5660-c09683d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:36.529115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56837f6-b4df2a03-3afb5660-c09683d_0] Write session will restart in 0.009575s
2025-10-10T14:31:36.529135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56837f6-b4df2a03-3afb5660-c09683d_0] Write session: Do CDS request
2025-10-10T14:31:36.529139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56837f6-b4df2a03-3afb5660-c09683d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:36.529139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:36.529252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:36.535343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:36.536642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:36.536793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:36.536802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:36.536811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:36.536848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:36.536880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600698326145148:3404]
2025-10-10T14:31:36.537239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:36.537608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:36.537653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:36.537945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:36.538014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.538020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.538021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.538022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.538023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.538024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.538025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.538026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.538027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.538028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.538029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.538030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.538032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.538038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.538048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.538052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.538055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.538059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.538063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.538066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.538070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.538074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.538078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.538082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.538086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.538089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.538095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.538103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.538109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.538114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.538117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.538122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.538126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.538131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.538136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.538141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.538145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.538150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.538154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.538159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.538161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.538164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.538168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.538172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.538174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.538177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.538180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.538183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.538186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.538189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.538191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.538194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.538216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:36.539885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56837f6-b4df2a03-3afb5660-c09683d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.539949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:36.539960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 240
2025-10-10T14:31:36.540103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.540135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:36.540139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:36.540142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:36.540481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 240 sessionId:  describe result for acl check
2025-10-10T14:31:36.540492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:36.540527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:36.540535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:36.540537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:36.540542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600699108354745:3883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:36.541022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:36.541030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600699108354745:3883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:36.541037Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:36.541039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:36.541042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:36.541047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 239 [2:7559600698326145148:3404]
2025-10-10T14:31:36.541058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:36.541078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:36.541086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.541089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.541091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.541105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:36.541117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:36.541124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:36.541164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.541169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.541170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.541172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:36.541219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:36.541224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.541232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.541242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.541262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:36.541288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354694:2438], now have 1 active actors on pipe
2025-10-10T14:31:36.541301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600698326145136:3404]
2025-10-10T14:31:36.541308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600698326145136:3404]
2025-10-10T14:31:36.541310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600698326145136:3404]
2025-10-10T14:31:36.541321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:36.541322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 239
2025-10-10T14:31:36.541345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:36.541353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:36.541355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:36.541357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:36.541370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:36.541378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:36.541402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600698326145136:3404]
2025-10-10T14:31:36.541415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:36.541441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:36.542628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600699108354745:3883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:36.548141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600699108354745:3883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:36.548157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600699108354745:3883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:36.548160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600699108354745:3883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:36.548166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:36.548413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354775:3883], now have 1 active actors on pipe
2025-10-10T14:31:36.548443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 239
2025-10-10T14:31:36.548495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.548506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.548542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:36.548560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.548570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.548573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:36.548598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.548621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:36.548648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.548828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.548837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.548853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.548937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 240 partition: 0 MaxSeqNo: 40 sessionId: src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0
2025-10-10T14:31:36.549302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56837f6-b4df2a03-3afb5660-c09683d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:36.551881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0] Write session: try to update token
2025-10-10T14:31:36.551897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:36.558366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:36.558384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.558393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600698326145136:3404]
2025-10-10T14:31:36.558440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:36.558445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:36.558651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:36.558797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.558942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.559082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.559267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:36.559309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:36.565968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId: src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:36.568255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:36.568434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.568455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.568494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:36.568551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:36.570168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:36.570183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.570186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:36.570188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:36.570198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600698326145136:3404]
2025-10-10T14:31:36.570201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600698326145136:3404]
2025-10-10T14:31:36.570204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600698326145136:3404]
2025-10-10T14:31:36.570235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:36.570246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:36.570247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:36.570249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:36.570254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.570257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:36.570401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:36.628905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600699108354782:3658]
2025-10-10T14:31:36.629145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 239, pipe: [1:7559600699108354782:3658]
2025-10-10T14:31:36.683079Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:36.690192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.690218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.690394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.690452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.690513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.690573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.690616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.690624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.690686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.690744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.690810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.690874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.690918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.690926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.691037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.691148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.691267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.691386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.691460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.691468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.691595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.691676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.691756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.691834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.691886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.691895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.691979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.692074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.692166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.692241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.692294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.692303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.692382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.692454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.692555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.692642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.692693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.692703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.692777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.692849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.692931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.693042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.693095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.693103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.693179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.693252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.693347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.693426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.693490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.693502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.693592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.693666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.693739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.693815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.693870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.693878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.693954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.694030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.694111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.694187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.694239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.694248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.694331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354782:3658], now have 1 active actors on pipe
2025-10-10T14:31:36.694753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600699108354782:3658]
2025-10-10T14:31:36.694765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:36.694769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:36.694791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:36.694798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 240 reason: error at write: Disconnected sessionId: src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0
2025-10-10T14:31:36.695028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 240 sessionId: src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0 is DEAD
2025-10-10T14:31:36.695156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:36.695165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0] Write session will restart in 0.007511s
2025-10-10T14:31:36.695189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0] Write session: Do CDS request
2025-10-10T14:31:36.695196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:36.695354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:36.701801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:36.703195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:36.703383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:36.703394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:36.703406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:36.703462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:36.703505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600698326145236:3414]
2025-10-10T14:31:36.703927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.703986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:36.703997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 241
2025-10-10T14:31:36.704103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:36.704170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.704211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:36.704241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:36.704246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:36.704388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:36.704432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:36.704660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 241 sessionId:  describe result for acl check
2025-10-10T14:31:36.704692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:36.704700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:36.704701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:36.704707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600699108354816:3887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:36.704742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:36.704793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.704798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.704799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.704801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.704802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.704803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.704805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.704806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.704807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.704808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.704810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.704811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.704812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.704817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.704830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.704833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.704837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.704843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.704848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.704852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.704855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.704859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.704863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.704867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.704871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.704874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.704881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.704889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.704895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.704902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.704906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.704911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.704916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.704921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.704925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.704932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.704938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.704948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.704952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.704956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.704964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.704969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.704974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.704979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.704987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.704992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.704997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.705006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.705010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.705016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.705024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.705029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.705066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:36.705228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600699108354816:3887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:36.707200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:36.707189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600699108354816:3887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:36.707521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:36.707535Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:36.707537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:36.707540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:36.707546Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 240 [2:7559600698326145236:3414]
2025-10-10T14:31:36.707559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:36.707577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:36.707584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.707587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.707589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.707601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:36.707608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:36.707615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:36.707668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.707675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.707677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.707679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:36.707746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:36.707752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.707763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.707774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.707797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:36.707822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354783:2438], now have 1 active actors on pipe
2025-10-10T14:31:36.707814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 240
2025-10-10T14:31:36.707836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600698326145231:3414]
2025-10-10T14:31:36.707842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600698326145231:3414]
2025-10-10T14:31:36.707844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600698326145231:3414]
2025-10-10T14:31:36.707852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:36.707865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:36.707873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:36.707880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:36.707881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:36.707883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:36.707882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:36.707907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600698326145231:3414]
2025-10-10T14:31:36.707918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:36.707923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:36.712400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600699108354816:3887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:36.712413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600699108354816:3887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:36.712417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600699108354816:3887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:36.712425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:36.712638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354852:3887], now have 1 active actors on pipe
2025-10-10T14:31:36.712690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 240
2025-10-10T14:31:36.712757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.712768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.712800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|483617fa-8bd1426c-a193fd11-3d22e920_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:36.712814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.712822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.712825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:36.712838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.712857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:36.712877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.713013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.713020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.713034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.713104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 241 partition: 0 MaxSeqNo: 40 sessionId: src_id|483617fa-8bd1426c-a193fd11-3d22e920_0
2025-10-10T14:31:36.713461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c7ff76d-136f07fe-e17df37d-7eb85eec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|483617fa-8bd1426c-a193fd11-3d22e920_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:36.716015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483617fa-8bd1426c-a193fd11-3d22e920_0] Write session: try to update token
2025-10-10T14:31:36.716030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483617fa-8bd1426c-a193fd11-3d22e920_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:36.726622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:36.726641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.726644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:36.726646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:36.726659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600698326145231:3414]
2025-10-10T14:31:36.726663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600698326145231:3414]
2025-10-10T14:31:36.726667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600698326145231:3414]
2025-10-10T14:31:36.726714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:36.726719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:36.726720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:36.726723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:36.726726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.726729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:36.726867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:36.730268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId: src_id|483617fa-8bd1426c-a193fd11-3d22e920_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:36.733091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:36.794816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600699108354856:3658]
2025-10-10T14:31:36.795064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 240, pipe: [1:7559600699108354856:3658]
2025-10-10T14:31:36.831404Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:36.831657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.831672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.831722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354856:3658], now have 1 active actors on pipe
2025-10-10T14:31:36.831942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:36.831957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:36.831960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:36.831994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600699108354856:3658]
2025-10-10T14:31:36.832014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 241 reason: error at write: Disconnected sessionId: src_id|483617fa-8bd1426c-a193fd11-3d22e920_0
2025-10-10T14:31:36.832231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 241 sessionId: src_id|483617fa-8bd1426c-a193fd11-3d22e920_0 is DEAD
2025-10-10T14:31:36.832363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483617fa-8bd1426c-a193fd11-3d22e920_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:36.832373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483617fa-8bd1426c-a193fd11-3d22e920_0] Write session will restart in 0.006427s
2025-10-10T14:31:36.832394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483617fa-8bd1426c-a193fd11-3d22e920_0] Write session: Do CDS request
2025-10-10T14:31:36.832399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483617fa-8bd1426c-a193fd11-3d22e920_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:36.832388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:36.838714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:36.839860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483617fa-8bd1426c-a193fd11-3d22e920_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.839990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:36.840005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 242
2025-10-10T14:31:36.840132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.840165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:36.840175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:36.840181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:36.840297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:36.840499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:36.840509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:36.840521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:36.840580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:36.840623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600698326145306:3416]
2025-10-10T14:31:36.840648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 242 sessionId:  describe result for acl check
2025-10-10T14:31:36.840680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:36.840686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:36.840688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:36.840702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600699108354888:3891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:36.841146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600699108354888:3891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:36.841183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:36.841515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:36.841556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:36.841849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:36.841891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.841895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.841896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.841897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.841897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.841898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.841899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.841901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.841902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.841902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.841903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.841904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.841904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.841908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.841916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.841918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.841921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.841923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.841925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.841927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.841930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.841932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.841934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.841937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.841939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.841941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.841946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.841951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:36.841956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.841959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:36.841962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.841965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:36.841968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.841971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:36.841974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.841978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:36.841980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.841983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:36.841987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.841993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:36.841996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.842001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:36.842004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.842008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:36.842011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.842016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:36.842020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.842025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.842030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.842036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.842040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.842045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.842075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:36.843339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600699108354888:3891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:36.844268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:36.844572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:36.844583Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:36.844585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:36.844591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:36.844598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 241 [2:7559600698326145306:3416]
2025-10-10T14:31:36.844611Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:36.844631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:36.844638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.844641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.844643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.844658Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:36.844669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:36.844680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:36.844733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.844739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.844740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.844742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:36.844807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:36.844814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.844826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:36.844842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:36.844864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:36.844888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354857:2438], now have 1 active actors on pipe
2025-10-10T14:31:36.844900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600698326145301:3416]
2025-10-10T14:31:36.844905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600698326145301:3416]
2025-10-10T14:31:36.844907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600698326145301:3416]
2025-10-10T14:31:36.844920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:36.844934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:36.844936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:36.844942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:36.844904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 241
2025-10-10T14:31:36.844943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:36.844953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:36.844956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:36.844982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600698326145301:3416]
2025-10-10T14:31:36.844992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:36.844998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:36.849729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600699108354888:3891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:36.849741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600699108354888:3891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:36.849751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600699108354888:3891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:36.849758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:36.849976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354926:3891], now have 1 active actors on pipe
2025-10-10T14:31:36.850024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 241
2025-10-10T14:31:36.850090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.850101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.850134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20abea89-8738c0be-74167d3-ba219842_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:36.850151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:36.850160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:36.850163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:36.850176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:36.850197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:36.850219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.850385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.850394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.850409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:36.850491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 242 partition: 0 MaxSeqNo: 40 sessionId: src_id|20abea89-8738c0be-74167d3-ba219842_0
2025-10-10T14:31:36.850854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483617fa-8bd1426c-a193fd11-3d22e920_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20abea89-8738c0be-74167d3-ba219842_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:36.853467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20abea89-8738c0be-74167d3-ba219842_0] Write session: try to update token
2025-10-10T14:31:36.853484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20abea89-8738c0be-74167d3-ba219842_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:36.855851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:36.855864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.855874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600698326145301:3416]
2025-10-10T14:31:36.855920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:36.855921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:36.856090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:36.856260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.856427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.856719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:36.856996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:36.857054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:36.867576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId: src_id|20abea89-8738c0be-74167d3-ba219842_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:36.870094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:36.870326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.870345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.870396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:36.870500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:36.872908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:36.872922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:36.872925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:36.872927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:36.872937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600698326145301:3416]
2025-10-10T14:31:36.872941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600698326145301:3416]
2025-10-10T14:31:36.872946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600698326145301:3416]
2025-10-10T14:31:36.872991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:36.872995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:36.873001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:36.873002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:36.873005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:36.873007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:36.873142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:36.932042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600699108354929:3658]
2025-10-10T14:31:36.932586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 241, pipe: [1:7559600699108354929:3658]
2025-10-10T14:31:36.982272Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:36.989057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:36.989079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:36.989231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.989288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.989382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.989441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.989481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.989488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.989548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.989613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.989669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.989727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.989766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.989772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.989829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.989882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.989937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.989991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.990032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.990041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.990109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.990164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.990219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.990272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.990321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.990329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.990388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.990442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.990496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.990552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.990590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.990595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.990652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.990705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.990757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.990811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.990853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.990858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.990914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.990986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.991041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.991093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.991143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.991149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.991212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.991263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.991317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.991372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.991410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.991417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.991486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.991538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.991592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.991650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.991688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.991693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.991750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:36.991800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:36.991855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:36.991908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:36.991950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:36.991955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:36.991996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354929:3658], now have 1 active actors on pipe
2025-10-10T14:31:36.992262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600699108354929:3658]
2025-10-10T14:31:36.992271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:36.992275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:36.992290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:36.992310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 242 reason: error at write: Disconnected sessionId: src_id|20abea89-8738c0be-74167d3-ba219842_0
2025-10-10T14:31:36.992538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 242 sessionId: src_id|20abea89-8738c0be-74167d3-ba219842_0 is DEAD
2025-10-10T14:31:36.992686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abea89-8738c0be-74167d3-ba219842_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:36.992693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abea89-8738c0be-74167d3-ba219842_0] Write session will restart in 0.005276s
2025-10-10T14:31:36.992714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abea89-8738c0be-74167d3-ba219842_0] Write session: Do CDS request
2025-10-10T14:31:36.992719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abea89-8738c0be-74167d3-ba219842_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:36.992745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:36.998671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:36.998800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20abea89-8738c0be-74167d3-ba219842_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.998915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:36.998926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 243
2025-10-10T14:31:36.999038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:36.999071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:36.999081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:36.999087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:36.999663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 243 sessionId:  describe result for acl check
2025-10-10T14:31:36.999709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:36.999715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:36.999717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:36.999723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600699108354963:3895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:37.000019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:37.000187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:37.000199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:37.000210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:37.000262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:37.000302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600702621112672:3418]
2025-10-10T14:31:37.000300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600699108354963:3895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:37.000889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:37.001136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:37.001175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:37.001477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:37.001532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.001538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.001539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.001540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.001541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.001543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.001544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.001545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.001546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.001547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.001548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.001550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.001551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.001556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.001567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.001573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.001577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.001580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.001584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.001588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.001592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.001596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.001600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.001604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.001607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.001611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.001617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.001625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.001631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.001639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.001643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.001649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.001655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.001660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.001664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.001674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.001678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.001683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.001687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.001693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.001697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.001706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.001710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.001716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.001720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.001728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.001733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.001738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.001746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.001751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.001755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.001764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.001802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:37.002893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600699108354963:3895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:37.003860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:37.004164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:37.004174Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:37.004176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:37.004179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:37.004184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 242 [2:7559600702621112672:3418]
2025-10-10T14:31:37.004195Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:37.004215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:37.004222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.004224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.004227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.004240Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:37.004251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:37.004263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:37.004312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.004318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.004321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.004323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:37.004379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:37.004386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.004398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.004416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.004439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:37.004463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600699108354931:2438], now have 1 active actors on pipe
2025-10-10T14:31:37.004460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 242
2025-10-10T14:31:37.004475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600698326145371:3418]
2025-10-10T14:31:37.004482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600698326145371:3418]
2025-10-10T14:31:37.004483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600698326145371:3418]
2025-10-10T14:31:37.004492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:37.004500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:37.004505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:37.004510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:37.004512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:37.004522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:37.004525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:37.004550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600698326145371:3418]
2025-10-10T14:31:37.004562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:37.004574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:37.006893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600699108354963:3895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:37.006904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600699108354963:3895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:37.006906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600699108354963:3895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:37.006912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:37.007104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322296:3895], now have 1 active actors on pipe
2025-10-10T14:31:37.007139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 242
2025-10-10T14:31:37.007211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.007221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.007250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:37.007262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.007266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.007268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:37.007279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.007294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:37.007311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.007459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.007467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.007480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.007570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 243 partition: 0 MaxSeqNo: 40 sessionId: src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0
2025-10-10T14:31:37.007838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20abea89-8738c0be-74167d3-ba219842_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:37.010416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0] Write session: try to update token
2025-10-10T14:31:37.010432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:37.015693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:37.015710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.015727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600698326145371:3418]
2025-10-10T14:31:37.015769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:37.015774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:37.015949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:37.016093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.016231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.016369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.016554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:37.016594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:37.027313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId: src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:37.030099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:37.030352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.030379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.030422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:37.030537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:37.032932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:37.032950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.032953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:37.032956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:37.032970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600698326145371:3418]
2025-10-10T14:31:37.032974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600698326145371:3418]
2025-10-10T14:31:37.032977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600698326145371:3418]
2025-10-10T14:31:37.033025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:37.033037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.033036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:37.033044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:37.033044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:37.033048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:37.033189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:37.092288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600703403322312:3658]
2025-10-10T14:31:37.092610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 242, pipe: [1:7559600703403322312:3658]
2025-10-10T14:31:37.137630Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:37.144192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.144215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.144366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.144427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.144500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.144563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.144607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.144614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.144675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.144731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.144788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.144849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.144890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.144897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.144958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.145008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.145062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.145120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.145168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.145180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.145248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.145303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.145375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.145440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.145489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.145496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.145566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.145627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.145693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.145757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.145807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.145814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.145879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.145938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.146006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.146077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.146121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.146134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.146203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.146263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.146336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.146399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.146444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.146453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.146518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.146580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.146647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.146712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.146753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.146761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.146822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.146882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.146940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.147002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.147046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.147054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.147120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.147182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.147244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.147308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.147353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.147361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.147409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322312:3658], now have 1 active actors on pipe
2025-10-10T14:31:37.147674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:37.147687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600703403322312:3658]
2025-10-10T14:31:37.147731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:37.147741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:37.147770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 243 reason: error at write: Disconnected sessionId: src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0
2025-10-10T14:31:37.147998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 243 sessionId: src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0 is DEAD
2025-10-10T14:31:37.148135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:37.148151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0] Write session will restart in 0.005984s
2025-10-10T14:31:37.148177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0] Write session: Do CDS request
2025-10-10T14:31:37.148183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:37.148307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:37.155985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.156112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:37.156130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 244
2025-10-10T14:31:37.156324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.156373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:37.156384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:37.156387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:37.156769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:37.156825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 244 sessionId:  describe result for acl check
2025-10-10T14:31:37.156869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:37.156876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:37.156878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:37.156884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600703403322346:3900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:37.157399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600703403322346:3900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:37.158083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:37.158297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:37.158307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:37.158319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:37.158377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:37.158418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600702621112756:3421]
2025-10-10T14:31:37.159003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:37.159096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600703403322346:3900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:37.159312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:37.159356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:37.159684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:37.159736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.159742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.159743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.159744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.159746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.159747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.159748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.159750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.159751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.159752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.159754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.159755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.159756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.159761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.159775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.159780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.159784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.159789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.159793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.159797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.159802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.159806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.159812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.159824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.159828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.159832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.159843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.159856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.159867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.159876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.159883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.159892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.159901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.159910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.159920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.159929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.159938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.159944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.159953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.159962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.159970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.159975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.159983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.159988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.159992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.159998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.160002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.160007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.160010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.160019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.160023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.160031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.160068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:37.162276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600703403322346:3900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:37.162300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600703403322346:3900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:37.162304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600703403322346:3900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:37.162312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:37.162336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:37.162646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:37.162659Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:37.162661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:37.162664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:37.162670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 243 [2:7559600702621112756:3421]
2025-10-10T14:31:37.162681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:37.162703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:37.162706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.162710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.162712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.162728Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:37.162739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:37.162752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:37.162809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.162817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.162819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.162821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:37.162888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:37.162894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.162904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.162917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.162940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:37.162964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322314:2438], now have 1 active actors on pipe
2025-10-10T14:31:37.162972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322381:3900], now have 1 active actors on pipe
2025-10-10T14:31:37.162979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600702621112751:3421]
2025-10-10T14:31:37.162987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600702621112751:3421]
2025-10-10T14:31:37.162989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600702621112751:3421]
2025-10-10T14:31:37.162989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 243
2025-10-10T14:31:37.163003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:37.163006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 243
2025-10-10T14:31:37.163020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:37.163025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:37.163029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:37.163031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:37.163040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:37.163043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:37.163081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.163090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.163104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600702621112751:3421]
2025-10-10T14:31:37.163115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:37.163128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:37.163148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:37.163159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.163164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.163170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:37.163181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.163194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:37.163216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.163340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.163348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.163364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.163432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 244 partition: 0 MaxSeqNo: 40 sessionId: src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0
2025-10-10T14:31:37.163920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370eaebf-b9ea72f3-3442aa2a-6742cbe5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:37.166375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0] Write session: try to update token
2025-10-10T14:31:37.166389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:37.181347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId: src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:37.181726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:37.181749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.181752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:37.181757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:37.181768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600702621112751:3421]
2025-10-10T14:31:37.181772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600702621112751:3421]
2025-10-10T14:31:37.181776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600702621112751:3421]
2025-10-10T14:31:37.181824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:37.181838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.181840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:37.181842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:37.181849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:37.181853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:37.181979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:37.183987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:37.247958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600703403322389:3658]
2025-10-10T14:31:37.248197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 243, pipe: [1:7559600703403322389:3658]
2025-10-10T14:31:37.299362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:37.299629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.299645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.299690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322389:3658], now have 1 active actors on pipe
2025-10-10T14:31:37.299900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:37.299928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600703403322389:3658]
2025-10-10T14:31:37.299929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:37.299959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:37.299961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:37.300035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 244 reason: error at write: Disconnected sessionId: src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0
2025-10-10T14:31:37.300227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 244 sessionId: src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0 is DEAD
2025-10-10T14:31:37.300383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:37.300394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0] Write session will restart in 0.009408s
2025-10-10T14:31:37.300419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0] Write session: Do CDS request
2025-10-10T14:31:37.300440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:37.306441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:37.308345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:37.308531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:37.308543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:37.308554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:37.308611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:37.308651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600702621112829:3423]
2025-10-10T14:31:37.309291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:37.309612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:37.309657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:37.309965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:37.310022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.310027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.310031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.310032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.310033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.310034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.310036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.310037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.310038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.310039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.310040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.310041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.310042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.310047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.310059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.310063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.310066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.310070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.310073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.310077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.310080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.310089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.310092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.310101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.310104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.310109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.310117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.310130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.310137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.310147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.310155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.310165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.310174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.310182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.310193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.310199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.310207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.310213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.310219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.310224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.310228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.310234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.310242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.310248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.310252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.310258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.310266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.310276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.310296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.310305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.310314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.310323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.310366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:37.310855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.310928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:37.310953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 245
2025-10-10T14:31:37.311095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.311129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:37.311137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:37.311141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:37.311495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 245 sessionId:  describe result for acl check
2025-10-10T14:31:37.311523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:37.311528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:37.311530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:37.311535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600703403322430:3904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:37.311942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600703403322430:3904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:37.312658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:37.312966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:37.312980Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:37.312982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:37.312985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:37.312991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 244 [2:7559600702621112829:3423]
2025-10-10T14:31:37.313004Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:37.313021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:37.313023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.313026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.313028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.313045Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:37.313057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:37.313065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:37.313114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.313120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.313122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.313124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:37.313188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:37.313196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.313207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.313218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.313240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:37.313256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 244
2025-10-10T14:31:37.313264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322391:2438], now have 1 active actors on pipe
2025-10-10T14:31:37.313276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600702621112824:3423]
2025-10-10T14:31:37.313279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600702621112824:3423]
2025-10-10T14:31:37.313281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600702621112824:3423]
2025-10-10T14:31:37.313289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:37.313303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:37.313306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:37.313308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:37.313310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:37.313320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:37.313323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:37.313364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600702621112824:3423]
2025-10-10T14:31:37.313376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:37.313380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:37.313707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600703403322430:3904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:37.319552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600703403322430:3904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:37.319563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600703403322430:3904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:37.319567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600703403322430:3904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:37.319573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:37.319773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322463:3904], now have 1 active actors on pipe
2025-10-10T14:31:37.319817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 244
2025-10-10T14:31:37.319869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.319884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.319915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:37.319930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.319937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.319940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:37.319952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.319971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:37.319990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.320139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.320148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.320163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.320267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 245 partition: 0 MaxSeqNo: 40 sessionId: src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0
2025-10-10T14:31:37.320536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ef94560-617455b9-cafe5fdf-fa4d7d07_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:37.322977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0] Write session: try to update token
2025-10-10T14:31:37.322991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:37.332561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:37.332580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.332583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:37.332585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:37.332595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600702621112824:3423]
2025-10-10T14:31:37.332600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600702621112824:3423]
2025-10-10T14:31:37.332605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600702621112824:3423]
2025-10-10T14:31:37.332642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:37.332647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:37.332650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:37.332649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:37.332657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.332661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:37.332797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:37.336552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId: src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:37.338951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:37.399997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600703403322466:3658]
2025-10-10T14:31:37.400235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 244, pipe: [1:7559600703403322466:3658]
2025-10-10T14:31:37.452226Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:37.452493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.452507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.452552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322466:3658], now have 1 active actors on pipe
2025-10-10T14:31:37.452760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:37.452763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600703403322466:3658]
2025-10-10T14:31:37.452770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:37.452775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:37.452804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:37.452857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 245 reason: error at write: Disconnected sessionId: src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0
2025-10-10T14:31:37.453076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 245 sessionId: src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0 is DEAD
2025-10-10T14:31:37.453222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:37.453234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0] Write session will restart in 0.005889s
2025-10-10T14:31:37.453260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0] Write session: Do CDS request
2025-10-10T14:31:37.453268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:37.459368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:37.460592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:37.460761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:37.460774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:37.460786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:37.460841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:37.460879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600702621112903:3425]
2025-10-10T14:31:37.460890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.460913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:37.460923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 246
2025-10-10T14:31:37.461117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.461140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:37.461147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:37.461150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:37.461480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 246 sessionId:  describe result for acl check
2025-10-10T14:31:37.461489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:37.461511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:37.461516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:37.461519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:37.461525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600703403322503:3908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:37.461713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:37.461754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:37.461935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600703403322503:3908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:37.462057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:37.462114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.462120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.462121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.462122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.462123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.462124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.462125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.462126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.462127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.462129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.462130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.462131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.462132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.462138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.462149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.462153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.462157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.462162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.462166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.462170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.462174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.462178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.462184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.462188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.462192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.462197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.462203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.462211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.462222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.462228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.462232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.462240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.462249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.462254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.462260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.462265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.462274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.462295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.462306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.462316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.462324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.462330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.462340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.462345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.462353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.462358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.462367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.462372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.462381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.462390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.462399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.462404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.462445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:37.463838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600703403322503:3908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:37.464627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:37.464940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:37.464951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:37.464956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:37.464959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:37.464964Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 245 [2:7559600702621112903:3425]
2025-10-10T14:31:37.464976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:37.464992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:37.465000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.465003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.465006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.465021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:37.465028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:37.465035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:37.465084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.465092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.465094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.465096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:37.465155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:37.465163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.465174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.465191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.465214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:37.465220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 245
2025-10-10T14:31:37.465239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322467:2438], now have 1 active actors on pipe
2025-10-10T14:31:37.465252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600702621112898:3425]
2025-10-10T14:31:37.465254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600702621112898:3425]
2025-10-10T14:31:37.465257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600702621112898:3425]
2025-10-10T14:31:37.465269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:37.465278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:37.465281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:37.465284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:37.465285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:37.465299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:37.465302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:37.465326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600702621112898:3425]
2025-10-10T14:31:37.465354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:37.465358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:37.469401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600703403322503:3908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:37.469413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600703403322503:3908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:37.469417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600703403322503:3908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:37.469425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:37.469636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322541:3908], now have 1 active actors on pipe
2025-10-10T14:31:37.469678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 245
2025-10-10T14:31:37.469738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.469748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.469779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4bea82-9b97432c-d90d0211-33142983_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:37.469797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.469802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.469805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:37.469816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.469830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:37.469847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.470000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.470009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.470023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.470084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 246 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4bea82-9b97432c-d90d0211-33142983_0
2025-10-10T14:31:37.470428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10434f17-c2b63c1b-dab0f603-8b06266e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4bea82-9b97432c-d90d0211-33142983_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:37.473111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4bea82-9b97432c-d90d0211-33142983_0] Write session: try to update token
2025-10-10T14:31:37.473127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4bea82-9b97432c-d90d0211-33142983_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:37.476072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:37.476094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.476107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600702621112898:3425]
2025-10-10T14:31:37.476139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:37.476150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:37.476368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:37.476516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.476652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.476788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.476976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:37.477016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:37.486881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId: src_id|c4bea82-9b97432c-d90d0211-33142983_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:37.489230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:37.489434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.489456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.489499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:37.489570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:37.493392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:37.493407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.493410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:37.493412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:37.493425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600702621112898:3425]
2025-10-10T14:31:37.493429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600702621112898:3425]
2025-10-10T14:31:37.493433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600702621112898:3425]
2025-10-10T14:31:37.493473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:37.493478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:37.493486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.493486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:37.493488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:37.493490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:37.493640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:37.553087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600703403322564:3658]
2025-10-10T14:31:37.553290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 245, pipe: [1:7559600703403322564:3658]
2025-10-10T14:31:37.601226Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:37.607749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.607772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.607923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.607979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.608037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.608094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.608136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.608144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.608202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.608256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.608310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.608370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.608409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.608415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.608476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.608529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.608587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.608645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.608684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.608689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.608761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.608814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.608874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.608931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.608971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.608977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.609034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.609085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.609141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.609196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.609235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.609240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.609296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.609367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.609423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.609478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.609523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.609531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.609599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.609655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.609712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.609771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.609811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.609816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.609873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.609924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.609981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.610036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.610074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.610080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.610135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.610192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.610244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.610313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.610369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.610374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.610431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:37.610482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:37.610538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:37.610592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:37.610645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:37.610650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:37.610690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322564:3658], now have 1 active actors on pipe
2025-10-10T14:31:37.610913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:37.610924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:37.610928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:37.610958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 246 reason: error at write: Disconnected sessionId: src_id|c4bea82-9b97432c-d90d0211-33142983_0
2025-10-10T14:31:37.610971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600703403322564:3658]
2025-10-10T14:31:37.611161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 246 sessionId: src_id|c4bea82-9b97432c-d90d0211-33142983_0 is DEAD
2025-10-10T14:31:37.611278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4bea82-9b97432c-d90d0211-33142983_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:37.611285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4bea82-9b97432c-d90d0211-33142983_0] Write session will restart in 0.005397s
2025-10-10T14:31:37.611308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4bea82-9b97432c-d90d0211-33142983_0] Write session: Do CDS request
2025-10-10T14:31:37.611313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4bea82-9b97432c-d90d0211-33142983_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:37.611411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:37.617498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:37.617794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4bea82-9b97432c-d90d0211-33142983_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.618236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:37.618247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 247
2025-10-10T14:31:37.618365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.618397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:37.618406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:37.618411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:37.618951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 247 sessionId:  describe result for acl check
2025-10-10T14:31:37.618982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:37.618989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:37.618991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:37.618998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600703403322615:3923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:37.619000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:37.619196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:37.619208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:37.619220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:37.619279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:37.619319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600702621113017:3441]
2025-10-10T14:31:37.619527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600703403322615:3923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:37.619910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:37.620174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:37.620210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:37.620455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:37.620501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.620506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.620508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.620509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.620509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.620510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.620512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.620512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.620513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.620514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.620517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.620519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.620519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.620524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.620535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.620539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.620542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.620546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.620549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.620552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.620557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.620561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.620565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.620569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.620573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.620577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.620583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.620590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.620595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.620600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.620602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.620605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.620608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.620611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.620615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.620618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.620620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.620623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.620626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.620629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.620631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.620635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.620638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.620641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.620643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.620646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.620650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.620653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.620655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.620658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.620661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.620664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.620685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:37.621523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600703403322615:3923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:37.622801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:37.623115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:37.623125Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:37.623128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:37.623131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:37.623137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 246 [2:7559600702621113017:3441]
2025-10-10T14:31:37.623148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:37.623163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:37.623170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.623174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.623176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.623191Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:37.623201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:37.623208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:37.623255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.623261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.623262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.623264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:37.623323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:37.623330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.623341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.623355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.623377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:37.623393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 246
2025-10-10T14:31:37.623399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322579:2438], now have 1 active actors on pipe
2025-10-10T14:31:37.623410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600702621113012:3441]
2025-10-10T14:31:37.623413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600702621113012:3441]
2025-10-10T14:31:37.623415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600702621113012:3441]
2025-10-10T14:31:37.623424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:37.623435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:37.623436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:37.623444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:37.623447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:37.623452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:37.623454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:37.623478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600702621113012:3441]
2025-10-10T14:31:37.623490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:37.623504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:37.623862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600703403322615:3923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:37.623874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600703403322615:3923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:37.623877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600703403322615:3923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:37.623884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:37.624068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322651:3923], now have 1 active actors on pipe
2025-10-10T14:31:37.624114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 246
2025-10-10T14:31:37.624176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.624187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.624215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:37.624228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.624232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.624234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:37.624245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.624261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:37.624279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.624419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.624428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.624444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.624524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 247 partition: 0 MaxSeqNo: 40 sessionId: src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0
2025-10-10T14:31:37.624783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4bea82-9b97432c-d90d0211-33142983_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:37.627367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0] Write session: try to update token
2025-10-10T14:31:37.627385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:37.640397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId: src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:37.641184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:37.641204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.641207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:37.641209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:37.641219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600702621113012:3441]
2025-10-10T14:31:37.641223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600702621113012:3441]
2025-10-10T14:31:37.641227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600702621113012:3441]
2025-10-10T14:31:37.641273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:37.641276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:37.641282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:37.641284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.641285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:37.641287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:37.641457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:37.642885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:37.711475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600703403322657:3658]
2025-10-10T14:31:37.711841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 246, pipe: [1:7559600703403322657:3658]
2025-10-10T14:31:37.758343Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:37.758613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.758629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.758675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322657:3658], now have 1 active actors on pipe
2025-10-10T14:31:37.758899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:37.758909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:37.758924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600703403322657:3658]
2025-10-10T14:31:37.758957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:37.759031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 247 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0
2025-10-10T14:31:37.759240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 247 sessionId: src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0 is DEAD
2025-10-10T14:31:37.759372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:37.759381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0] Write session will restart in 0.007959s
2025-10-10T14:31:37.759406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0] Write session: Do CDS request
2025-10-10T14:31:37.759411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:37.765923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:37.767316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:37.767488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:37.767499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:37.767510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:37.767557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:37.767598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600702621113092:3443]
2025-10-10T14:31:37.768072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:37.768295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:37.768329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:37.768575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:37.768630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.768636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.768637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.768638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.768639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.768640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.768641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.768642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.768643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.768645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.768646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.768647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.768648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.768653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.768666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.768671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.768675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.768679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.768683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.768687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.768691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.768695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.768699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.768703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.768707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.768711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.768719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.768727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.768733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.768739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.768743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.768748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.768752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.768757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.768761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.768771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.768775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.768780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.768785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.768790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.768797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.768802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.768807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.768813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.768822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.768827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.768832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.768836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.768844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.768850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.768853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.768856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.768884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.768879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:37.768967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:37.768979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 248
2025-10-10T14:31:37.769087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.769116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:37.769126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:37.769130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:37.769523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 248 sessionId:  describe result for acl check
2025-10-10T14:31:37.769554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:37.769557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:37.769559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:37.769565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600703403322699:3927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:37.770084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600703403322699:3927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:37.771038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:37.771344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:37.771355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:37.771358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:37.771361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:37.771366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 247 [2:7559600702621113092:3443]
2025-10-10T14:31:37.771377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:37.771396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:37.771404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.771407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.771409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.771425Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:37.771437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:37.771448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:37.771501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.771507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.771509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.771511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:37.771569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:37.771575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.771586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.771602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.771623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:37.771646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322658:2438], now have 1 active actors on pipe
2025-10-10T14:31:37.771632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 247
2025-10-10T14:31:37.771658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600702621113087:3443]
2025-10-10T14:31:37.771664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600702621113087:3443]
2025-10-10T14:31:37.771666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600702621113087:3443]
2025-10-10T14:31:37.771675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:37.771681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:37.771683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:37.771684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:37.771687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:37.771703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:37.771711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:37.771735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600702621113087:3443]
2025-10-10T14:31:37.771747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:37.771750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:37.772045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600703403322699:3927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:37.777719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600703403322699:3927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:37.777729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600703403322699:3927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:37.777731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600703403322699:3927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:37.777737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:37.777949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322733:3927], now have 1 active actors on pipe
2025-10-10T14:31:37.778007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 247
2025-10-10T14:31:37.778104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.778116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.778147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:37.778161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.778172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.778174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:37.778186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.778200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:37.778219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.778425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.778435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.778450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.778563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 248 partition: 0 MaxSeqNo: 40 sessionId: src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0
2025-10-10T14:31:37.778846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d7ce26-1b0e8a56-eb387ba1-1aa85325_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:37.781398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0] Write session: try to update token
2025-10-10T14:31:37.781413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:37.789674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:37.789689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.789693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:37.789695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:37.789704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600702621113087:3443]
2025-10-10T14:31:37.789708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600702621113087:3443]
2025-10-10T14:31:37.789712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600702621113087:3443]
2025-10-10T14:31:37.789757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:37.789760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:37.789768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.789771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:37.789774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:37.789779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:37.789901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:37.794551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId: src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:37.797041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:37.859267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600703403322737:3658]
2025-10-10T14:31:37.859483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 247, pipe: [1:7559600703403322737:3658]
2025-10-10T14:31:37.894213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:37.894435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.894449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.894484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322737:3658], now have 1 active actors on pipe
2025-10-10T14:31:37.894713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:37.894784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:37.894795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600703403322737:3658]
2025-10-10T14:31:37.894814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:37.894856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 248 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0
2025-10-10T14:31:37.895003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 248 sessionId: src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0 is DEAD
2025-10-10T14:31:37.895144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:37.895162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0] Write session will restart in 0.007053s
2025-10-10T14:31:37.895187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0] Write session: Do CDS request
2025-10-10T14:31:37.895193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:37.902695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:37.903849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.903936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:37.903961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 249
2025-10-10T14:31:37.904028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:37.904105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:37.904153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:37.904163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:37.904171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:37.904222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:37.904232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:37.904244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:37.904294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:37.904335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600702621113169:3445]
2025-10-10T14:31:37.904589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 249 sessionId:  describe result for acl check
2025-10-10T14:31:37.904620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:37.904626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:37.904628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:37.904634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600703403322776:3931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:37.904928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:37.905161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600703403322776:3931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:37.905240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:37.905289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:37.905610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:37.905673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.905679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.905680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.905681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.905682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.905683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.905684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.905686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.905687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.905688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.905689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.905692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.905693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.905698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.905711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.905715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.905719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.905722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.905726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.905730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.905733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.905737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.905740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.905744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.905747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.905751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.905758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.905765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:37.905772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.905778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:37.905784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.905789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:37.905793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.905798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:37.905812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.905817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:37.905820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.905827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:37.905831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.905835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:37.905839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.905843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:37.905848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.905853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:37.905856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.905861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:37.905865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.905869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.905873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.905877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.905881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.905891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.905929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:37.907271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600703403322776:3931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:37.908275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:37.908599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:37.908609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:37.908612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:37.908618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:37.908623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 248 [2:7559600702621113169:3445]
2025-10-10T14:31:37.908634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:37.908655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:37.908662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.908665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.908668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.908684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:37.908696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:37.908709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:37.908765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.908772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.908774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.908777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:37.908843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:37.908851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.908862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:37.908877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:37.908915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:37.908942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322738:2438], now have 1 active actors on pipe
2025-10-10T14:31:37.908955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600702621113164:3445]
2025-10-10T14:31:37.908961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600702621113164:3445]
2025-10-10T14:31:37.908963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600702621113164:3445]
2025-10-10T14:31:37.908955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 248
2025-10-10T14:31:37.908979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:37.908990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:37.908992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:37.908994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:37.908997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:37.909016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:37.909020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:37.909047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600702621113164:3445]
2025-10-10T14:31:37.909059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:37.909072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:37.913838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600703403322776:3931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:37.913848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600703403322776:3931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:37.913852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600703403322776:3931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:37.913860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:37.914100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322814:3931], now have 1 active actors on pipe
2025-10-10T14:31:37.914154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 248
2025-10-10T14:31:37.914204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.914214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.914238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:37.914251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:37.914257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:37.914259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:37.914269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:37.914284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:37.914310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.914482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.914496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.914524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:37.914596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 249 partition: 0 MaxSeqNo: 40 sessionId: src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0
2025-10-10T14:31:37.914889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2dfd708-ffa18204-ff0a8a10-4cf38464_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:37.917687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0] Write session: try to update token
2025-10-10T14:31:37.917710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:37.925760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:37.925771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.925782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600702621113164:3445]
2025-10-10T14:31:37.925830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:37.925835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:37.926000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:37.926133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.926266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.926401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:37.926594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:37.926627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:37.932087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId: src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:37.934599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:37.934814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:37.934834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:37.934875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:37.934965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:37.937951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:37.937965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:37.937968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:37.937970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:37.937980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600702621113164:3445]
2025-10-10T14:31:37.937985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600702621113164:3445]
2025-10-10T14:31:37.937988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600702621113164:3445]
2025-10-10T14:31:37.938032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:37.938042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:37.938046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:37.938050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:37.938050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:37.938054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:37.938178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:37.994964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600703403322818:3658]
2025-10-10T14:31:37.995299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 248, pipe: [1:7559600703403322818:3658]
2025-10-10T14:31:38.050240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:38.057343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.057367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.057523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.057589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.057663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.057743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.057974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.057986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.058057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.058118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.058182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.058246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.058302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.058310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.058382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.058444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.058503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.058565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.058609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.058617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.058681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.058762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.058839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.058907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.058956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.058963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.059032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.059104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.059168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.059230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.059273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.059280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.059355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.059423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.059488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.059584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.059627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.059630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.059697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.059755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.059825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.059891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.059937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.059944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.060010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.060069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.060136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.060199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.060242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.060248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.060313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.060370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.060430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.060490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.060537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.060546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.060612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.060669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.060733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.060794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.060836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.060846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.060902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600703403322818:3658], now have 1 active actors on pipe
2025-10-10T14:31:38.061162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:38.061171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:38.061174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:38.061203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600703403322818:3658]
2025-10-10T14:31:38.061205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 249 reason: error at write: Disconnected sessionId: src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0
2025-10-10T14:31:38.061443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 249 sessionId: src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0 is DEAD
2025-10-10T14:31:38.061564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:38.061574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0] Write session will restart in 0.008700s
2025-10-10T14:31:38.061600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0] Write session: Do CDS request
2025-10-10T14:31:38.061606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:38.061763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:38.068703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:38.070131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:38.070337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:38.070347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:38.070360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:38.070410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:38.070450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600706916080542:3447]
2025-10-10T14:31:38.071052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:38.071311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:38.071355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:38.071663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:38.071714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.071720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.071721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.071722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.071723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.071725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.071726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.071727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.071728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.071729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.071730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.071731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.071732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.071738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.071751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.071755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.071759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.071763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.071767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.071771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.071775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.071779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.071783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.071787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.071791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.071795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.071802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.071810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.071817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.071822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.071826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.071842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.071847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.071853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.071857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.071862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.071866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.071871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.071887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.071897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.071900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.071904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.071908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.071915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.071918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.071919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.071928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.071932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.071937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.071941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.071946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.071954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.071960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.071957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:38.071969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 250
2025-10-10T14:31:38.071999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:38.072154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.072184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:38.072193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:38.072197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:38.072587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 250 sessionId:  describe result for acl check
2025-10-10T14:31:38.072619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:38.072625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:38.072626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:38.072632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600707698290158:3935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:38.073165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600707698290158:3935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:38.074354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:38.074654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:38.074666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:38.074668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:38.074671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:38.074677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 249 [2:7559600706916080542:3447]
2025-10-10T14:31:38.074687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:38.074703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:38.074706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.074709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.074714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.074729Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:38.074741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:38.074752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:38.074798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.074806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.074807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.074810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:38.074870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:38.074877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.074887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.074898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.074915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:38.074938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290115:2438], now have 1 active actors on pipe
2025-10-10T14:31:38.074949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600706916080537:3447]
2025-10-10T14:31:38.074951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600706916080537:3447]
2025-10-10T14:31:38.074953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600706916080537:3447]
2025-10-10T14:31:38.074966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:38.074964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 249
2025-10-10T14:31:38.074984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:38.074987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:38.074991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:38.074992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:38.075005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:38.075008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:38.075034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600706916080537:3447]
2025-10-10T14:31:38.075044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:38.075051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:38.075578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600707698290158:3935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:38.081144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600707698290158:3935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:38.081157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600707698290158:3935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:38.081161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600707698290158:3935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:38.081168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:38.081485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290196:3935], now have 1 active actors on pipe
2025-10-10T14:31:38.081550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 249
2025-10-10T14:31:38.081641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.081655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.081685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:38.081701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.081706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.081709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:38.081723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.081745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:38.081767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.081984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.081994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.082017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.082090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 250 partition: 0 MaxSeqNo: 40 sessionId: src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0
2025-10-10T14:31:38.082452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f39518c0-85bd3be8-1036793b-65c2eefb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:38.085006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0] Write session: try to update token
2025-10-10T14:31:38.085026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:38.093356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:38.093371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.093374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:38.093376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:38.093386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600706916080537:3447]
2025-10-10T14:31:38.093390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600706916080537:3447]
2025-10-10T14:31:38.093394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600706916080537:3447]
2025-10-10T14:31:38.093439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:38.093441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:38.093447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:38.093451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.093451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:38.093454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:38.093583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:38.099760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId: src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:38.102330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:38.161386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600707698290209:3658]
2025-10-10T14:31:38.161659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 249, pipe: [1:7559600707698290209:3658]
2025-10-10T14:31:38.201403Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:38.201731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.201746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.201771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290209:3658], now have 1 active actors on pipe
2025-10-10T14:31:38.202003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:38.202016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:38.202022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:38.202073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600707698290209:3658]
2025-10-10T14:31:38.202083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 250 reason: error at write: Disconnected sessionId: src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0
2025-10-10T14:31:38.202356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 250 sessionId: src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0 is DEAD
2025-10-10T14:31:38.202487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:38.202499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0] Write session will restart in 0.005357s
2025-10-10T14:31:38.202525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0] Write session: Do CDS request
2025-10-10T14:31:38.202532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:38.203318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:38.208913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.209025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:38.209038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 251
2025-10-10T14:31:38.209161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.209209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:38.209220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:38.209224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:38.209646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 251 sessionId:  describe result for acl check
2025-10-10T14:31:38.209682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:38.209688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:38.209690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:38.209695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600707698290249:3940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:38.209829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:38.210224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600707698290249:3940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:38.211088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:38.211260Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:38.211272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:38.211283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:38.211331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:38.211383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600706916080632:3450]
2025-10-10T14:31:38.212003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:38.212242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:38.212281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:38.212332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600707698290249:3940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:38.212596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:38.212663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.212669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.212670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.212671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.212672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.212673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.212674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.212676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.212677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.212678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.212679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.212681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.212682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.212689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.212702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.212706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.212711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.212715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.212720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.212724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.212728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.212732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.212737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.212741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.212745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.212749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.212755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.212768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.212774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.212780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.212784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.212790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.212796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.212805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.212810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.212815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.212823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.212827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.212831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.212848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.212859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.212864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.212868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.212874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.212878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.212882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.212887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.212892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.212897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.212903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.212907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.212913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.212952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:38.215233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:38.215294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600707698290249:3940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:38.215308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600707698290249:3940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:38.215312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600707698290249:3940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:38.215321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:38.215535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:38.215546Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:38.215548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:38.215551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:38.215556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 250 [2:7559600706916080632:3450]
2025-10-10T14:31:38.215565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:38.215580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:38.215582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.215588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.215590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.215609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:38.215616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:38.215639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:38.215694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.215701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.215703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.215706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:38.215804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:38.215825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.215840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.215856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.215880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:38.215907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290284:3940], now have 1 active actors on pipe
2025-10-10T14:31:38.215916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290210:2438], now have 1 active actors on pipe
2025-10-10T14:31:38.215923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600706916080627:3450]
2025-10-10T14:31:38.215925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600706916080627:3450]
2025-10-10T14:31:38.215906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 250
2025-10-10T14:31:38.215927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600706916080627:3450]
2025-10-10T14:31:38.215942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:38.215911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 250
2025-10-10T14:31:38.215958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:38.215972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:38.215976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:38.215978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:38.215979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:38.215982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:38.216018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.216027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.216041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600706916080627:3450]
2025-10-10T14:31:38.216052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:38.216057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:38.216081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:38.216094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.216098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.216100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:38.216111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.216126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:38.216153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.216299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.216306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.216319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.216420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 251 partition: 0 MaxSeqNo: 40 sessionId: src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0
2025-10-10T14:31:38.216795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a23ace-cb699fd5-a57da2ef-21c656f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:38.219489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0] Write session: try to update token
2025-10-10T14:31:38.219513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:38.234124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId: src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:38.235298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:38.235316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.235318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:38.235320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:38.235330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600706916080627:3450]
2025-10-10T14:31:38.235334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600706916080627:3450]
2025-10-10T14:31:38.235336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600706916080627:3450]
2025-10-10T14:31:38.235380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:38.235386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.235387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:38.235474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:38.235490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:38.235496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:38.235510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:38.236750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:38.302149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600707698290292:3658]
2025-10-10T14:31:38.302376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 250, pipe: [1:7559600707698290292:3658]
2025-10-10T14:31:38.336229Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:38.336508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.336521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.336558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290292:3658], now have 1 active actors on pipe
2025-10-10T14:31:38.336742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:38.336777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:38.336788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:38.336790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:38.336836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600707698290292:3658]
2025-10-10T14:31:38.336923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 251 reason: error at write: Disconnected sessionId: src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0
2025-10-10T14:31:38.337126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 251 sessionId: src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0 is DEAD
2025-10-10T14:31:38.337276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:38.337288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0] Write session will restart in 0.006130s
2025-10-10T14:31:38.337314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0] Write session: Do CDS request
2025-10-10T14:31:38.337323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:38.343415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:38.344585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:38.344761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:38.344775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:38.344786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:38.344821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.344844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:38.344887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600706916080711:3452]
2025-10-10T14:31:38.344890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:38.344898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 252
2025-10-10T14:31:38.345017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.345047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:38.345054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:38.345057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:38.345372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:38.345402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 252 sessionId:  describe result for acl check
2025-10-10T14:31:38.345433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:38.345436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:38.345438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:38.345443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600707698290334:3944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:38.345661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:38.345708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:38.345967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600707698290334:3944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:38.345996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:38.346057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.346062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.346063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.346064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.346065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.346066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.346067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.346068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.346069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.346070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.346071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.346072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.346073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.346077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.346088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.346091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.346095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.346098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.346101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.346105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.346108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.346111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.346115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.346118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.346122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.346125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.346132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.346141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.346151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.346161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.346169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.346179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.346182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.346187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.346191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.346200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.346209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.346214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.346219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.346224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.346228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.346233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.346237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.346242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.346246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.346250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.346254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.346259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.346263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.346268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.346271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.346276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.346324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:38.347929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600707698290334:3944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:38.348413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:38.348699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:38.348710Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:38.348715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:38.348718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:38.348724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 251 [2:7559600706916080711:3452]
2025-10-10T14:31:38.348735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:38.348753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:38.348762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.348766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.348768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.348782Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:38.348793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:38.348798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:38.348836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.348841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.348842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.348844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:38.348889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:38.348896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.348903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.348909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.348918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:38.348934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600706916080706:3452]
2025-10-10T14:31:38.348939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600706916080706:3452]
2025-10-10T14:31:38.348940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600706916080706:3452]
2025-10-10T14:31:38.348946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:38.348956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:38.348958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:38.348961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:38.348963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:38.348975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:38.348978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:38.348988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290293:2438], now have 1 active actors on pipe
2025-10-10T14:31:38.349007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600706916080706:3452]
2025-10-10T14:31:38.349019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:38.349032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:38.349032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 251
2025-10-10T14:31:38.353833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600707698290334:3944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:38.353843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600707698290334:3944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:38.353847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600707698290334:3944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:38.353861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:38.354073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290372:3944], now have 1 active actors on pipe
2025-10-10T14:31:38.354154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 251
2025-10-10T14:31:38.354209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.354221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.354251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:38.354266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.354275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.354277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:38.354290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.354321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:38.354342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.354508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.354514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.354527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.354605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 252 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0
2025-10-10T14:31:38.354962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c13b4752-9ae78ce6-e30964f7-619cb23a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:38.357570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0] Write session: try to update token
2025-10-10T14:31:38.357590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:38.360064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:38.360080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.360091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600706916080706:3452]
2025-10-10T14:31:38.360123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:38.360134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:38.360297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:38.360432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.360566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.360705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.360894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:38.360934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:38.371878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId: src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:38.374450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:38.374648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.374671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.374721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:38.374824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:38.377358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:38.377375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.377379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:38.377381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:38.377392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600706916080706:3452]
2025-10-10T14:31:38.377395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600706916080706:3452]
2025-10-10T14:31:38.377399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600706916080706:3452]
2025-10-10T14:31:38.377449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:38.377450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:38.377456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:38.377460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:38.377461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.377463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:38.377596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:38.436821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600707698290375:3658]
2025-10-10T14:31:38.437097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 251, pipe: [1:7559600707698290375:3658]
2025-10-10T14:31:38.480596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:38.487086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.487108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.487266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.487319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.487376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.487431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.487478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.487486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.487551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.487610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.487665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.487723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.487760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.487766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.487826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.487882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.487937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.487990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.488030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.488038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.488146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.488215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.488285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.488353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.488393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.488399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.488456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.488508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.488560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.488612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.488650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.488656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.488714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.488778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.488839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.488893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.488938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.488945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.489002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.489060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.489118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.489173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.489211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.489216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.489272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.489323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.489401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.489456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.489493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.489498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.489550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.489603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.489661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.489724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.489816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.489822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.489875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.489925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.489977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.490032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.490069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.490074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.490112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290375:3658], now have 1 active actors on pipe
2025-10-10T14:31:38.490349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600707698290375:3658]
2025-10-10T14:31:38.490349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:38.490354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:38.490375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:38.490384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 252 reason: error at write: Disconnected sessionId: src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0
2025-10-10T14:31:38.490601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 252 sessionId: src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0 is DEAD
2025-10-10T14:31:38.490761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:38.490773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0] Write session will restart in 0.009399s
2025-10-10T14:31:38.490805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0] Write session: Do CDS request
2025-10-10T14:31:38.490811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:38.490858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:38.498334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:38.499605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:38.499800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:38.499818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:38.499830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:38.499886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:38.499929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600706916080790:3454]
2025-10-10T14:31:38.500553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:38.500844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:38.500896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:38.501214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:38.501294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.501302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.501303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.501306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.501308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.501309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.501310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.501311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.501312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.501314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.501315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.501317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.501318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.501324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.501359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.501363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.501367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.501371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.501375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.501379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.501383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.501390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.501394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.501397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.501401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.501405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.501414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.501423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.501430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.501436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.501440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.501445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.501453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.501458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.501464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.501474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.501480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.501485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.501490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.501499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.501504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.501509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.501514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.501520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.501527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.501532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.501537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.501542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.501548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.501553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.501558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.501568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.501612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:38.501808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.501857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:38.501870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 253
2025-10-10T14:31:38.502016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.502052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:38.502062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:38.502066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:38.502477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 253 sessionId:  describe result for acl check
2025-10-10T14:31:38.502514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:38.502516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:38.502518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:38.502523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600707698290424:3948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:38.503106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600707698290424:3948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:38.503867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:38.504213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:38.504224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:38.504227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:38.504230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:38.504236Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 252 [2:7559600706916080790:3454]
2025-10-10T14:31:38.504250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:38.504273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:38.504284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.504288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.504290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.504307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:38.504315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:38.504322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:38.504383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.504391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.504393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.504396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:38.504461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:38.504469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.504483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.504500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.504524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:38.504527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 252
2025-10-10T14:31:38.504553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290377:2438], now have 1 active actors on pipe
2025-10-10T14:31:38.504566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600706916080785:3454]
2025-10-10T14:31:38.504573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600706916080785:3454]
2025-10-10T14:31:38.504575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600706916080785:3454]
2025-10-10T14:31:38.504587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:38.504597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:38.504605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:38.504606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:38.504608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:38.504622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:38.504630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:38.504660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600706916080785:3454]
2025-10-10T14:31:38.504674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:38.504689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:38.505543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600707698290424:3948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:38.510984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600707698290424:3948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:38.510998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600707698290424:3948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:38.511002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600707698290424:3948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:38.511010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:38.511285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290457:3948], now have 1 active actors on pipe
2025-10-10T14:31:38.511301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 252
2025-10-10T14:31:38.511335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.511349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.511383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:38.511400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.511410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.511412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:38.511426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.511444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:38.511465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.511679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.511689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.511706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.511802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 253 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0
2025-10-10T14:31:38.512185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8f8c16-7c210a1d-9ace683-eb06dcb0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:38.514810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0] Write session: try to update token
2025-10-10T14:31:38.514828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:38.523354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:38.523376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.523379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:38.523384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:38.523394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600706916080785:3454]
2025-10-10T14:31:38.523398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600706916080785:3454]
2025-10-10T14:31:38.523401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600706916080785:3454]
2025-10-10T14:31:38.523451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:38.523453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:38.523461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:38.523463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.523465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:38.523466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:38.523609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:38.528765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId: src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:38.531245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:38.590372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600707698290480:3658]
2025-10-10T14:31:38.590590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 252, pipe: [1:7559600707698290480:3658]
2025-10-10T14:31:38.637885Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:38.638132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.638144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.638181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290480:3658], now have 1 active actors on pipe
2025-10-10T14:31:38.638374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:38.638370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:38.638381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:38.638405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:38.638442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 253 reason: error at write: Disconnected sessionId: src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0
2025-10-10T14:31:38.638449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600707698290480:3658]
2025-10-10T14:31:38.638614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 253 sessionId: src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0 is DEAD
2025-10-10T14:31:38.638731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:38.638740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0] Write session will restart in 0.009926s
2025-10-10T14:31:38.638768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0] Write session: Do CDS request
2025-10-10T14:31:38.638776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:38.645557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:38.646826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:38.646990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:38.647001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:38.647012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:38.647061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:38.647102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600706916080913:3470]
2025-10-10T14:31:38.647719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:38.647965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:38.648007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:38.648316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:38.648368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.648374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.648375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.648376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.648378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.648379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.648379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.648380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.648381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.648382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.648383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.648387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.648388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.648393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.648407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.648411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.648415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.648419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.648423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.648427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.648431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.648439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.648444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.648452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.648460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.648464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.648475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.648488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.648498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.648507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.648516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.648527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.648535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.648541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.648545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.648550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.648556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.648565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.648573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.648578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.648586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.648591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.648596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.648605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.648609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.648618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.648626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.648635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.648643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.648653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.648661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.648670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.648715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:38.649761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.649906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:38.649916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 254
2025-10-10T14:31:38.650030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.650062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:38.650070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:38.650074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:38.650520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 254 sessionId:  describe result for acl check
2025-10-10T14:31:38.650545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:38.650549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:38.650551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:38.650555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600707698290544:3963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:38.650990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:38.650997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600707698290544:3963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:38.651288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:38.651299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:38.651301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:38.651304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:38.651310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 253 [2:7559600706916080913:3470]
2025-10-10T14:31:38.651320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:38.651340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:38.651347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.651351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.651353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.651368Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:38.651378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:38.651390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:38.651449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.651455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.651458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.651460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:38.651519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:38.651527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.651538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.651555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.651583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 253
2025-10-10T14:31:38.651577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:38.651604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290496:2438], now have 1 active actors on pipe
2025-10-10T14:31:38.651614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600706916080908:3470]
2025-10-10T14:31:38.651617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600706916080908:3470]
2025-10-10T14:31:38.651618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600706916080908:3470]
2025-10-10T14:31:38.651631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:38.651637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:38.651639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:38.651640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:38.651648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:38.651665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:38.651673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:38.651697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600706916080908:3470]
2025-10-10T14:31:38.651709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:38.651716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:38.652830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600707698290544:3963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:38.658106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600707698290544:3963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:38.658119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600707698290544:3963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:38.658123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600707698290544:3963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:38.658131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:38.658393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290576:3963], now have 1 active actors on pipe
2025-10-10T14:31:38.658425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 253
2025-10-10T14:31:38.658495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.658507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.658539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29308572-19f7f624-e7ec4f63-25286f91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:38.658555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.658565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.658569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:38.658583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.658603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:38.658622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.658796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.658805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.658821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.658894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 254 partition: 0 MaxSeqNo: 40 sessionId: src_id|29308572-19f7f624-e7ec4f63-25286f91_0
2025-10-10T14:31:38.659212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3701c5-e87f29ee-a7c9787a-855f61a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29308572-19f7f624-e7ec4f63-25286f91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:38.661687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29308572-19f7f624-e7ec4f63-25286f91_0] Write session: try to update token
2025-10-10T14:31:38.661701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29308572-19f7f624-e7ec4f63-25286f91_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:38.662523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:38.662537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.662546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600706916080908:3470]
2025-10-10T14:31:38.662585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:38.662590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:38.662761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:38.662901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.663035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.663168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.663353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:38.663390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:38.675588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId: src_id|29308572-19f7f624-e7ec4f63-25286f91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:38.677995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:38.678202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.678225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.678289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:38.678380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:38.679950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:38.679963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.679967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:38.679968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:38.679978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600706916080908:3470]
2025-10-10T14:31:38.679983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600706916080908:3470]
2025-10-10T14:31:38.679986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600706916080908:3470]
2025-10-10T14:31:38.680028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:38.680032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:38.680038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:38.680039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.680042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:38.680054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:38.680168Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:38.738365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600707698290580:3658]
2025-10-10T14:31:38.738636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 253, pipe: [1:7559600707698290580:3658]
2025-10-10T14:31:38.784732Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:38.792501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.792527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.792695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.792762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.792824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.792890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.793103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.793114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.793186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.793256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.793318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.793404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.793446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.793453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.793523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.793583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.793649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.793722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.793768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.793776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.793840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.793905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.793968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.794031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.794087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.794094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.794161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.794222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.794286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.794358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.794423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.794430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.794493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.794553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.794617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.794681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.794723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.794731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.794809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.794867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.794934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.794997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.795039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.795049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.795112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.795176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.795242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.795307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.795350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.795357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.795418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.795477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.795534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.795597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.795637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.795642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.795698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.795768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.795829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.795886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.795927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.795933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.795986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290580:3658], now have 1 active actors on pipe
2025-10-10T14:31:38.796169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:38.796195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600707698290580:3658]
2025-10-10T14:31:38.796216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:38.796221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:38.796254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 254 reason: error at write: Disconnected sessionId: src_id|29308572-19f7f624-e7ec4f63-25286f91_0
2025-10-10T14:31:38.796444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 254 sessionId: src_id|29308572-19f7f624-e7ec4f63-25286f91_0 is DEAD
2025-10-10T14:31:38.796615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29308572-19f7f624-e7ec4f63-25286f91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:38.796624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29308572-19f7f624-e7ec4f63-25286f91_0] Write session will restart in 0.006983s
2025-10-10T14:31:38.796650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29308572-19f7f624-e7ec4f63-25286f91_0] Write session: Do CDS request
2025-10-10T14:31:38.796655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29308572-19f7f624-e7ec4f63-25286f91_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:38.796807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:38.804028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:38.804872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29308572-19f7f624-e7ec4f63-25286f91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.804919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:38.804929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 255
2025-10-10T14:31:38.805067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.805093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:38.805100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:38.805103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:38.805376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:38.805429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 255 sessionId:  describe result for acl check
2025-10-10T14:31:38.805454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:38.805455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:38.805456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:38.805460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600707698290626:3967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:38.805555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:38.805567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:38.805579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:38.805650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:38.805699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600706916080996:3472]
2025-10-10T14:31:38.805896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600707698290626:3967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:38.806232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:38.806500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:38.806535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:38.806743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:38.806791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.806796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.806797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.806798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.806798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.806799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.806800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.806800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.806801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.806803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.806804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.806804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.806805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.806809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.806816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.806819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.806821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.806823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.806825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.806827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.806828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.806830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.806832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.806834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.806836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.806838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.806843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.806848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.806853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.806857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.806859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.806862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.806865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.806868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.806871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.806874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.806879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.806884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.806889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.806893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.806898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.806903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.806908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.806913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.806921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.806924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.806927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.806930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.806934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.806937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.806940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.806943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.806965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:38.808036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600707698290626:3967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:38.809083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:38.809406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:38.809414Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:38.809416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:38.809419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:38.809423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 254 [2:7559600706916080996:3472]
2025-10-10T14:31:38.809431Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:38.809444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:38.809450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.809452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.809453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.809466Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:38.809475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:38.809481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:38.809523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.809530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.809531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.809533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:38.809593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:38.809601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.809607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.809614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.809624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:38.809640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290581:2438], now have 1 active actors on pipe
2025-10-10T14:31:38.809651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600706916080991:3472]
2025-10-10T14:31:38.809653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600706916080991:3472]
2025-10-10T14:31:38.809655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600706916080991:3472]
2025-10-10T14:31:38.809665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:38.809674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:38.809687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:38.809691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:38.809696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:38.809700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:38.809702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:38.809679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 254
2025-10-10T14:31:38.809707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600706916080991:3472]
2025-10-10T14:31:38.809709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:38.809711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:38.810113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600707698290626:3967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:38.810123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600707698290626:3967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:38.810125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600707698290626:3967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:38.810138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:38.810280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290662:3967], now have 1 active actors on pipe
2025-10-10T14:31:38.810344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 254
2025-10-10T14:31:38.810390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.810398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.810421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:38.810430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.810437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.810438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:38.810446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.810460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:38.810483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.810644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.810656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.810677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.810772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 255 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0
2025-10-10T14:31:38.811138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29308572-19f7f624-e7ec4f63-25286f91_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:38.813936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0] Write session: try to update token
2025-10-10T14:31:38.813952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:38.826007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:38.826025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.826037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600706916080991:3472]
2025-10-10T14:31:38.826085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:38.826088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:38.826319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:38.826464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.826603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.826739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.827180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:38.827224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:38.828364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId: src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:38.830995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:38.831203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.831227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.831264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:38.831349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:38.839124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:38.839141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.839145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:38.839146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:38.839160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600706916080991:3472]
2025-10-10T14:31:38.839164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600706916080991:3472]
2025-10-10T14:31:38.839168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600706916080991:3472]
2025-10-10T14:31:38.839205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:38.839215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:38.839218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:38.839222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:38.839222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.839225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:38.839375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:38.896572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600707698290667:3658]
2025-10-10T14:31:38.896810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 254, pipe: [1:7559600707698290667:3658]
2025-10-10T14:31:38.942063Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:38.948365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.948390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.948538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.948604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.948660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.948719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.948767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.948778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.948836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.948891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.948945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.949003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.949044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.949049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.949106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.949159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.949218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.949275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.949315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.949320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.949395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.949450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.949505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.949558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.949596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.949601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.949659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.949715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.949767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.949834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.949874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.949879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.949935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.949991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.950047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.950109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.950165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.950172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.950240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.950321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.950395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.950458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.950500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.950503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.950574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.950637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.950698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.950765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.950809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.950812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.950887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.950949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.951023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.951088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.951128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.951131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.951194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:38.951244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:38.951296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:38.951348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:38.951395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:38.951402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:38.951445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290667:3658], now have 1 active actors on pipe
2025-10-10T14:31:38.951649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600707698290667:3658]
2025-10-10T14:31:38.951657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:38.951661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:38.951679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:38.951704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 255 reason: error at write: Disconnected sessionId: src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0
2025-10-10T14:31:38.951924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 255 sessionId: src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0 is DEAD
2025-10-10T14:31:38.952051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:38.952059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0] Write session will restart in 0.008841s
2025-10-10T14:31:38.952079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0] Write session: Do CDS request
2025-10-10T14:31:38.952083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:38.952168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:38.958563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:38.959698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:38.959866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:38.959877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:38.959888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:38.959941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:38.959979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600706916081080:3474]
2025-10-10T14:31:38.960580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:38.960862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:38.960906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:38.961221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:38.961271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.961276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.961277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.961278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.961279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.961280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.961281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.961283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.961284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.961285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.961288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.961289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.961290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.961295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.961308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.961312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.961317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.961320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.961324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.961344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.961348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.961351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.961356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.961360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.961363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.961366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.961374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.961383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:38.961394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.961399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:38.961404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.961409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:38.961418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.961423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:38.961432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.961437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:38.961446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.961455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:38.961462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.961471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:38.961479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.961485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:38.961493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.961500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:38.961511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.961520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:38.961529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.961534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.961543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.961548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.961552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.961557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.961599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:38.961815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.961923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:38.961932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 256
2025-10-10T14:31:38.962054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:38.962095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:38.962104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:38.962110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:38.962516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 256 sessionId:  describe result for acl check
2025-10-10T14:31:38.962549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:38.962554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:38.962556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:38.962562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600707698290720:3971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:38.963106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600707698290720:3971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:38.963800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:38.964117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:38.964129Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:38.964131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:38.964136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:38.964141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 255 [2:7559600706916081080:3474]
2025-10-10T14:31:38.964153Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:38.964169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:38.964177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.964180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.964183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.964198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:38.964205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:38.964216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:38.964272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.964279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.964281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.964283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:38.964340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:38.964347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.964357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:38.964370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:38.964392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:38.964417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290671:2438], now have 1 active actors on pipe
2025-10-10T14:31:38.964430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600706916081075:3474]
2025-10-10T14:31:38.964432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600706916081075:3474]
2025-10-10T14:31:38.964435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600706916081075:3474]
2025-10-10T14:31:38.964417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 255
2025-10-10T14:31:38.964444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:38.964458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:38.964461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:38.964466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:38.964468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:38.964477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:38.964481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:38.964507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600706916081075:3474]
2025-10-10T14:31:38.964519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:38.964531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:38.965084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600707698290720:3971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:38.970824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600707698290720:3971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:38.970839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600707698290720:3971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:38.970842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600707698290720:3971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:38.970850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:38.971077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600707698290752:3971], now have 1 active actors on pipe
2025-10-10T14:31:38.971112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 255
2025-10-10T14:31:38.971183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.971196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.971229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:38.971244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:38.971254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:38.971257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:38.971272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:38.971292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:38.971313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.971499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.971509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.971524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:38.971649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 256 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0
2025-10-10T14:31:38.972008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e19ab57-f6a2b4ce-5adac875-fef8eff4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:38.974690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0] Write session: try to update token
2025-10-10T14:31:38.974711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:38.975193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:38.975208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.975217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600706916081075:3474]
2025-10-10T14:31:38.975258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:38.975262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:38.975421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:38.975548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.975672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.975795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:38.975971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:38.976003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:38.988204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId: src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:38.990776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:38.992070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:38.992094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:38.992118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:38.992121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:38.992124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:38.992126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:38.992135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600706916081075:3474]
2025-10-10T14:31:38.992139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600706916081075:3474]
2025-10-10T14:31:38.992144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600706916081075:3474]
2025-10-10T14:31:38.992185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:38.992199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:38.992200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:38.992204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:38.992206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:38.992208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:38.992328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:39.051713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600711993258051:3658]
2025-10-10T14:31:39.051970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 255, pipe: [1:7559600711993258051:3658]
2025-10-10T14:31:39.096797Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:39.097041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:39.097069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258051:3658], now have 1 active actors on pipe
2025-10-10T14:31:39.097156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:39.097228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600711993258051:3658]
2025-10-10T14:31:39.097238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:39.097240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:39.097253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:39.097314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 256 reason: error at write: Disconnected sessionId: src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0
2025-10-10T14:31:39.097456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 256 sessionId: src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0 is DEAD
2025-10-10T14:31:39.097617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:39.097627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0] Write session will restart in 0.009328s
2025-10-10T14:31:39.097650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0] Write session: Do CDS request
2025-10-10T14:31:39.097656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:39.104174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:39.105424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:39.105599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:39.105611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:39.105623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:39.105675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:39.105712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600711211048472:3477]
2025-10-10T14:31:39.106327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:39.106576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:39.106618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:39.107041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:39.107099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.107105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.107107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.107108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.107109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.107112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.107113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.107114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.107115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.107116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.107117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.107118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.107119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.107124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.107136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.107140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.107144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.107148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.107151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.107155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.107159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.107162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.107166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.107169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.107173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.107177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.107184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.107191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.107203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.107208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.107217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.107222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.107231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.107236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.107245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.107249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.107255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.107264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.107270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.107274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.107278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.107283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.107287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.107293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.107301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.107306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.107310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.107317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.107326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.107331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.107335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.107344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.107384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:39.107834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.107896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:39.107905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 257
2025-10-10T14:31:39.108041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.108063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:39.108071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:39.108074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:39.108382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 257 sessionId:  describe result for acl check
2025-10-10T14:31:39.108405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:39.108409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:39.108410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:39.108414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600711993258114:3976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:39.108812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600711993258114:3976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:39.109523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:39.109845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:39.109858Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:39.109860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:39.109863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:39.109871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 256 [2:7559600711211048472:3477]
2025-10-10T14:31:39.109882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:39.109898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:39.109906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.109909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.109911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.109927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:39.109940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:39.109949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:39.110008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.110016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.110017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.110020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:39.110079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:39.110087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.110099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.110111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.110133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:39.110157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258064:2438], now have 1 active actors on pipe
2025-10-10T14:31:39.110168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600711211048467:3477]
2025-10-10T14:31:39.110170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600711211048467:3477]
2025-10-10T14:31:39.110157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 256
2025-10-10T14:31:39.110172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600711211048467:3477]
2025-10-10T14:31:39.110181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:39.110193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:39.110193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:39.110196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:39.110198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:39.110216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:39.110223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:39.110249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600711211048467:3477]
2025-10-10T14:31:39.110261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:39.110266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:39.110720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600711993258114:3976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:39.114936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600711993258114:3976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:39.114948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600711993258114:3976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:39.114950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600711993258114:3976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:39.114967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:39.115155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258148:3976], now have 1 active actors on pipe
2025-10-10T14:31:39.115201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 256
2025-10-10T14:31:39.115263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.115276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.115306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:39.115320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.115326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.115335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:39.115346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.115363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:39.115382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.115519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.115528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.115543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.115606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 257 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0
2025-10-10T14:31:39.115915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8002d01-74bf0788-c849e0ab-14b54d7c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:39.118536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0] Write session: try to update token
2025-10-10T14:31:39.118553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:39.121095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:39.121110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.121119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600711211048467:3477]
2025-10-10T14:31:39.121159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:39.121162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:39.121325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:39.121483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:39.121624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:39.121765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:39.121951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:39.121992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:39.131898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId: src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:39.134363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:39.134545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.134564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.134597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:39.134685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:39.137987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:39.138004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.138006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:39.138008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:39.138015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600711211048467:3477]
2025-10-10T14:31:39.138019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600711211048467:3477]
2025-10-10T14:31:39.138021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600711211048467:3477]
2025-10-10T14:31:39.138061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:39.138064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:39.138069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:39.138070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.138072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:39.138074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:39.138194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:39.197597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600711993258152:3658]
2025-10-10T14:31:39.197853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 256, pipe: [1:7559600711993258152:3658]
2025-10-10T14:31:39.241968Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:39.248124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.248146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.248286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.248341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.248410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.248468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.248508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.248515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.248576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.248628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.248680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.248735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.248774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.248782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.248836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.248887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.248947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.249012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.249049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.249055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.249108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.249159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.249211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.249264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.249303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.249309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.249376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.249429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.249480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.249529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.249565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.249570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.249626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.249678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.249729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.249782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.249826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.249835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.249900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.249958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.250011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.250064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.250100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.250105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.250162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.250214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.250268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.250334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.250375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.250380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.250432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.250483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.250535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.250588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.250623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.250628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.250683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.250733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.250795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.250861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.250899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.250904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.250937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258152:3658], now have 1 active actors on pipe
2025-10-10T14:31:39.251179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:39.251196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600711993258152:3658]
2025-10-10T14:31:39.251220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:39.251222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:39.251251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 257 reason: error at write: Disconnected sessionId: src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0
2025-10-10T14:31:39.251470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 257 sessionId: src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0 is DEAD
2025-10-10T14:31:39.251501Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:39.251619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:39.251629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0] Write session will restart in 0.005291s
2025-10-10T14:31:39.251655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0] Write session: Do CDS request
2025-10-10T14:31:39.251661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:39.257775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.257834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:39.257846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 258
2025-10-10T14:31:39.257890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:39.257972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.258005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:39.258029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:39.258039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:39.258438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 258 sessionId:  describe result for acl check
2025-10-10T14:31:39.258468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:39.258472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:39.258473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:39.258479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600711993258200:3980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:39.258929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600711993258200:3980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:39.259254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:39.259418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:39.259429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:39.259441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:39.259488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:39.259528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600711211048558:3479]
2025-10-10T14:31:39.260112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:39.260393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:39.260441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:39.260739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:39.260796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.260799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.260800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.260802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.260803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.260804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.260805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.260805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.260807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.260808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.260809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.260810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.260811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.260817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.260828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.260833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.260837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.260841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.260845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.260849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.260853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.260857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.260861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.260864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.260869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.260873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.260879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.260888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.260894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.260901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.260906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.260911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.260915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.260920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.260925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.260930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.260934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.260939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.260944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.260949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.260953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.260959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.260969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.260974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.260977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.260983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.260987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.260992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.260996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.261006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.261010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.261015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.261054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:39.261237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600711993258200:3980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:39.263355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:39.263664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:39.263679Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:39.263682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:39.263685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:39.263691Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 257 [2:7559600711211048558:3479]
2025-10-10T14:31:39.263703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:39.263718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:39.263724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.263733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.263735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.263751Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:39.263751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600711993258200:3980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:39.263764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:39.263776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:39.263764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600711993258200:3980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:39.263768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600711993258200:3980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:39.263785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:39.263823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.263830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.263832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.263834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:39.263894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:39.263901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.263913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.263929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.263953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:39.263975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600711211048553:3479]
2025-10-10T14:31:39.263984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600711211048553:3479]
2025-10-10T14:31:39.263986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600711211048553:3479]
2025-10-10T14:31:39.263996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:39.264009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258153:2438], now have 1 active actors on pipe
2025-10-10T14:31:39.264013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258234:3980], now have 1 active actors on pipe
2025-10-10T14:31:39.264021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:39.264010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:39.264030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:39.264032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:39.264037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:39.264040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:39.264062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600711211048553:3479]
2025-10-10T14:31:39.264062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 257
2025-10-10T14:31:39.264066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 257
2025-10-10T14:31:39.264072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:39.264085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:39.264116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.264125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.264154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f955735-8c984bf9-40def66b-b1221c46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:39.264165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.264169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.264175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:39.264186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.264200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:39.264213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.264400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.264410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.264426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.264514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 258 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f955735-8c984bf9-40def66b-b1221c46_0
2025-10-10T14:31:39.264847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a85a43d-2b599621-2655eb51-eb1023a6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f955735-8c984bf9-40def66b-b1221c46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:39.267302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f955735-8c984bf9-40def66b-b1221c46_0] Write session: try to update token
2025-10-10T14:31:39.267322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f955735-8c984bf9-40def66b-b1221c46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:39.275015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:39.275034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.275044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600711211048553:3479]
2025-10-10T14:31:39.275089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:39.275093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:39.275257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:39.275395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:39.275529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:39.275661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:39.275855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:39.275898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:39.281606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId: src_id|9f955735-8c984bf9-40def66b-b1221c46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:39.284073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:39.284292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.284313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.284354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:39.284443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:39.292702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:39.292720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.292723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:39.292724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:39.292735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600711211048553:3479]
2025-10-10T14:31:39.292740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600711211048553:3479]
2025-10-10T14:31:39.292741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600711211048553:3479]
2025-10-10T14:31:39.292776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:39.292782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.292784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:39.292792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:39.292801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:39.292805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:39.292903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:39.351242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600711993258242:3658]
2025-10-10T14:31:39.351527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 257, pipe: [1:7559600711993258242:3658]
2025-10-10T14:31:39.396936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:39.403323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.403346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.403493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.403547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.403604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.403660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.403703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.403716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.403785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.403855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.403920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.403985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.404027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.404033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.404095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.404147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.404202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.404256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.404294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.404300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.404363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.404423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.404477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.404541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.404585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.404593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.404659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.404720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.404779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.404846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.404892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.404899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.404961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.405019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.405084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.405143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.405189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.405196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.405259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.405321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.405401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.405463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.405506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.405512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.405576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.405635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.405700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.405762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.405805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.405811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.405872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.405929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.405988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.406046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.406089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.406095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.406157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:39.406213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:39.406274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:39.406345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:39.406386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:39.406393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:39.406438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258242:3658], now have 1 active actors on pipe
2025-10-10T14:31:39.406680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:39.406690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:39.406700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:39.406716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 258 reason: error at write: Disconnected sessionId: src_id|9f955735-8c984bf9-40def66b-b1221c46_0
2025-10-10T14:31:39.406744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600711993258242:3658]
2025-10-10T14:31:39.406918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 258 sessionId: src_id|9f955735-8c984bf9-40def66b-b1221c46_0 is DEAD
2025-10-10T14:31:39.407066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f955735-8c984bf9-40def66b-b1221c46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:39.407076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f955735-8c984bf9-40def66b-b1221c46_0] Write session will restart in 0.005223s
2025-10-10T14:31:39.407057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:39.407112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f955735-8c984bf9-40def66b-b1221c46_0] Write session: Do CDS request
2025-10-10T14:31:39.407120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f955735-8c984bf9-40def66b-b1221c46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:39.413845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f955735-8c984bf9-40def66b-b1221c46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.413898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:39.413909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 259
2025-10-10T14:31:39.414111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.414162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:39.414169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:39.414173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:39.414566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 259 sessionId:  describe result for acl check
2025-10-10T14:31:39.414598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:39.414600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:39.414601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:39.414588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:39.414607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600711993258290:3984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:39.415042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:39.415140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600711993258290:3984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:39.415208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:39.415220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:39.415232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:39.415290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:39.415327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600711211048645:3481]
2025-10-10T14:31:39.415850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:39.416144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:39.416188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:39.416475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:39.416527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.416532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.416534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.416535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.416536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.416537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.416538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.416539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.416540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.416541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.416543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.416544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.416545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.416550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.416561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.416565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.416569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.416573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.416576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.416580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.416584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.416588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.416593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.416597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.416601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.416604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.416611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.416619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.416625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.416630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.416634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.416640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.416645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.416653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.416657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.416663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.416667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.416672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.416680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.416685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.416689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.416698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.416702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.416707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.416711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.416716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.416720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.416725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.416729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.416734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.416738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.416745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.416783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:39.417293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600711993258290:3984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:39.418844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:39.419138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:39.419151Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:39.419153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:39.419156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:39.419161Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 258 [2:7559600711211048645:3481]
2025-10-10T14:31:39.419171Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:39.419187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:39.419194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.419197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.419203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.419218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:39.419230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:39.419236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:39.419290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.419296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.419298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.419301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:39.419360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:39.419367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.419377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.419389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.419410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:39.419434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258243:2438], now have 1 active actors on pipe
2025-10-10T14:31:39.419447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600711211048640:3481]
2025-10-10T14:31:39.419453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600711211048640:3481]
2025-10-10T14:31:39.419455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600711211048640:3481]
2025-10-10T14:31:39.419441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 258
2025-10-10T14:31:39.419467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:39.419473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:39.419476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:39.419478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:39.419484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:39.419500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:39.419519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:39.419547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600711211048640:3481]
2025-10-10T14:31:39.419558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:39.419570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:39.419853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600711993258290:3984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:39.419866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600711993258290:3984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:39.419869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600711993258290:3984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:39.419875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:39.420058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258327:3984], now have 1 active actors on pipe
2025-10-10T14:31:39.420082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 258
2025-10-10T14:31:39.420139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.420150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.420182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7181bb8-feff94a1-7a70b349-8de64690_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:39.420196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.420204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.420206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:39.420218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.420234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:39.420253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.420364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.420371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.420385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.420442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 259 partition: 0 MaxSeqNo: 40 sessionId: src_id|f7181bb8-feff94a1-7a70b349-8de64690_0
2025-10-10T14:31:39.420724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f955735-8c984bf9-40def66b-b1221c46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f7181bb8-feff94a1-7a70b349-8de64690_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:39.423094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7181bb8-feff94a1-7a70b349-8de64690_0] Write session: try to update token
2025-10-10T14:31:39.423109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7181bb8-feff94a1-7a70b349-8de64690_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:39.436526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId: src_id|f7181bb8-feff94a1-7a70b349-8de64690_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:39.437484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:39.437503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.437506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:39.437509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:39.437518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600711211048640:3481]
2025-10-10T14:31:39.437523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600711211048640:3481]
2025-10-10T14:31:39.437527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600711211048640:3481]
2025-10-10T14:31:39.437572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:39.437574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:39.437578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.437579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:39.437580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:39.437582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:39.437714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:39.439014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:39.506869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600711993258333:3658]
2025-10-10T14:31:39.507053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 258, pipe: [1:7559600711993258333:3658]
2025-10-10T14:31:39.541409Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:39.541686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.541700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.541737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258333:3658], now have 1 active actors on pipe
2025-10-10T14:31:39.541897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:39.541926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:39.541936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:39.541956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:39.541995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 259 reason: error at write: Disconnected sessionId: src_id|f7181bb8-feff94a1-7a70b349-8de64690_0
2025-10-10T14:31:39.542003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600711993258333:3658]
2025-10-10T14:31:39.542165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 259 sessionId: src_id|f7181bb8-feff94a1-7a70b349-8de64690_0 is DEAD
2025-10-10T14:31:39.542386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7181bb8-feff94a1-7a70b349-8de64690_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:39.542401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7181bb8-feff94a1-7a70b349-8de64690_0] Write session will restart in 0.006199s
2025-10-10T14:31:39.542429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7181bb8-feff94a1-7a70b349-8de64690_0] Write session: Do CDS request
2025-10-10T14:31:39.542440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7181bb8-feff94a1-7a70b349-8de64690_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:39.549518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:39.549775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7181bb8-feff94a1-7a70b349-8de64690_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.549854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:39.549879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 260
2025-10-10T14:31:39.550015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.550044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:39.550053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:39.550056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:39.550468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 260 sessionId:  describe result for acl check
2025-10-10T14:31:39.550507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:39.550513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:39.550516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:39.550522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600711993258390:3990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:39.550762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:39.550922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:39.550933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:39.550944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:39.550995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:39.551036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600711211048733:3483]
2025-10-10T14:31:39.551105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600711993258390:3990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:39.551614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:39.551882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:39.551926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:39.552230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:39.552282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.552288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.552291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.552292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.552294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.552295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.552296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.552298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.552299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.552300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.552302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.552303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.552304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.552309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.552321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.552325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.552329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.552334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.552338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.552341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.552345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.552349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.552354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.552357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.552361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.552365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.552372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.552386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.552395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.552405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.552414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.552430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.552439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.552449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.552458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.552467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.552475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.552485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.552490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.552495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.552504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.552513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.552520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.552526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.552534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.552540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.552545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.552555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.552563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.552568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.552576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.552585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.552630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:39.553090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600711993258390:3990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:39.554840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:39.555134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:39.555147Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:39.555149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:39.555153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:39.555158Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 259 [2:7559600711211048733:3483]
2025-10-10T14:31:39.555169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:39.555184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:39.555187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.555190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.555192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.555209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:39.555221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:39.555228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:39.555282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.555289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.555291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.555294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:39.555355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:39.555364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.555375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.555387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.555406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:39.555434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258341:2438], now have 1 active actors on pipe
2025-10-10T14:31:39.555445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600711211048728:3483]
2025-10-10T14:31:39.555452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600711211048728:3483]
2025-10-10T14:31:39.555454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600711211048728:3483]
2025-10-10T14:31:39.555467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:39.555475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:39.555453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 259
2025-10-10T14:31:39.555478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:39.555480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:39.555482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:39.555498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:39.555505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:39.555531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600711211048728:3483]
2025-10-10T14:31:39.555542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:39.555548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:39.555625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600711993258390:3990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:39.555640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600711993258390:3990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:39.555644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600711993258390:3990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:39.555651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:39.555835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258426:3990], now have 1 active actors on pipe
2025-10-10T14:31:39.555873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 259
2025-10-10T14:31:39.555915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.555924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.555954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:39.555967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.555971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.555972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:39.555983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.555997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:39.556016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.556244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.556251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.556264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.556347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 260 partition: 0 MaxSeqNo: 40 sessionId: src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0
2025-10-10T14:31:39.556663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7181bb8-feff94a1-7a70b349-8de64690_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:39.559257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0] Write session: try to update token
2025-10-10T14:31:39.559271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:39.573020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId: src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:39.574696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:39.574717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.574721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:39.574723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:39.574738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600711211048728:3483]
2025-10-10T14:31:39.574742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600711211048728:3483]
2025-10-10T14:31:39.574746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600711211048728:3483]
2025-10-10T14:31:39.574778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:39.574784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:39.574788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:39.574796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:39.574803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.574806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:39.574946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:39.575585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:39.642045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600711993258450:3658]
2025-10-10T14:31:39.642365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 259, pipe: [1:7559600711993258450:3658]
2025-10-10T14:31:39.680706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:39.681022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.681036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.681072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258450:3658], now have 1 active actors on pipe
2025-10-10T14:31:39.681241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:39.681339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:39.681349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:39.681354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:39.681382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600711993258450:3658]
2025-10-10T14:31:39.681416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 260 reason: error at write: Disconnected sessionId: src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0
2025-10-10T14:31:39.681627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 260 sessionId: src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0 is DEAD
2025-10-10T14:31:39.681781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:39.681794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0] Write session will restart in 0.006264s
2025-10-10T14:31:39.681818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0] Write session: Do CDS request
2025-10-10T14:31:39.681824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:39.688905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.688936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:39.688949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 261
2025-10-10T14:31:39.689142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.689176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:39.689186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:39.689190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:39.689352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:39.689591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 261 sessionId:  describe result for acl check
2025-10-10T14:31:39.689624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:39.689629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:39.689630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:39.689634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600711993258512:4003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:39.690083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600711993258512:4003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:39.690887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:39.691051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:39.691063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:39.691075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:39.691116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:39.691149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600711211048862:3499]
2025-10-10T14:31:39.691567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:39.691814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:39.691848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:39.691899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600711993258512:4003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:39.692103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:39.692145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.692151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.692153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.692154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.692154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.692155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.692156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.692157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.692157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.692158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.692159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.692159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.692160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.692164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.692171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.692173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.692175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.692177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.692179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.692181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.692183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.692186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.692190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.692194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.692198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.692202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.692209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.692218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.692222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.692226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.692228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.692231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.692234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.692241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.692245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.692251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.692255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.692260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.692265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.692269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.692272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.692275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.692278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.692281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.692283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.692287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.692292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.692298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.692301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.692306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.692309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.692314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.692351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:39.694626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:39.694933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:39.694947Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:39.694929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600711993258512:4003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:39.694949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:39.694953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:39.694939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600711993258512:4003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:39.694959Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 260 [2:7559600711211048862:3499]
2025-10-10T14:31:39.694942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600711993258512:4003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:39.694971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:39.694948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:39.694988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:39.694996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.695000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.695006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.695025Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:39.695037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:39.695049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:39.695102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.695108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.695110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.695112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:39.695180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:39.695188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.695200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.695212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.695230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:39.695257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258546:4003], now have 1 active actors on pipe
2025-10-10T14:31:39.695265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258462:2438], now have 1 active actors on pipe
2025-10-10T14:31:39.695272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600711211048857:3499]
2025-10-10T14:31:39.695275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600711211048857:3499]
2025-10-10T14:31:39.695277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600711211048857:3499]
2025-10-10T14:31:39.695289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 260
2025-10-10T14:31:39.695300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 260
2025-10-10T14:31:39.695293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:39.695312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:39.695316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:39.695319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:39.695323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:39.695328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:39.695331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:39.695368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.695378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.695391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600711211048857:3499]
2025-10-10T14:31:39.695403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:39.695417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:39.695438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:39.695449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.695453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.695455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:39.695467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.695481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:39.695507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.695653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.695663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.695678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.695765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 261 partition: 0 MaxSeqNo: 40 sessionId: src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0
2025-10-10T14:31:39.696134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95dd4f84-fbeff4eb-52281157-886b65a6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:39.698693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0] Write session: try to update token
2025-10-10T14:31:39.698716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:39.713011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId: src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:39.714045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:39.714063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.714067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:39.714069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:39.714078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600711211048857:3499]
2025-10-10T14:31:39.714083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600711211048857:3499]
2025-10-10T14:31:39.714086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600711211048857:3499]
2025-10-10T14:31:39.714128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:39.714134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:39.714134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:39.714137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:39.714144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.714146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:39.714277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:39.715700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:39.781350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600711993258553:3658]
2025-10-10T14:31:39.781598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 260, pipe: [1:7559600711993258553:3658]
2025-10-10T14:31:39.818256Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:39.818498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.818514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.818555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258553:3658], now have 1 active actors on pipe
2025-10-10T14:31:39.818727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:39.818827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600711993258553:3658]
2025-10-10T14:31:39.818837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:39.818850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:39.818907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 261 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0
2025-10-10T14:31:39.819111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 261 sessionId: src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0 is DEAD
2025-10-10T14:31:39.819248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:39.819258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0] Write session will restart in 0.005255s
2025-10-10T14:31:39.819277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0] Write session: Do CDS request
2025-10-10T14:31:39.819282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:39.825883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.825953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:39.825977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 262
2025-10-10T14:31:39.826109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.826146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:39.826157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:39.826161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:39.826567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:39.826649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 262 sessionId:  describe result for acl check
2025-10-10T14:31:39.826689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:39.826695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:39.826697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:39.826704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600711993258605:4007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:39.827215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600711993258605:4007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:39.827896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:39.828101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:39.828118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:39.828132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:39.828209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:39.828263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600711211048951:3501]
2025-10-10T14:31:39.828926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:39.829197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:39.829239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:39.829251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600711993258605:4007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:39.829527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:39.829592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.829599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.829601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.829602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.829605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.829606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.829607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.829608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.829609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.829611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.829612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.829613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.829614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.829620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.829629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.829631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.829633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.829635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.829637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.829639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.829642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.829644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.829646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.829648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.829650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.829652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.829657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.829662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.829667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.829670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.829674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.829677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.829680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.829683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.829686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.829691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.829694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.829697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.829701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.829704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.829706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.829709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.829712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.829715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.829717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.829720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.829723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.829726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.829728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.829731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.829734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.829737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.829759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:39.831921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600711993258605:4007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:39.831932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600711993258605:4007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:39.831934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600711993258605:4007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:39.831941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:39.831948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:39.832230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:39.832240Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:39.832242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:39.832245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:39.832249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 261 [2:7559600711211048951:3501]
2025-10-10T14:31:39.832256Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:39.832268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:39.832275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.832278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.832281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.832295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:39.832304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:39.832316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:39.832365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.832373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.832375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.832377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:39.832434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:39.832451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.832465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.832482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.832504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:39.832529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258555:2438], now have 1 active actors on pipe
2025-10-10T14:31:39.832537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258640:4007], now have 1 active actors on pipe
2025-10-10T14:31:39.832544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600711211048946:3501]
2025-10-10T14:31:39.832547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600711211048946:3501]
2025-10-10T14:31:39.832549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600711211048946:3501]
2025-10-10T14:31:39.832562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:39.832549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 261
2025-10-10T14:31:39.832566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 261
2025-10-10T14:31:39.832576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:39.832593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:39.832596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:39.832599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:39.832603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:39.832605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:39.832635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.832644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.832657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600711211048946:3501]
2025-10-10T14:31:39.832668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:39.832691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:39.832699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:39.832706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.832710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.832713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:39.832724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.832739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:39.832762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.832946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.832955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.832971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.833064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 262 partition: 0 MaxSeqNo: 40 sessionId: src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0
2025-10-10T14:31:39.833409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dbd113-39c0d026-3ca37ae7-cca3d11e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:39.836073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0] Write session: try to update token
2025-10-10T14:31:39.836090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:39.850604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId: src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:39.851189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:39.851211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.851216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:39.851218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:39.851228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600711211048946:3501]
2025-10-10T14:31:39.851234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600711211048946:3501]
2025-10-10T14:31:39.851240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600711211048946:3501]
2025-10-10T14:31:39.851298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:39.851304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:39.851312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:39.851314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.851316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:39.851317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:39.851469Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:39.853220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:39.919043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600711993258647:3658]
2025-10-10T14:31:39.919326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 261, pipe: [1:7559600711993258647:3658]
2025-10-10T14:31:39.953379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:39.953615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.953628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.953663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258647:3658], now have 1 active actors on pipe
2025-10-10T14:31:39.953799Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:39.953856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600711993258647:3658]
2025-10-10T14:31:39.953878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:39.953885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:39.953948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 262 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0
2025-10-10T14:31:39.954111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 262 sessionId: src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0 is DEAD
2025-10-10T14:31:39.954247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:39.954258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0] Write session will restart in 0.009941s
2025-10-10T14:31:39.954284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0] Write session: Do CDS request
2025-10-10T14:31:39.954291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:39.960607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:39.961957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:39.962124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:39.962132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:39.962141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:39.962192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:39.962229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600711211049043:3503]
2025-10-10T14:31:39.962885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:39.963143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:39.963174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:39.963403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:39.963452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.963458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.963460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.963460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.963461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.963465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.963466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.963467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.963468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.963469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.963470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.963471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.963472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.963477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.963490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.963495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.963498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.963500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.963502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.963504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.963506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.963508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.963511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.963513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.963515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.963517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.963523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.963528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:39.963533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.963536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:39.963540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.963543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:39.963549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.963552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:39.963555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.963558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:39.963561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.963564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:39.963567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.963570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:39.963572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.963575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:39.963578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.963581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:39.963583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.963586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:39.963590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.963593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.963596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.963598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.963605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.963608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.963630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:39.965813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.965805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:39.965898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:39.965912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 263
2025-10-10T14:31:39.966059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:39.966094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:39.966104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:39.966109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:39.966127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:39.966140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:39.966143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:39.966146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:39.966152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 262 [2:7559600711211049043:3503]
2025-10-10T14:31:39.966164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:39.966186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:39.966194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.966198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.966200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.966216Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:39.966228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:39.966239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:39.966296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.966302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.966304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.966307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:39.966382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:39.966391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.966402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:39.966419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:39.966439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:39.966461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258649:2438], now have 1 active actors on pipe
2025-10-10T14:31:39.966473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600711211049038:3503]
2025-10-10T14:31:39.966476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600711211049038:3503]
2025-10-10T14:31:39.966479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600711211049038:3503]
2025-10-10T14:31:39.966470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 263 sessionId:  describe result for acl check
2025-10-10T14:31:39.966492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:39.966494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 262
2025-10-10T14:31:39.966501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:39.966503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:39.966505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:39.966511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600711993258711:4011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:39.966510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:39.966515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:39.966517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:39.966518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:39.966537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:39.966540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:39.966568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600711211049038:3503]
2025-10-10T14:31:39.966575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:39.966589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:39.967063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600711993258711:4011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:39.969090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600711993258711:4011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:39.974908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600711993258711:4011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:39.974920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600711993258711:4011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:39.974922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600711993258711:4011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:39.974928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:39.975156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600711993258744:4011], now have 1 active actors on pipe
2025-10-10T14:31:39.975190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 262
2025-10-10T14:31:39.975236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.975250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.975289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:39.975306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:39.975317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:39.975323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:39.975340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:39.975363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:39.975388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.975531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:39.975545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:39.975564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:39.975659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 263 partition: 0 MaxSeqNo: 40 sessionId: src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0
2025-10-10T14:31:39.976005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8d118-d5217f70-4f395f04-8e2c4831_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:39.978623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0] Write session: try to update token
2025-10-10T14:31:39.978640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:39.984572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:39.984588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:39.984591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:39.984592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:39.984599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600711211049038:3503]
2025-10-10T14:31:39.984602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600711211049038:3503]
2025-10-10T14:31:39.984605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600711211049038:3503]
2025-10-10T14:31:39.984643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:39.984644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:39.984648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:39.984650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:39.984650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:39.984652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:39.984782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:39.997123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId: src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:40.007510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:40.054230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600716288226044:3658]
2025-10-10T14:31:40.054526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 262, pipe: [1:7559600716288226044:3658]
2025-10-10T14:31:40.090233Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:40.090597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.090610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.090628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226044:3658], now have 1 active actors on pipe
2025-10-10T14:31:40.090785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:40.090791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600716288226044:3658]
2025-10-10T14:31:40.090807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:40.090809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:40.090859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 263 reason: error at write: Disconnected sessionId: src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0
2025-10-10T14:31:40.090855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:40.091055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 263 sessionId: src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0 is DEAD
2025-10-10T14:31:40.091161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:40.091167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0] Write session will restart in 0.006635s
2025-10-10T14:31:40.091192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0] Write session: Do CDS request
2025-10-10T14:31:40.091197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:40.097608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:40.098848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.098915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:40.098927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 264
2025-10-10T14:31:40.099078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.099112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:40.099123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:40.099127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:40.099149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:40.099305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:40.099313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:40.099323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:40.099363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:40.099402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600715506016443:3506]
2025-10-10T14:31:40.099550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 264 sessionId:  describe result for acl check
2025-10-10T14:31:40.099578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:40.099584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:40.099586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:40.099592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600716288226110:4016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:40.099774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:40.099989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:40.100016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:40.100136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600716288226110:4016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:40.100210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:40.100245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.100249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.100250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.100250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.100251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.100252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.100253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.100253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.100254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.100254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.100255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.100256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.100257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.100261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.100267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.100270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.100272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.100274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.100276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.100278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.100280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.100283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.100285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.100287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.100289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.100291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.100296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.100302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.100306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.100310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.100313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.100316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.100318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.100321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.100324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.100327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.100330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.100333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.100337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.100340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.100343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.100346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.100349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.100352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.100355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.100358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.100361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.100364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.100368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.100374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.100377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.100380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.100404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:40.102115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600716288226110:4016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:40.102468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:40.102791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:40.102811Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:40.102814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:40.102818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:40.102823Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 263 [2:7559600715506016443:3506]
2025-10-10T14:31:40.102834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:40.102851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:40.102870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.102873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.102876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.102891Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:40.102898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:40.102909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:40.102964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.102970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.102972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.102975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:40.103034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:40.103041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.103049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.103056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.103068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:40.103095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226057:2438], now have 1 active actors on pipe
2025-10-10T14:31:40.103106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600715506016438:3506]
2025-10-10T14:31:40.103109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600715506016438:3506]
2025-10-10T14:31:40.103111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600715506016438:3506]
2025-10-10T14:31:40.103119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 263
2025-10-10T14:31:40.103124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:40.103140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:40.103140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:40.103143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:40.103145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:40.103151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:40.103153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:40.103175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600715506016438:3506]
2025-10-10T14:31:40.103183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:40.103208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:40.107426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600716288226110:4016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:40.107436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600716288226110:4016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:40.107438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600716288226110:4016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:40.107444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:40.107670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 263
2025-10-10T14:31:40.107669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226148:4016], now have 1 active actors on pipe
2025-10-10T14:31:40.107735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.107749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.107773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:40.107785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.107792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.107794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:40.107803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.107826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:40.107841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.107964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.107975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.107994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.108066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 264 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0
2025-10-10T14:31:40.108386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|824e001-c47a714f-b35d0d88-ed34a2e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:40.112052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0] Write session: try to update token
2025-10-10T14:31:40.112067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:40.121000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:40.121016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.121018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:40.121019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:40.121027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600715506016438:3506]
2025-10-10T14:31:40.121031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600715506016438:3506]
2025-10-10T14:31:40.121033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600715506016438:3506]
2025-10-10T14:31:40.121070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:40.121075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.121077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:40.121099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:40.121115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:40.121120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:40.121198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:40.126583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId: src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:40.129004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:40.190907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600716288226152:3658]
2025-10-10T14:31:40.191164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 263, pipe: [1:7559600716288226152:3658]
2025-10-10T14:31:40.225807Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:40.226123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.226134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.226153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226152:3658], now have 1 active actors on pipe
2025-10-10T14:31:40.226327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:40.226408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:40.226419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:40.226436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600716288226152:3658]
2025-10-10T14:31:40.226452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:40.226482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 264 reason: error at write: Disconnected sessionId: src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0
2025-10-10T14:31:40.226656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 264 sessionId: src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0 is DEAD
2025-10-10T14:31:40.226816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:40.226825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0] Write session will restart in 0.005202s
2025-10-10T14:31:40.226849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0] Write session: Do CDS request
2025-10-10T14:31:40.226854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:40.232760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.232866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:40.232880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 265
2025-10-10T14:31:40.233040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.233075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:40.233084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:40.233071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:40.233096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:40.233459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 265 sessionId:  describe result for acl check
2025-10-10T14:31:40.233495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:40.233497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:40.233498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:40.233503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600716288226207:4020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:40.233999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600716288226207:4020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:40.234670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:40.234826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:40.234835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:40.234844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:40.234904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:40.234936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600715506016536:3508]
2025-10-10T14:31:40.235309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:40.235582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:40.235606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600716288226207:4020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:40.235635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:40.235920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:40.235964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.235968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.235969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.235970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.235970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.235971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.235972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.235972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.235973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.235973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.235974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.235975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.235977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.235981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.235989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.235991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.235995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.235999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.236003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.236006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.236009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.236013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.236017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.236021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.236025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.236029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.236035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.236050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.236068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.236075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.236078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.236081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.236084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.236087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.236090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.236092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.236095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.236098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.236100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.236103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.236106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.236109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.236111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.236115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.236119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.236122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.236124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.236127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.236129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.236132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.236135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.236138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.236169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:40.238072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600716288226207:4020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:40.238084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600716288226207:4020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:40.238087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600716288226207:4020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:40.238095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:40.238176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:40.238482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:40.238492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:40.238493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:40.238496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:40.238500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 264 [2:7559600715506016536:3508]
2025-10-10T14:31:40.238507Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:40.238518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:40.238523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.238525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.238526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.238537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:40.238545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:40.238551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:40.238601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.238605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.238607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.238608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:40.238652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:40.238657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.238664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.238670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.238683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:40.238702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226241:4020], now have 1 active actors on pipe
2025-10-10T14:31:40.238708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226153:2438], now have 1 active actors on pipe
2025-10-10T14:31:40.238713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600715506016531:3508]
2025-10-10T14:31:40.238715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600715506016531:3508]
2025-10-10T14:31:40.238716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600715506016531:3508]
2025-10-10T14:31:40.238724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:40.238734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:40.238747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:40.238749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:40.238752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:40.238753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:40.238755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:40.238747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 264
2025-10-10T14:31:40.238776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600715506016531:3508]
2025-10-10T14:31:40.238752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 264
2025-10-10T14:31:40.238784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:40.238785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:40.238799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.238802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.238859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:40.238869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.238872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.238873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:40.238880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.238888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:40.238901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.239019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.239026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.239036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.239110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 265 partition: 0 MaxSeqNo: 40 sessionId: src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0
2025-10-10T14:31:40.239390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4784bd1-343054a2-c05ac013-8a2f84c5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:40.242468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0] Write session: try to update token
2025-10-10T14:31:40.242484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:40.256790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:40.256809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.256814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:40.256815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:40.256823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600715506016531:3508]
2025-10-10T14:31:40.256826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600715506016531:3508]
2025-10-10T14:31:40.256830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600715506016531:3508]
2025-10-10T14:31:40.256867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:40.256877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.256879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:40.256881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:40.256886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:40.256892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:40.256876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId: src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:40.257001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:40.259571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:40.326605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600716288226249:3658]
2025-10-10T14:31:40.326954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 264, pipe: [1:7559600716288226249:3658]
2025-10-10T14:31:40.361062Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:40.361269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.361283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.361323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226249:3658], now have 1 active actors on pipe
2025-10-10T14:31:40.361489Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:40.361591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:40.361638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600716288226249:3658]
2025-10-10T14:31:40.361641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:40.361724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 265 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0
2025-10-10T14:31:40.361921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 265 sessionId: src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0 is DEAD
2025-10-10T14:31:40.362134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:40.362154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0] Write session will restart in 0.008185s
2025-10-10T14:31:40.362177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0] Write session: Do CDS request
2025-10-10T14:31:40.362183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:40.369221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:40.370608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:40.370781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:40.370791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:40.370800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:40.370837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:40.370870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600715506016630:3510]
2025-10-10T14:31:40.371251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:40.371524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:40.371557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:40.371769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:40.371808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.371812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.371813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.371814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.371814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.371815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.371815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.371816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.371817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.371817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.371818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.371819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.371820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.371825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.371833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.371835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.371837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.371839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.371841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.371843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.371845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.371847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.371849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.371851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.371854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.371856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.371861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.371867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.371872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.371875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.371878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.371880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.371884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.371887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.371890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.371893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.371895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.371898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.371901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.371904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.371906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.371910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.371912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.371915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.371919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.371921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.371924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.371927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.371930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.371933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.371935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.371935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.371938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.371960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:40.372097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:40.372117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 266
2025-10-10T14:31:40.372282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.372337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:40.372345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:40.372352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:40.372801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 266 sessionId:  describe result for acl check
2025-10-10T14:31:40.372851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:40.372856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:40.372858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:40.372862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600716288226309:4024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:40.373396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600716288226309:4024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:40.374143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:40.374483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:40.374496Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:40.374498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:40.374501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:40.374507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 265 [2:7559600715506016630:3510]
2025-10-10T14:31:40.374520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:40.374543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:40.374551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.374554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.374556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.374573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:40.374581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:40.374589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:40.374649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.374656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.374658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.374660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:40.374723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:40.374730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.374741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.374757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.374777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:40.374805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226250:2438], now have 1 active actors on pipe
2025-10-10T14:31:40.374801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 265
2025-10-10T14:31:40.374818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600715506016625:3510]
2025-10-10T14:31:40.374824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600715506016625:3510]
2025-10-10T14:31:40.374826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600715506016625:3510]
2025-10-10T14:31:40.374840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:40.374859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:40.374862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:40.374866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:40.374868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:40.374875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:40.374878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:40.374902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600715506016625:3510]
2025-10-10T14:31:40.374909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:40.374925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:40.375835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600716288226309:4024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:40.381271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600716288226309:4024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:40.381286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600716288226309:4024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:40.381290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600716288226309:4024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:40.381299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:40.381577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226347:4024], now have 1 active actors on pipe
2025-10-10T14:31:40.381647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 265
2025-10-10T14:31:40.381701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.381714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.381747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d879219-556ea56a-a47e8773-6931198_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:40.381762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.381773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.381776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:40.381791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.381813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:40.381839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.382009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.382017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.382034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.382142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 266 partition: 0 MaxSeqNo: 40 sessionId: src_id|d879219-556ea56a-a47e8773-6931198_0
2025-10-10T14:31:40.382522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fb68fe9-15ecc940-6fd8011-14497b9e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d879219-556ea56a-a47e8773-6931198_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:40.385265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d879219-556ea56a-a47e8773-6931198_0] Write session: try to update token
2025-10-10T14:31:40.385279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d879219-556ea56a-a47e8773-6931198_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:40.390743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:40.390760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.390777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600715506016625:3510]
2025-10-10T14:31:40.390831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:40.390833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:40.391020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:40.391164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:40.391293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:40.391424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:40.391623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:40.391660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:40.399232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId: src_id|d879219-556ea56a-a47e8773-6931198_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:40.403718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:40.405388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.405413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.405437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:40.405443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.405446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:40.405448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:40.405457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600715506016625:3510]
2025-10-10T14:31:40.405460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600715506016625:3510]
2025-10-10T14:31:40.405464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600715506016625:3510]
2025-10-10T14:31:40.405503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:40.405514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:40.405519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:40.405520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:40.405526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.405529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:40.405672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:40.461788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600716288226350:3658]
2025-10-10T14:31:40.462002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 265, pipe: [1:7559600716288226350:3658]
2025-10-10T14:31:40.511506Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:40.511867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:40.511901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226350:3658], now have 1 active actors on pipe
2025-10-10T14:31:40.512012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:40.512624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:40.512662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600716288226350:3658]
2025-10-10T14:31:40.520445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:40.520780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:40.520923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:40.520932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:40.520940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:40.520976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:40.521006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600715506016725:3512]
2025-10-10T14:31:40.521419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:40.522127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:40.522158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:40.522394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:40.522438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.522443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.522444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.522444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.522445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.522446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.522446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.522447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.522447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.522448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.522449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.522449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.522450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.522454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.522463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.522466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.522468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.522470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.522472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.522475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.522477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.522479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.522481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.522483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.522486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.522488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.522495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.522501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.522506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.522510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.522513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.522516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.522518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.522521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.522524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.522527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.522530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.522533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.522536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.522539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.522542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.522545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.522548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.522551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.522553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.522556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.522558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.522561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.522563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.522566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.522572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.522575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.522596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:40.523211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:40.523222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:40.523242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 266 reason: error at write: Disconnected sessionId: src_id|d879219-556ea56a-a47e8773-6931198_0
2025-10-10T14:31:40.523421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 266 sessionId: src_id|d879219-556ea56a-a47e8773-6931198_0 is DEAD
2025-10-10T14:31:40.523549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879219-556ea56a-a47e8773-6931198_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:40.523558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879219-556ea56a-a47e8773-6931198_0] Write session will restart in 0.006820s
2025-10-10T14:31:40.523577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879219-556ea56a-a47e8773-6931198_0] Write session: Do CDS request
2025-10-10T14:31:40.523582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879219-556ea56a-a47e8773-6931198_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:40.526488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:40.526770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:40.526779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:40.526781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:40.526783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:40.526787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 266 [2:7559600715506016725:3512]
2025-10-10T14:31:40.526795Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:40.526809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:40.526814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.526817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.526818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.526832Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:40.526859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:40.526868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:40.526912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.526917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.526918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.526920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:40.526979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:40.526987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.526997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.527012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.527033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:40.527056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226352:2438], now have 1 active actors on pipe
2025-10-10T14:31:40.527065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600715506016720:3512]
2025-10-10T14:31:40.527068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600715506016720:3512]
2025-10-10T14:31:40.527070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600715506016720:3512]
2025-10-10T14:31:40.527080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:40.527097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:40.527084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 266
2025-10-10T14:31:40.527099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:40.527105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:40.527108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:40.527115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:40.527118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:40.527140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600715506016720:3512]
2025-10-10T14:31:40.527144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:40.527145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:40.531856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d879219-556ea56a-a47e8773-6931198_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.531948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:40.531963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 267
2025-10-10T14:31:40.532095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.532132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:40.532146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:40.532150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:40.532560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 267 sessionId:  describe result for acl check
2025-10-10T14:31:40.532594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:40.532603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:40.532605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:40.532611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600716288226420:4028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:40.533155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600716288226420:4028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:40.536022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600716288226420:4028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:40.542106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600716288226420:4028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:40.542117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600716288226420:4028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:40.542121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600716288226420:4028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:40.542127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:40.542324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226456:4028], now have 1 active actors on pipe
2025-10-10T14:31:40.542368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 266
2025-10-10T14:31:40.542425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.542438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.542472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:40.542491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.542498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.542501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:40.542519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.542542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:40.542569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.542739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.542747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.542762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.542863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 267 partition: 0 MaxSeqNo: 40 sessionId: src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0
2025-10-10T14:31:40.543231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879219-556ea56a-a47e8773-6931198_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:40.545413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:40.545425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.545427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:40.545429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:40.545435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600715506016720:3512]
2025-10-10T14:31:40.545438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600715506016720:3512]
2025-10-10T14:31:40.545441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600715506016720:3512]
2025-10-10T14:31:40.545477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:40.545482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.545483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:40.545490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:40.545497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:40.545502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:40.545613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:40.545831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0] Write session: try to update token
2025-10-10T14:31:40.545845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:40.560973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId: src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:40.563406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:40.612826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600716288226464:3658]
2025-10-10T14:31:40.613064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 266, pipe: [1:7559600716288226464:3658]
2025-10-10T14:31:40.647318Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:40.647608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.647625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.647653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226464:3658], now have 1 active actors on pipe
2025-10-10T14:31:40.647802Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:40.647805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:40.647843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:40.647854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:40.647909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 267 reason: error at write: Disconnected sessionId: src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0
2025-10-10T14:31:40.647975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600716288226464:3658]
2025-10-10T14:31:40.648113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 267 sessionId: src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0 is DEAD
2025-10-10T14:31:40.648307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:40.648318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0] Write session will restart in 0.009967s
2025-10-10T14:31:40.648346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0] Write session: Do CDS request
2025-10-10T14:31:40.648352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:40.655922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:40.657299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:40.657537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:40.657553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:40.657566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:40.657634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:40.657684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600715506016823:3515]
2025-10-10T14:31:40.658283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:40.658615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:40.658670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:40.658986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:40.659056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.659062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.659064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.659065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.659066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.659067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.659068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.659069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.659070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.659072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.659073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.659074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.659075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.659081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.659095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.659099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.659103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.659107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.659111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.659115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.659119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.659123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.659128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.659133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.659137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.659140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.659148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.659157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.659169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.659175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.659185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.659190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.659195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.659204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.659209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.659214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.659223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.659228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.659237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.659242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.659246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.659251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.659255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.659265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.659270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.659279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.659285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.659294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.659299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.659304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.659313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.659319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.659365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:40.659856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.659940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:40.659952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 268
2025-10-10T14:31:40.660086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.660117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:40.660126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:40.660134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:40.660507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 268 sessionId:  describe result for acl check
2025-10-10T14:31:40.660544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:40.660550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:40.660552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:40.660556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600716288226528:4034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:40.661026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600716288226528:4034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:40.661436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:40.661812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:40.661830Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:40.661834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:40.661838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:40.661844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 267 [2:7559600715506016823:3515]
2025-10-10T14:31:40.661856Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:40.661873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:40.661876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.661879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.661881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.661897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:40.661911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:40.661918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:40.661974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.661982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.661984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.661986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:40.662051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:40.662059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.662072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.662085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.662106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:40.662132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226466:2438], now have 1 active actors on pipe
2025-10-10T14:31:40.662125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 267
2025-10-10T14:31:40.662145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600715506016818:3515]
2025-10-10T14:31:40.662151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600715506016818:3515]
2025-10-10T14:31:40.662155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600715506016818:3515]
2025-10-10T14:31:40.662170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:40.662185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:40.662189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:40.662197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:40.662199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:40.662206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:40.662209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:40.662230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600715506016818:3515]
2025-10-10T14:31:40.662238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:40.662239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:40.663559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600716288226528:4034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:40.669660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600716288226528:4034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:40.669686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600716288226528:4034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:40.669689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600716288226528:4034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:40.669697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:40.669945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226561:4034], now have 1 active actors on pipe
2025-10-10T14:31:40.670004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 267
2025-10-10T14:31:40.670076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.670090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.670126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:40.670153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.670164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.670166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:40.670180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.670205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:40.670231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.670414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.670427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.670450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.670541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 268 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0
2025-10-10T14:31:40.670898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6901abe-dd3f917d-3c6c9a6b-4fd1a55_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:40.673523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0] Write session: try to update token
2025-10-10T14:31:40.673543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:40.677685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:40.677700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.677710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600715506016818:3515]
2025-10-10T14:31:40.677747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:40.677756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:40.677919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:40.678069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:40.678248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:40.678383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:40.678783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:40.678819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:40.688320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId: src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:40.690225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:40.690243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.690245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:40.690247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:40.690256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600715506016818:3515]
2025-10-10T14:31:40.690258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600715506016818:3515]
2025-10-10T14:31:40.690263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600715506016818:3515]
2025-10-10T14:31:40.690302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:40.690310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.690327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:40.690341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:40.690349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:40.690356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:40.690478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:40.690976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:40.747967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600716288226588:3658]
2025-10-10T14:31:40.748256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 267, pipe: [1:7559600716288226588:3658]
2025-10-10T14:31:40.796268Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:40.796572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.796588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.796610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226588:3658], now have 1 active actors on pipe
2025-10-10T14:31:40.796834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:40.796890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:40.796903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:40.796906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:40.796943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600716288226588:3658]
2025-10-10T14:31:40.796969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 268 reason: error at write: Disconnected sessionId: src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0
2025-10-10T14:31:40.797172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 268 sessionId: src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0 is DEAD
2025-10-10T14:31:40.797278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:40.797286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0] Write session will restart in 0.006002s
2025-10-10T14:31:40.797303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0] Write session: Do CDS request
2025-10-10T14:31:40.797311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:40.804840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.804882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:40.804892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 269
2025-10-10T14:31:40.805049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.805092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:40.805103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:40.805107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:40.805262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:40.805604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 269 sessionId:  describe result for acl check
2025-10-10T14:31:40.805650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:40.805662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:40.805665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:40.805670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600716288226648:4047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:40.806222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600716288226648:4047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:40.806883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:40.807072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:40.807083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:40.807095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:40.807144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:40.807194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600715506016957:3530]
2025-10-10T14:31:40.807788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:40.808108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:40.808154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:40.808306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600716288226648:4047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:40.808402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:40.808457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.808463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.808464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.808465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.808466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.808466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.808467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.808468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.808468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.808469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.808470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.808470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.808471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.808475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.808483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.808486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.808488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.808490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.808492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.808494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.808496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.808498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.808501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.808503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.808505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.808507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.808512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.808518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.808522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.808525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.808528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.808531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.808534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.808537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.808539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.808543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.808545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.808549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.808551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.808555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.808557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.808560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.808563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.808566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.808568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.808571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.808574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.808577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.808580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.808583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.808586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.808589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.808611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:40.810865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:40.811035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600716288226648:4047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:40.811046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600716288226648:4047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:40.811048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600716288226648:4047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:40.811053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:40.811178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:40.811194Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:40.811196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:40.811200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:40.811205Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 268 [2:7559600715506016957:3530]
2025-10-10T14:31:40.811216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:40.811232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:40.811235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.811239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.811242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.811256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:40.811264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:40.811272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:40.811326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.811334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.811336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.811338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:40.811401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:40.811409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.811420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.811432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.811454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:40.811479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226682:4047], now have 1 active actors on pipe
2025-10-10T14:31:40.811486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226589:2438], now have 1 active actors on pipe
2025-10-10T14:31:40.811493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600715506016952:3530]
2025-10-10T14:31:40.811496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600715506016952:3530]
2025-10-10T14:31:40.811498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600715506016952:3530]
2025-10-10T14:31:40.811508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:40.811522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:40.811501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 268
2025-10-10T14:31:40.811502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 268
2025-10-10T14:31:40.811530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:40.811534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:40.811536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:40.811542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:40.811545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:40.811580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.811588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.811603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600715506016952:3530]
2025-10-10T14:31:40.811614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:40.811625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:40.811642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:40.811649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.811654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.811657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:40.811667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.811677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:40.811700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.811838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.811848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.811865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.811949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 269 partition: 0 MaxSeqNo: 40 sessionId: src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0
2025-10-10T14:31:40.812257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5162e12-2a66e12e-40b0eef-8177e3a1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:40.814766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0] Write session: try to update token
2025-10-10T14:31:40.814781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:40.828374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId: src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:40.829895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:40.829914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.829917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:40.829919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:40.829929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600715506016952:3530]
2025-10-10T14:31:40.829933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600715506016952:3530]
2025-10-10T14:31:40.829937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600715506016952:3530]
2025-10-10T14:31:40.829989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:40.829993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:40.829994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:40.829997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:40.830001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.830004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:40.830158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:40.830882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:40.896957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600716288226689:3658]
2025-10-10T14:31:40.897242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 268, pipe: [1:7559600716288226689:3658]
2025-10-10T14:31:40.935370Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:40.935841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.935855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.935892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226689:3658], now have 1 active actors on pipe
2025-10-10T14:31:40.936023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:40.936103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:40.936106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:40.936112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:40.936138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600716288226689:3658]
2025-10-10T14:31:40.936171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 269 reason: error at write: Disconnected sessionId: src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0
2025-10-10T14:31:40.936364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 269 sessionId: src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0 is DEAD
2025-10-10T14:31:40.936511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:40.936522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0] Write session will restart in 0.006971s
2025-10-10T14:31:40.936546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0] Write session: Do CDS request
2025-10-10T14:31:40.936552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:40.944252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:40.944829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.944894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:40.944908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 270
2025-10-10T14:31:40.945038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:40.945075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:40.945084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:40.945088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:40.945520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 270 sessionId:  describe result for acl check
2025-10-10T14:31:40.945559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:40.945568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:40.945570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:40.945577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600716288226749:4051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:40.945901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:40.946046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600716288226749:4051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:40.946073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:40.946084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:40.946095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:40.946146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:40.946183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600715506017055:3532]
2025-10-10T14:31:40.946776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:40.947030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:40.947072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:40.947391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:40.947448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.947454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.947455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.947456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.947457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.947459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.947460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.947461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.947462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.947463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.947464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.947465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.947467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.947472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.947484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.947488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.947493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.947496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.947500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.947505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.947508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.947512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.947517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.947521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.947525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.947529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.947536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.947544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:40.947551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.947556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:40.947560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.947567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:40.947570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.947576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:40.947585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.947590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:40.947593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.947599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:40.947603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.947608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:40.947612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.947617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:40.947622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.947627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:40.947631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.947641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:40.947646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.947651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.947655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.947660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.947667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.947672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.947714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:40.947919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600716288226749:4051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:40.949874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:40.950306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:40.950335Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:40.950337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:40.950341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:40.950348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 269 [2:7559600715506017055:3532]
2025-10-10T14:31:40.950361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:40.950378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:40.950381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.950385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.950387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.950406Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:40.950413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:40.950432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:40.950297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600716288226749:4051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:40.950310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600716288226749:4051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:40.950313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600716288226749:4051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:40.950330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:40.950497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.950506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.950509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.950511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:40.950580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:40.950583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.950594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:40.950605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:40.950621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:40.950644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600715506017050:3532]
2025-10-10T14:31:40.950647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600715506017050:3532]
2025-10-10T14:31:40.950651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600715506017050:3532]
2025-10-10T14:31:40.951056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 269
2025-10-10T14:31:40.950669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:40.950684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:40.950699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:40.950703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:40.950726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600715506017050:3532]
2025-10-10T14:31:40.950728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:40.950751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226690:2438], now have 1 active actors on pipe
2025-10-10T14:31:40.950805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:40.950808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:40.950810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:40.950817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:40.951239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600716288226782:4051], now have 1 active actors on pipe
2025-10-10T14:31:40.951331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 269
2025-10-10T14:31:40.951439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.951455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.951496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:40.951511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:40.951516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:40.951518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:40.951532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:40.951547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:40.951576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.951776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:40.951790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:40.951812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:40.951907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 270 partition: 0 MaxSeqNo: 40 sessionId: src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0
2025-10-10T14:31:40.952253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34162d53-e00a9c49-d1d01e6a-120d4d2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:40.954893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0] Write session: try to update token
2025-10-10T14:31:40.954911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:40.968549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId: src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:40.969732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:40.969748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:40.969750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:40.969752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:40.969758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600715506017050:3532]
2025-10-10T14:31:40.969761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600715506017050:3532]
2025-10-10T14:31:40.969764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600715506017050:3532]
2025-10-10T14:31:40.969801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:40.969810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:40.969816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:40.969910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:40.969933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:40.969936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:40.969951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:40.971085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:41.036235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600720583194087:3658]
2025-10-10T14:31:41.036460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 269, pipe: [1:7559600720583194087:3658]
2025-10-10T14:31:41.073858Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:41.074161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.074176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.074215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194087:3658], now have 1 active actors on pipe
2025-10-10T14:31:41.074483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600720583194087:3658]
2025-10-10T14:31:41.074518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:41.074560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:41.074568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:41.074622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 270 reason: error at write: Disconnected sessionId: src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0
2025-10-10T14:31:41.074813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 270 sessionId: src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0 is DEAD
2025-10-10T14:31:41.074834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:41.074973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:41.074993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0] Write session will restart in 0.008600s
2025-10-10T14:31:41.075019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0] Write session: Do CDS request
2025-10-10T14:31:41.075028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:41.082681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:41.084439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:41.084589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:41.084597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:41.084605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:41.084641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:41.084673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600719800984449:3534]
2025-10-10T14:31:41.085095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:41.085347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:41.085376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:41.085601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:41.085645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.085650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.085650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.085651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.085653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.085654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.085654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.085655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.085656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.085656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.085657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.085657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.085658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.085661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.085670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.085673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.085675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.085677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.085679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.085681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.085683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.085685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.085687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.085689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.085691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.085693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.085698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.085703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.085708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.085711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.085713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.085717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.085719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.085722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.085724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.085728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.085731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.085734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.085737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.085740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.085742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.085753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.085756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.085759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.085761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.085764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.085767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.085770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.085774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.085777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.085780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.085783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.085809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:41.085868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.085932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:41.085946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 271
2025-10-10T14:31:41.086113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.086145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:41.086154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:41.086158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:41.086544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 271 sessionId:  describe result for acl check
2025-10-10T14:31:41.086573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:41.086574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:41.086575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:41.086579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600720583194153:4055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:41.087113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600720583194153:4055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:41.087911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:41.088290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:41.088300Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:41.088301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:41.088304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:41.088308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 270 [2:7559600719800984449:3534]
2025-10-10T14:31:41.088315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:41.088331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:41.088336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.088338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.088340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.088324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600720583194153:4055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:41.088358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:41.088367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:41.088373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:41.088411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.088415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.088416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.088418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:41.088463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:41.088467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.088474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.088480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.088494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:41.088509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194088:2438], now have 1 active actors on pipe
2025-10-10T14:31:41.088518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600719800984444:3534]
2025-10-10T14:31:41.088520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600719800984444:3534]
2025-10-10T14:31:41.088521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600719800984444:3534]
2025-10-10T14:31:41.088531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:41.088542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:41.088551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:41.088554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:41.088556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:41.088556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:41.088558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:41.088575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600719800984444:3534]
2025-10-10T14:31:41.088573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 270
2025-10-10T14:31:41.088581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:41.088594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:41.093460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600720583194153:4055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:41.093473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600720583194153:4055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:41.093477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600720583194153:4055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:41.093485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:41.093692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194198:4055], now have 1 active actors on pipe
2025-10-10T14:31:41.093743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 270
2025-10-10T14:31:41.093785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.093796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.093821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:41.093833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.093842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.093844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:41.093862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.093878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:41.093894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.094019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.094025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.094035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.094108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 271 partition: 0 MaxSeqNo: 40 sessionId: src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0
2025-10-10T14:31:41.094462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ea2b62-465a1554-5bb6d39-b0f38153_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:41.096929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0] Write session: try to update token
2025-10-10T14:31:41.096942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:41.099661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:41.099684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.099691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600719800984444:3534]
2025-10-10T14:31:41.099730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:41.099735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:41.099882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:41.100010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.100139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.100259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.100436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:41.100483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:41.110181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId: src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:41.112635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:41.112824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.112846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.112889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:41.112973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:41.116319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:41.116332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.116335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:41.116337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:41.116348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600719800984444:3534]
2025-10-10T14:31:41.116352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600719800984444:3534]
2025-10-10T14:31:41.116355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600719800984444:3534]
2025-10-10T14:31:41.116385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:41.116395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:41.116398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:41.116408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:41.116421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.116428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:41.116560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:41.174474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600720583194202:3658]
2025-10-10T14:31:41.174762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 270, pipe: [1:7559600720583194202:3658]
2025-10-10T14:31:41.225184Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:41.231343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.231367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.231501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.231559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.231613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.231667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.231705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.231713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.231768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.231819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.231876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.231941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.231982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.231989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.232044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.232098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.232151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.232206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.232243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.232248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.232314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.232383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.232436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.232487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.232526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.232531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.232586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.232635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.232722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.232809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.232855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.232863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.232931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.232999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.233062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.233123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.233162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.233167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.233220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.233272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.233342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.233395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.233433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.233437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.233495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.233557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.233610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.233662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.233698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.233704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.233758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.233807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.233858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.233909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.233946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.233951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.234004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.234054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.234105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.234155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.234191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.234196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.234230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194202:3658], now have 1 active actors on pipe
2025-10-10T14:31:41.234470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600720583194202:3658]
2025-10-10T14:31:41.234464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:41.234479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:41.234502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:41.234509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 271 reason: error at write: Disconnected sessionId: src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0
2025-10-10T14:31:41.234702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 271 sessionId: src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0 is DEAD
2025-10-10T14:31:41.234864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:41.234876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0] Write session will restart in 0.008356s
2025-10-10T14:31:41.234867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:41.234899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0] Write session: Do CDS request
2025-10-10T14:31:41.234905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:41.241863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:41.243283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:41.243432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:41.243440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:41.243449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:41.243484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:41.243515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600719800984562:3537]
2025-10-10T14:31:41.243927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:41.244156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:41.244190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:41.244407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:41.244444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.244448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.244449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.244450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.244450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.244451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.244451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.244452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.244453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.244453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.244454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.244455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.244455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.244459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.244467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.244469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.244471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.244473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.244476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.244478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.244480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.244482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.244484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.244487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.244489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.244491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.244496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.244501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.244506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.244509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.244512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.244515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.244518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.244521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.244524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.244527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.244529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.244532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.244535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.244539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.244541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.244544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.244547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.244550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.244553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.244556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.244558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.244561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.244564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.244567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.244570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.244573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.244594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:41.244837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.244877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:41.244888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 272
2025-10-10T14:31:41.245032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.245060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:41.245067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:41.245071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:41.245445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 272 sessionId:  describe result for acl check
2025-10-10T14:31:41.245471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:41.245476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:41.245478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:41.245482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600720583194267:4060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:41.245969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600720583194267:4060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:41.246704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:41.247007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:41.247017Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:41.247019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:41.247021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:41.247025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 271 [2:7559600719800984562:3537]
2025-10-10T14:31:41.247035Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:41.247047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:41.247049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.247052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.247053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.247065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:41.247075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:41.247081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:41.247118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.247123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.247124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.247125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:41.247173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:41.247179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.247185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.247192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.247201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:41.247221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194203:2438], now have 1 active actors on pipe
2025-10-10T14:31:41.247231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600719800984556:3537]
2025-10-10T14:31:41.247233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600719800984556:3537]
2025-10-10T14:31:41.247234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600719800984556:3537]
2025-10-10T14:31:41.247243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:41.247257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:41.247256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:41.247258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:41.247250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 271
2025-10-10T14:31:41.247260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:41.247270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:41.247273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:41.247292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600719800984556:3537]
2025-10-10T14:31:41.247294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:41.247296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:41.248174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600720583194267:4060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:41.253603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600720583194267:4060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:41.253614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600720583194267:4060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:41.253618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600720583194267:4060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:41.253624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:41.253869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194301:4060], now have 1 active actors on pipe
2025-10-10T14:31:41.253909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 271
2025-10-10T14:31:41.253975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.253995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.254048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:41.254066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.254077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.254080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:41.254094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.254125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:41.254163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.254349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.254361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.254381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.254463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 272 partition: 0 MaxSeqNo: 40 sessionId: src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0
2025-10-10T14:31:41.254833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|158246a2-a4108ac2-e89d1e3f-e983a2d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:41.257557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0] Write session: try to update token
2025-10-10T14:31:41.257574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:41.257869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:41.257882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.257889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600719800984556:3537]
2025-10-10T14:31:41.257924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:41.257945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:41.258119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:41.258255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.258404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.258542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.258734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:41.258771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:41.271955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId: src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:41.274840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:41.275810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.275832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.275852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:41.275855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.275856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:41.275858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:41.275865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600719800984556:3537]
2025-10-10T14:31:41.275868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600719800984556:3537]
2025-10-10T14:31:41.275871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600719800984556:3537]
2025-10-10T14:31:41.275904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:41.275915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:41.275916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:41.275919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:41.275920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.275922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:41.276037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:41.334729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600720583194308:3658]
2025-10-10T14:31:41.334989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 271, pipe: [1:7559600720583194308:3658]
2025-10-10T14:31:41.378642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:41.378911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:41.378941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194308:3658], now have 1 active actors on pipe
2025-10-10T14:31:41.379037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:41.379113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600720583194308:3658]
2025-10-10T14:31:41.379129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:41.379132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:41.379140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:41.379205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 272 reason: error at write: Disconnected sessionId: src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0
2025-10-10T14:31:41.379377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 272 sessionId: src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0 is DEAD
2025-10-10T14:31:41.379551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:41.379564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0] Write session will restart in 0.007940s
2025-10-10T14:31:41.379587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0] Write session: Do CDS request
2025-10-10T14:31:41.379594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:41.386296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:41.387550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:41.387694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:41.387701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:41.387710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:41.387753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:41.387784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600719800984664:3539]
2025-10-10T14:31:41.388220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:41.388436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:41.388464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:41.388665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:41.388706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.388712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.388713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.388714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.388715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.388717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.388718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.388718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.388720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.388721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.388722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.388723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.388724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.388730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.388741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.388743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.388745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.388747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.388749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.388751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.388753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.388756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.388758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.388760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.388763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.388765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.388770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.388776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.388780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.388783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.388791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.388794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.388796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.388799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.388802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.388805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.388811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.388814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.388817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.388820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.388825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.388830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.388833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.388836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.388838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.388841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.388845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.388848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.388852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.388858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.388860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.388863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.388878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.388890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:41.388940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:41.388951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 273
2025-10-10T14:31:41.389114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.389143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:41.389153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:41.389157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:41.389539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 273 sessionId:  describe result for acl check
2025-10-10T14:31:41.389568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:41.389574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:41.389576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:41.389581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600720583194374:4066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:41.390085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600720583194374:4066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:41.390938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:41.391234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:41.391243Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:41.391245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:41.391248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:41.391252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 272 [2:7559600719800984664:3539]
2025-10-10T14:31:41.391272Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:41.391287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:41.391289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.391292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.391294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.391309Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:41.391321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:41.391343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:41.391390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.391395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.391396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.391398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:41.391443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:41.391448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.391455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.391465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.391485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:41.391503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194309:2438], now have 1 active actors on pipe
2025-10-10T14:31:41.391513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600719800984659:3539]
2025-10-10T14:31:41.391518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600719800984659:3539]
2025-10-10T14:31:41.391520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600719800984659:3539]
2025-10-10T14:31:41.391553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 272
2025-10-10T14:31:41.391529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:41.391541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:41.391541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:41.391543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:41.391545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:41.391554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:41.391557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:41.391577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600719800984659:3539]
2025-10-10T14:31:41.391580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:41.391582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:41.391648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600720583194374:4066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:41.397302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600720583194374:4066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:41.397313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600720583194374:4066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:41.397316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600720583194374:4066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:41.397323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:41.397522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194408:4066], now have 1 active actors on pipe
2025-10-10T14:31:41.397566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 272
2025-10-10T14:31:41.397616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.397637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.397662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:41.397674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.397677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.397681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:41.397690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.397704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:41.397717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.397836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.397844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.397855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.397944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 273 partition: 0 MaxSeqNo: 40 sessionId: src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0
2025-10-10T14:31:41.398221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b763c91a-a5b55c3a-374b15e0-52756f99_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:41.400672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0] Write session: try to update token
2025-10-10T14:31:41.400685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:41.408838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:41.408854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.408857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:41.408858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:41.408865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600719800984659:3539]
2025-10-10T14:31:41.408869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600719800984659:3539]
2025-10-10T14:31:41.408875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600719800984659:3539]
2025-10-10T14:31:41.408909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:41.408918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.408918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:41.408919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:41.408923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:41.408926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:41.409302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:41.414928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId: src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:41.417254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:41.479103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600720583194412:3658]
2025-10-10T14:31:41.479482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 272, pipe: [1:7559600720583194412:3658]
2025-10-10T14:31:41.512830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:41.513112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.513125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.513146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194412:3658], now have 1 active actors on pipe
2025-10-10T14:31:41.513345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:41.513422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:41.513430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600720583194412:3658]
2025-10-10T14:31:41.513465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:41.513539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0
2025-10-10T14:31:41.513753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 273 sessionId: src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0 is DEAD
2025-10-10T14:31:41.513907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:41.513920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0] Write session will restart in 0.009132s
2025-10-10T14:31:41.513957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0] Write session: Do CDS request
2025-10-10T14:31:41.513963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:41.521807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:41.523321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:41.523511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:41.523520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:41.523531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:41.523576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:41.523619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600719800984766:3541]
2025-10-10T14:31:41.523885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.523991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:41.524003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 274
2025-10-10T14:31:41.524063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:41.524098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.524121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:41.524129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:41.524132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:41.524382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:41.524436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:41.524520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 274 sessionId:  describe result for acl check
2025-10-10T14:31:41.524557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:41.524562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:41.524564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:41.524570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600720583194478:4070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:41.524747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:41.524796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.524801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.524802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.524803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.524803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.524804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.524805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.524805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.524806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.524807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.524808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.524808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.524809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.524814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.524821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.524823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.524826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.524829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.524831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.524834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.524836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.524838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.524841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.524843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.524845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.524847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.524853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.524859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.524863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.524868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.524871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.524874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.524876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.524880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.524882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.524885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.524888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.524891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.524893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.524896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.524899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.524902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.524912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.524919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.524922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.524928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.524936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.524946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.524953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.524957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.524959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.524962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.524984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:41.525134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600720583194478:4070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:41.526987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600720583194478:4070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:41.528058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:41.528370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:41.528382Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:41.528383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:41.528386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:41.528391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 273 [2:7559600719800984766:3541]
2025-10-10T14:31:41.528400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:41.528415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:41.528416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.528419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.528420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.528434Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:41.528440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:41.528446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:41.528487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.528493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.528494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.528496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:41.528563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:41.528570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.528578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.528584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.528598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:41.528617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194413:2438], now have 1 active actors on pipe
2025-10-10T14:31:41.528626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600719800984761:3541]
2025-10-10T14:31:41.528628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600719800984761:3541]
2025-10-10T14:31:41.528629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600719800984761:3541]
2025-10-10T14:31:41.528639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:41.528653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:41.528659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:41.528662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:41.528664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:41.528665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:41.528668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:41.528680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 273
2025-10-10T14:31:41.528693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600719800984761:3541]
2025-10-10T14:31:41.528701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:41.528716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:41.529962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600720583194478:4070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:41.529973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600720583194478:4070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:41.529977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600720583194478:4070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:41.529986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:41.530222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194517:4070], now have 1 active actors on pipe
2025-10-10T14:31:41.530267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 273
2025-10-10T14:31:41.530336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.530355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.530390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:41.530405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.530410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.530412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:41.530425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.530453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:41.530470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.530665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.530672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.530688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.530772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 274 partition: 0 MaxSeqNo: 40 sessionId: src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0
2025-10-10T14:31:41.531143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14cf17e6-3839406e-a3ef9e0b-8a7b0980_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:41.533783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0] Write session: try to update token
2025-10-10T14:31:41.533802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:41.545821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:41.545840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.545852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600719800984761:3541]
2025-10-10T14:31:41.545902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:41.545905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:41.546089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:41.546245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.546400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.546544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.546754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:41.546806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:41.548908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId: src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:41.551410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:41.551733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.551757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.551798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:41.551875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:41.556912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:41.556927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.556930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:41.556931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:41.556940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600719800984761:3541]
2025-10-10T14:31:41.556943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600719800984761:3541]
2025-10-10T14:31:41.556946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600719800984761:3541]
2025-10-10T14:31:41.556987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:41.556990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:41.556992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:41.556997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:41.556998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.557000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:41.557155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:41.613723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600720583194531:3658]
2025-10-10T14:31:41.613918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 273, pipe: [1:7559600720583194531:3658]
2025-10-10T14:31:41.662374Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:41.668586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.668612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.668769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.668827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.668895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.668955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.668996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.669004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.669064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.669122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.669177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.669239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.669279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.669284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.669364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.669427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.669490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.669553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.669593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.669598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.669659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.669717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.669772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.669828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.669868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.669873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.669932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.669983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.670039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.670097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.670147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.670155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.670217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.670270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.670323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.670393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.670448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.670453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.670511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.670563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.670617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.670675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.670714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.670720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.670776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.670830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.670884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.670939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.670978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.670983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.671038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.671090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.671145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.671201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.671240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.671245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.671301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.671353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.671407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.671460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.671498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.671503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.671545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194531:3658], now have 1 active actors on pipe
2025-10-10T14:31:41.671752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:41.671761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:41.671762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:41.671787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 274 reason: error at write: Disconnected sessionId: src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0
2025-10-10T14:31:41.671797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600720583194531:3658]
2025-10-10T14:31:41.671990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 274 sessionId: src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0 is DEAD
2025-10-10T14:31:41.672112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:41.672124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0] Write session will restart in 0.007902s
2025-10-10T14:31:41.672149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0] Write session: Do CDS request
2025-10-10T14:31:41.672155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:41.672171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:41.680067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:41.680860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.680939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:41.680954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 275
2025-10-10T14:31:41.681095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.681137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:41.681147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:41.681151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:41.681507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 275 sessionId:  describe result for acl check
2025-10-10T14:31:41.681535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:41.681540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:41.681543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:41.681547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600720583194597:4076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:41.681575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:41.681741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:41.681750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:41.681758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:41.681798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:41.681829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600719800984871:3544]
2025-10-10T14:31:41.681971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600720583194597:4076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:41.682264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:41.682589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:41.682634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:41.682941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:41.682989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.682993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.682994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.682995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.682995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.682996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.682996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.682997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.682998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.682998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.682999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.682999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.683000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.683004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.683011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.683014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.683016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.683018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.683021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.683023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.683025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.683027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.683030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.683032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.683034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.683036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.683041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.683046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.683052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.683055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.683057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.683060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.683063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.683066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.683069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.683073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.683077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.683082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.683086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.683091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.683095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.683100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.683105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.683110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.683114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.683120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.683125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.683130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.683134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.683139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.683145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.683150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.683190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:41.684296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600720583194597:4076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:41.685298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:41.685589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:41.685604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:41.685606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:41.685608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:41.685612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 274 [2:7559600719800984871:3544]
2025-10-10T14:31:41.685620Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:41.685631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:41.685633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.685635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.685637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.685649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:41.685655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:41.685660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:41.685695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.685700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.685701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.685703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:41.685749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:41.685755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.685762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.685772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.685792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:41.685814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194533:2438], now have 1 active actors on pipe
2025-10-10T14:31:41.685826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600719800984866:3544]
2025-10-10T14:31:41.685829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600719800984866:3544]
2025-10-10T14:31:41.685831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600719800984866:3544]
2025-10-10T14:31:41.685843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:41.685855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:41.685859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:41.685873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:41.685874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:41.685875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:41.685864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 274
2025-10-10T14:31:41.685876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:41.685895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600719800984866:3544]
2025-10-10T14:31:41.685903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:41.685904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:41.690867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600720583194597:4076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:41.690881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600720583194597:4076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:41.690884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600720583194597:4076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:41.690893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:41.691097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194635:4076], now have 1 active actors on pipe
2025-10-10T14:31:41.691146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 274
2025-10-10T14:31:41.691220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.691235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.691261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:41.691273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.691277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.691281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:41.691290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.691305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:41.691316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.691454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.691462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.691475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.691532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 275 partition: 0 MaxSeqNo: 40 sessionId: src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0
2025-10-10T14:31:41.691951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d355899-66cc83c-8690f1f9-6c3e72a5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:41.694607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0] Write session: try to update token
2025-10-10T14:31:41.694624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:41.697050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:41.697063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.697070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600719800984866:3544]
2025-10-10T14:31:41.697102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:41.697104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:41.697255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:41.697395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.697517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.697642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.697821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:41.697858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:41.708824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId: src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:41.711070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:41.711234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.711256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.711290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:41.711391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:41.713891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:41.713906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.713908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:41.713912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:41.713920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600719800984866:3544]
2025-10-10T14:31:41.713923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600719800984866:3544]
2025-10-10T14:31:41.713928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600719800984866:3544]
2025-10-10T14:31:41.713963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:41.713965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:41.713971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:41.713973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.713974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:41.713974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:41.714086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:41.771973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600720583194651:3658]
2025-10-10T14:31:41.772265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 274, pipe: [1:7559600720583194651:3658]
2025-10-10T14:31:41.815683Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:41.822304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.822336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.822497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.822555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.822615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.822670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.822713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.822723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.822795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.822850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.822908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.823047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.823088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.823094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.823153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.823207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.823270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.823327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.823366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.823371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.823429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.823489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.823549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.823602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.823642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.823647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.823709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.823770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.823825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.823878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.823916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.823921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.823980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.824037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.824090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.824143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.824185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.824190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.824250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.824316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.824371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.824427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.824468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.824474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.824540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.824595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.824649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.824705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.824743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.824749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.824812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.824866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.824921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.824981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.825024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.825031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.825096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:41.825149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:41.825203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:41.825257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:41.825302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:41.825309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:41.825361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194651:3658], now have 1 active actors on pipe
2025-10-10T14:31:41.825619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:41.825619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600720583194651:3658]
2025-10-10T14:31:41.825629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:41.825636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:41.825653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 275 reason: error at write: Disconnected sessionId: src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0
2025-10-10T14:31:41.825869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 275 sessionId: src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0 is DEAD
2025-10-10T14:31:41.826088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:41.826099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0] Write session will restart in 0.009583s
2025-10-10T14:31:41.826124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0] Write session: Do CDS request
2025-10-10T14:31:41.826102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:41.826131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:41.834052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:41.835688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:41.835865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:41.835876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:41.835884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:41.835930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:41.835972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600719800985013:3559]
2025-10-10T14:31:41.836375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:41.836630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:41.836659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:41.836862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.836863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:41.836898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.836903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.836903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.836904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.836904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.836905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.836906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.836906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.836907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.836908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.836909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.836909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.836910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.836913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.836922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.836925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.836913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:41.836929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.836933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.836924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 276
2025-10-10T14:31:41.836936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.836939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.836943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.836946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.836950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.836954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.836958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.836961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.836967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.836972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.836976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.836980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.836982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.836985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.836988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.836991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.836994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.836997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.837002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.837007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.837011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.837016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.837020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.837026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.837030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.837035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.837039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.837043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.837046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.837049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.837051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.837054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.837057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.837061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.837082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:41.837372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.837399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:41.837404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:41.837407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:41.837695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 276 sessionId:  describe result for acl check
2025-10-10T14:31:41.837720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:41.837721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:41.837722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:41.837726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600720583194734:4089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:41.838134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600720583194734:4089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:41.839264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:41.839603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:41.839615Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:41.839617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:41.839621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:41.839628Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 275 [2:7559600719800985013:3559]
2025-10-10T14:31:41.839640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:41.839654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:41.839656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.839659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.839661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.839673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:41.839680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:41.839688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:41.839737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.839745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.839747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.839749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:41.839923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 275
2025-10-10T14:31:41.839810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:41.839816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.839827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.839836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.839852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:41.839873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194664:2438], now have 1 active actors on pipe
2025-10-10T14:31:41.839880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600719800985008:3559]
2025-10-10T14:31:41.839882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600719800985008:3559]
2025-10-10T14:31:41.839883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600719800985008:3559]
2025-10-10T14:31:41.839898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:41.839913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:41.839914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:41.839918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:41.839920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:41.839928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:41.839931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:41.839952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600719800985008:3559]
2025-10-10T14:31:41.839955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:41.839958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:41.840593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600720583194734:4089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:41.844326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600720583194734:4089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:41.844336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600720583194734:4089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:41.844339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600720583194734:4089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:41.844345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:41.844547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194771:4089], now have 1 active actors on pipe
2025-10-10T14:31:41.844607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 275
2025-10-10T14:31:41.844663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.844673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.844698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:41.844713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.844720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.844722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:41.844734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.844747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:41.844761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.844913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.844922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.844936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.845025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 276 partition: 0 MaxSeqNo: 40 sessionId: src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0
2025-10-10T14:31:41.845347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|501473d-48c8e6e2-8493a8b-9719c5d7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:41.847827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0] Write session: try to update token
2025-10-10T14:31:41.847842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:41.858236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:41.858253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.858255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:41.858256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:41.858264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600719800985008:3559]
2025-10-10T14:31:41.858267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600719800985008:3559]
2025-10-10T14:31:41.858270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600719800985008:3559]
2025-10-10T14:31:41.858310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:41.858316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.858318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:41.858323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:41.858343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:41.858347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:41.858466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:41.861572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId: src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:41.863956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:41.925586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600720583194774:3658]
2025-10-10T14:31:41.925858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 275, pipe: [1:7559600720583194774:3658]
2025-10-10T14:31:41.961081Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:41.961429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.961443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.961479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194774:3658], now have 1 active actors on pipe
2025-10-10T14:31:41.961672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:41.961791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600720583194774:3658]
2025-10-10T14:31:41.961822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:41.961883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:41.961948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 276 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0
2025-10-10T14:31:41.962142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 276 sessionId: src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0 is DEAD
2025-10-10T14:31:41.962277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:41.962286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0] Write session will restart in 0.007308s
2025-10-10T14:31:41.962304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0] Write session: Do CDS request
2025-10-10T14:31:41.962309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:41.969964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:41.970855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.970930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:41.970943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 277
2025-10-10T14:31:41.971073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:41.971100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:41.971106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:41.971110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:41.971389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:41.971536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 277 sessionId:  describe result for acl check
2025-10-10T14:31:41.971574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:41.971580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:41.971582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:41.971588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600720583194843:4093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:41.971565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:41.971577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:41.971589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:41.971649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:41.971687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600719800985117:3561]
2025-10-10T14:31:41.972112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600720583194843:4093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:41.972332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:41.972589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:41.972636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:41.972954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:41.973017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.973024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.973025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.973026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.973027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.973029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.973030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.973031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.973032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.973033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.973035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.973036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.973037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.973042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.973054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.973058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.973063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.973066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.973071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.973075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.973079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.973083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.973088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.973092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.973095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.973100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.973106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.973118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:41.973130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.973136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:41.973145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.973151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:41.973160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.973166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:41.973173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.973179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:41.973189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.973197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:41.973202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.973207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:41.973216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.973223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:41.973233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.973238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:41.973247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.973257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:41.973265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.973275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.973284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.973294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.973303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.973309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.973367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:41.974077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600720583194843:4093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:41.975506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:41.975932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:41.975946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:41.975948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:41.975951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:41.975956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 276 [2:7559600719800985117:3561]
2025-10-10T14:31:41.975968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:41.975983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:41.975988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.975992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.975995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.976011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:41.976023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:41.976034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:41.976085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.976093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.976095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.976098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:41.976158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:41.976166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:41.976179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:41.976195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:41.976218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:41.976218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 276
2025-10-10T14:31:41.976244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194775:2438], now have 1 active actors on pipe
2025-10-10T14:31:41.976257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600719800985112:3561]
2025-10-10T14:31:41.976259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600719800985112:3561]
2025-10-10T14:31:41.976261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600719800985112:3561]
2025-10-10T14:31:41.976270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:41.976280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:41.976283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:41.976284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:41.976285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:41.976301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:41.976305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:41.976281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600720583194843:4093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:41.976294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600720583194843:4093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:41.976331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600719800985112:3561]
2025-10-10T14:31:41.976297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600720583194843:4093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:41.976304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:41.976345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:41.976351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:41.976448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600720583194877:4093], now have 1 active actors on pipe
2025-10-10T14:31:41.976475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 276
2025-10-10T14:31:41.976530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.976540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.976567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:41.976581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:41.976589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:41.976592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:41.976603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:41.976619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:41.976638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.976781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.976786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.976802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:41.976871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 277 partition: 0 MaxSeqNo: 40 sessionId: src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0
2025-10-10T14:31:41.977144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29bd26c2-66e12bd-ce02b2cf-2b0ac9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:41.979661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0] Write session: try to update token
2025-10-10T14:31:41.979675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:41.987375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:41.987394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:41.987404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600719800985112:3561]
2025-10-10T14:31:41.987441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:41.987454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:41.987606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:41.987739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.987870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.988003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:41.988173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:41.988211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:41.992907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId: src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:41.995294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:41.995459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:41.995482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:41.995521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:41.995614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:42.004649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:42.004670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.004674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:42.004676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:42.004687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600719800985112:3561]
2025-10-10T14:31:42.004691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600719800985112:3561]
2025-10-10T14:31:42.004696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600719800985112:3561]
2025-10-10T14:31:42.004740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:42.004743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:42.004751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.004752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:42.004755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:42.004756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:42.004877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:42.061766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600724878162180:3658]
2025-10-10T14:31:42.062023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 276, pipe: [1:7559600724878162180:3658]
2025-10-10T14:31:42.114127Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:42.120664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.120689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.120842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.120898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.120953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.121010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.121117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.121126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.121184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.121240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.121299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.121371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.121411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.121417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.121480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.121535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.121591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.121649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.121690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.121697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.121755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.121810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.121865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.121919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.122002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.122007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.122068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.122122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.122190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.122249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.122288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.122294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.122367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.122430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.122492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.122550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.122590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.122597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.122656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.122708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.122764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.122819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.122862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.122867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.122927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.122979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.123036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.123091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.123130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.123134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.123193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.123253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.123312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.123368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.123406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.123411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.123471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.123524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.123578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.123633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.123676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.123684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.123722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162180:3658], now have 1 active actors on pipe
2025-10-10T14:31:42.123948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600724878162180:3658]
2025-10-10T14:31:42.124035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:42.124041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:42.124063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:42.124067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 277 reason: error at write: Disconnected sessionId: src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0
2025-10-10T14:31:42.124283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 277 sessionId: src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0 is DEAD
2025-10-10T14:31:42.124415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:42.124426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0] Write session will restart in 0.007518s
2025-10-10T14:31:42.124418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:42.124452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0] Write session: Do CDS request
2025-10-10T14:31:42.124458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:42.132855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.132856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:42.132924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:42.132934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 278
2025-10-10T14:31:42.133091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.133125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:42.133132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:42.133136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:42.133513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 278 sessionId:  describe result for acl check
2025-10-10T14:31:42.133548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:42.133550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:42.133552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:42.133558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600724878162260:4098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:42.133986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600724878162260:4098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:42.134323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:42.134505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:42.134513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:42.134522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:42.134560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:42.134600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600724095952531:3564]
2025-10-10T14:31:42.134961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:42.135205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:42.135246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:42.135479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:42.135521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.135525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.135526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.135527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.135527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.135528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.135528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.135529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.135530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.135530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.135531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.135531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.135532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.135536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.135543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.135546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.135548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.135550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.135552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.135554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.135557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.135559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.135561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.135563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.135565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.135567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.135572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.135578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.135582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.135585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.135589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.135592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.135594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.135597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.135600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.135603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.135605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.135608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.135610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.135613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.135616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.135619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.135621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.135624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.135627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.135630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.135632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.135635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.135638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.135641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.135644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.135647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.135670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:42.135746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600724878162260:4098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:42.137661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:42.137959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:42.137969Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:42.137973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:42.137975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:42.137979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 277 [2:7559600724095952531:3564]
2025-10-10T14:31:42.137988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:42.138002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:42.138004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.138018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.138020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.138036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:42.138048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:42.138058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:42.138057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600724878162260:4098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:42.138067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600724878162260:4098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:42.138077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600724878162260:4098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:42.138082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:42.138098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.138104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.138105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.138107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:42.138151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:42.138156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.138163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.138173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.138186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:42.138205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162193:2438], now have 1 active actors on pipe
2025-10-10T14:31:42.138215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600724095952526:3564]
2025-10-10T14:31:42.138218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600724095952526:3564]
2025-10-10T14:31:42.138219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600724095952526:3564]
2025-10-10T14:31:42.138219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 277
2025-10-10T14:31:42.138230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:42.138236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:42.138239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:42.138239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162294:4098], now have 1 active actors on pipe
2025-10-10T14:31:42.138240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:42.138239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 277
2025-10-10T14:31:42.138246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:42.138255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:42.138257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:42.138296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.138305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.138316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600724095952526:3564]
2025-10-10T14:31:42.138326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:42.138354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:42.138362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|950de8b0-7e68bf17-e93aead9-74f65971_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:42.138368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.138371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.138373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:42.138381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.138393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:42.138412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.138548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.138556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.138568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.138627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 278 partition: 0 MaxSeqNo: 40 sessionId: src_id|950de8b0-7e68bf17-e93aead9-74f65971_0
2025-10-10T14:31:42.138898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f76ffe5-343d0cc2-902a0343-fddf4bad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|950de8b0-7e68bf17-e93aead9-74f65971_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:42.141432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950de8b0-7e68bf17-e93aead9-74f65971_0] Write session: try to update token
2025-10-10T14:31:42.141448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950de8b0-7e68bf17-e93aead9-74f65971_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:42.155509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId: src_id|950de8b0-7e68bf17-e93aead9-74f65971_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:42.156283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:42.156299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.156302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:42.156303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:42.156310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600724095952526:3564]
2025-10-10T14:31:42.156313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600724095952526:3564]
2025-10-10T14:31:42.156316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600724095952526:3564]
2025-10-10T14:31:42.156356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:42.156362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.156364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:42.156355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:42.156384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:42.156386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:42.156489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:42.159092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:42.224070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600724878162302:3658]
2025-10-10T14:31:42.224344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 277, pipe: [1:7559600724878162302:3658]
2025-10-10T14:31:42.259096Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:42.259333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.259346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.259387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162302:3658], now have 1 active actors on pipe
2025-10-10T14:31:42.259579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:42.259682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:42.259684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:42.259692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:42.259723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600724878162302:3658]
2025-10-10T14:31:42.259770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 278 reason: error at write: Disconnected sessionId: src_id|950de8b0-7e68bf17-e93aead9-74f65971_0
2025-10-10T14:31:42.259971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 278 sessionId: src_id|950de8b0-7e68bf17-e93aead9-74f65971_0 is DEAD
2025-10-10T14:31:42.260107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950de8b0-7e68bf17-e93aead9-74f65971_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:42.260117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950de8b0-7e68bf17-e93aead9-74f65971_0] Write session will restart in 0.006915s
2025-10-10T14:31:42.260139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950de8b0-7e68bf17-e93aead9-74f65971_0] Write session: Do CDS request
2025-10-10T14:31:42.260145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950de8b0-7e68bf17-e93aead9-74f65971_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:42.267616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:42.267924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950de8b0-7e68bf17-e93aead9-74f65971_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.267996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:42.268008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 279
2025-10-10T14:31:42.268160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.268202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:42.268211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:42.268215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:42.268588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 279 sessionId:  describe result for acl check
2025-10-10T14:31:42.268615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:42.268618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:42.268620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:42.268626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600724878162371:4102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:42.269061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600724878162371:4102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:42.269204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:42.269362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:42.269371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:42.269382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:42.269425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:42.269455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600724095952637:3566]
2025-10-10T14:31:42.269881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:42.270186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:42.270230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:42.270504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:42.270547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.270551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.270552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.270553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.270553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.270554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.270554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.270555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.270556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.270556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.270557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.270557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.270558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.270562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.270569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.270571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.270574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.270576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.270578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.270580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.270582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.270585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.270587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.270589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.270592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.270594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.270598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.270604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.270609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.270612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.270614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.270617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.270620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.270623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.270626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.270629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.270633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.270636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.270640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.270642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.270645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.270648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.270650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.270653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.270656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.270666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.270669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.270672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.270675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.270678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.270680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.270683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.270706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:42.271158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600724878162371:4102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:42.272872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:42.273166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:42.273176Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:42.273177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:42.273180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:42.273185Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 278 [2:7559600724095952637:3566]
2025-10-10T14:31:42.273193Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:42.273206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:42.273201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600724878162371:4102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:42.273208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.273211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.273212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.273211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600724878162371:4102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:42.273225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:42.273214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600724878162371:4102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:42.273230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:42.273235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:42.273236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:42.273275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.273280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.273281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.273283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:42.273354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:42.273365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.273376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.273387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.273400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:42.273423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600724095952632:3566]
2025-10-10T14:31:42.273425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600724095952632:3566]
2025-10-10T14:31:42.273426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600724095952632:3566]
2025-10-10T14:31:42.273433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:42.273443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:42.273443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:42.273445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:42.273447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:42.273452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:42.273454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:42.273464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162303:2438], now have 1 active actors on pipe
2025-10-10T14:31:42.273466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162405:4102], now have 1 active actors on pipe
2025-10-10T14:31:42.273482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600724095952632:3566]
2025-10-10T14:31:42.273488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:42.273510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 278
2025-10-10T14:31:42.273522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:42.273515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 278
2025-10-10T14:31:42.273601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.273608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.273629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:42.273639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.273641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.273643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:42.273651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.273661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:42.273676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.273815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.273838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.273862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.273955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 279 partition: 0 MaxSeqNo: 40 sessionId: src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0
2025-10-10T14:31:42.274287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950de8b0-7e68bf17-e93aead9-74f65971_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:42.276964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0] Write session: try to update token
2025-10-10T14:31:42.276986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:42.290690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:42.290711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.290723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600724095952632:3566]
2025-10-10T14:31:42.290766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:42.290777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:42.290950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:42.291092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.291229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.291324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId: src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:42.291381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.291586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:42.291631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:42.294246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:42.294451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.294467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.294502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:42.294612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:42.302161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:42.302177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.302179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:42.302181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:42.302190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600724095952632:3566]
2025-10-10T14:31:42.302193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600724095952632:3566]
2025-10-10T14:31:42.302196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600724095952632:3566]
2025-10-10T14:31:42.302231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:42.302238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.302240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:42.302242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:42.302247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:42.302251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:42.302387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:42.359758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600724878162413:3658]
2025-10-10T14:31:42.360054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 278, pipe: [1:7559600724878162413:3658]
2025-10-10T14:31:42.407926Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:42.414453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.414478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.414637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.414696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.414754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.414812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.414857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.414869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.414943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.415000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.415056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.415116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.415156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.415163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.415222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.415276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.415336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.415395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.415434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.415439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.415497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.415556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.415611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.415667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.415704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.415709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.415764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.415818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.415874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.415931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.415971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.415976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.416031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.416084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.416144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.416200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.416240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.416245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.416304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.416357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.416414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.416471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.416510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.416515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.416573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.416641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.416702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.416762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.416802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.416808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.416866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.416922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.416978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.417036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.417084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.417091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.417159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:42.417212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:42.417266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:42.417322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:42.417375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:42.417380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:42.417422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162413:3658], now have 1 active actors on pipe
2025-10-10T14:31:42.417658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:42.417680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:42.417684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:42.417709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600724878162413:3658]
2025-10-10T14:31:42.417717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 279 reason: error at write: Disconnected sessionId: src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0
2025-10-10T14:31:42.417960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 279 sessionId: src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0 is DEAD
2025-10-10T14:31:42.418101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:42.418114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0] Write session will restart in 0.006898s
2025-10-10T14:31:42.418140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0] Write session: Do CDS request
2025-10-10T14:31:42.418147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:42.418178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:42.425873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.425930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:42.425943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 280
2025-10-10T14:31:42.426096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.426136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:42.426145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:42.426151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:42.426608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 280 sessionId:  describe result for acl check
2025-10-10T14:31:42.426645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:42.426652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:42.426654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:42.426660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600724878162482:4106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:42.426697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:42.427160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600724878162482:4106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:42.428156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:42.428329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:42.428341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:42.428352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:42.428400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:42.428436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600724095952745:3568]
2025-10-10T14:31:42.429013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:42.429288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:42.429343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:42.429528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600724878162482:4106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:42.429658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:42.429711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.429717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.429718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.429719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.429720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.429721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.429723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.429724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.429725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.429727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.429728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.429729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.429730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.429736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.429748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.429752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.429756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.429760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.429764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.429768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.429772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.429776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.429780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.429784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.429787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.429791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.429797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.429806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.429813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.429818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.429822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.429827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.429831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.429838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.429843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.429848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.429853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.429858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.429863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.429868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.429872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.429877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.429882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.429891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.429895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.429900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.429906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.429912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.429918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.429924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.429930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.429935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.429972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:42.432168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600724878162482:4106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:42.432182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600724878162482:4106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:42.432185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600724878162482:4106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:42.432193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:42.432204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:42.432493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:42.432503Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:42.432505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:42.432508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:42.432513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 279 [2:7559600724095952745:3568]
2025-10-10T14:31:42.432522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:42.432536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:42.432538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.432540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.432542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.432556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:42.432566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:42.432573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:42.432631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.432638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.432639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.432641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:42.432697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:42.432703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.432711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.432717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.432728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:42.432752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162517:4106], now have 1 active actors on pipe
2025-10-10T14:31:42.432758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162414:2438], now have 1 active actors on pipe
2025-10-10T14:31:42.432765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600724095952740:3568]
2025-10-10T14:31:42.432766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600724095952740:3568]
2025-10-10T14:31:42.432767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600724095952740:3568]
2025-10-10T14:31:42.432777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:42.432787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:42.432797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:42.432801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:42.432802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:42.432805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:42.432807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:42.432821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600724095952740:3568]
2025-10-10T14:31:42.432823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:42.432825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:42.432836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 279
2025-10-10T14:31:42.432839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 279
2025-10-10T14:31:42.432913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.432919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.432943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:42.432952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.432955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.432956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:42.432965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.432977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:42.432992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.433139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.433146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.433159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.433231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 280 partition: 0 MaxSeqNo: 40 sessionId: src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0
2025-10-10T14:31:42.433662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48218d4-c9e6e7cb-f813312-1efe2df1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:42.436304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0] Write session: try to update token
2025-10-10T14:31:42.436322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:42.451049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:42.451072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.451075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:42.451077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:42.451086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600724095952740:3568]
2025-10-10T14:31:42.451091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600724095952740:3568]
2025-10-10T14:31:42.451095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600724095952740:3568]
2025-10-10T14:31:42.451096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId: src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:42.451139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:42.451149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:42.451152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.451155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:42.451162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:42.451167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:42.451295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:42.453667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:42.517955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600724878162525:3658]
2025-10-10T14:31:42.518216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 279, pipe: [1:7559600724878162525:3658]
2025-10-10T14:31:42.556872Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:42.557094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.557109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.557149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162525:3658], now have 1 active actors on pipe
2025-10-10T14:31:42.557377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600724878162525:3658]
2025-10-10T14:31:42.557395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:42.557400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:42.557405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:42.557476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 280 reason: error at write: Disconnected sessionId: src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0
2025-10-10T14:31:42.557621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:42.557699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 280 sessionId: src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0 is DEAD
2025-10-10T14:31:42.557795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:42.557803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0] Write session will restart in 0.009750s
2025-10-10T14:31:42.557828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0] Write session: Do CDS request
2025-10-10T14:31:42.557833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:42.565440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:42.566967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:42.567147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:42.567158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:42.567169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:42.567226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:42.567265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600724095952854:3570]
2025-10-10T14:31:42.567842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:42.568114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:42.568156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:42.568445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:42.568497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.568502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.568503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.568504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.568504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.568505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.568506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.568506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.568507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.568507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.568508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.568508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.568509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.568513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.568522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.568524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.568526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.568528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.568531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.568533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.568535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.568537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.568540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.568542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.568544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.568546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.568552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.568557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.568562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.568565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.568567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.568570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.568573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.568576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.568578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.568581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.568583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.568586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.568589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.568592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.568594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.568597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.568600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.568603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.568605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.568608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.568611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.568614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.568616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.568621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.568623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.568626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.568650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:42.568856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.568979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:42.568993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 281
2025-10-10T14:31:42.569126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.569163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:42.569173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:42.569177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:42.569618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 281 sessionId:  describe result for acl check
2025-10-10T14:31:42.569655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:42.569662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:42.569664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:42.569670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600724878162608:4112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:42.570200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600724878162608:4112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:42.570869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:42.571165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:42.571175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:42.571178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:42.571181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:42.571186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 280 [2:7559600724095952854:3570]
2025-10-10T14:31:42.571194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:42.571206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:42.571209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.571212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.571214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.571230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:42.571242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:42.571249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:42.571293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.571299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.571300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.571301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:42.571350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:42.571355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.571362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.571369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.571378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:42.571403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600724095952849:3570]
2025-10-10T14:31:42.571408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600724095952849:3570]
2025-10-10T14:31:42.571410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600724095952849:3570]
2025-10-10T14:31:42.571417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:42.571428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:42.571436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:42.571440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:42.571440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:42.571442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:42.571442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:42.571450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162533:2438], now have 1 active actors on pipe
2025-10-10T14:31:42.571468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600724095952849:3570]
2025-10-10T14:31:42.571476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:42.571478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:42.571478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 280
2025-10-10T14:31:42.572026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600724878162608:4112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:42.577931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600724878162608:4112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:42.577946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600724878162608:4112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:42.577950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600724878162608:4112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:42.577958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:42.578188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162641:4112], now have 1 active actors on pipe
2025-10-10T14:31:42.578267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 280
2025-10-10T14:31:42.578313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.578325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.578381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:42.578400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.578407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.578410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:42.578425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.578449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:42.578472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.578672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.578683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.578700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.578781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 281 partition: 0 MaxSeqNo: 40 sessionId: src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0
2025-10-10T14:31:42.579152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39eec6f7-f92184c1-3fd20d38-d7c3487b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:42.581774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0] Write session: try to update token
2025-10-10T14:31:42.581789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:42.582417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:42.582434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.582443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600724095952849:3570]
2025-10-10T14:31:42.582487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:42.582498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:42.582658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:42.582788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.582913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.583050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.583239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:42.583277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:42.595899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId: src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:42.598577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:42.599864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.599885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.599904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:42.599907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.599909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:42.599910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:42.599916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600724095952849:3570]
2025-10-10T14:31:42.599919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600724095952849:3570]
2025-10-10T14:31:42.599921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600724095952849:3570]
2025-10-10T14:31:42.599953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:42.599963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:42.599968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:42.599969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.599970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:42.599970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:42.600085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:42.657735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600724878162648:3658]
2025-10-10T14:31:42.657981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 280, pipe: [1:7559600724878162648:3658]
2025-10-10T14:31:42.701898Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:42.702230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:42.702263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162648:3658], now have 1 active actors on pipe
2025-10-10T14:31:42.702364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:42.702453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600724878162648:3658]
2025-10-10T14:31:42.702482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:42.710869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:42.710879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:42.710900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 281 reason: error at write: Disconnected sessionId: src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0
2025-10-10T14:31:42.711044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 281 sessionId: src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0 is DEAD
2025-10-10T14:31:42.711164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:42.711176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0] Write session will restart in 0.009633s
2025-10-10T14:31:42.711199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0] Write session: Do CDS request
2025-10-10T14:31:42.711205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:42.715980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:42.717566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:42.717752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:42.717762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:42.717775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:42.717823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:42.717868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600724095952967:3573]
2025-10-10T14:31:42.718506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:42.718747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:42.718792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:42.719113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:42.719176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.719182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.719183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.719185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.719186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.719187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.719188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.719189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.719190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.719191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.719193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.719194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.719195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.719200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.719214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.719217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.719220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.719223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.719225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.719227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.719229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.719231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.719234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.719236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.719238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.719240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.719247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.719255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.719262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.719268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.719272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.719276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.719278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.719282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.719287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.719292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.719296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.719301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.719306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.719311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.719316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.719320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.719323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.719326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.719329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.719332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.719334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.719337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.719340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.719343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.719346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.719349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.719386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:42.721541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:42.721872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:42.721885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:42.721887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:42.721890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:42.721896Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 281 [2:7559600724095952967:3573]
2025-10-10T14:31:42.721907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:42.721924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:42.721927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.721930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.721932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.721949Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:42.721957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.721959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:42.721966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:42.722023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.722030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.722032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.722035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:42.722030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:42.722043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 282
2025-10-10T14:31:42.722107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:42.722116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.722129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.722139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.722159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:42.722184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162649:2438], now have 1 active actors on pipe
2025-10-10T14:31:42.722197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600724095952962:3573]
2025-10-10T14:31:42.722199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600724095952962:3573]
2025-10-10T14:31:42.722202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600724095952962:3573]
2025-10-10T14:31:42.722217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:42.722233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:42.722212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.722235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:42.722216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 281
2025-10-10T14:31:42.722243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:42.722244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:42.722250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:42.722253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:42.722274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:42.722283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:42.722287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:42.722281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600724095952962:3573]
2025-10-10T14:31:42.722293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:42.722297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:42.722710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 282 sessionId:  describe result for acl check
2025-10-10T14:31:42.722747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:42.722753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:42.722755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:42.722770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600724878162727:4116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:42.723315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600724878162727:4116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:42.725118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600724878162727:4116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:42.730394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600724878162727:4116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:42.730408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600724878162727:4116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:42.730412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600724878162727:4116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:42.730420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:42.730736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162758:4116], now have 1 active actors on pipe
2025-10-10T14:31:42.730785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 281
2025-10-10T14:31:42.730858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.730870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.730902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:42.730918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.730928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.730930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:42.730944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.730960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:42.730983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.731134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.731147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.731168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.731251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 282 partition: 0 MaxSeqNo: 40 sessionId: src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0
2025-10-10T14:31:42.731588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77b1d87a-3f17fa35-9b0fa78c-97458432_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:42.732901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:42.732914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.732921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600724095952962:3573]
2025-10-10T14:31:42.732963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:42.732969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:42.733116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:42.733246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.733382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.733518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:42.733704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:42.733739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:42.734149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0] Write session: try to update token
2025-10-10T14:31:42.734163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:42.747725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId: src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:42.749908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:42.749928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.749931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:42.749933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:42.749941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600724095952962:3573]
2025-10-10T14:31:42.749945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600724095952962:3573]
2025-10-10T14:31:42.749948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600724095952962:3573]
2025-10-10T14:31:42.749986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:42.749988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:42.749991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:42.749994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.749995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:42.749995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:42.750140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:42.750428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:42.802580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600724878162775:3658]
2025-10-10T14:31:42.802788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 281, pipe: [1:7559600724878162775:3658]
2025-10-10T14:31:42.857907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:42.858245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.858263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.858283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162775:3658], now have 1 active actors on pipe
2025-10-10T14:31:42.858447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:42.858530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:42.858539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600724878162775:3658]
2025-10-10T14:31:42.858560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:42.858629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 282 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0
2025-10-10T14:31:42.858811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 282 sessionId: src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0 is DEAD
2025-10-10T14:31:42.858973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:42.858985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0] Write session will restart in 0.006272s
2025-10-10T14:31:42.859009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0] Write session: Do CDS request
2025-10-10T14:31:42.859015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:42.866300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:42.866788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.866881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:42.866893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 283
2025-10-10T14:31:42.866983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:42.867016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:42.867027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:42.867030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:42.867437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 283 sessionId:  describe result for acl check
2025-10-10T14:31:42.867468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:42.867470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:42.867472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:42.867477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600724878162859:4129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:42.867873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:42.867994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600724878162859:4129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:42.868071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:42.868082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:42.868093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:42.868154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:42.868195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600724095953115:3588]
2025-10-10T14:31:42.868595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:42.868845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:42.868887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:42.869191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:42.869257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.869263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.869264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.869265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.869266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.869267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.869268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.869269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.869270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.869270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.869271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.869272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.869273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.869278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.869289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.869293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.869297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.869301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.869304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.869307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.869310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.869313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.869317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.869320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.869323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.869326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.869349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.869357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:42.869362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.869367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:42.869371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.869375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:42.869379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.869383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:42.869387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.869391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:42.869395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.869399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:42.869403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.869407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:42.869411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.869415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:42.869420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.869425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:42.869429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.869439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:42.869443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.869451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.869455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.869463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.869466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.869475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.869517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:42.870144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600724878162859:4129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:42.871634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:42.872054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:42.872068Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:42.872070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:42.872073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:42.872079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 282 [2:7559600724095953115:3588]
2025-10-10T14:31:42.872090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:42.872105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:42.872108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.872111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.872114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.872130Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:42.872144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:42.872155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:42.872217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.872225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.872226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.872229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:42.872230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600724878162859:4129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:42.872239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600724878162859:4129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:42.872242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600724878162859:4129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:42.872258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:42.872289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:42.872297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.872307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:42.872324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:42.872338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:42.872354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 282
2025-10-10T14:31:42.872363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162787:2438], now have 1 active actors on pipe
2025-10-10T14:31:42.872374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600724095953110:3588]
2025-10-10T14:31:42.872376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600724095953110:3588]
2025-10-10T14:31:42.872378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600724095953110:3588]
2025-10-10T14:31:42.872386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:42.872400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:42.872410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:42.872411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:42.872412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:42.872421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:42.872423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:42.872435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162893:4129], now have 1 active actors on pipe
2025-10-10T14:31:42.872451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600724095953110:3588]
2025-10-10T14:31:42.872463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:42.872472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:42.872487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 282
2025-10-10T14:31:42.872554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.872561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.872582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f992833-e23d7669-525fa11b-bdd43f31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:42.872593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:42.872596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:42.872598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:42.872605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:42.872617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:42.872629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.872814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.872828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.872853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:42.872945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 283 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f992833-e23d7669-525fa11b-bdd43f31_0
2025-10-10T14:31:42.873203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71391c64-82bee63f-2cc23b81-57ba9da8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f992833-e23d7669-525fa11b-bdd43f31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:42.875736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f992833-e23d7669-525fa11b-bdd43f31_0] Write session: try to update token
2025-10-10T14:31:42.875748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f992833-e23d7669-525fa11b-bdd43f31_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:42.889508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId: src_id|7f992833-e23d7669-525fa11b-bdd43f31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:42.890624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:42.890642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:42.890645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:42.890646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:42.890654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600724095953110:3588]
2025-10-10T14:31:42.890658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600724095953110:3588]
2025-10-10T14:31:42.890660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600724095953110:3588]
2025-10-10T14:31:42.890704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:42.890717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:42.890719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:42.890849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:42.890909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:42.890929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:42.890933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:42.892143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:42.958779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600724878162900:3658]
2025-10-10T14:31:42.958971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 282, pipe: [1:7559600724878162900:3658]
2025-10-10T14:31:42.994223Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:42.994550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:42.994566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:42.994605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162900:3658], now have 1 active actors on pipe
2025-10-10T14:31:42.994764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:42.994848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:42.994851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:42.994862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:42.994885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600724878162900:3658]
2025-10-10T14:31:42.994921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 283 reason: error at write: Disconnected sessionId: src_id|7f992833-e23d7669-525fa11b-bdd43f31_0
2025-10-10T14:31:42.995130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 283 sessionId: src_id|7f992833-e23d7669-525fa11b-bdd43f31_0 is DEAD
2025-10-10T14:31:42.995316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f992833-e23d7669-525fa11b-bdd43f31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:42.995328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f992833-e23d7669-525fa11b-bdd43f31_0] Write session will restart in 0.009820s
2025-10-10T14:31:42.995354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f992833-e23d7669-525fa11b-bdd43f31_0] Write session: Do CDS request
2025-10-10T14:31:42.995359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f992833-e23d7669-525fa11b-bdd43f31_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:43.002821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:43.004135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:43.004302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.004311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:43.004320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:43.004359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:43.004388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600728390920522:3590]
2025-10-10T14:31:43.004910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:43.005151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:43.005186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:43.005488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:43.005540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.005546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.005547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.005548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.005549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.005550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.005551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.005552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.005553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.005554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.005555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.005556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.005557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.005563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.005575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.005579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.005583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.005587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.005591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.005595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.005599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.005603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.005611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.005615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.005621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.005625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.005631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.005639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.005649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.005654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.005658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.005667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.005676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.005681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.005689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.005694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.005698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.005707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.005711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.005720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.005728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.005733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.005737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.005743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.005751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.005756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.005765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.005771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.005779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.005784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.005792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.005799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.005842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:43.006892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f992833-e23d7669-525fa11b-bdd43f31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.006977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:43.006991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 284
2025-10-10T14:31:43.007106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.007135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:43.007144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:43.007149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:43.007533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 284 sessionId:  describe result for acl check
2025-10-10T14:31:43.007565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:43.007567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:43.007568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:43.007574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600729173130276:4133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:43.007877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:43.008081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600729173130276:4133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:43.008187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:43.008197Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:43.008199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:43.008202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:43.008276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 283 [2:7559600728390920522:3590]
2025-10-10T14:31:43.008293Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:43.008308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:43.008311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.008314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.008317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.008332Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:43.008343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:43.008356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:43.008411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.008417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.008420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.008422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:43.008479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:43.008488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.008505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.008517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.008538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:43.008535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 283
2025-10-10T14:31:43.008562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600724878162902:2438], now have 1 active actors on pipe
2025-10-10T14:31:43.008574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600728390920517:3590]
2025-10-10T14:31:43.008576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600728390920517:3590]
2025-10-10T14:31:43.008578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600728390920517:3590]
2025-10-10T14:31:43.008585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:43.008601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:43.008606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:43.008609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:43.008611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:43.008622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:43.008629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:43.008655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600728390920517:3590]
2025-10-10T14:31:43.008665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:43.008669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:43.009801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600729173130276:4133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:43.014527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600729173130276:4133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:43.014540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600729173130276:4133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:43.014544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600729173130276:4133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:43.014552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:43.014782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130309:4133], now have 1 active actors on pipe
2025-10-10T14:31:43.014827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 283
2025-10-10T14:31:43.014886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.014907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.014944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:43.014962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.014972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.014977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:43.014989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.015003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:43.015018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.015160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.015166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.015177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.015253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 284 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0
2025-10-10T14:31:43.015590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f992833-e23d7669-525fa11b-bdd43f31_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:43.018083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0] Write session: try to update token
2025-10-10T14:31:43.018101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:43.026448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:43.026469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.026471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:43.026472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:43.026481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600728390920517:3590]
2025-10-10T14:31:43.026486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600728390920517:3590]
2025-10-10T14:31:43.026489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600728390920517:3590]
2025-10-10T14:31:43.026530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:43.026541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:43.026543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:43.026546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.026548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:43.026548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:43.026665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:43.032706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId: src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:43.035312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:43.094922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600729173130324:3658]
2025-10-10T14:31:43.095134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 283, pipe: [1:7559600729173130324:3658]
2025-10-10T14:31:43.130979Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:43.131222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.131234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.131253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130324:3658], now have 1 active actors on pipe
2025-10-10T14:31:43.131432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:43.131489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:43.131505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:43.131552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600729173130324:3658]
2025-10-10T14:31:43.131576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 284 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0
2025-10-10T14:31:43.131788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 284 sessionId: src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0 is DEAD
2025-10-10T14:31:43.131965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:43.131975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0] Write session will restart in 0.007932s
2025-10-10T14:31:43.131994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0] Write session: Do CDS request
2025-10-10T14:31:43.131999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:43.139817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:43.140777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.140934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:43.140948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 285
2025-10-10T14:31:43.141109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.141145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:43.141154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:43.141158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:43.141501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:43.141621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 285 sessionId:  describe result for acl check
2025-10-10T14:31:43.141651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.141659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:43.141660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:43.141668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:43.141668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:43.141670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:43.141676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600729173130400:4138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:43.141704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:43.141734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600728390920645:3593]
2025-10-10T14:31:43.142224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:43.142215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600729173130400:4138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:43.142540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:43.142588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:43.142854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:43.142896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.142901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.142902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.142902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.142903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.142904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.142904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.142905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.142905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.142906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.142907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.142907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.142908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.142912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.142919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.142922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.142924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.142926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.142928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.142930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.142932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.142934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.142937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.142939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.142941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.142943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.142947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.142953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.142965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.142969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.142971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.142974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.142977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.142980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.142983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.142986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.142988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.142992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.142996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.142999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.143001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.143006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.143008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.143011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.143014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.143017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.143020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.143023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.143025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.143028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.143031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.143034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.143056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:43.143886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600729173130400:4138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:43.145152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:43.145560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:43.145570Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:43.145572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:43.145575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:43.145579Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 284 [2:7559600728390920645:3593]
2025-10-10T14:31:43.145597Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:43.145608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:43.145614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.145615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.145616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.145625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:43.145631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:43.145636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:43.145688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.145695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.145696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.145697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:43.145753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:43.145759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.145767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.145773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.145783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:43.145803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130325:2438], now have 1 active actors on pipe
2025-10-10T14:31:43.145812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600728390920640:3593]
2025-10-10T14:31:43.145816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600728390920640:3593]
2025-10-10T14:31:43.145818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600728390920640:3593]
2025-10-10T14:31:43.145831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:43.145848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:43.145850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:43.145856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:43.145858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:43.145848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 284
2025-10-10T14:31:43.145869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:43.145874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:43.145898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600728390920640:3593]
2025-10-10T14:31:43.145903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:43.145911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:43.146271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600729173130400:4138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:43.146282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600729173130400:4138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:43.146286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600729173130400:4138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:43.146293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:43.146484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130436:4138], now have 1 active actors on pipe
2025-10-10T14:31:43.146538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 284
2025-10-10T14:31:43.146605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.146620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.146647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7329d11a-9bfae57-ead6ea8d-83264895_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:43.146661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.146669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.146671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:43.146680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.146693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:43.146705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.146862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.146869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.146882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.146951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 285 partition: 0 MaxSeqNo: 40 sessionId: src_id|7329d11a-9bfae57-ead6ea8d-83264895_0
2025-10-10T14:31:43.147229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2e32eb-eec9a842-94f82b11-7050d29c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7329d11a-9bfae57-ead6ea8d-83264895_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:43.149900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7329d11a-9bfae57-ead6ea8d-83264895_0] Write session: try to update token
2025-10-10T14:31:43.149917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7329d11a-9bfae57-ead6ea8d-83264895_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:43.163076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:43.163094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.163107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600728390920640:3593]
2025-10-10T14:31:43.163155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:43.163159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:43.163319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:43.163459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.163599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.163744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.163928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:43.163961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:43.165343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId: src_id|7329d11a-9bfae57-ead6ea8d-83264895_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:43.167927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:43.168173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.168186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.168231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:43.168334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:43.173779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:43.173790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.173792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:43.173794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:43.173803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600728390920640:3593]
2025-10-10T14:31:43.173807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600728390920640:3593]
2025-10-10T14:31:43.173813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600728390920640:3593]
2025-10-10T14:31:43.173855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:43.173859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:43.173866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.173869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:43.173875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:43.173880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:43.173993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:43.231685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600729173130441:3658]
2025-10-10T14:31:43.231914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 284, pipe: [1:7559600729173130441:3658]
2025-10-10T14:31:43.281735Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:43.288776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.288801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.288977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.289042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.289109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.289169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.289210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.289217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.289284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.289363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.289434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.289502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.289552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.289561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.289629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.289686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.289742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.289804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.289852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.289860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.289926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.289987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.290049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.290112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.290157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.290165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.290235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.290311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.290387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.290452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.290556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.290564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.290634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.290695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.290758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.290825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.290869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.290876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.290941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.291000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.291065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.291125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.291169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.291176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.291242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.291299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.291363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.291424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.291471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.291480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.291550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.291621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.291690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.291758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.291805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.291812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.291880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.291942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.292005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.292068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.292108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.292117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.292177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130441:3658], now have 1 active actors on pipe
2025-10-10T14:31:43.292446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600729173130441:3658]
2025-10-10T14:31:43.292446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:43.292449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:43.292475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 285 reason: error at write: Disconnected sessionId: src_id|7329d11a-9bfae57-ead6ea8d-83264895_0
2025-10-10T14:31:43.292475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:43.292672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 285 sessionId: src_id|7329d11a-9bfae57-ead6ea8d-83264895_0 is DEAD
2025-10-10T14:31:43.292827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7329d11a-9bfae57-ead6ea8d-83264895_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:43.292839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7329d11a-9bfae57-ead6ea8d-83264895_0] Write session will restart in 0.006169s
2025-10-10T14:31:43.292865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7329d11a-9bfae57-ead6ea8d-83264895_0] Write session: Do CDS request
2025-10-10T14:31:43.292872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7329d11a-9bfae57-ead6ea8d-83264895_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:43.292907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:43.299890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7329d11a-9bfae57-ead6ea8d-83264895_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.299946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:43.299958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 286
2025-10-10T14:31:43.300106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.300156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:43.300167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:43.300172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:43.300603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 286 sessionId:  describe result for acl check
2025-10-10T14:31:43.300642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:43.300648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:43.300650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:43.300656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600729173130514:4142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:43.301172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600729173130514:4142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:43.301519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:43.303005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:43.303203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.303211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:43.303222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:43.303265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:43.303303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600728390920758:3595]
2025-10-10T14:31:43.303697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:43.303859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600729173130514:4142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:43.303912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:43.303941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:43.304144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:43.304185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.304188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.304189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.304190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.304190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.304191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.304192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.304192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.304193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.304193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.304194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.304195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.304195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.304199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.304207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.304209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.304211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.304213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.304216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.304218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.304220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.304222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.304225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.304227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.304229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.304231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.304236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.304242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.304246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.304250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.304253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.304256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.304259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.304262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.304265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.304267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.304270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.304273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.304275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.304279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.304281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.304284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.304286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.304289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.304292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.304295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.304297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.304300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.304302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.304305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.304308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.304311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.304332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:43.306364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:43.306500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600729173130514:4142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:43.306513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600729173130514:4142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:43.306516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600729173130514:4142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:43.306523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:43.306720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:43.306736Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:43.306738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:43.306740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:43.306744Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 285 [2:7559600728390920758:3595]
2025-10-10T14:31:43.306753Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:43.306763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:43.306766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.306768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.306770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.306789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:43.306797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:43.306803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:43.306840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.306845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.306846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.306847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:43.306893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:43.306898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.306905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.306911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.306934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:43.306957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130442:2438], now have 1 active actors on pipe
2025-10-10T14:31:43.306960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130552:4142], now have 1 active actors on pipe
2025-10-10T14:31:43.306967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600728390920753:3595]
2025-10-10T14:31:43.306973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600728390920753:3595]
2025-10-10T14:31:43.306975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600728390920753:3595]
2025-10-10T14:31:43.306986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:43.306995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:43.307000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:43.307003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:43.307005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:43.307008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:43.307010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:43.307024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600728390920753:3595]
2025-10-10T14:31:43.307010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 285
2025-10-10T14:31:43.307030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:43.307035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:43.307022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 285
2025-10-10T14:31:43.307047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.307053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.307080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:43.307088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.307091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.307092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:43.307100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.307107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:43.307132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.307270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.307281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.307302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.307386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 286 partition: 0 MaxSeqNo: 40 sessionId: src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0
2025-10-10T14:31:43.307664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7329d11a-9bfae57-ead6ea8d-83264895_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:43.310275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0] Write session: try to update token
2025-10-10T14:31:43.310291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:43.324011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId: src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:43.325174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:43.325188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.325190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:43.325192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:43.325198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600728390920753:3595]
2025-10-10T14:31:43.325202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600728390920753:3595]
2025-10-10T14:31:43.325205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600728390920753:3595]
2025-10-10T14:31:43.325243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:43.325243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:43.325248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.325248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:43.325249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:43.325252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:43.325403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:43.326667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:43.392445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600729173130559:3658]
2025-10-10T14:31:43.392673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 285, pipe: [1:7559600729173130559:3658]
2025-10-10T14:31:43.429679Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:43.429908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.429933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.429980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130559:3658], now have 1 active actors on pipe
2025-10-10T14:31:43.430192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:43.430221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600729173130559:3658]
2025-10-10T14:31:43.430250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:43.430260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:43.430314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 286 reason: error at write: Disconnected sessionId: src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0
2025-10-10T14:31:43.430502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 286 sessionId: src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0 is DEAD
2025-10-10T14:31:43.430661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:43.430672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0] Write session will restart in 0.006175s
2025-10-10T14:31:43.430652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:43.430698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0] Write session: Do CDS request
2025-10-10T14:31:43.430707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:43.437880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.437928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:43.437942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 287
2025-10-10T14:31:43.438119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.438155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:43.438161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:43.438169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:43.438610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 287 sessionId:  describe result for acl check
2025-10-10T14:31:43.438647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:43.438651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:43.438653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:43.438659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600729173130634:4146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:43.439074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:43.439231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600729173130634:4146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:43.440644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:43.440798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.440806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:43.440814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:43.440851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:43.440881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600728390920872:3597]
2025-10-10T14:31:43.441244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:43.441425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600729173130634:4146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:43.441502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:43.441531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:43.441737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:43.441770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.441774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.441774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.441775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.441776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.441776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.441777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.441778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.441778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.441779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.441779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.441780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.441781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.441784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.441792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.441794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.441797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.441799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.441801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.441804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.441806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.441808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.441811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.441813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.441815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.441817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.441823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.441828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.441833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.441836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.441839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.441842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.441845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.441848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.441851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.441854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.441856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.441859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.441862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.441865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.441868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.441871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.441874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.441877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.441879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.441890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.441893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.441896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.441898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.441901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.441904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.441907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.441929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:43.443926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600729173130634:4146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:43.443941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600729173130634:4146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:43.443945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600729173130634:4146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:43.443953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:43.443950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:43.444284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:43.444292Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:43.444293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:43.444296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:43.444300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 286 [2:7559600728390920872:3597]
2025-10-10T14:31:43.444308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:43.444321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:43.444323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.444326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.444328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.444340Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:43.444349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:43.444355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:43.444395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.444400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.444401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.444403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:43.444465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:43.444470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.444477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.444483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.444495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:43.444514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130560:2438], now have 1 active actors on pipe
2025-10-10T14:31:43.444522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130670:4146], now have 1 active actors on pipe
2025-10-10T14:31:43.444527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600728390920867:3597]
2025-10-10T14:31:43.444528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600728390920867:3597]
2025-10-10T14:31:43.444529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600728390920867:3597]
2025-10-10T14:31:43.444539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:43.444548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:43.444550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:43.444553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:43.444554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:43.444558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:43.444560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:43.444576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600728390920867:3597]
2025-10-10T14:31:43.444586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:43.444575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 286
2025-10-10T14:31:43.444584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 286
2025-10-10T14:31:43.444594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:43.444622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.444629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.444659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:43.444667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.444670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.444671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:43.444679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.444687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:43.444697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.444809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.444813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.444825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.444915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 287 partition: 0 MaxSeqNo: 40 sessionId: src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0
2025-10-10T14:31:43.445198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a504e043-90ec1ee7-4cd676dc-25e0efb0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:43.447706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0] Write session: try to update token
2025-10-10T14:31:43.447720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:43.455150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:43.455165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.455173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600728390920867:3597]
2025-10-10T14:31:43.455212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:43.455214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:43.455368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:43.455501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.455633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.455761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.455960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:43.455992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:43.461998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId: src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:43.464413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:43.464576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.464592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.464625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:43.464692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:43.471961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:43.471975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.471977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:43.471979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:43.471987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600728390920867:3597]
2025-10-10T14:31:43.471990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600728390920867:3597]
2025-10-10T14:31:43.471993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600728390920867:3597]
2025-10-10T14:31:43.472026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:43.472028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:43.472031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:43.472033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:43.472033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.472035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:43.472162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:43.530183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600729173130679:3658]
2025-10-10T14:31:43.530478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 286, pipe: [1:7559600729173130679:3658]
2025-10-10T14:31:43.574815Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:43.581247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.581268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.581427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.581483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.581541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.581598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.581985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.581996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.582059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.582116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.582171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.582236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.582277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.582282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.582364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.582422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.582480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.582539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.582579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.582584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.582643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.582698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.582754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.582812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.582857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.582863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.582921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.582983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.583046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.583102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.583156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.583163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.583223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.583274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.583331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.583386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.583427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.583432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.583489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.583544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.583604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.583660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.583699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.583707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.583763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.583816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.583871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.583937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.583978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.583984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.584047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.584110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.584166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.584222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.584263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.584269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.584330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.584382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.584437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.584492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.584533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.584538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.584576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130679:3658], now have 1 active actors on pipe
2025-10-10T14:31:43.584890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:43.584895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:43.584900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:43.584930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 287 reason: error at write: Disconnected sessionId: src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0
2025-10-10T14:31:43.584949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600729173130679:3658]
2025-10-10T14:31:43.585017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:43.585090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 287 sessionId: src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0 is DEAD
2025-10-10T14:31:43.585225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:43.585234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0] Write session will restart in 0.005672s
2025-10-10T14:31:43.585253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0] Write session: Do CDS request
2025-10-10T14:31:43.585257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:43.591825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.591944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:43.591960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 288
2025-10-10T14:31:43.592080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.592115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:43.592124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:43.592128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:43.592510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 288 sessionId:  describe result for acl check
2025-10-10T14:31:43.592539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:43.592543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:43.592545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:43.592549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600729173130761:4152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:43.593006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600729173130761:4152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:43.593601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:43.595348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:43.595466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600729173130761:4152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:43.595524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.595536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:43.595549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:43.595603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:43.595644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600728390920989:3600]
2025-10-10T14:31:43.596131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:43.596386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:43.596416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:43.596629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:43.596666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.596671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.596671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.596672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.596673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.596673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.596674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.596675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.596675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.596676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.596677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.596677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.596678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.596681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.596690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.596692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.596694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.596696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.596698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.596701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.596703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.596705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.596707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.596709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.596713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.596717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.596723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.596730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.596737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.596743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.596746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.596749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.596752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.596755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.596759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.596762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.596764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.596767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.596770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.596772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.596775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.596778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.596780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.596783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.596786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.596789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.596791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.596794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.596796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.596799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.596802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.596805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.596826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:43.598837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600729173130761:4152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:43.598848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600729173130761:4152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:43.598851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600729173130761:4152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:43.598865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:43.598916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:43.599226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:43.599237Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:43.599239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:43.599243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:43.599248Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 287 [2:7559600728390920989:3600]
2025-10-10T14:31:43.599260Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:43.599277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:43.599280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.599284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.599290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.599307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:43.599322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:43.599330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:43.599392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.599399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.599401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.599403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:43.599465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:43.599472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.599483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.599498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.599519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:43.599543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130687:2438], now have 1 active actors on pipe
2025-10-10T14:31:43.599550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130797:4152], now have 1 active actors on pipe
2025-10-10T14:31:43.599557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600728390920984:3600]
2025-10-10T14:31:43.599563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600728390920984:3600]
2025-10-10T14:31:43.599565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600728390920984:3600]
2025-10-10T14:31:43.599578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:43.599561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 287
2025-10-10T14:31:43.599584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:43.599586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:43.599573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 287
2025-10-10T14:31:43.599587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:43.599603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:43.599620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:43.599627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:43.599660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.599668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.599686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600728390920984:3600]
2025-10-10T14:31:43.599697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:43.599711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:43.599730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc989bde-2900b243-f62e54ad-a0245f16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:43.599741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.599748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.599750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:43.599760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.599773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:43.599800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.599923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.599930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.599944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.600031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 288 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc989bde-2900b243-f62e54ad-a0245f16_0
2025-10-10T14:31:43.600384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9488b9f-4c096b05-eedc00fa-bbca4340_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc989bde-2900b243-f62e54ad-a0245f16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:43.603185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc989bde-2900b243-f62e54ad-a0245f16_0] Write session: try to update token
2025-10-10T14:31:43.603205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc989bde-2900b243-f62e54ad-a0245f16_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:43.617253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:43.617268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.617270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:43.617271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:43.617279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600728390920984:3600]
2025-10-10T14:31:43.617282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600728390920984:3600]
2025-10-10T14:31:43.617285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600728390920984:3600]
2025-10-10T14:31:43.617325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:43.617343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:43.617349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:43.617350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.617353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:43.617354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:43.617437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId: src_id|cc989bde-2900b243-f62e54ad-a0245f16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:43.617576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:43.619825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:43.685358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600729173130809:3658]
2025-10-10T14:31:43.685636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 287, pipe: [1:7559600729173130809:3658]
2025-10-10T14:31:43.717746Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:43.718024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.718037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.718075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130809:3658], now have 1 active actors on pipe
2025-10-10T14:31:43.718234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:43.718295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:43.718296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600729173130809:3658]
2025-10-10T14:31:43.718319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:43.718385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc989bde-2900b243-f62e54ad-a0245f16_0
2025-10-10T14:31:43.718574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 288 sessionId: src_id|cc989bde-2900b243-f62e54ad-a0245f16_0 is DEAD
2025-10-10T14:31:43.718697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc989bde-2900b243-f62e54ad-a0245f16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:43.718713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc989bde-2900b243-f62e54ad-a0245f16_0] Write session will restart in 0.009971s
2025-10-10T14:31:43.718733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc989bde-2900b243-f62e54ad-a0245f16_0] Write session: Do CDS request
2025-10-10T14:31:43.718737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc989bde-2900b243-f62e54ad-a0245f16_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:43.726066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:43.727512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:43.727692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.727703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:43.727714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:43.727765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:43.727806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600728390921106:3602]
2025-10-10T14:31:43.728236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:43.728469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:43.728508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:43.728752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:43.728805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.728810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.728811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.728812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.728813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.728815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.728816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.728817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.728818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.728819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.728820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.728821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.728823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.728828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.728842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.728847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.728851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.728855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.728859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.728864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.728868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.728872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.728877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.728881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.728884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.728891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.728899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.728911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.728920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.728930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.728935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.728944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.728949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.728957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.728962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.728971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.728975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.728980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.728985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.728994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.728998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.729007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.729013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.729021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.729026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.729035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.729039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.729048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.729053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.729062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.729066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.729074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.729113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:43.729768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc989bde-2900b243-f62e54ad-a0245f16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.729859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:43.729874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 289
2025-10-10T14:31:43.730014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.730053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:43.730059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:43.730064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:43.730426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 289 sessionId:  describe result for acl check
2025-10-10T14:31:43.730459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:43.730461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:43.730462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:43.730468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600729173130893:4156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:43.731008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600729173130893:4156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:43.731065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:43.731464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:43.731474Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:43.731476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:43.731479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:43.731484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 288 [2:7559600728390921106:3602]
2025-10-10T14:31:43.731495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:43.731510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:43.731518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.731521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.731523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.731537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:43.731558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:43.731569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:43.731614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.731620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.731622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.731624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:43.731681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:43.731688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.731699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.731715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.731736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:43.731728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 288
2025-10-10T14:31:43.731759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130810:2438], now have 1 active actors on pipe
2025-10-10T14:31:43.731769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600728390921101:3602]
2025-10-10T14:31:43.731774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600728390921101:3602]
2025-10-10T14:31:43.731776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600728390921101:3602]
2025-10-10T14:31:43.731785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:43.731794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:43.731799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:43.731802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:43.731804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:43.731815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:43.731818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:43.731843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600728390921101:3602]
2025-10-10T14:31:43.731853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:43.731856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:43.732716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600729173130893:4156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:43.737940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600729173130893:4156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:43.737949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600729173130893:4156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:43.737952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600729173130893:4156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:43.737958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:43.738149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130926:4156], now have 1 active actors on pipe
2025-10-10T14:31:43.738255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 288
2025-10-10T14:31:43.738316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.738324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.738356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:43.738369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.738376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.738378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:43.738388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.738400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:43.738416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.738562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.738567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.738578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.738651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 289 partition: 0 MaxSeqNo: 40 sessionId: src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0
2025-10-10T14:31:43.738969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc989bde-2900b243-f62e54ad-a0245f16_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:43.741531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0] Write session: try to update token
2025-10-10T14:31:43.741544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:43.748091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:43.748107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.748117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600728390921101:3602]
2025-10-10T14:31:43.748156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:43.748168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:43.748325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:43.748461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.748589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.748721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.748905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:43.748942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:43.754906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId: src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:43.757456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:43.757609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.757632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.757664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:43.757764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:43.759317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:43.759330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.759333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:43.759335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:43.759344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600728390921101:3602]
2025-10-10T14:31:43.759346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600728390921101:3602]
2025-10-10T14:31:43.759351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600728390921101:3602]
2025-10-10T14:31:43.759383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:43.759384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:43.759390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.759391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:43.759399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:43.759402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:43.759513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:43.818451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600729173130930:3658]
2025-10-10T14:31:43.818634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 288, pipe: [1:7559600729173130930:3658]
2025-10-10T14:31:43.861798Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:43.868449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.868467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.868614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.868672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.868728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.868786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.868826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.868832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.868893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.868946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.869012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.869073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.869116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.869123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.869188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.869242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.869301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.869371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.869420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.869432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.869498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.869556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.869610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.869667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.869707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.869712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.869769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.869826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.869885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.869937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.869974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.869979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.870038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.870099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.870156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.870211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.870310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.870315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.870389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.870441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.870497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.870551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.870591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.870598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.870659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.870711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.870764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.870816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.870858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.870866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.870927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.870979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.871033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.871085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.871128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.871136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.871193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:43.871243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:43.871295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:43.871346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:43.871391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:43.871398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:43.871437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130930:3658], now have 1 active actors on pipe
2025-10-10T14:31:43.871656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:43.871695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600729173130930:3658]
2025-10-10T14:31:43.871726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:43.871733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:43.871757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 289 reason: error at write: Disconnected sessionId: src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0
2025-10-10T14:31:43.871959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 289 sessionId: src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0 is DEAD
2025-10-10T14:31:43.872103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:43.872113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0] Write session will restart in 0.007762s
2025-10-10T14:31:43.872134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0] Write session: Do CDS request
2025-10-10T14:31:43.872140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:43.872245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:43.880098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:43.880836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.880891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:43.880904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 290
2025-10-10T14:31:43.881058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:43.881093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:43.881102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:43.881106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:43.881529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 290 sessionId:  describe result for acl check
2025-10-10T14:31:43.881559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:43.881567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:43.881569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:43.881574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600729173131037:4169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:43.881646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:43.881790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:43.881799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:43.881807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:43.881842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:43.881875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600728390921262:3615]
2025-10-10T14:31:43.882057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600729173131037:4169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:43.882246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:43.882487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:43.882516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:43.882713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:43.882743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.882748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.882748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.882749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.882749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.882750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.882751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.882751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.882752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.882752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.882753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.882753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.882754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.882757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.882764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.882767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.882769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.882772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.882774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.882776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.882780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.882783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.882787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.882790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.882794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.882797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.882804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.882811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:43.882817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.882823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:43.882827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.882832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:43.882834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.882837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:43.882839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.882842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:43.882844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.882847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:43.882850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.882853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:43.882855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.882858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:43.882860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.882863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:43.882865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.882868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:43.882871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.882874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.882876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.882879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.882883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.882886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.882907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:43.883502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600729173131037:4169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:43.884967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:43.885266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:43.885273Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:43.885275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:43.885277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:43.885281Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 289 [2:7559600728390921262:3615]
2025-10-10T14:31:43.885288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:43.885299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:43.885300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.885303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.885304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.885315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:43.885324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:43.885346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:43.885383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.885388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.885389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.885391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:43.885434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:43.885441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.885447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:43.885453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:43.885462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:43.885478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600728390921257:3615]
2025-10-10T14:31:43.885480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600728390921257:3615]
2025-10-10T14:31:43.885482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600728390921257:3615]
2025-10-10T14:31:43.885490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:43.885499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:43.885501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:43.885503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:43.885485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600729173131037:4169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:43.885504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173130944:2438], now have 1 active actors on pipe
2025-10-10T14:31:43.885496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600729173131037:4169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:43.885510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:43.885500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600729173131037:4169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:43.885525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:43.885505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:43.885528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:43.885544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600728390921257:3615]
2025-10-10T14:31:43.885544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 289
2025-10-10T14:31:43.885551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:43.885571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:43.885673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173131068:4169], now have 1 active actors on pipe
2025-10-10T14:31:43.885709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 289
2025-10-10T14:31:43.885747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.885754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.885777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a4c5d78-362be753-6d749069-d8748af5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:43.885782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:43.885789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:43.885790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:43.885798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:43.885809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:43.885822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.885968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.885977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.885995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:43.886063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 290 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a4c5d78-362be753-6d749069-d8748af5_0
2025-10-10T14:31:43.886307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420d335a-a65f0b4-cfb915d0-a3e27348_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a4c5d78-362be753-6d749069-d8748af5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:43.889009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4c5d78-362be753-6d749069-d8748af5_0] Write session: try to update token
2025-10-10T14:31:43.889028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4c5d78-362be753-6d749069-d8748af5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:43.896456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:43.896473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.896481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600728390921257:3615]
2025-10-10T14:31:43.896528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:43.896531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:43.896704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:43.896830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.896955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.897083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:43.897260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:43.897293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:43.902754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId: src_id|9a4c5d78-362be753-6d749069-d8748af5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:43.904945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:43.905127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:43.905146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:43.905180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:43.905375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:43.913238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:43.913251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:43.913253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:43.913255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:43.913262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600728390921257:3615]
2025-10-10T14:31:43.913265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600728390921257:3615]
2025-10-10T14:31:43.913268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600728390921257:3615]
2025-10-10T14:31:43.913300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:43.913304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:43.913305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:43.913308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:43.913309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:43.913311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:43.913445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:43.972030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600729173131076:3658]
2025-10-10T14:31:43.972374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 289, pipe: [1:7559600729173131076:3658]
2025-10-10T14:31:44.023109Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:44.029470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.029492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.029639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.029695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.029751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.029811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.029853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.029860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.029920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.029988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.030054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.030114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.030155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.030161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.030220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.030279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.030336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.030411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.030505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.030513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.030573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.030629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.030689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.030750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.030799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.030805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.030865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.030921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.030980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.031041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.031082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.031088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.031148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.031203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.031262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.031321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.031364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.031371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.031433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.031487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.031543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.031597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.031637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.031642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.031701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.031759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.031826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.031894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.031934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.031941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.032001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.032053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.032106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.032161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.032200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.032211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.032283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.032347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.032413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.032481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.032524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.032530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.032577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600729173131076:3658], now have 1 active actors on pipe
2025-10-10T14:31:44.032791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600729173131076:3658]
2025-10-10T14:31:44.032797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:44.032801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:44.032817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:44.032830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 290 reason: error at write: Disconnected sessionId: src_id|9a4c5d78-362be753-6d749069-d8748af5_0
2025-10-10T14:31:44.033062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 290 sessionId: src_id|9a4c5d78-362be753-6d749069-d8748af5_0 is DEAD
2025-10-10T14:31:44.033220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4c5d78-362be753-6d749069-d8748af5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:44.033233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4c5d78-362be753-6d749069-d8748af5_0] Write session will restart in 0.009941s
2025-10-10T14:31:44.033258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4c5d78-362be753-6d749069-d8748af5_0] Write session: Do CDS request
2025-10-10T14:31:44.033265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4c5d78-362be753-6d749069-d8748af5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:44.033353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:44.042444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:44.044070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:44.044275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:44.044287Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:44.044299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:44.044348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:44.044389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600732685888677:3619]
2025-10-10T14:31:44.044815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4c5d78-362be753-6d749069-d8748af5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.044948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.044961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 291
2025-10-10T14:31:44.045009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:44.045073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.045098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:44.045105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.045108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.045269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:44.045311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:44.045427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 291 sessionId:  describe result for acl check
2025-10-10T14:31:44.045457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.045459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.045644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:44.045460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.045464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600733468098457:4173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.045698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.045705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.045706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.045707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.045708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.045709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.045710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.045712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.045713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.045714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.045715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.045716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.045718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.045724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.045735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.045739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.045744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.045747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.045751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.045755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.045759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.045763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.045768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.045771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.045776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.045780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.045786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.045794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.045801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.045806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.045811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.045816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.045820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.045826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.045830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.045842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.045846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.045851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.045856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.045865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.045870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.045859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600733468098457:4173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.045876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.045884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.045890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.045894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.045904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.045908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.045914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.045922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.045928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.045937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.045942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.045989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:44.047677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600733468098457:4173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.048113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:44.048574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:44.048586Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:44.048589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:44.048592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:44.048597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 290 [2:7559600732685888677:3619]
2025-10-10T14:31:44.048608Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:44.048625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:44.048632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.048635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.048637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.048651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:44.048663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:44.048676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:44.048724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.048731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.048733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.048735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:44.048796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:44.048803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.048814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.048826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.048848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:44.048873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098373:2438], now have 1 active actors on pipe
2025-10-10T14:31:44.048884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600732685888672:3619]
2025-10-10T14:31:44.048888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600732685888672:3619]
2025-10-10T14:31:44.048890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600732685888672:3619]
2025-10-10T14:31:44.048903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:44.048920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:44.048927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:44.048930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:44.048932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:44.048940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:44.048928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 290
2025-10-10T14:31:44.048943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:44.048967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600732685888672:3619]
2025-10-10T14:31:44.048974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:44.048983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:44.053659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600733468098457:4173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.053678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600733468098457:4173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:44.053681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600733468098457:4173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.053688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.053935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098492:4173], now have 1 active actors on pipe
2025-10-10T14:31:44.053969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 290
2025-10-10T14:31:44.054045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.054056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.054088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|826fb023-c5c6103b-2f191640-38be8288_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:44.054105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.054115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.054118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.054131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.054150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.054170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.054364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.054372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.054385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.054479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 291 partition: 0 MaxSeqNo: 40 sessionId: src_id|826fb023-c5c6103b-2f191640-38be8288_0
2025-10-10T14:31:44.054861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a4c5d78-362be753-6d749069-d8748af5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|826fb023-c5c6103b-2f191640-38be8288_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.057504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826fb023-c5c6103b-2f191640-38be8288_0] Write session: try to update token
2025-10-10T14:31:44.057518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826fb023-c5c6103b-2f191640-38be8288_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:44.059767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:44.059782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.059801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600732685888672:3619]
2025-10-10T14:31:44.059843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.059853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:44.060011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:44.060148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:44.060279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:44.060406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:44.060580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:44.060616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:44.073819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId: src_id|826fb023-c5c6103b-2f191640-38be8288_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.076465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.076731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.076752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.076772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:44.076775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.076777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:44.076779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:44.076786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600732685888672:3619]
2025-10-10T14:31:44.076789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600732685888672:3619]
2025-10-10T14:31:44.076792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600732685888672:3619]
2025-10-10T14:31:44.076836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:44.076836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:44.076842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:44.076845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.076847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:44.076847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:44.076970Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:44.132812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600733468098507:3658]
2025-10-10T14:31:44.133139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 290, pipe: [1:7559600733468098507:3658]
2025-10-10T14:31:44.179459Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:44.179682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:44.179719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098507:3658], now have 1 active actors on pipe
2025-10-10T14:31:44.179855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:44.179907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600733468098507:3658]
2025-10-10T14:31:44.179930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:44.179969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:44.179976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:44.180038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 291 reason: error at write: Disconnected sessionId: src_id|826fb023-c5c6103b-2f191640-38be8288_0
2025-10-10T14:31:44.180172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 291 sessionId: src_id|826fb023-c5c6103b-2f191640-38be8288_0 is DEAD
2025-10-10T14:31:44.180313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fb023-c5c6103b-2f191640-38be8288_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:44.180325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fb023-c5c6103b-2f191640-38be8288_0] Write session will restart in 0.007847s
2025-10-10T14:31:44.180354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fb023-c5c6103b-2f191640-38be8288_0] Write session: Do CDS request
2025-10-10T14:31:44.180359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fb023-c5c6103b-2f191640-38be8288_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:44.188264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:44.189714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|826fb023-c5c6103b-2f191640-38be8288_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.189826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.189840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 292
2025-10-10T14:31:44.190021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.190012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:44.190057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:44.190068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.190071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.190184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:44.190193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:44.190202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:44.190251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:44.190282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600732685888809:3622]
2025-10-10T14:31:44.190479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 292 sessionId:  describe result for acl check
2025-10-10T14:31:44.190511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.190517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.190519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.190524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600733468098590:4178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.190725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:44.190994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:44.191025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:44.191075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600733468098590:4178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.191225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:44.191258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.191262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.191263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.191264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.191264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.191265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.191266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.191266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.191267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.191268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.191268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.191269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.191269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.191274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.191282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.191284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.191287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.191289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.191291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.191293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.191295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.191297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.191299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.191301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.191303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.191305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.191310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.191316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.191320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.191324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.191326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.191329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.191332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.191335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.191338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.191341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.191344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.191347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.191351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.191363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.191366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.191369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.191371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.191374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.191377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.191381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.191384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.191386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.191389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.191392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.191395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.191398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.191419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:44.192957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600733468098590:4178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.193569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:44.193868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:44.193876Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:44.193877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:44.193880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:44.193885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 291 [2:7559600732685888809:3622]
2025-10-10T14:31:44.193893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:44.193905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:44.193907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.193909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.193910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.193923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:44.193928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:44.193934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:44.193975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.193980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.193982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.193984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:44.194045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:44.194052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.194068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.194075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.194087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:44.194103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098509:2438], now have 1 active actors on pipe
2025-10-10T14:31:44.194113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600732685888804:3622]
2025-10-10T14:31:44.194115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600732685888804:3622]
2025-10-10T14:31:44.194116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600732685888804:3622]
2025-10-10T14:31:44.194126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:44.194136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:44.194144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:44.194148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:44.194148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:44.194150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:44.194151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:44.194169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600732685888804:3622]
2025-10-10T14:31:44.194175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:44.194178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:44.194181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 291
2025-10-10T14:31:44.194779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600733468098590:4178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.194792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600733468098590:4178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:44.194796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600733468098590:4178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.194814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.194999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098629:4178], now have 1 active actors on pipe
2025-10-10T14:31:44.195042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 291
2025-10-10T14:31:44.195096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.195103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.195126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:44.195134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.195139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.195140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.195150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.195159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.195173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.195293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.195298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.195309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.195370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 292 partition: 0 MaxSeqNo: 40 sessionId: src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0
2025-10-10T14:31:44.195726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|826fb023-c5c6103b-2f191640-38be8288_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.198860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0] Write session: try to update token
2025-10-10T14:31:44.198874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:44.212027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:44.212044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.212046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:44.212048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:44.212055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600732685888804:3622]
2025-10-10T14:31:44.212059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600732685888804:3622]
2025-10-10T14:31:44.212062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600732685888804:3622]
2025-10-10T14:31:44.212101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:44.212106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:44.212106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:44.212112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:44.212114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.212115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:44.212234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:44.216057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId: src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.218735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.279709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600733468098635:3658]
2025-10-10T14:31:44.280091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 291, pipe: [1:7559600733468098635:3658]
2025-10-10T14:31:44.315504Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:44.315817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.315826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.315850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098635:3658], now have 1 active actors on pipe
2025-10-10T14:31:44.316094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:44.316104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600733468098635:3658]
2025-10-10T14:31:44.316127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:44.316130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:44.316194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 292 reason: error at write: Disconnected sessionId: src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0
2025-10-10T14:31:44.316308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 292 sessionId: src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0 is DEAD
2025-10-10T14:31:44.316384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:44.316462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:44.316476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0] Write session will restart in 0.008366s
2025-10-10T14:31:44.316503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0] Write session: Do CDS request
2025-10-10T14:31:44.316510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:44.324143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:44.325459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:44.325629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:44.325639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:44.325649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:44.325704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:44.325739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600732685888928:3624]
2025-10-10T14:31:44.325797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.325920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.325932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 293
2025-10-10T14:31:44.326038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.326064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:44.326073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.326076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.326317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:44.326471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 293 sessionId:  describe result for acl check
2025-10-10T14:31:44.326497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.326498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.326499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.326503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600733468098720:4182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.326638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:44.326679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:44.326909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:44.326921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600733468098720:4182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.326946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.326951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.326952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.326952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.326953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.326953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.326954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.326955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.326955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.326956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.326956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.326957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.326957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.326962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.326968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.326970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.326972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.326975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.326977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.326979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.326981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.326984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.326986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.326988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.326991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.326993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.326998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.327003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.327007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.327010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.327012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.327015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.327018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.327021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.327023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.327026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.327029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.327032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.327035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.327038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.327040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.327043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.327046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.327049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.327052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.327055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.327060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.327063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.327065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.327068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.327071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.327075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.327110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:44.328567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600733468098720:4182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.329144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:44.329482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:44.329490Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:44.329492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:44.329494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:44.329498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 292 [2:7559600732685888928:3624]
2025-10-10T14:31:44.329505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:44.329516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:44.329517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.329519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.329520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.329528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:44.329532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:44.329537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:44.329567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.329573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.329575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.329576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:44.329619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:44.329625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.329632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.329638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.329653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:44.329668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098636:2438], now have 1 active actors on pipe
2025-10-10T14:31:44.329677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600732685888923:3624]
2025-10-10T14:31:44.329679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600732685888923:3624]
2025-10-10T14:31:44.329681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600732685888923:3624]
2025-10-10T14:31:44.329691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:44.329702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:44.329711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:44.329714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:44.329715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:44.329728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:44.329735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:44.329753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600732685888923:3624]
2025-10-10T14:31:44.329757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 292
2025-10-10T14:31:44.329773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:44.329782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:44.333912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600733468098720:4182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.333922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600733468098720:4182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:44.333924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600733468098720:4182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.333929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.334129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098757:4182], now have 1 active actors on pipe
2025-10-10T14:31:44.334179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 292
2025-10-10T14:31:44.334248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:44.334292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.334300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.334302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.334310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.334320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.334338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.334538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.334546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.334561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.334647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 293 partition: 0 MaxSeqNo: 40 sessionId: src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0
2025-10-10T14:31:44.334931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e457444-1b4b5e99-fada06a-6dbf0933_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.338147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0] Write session: try to update token
2025-10-10T14:31:44.338164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:44.347169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:44.347186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.347189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:44.347190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:44.347198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600732685888923:3624]
2025-10-10T14:31:44.347202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600732685888923:3624]
2025-10-10T14:31:44.347206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600732685888923:3624]
2025-10-10T14:31:44.347246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:44.347252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.347254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:44.347260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:44.347266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:44.347270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:44.347407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:44.355590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId: src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.358200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.416419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600733468098761:3658]
2025-10-10T14:31:44.416705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 292, pipe: [1:7559600733468098761:3658]
2025-10-10T14:31:44.458844Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:44.459100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.459116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.459142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098761:3658], now have 1 active actors on pipe
2025-10-10T14:31:44.459328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:44.459334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:44.459341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:44.459346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:44.459384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600733468098761:3658]
2025-10-10T14:31:44.459407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 293 reason: error at write: Disconnected sessionId: src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0
2025-10-10T14:31:44.459591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 293 sessionId: src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0 is DEAD
2025-10-10T14:31:44.459728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:44.459739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0] Write session will restart in 0.006729s
2025-10-10T14:31:44.459759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0] Write session: Do CDS request
2025-10-10T14:31:44.459766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:44.467868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.467951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.467967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 294
2025-10-10T14:31:44.468116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.468156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:44.468169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.468173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.468204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:44.468554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 294 sessionId:  describe result for acl check
2025-10-10T14:31:44.468584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.468585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.468587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.468591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600733468098845:4186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.469088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600733468098845:4186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.469759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:44.469927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:44.469936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:44.469945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:44.469985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:44.470028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600732685889050:3626]
2025-10-10T14:31:44.470416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:44.470668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:44.470720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:44.471024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:44.471031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600733468098845:4186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.471085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.471091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.471092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.471093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.471094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.471095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.471096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.471097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.471098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.471099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.471100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.471102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.471103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.471108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.471119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.471123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.471127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.471130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.471134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.471137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.471141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.471144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.471148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.471152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.471155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.471159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.471165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.471173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.471180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.471185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.471190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.471195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.471199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.471203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.471207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.471213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.471217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.471221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.471226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.471230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.471237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.471242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.471247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.471251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.471253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.471256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.471259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.471262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.471264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.471267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.471270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.471273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.471306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:44.473271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600733468098845:4186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.473297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600733468098845:4186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:44.473301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600733468098845:4186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.473310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.473373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:44.473687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:44.473700Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:44.473702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:44.473706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:44.473711Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 293 [2:7559600732685889050:3626]
2025-10-10T14:31:44.473722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:44.473737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:44.473743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.473746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.473749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.473764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:44.473771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:44.473785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:44.473837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.473844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.473846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.473849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:44.473909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:44.473916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.473927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.473940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.473969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:44.473999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098879:4186], now have 1 active actors on pipe
2025-10-10T14:31:44.474006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098762:2438], now have 1 active actors on pipe
2025-10-10T14:31:44.474013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600732685889045:3626]
2025-10-10T14:31:44.474015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600732685889045:3626]
2025-10-10T14:31:44.474019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600732685889045:3626]
2025-10-10T14:31:44.474024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 293
2025-10-10T14:31:44.474026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 293
2025-10-10T14:31:44.474032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:44.474050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:44.474053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:44.474055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:44.474058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:44.474076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:44.474080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:44.474108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.474118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.474131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600732685889045:3626]
2025-10-10T14:31:44.474140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:44.474149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:44.474172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:44.474183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.474191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.474193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.474203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.474218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.474240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.474395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.474403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.474418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.474536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 294 partition: 0 MaxSeqNo: 40 sessionId: src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0
2025-10-10T14:31:44.474930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c7aaa7-8e92a8f-5b30912c-72b4d0d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.478166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0] Write session: try to update token
2025-10-10T14:31:44.478185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:44.492276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:44.492290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.492292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:44.492293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:44.492301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600732685889045:3626]
2025-10-10T14:31:44.492305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600732685889045:3626]
2025-10-10T14:31:44.492308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600732685889045:3626]
2025-10-10T14:31:44.492346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:44.492349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:44.492352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.492353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:44.492355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:44.492359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:44.492482Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:44.494899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId: src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.497748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.559301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600733468098898:3658]
2025-10-10T14:31:44.559590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 293, pipe: [1:7559600733468098898:3658]
2025-10-10T14:31:44.600347Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:44.600821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.600836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.600869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098898:3658], now have 1 active actors on pipe
2025-10-10T14:31:44.601089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:44.601093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:44.601103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:44.601138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:44.601145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600733468098898:3658]
2025-10-10T14:31:44.601169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 294 reason: error at write: Disconnected sessionId: src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0
2025-10-10T14:31:44.601386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 294 sessionId: src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0 is DEAD
2025-10-10T14:31:44.601503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:44.601514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0] Write session will restart in 0.008855s
2025-10-10T14:31:44.601540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0] Write session: Do CDS request
2025-10-10T14:31:44.601546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:44.610970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:44.611787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.611956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.611969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 295
2025-10-10T14:31:44.612097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.612130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:44.612140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.612147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.612505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 295 sessionId:  describe result for acl check
2025-10-10T14:31:44.612534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.612536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.612539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.612543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600733468098987:4192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.612748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:44.612894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:44.612903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:44.612912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:44.612952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:44.612967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600733468098987:4192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.612992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600732685889177:3629]
2025-10-10T14:31:44.613432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:44.613723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:44.613786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:44.614029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:44.614069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.614074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.614075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.614076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.614076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.614077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.614078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.614078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.614079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.614080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.614081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.614081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.614082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.614086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.614094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.614097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.614099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.614101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.614104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.614106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.614108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.614110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.614112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.614114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.614116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.614118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.614123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.614128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.614132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.614136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.614139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.614142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.614145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.614148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.614150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.614154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.614158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.614164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.614171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.614175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.614178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.614183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.614187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.614192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.614196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.614203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.614205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.614208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.614211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.614214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.614216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.614219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.614250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:44.614872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600733468098987:4192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.616358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:44.616700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:44.616708Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:44.616710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:44.616713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:44.616719Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 294 [2:7559600732685889177:3629]
2025-10-10T14:31:44.616731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:44.616758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:44.616766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.616769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.616770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.616783Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:44.616789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:44.616795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:44.616835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.616841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.616842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.616844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:44.616904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:44.616909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.616917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.616923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.616936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:44.616956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468098903:2438], now have 1 active actors on pipe
2025-10-10T14:31:44.616965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600732685889171:3629]
2025-10-10T14:31:44.616966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600732685889171:3629]
2025-10-10T14:31:44.616968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600732685889171:3629]
2025-10-10T14:31:44.616981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:44.616989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 294
2025-10-10T14:31:44.616996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:44.616998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:44.617005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:44.617007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:44.617020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:44.617027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:44.617053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600732685889171:3629]
2025-10-10T14:31:44.617061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:44.617071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:44.617277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600733468098987:4192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.617289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600733468098987:4192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:44.617292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600733468098987:4192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.617300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.617497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468099023:4192], now have 1 active actors on pipe
2025-10-10T14:31:44.617534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 294
2025-10-10T14:31:44.617586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.617598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.617627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:44.617640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.617648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.617650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.617661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.617674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.617692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.617815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.617821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.617835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.617895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 295 partition: 0 MaxSeqNo: 40 sessionId: src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0
2025-10-10T14:31:44.618212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdca8ef-7a9fbb4d-46af38a4-a5484bf0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.621049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0] Write session: try to update token
2025-10-10T14:31:44.621067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:44.627749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:44.627766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.627777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600732685889171:3629]
2025-10-10T14:31:44.627820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:44.627823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:44.627992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:44.628147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:44.628286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:44.628423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:44.628610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:44.628654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:44.637708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId: src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.640455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.640633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.640662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.640710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:44.640793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:44.644322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:44.644338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.644341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:44.644342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:44.644350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600732685889171:3629]
2025-10-10T14:31:44.644356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600732685889171:3629]
2025-10-10T14:31:44.644359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600732685889171:3629]
2025-10-10T14:31:44.644396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:44.644399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:44.644405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.644405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:44.644406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:44.644410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:44.644549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:44.701120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600733468099029:3658]
2025-10-10T14:31:44.701425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 294, pipe: [1:7559600733468099029:3658]
2025-10-10T14:31:44.751056Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:44.760764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.760796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.761001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.761073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.761147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.761216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.761283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.761295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.761391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.761473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.761553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.761644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.761701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.761708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.761792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.761870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.761949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.762025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.762087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.762094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.762175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.762247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.762321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.762408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.762467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.762485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.762566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.762636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.762719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.762801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.762862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.762869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.762948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.763014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.763081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.763148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.763202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.763208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.763284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.763346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.763418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.763488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.763546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.763555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.763628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.763689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.763767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.763849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.763914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.763923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.764004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.764076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.764154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.764235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.764420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.764439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.764517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:44.764574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:44.764635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:44.764698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:44.764743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:44.764753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:44.764821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468099029:3658], now have 1 active actors on pipe
2025-10-10T14:31:44.765088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600733468099029:3658]
2025-10-10T14:31:44.765098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:44.765101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:44.765131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 295 reason: error at write: Disconnected sessionId: src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0
2025-10-10T14:31:44.765139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:44.765326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 295 sessionId: src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0 is DEAD
2025-10-10T14:31:44.765528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:44.765540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0] Write session will restart in 0.006091s
2025-10-10T14:31:44.765562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0] Write session: Do CDS request
2025-10-10T14:31:44.765571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:44.765834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:44.772771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.772914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.772928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 296
2025-10-10T14:31:44.773097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.773134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:44.773146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.773150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.773511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 296 sessionId:  describe result for acl check
2025-10-10T14:31:44.773539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.773540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.773541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.773546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600733468099112:4196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.773994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600733468099112:4196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.774250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:44.775947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:44.776121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:44.776135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:44.776146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:44.776198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:44.776237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600732685889300:3631]
2025-10-10T14:31:44.776385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600733468099112:4196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.776861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:44.777115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:44.777157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:44.777497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:44.777569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.777577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.777578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.777579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.777580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.777581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.777582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.777583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.777584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.777586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.777587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.777588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.777589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.777594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.777607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.777611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.777615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.777620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.777624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.777628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.777632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.777636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.777640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.777645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.777649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.777653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.777660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.777668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.777674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.777680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.777691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.777704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.777708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.777729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.777739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.777745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.777749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.777760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.777764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.777775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.777779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.777790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.777800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.777812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.777817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.777824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.777829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.777834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.777843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.777849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.777858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.777864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.777911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:44.780060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600733468099112:4196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.780072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600733468099112:4196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:44.780075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600733468099112:4196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.780082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.780152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:44.780477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:44.780493Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:44.780496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:44.780500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:44.780508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 295 [2:7559600732685889300:3631]
2025-10-10T14:31:44.780531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:44.780549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:44.780559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.780562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.780564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.780581Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:44.780594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:44.780603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:44.780662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.780670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.780672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.780674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:44.780743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:44.780752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.780763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.780782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.780812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:44.780840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 295
2025-10-10T14:31:44.780852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 295
2025-10-10T14:31:44.780842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468099030:2438], now have 1 active actors on pipe
2025-10-10T14:31:44.780853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468099149:4196], now have 1 active actors on pipe
2025-10-10T14:31:44.780860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600732685889295:3631]
2025-10-10T14:31:44.780862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600732685889295:3631]
2025-10-10T14:31:44.780864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600732685889295:3631]
2025-10-10T14:31:44.780873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:44.780890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:44.780894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:44.780894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:44.780896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:44.780911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:44.780914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:44.780934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.780938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.780967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600732685889295:3631]
2025-10-10T14:31:44.780981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:44.780991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:44.781009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c155aee6-79120df5-4778da4c-4a8ab525_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:44.781022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.781031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.781034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.781045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.781056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.781101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.781251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.781261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.781275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.781371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 296 partition: 0 MaxSeqNo: 40 sessionId: src_id|c155aee6-79120df5-4778da4c-4a8ab525_0
2025-10-10T14:31:44.781705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc9a77d-b0a9a357-35f9147-f00a1a52_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c155aee6-79120df5-4778da4c-4a8ab525_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.784907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c155aee6-79120df5-4778da4c-4a8ab525_0] Write session: try to update token
2025-10-10T14:31:44.784922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c155aee6-79120df5-4778da4c-4a8ab525_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:44.799219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:44.799240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.799243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:44.799245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:44.799255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600732685889295:3631]
2025-10-10T14:31:44.799260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600732685889295:3631]
2025-10-10T14:31:44.799263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600732685889295:3631]
2025-10-10T14:31:44.799308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:44.799316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.799322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:44.799348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:44.799367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:44.799372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:44.799472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:44.801300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId: src_id|c155aee6-79120df5-4778da4c-4a8ab525_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.804188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:44.865459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600733468099157:3658]
2025-10-10T14:31:44.865692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 295, pipe: [1:7559600733468099157:3658]
2025-10-10T14:31:44.908270Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:44.908688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.908700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.908735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468099157:3658], now have 1 active actors on pipe
2025-10-10T14:31:44.908976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:44.908983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600733468099157:3658]
2025-10-10T14:31:44.909020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:44.909057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:44.909150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 296 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c155aee6-79120df5-4778da4c-4a8ab525_0
2025-10-10T14:31:44.909419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 296 sessionId: src_id|c155aee6-79120df5-4778da4c-4a8ab525_0 is DEAD
2025-10-10T14:31:44.909567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c155aee6-79120df5-4778da4c-4a8ab525_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:44.909576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c155aee6-79120df5-4778da4c-4a8ab525_0] Write session will restart in 0.007520s
2025-10-10T14:31:44.909602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c155aee6-79120df5-4778da4c-4a8ab525_0] Write session: Do CDS request
2025-10-10T14:31:44.909608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c155aee6-79120df5-4778da4c-4a8ab525_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:44.917761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c155aee6-79120df5-4778da4c-4a8ab525_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.917849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:44.917859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 297
2025-10-10T14:31:44.918014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:44.918042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:44.918048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:44.918051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:44.918422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 297 sessionId:  describe result for acl check
2025-10-10T14:31:44.918462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:44.918468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:44.918470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:44.918473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600733468099269:4209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:44.918893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600733468099269:4209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:44.918928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:44.920552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:44.920722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:44.920731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:44.920741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:44.920756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600733468099269:4209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:44.920786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:44.920829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600732685889463:3644]
2025-10-10T14:31:44.921399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:44.921645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:44.921690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:44.921998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:44.922048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.922055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.922056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.922057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.922058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.922060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.922060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.922062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.922063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.922064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.922065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.922066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.922067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.922074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.922085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.922090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.922094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.922098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.922102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.922105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.922109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.922113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.922117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.922121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.922124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.922128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.922136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.922143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:44.922149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.922154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:44.922160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.922165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:44.922171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.922176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:44.922180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.922185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:44.922189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.922194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:44.922199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.922204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:44.922208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.922214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:44.922218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.922224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:44.922239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.922245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:44.922254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.922260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.922264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.922273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.922282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.922286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.922330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:44.922828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600733468099269:4209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:44.922840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600733468099269:4209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:44.922843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600733468099269:4209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:44.922850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:44.924338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:44.924708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:44.924719Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:44.924721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:44.924725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:44.924730Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 296 [2:7559600732685889463:3644]
2025-10-10T14:31:44.924743Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:44.924759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:44.924764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.924766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.924767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.924777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:44.924783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:44.924791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:44.924847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.924854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.924856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.924859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:44.924913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:44.924919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.924926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:44.924943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:44.924966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:44.924987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468099171:2438], now have 1 active actors on pipe
2025-10-10T14:31:44.924997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600733468099302:4209], now have 1 active actors on pipe
2025-10-10T14:31:44.925002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600732685889458:3644]
2025-10-10T14:31:44.925007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600732685889458:3644]
2025-10-10T14:31:44.925008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600732685889458:3644]
2025-10-10T14:31:44.925021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:44.925012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 296
2025-10-10T14:31:44.925012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 296
2025-10-10T14:31:44.925033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:44.925038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:44.925042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:44.925044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:44.925045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:44.925047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:44.925078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.925084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.925094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600732685889458:3644]
2025-10-10T14:31:44.925106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:44.925129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:44.925132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:44.925138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:44.925141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:44.925143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:44.925153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:44.925162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:44.925185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.925321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:44.925327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:44.925355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:44.925441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 297 partition: 0 MaxSeqNo: 40 sessionId: src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0
2025-10-10T14:31:44.925787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c155aee6-79120df5-4778da4c-4a8ab525_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:44.928671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0] Write session: try to update token
2025-10-10T14:31:44.928686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:44.942303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId: src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:44.943353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:44.943377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:44.943380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:44.943383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:44.943393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600732685889458:3644]
2025-10-10T14:31:44.943403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600732685889458:3644]
2025-10-10T14:31:44.943408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600732685889458:3644]
2025-10-10T14:31:44.943460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:44.943466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:44.943475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:44.943477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:44.943478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:44.943483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:44.943635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:44.944853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:45.009368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600737763066605:3658]
2025-10-10T14:31:45.009689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 296, pipe: [1:7559600737763066605:3658]
2025-10-10T14:31:45.050918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:45.051266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.051281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.051324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763066605:3658], now have 1 active actors on pipe
2025-10-10T14:31:45.051528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:45.051541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:45.051600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600737763066605:3658]
2025-10-10T14:31:45.051628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:45.051706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 297 reason: status is not ok: tablet will be restarted right now sessionId: src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0
2025-10-10T14:31:45.051941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 297 sessionId: src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0 is DEAD
2025-10-10T14:31:45.052126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:45.052137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0] Write session will restart in 0.007881s
2025-10-10T14:31:45.052165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0] Write session: Do CDS request
2025-10-10T14:31:45.052170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:45.060713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:45.060836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.060964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:45.060981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 298
2025-10-10T14:31:45.061111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.061147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:45.061158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:45.061161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:45.061625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 298 sessionId:  describe result for acl check
2025-10-10T14:31:45.061675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:45.061681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:45.061684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:45.061691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600737763066694:4213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:45.062248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600737763066694:4213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:45.062698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:45.062917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:45.062936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:45.062955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:45.063013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:45.063055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600736980856885:3648]
2025-10-10T14:31:45.063522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:45.063811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:45.063884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:45.064232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:45.064309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.064328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.064329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.064331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.064332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.064333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.064334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.064335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.064337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.064338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.064339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.064340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.064342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.064348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.064358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.064362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.064366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.064370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.064374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.064377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.064380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.064384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.064388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.064392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.064395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.064408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.064417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.064425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.064431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.064436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.064441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.064445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.064450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.064454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.064459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.064465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.064469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.064474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.064478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.064483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.064487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.064492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.064495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.064500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.064504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.064510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.064515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.064529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.064533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.064538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.064542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.064522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600737763066694:4213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:45.064547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.064592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:45.066923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:45.067372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600737763066694:4213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:45.067387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600737763066694:4213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:45.067391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600737763066694:4213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:45.067400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:45.067488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:45.067505Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:45.067508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:45.067511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:45.067530Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 297 [2:7559600736980856885:3648]
2025-10-10T14:31:45.067544Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:45.067557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:45.067560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.067562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.067564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.067577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:45.067595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:45.067607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:45.067653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.067660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.067661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.067663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:45.067728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:45.067736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.067744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.067756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.067767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:45.067790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763066728:4213], now have 1 active actors on pipe
2025-10-10T14:31:45.067800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763066607:2438], now have 1 active actors on pipe
2025-10-10T14:31:45.067808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600736980856880:3648]
2025-10-10T14:31:45.067816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600736980856880:3648]
2025-10-10T14:31:45.067818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600736980856880:3648]
2025-10-10T14:31:45.067831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:45.067836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 297
2025-10-10T14:31:45.067837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 297
2025-10-10T14:31:45.067848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:45.067850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:45.067859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:45.067862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:45.067865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:45.067868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:45.067894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600736980856880:3648]
2025-10-10T14:31:45.067904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:45.067910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:45.067918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.067926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.067962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|951e82b8-99e364ba-640a190f-e21cecf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:45.067974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.067976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.067978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:45.067988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.068002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:45.068020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.068162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.068168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.068179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.068261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 298 partition: 0 MaxSeqNo: 40 sessionId: src_id|951e82b8-99e364ba-640a190f-e21cecf3_0
2025-10-10T14:31:45.068658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396507f1-4d1384df-c986b7bc-f31b9db9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|951e82b8-99e364ba-640a190f-e21cecf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:45.071215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951e82b8-99e364ba-640a190f-e21cecf3_0] Write session: try to update token
2025-10-10T14:31:45.071231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951e82b8-99e364ba-640a190f-e21cecf3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:45.086017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId: src_id|951e82b8-99e364ba-640a190f-e21cecf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:45.086521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:45.086540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.086542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:45.086543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:45.086550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600736980856880:3648]
2025-10-10T14:31:45.086554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600736980856880:3648]
2025-10-10T14:31:45.086557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600736980856880:3648]
2025-10-10T14:31:45.086603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:45.086605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:45.086610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.086613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:45.086692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:45.086711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:45.086760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:45.088902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:45.151704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600737763066750:3658]
2025-10-10T14:31:45.152009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 297, pipe: [1:7559600737763066750:3658]
2025-10-10T14:31:45.192680Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:45.192903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.192917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.192956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763066750:3658], now have 1 active actors on pipe
2025-10-10T14:31:45.193124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:45.193195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:45.193213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:45.193268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600737763066750:3658]
2025-10-10T14:31:45.193298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 298 reason: status is not ok: tablet will be restarted right now sessionId: src_id|951e82b8-99e364ba-640a190f-e21cecf3_0
2025-10-10T14:31:45.193542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 298 sessionId: src_id|951e82b8-99e364ba-640a190f-e21cecf3_0 is DEAD
2025-10-10T14:31:45.193680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951e82b8-99e364ba-640a190f-e21cecf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:45.193692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951e82b8-99e364ba-640a190f-e21cecf3_0] Write session will restart in 0.006958s
2025-10-10T14:31:45.193727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951e82b8-99e364ba-640a190f-e21cecf3_0] Write session: Do CDS request
2025-10-10T14:31:45.193734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951e82b8-99e364ba-640a190f-e21cecf3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:45.201804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:45.201832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951e82b8-99e364ba-640a190f-e21cecf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.201955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:45.201969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 299
2025-10-10T14:31:45.202108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.202144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:45.202155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:45.202160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:45.202628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 299 sessionId:  describe result for acl check
2025-10-10T14:31:45.202664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:45.202670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:45.202672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:45.202679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600737763066839:4218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:45.203225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600737763066839:4218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:45.203508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:45.203673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:45.203683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:45.203694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:45.203736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:45.203767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600736980857024:3651]
2025-10-10T14:31:45.204185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:45.204403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:45.204442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:45.204661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:45.204698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.204703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.204704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.204705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.204705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.204706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.204707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.204708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.204708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.204709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.204710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.204710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.204711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.204715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.204724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.204726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.204729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.204731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.204734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.204736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.204738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.204741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.204744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.204746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.204748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.204751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.204757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.204762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.204767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.204771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.204773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.204776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.204779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.204782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.204784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.204788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.204790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.204793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.204797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.204800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.204803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.204806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.204809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.204812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.204814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.204817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.204820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.204824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.204826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.204833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.204836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.204839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.204862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:45.205505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600737763066839:4218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:45.206992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:45.207290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:45.207301Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:45.207302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:45.207305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:45.207312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 298 [2:7559600736980857024:3651]
2025-10-10T14:31:45.207320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:45.207336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:45.207341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.207344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.207345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.207357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:45.207366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:45.207375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:45.207414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.207419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.207420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.207422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:45.207477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:45.207483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.207494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.207508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.207521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:45.207540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763066751:2438], now have 1 active actors on pipe
2025-10-10T14:31:45.207549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600736980857019:3651]
2025-10-10T14:31:45.207551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600736980857019:3651]
2025-10-10T14:31:45.207552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600736980857019:3651]
2025-10-10T14:31:45.207563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:45.207556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 298
2025-10-10T14:31:45.207576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:45.207580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:45.207583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:45.207584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:45.207589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:45.207592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:45.207614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600736980857019:3651]
2025-10-10T14:31:45.207622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:45.207629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:45.208020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600737763066839:4218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:45.208031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600737763066839:4218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:45.208034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600737763066839:4218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:45.208040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:45.208197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763066875:4218], now have 1 active actors on pipe
2025-10-10T14:31:45.208239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 298
2025-10-10T14:31:45.208282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.208290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.208315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|227045d8-7dd16272-314b795f-18513bfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:45.208325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.208331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.208333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:45.208340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.208354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:45.208370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.208536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.208545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.208560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.208639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 299 partition: 0 MaxSeqNo: 40 sessionId: src_id|227045d8-7dd16272-314b795f-18513bfe_0
2025-10-10T14:31:45.208996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951e82b8-99e364ba-640a190f-e21cecf3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|227045d8-7dd16272-314b795f-18513bfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:45.211646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|227045d8-7dd16272-314b795f-18513bfe_0] Write session: try to update token
2025-10-10T14:31:45.211662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|227045d8-7dd16272-314b795f-18513bfe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:45.223931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:45.223947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.223957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600736980857019:3651]
2025-10-10T14:31:45.224011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:45.224013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:45.224226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:45.224389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:45.224560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:45.224744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:45.224958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:45.225013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:45.226219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId: src_id|227045d8-7dd16272-314b795f-18513bfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:45.228992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:45.229258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.229276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.229315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:45.229431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:45.236393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:45.236408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.236410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:45.236412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:45.236423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600736980857019:3651]
2025-10-10T14:31:45.236427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600736980857019:3651]
2025-10-10T14:31:45.236435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600736980857019:3651]
2025-10-10T14:31:45.236479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:45.236479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:45.236490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.236491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:45.236497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:45.236501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:45.236606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:45.293537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600737763066881:3658]
2025-10-10T14:31:45.293865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 298, pipe: [1:7559600737763066881:3658]
2025-10-10T14:31:45.341893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:45.348751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.348775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.348932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.348989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.349051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.349119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.349167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.349174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.349236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.349297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.349376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.349436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.349473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.349479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.349537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.349604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.349662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.349719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.349761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.349763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.349819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.349880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.349940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.349996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.350035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.350040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.350106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.350160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.350224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.350283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.350326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.350332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.350406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.350460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.350517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.350572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.350616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.350625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.350685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.350737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.350795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.350854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.350897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.350904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.350963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.351016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.351080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.351146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.351194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.351200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.351259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.351311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.351416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.351521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.351583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.351594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.351657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.351707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.351759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.351811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.351851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.351857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.351904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763066881:3658], now have 1 active actors on pipe
2025-10-10T14:31:45.352072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600737763066881:3658]
2025-10-10T14:31:45.352110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:45.352112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:45.352142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 299 reason: error at write: Disconnected sessionId: src_id|227045d8-7dd16272-314b795f-18513bfe_0
2025-10-10T14:31:45.352262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:45.352373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 299 sessionId: src_id|227045d8-7dd16272-314b795f-18513bfe_0 is DEAD
2025-10-10T14:31:45.352499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227045d8-7dd16272-314b795f-18513bfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:45.352507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227045d8-7dd16272-314b795f-18513bfe_0] Write session will restart in 0.005999s
2025-10-10T14:31:45.352538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227045d8-7dd16272-314b795f-18513bfe_0] Write session: Do CDS request
2025-10-10T14:31:45.352545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227045d8-7dd16272-314b795f-18513bfe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:45.352820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:45.359837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|227045d8-7dd16272-314b795f-18513bfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.359903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:45.359923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 300
2025-10-10T14:31:45.360039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.360099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:45.360111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:45.360115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:45.360620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 300 sessionId:  describe result for acl check
2025-10-10T14:31:45.360657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:45.360663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:45.360665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:45.360671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600737763066968:4222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:45.361228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600737763066968:4222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:45.361609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:45.363300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:45.363467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:45.363480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:45.363492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:45.363545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:45.363585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600736980857152:3653]
2025-10-10T14:31:45.364173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600737763066968:4222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:45.364166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:45.364442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:45.364481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:45.364796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:45.364854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.364860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.364861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.364862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.364863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.364864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.364865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.364867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.364868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.364869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.364870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.364871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.364872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.364878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.364890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.364894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.364898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.364902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.364906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.364910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.364913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.364917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.364921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.364924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.364927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.364930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.364936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.364944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.364956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.364968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.364972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.364977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.364982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.364986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.364989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.364993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.364998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.365003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.365008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.365012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.365017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.365022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.365026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.365031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.365041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.365050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.365058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.365067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.365076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.365081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.365086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.365095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.365137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:45.367265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:45.367276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600737763066968:4222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:45.367289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600737763066968:4222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:45.367293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600737763066968:4222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:45.367301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:45.367559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:45.367569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:45.367571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:45.367575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:45.367580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 299 [2:7559600736980857152:3653]
2025-10-10T14:31:45.367591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:45.367606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:45.367610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.367617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.367619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.367635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:45.367647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:45.367654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:45.367708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.367715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.367717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.367719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:45.367783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:45.367792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.367803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.367815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.367844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:45.367861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 299
2025-10-10T14:31:45.367870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 299
2025-10-10T14:31:45.367873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763066882:2438], now have 1 active actors on pipe
2025-10-10T14:31:45.367877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067005:4222], now have 1 active actors on pipe
2025-10-10T14:31:45.367884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600736980857147:3653]
2025-10-10T14:31:45.367886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600736980857147:3653]
2025-10-10T14:31:45.367889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600736980857147:3653]
2025-10-10T14:31:45.367898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:45.367907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:45.367909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:45.367911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:45.367911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:45.367927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:45.367930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:45.367947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.367951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.367982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600736980857147:3653]
2025-10-10T14:31:45.367995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:45.368005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:45.368019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:45.368032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.368036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.368038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:45.368048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.368058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:45.368096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.368233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.368242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.368256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.368313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 300 partition: 0 MaxSeqNo: 40 sessionId: src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0
2025-10-10T14:31:45.368628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|227045d8-7dd16272-314b795f-18513bfe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:45.371187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0] Write session: try to update token
2025-10-10T14:31:45.371203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:45.379756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:45.379777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.379792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600736980857147:3653]
2025-10-10T14:31:45.379847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:45.379851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:45.380115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:45.380263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:45.380409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:45.380549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:45.380729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:45.380765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:45.386425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId: src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:45.388763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:45.388955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.388974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.389010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:45.389100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:45.396082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:45.396099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.396102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:45.396103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:45.396113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600736980857147:3653]
2025-10-10T14:31:45.396116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600736980857147:3653]
2025-10-10T14:31:45.396119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600736980857147:3653]
2025-10-10T14:31:45.396157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:45.396162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.396164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:45.396169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:45.396176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:45.396180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:45.396284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:45.452210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600737763067013:3658]
2025-10-10T14:31:45.452473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 299, pipe: [1:7559600737763067013:3658]
2025-10-10T14:31:45.500743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:45.507771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.507793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.507955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.508015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.508075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.508137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.508187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.508196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.508258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.508311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.508367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.508433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.508475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.508483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.508553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.508617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.508685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.508760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.508804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.508809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.508871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.508937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.509001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.509064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.509106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.509113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.509179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.509237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.509296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.509376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.509418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.509428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.509493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.509550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.509608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.509665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.509716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.509722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.509786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.509851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.509913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.509978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.510025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.510030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.510090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.510146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.510209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.510268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.510308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.510315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.510386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.510447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.510507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.510565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.510605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.510610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.510671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:45.510737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:45.510807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:45.510870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:45.510914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:45.510922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:45.510968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067013:3658], now have 1 active actors on pipe
2025-10-10T14:31:45.511263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:45.511276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:45.511281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600737763067013:3658]
2025-10-10T14:31:45.511309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:45.511311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 300 reason: error at write: Disconnected sessionId: src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0
2025-10-10T14:31:45.511515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 300 sessionId: src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0 is DEAD
2025-10-10T14:31:45.511686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:45.511697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0] Write session will restart in 0.007970s
2025-10-10T14:31:45.511716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0] Write session: Do CDS request
2025-10-10T14:31:45.511721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:45.511736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:45.520091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:45.520884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.520959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:45.520981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 301
2025-10-10T14:31:45.521095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.521128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:45.521138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:45.521143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:45.521591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 301 sessionId:  describe result for acl check
2025-10-10T14:31:45.521626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:45.521633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:45.521635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:45.521640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600737763067104:4226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:45.521851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:45.522035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:45.522044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:45.522053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:45.522097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:45.522136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600736980857281:3655]
2025-10-10T14:31:45.522165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600737763067104:4226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:45.522532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:45.522762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:45.522798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:45.523014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:45.523058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.523063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.523063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.523064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.523065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.523065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.523066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.523066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.523067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.523068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.523068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.523069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.523070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.523073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.523081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.523083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.523085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.523087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.523089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.523091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.523093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.523095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.523097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.523099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.523101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.523103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.523108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.523113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.523120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.523123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.523126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.523129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.523132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.523134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.523137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.523140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.523143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.523145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.523148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.523151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.523153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.523156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.523159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.523162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.523164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.523167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.523170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.523173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.523175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.523178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.523181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.523184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.523205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:45.524396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600737763067104:4226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:45.525254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:45.525600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:45.525613Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:45.525615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:45.525618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:45.525622Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 300 [2:7559600736980857281:3655]
2025-10-10T14:31:45.525630Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:45.525643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:45.525645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.525647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.525648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.525660Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:45.525669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:45.525675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:45.525721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.525727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.525728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.525730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:45.525778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:45.525784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.525794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.525804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.525820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:45.525841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067014:2438], now have 1 active actors on pipe
2025-10-10T14:31:45.525850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600736980857276:3655]
2025-10-10T14:31:45.525852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600736980857276:3655]
2025-10-10T14:31:45.525853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600736980857276:3655]
2025-10-10T14:31:45.525863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:45.525872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:45.525886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:45.525891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:45.525881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 300
2025-10-10T14:31:45.525906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:45.525914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600736980857276:3655]
2025-10-10T14:31:45.525916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:45.525919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:45.525922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:45.525930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:45.527169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600737763067104:4226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:45.527182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600737763067104:4226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:45.527186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600737763067104:4226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:45.527194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:45.527397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067142:4226], now have 1 active actors on pipe
2025-10-10T14:31:45.527455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 300
2025-10-10T14:31:45.527522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.527530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.527559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:45.527580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.527588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.527590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:45.527603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.527619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:45.527639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.527845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.527857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.527884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.528019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 301 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0
2025-10-10T14:31:45.528344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|592bb274-126e7e7c-7f43a466-8c9e44a3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:45.530968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0] Write session: try to update token
2025-10-10T14:31:45.530985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:45.544564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:45.544582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.544585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:45.544587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:45.544598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600736980857276:3655]
2025-10-10T14:31:45.544603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600736980857276:3655]
2025-10-10T14:31:45.544611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600736980857276:3655]
2025-10-10T14:31:45.544655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:45.544664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:45.544669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:45.544672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.544674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:45.544675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:45.544818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:45.546523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId: src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:45.549228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:45.611457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600737763067155:3658]
2025-10-10T14:31:45.611750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 300, pipe: [1:7559600737763067155:3658]
2025-10-10T14:31:45.656903Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:45.657143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.657154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.657192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067155:3658], now have 1 active actors on pipe
2025-10-10T14:31:45.657384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:45.657410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:45.657422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:45.657429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600737763067155:3658]
2025-10-10T14:31:45.657447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:45.657471Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:31:45.657690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 301 reason: error at write: Disconnected sessionId: src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0
2025-10-10T14:31:45.657723Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_14124424596769502290_v1 is DEAD
2025-10-10T14:31:45.657821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 301 sessionId: src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0 is DEAD
2025-10-10T14:31:45.657848Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:31:45.657881Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600673338542648:3653] disconnected; active server actors: 1
2025-10-10T14:31:45.657887Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600673338542648:3653] client user disconnected session shared/user_1_3_14124424596769502290_v1
2025-10-10T14:31:45.657921Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:45.657925Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:31:45.657935Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.006617s
2025-10-10T14:31:45.657986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:45.657996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0] Write session will restart in 0.008941s
2025-10-10T14:31:45.658012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0] Write session: Do CDS request
2025-10-10T14:31:45.658016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:45.665663Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:31:45.665882Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:31:45.665892Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 4
2025-10-10T14:31:45.666101Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:45.666161Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:31:45.666245Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 auth for : user
2025-10-10T14:31:45.666471Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 Handle describe topics response
2025-10-10T14:31:45.666502Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 auth is DEAD
2025-10-10T14:31:45.666507Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:31:45.666761Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:31:45.666843Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_4_7117977482433792610_v1
2025-10-10T14:31:45.666864Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600737763067247:4232] connected; active server actors: 1
2025-10-10T14:31:45.666882Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600737763067247:4232] session shared/user_1_4_7117977482433792610_v1
2025-10-10T14:31:45.666892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:31:45.666902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:31:45.666913Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_4_7117977482433792610_v1" (Sender=[1:7559600737763067243:4232], Pipe=[1:7559600737763067247:4232], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:45.666922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:31:45.666934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:31:45.666948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_4_7117977482433792610_v1" (Sender=[1:7559600737763067243:4232], Pipe=[1:7559600737763067247:4232], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:31:45.666962Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_4_7117977482433792610_v1" sender [1:7559600737763067243:4232] lock partition 0 for ReadingSession "shared/user_1_4_7117977482433792610_v1" (Sender=[1:7559600737763067243:4232], Pipe=[1:7559600737763067247:4232], Partitions=[], ActiveFamilyCount=1) generation 1 step 4
2025-10-10T14:31:45.666978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:31:45.666987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000046s
2025-10-10T14:31:45.667174Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_4_7117977482433792610_v1" ClientId: "user" PipeClient { RawX1: 7559600737763067247 RawX2: 4503603922342024 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:31:45.667197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:31:45.667198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:45.667705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.667747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:45.667756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 302
2025-10-10T14:31:45.667874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.667905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:45.667913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:45.667916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:45.668254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 302 sessionId:  describe result for acl check
2025-10-10T14:31:45.668280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:45.668285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:45.668287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:45.668292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600737763067256:4236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:45.668820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600737763067256:4236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:45.668928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:45.669111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:45.669119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:45.669130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:45.669195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:45.669238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600736980857412:3658]
2025-10-10T14:31:45.669839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:45.670171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:45.670229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:45.670517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:45.670559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.670564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.670564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.670565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.670566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.670567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.670567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.670568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.670569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.670569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.670570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.670571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.670571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.670575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.670583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.670585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.670588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.670590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.670592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.670595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.670597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.670599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.670602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.670604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.670606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.670608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.670624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.670629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.670634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.670637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.670641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.670644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.670647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.670650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.670652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.670655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.670658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.670661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.670664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.670667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.670669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.670672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.670675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.670678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.670680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.670683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.670672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600737763067256:4236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:45.670686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.670689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.670692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.670694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.670697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.670699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.670721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:45.672828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:45.672936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600737763067256:4236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:45.672947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600737763067256:4236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:45.672950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600737763067256:4236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:45.672958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:45.673193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:45.673203Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:45.673205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:45.673208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:45.673214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 301 [2:7559600736980857412:3658]
2025-10-10T14:31:45.673224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:45.673241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:45.673245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.673248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.673249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.673261Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:45.673269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:45.673280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:45.673319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.673325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.673326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.673344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:45.673398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:45.673404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.673411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.673425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.673447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:45.673471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067289:4236], now have 1 active actors on pipe
2025-10-10T14:31:45.673477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067157:2438], now have 1 active actors on pipe
2025-10-10T14:31:45.673479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067251:4235], now have 1 active actors on pipe
2025-10-10T14:31:45.673485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600736980857406:3658]
2025-10-10T14:31:45.673486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600736980857406:3658]
2025-10-10T14:31:45.673488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600736980857406:3658]
2025-10-10T14:31:45.673497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:45.673506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:45.673519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:45.673522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:45.673525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:45.673525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:45.673527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:45.673519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 301
2025-10-10T14:31:45.673526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 301
2025-10-10T14:31:45.673544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600736980857406:3658]
2025-10-10T14:31:45.673551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:45.673566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:45.673564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 301, pipe: [1:7559600737763067251:4235]
2025-10-10T14:31:45.673583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.673592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.673620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.673625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.673629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_4_7117977482433792610_v1 on pipe: [1:7559600737763067251:4235]
2025-10-10T14:31:45.673653Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_4_7117977482433792610_v1:1 with generation 301
2025-10-10T14:31:45.673657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c317841-e53cf15e-67f76c38-b72632dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:45.673662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.673665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.673666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:45.673673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.673684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:45.673695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.673699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.673700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:45.673715Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_4_7117977482433792610_v1
2025-10-10T14:31:45.673722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.673744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.673773Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:31:45.673860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.673867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.673879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.673956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 302 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c317841-e53cf15e-67f76c38-b72632dc_0
2025-10-10T14:31:45.674269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a79f10e-6a083bcb-f189c605-7fe0cab1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c317841-e53cf15e-67f76c38-b72632dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:45.676945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c317841-e53cf15e-67f76c38-b72632dc_0] Write session: try to update token
2025-10-10T14:31:45.676961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c317841-e53cf15e-67f76c38-b72632dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:45.677962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:31:45.677990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:31:45.677998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.677999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.678001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.678016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:31:45.678026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:31:45.678159Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106705673 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:31:45.678176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:31:45.678221Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 sending to client partition status
2025-10-10T14:31:45.691020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId: src_id|1c317841-e53cf15e-67f76c38-b72632dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:45.691994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:45.692010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.692012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:45.692014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:45.692020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600736980857406:3658]
2025-10-10T14:31:45.692026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600736980857406:3658]
2025-10-10T14:31:45.692029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600736980857406:3658]
2025-10-10T14:31:45.692066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:45.692072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.692074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:45.692077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:45.692083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:45.692087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:45.692212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:45.693625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:45.796461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:45.796673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.796684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.796862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_4_7117977482433792610_v1
2025-10-10T14:31:45.796877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:45.796903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:45.796917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:45.796922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:45.796964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600737763067251:4235]
2025-10-10T14:31:45.796974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 302 reason: error at write: Disconnected sessionId: src_id|1c317841-e53cf15e-67f76c38-b72632dc_0
2025-10-10T14:31:45.797103Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_4_7117977482433792610_v1
2025-10-10T14:31:45.797152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 302 sessionId: src_id|1c317841-e53cf15e-67f76c38-b72632dc_0 is DEAD
2025-10-10T14:31:45.797317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c317841-e53cf15e-67f76c38-b72632dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:45.797339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c317841-e53cf15e-67f76c38-b72632dc_0] Write session will restart in 0.009281s
2025-10-10T14:31:45.797369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c317841-e53cf15e-67f76c38-b72632dc_0] Write session: Do CDS request
2025-10-10T14:31:45.797373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c317841-e53cf15e-67f76c38-b72632dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:45.805823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:45.807766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:45.807858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c317841-e53cf15e-67f76c38-b72632dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.807930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:45.807941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:45.807942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 303
2025-10-10T14:31:45.807952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:45.807962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:45.808003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:45.808034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600736980857545:3660]
2025-10-10T14:31:45.808063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.808094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:45.808102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:45.808105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:45.808424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:45.808465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 303 sessionId:  describe result for acl check
2025-10-10T14:31:45.808494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:45.808499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:45.808500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:45.808504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600737763067391:4240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:45.808639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:45.808671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:45.808884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:45.808921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.808926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.808926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.808927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.808928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.808928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.808938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600737763067391:4240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:45.808929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.808930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.808931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.808931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.808932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.808932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.808933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.808936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.808944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.808946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.808949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.808951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.808953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.808956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.808958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.808962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.808966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.808970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.808973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.808977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.808983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.808991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.808997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.809003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.809007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.809012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.809015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.809019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.809022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.809026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.809028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.809032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.809034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.809037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.809040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.809042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.809045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.809048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.809050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.809053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.809056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.809059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.809061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.809064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.809067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.809070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.809092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:45.810880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600737763067391:4240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:45.811237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:45.811570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:45.811580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:45.811583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:45.811587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:45.811592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 302 [2:7559600736980857545:3660]
2025-10-10T14:31:45.811604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:45.811619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:45.811626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.811630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.811632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.811648Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:45.811655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:45.811662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:45.811721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.811728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.811730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.811732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:45.811793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:45.811800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.811812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.811828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.811846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:45.811869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067298:2438], now have 1 active actors on pipe
2025-10-10T14:31:45.811881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600736980857540:3660]
2025-10-10T14:31:45.811883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600736980857540:3660]
2025-10-10T14:31:45.811886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600736980857540:3660]
2025-10-10T14:31:45.811900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:45.811912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:45.811915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:45.811894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 302
2025-10-10T14:31:45.811917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:45.811926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:45.811943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:45.811946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:45.811976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600736980857540:3660]
2025-10-10T14:31:45.811987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:45.812007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:45.816367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600737763067391:4240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:45.816381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600737763067391:4240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:45.816384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600737763067391:4240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:45.816393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:45.816672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 302
2025-10-10T14:31:45.816873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067428:4240], now have 1 active actors on pipe
2025-10-10T14:31:45.816896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.816902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.816929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:45.816942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.816946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.816948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:45.816959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.816973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:45.816990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.817153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.817158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.817170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.817247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 303 partition: 0 MaxSeqNo: 40 sessionId: src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0
2025-10-10T14:31:45.817621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c317841-e53cf15e-67f76c38-b72632dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:45.820329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0] Write session: try to update token
2025-10-10T14:31:45.820347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:45.830119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:45.830140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.830144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:45.830146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:45.830156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600736980857540:3660]
2025-10-10T14:31:45.830161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600736980857540:3660]
2025-10-10T14:31:45.830167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600736980857540:3660]
2025-10-10T14:31:45.830215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:45.830227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:45.830230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:45.830241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:45.830253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.830256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:45.830401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:45.834647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId: src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:45.837014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:45.897137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600737763067431:4235]
2025-10-10T14:31:45.897345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 302, pipe: [1:7559600737763067431:4235]
2025-10-10T14:31:45.932576Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:45.932738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.932748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.932783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067431:4235], now have 1 active actors on pipe
2025-10-10T14:31:45.932942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:45.932926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600737763067431:4235]
2025-10-10T14:31:45.932949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:45.932951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:45.933005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 303 reason: error at write: Disconnected sessionId: src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0
2025-10-10T14:31:45.933276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 303 sessionId: src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0 is DEAD
2025-10-10T14:31:45.933388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:45.933400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0] Write session will restart in 0.005754s
2025-10-10T14:31:45.933425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0] Write session: Do CDS request
2025-10-10T14:31:45.933431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:45.933593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:45.940864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.940948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:45.940971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 304
2025-10-10T14:31:45.941109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:45.941138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:45.941145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:45.941149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:45.941571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 304 sessionId:  describe result for acl check
2025-10-10T14:31:45.941600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:45.941605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:45.941608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:45.941613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600737763067537:4250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:45.941613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:45.942152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600737763067537:4250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:45.943155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:45.943322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:45.943331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:45.943343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:45.943401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:45.943441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600736980857709:3673]
2025-10-10T14:31:45.943816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600737763067537:4250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:45.943966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:45.944196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:45.944234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:45.944471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:45.944524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.944529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.944530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.944531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.944532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.944533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.944534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.944535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.944536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.944537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.944538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.944539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.944540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.944545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.944557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.944561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.944565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.944569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.944573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.944578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.944582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.944586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.944590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.944594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.944597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.944601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.944608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.944616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:45.944622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.944628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:45.944632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.944638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:45.944642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.944648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:45.944653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.944657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:45.944661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.944666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:45.944671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.944676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:45.944680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.944689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:45.944696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.944701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:45.944709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.944714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:45.944719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.944726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.944730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.944736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.944744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.944749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.944792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:45.946722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600737763067537:4250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:45.946731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600737763067537:4250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:45.946733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600737763067537:4250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:45.946741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:45.946775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:45.947067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:45.947076Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:45.947077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:45.947080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:45.947083Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 303 [2:7559600736980857709:3673]
2025-10-10T14:31:45.947091Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:45.947103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:45.947108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.947110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.947111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.947122Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:45.947131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:45.947140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:45.947178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.947183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.947184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.947186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:45.947230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:45.947237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.947243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:45.947250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:45.947259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:45.947275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067570:4250], now have 1 active actors on pipe
2025-10-10T14:31:45.947281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600737763067445:2438], now have 1 active actors on pipe
2025-10-10T14:31:45.947286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600736980857704:3673]
2025-10-10T14:31:45.947288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600736980857704:3673]
2025-10-10T14:31:45.947289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600736980857704:3673]
2025-10-10T14:31:45.947292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 303
2025-10-10T14:31:45.947298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:45.947309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:45.947318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:45.947323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:45.947330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:45.947332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:45.947333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:45.947339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600736980857704:3673]
2025-10-10T14:31:45.947320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 303
2025-10-10T14:31:45.947341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:45.947351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:45.947355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.947358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.947388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2141185-31bba210-39284879-27a7d04d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:45.947399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:45.947403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:45.947405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:45.947415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:45.947428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:45.947448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.947547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:45.947553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:45.947565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:45.947622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 304 partition: 0 MaxSeqNo: 40 sessionId: src_id|b2141185-31bba210-39284879-27a7d04d_0
2025-10-10T14:31:45.947925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d61faf82-6dfe4285-68ab2b11-a6348fdd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b2141185-31bba210-39284879-27a7d04d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:45.950416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2141185-31bba210-39284879-27a7d04d_0] Write session: try to update token
2025-10-10T14:31:45.950433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2141185-31bba210-39284879-27a7d04d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:45.964011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId: src_id|b2141185-31bba210-39284879-27a7d04d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:45.965544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:45.965561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:45.965563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:45.965564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:45.965571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600736980857704:3673]
2025-10-10T14:31:45.965574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600736980857704:3673]
2025-10-10T14:31:45.965577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600736980857704:3673]
2025-10-10T14:31:45.965620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:45.965633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:45.965635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:45.965635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:45.965644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:45.965649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:45.965757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:45.966558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:46.033376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600742058034886:4235]
2025-10-10T14:31:46.033712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 303, pipe: [1:7559600742058034886:4235]
2025-10-10T14:31:46.068535Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:46.068752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.068764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.068798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058034886:4235], now have 1 active actors on pipe
2025-10-10T14:31:46.069046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:46.069026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:46.069040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:46.069049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600742058034886:4235]
2025-10-10T14:31:46.069077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:46.069098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 304 reason: error at write: Disconnected sessionId: src_id|b2141185-31bba210-39284879-27a7d04d_0
2025-10-10T14:31:46.069321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 304 sessionId: src_id|b2141185-31bba210-39284879-27a7d04d_0 is DEAD
2025-10-10T14:31:46.069491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2141185-31bba210-39284879-27a7d04d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:46.069503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2141185-31bba210-39284879-27a7d04d_0] Write session will restart in 0.005697s
2025-10-10T14:31:46.069526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2141185-31bba210-39284879-27a7d04d_0] Write session: Do CDS request
2025-10-10T14:31:46.069535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2141185-31bba210-39284879-27a7d04d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:46.076842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2141185-31bba210-39284879-27a7d04d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.076913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:46.076926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 305
2025-10-10T14:31:46.077044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.077083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:46.077103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:46.077111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:46.077503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 305 sessionId:  describe result for acl check
2025-10-10T14:31:46.077528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:46.077533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:46.077534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:46.077538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600742058034978:4257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:46.078002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600742058034978:4257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:46.078484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:46.079663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600742058034978:4257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:46.080422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:46.080612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:46.080621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:46.080630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:46.080678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:46.080712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600741275825145:3677]
2025-10-10T14:31:46.081131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:46.081385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:46.081416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:46.081633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:46.081672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.081677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.081677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.081678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.081679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.081680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.081680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.081681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.081682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.081682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.081683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.081684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.081685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.081689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.081698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.081701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.081703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.081705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.081707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.081710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.081712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.081714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.081717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.081719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.081722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.081724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.081730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.081735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.081741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.081745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.081747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.081751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.081753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.081757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.081760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.081763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.081766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.081770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.081774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.081777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.081781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.081785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.081787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.081790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.081794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.081800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.081807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.081814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.081822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.081827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.081832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.081839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.081861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:46.082114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600742058034978:4257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:46.082133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600742058034978:4257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:46.082136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600742058034978:4257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:46.082142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:46.083968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:46.084304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:46.084316Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:46.084318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:46.084322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:46.084327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 304 [2:7559600741275825145:3677]
2025-10-10T14:31:46.084336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:46.084348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:46.084350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.084353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.084354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.084368Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:46.084376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:46.084383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:46.084556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.084562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.084564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.084565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:46.084615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:46.084621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.084629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.084635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.084651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:46.084671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058034887:2438], now have 1 active actors on pipe
2025-10-10T14:31:46.084677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035015:4257], now have 1 active actors on pipe
2025-10-10T14:31:46.084683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600741275825139:3677]
2025-10-10T14:31:46.084685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600741275825139:3677]
2025-10-10T14:31:46.084686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600741275825139:3677]
2025-10-10T14:31:46.084696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:46.084698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 304
2025-10-10T14:31:46.084701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 304
2025-10-10T14:31:46.084711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:46.084722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:46.084722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:46.084724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:46.084725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:46.084726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:46.084746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600741275825139:3677]
2025-10-10T14:31:46.084748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:46.084755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:46.084760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.084763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.084798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:46.084809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.084812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.084813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:46.084821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.084829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:46.084846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.084968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.084974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.084986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.085052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 305 partition: 0 MaxSeqNo: 40 sessionId: src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0
2025-10-10T14:31:46.085420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2141185-31bba210-39284879-27a7d04d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:46.087922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0] Write session: try to update token
2025-10-10T14:31:46.087941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:46.101848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId: src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:46.102307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:46.102325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:46.102328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:46.102329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:46.102337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600741275825139:3677]
2025-10-10T14:31:46.102340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600741275825139:3677]
2025-10-10T14:31:46.102344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600741275825139:3677]
2025-10-10T14:31:46.102388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:46.102396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:46.102399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:46.102411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:46.102422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.102424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:46.102549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:46.104298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:46.169020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600742058035035:4235]
2025-10-10T14:31:46.169300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 304, pipe: [1:7559600742058035035:4235]
2025-10-10T14:31:46.203452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:46.203682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.203695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.203740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035035:4235], now have 1 active actors on pipe
2025-10-10T14:31:46.203890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:46.203987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:46.203999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:46.204040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:46.204060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 305 reason: error at write: Disconnected sessionId: src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0
2025-10-10T14:31:46.204082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600742058035035:4235]
2025-10-10T14:31:46.204199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 305 sessionId: src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0 is DEAD
2025-10-10T14:31:46.204303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:46.204314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0] Write session will restart in 0.009063s
2025-10-10T14:31:46.204338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0] Write session: Do CDS request
2025-10-10T14:31:46.204344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:46.212391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:46.214237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:46.214411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:46.214421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:46.214432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:46.214481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:46.214521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600741275825290:3680]
2025-10-10T14:31:46.214769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.214909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:46.214895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:46.214910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 306
2025-10-10T14:31:46.215028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.215056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:46.215068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:46.215073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:46.215198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:46.215235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:46.215447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:46.215471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 306 sessionId:  describe result for acl check
2025-10-10T14:31:46.215497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.215505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.215506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.215507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.215508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:46.215508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.215514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:46.215509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.215515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:46.215510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.215521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600742058035133:4262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:46.215512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.215513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.215514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.215515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.215516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.215517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.215522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.215535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.215540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.215544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.215548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.215553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.215557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.215561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.215565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.215570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.215574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.215578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.215582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.215590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.215599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.215608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.215618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.215622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.215626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.215632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.215637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.215646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.215652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.215658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.215664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.215672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.215677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.215682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.215691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.215696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.215705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.215710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.215716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.215724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.215729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.215737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.215743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.215748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.215755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.215796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:46.216051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600742058035133:4262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:46.217916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:46.217961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600742058035133:4262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:46.218400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:46.218410Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:46.218412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:46.218415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:46.218420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 305 [2:7559600741275825290:3680]
2025-10-10T14:31:46.218430Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:46.218446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:46.218449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.218452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.218454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.218470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:46.218477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:46.218490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:46.218532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.218538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.218540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.218543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:46.218601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:46.218608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.218619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.218630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.218647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:46.218671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035036:2438], now have 1 active actors on pipe
2025-10-10T14:31:46.218682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600741275825285:3680]
2025-10-10T14:31:46.218684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600741275825285:3680]
2025-10-10T14:31:46.218686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600741275825285:3680]
2025-10-10T14:31:46.218681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 305
2025-10-10T14:31:46.218699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:46.218709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:46.218713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:46.218716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:46.218716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:46.218733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:46.218739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:46.218764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600741275825285:3680]
2025-10-10T14:31:46.218774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:46.218778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:46.222926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600742058035133:4262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:46.222937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600742058035133:4262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:46.222939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600742058035133:4262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:46.222945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:46.223138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035169:4262], now have 1 active actors on pipe
2025-10-10T14:31:46.223171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 305
2025-10-10T14:31:46.223240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.223253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.223276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:46.223288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.223291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.223292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:46.223301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.223322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:46.223336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.223488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.223495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.223508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.223569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 306 partition: 0 MaxSeqNo: 40 sessionId: src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0
2025-10-10T14:31:46.223833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cea1c4f-245ae44c-455281d1-4ae484aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:46.226349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0] Write session: try to update token
2025-10-10T14:31:46.226366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:46.235940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:46.235957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:46.235960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:46.235962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:46.235972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600741275825285:3680]
2025-10-10T14:31:46.235975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600741275825285:3680]
2025-10-10T14:31:46.235979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600741275825285:3680]
2025-10-10T14:31:46.236023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:46.236029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.236032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:46.236037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:46.236053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:46.236057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:46.236167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:46.239944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId: src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:46.242304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:46.304185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600742058035176:4235]
2025-10-10T14:31:46.304462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 305, pipe: [1:7559600742058035176:4235]
2025-10-10T14:31:46.337287Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:46.337542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.337556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.337599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035176:4235], now have 1 active actors on pipe
2025-10-10T14:31:46.337771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:46.337820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:46.337831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:46.337842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:46.337885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 306 reason: error at write: Disconnected sessionId: src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0
2025-10-10T14:31:46.337887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600742058035176:4235]
2025-10-10T14:31:46.338065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 306 sessionId: src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0 is DEAD
2025-10-10T14:31:46.338203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:46.338214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0] Write session will restart in 0.006823s
2025-10-10T14:31:46.338238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0] Write session: Do CDS request
2025-10-10T14:31:46.338244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:46.345861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.345976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:46.345988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 307
2025-10-10T14:31:46.346117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.346144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:46.346153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:46.346156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:46.346559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 307 sessionId:  describe result for acl check
2025-10-10T14:31:46.346593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:46.346598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:46.346600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:46.346606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600742058035270:4268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:46.347145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600742058035270:4268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:46.347682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:46.348981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600742058035270:4268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:46.349580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:46.349744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:46.349762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:46.349772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:46.349814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:46.349845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600741275825423:3682]
2025-10-10T14:31:46.350223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:46.350449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:46.350480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:46.350714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:46.350756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.350761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.350762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.350762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.350763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.350763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.350764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.350765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.350765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.350766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.350766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.350767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.350768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.350771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.350779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.350781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.350784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.350786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.350788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.350790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.350792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.350795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.350797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.350800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.350804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.350807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.350815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.350824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.350830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.350833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.350836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.350839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.350841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.350844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.350847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.350850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.350852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.350855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.350858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.350861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.350864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.350867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.350870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.350873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.350875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.350878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.350881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.350884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.350887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.350890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.350893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.350896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.350917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:46.351348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600742058035270:4268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:46.351361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600742058035270:4268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:46.351364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600742058035270:4268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:46.351382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:46.353082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:46.353436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:46.353448Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:46.353450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:46.353454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:46.353471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 306 [2:7559600741275825423:3682]
2025-10-10T14:31:46.353487Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:46.353512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:46.353515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.353518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.353521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.353538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:46.353551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:46.353561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:46.353624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.353632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.353634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.353636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:46.353701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:46.353710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.353721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.353733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.353745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:46.353768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035307:4268], now have 1 active actors on pipe
2025-10-10T14:31:46.353777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035177:2438], now have 1 active actors on pipe
2025-10-10T14:31:46.353785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600741275825418:3682]
2025-10-10T14:31:46.353788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600741275825418:3682]
2025-10-10T14:31:46.353790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600741275825418:3682]
2025-10-10T14:31:46.353804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:46.353813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:46.353816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:46.353818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:46.353819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:46.353835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:46.353813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 306
2025-10-10T14:31:46.353825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 306
2025-10-10T14:31:46.353837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:46.353858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600741275825418:3682]
2025-10-10T14:31:46.353865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:46.353878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:46.353938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.353947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.353982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75077057-fe16677b-151220fd-90454100_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:46.353995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.354000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.354002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:46.354014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.354026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:46.354047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.354197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.354204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.354215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.354276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 307 partition: 0 MaxSeqNo: 40 sessionId: src_id|75077057-fe16677b-151220fd-90454100_0
2025-10-10T14:31:46.354622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41b7334-1ae2c547-2cfc24ab-71cbe13d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75077057-fe16677b-151220fd-90454100_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:46.357070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75077057-fe16677b-151220fd-90454100_0] Write session: try to update token
2025-10-10T14:31:46.357083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75077057-fe16677b-151220fd-90454100_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:46.370400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId: src_id|75077057-fe16677b-151220fd-90454100_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:46.372204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:46.372219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:46.372221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:46.372223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:46.372231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600741275825418:3682]
2025-10-10T14:31:46.372234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600741275825418:3682]
2025-10-10T14:31:46.372237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600741275825418:3682]
2025-10-10T14:31:46.372277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:46.372283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.372281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:46.372285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:46.372288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:46.372292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:46.372436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:46.373215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:46.437858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600742058035315:4235]
2025-10-10T14:31:46.438124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 306, pipe: [1:7559600742058035315:4235]
2025-10-10T14:31:46.477362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:46.477770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.477781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.477819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035315:4235], now have 1 active actors on pipe
2025-10-10T14:31:46.477976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:46.478039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:46.478043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:46.478047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:46.478089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600742058035315:4235]
2025-10-10T14:31:46.478107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 307 reason: error at write: Disconnected sessionId: src_id|75077057-fe16677b-151220fd-90454100_0
2025-10-10T14:31:46.478301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 307 sessionId: src_id|75077057-fe16677b-151220fd-90454100_0 is DEAD
2025-10-10T14:31:46.478429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75077057-fe16677b-151220fd-90454100_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:46.478440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75077057-fe16677b-151220fd-90454100_0] Write session will restart in 0.009431s
2025-10-10T14:31:46.478457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75077057-fe16677b-151220fd-90454100_0] Write session: Do CDS request
2025-10-10T14:31:46.478465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75077057-fe16677b-151220fd-90454100_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:46.486938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:46.488702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:46.488791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75077057-fe16677b-151220fd-90454100_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.488872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:46.488907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:46.488917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:46.488927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:46.488883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 308
2025-10-10T14:31:46.488970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:46.488983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.489007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:46.489011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:46.489014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:46.489003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600741275825559:3684]
2025-10-10T14:31:46.489387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 308 sessionId:  describe result for acl check
2025-10-10T14:31:46.489412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:46.489414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:46.489415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:46.489419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600742058035414:4272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:46.489471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:46.489727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:46.489767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:46.489870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600742058035414:4272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:46.489992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:46.490035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.490040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.490040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.490041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.490041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.490042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.490043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.490043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.490044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.490045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.490045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.490046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.490046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.490050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.490058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.490061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.490065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.490069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.490073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.490077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.490080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.490083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.490087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.490091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.490094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.490099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.490105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.490111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.490116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.490123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.490126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.490129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.490135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.490138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.490141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.490147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.490150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.490153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.490156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.490160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.490163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.490166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.490168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.490171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.490174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.490177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.490180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.490183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.490185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.490188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.490191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.490194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.490218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:46.491937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600742058035414:4272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:46.492395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:46.492706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:46.492717Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:46.492718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:46.492721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:46.492725Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 307 [2:7559600741275825559:3684]
2025-10-10T14:31:46.492733Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:46.492745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:46.492747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.492750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.492751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.492764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:46.492773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:46.492783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:46.492822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.492827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.492828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.492830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:46.492925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:46.492932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.492939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.492945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.492954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:46.492974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035317:2438], now have 1 active actors on pipe
2025-10-10T14:31:46.492983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600741275825554:3684]
2025-10-10T14:31:46.492986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600741275825554:3684]
2025-10-10T14:31:46.492988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600741275825554:3684]
2025-10-10T14:31:46.493001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:46.493015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:46.493025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:46.493029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:46.493041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 307
2025-10-10T14:31:46.493030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:46.493032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:46.493032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:46.493050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600741275825554:3684]
2025-10-10T14:31:46.493053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:46.493063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:46.497325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600742058035414:4272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:46.497352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600742058035414:4272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:46.497356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600742058035414:4272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:46.497363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:46.497604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035452:4272], now have 1 active actors on pipe
2025-10-10T14:31:46.497639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 307
2025-10-10T14:31:46.497714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.497726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.497759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:46.497772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.497779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.497781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:46.497792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.497805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:46.497829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.498000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.498013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.498024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.498098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 308 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0
2025-10-10T14:31:46.498446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75077057-fe16677b-151220fd-90454100_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:46.500816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0] Write session: try to update token
2025-10-10T14:31:46.500828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:46.511172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:46.511191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:46.511193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:46.511195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:46.511202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600741275825554:3684]
2025-10-10T14:31:46.511206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600741275825554:3684]
2025-10-10T14:31:46.511209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600741275825554:3684]
2025-10-10T14:31:46.511249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:46.511258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.511260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:46.511273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:46.511283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:46.511288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:46.511396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:46.514130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId: src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:46.516456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:46.578117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600742058035466:4235]
2025-10-10T14:31:46.578393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 307, pipe: [1:7559600742058035466:4235]
2025-10-10T14:31:46.613327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:46.613581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.613592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.613631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035466:4235], now have 1 active actors on pipe
2025-10-10T14:31:46.613819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:46.613937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600742058035466:4235]
2025-10-10T14:31:46.613951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:46.613955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:46.613972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:46.614018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 308 reason: error at write: Disconnected sessionId: src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0
2025-10-10T14:31:46.614236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 308 sessionId: src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0 is DEAD
2025-10-10T14:31:46.614405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:46.614414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0] Write session will restart in 0.006125s
2025-10-10T14:31:46.614433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0] Write session: Do CDS request
2025-10-10T14:31:46.614437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:46.621799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.621831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:46.621844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 309
2025-10-10T14:31:46.622049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.622086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:46.622094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:46.622097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:46.622567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 309 sessionId:  describe result for acl check
2025-10-10T14:31:46.622600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:46.622601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:46.622603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:46.622608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600742058035566:4278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:46.623070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600742058035566:4278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:46.623524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:46.624914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600742058035566:4278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:46.625222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:46.625382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:46.625391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:46.625399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:46.625440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:46.625471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600741275825698:3687]
2025-10-10T14:31:46.625831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:46.626034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:46.626063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:46.626261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:46.626308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.626314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.626315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.626315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.626316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.626317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.626317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.626318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.626319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.626320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.626320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.626321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.626321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.626325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.626333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.626335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.626338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.626340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.626342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.626344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.626347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.626349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.626351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.626354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.626356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.626358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.626363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.626368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.626373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.626389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.626392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.626396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.626398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.626401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.626404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.626407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.626410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.626413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.626415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.626418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.626421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.626424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.626426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.626430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.626432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.626435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.626438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.626441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.626444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.626447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.626449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.626452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.626474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:46.628508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600742058035566:4278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:46.628522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600742058035566:4278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:46.628526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600742058035566:4278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:46.628533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:46.628614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:46.628919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:46.628929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:46.628930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:46.628933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:46.628937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 308 [2:7559600741275825698:3687]
2025-10-10T14:31:46.628945Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:46.628957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:46.628967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.628973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.628975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.628987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:46.628992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:46.628998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:46.629035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.629041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.629042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.629043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:46.629089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:46.629093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.629099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.629106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.629116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:46.629133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035603:4278], now have 1 active actors on pipe
2025-10-10T14:31:46.629139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035470:2438], now have 1 active actors on pipe
2025-10-10T14:31:46.629145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600741275825693:3687]
2025-10-10T14:31:46.629147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600741275825693:3687]
2025-10-10T14:31:46.629148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600741275825693:3687]
2025-10-10T14:31:46.629157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:46.629166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:46.629169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:46.629171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:46.629173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:46.629179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:46.629182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:46.629197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600741275825693:3687]
2025-10-10T14:31:46.629206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:46.629195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 308
2025-10-10T14:31:46.629201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 308
2025-10-10T14:31:46.629234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:46.629252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.629255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.629278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:46.629284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.629287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.629288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:46.629296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.629307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:46.629319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.629429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.629447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.629458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.629550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 309 partition: 0 MaxSeqNo: 40 sessionId: src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0
2025-10-10T14:31:46.629847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5b85578-35c7b035-e535ce5f-d02148fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:46.632391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0] Write session: try to update token
2025-10-10T14:31:46.632410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:46.645467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId: src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:46.647156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:46.647176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:46.647180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:46.647182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:46.647192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600741275825693:3687]
2025-10-10T14:31:46.647197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600741275825693:3687]
2025-10-10T14:31:46.647201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600741275825693:3687]
2025-10-10T14:31:46.647252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:46.647259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:46.647260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.647262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:46.647271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:46.647274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:46.647405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:46.647927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:46.713782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600742058035610:4235]
2025-10-10T14:31:46.714122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 308, pipe: [1:7559600742058035610:4235]
2025-10-10T14:31:46.753899Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:46.754278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.754291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.754328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035610:4235], now have 1 active actors on pipe
2025-10-10T14:31:46.754517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:46.754603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:46.754613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:46.754622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:46.754667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 309 reason: error at write: Disconnected sessionId: src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0
2025-10-10T14:31:46.754667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600742058035610:4235]
2025-10-10T14:31:46.754841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 309 sessionId: src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0 is DEAD
2025-10-10T14:31:46.755000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:46.755010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0] Write session will restart in 0.008742s
2025-10-10T14:31:46.755028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0] Write session: Do CDS request
2025-10-10T14:31:46.755033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:46.763849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:46.764764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.764862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:46.764872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 310
2025-10-10T14:31:46.764975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.764999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:46.765006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:46.765009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:46.765359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 310 sessionId:  describe result for acl check
2025-10-10T14:31:46.765382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:46.765387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:46.765388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:46.765392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600742058035710:4282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:46.765612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:46.765762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:46.765773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:46.765782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:46.765798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600742058035710:4282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:46.765819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:46.765851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600741275825836:3689]
2025-10-10T14:31:46.766224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:46.766481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:46.766519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:46.766787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:46.766836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.766842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.766843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.766844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.766845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.766846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.766847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.766848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.766849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.766850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.766851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.766852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.766853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.766858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.766869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.766873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.766877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.766881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.766885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.766889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.766892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.766895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.766897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.766899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.766900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.766902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.766907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.766912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.766916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.766919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.766922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.766925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.766927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.766930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.766933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.766936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.766939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.766942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.766945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.766948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.766950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.766953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.766956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.766959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.766961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.766964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.766966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.766969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.766971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.766974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.766978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.766981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.767002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:46.767685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600742058035710:4282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:46.769081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:46.769398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:46.769408Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:46.769410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:46.769413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:46.769418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 309 [2:7559600741275825836:3689]
2025-10-10T14:31:46.769428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:46.769442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:46.769449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.769452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.769454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.769468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:46.769477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:46.769483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:46.769518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.769524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.769525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.769526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:46.769581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:46.769588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.769597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.769608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.769627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:46.769650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035611:2438], now have 1 active actors on pipe
2025-10-10T14:31:46.769661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600741275825831:3689]
2025-10-10T14:31:46.769663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600741275825831:3689]
2025-10-10T14:31:46.769665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600741275825831:3689]
2025-10-10T14:31:46.769645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600742058035710:4282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:46.769658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600742058035710:4282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:46.769661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600742058035710:4282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:46.769667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:46.769677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:46.769687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:46.769689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:46.769691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:46.769693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:46.769709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:46.769716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:46.769705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 309
2025-10-10T14:31:46.769735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600741275825831:3689]
2025-10-10T14:31:46.769742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:46.769744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:46.769841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035744:4282], now have 1 active actors on pipe
2025-10-10T14:31:46.769865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 309
2025-10-10T14:31:46.769916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.769925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.769951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:46.769962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.769966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.769972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:46.769985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.769998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:46.770015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.770129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.770136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.770148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.770200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 310 partition: 0 MaxSeqNo: 40 sessionId: src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0
2025-10-10T14:31:46.770447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|641c0e69-c5f3a43e-ec7ddcab-e5d70d43_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:46.772884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0] Write session: try to update token
2025-10-10T14:31:46.772898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:46.785563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId: src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:46.787873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:46.787877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:46.787895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:46.787898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:46.787900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:46.787909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600741275825831:3689]
2025-10-10T14:31:46.787914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600741275825831:3689]
2025-10-10T14:31:46.787918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600741275825831:3689]
2025-10-10T14:31:46.787955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:46.787960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:46.787963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:46.787966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:46.787974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.787976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:46.788103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:46.855081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600742058035752:4235]
2025-10-10T14:31:46.855295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 309, pipe: [1:7559600742058035752:4235]
2025-10-10T14:31:46.893047Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:46.893396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.893411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.893449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035752:4235], now have 1 active actors on pipe
2025-10-10T14:31:46.893673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:46.893709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:46.893719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:46.893734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:46.893781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600742058035752:4235]
2025-10-10T14:31:46.893786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 310 reason: error at write: Disconnected sessionId: src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0
2025-10-10T14:31:46.893986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 310 sessionId: src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0 is DEAD
2025-10-10T14:31:46.894128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:46.894139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0] Write session will restart in 0.007487s
2025-10-10T14:31:46.894166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0] Write session: Do CDS request
2025-10-10T14:31:46.894175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:46.902832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.902869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:46.902879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 311
2025-10-10T14:31:46.902892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:46.903042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:46.903084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:46.903092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:46.903095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:46.903551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 311 sessionId:  describe result for acl check
2025-10-10T14:31:46.903591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:46.903595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:46.903596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:46.903603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600742058035853:4286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:46.904122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600742058035853:4286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:46.904481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:46.904640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:46.904651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:46.904661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:46.904704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:46.904743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600741275825975:3691]
2025-10-10T14:31:46.905320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:46.905557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:46.905597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:46.905902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:46.905951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.905956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.905957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.905958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.905960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.905961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.905962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.905963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.905964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.905965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.905966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.905967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.905968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.905973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.905985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.905989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.905993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.905997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.906001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.906005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.906008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.906012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.906017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.906020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.906023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.906027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.906034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.906042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:46.906048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.906053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:46.906057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.906021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600742058035853:4286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:46.906062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:46.906071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.906076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:46.906080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.906085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:46.906089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.906099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:46.906102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.906106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:46.906110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.906120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:46.906124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.906130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:46.906138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.906143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:46.906152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.906163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.906171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.906176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.906181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.906187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.906224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:46.908340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600742058035853:4286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:46.908360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:46.908353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600742058035853:4286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:46.908357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600742058035853:4286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:46.908364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:46.908684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:46.908695Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:46.908697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:46.908701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:46.908706Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 310 [2:7559600741275825975:3691]
2025-10-10T14:31:46.908718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:46.908736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:46.908744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.908747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.908749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.908766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:46.908778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:46.908790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:46.908842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.908848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.908850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.908853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:46.908913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:46.908920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.908931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:46.908944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:46.908966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:46.908992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035887:4286], now have 1 active actors on pipe
2025-10-10T14:31:46.909000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035753:2438], now have 1 active actors on pipe
2025-10-10T14:31:46.909007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600741275825970:3691]
2025-10-10T14:31:46.909009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600741275825970:3691]
2025-10-10T14:31:46.909011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600741275825970:3691]
2025-10-10T14:31:46.908993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 310
2025-10-10T14:31:46.909012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 310
2025-10-10T14:31:46.909021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:46.909033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:46.909039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:46.909045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:46.909050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:46.909055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:46.909058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:46.909079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.909088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.909118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600741275825970:3691]
2025-10-10T14:31:46.909129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:46.909142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:46.909152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a554b326-563cc168-118c966-de1d33fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:46.909159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:46.909163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:46.909170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:46.909181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:46.909195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:46.909228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.909430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:46.909438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:46.909456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:46.909531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 311 partition: 0 MaxSeqNo: 40 sessionId: src_id|a554b326-563cc168-118c966-de1d33fe_0
2025-10-10T14:31:46.909863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63621d9f-c038f13f-447f07c4-e45a7bbc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a554b326-563cc168-118c966-de1d33fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:46.912523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a554b326-563cc168-118c966-de1d33fe_0] Write session: try to update token
2025-10-10T14:31:46.912538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a554b326-563cc168-118c966-de1d33fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:46.925908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId: src_id|a554b326-563cc168-118c966-de1d33fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:46.927393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:46.927413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:46.927416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:46.927418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:46.927427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600741275825970:3691]
2025-10-10T14:31:46.927431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600741275825970:3691]
2025-10-10T14:31:46.927434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600741275825970:3691]
2025-10-10T14:31:46.927481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:46.927483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:46.927489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:46.927491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:46.927495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:46.927498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:46.927626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:46.928256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:46.993841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600742058035919:4235]
2025-10-10T14:31:46.994040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 310, pipe: [1:7559600742058035919:4235]
2025-10-10T14:31:47.033887Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:47.034276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.034293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.034338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600742058035919:4235], now have 1 active actors on pipe
2025-10-10T14:31:47.034555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:47.034565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:47.034567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:47.034568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:47.034613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600742058035919:4235]
2025-10-10T14:31:47.034625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 311 reason: error at write: Disconnected sessionId: src_id|a554b326-563cc168-118c966-de1d33fe_0
2025-10-10T14:31:47.034776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 311 sessionId: src_id|a554b326-563cc168-118c966-de1d33fe_0 is DEAD
2025-10-10T14:31:47.034905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a554b326-563cc168-118c966-de1d33fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:47.034912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a554b326-563cc168-118c966-de1d33fe_0] Write session will restart in 0.007532s
2025-10-10T14:31:47.034931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a554b326-563cc168-118c966-de1d33fe_0] Write session: Do CDS request
2025-10-10T14:31:47.034936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a554b326-563cc168-118c966-de1d33fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:47.043787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a554b326-563cc168-118c966-de1d33fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.043915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:47.043928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 312
2025-10-10T14:31:47.044082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.044115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:47.044122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:47.044126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:47.044251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:47.044474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 312 sessionId:  describe result for acl check
2025-10-10T14:31:47.044505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:47.044507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:47.044509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:47.044514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600746353003317:4299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:47.044953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600746353003317:4299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:47.045791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:47.045977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:47.045989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:47.046000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:47.046058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:47.046105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600745570793450:3706]
2025-10-10T14:31:47.046704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:47.046869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600746353003317:4299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:47.046962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:47.047004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:47.047313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:47.047367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.047375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.047376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.047377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.047378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.047379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.047380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.047381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.047383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.047384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.047385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.047386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.047387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.047392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.047404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.047408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.047413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.047417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.047421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.047425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.047428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.047433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.047438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.047442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.047446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.047449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.047457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.047465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.047472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.047478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.047482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.047487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.047492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.047497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.047502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.047509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.047514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.047519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.047523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.047529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.047533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.047538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.047543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.047548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.047552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.047557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.047562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.047567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.047571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.047576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.047580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.047591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.047633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:47.049714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600746353003317:4299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:47.049728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600746353003317:4299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:47.049733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600746353003317:4299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:47.049741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:47.049789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:47.050243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:47.050257Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:47.050259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:47.050263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:47.050268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 311 [2:7559600745570793450:3706]
2025-10-10T14:31:47.050280Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:47.050296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:47.050304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.050308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.050310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.050325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:47.050337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:47.050348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:47.050414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.050421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.050423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.050425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:47.050487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:47.050495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.050506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.050518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.050541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:47.050567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003216:2438], now have 1 active actors on pipe
2025-10-10T14:31:47.050558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 311
2025-10-10T14:31:47.050575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003351:4299], now have 1 active actors on pipe
2025-10-10T14:31:47.050582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600745570793444:3706]
2025-10-10T14:31:47.050577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 311
2025-10-10T14:31:47.050584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600745570793444:3706]
2025-10-10T14:31:47.050586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600745570793444:3706]
2025-10-10T14:31:47.050595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:47.050602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:47.050604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:47.050606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:47.050607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:47.050623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:47.050631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:47.050652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.050661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.050693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600745570793444:3706]
2025-10-10T14:31:47.050706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:47.050729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:47.050730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:47.050738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.050741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.050744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:47.050756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.050765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:47.050799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.050939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.050947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.050960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.051039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 312 partition: 0 MaxSeqNo: 40 sessionId: src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0
2025-10-10T14:31:47.051323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a554b326-563cc168-118c966-de1d33fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:47.054559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0] Write session: try to update token
2025-10-10T14:31:47.054580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:47.066979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:47.066998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.067010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600745570793444:3706]
2025-10-10T14:31:47.067062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:47.067061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:47.067225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:47.067378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:47.067525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:47.067668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:47.067858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:47.067905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:47.068914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId: src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:47.071315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:47.071508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.071528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.071564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:47.071645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:47.078480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:47.078497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.078501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:47.078503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:47.078513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600745570793444:3706]
2025-10-10T14:31:47.078518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600745570793444:3706]
2025-10-10T14:31:47.078521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600745570793444:3706]
2025-10-10T14:31:47.078555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:47.078560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:47.078564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:47.078565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:47.078572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.078575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:47.078704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:47.134656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600746353003371:4235]
2025-10-10T14:31:47.134924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 311, pipe: [1:7559600746353003371:4235]
2025-10-10T14:31:47.182949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:47.189438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.189460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.189602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.189657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.189713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.189771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.189810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.189819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.189875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.189925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.189981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.190037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.190077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.190082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.190139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.190191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.190245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.190298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.190336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.190342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.190408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.190465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.190519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.190573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.190610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.190615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.190670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.190726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.190787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.190853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.190903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.190909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.190965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.191016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.191069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.191130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.191180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.191185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.191238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.191291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.191345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.191401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.191439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.191444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.191497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.191546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.191600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.191656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.191693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.191697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.191756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.191807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.191861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.191934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.191973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.191978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.192033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.192085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.192139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.192192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.192231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.192236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.192272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003371:4235], now have 1 active actors on pipe
2025-10-10T14:31:47.192520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:47.192520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600746353003371:4235]
2025-10-10T14:31:47.192532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:47.192539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:47.192571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 312 reason: error at write: Disconnected sessionId: src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0
2025-10-10T14:31:47.192767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 312 sessionId: src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0 is DEAD
2025-10-10T14:31:47.192894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:47.192904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0] Write session will restart in 0.006702s
2025-10-10T14:31:47.192925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0] Write session: Do CDS request
2025-10-10T14:31:47.192930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:47.193020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:47.200808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.200870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:47.200882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 313
2025-10-10T14:31:47.201025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.201057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:47.201068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:47.201072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:47.201478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 313 sessionId:  describe result for acl check
2025-10-10T14:31:47.201509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:47.201510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:47.201512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:47.201516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600746353003472:4304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:47.201908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:47.201937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600746353003472:4304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:47.203429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:47.203584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:47.203603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:47.203614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:47.203660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:47.203690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600745570793602:3709]
2025-10-10T14:31:47.204080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:47.204189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600746353003472:4304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:47.204285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:47.204320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:47.204526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:47.204567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.204573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.204574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.204576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.204577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.204578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.204580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.204581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.204582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.204583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.204584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.204586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.204587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.204591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.204598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.204601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.204603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.204605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.204607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.204609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.204611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.204613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.204615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.204617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.204619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.204621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.204626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.204631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.204636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.204639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.204642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.204645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.204647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.204651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.204653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.204656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.204658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.204662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.204665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.204668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.204670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.204673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.204676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.204679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.204681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.204684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.204687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.204690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.204693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.204696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.204700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.204703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.204724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:47.206693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600746353003472:4304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:47.206705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600746353003472:4304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:47.206709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600746353003472:4304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:47.206715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:47.206739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:47.207211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:47.207222Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:47.207224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:47.207226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:47.207230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 312 [2:7559600745570793602:3709]
2025-10-10T14:31:47.207238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:47.207251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:47.207252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.207255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.207256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.207268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:47.207273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:47.207279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:47.207317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.207323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.207324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.207326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:47.207371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:47.207377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.207387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.207398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.207414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:47.207439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003508:4304], now have 1 active actors on pipe
2025-10-10T14:31:47.207446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003372:2438], now have 1 active actors on pipe
2025-10-10T14:31:47.207453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600745570793597:3709]
2025-10-10T14:31:47.207455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600745570793597:3709]
2025-10-10T14:31:47.207458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600745570793597:3709]
2025-10-10T14:31:47.207470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:47.207480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:47.207483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:47.207484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:47.207488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:47.207503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:47.207510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:47.207494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 312
2025-10-10T14:31:47.207494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 312
2025-10-10T14:31:47.207536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600745570793597:3709]
2025-10-10T14:31:47.207544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:47.207549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:47.207555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.207560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.207592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6d35500-50129228-54b03ca4-9ebaab41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:47.207603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.207605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.207607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:47.207614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.207622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:47.207638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.207781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.207795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.207824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.207906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 313 partition: 0 MaxSeqNo: 40 sessionId: src_id|a6d35500-50129228-54b03ca4-9ebaab41_0
2025-10-10T14:31:47.208166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4decf3ea-e0c48876-b06a028-377f9e5e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a6d35500-50129228-54b03ca4-9ebaab41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:47.210573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d35500-50129228-54b03ca4-9ebaab41_0] Write session: try to update token
2025-10-10T14:31:47.210590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d35500-50129228-54b03ca4-9ebaab41_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:47.224113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId: src_id|a6d35500-50129228-54b03ca4-9ebaab41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:47.225697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:47.225721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.225723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:47.225725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:47.225734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600745570793597:3709]
2025-10-10T14:31:47.225738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600745570793597:3709]
2025-10-10T14:31:47.225742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600745570793597:3709]
2025-10-10T14:31:47.225786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:47.225793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.225795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:47.225799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:47.225816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:47.225820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:47.225941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:47.226429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:47.292865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600746353003516:4235]
2025-10-10T14:31:47.293136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 312, pipe: [1:7559600746353003516:4235]
2025-10-10T14:31:47.332111Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:47.332421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.332435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.332469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003516:4235], now have 1 active actors on pipe
2025-10-10T14:31:47.332708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:47.332756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:47.332761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:47.332764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600746353003516:4235]
2025-10-10T14:31:47.332832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 313 reason: error at write: Disconnected sessionId: src_id|a6d35500-50129228-54b03ca4-9ebaab41_0
2025-10-10T14:31:47.332948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:47.333037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 313 sessionId: src_id|a6d35500-50129228-54b03ca4-9ebaab41_0 is DEAD
2025-10-10T14:31:47.333165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d35500-50129228-54b03ca4-9ebaab41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:47.333174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d35500-50129228-54b03ca4-9ebaab41_0] Write session will restart in 0.006183s
2025-10-10T14:31:47.333197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d35500-50129228-54b03ca4-9ebaab41_0] Write session: Do CDS request
2025-10-10T14:31:47.333203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d35500-50129228-54b03ca4-9ebaab41_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:47.340768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d35500-50129228-54b03ca4-9ebaab41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.340852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:47.340862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 314
2025-10-10T14:31:47.340951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.340991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:47.340999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:47.341002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:47.341349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 314 sessionId:  describe result for acl check
2025-10-10T14:31:47.341377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:47.341382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:47.341384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:47.341389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600746353003617:4308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:47.341831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600746353003617:4308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:47.342218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:47.343654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:47.343795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600746353003617:4308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:47.343791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:47.343811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:47.343819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:47.343857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:47.343887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600745570793742:3711]
2025-10-10T14:31:47.344261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:47.344461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:47.344488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:47.344682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:47.344719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.344723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.344724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.344724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.344725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.344726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.344727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.344727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.344728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.344729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.344730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.344731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.344731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.344735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.344743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.344745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.344748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.344750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.344752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.344754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.344756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.344758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.344760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.344762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.344764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.344767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.344771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.344777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.344781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.344785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.344787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.344790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.344793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.344796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.344800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.344802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.344805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.344808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.344811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.344815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.344817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.344820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.344823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.344826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.344828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.344831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.344834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.344837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.344839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.344843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.344846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.344858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.344879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:47.346854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600746353003617:4308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:47.346866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600746353003617:4308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:47.346869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600746353003617:4308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:47.346876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:47.346964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:47.347252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:47.347262Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:47.347264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:47.347266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:47.347270Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 313 [2:7559600745570793742:3711]
2025-10-10T14:31:47.347278Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:47.347290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:47.347292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.347294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.347295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.347305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:47.347310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:47.347320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:47.347359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.347364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.347366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.347368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:47.347426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:47.347432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.347439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.347445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.347455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:47.347474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003517:2438], now have 1 active actors on pipe
2025-10-10T14:31:47.347480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003654:4308], now have 1 active actors on pipe
2025-10-10T14:31:47.347486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600745570793737:3711]
2025-10-10T14:31:47.347487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600745570793737:3711]
2025-10-10T14:31:47.347489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600745570793737:3711]
2025-10-10T14:31:47.347497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:47.347510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:47.347513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:47.347516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:47.347518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:47.347522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:47.347525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:47.347530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 313
2025-10-10T14:31:47.347546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 313
2025-10-10T14:31:47.347542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600745570793737:3711]
2025-10-10T14:31:47.347547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:47.347560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:47.347586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.347593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.347615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:47.347623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.347627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.347628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:47.347636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.347646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:47.347660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.347758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.347763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.347774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.347843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 314 partition: 0 MaxSeqNo: 40 sessionId: src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0
2025-10-10T14:31:47.348092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6d35500-50129228-54b03ca4-9ebaab41_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:47.350508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0] Write session: try to update token
2025-10-10T14:31:47.350523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:47.358553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:47.358583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.358594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600745570793737:3711]
2025-10-10T14:31:47.358637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:47.358640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:47.358834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:47.358995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:47.359150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:47.359306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:47.359539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:47.359588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:47.364118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId: src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:47.366607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:47.366818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.366840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.366879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:47.367079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:47.374800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:47.374817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.374819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:47.374821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:47.374830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600745570793737:3711]
2025-10-10T14:31:47.374833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600745570793737:3711]
2025-10-10T14:31:47.374835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600745570793737:3711]
2025-10-10T14:31:47.374871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:47.374882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.374881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:47.374887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:47.374889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:47.374893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:47.375010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:47.433166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600746353003661:4235]
2025-10-10T14:31:47.433456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 313, pipe: [1:7559600746353003661:4235]
2025-10-10T14:31:47.477529Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:47.485076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.485100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.485275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.485352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.485426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.485486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.485790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.485800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.485864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.485919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.485988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.486054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.486097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.486105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.486168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.486228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.486287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.486350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.486399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.486408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.486467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.486529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.486587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.486644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.486683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.486691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.486754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.486810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.486871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.486930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.486969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.486975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.487037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.487092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.487154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.487214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.487256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.487263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.487322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.487381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.487439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.487495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.487539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.487547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.487609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.487663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.487718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.487778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.488022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.488030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.488089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.488156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.488212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.488270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.488309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.488316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.488375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:47.488429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:47.488484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:47.488542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:47.488608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:47.488616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:47.488668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003661:4235], now have 1 active actors on pipe
2025-10-10T14:31:47.488954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:47.488973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600746353003661:4235]
2025-10-10T14:31:47.489004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:47.489012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:47.489041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 314 reason: error at write: Disconnected sessionId: src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0
2025-10-10T14:31:47.489092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:47.489260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 314 sessionId: src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0 is DEAD
2025-10-10T14:31:47.489415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:47.489429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0] Write session will restart in 0.008327s
2025-10-10T14:31:47.489454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0] Write session: Do CDS request
2025-10-10T14:31:47.489459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:47.498846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.498894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:47.498903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 315
2025-10-10T14:31:47.498937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:47.499084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.499111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:47.499118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:47.499124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:47.499514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 315 sessionId:  describe result for acl check
2025-10-10T14:31:47.499551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:47.499558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:47.499560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:47.499566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600746353003767:4312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:47.500058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600746353003767:4312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:47.500715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:47.500856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:47.500867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:47.500876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:47.500912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:47.500946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600745570793886:3713]
2025-10-10T14:31:47.501301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:47.501533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:47.501561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:47.501775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:47.501811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.501815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.501816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.501817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.501817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.501818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.501819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.501819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.501820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.501821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.501821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.501822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.501823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.501826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.501833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.501836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.501838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.501840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.501842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.501845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.501847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.501849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.501852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.501854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.501856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.501858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.501864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.501869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.501873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.501877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.501879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.501882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.501885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.501888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.501890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.501894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.501896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.501899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.501902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.501905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.501908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.501911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.501915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.501918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.501921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.501924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.501926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.501930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.501932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.501936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.501938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.501941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.501963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:47.502672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600746353003767:4312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:47.504053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:47.504354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:47.504362Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:47.504364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:47.504367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:47.504371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 314 [2:7559600745570793886:3713]
2025-10-10T14:31:47.504379Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:47.504391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:47.504394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.504397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.504408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.504429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:47.504442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:47.504454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:47.504501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.504506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.504508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.504509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:47.504583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:47.504588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.504595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.504610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.504624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:47.504642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003663:2438], now have 1 active actors on pipe
2025-10-10T14:31:47.504648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600745570793880:3713]
2025-10-10T14:31:47.504649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600745570793880:3713]
2025-10-10T14:31:47.504651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600745570793880:3713]
2025-10-10T14:31:47.504646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 314
2025-10-10T14:31:47.504667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:47.504672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:47.504680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:47.504675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:47.504683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:47.504690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:47.504692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:47.504714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600745570793880:3713]
2025-10-10T14:31:47.504723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:47.504733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:47.504876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600746353003767:4312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:47.504889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600746353003767:4312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:47.504892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600746353003767:4312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:47.504899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:47.505071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003803:4312], now have 1 active actors on pipe
2025-10-10T14:31:47.505141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 314
2025-10-10T14:31:47.505197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.505208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.505232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:47.505241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.505245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.505248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:47.505257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.505267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:47.505281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.505435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.505441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.505452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.505509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 315 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0
2025-10-10T14:31:47.505802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67fb5b3f-12e6c1fe-94c15162-7aa2fbbd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:47.508412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0] Write session: try to update token
2025-10-10T14:31:47.508430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:47.521815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId: src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:47.522737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:47.522755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.522757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:47.522759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:47.522766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600745570793880:3713]
2025-10-10T14:31:47.522768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600745570793880:3713]
2025-10-10T14:31:47.522773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600745570793880:3713]
2025-10-10T14:31:47.522810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:47.522810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:47.522816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:47.522819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.522820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:47.522821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:47.522956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:47.524330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:47.589319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600746353003819:4235]
2025-10-10T14:31:47.589579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 314, pipe: [1:7559600746353003819:4235]
2025-10-10T14:31:47.623471Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:47.623671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.623683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.623720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003819:4235], now have 1 active actors on pipe
2025-10-10T14:31:47.623875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:47.623912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:47.623937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600746353003819:4235]
2025-10-10T14:31:47.623969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:47.624041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 315 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0
2025-10-10T14:31:47.624211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 315 sessionId: src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0 is DEAD
2025-10-10T14:31:47.624395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:47.624417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0] Write session will restart in 0.005538s
2025-10-10T14:31:47.624440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0] Write session: Do CDS request
2025-10-10T14:31:47.624446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:47.630754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.630829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:47.630838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 316
2025-10-10T14:31:47.630986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.631020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:47.631030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:47.631033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:47.631343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 316 sessionId:  describe result for acl check
2025-10-10T14:31:47.631369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:47.631375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:47.631377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:47.631383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600746353003926:4318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:47.631785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600746353003926:4318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:47.632387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:47.633605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600746353003926:4318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:47.633920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:47.634082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:47.634091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:47.634100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:47.634159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:47.634189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600745570794031:3716]
2025-10-10T14:31:47.634589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:47.634806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:47.634842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:47.635046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:47.635085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.635089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.635090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.635090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.635091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.635092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.635092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.635093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.635094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.635094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.635095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.635095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.635096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.635099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.635106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.635109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.635111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.635113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.635115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.635118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.635120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.635122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.635124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.635126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.635128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.635131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.635137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.635145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.635151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.635156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.635160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.635165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.635168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.635171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.635173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.635176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.635179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.635183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.635186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.635189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.635191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.635194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.635197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.635199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.635202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.635209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.635212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.635215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.635217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.635220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.635226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.635229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.635250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:47.637108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600746353003926:4318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:47.637121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600746353003926:4318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:47.637124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600746353003926:4318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:47.637130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:47.637378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:47.637708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:47.637731Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:47.637734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:47.637741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:47.637747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 315 [2:7559600745570794031:3716]
2025-10-10T14:31:47.637761Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:47.637776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:47.637778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.637780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.637782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.637795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:47.637804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:47.637813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:47.637853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.637858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.637859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.637861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:47.637903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:47.637911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.637925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.637931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.637941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:47.637960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003963:4318], now have 1 active actors on pipe
2025-10-10T14:31:47.637963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003824:2438], now have 1 active actors on pipe
2025-10-10T14:31:47.637970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600745570794026:3716]
2025-10-10T14:31:47.637972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600745570794026:3716]
2025-10-10T14:31:47.637974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600745570794026:3716]
2025-10-10T14:31:47.637984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:47.637997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:47.638009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 315
2025-10-10T14:31:47.638013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:47.638023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:47.638024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:47.638027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 315
2025-10-10T14:31:47.638031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:47.638034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:47.638062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.638065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.638076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600745570794026:3716]
2025-10-10T14:31:47.638082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:47.638086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:47.638113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|616a0f25-8c018a0b-915031db-c5179595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:47.638123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.638129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.638130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:47.638138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.638149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:47.638167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.638295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.638301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.638313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.638372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 316 partition: 0 MaxSeqNo: 40 sessionId: src_id|616a0f25-8c018a0b-915031db-c5179595_0
2025-10-10T14:31:47.638618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5d3b32-91ce3041-4e2ef19f-ad3ccc44_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|616a0f25-8c018a0b-915031db-c5179595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:47.641148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|616a0f25-8c018a0b-915031db-c5179595_0] Write session: try to update token
2025-10-10T14:31:47.641164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|616a0f25-8c018a0b-915031db-c5179595_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:47.655951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId: src_id|616a0f25-8c018a0b-915031db-c5179595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:47.656179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:47.656200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.656204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:47.656206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:47.656215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600745570794026:3716]
2025-10-10T14:31:47.656218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600745570794026:3716]
2025-10-10T14:31:47.656222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600745570794026:3716]
2025-10-10T14:31:47.656265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:47.656267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:47.656270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.656271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:47.656272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:47.656276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:47.656395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:47.658318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:47.723961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600746353003970:4235]
2025-10-10T14:31:47.724166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 315, pipe: [1:7559600746353003970:4235]
2025-10-10T14:31:47.759021Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:47.759242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.759254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.759291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003970:4235], now have 1 active actors on pipe
2025-10-10T14:31:47.759442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:47.759499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:47.759519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:47.759535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600746353003970:4235]
2025-10-10T14:31:47.759554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:47.759585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 316 reason: error at write: Disconnected sessionId: src_id|616a0f25-8c018a0b-915031db-c5179595_0
2025-10-10T14:31:47.759745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 316 sessionId: src_id|616a0f25-8c018a0b-915031db-c5179595_0 is DEAD
2025-10-10T14:31:47.759922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|616a0f25-8c018a0b-915031db-c5179595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:47.759933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|616a0f25-8c018a0b-915031db-c5179595_0] Write session will restart in 0.007603s
2025-10-10T14:31:47.759958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|616a0f25-8c018a0b-915031db-c5179595_0] Write session: Do CDS request
2025-10-10T14:31:47.759964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|616a0f25-8c018a0b-915031db-c5179595_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:47.767728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:47.768794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|616a0f25-8c018a0b-915031db-c5179595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.768883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:47.768894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 317
2025-10-10T14:31:47.769017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.769057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:47.769067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:47.769070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:47.769155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:47.769292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:47.769300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:47.769310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:47.769370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:47.769401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600745570794176:3718]
2025-10-10T14:31:47.769561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 317 sessionId:  describe result for acl check
2025-10-10T14:31:47.769595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:47.769602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:47.769603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:47.769609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600746353004077:4322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:47.770172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:47.770227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600746353004077:4322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:47.770456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:47.770501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:47.770850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:47.770887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.770892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.770892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.770893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.770894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.770894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.770895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.770896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.770896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.770897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.770898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.770898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.770899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.770903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.770911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.770913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.770915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.770918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.770920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.770923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.770925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.770927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.770930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.770932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.770934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.770936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.770942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.770948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.770952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.770955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.770958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.770961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.770963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.770967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.770969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.770973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.770976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.770979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.770982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.770985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.770991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.770994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.770997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.771000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.771006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.771009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.771012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.771015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.771017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.771020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.771026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.771030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.771051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:47.772350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600746353004077:4322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:47.773200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:47.773585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:47.773596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:47.773597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:47.773600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:47.773604Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 316 [2:7559600745570794176:3718]
2025-10-10T14:31:47.773611Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:47.773622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:47.773628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.773630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.773631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.773643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:47.773648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:47.773657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:47.773694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.773710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.773714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.773716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:47.773766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:47.773773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.773780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.773786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.773795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:47.773811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353003971:2438], now have 1 active actors on pipe
2025-10-10T14:31:47.773820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600745570794171:3718]
2025-10-10T14:31:47.773823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600745570794171:3718]
2025-10-10T14:31:47.773825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600745570794171:3718]
2025-10-10T14:31:47.773834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:47.773844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:47.773845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:47.773854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:47.773855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:47.773849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 316
2025-10-10T14:31:47.773858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:47.773861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:47.773878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600745570794171:3718]
2025-10-10T14:31:47.773886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:47.773891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:47.778298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600746353004077:4322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:47.778310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600746353004077:4322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:47.778313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600746353004077:4322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:47.778321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:47.778506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353004115:4322], now have 1 active actors on pipe
2025-10-10T14:31:47.778558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 316
2025-10-10T14:31:47.778603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.778615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.778646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72215ba4-c218925a-d81059a-cc431a1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:47.778658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.778665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.778667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:47.778675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.778696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:47.778712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.778802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.778807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.778818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.778871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 317 partition: 0 MaxSeqNo: 40 sessionId: src_id|72215ba4-c218925a-d81059a-cc431a1e_0
2025-10-10T14:31:47.779216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|616a0f25-8c018a0b-915031db-c5179595_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72215ba4-c218925a-d81059a-cc431a1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:47.781777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72215ba4-c218925a-d81059a-cc431a1e_0] Write session: try to update token
2025-10-10T14:31:47.781794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72215ba4-c218925a-d81059a-cc431a1e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:47.792129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:47.792144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.792146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:47.792148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:47.792155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600745570794171:3718]
2025-10-10T14:31:47.792158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600745570794171:3718]
2025-10-10T14:31:47.792161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600745570794171:3718]
2025-10-10T14:31:47.792195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:47.792195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:47.792200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:47.792203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:47.792203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.792205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:47.792320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:47.794941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId: src_id|72215ba4-c218925a-d81059a-cc431a1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:47.797408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:47.859659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600746353004119:4235]
2025-10-10T14:31:47.859873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 316, pipe: [1:7559600746353004119:4235]
2025-10-10T14:31:47.893144Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:47.893363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.893375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.893413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353004119:4235], now have 1 active actors on pipe
2025-10-10T14:31:47.893568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:47.893646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600746353004119:4235]
2025-10-10T14:31:47.893662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:47.893682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:47.893760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 317 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72215ba4-c218925a-d81059a-cc431a1e_0
2025-10-10T14:31:47.893968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 317 sessionId: src_id|72215ba4-c218925a-d81059a-cc431a1e_0 is DEAD
2025-10-10T14:31:47.894105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72215ba4-c218925a-d81059a-cc431a1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:47.894116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72215ba4-c218925a-d81059a-cc431a1e_0] Write session will restart in 0.005785s
2025-10-10T14:31:47.894141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72215ba4-c218925a-d81059a-cc431a1e_0] Write session: Do CDS request
2025-10-10T14:31:47.894147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72215ba4-c218925a-d81059a-cc431a1e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:47.900814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72215ba4-c218925a-d81059a-cc431a1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.900946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:47.900960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 318
2025-10-10T14:31:47.901072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:47.901108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:47.901118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:47.901122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:47.901603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 318 sessionId:  describe result for acl check
2025-10-10T14:31:47.901641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:47.901650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:47.901651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:47.901657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600746353004224:4326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:47.902188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600746353004224:4326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:47.902415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:47.903891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600746353004224:4326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:47.903962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:47.904146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:47.904156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:47.904167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:47.904226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:47.904267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600745570794322:3720]
2025-10-10T14:31:47.904866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:47.905081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:47.905117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:47.905426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:47.905473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.905479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.905480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.905481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.905482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.905483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.905484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.905494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.905499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.905500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.905501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.905502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.905503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.905508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.905520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.905524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.905527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.905530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.905533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.905542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.905550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.905554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.905559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.905566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.905570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.905578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.905585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.905598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:47.905605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.905615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:47.905623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.905628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:47.905635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.905640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:47.905649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.905654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:47.905662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.905672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:47.905681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.905690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:47.905696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.905701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:47.905710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.905715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:47.905719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.905728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:47.905734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.905739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.905747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.905753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.905761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.905768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.905812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:47.906196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600746353004224:4326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:47.906208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600746353004224:4326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:47.906211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600746353004224:4326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:47.906216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:47.907839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:47.908130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:47.908142Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:47.908144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:47.908148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:47.908153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 317 [2:7559600745570794322:3720]
2025-10-10T14:31:47.908164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:47.908183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:47.908190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.908193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.908195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.908209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:47.908219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:47.908232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:47.908282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.908288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.908289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.908292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:47.908351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:47.908357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.908367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:47.908385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:47.908406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:47.908428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353004261:4326], now have 1 active actors on pipe
2025-10-10T14:31:47.908435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353004120:2438], now have 1 active actors on pipe
2025-10-10T14:31:47.908442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600745570794317:3720]
2025-10-10T14:31:47.908438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 317
2025-10-10T14:31:47.908440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 317
2025-10-10T14:31:47.908460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600745570794317:3720]
2025-10-10T14:31:47.908465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600745570794317:3720]
2025-10-10T14:31:47.908473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:47.908481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:47.908489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:47.908490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:47.908490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:47.908506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:47.908513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:47.908528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.908537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.908567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600745570794317:3720]
2025-10-10T14:31:47.908578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:47.908582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:47.908597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:47.908608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:47.908611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:47.908613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:47.908635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:47.908644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:47.908677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.908849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:47.908856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:47.908869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:47.908972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 318 partition: 0 MaxSeqNo: 40 sessionId: src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0
2025-10-10T14:31:47.909250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72215ba4-c218925a-d81059a-cc431a1e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:47.912010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0] Write session: try to update token
2025-10-10T14:31:47.912027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:47.925301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId: src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:47.926730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:47.926747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:47.926750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:47.926752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:47.926761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600745570794317:3720]
2025-10-10T14:31:47.926765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600745570794317:3720]
2025-10-10T14:31:47.926769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600745570794317:3720]
2025-10-10T14:31:47.926815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:47.926826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:47.926833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:47.926872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:47.926885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:47.926888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:47.926982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:47.927702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:47.993766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600746353004275:4235]
2025-10-10T14:31:47.994128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 317, pipe: [1:7559600746353004275:4235]
2025-10-10T14:31:48.043130Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:48.043383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.043397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.043445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600746353004275:4235], now have 1 active actors on pipe
2025-10-10T14:31:48.043649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:48.043730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:48.043748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600746353004275:4235]
2025-10-10T14:31:48.043775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:48.043853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 318 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0
2025-10-10T14:31:48.044066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 318 sessionId: src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0 is DEAD
2025-10-10T14:31:48.044218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:48.044224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0] Write session will restart in 0.007367s
2025-10-10T14:31:48.044249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0] Write session: Do CDS request
2025-10-10T14:31:48.044254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:48.052832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.052893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:48.052907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 319
2025-10-10T14:31:48.053049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.053077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:48.053096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:48.053099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:48.053532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 319 sessionId:  describe result for acl check
2025-10-10T14:31:48.053560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:48.053561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:48.053562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:48.053566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600750647971700:4339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:48.053561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:48.054137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600750647971700:4339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:48.055151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:48.055358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:48.055370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:48.055382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:48.055446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:48.055536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600749865761804:3735]
2025-10-10T14:31:48.056062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:48.056164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600750647971700:4339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:48.056343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:48.056384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:48.056659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:48.056723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.056730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.056731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.056732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.056733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.056734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.056735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.056737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.056738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.056739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.056740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.056741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.056742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.056746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.056755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.056759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.056763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.056767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.056770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.056774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.056777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.056781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.056785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.056788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.056792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.056795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.056802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.056811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.056822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.056833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.056836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.056839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.056841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.056845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.056851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.056854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.056857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.056862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.056864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.056867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.056870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.056873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.056879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.056882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.056884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.056887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.056891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.056895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.056897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.056904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.056907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.056910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.056934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:48.059110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600750647971700:4339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:48.059124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600750647971700:4339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:48.059128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600750647971700:4339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:48.059137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:48.059161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:48.059629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:48.059637Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:48.059639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:48.059641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:48.059645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 318 [2:7559600749865761804:3735]
2025-10-10T14:31:48.059653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:48.059666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:48.059668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.059670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.059671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.059684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:48.059694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:48.059701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:48.059739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.059745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.059746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.059747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:48.059795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:48.059801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.059807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.059814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.059823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:48.059841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600749865761798:3735]
2025-10-10T14:31:48.059849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600749865761798:3735]
2025-10-10T14:31:48.059851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600749865761798:3735]
2025-10-10T14:31:48.059862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:48.059872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:48.059875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:48.059875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:48.059877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:48.059890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:48.059897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:48.059908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647971593:2438], now have 1 active actors on pipe
2025-10-10T14:31:48.059916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647971731:4339], now have 1 active actors on pipe
2025-10-10T14:31:48.059933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600749865761798:3735]
2025-10-10T14:31:48.059944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:48.059959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:48.059963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 318
2025-10-10T14:31:48.059964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 318
2025-10-10T14:31:48.060004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.060013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.060040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4116675b-8c589ed1-63bab622-b4a34f07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:48.060052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.060061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.060063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:48.060073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.060088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:48.060106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.060254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.060262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.060273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.060371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 319 partition: 0 MaxSeqNo: 40 sessionId: src_id|4116675b-8c589ed1-63bab622-b4a34f07_0
2025-10-10T14:31:48.060693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba45732-a3940c88-fecc1fc8-4fb0f933_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4116675b-8c589ed1-63bab622-b4a34f07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:48.063202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4116675b-8c589ed1-63bab622-b4a34f07_0] Write session: try to update token
2025-10-10T14:31:48.063217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4116675b-8c589ed1-63bab622-b4a34f07_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:48.075416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:48.075436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.075445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600749865761798:3735]
2025-10-10T14:31:48.075496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:48.075496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:48.075656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:48.075790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:48.075909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:48.076028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:48.076205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:48.076238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:48.077004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId: src_id|4116675b-8c589ed1-63bab622-b4a34f07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:48.079619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:48.079853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.079869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.079898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:48.079978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:48.087627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:48.087647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.087650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:48.087652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:48.087663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600749865761798:3735]
2025-10-10T14:31:48.087667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600749865761798:3735]
2025-10-10T14:31:48.087672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600749865761798:3735]
2025-10-10T14:31:48.087718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:48.087720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:48.087727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:48.087727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.087729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:48.087731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:48.087858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:48.143802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600750647971752:4235]
2025-10-10T14:31:48.144196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 318, pipe: [1:7559600750647971752:4235]
2025-10-10T14:31:48.191142Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:48.198274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.198300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.198473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.198535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.198595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.198656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.198716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.198725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.198799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.198865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.198931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.198999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.199043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.199050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.199117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.199174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.199245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.199319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.199362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.199370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.199439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.199504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.199563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.199621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.199663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.199668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.199739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.199801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.199861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.199920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.199965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.199973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.200041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.200108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.200174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.200242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.200287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.200294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.200358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.200417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.200479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.200546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.200588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.200595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.200661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.200716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.200777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.200848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.200893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.200900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.200959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.201019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.201078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.201137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.201179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.201186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.201253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.201317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.201391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.201457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.201506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.201514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.201569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647971752:4235], now have 1 active actors on pipe
2025-10-10T14:31:48.201779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:48.201836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:48.201843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:48.201875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 319 reason: error at write: Disconnected sessionId: src_id|4116675b-8c589ed1-63bab622-b4a34f07_0
2025-10-10T14:31:48.201912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600750647971752:4235]
2025-10-10T14:31:48.202095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 319 sessionId: src_id|4116675b-8c589ed1-63bab622-b4a34f07_0 is DEAD
2025-10-10T14:31:48.202254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4116675b-8c589ed1-63bab622-b4a34f07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:48.202271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4116675b-8c589ed1-63bab622-b4a34f07_0] Write session will restart in 0.008385s
2025-10-10T14:31:48.202309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4116675b-8c589ed1-63bab622-b4a34f07_0] Write session: Do CDS request
2025-10-10T14:31:48.202318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4116675b-8c589ed1-63bab622-b4a34f07_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:48.202350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:48.211866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4116675b-8c589ed1-63bab622-b4a34f07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.211825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:48.211951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:48.211964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 320
2025-10-10T14:31:48.212134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.212176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:48.212187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:48.212191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:48.212548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 320 sessionId:  describe result for acl check
2025-10-10T14:31:48.212578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:48.212584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:48.212586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:48.212593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600750647971863:4344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:48.213104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600750647971863:4344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:48.213674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:48.213843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:48.213853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:48.213864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:48.213914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:48.213954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600749865761964:3738]
2025-10-10T14:31:48.214579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:48.214800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:48.214838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:48.215141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:48.215189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.215194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.215196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.215197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.215198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.215199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.215200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.215201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.215203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.215204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.215205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.215206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.215207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.215212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.215224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.215228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.215232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.215236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.215240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.215244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.215250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.215253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.215258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.215265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.215269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.215273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.215279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.215288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.215297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.215304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.215312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.215315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.215322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.215325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.215328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.215335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.215337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.215340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.215345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.215348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.215350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.215353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.215339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600750647971863:4344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:48.215356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.215359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.215362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.215364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.215367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.215370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.215375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.215380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.215384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.215390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.215419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:48.217496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:48.217559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600750647971863:4344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:48.217571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600750647971863:4344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:48.217574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600750647971863:4344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:48.217583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:48.217928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:48.217937Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:48.217939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:48.217941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:48.217945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 319 [2:7559600749865761964:3738]
2025-10-10T14:31:48.217953Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:48.217966Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:48.217971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.217973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.217975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.217987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:48.217995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:48.218005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:48.218049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.218058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.218060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.218063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:48.218116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:48.218121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.218129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.218136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.218146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:48.218165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647971754:2438], now have 1 active actors on pipe
2025-10-10T14:31:48.218172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647971897:4344], now have 1 active actors on pipe
2025-10-10T14:31:48.218177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600749865761958:3738]
2025-10-10T14:31:48.218179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600749865761958:3738]
2025-10-10T14:31:48.218180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600749865761958:3738]
2025-10-10T14:31:48.218189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:48.218202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:48.218204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:48.218207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:48.218209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:48.218216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:48.218218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:48.218244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600749865761958:3738]
2025-10-10T14:31:48.218254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:48.218233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 319
2025-10-10T14:31:48.218240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 319
2025-10-10T14:31:48.218261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:48.218285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.218291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.218322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:48.218333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.218336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.218338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:48.218346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.218355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:48.218369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.218510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.218520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.218538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.218627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 320 partition: 0 MaxSeqNo: 40 sessionId: src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0
2025-10-10T14:31:48.218947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4116675b-8c589ed1-63bab622-b4a34f07_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:48.221611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0] Write session: try to update token
2025-10-10T14:31:48.221625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:48.228636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:48.228654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.228663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600749865761958:3738]
2025-10-10T14:31:48.228705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:48.228715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:48.228879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:48.229022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:48.229158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:48.229305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:48.229511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:48.229553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:48.235361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId: src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:48.237628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:48.237767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.237789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.237823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:48.237879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:48.244661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:48.244681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.244684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:48.244685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:48.244694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600749865761958:3738]
2025-10-10T14:31:48.244698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600749865761958:3738]
2025-10-10T14:31:48.244702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600749865761958:3738]
2025-10-10T14:31:48.244740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:48.244743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:48.244747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.244748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:48.244748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:48.244752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:48.244875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:48.302015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600750647971905:4235]
2025-10-10T14:31:48.302453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 319, pipe: [1:7559600750647971905:4235]
2025-10-10T14:31:48.351971Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:48.364373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.364400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.364709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.364917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.364980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.365205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.365317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.365340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.365563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.365774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.365834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.365897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.365945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.365954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.366170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.366376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.366468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.366527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.366650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.366659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.366721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.366776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.366832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.367038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.367156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.367162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.367374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.367559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.367762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.367996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.368116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.368125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.368370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.368583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.368796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.368989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.369102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.369109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.369174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.369228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.369458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.369677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.369724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.369729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.369931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.370107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.370168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.370224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.370339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.370345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.370562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.370755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.371001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.371238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.371353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.371360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.371570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:48.371763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:48.371978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:48.372192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:48.372238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:48.372243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:48.372298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647971905:4235], now have 1 active actors on pipe
2025-10-10T14:31:48.372494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:48.372520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600750647971905:4235]
2025-10-10T14:31:48.372548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:48.372550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:48.372587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 320 reason: error at write: Disconnected sessionId: src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0
2025-10-10T14:31:48.372777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 320 sessionId: src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0 is DEAD
2025-10-10T14:31:48.372981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:48.372991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0] Write session will restart in 0.007107s
2025-10-10T14:31:48.373020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0] Write session: Do CDS request
2025-10-10T14:31:48.373029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:48.373306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:48.380830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.380924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:48.380936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 321
2025-10-10T14:31:48.381062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.381105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:48.381116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:48.381120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:48.381510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 321 sessionId:  describe result for acl check
2025-10-10T14:31:48.381551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:48.381556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:48.381559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:48.381564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600750647971980:4348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:48.382040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600750647971980:4348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:48.383905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:48.384650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600750647971980:4348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:48.385425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:48.385633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:48.385646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:48.385657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:48.385706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:48.385751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600749865762113:3740]
2025-10-10T14:31:48.386375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:48.386629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:48.386667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:48.386987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:48.387001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600750647971980:4348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:48.387014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600750647971980:4348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:48.387017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600750647971980:4348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:48.387024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:48.387041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.387047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.387048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.387049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.387050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.387052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.387053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.387054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.387055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.387056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.387058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.387059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.387060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.387065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.387077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.387081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.387085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.387089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.387093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.387101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.387105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.387113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.387117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.387121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.387125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.387129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.387135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.387147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.387158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.387167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.387176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.387181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.387189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.387199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.387208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.387217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.387225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.387235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.387243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.387248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.387253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.387262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.387271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.387276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.387280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.387285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.387294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.387299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.387303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.387309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.387313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.387318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.387359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:48.389557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:48.389902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:48.389913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:48.389915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:48.389918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:48.389923Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 320 [2:7559600749865762113:3740]
2025-10-10T14:31:48.389933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:48.389953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:48.389960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.389964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.389966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.389981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:48.389992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:48.390003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:48.390059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.390065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.390067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.390070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:48.390129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:48.390137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.390148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.390164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.390197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:48.390222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972048:4348], now have 1 active actors on pipe
2025-10-10T14:31:48.390229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647971906:2438], now have 1 active actors on pipe
2025-10-10T14:31:48.390236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600749865762107:3740]
2025-10-10T14:31:48.390243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600749865762107:3740]
2025-10-10T14:31:48.390222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 320
2025-10-10T14:31:48.390225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 320
2025-10-10T14:31:48.390245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600749865762107:3740]
2025-10-10T14:31:48.390254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:48.390265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:48.390267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:48.390268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:48.390270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:48.390284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:48.390286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:48.390308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.390318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.390348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600749865762107:3740]
2025-10-10T14:31:48.390360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:48.390370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:48.390382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:48.390390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.390403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.390411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:48.390422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.390435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:48.390467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.390584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.390592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.390606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.390672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 321 partition: 0 MaxSeqNo: 40 sessionId: src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0
2025-10-10T14:31:48.390975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2036b1a4-2cd608d8-be99a5ff-e784e1d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:48.401085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0] Write session: try to update token
2025-10-10T14:31:48.401103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:48.408176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:48.408190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.408192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:48.408194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:48.408202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600749865762107:3740]
2025-10-10T14:31:48.408205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600749865762107:3740]
2025-10-10T14:31:48.408207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600749865762107:3740]
2025-10-10T14:31:48.408244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:48.408244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:48.408249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:48.408249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.408251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:48.408252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:48.408378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:48.421758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId: src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:48.424143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:48.472509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600750647972059:4235]
2025-10-10T14:31:48.472817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 320, pipe: [1:7559600750647972059:4235]
2025-10-10T14:31:48.510768Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:48.511003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.511019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.511042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972059:4235], now have 1 active actors on pipe
2025-10-10T14:31:48.511259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:48.511263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:48.511268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:48.511300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600750647972059:4235]
2025-10-10T14:31:48.511331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 321 reason: error at write: Disconnected sessionId: src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0
2025-10-10T14:31:48.511423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:48.511563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 321 sessionId: src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0 is DEAD
2025-10-10T14:31:48.511702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:48.511713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0] Write session will restart in 0.009826s
2025-10-10T14:31:48.511737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0] Write session: Do CDS request
2025-10-10T14:31:48.511746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:48.520513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:48.522333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:48.522544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:48.522553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:48.522562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:48.522603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:48.522638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600749865762261:3742]
2025-10-10T14:31:48.522821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.522965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:48.522976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 322
2025-10-10T14:31:48.523073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:48.523112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.523143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:48.523154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:48.523158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:48.523372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:48.523422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:48.523490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 322 sessionId:  describe result for acl check
2025-10-10T14:31:48.523519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:48.523524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:48.523525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:48.523529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600750647972174:4352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:48.523651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:48.523694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.523700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.523701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.523702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.523704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.523705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.523706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.523708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.523709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.523710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.523711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.523712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.523713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.523718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.523730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.523734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.523738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.523741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.523745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.523748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.523752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.523755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.523759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.523763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.523766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.523769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.523777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.523786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.523792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.523797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.523800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.523806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.523815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.523820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.523825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.523836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.523840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.523844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.523848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.523850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.523853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.523856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.523859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.523862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.523866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.523871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.523879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.523883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.523887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.523897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.523901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.523909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.523942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600750647972174:4352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:48.523954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:48.526074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:48.526080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600750647972174:4352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:48.526491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:48.526501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:48.526502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:48.526504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:48.526509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 321 [2:7559600749865762261:3742]
2025-10-10T14:31:48.526517Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:48.526529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:48.526530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.526532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.526534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.526546Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:48.526551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:48.526557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:48.526593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.526600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.526602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.526603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:48.526659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:48.526668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.526678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.526687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.526703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:48.526722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972060:2438], now have 1 active actors on pipe
2025-10-10T14:31:48.526733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600749865762255:3742]
2025-10-10T14:31:48.526739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600749865762255:3742]
2025-10-10T14:31:48.526740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600749865762255:3742]
2025-10-10T14:31:48.526735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 321
2025-10-10T14:31:48.526755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:48.526770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:48.526773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:48.526781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:48.526785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:48.526790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:48.526792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:48.526811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600749865762255:3742]
2025-10-10T14:31:48.526819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:48.526821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:48.531165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600750647972174:4352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:48.531179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600750647972174:4352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:48.531183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600750647972174:4352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:48.531192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:48.531392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972208:4352], now have 1 active actors on pipe
2025-10-10T14:31:48.531445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 321
2025-10-10T14:31:48.531512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.531523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.531560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:48.531579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.531590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.531597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:48.531610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.531627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:48.531644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.531808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.531816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.531831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.531909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 322 partition: 0 MaxSeqNo: 40 sessionId: src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0
2025-10-10T14:31:48.532227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d22aaa-6523956e-edbd731-a1fa6634_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:48.534876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0] Write session: try to update token
2025-10-10T14:31:48.534893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:48.544954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:48.544974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.544977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:48.544979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:48.544989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600749865762255:3742]
2025-10-10T14:31:48.544993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600749865762255:3742]
2025-10-10T14:31:48.544997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600749865762255:3742]
2025-10-10T14:31:48.545041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:48.545042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:48.545048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:48.545048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.545051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:48.545051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:48.545187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:48.550033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId: src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:48.552629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:48.611278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600750647972222:4235]
2025-10-10T14:31:48.611614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 321, pipe: [1:7559600750647972222:4235]
2025-10-10T14:31:48.648827Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:48.649085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.649097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.649116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972222:4235], now have 1 active actors on pipe
2025-10-10T14:31:48.649282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:48.649400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600750647972222:4235]
2025-10-10T14:31:48.649410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:48.649413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:48.649425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:48.649493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 322 reason: error at write: Disconnected sessionId: src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0
2025-10-10T14:31:48.649673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 322 sessionId: src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0 is DEAD
2025-10-10T14:31:48.649842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:48.649855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0] Write session will restart in 0.008443s
2025-10-10T14:31:48.649880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0] Write session: Do CDS request
2025-10-10T14:31:48.649886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:48.659276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:48.659729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.659870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:48.659882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 323
2025-10-10T14:31:48.660026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.660059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:48.660069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:48.660074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:48.660440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 323 sessionId:  describe result for acl check
2025-10-10T14:31:48.660470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:48.660475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:48.660476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:48.660480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600750647972336:4358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:48.660921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600750647972336:4358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:48.661127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:48.661355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:48.661365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:48.661375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:48.661443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:48.661500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600749865762414:3745]
2025-10-10T14:31:48.661913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:48.662165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:48.662201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:48.662486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:48.662537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.662542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.662543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.662544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.662544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.662545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.662546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.662546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.662547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.662547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.662548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.662549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.662549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.662553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.662560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.662563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.662565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.662568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.662570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.662572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.662574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.662577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.662579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.662582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.662584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.662586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.662591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.662597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.662602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.662605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.662609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.662612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.662617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.662622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.662626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.662631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.662636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.662641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.662645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.662651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.662655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.662659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.662662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.662665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.662668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.662671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.662674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.662677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.662679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.662683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.662685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.662689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.662711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:48.662767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600750647972336:4358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:48.664895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:48.664991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600750647972336:4358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:48.665002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600750647972336:4358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:48.665005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600750647972336:4358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:48.665028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:48.665220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:48.665232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:48.665233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:48.665236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:48.665240Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 322 [2:7559600749865762414:3745]
2025-10-10T14:31:48.665261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:48.665271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:48.665278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.665280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.665282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.665293Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:48.665301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:48.665312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:48.665370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.665376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.665378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.665381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:48.665435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:48.665441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.665448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.665459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.665473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:48.665490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972370:4358], now have 1 active actors on pipe
2025-10-10T14:31:48.665497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972224:2438], now have 1 active actors on pipe
2025-10-10T14:31:48.665502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600749865762408:3745]
2025-10-10T14:31:48.665504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600749865762408:3745]
2025-10-10T14:31:48.665506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600749865762408:3745]
2025-10-10T14:31:48.665514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:48.665524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:48.665530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:48.665533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:48.665535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:48.665538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:48.665540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:48.665556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600749865762408:3745]
2025-10-10T14:31:48.665562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:48.665547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 322
2025-10-10T14:31:48.665556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 322
2025-10-10T14:31:48.665576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:48.665587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.665590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.665612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|688ce742-b13bafac-75ee1286-79b86b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:48.665622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.665625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.665626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:48.665634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.665642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:48.665658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.665780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.665792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.665818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.665915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 323 partition: 0 MaxSeqNo: 40 sessionId: src_id|688ce742-b13bafac-75ee1286-79b86b7_0
2025-10-10T14:31:48.666231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b078635d-14fe9fa4-40da96bc-46c8ee68_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|688ce742-b13bafac-75ee1286-79b86b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:48.668857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688ce742-b13bafac-75ee1286-79b86b7_0] Write session: try to update token
2025-10-10T14:31:48.668873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688ce742-b13bafac-75ee1286-79b86b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:48.682478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId: src_id|688ce742-b13bafac-75ee1286-79b86b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:48.683850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:48.683869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.683871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:48.683874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:48.683882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600749865762408:3745]
2025-10-10T14:31:48.683885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600749865762408:3745]
2025-10-10T14:31:48.683888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600749865762408:3745]
2025-10-10T14:31:48.683934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:48.683942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.683944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:48.683949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:48.683965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:48.683969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:48.684086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:48.684836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:48.749503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600750647972377:4235]
2025-10-10T14:31:48.749745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 322, pipe: [1:7559600750647972377:4235]
2025-10-10T14:31:48.786003Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:48.786446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.786463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.786516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972377:4235], now have 1 active actors on pipe
2025-10-10T14:31:48.786741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:48.786760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600750647972377:4235]
2025-10-10T14:31:48.786788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:48.786823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:48.786845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 323 reason: status is not ok: tablet will be restarted right now sessionId: src_id|688ce742-b13bafac-75ee1286-79b86b7_0
2025-10-10T14:31:48.787028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 323 sessionId: src_id|688ce742-b13bafac-75ee1286-79b86b7_0 is DEAD
2025-10-10T14:31:48.787180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688ce742-b13bafac-75ee1286-79b86b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:48.787192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688ce742-b13bafac-75ee1286-79b86b7_0] Write session will restart in 0.006626s
2025-10-10T14:31:48.787218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688ce742-b13bafac-75ee1286-79b86b7_0] Write session: Do CDS request
2025-10-10T14:31:48.787224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688ce742-b13bafac-75ee1286-79b86b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:48.794765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688ce742-b13bafac-75ee1286-79b86b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.794900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:48.794912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 324
2025-10-10T14:31:48.795000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.795026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:48.795034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:48.795036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:48.795435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 324 sessionId:  describe result for acl check
2025-10-10T14:31:48.795472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:48.795474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:48.795475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:48.795480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600750647972476:4362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:48.795920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600750647972476:4362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:48.797247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:48.797934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600750647972476:4362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:48.798941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:48.799101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:48.799111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:48.799119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:48.799156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:48.799190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600749865762566:3747]
2025-10-10T14:31:48.799569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:48.799829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:48.799866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:48.800072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:48.800109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.800116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600750647972476:4362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:48.800115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.800126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600750647972476:4362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:48.800138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600750647972476:4362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:48.800116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.800117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.800117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.800144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:48.800118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.800118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.800119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.800120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.800120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.800121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.800122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.800122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.800126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.800134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.800137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.800139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.800141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.800144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.800146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.800150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.800154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.800157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.800161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.800165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.800168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.800175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.800182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.800188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.800193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.800198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.800203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.800207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.800212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.800215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.800218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.800221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.800224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.800228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.800231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.800236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.800241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.800245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.800250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.800253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.800258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.800262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.800267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.800270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.800275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.800279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.800284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.800316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:48.802472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:48.802781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:48.802792Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:48.802793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:48.802796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:48.802800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 323 [2:7559600749865762566:3747]
2025-10-10T14:31:48.802808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:48.802820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:48.802822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.802824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.802826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.802838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:48.802847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:48.802853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:48.802891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.802896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.802897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.802899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:48.802970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:48.802979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.802988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.803004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.803021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:48.803045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972378:2438], now have 1 active actors on pipe
2025-10-10T14:31:48.803051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972524:4362], now have 1 active actors on pipe
2025-10-10T14:31:48.803056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600749865762560:3747]
2025-10-10T14:31:48.803058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600749865762560:3747]
2025-10-10T14:31:48.803059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600749865762560:3747]
2025-10-10T14:31:48.803069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:48.803086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:48.803087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:48.803089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:48.803091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:48.803106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:48.803109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:48.803082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 323
2025-10-10T14:31:48.803097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 323
2025-10-10T14:31:48.803126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600749865762560:3747]
2025-10-10T14:31:48.803135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:48.803136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:48.803151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.803159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.803201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f955567f-3613337a-3a58c0a-4c970d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:48.803214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.803218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.803220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:48.803235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.803248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:48.803268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.803415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.803423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.803438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.803520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 324 partition: 0 MaxSeqNo: 40 sessionId: src_id|f955567f-3613337a-3a58c0a-4c970d4_0
2025-10-10T14:31:48.803867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688ce742-b13bafac-75ee1286-79b86b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f955567f-3613337a-3a58c0a-4c970d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:48.806589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f955567f-3613337a-3a58c0a-4c970d4_0] Write session: try to update token
2025-10-10T14:31:48.806607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f955567f-3613337a-3a58c0a-4c970d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:48.820645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId: src_id|f955567f-3613337a-3a58c0a-4c970d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:48.821052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:48.821069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.821071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:48.821073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:48.821080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600749865762560:3747]
2025-10-10T14:31:48.821084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600749865762560:3747]
2025-10-10T14:31:48.821086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600749865762560:3747]
2025-10-10T14:31:48.821124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:48.821130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.821132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:48.821132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:48.821138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:48.821142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:48.821257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:48.823103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:48.886715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600750647972533:4235]
2025-10-10T14:31:48.886968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 323, pipe: [1:7559600750647972533:4235]
2025-10-10T14:31:48.922830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:48.923042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.923054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.923090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972533:4235], now have 1 active actors on pipe
2025-10-10T14:31:48.923262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:48.923295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:48.923298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:48.923317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600750647972533:4235]
2025-10-10T14:31:48.923351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 324 reason: error at write: Disconnected sessionId: src_id|f955567f-3613337a-3a58c0a-4c970d4_0
2025-10-10T14:31:48.923387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:48.923543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 324 sessionId: src_id|f955567f-3613337a-3a58c0a-4c970d4_0 is DEAD
2025-10-10T14:31:48.923668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f955567f-3613337a-3a58c0a-4c970d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:48.923677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f955567f-3613337a-3a58c0a-4c970d4_0] Write session will restart in 0.005053s
2025-10-10T14:31:48.923701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f955567f-3613337a-3a58c0a-4c970d4_0] Write session: Do CDS request
2025-10-10T14:31:48.923708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f955567f-3613337a-3a58c0a-4c970d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:48.929769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f955567f-3613337a-3a58c0a-4c970d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.929873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:48.929885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 325
2025-10-10T14:31:48.929992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:48.930025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:48.930034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:48.930039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:48.930421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 325 sessionId:  describe result for acl check
2025-10-10T14:31:48.930450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:48.930451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:48.930452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:48.930457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600750647972601:4366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:48.930884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600750647972601:4366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:48.932384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600750647972601:4366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:48.932395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:48.933884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:48.934026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:48.934040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:48.934048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:48.934086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:48.934129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600749865762718:3749]
2025-10-10T14:31:48.934153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600750647972601:4366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:48.934162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600750647972601:4366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:48.934164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600750647972601:4366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:48.934169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:48.934519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:48.934742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:48.934790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:48.935035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:48.935079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.935085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.935085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.935086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.935087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.935087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.935088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.935088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.935089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.935089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.935090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.935091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.935091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.935095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.935103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.935105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.935107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.935109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.935112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.935114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.935116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.935118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.935123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.935126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.935130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.935133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.935140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.935147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:48.935154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.935158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:48.935163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.935168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:48.935172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.935178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:48.935182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.935187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:48.935191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.935196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:48.935200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.935204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:48.935209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.935214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:48.935218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.935223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:48.935226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.935231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:48.935235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.935238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.935240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.935243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.935246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.935250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.935271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:48.937254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:48.937571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:48.937581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:48.937582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:48.937585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:48.937589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 324 [2:7559600749865762718:3749]
2025-10-10T14:31:48.937596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:48.937607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:48.937612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.937614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.937616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.937628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:48.937633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:48.937642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:48.937689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.937694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.937695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.937697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:48.937750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:48.937756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.937762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:48.937771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:48.937784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:48.937800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972534:2438], now have 1 active actors on pipe
2025-10-10T14:31:48.937805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600750647972677:4366], now have 1 active actors on pipe
2025-10-10T14:31:48.937810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600749865762713:3749]
2025-10-10T14:31:48.937815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600749865762713:3749]
2025-10-10T14:31:48.937816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600749865762713:3749]
2025-10-10T14:31:48.937826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:48.937838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:48.937838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:48.937840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:48.937842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:48.937851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:48.937853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:48.937849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 324
2025-10-10T14:31:48.937870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600749865762713:3749]
2025-10-10T14:31:48.937876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:48.937877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:48.937860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 324
2025-10-10T14:31:48.937890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.937896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.937929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24b72243-648a1765-11d201d9-3a018c6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:48.937938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:48.937940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:48.937953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:48.937968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:48.937979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:48.937995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.938105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:48.938111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:48.938122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:48.938195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 325 partition: 0 MaxSeqNo: 40 sessionId: src_id|24b72243-648a1765-11d201d9-3a018c6b_0
2025-10-10T14:31:48.938453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f955567f-3613337a-3a58c0a-4c970d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24b72243-648a1765-11d201d9-3a018c6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:48.941067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b72243-648a1765-11d201d9-3a018c6b_0] Write session: try to update token
2025-10-10T14:31:48.941082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b72243-648a1765-11d201d9-3a018c6b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:48.954509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId: src_id|24b72243-648a1765-11d201d9-3a018c6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:48.955591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:48.955608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:48.955610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:48.955612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:48.955619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600749865762713:3749]
2025-10-10T14:31:48.955622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600749865762713:3749]
2025-10-10T14:31:48.955624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600749865762713:3749]
2025-10-10T14:31:48.955662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:48.955663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:48.955669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:48.955673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:48.955674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:48.955676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:48.955826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:48.956818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:49.023370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600754942939995:4235]
2025-10-10T14:31:49.023614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 324, pipe: [1:7559600754942939995:4235]
2025-10-10T14:31:49.057061Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:49.057423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.057434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.057471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942939995:4235], now have 1 active actors on pipe
2025-10-10T14:31:49.057645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:49.057689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:49.057700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:49.057797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 325 reason: error at write: Disconnected sessionId: src_id|24b72243-648a1765-11d201d9-3a018c6b_0
2025-10-10T14:31:49.057994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 325 sessionId: src_id|24b72243-648a1765-11d201d9-3a018c6b_0 is DEAD
2025-10-10T14:31:49.058129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:49.058161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600754942939995:4235]
2025-10-10T14:31:49.058180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b72243-648a1765-11d201d9-3a018c6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:49.058190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b72243-648a1765-11d201d9-3a018c6b_0] Write session will restart in 0.006188s
2025-10-10T14:31:49.058214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b72243-648a1765-11d201d9-3a018c6b_0] Write session: Do CDS request
2025-10-10T14:31:49.058218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b72243-648a1765-11d201d9-3a018c6b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:49.065844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b72243-648a1765-11d201d9-3a018c6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.065911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:49.065920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 326
2025-10-10T14:31:49.066044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.066071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:49.066074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:49.066077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:49.066490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 326 sessionId:  describe result for acl check
2025-10-10T14:31:49.066528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:49.066534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:49.066536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:49.066541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600754942940120:4379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:49.067061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600754942940120:4379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:49.067907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:49.068702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600754942940120:4379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:49.069742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:49.069884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:49.069893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:49.069902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:49.069950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:49.069982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600754160730207:3762]
2025-10-10T14:31:49.070351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:49.070618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:49.070656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:49.070879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600754942940120:4379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:49.070886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:49.070891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600754942940120:4379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:49.070894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600754942940120:4379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:49.070900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:49.070927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.070931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.070932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.070933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.070934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.070934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.070935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.070935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.070936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.070937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.070937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.070938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.070938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.070942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.070950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.070952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.070955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.070957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.070959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.070962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.070964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.070966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.070970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.070972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.070974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.070976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.070982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.070987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.070991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.070995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.070998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.071001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.071004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.071007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.071009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.071012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.071015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.071018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.071021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.071024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.071026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.071029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.071032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.071035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.071037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.071040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.071043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.071046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.071048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.071052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.071056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.071058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.071080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:49.073185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:49.073493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:49.073505Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:49.073506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:49.073509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:49.073514Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 325 [2:7559600754160730207:3762]
2025-10-10T14:31:49.073521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:49.073533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:49.073535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.073537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.073538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.073550Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:49.073558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:49.073575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:49.073618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.073623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.073624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.073626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:49.073673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:49.073678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.073685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.073695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.073706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:49.073730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940009:2438], now have 1 active actors on pipe
2025-10-10T14:31:49.073738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940166:4379], now have 1 active actors on pipe
2025-10-10T14:31:49.073745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600754160730202:3762]
2025-10-10T14:31:49.073747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600754160730202:3762]
2025-10-10T14:31:49.073748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600754160730202:3762]
2025-10-10T14:31:49.073761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:49.073777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:49.073762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 325
2025-10-10T14:31:49.073785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:49.073772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 325
2025-10-10T14:31:49.073787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:49.073788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:49.073798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:49.073802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:49.073837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.073846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.073858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600754160730202:3762]
2025-10-10T14:31:49.073866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:49.073883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:49.073888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:49.073894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.073897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.073898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:49.073905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.073916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:49.073937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.074061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.074070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.074084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.074150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 326 partition: 0 MaxSeqNo: 40 sessionId: src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0
2025-10-10T14:31:49.074501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b72243-648a1765-11d201d9-3a018c6b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:49.077097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0] Write session: try to update token
2025-10-10T14:31:49.077116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:49.090869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId: src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:49.091598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:49.091616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.091618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:49.091619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:49.091626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600754160730202:3762]
2025-10-10T14:31:49.091629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600754160730202:3762]
2025-10-10T14:31:49.091632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600754160730202:3762]
2025-10-10T14:31:49.091670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:49.091675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.091676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:49.091680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:49.091687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:49.091691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:49.091802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:49.093237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:49.158080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600754942940189:4235]
2025-10-10T14:31:49.158336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 325, pipe: [1:7559600754942940189:4235]
2025-10-10T14:31:49.193591Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:49.193988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.194009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.194051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940189:4235], now have 1 active actors on pipe
2025-10-10T14:31:49.194239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:49.194264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600754942940189:4235]
2025-10-10T14:31:49.194275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:49.194279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:49.194298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:49.194353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 326 reason: error at write: Disconnected sessionId: src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0
2025-10-10T14:31:49.194579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 326 sessionId: src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0 is DEAD
2025-10-10T14:31:49.194767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:49.194779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0] Write session will restart in 0.005087s
2025-10-10T14:31:49.194804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0] Write session: Do CDS request
2025-10-10T14:31:49.194810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:49.200859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.200933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:49.200946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 327
2025-10-10T14:31:49.201043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.201072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:49.201076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:49.201081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:49.201542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 327 sessionId:  describe result for acl check
2025-10-10T14:31:49.201577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:49.201583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:49.201585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:49.201591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600754942940251:4384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:49.202133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600754942940251:4384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:49.203887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600754942940251:4384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:49.203927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:49.205496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:49.205652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:49.205660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:49.205669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:49.205708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:49.205737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600754160730373:3767]
2025-10-10T14:31:49.206117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:49.206137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600754942940251:4384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:49.206146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600754942940251:4384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:49.206148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600754942940251:4384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:49.206154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:49.206357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:49.206416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:49.206708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:49.206762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.206772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.206773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.206774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.206775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.206776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.206777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.206778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.206779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.206780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.206782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.206783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.206784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.206790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.206803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.206806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.206811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.206815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.206818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.206822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.206826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.206830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.206835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.206839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.206842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.206846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.206853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.206863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.206870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.206875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.206880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.206885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.206894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.206899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.206904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.206910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.206914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.206930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.206938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.206944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.206948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.206955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.206961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.206966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.206971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.206977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.206981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.206987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.206992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.206997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.207002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.207006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.207047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:49.209046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:49.209371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:49.209381Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:49.209383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:49.209386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:49.209391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 326 [2:7559600754160730373:3767]
2025-10-10T14:31:49.209402Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:49.209418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:49.209421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.209424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.209436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.209453Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:49.209465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:49.209476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:49.209529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.209536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.209538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.209540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:49.209593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:49.209598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.209606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.209628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.209643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:49.209662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940190:2438], now have 1 active actors on pipe
2025-10-10T14:31:49.209669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940336:4384], now have 1 active actors on pipe
2025-10-10T14:31:49.209675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600754160730368:3767]
2025-10-10T14:31:49.209682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600754160730368:3767]
2025-10-10T14:31:49.209684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600754160730368:3767]
2025-10-10T14:31:49.209696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:49.209693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 326
2025-10-10T14:31:49.209694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 326
2025-10-10T14:31:49.209706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:49.209713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:49.209713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:49.209714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:49.209729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:49.209732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:49.209766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.209774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.209789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600754160730368:3767]
2025-10-10T14:31:49.209799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:49.209824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:49.209826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7960a610-2582a918-fc754a30-b0466246_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:49.209835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.209838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.209841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:49.209850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.209863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:49.209886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.209967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.209973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.209987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.210061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 327 partition: 0 MaxSeqNo: 40 sessionId: src_id|7960a610-2582a918-fc754a30-b0466246_0
2025-10-10T14:31:49.210373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2399c85-76db0c6e-2f28515e-eaeb8420_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7960a610-2582a918-fc754a30-b0466246_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:49.212985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7960a610-2582a918-fc754a30-b0466246_0] Write session: try to update token
2025-10-10T14:31:49.213003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7960a610-2582a918-fc754a30-b0466246_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:49.226489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId: src_id|7960a610-2582a918-fc754a30-b0466246_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:49.227751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:49.227765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.227768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:49.227770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:49.227783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600754160730368:3767]
2025-10-10T14:31:49.227787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600754160730368:3767]
2025-10-10T14:31:49.227790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600754160730368:3767]
2025-10-10T14:31:49.227839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:49.227843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:49.227846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.227848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:49.227851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:49.227855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:49.227999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:49.228851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:49.294258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600754942940348:4235]
2025-10-10T14:31:49.294561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 326, pipe: [1:7559600754942940348:4235]
2025-10-10T14:31:49.328731Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:49.329166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.329183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.329226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940348:4235], now have 1 active actors on pipe
2025-10-10T14:31:49.329456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:49.329463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:49.329506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:49.329507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600754942940348:4235]
2025-10-10T14:31:49.329508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:49.329569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 327 reason: error at write: Disconnected sessionId: src_id|7960a610-2582a918-fc754a30-b0466246_0
2025-10-10T14:31:49.329754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 327 sessionId: src_id|7960a610-2582a918-fc754a30-b0466246_0 is DEAD
2025-10-10T14:31:49.329944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7960a610-2582a918-fc754a30-b0466246_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:49.329956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7960a610-2582a918-fc754a30-b0466246_0] Write session will restart in 0.005673s
2025-10-10T14:31:49.329984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7960a610-2582a918-fc754a30-b0466246_0] Write session: Do CDS request
2025-10-10T14:31:49.329994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7960a610-2582a918-fc754a30-b0466246_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:49.336874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7960a610-2582a918-fc754a30-b0466246_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.336868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:49.336879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 328
2025-10-10T14:31:49.337052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.337078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:49.337086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:49.337089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:49.337508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 328 sessionId:  describe result for acl check
2025-10-10T14:31:49.337532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:49.337536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:49.337538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:49.337542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600754942940425:4388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:49.337968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600754942940425:4388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:49.339363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:49.339571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600754942940425:4388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:49.341020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:49.341168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:49.341177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:49.341185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:49.341232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:49.341265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600754160730528:3769]
2025-10-10T14:31:49.341698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:49.341792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600754942940425:4388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:49.341803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600754942940425:4388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:49.341805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600754942940425:4388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:49.341811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:49.341917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:49.341947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:49.342150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:49.342189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.342194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.342194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.342195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.342195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.342196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.342197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.342197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.342198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.342198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.342199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.342200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.342201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.342204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.342212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.342215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.342219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.342222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.342226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.342230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.342233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.342236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.342242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.342246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.342249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.342252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.342256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.342262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.342268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.342271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.342273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.342276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.342279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.342282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.342284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.342287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.342290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.342293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.342296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.342299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.342302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.342305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.342307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.342310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.342312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.342315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.342318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.342321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.342323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.342326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.342329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.342332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.342354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:49.344538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:49.344838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:49.344846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:49.344847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:49.344849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:49.344853Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 327 [2:7559600754160730528:3769]
2025-10-10T14:31:49.344861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:49.344872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:49.344873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.344876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.344878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.344890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:49.344895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:49.344902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:49.344944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.344949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.344951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.344952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:49.345008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:49.345013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.345019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.345030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.345048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:49.345073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940349:2438], now have 1 active actors on pipe
2025-10-10T14:31:49.345079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940498:4388], now have 1 active actors on pipe
2025-10-10T14:31:49.345084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600754160730523:3769]
2025-10-10T14:31:49.345086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600754160730523:3769]
2025-10-10T14:31:49.345088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600754160730523:3769]
2025-10-10T14:31:49.345097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:49.345107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:49.345118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:49.345111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 327
2025-10-10T14:31:49.345120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:49.345122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:49.345127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:49.345129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:49.345113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 327
2025-10-10T14:31:49.345143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600754160730523:3769]
2025-10-10T14:31:49.345145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:49.345148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:49.345155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.345158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.345190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c36a8f61-82e3b037-9788bffd-561177b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:49.345200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.345202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.345204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:49.345211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.345222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:49.345237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.345363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.345368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.345379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.345445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 328 partition: 0 MaxSeqNo: 40 sessionId: src_id|c36a8f61-82e3b037-9788bffd-561177b6_0
2025-10-10T14:31:49.345706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7960a610-2582a918-fc754a30-b0466246_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c36a8f61-82e3b037-9788bffd-561177b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:49.348414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c36a8f61-82e3b037-9788bffd-561177b6_0] Write session: try to update token
2025-10-10T14:31:49.348432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c36a8f61-82e3b037-9788bffd-561177b6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:49.362925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId: src_id|c36a8f61-82e3b037-9788bffd-561177b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:49.363196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:49.363212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.363214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:49.363216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:49.363223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600754160730523:3769]
2025-10-10T14:31:49.363225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600754160730523:3769]
2025-10-10T14:31:49.363239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600754160730523:3769]
2025-10-10T14:31:49.363279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:49.363285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.363287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:49.363302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:49.363315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:49.363321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:49.363440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:49.365322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:49.429397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600754942940507:4235]
2025-10-10T14:31:49.429630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 327, pipe: [1:7559600754942940507:4235]
2025-10-10T14:31:49.466116Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:49.466382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.466394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.466442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940507:4235], now have 1 active actors on pipe
2025-10-10T14:31:49.466631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:49.466700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:49.466715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:49.466716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:49.466774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600754942940507:4235]
2025-10-10T14:31:49.466777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 328 reason: error at write: Disconnected sessionId: src_id|c36a8f61-82e3b037-9788bffd-561177b6_0
2025-10-10T14:31:49.466968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 328 sessionId: src_id|c36a8f61-82e3b037-9788bffd-561177b6_0 is DEAD
2025-10-10T14:31:49.467126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36a8f61-82e3b037-9788bffd-561177b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:49.467136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36a8f61-82e3b037-9788bffd-561177b6_0] Write session will restart in 0.007984s
2025-10-10T14:31:49.467165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36a8f61-82e3b037-9788bffd-561177b6_0] Write session: Do CDS request
2025-10-10T14:31:49.467172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36a8f61-82e3b037-9788bffd-561177b6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:49.475885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c36a8f61-82e3b037-9788bffd-561177b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.475966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:49.475982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 329
2025-10-10T14:31:49.476090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.476125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:49.476135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:49.476139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:49.476504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 329 sessionId:  describe result for acl check
2025-10-10T14:31:49.476537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:49.476543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:49.476545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:49.476550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600754942940624:4392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:49.477027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600754942940624:4392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:49.477982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:49.478993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600754942940624:4392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:49.479755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:49.479992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:49.480003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:49.480015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:49.480073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:49.480116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600754160730686:3771]
2025-10-10T14:31:49.480752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:49.481000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:49.481040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:49.481183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600754942940624:4392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:49.481196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600754942940624:4392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:49.481199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600754942940624:4392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:49.481206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:49.481370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:49.481422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.481430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.481431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.481432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.481433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.481434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.481435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.481437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.481438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.481439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.481440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.481441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.481442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.481447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.481459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.481463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.481467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.481471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.481475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.481479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.481483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.481487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.481491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.481495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.481499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.481502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.481509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.481517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.481524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.481529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.481535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.481540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.481544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.481549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.481554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.481559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.481564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.481569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.481573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.481578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.481583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.481587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.481592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.481597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.481601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.481606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.481615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.481619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.481624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.481630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.481636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.481645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.481681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:49.483983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:49.484317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:49.484327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:49.484329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:49.484332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:49.484337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 328 [2:7559600754160730686:3771]
2025-10-10T14:31:49.484348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:49.484363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:49.484371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.484374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.484377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.484392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:49.484400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:49.484411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:49.484463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.484469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.484470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.484473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:49.484535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:49.484542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.484554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.484566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.484587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:49.484612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940509:2438], now have 1 active actors on pipe
2025-10-10T14:31:49.484620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940659:4392], now have 1 active actors on pipe
2025-10-10T14:31:49.484626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600754160730680:3771]
2025-10-10T14:31:49.484628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600754160730680:3771]
2025-10-10T14:31:49.484630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600754160730680:3771]
2025-10-10T14:31:49.484642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:49.484653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:49.484655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:49.484657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:49.484659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:49.484646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 328
2025-10-10T14:31:49.484647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 328
2025-10-10T14:31:49.484674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:49.484681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:49.484717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.484725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.484739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600754160730680:3771]
2025-10-10T14:31:49.484750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:49.484754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:49.484774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:49.484786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.484790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.484792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:49.484802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.484816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:49.484839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.484974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.484983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.484996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.485088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 329 partition: 0 MaxSeqNo: 40 sessionId: src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0
2025-10-10T14:31:49.485404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c36a8f61-82e3b037-9788bffd-561177b6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:49.488270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0] Write session: try to update token
2025-10-10T14:31:49.488289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:49.502514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId: src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:49.503019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:49.503039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.503042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:49.503044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:49.503055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600754160730680:3771]
2025-10-10T14:31:49.503059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600754160730680:3771]
2025-10-10T14:31:49.503063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600754160730680:3771]
2025-10-10T14:31:49.503105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:49.503108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:49.503113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.503115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:49.503115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:49.503120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:49.503238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:49.505138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:49.567126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600754942940675:4235]
2025-10-10T14:31:49.567386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 328, pipe: [1:7559600754942940675:4235]
2025-10-10T14:31:49.606921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:49.607429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.607445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.607483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940675:4235], now have 1 active actors on pipe
2025-10-10T14:31:49.607693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:49.607725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600754942940675:4235]
2025-10-10T14:31:49.607745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:49.607826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:49.607903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 329 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0
2025-10-10T14:31:49.608126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 329 sessionId: src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0 is DEAD
2025-10-10T14:31:49.608278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:49.608289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0] Write session will restart in 0.006576s
2025-10-10T14:31:49.608310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0] Write session: Do CDS request
2025-10-10T14:31:49.608315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:49.615915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.615985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:49.616000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 330
2025-10-10T14:31:49.616149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.616186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:49.616196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:49.616199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:49.616669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 330 sessionId:  describe result for acl check
2025-10-10T14:31:49.616705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:49.616713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:49.616715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:49.616721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600754942940756:4398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:49.617276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600754942940756:4398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:49.618923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:49.619069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600754942940756:4398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:49.620842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:49.621043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:49.621053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:49.621076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:49.621147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:49.621184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600754160730846:3774]
2025-10-10T14:31:49.621548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600754942940756:4398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:49.621560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600754942940756:4398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:49.621563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600754942940756:4398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:49.621583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:49.621696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:49.621993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:49.622037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:49.622259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:49.622304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.622309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.622309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.622310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.622311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.622312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.622312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.622313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.622314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.622314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.622315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.622315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.622316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.622320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.622328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.622331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.622333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.622335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.622338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.622340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.622342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.622344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.622347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.622349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.622351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.622354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.622360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.622365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.622369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.622373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.622375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.622378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.622381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.622384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.622387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.622390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.622392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.622396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.622399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.622401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.622414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.622421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.622423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.622426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.622429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.622432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.622434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.622437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.622440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.622443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.622445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.622448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.622470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:49.624604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:49.624924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:49.624933Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:49.624935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:49.624939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:49.624945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 329 [2:7559600754160730846:3774]
2025-10-10T14:31:49.624956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:49.624971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:49.624988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.624996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.624998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.625015Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:49.625029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:49.625036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:49.625082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.625088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.625089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.625091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:49.625138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:49.625144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.625150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.625156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.625166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:49.625180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600754160730840:3774]
2025-10-10T14:31:49.625185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600754160730840:3774]
2025-10-10T14:31:49.625186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600754160730840:3774]
2025-10-10T14:31:49.625193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:49.625203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:49.625206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940679:2438], now have 1 active actors on pipe
2025-10-10T14:31:49.625208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940828:4398], now have 1 active actors on pipe
2025-10-10T14:31:49.625211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:49.625212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:49.625213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:49.625221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:49.625224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:49.625245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600754160730840:3774]
2025-10-10T14:31:49.625256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:49.625262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:49.625280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 329
2025-10-10T14:31:49.625286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 329
2025-10-10T14:31:49.625416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.625430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.625466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:49.625481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.625489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.625491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:49.625502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.625518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:49.625535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.625694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.625701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.625714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.625788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 330 partition: 0 MaxSeqNo: 40 sessionId: src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0
2025-10-10T14:31:49.626114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfb5726-153586ff-a1e117a2-be2695fa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:49.628669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0] Write session: try to update token
2025-10-10T14:31:49.628685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:49.641413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:49.641427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.641436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600754160730840:3774]
2025-10-10T14:31:49.641477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:49.641481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:49.641626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:49.641767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:49.641896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:49.642034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:49.642208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:49.642242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:49.642798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId: src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:49.645201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:49.645749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.645768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.645799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:49.645881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:49.653413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:49.653426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.653429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:49.653431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:49.653441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600754160730840:3774]
2025-10-10T14:31:49.653445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600754160730840:3774]
2025-10-10T14:31:49.653448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600754160730840:3774]
2025-10-10T14:31:49.653488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:49.653491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:49.653492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:49.653495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:49.653497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.653500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:49.653639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:49.707983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600754942940840:4235]
2025-10-10T14:31:49.708242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 329, pipe: [1:7559600754942940840:4235]
2025-10-10T14:31:49.753892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:49.760117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.760136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.760279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.760335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.760388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.760442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.760484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.760491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.760550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.760600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.760653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.760722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.760761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.760766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.760822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.760891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.760944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.760996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.761032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.761037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.761112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.761167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.761221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.761278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.761314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.761321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.761397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.761475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.761530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.761582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.761618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.761623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.761696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.761763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.761815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.761866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.761903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.761908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.761960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.762009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.762063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.762112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.762158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.762165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.762217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.762268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.762320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.762372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.762425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.762430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.762482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.762531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.762582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.762634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.762680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.762685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.762738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:49.762789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:49.762840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:49.762890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:49.762925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:49.762930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:49.762964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940840:4235], now have 1 active actors on pipe
2025-10-10T14:31:49.763162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:49.763173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600754942940840:4235]
2025-10-10T14:31:49.763203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:49.763205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:49.763232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 330 reason: error at write: Disconnected sessionId: src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0
2025-10-10T14:31:49.763450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 330 sessionId: src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0 is DEAD
2025-10-10T14:31:49.763573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:49.763583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0] Write session will restart in 0.008028s
2025-10-10T14:31:49.763601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0] Write session: Do CDS request
2025-10-10T14:31:49.763606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:49.763724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:49.772862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.773171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:49.773184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 331
2025-10-10T14:31:49.773291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.773323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:49.773347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:49.773355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:49.773684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 331 sessionId:  describe result for acl check
2025-10-10T14:31:49.773713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:49.773718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:49.773719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:49.773723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600754942940958:4402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:49.774129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600754942940958:4402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:49.774475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:49.776194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600754942940958:4402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:49.776334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:49.776492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:49.776501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:49.776510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:49.776552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:49.776582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600754160731005:3776]
2025-10-10T14:31:49.776983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:49.777194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:49.777222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:49.777447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:49.777487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.777492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.777494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.777494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.777495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.777497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.777498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.777498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.777499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.777500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.777501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.777502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.777503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.777509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.777518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.777521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.777523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.777525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.777527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.777529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.777531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.777533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.777535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.777537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.777538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.777540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.777546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.777551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.777555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.777558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.777561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.777564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.777566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.777570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.777572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.777575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.777577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.777580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.777583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.777586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.777588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.777591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.777593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.777596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.777599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.777602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.777604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.777607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.777609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.777612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.777615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.777618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.777639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:49.779552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600754942940958:4402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:49.779564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600754942940958:4402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:49.779568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600754942940958:4402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:49.779575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:49.779629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:49.780035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:49.780044Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:49.780045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:49.780048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:49.780051Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 330 [2:7559600754160731005:3776]
2025-10-10T14:31:49.780066Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:49.780076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:49.780078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.780080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.780081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.780093Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:49.780098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:49.780103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:49.780140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.780145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.780146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.780148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:49.780191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:49.780196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.780203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.780209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.780228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:49.780251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940841:2438], now have 1 active actors on pipe
2025-10-10T14:31:49.780259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942940995:4402], now have 1 active actors on pipe
2025-10-10T14:31:49.780265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600754160730999:3776]
2025-10-10T14:31:49.780267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600754160730999:3776]
2025-10-10T14:31:49.780269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600754160730999:3776]
2025-10-10T14:31:49.780282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:49.780299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:49.780300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:49.780303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:49.780304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:49.780317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:49.780320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:49.780339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600754160730999:3776]
2025-10-10T14:31:49.780319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 330
2025-10-10T14:31:49.780321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 330
2025-10-10T14:31:49.780346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:49.780348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:49.780358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.780362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.780396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:49.780405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.780408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.780409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:49.780416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.780423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:49.780437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.780571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.780578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.780592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.780677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 331 partition: 0 MaxSeqNo: 40 sessionId: src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0
2025-10-10T14:31:49.780931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cc49e4b-8cd7c18f-ac3516a0-7ec30d24_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:49.783274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0] Write session: try to update token
2025-10-10T14:31:49.783291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:49.796790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId: src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:49.798146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:49.798161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.798164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:49.798165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:49.798172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600754160730999:3776]
2025-10-10T14:31:49.798175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600754160730999:3776]
2025-10-10T14:31:49.798178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600754160730999:3776]
2025-10-10T14:31:49.798216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:49.798222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.798224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:49.798226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:49.798232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:49.798236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:49.798339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:49.799254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:49.863113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600754942941003:4235]
2025-10-10T14:31:49.863374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 330, pipe: [1:7559600754942941003:4235]
2025-10-10T14:31:49.899874Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:49.900086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.900098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.900136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942941003:4235], now have 1 active actors on pipe
2025-10-10T14:31:49.900307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:49.900327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:49.900332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600754942941003:4235]
2025-10-10T14:31:49.900352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:49.900424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 331 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0
2025-10-10T14:31:49.900623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 331 sessionId: src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0 is DEAD
2025-10-10T14:31:49.900766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:49.900776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0] Write session will restart in 0.005211s
2025-10-10T14:31:49.900804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0] Write session: Do CDS request
2025-10-10T14:31:49.900809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:49.906746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.906856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:49.906866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 332
2025-10-10T14:31:49.906979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:49.907014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:49.907020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:49.907024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:49.907435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 332 sessionId:  describe result for acl check
2025-10-10T14:31:49.907467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:49.907468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:49.907470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:49.907475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600754942941041:4406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:49.907888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600754942941041:4406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:49.910430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600754942941041:4406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:49.911005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:49.912706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:49.912822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600754942941041:4406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:49.912834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600754942941041:4406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:49.912837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600754942941041:4406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:49.912844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:49.912867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:49.912873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:49.912882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:49.912921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:49.912968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600754160731165:3778]
2025-10-10T14:31:49.913383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:49.913635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:49.913665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:49.913894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:49.913935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.913939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.913940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.913941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.913942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.913942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.913943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.913943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.913944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.913945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.913945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.913946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.913946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.913950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.913958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.913960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.913963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.913965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.913967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.913969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.913971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.913973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.913977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.913981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.913985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.913988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.913996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.914005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:49.914012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.914017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:49.914021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.914026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:49.914028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.914031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:49.914034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.914037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:49.914040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.914043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:49.914046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.914049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:49.914052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.914055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:49.914058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.914061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:49.914063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.914066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:49.914069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.914072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.914075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.914078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.914080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.914083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.914105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:49.916242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:49.916530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:49.916542Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:49.916544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:49.916547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:49.916553Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 331 [2:7559600754160731165:3778]
2025-10-10T14:31:49.916563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:49.916579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:49.916583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.916586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.916588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.916600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:49.916609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:49.916617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:49.916657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.916662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.916664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.916665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:49.916721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:49.916726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.916733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:49.916739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:49.916749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:49.916763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942941155:4406], now have 1 active actors on pipe
2025-10-10T14:31:49.916769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600754942941004:2438], now have 1 active actors on pipe
2025-10-10T14:31:49.916775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600754160731159:3778]
2025-10-10T14:31:49.916776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600754160731159:3778]
2025-10-10T14:31:49.916778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600754160731159:3778]
2025-10-10T14:31:49.916788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:49.916804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:49.916805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:49.916812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:49.916814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:49.916829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:49.916836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:49.916857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600754160731159:3778]
2025-10-10T14:31:49.916867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:49.916847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 331
2025-10-10T14:31:49.916849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 331
2025-10-10T14:31:49.916873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:49.916900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.916905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.916927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:49.916937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:49.916939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:49.916941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:49.916948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:49.916957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:49.916968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.917114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.917119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.917130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:49.917226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 332 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0
2025-10-10T14:31:49.917564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f53d83-e665b5d1-1717b084-9a7e32d9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:49.920284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0] Write session: try to update token
2025-10-10T14:31:49.920301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:49.927505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:49.927518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.927527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600754160731159:3778]
2025-10-10T14:31:49.927564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:49.927573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:49.927731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:49.927856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:49.927981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:49.928111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:49.928283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:49.928314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:49.933632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId: src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:49.935926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:49.936222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:49.936245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:49.936278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:49.936358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:49.944026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:49.944041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:49.944043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:49.944044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:49.944052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600754160731159:3778]
2025-10-10T14:31:49.944054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600754160731159:3778]
2025-10-10T14:31:49.944057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600754160731159:3778]
2025-10-10T14:31:49.944092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:49.944097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:49.944097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:49.944098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:49.944102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:49.944106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:49.944217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:50.000360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600759237908463:4235]
2025-10-10T14:31:50.000722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 331, pipe: [1:7559600759237908463:4235]
2025-10-10T14:31:50.049778Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:50.057194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.057215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.057413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.057469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.057526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.057586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.057639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.057648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.057867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.057923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.057981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.058041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.058084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.058092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.058297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.058508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.058583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.058679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.058721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.058723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.058940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.059000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.059062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.059121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.059166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.059172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.059234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.059289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.059344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.059413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.059452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.059457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.059520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.059574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.059633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.059696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.059737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.059743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.059801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.059856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.059928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.059986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.060025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.060030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.060088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.060144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.060206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.060264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.060309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.060314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.060372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.060432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.060487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.060545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.060663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.060671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.060730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.060783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.060837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.060893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.060937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.060948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.061021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908463:4235], now have 1 active actors on pipe
2025-10-10T14:31:50.061314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600759237908463:4235]
2025-10-10T14:31:50.061324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:50.061328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:50.061372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:50.061395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 332 reason: error at write: Disconnected sessionId: src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0
2025-10-10T14:31:50.061643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 332 sessionId: src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0 is DEAD
2025-10-10T14:31:50.061834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:50.061846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0] Write session will restart in 0.009779s
2025-10-10T14:31:50.061880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0] Write session: Do CDS request
2025-10-10T14:31:50.061887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:50.061891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:50.072857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.072944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:50.072956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 333
2025-10-10T14:31:50.073063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.073090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:50.073096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:50.073099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:50.073501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 333 sessionId:  describe result for acl check
2025-10-10T14:31:50.073534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:50.073539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:50.073540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:50.073544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600759237908598:4416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:50.073947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600759237908598:4416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:50.074056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:50.075664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600759237908598:4416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:50.075795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:50.076021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:50.076030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:50.076042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:50.076091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:50.076127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600758455698635:3786]
2025-10-10T14:31:50.077223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:50.077518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:50.077559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:50.077715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600759237908598:4416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:50.077727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600759237908598:4416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:50.077730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600759237908598:4416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:50.077737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:50.077921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:50.077982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.077989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.077990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.077991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.077992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.077993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.077994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.077996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.077997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.077998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.078000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.078001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.078002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.078007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.078019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.078023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.078027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.078031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.078035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.078038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.078042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.078046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.078051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.078055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.078059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.078065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.078073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.078084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.078092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.078097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.078105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.078111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.078120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.078126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.078131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.078137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.078143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.078149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.078157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.078162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.078166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.078172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.078180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.078186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.078190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.078197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.078201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.078211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.078215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.078221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.078229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.078234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.078279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:50.080992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:50.081380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:50.081392Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:50.081394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:50.081397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:50.081401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 332 [2:7559600758455698635:3786]
2025-10-10T14:31:50.081409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:50.081422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:50.081424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.081428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.081429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.081444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:50.081452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:50.081460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:50.081510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.081518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.081519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.081521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:50.081571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:50.081589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.081598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.081611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.081628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:50.081658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908464:2438], now have 1 active actors on pipe
2025-10-10T14:31:50.081667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908630:4416], now have 1 active actors on pipe
2025-10-10T14:31:50.081675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600758455698630:3786]
2025-10-10T14:31:50.081676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600758455698630:3786]
2025-10-10T14:31:50.081677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600758455698630:3786]
2025-10-10T14:31:50.081687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:50.081699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:50.081705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:50.081708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:50.081710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:50.081720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:50.081724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:50.081714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 332
2025-10-10T14:31:50.081749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600758455698630:3786]
2025-10-10T14:31:50.081749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 332
2025-10-10T14:31:50.081756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:50.081761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:50.081784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.081793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.081830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:50.081837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.081846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.081848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:50.081859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.081873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:50.081900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.082023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.082033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.082053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.082145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 333 partition: 0 MaxSeqNo: 40 sessionId: src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0
2025-10-10T14:31:50.082540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6b0cb-8f4fb728-2ab8a871-ad7b8fdd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:50.085491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0] Write session: try to update token
2025-10-10T14:31:50.085508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:50.100684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId: src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:50.103202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:50.103928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.103946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.103966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:50.103968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.103970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:50.103971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:50.103977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600758455698630:3786]
2025-10-10T14:31:50.103982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600758455698630:3786]
2025-10-10T14:31:50.103985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600758455698630:3786]
2025-10-10T14:31:50.104017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:50.104026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:50.104030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:50.104033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:50.104035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.104036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:50.104165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:50.161596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600759237908664:4235]
2025-10-10T14:31:50.162142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 332, pipe: [1:7559600759237908664:4235]
2025-10-10T14:31:50.204480Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:50.204787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:50.204832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908664:4235], now have 1 active actors on pipe
2025-10-10T14:31:50.204904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:50.204957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:50.204992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:50.204994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:50.205007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600759237908664:4235]
2025-10-10T14:31:50.205058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 333 reason: error at write: Disconnected sessionId: src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0
2025-10-10T14:31:50.205206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 333 sessionId: src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0 is DEAD
2025-10-10T14:31:50.205404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:50.205417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0] Write session will restart in 0.006237s
2025-10-10T14:31:50.205442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0] Write session: Do CDS request
2025-10-10T14:31:50.205448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:50.212787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.212851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:50.212860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 334
2025-10-10T14:31:50.212978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.213005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:50.213009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:50.213012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:50.213502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 334 sessionId:  describe result for acl check
2025-10-10T14:31:50.213534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:50.213536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:50.213538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:50.213544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600759237908748:4424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:50.214076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600759237908748:4424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:50.215489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:50.216115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600759237908748:4424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:50.217033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:50.217212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:50.217222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:50.217234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:50.217285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:50.217324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600758455698834:3796]
2025-10-10T14:31:50.217918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:50.218156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:50.218195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:50.218353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600759237908748:4424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:50.218364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600759237908748:4424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:50.218368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600759237908748:4424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:50.218373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:50.218509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:50.218561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.218566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.218567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.218569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.218570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.218571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.218572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.218573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.218574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.218575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.218576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.218577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.218578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.218583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.218595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.218599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.218604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.218608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.218612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.218615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.218620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.218623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.218628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.218632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.218635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.218639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.218646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.218654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.218661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.218667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.218673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.218679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.218685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.218691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.218695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.218702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.218706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.218711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.218716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.218721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.218725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.218730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.218739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.218744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.218749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.218754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.218759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.218764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.218768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.218778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.218782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.218787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.218827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:50.221240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:50.221562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:50.221572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:50.221574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:50.221577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:50.221584Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 333 [2:7559600758455698834:3796]
2025-10-10T14:31:50.221595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:50.221610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:50.221613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.221616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.221618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.221632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:50.221643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:50.221650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:50.221697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.221703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.221705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.221708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:50.221765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:50.221773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.221783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.221794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.221815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:50.221839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908665:2438], now have 1 active actors on pipe
2025-10-10T14:31:50.221847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908820:4424], now have 1 active actors on pipe
2025-10-10T14:31:50.221853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600758455698828:3796]
2025-10-10T14:31:50.221855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600758455698828:3796]
2025-10-10T14:31:50.221857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600758455698828:3796]
2025-10-10T14:31:50.221870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:50.221858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 333
2025-10-10T14:31:50.221875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 333
2025-10-10T14:31:50.221884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:50.221887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:50.221891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:50.221892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:50.221903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:50.221906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:50.221941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.221950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.221963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600758455698828:3796]
2025-10-10T14:31:50.221974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:50.221985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:50.222001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee0bcd6a-be899adb-f4444951-255344fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:50.222013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.222016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.222018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:50.222027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.222041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:50.222064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.222170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.222177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.222190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.222248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 334 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee0bcd6a-be899adb-f4444951-255344fb_0
2025-10-10T14:31:50.222518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95fdff7a-5712f93a-e465ff2-ebc5b1bc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee0bcd6a-be899adb-f4444951-255344fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:50.225174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0bcd6a-be899adb-f4444951-255344fb_0] Write session: try to update token
2025-10-10T14:31:50.225193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0bcd6a-be899adb-f4444951-255344fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:50.238964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId: src_id|ee0bcd6a-be899adb-f4444951-255344fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:50.241197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:50.242776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.242794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.242816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:50.242819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.242822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:50.242825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:50.242833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600758455698828:3796]
2025-10-10T14:31:50.242837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600758455698828:3796]
2025-10-10T14:31:50.242841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600758455698828:3796]
2025-10-10T14:31:50.242889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:50.242893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:50.242899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.242901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:50.242901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:50.242905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:50.243017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:50.304960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600759237908830:4235]
2025-10-10T14:31:50.305236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 333, pipe: [1:7559600759237908830:4235]
2025-10-10T14:31:50.347414Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:50.347609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:50.347669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908830:4235], now have 1 active actors on pipe
2025-10-10T14:31:50.347812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:50.347841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:50.347898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600759237908830:4235]
2025-10-10T14:31:50.347902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:50.347904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:50.347979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 334 reason: error at write: Disconnected sessionId: src_id|ee0bcd6a-be899adb-f4444951-255344fb_0
2025-10-10T14:31:50.348146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 334 sessionId: src_id|ee0bcd6a-be899adb-f4444951-255344fb_0 is DEAD
2025-10-10T14:31:50.348295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0bcd6a-be899adb-f4444951-255344fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:50.348306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0bcd6a-be899adb-f4444951-255344fb_0] Write session will restart in 0.009057s
2025-10-10T14:31:50.348331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0bcd6a-be899adb-f4444951-255344fb_0] Write session: Do CDS request
2025-10-10T14:31:50.348337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0bcd6a-be899adb-f4444951-255344fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:50.358009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:50.358869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0bcd6a-be899adb-f4444951-255344fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.358945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:50.358958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 335
2025-10-10T14:31:50.359083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.359109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:50.359123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:50.359129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:50.359466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 335 sessionId:  describe result for acl check
2025-10-10T14:31:50.359490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:50.359491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:50.359492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:50.359497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600759237908955:4428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:50.359655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:50.359823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:50.359834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:50.359846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:50.359898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:50.359935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600758455698995:3798]
2025-10-10T14:31:50.360177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600759237908955:4428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:50.360509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:50.360744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:50.360781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:50.361086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:50.361137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.361142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.361143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.361145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.361146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.361147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.361148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.361149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.361150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.361151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.361152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.361154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.361155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.361160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.361171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.361175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.361179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.361183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.361188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.361191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.361195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.361198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.361202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.361207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.361210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.361214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.361221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.361229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.361235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.361245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.361249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.361254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.361258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.361263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.361267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.361272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.361276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.361280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.361285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.361292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.361296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.361305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.361310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.361315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.361319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.361324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.361345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.361354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.361358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.361363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.361368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.361375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.361413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:50.361905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600759237908955:4428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:50.363690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:50.363979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:50.363990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:50.363991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:50.363994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:50.363999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 334 [2:7559600758455698995:3798]
2025-10-10T14:31:50.364006Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:50.364020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:50.364022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.364024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.364025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.364037Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:50.364042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:50.364048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:50.364085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.364090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.364092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.364093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:50.364144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:50.364152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.364160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.364170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.364186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:50.364211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908831:2438], now have 1 active actors on pipe
2025-10-10T14:31:50.364220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600758455698989:3798]
2025-10-10T14:31:50.364224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600758455698989:3798]
2025-10-10T14:31:50.364226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600758455698989:3798]
2025-10-10T14:31:50.364217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 334
2025-10-10T14:31:50.364238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:50.364252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:50.364254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:50.364260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:50.364262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:50.364269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:50.364274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:50.364297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600758455698989:3798]
2025-10-10T14:31:50.364310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:50.364311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600759237908955:4428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:50.364328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:50.364325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600759237908955:4428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:50.364328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600759237908955:4428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:50.364334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:50.364512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908989:4428], now have 1 active actors on pipe
2025-10-10T14:31:50.364540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 334
2025-10-10T14:31:50.364597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.364606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.364634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:50.364644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.364647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.364649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:50.364657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.364668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:50.364679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.364827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.364835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.364848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.364908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 335 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0
2025-10-10T14:31:50.365188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee0bcd6a-be899adb-f4444951-255344fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:50.367834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0] Write session: try to update token
2025-10-10T14:31:50.367852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:50.380918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:50.380934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.380943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600758455698989:3798]
2025-10-10T14:31:50.380984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:50.381005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:50.381146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:50.381270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.381410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.381532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.381697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:50.381730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:50.382498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId: src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:50.384979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:50.385218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.385232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.385266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:50.385373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:50.395100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:50.395121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.395124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:50.395127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:50.395138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600758455698989:3798]
2025-10-10T14:31:50.395143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600758455698989:3798]
2025-10-10T14:31:50.395148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600758455698989:3798]
2025-10-10T14:31:50.395207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:50.395219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.395222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:50.395233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:50.395251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:50.395255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:50.395344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:50.447766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600759237908996:4235]
2025-10-10T14:31:50.448077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 334, pipe: [1:7559600759237908996:4235]
2025-10-10T14:31:50.499781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:50.511155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.511178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.511413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.511486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.511558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.511624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.511676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.511686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.511761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.511826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.511890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.511960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.512006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.512014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.512079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.512141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.512207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.512271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.512315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.512329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.512400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.512502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.512583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.512647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.512691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.512699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.512765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.512828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.512892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.512957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.512998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.513004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.513062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.513115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.513166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.513219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.513257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.513261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.513318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.513391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.513451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.513505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.513543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.513548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.513602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.513653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.513707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.513760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.513808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.513814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.513867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.513915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.513964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.514018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.514054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.514060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.514113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.514163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.514219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.514271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.514308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.514313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.514360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908996:4235], now have 1 active actors on pipe
2025-10-10T14:31:50.514679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600759237908996:4235]
2025-10-10T14:31:50.514692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:50.514711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:50.514713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:50.514741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 335 reason: error at write: Disconnected sessionId: src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0
2025-10-10T14:31:50.514957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 335 sessionId: src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0 is DEAD
2025-10-10T14:31:50.515117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:50.515138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:50.515153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0] Write session will restart in 0.008905s
2025-10-10T14:31:50.515173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0] Write session: Do CDS request
2025-10-10T14:31:50.515180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:50.524837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.524948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:50.524962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 336
2025-10-10T14:31:50.525100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.525146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:50.525153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:50.525156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:50.525548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 336 sessionId:  describe result for acl check
2025-10-10T14:31:50.525571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:50.525573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:50.525575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:50.525578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600759237909097:4432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:50.526390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600759237909097:4432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:50.527526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:50.528698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600759237909097:4432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:50.530444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:50.530612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:50.530625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:50.530636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:50.530682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:50.530734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600758455699159:3800]
2025-10-10T14:31:50.530759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600759237909097:4432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:50.530769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600759237909097:4432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:50.530773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600759237909097:4432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:50.530779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:50.531336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:50.531652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:50.531690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:50.531992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:50.532041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.532045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.532046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.532047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.532047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.532048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.532049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.532049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.532050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.532051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.532052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.532052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.532053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.532057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.532065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.532067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.532070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.532072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.532074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.532076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.532078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.532081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.532083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.532085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.532087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.532090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.532094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.532100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.532104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.532107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.532110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.532113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.532115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.532118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.532121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.532124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.532126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.532129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.532132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.532135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.532137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.532140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.532143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.532146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.532151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.532156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.532160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.532165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.532169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.532174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.532178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.532187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.532216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:50.534816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:50.535256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:50.535269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:50.535270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:50.535275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:50.535282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 335 [2:7559600758455699159:3800]
2025-10-10T14:31:50.535293Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:50.535310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:50.535313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.535316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.535318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.535333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:50.535346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:50.535353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:50.535413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.535420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.535422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.535425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:50.535485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:50.535492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.535504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.535520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.535542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:50.535564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237908998:2438], now have 1 active actors on pipe
2025-10-10T14:31:50.535571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909153:4432], now have 1 active actors on pipe
2025-10-10T14:31:50.535576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600758455699154:3800]
2025-10-10T14:31:50.535577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600758455699154:3800]
2025-10-10T14:31:50.535579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600758455699154:3800]
2025-10-10T14:31:50.535588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:50.535598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:50.535611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:50.535616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:50.535619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:50.535623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:50.535625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:50.535633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600758455699154:3800]
2025-10-10T14:31:50.535636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:50.535638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:50.535673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 335
2025-10-10T14:31:50.535680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 335
2025-10-10T14:31:50.535752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.535759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.535782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:50.535793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.535795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.535797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:50.535805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.535816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:50.535835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.536025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.536033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.536049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.536121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 336 partition: 0 MaxSeqNo: 40 sessionId: src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0
2025-10-10T14:31:50.536436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd107f6d-e6c0527f-af384250-7af1b3c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:50.541715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0] Write session: try to update token
2025-10-10T14:31:50.541732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:50.548706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:50.548721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.548730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600758455699154:3800]
2025-10-10T14:31:50.548770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:50.548775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:50.548971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:50.549099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.549225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.549359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.549523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:50.549560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:50.556233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId: src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:50.558650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:50.558848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.558865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.558903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:50.559003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:50.572004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:50.572019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.572022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:50.572024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:50.572034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600758455699154:3800]
2025-10-10T14:31:50.572037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600758455699154:3800]
2025-10-10T14:31:50.572041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600758455699154:3800]
2025-10-10T14:31:50.572083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:50.572090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.572098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:50.572099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:50.572107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:50.572111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:50.572225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:50.614738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600759237909174:4235]
2025-10-10T14:31:50.615013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 335, pipe: [1:7559600759237909174:4235]
2025-10-10T14:31:50.673961Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:50.680635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.680658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.680810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.680865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.680930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.680989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.681031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.681039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.681099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.681152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.681215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.681274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.681315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.681320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.681394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.681454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.681544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.681598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.681637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.681643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.681707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.681763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.681819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.681873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.681911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.681917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.681984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.682044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.682097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.682153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.682194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.682201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.682268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.682323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.682379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.682459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.682503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.682510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.682569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.682624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.682681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.682743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.682791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.682797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.682855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.682906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.682965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.683027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.683065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.683072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.683130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.683182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.683242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.683302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.683342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.683347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.683402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.683452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.683515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.683604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.683643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.683648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.683689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909174:4235], now have 1 active actors on pipe
2025-10-10T14:31:50.683888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:50.683918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600759237909174:4235]
2025-10-10T14:31:50.683954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:50.683961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:50.683993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 336 reason: error at write: Disconnected sessionId: src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0
2025-10-10T14:31:50.684257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 336 sessionId: src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0 is DEAD
2025-10-10T14:31:50.684366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:50.684389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:50.684397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0] Write session will restart in 0.006891s
2025-10-10T14:31:50.684423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0] Write session: Do CDS request
2025-10-10T14:31:50.684429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:50.692802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.692865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:50.692877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 337
2025-10-10T14:31:50.693038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.693073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:50.693083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:50.693087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:50.693610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 337 sessionId:  describe result for acl check
2025-10-10T14:31:50.693642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:50.693648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:50.693650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:50.693655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600759237909299:4438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:50.694181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600759237909299:4438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:50.694625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:50.695947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600759237909299:4438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:50.696210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:50.696362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:50.696374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:50.696383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:50.696420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:50.696451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600758455699326:3803]
2025-10-10T14:31:50.696821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:50.697059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:50.697087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:50.697286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:50.697321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.697326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.697326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.697327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.697339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.697340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.697340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.697341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.697341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.697342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.697342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.697343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.697344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.697347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.697354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.697357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.697359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.697361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.697363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.697366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.697368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.697370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.697372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.697374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.697376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.697378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.697383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.697388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.697393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.697396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.697398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.697401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.697404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.697407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.697409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.697412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.697414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.697417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.697420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.697423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.697425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.697428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.697431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.697434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.697436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.697439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.697442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.697444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.697447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.697450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.697453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.697456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.697476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:50.699762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600759237909299:4438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:50.699778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600759237909299:4438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:50.699782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600759237909299:4438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:50.699791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:50.699806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:50.700095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:50.700105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:50.700106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:50.700109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:50.700114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 336 [2:7559600758455699326:3803]
2025-10-10T14:31:50.700122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:50.700136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:50.700141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.700144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.700145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.700157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:50.700166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:50.700175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:50.700215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.700219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.700220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.700222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:50.700268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:50.700275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.700281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.700288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.700298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:50.700316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600758455699320:3803]
2025-10-10T14:31:50.700321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600758455699320:3803]
2025-10-10T14:31:50.700322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600758455699320:3803]
2025-10-10T14:31:50.700331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:50.700348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909337:4438], now have 1 active actors on pipe
2025-10-10T14:31:50.700347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:50.700350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:50.700352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:50.700355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909176:2438], now have 1 active actors on pipe
2025-10-10T14:31:50.700363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:50.700377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:50.700384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:50.700384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 336
2025-10-10T14:31:50.700401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 336
2025-10-10T14:31:50.700402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600758455699320:3803]
2025-10-10T14:31:50.700411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:50.700424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:50.700438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.700441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.700466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:50.700477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.700484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.700487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:50.700496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.700520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:50.700539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.700693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.700701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.700713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.700817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 337 partition: 0 MaxSeqNo: 40 sessionId: src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0
2025-10-10T14:31:50.701180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72ea9131-2bbdf137-b32a19c8-dbe06069_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:50.703902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0] Write session: try to update token
2025-10-10T14:31:50.703927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:50.718003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId: src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:50.720251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:50.721579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.721601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.721625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:50.721628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.721632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:50.721634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:50.721642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600758455699320:3803]
2025-10-10T14:31:50.721647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600758455699320:3803]
2025-10-10T14:31:50.721651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600758455699320:3803]
2025-10-10T14:31:50.721706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:50.721719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.721721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:50.721787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:50.721800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:50.721819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:50.721891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:50.784189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600759237909344:4235]
2025-10-10T14:31:50.784498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 336, pipe: [1:7559600759237909344:4235]
2025-10-10T14:31:50.825319Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:50.825623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:50.825682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909344:4235], now have 1 active actors on pipe
2025-10-10T14:31:50.825750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:50.825860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:50.825918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600759237909344:4235]
2025-10-10T14:31:50.835053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:50.835066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:50.835090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 337 reason: error at write: Disconnected sessionId: src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0
2025-10-10T14:31:50.835240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 337 sessionId: src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0 is DEAD
2025-10-10T14:31:50.835394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:50.835408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0] Write session will restart in 0.005747s
2025-10-10T14:31:50.835439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0] Write session: Do CDS request
2025-10-10T14:31:50.835445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:50.840523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:50.842715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:50.842902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:50.842914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:50.842927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:50.842950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.842984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:50.843018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600758455699492:3805]
2025-10-10T14:31:50.843032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:50.843045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 338
2025-10-10T14:31:50.843191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:50.843216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:50.843221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:50.843223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:50.843601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:50.843614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 338 sessionId:  describe result for acl check
2025-10-10T14:31:50.843651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:50.843657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:50.843659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:50.843665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600759237909474:4442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:50.843852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:50.843899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:50.844185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600759237909474:4442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:50.844196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:50.844249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.844255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.844256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.844257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.844259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.844260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.844261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.844263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.844264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.844266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.844267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.844268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.844269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.844275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.844286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.844290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.844294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.844298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.844302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.844306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.844310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.844314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.844318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.844323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.844326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.844330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.844337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.844345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:50.844351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.844356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:50.844360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.844366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:50.844370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.844376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:50.844380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.844385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:50.844390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.844395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:50.844400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.844405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:50.844409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.844416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:50.844420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.844426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:50.844434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.844440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:50.844444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.844451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.844456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.844461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.844465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.844470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.844510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:50.846483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600759237909474:4442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:50.846678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:50.846972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:50.846982Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:50.846983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:50.846986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:50.846991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 337 [2:7559600758455699492:3805]
2025-10-10T14:31:50.847000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:50.847013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:50.847016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.847019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.847020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.847032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:50.847040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:50.847047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:50.847087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.847092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.847093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.847094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:50.847155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:50.847161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.847171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:50.847182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:50.847198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:50.847220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909346:2438], now have 1 active actors on pipe
2025-10-10T14:31:50.847229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600758455699487:3805]
2025-10-10T14:31:50.847231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600758455699487:3805]
2025-10-10T14:31:50.847232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600758455699487:3805]
2025-10-10T14:31:50.847245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:50.847233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 337
2025-10-10T14:31:50.847252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:50.847254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:50.847256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:50.847263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:50.847279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:50.847282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:50.847306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600758455699487:3805]
2025-10-10T14:31:50.847315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:50.847320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:50.852730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600759237909474:4442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:50.852745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600759237909474:4442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:50.852749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600759237909474:4442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:50.852757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:50.853003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909511:4442], now have 1 active actors on pipe
2025-10-10T14:31:50.853040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 337
2025-10-10T14:31:50.853102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.853116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.853153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|930de7e0-18fd8670-787f45d0-4f88301_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:50.853170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:50.853181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:50.853187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:50.853207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:50.853230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:50.853255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.853411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.853419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.853435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:50.853522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 338 partition: 0 MaxSeqNo: 40 sessionId: src_id|930de7e0-18fd8670-787f45d0-4f88301_0
2025-10-10T14:31:50.853891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f577-61a4a7e-74d01416-22c30ab7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|930de7e0-18fd8670-787f45d0-4f88301_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:50.856568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|930de7e0-18fd8670-787f45d0-4f88301_0] Write session: try to update token
2025-10-10T14:31:50.856586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|930de7e0-18fd8670-787f45d0-4f88301_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:50.859255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:50.859267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.859276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600758455699487:3805]
2025-10-10T14:31:50.859321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:50.859324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:50.859499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:50.859641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.859768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.859947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:50.860143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:50.860192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:50.870805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId: src_id|930de7e0-18fd8670-787f45d0-4f88301_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:50.873147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:50.873363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.873382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.873422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:50.873496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:50.877151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:50.877170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:50.877173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:50.877175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:50.877186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600758455699487:3805]
2025-10-10T14:31:50.877190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600758455699487:3805]
2025-10-10T14:31:50.877194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600758455699487:3805]
2025-10-10T14:31:50.877237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:50.877251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:50.877252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:50.877254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:50.877257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:50.877261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:50.877399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:50.925982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600759237909514:4235]
2025-10-10T14:31:50.926185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 337, pipe: [1:7559600759237909514:4235]
2025-10-10T14:31:50.981993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:50.988915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:50.988936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:50.989096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.989155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.989210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.989268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.989318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.989347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.989425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.989476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.989535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.989601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.989644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.989652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.989744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.989799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.989864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.989920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.989959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.989965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.990023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.990086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.990141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.990196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.990233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.990238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.990300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.990357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.990414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.990479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.990518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.990525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.990591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.990654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.990710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.990776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.990822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.990828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.990889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.990941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.990998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.991054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.991120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.991128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.991187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.991239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.991296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.991359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.991406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.991412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.991468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.991520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.991572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.991639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.991683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.991688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.991744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:50.991797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:50.991856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:50.991916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:50.992011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:50.992017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:50.992055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909514:4235], now have 1 active actors on pipe
2025-10-10T14:31:50.992294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:50.992298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:50.992304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:50.992333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 338 reason: error at write: Disconnected sessionId: src_id|930de7e0-18fd8670-787f45d0-4f88301_0
2025-10-10T14:31:50.992334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600759237909514:4235]
2025-10-10T14:31:50.992529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 338 sessionId: src_id|930de7e0-18fd8670-787f45d0-4f88301_0 is DEAD
2025-10-10T14:31:50.992683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930de7e0-18fd8670-787f45d0-4f88301_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:50.992694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930de7e0-18fd8670-787f45d0-4f88301_0] Write session will restart in 0.007604s
2025-10-10T14:31:50.992712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930de7e0-18fd8670-787f45d0-4f88301_0] Write session: Do CDS request
2025-10-10T14:31:50.992717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930de7e0-18fd8670-787f45d0-4f88301_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:50.992811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:51.001744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|930de7e0-18fd8670-787f45d0-4f88301_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.001865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:51.001876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 339
2025-10-10T14:31:51.001996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.002023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:51.002030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:51.002042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:51.002374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 339 sessionId:  describe result for acl check
2025-10-10T14:31:51.002401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:51.002402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:51.002403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:51.002407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600763532876938:4446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:51.002861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600763532876938:4446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:51.002898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:51.004637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:51.004791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:51.004801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:51.004810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:51.004850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:51.004879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600762750666955:3807]
2025-10-10T14:31:51.004994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600763532876938:4446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:51.005306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:51.005593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:51.005635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:51.005897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:51.005946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.005952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.005954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.005955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.005956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.005957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.005958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.005959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.005960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.005961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.005963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.005964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.005965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.005970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.005982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.005986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.005990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.005993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.005997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.006001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.006009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.006013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.006022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.006026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.006029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.006033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.006040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.006051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.006062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.006071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.006079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.006084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.006092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.006098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.006106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.006112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.006116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.006121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.006129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.006134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.006142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.006152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.006161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.006167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.006175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.006180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.006184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.006189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.006198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.006208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.006216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.006223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.006261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:51.008429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600763532876938:4446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:51.008443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600763532876938:4446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:51.008446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600763532876938:4446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:51.008453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:51.008521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:51.008954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:51.008966Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:51.008968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:51.008971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:51.008977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 338 [2:7559600762750666955:3807]
2025-10-10T14:31:51.008988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:51.009003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:51.009011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.009014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.009016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.009031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:51.009042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:51.009054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:51.009102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.009108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.009109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.009112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:51.009170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:51.009177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.009187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.009202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.009222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:51.009243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 338
2025-10-10T14:31:51.009248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600759237909516:2438], now have 1 active actors on pipe
2025-10-10T14:31:51.009255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532876974:4446], now have 1 active actors on pipe
2025-10-10T14:31:51.009262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600762750666949:3807]
2025-10-10T14:31:51.009265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600762750666949:3807]
2025-10-10T14:31:51.009267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600762750666949:3807]
2025-10-10T14:31:51.009260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 338
2025-10-10T14:31:51.009276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:51.009281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:51.009293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:51.009297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:51.009298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:51.009309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:51.009312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:51.009326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.009344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.009377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600762750666949:3807]
2025-10-10T14:31:51.009389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:51.009394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:51.009406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:51.009418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.009422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.009424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:51.009435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.009450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:51.009483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.009641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.009650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.009666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.009762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 339 partition: 0 MaxSeqNo: 40 sessionId: src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0
2025-10-10T14:31:51.010046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|930de7e0-18fd8670-787f45d0-4f88301_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:51.012729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0] Write session: try to update token
2025-10-10T14:31:51.012750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:51.027832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId: src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:51.030118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:51.030134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:51.030137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:51.030139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:51.030148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600762750666949:3807]
2025-10-10T14:31:51.030153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600762750666949:3807]
2025-10-10T14:31:51.030156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600762750666949:3807]
2025-10-10T14:31:51.030151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:51.030205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:51.030216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.030223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:51.030225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:51.030232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:51.030242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:51.030355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:51.092410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600763532876981:4235]
2025-10-10T14:31:51.092650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 338, pipe: [1:7559600763532876981:4235]
2025-10-10T14:31:51.134777Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:51.135034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.135045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.135081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532876981:4235], now have 1 active actors on pipe
2025-10-10T14:31:51.135261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:51.135332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:51.135346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:51.135397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 339 reason: error at write: Disconnected sessionId: src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0
2025-10-10T14:31:51.135599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 339 sessionId: src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0 is DEAD
2025-10-10T14:31:51.135759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:51.135771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0] Write session will restart in 0.008542s
2025-10-10T14:31:51.135808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0] Write session: Do CDS request
2025-10-10T14:31:51.135814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:51.135855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600763532876981:4235]
2025-10-10T14:31:51.135882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:51.145787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.145910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:51.145925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 340
2025-10-10T14:31:51.146043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.146080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:51.146089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:51.146093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:51.146222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:51.146465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 340 sessionId:  describe result for acl check
2025-10-10T14:31:51.146493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:51.146499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:51.146501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:51.146508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600763532877136:4457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:51.146965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600763532877136:4457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:51.147827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:51.147980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:51.147988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:51.147996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:51.148033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:51.148070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600762750667166:3821]
2025-10-10T14:31:51.148743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:51.148920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:51.148947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:51.149059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600763532877136:4457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:51.149156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:51.149200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.149204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.149205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.149205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.149206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.149207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.149207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.149208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.149209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.149209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.149210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.149210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.149211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.149214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.149221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.149224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.149226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.149229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.149231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.149233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.149236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.149238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.149240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.149243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.149245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.149247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.149252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.149258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.149262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.149265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.149267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.149270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.149273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.149276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.149279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.149283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.149287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.149292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.149296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.149300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.149304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.149310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.149314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.149319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.149345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.149350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.149354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.149359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.149363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.149368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.149371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.149374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.149396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:51.151582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600763532877136:4457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:51.151593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600763532877136:4457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:51.151596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600763532877136:4457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:51.151604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:51.151593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:51.151887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:51.151900Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:51.151902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:51.151905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:51.151911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 339 [2:7559600762750667166:3821]
2025-10-10T14:31:51.151923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:51.151939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:51.151941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.151943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.151945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.151963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:51.151972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:51.151979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:51.152021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.152025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.152026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.152028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:51.152082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:51.152091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.152101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.152112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.152128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:51.152164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877169:4457], now have 1 active actors on pipe
2025-10-10T14:31:51.152169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877008:2438], now have 1 active actors on pipe
2025-10-10T14:31:51.152174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600762750667161:3821]
2025-10-10T14:31:51.152176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600762750667161:3821]
2025-10-10T14:31:51.152177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600762750667161:3821]
2025-10-10T14:31:51.152187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:51.152170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 339
2025-10-10T14:31:51.152199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:51.152196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 339
2025-10-10T14:31:51.152208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:51.152209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:51.152210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:51.152212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:51.152214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:51.152227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600762750667161:3821]
2025-10-10T14:31:51.152229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:51.152239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:51.152241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.152245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.152279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:51.152285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.152287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.152289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:51.152296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.152304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:51.152322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.152516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.152529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.152553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.152644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 340 partition: 0 MaxSeqNo: 40 sessionId: src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0
2025-10-10T14:31:51.152975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddf269a6-eb477e72-b0fd071d-f440d04f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:51.155637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0] Write session: try to update token
2025-10-10T14:31:51.155654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:51.168970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId: src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:51.171376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:51.172126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.172146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.172164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:51.172168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:51.172170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:51.172171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:51.172178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600762750667161:3821]
2025-10-10T14:31:51.172181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600762750667161:3821]
2025-10-10T14:31:51.172184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600762750667161:3821]
2025-10-10T14:31:51.172228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:51.172231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:51.172236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:51.172237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.172238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:51.172240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:51.172364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:51.235768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600763532877188:4235]
2025-10-10T14:31:51.236057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 339, pipe: [1:7559600763532877188:4235]
2025-10-10T14:31:51.273753Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:51.274033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:51.274082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877188:4235], now have 1 active actors on pipe
2025-10-10T14:31:51.274176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:51.274290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600763532877188:4235]
2025-10-10T14:31:51.274315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:51.283546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:51.283561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:51.283583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 340 reason: error at write: Disconnected sessionId: src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0
2025-10-10T14:31:51.283729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 340 sessionId: src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0 is DEAD
2025-10-10T14:31:51.283886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:51.283897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0] Write session will restart in 0.009385s
2025-10-10T14:31:51.283915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0] Write session: Do CDS request
2025-10-10T14:31:51.283920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:51.290746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:51.293120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:51.293376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:51.293388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:51.293401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:51.293467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:51.293512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600762750667342:3825]
2025-10-10T14:31:51.293948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:51.294207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:51.294248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:51.294536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:51.294581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.294586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.294587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.294587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.294588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.294589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.294590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.294591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.294591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.294592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.294593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.294594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.294594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.294599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.294608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.294610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.294613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.294615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.294618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.294620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.294622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.294625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.294628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.294630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.294632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.294634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.294641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.294646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.294651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.294655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.294658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.294661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.294665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.294670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.294675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.294680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.294684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.294689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.294695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.294699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.294702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.294705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.294709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.294712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.294714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.294718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.294722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.294725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.294727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.294730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.294733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.294736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.294769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:51.294936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.294999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:51.295019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 341
2025-10-10T14:31:51.295170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.295198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:51.295204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:51.295208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:51.295605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 341 sessionId:  describe result for acl check
2025-10-10T14:31:51.295638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:51.295639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:51.295640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:51.295645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600763532877328:4466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:51.296070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600763532877328:4466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:51.297112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:51.297429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:51.297439Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:51.297441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:51.297443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:51.297447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 340 [2:7559600762750667342:3825]
2025-10-10T14:31:51.297456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:51.297469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:51.297471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.297473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.297474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.297487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:51.297492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:51.297499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:51.297538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.297544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.297546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.297547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:51.297605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:51.297610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.297617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.297624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.297634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:51.297651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600762750667337:3825]
2025-10-10T14:31:51.297656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600762750667337:3825]
2025-10-10T14:31:51.297658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600762750667337:3825]
2025-10-10T14:31:51.297671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:51.297689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:51.297690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877192:2438], now have 1 active actors on pipe
2025-10-10T14:31:51.297697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:51.297699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:51.297699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:51.297715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:51.297718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:51.297717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 340
2025-10-10T14:31:51.297742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600762750667337:3825]
2025-10-10T14:31:51.297751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:51.297752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:51.298705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600763532877328:4466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:51.304442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600763532877328:4466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:51.304456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600763532877328:4466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:51.304459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600763532877328:4466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:51.304466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:51.304678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877361:4466], now have 1 active actors on pipe
2025-10-10T14:31:51.304725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 340
2025-10-10T14:31:51.304781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.304793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.304829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f810ff48-62bee72a-8ce774bd-641444b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:51.304846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.304852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.304856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:51.304870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.304893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:51.304918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.305070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.305079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.305093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.305163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 341 partition: 0 MaxSeqNo: 40 sessionId: src_id|f810ff48-62bee72a-8ce774bd-641444b4_0
2025-10-10T14:31:51.305544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a0b2d5-d68c5f52-ff55c5b3-92498fe9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f810ff48-62bee72a-8ce774bd-641444b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:51.308212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f810ff48-62bee72a-8ce774bd-641444b4_0] Write session: try to update token
2025-10-10T14:31:51.308225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f810ff48-62bee72a-8ce774bd-641444b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:51.317459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:51.317474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:51.317478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:51.317479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:51.317489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600762750667337:3825]
2025-10-10T14:31:51.317494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600762750667337:3825]
2025-10-10T14:31:51.317496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600762750667337:3825]
2025-10-10T14:31:51.317536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:51.317541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.317543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:51.317553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:51.317559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:51.317563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:51.317658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:51.321868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId: src_id|f810ff48-62bee72a-8ce774bd-641444b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:51.324270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:51.374513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600763532877364:4235]
2025-10-10T14:31:51.374806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 340, pipe: [1:7559600763532877364:4235]
2025-10-10T14:31:51.421142Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:51.421502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.421514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.421551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877364:4235], now have 1 active actors on pipe
2025-10-10T14:31:51.421753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:51.421792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600763532877364:4235]
2025-10-10T14:31:51.421794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:51.421796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:51.421857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 341 reason: error at write: Disconnected sessionId: src_id|f810ff48-62bee72a-8ce774bd-641444b4_0
2025-10-10T14:31:51.422006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:51.422027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 341 sessionId: src_id|f810ff48-62bee72a-8ce774bd-641444b4_0 is DEAD
2025-10-10T14:31:51.422180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f810ff48-62bee72a-8ce774bd-641444b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:51.422187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f810ff48-62bee72a-8ce774bd-641444b4_0] Write session will restart in 0.006518s
2025-10-10T14:31:51.422206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f810ff48-62bee72a-8ce774bd-641444b4_0] Write session: Do CDS request
2025-10-10T14:31:51.422211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f810ff48-62bee72a-8ce774bd-641444b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:51.429732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f810ff48-62bee72a-8ce774bd-641444b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.429771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:51.429782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 342
2025-10-10T14:31:51.429950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.429976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:51.429985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:51.429988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:51.430381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 342 sessionId:  describe result for acl check
2025-10-10T14:31:51.430417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:51.430430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:51.430433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:51.430439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600763532877454:4470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:51.430983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600763532877454:4470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:51.432581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:51.432597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600763532877454:4470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:51.434206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:51.434374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:51.434387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:51.434400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:51.434471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:51.434510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600762750667513:3827]
2025-10-10T14:31:51.434848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600763532877454:4470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:51.434858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600763532877454:4470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:51.434861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600763532877454:4470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:51.434867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:51.434963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:51.435196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:51.435230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:51.435490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:51.435536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.435541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.435542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.435543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.435543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.435544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.435545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.435545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.435546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.435547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.435547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.435548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.435548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.435552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.435560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.435563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.435565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.435567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.435570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.435572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.435574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.435576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.435579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.435581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.435583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.435585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.435590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.435595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.435599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.435602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.435605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.435608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.435610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.435613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.435616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.435619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.435621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.435624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.435627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.435630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.435632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.435635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.435638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.435641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.435643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.435646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.435648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.435651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.435654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.435657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.435659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.435662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.435683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:51.437927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:51.438234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:51.438248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:51.438250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:51.438253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:51.438259Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 341 [2:7559600762750667513:3827]
2025-10-10T14:31:51.438272Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:51.438287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:51.438296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.438299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.438301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.438316Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:51.438328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:51.438340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:51.438395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.438402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.438404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.438407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:51.438482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:51.438488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.438501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.438517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.438539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:51.438563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877525:4470], now have 1 active actors on pipe
2025-10-10T14:31:51.438570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877365:2438], now have 1 active actors on pipe
2025-10-10T14:31:51.438577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600762750667507:3827]
2025-10-10T14:31:51.438579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600762750667507:3827]
2025-10-10T14:31:51.438581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600762750667507:3827]
2025-10-10T14:31:51.438594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:51.438611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:51.438599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 341
2025-10-10T14:31:51.438621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:51.438601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 341
2025-10-10T14:31:51.438630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:51.438631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:51.438632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:51.438634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:51.438652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600762750667507:3827]
2025-10-10T14:31:51.438654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:51.438663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:51.438667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.438671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.438704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:51.438714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.438717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.438718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:51.438726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.438735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:51.438752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.438928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.438935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.438948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.439044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 342 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0
2025-10-10T14:31:51.439360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f810ff48-62bee72a-8ce774bd-641444b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:51.441896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0] Write session: try to update token
2025-10-10T14:31:51.441912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:51.455221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId: src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:51.456575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:51.456589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:51.456592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:51.456594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:51.456601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600762750667507:3827]
2025-10-10T14:31:51.456604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600762750667507:3827]
2025-10-10T14:31:51.456607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600762750667507:3827]
2025-10-10T14:31:51.456642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:51.456647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.456649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:51.456652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:51.456657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:51.456662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:51.456770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:51.457560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:51.521995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600763532877537:4235]
2025-10-10T14:31:51.522239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 341, pipe: [1:7559600763532877537:4235]
2025-10-10T14:31:51.558966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:51.559398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.559410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.559449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877537:4235], now have 1 active actors on pipe
2025-10-10T14:31:51.559593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:51.559654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600763532877537:4235]
2025-10-10T14:31:51.559701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:51.559710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:51.559728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:51.559779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 342 reason: error at write: Disconnected sessionId: src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0
2025-10-10T14:31:51.559998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 342 sessionId: src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0 is DEAD
2025-10-10T14:31:51.560138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:51.560148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0] Write session will restart in 0.005935s
2025-10-10T14:31:51.560169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0] Write session: Do CDS request
2025-10-10T14:31:51.560186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:51.566760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.566923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:51.566934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 343
2025-10-10T14:31:51.567063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.567096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:51.567106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:51.567112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:51.567555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 343 sessionId:  describe result for acl check
2025-10-10T14:31:51.567583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:51.567588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:51.567589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:51.567593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600763532877616:4476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:51.568050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600763532877616:4476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:51.569844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600763532877616:4476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:51.570300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:51.571800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:51.571967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:51.571978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:51.571989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:51.572033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:51.572069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600762750667684:3829]
2025-10-10T14:31:51.572118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600763532877616:4476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:51.572130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600763532877616:4476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:51.572134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600763532877616:4476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:51.572141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:51.572652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:51.572859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:51.572894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:51.573199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:51.573252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.573257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.573258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.573259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.573260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.573261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.573263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.573264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.573265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.573265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.573266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.573267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.573268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.573273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.573287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.573291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.573295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.573299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.573303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.573306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.573315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.573318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.573326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.573343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.573347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.573351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.573358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.573370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.573380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.573389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.573398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.573403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.573411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.573416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.573424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.573433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.573441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.573446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.573455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.573460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.573464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.573468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.573472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.573477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.573485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.573494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.573504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.573513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.573521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.573526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.573534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.573539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.573581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:51.575655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:51.576002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:51.576013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:51.576015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:51.576018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:51.576023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 342 [2:7559600762750667684:3829]
2025-10-10T14:31:51.576034Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:51.576049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:51.576057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.576060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.576062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.576075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:51.576085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:51.576093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:51.576142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.576149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.576151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.576153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:51.576210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:51.576218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.576227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.576237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.576257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:51.576283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877707:4476], now have 1 active actors on pipe
2025-10-10T14:31:51.576290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877545:2438], now have 1 active actors on pipe
2025-10-10T14:31:51.576297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600762750667678:3829]
2025-10-10T14:31:51.576299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600762750667678:3829]
2025-10-10T14:31:51.576301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600762750667678:3829]
2025-10-10T14:31:51.576313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:51.576324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:51.576326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:51.576324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 342
2025-10-10T14:31:51.576339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:51.576341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:51.576342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:51.576345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:51.576349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 342
2025-10-10T14:31:51.576364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600762750667678:3829]
2025-10-10T14:31:51.576367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:51.576368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:51.576384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.576392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.576546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b877661f-df0bead6-62516fe6-21c7c39b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:51.576558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.576562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.576564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:51.576574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.576584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:51.576611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.576738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.576745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.576760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.576835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 343 partition: 0 MaxSeqNo: 40 sessionId: src_id|b877661f-df0bead6-62516fe6-21c7c39b_0
2025-10-10T14:31:51.577163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c78d2f0-57b6658a-b6265a58-cad8e898_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b877661f-df0bead6-62516fe6-21c7c39b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:51.579958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b877661f-df0bead6-62516fe6-21c7c39b_0] Write session: try to update token
2025-10-10T14:31:51.579977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b877661f-df0bead6-62516fe6-21c7c39b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:51.593157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId: src_id|b877661f-df0bead6-62516fe6-21c7c39b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:51.595080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:51.595099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:51.595102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:51.595103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:51.595111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600762750667678:3829]
2025-10-10T14:31:51.595115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600762750667678:3829]
2025-10-10T14:31:51.595119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600762750667678:3829]
2025-10-10T14:31:51.595160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:51.595166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:51.595173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.595174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:51.595176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:51.595177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:51.595308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:51.595447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:51.659708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600763532877722:4235]
2025-10-10T14:31:51.659963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 342, pipe: [1:7559600763532877722:4235]
2025-10-10T14:31:51.698415Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:51.698752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.698769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.698811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877722:4235], now have 1 active actors on pipe
2025-10-10T14:31:51.698997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:51.699015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600763532877722:4235]
2025-10-10T14:31:51.699023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:51.699027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:51.699047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:51.699088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 343 reason: error at write: Disconnected sessionId: src_id|b877661f-df0bead6-62516fe6-21c7c39b_0
2025-10-10T14:31:51.699305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 343 sessionId: src_id|b877661f-df0bead6-62516fe6-21c7c39b_0 is DEAD
2025-10-10T14:31:51.699465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b877661f-df0bead6-62516fe6-21c7c39b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:51.699477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b877661f-df0bead6-62516fe6-21c7c39b_0] Write session will restart in 0.007267s
2025-10-10T14:31:51.699501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b877661f-df0bead6-62516fe6-21c7c39b_0] Write session: Do CDS request
2025-10-10T14:31:51.699511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b877661f-df0bead6-62516fe6-21c7c39b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:51.707840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b877661f-df0bead6-62516fe6-21c7c39b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.707925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:51.707938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 344
2025-10-10T14:31:51.708048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.708076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:51.708084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:51.708087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:51.708571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 344 sessionId:  describe result for acl check
2025-10-10T14:31:51.708608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:51.708615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:51.708616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:51.708622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600763532877853:4480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:51.709236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600763532877853:4480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:51.709670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:51.711173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600763532877853:4480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:51.711465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:51.711651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:51.711664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:51.711676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:51.711733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:51.711772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600762750667858:3832]
2025-10-10T14:31:51.712373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:51.712673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:51.712706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:51.712911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:51.712955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.712960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.712961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.712962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.712963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.712963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.712964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.712965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.712965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.712966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.712966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.712967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.712968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.712972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.712984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.712987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.712992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.712995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.712999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.713004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.713008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.713012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.713016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.713020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.713023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.713028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.713034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.713042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.713048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.713051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.713054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.713057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.713060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.713063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.713066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.713069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.713072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.713075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.713078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.713081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.713084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.713087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.713090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.713093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.713095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.713098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.713101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.713104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.713111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.713114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.713116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.713119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.713141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:51.713456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600763532877853:4480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:51.713471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600763532877853:4480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:51.713474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600763532877853:4480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:51.713482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:51.715305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:51.715600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:51.715610Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:51.715611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:51.715614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:51.715618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 343 [2:7559600762750667858:3832]
2025-10-10T14:31:51.715626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:51.715642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:51.715647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.715649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.715651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.715663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:51.715672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:51.715680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:51.715723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.715728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.715729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.715731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:51.715774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:51.715782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.715792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.715802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.715817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:51.715841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600762750667852:3832]
2025-10-10T14:31:51.715847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600762750667852:3832]
2025-10-10T14:31:51.715849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600762750667852:3832]
2025-10-10T14:31:51.715858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:51.715866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:51.715869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:51.715871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:51.715876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877723:2438], now have 1 active actors on pipe
2025-10-10T14:31:51.715882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877890:4480], now have 1 active actors on pipe
2025-10-10T14:31:51.715886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:51.715897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:51.715904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:51.715890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 343
2025-10-10T14:31:51.715920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 343
2025-10-10T14:31:51.715927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600762750667852:3832]
2025-10-10T14:31:51.715934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:51.715936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:51.715954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.715963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.715996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84751771-f866308a-8f781f39-d6e16689_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:51.716007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.716010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.716012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:51.716022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.716033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:51.716059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.716230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.716240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.716257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.716342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 344 partition: 0 MaxSeqNo: 40 sessionId: src_id|84751771-f866308a-8f781f39-d6e16689_0
2025-10-10T14:31:51.716664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b877661f-df0bead6-62516fe6-21c7c39b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84751771-f866308a-8f781f39-d6e16689_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:51.719327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84751771-f866308a-8f781f39-d6e16689_0] Write session: try to update token
2025-10-10T14:31:51.719346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84751771-f866308a-8f781f39-d6e16689_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:51.732775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId: src_id|84751771-f866308a-8f781f39-d6e16689_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:51.735068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:51.735533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.735555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.735579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:51.735590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:51.735592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:51.735594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:51.735603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600762750667852:3832]
2025-10-10T14:31:51.735608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600762750667852:3832]
2025-10-10T14:31:51.735611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600762750667852:3832]
2025-10-10T14:31:51.735657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:51.735663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:51.735666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.735667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:51.735670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:51.735674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:51.735788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:51.798964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600763532877898:4235]
2025-10-10T14:31:51.799188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 343, pipe: [1:7559600763532877898:4235]
2025-10-10T14:31:51.838928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:51.839414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:51.839479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877898:4235], now have 1 active actors on pipe
2025-10-10T14:31:51.839563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:51.839619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:51.839652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:51.839658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:51.839672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600763532877898:4235]
2025-10-10T14:31:51.839737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 344 reason: error at write: Disconnected sessionId: src_id|84751771-f866308a-8f781f39-d6e16689_0
2025-10-10T14:31:51.839890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 344 sessionId: src_id|84751771-f866308a-8f781f39-d6e16689_0 is DEAD
2025-10-10T14:31:51.840035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84751771-f866308a-8f781f39-d6e16689_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:51.840042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84751771-f866308a-8f781f39-d6e16689_0] Write session will restart in 0.009013s
2025-10-10T14:31:51.840061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84751771-f866308a-8f781f39-d6e16689_0] Write session: Do CDS request
2025-10-10T14:31:51.840066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84751771-f866308a-8f781f39-d6e16689_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:51.849770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84751771-f866308a-8f781f39-d6e16689_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.849926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:51.849939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 345
2025-10-10T14:31:51.850063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.850078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:51.850098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:51.850106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:51.850109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:51.850527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 345 sessionId:  describe result for acl check
2025-10-10T14:31:51.850566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:51.850572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:51.850573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:51.850579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600763532878033:4484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:51.851115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600763532878033:4484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:51.851675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:51.851865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:51.851878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:51.851890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:51.851950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:51.851989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600762750668029:3834]
2025-10-10T14:31:51.852579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:51.852867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:51.852916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:51.852920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600763532878033:4484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:51.853228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:51.853288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.853296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.853297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.853298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.853299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.853300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.853301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.853303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.853304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.853305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.853306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.853307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.853309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.853315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.853326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.853349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.853358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.853362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.853370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.853375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.853383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.853387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.853396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.853404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.853409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.853417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.853424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.853436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.853447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.853457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.853466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.853471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.853479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.853488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.853497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.853506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.853510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.853516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.853524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.853530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.853537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.853546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.853554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.853560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.853564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.853573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.853583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.853589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.853594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.853600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.853608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.853613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.853659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:51.855598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600763532878033:4484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:51.855608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600763532878033:4484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:51.855610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600763532878033:4484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:51.855615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:51.855729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:51.856193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:51.856209Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:51.856212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:51.856215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:51.856220Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 344 [2:7559600762750668029:3834]
2025-10-10T14:31:51.856232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:51.856249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:51.856256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.856260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.856262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.856277Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:51.856288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:51.856295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:51.856347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.856357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.856359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.856361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:51.856418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:51.856426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.856437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.856453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.856473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:51.856499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532878067:4484], now have 1 active actors on pipe
2025-10-10T14:31:51.856507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532877899:2438], now have 1 active actors on pipe
2025-10-10T14:31:51.856514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600762750668023:3834]
2025-10-10T14:31:51.856521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600762750668023:3834]
2025-10-10T14:31:51.856524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600762750668023:3834]
2025-10-10T14:31:51.856516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 344
2025-10-10T14:31:51.856527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 344
2025-10-10T14:31:51.856541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:51.856552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:51.856555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:51.856556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:51.856559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:51.856575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:51.856582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:51.856616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.856625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.856643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600762750668023:3834]
2025-10-10T14:31:51.856654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:51.856666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:51.856686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2130242c-48235639-32432498-653e760b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:51.856698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.856706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.856708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:51.856723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.856738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:51.856762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.856916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.856926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.856944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.857025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 345 partition: 0 MaxSeqNo: 40 sessionId: src_id|2130242c-48235639-32432498-653e760b_0
2025-10-10T14:31:51.857380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84751771-f866308a-8f781f39-d6e16689_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2130242c-48235639-32432498-653e760b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:51.860090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2130242c-48235639-32432498-653e760b_0] Write session: try to update token
2025-10-10T14:31:51.860107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2130242c-48235639-32432498-653e760b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:51.874559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId: src_id|2130242c-48235639-32432498-653e760b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:51.875913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:51.875934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:51.875937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:51.875940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:51.875948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600762750668023:3834]
2025-10-10T14:31:51.875953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600762750668023:3834]
2025-10-10T14:31:51.875956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600762750668023:3834]
2025-10-10T14:31:51.876003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:51.876004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:51.876011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:51.876015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:51.876015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.876020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:51.876155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:51.876937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:51.939784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600763532878074:4235]
2025-10-10T14:31:51.939996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 344, pipe: [1:7559600763532878074:4235]
2025-10-10T14:31:51.978053Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:51.978319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.978331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.978368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532878074:4235], now have 1 active actors on pipe
2025-10-10T14:31:51.978536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:51.978633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:51.978627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600763532878074:4235]
2025-10-10T14:31:51.978655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:51.978715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 345 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2130242c-48235639-32432498-653e760b_0
2025-10-10T14:31:51.978891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 345 sessionId: src_id|2130242c-48235639-32432498-653e760b_0 is DEAD
2025-10-10T14:31:51.979026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2130242c-48235639-32432498-653e760b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:51.979045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2130242c-48235639-32432498-653e760b_0] Write session will restart in 0.007636s
2025-10-10T14:31:51.979062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2130242c-48235639-32432498-653e760b_0] Write session: Do CDS request
2025-10-10T14:31:51.979068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2130242c-48235639-32432498-653e760b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:51.987877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2130242c-48235639-32432498-653e760b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.987930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:51.987940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 346
2025-10-10T14:31:51.988090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:51.988118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:51.988126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:51.988129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:51.988537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 346 sessionId:  describe result for acl check
2025-10-10T14:31:51.988575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:51.988581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:51.988583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:51.988589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600763532878208:4488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:51.989142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600763532878208:4488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:51.989548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:51.991362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:51.991381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600763532878208:4488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:51.991533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:51.991544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:51.991555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:51.991602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:51.991639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600762750668203:3836]
2025-10-10T14:31:51.992228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:51.992494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:51.992534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:51.992835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:51.992884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.992890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.992891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.992892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.992893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.992894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.992895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.992897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.992898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.992899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.992900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.992901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.992902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.992907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.992920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.992924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.992928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.992932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.992940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.992944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.992948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.992952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.992956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.992964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.992968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.992976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.992983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.992995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:51.993005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.993010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:51.993021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.993027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:51.993031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.993037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:51.993041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.993047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:51.993051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.993056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:51.993061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.993071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:51.993074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.993081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:51.993086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.993091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:51.993099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.993105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:51.993109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.993116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.993121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.993128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.993133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.993138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.993184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:51.993493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600763532878208:4488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:51.993506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600763532878208:4488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:51.993509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600763532878208:4488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:51.993516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:51.995285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:51.995604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:51.995614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:51.995617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:51.995620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:51.995626Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 345 [2:7559600762750668203:3836]
2025-10-10T14:31:51.995636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:51.995651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:51.995658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.995661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.995663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.995678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:51.995689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:51.995701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:51.995754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.995760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.995762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.995764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:51.995826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:51.995833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:51.995843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:51.995859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:51.995879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:51.995903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532878245:4488], now have 1 active actors on pipe
2025-10-10T14:31:51.995910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600763532878076:2438], now have 1 active actors on pipe
2025-10-10T14:31:51.995917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600762750668197:3836]
2025-10-10T14:31:51.995923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600762750668197:3836]
2025-10-10T14:31:51.995925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600762750668197:3836]
2025-10-10T14:31:51.995938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:51.995941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 345
2025-10-10T14:31:51.995954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:51.995945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 345
2025-10-10T14:31:51.995958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:51.995961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:51.995962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:51.995974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:51.995978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:51.996007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.996016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.996034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600762750668197:3836]
2025-10-10T14:31:51.996044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:51.996067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:51.996076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51853031-6e94dcbe-19375c25-10203284_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:51.996084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:51.996093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:51.996095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:51.996106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:51.996119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:51.996144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.996283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:51.996294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:51.996310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:51.996389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 346 partition: 0 MaxSeqNo: 40 sessionId: src_id|51853031-6e94dcbe-19375c25-10203284_0
2025-10-10T14:31:51.996702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2130242c-48235639-32432498-653e760b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51853031-6e94dcbe-19375c25-10203284_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:51.999450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51853031-6e94dcbe-19375c25-10203284_0] Write session: try to update token
2025-10-10T14:31:51.999468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51853031-6e94dcbe-19375c25-10203284_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:52.017510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId: src_id|51853031-6e94dcbe-19375c25-10203284_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:52.020546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:52.020560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:52.020564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:52.020566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:52.020574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600762750668197:3836]
2025-10-10T14:31:52.020579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600762750668197:3836]
2025-10-10T14:31:52.020583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600762750668197:3836]
2025-10-10T14:31:52.020632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:52.020636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:52.020642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:52.020644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.020646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:52.020647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:52.020781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:52.022778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:52.079028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600767827845548:4235]
2025-10-10T14:31:52.079287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 345, pipe: [1:7559600767827845548:4235]
2025-10-10T14:31:52.127816Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:52.128155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.128167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.128201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827845548:4235], now have 1 active actors on pipe
2025-10-10T14:31:52.128369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:52.128382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600767827845548:4235]
2025-10-10T14:31:52.128400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:52.128404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:52.128405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:52.128479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 346 reason: error at write: Disconnected sessionId: src_id|51853031-6e94dcbe-19375c25-10203284_0
2025-10-10T14:31:52.128688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 346 sessionId: src_id|51853031-6e94dcbe-19375c25-10203284_0 is DEAD
2025-10-10T14:31:52.128830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51853031-6e94dcbe-19375c25-10203284_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:52.128842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51853031-6e94dcbe-19375c25-10203284_0] Write session will restart in 0.008382s
2025-10-10T14:31:52.128867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51853031-6e94dcbe-19375c25-10203284_0] Write session: Do CDS request
2025-10-10T14:31:52.128873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51853031-6e94dcbe-19375c25-10203284_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:52.138868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51853031-6e94dcbe-19375c25-10203284_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.138962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:52.138977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 347
2025-10-10T14:31:52.139114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.139156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:52.139165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:52.139168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:52.139279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:52.139590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 347 sessionId:  describe result for acl check
2025-10-10T14:31:52.139632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:52.139640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:52.139642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:52.139648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600767827845698:4493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:52.140195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600767827845698:4493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:52.141031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:52.141205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:52.141218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:52.141231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:52.141285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:52.141324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600767045635699:3845]
2025-10-10T14:31:52.141877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:52.142152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:52.142188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:52.142409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:52.142472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600767827845698:4493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:52.142471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.142477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.142478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.142479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.142480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.142481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.142483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.142483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.142485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.142486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.142487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.142488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.142489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.142494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.142504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.142506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.142509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.142511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.142513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.142515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.142517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.142519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.142523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.142525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.142527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.142529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.142533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.142539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.142543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.142547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.142549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.142552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.142555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.142558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.142561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.142564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.142567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.142570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.142572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.142575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.142577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.142580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.142583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.142586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.142591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.142596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.142600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.142605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.142609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.142613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.142618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.142622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.142657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:52.144774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600767827845698:4493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:52.144788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600767827845698:4493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:52.144791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600767827845698:4493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:52.144799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:52.144916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:52.145348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:52.145361Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:52.145363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:52.145366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:52.145372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 346 [2:7559600767045635699:3845]
2025-10-10T14:31:52.145382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:52.145393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:52.145396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.145398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.145401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.145417Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:52.145425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:52.145437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:52.145475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.145481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.145482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.145485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:52.145541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:52.145547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.145553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.145559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.145571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:52.145589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600767045635693:3845]
2025-10-10T14:31:52.145596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600767045635693:3845]
2025-10-10T14:31:52.145598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600767045635693:3845]
2025-10-10T14:31:52.145606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:52.145615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:52.145622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827845562:2438], now have 1 active actors on pipe
2025-10-10T14:31:52.145623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:52.145625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827845732:4493], now have 1 active actors on pipe
2025-10-10T14:31:52.145626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:52.145631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:52.145647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:52.145650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:52.145668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600767045635693:3845]
2025-10-10T14:31:52.145681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:52.145673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 346
2025-10-10T14:31:52.145685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 346
2025-10-10T14:31:52.145708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:52.145759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.145769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.145797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2355af75-60689af5-e404dceb-d5e50dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:52.145809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.145812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.145818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:52.145828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.145839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:52.145853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.146023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.146030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.146045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.146128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 347 partition: 0 MaxSeqNo: 40 sessionId: src_id|2355af75-60689af5-e404dceb-d5e50dff_0
2025-10-10T14:31:52.146427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51853031-6e94dcbe-19375c25-10203284_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2355af75-60689af5-e404dceb-d5e50dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:52.149111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2355af75-60689af5-e404dceb-d5e50dff_0] Write session: try to update token
2025-10-10T14:31:52.149128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2355af75-60689af5-e404dceb-d5e50dff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:52.163119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId: src_id|2355af75-60689af5-e404dceb-d5e50dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:52.164181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:52.164198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:52.164200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:52.164201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:52.164208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600767045635693:3845]
2025-10-10T14:31:52.164211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600767045635693:3845]
2025-10-10T14:31:52.164213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600767045635693:3845]
2025-10-10T14:31:52.164250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:52.164255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.164257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:52.164266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:52.164272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:52.164275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:52.164394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:52.165674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:52.228536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600767827845763:4235]
2025-10-10T14:31:52.228798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 346, pipe: [1:7559600767827845763:4235]
2025-10-10T14:31:52.266713Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:52.267012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.267031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.267091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827845763:4235], now have 1 active actors on pipe
2025-10-10T14:31:52.267297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:52.267322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600767827845763:4235]
2025-10-10T14:31:52.267345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:52.267347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:52.267401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 347 reason: error at write: Disconnected sessionId: src_id|2355af75-60689af5-e404dceb-d5e50dff_0
2025-10-10T14:31:52.267455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:52.267615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 347 sessionId: src_id|2355af75-60689af5-e404dceb-d5e50dff_0 is DEAD
2025-10-10T14:31:52.267785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2355af75-60689af5-e404dceb-d5e50dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:52.267795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2355af75-60689af5-e404dceb-d5e50dff_0] Write session will restart in 0.007100s
2025-10-10T14:31:52.267818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2355af75-60689af5-e404dceb-d5e50dff_0] Write session: Do CDS request
2025-10-10T14:31:52.267823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2355af75-60689af5-e404dceb-d5e50dff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:52.275892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2355af75-60689af5-e404dceb-d5e50dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.276034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:52.276061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 348
2025-10-10T14:31:52.276193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.276230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:52.276240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:52.276244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:52.276712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 348 sessionId:  describe result for acl check
2025-10-10T14:31:52.276754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:52.276761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:52.276763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:52.276770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600767827845869:4506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:52.277361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600767827845869:4506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:52.278893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:52.279625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600767827845869:4506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:52.280561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:52.280829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:52.280842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:52.280854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:52.280909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:52.280957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600767045635900:3854]
2025-10-10T14:31:52.281524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:52.281762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600767827845869:4506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:52.281772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:52.281774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600767827845869:4506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:52.281815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:52.281777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600767827845869:4506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:52.281786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:52.282124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:52.282171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.282177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.282179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.282180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.282181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.282182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.282183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.282185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.282186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.282187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.282188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.282189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.282190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.282195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.282206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.282210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.282214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.282217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.282221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.282225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.282229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.282233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.282238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.282240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.282242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.282244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.282249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.282254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.282258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.282262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.282265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.282268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.282270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.282273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.282276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.282279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.282281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.282284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.282286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.282289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.282291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.282294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.282298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.282301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.282304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.282307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.282310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.282315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.282319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.282324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.282328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.282333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.282365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:52.284620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:52.285096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:52.285114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:52.285117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:52.285121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:52.285129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 347 [2:7559600767045635900:3854]
2025-10-10T14:31:52.285146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:52.285168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:52.285171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.285175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.285177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.285193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:52.285209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:52.285217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:52.285272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.285281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.285283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.285285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:52.285376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:52.285384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.285395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.285405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.285421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:52.285454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827845764:2438], now have 1 active actors on pipe
2025-10-10T14:31:52.285465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827845933:4506], now have 1 active actors on pipe
2025-10-10T14:31:52.285475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600767045635895:3854]
2025-10-10T14:31:52.285481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600767045635895:3854]
2025-10-10T14:31:52.285483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600767045635895:3854]
2025-10-10T14:31:52.285502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:52.285520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:52.285498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 347
2025-10-10T14:31:52.285515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 347
2025-10-10T14:31:52.285519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:52.285522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:52.285524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:52.285542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:52.285547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:52.285576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600767045635895:3854]
2025-10-10T14:31:52.285589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:52.285601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:52.285603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.285607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.285727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44718326-e88576a3-826e4e15-138043f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:52.285744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.285747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.285749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:52.285764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.285781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:52.285819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.285976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.285987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.286006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.286126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 348 partition: 0 MaxSeqNo: 40 sessionId: src_id|44718326-e88576a3-826e4e15-138043f2_0
2025-10-10T14:31:52.286520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2355af75-60689af5-e404dceb-d5e50dff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44718326-e88576a3-826e4e15-138043f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:52.289080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44718326-e88576a3-826e4e15-138043f2_0] Write session: try to update token
2025-10-10T14:31:52.289094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44718326-e88576a3-826e4e15-138043f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:52.305823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:52.305845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:52.305848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:52.305850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:52.305860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600767045635895:3854]
2025-10-10T14:31:52.305864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600767045635895:3854]
2025-10-10T14:31:52.305867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600767045635895:3854]
2025-10-10T14:31:52.305913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:52.305912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:52.305919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:52.305922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:52.305928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.305930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:52.305975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId: src_id|44718326-e88576a3-826e4e15-138043f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:52.306140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:52.308470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:52.367298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600767827845943:4235]
2025-10-10T14:31:52.367537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 347, pipe: [1:7559600767827845943:4235]
2025-10-10T14:31:52.411532Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:52.411858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.411877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.411933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827845943:4235], now have 1 active actors on pipe
2025-10-10T14:31:52.412145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600767827845943:4235]
2025-10-10T14:31:52.412176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:52.412178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:52.412192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:52.412232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 348 reason: error at write: Disconnected sessionId: src_id|44718326-e88576a3-826e4e15-138043f2_0
2025-10-10T14:31:52.412239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:52.412433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 348 sessionId: src_id|44718326-e88576a3-826e4e15-138043f2_0 is DEAD
2025-10-10T14:31:52.412624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44718326-e88576a3-826e4e15-138043f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:52.412636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44718326-e88576a3-826e4e15-138043f2_0] Write session will restart in 0.005847s
2025-10-10T14:31:52.412661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44718326-e88576a3-826e4e15-138043f2_0] Write session: Do CDS request
2025-10-10T14:31:52.412671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44718326-e88576a3-826e4e15-138043f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:52.419837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44718326-e88576a3-826e4e15-138043f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.419938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:52.419949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 349
2025-10-10T14:31:52.420092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.420128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:52.420137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:52.420140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:52.420578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 349 sessionId:  describe result for acl check
2025-10-10T14:31:52.420616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:52.420623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:52.420624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:52.420630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600767827846013:4510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:52.421181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600767827846013:4510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:52.423525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600767827846013:4510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:52.423717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:52.425520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:52.425769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:52.425781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:52.425794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:52.425847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:52.425886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600767045636077:3856]
2025-10-10T14:31:52.426173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600767827846013:4510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:52.426185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600767827846013:4510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:52.426188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600767827846013:4510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:52.426195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:52.426279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:52.426538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:52.426569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:52.426840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:52.426896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.426901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.426902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.426903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.426904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.426906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.426907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.426908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.426909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.426910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.426911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.426912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.426914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.426919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.426927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.426930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.426932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.426934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.426936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.426938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.426940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.426942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.426944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.426946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.426948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.426950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.426956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.426964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.426970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.426975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.426979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.426984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.426987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.426993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.426997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.427003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.427011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.427017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.427022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.427028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.427037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.427042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.427050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.427055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.427064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.427069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.427077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.427082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.427086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.427091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.427099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.427104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.427149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:52.429433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:52.429802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:52.429813Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:52.429815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:52.429819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:52.429824Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 348 [2:7559600767045636077:3856]
2025-10-10T14:31:52.429835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:52.429856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:52.429863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.429866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.429868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.429882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:52.429891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:52.429901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:52.429941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.429946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.429947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.429949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:52.429998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:52.430005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.430014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.430030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.430054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:52.430073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600767045636071:3856]
2025-10-10T14:31:52.430075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600767045636071:3856]
2025-10-10T14:31:52.430077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600767045636071:3856]
2025-10-10T14:31:52.430085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:52.430095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:52.430098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846111:4510], now have 1 active actors on pipe
2025-10-10T14:31:52.430102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827845944:2438], now have 1 active actors on pipe
2025-10-10T14:31:52.430105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:52.430108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:52.430109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:52.430124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:52.430133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:52.430151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600767045636071:3856]
2025-10-10T14:31:52.430164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:52.430151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 348
2025-10-10T14:31:52.430178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:52.430156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 348
2025-10-10T14:31:52.430236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.430246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.430278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:52.430289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.430297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.430299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:52.430310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.430323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:52.430340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.430531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.430538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.430552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.430632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 349 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0
2025-10-10T14:31:52.430944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44718326-e88576a3-826e4e15-138043f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:52.433297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0] Write session: try to update token
2025-10-10T14:31:52.433315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:52.446990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:52.447004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:52.447014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600767045636071:3856]
2025-10-10T14:31:52.447056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:52.447101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:52.447359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:52.447491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:52.447624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:52.447752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:52.447933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:52.447965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:52.448398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId: src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:52.451147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:52.451384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.451401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.451449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:52.451536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:52.462885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:52.462902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:52.462905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:52.462907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:52.462918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600767045636071:3856]
2025-10-10T14:31:52.462922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600767045636071:3856]
2025-10-10T14:31:52.462927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600767045636071:3856]
2025-10-10T14:31:52.462961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:52.462969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:52.462971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:52.462973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:52.462976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.462981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:52.463102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:52.512186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600767827846124:4235]
2025-10-10T14:31:52.512488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 348, pipe: [1:7559600767827846124:4235]
2025-10-10T14:31:52.566745Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:52.573218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.573237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.573396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.573449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.573515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.573578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.573720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.573726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.573799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.573853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.573939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.573996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.574033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.574039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.574093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.574157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.574221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.574275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.574313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.574318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.574374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.574590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.574687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.574740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.574778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.574783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.574839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.574892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.574945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.575000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.575042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.575052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.575117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.575168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.575227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.575290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.575327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.575333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.575387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.575437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.575492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.575546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.575583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.575588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.575644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.575694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.575745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.575796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.575834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.575839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.575892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.575977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.576092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.576156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.576194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.576201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.576254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:52.576302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:52.576353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:52.576406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:52.576443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:52.576449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:52.576486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846124:4235], now have 1 active actors on pipe
2025-10-10T14:31:52.576760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:52.576773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:52.576803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 349 reason: error at write: Disconnected sessionId: src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0
2025-10-10T14:31:52.576902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:52.577014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 349 sessionId: src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0 is DEAD
2025-10-10T14:31:52.577119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600767827846124:4235]
2025-10-10T14:31:52.577146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:52.577153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0] Write session will restart in 0.005527s
2025-10-10T14:31:52.577158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:52.577173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0] Write session: Do CDS request
2025-10-10T14:31:52.577178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:52.583807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.583918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:52.583930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 350
2025-10-10T14:31:52.584055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.584088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:52.584099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:52.584103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:52.584560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 350 sessionId:  describe result for acl check
2025-10-10T14:31:52.584599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:52.584605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:52.584608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:52.584613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600767827846159:4516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:52.585135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600767827846159:4516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:52.588257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600767827846159:4516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:52.589610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:52.591605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:52.591811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:52.591823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:52.591835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:52.591888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:52.591894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600767827846159:4516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:52.591908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600767827846159:4516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:52.591911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600767827846159:4516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:52.591929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600767045636257:3858]
2025-10-10T14:31:52.591919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:52.592517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:52.592850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:52.592892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:52.593207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:52.593255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.593261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.593262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.593263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.593264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.593265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.593266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.593268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.593269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.593270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.593271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.593271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.593272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.593276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.593284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.593286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.593288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.593290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.593292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.593294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.593296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.593298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.593301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.593303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.593305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.593307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.593312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.593317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.593321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.593325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.593327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.593345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.593349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.593355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.593359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.593364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.593368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.593372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.593377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.593382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.593385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.593388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.593391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.593394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.593396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.593400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.593402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.593407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.593409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.593412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.593415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.593420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.593457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:52.595787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:52.596281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:52.596294Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:52.596297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:52.596300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:52.596306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 349 [2:7559600767045636257:3858]
2025-10-10T14:31:52.596317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:52.596332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:52.596340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.596343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.596345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.596360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:52.596368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:52.596376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:52.596432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.596438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.596440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.596443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:52.596504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:52.596512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.596523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.596535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.596557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:52.596580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846136:2438], now have 1 active actors on pipe
2025-10-10T14:31:52.596588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846305:4516], now have 1 active actors on pipe
2025-10-10T14:31:52.596595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600767045636252:3858]
2025-10-10T14:31:52.596598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600767045636252:3858]
2025-10-10T14:31:52.596600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600767045636252:3858]
2025-10-10T14:31:52.596614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:52.596626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:52.596639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:52.596646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:52.596649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:52.596649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:52.596651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:52.596668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600767045636252:3858]
2025-10-10T14:31:52.596676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:52.596650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 349
2025-10-10T14:31:52.596667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 349
2025-10-10T14:31:52.596685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:52.596707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.596716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.596753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|820adbf8-9caf3322-de1cf0b8-82220772_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:52.596766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.596769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.596772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:52.596782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.596792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:52.596809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.596985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.596992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.597008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.597123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 350 partition: 0 MaxSeqNo: 40 sessionId: src_id|820adbf8-9caf3322-de1cf0b8-82220772_0
2025-10-10T14:31:52.597493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b1e86-6dba7e6d-21009e39-89ecdbf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|820adbf8-9caf3322-de1cf0b8-82220772_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:52.599869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820adbf8-9caf3322-de1cf0b8-82220772_0] Write session: try to update token
2025-10-10T14:31:52.599883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820adbf8-9caf3322-de1cf0b8-82220772_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:52.614841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:52.614858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:52.614862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:52.614868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:52.614876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600767045636252:3858]
2025-10-10T14:31:52.614879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600767045636252:3858]
2025-10-10T14:31:52.614885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600767045636252:3858]
2025-10-10T14:31:52.614926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:52.614932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.614934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:52.614956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:52.614972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:52.614977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:52.615058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:52.615717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId: src_id|820adbf8-9caf3322-de1cf0b8-82220772_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:52.618365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:52.677053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600767827846320:4235]
2025-10-10T14:31:52.677354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 349, pipe: [1:7559600767827846320:4235]
2025-10-10T14:31:52.718611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:52.718884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.718899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.718935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846320:4235], now have 1 active actors on pipe
2025-10-10T14:31:52.719136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:52.719142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:52.719156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:52.719171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600767827846320:4235]
2025-10-10T14:31:52.719192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:52.719208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 350 reason: error at write: Disconnected sessionId: src_id|820adbf8-9caf3322-de1cf0b8-82220772_0
2025-10-10T14:31:52.719402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 350 sessionId: src_id|820adbf8-9caf3322-de1cf0b8-82220772_0 is DEAD
2025-10-10T14:31:52.719546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820adbf8-9caf3322-de1cf0b8-82220772_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:52.719557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820adbf8-9caf3322-de1cf0b8-82220772_0] Write session will restart in 0.006463s
2025-10-10T14:31:52.719588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820adbf8-9caf3322-de1cf0b8-82220772_0] Write session: Do CDS request
2025-10-10T14:31:52.719597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820adbf8-9caf3322-de1cf0b8-82220772_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:52.726830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820adbf8-9caf3322-de1cf0b8-82220772_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.726891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:52.726903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 351
2025-10-10T14:31:52.727044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.727078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:52.727084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:52.727092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:52.727537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 351 sessionId:  describe result for acl check
2025-10-10T14:31:52.727566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:52.727567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:52.727568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:52.727572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600767827846387:4520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:52.727972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600767827846387:4520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:52.730201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600767827846387:4520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:52.731224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:52.732967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:52.733053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600767827846387:4520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:52.733065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600767827846387:4520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:52.733069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600767827846387:4520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:52.733076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:52.733141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:52.733153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:52.733164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:52.733216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:52.733255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600767045636436:3861]
2025-10-10T14:31:52.733847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:52.734151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:52.734187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:52.734401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:52.734452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.734458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.734459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.734460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.734461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.734462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.734463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.734464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.734465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.734466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.734467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.734468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.734469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.734473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.734484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.734487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.734491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.734494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.734498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.734502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.734506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.734510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.734514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.734518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.734522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.734526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.734531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.734536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.734541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.734544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.734547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.734550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.734552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.734555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.734558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.734560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.734563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.734566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.734568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.734571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.734574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.734577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.734580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.734583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.734586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.734589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.734592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.734595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.734597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.734601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.734603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.734606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.734627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:52.736724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:52.737168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:52.737178Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:52.737179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:52.737183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:52.737187Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 350 [2:7559600767045636436:3861]
2025-10-10T14:31:52.737194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:52.737206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:52.737211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.737213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.737214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.737225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:52.737233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:52.737240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:52.737292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.737299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.737301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.737304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:52.737375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:52.737382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.737393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.737405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.737427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:52.737450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846321:2438], now have 1 active actors on pipe
2025-10-10T14:31:52.737458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846491:4520], now have 1 active actors on pipe
2025-10-10T14:31:52.737464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600767045636431:3861]
2025-10-10T14:31:52.737470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600767045636431:3861]
2025-10-10T14:31:52.737473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600767045636431:3861]
2025-10-10T14:31:52.737471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 350
2025-10-10T14:31:52.737485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:52.737489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 350
2025-10-10T14:31:52.737490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:52.737493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:52.737494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:52.737502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:52.737518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:52.737524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:52.737555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.737564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.737578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600767045636431:3861]
2025-10-10T14:31:52.737589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:52.737597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:52.737615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|989f1151-5481fa66-72236e34-f2607544_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:52.737626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.737634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.737636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:52.737645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.737658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:52.737682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.737805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.737814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.737827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.737895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 351 partition: 0 MaxSeqNo: 40 sessionId: src_id|989f1151-5481fa66-72236e34-f2607544_0
2025-10-10T14:31:52.738177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820adbf8-9caf3322-de1cf0b8-82220772_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|989f1151-5481fa66-72236e34-f2607544_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:52.740661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989f1151-5481fa66-72236e34-f2607544_0] Write session: try to update token
2025-10-10T14:31:52.740677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989f1151-5481fa66-72236e34-f2607544_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:52.755596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:52.755615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:52.755617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:52.755619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:52.755630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600767045636431:3861]
2025-10-10T14:31:52.755634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600767045636431:3861]
2025-10-10T14:31:52.755638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600767045636431:3861]
2025-10-10T14:31:52.755685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:52.755694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:52.755697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.755700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:52.755701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:52.755705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:52.755829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:52.756504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId: src_id|989f1151-5481fa66-72236e34-f2607544_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:52.759059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:52.819382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600767827846503:4235]
2025-10-10T14:31:52.819677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 350, pipe: [1:7559600767827846503:4235]
2025-10-10T14:31:52.859180Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:52.859469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.859482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.859519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846503:4235], now have 1 active actors on pipe
2025-10-10T14:31:52.859666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:52.859761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:52.859772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600767827846503:4235]
2025-10-10T14:31:52.859793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:52.859795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:52.859859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 351 reason: error at write: Disconnected sessionId: src_id|989f1151-5481fa66-72236e34-f2607544_0
2025-10-10T14:31:52.860045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 351 sessionId: src_id|989f1151-5481fa66-72236e34-f2607544_0 is DEAD
2025-10-10T14:31:52.860213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989f1151-5481fa66-72236e34-f2607544_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:52.860222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989f1151-5481fa66-72236e34-f2607544_0] Write session will restart in 0.007318s
2025-10-10T14:31:52.860241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989f1151-5481fa66-72236e34-f2607544_0] Write session: Do CDS request
2025-10-10T14:31:52.860245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989f1151-5481fa66-72236e34-f2607544_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:52.868722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989f1151-5481fa66-72236e34-f2607544_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.868853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:52.868862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 352
2025-10-10T14:31:52.868950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:52.868982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:52.868987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:52.868990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:52.869341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 352 sessionId:  describe result for acl check
2025-10-10T14:31:52.869371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:52.869376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:52.869377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:52.869381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600767827846600:4524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:52.869810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600767827846600:4524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:52.871701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:52.871756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600767827846600:4524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:52.873582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:52.873759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600767827846600:4524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:52.873769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600767827846600:4524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:52.873772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600767827846600:4524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:52.873776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:52.873839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:52.873853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:52.873871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:52.873936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:52.873982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600767045636616:3863]
2025-10-10T14:31:52.874421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:52.874664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:52.874694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:52.874970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:52.875023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.875029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.875030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.875031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.875033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.875034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.875035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.875036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.875037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.875038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.875039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.875040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.875042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.875047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.875058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.875062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.875066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.875070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.875074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.875078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.875082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.875086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.875090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.875094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.875098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.875102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.875109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.875117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:52.875124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.875129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:52.875134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.875139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:52.875148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.875154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:52.875158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.875164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:52.875168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.875173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:52.875178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.875185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:52.875189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.875194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:52.875199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.875206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:52.875210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.875216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:52.875220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.875227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.875231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.875236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.875241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.875250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.875288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:52.877474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:52.877850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:52.877862Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:52.877864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:52.877868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:52.877873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 351 [2:7559600767045636616:3863]
2025-10-10T14:31:52.877884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:52.877898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:52.877904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.877906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.877908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.877919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:52.877924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:52.877930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:52.877978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.877985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.877987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.877989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:52.878048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:52.878056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.878067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:52.878079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:52.878100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:52.878120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846504:2438], now have 1 active actors on pipe
2025-10-10T14:31:52.878126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846675:4524], now have 1 active actors on pipe
2025-10-10T14:31:52.878132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600767045636608:3863]
2025-10-10T14:31:52.878134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600767045636608:3863]
2025-10-10T14:31:52.878136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600767045636608:3863]
2025-10-10T14:31:52.878149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:52.878167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:52.878170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:52.878173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:52.878175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:52.878181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:52.878184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:52.878202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600767045636608:3863]
2025-10-10T14:31:52.878185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 351
2025-10-10T14:31:52.878210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:52.878186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 351
2025-10-10T14:31:52.878220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:52.878229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.878237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.878272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:52.878284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:52.878288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:52.878290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:52.878300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:52.878311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:52.878334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.878470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:52.878478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:52.878491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:52.878558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 352 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0
2025-10-10T14:31:52.878829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989f1151-5481fa66-72236e34-f2607544_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:52.881138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0] Write session: try to update token
2025-10-10T14:31:52.881160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:52.894921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId: src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:52.896653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:52.896674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:52.896678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:52.896679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:52.896688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600767045636608:3863]
2025-10-10T14:31:52.896692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600767045636608:3863]
2025-10-10T14:31:52.896695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600767045636608:3863]
2025-10-10T14:31:52.896741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:52.896745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:52.896751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:52.896755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:52.896756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:52.896758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:52.896897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:52.897412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:52.959674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600767827846686:4235]
2025-10-10T14:31:52.959905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 351, pipe: [1:7559600767827846686:4235]
2025-10-10T14:31:53.001990Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:53.002302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.002315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.002352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600767827846686:4235], now have 1 active actors on pipe
2025-10-10T14:31:53.002562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:53.002567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600767827846686:4235]
2025-10-10T14:31:53.002571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:53.002594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:53.002596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:53.002663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 352 reason: error at write: Disconnected sessionId: src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0
2025-10-10T14:31:53.002836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 352 sessionId: src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0 is DEAD
2025-10-10T14:31:53.002997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:53.003004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0] Write session will restart in 0.007982s
2025-10-10T14:31:53.003022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0] Write session: Do CDS request
2025-10-10T14:31:53.003029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:53.011832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.011929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:53.011941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 353
2025-10-10T14:31:53.012100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.012128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:53.012135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:53.012146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:53.012466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 353 sessionId:  describe result for acl check
2025-10-10T14:31:53.012490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:53.012495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:53.012496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:53.012500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600772122814119:4528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:53.012880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600772122814119:4528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:53.013842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:53.014625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600772122814119:4528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:53.015581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:53.015771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:53.015782Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:53.015793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:53.015846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:53.015979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600771340604091:3865]
2025-10-10T14:31:53.016566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:53.016787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:53.016825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:53.016936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600772122814119:4528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:53.016946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600772122814119:4528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:53.016949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600772122814119:4528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:53.016954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:53.017125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:53.017180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.017187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.017188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.017189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.017190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.017191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.017192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.017193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.017195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.017196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.017197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.017198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.017199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.017205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.017217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.017221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.017225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.017228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.017232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.017236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.017240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.017244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.017248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.017252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.017256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.017259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.017267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.017279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.017289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.017299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.017307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.017320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.017325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.017345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.017350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.017359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.017364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.017371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.017380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.017389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.017397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.017402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.017410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.017415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.017423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.017428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.017432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.017439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.017446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.017452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.017460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.017465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.017509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:53.019547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:53.020071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:53.020081Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:53.020084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:53.020087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:53.020093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 352 [2:7559600771340604091:3865]
2025-10-10T14:31:53.020105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:53.020127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:53.020137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.020140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.020142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.020157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:53.020163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:53.020171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:53.020227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.020235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.020236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.020239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:53.020326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:53.020334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.020345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.020362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.020384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:53.020386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 352
2025-10-10T14:31:53.020409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122813984:2438], now have 1 active actors on pipe
2025-10-10T14:31:53.020413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 352
2025-10-10T14:31:53.020416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814158:4528], now have 1 active actors on pipe
2025-10-10T14:31:53.020422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600771340604085:3865]
2025-10-10T14:31:53.020424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600771340604085:3865]
2025-10-10T14:31:53.020426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600771340604085:3865]
2025-10-10T14:31:53.020435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:53.020445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:53.020448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:53.020448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:53.020449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:53.020463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:53.020466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:53.020486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.020491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.020521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600771340604085:3865]
2025-10-10T14:31:53.020533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:53.020539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:53.020557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:53.020567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.020572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.020578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:53.020588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.020602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:53.020635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.020775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.020782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.020797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.020855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 353 partition: 0 MaxSeqNo: 40 sessionId: src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0
2025-10-10T14:31:53.021180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e51b6b7-3c6afd42-9c4f117b-88055749_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:53.023773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0] Write session: try to update token
2025-10-10T14:31:53.023793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:53.037388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId: src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:53.038804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:53.038824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:53.038828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:53.038829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:53.038838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600771340604085:3865]
2025-10-10T14:31:53.038843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600771340604085:3865]
2025-10-10T14:31:53.038847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600771340604085:3865]
2025-10-10T14:31:53.038893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:53.038896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:53.038903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:53.038905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.038906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:53.038907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:53.039114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:53.039941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:53.102532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600772122814167:4235]
2025-10-10T14:31:53.102859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 352, pipe: [1:7559600772122814167:4235]
2025-10-10T14:31:53.143166Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:53.143398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.143410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.143448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814167:4235], now have 1 active actors on pipe
2025-10-10T14:31:53.143660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:53.143836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600772122814167:4235]
2025-10-10T14:31:53.143839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:53.143868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:53.143929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 353 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0
2025-10-10T14:31:53.144134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 353 sessionId: src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0 is DEAD
2025-10-10T14:31:53.144311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:53.144323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0] Write session will restart in 0.009853s
2025-10-10T14:31:53.144358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0] Write session: Do CDS request
2025-10-10T14:31:53.144365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:53.155167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:53.155872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.155969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:53.155983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 354
2025-10-10T14:31:53.156124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.156156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:53.156163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:53.156167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:53.156576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 354 sessionId:  describe result for acl check
2025-10-10T14:31:53.156620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:53.156627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:53.156629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:53.156636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600772122814325:4533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:53.157195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600772122814325:4533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:53.157301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:53.157548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:53.157559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:53.157572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:53.157625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:53.157778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600771340604285:3868]
2025-10-10T14:31:53.158401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:53.158659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:53.158694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:53.158980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:53.159037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.159044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.159045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.159047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.159048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.159049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.159050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.159051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.159052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.159053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.159054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.159056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.159057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.159063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.159075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.159080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.159084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.159088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.159092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.159096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.159100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.159104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.159109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.159113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.159117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.159122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.159129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.159138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.159144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.159150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.159154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.159159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.159164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.159169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.159174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.159179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.159183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.159167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600772122814325:4533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:53.159188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.159193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.159198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.159203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.159210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.159215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.159220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.159225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.159234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.159239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.159245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.159251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.159257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.159266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.159272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.159309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:53.161467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600772122814325:4533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:53.161480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600772122814325:4533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:53.161483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600772122814325:4533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:53.161491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:53.161647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:53.162061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:53.162077Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:53.162079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:53.162085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:53.162091Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 353 [2:7559600771340604285:3868]
2025-10-10T14:31:53.162104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:53.162123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:53.162131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.162135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.162137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.162153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:53.162166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:53.162173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:53.162238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.162245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.162248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.162250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:53.162314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:53.162323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.162335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.162346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.162365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:53.162391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814358:4533], now have 1 active actors on pipe
2025-10-10T14:31:53.162400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814181:2438], now have 1 active actors on pipe
2025-10-10T14:31:53.162408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600771340604279:3868]
2025-10-10T14:31:53.162411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600771340604279:3868]
2025-10-10T14:31:53.162413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600771340604279:3868]
2025-10-10T14:31:53.162411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 353
2025-10-10T14:31:53.162424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:53.162426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 353
2025-10-10T14:31:53.162438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:53.162455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:53.162458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:53.162460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:53.162471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:53.162475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:53.162492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.162502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.162542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600771340604279:3868]
2025-10-10T14:31:53.162555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:53.162577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:53.162577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:53.162592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.162597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.162599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:53.162611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.162626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:53.162661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.162837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.162848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.162866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.162929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 354 partition: 0 MaxSeqNo: 40 sessionId: src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0
2025-10-10T14:31:53.163356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b96e603f-f67ee58-ff9f4610-1c4f71ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:53.166503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0] Write session: try to update token
2025-10-10T14:31:53.166524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:53.181350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:53.181369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:53.181373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:53.181375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:53.181385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600771340604279:3868]
2025-10-10T14:31:53.181389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600771340604279:3868]
2025-10-10T14:31:53.181393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600771340604279:3868]
2025-10-10T14:31:53.181445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:53.181445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:53.181451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:53.181455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:53.181457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.181459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:53.181600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:53.181900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId: src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:53.184402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:53.243835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600772122814389:4235]
2025-10-10T14:31:53.244138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 353, pipe: [1:7559600772122814389:4235]
2025-10-10T14:31:53.287255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:53.287836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.287849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.287890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814389:4235], now have 1 active actors on pipe
2025-10-10T14:31:53.288094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:53.288127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600772122814389:4235]
2025-10-10T14:31:53.288138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:53.288141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:53.288172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:53.288194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 354 reason: error at write: Disconnected sessionId: src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0
2025-10-10T14:31:53.288382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 354 sessionId: src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0 is DEAD
2025-10-10T14:31:53.288536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:53.288546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0] Write session will restart in 0.008404s
2025-10-10T14:31:53.288571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0] Write session: Do CDS request
2025-10-10T14:31:53.288582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:53.297860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.297928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:53.297943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 355
2025-10-10T14:31:53.298102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.298137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:53.298147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:53.298151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:53.298646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 355 sessionId:  describe result for acl check
2025-10-10T14:31:53.298684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:53.298691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:53.298693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:53.298699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600772122814510:4546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:53.299148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600772122814510:4546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:53.300661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:53.300907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600772122814510:4546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:53.302828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:53.303037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:53.303047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:53.303057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:53.303098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:53.303150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600771340604506:3883]
2025-10-10T14:31:53.303267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600772122814510:4546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:53.303282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600772122814510:4546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:53.303286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600772122814510:4546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:53.303293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:53.303685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:53.303946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:53.303986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:53.304251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:53.304289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.304295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.304296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.304297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.304298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.304299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.304300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.304301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.304303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.304304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.304305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.304306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.304307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.304313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.304325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.304329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.304332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.304336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.304339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.304342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.304346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.304349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.304353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.304356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.304360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.304364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.304371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.304380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.304386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.304389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.304392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.304395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.304398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.304401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.304404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.304407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.304414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.304417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.304420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.304423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.304426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.304432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.304435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.304438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.304441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.304446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.304451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.304455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.304459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.304469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.304478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.304486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.304529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:53.306745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:53.307045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:53.307055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:53.307056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:53.307059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:53.307065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 354 [2:7559600771340604506:3883]
2025-10-10T14:31:53.307074Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:53.307092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:53.307100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.307104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.307106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.307122Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:53.307131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:53.307140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:53.307183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.307190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.307191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.307193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:53.307246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:53.307255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.307261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.307268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.307277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:53.307294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600771340604501:3883]
2025-10-10T14:31:53.307300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600771340604501:3883]
2025-10-10T14:31:53.307302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600771340604501:3883]
2025-10-10T14:31:53.307309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:53.307319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:53.307321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814390:2438], now have 1 active actors on pipe
2025-10-10T14:31:53.307322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:53.307323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814565:4546], now have 1 active actors on pipe
2025-10-10T14:31:53.307324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:53.307330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:53.307339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:53.307345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:53.307359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600771340604501:3883]
2025-10-10T14:31:53.307368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:53.307379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:53.307397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 354
2025-10-10T14:31:53.307404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 354
2025-10-10T14:31:53.307488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.307499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.307531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:53.307541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.307547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.307549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:53.307558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.307571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:53.307586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.307768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.307777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.307792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.307875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 355 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0
2025-10-10T14:31:53.308246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7d3ec3-a0ef7ca3-76f6eada-6b557e6d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:53.311056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0] Write session: try to update token
2025-10-10T14:31:53.311074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:53.323261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:53.323278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:53.323287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600771340604501:3883]
2025-10-10T14:31:53.323332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:53.323338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:53.323502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:53.323662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:53.323797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:53.323932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:53.324112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:53.324156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:53.325091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId: src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:53.327511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:53.327738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.327757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.327806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:53.327899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:53.336350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:53.336367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:53.336370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:53.336371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:53.336380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600771340604501:3883]
2025-10-10T14:31:53.336383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600771340604501:3883]
2025-10-10T14:31:53.336386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600771340604501:3883]
2025-10-10T14:31:53.336424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:53.336434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.336435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:53.336438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:53.336444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:53.336448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:53.336571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:53.388219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600772122814576:4235]
2025-10-10T14:31:53.388513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 354, pipe: [1:7559600772122814576:4235]
2025-10-10T14:31:53.440085Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:53.446673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.446694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.446836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.446895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.446968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.447037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.447086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.447096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.447158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.447209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.447303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.447359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.447400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.447407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.447477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.447539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.447594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.447648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.447686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.447691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.447781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.447852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.447925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.447979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.448016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.448021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.448077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.448126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.448179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.448232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.448284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.448290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.448344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.448396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.448449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.448500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.448537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.448542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.448604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.448663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.448716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.448766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.448803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.448810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.448864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.448913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.448961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.449015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.449070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.449075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.449127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.449175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.449230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.449295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.449354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.449360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.449413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:53.449467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:53.449531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:53.449632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:53.449752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:53.449758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:53.449796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814576:4235], now have 1 active actors on pipe
2025-10-10T14:31:53.449986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:53.450040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:53.450042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:53.450068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 355 reason: error at write: Disconnected sessionId: src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0
2025-10-10T14:31:53.450241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 355 sessionId: src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0 is DEAD
2025-10-10T14:31:53.450357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600772122814576:4235]
2025-10-10T14:31:53.450384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:53.450396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0] Write session will restart in 0.008295s
2025-10-10T14:31:53.450421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0] Write session: Do CDS request
2025-10-10T14:31:53.450427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:53.450529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:53.459857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.459926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:53.459946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 356
2025-10-10T14:31:53.460126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.460153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:53.460161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:53.460165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:53.460572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 356 sessionId:  describe result for acl check
2025-10-10T14:31:53.460598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:53.460603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:53.460604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:53.460609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600772122814688:4550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:53.461446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600772122814688:4550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:53.462610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:53.463527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600772122814688:4550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:53.464633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:53.464794Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:53.464809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:53.464821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:53.464875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:53.464914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600771340604690:3885]
2025-10-10T14:31:53.465503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:53.465573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600772122814688:4550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:53.465596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600772122814688:4550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:53.465600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600772122814688:4550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:53.465607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:53.465825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:53.465871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:53.466207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:53.466261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.466267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.466268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.466269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.466270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.466271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.466272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.466273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.466274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.466276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.466277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.466278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.466279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.466285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.466297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.466302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.466306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.466310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.466314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.466317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.466320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.466324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.466328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.466331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.466335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.466338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.466346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.466360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.466372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.466381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.466390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.466399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.466404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.466410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.466418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.466424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.466433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.466438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.466452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.466461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.466466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.466476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.466484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.466491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.466499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.466506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.466514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.466519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.466528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.466534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.466542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.466548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.466592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:53.468798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:53.469093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:53.469105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:53.469107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:53.469110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:53.469116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 355 [2:7559600771340604690:3885]
2025-10-10T14:31:53.469127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:53.469142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:53.469149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.469152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.469154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.469169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:53.469180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:53.469187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:53.469237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.469244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.469246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.469248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:53.469312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:53.469321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.469347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.469359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.469382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:53.469406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814577:2438], now have 1 active actors on pipe
2025-10-10T14:31:53.469409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814755:4550], now have 1 active actors on pipe
2025-10-10T14:31:53.469417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600771340604685:3885]
2025-10-10T14:31:53.469423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600771340604685:3885]
2025-10-10T14:31:53.469425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600771340604685:3885]
2025-10-10T14:31:53.469417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 355
2025-10-10T14:31:53.469433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 355
2025-10-10T14:31:53.469440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:53.469457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:53.469458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:53.469461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:53.469462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:53.469477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:53.469481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:53.469514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.469522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.469536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600771340604685:3885]
2025-10-10T14:31:53.469547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:53.469570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:53.469579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|815ad701-e127515-6f3b52cb-48798bf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:53.469586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.469589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.469592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:53.469602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.469616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:53.469638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.469768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.469776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.469791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.469933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 356 partition: 0 MaxSeqNo: 40 sessionId: src_id|815ad701-e127515-6f3b52cb-48798bf3_0
2025-10-10T14:31:53.470250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f5dfd1b-2d8d3b1c-ad147ac5-d9cc7d6f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|815ad701-e127515-6f3b52cb-48798bf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:53.472797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815ad701-e127515-6f3b52cb-48798bf3_0] Write session: try to update token
2025-10-10T14:31:53.472816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815ad701-e127515-6f3b52cb-48798bf3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:53.486335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId: src_id|815ad701-e127515-6f3b52cb-48798bf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:53.487946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:53.487965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:53.487968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:53.487970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:53.487978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600771340604685:3885]
2025-10-10T14:31:53.487983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600771340604685:3885]
2025-10-10T14:31:53.487986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600771340604685:3885]
2025-10-10T14:31:53.488033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:53.488036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:53.488042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:53.488045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.488046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:53.488048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:53.488182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:53.488897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:53.550495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600772122814775:4235]
2025-10-10T14:31:53.550696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 355, pipe: [1:7559600772122814775:4235]
2025-10-10T14:31:53.592654Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:53.593100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.593118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.593169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814775:4235], now have 1 active actors on pipe
2025-10-10T14:31:53.593385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600772122814775:4235]
2025-10-10T14:31:53.593413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:53.593400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:53.593412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:53.593415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:53.593487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 356 reason: error at write: Disconnected sessionId: src_id|815ad701-e127515-6f3b52cb-48798bf3_0
2025-10-10T14:31:53.593687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 356 sessionId: src_id|815ad701-e127515-6f3b52cb-48798bf3_0 is DEAD
2025-10-10T14:31:53.593865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815ad701-e127515-6f3b52cb-48798bf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:53.593876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815ad701-e127515-6f3b52cb-48798bf3_0] Write session will restart in 0.007615s
2025-10-10T14:31:53.593901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815ad701-e127515-6f3b52cb-48798bf3_0] Write session: Do CDS request
2025-10-10T14:31:53.593908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815ad701-e127515-6f3b52cb-48798bf3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:53.603894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815ad701-e127515-6f3b52cb-48798bf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.603994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:53.604006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 357
2025-10-10T14:31:53.604114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.604139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:53.604147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:53.604150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:53.604599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 357 sessionId:  describe result for acl check
2025-10-10T14:31:53.604637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:53.604644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:53.604646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:53.604654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600772122814923:4556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:53.605181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600772122814923:4556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:53.605285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:53.607327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600772122814923:4556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:53.607385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:53.607565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:53.607575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:53.607587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:53.607638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:53.607676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600771340604877:3888]
2025-10-10T14:31:53.608271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:53.608563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:53.608599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:53.608912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:53.608966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.608972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.608973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.608974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.608975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.608977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.608978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.608980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.608981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.608982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.608983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.608985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.608986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.608992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.609004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.609008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.609012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.609019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.609023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.609031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.609035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.609039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.609043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.609046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.609051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.609055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.609062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.609074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.609085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.609094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.609103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.609107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.609112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.609117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.609127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.609132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.609136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.609141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.609151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.609157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.609161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.609166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.609172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.609177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.609181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.609186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.609190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.609195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.609204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.609209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.609213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.609222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.609261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:53.609494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600772122814923:4556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:53.609506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600772122814923:4556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:53.609509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600772122814923:4556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:53.609518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:53.611435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:53.612055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:53.612065Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:53.612067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:53.612071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:53.612078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 356 [2:7559600771340604877:3888]
2025-10-10T14:31:53.612090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:53.612108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:53.612118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.612121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.612123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.612139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:53.612151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:53.612162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:53.612228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.612235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.612237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.612240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:53.612307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:53.612316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.612327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.612339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.612355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:53.612382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814959:4556], now have 1 active actors on pipe
2025-10-10T14:31:53.612391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814776:2438], now have 1 active actors on pipe
2025-10-10T14:31:53.612398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600771340604871:3888]
2025-10-10T14:31:53.612404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600771340604871:3888]
2025-10-10T14:31:53.612406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600771340604871:3888]
2025-10-10T14:31:53.612420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:53.612425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 356
2025-10-10T14:31:53.612431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 356
2025-10-10T14:31:53.612433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:53.612444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:53.612448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:53.612451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:53.612455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:53.612459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:53.612481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600771340604871:3888]
2025-10-10T14:31:53.612484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:53.612486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:53.612504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.612513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.612559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9777666a-661cfb28-af21f057-69a5d0ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:53.612573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.612576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.612583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:53.612593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.612608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:53.612629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.612762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.612770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.612784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.612836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 357 partition: 0 MaxSeqNo: 40 sessionId: src_id|9777666a-661cfb28-af21f057-69a5d0ec_0
2025-10-10T14:31:53.613173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815ad701-e127515-6f3b52cb-48798bf3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9777666a-661cfb28-af21f057-69a5d0ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:53.616085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9777666a-661cfb28-af21f057-69a5d0ec_0] Write session: try to update token
2025-10-10T14:31:53.616101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9777666a-661cfb28-af21f057-69a5d0ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:53.629774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId: src_id|9777666a-661cfb28-af21f057-69a5d0ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:53.630959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:53.630978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:53.630982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:53.630984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:53.630994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600771340604871:3888]
2025-10-10T14:31:53.630999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600771340604871:3888]
2025-10-10T14:31:53.631003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600771340604871:3888]
2025-10-10T14:31:53.631052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:53.631052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:53.631058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:53.631062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:53.631066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.631069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:53.631202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:53.632211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:53.693378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600772122814967:4235]
2025-10-10T14:31:53.693665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 356, pipe: [1:7559600772122814967:4235]
2025-10-10T14:31:53.733171Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:53.733395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.733407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.733445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814967:4235], now have 1 active actors on pipe
2025-10-10T14:31:53.733618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:53.733676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:53.733688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:53.733688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:53.733724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600772122814967:4235]
2025-10-10T14:31:53.733743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 357 reason: error at write: Disconnected sessionId: src_id|9777666a-661cfb28-af21f057-69a5d0ec_0
2025-10-10T14:31:53.733909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 357 sessionId: src_id|9777666a-661cfb28-af21f057-69a5d0ec_0 is DEAD
2025-10-10T14:31:53.734046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9777666a-661cfb28-af21f057-69a5d0ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:53.734057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9777666a-661cfb28-af21f057-69a5d0ec_0] Write session will restart in 0.005527s
2025-10-10T14:31:53.734077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9777666a-661cfb28-af21f057-69a5d0ec_0] Write session: Do CDS request
2025-10-10T14:31:53.734097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9777666a-661cfb28-af21f057-69a5d0ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:53.740694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9777666a-661cfb28-af21f057-69a5d0ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.740786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:53.740799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 358
2025-10-10T14:31:53.740945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.740978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:53.740987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:53.740990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:53.741476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 358 sessionId:  describe result for acl check
2025-10-10T14:31:53.741508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:53.741513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:53.741515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:53.741520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600772122815005:4560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:53.741971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600772122815005:4560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:53.744051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600772122815005:4560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:53.746085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600772122815005:4560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:53.746095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:53.746104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600772122815005:4560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:53.746107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600772122815005:4560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:53.746112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:53.748049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:53.748208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:53.748219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:53.748229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:53.748266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:53.748297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600771340605064:3890]
2025-10-10T14:31:53.748744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:53.749009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:53.749052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:53.749372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:53.749425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.749431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.749432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.749433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.749435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.749436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.749437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.749438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.749439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.749440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.749441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.749442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.749444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.749449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.749459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.749463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.749467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.749471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.749475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.749479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.749483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.749487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.749495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.749501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.749505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.749513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.749519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.749531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.749541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.749550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.749557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.749566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.749572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.749582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.749591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.749598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.749607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.749612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.749616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.749621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.749626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.749632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.749640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.749649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.749653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.749662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.749670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.749675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.749680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.749689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.749697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.749706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.749750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:53.751926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:53.752230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:53.752240Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:53.752242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:53.752245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:53.752251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 357 [2:7559600771340605064:3890]
2025-10-10T14:31:53.752262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:53.752280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:53.752287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.752291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.752295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.752311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:53.752322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:53.752334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:53.752390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.752396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.752398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.752400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:53.752474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:53.752481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.752492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.752505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.752528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:53.752554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122814968:2438], now have 1 active actors on pipe
2025-10-10T14:31:53.752562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122815144:4560], now have 1 active actors on pipe
2025-10-10T14:31:53.752569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600771340605058:3890]
2025-10-10T14:31:53.752575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600771340605058:3890]
2025-10-10T14:31:53.752578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600771340605058:3890]
2025-10-10T14:31:53.752569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 357
2025-10-10T14:31:53.752591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:53.752570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 357
2025-10-10T14:31:53.752607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:53.752607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:53.752610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:53.752611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:53.752627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:53.752634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:53.752668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.752679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.752693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600771340605058:3890]
2025-10-10T14:31:53.752701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:53.752712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:53.752728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:53.752740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.752743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.752750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:53.752760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.752770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:53.752791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.752933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.752943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.752958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.753070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 358 partition: 0 MaxSeqNo: 40 sessionId: src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0
2025-10-10T14:31:53.753420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9777666a-661cfb28-af21f057-69a5d0ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:53.755904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0] Write session: try to update token
2025-10-10T14:31:53.755918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:53.769280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId: src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:53.771511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:53.771531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:53.771535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:53.771537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:53.771546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600771340605058:3890]
2025-10-10T14:31:53.771551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600771340605058:3890]
2025-10-10T14:31:53.771555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600771340605058:3890]
2025-10-10T14:31:53.771604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:53.771609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:53.771616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:53.771616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.771619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:53.771621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:53.771715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:53.771748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:53.833669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600772122815157:4235]
2025-10-10T14:31:53.834003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 357, pipe: [1:7559600772122815157:4235]
2025-10-10T14:31:53.881309Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:53.881753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.881766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.881804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122815157:4235], now have 1 active actors on pipe
2025-10-10T14:31:53.881983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:53.882061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:53.882085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:53.882088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:53.882107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600772122815157:4235]
2025-10-10T14:31:53.882146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 358 reason: error at write: Disconnected sessionId: src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0
2025-10-10T14:31:53.882341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 358 sessionId: src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0 is DEAD
2025-10-10T14:31:53.882489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:53.882499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0] Write session will restart in 0.008989s
2025-10-10T14:31:53.882522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0] Write session: Do CDS request
2025-10-10T14:31:53.882535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:53.892877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.892919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:53.892934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 359
2025-10-10T14:31:53.893083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:53.893119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:53.893124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:53.893127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:53.893576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 359 sessionId:  describe result for acl check
2025-10-10T14:31:53.893613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:53.893620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:53.893622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:53.893630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600772122815303:4564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:53.894100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600772122815303:4564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:53.894986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:53.895927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600772122815303:4564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:53.896949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:53.897137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:53.897148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:53.897160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:53.897214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:53.897254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600771340605250:3892]
2025-10-10T14:31:53.897844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:53.898201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:53.898262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:53.898322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600772122815303:4564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:53.898336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600772122815303:4564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:53.898340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600772122815303:4564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:53.898347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:53.898528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:53.898572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.898577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.898578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.898579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.898580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.898581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.898581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.898582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.898583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.898584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.898584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.898585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.898586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.898591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.898599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.898601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.898604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.898606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.898609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.898612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.898614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.898616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.898619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.898622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.898632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.898634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.898640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.898647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:53.898653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.898662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:53.898667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.898672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:53.898676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.898681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:53.898686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.898692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:53.898696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.898699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:53.898704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.898707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:53.898709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.898712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:53.898715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.898718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:53.898720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.898723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:53.898726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.898728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.898731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.898734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.898736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.898739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.898762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:53.901019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:53.901318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:53.901346Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:53.901348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:53.901352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:53.901357Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 358 [2:7559600771340605250:3892]
2025-10-10T14:31:53.901367Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:53.901383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:53.901391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.901394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.901396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.901411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:53.901423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:53.901434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:53.901487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.901493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.901495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.901498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:53.901557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:53.901566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.901577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:53.901589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:53.901606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:53.901629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122815338:4564], now have 1 active actors on pipe
2025-10-10T14:31:53.901638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122815158:2438], now have 1 active actors on pipe
2025-10-10T14:31:53.901645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600771340605245:3892]
2025-10-10T14:31:53.901651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600771340605245:3892]
2025-10-10T14:31:53.901653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600771340605245:3892]
2025-10-10T14:31:53.901666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:53.901684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:53.901689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:53.901697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:53.901699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:53.901700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:53.901703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:53.901700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 358
2025-10-10T14:31:53.901722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 358
2025-10-10T14:31:53.901723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600771340605245:3892]
2025-10-10T14:31:53.901731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:53.901732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:53.901755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.901763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.901798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5375df09-257b89ec-dbd57df7-faee802d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:53.901811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:53.901815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:53.901817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:53.901827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:53.901836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:53.901860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.902006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:53.902015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:53.902030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:53.902131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 359 partition: 0 MaxSeqNo: 40 sessionId: src_id|5375df09-257b89ec-dbd57df7-faee802d_0
2025-10-10T14:31:53.902400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0203aad-d6775f08-76ea4133-472ff6ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5375df09-257b89ec-dbd57df7-faee802d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:53.904888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5375df09-257b89ec-dbd57df7-faee802d_0] Write session: try to update token
2025-10-10T14:31:53.904903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5375df09-257b89ec-dbd57df7-faee802d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:53.918733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId: src_id|5375df09-257b89ec-dbd57df7-faee802d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:53.920031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:53.920050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:53.920053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:53.920055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:53.920065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600771340605245:3892]
2025-10-10T14:31:53.920070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600771340605245:3892]
2025-10-10T14:31:53.920074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600771340605245:3892]
2025-10-10T14:31:53.920121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:53.920122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:53.920128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:53.920133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:53.920133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:53.920135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:53.920265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:53.921114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:53.982137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600772122815348:4235]
2025-10-10T14:31:53.982415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 358, pipe: [1:7559600772122815348:4235]
2025-10-10T14:31:54.025744Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:54.026188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.026200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.026238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600772122815348:4235], now have 1 active actors on pipe
2025-10-10T14:31:54.026520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600772122815348:4235]
2025-10-10T14:31:54.026537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:54.026541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:54.026563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:54.026605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 359 reason: error at write: Disconnected sessionId: src_id|5375df09-257b89ec-dbd57df7-faee802d_0
2025-10-10T14:31:54.026610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:54.026822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 359 sessionId: src_id|5375df09-257b89ec-dbd57df7-faee802d_0 is DEAD
2025-10-10T14:31:54.026983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5375df09-257b89ec-dbd57df7-faee802d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:54.026995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5375df09-257b89ec-dbd57df7-faee802d_0] Write session will restart in 0.008625s
2025-10-10T14:31:54.027019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5375df09-257b89ec-dbd57df7-faee802d_0] Write session: Do CDS request
2025-10-10T14:31:54.027041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5375df09-257b89ec-dbd57df7-faee802d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:54.036878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5375df09-257b89ec-dbd57df7-faee802d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.036950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:54.036964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 360
2025-10-10T14:31:54.037118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.037153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:54.037162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:54.037166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:54.037633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 360 sessionId:  describe result for acl check
2025-10-10T14:31:54.037668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:54.037672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:54.037674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:54.037680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600776417782792:4568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:54.038232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:54.038241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600776417782792:4568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:54.040033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:54.040212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:54.040223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:54.040235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:54.040291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:54.040324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600775635572732:3894]
2025-10-10T14:31:54.040386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600776417782792:4568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:54.040752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:54.041051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:54.041085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:54.041312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:54.041373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.041379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.041379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.041380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.041381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.041381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.041382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.041383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.041383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.041384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.041385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.041385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.041386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.041390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.041399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.041401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.041403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.041406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.041408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.041410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.041412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.041415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.041417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.041419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.041422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.041424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.041429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.041434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.041438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.041442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.041444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.041448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.041450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.041455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.041460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.041465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.041469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.041474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.041478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.041483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.041488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.041493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.041498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.041504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.041508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.041513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.041516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.041519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.041522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.041525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.041528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.041531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.041552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:54.043728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600776417782792:4568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:54.043742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600776417782792:4568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:54.043745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600776417782792:4568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:54.043753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:54.043812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:54.044334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:54.044347Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:54.044349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:54.044353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:54.044358Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 359 [2:7559600775635572732:3894]
2025-10-10T14:31:54.044369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:54.044384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:54.044387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.044390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.044392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.044407Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:54.044415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:54.044422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:54.044470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.044477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.044478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.044480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:54.044529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:54.044539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.044550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.044561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.044571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:54.044591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417782828:4568], now have 1 active actors on pipe
2025-10-10T14:31:54.044597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600775635572727:3894]
2025-10-10T14:31:54.044599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600775635572727:3894]
2025-10-10T14:31:54.044600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600775635572727:3894]
2025-10-10T14:31:54.044613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:54.044627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417782645:2438], now have 1 active actors on pipe
2025-10-10T14:31:54.044633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:54.044636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:54.044638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:54.044640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:54.044655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:54.044657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:54.044655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 359
2025-10-10T14:31:54.044675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 359
2025-10-10T14:31:54.044673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600775635572727:3894]
2025-10-10T14:31:54.044679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:54.044687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:54.044702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.044704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.044732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4b24d8c-ae98997d-69183905-a707a92e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:54.044741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.044748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.044750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:54.044758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.044770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:54.044785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.044933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.044942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.044958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.045056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 360 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4b24d8c-ae98997d-69183905-a707a92e_0
2025-10-10T14:31:54.045420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5375df09-257b89ec-dbd57df7-faee802d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4b24d8c-ae98997d-69183905-a707a92e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:54.047946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b24d8c-ae98997d-69183905-a707a92e_0] Write session: try to update token
2025-10-10T14:31:54.047959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b24d8c-ae98997d-69183905-a707a92e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:54.061984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId: src_id|c4b24d8c-ae98997d-69183905-a707a92e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:54.063707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:54.063726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:54.063729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:54.063731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:54.063740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600775635572727:3894]
2025-10-10T14:31:54.063746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600775635572727:3894]
2025-10-10T14:31:54.063750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600775635572727:3894]
2025-10-10T14:31:54.063799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:54.063800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:54.063806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:54.063809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:54.063811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.063814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:54.063941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:54.064385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:54.126533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600776417782847:4235]
2025-10-10T14:31:54.126791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 359, pipe: [1:7559600776417782847:4235]
2025-10-10T14:31:54.168021Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:54.168374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.168385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.168422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417782847:4235], now have 1 active actors on pipe
2025-10-10T14:31:54.168586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:54.168701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:54.168711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:54.168717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:54.168761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600776417782847:4235]
2025-10-10T14:31:54.168804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 360 reason: error at write: Disconnected sessionId: src_id|c4b24d8c-ae98997d-69183905-a707a92e_0
2025-10-10T14:31:54.169075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 360 sessionId: src_id|c4b24d8c-ae98997d-69183905-a707a92e_0 is DEAD
2025-10-10T14:31:54.169234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b24d8c-ae98997d-69183905-a707a92e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:54.169246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b24d8c-ae98997d-69183905-a707a92e_0] Write session will restart in 0.005489s
2025-10-10T14:31:54.169271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b24d8c-ae98997d-69183905-a707a92e_0] Write session: Do CDS request
2025-10-10T14:31:54.169278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b24d8c-ae98997d-69183905-a707a92e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:54.175856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b24d8c-ae98997d-69183905-a707a92e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.175950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:54.175973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 361
2025-10-10T14:31:54.176087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.176117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:54.176126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:54.176130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:54.176718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 361 sessionId:  describe result for acl check
2025-10-10T14:31:54.176758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:54.176767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:54.176769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:54.176777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600776417782902:4573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:54.177340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600776417782902:4573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:54.180139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600776417782902:4573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:54.181035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:54.182807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:54.183017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:54.183027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:54.183039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:54.183083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:54.183124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600775635572933:3897]
2025-10-10T14:31:54.183169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600776417782902:4573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:54.183183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600776417782902:4573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:54.183186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600776417782902:4573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:54.183194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:54.183564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:54.183806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:54.183840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:54.184133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:54.184184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.184190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.184191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.184193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.184194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.184195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.184196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.184198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.184199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.184200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.184201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.184203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.184204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.184209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.184222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.184226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.184231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.184235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.184246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.184250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.184254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.184262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.184267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.184275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.184279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.184287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.184293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.184305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.184315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.184321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.184324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.184327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.184330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.184336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.184340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.184345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.184354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.184363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.184370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.184379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.184384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.184394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.184401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.184410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.184416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.184425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.184434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.184443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.184448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.184457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.184465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.184470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.184514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:54.186678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:54.186967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:54.186978Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:54.186981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:54.186984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:54.186989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 360 [2:7559600775635572933:3897]
2025-10-10T14:31:54.187002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:54.187018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:54.187023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.187024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.187026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.187037Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:54.187046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:54.187054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:54.187089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.187094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.187095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.187096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:54.187141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:54.187148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.187154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.187162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.187175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:54.187194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600775635572928:3897]
2025-10-10T14:31:54.187201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600775635572928:3897]
2025-10-10T14:31:54.187203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600775635572928:3897]
2025-10-10T14:31:54.187216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:54.187230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783029:4573], now have 1 active actors on pipe
2025-10-10T14:31:54.187233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417782849:2438], now have 1 active actors on pipe
2025-10-10T14:31:54.187233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:54.187236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:54.187238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:54.187239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:54.187249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:54.187251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:54.187265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600775635572928:3897]
2025-10-10T14:31:54.187271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:54.187260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 360
2025-10-10T14:31:54.187282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:54.187295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.187298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.187266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 360
2025-10-10T14:31:54.187323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:54.187333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.187335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.187336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:54.187344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.187351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:54.187365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.187491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.187499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.187511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.187679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 361 partition: 0 MaxSeqNo: 40 sessionId: src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0
2025-10-10T14:31:54.188008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b24d8c-ae98997d-69183905-a707a92e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:54.190629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0] Write session: try to update token
2025-10-10T14:31:54.190648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:54.205125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId: src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:54.206120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:54.206138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:54.206142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:54.206144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:54.206154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600775635572928:3897]
2025-10-10T14:31:54.206159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600775635572928:3897]
2025-10-10T14:31:54.206162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600775635572928:3897]
2025-10-10T14:31:54.206213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:54.206216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:54.206222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:54.206225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.206225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:54.206227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:54.206377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:54.207565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:54.268840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600776417783064:4235]
2025-10-10T14:31:54.269009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 360, pipe: [1:7559600776417783064:4235]
2025-10-10T14:31:54.309687Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:54.310025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.310041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.310080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783064:4235], now have 1 active actors on pipe
2025-10-10T14:31:54.310322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:54.310334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:54.310343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600776417783064:4235]
2025-10-10T14:31:54.310365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:54.310387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 361 reason: error at write: Disconnected sessionId: src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0
2025-10-10T14:31:54.310386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:54.310594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 361 sessionId: src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0 is DEAD
2025-10-10T14:31:54.310753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:54.310765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0] Write session will restart in 0.008280s
2025-10-10T14:31:54.310790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0] Write session: Do CDS request
2025-10-10T14:31:54.310814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:54.319800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.319881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:54.319892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 362
2025-10-10T14:31:54.320010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.320036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:54.320043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:54.320046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:54.320344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 362 sessionId:  describe result for acl check
2025-10-10T14:31:54.320370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:54.320375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:54.320376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:54.320381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600776417783214:4586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:54.320798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600776417783214:4586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:54.321718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:54.323003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600776417783214:4586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:54.323782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:54.323929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:54.323940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:54.323948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:54.323992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:54.324025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600775635573161:3912]
2025-10-10T14:31:54.324382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:54.324591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:54.324623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:54.324823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:54.324862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.324867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.324867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.324868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.324868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.324869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.324870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.324871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.324871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.324872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.324872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.324873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.324874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.324877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.324884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.324886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.324888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.324890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.324892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.324894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.324896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.324898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.324900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.324902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.324904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.324906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.324910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.324915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.324922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.324927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.324931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.324935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.324939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.324944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.324948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.324951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.324954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.324957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.324962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.324966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.324970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.324974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.324979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.324983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.324987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.324998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.325002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.325006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.325010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.325018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.325023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.325027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.325062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:54.325118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600776417783214:4586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:54.325129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600776417783214:4586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:54.325132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600776417783214:4586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:54.325137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:54.327054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:54.327539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:54.327551Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:54.327553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:54.327556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:54.327561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 361 [2:7559600775635573161:3912]
2025-10-10T14:31:54.327572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:54.327586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:54.327593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.327596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.327598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.327613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:54.327624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:54.327635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:54.327684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.327690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.327692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.327695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:54.327752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:54.327761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.327771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.327781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.327797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:54.327820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783066:2438], now have 1 active actors on pipe
2025-10-10T14:31:54.327827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783249:4586], now have 1 active actors on pipe
2025-10-10T14:31:54.327834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600775635573155:3912]
2025-10-10T14:31:54.327837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600775635573155:3912]
2025-10-10T14:31:54.327839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600775635573155:3912]
2025-10-10T14:31:54.327850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:54.327868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:54.327877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:54.327879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:54.327856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 361
2025-10-10T14:31:54.327880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:54.327896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:54.327857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 361
2025-10-10T14:31:54.327900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:54.327929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.327938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.327951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600775635573155:3912]
2025-10-10T14:31:54.327962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:54.327972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:54.327989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64be5950-2545a342-c6a7fd9b-6673975c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:54.328001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.328008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.328011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:54.328021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.328034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:54.328058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.328183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.328191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.328205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.328292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 362 partition: 0 MaxSeqNo: 40 sessionId: src_id|64be5950-2545a342-c6a7fd9b-6673975c_0
2025-10-10T14:31:54.328540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf65eb6-7563b2db-7a7077e8-9892facd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|64be5950-2545a342-c6a7fd9b-6673975c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:54.331113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64be5950-2545a342-c6a7fd9b-6673975c_0] Write session: try to update token
2025-10-10T14:31:54.331129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64be5950-2545a342-c6a7fd9b-6673975c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:54.345094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId: src_id|64be5950-2545a342-c6a7fd9b-6673975c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:54.346195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:54.346212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:54.346214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:54.346216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:54.346225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600775635573155:3912]
2025-10-10T14:31:54.346228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600775635573155:3912]
2025-10-10T14:31:54.346231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600775635573155:3912]
2025-10-10T14:31:54.346269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:54.346279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.346281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:54.346280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:54.346286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:54.346290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:54.346437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:54.347421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:54.410689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600776417783258:4235]
2025-10-10T14:31:54.410923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 361, pipe: [1:7559600776417783258:4235]
2025-10-10T14:31:54.449750Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:54.450282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.450298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.450340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783258:4235], now have 1 active actors on pipe
2025-10-10T14:31:54.450559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:54.450584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:54.450632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:54.450642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600776417783258:4235]
2025-10-10T14:31:54.450708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 362 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64be5950-2545a342-c6a7fd9b-6673975c_0
2025-10-10T14:31:54.450887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 362 sessionId: src_id|64be5950-2545a342-c6a7fd9b-6673975c_0 is DEAD
2025-10-10T14:31:54.451068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64be5950-2545a342-c6a7fd9b-6673975c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:54.451079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64be5950-2545a342-c6a7fd9b-6673975c_0] Write session will restart in 0.008082s
2025-10-10T14:31:54.451102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64be5950-2545a342-c6a7fd9b-6673975c_0] Write session: Do CDS request
2025-10-10T14:31:54.451108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64be5950-2545a342-c6a7fd9b-6673975c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:54.460840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64be5950-2545a342-c6a7fd9b-6673975c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.460949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:54.460961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 363
2025-10-10T14:31:54.461078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.461103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:54.461110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:54.461114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:54.461459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 363 sessionId:  describe result for acl check
2025-10-10T14:31:54.461491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:54.461496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:54.461497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:54.461502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600776417783409:4590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:54.461905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600776417783409:4590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:54.462022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:54.463643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600776417783409:4590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:54.464106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:54.464271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:54.464282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:54.464294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:54.464340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:54.464378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600775635573352:3914]
2025-10-10T14:31:54.464971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:54.465235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:54.465281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:54.465604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:54.465659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.465667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.465668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.465669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.465671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.465672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.465673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.465674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.465675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.465676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.465677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.465679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.465680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.465685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.465696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.465701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.465705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.465709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.465713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.465717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.465721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.465725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.465729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.465733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.465740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.465743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.465749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.465757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.465764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.465774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.465783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.465788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.465797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.465802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.465805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.465809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.465814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.465820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.465829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.465839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.465849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.465854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.465839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600776417783409:4590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:54.465859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.465864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.465857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600776417783409:4590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:54.465868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.465860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600776417783409:4590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:54.465873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.465865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:54.465877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.465882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.465887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.465892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.465896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.465906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.465950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:54.467988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:54.468393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:54.468403Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:54.468405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:54.468407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:54.468411Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 362 [2:7559600775635573352:3914]
2025-10-10T14:31:54.468420Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:54.468433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:54.468441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.468443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.468445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.468456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:54.468464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:54.468475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:54.468524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.468529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.468530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.468531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:54.468584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:54.468591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.468603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.468616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.468638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:54.468661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783259:2438], now have 1 active actors on pipe
2025-10-10T14:31:54.468668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783444:4590], now have 1 active actors on pipe
2025-10-10T14:31:54.468674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600775635573346:3914]
2025-10-10T14:31:54.468680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600775635573346:3914]
2025-10-10T14:31:54.468682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600775635573346:3914]
2025-10-10T14:31:54.468695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:54.468694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 362
2025-10-10T14:31:54.468703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 362
2025-10-10T14:31:54.468711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:54.468718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:54.468722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:54.468724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:54.468732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:54.468739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:54.468769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.468777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.468794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600775635573346:3914]
2025-10-10T14:31:54.468806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:54.468828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:54.468831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:54.468838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.468842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.468843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:54.468853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.468866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:54.468885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.468995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.469005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.469019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.469097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 363 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0
2025-10-10T14:31:54.469384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64be5950-2545a342-c6a7fd9b-6673975c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:54.471936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0] Write session: try to update token
2025-10-10T14:31:54.471949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:54.486141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId: src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:54.486799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:54.486815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:54.486817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:54.486818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:54.486825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600775635573346:3914]
2025-10-10T14:31:54.486828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600775635573346:3914]
2025-10-10T14:31:54.486831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600775635573346:3914]
2025-10-10T14:31:54.486868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:54.486878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.486879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:54.486879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:54.486886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:54.486890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:54.487001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:54.488491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:54.550971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600776417783462:4235]
2025-10-10T14:31:54.551205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 362, pipe: [1:7559600776417783462:4235]
2025-10-10T14:31:54.589845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:54.590054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.590068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.590105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783462:4235], now have 1 active actors on pipe
2025-10-10T14:31:54.590299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:54.590311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:54.590349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:54.590315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600776417783462:4235]
2025-10-10T14:31:54.590335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:54.590363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 363 reason: error at write: Disconnected sessionId: src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0
2025-10-10T14:31:54.590565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 363 sessionId: src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0 is DEAD
2025-10-10T14:31:54.590684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:54.590693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0] Write session will restart in 0.007019s
2025-10-10T14:31:54.590712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0] Write session: Do CDS request
2025-10-10T14:31:54.590716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:54.598813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.598888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:54.598899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 364
2025-10-10T14:31:54.599019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.599045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:54.599053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:54.599056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:54.599408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 364 sessionId:  describe result for acl check
2025-10-10T14:31:54.599432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:54.599433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:54.599434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:54.599440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600776417783580:4596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:54.599855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600776417783580:4596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:54.601552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:54.601914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600776417783580:4596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:54.603313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:54.603489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:54.603500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:54.603512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:54.603563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:54.603596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600775635573547:3917]
2025-10-10T14:31:54.604012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:54.604222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600776417783580:4596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:54.604234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600776417783580:4596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:54.604236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600776417783580:4596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:54.604242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:54.604275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:54.604310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:54.604524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:54.604560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.604566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.604567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.604567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.604568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.604568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.604569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.604570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.604570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.604571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.604572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.604572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.604573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.604577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.604585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.604588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.604590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.604591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.604594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.604596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.604598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.604599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.604602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.604604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.604606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.604608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.604613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.604618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.604623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.604626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.604629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.604632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.604635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.604638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.604640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.604643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.604645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.604648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.604651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.604654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.604657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.604660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.604663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.604666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.604669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.604672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.604674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.604678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.604680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.604683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.604686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.604688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.604711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:54.606828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:54.607120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:54.607129Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:54.607131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:54.607133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:54.607138Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 363 [2:7559600775635573547:3917]
2025-10-10T14:31:54.607147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:54.607159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:54.607161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.607164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.607165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.607178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:54.607188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:54.607193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:54.607233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.607238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.607239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.607241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:54.607289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:54.607294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.607302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.607316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.607335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:54.607357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783468:2438], now have 1 active actors on pipe
2025-10-10T14:31:54.607363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783656:4596], now have 1 active actors on pipe
2025-10-10T14:31:54.607368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600775635573541:3917]
2025-10-10T14:31:54.607373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600775635573541:3917]
2025-10-10T14:31:54.607375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600775635573541:3917]
2025-10-10T14:31:54.607385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:54.607388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 363
2025-10-10T14:31:54.607398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:54.607393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 363
2025-10-10T14:31:54.607404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:54.607408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:54.607410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:54.607411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:54.607413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:54.607440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600775635573541:3917]
2025-10-10T14:31:54.607450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:54.607465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:54.607477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.607481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.607520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7165617-252f873d-ec90f3c0-21a75359_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:54.607530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.607536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.607538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:54.607546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.607558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:54.607570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.607685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.607690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.607701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.607800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 364 partition: 0 MaxSeqNo: 40 sessionId: src_id|d7165617-252f873d-ec90f3c0-21a75359_0
2025-10-10T14:31:54.608162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6067d2-9fe1ff65-22e7852c-8a9c42b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d7165617-252f873d-ec90f3c0-21a75359_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:54.610743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7165617-252f873d-ec90f3c0-21a75359_0] Write session: try to update token
2025-10-10T14:31:54.610761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7165617-252f873d-ec90f3c0-21a75359_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:54.624856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId: src_id|d7165617-252f873d-ec90f3c0-21a75359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:54.625816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:54.625832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:54.625834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:54.625835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:54.625843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600775635573541:3917]
2025-10-10T14:31:54.625847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600775635573541:3917]
2025-10-10T14:31:54.625849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600775635573541:3917]
2025-10-10T14:31:54.625886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:54.625897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.625899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:54.625989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:54.626004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:54.626008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:54.626030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:54.627529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:54.690241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600776417783666:4235]
2025-10-10T14:31:54.690486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 363, pipe: [1:7559600776417783666:4235]
2025-10-10T14:31:54.728016Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:54.728539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.728551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.728590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783666:4235], now have 1 active actors on pipe
2025-10-10T14:31:54.728756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:54.728757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:54.728769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:54.728783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:54.728822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600776417783666:4235]
2025-10-10T14:31:54.728830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 364 reason: error at write: Disconnected sessionId: src_id|d7165617-252f873d-ec90f3c0-21a75359_0
2025-10-10T14:31:54.729002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 364 sessionId: src_id|d7165617-252f873d-ec90f3c0-21a75359_0 is DEAD
2025-10-10T14:31:54.729157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7165617-252f873d-ec90f3c0-21a75359_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:54.729166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7165617-252f873d-ec90f3c0-21a75359_0] Write session will restart in 0.006006s
2025-10-10T14:31:54.729186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7165617-252f873d-ec90f3c0-21a75359_0] Write session: Do CDS request
2025-10-10T14:31:54.729197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7165617-252f873d-ec90f3c0-21a75359_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:54.736854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7165617-252f873d-ec90f3c0-21a75359_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.736899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:54.736909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 365
2025-10-10T14:31:54.737039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.737074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:54.737082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:54.737085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:54.737498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 365 sessionId:  describe result for acl check
2025-10-10T14:31:54.737531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:54.737536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:54.737537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:54.737541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600776417783761:4600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:54.738017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600776417783761:4600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:54.739581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600776417783761:4600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:54.739765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:54.741396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:54.741541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:54.741549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:54.741558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:54.741594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:54.741628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600775635573740:3919]
2025-10-10T14:31:54.741867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600776417783761:4600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:54.741876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600776417783761:4600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:54.741879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600776417783761:4600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:54.741884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:54.742018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:54.742252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:54.742282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:54.742490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:54.742528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.742532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.742533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.742533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.742534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.742535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.742535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.742536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.742537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.742537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.742538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.742538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.742539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.742543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.742551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.742554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.742556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.742558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.742560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.742563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.742565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.742567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.742569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.742572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.742574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.742576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.742580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.742586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.742590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.742594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.742596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.742600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.742602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.742606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.742609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.742612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.742614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.742617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.742620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.742622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.742625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.742628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.742631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.742636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.742638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.742641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.742647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.742650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.742653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.742656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.742662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.742665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.742687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:54.744819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:54.745179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:54.745188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:54.745189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:54.745192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:54.745195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 364 [2:7559600775635573740:3919]
2025-10-10T14:31:54.745203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:54.745214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:54.745216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.745218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.745219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.745231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:54.745236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:54.745247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:54.745284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.745291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.745293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.745295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:54.745373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:54.745379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.745386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.745396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.745409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:54.745425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783851:4600], now have 1 active actors on pipe
2025-10-10T14:31:54.745431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783667:2438], now have 1 active actors on pipe
2025-10-10T14:31:54.745437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600775635573734:3919]
2025-10-10T14:31:54.745440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600775635573734:3919]
2025-10-10T14:31:54.745441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600775635573734:3919]
2025-10-10T14:31:54.745451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:54.745463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:54.745473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:54.745475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:54.745476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:54.745479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:54.745482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:54.745489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600775635573734:3919]
2025-10-10T14:31:54.745491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:54.745473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 364
2025-10-10T14:31:54.745485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 364
2025-10-10T14:31:54.745503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:54.745624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.745631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.745655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:54.745664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.745670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.745671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:54.745679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.745687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:54.745702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.745833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.745838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.745849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.745907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 365 partition: 0 MaxSeqNo: 40 sessionId: src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0
2025-10-10T14:31:54.746184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7165617-252f873d-ec90f3c0-21a75359_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:54.748710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0] Write session: try to update token
2025-10-10T14:31:54.748725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:54.761999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId: src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:54.763798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:54.763812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:54.763814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:54.763816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:54.763823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600775635573734:3919]
2025-10-10T14:31:54.763827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600775635573734:3919]
2025-10-10T14:31:54.763830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600775635573734:3919]
2025-10-10T14:31:54.763866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:54.763876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.763878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:54.763887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:54.763894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:54.763898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:54.764036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:54.764403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:54.828948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600776417783863:4235]
2025-10-10T14:31:54.829214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 364, pipe: [1:7559600776417783863:4235]
2025-10-10T14:31:54.865885Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:54.866212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.866226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.866264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783863:4235], now have 1 active actors on pipe
2025-10-10T14:31:54.866430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:54.866545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:54.866546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600776417783863:4235]
2025-10-10T14:31:54.866569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:54.866655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 365 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0
2025-10-10T14:31:54.866864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 365 sessionId: src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0 is DEAD
2025-10-10T14:31:54.867005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:54.867014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0] Write session will restart in 0.009498s
2025-10-10T14:31:54.867039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0] Write session: Do CDS request
2025-10-10T14:31:54.867045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:54.877859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.877946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:54.877961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 366
2025-10-10T14:31:54.878000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:54.878104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:54.878160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:54.878172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:54.878176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:54.878620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 366 sessionId:  describe result for acl check
2025-10-10T14:31:54.878659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:54.878666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:54.878668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:54.878674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600776417784019:4604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:54.879220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600776417784019:4604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:54.879999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:54.880201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:54.880212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:54.880239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:54.880294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:54.880324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600775635573932:3921]
2025-10-10T14:31:54.880831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:54.881071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600776417784019:4604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:54.881096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:54.881137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:54.881453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:54.881511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.881517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.881518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.881520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.881521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.881522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.881524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.881524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.881525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.881526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.881526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.881527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.881528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.881531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.881539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.881541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.881543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.881546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.881548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.881550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.881552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.881554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.881556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.881559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.881560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.881563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.881568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.881574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:54.881579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.881582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:54.881585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.881588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:54.881590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.881594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:54.881596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.881600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:54.881602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.881605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:54.881608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.881611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:54.881614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.881617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:54.881620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.881623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:54.881626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.881629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:54.881632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.881635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.881638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.881645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.881648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.881651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.881687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:54.883820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600776417784019:4604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:54.883833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600776417784019:4604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:54.883837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600776417784019:4604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:54.883844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:54.883866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:54.884174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:54.884183Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:54.884185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:54.884187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:54.884191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 365 [2:7559600775635573932:3921]
2025-10-10T14:31:54.884200Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:54.884211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:54.884218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.884220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.884221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.884233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:54.884238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:54.884243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:54.884282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.884288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.884289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.884291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:54.884349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:54.884357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.884367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:54.884381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:54.884401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:54.884427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417783864:2438], now have 1 active actors on pipe
2025-10-10T14:31:54.884434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417784053:4604], now have 1 active actors on pipe
2025-10-10T14:31:54.884440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600775635573926:3921]
2025-10-10T14:31:54.884441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600775635573926:3921]
2025-10-10T14:31:54.884442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600775635573926:3921]
2025-10-10T14:31:54.884454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:54.884447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 365
2025-10-10T14:31:54.884459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 365
2025-10-10T14:31:54.884468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:54.884470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:54.884473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:54.884476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:54.884489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:54.884492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:54.884521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.884530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.884546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600775635573926:3921]
2025-10-10T14:31:54.884558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:54.884577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:54.884585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:54.884596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:54.884600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:54.884602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:54.884612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:54.884627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:54.884649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.884738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:54.884746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:54.884760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:54.884852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 366 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0
2025-10-10T14:31:54.885154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddc446ed-c542c883-318e4fb2-5ec504d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:54.887583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0] Write session: try to update token
2025-10-10T14:31:54.887600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:54.901064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId: src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:54.902972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:54.902996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:54.902999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:54.903001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:54.903010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600775635573926:3921]
2025-10-10T14:31:54.903015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600775635573926:3921]
2025-10-10T14:31:54.903022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600775635573926:3921]
2025-10-10T14:31:54.903064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:54.903068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:54.903075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:54.903075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:54.903078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:54.903079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:54.903213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:54.903794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:54.966709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600776417784065:4235]
2025-10-10T14:31:54.966967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 365, pipe: [1:7559600776417784065:4235]
2025-10-10T14:31:55.008217Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:55.008686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.008703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.008744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600776417784065:4235], now have 1 active actors on pipe
2025-10-10T14:31:55.008960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:55.008995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:55.009002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:55.009006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:55.009055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600776417784065:4235]
2025-10-10T14:31:55.009076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 366 reason: error at write: Disconnected sessionId: src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0
2025-10-10T14:31:55.009289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 366 sessionId: src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0 is DEAD
2025-10-10T14:31:55.009423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:55.009432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0] Write session will restart in 0.009881s
2025-10-10T14:31:55.009450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0] Write session: Do CDS request
2025-10-10T14:31:55.009455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:55.020848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.020831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:55.020900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:55.020915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 367
2025-10-10T14:31:55.021071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.021108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:55.021119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:55.021123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:55.021575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 367 sessionId:  describe result for acl check
2025-10-10T14:31:55.021611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:55.021613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:55.021615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:55.021621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600780712751520:4608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:55.022154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600780712751520:4608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:55.023016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:55.023219Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:55.023233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:55.023244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:55.023295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:55.023332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600779930541427:3923]
2025-10-10T14:31:55.023927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:55.024178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:55.024222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:55.024407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600780712751520:4608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:55.024526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:55.024577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.024583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.024584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.024585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.024586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.024587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.024588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.024589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.024590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.024591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.024592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.024593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.024594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.024599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.024612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.024616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.024619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.024622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.024627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.024631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.024634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.024638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.024643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.024647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.024651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.024655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.024662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.024670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.024676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.024682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.024686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.024696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.024701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.024706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.024714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.024720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.024728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.024733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.024738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.024747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.024755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.024762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.024770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.024779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.024787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.024792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.024801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.024811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.024820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.024824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.024829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.024834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.024874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:55.027090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:55.027244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600780712751520:4608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:55.027258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600780712751520:4608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:55.027260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600780712751520:4608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:55.027267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:55.027460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:55.027472Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:55.027475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:55.027478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:55.027483Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 366 [2:7559600779930541427:3923]
2025-10-10T14:31:55.027495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:55.027510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:55.027518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.027521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.027523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.027539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:55.027547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:55.027554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:55.027608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.027615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.027617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.027619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:55.027681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:55.027688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.027699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.027716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.027738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:55.027761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751363:2438], now have 1 active actors on pipe
2025-10-10T14:31:55.027769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751553:4608], now have 1 active actors on pipe
2025-10-10T14:31:55.027776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600779930541422:3923]
2025-10-10T14:31:55.027764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 366
2025-10-10T14:31:55.027783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600779930541422:3923]
2025-10-10T14:31:55.027772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 366
2025-10-10T14:31:55.027785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600779930541422:3923]
2025-10-10T14:31:55.027793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:55.027806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:55.027808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:55.027811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:55.027813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:55.027824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:55.027831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:55.027863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.027872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.027893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600779930541422:3923]
2025-10-10T14:31:55.027904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:55.027915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:55.027936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21390da4-d7edd453-4c376871-296ee9d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:55.027947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.027955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.027957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:55.027967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.027980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:55.028165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.028350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.028360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.028375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.028471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 367 partition: 0 MaxSeqNo: 40 sessionId: src_id|21390da4-d7edd453-4c376871-296ee9d9_0
2025-10-10T14:31:55.028843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a905253-d2aa28e7-96dae5db-86aae2b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21390da4-d7edd453-4c376871-296ee9d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:55.031350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21390da4-d7edd453-4c376871-296ee9d9_0] Write session: try to update token
2025-10-10T14:31:55.031364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21390da4-d7edd453-4c376871-296ee9d9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:55.045773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId: src_id|21390da4-d7edd453-4c376871-296ee9d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:55.045973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:55.045992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:55.045996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:55.045998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:55.046007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600779930541422:3923]
2025-10-10T14:31:55.046011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600779930541422:3923]
2025-10-10T14:31:55.046015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600779930541422:3923]
2025-10-10T14:31:55.046058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:55.046058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:55.046065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:55.046068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.046069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:55.046069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:55.046196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:55.048514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:55.109101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600780712751560:4235]
2025-10-10T14:31:55.109298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 366, pipe: [1:7559600780712751560:4235]
2025-10-10T14:31:55.150820Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:55.151213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.151232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.151276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751560:4235], now have 1 active actors on pipe
2025-10-10T14:31:55.151492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:55.151490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:55.151491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600780712751560:4235]
2025-10-10T14:31:55.151505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:55.151509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:55.151567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 367 reason: error at write: Disconnected sessionId: src_id|21390da4-d7edd453-4c376871-296ee9d9_0
2025-10-10T14:31:55.151770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 367 sessionId: src_id|21390da4-d7edd453-4c376871-296ee9d9_0 is DEAD
2025-10-10T14:31:55.151914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21390da4-d7edd453-4c376871-296ee9d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:55.151927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21390da4-d7edd453-4c376871-296ee9d9_0] Write session will restart in 0.009611s
2025-10-10T14:31:55.151952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21390da4-d7edd453-4c376871-296ee9d9_0] Write session: Do CDS request
2025-10-10T14:31:55.151961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21390da4-d7edd453-4c376871-296ee9d9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:55.162851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21390da4-d7edd453-4c376871-296ee9d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.162904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:55.162919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 368
2025-10-10T14:31:55.163074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.163112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:55.163118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:55.163125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:55.163541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 368 sessionId:  describe result for acl check
2025-10-10T14:31:55.163574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:55.163578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:55.163579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:55.163584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600780712751730:4613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:55.164008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600780712751730:4613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:55.164330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:55.166343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600780712751730:4613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:55.166485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:55.166686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:55.166697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:55.166708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:55.166761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:55.166800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600779930541635:3926]
2025-10-10T14:31:55.167407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:55.167654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:55.167684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:55.167907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:55.167955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.167960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.167961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.167962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.167963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.167964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.167964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.167965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.167965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.167966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.167967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.167968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.167968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.167972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.167980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.167983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.167985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.167987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.167989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.167992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.167994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.167996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.167998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.168000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.168002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.168004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.168010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.168016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.168020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.168024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.168027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.168030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.168033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.168036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.168039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.168042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.168044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.168047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.168050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.168053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.168056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.168059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.168062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.168065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.168067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.168071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.168073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.168077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.168079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.168082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.168085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.168088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.168109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:55.170173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600780712751730:4613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:55.170184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600780712751730:4613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:55.170187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600780712751730:4613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:55.170194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:55.170225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:55.170600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:55.170610Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:55.170612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:55.170616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:55.170621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 367 [2:7559600779930541635:3926]
2025-10-10T14:31:55.170633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:55.170648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:55.170657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.170659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.170661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.170673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:55.170682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:55.170696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:55.170750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.170757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.170759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.170761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:55.170826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:55.170834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.170845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.170857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.170880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:55.170905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751765:4613], now have 1 active actors on pipe
2025-10-10T14:31:55.170913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751574:2438], now have 1 active actors on pipe
2025-10-10T14:31:55.170921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600779930541630:3926]
2025-10-10T14:31:55.170923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600779930541630:3926]
2025-10-10T14:31:55.170926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600779930541630:3926]
2025-10-10T14:31:55.170938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:55.170945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 367
2025-10-10T14:31:55.170955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:55.170959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 367
2025-10-10T14:31:55.170955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:55.170957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:55.170959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:55.170974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:55.170977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:55.171000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600779930541630:3926]
2025-10-10T14:31:55.171011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:55.171018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:55.171028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.171033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.171082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|386c509c-ad7310ad-964585ff-df414842_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:55.171097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.171101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.171103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:55.171113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.171124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:55.171140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.171301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.171310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.171326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.171420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 368 partition: 0 MaxSeqNo: 40 sessionId: src_id|386c509c-ad7310ad-964585ff-df414842_0
2025-10-10T14:31:55.171815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21390da4-d7edd453-4c376871-296ee9d9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|386c509c-ad7310ad-964585ff-df414842_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:55.174582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386c509c-ad7310ad-964585ff-df414842_0] Write session: try to update token
2025-10-10T14:31:55.174601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386c509c-ad7310ad-964585ff-df414842_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:55.189045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId: src_id|386c509c-ad7310ad-964585ff-df414842_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:55.189739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:55.189758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:55.189761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:55.189763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:55.189774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600779930541630:3926]
2025-10-10T14:31:55.189778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600779930541630:3926]
2025-10-10T14:31:55.189781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600779930541630:3926]
2025-10-10T14:31:55.189827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:55.189838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.189838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:55.189841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:55.189845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:55.189849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:55.189975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:55.191788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:55.251403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600780712751772:4235]
2025-10-10T14:31:55.251681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 367, pipe: [1:7559600780712751772:4235]
2025-10-10T14:31:55.301180Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:55.301593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.301611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.301656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751772:4235], now have 1 active actors on pipe
2025-10-10T14:31:55.301867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:55.301853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:55.301864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:55.301915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 368 reason: error at write: Disconnected sessionId: src_id|386c509c-ad7310ad-964585ff-df414842_0
2025-10-10T14:31:55.302065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 368 sessionId: src_id|386c509c-ad7310ad-964585ff-df414842_0 is DEAD
2025-10-10T14:31:55.302205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386c509c-ad7310ad-964585ff-df414842_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:55.302216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386c509c-ad7310ad-964585ff-df414842_0] Write session will restart in 0.009707s
2025-10-10T14:31:55.302223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600780712751772:4235]
2025-10-10T14:31:55.302244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386c509c-ad7310ad-964585ff-df414842_0] Write session: Do CDS request
2025-10-10T14:31:55.302240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:55.302251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386c509c-ad7310ad-964585ff-df414842_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:55.312877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386c509c-ad7310ad-964585ff-df414842_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.312958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:55.312973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 369
2025-10-10T14:31:55.313088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.313122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:55.313135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:55.313138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:55.313489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 369 sessionId:  describe result for acl check
2025-10-10T14:31:55.313521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:55.313526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:55.313527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:55.313532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600780712751957:4626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:55.313934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600780712751957:4626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:55.313972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:55.315583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600780712751957:4626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:55.315998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:55.316187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:55.316202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:55.316216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:55.316282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:55.316325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600779930541870:3939]
2025-10-10T14:31:55.316871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:55.317182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:55.317239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:55.317586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:55.317663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.317672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.317673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.317674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.317675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.317676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.317678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.317679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.317680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.317681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.317683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.317684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.317685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.317691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.317703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.317707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.317711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.317715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.317719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.317722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.317726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.317730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.317734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.317738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.317742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.317746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.317753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.317762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.317768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.317773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.317778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.317783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.317786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.317792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.317804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.317810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.317818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.317824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.317833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.317838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.317842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.317847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.317854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.317859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.317867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.317873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.317882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.317888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.317892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.317902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.317907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.317912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.317899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600780712751957:4626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:55.317910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600780712751957:4626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:55.317913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600780712751957:4626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:55.317918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:55.317951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:55.320106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:55.320676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:55.320695Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:55.320698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:55.320701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:55.320707Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 368 [2:7559600779930541870:3939]
2025-10-10T14:31:55.320721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:55.320736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:55.320740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.320744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.320746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.320761Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:55.320775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:55.320782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:55.320837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.320846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.320849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.320852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:55.320916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:55.320925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.320937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.320949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.320966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:55.320992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751787:2438], now have 1 active actors on pipe
2025-10-10T14:31:55.321001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751987:4626], now have 1 active actors on pipe
2025-10-10T14:31:55.321008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600779930541865:3939]
2025-10-10T14:31:55.321016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600779930541865:3939]
2025-10-10T14:31:55.321018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600779930541865:3939]
2025-10-10T14:31:55.321033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:55.321030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 368
2025-10-10T14:31:55.321058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 368
2025-10-10T14:31:55.321052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:55.321053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:55.321056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:55.321058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:55.321070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:55.321074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:55.321113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.321123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.321138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600779930541865:3939]
2025-10-10T14:31:55.321151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:55.321167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:55.321185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74ebc742-1044f597-b7ce938e-f1544e08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:55.321198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.321202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.321204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:55.321214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.321230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:55.321257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.321439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.321452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.321472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.321563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 369 partition: 0 MaxSeqNo: 40 sessionId: src_id|74ebc742-1044f597-b7ce938e-f1544e08_0
2025-10-10T14:31:55.321878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386c509c-ad7310ad-964585ff-df414842_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|74ebc742-1044f597-b7ce938e-f1544e08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:55.324502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74ebc742-1044f597-b7ce938e-f1544e08_0] Write session: try to update token
2025-10-10T14:31:55.324519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74ebc742-1044f597-b7ce938e-f1544e08_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:55.338637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId: src_id|74ebc742-1044f597-b7ce938e-f1544e08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:55.339826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:55.339846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:55.339850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:55.339852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:55.339862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600779930541865:3939]
2025-10-10T14:31:55.339867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600779930541865:3939]
2025-10-10T14:31:55.339871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600779930541865:3939]
2025-10-10T14:31:55.339920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:55.339932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.339934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:55.340015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:55.340029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:55.340033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:55.340068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:55.341106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:55.402472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600780712751996:4235]
2025-10-10T14:31:55.402803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 368, pipe: [1:7559600780712751996:4235]
2025-10-10T14:31:55.442302Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:55.442680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.442697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.442735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751996:4235], now have 1 active actors on pipe
2025-10-10T14:31:55.442907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:55.442972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:55.442976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600780712751996:4235]
2025-10-10T14:31:55.442986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:55.443007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:55.443050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 369 reason: error at write: Disconnected sessionId: src_id|74ebc742-1044f597-b7ce938e-f1544e08_0
2025-10-10T14:31:55.443273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 369 sessionId: src_id|74ebc742-1044f597-b7ce938e-f1544e08_0 is DEAD
2025-10-10T14:31:55.443427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ebc742-1044f597-b7ce938e-f1544e08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:55.443435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ebc742-1044f597-b7ce938e-f1544e08_0] Write session will restart in 0.009752s
2025-10-10T14:31:55.443458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ebc742-1044f597-b7ce938e-f1544e08_0] Write session: Do CDS request
2025-10-10T14:31:55.443467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ebc742-1044f597-b7ce938e-f1544e08_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:55.454892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74ebc742-1044f597-b7ce938e-f1544e08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.454934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:55.454949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 370
2025-10-10T14:31:55.455104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.455149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:55.455159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:55.455163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:55.455596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 370 sessionId:  describe result for acl check
2025-10-10T14:31:55.455641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:55.455648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:55.455650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:55.455656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600780712752154:4630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:55.456186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600780712752154:4630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:55.456647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:55.458132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600780712752154:4630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:55.458971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:55.459190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:55.459204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:55.459215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:55.459276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:55.459318Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600779930542067:3943]
2025-10-10T14:31:55.459890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:55.460212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:55.460259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:55.460351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600780712752154:4630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:55.460365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600780712752154:4630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:55.460368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600780712752154:4630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:55.460376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:55.460578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:55.460645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.460652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.460653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.460655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.460656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.460657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.460658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.460660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.460661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.460663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.460664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.460665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.460666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.460672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.460686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.460690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.460695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.460699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.460704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.460708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.460712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.460717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.460722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.460726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.460731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.460735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.460743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.460758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.460770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.460781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.460790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.460800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.460810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.460816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.460825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.460831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.460840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.460846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.460851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.460861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.460866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.460876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.460880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.460886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.460892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.460897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.460905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.460911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.460920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.460925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.460934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.460939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.460986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:55.463213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:55.463729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:55.463744Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:55.463747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:55.463750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:55.463756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 369 [2:7559600779930542067:3943]
2025-10-10T14:31:55.463767Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:55.463787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:55.463795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.463799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.463801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.463818Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:55.463834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:55.463845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:55.463901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.463907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.463909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.463912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:55.463976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:55.463989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.464001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.464012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.464028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:55.464055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752188:4630], now have 1 active actors on pipe
2025-10-10T14:31:55.464066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712751997:2438], now have 1 active actors on pipe
2025-10-10T14:31:55.464073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600779930542062:3943]
2025-10-10T14:31:55.464075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600779930542062:3943]
2025-10-10T14:31:55.464071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 369
2025-10-10T14:31:55.464077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600779930542062:3943]
2025-10-10T14:31:55.464091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:55.464073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 369
2025-10-10T14:31:55.464105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:55.464116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:55.464123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:55.464124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:55.464126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:55.464126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:55.464147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600779930542062:3943]
2025-10-10T14:31:55.464155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:55.464168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:55.464179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.464184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.464233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de821f9f-222e13aa-93740788-1e25ddd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:55.464248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.464252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.464255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:55.464266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.464277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:55.464298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.464459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.464469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.464486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.464571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 370 partition: 0 MaxSeqNo: 40 sessionId: src_id|de821f9f-222e13aa-93740788-1e25ddd0_0
2025-10-10T14:31:55.464915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ebc742-1044f597-b7ce938e-f1544e08_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|de821f9f-222e13aa-93740788-1e25ddd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:55.467534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de821f9f-222e13aa-93740788-1e25ddd0_0] Write session: try to update token
2025-10-10T14:31:55.467553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de821f9f-222e13aa-93740788-1e25ddd0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:55.482201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId: src_id|de821f9f-222e13aa-93740788-1e25ddd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:55.482386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:55.482402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:55.482404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:55.482405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:55.482414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600779930542062:3943]
2025-10-10T14:31:55.482420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600779930542062:3943]
2025-10-10T14:31:55.482423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600779930542062:3943]
2025-10-10T14:31:55.482474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:55.482480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:55.482486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.482488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:55.482493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:55.482496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:55.482615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:55.484746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:55.543260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600780712752203:4235]
2025-10-10T14:31:55.543508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 369, pipe: [1:7559600780712752203:4235]
2025-10-10T14:31:55.584831Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:55.585118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.585135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.585181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752203:4235], now have 1 active actors on pipe
2025-10-10T14:31:55.585345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:55.585426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:55.585439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:55.585453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:55.585499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600780712752203:4235]
2025-10-10T14:31:55.585515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 370 reason: error at write: Disconnected sessionId: src_id|de821f9f-222e13aa-93740788-1e25ddd0_0
2025-10-10T14:31:55.585724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 370 sessionId: src_id|de821f9f-222e13aa-93740788-1e25ddd0_0 is DEAD
2025-10-10T14:31:55.585899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de821f9f-222e13aa-93740788-1e25ddd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:55.585910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de821f9f-222e13aa-93740788-1e25ddd0_0] Write session will restart in 0.005908s
2025-10-10T14:31:55.585934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de821f9f-222e13aa-93740788-1e25ddd0_0] Write session: Do CDS request
2025-10-10T14:31:55.585939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de821f9f-222e13aa-93740788-1e25ddd0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:55.592803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de821f9f-222e13aa-93740788-1e25ddd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.592921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:55.592936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 371
2025-10-10T14:31:55.593065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.593108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:55.593118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:55.593126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:55.593542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 371 sessionId:  describe result for acl check
2025-10-10T14:31:55.593586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:55.593592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:55.593594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:55.593600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600780712752280:4636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:55.594161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600780712752280:4636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:55.596756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600780712752280:4636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:55.599542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:55.599751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600780712752280:4636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:55.599766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600780712752280:4636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:55.599770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600780712752280:4636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:55.599777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:55.599896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:55.600190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:55.600207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:55.600222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:55.600296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:55.600337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600779930542269:3946]
2025-10-10T14:31:55.600955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:55.601214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:55.601265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:55.601617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:55.601675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.601681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.601682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.601684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.601685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.601686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.601687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.601689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.601690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.601691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.601692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.601693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.601694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.601700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.601713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.601718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.601723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.601727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.601732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.601736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.601740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.601745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.601750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.601754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.601758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.601763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.601769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.601778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.601785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.601791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.601795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.601800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.601810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.601816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.601822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.601828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.601832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.601838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.601847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.601851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.601855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.601864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.601869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.601874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.601883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.601888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.601894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.601903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.601908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.601912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.601920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.601925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.601962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:55.604241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:55.604568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:55.604581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:55.604583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:55.604587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:55.604593Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 370 [2:7559600779930542269:3946]
2025-10-10T14:31:55.604605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:55.604629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:55.604639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.604643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.604646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.604665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:55.604673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:55.604686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:55.604749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.604759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.604762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.604765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:55.604852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:55.604861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.604871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.604885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.604906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:55.604933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752206:2438], now have 1 active actors on pipe
2025-10-10T14:31:55.604943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752396:4636], now have 1 active actors on pipe
2025-10-10T14:31:55.604951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600779930542263:3946]
2025-10-10T14:31:55.604953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600779930542263:3946]
2025-10-10T14:31:55.604955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600779930542263:3946]
2025-10-10T14:31:55.604971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:55.604981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:55.604984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:55.604985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:55.604986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:55.605001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:55.605010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:55.604966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 370
2025-10-10T14:31:55.604967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 370
2025-10-10T14:31:55.605052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.605060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.605074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600779930542263:3946]
2025-10-10T14:31:55.605087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:55.605102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:55.605113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:55.605119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.605122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.605124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:55.605132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.605140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:55.605158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.605309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.605316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.605327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.605420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 371 partition: 0 MaxSeqNo: 40 sessionId: src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0
2025-10-10T14:31:55.605804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de821f9f-222e13aa-93740788-1e25ddd0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:55.608543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0] Write session: try to update token
2025-10-10T14:31:55.608566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:55.623137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId: src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:55.623590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:55.623614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:55.623618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:55.623620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:55.623630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600779930542263:3946]
2025-10-10T14:31:55.623636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600779930542263:3946]
2025-10-10T14:31:55.623640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600779930542263:3946]
2025-10-10T14:31:55.623682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:55.623688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:55.623689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:55.623692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:55.623696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.623699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:55.623834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:55.625876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:55.685573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600780712752411:4235]
2025-10-10T14:31:55.685829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 370, pipe: [1:7559600780712752411:4235]
2025-10-10T14:31:55.741764Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:55.742180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.742199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.742246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752411:4235], now have 1 active actors on pipe
2025-10-10T14:31:55.742482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:55.742512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:55.742520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:55.742524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:55.742567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600780712752411:4235]
2025-10-10T14:31:55.742593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 371 reason: error at write: Disconnected sessionId: src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0
2025-10-10T14:31:55.742825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 371 sessionId: src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0 is DEAD
2025-10-10T14:31:55.742999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:55.743011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0] Write session will restart in 0.008816s
2025-10-10T14:31:55.743036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0] Write session: Do CDS request
2025-10-10T14:31:55.743046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:55.752895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.752958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:55.752986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 372
2025-10-10T14:31:55.753095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.753133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:55.753141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:55.753144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:55.753611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 372 sessionId:  describe result for acl check
2025-10-10T14:31:55.753650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:55.753656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:55.753658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:55.753665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600780712752513:4640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:55.754222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600780712752513:4640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:55.756273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600780712752513:4640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:55.756605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:55.758661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:55.758828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:55.758838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:55.758848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:55.758888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:55.758920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600779930542468:3948]
2025-10-10T14:31:55.758932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600780712752513:4640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:55.758946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600780712752513:4640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:55.758949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600780712752513:4640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:55.758957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:55.759312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:55.759523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:55.759550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:55.759761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:55.759797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.759801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.759802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.759803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.759804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.759805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.759806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.759807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.759808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.759810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.759811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.759812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.759813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.759818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.759832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.759834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.759836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.759839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.759841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.759843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.759845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.759847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.759849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.759851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.759853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.759855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.759860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.759866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.759870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.759873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.759876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.759879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.759882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.759885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.759896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.759900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.759903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.759906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.759908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.759911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.759914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.759917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.759920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.759923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.759925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.759928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.759932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.759935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.759938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.759941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.759944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.759947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.759968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:55.762154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:55.762495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:55.762505Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:55.762507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:55.762510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:55.762514Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 371 [2:7559600779930542468:3948]
2025-10-10T14:31:55.762524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:55.762537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:55.762539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.762541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.762542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.762555Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:55.762561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:55.762571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:55.762614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.762620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.762622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.762625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:55.762686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:55.762692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.762699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.762706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.762716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:55.762737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752603:4640], now have 1 active actors on pipe
2025-10-10T14:31:55.762743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752412:2438], now have 1 active actors on pipe
2025-10-10T14:31:55.762748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600779930542463:3948]
2025-10-10T14:31:55.762750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600779930542463:3948]
2025-10-10T14:31:55.762751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600779930542463:3948]
2025-10-10T14:31:55.762760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:55.762775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:55.762778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:55.762782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:55.762784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:55.762788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:55.762790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:55.762808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600779930542463:3948]
2025-10-10T14:31:55.762816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:55.762823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:55.762836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 371
2025-10-10T14:31:55.762845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 371
2025-10-10T14:31:55.763205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 372 partition: 0 MaxSeqNo: 40 sessionId: src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0
2025-10-10T14:31:55.763588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a06291a9-4debde78-f8425cb9-3d9b2efa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:55.762891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.762902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.762927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:55.762933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.762936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.762938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:55.762946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.762954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:55.762964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.763098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.763099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.763111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.766164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0] Write session: try to update token
2025-10-10T14:31:55.766180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:55.780567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId: src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:55.781515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:55.781536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:55.781539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:55.781541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:55.781551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600779930542463:3948]
2025-10-10T14:31:55.781555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600779930542463:3948]
2025-10-10T14:31:55.781559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600779930542463:3948]
2025-10-10T14:31:55.781611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:55.781611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:55.781618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:55.781621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:55.781624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.781627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:55.781762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:55.783027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:55.842738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600780712752616:4235]
2025-10-10T14:31:55.843006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 371, pipe: [1:7559600780712752616:4235]
2025-10-10T14:31:55.884798Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:55.885360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.885381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.885430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752616:4235], now have 1 active actors on pipe
2025-10-10T14:31:55.885652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:55.885681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:55.885696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:55.885704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600780712752616:4235]
2025-10-10T14:31:55.885760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 372 reason: error at write: Disconnected sessionId: src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0
2025-10-10T14:31:55.885807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:55.885979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 372 sessionId: src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0 is DEAD
2025-10-10T14:31:55.886121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:55.886132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0] Write session will restart in 0.005086s
2025-10-10T14:31:55.886159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0] Write session: Do CDS request
2025-10-10T14:31:55.886165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:55.892889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.892984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:55.893001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 373
2025-10-10T14:31:55.893116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:55.893153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:55.893164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:55.893169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:55.893686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 373 sessionId:  describe result for acl check
2025-10-10T14:31:55.893725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:55.893727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:55.893729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:55.893738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600780712752662:4644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:55.894325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600780712752662:4644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:55.896927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600780712752662:4644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:55.898929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:55.899120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600780712752662:4644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:55.899136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600780712752662:4644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:55.899140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600780712752662:4644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:55.899159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:55.900848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:55.901035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:55.901048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:55.901060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:55.901110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:55.901155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600779930542670:3950]
2025-10-10T14:31:55.901818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:55.902106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:55.902145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:55.902455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:55.902520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.902526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.902527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.902528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.902530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.902531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.902532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.902534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.902535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.902536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.902537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.902539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.902540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.902545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.902559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.902563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.902568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.902574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.902581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.902585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.902589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.902592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.902597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.902606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.902611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.902619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.902626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.902639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:55.902650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.902660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:55.902670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.902674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:55.902679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.902689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:55.902694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.902703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:55.902712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.902721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:55.902730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.902739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:55.902745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.902752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:55.902761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.902767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:55.902774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.902779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:55.902784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.902790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.902797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.902802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.902810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.902818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.902861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:55.905131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:55.905453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:55.905466Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:55.905468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:55.905472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:55.905479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 372 [2:7559600779930542670:3950]
2025-10-10T14:31:55.905491Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:55.905513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:55.905520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.905523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.905525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.905542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:55.905553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:55.905564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:55.905620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.905627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.905628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.905631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:55.905692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:55.905704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.905714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:55.905726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:55.905744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:55.905773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752617:2438], now have 1 active actors on pipe
2025-10-10T14:31:55.905780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752809:4644], now have 1 active actors on pipe
2025-10-10T14:31:55.905787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600779930542664:3950]
2025-10-10T14:31:55.905793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600779930542664:3950]
2025-10-10T14:31:55.905796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600779930542664:3950]
2025-10-10T14:31:55.905809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:55.905811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 372
2025-10-10T14:31:55.905821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 372
2025-10-10T14:31:55.905826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:55.905825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:55.905828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:55.905829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:55.905847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:55.905851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:55.905884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.905893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.905911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600779930542664:3950]
2025-10-10T14:31:55.905922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:55.905926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:55.905949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:55.905961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:55.905965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:55.905971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:55.905981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:55.905994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:55.906129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.906298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:55.906304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:55.906316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:55.906398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 373 partition: 0 MaxSeqNo: 40 sessionId: src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0
2025-10-10T14:31:55.906830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd408ba-e56391a8-77244095-2fc32ca5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:55.909513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0] Write session: try to update token
2025-10-10T14:31:55.909535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:55.924028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId: src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:55.924491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:55.924514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:55.924517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:55.924519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:55.924531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600779930542664:3950]
2025-10-10T14:31:55.924537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600779930542664:3950]
2025-10-10T14:31:55.924541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600779930542664:3950]
2025-10-10T14:31:55.924593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:55.924605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:55.924612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:55.924710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:55.924722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:55.924727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:55.924748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:55.926742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:55.985604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600780712752821:4235]
2025-10-10T14:31:55.985850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 372, pipe: [1:7559600780712752821:4235]
2025-10-10T14:31:56.031503Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:56.031705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.031717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.031755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600780712752821:4235], now have 1 active actors on pipe
2025-10-10T14:31:56.031900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:56.031951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:56.031959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600780712752821:4235]
2025-10-10T14:31:56.031978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:56.032043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 373 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0
2025-10-10T14:31:56.032237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 373 sessionId: src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0 is DEAD
2025-10-10T14:31:56.032384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:56.032393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0] Write session will restart in 0.009911s
2025-10-10T14:31:56.032417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0] Write session: Do CDS request
2025-10-10T14:31:56.032424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:56.043898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.044006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:56.044023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 374
2025-10-10T14:31:56.044048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:56.044171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.044206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:56.044216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:56.044220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:56.044639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 374 sessionId:  describe result for acl check
2025-10-10T14:31:56.044671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:56.044678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:56.044680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:56.044686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600785007720282:4648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:56.045212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600785007720282:4648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:56.046139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:56.046312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:56.046324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:56.046336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:56.046385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:56.046427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600784225510167:3952]
2025-10-10T14:31:56.046876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:56.047084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:56.047127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:56.047429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:56.047479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.047485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.047486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.047469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600785007720282:4648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:56.047487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.047489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.047489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.047491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.047492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.047493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.047494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.047496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.047497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.047498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.047504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.047516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.047520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.047524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.047528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.047532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.047536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.047540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.047544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.047548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.047552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.047556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.047560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.047567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.047576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.047582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.047588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.047592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.047597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.047606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.047612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.047616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.047626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.047630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.047636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.047644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.047649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.047653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.047662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.047664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.047667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.047671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.047674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.047678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.047683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.047687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.047691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.047695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.047699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.047738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:56.049877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600785007720282:4648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:56.049888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600785007720282:4648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:56.049890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600785007720282:4648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:56.049896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:56.049940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:56.050239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:56.050252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:56.050254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:56.050258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:56.050263Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 373 [2:7559600784225510167:3952]
2025-10-10T14:31:56.050275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:56.050296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:56.050303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.050306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.050309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.050329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:56.050342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:56.050354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:56.050407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.050416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.050419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.050421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:56.050496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:56.050504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.050515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.050528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.050550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:56.050576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720315:4648], now have 1 active actors on pipe
2025-10-10T14:31:56.050584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720118:2438], now have 1 active actors on pipe
2025-10-10T14:31:56.050591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600784225510162:3952]
2025-10-10T14:31:56.050593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600784225510162:3952]
2025-10-10T14:31:56.050587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 373
2025-10-10T14:31:56.050595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600784225510162:3952]
2025-10-10T14:31:56.050592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 373
2025-10-10T14:31:56.050608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:56.050620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:56.050626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:56.050632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:56.050634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:56.050643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:56.050646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:56.050680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.050689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.050703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600784225510162:3952]
2025-10-10T14:31:56.050714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:56.050727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:56.050748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6446752-73964056-7167da71-78bba4b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:56.050760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.050764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.050771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:56.050781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.050797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:56.050823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.050961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.050972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.050989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.051086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 374 partition: 0 MaxSeqNo: 40 sessionId: src_id|a6446752-73964056-7167da71-78bba4b8_0
2025-10-10T14:31:56.051409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fa919d8-3b333b04-d43b5b7-cd022c37_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a6446752-73964056-7167da71-78bba4b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:56.054134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6446752-73964056-7167da71-78bba4b8_0] Write session: try to update token
2025-10-10T14:31:56.054153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6446752-73964056-7167da71-78bba4b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:56.068310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId: src_id|a6446752-73964056-7167da71-78bba4b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:56.069671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:56.069689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:56.069692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:56.069695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:56.069705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600784225510162:3952]
2025-10-10T14:31:56.069709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600784225510162:3952]
2025-10-10T14:31:56.069715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600784225510162:3952]
2025-10-10T14:31:56.069762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:56.069774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.069779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:56.069804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:56.069816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:56.069819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:56.069910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:56.070815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:56.132020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600785007720334:4235]
2025-10-10T14:31:56.132273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 373, pipe: [1:7559600785007720334:4235]
2025-10-10T14:31:56.174193Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:56.174646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.174658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.174696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720334:4235], now have 1 active actors on pipe
2025-10-10T14:31:56.174884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:56.174937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600785007720334:4235]
2025-10-10T14:31:56.174948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:56.174968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:56.175044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 374 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6446752-73964056-7167da71-78bba4b8_0
2025-10-10T14:31:56.175233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 374 sessionId: src_id|a6446752-73964056-7167da71-78bba4b8_0 is DEAD
2025-10-10T14:31:56.175383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6446752-73964056-7167da71-78bba4b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:56.175394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6446752-73964056-7167da71-78bba4b8_0] Write session will restart in 0.007777s
2025-10-10T14:31:56.175416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6446752-73964056-7167da71-78bba4b8_0] Write session: Do CDS request
2025-10-10T14:31:56.175424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6446752-73964056-7167da71-78bba4b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:56.184898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6446752-73964056-7167da71-78bba4b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.184991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:56.185007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 375
2025-10-10T14:31:56.185127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.185165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:56.185175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:56.185179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:56.185645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 375 sessionId:  describe result for acl check
2025-10-10T14:31:56.185685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:56.185691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:56.185692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:56.185699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600785007720463:4653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:56.186237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600785007720463:4653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:56.187759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:56.188286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600785007720463:4653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:56.189957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:56.190240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:56.190251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:56.190263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:56.190312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:56.190353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600784225510382:3955]
2025-10-10T14:31:56.190508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600785007720463:4653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:56.190521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600785007720463:4653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:56.190524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600785007720463:4653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:56.190532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:56.190854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:56.191122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:56.191167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:56.191386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:56.191431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.191437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.191438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.191439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.191441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.191442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.191443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.191444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.191445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.191446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.191447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.191448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.191449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.191455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.191469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.191477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.191480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.191485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.191489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.191492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.191500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.191502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.191505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.191507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.191509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.191511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.191516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.191521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.191525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.191529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.191532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.191535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.191538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.191545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.191548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.191551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.191558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.191561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.191568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.191571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.191574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.191577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.191580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.191583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.191586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.191589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.191592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.191596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.191602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.191605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.191608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.191611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.191637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:56.194043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:56.194744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:56.194766Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:56.194770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:56.194775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:56.194782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 374 [2:7559600784225510382:3955]
2025-10-10T14:31:56.194796Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:56.194820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:56.194828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.194832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.194839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.194856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:56.194869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:56.194882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:56.194957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.194965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.194984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.194993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:56.195095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:56.195109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.195129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.195146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.195165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:56.195197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720530:4653], now have 1 active actors on pipe
2025-10-10T14:31:56.195206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720336:2438], now have 1 active actors on pipe
2025-10-10T14:31:56.195214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600784225510377:3955]
2025-10-10T14:31:56.195222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600784225510377:3955]
2025-10-10T14:31:56.195225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600784225510377:3955]
2025-10-10T14:31:56.195203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 374
2025-10-10T14:31:56.195235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:56.195212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 374
2025-10-10T14:31:56.195254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:56.195258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:56.195264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:56.195265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:56.195277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:56.195281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:56.195309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.195319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.195376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600784225510377:3955]
2025-10-10T14:31:56.195396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:56.195425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:56.195439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.195448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.195455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:56.195469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.195487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:56.195522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:56.195540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.195680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.195689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.195707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.195811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 375 partition: 0 MaxSeqNo: 40 sessionId: src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0
2025-10-10T14:31:56.196172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6446752-73964056-7167da71-78bba4b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:56.198883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0] Write session: try to update token
2025-10-10T14:31:56.198902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:56.212914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId: src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:56.213905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:56.213924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:56.213927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:56.213930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:56.213940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600784225510377:3955]
2025-10-10T14:31:56.213944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600784225510377:3955]
2025-10-10T14:31:56.213948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600784225510377:3955]
2025-10-10T14:31:56.213997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:56.214000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:56.214007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:56.214009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.214011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:56.214011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:56.214142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:56.215282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:56.275390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600785007720544:4235]
2025-10-10T14:31:56.275716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 374, pipe: [1:7559600785007720544:4235]
2025-10-10T14:31:56.321253Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:56.321488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.321502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.321540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720544:4235], now have 1 active actors on pipe
2025-10-10T14:31:56.321686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:56.321731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600785007720544:4235]
2025-10-10T14:31:56.321762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:56.321833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 375 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0
2025-10-10T14:31:56.322062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 375 sessionId: src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0 is DEAD
2025-10-10T14:31:56.322206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:56.322219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0] Write session will restart in 0.007377s
2025-10-10T14:31:56.322244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0] Write session: Do CDS request
2025-10-10T14:31:56.322250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:56.322245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:56.330838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.330932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:56.330946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 376
2025-10-10T14:31:56.331090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.331127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:56.331136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:56.331140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:56.331518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 376 sessionId:  describe result for acl check
2025-10-10T14:31:56.331550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:56.331552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:56.331555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:56.331560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600785007720672:4665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:56.332069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600785007720672:4665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:56.333993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600785007720672:4665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:56.334253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:56.336351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:56.336515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:56.336526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:56.336545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:56.336588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:56.336637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600784225510617:3968]
2025-10-10T14:31:56.336668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600785007720672:4665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:56.336681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600785007720672:4665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:56.336684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600785007720672:4665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:56.336690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:56.337065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:56.337324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:56.337393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:56.337736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:56.337794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.337800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.337801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.337802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.337804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.337805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.337806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.337807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.337808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.337809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.337810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.337811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.337812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.337818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.337829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.337833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.337837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.337841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.337845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.337849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.337858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.337862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.337871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.337877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.337883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.337887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.337894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.337906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.337917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.337927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.337935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.337940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.337948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.337954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.337963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.337972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.337977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.337982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.337990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.337995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.338003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.338009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.338017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.338026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.338032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.338038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.338042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.338047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.338055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.338060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.338069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.338076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.338117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:56.340217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:56.340542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:56.340553Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:56.340554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:56.340557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:56.340561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 375 [2:7559600784225510617:3968]
2025-10-10T14:31:56.340569Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:56.340581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:56.340582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.340585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.340586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.340599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:56.340604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:56.340609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:56.340646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.340651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.340652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.340654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:56.340712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:56.340719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.340730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.340743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.340759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:56.340778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720752:4665], now have 1 active actors on pipe
2025-10-10T14:31:56.340786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720562:2438], now have 1 active actors on pipe
2025-10-10T14:31:56.340791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600784225510612:3968]
2025-10-10T14:31:56.340794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600784225510612:3968]
2025-10-10T14:31:56.340795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600784225510612:3968]
2025-10-10T14:31:56.340813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 375
2025-10-10T14:31:56.340805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:56.340817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:56.340824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:56.340826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:56.340827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:56.340828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:56.340828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:56.340847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600784225510612:3968]
2025-10-10T14:31:56.340849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:56.340851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 375
2025-10-10T14:31:56.340851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:56.340881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.340890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.340920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:56.340932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.340936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.340938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:56.340949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.340963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:56.340978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.341226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.341235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.341250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.341375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 376 partition: 0 MaxSeqNo: 40 sessionId: src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0
2025-10-10T14:31:56.341685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88280aef-1943c83f-a0ce9a8e-6f1d5bae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:56.344242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0] Write session: try to update token
2025-10-10T14:31:56.344258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:56.358696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId: src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:56.359595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:56.359607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:56.359610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:56.359612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:56.359619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600784225510612:3968]
2025-10-10T14:31:56.359623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600784225510612:3968]
2025-10-10T14:31:56.359626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600784225510612:3968]
2025-10-10T14:31:56.359664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:56.359670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.359672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:56.359772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:56.359786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:56.359793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:56.359809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:56.361326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:56.421821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600785007720775:4235]
2025-10-10T14:31:56.422061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 375, pipe: [1:7559600785007720775:4235]
2025-10-10T14:31:56.463076Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:56.463418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.463434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.463482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720775:4235], now have 1 active actors on pipe
2025-10-10T14:31:56.463653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:56.463701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:56.463727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600785007720775:4235]
2025-10-10T14:31:56.463759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:56.463849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0
2025-10-10T14:31:56.464053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 376 sessionId: src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0 is DEAD
2025-10-10T14:31:56.464202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:56.464212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0] Write session will restart in 0.005525s
2025-10-10T14:31:56.464231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0] Write session: Do CDS request
2025-10-10T14:31:56.464236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:56.470807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.470933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:56.470947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 377
2025-10-10T14:31:56.471072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.471106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:56.471117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:56.471123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:56.471594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 377 sessionId:  describe result for acl check
2025-10-10T14:31:56.471623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:56.471629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:56.471631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:56.471635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600785007720817:4672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:56.472113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600785007720817:4672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:56.474682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600785007720817:4672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:56.476065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:56.477826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:56.478014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:56.478025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:56.478036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:56.478024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600785007720817:4672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:56.478034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600785007720817:4672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:56.478036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600785007720817:4672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:56.478041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:56.478087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:56.478126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600784225510828:3972]
2025-10-10T14:31:56.478589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:56.478855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:56.478894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:56.479191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:56.479241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.479246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.479248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.479249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.479250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.479251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.479252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.479253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.479255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.479256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.479257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.479258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.479259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.479264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.479272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.479275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.479277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.479279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.479282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.479284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.479286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.479289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.479291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.479293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.479296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.479298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.479303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.479309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.479315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.479320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.479325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.479330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.479335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.479339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.479342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.479345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.479348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.479351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.479354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.479357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.479359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.479362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.479365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.479367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.479370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.479372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.479376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.479381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.479385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.479390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.479396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.479401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.479425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:56.481578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:56.482080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:56.482091Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:56.482093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:56.482096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:56.482101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 376 [2:7559600784225510828:3972]
2025-10-10T14:31:56.482113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:56.482127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:56.482134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.482137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.482139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.482153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:56.482165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:56.482172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:56.482219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.482225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.482227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.482229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:56.482284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:56.482289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.482300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.482310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.482320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:56.482338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720973:4672], now have 1 active actors on pipe
2025-10-10T14:31:56.482344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720776:2438], now have 1 active actors on pipe
2025-10-10T14:31:56.482349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600784225510823:3972]
2025-10-10T14:31:56.482351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600784225510823:3972]
2025-10-10T14:31:56.482352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600784225510823:3972]
2025-10-10T14:31:56.482362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:56.482371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:56.482381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:56.482387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:56.482387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:56.482388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:56.482391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:56.482384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 376
2025-10-10T14:31:56.482394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 376
2025-10-10T14:31:56.482410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600784225510823:3972]
2025-10-10T14:31:56.482416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:56.482429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:56.482431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.482434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.482484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|103e6872-f934b38d-cd62707-442878ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:56.482496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.482500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.482504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:56.482512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.482520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:56.482534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.482654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.482661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.482674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.482747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 377 partition: 0 MaxSeqNo: 40 sessionId: src_id|103e6872-f934b38d-cd62707-442878ff_0
2025-10-10T14:31:56.483044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|137b93e7-739b93e0-d5bc4e08-8a5f7a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|103e6872-f934b38d-cd62707-442878ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:56.485587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103e6872-f934b38d-cd62707-442878ff_0] Write session: try to update token
2025-10-10T14:31:56.485604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103e6872-f934b38d-cd62707-442878ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:56.499503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId: src_id|103e6872-f934b38d-cd62707-442878ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:56.500847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:56.500864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:56.500867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:56.500869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:56.500878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600784225510823:3972]
2025-10-10T14:31:56.500883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600784225510823:3972]
2025-10-10T14:31:56.500886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600784225510823:3972]
2025-10-10T14:31:56.500938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:56.500949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.500952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:56.501070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:56.501083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:56.501084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:56.501089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:56.501970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:56.563603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600785007720991:4235]
2025-10-10T14:31:56.563881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 376, pipe: [1:7559600785007720991:4235]
2025-10-10T14:31:56.604374Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:56.604585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.604597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.604637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720991:4235], now have 1 active actors on pipe
2025-10-10T14:31:56.604830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:56.604873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:56.604887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:56.604887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:56.604924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600785007720991:4235]
2025-10-10T14:31:56.604963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 377 reason: error at write: Disconnected sessionId: src_id|103e6872-f934b38d-cd62707-442878ff_0
2025-10-10T14:31:56.605197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 377 sessionId: src_id|103e6872-f934b38d-cd62707-442878ff_0 is DEAD
2025-10-10T14:31:56.605363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103e6872-f934b38d-cd62707-442878ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:56.605374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103e6872-f934b38d-cd62707-442878ff_0] Write session will restart in 0.007306s
2025-10-10T14:31:56.605392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103e6872-f934b38d-cd62707-442878ff_0] Write session: Do CDS request
2025-10-10T14:31:56.605397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103e6872-f934b38d-cd62707-442878ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:56.613856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103e6872-f934b38d-cd62707-442878ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.613967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:56.613983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 378
2025-10-10T14:31:56.614115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.614170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:56.614181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:56.614185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:56.614704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 378 sessionId:  describe result for acl check
2025-10-10T14:31:56.614745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:56.614747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:56.614749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:56.614756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600785007721112:4678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:56.615319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600785007721112:4678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:56.617215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:56.617253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600785007721112:4678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:56.619320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:56.619401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600785007721112:4678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:56.619415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600785007721112:4678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:56.619418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600785007721112:4678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:56.619425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:56.619508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:56.619518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:56.619530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:56.619582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:56.619736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600784225511036:3975]
2025-10-10T14:31:56.620331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:56.620638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:56.620678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:56.620999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:56.621050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.621056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.621056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.621057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.621058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.621059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.621059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.621060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.621061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.621061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.621062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.621063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.621064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.621067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.621076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.621078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.621080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.621082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.621085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.621087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.621089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.621091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.621093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.621095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.621097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.621099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.621105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.621110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.621115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.621118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.621121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.621124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.621127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.621130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.621133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.621136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.621138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.621142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.621145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.621148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.621151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.621154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.621156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.621160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.621163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.621166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.621170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.621175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.621180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.621184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.621189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.621194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.621224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:56.623483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:56.623916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:56.623926Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:56.623928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:56.623932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:56.623937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 377 [2:7559600784225511036:3975]
2025-10-10T14:31:56.623948Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:56.623967Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:56.623974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.623978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.623980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.623997Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:56.624009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:56.624022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:56.624077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.624086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.624088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.624091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:56.624155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:56.624162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.624173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.624186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.624208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:56.624233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007721192:4678], now have 1 active actors on pipe
2025-10-10T14:31:56.624241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007720992:2438], now have 1 active actors on pipe
2025-10-10T14:31:56.624248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600784225511031:3975]
2025-10-10T14:31:56.624254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600784225511031:3975]
2025-10-10T14:31:56.624256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600784225511031:3975]
2025-10-10T14:31:56.624270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:56.624260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 377
2025-10-10T14:31:56.624266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 377
2025-10-10T14:31:56.624286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:56.624287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:56.624290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:56.624292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:56.624305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:56.624308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:56.624342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.624352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.624366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600784225511031:3975]
2025-10-10T14:31:56.624377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:56.624399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:56.624410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:56.624417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.624426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.624429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:56.624440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.624454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:56.624480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.624648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.624657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.624672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.624759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 378 partition: 0 MaxSeqNo: 40 sessionId: src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0
2025-10-10T14:31:56.625092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103e6872-f934b38d-cd62707-442878ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:56.627676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0] Write session: try to update token
2025-10-10T14:31:56.627692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:56.641202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId: src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:56.642606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:56.642622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:56.642625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:56.642627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:56.642637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600784225511031:3975]
2025-10-10T14:31:56.642645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600784225511031:3975]
2025-10-10T14:31:56.642649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600784225511031:3975]
2025-10-10T14:31:56.642700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:56.642711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.642713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:56.642771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:56.642783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:56.642788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:56.642849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:56.643756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:56.704959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600785007721204:4235]
2025-10-10T14:31:56.705264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 377, pipe: [1:7559600785007721204:4235]
2025-10-10T14:31:56.746658Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:56.746896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.746908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.746952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007721204:4235], now have 1 active actors on pipe
2025-10-10T14:31:56.747098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:56.747168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600785007721204:4235]
2025-10-10T14:31:56.747186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:56.747276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:56.747282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:56.747336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 378 reason: error at write: Disconnected sessionId: src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0
2025-10-10T14:31:56.747528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 378 sessionId: src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0 is DEAD
2025-10-10T14:31:56.747649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:56.747656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0] Write session will restart in 0.009773s
2025-10-10T14:31:56.747695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0] Write session: Do CDS request
2025-10-10T14:31:56.747700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:56.758762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.758918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:56.758931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 379
2025-10-10T14:31:56.759083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.759127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:56.759135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:56.759139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:56.759580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 379 sessionId:  describe result for acl check
2025-10-10T14:31:56.759614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:56.759617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:56.759618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:56.759624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600785007721373:4682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:56.759967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:56.760159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600785007721373:4682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:56.761938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:56.762115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:56.762128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:56.762139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:56.762133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600785007721373:4682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:56.762188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:56.762227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600784225511242:3977]
2025-10-10T14:31:56.762825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:56.763069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:56.763110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:56.763416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:56.763467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.763473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.763474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.763475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.763476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.763477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.763479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.763480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.763481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.763482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.763483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.763484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.763485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.763491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.763502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.763506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.763511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.763514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.763519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.763522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.763526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.763530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.763535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.763538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.763541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.763552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.763558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.763571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.763581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.763592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.763597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.763603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.763611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.763617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.763627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.763636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.763645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.763654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.763659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.763665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.763670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.763675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.763684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.763693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.763701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.763706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.763715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.763722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.763730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.763735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.763743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.763752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.763793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:56.763779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600785007721373:4682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:56.763788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600785007721373:4682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:56.763791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600785007721373:4682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:56.763796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:56.765993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:56.766379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:56.766391Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:56.766393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:56.766395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:56.766400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 378 [2:7559600784225511242:3977]
2025-10-10T14:31:56.766408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:56.766419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:56.766421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.766423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.766425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.766436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:56.766442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:56.766448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:56.766495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.766502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.766504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.766506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:56.766557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:56.766562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.766569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.766577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.766590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:56.766608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600784225511237:3977]
2025-10-10T14:31:56.766612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600784225511237:3977]
2025-10-10T14:31:56.766614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600784225511237:3977]
2025-10-10T14:31:56.766623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:56.766634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007721405:4682], now have 1 active actors on pipe
2025-10-10T14:31:56.766637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:56.766639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:56.766640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:56.766640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007721205:2438], now have 1 active actors on pipe
2025-10-10T14:31:56.766647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:56.766656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:56.766661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:56.766677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600784225511237:3977]
2025-10-10T14:31:56.766687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:56.766704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:56.766688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 378
2025-10-10T14:31:56.766705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 378
2025-10-10T14:31:56.766735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.766743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.766773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:56.766784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.766788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.766794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:56.766802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.766810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:56.766822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.766960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.766967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.766983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.767050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 379 partition: 0 MaxSeqNo: 40 sessionId: src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0
2025-10-10T14:31:56.767372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d587522-1fe6e189-6e0c537b-6d7f9d10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:56.769736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0] Write session: try to update token
2025-10-10T14:31:56.769749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:56.783149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:56.783163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:56.783171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600784225511237:3977]
2025-10-10T14:31:56.783213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:56.783212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:56.783375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:56.783496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId: src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:56.783521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:56.783681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:56.783810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:56.783995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:56.784028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:56.785732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:56.785903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.785919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.785947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:56.786014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:56.794186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:56.794198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:56.794201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:56.794203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:56.794212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600784225511237:3977]
2025-10-10T14:31:56.794215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600784225511237:3977]
2025-10-10T14:31:56.794218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600784225511237:3977]
2025-10-10T14:31:56.794260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:56.794265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:56.794271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.794274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:56.794276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:56.794287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:56.794392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:56.847282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600785007721415:4235]
2025-10-10T14:31:56.847497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 378, pipe: [1:7559600785007721415:4235]
2025-10-10T14:31:56.897488Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:56.904164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.904188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.904347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.904404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.904458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.904516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.904556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.904563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.904623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.904678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.904735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.904791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.904829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.904834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.904891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.904942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.904996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.905050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.905089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.905094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.905151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.905405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.905471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.905541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.905585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.905591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.905686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.905745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.905799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.905850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.905889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.905894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.905951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.906003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.906058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.906112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.906150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.906155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.906213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.906265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.906333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.906395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.906433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.906438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.906501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.906552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.906605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.906659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.906703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.906711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.906778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.906838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.906903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.906969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.907011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.907018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.907079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:56.907144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:56.907208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:56.907298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:56.907334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:56.907339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:56.907376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007721415:4235], now have 1 active actors on pipe
2025-10-10T14:31:56.907616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600785007721415:4235]
2025-10-10T14:31:56.907639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:56.907641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:56.907642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:56.907675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 379 reason: error at write: Disconnected sessionId: src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0
2025-10-10T14:31:56.907845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:56.907880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 379 sessionId: src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0 is DEAD
2025-10-10T14:31:56.908021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:56.908031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0] Write session will restart in 0.008826s
2025-10-10T14:31:56.908068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0] Write session: Do CDS request
2025-10-10T14:31:56.908072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:56.917814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.917896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:56.917908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 380
2025-10-10T14:31:56.918040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:56.918077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:56.918084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:56.918088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:56.918510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 380 sessionId:  describe result for acl check
2025-10-10T14:31:56.918547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:56.918555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:56.918557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:56.918563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600785007721573:4686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:56.919117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600785007721573:4686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:56.920187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:56.921072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600785007721573:4686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:56.922055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:56.922229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:56.922242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:56.922256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:56.922311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:56.922349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600784225511450:3979]
2025-10-10T14:31:56.922948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:56.923218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:56.923259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:56.923494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600785007721573:4686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:56.923507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600785007721573:4686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:56.923511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600785007721573:4686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:56.923517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:56.923545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:56.923607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.923613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.923614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.923615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.923617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.923618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.923619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.923620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.923621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.923622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.923623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.923624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.923625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.923630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.923641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.923645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.923649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.923652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.923656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.923660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.923664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.923668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.923674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.923679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.923688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.923692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.923698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.923707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:56.923713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.923723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:56.923731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.923737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:56.923745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.923750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:56.923754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.923763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:56.923767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.923776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:56.923785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.923794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:56.923802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.923807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:56.923815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.923821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:56.923829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.923834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:56.923842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.923848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.923856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.923861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.923869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.923874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.923918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:56.926058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:56.926435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:56.926446Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:56.926447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:56.926449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:56.926453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 379 [2:7559600784225511450:3979]
2025-10-10T14:31:56.926460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:56.926471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:56.926476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.926491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.926496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.926508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:56.926513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:56.926519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:56.926560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.926565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.926566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.926568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:56.926621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:56.926629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.926639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:56.926655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:56.926676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:56.926699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007721617:4686], now have 1 active actors on pipe
2025-10-10T14:31:56.926708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600785007721416:2438], now have 1 active actors on pipe
2025-10-10T14:31:56.926714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600784225511445:3979]
2025-10-10T14:31:56.926720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600784225511445:3979]
2025-10-10T14:31:56.926722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600784225511445:3979]
2025-10-10T14:31:56.926716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 379
2025-10-10T14:31:56.926734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 379
2025-10-10T14:31:56.926737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:56.926754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:56.926762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:56.926765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:56.926766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:56.926775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:56.926782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:56.926808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.926814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.926828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600784225511445:3979]
2025-10-10T14:31:56.926837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:56.926846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:56.926862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63881dbe-a68fc231-2d441f36-ea71c317_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:56.926871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:56.926874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:56.926876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:56.926884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:56.926898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:56.926924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.927041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.927049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.927063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:56.927153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 380 partition: 0 MaxSeqNo: 40 sessionId: src_id|63881dbe-a68fc231-2d441f36-ea71c317_0
2025-10-10T14:31:56.927459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d5eb6a-ea7873b5-c1fffe12-25df21ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63881dbe-a68fc231-2d441f36-ea71c317_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:56.929861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63881dbe-a68fc231-2d441f36-ea71c317_0] Write session: try to update token
2025-10-10T14:31:56.929874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63881dbe-a68fc231-2d441f36-ea71c317_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:56.942471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId: src_id|63881dbe-a68fc231-2d441f36-ea71c317_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:56.944810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:56.945055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:56.945077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:56.945102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:56.945105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:56.945108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:56.945110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:56.945118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600784225511445:3979]
2025-10-10T14:31:56.945128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600784225511445:3979]
2025-10-10T14:31:56.945131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600784225511445:3979]
2025-10-10T14:31:56.945150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:56.945157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:56.945160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:56.945181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:56.945192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:56.945198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:56.945325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:57.007559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600789302688923:4235]
2025-10-10T14:31:57.007889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 379, pipe: [1:7559600789302688923:4235]
2025-10-10T14:31:57.050426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:57.050905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:57.050954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302688923:4235], now have 1 active actors on pipe
2025-10-10T14:31:57.051019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:57.051333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600789302688923:4235]
2025-10-10T14:31:57.051355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:57.059428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:57.059440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:57.059462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 380 reason: error at write: Disconnected sessionId: src_id|63881dbe-a68fc231-2d441f36-ea71c317_0
2025-10-10T14:31:57.059601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 380 sessionId: src_id|63881dbe-a68fc231-2d441f36-ea71c317_0 is DEAD
2025-10-10T14:31:57.059778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63881dbe-a68fc231-2d441f36-ea71c317_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:57.059790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63881dbe-a68fc231-2d441f36-ea71c317_0] Write session will restart in 0.009332s
2025-10-10T14:31:57.059814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63881dbe-a68fc231-2d441f36-ea71c317_0] Write session: Do CDS request
2025-10-10T14:31:57.059821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63881dbe-a68fc231-2d441f36-ea71c317_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:57.067521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:57.069554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:57.069764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:57.069776Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:57.069788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:57.069842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63881dbe-a68fc231-2d441f36-ea71c317_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.069848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:57.069890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600788520478955:3981]
2025-10-10T14:31:57.069911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:57.069924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 381
2025-10-10T14:31:57.070058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.070090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:57.070100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:57.070108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:57.070478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:57.070521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 381 sessionId:  describe result for acl check
2025-10-10T14:31:57.070555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:57.070562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:57.070563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:57.070569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600789302689095:4690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:57.070782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:57.070829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:57.071067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600789302689095:4690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:57.071119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:57.071180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.071186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.071187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.071188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.071189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.071190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.071191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.071192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.071194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.071194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.071195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.071197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.071198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.071203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.071214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.071218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.071223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.071227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.071231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.071235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.071239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.071243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.071247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.071252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.071256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.071260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.071270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.071282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.071295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.071304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.071314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.071319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.071323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.071328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.071332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.071341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.071345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.071354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.071360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.071370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.071379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.071384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.071392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.071398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.071405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.071410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.071418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.071422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.071430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.071435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.071444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.071450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.071496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:57.072982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600789302689095:4690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:57.073681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:57.074092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:57.074103Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:57.074104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:57.074107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:57.074111Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 380 [2:7559600788520478955:3981]
2025-10-10T14:31:57.074120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:57.074132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:57.074137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.074139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.074141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.074153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:57.074158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:57.074168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:57.074211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.074216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.074217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.074220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:57.074276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:57.074284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.074297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.074312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.074333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:57.074356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302688924:2438], now have 1 active actors on pipe
2025-10-10T14:31:57.074363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600788520478950:3981]
2025-10-10T14:31:57.074364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600788520478950:3981]
2025-10-10T14:31:57.074365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600788520478950:3981]
2025-10-10T14:31:57.074377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:57.074387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:57.074393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:57.074372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 380
2025-10-10T14:31:57.074401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:57.074402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:57.074403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:57.074405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:57.074430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600788520478950:3981]
2025-10-10T14:31:57.074436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:57.074446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:57.076758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600789302689095:4690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:57.076778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600789302689095:4690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:57.076780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600789302689095:4690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:57.076786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:57.076966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689132:4690], now have 1 active actors on pipe
2025-10-10T14:31:57.076997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 380
2025-10-10T14:31:57.077054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.077064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.077096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:57.077112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.077118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.077121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:57.077137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.077156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:57.077181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.077349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.077357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.077372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.077448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 381 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0
2025-10-10T14:31:57.077759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63881dbe-a68fc231-2d441f36-ea71c317_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:57.080132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0] Write session: try to update token
2025-10-10T14:31:57.080145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:57.092571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId: src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:57.093212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:57.093230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.093234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:57.093236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:57.093245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600788520478950:3981]
2025-10-10T14:31:57.093249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600788520478950:3981]
2025-10-10T14:31:57.093253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600788520478950:3981]
2025-10-10T14:31:57.093299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:57.093299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:57.093305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:57.093307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.093309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:57.093310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:57.093452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:57.095027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:57.151409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600789302689148:4235]
2025-10-10T14:31:57.151577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 380, pipe: [1:7559600789302689148:4235]
2025-10-10T14:31:57.195436Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:57.195681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.195695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.195736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689148:4235], now have 1 active actors on pipe
2025-10-10T14:31:57.195997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:57.196005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:57.196010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:57.196057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600789302689148:4235]
2025-10-10T14:31:57.196080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 381 reason: error at write: Disconnected sessionId: src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0
2025-10-10T14:31:57.196312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 381 sessionId: src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0 is DEAD
2025-10-10T14:31:57.196449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:57.196439Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:57.196458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0] Write session will restart in 0.006932s
2025-10-10T14:31:57.196493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0] Write session: Do CDS request
2025-10-10T14:31:57.196502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:57.204889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.204973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:57.204985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 382
2025-10-10T14:31:57.205132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.205170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:57.205177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:57.205180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:57.205530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 382 sessionId:  describe result for acl check
2025-10-10T14:31:57.205561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:57.205562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:57.205563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:57.205567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600789302689233:4695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:57.206122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600789302689233:4695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:57.208353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600789302689233:4695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:57.209430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:57.211281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:57.211413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600789302689233:4695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:57.211430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600789302689233:4695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:57.211432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600789302689233:4695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:57.211438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:57.211442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:57.211451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:57.211462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:57.211515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:57.211544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600788520479177:3984]
2025-10-10T14:31:57.212025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:57.212275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:57.212306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:57.212525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:57.212565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.212569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.212571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.212571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.212572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.212572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.212574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.212574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.212575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.212575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.212576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.212577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.212577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.212581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.212590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.212592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.212594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.212597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.212599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.212601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.212604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.212606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.212608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.212610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.212613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.212615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.212620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.212625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.212630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.212634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.212637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.212640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.212643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.212647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.212649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.212653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.212655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.212658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.212661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.212664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.212667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.212670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.212673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.212676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.212678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.212682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.212684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.212687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.212691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.212694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.212697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.212700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.212720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:57.214812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:57.215200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:57.215208Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:57.215209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:57.215211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:57.215216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 381 [2:7559600788520479177:3984]
2025-10-10T14:31:57.215223Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:57.215235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:57.215237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.215238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.215240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.215252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:57.215257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:57.215263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:57.215310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.215317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.215318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.215320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:57.215368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:57.215373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.215380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.215388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.215398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:57.215416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689350:4695], now have 1 active actors on pipe
2025-10-10T14:31:57.215422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689149:2438], now have 1 active actors on pipe
2025-10-10T14:31:57.215428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600788520479172:3984]
2025-10-10T14:31:57.215431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600788520479172:3984]
2025-10-10T14:31:57.215432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600788520479172:3984]
2025-10-10T14:31:57.215441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:57.215451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:57.215455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:57.215458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:57.215460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:57.215464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:57.215466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:57.215483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600788520479172:3984]
2025-10-10T14:31:57.215488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:57.215476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 381
2025-10-10T14:31:57.215482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 381
2025-10-10T14:31:57.215508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:57.215590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.215599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.215623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:57.215632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.215635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.215640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:57.215647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.215657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:57.215670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.215868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.215879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.215899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.215991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 382 partition: 0 MaxSeqNo: 40 sessionId: src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0
2025-10-10T14:31:57.216348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba164789-392d81df-bd5cc8bf-4c7fb3aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:57.218939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0] Write session: try to update token
2025-10-10T14:31:57.218955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:57.231572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId: src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:57.233882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:57.234281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.234299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.234318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:57.234321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.234323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:57.234325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:57.234331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600788520479172:3984]
2025-10-10T14:31:57.234335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600788520479172:3984]
2025-10-10T14:31:57.234337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600788520479172:3984]
2025-10-10T14:31:57.234368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:57.234376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:57.234379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:57.234382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:57.234389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.234391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:57.234521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:57.296311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600789302689361:4235]
2025-10-10T14:31:57.296616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 381, pipe: [1:7559600789302689361:4235]
2025-10-10T14:31:57.336463Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:57.336726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:57.336776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689361:4235], now have 1 active actors on pipe
2025-10-10T14:31:57.336813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:57.336978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:57.337039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600789302689361:4235]
2025-10-10T14:31:57.345205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:57.345217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:57.345237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 382 reason: error at write: Disconnected sessionId: src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0
2025-10-10T14:31:57.345428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 382 sessionId: src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0 is DEAD
2025-10-10T14:31:57.345585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:57.345593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0] Write session will restart in 0.008559s
2025-10-10T14:31:57.345612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0] Write session: Do CDS request
2025-10-10T14:31:57.345616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:57.351774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:57.353906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:57.354142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:57.354154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:57.354164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:57.354224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:57.354263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600788520479419:3992]
2025-10-10T14:31:57.354758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:57.354886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.354947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:57.354963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 383
2025-10-10T14:31:57.355028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:57.355072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:57.355113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.355145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:57.355155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:57.355159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:57.355360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:57.355414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.355419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.355420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.355421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.355422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.355422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.355423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.355424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.355424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.355425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.355426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.355426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.355427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.355433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.355444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.355448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.355452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.355457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.355461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.355465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.355469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.355473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.355478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.355482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.355486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.355490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.355496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.355506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.355499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 383 sessionId:  describe result for acl check
2025-10-10T14:31:57.355513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.355518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.355522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.355528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.355532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:57.355532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.355538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:57.355538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.355540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:57.355542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.355546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600789302689554:4705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:57.355547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.355551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.355557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.355562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.355567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.355571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.355577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.355581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.355587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.355595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.355600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.355605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.355610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.355618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.355624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.355632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.355637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.355682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:57.356043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600789302689554:4705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:57.357850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:57.357985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600789302689554:4705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:57.358223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:57.358235Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:57.358237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:57.358240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:57.358247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 382 [2:7559600788520479419:3992]
2025-10-10T14:31:57.358258Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:57.358278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:57.358286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.358290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.358292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.358312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:57.358325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:57.358337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:57.358389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.358396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.358398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.358401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:57.358460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:57.358463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.358471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.358481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.358509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:57.358532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689363:2438], now have 1 active actors on pipe
2025-10-10T14:31:57.358542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600788520479414:3992]
2025-10-10T14:31:57.358543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600788520479414:3992]
2025-10-10T14:31:57.358545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600788520479414:3992]
2025-10-10T14:31:57.358555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:57.358566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:57.358574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:57.358577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:57.358579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:57.358580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:57.358583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:57.358602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600788520479414:3992]
2025-10-10T14:31:57.358611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:57.358618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:57.358674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 382
2025-10-10T14:31:57.362956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600789302689554:4705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:57.362968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600789302689554:4705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:57.362971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600789302689554:4705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:57.362980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:57.363377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689585:4705], now have 1 active actors on pipe
2025-10-10T14:31:57.363439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 382
2025-10-10T14:31:57.363512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.363524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.363555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:57.363572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.363581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.363583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:57.363596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.363613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:57.363631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.363810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.363819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.363833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.363924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 383 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0
2025-10-10T14:31:57.364258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b275ef52-a3f36a66-5654b747-a66b25ba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:57.366720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0] Write session: try to update token
2025-10-10T14:31:57.366733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:57.376538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:57.376552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.376555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:57.376557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:57.376567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600788520479414:3992]
2025-10-10T14:31:57.376571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600788520479414:3992]
2025-10-10T14:31:57.376574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600788520479414:3992]
2025-10-10T14:31:57.376620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:57.376622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:57.376629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.376631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:57.376632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:57.376636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:57.376764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:57.380148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId: src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:57.383681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:57.437146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600789302689600:4235]
2025-10-10T14:31:57.437394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 382, pipe: [1:7559600789302689600:4235]
2025-10-10T14:31:57.480659Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:57.480964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.480976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.481015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689600:4235], now have 1 active actors on pipe
2025-10-10T14:31:57.481201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:57.481220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600789302689600:4235]
2025-10-10T14:31:57.481232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:57.481265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:57.481344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0
2025-10-10T14:31:57.481530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 383 sessionId: src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0 is DEAD
2025-10-10T14:31:57.481720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:57.481729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0] Write session will restart in 0.006414s
2025-10-10T14:31:57.481756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0] Write session: Do CDS request
2025-10-10T14:31:57.481762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:57.489763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.489910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:57.489923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 384
2025-10-10T14:31:57.490055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.490089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:57.490097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:57.490101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:57.490558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 384 sessionId:  describe result for acl check
2025-10-10T14:31:57.490597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:57.490603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:57.490605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:57.490611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600789302689679:4712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:57.491169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600789302689679:4712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:57.493889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600789302689679:4712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:57.494867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:57.496800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:57.496938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600789302689679:4712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:57.496951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600789302689679:4712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:57.496955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600789302689679:4712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:57.496962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:57.497087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:57.497099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:57.497112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:57.497176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:57.497215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600788520479638:4001]
2025-10-10T14:31:57.497962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:57.498191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:57.498222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:57.498564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:57.498613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.498618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.498619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.498619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.498620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.498621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.498622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.498622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.498623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.498624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.498625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.498626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.498626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.498630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.498639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.498641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.498644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.498646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.498648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.498651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.498653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.498655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.498657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.498660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.498662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.498664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.498669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.498676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.498681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.498684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.498687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.498690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.498693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.498697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.498700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.498703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.498706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.498709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.498712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.498715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.498718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.498721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.498724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.498727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.498729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.498733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.498736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.498740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.498742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.498746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.498748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.498751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.498774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:57.500823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:57.501297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:57.501308Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:57.501309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:57.501312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:57.501316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 383 [2:7559600788520479638:4001]
2025-10-10T14:31:57.501324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:57.501350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:57.501352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.501354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.501356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.501366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:57.501371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:57.501378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:57.501420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.501425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.501427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.501428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:57.501479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:57.501485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.501493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.501500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.501517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:57.501542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689805:4712], now have 1 active actors on pipe
2025-10-10T14:31:57.501550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689602:2438], now have 1 active actors on pipe
2025-10-10T14:31:57.501558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600788520479633:4001]
2025-10-10T14:31:57.501562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600788520479633:4001]
2025-10-10T14:31:57.501564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600788520479633:4001]
2025-10-10T14:31:57.501574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:57.501582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:57.501585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:57.501586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:57.501591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:57.501604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:57.501611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:57.501634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600788520479633:4001]
2025-10-10T14:31:57.501646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:57.501634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 383
2025-10-10T14:31:57.501659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:57.501775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 383
2025-10-10T14:31:57.501830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.501840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.501867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:57.501879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.501882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.501884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:57.501892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.501906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:57.501917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.502073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.502080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.502092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.502181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 384 partition: 0 MaxSeqNo: 40 sessionId: src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0
2025-10-10T14:31:57.502550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f065580-60875bb6-e1ea2f42-bc3d941c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:57.505132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0] Write session: try to update token
2025-10-10T14:31:57.505151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:57.519057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId: src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:57.519225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:57.519239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.519249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600788520479633:4001]
2025-10-10T14:31:57.519293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:57.519308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:57.519478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:57.519615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:57.519742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:57.519871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:57.520043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:57.520078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:57.521697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:57.521895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.521910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.521938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:57.522024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:57.530213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:57.530226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.530227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:57.530228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:57.530236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600788520479633:4001]
2025-10-10T14:31:57.530239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600788520479633:4001]
2025-10-10T14:31:57.530241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600788520479633:4001]
2025-10-10T14:31:57.530273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:57.530278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.530278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:57.530279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:57.530284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:57.530289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:57.530388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:57.581507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600789302689823:4235]
2025-10-10T14:31:57.581698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 383, pipe: [1:7559600789302689823:4235]
2025-10-10T14:31:57.632949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:57.639605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.639625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.639769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.639827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.639896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.639951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.640162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.640175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.640234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.640288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.640346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.640404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.640442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.640447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.640502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.640556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.640610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.640664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.640702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.640710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.640764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.640821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.640874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.640927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.640966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.640971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.641029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.641082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.641145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.641212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.641323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.641341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.641400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.641454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.641507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.641569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.641614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.641622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.641684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.641737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.641789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.641858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.641901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.641906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.641962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.642014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.642066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.642121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.642159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.642164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.642229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.642282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.642335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.642387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.642426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.642431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.642499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:57.642554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:57.642613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:57.642675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:57.642718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:57.642726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:57.642765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689823:4235], now have 1 active actors on pipe
2025-10-10T14:31:57.642981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:57.642995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600789302689823:4235]
2025-10-10T14:31:57.643023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:57.643025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:57.643058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 384 reason: error at write: Disconnected sessionId: src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0
2025-10-10T14:31:57.643276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 384 sessionId: src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0 is DEAD
2025-10-10T14:31:57.643283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:57.643407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:57.643416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0] Write session will restart in 0.008486s
2025-10-10T14:31:57.643436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0] Write session: Do CDS request
2025-10-10T14:31:57.643441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:57.652857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.652929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:57.652945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 385
2025-10-10T14:31:57.653185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.653224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:57.653240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:57.653244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:57.653710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 385 sessionId:  describe result for acl check
2025-10-10T14:31:57.653764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:57.653771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:57.653773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:57.653779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600789302689952:4718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:57.654371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600789302689952:4718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:57.657123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:57.657306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600789302689952:4718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:57.659536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:57.659775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:57.659787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:57.659800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:57.659849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:57.659859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600789302689952:4718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:57.659870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600789302689952:4718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:57.659884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600788520479853:4004]
2025-10-10T14:31:57.659873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600789302689952:4718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:57.659879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:57.660375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:57.660622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:57.660657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:57.660907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:57.660961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.660967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.660968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.660970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.660971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.660972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.660973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.660975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.660976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.660977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.660979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.660980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.660981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.660987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.661001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.661005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.661010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.661018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.661022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.661030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.661034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.661038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.661043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.661049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.661052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.661054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.661060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.661068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.661076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.661080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.661086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.661090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.661094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.661097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.661100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.661103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.661105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.661108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.661111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.661114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.661123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.661126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.661128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.661132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.661134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.661139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.661144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.661149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.661153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.661157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.661161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.661166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.661207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:57.663390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:57.663860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:57.663870Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:57.663872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:57.663875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:57.663881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 384 [2:7559600788520479853:4004]
2025-10-10T14:31:57.663892Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:57.663913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:57.663920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.663923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.663924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.663939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:57.663951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:57.663962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:57.664009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.664014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.664015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.664017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:57.664071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:57.664079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.664090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.664107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.664129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:57.664150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302689828:2438], now have 1 active actors on pipe
2025-10-10T14:31:57.664156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302690032:4718], now have 1 active actors on pipe
2025-10-10T14:31:57.664161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600788520479848:4004]
2025-10-10T14:31:57.664163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600788520479848:4004]
2025-10-10T14:31:57.664164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600788520479848:4004]
2025-10-10T14:31:57.664174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:57.664186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:57.664187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:57.664192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:57.664194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:57.664197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:57.664200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:57.664195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 384
2025-10-10T14:31:57.664208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 384
2025-10-10T14:31:57.664214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600788520479848:4004]
2025-10-10T14:31:57.664222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:57.664224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:57.664242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.664246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.664272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:57.664282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.664285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.664286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:57.664293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.664304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:57.664326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.664471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.664481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.664502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.664579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 385 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0
2025-10-10T14:31:57.664958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ae5388-548fe5b6-a728a2d6-8a6f6664_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:57.667491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0] Write session: try to update token
2025-10-10T14:31:57.667507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:57.681185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId: src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:57.682212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:57.682230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.682234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:57.682236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:57.682244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600788520479848:4004]
2025-10-10T14:31:57.682248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600788520479848:4004]
2025-10-10T14:31:57.682252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600788520479848:4004]
2025-10-10T14:31:57.682288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:57.682300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:57.682300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:57.682302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:57.682308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.682310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:57.682445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:57.683852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:57.743307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600789302690043:4235]
2025-10-10T14:31:57.743591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 384, pipe: [1:7559600789302690043:4235]
2025-10-10T14:31:57.788769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:57.789071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.789086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.789125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302690043:4235], now have 1 active actors on pipe
2025-10-10T14:31:57.789270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:57.789315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:57.789344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:57.789385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600789302690043:4235]
2025-10-10T14:31:57.789427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 385 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0
2025-10-10T14:31:57.789635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 385 sessionId: src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0 is DEAD
2025-10-10T14:31:57.789788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:57.789797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0] Write session will restart in 0.009464s
2025-10-10T14:31:57.789822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0] Write session: Do CDS request
2025-10-10T14:31:57.789829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:57.800841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.800902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:57.800914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 386
2025-10-10T14:31:57.801055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.801084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:57.801092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:57.801095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:57.801453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 386 sessionId:  describe result for acl check
2025-10-10T14:31:57.801481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:57.801487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:57.801488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:57.801493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600789302690218:4722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:57.801940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600789302690218:4722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:57.802024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:57.804080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:57.804290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:57.804303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:57.804315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:57.804358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600789302690218:4722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:57.804373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:57.804414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600788520480066:4006]
2025-10-10T14:31:57.804938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:57.805226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:57.805274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:57.805588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:57.805631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.805635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.805636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.805637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.805637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.805638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.805639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.805639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.805640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.805641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.805641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.805642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.805643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.805646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.805655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.805657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.805660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.805662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.805664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.805666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.805668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.805670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.805672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.805674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.805676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.805678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.805683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.805689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.805693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.805696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.805699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.805702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.805704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.805708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.805711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.805714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.805716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.805719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.805722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.805725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.805727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.805731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.805734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.805737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.805742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.805747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.805751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.805756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.805760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.805765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.805770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.805773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.805794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:57.807836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:57.807871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600789302690218:4722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:57.807885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600789302690218:4722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:57.807889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600789302690218:4722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:57.807897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:57.808126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:57.808138Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:57.808140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:57.808144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:57.808150Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 385 [2:7559600788520480066:4006]
2025-10-10T14:31:57.808160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:57.808173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:57.808179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.808181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.808183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.808195Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:57.808200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:57.808206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:57.808246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.808251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.808252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.808254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:57.808302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:57.808308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.808314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.808320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.808330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:57.808349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302690044:2438], now have 1 active actors on pipe
2025-10-10T14:31:57.808358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600788520480061:4006]
2025-10-10T14:31:57.808360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600788520480061:4006]
2025-10-10T14:31:57.808361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600788520480061:4006]
2025-10-10T14:31:57.808370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:57.808377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302690254:4722], now have 1 active actors on pipe
2025-10-10T14:31:57.808387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:57.808387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:57.808389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:57.808391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:57.808401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:57.808406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:57.808426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600788520480061:4006]
2025-10-10T14:31:57.808425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 385
2025-10-10T14:31:57.808434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:57.808436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:57.808442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 385
2025-10-10T14:31:57.808461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.808468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.808496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:57.808507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.808511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.808513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:57.808524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.808537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:57.808554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.808685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.808694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.808711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.808825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 386 partition: 0 MaxSeqNo: 40 sessionId: src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0
2025-10-10T14:31:57.809222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f6c23-31b103c0-9e727fe-26f820cd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:57.811893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0] Write session: try to update token
2025-10-10T14:31:57.811913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:57.826054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId: src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:57.826111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:57.826128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.826131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:57.826133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:57.826142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600788520480061:4006]
2025-10-10T14:31:57.826146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600788520480061:4006]
2025-10-10T14:31:57.826150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600788520480061:4006]
2025-10-10T14:31:57.826187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:57.826196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:57.826197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:57.826203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.826206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:57.826211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:57.826345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:57.829565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:57.889765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600789302690261:4235]
2025-10-10T14:31:57.890089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 385, pipe: [1:7559600789302690261:4235]
2025-10-10T14:31:57.929886Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:57.930519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.930533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.930577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302690261:4235], now have 1 active actors on pipe
2025-10-10T14:31:57.930859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:57.930870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:57.930886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600789302690261:4235]
2025-10-10T14:31:57.930919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:57.930929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 386 reason: error at write: Disconnected sessionId: src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0
2025-10-10T14:31:57.930999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:57.931100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 386 sessionId: src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0 is DEAD
2025-10-10T14:31:57.931239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:57.931248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0] Write session will restart in 0.009397s
2025-10-10T14:31:57.931267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0] Write session: Do CDS request
2025-10-10T14:31:57.931272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:57.941889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.941949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:57.941962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 387
2025-10-10T14:31:57.942147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:57.942205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:57.942219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:57.942229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:57.942747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 387 sessionId:  describe result for acl check
2025-10-10T14:31:57.942803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:57.942811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:57.942813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:57.942820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600789302690437:4726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:57.943247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:57.943464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600789302690437:4726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:57.945495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600789302690437:4726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:57.945609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:57.945818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:57.945831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:57.945845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:57.945910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:57.945965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600788520480280:4008]
2025-10-10T14:31:57.946577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:57.946792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:57.946843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:57.947179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:57.947251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.947258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.947259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.947260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.947261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.947263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.947264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.947265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.947267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.947268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.947269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.947270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.947271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.947277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.947288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.947293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.947297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.947301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.947305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.947309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.947313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.947317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.947322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.947326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.947330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.947334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.947341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.947349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:57.947356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.947362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:57.947366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.947372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:57.947382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.947388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:57.947397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.947403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:57.947409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.947414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:57.947418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.947424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:57.947428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.947433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:57.947443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.947448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:57.947455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.947460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:57.947466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.947476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.947480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.947490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.947497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.947506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.947546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:57.948206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600789302690437:4726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:57.948217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600789302690437:4726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:57.948221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600789302690437:4726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:57.948228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:57.949690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:57.950024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:57.950037Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:57.950040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:57.950043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:57.950049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 386 [2:7559600788520480280:4008]
2025-10-10T14:31:57.950067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:57.950088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:57.950096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.950099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.950101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.950117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:57.950127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:57.950140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:57.950197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.950205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.950207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.950209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:57.950378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 386
2025-10-10T14:31:57.950384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 386
2025-10-10T14:31:57.950281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:57.950294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.950305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:57.950318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:57.950335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:57.950359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302690262:2438], now have 1 active actors on pipe
2025-10-10T14:31:57.950363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600789302690472:4726], now have 1 active actors on pipe
2025-10-10T14:31:57.950371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600788520480275:4008]
2025-10-10T14:31:57.950373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600788520480275:4008]
2025-10-10T14:31:57.950376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600788520480275:4008]
2025-10-10T14:31:57.950391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:57.950406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:57.950407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:57.950411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:57.950413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:57.950422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:57.950425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:57.950446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600788520480275:4008]
2025-10-10T14:31:57.950449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:57.950457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:57.950838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.950853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.950888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d480c630-3ae5444c-a03d79d1-32cca469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:57.950897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:57.950902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:57.950904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:57.950916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:57.950930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:57.950946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.951278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.951294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.951316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:57.951418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 387 partition: 0 MaxSeqNo: 40 sessionId: src_id|d480c630-3ae5444c-a03d79d1-32cca469_0
2025-10-10T14:31:57.951808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7dec76-d19e8f0-6c4ac45e-f5a93f99_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d480c630-3ae5444c-a03d79d1-32cca469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:57.954432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d480c630-3ae5444c-a03d79d1-32cca469_0] Write session: try to update token
2025-10-10T14:31:57.954448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d480c630-3ae5444c-a03d79d1-32cca469_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:57.962165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:57.962182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.962193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600788520480275:4008]
2025-10-10T14:31:57.962243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:57.962251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:57.962408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:57.962552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:57.962690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:57.962827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:57.963019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:57.963064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:57.968222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId: src_id|d480c630-3ae5444c-a03d79d1-32cca469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:57.970723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:57.970905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:57.970927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:57.970968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:57.971049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:57.979548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:57.979561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:57.979564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:57.979565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:57.979573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600788520480275:4008]
2025-10-10T14:31:57.979577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600788520480275:4008]
2025-10-10T14:31:57.979580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600788520480275:4008]
2025-10-10T14:31:57.979614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:57.979623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:57.979623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:57.979625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:57.979627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:57.979630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:57.979734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:58.031057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600793597657776:4235]
2025-10-10T14:31:58.031321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 386, pipe: [1:7559600793597657776:4235]
2025-10-10T14:31:58.082015Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:58.089211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.089234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.089425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.089482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.089539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.089604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.089965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.089980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.090061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.090125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.090185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.090243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.090284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.090289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.090352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.090413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.090470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.090542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.090584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.090586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.090665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.090724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.090783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.090840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.090889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.090897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.090973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.091028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.091087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.091151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.091194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.091200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.091260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.091350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.091412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.091468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.091509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.091514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.091576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.091633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.091695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.091753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.091809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.091814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.091885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.091952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.092012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.092079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.092132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.092137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.092205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.092260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.092317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.092376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.092429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.092437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.092500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.092556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.092616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.092681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.092722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.092727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.092782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597657776:4235], now have 1 active actors on pipe
2025-10-10T14:31:58.093032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:58.093039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:58.093047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:58.093080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 387 reason: error at write: Disconnected sessionId: src_id|d480c630-3ae5444c-a03d79d1-32cca469_0
2025-10-10T14:31:58.093085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600793597657776:4235]
2025-10-10T14:31:58.093161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:58.093312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 387 sessionId: src_id|d480c630-3ae5444c-a03d79d1-32cca469_0 is DEAD
2025-10-10T14:31:58.093479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d480c630-3ae5444c-a03d79d1-32cca469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:58.093494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d480c630-3ae5444c-a03d79d1-32cca469_0] Write session will restart in 0.005950s
2025-10-10T14:31:58.093522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d480c630-3ae5444c-a03d79d1-32cca469_0] Write session: Do CDS request
2025-10-10T14:31:58.093527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d480c630-3ae5444c-a03d79d1-32cca469_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:58.100889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d480c630-3ae5444c-a03d79d1-32cca469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.101008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:58.101022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 388
2025-10-10T14:31:58.101127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.101154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:58.101158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:58.101162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:58.101859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 388 sessionId:  describe result for acl check
2025-10-10T14:31:58.101898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:58.101905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:58.101907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:58.101913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600793597657835:4730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:58.102466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600793597657835:4730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:58.105106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600793597657835:4730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:58.106966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:58.107380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600793597657835:4730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:58.107391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600793597657835:4730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:58.107394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600793597657835:4730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:58.107400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:58.109084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:58.109257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:58.109267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:58.109276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:58.109317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:58.109374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600792815447793:4010]
2025-10-10T14:31:58.109845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:58.110075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:58.110117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:58.110415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:58.110466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.110472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.110473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.110475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.110476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.110477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.110478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.110479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.110480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.110481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.110482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.110483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.110484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.110499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.110511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.110515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.110520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.110523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.110528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.110531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.110535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.110539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.110542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.110546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.110550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.110554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.110561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.110569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.110576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.110586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.110594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.110599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.110603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.110612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.110620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.110629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.110633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.110642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.110651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.110660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.110668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.110675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.110683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.110689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.110699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.110708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.110717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.110722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.110731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.110736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.110744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.110748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.110785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:58.112831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:58.113122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:58.113132Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:58.113135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:58.113139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:58.113144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 387 [2:7559600792815447793:4010]
2025-10-10T14:31:58.113152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:58.113168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:58.113173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.113176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.113177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.113190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:58.113198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:58.113208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:58.113249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.113253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.113254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.113256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:58.113311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:58.113319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.113345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.113361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.113377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:58.113402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597657984:4730], now have 1 active actors on pipe
2025-10-10T14:31:58.113408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597657777:2438], now have 1 active actors on pipe
2025-10-10T14:31:58.113413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600792815447787:4010]
2025-10-10T14:31:58.113415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600792815447787:4010]
2025-10-10T14:31:58.113416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600792815447787:4010]
2025-10-10T14:31:58.113426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:58.113435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 387
2025-10-10T14:31:58.113442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:58.113444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 387
2025-10-10T14:31:58.113449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:58.113452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:58.113454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:58.113462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:58.113465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:58.113484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600792815447787:4010]
2025-10-10T14:31:58.113487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:58.113492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:58.113502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.113506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.113555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85e5b8f0-3128723-46afb348-455d7f56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:58.113566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.113570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.113573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:58.113583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.113597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:58.113618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.113734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.113744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.113759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.113885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 388 partition: 0 MaxSeqNo: 40 sessionId: src_id|85e5b8f0-3128723-46afb348-455d7f56_0
2025-10-10T14:31:58.114241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d480c630-3ae5444c-a03d79d1-32cca469_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|85e5b8f0-3128723-46afb348-455d7f56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:58.116869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e5b8f0-3128723-46afb348-455d7f56_0] Write session: try to update token
2025-10-10T14:31:58.116884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e5b8f0-3128723-46afb348-455d7f56_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:58.130624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId: src_id|85e5b8f0-3128723-46afb348-455d7f56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:58.130977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:58.130996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:58.130999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:58.131001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:58.131009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600792815447787:4010]
2025-10-10T14:31:58.131013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600792815447787:4010]
2025-10-10T14:31:58.131018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600792815447787:4010]
2025-10-10T14:31:58.131054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:58.131065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:58.131065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:58.131068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:58.131073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.131075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:58.131205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:58.133042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:58.193348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600793597658008:4235]
2025-10-10T14:31:58.193607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 387, pipe: [1:7559600793597658008:4235]
2025-10-10T14:31:58.232990Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:58.233531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.233546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.233593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658008:4235], now have 1 active actors on pipe
2025-10-10T14:31:58.233843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:58.233854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:58.233856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:58.233898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600793597658008:4235]
2025-10-10T14:31:58.233916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 388 reason: error at write: Disconnected sessionId: src_id|85e5b8f0-3128723-46afb348-455d7f56_0
2025-10-10T14:31:58.233941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:58.234098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 388 sessionId: src_id|85e5b8f0-3128723-46afb348-455d7f56_0 is DEAD
2025-10-10T14:31:58.234252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e5b8f0-3128723-46afb348-455d7f56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:58.234264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e5b8f0-3128723-46afb348-455d7f56_0] Write session will restart in 0.007235s
2025-10-10T14:31:58.234288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e5b8f0-3128723-46afb348-455d7f56_0] Write session: Do CDS request
2025-10-10T14:31:58.234294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e5b8f0-3128723-46afb348-455d7f56_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:58.242821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e5b8f0-3128723-46afb348-455d7f56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.242912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:58.242924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 389
2025-10-10T14:31:58.243051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.243091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:58.243100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:58.243104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:58.243516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 389 sessionId:  describe result for acl check
2025-10-10T14:31:58.243565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:58.243566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:58.243568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:58.243574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600793597658145:4735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:58.244072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600793597658145:4735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:58.245868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600793597658145:4735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:58.245906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:58.247923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:58.248028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600793597658145:4735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:58.248043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600793597658145:4735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:58.248047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600793597658145:4735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:58.248054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:58.248104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:58.248115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:58.248127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:58.248180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:58.248218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600792815448021:4013]
2025-10-10T14:31:58.248811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:58.249057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:58.249098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:58.249419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:58.249468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.249475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.249476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.249477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.249478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.249479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.249480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.249482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.249483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.249484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.249485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.249486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.249487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.249493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.249506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.249510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.249515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.249519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.249523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.249527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.249531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.249534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.249538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.249542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.249546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.249550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.249556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.249565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.249572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.249577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.249581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.249587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.249596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.249602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.249606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.249612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.249620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.249626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.249635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.249641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.249645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.249650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.249661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.249666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.249670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.249675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.249687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.249693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.249697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.249702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.249707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.249712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.249753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:58.251918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:58.252236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:58.252247Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:58.252250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:58.252254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:58.252259Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 388 [2:7559600792815448021:4013]
2025-10-10T14:31:58.252270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:58.252286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:58.252294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.252297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.252299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.252315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:58.252327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:58.252339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:58.252385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.252391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.252393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.252395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:58.252455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:58.252461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.252473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.252490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.252512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:58.252536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658217:4735], now have 1 active actors on pipe
2025-10-10T14:31:58.252544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658009:2438], now have 1 active actors on pipe
2025-10-10T14:31:58.252551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600792815448016:4013]
2025-10-10T14:31:58.252557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600792815448016:4013]
2025-10-10T14:31:58.252559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600792815448016:4013]
2025-10-10T14:31:58.252573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:58.252561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 388
2025-10-10T14:31:58.252561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 388
2025-10-10T14:31:58.252587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:58.252588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:58.252591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:58.252593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:58.252608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:58.252611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:58.252645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.252653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.252668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600792815448016:4013]
2025-10-10T14:31:58.252679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:58.252697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:58.252708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc600cc0-d5a5960c-361bbdce-62246373_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:58.252715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.252724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.252726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:58.252737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.252751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:58.252774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.252893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.252903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.252918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.253009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 389 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc600cc0-d5a5960c-361bbdce-62246373_0
2025-10-10T14:31:58.253353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e5b8f0-3128723-46afb348-455d7f56_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc600cc0-d5a5960c-361bbdce-62246373_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:58.256057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc600cc0-d5a5960c-361bbdce-62246373_0] Write session: try to update token
2025-10-10T14:31:58.256077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc600cc0-d5a5960c-361bbdce-62246373_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:58.270195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId: src_id|fc600cc0-d5a5960c-361bbdce-62246373_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:58.270777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:58.270792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:58.270795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:58.270797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:58.270806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600792815448016:4013]
2025-10-10T14:31:58.270810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600792815448016:4013]
2025-10-10T14:31:58.270814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600792815448016:4013]
2025-10-10T14:31:58.270853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:58.270862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:58.270863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:58.270866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:58.270870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.270873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:58.271008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:58.272608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:58.334118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600793597658229:4235]
2025-10-10T14:31:58.334381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 388, pipe: [1:7559600793597658229:4235]
2025-10-10T14:31:58.371636Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:58.372078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.372094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.372132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658229:4235], now have 1 active actors on pipe
2025-10-10T14:31:58.372282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:58.372318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600793597658229:4235]
2025-10-10T14:31:58.372342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:58.372361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:58.372444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 389 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc600cc0-d5a5960c-361bbdce-62246373_0
2025-10-10T14:31:58.372644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 389 sessionId: src_id|fc600cc0-d5a5960c-361bbdce-62246373_0 is DEAD
2025-10-10T14:31:58.372813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc600cc0-d5a5960c-361bbdce-62246373_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:58.372822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc600cc0-d5a5960c-361bbdce-62246373_0] Write session will restart in 0.007039s
2025-10-10T14:31:58.372846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc600cc0-d5a5960c-361bbdce-62246373_0] Write session: Do CDS request
2025-10-10T14:31:58.372853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc600cc0-d5a5960c-361bbdce-62246373_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:58.380822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc600cc0-d5a5960c-361bbdce-62246373_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.380914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:58.380926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 390
2025-10-10T14:31:58.381049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.381076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:58.381082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:58.381086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:58.381583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 390 sessionId:  describe result for acl check
2025-10-10T14:31:58.381628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:58.381637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:58.381639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:58.381644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600793597658320:4739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:58.382152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600793597658320:4739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:58.384337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600793597658320:4739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:58.385579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:58.387465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:58.387631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:58.387642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:58.387654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:58.387714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:58.387752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600792815448252:4021]
2025-10-10T14:31:58.387771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600793597658320:4739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:58.387785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600793597658320:4739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:58.387788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600793597658320:4739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:58.387796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:58.388337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:58.388572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:58.388611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:58.388910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:58.388949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.388957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.388958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.388959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.388960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.388961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.388962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.388964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.388965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.388966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.388967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.388968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.388969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.388975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.388983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.388985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.388987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.388989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.388991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.388993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.388995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.388997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.388999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.389001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.389003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.389005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.389027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.389033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.389037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.389040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.389043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.389046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.389049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.389052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.389054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.389057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.389061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.389064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.389066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.389069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.389073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.389076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.389084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.389087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.389089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.389093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.389096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.389098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.389101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.389104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.389111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.389114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.389136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:58.391322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:58.391748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:58.391759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:58.391760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:58.391764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:58.391769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 389 [2:7559600792815448252:4021]
2025-10-10T14:31:58.391780Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:58.391796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:58.391798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.391800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.391801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.391813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:58.391822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:58.391828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:58.391870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.391875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.391876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.391877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:58.391920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:58.391927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.391934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.391940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.391950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:58.391970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658230:2438], now have 1 active actors on pipe
2025-10-10T14:31:58.391986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600792815448247:4021]
2025-10-10T14:31:58.391988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600792815448247:4021]
2025-10-10T14:31:58.391990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600792815448247:4021]
2025-10-10T14:31:58.392002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:58.392010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658451:4739], now have 1 active actors on pipe
2025-10-10T14:31:58.392011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:58.392012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:58.392013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:58.392018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:58.392041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:58.392048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:58.392068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600792815448247:4021]
2025-10-10T14:31:58.392064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 389
2025-10-10T14:31:58.392076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:58.392077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:58.392106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 389
2025-10-10T14:31:58.392178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.392187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.392209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1673383-b0911593-a13a8908-6f7aca7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:58.392220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.392223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.392224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:58.392233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.392241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:58.392254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.392407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.392415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.392430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.392506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 390 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1673383-b0911593-a13a8908-6f7aca7f_0
2025-10-10T14:31:58.392832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc600cc0-d5a5960c-361bbdce-62246373_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1673383-b0911593-a13a8908-6f7aca7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:58.395386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1673383-b0911593-a13a8908-6f7aca7f_0] Write session: try to update token
2025-10-10T14:31:58.395400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1673383-b0911593-a13a8908-6f7aca7f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:58.402359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:31:58.402373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:58.402382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600792815448247:4021]
2025-10-10T14:31:58.402413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:31:58.402426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:31:58.402596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:31:58.402725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:58.402852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:58.403007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:31:58.403495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:31:58.403548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:31:58.408279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId: src_id|b1673383-b0911593-a13a8908-6f7aca7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:58.410581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:58.410776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.410796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.410832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:58.410916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:58.418524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:58.418537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:58.418538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:58.418540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:58.418546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600792815448247:4021]
2025-10-10T14:31:58.418548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600792815448247:4021]
2025-10-10T14:31:58.418550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600792815448247:4021]
2025-10-10T14:31:58.418581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:58.418584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:58.418587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.418589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:58.418589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:58.418593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:58.418700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:58.472380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600793597658475:4235]
2025-10-10T14:31:58.472575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 389, pipe: [1:7559600793597658475:4235]
2025-10-10T14:31:58.523377Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:58.530074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.530097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.530243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.530297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.530353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.530417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.530464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.530473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.530548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.530603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.530659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.530717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.530756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.530761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.530822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.530877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.530931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.530986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.531025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.531035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.531092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.531150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.531206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.531280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.531319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.531325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.531391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.531443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.531497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.531552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.531591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.531597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.531655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.531709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.531765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.531819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.531861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.531868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.531924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.531980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.532051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.532109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.532150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.532155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.532213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.532267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.532328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.532401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.532441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.532447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.532520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.532578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.532631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.532686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.532725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.532730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.532788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:31:58.532840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:31:58.532892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:31:58.532948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:31:58.533002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:31:58.533008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:31:58.533046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658475:4235], now have 1 active actors on pipe
2025-10-10T14:31:58.533288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:58.533292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600793597658475:4235]
2025-10-10T14:31:58.533302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:58.533341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 390 reason: error at write: Disconnected sessionId: src_id|b1673383-b0911593-a13a8908-6f7aca7f_0
2025-10-10T14:31:58.533341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:58.533531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 390 sessionId: src_id|b1673383-b0911593-a13a8908-6f7aca7f_0 is DEAD
2025-10-10T14:31:58.533717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1673383-b0911593-a13a8908-6f7aca7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:58.533730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1673383-b0911593-a13a8908-6f7aca7f_0] Write session will restart in 0.006971s
2025-10-10T14:31:58.533756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1673383-b0911593-a13a8908-6f7aca7f_0] Write session: Do CDS request
2025-10-10T14:31:58.533762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1673383-b0911593-a13a8908-6f7aca7f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:58.533859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:58.541875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1673383-b0911593-a13a8908-6f7aca7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.541951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:58.541964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 391
2025-10-10T14:31:58.542106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.542133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:58.542141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:58.542144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:58.542549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 391 sessionId:  describe result for acl check
2025-10-10T14:31:58.542584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:58.542590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:58.542591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:58.542596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600793597658571:4752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:58.543053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600793597658571:4752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:58.545604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600793597658571:4752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:58.546583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:58.548442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:58.548633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:58.548643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:58.548654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:58.548706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:58.548745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600792815448496:4030]
2025-10-10T14:31:58.548889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600793597658571:4752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:58.548900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600793597658571:4752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:58.548902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600793597658571:4752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:58.548910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:58.549168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:58.549435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:58.549467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:58.549674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:58.549710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.549715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.549715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.549716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.549717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.549718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.549718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.549719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.549720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.549721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.549722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.549722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.549723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.549727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.549736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.549739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.549741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.549743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.549745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.549747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.549749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.549751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.549753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.549755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.549757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.549759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.549765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.549770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.549775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.549778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.549781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.549784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.549786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.549789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.549792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.549795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.549797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.549800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.549803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.549806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.549810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.549813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.549815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.549818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.549822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.549825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.549828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.549830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.549836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.549839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.549842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.549845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.549869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:58.551961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:58.552275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:58.552285Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:58.552288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:58.552291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:58.552301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 390 [2:7559600792815448496:4030]
2025-10-10T14:31:58.552317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:58.552339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:58.552346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.552349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.552352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.552371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:58.552382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:58.552394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:58.552448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.552454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.552456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.552458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:58.552523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:58.552530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.552540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.552556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.552579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:58.552600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658476:2438], now have 1 active actors on pipe
2025-10-10T14:31:58.552607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658695:4752], now have 1 active actors on pipe
2025-10-10T14:31:58.552614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600792815448491:4030]
2025-10-10T14:31:58.552617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600792815448491:4030]
2025-10-10T14:31:58.552619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600792815448491:4030]
2025-10-10T14:31:58.552607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 390
2025-10-10T14:31:58.552627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 390
2025-10-10T14:31:58.552633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:58.552647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:58.552651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:58.552654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:58.552655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:58.552667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:58.552670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:58.552700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.552708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.552727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600792815448491:4030]
2025-10-10T14:31:58.552738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:58.552748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:58.552765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:58.552776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.552780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.552782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:58.552792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.552806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:58.552831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.552955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.552965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.552981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.553079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 391 partition: 0 MaxSeqNo: 40 sessionId: src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0
2025-10-10T14:31:58.553485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1673383-b0911593-a13a8908-6f7aca7f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:58.556109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0] Write session: try to update token
2025-10-10T14:31:58.556125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:58.570133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId: src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:58.570903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:58.570919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:58.570922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:58.570924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:58.570934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600792815448491:4030]
2025-10-10T14:31:58.570938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600792815448491:4030]
2025-10-10T14:31:58.570942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600792815448491:4030]
2025-10-10T14:31:58.570985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:58.570990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:58.570996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:58.570997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.571000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:58.571000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:58.571131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:58.572668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:58.633663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600793597658711:4235]
2025-10-10T14:31:58.633890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 390, pipe: [1:7559600793597658711:4235]
2025-10-10T14:31:58.679860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:58.680469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.680482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.680521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658711:4235], now have 1 active actors on pipe
2025-10-10T14:31:58.680696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:58.680735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600793597658711:4235]
2025-10-10T14:31:58.680750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:58.680764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:58.680843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 391 reason: status is not ok: tablet will be restarted right now sessionId: src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0
2025-10-10T14:31:58.681026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 391 sessionId: src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0 is DEAD
2025-10-10T14:31:58.681209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:58.681222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0] Write session will restart in 0.005003s
2025-10-10T14:31:58.681249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0] Write session: Do CDS request
2025-10-10T14:31:58.681255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:58.687800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.687895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:58.687906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 392
2025-10-10T14:31:58.688025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.688062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:58.688069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:58.688073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:58.688427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 392 sessionId:  describe result for acl check
2025-10-10T14:31:58.688457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:58.688464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:58.688465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:58.688470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600793597658754:4758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:58.688950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600793597658754:4758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:58.691861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600793597658754:4758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:58.693855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:58.695501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600793597658754:4758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:58.695510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600793597658754:4758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:58.695513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600793597658754:4758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:58.695518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:58.695560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:58.695724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:58.695735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:58.695745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:58.695795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:58.695831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600792815448719:4033]
2025-10-10T14:31:58.696409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:58.696641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:58.696678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:58.696979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:58.697034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.697040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.697041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.697042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.697043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.697044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.697046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.697047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.697048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.697049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.697050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.697051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.697052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.697057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.697071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.697075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.697079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.697083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.697087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.697091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.697095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.697098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.697107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.697111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.697117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.697121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.697128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.697140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.697146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.697153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.697157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.697163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.697172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.697178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.697186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.697198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.697202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.697208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.697217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.697226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.697230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.697239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.697245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.697250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.697258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.697263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.697268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.697273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.697278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.697284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.697289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.697295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.697351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:58.699363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:58.699630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:58.699638Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:58.699639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:58.699642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:58.699645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 391 [2:7559600792815448719:4033]
2025-10-10T14:31:58.699653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:58.699664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:58.699669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.699670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.699671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.699680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:58.699688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:58.699698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:58.699740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.699747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.699749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.699751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:58.699801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:58.699807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.699813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.699820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.699829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:58.699844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658713:2438], now have 1 active actors on pipe
2025-10-10T14:31:58.699850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658924:4758], now have 1 active actors on pipe
2025-10-10T14:31:58.699855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600792815448713:4033]
2025-10-10T14:31:58.699860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600792815448713:4033]
2025-10-10T14:31:58.699861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600792815448713:4033]
2025-10-10T14:31:58.699872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:58.699884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:58.699888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:58.699891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:58.699893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:58.699898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:58.699900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:58.699905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 391
2025-10-10T14:31:58.699907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 391
2025-10-10T14:31:58.699918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600792815448713:4033]
2025-10-10T14:31:58.699927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:58.699933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:58.699948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.699953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.699991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:58.700003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.700007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.700009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:58.700018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.700026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:58.700043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.700189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.700196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.700210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.700288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 392 partition: 0 MaxSeqNo: 40 sessionId: src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0
2025-10-10T14:31:58.700548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|694a0d21-86cd00ab-fa23aaeb-be385bfa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:58.703043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0] Write session: try to update token
2025-10-10T14:31:58.703070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:58.716017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId: src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:58.717719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:58.717736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:58.717738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:58.717740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:58.717748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600792815448713:4033]
2025-10-10T14:31:58.717751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600792815448713:4033]
2025-10-10T14:31:58.717754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600792815448713:4033]
2025-10-10T14:31:58.717795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:58.717805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.717807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:58.717807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:58.717812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:58.717815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:58.717937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:58.718413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:58.781112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600793597658935:4235]
2025-10-10T14:31:58.781290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 391, pipe: [1:7559600793597658935:4235]
2025-10-10T14:31:58.819181Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:58.819419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.819431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.819469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658935:4235], now have 1 active actors on pipe
2025-10-10T14:31:58.819656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:58.819669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:58.819670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600793597658935:4235]
2025-10-10T14:31:58.819689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:58.819691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:58.819747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 392 reason: error at write: Disconnected sessionId: src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0
2025-10-10T14:31:58.819955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 392 sessionId: src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0 is DEAD
2025-10-10T14:31:58.820129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:58.820142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0] Write session will restart in 0.007291s
2025-10-10T14:31:58.820166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0] Write session: Do CDS request
2025-10-10T14:31:58.820179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:58.828959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.828984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:58.828996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 393
2025-10-10T14:31:58.829165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.829210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:58.829218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:58.829222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:58.829606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 393 sessionId:  describe result for acl check
2025-10-10T14:31:58.829633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:58.829638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:58.829640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:58.829647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600793597659058:4762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:58.830095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600793597659058:4762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:58.832022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600793597659058:4762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:58.833904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:58.834232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:58.834325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600793597659058:4762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:58.834335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600793597659058:4762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:58.834338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600793597659058:4762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:58.834345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:58.834378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:58.834390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:58.834401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:58.834445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:58.834486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600792815448939:4035]
2025-10-10T14:31:58.835091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:58.835343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:58.835380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:58.835692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:58.835740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.835746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.835748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.835749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.835750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.835751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.835752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.835753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.835755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.835759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.835760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.835761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.835762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.835766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.835774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.835776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.835778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.835780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.835783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.835785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.835787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.835789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.835791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.835793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.835795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.835797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.835802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.835807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.835812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.835816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.835818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.835821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.835824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.835827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.835830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.835833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.835835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.835838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.835841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.835844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.835846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.835849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.835852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.835855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.835857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.835861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.835863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.835866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.835868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.835872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.835875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.835877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.835900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:58.838058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:58.838353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:58.838363Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:58.838366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:58.838369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:58.838375Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 392 [2:7559600792815448939:4035]
2025-10-10T14:31:58.838385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:58.838406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:58.838413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.838417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.838423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.838439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:58.838452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:58.838463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:58.838527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.838534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.838536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.838538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:58.838598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:58.838608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.838619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.838632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.838650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:58.838676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597659149:4762], now have 1 active actors on pipe
2025-10-10T14:31:58.838685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597658937:2438], now have 1 active actors on pipe
2025-10-10T14:31:58.838692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600792815448934:4035]
2025-10-10T14:31:58.838699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600792815448934:4035]
2025-10-10T14:31:58.838701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600792815448934:4035]
2025-10-10T14:31:58.838709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:58.838690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 392
2025-10-10T14:31:58.838700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 392
2025-10-10T14:31:58.838722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:58.838730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:58.838732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:58.838733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:58.838744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:58.838748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:58.838783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.838793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.838807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600792815448934:4035]
2025-10-10T14:31:58.838815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:58.838824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:58.838848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:58.838859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.838866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.838869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:58.838879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.838892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:58.838915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.839048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.839057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.839074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.839132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 393 partition: 0 MaxSeqNo: 40 sessionId: src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0
2025-10-10T14:31:58.839454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78c543fe-d2054f1b-d916a56a-efe66bf0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:58.841986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0] Write session: try to update token
2025-10-10T14:31:58.842002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:58.855689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId: src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:58.858154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:58.858173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:58.858176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:58.858178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:58.858188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600792815448934:4035]
2025-10-10T14:31:58.858192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600792815448934:4035]
2025-10-10T14:31:58.858196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600792815448934:4035]
2025-10-10T14:31:58.858201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:58.858248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:58.858248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:58.858254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:58.858258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:58.858264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.858267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:58.858467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:58.919867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600793597659160:4235]
2025-10-10T14:31:58.920120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 392, pipe: [1:7559600793597659160:4235]
2025-10-10T14:31:58.966015Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:58.966510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.966526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.966566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597659160:4235], now have 1 active actors on pipe
2025-10-10T14:31:58.966723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:58.966788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:58.966791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600793597659160:4235]
2025-10-10T14:31:58.966802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:58.966809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:58.966862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 393 reason: error at write: Disconnected sessionId: src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0
2025-10-10T14:31:58.967046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 393 sessionId: src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0 is DEAD
2025-10-10T14:31:58.967239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:58.967262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0] Write session will restart in 0.006401s
2025-10-10T14:31:58.967287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0] Write session: Do CDS request
2025-10-10T14:31:58.967293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:58.974814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.974914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:58.974929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 394
2025-10-10T14:31:58.975051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:58.975086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:58.975096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:58.975100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:58.975502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 394 sessionId:  describe result for acl check
2025-10-10T14:31:58.975532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:58.975537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:58.975538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:58.975543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600793597659226:4766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:58.975970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600793597659226:4766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:58.978346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600793597659226:4766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:58.979821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:58.981836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:58.982010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600793597659226:4766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:58.982021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600793597659226:4766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:58.982010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:58.982024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600793597659226:4766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:58.982023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:58.982035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:58.982029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:58.982084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:58.982124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600792815449160:4037]
2025-10-10T14:31:58.982607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:58.982873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:58.982916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:58.983130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:58.983176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.983182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.983184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.983185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.983186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.983187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.983188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.983189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.983190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.983191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.983193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.983194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.983195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.983200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.983211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.983213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.983216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.983218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.983220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.983221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.983223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.983226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.983228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.983230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.983232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.983234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.983238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.983244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:58.983253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.983256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:58.983258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.983261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:58.983264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.983267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:58.983270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.983276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:58.983280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.983282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:58.983287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.983289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:58.983292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.983294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:58.983299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.983302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:58.983304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.983307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:58.983309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.983312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.983315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.983318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.983320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.983323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.983344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:58.985411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:58.985774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:58.985782Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:58.985783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:58.985785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:58.985789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 393 [2:7559600792815449160:4037]
2025-10-10T14:31:58.985797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:58.985809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:58.985811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.985814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.985816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.985828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:58.985836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:58.985846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:58.985884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.985888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.985889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.985891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:58.985935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:58.985942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:58.985948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:58.985959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:58.985975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:58.985998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597659375:4766], now have 1 active actors on pipe
2025-10-10T14:31:58.986010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600792815449155:4037]
2025-10-10T14:31:58.986013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600792815449155:4037]
2025-10-10T14:31:58.986015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600792815449155:4037]
2025-10-10T14:31:58.986027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:58.986041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600793597659164:2438], now have 1 active actors on pipe
2025-10-10T14:31:58.986043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:58.986046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:58.986048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:58.986050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:58.986059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:58.986061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:58.986048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 393
2025-10-10T14:31:58.986063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 393
2025-10-10T14:31:58.986074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600792815449155:4037]
2025-10-10T14:31:58.986080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:58.986082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:58.986093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.986097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.986134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:58.986143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:58.986146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:58.986147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:58.986154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:58.986163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:58.986178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.986296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:58.986302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:58.986313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:58.986380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 394 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0
2025-10-10T14:31:58.986689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f44b1-371bd20c-19ee2edb-9ea59853_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:58.989118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0] Write session: try to update token
2025-10-10T14:31:58.989132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:59.001863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId: src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:59.004326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:59.004461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:59.004478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:59.004481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:59.004483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:59.004492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600792815449155:4037]
2025-10-10T14:31:59.004497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600792815449155:4037]
2025-10-10T14:31:59.004500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600792815449155:4037]
2025-10-10T14:31:59.004540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:59.004550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:59.004552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:59.004557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.004565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.004591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:59.004601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.004604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:59.004735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:59.066818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600797892626682:4235]
2025-10-10T14:31:59.067047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 393, pipe: [1:7559600797892626682:4235]
2025-10-10T14:31:59.111521Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:59.111935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892626682:4235], now have 1 active actors on pipe
2025-10-10T14:31:59.112118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:59.112170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:59.112186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600797892626682:4235]
2025-10-10T14:31:59.112206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:59.112283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 394 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0
2025-10-10T14:31:59.112465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 394 sessionId: src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0 is DEAD
2025-10-10T14:31:59.112630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:59.112641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0] Write session will restart in 0.007476s
2025-10-10T14:31:59.112666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0] Write session: Do CDS request
2025-10-10T14:31:59.112673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:59.120872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.120958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:59.120973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 395
2025-10-10T14:31:59.121107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.121143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:59.121153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:59.121161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:59.121611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 395 sessionId:  describe result for acl check
2025-10-10T14:31:59.121640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:59.121641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:59.121643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:59.121647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600797892626775:4770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:59.122089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600797892626775:4770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:59.124079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600797892626775:4770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:59.125280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:59.127339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:59.127527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600797892626775:4770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:59.127542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600797892626775:4770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:59.127544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600797892626775:4770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:59.127551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:59.127528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:59.127538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:59.127550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:59.127605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:59.127647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600797110416691:4039]
2025-10-10T14:31:59.128130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:59.128362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:59.128391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:59.128603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:59.128638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.128644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.128645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.128645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.128646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.128647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.128647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.128648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.128648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.128649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.128650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.128650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.128651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.128655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.128662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.128665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.128667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.128670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.128672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.128674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.128676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.128679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.128681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.128683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.128686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.128688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.128693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.128698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.128703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.128707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.128709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.128713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.128715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.128718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.128721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.128724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.128727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.128730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.128733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.128736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.128740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.128743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.128746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.128748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.128751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.128754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.128756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.128759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.128762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.128765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.128768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.128772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.128809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:59.131046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:59.131337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:59.131348Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:59.131351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:59.131354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:59.131360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 394 [2:7559600797110416691:4039]
2025-10-10T14:31:59.131372Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:59.131394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:59.131403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.131406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.131409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.131424Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:59.131438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:59.131449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:59.131493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.131498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.131499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.131501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:59.131546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:59.131552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.131559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.131566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.131579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:59.131596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892626683:2438], now have 1 active actors on pipe
2025-10-10T14:31:59.131602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892626910:4770], now have 1 active actors on pipe
2025-10-10T14:31:59.131609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600797110416674:4039]
2025-10-10T14:31:59.131611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600797110416674:4039]
2025-10-10T14:31:59.131613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600797110416674:4039]
2025-10-10T14:31:59.131625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:59.131641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:59.131640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:59.131643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:59.131645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:59.131660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:59.131663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:59.131674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 394
2025-10-10T14:31:59.131676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 394
2025-10-10T14:31:59.131684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600797110416674:4039]
2025-10-10T14:31:59.131698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:59.131699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:59.131737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.131746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.131773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:59.131784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.131788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.131790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:59.131801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.131813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:59.131827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.131980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.131990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.132007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.132078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 395 partition: 0 MaxSeqNo: 40 sessionId: src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0
2025-10-10T14:31:59.132427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a2268-f43e1311-fd5fcfd6-55e81c01_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:59.134914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0] Write session: try to update token
2025-10-10T14:31:59.134929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:59.148458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId: src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:59.149799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:59.149817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:59.149820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:59.149822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:59.149833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600797110416674:4039]
2025-10-10T14:31:59.149837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600797110416674:4039]
2025-10-10T14:31:59.149841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600797110416674:4039]
2025-10-10T14:31:59.149891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:59.149891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:59.149897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:59.149901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:59.149903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.149906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:59.150050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:59.151110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:59.212188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600797892626922:4235]
2025-10-10T14:31:59.212516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 394, pipe: [1:7559600797892626922:4235]
2025-10-10T14:31:59.254313Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:59.254924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.254936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.254977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892626922:4235], now have 1 active actors on pipe
2025-10-10T14:31:59.255170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:59.255247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:59.255275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600797892626922:4235]
2025-10-10T14:31:59.255294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:59.255368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 395 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0
2025-10-10T14:31:59.255573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 395 sessionId: src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0 is DEAD
2025-10-10T14:31:59.255740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:59.255753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0] Write session will restart in 0.007669s
2025-10-10T14:31:59.255778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0] Write session: Do CDS request
2025-10-10T14:31:59.255785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:59.264833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.264942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:59.264957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 396
2025-10-10T14:31:59.265085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.265127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:59.265138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:59.265142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:59.265606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 396 sessionId:  describe result for acl check
2025-10-10T14:31:59.265639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:59.265645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:59.265646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:59.265650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600797892627057:4775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:59.266063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600797892627057:4775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:59.268015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600797892627057:4775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:59.268460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:59.270566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:59.270747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:59.270758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:59.270769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:59.270816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:59.270820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600797892627057:4775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:59.270837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600797892627057:4775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:59.270840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600797892627057:4775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:59.270850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:59.270856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600797110416914:4042]
2025-10-10T14:31:59.271446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:59.271715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:59.271756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:59.272067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:59.272117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.272123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.272124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.272125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.272126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.272127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.272128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.272130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.272131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.272132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.272134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.272135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.272136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.272142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.272154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.272159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.272163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.272167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.272171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.272175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.272179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.272183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.272188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.272192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.272196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.272200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.272207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.272215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.272223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.272233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.272241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.272246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.272255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.272260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.272265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.272276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.272280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.272285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.272289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.272298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.272302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.272307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.272312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.272321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.272325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.272330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.272338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.272343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.272347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.272357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.272363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.272372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.272416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:59.274685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:59.275069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:59.275079Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:59.275081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:59.275083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:59.275088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 395 [2:7559600797110416914:4042]
2025-10-10T14:31:59.275095Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:59.275107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:59.275113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.275115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.275117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.275129Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:59.275136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:59.275148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:59.275201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.275207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.275210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.275212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:59.275274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:59.275281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.275290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.275296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.275305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:59.275326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892626923:2438], now have 1 active actors on pipe
2025-10-10T14:31:59.275332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627138:4775], now have 1 active actors on pipe
2025-10-10T14:31:59.275338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600797110416909:4042]
2025-10-10T14:31:59.275344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600797110416909:4042]
2025-10-10T14:31:59.275346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600797110416909:4042]
2025-10-10T14:31:59.275359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:59.275372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:59.275368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 395
2025-10-10T14:31:59.275393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 395
2025-10-10T14:31:59.275388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:59.275388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:59.275392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:59.275394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:59.275397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:59.275431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.275439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.275454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600797110416909:4042]
2025-10-10T14:31:59.275465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:59.275482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:59.275495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|867e207c-1524852c-6dfcb444-87e0a185_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:59.275503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.275506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.275508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:59.275518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.275533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:59.275555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.275661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.275669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.275685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.275767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 396 partition: 0 MaxSeqNo: 40 sessionId: src_id|867e207c-1524852c-6dfcb444-87e0a185_0
2025-10-10T14:31:59.276100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4256afc6-aff1a3a9-6a26e708-d914a516_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|867e207c-1524852c-6dfcb444-87e0a185_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:59.278745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|867e207c-1524852c-6dfcb444-87e0a185_0] Write session: try to update token
2025-10-10T14:31:59.278762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|867e207c-1524852c-6dfcb444-87e0a185_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:59.292411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId: src_id|867e207c-1524852c-6dfcb444-87e0a185_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:59.293978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:59.293997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:59.294000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:59.294003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:59.294012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600797110416909:4042]
2025-10-10T14:31:59.294017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600797110416909:4042]
2025-10-10T14:31:59.294020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600797110416909:4042]
2025-10-10T14:31:59.294069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:59.294071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:59.294078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.294081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:59.294083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:59.294087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:59.294243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:59.294981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:59.355566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600797892627150:4235]
2025-10-10T14:31:59.355803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 395, pipe: [1:7559600797892627150:4235]
2025-10-10T14:31:59.396822Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:59.397038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.397050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.397088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627150:4235], now have 1 active actors on pipe
2025-10-10T14:31:59.397272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:59.397297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600797892627150:4235]
2025-10-10T14:31:59.397323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:59.397338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:59.397404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 396 reason: status is not ok: tablet will be restarted right now sessionId: src_id|867e207c-1524852c-6dfcb444-87e0a185_0
2025-10-10T14:31:59.397588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 396 sessionId: src_id|867e207c-1524852c-6dfcb444-87e0a185_0 is DEAD
2025-10-10T14:31:59.397783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867e207c-1524852c-6dfcb444-87e0a185_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:31:59.397791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867e207c-1524852c-6dfcb444-87e0a185_0] Write session will restart in 0.009800s
2025-10-10T14:31:59.397815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867e207c-1524852c-6dfcb444-87e0a185_0] Write session: Do CDS request
2025-10-10T14:31:59.397821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867e207c-1524852c-6dfcb444-87e0a185_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:59.408773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|867e207c-1524852c-6dfcb444-87e0a185_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.408842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:59.408856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 397
2025-10-10T14:31:59.408967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.409010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:59.409019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:59.409023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:59.409036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:59.409398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 397 sessionId:  describe result for acl check
2025-10-10T14:31:59.409439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:59.409446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:59.409448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:59.409454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600797892627338:4779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:59.409981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600797892627338:4779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:59.410814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:59.411028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:59.411038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:59.411048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:59.411089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:59.411126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600797110417152:4044]
2025-10-10T14:31:59.411488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:59.411558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600797892627338:4779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:59.411720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:59.411749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:59.411948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:59.411982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.411986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.411987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.411987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.411988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.411988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.411989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.411990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.411990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.411991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.411992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.411992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.411993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.411996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.412003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.412006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.412008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.412010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.412012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.412014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.412016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.412018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.412020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.412022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.412024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.412026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.412031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.412036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.412040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.412043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.412047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.412050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.412053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.412056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.412059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.412062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.412064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.412067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.412070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.412073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.412076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.412079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.412081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.412084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.412087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.412090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.412092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.412095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.412098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.412101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.412103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.412106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.412149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:59.414030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600797892627338:4779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:59.414043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600797892627338:4779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:59.414047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600797892627338:4779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:59.414053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:59.414102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:59.414450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:59.414459Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:59.414460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:59.414463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:59.414467Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 396 [2:7559600797110417152:4044]
2025-10-10T14:31:59.414475Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:59.414486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:59.414488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.414490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.414491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.414501Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:59.414519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:59.414525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:59.414568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.414573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.414574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.414576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:59.414622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:59.414627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.414634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.414640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.414650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:59.414668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627151:2438], now have 1 active actors on pipe
2025-10-10T14:31:59.414674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627371:4779], now have 1 active actors on pipe
2025-10-10T14:31:59.414681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600797110417147:4044]
2025-10-10T14:31:59.414683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600797110417147:4044]
2025-10-10T14:31:59.414684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600797110417147:4044]
2025-10-10T14:31:59.414705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:59.414721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:59.414723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:59.414720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 396
2025-10-10T14:31:59.414726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:59.414727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:59.414732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:59.414735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:59.414750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600797110417147:4044]
2025-10-10T14:31:59.414755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:59.414757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:59.414760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 396
2025-10-10T14:31:59.414783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.414790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.414821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:59.414830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.414832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.414834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:59.414841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.414849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:59.414860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.414971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.414976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.414986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.415049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 397 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0
2025-10-10T14:31:59.415293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|867e207c-1524852c-6dfcb444-87e0a185_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:59.417649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0] Write session: try to update token
2025-10-10T14:31:59.417662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:59.429712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId: src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:59.432035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:59.432261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.432282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.432301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:59.432303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:59.432306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:59.432307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:59.432312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600797110417147:4044]
2025-10-10T14:31:59.432315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600797110417147:4044]
2025-10-10T14:31:59.432318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600797110417147:4044]
2025-10-10T14:31:59.432360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:59.432364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:59.432370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.432372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:59.432372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:59.432376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:59.432492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:59.497397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600797892627403:4235]
2025-10-10T14:31:59.497642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 396, pipe: [1:7559600797892627403:4235]
2025-10-10T14:31:59.536687Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:59.536918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:59.536968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627403:4235], now have 1 active actors on pipe
2025-10-10T14:31:59.537048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:59.537143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:59.537196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600797892627403:4235]
2025-10-10T14:31:59.545411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:59.545422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:59.545442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 397 reason: error at write: Disconnected sessionId: src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0
2025-10-10T14:31:59.545561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 397 sessionId: src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0 is DEAD
2025-10-10T14:31:59.545703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:59.545713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0] Write session will restart in 0.006975s
2025-10-10T14:31:59.545731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0] Write session: Do CDS request
2025-10-10T14:31:59.545735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:59.553762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.553718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:59.553851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:59.553873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 398
2025-10-10T14:31:59.553964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.553996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:59.554005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:59.554009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:59.554370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 398 sessionId:  describe result for acl check
2025-10-10T14:31:59.554399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:59.554404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:59.554405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:59.554409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600797892627602:4794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:59.554839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600797892627602:4794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:59.555702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:59.555831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:59.555840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:59.555848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:59.555886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:59.555921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600797110417403:4059]
2025-10-10T14:31:59.556298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:59.556533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:59.556565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:59.556767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:59.556803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.556808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.556808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.556809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.556810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.556810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.556811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.556811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.556812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.556812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.556813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.556814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.556814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.556818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.556825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.556827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.556830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.556832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.556834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.556836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.556838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.556841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.556843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.556845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.556848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.556850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.556854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.556859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.556864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.556867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.556869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.556872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.556876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.556879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.556882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.556885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.556887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.556892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600797892627602:4794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:59.556890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.556893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.556896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.556898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.556903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.556908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.556912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.556916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.556920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.556925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.556929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.556933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.556938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.556942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.556947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.556986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:59.558971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:59.559319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600797892627602:4794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:59.559331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600797892627602:4794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:59.559335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600797892627602:4794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:59.559343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:59.559341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:59.559356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:59.559357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:59.559360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:59.559365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 397 [2:7559600797110417403:4059]
2025-10-10T14:31:59.559375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:59.559390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:59.559392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.559394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.559395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.559406Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:59.559411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:59.559420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:59.559454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.559461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.559462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.559465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:59.559514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:59.559521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.559527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.559533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.559543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:59.559557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627404:2438], now have 1 active actors on pipe
2025-10-10T14:31:59.559563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627636:4794], now have 1 active actors on pipe
2025-10-10T14:31:59.559568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600797110417398:4059]
2025-10-10T14:31:59.559569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600797110417398:4059]
2025-10-10T14:31:59.559570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600797110417398:4059]
2025-10-10T14:31:59.559579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:59.559575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 397
2025-10-10T14:31:59.559591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 397
2025-10-10T14:31:59.559591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:59.559595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:59.559597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:59.559598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:59.559611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:59.559614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:59.559644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.559654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.559671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600797110417398:4059]
2025-10-10T14:31:59.559683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:59.559693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:59.559709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:59.559719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.559721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.559722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:59.559730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.559739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:59.559755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.559846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.559851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.559862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.559919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 398 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0
2025-10-10T14:31:59.560172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3013-5b1f8b82-f60d5e05-9f578cb2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:59.562428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0] Write session: try to update token
2025-10-10T14:31:59.562440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:59.574593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId: src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:59.576957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:59.577524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.577543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.577564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:59.577568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:59.577571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:59.577573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:59.577581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600797110417398:4059]
2025-10-10T14:31:59.577585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600797110417398:4059]
2025-10-10T14:31:59.577588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600797110417398:4059]
2025-10-10T14:31:59.577625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:59.577643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:59.577646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:59.577646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:59.577652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.577655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:59.577775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:59.637179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600797892627646:4235]
2025-10-10T14:31:59.637461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 397, pipe: [1:7559600797892627646:4235]
2025-10-10T14:31:59.682273Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:59.682801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:31:59.682855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627646:4235], now have 1 active actors on pipe
2025-10-10T14:31:59.682940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:31:59.683019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600797892627646:4235]
2025-10-10T14:31:59.683044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:59.683048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:59.683052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:59.683127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 398 reason: error at write: Disconnected sessionId: src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0
2025-10-10T14:31:59.683284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 398 sessionId: src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0 is DEAD
2025-10-10T14:31:59.683427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:59.683436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0] Write session will restart in 0.005688s
2025-10-10T14:31:59.683455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0] Write session: Do CDS request
2025-10-10T14:31:59.683459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:59.689761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.689897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:59.689908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 399
2025-10-10T14:31:59.690039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.690065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:59.690073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:59.690076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:59.690608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 399 sessionId:  describe result for acl check
2025-10-10T14:31:59.690646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:59.690647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:59.690649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:59.690655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600797892627703:4798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:59.691231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600797892627703:4798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:59.693834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600797892627703:4798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:59.695595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:59.697447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:59.697519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600797892627703:4798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:59.697533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600797892627703:4798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:59.697536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600797892627703:4798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:59.697544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:59.697623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:59.697636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:59.697650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:59.697709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:59.697752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600797110417632:4062]
2025-10-10T14:31:59.698293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:59.698544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:59.698574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:59.698782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:59.698821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.698826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.698827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.698828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.698828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.698829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.698830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.698830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.698831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.698832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.698832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.698833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.698833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.698837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.698846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.698848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.698851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.698853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.698855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.698858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.698860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.698862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.698865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.698867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.698869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.698872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.698876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.698883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.698890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.698895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.698899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.698904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.698909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.698914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.698919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.698924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.698929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.698934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.698940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.698945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.698950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.698955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.698960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.698965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.698969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.698974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.698979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.698985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.698990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.698996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.699001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.699006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.699047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:59.701153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:59.701580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:59.701591Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:59.701592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:59.701595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:59.701600Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 398 [2:7559600797110417632:4062]
2025-10-10T14:31:59.701610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:59.701622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:59.701624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.701626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.701628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.701641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:59.701646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:59.701653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:59.701690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.701696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.701697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.701698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:59.701749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:59.701755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.701761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.701767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.701777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:59.701792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600797110417627:4062]
2025-10-10T14:31:59.701797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600797110417627:4062]
2025-10-10T14:31:59.701798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600797110417627:4062]
2025-10-10T14:31:59.701809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:59.701827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627866:4798], now have 1 active actors on pipe
2025-10-10T14:31:59.701827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:59.701830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:59.701832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:59.701835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627648:2438], now have 1 active actors on pipe
2025-10-10T14:31:59.701842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:59.701858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:59.701865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:59.701884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600797110417627:4062]
2025-10-10T14:31:59.701895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:59.701887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 398
2025-10-10T14:31:59.701908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:59.701927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.701894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 398
2025-10-10T14:31:59.701935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.701961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:59.701972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.701976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.701978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:59.701990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.702006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:59.702026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.702171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.702177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.702188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.702268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 399 partition: 0 MaxSeqNo: 40 sessionId: src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0
2025-10-10T14:31:59.702627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd33e8b5-7ac6b4e5-68c55e10-801906dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:59.705078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0] Write session: try to update token
2025-10-10T14:31:59.705091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:59.717851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId: src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:59.720266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:59.720441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:59.720464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:59.720468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:59.720470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:59.720480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600797110417627:4062]
2025-10-10T14:31:59.720485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600797110417627:4062]
2025-10-10T14:31:59.720489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600797110417627:4062]
2025-10-10T14:31:59.720537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:59.720546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.720551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:59.720555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:59.720557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.720578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:59.720594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.720596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:59.720736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:59.783122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600797892627877:4235]
2025-10-10T14:31:59.783309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 398, pipe: [1:7559600797892627877:4235]
2025-10-10T14:31:59.823274Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:59.823746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627877:4235], now have 1 active actors on pipe
2025-10-10T14:31:59.823924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:59.823914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600797892627877:4235]
2025-10-10T14:31:59.823942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:59.823950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:59.823955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:59.824016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 399 reason: error at write: Disconnected sessionId: src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0
2025-10-10T14:31:59.824248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 399 sessionId: src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0 is DEAD
2025-10-10T14:31:59.824403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:59.824418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0] Write session will restart in 0.007509s
2025-10-10T14:31:59.824437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0] Write session: Do CDS request
2025-10-10T14:31:59.824442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:59.832842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.832925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:59.832938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 400
2025-10-10T14:31:59.833091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.833119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:59.833127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:59.833131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:59.833615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 400 sessionId:  describe result for acl check
2025-10-10T14:31:59.833650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:59.833656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:59.833657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:59.833661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600797892627968:4802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:59.834120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600797892627968:4802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:59.836373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600797892627968:4802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:59.837454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:59.839599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:59.839789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:59.839801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:59.839813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:59.839862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:59.839878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600797892627968:4802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:59.839902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600797110417860:4064]
2025-10-10T14:31:59.839890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600797892627968:4802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:59.839892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600797892627968:4802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:59.839898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:59.840389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:59.840651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:59.840683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:59.840943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:59.840983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.840987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.840988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.840988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.840989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.840989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.840990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.840991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.840991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.840992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.840993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.840993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.840994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.840998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.841010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.841014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.841017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.841021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.841025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.841029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.841033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.841037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.841041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.841045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.841051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.841055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.841062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.841074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.841084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.841090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.841097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.841102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.841106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.841111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.841115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.841119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.841121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.841124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.841127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.841135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.841137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.841140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.841143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.841146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.841148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.841151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.841154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.841157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.841159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.841162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.841164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.841167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.841187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:59.843372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:59.843907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:59.843920Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:59.843922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:59.843926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:59.843932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 399 [2:7559600797110417860:4064]
2025-10-10T14:31:59.843944Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:59.843965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:59.843973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.843976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.843979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.843995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:59.844007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:59.844014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:59.844073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.844080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.844082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.844084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:59.844148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:59.844155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.844167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.844183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.844205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:59.844230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892628098:4802], now have 1 active actors on pipe
2025-10-10T14:31:59.844237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892627879:2438], now have 1 active actors on pipe
2025-10-10T14:31:59.844245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600797110417855:4064]
2025-10-10T14:31:59.844251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600797110417855:4064]
2025-10-10T14:31:59.844253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600797110417855:4064]
2025-10-10T14:31:59.844265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:59.844283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:59.844287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:59.844290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:59.844292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:59.844289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 399
2025-10-10T14:31:59.844301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:59.844290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 399
2025-10-10T14:31:59.844304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:59.844324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600797110417855:4064]
2025-10-10T14:31:59.844327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:59.844329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:59.844351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.844361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.844396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:59.844408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.844411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.844418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:59.844429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.844442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:59.844469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.844623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.844632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.844649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.844735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 400 partition: 0 MaxSeqNo: 40 sessionId: src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0
2025-10-10T14:31:59.845087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc10e0e-3b2d41ce-1b801521-2c52f6b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:59.847559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0] Write session: try to update token
2025-10-10T14:31:59.847575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:31:59.860346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId: src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:31:59.861909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:31:59.861927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:31:59.861930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:31:59.861932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:31:59.861940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600797110417855:4064]
2025-10-10T14:31:59.861945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600797110417855:4064]
2025-10-10T14:31:59.861949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600797110417855:4064]
2025-10-10T14:31:59.861996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:31:59.862004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:31:59.862008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.862010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:31:59.862010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:31:59.862014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:31:59.862136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:31:59.862693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:31:59.923873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600797892628109:4235]
2025-10-10T14:31:59.924169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 399, pipe: [1:7559600797892628109:4235]
2025-10-10T14:31:59.967562Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:31:59.967829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.967845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.967891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892628109:4235], now have 1 active actors on pipe
2025-10-10T14:31:59.968095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:31:59.968085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600797892628109:4235]
2025-10-10T14:31:59.968105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:31:59.968108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:31:59.968109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:31:59.968171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 400 reason: error at write: Disconnected sessionId: src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0
2025-10-10T14:31:59.968354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 400 sessionId: src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0 is DEAD
2025-10-10T14:31:59.968530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:31:59.968552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0] Write session will restart in 0.008045s
2025-10-10T14:31:59.968577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0] Write session: Do CDS request
2025-10-10T14:31:59.968587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:31:59.977762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.977859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:31:59.977871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 401
2025-10-10T14:31:59.977988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:31:59.978016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:31:59.978025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:31:59.978028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:31:59.978369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 401 sessionId:  describe result for acl check
2025-10-10T14:31:59.978396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:31:59.978405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:31:59.978407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:31:59.978412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600797892628218:4806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:31:59.978857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600797892628218:4806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:31:59.981380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600797892628218:4806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:31:59.982072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:31:59.983986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:31:59.984150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:31:59.984162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:31:59.984173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:31:59.984214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:31:59.984244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600797110418094:4066]
2025-10-10T14:31:59.984240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600797892628218:4806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:31:59.984254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600797892628218:4806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:31:59.984257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600797892628218:4806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:31:59.984263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:31:59.984607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:31:59.984888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:31:59.984922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:31:59.985156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:31:59.985196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.985200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.985201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.985201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.985202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.985202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.985203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.985204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.985204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.985205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.985206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.985206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.985207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.985210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.985218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.985220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.985222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.985224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.985226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.985229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.985230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.985232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.985235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.985237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.985239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.985241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.985246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.985251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:31:59.985255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.985259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:31:59.985261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.985264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:31:59.985267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.985270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:31:59.985273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.985276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:31:59.985278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.985281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:31:59.985284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.985287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:31:59.985289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.985292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:31:59.985295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.985298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:31:59.985300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.985304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:31:59.985306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.985310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.985312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.985315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.985319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.985322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.985371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:31:59.987526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:31:59.987830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:31:59.987840Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:31:59.987841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:31:59.987845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:31:59.987849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 400 [2:7559600797110418094:4066]
2025-10-10T14:31:59.987857Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:31:59.987867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:31:59.987869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.987870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.987871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.987880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:31:59.987885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:31:59.987891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:31:59.987930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.987937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.987939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.987941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:31:59.988002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:31:59.988008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:31:59.988016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:31:59.988028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:31:59.988050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:31:59.988076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892628333:4806], now have 1 active actors on pipe
2025-10-10T14:31:59.988083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600797892628112:2438], now have 1 active actors on pipe
2025-10-10T14:31:59.988089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600797110418089:4066]
2025-10-10T14:31:59.988091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600797110418089:4066]
2025-10-10T14:31:59.988093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600797110418089:4066]
2025-10-10T14:31:59.988106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:31:59.988124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:31:59.988130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:31:59.988133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:31:59.988135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:31:59.988143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:31:59.988146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:31:59.988149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 400
2025-10-10T14:31:59.988166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600797110418089:4066]
2025-10-10T14:31:59.988173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:31:59.988181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:31:59.988205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 400
2025-10-10T14:31:59.988262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.988271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.988294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:31:59.988303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:31:59.988306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:31:59.988307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:31:59.988316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:31:59.988324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:31:59.988338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.988479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:31:59.988487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:31:59.988500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:31:59.988580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 401 partition: 0 MaxSeqNo: 40 sessionId: src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0
2025-10-10T14:31:59.988890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e227ee15-7d98c217-1b4a0439-f9d24d59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:31:59.991426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0] Write session: try to update token
2025-10-10T14:31:59.991441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:00.004271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId: src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:00.006689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:00.007139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.007160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.007186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:00.007189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:00.007192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:00.007194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:00.007202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600797110418089:4066]
2025-10-10T14:32:00.007206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600797110418089:4066]
2025-10-10T14:32:00.007209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600797110418089:4066]
2025-10-10T14:32:00.007248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:00.007259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:00.007264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:00.007267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:00.007273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.007276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:00.007399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:00.068279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600802187595640:4235]
2025-10-10T14:32:00.068627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 400, pipe: [1:7559600802187595640:4235]
2025-10-10T14:32:00.111800Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:00.112033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:00.112095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187595640:4235], now have 1 active actors on pipe
2025-10-10T14:32:00.112138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:00.112315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600802187595640:4235]
2025-10-10T14:32:00.112342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:00.112372Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:32:00.112618Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 4 consumer shared/user session shared/user_1_4_7117977482433792610_v1 is DEAD
2025-10-10T14:32:00.112749Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:32:00.112797Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600737763067247:4232] disconnected; active server actors: 1
2025-10-10T14:32:00.112806Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600737763067247:4232] client user disconnected session shared/user_1_4_7117977482433792610_v1
2025-10-10T14:32:00.112888Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:00.112892Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:00.112900Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009962s
2025-10-10T14:32:00.121741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:00.121752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:00.121773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 401 reason: error at write: Disconnected sessionId: src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0
2025-10-10T14:32:00.121929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 401 sessionId: src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0 is DEAD
2025-10-10T14:32:00.122111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:00.122122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0] Write session will restart in 0.008956s
2025-10-10T14:32:00.122152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0] Write session: Do CDS request
2025-10-10T14:32:00.122158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:00.123624Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:32:00.123829Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:32:00.123837Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 5
2025-10-10T14:32:00.123982Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:00.124041Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:00.124116Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 auth for : user
2025-10-10T14:32:00.124300Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 Handle describe topics response
2025-10-10T14:32:00.124333Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 auth is DEAD
2025-10-10T14:32:00.124340Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:32:00.124544Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:32:00.124623Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_5_8777415409333158409_v1
2025-10-10T14:32:00.124620Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600802187595731:4810] connected; active server actors: 1
2025-10-10T14:32:00.124632Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600802187595731:4810] session shared/user_1_5_8777415409333158409_v1
2025-10-10T14:32:00.124639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:32:00.124648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:32:00.124658Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_5_8777415409333158409_v1" (Sender=[1:7559600802187595727:4810], Pipe=[1:7559600802187595731:4810], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:00.124660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:00.124669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:32:00.124676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_5_8777415409333158409_v1" (Sender=[1:7559600802187595727:4810], Pipe=[1:7559600802187595731:4810], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:00.124683Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_5_8777415409333158409_v1" sender [1:7559600802187595727:4810] lock partition 0 for ReadingSession "shared/user_1_5_8777415409333158409_v1" (Sender=[1:7559600802187595727:4810], Pipe=[1:7559600802187595731:4810], Partitions=[], ActiveFamilyCount=1) generation 1 step 5
2025-10-10T14:32:00.124696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:32:00.124709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000038s
2025-10-10T14:32:00.124936Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_5_8777415409333158409_v1" ClientId: "user" PipeClient { RawX1: 7559600802187595731 RawX2: 4503603922342602 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:32:00.124963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:32:00.129480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:00.131234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:32:00.131250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-10T14:32:00.131681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:00.131723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.131785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:00.131795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 402
2025-10-10T14:32:00.131852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:00.131862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:00.131874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:00.131897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.131919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:00.131927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:00.131922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:00.131930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:00.131962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600801405385633:4068]
2025-10-10T14:32:00.132290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 402 sessionId:  describe result for acl check
2025-10-10T14:32:00.132320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:00.132327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:00.132329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:00.132334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600802187595855:4815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:00.132566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:00.132695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600802187595855:4815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:00.132854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:00.132898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:00.133209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:00.133263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.133269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.133270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.133271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.133273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.133274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.133276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.133277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.133278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.133279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.133280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.133281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.133282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.133288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.133299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.133304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.133308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.133312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.133316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.133320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.133325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.133350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.133354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.133362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.133366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.133375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.133381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.133394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.133402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.133407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.133411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.133417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.133421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.133426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.133430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.133435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.133440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.133445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.133449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.133455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.133459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.133464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.133469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.133474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.133478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.133483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.133487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.133492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.133496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.133502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.133506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.133511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.133534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:00.134341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600802187595855:4815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:00.135606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:00.135993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:00.136004Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:00.136006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:00.136009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:00.136013Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 401 [2:7559600801405385633:4068]
2025-10-10T14:32:00.136025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:00.136043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:00.136048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.136051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.136053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.136069Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:00.136078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:00.136084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:00.136124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.136129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.136130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.136131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:00.136193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:00.136201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.136212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.136225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.136247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:00.136273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187595734:4813], now have 1 active actors on pipe
2025-10-10T14:32:00.136281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187595641:2438], now have 1 active actors on pipe
2025-10-10T14:32:00.136266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 401
2025-10-10T14:32:00.136289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600801405385628:4068]
2025-10-10T14:32:00.136273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 401, pipe: [1:7559600802187595734:4813]
2025-10-10T14:32:00.136295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600801405385628:4068]
2025-10-10T14:32:00.136298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600801405385628:4068]
2025-10-10T14:32:00.136308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:00.136319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:00.136323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:00.136324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:00.136324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:00.136340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:00.136347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:00.136387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.136395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.136409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_5_8777415409333158409_v1 on pipe: [1:7559600802187595734:4813]
2025-10-10T14:32:00.136438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600802187595855:4815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:00.136441Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_5_8777415409333158409_v1:1 with generation 401
2025-10-10T14:32:00.136450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600802187595855:4815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:00.136447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600801405385628:4068]
2025-10-10T14:32:00.136455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:00.136453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600802187595855:4815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:00.136461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:00.136479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:00.136495Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:32:00.136526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.136534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.136535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:00.136550Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_5_8777415409333158409_v1
2025-10-10T14:32:00.136555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.136582Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:32:00.136651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:32:00.136667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 401
2025-10-10T14:32:00.136648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187595888:4815], now have 1 active actors on pipe
2025-10-10T14:32:00.136685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:32:00.136698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.136703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.136719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|352fb371-17ee6e90-79b4103d-241761f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:00.136727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:32:00.137034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:32:00.137052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:32:00.137063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.137067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.137074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:00.137085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.137095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:00.137104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:32:00.137111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:32:00.137125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.137239Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106720135 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:32:00.137260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.137253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:32:00.137267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.137280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.137283Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 sending to client partition status
2025-10-10T14:32:00.137357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 402 partition: 0 MaxSeqNo: 40 sessionId: src_id|352fb371-17ee6e90-79b4103d-241761f2_0
2025-10-10T14:32:00.137663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f20665-9ca8be72-f77f8b7e-7bfeb53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|352fb371-17ee6e90-79b4103d-241761f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:00.140222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|352fb371-17ee6e90-79b4103d-241761f2_0] Write session: try to update token
2025-10-10T14:32:00.140235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|352fb371-17ee6e90-79b4103d-241761f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:00.153504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId: src_id|352fb371-17ee6e90-79b4103d-241761f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:00.155217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:00.155236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:00.155239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:00.155241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:00.155248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600801405385628:4068]
2025-10-10T14:32:00.155251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600801405385628:4068]
2025-10-10T14:32:00.155254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600801405385628:4068]
2025-10-10T14:32:00.155295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:00.155301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.155302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:00.155316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:00.155322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:00.155326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:00.155437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:00.156082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:00.257993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:00.258322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.258334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.258661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_5_8777415409333158409_v1
2025-10-10T14:32:00.258630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:00.258684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:00.258643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:00.258667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600802187595734:4813]
2025-10-10T14:32:00.258709Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_5_8777415409333158409_v1
2025-10-10T14:32:00.258698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:00.258699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 402 reason: error at write: Disconnected sessionId: src_id|352fb371-17ee6e90-79b4103d-241761f2_0
2025-10-10T14:32:00.258913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 402 sessionId: src_id|352fb371-17ee6e90-79b4103d-241761f2_0 is DEAD
2025-10-10T14:32:00.259057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352fb371-17ee6e90-79b4103d-241761f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:00.259067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352fb371-17ee6e90-79b4103d-241761f2_0] Write session will restart in 0.006269s
2025-10-10T14:32:00.259087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352fb371-17ee6e90-79b4103d-241761f2_0] Write session: Do CDS request
2025-10-10T14:32:00.259092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352fb371-17ee6e90-79b4103d-241761f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:00.266825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|352fb371-17ee6e90-79b4103d-241761f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.266911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:00.266922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 403
2025-10-10T14:32:00.267053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.267081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:00.267085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:00.267088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:00.267538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 403 sessionId:  describe result for acl check
2025-10-10T14:32:00.267582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:00.267604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:00.267606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:00.267613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600802187595961:4819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:00.268172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600802187595961:4819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:00.270725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600802187595961:4819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:00.273172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600802187595961:4819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:00.273184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600802187595961:4819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:00.273186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600802187595961:4819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:00.273192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:00.273399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:00.275566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:00.275726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:00.275738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:00.275749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:00.275794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:00.275825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600801405385867:4072]
2025-10-10T14:32:00.276235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:00.276477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:00.276512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:00.276728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:00.276764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.276766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.276767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.276768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.276768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.276769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.276770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.276770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.276771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.276772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.276772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.276773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.276773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.276777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.276785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.276788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.276790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.276792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.276794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.276796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.276798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.276800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.276802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.276804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.276807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.276809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.276814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.276819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.276824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.276827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.276830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.276833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.276835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.276838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.276841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.276844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.276846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.276849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.276852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.276855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.276858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.276861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.276864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.276867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.276869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.276872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.276876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.276879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.276882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.276884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.276887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.276890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.276913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:00.279172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:00.279760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:00.279773Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:00.279775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:00.279779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:00.279785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 402 [2:7559600801405385867:4072]
2025-10-10T14:32:00.279798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:00.279815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:00.279825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.279828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.279830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.279848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:00.279856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:00.279864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:00.279918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.279926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.279928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.279931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:00.279994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:00.280002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.280013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.280026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.280046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:00.280069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596123:4819], now have 1 active actors on pipe
2025-10-10T14:32:00.280077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187595902:2438], now have 1 active actors on pipe
2025-10-10T14:32:00.280087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600801405385861:4072]
2025-10-10T14:32:00.280091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600801405385861:4072]
2025-10-10T14:32:00.280093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600801405385861:4072]
2025-10-10T14:32:00.280106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:00.280115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:00.280095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 402
2025-10-10T14:32:00.280099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 402
2025-10-10T14:32:00.280118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:00.280119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:00.280123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:00.280140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:00.280143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:00.280182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.280193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.280211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600801405385861:4072]
2025-10-10T14:32:00.280222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:00.280226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:00.280248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:00.280260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.280263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.280267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:00.280278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.280291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:00.280317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.280450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.280458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.280472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.280548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 403 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0
2025-10-10T14:32:00.280924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352fb371-17ee6e90-79b4103d-241761f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:00.283439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0] Write session: try to update token
2025-10-10T14:32:00.283455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:00.296556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId: src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:00.298293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:00.298312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:00.298315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:00.298317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:00.298327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600801405385861:4072]
2025-10-10T14:32:00.298332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600801405385861:4072]
2025-10-10T14:32:00.298336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600801405385861:4072]
2025-10-10T14:32:00.298373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:00.298378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:00.298381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:00.298386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:00.298394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.298397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:00.298562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:00.299194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:00.358589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600802187596136:4813]
2025-10-10T14:32:00.358859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 402, pipe: [1:7559600802187596136:4813]
2025-10-10T14:32:00.402580Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:00.402903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.402917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.402961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596136:4813], now have 1 active actors on pipe
2025-10-10T14:32:00.403103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:00.403176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:00.403176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600802187596136:4813]
2025-10-10T14:32:00.403201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:00.403289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 403 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0
2025-10-10T14:32:00.403481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 403 sessionId: src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0 is DEAD
2025-10-10T14:32:00.403611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:00.403623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0] Write session will restart in 0.009662s
2025-10-10T14:32:00.403654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0] Write session: Do CDS request
2025-10-10T14:32:00.403661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:00.414817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.414892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:00.414906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 404
2025-10-10T14:32:00.415034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.415067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:00.415073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:00.415076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:00.415394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 404 sessionId:  describe result for acl check
2025-10-10T14:32:00.415420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:00.415430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:00.415432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:00.415436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600802187596329:4823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:00.415881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600802187596329:4823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:00.416129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:00.417769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600802187596329:4823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:00.418282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:00.418451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:00.418460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:00.418468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:00.418508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:00.418559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600801405386098:4074]
2025-10-10T14:32:00.418955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:00.419167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:00.419195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:00.419419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:00.419459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.419465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.419465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.419466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.419467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.419467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.419468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.419469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.419469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.419470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.419471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.419471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.419472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.419475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.419482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.419485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.419487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.419489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.419492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.419494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.419496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.419498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.419501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.419503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.419505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.419508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.419513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.419518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.419522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.419526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.419529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.419532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.419534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.419538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.419540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.419544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.419546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.419551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.419556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.419561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.419565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.419569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.419573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.419578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.419583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.419588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.419592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.419595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.419597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.419601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.419604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.419607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.419637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:00.420059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600802187596329:4823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:00.420073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600802187596329:4823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:00.420077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600802187596329:4823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:00.420084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:00.421833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:00.422150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:00.422163Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:00.422165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:00.422169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:00.422174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 403 [2:7559600801405386098:4074]
2025-10-10T14:32:00.422185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:00.422203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:00.422208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.422211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.422212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.422224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:00.422229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:00.422235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:00.422274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.422281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.422283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.422286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:00.422334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:00.422340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.422347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.422353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.422363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:00.422384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596137:2438], now have 1 active actors on pipe
2025-10-10T14:32:00.422392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596364:4823], now have 1 active actors on pipe
2025-10-10T14:32:00.422399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600801405386093:4074]
2025-10-10T14:32:00.422406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600801405386093:4074]
2025-10-10T14:32:00.422408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600801405386093:4074]
2025-10-10T14:32:00.422421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:00.422431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:00.422432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:00.422415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 403
2025-10-10T14:32:00.422435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:00.422440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 403
2025-10-10T14:32:00.422436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:00.422444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:00.422446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:00.422475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.422482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.422493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600801405386093:4074]
2025-10-10T14:32:00.422502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:00.422512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:00.422537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:00.422547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.422552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.422554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:00.422561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.422573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:00.422592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.422698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.422706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.422720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.422814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 404 partition: 0 MaxSeqNo: 40 sessionId: src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0
2025-10-10T14:32:00.423076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e70c1d1-b4c66898-e0c4b4b5-77809ace_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:00.425527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0] Write session: try to update token
2025-10-10T14:32:00.425541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:00.438103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId: src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:00.440425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:00.441849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.441873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.441893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:00.441896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:00.441898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:00.441899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:00.441905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600801405386093:4074]
2025-10-10T14:32:00.441908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600801405386093:4074]
2025-10-10T14:32:00.441910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600801405386093:4074]
2025-10-10T14:32:00.441947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:00.441957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:00.441959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:00.441963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.441965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:00.441965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:00.442092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:00.503484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600802187596396:4813]
2025-10-10T14:32:00.503737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 403, pipe: [1:7559600802187596396:4813]
2025-10-10T14:32:00.547428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:00.547756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:00.547807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596396:4813], now have 1 active actors on pipe
2025-10-10T14:32:00.547861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:00.547932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:00.547979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600802187596396:4813]
2025-10-10T14:32:00.556224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:00.556238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:00.556258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 404 reason: error at write: Disconnected sessionId: src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0
2025-10-10T14:32:00.556411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 404 sessionId: src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0 is DEAD
2025-10-10T14:32:00.556527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:00.556538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0] Write session will restart in 0.005756s
2025-10-10T14:32:00.556564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0] Write session: Do CDS request
2025-10-10T14:32:00.556569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:00.563790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.563938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:00.563949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 405
2025-10-10T14:32:00.564073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.564099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:00.564107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:00.564109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:00.564497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 405 sessionId:  describe result for acl check
2025-10-10T14:32:00.564526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:00.564527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:00.564528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:00.564533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600802187596596:4838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:00.564939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600802187596596:4838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:00.565937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:00.566949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600802187596596:4838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:00.568086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:00.568269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:00.568280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:00.568291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:00.568342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:00.568376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600801405386369:4089]
2025-10-10T14:32:00.568963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:00.568992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600802187596596:4838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:00.569005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600802187596596:4838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:00.569008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600802187596596:4838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:00.569015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:00.569229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:00.569271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:00.569722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:00.569783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.569789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.569790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.569791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.569792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.569794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.569795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.569796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.569797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.569798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.569799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.569801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.569802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.569807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.569820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.569824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.569828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.569832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.569836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.569840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.569844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.569849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.569853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.569857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.569861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.569865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.569872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.569882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.569894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.569906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.569910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.569920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.569929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.569933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.569943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.569952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.569961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.569967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.569976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.569982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.569990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.569999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.570008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.570013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.570017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.570023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.570031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.570036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.570045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.570050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.570058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.570064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.570108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:00.572265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:00.572571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:00.572582Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:00.572583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:00.572586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:00.572591Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 404 [2:7559600801405386369:4089]
2025-10-10T14:32:00.572600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:00.572614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:00.572619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.572621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.572623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.572635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:00.572640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:00.572646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:00.572683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.572689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.572690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.572692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:00.572741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:00.572748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.572755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.572761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.572771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:00.572787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596404:2438], now have 1 active actors on pipe
2025-10-10T14:32:00.572793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596628:4838], now have 1 active actors on pipe
2025-10-10T14:32:00.572798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600801405386364:4089]
2025-10-10T14:32:00.572800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600801405386364:4089]
2025-10-10T14:32:00.572802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600801405386364:4089]
2025-10-10T14:32:00.572810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:00.572821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:00.572836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:00.572842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:00.572845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:00.572846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:00.572849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:00.572865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600801405386364:4089]
2025-10-10T14:32:00.572877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:00.572881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:00.572871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 404
2025-10-10T14:32:00.572874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 404
2025-10-10T14:32:00.572970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.572977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.573003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:00.573012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.573015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.573018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:00.573025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.573034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:00.573045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.573202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.573209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.573220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.573295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 405 partition: 0 MaxSeqNo: 40 sessionId: src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0
2025-10-10T14:32:00.573594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d5c146e-eeda6ba-d6c8256a-814914f1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:00.576042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0] Write session: try to update token
2025-10-10T14:32:00.576054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:00.589066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId: src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:00.591315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:00.591333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:00.591336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:00.591338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:00.591349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600801405386364:4089]
2025-10-10T14:32:00.591354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600801405386364:4089]
2025-10-10T14:32:00.591359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600801405386364:4089]
2025-10-10T14:32:00.591412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:00.591414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:00.591422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.591424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:00.591426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:00.591430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:00.591613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:00.592468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:00.648405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600802187596643:4813]
2025-10-10T14:32:00.648700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 404, pipe: [1:7559600802187596643:4813]
2025-10-10T14:32:00.695393Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:00.695687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.695704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.695748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596643:4813], now have 1 active actors on pipe
2025-10-10T14:32:00.696008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:00.696072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:00.696079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:00.696128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600802187596643:4813]
2025-10-10T14:32:00.696147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 405 reason: error at write: Disconnected sessionId: src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0
2025-10-10T14:32:00.696215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:00.696370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 405 sessionId: src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0 is DEAD
2025-10-10T14:32:00.696469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:00.696480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0] Write session will restart in 0.008575s
2025-10-10T14:32:00.696497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0] Write session: Do CDS request
2025-10-10T14:32:00.696502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:00.705740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.705815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:00.705836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 406
2025-10-10T14:32:00.705941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.705975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:00.705980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:00.705983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:00.706499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 406 sessionId:  describe result for acl check
2025-10-10T14:32:00.706566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:00.706574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:00.706576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:00.706581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600802187596765:4842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:00.707148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600802187596765:4842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:00.709390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600802187596765:4842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:00.709942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:00.711987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:00.712157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:00.712168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:00.712180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:00.712178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600802187596765:4842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:00.712191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600802187596765:4842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:00.712194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600802187596765:4842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:00.712200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:00.712234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:00.712299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600801405386605:4092]
2025-10-10T14:32:00.712917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:00.713200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:00.713252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:00.713595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:00.713671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.713679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.713680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.713681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.713682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.713684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.713685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.713686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.713688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.713689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.713690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.713691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.713693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.713698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.713711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.713715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.713724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.713728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.713737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.713741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.713745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.713749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.713755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.713759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.713768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.713772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.713784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.713794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.713806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.713812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.713821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.713826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.713831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.713841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.713851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.713861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.713871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.713880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.713889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.713894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.713898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.713903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.713913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.713923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.713931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.713936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.713944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.713953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.713962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.713966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.713975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.713984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.714026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:00.716130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:00.716580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:00.716597Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:00.716599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:00.716603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:00.716608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 405 [2:7559600801405386605:4092]
2025-10-10T14:32:00.716618Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:00.716639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:00.716647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.716650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.716652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.716667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:00.716680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:00.716692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:00.716748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.716756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.716758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.716761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:00.716822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:00.716830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.716843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.716857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.716881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:00.716906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596869:4842], now have 1 active actors on pipe
2025-10-10T14:32:00.716915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596644:2438], now have 1 active actors on pipe
2025-10-10T14:32:00.716922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600801405386600:4092]
2025-10-10T14:32:00.716924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600801405386600:4092]
2025-10-10T14:32:00.716926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600801405386600:4092]
2025-10-10T14:32:00.716939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:00.716949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:00.716956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:00.716926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 405
2025-10-10T14:32:00.716957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:00.716937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 405
2025-10-10T14:32:00.716959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:00.716972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:00.716975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:00.717008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.717017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.717035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600801405386600:4092]
2025-10-10T14:32:00.717047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:00.717067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:00.717078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:00.717087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.717091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.717093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:00.717104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.717114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:00.717144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.717279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.717289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.717307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.717437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 406 partition: 0 MaxSeqNo: 40 sessionId: src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0
2025-10-10T14:32:00.717714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fdde316-e4ccc674-23b7f31-f194f5aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:00.720190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0] Write session: try to update token
2025-10-10T14:32:00.720205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:00.733061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId: src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:00.734685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:00.734702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:00.734706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:00.734708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:00.734717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600801405386600:4092]
2025-10-10T14:32:00.734724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600801405386600:4092]
2025-10-10T14:32:00.734727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600801405386600:4092]
2025-10-10T14:32:00.734775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:00.734786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.734786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:00.734792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:00.734793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:00.734797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:00.734926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:00.735498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:00.796361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600802187596881:4813]
2025-10-10T14:32:00.796642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 405, pipe: [1:7559600802187596881:4813]
2025-10-10T14:32:00.845655Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:00.845999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.846018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.846067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596881:4813], now have 1 active actors on pipe
2025-10-10T14:32:00.846291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:00.846273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:00.846277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:00.846287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:00.846321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600802187596881:4813]
2025-10-10T14:32:00.846354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 406 reason: error at write: Disconnected sessionId: src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0
2025-10-10T14:32:00.846590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 406 sessionId: src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0 is DEAD
2025-10-10T14:32:00.846689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:00.846698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0] Write session will restart in 0.006558s
2025-10-10T14:32:00.846722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0] Write session: Do CDS request
2025-10-10T14:32:00.846729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:00.854898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.854970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:00.854984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 407
2025-10-10T14:32:00.855129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.855164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:00.855174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:00.855178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:00.855583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 407 sessionId:  describe result for acl check
2025-10-10T14:32:00.855615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:00.855617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:00.855618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:00.855623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600802187596977:4846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:00.856051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600802187596977:4846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:00.858465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600802187596977:4846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:00.859834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:00.861824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:00.861969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600802187596977:4846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:00.861979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600802187596977:4846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:00.861981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600802187596977:4846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:00.861988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:00.861991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:00.862005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:00.862018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:00.862071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:00.862112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600801405386840:4094]
2025-10-10T14:32:00.862643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:00.862917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:00.862947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:00.863160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:00.863199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.863203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.863204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.863205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.863205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.863206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.863207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.863207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.863208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.863209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.863209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.863210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.863210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.863214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.863222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.863225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.863227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.863230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.863232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.863234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.863236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.863239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.863241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.863243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.863246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.863248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.863253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.863258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:00.863263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.863266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:00.863271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.863276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:00.863280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.863290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:00.863298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.863301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:00.863307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.863312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:00.863317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.863327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:00.863338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.863345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:00.863348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.863352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:00.863357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.863360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:00.863362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.863365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.863374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.863382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.863390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.863399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.863435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:00.865514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:00.865901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:00.865911Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:00.865913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:00.865916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:00.865921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 406 [2:7559600801405386840:4094]
2025-10-10T14:32:00.865933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:00.865946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:00.865954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.865958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.865965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.865980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:00.865990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:00.866003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:00.866046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.866050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.866051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.866053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:00.866103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:00.866110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.866121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:00.866137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:00.866158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:00.866186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187596882:2438], now have 1 active actors on pipe
2025-10-10T14:32:00.866194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187597108:4846], now have 1 active actors on pipe
2025-10-10T14:32:00.866199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600801405386835:4094]
2025-10-10T14:32:00.866201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600801405386835:4094]
2025-10-10T14:32:00.866202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600801405386835:4094]
2025-10-10T14:32:00.866211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:00.866222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:00.866224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:00.866225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:00.866226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:00.866234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:00.866236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:00.866226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 406
2025-10-10T14:32:00.866252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600801405386835:4094]
2025-10-10T14:32:00.866257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:00.866238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 406
2025-10-10T14:32:00.866263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:00.866282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.866288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.866320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3568cbf-607bcf34-57b27d40-9f003135_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:00.866331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:00.866339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:00.866341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:00.866350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:00.866364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:00.866381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.866516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.866531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.866547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:00.866640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 407 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3568cbf-607bcf34-57b27d40-9f003135_0
2025-10-10T14:32:00.866927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7cc9dc9-aa955cff-d3778de7-9c110e1f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3568cbf-607bcf34-57b27d40-9f003135_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:00.869409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3568cbf-607bcf34-57b27d40-9f003135_0] Write session: try to update token
2025-10-10T14:32:00.869423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3568cbf-607bcf34-57b27d40-9f003135_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:00.882028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId: src_id|d3568cbf-607bcf34-57b27d40-9f003135_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:00.884116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:00.884134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:00.884137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:00.884139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:00.884148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600801405386835:4094]
2025-10-10T14:32:00.884153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600801405386835:4094]
2025-10-10T14:32:00.884157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600801405386835:4094]
2025-10-10T14:32:00.884207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:00.884210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:00.884215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:00.884219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:00.884221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:00.884223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:00.884359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:00.884565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:00.946388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600802187597119:4813]
2025-10-10T14:32:00.946591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 406, pipe: [1:7559600802187597119:4813]
2025-10-10T14:32:00.990618Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:00.991011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:00.991029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:00.991076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187597119:4813], now have 1 active actors on pipe
2025-10-10T14:32:00.991274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:00.991339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600802187597119:4813]
2025-10-10T14:32:00.991344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:00.991375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:00.991466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 407 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3568cbf-607bcf34-57b27d40-9f003135_0
2025-10-10T14:32:00.991656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 407 sessionId: src_id|d3568cbf-607bcf34-57b27d40-9f003135_0 is DEAD
2025-10-10T14:32:00.991803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3568cbf-607bcf34-57b27d40-9f003135_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:00.991814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3568cbf-607bcf34-57b27d40-9f003135_0] Write session will restart in 0.006088s
2025-10-10T14:32:00.991832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3568cbf-607bcf34-57b27d40-9f003135_0] Write session: Do CDS request
2025-10-10T14:32:00.991836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3568cbf-607bcf34-57b27d40-9f003135_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:00.998798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3568cbf-607bcf34-57b27d40-9f003135_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.998938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:00.998952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 408
2025-10-10T14:32:00.999064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:00.999099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:00.999110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:00.999118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:00.999525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 408 sessionId:  describe result for acl check
2025-10-10T14:32:00.999557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:00.999563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:00.999565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:00.999571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600802187597153:4850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:01.000116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600802187597153:4850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:01.002532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600802187597153:4850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:01.005486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600802187597153:4850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:01.005501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600802187597153:4850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:01.005505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600802187597153:4850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:01.005515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:01.007194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:01.009179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:01.009446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:01.009455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:01.009467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:01.009516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:01.009546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600805700354373:4096]
2025-10-10T14:32:01.009950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:01.010179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:01.010209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:01.010410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:01.010447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.010452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.010453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.010454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.010454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.010455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.010455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.010456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.010457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.010457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.010458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.010458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.010459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.010463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.010471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.010474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.010476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.010479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.010481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.010483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.010486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.010488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.010490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.010493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.010495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.010497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.010503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.010509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.010514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.010517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.010531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.010534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.010537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.010540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.010543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.010546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.010548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.010552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.010555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.010558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.010561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.010564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.010567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.010570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.010573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.010576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.010578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.010581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.010584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.010587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.010589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.010592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.010613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:01.012739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:01.013232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:01.013243Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:01.013244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:01.013247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:01.013252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 407 [2:7559600805700354373:4096]
2025-10-10T14:32:01.013264Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:01.013285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:01.013293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.013296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.013298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.013312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:01.013322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:01.013349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:01.013405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.013412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.013414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.013417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:01.013544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:01.013553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.013566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.013580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.013602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:01.013629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482564641:4850], now have 1 active actors on pipe
2025-10-10T14:32:01.013637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600802187597121:2438], now have 1 active actors on pipe
2025-10-10T14:32:01.013649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600805700354368:4096]
2025-10-10T14:32:01.013656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600805700354368:4096]
2025-10-10T14:32:01.013658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600805700354368:4096]
2025-10-10T14:32:01.013671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:01.013685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:01.013666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 407
2025-10-10T14:32:01.013690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:01.013694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:01.013695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:01.013706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:01.013709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:01.013719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 407
2025-10-10T14:32:01.013738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600805700354368:4096]
2025-10-10T14:32:01.013750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:01.013764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:01.013768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.013772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.013816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:01.013829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.013833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.013839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:01.013850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.013864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:01.013884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.014007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.014013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.014025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.014118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 408 partition: 0 MaxSeqNo: 40 sessionId: src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0
2025-10-10T14:32:01.014485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3568cbf-607bcf34-57b27d40-9f003135_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:01.016942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0] Write session: try to update token
2025-10-10T14:32:01.016961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:01.029845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId: src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:01.032300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:01.032321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:01.032324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:01.032325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:01.032335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600805700354368:4096]
2025-10-10T14:32:01.032339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600805700354368:4096]
2025-10-10T14:32:01.032343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600805700354368:4096]
2025-10-10T14:32:01.032387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:01.032392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:01.032399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.032401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:01.032401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:01.032405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:01.032537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:01.032582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:01.091250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600806482564655:4813]
2025-10-10T14:32:01.091532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 407, pipe: [1:7559600806482564655:4813]
2025-10-10T14:32:01.136896Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:01.137109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.137125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.137163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482564655:4813], now have 1 active actors on pipe
2025-10-10T14:32:01.137321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:01.137356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600806482564655:4813]
2025-10-10T14:32:01.137358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:01.137361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:01.137379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:01.137416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 408 reason: error at write: Disconnected sessionId: src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0
2025-10-10T14:32:01.137612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 408 sessionId: src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0 is DEAD
2025-10-10T14:32:01.137761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:01.137773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0] Write session will restart in 0.009915s
2025-10-10T14:32:01.137798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0] Write session: Do CDS request
2025-10-10T14:32:01.137804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:01.148699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.148778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:01.148789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 409
2025-10-10T14:32:01.148905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.148934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:01.148939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:01.148942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:01.149388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 409 sessionId:  describe result for acl check
2025-10-10T14:32:01.149419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:01.149425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:01.149427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:01.149431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600806482564828:4855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:01.149835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600806482564828:4855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:01.151873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600806482564828:4855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:01.151970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:01.154195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:01.154272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600806482564828:4855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:01.154285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600806482564828:4855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:01.154289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600806482564828:4855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:01.154297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:01.154509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:01.154533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:01.154545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:01.154610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:01.154646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600805700354621:4099]
2025-10-10T14:32:01.155014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:01.155266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:01.155301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:01.155519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:01.155556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.155561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.155561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.155562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.155563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.155564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.155564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.155565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.155565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.155566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.155567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.155567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.155568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.155571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.155581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.155583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.155585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.155587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.155589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.155591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.155593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.155596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.155598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.155600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.155602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.155604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.155609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.155614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.155618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.155621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.155624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.155627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.155631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.155637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.155643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.155648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.155656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.155665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.155668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.155671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.155676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.155679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.155682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.155688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.155695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.155700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.155704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.155710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.155713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.155718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.155724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.155728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.155764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:01.157992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:01.158511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:01.158532Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:01.158534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:01.158539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:01.158544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 408 [2:7559600805700354621:4099]
2025-10-10T14:32:01.158555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:01.158569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:01.158572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.158575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.158577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.158593Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:01.158606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:01.158617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:01.158678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.158685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.158688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.158691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:01.158753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:01.158759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.158770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.158786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.158808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:01.158833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482564669:2438], now have 1 active actors on pipe
2025-10-10T14:32:01.158842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482564897:4855], now have 1 active actors on pipe
2025-10-10T14:32:01.158850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600805700354615:4099]
2025-10-10T14:32:01.158854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600805700354615:4099]
2025-10-10T14:32:01.158856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600805700354615:4099]
2025-10-10T14:32:01.158869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:01.158885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:01.158886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:01.158888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:01.158890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:01.158903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:01.158906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:01.158879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 408
2025-10-10T14:32:01.158883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 408
2025-10-10T14:32:01.158943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.158955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.158969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600805700354615:4099]
2025-10-10T14:32:01.158977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:01.158985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:01.159006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:01.159019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.159024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.159027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:01.159037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.159052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:01.159077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.159211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.159221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.159235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.159327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 409 partition: 0 MaxSeqNo: 40 sessionId: src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0
2025-10-10T14:32:01.159663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc92ea9f-96c1b807-b22fcb09-b9c096d9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:01.162394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Write session: try to update token
2025-10-10T14:32:01.162413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:01.175656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId: src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:01.178077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:01.178097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:01.178100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:01.178101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:01.178109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600805700354615:4099]
2025-10-10T14:32:01.178113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600805700354615:4099]
2025-10-10T14:32:01.178116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600805700354615:4099]
2025-10-10T14:32:01.178168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:01.178170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:01.178176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:01.178179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.178179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:01.178180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:01.178306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:01.178395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:01.237677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600806482564908:4813]
2025-10-10T14:32:01.237974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 408, pipe: [1:7559600806482564908:4813]
2025-10-10T14:32:01.246694Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:32:01.282362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:01.282611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.282628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.282677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482564908:4813], now have 1 active actors on pipe
2025-10-10T14:32:01.282913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:01.282921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:01.282922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600806482564908:4813]
2025-10-10T14:32:01.282941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:01.282944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:01.283000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 409 reason: error at write: Disconnected sessionId: src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0
2025-10-10T14:32:01.283167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 409 sessionId: src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0 is DEAD
2025-10-10T14:32:01.283278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:01.283287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Write session will restart in 0.005007s
2025-10-10T14:32:01.283306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Write session: Do CDS request
2025-10-10T14:32:01.283311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:01.289862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.289981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:01.289999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 410
2025-10-10T14:32:01.290152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.290201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:01.290217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:01.290229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:01.290755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 410 sessionId:  describe result for acl check
2025-10-10T14:32:01.290808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:01.290816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:01.290817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:01.290825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600806482564946:4868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:01.291304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600806482564946:4868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:01.294273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600806482564946:4868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:01.296948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600806482564946:4868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:01.296961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600806482564946:4868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:01.296964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600806482564946:4868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:01.296971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:01.299704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:01.301986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:01.302156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:01.302168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:01.302177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:01.302316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:01.302349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600805700354860:4101]
2025-10-10T14:32:01.302750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:01.303004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:01.303043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:01.303288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:01.303329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.303333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.303334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.303335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.303336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.303336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.303337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.303338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.303338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.303339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.303340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.303341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.303341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.303344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.303353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.303355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.303357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.303359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.303362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.303364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.303366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.303368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.303370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.303372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.303374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.303376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.303382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.303388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.303392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.303395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.303398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.303403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.303407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.303413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.303418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.303428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.303436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.303439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.303442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.303448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.303451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.303454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.303461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.303465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.303467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.303470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.303476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.303479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.303481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.303486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.303489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.303492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.303517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:01.305598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:01.305900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:01.305913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:01.305915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:01.305919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:01.305924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 409 [2:7559600805700354860:4101]
2025-10-10T14:32:01.305936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:01.305951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:01.305958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.305961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.305962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.305976Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:01.305988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:01.306001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:01.306054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.306062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.306064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.306066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:01.306127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:01.306135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.306145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.306161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.306182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:01.306206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482564922:2438], now have 1 active actors on pipe
2025-10-10T14:32:01.306214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565114:4868], now have 1 active actors on pipe
2025-10-10T14:32:01.306221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600805700354855:4101]
2025-10-10T14:32:01.306228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600805700354855:4101]
2025-10-10T14:32:01.306230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600805700354855:4101]
2025-10-10T14:32:01.306243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:01.306260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:01.306262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:01.306265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:01.306267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:01.306279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:01.306286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:01.306276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 409
2025-10-10T14:32:01.306306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600805700354855:4101]
2025-10-10T14:32:01.306314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:01.306316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:01.306330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.306340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.306340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 409
2025-10-10T14:32:01.306381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:01.306393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.306397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.306403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:01.306414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.306427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:01.306459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.306673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.306684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.306699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.306821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 410 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0
2025-10-10T14:32:01.307141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 147 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:32:01.307174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dba0807b-1f7029d1-e3690a56-c136a3d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:01.309680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0] Write session: try to update token
2025-10-10T14:32:01.309695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:01.321909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId: src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:01.324308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:01.324326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:01.324328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:01.324329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:01.324336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600805700354855:4101]
2025-10-10T14:32:01.324340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600805700354855:4101]
2025-10-10T14:32:01.324343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600805700354855:4101]
2025-10-10T14:32:01.324378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:01.324385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.324386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:01.324386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:01.324391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:01.324395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:01.324392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:01.324508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:01.383147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600806482565163:4813]
2025-10-10T14:32:01.383486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 409, pipe: [1:7559600806482565163:4813]
2025-10-10T14:32:01.429258Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:01.429575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.429587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.429626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565163:4813], now have 1 active actors on pipe
2025-10-10T14:32:01.429847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:01.429916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:01.429931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600806482565163:4813]
2025-10-10T14:32:01.429954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:01.430045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 410 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0
2025-10-10T14:32:01.430268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 410 sessionId: src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0 is DEAD
2025-10-10T14:32:01.430377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:01.430387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0] Write session will restart in 0.008859s
2025-10-10T14:32:01.430405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0] Write session: Do CDS request
2025-10-10T14:32:01.430410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:01.440908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.440941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:01.440959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 411
2025-10-10T14:32:01.441129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.441170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:01.441180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:01.441185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:01.441590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 411 sessionId:  describe result for acl check
2025-10-10T14:32:01.441630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:01.441634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:01.441636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:01.441640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600806482565291:4872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:01.442090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600806482565291:4872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:01.444409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600806482565291:4872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:01.445262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:01.447453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:01.447621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:01.447632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:01.447644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:01.447695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:01.447738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600805700355098:4103]
2025-10-10T14:32:01.447818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600806482565291:4872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:01.447831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600806482565291:4872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:01.447834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600806482565291:4872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:01.447843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:01.448287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:01.448551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:01.448620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:01.448965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:01.449038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.449045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.449046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.449047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.449048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.449049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.449050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.449051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.449051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.449052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.449052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.449053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.449054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.449057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.449066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.449068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.449070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.449072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.449075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.449077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.449078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.449080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.449083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.449084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.449087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.449089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.449094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.449099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.449104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.449107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.449111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.449114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.449117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.449120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.449122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.449125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.449128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.449131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.449133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.449137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.449139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.449142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.449145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.449148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.449150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.449153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.449156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.449159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.449161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.449164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.449167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.449170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.449190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:01.451228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:01.451503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:01.451514Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:01.451515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:01.451518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:01.451522Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 410 [2:7559600805700355098:4103]
2025-10-10T14:32:01.451530Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:01.451545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:01.451549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.451551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.451553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.451565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:01.451573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:01.451583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:01.451620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.451624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.451625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.451627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:01.451804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 410
2025-10-10T14:32:01.451810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 410
2025-10-10T14:32:01.451850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:01.451859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.451866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.451875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.451889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:01.451908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565164:2438], now have 1 active actors on pipe
2025-10-10T14:32:01.451914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565394:4872], now have 1 active actors on pipe
2025-10-10T14:32:01.451927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.451930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.451944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600805700355093:4103]
2025-10-10T14:32:01.451948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600805700355093:4103]
2025-10-10T14:32:01.451949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600805700355093:4103]
2025-10-10T14:32:01.451959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:01.451969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:01.451976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:01.451976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:01.451977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:01.451992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:01.452000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:01.452022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:01.452034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.452041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.452044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:01.452054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.452067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:01.452089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600805700355093:4103]
2025-10-10T14:32:01.452097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:01.452103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:01.452109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.452256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.452264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.452278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.452364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 411 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0
2025-10-10T14:32:01.452702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac46c51-ab2bb8cf-1d0d5a17-e762bd7d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:01.455105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0] Write session: try to update token
2025-10-10T14:32:01.455119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:01.468141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId: src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:01.469710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:01.469730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:01.469733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:01.469736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:01.469745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600805700355093:4103]
2025-10-10T14:32:01.469750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600805700355093:4103]
2025-10-10T14:32:01.469754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600805700355093:4103]
2025-10-10T14:32:01.469786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:01.469798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:01.469801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:01.469802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:01.469809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.469812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:01.469938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:01.470758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:01.530026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600806482565429:4813]
2025-10-10T14:32:01.530174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 410, pipe: [1:7559600806482565429:4813]
2025-10-10T14:32:01.579471Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:01.579863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.579877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.579917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565429:4813], now have 1 active actors on pipe
2025-10-10T14:32:01.580100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:01.580214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:01.580223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600806482565429:4813]
2025-10-10T14:32:01.580250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:01.580324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 411 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0
2025-10-10T14:32:01.580541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 411 sessionId: src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0 is DEAD
2025-10-10T14:32:01.580705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:01.580715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0] Write session will restart in 0.008091s
2025-10-10T14:32:01.580738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0] Write session: Do CDS request
2025-10-10T14:32:01.580745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:01.589748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.589843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:01.589858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 412
2025-10-10T14:32:01.590008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.590043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:01.590054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:01.590058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:01.590555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 412 sessionId:  describe result for acl check
2025-10-10T14:32:01.590592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:01.590598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:01.590600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:01.590607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600806482565515:4887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:01.591139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600806482565515:4887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:01.593847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600806482565515:4887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:01.595877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:01.596235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600806482565515:4887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:01.596247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600806482565515:4887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:01.596249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600806482565515:4887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:01.596255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:01.598274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:01.598468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:01.598479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:01.598491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:01.598552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:01.598593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600805700355378:4118]
2025-10-10T14:32:01.599199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:01.599464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:01.599503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:01.599809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:01.599861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.599868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.599869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.599870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.599871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.599873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.599874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.599875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.599876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.599877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.599878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.599879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.599880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.599886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.599899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.599903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.599906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.599911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.599915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.599919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.599922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.599925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.599930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.599934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.599938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.599942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.599949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.599957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.599964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.599970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.599973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.599979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.599988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.599993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.600002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.600007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.600011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.600022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.600027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.600032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.600036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.600042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.600048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.600057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.600065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.600075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.600085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.600095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.600103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.600112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.600120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.600129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.600173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:01.602501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:01.603140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:01.603152Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:01.603154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:01.603158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:01.603165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 411 [2:7559600805700355378:4118]
2025-10-10T14:32:01.603178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:01.603199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:01.603207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.603210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.603216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.603233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:01.603240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:01.603247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:01.603301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.603308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.603310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.603312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:01.603373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:01.603383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.603395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.603407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.603425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:01.603450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565669:4887], now have 1 active actors on pipe
2025-10-10T14:32:01.603458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565438:2438], now have 1 active actors on pipe
2025-10-10T14:32:01.603466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600805700355372:4118]
2025-10-10T14:32:01.603472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600805700355372:4118]
2025-10-10T14:32:01.603473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600805700355372:4118]
2025-10-10T14:32:01.603489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:01.603507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:01.603506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:01.603510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:01.603511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:01.603526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:01.603533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:01.603514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 411
2025-10-10T14:32:01.603518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 411
2025-10-10T14:32:01.603570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.603579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.603592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600805700355372:4118]
2025-10-10T14:32:01.603604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:01.603618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:01.603636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:01.603647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.603655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.603657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:01.603668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.603682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:01.603706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.603850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.603858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.603871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.603959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 412 partition: 0 MaxSeqNo: 40 sessionId: src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0
2025-10-10T14:32:01.604358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58312e-ace75e6b-7690952a-ea8a41d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:01.607634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0] Write session: try to update token
2025-10-10T14:32:01.607654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:01.622805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:01.622827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:01.622831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:01.622833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:01.622844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600805700355372:4118]
2025-10-10T14:32:01.622848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600805700355372:4118]
2025-10-10T14:32:01.622852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600805700355372:4118]
2025-10-10T14:32:01.622877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId: src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:01.622900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:01.622908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:01.622914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:01.622914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.622916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:01.622917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:01.623061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:01.625660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:01.680587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600806482565684:4813]
2025-10-10T14:32:01.680774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 411, pipe: [1:7559600806482565684:4813]
2025-10-10T14:32:01.726117Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:01.726458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.726471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.726519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565684:4813], now have 1 active actors on pipe
2025-10-10T14:32:01.726668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:01.726759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:01.726763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:01.726772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:01.726812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600806482565684:4813]
2025-10-10T14:32:01.726834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 412 reason: error at write: Disconnected sessionId: src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0
2025-10-10T14:32:01.727050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 412 sessionId: src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0 is DEAD
2025-10-10T14:32:01.727204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:01.727210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0] Write session will restart in 0.005284s
2025-10-10T14:32:01.727229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0] Write session: Do CDS request
2025-10-10T14:32:01.727240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:01.733741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.733836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:01.733849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 413
2025-10-10T14:32:01.733962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.733997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:01.734007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:01.734011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:01.734412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 413 sessionId:  describe result for acl check
2025-10-10T14:32:01.734442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:01.734449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:01.734450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:01.734454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600806482565731:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:01.734900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600806482565731:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:01.737208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600806482565731:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:01.739421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600806482565731:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:01.739432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600806482565731:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:01.739435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600806482565731:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:01.739441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:01.740519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:01.742603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:01.742763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:01.742773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:01.742782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:01.742822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:01.743027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600805700355619:4121]
2025-10-10T14:32:01.743409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:01.743663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:01.743694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:01.743895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:01.743943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.743949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.743950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.743951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.743951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.743952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.743953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.743954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.743954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.743955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.743956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.743957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.743957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.743961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.743971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.743973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.743975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.743977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.743980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.743982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.743984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.743986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.743988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.743991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.743993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.743995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.744000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.744006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.744010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.744014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.744017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.744020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.744023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.744026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.744029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.744032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.744034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.744038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.744043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.744046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.744049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.744052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.744055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.744059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.744061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.744064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.744067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.744070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.744073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.744076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.744079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.744082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.744103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:01.746188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:01.746470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:01.746481Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:01.746484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:01.746488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:01.746493Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 412 [2:7559600805700355619:4121]
2025-10-10T14:32:01.746505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:01.746523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:01.746539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.746543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.746546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.746562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:01.746574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:01.746587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:01.746639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.746647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.746649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.746652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:01.746717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:01.746725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.746736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.746747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.746762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:01.746787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565915:4891], now have 1 active actors on pipe
2025-10-10T14:32:01.746794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565686:2438], now have 1 active actors on pipe
2025-10-10T14:32:01.746802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600805700355614:4121]
2025-10-10T14:32:01.746808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600805700355614:4121]
2025-10-10T14:32:01.746811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600805700355614:4121]
2025-10-10T14:32:01.746824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:01.746816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 412
2025-10-10T14:32:01.746841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:01.746820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 412
2025-10-10T14:32:01.746852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:01.746855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:01.746857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:01.746863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:01.746866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:01.746897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.746907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.746926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600805700355614:4121]
2025-10-10T14:32:01.746936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:01.746946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:01.746960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:01.746970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.746973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.746974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:01.746985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.747000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:01.747027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.747167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.747174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.747189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.747265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 413 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0
2025-10-10T14:32:01.747600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68b2203a-e7dfa3e0-d5c711d9-6eeebcf9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:01.750075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0] Write session: try to update token
2025-10-10T14:32:01.750090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:01.762675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId: src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:01.764969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:01.764989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:01.764992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:01.764994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:01.765003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600805700355614:4121]
2025-10-10T14:32:01.765008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600805700355614:4121]
2025-10-10T14:32:01.765011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600805700355614:4121]
2025-10-10T14:32:01.765047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:01.765057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:01.765063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:01.765064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.765066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:01.765067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:01.765199Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:01.765296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:01.826971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600806482565930:4813]
2025-10-10T14:32:01.827297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 412, pipe: [1:7559600806482565930:4813]
2025-10-10T14:32:01.869451Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:01.869747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.869760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.869798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565930:4813], now have 1 active actors on pipe
2025-10-10T14:32:01.869947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:01.870055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:01.870058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600806482565930:4813]
2025-10-10T14:32:01.870068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:01.870074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:01.870133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 413 reason: error at write: Disconnected sessionId: src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0
2025-10-10T14:32:01.870315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 413 sessionId: src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0 is DEAD
2025-10-10T14:32:01.870466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:01.870475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0] Write session will restart in 0.008298s
2025-10-10T14:32:01.870493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0] Write session: Do CDS request
2025-10-10T14:32:01.870501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:01.879722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.879845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:01.879859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 414
2025-10-10T14:32:01.879986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:01.880021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:01.880031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:01.880035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:01.880464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 414 sessionId:  describe result for acl check
2025-10-10T14:32:01.880499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:01.880505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:01.880507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:01.880513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600806482566069:4895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:01.880968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600806482566069:4895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:01.883039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600806482566069:4895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:01.884841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:01.885182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:01.885271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600806482566069:4895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:01.885281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600806482566069:4895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:01.885284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600806482566069:4895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:01.885289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:01.885312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:01.885321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:01.885344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:01.885396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:01.885431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600805700355860:4123]
2025-10-10T14:32:01.885978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:01.886232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:01.886263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:01.886466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:01.886498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.886503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.886503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.886504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.886505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.886505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.886506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.886506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.886507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.886507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.886508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.886509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.886509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.886513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.886521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.886523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.886525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.886537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.886541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.886543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.886545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.886547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.886549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.886551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.886553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.886555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.886561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.886566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:01.886571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.886574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:01.886577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.886580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:01.886587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.886590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:01.886593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.886598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:01.886606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.886611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:01.886619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.886624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:01.886633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.886642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:01.886648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.886651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:01.886653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.886656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:01.886661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.886664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.886667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.886670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.886672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.886678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.886702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:01.888783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:01.889167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:01.889179Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:01.889180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:01.889182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:01.889187Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 413 [2:7559600805700355860:4123]
2025-10-10T14:32:01.889194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:01.889206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:01.889208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.889210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.889212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.889223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:01.889231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:01.889238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:01.889277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.889282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.889283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.889285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:01.889357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:01.889364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.889371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:01.889377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:01.889386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:01.889407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482566164:4895], now have 1 active actors on pipe
2025-10-10T14:32:01.889409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482565931:2438], now have 1 active actors on pipe
2025-10-10T14:32:01.889414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600805700355855:4123]
2025-10-10T14:32:01.889416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600805700355855:4123]
2025-10-10T14:32:01.889417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600805700355855:4123]
2025-10-10T14:32:01.889425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:01.889436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:01.889446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:01.889450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:01.889452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:01.889456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:01.889457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:01.889466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600805700355855:4123]
2025-10-10T14:32:01.889468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:01.889470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:01.889487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 413
2025-10-10T14:32:01.889494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 413
2025-10-10T14:32:01.889561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.889572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.889600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:01.889610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:01.889613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:01.889614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:01.889621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:01.889630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:01.889642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.889827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:01.889836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:01.889850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:01.889938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 414 partition: 0 MaxSeqNo: 40 sessionId: src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0
2025-10-10T14:32:01.890223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c96581-53e70c0b-4a041bdf-b2602c58_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:01.892740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0] Write session: try to update token
2025-10-10T14:32:01.892753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:01.905799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId: src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:01.907583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:01.907600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:01.907602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:01.907604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:01.907612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600805700355855:4123]
2025-10-10T14:32:01.907615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600805700355855:4123]
2025-10-10T14:32:01.907617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600805700355855:4123]
2025-10-10T14:32:01.907653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:01.907659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:01.907660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:01.907668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:01.907677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:01.907681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:01.907791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:01.908381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:01.970380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600806482566176:4813]
2025-10-10T14:32:01.970670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 413, pipe: [1:7559600806482566176:4813]
2025-10-10T14:32:02.017465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:02.017856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.017868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.017907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600806482566176:4813], now have 1 active actors on pipe
2025-10-10T14:32:02.018047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:02.018093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600806482566176:4813]
2025-10-10T14:32:02.018111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:02.018120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:02.018185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 414 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0
2025-10-10T14:32:02.018377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 414 sessionId: src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0 is DEAD
2025-10-10T14:32:02.018513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:02.018523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0] Write session will restart in 0.005725s
2025-10-10T14:32:02.018553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0] Write session: Do CDS request
2025-10-10T14:32:02.018558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:02.025779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.025870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:02.025882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 415
2025-10-10T14:32:02.025995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.026022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:02.026035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:02.026039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:02.026461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 415 sessionId:  describe result for acl check
2025-10-10T14:32:02.026496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:02.026502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:02.026504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:02.026510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600810777533510:4899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:02.027073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600810777533510:4899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:02.029697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600810777533510:4899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:02.032068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600810777533510:4899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:02.032080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600810777533510:4899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:02.032084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600810777533510:4899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:02.032091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:02.033448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:02.035587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:02.035746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:02.035755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:02.035764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:02.035805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:02.035837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600809995323400:4125]
2025-10-10T14:32:02.036229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:02.036478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:02.036510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:02.036717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:02.036752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.036757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.036757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.036758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.036759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.036759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.036760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.036761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.036761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.036762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.036762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.036763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.036763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.036767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.036775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.036777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.036780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.036782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.036785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.036787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.036789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.036791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.036794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.036797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.036799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.036801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.036806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.036811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.036816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.036819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.036822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.036825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.036827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.036831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.036833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.036837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.036839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.036842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.036845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.036848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.036852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.036855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.036858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.036861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.036863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.036866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.036871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.036873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.036876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.036884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.036886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.036889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.036914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:02.039096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:02.039719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:02.039730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:02.039733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:02.039736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:02.039742Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 414 [2:7559600809995323400:4125]
2025-10-10T14:32:02.039752Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:02.039773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:02.039781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.039785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.039796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.039813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:02.039820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:02.039827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:02.039882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.039889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.039891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.039894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:02.039957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:02.039965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.039976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.039990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.040014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:02.040034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777533704:4899], now have 1 active actors on pipe
2025-10-10T14:32:02.040042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777533473:2438], now have 1 active actors on pipe
2025-10-10T14:32:02.040049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600809995323395:4125]
2025-10-10T14:32:02.040057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600809995323395:4125]
2025-10-10T14:32:02.040059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600809995323395:4125]
2025-10-10T14:32:02.040073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:02.040083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:02.040086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:02.040088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:02.040090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:02.040104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:02.040087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 414
2025-10-10T14:32:02.040107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:02.040094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 414
2025-10-10T14:32:02.040136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600809995323395:4125]
2025-10-10T14:32:02.040148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:02.040152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:02.040171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.040181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.040230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:02.040244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.040252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.040255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:02.040266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.040282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:02.040303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.040416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.040424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.040438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.040551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 415 partition: 0 MaxSeqNo: 40 sessionId: src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0
2025-10-10T14:32:02.040945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34925ce3-f5c93c34-ece77a1c-f75fcc38_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:02.043594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0] Write session: try to update token
2025-10-10T14:32:02.043610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:02.057107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId: src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:02.058491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:02.058510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:02.058513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:02.058515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:02.058525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600809995323395:4125]
2025-10-10T14:32:02.058541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600809995323395:4125]
2025-10-10T14:32:02.058546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600809995323395:4125]
2025-10-10T14:32:02.058595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:02.058596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:02.058602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:02.058607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:02.058608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.058610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:02.058755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:02.059572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:02.118325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600810777533718:4813]
2025-10-10T14:32:02.118590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 414, pipe: [1:7559600810777533718:4813]
2025-10-10T14:32:02.164575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:02.164793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.164806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.164842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777533718:4813], now have 1 active actors on pipe
2025-10-10T14:32:02.165020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:02.165122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:02.165124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:02.165137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:02.165168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600810777533718:4813]
2025-10-10T14:32:02.165238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 415 reason: error at write: Disconnected sessionId: src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0
2025-10-10T14:32:02.165449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 415 sessionId: src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0 is DEAD
2025-10-10T14:32:02.165625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:02.165631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0] Write session will restart in 0.005090s
2025-10-10T14:32:02.165649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0] Write session: Do CDS request
2025-10-10T14:32:02.165669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:02.171767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.171855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:02.171867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 416
2025-10-10T14:32:02.171975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.172008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:02.172017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:02.172021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:02.172440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 416 sessionId:  describe result for acl check
2025-10-10T14:32:02.172478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:02.172484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:02.172486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:02.172492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600810777533762:4904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:02.172996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600810777533762:4904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:02.175528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600810777533762:4904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:02.178471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600810777533762:4904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:02.178485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600810777533762:4904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:02.178489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600810777533762:4904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:02.178497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:02.180069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:02.182162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:02.182347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:02.182357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:02.182369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:02.182420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:02.182461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600809995323656:4128]
2025-10-10T14:32:02.183094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:02.183379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:02.183429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:02.183752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:02.183808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.183813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.183814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.183815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.183815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.183816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.183817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.183817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.183818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.183819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.183819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.183820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.183821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.183824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.183833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.183836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.183838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.183840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.183843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.183845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.183848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.183850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.183852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.183855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.183857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.183859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.183864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.183870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.183875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.183878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.183881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.183884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.183887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.183890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.183893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.183896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.183899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.183902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.183905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.183908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.183911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.183914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.183918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.183924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.183928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.183933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.183938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.183943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.183955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.183958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.183962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.183965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.183988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:02.186183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:02.186552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:02.186563Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:02.186566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:02.186569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:02.186575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 415 [2:7559600809995323656:4128]
2025-10-10T14:32:02.186588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:02.186610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:02.186617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.186621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.186623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.186640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:02.186653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:02.186662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:02.186723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.186727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.186729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.186732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:02.186802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:02.186809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.186819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.186836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.186858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:02.186886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777533964:4904], now have 1 active actors on pipe
2025-10-10T14:32:02.186895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777533732:2438], now have 1 active actors on pipe
2025-10-10T14:32:02.186903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600809995323651:4128]
2025-10-10T14:32:02.186909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600809995323651:4128]
2025-10-10T14:32:02.186912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600809995323651:4128]
2025-10-10T14:32:02.186925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:02.186942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:02.186939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 415
2025-10-10T14:32:02.186948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:02.186962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 415
2025-10-10T14:32:02.186952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:02.186953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:02.186965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:02.186968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:02.187220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.187231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.187248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600809995323651:4128]
2025-10-10T14:32:02.187260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:02.187274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:02.187296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4314410b-e00563bf-5f8d2639-846ecf90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:02.187306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.187314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.187317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:02.187328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.187343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:02.187368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.187516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.187524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.187539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.187637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 416 partition: 0 MaxSeqNo: 40 sessionId: src_id|4314410b-e00563bf-5f8d2639-846ecf90_0
2025-10-10T14:32:02.188004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5563cd1d-8670818a-8a238a06-e9c3835c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4314410b-e00563bf-5f8d2639-846ecf90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:02.190589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4314410b-e00563bf-5f8d2639-846ecf90_0] Write session: try to update token
2025-10-10T14:32:02.190605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4314410b-e00563bf-5f8d2639-846ecf90_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:02.204635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId: src_id|4314410b-e00563bf-5f8d2639-846ecf90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:02.205588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:02.205605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:02.205607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:02.205608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:02.205617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600809995323651:4128]
2025-10-10T14:32:02.205620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600809995323651:4128]
2025-10-10T14:32:02.205625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600809995323651:4128]
2025-10-10T14:32:02.205672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:02.205679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:02.205681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.205683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:02.205685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:02.205689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:02.205809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:02.207293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:02.265296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600810777533978:4813]
2025-10-10T14:32:02.265574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 415, pipe: [1:7559600810777533978:4813]
2025-10-10T14:32:02.307489Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 4 CurrentSessionLifetimeMs: 61060 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:32:02.310271Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:02.310680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.310693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.310732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777533978:4813], now have 1 active actors on pipe
2025-10-10T14:32:02.310915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:02.310982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:02.310988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600810777533978:4813]
2025-10-10T14:32:02.311009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:02.311072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 416 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4314410b-e00563bf-5f8d2639-846ecf90_0
2025-10-10T14:32:02.311278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 416 sessionId: src_id|4314410b-e00563bf-5f8d2639-846ecf90_0 is DEAD
2025-10-10T14:32:02.311416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4314410b-e00563bf-5f8d2639-846ecf90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:02.311423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4314410b-e00563bf-5f8d2639-846ecf90_0] Write session will restart in 0.005987s
2025-10-10T14:32:02.311441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4314410b-e00563bf-5f8d2639-846ecf90_0] Write session: Do CDS request
2025-10-10T14:32:02.311446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4314410b-e00563bf-5f8d2639-846ecf90_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:02.318787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4314410b-e00563bf-5f8d2639-846ecf90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.318898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:02.318911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 417
2025-10-10T14:32:02.319039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.319075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:02.319085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:02.319088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:02.319531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 417 sessionId:  describe result for acl check
2025-10-10T14:32:02.319566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:02.319574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:02.319576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:02.319582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600810777534026:4908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:02.320101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600810777534026:4908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:02.322493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600810777534026:4908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:02.325318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600810777534026:4908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:02.325360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600810777534026:4908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:02.325364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600810777534026:4908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:02.325372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:02.326729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:02.328758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:02.328951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:02.328960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:02.328969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:02.329010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:02.329047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600809995323900:4130]
2025-10-10T14:32:02.329571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:02.329833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:02.329871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:02.330102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:02.330152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.330159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.330160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.330161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.330162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.330162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.330163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.330163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.330164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.330165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.330165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.330166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.330167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.330171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.330180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.330182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.330184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.330186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.330188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.330190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.330192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.330194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.330196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.330198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.330200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.330202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.330208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.330214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.330218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.330221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.330224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.330227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.330230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.330233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.330235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.330238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.330241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.330244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.330246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.330249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.330252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.330255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.330257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.330260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.330264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.330267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.330269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.330272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.330274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.330278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.330280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.330283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.330306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:02.332398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:02.332898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:02.332914Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:02.332916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:02.332920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:02.332928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 416 [2:7559600809995323900:4130]
2025-10-10T14:32:02.332939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:02.332956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:02.332959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.332963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.332965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.332981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:02.332994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:02.333008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:02.333051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.333056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.333057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.333059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:02.333109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:02.333114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.333121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.333127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.333137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:02.333152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600809995323895:4130]
2025-10-10T14:32:02.333156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600809995323895:4130]
2025-10-10T14:32:02.333158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600809995323895:4130]
2025-10-10T14:32:02.333164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:02.333173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534213:4908], now have 1 active actors on pipe
2025-10-10T14:32:02.333176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777533980:2438], now have 1 active actors on pipe
2025-10-10T14:32:02.333175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:02.333179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:02.333181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:02.333182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:02.333191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:02.333193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:02.333207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600809995323895:4130]
2025-10-10T14:32:02.333216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:02.333221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:02.333266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 416
2025-10-10T14:32:02.333324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.333268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 416
2025-10-10T14:32:02.333343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.333366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:02.333371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.333374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.333376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:02.333384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.333392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:02.333408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.333590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.333596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.333607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.333697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 417 partition: 0 MaxSeqNo: 40 sessionId: src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0
2025-10-10T14:32:02.334058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4314410b-e00563bf-5f8d2639-846ecf90_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:02.336672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0] Write session: try to update token
2025-10-10T14:32:02.336690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:02.351281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:02.351303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:02.351306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:02.351308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:02.351317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600809995323895:4130]
2025-10-10T14:32:02.351323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600809995323895:4130]
2025-10-10T14:32:02.351326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600809995323895:4130]
2025-10-10T14:32:02.351374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:02.351375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:02.351380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:02.351382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.351385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:02.351385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:02.351525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:02.351934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId: src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:02.354669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:02.411221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600810777534227:4813]
2025-10-10T14:32:02.411515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 416, pipe: [1:7559600810777534227:4813]
2025-10-10T14:32:02.459372Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:02.459729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.459740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.459779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534227:4813], now have 1 active actors on pipe
2025-10-10T14:32:02.460028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:02.460048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:02.460053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:02.460099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600810777534227:4813]
2025-10-10T14:32:02.460119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 417 reason: error at write: Disconnected sessionId: src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0
2025-10-10T14:32:02.460316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 417 sessionId: src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0 is DEAD
2025-10-10T14:32:02.460453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:02.460434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:02.460462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0] Write session will restart in 0.006348s
2025-10-10T14:32:02.460481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0] Write session: Do CDS request
2025-10-10T14:32:02.460486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:02.467776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.467884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:02.467899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 418
2025-10-10T14:32:02.468041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.468077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:02.468088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:02.468092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:02.468852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 418 sessionId:  describe result for acl check
2025-10-10T14:32:02.468888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:02.468894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:02.468896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:02.468902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600810777534274:4912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:02.469459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600810777534274:4912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:02.472053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600810777534274:4912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:02.474689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600810777534274:4912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:02.474703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600810777534274:4912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:02.474706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600810777534274:4912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:02.474714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:02.475147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:02.477224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:02.477383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:02.477394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:02.477403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:02.477448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:02.477479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600809995324146:4132]
2025-10-10T14:32:02.477855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:02.478115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:02.478147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:02.478414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:02.478459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.478463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.478464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.478464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.478465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.478466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.478466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.478467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.478468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.478468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.478469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.478470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.478470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.478473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.478481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.478484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.478486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.478488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.478490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.478492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.478495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.478497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.478499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.478501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.478504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.478506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.478510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.478517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.478521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.478524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.478527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.478530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.478532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.478545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.478548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.478551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.478554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.478556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.478559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.478562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.478564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.478567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.478570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.478573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.478576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.478579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.478581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.478584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.478586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.478590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.478592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.478595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.478616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:02.480653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:02.481020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:02.481031Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:02.481032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:02.481035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:02.481039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 417 [2:7559600809995324146:4132]
2025-10-10T14:32:02.481046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:02.481059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:02.481065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.481067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.481068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.481080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:02.481088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:02.481096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:02.481139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.481146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.481148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.481150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:02.481196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:02.481201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.481207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.481213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.481225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:02.481243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600809995324141:4132]
2025-10-10T14:32:02.481248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600809995324141:4132]
2025-10-10T14:32:02.481249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600809995324141:4132]
2025-10-10T14:32:02.481255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:02.481265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534464:4912], now have 1 active actors on pipe
2025-10-10T14:32:02.481266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:02.481269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:02.481270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:02.481271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534229:2438], now have 1 active actors on pipe
2025-10-10T14:32:02.481277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:02.481286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:02.481292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:02.481311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600809995324141:4132]
2025-10-10T14:32:02.481322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:02.481344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:02.481353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 417
2025-10-10T14:32:02.481353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 417
2025-10-10T14:32:02.481425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.481433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.481457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|643655cf-9ca836db-252284d4-60133e04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:02.481466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.481471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.481472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:02.481480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.481491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:02.481505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.481650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.481655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.481671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.481749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 418 partition: 0 MaxSeqNo: 40 sessionId: src_id|643655cf-9ca836db-252284d4-60133e04_0
2025-10-10T14:32:02.482049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dccf567-1387518b-8abda5db-5f8d99f0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|643655cf-9ca836db-252284d4-60133e04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:02.484469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643655cf-9ca836db-252284d4-60133e04_0] Write session: try to update token
2025-10-10T14:32:02.484482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643655cf-9ca836db-252284d4-60133e04_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:02.497960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId: src_id|643655cf-9ca836db-252284d4-60133e04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:02.499656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:02.499682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:02.499686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:02.499688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:02.499696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600809995324141:4132]
2025-10-10T14:32:02.499703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600809995324141:4132]
2025-10-10T14:32:02.499708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600809995324141:4132]
2025-10-10T14:32:02.499748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:02.499753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.499755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:02.499756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:02.499762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:02.499766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:02.499885Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:02.500711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:02.560188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600810777534497:4813]
2025-10-10T14:32:02.560439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 417, pipe: [1:7559600810777534497:4813]
2025-10-10T14:32:02.601941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:02.602187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.602200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.602237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534497:4813], now have 1 active actors on pipe
2025-10-10T14:32:02.602496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:02.602483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:02.602503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:02.602507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:02.602549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600810777534497:4813]
2025-10-10T14:32:02.602574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 418 reason: error at write: Disconnected sessionId: src_id|643655cf-9ca836db-252284d4-60133e04_0
2025-10-10T14:32:02.602797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 418 sessionId: src_id|643655cf-9ca836db-252284d4-60133e04_0 is DEAD
2025-10-10T14:32:02.602929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643655cf-9ca836db-252284d4-60133e04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:02.602941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643655cf-9ca836db-252284d4-60133e04_0] Write session will restart in 0.007434s
2025-10-10T14:32:02.602968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643655cf-9ca836db-252284d4-60133e04_0] Write session: Do CDS request
2025-10-10T14:32:02.602979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643655cf-9ca836db-252284d4-60133e04_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:02.611932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|643655cf-9ca836db-252284d4-60133e04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.612063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:02.612079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 419
2025-10-10T14:32:02.612228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.612275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:02.612283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:02.612287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:02.612635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 419 sessionId:  describe result for acl check
2025-10-10T14:32:02.612662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:02.612667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:02.612669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:02.612673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600810777534565:4927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:02.613164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600810777534565:4927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:02.615858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600810777534565:4927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:02.618286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600810777534565:4927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:02.618301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600810777534565:4927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:02.618305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600810777534565:4927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:02.618314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:02.622512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:02.622997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:02.623426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:02.623458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:02.623489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:02.623603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:02.623651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600809995324433:4148]
2025-10-10T14:32:02.624263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:02.624581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:02.624656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:02.625004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:02.625078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.625085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.625086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.625087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.625088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.625090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.625091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.625092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.625093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.625095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.625096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.625097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.625098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.625104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.625117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.625121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.625125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.625129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.625136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.625140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.625143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.625149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.625153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.625156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.625159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.625162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.625170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.625182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.625192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.625197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.625202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.625211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.625220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.625229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.625234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.625243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.625251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.625255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.625264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.625268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.625272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.625276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.625280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.625289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.625298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.625307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.625315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.625320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.625328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.625356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.625360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.625369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.625407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:02.627672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:02.628061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:02.628078Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:02.628080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:02.628083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:02.628088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 418 [2:7559600809995324433:4148]
2025-10-10T14:32:02.628100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:02.628116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:02.628119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.628122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.628124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.628140Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:02.628146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:02.628154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:02.628207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.628216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.628217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.628219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:02.628282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:02.628290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.628303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.628315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.628338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:02.628361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534509:2438], now have 1 active actors on pipe
2025-10-10T14:32:02.628369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534747:4927], now have 1 active actors on pipe
2025-10-10T14:32:02.628376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600809995324428:4148]
2025-10-10T14:32:02.628385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600809995324428:4148]
2025-10-10T14:32:02.628387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600809995324428:4148]
2025-10-10T14:32:02.628400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:02.628414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:02.628424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:02.628427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:02.628429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:02.628434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:02.628437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:02.628419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 418
2025-10-10T14:32:02.628458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600809995324428:4148]
2025-10-10T14:32:02.628466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:02.628467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:02.628438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 418
2025-10-10T14:32:02.628488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.628497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.628551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c8ed6f2-592a2c64-558acf48-40356035_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:02.628565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.628569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.628576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:02.628587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.628601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:02.628622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.628789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.628800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.628818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.628894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 419 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c8ed6f2-592a2c64-558acf48-40356035_0
2025-10-10T14:32:02.629303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|643655cf-9ca836db-252284d4-60133e04_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c8ed6f2-592a2c64-558acf48-40356035_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:02.632007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8ed6f2-592a2c64-558acf48-40356035_0] Write session: try to update token
2025-10-10T14:32:02.632028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8ed6f2-592a2c64-558acf48-40356035_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:02.646861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId: src_id|1c8ed6f2-592a2c64-558acf48-40356035_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:02.647124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:02.647142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:02.647145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:02.647147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:02.647156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600809995324428:4148]
2025-10-10T14:32:02.647161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600809995324428:4148]
2025-10-10T14:32:02.647164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600809995324428:4148]
2025-10-10T14:32:02.647215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:02.647219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:02.647227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:02.647227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.647229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:02.647231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:02.647443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:02.649209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:02.702524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600810777534766:4813]
2025-10-10T14:32:02.702830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 418, pipe: [1:7559600810777534766:4813]
2025-10-10T14:32:02.751547Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:02.751784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.751796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.751836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534766:4813], now have 1 active actors on pipe
2025-10-10T14:32:02.752014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:02.752080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:02.752101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600810777534766:4813]
2025-10-10T14:32:02.752125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:02.752213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 419 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c8ed6f2-592a2c64-558acf48-40356035_0
2025-10-10T14:32:02.752438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 419 sessionId: src_id|1c8ed6f2-592a2c64-558acf48-40356035_0 is DEAD
2025-10-10T14:32:02.752626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8ed6f2-592a2c64-558acf48-40356035_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:02.752640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8ed6f2-592a2c64-558acf48-40356035_0] Write session will restart in 0.006355s
2025-10-10T14:32:02.752667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8ed6f2-592a2c64-558acf48-40356035_0] Write session: Do CDS request
2025-10-10T14:32:02.752674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8ed6f2-592a2c64-558acf48-40356035_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:02.759845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8ed6f2-592a2c64-558acf48-40356035_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.759922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:02.759936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 420
2025-10-10T14:32:02.760061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.760104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:02.760116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:02.760120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:02.760512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 420 sessionId:  describe result for acl check
2025-10-10T14:32:02.760550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:02.760555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:02.760556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:02.760560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600810777534795:4931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:02.760989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600810777534795:4931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:02.763755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600810777534795:4931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:02.767006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600810777534795:4931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:02.767019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600810777534795:4931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:02.767022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600810777534795:4931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:02.767030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:02.769323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:02.771384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:02.771554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:02.771562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:02.771571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:02.771612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:02.771644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600809995324680:4150]
2025-10-10T14:32:02.772018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:02.772250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:02.772281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:02.772492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:02.772532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.772536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.772537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.772537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.772538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.772539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.772540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.772540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.772541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.772542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.772542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.772543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.772543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.772547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.772556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.772558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.772561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.772563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.772565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.772567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.772569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.772571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.772574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.772576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.772578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.772580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.772585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.772591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.772595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.772598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.772602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.772605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.772616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.772619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.772622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.772625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.772627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.772630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.772633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.772636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.772638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.772641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.772645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.772648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.772650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.772653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.772655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.772658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.772660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.772663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.772667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.772673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.772695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:02.774798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:02.775244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:02.775254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:02.775257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:02.775260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:02.775265Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 419 [2:7559600809995324680:4150]
2025-10-10T14:32:02.775276Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:02.775295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:02.775301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.775305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.775307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.775323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:02.775334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:02.775345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:02.775391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.775397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.775399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.775401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:02.775460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:02.775468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.775478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.775494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.775516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:02.775540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534969:4931], now have 1 active actors on pipe
2025-10-10T14:32:02.775549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777534767:2438], now have 1 active actors on pipe
2025-10-10T14:32:02.775555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600809995324675:4150]
2025-10-10T14:32:02.775558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600809995324675:4150]
2025-10-10T14:32:02.775560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600809995324675:4150]
2025-10-10T14:32:02.775573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:02.775586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:02.775580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 419
2025-10-10T14:32:02.775588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:02.775591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:02.775593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:02.775590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 419
2025-10-10T14:32:02.775602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:02.775605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:02.775624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600809995324675:4150]
2025-10-10T14:32:02.775634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:02.775639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:02.775652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.775661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.775713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43a0dc5b-840e3989-8655841a-216c11d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:02.775724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.775728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.775730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:02.775740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.775754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:02.775774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.775872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.775879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.775891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.775967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 420 partition: 0 MaxSeqNo: 40 sessionId: src_id|43a0dc5b-840e3989-8655841a-216c11d8_0
2025-10-10T14:32:02.776334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8ed6f2-592a2c64-558acf48-40356035_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43a0dc5b-840e3989-8655841a-216c11d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:02.778796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43a0dc5b-840e3989-8655841a-216c11d8_0] Write session: try to update token
2025-10-10T14:32:02.778814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43a0dc5b-840e3989-8655841a-216c11d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:02.791887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId: src_id|43a0dc5b-840e3989-8655841a-216c11d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:02.794185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:02.794354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:02.794371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:02.794375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:02.794377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:02.794388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600809995324675:4150]
2025-10-10T14:32:02.794392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600809995324675:4150]
2025-10-10T14:32:02.794396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600809995324675:4150]
2025-10-10T14:32:02.794428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:02.794441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:02.794444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:02.794449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.794457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.794479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:02.794494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.794502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:02.794644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:02.852038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600810777535019:4813]
2025-10-10T14:32:02.852312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 419, pipe: [1:7559600810777535019:4813]
2025-10-10T14:32:02.903590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:02.903913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777535019:4813], now have 1 active actors on pipe
2025-10-10T14:32:02.904113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:02.904188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:02.904227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:02.904235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600810777535019:4813]
2025-10-10T14:32:02.904315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 420 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43a0dc5b-840e3989-8655841a-216c11d8_0
2025-10-10T14:32:02.904485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 420 sessionId: src_id|43a0dc5b-840e3989-8655841a-216c11d8_0 is DEAD
2025-10-10T14:32:02.904645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a0dc5b-840e3989-8655841a-216c11d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:02.904656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a0dc5b-840e3989-8655841a-216c11d8_0] Write session will restart in 0.008669s
2025-10-10T14:32:02.904677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a0dc5b-840e3989-8655841a-216c11d8_0] Write session: Do CDS request
2025-10-10T14:32:02.904682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a0dc5b-840e3989-8655841a-216c11d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:02.914937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43a0dc5b-840e3989-8655841a-216c11d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.915023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:02.915037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 421
2025-10-10T14:32:02.915158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:02.915197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:02.915209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:02.915213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:02.915650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 421 sessionId:  describe result for acl check
2025-10-10T14:32:02.915691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:02.915699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:02.915701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:02.915707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600810777535107:4935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:02.916274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600810777535107:4935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:02.919143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600810777535107:4935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:02.920857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:02.923369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:02.923498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600810777535107:4935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:02.923509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600810777535107:4935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:02.923513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600810777535107:4935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:02.923519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:02.923566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:02.923578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:02.923591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:02.923647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:02.923689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600809995324928:4152]
2025-10-10T14:32:02.924289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:02.924546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:02.924587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:02.924905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:02.924957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.924963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.924964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.924965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.924966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.924967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.924969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.924970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.924971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.924972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.924974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.924975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.924976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.924981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.924995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.924999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.925003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.925007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.925011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.925015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.925019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.925023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.925032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.925036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.925044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.925048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.925059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.925073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:02.925084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.925093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:02.925101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.925107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:02.925115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.925124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:02.925135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.925144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:02.925148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.925154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:02.925158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.925168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:02.925173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.925178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:02.925187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.925196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:02.925200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.925206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:02.925210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.925219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.925227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.925233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.925241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.925248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.925293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:02.927500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:02.927959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:02.927973Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:02.927975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:02.927979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:02.927984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 420 [2:7559600809995324928:4152]
2025-10-10T14:32:02.927996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:02.928016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:02.928023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.928027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.928029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.928046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:02.928058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:02.928069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:02.928126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.928132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.928134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.928137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:02.928199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:02.928206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.928218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:02.928235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:02.928258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:02.928285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777535020:2438], now have 1 active actors on pipe
2025-10-10T14:32:02.928289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600810777535260:4935], now have 1 active actors on pipe
2025-10-10T14:32:02.928296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600809995324923:4152]
2025-10-10T14:32:02.928300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600809995324923:4152]
2025-10-10T14:32:02.928302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600809995324923:4152]
2025-10-10T14:32:02.928315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:02.928317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 420
2025-10-10T14:32:02.928333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:02.928335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 420
2025-10-10T14:32:02.928334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:02.928347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:02.928347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:02.928349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:02.928351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:02.928374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600809995324923:4152]
2025-10-10T14:32:02.928377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:02.928379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:02.928394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.928399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.928449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|454550dd-315e6815-77b68a50-d87d969a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:02.928462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:02.928466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:02.928469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:02.928480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:02.928495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:02.928516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.928655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:02.928664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:02.928679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:02.928811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 421 partition: 0 MaxSeqNo: 40 sessionId: src_id|454550dd-315e6815-77b68a50-d87d969a_0
2025-10-10T14:32:02.929255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43a0dc5b-840e3989-8655841a-216c11d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|454550dd-315e6815-77b68a50-d87d969a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:02.932057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|454550dd-315e6815-77b68a50-d87d969a_0] Write session: try to update token
2025-10-10T14:32:02.932078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|454550dd-315e6815-77b68a50-d87d969a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:02.945976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId: src_id|454550dd-315e6815-77b68a50-d87d969a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:02.946448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:02.946469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:02.946472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:02.946475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:02.946486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600809995324923:4152]
2025-10-10T14:32:02.946493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600809995324923:4152]
2025-10-10T14:32:02.946497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600809995324923:4152]
2025-10-10T14:32:02.946558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:02.946563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:02.946571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:02.946573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:02.946573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:02.946577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:02.946727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:02.948545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:03.004605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600815072502568:4813]
2025-10-10T14:32:03.004898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 420, pipe: [1:7559600815072502568:4813]
2025-10-10T14:32:03.053111Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:03.053620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.053638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.053684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072502568:4813], now have 1 active actors on pipe
2025-10-10T14:32:03.053878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:03.053906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600815072502568:4813]
2025-10-10T14:32:03.053931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:03.053937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:03.054022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 421 reason: status is not ok: tablet will be restarted right now sessionId: src_id|454550dd-315e6815-77b68a50-d87d969a_0
2025-10-10T14:32:03.054220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 421 sessionId: src_id|454550dd-315e6815-77b68a50-d87d969a_0 is DEAD
2025-10-10T14:32:03.054419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454550dd-315e6815-77b68a50-d87d969a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:03.054433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454550dd-315e6815-77b68a50-d87d969a_0] Write session will restart in 0.005776s
2025-10-10T14:32:03.054458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454550dd-315e6815-77b68a50-d87d969a_0] Write session: Do CDS request
2025-10-10T14:32:03.054464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454550dd-315e6815-77b68a50-d87d969a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:03.061893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|454550dd-315e6815-77b68a50-d87d969a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.061949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:03.061962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 422
2025-10-10T14:32:03.062108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.062135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:03.062143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:03.062146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:03.062711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 422 sessionId:  describe result for acl check
2025-10-10T14:32:03.062750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:03.062758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:03.062760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:03.062766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600815072502604:4939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:03.063401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600815072502604:4939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:03.066042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600815072502604:4939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:03.068829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600815072502604:4939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:03.068843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600815072502604:4939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:03.068847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600815072502604:4939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:03.068855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:03.070356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:03.072371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:03.072544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:03.072556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:03.072568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:03.072619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:03.072660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600814290292475:4154]
2025-10-10T14:32:03.073248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:03.073543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:03.073587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:03.073896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:03.073947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.073953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.073955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.073956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.073957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.073958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.073959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.073960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.073961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.073962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.073963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.073964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.073965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.073971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.073983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.073987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.073991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.073994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.073997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.074002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.074006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.074009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.074015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.074023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.074028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.074036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.074044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.074052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.074063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.074068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.074076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.074082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.074086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.074091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.074094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.074102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.074110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.074115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.074124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.074131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.074135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.074140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.074145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.074155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.074163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.074168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.074178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.074183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.074186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.074196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.074201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.074206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.074243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:03.076351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:03.076748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:03.076761Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:03.076763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:03.076767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:03.076772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 421 [2:7559600814290292475:4154]
2025-10-10T14:32:03.076782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:03.076798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:03.076806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.076809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.076811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.076825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:03.076837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:03.076848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:03.076904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.076911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.076912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.076914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:03.077073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 421
2025-10-10T14:32:03.077120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:03.077128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.077140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.077119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 421
2025-10-10T14:32:03.077153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.077176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:03.077201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072502569:2438], now have 1 active actors on pipe
2025-10-10T14:32:03.077209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072502807:4939], now have 1 active actors on pipe
2025-10-10T14:32:03.077223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.077231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.077254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600814290292470:4154]
2025-10-10T14:32:03.077260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600814290292470:4154]
2025-10-10T14:32:03.077262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600814290292470:4154]
2025-10-10T14:32:03.077275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:03.077292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:03.077295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:03.077298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:03.077300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:03.077313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:03.077320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:03.077356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:03.077367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.077375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.077377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:03.077387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.077401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:03.077430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600814290292470:4154]
2025-10-10T14:32:03.077442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:03.077456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:03.077457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.077597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.077606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.077621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.077688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 422 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0
2025-10-10T14:32:03.078021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454550dd-315e6815-77b68a50-d87d969a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:03.080742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0] Write session: try to update token
2025-10-10T14:32:03.080764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:03.093852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId: src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:03.093968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:03.093987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:03.093997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600814290292470:4154]
2025-10-10T14:32:03.094052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:03.094051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:03.094231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:03.094376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:03.094518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:03.094676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:03.094869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:03.094908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:03.096200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:03.096384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.096399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.096433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:03.096492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:03.105847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:03.105868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:03.105871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:03.105874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:03.105884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600814290292470:4154]
2025-10-10T14:32:03.105888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600814290292470:4154]
2025-10-10T14:32:03.105892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600814290292470:4154]
2025-10-10T14:32:03.105934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:03.105935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:03.105942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.105943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:03.105944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:03.105946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:03.106071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:03.154103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600815072502834:4813]
2025-10-10T14:32:03.154326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 421, pipe: [1:7559600815072502834:4813]
2025-10-10T14:32:03.214828Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:03.222054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.222076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.222231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.222289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.222348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.222404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.222801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.222811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.222871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.222995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.223055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.223125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.223166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.223172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.223252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.223310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.223365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.223426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.223470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.223479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.223543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.223598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.223657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.223715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.223826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.223832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.223891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.223945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.224010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.224067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.224105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.224111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.224170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.224223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.224289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.224346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.224396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.224402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.224462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.224522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.224590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.224647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.224687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.224692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.224758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.224817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.224875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.224930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.224969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.224975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.225037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.225089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.225143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.225196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.225236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.225241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.225309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:03.225395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:03.225450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:03.225505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:03.225564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:03.225572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:03.225621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072502834:4813], now have 1 active actors on pipe
2025-10-10T14:32:03.225905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:03.225916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:03.225942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:03.225916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600815072502834:4813]
2025-10-10T14:32:03.225934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:03.225942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 422 reason: error at write: Disconnected sessionId: src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0
2025-10-10T14:32:03.226127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 422 sessionId: src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0 is DEAD
2025-10-10T14:32:03.226318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:03.226330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0] Write session will restart in 0.008267s
2025-10-10T14:32:03.226356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0] Write session: Do CDS request
2025-10-10T14:32:03.226364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:03.235829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.235935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:03.235947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 423
2025-10-10T14:32:03.236074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.236102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:03.236109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:03.236113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:03.236457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 423 sessionId:  describe result for acl check
2025-10-10T14:32:03.236484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:03.236488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:03.236490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:03.236496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600815072502913:4944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:03.236947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600815072502913:4944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:03.239237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600815072502913:4944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:03.241677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600815072502913:4944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:03.241690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600815072502913:4944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:03.241692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600815072502913:4944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:03.241699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:03.242298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:03.244751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:03.244941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:03.244952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:03.244964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:03.245018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:03.245062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600814290292738:4157]
2025-10-10T14:32:03.245679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:03.245938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:03.245976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:03.246202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:03.246245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.246251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.246251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.246252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.246253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.246253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.246254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.246255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.246255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.246256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.246257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.246257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.246258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.246262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.246271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.246273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.246276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.246278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.246280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.246282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.246285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.246287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.246289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.246291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.246293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.246295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.246301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.246306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.246312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.246315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.246317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.246321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.246327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.246331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.246333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.246338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.246346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.246351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.246358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.246363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.246371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.246376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.246384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.246387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.246391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.246394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.246397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.246400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.246402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.246405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.246408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.246410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.246435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:03.248842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:03.249566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:03.249579Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:03.249581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:03.249584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:03.249590Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 422 [2:7559600814290292738:4157]
2025-10-10T14:32:03.249603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:03.249621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:03.249630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.249633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.249636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.249652Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:03.249665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:03.249672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:03.249720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.249728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.249729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.249731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:03.249795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:03.249804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.249815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.249828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.249850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:03.249874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503076:4944], now have 1 active actors on pipe
2025-10-10T14:32:03.249881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072502835:2438], now have 1 active actors on pipe
2025-10-10T14:32:03.249888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600814290292733:4157]
2025-10-10T14:32:03.249895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600814290292733:4157]
2025-10-10T14:32:03.249897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600814290292733:4157]
2025-10-10T14:32:03.249910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:03.249923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:03.249926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:03.249933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:03.249935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:03.249935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:03.249938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:03.249956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600814290292733:4157]
2025-10-10T14:32:03.249958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:03.249961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:03.249962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 422
2025-10-10T14:32:03.249965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 422
2025-10-10T14:32:03.250001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.250009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.250035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:03.250045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.250051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.250053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:03.250062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.250073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:03.250088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.250222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.250233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.250251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.250341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 423 partition: 0 MaxSeqNo: 40 sessionId: src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0
2025-10-10T14:32:03.250715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f98a2f-aaf30173-38cd1a2c-fbf56b45_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:03.253460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0] Write session: try to update token
2025-10-10T14:32:03.253476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:03.267216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId: src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:03.268199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:03.268219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:03.268222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:03.268223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:03.268230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600814290292733:4157]
2025-10-10T14:32:03.268233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600814290292733:4157]
2025-10-10T14:32:03.268236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600814290292733:4157]
2025-10-10T14:32:03.268273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:03.268279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.268281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:03.268281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:03.268287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:03.268292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:03.268412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:03.269948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:03.326158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600815072503090:4813]
2025-10-10T14:32:03.326411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 422, pipe: [1:7559600815072503090:4813]
2025-10-10T14:32:03.374244Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:03.374478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.374495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.374540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503090:4813], now have 1 active actors on pipe
2025-10-10T14:32:03.374727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:03.374769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:03.374779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:03.374807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600815072503090:4813]
2025-10-10T14:32:03.374828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:03.374854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 423 reason: error at write: Disconnected sessionId: src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0
2025-10-10T14:32:03.375035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 423 sessionId: src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0 is DEAD
2025-10-10T14:32:03.375186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:03.375195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0] Write session will restart in 0.007526s
2025-10-10T14:32:03.375214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0] Write session: Do CDS request
2025-10-10T14:32:03.375218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:03.383865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.383929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:03.383941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 424
2025-10-10T14:32:03.384071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.384108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:03.384124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:03.384130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:03.384601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 424 sessionId:  describe result for acl check
2025-10-10T14:32:03.384635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:03.384641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:03.384643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:03.384649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600815072503163:4948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:03.385180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600815072503163:4948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:03.388044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600815072503163:4948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:03.390053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600815072503163:4948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:03.390066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600815072503163:4948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:03.390069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600815072503163:4948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:03.390076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:03.390354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:03.392393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:03.392571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:03.392582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:03.392593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:03.392644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:03.392682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600814290292990:4159]
2025-10-10T14:32:03.393267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:03.393498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:03.393538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:03.393846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:03.393896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.393901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.393903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.393904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.393905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.393906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.393907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.393909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.393910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.393911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.393912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.393913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.393914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.393920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.393932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.393936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.393948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.393952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.393956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.393960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.393968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.393972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.393980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.393989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.393992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.393996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.394003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.394016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.394027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.394032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.394037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.394042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.394051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.394060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.394068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.394078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.394082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.394088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.394092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.394097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.394101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.394107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.394117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.394125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.394133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.394138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.394147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.394156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.394163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.394169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.394178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.394187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.394230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:03.396388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:03.396710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:03.396721Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:03.396724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:03.396728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:03.396733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 423 [2:7559600814290292990:4159]
2025-10-10T14:32:03.396748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:03.396767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:03.396774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.396777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.396780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.396799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:03.396810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:03.396822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:03.396871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.396878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.396880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.396882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:03.396943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:03.396950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.396961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.396977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.396999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:03.397025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503333:4948], now have 1 active actors on pipe
2025-10-10T14:32:03.397028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503091:2438], now have 1 active actors on pipe
2025-10-10T14:32:03.397035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600814290292985:4159]
2025-10-10T14:32:03.397037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600814290292985:4159]
2025-10-10T14:32:03.397039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600814290292985:4159]
2025-10-10T14:32:03.397051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:03.397064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:03.397065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:03.397067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:03.397069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:03.397085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:03.397093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:03.397079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 423
2025-10-10T14:32:03.397082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 423
2025-10-10T14:32:03.397112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600814290292985:4159]
2025-10-10T14:32:03.397119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:03.397121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:03.397139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.397149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.397195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:03.397207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.397211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.397217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:03.397228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.397242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:03.397263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.397397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.397407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.397423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.397512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 424 partition: 0 MaxSeqNo: 40 sessionId: src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0
2025-10-10T14:32:03.397835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aee121fd-f52cb0b8-b7bba45a-87b6d713_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:03.400280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0] Write session: try to update token
2025-10-10T14:32:03.400295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:03.413053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId: src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:03.415686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:03.416420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.416447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.416470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:03.416473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:03.416476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:03.416478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:03.416488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600814290292985:4159]
2025-10-10T14:32:03.416492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600814290292985:4159]
2025-10-10T14:32:03.416496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600814290292985:4159]
2025-10-10T14:32:03.416532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:03.416542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:03.416546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:03.416554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:03.416561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.416563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:03.416696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:03.475120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600815072503346:4813]
2025-10-10T14:32:03.475370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 423, pipe: [1:7559600815072503346:4813]
2025-10-10T14:32:03.522982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:03.523490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:03.523539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503346:4813], now have 1 active actors on pipe
2025-10-10T14:32:03.523629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:03.523732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600815072503346:4813]
2025-10-10T14:32:03.523758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:03.534300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:03.534314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:03.534339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 424 reason: error at write: Disconnected sessionId: src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0
2025-10-10T14:32:03.534499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 424 sessionId: src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0 is DEAD
2025-10-10T14:32:03.534647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:03.534664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0] Write session will restart in 0.006701s
2025-10-10T14:32:03.534682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0] Write session: Do CDS request
2025-10-10T14:32:03.534687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:03.542905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.542955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:03.542971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 425
2025-10-10T14:32:03.543144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.543179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:03.543189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:03.543193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:03.543625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 425 sessionId:  describe result for acl check
2025-10-10T14:32:03.543658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:03.543668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:03.543673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:03.543679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600815072503514:4952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:03.544227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600815072503514:4952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:03.546365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:03.546469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600815072503514:4952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:03.548940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:03.549154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:03.549169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:03.549182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:03.549249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:03.549286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600815072503514:4952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:03.549301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600815072503514:4952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:03.549305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600815072503514:4952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:03.549314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:03.549467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600814290293246:4161]
2025-10-10T14:32:03.550005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:03.550298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:03.550343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:03.550579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:03.550622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.550626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.550627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.550628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.550629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.550630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.550630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.550631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.550632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.550632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.550633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.550634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.550634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.550638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.550646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.550648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.550651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.550653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.550656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.550658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.550661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.550665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.550669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.550673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.550677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.550680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.550686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.550696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.550700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.550703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.550706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.550709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.550712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.550716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.550718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.550726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.550729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.550732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.550735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.550738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.550741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.550744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.550749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.550752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.550755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.550758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.550760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.550763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.550767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.550770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.550773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.550778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.550800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:03.553488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:03.553919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:03.553934Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:03.553937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:03.553940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:03.553945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 424 [2:7559600814290293246:4161]
2025-10-10T14:32:03.553956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:03.553974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:03.553979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.553982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.553983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.553996Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:03.554004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:03.554015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:03.554057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.554062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.554063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.554065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:03.554128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:03.554136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.554147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.554164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.554185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:03.554210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503598:4952], now have 1 active actors on pipe
2025-10-10T14:32:03.554218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503347:2438], now have 1 active actors on pipe
2025-10-10T14:32:03.554225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600814290293237:4161]
2025-10-10T14:32:03.554232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600814290293237:4161]
2025-10-10T14:32:03.554234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600814290293237:4161]
2025-10-10T14:32:03.554245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 424
2025-10-10T14:32:03.554247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 424
2025-10-10T14:32:03.554246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:03.554264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:03.554266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:03.554269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:03.554272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:03.554277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:03.554279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:03.554301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600814290293237:4161]
2025-10-10T14:32:03.554303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:03.554305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:03.554314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.554320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.554356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:03.554365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.554373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.554375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:03.554383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.554392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:03.554408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.554543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.554560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.554572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.554635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 425 partition: 0 MaxSeqNo: 40 sessionId: src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0
2025-10-10T14:32:03.555007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ce573d-d627dc53-f4e2c350-31f7be4d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:03.557665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0] Write session: try to update token
2025-10-10T14:32:03.557680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:03.571451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId: src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:03.572382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:03.572402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:03.572404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:03.572405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:03.572413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600814290293237:4161]
2025-10-10T14:32:03.572416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600814290293237:4161]
2025-10-10T14:32:03.572419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600814290293237:4161]
2025-10-10T14:32:03.572460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:03.572469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.572471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:03.572474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:03.572490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:03.572494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:03.572593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:03.574019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:03.624129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600815072503637:4813]
2025-10-10T14:32:03.624421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 424, pipe: [1:7559600815072503637:4813]
2025-10-10T14:32:03.675215Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:03.675551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.675564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.675602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503637:4813], now have 1 active actors on pipe
2025-10-10T14:32:03.675808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:03.675946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:03.675949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:03.676005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600815072503637:4813]
2025-10-10T14:32:03.676028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 425 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0
2025-10-10T14:32:03.676249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 425 sessionId: src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0 is DEAD
2025-10-10T14:32:03.676408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:03.676418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0] Write session will restart in 0.006476s
2025-10-10T14:32:03.676435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0] Write session: Do CDS request
2025-10-10T14:32:03.676440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:03.684019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.684069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:03.684081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 426
2025-10-10T14:32:03.684233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.684269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:03.684280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:03.684287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:03.684708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 426 sessionId:  describe result for acl check
2025-10-10T14:32:03.684755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:03.684757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:03.684759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:03.684765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600815072503684:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:03.685345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600815072503684:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:03.688276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600815072503684:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:03.690906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600815072503684:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:03.690918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600815072503684:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:03.690922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600815072503684:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:03.690929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:03.692066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:03.694284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:03.694483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:03.694494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:03.694507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:03.694571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:03.694613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600814290293537:4177]
2025-10-10T14:32:03.695224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:03.695532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:03.695576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:03.695884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:03.695937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.695943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.695944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.695945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.695946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.695947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.695949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.695950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.695951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.695952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.695953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.695955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.695956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.695963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.695976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.695980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.695989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.695993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.696001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.696006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.696014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.696018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.696027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.696033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.696041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.696045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.696056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.696068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.696079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.696090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.696098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.696104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.696112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.696117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.696126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.696135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.696143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.696148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.696156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.696162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.696170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.696179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.696187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.696194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.696202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.696207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.696215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.696222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.696231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.696240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.696249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.696259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.696302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:03.698506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:03.699067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:03.699084Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:03.699086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:03.699089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:03.699095Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 425 [2:7559600814290293537:4177]
2025-10-10T14:32:03.699106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:03.699126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:03.699133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.699137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.699139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.699155Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:03.699168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:03.699179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:03.699233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.699240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.699241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.699244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:03.699304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:03.699312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.699323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.699340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.699362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:03.699387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503638:2438], now have 1 active actors on pipe
2025-10-10T14:32:03.699395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503880:4967], now have 1 active actors on pipe
2025-10-10T14:32:03.699402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600814290293532:4177]
2025-10-10T14:32:03.699409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600814290293532:4177]
2025-10-10T14:32:03.699411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600814290293532:4177]
2025-10-10T14:32:03.699424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:03.699442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:03.699454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:03.699452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 425
2025-10-10T14:32:03.699462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:03.699459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 425
2025-10-10T14:32:03.699465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:03.699466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:03.699468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:03.699485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600814290293532:4177]
2025-10-10T14:32:03.699488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:03.699489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:03.699508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.699513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.699563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c539980e-8c099f5e-a1037325-754f033d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:03.699577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.699581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.699584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:03.699594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.699604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:03.699622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.699750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.699759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.699773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.699868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 426 partition: 0 MaxSeqNo: 40 sessionId: src_id|c539980e-8c099f5e-a1037325-754f033d_0
2025-10-10T14:32:03.700241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfec6d01-4ba145e3-7f22e12d-a73b16ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c539980e-8c099f5e-a1037325-754f033d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:03.702787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c539980e-8c099f5e-a1037325-754f033d_0] Write session: try to update token
2025-10-10T14:32:03.702804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c539980e-8c099f5e-a1037325-754f033d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:03.716589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId: src_id|c539980e-8c099f5e-a1037325-754f033d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:03.718024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:03.718048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:03.718052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:03.718054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:03.718063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600814290293532:4177]
2025-10-10T14:32:03.718070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600814290293532:4177]
2025-10-10T14:32:03.718073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600814290293532:4177]
2025-10-10T14:32:03.718125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:03.718125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:03.718132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:03.718135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:03.718139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.718142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:03.718298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:03.719250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:03.776167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600815072503894:4813]
2025-10-10T14:32:03.776426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 425, pipe: [1:7559600815072503894:4813]
2025-10-10T14:32:03.822770Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:03.823060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.823079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.823129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503894:4813], now have 1 active actors on pipe
2025-10-10T14:32:03.823336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:03.823342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:03.823381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:03.823384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:03.823406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600815072503894:4813]
2025-10-10T14:32:03.823435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 426 reason: error at write: Disconnected sessionId: src_id|c539980e-8c099f5e-a1037325-754f033d_0
2025-10-10T14:32:03.823630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 426 sessionId: src_id|c539980e-8c099f5e-a1037325-754f033d_0 is DEAD
2025-10-10T14:32:03.823793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c539980e-8c099f5e-a1037325-754f033d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:03.823803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c539980e-8c099f5e-a1037325-754f033d_0] Write session will restart in 0.006469s
2025-10-10T14:32:03.823828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c539980e-8c099f5e-a1037325-754f033d_0] Write session: Do CDS request
2025-10-10T14:32:03.823837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c539980e-8c099f5e-a1037325-754f033d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:03.831762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c539980e-8c099f5e-a1037325-754f033d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.831925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:03.831939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 427
2025-10-10T14:32:03.832091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.832130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:03.832136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:03.832140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:03.832660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 427 sessionId:  describe result for acl check
2025-10-10T14:32:03.832698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:03.832704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:03.832706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:03.832711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600815072503938:4971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:03.833228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600815072503938:4971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:03.836366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600815072503938:4971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:03.839542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600815072503938:4971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:03.839556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600815072503938:4971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:03.839559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600815072503938:4971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:03.839566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:03.840791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:03.843241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:03.843452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:03.843465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:03.843482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:03.843542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:03.843591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600814290293791:4179]
2025-10-10T14:32:03.844168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:03.844534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:03.844583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:03.844909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:03.844978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.844985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.844986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.844987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.844988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.844989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.844991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.844992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.844993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.844994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.844996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.844997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.844998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.845004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.845018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.845022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.845026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.845030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.845034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.845038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.845047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.845051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.845060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.845068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.845073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.845077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.845085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.845098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.845113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.845119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.845123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.845128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.845133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.845138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.845143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.845148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.845153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.845158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.845163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.845168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.845172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.845182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.845186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.845191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.845195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.845199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.845209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.845218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.845226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.845233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.845242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.845247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.845283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:03.847751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:03.848062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:03.848076Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:03.848079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:03.848083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:03.848089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 426 [2:7559600814290293791:4179]
2025-10-10T14:32:03.848103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:03.848120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:03.848128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.848133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.848139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.848157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:03.848182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:03.848197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:03.848260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.848267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.848269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.848272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:03.848353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:03.848361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.848373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.848385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.848408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:03.848447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072504139:4971], now have 1 active actors on pipe
2025-10-10T14:32:03.848457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072503896:2438], now have 1 active actors on pipe
2025-10-10T14:32:03.848465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600814290293786:4179]
2025-10-10T14:32:03.848472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600814290293786:4179]
2025-10-10T14:32:03.848474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600814290293786:4179]
2025-10-10T14:32:03.848487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:03.848509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:03.848514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:03.848517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:03.848519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:03.848505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 426
2025-10-10T14:32:03.848505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 426
2025-10-10T14:32:03.848529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:03.848551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:03.848591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.848601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.848616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600814290293786:4179]
2025-10-10T14:32:03.848627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:03.848642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:03.848661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:03.848673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.848677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.848680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:03.848692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.848708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:03.848731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.848876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.848884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.848895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.848973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 427 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0
2025-10-10T14:32:03.849352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c539980e-8c099f5e-a1037325-754f033d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:03.851875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0] Write session: try to update token
2025-10-10T14:32:03.851890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:03.864726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId: src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:03.867281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:03.867329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:03.867347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:03.867350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:03.867351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:03.867359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600814290293786:4179]
2025-10-10T14:32:03.867362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600814290293786:4179]
2025-10-10T14:32:03.867365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600814290293786:4179]
2025-10-10T14:32:03.867404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:03.867413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.867415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:03.867420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:03.867426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:03.867429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:03.867534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:03.923650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600815072504153:4813]
2025-10-10T14:32:03.923945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 426, pipe: [1:7559600815072504153:4813]
2025-10-10T14:32:03.969327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:03.969906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.969922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.969961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072504153:4813], now have 1 active actors on pipe
2025-10-10T14:32:03.970117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:03.970156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:03.970182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:03.970187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:03.970217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600815072504153:4813]
2025-10-10T14:32:03.970252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 427 reason: error at write: Disconnected sessionId: src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0
2025-10-10T14:32:03.970473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 427 sessionId: src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0 is DEAD
2025-10-10T14:32:03.970640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:03.970651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0] Write session will restart in 0.006099s
2025-10-10T14:32:03.970670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0] Write session: Do CDS request
2025-10-10T14:32:03.970675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:03.977707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.977767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:03.977779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 428
2025-10-10T14:32:03.977887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:03.977923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:03.977934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:03.977938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:03.978443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 428 sessionId:  describe result for acl check
2025-10-10T14:32:03.978478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:03.978486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:03.978488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:03.978493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600815072504194:4975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:03.978974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600815072504194:4975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:03.981738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600815072504194:4975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:03.984009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600815072504194:4975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:03.984019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600815072504194:4975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:03.984022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600815072504194:4975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:03.984026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:03.985193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:03.987220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:03.987385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:03.987395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:03.987403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:03.987458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:03.987485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600814290294047:4181]
2025-10-10T14:32:03.988211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:03.988463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:03.988491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:03.988694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:03.988738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.988744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.988745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.988746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.988746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.988747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.988748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.988748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.988749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.988749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.988750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.988750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.988751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.988755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.988764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.988767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.988769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.988771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.988774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.988776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.988778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.988781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.988783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.988785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.988787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.988790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.988796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.988801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:03.988805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.988808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:03.988811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.988814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:03.988816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.988819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:03.988822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.988825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:03.988828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.988830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:03.988833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.988836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:03.988839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.988841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:03.988844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.988847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:03.988849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.988852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:03.988855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.988858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.988860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.988864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.988870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.988875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.988908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:03.991084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:03.991601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:03.991612Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:03.991613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:03.991617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:03.991622Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 427 [2:7559600814290294047:4181]
2025-10-10T14:32:03.991630Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:03.991643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:03.991648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.991650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.991652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.991665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:03.991674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:03.991681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:03.991730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.991735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.991736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.991738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:03.991793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:03.991800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:03.991807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:03.991813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:03.991823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:03.991838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600814290294042:4181]
2025-10-10T14:32:03.991840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600814290294042:4181]
2025-10-10T14:32:03.991841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600814290294042:4181]
2025-10-10T14:32:03.991848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:03.991859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:03.991863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072504399:4975], now have 1 active actors on pipe
2025-10-10T14:32:03.991866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600815072504155:2438], now have 1 active actors on pipe
2025-10-10T14:32:03.991869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:03.991870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:03.991871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:03.991879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:03.991881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:03.991897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600814290294042:4181]
2025-10-10T14:32:03.991901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:03.991909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:03.991936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 427
2025-10-10T14:32:03.991938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 427
2025-10-10T14:32:03.992018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.992031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.992057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:03.992068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:03.992072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:03.992074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:03.992085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:03.992096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:03.992109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.992321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:03.992334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:03.992355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:03.992440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 428 partition: 0 MaxSeqNo: 40 sessionId: src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0
2025-10-10T14:32:03.992752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab011421-586f2c3b-df88e6dd-ac71654b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:03.995287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0] Write session: try to update token
2025-10-10T14:32:03.995302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:04.008083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId: src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:04.008546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:04.008568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.008579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600814290294042:4181]
2025-10-10T14:32:04.008627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:04.008645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:04.008806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:04.008953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:04.009118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:04.009274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:04.009475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:04.009507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:04.010399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:04.010596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.010611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.010638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:04.010732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:04.019481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:04.019497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.019499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:04.019501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:04.019508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600814290294042:4181]
2025-10-10T14:32:04.019511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600814290294042:4181]
2025-10-10T14:32:04.019514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600814290294042:4181]
2025-10-10T14:32:04.019546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:04.019552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.019557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:04.019561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:04.019576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:04.019580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:04.019678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:04.070602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600819367471709:4813]
2025-10-10T14:32:04.070919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 427, pipe: [1:7559600819367471709:4813]
2025-10-10T14:32:04.120837Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:04.127447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.127470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.127624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.127681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.127737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.127792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.128194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.128207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.128267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.128317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.128367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.128422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.128460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.128468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.128524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.128574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.128640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.128695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.128735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.128740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.128795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.128928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.128989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.129042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.129080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.129085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.129142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.129192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.129243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.129295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.129343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.129348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.129413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.129465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.129519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.129571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.129608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.129614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.129666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.129729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.129785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.129837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.129876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.129881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.129938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.129988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.130045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.130097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.130134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.130139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.130194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.130244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.130294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.130347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.130384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.130389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.130444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:04.130504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:04.130572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:04.130626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:04.130664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:04.130670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:04.130706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367471709:4813], now have 1 active actors on pipe
2025-10-10T14:32:04.130961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600819367471709:4813]
2025-10-10T14:32:04.130974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:04.130978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:04.130988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:04.131008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 428 reason: error at write: Disconnected sessionId: src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0
2025-10-10T14:32:04.131022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:04.131232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 428 sessionId: src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0 is DEAD
2025-10-10T14:32:04.131364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:04.131373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0] Write session will restart in 0.008743s
2025-10-10T14:32:04.131391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0] Write session: Do CDS request
2025-10-10T14:32:04.131396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:04.140783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.141113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:04.141124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 429
2025-10-10T14:32:04.141223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.141251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:04.141266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:04.141273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:04.141805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 429 sessionId:  describe result for acl check
2025-10-10T14:32:04.141842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:04.141844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:04.141845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:04.141851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600819367471829:4980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:04.142291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600819367471829:4980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:04.144214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600819367471829:4980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:04.146192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:04.146310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600819367471829:4980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:04.146323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600819367471829:4980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:04.146327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600819367471829:4980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:04.146334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:04.148739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:04.148901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:04.148905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:04.148913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:04.148948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:04.148974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600818585261612:4183]
2025-10-10T14:32:04.149354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:04.149630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:04.149659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:04.149858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:04.149893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.149897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.149898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.149899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.149899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.149900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.149901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.149901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.149902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.149903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.149904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.149904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.149905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.149908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.149916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.149919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.149921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.149923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.149925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.149928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.149930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.149932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.149934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.149936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.149938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.149941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.149945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.149950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.149955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.149958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.149961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.149964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.149968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.149971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.149977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.149980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.149983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.149986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.149988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.149991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.149994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.149996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.150013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.150019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.150022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.150024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.150030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.150033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.150036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.150039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.150041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.150048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.150069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:04.152252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:04.152771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:04.152781Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:04.152782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:04.152784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:04.152788Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 428 [2:7559600818585261612:4183]
2025-10-10T14:32:04.152796Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:04.152808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:04.152810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.152813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.152814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.152826Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:04.152835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:04.152842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:04.152885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.152890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.152891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.152893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:04.152943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:04.152949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.152956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.152962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.152971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:04.152990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600818585261606:4183]
2025-10-10T14:32:04.152996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600818585261606:4183]
2025-10-10T14:32:04.152997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600818585261606:4183]
2025-10-10T14:32:04.153004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:04.153017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:04.153018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:04.153021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:04.153022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:04.153032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:04.153043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:04.153052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367471970:4980], now have 1 active actors on pipe
2025-10-10T14:32:04.153054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367471711:2438], now have 1 active actors on pipe
2025-10-10T14:32:04.153069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600818585261606:4183]
2025-10-10T14:32:04.153075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:04.153099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:04.153108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 428
2025-10-10T14:32:04.153141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 428
2025-10-10T14:32:04.153184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.153191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.153213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99821f03-fac3da24-21c6029e-d0734f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:04.153223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.153229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.153231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:04.153238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.153249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:04.153261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.153459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.153467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.153481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.153579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 429 partition: 0 MaxSeqNo: 40 sessionId: src_id|99821f03-fac3da24-21c6029e-d0734f_0
2025-10-10T14:32:04.153920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|337b62ab-83bcbe51-4c5f5d88-35a7245d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99821f03-fac3da24-21c6029e-d0734f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:04.156433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99821f03-fac3da24-21c6029e-d0734f_0] Write session: try to update token
2025-10-10T14:32:04.156449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99821f03-fac3da24-21c6029e-d0734f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:04.169447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId: src_id|99821f03-fac3da24-21c6029e-d0734f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:04.171364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:04.171378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.171381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:04.171383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:04.171391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600818585261606:4183]
2025-10-10T14:32:04.171393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600818585261606:4183]
2025-10-10T14:32:04.171396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600818585261606:4183]
2025-10-10T14:32:04.171438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:04.171444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.171446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:04.171477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:04.171495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:04.171499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:04.171582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:04.171998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:04.231355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600819367471982:4813]
2025-10-10T14:32:04.231663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 428, pipe: [1:7559600819367471982:4813]
2025-10-10T14:32:04.276566Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:04.276949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.276966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.277018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367471982:4813], now have 1 active actors on pipe
2025-10-10T14:32:04.277192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:04.277283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600819367471982:4813]
2025-10-10T14:32:04.277291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:04.277308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:04.277400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 429 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99821f03-fac3da24-21c6029e-d0734f_0
2025-10-10T14:32:04.277625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 429 sessionId: src_id|99821f03-fac3da24-21c6029e-d0734f_0 is DEAD
2025-10-10T14:32:04.277777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821f03-fac3da24-21c6029e-d0734f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:04.277787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821f03-fac3da24-21c6029e-d0734f_0] Write session will restart in 0.005516s
2025-10-10T14:32:04.277806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821f03-fac3da24-21c6029e-d0734f_0] Write session: Do CDS request
2025-10-10T14:32:04.277812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821f03-fac3da24-21c6029e-d0734f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:04.284691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99821f03-fac3da24-21c6029e-d0734f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.284789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:04.284800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 430
2025-10-10T14:32:04.284920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.284955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:04.284961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:04.284964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:04.285641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 430 sessionId:  describe result for acl check
2025-10-10T14:32:04.285677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:04.285682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:04.285684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:04.285690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600819367472021:4984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:04.286198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600819367472021:4984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:04.289086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600819367472021:4984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:04.291999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600819367472021:4984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:04.292027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600819367472021:4984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:04.292030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600819367472021:4984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:04.292038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:04.293457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:04.295624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:04.295786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:04.295795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:04.295803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:04.295843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:04.295875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600818585261870:4186]
2025-10-10T14:32:04.296265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:04.296517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:04.296548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:04.296758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:04.296795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.296801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.296801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.296802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.296803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.296803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.296804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.296805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.296805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.296806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.296807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.296807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.296808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.296812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.296820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.296823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.296825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.296827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.296829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.296831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.296834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.296836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.296839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.296841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.296843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.296845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.296850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.296855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.296860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.296863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.296865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.296868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.296871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.296874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.296877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.296880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.296882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.296885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.296888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.296891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.296893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.296896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.296899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.296902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.296904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.296907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.296910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.296913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.296915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.296919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.296922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.296925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.296947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:04.299246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:04.299532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:04.299543Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:04.299545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:04.299547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:04.299552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 429 [2:7559600818585261870:4186]
2025-10-10T14:32:04.299562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:04.299575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:04.299576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.299579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.299580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.299593Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:04.299598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:04.299604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:04.299642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.299649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.299650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.299652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:04.299703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:04.299711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.299721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.299735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.299755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:04.299781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472227:4984], now have 1 active actors on pipe
2025-10-10T14:32:04.299792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367471983:2438], now have 1 active actors on pipe
2025-10-10T14:32:04.299798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600818585261865:4186]
2025-10-10T14:32:04.299800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600818585261865:4186]
2025-10-10T14:32:04.299802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600818585261865:4186]
2025-10-10T14:32:04.299811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:04.299821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:04.299831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:04.299835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:04.299837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:04.299840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:04.299842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:04.299857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600818585261865:4186]
2025-10-10T14:32:04.299866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:04.299878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:04.299844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 429
2025-10-10T14:32:04.299856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 429
2025-10-10T14:32:04.299896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.299906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.299943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:04.299957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.299965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.299967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:04.299978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.299993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:04.300011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.300157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.300164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.300178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.300263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 430 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0
2025-10-10T14:32:04.300668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821f03-fac3da24-21c6029e-d0734f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:04.303132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0] Write session: try to update token
2025-10-10T14:32:04.303148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:04.315245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId: src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:04.317554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:04.318532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.318562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.318582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:04.318585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.318587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:04.318588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:04.318594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600818585261865:4186]
2025-10-10T14:32:04.318597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600818585261865:4186]
2025-10-10T14:32:04.318599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600818585261865:4186]
2025-10-10T14:32:04.318641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:04.318646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.318646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:04.318651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:04.318653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:04.318655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:04.318768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:04.377285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600819367472244:4813]
2025-10-10T14:32:04.377597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 429, pipe: [1:7559600819367472244:4813]
2025-10-10T14:32:04.420018Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:04.420406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:04.420461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472244:4813], now have 1 active actors on pipe
2025-10-10T14:32:04.420553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:04.420623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600819367472244:4813]
2025-10-10T14:32:04.420695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:04.429378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:04.429394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:04.429420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 430 reason: error at write: Disconnected sessionId: src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0
2025-10-10T14:32:04.429567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 430 sessionId: src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0 is DEAD
2025-10-10T14:32:04.429739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:04.429749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0] Write session will restart in 0.009070s
2025-10-10T14:32:04.429768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0] Write session: Do CDS request
2025-10-10T14:32:04.429773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:04.439878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.439949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:04.439964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 431
2025-10-10T14:32:04.440116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.440145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:04.440152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:04.440157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:04.440587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 431 sessionId:  describe result for acl check
2025-10-10T14:32:04.440633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:04.440639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:04.440641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:04.440649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600819367472463:4988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:04.441227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600819367472463:4988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:04.441684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:04.443793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600819367472463:4988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:04.444370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:04.444564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:04.444573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:04.444582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:04.444642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:04.444674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600818585262127:4188]
2025-10-10T14:32:04.445083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:04.445389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:04.445428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:04.445633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:04.445671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.445676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.445677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.445677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.445678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.445679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.445680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.445680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.445681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.445681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.445683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.445683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.445684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.445689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.445697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.445699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.445702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.445704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.445706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.445708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.445711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.445713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.445717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.445719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.445721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.445723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.445729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.445734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.445738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.445742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.445746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.445749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.445751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.445758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.445761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.445764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.445770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.445782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.445788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.445791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.445793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.445799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.445802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.445805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.445808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.445811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.445817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.445820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.445822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.445826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.445828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.445831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.445854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:04.446016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600819367472463:4988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:04.446032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600819367472463:4988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:04.446036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600819367472463:4988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:04.446045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:04.448021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:04.448561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:04.448571Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:04.448572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:04.448575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:04.448580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 430 [2:7559600818585262127:4188]
2025-10-10T14:32:04.448588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:04.448600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:04.448605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.448608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.448609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.448622Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:04.448630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:04.448637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:04.448679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.448684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.448685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.448687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:04.448754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:04.448762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.448773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.448788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.448807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:04.448843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472499:4988], now have 1 active actors on pipe
2025-10-10T14:32:04.448850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472245:2438], now have 1 active actors on pipe
2025-10-10T14:32:04.448856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600818585262122:4188]
2025-10-10T14:32:04.448857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600818585262122:4188]
2025-10-10T14:32:04.448859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600818585262122:4188]
2025-10-10T14:32:04.448869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:04.448882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:04.448857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 430
2025-10-10T14:32:04.448871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 430
2025-10-10T14:32:04.448892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:04.448901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:04.448901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:04.448904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:04.448904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:04.448939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.448947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.448979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600818585262122:4188]
2025-10-10T14:32:04.448987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:04.448994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:04.449011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:04.449023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.449030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.449032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:04.449042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.449057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:04.449083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.449213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.449220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.449235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.449312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 431 partition: 0 MaxSeqNo: 40 sessionId: src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0
2025-10-10T14:32:04.449690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f0fd576-b976a90d-fd2cb932-8b5af242_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:04.452368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0] Write session: try to update token
2025-10-10T14:32:04.452386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:04.465682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId: src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:04.467425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:04.467446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.467448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:04.467450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:04.467457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600818585262122:4188]
2025-10-10T14:32:04.467460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600818585262122:4188]
2025-10-10T14:32:04.467463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600818585262122:4188]
2025-10-10T14:32:04.467504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:04.467510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.467516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:04.467522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:04.467537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:04.467543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:04.467638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:04.468316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:04.520642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600819367472509:4813]
2025-10-10T14:32:04.520882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 430, pipe: [1:7559600819367472509:4813]
2025-10-10T14:32:04.569327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:04.569640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.569653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.569689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472509:4813], now have 1 active actors on pipe
2025-10-10T14:32:04.569821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:04.569857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:04.569878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600819367472509:4813]
2025-10-10T14:32:04.569902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:04.569991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0
2025-10-10T14:32:04.570212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 431 sessionId: src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0 is DEAD
2025-10-10T14:32:04.570364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:04.570374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0] Write session will restart in 0.009891s
2025-10-10T14:32:04.570392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0] Write session: Do CDS request
2025-10-10T14:32:04.570396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:04.581808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.581812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:04.581825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 432
2025-10-10T14:32:04.582017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.582054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:04.582060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:04.582063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:04.582468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 432 sessionId:  describe result for acl check
2025-10-10T14:32:04.582504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:04.582509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:04.582511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:04.582515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600819367472688:4994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:04.583034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600819367472688:4994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:04.585014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600819367472688:4994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:04.585049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:04.587081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:04.587233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:04.587241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:04.587250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:04.587289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:04.587278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600819367472688:4994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:04.587290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600819367472688:4994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:04.587292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600819367472688:4994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:04.587298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:04.587321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600818585262394:4190]
2025-10-10T14:32:04.587716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:04.587985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:04.588031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:04.588276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:04.588318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.588322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.588323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.588324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.588324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.588325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.588325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.588326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.588326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.588327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.588328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.588328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.588329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.588341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.588348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.588351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.588353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.588355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.588358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.588360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.588362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.588364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.588367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.588369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.588371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.588373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.588378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.588383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.588388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.588391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.588393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.588396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.588398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.588402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.588404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.588407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.588410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.588413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.588415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.588418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.588421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.588424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.588427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.588435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.588438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.588442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.588450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.588455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.588463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.588467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.588475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.588479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.588511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:04.590529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:04.591018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:04.591028Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:04.591031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:04.591034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:04.591039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 431 [2:7559600818585262394:4190]
2025-10-10T14:32:04.591046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:04.591061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:04.591066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.591068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.591070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.591080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:04.591088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:04.591095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:04.591136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.591140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.591142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.591143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:04.591188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:04.591193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.591199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.591208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.591218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:04.591237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472523:2438], now have 1 active actors on pipe
2025-10-10T14:32:04.591242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472775:4994], now have 1 active actors on pipe
2025-10-10T14:32:04.591249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600818585262385:4190]
2025-10-10T14:32:04.591253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600818585262385:4190]
2025-10-10T14:32:04.591254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600818585262385:4190]
2025-10-10T14:32:04.591266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:04.591277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:04.591283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:04.591283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:04.591284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:04.591305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:04.591304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 431
2025-10-10T14:32:04.591312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:04.591334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600818585262385:4190]
2025-10-10T14:32:04.591336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:04.591321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 431
2025-10-10T14:32:04.591338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:04.591347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.591350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.591391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:04.591399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.591402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.591403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:04.591411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.591419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:04.591434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.591551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.591559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.591570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.591646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 432 partition: 0 MaxSeqNo: 40 sessionId: src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0
2025-10-10T14:32:04.591934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4671036b-3a32dd2b-bfcb96d3-a69b7866_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:04.594497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0] Write session: try to update token
2025-10-10T14:32:04.594513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:04.607718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId: src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:04.609961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:04.609975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.609978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:04.609981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:04.609988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600818585262385:4190]
2025-10-10T14:32:04.609991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600818585262385:4190]
2025-10-10T14:32:04.609993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600818585262385:4190]
2025-10-10T14:32:04.610033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:04.610039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.610045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:04.610049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:04.610059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:04.610063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:04.610176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:04.610537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:04.670131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600819367472814:4813]
2025-10-10T14:32:04.670428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 431, pipe: [1:7559600819367472814:4813]
2025-10-10T14:32:04.710401Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:04.710699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.710710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.710748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472814:4813], now have 1 active actors on pipe
2025-10-10T14:32:04.710910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:04.710999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600819367472814:4813]
2025-10-10T14:32:04.710999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:04.711025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:04.711090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 432 reason: status is not ok: tablet will be restarted right now sessionId: src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0
2025-10-10T14:32:04.711311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 432 sessionId: src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0 is DEAD
2025-10-10T14:32:04.711478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:04.711486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0] Write session will restart in 0.006470s
2025-10-10T14:32:04.711504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0] Write session: Do CDS request
2025-10-10T14:32:04.711509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:04.718789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.718881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:04.718895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 433
2025-10-10T14:32:04.719025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.719060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:04.719071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:04.719074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:04.719503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 433 sessionId:  describe result for acl check
2025-10-10T14:32:04.719537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:04.719543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:04.719545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:04.719551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600819367472865:5007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:04.720074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600819367472865:5007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:04.722833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600819367472865:5007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:04.725701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600819367472865:5007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:04.725719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600819367472865:5007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:04.725722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600819367472865:5007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:04.725727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:04.726990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:04.729261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:04.729427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:04.729435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:04.729445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:04.729492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:04.729523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600818585262689:4206]
2025-10-10T14:32:04.729922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:04.730175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:04.730203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:04.730411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:04.730449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.730454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.730455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.730455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.730456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.730457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.730457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.730458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.730458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.730459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.730459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.730460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.730460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.730464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.730474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.730476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.730478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.730481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.730483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.730485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.730488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.730490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.730492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.730494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.730497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.730499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.730504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.730509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.730513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.730517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.730519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.730522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.730525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.730528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.730530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.730533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.730536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.730539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.730542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.730545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.730547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.730550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.730552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.730567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.730571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.730576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.730585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.730590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.730597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.730600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.730605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.730607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.730629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:04.732752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:04.733144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:04.733152Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:04.733153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:04.733156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:04.733160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 432 [2:7559600818585262689:4206]
2025-10-10T14:32:04.733167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:04.733181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:04.733188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.733191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.733194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.733209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:04.733217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:04.733224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:04.733266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.733271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.733272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.733273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:04.733315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:04.733322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.733342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.733348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.733357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:04.733372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600818585262684:4206]
2025-10-10T14:32:04.733377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600818585262684:4206]
2025-10-10T14:32:04.733378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600818585262684:4206]
2025-10-10T14:32:04.733384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:04.733393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:04.733395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367473064:5007], now have 1 active actors on pipe
2025-10-10T14:32:04.733398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367472815:2438], now have 1 active actors on pipe
2025-10-10T14:32:04.733400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:04.733401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:04.733402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:04.733411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:04.733413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:04.733433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600818585262684:4206]
2025-10-10T14:32:04.733444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:04.733459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:04.733488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 432
2025-10-10T14:32:04.733581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 432
2025-10-10T14:32:04.733652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.733665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.733695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:04.733715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.733722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.733724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:04.733732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.733743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:04.733758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.733937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.733943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.733956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.734048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 433 partition: 0 MaxSeqNo: 40 sessionId: src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0
2025-10-10T14:32:04.734373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ac9c76-7691e362-c35c4702-d8f35f7a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:04.736957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0] Write session: try to update token
2025-10-10T14:32:04.736974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:04.749587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId: src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:04.751245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:04.751258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.751260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:04.751261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:04.751270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600818585262684:4206]
2025-10-10T14:32:04.751275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600818585262684:4206]
2025-10-10T14:32:04.751278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600818585262684:4206]
2025-10-10T14:32:04.751317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:04.751319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:04.751325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:04.751326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.751328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:04.751327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:04.751446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:04.752104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:04.810973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600819367473079:4813]
2025-10-10T14:32:04.811265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 432, pipe: [1:7559600819367473079:4813]
2025-10-10T14:32:04.852580Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:04.852898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.852910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.852951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367473079:4813], now have 1 active actors on pipe
2025-10-10T14:32:04.853102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:04.853157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:04.853211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:04.853272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600819367473079:4813]
2025-10-10T14:32:04.853289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 433 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0
2025-10-10T14:32:04.853512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 433 sessionId: src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0 is DEAD
2025-10-10T14:32:04.853649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:04.853660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0] Write session will restart in 0.006243s
2025-10-10T14:32:04.853684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0] Write session: Do CDS request
2025-10-10T14:32:04.853690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:04.860794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.860913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:04.860926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 434
2025-10-10T14:32:04.861040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:04.861075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:04.861085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:04.861093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:04.861649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 434 sessionId:  describe result for acl check
2025-10-10T14:32:04.861688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:04.861696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:04.861698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:04.861704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600819367473139:5011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:04.862232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600819367473139:5011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:04.865086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600819367473139:5011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:04.867284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600819367473139:5011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:04.867300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600819367473139:5011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:04.867303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600819367473139:5011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:04.867310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:04.868008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:04.870188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:04.870338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:04.870346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:04.870355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:04.870394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:04.870426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600818585262950:4208]
2025-10-10T14:32:04.870849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:04.871088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:04.871114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:04.871306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:04.871341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.871346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.871346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.871347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.871348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.871348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.871349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.871349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.871350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.871351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.871351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.871352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.871352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.871356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.871365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.871368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.871370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.871372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.871375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.871377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.871379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.871381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.871384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.871386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.871388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.871390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.871395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.871401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:04.871406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.871409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:04.871411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.871414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:04.871417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.871421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:04.871432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.871438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:04.871441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.871444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:04.871446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.871449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:04.871455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.871459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:04.871462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.871465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:04.871467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.871470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:04.871473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.871475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.871478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.871481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.871483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.871486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.871506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:04.873571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:04.874323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:04.874333Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:04.874334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:04.874337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:04.874341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 433 [2:7559600818585262950:4208]
2025-10-10T14:32:04.874348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:04.874360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:04.874362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.874364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.874366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.874377Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:04.874382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:04.874392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:04.874430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.874435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.874436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.874437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:04.874486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:04.874491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.874499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:04.874508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:04.874518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:04.874541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600818585262945:4208]
2025-10-10T14:32:04.874548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600818585262945:4208]
2025-10-10T14:32:04.874550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600818585262945:4208]
2025-10-10T14:32:04.874573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:04.874585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:04.874586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367473080:2438], now have 1 active actors on pipe
2025-10-10T14:32:04.874588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:04.874590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367473331:5011], now have 1 active actors on pipe
2025-10-10T14:32:04.874590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:04.874598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:04.874613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:04.874615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:04.874637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600818585262945:4208]
2025-10-10T14:32:04.874647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:04.874666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:04.874678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 433
2025-10-10T14:32:04.874679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 433
2025-10-10T14:32:04.874747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.874757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.874787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a329a15-23214e69-e24dff4f-2f44df15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:04.874800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:04.874804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:04.874806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:04.874816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:04.874831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:04.874850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.875033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.875039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.875050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:04.875144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 434 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a329a15-23214e69-e24dff4f-2f44df15_0
2025-10-10T14:32:04.875484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5dfb0-b2c8c731-99e600ba-dfadf350_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a329a15-23214e69-e24dff4f-2f44df15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:04.877975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a329a15-23214e69-e24dff4f-2f44df15_0] Write session: try to update token
2025-10-10T14:32:04.877989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a329a15-23214e69-e24dff4f-2f44df15_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:04.885070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:04.885082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.885090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600818585262945:4208]
2025-10-10T14:32:04.885128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:04.885147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:04.885271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:04.885405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:04.885533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:04.885659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:04.885824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:04.885854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:04.890214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId: src_id|2a329a15-23214e69-e24dff4f-2f44df15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:04.892777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:04.892990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:04.893006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:04.893037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:04.893147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:04.902070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:04.902084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:04.902087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:04.902089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:04.902100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600818585262945:4208]
2025-10-10T14:32:04.902104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600818585262945:4208]
2025-10-10T14:32:04.902106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600818585262945:4208]
2025-10-10T14:32:04.902143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:04.902149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:04.902150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:04.902154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:04.902159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:04.902163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:04.902265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:04.953299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600819367473344:4813]
2025-10-10T14:32:04.953511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 433, pipe: [1:7559600819367473344:4813]
2025-10-10T14:32:05.006653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:05.013137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.013157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.013306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.013381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.013438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.013492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.013532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.013541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.013601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.013654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.013710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.013769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.013813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.013818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.013872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.013922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.013976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.014031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.014068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.014073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.014128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.014182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.014241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.014303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.014340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.014345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.014405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.014470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.014524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.014589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.014626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.014631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.014686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.014735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.014789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.014841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.014880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.014884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.014940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.014990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.015044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.015095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.015133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.015139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.015199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.015257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.015309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.015361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.015398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.015403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.015463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.015518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.015569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.015622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.015681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.015687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.015741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.015790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.015841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.015892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.015927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.015934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.015970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600819367473344:4813], now have 1 active actors on pipe
2025-10-10T14:32:05.016142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600819367473344:4813]
2025-10-10T14:32:05.016142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:05.016147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:05.016172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:05.016178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 434 reason: error at write: Disconnected sessionId: src_id|2a329a15-23214e69-e24dff4f-2f44df15_0
2025-10-10T14:32:05.016396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 434 sessionId: src_id|2a329a15-23214e69-e24dff4f-2f44df15_0 is DEAD
2025-10-10T14:32:05.016546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a329a15-23214e69-e24dff4f-2f44df15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:05.016556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a329a15-23214e69-e24dff4f-2f44df15_0] Write session will restart in 0.007474s
2025-10-10T14:32:05.016599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a329a15-23214e69-e24dff4f-2f44df15_0] Write session: Do CDS request
2025-10-10T14:32:05.016605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a329a15-23214e69-e24dff4f-2f44df15_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:05.016665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:05.024875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a329a15-23214e69-e24dff4f-2f44df15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.024985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:05.024998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 435
2025-10-10T14:32:05.025130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.025166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:05.025176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:05.025180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:05.025727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 435 sessionId:  describe result for acl check
2025-10-10T14:32:05.025766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:05.025772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:05.025774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:05.025781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600823662440720:5015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:05.026333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600823662440720:5015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:05.029383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600823662440720:5015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:05.031654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600823662440720:5015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:05.031668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600823662440720:5015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:05.031672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600823662440720:5015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:05.031679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:05.034288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:05.034648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:05.034816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:05.034829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:05.034841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:05.034909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:05.034948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600822880230508:4210]
2025-10-10T14:32:05.035470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:05.035708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:05.035746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:05.036117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:05.036169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.036174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.036175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.036175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.036176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.036176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.036177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.036178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.036178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.036179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.036179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.036180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.036181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.036185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.036193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.036195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.036197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.036199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.036202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.036204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.036206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.036207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.036210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.036212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.036214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.036216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.036221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.036226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.036231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.036234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.036237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.036240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.036243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.036247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.036249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.036252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.036255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.036258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.036260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.036263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.036266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.036269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.036271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.036275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.036278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.036281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.036285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.036287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.036294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.036297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.036299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.036302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.036324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:05.038466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:05.038914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:05.038925Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:05.038927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:05.038931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:05.038937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 434 [2:7559600822880230508:4210]
2025-10-10T14:32:05.038948Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:05.038969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:05.038975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.038977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.038979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.038991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:05.038999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:05.039006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:05.039048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.039053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.039054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.039056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:05.039105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:05.039111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.039118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.039124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.039137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:05.039158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662440894:5015], now have 1 active actors on pipe
2025-10-10T14:32:05.039164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662440642:2438], now have 1 active actors on pipe
2025-10-10T14:32:05.039169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600822880230503:4210]
2025-10-10T14:32:05.039170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600822880230503:4210]
2025-10-10T14:32:05.039172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600822880230503:4210]
2025-10-10T14:32:05.039183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:05.039196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:05.039195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:05.039198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:05.039199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:05.039208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:05.039210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:05.039226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600822880230503:4210]
2025-10-10T14:32:05.039232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:05.039245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:05.039258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.039228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 434
2025-10-10T14:32:05.039261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.039243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 434
2025-10-10T14:32:05.039284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5697738-23542826-887f3843-54ea1f4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:05.039294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.039298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.039301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:05.039309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.039320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:05.039330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.039441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.039446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.039457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.039537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 435 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5697738-23542826-887f3843-54ea1f4a_0
2025-10-10T14:32:05.039938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a329a15-23214e69-e24dff4f-2f44df15_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5697738-23542826-887f3843-54ea1f4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:05.042653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5697738-23542826-887f3843-54ea1f4a_0] Write session: try to update token
2025-10-10T14:32:05.042671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5697738-23542826-887f3843-54ea1f4a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:05.056126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId: src_id|f5697738-23542826-887f3843-54ea1f4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:05.057809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:05.057822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.057825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:05.057826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:05.057834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600822880230503:4210]
2025-10-10T14:32:05.057839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600822880230503:4210]
2025-10-10T14:32:05.057842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600822880230503:4210]
2025-10-10T14:32:05.057880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:05.057883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:05.057885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.057887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:05.057888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:05.057891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:05.058018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:05.058807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:05.116114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600823662440907:4813]
2025-10-10T14:32:05.116369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 434, pipe: [1:7559600823662440907:4813]
2025-10-10T14:32:05.160203Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:05.160427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.160443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.160494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662440907:4813], now have 1 active actors on pipe
2025-10-10T14:32:05.160670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:05.160694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:05.160708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:05.160716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600823662440907:4813]
2025-10-10T14:32:05.160737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:05.160772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 435 reason: error at write: Disconnected sessionId: src_id|f5697738-23542826-887f3843-54ea1f4a_0
2025-10-10T14:32:05.160974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 435 sessionId: src_id|f5697738-23542826-887f3843-54ea1f4a_0 is DEAD
2025-10-10T14:32:05.161106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5697738-23542826-887f3843-54ea1f4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:05.161117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5697738-23542826-887f3843-54ea1f4a_0] Write session will restart in 0.008540s
2025-10-10T14:32:05.161141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5697738-23542826-887f3843-54ea1f4a_0] Write session: Do CDS request
2025-10-10T14:32:05.161146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5697738-23542826-887f3843-54ea1f4a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:05.170865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5697738-23542826-887f3843-54ea1f4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.170978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:05.170994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 436
2025-10-10T14:32:05.171112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.171146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:05.171156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:05.171161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:05.171712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 436 sessionId:  describe result for acl check
2025-10-10T14:32:05.171747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:05.171754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:05.171756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:05.171762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600823662441030:5020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:05.172284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600823662441030:5020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:05.174927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600823662441030:5020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:05.176766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:05.179138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:05.179326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:05.179336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:05.179345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:05.179384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:05.179418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600822880230781:4213]
2025-10-10T14:32:05.179469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600823662441030:5020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:05.179488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600823662441030:5020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:05.179492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600823662441030:5020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:05.179505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:05.179828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:05.180060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:05.180091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:05.180308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:05.180343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.180348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.180348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.180349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.180350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.180351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.180351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.180352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.180352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.180353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.180354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.180354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.180355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.180359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.180368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.180370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.180373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.180375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.180377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.180379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.180381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.180383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.180387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.180389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.180391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.180393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.180398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.180403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.180409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.180412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.180415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.180418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.180420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.180423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.180426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.180429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.180432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.180435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.180438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.180441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.180443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.180447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.180450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.180457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.180460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.180463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.180470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.180474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.180478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.180482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.180487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.180491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.180514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:05.182658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:05.183021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:05.183030Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:05.183031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:05.183034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:05.183039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 435 [2:7559600822880230781:4213]
2025-10-10T14:32:05.183047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:05.183059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:05.183061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.183063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.183065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.183078Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:05.183086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:05.183092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:05.183150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.183156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.183158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.183160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:05.183214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:05.183220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.183227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.183236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.183249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:05.183270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662440923:2438], now have 1 active actors on pipe
2025-10-10T14:32:05.183277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441178:5020], now have 1 active actors on pipe
2025-10-10T14:32:05.183284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600822880230776:4213]
2025-10-10T14:32:05.183291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600822880230776:4213]
2025-10-10T14:32:05.183293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600822880230776:4213]
2025-10-10T14:32:05.183305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:05.183317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:05.183324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:05.183325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:05.183329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:05.183344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:05.183351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:05.183345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 435
2025-10-10T14:32:05.183372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600822880230776:4213]
2025-10-10T14:32:05.183355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 435
2025-10-10T14:32:05.183380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:05.183380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:05.183399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.183405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.183443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1ef2b64-ead39571-22621de0-e4410848_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:05.183451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.183454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.183456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:05.183464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.183473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:05.183487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.183631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.183638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.183653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.183750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 436 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1ef2b64-ead39571-22621de0-e4410848_0
2025-10-10T14:32:05.184141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5697738-23542826-887f3843-54ea1f4a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1ef2b64-ead39571-22621de0-e4410848_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:05.186660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ef2b64-ead39571-22621de0-e4410848_0] Write session: try to update token
2025-10-10T14:32:05.186674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ef2b64-ead39571-22621de0-e4410848_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:05.199393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId: src_id|e1ef2b64-ead39571-22621de0-e4410848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:05.201727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:05.201740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.201742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:05.201744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:05.201751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600822880230776:4213]
2025-10-10T14:32:05.201755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600822880230776:4213]
2025-10-10T14:32:05.201757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600822880230776:4213]
2025-10-10T14:32:05.201793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:05.201796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:05.201799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.201801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:05.201801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:05.201804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:05.201879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:05.201912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:05.261011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600823662441189:4813]
2025-10-10T14:32:05.261280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 435, pipe: [1:7559600823662441189:4813]
2025-10-10T14:32:05.304076Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:05.304734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.304747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.304789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441189:4813], now have 1 active actors on pipe
2025-10-10T14:32:05.304960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:05.305016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:05.305023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600823662441189:4813]
2025-10-10T14:32:05.305046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:05.305133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 436 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e1ef2b64-ead39571-22621de0-e4410848_0
2025-10-10T14:32:05.305344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 436 sessionId: src_id|e1ef2b64-ead39571-22621de0-e4410848_0 is DEAD
2025-10-10T14:32:05.305488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ef2b64-ead39571-22621de0-e4410848_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:05.305497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ef2b64-ead39571-22621de0-e4410848_0] Write session will restart in 0.008580s
2025-10-10T14:32:05.305525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ef2b64-ead39571-22621de0-e4410848_0] Write session: Do CDS request
2025-10-10T14:32:05.305530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ef2b64-ead39571-22621de0-e4410848_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:05.314789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ef2b64-ead39571-22621de0-e4410848_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.314880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:05.314893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 437
2025-10-10T14:32:05.315000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.315035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:05.315045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:05.315049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:05.315442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 437 sessionId:  describe result for acl check
2025-10-10T14:32:05.315471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:05.315478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:05.315480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:05.315486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600823662441309:5024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:05.316010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600823662441309:5024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:05.318375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600823662441309:5024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:05.319526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:05.321636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:05.321781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:05.321791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:05.321801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:05.321837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:05.321866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600822880231045:4215]
2025-10-10T14:32:05.321920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600823662441309:5024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:05.321934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600823662441309:5024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:05.321937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600823662441309:5024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:05.321943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:05.322260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:05.322464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:05.322492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:05.322720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:05.322762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.322766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.322767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.322767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.322768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.322768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.322769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.322770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.322770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.322771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.322772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.322772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.322773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.322776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.322785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.322788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.322790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.322792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.322795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.322797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.322799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.322802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.322804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.322806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.322809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.322811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.322816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.322821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.322826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.322829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.322832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.322835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.322837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.322842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.322844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.322847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.322850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.322853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.322855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.322858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.322861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.322864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.322866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.322869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.322872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.322875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.322877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.322880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.322883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.322886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.322892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.322895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.322920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:05.324834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:05.325094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:05.325102Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:05.325104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:05.325106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:05.325110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 436 [2:7559600822880231045:4215]
2025-10-10T14:32:05.325117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:05.325131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:05.325136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.325137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.325139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.325148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:05.325153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:05.325161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:05.325198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.325203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.325204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.325205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:05.325248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:05.325253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.325259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.325268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.325281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:05.325304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441447:5024], now have 1 active actors on pipe
2025-10-10T14:32:05.325312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441191:2438], now have 1 active actors on pipe
2025-10-10T14:32:05.325319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600822880231040:4215]
2025-10-10T14:32:05.325321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600822880231040:4215]
2025-10-10T14:32:05.325322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600822880231040:4215]
2025-10-10T14:32:05.325344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:05.325346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:05.325347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:05.325347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:05.325361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:05.325375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:05.325382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:05.325372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 436
2025-10-10T14:32:05.325374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 436
2025-10-10T14:32:05.325400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600822880231040:4215]
2025-10-10T14:32:05.325408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:05.325409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:05.325544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.325554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.325589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:05.325600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.325605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.325607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:05.325617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.325630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:05.325644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.325788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.325793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.325804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.325878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 437 partition: 0 MaxSeqNo: 40 sessionId: src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0
2025-10-10T14:32:05.326157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ef2b64-ead39571-22621de0-e4410848_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:05.328703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0] Write session: try to update token
2025-10-10T14:32:05.328720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:05.341085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId: src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:05.343437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:05.343559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:05.343569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.343572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:05.343573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:05.343580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600822880231040:4215]
2025-10-10T14:32:05.343583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600822880231040:4215]
2025-10-10T14:32:05.343585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600822880231040:4215]
2025-10-10T14:32:05.343627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.343629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:05.343633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:05.343636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:05.343636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.343656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:05.343664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.343666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:05.343776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:05.405366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600823662441458:4813]
2025-10-10T14:32:05.405664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 436, pipe: [1:7559600823662441458:4813]
2025-10-10T14:32:05.443250Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:05.443700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441458:4813], now have 1 active actors on pipe
2025-10-10T14:32:05.443869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:05.443935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:05.443944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600823662441458:4813]
2025-10-10T14:32:05.443965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:05.444044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 437 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0
2025-10-10T14:32:05.444245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 437 sessionId: src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0 is DEAD
2025-10-10T14:32:05.444411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:05.444423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0] Write session will restart in 0.009034s
2025-10-10T14:32:05.444448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0] Write session: Do CDS request
2025-10-10T14:32:05.444454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:05.454756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.454869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:05.454885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 438
2025-10-10T14:32:05.455001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.455032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:05.455042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:05.455046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:05.455423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 438 sessionId:  describe result for acl check
2025-10-10T14:32:05.455452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:05.455458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:05.455459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:05.455465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600823662441607:5028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:05.455979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600823662441607:5028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:05.458121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600823662441607:5028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:05.458669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:05.460556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:05.460706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:05.460714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:05.460722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:05.460768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:05.460796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600822880231310:4217]
2025-10-10T14:32:05.460795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600823662441607:5028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:05.460807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600823662441607:5028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:05.460810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600823662441607:5028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:05.460816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:05.461151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:05.461405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:05.461439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:05.461645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:05.461679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.461683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.461684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.461684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.461685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.461685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.461686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.461686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.461687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.461688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.461688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.461689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.461689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.461693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.461701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.461703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.461705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.461708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.461710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.461712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.461714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.461716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.461719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.461721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.461723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.461725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.461729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.461735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.461739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.461742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.461744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.461747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.461750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.461753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.461755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.461758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.461761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.461764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.461767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.461770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.461772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.461775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.461778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.461781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.461784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.461786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.461789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.461792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.461794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.461797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.461801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.461803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.461824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:05.463786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:05.464048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:05.464055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:05.464056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:05.464059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:05.464063Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 437 [2:7559600822880231310:4217]
2025-10-10T14:32:05.464071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:05.464080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:05.464082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.464084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.464085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.464097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:05.464102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:05.464108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:05.464166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.464172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.464173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.464174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:05.464217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:05.464223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.464229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.464235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.464246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:05.464264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441459:2438], now have 1 active actors on pipe
2025-10-10T14:32:05.464275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600822880231305:4217]
2025-10-10T14:32:05.464277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600822880231305:4217]
2025-10-10T14:32:05.464278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600822880231305:4217]
2025-10-10T14:32:05.464290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:05.464301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441717:5028], now have 1 active actors on pipe
2025-10-10T14:32:05.464307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:05.464309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:05.464310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:05.464314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:05.464329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:05.464332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:05.464348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600822880231305:4217]
2025-10-10T14:32:05.464354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:05.464344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 437
2025-10-10T14:32:05.464344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 437
2025-10-10T14:32:05.464370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:05.464389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.464395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.464416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|614d543d-96b604b5-3ece8770-1e79213b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:05.464424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.464427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.464428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:05.464435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.464443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:05.464458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.464601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.464612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.464636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.464736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 438 partition: 0 MaxSeqNo: 40 sessionId: src_id|614d543d-96b604b5-3ece8770-1e79213b_0
2025-10-10T14:32:05.464999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79929d1f-ee444fb4-ceba5907-feb267ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|614d543d-96b604b5-3ece8770-1e79213b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:05.467732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614d543d-96b604b5-3ece8770-1e79213b_0] Write session: try to update token
2025-10-10T14:32:05.467752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614d543d-96b604b5-3ece8770-1e79213b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:05.474546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:05.474560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.474580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600822880231305:4217]
2025-10-10T14:32:05.474615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:05.474627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:05.474763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:05.474885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:05.475006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:05.475126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:05.475291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:05.475319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:05.480856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId: src_id|614d543d-96b604b5-3ece8770-1e79213b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:05.483298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:05.483464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.483483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.483520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:05.483615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:05.491105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:05.491117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.491119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:05.491120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:05.491128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600822880231305:4217]
2025-10-10T14:32:05.491131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600822880231305:4217]
2025-10-10T14:32:05.491133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600822880231305:4217]
2025-10-10T14:32:05.491167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:05.491168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:05.491173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:05.491173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.491175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:05.491176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:05.491290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:05.544138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600823662441731:4813]
2025-10-10T14:32:05.544421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 437, pipe: [1:7559600823662441731:4813]
2025-10-10T14:32:05.590953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:05.597296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.597318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.597477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.597533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.597589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.597646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.597687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.597694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.597772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.597825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.597882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.598129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.598169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.598174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.598232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.598285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.598341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.598396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.598434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.598440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.598497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.598553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.598618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.598677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.598716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.598722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.598777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.598830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.598884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.598941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.598980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.598985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.599042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.599095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.599148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.599203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.599241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.599247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.599301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.599354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.599412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.599467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.599505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.599510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.599564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.599618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.599671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.599726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.599837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.599845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.599899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.599952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.600004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.600058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.600094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.600099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.600155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:05.600208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:05.600263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:05.600315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:05.600353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:05.600360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:05.600396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441731:4813], now have 1 active actors on pipe
2025-10-10T14:32:05.600658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:05.600675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:05.600678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:05.600711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 438 reason: error at write: Disconnected sessionId: src_id|614d543d-96b604b5-3ece8770-1e79213b_0
2025-10-10T14:32:05.600724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600823662441731:4813]
2025-10-10T14:32:05.600944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 438 sessionId: src_id|614d543d-96b604b5-3ece8770-1e79213b_0 is DEAD
2025-10-10T14:32:05.600932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:05.601092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614d543d-96b604b5-3ece8770-1e79213b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:05.601102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614d543d-96b604b5-3ece8770-1e79213b_0] Write session will restart in 0.005209s
2025-10-10T14:32:05.601120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614d543d-96b604b5-3ece8770-1e79213b_0] Write session: Do CDS request
2025-10-10T14:32:05.601125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614d543d-96b604b5-3ece8770-1e79213b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:05.607846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614d543d-96b604b5-3ece8770-1e79213b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.607965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:05.607981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 439
2025-10-10T14:32:05.608082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.608127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:05.608136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:05.608140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:05.608525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 439 sessionId:  describe result for acl check
2025-10-10T14:32:05.608555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:05.608560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:05.608561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:05.608566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600823662441765:5034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:05.608992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600823662441765:5034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:05.612435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600823662441765:5034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:05.615703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600823662441765:5034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:05.615717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600823662441765:5034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:05.615720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600823662441765:5034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:05.615727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:05.617574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:05.619991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:05.620153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:05.620162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:05.620171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:05.620211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:05.620240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600822880231579:4220]
2025-10-10T14:32:05.620651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:05.620925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:05.620954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:05.621162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:05.621203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.621207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.621208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.621208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.621209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.621210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.621210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.621211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.621211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.621212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.621213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.621213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.621214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.621217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.621226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.621228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.621231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.621233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.621235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.621237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.621239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.621241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.621243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.621245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.621247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.621249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.621255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.621261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.621265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.621268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.621271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.621274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.621276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.621279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.621282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.621285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.621287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.621290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.621293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.621296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.621298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.621301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.621304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.621307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.621309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.621313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.621315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.621319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.621322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.621340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.621343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.621346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.621370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:05.623514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:05.623804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:05.623813Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:05.623815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:05.623818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:05.623822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 438 [2:7559600822880231579:4220]
2025-10-10T14:32:05.623829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:05.623841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:05.623843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.623844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.623845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.623855Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:05.623860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:05.623866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:05.623900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.623906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.623907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.623909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:05.623954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:05.623959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.623969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.623980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.624007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:05.624026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441978:5034], now have 1 active actors on pipe
2025-10-10T14:32:05.624032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662441738:2438], now have 1 active actors on pipe
2025-10-10T14:32:05.624037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600822880231574:4220]
2025-10-10T14:32:05.624039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600822880231574:4220]
2025-10-10T14:32:05.624040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600822880231574:4220]
2025-10-10T14:32:05.624051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:05.624060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:05.624071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:05.624075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:05.624076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:05.624080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:05.624066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 438
2025-10-10T14:32:05.624088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 438
2025-10-10T14:32:05.624081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:05.624089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600822880231574:4220]
2025-10-10T14:32:05.624091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:05.624098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:05.624112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.624116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.624142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:05.624150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.624153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.624154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:05.624161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.624170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:05.624182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.624315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.624321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.624331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.624429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 439 partition: 0 MaxSeqNo: 40 sessionId: src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0
2025-10-10T14:32:05.624834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614d543d-96b604b5-3ece8770-1e79213b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:05.627416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0] Write session: try to update token
2025-10-10T14:32:05.627441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:05.639823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId: src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:05.641809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:05.641825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.641828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:05.641830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:05.641840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600822880231574:4220]
2025-10-10T14:32:05.641847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600822880231574:4220]
2025-10-10T14:32:05.641851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600822880231574:4220]
2025-10-10T14:32:05.641895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:05.641897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:05.641901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:05.641904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:05.641905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.641907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:05.642041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:05.642295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:05.700816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600823662442035:4813]
2025-10-10T14:32:05.701076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 438, pipe: [1:7559600823662442035:4813]
2025-10-10T14:32:05.744361Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:05.744613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.744626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.744669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662442035:4813], now have 1 active actors on pipe
2025-10-10T14:32:05.744917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:05.744933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:05.744936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:05.744984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600823662442035:4813]
2025-10-10T14:32:05.744997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 439 reason: error at write: Disconnected sessionId: src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0
2025-10-10T14:32:05.745223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 439 sessionId: src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0 is DEAD
2025-10-10T14:32:05.745319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:05.749014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:05.749026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0] Write session will restart in 0.008664s
2025-10-10T14:32:05.749057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0] Write session: Do CDS request
2025-10-10T14:32:05.749069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:05.758756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.758842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:05.758862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 440
2025-10-10T14:32:05.758984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.759020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:05.759031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:05.759035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:05.759419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 440 sessionId:  describe result for acl check
2025-10-10T14:32:05.759452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:05.759459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:05.759461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:05.759469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600823662442263:5047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:05.759931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600823662442263:5047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:05.761114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:05.762219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600823662442263:5047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:05.763120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:05.763300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:05.763309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:05.763317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:05.763361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:05.763406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600822880231884:4235]
2025-10-10T14:32:05.763812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:05.764026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:05.764064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:05.764234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600823662442263:5047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:05.764247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600823662442263:5047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:05.764250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600823662442263:5047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:05.764256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:05.764264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:05.764309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.764315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.764316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.764317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.764317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.764318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.764319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.764319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.764320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.764321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.764321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.764322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.764322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.764326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.764334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.764336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.764338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.764340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.764343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.764345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.764347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.764349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.764351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.764353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.764356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.764358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.764362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.764367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.764372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.764375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.764379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.764382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.764384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.764387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.764390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.764393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.764395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.764398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.764401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.764403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.764406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.764409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.764411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.764415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.764417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.764420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.764422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.764425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.764428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.764431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.764433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.764436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.764457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:05.766945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:05.767917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:05.767926Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:05.767927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:05.767930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:05.767934Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 439 [2:7559600822880231884:4235]
2025-10-10T14:32:05.767942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:05.767953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:05.767954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.767956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.767958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.767969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:05.767979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:05.767988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:05.768029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.768034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.768035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.768037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:05.768083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:05.768088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.768095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.768102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.768111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:05.768134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662442297:5047], now have 1 active actors on pipe
2025-10-10T14:32:05.768142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662442036:2438], now have 1 active actors on pipe
2025-10-10T14:32:05.768149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600822880231879:4235]
2025-10-10T14:32:05.768154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600822880231879:4235]
2025-10-10T14:32:05.768155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600822880231879:4235]
2025-10-10T14:32:05.768164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:05.768174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:05.768177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:05.768181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:05.768182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:05.768187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:05.768189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:05.768204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600822880231879:4235]
2025-10-10T14:32:05.768210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:05.768197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 439
2025-10-10T14:32:05.768218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:05.768199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 439
2025-10-10T14:32:05.768237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.768243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.768265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:05.768273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.768279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.768280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:05.768288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.768299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:05.768312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.768427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.768433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.768444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.768519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 440 partition: 0 MaxSeqNo: 40 sessionId: src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0
2025-10-10T14:32:05.768809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5784a854-51d90e51-9d7bba51-d7403cf7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:05.778803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0] Write session: try to update token
2025-10-10T14:32:05.778824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:05.785151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:05.785165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.785168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:05.785169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:05.785177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600822880231879:4235]
2025-10-10T14:32:05.785180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600822880231879:4235]
2025-10-10T14:32:05.785183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600822880231879:4235]
2025-10-10T14:32:05.785219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:05.785224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.785225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:05.785227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:05.785232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:05.785236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:05.785674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:05.797499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId: src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:05.799941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:05.845214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600823662442307:4813]
2025-10-10T14:32:05.845503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 439, pipe: [1:7559600823662442307:4813]
2025-10-10T14:32:05.888329Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:05.888566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.888578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.888598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662442307:4813], now have 1 active actors on pipe
2025-10-10T14:32:05.888764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:05.888791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600823662442307:4813]
2025-10-10T14:32:05.888792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:05.888796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:05.888822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:05.888862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 440 reason: error at write: Disconnected sessionId: src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0
2025-10-10T14:32:05.889068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 440 sessionId: src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0 is DEAD
2025-10-10T14:32:05.889250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:05.889262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0] Write session will restart in 0.006694s
2025-10-10T14:32:05.889295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0] Write session: Do CDS request
2025-10-10T14:32:05.889300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:05.896871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.896980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:05.896997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 441
2025-10-10T14:32:05.897087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:05.897122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:05.897133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:05.897138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:05.897527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 441 sessionId:  describe result for acl check
2025-10-10T14:32:05.897561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:05.897567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:05.897568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:05.897575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600823662442352:5051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:05.898028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600823662442352:5051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:05.900482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600823662442352:5051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:05.903340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600823662442352:5051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:05.903352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600823662442352:5051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:05.903355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600823662442352:5051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:05.903362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:05.904716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:05.907060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:05.907218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:05.907227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:05.907235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:05.907270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:05.907300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600822880232154:4237]
2025-10-10T14:32:05.907680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:05.907880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:05.907906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:05.908106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:05.908142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.908147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.908147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.908148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.908149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.908149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.908150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.908150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.908151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.908152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.908152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.908154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.908154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.908158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.908167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.908170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.908173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.908175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.908177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.908180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.908182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.908184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.908187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.908189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.908192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.908194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.908200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.908205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:05.908209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.908213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:05.908216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.908219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:05.908221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.908225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:05.908227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.908231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:05.908233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.908236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:05.908239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.908242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:05.908245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.908249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:05.908251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.908255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:05.908257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.908260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:05.908264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.908267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.908270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.908273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.908275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.908278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.908302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:05.910448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:05.910760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:05.910769Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:05.910770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:05.910773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:05.910777Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 440 [2:7559600822880232154:4237]
2025-10-10T14:32:05.910786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:05.910798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:05.910800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.910802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.910804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.910814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:05.910820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:05.910826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:05.910866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.910871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.910872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.910874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:05.911067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 440
2025-10-10T14:32:05.911079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 440
2025-10-10T14:32:05.911138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:05.911148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.911155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:05.911162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:05.911172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:05.911189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662442308:2438], now have 1 active actors on pipe
2025-10-10T14:32:05.911195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662442565:5051], now have 1 active actors on pipe
2025-10-10T14:32:05.911212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.911218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.911233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600822880232149:4237]
2025-10-10T14:32:05.911238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600822880232149:4237]
2025-10-10T14:32:05.911240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600822880232149:4237]
2025-10-10T14:32:05.911247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:05.911260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:05.911262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:05.911265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:05.911267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:05.911274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:05.911275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:05.911291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:05.911300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:05.911302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:05.911305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:05.911313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:05.911325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:05.911343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600822880232149:4237]
2025-10-10T14:32:05.911354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:05.911365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.911380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:05.911503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.911510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.911524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:05.911616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 441 partition: 0 MaxSeqNo: 40 sessionId: src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0
2025-10-10T14:32:05.912038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f4ee1-33aeaa16-4e7b2e31-4bf18bce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:05.914826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0] Write session: try to update token
2025-10-10T14:32:05.914844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:05.922240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:05.922268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.922284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600822880232149:4237]
2025-10-10T14:32:05.922324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:05.922349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:05.922867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:05.923018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:05.923157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:05.923290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:05.923468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:05.923511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:05.929840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId: src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:05.932404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:05.932576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:05.932594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:05.932627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:05.932695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:05.938694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:05.938707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:05.938709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:05.938710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:05.938719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600822880232149:4237]
2025-10-10T14:32:05.938723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600822880232149:4237]
2025-10-10T14:32:05.938726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600822880232149:4237]
2025-10-10T14:32:05.938762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:05.938763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:05.938767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:05.938770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:05.938771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:05.938773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:05.938940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:05.989080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600823662442580:4813]
2025-10-10T14:32:05.989324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 440, pipe: [1:7559600823662442580:4813]
2025-10-10T14:32:06.045074Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:06.052325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.052347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.052505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.052570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.052632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.052703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.052745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.052753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.052822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.052925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.052988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.053054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.053104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.053110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.053174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.053264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.053327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.053409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.053519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.053524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.053616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.053702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.053811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.053899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.053940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.053945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.054006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.054064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.054122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.054179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.054219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.054225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.054310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.054393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.054477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.054562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.054620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.054627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.054711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.054794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.054901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.054997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.055042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.055051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.055112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.055166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.055225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.055286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.055328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.055335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.055411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.055471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.055528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.055587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.055695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.055701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.055761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:06.055816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:06.055873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:06.055929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:06.055969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:06.055975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:06.056028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600823662442580:4813], now have 1 active actors on pipe
2025-10-10T14:32:06.056239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:06.056264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600823662442580:4813]
2025-10-10T14:32:06.056290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:06.056292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:06.056321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 441 reason: error at write: Disconnected sessionId: src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0
2025-10-10T14:32:06.056615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 441 sessionId: src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0 is DEAD
2025-10-10T14:32:06.056693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:06.056702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0] Write session will restart in 0.008223s
2025-10-10T14:32:06.056721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0] Write session: Do CDS request
2025-10-10T14:32:06.056726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:06.056913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:06.065879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.065969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:06.065986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 442
2025-10-10T14:32:06.066101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.066137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:06.066150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:06.066158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:06.066805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 442 sessionId:  describe result for acl check
2025-10-10T14:32:06.066845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:06.066852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:06.066857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:06.066864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600827957409946:5055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:06.067780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600827957409946:5055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:06.070555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600827957409946:5055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:06.073120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600827957409946:5055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:06.073132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600827957409946:5055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:06.073135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600827957409946:5055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:06.073142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:06.073948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:06.076155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:06.076355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:06.076364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:06.076374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:06.076415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:06.076451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600827175199720:4239]
2025-10-10T14:32:06.076872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:06.077101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:06.077134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:06.077386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:06.077438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.077444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.077444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.077445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.077446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.077446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.077447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.077448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.077448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.077449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.077450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.077450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.077451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.077455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.077464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.077467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.077469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.077472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.077474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.077477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.077479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.077482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.077484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.077486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.077488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.077491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.077498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.077503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.077508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.077512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.077514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.077518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.077520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.077524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.077527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.077530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.077532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.077535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.077538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.077542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.077544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.077547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.077551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.077554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.077558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.077563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.077568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.077574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.077578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.077584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.077595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.077600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.077641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:06.079784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:06.080112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:06.080123Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:06.080125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:06.080129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:06.080136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 441 [2:7559600827175199720:4239]
2025-10-10T14:32:06.080149Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:06.080168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:06.080179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.080182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.080185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.080202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:06.080211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:06.080219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:06.080270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.080277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.080278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.080281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:06.080362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:06.080370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.080381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.080396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.080418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:06.080442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410137:5055], now have 1 active actors on pipe
2025-10-10T14:32:06.080451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957409877:2438], now have 1 active actors on pipe
2025-10-10T14:32:06.080459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600827175199715:4239]
2025-10-10T14:32:06.080466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600827175199715:4239]
2025-10-10T14:32:06.080468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600827175199715:4239]
2025-10-10T14:32:06.080478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:06.080457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 441
2025-10-10T14:32:06.080494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:06.080497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:06.080502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:06.080461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 441
2025-10-10T14:32:06.080504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:06.080523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:06.080527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:06.080544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.080554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.080589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600827175199715:4239]
2025-10-10T14:32:06.080601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:06.080604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:06.080623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:06.080635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.080639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.080646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:06.080657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.080672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:06.080710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.080944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.080951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.080965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.081074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 442 partition: 0 MaxSeqNo: 40 sessionId: src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0
2025-10-10T14:32:06.081506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99a5bb4-24b5efaa-6706fea4-f3195133_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:06.084200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0] Write session: try to update token
2025-10-10T14:32:06.084215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:06.098659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId: src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:06.099024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:06.099037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:06.099039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:06.099041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:06.099049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600827175199715:4239]
2025-10-10T14:32:06.099054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600827175199715:4239]
2025-10-10T14:32:06.099057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600827175199715:4239]
2025-10-10T14:32:06.099100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:06.099111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.099112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:06.099179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:06.099197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:06.099200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:06.099247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:06.101543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:06.156494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600827957410163:4813]
2025-10-10T14:32:06.156735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 441, pipe: [1:7559600827957410163:4813]
2025-10-10T14:32:06.203176Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:06.203635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.203646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.203687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410163:4813], now have 1 active actors on pipe
2025-10-10T14:32:06.203852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:06.203896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:06.203910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:06.203973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 442 reason: error at write: Disconnected sessionId: src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0
2025-10-10T14:32:06.203985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:06.204020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600827957410163:4813]
2025-10-10T14:32:06.204186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 442 sessionId: src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0 is DEAD
2025-10-10T14:32:06.204321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:06.204331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0] Write session will restart in 0.007597s
2025-10-10T14:32:06.204355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0] Write session: Do CDS request
2025-10-10T14:32:06.204360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:06.212741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.212791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:06.212804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 443
2025-10-10T14:32:06.212916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.212950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:06.212960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:06.212964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:06.213552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 443 sessionId:  describe result for acl check
2025-10-10T14:32:06.213591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:06.213596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:06.213597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:06.213602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600827957410242:5060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:06.214091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600827957410242:5060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:06.216825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600827957410242:5060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:06.218968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600827957410242:5060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:06.218979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600827957410242:5060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:06.218988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600827957410242:5060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:06.218993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:06.220121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:06.222206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:06.222383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:06.222399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:06.222408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:06.222474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:06.222503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600827175200003:4242]
2025-10-10T14:32:06.222905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:06.223132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:06.223159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:06.223384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:06.223425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.223430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.223430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.223431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.223432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.223432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.223433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.223434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.223434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.223435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.223435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.223436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.223436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.223440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.223447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.223450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.223452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.223454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.223457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.223459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.223461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.223463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.223466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.223468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.223470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.223472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.223477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.223483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.223489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.223495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.223498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.223503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.223507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.223513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.223518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.223523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.223526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.223529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.223532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.223535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.223537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.223540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.223543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.223546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.223548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.223551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.223554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.223556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.223559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.223562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.223564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.223569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.223611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:06.225703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:06.226056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:06.226065Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:06.226067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:06.226069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:06.226073Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 442 [2:7559600827175200003:4242]
2025-10-10T14:32:06.226081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:06.226092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:06.226093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.226096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.226097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.226108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:06.226112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:06.226118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:06.226172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.226178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.226179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.226181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:06.226238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:06.226247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.226256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.226262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.226272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:06.226288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410164:2438], now have 1 active actors on pipe
2025-10-10T14:32:06.226291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410423:5060], now have 1 active actors on pipe
2025-10-10T14:32:06.226296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600827175199998:4242]
2025-10-10T14:32:06.226300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600827175199998:4242]
2025-10-10T14:32:06.226301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600827175199998:4242]
2025-10-10T14:32:06.226313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:06.226329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:06.226335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:06.226338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:06.226340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:06.226349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:06.226352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:06.226347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 442
2025-10-10T14:32:06.226371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600827175199998:4242]
2025-10-10T14:32:06.226378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:06.226380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:06.226354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 442
2025-10-10T14:32:06.226401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.226406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.226441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2e35d7e-14af272a-591f9260-89a6df24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:06.226455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.226458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.226461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:06.226472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.226482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:06.226500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.226658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.226669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.226689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.226775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 443 partition: 0 MaxSeqNo: 40 sessionId: src_id|d2e35d7e-14af272a-591f9260-89a6df24_0
2025-10-10T14:32:06.227044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|739e8ba7-ed6a2d20-821078b8-9ad2c851_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d2e35d7e-14af272a-591f9260-89a6df24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:06.229511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e35d7e-14af272a-591f9260-89a6df24_0] Write session: try to update token
2025-10-10T14:32:06.229523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e35d7e-14af272a-591f9260-89a6df24_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:06.241708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId: src_id|d2e35d7e-14af272a-591f9260-89a6df24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:06.244067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:06.244080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:06.244083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:06.244084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:06.244091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600827175199998:4242]
2025-10-10T14:32:06.244094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600827175199998:4242]
2025-10-10T14:32:06.244097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600827175199998:4242]
2025-10-10T14:32:06.244133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:06.244139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.244141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:06.244146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:06.244151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:06.244155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:06.244146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:06.244251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:06.304413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600827957410441:4813]
2025-10-10T14:32:06.304698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 442, pipe: [1:7559600827957410441:4813]
2025-10-10T14:32:06.345605Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:06.345836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.345848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.345888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410441:4813], now have 1 active actors on pipe
2025-10-10T14:32:06.346045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:06.346118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:06.346129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600827957410441:4813]
2025-10-10T14:32:06.346150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:06.346226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 443 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d2e35d7e-14af272a-591f9260-89a6df24_0
2025-10-10T14:32:06.346408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 443 sessionId: src_id|d2e35d7e-14af272a-591f9260-89a6df24_0 is DEAD
2025-10-10T14:32:06.346553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e35d7e-14af272a-591f9260-89a6df24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:06.346564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e35d7e-14af272a-591f9260-89a6df24_0] Write session will restart in 0.008481s
2025-10-10T14:32:06.346595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e35d7e-14af272a-591f9260-89a6df24_0] Write session: Do CDS request
2025-10-10T14:32:06.346600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e35d7e-14af272a-591f9260-89a6df24_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:06.355830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e35d7e-14af272a-591f9260-89a6df24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.355898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:06.355913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 444
2025-10-10T14:32:06.356081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.356119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:06.356130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:06.356133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:06.356553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 444 sessionId:  describe result for acl check
2025-10-10T14:32:06.356587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:06.356594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:06.356596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:06.356602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600827957410546:5066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:06.357107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600827957410546:5066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:06.359383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600827957410546:5066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:06.361316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:06.363623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:06.363723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600827957410546:5066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:06.363734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600827957410546:5066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:06.363736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600827957410546:5066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:06.363743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:06.363777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:06.363785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:06.363794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:06.363834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:06.363862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600827175200274:4244]
2025-10-10T14:32:06.364244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:06.364438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:06.364471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:06.364707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:06.364747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.364751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.364752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.364752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.364753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.364754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.364754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.364755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.364755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.364756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.364757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.364757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.364758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.364761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.364770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.364772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.364775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.364777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.364779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.364781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.364783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.364785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.364788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.364790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.364792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.364795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.364799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.364804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.364809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.364812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.364814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.364817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.364820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.364823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.364826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.364829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.364831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.364834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.364837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.364840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.364842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.364845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.364848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.364851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.364855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.364858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.364868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.364871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.364873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.364878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.364887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.364893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.364915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:06.366828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:06.367112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:06.367120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:06.367121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:06.367124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:06.367128Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 443 [2:7559600827175200274:4244]
2025-10-10T14:32:06.367135Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:06.367146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:06.367152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.367154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.367155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.367168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:06.367173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:06.367179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:06.367228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.367235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.367236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.367237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:06.367296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:06.367303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.367309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.367315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.367325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:06.367339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410705:5066], now have 1 active actors on pipe
2025-10-10T14:32:06.367345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410442:2438], now have 1 active actors on pipe
2025-10-10T14:32:06.367351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600827175200269:4244]
2025-10-10T14:32:06.367353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600827175200269:4244]
2025-10-10T14:32:06.367354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600827175200269:4244]
2025-10-10T14:32:06.367363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:06.367373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:06.367381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:06.367384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:06.367385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:06.367385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:06.367388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:06.367402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600827175200269:4244]
2025-10-10T14:32:06.367404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:06.367385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 443
2025-10-10T14:32:06.367385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 443
2025-10-10T14:32:06.367410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:06.367427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.367434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.367459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:06.367469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.367472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.367473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:06.367480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.367488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:06.367499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.367620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.367626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.367640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.367716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 444 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0
2025-10-10T14:32:06.367982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e35d7e-14af272a-591f9260-89a6df24_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:06.370608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0] Write session: try to update token
2025-10-10T14:32:06.370627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:06.383627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId: src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:06.384887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:06.384900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:06.384902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:06.384903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:06.384910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600827175200269:4244]
2025-10-10T14:32:06.384914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600827175200269:4244]
2025-10-10T14:32:06.384917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600827175200269:4244]
2025-10-10T14:32:06.384956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:06.384966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.384968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:06.384971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:06.384978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:06.384983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:06.385085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:06.386279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:06.446273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600827957410716:4813]
2025-10-10T14:32:06.446506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 443, pipe: [1:7559600827957410716:4813]
2025-10-10T14:32:06.485158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:06.485721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.485733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.485771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410716:4813], now have 1 active actors on pipe
2025-10-10T14:32:06.485910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:06.485960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600827957410716:4813]
2025-10-10T14:32:06.485966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:06.485991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:06.486053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 444 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0
2025-10-10T14:32:06.486267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 444 sessionId: src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0 is DEAD
2025-10-10T14:32:06.486437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:06.486447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0] Write session will restart in 0.007707s
2025-10-10T14:32:06.486465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0] Write session: Do CDS request
2025-10-10T14:32:06.486469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:06.494819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.494916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:06.494932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 445
2025-10-10T14:32:06.495059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.495093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:06.495104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:06.495108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:06.495512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 445 sessionId:  describe result for acl check
2025-10-10T14:32:06.495543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:06.495550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:06.495552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:06.495557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600827957410805:5070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:06.496057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600827957410805:5070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:06.498794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600827957410805:5070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:06.500998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600827957410805:5070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:06.501008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600827957410805:5070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:06.501011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600827957410805:5070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:06.501017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:06.501367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:06.503084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:06.503252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:06.503264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:06.503275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:06.503323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:06.503364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600827175200547:4246]
2025-10-10T14:32:06.503961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:06.504210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:06.504253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:06.504575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:06.504630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.504635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.504636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.504637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.504638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.504639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.504640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.504642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.504643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.504644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.504645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.504646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.504647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.504653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.504666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.504670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.504675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.504678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.504682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.504686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.504690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.504693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.504697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.504702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.504706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.504710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.504717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.504726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.504733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.504738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.504743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.504749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.504753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.504759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.504769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.504774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.504779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.504784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.504788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.504794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.504799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.504804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.504813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.504818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.504823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.504833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.504838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.504848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.504852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.504861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.504865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.504871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.504911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:06.507134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:06.507540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:06.507554Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:06.507557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:06.507560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:06.507566Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 444 [2:7559600827175200547:4246]
2025-10-10T14:32:06.507577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:06.507595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:06.507603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.507606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.507608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.507624Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:06.507636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:06.507648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:06.507716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.507723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.507725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.507727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:06.507791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:06.507799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.507811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.507827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.507849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:06.507874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410981:5070], now have 1 active actors on pipe
2025-10-10T14:32:06.507882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957410718:2438], now have 1 active actors on pipe
2025-10-10T14:32:06.507890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600827175200542:4246]
2025-10-10T14:32:06.507897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600827175200542:4246]
2025-10-10T14:32:06.507899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600827175200542:4246]
2025-10-10T14:32:06.507913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:06.507908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 444
2025-10-10T14:32:06.507916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 444
2025-10-10T14:32:06.507930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:06.507930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:06.507935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:06.507936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:06.507944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:06.507946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:06.507974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.507981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.507995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600827175200542:4246]
2025-10-10T14:32:06.508007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:06.508011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:06.508034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:06.508042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.508046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.508048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:06.508059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.508069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:06.508101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.508248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.508256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.508273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.508363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 445 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0
2025-10-10T14:32:06.508686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3eca77-7b8eee90-f55488c0-48a943db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:06.511267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0] Write session: try to update token
2025-10-10T14:32:06.511285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:06.524171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId: src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:06.525983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:06.525998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:06.526001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:06.526004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:06.526013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600827175200542:4246]
2025-10-10T14:32:06.526018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600827175200542:4246]
2025-10-10T14:32:06.526021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600827175200542:4246]
2025-10-10T14:32:06.526064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:06.526067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:06.526070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:06.526075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:06.526076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.526078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:06.526213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:06.526676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:06.586053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600827957411000:4813]
2025-10-10T14:32:06.586247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 444, pipe: [1:7559600827957411000:4813]
2025-10-10T14:32:06.631612Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:06.632118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.632134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.632183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411000:4813], now have 1 active actors on pipe
2025-10-10T14:32:06.632369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:06.632431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:06.632432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600827957411000:4813]
2025-10-10T14:32:06.632446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:06.632451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:06.632504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 445 reason: error at write: Disconnected sessionId: src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0
2025-10-10T14:32:06.632706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 445 sessionId: src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0 is DEAD
2025-10-10T14:32:06.632857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:06.632881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0] Write session will restart in 0.006126s
2025-10-10T14:32:06.632905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0] Write session: Do CDS request
2025-10-10T14:32:06.632912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:06.639776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.639861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:06.639875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 446
2025-10-10T14:32:06.640006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.640040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:06.640050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:06.640053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:06.640477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 446 sessionId:  describe result for acl check
2025-10-10T14:32:06.640506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:06.640511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:06.640513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:06.640518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600827957411061:5076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:06.641049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600827957411061:5076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:06.644101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600827957411061:5076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:06.646563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600827957411061:5076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:06.646574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600827957411061:5076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:06.646586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600827957411061:5076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:06.646592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:06.647823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:06.649973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:06.650186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:06.650197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:06.650209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:06.650267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:06.650311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600827175200822:4249]
2025-10-10T14:32:06.650918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:06.651153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:06.651192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:06.651489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:06.651544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.651548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.651550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.651551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.651552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.651553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.651554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.651555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.651557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.651558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.651559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.651560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.651561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.651567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.651580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.651584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.651588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.651592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.651596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.651600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.651604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.651609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.651614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.651618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.651622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.651625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.651632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.651642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.651652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.651658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.651663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.651668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.651677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.651682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.651690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.651695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.651699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.651705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.651710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.651716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.651723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.651729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.651736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.651742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.651750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.651755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.651760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.651765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.651771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.651777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.651785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.651791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.651835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:06.653814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:06.654112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:06.654122Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:06.654125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:06.654128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:06.654134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 445 [2:7559600827175200822:4249]
2025-10-10T14:32:06.654144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:06.654161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:06.654168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.654172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.654174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.654190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:06.654201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:06.654212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:06.654266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.654272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.654274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.654277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:06.654344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:06.654350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.654361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.654377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.654398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:06.654422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411267:5076], now have 1 active actors on pipe
2025-10-10T14:32:06.654429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411005:2438], now have 1 active actors on pipe
2025-10-10T14:32:06.654438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600827175200817:4249]
2025-10-10T14:32:06.654443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600827175200817:4249]
2025-10-10T14:32:06.654446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600827175200817:4249]
2025-10-10T14:32:06.654461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:06.654441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 445
2025-10-10T14:32:06.654469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:06.654471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:06.654472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:06.654477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:06.654448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 445
2025-10-10T14:32:06.654493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:06.654496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:06.654528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.654537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.654556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600827175200817:4249]
2025-10-10T14:32:06.654569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:06.654594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:06.654609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22fabf80-5083f397-ddf6872-6232dbd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:06.654621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.654630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.654632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:06.654643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.654659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:06.654681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.654815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.654822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.654836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.654921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 446 partition: 0 MaxSeqNo: 40 sessionId: src_id|22fabf80-5083f397-ddf6872-6232dbd1_0
2025-10-10T14:32:06.655270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a24df99-5a979962-8fb9d13d-81c0fc3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|22fabf80-5083f397-ddf6872-6232dbd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:06.657715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22fabf80-5083f397-ddf6872-6232dbd1_0] Write session: try to update token
2025-10-10T14:32:06.657730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22fabf80-5083f397-ddf6872-6232dbd1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:06.669957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId: src_id|22fabf80-5083f397-ddf6872-6232dbd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:06.671726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:06.671740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:06.671742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:06.671743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:06.671750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600827175200817:4249]
2025-10-10T14:32:06.671753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600827175200817:4249]
2025-10-10T14:32:06.671755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600827175200817:4249]
2025-10-10T14:32:06.671786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:06.671789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:06.671791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:06.671793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:06.671795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.671796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:06.671928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:06.672496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:06.732465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600827957411305:4813]
2025-10-10T14:32:06.732668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 445, pipe: [1:7559600827957411305:4813]
2025-10-10T14:32:06.772307Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:06.772589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.772600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.772638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411305:4813], now have 1 active actors on pipe
2025-10-10T14:32:06.772833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:06.772858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:06.772843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:06.772847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:06.772882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600827957411305:4813]
2025-10-10T14:32:06.772912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 446 reason: error at write: Disconnected sessionId: src_id|22fabf80-5083f397-ddf6872-6232dbd1_0
2025-10-10T14:32:06.773126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 446 sessionId: src_id|22fabf80-5083f397-ddf6872-6232dbd1_0 is DEAD
2025-10-10T14:32:06.773245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22fabf80-5083f397-ddf6872-6232dbd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:06.773254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22fabf80-5083f397-ddf6872-6232dbd1_0] Write session will restart in 0.008520s
2025-10-10T14:32:06.773279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22fabf80-5083f397-ddf6872-6232dbd1_0] Write session: Do CDS request
2025-10-10T14:32:06.773286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22fabf80-5083f397-ddf6872-6232dbd1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:06.782743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22fabf80-5083f397-ddf6872-6232dbd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.782864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:06.782875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 447
2025-10-10T14:32:06.782975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.783002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:06.783009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:06.783012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:06.783498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 447 sessionId:  describe result for acl check
2025-10-10T14:32:06.783524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:06.783529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:06.783531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:06.783535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600827957411396:5089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:06.784143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600827957411396:5089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:06.786655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600827957411396:5089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:06.789273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600827957411396:5089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:06.789283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600827957411396:5089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:06.789287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600827957411396:5089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:06.789293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:06.789402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:06.791441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:06.791592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:06.791603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:06.791613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:06.791663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:06.791711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600827175201135:4264]
2025-10-10T14:32:06.792193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:06.792439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:06.792483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:06.792789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:06.792838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.792843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.792844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.792845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.792846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.792847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.792848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.792849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.792850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.792851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.792853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.792854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.792855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.792860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.792873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.792876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.792881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.792885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.792889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.792893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.792897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.792901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.792905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.792910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.792914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.792918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.792924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.792932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.792939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.792944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.792949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.792960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.792965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.792970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.792977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.792983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.792990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.792996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.793000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.793004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.793008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.793014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.793018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.793023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.793027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.793033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.793040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.793045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.793050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.793055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.793060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.793066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.793106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:06.795280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:06.795690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:06.795702Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:06.795704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:06.795708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:06.795713Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 446 [2:7559600827175201135:4264]
2025-10-10T14:32:06.795725Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:06.795741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:06.795744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.795747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.795749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.795765Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:06.795772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:06.795784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:06.795825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.795830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.795832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.795834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:06.795892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:06.795899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.795909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.795922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.795943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:06.795967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411571:5089], now have 1 active actors on pipe
2025-10-10T14:32:06.795974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411306:2438], now have 1 active actors on pipe
2025-10-10T14:32:06.795982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600827175201129:4264]
2025-10-10T14:32:06.795987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600827175201129:4264]
2025-10-10T14:32:06.795989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600827175201129:4264]
2025-10-10T14:32:06.796004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:06.795990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 446
2025-10-10T14:32:06.796011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:06.795990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 446
2025-10-10T14:32:06.796013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:06.796014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:06.796021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:06.796037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:06.796044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:06.796078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.796086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.796101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600827175201129:4264]
2025-10-10T14:32:06.796111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:06.796115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:06.796140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef1ce129-4f841239-96fcade5-ca18619c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:06.796151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.796158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.796160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:06.796170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.796180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:06.796204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.796341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.796350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.796366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.796457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 447 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef1ce129-4f841239-96fcade5-ca18619c_0
2025-10-10T14:32:06.796753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22fabf80-5083f397-ddf6872-6232dbd1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef1ce129-4f841239-96fcade5-ca18619c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:06.799203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1ce129-4f841239-96fcade5-ca18619c_0] Write session: try to update token
2025-10-10T14:32:06.799219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1ce129-4f841239-96fcade5-ca18619c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:06.810965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId: src_id|ef1ce129-4f841239-96fcade5-ca18619c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:06.813366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:06.813416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:06.813430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:06.813434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:06.813436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:06.813446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600827175201129:4264]
2025-10-10T14:32:06.813450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600827175201129:4264]
2025-10-10T14:32:06.813453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600827175201129:4264]
2025-10-10T14:32:06.813494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:06.813498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:06.813501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:06.813503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:06.813513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.813516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:06.813675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:06.873267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600827957411584:4813]
2025-10-10T14:32:06.873475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 446, pipe: [1:7559600827957411584:4813]
2025-10-10T14:32:06.918939Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:06.919433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.919448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.919490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411584:4813], now have 1 active actors on pipe
2025-10-10T14:32:06.919658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:06.919717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600827957411584:4813]
2025-10-10T14:32:06.919747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:06.919809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 447 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef1ce129-4f841239-96fcade5-ca18619c_0
2025-10-10T14:32:06.919823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:06.920007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 447 sessionId: src_id|ef1ce129-4f841239-96fcade5-ca18619c_0 is DEAD
2025-10-10T14:32:06.920161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1ce129-4f841239-96fcade5-ca18619c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:06.920172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1ce129-4f841239-96fcade5-ca18619c_0] Write session will restart in 0.008555s
2025-10-10T14:32:06.920195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1ce129-4f841239-96fcade5-ca18619c_0] Write session: Do CDS request
2025-10-10T14:32:06.920201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1ce129-4f841239-96fcade5-ca18619c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:06.929832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1ce129-4f841239-96fcade5-ca18619c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.929876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:06.929890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 448
2025-10-10T14:32:06.930055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:06.930093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:06.930101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:06.930104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:06.930603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 448 sessionId:  describe result for acl check
2025-10-10T14:32:06.930631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:06.930637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:06.930639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:06.930646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600827957411676:5093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:06.931060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600827957411676:5093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:06.933757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600827957411676:5093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:06.936261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600827957411676:5093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:06.936272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600827957411676:5093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:06.936275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600827957411676:5093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:06.936281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:06.936822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:06.939021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:06.939208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:06.939217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:06.939229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:06.939284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:06.939322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600827175201411:4266]
2025-10-10T14:32:06.940344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:06.940647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:06.940690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:06.941008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:06.941062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.941068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.941070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.941071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.941072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.941073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.941075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.941076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.941077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.941078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.941079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.941080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.941082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.941087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.941100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.941105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.941110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.941114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.941119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.941123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.941127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.941132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.941141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.941146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.941150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.941153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.941160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.941171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:06.941179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.941188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:06.941193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.941199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:06.941209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.941214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:06.941219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.941225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:06.941229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.941234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:06.941238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.941243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:06.941248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.941253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:06.941258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.941263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:06.941272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.941277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:06.941282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.941287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.941291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.941297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.941305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.941310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.941368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:06.943534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:06.943838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:06.943849Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:06.943852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:06.943855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:06.943861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 447 [2:7559600827175201411:4266]
2025-10-10T14:32:06.943872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:06.943892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:06.943900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.943903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.943905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.943919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:06.943933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:06.943944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:06.943991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.943998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.944000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.944002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:06.944060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:06.944067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.944077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:06.944095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:06.944117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:06.944141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411585:2438], now have 1 active actors on pipe
2025-10-10T14:32:06.944149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600827957411850:5093], now have 1 active actors on pipe
2025-10-10T14:32:06.944156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600827175201406:4266]
2025-10-10T14:32:06.944163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600827175201406:4266]
2025-10-10T14:32:06.944165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600827175201406:4266]
2025-10-10T14:32:06.944164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 447
2025-10-10T14:32:06.944180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:06.944193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:06.944169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 447
2025-10-10T14:32:06.944196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:06.944197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:06.944198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:06.944214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:06.944217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:06.944251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.944259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.944273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600827175201406:4266]
2025-10-10T14:32:06.944287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:06.944313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:06.944316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:06.944324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:06.944327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:06.944329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:06.944339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:06.944349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:06.944376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.944526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:06.944535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:06.944550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:06.944657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 448 partition: 0 MaxSeqNo: 40 sessionId: src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0
2025-10-10T14:32:06.944985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef1ce129-4f841239-96fcade5-ca18619c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:06.947517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0] Write session: try to update token
2025-10-10T14:32:06.947534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:06.961549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId: src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:06.962272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:06.962288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:06.962290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:06.962293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:06.962301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600827175201406:4266]
2025-10-10T14:32:06.962306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600827175201406:4266]
2025-10-10T14:32:06.962309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600827175201406:4266]
2025-10-10T14:32:06.962349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:06.962362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:06.962363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:06.962364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:06.962369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:06.962373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:06.962498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:06.964104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:07.019718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600832252379160:4813]
2025-10-10T14:32:07.019955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 447, pipe: [1:7559600832252379160:4813]
2025-10-10T14:32:07.067611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:07.068110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.068124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.068163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379160:4813], now have 1 active actors on pipe
2025-10-10T14:32:07.068321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:07.068376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:07.068396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:07.068399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:07.068437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600832252379160:4813]
2025-10-10T14:32:07.068449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 448 reason: error at write: Disconnected sessionId: src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0
2025-10-10T14:32:07.068633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 448 sessionId: src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0 is DEAD
2025-10-10T14:32:07.068794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:07.068805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0] Write session will restart in 0.005175s
2025-10-10T14:32:07.068832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0] Write session: Do CDS request
2025-10-10T14:32:07.068842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:07.074788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.074841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:07.074858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 449
2025-10-10T14:32:07.075014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.075059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:07.075071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:07.075074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:07.075562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 449 sessionId:  describe result for acl check
2025-10-10T14:32:07.075601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:07.075605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:07.075606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:07.075610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600832252379210:5097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:07.076137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600832252379210:5097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:07.079201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600832252379210:5097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:07.081751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600832252379210:5097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:07.081763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600832252379210:5097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:07.081765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600832252379210:5097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:07.081771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:07.083814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:07.086022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:07.086237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:07.086248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:07.086260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:07.086319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:07.086358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600831470168984:4268]
2025-10-10T14:32:07.086984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:07.087248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:07.087292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:07.087611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:07.087667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.087672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.087674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.087675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.087676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.087678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.087679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.087681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.087682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.087683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.087684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.087685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.087686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.087692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.087705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.087708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.087712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.087716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.087720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.087729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.087737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.087741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.087745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.087749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.087753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.087762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.087769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.087782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.087793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.087803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.087812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.087819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.087827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.087833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.087842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.087852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.087860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.087865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.087874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.087883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.087892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.087902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.087911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.087921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.087929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.087934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.087943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.087953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.087961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.087966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.087975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.087984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.088026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:07.090162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:07.090659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:07.090671Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:07.090673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:07.090677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:07.090682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 448 [2:7559600831470168984:4268]
2025-10-10T14:32:07.090693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:07.090713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:07.090721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.090724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.090726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.090744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:07.090755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:07.090764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:07.090817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.090824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.090826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.090828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:07.090890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:07.090900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.090911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.090924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.090942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:07.090965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379417:5097], now have 1 active actors on pipe
2025-10-10T14:32:07.090969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379162:2438], now have 1 active actors on pipe
2025-10-10T14:32:07.090976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600831470168979:4268]
2025-10-10T14:32:07.090980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600831470168979:4268]
2025-10-10T14:32:07.090982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600831470168979:4268]
2025-10-10T14:32:07.090996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:07.090986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 448
2025-10-10T14:32:07.090991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 448
2025-10-10T14:32:07.091013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:07.091022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:07.091025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:07.091026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:07.091034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:07.091037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:07.091077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.091086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.091100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600831470168979:4268]
2025-10-10T14:32:07.091107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:07.091111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:07.091135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:07.091147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.091154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.091157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:07.091167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.091183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:07.091207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.091328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.091338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.091354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.091440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 449 partition: 0 MaxSeqNo: 40 sessionId: src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0
2025-10-10T14:32:07.091816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7354fa9-cc4a1d11-f5c843e9-22fd6c2c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:07.094304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0] Write session: try to update token
2025-10-10T14:32:07.094324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:07.106923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId: src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:07.108754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:07.108774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:07.108777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:07.108779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:07.108788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600831470168979:4268]
2025-10-10T14:32:07.108791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600831470168979:4268]
2025-10-10T14:32:07.108795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600831470168979:4268]
2025-10-10T14:32:07.108839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:07.108841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:07.108849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:07.108849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.108852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:07.108852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:07.108989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:07.109226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:07.168711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600832252379462:4813]
2025-10-10T14:32:07.168912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 448, pipe: [1:7559600832252379462:4813]
2025-10-10T14:32:07.214648Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:07.215546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.215563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.215601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379462:4813], now have 1 active actors on pipe
2025-10-10T14:32:07.215791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:07.215802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600832252379462:4813]
2025-10-10T14:32:07.215804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:07.215821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:07.215838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:07.215889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 449 reason: error at write: Disconnected sessionId: src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0
2025-10-10T14:32:07.216092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 449 sessionId: src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0 is DEAD
2025-10-10T14:32:07.216252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:07.216261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0] Write session will restart in 0.009574s
2025-10-10T14:32:07.216293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0] Write session: Do CDS request
2025-10-10T14:32:07.216299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:07.226865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.226989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:07.227004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 450
2025-10-10T14:32:07.227140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.227174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:07.227184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:07.227187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:07.227730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 450 sessionId:  describe result for acl check
2025-10-10T14:32:07.227765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:07.227770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:07.227772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:07.227777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600832252379605:5102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:07.228203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600832252379605:5102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:07.230348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600832252379605:5102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:07.231969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:07.234060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:07.234266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:07.234279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:07.234291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:07.234352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:07.234366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600832252379605:5102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:07.234379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600832252379605:5102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:07.234383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600832252379605:5102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:07.234393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600831470169273:4271]
2025-10-10T14:32:07.234402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:07.235001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:07.235221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:07.235253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:07.235495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:07.235535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.235539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.235540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.235541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.235541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.235542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.235543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.235543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.235544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.235545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.235545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.235546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.235546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.235550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.235557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.235560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.235562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.235565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.235567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.235569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.235571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.235574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.235576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.235579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.235581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.235583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.235589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.235594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.235598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.235602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.235604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.235608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.235610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.235613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.235616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.235619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.235622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.235624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.235628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.235632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.235635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.235637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.235640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.235643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.235645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.235648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.235650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.235653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.235656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.235659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.235662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.235664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.235686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:07.238253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:07.238659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:07.238670Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:07.238672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:07.238675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:07.238680Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 449 [2:7559600831470169273:4271]
2025-10-10T14:32:07.238691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:07.238710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:07.238715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.238719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.238721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.238735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:07.238746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:07.238756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:07.238808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.238814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.238816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.238818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:07.238879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:07.238886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.238898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.238913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.238932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:07.238956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379463:2438], now have 1 active actors on pipe
2025-10-10T14:32:07.238964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379732:5102], now have 1 active actors on pipe
2025-10-10T14:32:07.238971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600831470169268:4271]
2025-10-10T14:32:07.238977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600831470169268:4271]
2025-10-10T14:32:07.238979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600831470169268:4271]
2025-10-10T14:32:07.238990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 449
2025-10-10T14:32:07.239004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 449
2025-10-10T14:32:07.238993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:07.239013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:07.239012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:07.239016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:07.239017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:07.239029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:07.239037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:07.239069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.239077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.239091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600831470169268:4271]
2025-10-10T14:32:07.239104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:07.239117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:07.239135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:07.239147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.239154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.239157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:07.239169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.239183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:07.239210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.239329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.239337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.239352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.239415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 450 partition: 0 MaxSeqNo: 40 sessionId: src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0
2025-10-10T14:32:07.239712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f833eb7-1f96c57a-7574d0dd-d53a74c6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:07.242341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0] Write session: try to update token
2025-10-10T14:32:07.242358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:07.255870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId: src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:07.258162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:07.258690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.258709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.260423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:07.260461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:07.260469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:07.260472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:07.260474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:07.260483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600831470169268:4271]
2025-10-10T14:32:07.260487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600831470169268:4271]
2025-10-10T14:32:07.260491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600831470169268:4271]
2025-10-10T14:32:07.260527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:07.260539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:07.260540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:07.260553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:07.260544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:07.260545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.260548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:07.260713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:07.316168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600832252379744:4813]
2025-10-10T14:32:07.316431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 449, pipe: [1:7559600832252379744:4813]
2025-10-10T14:32:07.363460Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:07.370014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.370035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.370180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.370239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.370296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.370353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.370550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.370558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.370655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.370707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.370761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.370819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.370859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.370866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.370932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.371011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.371070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.371123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.371161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.371167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.371226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.371284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.371341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.371427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.371467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.371472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.371531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.371589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.371645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.371712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.371752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.371758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.371851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.371901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.371955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.372052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.372090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.372095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.372175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.372224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.372440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.372661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.372701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.372707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.372762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.372812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.372864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.372917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.372953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.372958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.373013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.373072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.373128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.373181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.373217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.373222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.373276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.373326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.373391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.373453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.373568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.373574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.373610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379744:4813], now have 1 active actors on pipe
2025-10-10T14:32:07.373832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:07.373842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600832252379744:4813]
2025-10-10T14:32:07.373869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:07.373873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:07.373905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 450 reason: error at write: Disconnected sessionId: src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0
2025-10-10T14:32:07.373966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:07.374088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 450 sessionId: src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0 is DEAD
2025-10-10T14:32:07.374239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:07.374249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0] Write session will restart in 0.005635s
2025-10-10T14:32:07.374273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0] Write session: Do CDS request
2025-10-10T14:32:07.374278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:07.380813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.380950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:07.380961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 451
2025-10-10T14:32:07.381057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.381082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:07.381089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:07.381092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:07.381499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 451 sessionId:  describe result for acl check
2025-10-10T14:32:07.381536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:07.381545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:07.381547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:07.381552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600832252379781:5106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:07.381973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600832252379781:5106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:07.385003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600832252379781:5106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:07.387497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600832252379781:5106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:07.387509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600832252379781:5106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:07.387512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600832252379781:5106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:07.387518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:07.390007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:07.392345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:07.392546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:07.392556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:07.392571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:07.392619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:07.392670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600831470169553:4273]
2025-10-10T14:32:07.393280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:07.393531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:07.393571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:07.393898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:07.393948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.393954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.393955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.393956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.393958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.393959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.393960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.393961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.393962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.393963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.393965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.393966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.393967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.393973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.393985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.393990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.393994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.393997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.394002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.394005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.394009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.394013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.394018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.394021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.394024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.394028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.394035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.394043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.394056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.394062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.394068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.394073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.394091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.394096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.394100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.394104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.394111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.394116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.394124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.394129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.394134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.394138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.394143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.394152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.394156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.394161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.394165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.394170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.394178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.394183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.394187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.394196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.394237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:07.396300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:07.396693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:07.396706Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:07.396708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:07.396711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:07.396718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 450 [2:7559600831470169553:4273]
2025-10-10T14:32:07.396730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:07.396749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:07.396757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.396760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.396762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.396779Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:07.396787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:07.396795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:07.396846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.396852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.396854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.396856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:07.396922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:07.396930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.396943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.396955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.396976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:07.397000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379976:5106], now have 1 active actors on pipe
2025-10-10T14:32:07.397009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252379745:2438], now have 1 active actors on pipe
2025-10-10T14:32:07.397016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600831470169548:4273]
2025-10-10T14:32:07.397018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600831470169548:4273]
2025-10-10T14:32:07.397020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600831470169548:4273]
2025-10-10T14:32:07.397028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:07.397041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:07.397016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 450
2025-10-10T14:32:07.397013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 450
2025-10-10T14:32:07.397048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:07.397052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:07.397055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:07.397060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:07.397063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:07.397099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.397108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.397123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600831470169548:4273]
2025-10-10T14:32:07.397134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:07.397146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:07.397166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26e950e2-cd478772-a369c023-ccf9541d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:07.397178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.397182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.397188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:07.397199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.397209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:07.397233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.397353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.397363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.397378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.397468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 451 partition: 0 MaxSeqNo: 40 sessionId: src_id|26e950e2-cd478772-a369c023-ccf9541d_0
2025-10-10T14:32:07.397850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bcd7c06-44c8a1dc-9d5fc5fc-ca7ce18d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26e950e2-cd478772-a369c023-ccf9541d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:07.400503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26e950e2-cd478772-a369c023-ccf9541d_0] Write session: try to update token
2025-10-10T14:32:07.400522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26e950e2-cd478772-a369c023-ccf9541d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:07.412786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId: src_id|26e950e2-cd478772-a369c023-ccf9541d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:07.415116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:07.415754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.415777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.415802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:07.415805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:07.415808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:07.415810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:07.415818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600831470169548:4273]
2025-10-10T14:32:07.415822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600831470169548:4273]
2025-10-10T14:32:07.415825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600831470169548:4273]
2025-10-10T14:32:07.415856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:07.415865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:07.415868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:07.415882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:07.415893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.415900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:07.416032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:07.473858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600832252380027:4813]
2025-10-10T14:32:07.474067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 450, pipe: [1:7559600832252380027:4813]
2025-10-10T14:32:07.520361Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:07.520734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:07.520786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380027:4813], now have 1 active actors on pipe
2025-10-10T14:32:07.520852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:07.520981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:07.521036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600832252380027:4813]
2025-10-10T14:32:07.530921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:07.530934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:07.530959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 451 reason: error at write: Disconnected sessionId: src_id|26e950e2-cd478772-a369c023-ccf9541d_0
2025-10-10T14:32:07.531080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 451 sessionId: src_id|26e950e2-cd478772-a369c023-ccf9541d_0 is DEAD
2025-10-10T14:32:07.531224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e950e2-cd478772-a369c023-ccf9541d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:07.531234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e950e2-cd478772-a369c023-ccf9541d_0] Write session will restart in 0.005046s
2025-10-10T14:32:07.531261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e950e2-cd478772-a369c023-ccf9541d_0] Write session: Do CDS request
2025-10-10T14:32:07.531267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e950e2-cd478772-a369c023-ccf9541d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:07.537787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26e950e2-cd478772-a369c023-ccf9541d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.537885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:07.537898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 452
2025-10-10T14:32:07.538024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.538059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:07.538069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:07.538073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:07.538538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 452 sessionId:  describe result for acl check
2025-10-10T14:32:07.538574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:07.538580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:07.538607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:07.538614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600832252380161:5110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:07.539153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600832252380161:5110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:07.542129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600832252380161:5110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:07.543265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:07.546310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:07.546520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:07.546533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:07.546546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:07.546619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:07.546661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600831470169833:4275]
2025-10-10T14:32:07.546734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600832252380161:5110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:07.546750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600832252380161:5110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:07.546754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600832252380161:5110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:07.546764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:07.547635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:07.547896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:07.547931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:07.548149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:07.548192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.548200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.548201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.548202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.548203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.548204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.548205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.548206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.548207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.548209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.548210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.548210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.548212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.548218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.548230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.548232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.548235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.548238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.548242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.548246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.548250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.548253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.548259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.548263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.548267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.548271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.548279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.548285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.548290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.548293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.548295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.548298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.548301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.548304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.548307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.548310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.548313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.548316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.548318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.548321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.548324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.548327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.548330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.548333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.548336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.548339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.548342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.548345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.548347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.548352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.548354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.548357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.548379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:07.550696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:07.551180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:07.551190Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:07.551192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:07.551194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:07.551199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 451 [2:7559600831470169833:4275]
2025-10-10T14:32:07.551207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:07.551220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:07.551222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.551223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.551225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.551239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:07.551244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:07.551251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:07.551298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.551304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.551306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.551308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:07.551370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:07.551376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.551383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.551390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.551401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:07.551417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380028:2438], now have 1 active actors on pipe
2025-10-10T14:32:07.551423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380302:5110], now have 1 active actors on pipe
2025-10-10T14:32:07.551429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600831470169828:4275]
2025-10-10T14:32:07.551431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600831470169828:4275]
2025-10-10T14:32:07.551432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600831470169828:4275]
2025-10-10T14:32:07.551442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:07.551452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:07.551466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:07.551468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:07.551471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:07.551472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:07.551473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:07.551491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600831470169828:4275]
2025-10-10T14:32:07.551496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:07.551498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:07.551513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 451
2025-10-10T14:32:07.551528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 451
2025-10-10T14:32:07.551602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.551612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.551642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:07.551654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.551658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.551661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:07.551672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.551685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:07.551700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.551873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.551881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.551893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.551979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 452 partition: 0 MaxSeqNo: 40 sessionId: src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0
2025-10-10T14:32:07.552347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e950e2-cd478772-a369c023-ccf9541d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:07.554969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0] Write session: try to update token
2025-10-10T14:32:07.554987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:07.567576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId: src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:07.569917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:07.570141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.570163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.570205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:07.570286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:07.572567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:07.572582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:07.572586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:07.572587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:07.572597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600831470169828:4275]
2025-10-10T14:32:07.572601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600831470169828:4275]
2025-10-10T14:32:07.572604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600831470169828:4275]
2025-10-10T14:32:07.572649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:07.572657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.572658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:07.572660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:07.572665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:07.572672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:07.572792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:07.621322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600832252380320:4813]
2025-10-10T14:32:07.621632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 451, pipe: [1:7559600832252380320:4813]
2025-10-10T14:32:07.680123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:07.686728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.686751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.686906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.686965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.687021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.687076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.687120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.687127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.687216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.687294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.687372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.687445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.687812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.687822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.687889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.687941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.687996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.688058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.688096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.688101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.688159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.688212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.688265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.688335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.688373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.688380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.688464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.688515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.688568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.688620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.688658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.688664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.688721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.688772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.688824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.688877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.688917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.688923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.688977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.689026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.689079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.689134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.689172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.689178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.689233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.689290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.689373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.689430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.689492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.689500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.689562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.689611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.689662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.689724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.689771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.689778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.689834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.689891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.689953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.690013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.690057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.690064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.690109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380320:4813], now have 1 active actors on pipe
2025-10-10T14:32:07.690370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:07.690382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:07.690383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:07.690410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 452 reason: error at write: Disconnected sessionId: src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0
2025-10-10T14:32:07.690419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600832252380320:4813]
2025-10-10T14:32:07.690648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 452 sessionId: src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0 is DEAD
2025-10-10T14:32:07.690662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:07.690787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:07.690798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0] Write session will restart in 0.007110s
2025-10-10T14:32:07.690823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0] Write session: Do CDS request
2025-10-10T14:32:07.690830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:07.698832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.698867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:07.698887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 453
2025-10-10T14:32:07.699043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.699081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:07.699089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:07.699093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:07.699523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 453 sessionId:  describe result for acl check
2025-10-10T14:32:07.699548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:07.699552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:07.699553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:07.699558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600832252380372:5116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:07.700264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600832252380372:5116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:07.703333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600832252380372:5116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:07.705278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600832252380372:5116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:07.705295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600832252380372:5116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:07.705298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600832252380372:5116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:07.705305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:07.707211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:07.709535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:07.709778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:07.709787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:07.709797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:07.709841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:07.709880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600831470170130:4278]
2025-10-10T14:32:07.710443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:07.710733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:07.710767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:07.710997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:07.711033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.711037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.711038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.711039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.711039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.711040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.711040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.711041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.711042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.711042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.711043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.711043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.711044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.711048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.711055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.711058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.711060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.711064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.711066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.711068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.711071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.711073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.711075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.711077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.711079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.711081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.711086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.711091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.711095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.711098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.711101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.711104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.711106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.711109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.711112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.711115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.711117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.711121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.711124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.711127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.711130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.711133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.711135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.711138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.711140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.711143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.711146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.711148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.711152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.711155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.711157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.711160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.711182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:07.713385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:07.713783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:07.713792Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:07.713793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:07.713796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:07.713800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 452 [2:7559600831470170130:4278]
2025-10-10T14:32:07.713808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:07.713819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:07.713821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.713823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.713825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.713842Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:07.713847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:07.713853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:07.713893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.713899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.713900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.713901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:07.713950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:07.713955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.713962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.713969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.713979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:07.714006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600831470170116:4278]
2025-10-10T14:32:07.714013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600831470170116:4278]
2025-10-10T14:32:07.714014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600831470170116:4278]
2025-10-10T14:32:07.714024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:07.714036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380322:2438], now have 1 active actors on pipe
2025-10-10T14:32:07.714041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:07.714042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380585:5116], now have 1 active actors on pipe
2025-10-10T14:32:07.714044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:07.714046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:07.714046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:07.714057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:07.714059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:07.714074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600831470170116:4278]
2025-10-10T14:32:07.714082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:07.714082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 452
2025-10-10T14:32:07.714105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 452
2025-10-10T14:32:07.714100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:07.714149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.714157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.714178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:07.714187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.714190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.714191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:07.714199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.714207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:07.714220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.714357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.714363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.714373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.714453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 453 partition: 0 MaxSeqNo: 40 sessionId: src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0
2025-10-10T14:32:07.714780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcd793e4-6e2460d3-d158f23b-3358daa1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:07.717137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0] Write session: try to update token
2025-10-10T14:32:07.717156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:07.729630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId: src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:07.731866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:07.732047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.732066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.732103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:07.732197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:07.735456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:07.735470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:07.735471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:07.735473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:07.735481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600831470170116:4278]
2025-10-10T14:32:07.735484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600831470170116:4278]
2025-10-10T14:32:07.735487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600831470170116:4278]
2025-10-10T14:32:07.735521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:07.735523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:07.735527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.735528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:07.735529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:07.735532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:07.735682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:07.790789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600832252380629:4813]
2025-10-10T14:32:07.791049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 452, pipe: [1:7559600832252380629:4813]
2025-10-10T14:32:07.838035Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:07.844669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.844688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.844842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.844902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.844971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.845032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.845074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.845084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.845142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.845205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.845263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.845323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.845375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.845380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.845446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.845500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.845555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.845610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.845649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.845654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.845718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.845926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.845990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.846046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.846085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.846090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.846150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.846213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.846270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.846329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.846382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.846387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.846450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.846509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.846566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.846634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.846673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.846680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.846745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.846802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.846862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.846918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.846962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.846969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.847031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.847084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.847142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.847203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.847253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.847259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.847315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.847368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.847424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.847492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.847542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.847548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.847606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:07.847661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:07.847715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:07.847770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:07.847809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:07.847814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:07.847853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380629:4813], now have 1 active actors on pipe
2025-10-10T14:32:07.848107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:07.848125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600832252380629:4813]
2025-10-10T14:32:07.848151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:07.848154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:07.848186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 453 reason: error at write: Disconnected sessionId: src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0
2025-10-10T14:32:07.848353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:07.848451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 453 sessionId: src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0 is DEAD
2025-10-10T14:32:07.848606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:07.848617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0] Write session will restart in 0.006294s
2025-10-10T14:32:07.848642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0] Write session: Do CDS request
2025-10-10T14:32:07.848648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:07.855864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.855964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:07.855977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 454
2025-10-10T14:32:07.856082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:07.856109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:07.856113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:07.856117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:07.856466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 454 sessionId:  describe result for acl check
2025-10-10T14:32:07.856490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:07.856491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:07.856493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:07.856497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600832252380656:5129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:07.856915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600832252380656:5129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:07.859638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600832252380656:5129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:07.863073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600832252380656:5129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:07.863087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600832252380656:5129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:07.863089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600832252380656:5129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:07.863096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:07.866079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:07.868423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:07.868607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:07.868622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:07.868633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:07.868677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:07.868715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600831470170436:4293]
2025-10-10T14:32:07.869282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:07.869548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:07.869586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:07.869884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:07.869932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.869938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.869939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.869940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.869941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.869942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.869943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.869944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.869945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.869946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.869947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.869948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.869949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.869954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.869967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.869971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.869975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.869978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.869982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.869985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.869989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.869992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.869996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.869999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.870003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.870006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.870013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.870021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:07.870027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.870032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:07.870036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.870041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:07.870044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.870049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:07.870053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.870057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:07.870063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.870067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:07.870071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.870076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:07.870080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.870085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:07.870088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.870093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:07.870096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.870101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:07.870105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.870109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.870113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.870122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.870126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.870130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.870183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:07.872557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:07.872970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:07.872983Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:07.872984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:07.872987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:07.872993Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 453 [2:7559600831470170436:4293]
2025-10-10T14:32:07.873004Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:07.873023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:07.873030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.873034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.873036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.873051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:07.873062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:07.873069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:07.873115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.873123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.873125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.873127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:07.873190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:07.873197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.873208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:07.873218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:07.873238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:07.873257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380841:5129], now have 1 active actors on pipe
2025-10-10T14:32:07.873265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380631:2438], now have 1 active actors on pipe
2025-10-10T14:32:07.873272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600831470170431:4293]
2025-10-10T14:32:07.873278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600831470170431:4293]
2025-10-10T14:32:07.873280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600831470170431:4293]
2025-10-10T14:32:07.873294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:07.873313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:07.873316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:07.873319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:07.873320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:07.873348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:07.873351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:07.873369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600831470170431:4293]
2025-10-10T14:32:07.873377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:07.873351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 453
2025-10-10T14:32:07.873354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 453
2025-10-10T14:32:07.873395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:07.873412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.873421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.873452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:07.873464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:07.873467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:07.873469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:07.873480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:07.873496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:07.873513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.873666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.873674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.873689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:07.873768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 454 partition: 0 MaxSeqNo: 40 sessionId: src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0
2025-10-10T14:32:07.874146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47cca75-19d75a1b-502378bf-2a8eb820_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:07.876809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0] Write session: try to update token
2025-10-10T14:32:07.876829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:07.889500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId: src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:07.891898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:07.892730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:07.892756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:07.892781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:07.892784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:07.892788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:07.892790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:07.892797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600831470170431:4293]
2025-10-10T14:32:07.892802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600831470170431:4293]
2025-10-10T14:32:07.892805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600831470170431:4293]
2025-10-10T14:32:07.892859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:07.892864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:07.892872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:07.892872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:07.892874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:07.892875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:07.893004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:07.948503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600832252380915:4813]
2025-10-10T14:32:07.948823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 453, pipe: [1:7559600832252380915:4813]
2025-10-10T14:32:07.995505Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:07.996239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:07.996307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380915:4813], now have 1 active actors on pipe
2025-10-10T14:32:07.996388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:07.996467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:07.996530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600832252380915:4813]
2025-10-10T14:32:08.005343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:08.005357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:08.005384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 454 reason: error at write: Disconnected sessionId: src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0
2025-10-10T14:32:08.005560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 454 sessionId: src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0 is DEAD
2025-10-10T14:32:08.005677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:08.005688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0] Write session will restart in 0.006792s
2025-10-10T14:32:08.005713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0] Write session: Do CDS request
2025-10-10T14:32:08.005719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:08.013788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.014117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:08.014131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 455
2025-10-10T14:32:08.014237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.014271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:08.014281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:08.014285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:08.014698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 455 sessionId:  describe result for acl check
2025-10-10T14:32:08.014734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:08.014740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:08.014742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:08.014748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600836547348413:5133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:08.015282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600836547348413:5133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:08.016888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:08.017746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600836547348413:5133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:08.019459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:08.019655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:08.019668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:08.019680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:08.019736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:08.019769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600835765138014:4295]
2025-10-10T14:32:08.020245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600836547348413:5133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:08.020261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600836547348413:5133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:08.020265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600836547348413:5133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:08.020273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:08.020612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:08.020872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:08.020905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:08.021355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:08.021413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.021421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.021422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.021424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.021425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.021426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.021427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.021428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.021430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.021431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.021432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.021433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.021434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.021440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.021453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.021458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.021461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.021466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.021469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.021473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.021477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.021481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.021485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.021489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.021493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.021496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.021503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.021512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.021517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.021523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.021527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.021533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.021536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.021541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.021546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.021551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.021555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.021560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.021565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.021569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.021573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.021579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.021583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.021589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.021593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.021598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.021603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.021608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.021612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.021618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.021627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.021632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.021671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:08.023778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:08.024278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:08.024289Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:08.024291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:08.024294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:08.024298Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 454 [2:7559600835765138014:4295]
2025-10-10T14:32:08.024306Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:08.024320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:08.024322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.024324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.024326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.024343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:08.024356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:08.024362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:08.024403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.024409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.024411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.024413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:08.024471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:08.024476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.024483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.024489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.024499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:08.024518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547348487:5133], now have 1 active actors on pipe
2025-10-10T14:32:08.024527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600835765138009:4295]
2025-10-10T14:32:08.024529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600835765138009:4295]
2025-10-10T14:32:08.024530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600835765138009:4295]
2025-10-10T14:32:08.024540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:08.024545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600832252380917:2438], now have 1 active actors on pipe
2025-10-10T14:32:08.024556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:08.024564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:08.024566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:08.024568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:08.024574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:08.024577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:08.024586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600835765138009:4295]
2025-10-10T14:32:08.024589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:08.024591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:08.024618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 454
2025-10-10T14:32:08.024620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 454
2025-10-10T14:32:08.024697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.024705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.024731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:08.024740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.024743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.024744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:08.024752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.024760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:08.024774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.024956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.024965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.024979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.025073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 455 partition: 0 MaxSeqNo: 40 sessionId: src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0
2025-10-10T14:32:08.025442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57e53a3-a254057d-bfa6a74e-f3e9ba40_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:08.027859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0] Write session: try to update token
2025-10-10T14:32:08.027875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:08.041293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId: src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:08.042264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:08.042285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.042297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600835765138009:4295]
2025-10-10T14:32:08.042347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:08.042359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:08.042532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:08.042687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:08.042838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:08.042976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:08.043171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:08.043212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:08.043887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:08.044108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.044122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.044154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:08.044256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:08.053006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:08.053025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.053028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:08.053030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:08.053041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600835765138009:4295]
2025-10-10T14:32:08.053045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600835765138009:4295]
2025-10-10T14:32:08.053048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600835765138009:4295]
2025-10-10T14:32:08.053091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:08.053094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:08.053096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.053098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:08.053099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:08.053104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:08.053224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:08.096461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600836547348498:4813]
2025-10-10T14:32:08.096734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 454, pipe: [1:7559600836547348498:4813]
2025-10-10T14:32:08.157545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:08.164232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.164253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.164413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.164469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.164534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.164603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.165041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.165054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.165117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.165171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.165229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.165291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.165365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.165372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.165712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.165766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.165831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.165886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.165924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.165929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.165990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.166043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.166105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.166197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.166247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.166253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.166312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.166373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.166436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.166493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.166537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.166542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.166630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.166684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.166741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.166796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.166839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.166847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.166909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.166963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.167020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.167078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.167123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.167129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.167187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.167253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.167309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.167371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.167420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.167426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.167485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.167548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.167612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.167672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.167711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.167716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.167774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:08.167829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:08.167892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:08.167952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:08.167988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:08.167994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:08.168050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547348498:4813], now have 1 active actors on pipe
2025-10-10T14:32:08.168253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:08.168266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:08.168293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 455 reason: error at write: Disconnected sessionId: src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0
2025-10-10T14:32:08.168380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:08.168395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:08.168448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600836547348498:4813]
2025-10-10T14:32:08.168515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 455 sessionId: src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0 is DEAD
2025-10-10T14:32:08.168698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:08.168710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0] Write session will restart in 0.005415s
2025-10-10T14:32:08.168734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0] Write session: Do CDS request
2025-10-10T14:32:08.168740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:08.174840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.174988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:08.175006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 456
2025-10-10T14:32:08.175113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.175157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:08.175165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:08.175168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:08.175658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 456 sessionId:  describe result for acl check
2025-10-10T14:32:08.175693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:08.175698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:08.175700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:08.175704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600836547348535:5138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:08.176142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600836547348535:5138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:08.179301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600836547348535:5138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:08.182232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600836547348535:5138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:08.182244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600836547348535:5138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:08.182247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600836547348535:5138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:08.182255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:08.186517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:08.189210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:08.189384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:08.189393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:08.189402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:08.189441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:08.189473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600835765138311:4298]
2025-10-10T14:32:08.189950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:08.190213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:08.190253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:08.190481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:08.190519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.190523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.190524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.190525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.190526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.190527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.190527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.190528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.190529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.190529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.190530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.190531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.190531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.190535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.190544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.190546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.190549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.190551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.190553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.190555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.190558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.190559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.190561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.190563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.190565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.190567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.190573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.190578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.190582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.190586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.190588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.190603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.190606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.190609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.190611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.190614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.190617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.190620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.190625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.190631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.190635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.190638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.190644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.190647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.190649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.190652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.190655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.190661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.190663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.190666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.190669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.190675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.190708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:08.192869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:08.193412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:08.193431Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:08.193433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:08.193437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:08.193445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 455 [2:7559600835765138311:4298]
2025-10-10T14:32:08.193459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:08.193481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:08.193490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.193494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.193496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.193519Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:08.193532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:08.193542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:08.193617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.193627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.193629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.193633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:08.193721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:08.193732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.193746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.193758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.193782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:08.193813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547348512:2438], now have 1 active actors on pipe
2025-10-10T14:32:08.193821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547348704:5138], now have 1 active actors on pipe
2025-10-10T14:32:08.193829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600835765138306:4298]
2025-10-10T14:32:08.193831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600835765138306:4298]
2025-10-10T14:32:08.193833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600835765138306:4298]
2025-10-10T14:32:08.193847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:08.193863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:08.193866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:08.193872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:08.193874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:08.193883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:08.193860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 455
2025-10-10T14:32:08.193871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 455
2025-10-10T14:32:08.193886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:08.193909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600835765138306:4298]
2025-10-10T14:32:08.193912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:08.193913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:08.193931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.193939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.193977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68101218-22106a6f-975acd9-6cafc3ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:08.193986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.193989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.193991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:08.193999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.194009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:08.194026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.194194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.194201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.194215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.194308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 456 partition: 0 MaxSeqNo: 40 sessionId: src_id|68101218-22106a6f-975acd9-6cafc3ea_0
2025-10-10T14:32:08.194692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aeebab-5325ab3c-c73fe760-f3e7982e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68101218-22106a6f-975acd9-6cafc3ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:08.197447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68101218-22106a6f-975acd9-6cafc3ea_0] Write session: try to update token
2025-10-10T14:32:08.197466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68101218-22106a6f-975acd9-6cafc3ea_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:08.212120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:08.212139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.212141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:08.212143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:08.212155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600835765138306:4298]
2025-10-10T14:32:08.212160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600835765138306:4298]
2025-10-10T14:32:08.212164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600835765138306:4298]
2025-10-10T14:32:08.212216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:08.212225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.212228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:08.212248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:08.212269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:08.212275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:08.212376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:08.214467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId: src_id|68101218-22106a6f-975acd9-6cafc3ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:08.216999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:08.268446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600836547348798:4813]
2025-10-10T14:32:08.268753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 455, pipe: [1:7559600836547348798:4813]
2025-10-10T14:32:08.315015Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:08.315415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.315428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.315465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547348798:4813], now have 1 active actors on pipe
2025-10-10T14:32:08.315718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:08.315721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600836547348798:4813]
2025-10-10T14:32:08.315742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:08.315745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:08.315816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 456 reason: error at write: Disconnected sessionId: src_id|68101218-22106a6f-975acd9-6cafc3ea_0
2025-10-10T14:32:08.316028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 456 sessionId: src_id|68101218-22106a6f-975acd9-6cafc3ea_0 is DEAD
2025-10-10T14:32:08.316164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68101218-22106a6f-975acd9-6cafc3ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:08.316174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68101218-22106a6f-975acd9-6cafc3ea_0] Write session will restart in 0.005826s
2025-10-10T14:32:08.316192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68101218-22106a6f-975acd9-6cafc3ea_0] Write session: Do CDS request
2025-10-10T14:32:08.316196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68101218-22106a6f-975acd9-6cafc3ea_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:08.316428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:08.322792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68101218-22106a6f-975acd9-6cafc3ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.322858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:08.322871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 457
2025-10-10T14:32:08.322973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.323005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:08.323014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:08.323017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:08.323375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 457 sessionId:  describe result for acl check
2025-10-10T14:32:08.323410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:08.323416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:08.323418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:08.323422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600836547348836:5142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:08.323829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600836547348836:5142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:08.325639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600836547348836:5142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:08.328782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600836547348836:5142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:08.328800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600836547348836:5142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:08.328803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600836547348836:5142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:08.328807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:08.332660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:08.335206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:08.335384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:08.335397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:08.335409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:08.335466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:08.335505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600835765138596:4300]
2025-10-10T14:32:08.336047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:08.336323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:08.336359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:08.336617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:08.336661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.336666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.336667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.336668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.336668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.336669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.336670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.336670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.336671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.336672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.336672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.336673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.336673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.336677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.336685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.336687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.336690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.336692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.336694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.336696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.336699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.336701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.336703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.336706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.336708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.336710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.336715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.336720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.336725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.336728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.336730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.336733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.336736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.336739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.336742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.336744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.336747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.336750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.336753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.336756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.336759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.336762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.336764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.336767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.336770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.336774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.336777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.336779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.336782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.336785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.336788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.336791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.336812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:08.338888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:08.339230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:08.339243Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:08.339246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:08.339250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:08.339255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 456 [2:7559600835765138596:4300]
2025-10-10T14:32:08.339266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:08.339281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:08.339283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.339285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.339286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.339298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:08.339306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:08.339315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:08.339516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.339524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.339525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.339527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:08.339583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:08.339590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.339602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.339617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.339637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:08.339660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547348986:5142], now have 1 active actors on pipe
2025-10-10T14:32:08.339668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547348800:2438], now have 1 active actors on pipe
2025-10-10T14:32:08.339675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600835765138590:4300]
2025-10-10T14:32:08.339681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600835765138590:4300]
2025-10-10T14:32:08.339684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600835765138590:4300]
2025-10-10T14:32:08.339694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:08.339704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 456
2025-10-10T14:32:08.339711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:08.339714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:08.339717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:08.339718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:08.339730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:08.339733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:08.339758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600835765138590:4300]
2025-10-10T14:32:08.339753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 456
2025-10-10T14:32:08.339768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:08.339774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:08.339798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.339807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.339836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:08.339849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.339857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.339859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:08.339869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.339883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:08.339901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.340059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.340069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.340084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.340179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 457 partition: 0 MaxSeqNo: 40 sessionId: src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0
2025-10-10T14:32:08.340513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68101218-22106a6f-975acd9-6cafc3ea_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:08.343304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0] Write session: try to update token
2025-10-10T14:32:08.343324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:08.355958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId: src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:08.358516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:08.359090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.359110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.359131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:08.359134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.359136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:08.359137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:08.359144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600835765138590:4300]
2025-10-10T14:32:08.359152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600835765138590:4300]
2025-10-10T14:32:08.359156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600835765138590:4300]
2025-10-10T14:32:08.359201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:08.359209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:08.359211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.359213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:08.359216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:08.359221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:08.359339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:08.415944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600836547349087:4813]
2025-10-10T14:32:08.416245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 456, pipe: [1:7559600836547349087:4813]
2025-10-10T14:32:08.462758Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:08.463144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:08.463197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349087:4813], now have 1 active actors on pipe
2025-10-10T14:32:08.463287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:08.463381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:08.463422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600836547349087:4813]
2025-10-10T14:32:08.472641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:08.472660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:08.472684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 457 reason: error at write: Disconnected sessionId: src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0
2025-10-10T14:32:08.472858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 457 sessionId: src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0 is DEAD
2025-10-10T14:32:08.473069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:08.473081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0] Write session will restart in 0.008487s
2025-10-10T14:32:08.473107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0] Write session: Do CDS request
2025-10-10T14:32:08.473113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:08.482838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.482933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:08.482947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 458
2025-10-10T14:32:08.483097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.483133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:08.483143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:08.483155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:08.483546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 458 sessionId:  describe result for acl check
2025-10-10T14:32:08.483580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:08.483586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:08.483588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:08.483594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600836547349335:5146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:08.483968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:08.484120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600836547349335:5146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:08.486234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600836547349335:5146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:08.486425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:08.486635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:08.486646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:08.486658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:08.486710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:08.486751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600835765138880:4302]
2025-10-10T14:32:08.487351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:08.487632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:08.487674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:08.487986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:08.488038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.488044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.488046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.488047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.488048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.488049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.488050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.488051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.488052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.488053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.488055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.488056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.488057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.488063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.488075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.488079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.488083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.488087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.488092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.488096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.488100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.488103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.488108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.488112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.488116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.488120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.488126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.488135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.488141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.488146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.488158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.488164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.488172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.488178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.488182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.488187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.488191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.488201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.488205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.488212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.488216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.488223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.488227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.488233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.488238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.488244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.488249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.488255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.488263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.488268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.488274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.488279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.488323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:08.488718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600836547349335:5146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:08.488728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600836547349335:5146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:08.488731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600836547349335:5146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:08.488736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:08.490428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:08.490947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:08.490959Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:08.490961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:08.490964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:08.490970Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 457 [2:7559600835765138880:4302]
2025-10-10T14:32:08.490981Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:08.490997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:08.491006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.491009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.491011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.491026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:08.491038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:08.491049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:08.491099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.491105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.491106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.491109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:08.491167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:08.491173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.491185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.491200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.491220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:08.491244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349370:5146], now have 1 active actors on pipe
2025-10-10T14:32:08.491252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349088:2438], now have 1 active actors on pipe
2025-10-10T14:32:08.491259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600835765138875:4302]
2025-10-10T14:32:08.491261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600835765138875:4302]
2025-10-10T14:32:08.491264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600835765138875:4302]
2025-10-10T14:32:08.491277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:08.491295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:08.491300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:08.491303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:08.491305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:08.491301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 457
2025-10-10T14:32:08.491315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:08.491305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 457
2025-10-10T14:32:08.491322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:08.491342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600835765138875:4302]
2025-10-10T14:32:08.491349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:08.491350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:08.491366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.491375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.491419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:08.491430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.491434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.491436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:08.491448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.491462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:08.491479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.491644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.491654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.491669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.491745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 458 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0
2025-10-10T14:32:08.492047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4091b0-84f728a2-78bb8811-b3f6469f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:08.494663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0] Write session: try to update token
2025-10-10T14:32:08.494679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:08.507918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId: src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:08.510388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:08.510882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.510905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.510924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:08.510927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.510929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:08.510930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:08.510937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600835765138875:4302]
2025-10-10T14:32:08.510940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600835765138875:4302]
2025-10-10T14:32:08.510942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600835765138875:4302]
2025-10-10T14:32:08.510986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:08.510987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:08.510995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.510996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:08.511000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:08.511004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:08.511149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:08.563356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600836547349384:4813]
2025-10-10T14:32:08.563599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 457, pipe: [1:7559600836547349384:4813]
2025-10-10T14:32:08.613957Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:08.614271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:08.614339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349384:4813], now have 1 active actors on pipe
2025-10-10T14:32:08.614395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:08.614563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600836547349384:4813]
2025-10-10T14:32:08.614588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:08.623809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:08.623825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:08.623846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 458 reason: error at write: Disconnected sessionId: src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0
2025-10-10T14:32:08.623986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 458 sessionId: src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0 is DEAD
2025-10-10T14:32:08.624126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:08.624137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0] Write session will restart in 0.008214s
2025-10-10T14:32:08.624161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0] Write session: Do CDS request
2025-10-10T14:32:08.624167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:08.633860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.633930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:08.633946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 459
2025-10-10T14:32:08.634129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.634164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:08.634174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:08.634181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:08.634538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 459 sessionId:  describe result for acl check
2025-10-10T14:32:08.634585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:08.634605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:08.634607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:08.634613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600836547349586:5152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:08.635053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600836547349586:5152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:08.637284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600836547349586:5152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:08.639943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:08.640093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600836547349586:5152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:08.640104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600836547349586:5152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:08.640106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600836547349586:5152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:08.640111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:08.640278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:08.640435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:08.640445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:08.640456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:08.640501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:08.640539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600835765139170:4305]
2025-10-10T14:32:08.641119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:08.641394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:08.641433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:08.641728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:08.641780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.641786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.641787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.641788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.641789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.641790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.641791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.641793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.641794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.641795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.641796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.641797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.641799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.641804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.641816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.641820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.641824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.641828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.641832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.641836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.641840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.641844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.641848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.641852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.641856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.641859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.641866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.641874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.641880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.641886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.641890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.641895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.641899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.641905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.641909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.641915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.641924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.641929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.641934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.641939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.641944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.641953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.641958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.641962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.641971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.641975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.641980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.641985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.641989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.641994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.642001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.642006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.642057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:08.644152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:08.644600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:08.644613Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:08.644616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:08.644619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:08.644624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 458 [2:7559600835765139170:4305]
2025-10-10T14:32:08.644634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:08.644649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:08.644658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.644662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.644664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.644678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:08.644690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:08.644697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:08.644749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.644755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.644757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.644759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:08.644817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:08.644825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.644835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.644851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.644874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:08.644894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349667:5152], now have 1 active actors on pipe
2025-10-10T14:32:08.644901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349388:2438], now have 1 active actors on pipe
2025-10-10T14:32:08.644909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600835765139164:4305]
2025-10-10T14:32:08.644912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600835765139164:4305]
2025-10-10T14:32:08.644914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600835765139164:4305]
2025-10-10T14:32:08.644926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:08.644920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 458
2025-10-10T14:32:08.644943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:08.644945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:08.644948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:08.644922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 458
2025-10-10T14:32:08.644950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:08.644963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:08.644971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:08.645006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.645014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.645029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600835765139164:4305]
2025-10-10T14:32:08.645040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:08.645059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:08.645072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:08.645079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.645087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.645089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:08.645100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.645114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:08.645132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.645322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.645343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.645356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.645470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 459 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0
2025-10-10T14:32:08.645786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e44c9ec-3e76d140-f31d27e-4178654e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:08.648427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0] Write session: try to update token
2025-10-10T14:32:08.648444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:08.662170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId: src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:08.664162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:08.664184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.664187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:08.664189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:08.664200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600835765139164:4305]
2025-10-10T14:32:08.664204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600835765139164:4305]
2025-10-10T14:32:08.664208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600835765139164:4305]
2025-10-10T14:32:08.664250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:08.664255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:08.664261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.664263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:08.664264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:08.664269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:08.664393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:08.664796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:08.714961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600836547349678:4813]
2025-10-10T14:32:08.715242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 458, pipe: [1:7559600836547349678:4813]
2025-10-10T14:32:08.767725Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:08.767947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.767960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.767994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349678:4813], now have 1 active actors on pipe
2025-10-10T14:32:08.768157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:08.768200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600836547349678:4813]
2025-10-10T14:32:08.768230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:08.768290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 459 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0
2025-10-10T14:32:08.768441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 459 sessionId: src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0 is DEAD
2025-10-10T14:32:08.768583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:08.768596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0] Write session will restart in 0.006821s
2025-10-10T14:32:08.768586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:08.768614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0] Write session: Do CDS request
2025-10-10T14:32:08.768619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:08.776723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.776785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:08.776797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 460
2025-10-10T14:32:08.776923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.776949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:08.776955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:08.776958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:08.777416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 460 sessionId:  describe result for acl check
2025-10-10T14:32:08.777438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:08.777439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:08.777440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:08.777445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600836547349734:5162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:08.777944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600836547349734:5162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:08.780290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600836547349734:5162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:08.782982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600836547349734:5162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:08.782994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600836547349734:5162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:08.782996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600836547349734:5162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:08.783003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:08.786806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:08.789033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:08.789224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:08.789235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:08.789246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:08.789294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:08.789344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600835765139471:4313]
2025-10-10T14:32:08.789944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:08.790235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:08.790275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:08.790535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:08.790594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.790611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.790612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.790612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.790613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.790614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.790614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.790615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.790616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.790616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.790617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.790617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.790618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.790622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.790630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.790632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.790634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.790636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.790638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.790640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.790642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.790644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.790646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.790648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.790650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.790652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.790657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.790663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.790668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.790671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.790673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.790676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.790679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.790682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.790687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.790692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.790696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.790700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.790705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.790710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.790715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.790721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.790729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.790735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.790743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.790748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.790755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.790761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.790769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.790774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.790783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.790792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.790837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:08.792980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:08.793279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:08.793286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:08.793288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:08.793292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:08.793297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 459 [2:7559600835765139471:4313]
2025-10-10T14:32:08.793308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:08.793344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:08.793353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.793356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.793358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.793375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:08.793383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:08.793395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:08.793448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.793456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.793458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.793460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:08.793519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:08.793527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.793539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.793549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.793570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:08.793594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349692:2438], now have 1 active actors on pipe
2025-10-10T14:32:08.793603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349884:5162], now have 1 active actors on pipe
2025-10-10T14:32:08.793609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600835765139466:4313]
2025-10-10T14:32:08.793612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600835765139466:4313]
2025-10-10T14:32:08.793614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600835765139466:4313]
2025-10-10T14:32:08.793626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:08.793638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:08.793659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:08.793661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:08.793664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:08.793639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 459
2025-10-10T14:32:08.793666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:08.793666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:08.793673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 459
2025-10-10T14:32:08.793691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600835765139466:4313]
2025-10-10T14:32:08.793698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:08.793702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:08.793725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.793734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.793764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|132d992b-523b6e60-d9166cb7-bd13be50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:08.793776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.793784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.793786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:08.793796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.793805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:08.793821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.793955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.793963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.793976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.794047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 460 partition: 0 MaxSeqNo: 40 sessionId: src_id|132d992b-523b6e60-d9166cb7-bd13be50_0
2025-10-10T14:32:08.794411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3858292-3ddc1850-f4d3ea31-2f75069d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|132d992b-523b6e60-d9166cb7-bd13be50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:08.796857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132d992b-523b6e60-d9166cb7-bd13be50_0] Write session: try to update token
2025-10-10T14:32:08.796870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132d992b-523b6e60-d9166cb7-bd13be50_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:08.811165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId: src_id|132d992b-523b6e60-d9166cb7-bd13be50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:08.811724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:08.811743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.811746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:08.811748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:08.811756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600835765139466:4313]
2025-10-10T14:32:08.811760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600835765139466:4313]
2025-10-10T14:32:08.811763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600835765139466:4313]
2025-10-10T14:32:08.811812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:08.811811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:08.811817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:08.811820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:08.811823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.811825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:08.811951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:08.813617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:08.868503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600836547349993:4813]
2025-10-10T14:32:08.868800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 459, pipe: [1:7559600836547349993:4813]
2025-10-10T14:32:08.920010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:08.920295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.920313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.920357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349993:4813], now have 1 active actors on pipe
2025-10-10T14:32:08.920537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:08.920578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600836547349993:4813]
2025-10-10T14:32:08.920580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:08.920591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:08.920609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:08.921018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 460 reason: error at write: Disconnected sessionId: src_id|132d992b-523b6e60-d9166cb7-bd13be50_0
2025-10-10T14:32:08.921185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 460 sessionId: src_id|132d992b-523b6e60-d9166cb7-bd13be50_0 is DEAD
2025-10-10T14:32:08.921339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132d992b-523b6e60-d9166cb7-bd13be50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:08.921349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132d992b-523b6e60-d9166cb7-bd13be50_0] Write session will restart in 0.006582s
2025-10-10T14:32:08.921368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132d992b-523b6e60-d9166cb7-bd13be50_0] Write session: Do CDS request
2025-10-10T14:32:08.921375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132d992b-523b6e60-d9166cb7-bd13be50_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:08.928861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132d992b-523b6e60-d9166cb7-bd13be50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.928932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:08.928955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 461
2025-10-10T14:32:08.929086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:08.929120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:08.929130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:08.929134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:08.929740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 461 sessionId:  describe result for acl check
2025-10-10T14:32:08.929776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:08.929781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:08.929783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:08.929787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600836547350049:5169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:08.930198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600836547350049:5169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:08.932608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600836547350049:5169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:08.935396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600836547350049:5169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:08.935408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600836547350049:5169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:08.935411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600836547350049:5169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:08.935416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:08.938135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:08.940402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:08.940579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:08.940590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:08.940601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:08.940648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:08.940682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600835765139785:4322]
2025-10-10T14:32:08.941281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:08.941557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:08.941599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:08.941918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:08.941968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.941974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.941975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.941976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.941977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.941978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.941979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.941980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.941981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.941982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.941983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.941985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.941986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.941991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.942004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.942008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.942012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.942016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.942020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.942023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.942027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.942031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.942036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.942040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.942043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.942048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.942055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.942062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:08.942068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.942078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:08.942083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.942088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:08.942092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.942097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:08.942101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.942106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:08.942111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.942116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:08.942121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.942129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:08.942133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.942138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:08.942143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.942147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:08.942156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.942162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:08.942168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.942172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.942176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.942186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.942191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.942195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.942234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:08.944373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:08.944888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:08.944899Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:08.944901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:08.944903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:08.944907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 460 [2:7559600835765139785:4322]
2025-10-10T14:32:08.944915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:08.944926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:08.944927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.944929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.944931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.944942Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:08.944947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:08.944953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:08.944994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.945000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.945001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.945003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:08.945162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:08.945169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.945177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:08.945184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:08.945198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:08.945181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 460
2025-10-10T14:32:08.945215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547349994:2438], now have 1 active actors on pipe
2025-10-10T14:32:08.945202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 460
2025-10-10T14:32:08.945221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600836547350225:5169], now have 1 active actors on pipe
2025-10-10T14:32:08.945227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600835765139780:4322]
2025-10-10T14:32:08.945228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600835765139780:4322]
2025-10-10T14:32:08.945229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600835765139780:4322]
2025-10-10T14:32:08.945236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:08.945246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:08.945248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:08.945250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:08.945252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:08.945255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:08.945257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:08.945272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.945278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.945309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600835765139780:4322]
2025-10-10T14:32:08.945322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:08.945348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:08.945355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:08.945364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:08.945373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:08.945375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:08.945384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:08.945395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:08.945421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.945645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.945655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.945668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:08.945777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 461 partition: 0 MaxSeqNo: 40 sessionId: src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0
2025-10-10T14:32:08.946079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132d992b-523b6e60-d9166cb7-bd13be50_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:08.948421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0] Write session: try to update token
2025-10-10T14:32:08.948432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:08.956466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:08.956481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.956492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600835765139780:4322]
2025-10-10T14:32:08.956527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:08.956540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:08.957452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:08.957584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:08.957720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:08.957852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:08.958030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:08.958069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:08.962525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId: src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:08.965046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:08.965221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:08.965237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:08.965271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:08.965381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:08.973280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:08.973298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:08.973300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:08.973301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:08.973309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600835765139780:4322]
2025-10-10T14:32:08.973311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600835765139780:4322]
2025-10-10T14:32:08.973314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600835765139780:4322]
2025-10-10T14:32:08.973364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:08.973367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:08.973372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:08.973373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:08.973375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:08.973377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:08.973507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:09.020621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600840842317582:4813]
2025-10-10T14:32:09.020933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 460, pipe: [1:7559600840842317582:4813]
2025-10-10T14:32:09.078035Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:09.085325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.085368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.085521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.085578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.085640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.085701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.085744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.085752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.085832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.085895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.085955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.086015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.086061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.086066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.086126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.086277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.086382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.086442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.086488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.086495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.086567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.086763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.086822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.086892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.086935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.086944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.087005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.087064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.087121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.087181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.087222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.087227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.087287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.087342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.087399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.087454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.087494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.087499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.087557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.087610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.087668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.087724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.087762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.087767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.087828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.087883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.087939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.087995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.088035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.088040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.088098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.088150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.088206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.088263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.088304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.088308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.088365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.088428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.088483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.088537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.088576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.088581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.088627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842317582:4813], now have 1 active actors on pipe
2025-10-10T14:32:09.088916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:09.088942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:09.088945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:09.088970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600840842317582:4813]
2025-10-10T14:32:09.088976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 461 reason: error at write: Disconnected sessionId: src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0
2025-10-10T14:32:09.089182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 461 sessionId: src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0 is DEAD
2025-10-10T14:32:09.089306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:09.089320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0] Write session will restart in 0.007453s
2025-10-10T14:32:09.089358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0] Write session: Do CDS request
2025-10-10T14:32:09.089365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:09.089399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:09.097794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.097885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:09.097900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 462
2025-10-10T14:32:09.098052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.098097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:09.098106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:09.098109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:09.098570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 462 sessionId:  describe result for acl check
2025-10-10T14:32:09.098625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:09.098632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:09.098634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:09.098640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600840842317669:5173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:09.099154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600840842317669:5173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:09.102347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600840842317669:5173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:09.104570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:09.106968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:09.107117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600840842317669:5173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:09.107130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600840842317669:5173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:09.107134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600840842317669:5173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:09.107156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:09.107209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:09.107223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:09.107235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:09.107294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:09.107336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600840060107370:4324]
2025-10-10T14:32:09.107906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:09.108160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:09.108207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:09.108425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:09.108468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.108474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.108474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.108475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.108476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.108476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.108477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.108478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.108478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.108479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.108480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.108480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.108481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.108484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.108492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.108495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.108497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.108499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.108502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.108504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.108506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.108508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.108511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.108514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.108517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.108521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.108527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.108536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.108542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.108546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.108550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.108554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.108557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.108562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.108569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.108574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.108580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.108585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.108591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.108594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.108598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.108603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.108613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.108619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.108627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.108632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.108639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.108642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.108644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.108647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.108651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.108654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.108675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:09.110768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:09.111261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:09.111273Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:09.111275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:09.111279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:09.111283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 461 [2:7559600840060107370:4324]
2025-10-10T14:32:09.111294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:09.111307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:09.111315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.111317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.111319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.111335Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:09.111346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:09.111357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:09.111408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.111414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.111417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.111419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:09.111467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:09.111473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.111480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.111486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.111501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:09.111523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842317583:2438], now have 1 active actors on pipe
2025-10-10T14:32:09.111529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842317865:5173], now have 1 active actors on pipe
2025-10-10T14:32:09.111536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600840060107365:4324]
2025-10-10T14:32:09.111538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600840060107365:4324]
2025-10-10T14:32:09.111540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600840060107365:4324]
2025-10-10T14:32:09.111551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:09.111567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:09.111569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:09.111571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:09.111572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:09.111586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:09.111589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:09.111573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 461
2025-10-10T14:32:09.111607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600840060107365:4324]
2025-10-10T14:32:09.111581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 461
2025-10-10T14:32:09.111614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:09.111613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:09.111631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.111638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.111672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:09.111682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.111686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.111692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:09.111704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.111717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:09.111737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.111862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.111869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.111881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.111958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 462 partition: 0 MaxSeqNo: 40 sessionId: src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0
2025-10-10T14:32:09.112264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7eaba0b-cbef6ad8-921aa94-f0ff9798_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:09.114901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0] Write session: try to update token
2025-10-10T14:32:09.114918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:09.130627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:09.130625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId: src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:09.130646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:09.130649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:09.130651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:09.130661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600840060107365:4324]
2025-10-10T14:32:09.130667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600840060107365:4324]
2025-10-10T14:32:09.130671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600840060107365:4324]
2025-10-10T14:32:09.130721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:09.130726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:09.130732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:09.130733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.130736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:09.130736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:09.130883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:09.133203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:09.189072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600840842317889:4813]
2025-10-10T14:32:09.189369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 461, pipe: [1:7559600840842317889:4813]
2025-10-10T14:32:09.232891Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:09.233264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.233277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.233314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842317889:4813], now have 1 active actors on pipe
2025-10-10T14:32:09.233562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:09.233577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:09.233577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600840842317889:4813]
2025-10-10T14:32:09.233598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:09.233633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 462 reason: error at write: Disconnected sessionId: src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0
2025-10-10T14:32:09.233610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:09.233854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 462 sessionId: src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0 is DEAD
2025-10-10T14:32:09.233978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:09.233989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0] Write session will restart in 0.008080s
2025-10-10T14:32:09.234009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0] Write session: Do CDS request
2025-10-10T14:32:09.234017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:09.242808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.242901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:09.242913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 463
2025-10-10T14:32:09.243022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.243050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:09.243057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:09.243060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:09.243525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 463 sessionId:  describe result for acl check
2025-10-10T14:32:09.243552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:09.243557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:09.243560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:09.243565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600840842317957:5178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:09.244048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600840842317957:5178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:09.246961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600840842317957:5178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:09.249573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600840842317957:5178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:09.249587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600840842317957:5178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:09.249591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600840842317957:5178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:09.249599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:09.250554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:09.252678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:09.252833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:09.252844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:09.252852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:09.252886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:09.252913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600840060107674:4327]
2025-10-10T14:32:09.253293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:09.253536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:09.253567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:09.253766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:09.253800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.253804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.253804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.253805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.253806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.253806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.253807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.253807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.253808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.253808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.253809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.253809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.253810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.253813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.253822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.253824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.253826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.253829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.253831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.253833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.253835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.253836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.253839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.253841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.253843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.253844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.253849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.253854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.253859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.253862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.253864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.253867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.253870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.253873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.253875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.253879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.253881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.253884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.253887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.253890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.253892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.253895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.253898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.253901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.253903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.253906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.253909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.253912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.253914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.253918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.253921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.253924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.253947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:09.255972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:09.256347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:09.256358Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:09.256359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:09.256362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:09.256366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 462 [2:7559600840060107674:4327]
2025-10-10T14:32:09.256373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:09.256385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:09.256387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.256389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.256390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.256404Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:09.256416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:09.256424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:09.256479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.256485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.256487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.256489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:09.256540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:09.256545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.256552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.256558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.256568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:09.256590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318169:5178], now have 1 active actors on pipe
2025-10-10T14:32:09.256597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842317890:2438], now have 1 active actors on pipe
2025-10-10T14:32:09.256605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600840060107669:4327]
2025-10-10T14:32:09.256612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600840060107669:4327]
2025-10-10T14:32:09.256614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600840060107669:4327]
2025-10-10T14:32:09.256628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:09.256645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:09.256647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:09.256650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:09.256651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:09.256665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:09.256669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:09.256658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 462
2025-10-10T14:32:09.256662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 462
2025-10-10T14:32:09.256687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600840060107669:4327]
2025-10-10T14:32:09.256695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:09.256697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:09.256716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.256724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.256768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:09.256780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.256783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.256785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:09.256797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.256812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:09.256831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.256963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.256970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.256984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.257092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 463 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0
2025-10-10T14:32:09.257446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb20be8-98db6e41-1cc75feb-b4748a55_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:09.259954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0] Write session: try to update token
2025-10-10T14:32:09.259969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:09.272891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId: src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:09.275403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:09.276320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.276345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.276369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:09.276372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:09.276375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:09.276377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:09.276386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600840060107669:4327]
2025-10-10T14:32:09.276394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600840060107669:4327]
2025-10-10T14:32:09.276398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600840060107669:4327]
2025-10-10T14:32:09.276445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:09.276456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:09.276458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:09.276462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:09.276463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.276465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:09.276595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:09.333959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600840842318184:4813]
2025-10-10T14:32:09.334233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 462, pipe: [1:7559600840842318184:4813]
2025-10-10T14:32:09.383017Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:09.383390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:09.383440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318184:4813], now have 1 active actors on pipe
2025-10-10T14:32:09.383517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:09.383598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600840842318184:4813]
2025-10-10T14:32:09.383636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:09.394113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:09.394126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:09.394151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 463 reason: error at write: Disconnected sessionId: src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0
2025-10-10T14:32:09.394284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 463 sessionId: src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0 is DEAD
2025-10-10T14:32:09.394454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:09.394465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0] Write session will restart in 0.005817s
2025-10-10T14:32:09.394489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0] Write session: Do CDS request
2025-10-10T14:32:09.394496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:09.401775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.401877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:09.401894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 464
2025-10-10T14:32:09.402053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.402087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:09.402097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:09.402102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:09.402447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 464 sessionId:  describe result for acl check
2025-10-10T14:32:09.402476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:09.402482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:09.402485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:09.402492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600840842318436:5182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:09.403000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600840842318436:5182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:09.403673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:09.404972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600840842318436:5182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:09.405947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:09.406192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:09.406202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:09.406211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:09.406253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:09.406282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600840060107965:4329]
2025-10-10T14:32:09.406675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:09.406936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:09.406969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:09.407033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600840842318436:5182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:09.407051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600840842318436:5182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:09.407054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600840842318436:5182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:09.407059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:09.407201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:09.407253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.407260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.407261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.407262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.407263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.407264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.407265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.407267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.407268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.407269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.407269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.407270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.407270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.407275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.407282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.407284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.407286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.407288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.407291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.407293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.407295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.407297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.407299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.407301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.407303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.407305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.407311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.407317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.407322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.407325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.407327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.407330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.407333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.407336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.407339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.407342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.407344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.407347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.407351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.407354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.407356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.407361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.407366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.407375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.407379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.407389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.407397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.407407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.407416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.407425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.407431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.407434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.407456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:09.409657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:09.410075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:09.410088Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:09.410089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:09.410091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:09.410096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 463 [2:7559600840060107965:4329]
2025-10-10T14:32:09.410104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:09.410116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:09.410118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.410120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.410121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.410134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:09.410139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:09.410149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:09.410193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.410199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.410201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.410204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:09.410258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:09.410264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.410271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.410281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.410293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:09.410315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600840060107960:4329]
2025-10-10T14:32:09.410323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600840060107960:4329]
2025-10-10T14:32:09.410325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600840060107960:4329]
2025-10-10T14:32:09.410333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:09.410342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:09.410345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:09.410347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:09.410349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318469:5182], now have 1 active actors on pipe
2025-10-10T14:32:09.410354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:09.410364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:09.410369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:09.410374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318185:2438], now have 1 active actors on pipe
2025-10-10T14:32:09.410390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600840060107960:4329]
2025-10-10T14:32:09.410400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:09.410405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 463
2025-10-10T14:32:09.410424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 463
2025-10-10T14:32:09.410421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:09.410462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.410469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.410493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:09.410503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.410505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.410507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:09.410515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.410526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:09.410540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.410718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.410728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.410743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.410828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 464 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0
2025-10-10T14:32:09.411176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1f357b-d37d97c8-d2b0d11a-1362c2a5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:09.413750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0] Write session: try to update token
2025-10-10T14:32:09.413767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:09.420861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:09.420880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:09.420890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600840060107960:4329]
2025-10-10T14:32:09.420935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:09.420943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:09.421109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:09.421274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:09.421456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:09.421633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:09.421856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:09.421903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:09.427513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId: src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:09.430163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:09.430346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.430363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.430397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:09.430480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:09.438468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:09.438485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:09.438488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:09.438493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:09.438504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600840060107960:4329]
2025-10-10T14:32:09.438507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600840060107960:4329]
2025-10-10T14:32:09.438511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600840060107960:4329]
2025-10-10T14:32:09.438553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:09.438556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:09.438559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:09.438563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.438564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:09.438566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:09.438703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:09.483967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600840842318480:4813]
2025-10-10T14:32:09.484230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 463, pipe: [1:7559600840842318480:4813]
2025-10-10T14:32:09.543762Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:09.550392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.550414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.550561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.550635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.550694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.550763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.550805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.550812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.550872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.550926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.550990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.551056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.551096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.551101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.551166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.551224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.551283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.551338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.551377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.551382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.551436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.551490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.551564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.551631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.551669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.551675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.551732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.551789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.551844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.551896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.551934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.551939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.551994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.552052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.552107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.552162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.552200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.552205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.552259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.552309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.552366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.552418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.552462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.552471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.552532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.552646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.552701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.552753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.552790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.552795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.552852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.552906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.552958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.553009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.553046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.553051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.553106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:09.553167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:09.553224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:09.553275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:09.553311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:09.553316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:09.553375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318480:4813], now have 1 active actors on pipe
2025-10-10T14:32:09.553584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:09.553587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:09.553598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:09.553627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 464 reason: error at write: Disconnected sessionId: src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0
2025-10-10T14:32:09.553628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600840842318480:4813]
2025-10-10T14:32:09.553834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 464 sessionId: src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0 is DEAD
2025-10-10T14:32:09.553970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:09.553981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0] Write session will restart in 0.005280s
2025-10-10T14:32:09.553999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0] Write session: Do CDS request
2025-10-10T14:32:09.554005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:09.554098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:09.560758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.560886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:09.560900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 465
2025-10-10T14:32:09.561049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.561084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:09.561089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:09.561093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:09.561502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 465 sessionId:  describe result for acl check
2025-10-10T14:32:09.561532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:09.561539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:09.561541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:09.561549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600840842318524:5188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:09.562081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600840842318524:5188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:09.565360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600840842318524:5188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:09.568158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600840842318524:5188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:09.568169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600840842318524:5188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:09.568171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600840842318524:5188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:09.568185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:09.572674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:09.573075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:09.573263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:09.573273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:09.573288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:09.573350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:09.573389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600840060108259:4331]
2025-10-10T14:32:09.573775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:09.574019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:09.574058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:09.574315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:09.574367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.574374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.574374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.574375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.574376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.574376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.574377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.574378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.574379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.574379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.574380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.574381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.574381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.574386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.574394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.574397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.574399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.574401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.574403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.574405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.574407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.574409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.574411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.574413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.574415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.574417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.574422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.574428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.574432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.574435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.574438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.574441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.574443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.574446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.574449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.574452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.574455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.574458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.574461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.574464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.574466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.574470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.574472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.574475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.574478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.574482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.574485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.574488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.574490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.574493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.574496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.574498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.574520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:09.576620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:09.576950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:09.576962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:09.576964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:09.576967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:09.576973Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 464 [2:7559600840060108259:4331]
2025-10-10T14:32:09.576985Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:09.577001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:09.577009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.577013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.577015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.577030Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:09.577043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:09.577051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:09.577103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.577110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.577112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.577114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:09.577177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:09.577186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.577197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.577209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.577231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:09.577257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318488:2438], now have 1 active actors on pipe
2025-10-10T14:32:09.577265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318732:5188], now have 1 active actors on pipe
2025-10-10T14:32:09.577272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600840060108254:4331]
2025-10-10T14:32:09.577274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600840060108254:4331]
2025-10-10T14:32:09.577276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600840060108254:4331]
2025-10-10T14:32:09.577284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:09.577271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 464
2025-10-10T14:32:09.577291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 464
2025-10-10T14:32:09.577302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:09.577308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:09.577311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:09.577313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:09.577322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:09.577325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:09.577381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.577390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.577405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600840060108254:4331]
2025-10-10T14:32:09.577418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:09.577432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:09.577448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:09.577460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.577468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.577470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:09.577480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.577495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:09.577521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.577642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.577652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.577668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.577782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 465 partition: 0 MaxSeqNo: 40 sessionId: src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0
2025-10-10T14:32:09.578155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c2a4666-c0f2bd29-26969d21-502e9a7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:09.580784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0] Write session: try to update token
2025-10-10T14:32:09.580803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:09.593662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId: src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:09.595014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:09.595031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:09.595033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:09.595034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:09.595040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600840060108254:4331]
2025-10-10T14:32:09.595044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600840060108254:4331]
2025-10-10T14:32:09.595046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600840060108254:4331]
2025-10-10T14:32:09.595081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:09.595089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.595091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:09.595096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:09.595102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:09.595106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:09.595216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:09.596292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:09.653941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600840842318789:4813]
2025-10-10T14:32:09.654247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 464, pipe: [1:7559600840842318789:4813]
2025-10-10T14:32:09.698963Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:09.699448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.699465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.699507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318789:4813], now have 1 active actors on pipe
2025-10-10T14:32:09.699756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:09.699740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:09.699776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600840842318789:4813]
2025-10-10T14:32:09.699792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:09.699798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:09.699858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 465 reason: error at write: Disconnected sessionId: src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0
2025-10-10T14:32:09.700075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 465 sessionId: src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0 is DEAD
2025-10-10T14:32:09.700237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:09.700248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0] Write session will restart in 0.006146s
2025-10-10T14:32:09.700274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0] Write session: Do CDS request
2025-10-10T14:32:09.700280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:09.707834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.707938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:09.707955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 466
2025-10-10T14:32:09.708114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.708153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:09.708166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:09.708171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:09.708716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 466 sessionId:  describe result for acl check
2025-10-10T14:32:09.708749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:09.708754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:09.708756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:09.708761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600840842318840:5192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:09.709247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600840842318840:5192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:09.711403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600840842318840:5192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:09.714230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600840842318840:5192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:09.714245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600840842318840:5192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:09.714248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600840842318840:5192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:09.714256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:09.717508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:09.719919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:09.720096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:09.720106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:09.720115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:09.720156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:09.720188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600840060108555:4334]
2025-10-10T14:32:09.720645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:09.720900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:09.720941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:09.721251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:09.721294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.721301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.721301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.721302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.721303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.721303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.721304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.721304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.721305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.721306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.721306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.721307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.721308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.721311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.721321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.721325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.721345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.721349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.721353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.721357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.721360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.721363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.721367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.721371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.721374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.721378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.721387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.721392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.721397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.721400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.721403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.721407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.721409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.721413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.721416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.721419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.721421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.721424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.721427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.721432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.721437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.721441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.721446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.721451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.721460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.721466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.721470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.721473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.721476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.721481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.721484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.721487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.721521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:09.723647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:09.723946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:09.723959Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:09.723961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:09.723965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:09.723972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 465 [2:7559600840060108555:4334]
2025-10-10T14:32:09.723988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:09.724011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:09.724019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.724023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.724025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.724040Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:09.724055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:09.724068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:09.724131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.724137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.724138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.724140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:09.724190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:09.724195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.724202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.724212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.724225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:09.724247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842319005:5192], now have 1 active actors on pipe
2025-10-10T14:32:09.724254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842318790:2438], now have 1 active actors on pipe
2025-10-10T14:32:09.724261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600840060108550:4334]
2025-10-10T14:32:09.724264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600840060108550:4334]
2025-10-10T14:32:09.724265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600840060108550:4334]
2025-10-10T14:32:09.724279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:09.724296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:09.724296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:09.724299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:09.724301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:09.724316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:09.724320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:09.724315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 465
2025-10-10T14:32:09.724345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600840060108550:4334]
2025-10-10T14:32:09.724350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 465
2025-10-10T14:32:09.724356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:09.724357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:09.724388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.724396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.724420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f117ec7-8087de13-8622f741-729051c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:09.724429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.724432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.724433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:09.724442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.724454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:09.724468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.724598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.724604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.724616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.724725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 466 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f117ec7-8087de13-8622f741-729051c6_0
2025-10-10T14:32:09.725150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5bcf8f0-cd4597e4-6d4bcff-480c920d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f117ec7-8087de13-8622f741-729051c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:09.728036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f117ec7-8087de13-8622f741-729051c6_0] Write session: try to update token
2025-10-10T14:32:09.728053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f117ec7-8087de13-8622f741-729051c6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:09.742139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId: src_id|7f117ec7-8087de13-8622f741-729051c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:09.742549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:09.742566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:09.742568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:09.742570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:09.742577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600840060108550:4334]
2025-10-10T14:32:09.742580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600840060108550:4334]
2025-10-10T14:32:09.742583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600840060108550:4334]
2025-10-10T14:32:09.742624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:09.742634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:09.742636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:09.742639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:09.742640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.742642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:09.742761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:09.744520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:09.799843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600840842319087:4813]
2025-10-10T14:32:09.800022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 465, pipe: [1:7559600840842319087:4813]
2025-10-10T14:32:09.845761Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:09.846318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.846335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.846375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842319087:4813], now have 1 active actors on pipe
2025-10-10T14:32:09.846538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:09.846584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:09.846588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600840842319087:4813]
2025-10-10T14:32:09.846599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:09.846604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:09.846668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 466 reason: error at write: Disconnected sessionId: src_id|7f117ec7-8087de13-8622f741-729051c6_0
2025-10-10T14:32:09.846874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 466 sessionId: src_id|7f117ec7-8087de13-8622f741-729051c6_0 is DEAD
2025-10-10T14:32:09.846987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f117ec7-8087de13-8622f741-729051c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:09.846997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f117ec7-8087de13-8622f741-729051c6_0] Write session will restart in 0.005185s
2025-10-10T14:32:09.847023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f117ec7-8087de13-8622f741-729051c6_0] Write session: Do CDS request
2025-10-10T14:32:09.847031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f117ec7-8087de13-8622f741-729051c6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:09.853878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f117ec7-8087de13-8622f741-729051c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.854007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:09.854024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 467
2025-10-10T14:32:09.854164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:09.854201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:09.854211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:09.854214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:09.854649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 467 sessionId:  describe result for acl check
2025-10-10T14:32:09.854698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:09.854705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:09.854707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:09.854712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600840842319142:5205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:09.855237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600840842319142:5205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:09.858335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600840842319142:5205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:09.861149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600840842319142:5205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:09.861161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600840842319142:5205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:09.861163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600840842319142:5205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:09.861170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:09.864310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:09.867112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:09.867295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:09.867307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:09.867318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:09.867365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:09.867403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600840060108887:4349]
2025-10-10T14:32:09.867852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:09.868138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:09.868172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:09.868467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:09.868717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.868725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.868727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.868728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.868729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.868730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.868731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.868732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.868733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.868734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.868736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.868737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.868738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.868744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.868758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.868762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.868766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.868770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.868774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.868777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.868780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.868785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.868789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.868792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.868796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.868799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.868807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.868816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:09.868823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.868828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:09.868832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.868837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:09.868841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.868846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:09.868851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.868856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:09.868860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.868865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:09.868871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.868881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:09.868885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.868891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:09.868898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.868903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:09.868911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.868916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:09.868921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.868926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.868930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.868935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.868944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.868949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.868988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:09.871080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:09.871604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:09.871617Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:09.871619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:09.871623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:09.871629Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 466 [2:7559600840060108887:4349]
2025-10-10T14:32:09.871640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:09.871657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:09.871665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.871668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.871670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.871687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:09.871699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:09.871706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:09.871760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.871768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.871770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.871773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:09.871837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:09.871845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.871855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:09.871866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:09.871889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:09.871913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842319331:5205], now have 1 active actors on pipe
2025-10-10T14:32:09.871921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842319112:2438], now have 1 active actors on pipe
2025-10-10T14:32:09.871928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600840060108882:4349]
2025-10-10T14:32:09.871935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600840060108882:4349]
2025-10-10T14:32:09.871938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600840060108882:4349]
2025-10-10T14:32:09.871950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:09.871962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:09.871964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:09.871965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:09.871967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:09.871975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 466
2025-10-10T14:32:09.871989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 466
2025-10-10T14:32:09.871984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:09.871991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:09.872023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.872031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.872049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600840060108882:4349]
2025-10-10T14:32:09.872060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:09.872079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:09.872089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:09.872096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:09.872104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:09.872107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:09.872118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:09.872133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:09.872153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.872280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.872290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.872307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:09.872418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 467 partition: 0 MaxSeqNo: 40 sessionId: src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0
2025-10-10T14:32:09.872830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f117ec7-8087de13-8622f741-729051c6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:09.875409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0] Write session: try to update token
2025-10-10T14:32:09.875427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:09.889596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId: src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:09.890047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:09.890065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:09.890068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:09.890070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:09.890082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600840060108882:4349]
2025-10-10T14:32:09.890086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600840060108882:4349]
2025-10-10T14:32:09.890089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600840060108882:4349]
2025-10-10T14:32:09.890136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:09.890141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:09.890147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:09.890147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:09.890150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:09.890164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:09.890329Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:09.892122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:09.946820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600840842319410:4813]
2025-10-10T14:32:09.947036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 466, pipe: [1:7559600840842319410:4813]
2025-10-10T14:32:09.994892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:09.995201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:09.995213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:09.995252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842319410:4813], now have 1 active actors on pipe
2025-10-10T14:32:09.995453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:09.995470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:09.995550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 467 reason: error at write: Disconnected sessionId: src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0
2025-10-10T14:32:09.995604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:09.995672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600840842319410:4813]
2025-10-10T14:32:09.995696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:09.995762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 467 sessionId: src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0 is DEAD
2025-10-10T14:32:09.995903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:09.995913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0] Write session will restart in 0.007687s
2025-10-10T14:32:09.995935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0] Write session: Do CDS request
2025-10-10T14:32:09.995949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:10.004949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.005210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:10.005225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 468
2025-10-10T14:32:10.005369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.005397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:10.005412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:10.005419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:10.005831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 468 sessionId:  describe result for acl check
2025-10-10T14:32:10.005870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:10.005877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:10.005879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:10.005885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600845137286782:5209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:10.006475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600845137286782:5209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:10.009513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600845137286782:5209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:10.012522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600845137286782:5209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:10.012536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600845137286782:5209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:10.012539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600845137286782:5209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:10.012547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:10.013825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:10.016192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:10.016384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:10.016395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:10.016406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:10.016458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:10.016497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600844355076490:4351]
2025-10-10T14:32:10.017077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:10.017383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:10.017430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:10.017745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:10.017811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.017818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.017819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.017820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.017821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.017822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.017823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.017825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.017826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.017827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.017828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.017829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.017831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.017836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.017849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.017853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.017857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.017861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.017865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.017869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.017873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.017877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.017881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.017885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.017889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.017893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.017900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.017908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.017914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.017919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.017924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.017929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.017933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.017938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.017942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.017947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.017952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.017960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.017965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.017970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.017974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.017979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.017984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.017993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.017997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.018002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.018007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.018012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.018016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.018021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.018030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.018035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.018072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:10.020359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:10.020671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:10.020681Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:10.020682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:10.020686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:10.020692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 467 [2:7559600844355076490:4351]
2025-10-10T14:32:10.020700Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:10.020711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:10.020713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.020715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.020717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.020729Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:10.020735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:10.020741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:10.020778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.020784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.020785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.020787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:10.020833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:10.020839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.020846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.020852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.020862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:10.020877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600844355076485:4351]
2025-10-10T14:32:10.020882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600844355076485:4351]
2025-10-10T14:32:10.020883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600844355076485:4351]
2025-10-10T14:32:10.020890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:10.020900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:10.020902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600840842319427:2438], now have 1 active actors on pipe
2025-10-10T14:32:10.020907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:10.020908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:10.020910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:10.020916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:10.020918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:10.020921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287007:5209], now have 1 active actors on pipe
2025-10-10T14:32:10.020936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600844355076485:4351]
2025-10-10T14:32:10.020941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:10.020953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:10.020967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 467
2025-10-10T14:32:10.020966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 467
2025-10-10T14:32:10.021014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.021021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.021051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:10.021064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.021068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.021071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:10.021082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.021097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:10.021110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.021289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.021300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.021318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.021434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 468 partition: 0 MaxSeqNo: 40 sessionId: src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0
2025-10-10T14:32:10.021791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67b7df1b-2ef5c6b8-58025b98-22822c25_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:10.024238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0] Write session: try to update token
2025-10-10T14:32:10.024255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:10.032060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:10.032080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.032091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600844355076485:4351]
2025-10-10T14:32:10.032141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:10.032142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:10.032349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:10.032494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:10.032626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:10.032752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:10.032937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:10.032974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:10.037246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId: src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:10.039641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:10.039906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.039929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.039967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:10.040066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:10.049144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:10.049162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.049166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:10.049168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:10.049179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600844355076485:4351]
2025-10-10T14:32:10.049182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600844355076485:4351]
2025-10-10T14:32:10.049186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600844355076485:4351]
2025-10-10T14:32:10.049235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:10.049243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.049246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:10.049245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:10.049252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:10.049256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:10.049417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:10.095813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600845137287021:4813]
2025-10-10T14:32:10.096034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 467, pipe: [1:7559600845137287021:4813]
2025-10-10T14:32:10.151967Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:10.158368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.158389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.158534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.158589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.158653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.158708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.158748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.158755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.158814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.158865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.158918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.158977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.159017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.159022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.159076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.159134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.159190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.159243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.159281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.159286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.159340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.159399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.159453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.159505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.159543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.159548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.159601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.159659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.159712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.159767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.159806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.159811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.159864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.159915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.159967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.160037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.160084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.160091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.160144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.160195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.160249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.160301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.160342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.160347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.160398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.160449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.160501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.160567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.160603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.160608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.160661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.160709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.160760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.160810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.160850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.160855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.160907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.160956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.161006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.161057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.161092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.161097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.161132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287021:4813], now have 1 active actors on pipe
2025-10-10T14:32:10.161343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:10.161356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:10.161359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:10.161384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 468 reason: error at write: Disconnected sessionId: src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0
2025-10-10T14:32:10.161391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600845137287021:4813]
2025-10-10T14:32:10.161571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 468 sessionId: src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0 is DEAD
2025-10-10T14:32:10.161740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:10.161751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0] Write session will restart in 0.009755s
2025-10-10T14:32:10.161778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0] Write session: Do CDS request
2025-10-10T14:32:10.161784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:10.161894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:10.172848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.172946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:10.172970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 469
2025-10-10T14:32:10.173098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.173136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:10.173143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:10.173147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:10.173571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 469 sessionId:  describe result for acl check
2025-10-10T14:32:10.173600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:10.173605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:10.173607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:10.173611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600845137287162:5214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:10.174078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600845137287162:5214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:10.176255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600845137287162:5214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:10.178308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:10.178692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600845137287162:5214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:10.178703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600845137287162:5214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:10.178705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600845137287162:5214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:10.178711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:10.178876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:10.179002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:10.179011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:10.179020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:10.179051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:10.179080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600844355076799:4354]
2025-10-10T14:32:10.179455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:10.181096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:10.181136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:10.181577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:10.181662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.181669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.181670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.181671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.181672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.181673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.181675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.181676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.181677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.181678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.181679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.181680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.181681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.181688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.181701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.181705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.181709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.181712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.181715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.181719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.181723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.181727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.181731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.181735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.181739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.181742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.181749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.181758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.181764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.181769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.181773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.181778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.181783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.181788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.181793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.181798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.181802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.181808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.181817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.181822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.181826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.181831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.181840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.181845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.181854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.181859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.181863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.181869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.181877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.181882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.181888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.181897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.181937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:10.183980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:10.184479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:10.184490Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:10.184491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:10.184494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:10.184499Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 468 [2:7559600844355076799:4354]
2025-10-10T14:32:10.184506Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:10.184518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:10.184520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.184522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.184524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.184535Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:10.184544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:10.184551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:10.184591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.184596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.184598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.184599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:10.184649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:10.184656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.184667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.184678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.184694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:10.184714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287324:5214], now have 1 active actors on pipe
2025-10-10T14:32:10.184720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287035:2438], now have 1 active actors on pipe
2025-10-10T14:32:10.184726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600844355076792:4354]
2025-10-10T14:32:10.184728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600844355076792:4354]
2025-10-10T14:32:10.184729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600844355076792:4354]
2025-10-10T14:32:10.184740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:10.184754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:10.184758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:10.184761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:10.184762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:10.184766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:10.184768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:10.184783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600844355076792:4354]
2025-10-10T14:32:10.184789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:10.184790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:10.184771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 468
2025-10-10T14:32:10.184872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 468
2025-10-10T14:32:10.184923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.184935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.184957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:10.184968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.184971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.184972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:10.184982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.184995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:10.185010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.185132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.185140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.185155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.185216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 469 partition: 0 MaxSeqNo: 40 sessionId: src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0
2025-10-10T14:32:10.185598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89b97e6-af2914d9-ae3bd807-67cba7d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:10.188646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0] Write session: try to update token
2025-10-10T14:32:10.188666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:10.202352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:10.202371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.202375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:10.202377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:10.202386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600844355076792:4354]
2025-10-10T14:32:10.202392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600844355076792:4354]
2025-10-10T14:32:10.202396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600844355076792:4354]
2025-10-10T14:32:10.202437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:10.202441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:10.202441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:10.202444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:10.202449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.202451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:10.202582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:10.203125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId: src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:10.205711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:10.261705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600845137287335:4813]
2025-10-10T14:32:10.261941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 468, pipe: [1:7559600845137287335:4813]
2025-10-10T14:32:10.305713Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:10.306098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.306112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.306149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287335:4813], now have 1 active actors on pipe
2025-10-10T14:32:10.306301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:10.306365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:10.306395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600845137287335:4813]
2025-10-10T14:32:10.306412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:10.306478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 469 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0
2025-10-10T14:32:10.306681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 469 sessionId: src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0 is DEAD
2025-10-10T14:32:10.306817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:10.306828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0] Write session will restart in 0.005593s
2025-10-10T14:32:10.306853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0] Write session: Do CDS request
2025-10-10T14:32:10.306859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:10.313853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.313941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:10.313962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 470
2025-10-10T14:32:10.314077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.314104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:10.314112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:10.314115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:10.314587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 470 sessionId:  describe result for acl check
2025-10-10T14:32:10.314643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:10.314650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:10.314652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:10.314659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600845137287374:5218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:10.315235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600845137287374:5218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:10.317876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600845137287374:5218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:10.321107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600845137287374:5218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:10.321122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600845137287374:5218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:10.321125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600845137287374:5218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:10.321133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:10.326679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:10.327080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:10.327288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:10.327299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:10.327310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:10.327357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:10.327395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600844355077097:4356]
2025-10-10T14:32:10.327985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:10.328300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:10.328339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:10.328640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:10.328690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.328696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.328697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.328698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.328699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.328701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.328702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.328703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.328704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.328705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.328707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.328708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.328709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.328714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.328728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.328732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.328736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.328740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.328744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.328748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.328751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.328754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.328758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.328761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.328764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.328767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.328774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.328782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.328789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.328794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.328800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.328805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.328809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.328815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.328819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.328824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.328828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.328833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.328837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.328846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.328850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.328855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.328859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.328864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.328871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.328876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.328881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.328886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.328892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.328897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.328901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.328906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.328945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:10.331158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:10.331459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:10.331471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:10.331473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:10.331477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:10.331483Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 469 [2:7559600844355077097:4356]
2025-10-10T14:32:10.331494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:10.331510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:10.331518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.331521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.331524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.331538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:10.331549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:10.331556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:10.331608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.331616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.331618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.331621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:10.331680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:10.331687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.331700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.331714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.331734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:10.331760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287564:5218], now have 1 active actors on pipe
2025-10-10T14:32:10.331768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287337:2438], now have 1 active actors on pipe
2025-10-10T14:32:10.331774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600844355077092:4356]
2025-10-10T14:32:10.331777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600844355077092:4356]
2025-10-10T14:32:10.331779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600844355077092:4356]
2025-10-10T14:32:10.331791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:10.331801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:10.331803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:10.331805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:10.331808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:10.331798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 469
2025-10-10T14:32:10.331824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:10.331832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:10.331833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 469
2025-10-10T14:32:10.331858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600844355077092:4356]
2025-10-10T14:32:10.331871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:10.331885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.331886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:10.331894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.331939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e750541-c0238006-436c2dca-222d4090_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:10.331950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.331955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.331957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:10.331967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.331982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:10.332002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.332141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.332149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.332162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.332237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 470 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e750541-c0238006-436c2dca-222d4090_0
2025-10-10T14:32:10.332584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12eb10a3-71b8cd92-34a3d9ad-ac3e6109_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e750541-c0238006-436c2dca-222d4090_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:10.335209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e750541-c0238006-436c2dca-222d4090_0] Write session: try to update token
2025-10-10T14:32:10.335222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e750541-c0238006-436c2dca-222d4090_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:10.347996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId: src_id|7e750541-c0238006-436c2dca-222d4090_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:10.350030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:10.350049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.350053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:10.350055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:10.350064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600844355077092:4356]
2025-10-10T14:32:10.350068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600844355077092:4356]
2025-10-10T14:32:10.350072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600844355077092:4356]
2025-10-10T14:32:10.350114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:10.350119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:10.350120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:10.350122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:10.350128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.350131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:10.350262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:10.350430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:10.406598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600845137287637:4813]
2025-10-10T14:32:10.406873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 469, pipe: [1:7559600845137287637:4813]
2025-10-10T14:32:10.454408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:10.455215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.455234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.455272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287637:4813], now have 1 active actors on pipe
2025-10-10T14:32:10.455455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:10.455535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:10.455556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600845137287637:4813]
2025-10-10T14:32:10.455579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:10.455661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 470 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7e750541-c0238006-436c2dca-222d4090_0
2025-10-10T14:32:10.455837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 470 sessionId: src_id|7e750541-c0238006-436c2dca-222d4090_0 is DEAD
2025-10-10T14:32:10.455996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e750541-c0238006-436c2dca-222d4090_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:10.456005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e750541-c0238006-436c2dca-222d4090_0] Write session will restart in 0.005452s
2025-10-10T14:32:10.456022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e750541-c0238006-436c2dca-222d4090_0] Write session: Do CDS request
2025-10-10T14:32:10.456027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e750541-c0238006-436c2dca-222d4090_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:10.462784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e750541-c0238006-436c2dca-222d4090_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.462888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:10.462901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 471
2025-10-10T14:32:10.462997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.463023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:10.463030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:10.463033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:10.463358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 471 sessionId:  describe result for acl check
2025-10-10T14:32:10.463384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:10.463385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:10.463386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:10.463391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600845137287665:5222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:10.463803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600845137287665:5222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:10.466397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600845137287665:5222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:10.469307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600845137287665:5222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:10.469320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600845137287665:5222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:10.469323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600845137287665:5222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:10.469347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:10.473894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:10.476396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:10.476590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:10.476601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:10.476613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:10.476665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:10.476707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600844355077395:4358]
2025-10-10T14:32:10.477345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:10.477683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:10.477725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:10.478115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:10.478171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.478177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.478178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.478179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.478180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.478181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.478182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.478184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.478185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.478186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.478187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.478188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.478189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.478195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.478207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.478212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.478216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.478220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.478224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.478227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.478231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.478235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.478239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.478243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.478247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.478251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.478259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.478268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.478278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.478283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.478287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.478292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.478296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.478301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.478306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.478312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.478318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.478323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.478332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.478337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.478341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.478346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.478350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.478355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.478359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.478364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.478368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.478373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.478377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.478387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.478391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.478396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.478436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:10.480658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:10.481385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:10.481397Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:10.481399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:10.481403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:10.481408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 470 [2:7559600844355077395:4358]
2025-10-10T14:32:10.481421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:10.481441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:10.481450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.481453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.481460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.481476Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:10.481488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:10.481500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:10.481558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.481565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.481567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.481569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:10.481635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:10.481642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.481654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.481671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.481693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:10.481719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287638:2438], now have 1 active actors on pipe
2025-10-10T14:32:10.481727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287827:5222], now have 1 active actors on pipe
2025-10-10T14:32:10.481734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600844355077390:4358]
2025-10-10T14:32:10.481743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600844355077390:4358]
2025-10-10T14:32:10.481747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600844355077390:4358]
2025-10-10T14:32:10.481766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:10.481779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:10.481789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:10.481793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:10.481795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:10.481795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:10.481798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:10.481818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600844355077390:4358]
2025-10-10T14:32:10.481826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:10.481835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:10.481818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 470
2025-10-10T14:32:10.481818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 470
2025-10-10T14:32:10.481855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.481864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.481898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7592b86-f41cd964-460f9a1f-70259421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:10.481909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.481918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.481920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:10.481931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.481941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:10.481958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.482113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.482123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.482137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.482202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 471 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7592b86-f41cd964-460f9a1f-70259421_0
2025-10-10T14:32:10.482583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e750541-c0238006-436c2dca-222d4090_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7592b86-f41cd964-460f9a1f-70259421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:10.485272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7592b86-f41cd964-460f9a1f-70259421_0] Write session: try to update token
2025-10-10T14:32:10.485290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7592b86-f41cd964-460f9a1f-70259421_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:10.492705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:10.492726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.492736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600844355077390:4358]
2025-10-10T14:32:10.492768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:10.492782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:10.492959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:10.493093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:10.493224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:10.493370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:10.493551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:10.493594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:10.499223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId: src_id|a7592b86-f41cd964-460f9a1f-70259421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:10.501953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:10.502135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.502157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.502196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:10.502267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:10.509940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:10.509958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.509962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:10.509964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:10.509974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600844355077390:4358]
2025-10-10T14:32:10.509978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600844355077390:4358]
2025-10-10T14:32:10.509982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600844355077390:4358]
2025-10-10T14:32:10.510022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:10.510027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:10.510028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:10.510031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:10.510035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.510037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:10.510156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:10.555564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600845137287949:4813]
2025-10-10T14:32:10.555735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 470, pipe: [1:7559600845137287949:4813]
2025-10-10T14:32:10.615567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:10.622300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.622325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.622473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.622542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.622600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.622667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.622708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.622716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.622779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.622850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.622926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.622981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.623021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.623027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.623120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.623172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.623230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.623286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.623324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.623332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.623388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.623442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.623497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.623552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.623648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.623654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.623707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.623757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.623819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.623885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.623923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.623929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.623985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.624040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.624092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.624144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.624185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.624190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.624244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.624302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.624372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.624427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.624464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.624469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.624522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.624571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.624625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.624679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.624730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.624735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.624787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.624835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.624887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.624939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.625034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.625039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.625091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:10.625140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:10.625191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:10.625241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:10.625277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:10.625282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:10.625317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287949:4813], now have 1 active actors on pipe
2025-10-10T14:32:10.625545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600845137287949:4813]
2025-10-10T14:32:10.625555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:10.625579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:10.625591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:10.625618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 471 reason: error at write: Disconnected sessionId: src_id|a7592b86-f41cd964-460f9a1f-70259421_0
2025-10-10T14:32:10.625846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 471 sessionId: src_id|a7592b86-f41cd964-460f9a1f-70259421_0 is DEAD
2025-10-10T14:32:10.625929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7592b86-f41cd964-460f9a1f-70259421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:10.625939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7592b86-f41cd964-460f9a1f-70259421_0] Write session will restart in 0.005783s
2025-10-10T14:32:10.625960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7592b86-f41cd964-460f9a1f-70259421_0] Write session: Do CDS request
2025-10-10T14:32:10.625965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7592b86-f41cd964-460f9a1f-70259421_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:10.626015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:10.632810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7592b86-f41cd964-460f9a1f-70259421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.632876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:10.632889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 472
2025-10-10T14:32:10.633014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.633058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:10.633065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:10.633068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:10.633590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 472 sessionId:  describe result for acl check
2025-10-10T14:32:10.633626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:10.633628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:10.633631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:10.633637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600845137287995:5228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:10.634235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600845137287995:5228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:10.637517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600845137287995:5228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:10.640370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600845137287995:5228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:10.640384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600845137287995:5228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:10.640387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600845137287995:5228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:10.640394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:10.642711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:10.644800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:10.644971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:10.644983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:10.644995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:10.645056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:10.645096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600844355077697:4361]
2025-10-10T14:32:10.645586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:10.645828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:10.645858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:10.646114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:10.646166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.646173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.646174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.646175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.646176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.646177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.646178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.646179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.646180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.646181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.646182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.646183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.646185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.646190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.646203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.646207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.646211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.646214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.646218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.646222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.646225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.646229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.646234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.646238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.646242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.646246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.646253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.646261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.646267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.646273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.646278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.646281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.646283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.646287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.646289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.646293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.646295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.646298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.646301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.646304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.646307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.646310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.646312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.646315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.646317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.646321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.646325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.646327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.646330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.646333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.646336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.646338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.646359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:10.648406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:10.648817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:10.648829Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:10.648831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:10.648835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:10.648841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 471 [2:7559600844355077697:4361]
2025-10-10T14:32:10.648852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:10.648868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:10.648876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.648880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.648882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.648897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:10.648909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:10.648921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:10.648963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.648969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.648970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.648972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:10.649021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:10.649028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.649039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.649054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.649076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:10.649101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137288198:5228], now have 1 active actors on pipe
2025-10-10T14:32:10.649108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137287955:2438], now have 1 active actors on pipe
2025-10-10T14:32:10.649116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600844355077692:4361]
2025-10-10T14:32:10.649122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600844355077692:4361]
2025-10-10T14:32:10.649124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600844355077692:4361]
2025-10-10T14:32:10.649139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:10.649156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:10.649156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:10.649159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:10.649160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:10.649177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:10.649184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:10.649203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600844355077692:4361]
2025-10-10T14:32:10.649211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:10.649212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:10.649186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 471
2025-10-10T14:32:10.649276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 471
2025-10-10T14:32:10.649342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.649354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.649383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:10.649395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.649398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.649400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:10.649411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.649426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:10.649443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.649631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.649640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.649655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.649717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 472 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0
2025-10-10T14:32:10.650075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7592b86-f41cd964-460f9a1f-70259421_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:10.652625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0] Write session: try to update token
2025-10-10T14:32:10.652644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:10.666067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId: src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:10.667637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:10.667658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.667661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:10.667663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:10.667672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600844355077692:4361]
2025-10-10T14:32:10.667675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600844355077692:4361]
2025-10-10T14:32:10.667681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600844355077692:4361]
2025-10-10T14:32:10.667714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:10.667725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:10.667728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:10.667735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.667736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:10.667737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:10.667870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:10.668437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:10.725566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600845137288259:4813]
2025-10-10T14:32:10.725834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 471, pipe: [1:7559600845137288259:4813]
2025-10-10T14:32:10.773844Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:10.774227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.774239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.774278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137288259:4813], now have 1 active actors on pipe
2025-10-10T14:32:10.774431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:10.774527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:10.774537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:10.774550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:10.774575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600845137288259:4813]
2025-10-10T14:32:10.774607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 472 reason: error at write: Disconnected sessionId: src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0
2025-10-10T14:32:10.774802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 472 sessionId: src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0 is DEAD
2025-10-10T14:32:10.774963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:10.774973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0] Write session will restart in 0.009219s
2025-10-10T14:32:10.774994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0] Write session: Do CDS request
2025-10-10T14:32:10.775000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:10.785815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.785828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:10.785842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 473
2025-10-10T14:32:10.786037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.786077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:10.786084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:10.786087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:10.786501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 473 sessionId:  describe result for acl check
2025-10-10T14:32:10.786538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:10.786544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:10.786546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:10.786552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600845137288372:5232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:10.787001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600845137288372:5232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:10.789411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600845137288372:5232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:10.791635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600845137288372:5232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:10.791649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600845137288372:5232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:10.791653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600845137288372:5232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:10.791658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:10.792926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:10.795074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:10.795242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:10.795253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:10.795264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:10.795308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:10.795335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600844355077998:4363]
2025-10-10T14:32:10.795696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:10.795908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:10.795939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:10.796190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:10.796241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.796246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.796246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.796247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.796247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.796248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.796249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.796249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.796250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.796250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.796251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.796251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.796252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.796255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.796263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.796266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.796268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.796270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.796272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.796275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.796277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.796279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.796282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.796284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.796286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.796288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.796293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.796298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.796302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.796306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.796308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.796311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.796313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.796316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.796319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.796322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.796324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.796327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.796329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.796332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.796334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.796337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.796340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.796343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.796345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.796348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.796350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.796353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.796356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.796358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.796361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.796364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.796385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:10.798327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:10.798591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:10.798600Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:10.798601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:10.798603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:10.798607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 472 [2:7559600844355077998:4363]
2025-10-10T14:32:10.798615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:10.798638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:10.798643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.798645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.798647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.798659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:10.798669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:10.798677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:10.798723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.798728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.798730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.798731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:10.798784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:10.798792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.798802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.798816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.798835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:10.798856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137288549:5232], now have 1 active actors on pipe
2025-10-10T14:32:10.798864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137288260:2438], now have 1 active actors on pipe
2025-10-10T14:32:10.798870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600844355077993:4363]
2025-10-10T14:32:10.798872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600844355077993:4363]
2025-10-10T14:32:10.798874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600844355077993:4363]
2025-10-10T14:32:10.798888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:10.798895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:10.798897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:10.798899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:10.798906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:10.798899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 472
2025-10-10T14:32:10.798920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:10.798910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 472
2025-10-10T14:32:10.798927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:10.798954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.798962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.798976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600844355077993:4363]
2025-10-10T14:32:10.798987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:10.798990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:10.799007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:10.799018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.799021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.799023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:10.799033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.799047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:10.799071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.799173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.799181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.799194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.799286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 473 partition: 0 MaxSeqNo: 40 sessionId: src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0
2025-10-10T14:32:10.799556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a408478-7ae3b887-f66fdb09-cd6a96bc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:10.802131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0] Write session: try to update token
2025-10-10T14:32:10.802148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:10.815842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId: src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:10.816567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:10.816590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.816592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:10.816594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:10.816605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600844355077993:4363]
2025-10-10T14:32:10.816610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600844355077993:4363]
2025-10-10T14:32:10.816613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600844355077993:4363]
2025-10-10T14:32:10.816650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:10.816661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:10.816662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:10.816665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:10.816669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.816671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:10.816897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:10.818108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:10.874540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600845137288588:4813]
2025-10-10T14:32:10.874745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 472, pipe: [1:7559600845137288588:4813]
2025-10-10T14:32:10.921670Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:10.922176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.922191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.922241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137288588:4813], now have 1 active actors on pipe
2025-10-10T14:32:10.922434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:10.922446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600845137288588:4813]
2025-10-10T14:32:10.922472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:10.922476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:10.922477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:10.922539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 473 reason: error at write: Disconnected sessionId: src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0
2025-10-10T14:32:10.922766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 473 sessionId: src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0 is DEAD
2025-10-10T14:32:10.922921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:10.922931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0] Write session will restart in 0.007984s
2025-10-10T14:32:10.922950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0] Write session: Do CDS request
2025-10-10T14:32:10.922955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:10.931804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.931899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:10.931911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 474
2025-10-10T14:32:10.932019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:10.932047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:10.932054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:10.932058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:10.932409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 474 sessionId:  describe result for acl check
2025-10-10T14:32:10.932433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:10.932438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:10.932439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:10.932443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600845137288680:5245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:10.932874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600845137288680:5245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:10.934970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600845137288680:5245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:10.937635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600845137288680:5245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:10.937649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600845137288680:5245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:10.937652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600845137288680:5245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:10.937658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:10.941147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:10.941567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:10.941732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:10.941743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:10.941754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:10.941805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:10.941844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600844355078337:4378]
2025-10-10T14:32:10.942222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:10.942457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:10.942491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:10.942887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:10.942943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.942948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.942949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.942949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.942950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.942951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.942951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.942952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.942952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.942953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.942954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.942954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.942955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.942958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.942967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.942969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.942972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.942974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.942976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.942978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.942981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.942983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.942986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.942988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.942991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.942993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.942998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.943005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:10.943010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.943013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:10.943016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.943019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:10.943022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.943025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:10.943027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.943030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:10.943032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.943035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:10.943038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.943041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:10.943044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.943047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:10.943049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.943053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:10.943055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.943058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:10.943061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.943064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.943067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.943071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.943075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.943078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.943099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:10.945134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:10.945448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:10.945458Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:10.945459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:10.945462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:10.945466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 473 [2:7559600844355078337:4378]
2025-10-10T14:32:10.945475Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:10.945489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:10.945497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.945499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.945501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.945513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:10.945525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:10.945536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:10.945585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.945591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.945592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.945595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:10.945652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:10.945660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.945670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:10.945687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:10.945705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:10.945725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137288879:5245], now have 1 active actors on pipe
2025-10-10T14:32:10.945732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600845137288589:2438], now have 1 active actors on pipe
2025-10-10T14:32:10.945738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600844355078332:4378]
2025-10-10T14:32:10.945740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600844355078332:4378]
2025-10-10T14:32:10.945741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600844355078332:4378]
2025-10-10T14:32:10.945751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:10.945762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:10.945764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:10.945771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:10.945757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 473
2025-10-10T14:32:10.945773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:10.945774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:10.945776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:10.945802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.945806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.945821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600844355078332:4378]
2025-10-10T14:32:10.945829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:10.945846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:10.945855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:10.945862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:10.945866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:10.945868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:10.945878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:10.945893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:10.945917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.946055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:10.946063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:10.946078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:10.946095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 473
2025-10-10T14:32:10.946153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 474 partition: 0 MaxSeqNo: 40 sessionId: src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0
2025-10-10T14:32:10.946464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c9926-d84e527-fa3aa1c0-1af8b25c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:10.949068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0] Write session: try to update token
2025-10-10T14:32:10.949084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:10.963600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:10.963620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:10.963623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:10.963625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:10.963636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600844355078332:4378]
2025-10-10T14:32:10.963640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600844355078332:4378]
2025-10-10T14:32:10.963644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600844355078332:4378]
2025-10-10T14:32:10.963681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:10.963687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:10.963690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:10.963691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:10.963697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:10.963699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:10.963815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:10.965514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId: src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:10.968302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:11.022521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600849432256190:4813]
2025-10-10T14:32:11.022813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 473, pipe: [1:7559600849432256190:4813]
2025-10-10T14:32:11.068582Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:11.069111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.069125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.069164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432256190:4813], now have 1 active actors on pipe
2025-10-10T14:32:11.069380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:11.069403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:11.069404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:11.069444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600849432256190:4813]
2025-10-10T14:32:11.069458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 474 reason: error at write: Disconnected sessionId: src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0
2025-10-10T14:32:11.069637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 474 sessionId: src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0 is DEAD
2025-10-10T14:32:11.069651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:11.069760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:11.069770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0] Write session will restart in 0.007466s
2025-10-10T14:32:11.069788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0] Write session: Do CDS request
2025-10-10T14:32:11.069795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:11.079011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.079020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:11.079032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 475
2025-10-10T14:32:11.079289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.079328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:11.079338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:11.079342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:11.079756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 475 sessionId:  describe result for acl check
2025-10-10T14:32:11.079782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:11.079787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:11.079788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:11.079794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600849432256268:5249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:11.080254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600849432256268:5249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:11.082609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600849432256268:5249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:11.085131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600849432256268:5249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:11.085144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600849432256268:5249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:11.085147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600849432256268:5249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:11.085153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:11.087253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:11.089499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:11.089676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:11.089685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:11.089695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:11.089737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:11.089770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600848650045936:4380]
2025-10-10T14:32:11.090188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:11.090420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:11.090453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:11.090775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:11.090829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.090835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.090836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.090837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.090839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.090840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.090841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.090842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.090844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.090845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.090846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.090847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.090848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.090853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.090865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.090869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.090873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.090876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.090880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.090884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.090888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.090892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.090896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.090900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.090903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.090907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.090915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.090923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.090929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.090935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.090939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.090945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.090949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.090954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.090958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.090966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.090970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.090975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.090980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.090988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.090992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.090997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.091002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.091012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.091016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.091022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.091028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.091033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.091043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.091048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.091052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.091057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.091101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:11.093276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:11.093905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:11.093920Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:11.093922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:11.093925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:11.093931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 474 [2:7559600848650045936:4380]
2025-10-10T14:32:11.093942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:11.093959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:11.093962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.093965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.093967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.093982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:11.093994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:11.094003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:11.094056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.094063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.094065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.094068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:11.094131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:11.094141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.094152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.094165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.094187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:11.094211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600848650045931:4380]
2025-10-10T14:32:11.094216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600848650045931:4380]
2025-10-10T14:32:11.094218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600848650045931:4380]
2025-10-10T14:32:11.094233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:11.094247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432256191:2438], now have 1 active actors on pipe
2025-10-10T14:32:11.094250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:11.094252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432256459:5249], now have 1 active actors on pipe
2025-10-10T14:32:11.094253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:11.094256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:11.094258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:11.094269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:11.094272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:11.094266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 474
2025-10-10T14:32:11.094290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600848650045931:4380]
2025-10-10T14:32:11.094288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 474
2025-10-10T14:32:11.094298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:11.094305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:11.094324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.094332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.094360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9857bd51-49636a7-6e1dc21-961bac05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:11.094370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.094372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.094374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:11.094382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.094395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:11.094422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.094537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.094545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.094561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.094654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 475 partition: 0 MaxSeqNo: 40 sessionId: src_id|9857bd51-49636a7-6e1dc21-961bac05_0
2025-10-10T14:32:11.095009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445040a9-ac9dc7b0-ba1b5644-3df2319f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9857bd51-49636a7-6e1dc21-961bac05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:11.097526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9857bd51-49636a7-6e1dc21-961bac05_0] Write session: try to update token
2025-10-10T14:32:11.097542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9857bd51-49636a7-6e1dc21-961bac05_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:11.111850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:11.111868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:11.111871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:11.111873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:11.111882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600848650045931:4380]
2025-10-10T14:32:11.111887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600848650045931:4380]
2025-10-10T14:32:11.111890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600848650045931:4380]
2025-10-10T14:32:11.111933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:11.111935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:11.111940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:11.111943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:11.111945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.111947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:11.112143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:11.112732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId: src_id|9857bd51-49636a7-6e1dc21-961bac05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:11.115262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:11.169471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600849432256509:4813]
2025-10-10T14:32:11.169735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 474, pipe: [1:7559600849432256509:4813]
2025-10-10T14:32:11.216311Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:11.216516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.216528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.216564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432256509:4813], now have 1 active actors on pipe
2025-10-10T14:32:11.216726Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:11.216831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:11.216843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:11.216845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:11.216882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600849432256509:4813]
2025-10-10T14:32:11.216909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 475 reason: error at write: Disconnected sessionId: src_id|9857bd51-49636a7-6e1dc21-961bac05_0
2025-10-10T14:32:11.217043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 475 sessionId: src_id|9857bd51-49636a7-6e1dc21-961bac05_0 is DEAD
2025-10-10T14:32:11.217204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9857bd51-49636a7-6e1dc21-961bac05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:11.217231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9857bd51-49636a7-6e1dc21-961bac05_0] Write session will restart in 0.006620s
2025-10-10T14:32:11.217257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9857bd51-49636a7-6e1dc21-961bac05_0] Write session: Do CDS request
2025-10-10T14:32:11.217264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9857bd51-49636a7-6e1dc21-961bac05_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:11.224745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9857bd51-49636a7-6e1dc21-961bac05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.224836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:11.224848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 476
2025-10-10T14:32:11.224963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.224990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:11.224998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:11.225001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:11.225424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 476 sessionId:  describe result for acl check
2025-10-10T14:32:11.225454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:11.225459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:11.225460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:11.225464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600849432256554:5254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:11.225864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600849432256554:5254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:11.228235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600849432256554:5254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:11.231149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600849432256554:5254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:11.231165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600849432256554:5254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:11.231168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600849432256554:5254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:11.231174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:11.234840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:11.236974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:11.237137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:11.237150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:11.237162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:11.237211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:11.237254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600848650046252:4383]
2025-10-10T14:32:11.237804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:11.238081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:11.238114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:11.238336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:11.238382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.238388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.238389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.238389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.238390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.238390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.238391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.238392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.238393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.238393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.238394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.238394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.238395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.238398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.238407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.238409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.238411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.238413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.238416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.238418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.238420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.238422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.238425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.238427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.238429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.238431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.238437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.238442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.238447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.238450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.238453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.238455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.238458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.238461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.238464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.238466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.238469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.238472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.238475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.238478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.238480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.238483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.238485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.238488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.238491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.238494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.238497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.238500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.238503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.238506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.238509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.238511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.238546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:11.240558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:11.240872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:11.240882Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:11.240884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:11.240886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:11.240890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 475 [2:7559600848650046252:4383]
2025-10-10T14:32:11.240900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:11.240919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:11.240926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.240930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.240936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.240950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:11.240963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:11.240970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:11.241013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.241020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.241022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.241024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:11.241083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:11.241091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.241101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.241112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.241130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:11.241154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432256723:5254], now have 1 active actors on pipe
2025-10-10T14:32:11.241161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432256510:2438], now have 1 active actors on pipe
2025-10-10T14:32:11.241168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600848650046247:4383]
2025-10-10T14:32:11.241170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600848650046247:4383]
2025-10-10T14:32:11.241172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600848650046247:4383]
2025-10-10T14:32:11.241184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:11.241192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:11.241194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:11.241196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:11.241201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:11.241216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:11.241223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:11.241198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 475
2025-10-10T14:32:11.241206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 475
2025-10-10T14:32:11.241252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.241260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.241279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600848650046247:4383]
2025-10-10T14:32:11.241289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:11.241293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:11.241310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be088346-85f34974-2411beee-4dda000_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:11.241319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.241321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.241323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:11.241347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.241356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:11.241376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.241501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.241509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.241522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.241604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 476 partition: 0 MaxSeqNo: 40 sessionId: src_id|be088346-85f34974-2411beee-4dda000_0
2025-10-10T14:32:11.241947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9857bd51-49636a7-6e1dc21-961bac05_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be088346-85f34974-2411beee-4dda000_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:11.245103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be088346-85f34974-2411beee-4dda000_0] Write session: try to update token
2025-10-10T14:32:11.245121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be088346-85f34974-2411beee-4dda000_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:11.259089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:11.259108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:11.259111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:11.259113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:11.259122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600848650046247:4383]
2025-10-10T14:32:11.259126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600848650046247:4383]
2025-10-10T14:32:11.259130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600848650046247:4383]
2025-10-10T14:32:11.259174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:11.259184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.259186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:11.259297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId: src_id|be088346-85f34974-2411beee-4dda000_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:11.259310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:11.259321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:11.259324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:11.259764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:11.261796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:11.316926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600849432256820:4813]
2025-10-10T14:32:11.317142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 475, pipe: [1:7559600849432256820:4813]
2025-10-10T14:32:11.366010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:11.366226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.366239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.366279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432256820:4813], now have 1 active actors on pipe
2025-10-10T14:32:11.366452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:11.366543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600849432256820:4813]
2025-10-10T14:32:11.366549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:11.366553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:11.366582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:11.366609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 476 reason: error at write: Disconnected sessionId: src_id|be088346-85f34974-2411beee-4dda000_0
2025-10-10T14:32:11.366789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 476 sessionId: src_id|be088346-85f34974-2411beee-4dda000_0 is DEAD
2025-10-10T14:32:11.366922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be088346-85f34974-2411beee-4dda000_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:11.366932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be088346-85f34974-2411beee-4dda000_0] Write session will restart in 0.008256s
2025-10-10T14:32:11.366950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be088346-85f34974-2411beee-4dda000_0] Write session: Do CDS request
2025-10-10T14:32:11.366957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be088346-85f34974-2411beee-4dda000_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:11.376829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be088346-85f34974-2411beee-4dda000_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.376952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:11.376964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 477
2025-10-10T14:32:11.377075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.377101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:11.377109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:11.377112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:11.377574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 477 sessionId:  describe result for acl check
2025-10-10T14:32:11.377614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:11.377620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:11.377622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:11.377628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600849432256928:5260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:11.378072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600849432256928:5260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:11.380561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600849432256928:5260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:11.382992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600849432256928:5260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:11.383003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600849432256928:5260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:11.383005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600849432256928:5260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:11.383011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:11.383605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:11.385919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:11.386099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:11.386111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:11.386398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:11.386462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:11.386507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600848650046563:4385]
2025-10-10T14:32:11.387111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:11.387385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:11.387426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:11.387729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:11.387776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.387782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.387783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.387784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.387785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.387786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.387787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.387789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.387790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.387791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.387792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.387793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.387794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.387800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.387813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.387817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.387821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.387825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.387829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.387833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.387837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.387840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.387845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.387849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.387852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.387856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.387862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.387871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.387877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.387887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.387891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.387897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.387905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.387910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.387915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.387924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.387928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.387933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.387938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.387946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.387950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.387955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.387965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.387971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.387980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.387985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.387993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.387998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.388002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.388012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.388016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.388021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.388063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:11.390059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:11.390353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:11.390365Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:11.390368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:11.390371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:11.390377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 476 [2:7559600848650046563:4385]
2025-10-10T14:32:11.390388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:11.390404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:11.390412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.390416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.390418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.390434Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:11.390446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:11.390460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:11.390512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.390519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.390522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.390524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:11.390708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 476
2025-10-10T14:32:11.390717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 476
2025-10-10T14:32:11.390830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:11.390843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.390853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.390863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.390882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:11.390907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257115:5260], now have 1 active actors on pipe
2025-10-10T14:32:11.390914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432256821:2438], now have 1 active actors on pipe
2025-10-10T14:32:11.390930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.390938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.390965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600848650046552:4385]
2025-10-10T14:32:11.390971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600848650046552:4385]
2025-10-10T14:32:11.390973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600848650046552:4385]
2025-10-10T14:32:11.390985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:11.391001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:11.391003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:11.391009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:11.391011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:11.391019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:11.391026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:11.391044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:11.391055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.391064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.391067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:11.391077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.391091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:11.391118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600848650046552:4385]
2025-10-10T14:32:11.391128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:11.391131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:11.391142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.391257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.391267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.391283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.391363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 477 partition: 0 MaxSeqNo: 40 sessionId: src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0
2025-10-10T14:32:11.391692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be088346-85f34974-2411beee-4dda000_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:11.394521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0] Write session: try to update token
2025-10-10T14:32:11.394539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:11.408320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:11.408340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:11.408343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:11.408345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:11.408354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600848650046552:4385]
2025-10-10T14:32:11.408359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600848650046552:4385]
2025-10-10T14:32:11.408362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600848650046552:4385]
2025-10-10T14:32:11.408405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:11.408406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:11.408410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:11.408413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.408413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:11.408415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:11.408548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:11.409424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId: src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:11.411996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:11.466949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600849432257130:4813]
2025-10-10T14:32:11.467185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 476, pipe: [1:7559600849432257130:4813]
2025-10-10T14:32:11.511737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:11.512259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.512275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.512321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257130:4813], now have 1 active actors on pipe
2025-10-10T14:32:11.512486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:11.512539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:11.512548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600849432257130:4813]
2025-10-10T14:32:11.512553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:11.512567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:11.512629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 477 reason: error at write: Disconnected sessionId: src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0
2025-10-10T14:32:11.512838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 477 sessionId: src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0 is DEAD
2025-10-10T14:32:11.513045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:11.513058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0] Write session will restart in 0.005262s
2025-10-10T14:32:11.513084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0] Write session: Do CDS request
2025-10-10T14:32:11.513090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:11.519479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:11.519798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.519917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:11.519939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 478
2025-10-10T14:32:11.520085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.520121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:11.520134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:11.520139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:11.520528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 478 sessionId:  describe result for acl check
2025-10-10T14:32:11.520569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:11.520577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:11.520579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:11.520585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600849432257151:5264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:11.520867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:11.521000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:11.521011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:11.521019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:11.521052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:11.521065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600849432257151:5264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:11.521083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600848650046624:4387]
2025-10-10T14:32:11.521458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:11.521667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:11.521705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:11.521924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:11.521976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.521982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.521983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.521983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.521984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.521985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.521985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.521986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.521987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.521987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.521988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.521989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.521990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.521993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.522001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.522003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.522006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.522008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.522011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.522013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.522015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.522018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.522021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.522023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.522025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.522028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.522034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.522039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.522044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.522047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.522050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.522053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.522056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.522060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.522063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.522066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.522069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.522072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.522076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.522079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.522081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.522085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.522088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.522091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.522094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.522097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.522100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.522103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.522106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.522109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.522112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.522115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.522138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:11.523018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600849432257151:5264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:11.524179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:11.524464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:11.524478Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:11.524481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:11.524485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:11.524489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 477 [2:7559600848650046624:4387]
2025-10-10T14:32:11.524501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:11.524516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:11.524519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.524523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.524524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.524537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:11.524544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:11.524550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:11.524588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.524593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.524594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.524596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:11.524641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:11.524646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.524653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.524660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.524670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:11.524685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257132:2438], now have 1 active actors on pipe
2025-10-10T14:32:11.524694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600848650046619:4387]
2025-10-10T14:32:11.524696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600848650046619:4387]
2025-10-10T14:32:11.524697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600848650046619:4387]
2025-10-10T14:32:11.524708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:11.524723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:11.524727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:11.524729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:11.524730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:11.524742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:11.524751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:11.524769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600848650046619:4387]
2025-10-10T14:32:11.524778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:11.524784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:11.524800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 477
2025-10-10T14:32:11.525181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600849432257151:5264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:11.525195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600849432257151:5264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:11.525198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600849432257151:5264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:11.525205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:11.525359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257200:5264], now have 1 active actors on pipe
2025-10-10T14:32:11.525399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 477
2025-10-10T14:32:11.525445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.525454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.525483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56941386-a91f0c43-a509dacf-778a1739_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:11.525495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.525499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.525501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:11.525511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.525525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:11.525542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.525664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.525671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.525684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.525745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 478 partition: 0 MaxSeqNo: 40 sessionId: src_id|56941386-a91f0c43-a509dacf-778a1739_0
2025-10-10T14:32:11.526005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2718bb2-c0155dcb-7c5a43a6-8b59e25f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56941386-a91f0c43-a509dacf-778a1739_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:11.528766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56941386-a91f0c43-a509dacf-778a1739_0] Write session: try to update token
2025-10-10T14:32:11.528780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56941386-a91f0c43-a509dacf-778a1739_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:11.540963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:11.540980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:11.540989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600848650046619:4387]
2025-10-10T14:32:11.541032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:11.541039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:11.541204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:11.541371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:11.541520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:11.541665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:11.541849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:11.541892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:11.542019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId: src_id|56941386-a91f0c43-a509dacf-778a1739_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:11.544698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:11.544904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.544923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.544960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:11.545055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:11.551995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:11.552012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:11.552014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:11.552015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:11.552024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600848650046619:4387]
2025-10-10T14:32:11.552027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600848650046619:4387]
2025-10-10T14:32:11.552030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600848650046619:4387]
2025-10-10T14:32:11.552065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:11.552073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.552075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:11.552080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:11.552086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:11.552089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:11.552201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:11.612835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600849432257217:4813]
2025-10-10T14:32:11.613017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 477, pipe: [1:7559600849432257217:4813]
2025-10-10T14:32:11.656261Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:11.662911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.662936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.663091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.663146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.663203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.663262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.663311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.663321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.663387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.663442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.663501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.663566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.663611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.663616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.663674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.663747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.663801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.663893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.663932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.663938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.663997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.664051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.664114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.664169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.664206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.664211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.664267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.664318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.664384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.664439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.664477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.664483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.664537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.664593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.664651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.664704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.664742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.664748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.664806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.664866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.664926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.664981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.665018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.665023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.665079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.665143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.665200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.665259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.665348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.665355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.665416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.665467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.665521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.665575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.665617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.665625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.665683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:11.665734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:11.665788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:11.665853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:11.665907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:11.665912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:11.665950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257217:4813], now have 1 active actors on pipe
2025-10-10T14:32:11.666204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600849432257217:4813]
2025-10-10T14:32:11.666239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:11.666248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:11.666250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:11.666279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 478 reason: error at write: Disconnected sessionId: src_id|56941386-a91f0c43-a509dacf-778a1739_0
2025-10-10T14:32:11.666480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 478 sessionId: src_id|56941386-a91f0c43-a509dacf-778a1739_0 is DEAD
2025-10-10T14:32:11.666583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56941386-a91f0c43-a509dacf-778a1739_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:11.666594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56941386-a91f0c43-a509dacf-778a1739_0] Write session will restart in 0.009893s
2025-10-10T14:32:11.666615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56941386-a91f0c43-a509dacf-778a1739_0] Write session: Do CDS request
2025-10-10T14:32:11.666622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56941386-a91f0c43-a509dacf-778a1739_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:11.666741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:11.672246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:11.673297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:11.673498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:11.673507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:11.673516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:11.673560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:11.673592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600848650046684:4390]
2025-10-10T14:32:11.674002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:11.674220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:11.674262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:11.674504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:11.674544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.674548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.674549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.674550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.674550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.674551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.674552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.674553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.674553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.674554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.674555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.674556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.674556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.674560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.674569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.674572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.674576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.674586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.674588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.674590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.674593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.674595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.674597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.674599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.674602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.674604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.674610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.674615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.674620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.674623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.674638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.674643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.674649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.674653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.674657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.674662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.674666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.674671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.674676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.674681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.674685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.674690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.674693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.674696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.674698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.674703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.674705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.674708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.674711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.674714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.674716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.674719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.674741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:11.676831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:11.677130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:11.677141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:11.677142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:11.677144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:11.677149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 478 [2:7559600848650046684:4390]
2025-10-10T14:32:11.677156Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:11.677168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:11.677170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.677172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.677174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.677186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:11.677199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:11.677206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:11.677258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.677264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.677265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.677268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:11.677326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:11.677345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.677352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.677359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.677369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:11.677386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600848650046679:4390]
2025-10-10T14:32:11.677391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600848650046679:4390]
2025-10-10T14:32:11.677392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600848650046679:4390]
2025-10-10T14:32:11.677402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:11.677411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:11.677417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:11.677420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:11.677421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:11.677424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:11.677426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:11.677442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600848650046679:4390]
2025-10-10T14:32:11.677450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:11.677454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:11.677737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56941386-a91f0c43-a509dacf-778a1739_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.677839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:11.677853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 479
2025-10-10T14:32:11.677979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.678003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:11.678010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:11.678012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:11.678042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 478
2025-10-10T14:32:11.678035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257219:2438], now have 1 active actors on pipe
2025-10-10T14:32:11.678318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 479 sessionId:  describe result for acl check
2025-10-10T14:32:11.678341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:11.678346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:11.678348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:11.678352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600849432257245:5270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:11.678934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600849432257245:5270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:11.680932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600849432257245:5270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:11.686137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600849432257245:5270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:11.686148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600849432257245:5270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:11.686151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600849432257245:5270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:11.686157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:11.686369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257277:5270], now have 1 active actors on pipe
2025-10-10T14:32:11.686416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 478
2025-10-10T14:32:11.686484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.686495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.686537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f361e07d-d1256413-982acc2d-2a087ecf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:11.686553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.686558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.686562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:11.686579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.686598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:11.686620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.686815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.686825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.686840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.686924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 479 partition: 0 MaxSeqNo: 40 sessionId: src_id|f361e07d-d1256413-982acc2d-2a087ecf_0
2025-10-10T14:32:11.687237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56941386-a91f0c43-a509dacf-778a1739_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f361e07d-d1256413-982acc2d-2a087ecf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:11.689725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f361e07d-d1256413-982acc2d-2a087ecf_0] Write session: try to update token
2025-10-10T14:32:11.689738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f361e07d-d1256413-982acc2d-2a087ecf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:11.695144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:11.695161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:11.695164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:11.695166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:11.695177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600848650046679:4390]
2025-10-10T14:32:11.695181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600848650046679:4390]
2025-10-10T14:32:11.695184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600848650046679:4390]
2025-10-10T14:32:11.695227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:11.695229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:11.695234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:11.695238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:11.695240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.695242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:11.695371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:11.704132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId: src_id|f361e07d-d1256413-982acc2d-2a087ecf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:11.706339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:11.766463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600849432257280:4813]
2025-10-10T14:32:11.766742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 478, pipe: [1:7559600849432257280:4813]
2025-10-10T14:32:11.802921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:11.803156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.803167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.803187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257280:4813], now have 1 active actors on pipe
2025-10-10T14:32:11.803349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:11.803417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600849432257280:4813]
2025-10-10T14:32:11.803437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:11.803444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:11.803506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 479 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f361e07d-d1256413-982acc2d-2a087ecf_0
2025-10-10T14:32:11.803695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 479 sessionId: src_id|f361e07d-d1256413-982acc2d-2a087ecf_0 is DEAD
2025-10-10T14:32:11.803838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f361e07d-d1256413-982acc2d-2a087ecf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:11.803849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f361e07d-d1256413-982acc2d-2a087ecf_0] Write session will restart in 0.005582s
2025-10-10T14:32:11.803874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f361e07d-d1256413-982acc2d-2a087ecf_0] Write session: Do CDS request
2025-10-10T14:32:11.803880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f361e07d-d1256413-982acc2d-2a087ecf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:11.809878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:11.810810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f361e07d-d1256413-982acc2d-2a087ecf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.810897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:11.810909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 480
2025-10-10T14:32:11.811035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.811064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:11.811072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:11.811076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:11.811185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:11.811346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:11.811356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:11.811367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:11.811417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:11.811456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600848650046742:4392]
2025-10-10T14:32:11.811461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 480 sessionId:  describe result for acl check
2025-10-10T14:32:11.811497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:11.811502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:11.811504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:11.811509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600849432257302:5274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:11.812027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600849432257302:5274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:11.812036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:11.812293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:11.812329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:11.812561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:11.812610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.812616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.812616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.812617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.812618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.812619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.812619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.812620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.812621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.812621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.812622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.812623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.812624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.812628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.812636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.812638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.812641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.812646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.812650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.812653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.812657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.812661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.812665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.812669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.812672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.812676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.812682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.812690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.812697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.812702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.812706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.812709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.812713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.812716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.812720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.812725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.812729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.812734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.812739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.812744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.812747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.812759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.812764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.812770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.812774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.812781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.812785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.812790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.812795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.812802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.812806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.812811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.812837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:11.813773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600849432257302:5274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:11.814811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:11.815105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:11.815118Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:11.815121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:11.815124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:11.815129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 479 [2:7559600848650046742:4392]
2025-10-10T14:32:11.815139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:11.815154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:11.815162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.815165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.815168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.815183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:11.815196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:11.815209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:11.815260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.815266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.815269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.815271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:11.815326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:11.815333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.815344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.815355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.815371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:11.815389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257282:2438], now have 1 active actors on pipe
2025-10-10T14:32:11.815399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600848650046737:4392]
2025-10-10T14:32:11.815400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600848650046737:4392]
2025-10-10T14:32:11.815401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600848650046737:4392]
2025-10-10T14:32:11.815408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:11.815388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 479
2025-10-10T14:32:11.815415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:11.815417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:11.815418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:11.815420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:11.815429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:11.815436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:11.815463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600848650046737:4392]
2025-10-10T14:32:11.815473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:11.815484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:11.815615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600849432257302:5274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:11.815630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600849432257302:5274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:11.815633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600849432257302:5274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:11.815640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:11.815822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257338:5274], now have 1 active actors on pipe
2025-10-10T14:32:11.815852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 479
2025-10-10T14:32:11.815921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.815933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.815962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77284303-ba9f4022-adee94b4-6dade438_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:11.815975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.815979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.815983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:11.815994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.816012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:11.816031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.816187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.816195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.816210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.816285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 480 partition: 0 MaxSeqNo: 40 sessionId: src_id|77284303-ba9f4022-adee94b4-6dade438_0
2025-10-10T14:32:11.816570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f361e07d-d1256413-982acc2d-2a087ecf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77284303-ba9f4022-adee94b4-6dade438_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:11.819137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77284303-ba9f4022-adee94b4-6dade438_0] Write session: try to update token
2025-10-10T14:32:11.819152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77284303-ba9f4022-adee94b4-6dade438_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:11.831435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId: src_id|77284303-ba9f4022-adee94b4-6dade438_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:11.832733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:11.832750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:11.832753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:11.832755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:11.832768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600848650046737:4392]
2025-10-10T14:32:11.832772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600848650046737:4392]
2025-10-10T14:32:11.832776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600848650046737:4392]
2025-10-10T14:32:11.832819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:11.832822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:11.832828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.832829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:11.832830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:11.832833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:11.832965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:11.833862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:11.903656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600849432257366:4813]
2025-10-10T14:32:11.903762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 479, pipe: [1:7559600849432257366:4813]
2025-10-10T14:32:11.940107Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:11.940415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.940430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.940477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257366:4813], now have 1 active actors on pipe
2025-10-10T14:32:11.940711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:11.940718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:11.940731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:11.940752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600849432257366:4813]
2025-10-10T14:32:11.940772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:11.940786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 480 reason: error at write: Disconnected sessionId: src_id|77284303-ba9f4022-adee94b4-6dade438_0
2025-10-10T14:32:11.940995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 480 sessionId: src_id|77284303-ba9f4022-adee94b4-6dade438_0 is DEAD
2025-10-10T14:32:11.941123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77284303-ba9f4022-adee94b4-6dade438_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:11.941133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77284303-ba9f4022-adee94b4-6dade438_0] Write session will restart in 0.007343s
2025-10-10T14:32:11.941153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77284303-ba9f4022-adee94b4-6dade438_0] Write session: Do CDS request
2025-10-10T14:32:11.941157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77284303-ba9f4022-adee94b4-6dade438_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:11.947397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:11.948636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:11.948833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:11.948848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:11.948862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:11.948921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:11.948954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600848650046840:4407]
2025-10-10T14:32:11.949347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:11.949750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:11.949803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77284303-ba9f4022-adee94b4-6dade438_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.949802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:11.949877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:11.949890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 481
2025-10-10T14:32:11.949998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:11.950022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:11.950040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:11.950047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:11.950055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:11.950096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.950101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.950101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.950102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.950103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.950104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.950104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.950105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.950105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.950106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.950107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.950107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.950108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.950113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.950123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.950125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.950127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.950129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.950133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.950135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.950137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.950139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.950141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.950143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.950145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.950147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.950153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.950158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:11.950163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.950166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:11.950169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.950172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:11.950174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.950177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:11.950180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.950183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:11.950186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.950189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:11.950193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.950196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:11.950199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.950203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:11.950206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.950209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:11.950212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.950215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:11.950218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.950221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.950223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.950227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.950230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.950233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.950269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:11.950453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 481 sessionId:  describe result for acl check
2025-10-10T14:32:11.950491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:11.950493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:11.950494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:11.950500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600849432257395:5287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:11.951058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600849432257395:5287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:11.952554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:11.952875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:11.952887Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:11.952889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:11.952893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:11.952899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 480 [2:7559600848650046840:4407]
2025-10-10T14:32:11.952912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:11.952928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:11.952936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.952940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.952942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.952960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:11.952971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:11.952983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:11.953040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.953047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.953049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.953052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:11.953072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600849432257395:5287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:11.953122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:11.953129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.953141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:11.953153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:11.953175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:11.953199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257368:2438], now have 1 active actors on pipe
2025-10-10T14:32:11.953211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600848650046835:4407]
2025-10-10T14:32:11.953213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600848650046835:4407]
2025-10-10T14:32:11.953215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600848650046835:4407]
2025-10-10T14:32:11.953228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:11.953229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 480
2025-10-10T14:32:11.953246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:11.953249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:11.953253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:11.953257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:11.953267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:11.953270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:11.953296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600848650046835:4407]
2025-10-10T14:32:11.953306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:11.953321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:11.959041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600849432257395:5287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:11.959065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600849432257395:5287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:11.959068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600849432257395:5287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:11.959075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:11.959284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600849432257427:5287], now have 1 active actors on pipe
2025-10-10T14:32:11.959346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 480
2025-10-10T14:32:11.959412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.959423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.959456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1726e06-10796a0f-d170553-ecf34a5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:11.959472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:11.959481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:11.959484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:11.959498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:11.959515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:11.959539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.959689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:11.959696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:11.959709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:11.959782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 481 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1726e06-10796a0f-d170553-ecf34a5f_0
2025-10-10T14:32:11.960113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77284303-ba9f4022-adee94b4-6dade438_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1726e06-10796a0f-d170553-ecf34a5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:11.962749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1726e06-10796a0f-d170553-ecf34a5f_0] Write session: try to update token
2025-10-10T14:32:11.962767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1726e06-10796a0f-d170553-ecf34a5f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:11.972282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:11.972300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:11.972303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:11.972305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:11.972318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600848650046835:4407]
2025-10-10T14:32:11.972323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600848650046835:4407]
2025-10-10T14:32:11.972326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600848650046835:4407]
2025-10-10T14:32:11.972369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:11.972373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:11.972380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:11.972381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:11.972383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:11.972384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:11.972515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:11.975836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId: src_id|b1726e06-10796a0f-d170553-ecf34a5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:11.978463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:12.040906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600853727224727:4813]
2025-10-10T14:32:12.041238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 480, pipe: [1:7559600853727224727:4813]
2025-10-10T14:32:12.079900Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:12.080104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.080116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.080159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224727:4813], now have 1 active actors on pipe
2025-10-10T14:32:12.080339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:12.080386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600853727224727:4813]
2025-10-10T14:32:12.080392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:12.080396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:12.080414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:12.080468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 481 reason: error at write: Disconnected sessionId: src_id|b1726e06-10796a0f-d170553-ecf34a5f_0
2025-10-10T14:32:12.080679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 481 sessionId: src_id|b1726e06-10796a0f-d170553-ecf34a5f_0 is DEAD
2025-10-10T14:32:12.080826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1726e06-10796a0f-d170553-ecf34a5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:12.080836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1726e06-10796a0f-d170553-ecf34a5f_0] Write session will restart in 0.006277s
2025-10-10T14:32:12.080867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1726e06-10796a0f-d170553-ecf34a5f_0] Write session: Do CDS request
2025-10-10T14:32:12.080876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1726e06-10796a0f-d170553-ecf34a5f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:12.086827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:12.087773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1726e06-10796a0f-d170553-ecf34a5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.087844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:12.087855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 482
2025-10-10T14:32:12.087974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.088001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:12.088009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:12.088019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:12.088050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:12.088187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:12.088196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:12.088204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:12.088237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:12.088268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600852945014196:4409]
2025-10-10T14:32:12.088356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 482 sessionId:  describe result for acl check
2025-10-10T14:32:12.088391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:12.088398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:12.088399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:12.088405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600853727224750:5291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:12.088948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600853727224750:5291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:12.089021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:12.089263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:12.089295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:12.089551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:12.089599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.089605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.089607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.089608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.089609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.089611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.089612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.089613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.089614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.089616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.089617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.089618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.089620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.089625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.089634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.089636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.089640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.089642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.089645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.089647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.089649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.089651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.089654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.089655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.089657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.089659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.089664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.089669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.089674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.089677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.089680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.089683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.089685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.089688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.089691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.089694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.089696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.089700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.089702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.089705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.089710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.089714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.089716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.089719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.089721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.089724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.089727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.089730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.089733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.089736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.089738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.089741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.089763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:12.090966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600853727224750:5291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:12.091817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:12.092105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:12.092115Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:12.092117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:12.092121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:12.092125Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 481 [2:7559600852945014196:4409]
2025-10-10T14:32:12.092136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:12.092152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:12.092160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.092163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.092166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.092181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:12.092193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:12.092201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:12.092254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.092261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.092262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.092265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:12.092323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:12.092330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.092341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.092356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.092377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:12.092402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224728:2438], now have 1 active actors on pipe
2025-10-10T14:32:12.092395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 481
2025-10-10T14:32:12.092415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600852945014191:4409]
2025-10-10T14:32:12.092421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600852945014191:4409]
2025-10-10T14:32:12.092423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600852945014191:4409]
2025-10-10T14:32:12.092431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:12.092440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:12.092444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:12.092456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:12.092458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:12.092461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:12.092464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:12.092490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600852945014191:4409]
2025-10-10T14:32:12.092503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:12.092508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:12.093704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600853727224750:5291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:12.093717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600853727224750:5291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:12.093720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600853727224750:5291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:12.093726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:12.093903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224788:5291], now have 1 active actors on pipe
2025-10-10T14:32:12.093934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 481
2025-10-10T14:32:12.093994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.094005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.094036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:12.094049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.094052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.094054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:12.094064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.094075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:12.094088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.094224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.094229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.094240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.094301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 482 partition: 0 MaxSeqNo: 40 sessionId: src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0
2025-10-10T14:32:12.094567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1726e06-10796a0f-d170553-ecf34a5f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:12.097031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0] Write session: try to update token
2025-10-10T14:32:12.097044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:12.109127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId: src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:12.111131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:12.111142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.111144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:12.111146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:12.111152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600852945014191:4409]
2025-10-10T14:32:12.111158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600852945014191:4409]
2025-10-10T14:32:12.111160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600852945014191:4409]
2025-10-10T14:32:12.111197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:12.111200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:12.111203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.111205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:12.111206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:12.111209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:12.111332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:12.111435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:12.180638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600853727224804:4813]
2025-10-10T14:32:12.180896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 481, pipe: [1:7559600853727224804:4813]
2025-10-10T14:32:12.214089Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:12.214324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.214336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.214379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224804:4813], now have 1 active actors on pipe
2025-10-10T14:32:12.214575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:12.214593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:12.214596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:12.214630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600853727224804:4813]
2025-10-10T14:32:12.214671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 482 reason: error at write: Disconnected sessionId: src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0
2025-10-10T14:32:12.214815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:12.214858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 482 sessionId: src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0 is DEAD
2025-10-10T14:32:12.215040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:12.215052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0] Write session will restart in 0.008523s
2025-10-10T14:32:12.215076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0] Write session: Do CDS request
2025-10-10T14:32:12.215083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:12.221478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:12.222664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:12.222814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:12.222822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:12.222831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:12.222870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:12.222903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600852945014270:4412]
2025-10-10T14:32:12.223320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:12.223567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:12.223596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:12.223810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:12.223850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.223855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.223855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.223856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.223857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.223857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.223858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.223859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.223860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.223860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.223861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.223861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.223862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.223866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.223875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.223877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.223879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.223883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.223885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.223887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.223890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.223892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.223894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.223896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.223898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.223900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.223906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.223911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.223916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.223922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.223925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.223928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.223934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.223937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.223939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.223942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.223945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.223948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.223951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.223954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.223960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.223963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.223966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.223970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.223975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.223978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.223981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.223984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.223990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.223993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.223996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.224002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.224025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:12.224852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.224920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:12.224932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 483
2025-10-10T14:32:12.225045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.225069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:12.225078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:12.225081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:12.225634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 483 sessionId:  describe result for acl check
2025-10-10T14:32:12.225670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:12.225679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:12.225681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:12.225687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600853727224832:5296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:12.226048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:12.226302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600853727224832:5296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:12.226339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:12.226349Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:12.226351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:12.226355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:12.226360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 482 [2:7559600852945014270:4412]
2025-10-10T14:32:12.226368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:12.226382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:12.226390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.226393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.226395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.226412Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:12.226423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:12.226436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:12.226483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.226488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.226489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.226491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:12.226540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:12.226546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.226552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.226558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.226567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:12.226583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224805:2438], now have 1 active actors on pipe
2025-10-10T14:32:12.226592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600852945014265:4412]
2025-10-10T14:32:12.226593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600852945014265:4412]
2025-10-10T14:32:12.226594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600852945014265:4412]
2025-10-10T14:32:12.226603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:12.226612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:12.226609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 482
2025-10-10T14:32:12.226617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:12.226620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:12.226621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:12.226622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:12.226624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:12.226657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600852945014265:4412]
2025-10-10T14:32:12.226666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:12.226672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:12.227902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600853727224832:5296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:12.232097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600853727224832:5296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:12.232112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600853727224832:5296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:12.232115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600853727224832:5296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:12.232123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:12.232322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224866:5296], now have 1 active actors on pipe
2025-10-10T14:32:12.232361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 482
2025-10-10T14:32:12.232415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.232427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.232455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:12.232468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.232478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.232480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:12.232491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.232504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:12.232523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.232647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.232655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.232668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.232724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 483 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0
2025-10-10T14:32:12.232987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f229a5a-4c79fdd9-81fdc740-23925a41_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:12.235387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0] Write session: try to update token
2025-10-10T14:32:12.235399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:12.242329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:12.242342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.242351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600852945014265:4412]
2025-10-10T14:32:12.242389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:12.242404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:12.243152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:12.243608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.243736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.243863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.244042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:12.244078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:12.248905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId: src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:12.251167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:12.251306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.251323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.251362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:12.251626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:12.253159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:12.253173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.253176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:12.253180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:12.253189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600852945014265:4412]
2025-10-10T14:32:12.253193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600852945014265:4412]
2025-10-10T14:32:12.253196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600852945014265:4412]
2025-10-10T14:32:12.253236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:12.253241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:12.253246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:12.253249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.253250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:12.253251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:12.253397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:12.314821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600853727224870:4813]
2025-10-10T14:32:12.315059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 482, pipe: [1:7559600853727224870:4813]
2025-10-10T14:32:12.357741Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:12.364387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.364413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.364583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.364643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.364701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.364759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.364910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.364920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.364989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.365042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.365097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.365157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.365197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.365202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.365260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.365313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.365385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.365439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.365478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.365484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.365544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.365599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.365656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.365711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.365751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.365756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.365818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.365872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.365979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.366081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.366118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.366123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.366180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.366230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.366285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.366338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.366376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.366381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.366437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.366487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.366544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.366597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.366646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.366653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.366707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.366758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.366813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.366883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.366922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.366927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.366982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.367032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.367085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.367137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.367174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.367179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.367233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.367281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.367332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.367382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.367420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.367425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.367464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224870:4813], now have 1 active actors on pipe
2025-10-10T14:32:12.367670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600853727224870:4813]
2025-10-10T14:32:12.367699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:12.367710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:12.367715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:12.367745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 483 reason: error at write: Disconnected sessionId: src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0
2025-10-10T14:32:12.367963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 483 sessionId: src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0 is DEAD
2025-10-10T14:32:12.368114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:12.368122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0] Write session will restart in 0.007731s
2025-10-10T14:32:12.368142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0] Write session: Do CDS request
2025-10-10T14:32:12.368147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:12.368195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:12.375473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:12.375823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:12.375950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:12.375959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:12.375967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:12.376003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:12.376039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600852945014333:4414]
2025-10-10T14:32:12.376432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:12.376647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:12.376677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:12.376741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.376878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:12.376857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:12.376871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 484
2025-10-10T14:32:12.376912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.376916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.376917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.376917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.376918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.376919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.376919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.376920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.376921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.376921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.376922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.376923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.376924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.376928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.376937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.376940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.376942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.376944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.376947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.376949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.376951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.376953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.376963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.376957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.376959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.376962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.376963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.376969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.376974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.376979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.376982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.376984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.376987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.376991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.376994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.376995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:12.376997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.377002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:12.377005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:12.377000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.377002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.377005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.377008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.377010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.377013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.377016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.377019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.377022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.377024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.377027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.377030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.377035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.377038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.377044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.377051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.377056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.377087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:12.377355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 484 sessionId:  describe result for acl check
2025-10-10T14:32:12.377380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:12.377386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:12.377387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:12.377391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600853727224899:5300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:12.377822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600853727224899:5300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:12.379124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:12.379431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:12.379442Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:12.379445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:12.379448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:12.379453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 483 [2:7559600852945014333:4414]
2025-10-10T14:32:12.379464Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:12.379479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:12.379486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.379489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.379491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.379505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:12.379517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:12.379524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:12.379570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.379576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.379578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.379582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:12.379641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:12.379648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.379659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.379675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.379696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:12.379688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 483
2025-10-10T14:32:12.379719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224871:2438], now have 1 active actors on pipe
2025-10-10T14:32:12.379733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600852945014328:4414]
2025-10-10T14:32:12.379739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600852945014328:4414]
2025-10-10T14:32:12.379741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600852945014328:4414]
2025-10-10T14:32:12.379754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:12.379766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:12.379770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:12.379774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:12.379776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:12.379786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:12.379789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:12.379812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600852945014328:4414]
2025-10-10T14:32:12.379792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600853727224899:5300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:12.379823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:12.379829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:12.384374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600853727224899:5300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:12.384389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600853727224899:5300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:12.384392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600853727224899:5300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:12.384399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:12.384658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224933:5300], now have 1 active actors on pipe
2025-10-10T14:32:12.384697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 483
2025-10-10T14:32:12.384767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.384777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.384809Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16024023-3cfc830-e8ee24fb-60c9e46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:12.384825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.384830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.384833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:12.384846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.384866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:12.384885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.385068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.385075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.385088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.385167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 484 partition: 0 MaxSeqNo: 40 sessionId: src_id|16024023-3cfc830-e8ee24fb-60c9e46_0
2025-10-10T14:32:12.385488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ee5ce-5b86151d-9d16f95e-a51a7b22_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|16024023-3cfc830-e8ee24fb-60c9e46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:12.388143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16024023-3cfc830-e8ee24fb-60c9e46_0] Write session: try to update token
2025-10-10T14:32:12.388160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16024023-3cfc830-e8ee24fb-60c9e46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:12.390262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:12.390278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.390288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600852945014328:4414]
2025-10-10T14:32:12.390317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:12.390323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:12.390492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:12.390626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.390762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.390895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.391073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:12.391107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:12.401762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId: src_id|16024023-3cfc830-e8ee24fb-60c9e46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:12.404105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:12.404282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.404300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.404343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:12.404417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:12.406622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:12.406646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.406649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:12.406650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:12.406660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600852945014328:4414]
2025-10-10T14:32:12.406664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600852945014328:4414]
2025-10-10T14:32:12.406668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600852945014328:4414]
2025-10-10T14:32:12.406709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:12.406710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:12.406715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:12.406717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:12.406720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.406723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:12.406850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:12.467907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600853727224936:4813]
2025-10-10T14:32:12.468152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 483, pipe: [1:7559600853727224936:4813]
2025-10-10T14:32:12.510116Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:12.516506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.516526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.516666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.516721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.516773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.516834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.516884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.516894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.516959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.517007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.517059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.517144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.517186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.517192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.517248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.517298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.517365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.517458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.517495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.517502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.517605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.517704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.517824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.517932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.517970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.517976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.518085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.518137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.518190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.518242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.518278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.518283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.518337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.518392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.518457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.518520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.518564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.518570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.518621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.518679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.518730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.518780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.518817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.518824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.518879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.518928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.518979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.519032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.519068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.519073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.519122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.519176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.519227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.519275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.519310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.519315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.519367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.519416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.519469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.519518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.519557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.519562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.519596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224936:4813], now have 1 active actors on pipe
2025-10-10T14:32:12.519793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:12.519806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:12.519830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 484 reason: error at write: Disconnected sessionId: src_id|16024023-3cfc830-e8ee24fb-60c9e46_0
2025-10-10T14:32:12.519846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:12.519891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600853727224936:4813]
2025-10-10T14:32:12.520002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 484 sessionId: src_id|16024023-3cfc830-e8ee24fb-60c9e46_0 is DEAD
2025-10-10T14:32:12.520163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16024023-3cfc830-e8ee24fb-60c9e46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:12.520178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16024023-3cfc830-e8ee24fb-60c9e46_0] Write session will restart in 0.007211s
2025-10-10T14:32:12.520199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16024023-3cfc830-e8ee24fb-60c9e46_0] Write session: Do CDS request
2025-10-10T14:32:12.520204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16024023-3cfc830-e8ee24fb-60c9e46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:12.520282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:12.526366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:12.527535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:12.527678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:12.527686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:12.527694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:12.527740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:12.527773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600852945014397:4416]
2025-10-10T14:32:12.528174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:12.528417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:12.528449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:12.528692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:12.528732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.528736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.528737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.528738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.528739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.528740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.528740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.528741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.528742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.528742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.528743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.528743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.528745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.528749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.528757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.528759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.528761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.528763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.528766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.528768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.528770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.528773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.528777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.528781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.528784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.528788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.528795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.528807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.528818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.528827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.528833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.528836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.528839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.528848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.528852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.528862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.528870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.528874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16024023-3cfc830-e8ee24fb-60c9e46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.528876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.528884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.528889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.528894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.528879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:12.528899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.528891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 485
2025-10-10T14:32:12.528907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.528912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.528915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.528917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.528920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.528923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.528925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.528929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.528934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.528937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.528958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:12.529186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.529219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:12.529227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:12.529230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:12.529604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 485 sessionId:  describe result for acl check
2025-10-10T14:32:12.529638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:12.529644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:12.529646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:12.529652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600853727224967:5304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:12.530172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600853727224967:5304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:12.530967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:12.531236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:12.531246Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:12.531247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:12.531250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:12.531253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 484 [2:7559600852945014397:4416]
2025-10-10T14:32:12.531260Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:12.531272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:12.531273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.531275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.531277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.531286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:12.531291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:12.531297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:12.531330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.531335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.531336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.531339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:12.531384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:12.531389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.531396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.531406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.531416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:12.531434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600852945014392:4416]
2025-10-10T14:32:12.531439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600852945014392:4416]
2025-10-10T14:32:12.531441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600852945014392:4416]
2025-10-10T14:32:12.531449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:12.531454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:12.531456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:12.531457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:12.531465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:12.531479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:12.531487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:12.531507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727224938:2438], now have 1 active actors on pipe
2025-10-10T14:32:12.531513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600852945014392:4416]
2025-10-10T14:32:12.531520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:12.531515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 484
2025-10-10T14:32:12.531525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:12.532089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600853727224967:5304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:12.537657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600853727224967:5304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:12.537669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600853727224967:5304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:12.537672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600853727224967:5304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:12.537677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:12.537879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225001:5304], now have 1 active actors on pipe
2025-10-10T14:32:12.537900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 484
2025-10-10T14:32:12.537977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.537988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.538021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f975220a-bfcbb085-cac7c010-65b11d42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:12.538036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.538042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.538044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:12.538057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.538071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:12.538090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.538243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.538251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.538266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.538335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 485 partition: 0 MaxSeqNo: 40 sessionId: src_id|f975220a-bfcbb085-cac7c010-65b11d42_0
2025-10-10T14:32:12.538674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16024023-3cfc830-e8ee24fb-60c9e46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f975220a-bfcbb085-cac7c010-65b11d42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:12.541816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f975220a-bfcbb085-cac7c010-65b11d42_0] Write session: try to update token
2025-10-10T14:32:12.541831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f975220a-bfcbb085-cac7c010-65b11d42_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:12.541941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:12.541956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.541964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600852945014392:4416]
2025-10-10T14:32:12.541997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:12.542004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:12.542177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:12.542320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.542460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.542607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.542810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:12.542845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:12.557376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId: src_id|f975220a-bfcbb085-cac7c010-65b11d42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:12.558340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:12.558356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.558361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:12.558362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:12.558370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600852945014392:4416]
2025-10-10T14:32:12.558373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600852945014392:4416]
2025-10-10T14:32:12.558376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600852945014392:4416]
2025-10-10T14:32:12.558411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:12.558418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.558419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:12.558556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:12.558618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:12.558626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:12.558629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:12.559978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:12.619933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600853727225014:4813]
2025-10-10T14:32:12.620172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 484, pipe: [1:7559600853727225014:4813]
2025-10-10T14:32:12.659099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:12.659390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.659403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.659422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225014:4813], now have 1 active actors on pipe
2025-10-10T14:32:12.659587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:12.659635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:12.659648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:12.659716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 485 reason: error at write: Disconnected sessionId: src_id|f975220a-bfcbb085-cac7c010-65b11d42_0
2025-10-10T14:32:12.659735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600853727225014:4813]
2025-10-10T14:32:12.659754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:12.659905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 485 sessionId: src_id|f975220a-bfcbb085-cac7c010-65b11d42_0 is DEAD
2025-10-10T14:32:12.660085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f975220a-bfcbb085-cac7c010-65b11d42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:12.660091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f975220a-bfcbb085-cac7c010-65b11d42_0] Write session will restart in 0.006767s
2025-10-10T14:32:12.660109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f975220a-bfcbb085-cac7c010-65b11d42_0] Write session: Do CDS request
2025-10-10T14:32:12.660118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f975220a-bfcbb085-cac7c010-65b11d42_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:12.665930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:12.667249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:12.667396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:12.667405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:12.667414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:12.667453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:12.667482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600852945014464:4419]
2025-10-10T14:32:12.667735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f975220a-bfcbb085-cac7c010-65b11d42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.667850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:12.667850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:12.667860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 486
2025-10-10T14:32:12.667971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.667993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:12.668001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:12.668004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:12.668102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:12.668135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:12.668317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 486 sessionId:  describe result for acl check
2025-10-10T14:32:12.668348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:12.668355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:12.668357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:12.668362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600853727225044:5310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:12.668403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:12.668453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.668458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.668460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.668461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.668461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.668462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.668463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.668463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.668464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.668465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.668465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.668466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.668466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.668470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.668478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.668480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.668482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.668484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.668486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.668488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.668490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.668492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.668494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.668496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.668498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.668501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.668507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.668512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.668517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.668520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.668524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.668527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.668529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.668533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.668537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.668540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.668543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.668549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.668553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.668562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.668567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.668578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.668586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.668593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.668602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.668607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.668619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.668624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.668628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.668633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.668638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.668643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.668683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:12.668790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600853727225044:5310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:12.670169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600853727225044:5310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:12.670722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:12.671008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:12.671018Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:12.671020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:12.671022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:12.671026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 485 [2:7559600852945014464:4419]
2025-10-10T14:32:12.671034Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:12.671044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:12.671046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.671050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.671051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.671062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:12.671071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:12.671081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:12.671114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.671118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.671119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.671121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:12.671163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:12.671170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.671176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.671185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.671197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:12.671214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600852945014459:4419]
2025-10-10T14:32:12.671218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600852945014459:4419]
2025-10-10T14:32:12.671219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600852945014459:4419]
2025-10-10T14:32:12.671229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:12.671241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:12.671242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:12.671245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:12.671246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:12.671253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:12.671255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:12.671268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600852945014459:4419]
2025-10-10T14:32:12.671276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:12.671280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:12.671802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 485
2025-10-10T14:32:12.671821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225016:2438], now have 1 active actors on pipe
2025-10-10T14:32:12.675581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600853727225044:5310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:12.675596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600853727225044:5310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:12.675599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600853727225044:5310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:12.675606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:12.675816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225080:5310], now have 1 active actors on pipe
2025-10-10T14:32:12.675848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 485
2025-10-10T14:32:12.675929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.675938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.675967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|823da388-91685287-c49fc2ec-b3bad226_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:12.675981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.675989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.675991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:12.676003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.676019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:12.676036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.676183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.676192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.676207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.676295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 486 partition: 0 MaxSeqNo: 40 sessionId: src_id|823da388-91685287-c49fc2ec-b3bad226_0
2025-10-10T14:32:12.676568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f975220a-bfcbb085-cac7c010-65b11d42_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|823da388-91685287-c49fc2ec-b3bad226_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:12.679263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|823da388-91685287-c49fc2ec-b3bad226_0] Write session: try to update token
2025-10-10T14:32:12.679278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|823da388-91685287-c49fc2ec-b3bad226_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:12.681452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:12.681462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.681470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600852945014459:4419]
2025-10-10T14:32:12.681507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:12.681510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:12.681667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:12.681802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.681935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.682066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:12.682243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:12.682281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:12.693383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId: src_id|823da388-91685287-c49fc2ec-b3bad226_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:12.695745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:12.695948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.695966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.696004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:12.696072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:12.698070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:12.698084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.698087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:12.698088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:12.698098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600852945014459:4419]
2025-10-10T14:32:12.698100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600852945014459:4419]
2025-10-10T14:32:12.698103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600852945014459:4419]
2025-10-10T14:32:12.698133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:12.698138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:12.698143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.698144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:12.698145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:12.698148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:12.698271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:12.759743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600853727225083:4813]
2025-10-10T14:32:12.759986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 485, pipe: [1:7559600853727225083:4813]
2025-10-10T14:32:12.798158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:12.804404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.804423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.804570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.804623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.804684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.804740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.805054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.805063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.805123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.805177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.805231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.805290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.805343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.805349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.805405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.805458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.805514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.805568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.805605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.805614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.805676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.805749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.805816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.805874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.805916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.805921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.805977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.806026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.806081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.806135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.806174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.806179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.806235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.806286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.806339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.806389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.806430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.806436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.806491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.806543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.806597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.806659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.806786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.806792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.806848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.806900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.807007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.807062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.807100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.807105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.807159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.807210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.807264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.807318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.807354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.807359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.807414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:12.807467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:12.807519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:12.807573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:12.807610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:12.807615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:12.807654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225083:4813], now have 1 active actors on pipe
2025-10-10T14:32:12.807845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:12.807900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:12.807905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:12.807936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:12.807933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 486 reason: error at write: Disconnected sessionId: src_id|823da388-91685287-c49fc2ec-b3bad226_0
2025-10-10T14:32:12.807933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600853727225083:4813]
2025-10-10T14:32:12.808123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 486 sessionId: src_id|823da388-91685287-c49fc2ec-b3bad226_0 is DEAD
2025-10-10T14:32:12.808315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|823da388-91685287-c49fc2ec-b3bad226_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:12.808326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|823da388-91685287-c49fc2ec-b3bad226_0] Write session will restart in 0.005642s
2025-10-10T14:32:12.808350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|823da388-91685287-c49fc2ec-b3bad226_0] Write session: Do CDS request
2025-10-10T14:32:12.808356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|823da388-91685287-c49fc2ec-b3bad226_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:12.814757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|823da388-91685287-c49fc2ec-b3bad226_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.814909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:12.814921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 487
2025-10-10T14:32:12.815080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:12.815095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.815160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:12.815166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:12.815171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:12.815552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 487 sessionId:  describe result for acl check
2025-10-10T14:32:12.815590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:12.815598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:12.815600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:12.815606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600853727225112:5314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:12.816137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600853727225112:5314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:12.816325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:12.816484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:12.816495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:12.816504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:12.816545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:12.816585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600852945014529:4421]
2025-10-10T14:32:12.817100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:12.817353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:12.817392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:12.817699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:12.817750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.817757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.817758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.817759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.817761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.817762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.817763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.817764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.817765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.817766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.817767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.817769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.817770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.817775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.817787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.817791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.817794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.817799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.817802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.817807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.817810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.817814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.817818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.817822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.817825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.817829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.817835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.817843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.817850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.817856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.817862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.817872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.817876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.817880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.817890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.817895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.817899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.817904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.817913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.817917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.817921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.817930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.817934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.817939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.817947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.817952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.817956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.817965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.817970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.817975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.817983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.817988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.818029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:12.818984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600853727225112:5314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:12.820205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:12.820502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:12.820511Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:12.820512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:12.820515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:12.820521Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 486 [2:7559600852945014529:4421]
2025-10-10T14:32:12.820530Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:12.820549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:12.820557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.820560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.820567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.820580Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:12.820589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:12.820595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:12.820640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.820647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.820649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.820651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:12.820713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:12.820721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.820732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.820744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.820757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:12.820778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225085:2438], now have 1 active actors on pipe
2025-10-10T14:32:12.820791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600852945014524:4421]
2025-10-10T14:32:12.820797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600852945014524:4421]
2025-10-10T14:32:12.820799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600852945014524:4421]
2025-10-10T14:32:12.820811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:12.820823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:12.820828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:12.820832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:12.820834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:12.820842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:12.820846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:12.820835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 486
2025-10-10T14:32:12.820866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600852945014524:4421]
2025-10-10T14:32:12.820873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:12.820875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:12.821308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600853727225112:5314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:12.821323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600853727225112:5314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:12.821326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600853727225112:5314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:12.821347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:12.821512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225148:5314], now have 1 active actors on pipe
2025-10-10T14:32:12.821535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 486
2025-10-10T14:32:12.821589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.821600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.821631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:12.821643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.821646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.821648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:12.821659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.821673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:12.821689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.821802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.821808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.821822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.821886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 487 partition: 0 MaxSeqNo: 40 sessionId: src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0
2025-10-10T14:32:12.822222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|823da388-91685287-c49fc2ec-b3bad226_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:12.825289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0] Write session: try to update token
2025-10-10T14:32:12.825306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:12.838424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:12.838440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.838443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:12.838448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:12.838458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600852945014524:4421]
2025-10-10T14:32:12.838463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600852945014524:4421]
2025-10-10T14:32:12.838466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600852945014524:4421]
2025-10-10T14:32:12.838502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:12.838502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:12.838506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:12.838510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:12.838512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.838514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:12.838652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:12.839639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId: src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:12.842626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:12.908219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600853727225157:4813]
2025-10-10T14:32:12.908421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 486, pipe: [1:7559600853727225157:4813]
2025-10-10T14:32:12.942697Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:12.942876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.942890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.942930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225157:4813], now have 1 active actors on pipe
2025-10-10T14:32:12.943059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:12.943027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:12.943052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:12.943058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:12.943077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600853727225157:4813]
2025-10-10T14:32:12.943127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 487 reason: error at write: Disconnected sessionId: src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0
2025-10-10T14:32:12.943367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 487 sessionId: src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0 is DEAD
2025-10-10T14:32:12.943484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:12.943503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0] Write session will restart in 0.005038s
2025-10-10T14:32:12.943521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0] Write session: Do CDS request
2025-10-10T14:32:12.943525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:12.949833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.949817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:12.949831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 488
2025-10-10T14:32:12.950034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:12.950070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:12.950082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:12.950086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:12.950228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:12.950527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 488 sessionId:  describe result for acl check
2025-10-10T14:32:12.950574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:12.950582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:12.950584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:12.950590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600853727225208:5327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:12.951181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600853727225208:5327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:12.951545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:12.951760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:12.951772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:12.951785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:12.951841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:12.951874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600852945014634:4436]
2025-10-10T14:32:12.952352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:12.952586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:12.952616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:12.952839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:12.952879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.952883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.952884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.952885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.952886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.952887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.952888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.952888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.952889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.952889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.952890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.952891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.952891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.952895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.952903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.952905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.952908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.952910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.952912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.952914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.952916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.952919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.952921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.952923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.952925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.952927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.952933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.952938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:12.952944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.952947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:12.952950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.952953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:12.952955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.952958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:12.952961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.952964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:12.952967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.952970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:12.952972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.952975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:12.952977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.952980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:12.952982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.952985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:12.952987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.952990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:12.952993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.952995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.952998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.953001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.953003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.953006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.953029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:12.953121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600853727225208:5327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:12.955216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:12.955380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600853727225208:5327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:12.955393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600853727225208:5327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:12.955396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600853727225208:5327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:12.955403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:12.955486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:12.955496Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:12.955498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:12.955500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:12.955505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 487 [2:7559600852945014634:4436]
2025-10-10T14:32:12.955512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:12.955524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:12.955530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.955533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.955536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.955563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:12.955571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:12.955577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:12.955621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.955628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.955629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.955632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:12.955691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:12.955698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.955705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:12.955711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:12.955720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:12.955739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225180:2438], now have 1 active actors on pipe
2025-10-10T14:32:12.955745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600853727225240:5327], now have 1 active actors on pipe
2025-10-10T14:32:12.955751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600852945014629:4436]
2025-10-10T14:32:12.955752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600852945014629:4436]
2025-10-10T14:32:12.955754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600852945014629:4436]
2025-10-10T14:32:12.955763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:12.955778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:12.955787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:12.955788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:12.955790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:12.955769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 487
2025-10-10T14:32:12.955791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:12.955793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:12.955819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.955775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 487
2025-10-10T14:32:12.955826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.955837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600852945014629:4436]
2025-10-10T14:32:12.955846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:12.955856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:12.955874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdd93d18-aa193840-ee834f9d-75a63902_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:12.955886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:12.955889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:12.955890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:12.955898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:12.955906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:12.955927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.956025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:12.956031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:12.956042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:12.956107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 488 partition: 0 MaxSeqNo: 40 sessionId: src_id|fdd93d18-aa193840-ee834f9d-75a63902_0
2025-10-10T14:32:12.956396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbed783-17575d97-ffe52cfa-4d56fe7e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fdd93d18-aa193840-ee834f9d-75a63902_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:12.959146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd93d18-aa193840-ee834f9d-75a63902_0] Write session: try to update token
2025-10-10T14:32:12.959161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd93d18-aa193840-ee834f9d-75a63902_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:12.974262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:12.974280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:12.974282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:12.974283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:12.974291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600852945014629:4436]
2025-10-10T14:32:12.974296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600852945014629:4436]
2025-10-10T14:32:12.974299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600852945014629:4436]
2025-10-10T14:32:12.974331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:12.974336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:12.974337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:12.974339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:12.974345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:12.974346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:12.974477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:12.975383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId: src_id|fdd93d18-aa193840-ee834f9d-75a63902_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:12.977935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:13.043366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600858022192544:4813]
2025-10-10T14:32:13.043626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 487, pipe: [1:7559600858022192544:4813]
2025-10-10T14:32:13.077861Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:13.078133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.078146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.078184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192544:4813], now have 1 active actors on pipe
2025-10-10T14:32:13.078383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:13.078411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600858022192544:4813]
2025-10-10T14:32:13.078427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:13.078429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:13.078490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 488 reason: error at write: Disconnected sessionId: src_id|fdd93d18-aa193840-ee834f9d-75a63902_0
2025-10-10T14:32:13.078689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 488 sessionId: src_id|fdd93d18-aa193840-ee834f9d-75a63902_0 is DEAD
2025-10-10T14:32:13.078688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:13.078843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd93d18-aa193840-ee834f9d-75a63902_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:13.078856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd93d18-aa193840-ee834f9d-75a63902_0] Write session will restart in 0.009221s
2025-10-10T14:32:13.078877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd93d18-aa193840-ee834f9d-75a63902_0] Write session: Do CDS request
2025-10-10T14:32:13.078884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd93d18-aa193840-ee834f9d-75a63902_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:13.084863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:13.086092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:13.086265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:13.086274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:13.086283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:13.086320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:13.086359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600857239981997:4438]
2025-10-10T14:32:13.086800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:13.087035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:13.087079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:13.087323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:13.087361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.087366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.087367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.087368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.087368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.087369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.087370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.087371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.087371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.087372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.087373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.087373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.087374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.087378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.087388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.087390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.087393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.087395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.087397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.087400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.087402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.087404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.087406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.087409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.087412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.087414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.087420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.087426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.087431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.087435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.087437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.087441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.087444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.087447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.087450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.087453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.087455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.087459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.087461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.087465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.087468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.087473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.087478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.087483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.087486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.087491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.087496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.087500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.087506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.087512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.087515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.087518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.087541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:13.088938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd93d18-aa193840-ee834f9d-75a63902_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.088983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:13.088996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 489
2025-10-10T14:32:13.089222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.089249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:13.089257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:13.089260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:13.089620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:13.089665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 489 sessionId:  describe result for acl check
2025-10-10T14:32:13.089697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:13.089703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:13.089704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:13.089708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600858022192578:5331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:13.089915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:13.089926Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:13.089928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:13.089930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:13.089935Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 488 [2:7559600857239981997:4438]
2025-10-10T14:32:13.089942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:13.089954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:13.089956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.089959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.089961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.089973Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:13.089978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:13.089984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:13.090022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.090027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.090028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.090030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:13.090092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:13.090098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.090117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.090127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.090137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:13.090150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600858022192578:5331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:13.090156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192545:2438], now have 1 active actors on pipe
2025-10-10T14:32:13.090166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600857239981992:4438]
2025-10-10T14:32:13.090167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600857239981992:4438]
2025-10-10T14:32:13.090168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600857239981992:4438]
2025-10-10T14:32:13.090176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 488
2025-10-10T14:32:13.090178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:13.090192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:13.090193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:13.090195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:13.090196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:13.090204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:13.090206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:13.090227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600857239981992:4438]
2025-10-10T14:32:13.090235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:13.090246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:13.091770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600858022192578:5331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:13.096555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600858022192578:5331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:13.096570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600858022192578:5331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:13.096574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600858022192578:5331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:13.096583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:13.096790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192612:5331], now have 1 active actors on pipe
2025-10-10T14:32:13.096837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 488
2025-10-10T14:32:13.096881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.096892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.096921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:13.096934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.096940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.096942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:13.096951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.096967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:13.096998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.097130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.097137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.097163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.097244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 489 partition: 0 MaxSeqNo: 40 sessionId: src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0
2025-10-10T14:32:13.097591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd93d18-aa193840-ee834f9d-75a63902_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:13.099957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0] Write session: try to update token
2025-10-10T14:32:13.099972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:13.100673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:13.100685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.100692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600857239981992:4438]
2025-10-10T14:32:13.100727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:13.100729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:13.100874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:13.100997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.101119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.101241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.101428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:13.101456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:13.112202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId: src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:13.114460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:13.114651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.114670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.114709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:13.114789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:13.116761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:13.116776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.116780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:13.116781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:13.116795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600857239981992:4438]
2025-10-10T14:32:13.116798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600857239981992:4438]
2025-10-10T14:32:13.116801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600857239981992:4438]
2025-10-10T14:32:13.116836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:13.116840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:13.116843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:13.116847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:13.116855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.116858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:13.116993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:13.178555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600858022192628:4813]
2025-10-10T14:32:13.178812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 488, pipe: [1:7559600858022192628:4813]
2025-10-10T14:32:13.218064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:13.224402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.224422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.224564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.224616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.224672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.224728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.225007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.225016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.225082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.225188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.225243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.225296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.225344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.225350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.225407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.225460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.225515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.225569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.225616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.225621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.225674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.225727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.225780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.225832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.225874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.225879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.225932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.225983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.226053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.226105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.226148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.226156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.226214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.226266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.226319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.226373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.226411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.226416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.226470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.226521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.226576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.226631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.226683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.226688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.226743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.226792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.226846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.226910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.226949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.226954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.227008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.227059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.227110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.227165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.227202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.227210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.227273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.227326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.227377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.227431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.227478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.227486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.227522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192628:4813], now have 1 active actors on pipe
2025-10-10T14:32:13.227746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600858022192628:4813]
2025-10-10T14:32:13.227752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:13.228045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:13.228051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:13.228074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 489 reason: error at write: Disconnected sessionId: src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0
2025-10-10T14:32:13.228095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:13.228253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 489 sessionId: src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0 is DEAD
2025-10-10T14:32:13.228379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:13.228389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0] Write session will restart in 0.007698s
2025-10-10T14:32:13.228407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0] Write session: Do CDS request
2025-10-10T14:32:13.228412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:13.234669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:13.235007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:13.235159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:13.235170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:13.235181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:13.235234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:13.235276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600857239982078:4441]
2025-10-10T14:32:13.235672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:13.236175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:13.236214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:13.236430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:13.236483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.236488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.236489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.236490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.236491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.236493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.236494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.236494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.236496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.236497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.236498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.236499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.236500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.236507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.236520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.236525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.236529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.236532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.236536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.236540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.236545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.236549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.236553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.236557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.236561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.236565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.236574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.236582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.236590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.236596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.236600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.236607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.236611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.236616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.236621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.236630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.236634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.236639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.236644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.236650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.236655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.236660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.236665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.236670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.236678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.236683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.236687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.236692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.236697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.236703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.236710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.236715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.236762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.236758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:13.236832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:13.236846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 490
2025-10-10T14:32:13.237050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.237074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:13.237082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:13.237084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:13.237419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 490 sessionId:  describe result for acl check
2025-10-10T14:32:13.237444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:13.237445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:13.237446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:13.237450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600858022192663:5336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:13.237842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600858022192663:5336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:13.238763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:13.239065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:13.239076Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:13.239077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:13.239081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:13.239086Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 489 [2:7559600857239982078:4441]
2025-10-10T14:32:13.239098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:13.239114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:13.239117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.239120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.239123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.239137Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:13.239146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:13.239155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:13.239198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.239205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.239207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.239209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:13.239269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:13.239276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.239286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.239297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.239315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:13.239337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600857239982073:4441]
2025-10-10T14:32:13.239343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600857239982073:4441]
2025-10-10T14:32:13.239345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600857239982073:4441]
2025-10-10T14:32:13.239359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:13.239367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:13.239370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:13.239371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:13.239374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:13.239391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:13.239398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:13.239419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600857239982073:4441]
2025-10-10T14:32:13.239429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:13.239432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:13.239584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192629:2438], now have 1 active actors on pipe
2025-10-10T14:32:13.239596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600858022192663:5336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:13.239625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 489
2025-10-10T14:32:13.243626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600858022192663:5336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:13.243640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600858022192663:5336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:13.243644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600858022192663:5336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:13.243651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:13.243935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192704:5336], now have 1 active actors on pipe
2025-10-10T14:32:13.243983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 489
2025-10-10T14:32:13.244030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.244038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.244068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:13.244082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.244091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.244094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:13.244106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.244124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:13.244138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.244277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.244283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.244297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.244362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 490 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0
2025-10-10T14:32:13.244629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae37ce-8c6b8f50-6e0b9e5e-b53d58ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:13.247069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0] Write session: try to update token
2025-10-10T14:32:13.247083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:13.256512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:13.256526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.256528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:13.256533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:13.256540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600857239982073:4441]
2025-10-10T14:32:13.256545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600857239982073:4441]
2025-10-10T14:32:13.256547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600857239982073:4441]
2025-10-10T14:32:13.256581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:13.256589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:13.256591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.256592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:13.256595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:13.256599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:13.256714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:13.259351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId: src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:13.261589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:13.328075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600858022192709:4813]
2025-10-10T14:32:13.328335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 489, pipe: [1:7559600858022192709:4813]
2025-10-10T14:32:13.358753Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:13.358972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.358983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.359026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192709:4813], now have 1 active actors on pipe
2025-10-10T14:32:13.359245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:13.359292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600858022192709:4813]
2025-10-10T14:32:13.359318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:13.359337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:13.359419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 490 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0
2025-10-10T14:32:13.359634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 490 sessionId: src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0 is DEAD
2025-10-10T14:32:13.359780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:13.359792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0] Write session will restart in 0.007076s
2025-10-10T14:32:13.359819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0] Write session: Do CDS request
2025-10-10T14:32:13.359834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:13.365572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:13.367019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:13.367180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:13.367191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:13.367201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:13.367249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:13.367289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600857239982150:4443]
2025-10-10T14:32:13.367926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.368022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:13.368035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 491
2025-10-10T14:32:13.368065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:13.368275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.368300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:13.368305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:13.368308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:13.368362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:13.368395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:13.368733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:13.368780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.368785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.368786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.368787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.368788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.368788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.368789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.368790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.368790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.368791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.368792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.368792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.368793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.368797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.368806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.368809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.368811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.368813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.368816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.368818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.368820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.368823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.368825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.368827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.368830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.368832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.368838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.368826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 491 sessionId:  describe result for acl check
2025-10-10T14:32:13.368844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.368850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.368854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.368864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:13.368856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.368860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.368868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:13.368863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.368870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:13.368866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.368870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.368877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600858022192752:5340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:13.368874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.368876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.368880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.368882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.368885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.368888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.368891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.368893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.368897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.368899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.368903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.368905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.368908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.368911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.368914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.368920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.368923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.368945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:13.369414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600858022192752:5340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:13.371140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:13.371468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:13.371478Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:13.371480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:13.371482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:13.371487Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 490 [2:7559600857239982150:4443]
2025-10-10T14:32:13.371496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:13.371510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:13.371514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.371516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.371519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.371539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:13.371513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600858022192752:5340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:13.371546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:13.371553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:13.371593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.371599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.371600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.371602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:13.371653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:13.371658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.371665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.371671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.371690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:13.371716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192710:2438], now have 1 active actors on pipe
2025-10-10T14:32:13.371726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600857239982145:4443]
2025-10-10T14:32:13.371727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600857239982145:4443]
2025-10-10T14:32:13.371728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600857239982145:4443]
2025-10-10T14:32:13.371738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:13.371749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:13.371758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:13.371762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:13.371764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:13.371765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:13.371767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:13.371785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600857239982145:4443]
2025-10-10T14:32:13.371792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:13.371770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 490
2025-10-10T14:32:13.371792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:13.376336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600858022192752:5340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:13.376351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600858022192752:5340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:13.376354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600858022192752:5340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:13.376362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:13.376623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192787:5340], now have 1 active actors on pipe
2025-10-10T14:32:13.376671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 490
2025-10-10T14:32:13.376737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.376745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.376772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|712bb077-66c0cf45-3371fc5-930e01db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:13.376786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.376795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.376798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:13.376812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.376832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:13.376852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.377048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.377066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.377087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.377163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 491 partition: 0 MaxSeqNo: 40 sessionId: src_id|712bb077-66c0cf45-3371fc5-930e01db_0
2025-10-10T14:32:13.377524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed0efde-9d8d6dfb-ea5365d9-48d7b384_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|712bb077-66c0cf45-3371fc5-930e01db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:13.380119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712bb077-66c0cf45-3371fc5-930e01db_0] Write session: try to update token
2025-10-10T14:32:13.380133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712bb077-66c0cf45-3371fc5-930e01db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:13.382262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:13.382276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.382284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600857239982145:4443]
2025-10-10T14:32:13.382321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:13.382327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:13.382474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:13.382607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.382745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.382873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.383063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:13.383098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:13.393784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId: src_id|712bb077-66c0cf45-3371fc5-930e01db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:13.396161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:13.396526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.396545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.396589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:13.396688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:13.399129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:13.399144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.399147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:13.399148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:13.399156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600857239982145:4443]
2025-10-10T14:32:13.399162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600857239982145:4443]
2025-10-10T14:32:13.399164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600857239982145:4443]
2025-10-10T14:32:13.399201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:13.399209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:13.399212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.399214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:13.399213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:13.399218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:13.399337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:13.459635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600858022192791:4813]
2025-10-10T14:32:13.459927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 490, pipe: [1:7559600858022192791:4813]
2025-10-10T14:32:13.499093Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:13.505138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.505157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.505302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.505367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.505425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.505478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.505518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.505526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.505583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.505643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.505701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.505758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.505798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.505803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.505859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.505909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.505963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.506019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.506056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.506061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.506116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.506169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.506223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.506276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.506314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.506322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.506374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.506427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.506483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.506540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.506577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.506584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.506639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.506698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.506752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.506808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.506847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.506852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.506908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.506963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.507018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.507076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.507119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.507126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.507182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.507235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.507289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.507348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.507386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.507391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.507448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.507502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.507556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.507612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.507650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.507655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.507711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.507766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.507819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.507874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.507911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.507916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.507953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192791:4813], now have 1 active actors on pipe
2025-10-10T14:32:13.508228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600858022192791:4813]
2025-10-10T14:32:13.508250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:13.508254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:13.508255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:13.508284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 491 reason: error at write: Disconnected sessionId: src_id|712bb077-66c0cf45-3371fc5-930e01db_0
2025-10-10T14:32:13.508511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 491 sessionId: src_id|712bb077-66c0cf45-3371fc5-930e01db_0 is DEAD
2025-10-10T14:32:13.508599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:13.508645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712bb077-66c0cf45-3371fc5-930e01db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:13.508665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712bb077-66c0cf45-3371fc5-930e01db_0] Write session will restart in 0.005521s
2025-10-10T14:32:13.508685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712bb077-66c0cf45-3371fc5-930e01db_0] Write session: Do CDS request
2025-10-10T14:32:13.508691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712bb077-66c0cf45-3371fc5-930e01db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:13.515402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:13.515823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712bb077-66c0cf45-3371fc5-930e01db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.515910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:13.515924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 492
2025-10-10T14:32:13.516044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.516076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:13.516085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:13.516089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:13.516481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 492 sessionId:  describe result for acl check
2025-10-10T14:32:13.516517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:13.516524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:13.516527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:13.516533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600858022192824:5344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:13.516744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:13.516914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:13.516923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:13.516938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:13.516982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:13.517009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600857239982220:4445]
2025-10-10T14:32:13.517043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600858022192824:5344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:13.517442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:13.517850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:13.517886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:13.518136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:13.518178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.518182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.518183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.518183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.518184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.518185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.518186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.518186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.518187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.518188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.518188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.518189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.518189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.518193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.518202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.518204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.518206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.518208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.518210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.518213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.518215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.518217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.518219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.518221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.518223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.518225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.518229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.518234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.518239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.518243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.518245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.518259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.518261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.518264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.518267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.518269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.518272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.518275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.518277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.518280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.518283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.518286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.518288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.518291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.518294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.518297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.518300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.518303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.518305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.518308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.518310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.518314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.518334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:13.519180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600858022192824:5344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:13.520340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:13.520617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:13.520625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:13.520627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:13.520629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:13.520633Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 491 [2:7559600857239982220:4445]
2025-10-10T14:32:13.520640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:13.520658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:13.520663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.520665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.520667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.520679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:13.520687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:13.520692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:13.520733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.520739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.520740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.520741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:13.520784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:13.520789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.520798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.520806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.520817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:13.520834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600857239982215:4445]
2025-10-10T14:32:13.520841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600857239982215:4445]
2025-10-10T14:32:13.520842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600857239982215:4445]
2025-10-10T14:32:13.520848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:13.520858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192792:2438], now have 1 active actors on pipe
2025-10-10T14:32:13.520860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:13.520864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:13.520864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:13.520866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:13.520874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:13.520876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:13.520891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600857239982215:4445]
2025-10-10T14:32:13.520899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:13.520909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:13.520904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 491
2025-10-10T14:32:13.521068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600858022192824:5344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:13.521079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600858022192824:5344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:13.521083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600858022192824:5344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:13.521090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:13.521263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192860:5344], now have 1 active actors on pipe
2025-10-10T14:32:13.521312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 491
2025-10-10T14:32:13.521367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.521373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.521394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|901607e8-aa8d6951-f4b09462-d19884fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:13.521404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.521409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.521410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:13.521418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.521426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:13.521436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.521561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.521567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.521577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.521651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 492 partition: 0 MaxSeqNo: 40 sessionId: src_id|901607e8-aa8d6951-f4b09462-d19884fb_0
2025-10-10T14:32:13.521895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712bb077-66c0cf45-3371fc5-930e01db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|901607e8-aa8d6951-f4b09462-d19884fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:13.524229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901607e8-aa8d6951-f4b09462-d19884fb_0] Write session: try to update token
2025-10-10T14:32:13.524241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901607e8-aa8d6951-f4b09462-d19884fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:13.531583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:13.531598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.531609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600857239982215:4445]
2025-10-10T14:32:13.531655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:13.531668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:13.531817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:13.531943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.532060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.532189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.532354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:13.532395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:13.536834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId: src_id|901607e8-aa8d6951-f4b09462-d19884fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:13.539074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:13.539263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.539277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.539306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:13.539380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:13.548157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:13.548169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.548171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:13.548174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:13.548182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600857239982215:4445]
2025-10-10T14:32:13.548185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600857239982215:4445]
2025-10-10T14:32:13.548188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600857239982215:4445]
2025-10-10T14:32:13.548221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:13.548220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:13.548226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:13.548226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.548228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:13.548229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:13.548413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:13.608640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600858022192873:4813]
2025-10-10T14:32:13.608909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 491, pipe: [1:7559600858022192873:4813]
2025-10-10T14:32:13.649018Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:13.655578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.655597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.655748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.655810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.655867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.655923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.656020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.656030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.656097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.656155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.656211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.656269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.656316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.656324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.656386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.656437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.656496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.656557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.656600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.656606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.656666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.656720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.656775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.656837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.656877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.656883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.656940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.656995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.657049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.657113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.657152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.657157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.657219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.657272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.657347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.657406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.657446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.657451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.657510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.657562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.657626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.657686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.657723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.657728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.657794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.657897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.657953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.658006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.658047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.658054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.658116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.658171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.658226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.658283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.658323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.658329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.658392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:13.658445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:13.658496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:13.658551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:13.658592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:13.658601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:13.658644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192873:4813], now have 1 active actors on pipe
2025-10-10T14:32:13.658887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:13.658945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:13.658967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:13.658999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 492 reason: error at write: Disconnected sessionId: src_id|901607e8-aa8d6951-f4b09462-d19884fb_0
2025-10-10T14:32:13.659114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600858022192873:4813]
2025-10-10T14:32:13.659187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 492 sessionId: src_id|901607e8-aa8d6951-f4b09462-d19884fb_0 is DEAD
2025-10-10T14:32:13.659334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901607e8-aa8d6951-f4b09462-d19884fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:13.659350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901607e8-aa8d6951-f4b09462-d19884fb_0] Write session will restart in 0.005406s
2025-10-10T14:32:13.659368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901607e8-aa8d6951-f4b09462-d19884fb_0] Write session: Do CDS request
2025-10-10T14:32:13.659350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:13.659373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901607e8-aa8d6951-f4b09462-d19884fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:13.665742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901607e8-aa8d6951-f4b09462-d19884fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.665846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:13.665854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:13.665869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 493
2025-10-10T14:32:13.666004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.666052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:13.666062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:13.666066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:13.666507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 493 sessionId:  describe result for acl check
2025-10-10T14:32:13.666543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:13.666551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:13.666553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:13.666559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600858022192910:5350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:13.667065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600858022192910:5350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:13.667267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:13.667424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:13.667433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:13.667441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:13.667478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:13.667510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600857239982294:4448]
2025-10-10T14:32:13.667918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:13.668108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:13.668136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:13.668347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:13.668387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.668391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.668392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.668393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.668393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.668395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.668396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.668397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.668397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.668398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.668398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.668399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.668400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.668403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.668411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.668413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.668416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.668418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.668420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.668423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.668425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.668427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.668429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.668431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.668434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.668436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.668441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.668446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.668451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.668454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.668456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.668460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.668462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.668465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.668468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.668471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.668476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.668479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.668482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.668485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.668487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.668490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.668493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.668497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.668500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.668503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.668505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.668508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.668511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.668514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.668516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.668519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.668541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:13.669093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600858022192910:5350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:13.670657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:13.670942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:13.670950Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:13.670951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:13.670953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:13.670958Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 492 [2:7559600857239982294:4448]
2025-10-10T14:32:13.670967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:13.670979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:13.670982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.670984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.670985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.670997Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:13.671002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:13.671007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:13.671043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.671048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.671050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.671052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:13.671098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:13.671104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.671110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.671116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.671125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:13.671144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192877:2438], now have 1 active actors on pipe
2025-10-10T14:32:13.671155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600857239982289:4448]
2025-10-10T14:32:13.671158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600857239982289:4448]
2025-10-10T14:32:13.671160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600857239982289:4448]
2025-10-10T14:32:13.671170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:13.671182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:13.671187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:13.671180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 492
2025-10-10T14:32:13.671193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:13.671193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:13.671195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:13.671195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:13.671210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600857239982289:4448]
2025-10-10T14:32:13.671212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:13.671223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:13.671617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600858022192910:5350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:13.671631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600858022192910:5350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:13.671635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600858022192910:5350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:13.671642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:13.671815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192946:5350], now have 1 active actors on pipe
2025-10-10T14:32:13.671862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 492
2025-10-10T14:32:13.671916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.671931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.671953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:13.671963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.671966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.671968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:13.671978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.671987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:13.672001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.672111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.672116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.672126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.672204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 493 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0
2025-10-10T14:32:13.672495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901607e8-aa8d6951-f4b09462-d19884fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:13.675055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0] Write session: try to update token
2025-10-10T14:32:13.675071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:13.688503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId: src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:13.689380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:13.689394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.689397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:13.689400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:13.689409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600857239982289:4448]
2025-10-10T14:32:13.689414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600857239982289:4448]
2025-10-10T14:32:13.689418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600857239982289:4448]
2025-10-10T14:32:13.689467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:13.689472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:13.689474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.689476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:13.689480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:13.689484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:13.689609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:13.691009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:13.759156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600858022192952:4813]
2025-10-10T14:32:13.759400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 492, pipe: [1:7559600858022192952:4813]
2025-10-10T14:32:13.789211Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:13.789577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.789595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.789635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192952:4813], now have 1 active actors on pipe
2025-10-10T14:32:13.789869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:13.789909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:13.789911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:13.789918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600858022192952:4813]
2025-10-10T14:32:13.789969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 493 reason: error at write: Disconnected sessionId: src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0
2025-10-10T14:32:13.789946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:13.790190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 493 sessionId: src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0 is DEAD
2025-10-10T14:32:13.790319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:13.790326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0] Write session will restart in 0.005814s
2025-10-10T14:32:13.790354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0] Write session: Do CDS request
2025-10-10T14:32:13.790362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:13.796730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.796797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:13.796860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:13.796879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 494
2025-10-10T14:32:13.796980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.797004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:13.797012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:13.797016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:13.797421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 494 sessionId:  describe result for acl check
2025-10-10T14:32:13.797462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:13.797469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:13.797471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:13.797476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600858022192987:5354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:13.798006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600858022192987:5354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:13.798151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:13.798287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:13.798298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:13.798309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:13.798357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:13.798398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600857239982366:4450]
2025-10-10T14:32:13.798783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:13.798995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:13.799033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:13.799251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:13.799299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.799304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.799306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.799307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.799308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.799309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.799310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.799311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.799314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.799315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.799317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.799318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.799319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.799324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.799336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.799340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.799345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.799349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.799353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.799357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.799360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.799364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.799370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.799375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.799379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.799382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.799390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.799399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.799409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.799415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.799419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.799428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.799432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.799438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.799443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.799452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.799455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.799461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.799465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.799471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.799478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.799483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.799487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.799492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.799496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.799502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.799507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.799513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.799517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.799522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.799526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.799532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.799570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:13.799677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600858022192987:5354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:13.801477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:13.801587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600858022192987:5354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:13.801601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600858022192987:5354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:13.801604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600858022192987:5354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:13.801610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:13.801769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:13.801779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:13.801781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:13.801785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:13.801789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 493 [2:7559600857239982366:4450]
2025-10-10T14:32:13.801800Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:13.801815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:13.801818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.801821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.801823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.801838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:13.801849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:13.801856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:13.801901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.801906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.801908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.801910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:13.801967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:13.801974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.801985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.801997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.802018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:13.802041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022193020:5354], now have 1 active actors on pipe
2025-10-10T14:32:13.802047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022192953:2438], now have 1 active actors on pipe
2025-10-10T14:32:13.802054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600857239982361:4450]
2025-10-10T14:32:13.802041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 493
2025-10-10T14:32:13.802057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600857239982361:4450]
2025-10-10T14:32:13.802059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600857239982361:4450]
2025-10-10T14:32:13.802050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 493
2025-10-10T14:32:13.802067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:13.802079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:13.802081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:13.802087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:13.802089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:13.802097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:13.802100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:13.802115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.802124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.802155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600857239982361:4450]
2025-10-10T14:32:13.802166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:13.802172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:13.802182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:13.802190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.802197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.802199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:13.802209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.802220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:13.802267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.802390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.802410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.802431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.802510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 494 partition: 0 MaxSeqNo: 40 sessionId: src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0
2025-10-10T14:32:13.802781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e233a81-9ea5fc4b-481207bd-3e01270c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:13.805207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0] Write session: try to update token
2025-10-10T14:32:13.805222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:13.817571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId: src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:13.819994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:13.819999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:13.820015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.820018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:13.820019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:13.820026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600857239982361:4450]
2025-10-10T14:32:13.820029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600857239982361:4450]
2025-10-10T14:32:13.820034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600857239982361:4450]
2025-10-10T14:32:13.820077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:13.820082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:13.820083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:13.820086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:13.820091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.820095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:13.820254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:13.890241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600858022193028:4813]
2025-10-10T14:32:13.890494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 493, pipe: [1:7559600858022193028:4813]
2025-10-10T14:32:13.920411Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:13.920662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.920674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.920712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022193028:4813], now have 1 active actors on pipe
2025-10-10T14:32:13.920910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:13.920973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600858022193028:4813]
2025-10-10T14:32:13.920993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:13.920997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:13.920999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:13.921061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 494 reason: error at write: Disconnected sessionId: src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0
2025-10-10T14:32:13.921283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 494 sessionId: src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0 is DEAD
2025-10-10T14:32:13.921464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:13.921475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0] Write session will restart in 0.005517s
2025-10-10T14:32:13.921499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0] Write session: Do CDS request
2025-10-10T14:32:13.921506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:13.927496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:13.927777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.927834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:13.927846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 495
2025-10-10T14:32:13.927985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:13.928029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:13.928040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:13.928044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:13.928431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 495 sessionId:  describe result for acl check
2025-10-10T14:32:13.928464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:13.928470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:13.928472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:13.928478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600858022193065:5358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:13.928927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:13.929025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600858022193065:5358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:13.929092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:13.929104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:13.929115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:13.929167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:13.929208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600857239982439:4452]
2025-10-10T14:32:13.929616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:13.929898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:13.929926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:13.930139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:13.930178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.930183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.930183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.930184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.930185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.930186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.930186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.930187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.930188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.930188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.930189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.930189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.930190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.930194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.930202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.930204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.930207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.930209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.930211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.930213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.930215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.930217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.930220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.930222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.930224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.930226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.930233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.930238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:13.930243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.930246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:13.930249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.930252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:13.930254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.930258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:13.930260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.930263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:13.930266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.930269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:13.930272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.930275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:13.930278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.930285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:13.930288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.930291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:13.930294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.930297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:13.930299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.930302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.930305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.930308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.930311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.930313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.930336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:13.930958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600858022193065:5358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:13.932379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:13.932675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:13.932684Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:13.932686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:13.932688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:13.932692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 494 [2:7559600857239982439:4452]
2025-10-10T14:32:13.932701Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:13.932714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:13.932719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.932721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.932723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.932734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:13.932743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:13.932751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:13.932793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.932798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.932799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.932801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:13.932847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:13.932854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.932860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:13.932868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:13.932878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:13.932896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022193030:2438], now have 1 active actors on pipe
2025-10-10T14:32:13.932905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600857239982434:4452]
2025-10-10T14:32:13.932907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600857239982434:4452]
2025-10-10T14:32:13.932908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600857239982434:4452]
2025-10-10T14:32:13.932920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:13.932937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:13.932936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:13.932939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:13.932941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:13.932933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 494
2025-10-10T14:32:13.932955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:13.932961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:13.932980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600857239982434:4452]
2025-10-10T14:32:13.932989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:13.932995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:13.933196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600858022193065:5358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:13.933209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600858022193065:5358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:13.933212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600858022193065:5358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:13.933218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:13.933385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600858022193101:5358], now have 1 active actors on pipe
2025-10-10T14:32:13.933444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 494
2025-10-10T14:32:13.933487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.933494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.933514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:13.933523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:13.933526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:13.933533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:13.933541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:13.933554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:13.933568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.933706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.933712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.933722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:13.933781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 495 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0
2025-10-10T14:32:13.934021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c1313d-2aef2509-acdcf2e4-8da83bea_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:13.936548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0] Write session: try to update token
2025-10-10T14:32:13.936561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:13.943872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:13.943886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.943894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600857239982434:4452]
2025-10-10T14:32:13.943930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:13.943944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:13.944106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:13.944236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.944378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.944513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:13.944691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:13.944724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:13.949354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId: src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:13.951808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:13.951989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:13.952007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:13.952053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:13.952128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:13.960387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:13.960403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:13.960405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:13.960406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:13.960413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600857239982434:4452]
2025-10-10T14:32:13.960417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600857239982434:4452]
2025-10-10T14:32:13.960419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600857239982434:4452]
2025-10-10T14:32:13.960453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:13.960459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:13.960460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:13.960469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:13.960484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:13.960488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:13.960592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:14.021325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600862317160427:4813]
2025-10-10T14:32:14.021633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 494, pipe: [1:7559600862317160427:4813]
2025-10-10T14:32:14.064488Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:14.070910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.070930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.071080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.071134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.071190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.071286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.071328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.071335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.071397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.071452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.071512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.071570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.071611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.071616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.071676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.071732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.071803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.071867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.071905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.071911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.071971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.072024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.072081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.072138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.072179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.072184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.072245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.072305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.072362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.072419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.072457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.072464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.072524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.072580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.072637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.072695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.072736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.072744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.072809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.072904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.072963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.073022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.073063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.073073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.073134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.073186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.073241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.073300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.073354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.073362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.073419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.073471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.073528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.073583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.073624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.073629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.073687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.073741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.073795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.073850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.073892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.073898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.073948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160427:4813], now have 1 active actors on pipe
2025-10-10T14:32:14.074207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600862317160427:4813]
2025-10-10T14:32:14.074248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:14.074251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:14.074281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 495 reason: error at write: Disconnected sessionId: src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0
2025-10-10T14:32:14.074493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 495 sessionId: src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0 is DEAD
2025-10-10T14:32:14.074641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:14.074663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0] Write session will restart in 0.005437s
2025-10-10T14:32:14.074688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0] Write session: Do CDS request
2025-10-10T14:32:14.074694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:14.074738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:14.074762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:14.080755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.080837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:14.080850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 496
2025-10-10T14:32:14.080976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.081009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:14.081021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:14.081024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:14.081565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 496 sessionId:  describe result for acl check
2025-10-10T14:32:14.081598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:14.081605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:14.081606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:14.081613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600862317160464:5371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:14.081770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:14.082136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600862317160464:5371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:14.083120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:14.083249Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:14.083258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:14.083267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:14.083312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:14.083343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600861534949847:4467]
2025-10-10T14:32:14.083736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:14.084015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:14.084066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:14.084176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600862317160464:5371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:14.084305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:14.084362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.084369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.084370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.084371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.084372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.084373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.084375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.084376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.084377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.084377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.084378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.084379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.084379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.084384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.084391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.084393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.084395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.084397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.084406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.084408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.084410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.084412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.084415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.084417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.084419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.084421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.084426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.084431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.084436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.084439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.084442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.084444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.084448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.084451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.084454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.084457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.084460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.084463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.084466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.084469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.084471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.084474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.084477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.084479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.084482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.084485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.084488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.084491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.084493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.084496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.084499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.084502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.084523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:14.086422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600862317160464:5371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:14.086435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600862317160464:5371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:14.086438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600862317160464:5371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:14.086444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:14.086530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:14.086907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:14.086917Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:14.086918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:14.086921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:14.086926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 495 [2:7559600861534949847:4467]
2025-10-10T14:32:14.086936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:14.086947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:14.086949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.086951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.086952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.086967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:14.086976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:14.086982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:14.087021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.087026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.087027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.087029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:14.087077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:14.087082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.087089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.087099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.087112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:14.087127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160499:5371], now have 1 active actors on pipe
2025-10-10T14:32:14.087133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160428:2438], now have 1 active actors on pipe
2025-10-10T14:32:14.087139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600861534949842:4467]
2025-10-10T14:32:14.087143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600861534949842:4467]
2025-10-10T14:32:14.087144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600861534949842:4467]
2025-10-10T14:32:14.087154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:14.087166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:14.087179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:14.087178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:14.087181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:14.087181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:14.087183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:14.087200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600861534949842:4467]
2025-10-10T14:32:14.087203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:14.087188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 495
2025-10-10T14:32:14.087197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 495
2025-10-10T14:32:14.087225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.087227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:14.087233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.087260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:14.087269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.087271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.087273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:14.087280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.087287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:14.087298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.087478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.087484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.087495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.087585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 496 partition: 0 MaxSeqNo: 40 sessionId: src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0
2025-10-10T14:32:14.087840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8e81c6-8438ebd9-49c99056-60893ddf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:14.090408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0] Write session: try to update token
2025-10-10T14:32:14.090423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:14.103210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId: src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:14.105451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:14.105467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:14.105469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:14.105471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:14.105479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600861534949842:4467]
2025-10-10T14:32:14.105482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600861534949842:4467]
2025-10-10T14:32:14.105486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600861534949842:4467]
2025-10-10T14:32:14.105523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:14.105524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:14.105529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:14.105532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:14.105533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.105535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:14.105654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:14.105719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:14.174416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600862317160518:4813]
2025-10-10T14:32:14.174705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 495, pipe: [1:7559600862317160518:4813]
2025-10-10T14:32:14.205525Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:14.205733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.205745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.205783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160518:4813], now have 1 active actors on pipe
2025-10-10T14:32:14.205981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:14.206000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:14.206004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600862317160518:4813]
2025-10-10T14:32:14.206016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:14.206021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:14.206080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 496 reason: error at write: Disconnected sessionId: src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0
2025-10-10T14:32:14.206275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 496 sessionId: src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0 is DEAD
2025-10-10T14:32:14.206444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:14.206453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0] Write session will restart in 0.005346s
2025-10-10T14:32:14.206472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0] Write session: Do CDS request
2025-10-10T14:32:14.206479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:14.212760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.212870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:14.212885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 497
2025-10-10T14:32:14.212987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.213021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:14.213032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:14.213035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:14.213435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 497 sessionId:  describe result for acl check
2025-10-10T14:32:14.213466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:14.213473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:14.213474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:14.213478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600862317160554:5376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:14.213741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:14.213883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600862317160554:5376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:14.215116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:14.215256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:14.215265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:14.215273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:14.215309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:14.215338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600861534949934:4470]
2025-10-10T14:32:14.215663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600862317160554:5376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:14.215693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:14.215895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:14.215932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:14.216141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:14.216175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.216179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.216180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.216181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.216181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.216182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.216183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.216183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.216184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.216184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.216185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.216185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.216186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.216190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.216196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.216199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.216201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.216205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.216207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.216209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.216211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.216214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.216216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.216218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.216221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.216223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.216227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.216232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.216236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.216239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.216242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.216244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.216247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.216251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.216253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.216256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.216259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.216262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.216269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.216273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.216275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.216283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.216285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.216288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.216290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.216293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.216299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.216302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.216304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.216307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.216310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.216312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.216334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:14.218178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600862317160554:5376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:14.218189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600862317160554:5376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:14.218199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600862317160554:5376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:14.218205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:14.218236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:14.218524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:14.218534Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:14.218535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:14.218539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:14.218543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 496 [2:7559600861534949934:4470]
2025-10-10T14:32:14.218550Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:14.218564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:14.218569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.218571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.218573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.218584Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:14.218594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:14.218603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:14.218643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.218648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.218649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.218659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:14.218718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:14.218723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.218729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.218739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.218752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:14.218770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160519:2438], now have 1 active actors on pipe
2025-10-10T14:32:14.218775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160590:5376], now have 1 active actors on pipe
2025-10-10T14:32:14.218780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600861534949929:4470]
2025-10-10T14:32:14.218781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600861534949929:4470]
2025-10-10T14:32:14.218782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600861534949929:4470]
2025-10-10T14:32:14.218791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:14.218811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:14.218812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:14.218815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:14.218817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:14.218824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:14.218826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:14.218839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600861534949929:4470]
2025-10-10T14:32:14.218844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:14.218846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:14.218822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 496
2025-10-10T14:32:14.218824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 496
2025-10-10T14:32:14.218864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.218869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.218897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:14.218905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.218911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.218912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:14.218920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.218931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:14.218949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.219091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.219096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.219106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.219196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 497 partition: 0 MaxSeqNo: 40 sessionId: src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0
2025-10-10T14:32:14.219440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c3b9c2-2ca8a873-2990ca85-aee9054a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:14.221959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0] Write session: try to update token
2025-10-10T14:32:14.221973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:14.234556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId: src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:14.236417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:14.236433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:14.236435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:14.236437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:14.236456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600861534949929:4470]
2025-10-10T14:32:14.236460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600861534949929:4470]
2025-10-10T14:32:14.236464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600861534949929:4470]
2025-10-10T14:32:14.236509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:14.236514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:14.236519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:14.236521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.236522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:14.236522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:14.236686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:14.237028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:14.305998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600862317160598:4813]
2025-10-10T14:32:14.306299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 496, pipe: [1:7559600862317160598:4813]
2025-10-10T14:32:14.337581Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:14.337886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.337902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.337945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160598:4813], now have 1 active actors on pipe
2025-10-10T14:32:14.338106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:14.338173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:14.338177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:14.338181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:14.338221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600862317160598:4813]
2025-10-10T14:32:14.338238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 497 reason: error at write: Disconnected sessionId: src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0
2025-10-10T14:32:14.338439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 497 sessionId: src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0 is DEAD
2025-10-10T14:32:14.338567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:14.338577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0] Write session will restart in 0.006340s
2025-10-10T14:32:14.338596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0] Write session: Do CDS request
2025-10-10T14:32:14.338600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:14.345070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:14.345723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.345832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:14.345845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 498
2025-10-10T14:32:14.345968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.345994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:14.346000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:14.346003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:14.346390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 498 sessionId:  describe result for acl check
2025-10-10T14:32:14.346419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:14.346426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:14.346429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:14.346435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600862317160637:5380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:14.346615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:14.346775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:14.346784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:14.346804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:14.346854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:14.346885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600861534950010:4472]
2025-10-10T14:32:14.346906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600862317160637:5380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:14.347260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:14.347514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:14.347566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:14.347903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:14.347941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.347946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.347947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.347947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.347948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.347949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.347950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.347950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.347951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.347951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.347952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.347953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.347953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.347958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.347965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.347967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.347969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.347972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.347974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.347982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.347985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.347988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.347991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.347993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.347995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.347997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.348002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.348007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.348012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.348015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.348017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.348020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.348023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.348026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.348029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.348032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.348034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.348037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.348040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.348043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.348046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.348049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.348052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.348056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.348058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.348061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.348064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.348067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.348069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.348073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.348075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.348078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.348100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:14.348584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600862317160637:5380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:14.350088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:14.350407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:14.350410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600862317160637:5380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:14.350420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600862317160637:5380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:14.350417Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:14.350423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600862317160637:5380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:14.350427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:14.350419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:14.350422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:14.350427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 497 [2:7559600861534950010:4472]
2025-10-10T14:32:14.350434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:14.350445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:14.350447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.350449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.350451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.350461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:14.350467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:14.350473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:14.350512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.350519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.350520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.350522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:14.350563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:14.350569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.350575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.350585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.350606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:14.350624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160671:5380], now have 1 active actors on pipe
2025-10-10T14:32:14.350631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160599:2438], now have 1 active actors on pipe
2025-10-10T14:32:14.350638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600861534950005:4472]
2025-10-10T14:32:14.350646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600861534950005:4472]
2025-10-10T14:32:14.350648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600861534950005:4472]
2025-10-10T14:32:14.350638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 497
2025-10-10T14:32:14.350641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 497
2025-10-10T14:32:14.350670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:14.350683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:14.350682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:14.350684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:14.350685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:14.350694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:14.350696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:14.350722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.350728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.350741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600861534950005:4472]
2025-10-10T14:32:14.350750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:14.350759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:14.350773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:14.350784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.350788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.350789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:14.350797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.350805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:14.350823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.350938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.350944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.350955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.351018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 498 partition: 0 MaxSeqNo: 40 sessionId: src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0
2025-10-10T14:32:14.351238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|979bab4e-4d1940f0-13f9ae7e-7de9e829_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:14.353838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0] Write session: try to update token
2025-10-10T14:32:14.353854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:14.368514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:14.368530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:14.368532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:14.368534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:14.368543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600861534950005:4472]
2025-10-10T14:32:14.368545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600861534950005:4472]
2025-10-10T14:32:14.368551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600861534950005:4472]
2025-10-10T14:32:14.368590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:14.368595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.368597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:14.368609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:14.368616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:14.368620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:14.368747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:14.369390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId: src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:14.371991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:14.438621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600862317160679:4813]
2025-10-10T14:32:14.438951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 497, pipe: [1:7559600862317160679:4813]
2025-10-10T14:32:14.473277Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:14.473543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.473557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.473596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160679:4813], now have 1 active actors on pipe
2025-10-10T14:32:14.473763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:14.473770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:14.473783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:14.473801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:14.473839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600862317160679:4813]
2025-10-10T14:32:14.473848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 498 reason: error at write: Disconnected sessionId: src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0
2025-10-10T14:32:14.474053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 498 sessionId: src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0 is DEAD
2025-10-10T14:32:14.474166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:14.474176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0] Write session will restart in 0.008777s
2025-10-10T14:32:14.474195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0] Write session: Do CDS request
2025-10-10T14:32:14.474200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:14.481514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:14.482681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:14.482844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:14.482853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:14.482864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:14.482911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:14.482946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600861534950086:4474]
2025-10-10T14:32:14.483367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:14.483628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:14.483686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:14.483778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.483934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:14.483916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:14.483930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 499
2025-10-10T14:32:14.483990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.483996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.483997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.483998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.483999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.484000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.484000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.484002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.484003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.484004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.484004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.484005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.484006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.484010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.484019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.484022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.484024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.484027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.484029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.484032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.484034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.484036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.484039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.484042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.484044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.484046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.484053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.484058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.484063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.484067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.484070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.484073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.484086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.484076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.484079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.484082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.484085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.484088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.484120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:14.484092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.484131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:14.484095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.484098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.484101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.484104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.484135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:14.484107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.484110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.484113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.484116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.484120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.484123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.484125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.484129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.484131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.484135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.484157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:14.484473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 499 sessionId:  describe result for acl check
2025-10-10T14:32:14.484505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:14.484507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:14.484508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:14.484512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600862317160723:5384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:14.484882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600862317160723:5384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:14.486247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:14.486560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:14.486566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:14.486568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:14.486571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:14.486577Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 498 [2:7559600861534950086:4474]
2025-10-10T14:32:14.486588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:14.486602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:14.486610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.486614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.486616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.486631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:14.486643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:14.486697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:14.486753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.486769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.486771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.486774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:14.486834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:14.486841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.486852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.486863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.486878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:14.486902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160680:2438], now have 1 active actors on pipe
2025-10-10T14:32:14.486913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600861534950081:4474]
2025-10-10T14:32:14.486919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600861534950081:4474]
2025-10-10T14:32:14.486921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600861534950081:4474]
2025-10-10T14:32:14.486892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600862317160723:5384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:14.486926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 498
2025-10-10T14:32:14.486943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:14.486950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:14.486952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:14.486955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:14.486960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:14.486977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:14.486986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:14.487016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600861534950081:4474]
2025-10-10T14:32:14.487028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:14.487046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:14.491586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600862317160723:5384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:14.491601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600862317160723:5384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:14.491604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600862317160723:5384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:14.491609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:14.491820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160757:5384], now have 1 active actors on pipe
2025-10-10T14:32:14.491871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 498
2025-10-10T14:32:14.491931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.491940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.491963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c648400-33caccb9-1399882e-33aa3096_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:14.491984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.491991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.491993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:14.492003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.492019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:14.492034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.492201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.492207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.492218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.492294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 499 partition: 0 MaxSeqNo: 40 sessionId: src_id|6c648400-33caccb9-1399882e-33aa3096_0
2025-10-10T14:32:14.492571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c730e43c-dcd1f7f2-739cb326-a8cc131d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6c648400-33caccb9-1399882e-33aa3096_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:14.495055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c648400-33caccb9-1399882e-33aa3096_0] Write session: try to update token
2025-10-10T14:32:14.495068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c648400-33caccb9-1399882e-33aa3096_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:14.502219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:14.502235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:14.502244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600861534950081:4474]
2025-10-10T14:32:14.502287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:14.502298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:14.502460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:14.502591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:14.502719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:14.502846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:14.503038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:14.503070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:14.508347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId: src_id|6c648400-33caccb9-1399882e-33aa3096_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:14.510818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:14.511030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.511060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.511095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:14.511182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:14.515021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:14.515036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:14.515038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:14.515040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:14.515048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600861534950081:4474]
2025-10-10T14:32:14.515051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600861534950081:4474]
2025-10-10T14:32:14.515054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600861534950081:4474]
2025-10-10T14:32:14.515089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:14.515096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.515098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:14.515108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:14.515121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:14.515125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:14.515214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:14.573756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600862317160771:4813]
2025-10-10T14:32:14.573978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 498, pipe: [1:7559600862317160771:4813]
2025-10-10T14:32:14.616727Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:14.623123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.623148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.623299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.623355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.623413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.623471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.623515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.623523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.623591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.623647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.623706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.623765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.623806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.623812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.623869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.623921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.623976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.624031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.624069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.624075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.624132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.624187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.624243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.624299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.624339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.624345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.624414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.624467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.624525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.624578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.624621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.624629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.624695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.624758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.624809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.624864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.624903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.624908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.625001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.625054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.625111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.625168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.625207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.625212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.625274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.625343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.625399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.625454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.625493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.625498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.625554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.625606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.625661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.625720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.625769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.625775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.625833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:14.625886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:14.625943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:14.625999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:14.626038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:14.626046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:14.626084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160771:4813], now have 1 active actors on pipe
2025-10-10T14:32:14.626347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600862317160771:4813]
2025-10-10T14:32:14.626366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:14.626380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:14.626385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:14.626411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 499 reason: error at write: Disconnected sessionId: src_id|6c648400-33caccb9-1399882e-33aa3096_0
2025-10-10T14:32:14.626614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 499 sessionId: src_id|6c648400-33caccb9-1399882e-33aa3096_0 is DEAD
2025-10-10T14:32:14.626767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c648400-33caccb9-1399882e-33aa3096_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:14.626786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c648400-33caccb9-1399882e-33aa3096_0] Write session will restart in 0.007333s
2025-10-10T14:32:14.626781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:14.626804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c648400-33caccb9-1399882e-33aa3096_0] Write session: Do CDS request
2025-10-10T14:32:14.626809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c648400-33caccb9-1399882e-33aa3096_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:14.634458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:14.634791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c648400-33caccb9-1399882e-33aa3096_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.634876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:14.634889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 500
2025-10-10T14:32:14.634996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.635026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:14.635035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:14.635038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:14.635379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 500 sessionId:  describe result for acl check
2025-10-10T14:32:14.635409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:14.635414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:14.635415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:14.635420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600862317160817:5390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:14.635839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:14.635873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600862317160817:5390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:14.636003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:14.636010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:14.636019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:14.636057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:14.636099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600861534950167:4477]
2025-10-10T14:32:14.636469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:14.636699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:14.636727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:14.636928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:14.636962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.636967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.636967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.636968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.636968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.636969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.636970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.636970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.636971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.636971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.636972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.636973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.636974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.636977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.636984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.636987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.636990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.636992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.636994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.636996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.636998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.637001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.637003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.637005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.637007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.637009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.637014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.637018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.637025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.637028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.637031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.637034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.637036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.637039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.637042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.637045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.637047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.637050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.637053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.637056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.637059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.637062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.637065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.637067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.637070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.637073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.637075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.637078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.637080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.637083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.637086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.637089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.637109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:14.637574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600862317160817:5390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:14.639021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600862317160817:5390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:14.639032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600862317160817:5390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:14.639034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600862317160817:5390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:14.639039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:14.639122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:14.639404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:14.639411Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:14.639413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:14.639417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:14.639422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 499 [2:7559600861534950167:4477]
2025-10-10T14:32:14.639430Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:14.639442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:14.639444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.639446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.639447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.639458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:14.639463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:14.639469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:14.639505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.639510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.639511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.639513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:14.639555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:14.639560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.639567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.639573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.639582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:14.639595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160855:5390], now have 1 active actors on pipe
2025-10-10T14:32:14.639599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160777:2438], now have 1 active actors on pipe
2025-10-10T14:32:14.639604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600861534950162:4477]
2025-10-10T14:32:14.639606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600861534950162:4477]
2025-10-10T14:32:14.639607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600861534950162:4477]
2025-10-10T14:32:14.639615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:14.639625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:14.639632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:14.639635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:14.639637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:14.639637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:14.639639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:14.639655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600861534950162:4477]
2025-10-10T14:32:14.639660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:14.639642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 499
2025-10-10T14:32:14.639663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 499
2025-10-10T14:32:14.639666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:14.639683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.639686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.639708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:14.639717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.639720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.639721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:14.639727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.639735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:14.639745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.639840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.639846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.639866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.639933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 500 partition: 0 MaxSeqNo: 40 sessionId: src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0
2025-10-10T14:32:14.640162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c648400-33caccb9-1399882e-33aa3096_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:14.642696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0] Write session: try to update token
2025-10-10T14:32:14.642712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:14.657036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId: src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:14.657270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:14.657294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:14.657297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:14.657300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:14.657309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600861534950162:4477]
2025-10-10T14:32:14.657315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600861534950162:4477]
2025-10-10T14:32:14.657319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600861534950162:4477]
2025-10-10T14:32:14.657370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:14.657383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:14.657386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:14.657388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:14.657396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.657398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:14.657575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:14.659635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:14.726361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600862317160867:4813]
2025-10-10T14:32:14.726649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 499, pipe: [1:7559600862317160867:4813]
2025-10-10T14:32:14.758459Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:14.758770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.758782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.758818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160867:4813], now have 1 active actors on pipe
2025-10-10T14:32:14.759030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:14.759033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:14.759037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:14.759084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600862317160867:4813]
2025-10-10T14:32:14.759097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 500 reason: error at write: Disconnected sessionId: src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0
2025-10-10T14:32:14.759276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 500 sessionId: src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0 is DEAD
2025-10-10T14:32:14.759385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:14.759394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0] Write session will restart in 0.005412s
2025-10-10T14:32:14.759422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0] Write session: Do CDS request
2025-10-10T14:32:14.759426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:14.759673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:14.765650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.765761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:14.765774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 501
2025-10-10T14:32:14.765893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.765926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:14.765936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:14.765939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:14.766316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 501 sessionId:  describe result for acl check
2025-10-10T14:32:14.766345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:14.766354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:14.766356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:14.766362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600862317160908:5394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:14.766372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:14.766882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600862317160908:5394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:14.767800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:14.767948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:14.767956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:14.767965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:14.768013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:14.768055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600861534950246:4479]
2025-10-10T14:32:14.768431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:14.768551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600862317160908:5394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:14.768648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:14.768688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:14.768884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:14.768917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.768921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.768922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.768923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.768923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.768924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.768925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.768925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.768926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.768927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.768927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.768928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.768928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.768932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.768939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.768941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.768943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.768945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.768947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.768949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.768951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.768954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.768957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.768959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.768961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.768963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.768969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.768974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.768979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.768982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.768984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.768995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.768997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.769000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.769003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.769006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.769008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.769011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.769016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.769019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.769022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.769025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.769028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.769031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.769034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.769037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.769039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.769042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.769044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.769047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.769050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.769053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.769075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:14.771065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600862317160908:5394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:14.771078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600862317160908:5394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:14.771081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600862317160908:5394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:14.771087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:14.771185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:14.771482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:14.771491Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:14.771492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:14.771495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:14.771501Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 500 [2:7559600861534950246:4479]
2025-10-10T14:32:14.771510Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:14.771522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:14.771524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.771526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.771528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.771540Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:14.771546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:14.771558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:14.771609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.771614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.771615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.771617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:14.771663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:14.771669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.771675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.771689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.771699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:14.771714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160868:2438], now have 1 active actors on pipe
2025-10-10T14:32:14.771720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160943:5394], now have 1 active actors on pipe
2025-10-10T14:32:14.771725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600861534950241:4479]
2025-10-10T14:32:14.771727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600861534950241:4479]
2025-10-10T14:32:14.771728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600861534950241:4479]
2025-10-10T14:32:14.771738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:14.771748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:14.771741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 500
2025-10-10T14:32:14.771747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 500
2025-10-10T14:32:14.771761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:14.771763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:14.771765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:14.771770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:14.771772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:14.771781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600861534950241:4479]
2025-10-10T14:32:14.771783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:14.771790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:14.771798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.771800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.771834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:14.771843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.771846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.771847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:14.771855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.771863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:14.771876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.772031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.772042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.772063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.772166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 501 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0
2025-10-10T14:32:14.772441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5d9b1-96687ae7-ebc3e534-117cfd0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:14.774907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0] Write session: try to update token
2025-10-10T14:32:14.774921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:14.789904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:14.789920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:14.789923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:14.789924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:14.789932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600861534950241:4479]
2025-10-10T14:32:14.789936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600861534950241:4479]
2025-10-10T14:32:14.789939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600861534950241:4479]
2025-10-10T14:32:14.789979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:14.789985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.789988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:14.789990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:14.789994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:14.789998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:14.790121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:14.791489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId: src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:14.794101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:14.859509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600862317160951:4813]
2025-10-10T14:32:14.859861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 500, pipe: [1:7559600862317160951:4813]
2025-10-10T14:32:14.894371Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:14.894606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.894620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.894669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160951:4813], now have 1 active actors on pipe
2025-10-10T14:32:14.894877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:14.894898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:14.894964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600862317160951:4813]
2025-10-10T14:32:14.894994Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:32:14.895035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:14.895112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 501 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0
2025-10-10T14:32:14.895173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 501 sessionId: src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0 is DEAD
2025-10-10T14:32:14.895214Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 5 consumer shared/user session shared/user_1_5_8777415409333158409_v1 is DEAD
2025-10-10T14:32:14.895346Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600802187595731:4810] disconnected; active server actors: 1
2025-10-10T14:32:14.895356Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600802187595731:4810] client user disconnected session shared/user_1_5_8777415409333158409_v1
2025-10-10T14:32:14.895395Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:32:14.895504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:14.895519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0] Write session will restart in 0.009688s
2025-10-10T14:32:14.895530Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:14.895534Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:14.895540Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.006281s
2025-10-10T14:32:14.895546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0] Write session: Do CDS request
2025-10-10T14:32:14.895554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:14.902294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:14.902704Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:32:14.902983Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:32:14.902998Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 6
2025-10-10T14:32:14.903166Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:14.903220Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:14.903291Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 auth for : user
2025-10-10T14:32:14.903495Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 Handle describe topics response
2025-10-10T14:32:14.903525Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 auth is DEAD
2025-10-10T14:32:14.903534Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:32:14.903773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:14.903794Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:32:14.903861Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_6_145653412642538201_v1
2025-10-10T14:32:14.903876Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600862317160995:5398] connected; active server actors: 1
2025-10-10T14:32:14.903891Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600862317160995:5398] session shared/user_1_6_145653412642538201_v1
2025-10-10T14:32:14.903902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:32:14.903914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:32:14.903925Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_6_145653412642538201_v1" (Sender=[1:7559600862317160992:5398], Pipe=[1:7559600862317160995:5398], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:14.903929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:14.903926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:14.903936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:14.903942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:32:14.903955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_6_145653412642538201_v1" (Sender=[1:7559600862317160992:5398], Pipe=[1:7559600862317160995:5398], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:14.903945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:14.903965Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_6_145653412642538201_v1" sender [1:7559600862317160992:5398] lock partition 0 for ReadingSession "shared/user_1_6_145653412642538201_v1" (Sender=[1:7559600862317160992:5398], Pipe=[1:7559600862317160995:5398], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-10T14:32:14.903982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:32:14.903984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:14.903991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-10-10T14:32:14.904013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600861534950326:4481]
2025-10-10T14:32:14.904140Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_6_145653412642538201_v1" ClientId: "user" PipeClient { RawX1: 7559600862317160995 RawX2: 4503603922343190 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:32:14.904162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:32:14.904397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:14.904633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:14.904663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:14.904883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:14.904924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.904932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.904932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.904933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.904934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.904938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.904939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.904940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.904941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.904942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.904943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.904944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.904944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.904949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.904961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.904965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.904968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.904972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.904976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.904979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.904982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.904986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.904990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.904993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.904996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.905001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.905008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.905016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:14.905022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.905027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:14.905030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.905035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:14.905039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.905044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:14.905049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.905053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:14.905058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.905062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:14.905073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.905082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:14.905090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.905097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:14.905100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.905103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:14.905106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.905109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:14.905112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.905115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.905118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.905121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.905124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.905127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.905149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:14.906667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.906717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:14.906727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 502
2025-10-10T14:32:14.906812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:14.906840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:14.906848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:14.906852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:14.907229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 502 sessionId:  describe result for acl check
2025-10-10T14:32:14.907233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:14.907256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:14.907261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:14.907262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:14.907266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600862317161006:5402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:14.907521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:14.907530Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:14.907532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:14.907534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:14.907539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 501 [2:7559600861534950326:4481]
2025-10-10T14:32:14.907547Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:14.907558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:14.907559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.907562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.907563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.907574Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:14.907578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:14.907585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:14.907635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.907644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.907645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.907646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:14.907674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600862317161006:5402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:14.907694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:14.907700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.907706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:14.907715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:14.907728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:14.907743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160952:2438], now have 1 active actors on pipe
2025-10-10T14:32:14.907748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317160998:5401], now have 1 active actors on pipe
2025-10-10T14:32:14.907753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600861534950321:4481]
2025-10-10T14:32:14.907755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600861534950321:4481]
2025-10-10T14:32:14.907756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600861534950321:4481]
2025-10-10T14:32:14.907764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:14.907773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:14.907783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:14.907786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:14.907789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:14.907791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:14.907793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:14.907803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600861534950321:4481]
2025-10-10T14:32:14.907805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:14.907787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 501
2025-10-10T14:32:14.907814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:14.907820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 501, pipe: [1:7559600862317160998:5401]
2025-10-10T14:32:14.907841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.907848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.907858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_6_145653412642538201_v1 on pipe: [1:7559600862317160998:5401]
2025-10-10T14:32:14.907881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.907888Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_6_145653412642538201_v1:1 with generation 501
2025-10-10T14:32:14.907890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.907892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:14.907907Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_6_145653412642538201_v1
2025-10-10T14:32:14.907912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.907926Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:32:14.909282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600862317161006:5402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:14.911838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:32:14.911864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:32:14.911872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.911874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.911876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.911883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:32:14.911894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:32:14.912027Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106734907 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:32:14.912045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:32:14.912068Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 sending to client partition status
2025-10-10T14:32:14.914616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600862317161006:5402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:14.914627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600862317161006:5402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:14.914630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600862317161006:5402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:14.914642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:14.914826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600862317161040:5402], now have 1 active actors on pipe
2025-10-10T14:32:14.914884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 501
2025-10-10T14:32:14.914962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.914973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.915007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:14.915018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:14.915021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:14.915022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:14.915032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:14.915047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:14.915061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.915219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:14.915224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:14.915235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:14.915305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 502 partition: 0 MaxSeqNo: 40 sessionId: src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0
2025-10-10T14:32:14.915559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e1a92d1-a7c7bdd9-8fdfb663-a1b10d0c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:14.918719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0] Write session: try to update token
2025-10-10T14:32:14.918739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:14.925311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:14.925321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:14.925323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:14.925324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:14.925349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600861534950321:4481]
2025-10-10T14:32:14.925354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600861534950321:4481]
2025-10-10T14:32:14.925357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600861534950321:4481]
2025-10-10T14:32:14.925393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:14.925399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:14.925400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:14.925402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:14.925408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:14.925412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:14.925541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:14.935018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId: src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:14.937567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:15.030479Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:15.030843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.030857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.031093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600862317160998:5401]
2025-10-10T14:32:15.031103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:15.031103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_6_145653412642538201_v1
2025-10-10T14:32:15.031108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:15.031124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:15.031129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:15.031136Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_6_145653412642538201_v1
2025-10-10T14:32:15.031180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 502 reason: error at write: Disconnected sessionId: src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0
2025-10-10T14:32:15.031398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 502 sessionId: src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0 is DEAD
2025-10-10T14:32:15.031568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:15.031578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0] Write session will restart in 0.008110s
2025-10-10T14:32:15.031599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0] Write session: Do CDS request
2025-10-10T14:32:15.031604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:15.039317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:15.040818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.040864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:15.040939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:15.040954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 503
2025-10-10T14:32:15.041025Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:15.041034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:15.041043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:15.041078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:15.041112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600865829917745:4496]
2025-10-10T14:32:15.041104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.041130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:15.041138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:15.041141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:15.041543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:15.041592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 503 sessionId:  describe result for acl check
2025-10-10T14:32:15.041625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:15.041627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:15.041628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:15.041632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600866612128407:5415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:15.041882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:15.041921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:15.042092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600866612128407:5415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:15.042131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:15.042170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.042174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.042175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.042176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.042177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.042177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.042178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.042179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.042180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.042180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.042181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.042182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.042182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.042187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.042195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.042198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.042200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.042202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.042205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.042207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.042209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.042210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.042213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.042215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.042217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.042219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.042224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.042229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.042233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.042237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.042240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.042243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.042247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.042253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.042258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.042263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.042267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.042272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.042277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.042283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.042286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.042289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.042293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.042296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.042299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.042302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.042305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.042308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.042311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.042314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.042316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.042319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.042351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:15.044130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600866612128407:5415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:15.044492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:15.044852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:15.044863Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:15.044864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:15.044867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:15.044872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 502 [2:7559600865829917745:4496]
2025-10-10T14:32:15.044882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:15.044896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:15.044898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.044900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.044902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.044916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:15.044921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:15.044927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:15.044969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.044975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.044978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.044979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:15.045031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:15.045037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.045045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.045052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.045061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:15.045081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128364:2438], now have 1 active actors on pipe
2025-10-10T14:32:15.045090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600865829917740:4496]
2025-10-10T14:32:15.045092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600865829917740:4496]
2025-10-10T14:32:15.045093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600865829917740:4496]
2025-10-10T14:32:15.045102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:15.045111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:15.045121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:15.045122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:15.045125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:15.045127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:15.045127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:15.045151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600865829917740:4496]
2025-10-10T14:32:15.045154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:15.045143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 502
2025-10-10T14:32:15.045156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:15.049844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600866612128407:5415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:15.049859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600866612128407:5415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:15.049863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600866612128407:5415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:15.049872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:15.050108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128445:5415], now have 1 active actors on pipe
2025-10-10T14:32:15.050169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 502
2025-10-10T14:32:15.050233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.050246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.050280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:15.050297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.050307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.050309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:15.050324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.050345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:15.050368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.050567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.050578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.050594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.050729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 503 partition: 0 MaxSeqNo: 40 sessionId: src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0
2025-10-10T14:32:15.051117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7acb5e2-48de0b50-4e433be4-509d40ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:15.054112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0] Write session: try to update token
2025-10-10T14:32:15.054128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:15.055771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:15.055786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.055795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600865829917740:4496]
2025-10-10T14:32:15.055837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:15.055839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:15.056021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:15.056167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.056312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.056459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.056658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:15.056696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:15.070036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId: src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:15.072692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:15.072921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.072942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.072962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:15.072965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.072966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:15.072968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:15.072974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600865829917740:4496]
2025-10-10T14:32:15.072977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600865829917740:4496]
2025-10-10T14:32:15.072984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600865829917740:4496]
2025-10-10T14:32:15.073028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:15.073035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:15.073041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:15.073043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.073044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:15.073046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:15.073163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:15.131344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600866612128452:5401]
2025-10-10T14:32:15.131593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 502, pipe: [1:7559600866612128452:5401]
2025-10-10T14:32:15.176407Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:15.176699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:15.176735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128452:5401], now have 1 active actors on pipe
2025-10-10T14:32:15.176852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:15.176907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600866612128452:5401]
2025-10-10T14:32:15.176931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:15.176952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:15.176960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:15.177033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 503 reason: error at write: Disconnected sessionId: src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0
2025-10-10T14:32:15.177215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 503 sessionId: src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0 is DEAD
2025-10-10T14:32:15.177380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:15.177391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0] Write session will restart in 0.009963s
2025-10-10T14:32:15.177410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0] Write session: Do CDS request
2025-10-10T14:32:15.177414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:15.184487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:15.185955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:15.186114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:15.186125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:15.186136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:15.186183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:15.186225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600865829917840:4499]
2025-10-10T14:32:15.186629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:15.186861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:15.186892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:15.187130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:15.187181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.187187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.187188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.187189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.187191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.187192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.187193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.187194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.187195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.187197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.187198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.187199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.187200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.187206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.187219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.187222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.187227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.187231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.187235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.187239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.187243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.187247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.187252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.187256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.187260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.187264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.187270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.187283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.187294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.187304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.187308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.187313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.187320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.187323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.187326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.187333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.187335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.187338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.187341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.187344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.187349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.187352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.187356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.187363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.187365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.187368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.187370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.187373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.187375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.187379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.187381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.187384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.187409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:15.188824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.188958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:15.188975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 504
2025-10-10T14:32:15.189121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.189153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:15.189161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:15.189165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:15.189462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:15.189546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 504 sessionId:  describe result for acl check
2025-10-10T14:32:15.189583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:15.189589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:15.189590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:15.189594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600866612128514:5420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:15.189758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:15.189768Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:15.189770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:15.189774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:15.189779Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 503 [2:7559600865829917840:4499]
2025-10-10T14:32:15.189787Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:15.189803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:15.189808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.189811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.189813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.189824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:15.189833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:15.189843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:15.189883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.189888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.189889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.189891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:15.189940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:15.189946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.189952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.189959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.189974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:15.189989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128465:2438], now have 1 active actors on pipe
2025-10-10T14:32:15.189999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600865829917835:4499]
2025-10-10T14:32:15.190005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600865829917835:4499]
2025-10-10T14:32:15.190007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600865829917835:4499]
2025-10-10T14:32:15.190016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:15.190025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:15.190035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:15.190040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:15.190042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:15.190045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:15.190047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:15.190056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600865829917835:4499]
2025-10-10T14:32:15.190049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 503
2025-10-10T14:32:15.190062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:15.190074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:15.190174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600866612128514:5420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:15.192062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600866612128514:5420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:15.196175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600866612128514:5420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:15.196187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600866612128514:5420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:15.196199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600866612128514:5420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:15.196206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:15.196415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128547:5420], now have 1 active actors on pipe
2025-10-10T14:32:15.196500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 503
2025-10-10T14:32:15.196567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.196578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.196607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35b1d506-b83dd161-f6cda920-5d406f16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:15.196622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.196629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.196636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:15.196648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.196668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:15.196691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.196848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.196855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.196870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.196966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 504 partition: 0 MaxSeqNo: 40 sessionId: src_id|35b1d506-b83dd161-f6cda920-5d406f16_0
2025-10-10T14:32:15.197348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503fb8bc-15b436a5-e6b3946b-25ece7e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35b1d506-b83dd161-f6cda920-5d406f16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:15.200199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b1d506-b83dd161-f6cda920-5d406f16_0] Write session: try to update token
2025-10-10T14:32:15.200216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b1d506-b83dd161-f6cda920-5d406f16_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:15.200539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:15.200553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.200564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600865829917835:4499]
2025-10-10T14:32:15.200607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:15.200619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:15.200778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:15.200922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.201058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.201205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.201421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:15.201458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:15.213280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId: src_id|35b1d506-b83dd161-f6cda920-5d406f16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:15.215803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:15.217292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.217314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.217354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:15.217357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.217359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:15.217360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:15.217367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600865829917835:4499]
2025-10-10T14:32:15.217370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600865829917835:4499]
2025-10-10T14:32:15.217373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600865829917835:4499]
2025-10-10T14:32:15.217419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:15.217422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:15.217428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:15.217429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.217432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:15.217432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:15.217555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:15.277233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600866612128550:5401]
2025-10-10T14:32:15.277503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 503, pipe: [1:7559600866612128550:5401]
2025-10-10T14:32:15.317985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:15.318196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:15.318227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128550:5401], now have 1 active actors on pipe
2025-10-10T14:32:15.318318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:15.318387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600866612128550:5401]
2025-10-10T14:32:15.318410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:15.327043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:15.328039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:15.328053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:15.328075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 504 reason: error at write: Disconnected sessionId: src_id|35b1d506-b83dd161-f6cda920-5d406f16_0
2025-10-10T14:32:15.328233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 504 sessionId: src_id|35b1d506-b83dd161-f6cda920-5d406f16_0 is DEAD
2025-10-10T14:32:15.328395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b1d506-b83dd161-f6cda920-5d406f16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:15.328406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b1d506-b83dd161-f6cda920-5d406f16_0] Write session will restart in 0.005744s
2025-10-10T14:32:15.328425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b1d506-b83dd161-f6cda920-5d406f16_0] Write session: Do CDS request
2025-10-10T14:32:15.328431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b1d506-b83dd161-f6cda920-5d406f16_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:15.331753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:15.331957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:15.331968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:15.331980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:15.332037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:15.332080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600865829917923:4501]
2025-10-10T14:32:15.332671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:15.332967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:15.333016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:15.333343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:15.333396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.333401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.333403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.333404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.333405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.333408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.333409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.333410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.333411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.333413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.333414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.333415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.333416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.333421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.333433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.333436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.333439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.333443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.333446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.333449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.333457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.333460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.333471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.333479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.333483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.333490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.333498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.333511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.333521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.333531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.333540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.333549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.333554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.333563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.333570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.333579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.333583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.333588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.333594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.333599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.333603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.333610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.333619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.333626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.333634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.333640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.333648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.333653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.333661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.333666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.333670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.333674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.333713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:15.334747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b1d506-b83dd161-f6cda920-5d406f16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.335013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:15.335026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 505
2025-10-10T14:32:15.335161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.335194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:15.335205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:15.335213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:15.335550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 505 sessionId:  describe result for acl check
2025-10-10T14:32:15.335580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:15.335585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:15.335586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:15.335591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600866612128602:5424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:15.335864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:15.336035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600866612128602:5424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:15.336174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:15.336186Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:15.336188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:15.336194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:15.336200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 504 [2:7559600865829917923:4501]
2025-10-10T14:32:15.336215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:15.336236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:15.336243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.336246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.336248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.336264Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:15.336272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:15.336282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:15.336337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.336344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.336345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.336347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:15.336410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:15.336419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.336430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.336441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.336463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:15.336486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128552:2438], now have 1 active actors on pipe
2025-10-10T14:32:15.336497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600865829917917:4501]
2025-10-10T14:32:15.336490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 504
2025-10-10T14:32:15.336504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600865829917917:4501]
2025-10-10T14:32:15.336506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600865829917917:4501]
2025-10-10T14:32:15.336514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:15.336524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:15.336526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:15.336527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:15.336533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:15.336549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:15.336556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:15.336581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600865829917917:4501]
2025-10-10T14:32:15.336592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:15.336604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:15.338197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600866612128602:5424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:15.342923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600866612128602:5424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:15.342934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600866612128602:5424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:15.342937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600866612128602:5424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:15.342943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:15.343170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 504
2025-10-10T14:32:15.343164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128634:5424], now have 1 active actors on pipe
2025-10-10T14:32:15.343239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.343249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.343271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:15.343282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.343292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.343295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:15.343305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.343323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:15.343343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.343543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.343552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.343567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.343653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 505 partition: 0 MaxSeqNo: 40 sessionId: src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0
2025-10-10T14:32:15.343946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b1d506-b83dd161-f6cda920-5d406f16_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:15.346343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0] Write session: try to update token
2025-10-10T14:32:15.346354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:15.347266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:15.347281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.347291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600865829917917:4501]
2025-10-10T14:32:15.347319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:15.347331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:15.347494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:15.347633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.347759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.347896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.348083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:15.348117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:15.359060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId: src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:15.361520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:15.361742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.361766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.361807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:15.361924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:15.364137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:15.364153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.364156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:15.364158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:15.364167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600865829917917:4501]
2025-10-10T14:32:15.364171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600865829917917:4501]
2025-10-10T14:32:15.364175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600865829917917:4501]
2025-10-10T14:32:15.364220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:15.364233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.364232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:15.364239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:15.364240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:15.364243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:15.364367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:15.418569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600866612128638:5401]
2025-10-10T14:32:15.418803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 504, pipe: [1:7559600866612128638:5401]
2025-10-10T14:32:15.468279Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:15.475105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.475127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.475271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.475325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.475380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.475434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.475475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.475483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.475544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.475600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.475656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.475716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.475761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.475771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.475837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.475893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.475947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.476001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.476041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.476047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.476104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.476411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.476471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.476524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.476562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.476567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.476626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.476679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.476732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.476785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.476824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.476832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.476887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.476941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.476994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.477050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.477089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.477094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.477148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.477199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.477257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.477310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.477363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.477370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.477425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.477483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.477547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.477600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.477639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.477644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.477697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.477747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.477799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.477852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.477890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.477895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.477948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.478000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.478055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.478106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.478143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.478149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.478186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128638:5401], now have 1 active actors on pipe
2025-10-10T14:32:15.478405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:15.478433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:15.478436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:15.478455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600866612128638:5401]
2025-10-10T14:32:15.478467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 505 reason: error at write: Disconnected sessionId: src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0
2025-10-10T14:32:15.478548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:15.478660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 505 sessionId: src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0 is DEAD
2025-10-10T14:32:15.478825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:15.478837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0] Write session will restart in 0.008307s
2025-10-10T14:32:15.478862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0] Write session: Do CDS request
2025-10-10T14:32:15.478867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:15.485380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:15.486891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:15.487058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:15.487068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:15.487077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:15.487120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:15.487153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600865829918007:4503]
2025-10-10T14:32:15.487932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:15.488170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:15.488200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:15.488422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:15.488472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.488477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.488478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.488479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.488480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.488481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.488482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.488483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.488484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.488484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.488485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.488486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.488487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.488492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.488504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.488507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.488510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.488513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.488517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.488519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.488523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.488525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.488529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.488534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.488537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.488541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.488548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.488555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.488565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.488575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.488582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.488587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.488595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.488599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.488607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.488612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.488620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.488625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.488629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.488633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.488642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.488646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.488654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.488659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.488667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.488672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.488676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.488684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.488690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.488695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.488703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.488708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.488745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:15.488804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.488889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:15.488903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 506
2025-10-10T14:32:15.489025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.489053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:15.489065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:15.489069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:15.489439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 506 sessionId:  describe result for acl check
2025-10-10T14:32:15.489469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:15.489475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:15.489477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:15.489483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600866612128690:5428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:15.490013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600866612128690:5428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:15.490892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:15.491274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:15.491286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:15.491288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:15.491292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:15.491298Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 505 [2:7559600865829918007:4503]
2025-10-10T14:32:15.491308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:15.491323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:15.491330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.491333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.491335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.491350Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:15.491361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:15.491368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:15.491411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.491416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.491417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.491418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:15.491462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:15.491468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.491477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.491492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.491512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:15.491530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128640:2438], now have 1 active actors on pipe
2025-10-10T14:32:15.491536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600865829918002:4503]
2025-10-10T14:32:15.491538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600865829918002:4503]
2025-10-10T14:32:15.491540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600865829918002:4503]
2025-10-10T14:32:15.491553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:15.491549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 505
2025-10-10T14:32:15.491571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:15.491572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:15.491574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:15.491576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:15.491586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:15.491589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:15.491610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600865829918002:4503]
2025-10-10T14:32:15.491615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:15.491633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:15.492634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600866612128690:5428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:15.497552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600866612128690:5428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:15.497567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600866612128690:5428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:15.497571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600866612128690:5428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:15.497579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:15.497788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128724:5428], now have 1 active actors on pipe
2025-10-10T14:32:15.497856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 505
2025-10-10T14:32:15.497922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.497933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.497963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:15.497978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.497986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.497989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:15.498002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.498019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:15.498033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.498193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.498202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.498216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.498287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 506 partition: 0 MaxSeqNo: 40 sessionId: src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0
2025-10-10T14:32:15.498585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4c29bf3-522e31c7-3b2f3ac0-8dbe5cbd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:15.501018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0] Write session: try to update token
2025-10-10T14:32:15.501032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:15.509699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:15.509717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.509720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:15.509723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:15.509733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600865829918002:4503]
2025-10-10T14:32:15.509738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600865829918002:4503]
2025-10-10T14:32:15.509741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600865829918002:4503]
2025-10-10T14:32:15.509789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:15.509807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.509808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:15.509812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:15.509812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:15.509816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:15.509954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:15.513762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId: src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:15.516234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:15.578826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600866612128734:5401]
2025-10-10T14:32:15.579118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 505, pipe: [1:7559600866612128734:5401]
2025-10-10T14:32:15.614438Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:15.614648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.614660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.614716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128734:5401], now have 1 active actors on pipe
2025-10-10T14:32:15.614905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:15.614988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:15.615031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600866612128734:5401]
2025-10-10T14:32:15.615037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:15.615110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 506 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0
2025-10-10T14:32:15.615331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 506 sessionId: src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0 is DEAD
2025-10-10T14:32:15.615429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:15.615438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0] Write session will restart in 0.007791s
2025-10-10T14:32:15.615455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0] Write session: Do CDS request
2025-10-10T14:32:15.615461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:15.623269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:15.624845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.624886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:15.624945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:15.624960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 507
2025-10-10T14:32:15.625077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:15.625086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:15.625068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.625096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:15.625098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:15.625106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:15.625109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:15.625142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:15.625187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600865829918095:4506]
2025-10-10T14:32:15.625502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 507 sessionId:  describe result for acl check
2025-10-10T14:32:15.625539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:15.625546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:15.625548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:15.625553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600866612128786:5434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:15.625760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:15.626059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:15.626058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600866612128786:5434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:15.626108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:15.626363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:15.626416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.626424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.626425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.626426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.626427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.626428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.626429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.626430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.626431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.626432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.626433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.626435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.626436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.626441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.626452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.626456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.626460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.626464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.626468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.626471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.626474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.626477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.626481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.626484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.626487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.626490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.626497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.626506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.626514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.626525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.626534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.626539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.626548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.626557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.626566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.626575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.626583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.626592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.626601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.626610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.626617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.626624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.626633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.626638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.626643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.626652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.626656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.626661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.626678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.626683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.626692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.626697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.626737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:15.627661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600866612128786:5434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:15.628876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:15.629197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:15.629209Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:15.629211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:15.629214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:15.629220Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 506 [2:7559600865829918095:4506]
2025-10-10T14:32:15.629230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:15.629253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:15.629261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.629265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.629268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.629283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:15.629291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:15.629298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:15.629363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.629370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.629372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.629374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:15.629434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:15.629442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.629453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.629465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.629487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:15.629512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128738:2438], now have 1 active actors on pipe
2025-10-10T14:32:15.629524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600865829918090:4506]
2025-10-10T14:32:15.629526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600865829918090:4506]
2025-10-10T14:32:15.629528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600865829918090:4506]
2025-10-10T14:32:15.629540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:15.629552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:15.629563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:15.629566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:15.629568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:15.629573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:15.629575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:15.629582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 506
2025-10-10T14:32:15.629597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600865829918090:4506]
2025-10-10T14:32:15.629613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:15.629621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:15.630064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600866612128786:5434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:15.630074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600866612128786:5434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:15.630076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600866612128786:5434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:15.630082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:15.630242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128822:5434], now have 1 active actors on pipe
2025-10-10T14:32:15.630282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 506
2025-10-10T14:32:15.630342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.630352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.630382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|190522df-13287f23-b61a9eca-56adc67e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:15.630393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.630401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.630403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:15.630416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.630432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:15.630450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.630625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.630634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.630649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.630734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 507 partition: 0 MaxSeqNo: 40 sessionId: src_id|190522df-13287f23-b61a9eca-56adc67e_0
2025-10-10T14:32:15.631027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8330e6c5-1a1a7aa8-f765c4e3-788e0ffe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|190522df-13287f23-b61a9eca-56adc67e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:15.633427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|190522df-13287f23-b61a9eca-56adc67e_0] Write session: try to update token
2025-10-10T14:32:15.633441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|190522df-13287f23-b61a9eca-56adc67e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:15.645248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId: src_id|190522df-13287f23-b61a9eca-56adc67e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:15.647110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:15.647127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.647129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:15.647131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:15.647138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600865829918090:4506]
2025-10-10T14:32:15.647143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600865829918090:4506]
2025-10-10T14:32:15.647146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600865829918090:4506]
2025-10-10T14:32:15.647181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:15.647187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.647188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:15.647213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:15.647229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:15.647234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:15.647317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:15.647793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:15.715009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600866612128827:5401]
2025-10-10T14:32:15.715248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 506, pipe: [1:7559600866612128827:5401]
2025-10-10T14:32:15.748601Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:15.748849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.748861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.748900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128827:5401], now have 1 active actors on pipe
2025-10-10T14:32:15.749100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:15.749151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600866612128827:5401]
2025-10-10T14:32:15.749184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:15.749193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:15.749280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 507 reason: status is not ok: tablet will be restarted right now sessionId: src_id|190522df-13287f23-b61a9eca-56adc67e_0
2025-10-10T14:32:15.749515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 507 sessionId: src_id|190522df-13287f23-b61a9eca-56adc67e_0 is DEAD
2025-10-10T14:32:15.749634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190522df-13287f23-b61a9eca-56adc67e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:15.749649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190522df-13287f23-b61a9eca-56adc67e_0] Write session will restart in 0.009939s
2025-10-10T14:32:15.749668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190522df-13287f23-b61a9eca-56adc67e_0] Write session: Do CDS request
2025-10-10T14:32:15.749673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190522df-13287f23-b61a9eca-56adc67e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:15.757476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:15.758899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:15.759091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:15.759102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:15.759114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:15.759167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:15.759205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600865829918182:4508]
2025-10-10T14:32:15.759798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:15.760047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:15.760085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:15.760383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:15.760436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.760442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.760444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.760446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.760447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.760448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.760449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.760451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.760452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.760453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.760454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.760455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.760456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.760461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.760473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.760477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.760481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.760485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.760488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.760492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.760496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.760499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.760503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.760507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.760511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.760514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.760521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.760528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.760535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.760540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.760544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.760549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.760554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.760561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.760567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.760576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.760581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.760586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.760595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.760600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.760606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.760611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.760616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.760625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.760629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.760635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.760643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.760648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.760653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.760661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.760665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.760670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.760712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:15.760805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|190522df-13287f23-b61a9eca-56adc67e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.760909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:15.760925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 508
2025-10-10T14:32:15.761036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.761066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:15.761076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:15.761079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:15.761496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 508 sessionId:  describe result for acl check
2025-10-10T14:32:15.761533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:15.761540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:15.761542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:15.761547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600866612128881:5438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:15.762072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600866612128881:5438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:15.762783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:15.763095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:15.763109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:15.763112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:15.763115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:15.763121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 507 [2:7559600865829918182:4508]
2025-10-10T14:32:15.763132Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:15.763152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:15.763159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.763162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.763166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.763183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:15.763194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:15.763201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:15.763249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.763255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.763257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.763260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:15.763321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:15.763328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.763339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.763351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.763368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:15.763392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128828:2438], now have 1 active actors on pipe
2025-10-10T14:32:15.763404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600865829918177:4508]
2025-10-10T14:32:15.763412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600865829918177:4508]
2025-10-10T14:32:15.763414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600865829918177:4508]
2025-10-10T14:32:15.763427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:15.763445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:15.763450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:15.763453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:15.763431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 507
2025-10-10T14:32:15.763455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:15.763465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:15.763469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:15.763496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600865829918177:4508]
2025-10-10T14:32:15.763507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:15.763525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:15.763854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600866612128881:5438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:15.769782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600866612128881:5438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:15.769796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600866612128881:5438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:15.769799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600866612128881:5438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:15.769806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:15.770017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128914:5438], now have 1 active actors on pipe
2025-10-10T14:32:15.770068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 507
2025-10-10T14:32:15.770127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.770139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.770181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:15.770198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.770208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.770210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:15.770222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.770241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:15.770263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.770423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.770430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.770443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.770519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 508 partition: 0 MaxSeqNo: 40 sessionId: src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0
2025-10-10T14:32:15.770836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|190522df-13287f23-b61a9eca-56adc67e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:15.773427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0] Write session: try to update token
2025-10-10T14:32:15.773440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:15.774081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:15.774095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.774104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600865829918177:4508]
2025-10-10T14:32:15.774148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:15.774156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:15.774323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:15.774464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.774605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.774758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:15.774947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:15.774985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:15.785930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId: src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:15.788157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:15.788374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.788395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.788434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:15.788522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:15.790657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:15.790685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.790688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:15.790689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:15.790697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600865829918177:4508]
2025-10-10T14:32:15.790702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600865829918177:4508]
2025-10-10T14:32:15.790707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600865829918177:4508]
2025-10-10T14:32:15.790751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:15.790761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:15.790764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.790767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:15.790767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:15.790771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:15.790883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:15.849281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600866612128918:5401]
2025-10-10T14:32:15.849509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 507, pipe: [1:7559600866612128918:5401]
2025-10-10T14:32:15.892837Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:15.899622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.899649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.899800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.899856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.899927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.899997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.900047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.900055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.900124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.900183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.900240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.900304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.900515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.900523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.900584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.900641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.900703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.900769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.900809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.900814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.900871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.900929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.900984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.901040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.901081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.901087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.901146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.901201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.901256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.901313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.901366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.901374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.901444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.901502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.901556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.901610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.901653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.901659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.901716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.901780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.901839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.901897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.901938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.901945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.902002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.902056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.902111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.902165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.902204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.902210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.902265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.902317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.902373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.902428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.902466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.902471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.902528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:15.902580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:15.902634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:15.902703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:15.902747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:15.902752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:15.902788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128918:5401], now have 1 active actors on pipe
2025-10-10T14:32:15.903027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:15.903058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600866612128918:5401]
2025-10-10T14:32:15.903083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:15.903085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:15.903116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 508 reason: error at write: Disconnected sessionId: src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0
2025-10-10T14:32:15.903318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 508 sessionId: src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0 is DEAD
2025-10-10T14:32:15.903352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:15.903466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:15.903476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0] Write session will restart in 0.005593s
2025-10-10T14:32:15.903494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0] Write session: Do CDS request
2025-10-10T14:32:15.903498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:15.909723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.909767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:15.909781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 509
2025-10-10T14:32:15.909939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:15.909978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:15.909990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:15.909993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:15.910395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 509 sessionId:  describe result for acl check
2025-10-10T14:32:15.910423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:15.910425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:15.910426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:15.910432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600866612128965:5442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:15.910958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600866612128965:5442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:15.911133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:15.912577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:15.912710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:15.912719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:15.912729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:15.912768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:15.912800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600865829918270:4510]
2025-10-10T14:32:15.913177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:15.913398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:15.913434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:15.913501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600866612128965:5442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:15.913658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:15.913705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.913710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.913711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.913711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.913712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.913713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.913714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.913714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.913715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.913716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.913716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.913717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.913718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.913721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.913729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.913731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.913734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.913737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.913740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.913742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.913744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.913745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.913748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.913749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.913751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.913753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.913758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.913763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:15.913768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.913771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:15.913774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.913777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:15.913780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.913783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:15.913785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.913788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:15.913790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.913793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:15.913796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.913798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:15.913801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.913804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:15.913806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.913809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:15.913812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.913815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:15.913819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.913822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.913825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.913828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.913833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.913836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.913857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:15.915763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600866612128965:5442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:15.915776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600866612128965:5442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:15.915780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600866612128965:5442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:15.915785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:15.915828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:15.916106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:15.916115Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:15.916116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:15.916119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:15.916123Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 508 [2:7559600865829918270:4510]
2025-10-10T14:32:15.916130Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:15.916140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:15.916141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.916143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.916145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.916156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:15.916160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:15.916166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:15.916203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.916208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.916209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.916211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:15.916293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:15.916299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.916306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:15.916315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:15.916328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:15.916345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612129002:5442], now have 1 active actors on pipe
2025-10-10T14:32:15.916351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600866612128919:2438], now have 1 active actors on pipe
2025-10-10T14:32:15.916331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 508
2025-10-10T14:32:15.916357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600865829918265:4510]
2025-10-10T14:32:15.916361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600865829918265:4510]
2025-10-10T14:32:15.916333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 508
2025-10-10T14:32:15.916362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600865829918265:4510]
2025-10-10T14:32:15.916368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:15.916376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:15.916379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:15.916383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:15.916384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:15.916389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:15.916391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:15.916406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.916415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.916442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600865829918265:4510]
2025-10-10T14:32:15.916453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:15.916459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:15.916468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|427139e9-3671925-f0df7ca8-34396397_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:15.916476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:15.916478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:15.916480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:15.916487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:15.916494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:15.916520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.916639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:15.916646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:15.916657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:15.916726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 509 partition: 0 MaxSeqNo: 40 sessionId: src_id|427139e9-3671925-f0df7ca8-34396397_0
2025-10-10T14:32:15.916952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb27d0-c6a85f2c-366a2b65-8fc8b4ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|427139e9-3671925-f0df7ca8-34396397_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:15.919302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427139e9-3671925-f0df7ca8-34396397_0] Write session: try to update token
2025-10-10T14:32:15.919315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427139e9-3671925-f0df7ca8-34396397_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:15.934124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId: src_id|427139e9-3671925-f0df7ca8-34396397_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:15.934986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:15.935004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:15.935007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:15.935009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:15.935023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600865829918265:4510]
2025-10-10T14:32:15.935027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600865829918265:4510]
2025-10-10T14:32:15.935030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600865829918265:4510]
2025-10-10T14:32:15.935076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:15.935078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:15.935088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:15.935090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:15.935090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:15.935094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:15.935225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:15.936804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:16.003269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600870907096306:5401]
2025-10-10T14:32:16.003502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 508, pipe: [1:7559600870907096306:5401]
2025-10-10T14:32:16.039766Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:16.040018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.040032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.040069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096306:5401], now have 1 active actors on pipe
2025-10-10T14:32:16.040247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:16.040300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:16.040316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:16.040386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 509 reason: error at write: Disconnected sessionId: src_id|427139e9-3671925-f0df7ca8-34396397_0
2025-10-10T14:32:16.040601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 509 sessionId: src_id|427139e9-3671925-f0df7ca8-34396397_0 is DEAD
2025-10-10T14:32:16.040771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600870907096306:5401]
2025-10-10T14:32:16.040792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427139e9-3671925-f0df7ca8-34396397_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:16.040806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427139e9-3671925-f0df7ca8-34396397_0] Write session will restart in 0.008454s
2025-10-10T14:32:16.040834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427139e9-3671925-f0df7ca8-34396397_0] Write session: Do CDS request
2025-10-10T14:32:16.040841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427139e9-3671925-f0df7ca8-34396397_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:16.040844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:16.047760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:16.049136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:16.049303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:16.049312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:16.049322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:16.049387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:16.049416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600870124885686:4518]
2025-10-10T14:32:16.049808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:16.050063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:16.050103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:16.050331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:16.050370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.050377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.050377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.050378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.050379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.050379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.050380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.050380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.050381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.050381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.050382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.050382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.050383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.050387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.050394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.050397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.050399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.050401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.050404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.050406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.050408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.050410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.050413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.050415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.050417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.050419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.050424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.050431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.050436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.050439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.050441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.050444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.050447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.050450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.050452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.050455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.050457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.050461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.050463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.050466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.050468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.050471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.050474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.050477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.050479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.050483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.050488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.050493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.050496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.050501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.050505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.050511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.050537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:16.050819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427139e9-3671925-f0df7ca8-34396397_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.050900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:16.050916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 510
2025-10-10T14:32:16.051107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.051136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:16.051146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:16.051150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:16.051483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 510 sessionId:  describe result for acl check
2025-10-10T14:32:16.051515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:16.051521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:16.051522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:16.051528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600870907096377:5452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:16.051929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600870907096377:5452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:16.052596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:16.052886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:16.052897Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:16.052898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:16.052901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:16.052905Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 509 [2:7559600870124885686:4518]
2025-10-10T14:32:16.052913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:16.052927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:16.052933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.052935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.052936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.052948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:16.052953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:16.052959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:16.052995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.053000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.053001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.053002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:16.053059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:16.053065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.053071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.053078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.053090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:16.053108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096320:2438], now have 1 active actors on pipe
2025-10-10T14:32:16.053117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600870124885666:4518]
2025-10-10T14:32:16.053118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600870124885666:4518]
2025-10-10T14:32:16.053119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600870124885666:4518]
2025-10-10T14:32:16.053125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:16.053133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:16.053135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:16.053141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:16.053143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:16.053144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:16.053146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:16.053163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600870124885666:4518]
2025-10-10T14:32:16.053164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:16.053166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:16.053317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600870907096377:5452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:16.053414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 509
2025-10-10T14:32:16.057384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600870907096377:5452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:16.057399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600870907096377:5452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:16.057403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600870907096377:5452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:16.057411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:16.057588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096418:5452], now have 1 active actors on pipe
2025-10-10T14:32:16.057618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 509
2025-10-10T14:32:16.057669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.057682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.057707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:16.057716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.057724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.057726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:16.057736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.057753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:16.057769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.057895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.057903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.057915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.057984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 510 partition: 0 MaxSeqNo: 40 sessionId: src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0
2025-10-10T14:32:16.058308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427139e9-3671925-f0df7ca8-34396397_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:16.060860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0] Write session: try to update token
2025-10-10T14:32:16.060876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:16.071302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:16.071325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.071328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:16.071331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:16.071340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600870124885666:4518]
2025-10-10T14:32:16.071344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600870124885666:4518]
2025-10-10T14:32:16.071348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600870124885666:4518]
2025-10-10T14:32:16.071384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:16.071397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:16.071401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:16.071405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.071406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:16.071407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:16.071550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:16.073746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId: src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:16.076133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:16.141001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600870907096422:5401]
2025-10-10T14:32:16.141233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 509, pipe: [1:7559600870907096422:5401]
2025-10-10T14:32:16.179682Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:16.180097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.180113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.180152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096422:5401], now have 1 active actors on pipe
2025-10-10T14:32:16.180371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:16.180357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:16.180369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600870907096422:5401]
2025-10-10T14:32:16.180397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:16.180400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:16.180473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 510 reason: error at write: Disconnected sessionId: src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0
2025-10-10T14:32:16.180678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 510 sessionId: src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0 is DEAD
2025-10-10T14:32:16.180818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:16.180828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0] Write session will restart in 0.009008s
2025-10-10T14:32:16.180847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0] Write session: Do CDS request
2025-10-10T14:32:16.180851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:16.188206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:16.189578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:16.189741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:16.189750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:16.189759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:16.189793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:16.189824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600870124885795:4528]
2025-10-10T14:32:16.190209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:16.190443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:16.190470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:16.190681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:16.190720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.190725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.190726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.190726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.190727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.190728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.190728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.190729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.190730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.190731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.190731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.190732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.190733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.190736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.190745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.190747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.190749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.190751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.190754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.190756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.190758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.190760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.190763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.190765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.190767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.190769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.190776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.190782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.190786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.190790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.190792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.190796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.190798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.190802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.190805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.190807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.190811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.190814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.190817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.190820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.190823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.190826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.190828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.190832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.190834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.190837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.190840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.190843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.190845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.190857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.190848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.190851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.190854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.190876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:16.190956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:16.190974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 511
2025-10-10T14:32:16.191103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.191135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:16.191145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:16.191150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:16.191531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 511 sessionId:  describe result for acl check
2025-10-10T14:32:16.191562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:16.191569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:16.191573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:16.191579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600870907096490:5460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:16.192133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600870907096490:5460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:16.193071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:16.193401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:16.193409Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:16.193412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:16.193416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:16.193422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 510 [2:7559600870124885795:4528]
2025-10-10T14:32:16.193436Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:16.193460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:16.193469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.193471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.193473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.193485Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:16.193491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:16.193497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:16.193535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.193540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.193542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.193543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:16.193614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:16.193623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.193634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.193651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.193670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:16.193673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 510
2025-10-10T14:32:16.193696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096435:2438], now have 1 active actors on pipe
2025-10-10T14:32:16.193709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600870124885790:4528]
2025-10-10T14:32:16.193711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600870124885790:4528]
2025-10-10T14:32:16.193713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600870124885790:4528]
2025-10-10T14:32:16.193722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:16.193730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:16.193732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:16.193733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:16.193735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:16.193753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:16.193757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:16.193784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600870124885790:4528]
2025-10-10T14:32:16.193793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:16.193814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:16.194069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600870907096490:5460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:16.198538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600870907096490:5460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:16.198552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600870907096490:5460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:16.198555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600870907096490:5460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:16.198563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:16.198767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096524:5460], now have 1 active actors on pipe
2025-10-10T14:32:16.198817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 510
2025-10-10T14:32:16.198886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.198897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.198928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:16.198944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.198953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.198955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:16.198973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.198992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:16.199014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.199152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.199159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.199174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.199253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 511 partition: 0 MaxSeqNo: 40 sessionId: src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0
2025-10-10T14:32:16.199572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f04cd9c-4825051e-cf1228c4-6d93f612_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:16.202147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0] Write session: try to update token
2025-10-10T14:32:16.202162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:16.204490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:16.204505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.204514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600870124885790:4528]
2025-10-10T14:32:16.204552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:16.204557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:16.204723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:16.204865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.204998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.205147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.205325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:16.205380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:16.215198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId: src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:16.217599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:16.217761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.217781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.217831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:16.217901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:16.221727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:16.221747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.221753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:16.221755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:16.221764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600870124885790:4528]
2025-10-10T14:32:16.221769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600870124885790:4528]
2025-10-10T14:32:16.221772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600870124885790:4528]
2025-10-10T14:32:16.221809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:16.221817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:16.221820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:16.221824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:16.221826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.221829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:16.221958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:16.280816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600870907096530:5401]
2025-10-10T14:32:16.281067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 510, pipe: [1:7559600870907096530:5401]
2025-10-10T14:32:16.325211Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:16.331889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.331915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.332071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.332147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.332225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.332299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.332350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.332361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.332437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.332506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.332571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.332630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.332670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.332676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.332735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.332790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.332846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.332898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.332937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.332942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.332998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.333052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.333107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.333162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.333202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.333207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.333266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.333317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.333399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.333455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.333494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.333499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.333558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.333610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.333665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.333724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.333764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.333769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.333827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.333879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.333936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.333992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.334031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.334038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.334096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.334145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.334204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.334260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.334297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.334302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.334358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.334413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.334466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.334520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.334559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.334565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.334621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.334685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.334741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.334794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.334832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.334839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.334877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096530:5401], now have 1 active actors on pipe
2025-10-10T14:32:16.335118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:16.335131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600870907096530:5401]
2025-10-10T14:32:16.335166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:16.335168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:16.335197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 511 reason: error at write: Disconnected sessionId: src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0
2025-10-10T14:32:16.335392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 511 sessionId: src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0 is DEAD
2025-10-10T14:32:16.335489Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:16.335541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:16.335548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0] Write session will restart in 0.005948s
2025-10-10T14:32:16.335571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0] Write session: Do CDS request
2025-10-10T14:32:16.335576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:16.342348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:16.342756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.342898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:16.342912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 512
2025-10-10T14:32:16.343014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.343047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:16.343056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:16.343061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:16.343408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:16.343461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 512 sessionId:  describe result for acl check
2025-10-10T14:32:16.343497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:16.343504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:16.343506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:16.343512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600870907096584:5466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:16.343563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:16.343573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:16.343583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:16.343622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:16.343653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600870124885884:4530]
2025-10-10T14:32:16.344017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600870907096584:5466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:16.344064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:16.344304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:16.344338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:16.344551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:16.344588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.344594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.344595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.344595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.344596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.344597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.344598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.344599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.344600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.344601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.344602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.344603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.344604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.344610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.344620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.344625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.344629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.344633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.344637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.344641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.344645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.344648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.344652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.344653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.344655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.344658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.344662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.344667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.344671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.344675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.344677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.344680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.344683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.344686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.344688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.344691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.344695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.344698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.344700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.344703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.344706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.344709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.344711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.344714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.344717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.344719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.344722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.344725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.344728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.344731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.344733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.344736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.344760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:16.346523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600870907096584:5466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:16.346844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:16.347128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:16.347139Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:16.347140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:16.347144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:16.347149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 511 [2:7559600870124885884:4530]
2025-10-10T14:32:16.347160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:16.347175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:16.347182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.347184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.347186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.347196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:16.347205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:16.347210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:16.347246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.347251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.347253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.347255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:16.347297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:16.347302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.347309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.347319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.347331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:16.347349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096532:2438], now have 1 active actors on pipe
2025-10-10T14:32:16.347359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600870124885879:4530]
2025-10-10T14:32:16.347361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600870124885879:4530]
2025-10-10T14:32:16.347362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600870124885879:4530]
2025-10-10T14:32:16.347358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 511
2025-10-10T14:32:16.347368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:16.347377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:16.347382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:16.347387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:16.347388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:16.347391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:16.347392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:16.347410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600870124885879:4530]
2025-10-10T14:32:16.347421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:16.347432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:16.352021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600870907096584:5466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:16.352033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600870907096584:5466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:16.352036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600870907096584:5466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:16.352041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:16.352216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096622:5466], now have 1 active actors on pipe
2025-10-10T14:32:16.352279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 511
2025-10-10T14:32:16.352356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.352370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.352399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:16.352414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.352419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.352421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:16.352433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.352446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:16.352463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.352610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.352618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.352630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.352697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 512 partition: 0 MaxSeqNo: 40 sessionId: src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0
2025-10-10T14:32:16.352985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce5f32eb-e0458709-25ef283b-71e6dd84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:16.355425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0] Write session: try to update token
2025-10-10T14:32:16.355440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:16.358228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:16.358248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.358260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600870124885879:4530]
2025-10-10T14:32:16.358306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:16.358308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:16.358479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:16.358623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.358768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.358908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.359088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:16.359133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:16.368728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId: src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:16.371095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:16.371277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.371298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.371340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:16.371405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:16.375416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:16.375435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.375438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:16.375440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:16.375451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600870124885879:4530]
2025-10-10T14:32:16.375454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600870124885879:4530]
2025-10-10T14:32:16.375458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600870124885879:4530]
2025-10-10T14:32:16.375492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:16.375507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:16.375511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:16.375514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:16.375515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.375517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:16.375641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:16.435341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600870907096625:5401]
2025-10-10T14:32:16.435629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 511, pipe: [1:7559600870907096625:5401]
2025-10-10T14:32:16.478793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:16.485621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.485645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.485809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.485885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.485956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.486028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.486076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.486090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.486165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.486222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.486282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.486341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.486381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.486387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.486449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.486503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.486561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.486615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.486656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.486665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.486742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.486807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.486865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.486921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.486966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.486971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.487032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.487090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.487151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.487215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.487260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.487265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.487330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.487399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.487469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.487541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.487590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.487598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.487667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.487739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.487810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.487870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.487911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.487917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.487978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.488045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.488103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.488161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.488203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.488208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.488269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.488326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.488381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.488437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.488481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.488487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.488546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.488600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.488656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.488712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.488751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.488755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.488795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096625:5401], now have 1 active actors on pipe
2025-10-10T14:32:16.489058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:16.489066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:16.489071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:16.489103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 512 reason: error at write: Disconnected sessionId: src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0
2025-10-10T14:32:16.489123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600870907096625:5401]
2025-10-10T14:32:16.489439Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:16.489467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:16.489477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0] Write session will restart in 0.006378s
2025-10-10T14:32:16.489496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0] Write session: Do CDS request
2025-10-10T14:32:16.489501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:16.489537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 512 sessionId: src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0 is DEAD
2025-10-10T14:32:16.496733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:16.496821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.496932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:16.496948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 513
2025-10-10T14:32:16.497047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.497080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:16.497091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:16.497094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:16.497557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 513 sessionId:  describe result for acl check
2025-10-10T14:32:16.497594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:16.497601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:16.497602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:16.497608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600870907096680:5470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:16.498141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600870907096680:5470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:16.498375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:16.498587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:16.498604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:16.498618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:16.498699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:16.498744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600870124885976:4532]
2025-10-10T14:32:16.499295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:16.499570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:16.499624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:16.499935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:16.500011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.500018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.500019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.500020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.500021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.500022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.500024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.500025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.500025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.500026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.500028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.500029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.500030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.500036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.500047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.500051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.500055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.500059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.500063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.500067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.500070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.500074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.500078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.500087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.500090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.500094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.500107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.500119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.500130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.500137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.500141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.500145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.500149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.500153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.500157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.500162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.500166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.500170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.500174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.500178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.500188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.500192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.500200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.500209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.500215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.500224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.500232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.500237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.500245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.500250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.500259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.500264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.500303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:16.501198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600870907096680:5470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:16.502565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:16.502933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:16.502947Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:16.502949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:16.502953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:16.502962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 512 [2:7559600870124885976:4532]
2025-10-10T14:32:16.502975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:16.502998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:16.503007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.503011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.503013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.503031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:16.503038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:16.503045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:16.503098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.503105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.503107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.503110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:16.503172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:16.503179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.503188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.503195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.503205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:16.503226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096627:2438], now have 1 active actors on pipe
2025-10-10T14:32:16.503236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600870124885971:4532]
2025-10-10T14:32:16.503241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600870124885971:4532]
2025-10-10T14:32:16.503242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600870124885971:4532]
2025-10-10T14:32:16.503254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:16.503269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:16.503286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:16.503291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:16.503294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:16.503299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:16.503301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:16.503312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600870124885971:4532]
2025-10-10T14:32:16.503319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:16.503329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:16.503313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 512
2025-10-10T14:32:16.505839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600870907096680:5470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:16.505855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600870907096680:5470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:16.505859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600870907096680:5470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:16.505868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:16.506100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096717:5470], now have 1 active actors on pipe
2025-10-10T14:32:16.506143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 512
2025-10-10T14:32:16.506200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.506211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.506248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:16.506263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.506273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.506281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:16.506294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.506313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:16.506333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.506493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.506502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.506516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.506593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 513 partition: 0 MaxSeqNo: 40 sessionId: src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0
2025-10-10T14:32:16.507006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaf0f5d-37848023-e36c3f6b-3d400913_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:16.509752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0] Write session: try to update token
2025-10-10T14:32:16.509768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:16.522017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:16.522040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.522045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:16.522047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:16.522057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600870124885971:4532]
2025-10-10T14:32:16.522062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600870124885971:4532]
2025-10-10T14:32:16.522067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600870124885971:4532]
2025-10-10T14:32:16.522105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:16.522115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:16.522119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:16.522123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:16.522123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.522126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:16.522277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:16.523132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId: src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:16.525696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:16.589509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600870907096732:5401]
2025-10-10T14:32:16.589724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 512, pipe: [1:7559600870907096732:5401]
2025-10-10T14:32:16.630030Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:16.630260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.630281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.630326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096732:5401], now have 1 active actors on pipe
2025-10-10T14:32:16.630488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:16.630528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:16.630543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:16.630545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600870907096732:5401]
2025-10-10T14:32:16.630562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:16.630600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 513 reason: error at write: Disconnected sessionId: src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0
2025-10-10T14:32:16.630840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 513 sessionId: src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0 is DEAD
2025-10-10T14:32:16.630989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:16.630999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0] Write session will restart in 0.007833s
2025-10-10T14:32:16.631017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0] Write session: Do CDS request
2025-10-10T14:32:16.631021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:16.638234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:16.639627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:16.639793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:16.639803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:16.639804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.639813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:16.639853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:16.639891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600870124886071:4535]
2025-10-10T14:32:16.639911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:16.639924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 514
2025-10-10T14:32:16.640033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.640055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:16.640063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:16.640066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:16.640334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:16.640439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 514 sessionId:  describe result for acl check
2025-10-10T14:32:16.640469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:16.640471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:16.640473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:16.640479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600870907096793:5476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:16.640589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:16.640629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:16.640893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:16.640934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600870907096793:5476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:16.640942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.640948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.640949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.640950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.640951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.640952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.640953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.640954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.640955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.640956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.640958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.640959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.640960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.640965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.640976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.640980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.640984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.640988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.640992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.640996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.641000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.641004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.641008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.641012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.641017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.641021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.641032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.641045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.641055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.641060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.641070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.641075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.641083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.641088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.641092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.641099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.641103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.641108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.641116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.641121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.641129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.641134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.641141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.641146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.641155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.641160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.641167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.641172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.641181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.641191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.641200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.641206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.641244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:16.642711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600870907096793:5476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:16.643247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:16.643548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:16.643561Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:16.643565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:16.643569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:16.643574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 513 [2:7559600870124886071:4535]
2025-10-10T14:32:16.643584Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:16.643603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:16.643611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.643614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.643616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.643631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:16.643643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:16.643654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:16.643705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.643711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.643712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.643715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:16.643777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:16.643786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.643796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.643808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.643825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:16.643850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096737:2438], now have 1 active actors on pipe
2025-10-10T14:32:16.643862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600870124886066:4535]
2025-10-10T14:32:16.643864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600870124886066:4535]
2025-10-10T14:32:16.643855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 513
2025-10-10T14:32:16.643866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600870124886066:4535]
2025-10-10T14:32:16.643875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:16.643881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:16.643882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:16.643884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:16.643889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:16.643905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:16.643908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:16.643934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600870124886066:4535]
2025-10-10T14:32:16.643945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:16.643948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:16.648108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600870907096793:5476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:16.648128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600870907096793:5476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:16.648131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600870907096793:5476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:16.648136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:16.648338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096829:5476], now have 1 active actors on pipe
2025-10-10T14:32:16.648371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 513
2025-10-10T14:32:16.648427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.648438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.648467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e25b903-3dab659d-b6617aa0-54100d28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:16.648481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.648486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.648489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:16.648501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.648520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:16.648541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.648665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.648674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.648688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.648771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 514 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e25b903-3dab659d-b6617aa0-54100d28_0
2025-10-10T14:32:16.649100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c57687f6-7dd2b60d-2972dd6a-dc02e009_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e25b903-3dab659d-b6617aa0-54100d28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:16.651477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e25b903-3dab659d-b6617aa0-54100d28_0] Write session: try to update token
2025-10-10T14:32:16.651494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e25b903-3dab659d-b6617aa0-54100d28_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:16.663466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:16.663494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.663499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:16.663501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:16.663514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600870124886066:4535]
2025-10-10T14:32:16.663521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600870124886066:4535]
2025-10-10T14:32:16.663528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600870124886066:4535]
2025-10-10T14:32:16.663581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:16.663593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:16.663596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:16.663605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.663606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:16.663618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:16.663893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:16.665570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId: src_id|7e25b903-3dab659d-b6617aa0-54100d28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:16.667999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:16.730818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600870907096832:5401]
2025-10-10T14:32:16.731094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 513, pipe: [1:7559600870907096832:5401]
2025-10-10T14:32:16.765843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:16.766086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.766101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.766145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096832:5401], now have 1 active actors on pipe
2025-10-10T14:32:16.766398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600870907096832:5401]
2025-10-10T14:32:16.766402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:16.766406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:16.766428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:16.766471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 514 reason: error at write: Disconnected sessionId: src_id|7e25b903-3dab659d-b6617aa0-54100d28_0
2025-10-10T14:32:16.766492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:16.766650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 514 sessionId: src_id|7e25b903-3dab659d-b6617aa0-54100d28_0 is DEAD
2025-10-10T14:32:16.766852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e25b903-3dab659d-b6617aa0-54100d28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:16.766864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e25b903-3dab659d-b6617aa0-54100d28_0] Write session will restart in 0.008998s
2025-10-10T14:32:16.766883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e25b903-3dab659d-b6617aa0-54100d28_0] Write session: Do CDS request
2025-10-10T14:32:16.766891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e25b903-3dab659d-b6617aa0-54100d28_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:16.773969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:16.775251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:16.775404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:16.775415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:16.775424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:16.775465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:16.775503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600870124886165:4537]
2025-10-10T14:32:16.775897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:16.776132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:16.776160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:16.776379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:16.776422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.776427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.776428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.776428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.776429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.776429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.776430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.776431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.776431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.776431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.776432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.776433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.776433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.776438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.776449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.776453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.776457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.776461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.776464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.776468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.776472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.776474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.776478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.776483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.776487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.776490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.776498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.776507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.776511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.776516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.776520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.776525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.776529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.776533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.776537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.776547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.776550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.776560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.776569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.776579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.776584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.776591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.776594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.776597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.776599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.776605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.776607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.776611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.776613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.776616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.776619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.776621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.776643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:16.776784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e25b903-3dab659d-b6617aa0-54100d28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.776843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:16.776855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 515
2025-10-10T14:32:16.776947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.776977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:16.776985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:16.776988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:16.777445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 515 sessionId:  describe result for acl check
2025-10-10T14:32:16.777479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:16.777486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:16.777487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:16.777494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600870907096893:5480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:16.778084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600870907096893:5480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:16.778732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:16.779042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:16.779055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:16.779057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:16.779060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:16.779065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 514 [2:7559600870124886165:4537]
2025-10-10T14:32:16.779075Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:16.779095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:16.779102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.779105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.779107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.779122Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:16.779133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:16.779145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:16.779195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.779201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.779203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.779206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:16.779265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:16.779272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.779283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.779299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.779321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:16.779348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096833:2438], now have 1 active actors on pipe
2025-10-10T14:32:16.779361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600870124886160:4537]
2025-10-10T14:32:16.779368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600870124886160:4537]
2025-10-10T14:32:16.779358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 514
2025-10-10T14:32:16.779370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600870124886160:4537]
2025-10-10T14:32:16.779384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:16.779402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:16.779408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:16.779411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:16.779416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:16.779427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:16.779430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:16.779456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600870124886160:4537]
2025-10-10T14:32:16.779467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:16.779491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:16.779660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600870907096893:5480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:16.785892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600870907096893:5480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:16.785906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600870907096893:5480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:16.785909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600870907096893:5480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:16.785917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:16.786156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096926:5480], now have 1 active actors on pipe
2025-10-10T14:32:16.786200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 514
2025-10-10T14:32:16.786253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.786263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.786295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b82d189b-f0469019-87c7042b-a72cc892_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:16.786311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.786320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.786323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:16.786335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.786354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:16.786375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.786517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.786524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.786538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.786599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 515 partition: 0 MaxSeqNo: 40 sessionId: src_id|b82d189b-f0469019-87c7042b-a72cc892_0
2025-10-10T14:32:16.786901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e25b903-3dab659d-b6617aa0-54100d28_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b82d189b-f0469019-87c7042b-a72cc892_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:16.789284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d189b-f0469019-87c7042b-a72cc892_0] Write session: try to update token
2025-10-10T14:32:16.789298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d189b-f0469019-87c7042b-a72cc892_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:16.790223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:16.790238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.790245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600870124886160:4537]
2025-10-10T14:32:16.790275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:16.790283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:16.790426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:16.790560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.790695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.790827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.791000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:16.791039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:16.801821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId: src_id|b82d189b-f0469019-87c7042b-a72cc892_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:16.804041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:16.804385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.804405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.804437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:16.804510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:16.807299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:16.807315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.807319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:16.807320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:16.807328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600870124886160:4537]
2025-10-10T14:32:16.807332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600870124886160:4537]
2025-10-10T14:32:16.807335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600870124886160:4537]
2025-10-10T14:32:16.807368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:16.807376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:16.807383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.807385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:16.807386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:16.807389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:16.807510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:16.866483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600870907096930:5401]
2025-10-10T14:32:16.866747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 514, pipe: [1:7559600870907096930:5401]
2025-10-10T14:32:16.911770Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:16.918145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.918170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.918319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.918373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.918428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.918482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.918649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.918658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.918726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.918781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.918838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.918898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.918940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.918945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.919002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.919056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.919111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.919168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.919217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.919223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.919280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.919443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.919499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.919552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.919595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.919603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.919676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.919744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.919814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.919886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.919933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.919944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.920020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.920075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.920140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.920194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.920235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.920241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.920296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.920348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.920404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.920459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.920497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.920502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.920558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.920610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.920663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.920728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.920766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.920771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.920824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.920876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.920931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.920987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.921024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.921030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.921085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:16.921136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:16.921189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:16.921244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:16.921293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:16.921304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:16.921366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096930:5401], now have 1 active actors on pipe
2025-10-10T14:32:16.921584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:16.921610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:16.921614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:16.921628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600870907096930:5401]
2025-10-10T14:32:16.921623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:16.921643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 515 reason: error at write: Disconnected sessionId: src_id|b82d189b-f0469019-87c7042b-a72cc892_0
2025-10-10T14:32:16.921866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 515 sessionId: src_id|b82d189b-f0469019-87c7042b-a72cc892_0 is DEAD
2025-10-10T14:32:16.921991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d189b-f0469019-87c7042b-a72cc892_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:16.922000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d189b-f0469019-87c7042b-a72cc892_0] Write session will restart in 0.008600s
2025-10-10T14:32:16.922017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d189b-f0469019-87c7042b-a72cc892_0] Write session: Do CDS request
2025-10-10T14:32:16.922021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d189b-f0469019-87c7042b-a72cc892_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:16.929417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:16.930957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:16.931160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:16.931174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:16.931186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:16.931240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:16.931282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600870124886260:4539]
2025-10-10T14:32:16.931901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d189b-f0469019-87c7042b-a72cc892_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.931939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:16.931956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 516
2025-10-10T14:32:16.932134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:16.932159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:16.932163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:16.932167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:16.932229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:16.932540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:16.932550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 516 sessionId:  describe result for acl check
2025-10-10T14:32:16.932581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:16.932588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:16.932587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:16.932590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:16.932596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600870907096989:5484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:16.932998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:16.933022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600870907096989:5484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:16.933053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.933060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.933061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.933062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.933063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.933064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.933066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.933067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.933068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.933069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.933070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.933071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.933072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.933078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.933090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.933095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.933099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.933103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.933108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.933112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.933118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.933122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.933126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.933130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.933138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.933142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.933149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.933158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:16.933168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.933173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:16.933175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.933178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:16.933182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.933187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:16.933196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.933201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:16.933209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.933215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:16.933223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.933233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:16.933237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.933242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:16.933247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.933257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:16.933265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.933275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:16.933283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.933293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.933301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.933307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.933316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.933327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.933391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:16.935329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600870907096989:5484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:16.935909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:16.936343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:16.936358Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:16.936361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:16.936364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:16.936370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 515 [2:7559600870124886260:4539]
2025-10-10T14:32:16.936381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:16.936404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:16.936412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.936417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.936419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.936436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:16.936448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:16.936462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:16.936521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.936528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.936530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.936533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:16.936595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:16.936602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.936613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:16.936629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:16.936643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:16.936668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907096931:2438], now have 1 active actors on pipe
2025-10-10T14:32:16.936681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600870124886255:4539]
2025-10-10T14:32:16.936698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600870124886255:4539]
2025-10-10T14:32:16.936700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600870124886255:4539]
2025-10-10T14:32:16.936713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:16.936701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 515
2025-10-10T14:32:16.936727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:16.936730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:16.936744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:16.936747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:16.936751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:16.936753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:16.936771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600870124886255:4539]
2025-10-10T14:32:16.936781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:16.936797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:16.941577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600870907096989:5484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:16.941591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600870907096989:5484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:16.941594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600870907096989:5484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:16.941601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:16.941803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600870907097025:5484], now have 1 active actors on pipe
2025-10-10T14:32:16.941841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 515
2025-10-10T14:32:16.941894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.941905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.941935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:16.941949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:16.941959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:16.941961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:16.941976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:16.942006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:16.942026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.942148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.942160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.942175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:16.942256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 516 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0
2025-10-10T14:32:16.942596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b82d189b-f0469019-87c7042b-a72cc892_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:16.944946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0] Write session: try to update token
2025-10-10T14:32:16.944957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:16.947604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:16.947623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.947634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600870124886255:4539]
2025-10-10T14:32:16.947664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:16.947675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:16.947918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:16.948131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.948333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.948544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:16.948796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:16.948845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:16.959025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId: src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:16.961315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:16.961525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:16.961557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:16.961593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:16.961664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:16.964520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:16.964535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:16.964537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:16.964538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:16.964548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600870124886255:4539]
2025-10-10T14:32:16.964552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600870124886255:4539]
2025-10-10T14:32:16.964556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600870124886255:4539]
2025-10-10T14:32:16.964604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:16.964614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:16.964615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:16.964617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:16.964621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:16.964624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:16.964751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:17.021623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600875202064325:5401]
2025-10-10T14:32:17.021823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 515, pipe: [1:7559600875202064325:5401]
2025-10-10T14:32:17.068294Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:17.074699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.074721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.074875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.074931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.074990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.075048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.075090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.075098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.075157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.075227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.075288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.075346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.075387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.075392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.075453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.075506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.075562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.075620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.075660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.075666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.075726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.075934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.075993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.076047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.076085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.076090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.076149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.076203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.076274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.076331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.076371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.076376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.076433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.076485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.076539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.076596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.076636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.076641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.076697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.076752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.076811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.076867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.076906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.076911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.076970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.077026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.077082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.077140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.077179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.077184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.077240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.077296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.077375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.077436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.077475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.077480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.077538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.077589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.077644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.077700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.077741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.077748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.077793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064325:5401], now have 1 active actors on pipe
2025-10-10T14:32:17.077989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600875202064325:5401]
2025-10-10T14:32:17.078031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:17.078033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:17.078057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 516 reason: error at write: Disconnected sessionId: src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0
2025-10-10T14:32:17.078275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 516 sessionId: src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0 is DEAD
2025-10-10T14:32:17.078379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:17.078388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0] Write session will restart in 0.008961s
2025-10-10T14:32:17.078405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0] Write session: Do CDS request
2025-10-10T14:32:17.078409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:17.078426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:17.078500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:17.086944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:17.088420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:17.088604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:17.088614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:17.088626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:17.088682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:17.088723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600874419853683:4547]
2025-10-10T14:32:17.088827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.088872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:17.088895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 517
2025-10-10T14:32:17.089048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.089080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:17.089087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:17.089090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:17.089308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:17.089409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 517 sessionId:  describe result for acl check
2025-10-10T14:32:17.089435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:17.089441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:17.089442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:17.089446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600875202064399:5494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:17.089593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:17.089642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:17.089874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600875202064399:5494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:17.089960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:17.090009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.090015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.090016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.090017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.090018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.090019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.090020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.090021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.090022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.090023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.090024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.090025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.090026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.090032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.090044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.090049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.090053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.090057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.090061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.090065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.090069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.090073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.090077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.090081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.090085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.090089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.090097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.090105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.090113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.090120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.090124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.090134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.090139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.090144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.090152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.090157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.090161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.090167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.090171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.090177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.090185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.090190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.090194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.090199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.090203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.090209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.090219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.090223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.090232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.090237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.090244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.090247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.090269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:17.091416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600875202064399:5494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:17.092468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:17.092787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:17.092800Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:17.092802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:17.092805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:17.092811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 516 [2:7559600874419853683:4547]
2025-10-10T14:32:17.092822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:17.092838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:17.092845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.092848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.092850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.092865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:17.092877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:17.092885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:17.092938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.092944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.092948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.092950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:17.093009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:17.093016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.093026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.093040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.093059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:17.093066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 516
2025-10-10T14:32:17.093083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064339:2438], now have 1 active actors on pipe
2025-10-10T14:32:17.093094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600874419853678:4547]
2025-10-10T14:32:17.093097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600874419853678:4547]
2025-10-10T14:32:17.093099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600874419853678:4547]
2025-10-10T14:32:17.093107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:17.093113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:17.093115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:17.093116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:17.093123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:17.093138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:17.093145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:17.093169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600874419853678:4547]
2025-10-10T14:32:17.093179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:17.093180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:17.095626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600875202064399:5494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:17.095637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600875202064399:5494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:17.095639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600875202064399:5494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:17.095645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:17.095864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064445:5494], now have 1 active actors on pipe
2025-10-10T14:32:17.095895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 516
2025-10-10T14:32:17.095935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.095946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.095977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:17.095992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.096001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.096003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:17.096015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.096035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:17.096054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.096217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.096227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.096242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.096320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 517 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0
2025-10-10T14:32:17.096622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7676b-9f82017b-e06aeca4-cc1fdcda_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:17.099144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0] Write session: try to update token
2025-10-10T14:32:17.099158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:17.104184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:17.104209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.104220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600874419853678:4547]
2025-10-10T14:32:17.104252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:17.104268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:17.104441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:17.104640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:17.104799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:17.104950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:17.105184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:17.105229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:17.111910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId: src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:17.114318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:17.114529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.114555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.114597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:17.114696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:17.120610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:17.120632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.120635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:17.120640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:17.120650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600874419853678:4547]
2025-10-10T14:32:17.120653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600874419853678:4547]
2025-10-10T14:32:17.120657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600874419853678:4547]
2025-10-10T14:32:17.120696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:17.120701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:17.120707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:17.120711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:17.120711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.120713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:17.120854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:17.178314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600875202064461:5401]
2025-10-10T14:32:17.178562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 516, pipe: [1:7559600875202064461:5401]
2025-10-10T14:32:17.225693Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:17.232169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.232195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.232355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.232409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.232464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.232518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.232692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.232702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.232762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.232813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.232869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.232925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.232963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.232970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.233027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.233078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.233132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.233187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.233226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.233232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.233287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.233353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.233407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.233462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.233507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.233517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.233586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.233649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.233713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.233777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.233822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.233830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.233893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.233954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.234017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.234079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.234124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.234135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.234199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.234259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.234324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.234386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.234449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.234458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.234522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.234587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.234647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.234719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.234759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.234766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.234823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.234872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.234925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.234978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.235016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.235021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.235077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.235129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.235182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.235234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.235273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.235278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.235320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064461:5401], now have 1 active actors on pipe
2025-10-10T14:32:17.235548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:17.235562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:17.235562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:17.235593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 517 reason: error at write: Disconnected sessionId: src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0
2025-10-10T14:32:17.235597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600875202064461:5401]
2025-10-10T14:32:17.235791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 517 sessionId: src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0 is DEAD
2025-10-10T14:32:17.235941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:17.235960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0] Write session will restart in 0.009298s
2025-10-10T14:32:17.235979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0] Write session: Do CDS request
2025-10-10T14:32:17.235984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:17.236039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:17.244294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:17.245835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:17.245985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:17.245995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:17.246004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:17.246046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:17.246078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600874419853799:4557]
2025-10-10T14:32:17.246487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:17.246734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:17.246766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:17.246791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.246882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:17.246899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 518
2025-10-10T14:32:17.247010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.247039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:17.247045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:17.247049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:17.247033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:17.247096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.247104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.247105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.247106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.247107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.247108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.247109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.247110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.247111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.247111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.247112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.247113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.247114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.247119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.247133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.247137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.247142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.247145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.247149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.247153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.247157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.247160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.247164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.247168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.247172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.247176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.247184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.247192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.247199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.247204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.247208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.247213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.247217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.247222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.247227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.247232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.247236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.247241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.247245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.247250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.247254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.247258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.247263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.247268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.247271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.247276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.247280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.247284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.247288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.247300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.247305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.247310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.247347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:17.247637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 518 sessionId:  describe result for acl check
2025-10-10T14:32:17.247669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:17.247670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:17.247672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:17.247676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600875202064525:5502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:17.248114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600875202064525:5502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:17.249437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:17.249760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:17.249775Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:17.249777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:17.249780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:17.249786Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 517 [2:7559600874419853799:4557]
2025-10-10T14:32:17.249796Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:17.249817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:17.249825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.249827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.249829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.249840Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:17.249851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:17.249863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:17.249914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.249921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.249923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.249925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:17.249982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:17.249991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.250001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.250011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.250026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:17.250025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 517
2025-10-10T14:32:17.250048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064462:2438], now have 1 active actors on pipe
2025-10-10T14:32:17.250059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600874419853794:4557]
2025-10-10T14:32:17.250061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600874419853794:4557]
2025-10-10T14:32:17.250063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600874419853794:4557]
2025-10-10T14:32:17.250071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:17.250080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:17.250083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:17.250083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:17.250084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:17.250100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:17.250105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:17.250129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600874419853794:4557]
2025-10-10T14:32:17.250141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:17.250155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:17.250354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600875202064525:5502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:17.256323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600875202064525:5502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:17.256336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600875202064525:5502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:17.256338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600875202064525:5502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:17.256345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:17.256550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064558:5502], now have 1 active actors on pipe
2025-10-10T14:32:17.256613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 517
2025-10-10T14:32:17.256643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.256653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.256684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77341dea-ce7cda85-798eecd5-1af728de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:17.256699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.256708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.256711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:17.256723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.256742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:17.256763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.256946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.256953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.256966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.257049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 518 partition: 0 MaxSeqNo: 40 sessionId: src_id|77341dea-ce7cda85-798eecd5-1af728de_0
2025-10-10T14:32:17.257383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca2e706-99823d0c-a4849f78-317e3b81_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77341dea-ce7cda85-798eecd5-1af728de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:17.259955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77341dea-ce7cda85-798eecd5-1af728de_0] Write session: try to update token
2025-10-10T14:32:17.259969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77341dea-ce7cda85-798eecd5-1af728de_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:17.260575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:17.260595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.260605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600874419853794:4557]
2025-10-10T14:32:17.260639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:17.260646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:17.260811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:17.260962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:17.261103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:17.261248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:17.261468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:17.261510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:17.272452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId: src_id|77341dea-ce7cda85-798eecd5-1af728de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:17.274871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:17.275225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.275252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.276901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:17.276934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:17.276937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.276940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:17.276942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:17.276951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600874419853794:4557]
2025-10-10T14:32:17.276956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600874419853794:4557]
2025-10-10T14:32:17.276959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600874419853794:4557]
2025-10-10T14:32:17.276990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:17.277000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:17.277006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.277009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:17.277013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:17.277016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:17.277013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:17.277139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:17.335993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600875202064562:5401]
2025-10-10T14:32:17.336248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 517, pipe: [1:7559600875202064562:5401]
2025-10-10T14:32:17.381595Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:17.388308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.388333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.388503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.388560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.388621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.388680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.388720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.388728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.388790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.388846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.388904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.388964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.389005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.389011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.389071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.389125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.389183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.389242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.389284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.389289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.389362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.389419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.389489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.389545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.389760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.389772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.389841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.389905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.389970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.390025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.390068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.390073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.390135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.390191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.390252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.390315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.390355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.390361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.390420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.390473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.390539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.390597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.390639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.390644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.390715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.390771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.390830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.390893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.390941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.390947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.391012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.391068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.391127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.391185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.391227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.391232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.391295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:17.391353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:17.391415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:17.391479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:17.391522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:17.391527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:17.391569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064562:5401], now have 1 active actors on pipe
2025-10-10T14:32:17.391799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:17.391817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600875202064562:5401]
2025-10-10T14:32:17.391848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:17.391851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:17.391891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 518 reason: error at write: Disconnected sessionId: src_id|77341dea-ce7cda85-798eecd5-1af728de_0
2025-10-10T14:32:17.392129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 518 sessionId: src_id|77341dea-ce7cda85-798eecd5-1af728de_0 is DEAD
2025-10-10T14:32:17.392296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77341dea-ce7cda85-798eecd5-1af728de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:17.392310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77341dea-ce7cda85-798eecd5-1af728de_0] Write session will restart in 0.007928s
2025-10-10T14:32:17.392337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77341dea-ce7cda85-798eecd5-1af728de_0] Write session: Do CDS request
2025-10-10T14:32:17.392343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77341dea-ce7cda85-798eecd5-1af728de_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:17.392320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:17.401268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:17.401805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77341dea-ce7cda85-798eecd5-1af728de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.401885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:17.401912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 519
2025-10-10T14:32:17.402022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.402065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:17.402076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:17.402082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:17.402496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 519 sessionId:  describe result for acl check
2025-10-10T14:32:17.402530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:17.402532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:17.402536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:17.402542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600875202064622:5506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:17.402600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:17.402780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:17.402791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:17.402803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:17.402854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:17.402894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600874419853897:4559]
2025-10-10T14:32:17.403088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600875202064622:5506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:17.403483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:17.403726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:17.403764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:17.404083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:17.404136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.404142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.404143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.404144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.404145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.404146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.404148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.404149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.404150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.404151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.404152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.404153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.404154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.404159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.404171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.404175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.404179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.404183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.404187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.404191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.404194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.404198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.404202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.404206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.404210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.404214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.404220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.404228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.404234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.404241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.404245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.404250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.404254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.404259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.404263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.404268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.404272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.404277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.404281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.404291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.404295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.404299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.404304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.404309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.404317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.404322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.404331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.404336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.404340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.404347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.404351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.404361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.404399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:17.405491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600875202064622:5506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:17.406462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:17.406900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:17.406913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:17.406915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:17.406919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:17.406924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 518 [2:7559600874419853897:4559]
2025-10-10T14:32:17.406935Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:17.406951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:17.406959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.406963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.406969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.406985Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:17.406996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:17.407008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:17.407064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.407072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.407074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.407077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:17.407140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:17.407150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.407161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.407174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.407192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:17.407214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064563:2438], now have 1 active actors on pipe
2025-10-10T14:32:17.407197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 518
2025-10-10T14:32:17.407227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600874419853892:4559]
2025-10-10T14:32:17.407229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600874419853892:4559]
2025-10-10T14:32:17.407232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600874419853892:4559]
2025-10-10T14:32:17.407240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:17.407253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:17.407262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:17.407265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:17.407266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:17.407270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:17.407273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:17.407303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600874419853892:4559]
2025-10-10T14:32:17.407315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:17.407318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:17.407702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600875202064622:5506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:17.407716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600875202064622:5506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:17.407719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600875202064622:5506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:17.407726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:17.407905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064657:5506], now have 1 active actors on pipe
2025-10-10T14:32:17.407946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 518
2025-10-10T14:32:17.407991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.408000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.408027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:17.408042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.408047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.408049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:17.408060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.408075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:17.408094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.408263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.408274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.408288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.408394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 519 partition: 0 MaxSeqNo: 40 sessionId: src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0
2025-10-10T14:32:17.408715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77341dea-ce7cda85-798eecd5-1af728de_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:17.411410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0] Write session: try to update token
2025-10-10T14:32:17.411426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:17.425266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId: src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:17.425420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:17.425438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.425440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:17.425441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:17.425450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600874419853892:4559]
2025-10-10T14:32:17.425453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600874419853892:4559]
2025-10-10T14:32:17.425458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600874419853892:4559]
2025-10-10T14:32:17.425497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:17.425500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:17.425506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:17.425510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.425510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:17.425512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:17.425652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:17.427717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:17.492191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600875202064664:5401]
2025-10-10T14:32:17.492410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 518, pipe: [1:7559600875202064664:5401]
2025-10-10T14:32:17.529967Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:17.530210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.530223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.530259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064664:5401], now have 1 active actors on pipe
2025-10-10T14:32:17.530433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:17.530459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:17.530466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600875202064664:5401]
2025-10-10T14:32:17.530483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:17.530553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 519 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0
2025-10-10T14:32:17.530728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 519 sessionId: src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0 is DEAD
2025-10-10T14:32:17.530853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:17.530862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0] Write session will restart in 0.009202s
2025-10-10T14:32:17.530880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0] Write session: Do CDS request
2025-10-10T14:32:17.530885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:17.539248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:17.540538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:17.540732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:17.540746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:17.540757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.540760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:17.540815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:17.540859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600874419853996:4561]
2025-10-10T14:32:17.540863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:17.540880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 520
2025-10-10T14:32:17.540970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.540993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:17.540999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:17.541002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:17.541326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 520 sessionId:  describe result for acl check
2025-10-10T14:32:17.541363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:17.541368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:17.541371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:17.541375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600875202064725:5510] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:17.541413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:17.541712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:17.541755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:17.541761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600875202064725:5510] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:17.541987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:17.542027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.542032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.542032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.542033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.542033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.542034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.542035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.542035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.542036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.542037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.542037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.542038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.542039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.542042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.542050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.542052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.542054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.542056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.542058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.542060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.542062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.542064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.542066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.542068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.542070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.542072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.542078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.542086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.542092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.542097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.542101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.542106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.542110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.542115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.542119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.542122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.542124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.542128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.542130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.542133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.542136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.542138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.542141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.542144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.542147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.542150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.542152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.542156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.542158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.542162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.542164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.542167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.542188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:17.543517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600875202064725:5510] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:17.544275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:17.544580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:17.544592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:17.544594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:17.544598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:17.544602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 519 [2:7559600874419853996:4561]
2025-10-10T14:32:17.544610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:17.544626Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:17.544631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.544633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.544635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.544647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:17.544659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:17.544671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:17.544717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.544724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.544725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.544728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:17.544787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:17.544793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.544799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.544805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.544816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:17.544841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064665:2438], now have 1 active actors on pipe
2025-10-10T14:32:17.544855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600874419853991:4561]
2025-10-10T14:32:17.544858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600874419853991:4561]
2025-10-10T14:32:17.544859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600874419853991:4561]
2025-10-10T14:32:17.544872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:17.544885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:17.544897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:17.544905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:17.544895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 519
2025-10-10T14:32:17.544908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:17.544908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:17.544910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:17.544927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600874419853991:4561]
2025-10-10T14:32:17.544929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:17.544931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:17.549062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600875202064725:5510] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:17.549075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600875202064725:5510] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:17.549078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600875202064725:5510] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:17.549085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:17.549303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064766:5510], now have 1 active actors on pipe
2025-10-10T14:32:17.549360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 519
2025-10-10T14:32:17.549425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.549432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.549470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:17.549485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.549494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.549497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:17.549526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.549544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:17.549568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.549732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.549743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.549762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.549846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 520 partition: 0 MaxSeqNo: 40 sessionId: src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0
2025-10-10T14:32:17.550190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a8d89b-e0a8f252-a9d2c653-1d56c3d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:17.552989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0] Write session: try to update token
2025-10-10T14:32:17.553006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:17.562226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:17.562247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.562253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:17.562255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:17.562265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600874419853991:4561]
2025-10-10T14:32:17.562269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600874419853991:4561]
2025-10-10T14:32:17.562272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600874419853991:4561]
2025-10-10T14:32:17.562315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:17.562319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:17.562326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.562327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:17.562329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:17.562330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:17.562473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:17.566258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId: src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:17.568741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:17.630396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600875202064779:5401]
2025-10-10T14:32:17.630592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 519, pipe: [1:7559600875202064779:5401]
2025-10-10T14:32:17.667213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:17.667428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.667439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.667477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064779:5401], now have 1 active actors on pipe
2025-10-10T14:32:17.667644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:17.667681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:17.667691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600875202064779:5401]
2025-10-10T14:32:17.667695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:17.667712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:17.667754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 520 reason: error at write: Disconnected sessionId: src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0
2025-10-10T14:32:17.667969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 520 sessionId: src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0 is DEAD
2025-10-10T14:32:17.668134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:17.668143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0] Write session will restart in 0.006725s
2025-10-10T14:32:17.668168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0] Write session: Do CDS request
2025-10-10T14:32:17.668180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:17.675502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:17.675838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.675885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:17.675899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 521
2025-10-10T14:32:17.676055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.676091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:17.676101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:17.676110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:17.676578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 521 sessionId:  describe result for acl check
2025-10-10T14:32:17.676609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:17.676616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:17.676618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:17.676623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600875202064841:5516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:17.677111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:17.677211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600875202064841:5516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:17.677262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:17.677274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:17.677284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:17.677341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:17.677377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600874419854096:4564]
2025-10-10T14:32:17.677835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:17.678114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:17.678159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:17.678398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:17.678438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.678443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.678443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.678444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.678445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.678445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.678446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.678447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.678447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.678448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.678448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.678449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.678450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.678454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.678465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.678469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.678472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.678475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.678479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.678483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.678486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.678490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.678493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.678497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.678501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.678505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.678512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.678526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.678537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.678544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.678548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.678553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.678558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.678563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.678574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.678583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.678587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.678593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.678602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.678611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.678618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.678621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.678624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.678627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.678629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.678632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.678634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.678637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.678639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.678642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.678645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.678648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.678696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:17.679028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600875202064841:5516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:17.680740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:17.680994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600875202064841:5516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:17.681005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600875202064841:5516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:17.681007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600875202064841:5516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:17.681013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:17.681049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:17.681058Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:17.681060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:17.681063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:17.681067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 520 [2:7559600874419854096:4564]
2025-10-10T14:32:17.681076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:17.681093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:17.681095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.681097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.681098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.681110Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:17.681117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:17.681124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:17.681172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.681180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.681182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.681185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:17.681282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:17.681289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.681296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.681304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.681316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:17.681322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 520
2025-10-10T14:32:17.681351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064875:5516], now have 1 active actors on pipe
2025-10-10T14:32:17.681358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064780:2438], now have 1 active actors on pipe
2025-10-10T14:32:17.681326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 520
2025-10-10T14:32:17.681363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600874419854091:4564]
2025-10-10T14:32:17.681368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600874419854091:4564]
2025-10-10T14:32:17.681369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600874419854091:4564]
2025-10-10T14:32:17.681375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:17.681385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:17.681386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:17.681389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:17.681390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:17.681398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:17.681400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:17.681417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.681426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.681451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600874419854091:4564]
2025-10-10T14:32:17.681458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:17.681471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:17.681475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eae100aa-3bb56e74-42d3008a-972c2799_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:17.681481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.681484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.681485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:17.681493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.681501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:17.681541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.681669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.681683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.681706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.681796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 521 partition: 0 MaxSeqNo: 40 sessionId: src_id|eae100aa-3bb56e74-42d3008a-972c2799_0
2025-10-10T14:32:17.682068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7969271c-31ab6f68-b703cd38-6f7ce55d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eae100aa-3bb56e74-42d3008a-972c2799_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:17.684634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae100aa-3bb56e74-42d3008a-972c2799_0] Write session: try to update token
2025-10-10T14:32:17.684648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae100aa-3bb56e74-42d3008a-972c2799_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:17.697833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId: src_id|eae100aa-3bb56e74-42d3008a-972c2799_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:17.699405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:17.699428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.699431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:17.699434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:17.699442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600874419854091:4564]
2025-10-10T14:32:17.699446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600874419854091:4564]
2025-10-10T14:32:17.699450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600874419854091:4564]
2025-10-10T14:32:17.699499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:17.699499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:17.699504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:17.699508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:17.699510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.699516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:17.699652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:17.700332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:17.768082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600875202064882:5401]
2025-10-10T14:32:17.768323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 520, pipe: [1:7559600875202064882:5401]
2025-10-10T14:32:17.801746Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:17.802073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.802085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.802124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064882:5401], now have 1 active actors on pipe
2025-10-10T14:32:17.802338Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:17.802378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600875202064882:5401]
2025-10-10T14:32:17.802383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:17.802386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:17.802408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:17.802452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 521 reason: error at write: Disconnected sessionId: src_id|eae100aa-3bb56e74-42d3008a-972c2799_0
2025-10-10T14:32:17.802647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 521 sessionId: src_id|eae100aa-3bb56e74-42d3008a-972c2799_0 is DEAD
2025-10-10T14:32:17.802819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae100aa-3bb56e74-42d3008a-972c2799_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:17.802831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae100aa-3bb56e74-42d3008a-972c2799_0] Write session will restart in 0.007098s
2025-10-10T14:32:17.802854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae100aa-3bb56e74-42d3008a-972c2799_0] Write session: Do CDS request
2025-10-10T14:32:17.802861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae100aa-3bb56e74-42d3008a-972c2799_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:17.810310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:17.810876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae100aa-3bb56e74-42d3008a-972c2799_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.810976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:17.810991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 522
2025-10-10T14:32:17.811115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.811153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:17.811164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:17.811168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:17.811584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 522 sessionId:  describe result for acl check
2025-10-10T14:32:17.811617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:17.811623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:17.811625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:17.811632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600875202064946:5520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:17.811657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:17.811828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:17.811840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:17.811852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:17.811903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:17.811941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600874419854197:4566]
2025-10-10T14:32:17.812150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600875202064946:5520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:17.812524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:17.812781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:17.812821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:17.813122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:17.813176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.813181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.813183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.813184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.813185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.813186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.813187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.813188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.813189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.813190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.813191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.813192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.813194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.813199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.813211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.813215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.813219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.813223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.813227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.813231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.813235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.813239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.813248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.813252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.813260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.813264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.813275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.813288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.813294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.813301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.813311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.813316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.813322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.813345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.813355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.813359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.813363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.813367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.813372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.813375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.813379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.813383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.813386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.813390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.813394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.813398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.813402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.813406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.813409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.813414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.813418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.813422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.813460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:17.814011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600875202064946:5520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:17.815486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:17.815784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:17.815795Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:17.815798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:17.815801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:17.815807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 521 [2:7559600874419854197:4566]
2025-10-10T14:32:17.815816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:17.815833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:17.815838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.815841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.815842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.815857Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:17.815866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:17.815873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:17.815914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.815919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.815921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.815922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:17.815986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:17.815995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.816005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.816011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.816021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:17.816039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064884:2438], now have 1 active actors on pipe
2025-10-10T14:32:17.816048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600874419854192:4566]
2025-10-10T14:32:17.816050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600874419854192:4566]
2025-10-10T14:32:17.816051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600874419854192:4566]
2025-10-10T14:32:17.816062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:17.816074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:17.816073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 521
2025-10-10T14:32:17.816080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:17.816085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:17.816088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:17.816092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:17.816094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:17.816104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600874419854192:4566]
2025-10-10T14:32:17.816106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:17.816116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:17.816341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600875202064946:5520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:17.816353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600875202064946:5520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:17.816356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600875202064946:5520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:17.816363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:17.816540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064982:5520], now have 1 active actors on pipe
2025-10-10T14:32:17.816584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 521
2025-10-10T14:32:17.816655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.816666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.816694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b73c413-6703689e-5737072a-53009d11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:17.816709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.816714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.816716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:17.816726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.816739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:17.816755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.816880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.816887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.816902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.816968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 522 partition: 0 MaxSeqNo: 40 sessionId: src_id|b73c413-6703689e-5737072a-53009d11_0
2025-10-10T14:32:17.817304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae100aa-3bb56e74-42d3008a-972c2799_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b73c413-6703689e-5737072a-53009d11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:17.819864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73c413-6703689e-5737072a-53009d11_0] Write session: try to update token
2025-10-10T14:32:17.819886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73c413-6703689e-5737072a-53009d11_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:17.833786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:17.833804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.833806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:17.833807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:17.833815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600874419854192:4566]
2025-10-10T14:32:17.833818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600874419854192:4566]
2025-10-10T14:32:17.833821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600874419854192:4566]
2025-10-10T14:32:17.833857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:17.833863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.833865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:17.833867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:17.833873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:17.833877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:17.834021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:17.835127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId: src_id|b73c413-6703689e-5737072a-53009d11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:17.837702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:17.902775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600875202064987:5401]
2025-10-10T14:32:17.903015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 521, pipe: [1:7559600875202064987:5401]
2025-10-10T14:32:17.933489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:17.933770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.933784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.933820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064987:5401], now have 1 active actors on pipe
2025-10-10T14:32:17.934001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:17.934010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:17.934030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:17.934039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600875202064987:5401]
2025-10-10T14:32:17.934058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:17.934087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 522 reason: error at write: Disconnected sessionId: src_id|b73c413-6703689e-5737072a-53009d11_0
2025-10-10T14:32:17.934272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 522 sessionId: src_id|b73c413-6703689e-5737072a-53009d11_0 is DEAD
2025-10-10T14:32:17.934426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73c413-6703689e-5737072a-53009d11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:17.934438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73c413-6703689e-5737072a-53009d11_0] Write session will restart in 0.005571s
2025-10-10T14:32:17.934477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73c413-6703689e-5737072a-53009d11_0] Write session: Do CDS request
2025-10-10T14:32:17.934483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73c413-6703689e-5737072a-53009d11_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:17.940826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73c413-6703689e-5737072a-53009d11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.940882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:17.940894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 523
2025-10-10T14:32:17.941038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:17.941074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:17.941083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:17.941086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:17.941497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:17.941505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 523 sessionId:  describe result for acl check
2025-10-10T14:32:17.941542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:17.941545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:17.941547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:17.941551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600875202065050:5524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:17.942017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600875202065050:5524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:17.943030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:17.943192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:17.943202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:17.943214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:17.943265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:17.943302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600874419854299:4568]
2025-10-10T14:32:17.944077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600875202065050:5524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:17.944194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:17.944458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:17.944490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:17.944716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:17.944765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.944770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.944771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.944772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.944773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.944773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.944774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.944775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.944775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.944776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.944777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.944777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.944778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.944782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.944789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.944792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.944794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.944796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.944798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.944800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.944802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.944804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.944806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.944808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.944810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.944812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.944817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.944822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:17.944827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.944830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:17.944832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.944835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:17.944838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.944841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:17.944844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.944847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:17.944850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.944856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:17.944860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.944865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:17.944870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.944876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:17.944885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.944892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:17.944901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.944906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:17.944911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.944916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.944920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.944925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.944930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.944935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.944969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:17.946869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600875202065050:5524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:17.946880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600875202065050:5524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:17.946883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600875202065050:5524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:17.946889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:17.946975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:17.947362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:17.947374Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:17.947377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:17.947380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:17.947385Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 522 [2:7559600874419854299:4568]
2025-10-10T14:32:17.947396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:17.947414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:17.947421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.947424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.947427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.947442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:17.947453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:17.947464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:17.947516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.947523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.947525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.947528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:17.947587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:17.947595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.947606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:17.947618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:17.947644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:17.947668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202064988:2438], now have 1 active actors on pipe
2025-10-10T14:32:17.947676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600875202065085:5524], now have 1 active actors on pipe
2025-10-10T14:32:17.947682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600874419854294:4568]
2025-10-10T14:32:17.947688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600874419854294:4568]
2025-10-10T14:32:17.947689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600874419854294:4568]
2025-10-10T14:32:17.947666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 522
2025-10-10T14:32:17.947673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 522
2025-10-10T14:32:17.947698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:17.947716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:17.947718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:17.947725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:17.947727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:17.947735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:17.947742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:17.947758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.947766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.947797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600874419854294:4568]
2025-10-10T14:32:17.947809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:17.947828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:17.947829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:17.947836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:17.947840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:17.947842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:17.947852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:17.947865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:17.947897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.948029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:17.948037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:17.948051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:17.948138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 523 partition: 0 MaxSeqNo: 40 sessionId: src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0
2025-10-10T14:32:17.948431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73c413-6703689e-5737072a-53009d11_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:17.951027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0] Write session: try to update token
2025-10-10T14:32:17.951045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:17.963301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId: src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:17.965480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:17.965498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:17.965501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:17.965502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:17.965512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600874419854294:4568]
2025-10-10T14:32:17.965516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600874419854294:4568]
2025-10-10T14:32:17.965519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600874419854294:4568]
2025-10-10T14:32:17.965565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:17.965566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:17.965572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:17.965576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:17.965576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:17.965580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:17.965563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:17.965705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:18.034342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600879497032389:5401]
2025-10-10T14:32:18.034594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 522, pipe: [1:7559600879497032389:5401]
2025-10-10T14:32:18.076229Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:18.076480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.076491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.076528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032389:5401], now have 1 active actors on pipe
2025-10-10T14:32:18.076718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:18.076778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:18.076785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600879497032389:5401]
2025-10-10T14:32:18.076810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:18.076899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 523 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0
2025-10-10T14:32:18.077123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 523 sessionId: src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0 is DEAD
2025-10-10T14:32:18.077259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:18.077270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0] Write session will restart in 0.006201s
2025-10-10T14:32:18.077295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0] Write session: Do CDS request
2025-10-10T14:32:18.077301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:18.084609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:18.084816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.084848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:18.084861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 524
2025-10-10T14:32:18.085002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.085035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:18.085045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:18.085053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:18.085483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 524 sessionId:  describe result for acl check
2025-10-10T14:32:18.085521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:18.085527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:18.085529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:18.085534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600879497032454:5528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:18.085997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:18.086037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600879497032454:5528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:18.086146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:18.086156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:18.086166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:18.086215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:18.086250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600878714821698:4570]
2025-10-10T14:32:18.086818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:18.087029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:18.087070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:18.087370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:18.087419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.087425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.087426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.087427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.087428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.087429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.087431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.087432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.087433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.087434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.087435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.087436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.087437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.087442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.087453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.087457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.087461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.087465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.087469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.087473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.087477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.087485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.087489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.087497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.087500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.087504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.087511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.087523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.087535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.087544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.087552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.087561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.087569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.087579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.087587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.087596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.087604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.087613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.087622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.087626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.087630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.087635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.087644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.087653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.087661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.087666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.087675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.087684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.087692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.087702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.087710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.087718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.087754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:18.087876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600879497032454:5528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:18.089707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:18.090006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:18.090019Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:18.090021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:18.090024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:18.090029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 523 [2:7559600878714821698:4570]
2025-10-10T14:32:18.090042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:18.090061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:18.090069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.090072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.090074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.090088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:18.090101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:18.090109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:18.090128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600879497032454:5528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:18.090141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600879497032454:5528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:18.090144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600879497032454:5528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:18.090150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:18.090159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.090167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.090169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.090171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:18.090228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:18.090236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.090247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.090263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.090270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 523
2025-10-10T14:32:18.090284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:18.090308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032390:2438], now have 1 active actors on pipe
2025-10-10T14:32:18.090319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600878714821693:4570]
2025-10-10T14:32:18.090321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600878714821693:4570]
2025-10-10T14:32:18.090323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600878714821693:4570]
2025-10-10T14:32:18.090331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:18.090343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:18.090343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:18.090345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:18.090347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:18.090363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:18.090370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:18.090395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032488:5528], now have 1 active actors on pipe
2025-10-10T14:32:18.090403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600878714821693:4570]
2025-10-10T14:32:18.090405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:18.090405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 523
2025-10-10T14:32:18.090421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:18.090513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.090529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.090560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:18.090573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.090582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.090587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:18.090595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.090609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:18.090623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.090780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.090786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.090796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.090872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 524 partition: 0 MaxSeqNo: 40 sessionId: src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0
2025-10-10T14:32:18.091167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e625b2-8d399bde-66868549-a8f5c6f9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:18.093688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0] Write session: try to update token
2025-10-10T14:32:18.093703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:18.106764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId: src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:18.108547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:18.108565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.108568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:18.108570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:18.108579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600878714821693:4570]
2025-10-10T14:32:18.108583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600878714821693:4570]
2025-10-10T14:32:18.108587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600878714821693:4570]
2025-10-10T14:32:18.108633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:18.108632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:18.108638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:18.108641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:18.108647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.108650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:18.108781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:18.109180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:18.176691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600879497032532:5401]
2025-10-10T14:32:18.176930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 523, pipe: [1:7559600879497032532:5401]
2025-10-10T14:32:18.210562Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:18.210998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.211015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.211054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032532:5401], now have 1 active actors on pipe
2025-10-10T14:32:18.211261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:18.211280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:18.211285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:18.211293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:18.211326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600879497032532:5401]
2025-10-10T14:32:18.211353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 524 reason: error at write: Disconnected sessionId: src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0
2025-10-10T14:32:18.211580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 524 sessionId: src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0 is DEAD
2025-10-10T14:32:18.212125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:18.212135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0] Write session will restart in 0.007820s
2025-10-10T14:32:18.212161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0] Write session: Do CDS request
2025-10-10T14:32:18.212167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:18.219287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:18.220757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:18.220841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.220907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:18.220918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:18.220926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:18.220924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:18.220939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 525
2025-10-10T14:32:18.220969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:18.221004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600878714821852:4586]
2025-10-10T14:32:18.221239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.221270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:18.221279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:18.221281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:18.221520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:18.221611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 525 sessionId:  describe result for acl check
2025-10-10T14:32:18.221636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:18.221639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:18.221640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:18.221645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600879497032598:5542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:18.221765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:18.221807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:18.222021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:18.222070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.222075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.222076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.222076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.222077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.222077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.222078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.222079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.222079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.222080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.222080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.222081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.222082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.222086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.222093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.222097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600879497032598:5542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:18.222096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.222098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.222101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.222103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.222105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.222107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.222109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.222112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.222115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.222117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.222119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.222125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.222130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.222134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.222137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.222140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.222143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.222146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.222149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.222152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.222155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.222157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.222160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.222163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.222166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.222168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.222171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.222174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.222177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.222179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.222183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.222185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.222188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.222191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.222194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.222197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.222200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.222236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:18.223956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600879497032598:5542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:18.224323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:18.224605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:18.224616Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:18.224618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:18.224620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:18.224624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 524 [2:7559600878714821852:4586]
2025-10-10T14:32:18.224632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:18.224644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:18.224645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.224647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.224649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.224660Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:18.224665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:18.224671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:18.224715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.224723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.224725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.224727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:18.224777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:18.224783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.224790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.224797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.224810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:18.224827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032533:2438], now have 1 active actors on pipe
2025-10-10T14:32:18.224837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600878714821847:4586]
2025-10-10T14:32:18.224838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600878714821847:4586]
2025-10-10T14:32:18.224840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600878714821847:4586]
2025-10-10T14:32:18.224849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:18.224859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:18.224865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:18.224869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:18.224870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:18.224872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:18.224875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:18.224867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 524
2025-10-10T14:32:18.224893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600878714821847:4586]
2025-10-10T14:32:18.224901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:18.224902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:18.229605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600879497032598:5542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:18.229618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600879497032598:5542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:18.229620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600879497032598:5542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:18.229626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:18.229824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032636:5542], now have 1 active actors on pipe
2025-10-10T14:32:18.229871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 524
2025-10-10T14:32:18.229935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.229946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.229975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:18.229989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.229999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.230001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:18.230013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.230032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:18.230052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.230227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.230234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.230248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.230326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 525 partition: 0 MaxSeqNo: 40 sessionId: src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0
2025-10-10T14:32:18.230615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26019b9-46bcece2-8cb633b0-c2b3e77f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:18.233042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0] Write session: try to update token
2025-10-10T14:32:18.233055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:18.235631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:18.235648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.235659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600878714821847:4586]
2025-10-10T14:32:18.235699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:18.235709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:18.235879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:18.236020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:18.236159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:18.236293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:18.236656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:18.236696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:18.246383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId: src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:18.248924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:18.249114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.249138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.249175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:18.249265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:18.252296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:18.252314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.252317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:18.252319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:18.252329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600878714821847:4586]
2025-10-10T14:32:18.252333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600878714821847:4586]
2025-10-10T14:32:18.252336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600878714821847:4586]
2025-10-10T14:32:18.252373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:18.252378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:18.252386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.252386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:18.252389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:18.252389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:18.252513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:18.311377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600879497032640:5401]
2025-10-10T14:32:18.311623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 524, pipe: [1:7559600879497032640:5401]
2025-10-10T14:32:18.355984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:18.362528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.362555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.362718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.362772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.362827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.362880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.362921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.362929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.362988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.363046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.363101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.363158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.363197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.363203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.363261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.363317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.363381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.363442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.363487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.363493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.363548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.363599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.363656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.363719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.363759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.363766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.363827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.363879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.363935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.363984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.364018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.364020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.364074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.364121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.364169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.364217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.364251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.364253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.364309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.364357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.364408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.364458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.364492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.364494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.364559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.364607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.364655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.364704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.364745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.364757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.364818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.364875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.364928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.364980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.365016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.365021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.365072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.365124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.365175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.365228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.365264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.365269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.365304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032640:5401], now have 1 active actors on pipe
2025-10-10T14:32:18.365557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600879497032640:5401]
2025-10-10T14:32:18.365557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:18.365561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:18.365586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:18.365592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 525 reason: error at write: Disconnected sessionId: src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0
2025-10-10T14:32:18.365816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 525 sessionId: src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0 is DEAD
2025-10-10T14:32:18.365969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:18.365978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0] Write session will restart in 0.007044s
2025-10-10T14:32:18.366003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0] Write session: Do CDS request
2025-10-10T14:32:18.366009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:18.366124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:18.373805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.373925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:18.373939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 526
2025-10-10T14:32:18.373976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:18.374069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.374104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:18.374114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:18.374118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:18.374526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 526 sessionId:  describe result for acl check
2025-10-10T14:32:18.374554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:18.374561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:18.374563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:18.374569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600879497032707:5546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:18.375107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600879497032707:5546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:18.375391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:18.375558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:18.375568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:18.375579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:18.375629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:18.375669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600878714821957:4588]
2025-10-10T14:32:18.376239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:18.376443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:18.376480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:18.376775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:18.376822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.376828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.376829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.376830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.376831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.376833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.376834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.376835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.376836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.376837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.376838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.376839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.376840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.376845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.376856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.376861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.376868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.376872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.376876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.376880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.376884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.376888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.376891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.376895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.376903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.376906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.376917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.376929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.376939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.376948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.376956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.376961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.376969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.376974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.376984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.376993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.377001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.377006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.377010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.377019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.377027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.377032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.377041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.377049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.377057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.377062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.377071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.377080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.377088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.377093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.377099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.377108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.377151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:18.377482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600879497032707:5546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:18.379243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:18.379422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600879497032707:5546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:18.379434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600879497032707:5546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:18.379436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600879497032707:5546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:18.379442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:18.379551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:18.379564Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:18.379566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:18.379570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:18.379575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 525 [2:7559600878714821957:4588]
2025-10-10T14:32:18.379589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:18.379603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:18.379606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.379610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.379612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.379627Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:18.379639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:18.379650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:18.379700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.379706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.379708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.379710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:18.379771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:18.379779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.379790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.379806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.379827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:18.379849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032740:5546], now have 1 active actors on pipe
2025-10-10T14:32:18.379857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032641:2438], now have 1 active actors on pipe
2025-10-10T14:32:18.379864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600878714821952:4588]
2025-10-10T14:32:18.379871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600878714821952:4588]
2025-10-10T14:32:18.379872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600878714821952:4588]
2025-10-10T14:32:18.379885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:18.379895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 525
2025-10-10T14:32:18.379905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 525
2025-10-10T14:32:18.379901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:18.379902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:18.379904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:18.379905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:18.379922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:18.379925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:18.379944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600878714821952:4588]
2025-10-10T14:32:18.379947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:18.379948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:18.379967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.379980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.380015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:18.380027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.380032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.380034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:18.380044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.380054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:18.380078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.380209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.380218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.380231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.380324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 526 partition: 0 MaxSeqNo: 40 sessionId: src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0
2025-10-10T14:32:18.380599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c4c1a-92c4c13c-92d56da2-a7231eef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:18.383275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0] Write session: try to update token
2025-10-10T14:32:18.383293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:18.397101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId: src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:18.398196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:18.398216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.398219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:18.398221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:18.398230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600878714821952:4588]
2025-10-10T14:32:18.398235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600878714821952:4588]
2025-10-10T14:32:18.398238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600878714821952:4588]
2025-10-10T14:32:18.398287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:18.398283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:18.398299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:18.398300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.398302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:18.398304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:18.398432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:18.399681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:18.465992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600879497032749:5401]
2025-10-10T14:32:18.466225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 525, pipe: [1:7559600879497032749:5401]
2025-10-10T14:32:18.501180Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:18.501540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.501551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.501595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032749:5401], now have 1 active actors on pipe
2025-10-10T14:32:18.501772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:18.501805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:18.501817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:18.501863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600879497032749:5401]
2025-10-10T14:32:18.501892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 526 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0
2025-10-10T14:32:18.502083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 526 sessionId: src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0 is DEAD
2025-10-10T14:32:18.502285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:18.502298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0] Write session will restart in 0.009739s
2025-10-10T14:32:18.502319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0] Write session: Do CDS request
2025-10-10T14:32:18.502324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:18.510335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:18.511636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:18.511823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:18.511834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:18.511847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:18.511894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:18.511933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600878714822061:4590]
2025-10-10T14:32:18.512541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:18.512807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:18.512846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:18.512915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.512936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:18.512952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 527
2025-10-10T14:32:18.513146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:18.513195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.513190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.513202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.513203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.513204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.513205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.513206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.513207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.513208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.513210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.513211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.513212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.513213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.513214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.513219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.513232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.513221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:18.513236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.513240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.513231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:18.513236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:18.513244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.513250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.513254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.513258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.513264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.513267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.513271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.513279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.513283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.513290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.513303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.513313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.513318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.513327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.513348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.513356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.513362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.513370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.513376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.513384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.513391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.513401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.513410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.513416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.513422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.513431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.513440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.513448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.513453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.513461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.513468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.513472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.513482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.513490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.513497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.513542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:18.513621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 527 sessionId:  describe result for acl check
2025-10-10T14:32:18.513658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:18.513664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:18.513666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:18.513671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600879497032820:5550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:18.514116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600879497032820:5550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:18.515592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:18.515847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600879497032820:5550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:18.515903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:18.515913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:18.515914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:18.515917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:18.515921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 526 [2:7559600878714822061:4590]
2025-10-10T14:32:18.515928Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:18.515941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:18.515946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.515948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.515949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.515961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:18.515969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:18.515977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:18.516016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.516021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.516023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.516024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:18.516071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:18.516078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.516089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.516105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.516122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:18.516142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032750:2438], now have 1 active actors on pipe
2025-10-10T14:32:18.516151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600878714822056:4590]
2025-10-10T14:32:18.516153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600878714822056:4590]
2025-10-10T14:32:18.516154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600878714822056:4590]
2025-10-10T14:32:18.516165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 526
2025-10-10T14:32:18.516162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:18.516178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:18.516180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:18.516184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:18.516185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:18.516194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:18.516197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:18.516223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600878714822056:4590]
2025-10-10T14:32:18.516230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:18.516237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:18.520593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600879497032820:5550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:18.520605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600879497032820:5550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:18.520607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600879497032820:5550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:18.520614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:18.520829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032855:5550], now have 1 active actors on pipe
2025-10-10T14:32:18.520899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 526
2025-10-10T14:32:18.520959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.520970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.521000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6251c5-50a3a123-685b2556-b1c9abef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:18.521017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.521022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.521024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:18.521038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.521059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:18.521079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.521246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.521255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.521270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.521371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 527 partition: 0 MaxSeqNo: 40 sessionId: src_id|f6251c5-50a3a123-685b2556-b1c9abef_0
2025-10-10T14:32:18.521664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587e99b-c9e27ca0-cd1953ea-e472b6f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f6251c5-50a3a123-685b2556-b1c9abef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:18.524069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6251c5-50a3a123-685b2556-b1c9abef_0] Write session: try to update token
2025-10-10T14:32:18.524081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6251c5-50a3a123-685b2556-b1c9abef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:18.534634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:18.534653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.534655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:18.534656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:18.534663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600878714822056:4590]
2025-10-10T14:32:18.534666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600878714822056:4590]
2025-10-10T14:32:18.534673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600878714822056:4590]
2025-10-10T14:32:18.534717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:18.534726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.534728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:18.534727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:18.534732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:18.534736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:18.534842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:18.535974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId: src_id|f6251c5-50a3a123-685b2556-b1c9abef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:18.538359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:18.602190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600879497032865:5401]
2025-10-10T14:32:18.602434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 526, pipe: [1:7559600879497032865:5401]
2025-10-10T14:32:18.637271Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:18.637517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.637541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.637583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032865:5401], now have 1 active actors on pipe
2025-10-10T14:32:18.637797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:18.637804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:18.637814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:18.637844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600879497032865:5401]
2025-10-10T14:32:18.637873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 527 reason: error at write: Disconnected sessionId: src_id|f6251c5-50a3a123-685b2556-b1c9abef_0
2025-10-10T14:32:18.637978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:18.638085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 527 sessionId: src_id|f6251c5-50a3a123-685b2556-b1c9abef_0 is DEAD
2025-10-10T14:32:18.638243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6251c5-50a3a123-685b2556-b1c9abef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:18.638253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6251c5-50a3a123-685b2556-b1c9abef_0] Write session will restart in 0.005669s
2025-10-10T14:32:18.638271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6251c5-50a3a123-685b2556-b1c9abef_0] Write session: Do CDS request
2025-10-10T14:32:18.638276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6251c5-50a3a123-685b2556-b1c9abef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:18.644705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6251c5-50a3a123-685b2556-b1c9abef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.644765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:18.644777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 528
2025-10-10T14:32:18.644894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.644931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:18.644942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:18.644946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:18.645026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:18.645320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 528 sessionId:  describe result for acl check
2025-10-10T14:32:18.645363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:18.645368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:18.645369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:18.645373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600879497032938:5556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:18.645777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600879497032938:5556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:18.646500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:18.646632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:18.646641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:18.646650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:18.646689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:18.646728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600878714822170:4593]
2025-10-10T14:32:18.647162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:18.647390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:18.647403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600879497032938:5556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:18.647431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:18.647657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:18.647693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.647698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.647698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.647699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.647700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.647700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.647701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.647701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.647702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.647703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.647703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.647704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.647704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.647708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.647716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.647718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.647720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.647723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.647725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.647727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.647729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.647731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.647734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.647736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.647738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.647741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.647747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.647752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.647756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.647760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.647762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.647765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.647768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.647771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.647773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.647776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.647779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.647781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.647784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.647787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.647789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.647792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.647795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.647798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.647800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.647803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.647806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.647809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.647811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.647814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.647817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.647820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.647856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:18.649886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600879497032938:5556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:18.649898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600879497032938:5556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:18.649901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600879497032938:5556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:18.649906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:18.649931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:18.650227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:18.650239Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:18.650241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:18.650245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:18.650250Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 527 [2:7559600878714822170:4593]
2025-10-10T14:32:18.650266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:18.650282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:18.650284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.650286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.650288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.650299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:18.650306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:18.650312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:18.650350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.650357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.650361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.650363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:18.650413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:18.650418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.650425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.650432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.650441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:18.650459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032972:5556], now have 1 active actors on pipe
2025-10-10T14:32:18.650465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032870:2438], now have 1 active actors on pipe
2025-10-10T14:32:18.650471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600878714822165:4593]
2025-10-10T14:32:18.650472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600878714822165:4593]
2025-10-10T14:32:18.650473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600878714822165:4593]
2025-10-10T14:32:18.650482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:18.650493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:18.650511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:18.650492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 527
2025-10-10T14:32:18.650515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:18.650507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 527
2025-10-10T14:32:18.650518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:18.650519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:18.650521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:18.650549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.650559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.650577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600878714822165:4593]
2025-10-10T14:32:18.650590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:18.650609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:18.650618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|176f77de-afb107fb-afcbc99e-cff99888_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:18.650629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.650637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.650639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:18.650648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.650660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:18.650679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.650817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.650823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.650834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.650912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 528 partition: 0 MaxSeqNo: 40 sessionId: src_id|176f77de-afb107fb-afcbc99e-cff99888_0
2025-10-10T14:32:18.651170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6251c5-50a3a123-685b2556-b1c9abef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|176f77de-afb107fb-afcbc99e-cff99888_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:18.653840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|176f77de-afb107fb-afcbc99e-cff99888_0] Write session: try to update token
2025-10-10T14:32:18.653855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|176f77de-afb107fb-afcbc99e-cff99888_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:18.666833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId: src_id|176f77de-afb107fb-afcbc99e-cff99888_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:18.669362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:18.669538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:18.669559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.669562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:18.669564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:18.669574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600878714822165:4593]
2025-10-10T14:32:18.669578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600878714822165:4593]
2025-10-10T14:32:18.669581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600878714822165:4593]
2025-10-10T14:32:18.669625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:18.669633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.669638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:18.669642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:18.669642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.669661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:18.669668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.669671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:18.669800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:18.737840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600879497032979:5401]
2025-10-10T14:32:18.738144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 527, pipe: [1:7559600879497032979:5401]
2025-10-10T14:32:18.771585Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:18.771887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032979:5401], now have 1 active actors on pipe
2025-10-10T14:32:18.772108Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:18.772116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:18.772129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:18.772165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600879497032979:5401]
2025-10-10T14:32:18.772183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 528 reason: error at write: Disconnected sessionId: src_id|176f77de-afb107fb-afcbc99e-cff99888_0
2025-10-10T14:32:18.772183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:18.772328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 528 sessionId: src_id|176f77de-afb107fb-afcbc99e-cff99888_0 is DEAD
2025-10-10T14:32:18.772456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176f77de-afb107fb-afcbc99e-cff99888_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:18.772464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176f77de-afb107fb-afcbc99e-cff99888_0] Write session will restart in 0.008152s
2025-10-10T14:32:18.772482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176f77de-afb107fb-afcbc99e-cff99888_0] Write session: Do CDS request
2025-10-10T14:32:18.772494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176f77de-afb107fb-afcbc99e-cff99888_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:18.780239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:18.781782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|176f77de-afb107fb-afcbc99e-cff99888_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.781777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:18.781864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:18.781877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 529
2025-10-10T14:32:18.781917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:18.781930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:18.781941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:18.781979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.781991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:18.782009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:18.782018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:18.782021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:18.782030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600878714822278:4595]
2025-10-10T14:32:18.782328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 529 sessionId:  describe result for acl check
2025-10-10T14:32:18.782354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:18.782358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:18.782360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:18.782364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600879497033049:5560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:18.782430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:18.782639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:18.782669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:18.782802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600879497033049:5560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:18.782891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:18.782929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.782934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.782934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.782935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.782936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.782936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.782937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.782937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.782938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.782938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.782939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.782939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.782940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.782943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.782951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.782953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.782955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.782957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.782960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.782962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.782964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.782966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.782969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.782971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.782973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.782975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.782980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.782985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.782989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.782992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.782995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.782998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.783000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.783003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.783006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.783009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.783011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.783014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.783017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.783019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.783022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.783026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.783028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.783031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.783034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.783037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.783039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.783042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.783044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.783047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.783050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.783053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.783074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:18.784541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600879497033049:5560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:18.784969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:18.785255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:18.785263Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:18.785264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:18.785267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:18.785271Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 528 [2:7559600878714822278:4595]
2025-10-10T14:32:18.785278Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:18.785288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:18.785293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.785295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.785296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.785307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:18.785312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:18.785322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:18.785439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.785446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.785447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.785449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:18.785494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:18.785499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.785506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.785516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.785529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:18.785547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497032980:2438], now have 1 active actors on pipe
2025-10-10T14:32:18.785555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600878714822273:4595]
2025-10-10T14:32:18.785558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600878714822273:4595]
2025-10-10T14:32:18.785559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600878714822273:4595]
2025-10-10T14:32:18.785568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:18.785580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:18.785587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:18.785590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:18.785591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:18.785592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:18.785594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:18.785614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600878714822273:4595]
2025-10-10T14:32:18.785625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:18.785626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:18.785611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 528
2025-10-10T14:32:18.790065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600879497033049:5560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:18.790078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600879497033049:5560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:18.790081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600879497033049:5560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:18.790088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:18.790267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497033088:5560], now have 1 active actors on pipe
2025-10-10T14:32:18.790307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 528
2025-10-10T14:32:18.790357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.790364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.790386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:18.790397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.790403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.790405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:18.790413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.790426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:18.790440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.790554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.790560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.790570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.790637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 529 partition: 0 MaxSeqNo: 40 sessionId: src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0
2025-10-10T14:32:18.790897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|176f77de-afb107fb-afcbc99e-cff99888_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:18.793800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0] Write session: try to update token
2025-10-10T14:32:18.793811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:18.795654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:18.795671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.795681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600878714822273:4595]
2025-10-10T14:32:18.795714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:18.795723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:18.795886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:18.796022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:18.796153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:18.796286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:18.796466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:18.796498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:18.807780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId: src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:18.810105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:18.810322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.810345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.810383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:18.810458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:18.812376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:18.812390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.812393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:18.812395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:18.812405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600878714822273:4595]
2025-10-10T14:32:18.812409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600878714822273:4595]
2025-10-10T14:32:18.812412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600878714822273:4595]
2025-10-10T14:32:18.812452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:18.812458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:18.812464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.812464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:18.812468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:18.812469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:18.812592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:18.872496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600879497033091:5401]
2025-10-10T14:32:18.872755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 528, pipe: [1:7559600879497033091:5401]
2025-10-10T14:32:18.919137Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:18.925440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.925461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.925607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.925661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.925717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.925774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.925815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.925822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.925883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.925935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.925988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.926045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.926084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.926093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.926147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.926201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.926255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.926308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.926346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.926352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.926408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.926461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.926515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.926569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.926607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.926613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.926667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.926734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.926792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.926851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.926888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.926894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.926947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.926999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.927053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.927108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.927145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.927150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.927205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.927256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.927312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.927366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.927403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.927408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.927462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.927514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.927569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.927621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.927662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.927669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.927736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.927800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.927855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.927908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.927943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.927948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.928002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:18.928052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:18.928105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:18.928157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:18.928196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:18.928201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:18.928237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497033091:5401], now have 1 active actors on pipe
2025-10-10T14:32:18.928458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:18.928460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:18.928463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:18.928496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 529 reason: error at write: Disconnected sessionId: src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0
2025-10-10T14:32:18.928502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600879497033091:5401]
2025-10-10T14:32:18.928689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 529 sessionId: src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0 is DEAD
2025-10-10T14:32:18.928827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:18.928839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0] Write session will restart in 0.008586s
2025-10-10T14:32:18.928858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0] Write session: Do CDS request
2025-10-10T14:32:18.928863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:18.928940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:18.937935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:18.938759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.938846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:18.938860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 530
2025-10-10T14:32:18.939034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:18.939064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:18.939071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:18.939074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:18.939431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 530 sessionId:  describe result for acl check
2025-10-10T14:32:18.939458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:18.939463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:18.939464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:18.939469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600879497033162:5564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:18.939543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:18.939702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:18.939712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:18.939724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:18.939776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:18.939815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600878714822387:4597]
2025-10-10T14:32:18.939879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600879497033162:5564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:18.940404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:18.940679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:18.940723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:18.941029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:18.941080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.941086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.941087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.941088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.941090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.941091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.941092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.941093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.941094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.941095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.941096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.941097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.941098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.941103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.941115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.941119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.941123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.941127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.941131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.941135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.941138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.941142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.941147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.941150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.941154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.941158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.941167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.941175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:18.941187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.941194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:18.941199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.941209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:18.941216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.941221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:18.941228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.941233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:18.941239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.941244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:18.941250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.941255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:18.941259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.941266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:18.941270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.941278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:18.941285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.941290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:18.941296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.941301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.941307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.941313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.941322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.941327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.941389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:18.941954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600879497033162:5564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:18.943564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:18.943993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:18.944006Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:18.944008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:18.944012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:18.944017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 529 [2:7559600878714822387:4597]
2025-10-10T14:32:18.944028Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:18.944047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:18.944057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.944060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.944062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.944077Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:18.944084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:18.944092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:18.944138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.944145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.944147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.944150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:18.944161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600879497033162:5564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:18.944173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600879497033162:5564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:18.944176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600879497033162:5564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:18.944181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:18.944212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:18.944220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.944231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:18.944247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:18.944267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:18.944283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 529
2025-10-10T14:32:18.944291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497033092:2438], now have 1 active actors on pipe
2025-10-10T14:32:18.944305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600878714822382:4597]
2025-10-10T14:32:18.944307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600878714822382:4597]
2025-10-10T14:32:18.944309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600878714822382:4597]
2025-10-10T14:32:18.944318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:18.944333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:18.944346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:18.944354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:18.944356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:18.944357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:18.944365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 529
2025-10-10T14:32:18.944358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:18.944376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600879497033195:5564], now have 1 active actors on pipe
2025-10-10T14:32:18.944385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600878714822382:4597]
2025-10-10T14:32:18.944388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:18.944390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:18.944401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.944411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.944455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:18.944467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:18.944470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:18.944477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:18.944488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:18.944503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:18.944524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.944665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:18.944675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:18.944691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:18.944771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 530 partition: 0 MaxSeqNo: 40 sessionId: src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0
2025-10-10T14:32:18.945083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b29d5f7b-74c4ab08-ac849cbd-91471ec2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:18.948147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0] Write session: try to update token
2025-10-10T14:32:18.948160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:18.962640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:18.962659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:18.962663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:18.962665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:18.962674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600878714822382:4597]
2025-10-10T14:32:18.962679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600878714822382:4597]
2025-10-10T14:32:18.962683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600878714822382:4597]
2025-10-10T14:32:18.962736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:18.962749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:18.962752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:18.962780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:18.962792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:18.962798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:18.962926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:18.964467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId: src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:18.967287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:19.028701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600883792000500:5401]
2025-10-10T14:32:19.028950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 529, pipe: [1:7559600883792000500:5401]
2025-10-10T14:32:19.070910Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:19.071138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.071156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.071201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000500:5401], now have 1 active actors on pipe
2025-10-10T14:32:19.071415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:19.071499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:19.071510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600883792000500:5401]
2025-10-10T14:32:19.071537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:19.071620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 530 reason: status is not ok: tablet will be restarted right now sessionId: src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0
2025-10-10T14:32:19.071835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 530 sessionId: src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0 is DEAD
2025-10-10T14:32:19.072029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:19.072038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0] Write session will restart in 0.007290s
2025-10-10T14:32:19.072057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0] Write session: Do CDS request
2025-10-10T14:32:19.072062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:19.080752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.080815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:19.080848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:19.080865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 531
2025-10-10T14:32:19.081067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.081119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:19.081127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:19.081131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:19.081494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 531 sessionId:  describe result for acl check
2025-10-10T14:32:19.081519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:19.081527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:19.081536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:19.081540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600883792000572:5568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:19.082006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600883792000572:5568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:19.082589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:19.082755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:19.082767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:19.082779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:19.082836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:19.082879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600883009789793:4599]
2025-10-10T14:32:19.083466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:19.083602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600883792000572:5568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:19.083696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:19.083737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:19.084039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:19.084093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.084099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.084100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.084101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.084103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.084104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.084105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.084106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.084108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.084109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.084110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.084111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.084112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.084118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.084130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.084134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.084138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.084147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.084151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.084155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.084159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.084163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.084167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.084171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.084175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.084179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.084186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.084194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.084201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.084206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.084211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.084216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.084220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.084225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.084230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.084235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.084240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.084245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.084250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.084256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.084265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.084270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.084279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.084286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.084294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.084299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.084308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.084317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.084323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.084333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.084341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.084351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.084395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:19.086504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600883792000572:5568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:19.086517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600883792000572:5568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:19.086520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600883792000572:5568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:19.086527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:19.086568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:19.086879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:19.086889Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:19.086891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:19.086895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:19.086901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 530 [2:7559600883009789793:4599]
2025-10-10T14:32:19.086913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:19.086929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:19.086937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.086941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.086948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.086962Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:19.086973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:19.086987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:19.087039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.087045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.087047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.087050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:19.087107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:19.087114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.087125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.087143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.087161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:19.087185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000606:5568], now have 1 active actors on pipe
2025-10-10T14:32:19.087193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000501:2438], now have 1 active actors on pipe
2025-10-10T14:32:19.087181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 530
2025-10-10T14:32:19.087200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600883009789788:4599]
2025-10-10T14:32:19.087197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 530
2025-10-10T14:32:19.087206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600883009789788:4599]
2025-10-10T14:32:19.087208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600883009789788:4599]
2025-10-10T14:32:19.087217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:19.087222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:19.087225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:19.087226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:19.087230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:19.087246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:19.087249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:19.087265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.087274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.087305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600883009789788:4599]
2025-10-10T14:32:19.087316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:19.087321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:19.087335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:19.087346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.087353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.087355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:19.087365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.087379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:19.087412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.087550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.087559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.087574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.087668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 531 partition: 0 MaxSeqNo: 40 sessionId: src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0
2025-10-10T14:32:19.088022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b784ed-9318b1e8-cbb638a9-4ff16634_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:19.091076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0] Write session: try to update token
2025-10-10T14:32:19.091090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:19.105527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:19.105545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:19.105548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:19.105550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:19.105562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600883009789788:4599]
2025-10-10T14:32:19.105566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600883009789788:4599]
2025-10-10T14:32:19.105569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600883009789788:4599]
2025-10-10T14:32:19.105608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:19.105613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:19.105619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:19.105621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.105622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:19.105623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:19.105759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:19.106269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId: src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:19.108699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:19.171498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600883792000650:5401]
2025-10-10T14:32:19.171659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 530, pipe: [1:7559600883792000650:5401]
2025-10-10T14:32:19.222084Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:19.222352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.222367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.222408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000650:5401], now have 1 active actors on pipe
2025-10-10T14:32:19.222638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:19.222641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600883792000650:5401]
2025-10-10T14:32:19.222656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:19.222659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:19.222749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 531 reason: error at write: Disconnected sessionId: src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0
2025-10-10T14:32:19.222892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:19.222941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 531 sessionId: src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0 is DEAD
2025-10-10T14:32:19.223125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:19.223135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0] Write session will restart in 0.008113s
2025-10-10T14:32:19.223154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0] Write session: Do CDS request
2025-10-10T14:32:19.223164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:19.231483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:19.232778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.232883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:19.232904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 532
2025-10-10T14:32:19.233049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.233096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:19.233104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:19.233107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:19.233134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:19.233306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:19.233317Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:19.233327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:19.233389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:19.233425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600883009789954:4615]
2025-10-10T14:32:19.233464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 532 sessionId:  describe result for acl check
2025-10-10T14:32:19.233496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:19.233503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:19.233505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:19.233510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600883792000723:5582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:19.233924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600883792000723:5582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:19.234014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:19.234241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:19.234280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:19.234584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:19.234629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.234637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.234638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.234639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.234640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.234641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.234642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.234643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.234644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.234645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.234646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.234647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.234648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.234653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.234665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.234669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.234673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.234677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.234681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.234685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.234689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.234693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.234697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.234701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.234710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.234714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.234720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.234729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.234739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.234749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.234758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.234767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.234775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.234780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.234789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.234794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.234803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.234808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.234813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.234818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.234822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.234832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.234836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.234845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.234850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.234855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.234863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.234868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.234873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.234877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.234881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.234885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.234922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:19.235599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600883792000723:5582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:19.236987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:19.237302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:19.237313Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:19.237315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:19.237318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:19.237323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 531 [2:7559600883009789954:4615]
2025-10-10T14:32:19.237348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:19.237363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:19.237367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.237370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.237372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.237386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:19.237399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:19.237408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:19.237461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.237467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.237460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600883792000723:5582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:19.237471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600883792000723:5582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:19.237469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.237474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600883792000723:5582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:19.237478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:19.237471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:19.237532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:19.237539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.237550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.237562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.237582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:19.237573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 531
2025-10-10T14:32:19.237606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000651:2438], now have 1 active actors on pipe
2025-10-10T14:32:19.237618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600883009789949:4615]
2025-10-10T14:32:19.237620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600883009789949:4615]
2025-10-10T14:32:19.237622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600883009789949:4615]
2025-10-10T14:32:19.237633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:19.237641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:19.237644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:19.237645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:19.237648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000757:5582], now have 1 active actors on pipe
2025-10-10T14:32:19.237653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:19.237663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 531
2025-10-10T14:32:19.237668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:19.237676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:19.237707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.237715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.237728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600883009789949:4615]
2025-10-10T14:32:19.237738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:19.237742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:19.237763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:19.237774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.237782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.237784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:19.237794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.237807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:19.237833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.237947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.237956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.237970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.238040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 532 partition: 0 MaxSeqNo: 40 sessionId: src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0
2025-10-10T14:32:19.238335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ec8c03-a5949aea-b03b7fc3-85e3759c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:19.242485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0] Write session: try to update token
2025-10-10T14:32:19.242503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:19.256349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:19.256368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:19.256372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:19.256374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:19.256386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600883009789949:4615]
2025-10-10T14:32:19.256391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600883009789949:4615]
2025-10-10T14:32:19.256394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600883009789949:4615]
2025-10-10T14:32:19.256441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:19.256442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:19.256447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:19.256450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:19.256452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.256455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:19.256594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:19.260382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId: src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:19.262969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:19.322565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600883792000765:5401]
2025-10-10T14:32:19.322827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 531, pipe: [1:7559600883792000765:5401]
2025-10-10T14:32:19.361267Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:19.361593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.361604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.361641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000765:5401], now have 1 active actors on pipe
2025-10-10T14:32:19.361822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:19.361857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600883792000765:5401]
2025-10-10T14:32:19.361873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:19.361876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:19.361893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:19.361946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 532 reason: error at write: Disconnected sessionId: src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0
2025-10-10T14:32:19.362137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 532 sessionId: src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0 is DEAD
2025-10-10T14:32:19.362292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:19.362303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0] Write session will restart in 0.006655s
2025-10-10T14:32:19.362321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0] Write session: Do CDS request
2025-10-10T14:32:19.362325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:19.369734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.369829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:19.369842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 533
2025-10-10T14:32:19.369952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.369986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:19.369995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:19.369997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:19.370149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:19.370336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 533 sessionId:  describe result for acl check
2025-10-10T14:32:19.370371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:19.370377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:19.370379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:19.370384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600883792000839:5586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:19.370819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600883792000839:5586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:19.371682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:19.371833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:19.371843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:19.371853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:19.371900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:19.371936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600883009790066:4617]
2025-10-10T14:32:19.372429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600883792000839:5586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:19.372445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:19.372689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:19.372720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:19.372973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:19.373023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.373028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.373029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.373030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.373031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.373033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.373034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.373035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.373036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.373037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.373038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.373039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.373040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.373045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.373055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.373060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.373064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.373068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.373072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.373075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.373079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.373083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.373087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.373091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.373095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.373099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.373107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.373119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.373125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.373135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.373143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.373147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.373153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.373157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.373159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.373166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.373168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.373171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.373175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.373179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.373184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.373187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.373190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.373196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.373199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.373202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.373204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.373207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.373209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.373215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.373218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.373221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.373242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:19.375188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600883792000839:5586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:19.375201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600883792000839:5586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:19.375204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600883792000839:5586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:19.375210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:19.375262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:19.375562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:19.375574Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:19.375576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:19.375579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:19.375583Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 532 [2:7559600883009790066:4617]
2025-10-10T14:32:19.375596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:19.375610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:19.375618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.375620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.375622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.375634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:19.375644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:19.375654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:19.375703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.375709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.375711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.375713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:19.375771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:19.375778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.375788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.375804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.375825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:19.375849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000873:5586], now have 1 active actors on pipe
2025-10-10T14:32:19.375853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000766:2438], now have 1 active actors on pipe
2025-10-10T14:32:19.375841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 532
2025-10-10T14:32:19.375846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 532
2025-10-10T14:32:19.375860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600883009790061:4617]
2025-10-10T14:32:19.375866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600883009790061:4617]
2025-10-10T14:32:19.375869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600883009790061:4617]
2025-10-10T14:32:19.375877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:19.375882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:19.375884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:19.375885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:19.375894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:19.375914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:19.375922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:19.375937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.375944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.375975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600883009790061:4617]
2025-10-10T14:32:19.375986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:19.375988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:19.376004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b05b1054-11d87d7d-55e840d5-f702e359_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:19.376014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.376021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.376024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:19.376034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.376047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:19.376079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.376192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.376199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.376211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.376277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 533 partition: 0 MaxSeqNo: 40 sessionId: src_id|b05b1054-11d87d7d-55e840d5-f702e359_0
2025-10-10T14:32:19.376578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18eae43f-80f9b1fa-8419456b-c4573a3c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b05b1054-11d87d7d-55e840d5-f702e359_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:19.380785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b1054-11d87d7d-55e840d5-f702e359_0] Write session: try to update token
2025-10-10T14:32:19.380806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b1054-11d87d7d-55e840d5-f702e359_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:19.393312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:19.393349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:19.393352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:19.393353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:19.393363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600883009790061:4617]
2025-10-10T14:32:19.393367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600883009790061:4617]
2025-10-10T14:32:19.393371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600883009790061:4617]
2025-10-10T14:32:19.393417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:19.393422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:19.393428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:19.393429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.393432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:19.393432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:19.393567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:19.398993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId: src_id|b05b1054-11d87d7d-55e840d5-f702e359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:19.401714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:19.461817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600883792000881:5401]
2025-10-10T14:32:19.462025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 532, pipe: [1:7559600883792000881:5401]
2025-10-10T14:32:19.494880Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:19.495116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.495129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.495149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000881:5401], now have 1 active actors on pipe
2025-10-10T14:32:19.495390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600883792000881:5401]
2025-10-10T14:32:19.495403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:19.495407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:19.495419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:19.495485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 533 reason: error at write: Disconnected sessionId: src_id|b05b1054-11d87d7d-55e840d5-f702e359_0
2025-10-10T14:32:19.495713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 533 sessionId: src_id|b05b1054-11d87d7d-55e840d5-f702e359_0 is DEAD
2025-10-10T14:32:19.495709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:19.495850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b1054-11d87d7d-55e840d5-f702e359_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:19.495859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b1054-11d87d7d-55e840d5-f702e359_0] Write session will restart in 0.006624s
2025-10-10T14:32:19.495878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b1054-11d87d7d-55e840d5-f702e359_0] Write session: Do CDS request
2025-10-10T14:32:19.495885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b1054-11d87d7d-55e840d5-f702e359_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:19.503265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:19.503756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b1054-11d87d7d-55e840d5-f702e359_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.503871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:19.503884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 534
2025-10-10T14:32:19.504008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.504036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:19.504044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:19.504047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:19.504399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 534 sessionId:  describe result for acl check
2025-10-10T14:32:19.504434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:19.504442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:19.504444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:19.504450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600883792000956:5590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:19.504847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:19.504897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600883792000956:5590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:19.505006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:19.505017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:19.505029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:19.505079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:19.505120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600883009790177:4619]
2025-10-10T14:32:19.505716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:19.505942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:19.505985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:19.506296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:19.506347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.506354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.506355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.506356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.506357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.506358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.506359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.506361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.506362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.506363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.506364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.506365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.506366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.506371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.506383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.506386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.506390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.506394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.506398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.506402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.506406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.506410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.506415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.506419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.506423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.506427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.506433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.506441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.506448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.506454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.506458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.506463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.506469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.506474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.506483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.506489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.506493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.506503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.506512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.506519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.506527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.506534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.506542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.506548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.506520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600883792000956:5590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:19.506553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.506562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.506568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.506575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.506583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.506593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.506599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.506606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.506647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:19.508623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600883792000956:5590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:19.508636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600883792000956:5590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:19.508640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600883792000956:5590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:19.508647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:19.508738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:19.509112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:19.509124Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:19.509126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:19.509129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:19.509135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 533 [2:7559600883009790177:4619]
2025-10-10T14:32:19.509146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:19.509161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:19.509168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.509170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.509172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.509185Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:19.509196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:19.509207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:19.509251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.509256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.509257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.509259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:19.509303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:19.509309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.509316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.509323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.509345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:19.509360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000990:5590], now have 1 active actors on pipe
2025-10-10T14:32:19.509367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792000882:2438], now have 1 active actors on pipe
2025-10-10T14:32:19.509372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600883009790172:4619]
2025-10-10T14:32:19.509374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600883009790172:4619]
2025-10-10T14:32:19.509375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600883009790172:4619]
2025-10-10T14:32:19.509384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:19.509376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 533
2025-10-10T14:32:19.509397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:19.509391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 533
2025-10-10T14:32:19.509405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:19.509408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:19.509410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:19.509411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:19.509413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:19.509444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.509453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.509470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600883009790172:4619]
2025-10-10T14:32:19.509483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:19.509493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:19.509508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:19.509516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.509523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.509524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:19.509531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.509542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:19.509563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.509684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.509693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.509709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.509774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 534 partition: 0 MaxSeqNo: 40 sessionId: src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0
2025-10-10T14:32:19.509999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05b1054-11d87d7d-55e840d5-f702e359_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:19.512973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0] Write session: try to update token
2025-10-10T14:32:19.512991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:19.525709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId: src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:19.527355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:19.527373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:19.527375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:19.527380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:19.527389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600883009790172:4619]
2025-10-10T14:32:19.527393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600883009790172:4619]
2025-10-10T14:32:19.527397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600883009790172:4619]
2025-10-10T14:32:19.527435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:19.527444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:19.527447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:19.527451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.527452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:19.527453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:19.527587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:19.528163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:19.595446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600883792001005:5401]
2025-10-10T14:32:19.595640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 533, pipe: [1:7559600883792001005:5401]
2025-10-10T14:32:19.629469Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:19.629715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.629728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.629763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001005:5401], now have 1 active actors on pipe
2025-10-10T14:32:19.629934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:19.629952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600883792001005:5401]
2025-10-10T14:32:19.629956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:19.629959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:19.629982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:19.630023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 534 reason: error at write: Disconnected sessionId: src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0
2025-10-10T14:32:19.630211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 534 sessionId: src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0 is DEAD
2025-10-10T14:32:19.630374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:19.630384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0] Write session will restart in 0.006157s
2025-10-10T14:32:19.630403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0] Write session: Do CDS request
2025-10-10T14:32:19.630408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:19.637802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.637822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:19.637834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 535
2025-10-10T14:32:19.637865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:19.637978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.638002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:19.638009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:19.638012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:19.638313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 535 sessionId:  describe result for acl check
2025-10-10T14:32:19.638338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:19.638343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:19.638355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:19.638360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600883792001085:5596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:19.638782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600883792001085:5596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:19.639340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:19.639487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:19.639496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:19.639506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:19.639554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:19.639584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600883009790294:4622]
2025-10-10T14:32:19.640049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:19.640251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:19.640293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:19.640608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:19.640657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.640663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.640664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.640665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.640666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.640667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.640668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.640669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.640670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.640671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.640679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600883792001085:5596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:19.640672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.640673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.640675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.640680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.640692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.640696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.640700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.640704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.640708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.640712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.640716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.640720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.640724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.640728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.640731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.640735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.640741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.640753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.640763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.640773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.640781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.640786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.640790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.640795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.640802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.640808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.640816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.640821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.640828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.640833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.640838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.640843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.640847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.640857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.640861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.640867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.640872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.640878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.640881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.640886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.640894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.640900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.640943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:19.642893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600883792001085:5596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:19.642904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600883792001085:5596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:19.642907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600883792001085:5596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:19.642911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:19.642990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:19.643368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:19.643378Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:19.643381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:19.643384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:19.643389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 534 [2:7559600883009790294:4622]
2025-10-10T14:32:19.643401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:19.643420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:19.643427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.643430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.643432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.643445Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:19.643458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:19.643465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:19.643512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.643518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.643520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.643522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:19.643576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:19.643583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.643593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.643609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.643631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 534
2025-10-10T14:32:19.643630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:19.643653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001010:2438], now have 1 active actors on pipe
2025-10-10T14:32:19.643660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001119:5596], now have 1 active actors on pipe
2025-10-10T14:32:19.643668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 534
2025-10-10T14:32:19.643667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600883009790289:4622]
2025-10-10T14:32:19.643674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600883009790289:4622]
2025-10-10T14:32:19.643676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600883009790289:4622]
2025-10-10T14:32:19.643689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:19.643693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:19.643696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:19.643697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:19.643705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:19.643725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:19.643729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:19.643747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.643751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.643778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600883009790289:4622]
2025-10-10T14:32:19.643790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:19.643794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:19.643812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:19.643823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.643830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.643832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:19.643842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.643852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:19.643884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.644037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.644046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.644061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.644140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 535 partition: 0 MaxSeqNo: 40 sessionId: src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0
2025-10-10T14:32:19.644338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9dfd8f1-101ce696-5ff12af6-ef5879_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:19.646790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0] Write session: try to update token
2025-10-10T14:32:19.646804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:19.659254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId: src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:19.661670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:19.661675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:19.661686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:19.661689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:19.661691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:19.661700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600883009790289:4622]
2025-10-10T14:32:19.661704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600883009790289:4622]
2025-10-10T14:32:19.661707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600883009790289:4622]
2025-10-10T14:32:19.661743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:19.661748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:19.661751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:19.661756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:19.661762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.661765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:19.661891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:19.730126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600883792001126:5401]
2025-10-10T14:32:19.730349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 534, pipe: [1:7559600883792001126:5401]
2025-10-10T14:32:19.764779Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:19.765041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.765056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.765104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001126:5401], now have 1 active actors on pipe
2025-10-10T14:32:19.765260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600883792001126:5401]
2025-10-10T14:32:19.765306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:19.765290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:19.765293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:19.765303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:19.765364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 535 reason: error at write: Disconnected sessionId: src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0
2025-10-10T14:32:19.765553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 535 sessionId: src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0 is DEAD
2025-10-10T14:32:19.765686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:19.765695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0] Write session will restart in 0.008115s
2025-10-10T14:32:19.765714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0] Write session: Do CDS request
2025-10-10T14:32:19.765719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:19.773967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:19.774775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.774827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:19.774841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 536
2025-10-10T14:32:19.774935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.774961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:19.774965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:19.774968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:19.775337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:19.775346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 536 sessionId:  describe result for acl check
2025-10-10T14:32:19.775375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:19.775380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:19.775382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:19.775386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600883792001203:5600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:19.775478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:19.775489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:19.775499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:19.775550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:19.775585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600883009790409:4624]
2025-10-10T14:32:19.775818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600883792001203:5600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:19.775948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:19.776201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:19.776244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:19.776536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:19.776591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.776598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.776599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.776600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.776600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.776602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.776603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.776604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.776605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.776606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.776607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.776608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.776608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.776613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.776624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.776628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.776632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.776635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.776639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.776642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.776646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.776649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.776654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.776657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.776661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.776664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.776670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.776678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.776684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.776689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.776694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.776698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.776702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.776707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.776710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.776715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.776719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.776724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.776728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.776735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.776738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.776744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.776753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.776758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.776765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.776770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.776779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.776789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.776796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.776803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.776812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.776821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.776849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:19.777350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600883792001203:5600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:19.778909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:19.779212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600883792001203:5600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:19.779224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600883792001203:5600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:19.779226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600883792001203:5600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:19.779232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:19.779288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:19.779302Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:19.779304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:19.779307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:19.779312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 535 [2:7559600883009790409:4624]
2025-10-10T14:32:19.779324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:19.779338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:19.779343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.779345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.779346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.779357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:19.779361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:19.779367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:19.779405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.779410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.779411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.779413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:19.779480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:19.779485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.779492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.779499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.779508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:19.779527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001127:2438], now have 1 active actors on pipe
2025-10-10T14:32:19.779530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001237:5600], now have 1 active actors on pipe
2025-10-10T14:32:19.779535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600883009790404:4624]
2025-10-10T14:32:19.779536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600883009790404:4624]
2025-10-10T14:32:19.779537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600883009790404:4624]
2025-10-10T14:32:19.779544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:19.779525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 535
2025-10-10T14:32:19.779553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:19.779535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 535
2025-10-10T14:32:19.779560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:19.779563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:19.779565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:19.779569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:19.779572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:19.779607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.779616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.779629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600883009790404:4624]
2025-10-10T14:32:19.779638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:19.779648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:19.779668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:19.779684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.779688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.779690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:19.779701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.779712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:19.779730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.779855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.779865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.779881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.779965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 536 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0
2025-10-10T14:32:19.780183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd71f3e-85a088e-ddbd84b6-30e78fb7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:19.782765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0] Write session: try to update token
2025-10-10T14:32:19.782778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:19.795572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId: src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:19.797876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:19.797907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:19.797892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:19.797895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:19.797897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:19.797906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600883009790404:4624]
2025-10-10T14:32:19.797910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600883009790404:4624]
2025-10-10T14:32:19.797913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600883009790404:4624]
2025-10-10T14:32:19.797948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:19.797953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:19.797955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:19.797956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:19.797962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.797964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:19.798141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:19.865270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600883792001245:5401]
2025-10-10T14:32:19.865497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 535, pipe: [1:7559600883792001245:5401]
2025-10-10T14:32:19.899061Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:19.899274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.899285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.899322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001245:5401], now have 1 active actors on pipe
2025-10-10T14:32:19.899494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:19.899573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600883792001245:5401]
2025-10-10T14:32:19.899582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:19.899611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:19.899678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 536 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0
2025-10-10T14:32:19.899864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 536 sessionId: src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0 is DEAD
2025-10-10T14:32:19.900019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:19.900029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0] Write session will restart in 0.005727s
2025-10-10T14:32:19.900046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0] Write session: Do CDS request
2025-10-10T14:32:19.900051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:19.906880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:19.906917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.906962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 537
2025-10-10T14:32:19.907128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:19.907157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:19.907165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:19.907168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:19.907516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 537 sessionId:  describe result for acl check
2025-10-10T14:32:19.907546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:19.907553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:19.907554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:19.907559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600883792001320:5604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:19.907980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600883792001320:5604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:19.908393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:19.909371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600883792001320:5604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:19.910069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:19.910256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:19.910268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:19.910279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:19.910329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:19.910368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600883009790525:4626]
2025-10-10T14:32:19.910938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:19.911175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:19.911215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:19.911322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600883792001320:5604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:19.911343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600883792001320:5604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:19.911346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600883792001320:5604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:19.911353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:19.911467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:19.911520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.911526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.911527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.911528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.911529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.911531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.911532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.911533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.911534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.911535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.911537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.911538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.911539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.911544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.911554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.911557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.911559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.911561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.911563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.911565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.911567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.911569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.911572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.911574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.911576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.911578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.911582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.911591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:19.911598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.911608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:19.911612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.911622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:19.911633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.911644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:19.911649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.911654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:19.911658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.911664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:19.911668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.911674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:19.911678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.911683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:19.911692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.911698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:19.911706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.911711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:19.911720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.911725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.911730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.911739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.911748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.911753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.911796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:19.913964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:19.914324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:19.914334Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:19.914335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:19.914338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:19.914342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 536 [2:7559600883009790525:4626]
2025-10-10T14:32:19.914351Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:19.914363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:19.914365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.914368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.914370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.914385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:19.914399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:19.914411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:19.914454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.914458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.914459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.914461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:19.914507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:19.914512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.914519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:19.914528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:19.914541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:19.914565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001355:5604], now have 1 active actors on pipe
2025-10-10T14:32:19.914573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001246:2438], now have 1 active actors on pipe
2025-10-10T14:32:19.914580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600883009790520:4626]
2025-10-10T14:32:19.914587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600883009790520:4626]
2025-10-10T14:32:19.914588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600883009790520:4626]
2025-10-10T14:32:19.914598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:19.914583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 536
2025-10-10T14:32:19.914583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 536
2025-10-10T14:32:19.914607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:19.914611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:19.914613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:19.914615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:19.914623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:19.914627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:19.914666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.914671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.914690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600883009790520:4626]
2025-10-10T14:32:19.914701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:19.914706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:19.914737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:19.914748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:19.914756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:19.914759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:19.914773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:19.914788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:19.914812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.914922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.914929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.914943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:19.915026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 537 partition: 0 MaxSeqNo: 40 sessionId: src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0
2025-10-10T14:32:19.915302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee67dbed-b63b5f69-42c6cdc6-8abb1a92_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:19.917699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0] Write session: try to update token
2025-10-10T14:32:19.917711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:19.929811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId: src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:19.932032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:19.932941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:19.932967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:19.932990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:19.932993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:19.932997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:19.932999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:19.933008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600883009790520:4626]
2025-10-10T14:32:19.933012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600883009790520:4626]
2025-10-10T14:32:19.933015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600883009790520:4626]
2025-10-10T14:32:19.933046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:19.933055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:19.933058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:19.933069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:19.933081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:19.933087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:19.933211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:19.999931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600883792001366:5401]
2025-10-10T14:32:20.000164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 536, pipe: [1:7559600883792001366:5401]
2025-10-10T14:32:20.036546Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:20.036799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:20.036850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600883792001366:5401], now have 1 active actors on pipe
2025-10-10T14:32:20.036921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:20.037001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600883792001366:5401]
2025-10-10T14:32:20.037015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:20.037018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:20.037025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:20.037097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 537 reason: error at write: Disconnected sessionId: src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0
2025-10-10T14:32:20.037256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 537 sessionId: src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0 is DEAD
2025-10-10T14:32:20.037456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:20.037468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0] Write session will restart in 0.008383s
2025-10-10T14:32:20.037494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0] Write session: Do CDS request
2025-10-10T14:32:20.037502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:20.046190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:20.046788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.046911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:20.046924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 538
2025-10-10T14:32:20.047051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.047078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:20.047082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:20.047085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:20.047411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 538 sessionId:  describe result for acl check
2025-10-10T14:32:20.047439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:20.047444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:20.047445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:20.047449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600888086968741:5608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:20.047790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:20.047874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600888086968741:5608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:20.047954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:20.047965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:20.047976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:20.048022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:20.048060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600887304757939:4628]
2025-10-10T14:32:20.048655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:20.048896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:20.048935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:20.049239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:20.049288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.049294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.049295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.049296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.049297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.049298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.049299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.049300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.049301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.049303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.049304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.049305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.049306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.049311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.049323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.049342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.049346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.049350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.049354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.049358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.049367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.049370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.049374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.049381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.049385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.049392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.049398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.049411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.049421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.049430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.049436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.049442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.049446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.049451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.049460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.049465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.049473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.049479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.049488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.049497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.049505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.049511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.049520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.049529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.049533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.049538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.049547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.049552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.049560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.049565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.049574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.049583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.049622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:20.049716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600888086968741:5608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:20.051740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:20.052144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600888086968741:5608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:20.052156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600888086968741:5608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:20.052158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600888086968741:5608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:20.052173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:20.052175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:20.052189Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:20.052191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:20.052195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:20.052200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 537 [2:7559600887304757939:4628]
2025-10-10T14:32:20.052211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:20.052227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:20.052234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.052238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.052240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.052256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:20.052268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:20.052279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:20.052332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.052338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.052340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.052343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:20.052406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:20.052413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.052425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.052438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.052458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:20.052483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086968663:2438], now have 1 active actors on pipe
2025-10-10T14:32:20.052490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086968775:5608], now have 1 active actors on pipe
2025-10-10T14:32:20.052497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600887304757934:4628]
2025-10-10T14:32:20.052502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600887304757934:4628]
2025-10-10T14:32:20.052504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600887304757934:4628]
2025-10-10T14:32:20.052512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:20.052483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 537
2025-10-10T14:32:20.052521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:20.052524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:20.052529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:20.052484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 537
2025-10-10T14:32:20.052531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:20.052540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:20.052543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:20.052578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.052587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.052602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600887304757934:4628]
2025-10-10T14:32:20.052614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:20.052624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:20.052646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:20.052658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.052663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.052666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:20.052677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.052690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:20.052713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.052815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.052821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.052835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.052900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 538 partition: 0 MaxSeqNo: 40 sessionId: src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0
2025-10-10T14:32:20.053203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbcb1622-d343d55e-febc4f67-b9a639ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:20.055869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0] Write session: try to update token
2025-10-10T14:32:20.055891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:20.071002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:20.071019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.071022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:20.071025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:20.071038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600887304757934:4628]
2025-10-10T14:32:20.071043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600887304757934:4628]
2025-10-10T14:32:20.071046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600887304757934:4628]
2025-10-10T14:32:20.071084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:20.071092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:20.071095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:20.071098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:20.071099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.071101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:20.071234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:20.071280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId: src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:20.073809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:20.137165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600888086968783:5401]
2025-10-10T14:32:20.137463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 537, pipe: [1:7559600888086968783:5401]
2025-10-10T14:32:20.176546Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:20.176721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.176733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.176766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086968783:5401], now have 1 active actors on pipe
2025-10-10T14:32:20.176926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:20.176988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600888086968783:5401]
2025-10-10T14:32:20.177013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:20.177044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:20.177106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 538 reason: status is not ok: tablet will be restarted right now sessionId: src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0
2025-10-10T14:32:20.177295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 538 sessionId: src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0 is DEAD
2025-10-10T14:32:20.177455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:20.177463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0] Write session will restart in 0.006724s
2025-10-10T14:32:20.177487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0] Write session: Do CDS request
2025-10-10T14:32:20.177493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:20.185922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.185945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:20.185959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 539
2025-10-10T14:32:20.186234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.186272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:20.186279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:20.186283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:20.186573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 539 sessionId:  describe result for acl check
2025-10-10T14:32:20.186574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:20.186602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:20.186608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:20.186611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:20.186618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600888086968887:5619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:20.187054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600888086968887:5619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:20.188384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:20.188560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:20.188571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:20.188582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:20.188634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:20.188672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600887304758081:4637]
2025-10-10T14:32:20.189257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:20.189290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600888086968887:5619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:20.189545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:20.189590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:20.189896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:20.189956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.189962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.189963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.189965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.189966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.189967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.189968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.189969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.189970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.189972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.189973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.189974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.189975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.189981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.189993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.189997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.190001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.190005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.190009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.190013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.190017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.190021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.190025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.190029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.190033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.190037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.190043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.190052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.190058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.190064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.190069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.190078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.190083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.190088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.190093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.190100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.190105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.190110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.190116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.190121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.190129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.190134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.190139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.190144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.190153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.190158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.190163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.190169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.190177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.190181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.190186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.190190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.190229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:20.192494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600888086968887:5619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:20.192507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600888086968887:5619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:20.192510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600888086968887:5619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:20.192517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:20.192533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:20.192834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:20.192846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:20.192849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:20.192852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:20.192859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 538 [2:7559600887304758081:4637]
2025-10-10T14:32:20.192871Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:20.192892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:20.192900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.192903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.192910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.192926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:20.192938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:20.192949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:20.193003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.193011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.193012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.193015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:20.193078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:20.193085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.193096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.193108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.193127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:20.193153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086968921:5619], now have 1 active actors on pipe
2025-10-10T14:32:20.193161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086968809:2438], now have 1 active actors on pipe
2025-10-10T14:32:20.193167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600887304758076:4637]
2025-10-10T14:32:20.193170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600887304758076:4637]
2025-10-10T14:32:20.193172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600887304758076:4637]
2025-10-10T14:32:20.193185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:20.193202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:20.193202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:20.193198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 538
2025-10-10T14:32:20.193221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 538
2025-10-10T14:32:20.193205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:20.193207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:20.193221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:20.193224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:20.193258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.193267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.193281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600887304758076:4637]
2025-10-10T14:32:20.193294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:20.193304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:20.193343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96f345dc-687e6709-520c24e2-50f0a47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:20.193355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.193359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.193361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:20.193371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.193381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:20.193407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.193545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.193555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.193569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.193656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 539 partition: 0 MaxSeqNo: 40 sessionId: src_id|96f345dc-687e6709-520c24e2-50f0a47_0
2025-10-10T14:32:20.194040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664fdf1d-f632c133-219cbc3d-7d8c3bab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|96f345dc-687e6709-520c24e2-50f0a47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:20.197221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f345dc-687e6709-520c24e2-50f0a47_0] Write session: try to update token
2025-10-10T14:32:20.197241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f345dc-687e6709-520c24e2-50f0a47_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:20.212088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:20.212106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.212109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:20.212111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:20.212120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600887304758076:4637]
2025-10-10T14:32:20.212124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600887304758076:4637]
2025-10-10T14:32:20.212128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600887304758076:4637]
2025-10-10T14:32:20.212164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:20.212171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:20.212174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:20.212176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:20.212182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.212185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:20.212331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:20.213706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId: src_id|96f345dc-687e6709-520c24e2-50f0a47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:20.216245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:20.276925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600888086968940:5401]
2025-10-10T14:32:20.277193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 538, pipe: [1:7559600888086968940:5401]
2025-10-10T14:32:20.316928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:20.317166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.317179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.317223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086968940:5401], now have 1 active actors on pipe
2025-10-10T14:32:20.317411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:20.317465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:20.317479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:20.317486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:20.317526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600888086968940:5401]
2025-10-10T14:32:20.317536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 539 reason: error at write: Disconnected sessionId: src_id|96f345dc-687e6709-520c24e2-50f0a47_0
2025-10-10T14:32:20.317730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 539 sessionId: src_id|96f345dc-687e6709-520c24e2-50f0a47_0 is DEAD
2025-10-10T14:32:20.317924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f345dc-687e6709-520c24e2-50f0a47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:20.317937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f345dc-687e6709-520c24e2-50f0a47_0] Write session will restart in 0.009329s
2025-10-10T14:32:20.317957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f345dc-687e6709-520c24e2-50f0a47_0] Write session: Do CDS request
2025-10-10T14:32:20.317966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f345dc-687e6709-520c24e2-50f0a47_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:20.325879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:20.327394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:20.327572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:20.327583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:20.327594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:20.327639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:20.327677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600887304758223:4646]
2025-10-10T14:32:20.328283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:20.328539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:20.328584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:20.328747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f345dc-687e6709-520c24e2-50f0a47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.328821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:20.328871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.328875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.328876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.328877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.328877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.328878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.328879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.328879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.328880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.328880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.328881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.328881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.328882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.328886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.328895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.328897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.328900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.328902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.328904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.328906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.328909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.328911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.328913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.328916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.328918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.328920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.328926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.328932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.328936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.328940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.328944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.328947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.328949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.328952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.328955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.328958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.328962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.328967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.328971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.328976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.328979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.328985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.328989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.328994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.328998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.329003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.329007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.329013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.329017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.329022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.329026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.329031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.329066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:20.329559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:20.329581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 540
2025-10-10T14:32:20.329696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.329723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:20.329731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:20.329735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:20.330087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 540 sessionId:  describe result for acl check
2025-10-10T14:32:20.330115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:20.330121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:20.330122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:20.330126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600888086969027:5626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:20.330597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600888086969027:5626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:20.331203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:20.331559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:20.331571Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:20.331573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:20.331576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:20.331582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 539 [2:7559600887304758223:4646]
2025-10-10T14:32:20.331593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:20.331610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:20.331617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.331620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.331622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.331638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:20.331650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:20.331658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:20.331711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.331718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.331720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.331722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:20.331786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:20.331794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.331806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.331822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.331833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 539
2025-10-10T14:32:20.331842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:20.331867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086968942:2438], now have 1 active actors on pipe
2025-10-10T14:32:20.331879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600887304758218:4646]
2025-10-10T14:32:20.331888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600887304758218:4646]
2025-10-10T14:32:20.331891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600887304758218:4646]
2025-10-10T14:32:20.331904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:20.331914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:20.331921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:20.331922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:20.331927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:20.331946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:20.331954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:20.331974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600887304758218:4646]
2025-10-10T14:32:20.331984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:20.331988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:20.332465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600888086969027:5626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:20.338504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600888086969027:5626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:20.338518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600888086969027:5626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:20.338521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600888086969027:5626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:20.338528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:20.338753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 539
2025-10-10T14:32:20.338738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969060:5626], now have 1 active actors on pipe
2025-10-10T14:32:20.338833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.338842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.338867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:20.338877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.338882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.338884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:20.338894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.338910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:20.338928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.339074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.339082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.339097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.339176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 540 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0
2025-10-10T14:32:20.339558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f345dc-687e6709-520c24e2-50f0a47_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:20.342671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0] Write session: try to update token
2025-10-10T14:32:20.342687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:20.347557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:20.347569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.347576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600887304758218:4646]
2025-10-10T14:32:20.347611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:20.347610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:20.347808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:20.347948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:20.348076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:20.348196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:20.348365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:20.348401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:20.359571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId: src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:20.359626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:20.359643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.359647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:20.359649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:20.359659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600887304758218:4646]
2025-10-10T14:32:20.359662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600887304758218:4646]
2025-10-10T14:32:20.359667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600887304758218:4646]
2025-10-10T14:32:20.359701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:20.359705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:20.359708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:20.359710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:20.359717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.359719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:20.359849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:20.362018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:20.417729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600888086969063:5401]
2025-10-10T14:32:20.417975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 539, pipe: [1:7559600888086969063:5401]
2025-10-10T14:32:20.462949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:20.463277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.463290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.463310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969063:5401], now have 1 active actors on pipe
2025-10-10T14:32:20.463502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:20.463514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600888086969063:5401]
2025-10-10T14:32:20.463516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:20.463544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:20.463610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 540 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0
2025-10-10T14:32:20.463800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 540 sessionId: src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0 is DEAD
2025-10-10T14:32:20.463934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:20.463943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0] Write session will restart in 0.009833s
2025-10-10T14:32:20.463961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0] Write session: Do CDS request
2025-10-10T14:32:20.463966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:20.472932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:20.474752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:20.474900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.474984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:20.475000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 541
2025-10-10T14:32:20.474986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:20.475006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:20.475019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:20.475081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:20.475133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600887304758342:4648]
2025-10-10T14:32:20.475185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.475210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:20.475218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:20.475221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:20.475534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 541 sessionId:  describe result for acl check
2025-10-10T14:32:20.475559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:20.475564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:20.475565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:20.475569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600888086969147:5630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:20.475825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:20.475999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600888086969147:5630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:20.476174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:20.476241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:20.476610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:20.476707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.476719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.476720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.476721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.476723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.476724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.476725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.476726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.476728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.476729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.476730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.476732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.476733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.476740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.476751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.476755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.476759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.476762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.476766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.476770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.476773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.476777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.476781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.476784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.476788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.476792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.476800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.476819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.476832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.476838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.476849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.476854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.476865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.476870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.476881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.476891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.476902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.476912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.476919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.476924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.476930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.476938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.476944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.476950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.476960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.476966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.476971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.476979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.476983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.476990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.476999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.477004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.477045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:20.477842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600888086969147:5630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:20.479356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:20.479923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:20.479944Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:20.479947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:20.479951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:20.479959Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 540 [2:7559600887304758342:4648]
2025-10-10T14:32:20.479973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:20.480001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:20.480011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.480015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.480018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.480036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:20.480045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:20.480060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:20.480146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.480158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.480161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.480165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:20.480260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:20.480272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.480285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.480302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.480308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600888086969147:5630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:20.480322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600888086969147:5630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:20.480325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:20.480325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600888086969147:5630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:20.480333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:20.480345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 540
2025-10-10T14:32:20.480356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969065:2438], now have 1 active actors on pipe
2025-10-10T14:32:20.480371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600887304758337:4648]
2025-10-10T14:32:20.480379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600887304758337:4648]
2025-10-10T14:32:20.480381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600887304758337:4648]
2025-10-10T14:32:20.480393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:20.480402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:20.480405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:20.480406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:20.480419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:20.480442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:20.480451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:20.480490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600887304758337:4648]
2025-10-10T14:32:20.480509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:20.480525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:20.480590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969180:5630], now have 1 active actors on pipe
2025-10-10T14:32:20.480626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 540
2025-10-10T14:32:20.480723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.480739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.480774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:20.480793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.480804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.480813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:20.480827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.480847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:20.480872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.481064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.481079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.481102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.481174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 541 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0
2025-10-10T14:32:20.481501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a4e6b5-e42ede0b-7f220c41-232851ba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:20.484241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0] Write session: try to update token
2025-10-10T14:32:20.484256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:20.491803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:20.491822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.491833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600887304758337:4648]
2025-10-10T14:32:20.491885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:20.491887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:20.492065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:20.492207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:20.492352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:20.492488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:20.492669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:20.492702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:20.499961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId: src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:20.502499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:20.502744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.502771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.502824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:20.502900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:20.509663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:20.509683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.509687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:20.509689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:20.509700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600887304758337:4648]
2025-10-10T14:32:20.509704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600887304758337:4648]
2025-10-10T14:32:20.509708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600887304758337:4648]
2025-10-10T14:32:20.509756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:20.509758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:20.509767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.509768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:20.509769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:20.509771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:20.509922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:20.563639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600888086969194:5401]
2025-10-10T14:32:20.563891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 540, pipe: [1:7559600888086969194:5401]
2025-10-10T14:32:20.624540Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:20.631079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.631102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.631252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.631309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.631369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.631426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.631472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.631480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.631540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.631597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.631654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.631716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.631756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.631761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.631821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.631877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.631933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.631989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.632029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.632034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.632103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.632159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.632216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.632298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.632338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.632343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.632399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.632451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.632507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.632573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.632624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.632632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.632693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.632746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.632801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.632858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.632903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.632909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.632967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.633019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.633075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.633131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.633170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.633175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.633232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.633284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.633355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.633410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.633449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.633454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.633513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.633568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.633623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.633678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.633718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.633723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.633778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:20.633831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:20.633889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:20.633945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:20.633984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:20.633988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:20.634027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969194:5401], now have 1 active actors on pipe
2025-10-10T14:32:20.634267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600888086969194:5401]
2025-10-10T14:32:20.634279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:20.634311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:20.634316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:20.634342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 541 reason: error at write: Disconnected sessionId: src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0
2025-10-10T14:32:20.634536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 541 sessionId: src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0 is DEAD
2025-10-10T14:32:20.634704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:20.634726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0] Write session will restart in 0.005908s
2025-10-10T14:32:20.634701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:20.634750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0] Write session: Do CDS request
2025-10-10T14:32:20.634755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:20.641830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.641928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:20.641942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 542
2025-10-10T14:32:20.642088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.642116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:20.642124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:20.642127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:20.642566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 542 sessionId:  describe result for acl check
2025-10-10T14:32:20.642599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:20.642604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:20.642606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:20.642617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600888086969265:5636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:20.643068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600888086969265:5636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:20.643896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:20.644924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600888086969265:5636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:20.645517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:20.645679Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:20.645688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:20.645697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:20.645736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:20.645768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600887304758464:4651]
2025-10-10T14:32:20.646130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:20.646341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:20.646369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:20.646565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:20.646598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.646602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.646603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.646604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.646605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.646605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.646606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.646607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.646607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.646608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.646608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.646609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.646610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.646614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.646621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.646624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.646626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.646628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.646630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.646632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.646635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.646637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.646639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.646642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.646644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.646646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.646651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.646656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.646661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.646664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.646666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.646669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.646673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.646676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.646678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.646682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.646684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.646687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.646689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.646692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.646695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.646698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.646700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.646703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.646706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.646709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.646711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.646714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.646728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.646732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.646734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.646737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.646759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:20.647095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600888086969265:5636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:20.647108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600888086969265:5636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:20.647111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600888086969265:5636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:20.647117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:20.648785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:20.649096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:20.649104Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:20.649106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:20.649108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:20.649113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 541 [2:7559600887304758464:4651]
2025-10-10T14:32:20.649122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:20.649134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:20.649135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.649138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.649140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.649152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:20.649159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:20.649165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:20.649203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.649207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.649208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.649210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:20.649258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:20.649263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.649270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.649276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.649285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:20.649304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969199:2438], now have 1 active actors on pipe
2025-10-10T14:32:20.649310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969316:5636], now have 1 active actors on pipe
2025-10-10T14:32:20.649315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600887304758459:4651]
2025-10-10T14:32:20.649316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600887304758459:4651]
2025-10-10T14:32:20.649318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600887304758459:4651]
2025-10-10T14:32:20.649326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:20.649350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:20.649350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:20.649353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:20.649354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:20.649362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:20.649364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:20.649380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600887304758459:4651]
2025-10-10T14:32:20.649385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:20.649390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:20.649381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 541
2025-10-10T14:32:20.649395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 541
2025-10-10T14:32:20.649407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.649413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.649441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:20.649450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.649452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.649454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:20.649461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.649469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:20.649482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.649646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.649660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.649738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.649819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 542 partition: 0 MaxSeqNo: 40 sessionId: src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0
2025-10-10T14:32:20.650177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a9dbd6-dc7b7480-f2f6496d-acea8da0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:20.653253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0] Write session: try to update token
2025-10-10T14:32:20.653272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:20.667565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:20.667581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.667583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:20.667584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:20.667593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600887304758459:4651]
2025-10-10T14:32:20.667596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600887304758459:4651]
2025-10-10T14:32:20.667599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600887304758459:4651]
2025-10-10T14:32:20.667634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:20.667637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:20.667639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:20.667642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:20.667643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.667644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:20.667771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:20.668715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId: src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:20.671348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:20.734652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600888086969323:5401]
2025-10-10T14:32:20.734901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 541, pipe: [1:7559600888086969323:5401]
2025-10-10T14:32:20.769259Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:20.769621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.769637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.769683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969323:5401], now have 1 active actors on pipe
2025-10-10T14:32:20.769893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:20.769892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:20.769892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:20.769895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:20.769948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600888086969323:5401]
2025-10-10T14:32:20.769957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 542 reason: error at write: Disconnected sessionId: src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0
2025-10-10T14:32:20.770154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 542 sessionId: src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0 is DEAD
2025-10-10T14:32:20.770328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:20.770340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0] Write session will restart in 0.006350s
2025-10-10T14:32:20.770359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0] Write session: Do CDS request
2025-10-10T14:32:20.770364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:20.777720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.777793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:20.777804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 543
2025-10-10T14:32:20.777919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.777943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:20.777956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:20.777959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:20.778268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 543 sessionId:  describe result for acl check
2025-10-10T14:32:20.778293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:20.778297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:20.778298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:20.778303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600888086969406:5640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:20.778451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:20.778752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600888086969406:5640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:20.780008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:20.780118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600888086969406:5640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:20.780155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:20.780165Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:20.780176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:20.780219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:20.780257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600887304758585:4653]
2025-10-10T14:32:20.780823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:20.781050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:20.781092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:20.781403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:20.781453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.781458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.781460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.781461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.781462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.781463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.781464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.781465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.781466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.781467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.781468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.781469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.781471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.781476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.781486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.781490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.781495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.781498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.781502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.781506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.781509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.781513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.781517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.781521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.781524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.781528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.781534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.781543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.781548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.781554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.781558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.781563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.781567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.781572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.781576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.781581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.781585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.781590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.781600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.781605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.781609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.781619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.781623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.781628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.781637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.781642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.781650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.781655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.781659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.781664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.781672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.781677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.781719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:20.782284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600888086969406:5640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:20.782296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600888086969406:5640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:20.782298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600888086969406:5640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:20.782302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:20.783758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:20.784050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:20.784062Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:20.784064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:20.784067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:20.784072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 542 [2:7559600887304758585:4653]
2025-10-10T14:32:20.784083Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:20.784097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:20.784104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.784107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.784109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.784123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:20.784133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:20.784144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:20.784185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.784191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.784192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.784193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:20.784236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:20.784241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.784248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.784254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.784269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:20.784293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969324:2438], now have 1 active actors on pipe
2025-10-10T14:32:20.784300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969441:5640], now have 1 active actors on pipe
2025-10-10T14:32:20.784306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600887304758580:4653]
2025-10-10T14:32:20.784309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600887304758580:4653]
2025-10-10T14:32:20.784311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600887304758580:4653]
2025-10-10T14:32:20.784324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:20.784325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 542
2025-10-10T14:32:20.784339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 542
2025-10-10T14:32:20.784340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:20.784341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:20.784344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:20.784346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:20.784360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:20.784363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:20.784394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.784403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.784418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600887304758580:4653]
2025-10-10T14:32:20.784425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:20.784429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:20.784453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:20.784464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.784468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.784470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:20.784480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.784494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:20.784514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.784618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.784628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.784642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.784706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 543 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0
2025-10-10T14:32:20.784992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07396f0-92b2e5fb-2803cd31-8f5f1940_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:20.787899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0] Write session: try to update token
2025-10-10T14:32:20.787911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:20.802104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:20.802121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.802123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:20.802124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:20.802132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600887304758580:4653]
2025-10-10T14:32:20.802136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600887304758580:4653]
2025-10-10T14:32:20.802138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600887304758580:4653]
2025-10-10T14:32:20.802175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:20.802178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:20.802180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:20.802182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:20.802186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.802189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:20.802320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:20.803343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId: src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:20.805906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:20.870344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600888086969449:5401]
2025-10-10T14:32:20.870601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 542, pipe: [1:7559600888086969449:5401]
2025-10-10T14:32:20.906564Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:20.906791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.906803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.906840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969449:5401], now have 1 active actors on pipe
2025-10-10T14:32:20.907011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:20.907052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600888086969449:5401]
2025-10-10T14:32:20.907084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:20.907094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:20.907178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 543 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0
2025-10-10T14:32:20.907344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 543 sessionId: src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0 is DEAD
2025-10-10T14:32:20.907516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:20.907534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0] Write session will restart in 0.008648s
2025-10-10T14:32:20.907559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0] Write session: Do CDS request
2025-10-10T14:32:20.907564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:20.916847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:20.917864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.917941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:20.917957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 544
2025-10-10T14:32:20.918105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:20.918131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:20.918139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:20.918142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:20.918530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:20.918553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 544 sessionId:  describe result for acl check
2025-10-10T14:32:20.918593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:20.918600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:20.918602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:20.918608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600888086969534:5644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:20.918694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:20.918705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:20.918716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:20.918773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:20.918809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600887304758707:4655]
2025-10-10T14:32:20.919049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600888086969534:5644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:20.919397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:20.919646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:20.919689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:20.919983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:20.920034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.920040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.920042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.920043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.920044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.920045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.920046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.920047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.920048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.920050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.920051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.920052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.920053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.920058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.920070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.920074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.920078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.920082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.920086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.920090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.920094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.920098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.920102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.920106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.920110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.920114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.920122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.920130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:20.920136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.920142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:20.920146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.920151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:20.920154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.920158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:20.920161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.920164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:20.920166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.920169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:20.920172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.920175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:20.920177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.920180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:20.920183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.920186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:20.920188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.920191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:20.920194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.920197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.920199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.920202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.920204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.920207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.920228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:20.920649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600888086969534:5644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:20.922321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:20.922502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600888086969534:5644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:20.922513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600888086969534:5644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:20.922515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600888086969534:5644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:20.922521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:20.922620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:20.922630Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:20.922632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:20.922635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:20.922640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 543 [2:7559600887304758707:4655]
2025-10-10T14:32:20.922651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:20.922665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:20.922671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.922674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.922676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.922692Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:20.922703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:20.922710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:20.922768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.922776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.922778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.922780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:20.922844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:20.922852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.922863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:20.922874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:20.922892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:20.922916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969450:2438], now have 1 active actors on pipe
2025-10-10T14:32:20.922924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600888086969568:5644], now have 1 active actors on pipe
2025-10-10T14:32:20.922920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 543
2025-10-10T14:32:20.922931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600887304758702:4655]
2025-10-10T14:32:20.922930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 543
2025-10-10T14:32:20.922933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600887304758702:4655]
2025-10-10T14:32:20.922935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600887304758702:4655]
2025-10-10T14:32:20.922944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:20.922956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:20.922958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:20.922960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:20.922961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:20.922976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:20.922980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:20.923016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.923025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.923039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600887304758702:4655]
2025-10-10T14:32:20.923050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:20.923060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:20.923078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7304286a-fd8bdb79-4111a667-842cf281_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:20.923090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:20.923094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:20.923096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:20.923107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:20.923122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:20.923145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.923277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:20.923287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:20.923302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:20.923379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 544 partition: 0 MaxSeqNo: 40 sessionId: src_id|7304286a-fd8bdb79-4111a667-842cf281_0
2025-10-10T14:32:20.923718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d499ee-101c7edb-dd5ef57-27c16e9e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7304286a-fd8bdb79-4111a667-842cf281_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:20.926741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7304286a-fd8bdb79-4111a667-842cf281_0] Write session: try to update token
2025-10-10T14:32:20.926753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7304286a-fd8bdb79-4111a667-842cf281_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:20.941411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:20.941427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:20.941432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:20.941434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:20.941443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600887304758702:4655]
2025-10-10T14:32:20.941447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600887304758702:4655]
2025-10-10T14:32:20.941451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600887304758702:4655]
2025-10-10T14:32:20.941493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:20.941497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:20.941507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:20.941513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:20.941521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:20.941523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:20.941671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:20.942977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId: src_id|7304286a-fd8bdb79-4111a667-842cf281_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:20.945577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:21.007052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600892381936872:5401]
2025-10-10T14:32:21.007292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 543, pipe: [1:7559600892381936872:5401]
2025-10-10T14:32:21.047132Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:21.047490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.047502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.047542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381936872:5401], now have 1 active actors on pipe
2025-10-10T14:32:21.047717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:21.047777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:21.047792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:21.047811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600892381936872:5401]
2025-10-10T14:32:21.047837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:21.047856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 544 reason: error at write: Disconnected sessionId: src_id|7304286a-fd8bdb79-4111a667-842cf281_0
2025-10-10T14:32:21.048053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 544 sessionId: src_id|7304286a-fd8bdb79-4111a667-842cf281_0 is DEAD
2025-10-10T14:32:21.048283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7304286a-fd8bdb79-4111a667-842cf281_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:21.048298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7304286a-fd8bdb79-4111a667-842cf281_0] Write session will restart in 0.009895s
2025-10-10T14:32:21.048335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7304286a-fd8bdb79-4111a667-842cf281_0] Write session: Do CDS request
2025-10-10T14:32:21.048345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7304286a-fd8bdb79-4111a667-842cf281_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:21.057178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:21.058951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:21.059099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:21.059111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:21.059123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:21.059168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:21.059198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600891599726126:4657]
2025-10-10T14:32:21.059645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:21.059875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7304286a-fd8bdb79-4111a667-842cf281_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.059873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:21.059913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:21.059951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:21.059965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 545
2025-10-10T14:32:21.060125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:21.060136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.060160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:21.060162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.060169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:21.060166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.060167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.060168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.060173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:21.060168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.060169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.060169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.060170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.060171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.060171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.060172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.060172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.060173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.060177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.060186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.060188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.060191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.060193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.060196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.060198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.060200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.060202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.060205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.060207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.060209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.060211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.060217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.060222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.060228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.060232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.060234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.060237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.060240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.060243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.060245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.060248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.060251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.060254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.060257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.060259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.060263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.060266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.060269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.060272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.060274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.060277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.060280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.060283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.060285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.060288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.060291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.060294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.060315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:21.060520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 545 sessionId:  describe result for acl check
2025-10-10T14:32:21.060546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:21.060551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:21.060552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:21.060557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600892381936963:5648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:21.060980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600892381936963:5648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:21.062453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:21.062801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:21.062814Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:21.062815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:21.062819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:21.062823Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 544 [2:7559600891599726126:4657]
2025-10-10T14:32:21.062835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:21.062851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:21.062859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.062862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.062864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.062876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:21.062883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:21.062890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:21.062944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.062954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.062957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.062959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:21.063085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:21.063094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.063104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.063120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.063112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 544
2025-10-10T14:32:21.063141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:21.063143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600892381936963:5648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:21.063164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381936873:2438], now have 1 active actors on pipe
2025-10-10T14:32:21.063176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600891599726121:4657]
2025-10-10T14:32:21.063194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600891599726121:4657]
2025-10-10T14:32:21.063200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600891599726121:4657]
2025-10-10T14:32:21.063214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:21.063236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:21.063239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:21.063245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:21.063247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:21.063254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:21.063257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:21.063280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600891599726121:4657]
2025-10-10T14:32:21.063293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:21.063300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:21.067934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600892381936963:5648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:21.067948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600892381936963:5648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:21.067952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600892381936963:5648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:21.067969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:21.068206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381936996:5648], now have 1 active actors on pipe
2025-10-10T14:32:21.068239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 544
2025-10-10T14:32:21.068311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.068323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.068352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20b37264-5f2d0384-e9392403-cd62376_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:21.068369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.068379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.068381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:21.068393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.068408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:21.068422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.068568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.068577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.068591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.068668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 545 partition: 0 MaxSeqNo: 40 sessionId: src_id|20b37264-5f2d0384-e9392403-cd62376_0
2025-10-10T14:32:21.069024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7304286a-fd8bdb79-4111a667-842cf281_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20b37264-5f2d0384-e9392403-cd62376_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:21.072050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b37264-5f2d0384-e9392403-cd62376_0] Write session: try to update token
2025-10-10T14:32:21.072063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b37264-5f2d0384-e9392403-cd62376_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:21.078883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:21.078899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.078909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600891599726121:4657]
2025-10-10T14:32:21.078944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:21.078959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:21.079112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:21.079243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.079374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.079505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.079690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:21.079728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:21.088049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId: src_id|20b37264-5f2d0384-e9392403-cd62376_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:21.090831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:21.090910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:21.090926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.090929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:21.090931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:21.090941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600891599726121:4657]
2025-10-10T14:32:21.090946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600891599726121:4657]
2025-10-10T14:32:21.090949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600891599726121:4657]
2025-10-10T14:32:21.090973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:21.090985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:21.090989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:21.090999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.091014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.091039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:21.091053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.091055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:21.091184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:21.147866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600892381937000:5401]
2025-10-10T14:32:21.148139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 544, pipe: [1:7559600892381937000:5401]
2025-10-10T14:32:21.195949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:21.196240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937000:5401], now have 1 active actors on pipe
2025-10-10T14:32:21.196463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:21.196500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:21.196505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600892381937000:5401]
2025-10-10T14:32:21.196516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:21.196525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:21.196597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 545 reason: error at write: Disconnected sessionId: src_id|20b37264-5f2d0384-e9392403-cd62376_0
2025-10-10T14:32:21.196794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 545 sessionId: src_id|20b37264-5f2d0384-e9392403-cd62376_0 is DEAD
2025-10-10T14:32:21.196970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b37264-5f2d0384-e9392403-cd62376_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:21.196983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b37264-5f2d0384-e9392403-cd62376_0] Write session will restart in 0.009667s
2025-10-10T14:32:21.197004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b37264-5f2d0384-e9392403-cd62376_0] Write session: Do CDS request
2025-10-10T14:32:21.197008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b37264-5f2d0384-e9392403-cd62376_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:21.206030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:21.207604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:21.207795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:21.207804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:21.207813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:21.207847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b37264-5f2d0384-e9392403-cd62376_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.207858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:21.207890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600891599726266:4660]
2025-10-10T14:32:21.207968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:21.207985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 546
2025-10-10T14:32:21.208145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.208169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:21.208176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:21.208180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:21.208304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:21.208450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 546 sessionId:  describe result for acl check
2025-10-10T14:32:21.208478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:21.208481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:21.208482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:21.208487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600892381937115:5659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:21.208491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:21.208520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:21.208737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:21.208781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.208785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.208788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.208788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.208789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.208790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.208790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.208791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.208792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.208792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.208793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.208793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.208794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.208799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.208806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.208809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.208811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.208812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.208814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.208816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.208818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.208821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.208823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.208837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600892381937115:5659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:21.208825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.208827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.208829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.208833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.208839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.208843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.208846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.208851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.208856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.208860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.208866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.208870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.208874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.208878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.208882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.208886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.208890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.208894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.208904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.208913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.208920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.208923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.208926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.208931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.208934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.208936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.208939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.208945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.208947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.208970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:21.210484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600892381937115:5659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:21.211082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:21.211544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:21.211558Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:21.211560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:21.211564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:21.211570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 545 [2:7559600891599726266:4660]
2025-10-10T14:32:21.211582Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:21.211603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:21.211611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.211615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.211621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.211637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:21.211649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:21.211661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:21.211718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.211725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.211727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.211729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:21.211787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:21.211795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.211806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.211821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.211839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:21.211865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937013:2438], now have 1 active actors on pipe
2025-10-10T14:32:21.211877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600891599726257:4660]
2025-10-10T14:32:21.211883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600891599726257:4660]
2025-10-10T14:32:21.211885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600891599726257:4660]
2025-10-10T14:32:21.211887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 545
2025-10-10T14:32:21.211901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:21.211918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:21.211921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:21.211923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:21.211925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:21.211939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:21.211946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:21.211974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600891599726257:4660]
2025-10-10T14:32:21.211985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:21.212000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:21.216740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600892381937115:5659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:21.216752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600892381937115:5659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:21.216755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600892381937115:5659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:21.216761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:21.217147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937149:5659], now have 1 active actors on pipe
2025-10-10T14:32:21.217171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 545
2025-10-10T14:32:21.217248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.217261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.217289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92a5823f-21d2d287-ca15299a-4576dc32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:21.217301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.217310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.217313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:21.217327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.217362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:21.217385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.217543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.217552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.217568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.217636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 546 partition: 0 MaxSeqNo: 40 sessionId: src_id|92a5823f-21d2d287-ca15299a-4576dc32_0
2025-10-10T14:32:21.218002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b37264-5f2d0384-e9392403-cd62376_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|92a5823f-21d2d287-ca15299a-4576dc32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:21.221111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92a5823f-21d2d287-ca15299a-4576dc32_0] Write session: try to update token
2025-10-10T14:32:21.221127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92a5823f-21d2d287-ca15299a-4576dc32_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:21.222680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:21.222693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.222702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600891599726257:4660]
2025-10-10T14:32:21.222754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:21.222759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:21.222938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:21.223083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.223217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.223345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.223553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:21.223591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:21.237697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId: src_id|92a5823f-21d2d287-ca15299a-4576dc32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:21.240465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:21.240486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.240489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:21.240491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:21.240501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600891599726257:4660]
2025-10-10T14:32:21.240505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600891599726257:4660]
2025-10-10T14:32:21.240509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600891599726257:4660]
2025-10-10T14:32:21.240556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:21.240563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:21.240567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:21.240571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:21.240572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.240574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:21.240767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:21.241364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:21.296834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600892381937168:5401]
2025-10-10T14:32:21.297126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 545, pipe: [1:7559600892381937168:5401]
2025-10-10T14:32:21.344426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:21.344636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.344647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.344667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937168:5401], now have 1 active actors on pipe
2025-10-10T14:32:21.344857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:21.344872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:21.344875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:21.344873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:21.344914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600892381937168:5401]
2025-10-10T14:32:21.344960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 546 reason: error at write: Disconnected sessionId: src_id|92a5823f-21d2d287-ca15299a-4576dc32_0
2025-10-10T14:32:21.345164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 546 sessionId: src_id|92a5823f-21d2d287-ca15299a-4576dc32_0 is DEAD
2025-10-10T14:32:21.345352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a5823f-21d2d287-ca15299a-4576dc32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:21.345367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a5823f-21d2d287-ca15299a-4576dc32_0] Write session will restart in 0.006382s
2025-10-10T14:32:21.345393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a5823f-21d2d287-ca15299a-4576dc32_0] Write session: Do CDS request
2025-10-10T14:32:21.345402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a5823f-21d2d287-ca15299a-4576dc32_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:21.352876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92a5823f-21d2d287-ca15299a-4576dc32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.352937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:21.352952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 547
2025-10-10T14:32:21.353054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:21.353126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.353163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:21.353174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:21.353178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:21.353560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 547 sessionId:  describe result for acl check
2025-10-10T14:32:21.353591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:21.353596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:21.353598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:21.353605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600892381937256:5668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:21.354057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600892381937256:5668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:21.354449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:21.354607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:21.354617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:21.354629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:21.354683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:21.354731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600891599726426:4675]
2025-10-10T14:32:21.355225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:21.355455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:21.355503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:21.355808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:21.355863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.355869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.355870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.355871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.355872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.355873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.355874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.355874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.355878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600892381937256:5668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:21.355876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.355877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.355878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.355879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.355880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.355885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.355895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.355899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.355902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.355906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.355909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.355912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.355915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.355919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.355922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.355925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.355929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.355932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.355938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.355947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.355953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.355959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.355963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.355968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.355972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.355978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.355982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.355987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.355991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.355996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.356001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.356006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.356010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.356014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.356018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.356023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.356026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.356031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.356036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.356040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.356044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.356048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.356052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.356056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.356090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:21.358114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:21.358243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600892381937256:5668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:21.358264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600892381937256:5668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:21.358268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600892381937256:5668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:21.358274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:21.358425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:21.358438Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:21.358440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:21.358443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:21.358449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 546 [2:7559600891599726426:4675]
2025-10-10T14:32:21.358460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:21.358480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:21.358487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.358491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.358497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.358512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:21.358525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:21.358532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:21.358585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.358591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.358593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.358596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:21.358655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:21.358663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.358670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.358676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.358686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:21.358706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937169:2438], now have 1 active actors on pipe
2025-10-10T14:32:21.358709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937290:5668], now have 1 active actors on pipe
2025-10-10T14:32:21.358716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600891599726421:4675]
2025-10-10T14:32:21.358718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600891599726421:4675]
2025-10-10T14:32:21.358720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600891599726421:4675]
2025-10-10T14:32:21.358744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:21.358735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 546
2025-10-10T14:32:21.358756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:21.358756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 546
2025-10-10T14:32:21.358768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:21.358771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:21.358772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:21.358777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:21.358780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:21.358812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.358819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.358829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600891599726421:4675]
2025-10-10T14:32:21.358835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:21.358852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:21.358860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:21.358866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.358868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.358870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:21.358877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.358885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:21.358903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.359030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.359037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.359048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.359107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 547 partition: 0 MaxSeqNo: 40 sessionId: src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0
2025-10-10T14:32:21.359403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92a5823f-21d2d287-ca15299a-4576dc32_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:21.362209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0] Write session: try to update token
2025-10-10T14:32:21.362224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:21.375338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId: src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:21.376426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:21.376447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.376449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:21.376451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:21.376460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600891599726421:4675]
2025-10-10T14:32:21.376464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600891599726421:4675]
2025-10-10T14:32:21.376469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600891599726421:4675]
2025-10-10T14:32:21.376515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:21.376526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.376532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:21.376641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:21.376658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:21.376661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:21.376665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:21.377673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:21.445314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600892381937297:5401]
2025-10-10T14:32:21.445595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 546, pipe: [1:7559600892381937297:5401]
2025-10-10T14:32:21.484511Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:21.484833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.484847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.484883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937297:5401], now have 1 active actors on pipe
2025-10-10T14:32:21.485111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:21.485102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:21.485164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:21.485174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:21.485249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 547 reason: error at write: Disconnected sessionId: src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0
2025-10-10T14:32:21.485408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600892381937297:5401]
2025-10-10T14:32:21.485475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 547 sessionId: src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0 is DEAD
2025-10-10T14:32:21.485604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:21.485624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0] Write session will restart in 0.009397s
2025-10-10T14:32:21.485642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0] Write session: Do CDS request
2025-10-10T14:32:21.485647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:21.494275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:21.495753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.495787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:21.495821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:21.495833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 548
2025-10-10T14:32:21.495959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:21.495970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:21.495966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.495980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:21.495990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:21.495994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:21.495997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:21.496031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:21.496069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600891599726553:4677]
2025-10-10T14:32:21.496307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 548 sessionId:  describe result for acl check
2025-10-10T14:32:21.496331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:21.496332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:21.496334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:21.496338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600892381937386:5672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:21.496673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:21.496743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600892381937386:5672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:21.496940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:21.496979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:21.497278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:21.497342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.497348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.497349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.497350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.497351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.497352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.497353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.497354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.497355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.497356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.497358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.497359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.497360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.497365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.497377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.497381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.497385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.497390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.497394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.497398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.497402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.497405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.497410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.497414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.497418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.497422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.497428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.497436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.497443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.497448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.497452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.497457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.497461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.497467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.497471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.497476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.497480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.497486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.497490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.497495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.497501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.497506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.497510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.497516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.497520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.497525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.497535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.497540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.497544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.497550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.497554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.497560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.497600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:21.498655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600892381937386:5672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:21.499692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:21.500005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:21.500016Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:21.500018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:21.500021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:21.500027Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 547 [2:7559600891599726553:4677]
2025-10-10T14:32:21.500037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:21.500052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:21.500059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.500063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.500065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.500080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:21.500091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:21.500102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:21.500153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.500159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.500161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.500164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:21.500223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:21.500230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.500241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.500258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.500279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:21.500285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 547
2025-10-10T14:32:21.500304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937299:2438], now have 1 active actors on pipe
2025-10-10T14:32:21.500315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600891599726547:4677]
2025-10-10T14:32:21.500318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600891599726547:4677]
2025-10-10T14:32:21.500320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600891599726547:4677]
2025-10-10T14:32:21.500328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:21.500336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:21.500342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:21.500345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:21.500346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:21.500358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:21.500365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:21.500389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600891599726547:4677]
2025-10-10T14:32:21.500402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:21.500422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:21.500521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600892381937386:5672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:21.500534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600892381937386:5672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:21.500536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600892381937386:5672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:21.500541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:21.500695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937422:5672], now have 1 active actors on pipe
2025-10-10T14:32:21.500728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 547
2025-10-10T14:32:21.500781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.500790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.500812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:21.500822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.500825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.500826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:21.500838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.500853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:21.500870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.501011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.501019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.501033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.501100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 548 partition: 0 MaxSeqNo: 40 sessionId: src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0
2025-10-10T14:32:21.501371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b62313-c5f23e09-c6ac5fd6-8b47c8b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:21.503807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0] Write session: try to update token
2025-10-10T14:32:21.503820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:21.511019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:21.511035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.511045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600891599726547:4677]
2025-10-10T14:32:21.511088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:21.511093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:21.511286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:21.511430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.511574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.511715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.511994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:21.512035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:21.517345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId: src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:21.519840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:21.520019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.520038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.520080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:21.520168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:21.527821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:21.527837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.527839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:21.527841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:21.527852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600891599726547:4677]
2025-10-10T14:32:21.527856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600891599726547:4677]
2025-10-10T14:32:21.527859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600891599726547:4677]
2025-10-10T14:32:21.527903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:21.527904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:21.527909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:21.527913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:21.527915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.527917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:21.528037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:21.585596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600892381937434:5401]
2025-10-10T14:32:21.585840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 547, pipe: [1:7559600892381937434:5401]
2025-10-10T14:32:21.630612Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:21.636905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.636924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.637067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.637120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.637177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.637251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.637296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.637309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.637383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.637442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.637501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.637557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.637596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.637602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.637658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.637710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.637764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.637817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.637854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.637859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.637915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.637970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.638024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.638079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.638117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.638122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.638179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.638235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.638288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.638340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.638382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.638388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.638443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.638497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.638554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.638610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.638647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.638654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.638708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.638772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.638827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.638880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.638918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.638925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.638980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.639030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.639084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.639152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.639189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.639194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.639247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.639300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.639354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.639407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.639444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.639449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.639502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.639554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.639614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.639667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.639707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.639716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.639759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937434:5401], now have 1 active actors on pipe
2025-10-10T14:32:21.639967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:21.640016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:21.640019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:21.640050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 548 reason: error at write: Disconnected sessionId: src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0
2025-10-10T14:32:21.640172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600892381937434:5401]
2025-10-10T14:32:21.640269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 548 sessionId: src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0 is DEAD
2025-10-10T14:32:21.640386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:21.640395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0] Write session will restart in 0.009389s
2025-10-10T14:32:21.640409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:21.640424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0] Write session: Do CDS request
2025-10-10T14:32:21.640437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:21.648362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:21.649970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:21.650146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:21.650157Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:21.650168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:21.650214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:21.650248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600891599726683:4680]
2025-10-10T14:32:21.650632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:21.650815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.650899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:21.650932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:21.650906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:21.650923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 549
2025-10-10T14:32:21.651047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.651072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:21.651080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:21.651082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:21.651168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:21.651206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.651211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.651211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.651212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.651213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.651213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.651214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.651215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.651215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.651216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.651217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.651217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.651218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.651221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.651230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.651232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.651235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.651237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.651239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.651242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.651244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.651246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.651248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.651251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.651253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.651255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.651261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.651266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.651270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.651274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.651276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.651280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.651282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.651286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.651288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.651292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.651294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.651297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.651299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.651303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.651305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.651308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.651311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.651314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.651316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.651319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.651322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.651325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.651329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.651334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.651337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.651340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.651363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:21.651366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 549 sessionId:  describe result for acl check
2025-10-10T14:32:21.651391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:21.651392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:21.651393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:21.651397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600892381937530:5678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:21.652087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600892381937530:5678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:21.653448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:21.653838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:21.653850Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:21.653852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:21.653856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:21.653863Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 548 [2:7559600891599726683:4680]
2025-10-10T14:32:21.653876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:21.653895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:21.653902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.653906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.653908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.653923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:21.653935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:21.653948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:21.653996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.654003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.654005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.654008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:21.654052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600892381937530:5678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:21.654067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:21.654076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.654087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.654100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.654117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:21.654141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937439:2438], now have 1 active actors on pipe
2025-10-10T14:32:21.654128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 548
2025-10-10T14:32:21.654149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600891599726678:4680]
2025-10-10T14:32:21.654156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600891599726678:4680]
2025-10-10T14:32:21.654158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600891599726678:4680]
2025-10-10T14:32:21.654166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:21.654179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:21.654179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:21.654182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:21.654184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:21.654200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:21.654203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:21.654227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600891599726678:4680]
2025-10-10T14:32:21.654239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:21.654248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:21.658676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600892381937530:5678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:21.658689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600892381937530:5678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:21.658692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600892381937530:5678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:21.658698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:21.658943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937566:5678], now have 1 active actors on pipe
2025-10-10T14:32:21.658971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 548
2025-10-10T14:32:21.659059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.659071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.659104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d87c4489-ae47e895-63bac06a-737fade6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:21.659121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.659132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.659135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:21.659147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.659167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:21.659187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.659345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.659353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.659369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.659440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 549 partition: 0 MaxSeqNo: 40 sessionId: src_id|d87c4489-ae47e895-63bac06a-737fade6_0
2025-10-10T14:32:21.659743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2116ec04-3b55582f-f9c08a90-22442eaf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d87c4489-ae47e895-63bac06a-737fade6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:21.662155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c4489-ae47e895-63bac06a-737fade6_0] Write session: try to update token
2025-10-10T14:32:21.662168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c4489-ae47e895-63bac06a-737fade6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:21.664359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:21.664374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.664383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600891599726678:4680]
2025-10-10T14:32:21.664423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:21.664435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:21.664589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:21.664728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.664860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.664991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:21.665169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:21.665204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:21.674747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId: src_id|d87c4489-ae47e895-63bac06a-737fade6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:21.677112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:21.677305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.677325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.677381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:21.677456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:21.680652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:21.680666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.680669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:21.680671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:21.680681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600891599726678:4680]
2025-10-10T14:32:21.680685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600891599726678:4680]
2025-10-10T14:32:21.680691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600891599726678:4680]
2025-10-10T14:32:21.680734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:21.680739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:21.680744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:21.680745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.680747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:21.680748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:21.680873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:21.740230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600892381937569:5401]
2025-10-10T14:32:21.740444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 548, pipe: [1:7559600892381937569:5401]
2025-10-10T14:32:21.783027Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:21.789290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.789314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.789468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.789521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.789575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.789631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.789839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.789849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.789906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.789954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.790007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.790064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.790103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.790109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.790167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.790219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.790272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.790326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.790363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.790368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.790425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.790479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.790531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.790583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.790627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.790632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.790685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.790747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.790802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.790854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.790892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.790897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.790952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.791004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.791065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.791122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.791163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.791170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.791224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.791273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.791328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.791381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.791418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.791423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.791476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.791528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.791581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.791633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.791673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.791678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.791733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.791796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.791848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.791899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.791936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.791941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.791993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:21.792042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:21.792093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:21.792150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:21.792195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:21.792202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:21.792236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937569:5401], now have 1 active actors on pipe
2025-10-10T14:32:21.792429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:21.792464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:21.792468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:21.792483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600892381937569:5401]
2025-10-10T14:32:21.792497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 549 reason: error at write: Disconnected sessionId: src_id|d87c4489-ae47e895-63bac06a-737fade6_0
2025-10-10T14:32:21.792574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:21.792710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 549 sessionId: src_id|d87c4489-ae47e895-63bac06a-737fade6_0 is DEAD
2025-10-10T14:32:21.792854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c4489-ae47e895-63bac06a-737fade6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:21.792863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c4489-ae47e895-63bac06a-737fade6_0] Write session will restart in 0.007145s
2025-10-10T14:32:21.792881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c4489-ae47e895-63bac06a-737fade6_0] Write session: Do CDS request
2025-10-10T14:32:21.792892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c4489-ae47e895-63bac06a-737fade6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:21.800762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c4489-ae47e895-63bac06a-737fade6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.801052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:21.801066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 550
2025-10-10T14:32:21.801173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.801200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:21.801207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:21.801210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:21.801602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 550 sessionId:  describe result for acl check
2025-10-10T14:32:21.801642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:21.801648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:21.801650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:21.801655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600892381937660:5682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:21.801764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:21.802076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600892381937660:5682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:21.803401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:21.803552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:21.803564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:21.803574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:21.803626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:21.803663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600891599726812:4682]
2025-10-10T14:32:21.804157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600892381937660:5682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:21.804224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:21.804489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:21.804526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:21.804816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:21.804864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.804871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.804872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.804873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.804874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.804875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.804876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.804877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.804879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.804880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.804881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.804882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.804883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.804888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.804899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.804903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.804907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.804911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.804915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.804919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.804923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.804926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.804930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.804939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.804947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.804950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.804961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.804974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.804979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.804985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.804993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.804998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.805007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.805016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.805024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.805031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.805039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.805044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.805052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.805061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.805069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.805074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.805084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.805092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.805096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.805100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.805109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.805114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.805122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.805131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.805136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.805144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.805185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:21.807154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600892381937660:5682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:21.807167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600892381937660:5682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:21.807171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600892381937660:5682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:21.807178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:21.807264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:21.807558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:21.807569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:21.807571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:21.807574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:21.807580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 549 [2:7559600891599726812:4682]
2025-10-10T14:32:21.807590Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:21.807609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:21.807616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.807619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.807622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.807638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:21.807651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:21.807662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:21.807709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.807718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.807720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.807722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:21.807780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:21.807787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.807798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.807812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.807828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:21.807853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937695:5682], now have 1 active actors on pipe
2025-10-10T14:32:21.807861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937570:2438], now have 1 active actors on pipe
2025-10-10T14:32:21.807868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600891599726807:4682]
2025-10-10T14:32:21.807873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600891599726807:4682]
2025-10-10T14:32:21.807875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600891599726807:4682]
2025-10-10T14:32:21.807865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 549
2025-10-10T14:32:21.807869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 549
2025-10-10T14:32:21.807888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:21.807904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:21.807905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:21.807908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:21.807910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:21.807920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:21.807923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:21.807952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.807960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.807978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600891599726807:4682]
2025-10-10T14:32:21.807989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:21.808008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:21.808015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9e50080-9068253b-19a21985-20a2b22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:21.808022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.808026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.808028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:21.808040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.808054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:21.808077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.808219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.808228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.808241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.808322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 550 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9e50080-9068253b-19a21985-20a2b22_0
2025-10-10T14:32:21.808598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c4489-ae47e895-63bac06a-737fade6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9e50080-9068253b-19a21985-20a2b22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:21.810964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e50080-9068253b-19a21985-20a2b22_0] Write session: try to update token
2025-10-10T14:32:21.810981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e50080-9068253b-19a21985-20a2b22_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:21.824406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId: src_id|c9e50080-9068253b-19a21985-20a2b22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:21.826025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:21.826042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.826045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:21.826048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:21.826057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600891599726807:4682]
2025-10-10T14:32:21.826061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600891599726807:4682]
2025-10-10T14:32:21.826064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600891599726807:4682]
2025-10-10T14:32:21.826103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:21.826112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:21.826115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:21.826119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:21.826119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.826122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:21.826253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:21.826897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:21.892793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600892381937702:5401]
2025-10-10T14:32:21.892990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 549, pipe: [1:7559600892381937702:5401]
2025-10-10T14:32:21.928916Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:21.929265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.929277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.929314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937702:5401], now have 1 active actors on pipe
2025-10-10T14:32:21.929460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:21.929535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600892381937702:5401]
2025-10-10T14:32:21.929561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:21.929564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:21.929647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 550 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9e50080-9068253b-19a21985-20a2b22_0
2025-10-10T14:32:21.929840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 550 sessionId: src_id|c9e50080-9068253b-19a21985-20a2b22_0 is DEAD
2025-10-10T14:32:21.929986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e50080-9068253b-19a21985-20a2b22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:21.929996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e50080-9068253b-19a21985-20a2b22_0] Write session will restart in 0.008887s
2025-10-10T14:32:21.930015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e50080-9068253b-19a21985-20a2b22_0] Write session: Do CDS request
2025-10-10T14:32:21.930020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e50080-9068253b-19a21985-20a2b22_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:21.937702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:21.939311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:21.939457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:21.939468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:21.939479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:21.939529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:21.939569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600891599726942:4684]
2025-10-10T14:32:21.939883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e50080-9068253b-19a21985-20a2b22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.939989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:21.940006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 551
2025-10-10T14:32:21.940098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:21.940138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:21.940167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:21.940177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:21.940182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:21.940372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:21.940414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:21.940539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 551 sessionId:  describe result for acl check
2025-10-10T14:32:21.940574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:21.940580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:21.940582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:21.940588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600892381937796:5686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:21.940673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:21.940721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.940727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.940728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.940729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.940730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.940732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.940733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.940734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.940735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.940736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.940737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.940738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.940739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.940744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.940751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.940753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.940755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.940757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.940760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.940761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.940764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.940766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.940768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.940770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.940772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.940774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.940779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.940785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:21.940790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.940794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:21.940796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.940799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:21.940806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.940809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:21.940812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.940815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:21.940818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.940821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:21.940823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.940828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:21.940830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.940833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:21.940838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.940841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:21.940843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.940846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:21.940849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.940852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.940856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.940862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.940866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.940875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.940920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:21.941094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600892381937796:5686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:21.942960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:21.943235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600892381937796:5686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:21.943286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:21.943298Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:21.943300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:21.943303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:21.943309Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 550 [2:7559600891599726942:4684]
2025-10-10T14:32:21.943320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:21.943336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:21.943337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.943340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.943341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.943354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:21.943363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:21.943372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:21.943410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.943414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.943415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.943417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:21.943464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:21.943469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.943476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:21.943486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:21.943499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:21.943516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937703:2438], now have 1 active actors on pipe
2025-10-10T14:32:21.943526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600891599726937:4684]
2025-10-10T14:32:21.943527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600891599726937:4684]
2025-10-10T14:32:21.943528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600891599726937:4684]
2025-10-10T14:32:21.943539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:21.943551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:21.943554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:21.943556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:21.943558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:21.943569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:21.943572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:21.943589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600891599726937:4684]
2025-10-10T14:32:21.943598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:21.943604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:21.943609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 550
2025-10-10T14:32:21.947871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600892381937796:5686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:21.947885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600892381937796:5686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:21.947888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600892381937796:5686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:21.947896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:21.948103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600892381937832:5686], now have 1 active actors on pipe
2025-10-10T14:32:21.948136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 550
2025-10-10T14:32:21.948180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.948190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.948225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:21.948239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:21.948248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:21.948250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:21.948266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:21.948285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:21.948304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.948415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:21.948422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:21.948435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:21.948542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 551 partition: 0 MaxSeqNo: 40 sessionId: src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0
2025-10-10T14:32:21.948809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e50080-9068253b-19a21985-20a2b22_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:21.951446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0] Write session: try to update token
2025-10-10T14:32:21.951462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:21.961887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:21.961903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:21.961907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:21.961909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:21.961919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600891599726937:4684]
2025-10-10T14:32:21.961923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600891599726937:4684]
2025-10-10T14:32:21.961927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600891599726937:4684]
2025-10-10T14:32:21.961967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:21.961973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:21.961979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:21.961980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:21.961983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:21.961983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:21.962114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:21.965564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId: src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:21.967912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:22.029491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600896676905132:5401]
2025-10-10T14:32:22.029698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 550, pipe: [1:7559600896676905132:5401]
2025-10-10T14:32:22.065123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:22.065356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.065371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.065423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905132:5401], now have 1 active actors on pipe
2025-10-10T14:32:22.065625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:22.065642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600896676905132:5401]
2025-10-10T14:32:22.065667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:22.065670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:22.065753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 551 reason: error at write: Disconnected sessionId: src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0
2025-10-10T14:32:22.065838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:22.065971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 551 sessionId: src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0 is DEAD
2025-10-10T14:32:22.066141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:22.066163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0] Write session will restart in 0.006926s
2025-10-10T14:32:22.066183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0] Write session: Do CDS request
2025-10-10T14:32:22.066191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:22.073749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.073896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:22.073913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 552
2025-10-10T14:32:22.074061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.074108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:22.074112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:22.074119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:22.074347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:22.074448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 552 sessionId:  describe result for acl check
2025-10-10T14:32:22.074483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:22.074489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:22.074491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:22.074497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600896676905224:5690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:22.074950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600896676905224:5690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:22.075976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:22.076149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:22.076160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:22.076170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:22.076221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:22.076258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600895894694369:4686]
2025-10-10T14:32:22.076645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600896676905224:5690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:22.076807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:22.077061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:22.077102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:22.077422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:22.077466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.077472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.077472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.077473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.077474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.077474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.077475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.077475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.077476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.077476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.077477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.077477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.077478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.077482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.077489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.077492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.077494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.077496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.077499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.077501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.077503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.077505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.077508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.077510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.077512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.077515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.077521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.077526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.077531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.077534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.077536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.077539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.077542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.077545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.077547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.077550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.077553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.077556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.077558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.077562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.077564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.077567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.077570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.077573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.077576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.077579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.077581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.077584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.077587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.077590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.077593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.077596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.077618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:22.079510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600896676905224:5690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:22.079521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600896676905224:5690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:22.079524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600896676905224:5690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:22.079529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:22.079823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:22.080119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:22.080130Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:22.080131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:22.080134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:22.080138Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 551 [2:7559600895894694369:4686]
2025-10-10T14:32:22.080146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:22.080159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:22.080164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.080166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.080167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.080179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:22.080188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:22.080193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:22.080232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.080238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.080239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.080241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:22.080285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:22.080290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.080296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.080303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.080312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:22.080331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905259:5690], now have 1 active actors on pipe
2025-10-10T14:32:22.080337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905133:2438], now have 1 active actors on pipe
2025-10-10T14:32:22.080342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600895894694364:4686]
2025-10-10T14:32:22.080344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600895894694364:4686]
2025-10-10T14:32:22.080345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600895894694364:4686]
2025-10-10T14:32:22.080354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:22.080367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:22.080372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:22.080375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:22.080376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:22.080379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:22.080382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:22.080398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600895894694364:4686]
2025-10-10T14:32:22.080396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 551
2025-10-10T14:32:22.080408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 551
2025-10-10T14:32:22.080409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:22.080411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:22.080438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.080445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.080471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9206b382-7606b002-f798d8e7-e0830967_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:22.080482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.080489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.080491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:22.080503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.080518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:22.080535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.080661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.080669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.080681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.080768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 552 partition: 0 MaxSeqNo: 40 sessionId: src_id|9206b382-7606b002-f798d8e7-e0830967_0
2025-10-10T14:32:22.081084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a323b2db-d5a6325d-63493c51-a1448a9f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9206b382-7606b002-f798d8e7-e0830967_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:22.083655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9206b382-7606b002-f798d8e7-e0830967_0] Write session: try to update token
2025-10-10T14:32:22.083668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9206b382-7606b002-f798d8e7-e0830967_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:22.091571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:22.091589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:22.091600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600895894694364:4686]
2025-10-10T14:32:22.091636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:22.091649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:22.091823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:22.091963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:22.092098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:22.092241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:22.092428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:22.092473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:22.096605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId: src_id|9206b382-7606b002-f798d8e7-e0830967_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:22.099159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:22.099356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.099381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.099423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:22.099515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:22.108774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:22.108795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:22.108798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:22.108800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:22.108810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600895894694364:4686]
2025-10-10T14:32:22.108814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600895894694364:4686]
2025-10-10T14:32:22.108818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600895894694364:4686]
2025-10-10T14:32:22.108851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:22.108863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:22.108868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:22.108870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.108872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:22.108875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:22.108995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:22.165698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600896676905267:5401]
2025-10-10T14:32:22.165946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 551, pipe: [1:7559600896676905267:5401]
2025-10-10T14:32:22.215416Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:22.221732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.221753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.221901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.221959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.222020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.222075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.222119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.222128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.222186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.222243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.222298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.222354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.222393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.222398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.222456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.222508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.222563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.222623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.222663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.222668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.222724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.222794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.222851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.222906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.222947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.222952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.223009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.223060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.223113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.223171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.223217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.223225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.223293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.223357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.223422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.223489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.223560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.223566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.223634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.223696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.223763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.223825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.223870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.223877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.223945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.224007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.224069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.224134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.224180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.224187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.224255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.224315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.224379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.224443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.224489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.224498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.224563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:22.224631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:22.224700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:22.224767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:22.224815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:22.224823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:22.224872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905267:5401], now have 1 active actors on pipe
2025-10-10T14:32:22.225088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:22.225103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:22.225118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600896676905267:5401]
2025-10-10T14:32:22.225128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 552 reason: error at write: Disconnected sessionId: src_id|9206b382-7606b002-f798d8e7-e0830967_0
2025-10-10T14:32:22.225145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:22.225353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 552 sessionId: src_id|9206b382-7606b002-f798d8e7-e0830967_0 is DEAD
2025-10-10T14:32:22.225508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9206b382-7606b002-f798d8e7-e0830967_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:22.225520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9206b382-7606b002-f798d8e7-e0830967_0] Write session will restart in 0.009669s
2025-10-10T14:32:22.225548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9206b382-7606b002-f798d8e7-e0830967_0] Write session: Do CDS request
2025-10-10T14:32:22.225553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9206b382-7606b002-f798d8e7-e0830967_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:22.225878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:22.234622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:22.236352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:22.236498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:22.236508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:22.236517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:22.236553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:22.236581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600895894694512:4689]
2025-10-10T14:32:22.236728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9206b382-7606b002-f798d8e7-e0830967_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.236916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:22.236929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 553
2025-10-10T14:32:22.237006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:22.237035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.237059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:22.237066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:22.237069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:22.237220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:22.237259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:22.237449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 553 sessionId:  describe result for acl check
2025-10-10T14:32:22.237490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:22.237485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:22.237493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:22.237494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:22.237500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600896676905376:5695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:22.237538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.237544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.237545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.237546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.237548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.237549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.237550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.237551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.237552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.237553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.237554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.237555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.237555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.237560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.237572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.237576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.237580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.237583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.237586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.237589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.237593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.237596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.237600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.237608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.237612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.237617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.237624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.237637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.237647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.237657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.237661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.237665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.237673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.237678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.237686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.237690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.237698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.237703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.237712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.237716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.237721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.237729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.237733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.237737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.237742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.237746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.237750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.237754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.237758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.237767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.237770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.237779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.237814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:22.238026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600896676905376:5695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:22.239616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600896676905376:5695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:22.240082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:22.240399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:22.240415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:22.240418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:22.240421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:22.240426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 552 [2:7559600895894694512:4689]
2025-10-10T14:32:22.240437Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:22.240458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:22.240466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.240470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.240472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.240485Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:22.240497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:22.240509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:22.240563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.240570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.240572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.240574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:22.240635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:22.240642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.240654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.240670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.240692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:22.240717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905280:2438], now have 1 active actors on pipe
2025-10-10T14:32:22.240723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600895894694507:4689]
2025-10-10T14:32:22.240725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600895894694507:4689]
2025-10-10T14:32:22.240715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 552
2025-10-10T14:32:22.240727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600895894694507:4689]
2025-10-10T14:32:22.240738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:22.240746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:22.240747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:22.240748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:22.240749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:22.240758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:22.240760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:22.240776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600895894694507:4689]
2025-10-10T14:32:22.240785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:22.240806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:22.244793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600896676905376:5695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:22.244804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600896676905376:5695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:22.244806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600896676905376:5695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:22.244812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:22.245133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905414:5695], now have 1 active actors on pipe
2025-10-10T14:32:22.245188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 552
2025-10-10T14:32:22.245237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.245246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.245272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|491e315b-7511c24d-ced65403-d6ca0c34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:22.245286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.245296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.245298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:22.245310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.245323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:22.245355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.245514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.245520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.245532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.245619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 553 partition: 0 MaxSeqNo: 40 sessionId: src_id|491e315b-7511c24d-ced65403-d6ca0c34_0
2025-10-10T14:32:22.245936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9206b382-7606b002-f798d8e7-e0830967_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|491e315b-7511c24d-ced65403-d6ca0c34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:22.248828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|491e315b-7511c24d-ced65403-d6ca0c34_0] Write session: try to update token
2025-10-10T14:32:22.248843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|491e315b-7511c24d-ced65403-d6ca0c34_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:22.257695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:22.257709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:22.257711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:22.257712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:22.257718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600895894694507:4689]
2025-10-10T14:32:22.257720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600895894694507:4689]
2025-10-10T14:32:22.257722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600895894694507:4689]
2025-10-10T14:32:22.257754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:22.257759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.257760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:22.257767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:22.257772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:22.257775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:22.257896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:22.263668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId: src_id|491e315b-7511c24d-ced65403-d6ca0c34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:22.266290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:22.325435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600896676905439:5401]
2025-10-10T14:32:22.325661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 552, pipe: [1:7559600896676905439:5401]
2025-10-10T14:32:22.358870Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:22.359361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.359372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.359393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905439:5401], now have 1 active actors on pipe
2025-10-10T14:32:22.359585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:22.359615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600896676905439:5401]
2025-10-10T14:32:22.359642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:22.359649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:22.359717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 553 reason: error at write: Disconnected sessionId: src_id|491e315b-7511c24d-ced65403-d6ca0c34_0
2025-10-10T14:32:22.359922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 553 sessionId: src_id|491e315b-7511c24d-ced65403-d6ca0c34_0 is DEAD
2025-10-10T14:32:22.360013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:22.360077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491e315b-7511c24d-ced65403-d6ca0c34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:22.360087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491e315b-7511c24d-ced65403-d6ca0c34_0] Write session will restart in 0.006094s
2025-10-10T14:32:22.360112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491e315b-7511c24d-ced65403-d6ca0c34_0] Write session: Do CDS request
2025-10-10T14:32:22.360133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491e315b-7511c24d-ced65403-d6ca0c34_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:22.367790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|491e315b-7511c24d-ced65403-d6ca0c34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.367864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:22.367875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 554
2025-10-10T14:32:22.368018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.368053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:22.368060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:22.368063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:22.368472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 554 sessionId:  describe result for acl check
2025-10-10T14:32:22.368506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:22.368512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:22.368515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:22.368521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600896676905532:5708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:22.368977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600896676905532:5708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:22.369109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:22.370805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600896676905532:5708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:22.370851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:22.370996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:22.371008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:22.371018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:22.371068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:22.371105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600895894694685:4704]
2025-10-10T14:32:22.371683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:22.371895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:22.371937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:22.372240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:22.372280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.372290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.372291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.372292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.372292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.372294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.372295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.372296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.372297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.372298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.372299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.372300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.372301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.372306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.372315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.372317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.372319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.372321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.372323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.372325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.372327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.372329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.372331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.372333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.372335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.372337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.372343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.372348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.372352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.372356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.372358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.372361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.372363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.372366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.372369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.372372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.372374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.372377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.372380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.372384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.372388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.372393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.372397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.372402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.372406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.372411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.372415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.372420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.372428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.372431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.372434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.372437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.372459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:22.372952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600896676905532:5708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:22.372964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600896676905532:5708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:22.372967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600896676905532:5708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:22.372972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:22.374378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:22.374819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:22.374829Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:22.374831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:22.374833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:22.374836Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 553 [2:7559600895894694685:4704]
2025-10-10T14:32:22.374844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:22.374855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:22.374860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.374863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.374864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.374874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:22.374883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:22.374893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:22.374931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.374935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.374937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.374939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:22.374993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:22.375000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.375010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.375025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.375044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:22.375064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905440:2438], now have 1 active actors on pipe
2025-10-10T14:32:22.375069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905567:5708], now have 1 active actors on pipe
2025-10-10T14:32:22.375074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600895894694679:4704]
2025-10-10T14:32:22.375076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600895894694679:4704]
2025-10-10T14:32:22.375077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600895894694679:4704]
2025-10-10T14:32:22.375080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 553
2025-10-10T14:32:22.375088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:22.375082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 553
2025-10-10T14:32:22.375105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:22.375108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:22.375111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:22.375112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:22.375122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:22.375124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:22.375147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600895894694679:4704]
2025-10-10T14:32:22.375159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:22.375162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:22.375173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.375177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.375212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|454f1304-271f73f1-7b648588-705d6d60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:22.375221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.375223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.375224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:22.375232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.375239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:22.375251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.375421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.375428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.375444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.375537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 554 partition: 0 MaxSeqNo: 40 sessionId: src_id|454f1304-271f73f1-7b648588-705d6d60_0
2025-10-10T14:32:22.375853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491e315b-7511c24d-ced65403-d6ca0c34_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|454f1304-271f73f1-7b648588-705d6d60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:22.378802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|454f1304-271f73f1-7b648588-705d6d60_0] Write session: try to update token
2025-10-10T14:32:22.378818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|454f1304-271f73f1-7b648588-705d6d60_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:22.392611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:22.392629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:22.392632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:22.392634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:22.392644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600895894694679:4704]
2025-10-10T14:32:22.392648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600895894694679:4704]
2025-10-10T14:32:22.392652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600895894694679:4704]
2025-10-10T14:32:22.392686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:22.392694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:22.392697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:22.392701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:22.392701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.392703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:22.392832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:22.392925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId: src_id|454f1304-271f73f1-7b648588-705d6d60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:22.395340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:22.459584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600896676905574:5401]
2025-10-10T14:32:22.459835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 553, pipe: [1:7559600896676905574:5401]
2025-10-10T14:32:22.496788Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:22.497196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.497207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.497247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905574:5401], now have 1 active actors on pipe
2025-10-10T14:32:22.497427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:22.497517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:22.497532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600896676905574:5401]
2025-10-10T14:32:22.497552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:22.497621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|454f1304-271f73f1-7b648588-705d6d60_0
2025-10-10T14:32:22.497796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 554 sessionId: src_id|454f1304-271f73f1-7b648588-705d6d60_0 is DEAD
2025-10-10T14:32:22.497965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454f1304-271f73f1-7b648588-705d6d60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:22.497989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454f1304-271f73f1-7b648588-705d6d60_0] Write session will restart in 0.009325s
2025-10-10T14:32:22.498009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454f1304-271f73f1-7b648588-705d6d60_0] Write session: Do CDS request
2025-10-10T14:32:22.498014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454f1304-271f73f1-7b648588-705d6d60_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:22.506551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:22.508145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:22.508317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:22.508328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:22.508340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:22.508389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:22.508427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600895894694818:4706]
2025-10-10T14:32:22.508808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|454f1304-271f73f1-7b648588-705d6d60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.508900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:22.508913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 555
2025-10-10T14:32:22.509027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:22.509065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.509091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:22.509095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:22.509098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:22.509354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:22.509395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:22.509421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 555 sessionId:  describe result for acl check
2025-10-10T14:32:22.509445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:22.509450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:22.509451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:22.509456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600896676905674:5712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:22.509710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:22.509756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.509763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.509764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.509765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.509766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.509767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.509768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.509769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.509770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.509771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.509772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.509774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.509775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.509779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.509786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.509788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.509791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.509793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.509795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.509797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.509799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.509801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.509803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.509805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.509808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.509811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.509818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.509826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.509833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.509837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.509840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.509843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.509845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.509848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.509851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.509854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.509857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.509860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.509863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.509866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.509868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.509871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.509874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.509877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.509880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.509883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.509887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600896676905674:5712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:22.509885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.509889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.509891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.509894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.509897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.509900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.509922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:22.511372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600896676905674:5712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:22.511955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:22.512251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:22.512261Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:22.512263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:22.512266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:22.512271Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 554 [2:7559600895894694818:4706]
2025-10-10T14:32:22.512282Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:22.512295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:22.512300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.512303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.512304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.512317Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:22.512324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:22.512335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:22.512386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.512392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.512394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.512395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:22.512446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:22.512454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.512466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.512480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.512500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:22.512524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905576:2438], now have 1 active actors on pipe
2025-10-10T14:32:22.512535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600895894694813:4706]
2025-10-10T14:32:22.512538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600895894694813:4706]
2025-10-10T14:32:22.512540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600895894694813:4706]
2025-10-10T14:32:22.512552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:22.512547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 554
2025-10-10T14:32:22.512566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:22.512577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:22.512579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:22.512581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:22.512586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:22.512587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:22.512596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600895894694813:4706]
2025-10-10T14:32:22.512598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:22.512608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:22.516669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600896676905674:5712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:22.516681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600896676905674:5712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:22.516684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600896676905674:5712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:22.516690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:22.516880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905709:5712], now have 1 active actors on pipe
2025-10-10T14:32:22.516897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 554
2025-10-10T14:32:22.516975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.516986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.517012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:22.517023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.517031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.517032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:22.517042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.517054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:22.517069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.517364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.517376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.517394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.517584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 555 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0
2025-10-10T14:32:22.517891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|454f1304-271f73f1-7b648588-705d6d60_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:22.520890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0] Write session: try to update token
2025-10-10T14:32:22.520902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:22.529990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:22.530003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:22.530005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:22.530007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:22.530012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600895894694813:4706]
2025-10-10T14:32:22.530016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600895894694813:4706]
2025-10-10T14:32:22.530019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600895894694813:4706]
2025-10-10T14:32:22.530049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:22.530057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:22.530060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.530061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:22.530062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:22.530065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:22.530192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:22.535224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId: src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:22.537834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:22.597815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600896676905723:5401]
2025-10-10T14:32:22.598041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 554, pipe: [1:7559600896676905723:5401]
2025-10-10T14:32:22.631690Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:22.632125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.632137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.632156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905723:5401], now have 1 active actors on pipe
2025-10-10T14:32:22.632327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:22.632347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:22.632389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:22.632399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600896676905723:5401]
2025-10-10T14:32:22.632465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 555 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0
2025-10-10T14:32:22.632649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 555 sessionId: src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0 is DEAD
2025-10-10T14:32:22.632797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:22.632806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0] Write session will restart in 0.008948s
2025-10-10T14:32:22.632832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0] Write session: Do CDS request
2025-10-10T14:32:22.632838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:22.641601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:22.642782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.642847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:22.642868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 556
2025-10-10T14:32:22.643038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.643065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:22.643073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:22.643076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:22.643334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:22.643466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 556 sessionId:  describe result for acl check
2025-10-10T14:32:22.643497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:22.643508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:22.643500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:22.643524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:22.643508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:22.643510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:22.643516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600896676905824:5718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:22.643574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:22.643614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600895894694955:4709]
2025-10-10T14:32:22.644057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600896676905824:5718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:22.644208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:22.644396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:22.644424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:22.644635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:22.644675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.644679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.644680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.644680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.644681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.644682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.644682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.644683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.644683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.644684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.644685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.644685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.644686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.644689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.644696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.644699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.644701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.644703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.644705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.644708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.644711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.644714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.644718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.644722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.644726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.644729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.644735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.644744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.644750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.644759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.644762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.644765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.644767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.644771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.644774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.644777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.644779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.644783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.644786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.644789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.644791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.644794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.644797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.644800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.644802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.644806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.644812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.644815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.644818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.644821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.644824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.644827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.644849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:22.645565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600896676905824:5718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:22.646872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:22.647237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:22.647250Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:22.647252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:22.647256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:22.647261Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 555 [2:7559600895894694955:4709]
2025-10-10T14:32:22.647273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:22.647288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:22.647289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.647292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.647293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.647304Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:22.647313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:22.647322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:22.647360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.647367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.647369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.647372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:22.647411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600896676905824:5718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:22.647423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600896676905824:5718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:22.647427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600896676905824:5718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:22.647433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:22.647425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:22.647432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.647440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.647447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.647456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:22.647470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905728:2438], now have 1 active actors on pipe
2025-10-10T14:32:22.647476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600895894694950:4709]
2025-10-10T14:32:22.647482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600895894694950:4709]
2025-10-10T14:32:22.647483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600895894694950:4709]
2025-10-10T14:32:22.647494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:22.647504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:22.647507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:22.647511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:22.647513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:22.647521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:22.647525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:22.647545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600895894694950:4709]
2025-10-10T14:32:22.647546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 555
2025-10-10T14:32:22.647557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:22.647563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:22.647599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905857:5718], now have 1 active actors on pipe
2025-10-10T14:32:22.647683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 555
2025-10-10T14:32:22.647723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.647731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.647757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:22.647770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.647779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.647781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:22.647792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.647806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:22.647823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.647951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.647958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.647971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.648036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 556 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0
2025-10-10T14:32:22.648310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d93cdf8-76f3f5fa-2591de0d-bf5ae0d7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:22.651293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0] Write session: try to update token
2025-10-10T14:32:22.651307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:22.665306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:22.665325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:22.665345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:22.665347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:22.665356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600895894694950:4709]
2025-10-10T14:32:22.665362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600895894694950:4709]
2025-10-10T14:32:22.665366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600895894694950:4709]
2025-10-10T14:32:22.665413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:22.665416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:22.665421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:22.665424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:22.665425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.665427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:22.665557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:22.666524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId: src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:22.669090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:22.732471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600896676905865:5401]
2025-10-10T14:32:22.732694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 555, pipe: [1:7559600896676905865:5401]
2025-10-10T14:32:22.771450Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:22.771653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.771666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.771708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905865:5401], now have 1 active actors on pipe
2025-10-10T14:32:22.771874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:22.771956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:22.771970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600896676905865:5401]
2025-10-10T14:32:22.771994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:22.772069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 556 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0
2025-10-10T14:32:22.772311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 556 sessionId: src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0 is DEAD
2025-10-10T14:32:22.772452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:22.772465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0] Write session will restart in 0.007588s
2025-10-10T14:32:22.772491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0] Write session: Do CDS request
2025-10-10T14:32:22.772496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:22.780746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.780846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:22.780869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 557
2025-10-10T14:32:22.781025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.781059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:22.781066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:22.781069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:22.781420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:22.781460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 557 sessionId:  describe result for acl check
2025-10-10T14:32:22.781498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:22.781505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:22.781506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:22.781512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600896676905962:5722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:22.781955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600896676905962:5722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:22.783257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:22.783420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:22.783430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:22.783442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:22.783486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:22.783520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600895894695091:4711]
2025-10-10T14:32:22.784012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:22.784059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600896676905962:5722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:22.784246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:22.784289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:22.784584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:22.784652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.784658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.784660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.784661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.784662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.784663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.784663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.784664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.784665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.784666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.784667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.784668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.784669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.784674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.784685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.784688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.784692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.784695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.784699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.784703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.784706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.784710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.784714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.784722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.784725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.784729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.784735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.784748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.784760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.784765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.784768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.784773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.784776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.784781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.784791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.784795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.784799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.784809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.784814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.784818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.784822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.784827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.784836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.784841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.784848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.784853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.784861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.784866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.784872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.784878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.784882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.784886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.784927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:22.786937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600896676905962:5722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:22.786951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600896676905962:5722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:22.786955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600896676905962:5722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:22.786962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:22.786988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:22.787403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:22.787416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:22.787417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:22.787420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:22.787424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 556 [2:7559600895894695091:4711]
2025-10-10T14:32:22.787432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:22.787443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:22.787445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.787448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.787450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.787463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:22.787475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:22.787488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:22.787535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.787542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.787544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.787546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:22.787594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:22.787599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.787607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.787617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.787635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:22.787658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905997:5722], now have 1 active actors on pipe
2025-10-10T14:32:22.787666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676905866:2438], now have 1 active actors on pipe
2025-10-10T14:32:22.787672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600895894695086:4711]
2025-10-10T14:32:22.787674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600895894695086:4711]
2025-10-10T14:32:22.787677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600895894695086:4711]
2025-10-10T14:32:22.787677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 556
2025-10-10T14:32:22.787693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 556
2025-10-10T14:32:22.787690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:22.787697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:22.787700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:22.787702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:22.787705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:22.787722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:22.787729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:22.787759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.787767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.787783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600895894695086:4711]
2025-10-10T14:32:22.787794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:22.787798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:22.787819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:22.787830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.787837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.787840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:22.787849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.787864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:22.787882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.788001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.788008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.788022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.788095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 557 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0
2025-10-10T14:32:22.788378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a8f48c1-bb80c091-9fc32197-644c6d6e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:22.790979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0] Write session: try to update token
2025-10-10T14:32:22.790992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:22.803317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId: src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:22.805695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:22.805712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:22.805715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:22.805717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:22.805733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:22.805726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600895894695086:4711]
2025-10-10T14:32:22.805731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600895894695086:4711]
2025-10-10T14:32:22.805734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600895894695086:4711]
2025-10-10T14:32:22.805771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:22.805778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:22.805778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:22.805782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:22.805785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.805787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:22.805918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:22.872209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600896676906005:5401]
2025-10-10T14:32:22.872428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 556, pipe: [1:7559600896676906005:5401]
2025-10-10T14:32:22.910698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:22.910924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.910940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.910977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676906005:5401], now have 1 active actors on pipe
2025-10-10T14:32:22.911152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600896676906005:5401]
2025-10-10T14:32:22.911174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:22.911189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:22.911191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:22.911248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 557 reason: error at write: Disconnected sessionId: src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0
2025-10-10T14:32:22.911356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:22.911435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 557 sessionId: src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0 is DEAD
2025-10-10T14:32:22.911555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:22.911565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0] Write session will restart in 0.005636s
2025-10-10T14:32:22.911583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0] Write session: Do CDS request
2025-10-10T14:32:22.911587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:22.918785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.918921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:22.918934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 558
2025-10-10T14:32:22.919020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:22.919046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:22.919054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:22.919058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:22.919458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 558 sessionId:  describe result for acl check
2025-10-10T14:32:22.919497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:22.919506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:22.919508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:22.919514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600896676906102:5726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:22.919870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:22.920063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600896676906102:5726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:22.921652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:22.921828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:22.921840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:22.921852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:22.921904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:22.921945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600895894695228:4713]
2025-10-10T14:32:22.922431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600896676906102:5726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:22.922505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:22.922747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:22.922793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:22.923083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:22.923152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.923159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.923160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.923161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.923162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.923163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.923164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.923165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.923166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.923167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.923168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.923169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.923170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.923175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.923186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.923190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.923193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.923197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.923200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.923204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.923208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.923212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.923215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.923219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.923223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.923231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.923238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.923249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:22.923255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.923260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:22.923264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.923274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:22.923279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.923288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:22.923297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.923303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:22.923306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.923314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:22.923319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.923327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:22.923331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.923336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:22.923340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.923349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:22.923353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.923361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:22.923365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.923370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.923376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.923381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.923391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.923396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.923430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:22.925454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600896676906102:5726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:22.925468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600896676906102:5726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:22.925471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600896676906102:5726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:22.925479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:22.925523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:22.925929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:22.925940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:22.925941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:22.925944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:22.925948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 557 [2:7559600895894695228:4713]
2025-10-10T14:32:22.925957Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:22.925971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:22.925976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.925978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.925980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.925991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:22.925997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:22.926006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:22.926044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.926049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.926050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.926052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:22.926108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:22.926114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.926121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:22.926128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:22.926140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:22.926163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676906138:5726], now have 1 active actors on pipe
2025-10-10T14:32:22.926171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600896676906006:2438], now have 1 active actors on pipe
2025-10-10T14:32:22.926178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600895894695223:4713]
2025-10-10T14:32:22.926184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600895894695223:4713]
2025-10-10T14:32:22.926186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600895894695223:4713]
2025-10-10T14:32:22.926198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:22.926208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:22.926215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:22.926196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 557
2025-10-10T14:32:22.926217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:22.926198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 557
2025-10-10T14:32:22.926230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:22.926230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:22.926238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:22.926263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.926272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.926284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600895894695223:4713]
2025-10-10T14:32:22.926290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:22.926295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:22.926312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:22.926321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:22.926324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:22.926326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:22.926334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:22.926346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:22.926368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.926528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.926536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.926550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:22.926631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 558 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0
2025-10-10T14:32:22.926949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba0ac347-25aaed40-9e55b2a6-482e0c85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:22.929516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0] Write session: try to update token
2025-10-10T14:32:22.929530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:22.941363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId: src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:22.943621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:22.944108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:22.944132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:22.944157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:22.944164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:22.944168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:22.944170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:22.944178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600895894695223:4713]
2025-10-10T14:32:22.944183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600895894695223:4713]
2025-10-10T14:32:22.944186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600895894695223:4713]
2025-10-10T14:32:22.944215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:22.944233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:22.944239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:22.944241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:22.944248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:22.944255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:22.944378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:23.011514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600900971873442:5401]
2025-10-10T14:32:23.011755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 557, pipe: [1:7559600900971873442:5401]
2025-10-10T14:32:23.050588Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:23.050862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:23.050923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873442:5401], now have 1 active actors on pipe
2025-10-10T14:32:23.051005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:23.051136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600900971873442:5401]
2025-10-10T14:32:23.051159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:23.060105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:23.060122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:23.060143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 558 reason: error at write: Disconnected sessionId: src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0
2025-10-10T14:32:23.060313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 558 sessionId: src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0 is DEAD
2025-10-10T14:32:23.060426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:23.060436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0] Write session will restart in 0.008286s
2025-10-10T14:32:23.060454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0] Write session: Do CDS request
2025-10-10T14:32:23.060459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:23.064254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:23.065878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:23.066031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:23.066041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:23.066050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:23.066089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:23.066118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600900189662662:4715]
2025-10-10T14:32:23.066848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:23.067119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:23.067154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:23.067374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:23.067424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.067429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.067429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.067430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.067431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.067432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.067432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.067433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.067434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.067434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.067435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.067436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.067436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.067440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.067449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.067452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.067454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.067456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.067458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.067460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.067462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.067464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.067466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.067468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.067470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.067472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.067478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.067483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.067487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.067491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.067493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.067496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.067499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.067502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.067505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.067508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.067510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.067513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.067520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.067523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.067525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.067533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.067536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.067539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.067546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.067550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.067553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.067559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.067561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.067565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.067567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.067570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.067593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:23.069682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:23.069803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.069832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:23.069847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 559
2025-10-10T14:32:23.069974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:23.069984Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:23.069986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:23.069988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:23.069992Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 558 [2:7559600900189662662:4715]
2025-10-10T14:32:23.070000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:23.070002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.070012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:23.070019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.070022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.070024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.070027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:23.070035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:23.070038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:23.070035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:23.070046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:23.070057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:23.070094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.070099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.070101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.070102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:23.070150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:23.070156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.070163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.070169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.070182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:23.070201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873443:2438], now have 1 active actors on pipe
2025-10-10T14:32:23.070213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600900189662657:4715]
2025-10-10T14:32:23.070218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600900189662657:4715]
2025-10-10T14:32:23.070220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600900189662657:4715]
2025-10-10T14:32:23.070233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:23.070230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 558
2025-10-10T14:32:23.070249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:23.070250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:23.070258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:23.070261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:23.070266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:23.070269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:23.070293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600900189662657:4715]
2025-10-10T14:32:23.070301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:23.070308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:23.070421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 559 sessionId:  describe result for acl check
2025-10-10T14:32:23.070458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:23.070465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:23.070467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:23.070473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600900971873549:5730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:23.070877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600900971873549:5730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:23.072749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600900971873549:5730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:23.077725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600900971873549:5730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:23.077740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600900971873549:5730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:23.077744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600900971873549:5730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:23.077752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:23.077967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873580:5730], now have 1 active actors on pipe
2025-10-10T14:32:23.078001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 558
2025-10-10T14:32:23.078056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.078069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.078102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b22ff2a0-c7de9f43-46065618-33291077_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:23.078119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.078128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.078133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:23.078146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.078167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:23.078189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.078338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.078347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.078362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.078450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 559 partition: 0 MaxSeqNo: 40 sessionId: src_id|b22ff2a0-c7de9f43-46065618-33291077_0
2025-10-10T14:32:23.078787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1be9552-a53e36a7-c6dbdbbc-f83cb7d3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b22ff2a0-c7de9f43-46065618-33291077_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:23.080733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:23.080751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:23.080760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600900189662657:4715]
2025-10-10T14:32:23.080793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:23.080800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:23.080962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:23.081098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:23.081149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22ff2a0-c7de9f43-46065618-33291077_0] Write session: try to update token
2025-10-10T14:32:23.081161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22ff2a0-c7de9f43-46065618-33291077_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:23.081227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:23.081378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:23.081561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:23.081598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:23.095406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId: src_id|b22ff2a0-c7de9f43-46065618-33291077_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:23.097634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:23.097652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:23.097655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:23.097657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:23.097667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600900189662657:4715]
2025-10-10T14:32:23.097671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600900189662657:4715]
2025-10-10T14:32:23.097677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600900189662657:4715]
2025-10-10T14:32:23.097715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:23.097717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:23.097722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.097724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:23.097727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:23.097731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:23.097848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:23.097883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:23.151292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600900971873584:5401]
2025-10-10T14:32:23.151587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 558, pipe: [1:7559600900971873584:5401]
2025-10-10T14:32:23.203680Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:23.204032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.204048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.204071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873584:5401], now have 1 active actors on pipe
2025-10-10T14:32:23.204255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:23.204306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600900971873584:5401]
2025-10-10T14:32:23.204323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:23.204335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:23.204403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 559 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b22ff2a0-c7de9f43-46065618-33291077_0
2025-10-10T14:32:23.204602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 559 sessionId: src_id|b22ff2a0-c7de9f43-46065618-33291077_0 is DEAD
2025-10-10T14:32:23.204783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22ff2a0-c7de9f43-46065618-33291077_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:23.204806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22ff2a0-c7de9f43-46065618-33291077_0] Write session will restart in 0.007433s
2025-10-10T14:32:23.204829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22ff2a0-c7de9f43-46065618-33291077_0] Write session: Do CDS request
2025-10-10T14:32:23.204834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22ff2a0-c7de9f43-46065618-33291077_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:23.213758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22ff2a0-c7de9f43-46065618-33291077_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.213924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:23.213937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 560
2025-10-10T14:32:23.214062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.214089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:23.214097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:23.214101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:23.214306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:23.214589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 560 sessionId:  describe result for acl check
2025-10-10T14:32:23.214626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:23.214633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:23.214635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:23.214640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600900971873697:5735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:23.215250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600900971873697:5735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:23.215718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:23.215880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:23.215891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:23.215901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:23.215948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:23.215987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600900189662812:4718]
2025-10-10T14:32:23.216571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:23.216808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:23.216849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:23.217002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600900971873697:5735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:23.217054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:23.217094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.217100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.217101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.217102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.217104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.217105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.217106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.217107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.217108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.217109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.217110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.217111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.217112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.217118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.217129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.217133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.217137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.217141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.217145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.217148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.217150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.217152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.217154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.217156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.217158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.217160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.217165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.217170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.217178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.217185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.217188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.217191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.217197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.217200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.217203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.217206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.217214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.217224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.217233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.217242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.217252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.217259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.217262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.217265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.217268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.217275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.217283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.217289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.217297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.217302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.217311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.217320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.217380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:23.219375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600900971873697:5735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:23.219389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600900971873697:5735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:23.219393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600900971873697:5735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:23.219399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:23.219475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:23.219938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:23.219948Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:23.219950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:23.219954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:23.219960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 559 [2:7559600900189662812:4718]
2025-10-10T14:32:23.219971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:23.219990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:23.219997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.220001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.220008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.220021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:23.220033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:23.220044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:23.220094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.220100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.220102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.220104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:23.220161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:23.220172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.220183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.220195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.220213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:23.220236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873731:5735], now have 1 active actors on pipe
2025-10-10T14:32:23.220243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873597:2438], now have 1 active actors on pipe
2025-10-10T14:32:23.220250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600900189662807:4718]
2025-10-10T14:32:23.220255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600900189662807:4718]
2025-10-10T14:32:23.220257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600900189662807:4718]
2025-10-10T14:32:23.220269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:23.220275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 559
2025-10-10T14:32:23.220284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 559
2025-10-10T14:32:23.220287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:23.220288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:23.220295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:23.220296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:23.220303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:23.220306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:23.220336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.220346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.220364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600900189662807:4718]
2025-10-10T14:32:23.220375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:23.220392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:23.220404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71f9707a-f4148abb-8ee05c61-613bfef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:23.220412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.220416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.220418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:23.220428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.220443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:23.220468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.220605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.220614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.220628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.220718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 560 partition: 0 MaxSeqNo: 40 sessionId: src_id|71f9707a-f4148abb-8ee05c61-613bfef_0
2025-10-10T14:32:23.221040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22ff2a0-c7de9f43-46065618-33291077_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71f9707a-f4148abb-8ee05c61-613bfef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:23.223938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f9707a-f4148abb-8ee05c61-613bfef_0] Write session: try to update token
2025-10-10T14:32:23.223950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f9707a-f4148abb-8ee05c61-613bfef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:23.238335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:23.238352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:23.238356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:23.238358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:23.238366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600900189662807:4718]
2025-10-10T14:32:23.238371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600900189662807:4718]
2025-10-10T14:32:23.238375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600900189662807:4718]
2025-10-10T14:32:23.238417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:23.238420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:23.238427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.238429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:23.238430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:23.238433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:23.238557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:23.239102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId: src_id|71f9707a-f4148abb-8ee05c61-613bfef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:23.241794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:23.304367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600900971873752:5401]
2025-10-10T14:32:23.304779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 559, pipe: [1:7559600900971873752:5401]
2025-10-10T14:32:23.353346Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:23.353670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.353684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.353729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873752:5401], now have 1 active actors on pipe
2025-10-10T14:32:23.353931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:23.353942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600900971873752:5401]
2025-10-10T14:32:23.353950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:23.353954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:23.353974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:23.354015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 560 reason: error at write: Disconnected sessionId: src_id|71f9707a-f4148abb-8ee05c61-613bfef_0
2025-10-10T14:32:23.354231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 560 sessionId: src_id|71f9707a-f4148abb-8ee05c61-613bfef_0 is DEAD
2025-10-10T14:32:23.354413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f9707a-f4148abb-8ee05c61-613bfef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:23.354420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f9707a-f4148abb-8ee05c61-613bfef_0] Write session will restart in 0.005709s
2025-10-10T14:32:23.354438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f9707a-f4148abb-8ee05c61-613bfef_0] Write session: Do CDS request
2025-10-10T14:32:23.354443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f9707a-f4148abb-8ee05c61-613bfef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:23.360858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71f9707a-f4148abb-8ee05c61-613bfef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.360902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:23.360916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 561
2025-10-10T14:32:23.361083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.361119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:23.361129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:23.361138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:23.361571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 561 sessionId:  describe result for acl check
2025-10-10T14:32:23.361612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:23.361615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:23.361617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:23.361623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600900971873807:5748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:23.362156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600900971873807:5748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:23.363960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600900971873807:5748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:23.365505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:23.365940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:23.366095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:23.366105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:23.366117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:23.366167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:23.366206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600900189662991:4733]
2025-10-10T14:32:23.366246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600900971873807:5748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:23.366260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600900971873807:5748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:23.366263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600900971873807:5748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:23.366270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:23.366805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:23.367074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:23.367116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:23.367424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:23.367472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.367478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.367479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.367481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.367482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.367483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.367484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.367486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.367487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.367488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.367489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.367490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.367491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.367497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.367509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.367513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.367517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.367521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.367525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.367529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.367533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.367537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.367546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.367550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.367558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.367562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.367573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.367585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.367596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.367605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.367613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.367619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.367627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.367637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.367641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.367647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.367655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.367665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.367674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.367683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.367687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.367697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.367706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.367712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.367719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.367724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.367733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.367742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.367750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.367755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.367763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.367768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.367812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:23.369907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:23.370324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:23.370337Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:23.370339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:23.370342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:23.370347Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 560 [2:7559600900189662991:4733]
2025-10-10T14:32:23.370358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:23.370373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:23.370380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.370387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.370390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.370402Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:23.370415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:23.370422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:23.370473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.370481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.370483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.370486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:23.370545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:23.370553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.370564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.370581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.370603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:23.370628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873764:2438], now have 1 active actors on pipe
2025-10-10T14:32:23.370636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873895:5748], now have 1 active actors on pipe
2025-10-10T14:32:23.370642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600900189662985:4733]
2025-10-10T14:32:23.370644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600900189662985:4733]
2025-10-10T14:32:23.370646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600900189662985:4733]
2025-10-10T14:32:23.370659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:23.370677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:23.370677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:23.370680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:23.370682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:23.370670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 560
2025-10-10T14:32:23.370686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 560
2025-10-10T14:32:23.370697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:23.370703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:23.370738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.370756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.370772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600900189662985:4733]
2025-10-10T14:32:23.370783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:23.370801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:23.370817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:23.370828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.370833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.370835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:23.370847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.370861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:23.370885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.371041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.371051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.371067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.371138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 561 partition: 0 MaxSeqNo: 40 sessionId: src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0
2025-10-10T14:32:23.371498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71f9707a-f4148abb-8ee05c61-613bfef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:23.374732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0] Write session: try to update token
2025-10-10T14:32:23.374770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:23.388759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:23.388781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:23.388784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:23.388786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:23.388796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600900189662985:4733]
2025-10-10T14:32:23.388800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600900189662985:4733]
2025-10-10T14:32:23.388804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600900189662985:4733]
2025-10-10T14:32:23.388851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:23.388862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.388861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:23.388865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:23.388868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:23.388871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:23.388995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:23.389405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId: src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:23.391912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:23.453877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600900971873910:5401]
2025-10-10T14:32:23.454121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 560, pipe: [1:7559600900971873910:5401]
2025-10-10T14:32:23.497306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:23.497550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.497567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.497615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873910:5401], now have 1 active actors on pipe
2025-10-10T14:32:23.497859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:23.497889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600900971873910:5401]
2025-10-10T14:32:23.497895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:23.497924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:23.498192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 561 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0
2025-10-10T14:32:23.498375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 561 sessionId: src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0 is DEAD
2025-10-10T14:32:23.498500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:23.498509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0] Write session will restart in 0.008832s
2025-10-10T14:32:23.498527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0] Write session: Do CDS request
2025-10-10T14:32:23.498532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:23.507478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:23.508805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.509032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:23.509016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:23.509031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 562
2025-10-10T14:32:23.509139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.509165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:23.509174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:23.509186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:23.509215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:23.509228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:23.509239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:23.509290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:23.509348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600900189663130:4735]
2025-10-10T14:32:23.509622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 562 sessionId:  describe result for acl check
2025-10-10T14:32:23.509657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:23.509662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:23.509663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:23.509667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600900971874015:5752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:23.510065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:23.510084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600900971874015:5752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:23.510290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:23.510324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:23.510562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:23.510602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.510608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.510609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.510610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.510610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.510611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.510611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.510612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.510613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.510613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.510614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.510614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.510615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.510619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.510627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.510629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.510631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.510633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.510635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.510638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.510640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.510642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.510644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.510646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.510648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.510650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.510655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.510661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.510665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.510668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.510671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.510675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.510679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.510682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.510685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.510688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.510691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.510694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.510697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.510700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.510703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.510707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.510711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.510716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.510721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.510725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.510729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.510733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.510737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.510742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.510758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.510764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.510804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:23.512129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600900971874015:5752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:23.512844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:23.513278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:23.513292Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:23.513294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:23.513298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:23.513304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 561 [2:7559600900189663130:4735]
2025-10-10T14:32:23.513320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:23.513357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:23.513366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.513369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.513372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.513387Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:23.513399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:23.513412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:23.513458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.513463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.513464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.513466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:23.513520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:23.513527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.513538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.513549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.513567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:23.513592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971873912:2438], now have 1 active actors on pipe
2025-10-10T14:32:23.513604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600900189663125:4735]
2025-10-10T14:32:23.513611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600900189663125:4735]
2025-10-10T14:32:23.513613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600900189663125:4735]
2025-10-10T14:32:23.513614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 561
2025-10-10T14:32:23.513627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:23.513633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:23.513636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:23.513637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:23.513646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:23.513663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:23.513671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:23.513698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600900189663125:4735]
2025-10-10T14:32:23.513709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:23.513713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:23.515486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600900971874015:5752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:23.515500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600900971874015:5752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:23.515504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600900971874015:5752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:23.515511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:23.515701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874053:5752], now have 1 active actors on pipe
2025-10-10T14:32:23.515744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 561
2025-10-10T14:32:23.515804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.515815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.515845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:23.515859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.515868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.515870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:23.515882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.515899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:23.515918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.516053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.516061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.516078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.516158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 562 partition: 0 MaxSeqNo: 40 sessionId: src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0
2025-10-10T14:32:23.516448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7580fe8-61011a4c-28b85d68-7d39a6ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:23.519156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0] Write session: try to update token
2025-10-10T14:32:23.519169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:23.531489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:23.531507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:23.531510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:23.531511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:23.531519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600900189663125:4735]
2025-10-10T14:32:23.531523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600900189663125:4735]
2025-10-10T14:32:23.531525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600900189663125:4735]
2025-10-10T14:32:23.531562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:23.531565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:23.531568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.531570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:23.531570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:23.531573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:23.531698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:23.531928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId: src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:23.534321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:23.598286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600900971874065:5401]
2025-10-10T14:32:23.598483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 561, pipe: [1:7559600900971874065:5401]
2025-10-10T14:32:23.636550Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:23.636775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.636791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.636840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874065:5401], now have 1 active actors on pipe
2025-10-10T14:32:23.637002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:23.637067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600900971874065:5401]
2025-10-10T14:32:23.637094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:23.637102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:23.637105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:23.637152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 562 reason: error at write: Disconnected sessionId: src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0
2025-10-10T14:32:23.637321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 562 sessionId: src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0 is DEAD
2025-10-10T14:32:23.637476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:23.637486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0] Write session will restart in 0.006833s
2025-10-10T14:32:23.637504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0] Write session: Do CDS request
2025-10-10T14:32:23.637509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:23.645768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.645838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:23.645853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 563
2025-10-10T14:32:23.645993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.646028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:23.646039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:23.646047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:23.646434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:23.646435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 563 sessionId:  describe result for acl check
2025-10-10T14:32:23.646470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:23.646472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:23.646474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:23.646479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600900971874172:5758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:23.647050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600900971874172:5758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:23.647923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:23.648089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:23.648099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:23.648111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:23.648155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:23.648185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600900189663274:4738]
2025-10-10T14:32:23.648616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:23.648695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600900971874172:5758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:23.648917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:23.648958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:23.649268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:23.649323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.649344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.649345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.649346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.649347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.649348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.649349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.649350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.649351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.649352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.649353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.649354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.649355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.649360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.649372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.649376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.649380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.649384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.649388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.649392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.649396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.649400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.649405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.649408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.649412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.649416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.649422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.649431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.649437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.649442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.649446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.649452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.649461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.649466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.649470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.649475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.649480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.649485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.649489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.649495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.649499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.649504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.649508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.649512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.649515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.649521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.649525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.649529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.649533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.649537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.649541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.649546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.649583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:23.651848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600900971874172:5758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:23.651861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600900971874172:5758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:23.651865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600900971874172:5758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:23.651871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:23.651913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:23.652342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:23.652352Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:23.652354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:23.652357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:23.652363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 562 [2:7559600900189663274:4738]
2025-10-10T14:32:23.652374Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:23.652395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:23.652402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.652406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.652408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.652422Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:23.652434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:23.652445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:23.652492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.652498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.652499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.652501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:23.652558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:23.652566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.652577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.652591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.652611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:23.652628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 562
2025-10-10T14:32:23.652637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874070:2438], now have 1 active actors on pipe
2025-10-10T14:32:23.652643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874207:5758], now have 1 active actors on pipe
2025-10-10T14:32:23.652631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 562
2025-10-10T14:32:23.652649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600900189663269:4738]
2025-10-10T14:32:23.652652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600900189663269:4738]
2025-10-10T14:32:23.652654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600900189663269:4738]
2025-10-10T14:32:23.652660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:23.652668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:23.652673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:23.652675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:23.652677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:23.652684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:23.652686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:23.652699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.652706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.652733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600900189663269:4738]
2025-10-10T14:32:23.652741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:23.652745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:23.652755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4401c432-459534b3-1f1377fb-1b5949c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:23.652763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.652769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.652770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:23.652778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.652787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:23.652822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.652976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.652987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.653003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.653080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 563 partition: 0 MaxSeqNo: 40 sessionId: src_id|4401c432-459534b3-1f1377fb-1b5949c0_0
2025-10-10T14:32:23.653366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eb40da-2ab8d752-b9c915cc-8ba92ba2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4401c432-459534b3-1f1377fb-1b5949c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:23.655794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4401c432-459534b3-1f1377fb-1b5949c0_0] Write session: try to update token
2025-10-10T14:32:23.655809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4401c432-459534b3-1f1377fb-1b5949c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:23.668310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId: src_id|4401c432-459534b3-1f1377fb-1b5949c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:23.670662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:23.671189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.671213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.671238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:23.671241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:23.671244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:23.671246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:23.671255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600900189663269:4738]
2025-10-10T14:32:23.671259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600900189663269:4738]
2025-10-10T14:32:23.671263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600900189663269:4738]
2025-10-10T14:32:23.671296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:23.671306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:23.671310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:23.671319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:23.671325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.671332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:23.671454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:23.737025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600900971874214:5401]
2025-10-10T14:32:23.737277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 562, pipe: [1:7559600900971874214:5401]
2025-10-10T14:32:23.774419Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:23.774663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:23.774711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874214:5401], now have 1 active actors on pipe
2025-10-10T14:32:23.774821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:23.774891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:23.774924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:23.774935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:23.774945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600900971874214:5401]
2025-10-10T14:32:23.775006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 563 reason: error at write: Disconnected sessionId: src_id|4401c432-459534b3-1f1377fb-1b5949c0_0
2025-10-10T14:32:23.775165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 563 sessionId: src_id|4401c432-459534b3-1f1377fb-1b5949c0_0 is DEAD
2025-10-10T14:32:23.775276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4401c432-459534b3-1f1377fb-1b5949c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:23.775286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4401c432-459534b3-1f1377fb-1b5949c0_0] Write session will restart in 0.005882s
2025-10-10T14:32:23.775303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4401c432-459534b3-1f1377fb-1b5949c0_0] Write session: Do CDS request
2025-10-10T14:32:23.775308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4401c432-459534b3-1f1377fb-1b5949c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:23.782889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4401c432-459534b3-1f1377fb-1b5949c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.782968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:23.782984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 564
2025-10-10T14:32:23.783109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.783147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:23.783161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:23.783165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:23.783696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 564 sessionId:  describe result for acl check
2025-10-10T14:32:23.783733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:23.783740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:23.783742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:23.783748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600900971874316:5762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:23.784286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600900971874316:5762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:23.784696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:23.786495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:23.786511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600900971874316:5762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:23.786662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:23.786675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:23.786687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:23.786737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:23.786788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600900189663417:4740]
2025-10-10T14:32:23.787392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:23.787641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:23.787678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:23.787979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:23.788029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.788035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.788036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.788037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.788038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.788040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.788041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.788042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.788043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.788044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.788045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.788047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.788048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.788053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.788065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.788069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.788078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.788082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.788090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.788095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.788103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.788107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.788116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.788120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.788128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.788132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.788138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.788150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.788161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.788170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.788179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.788185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.788194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.788200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.788208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.788214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.788222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.788231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.788238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.788247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.788251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.788260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.788269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.788273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.788281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.788287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.788298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.788303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.788308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.788314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.788318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.788324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.788365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:23.788774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600900971874316:5762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:23.788787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600900971874316:5762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:23.788791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600900971874316:5762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:23.788798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:23.790464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:23.790792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:23.790802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:23.790805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:23.790808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:23.790814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 563 [2:7559600900189663417:4740]
2025-10-10T14:32:23.790825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:23.790841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:23.790844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.790847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.790849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.790862Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:23.790872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:23.790879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:23.790930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.790937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.790939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.790941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:23.791001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:23.791008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.791019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.791030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.791045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:23.791071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874353:5762], now have 1 active actors on pipe
2025-10-10T14:32:23.791079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874215:2438], now have 1 active actors on pipe
2025-10-10T14:32:23.791087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600900189663412:4740]
2025-10-10T14:32:23.791090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600900189663412:4740]
2025-10-10T14:32:23.791092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600900189663412:4740]
2025-10-10T14:32:23.791093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 563
2025-10-10T14:32:23.791104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:23.791104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 563
2025-10-10T14:32:23.791121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:23.791122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:23.791125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:23.791127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:23.791138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:23.791141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:23.791172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.791181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.791198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600900189663412:4740]
2025-10-10T14:32:23.791209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:23.791215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:23.791234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:23.791244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.791248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.791250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:23.791260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.791273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:23.791297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.791434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.791446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.791460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.791543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 564 partition: 0 MaxSeqNo: 40 sessionId: src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0
2025-10-10T14:32:23.791859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4401c432-459534b3-1f1377fb-1b5949c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:23.794381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0] Write session: try to update token
2025-10-10T14:32:23.794399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:23.807005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId: src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:23.809371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:23.810122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.810146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.810172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:23.810175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:23.810178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:23.810181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:23.810189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600900189663412:4740]
2025-10-10T14:32:23.810199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600900189663412:4740]
2025-10-10T14:32:23.810204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600900189663412:4740]
2025-10-10T14:32:23.810247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:23.810257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:23.810260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:23.810265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:23.810271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.810274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:23.810395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:23.875285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600900971874361:5401]
2025-10-10T14:32:23.875535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 563, pipe: [1:7559600900971874361:5401]
2025-10-10T14:32:23.916798Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:23.917096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:23.917144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874361:5401], now have 1 active actors on pipe
2025-10-10T14:32:23.917320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600900971874361:5401]
2025-10-10T14:32:23.917341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:23.917371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:23.917421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:23.917432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:23.917506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 564 reason: error at write: Disconnected sessionId: src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0
2025-10-10T14:32:23.917685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 564 sessionId: src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0 is DEAD
2025-10-10T14:32:23.917904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:23.917913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0] Write session will restart in 0.006070s
2025-10-10T14:32:23.917936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0] Write session: Do CDS request
2025-10-10T14:32:23.917942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:23.924775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.924856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:23.924875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 565
2025-10-10T14:32:23.925115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:23.925155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:23.925165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:23.925169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:23.925612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 565 sessionId:  describe result for acl check
2025-10-10T14:32:23.925653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:23.925659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:23.925662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:23.925668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600900971874453:5766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:23.926240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600900971874453:5766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:23.927024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:23.928295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600900971874453:5766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:23.928813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:23.928983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:23.928994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:23.929006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:23.929059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:23.929099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600900189663561:4742]
2025-10-10T14:32:23.929570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:23.929777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:23.929813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:23.930041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:23.930092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.930101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.930102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.930103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.930104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.930105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.930106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.930107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.930108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.930109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.930110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.930111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.930112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.930117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.930128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.930132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.930136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.930140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.930144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.930148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.930152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.930156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.930162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.930165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.930169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.930173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.930180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.930185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:23.930190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.930195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:23.930199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.930209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:23.930213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.930218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:23.930227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.930233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:23.930242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.930247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:23.930252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.930261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:23.930265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.930270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:23.930276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.930285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:23.930293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.930298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:23.930306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.930309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.930311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.930317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.930320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.930323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.930357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:23.930510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600900971874453:5766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:23.930524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600900971874453:5766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:23.930526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600900971874453:5766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:23.930531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:23.932453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:23.932851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:23.932864Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:23.932866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:23.932870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:23.932876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 564 [2:7559600900189663561:4742]
2025-10-10T14:32:23.932886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:23.932907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:23.932916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.932919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.932921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.932936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:23.932948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:23.932959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:23.933012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.933017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.933018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.933020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:23.933079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:23.933087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.933098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:23.933115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:23.933137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:23.933157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874501:5766], now have 1 active actors on pipe
2025-10-10T14:32:23.933165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600900971874362:2438], now have 1 active actors on pipe
2025-10-10T14:32:23.933148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 564
2025-10-10T14:32:23.933150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 564
2025-10-10T14:32:23.933172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600900189663556:4742]
2025-10-10T14:32:23.933179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600900189663556:4742]
2025-10-10T14:32:23.933181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600900189663556:4742]
2025-10-10T14:32:23.933189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:23.933201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:23.933201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:23.933203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:23.933204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:23.933216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:23.933219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:23.933254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.933263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.933277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600900189663556:4742]
2025-10-10T14:32:23.933288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:23.933291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:23.933313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b97cb7f-58847957-21239edf-b6e697aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:23.933324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:23.933348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:23.933350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:23.933361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:23.933374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:23.933400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.933567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:23.933576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:23.933590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:23.933670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 565 partition: 0 MaxSeqNo: 40 sessionId: src_id|3b97cb7f-58847957-21239edf-b6e697aa_0
2025-10-10T14:32:23.933955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|613c40dc-fcbf8fde-884cf1b0-d17c5e68_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3b97cb7f-58847957-21239edf-b6e697aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:23.936635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b97cb7f-58847957-21239edf-b6e697aa_0] Write session: try to update token
2025-10-10T14:32:23.936649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b97cb7f-58847957-21239edf-b6e697aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:23.949684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId: src_id|3b97cb7f-58847957-21239edf-b6e697aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:23.951418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:23.951437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:23.951441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:23.951442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:23.951452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600900189663556:4742]
2025-10-10T14:32:23.951457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600900189663556:4742]
2025-10-10T14:32:23.951460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600900189663556:4742]
2025-10-10T14:32:23.951509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:23.951509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:23.951515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:23.951519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:23.951520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:23.951522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:23.951651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:23.952234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:24.017594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600905266841805:5401]
2025-10-10T14:32:24.017848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 564, pipe: [1:7559600905266841805:5401]
2025-10-10T14:32:24.057030Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:24.057326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.057359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.057406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266841805:5401], now have 1 active actors on pipe
2025-10-10T14:32:24.057632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:24.057659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600905266841805:5401]
2025-10-10T14:32:24.057659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:24.057663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:24.057687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:24.057724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 565 reason: error at write: Disconnected sessionId: src_id|3b97cb7f-58847957-21239edf-b6e697aa_0
2025-10-10T14:32:24.057944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 565 sessionId: src_id|3b97cb7f-58847957-21239edf-b6e697aa_0 is DEAD
2025-10-10T14:32:24.058104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b97cb7f-58847957-21239edf-b6e697aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:24.058115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b97cb7f-58847957-21239edf-b6e697aa_0] Write session will restart in 0.009453s
2025-10-10T14:32:24.058140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b97cb7f-58847957-21239edf-b6e697aa_0] Write session: Do CDS request
2025-10-10T14:32:24.058147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b97cb7f-58847957-21239edf-b6e697aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:24.067571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:24.068862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b97cb7f-58847957-21239edf-b6e697aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.068905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:24.068921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 566
2025-10-10T14:32:24.069067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.069094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:24.069102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:24.069105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:24.069494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 566 sessionId:  describe result for acl check
2025-10-10T14:32:24.069530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:24.069532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:24.069534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:24.069540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600905266841913:5770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:24.069555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:24.069761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:24.069771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:24.069783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:24.069835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:24.069875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600904484631002:4744]
2025-10-10T14:32:24.070059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600905266841913:5770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:24.070481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:24.070721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:24.070775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:24.071083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:24.071140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.071146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.071147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.071148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.071150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.071151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.071152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.071153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.071155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.071156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.071157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.071158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.071159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.071164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.071176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.071180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.071184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.071188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.071193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.071196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.071200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.071208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.071213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.071221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.071224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.071228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.071234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.071246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.071257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.071262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.071266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.071271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.071279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.071284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.071293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.071299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.071308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.071313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.071321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.071327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.071335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.071344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.071353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.071362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.071372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.071377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.071382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.071387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.071391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.071397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.071403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.071408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.071447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:24.072328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600905266841913:5770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:24.073522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:24.073810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:24.073819Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:24.073820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:24.073823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:24.073827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 565 [2:7559600904484631002:4744]
2025-10-10T14:32:24.073835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:24.073847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:24.073851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.073853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.073855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.073865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:24.073874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:24.073882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:24.073922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.073926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.073927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.073929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:24.074050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 565
2025-10-10T14:32:24.074062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:24.074069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.074076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.074086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.074100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:24.074119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266841806:2438], now have 1 active actors on pipe
2025-10-10T14:32:24.074128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600904484630996:4744]
2025-10-10T14:32:24.074130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600904484630996:4744]
2025-10-10T14:32:24.074131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600904484630996:4744]
2025-10-10T14:32:24.074141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:24.074152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:24.074158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:24.074159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:24.074160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:24.074168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:24.074170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:24.074202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600904484630996:4744]
2025-10-10T14:32:24.074210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:24.074217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:24.074440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600905266841913:5770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:24.074455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600905266841913:5770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:24.074458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600905266841913:5770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:24.074465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:24.074638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266841948:5770], now have 1 active actors on pipe
2025-10-10T14:32:24.074668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 565
2025-10-10T14:32:24.074696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.074703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.074724Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:24.074734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.074740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.074742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:24.074763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.074777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:24.074788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.074879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.074885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.074896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.074970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 566 partition: 0 MaxSeqNo: 40 sessionId: src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0
2025-10-10T14:32:24.075318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b97cb7f-58847957-21239edf-b6e697aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:24.077828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0] Write session: try to update token
2025-10-10T14:32:24.077842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:24.084884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:24.084898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.084913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600904484630996:4744]
2025-10-10T14:32:24.084947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:24.084955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:24.085125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:24.085255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.085405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.085532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.085708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:24.085751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:24.091353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId: src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:24.093676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:24.093874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.093895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.093934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:24.094010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:24.101801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:24.101818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.101820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:24.101823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:24.101831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600904484630996:4744]
2025-10-10T14:32:24.101834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600904484630996:4744]
2025-10-10T14:32:24.101836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600904484630996:4744]
2025-10-10T14:32:24.101879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:24.101889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:24.101891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.101893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:24.101895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:24.101898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:24.102021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:24.157888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600905266841954:5401]
2025-10-10T14:32:24.158149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 565, pipe: [1:7559600905266841954:5401]
2025-10-10T14:32:24.206408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:24.212691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.212716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.212858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.212911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.212967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.213023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.213063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.213071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.213129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.213183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.213238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.213299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.213359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.213368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.213424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.213477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.213538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.213594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.213631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.213639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.213695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.213750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.213804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.213857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.213894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.213899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.213953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.214004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.214055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.214107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.214145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.214150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.214202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.214256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.214311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.214364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.214404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.214410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.214463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.214522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.214575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.214629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.214666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.214671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.214726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.214789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.214843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.214896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.215011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.215017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.215069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.215119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.215171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.215223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.215260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.215267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.215319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.215368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.215419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.215473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.215510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.215517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.215553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266841954:5401], now have 1 active actors on pipe
2025-10-10T14:32:24.215774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:24.215778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600905266841954:5401]
2025-10-10T14:32:24.215791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:24.215795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:24.215822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 566 reason: error at write: Disconnected sessionId: src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0
2025-10-10T14:32:24.216310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 566 sessionId: src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0 is DEAD
2025-10-10T14:32:24.216311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:24.216399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:24.216406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0] Write session will restart in 0.008028s
2025-10-10T14:32:24.216424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0] Write session: Do CDS request
2025-10-10T14:32:24.216429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:24.225817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.225854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:24.225869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 567
2025-10-10T14:32:24.225936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:24.226036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.226068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:24.226078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:24.226082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:24.226491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 567 sessionId:  describe result for acl check
2025-10-10T14:32:24.226529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:24.226535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:24.226537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:24.226543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600905266842074:5775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:24.227104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600905266842074:5775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:24.227711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:24.227910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:24.227920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:24.227929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:24.227973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:24.228007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600904484631160:4747]
2025-10-10T14:32:24.228373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:24.228610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:24.228645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:24.228765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600905266842074:5775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:24.228873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:24.228927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.228933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.228934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.228935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.228936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.228937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.228938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.228939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.228940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.228942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.228943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.228944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.228945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.228950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.228962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.228966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.228970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.228974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.228976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.228978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.228981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.228985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.228989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.228993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.228996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.229000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.229007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.229015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.229022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.229028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.229032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.229037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.229042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.229047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.229052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.229057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.229061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.229066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.229071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.229078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.229084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.229089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.229094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.229099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.229103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.229110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.229114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.229120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.229124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.229134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.229138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.229143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.229178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:24.231206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600905266842074:5775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:24.231217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600905266842074:5775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:24.231220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600905266842074:5775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:24.231224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:24.231284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:24.231691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:24.231706Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:24.231709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:24.231712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:24.231716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 566 [2:7559600904484631160:4747]
2025-10-10T14:32:24.231727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:24.231743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:24.231751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.231754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.231757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.231773Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:24.231785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:24.231795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:24.231835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.231840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.231841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.231843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:24.231894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:24.231899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.231906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.231914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.231930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:24.231953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266841967:2438], now have 1 active actors on pipe
2025-10-10T14:32:24.231961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842108:5775], now have 1 active actors on pipe
2025-10-10T14:32:24.231969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600904484631154:4747]
2025-10-10T14:32:24.231973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600904484631154:4747]
2025-10-10T14:32:24.231975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600904484631154:4747]
2025-10-10T14:32:24.231989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:24.231992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 566
2025-10-10T14:32:24.232002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 566
2025-10-10T14:32:24.232006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:24.232008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:24.232010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:24.232011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:24.232026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:24.232028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:24.232064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.232074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.232088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600904484631154:4747]
2025-10-10T14:32:24.232099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:24.232102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:24.232127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:24.232138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.232142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.232149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:24.232160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.232175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:24.232200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.232348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.232357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.232373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.232476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 567 partition: 0 MaxSeqNo: 40 sessionId: src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0
2025-10-10T14:32:24.232723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af9f456-dcc25919-e0bf36a5-aa8b3404_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:24.235090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0] Write session: try to update token
2025-10-10T14:32:24.235103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:24.248184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId: src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:24.250700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:24.250799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:24.250821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.250824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:24.250826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:24.250835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600904484631154:4747]
2025-10-10T14:32:24.250840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600904484631154:4747]
2025-10-10T14:32:24.250844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600904484631154:4747]
2025-10-10T14:32:24.250874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:24.250879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:24.250882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:24.250899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.250912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.250934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:24.250946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.250948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:24.251071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:24.316093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600905266842116:5401]
2025-10-10T14:32:24.316370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 566, pipe: [1:7559600905266842116:5401]
2025-10-10T14:32:24.356320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:24.356634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842116:5401], now have 1 active actors on pipe
2025-10-10T14:32:24.356763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:24.356843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:24.356896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600905266842116:5401]
2025-10-10T14:32:24.356932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:24.357010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 567 reason: status is not ok: tablet will be restarted right now sessionId: src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0
2025-10-10T14:32:24.357227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 567 sessionId: src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0 is DEAD
2025-10-10T14:32:24.357371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:24.357388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0] Write session will restart in 0.007994s
2025-10-10T14:32:24.357413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0] Write session: Do CDS request
2025-10-10T14:32:24.357419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:24.366877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.366994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:24.367013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 568
2025-10-10T14:32:24.367141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.367178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:24.367188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:24.367193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:24.367375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:24.367552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 568 sessionId:  describe result for acl check
2025-10-10T14:32:24.367581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:24.367587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:24.367589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:24.367596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600905266842252:5788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:24.368035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600905266842252:5788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:24.369312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:24.369502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:24.369514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:24.369525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:24.369571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:24.369643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600904484631345:4760]
2025-10-10T14:32:24.370085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600905266842252:5788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:24.370247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:24.370526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:24.370567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:24.370888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:24.370944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.370951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.370952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.370953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.370954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.370956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.370957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.370959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.370960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.370961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.370962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.370963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.370964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.370970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.370982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.370986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.370991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.370994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.370998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.371002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.371006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.371010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.371015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.371019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.371023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.371027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.371034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.371042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.371049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.371055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.371059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.371067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.371072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.371077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.371087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.371092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.371097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.371102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.371109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.371114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.371121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.371127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.371133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.371139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.371147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.371154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.371161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.371166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.371174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.371179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.371186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.371192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.371236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:24.373315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600905266842252:5788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:24.373327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600905266842252:5788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:24.373350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600905266842252:5788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:24.373358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:24.373430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:24.373934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:24.373947Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:24.373949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:24.373952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:24.373957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 567 [2:7559600904484631345:4760]
2025-10-10T14:32:24.373968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:24.373985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:24.373988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.373990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.373993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.374005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:24.374016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:24.374023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:24.374071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.374078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.374080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.374083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:24.374146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:24.374153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.374164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.374176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.374198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:24.374223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842283:5788], now have 1 active actors on pipe
2025-10-10T14:32:24.374231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842133:2438], now have 1 active actors on pipe
2025-10-10T14:32:24.374221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 567
2025-10-10T14:32:24.374239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600904484631339:4760]
2025-10-10T14:32:24.374245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600904484631339:4760]
2025-10-10T14:32:24.374228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 567
2025-10-10T14:32:24.374247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600904484631339:4760]
2025-10-10T14:32:24.374256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:24.374264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:24.374272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:24.374274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:24.374276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:24.374288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:24.374291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:24.374307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.374316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.374350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600904484631339:4760]
2025-10-10T14:32:24.374360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:24.374370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:24.374378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:24.374385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.374388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.374390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:24.374401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.374415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:24.374451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.374569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.374578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.374593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.374657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 568 partition: 0 MaxSeqNo: 40 sessionId: src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0
2025-10-10T14:32:24.375033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d23ee-13c187ce-5d8369fe-32d483b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:24.377384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0] Write session: try to update token
2025-10-10T14:32:24.377397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:24.385300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:24.385319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.385349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600904484631339:4760]
2025-10-10T14:32:24.385396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:24.385397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:24.385569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:24.385717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.385857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.386003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.386194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:24.386239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:24.390692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId: src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:24.393436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:24.393633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.393652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.393691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:24.393777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:24.402297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:24.402315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.402318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:24.402320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:24.402330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600904484631339:4760]
2025-10-10T14:32:24.402337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600904484631339:4760]
2025-10-10T14:32:24.402340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600904484631339:4760]
2025-10-10T14:32:24.402379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:24.402382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:24.402385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:24.402389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.402389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:24.402393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:24.402518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:24.456921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600905266842290:5401]
2025-10-10T14:32:24.457149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 567, pipe: [1:7559600905266842290:5401]
2025-10-10T14:32:24.506256Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:24.512687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.512710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.512884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.512948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.513003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.513057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.513104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.513114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.513172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.513226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.513289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.513374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.513412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.513417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.513474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.513526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.513582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.513637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.513675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.513680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.513738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.513893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.513951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.514020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.514057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.514065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.514123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.514184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.514242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.514298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.514339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.514344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.514399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.514449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.514502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.514555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.514593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.514598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.514653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.514703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.514772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.514831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.514876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.514883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.514939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.514990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.515043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.515093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.515130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.515136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.515191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.515241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.515294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.515348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.515384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.515389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.515444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.515506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.515564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.515615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.515652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.515657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.515692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842290:5401], now have 1 active actors on pipe
2025-10-10T14:32:24.515918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:24.515980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:24.515981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600905266842290:5401]
2025-10-10T14:32:24.515988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:24.516017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 568 reason: error at write: Disconnected sessionId: src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0
2025-10-10T14:32:24.516233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 568 sessionId: src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0 is DEAD
2025-10-10T14:32:24.516302Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:24.516342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:24.516352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0] Write session will restart in 0.006749s
2025-10-10T14:32:24.516371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0] Write session: Do CDS request
2025-10-10T14:32:24.516375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:24.523800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.523869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:24.523884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 569
2025-10-10T14:32:24.524025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.524062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:24.524072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:24.524075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:24.524572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 569 sessionId:  describe result for acl check
2025-10-10T14:32:24.524605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:24.524611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:24.524613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:24.524619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600905266842382:5792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:24.525218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600905266842382:5792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:24.526311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:24.527563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600905266842382:5792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:24.527941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:24.528108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:24.528118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:24.528128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:24.528173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:24.528210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600904484631494:4764]
2025-10-10T14:32:24.528788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:24.529030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:24.529069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:24.529377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:24.529424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.529430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.529431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.529432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.529433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.529434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.529435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.529436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.529437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.529438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.529439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.529440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.529441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.529446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.529459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.529463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.529467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.529471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.529474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.529478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.529481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.529484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.529488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.529491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.529494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.529498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.529505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.529514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.529525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.529530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.529536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.529541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.529545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.529537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600905266842382:5792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:24.529550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.529559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.529549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600905266842382:5792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:24.529551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600905266842382:5792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:24.529557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:24.529564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.529572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.529578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.529582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.529591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.529596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.529601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.529611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.529616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.529624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.529630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.529634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.529641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.529645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.529650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.529658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.529663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.529703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:24.531763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:24.532071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:24.532083Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:24.532085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:24.532089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:24.532094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 568 [2:7559600904484631494:4764]
2025-10-10T14:32:24.532105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:24.532125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:24.532132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.532135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.532138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.532153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:24.532164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:24.532171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:24.532219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.532225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.532227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.532229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:24.532366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 568
2025-10-10T14:32:24.532372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 568
2025-10-10T14:32:24.532396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:24.532406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.532416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.532428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.532451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:24.532475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842436:5792], now have 1 active actors on pipe
2025-10-10T14:32:24.532483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842294:2438], now have 1 active actors on pipe
2025-10-10T14:32:24.532499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.532504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.532525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600904484631488:4764]
2025-10-10T14:32:24.532530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600904484631488:4764]
2025-10-10T14:32:24.532532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600904484631488:4764]
2025-10-10T14:32:24.532545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:24.532557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:24.532559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:24.532565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:24.532567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:24.532575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:24.532578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:24.532599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:24.532610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.532614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.532617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:24.532627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.532641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:24.532666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600904484631488:4764]
2025-10-10T14:32:24.532678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:24.532693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.532693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:24.532830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.532840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.532857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.532931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 569 partition: 0 MaxSeqNo: 40 sessionId: src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0
2025-10-10T14:32:24.533250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adeee3ad-a1b7c4a3-d891e4f5-4605dcb5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:24.535653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0] Write session: try to update token
2025-10-10T14:32:24.535667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:24.543661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:24.543681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.543692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600904484631488:4764]
2025-10-10T14:32:24.543732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:24.543738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:24.543911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:24.544056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.544190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.544319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:24.544509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:24.544551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:24.548628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId: src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:24.551145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:24.551310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.551331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.551371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:24.551429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:24.560878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:24.560896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.560899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:24.560905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:24.560915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600904484631488:4764]
2025-10-10T14:32:24.560920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600904484631488:4764]
2025-10-10T14:32:24.560923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600904484631488:4764]
2025-10-10T14:32:24.560966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:24.560970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:24.560975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:24.560978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.560979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:24.560981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:24.561107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:24.616129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600905266842457:5401]
2025-10-10T14:32:24.616457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 568, pipe: [1:7559600905266842457:5401]
2025-10-10T14:32:24.675272Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:24.683081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.683108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.683259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.683316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.683373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.683432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.683477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.683487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.683546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.683624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.683697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.683756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.683798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.683802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.683861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.683917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.683974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.684031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.684159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.684171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.684233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.684297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.684370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.684442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.684486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.684494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.684561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.684623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.684694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.684756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.684803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.684810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.684879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.684945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.685029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.685130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.685184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.685194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.685266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.685354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.685426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.685493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.685540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.685548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.685617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.685682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.685754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.685823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.685870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.685881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.685952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.686018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.686085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.686153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.686200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.686208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.686274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:24.686341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:24.686403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:24.686466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:24.686511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:24.686519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:24.686577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842457:5401], now have 1 active actors on pipe
2025-10-10T14:32:24.686875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600905266842457:5401]
2025-10-10T14:32:24.686884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:24.686889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:24.686914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:24.686920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 569 reason: error at write: Disconnected sessionId: src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0
2025-10-10T14:32:24.687139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 569 sessionId: src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0 is DEAD
2025-10-10T14:32:24.687253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:24.687261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0] Write session will restart in 0.005191s
2025-10-10T14:32:24.687281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0] Write session: Do CDS request
2025-10-10T14:32:24.687287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:24.687515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:24.693881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.693915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:24.693931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 570
2025-10-10T14:32:24.694126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.694166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:24.694173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:24.694177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:24.694552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 570 sessionId:  describe result for acl check
2025-10-10T14:32:24.694581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:24.694585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:24.694587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:24.694591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600905266842498:5798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:24.695030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600905266842498:5798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:24.697591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600905266842498:5798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:24.698341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:24.700123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:24.700327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:24.700337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:24.700346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:24.700361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600905266842498:5798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:24.700392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:24.700374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600905266842498:5798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:24.700376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600905266842498:5798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:24.700382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:24.700434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600904484631645:4767]
2025-10-10T14:32:24.700873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:24.701151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:24.701184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:24.701422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:24.701464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.701471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.701472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.701473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.701474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.701475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.701476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.701478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.701479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.701480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.701481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.701482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.701482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.701486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.701494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.701496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.701498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.701501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.701503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.701505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.701507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.701509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.701511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.701513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.701515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.701517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.701522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.701527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.701532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.701535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.701537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.701540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.701543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.701546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.701549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.701552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.701555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.701558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.701560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.701563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.701567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.701572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.701577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.701582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.701587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.701592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.701597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.701602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.701604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.701607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.701610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.701613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.701634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:24.703868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:24.704173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:24.704183Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:24.704185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:24.704189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:24.704194Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 569 [2:7559600904484631645:4767]
2025-10-10T14:32:24.704205Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:24.704220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:24.704227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.704230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.704232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.704248Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:24.704260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:24.704267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:24.704315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.704321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.704323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.704325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:24.704382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:24.704389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.704399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.704415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.704437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:24.704462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842603:5798], now have 1 active actors on pipe
2025-10-10T14:32:24.704468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842462:2438], now have 1 active actors on pipe
2025-10-10T14:32:24.704474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600904484631639:4767]
2025-10-10T14:32:24.704478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600904484631639:4767]
2025-10-10T14:32:24.704479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600904484631639:4767]
2025-10-10T14:32:24.704489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:24.704493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 569
2025-10-10T14:32:24.704504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:24.704512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:24.704494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 569
2025-10-10T14:32:24.704515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:24.704517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:24.704518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:24.704521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:24.704540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600904484631639:4767]
2025-10-10T14:32:24.704543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:24.704552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:24.704562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.704565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.704595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:24.704606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.704608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.704610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:24.704617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.704629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:24.704646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.704784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.704792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.704805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.704888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 570 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0
2025-10-10T14:32:24.705227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7635aeb5-cb6183b7-b91d63f6-39c53174_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:24.707908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0] Write session: try to update token
2025-10-10T14:32:24.707923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:24.723088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:24.723108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.723112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:24.723114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:24.723124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600904484631639:4767]
2025-10-10T14:32:24.723129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600904484631639:4767]
2025-10-10T14:32:24.723133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600904484631639:4767]
2025-10-10T14:32:24.723178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:24.723190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.723196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:24.723214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:24.723232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:24.723236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:24.723333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:24.723532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId: src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:24.726160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:24.787149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600905266842614:5401]
2025-10-10T14:32:24.787395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 569, pipe: [1:7559600905266842614:5401]
2025-10-10T14:32:24.827587Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:24.827967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.827978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.828017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842614:5401], now have 1 active actors on pipe
2025-10-10T14:32:24.828229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:24.828307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:24.828323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:24.828323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:24.828362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600905266842614:5401]
2025-10-10T14:32:24.828386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 570 reason: error at write: Disconnected sessionId: src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0
2025-10-10T14:32:24.828606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 570 sessionId: src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0 is DEAD
2025-10-10T14:32:24.828758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:24.828770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0] Write session will restart in 0.007622s
2025-10-10T14:32:24.828790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0] Write session: Do CDS request
2025-10-10T14:32:24.828805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:24.837752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.837864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:24.837879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 571
2025-10-10T14:32:24.838069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.838114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:24.838123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:24.838127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:24.838257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:24.838578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 571 sessionId:  describe result for acl check
2025-10-10T14:32:24.838611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:24.838616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:24.838617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:24.838622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600905266842727:5802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:24.839074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600905266842727:5802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:24.839787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:24.839951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:24.839964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:24.839974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:24.840021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:24.840059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600904484631793:4769]
2025-10-10T14:32:24.840480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:24.840677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:24.840723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:24.841014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:24.841069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.841075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.841077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.841078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.841079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.841080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.841081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.841082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.841083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.841085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.841086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.841087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.841088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.841093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.841105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.841109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.841113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.841117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.841121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.841125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.841129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.841133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.841137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.841141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.841145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.841152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.841138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600905266842727:5802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:24.841158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.841171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.841182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.841192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.841197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.841206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.841215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.841224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.841233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.841238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.841246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.841251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.841256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.841261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.841269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.841274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.841285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.841294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.841302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.841311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.841320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.841344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.841348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.841358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.841367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.841376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.841419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:24.843334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600905266842727:5802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:24.843345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600905266842727:5802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:24.843347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600905266842727:5802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:24.843352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:24.843488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:24.843802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:24.843816Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:24.843818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:24.843821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:24.843826Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 570 [2:7559600904484631793:4769]
2025-10-10T14:32:24.843836Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:24.843851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:24.843859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.843862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.843864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.843879Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:24.843890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:24.843897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:24.843949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.843955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.843957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.843959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:24.844020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:24.844028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.844039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.844052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.844074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:24.844097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842761:5802], now have 1 active actors on pipe
2025-10-10T14:32:24.844105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842616:2438], now have 1 active actors on pipe
2025-10-10T14:32:24.844089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 570
2025-10-10T14:32:24.844112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600904484631788:4769]
2025-10-10T14:32:24.844119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600904484631788:4769]
2025-10-10T14:32:24.844121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600904484631788:4769]
2025-10-10T14:32:24.844093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 570
2025-10-10T14:32:24.844129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:24.844137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:24.844139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:24.844141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:24.844147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:24.844163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:24.844171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:24.844191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.844199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.844226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600904484631788:4769]
2025-10-10T14:32:24.844238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:24.844255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:24.844257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:24.844265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.844269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.844271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:24.844283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.844297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:24.844327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.844462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.844472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.844487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.844561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 571 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0
2025-10-10T14:32:24.844874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f03b5c1-47a2f474-9acdc2f1-c9ec203d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:24.847947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0] Write session: try to update token
2025-10-10T14:32:24.847960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:24.862294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:24.862311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.862314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:24.862315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:24.862325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600904484631788:4769]
2025-10-10T14:32:24.862328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600904484631788:4769]
2025-10-10T14:32:24.862331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600904484631788:4769]
2025-10-10T14:32:24.862365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:24.862364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:24.862369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:24.862370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.862372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:24.862372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:24.862487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:24.863061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId: src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:24.865770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:24.928463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600905266842768:5401]
2025-10-10T14:32:24.928673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 570, pipe: [1:7559600905266842768:5401]
2025-10-10T14:32:24.962857Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:24.963211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.963223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.963258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842768:5401], now have 1 active actors on pipe
2025-10-10T14:32:24.963415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:24.963483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600905266842768:5401]
2025-10-10T14:32:24.963488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:24.963493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:24.963511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:24.963560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 571 reason: error at write: Disconnected sessionId: src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0
2025-10-10T14:32:24.963782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 571 sessionId: src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0 is DEAD
2025-10-10T14:32:24.963935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:24.963953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0] Write session will restart in 0.007422s
2025-10-10T14:32:24.963971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0] Write session: Do CDS request
2025-10-10T14:32:24.963976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:24.972844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.972930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:24.972948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 572
2025-10-10T14:32:24.973139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:24.973172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:24.973181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:24.973186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:24.973554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:24.973573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 572 sessionId:  describe result for acl check
2025-10-10T14:32:24.973605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:24.973611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:24.973613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:24.973617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600905266842885:5806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:24.974062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600905266842885:5806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:24.975488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:24.975568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600905266842885:5806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:24.975667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:24.975681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:24.975694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:24.975749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:24.975789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600904484631947:4771]
2025-10-10T14:32:24.976381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:24.976642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:24.976685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:24.976998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:24.977055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.977061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.977062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.977063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.977064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.977065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.977067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.977068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.977070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.977071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.977072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.977073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.977074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.977080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.977091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.977095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.977099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.977103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.977107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.977111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.977115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.977118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.977122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.977131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.977135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.977139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.977146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.977159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:24.977169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.977175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:24.977185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.977190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:24.977194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.977200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:24.977204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.977209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:24.977213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.977219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:24.977223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.977229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:24.977236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.977241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:24.977249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.977255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:24.977261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.977267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:24.977274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.977286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.977290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.977295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.977301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.977305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.977364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:24.977593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600905266842885:5806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:24.977611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600905266842885:5806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:24.977614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600905266842885:5806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:24.977618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:24.979478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:24.979789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:24.979802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:24.979805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:24.979808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:24.979813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 571 [2:7559600904484631947:4771]
2025-10-10T14:32:24.979824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:24.979838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:24.979841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.979844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.979846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.979860Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:24.979872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:24.979883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:24.979939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.979945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.979947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.979949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:24.980008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:24.980016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.980027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:24.980044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:24.980065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:24.980089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842920:5806], now have 1 active actors on pipe
2025-10-10T14:32:24.980098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600905266842773:2438], now have 1 active actors on pipe
2025-10-10T14:32:24.980094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 571
2025-10-10T14:32:24.980107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600904484631941:4771]
2025-10-10T14:32:24.980115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 571
2025-10-10T14:32:24.980113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600904484631941:4771]
2025-10-10T14:32:24.980115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600904484631941:4771]
2025-10-10T14:32:24.980124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:24.980134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:24.980137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:24.980144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:24.980146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:24.980153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:24.980156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:24.980172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.980181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.980212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600904484631941:4771]
2025-10-10T14:32:24.980220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:24.980228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:24.980238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:24.980250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:24.980253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:24.980255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:24.980265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:24.980275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:24.980306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.980439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:24.980449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:24.980464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:24.980530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 572 partition: 0 MaxSeqNo: 40 sessionId: src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0
2025-10-10T14:32:24.980878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8083dee-c754b3d8-d507d874-c83f87d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:24.983891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0] Write session: try to update token
2025-10-10T14:32:24.983909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:24.998363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:24.998383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:24.998387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:24.998389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:24.998398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600904484631941:4771]
2025-10-10T14:32:24.998402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600904484631941:4771]
2025-10-10T14:32:24.998407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600904484631941:4771]
2025-10-10T14:32:24.998454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:24.998461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:24.998462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:24.998468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:24.998469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:24.998471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:24.998601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:24.998751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId: src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:25.001654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:25.063605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600909561810225:5401]
2025-10-10T14:32:25.063955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 571, pipe: [1:7559600909561810225:5401]
2025-10-10T14:32:25.103453Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:25.103868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.103881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.103919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810225:5401], now have 1 active actors on pipe
2025-10-10T14:32:25.104121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:25.104131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:25.104142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:25.104146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:25.104185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600909561810225:5401]
2025-10-10T14:32:25.104211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 572 reason: error at write: Disconnected sessionId: src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0
2025-10-10T14:32:25.104419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 572 sessionId: src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0 is DEAD
2025-10-10T14:32:25.104591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:25.104601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0] Write session will restart in 0.005559s
2025-10-10T14:32:25.104620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0] Write session: Do CDS request
2025-10-10T14:32:25.104627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:25.110707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.110854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:25.110868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 573
2025-10-10T14:32:25.110991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.111024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:25.111033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:25.111036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:25.111524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 573 sessionId:  describe result for acl check
2025-10-10T14:32:25.111552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:25.111558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:25.111560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:25.111565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600909561810261:5810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:25.112090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600909561810261:5810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:25.114357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600909561810261:5810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:25.114559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:25.116169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:25.116253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600909561810261:5810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:25.116267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600909561810261:5810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:25.116271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600909561810261:5810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:25.116277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:25.116328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:25.116341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:25.116352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:25.116388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:25.116428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600908779599396:4773]
2025-10-10T14:32:25.116800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:25.117016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:25.117045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:25.117305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:25.117362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.117366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.117367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.117368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.117368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.117369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.117370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.117371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.117371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.117372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.117372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.117373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.117374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.117377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.117385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.117388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.117390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.117392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.117394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.117396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.117398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.117400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.117402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.117404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.117409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.117413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.117419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.117426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.117432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.117442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.117447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.117452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.117461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.117470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.117480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.117489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.117495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.117502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.117507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.117516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.117522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.117531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.117538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.117547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.117554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.117557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.117560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.117564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.117567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.117570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.117574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.117577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.117599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:25.119699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:25.120012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:25.120026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:25.120028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:25.120032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:25.120037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 572 [2:7559600908779599396:4773]
2025-10-10T14:32:25.120048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:25.120068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:25.120075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.120078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.120081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.120097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:25.120109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:25.120120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:25.120173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.120180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.120181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.120183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:25.120235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:25.120245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.120256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.120268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.120286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:25.120309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810369:5810], now have 1 active actors on pipe
2025-10-10T14:32:25.120317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810226:2438], now have 1 active actors on pipe
2025-10-10T14:32:25.120324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600908779599390:4773]
2025-10-10T14:32:25.120330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600908779599390:4773]
2025-10-10T14:32:25.120332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600908779599390:4773]
2025-10-10T14:32:25.120342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:25.120352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:25.120360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:25.120361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:25.120362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:25.120378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:25.120358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 572
2025-10-10T14:32:25.120381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:25.120370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 572
2025-10-10T14:32:25.120411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.120415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.120429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600908779599390:4773]
2025-10-10T14:32:25.120441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:25.120445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:25.120471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e910769-f5fae56b-6225040e-a748b7f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:25.120483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.120491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.120494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:25.120504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.120518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:25.120538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.120739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.120746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.120758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.120840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 573 partition: 0 MaxSeqNo: 40 sessionId: src_id|5e910769-f5fae56b-6225040e-a748b7f6_0
2025-10-10T14:32:25.121122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2c449-74b68394-8773d8cd-a8b0be25_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5e910769-f5fae56b-6225040e-a748b7f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:25.123848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e910769-f5fae56b-6225040e-a748b7f6_0] Write session: try to update token
2025-10-10T14:32:25.123862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e910769-f5fae56b-6225040e-a748b7f6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:25.136606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId: src_id|5e910769-f5fae56b-6225040e-a748b7f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:25.138878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:25.138897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:25.138899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:25.138901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:25.138908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600908779599390:4773]
2025-10-10T14:32:25.138911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600908779599390:4773]
2025-10-10T14:32:25.138916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600908779599390:4773]
2025-10-10T14:32:25.138956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:25.138961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:25.138965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.138967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:25.138967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:25.138970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:25.139094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:25.139239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:25.204438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600909561810393:5401]
2025-10-10T14:32:25.204720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 572, pipe: [1:7559600909561810393:5401]
2025-10-10T14:32:25.243834Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:25.244176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.244191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.244229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810393:5401], now have 1 active actors on pipe
2025-10-10T14:32:25.244386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:25.244474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:25.244488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600909561810393:5401]
2025-10-10T14:32:25.244511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:25.244594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 573 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e910769-f5fae56b-6225040e-a748b7f6_0
2025-10-10T14:32:25.244801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 573 sessionId: src_id|5e910769-f5fae56b-6225040e-a748b7f6_0 is DEAD
2025-10-10T14:32:25.244973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e910769-f5fae56b-6225040e-a748b7f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:25.244984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e910769-f5fae56b-6225040e-a748b7f6_0] Write session will restart in 0.007543s
2025-10-10T14:32:25.245002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e910769-f5fae56b-6225040e-a748b7f6_0] Write session: Do CDS request
2025-10-10T14:32:25.245007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e910769-f5fae56b-6225040e-a748b7f6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:25.253751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e910769-f5fae56b-6225040e-a748b7f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.253857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:25.253872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 574
2025-10-10T14:32:25.253985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.254016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:25.254026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:25.254029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:25.254280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:25.254441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 574 sessionId:  describe result for acl check
2025-10-10T14:32:25.254472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:25.254479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:25.254480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:25.254486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600909561810508:5815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:25.255052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600909561810508:5815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:25.255948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:25.256107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:25.256121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:25.256132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:25.256181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:25.256220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600908779599559:4776]
2025-10-10T14:32:25.256693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:25.256923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:25.256968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:25.256992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600909561810508:5815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:25.257276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:25.257346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.257352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.257354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.257355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.257356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.257357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.257358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.257360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.257361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.257362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.257363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.257364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.257365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.257371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.257383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.257392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.257396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.257405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.257409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.257413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.257421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.257425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.257429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.257435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.257437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.257439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.257445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.257457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.257463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.257468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.257478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.257483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.257493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.257498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.257506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.257512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.257516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.257521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.257529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.257534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.257542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.257547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.257555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.257564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.257572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.257577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.257582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.257587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.257595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.257600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.257610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.257615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.257654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:25.259889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600909561810508:5815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:25.259902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600909561810508:5815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:25.259905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600909561810508:5815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:25.259911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:25.259909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:25.260215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:25.260227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:25.260228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:25.260231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:25.260235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 573 [2:7559600908779599559:4776]
2025-10-10T14:32:25.260242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:25.260255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:25.260258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.260261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.260263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.260279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:25.260291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:25.260298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:25.260348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.260355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.260357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.260360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:25.260419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:25.260427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.260438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.260455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.260476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:25.260500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810394:2438], now have 1 active actors on pipe
2025-10-10T14:32:25.260509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810542:5815], now have 1 active actors on pipe
2025-10-10T14:32:25.260504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 573
2025-10-10T14:32:25.260512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 573
2025-10-10T14:32:25.260516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600908779599554:4776]
2025-10-10T14:32:25.260522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600908779599554:4776]
2025-10-10T14:32:25.260525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600908779599554:4776]
2025-10-10T14:32:25.260533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:25.260545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:25.260550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:25.260562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:25.260563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:25.260567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:25.260570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:25.260604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.260613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.260628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600908779599554:4776]
2025-10-10T14:32:25.260639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:25.260643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:25.260669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:25.260681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.260688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.260690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:25.260700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.260714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:25.260740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.260863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.260871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.260885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.260961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 574 partition: 0 MaxSeqNo: 40 sessionId: src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0
2025-10-10T14:32:25.261275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e910769-f5fae56b-6225040e-a748b7f6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:25.263952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0] Write session: try to update token
2025-10-10T14:32:25.263971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:25.276973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId: src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:25.279360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:25.279379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:25.279381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:25.279382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:25.279390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600908779599554:4776]
2025-10-10T14:32:25.279393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600908779599554:4776]
2025-10-10T14:32:25.279396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600908779599554:4776]
2025-10-10T14:32:25.279432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:25.279435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:25.279440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:25.279442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.279419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:25.279443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:25.279445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:25.279573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:25.344734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600909561810550:5401]
2025-10-10T14:32:25.345055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 573, pipe: [1:7559600909561810550:5401]
2025-10-10T14:32:25.383895Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:25.384332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.384346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.384384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810550:5401], now have 1 active actors on pipe
2025-10-10T14:32:25.384539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:25.384682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:25.384730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:25.384805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 574 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0
2025-10-10T14:32:25.385020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 574 sessionId: src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0 is DEAD
2025-10-10T14:32:25.385161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:25.385180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0] Write session will restart in 0.007845s
2025-10-10T14:32:25.385205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0] Write session: Do CDS request
2025-10-10T14:32:25.385198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600909561810550:5401]
2025-10-10T14:32:25.385212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:25.393847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.393929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:25.393948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 575
2025-10-10T14:32:25.394072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.394104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:25.394116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:25.394120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:25.394617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 575 sessionId:  describe result for acl check
2025-10-10T14:32:25.394651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:25.394662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:25.394664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:25.394669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600909561810683:5826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:25.395509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600909561810683:5826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:25.396309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:25.396617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600909561810683:5826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:25.398305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:25.398480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:25.398495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:25.398506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:25.398547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:25.398581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600908779599752:4784]
2025-10-10T14:32:25.398899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600909561810683:5826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:25.398910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600909561810683:5826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:25.398913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600909561810683:5826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:25.398918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:25.399042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:25.399266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:25.399309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:25.399621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:25.399676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.399682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.399683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.399684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.399685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.399686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.399687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.399688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.399689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.399690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.399691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.399692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.399693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.399699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.399710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.399714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.399719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.399723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.399727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.399731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.399735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.399739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.399743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.399747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.399750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.399754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.399761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.399775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.399786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.399796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.399804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.399814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.399823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.399833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.399841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.399846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.399855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.399860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.399869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.399877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.399881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.399889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.399893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.399903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.399907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.399916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.399920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.399928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.399937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.399942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.399950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.399955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.400000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:25.402226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:25.402691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:25.402704Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:25.402705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:25.402708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:25.402713Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 574 [2:7559600908779599752:4784]
2025-10-10T14:32:25.402722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:25.402735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:25.402740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.402743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.402744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.402756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:25.402775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:25.402786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:25.402841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.402852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.402855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.402858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:25.402913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:25.402919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.402926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.402942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.402964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:25.402989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810564:2438], now have 1 active actors on pipe
2025-10-10T14:32:25.402998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810720:5826], now have 1 active actors on pipe
2025-10-10T14:32:25.403004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600908779599746:4784]
2025-10-10T14:32:25.403007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600908779599746:4784]
2025-10-10T14:32:25.403008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600908779599746:4784]
2025-10-10T14:32:25.403022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:25.403029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:25.403031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:25.403032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:25.403034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:25.403046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:25.403049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:25.403036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 574
2025-10-10T14:32:25.403052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 574
2025-10-10T14:32:25.403072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600908779599746:4784]
2025-10-10T14:32:25.403087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:25.403091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:25.403109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.403118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.403163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edfc360c-9136d049-801736ca-b131820c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:25.403175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.403183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.403185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:25.403195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.403210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:25.403230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.403362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.403370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.403387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.403512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 575 partition: 0 MaxSeqNo: 40 sessionId: src_id|edfc360c-9136d049-801736ca-b131820c_0
2025-10-10T14:32:25.403843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37bc71c6-a33a4764-baad4190-74cc0dbc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|edfc360c-9136d049-801736ca-b131820c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:25.406325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edfc360c-9136d049-801736ca-b131820c_0] Write session: try to update token
2025-10-10T14:32:25.406337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edfc360c-9136d049-801736ca-b131820c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:25.419149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId: src_id|edfc360c-9136d049-801736ca-b131820c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:25.421678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:25.421696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:25.421718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:25.421720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:25.421724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:25.421731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600908779599746:4784]
2025-10-10T14:32:25.421734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600908779599746:4784]
2025-10-10T14:32:25.421738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600908779599746:4784]
2025-10-10T14:32:25.421777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:25.421781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:25.421787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:25.421789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.421791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:25.421791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:25.421925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:25.485509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600909561810732:5401]
2025-10-10T14:32:25.485758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 574, pipe: [1:7559600909561810732:5401]
2025-10-10T14:32:25.525769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:25.526026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.526038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.526075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810732:5401], now have 1 active actors on pipe
2025-10-10T14:32:25.526244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:25.526316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:25.526378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600909561810732:5401]
2025-10-10T14:32:25.526776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:25.526844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 575 reason: status is not ok: tablet will be restarted right now sessionId: src_id|edfc360c-9136d049-801736ca-b131820c_0
2025-10-10T14:32:25.527013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 575 sessionId: src_id|edfc360c-9136d049-801736ca-b131820c_0 is DEAD
2025-10-10T14:32:25.527146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfc360c-9136d049-801736ca-b131820c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:25.527156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfc360c-9136d049-801736ca-b131820c_0] Write session will restart in 0.009083s
2025-10-10T14:32:25.527172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfc360c-9136d049-801736ca-b131820c_0] Write session: Do CDS request
2025-10-10T14:32:25.527177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfc360c-9136d049-801736ca-b131820c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:25.536772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:25.537788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edfc360c-9136d049-801736ca-b131820c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.537864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:25.537880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 576
2025-10-10T14:32:25.537976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.538006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:25.538017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:25.538025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:25.538416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 576 sessionId:  describe result for acl check
2025-10-10T14:32:25.538460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:25.538461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:25.538463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:25.538469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600909561810850:5832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:25.538597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:25.538799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:25.538814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:25.538827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:25.538885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:25.538906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600909561810850:5832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:25.538927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600908779599907:4793]
2025-10-10T14:32:25.539334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:25.539621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:25.539669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:25.539955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:25.540001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.540007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.540008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.540008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.540009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.540010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.540010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.540011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.540012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.540012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.540013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.540013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.540014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.540019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.540031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.540035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.540039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.540043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.540047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.540051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.540055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.540060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.540064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.540068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.540072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.540076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.540082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.540091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.540097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.540103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.540109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.540120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.540124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.540130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.540139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.540146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.540156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.540161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.540170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.540179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.540186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.540195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.540203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.540208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.540215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.540219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.540223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.540228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.540232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.540236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.540245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.540249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.540289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:25.540461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600909561810850:5832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:25.542278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600909561810850:5832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:25.542291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600909561810850:5832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:25.542293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600909561810850:5832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:25.542307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:25.542328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:25.542857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:25.542869Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:25.542872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:25.542875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:25.542881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 575 [2:7559600908779599907:4793]
2025-10-10T14:32:25.542893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:25.542909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:25.542912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.542916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.542918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.542934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:25.542941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:25.542948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:25.543001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.543009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.543010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.543013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:25.543074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:25.543081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.543093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.543109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.543130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:25.543157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810733:2438], now have 1 active actors on pipe
2025-10-10T14:32:25.543166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810883:5832], now have 1 active actors on pipe
2025-10-10T14:32:25.543174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600908779599901:4793]
2025-10-10T14:32:25.543180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600908779599901:4793]
2025-10-10T14:32:25.543182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600908779599901:4793]
2025-10-10T14:32:25.543197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:25.543187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 575
2025-10-10T14:32:25.543210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:25.543214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:25.543219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:25.543220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:25.543230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:25.543238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:25.543264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600908779599901:4793]
2025-10-10T14:32:25.543276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:25.543279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:25.543354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 575
2025-10-10T14:32:25.543426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.543438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.543466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ffe5c49-748d997c-4d264788-8160819c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:25.543480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.543487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.543489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:25.543502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.543518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:25.543539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.543702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.543713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.543728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.543822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 576 partition: 0 MaxSeqNo: 40 sessionId: src_id|4ffe5c49-748d997c-4d264788-8160819c_0
2025-10-10T14:32:25.544097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfc360c-9136d049-801736ca-b131820c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4ffe5c49-748d997c-4d264788-8160819c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:25.546503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffe5c49-748d997c-4d264788-8160819c_0] Write session: try to update token
2025-10-10T14:32:25.546517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffe5c49-748d997c-4d264788-8160819c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:25.559086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId: src_id|4ffe5c49-748d997c-4d264788-8160819c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:25.559406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:25.559423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:25.559431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600908779599901:4793]
2025-10-10T14:32:25.559474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:25.559513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:25.559668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:25.559816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:25.559959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:25.560101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:25.560288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:25.560334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:25.561385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:25.561534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.561546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.561580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:25.561646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:25.571093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:25.571109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:25.571111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:25.571112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:25.571122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600908779599901:4793]
2025-10-10T14:32:25.571125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600908779599901:4793]
2025-10-10T14:32:25.571127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600908779599901:4793]
2025-10-10T14:32:25.571159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:25.571168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.571169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:25.571171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:25.571177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:25.571187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:25.571285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:25.626302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600909561810900:5401]
2025-10-10T14:32:25.626556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 575, pipe: [1:7559600909561810900:5401]
2025-10-10T14:32:25.674592Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:25.681499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.681525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.681684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.681748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.681812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.681872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.681922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.681933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.682000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.682059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.682119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.682184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.682229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.682240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.682301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.682355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.682420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.682483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.682523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.682528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.682586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.682645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.682710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.682779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.682818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.682824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.682883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.682948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.683007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.683066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.683108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.683114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.683177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.683238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.683296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.683355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.683397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.683403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.683468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.683526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.683585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.683642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.683689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.683696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.683762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.683818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.683880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.683941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.683992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.683998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.684058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.684113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.684170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.684238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.684278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.684284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.684344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.684399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.684463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.684523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.684565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.684570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.684613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810900:5401], now have 1 active actors on pipe
2025-10-10T14:32:25.684822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:25.684854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600909561810900:5401]
2025-10-10T14:32:25.684875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:25.684882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:25.684907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 576 reason: error at write: Disconnected sessionId: src_id|4ffe5c49-748d997c-4d264788-8160819c_0
2025-10-10T14:32:25.685128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 576 sessionId: src_id|4ffe5c49-748d997c-4d264788-8160819c_0 is DEAD
2025-10-10T14:32:25.685252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffe5c49-748d997c-4d264788-8160819c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:25.685263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffe5c49-748d997c-4d264788-8160819c_0] Write session will restart in 0.007410s
2025-10-10T14:32:25.685283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffe5c49-748d997c-4d264788-8160819c_0] Write session: Do CDS request
2025-10-10T14:32:25.685288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffe5c49-748d997c-4d264788-8160819c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:25.685321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:25.693739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffe5c49-748d997c-4d264788-8160819c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.693812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:25.693827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 577
2025-10-10T14:32:25.693947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.694001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:25.694011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:25.694016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:25.694465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 577 sessionId:  describe result for acl check
2025-10-10T14:32:25.694511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:25.694518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:25.694520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:25.694526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600909561810985:5838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:25.695059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600909561810985:5838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:25.696614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:25.697712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600909561810985:5838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:25.698263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:25.698414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:25.698424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:25.698433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:25.698470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:25.698502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600908779600066:4796]
2025-10-10T14:32:25.698889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:25.699166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:25.699213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:25.699439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:25.699477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.699481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.699482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.699482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.699483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.699484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.699485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.699486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.699487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.699488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.699489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.699490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.699491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.699496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.699507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.699511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.699515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.699519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.699523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.699527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.699531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.699534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.699538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.699541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.699544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.699547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.699555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.699563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.699569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.699574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.699576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.699580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.699584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.699589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.699593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.699598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.699602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.699608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.699612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.699617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.699621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.699627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.699630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.699635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.699639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.699644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.699648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.699671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.699675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.699680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.699684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.699690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.699728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:25.699946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600909561810985:5838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:25.699956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600909561810985:5838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:25.699959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600909561810985:5838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:25.699963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:25.701872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:25.702183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:25.702192Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:25.702194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:25.702196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:25.702202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 576 [2:7559600908779600066:4796]
2025-10-10T14:32:25.702209Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:25.702219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:25.702224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.702227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.702228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.702238Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:25.702247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:25.702257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:25.702301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.702308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.702309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.702312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:25.702367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:25.702373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.702380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.702387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.702397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:25.702488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 576
2025-10-10T14:32:25.702493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 576
2025-10-10T14:32:25.702414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600908779600061:4796]
2025-10-10T14:32:25.702421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600908779600061:4796]
2025-10-10T14:32:25.702422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600908779600061:4796]
2025-10-10T14:32:25.702435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:25.702449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561811053:5838], now have 1 active actors on pipe
2025-10-10T14:32:25.702452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:25.702453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561810902:2438], now have 1 active actors on pipe
2025-10-10T14:32:25.702455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:25.702457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:25.702461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:25.702478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:25.702480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:25.702495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600908779600061:4796]
2025-10-10T14:32:25.702497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:25.702515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:25.702522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.702525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.702547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:25.702552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.702555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.702557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:25.702566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.702576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:25.702588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.702821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 577 partition: 0 MaxSeqNo: 40 sessionId: src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0
2025-10-10T14:32:25.702729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.702733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.702749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.703106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ffe5c49-748d997c-4d264788-8160819c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:25.705573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0] Write session: try to update token
2025-10-10T14:32:25.705586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:25.713494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:25.713506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:25.713515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600908779600061:4796]
2025-10-10T14:32:25.713555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:25.713558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:25.713703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:25.713826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:25.713990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:25.714112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:25.714288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:25.714321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:25.718322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId: src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:25.720668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:25.720868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.720882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.720913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:25.720996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:25.730815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:25.730827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:25.730829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:25.730830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:25.730838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600908779600061:4796]
2025-10-10T14:32:25.730841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600908779600061:4796]
2025-10-10T14:32:25.730843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600908779600061:4796]
2025-10-10T14:32:25.730877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:25.730882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.730883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:25.730894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:25.730901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:25.730905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:25.731002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:25.785023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600909561811060:5401]
2025-10-10T14:32:25.785269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 576, pipe: [1:7559600909561811060:5401]
2025-10-10T14:32:25.834013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:25.840442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.840465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.840614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.840667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.840721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.840780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.840819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.840826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.840883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.840935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.840986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.841041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.841078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.841083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.841141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.841193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.841250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.841302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.841355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.841361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.841415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.841467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.841518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.841570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.841608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.841613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.841673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.841736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.841790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.841852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.841890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.841895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.841949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.841999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.842050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.842105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.842142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.842149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.842201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.842249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.842303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.842354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.842389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.842394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.842447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.842496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.842548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.842598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.842645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.842650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.842703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.842755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.842818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.842869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.842905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.842909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.842967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:25.843025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:25.843077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:25.843128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:25.843163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:25.843170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:25.843205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561811060:5401], now have 1 active actors on pipe
2025-10-10T14:32:25.843437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600909561811060:5401]
2025-10-10T14:32:25.843448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:25.843451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:25.843469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:25.843487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 577 reason: error at write: Disconnected sessionId: src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0
2025-10-10T14:32:25.843704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 577 sessionId: src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0 is DEAD
2025-10-10T14:32:25.843828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:25.843835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0] Write session will restart in 0.008685s
2025-10-10T14:32:25.843858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0] Write session: Do CDS request
2025-10-10T14:32:25.843846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:25.843864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:25.853812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.853939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:25.853957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 578
2025-10-10T14:32:25.854214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:25.854279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.854314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:25.854324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:25.854327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:25.854702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 578 sessionId:  describe result for acl check
2025-10-10T14:32:25.854742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:25.854747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:25.854748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:25.854753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600909561811180:5842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:25.855188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600909561811180:5842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:25.855870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:25.856049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:25.856059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:25.856072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:25.856130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:25.856160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600908779600223:4798]
2025-10-10T14:32:25.856681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:25.856881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:25.856913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:25.856997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600909561811180:5842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:25.857172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:25.857216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.857221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.857222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.857222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.857223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.857224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.857224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.857225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.857226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.857226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.857227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.857227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.857228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.857232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.857240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.857242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.857245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.857247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.857249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.857252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.857254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.857256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.857259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.857261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.857263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.857265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.857270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.857276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.857281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.857285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.857288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.857291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.857293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.857296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.857299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.857303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.857307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.857312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.857317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.857323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.857327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.857358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.857365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.857368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.857371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.857377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.857380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.857384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.857390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.857393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.857396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.857398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.857420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:25.859377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600909561811180:5842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:25.859390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600909561811180:5842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:25.859392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600909561811180:5842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:25.859398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:25.859450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:25.859719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:25.859729Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:25.859730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:25.859732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:25.859737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 577 [2:7559600908779600223:4798]
2025-10-10T14:32:25.859744Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:25.859756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:25.859762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.859764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.859766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.859776Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:25.859784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:25.859790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:25.859828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.859833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.859834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.859836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:25.859890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:25.859897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.859904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.859910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.859923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:25.859943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561811062:2438], now have 1 active actors on pipe
2025-10-10T14:32:25.859948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561811213:5842], now have 1 active actors on pipe
2025-10-10T14:32:25.859954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600908779600217:4798]
2025-10-10T14:32:25.859959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600908779600217:4798]
2025-10-10T14:32:25.859960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600908779600217:4798]
2025-10-10T14:32:25.859955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 577
2025-10-10T14:32:25.859967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:25.859961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 577
2025-10-10T14:32:25.859976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:25.859989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:25.859991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:25.859994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:25.859994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:25.859996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:25.860023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.860029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.860040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600908779600217:4798]
2025-10-10T14:32:25.860049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:25.860059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:25.860070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:25.860076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.860078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.860079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:25.860086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.860098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:25.860117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.860238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.860243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.860254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:25.860331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 578 partition: 0 MaxSeqNo: 40 sessionId: src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0
2025-10-10T14:32:25.860580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63ddc2c-de99b5ee-ea75f562-122a39b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:25.863057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0] Write session: try to update token
2025-10-10T14:32:25.863070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:25.876124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId: src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:25.878328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:25.878343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:25.878345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:25.878347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:25.878354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600908779600217:4798]
2025-10-10T14:32:25.878358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600908779600217:4798]
2025-10-10T14:32:25.878360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600908779600217:4798]
2025-10-10T14:32:25.878401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:25.878402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:25.878407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.878408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:25.878408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:25.878411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:25.878535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:25.878621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:25.943698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600909561811221:5401]
2025-10-10T14:32:25.943905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 577, pipe: [1:7559600909561811221:5401]
2025-10-10T14:32:25.982403Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:25.982728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:25.982741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:25.982788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561811221:5401], now have 1 active actors on pipe
2025-10-10T14:32:25.982985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:25.983001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:25.983025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:25.983029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:25.983050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600909561811221:5401]
2025-10-10T14:32:25.983090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 578 reason: error at write: Disconnected sessionId: src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0
2025-10-10T14:32:25.983294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 578 sessionId: src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0 is DEAD
2025-10-10T14:32:25.983392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:25.983400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0] Write session will restart in 0.009511s
2025-10-10T14:32:25.983425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0] Write session: Do CDS request
2025-10-10T14:32:25.983430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:25.993757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.993833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:25.993852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:25.993877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 579
2025-10-10T14:32:25.993987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:25.994025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:25.994039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:25.994043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:25.994486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 579 sessionId:  describe result for acl check
2025-10-10T14:32:25.994523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:25.994530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:25.994532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:25.994538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600909561811342:5846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:25.995079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600909561811342:5846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:25.995897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:25.996078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:25.996086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:25.996095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:25.996139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:25.996181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600908779600381:4800]
2025-10-10T14:32:25.996668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:25.996874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:25.996904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:25.996919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600909561811342:5846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:25.997137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:25.997182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.997187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.997187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.997188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.997189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.997189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.997190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.997191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.997192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.997192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.997193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.997194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.997194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.997198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.997206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.997208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.997210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.997212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.997215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.997217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.997219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.997221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.997224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.997227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.997229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.997231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.997236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.997241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:25.997246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.997249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:25.997252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.997255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:25.997257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.997261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:25.997265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.997268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:25.997271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.997275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:25.997278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.997281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:25.997284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.997287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:25.997289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.997294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:25.997298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.997308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:25.997317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.997322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.997327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.997343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.997346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.997349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.997370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:25.999443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600909561811342:5846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:25.999456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600909561811342:5846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:25.999460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600909561811342:5846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:25.999467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:25.999514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:25.999808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:25.999819Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:25.999820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:25.999823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:25.999827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 578 [2:7559600908779600381:4800]
2025-10-10T14:32:25.999834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:25.999846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:25.999851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:25.999854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:25.999855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:25.999870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:25.999881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:25.999893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:25.999933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:25.999938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:25.999939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:25.999941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:25.999990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:25.999996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.000003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.000009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.000022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:26.000041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561811376:5846], now have 1 active actors on pipe
2025-10-10T14:32:26.000047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600909561811223:2438], now have 1 active actors on pipe
2025-10-10T14:32:26.000053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600908779600375:4800]
2025-10-10T14:32:26.000059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600908779600375:4800]
2025-10-10T14:32:26.000061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600908779600375:4800]
2025-10-10T14:32:26.000067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:26.000077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:26.000051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 578
2025-10-10T14:32:26.000080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:26.000062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 578
2025-10-10T14:32:26.000083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:26.000084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:26.000090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:26.000093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:26.000106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.000109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.000147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600908779600375:4800]
2025-10-10T14:32:26.000158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:26.000161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:26.000174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:26.000183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.000186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.000187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:26.000195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.000207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:26.000234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.000330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.000336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.000347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.000424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 579 partition: 0 MaxSeqNo: 40 sessionId: src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0
2025-10-10T14:32:26.000715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d8514b-7c70e4ac-7fba0d67-c8f0d21c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:26.003445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0] Write session: try to update token
2025-10-10T14:32:26.003459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:26.016050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId: src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:26.018420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:26.018438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:26.018441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:26.018444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:26.018454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600908779600375:4800]
2025-10-10T14:32:26.018458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600908779600375:4800]
2025-10-10T14:32:26.018463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600908779600375:4800]
2025-10-10T14:32:26.018450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:26.018505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:26.018514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:26.018514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:26.018517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:26.018522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.018525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:26.018661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:26.083001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600913856778679:5401]
2025-10-10T14:32:26.083263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 578, pipe: [1:7559600913856778679:5401]
2025-10-10T14:32:26.123013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:26.123446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.123461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.123499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856778679:5401], now have 1 active actors on pipe
2025-10-10T14:32:26.123679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:26.123687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:26.123727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600913856778679:5401]
2025-10-10T14:32:26.123737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:26.123739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:26.123804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 579 reason: error at write: Disconnected sessionId: src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0
2025-10-10T14:32:26.124033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 579 sessionId: src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0 is DEAD
2025-10-10T14:32:26.124195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:26.124215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0] Write session will restart in 0.005280s
2025-10-10T14:32:26.124233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0] Write session: Do CDS request
2025-10-10T14:32:26.124241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:26.130706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.130873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:26.130885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 580
2025-10-10T14:32:26.131030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.131065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:26.131070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:26.131074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:26.131507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 580 sessionId:  describe result for acl check
2025-10-10T14:32:26.131538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:26.131544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:26.131546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:26.131551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600913856778750:5850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:26.132094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600913856778750:5850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:26.133611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:26.133764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600913856778750:5850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:26.135403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:26.135544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:26.135555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:26.135564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:26.135598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:26.135626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600913074567835:4802]
2025-10-10T14:32:26.135684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600913856778750:5850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:26.135697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600913856778750:5850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:26.135700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600913856778750:5850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:26.135707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:26.136012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:26.136256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:26.136290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:26.136496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:26.136531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.136537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.136537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.136538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.136539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.136539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.136540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.136540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.136541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.136542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.136542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.136543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.136543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.136547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.136555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.136557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.136559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.136562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.136564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.136566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.136568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.136571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.136573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.136575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.136577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.136579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.136584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.136590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.136594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.136597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.136600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.136603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.136605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.136608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.136611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.136614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.136617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.136619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.136622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.136625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.136627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.136630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.136633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.136636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.136639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.136642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.136645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.136648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.136650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.136653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.136656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.136658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.136681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:26.138720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:26.139030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:26.139038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:26.139039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:26.139041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:26.139045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 579 [2:7559600913074567835:4802]
2025-10-10T14:32:26.139053Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:26.139064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:26.139070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.139072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.139074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.139085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:26.139094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:26.139100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:26.139137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.139143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.139144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.139146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:26.139191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:26.139197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.139203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.139209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.139219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:26.139238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856778680:2438], now have 1 active actors on pipe
2025-10-10T14:32:26.139244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856778831:5850], now have 1 active actors on pipe
2025-10-10T14:32:26.139249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600913074567829:4802]
2025-10-10T14:32:26.139254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600913074567829:4802]
2025-10-10T14:32:26.139255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600913074567829:4802]
2025-10-10T14:32:26.139265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:26.139277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:26.139290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:26.139295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:26.139296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:26.139299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:26.139300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:26.139280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 579
2025-10-10T14:32:26.139311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600913074567829:4802]
2025-10-10T14:32:26.139298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 579
2025-10-10T14:32:26.139316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:26.139318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:26.139332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.139349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.139380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bbd8214-81a544f1-b44c052-57f5951f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:26.139390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.139397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.139398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:26.139406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.139418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:26.139446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.139606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.139617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.139640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.139723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 580 partition: 0 MaxSeqNo: 40 sessionId: src_id|5bbd8214-81a544f1-b44c052-57f5951f_0
2025-10-10T14:32:26.140145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f130898e-d5ada0e7-f71a2d92-ebb23211_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5bbd8214-81a544f1-b44c052-57f5951f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:26.142660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbd8214-81a544f1-b44c052-57f5951f_0] Write session: try to update token
2025-10-10T14:32:26.142675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbd8214-81a544f1-b44c052-57f5951f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:26.155374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId: src_id|5bbd8214-81a544f1-b44c052-57f5951f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:26.157610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:26.157627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:26.157631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:26.157633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:26.157642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600913074567829:4802]
2025-10-10T14:32:26.157647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600913074567829:4802]
2025-10-10T14:32:26.157653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600913074567829:4802]
2025-10-10T14:32:26.157706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:26.157710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:26.157715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:26.157719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.157719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:26.157721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:26.157803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:26.157874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:26.223806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600913856778854:5401]
2025-10-10T14:32:26.224054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 579, pipe: [1:7559600913856778854:5401]
2025-10-10T14:32:26.261149Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:26.261562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.261576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.261612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856778854:5401], now have 1 active actors on pipe
2025-10-10T14:32:26.261847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:26.261860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:26.261881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600913856778854:5401]
2025-10-10T14:32:26.261903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:26.261977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 580 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5bbd8214-81a544f1-b44c052-57f5951f_0
2025-10-10T14:32:26.262187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 580 sessionId: src_id|5bbd8214-81a544f1-b44c052-57f5951f_0 is DEAD
2025-10-10T14:32:26.262329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbd8214-81a544f1-b44c052-57f5951f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:26.262338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbd8214-81a544f1-b44c052-57f5951f_0] Write session will restart in 0.008814s
2025-10-10T14:32:26.262355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbd8214-81a544f1-b44c052-57f5951f_0] Write session: Do CDS request
2025-10-10T14:32:26.262360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbd8214-81a544f1-b44c052-57f5951f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:26.271803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbd8214-81a544f1-b44c052-57f5951f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.271811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:26.271827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 581
2025-10-10T14:32:26.271973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.272009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:26.272029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:26.272038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:26.272483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 581 sessionId:  describe result for acl check
2025-10-10T14:32:26.272522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:26.272529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:26.272532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:26.272540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600913856778978:5857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:26.272777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:26.273084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600913856778978:5857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:26.274920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600913856778978:5857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:26.274986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:26.275154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:26.275163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:26.275180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:26.275219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:26.275253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600913074568006:4805]
2025-10-10T14:32:26.275662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:26.275919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:26.275949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:26.276166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:26.276204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.276209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.276210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.276210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.276212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.276212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.276213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.276214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.276214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.276215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.276216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.276216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.276217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.276221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.276229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.276232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.276234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.276236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.276238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.276240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.276242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.276244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.276248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.276250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.276252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.276254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.276259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.276265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.276269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.276272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.276275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.276279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.276281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.276284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.276287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.276290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.276293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.276297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.276299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.276302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.276305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.276308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.276311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.276314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.276316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.276319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.276322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.276325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.276328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.276332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.276334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.276338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.276360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:26.277083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600913856778978:5857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:26.277099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600913856778978:5857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:26.277102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600913856778978:5857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:26.277111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:26.278616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:26.279156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:26.279166Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:26.279167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:26.279180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:26.279186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 580 [2:7559600913074568006:4805]
2025-10-10T14:32:26.279194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:26.279210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:26.279218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.279222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.279233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.279249Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:26.279258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:26.279264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:26.279313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.279318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.279319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.279321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:26.279371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:26.279377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.279384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.279391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.279401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:26.279424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600913074568000:4805]
2025-10-10T14:32:26.279431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600913074568000:4805]
2025-10-10T14:32:26.279434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600913074568000:4805]
2025-10-10T14:32:26.279442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:26.279449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:26.279452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:26.279455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:26.279456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856778855:2438], now have 1 active actors on pipe
2025-10-10T14:32:26.279460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779013:5857], now have 1 active actors on pipe
2025-10-10T14:32:26.279468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:26.279484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:26.279491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:26.279516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600913074568000:4805]
2025-10-10T14:32:26.279508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 580
2025-10-10T14:32:26.279524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 580
2025-10-10T14:32:26.279527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:26.279542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:26.279568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.279575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.279598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57d32812-1e48cb6a-eaee910-84b626c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:26.279608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.279611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.279613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:26.279622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.279636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:26.279651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.279849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.279857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.279870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.279947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 581 partition: 0 MaxSeqNo: 40 sessionId: src_id|57d32812-1e48cb6a-eaee910-84b626c1_0
2025-10-10T14:32:26.280272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbd8214-81a544f1-b44c052-57f5951f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57d32812-1e48cb6a-eaee910-84b626c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:26.282694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d32812-1e48cb6a-eaee910-84b626c1_0] Write session: try to update token
2025-10-10T14:32:26.282709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d32812-1e48cb6a-eaee910-84b626c1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:26.297238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId: src_id|57d32812-1e48cb6a-eaee910-84b626c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:26.299223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:26.299236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:26.299239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:26.299240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:26.299249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600913074568000:4805]
2025-10-10T14:32:26.299253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600913074568000:4805]
2025-10-10T14:32:26.299256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600913074568000:4805]
2025-10-10T14:32:26.299304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:26.299312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:26.299313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:26.299317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:26.299319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.299321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:26.299459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:26.300225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:26.362070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600913856779021:5401]
2025-10-10T14:32:26.362338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 580, pipe: [1:7559600913856779021:5401]
2025-10-10T14:32:26.403289Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:26.403518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.403529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.403567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779021:5401], now have 1 active actors on pipe
2025-10-10T14:32:26.403707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:26.403783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:26.403840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600913856779021:5401]
2025-10-10T14:32:26.403862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:26.403957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 581 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57d32812-1e48cb6a-eaee910-84b626c1_0
2025-10-10T14:32:26.404165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 581 sessionId: src_id|57d32812-1e48cb6a-eaee910-84b626c1_0 is DEAD
2025-10-10T14:32:26.404314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d32812-1e48cb6a-eaee910-84b626c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:26.404337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d32812-1e48cb6a-eaee910-84b626c1_0] Write session will restart in 0.005413s
2025-10-10T14:32:26.404359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d32812-1e48cb6a-eaee910-84b626c1_0] Write session: Do CDS request
2025-10-10T14:32:26.404366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d32812-1e48cb6a-eaee910-84b626c1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:26.410800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d32812-1e48cb6a-eaee910-84b626c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.410851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:26.410864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 582
2025-10-10T14:32:26.410985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.411009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:26.411017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:26.411020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:26.411448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 582 sessionId:  describe result for acl check
2025-10-10T14:32:26.411491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:26.411498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:26.411500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:26.411504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600913856779075:5867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:26.411898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600913856779075:5867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:26.414400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600913856779075:5867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:26.415050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:26.416980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:26.417151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:26.417161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:26.417173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:26.417220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:26.417254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600913074568180:4813]
2025-10-10T14:32:26.417271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600913856779075:5867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:26.417284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600913856779075:5867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:26.417287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600913856779075:5867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:26.417295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:26.417827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:26.418045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:26.418075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:26.418278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:26.418312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.418316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.418317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.418318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.418319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.418319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.418320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.418321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.418321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.418322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.418323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.418323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.418324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.418328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.418335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.418338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.418340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.418343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.418345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.418347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.418349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.418351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.418354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.418356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.418358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.418360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.418365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.418370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.418374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.418378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.418380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.418383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.418387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.418390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.418393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.418396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.418398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.418401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.418404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.418407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.418410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.418413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.418416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.418420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.418423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.418426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.418428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.418431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.418434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.418436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.418439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.418442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.418465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:26.420627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:26.420924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:26.420932Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:26.420933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:26.420937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:26.420941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 581 [2:7559600913074568180:4813]
2025-10-10T14:32:26.420948Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:26.420960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:26.420965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.420968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.420970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.420981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:26.420991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:26.420997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:26.421039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.421044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.421045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.421047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:26.421094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:26.421101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.421107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.421113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.421123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:26.421140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779035:2438], now have 1 active actors on pipe
2025-10-10T14:32:26.421143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779186:5867], now have 1 active actors on pipe
2025-10-10T14:32:26.421161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600913074568174:4813]
2025-10-10T14:32:26.421166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600913074568174:4813]
2025-10-10T14:32:26.421167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600913074568174:4813]
2025-10-10T14:32:26.421175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:26.421185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:26.421184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:26.421187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:26.421189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:26.421175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 581
2025-10-10T14:32:26.421199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:26.421201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:26.421213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 581
2025-10-10T14:32:26.421221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600913074568174:4813]
2025-10-10T14:32:26.421228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:26.421229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:26.421249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.421266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.421290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:26.421299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.421301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.421303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:26.421311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.421319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:26.421341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.421482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.421488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.421500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.421568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 582 partition: 0 MaxSeqNo: 40 sessionId: src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0
2025-10-10T14:32:26.421897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d32812-1e48cb6a-eaee910-84b626c1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:26.424533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0] Write session: try to update token
2025-10-10T14:32:26.424549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:26.438299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId: src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:26.439273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:26.439285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:26.439287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:26.439288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:26.439295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600913074568174:4813]
2025-10-10T14:32:26.439298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600913074568174:4813]
2025-10-10T14:32:26.439301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600913074568174:4813]
2025-10-10T14:32:26.439347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:26.439352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:26.439357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.439358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:26.439359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:26.439363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:26.439481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:26.441039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:26.503890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600913856779210:5401]
2025-10-10T14:32:26.504190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 581, pipe: [1:7559600913856779210:5401]
2025-10-10T14:32:26.543130Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:26.543424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.543435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.543472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779210:5401], now have 1 active actors on pipe
2025-10-10T14:32:26.543668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:26.543712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600913856779210:5401]
2025-10-10T14:32:26.543747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:26.544172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:26.544248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 582 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0
2025-10-10T14:32:26.544423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 582 sessionId: src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0 is DEAD
2025-10-10T14:32:26.544615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:26.544625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0] Write session will restart in 0.005206s
2025-10-10T14:32:26.544643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0] Write session: Do CDS request
2025-10-10T14:32:26.544648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:26.550869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.550938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:26.550953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 583
2025-10-10T14:32:26.551097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.551133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:26.551143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:26.551147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:26.551668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 583 sessionId:  describe result for acl check
2025-10-10T14:32:26.551702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:26.551709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:26.551710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:26.551717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600913856779255:5874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:26.552246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600913856779255:5874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:26.554606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600913856779255:5874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:26.555333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:26.557119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:26.557302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:26.557312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:26.557321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:26.557374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:26.557405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600913074568367:4822]
2025-10-10T14:32:26.557668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600913856779255:5874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:26.557680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600913856779255:5874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:26.557683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600913856779255:5874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:26.557689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:26.557873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:26.558151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:26.558206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:26.558444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:26.558483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.558488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.558489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.558489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.558490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.558491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.558492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.558492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.558493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.558494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.558494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.558495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.558496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.558500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.558508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.558511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.558513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.558515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.558517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.558519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.558521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.558523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.558526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.558527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.558529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.558531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.558538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.558544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.558548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.558551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.558554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.558556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.558559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.558562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.558564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.558567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.558570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.558573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.558575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.558578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.558580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.558583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.558586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.558589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.558592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.558595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.558597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.558600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.558603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.558606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.558609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.558612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.558633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:26.560749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:26.561075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:26.561085Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:26.561088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:26.561091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:26.561096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 582 [2:7559600913074568367:4822]
2025-10-10T14:32:26.561108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:26.561127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:26.561134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.561137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.561139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.561154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:26.561165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:26.561176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:26.561403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.561411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.561412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.561415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:26.561480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:26.561488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.561500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.561513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.561531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:26.561565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779368:5874], now have 1 active actors on pipe
2025-10-10T14:32:26.561573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779211:2438], now have 1 active actors on pipe
2025-10-10T14:32:26.561580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600913074568361:4822]
2025-10-10T14:32:26.561582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600913074568361:4822]
2025-10-10T14:32:26.561584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600913074568361:4822]
2025-10-10T14:32:26.561598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:26.561595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 582
2025-10-10T14:32:26.561611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:26.561597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 582
2025-10-10T14:32:26.561623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:26.561630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:26.561631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:26.561633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:26.561633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:26.561654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600913074568361:4822]
2025-10-10T14:32:26.561661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:26.561663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:26.561681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.561689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.561731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:26.561743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.561747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.561754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:26.561764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.561778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:26.561801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.561945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.561952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.561967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.562073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 583 partition: 0 MaxSeqNo: 40 sessionId: src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0
2025-10-10T14:32:26.562417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09b7579-d1355dd-9af93bdb-f32c4c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:26.564818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0] Write session: try to update token
2025-10-10T14:32:26.564831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:26.577123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId: src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:26.579703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:26.579784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:26.579798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:26.579801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:26.579803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:26.579812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600913074568361:4822]
2025-10-10T14:32:26.579817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600913074568361:4822]
2025-10-10T14:32:26.579821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600913074568361:4822]
2025-10-10T14:32:26.579859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:26.579868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:26.579872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.579879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:26.579880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.579901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:26.579908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.579915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:26.580036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:26.643671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600913856779386:5401]
2025-10-10T14:32:26.644008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 582, pipe: [1:7559600913856779386:5401]
2025-10-10T14:32:26.696432Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:26.696790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779386:5401], now have 1 active actors on pipe
2025-10-10T14:32:26.696990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:26.697027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600913856779386:5401]
2025-10-10T14:32:26.697052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:26.697054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:26.697056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:26.697118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 583 reason: error at write: Disconnected sessionId: src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0
2025-10-10T14:32:26.697325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 583 sessionId: src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0 is DEAD
2025-10-10T14:32:26.697516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:26.697524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0] Write session will restart in 0.007216s
2025-10-10T14:32:26.697541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0] Write session: Do CDS request
2025-10-10T14:32:26.697546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:26.705691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.705812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:26.705826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 584
2025-10-10T14:32:26.705949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.705974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:26.705981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:26.705984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:26.706417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 584 sessionId:  describe result for acl check
2025-10-10T14:32:26.706468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:26.706475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:26.706476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:26.706482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600913856779471:5880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:26.707000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600913856779471:5880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:26.708745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:26.708977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600913856779471:5880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:26.710597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:26.710795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:26.710804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:26.710816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:26.710869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:26.710908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600913074568532:4825]
2025-10-10T14:32:26.711215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600913856779471:5880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:26.711228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600913856779471:5880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:26.711231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600913856779471:5880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:26.711238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:26.711506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:26.711748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:26.711785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:26.712089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:26.712137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.712142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.712143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.712145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.712146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.712147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.712148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.712149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.712150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.712151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.712152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.712154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.712155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.712160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.712172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.712177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.712181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.712184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.712189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.712197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.712201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.712209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.712213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.712218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.712221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.712225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.712232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.712240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.712250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.712256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.712264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.712273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.712282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.712287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.712291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.712301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.712305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.712314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.712321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.712329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.712337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.712344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.712352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.712357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.712365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.712370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.712378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.712383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.712391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.712400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.712409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.712418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.712460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:26.714640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:26.715063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:26.715073Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:26.715074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:26.715076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:26.715080Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 583 [2:7559600913074568532:4825]
2025-10-10T14:32:26.715087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:26.715099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:26.715102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.715105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.715107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.715123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:26.715137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:26.715144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:26.715193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.715200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.715202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.715204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:26.715263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:26.715270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.715282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.715294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.715316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:26.715337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779541:5880], now have 1 active actors on pipe
2025-10-10T14:32:26.715344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779387:2438], now have 1 active actors on pipe
2025-10-10T14:32:26.715351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600913074568526:4825]
2025-10-10T14:32:26.715357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600913074568526:4825]
2025-10-10T14:32:26.715360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600913074568526:4825]
2025-10-10T14:32:26.715374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:26.715367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 583
2025-10-10T14:32:26.715374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 583
2025-10-10T14:32:26.715390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:26.715401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:26.715409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:26.715410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:26.715411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:26.715413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:26.715443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.715452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.715470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600913074568526:4825]
2025-10-10T14:32:26.715481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:26.715498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:26.715506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:26.715513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.715516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.715518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:26.715527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.715541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:26.715559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.715715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.715722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.715736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.715839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 584 partition: 0 MaxSeqNo: 40 sessionId: src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0
2025-10-10T14:32:26.716115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287cc10-8a99f3ab-9e165bbb-3b17c430_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:26.718689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0] Write session: try to update token
2025-10-10T14:32:26.718706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:26.732116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId: src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:26.733520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:26.733534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:26.733537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:26.733539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:26.733548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600913074568526:4825]
2025-10-10T14:32:26.733552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600913074568526:4825]
2025-10-10T14:32:26.733556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600913074568526:4825]
2025-10-10T14:32:26.733591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:26.733597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:26.733600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:26.733601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:26.733607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.733609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:26.733741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:26.734553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:26.797249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600913856779552:5401]
2025-10-10T14:32:26.797543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 583, pipe: [1:7559600913856779552:5401]
2025-10-10T14:32:26.849510Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:26.849797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.849810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.849848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779552:5401], now have 1 active actors on pipe
2025-10-10T14:32:26.850013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:26.850109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:26.850117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600913856779552:5401]
2025-10-10T14:32:26.850137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:26.850140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:26.850205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 584 reason: error at write: Disconnected sessionId: src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0
2025-10-10T14:32:26.850372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 584 sessionId: src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0 is DEAD
2025-10-10T14:32:26.850503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:26.850509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0] Write session will restart in 0.009915s
2025-10-10T14:32:26.850527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0] Write session: Do CDS request
2025-10-10T14:32:26.850535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:26.861247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:26.861889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.861907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:26.861922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 585
2025-10-10T14:32:26.862076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:26.862103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:26.862111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:26.862115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:26.862549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 585 sessionId:  describe result for acl check
2025-10-10T14:32:26.862593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:26.862602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:26.862605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:26.862611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600913856779680:5884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:26.863157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600913856779680:5884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:26.863728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:26.863900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:26.863909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:26.863919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:26.863961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:26.863991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600913074568696:4827]
2025-10-10T14:32:26.864410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:26.864676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:26.864724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:26.864980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:26.865016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.865022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.865023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.865024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.865025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.865025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.865026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.865027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.865027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.865028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.865029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.865029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.865030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.865034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.865042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.865044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.865047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.865049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.865051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.865053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.865056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.865058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.865061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.865063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.865065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.865068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.865072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.865078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:26.865083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.865086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:26.865089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.865092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:26.865094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.865128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600913856779680:5884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:26.865098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:26.865100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.865103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:26.865106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.865109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:26.865112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.865115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:26.865117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.865120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:26.865123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.865126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:26.865129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.865132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:26.865134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.865138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.865141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.865144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.865147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.865150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.865172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:26.867167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600913856779680:5884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:26.867179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600913856779680:5884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:26.867182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600913856779680:5884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:26.867188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:26.867310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:26.867595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:26.867604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:26.867605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:26.867608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:26.867612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 584 [2:7559600913074568696:4827]
2025-10-10T14:32:26.867620Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:26.867632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:26.867633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.867635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.867637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.867650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:26.867659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:26.867665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:26.867705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.867710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.867711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.867713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:26.867770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:26.867775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.867782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:26.867788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:26.867801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:26.867820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779716:5884], now have 1 active actors on pipe
2025-10-10T14:32:26.867826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779554:2438], now have 1 active actors on pipe
2025-10-10T14:32:26.867831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600913074568690:4827]
2025-10-10T14:32:26.867832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600913074568690:4827]
2025-10-10T14:32:26.867834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600913074568690:4827]
2025-10-10T14:32:26.867844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:26.867854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:26.867863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:26.867868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:26.867869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:26.867871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:26.867873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:26.867887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600913074568690:4827]
2025-10-10T14:32:26.867889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:26.867869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 584
2025-10-10T14:32:26.867886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 584
2025-10-10T14:32:26.867905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:26.867909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.867913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.867936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9287a682-c80d79e0-c4062d11-e2454a47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:26.867945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:26.867948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:26.867949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:26.867957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:26.867964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:26.867991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.868100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.868106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.868117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:26.868207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 585 partition: 0 MaxSeqNo: 40 sessionId: src_id|9287a682-c80d79e0-c4062d11-e2454a47_0
2025-10-10T14:32:26.868484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ed7d8-1db19291-c2e6f1aa-64fc9ea7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9287a682-c80d79e0-c4062d11-e2454a47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:26.871060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9287a682-c80d79e0-c4062d11-e2454a47_0] Write session: try to update token
2025-10-10T14:32:26.871078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9287a682-c80d79e0-c4062d11-e2454a47_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:26.886194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:26.886208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:26.886210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:26.886211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:26.886219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600913074568690:4827]
2025-10-10T14:32:26.886222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600913074568690:4827]
2025-10-10T14:32:26.886225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600913074568690:4827]
2025-10-10T14:32:26.886261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:26.886268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:26.886270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:26.886272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:26.886279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:26.886283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:26.886391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:26.886705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId: src_id|9287a682-c80d79e0-c4062d11-e2454a47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:26.889522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:26.950619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600913856779724:5401]
2025-10-10T14:32:26.950945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 584, pipe: [1:7559600913856779724:5401]
2025-10-10T14:32:26.991952Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:26.992156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:26.992168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:26.992211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779724:5401], now have 1 active actors on pipe
2025-10-10T14:32:26.992375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:26.992425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:26.992440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:26.992446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:26.992479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600913856779724:5401]
2025-10-10T14:32:26.992508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 585 reason: error at write: Disconnected sessionId: src_id|9287a682-c80d79e0-c4062d11-e2454a47_0
2025-10-10T14:32:26.992738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 585 sessionId: src_id|9287a682-c80d79e0-c4062d11-e2454a47_0 is DEAD
2025-10-10T14:32:26.992871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287a682-c80d79e0-c4062d11-e2454a47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:26.992883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287a682-c80d79e0-c4062d11-e2454a47_0] Write session will restart in 0.009661s
2025-10-10T14:32:26.992907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287a682-c80d79e0-c4062d11-e2454a47_0] Write session: Do CDS request
2025-10-10T14:32:26.992914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287a682-c80d79e0-c4062d11-e2454a47_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:27.003309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:27.003904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9287a682-c80d79e0-c4062d11-e2454a47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.003999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:27.004015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 586
2025-10-10T14:32:27.004141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.004176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:27.004186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:27.004189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:27.004516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 586 sessionId:  describe result for acl check
2025-10-10T14:32:27.004541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:27.004546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:27.004547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:27.004553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600918151747148:5888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:27.004953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600918151747148:5888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:27.005146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:27.005293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:27.005302Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:27.005311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:27.005366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:27.005396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600917369536157:4829]
2025-10-10T14:32:27.005789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:27.006068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:27.006101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:27.006318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:27.006354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.006359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.006360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.006361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.006361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.006362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.006363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.006364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.006364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.006365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.006365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.006366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.006367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.006371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.006378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.006380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.006383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.006385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.006387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.006389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.006392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.006394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.006396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.006398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.006400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.006402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.006408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.006413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.006417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.006420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.006424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.006428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.006430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.006433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.006436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.006439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.006441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.006444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.006447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.006449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.006452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.006455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.006457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.006460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.006463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.006466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.006469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.006472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.006474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.006478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.006480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.006483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.006504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:27.006741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600918151747148:5888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:27.008505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:27.008909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:27.008925Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:27.008926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:27.008928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:27.008932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 585 [2:7559600917369536157:4829]
2025-10-10T14:32:27.008940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:27.008950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:27.008956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.008958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.008960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.008971Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:27.008980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:27.008985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:27.009024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.009029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.009031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.009032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:27.009078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:27.009084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.009095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.009108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.009129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:27.009154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600913856779725:2438], now have 1 active actors on pipe
2025-10-10T14:32:27.009164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600917369536151:4829]
2025-10-10T14:32:27.009144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600918151747148:5888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:27.009153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 585
2025-10-10T14:32:27.009165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600917369536151:4829]
2025-10-10T14:32:27.009159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600918151747148:5888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:27.009162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600918151747148:5888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:27.009167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600917369536151:4829]
2025-10-10T14:32:27.009168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:27.009173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:27.009182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:27.009183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:27.009186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:27.009188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:27.009192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:27.009194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:27.009216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600917369536151:4829]
2025-10-10T14:32:27.009232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:27.009239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:27.009306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747182:5888], now have 1 active actors on pipe
2025-10-10T14:32:27.009340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 585
2025-10-10T14:32:27.009378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.009385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.009405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:27.009414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.009417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.009418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:27.009426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.009438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:27.009449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.009564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.009569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.009579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.009639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 586 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0
2025-10-10T14:32:27.009907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9287a682-c80d79e0-c4062d11-e2454a47_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:27.013085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0] Write session: try to update token
2025-10-10T14:32:27.013105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:27.027518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:27.027533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.027536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:27.027537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:27.027544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600917369536151:4829]
2025-10-10T14:32:27.027548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600917369536151:4829]
2025-10-10T14:32:27.027551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600917369536151:4829]
2025-10-10T14:32:27.027587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:27.027589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:27.027592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.027594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:27.027596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:27.027599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:27.027721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:27.029289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId: src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:27.031863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:27.092693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600918151747190:5401]
2025-10-10T14:32:27.092965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 585, pipe: [1:7559600918151747190:5401]
2025-10-10T14:32:27.131000Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:27.131297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.131309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.131347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747190:5401], now have 1 active actors on pipe
2025-10-10T14:32:27.131505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:27.131598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:27.131604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:27.131622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:27.131642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600918151747190:5401]
2025-10-10T14:32:27.131692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 586 reason: error at write: Disconnected sessionId: src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0
2025-10-10T14:32:27.131916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 586 sessionId: src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0 is DEAD
2025-10-10T14:32:27.132044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:27.132051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0] Write session will restart in 0.005785s
2025-10-10T14:32:27.132084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0] Write session: Do CDS request
2025-10-10T14:32:27.132093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:27.138824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.138944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:27.138955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 587
2025-10-10T14:32:27.139094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.139134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:27.139143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:27.139147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:27.139658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 587 sessionId:  describe result for acl check
2025-10-10T14:32:27.139698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:27.139706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:27.139708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:27.139713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600918151747250:5892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:27.140249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600918151747250:5892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:27.142243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600918151747250:5892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:27.142268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:27.143925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:27.144101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:27.144111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:27.144122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:27.144182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:27.144219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600917369536322:4831]
2025-10-10T14:32:27.144290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600918151747250:5892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:27.144299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600918151747250:5892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:27.144302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600918151747250:5892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:27.144307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:27.144839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:27.145070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:27.145105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:27.145422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:27.145470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.145475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.145477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.145478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.145479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.145480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.145481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.145482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.145483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.145484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.145486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.145486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.145488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.145492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.145505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.145509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.145513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.145517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.145521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.145525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.145529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.145533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.145537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.145541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.145545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.145549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.145555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.145563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.145569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.145575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.145579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.145584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.145589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.145594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.145601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.145606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.145610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.145615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.145620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.145630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.145634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.145639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.145647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.145652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.145658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.145664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.145668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.145674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.145684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.145689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.145698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.145703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.145741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:27.147868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:27.148198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:27.148209Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:27.148211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:27.148214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:27.148219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 586 [2:7559600917369536322:4831]
2025-10-10T14:32:27.148230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:27.148245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:27.148252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.148256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.148258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.148273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:27.148282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:27.148294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:27.148345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.148352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.148354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.148356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:27.148416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:27.148423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.148433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.148446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.148467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:27.148492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747191:2438], now have 1 active actors on pipe
2025-10-10T14:32:27.148500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747348:5892], now have 1 active actors on pipe
2025-10-10T14:32:27.148506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600917369536316:4831]
2025-10-10T14:32:27.148495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 586
2025-10-10T14:32:27.148509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600917369536316:4831]
2025-10-10T14:32:27.148496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 586
2025-10-10T14:32:27.148511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600917369536316:4831]
2025-10-10T14:32:27.148523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:27.148537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:27.148537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:27.148540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:27.148542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:27.148557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:27.148560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:27.148596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.148604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.148618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600917369536316:4831]
2025-10-10T14:32:27.148629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:27.148644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:27.148657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:27.148664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.148672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.148674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:27.148684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.148693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:27.148715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.148848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.148858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.148888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.148968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 587 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0
2025-10-10T14:32:27.149231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3fff86-9f69045a-a45f2b02-41701e71_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:27.152003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0] Write session: try to update token
2025-10-10T14:32:27.152016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:27.164754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId: src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:27.167215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:27.167449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.167473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.167498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:27.167501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.167504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:27.167506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:27.167515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600917369536316:4831]
2025-10-10T14:32:27.167519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600917369536316:4831]
2025-10-10T14:32:27.167523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600917369536316:4831]
2025-10-10T14:32:27.167554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:27.167559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:27.167561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:27.167580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:27.167590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.167593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:27.167726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:27.231939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600918151747372:5401]
2025-10-10T14:32:27.232201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 586, pipe: [1:7559600918151747372:5401]
2025-10-10T14:32:27.278427Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:27.278953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:27.279008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747372:5401], now have 1 active actors on pipe
2025-10-10T14:32:27.279081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:27.279204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:27.279266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600918151747372:5401]
2025-10-10T14:32:27.287778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:27.287790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:27.287818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 587 reason: error at write: Disconnected sessionId: src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0
2025-10-10T14:32:27.287975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 587 sessionId: src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0 is DEAD
2025-10-10T14:32:27.288123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:27.288133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0] Write session will restart in 0.009709s
2025-10-10T14:32:27.288160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0] Write session: Do CDS request
2025-10-10T14:32:27.288165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:27.295599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:27.297750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:27.297993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:27.298001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:27.298012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:27.298060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:27.298130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600917369536501:4834]
2025-10-10T14:32:27.298573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:27.298881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.298915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:27.298951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:27.298947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:27.298968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 588
2025-10-10T14:32:27.299132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.299162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:27.299172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:27.299180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:27.299176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:27.299214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.299219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.299219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.299220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.299221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.299222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.299223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.299223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.299224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.299225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.299225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.299226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.299227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.299231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.299240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.299243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.299245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.299247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.299249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.299251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.299254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.299256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.299258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.299260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.299262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.299264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.299270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.299276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.299288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.299292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.299295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.299299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.299302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.299305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.299309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.299312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.299315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.299318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.299320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.299323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.299326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.299329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.299331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.299334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.299337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.299340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.299343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.299345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.299348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.299351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.299353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.299357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.299381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:27.299592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 588 sessionId:  describe result for acl check
2025-10-10T14:32:27.299622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:27.299628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:27.299630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:27.299636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600918151747506:5897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:27.300369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600918151747506:5897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:27.301679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:27.302277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:27.302291Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:27.302293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:27.302298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:27.302304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 587 [2:7559600917369536501:4834]
2025-10-10T14:32:27.302318Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:27.302337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:27.302347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.302351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.302353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.302368Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:27.302383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:27.302396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:27.302467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.302476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.302478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.302480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:27.302551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:27.302559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.302556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600918151747506:5897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:27.302573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.302588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.302609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:27.302621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 587
2025-10-10T14:32:27.302633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747373:2438], now have 1 active actors on pipe
2025-10-10T14:32:27.302643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600917369536496:4834]
2025-10-10T14:32:27.302645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600917369536496:4834]
2025-10-10T14:32:27.302646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600917369536496:4834]
2025-10-10T14:32:27.302656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:27.302665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:27.302668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:27.302670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:27.302672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:27.302682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:27.302688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:27.302713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600917369536496:4834]
2025-10-10T14:32:27.302722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:27.302727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:27.307461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600918151747506:5897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:27.307472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600918151747506:5897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:27.307474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600918151747506:5897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:27.307481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:27.307698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747538:5897], now have 1 active actors on pipe
2025-10-10T14:32:27.307719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 587
2025-10-10T14:32:27.307802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.307815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.307847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:27.307862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.307870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.307873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:27.307887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.307908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:27.307929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.308058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.308068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.308083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.308148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 588 partition: 0 MaxSeqNo: 40 sessionId: src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0
2025-10-10T14:32:27.308487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9d004-1e7fd347-fc01b03e-56a7e941_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:27.311071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0] Write session: try to update token
2025-10-10T14:32:27.311089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:27.313561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:27.313574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.313583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600917369536496:4834]
2025-10-10T14:32:27.313626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:27.313627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:27.313801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:27.313944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.314085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.314228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.314420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:27.314454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:27.323942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId: src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:27.326440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:27.326614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.326635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.326676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:27.326749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:27.330833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:27.330847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.330849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:27.330850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:27.330859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600917369536496:4834]
2025-10-10T14:32:27.330861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600917369536496:4834]
2025-10-10T14:32:27.330864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600917369536496:4834]
2025-10-10T14:32:27.330898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:27.330899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:27.330904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:27.330907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:27.330908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.330910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:27.331026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:27.379389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600918151747543:5401]
2025-10-10T14:32:27.379641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 587, pipe: [1:7559600918151747543:5401]
2025-10-10T14:32:27.434598Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:27.441815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.441836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.441989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.442053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.442112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.442173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.442214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.442224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.442292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.442346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.442414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.442481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.442525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.442531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.442589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.442645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.442701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.442760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.442819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.442827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.442899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.442966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.443030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.443098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.443141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.443147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.443215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.443275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.443343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.443407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.443455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.443462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.443535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.443604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.443672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.443734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.443776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.443783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.443846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.443905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.443973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.444036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.444081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.444088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.444151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.444211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.444274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.444337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.444376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.444381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.444442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.444499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.444555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.444608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.444648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.444653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.444711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.444763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.444818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.444873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.444913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.444919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.444971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747543:5401], now have 1 active actors on pipe
2025-10-10T14:32:27.445194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600918151747543:5401]
2025-10-10T14:32:27.445215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:27.445262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:27.445267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:27.445293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 588 reason: error at write: Disconnected sessionId: src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0
2025-10-10T14:32:27.445478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 588 sessionId: src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0 is DEAD
2025-10-10T14:32:27.445618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:27.445630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0] Write session will restart in 0.007841s
2025-10-10T14:32:27.445654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0] Write session: Do CDS request
2025-10-10T14:32:27.445660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:27.445766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:27.454892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.454949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:27.454961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 589
2025-10-10T14:32:27.455118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.455145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:27.455148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:27.455151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:27.455453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 589 sessionId:  describe result for acl check
2025-10-10T14:32:27.455481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:27.455488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:27.455490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:27.455496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600918151747669:5907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:27.455934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600918151747669:5907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:27.457012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:27.458511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600918151747669:5907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:27.459286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:27.459464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:27.459474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:27.459486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:27.459537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:27.459574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600917369536681:4842]
2025-10-10T14:32:27.460176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:27.460429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:27.460468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:27.460774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:27.460801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600918151747669:5907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:27.460811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600918151747669:5907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:27.460813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600918151747669:5907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:27.460819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:27.460829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.460836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.460837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.460838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.460839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.460840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.460842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.460843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.460844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.460845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.460846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.460847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.460848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.460853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.460865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.460869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.460872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.460876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.460881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.460884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.460888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.460892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.460897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.460901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.460904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.460908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.460915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.460927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.460938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.460943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.460948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.460953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.460962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.460967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.460976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.460985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.460993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.460999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.461008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.461018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.461026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.461031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.461039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.461046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.461054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.461060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.461068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.461074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.461078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.461083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.461088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.461093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.461139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:27.463382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:27.463687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:27.463699Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:27.463702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:27.463705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:27.463710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 588 [2:7559600917369536681:4842]
2025-10-10T14:32:27.463721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:27.463738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:27.463743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.463751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.463753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.463768Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:27.463779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:27.463790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:27.463840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.463847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.463848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.463851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:27.463914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:27.463921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.463932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.463942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.463962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:27.463988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747557:2438], now have 1 active actors on pipe
2025-10-10T14:32:27.463996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747717:5907], now have 1 active actors on pipe
2025-10-10T14:32:27.464003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600917369536676:4842]
2025-10-10T14:32:27.464010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600917369536676:4842]
2025-10-10T14:32:27.464011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600917369536676:4842]
2025-10-10T14:32:27.464026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:27.464008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 588
2025-10-10T14:32:27.464035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:27.464040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 588
2025-10-10T14:32:27.464043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:27.464044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:27.464045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:27.464061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:27.464069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:27.464102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.464111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.464127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600917369536676:4842]
2025-10-10T14:32:27.464139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:27.464148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:27.464172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45b0d4d-b061801c-7da8767c-15d8a664_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:27.464183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.464191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.464193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:27.464205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.464219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:27.464243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.464372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.464381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.464395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.464487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 589 partition: 0 MaxSeqNo: 40 sessionId: src_id|45b0d4d-b061801c-7da8767c-15d8a664_0
2025-10-10T14:32:27.464786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ca16e0-e1a24ee4-41db59b9-27484fcb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45b0d4d-b061801c-7da8767c-15d8a664_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:27.467284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45b0d4d-b061801c-7da8767c-15d8a664_0] Write session: try to update token
2025-10-10T14:32:27.467300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45b0d4d-b061801c-7da8767c-15d8a664_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:27.479762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId: src_id|45b0d4d-b061801c-7da8767c-15d8a664_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:27.482074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:27.482889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.482911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.482935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:27.482938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.482941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:27.482943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:27.482950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600917369536676:4842]
2025-10-10T14:32:27.482955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600917369536676:4842]
2025-10-10T14:32:27.482958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600917369536676:4842]
2025-10-10T14:32:27.483004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:27.483014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:27.483017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:27.483021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:27.483022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.483024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:27.483139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:27.545274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600918151747739:5401]
2025-10-10T14:32:27.545579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 588, pipe: [1:7559600918151747739:5401]
2025-10-10T14:32:27.587848Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:27.588207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:27.588260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747739:5401], now have 1 active actors on pipe
2025-10-10T14:32:27.588347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:27.588453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:27.588506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600918151747739:5401]
2025-10-10T14:32:27.596998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:27.597009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:27.597029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 589 reason: error at write: Disconnected sessionId: src_id|45b0d4d-b061801c-7da8767c-15d8a664_0
2025-10-10T14:32:27.597170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 589 sessionId: src_id|45b0d4d-b061801c-7da8767c-15d8a664_0 is DEAD
2025-10-10T14:32:27.597364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b0d4d-b061801c-7da8767c-15d8a664_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:27.597376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b0d4d-b061801c-7da8767c-15d8a664_0] Write session will restart in 0.006603s
2025-10-10T14:32:27.597403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b0d4d-b061801c-7da8767c-15d8a664_0] Write session: Do CDS request
2025-10-10T14:32:27.597409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b0d4d-b061801c-7da8767c-15d8a664_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:27.603043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:27.604779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:27.604833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45b0d4d-b061801c-7da8767c-15d8a664_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.604914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:27.604926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 590
2025-10-10T14:32:27.604955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:27.604966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:27.604977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:27.605026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.605032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:27.605049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:27.605057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:27.605061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:27.605070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600917369536876:4851]
2025-10-10T14:32:27.605388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 590 sessionId:  describe result for acl check
2025-10-10T14:32:27.605411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:27.605416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:27.605417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:27.605421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600918151747878:5916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:27.605628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:27.605864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600918151747878:5916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:27.605924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:27.605973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:27.606234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:27.606291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.606297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.606298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.606300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.606301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.606302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.606303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.606304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.606305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.606306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.606307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.606308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.606309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.606314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.606325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.606328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.606333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.606336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.606340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.606348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.606351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.606354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.606358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.606362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.606369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.606373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.606386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.606398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.606408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.606414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.606423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.606432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.606440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.606449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.606457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.606462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.606470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.606474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.606478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.606483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.606490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.606495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.606505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.606511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.606515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.606520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.606525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.606530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.606533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.606536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.606542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.606545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.606572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:27.608098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600918151747878:5916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:27.608689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:27.609015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:27.609031Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:27.609034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:27.609038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:27.609043Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 589 [2:7559600917369536876:4851]
2025-10-10T14:32:27.609054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:27.609070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:27.609078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.609082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.609084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.609101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:27.609114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:27.609121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:27.609170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.609178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.609181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.609187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:27.609251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:27.609257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.609264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.609272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.609282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:27.609303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747747:2438], now have 1 active actors on pipe
2025-10-10T14:32:27.609315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600917369536871:4851]
2025-10-10T14:32:27.609322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600917369536871:4851]
2025-10-10T14:32:27.609324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600917369536871:4851]
2025-10-10T14:32:27.609353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:27.609372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:27.609371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:27.609374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:27.609376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:27.609392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:27.609400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:27.609380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 589
2025-10-10T14:32:27.609425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600917369536871:4851]
2025-10-10T14:32:27.609437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:27.609444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:27.614134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600918151747878:5916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:27.614149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600918151747878:5916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:27.614153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600918151747878:5916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:27.614161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:27.614426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747914:5916], now have 1 active actors on pipe
2025-10-10T14:32:27.614490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 589
2025-10-10T14:32:27.614555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.614568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.614608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95e15396-e043343e-b0716b3d-3343845e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:27.614625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.614636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.614643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:27.614658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.614678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:27.614701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.614901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.614915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.614943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.615033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 590 partition: 0 MaxSeqNo: 40 sessionId: src_id|95e15396-e043343e-b0716b3d-3343845e_0
2025-10-10T14:32:27.615399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45b0d4d-b061801c-7da8767c-15d8a664_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|95e15396-e043343e-b0716b3d-3343845e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:27.618378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e15396-e043343e-b0716b3d-3343845e_0] Write session: try to update token
2025-10-10T14:32:27.618393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e15396-e043343e-b0716b3d-3343845e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:27.626150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:27.626168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.626179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600917369536871:4851]
2025-10-10T14:32:27.626231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:27.626250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:27.626412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:27.626555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.626699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.626848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.627044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:27.627093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:27.632096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId: src_id|95e15396-e043343e-b0716b3d-3343845e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:27.634447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:27.634643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.634672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.634712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:27.634785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:27.637157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:27.637173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.637176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:27.637178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:27.637189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600917369536871:4851]
2025-10-10T14:32:27.637193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600917369536871:4851]
2025-10-10T14:32:27.637197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600917369536871:4851]
2025-10-10T14:32:27.637237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:27.637241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:27.637250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.637250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:27.637253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:27.637255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:27.637400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:27.688636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600918151747921:5401]
2025-10-10T14:32:27.688860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 589, pipe: [1:7559600918151747921:5401]
2025-10-10T14:32:27.743596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:27.750759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.750779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.750955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.751015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.751076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.751135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.751343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.751350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.751421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.751487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.751543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.751606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.751645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.751654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.751713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.751777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.751835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.751892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.751933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.751938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.751999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.752056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.752115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.752171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.752210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.752215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.752277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.752331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.752388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.752445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.752485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.752491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.752558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.752625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.752681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.752740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.752783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.752788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.752847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.752900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.752962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.753018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.753057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.753064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.753121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.753176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.753232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.753291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.753345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.753351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.753416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.753471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.753527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.753585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.753625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.753630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.753689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.753744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.753800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.753855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.753897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.753902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.753944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747921:5401], now have 1 active actors on pipe
2025-10-10T14:32:27.754205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:27.754213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600918151747921:5401]
2025-10-10T14:32:27.754240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:27.754242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:27.754269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 590 reason: error at write: Disconnected sessionId: src_id|95e15396-e043343e-b0716b3d-3343845e_0
2025-10-10T14:32:27.754425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:27.754455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 590 sessionId: src_id|95e15396-e043343e-b0716b3d-3343845e_0 is DEAD
2025-10-10T14:32:27.754604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e15396-e043343e-b0716b3d-3343845e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:27.754615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e15396-e043343e-b0716b3d-3343845e_0] Write session will restart in 0.009568s
2025-10-10T14:32:27.754640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e15396-e043343e-b0716b3d-3343845e_0] Write session: Do CDS request
2025-10-10T14:32:27.754646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e15396-e043343e-b0716b3d-3343845e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:27.765743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:27.765804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e15396-e043343e-b0716b3d-3343845e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.765917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:27.765943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 591
2025-10-10T14:32:27.766071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.766104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:27.766116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:27.766133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:27.766567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 591 sessionId:  describe result for acl check
2025-10-10T14:32:27.766605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:27.766610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:27.766612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:27.766618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600918151748055:5920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:27.767177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600918151748055:5920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:27.767402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:27.767564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:27.767575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:27.767587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:27.767635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:27.767673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600917369537045:4854]
2025-10-10T14:32:27.768283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:27.768549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:27.768586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:27.768888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:27.768940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.768945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.768946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.768948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.768949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.768950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.768951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.768952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.768954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.768955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.768956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.768957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.768958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.768963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.768975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.768980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.768984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.768988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.768992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.768996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.769000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.769004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.769008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.769016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.769020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.769028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.769035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.769048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.769058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.769068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.769076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.769081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.769090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.769095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.769104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.769114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.769123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.769128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.769132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.769137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.769145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.769151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.769159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.769164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.769173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.769178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.769182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.769189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.769196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.769201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.769209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.769215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.769257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:27.769890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600918151748055:5920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:27.771344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:27.771755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:27.771767Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:27.771769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:27.771772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:27.771779Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 590 [2:7559600917369537045:4854]
2025-10-10T14:32:27.771791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:27.771806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:27.771813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.771816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.771819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.771838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:27.771850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:27.771861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:27.771915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.771922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.771923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.771925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:27.771984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:27.771991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.772002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.772019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.772040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:27.772063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151747923:2438], now have 1 active actors on pipe
2025-10-10T14:32:27.772051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 590
2025-10-10T14:32:27.772074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600917369537039:4854]
2025-10-10T14:32:27.772073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600918151748055:5920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:27.772081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600917369537039:4854]
2025-10-10T14:32:27.772079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600918151748055:5920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:27.772083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600917369537039:4854]
2025-10-10T14:32:27.772082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600918151748055:5920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:27.772089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:27.772092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:27.772100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:27.772106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:27.772108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:27.772109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:27.772125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:27.772128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:27.772153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600917369537039:4854]
2025-10-10T14:32:27.772165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:27.772175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:27.772269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151748088:5920], now have 1 active actors on pipe
2025-10-10T14:32:27.772280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 590
2025-10-10T14:32:27.772322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.772331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.772359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31be3a11-ef1d7166-3b056456-eb46a723_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:27.772371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.772378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.772380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:27.772392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.772407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:27.772423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.772564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.772572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.772587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.772665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 591 partition: 0 MaxSeqNo: 40 sessionId: src_id|31be3a11-ef1d7166-3b056456-eb46a723_0
2025-10-10T14:32:27.772901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e15396-e043343e-b0716b3d-3343845e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|31be3a11-ef1d7166-3b056456-eb46a723_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:27.775375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31be3a11-ef1d7166-3b056456-eb46a723_0] Write session: try to update token
2025-10-10T14:32:27.775391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31be3a11-ef1d7166-3b056456-eb46a723_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:27.783092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:27.783105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.783113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600917369537039:4854]
2025-10-10T14:32:27.783149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:27.783154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:27.783305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:27.783445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.783562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.783681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:27.783854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:27.783884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:27.787915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId: src_id|31be3a11-ef1d7166-3b056456-eb46a723_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:27.790110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:27.790292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.790312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.790351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:27.790430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:27.799934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:27.799951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.799954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:27.799956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:27.799966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600917369537039:4854]
2025-10-10T14:32:27.799971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600917369537039:4854]
2025-10-10T14:32:27.799975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600917369537039:4854]
2025-10-10T14:32:27.800020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:27.800022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:27.800028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:27.800031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:27.800033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.800035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:27.800166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:27.854538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600918151748095:5401]
2025-10-10T14:32:27.854810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 590, pipe: [1:7559600918151748095:5401]
2025-10-10T14:32:27.904218Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:27.910973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.910995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.911142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.911196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.911260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.911334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.911566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.911580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.911639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.911693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.911747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.911807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.911845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.911853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.911910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.911962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.912020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.912073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.912112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.912117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.912173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.912231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.912285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.912344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.912393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.912399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.912457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.912508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.912562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.912616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.912657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.912663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.912718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.912769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.912824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.912878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.912917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.912924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.912981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.913033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.913088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.913143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.913192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.913195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.913254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.913306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.913381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.913440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.913485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.913489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.913547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.913600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.913655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.913710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.913750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.913755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.913809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:27.913864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:27.913925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:27.913986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:27.914026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:27.914031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:27.914070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151748095:5401], now have 1 active actors on pipe
2025-10-10T14:32:27.914338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600918151748095:5401]
2025-10-10T14:32:27.914378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:27.914381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:27.914414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 591 reason: error at write: Disconnected sessionId: src_id|31be3a11-ef1d7166-3b056456-eb46a723_0
2025-10-10T14:32:27.914481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:27.914624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 591 sessionId: src_id|31be3a11-ef1d7166-3b056456-eb46a723_0 is DEAD
2025-10-10T14:32:27.914630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:27.914777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31be3a11-ef1d7166-3b056456-eb46a723_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:27.914798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31be3a11-ef1d7166-3b056456-eb46a723_0] Write session will restart in 0.006747s
2025-10-10T14:32:27.914818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31be3a11-ef1d7166-3b056456-eb46a723_0] Write session: Do CDS request
2025-10-10T14:32:27.914822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31be3a11-ef1d7166-3b056456-eb46a723_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:27.922823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31be3a11-ef1d7166-3b056456-eb46a723_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.922905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:27.922923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 592
2025-10-10T14:32:27.923056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:27.923085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:27.923092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:27.923095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:27.923651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 592 sessionId:  describe result for acl check
2025-10-10T14:32:27.923692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:27.923698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:27.923700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:27.923707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600918151748205:5924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:27.924254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600918151748205:5924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:27.925672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:27.926599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600918151748205:5924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:27.927525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:27.927723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:27.927733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:27.927742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:27.927789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:27.927831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600917369537215:4856]
2025-10-10T14:32:27.928433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:27.928678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:27.928719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:27.928742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600918151748205:5924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:27.928753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600918151748205:5924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:27.928756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600918151748205:5924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:27.928763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:27.929006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:27.929056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.929061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.929062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.929063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.929065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.929066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.929067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.929068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.929069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.929070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.929071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.929072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.929073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.929078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.929091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.929095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.929099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.929103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.929111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.929115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.929122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.929125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.929129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.929136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.929140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.929143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.929149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.929162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:27.929174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.929183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:27.929191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.929196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:27.929204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.929213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:27.929217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.929226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:27.929234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.929241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:27.929250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.929260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:27.929264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.929269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:27.929273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.929278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:27.929282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.929291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:27.929299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.929304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.929312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.929318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.929341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.929347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.929386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:27.931550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:27.931865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:27.931877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:27.931879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:27.931883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:27.931888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 591 [2:7559600917369537215:4856]
2025-10-10T14:32:27.931901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:27.931923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:27.931932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.931936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.931938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.931953Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:27.931960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:27.931967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:27.932022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.932029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.932031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.932033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:27.932095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:27.932102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.932112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:27.932125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:27.932146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:27.932171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151748261:5924], now have 1 active actors on pipe
2025-10-10T14:32:27.932178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600918151748097:2438], now have 1 active actors on pipe
2025-10-10T14:32:27.932185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600917369537209:4856]
2025-10-10T14:32:27.932191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600917369537209:4856]
2025-10-10T14:32:27.932193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600917369537209:4856]
2025-10-10T14:32:27.932206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:27.932192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 591
2025-10-10T14:32:27.932219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:27.932223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 591
2025-10-10T14:32:27.932233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:27.932239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:27.932242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:27.932242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:27.932244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:27.932273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.932282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.932304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600917369537209:4856]
2025-10-10T14:32:27.932316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:27.932321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:27.932340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9909afa9-aa12802c-f954ced4-48725b13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:27.932353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:27.932357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:27.932360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:27.932371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:27.932386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:27.932414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.932518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.932526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.932541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:27.932638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 592 partition: 0 MaxSeqNo: 40 sessionId: src_id|9909afa9-aa12802c-f954ced4-48725b13_0
2025-10-10T14:32:27.932958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31be3a11-ef1d7166-3b056456-eb46a723_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9909afa9-aa12802c-f954ced4-48725b13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:27.935424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9909afa9-aa12802c-f954ced4-48725b13_0] Write session: try to update token
2025-10-10T14:32:27.935439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9909afa9-aa12802c-f954ced4-48725b13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:27.948275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId: src_id|9909afa9-aa12802c-f954ced4-48725b13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:27.950655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:27.951230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:27.951257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:27.951280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:27.951283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:27.951287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:27.951289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:27.951298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600917369537209:4856]
2025-10-10T14:32:27.951301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600917369537209:4856]
2025-10-10T14:32:27.951306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600917369537209:4856]
2025-10-10T14:32:27.951362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:27.951369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:27.951377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:27.951379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:27.951381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:27.951384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:27.951505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:28.014268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600922446715566:5401]
2025-10-10T14:32:28.014486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 591, pipe: [1:7559600922446715566:5401]
2025-10-10T14:32:28.053587Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:28.054079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:28.054128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446715566:5401], now have 1 active actors on pipe
2025-10-10T14:32:28.054198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:28.054330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:28.054383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600922446715566:5401]
2025-10-10T14:32:28.062643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:28.062656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:28.062676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 592 reason: error at write: Disconnected sessionId: src_id|9909afa9-aa12802c-f954ced4-48725b13_0
2025-10-10T14:32:28.062827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 592 sessionId: src_id|9909afa9-aa12802c-f954ced4-48725b13_0 is DEAD
2025-10-10T14:32:28.062929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9909afa9-aa12802c-f954ced4-48725b13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:28.062940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9909afa9-aa12802c-f954ced4-48725b13_0] Write session will restart in 0.006062s
2025-10-10T14:32:28.062957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9909afa9-aa12802c-f954ced4-48725b13_0] Write session: Do CDS request
2025-10-10T14:32:28.062962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9909afa9-aa12802c-f954ced4-48725b13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:28.067829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:28.069360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:28.069496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:28.069504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:28.069512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:28.069546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:28.069578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600921664504682:4858]
2025-10-10T14:32:28.069711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9909afa9-aa12802c-f954ced4-48725b13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.069770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:28.069779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 593
2025-10-10T14:32:28.069884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.069915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:28.069922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:28.069925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:28.069965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:28.070127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:28.070153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:28.070232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 593 sessionId:  describe result for acl check
2025-10-10T14:32:28.070256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:28.070261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:28.070263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:28.070267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600922446715704:5928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:28.070346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:28.070382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.070386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.070387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.070387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.070388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.070389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.070389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.070390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.070390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.070391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.070392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.070392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.070393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.070396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.070404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.070407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.070409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.070411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.070413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.070416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.070418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.070420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.070423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.070425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.070427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.070429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.070434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.070439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.070444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.070447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.070449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.070452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.070455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.070458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.070461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.070463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.070466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.070469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.070473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.070475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.070478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.070481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.070484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.070487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.070490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.070493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.070495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.070498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.070501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.070503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.070506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.070509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.070534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:28.070671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600922446715704:5928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:28.072580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:28.072608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600922446715704:5928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:28.073012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:28.073024Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:28.073025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:28.073028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:28.073032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 592 [2:7559600921664504682:4858]
2025-10-10T14:32:28.073039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:28.073050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:28.073053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.073055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.073056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.073069Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:28.073078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:28.073084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:28.073122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.073127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.073128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.073131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:28.073177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:28.073183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.073191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.073197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.073210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:28.073230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446715568:2438], now have 1 active actors on pipe
2025-10-10T14:32:28.073240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600921664504677:4858]
2025-10-10T14:32:28.073241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600921664504677:4858]
2025-10-10T14:32:28.073242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600921664504677:4858]
2025-10-10T14:32:28.073252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:28.073253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 592
2025-10-10T14:32:28.073263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:28.073267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:28.073269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:28.073271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:28.073286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:28.073288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:28.073309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600921664504677:4858]
2025-10-10T14:32:28.073318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:28.073325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:28.078103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600922446715704:5928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:28.078112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600922446715704:5928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:28.078114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600922446715704:5928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:28.078120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:28.078309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446715738:5928], now have 1 active actors on pipe
2025-10-10T14:32:28.078363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 592
2025-10-10T14:32:28.078403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.078416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.078448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:28.078465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.078470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.078472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:28.078484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.078498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:28.078511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.078629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.078638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.078657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.078745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 593 partition: 0 MaxSeqNo: 40 sessionId: src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0
2025-10-10T14:32:28.079020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9909afa9-aa12802c-f954ced4-48725b13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:28.081365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0] Write session: try to update token
2025-10-10T14:32:28.081376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:28.091688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:28.091708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.091711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:28.091714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:28.091726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600921664504677:4858]
2025-10-10T14:32:28.091731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600921664504677:4858]
2025-10-10T14:32:28.091736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600921664504677:4858]
2025-10-10T14:32:28.091783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:28.091789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:28.091793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:28.091796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.091797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:28.091799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:28.091945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:28.093978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId: src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:28.096332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:28.154586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600922446715742:5401]
2025-10-10T14:32:28.154777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 592, pipe: [1:7559600922446715742:5401]
2025-10-10T14:32:28.195521Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:28.195799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.195816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.195868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446715742:5401], now have 1 active actors on pipe
2025-10-10T14:32:28.196031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:28.196040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:28.196065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600922446715742:5401]
2025-10-10T14:32:28.196082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:28.196091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 593 reason: error at write: Disconnected sessionId: src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0
2025-10-10T14:32:28.196255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 593 sessionId: src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0 is DEAD
2025-10-10T14:32:28.196047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:28.196392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:28.196401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0] Write session will restart in 0.009833s
2025-10-10T14:32:28.196418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0] Write session: Do CDS request
2025-10-10T14:32:28.196422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:28.206077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:28.207830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.207854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:28.207876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:28.207885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 594
2025-10-10T14:32:28.208030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.208024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:28.208042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:28.208052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:28.208054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:28.208062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:28.208065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:28.208097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:28.208138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600921664504866:4861]
2025-10-10T14:32:28.208610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 594 sessionId:  describe result for acl check
2025-10-10T14:32:28.208653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:28.208664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:28.208667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:28.208675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600922446715891:5933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:28.209229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:28.209398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600922446715891:5933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:28.209467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:28.209510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:28.209777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:28.209817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.209822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.209823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.209824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.209825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.209826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.209827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.209829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.209830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.209831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.209832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.209833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.209834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.209839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.209850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.209854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.209858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.209862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.209866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.209870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.209874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.209878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.209883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.209887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.209891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.209900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.209906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.209918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.209927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.209933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.209939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.209948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.209956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.209962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.209973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.209978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.209982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.209987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.209991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.209996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.210001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.210006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.210010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.210016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.210020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.210023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.210027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.210030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.210032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.210035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.210038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.210041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.210062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:28.210981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600922446715891:5933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:28.212070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:28.212364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:28.212372Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:28.212373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:28.212376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:28.212380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 593 [2:7559600921664504866:4861]
2025-10-10T14:32:28.212387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:28.212397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:28.212399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.212401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.212403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.212414Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:28.212418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:28.212424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:28.212461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.212467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.212469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.212470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:28.212515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:28.212521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.212527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.212534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.212543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:28.212557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600921664504860:4861]
2025-10-10T14:32:28.212562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600921664504860:4861]
2025-10-10T14:32:28.212563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600921664504860:4861]
2025-10-10T14:32:28.212571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:28.212582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446715755:2438], now have 1 active actors on pipe
2025-10-10T14:32:28.212582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:28.212585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:28.212586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:28.212601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:28.212608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 593
2025-10-10T14:32:28.212614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:28.212619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:28.212641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600921664504860:4861]
2025-10-10T14:32:28.212649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:28.212654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:28.212960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600922446715891:5933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:28.212982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600922446715891:5933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:28.212988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600922446715891:5933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:28.212993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:28.213129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446715926:5933], now have 1 active actors on pipe
2025-10-10T14:32:28.213145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 593
2025-10-10T14:32:28.213183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.213193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.213222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:28.213235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.213239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.213244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:28.213254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.213270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:28.213287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.213797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.213811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.213830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.213901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 594 partition: 0 MaxSeqNo: 40 sessionId: src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0
2025-10-10T14:32:28.214141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbe5cbc1-c21f496f-9a4c1f62-d718bb4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:28.216600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0] Write session: try to update token
2025-10-10T14:32:28.216615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:28.228853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId: src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:28.229867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:28.229883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.229886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:28.229887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:28.229897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600921664504860:4861]
2025-10-10T14:32:28.229901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600921664504860:4861]
2025-10-10T14:32:28.229903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600921664504860:4861]
2025-10-10T14:32:28.229942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:28.229945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:28.229949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.229950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:28.229950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:28.229954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:28.230082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:28.231139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:28.296396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600922446715931:5401]
2025-10-10T14:32:28.296634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 593, pipe: [1:7559600922446715931:5401]
2025-10-10T14:32:28.333604Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:28.333926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.333944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.333986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446715931:5401], now have 1 active actors on pipe
2025-10-10T14:32:28.334151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:28.334227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:28.334237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:28.334262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600922446715931:5401]
2025-10-10T14:32:28.334283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:28.334300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 594 reason: error at write: Disconnected sessionId: src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0
2025-10-10T14:32:28.334481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 594 sessionId: src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0 is DEAD
2025-10-10T14:32:28.334651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:28.334661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0] Write session will restart in 0.008235s
2025-10-10T14:32:28.334679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0] Write session: Do CDS request
2025-10-10T14:32:28.334684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:28.343771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.343851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:28.343864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 595
2025-10-10T14:32:28.343994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.344029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:28.344039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:28.344042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:28.344498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 595 sessionId:  describe result for acl check
2025-10-10T14:32:28.344529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:28.344535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:28.344548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:28.344558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600922446716052:5937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:28.345113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600922446716052:5937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:28.345997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:28.346808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600922446716052:5937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:28.347690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:28.347835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:28.347845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:28.347853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:28.347892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:28.347922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600921664505039:4863]
2025-10-10T14:32:28.348303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:28.348509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:28.348536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:28.348743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:28.348776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.348781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.348781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.348782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.348783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.348783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.348784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.348784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.348785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.348785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.348786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.348786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.348787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.348791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.348798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.348800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.348803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.348805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.348807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.348809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.348812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.348814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.348816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.348818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.348821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.348823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.348828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.348833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.348837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.348840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.348845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.348848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.348851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.348853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.348856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.348863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.348866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.348869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.348872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.348875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.348878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.348880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.348883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.348889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.348891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.348895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.348898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.348901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.348908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.348919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.348925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.348928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.348956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:28.349120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600922446716052:5937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:28.349131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600922446716052:5937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:28.349134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600922446716052:5937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:28.349140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:28.351008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:28.351399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:28.351407Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:28.351408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:28.351411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:28.351416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 594 [2:7559600921664505039:4863]
2025-10-10T14:32:28.351424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:28.351435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:28.351440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.351442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.351443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.351454Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:28.351463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:28.351472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:28.351518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.351524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.351525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.351527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:28.351569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:28.351575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.351581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.351588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.351598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:28.351616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716101:5937], now have 1 active actors on pipe
2025-10-10T14:32:28.351623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446715932:2438], now have 1 active actors on pipe
2025-10-10T14:32:28.351628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600921664505033:4863]
2025-10-10T14:32:28.351629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600921664505033:4863]
2025-10-10T14:32:28.351631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600921664505033:4863]
2025-10-10T14:32:28.351641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:28.351651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:28.351652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:28.351658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:28.351659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:28.351666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:28.351669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:28.351695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 594
2025-10-10T14:32:28.351707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 594
2025-10-10T14:32:28.351690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600921664505033:4863]
2025-10-10T14:32:28.351703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:28.351707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:28.351732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.351741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.351767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8955169a-17b85b90-82205a6c-4a4d8039_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:28.351777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.351779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.351781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:28.351788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.351796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:28.351806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.351946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.351951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.351961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.352032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 595 partition: 0 MaxSeqNo: 40 sessionId: src_id|8955169a-17b85b90-82205a6c-4a4d8039_0
2025-10-10T14:32:28.352279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47be3c4a-17950a2b-7b03b1b8-9b8293ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8955169a-17b85b90-82205a6c-4a4d8039_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:28.354810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8955169a-17b85b90-82205a6c-4a4d8039_0] Write session: try to update token
2025-10-10T14:32:28.354826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8955169a-17b85b90-82205a6c-4a4d8039_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:28.367620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId: src_id|8955169a-17b85b90-82205a6c-4a4d8039_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:28.369608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:28.369625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.369628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:28.369629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:28.369637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600921664505033:4863]
2025-10-10T14:32:28.369640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600921664505033:4863]
2025-10-10T14:32:28.369643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600921664505033:4863]
2025-10-10T14:32:28.369679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:28.369681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:28.369684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:28.369688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.369688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:28.369689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:28.369813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:28.370130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:28.434636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600922446716109:5401]
2025-10-10T14:32:28.434917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 594, pipe: [1:7559600922446716109:5401]
2025-10-10T14:32:28.472213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:28.472447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.472459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.472494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716109:5401], now have 1 active actors on pipe
2025-10-10T14:32:28.472638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:28.472727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:28.472738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:28.472789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 595 reason: error at write: Disconnected sessionId: src_id|8955169a-17b85b90-82205a6c-4a4d8039_0
2025-10-10T14:32:28.472977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 595 sessionId: src_id|8955169a-17b85b90-82205a6c-4a4d8039_0 is DEAD
2025-10-10T14:32:28.473123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8955169a-17b85b90-82205a6c-4a4d8039_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:28.473134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8955169a-17b85b90-82205a6c-4a4d8039_0] Write session will restart in 0.009038s
2025-10-10T14:32:28.473158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8955169a-17b85b90-82205a6c-4a4d8039_0] Write session: Do CDS request
2025-10-10T14:32:28.473164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8955169a-17b85b90-82205a6c-4a4d8039_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:28.473143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:28.473186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600922446716109:5401]
2025-10-10T14:32:28.483801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8955169a-17b85b90-82205a6c-4a4d8039_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.483892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:28.483907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 596
2025-10-10T14:32:28.483942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:28.484035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.484068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:28.484081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:28.484086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:28.484436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 596 sessionId:  describe result for acl check
2025-10-10T14:32:28.484468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:28.484474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:28.484476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:28.484481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600922446716259:5947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:28.484978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600922446716259:5947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:28.485840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:28.485993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:28.486010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:28.486020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:28.486066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:28.486097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600921664505226:4871]
2025-10-10T14:32:28.486527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:28.486741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:28.486774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:28.487049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:28.487094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.487098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.487099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.487099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.487100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.487101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.487101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.487102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.487102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.487103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.487104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.487104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.487105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.487109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.487116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.487119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.487123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.487127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.487130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.487134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.487138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.487142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.487146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.487150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.487159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.487163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.487168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.487177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.487188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.487198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.487206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.487215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.487224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.487229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.487237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.487240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.487247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.487250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.487253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.487255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.487258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.487262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.487264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.487267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.487270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.487273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.487275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.487278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.487281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.487284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.487286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.487289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.487283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600922446716259:5947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:28.487315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:28.489442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:28.489804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:28.489814Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:28.489815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:28.489818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:28.489822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 595 [2:7559600921664505226:4871]
2025-10-10T14:32:28.489830Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:28.489842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:28.489844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.489846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.489847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.489860Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:28.489865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:28.489871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:28.489911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.489917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.489917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.489919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:28.489966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:28.489972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.489978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.489985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.489995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:28.490015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600922446716259:5947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:28.490025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600922446716259:5947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:28.490019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716123:2438], now have 1 active actors on pipe
2025-10-10T14:32:28.490030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600921664505220:4871]
2025-10-10T14:32:28.490031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600921664505220:4871]
2025-10-10T14:32:28.490033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600921664505220:4871]
2025-10-10T14:32:28.490028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600922446716259:5947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:28.490044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:28.490054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:28.490034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:28.490059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:28.490061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:28.490062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:28.490065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:28.490067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:28.490084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600921664505220:4871]
2025-10-10T14:32:28.490086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:28.490087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:28.490148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 595
2025-10-10T14:32:28.490212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716291:5947], now have 1 active actors on pipe
2025-10-10T14:32:28.490295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 595
2025-10-10T14:32:28.490348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.490356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.490386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:28.490399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.490407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.490414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:28.490423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.490433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:28.490448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.490593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.490599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.490610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.490674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 596 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0
2025-10-10T14:32:28.490985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8955169a-17b85b90-82205a6c-4a4d8039_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:28.493442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0] Write session: try to update token
2025-10-10T14:32:28.493455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:28.500317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:28.500341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.500348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600921664505220:4871]
2025-10-10T14:32:28.500386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:28.500397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:28.500536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:28.500665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:28.500795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:28.500927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:28.501094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:28.501128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:28.506684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId: src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:28.512697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:28.512875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.512902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.512946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:28.513024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:28.520337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:28.520351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.520353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:28.520355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:28.520362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600921664505220:4871]
2025-10-10T14:32:28.520365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600921664505220:4871]
2025-10-10T14:32:28.520367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600921664505220:4871]
2025-10-10T14:32:28.520404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:28.520410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.520412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:28.520422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:28.520433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:28.520438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:28.520545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:28.573379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600922446716322:5401]
2025-10-10T14:32:28.573603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 595, pipe: [1:7559600922446716322:5401]
2025-10-10T14:32:28.621940Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:28.628734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.628757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.628932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.628991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.629067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.629127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.629298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.629306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.629381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.629436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.629495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.629724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.629764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.629770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.629829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.629883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.629942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.630012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.630063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.630070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.630141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.630201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.630260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.630319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.630359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.630364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.630423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.630476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.630532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.630597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.630641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.630647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.630706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.630759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.630833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.630893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.630933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.630938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.630997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.631056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.631118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.631177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.631220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.631225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.631281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.631341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.631402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.631459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.631497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.631502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.631559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.631621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.631686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.631740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.631779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.631786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.631851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.631910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.631973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.632027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.632071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.632079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.632123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716322:5401], now have 1 active actors on pipe
2025-10-10T14:32:28.632427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:28.632460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600922446716322:5401]
2025-10-10T14:32:28.632499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:28.632507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:28.632548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 596 reason: error at write: Disconnected sessionId: src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0
2025-10-10T14:32:28.632602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:28.632806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 596 sessionId: src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0 is DEAD
2025-10-10T14:32:28.632908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:28.632920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0] Write session will restart in 0.007678s
2025-10-10T14:32:28.632941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0] Write session: Do CDS request
2025-10-10T14:32:28.632945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:28.641778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.641918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:28.641930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 597
2025-10-10T14:32:28.642027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.642052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:28.642060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:28.642063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:28.642554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 597 sessionId:  describe result for acl check
2025-10-10T14:32:28.642588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:28.642598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:28.642600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:28.642605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600922446716426:5956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:28.643201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600922446716426:5956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:28.644628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:28.645536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600922446716426:5956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:28.647254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:28.647438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:28.647448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:28.647460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:28.647493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600922446716426:5956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:28.647506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600922446716426:5956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:28.647509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600922446716426:5956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:28.647510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:28.647515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:28.647547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600921664505428:4881]
2025-10-10T14:32:28.648067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:28.648294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:28.648340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:28.648642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:28.648694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.648700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.648701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.648702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.648702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.648704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.648705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.648706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.648707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.648708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.648709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.648710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.648711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.648717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.648729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.648733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.648737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.648741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.648745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.648748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.648752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.648756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.648762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.648766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.648770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.648774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.648781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.648788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.648794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.648805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.648814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.648819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.648828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.648833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.648842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.648847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.648855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.648860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.648868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.648874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.648877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.648883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.648887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.648898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.648904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.648909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.648913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.648918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.648922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.648927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.648931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.648937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.648976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:28.651220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:28.651548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:28.651560Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:28.651562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:28.651566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:28.651571Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 596 [2:7559600921664505428:4881]
2025-10-10T14:32:28.651587Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:28.651603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:28.651610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.651613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.651616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.651631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:28.651638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:28.651647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:28.651703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.651710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.651711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.651714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:28.651873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:28.651883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.651882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 596
2025-10-10T14:32:28.651896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.651883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 596
2025-10-10T14:32:28.651912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.651928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:28.651949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716493:5956], now have 1 active actors on pipe
2025-10-10T14:32:28.651957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716326:2438], now have 1 active actors on pipe
2025-10-10T14:32:28.651964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600921664505423:4881]
2025-10-10T14:32:28.651970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600921664505423:4881]
2025-10-10T14:32:28.651972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600921664505423:4881]
2025-10-10T14:32:28.651986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:28.652006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:28.652009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.652014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.652015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:28.652017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:28.652037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:28.652057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:28.652065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:28.652097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|676a384f-ff4b1720-a15de178-f4cac87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:28.652111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.652114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.652116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:28.652126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.652135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:28.652143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600921664505423:4881]
2025-10-10T14:32:28.652154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:28.652171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:28.652176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.652311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.652320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.652337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.652407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 597 partition: 0 MaxSeqNo: 40 sessionId: src_id|676a384f-ff4b1720-a15de178-f4cac87_0
2025-10-10T14:32:28.652649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee3a1df2-eb042669-67cd4875-ab18421c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|676a384f-ff4b1720-a15de178-f4cac87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:28.655063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|676a384f-ff4b1720-a15de178-f4cac87_0] Write session: try to update token
2025-10-10T14:32:28.655075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|676a384f-ff4b1720-a15de178-f4cac87_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:28.667922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId: src_id|676a384f-ff4b1720-a15de178-f4cac87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:28.670275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:28.671761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.671781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.671801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:28.671803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.671805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:28.671806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:28.671813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600921664505423:4881]
2025-10-10T14:32:28.671816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600921664505423:4881]
2025-10-10T14:32:28.671820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600921664505423:4881]
2025-10-10T14:32:28.671865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:28.671873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:28.671875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.671877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:28.671879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:28.671884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:28.671991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:28.732599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600922446716505:5401]
2025-10-10T14:32:28.732876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 596, pipe: [1:7559600922446716505:5401]
2025-10-10T14:32:28.773613Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:28.773934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:28.774009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716505:5401], now have 1 active actors on pipe
2025-10-10T14:32:28.774155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:28.774206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600922446716505:5401]
2025-10-10T14:32:28.774232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:28.774234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:28.774235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:28.774307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 597 reason: error at write: Disconnected sessionId: src_id|676a384f-ff4b1720-a15de178-f4cac87_0
2025-10-10T14:32:28.774495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 597 sessionId: src_id|676a384f-ff4b1720-a15de178-f4cac87_0 is DEAD
2025-10-10T14:32:28.774602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676a384f-ff4b1720-a15de178-f4cac87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:28.774608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676a384f-ff4b1720-a15de178-f4cac87_0] Write session will restart in 0.005339s
2025-10-10T14:32:28.774625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676a384f-ff4b1720-a15de178-f4cac87_0] Write session: Do CDS request
2025-10-10T14:32:28.774629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676a384f-ff4b1720-a15de178-f4cac87_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:28.780767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|676a384f-ff4b1720-a15de178-f4cac87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.780862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:28.780874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 598
2025-10-10T14:32:28.781009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.781045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:28.781055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:28.781059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:28.781527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 598 sessionId:  describe result for acl check
2025-10-10T14:32:28.781566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:28.781573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:28.781575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:28.781581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600922446716525:5960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:28.782174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600922446716525:5960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:28.784666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600922446716525:5960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:28.786524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:28.788481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:28.788540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600922446716525:5960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:28.788551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600922446716525:5960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:28.788554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600922446716525:5960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:28.788560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:28.788669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:28.788681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:28.788692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:28.788742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:28.788782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600921664505605:4883]
2025-10-10T14:32:28.789392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:28.789648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:28.789687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:28.789997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:28.790052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.790059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.790060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.790061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.790062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.790064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.790065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.790066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.790067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.790068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.790069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.790070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.790071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.790077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.790089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.790094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.790098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.790102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.790106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.790115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.790119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.790123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.790128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.790132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.790136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.790142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.790149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.790157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.790169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.790175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.790179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.790185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.790193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.790198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.790203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.790207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.790211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.790218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.790223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.790230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.790234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.790240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.790244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.790254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.790258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.790263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.790268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.790273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.790281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.790287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.790295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.790301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.790345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:28.792518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:28.792821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:28.792833Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:28.792835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:28.792839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:28.792844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 597 [2:7559600921664505605:4883]
2025-10-10T14:32:28.792855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:28.792871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:28.792878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.792882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.792884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.792898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:28.792911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:28.792918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:28.792973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.792980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.792982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.792985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:28.793137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:28.793145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.793156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.793169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.793156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 597
2025-10-10T14:32:28.793160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 597
2025-10-10T14:32:28.793191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:28.793215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716674:5960], now have 1 active actors on pipe
2025-10-10T14:32:28.793223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716506:2438], now have 1 active actors on pipe
2025-10-10T14:32:28.793231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600921664505600:4883]
2025-10-10T14:32:28.793233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600921664505600:4883]
2025-10-10T14:32:28.793236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600921664505600:4883]
2025-10-10T14:32:28.793249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:28.793263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:28.793272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:28.793274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:28.793279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.793283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.793299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:28.793320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:28.793327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:28.793380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|518c42df-630686b9-ad21597e-2199b4ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:28.793392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.793396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.793398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:28.793408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.793424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:28.793435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600921664505600:4883]
2025-10-10T14:32:28.793443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:28.793464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:28.793468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.793603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.793613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.793629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.793711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 598 partition: 0 MaxSeqNo: 40 sessionId: src_id|518c42df-630686b9-ad21597e-2199b4ba_0
2025-10-10T14:32:28.794013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676a384f-ff4b1720-a15de178-f4cac87_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|518c42df-630686b9-ad21597e-2199b4ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:28.796519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|518c42df-630686b9-ad21597e-2199b4ba_0] Write session: try to update token
2025-10-10T14:32:28.796533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|518c42df-630686b9-ad21597e-2199b4ba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:28.804466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:28.804483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.804492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600921664505600:4883]
2025-10-10T14:32:28.804539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:28.804542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:28.804712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:28.804841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:28.804966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:28.805104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:28.805287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:28.805326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:28.809751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId: src_id|518c42df-630686b9-ad21597e-2199b4ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:28.812114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:28.812316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.812338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.812381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:28.812456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:28.821477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:28.821493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.821496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:28.821498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:28.821509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600921664505600:4883]
2025-10-10T14:32:28.821513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600921664505600:4883]
2025-10-10T14:32:28.821517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600921664505600:4883]
2025-10-10T14:32:28.821555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:28.821560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:28.821561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.821563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:28.821566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:28.821570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:28.821687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:28.874418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600922446716686:5401]
2025-10-10T14:32:28.874647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 597, pipe: [1:7559600922446716686:5401]
2025-10-10T14:32:28.926512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:28.933258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.933279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.933446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.933502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.933559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.933613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.933869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.933882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.933959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.934014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.934068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.934128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.934174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.934180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.934250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.934301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.934355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.934412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.934455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.934461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.934517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.934568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.934620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.934681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.934720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.934725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.934779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.934839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.934894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.934952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.934989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.934994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.935049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.935100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.935154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.935216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.935254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.935259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.935312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.935362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.935426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.935486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.935524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.935531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.935583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.935630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.935696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.935751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.935790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.935796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.935850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.935904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.935964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.936032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.936070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.936077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.936140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:28.936195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:28.936253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:28.936307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:28.936343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:28.936348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:28.936386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716686:5401], now have 1 active actors on pipe
2025-10-10T14:32:28.936633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:28.936648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:28.936652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:28.936682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 598 reason: error at write: Disconnected sessionId: src_id|518c42df-630686b9-ad21597e-2199b4ba_0
2025-10-10T14:32:28.936685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600922446716686:5401]
2025-10-10T14:32:28.936925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 598 sessionId: src_id|518c42df-630686b9-ad21597e-2199b4ba_0 is DEAD
2025-10-10T14:32:28.936951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:28.937047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518c42df-630686b9-ad21597e-2199b4ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:28.937058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518c42df-630686b9-ad21597e-2199b4ba_0] Write session will restart in 0.008188s
2025-10-10T14:32:28.937078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518c42df-630686b9-ad21597e-2199b4ba_0] Write session: Do CDS request
2025-10-10T14:32:28.937083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518c42df-630686b9-ad21597e-2199b4ba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:28.946798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|518c42df-630686b9-ad21597e-2199b4ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.946896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:28.946908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 599
2025-10-10T14:32:28.947007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:28.947035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:28.947045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:28.947049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:28.947488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 599 sessionId:  describe result for acl check
2025-10-10T14:32:28.947519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:28.947523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:28.947524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:28.947529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600922446716823:5964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:28.948022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600922446716823:5964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:28.948494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:28.950379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:28.950510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600922446716823:5964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:28.950582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:28.950598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:28.950612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:28.950679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:28.950719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600921664505783:4885]
2025-10-10T14:32:28.951303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:28.951603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:28.951638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:28.951870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:28.951910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.951915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.951916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.951917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.951917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.951918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.951919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.951919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.951920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.951921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.951921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.951922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.951923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.951928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.951936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.951939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.951941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.951944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.951946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.951949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.951951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.951953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.951957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.951959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.951961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.951963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.951968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.951975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:28.951981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.951987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:28.951991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.951996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:28.952001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.952006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:28.952011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.952017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:28.952021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.952026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:28.952030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.952036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:28.952040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.952045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:28.952050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.952055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:28.952060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.952065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:28.952071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.952076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.952081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.952086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.952090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.952096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.952119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:28.954114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600922446716823:5964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:28.954127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600922446716823:5964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:28.954130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600922446716823:5964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:28.954136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:28.954237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:28.954771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:28.954785Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:28.954787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:28.954791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:28.954796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 598 [2:7559600921664505783:4885]
2025-10-10T14:32:28.954817Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:28.954832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:28.954840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.954843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.954846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.954863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:28.954875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:28.954882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:28.954948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.954955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.954957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.954960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:28.955023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:28.955031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.955042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:28.955059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:28.955081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:28.955106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716860:5964], now have 1 active actors on pipe
2025-10-10T14:32:28.955114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600922446716687:2438], now have 1 active actors on pipe
2025-10-10T14:32:28.955117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 598
2025-10-10T14:32:28.955121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600921664505778:4885]
2025-10-10T14:32:28.955135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 598
2025-10-10T14:32:28.955128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600921664505778:4885]
2025-10-10T14:32:28.955130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600921664505778:4885]
2025-10-10T14:32:28.955143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:28.955154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:28.955157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:28.955159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:28.955159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:28.955176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:28.955184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:28.955219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.955227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.955245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600921664505778:4885]
2025-10-10T14:32:28.955256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:28.955263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:28.955285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:28.955295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:28.955299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:28.955301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:28.955313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:28.955324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:28.955350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.955480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:28.955490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:28.955508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:28.955587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 599 partition: 0 MaxSeqNo: 40 sessionId: src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0
2025-10-10T14:32:28.955908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|518c42df-630686b9-ad21597e-2199b4ba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:28.958364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0] Write session: try to update token
2025-10-10T14:32:28.958379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:28.971412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId: src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:28.973822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:28.973801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:28.973816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:28.973818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:28.973820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:28.973828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600921664505778:4885]
2025-10-10T14:32:28.973831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600921664505778:4885]
2025-10-10T14:32:28.973835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600921664505778:4885]
2025-10-10T14:32:28.973878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:28.973885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:28.973887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:28.973889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:28.973895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:28.973900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:28.974006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:29.036726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600926741684164:5401]
2025-10-10T14:32:29.036951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 598, pipe: [1:7559600926741684164:5401]
2025-10-10T14:32:29.085077Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:29.085371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.085389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.085437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684164:5401], now have 1 active actors on pipe
2025-10-10T14:32:29.085614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:29.085681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600926741684164:5401]
2025-10-10T14:32:29.085683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:29.085711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:29.085765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 599 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0
2025-10-10T14:32:29.085992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 599 sessionId: src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0 is DEAD
2025-10-10T14:32:29.086161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:29.086174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0] Write session will restart in 0.005570s
2025-10-10T14:32:29.086200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0] Write session: Do CDS request
2025-10-10T14:32:29.086206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:29.092790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.092923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:29.092934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 600
2025-10-10T14:32:29.093060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.093093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:29.093108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:29.093111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:29.093535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 600 sessionId:  describe result for acl check
2025-10-10T14:32:29.093565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:29.093571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:29.093573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:29.093579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600926741684208:5968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:29.094114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600926741684208:5968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:29.096147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600926741684208:5968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:29.097909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:29.098247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600926741684208:5968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:29.098258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600926741684208:5968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:29.098261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600926741684208:5968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:29.098268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:29.099828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:29.100026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:29.100040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:29.100053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:29.100115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:29.100157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600925959473259:4887]
2025-10-10T14:32:29.100701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:29.100984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:29.101033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:29.101373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:29.101443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.101449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.101450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.101451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.101453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.101454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.101455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.101457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.101458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.101459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.101460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.101462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.101463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.101469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.101482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.101487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.101490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.101494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.101498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.101502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.101507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.101511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.101515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.101519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.101523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.101527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.101534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.101543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.101550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.101556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.101565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.101571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.101575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.101581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.101590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.101596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.101605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.101611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.101616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.101623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.101632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.101637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.101644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.101650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.101656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.101661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.101666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.101671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.101678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.101683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.101693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.101698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.101739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:29.104088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:29.104438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:29.104450Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:29.104451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:29.104454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:29.104459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 599 [2:7559600925959473259:4887]
2025-10-10T14:32:29.104467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:29.104482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:29.104486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.104488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.104489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.104502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:29.104509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:29.104516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:29.104557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.104565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.104567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.104569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:29.104620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:29.104626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.104633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.104639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.104650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:29.104668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600925959473253:4887]
2025-10-10T14:32:29.104671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600925959473253:4887]
2025-10-10T14:32:29.104672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600925959473253:4887]
2025-10-10T14:32:29.104679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:29.104690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:29.104692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684335:5968], now have 1 active actors on pipe
2025-10-10T14:32:29.104696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:29.104699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:29.104701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:29.104706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:29.104708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:29.104713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684165:2438], now have 1 active actors on pipe
2025-10-10T14:32:29.104729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600925959473253:4887]
2025-10-10T14:32:29.104738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:29.104749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:29.104781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 599
2025-10-10T14:32:29.104784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 599
2025-10-10T14:32:29.104848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.104855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.104880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:29.104890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.104892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.104895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:29.104903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.104911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:29.104926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.105082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.105089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.105099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.105176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 600 partition: 0 MaxSeqNo: 40 sessionId: src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0
2025-10-10T14:32:29.105566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bc016a-1effe8b7-583a63d2-1077d21c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:29.108093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0] Write session: try to update token
2025-10-10T14:32:29.108107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:29.116984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:29.117000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.117010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600925959473253:4887]
2025-10-10T14:32:29.117050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:29.117060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:29.117220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:29.117373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.117507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.117634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.117816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:29.117851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:29.121126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId: src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:29.123679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:29.123856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.123873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.123909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:29.123995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:29.138736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:29.138753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.138755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:29.138756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:29.138764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600925959473253:4887]
2025-10-10T14:32:29.138767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600925959473253:4887]
2025-10-10T14:32:29.138770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600925959473253:4887]
2025-10-10T14:32:29.138815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:29.138822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.138823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:29.138825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:29.138832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:29.138835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:29.138940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:29.185729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600926741684346:5401]
2025-10-10T14:32:29.186069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 599, pipe: [1:7559600926741684346:5401]
2025-10-10T14:32:29.243543Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:29.250297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.250321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.250478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.250534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.250604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.250677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.250723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.250731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.250794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.250870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.250937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.250998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.251037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.251042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.251102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.251156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.251216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.251272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.251312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.251317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.251376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.251432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.251490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.251545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.251586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.251591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.251652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.251706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.251760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.251813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.251852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.251857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.251916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.251972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.252027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.252083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.252132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.252142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.252214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.252284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.252358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.252429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.252477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.252485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.252545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.252600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.252657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.252713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.252753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.252758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.252816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.252868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.252922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.252976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.253017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.253022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.253075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.253125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.253178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.253232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.253269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.253275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.253315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684346:5401], now have 1 active actors on pipe
2025-10-10T14:32:29.253539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:29.253547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600926741684346:5401]
2025-10-10T14:32:29.253551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:29.253567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:29.253587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 600 reason: error at write: Disconnected sessionId: src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0
2025-10-10T14:32:29.253771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 600 sessionId: src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0 is DEAD
2025-10-10T14:32:29.253915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:29.253925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0] Write session will restart in 0.008764s
2025-10-10T14:32:29.253954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0] Write session: Do CDS request
2025-10-10T14:32:29.253960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:29.254054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:29.263841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.263958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:29.263972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 601
2025-10-10T14:32:29.264201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.264207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:29.264236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:29.264246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:29.264250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:29.264607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 601 sessionId:  describe result for acl check
2025-10-10T14:32:29.264636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:29.264641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:29.264642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:29.264646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600926741684502:5973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:29.265050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600926741684502:5973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:29.266231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:29.266417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:29.266428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:29.266439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:29.266485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:29.266519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600925959473450:4890]
2025-10-10T14:32:29.266942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:29.267078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600926741684502:5973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:29.267208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:29.267249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:29.267529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:29.267580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.267586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.267587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.267588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.267589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.267591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.267592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.267593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.267594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.267595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.267596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.267597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.267599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.267604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.267616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.267620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.267624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.267628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.267632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.267636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.267640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.267644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.267649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.267653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.267657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.267661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.267667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.267675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.267682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.267687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.267699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.267705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.267714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.267719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.267724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.267733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.267738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.267747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.267752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.267757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.267765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.267770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.267779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.267784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.267789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.267794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.267802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.267808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.267812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.267822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.267826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.267831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.267873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:29.269891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600926741684502:5973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:29.269902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600926741684502:5973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:29.269905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600926741684502:5973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:29.269912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:29.270081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:29.270536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:29.270547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:29.270548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:29.270550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:29.270556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 600 [2:7559600925959473450:4890]
2025-10-10T14:32:29.270564Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:29.270578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:29.270580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.270582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.270583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.270596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:29.270605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:29.270610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:29.270650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.270655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.270657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.270659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:29.270721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:29.270729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.270739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.270754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.270775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:29.270797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684360:2438], now have 1 active actors on pipe
2025-10-10T14:32:29.270814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684536:5973], now have 1 active actors on pipe
2025-10-10T14:32:29.270820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600925959473444:4890]
2025-10-10T14:32:29.270823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600925959473444:4890]
2025-10-10T14:32:29.270825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600925959473444:4890]
2025-10-10T14:32:29.270833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:29.270842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:29.270813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 600
2025-10-10T14:32:29.270844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:29.270822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 600
2025-10-10T14:32:29.270846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:29.270851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:29.270865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:29.270868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:29.270890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.270899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.270925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600925959473444:4890]
2025-10-10T14:32:29.270934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:29.270945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:29.270948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d864ecea-f8c26a67-af80500-8682f768_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:29.270953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.270956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.270958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:29.270966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.270978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:29.271005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.271122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.271130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.271143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.271202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 601 partition: 0 MaxSeqNo: 40 sessionId: src_id|d864ecea-f8c26a67-af80500-8682f768_0
2025-10-10T14:32:29.271548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28110f85-994f7b24-e3ae9aca-f27ded72_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d864ecea-f8c26a67-af80500-8682f768_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:29.274037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d864ecea-f8c26a67-af80500-8682f768_0] Write session: try to update token
2025-10-10T14:32:29.274052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d864ecea-f8c26a67-af80500-8682f768_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:29.287239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId: src_id|d864ecea-f8c26a67-af80500-8682f768_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:29.289829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:29.289849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:29.289846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.289850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:29.289852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:29.289861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600925959473444:4890]
2025-10-10T14:32:29.289866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600925959473444:4890]
2025-10-10T14:32:29.289871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600925959473444:4890]
2025-10-10T14:32:29.289913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:29.289918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:29.289919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:29.289922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:29.289926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.289929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:29.290061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:29.353694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600926741684543:5401]
2025-10-10T14:32:29.354009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 600, pipe: [1:7559600926741684543:5401]
2025-10-10T14:32:29.394475Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:29.394818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.394831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.394870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684543:5401], now have 1 active actors on pipe
2025-10-10T14:32:29.395084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:29.395180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:29.395182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600926741684543:5401]
2025-10-10T14:32:29.395205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:29.395228Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:32:29.395276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d864ecea-f8c26a67-af80500-8682f768_0
2025-10-10T14:32:29.395340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 601 sessionId: src_id|d864ecea-f8c26a67-af80500-8682f768_0 is DEAD
2025-10-10T14:32:29.395450Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 6 consumer shared/user session shared/user_1_6_145653412642538201_v1 is DEAD
2025-10-10T14:32:29.395565Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600862317160995:5398] disconnected; active server actors: 1
2025-10-10T14:32:29.395577Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:32:29.395573Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600862317160995:5398] client user disconnected session shared/user_1_6_145653412642538201_v1
2025-10-10T14:32:29.395641Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:29.395646Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:29.395656Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.007116s
2025-10-10T14:32:29.395725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d864ecea-f8c26a67-af80500-8682f768_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:29.395736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d864ecea-f8c26a67-af80500-8682f768_0] Write session will restart in 0.006314s
2025-10-10T14:32:29.395760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d864ecea-f8c26a67-af80500-8682f768_0] Write session: Do CDS request
2025-10-10T14:32:29.395766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d864ecea-f8c26a67-af80500-8682f768_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:29.402821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d864ecea-f8c26a67-af80500-8682f768_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.402934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:29.402947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 602
2025-10-10T14:32:29.403098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.403134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:29.403144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:29.403148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:29.403582Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:32:29.403684Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:32:29.403692Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 7
2025-10-10T14:32:29.403693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 602 sessionId:  describe result for acl check
2025-10-10T14:32:29.403722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:29.403724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:29.403726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:29.403731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600926741684609:5977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:29.403804Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:29.403850Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:29.403911Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 auth for : user
2025-10-10T14:32:29.403984Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 Handle describe topics response
2025-10-10T14:32:29.404002Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 auth is DEAD
2025-10-10T14:32:29.404015Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:32:29.404208Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:32:29.404269Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_7_5079797391769373891_v1
2025-10-10T14:32:29.404258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600926741684609:5977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:29.404367Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600926741684630:5979] connected; active server actors: 1
2025-10-10T14:32:29.404426Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600926741684630:5979] session shared/user_1_7_5079797391769373891_v1
2025-10-10T14:32:29.404439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:32:29.404453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:32:29.404464Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_7_5079797391769373891_v1" (Sender=[1:7559600926741684610:5979], Pipe=[1:7559600926741684630:5979], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:29.404472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:29.404483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:32:29.404496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_7_5079797391769373891_v1" (Sender=[1:7559600926741684610:5979], Pipe=[1:7559600926741684630:5979], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:29.404509Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_7_5079797391769373891_v1" sender [1:7559600926741684610:5979] lock partition 0 for ReadingSession "shared/user_1_7_5079797391769373891_v1" (Sender=[1:7559600926741684610:5979], Pipe=[1:7559600926741684630:5979], Partitions=[], ActiveFamilyCount=1) generation 1 step 7
2025-10-10T14:32:29.404521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:32:29.404529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000039s
2025-10-10T14:32:29.404723Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_7_5079797391769373891_v1" ClientId: "user" PipeClient { RawX1: 7559600926741684630 RawX2: 4503603922343771 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:32:29.404745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:32:29.406301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600926741684609:5977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:29.407372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:29.409128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:29.409225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600926741684609:5977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:29.409235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600926741684609:5977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:29.409238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600926741684609:5977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:29.409242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:29.409282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:29.409294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:29.409304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:29.409366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:29.409403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600925959473632:4892]
2025-10-10T14:32:29.409883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:29.410103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:29.410140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:29.410428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:29.410474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.410479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.410480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.410480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.410481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.410482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.410483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.410484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.410485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.410487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.410488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.410489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.410490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.410494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.410505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.410509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.410514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.410518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.410522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.410526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.410529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.410538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.410543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.410547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.410551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.410559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.410566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.410578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.410589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.410594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.410601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.410608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.410616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.410622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.410630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.410639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.410645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.410654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.410660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.410670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.410675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.410681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.410687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.410690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.410693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.410696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.410700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.410702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.410705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.410709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.410712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.410718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.410739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:29.412831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:29.413160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:29.413170Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:29.413173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:29.413176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:29.413181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 601 [2:7559600925959473632:4892]
2025-10-10T14:32:29.413192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:29.413210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:29.413215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.413218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.413221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.413234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:29.413246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:29.413258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:29.413310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.413317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.413319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.413321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:29.413399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:29.413407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.413418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.413431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.413453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:29.413473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600925959473627:4892]
2025-10-10T14:32:29.413480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600925959473627:4892]
2025-10-10T14:32:29.413482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600925959473627:4892]
2025-10-10T14:32:29.413491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:29.413503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:29.413523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:29.413524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:29.413527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:29.413532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:29.413534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:29.413550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684724:5977], now have 1 active actors on pipe
2025-10-10T14:32:29.413556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684545:2438], now have 1 active actors on pipe
2025-10-10T14:32:29.413558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684656:5983], now have 1 active actors on pipe
2025-10-10T14:32:29.413562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600925959473627:4892]
2025-10-10T14:32:29.413569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:29.413577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:29.413615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 601
2025-10-10T14:32:29.413618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 601, pipe: [1:7559600926741684656:5983]
2025-10-10T14:32:29.413640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 601
2025-10-10T14:32:29.413678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.413687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.413700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_7_5079797391769373891_v1 on pipe: [1:7559600926741684656:5983]
2025-10-10T14:32:29.413720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.413724Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_7_5079797391769373891_v1:1 with generation 601
2025-10-10T14:32:29.413726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.413737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.413743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.413749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:29.413765Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_7_5079797391769373891_v1
2025-10-10T14:32:29.413772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.413801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:29.413811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:32:29.413815Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:32:29.417939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:32:29.417961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:32:29.417969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.417972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.417974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:29.417984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.417994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:29.417999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:32:29.418010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:32:29.418031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.418136Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106749412 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:32:29.418153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:32:29.418183Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 sending to client partition status
2025-10-10T14:32:29.418192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.418200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.418214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.418297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 602 partition: 0 MaxSeqNo: 40 sessionId: src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0
2025-10-10T14:32:29.418625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d864ecea-f8c26a67-af80500-8682f768_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:29.421191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0] Write session: try to update token
2025-10-10T14:32:29.421207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:29.424706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:29.424722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.424731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600925959473627:4892]
2025-10-10T14:32:29.424763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:29.424769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:29.424930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:29.425066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.425197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.425353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.425523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:29.425560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:29.433845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId: src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:29.436223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:29.436420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.436435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.436464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:29.436551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:29.441826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:29.441844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.441848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:29.441850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:29.441861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600925959473627:4892]
2025-10-10T14:32:29.441865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600925959473627:4892]
2025-10-10T14:32:29.441868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600925959473627:4892]
2025-10-10T14:32:29.441901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:29.441911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:29.441914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:29.441915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:29.441922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.441925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:29.442061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:29.545593Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:29.552094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.552115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.552256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.552311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.552371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.552428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.552469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.552477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.552537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.552591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.552648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.552706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.552746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.552752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.552812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.552866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.552924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.552982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.553021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.553026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.553084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.553142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.553199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.553257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.553298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.553303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.553384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.553441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.553498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.553552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.553595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.553601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.553657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.553710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.553763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.553819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.553862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.553868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.553927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.553980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.554037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.554093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.554189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.554195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.554251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.554303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.554360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.554416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.554455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.554460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.554518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.554572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.554628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.554682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.554722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.554727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.554782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.554850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.554907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.554962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.555001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.555006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.555164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600926741684656:5983]
2025-10-10T14:32:29.555184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:29.555190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:29.555194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:29.555219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 602 reason: error at write: Disconnected sessionId: src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0
2025-10-10T14:32:29.555423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 602 sessionId: src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0 is DEAD
2025-10-10T14:32:29.555569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:29.555579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0] Write session will restart in 0.009586s
2025-10-10T14:32:29.555596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0] Write session: Do CDS request
2025-10-10T14:32:29.555601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:29.555720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_7_5079797391769373891_v1
2025-10-10T14:32:29.555739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:29.555763Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_7_5079797391769373891_v1
2025-10-10T14:32:29.565760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.565931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:29.565944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 603
2025-10-10T14:32:29.566079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.566116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:29.566123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:29.566127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:29.566410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:29.566526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 603 sessionId:  describe result for acl check
2025-10-10T14:32:29.566558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:29.566563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:29.566564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:29.566569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600926741684915:5996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:29.566996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600926741684915:5996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:29.568469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:29.568753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:29.568766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:29.568778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:29.568832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:29.568863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600925959473854:4907]
2025-10-10T14:32:29.569092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600926741684915:5996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:29.569373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:29.569631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:29.569675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:29.569885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:29.569921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.569925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.569926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.569927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.569927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.569928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.569929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.569929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.569930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.569931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.569931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.569932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.569932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.569936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.569943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.569945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.569948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.569950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.569952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.569954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.569956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.569958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.569960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.569962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.569964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.569966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.569972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.569977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.569981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.569985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.569988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.569993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.569997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.570002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.570006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.570010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.570015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.570020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.570025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.570030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.570034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.570039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.570044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.570049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.570053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.570058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.570061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.570064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.570066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.570069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.570072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.570075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.570097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:29.572076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600926741684915:5996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:29.572095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600926741684915:5996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:29.572097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600926741684915:5996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:29.572102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:29.572255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:29.572532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:29.572545Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:29.572548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:29.572551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:29.572557Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 602 [2:7559600925959473854:4907]
2025-10-10T14:32:29.572565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:29.572576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:29.572578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.572580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.572581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.572593Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:29.572599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:29.572612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:29.572661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.572668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.572670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.572672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:29.572718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:29.572723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.572730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.572737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.572746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:29.572761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684947:5996], now have 1 active actors on pipe
2025-10-10T14:32:29.572770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600925959473848:4907]
2025-10-10T14:32:29.572772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600925959473848:4907]
2025-10-10T14:32:29.572773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600925959473848:4907]
2025-10-10T14:32:29.572782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:29.572787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684767:2438], now have 1 active actors on pipe
2025-10-10T14:32:29.572792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:29.572800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:29.572802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:29.572804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:29.572808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:29.572811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:29.572818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600925959473848:4907]
2025-10-10T14:32:29.572820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:29.572817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 602
2025-10-10T14:32:29.572833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:29.572823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 602
2025-10-10T14:32:29.572861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.572870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.572892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:29.572901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.572904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.572905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:29.572912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.572920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:29.572934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.573093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.573103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.573120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.573201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 603 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0
2025-10-10T14:32:29.573470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c12419-b1cdb9e9-67496879-1e517b8b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:29.575976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0] Write session: try to update token
2025-10-10T14:32:29.575993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:29.584124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:29.584144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.584154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600925959473848:4907]
2025-10-10T14:32:29.584198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:29.584201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:29.584379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:29.584539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.584662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.584791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:29.584975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:29.585020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:29.589060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId: src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:29.591478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:29.591691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.591708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.591739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:29.591841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:29.600968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:29.600984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.600986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:29.600988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:29.600998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600925959473848:4907]
2025-10-10T14:32:29.601001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600925959473848:4907]
2025-10-10T14:32:29.601005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600925959473848:4907]
2025-10-10T14:32:29.601048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:29.601049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:29.601053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.601054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:29.601055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:29.601058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:29.601182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:29.655263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600926741684957:5983]
2025-10-10T14:32:29.655481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 602, pipe: [1:7559600926741684957:5983]
2025-10-10T14:32:29.706124Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:29.712771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.712793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.712942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.712997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.713052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.713113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.713364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.713374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.713434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.713487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.713541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.713598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.713639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.713649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.713712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.713766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.713823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.713879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.713921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.713927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.713983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.714038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.714092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.714150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.714199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.714205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.714261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.714315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.714369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.714421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.714463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.714472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.714535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.714589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.714643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.714707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.714746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.714752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.714822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.714876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.714931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.714986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.715026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.715031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.715089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.715140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.715201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.715262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.715301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.715306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.715374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.715427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.715483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.715538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.715580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.715585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.715642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:29.715695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:29.715752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:29.715808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:29.715846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:29.715851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:29.715890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684957:5983], now have 1 active actors on pipe
2025-10-10T14:32:29.716173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:29.716169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600926741684957:5983]
2025-10-10T14:32:29.716186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:29.716200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:29.716217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 603 reason: error at write: Disconnected sessionId: src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0
2025-10-10T14:32:29.716440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 603 sessionId: src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0 is DEAD
2025-10-10T14:32:29.716578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:29.716591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0] Write session will restart in 0.007808s
2025-10-10T14:32:29.716591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:29.716617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0] Write session: Do CDS request
2025-10-10T14:32:29.716623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:29.725808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.725884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:29.725899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 604
2025-10-10T14:32:29.726003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.726039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:29.726044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:29.726048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:29.726441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 604 sessionId:  describe result for acl check
2025-10-10T14:32:29.726472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:29.726474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:29.726475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:29.726481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600926741685101:6000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:29.727255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600926741685101:6000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:29.727711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:29.729521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:29.729666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:29.729677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:29.729687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:29.729735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:29.729773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600925959474039:4910]
2025-10-10T14:32:29.729947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600926741685101:6000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:29.730262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:29.730506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:29.730535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:29.730788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:29.730839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.730844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.730845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.730846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.730846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.730847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.730847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.730848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.730849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.730849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.730850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.730850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.730851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.730854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.730862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.730865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.730867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.730869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.730871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.730873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.730876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.730878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.730880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.730882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.730884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.730886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.730891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.730896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.730901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.730904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.730906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.730909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.730912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.730915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.730918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.730921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.730924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.730929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.730933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.730937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.730941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.730946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.730951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.730955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.730957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.730960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.730963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.730965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.730968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.730975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.730979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.730986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.731007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:29.732972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600926741685101:6000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:29.732982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600926741685101:6000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:29.732985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600926741685101:6000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:29.732990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:29.733048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:29.733513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:29.733526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:29.733528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:29.733531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:29.733536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 603 [2:7559600925959474039:4910]
2025-10-10T14:32:29.733546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:29.733561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:29.733568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.733571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.733573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.733588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:29.733600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:29.733611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:29.733659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.733666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.733668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.733670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:29.733728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:29.733735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.733745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.733757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.733778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:29.733803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741685138:6000], now have 1 active actors on pipe
2025-10-10T14:32:29.733810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741684959:2438], now have 1 active actors on pipe
2025-10-10T14:32:29.733817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600925959474033:4910]
2025-10-10T14:32:29.733823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600925959474033:4910]
2025-10-10T14:32:29.733825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600925959474033:4910]
2025-10-10T14:32:29.733838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:29.733836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 603
2025-10-10T14:32:29.733840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 603
2025-10-10T14:32:29.733852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:29.733854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:29.733861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:29.733862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:29.733870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:29.733873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:29.733906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.733914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.733927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600925959474033:4910]
2025-10-10T14:32:29.733938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:29.733947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:29.733970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:29.733981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.733988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.733990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:29.734002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.734014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:29.734037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.734178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.734185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.734198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.734270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 604 partition: 0 MaxSeqNo: 40 sessionId: src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0
2025-10-10T14:32:29.734525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c17e73c-a2d260fc-7a622a26-49e40376_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:29.736891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0] Write session: try to update token
2025-10-10T14:32:29.736906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:29.749512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId: src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:29.752121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:29.752421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.752444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.752467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:29.752470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.752473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:29.752475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:29.752483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600925959474033:4910]
2025-10-10T14:32:29.752487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600925959474033:4910]
2025-10-10T14:32:29.752491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600925959474033:4910]
2025-10-10T14:32:29.752528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:29.752540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:29.752544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:29.752544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:29.752550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.752552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:29.752679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:29.816538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600926741685145:5983]
2025-10-10T14:32:29.816816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 603, pipe: [1:7559600926741685145:5983]
2025-10-10T14:32:29.857856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:29.858055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:29.858103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741685145:5983], now have 1 active actors on pipe
2025-10-10T14:32:29.858222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:29.858259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:29.858295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600926741685145:5983]
2025-10-10T14:32:29.858320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:29.858329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:29.858400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 604 reason: error at write: Disconnected sessionId: src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0
2025-10-10T14:32:29.858555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 604 sessionId: src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0 is DEAD
2025-10-10T14:32:29.858709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:29.858717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0] Write session will restart in 0.009179s
2025-10-10T14:32:29.858742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0] Write session: Do CDS request
2025-10-10T14:32:29.858758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:29.868760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.868879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:29.868891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 605
2025-10-10T14:32:29.869019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:29.869055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:29.869065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:29.869069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:29.869365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:29.869471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 605 sessionId:  describe result for acl check
2025-10-10T14:32:29.869500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:29.869506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:29.869508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:29.869514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600926741685290:6004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:29.869980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600926741685290:6004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:29.871454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:29.871582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:29.871592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:29.871600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:29.871635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:29.871673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600925959474223:4912]
2025-10-10T14:32:29.872177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600926741685290:6004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:29.872325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:29.872541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:29.872569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:29.872798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:29.872841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.872846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.872847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.872848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.872848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.872849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.872849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.872850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.872851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.872851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.872852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.872853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.872853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.872857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.872864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.872867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.872869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.872872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.872874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.872877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.872881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.872885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.872889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.872893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.872897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.872900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.872907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.872916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:29.872923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.872928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:29.872933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.872938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:29.872943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.872948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:29.872953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.872961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:29.872966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.872975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:29.872979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.872985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:29.872989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.872993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:29.873002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.873006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:29.873015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.873020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:29.873024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.873030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.873036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.873045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.873049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.873057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.873092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:29.875102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600926741685290:6004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:29.875113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600926741685290:6004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:29.875115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600926741685290:6004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:29.875120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:29.875188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:29.875486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:29.875498Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:29.875500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:29.875503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:29.875508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 604 [2:7559600925959474223:4912]
2025-10-10T14:32:29.875519Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:29.875537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:29.875543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.875546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.875547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.875559Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:29.875566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:29.875572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:29.875612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.875617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.875618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.875620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:29.875668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:29.875673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.875681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:29.875693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:29.875715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:29.875738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741685146:2438], now have 1 active actors on pipe
2025-10-10T14:32:29.875744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741685326:6004], now have 1 active actors on pipe
2025-10-10T14:32:29.875751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600925959474217:4912]
2025-10-10T14:32:29.875753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600925959474217:4912]
2025-10-10T14:32:29.875755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600925959474217:4912]
2025-10-10T14:32:29.875768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:29.875777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:29.875779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:29.875781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:29.875785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:29.875773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 604
2025-10-10T14:32:29.875780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 604
2025-10-10T14:32:29.875801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:29.875809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:29.875834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.875840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.875854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600925959474217:4912]
2025-10-10T14:32:29.875863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:29.875871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:29.875885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:29.875890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:29.875896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:29.875898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:29.875905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:29.875914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:29.876037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.876175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.876181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.876193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:29.876280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 605 partition: 0 MaxSeqNo: 40 sessionId: src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0
2025-10-10T14:32:29.876541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7639bb97-952cf2bc-23155b0f-cde6600d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:29.879064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0] Write session: try to update token
2025-10-10T14:32:29.879081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:29.891679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId: src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:29.894121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:29.894525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:29.894552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:29.894578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:29.894581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:29.894584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:29.894587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:29.894594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600925959474217:4912]
2025-10-10T14:32:29.894599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600925959474217:4912]
2025-10-10T14:32:29.894603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600925959474217:4912]
2025-10-10T14:32:29.894634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:29.894643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:29.894647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:29.894659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:29.894666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:29.894669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:29.894791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:29.958335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600926741685333:5983]
2025-10-10T14:32:29.958555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 604, pipe: [1:7559600926741685333:5983]
2025-10-10T14:32:30.000319Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:30.000568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:30.000619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600926741685333:5983], now have 1 active actors on pipe
2025-10-10T14:32:30.000681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:30.000852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:30.000920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600926741685333:5983]
2025-10-10T14:32:30.010054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:30.010067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:30.010093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 605 reason: error at write: Disconnected sessionId: src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0
2025-10-10T14:32:30.010269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 605 sessionId: src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0 is DEAD
2025-10-10T14:32:30.010428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:30.010453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0] Write session will restart in 0.007469s
2025-10-10T14:32:30.010482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0] Write session: Do CDS request
2025-10-10T14:32:30.010488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:30.015786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:30.017579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:30.017755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:30.017766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:30.017776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:30.017820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:30.017858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600930254441704:4914]
2025-10-10T14:32:30.018460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:30.018712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:30.018742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.018749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:30.018805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:30.018826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 606
2025-10-10T14:32:30.018993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.019025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:30.019034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:30.019040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:30.019077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:30.019132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.019138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.019139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.019140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.019142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.019143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.019144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.019145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.019146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.019147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.019148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.019150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.019151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.019156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.019167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.019172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.019176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.019180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.019184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.019188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.019192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.019196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.019200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.019204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.019208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.019213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.019219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.019227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.019239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.019244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.019251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.019256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.019262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.019268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.019272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.019277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.019285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.019291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.019296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.019301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.019305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.019315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.019319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.019326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.019330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.019335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.019341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.019346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.019352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.019359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.019364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.019369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.019411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:30.019453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 606 sessionId:  describe result for acl check
2025-10-10T14:32:30.019507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:30.019514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:30.019516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:30.019522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600931036652779:6008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:30.020084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600931036652779:6008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:30.021566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:30.022086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:30.022099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:30.022102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:30.022105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:30.022110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 605 [2:7559600930254441704:4914]
2025-10-10T14:32:30.022121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:30.022136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:30.022144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.022148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.022150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.022166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:30.022173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:30.022183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:30.022235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.022242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.022244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.022247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:30.022308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:30.022316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.022326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.022338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.022360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:30.022383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036652630:2438], now have 1 active actors on pipe
2025-10-10T14:32:30.022396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600930254441699:4914]
2025-10-10T14:32:30.022398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600930254441699:4914]
2025-10-10T14:32:30.022400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600930254441699:4914]
2025-10-10T14:32:30.022414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:30.022427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:30.022432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:30.022435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:30.022437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:30.022448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:30.022451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:30.022470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600930254441699:4914]
2025-10-10T14:32:30.022481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:30.022489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:30.022541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600931036652779:6008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:30.022570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 605
2025-10-10T14:32:30.027029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600931036652779:6008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:30.027043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600931036652779:6008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:30.027047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600931036652779:6008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:30.027055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:30.027294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036652814:6008], now have 1 active actors on pipe
2025-10-10T14:32:30.027345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 605
2025-10-10T14:32:30.027420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.027430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.027455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1c1145d-4ef60694-c4105f7f-1870166_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:30.027469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.027476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.027481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:30.027496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.027514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:30.027536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.027711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.027721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.027736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.027825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 606 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1c1145d-4ef60694-c4105f7f-1870166_0
2025-10-10T14:32:30.028182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5383837a-57ce8602-82ee4355-b1c3f9a3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1c1145d-4ef60694-c4105f7f-1870166_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:30.030806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1145d-4ef60694-c4105f7f-1870166_0] Write session: try to update token
2025-10-10T14:32:30.030836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1145d-4ef60694-c4105f7f-1870166_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:30.041459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:30.041479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:30.041483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:30.041484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:30.041499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600930254441699:4914]
2025-10-10T14:32:30.041503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600930254441699:4914]
2025-10-10T14:32:30.041505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600930254441699:4914]
2025-10-10T14:32:30.041551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:30.041557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:30.041559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:30.041563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:30.041566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.041569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:30.041712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:30.044484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId: src_id|d1c1145d-4ef60694-c4105f7f-1870166_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:30.047270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:30.101366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600931036652818:5983]
2025-10-10T14:32:30.101638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 605, pipe: [1:7559600931036652818:5983]
2025-10-10T14:32:30.131385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:32:30.131406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-10T14:32:30.144756Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:30.145086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.145099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.145145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036652818:5983], now have 1 active actors on pipe
2025-10-10T14:32:30.145504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:30.145513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600931036652818:5983]
2025-10-10T14:32:30.145528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-10T14:32:30.145537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:30.145540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:30.145602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 606 reason: error at write: Disconnected sessionId: src_id|d1c1145d-4ef60694-c4105f7f-1870166_0
2025-10-10T14:32:30.145830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 606 sessionId: src_id|d1c1145d-4ef60694-c4105f7f-1870166_0 is DEAD
2025-10-10T14:32:30.145970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1145d-4ef60694-c4105f7f-1870166_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:30.145981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1145d-4ef60694-c4105f7f-1870166_0] Write session will restart in 0.006949s
2025-10-10T14:32:30.145981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:30.146018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1145d-4ef60694-c4105f7f-1870166_0] Write session: Do CDS request
2025-10-10T14:32:30.146023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1145d-4ef60694-c4105f7f-1870166_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:30.153829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1145d-4ef60694-c4105f7f-1870166_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.153910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:30.153923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 607
2025-10-10T14:32:30.154031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.154059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:30.154067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:30.154071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:30.154529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 607 sessionId:  describe result for acl check
2025-10-10T14:32:30.154559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:30.154561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:30.154562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:30.154568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600931036652854:6012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:30.155041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600931036652854:6012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:30.157431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600931036652854:6012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:30.160138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600931036652854:6012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:30.160149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600931036652854:6012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:30.160151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600931036652854:6012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:30.160157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:30.161014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:30.164152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:30.164363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:30.164375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:30.164386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:30.164437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:30.164470Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600930254441891:4917]
2025-10-10T14:32:30.164928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:30.165280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:30.165325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:30.165659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:30.165715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.165721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.165723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.165724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.165725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.165726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.165727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.165729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.165730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.165731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.165732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.165734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.165735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.165740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.165754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.165758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.165762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.165766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.165771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.165775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.165779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.165788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.165793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.165801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.165805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.165813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.165822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.165835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.165843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.165846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.165849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.165853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.165859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.165862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.165865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.165869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.165872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.165875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.165878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.165882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.165888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.165891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.165894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.165901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.165904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.165908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.165914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.165917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.165920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.165925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.165928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.165931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.165958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:30.168325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:30.168834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:30.168847Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:30.168849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:30.168853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:30.168859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 606 [2:7559600930254441891:4917]
2025-10-10T14:32:30.168872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:30.168888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:30.168895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.168898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.168901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.168918Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:30.168924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:30.168935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:30.168990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.168997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.168999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.169002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:30.169071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:30.169079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.169090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.169103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.169125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:30.169152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036652996:6012], now have 1 active actors on pipe
2025-10-10T14:32:30.169160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036652822:2438], now have 1 active actors on pipe
2025-10-10T14:32:30.169168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600930254441886:4917]
2025-10-10T14:32:30.169170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600930254441886:4917]
2025-10-10T14:32:30.169173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600930254441886:4917]
2025-10-10T14:32:30.169187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:30.169204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:30.169204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:30.169206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:30.169208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:30.169224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:30.169228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:30.169251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600930254441886:4917]
2025-10-10T14:32:30.169265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:30.169255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 606
2025-10-10T14:32:30.169300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 606
2025-10-10T14:32:30.169286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:30.169379Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:32:30.169414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.169424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.169450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:30.169463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.169467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.169469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:30.169482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.169496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:30.169511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.169587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 3 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:32:30.169626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:32:30.169701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.169711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.169725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.169810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 607 partition: 0 MaxSeqNo: 40 sessionId: src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0
2025-10-10T14:32:30.170178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c1145d-4ef60694-c4105f7f-1870166_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:30.172961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0] Write session: try to update token
2025-10-10T14:32:30.172977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:30.187369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId: src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:30.188445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:30.188467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:30.188469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:30.188470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:30.188478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600930254441886:4917]
2025-10-10T14:32:30.188482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600930254441886:4917]
2025-10-10T14:32:30.188485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600930254441886:4917]
2025-10-10T14:32:30.188533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:30.188547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.188549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:30.188554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:30.188554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:30.188558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:30.188691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:30.190000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:30.245575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600931036653025:5983]
2025-10-10T14:32:30.245819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 606, pipe: [1:7559600931036653025:5983]
2025-10-10T14:32:30.291639Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:30.292036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.292052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.292091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653025:5983], now have 1 active actors on pipe
2025-10-10T14:32:30.292307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:30.292305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600931036653025:5983]
2025-10-10T14:32:30.292338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:30.292383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:30.292391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:30.292449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 607 reason: error at write: Disconnected sessionId: src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0
2025-10-10T14:32:30.292646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 607 sessionId: src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0 is DEAD
2025-10-10T14:32:30.292772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:30.292782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0] Write session will restart in 0.009526s
2025-10-10T14:32:30.292802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0] Write session: Do CDS request
2025-10-10T14:32:30.292810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:30.303324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:30.303841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.303920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:30.303938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 608
2025-10-10T14:32:30.304044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.304079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:30.304091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:30.304098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:30.304474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 608 sessionId:  describe result for acl check
2025-10-10T14:32:30.304506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:30.304512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:30.304514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:30.304521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600931036653179:6017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:30.304947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600931036653179:6017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:30.305387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:30.305567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:30.305579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:30.305591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:30.305643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:30.305684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600930254442089:4921]
2025-10-10T14:32:30.306277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:30.306504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:30.306544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:30.306843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600931036653179:6017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:30.306862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:30.306916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.306922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.306924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.306925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.306926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.306927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.306928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.306929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.306931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.306932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.306934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.306935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.306936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.306941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.306954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.306958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.306963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.306967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.306971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.306975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.306979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.306983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.306987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.306991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.306995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.306999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.307006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.307015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.307021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.307026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.307031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.307039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.307044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.307049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.307053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.307061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.307065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.307070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.307074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.307080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.307083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.307094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.307099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.307104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.307109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.307114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.307120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.307125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.307129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.307134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.307142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.307148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.307189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:30.309091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600931036653179:6017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:30.309101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600931036653179:6017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:30.309103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600931036653179:6017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:30.309109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:30.309247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:30.309831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:30.309844Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:30.309846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:30.309850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:30.309855Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 607 [2:7559600930254442089:4921]
2025-10-10T14:32:30.309866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:30.309882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:30.309890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.309892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.309895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.309906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:30.309913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:30.309920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:30.309979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.309986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.309989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.309991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:30.310056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:30.310064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.310075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.310087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.310110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:30.310135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653030:2438], now have 1 active actors on pipe
2025-10-10T14:32:30.310143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653212:6017], now have 1 active actors on pipe
2025-10-10T14:32:30.310149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600930254442083:4921]
2025-10-10T14:32:30.310152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600930254442083:4921]
2025-10-10T14:32:30.310154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600930254442083:4921]
2025-10-10T14:32:30.310138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 607
2025-10-10T14:32:30.310145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 607
2025-10-10T14:32:30.310163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:30.310178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:30.310182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:30.310185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:30.310186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:30.310198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:30.310201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:30.310238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.310247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.310262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600930254442083:4921]
2025-10-10T14:32:30.310274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:30.310282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:30.310303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53e60254-9a77ed8f-d2787252-8638862e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:30.310313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.310317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.310320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:30.310330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.310344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:30.310371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.310507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.310515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.310528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.310615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 608 partition: 0 MaxSeqNo: 40 sessionId: src_id|53e60254-9a77ed8f-d2787252-8638862e_0
2025-10-10T14:32:30.310923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771c948e-26881cd0-cb5c29cd-3ab608a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|53e60254-9a77ed8f-d2787252-8638862e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:30.313255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e60254-9a77ed8f-d2787252-8638862e_0] Write session: try to update token
2025-10-10T14:32:30.313267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e60254-9a77ed8f-d2787252-8638862e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:30.325845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId: src_id|53e60254-9a77ed8f-d2787252-8638862e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:30.328329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:30.328352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:30.328373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:30.328377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:30.328378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:30.328387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600930254442083:4921]
2025-10-10T14:32:30.328392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600930254442083:4921]
2025-10-10T14:32:30.328400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600930254442083:4921]
2025-10-10T14:32:30.328449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:30.328449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:30.328454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:30.328457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:30.328462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.328464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:30.328598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:30.392522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600931036653219:5983]
2025-10-10T14:32:30.392790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 607, pipe: [1:7559600931036653219:5983]
2025-10-10T14:32:30.433883Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:30.434114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.434128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.434166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653219:5983], now have 1 active actors on pipe
2025-10-10T14:32:30.434338Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:30.434373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:30.434383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:30.434386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600931036653219:5983]
2025-10-10T14:32:30.434408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:30.434437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 608 reason: error at write: Disconnected sessionId: src_id|53e60254-9a77ed8f-d2787252-8638862e_0
2025-10-10T14:32:30.434626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 608 sessionId: src_id|53e60254-9a77ed8f-d2787252-8638862e_0 is DEAD
2025-10-10T14:32:30.434769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e60254-9a77ed8f-d2787252-8638862e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:30.434778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e60254-9a77ed8f-d2787252-8638862e_0] Write session will restart in 0.009203s
2025-10-10T14:32:30.434809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e60254-9a77ed8f-d2787252-8638862e_0] Write session: Do CDS request
2025-10-10T14:32:30.434845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e60254-9a77ed8f-d2787252-8638862e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:30.444871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e60254-9a77ed8f-d2787252-8638862e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.444933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:30.444948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 609
2025-10-10T14:32:30.445114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.445153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:30.445164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:30.445170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:30.445619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 609 sessionId:  describe result for acl check
2025-10-10T14:32:30.445653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:30.445660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:30.445662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:30.445668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600931036653366:6021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:30.446135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600931036653366:6021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:30.446788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:30.448201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600931036653366:6021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:30.448877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:30.449129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:30.449142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:30.449155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:30.449208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:30.449248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600930254442277:4923]
2025-10-10T14:32:30.449861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:30.450178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:30.450234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:30.450402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600931036653366:6021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:30.450415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600931036653366:6021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:30.450419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600931036653366:6021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:30.450427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:30.450511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:30.450566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.450573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.450574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.450575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.450577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.450578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.450579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.450580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.450582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.450583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.450585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.450586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.450587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.450592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.450605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.450609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.450613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.450617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.450621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.450625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.450629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.450633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.450638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.450642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.450646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.450650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.450656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.450662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.450668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.450672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.450675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.450681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.450685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.450690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.450701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.450707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.450711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.450716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.450722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.450729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.450734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.450741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.450747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.450752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.450756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.450766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.450770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.450775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.450779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.450785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.450789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.450794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.450848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:30.453013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:30.453408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:30.453418Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:30.453419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:30.453422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:30.453426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 608 [2:7559600930254442277:4923]
2025-10-10T14:32:30.453433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:30.453445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:30.453447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.453449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.453451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.453462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:30.453468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:30.453473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:30.453511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.453517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.453518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.453520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:30.453567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:30.453573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.453582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.453593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.453608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:30.453633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653401:6021], now have 1 active actors on pipe
2025-10-10T14:32:30.453642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653220:2438], now have 1 active actors on pipe
2025-10-10T14:32:30.453648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600930254442272:4923]
2025-10-10T14:32:30.453650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600930254442272:4923]
2025-10-10T14:32:30.453652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600930254442272:4923]
2025-10-10T14:32:30.453664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:30.453673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:30.453675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:30.453676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:30.453681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:30.453696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:30.453703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:30.453693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 608
2025-10-10T14:32:30.453694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 608
2025-10-10T14:32:30.453724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600930254442272:4923]
2025-10-10T14:32:30.453731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:30.453732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:30.453745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.453752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.453805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:30.453818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.453822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.453823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:30.453835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.453845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:30.453869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.453988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.453998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.454011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.454084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 609 partition: 0 MaxSeqNo: 40 sessionId: src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0
2025-10-10T14:32:30.454399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e60254-9a77ed8f-d2787252-8638862e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:30.456798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0] Write session: try to update token
2025-10-10T14:32:30.456811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:30.469238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId: src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:30.471714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:30.472108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.472129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.472151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:30.472154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:30.472158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:30.472160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:30.472168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600930254442272:4923]
2025-10-10T14:32:30.472172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600930254442272:4923]
2025-10-10T14:32:30.472176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600930254442272:4923]
2025-10-10T14:32:30.472216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:30.472229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:30.472229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:30.472233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:30.472234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.472236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:30.472358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:30.534355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600931036653411:5983]
2025-10-10T14:32:30.534603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 608, pipe: [1:7559600931036653411:5983]
2025-10-10T14:32:30.576692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:30.576940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:30.576991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653411:5983], now have 1 active actors on pipe
2025-10-10T14:32:30.577073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:30.586870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:30.586884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:30.586903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 609 reason: error at write: Disconnected sessionId: src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0
2025-10-10T14:32:30.587057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 609 sessionId: src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0 is DEAD
2025-10-10T14:32:30.587181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:30.587188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0] Write session will restart in 0.006348s
2025-10-10T14:32:30.587212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0] Write session: Do CDS request
2025-10-10T14:32:30.587195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600931036653411:5983]
2025-10-10T14:32:30.587211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:30.587228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:30.594758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.594853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:30.594863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 610
2025-10-10T14:32:30.594859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:30.594967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.595000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:30.595004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:30.595008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:30.595391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 610 sessionId:  describe result for acl check
2025-10-10T14:32:30.595419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:30.595425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:30.595426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:30.595432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600931036653595:6036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:30.595846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600931036653595:6036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:30.596894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:30.597066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:30.597077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:30.597089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:30.597138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:30.597176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600930254442506:4931]
2025-10-10T14:32:30.597439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600931036653595:6036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:30.597779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:30.598022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:30.598067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:30.598363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:30.598419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.598427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.598428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.598429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.598430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.598431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.598432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.598433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.598434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.598435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.598436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.598437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.598439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.598444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.598455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.598459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.598462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.598466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.598470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.598473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.598476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.598480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.598484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.598488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.598491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.598494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.598501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.598509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.598516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.598521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.598530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.598536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.598544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.598554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.598561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.598569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.598573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.598581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.598590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.598595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.598601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.598605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.598613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.598617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.598625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.598630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.598638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.598648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.598652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.598663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.598666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.598671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.598704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:30.600833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600931036653595:6036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:30.600848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600931036653595:6036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:30.600851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600931036653595:6036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:30.600859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:30.600884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:30.601190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:30.601200Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:30.601201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:30.601204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:30.601208Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 609 [2:7559600930254442506:4931]
2025-10-10T14:32:30.601215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:30.601227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:30.601232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.601234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.601235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.601247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:30.601255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:30.601265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:30.601320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.601344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.601350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.601353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:30.601406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:30.601412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.601419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.601426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.601439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:30.601458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653507:2438], now have 1 active actors on pipe
2025-10-10T14:32:30.601465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653625:6036], now have 1 active actors on pipe
2025-10-10T14:32:30.601470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600930254442499:4931]
2025-10-10T14:32:30.601475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600930254442499:4931]
2025-10-10T14:32:30.601476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600930254442499:4931]
2025-10-10T14:32:30.601485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:30.601496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:30.601499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:30.601495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 609
2025-10-10T14:32:30.601504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:30.601508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 609
2025-10-10T14:32:30.601505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:30.601509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:30.601511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:30.601525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600930254442499:4931]
2025-10-10T14:32:30.601528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:30.601539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:30.601547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.601552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.601597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:30.601611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.601616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.601618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:30.601628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.601636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:30.601652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.601785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.601793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.601805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.601881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 610 partition: 0 MaxSeqNo: 40 sessionId: src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0
2025-10-10T14:32:30.602187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13515ead-4ccf2d9b-3cc06642-3980a97_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:30.604936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0] Write session: try to update token
2025-10-10T14:32:30.604952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:30.618720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId: src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:30.620836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:30.620856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:30.620858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:30.620859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:30.620868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600930254442499:4931]
2025-10-10T14:32:30.620871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600930254442499:4931]
2025-10-10T14:32:30.620873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600930254442499:4931]
2025-10-10T14:32:30.620910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:30.620911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:30.620916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:30.620916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.620917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:30.620919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:30.621054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:30.621430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:30.687426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600931036653636:5983]
2025-10-10T14:32:30.687641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 609, pipe: [1:7559600931036653636:5983]
2025-10-10T14:32:30.726862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:30.727282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.727298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.727336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653636:5983], now have 1 active actors on pipe
2025-10-10T14:32:30.727492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:30.727578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:30.727581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600931036653636:5983]
2025-10-10T14:32:30.727588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:30.727597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:30.727646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 610 reason: error at write: Disconnected sessionId: src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0
2025-10-10T14:32:30.727854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 610 sessionId: src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0 is DEAD
2025-10-10T14:32:30.728009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:30.728019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0] Write session will restart in 0.007206s
2025-10-10T14:32:30.728038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0] Write session: Do CDS request
2025-10-10T14:32:30.728043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:30.736802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.736867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:30.736880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 611
2025-10-10T14:32:30.737005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.737041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:30.737050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:30.737054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:30.737461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 611 sessionId:  describe result for acl check
2025-10-10T14:32:30.737491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:30.737495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:30.737497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:30.737501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600931036653768:6040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:30.737916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600931036653768:6040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:30.739266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:30.740089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600931036653768:6040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:30.741123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:30.741292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:30.741303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:30.741315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:30.741376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:30.741418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600930254442696:4941]
2025-10-10T14:32:30.741994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:30.742130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600931036653768:6040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:30.742142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600931036653768:6040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:30.742145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600931036653768:6040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:30.742149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:30.742242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:30.742285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:30.742593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:30.742646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.742652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.742653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.742654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.742655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.742656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.742657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.742658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.742659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.742660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.742661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.742662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.742663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.742668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.742679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.742682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.742686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.742691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.742695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.742699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.742702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.742706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.742711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.742715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.742718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.742722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.742730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.742739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.742746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.742751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.742756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.742761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.742765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.742770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.742776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.742786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.742790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.742795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.742803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.742809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.742826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.742832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.742840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.742846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.742850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.742859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.742864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.742873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.742877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.742882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.742890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.742896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.742939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:30.745044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:30.745419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:30.745431Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:30.745433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:30.745436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:30.745442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 610 [2:7559600930254442696:4941]
2025-10-10T14:32:30.745454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:30.745470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:30.745476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.745479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.745482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.745500Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:30.745511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:30.745523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:30.745571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.745578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.745580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.745582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:30.745647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:30.745654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.745665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.745681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.745703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:30.745729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653820:6040], now have 1 active actors on pipe
2025-10-10T14:32:30.745737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653637:2438], now have 1 active actors on pipe
2025-10-10T14:32:30.745744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600930254442690:4941]
2025-10-10T14:32:30.745751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600930254442690:4941]
2025-10-10T14:32:30.745753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600930254442690:4941]
2025-10-10T14:32:30.745743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 610
2025-10-10T14:32:30.745750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 610
2025-10-10T14:32:30.745766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:30.745782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:30.745788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:30.745791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:30.745793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:30.745803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:30.745810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:30.745844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.745853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.745867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600930254442690:4941]
2025-10-10T14:32:30.745878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:30.745893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:30.745908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28156885-17c8a958-15b37100-122997d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:30.745920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.745928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.745930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:30.745940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.745953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:30.745980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.746121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.746131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.746146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.746228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 611 partition: 0 MaxSeqNo: 40 sessionId: src_id|28156885-17c8a958-15b37100-122997d5_0
2025-10-10T14:32:30.746531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de10455d-6dfdd182-b302c94f-4bf85a50_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28156885-17c8a958-15b37100-122997d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:30.749127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28156885-17c8a958-15b37100-122997d5_0] Write session: try to update token
2025-10-10T14:32:30.749143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28156885-17c8a958-15b37100-122997d5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:30.761789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId: src_id|28156885-17c8a958-15b37100-122997d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:30.764382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:30.764544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:30.764565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:30.764568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:30.764570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:30.764579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600930254442690:4941]
2025-10-10T14:32:30.764583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600930254442690:4941]
2025-10-10T14:32:30.764586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600930254442690:4941]
2025-10-10T14:32:30.764627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:30.764631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.764634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:30.764637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.764638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:30.764655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:30.764665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.764666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:30.764782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:30.827710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600931036653830:5983]
2025-10-10T14:32:30.827934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 610, pipe: [1:7559600931036653830:5983]
2025-10-10T14:32:30.870702Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:30.871038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653830:5983], now have 1 active actors on pipe
2025-10-10T14:32:30.871281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:30.871314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600931036653830:5983]
2025-10-10T14:32:30.871343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:30.871354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:30.871423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 611 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28156885-17c8a958-15b37100-122997d5_0
2025-10-10T14:32:30.871626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 611 sessionId: src_id|28156885-17c8a958-15b37100-122997d5_0 is DEAD
2025-10-10T14:32:30.871832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28156885-17c8a958-15b37100-122997d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:30.871845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28156885-17c8a958-15b37100-122997d5_0] Write session will restart in 0.009051s
2025-10-10T14:32:30.871872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28156885-17c8a958-15b37100-122997d5_0] Write session: Do CDS request
2025-10-10T14:32:30.871877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28156885-17c8a958-15b37100-122997d5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:30.881871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28156885-17c8a958-15b37100-122997d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.881966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:30.881987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 612
2025-10-10T14:32:30.882121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:30.882163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:30.882174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:30.882178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:30.882438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:30.882541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 612 sessionId:  describe result for acl check
2025-10-10T14:32:30.882574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:30.882580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:30.882582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:30.882588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600931036653982:6044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:30.883091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600931036653982:6044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:30.884475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:30.884626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:30.884635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:30.884644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:30.884680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:30.884710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600930254442887:4943]
2025-10-10T14:32:30.884997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600931036653982:6044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:30.885100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:30.885315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:30.885357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:30.885555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:30.885590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.885595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.885596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.885597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.885597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.885598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.885599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.885599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.885600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.885600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.885601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.885602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.885602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.885606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.885614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.885616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.885619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.885621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.885623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.885626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.885628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.885630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.885633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.885635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.885637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.885640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.885645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.885650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:30.885654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.885658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:30.885660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.885663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:30.885666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.885669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:30.885671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.885674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:30.885677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.885680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:30.885682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.885686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:30.885688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.885691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:30.885694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.885697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:30.885700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.885703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:30.885706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.885708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.885711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.885714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.885716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.885719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.885742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:30.887673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600931036653982:6044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:30.887685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600931036653982:6044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:30.887689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600931036653982:6044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:30.887698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:30.887716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:30.888013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:30.888023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:30.888024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:30.888026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:30.888030Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 611 [2:7559600930254442887:4943]
2025-10-10T14:32:30.888038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:30.888052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:30.888055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.888058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.888061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.888076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:30.888084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:30.888096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:30.888144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.888150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.888152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.888153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:30.888202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:30.888211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.888218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:30.888228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:30.888242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:30.888262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036653831:2438], now have 1 active actors on pipe
2025-10-10T14:32:30.888267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036654017:6044], now have 1 active actors on pipe
2025-10-10T14:32:30.888273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600930254442881:4943]
2025-10-10T14:32:30.888278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600930254442881:4943]
2025-10-10T14:32:30.888280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600930254442881:4943]
2025-10-10T14:32:30.888289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:30.888304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:30.888308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:30.888311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:30.888313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:30.888317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:30.888319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:30.888308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 611
2025-10-10T14:32:30.888310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 611
2025-10-10T14:32:30.888346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600930254442881:4943]
2025-10-10T14:32:30.888352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:30.888354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:30.888372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.888378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.888404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:30.888414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:30.888417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:30.888419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:30.888426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:30.888435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:30.888449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.888571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:30.888578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:30.888592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:30.888670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 612 partition: 0 MaxSeqNo: 40 sessionId: src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0
2025-10-10T14:32:30.888955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28156885-17c8a958-15b37100-122997d5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:30.891429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0] Write session: try to update token
2025-10-10T14:32:30.891443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:30.904756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId: src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:30.906888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:30.906910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:30.906913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:30.906915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:30.906924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600930254442881:4943]
2025-10-10T14:32:30.906929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600930254442881:4943]
2025-10-10T14:32:30.906935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600930254442881:4943]
2025-10-10T14:32:30.906985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:30.906995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:30.906997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:30.906999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:30.907011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:30.907016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:30.907134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:30.907274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:30.971568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600931036654025:5983]
2025-10-10T14:32:30.971777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 611, pipe: [1:7559600931036654025:5983]
2025-10-10T14:32:31.014460Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:31.014905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.014919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.014956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600931036654025:5983], now have 1 active actors on pipe
2025-10-10T14:32:31.015138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:31.015150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:31.015251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600931036654025:5983]
2025-10-10T14:32:31.015383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:31.015455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 612 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0
2025-10-10T14:32:31.015654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 612 sessionId: src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0 is DEAD
2025-10-10T14:32:31.015796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:31.015806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0] Write session will restart in 0.005285s
2025-10-10T14:32:31.015832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0] Write session: Do CDS request
2025-10-10T14:32:31.015837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:31.021736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.021827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:31.021849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 613
2025-10-10T14:32:31.021994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.022028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:31.022037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:31.022041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:31.022421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 613 sessionId:  describe result for acl check
2025-10-10T14:32:31.022451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:31.022456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:31.022457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:31.022463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600935331621336:6048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:31.022930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600935331621336:6048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:31.025297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600935331621336:6048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:31.027914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600935331621336:6048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:31.027923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600935331621336:6048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:31.027926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600935331621336:6048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:31.027931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:31.028379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:31.030395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:31.030593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:31.030605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:31.030618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:31.030672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:31.030711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600934549410376:4945]
2025-10-10T14:32:31.031147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:31.031463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:31.031524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:31.031996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:31.032058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.032064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.032065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.032067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.032068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.032069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.032070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.032072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.032073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.032074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.032076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.032077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.032078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.032085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.032099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.032103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.032108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.032112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.032116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.032120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.032124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.032128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.032133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.032137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.032140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.032144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.032153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.032162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.032168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.032174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.032177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.032183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.032188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.032193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.032198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.032203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.032213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.032218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.032223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.032229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.032236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.032242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.032250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.032256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.032260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.032265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.032275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.032280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.032285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.032295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.032299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.032308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.032348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:31.034702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:31.035243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:31.035254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:31.035256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:31.035260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:31.035266Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 612 [2:7559600934549410376:4945]
2025-10-10T14:32:31.035274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:31.035287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:31.035293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.035296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.035297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.035322Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:31.035334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:31.035342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:31.035390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.035396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.035397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.035399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:31.035462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:31.035469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.035479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.035494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.035514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:31.035539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621503:6048], now have 1 active actors on pipe
2025-10-10T14:32:31.035547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621322:2438], now have 1 active actors on pipe
2025-10-10T14:32:31.035554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600934549410371:4945]
2025-10-10T14:32:31.035555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600934549410371:4945]
2025-10-10T14:32:31.035557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600934549410371:4945]
2025-10-10T14:32:31.035570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:31.035590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:31.035598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:31.035602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:31.035604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:31.035608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:31.035610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:31.035636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600934549410371:4945]
2025-10-10T14:32:31.035645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:31.035654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:31.035661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 612
2025-10-10T14:32:31.035666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 612
2025-10-10T14:32:31.035704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.035715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.035741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42847c1e-c807d017-1d537494-de93a225_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:31.035751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.035754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.035756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:31.035764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.035777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:31.035791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.035956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.035964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.035979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.036089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 613 partition: 0 MaxSeqNo: 40 sessionId: src_id|42847c1e-c807d017-1d537494-de93a225_0
2025-10-10T14:32:31.036468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8062651f-5e45c9dd-6484bbee-6d6cdbe5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|42847c1e-c807d017-1d537494-de93a225_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:31.039062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42847c1e-c807d017-1d537494-de93a225_0] Write session: try to update token
2025-10-10T14:32:31.039081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42847c1e-c807d017-1d537494-de93a225_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:31.052317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId: src_id|42847c1e-c807d017-1d537494-de93a225_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:31.054869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:31.054890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:31.054892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:31.054894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:31.054901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600934549410371:4945]
2025-10-10T14:32:31.054904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600934549410371:4945]
2025-10-10T14:32:31.054907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600934549410371:4945]
2025-10-10T14:32:31.054942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:31.054946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:31.054946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:31.054949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:31.054952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.054954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:31.054947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:31.055074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:31.115475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600935331621516:5983]
2025-10-10T14:32:31.115736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 612, pipe: [1:7559600935331621516:5983]
2025-10-10T14:32:31.159259Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:31.159975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.159989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.160028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621516:5983], now have 1 active actors on pipe
2025-10-10T14:32:31.160203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:31.160233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:31.160233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600935331621516:5983]
2025-10-10T14:32:31.160243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:31.160255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:31.160298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 613 reason: error at write: Disconnected sessionId: src_id|42847c1e-c807d017-1d537494-de93a225_0
2025-10-10T14:32:31.160474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 613 sessionId: src_id|42847c1e-c807d017-1d537494-de93a225_0 is DEAD
2025-10-10T14:32:31.160619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42847c1e-c807d017-1d537494-de93a225_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:31.160625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42847c1e-c807d017-1d537494-de93a225_0] Write session will restart in 0.009872s
2025-10-10T14:32:31.160643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42847c1e-c807d017-1d537494-de93a225_0] Write session: Do CDS request
2025-10-10T14:32:31.160648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42847c1e-c807d017-1d537494-de93a225_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:31.171810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42847c1e-c807d017-1d537494-de93a225_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.171880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:31.171891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 614
2025-10-10T14:32:31.172006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.172045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:31.172055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:31.172059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:31.172122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:31.172382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 614 sessionId:  describe result for acl check
2025-10-10T14:32:31.172414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:31.172418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:31.172419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:31.172424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600935331621673:6052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:31.172797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600935331621673:6052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:31.174062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:31.174225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:31.174237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:31.174247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:31.174299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:31.174340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600934549410567:4947]
2025-10-10T14:32:31.174367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600935331621673:6052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:31.174902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:31.175145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:31.175186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:31.175484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:31.175538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.175544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.175546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.175547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.175548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.175549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.175550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.175551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.175553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.175554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.175555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.175557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.175558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.175563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.175574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.175579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.175583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.175587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.175591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.175595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.175599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.175602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.175607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.175610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.175614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.175623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.175630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.175643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.175654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.175664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.175673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.175680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.175689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.175694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.175699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.175708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.175712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.175717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.175726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.175731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.175740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.175750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.175759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.175769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.175779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.175787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.175796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.175804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.175812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.175817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.175822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.175831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.175858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:31.176454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600935331621673:6052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:31.176467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600935331621673:6052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:31.176470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600935331621673:6052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:31.176478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:31.177947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:31.178273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:31.178284Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:31.178286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:31.178289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:31.178295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 613 [2:7559600934549410567:4947]
2025-10-10T14:32:31.178308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:31.178331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:31.178339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.178343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.178345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.178360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:31.178370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:31.178382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:31.178441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.178446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.178448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.178449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:31.178502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:31.178508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.178515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.178522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.178535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:31.178554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621706:6052], now have 1 active actors on pipe
2025-10-10T14:32:31.178561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621518:2438], now have 1 active actors on pipe
2025-10-10T14:32:31.178567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600934549410562:4947]
2025-10-10T14:32:31.178569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600934549410562:4947]
2025-10-10T14:32:31.178570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600934549410562:4947]
2025-10-10T14:32:31.178579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:31.178591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:31.178593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:31.178599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:31.178601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:31.178608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:31.178612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:31.178618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 613
2025-10-10T14:32:31.178636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600934549410562:4947]
2025-10-10T14:32:31.178621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 613
2025-10-10T14:32:31.178642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:31.178650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:31.178668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.178671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.178696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|666e7f04-1e53020c-97283880-e1f134df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:31.178706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.178708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.178710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:31.178718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.178726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:31.178741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.178874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.178882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.178897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.178986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 614 partition: 0 MaxSeqNo: 40 sessionId: src_id|666e7f04-1e53020c-97283880-e1f134df_0
2025-10-10T14:32:31.179299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42847c1e-c807d017-1d537494-de93a225_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|666e7f04-1e53020c-97283880-e1f134df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:31.181926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666e7f04-1e53020c-97283880-e1f134df_0] Write session: try to update token
2025-10-10T14:32:31.181942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666e7f04-1e53020c-97283880-e1f134df_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:31.194800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId: src_id|666e7f04-1e53020c-97283880-e1f134df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:31.196836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:31.196856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:31.196858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:31.196859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:31.196866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600934549410562:4947]
2025-10-10T14:32:31.196869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600934549410562:4947]
2025-10-10T14:32:31.196872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600934549410562:4947]
2025-10-10T14:32:31.196911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:31.196921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.196925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:31.196926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:31.196937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:31.196941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:31.197074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:31.197218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:31.260373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600935331621726:5983]
2025-10-10T14:32:31.260656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 613, pipe: [1:7559600935331621726:5983]
2025-10-10T14:32:31.302820Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:31.303168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.303180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.303220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621726:5983], now have 1 active actors on pipe
2025-10-10T14:32:31.303392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:31.303477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:31.303481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600935331621726:5983]
2025-10-10T14:32:31.303501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:31.303576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 614 reason: status is not ok: tablet will be restarted right now sessionId: src_id|666e7f04-1e53020c-97283880-e1f134df_0
2025-10-10T14:32:31.303783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 614 sessionId: src_id|666e7f04-1e53020c-97283880-e1f134df_0 is DEAD
2025-10-10T14:32:31.303926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666e7f04-1e53020c-97283880-e1f134df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:31.303936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666e7f04-1e53020c-97283880-e1f134df_0] Write session will restart in 0.006060s
2025-10-10T14:32:31.303954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666e7f04-1e53020c-97283880-e1f134df_0] Write session: Do CDS request
2025-10-10T14:32:31.303959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666e7f04-1e53020c-97283880-e1f134df_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:31.310781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666e7f04-1e53020c-97283880-e1f134df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.310897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:31.310910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 615
2025-10-10T14:32:31.311012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.311038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:31.311046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:31.311049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:31.311511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 615 sessionId:  describe result for acl check
2025-10-10T14:32:31.311548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:31.311554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:31.311556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:31.311562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600935331621776:6059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:31.312157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600935331621776:6059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:31.314049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600935331621776:6059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:31.316261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:31.318254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:31.318344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600935331621776:6059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:31.318357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600935331621776:6059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:31.318361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600935331621776:6059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:31.318369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:31.318446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:31.318458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:31.318469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:31.318524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:31.318562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600934549410772:4950]
2025-10-10T14:32:31.319161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:31.319422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:31.319465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:31.319751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:31.319792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.319797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.319798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.319798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.319799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.319800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.319801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.319801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.319802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.319803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.319803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.319804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.319804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.319808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.319816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.319819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.319821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.319823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.319826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.319828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.319830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.319832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.319835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.319837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.319839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.319841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.319847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.319853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.319857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.319860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.319863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.319866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.319869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.319872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.319875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.319878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.319880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.319884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.319886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.319889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.319892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.319899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.319901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.319904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.319907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.319914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.319917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.319920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.319922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.319925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.319928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.319931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.319952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:31.321997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:31.322300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:31.322312Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:31.322315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:31.322318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:31.322324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 614 [2:7559600934549410772:4950]
2025-10-10T14:32:31.322341Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:31.322360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:31.322368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.322370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.322373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.322386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:31.322395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:31.322402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:31.322440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.322445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.322447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.322448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:31.322495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:31.322504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.322510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.322517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.322526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:31.322544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621916:6059], now have 1 active actors on pipe
2025-10-10T14:32:31.322552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621731:2438], now have 1 active actors on pipe
2025-10-10T14:32:31.322558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600934549410767:4950]
2025-10-10T14:32:31.322564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600934549410767:4950]
2025-10-10T14:32:31.322566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600934549410767:4950]
2025-10-10T14:32:31.322578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:31.322593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:31.322599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:31.322602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:31.322605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:31.322609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:31.322611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:31.322628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600934549410767:4950]
2025-10-10T14:32:31.322634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:31.322636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:31.322614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 614
2025-10-10T14:32:31.322619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 614
2025-10-10T14:32:31.322651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.322656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.322691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:31.322704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.322712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.322714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:31.322724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.322736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:31.322757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.322926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.322936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.322948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.323045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 615 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0
2025-10-10T14:32:31.323378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666e7f04-1e53020c-97283880-e1f134df_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:31.325852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0] Write session: try to update token
2025-10-10T14:32:31.325868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:31.339917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId: src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:31.340808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:31.340831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:31.340835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:31.340837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:31.340847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600934549410767:4950]
2025-10-10T14:32:31.340852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600934549410767:4950]
2025-10-10T14:32:31.340856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600934549410767:4950]
2025-10-10T14:32:31.340904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:31.340909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:31.340915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.340917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:31.340918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:31.340921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:31.341056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:31.342544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:31.403740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600935331621927:5983]
2025-10-10T14:32:31.404057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 614, pipe: [1:7559600935331621927:5983]
2025-10-10T14:32:31.445813Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:31.446307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.446336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.446384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621927:5983], now have 1 active actors on pipe
2025-10-10T14:32:31.446584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:31.446608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:31.446637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600935331621927:5983]
2025-10-10T14:32:31.446658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:31.446737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 615 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0
2025-10-10T14:32:31.446977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 615 sessionId: src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0 is DEAD
2025-10-10T14:32:31.447098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:31.447105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0] Write session will restart in 0.005165s
2025-10-10T14:32:31.447124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0] Write session: Do CDS request
2025-10-10T14:32:31.447128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:31.453790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.453905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:31.453919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 616
2025-10-10T14:32:31.454049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.454088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:31.454098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:31.454102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:31.454422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 616 sessionId:  describe result for acl check
2025-10-10T14:32:31.454450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:31.454455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:31.454457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:31.454462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600935331621962:6063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:31.454940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600935331621962:6063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:31.457282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600935331621962:6063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:31.458712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:31.460602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:31.460803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:31.460814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:31.460824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:31.460869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:31.460851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600935331621962:6063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:31.460862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600935331621962:6063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:31.460865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600935331621962:6063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:31.460878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:31.460901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600934549410968:4952]
2025-10-10T14:32:31.461345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:31.461584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:31.461626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:31.461915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:31.461958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.461963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.461963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.461964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.461965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.461965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.461966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.461967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.461967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.461968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.461969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.461970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.461970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.461974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.461984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.461986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.461989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.461991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.461994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.461996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.461998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.462001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.462003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.462006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.462008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.462010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.462017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.462025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.462032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.462036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.462040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.462044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.462050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.462055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.462064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.462069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.462078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.462082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.462088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.462091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.462093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.462096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.462102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.462105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.462107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.462110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.462113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.462116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.462118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.462121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.462126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.462128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.462150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:31.464261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:31.464581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:31.464592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:31.464594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:31.464598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:31.464604Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 615 [2:7559600934549410968:4952]
2025-10-10T14:32:31.464615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:31.464636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:31.464643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.464647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.464649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.464665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:31.464677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:31.464687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:31.464742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.464749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.464751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.464754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:31.464819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:31.464826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.464837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.464852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.464874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:31.464900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622115:6063], now have 1 active actors on pipe
2025-10-10T14:32:31.464906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331621928:2438], now have 1 active actors on pipe
2025-10-10T14:32:31.464913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600934549410963:4952]
2025-10-10T14:32:31.464920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600934549410963:4952]
2025-10-10T14:32:31.464922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600934549410963:4952]
2025-10-10T14:32:31.464935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:31.464945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:31.464947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:31.464948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:31.464953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:31.464932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 615
2025-10-10T14:32:31.464938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 615
2025-10-10T14:32:31.464970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:31.464977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:31.465144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.465154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.465168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600934549410963:4952]
2025-10-10T14:32:31.465177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:31.465182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:31.465205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:31.465217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.465220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.465222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:31.465232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.465248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:31.465274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.465409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.465419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.465434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.465531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 616 partition: 0 MaxSeqNo: 40 sessionId: src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0
2025-10-10T14:32:31.465876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dd322b-832c4e9b-880f36b3-3fa43553_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:31.468307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0] Write session: try to update token
2025-10-10T14:32:31.468322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:31.481001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId: src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:31.483041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:31.483054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:31.483057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:31.483058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:31.483065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600934549410963:4952]
2025-10-10T14:32:31.483068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600934549410963:4952]
2025-10-10T14:32:31.483071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600934549410963:4952]
2025-10-10T14:32:31.483109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:31.483110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:31.483116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.483116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:31.483117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:31.483125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:31.483245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:31.483433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:31.546551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600935331622126:5983]
2025-10-10T14:32:31.546820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 615, pipe: [1:7559600935331622126:5983]
2025-10-10T14:32:31.585230Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:31.585581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.585594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.585633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622126:5983], now have 1 active actors on pipe
2025-10-10T14:32:31.585782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:31.585834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:31.585843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600935331622126:5983]
2025-10-10T14:32:31.585863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:31.585922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 616 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0
2025-10-10T14:32:31.586142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 616 sessionId: src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0 is DEAD
2025-10-10T14:32:31.586271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:31.586278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0] Write session will restart in 0.005396s
2025-10-10T14:32:31.586296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0] Write session: Do CDS request
2025-10-10T14:32:31.586301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:31.592740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.592836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:31.592848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 617
2025-10-10T14:32:31.592981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.593012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:31.593023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:31.593027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:31.593401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 617 sessionId:  describe result for acl check
2025-10-10T14:32:31.593431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:31.593434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:31.593435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:31.593441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600935331622166:6069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:31.593961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600935331622166:6069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:31.596576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600935331622166:6069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:31.598129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:31.600026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:31.600209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:31.600220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:31.600232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:31.600285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:31.600324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600934549411179:4954]
2025-10-10T14:32:31.600378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600935331622166:6069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:31.600391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600935331622166:6069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:31.600395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600935331622166:6069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:31.600403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:31.600914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:31.601151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:31.601189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:31.601507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:31.601566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.601571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.601573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.601574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.601575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.601576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.601577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.601579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.601580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.601581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.601582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.601583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.601584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.601590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.601601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.601605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.601610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.601614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.601618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.601622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.601626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.601630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.601634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.601638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.601642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.601645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.601652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.601661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.601667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.601673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.601677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.601683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.601687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.601692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.601697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.601706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.601710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.601720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.601725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.601730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.601734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.601739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.601748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.601754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.601760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.601765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.601774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.601779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.601783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.601788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.601793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.601798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.601834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:31.604037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:31.604404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:31.604415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:31.604416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:31.604419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:31.604424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 616 [2:7559600934549411179:4954]
2025-10-10T14:32:31.604433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:31.604446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:31.604448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.604451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.604453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.604465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:31.604476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:31.604482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:31.604528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.604535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.604536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.604537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:31.604594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:31.604601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.604611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.604626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.604646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:31.604669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622333:6069], now have 1 active actors on pipe
2025-10-10T14:32:31.604671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622134:2438], now have 1 active actors on pipe
2025-10-10T14:32:31.604677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600934549411174:4954]
2025-10-10T14:32:31.604678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600934549411174:4954]
2025-10-10T14:32:31.604679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600934549411174:4954]
2025-10-10T14:32:31.604689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:31.604700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:31.604705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:31.604707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:31.604708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:31.604711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:31.604714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:31.604707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 616
2025-10-10T14:32:31.604735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600934549411174:4954]
2025-10-10T14:32:31.604728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 616
2025-10-10T14:32:31.604743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:31.604745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:31.604765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.604773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.604941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|329ac370-7572c582-cb607854-2496fb38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:31.604953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.604956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.604957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:31.604965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.604976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:31.604998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.605242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.605251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.605267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.605381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 617 partition: 0 MaxSeqNo: 40 sessionId: src_id|329ac370-7572c582-cb607854-2496fb38_0
2025-10-10T14:32:31.605719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f1f4fb-b5c4af29-984374a3-10408a1e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|329ac370-7572c582-cb607854-2496fb38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:31.608415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329ac370-7572c582-cb607854-2496fb38_0] Write session: try to update token
2025-10-10T14:32:31.608430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329ac370-7572c582-cb607854-2496fb38_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:31.622230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId: src_id|329ac370-7572c582-cb607854-2496fb38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:31.623164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:31.623181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:31.623184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:31.623186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:31.623196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600934549411174:4954]
2025-10-10T14:32:31.623199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600934549411174:4954]
2025-10-10T14:32:31.623203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600934549411174:4954]
2025-10-10T14:32:31.623244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:31.623249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:31.623255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:31.623257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.623260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:31.623261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:31.623401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:31.624740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:31.685813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600935331622360:5983]
2025-10-10T14:32:31.686073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 616, pipe: [1:7559600935331622360:5983]
2025-10-10T14:32:31.729604Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:31.729989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.730006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.730049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622360:5983], now have 1 active actors on pipe
2025-10-10T14:32:31.730211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:31.730307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:31.730329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600935331622360:5983]
2025-10-10T14:32:31.730349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:31.730428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 617 reason: status is not ok: tablet will be restarted right now sessionId: src_id|329ac370-7572c582-cb607854-2496fb38_0
2025-10-10T14:32:31.730624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 617 sessionId: src_id|329ac370-7572c582-cb607854-2496fb38_0 is DEAD
2025-10-10T14:32:31.730774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ac370-7572c582-cb607854-2496fb38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:31.730783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ac370-7572c582-cb607854-2496fb38_0] Write session will restart in 0.008702s
2025-10-10T14:32:31.730813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ac370-7572c582-cb607854-2496fb38_0] Write session: Do CDS request
2025-10-10T14:32:31.730818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ac370-7572c582-cb607854-2496fb38_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:31.740917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329ac370-7572c582-cb607854-2496fb38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.741026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:31.741038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 618
2025-10-10T14:32:31.741184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.741220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:31.741232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:31.741236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:31.741773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 618 sessionId:  describe result for acl check
2025-10-10T14:32:31.741819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:31.741825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:31.741827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:31.741834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600935331622505:6082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:31.742415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600935331622505:6082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:31.743543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:31.744722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600935331622505:6082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:31.745894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:31.746083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:31.746092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:31.746103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:31.746156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:31.746188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600934549411401:4970]
2025-10-10T14:32:31.746712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:31.746973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:31.747013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:31.747304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:31.747354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.747361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.747362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.747363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.747364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.747366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.747367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.747369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.747369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.747370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.747371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.747372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.747372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.747376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.747385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.747405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600935331622505:6082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:31.747387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.747390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.747392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.747417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600935331622505:6082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:31.747419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600935331622505:6082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:31.747394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.747396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.747426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:31.747398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.747401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.747403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.747405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.747407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.747410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.747417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.747427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.747434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.747440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.747445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.747449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.747452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.747456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.747459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.747462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.747465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.747468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.747472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.747476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.747479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.747482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.747485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.747488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.747491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.747494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.747497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.747500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.747502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.747505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.747508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.747511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.747534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:31.749730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:31.750043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:31.750055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:31.750057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:31.750061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:31.750068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 617 [2:7559600934549411401:4970]
2025-10-10T14:32:31.750081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:31.750105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:31.750113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.750116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.750119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.750134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:31.750147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:31.750158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:31.750219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.750227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.750229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.750231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:31.750297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:31.750304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.750315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.750332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.750355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:31.750381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622361:2438], now have 1 active actors on pipe
2025-10-10T14:32:31.750387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622550:6082], now have 1 active actors on pipe
2025-10-10T14:32:31.750394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600934549411396:4970]
2025-10-10T14:32:31.750396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600934549411396:4970]
2025-10-10T14:32:31.750397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600934549411396:4970]
2025-10-10T14:32:31.750408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:31.750421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:31.750426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:31.750435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:31.750440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:31.750413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 617
2025-10-10T14:32:31.750441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:31.750443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:31.750460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 617
2025-10-10T14:32:31.750467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600934549411396:4970]
2025-10-10T14:32:31.750474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:31.750481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:31.750496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.750503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.750532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:31.750544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.750553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.750555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:31.750565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.750573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:31.750583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.750740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.750749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.750765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.750870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 618 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0
2025-10-10T14:32:31.751238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ac370-7572c582-cb607854-2496fb38_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:31.753752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0] Write session: try to update token
2025-10-10T14:32:31.753768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:31.767260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId: src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:31.769545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:31.769558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:31.769560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:31.769562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:31.769570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600934549411396:4970]
2025-10-10T14:32:31.769573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600934549411396:4970]
2025-10-10T14:32:31.769576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600934549411396:4970]
2025-10-10T14:32:31.769615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:31.769621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.769623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:31.769625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:31.769631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:31.769634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:31.769749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:31.769885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:31.830743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600935331622561:5983]
2025-10-10T14:32:31.831055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 617, pipe: [1:7559600935331622561:5983]
2025-10-10T14:32:31.875344Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:31.875846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.875859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.875900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622561:5983], now have 1 active actors on pipe
2025-10-10T14:32:31.876054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:31.876157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:31.876173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600935331622561:5983]
2025-10-10T14:32:31.876192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:31.876266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 618 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0
2025-10-10T14:32:31.876465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 618 sessionId: src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0 is DEAD
2025-10-10T14:32:31.876606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:31.876617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0] Write session will restart in 0.006614s
2025-10-10T14:32:31.876643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0] Write session: Do CDS request
2025-10-10T14:32:31.876650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:31.884881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.884939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:31.884952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 619
2025-10-10T14:32:31.885135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:31.885171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:31.885182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:31.885186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:31.885666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 619 sessionId:  describe result for acl check
2025-10-10T14:32:31.885700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:31.885701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:31.885702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:31.885707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600935331622643:6086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:31.886161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600935331622643:6086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:31.888672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:31.888673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600935331622643:6086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:31.890675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:31.890877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:31.890889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:31.890902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:31.890952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:31.890991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600934549411599:4972]
2025-10-10T14:32:31.891182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600935331622643:6086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:31.891203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600935331622643:6086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:31.891206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600935331622643:6086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:31.891215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:31.891597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:31.891858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:31.891900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:31.892217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:31.892270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.892276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.892278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.892279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.892280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.892281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.892283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.892284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.892285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.892286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.892287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.892289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.892290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.892295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.892309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.892313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.892317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.892321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.892325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.892329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.892333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.892337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.892343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.892348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.892352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.892357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.892363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.892372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:31.892379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.892384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:31.892389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.892394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:31.892398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.892403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:31.892408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.892413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:31.892418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.892423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:31.892431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.892437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:31.892447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.892452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:31.892457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.892466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:31.892470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.892476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:31.892486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.892492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.892500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.892505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.892510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.892516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.892559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:31.894920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:31.895349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:31.895362Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:31.895364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:31.895368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:31.895374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 618 [2:7559600934549411599:4972]
2025-10-10T14:32:31.895386Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:31.895405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:31.895413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.895417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.895419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.895435Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:31.895447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:31.895460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:31.895519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.895527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.895529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.895532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:31.895596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:31.895603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.895615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:31.895632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:31.895655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:31.895682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622562:2438], now have 1 active actors on pipe
2025-10-10T14:32:31.895689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622751:6086], now have 1 active actors on pipe
2025-10-10T14:32:31.895697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600934549411594:4972]
2025-10-10T14:32:31.895704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600934549411594:4972]
2025-10-10T14:32:31.895706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600934549411594:4972]
2025-10-10T14:32:31.895717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 618
2025-10-10T14:32:31.895739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 618
2025-10-10T14:32:31.895719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:31.895729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:31.895732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:31.895733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:31.895738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:31.895755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:31.895758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:31.895795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.895800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.895815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600934549411594:4972]
2025-10-10T14:32:31.895824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:31.895831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:31.895853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:31.895866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:31.895870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:31.895872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:31.895884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:31.895899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:31.895926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.896057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.896065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.896081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:31.896185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 619 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0
2025-10-10T14:32:31.896536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b8d658-1572f262-68f937b8-5d7edfc0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:31.899044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0] Write session: try to update token
2025-10-10T14:32:31.899064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:31.912383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId: src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:31.914773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:31.915765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:31.915786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:31.915806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:31.915809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:31.915811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:31.915812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:31.915817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600934549411594:4972]
2025-10-10T14:32:31.915820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600934549411594:4972]
2025-10-10T14:32:31.915824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600934549411594:4972]
2025-10-10T14:32:31.915872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:31.915878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:31.915882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:31.915885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:31.915887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:31.915888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:31.916014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:31.976129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600935331622763:5983]
2025-10-10T14:32:31.976393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 618, pipe: [1:7559600935331622763:5983]
2025-10-10T14:32:32.020546Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:32.020843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:32.020899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600935331622763:5983], now have 1 active actors on pipe
2025-10-10T14:32:32.020977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:32.021071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:32.021121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600935331622763:5983]
2025-10-10T14:32:32.030140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:32.030152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:32.030178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 619 reason: error at write: Disconnected sessionId: src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0
2025-10-10T14:32:32.030351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 619 sessionId: src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0 is DEAD
2025-10-10T14:32:32.030495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:32.030508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0] Write session will restart in 0.009881s
2025-10-10T14:32:32.030534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0] Write session: Do CDS request
2025-10-10T14:32:32.030540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:32.038626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:32.041120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:32.041367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.041379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:32.041392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:32.041452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:32.041499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600938844379094:4974]
2025-10-10T14:32:32.041874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.041979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:32.041993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 620
2025-10-10T14:32:32.042113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:32.042123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.042151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:32.042155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:32.042158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:32.042420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:32.042464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:32.042537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 620 sessionId:  describe result for acl check
2025-10-10T14:32:32.042570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:32.042576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:32.042578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:32.042582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600939626590223:6090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:32.042795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:32.042868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.042875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.042877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.042878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.042879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.042880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.042882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.042883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.042884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.042886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.042887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.042889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.042890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.042895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.042908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.042912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.042916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.042920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.042925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.042929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.042933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.042937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.042941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.042945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.042949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.042952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.042960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.042968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.042975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.042980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.042984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.042990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.042994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.042999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.043009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.043015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.043019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.043029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.043034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.043039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.043047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.043052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.043061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.043066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.043071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.043050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600939626590223:6090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:32.043077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.043085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.043090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.043094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.043100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.043110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.043115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.043155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:32.045447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:32.045553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600939626590223:6090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:32.046083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:32.046094Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:32.046098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:32.046101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:32.046108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 619 [2:7559600938844379094:4974]
2025-10-10T14:32:32.046122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:32.046147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:32.046155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.046158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.046160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.046179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:32.046190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:32.046197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:32.046377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.046388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.046389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.046392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:32.046468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:32.046480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.046495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.046510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.046533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:32.046568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590060:2438], now have 1 active actors on pipe
2025-10-10T14:32:32.046586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600938844379089:4974]
2025-10-10T14:32:32.046596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600938844379089:4974]
2025-10-10T14:32:32.046598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600938844379089:4974]
2025-10-10T14:32:32.046615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:32.046593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 619
2025-10-10T14:32:32.046634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:32.046634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:32.046637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:32.046639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:32.046656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:32.046659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:32.046706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600938844379089:4974]
2025-10-10T14:32:32.046728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:32.046753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:32.051669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600939626590223:6090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:32.051681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600939626590223:6090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:32.051684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600939626590223:6090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:32.051690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:32.051940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590258:6090], now have 1 active actors on pipe
2025-10-10T14:32:32.051971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 619
2025-10-10T14:32:32.052052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.052067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.052102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:32.052124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.052131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.052134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:32.052150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.052175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:32.052202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.052383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.052391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.052404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.052475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 620 partition: 0 MaxSeqNo: 40 sessionId: src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0
2025-10-10T14:32:32.052832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e8ab91-c7e3d1c9-874c108d-1c2f9f3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:32.055296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0] Write session: try to update token
2025-10-10T14:32:32.055310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:32.063739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:32.063755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:32.063766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600938844379089:4974]
2025-10-10T14:32:32.063815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:32.063817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:32.063980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:32.064113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:32.064254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:32.064380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:32.064562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:32.064601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:32.068927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId: src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:32.071341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:32.071527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.071547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.071583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:32.071679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:32.075887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:32.075903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:32.075907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:32.075909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:32.075919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600938844379089:4974]
2025-10-10T14:32:32.075923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600938844379089:4974]
2025-10-10T14:32:32.075928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600938844379089:4974]
2025-10-10T14:32:32.075962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:32.075973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:32.075973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:32.075976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:32.075982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.075984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:32.076123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:32.121558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600939626590261:5983]
2025-10-10T14:32:32.121826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 619, pipe: [1:7559600939626590261:5983]
2025-10-10T14:32:32.184176Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:32.191270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.191289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.191449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.191517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.191591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.191660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.191713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.191724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.191793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.191864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.191927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.191988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.192040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.192053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.192121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.192180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.192242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.192301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.192344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.192349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.192411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.192470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.192537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.192612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.192657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.192665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.192735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.192794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.192852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.192917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.192964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.192972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.193038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.193110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.193180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.193248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.193293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.193298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.193387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.193448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.193507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.193564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.193605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.193612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.193684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.193743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.193799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.193857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.193896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.193902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.193961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.194017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.194073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.194131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.194172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.194178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.194237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:32.194291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:32.194349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:32.194407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:32.194450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:32.194456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:32.194498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590261:5983], now have 1 active actors on pipe
2025-10-10T14:32:32.194686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600939626590261:5983]
2025-10-10T14:32:32.194705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:32.194715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:32.194719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:32.194741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 620 reason: error at write: Disconnected sessionId: src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0
2025-10-10T14:32:32.194871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 620 sessionId: src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0 is DEAD
2025-10-10T14:32:32.195014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:32.195024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0] Write session will restart in 0.008863s
2025-10-10T14:32:32.195056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0] Write session: Do CDS request
2025-10-10T14:32:32.195062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:32.195380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:32.204774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.204914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:32.204926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 621
2025-10-10T14:32:32.205020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.205047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:32.205054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:32.205057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:32.205450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 621 sessionId:  describe result for acl check
2025-10-10T14:32:32.205479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:32.205485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:32.205496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:32.205501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600939626590404:6095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:32.205946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600939626590404:6095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:32.207585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:32.207729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600939626590404:6095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:32.209691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:32.209870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.209881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:32.209893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:32.209941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:32.209986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600938844379306:4977]
2025-10-10T14:32:32.210058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600939626590404:6095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:32.210069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600939626590404:6095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:32.210071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600939626590404:6095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:32.210078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:32.210594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:32.210819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:32.210868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:32.211169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:32.211229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.211237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.211238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.211240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.211241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.211242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.211243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.211245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.211246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.211248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.211249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.211250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.211251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.211257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.211269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.211274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.211278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.211282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.211286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.211291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.211294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.211298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.211303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.211307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.211311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.211315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.211321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.211330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.211337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.211342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.211347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.211352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.211361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.211366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.211375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.211380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.211389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.211394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.211403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.211408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.211417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.211422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.211431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.211440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.211448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.211454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.211463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.211469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.211472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.211478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.211487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.211496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.211543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:32.213689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:32.214186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:32.214198Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:32.214201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:32.214205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:32.214211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 620 [2:7559600938844379306:4977]
2025-10-10T14:32:32.214221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:32.214237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:32.214245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.214249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.214252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.214275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:32.214282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:32.214290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:32.214346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.214353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.214355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.214358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:32.214422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:32.214429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.214441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.214458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.214479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:32.214503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590466:6095], now have 1 active actors on pipe
2025-10-10T14:32:32.214513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590265:2438], now have 1 active actors on pipe
2025-10-10T14:32:32.214520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600938844379301:4977]
2025-10-10T14:32:32.214523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600938844379301:4977]
2025-10-10T14:32:32.214525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600938844379301:4977]
2025-10-10T14:32:32.214538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:32.214556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:32.214559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:32.214529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 620
2025-10-10T14:32:32.214563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:32.214565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:32.214577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:32.214580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:32.214531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 620
2025-10-10T14:32:32.214615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.214625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.214644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600938844379301:4977]
2025-10-10T14:32:32.214655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:32.214667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:32.214689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:32.214701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.214705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.214708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:32.214718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.214733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:32.214758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.214941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.214950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.214964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.215080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 621 partition: 0 MaxSeqNo: 40 sessionId: src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0
2025-10-10T14:32:32.215445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe044ee-f3ccc0eb-a4345169-dec54dff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:32.217840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0] Write session: try to update token
2025-10-10T14:32:32.217854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:32.230666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId: src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:32.232428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:32.232445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:32.232448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:32.232450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:32.232460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600938844379301:4977]
2025-10-10T14:32:32.232465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600938844379301:4977]
2025-10-10T14:32:32.232470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600938844379301:4977]
2025-10-10T14:32:32.232509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:32.232512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:32.232518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.232519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:32.232519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:32.232522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:32.232646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:32.233084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:32.294594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600939626590478:5983]
2025-10-10T14:32:32.294901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 620, pipe: [1:7559600939626590478:5983]
2025-10-10T14:32:32.338759Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:32.339231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.339243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.339284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590478:5983], now have 1 active actors on pipe
2025-10-10T14:32:32.339496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:32.339541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:32.339552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:32.339552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:32.339601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600939626590478:5983]
2025-10-10T14:32:32.339633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 621 reason: error at write: Disconnected sessionId: src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0
2025-10-10T14:32:32.339848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 621 sessionId: src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0 is DEAD
2025-10-10T14:32:32.339998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:32.340008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0] Write session will restart in 0.006495s
2025-10-10T14:32:32.340027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0] Write session: Do CDS request
2025-10-10T14:32:32.340035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:32.347892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.347955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:32.347970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 622
2025-10-10T14:32:32.348156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.348187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:32.348195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:32.348199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:32.348581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 622 sessionId:  describe result for acl check
2025-10-10T14:32:32.348620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:32.348625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:32.348626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:32.348631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600939626590525:6099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:32.349085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600939626590525:6099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:32.351467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600939626590525:6099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:32.353396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:32.353458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600939626590525:6099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:32.353468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600939626590525:6099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:32.353471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600939626590525:6099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:32.353477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:32.355746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:32.355947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.355958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:32.355970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:32.356027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:32.356069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600938844379508:4979]
2025-10-10T14:32:32.356694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:32.356966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:32.357004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:32.357238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:32.357279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.357284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.357285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.357286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.357286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.357287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.357288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.357288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.357289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.357290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.357291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.357292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.357293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.357296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.357305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.357308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.357310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.357312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.357316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.357320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.357324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.357340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.357344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.357348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.357352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.357356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.357363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.357372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.357378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.357382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.357384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.357388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.357392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.357398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.357415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.357425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.357430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.357436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.357439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.357442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.357445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.357448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.357450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.357454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.357456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.357459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.357462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.357466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.357470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.357475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.357484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.357489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.357529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:32.359776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:32.360100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:32.360112Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:32.360115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:32.360120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:32.360126Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 621 [2:7559600938844379508:4979]
2025-10-10T14:32:32.360139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:32.360162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:32.360170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.360174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.360177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.360194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:32.360206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:32.360216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:32.360273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.360281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.360283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.360285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:32.360354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:32.360362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.360373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.360387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.360410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:32.360437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590479:2438], now have 1 active actors on pipe
2025-10-10T14:32:32.360445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590670:6099], now have 1 active actors on pipe
2025-10-10T14:32:32.360454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600938844379502:4979]
2025-10-10T14:32:32.360456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600938844379502:4979]
2025-10-10T14:32:32.360458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600938844379502:4979]
2025-10-10T14:32:32.360473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:32.360472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 621
2025-10-10T14:32:32.360492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:32.360493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:32.360483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 621
2025-10-10T14:32:32.360495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:32.360497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:32.360509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:32.360513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:32.360552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.360558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.360573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600938844379502:4979]
2025-10-10T14:32:32.360585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:32.360601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:32.360623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:32.360635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.360639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.360641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:32.360653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.360663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:32.360690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.360826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.360834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.360848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.360945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 622 partition: 0 MaxSeqNo: 40 sessionId: src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0
2025-10-10T14:32:32.361342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ffc6731-4e0e8d99-8db49218-d65fa71f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:32.364060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0] Write session: try to update token
2025-10-10T14:32:32.364081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:32.377447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId: src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:32.378802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:32.378821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:32.378823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:32.378825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:32.378849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600938844379502:4979]
2025-10-10T14:32:32.378854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600938844379502:4979]
2025-10-10T14:32:32.378858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600938844379502:4979]
2025-10-10T14:32:32.378905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:32.378917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.378919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:32.379057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:32.379238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:32.379249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:32.379252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:32.379908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:32.439992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600939626590682:5983]
2025-10-10T14:32:32.440249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 621, pipe: [1:7559600939626590682:5983]
2025-10-10T14:32:32.484818Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:32.485343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.485356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.485395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590682:5983], now have 1 active actors on pipe
2025-10-10T14:32:32.485591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:32.485647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:32.485671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600939626590682:5983]
2025-10-10T14:32:32.485691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:32.485759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 622 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0
2025-10-10T14:32:32.485935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 622 sessionId: src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0 is DEAD
2025-10-10T14:32:32.486052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:32.486061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0] Write session will restart in 0.005862s
2025-10-10T14:32:32.486078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0] Write session: Do CDS request
2025-10-10T14:32:32.486082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:32.492771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.492914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:32.492927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 623
2025-10-10T14:32:32.493081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.493118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:32.493128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:32.493132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:32.493539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 623 sessionId:  describe result for acl check
2025-10-10T14:32:32.493567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:32.493572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:32.493573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:32.493580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600939626590707:6103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:32.493999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600939626590707:6103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:32.496633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600939626590707:6103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:32.499506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600939626590707:6103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:32.499520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600939626590707:6103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:32.499524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600939626590707:6103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:32.499533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:32.499572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:32.501797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:32.501985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.501995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:32.502006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:32.502050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:32.502085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600938844379709:4981]
2025-10-10T14:32:32.502479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:32.502728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:32.502756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:32.502970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:32.503019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.503027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.503028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.503029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.503029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.503030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.503031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.503031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.503032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.503033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.503033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.503034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.503034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.503038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.503048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.503050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.503052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.503055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.503057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.503059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.503061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.503064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.503067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.503069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.503071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.503073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.503079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.503084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.503088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.503092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.503094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.503097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.503100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.503103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.503106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.503109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.503111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.503114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.503117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.503120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.503123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.503126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.503130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.503133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.503136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.503139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.503141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.503144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.503147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.503150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.503153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.503155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.503191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:32.505412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:32.505958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:32.505970Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:32.505972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:32.505975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:32.505979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 622 [2:7559600938844379709:4981]
2025-10-10T14:32:32.505989Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:32.506003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:32.506007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.506011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.506014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.506029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:32.506042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:32.506050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:32.506108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.506115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.506117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.506119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:32.506182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:32.506190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.506200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.506209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.506227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:32.506253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590684:2438], now have 1 active actors on pipe
2025-10-10T14:32:32.506261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590876:6103], now have 1 active actors on pipe
2025-10-10T14:32:32.506269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600938844379703:4981]
2025-10-10T14:32:32.506275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600938844379703:4981]
2025-10-10T14:32:32.506277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600938844379703:4981]
2025-10-10T14:32:32.506292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:32.506305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:32.506313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:32.506316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:32.506318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:32.506324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:32.506328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:32.506319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 622
2025-10-10T14:32:32.506351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600938844379703:4981]
2025-10-10T14:32:32.506322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 622
2025-10-10T14:32:32.506359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:32.506362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:32.506386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.506396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.506433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:32.506447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.506450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.506452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:32.506465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.506480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:32.506504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.506655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.506662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.506675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.506763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 623 partition: 0 MaxSeqNo: 40 sessionId: src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0
2025-10-10T14:32:32.507142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef38f93-bdf31bce-4c1b0b8a-b72a8abc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:32.509723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0] Write session: try to update token
2025-10-10T14:32:32.509739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:32.524019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId: src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:32.524860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:32.524877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:32.524879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:32.524881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:32.524889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600938844379703:4981]
2025-10-10T14:32:32.524892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600938844379703:4981]
2025-10-10T14:32:32.524895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600938844379703:4981]
2025-10-10T14:32:32.524936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:32.524942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.524944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:32.524944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:32.524949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:32.524953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:32.525100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:32.526962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:32.585942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600939626590895:5983]
2025-10-10T14:32:32.586210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 622, pipe: [1:7559600939626590895:5983]
2025-10-10T14:32:32.629575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:32.629891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.629905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.629946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590895:5983], now have 1 active actors on pipe
2025-10-10T14:32:32.630169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:32.630169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:32.630174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:32.630226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600939626590895:5983]
2025-10-10T14:32:32.630229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 623 reason: error at write: Disconnected sessionId: src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0
2025-10-10T14:32:32.630461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 623 sessionId: src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0 is DEAD
2025-10-10T14:32:32.630622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:32.630632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0] Write session will restart in 0.008264s
2025-10-10T14:32:32.630606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:32.630654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0] Write session: Do CDS request
2025-10-10T14:32:32.630662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:32.639875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.639972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:32.639988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 624
2025-10-10T14:32:32.640148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.640184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:32.640194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:32.640199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:32.640540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 624 sessionId:  describe result for acl check
2025-10-10T14:32:32.640575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:32.640582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:32.640584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:32.640591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600939626591029:6115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:32.641096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600939626591029:6115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:32.643040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600939626591029:6115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:32.643251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:32.645275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:32.645420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600939626591029:6115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:32.645433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600939626591029:6115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:32.645436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600939626591029:6115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:32.645444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:32.645496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.645506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:32.645518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:32.645569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:32.645604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600938844379925:4986]
2025-10-10T14:32:32.646225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:32.646452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:32.646491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:32.646812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:32.646877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.646883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.646884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.646885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.646886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.646888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.646889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.646890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.646891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.646892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.646893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.646894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.646895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.646901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.646913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.646917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.646921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.646925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.646929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.646933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.646937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.646941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.646945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.646949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.646953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.646956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.646963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.646976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.646982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.646992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.647000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.647005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.647013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.647019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.647023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.647028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.647036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.647041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.647050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.647059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.647067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.647072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.647080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.647085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.647090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.647095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.647103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.647108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.647116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.647121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.647129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.647134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.647173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:32.649365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:32.649942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:32.649953Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:32.649955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:32.649959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:32.649965Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 623 [2:7559600938844379925:4986]
2025-10-10T14:32:32.649977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:32.649996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:32.650000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.650003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.650006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.650024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:32.650036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:32.650045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:32.650107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.650114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.650116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.650118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:32.650186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:32.650194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.650206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.650217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.650232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:32.650262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626590900:2438], now have 1 active actors on pipe
2025-10-10T14:32:32.650270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626591106:6115], now have 1 active actors on pipe
2025-10-10T14:32:32.650277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600938844379920:4986]
2025-10-10T14:32:32.650280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600938844379920:4986]
2025-10-10T14:32:32.650282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600938844379920:4986]
2025-10-10T14:32:32.650297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 623
2025-10-10T14:32:32.650306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:32.650324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:32.650335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 623
2025-10-10T14:32:32.650323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:32.650327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:32.650329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:32.650340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:32.650344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:32.650380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600938844379920:4986]
2025-10-10T14:32:32.650392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:32.650407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.650411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:32.650417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.650466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d220fcdd-a84aefff-1d175547-8fec508_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:32.650485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.650489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.650491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:32.650503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.650519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:32.650540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.650683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.650689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.650703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.650799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 624 partition: 0 MaxSeqNo: 40 sessionId: src_id|d220fcdd-a84aefff-1d175547-8fec508_0
2025-10-10T14:32:32.651244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2117ed6c-206692fd-aca14398-ed8f2b28_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d220fcdd-a84aefff-1d175547-8fec508_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:32.654021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d220fcdd-a84aefff-1d175547-8fec508_0] Write session: try to update token
2025-10-10T14:32:32.654044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d220fcdd-a84aefff-1d175547-8fec508_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:32.668192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId: src_id|d220fcdd-a84aefff-1d175547-8fec508_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:32.669861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:32.669878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:32.669880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:32.669881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:32.669888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600938844379920:4986]
2025-10-10T14:32:32.669891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600938844379920:4986]
2025-10-10T14:32:32.669893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600938844379920:4986]
2025-10-10T14:32:32.669934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:32.669940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.669938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:32.669941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:32.669945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:32.669949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:32.670075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:32.670854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:32.730327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600939626591129:5983]
2025-10-10T14:32:32.730587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 623, pipe: [1:7559600939626591129:5983]
2025-10-10T14:32:32.776072Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:32.776306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.776319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.776359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626591129:5983], now have 1 active actors on pipe
2025-10-10T14:32:32.776554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:32.776600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600939626591129:5983]
2025-10-10T14:32:32.776618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:32.776622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:32.776626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:32.776687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 624 reason: error at write: Disconnected sessionId: src_id|d220fcdd-a84aefff-1d175547-8fec508_0
2025-10-10T14:32:32.776912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 624 sessionId: src_id|d220fcdd-a84aefff-1d175547-8fec508_0 is DEAD
2025-10-10T14:32:32.777086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d220fcdd-a84aefff-1d175547-8fec508_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:32.777096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d220fcdd-a84aefff-1d175547-8fec508_0] Write session will restart in 0.009549s
2025-10-10T14:32:32.777125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d220fcdd-a84aefff-1d175547-8fec508_0] Write session: Do CDS request
2025-10-10T14:32:32.777130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d220fcdd-a84aefff-1d175547-8fec508_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:32.787817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d220fcdd-a84aefff-1d175547-8fec508_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.788150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:32.788164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 625
2025-10-10T14:32:32.788304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.788339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:32.788353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:32.788357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:32.788774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 625 sessionId:  describe result for acl check
2025-10-10T14:32:32.788805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:32.788812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:32.788814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:32.788820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600939626591294:6122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:32.789283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:32.789366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600939626591294:6122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:32.791496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:32.791582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600939626591294:6122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:32.791683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.791696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:32.791707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:32.791767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:32.791808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600938844380154:4999]
2025-10-10T14:32:32.792405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:32.792665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:32.792707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:32.793040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:32.793093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.793100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.793101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.793102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.793103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.793104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.793105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.793107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.793108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.793109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.793111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.793112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.793113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.793119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.793134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.793138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.793142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.793145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.793149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.793158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.793162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.793166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.793170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.793174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.793183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.793187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.793199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.793212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.793223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.793233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.793251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.793260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.793264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.793269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.793274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.793280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.793288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.793294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.793299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.793304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.793308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.793314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.793318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.793323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.793346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.793355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.793360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.793366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.793374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.793379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.793388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.793397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.793443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:32.793806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600939626591294:6122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:32.793820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600939626591294:6122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:32.793824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600939626591294:6122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:32.793831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:32.795634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:32.796007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:32.796019Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:32.796022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:32.796026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:32.796032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 624 [2:7559600938844380154:4999]
2025-10-10T14:32:32.796046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:32.796067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:32.796074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.796079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.796081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.796098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:32.796110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:32.796123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:32.796180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.796189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.796192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.796194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:32.796258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:32.796266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.796278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.796290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.796314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:32.796340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626591330:6122], now have 1 active actors on pipe
2025-10-10T14:32:32.796348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626591130:2438], now have 1 active actors on pipe
2025-10-10T14:32:32.796356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600938844380149:4999]
2025-10-10T14:32:32.796362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600938844380149:4999]
2025-10-10T14:32:32.796365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600938844380149:4999]
2025-10-10T14:32:32.796362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 624
2025-10-10T14:32:32.796379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:32.796366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 624
2025-10-10T14:32:32.796398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:32.796399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:32.796402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:32.796405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:32.796418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:32.796422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:32.796456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.796465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.796485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600938844380149:4999]
2025-10-10T14:32:32.796497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:32.796520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:32.796533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:32.796545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.796554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.796556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:32.796568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.796582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:32.796609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.796735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.796744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.796761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.796848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 625 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0
2025-10-10T14:32:32.797203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d220fcdd-a84aefff-1d175547-8fec508_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:32.799819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0] Write session: try to update token
2025-10-10T14:32:32.799837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:32.813970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId: src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:32.815000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:32.815014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:32.815016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:32.815017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:32.815024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600938844380149:4999]
2025-10-10T14:32:32.815028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600938844380149:4999]
2025-10-10T14:32:32.815031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600938844380149:4999]
2025-10-10T14:32:32.815077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:32.815088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:32.815089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.815092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:32.815093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:32.815096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:32.815225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:32.816342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:32.876735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600939626591337:5983]
2025-10-10T14:32:32.877019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 624, pipe: [1:7559600939626591337:5983]
2025-10-10T14:32:32.919360Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:32.919715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.919728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.919767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626591337:5983], now have 1 active actors on pipe
2025-10-10T14:32:32.920028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:32.920040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:32.920040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600939626591337:5983]
2025-10-10T14:32:32.920064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:32.920114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 625 reason: error at write: Disconnected sessionId: src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0
2025-10-10T14:32:32.920163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:32.920345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 625 sessionId: src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0 is DEAD
2025-10-10T14:32:32.920494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:32.920504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0] Write session will restart in 0.009924s
2025-10-10T14:32:32.920530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0] Write session: Do CDS request
2025-10-10T14:32:32.920535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:32.931944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.932039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:32.932053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 626
2025-10-10T14:32:32.932156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:32.932201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:32.932211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:32.932215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:32.932673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 626 sessionId:  describe result for acl check
2025-10-10T14:32:32.932712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:32.932718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:32.932720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:32.932729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600939626591504:6126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:32.932987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:32.933289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600939626591504:6126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:32.935225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:32.935376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:32.935388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:32.935396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:32.935417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600939626591504:6126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:32.935432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:32.935465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600938844380359:5001]
2025-10-10T14:32:32.935856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:32.936129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:32.936159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:32.936377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:32.936413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.936418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.936418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.936419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.936420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.936420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.936421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.936422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.936422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.936423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.936424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.936424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.936425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.936429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.936437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.936440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.936442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.936445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.936447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.936450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.936452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.936454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.936457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.936459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.936461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.936464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.936469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.936476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:32.936480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.936484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:32.936486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.936489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:32.936492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.936495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:32.936498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.936501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:32.936504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.936507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:32.936509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.936512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:32.936515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.936518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:32.936521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.936524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:32.936527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.936530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:32.936533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.936536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.936538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.936542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.936544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.936547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.936569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:32.938763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600939626591504:6126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:32.938775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600939626591504:6126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:32.938778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600939626591504:6126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:32.938792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:32.938819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:32.939118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:32.939130Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:32.939133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:32.939136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:32.939142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 625 [2:7559600938844380359:5001]
2025-10-10T14:32:32.939157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:32.939178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:32.939187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.939190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.939193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.939209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:32.939221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:32.939231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:32.939275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.939280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.939281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.939283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:32.939345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:32.939351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.939359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:32.939368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:32.939382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:32.939402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626591338:2438], now have 1 active actors on pipe
2025-10-10T14:32:32.939407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600939626591538:6126], now have 1 active actors on pipe
2025-10-10T14:32:32.939413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600938844380354:5001]
2025-10-10T14:32:32.939414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600938844380354:5001]
2025-10-10T14:32:32.939415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600938844380354:5001]
2025-10-10T14:32:32.939427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:32.939440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:32.939428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 625
2025-10-10T14:32:32.939447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:32.939432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 625
2025-10-10T14:32:32.939450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:32.939452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:32.939453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:32.939455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:32.939485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.939488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.939500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600938844380354:5001]
2025-10-10T14:32:32.939505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:32.939516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:32.939529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:32.939535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:32.939541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:32.939542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:32.939551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:32.939559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:32.939661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.939855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:32.939865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:32.939884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:32.939983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 626 partition: 0 MaxSeqNo: 40 sessionId: src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0
2025-10-10T14:32:32.940358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f705531-4a7fb7de-4bfba9ce-aae93379_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:32.942878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0] Write session: try to update token
2025-10-10T14:32:32.942894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:32.957363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId: src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:32.958319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:32.958334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:32.958337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:32.958338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:32.958345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600938844380354:5001]
2025-10-10T14:32:32.958348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600938844380354:5001]
2025-10-10T14:32:32.958351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600938844380354:5001]
2025-10-10T14:32:32.958391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:32.958397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:32.958399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:32.958405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:32.958414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:32.958419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:32.958542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:32.959847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:33.020088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600943921558842:5983]
2025-10-10T14:32:33.020331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 625, pipe: [1:7559600943921558842:5983]
2025-10-10T14:32:33.062499Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:33.062998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.063015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.063054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921558842:5983], now have 1 active actors on pipe
2025-10-10T14:32:33.063204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:33.063270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:33.063290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:33.063351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 626 reason: error at write: Disconnected sessionId: src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0
2025-10-10T14:32:33.063377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600943921558842:5983]
2025-10-10T14:32:33.063421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:33.063558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 626 sessionId: src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0 is DEAD
2025-10-10T14:32:33.063750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:33.063762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0] Write session will restart in 0.006032s
2025-10-10T14:32:33.063788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0] Write session: Do CDS request
2025-10-10T14:32:33.063797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:33.070889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.070953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:33.070966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 627
2025-10-10T14:32:33.071111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.071150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:33.071158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:33.071162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:33.071623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 627 sessionId:  describe result for acl check
2025-10-10T14:32:33.071656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:33.071663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:33.071665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:33.071671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600943921558875:6130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:33.072257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600943921558875:6130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:33.074918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600943921558875:6130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:33.077463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600943921558875:6130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:33.077450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:33.077474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600943921558875:6130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:33.077476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600943921558875:6130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:33.077483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:33.079982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:33.080159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:33.080168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:33.080177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:33.080220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:33.080269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600943139347862:5003]
2025-10-10T14:32:33.080721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:33.081031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:33.081106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:33.081530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:33.081591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.081595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.081596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.081597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.081598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.081598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.081599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.081599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.081600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.081601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.081601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.081602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.081603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.081609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.081620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.081624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.081628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.081632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.081636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.081641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.081644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.081647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.081650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.081652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.081654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.081656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.081662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.081668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.081673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.081677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.081681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.081684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.081687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.081698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.081701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.081704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.081707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.081710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.081713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.081716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.081719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.081726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.081730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.081733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.081739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.081742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.081745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.081748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.081754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.081757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.081760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.081763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.081793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:33.084143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:33.084457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:33.084465Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:33.084467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:33.084471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:33.084477Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 626 [2:7559600943139347862:5003]
2025-10-10T14:32:33.084490Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:33.084508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:33.084516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.084519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.084535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.084554Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:33.084566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:33.084575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:33.084626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.084632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.084634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.084637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:33.084820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:33.084843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.084828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 626
2025-10-10T14:32:33.084829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 626
2025-10-10T14:32:33.084855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.084868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.084888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:33.084910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921558843:2438], now have 1 active actors on pipe
2025-10-10T14:32:33.084916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559039:6130], now have 1 active actors on pipe
2025-10-10T14:32:33.084933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.084940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.084955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600943139347856:5003]
2025-10-10T14:32:33.084957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600943139347856:5003]
2025-10-10T14:32:33.084959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600943139347856:5003]
2025-10-10T14:32:33.084968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:33.084988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:33.084995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:33.084998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:33.085000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:33.085001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:33.085004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:33.085020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:33.085029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.085032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.085033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:33.085043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.085056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:33.085083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600943139347856:5003]
2025-10-10T14:32:33.085092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:33.085101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.085112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:33.085235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.085245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.085267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.085357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 627 partition: 0 MaxSeqNo: 40 sessionId: src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0
2025-10-10T14:32:33.085722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fad1d502-d0b19f8c-8dc5ead8-85e934fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:33.088492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0] Write session: try to update token
2025-10-10T14:32:33.088512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:33.101845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:33.101863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.101880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600943139347856:5003]
2025-10-10T14:32:33.101936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:33.101943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:33.102142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:33.102308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:33.102469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:33.102646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:33.102837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:33.102913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:33.103141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId: src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:33.105620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:33.105800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.105816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.105850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:33.105921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:33.113767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:33.113784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.113788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:33.113790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:33.113802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600943139347856:5003]
2025-10-10T14:32:33.113806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600943139347856:5003]
2025-10-10T14:32:33.113810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600943139347856:5003]
2025-10-10T14:32:33.113859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:33.113859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:33.113870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.113872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:33.113879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:33.113883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:33.114005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:33.163792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600943921559052:5983]
2025-10-10T14:32:33.164039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 626, pipe: [1:7559600943921559052:5983]
2025-10-10T14:32:33.218718Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:33.225645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.225665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.225813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.225871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.225931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.225998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.226204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.226212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.226272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.226325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.226383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.226455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.226494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.226499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.226556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.226612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.226670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.226744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.226788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.226796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.226874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.226930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.226985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.227049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.227093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.227098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.227160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.227227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.227284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.227341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.227381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.227386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.227442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.227499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.227554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.227611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.227650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.227655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.227724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.227778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.227835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.227892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.227937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.227943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.228000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.228053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.228114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.228175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.228213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.228218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.228274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.228325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.228391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.228454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.228494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.228499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.228554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:33.228616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:33.228674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:33.228735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:33.228774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:33.228779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:33.228816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559052:5983], now have 1 active actors on pipe
2025-10-10T14:32:33.229017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:33.229047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:33.229051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:33.229080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 627 reason: error at write: Disconnected sessionId: src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0
2025-10-10T14:32:33.229081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600943921559052:5983]
2025-10-10T14:32:33.229241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:33.229297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 627 sessionId: src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0 is DEAD
2025-10-10T14:32:33.229448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:33.229459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0] Write session will restart in 0.009554s
2025-10-10T14:32:33.229482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0] Write session: Do CDS request
2025-10-10T14:32:33.229487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:33.239719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.239919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:33.239932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 628
2025-10-10T14:32:33.240090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.240122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:33.240125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:33.240127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:33.240624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 628 sessionId:  describe result for acl check
2025-10-10T14:32:33.240646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:33.240651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:33.240652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:33.240656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600943921559226:6135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:33.241060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600943921559226:6135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:33.241978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:33.243021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600943921559226:6135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:33.244140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:33.244385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:33.244395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:33.244404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:33.244446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:33.244479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600943139348080:5006]
2025-10-10T14:32:33.244771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600943921559226:6135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:33.244781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600943921559226:6135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:33.244783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600943921559226:6135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:33.244789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:33.244858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:33.245064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:33.245093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:33.245295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:33.245353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.245359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.245360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.245361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.245363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.245364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.245365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.245366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.245367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.245369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.245370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.245371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.245372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.245378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.245388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.245390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.245393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.245395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.245397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.245399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.245401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.245403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.245406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.245408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.245410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.245412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.245417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.245423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.245429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.245432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.245435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.245438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.245440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.245444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.245446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.245449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.245452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.245455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.245458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.245462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.245464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.245467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.245470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.245474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.245476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.245479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.245483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.245486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.245488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.245491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.245493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.245497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.245518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:33.247560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:33.247943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:33.247952Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:33.247953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:33.247956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:33.247960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 627 [2:7559600943139348080:5006]
2025-10-10T14:32:33.247968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:33.247980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:33.247982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.247985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.247986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.248001Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:33.248006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:33.248017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:33.248055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.248060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.248061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.248063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:33.248112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:33.248127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.248137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.248143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.248156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:33.248176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559264:6135], now have 1 active actors on pipe
2025-10-10T14:32:33.248182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559065:2438], now have 1 active actors on pipe
2025-10-10T14:32:33.248187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600943139348075:5006]
2025-10-10T14:32:33.248189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600943139348075:5006]
2025-10-10T14:32:33.248190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600943139348075:5006]
2025-10-10T14:32:33.248202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:33.248216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:33.248218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:33.248221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:33.248222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:33.248228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:33.248230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:33.248246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600943139348075:5006]
2025-10-10T14:32:33.248252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:33.248233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 627
2025-10-10T14:32:33.248234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 627
2025-10-10T14:32:33.248276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:33.248279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.248282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.248304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:33.248314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.248316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.248318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:33.248326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.248338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:33.248347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.248498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.248503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.248514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.248607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 628 partition: 0 MaxSeqNo: 40 sessionId: src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0
2025-10-10T14:32:33.248922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41fa64c1-dbeea28e-669b13ff-26896bb8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:33.251423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0] Write session: try to update token
2025-10-10T14:32:33.251443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:33.264597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId: src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:33.266757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:33.266780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.266783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:33.266784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:33.266792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600943139348075:5006]
2025-10-10T14:32:33.266799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600943139348075:5006]
2025-10-10T14:32:33.266801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600943139348075:5006]
2025-10-10T14:32:33.266852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:33.266856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:33.266860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.266861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:33.266862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:33.266867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:33.266989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:33.267148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:33.329344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600943921559276:5983]
2025-10-10T14:32:33.329523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 627, pipe: [1:7559600943921559276:5983]
2025-10-10T14:32:33.370535Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:33.370832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.370856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.370896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559276:5983], now have 1 active actors on pipe
2025-10-10T14:32:33.371064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:33.371098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:33.371108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:33.371174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 628 reason: error at write: Disconnected sessionId: src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0
2025-10-10T14:32:33.371374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 628 sessionId: src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0 is DEAD
2025-10-10T14:32:33.371373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600943921559276:5983]
2025-10-10T14:32:33.371390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:33.371548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:33.371560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0] Write session will restart in 0.009091s
2025-10-10T14:32:33.371586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0] Write session: Do CDS request
2025-10-10T14:32:33.371596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:33.381811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.381890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:33.381902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 629
2025-10-10T14:32:33.382014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.382050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:33.382058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:33.382061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:33.382252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:33.382392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 629 sessionId:  describe result for acl check
2025-10-10T14:32:33.382416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:33.382422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:33.382423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:33.382427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600943921559446:6139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:33.382866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600943921559446:6139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:33.384107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:33.384396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:33.384405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:33.384416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:33.384474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:33.384508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600943139348288:5008]
2025-10-10T14:32:33.384813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600943921559446:6139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:33.384910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:33.385143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:33.385177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:33.385426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:33.385477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.385483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.385484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.385484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.385485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.385486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.385486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.385487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.385487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.385488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.385489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.385489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.385490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.385493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.385501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.385504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.385506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.385509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.385511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.385513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.385515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.385517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.385519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.385521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.385523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.385525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.385532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.385537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.385543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.385549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.385553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.385558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.385563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.385568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.385573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.385576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.385579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.385582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.385585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.385588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.385591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.385594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.385597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.385600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.385602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.385605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.385608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.385611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.385614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.385617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.385619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.385622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.385644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:33.387710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600943921559446:6139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:33.387723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600943921559446:6139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:33.387727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600943921559446:6139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:33.387734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:33.387738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:33.388021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:33.388031Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:33.388032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:33.388034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:33.388038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 628 [2:7559600943139348288:5008]
2025-10-10T14:32:33.388047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:33.388058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:33.388060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.388062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.388063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.388071Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:33.388077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:33.388086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:33.388125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.388130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.388131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.388133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:33.388180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:33.388185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.388192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.388198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.388211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:33.388227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559479:6139], now have 1 active actors on pipe
2025-10-10T14:32:33.388231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559277:2438], now have 1 active actors on pipe
2025-10-10T14:32:33.388236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600943139348283:5008]
2025-10-10T14:32:33.388238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600943139348283:5008]
2025-10-10T14:32:33.388239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600943139348283:5008]
2025-10-10T14:32:33.388248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:33.388257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:33.388259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:33.388261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:33.388266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:33.388276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:33.388265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 628
2025-10-10T14:32:33.388281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:33.388266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 628
2025-10-10T14:32:33.388306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600943139348283:5008]
2025-10-10T14:32:33.388314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:33.388318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:33.388324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.388328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.388363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:33.388371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.388373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.388375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:33.388382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.388390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:33.388403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.388524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.388530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.388541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.388602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 629 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0
2025-10-10T14:32:33.388958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85674d2-2345fba2-6ef7a1ed-1a800c2b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:33.391521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0] Write session: try to update token
2025-10-10T14:32:33.391538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:33.404602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId: src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:33.406708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:33.406727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.406730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:33.406733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:33.406743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600943139348283:5008]
2025-10-10T14:32:33.406761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600943139348283:5008]
2025-10-10T14:32:33.406765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600943139348283:5008]
2025-10-10T14:32:33.406808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:33.406816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:33.406818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:33.406821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:33.406827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.406829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:33.406987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:33.407040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:33.471687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600943921559487:5983]
2025-10-10T14:32:33.471932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 628, pipe: [1:7559600943921559487:5983]
2025-10-10T14:32:33.515233Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:33.515507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.515519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.515558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559487:5983], now have 1 active actors on pipe
2025-10-10T14:32:33.515696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:33.515721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600943921559487:5983]
2025-10-10T14:32:33.515732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:33.515736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:33.515757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:33.515799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 629 reason: error at write: Disconnected sessionId: src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0
2025-10-10T14:32:33.515986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 629 sessionId: src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0 is DEAD
2025-10-10T14:32:33.516173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:33.516185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0] Write session will restart in 0.007922s
2025-10-10T14:32:33.516211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0] Write session: Do CDS request
2025-10-10T14:32:33.516218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:33.524825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.524894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:33.524918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 630
2025-10-10T14:32:33.525058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.525094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:33.525114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:33.525117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:33.525515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 630 sessionId:  describe result for acl check
2025-10-10T14:32:33.525542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:33.525543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:33.525545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:33.525549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600943921559599:6143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:33.525988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600943921559599:6143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:33.527643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600943921559599:6143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:33.528112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:33.529956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:33.530066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600943921559599:6143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:33.530078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600943921559599:6143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:33.530082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600943921559599:6143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:33.530090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:33.530133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:33.530142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:33.530152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:33.530195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:33.530226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600943139348497:5010]
2025-10-10T14:32:33.530617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:33.530868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:33.530902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:33.531142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:33.531182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.531186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.531187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.531187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.531188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.531189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.531189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.531190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.531190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.531191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.531192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.531192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.531193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.531196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.531204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.531207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.531209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.531211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.531213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.531215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.531217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.531219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.531221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.531223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.531225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.531227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.531232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.531237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.531244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.531248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.531250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.531253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.531256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.531259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.531263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.531266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.531269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.531272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.531275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.531278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.531281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.531284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.531287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.531290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.531292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.531295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.531298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.531300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.531303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.531306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.531309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.531312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.531333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:33.533457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:33.533824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:33.533837Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:33.533839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:33.533842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:33.533847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 629 [2:7559600943139348497:5010]
2025-10-10T14:32:33.533854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:33.533866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:33.533868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.533870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.533871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.533884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:33.533893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:33.533899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:33.533940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.533958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.533963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.533966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:33.534023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:33.534031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.534038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.534044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.534054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:33.534079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559488:2438], now have 1 active actors on pipe
2025-10-10T14:32:33.534087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559688:6143], now have 1 active actors on pipe
2025-10-10T14:32:33.534094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600943139348492:5010]
2025-10-10T14:32:33.534096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600943139348492:5010]
2025-10-10T14:32:33.534098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600943139348492:5010]
2025-10-10T14:32:33.534109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:33.534122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:33.534123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:33.534117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 629
2025-10-10T14:32:33.534126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:33.534129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 629
2025-10-10T14:32:33.534127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:33.534135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:33.534138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:33.534156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600943139348492:5010]
2025-10-10T14:32:33.534158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:33.534159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:33.534173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.534180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.534281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3871acc5-96aa48b1-522c4137-77673f80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:33.534292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.534295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.534296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:33.534303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.534312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:33.534332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.534460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.534465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.534477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.534547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 630 partition: 0 MaxSeqNo: 40 sessionId: src_id|3871acc5-96aa48b1-522c4137-77673f80_0
2025-10-10T14:32:33.534827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5fc5f02-5b9a62d0-8d656d56-99c50fbb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3871acc5-96aa48b1-522c4137-77673f80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:33.537492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3871acc5-96aa48b1-522c4137-77673f80_0] Write session: try to update token
2025-10-10T14:32:33.537507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3871acc5-96aa48b1-522c4137-77673f80_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:33.551276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId: src_id|3871acc5-96aa48b1-522c4137-77673f80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:33.553030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:33.553047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.553049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:33.553051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:33.553060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600943139348492:5010]
2025-10-10T14:32:33.553063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600943139348492:5010]
2025-10-10T14:32:33.553067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600943139348492:5010]
2025-10-10T14:32:33.553103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:33.553107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:33.553109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:33.553112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:33.553114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.553116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:33.553248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:33.553805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:33.616060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600943921559706:5983]
2025-10-10T14:32:33.616315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 629, pipe: [1:7559600943921559706:5983]
2025-10-10T14:32:33.657593Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:33.657917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.657936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.657987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559706:5983], now have 1 active actors on pipe
2025-10-10T14:32:33.658203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:33.658197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:33.658199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:33.658203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:33.658250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600943921559706:5983]
2025-10-10T14:32:33.658265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 630 reason: error at write: Disconnected sessionId: src_id|3871acc5-96aa48b1-522c4137-77673f80_0
2025-10-10T14:32:33.658508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 630 sessionId: src_id|3871acc5-96aa48b1-522c4137-77673f80_0 is DEAD
2025-10-10T14:32:33.658711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3871acc5-96aa48b1-522c4137-77673f80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:33.658725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3871acc5-96aa48b1-522c4137-77673f80_0] Write session will restart in 0.006482s
2025-10-10T14:32:33.658753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3871acc5-96aa48b1-522c4137-77673f80_0] Write session: Do CDS request
2025-10-10T14:32:33.658764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3871acc5-96aa48b1-522c4137-77673f80_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:33.666843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3871acc5-96aa48b1-522c4137-77673f80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.666983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:33.667000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 631
2025-10-10T14:32:33.667125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.667161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:33.667167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:33.667171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:33.667537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 631 sessionId:  describe result for acl check
2025-10-10T14:32:33.667573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:33.667574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:33.667576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:33.667580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600943921559791:6149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:33.668003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600943921559791:6149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:33.670256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600943921559791:6149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:33.671043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:33.673161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:33.673318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:33.673341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:33.673351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:33.673396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:33.673436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600943139348708:5013]
2025-10-10T14:32:33.673458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600943921559791:6149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:33.673471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600943921559791:6149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:33.673474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600943921559791:6149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:33.673482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:33.673813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:33.674051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:33.674081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:33.674408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:33.674457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.674462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.674463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.674463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.674464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.674465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.674465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.674466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.674467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.674467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.674468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.674468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.674469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.674473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.674481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.674483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.674485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.674488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.674490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.674492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.674494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.674497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.674500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.674502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.674505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.674507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.674513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.674518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.674523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.674527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.674529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.674533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.674535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.674539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.674541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.674544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.674547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.674550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.674553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.674556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.674558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.674561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.674564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.674567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.674569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.674572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.674574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.674577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.674579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.674582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.674585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.674588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.674609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:33.676736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:33.677029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:33.677038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:33.677040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:33.677043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:33.677047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 630 [2:7559600943139348708:5013]
2025-10-10T14:32:33.677057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:33.677069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:33.677071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.677073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.677074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.677086Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:33.677091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:33.677096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:33.677130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.677136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.677137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.677139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:33.677188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:33.677193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.677199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.677206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.677216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:33.677232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600943139348703:5013]
2025-10-10T14:32:33.677237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600943139348703:5013]
2025-10-10T14:32:33.677239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600943139348703:5013]
2025-10-10T14:32:33.677246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:33.677255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559711:2438], now have 1 active actors on pipe
2025-10-10T14:32:33.677257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:33.677260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:33.677262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:33.677262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559912:6149], now have 1 active actors on pipe
2025-10-10T14:32:33.677266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:33.677275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:33.677277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:33.677292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600943139348703:5013]
2025-10-10T14:32:33.677301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:33.677318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:33.677298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 630
2025-10-10T14:32:33.677339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 630
2025-10-10T14:32:33.677404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.677412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.677433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:33.677442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.677445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.677447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:33.677455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.677465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:33.677478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.677599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.677605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.677615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.677691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 631 partition: 0 MaxSeqNo: 40 sessionId: src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0
2025-10-10T14:32:33.678053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3871acc5-96aa48b1-522c4137-77673f80_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:33.680710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0] Write session: try to update token
2025-10-10T14:32:33.680727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:33.688508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:33.688529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.688540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600943139348703:5013]
2025-10-10T14:32:33.688585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:33.688609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:33.688760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:33.688909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:33.689042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:33.689182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:33.689622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:33.689671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:33.699881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId: src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:33.709197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:33.710166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.710182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.710201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:33.710203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.710206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:33.710207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:33.710214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600943139348703:5013]
2025-10-10T14:32:33.710217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600943139348703:5013]
2025-10-10T14:32:33.710219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600943139348703:5013]
2025-10-10T14:32:33.710258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:33.710258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:33.710263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:33.710265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:33.710267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.710268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:33.710385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:33.758406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600943921559947:5983]
2025-10-10T14:32:33.758670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 630, pipe: [1:7559600943921559947:5983]
2025-10-10T14:32:33.815686Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:33.816051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:33.816086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559947:5983], now have 1 active actors on pipe
2025-10-10T14:32:33.816214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:33.816260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600943921559947:5983]
2025-10-10T14:32:33.816277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:33.816324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:33.816332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:33.816423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 631 reason: error at write: Disconnected sessionId: src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0
2025-10-10T14:32:33.816602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 631 sessionId: src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0 is DEAD
2025-10-10T14:32:33.816785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:33.816797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0] Write session will restart in 0.007216s
2025-10-10T14:32:33.816821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0] Write session: Do CDS request
2025-10-10T14:32:33.816827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:33.824862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.824954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:33.824978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 632
2025-10-10T14:32:33.825083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.825120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:33.825130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:33.825134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:33.825537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 632 sessionId:  describe result for acl check
2025-10-10T14:32:33.825568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:33.825569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:33.825571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:33.825575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600943921560002:6162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:33.826058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600943921560002:6162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:33.828515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600943921560002:6162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:33.830319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:33.830529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600943921560002:6162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:33.830538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600943921560002:6162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:33.830541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600943921560002:6162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:33.830546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:33.832494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:33.832642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:33.832651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:33.832659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:33.832696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:33.832729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600943139348957:5028]
2025-10-10T14:32:33.833114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:33.833367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:33.833396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:33.833590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:33.833628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.833632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.833633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.833634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.833634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.833635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.833636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.833636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.833637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.833637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.833638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.833639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.833639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.833643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.833652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.833654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.833657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.833659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.833661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.833664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.833666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.833668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.833671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.833673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.833675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.833678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.833684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.833689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.833694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.833697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.833700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.833703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.833705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.833709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.833711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.833714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.833716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.833719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.833722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.833725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.833727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.833731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.833734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.833737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.833739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.833742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.833745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.833748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.833751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.833754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.833756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.833759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.833780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:33.835939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:33.836373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:33.836385Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:33.836387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:33.836391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:33.836396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 631 [2:7559600943139348957:5028]
2025-10-10T14:32:33.836408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:33.836422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:33.836430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.836433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.836436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.836460Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:33.836469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:33.836476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:33.836516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.836522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.836524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.836526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:33.836589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:33.836595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.836602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.836608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.836621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:33.836640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921560151:6162], now have 1 active actors on pipe
2025-10-10T14:32:33.836645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921559949:2438], now have 1 active actors on pipe
2025-10-10T14:32:33.836651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600943139348951:5028]
2025-10-10T14:32:33.836653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600943139348951:5028]
2025-10-10T14:32:33.836654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600943139348951:5028]
2025-10-10T14:32:33.836664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:33.836679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:33.836680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:33.836682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:33.836685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:33.836698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:33.836703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:33.836700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 631
2025-10-10T14:32:33.836727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600943139348951:5028]
2025-10-10T14:32:33.836733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:33.836717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 631
2025-10-10T14:32:33.836735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:33.836745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.836749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.836793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:33.836805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.836808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.836810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:33.836820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.836834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:33.836851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.836953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.836963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.836981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.837057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 632 partition: 0 MaxSeqNo: 40 sessionId: src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0
2025-10-10T14:32:33.837379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0ba71cd-62047e80-52d1c053-5a1e9911_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:33.839904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0] Write session: try to update token
2025-10-10T14:32:33.839918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:33.853031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId: src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:33.855346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:33.855516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:33.855531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.855534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:33.855535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:33.855543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600943139348951:5028]
2025-10-10T14:32:33.855547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600943139348951:5028]
2025-10-10T14:32:33.855550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600943139348951:5028]
2025-10-10T14:32:33.855582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:33.855594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.855594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:33.855600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:33.855601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.855620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:33.855629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.855631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:33.855758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:33.916600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600943921560162:5983]
2025-10-10T14:32:33.916834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 631, pipe: [1:7559600943921560162:5983]
2025-10-10T14:32:33.958451Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:33.958920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921560162:5983], now have 1 active actors on pipe
2025-10-10T14:32:33.959106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:33.959109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:33.959121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:33.959133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600943921560162:5983]
2025-10-10T14:32:33.959154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:33.959185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 632 reason: error at write: Disconnected sessionId: src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0
2025-10-10T14:32:33.959379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 632 sessionId: src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0 is DEAD
2025-10-10T14:32:33.959544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:33.959568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0] Write session will restart in 0.006764s
2025-10-10T14:32:33.959594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0] Write session: Do CDS request
2025-10-10T14:32:33.959600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:33.967866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.967982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:33.967998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 633
2025-10-10T14:32:33.968116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:33.968149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:33.968159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:33.968163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:33.968675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 633 sessionId:  describe result for acl check
2025-10-10T14:32:33.968718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:33.968724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:33.968727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:33.968733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600943921560229:6166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:33.969256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600943921560229:6166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:33.971349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600943921560229:6166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:33.972963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:33.975099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:33.975300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:33.975315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:33.975327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:33.975383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:33.975403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600943921560229:6166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:33.975426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600943139349166:5030]
2025-10-10T14:32:33.975415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600943921560229:6166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:33.975418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600943921560229:6166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:33.975424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:33.975883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:33.976232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:33.976283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:33.976512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:33.976547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.976552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.976552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.976553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.976554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.976554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.976555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.976556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.976556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.976557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.976558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.976559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.976559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.976563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.976572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.976574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.976576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.976578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.976581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.976583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.976585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.976587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.976589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.976591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.976593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.976595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.976600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.976606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:33.976611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.976614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:33.976616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.976619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:33.976622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.976625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:33.976628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.976631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:33.976633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.976637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:33.976641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.976644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:33.976646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.976649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:33.976652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.976655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:33.976658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.976662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:33.976664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.976667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.976669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.976672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.976675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.976678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.976700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:33.978866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:33.979353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:33.979365Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:33.979367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:33.979370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:33.979376Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 632 [2:7559600943139349166:5030]
2025-10-10T14:32:33.979386Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:33.979398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:33.979404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.979406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.979407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.979419Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:33.979427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:33.979433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:33.979489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.979496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.979498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.979500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:33.979569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:33.979577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.979588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:33.979600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:33.979622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:33.979648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921560367:6166], now have 1 active actors on pipe
2025-10-10T14:32:33.979656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600943921560167:2438], now have 1 active actors on pipe
2025-10-10T14:32:33.979664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600943139349161:5030]
2025-10-10T14:32:33.979669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600943139349161:5030]
2025-10-10T14:32:33.979671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600943139349161:5030]
2025-10-10T14:32:33.979682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:33.979693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:33.979678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 632
2025-10-10T14:32:33.979706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:33.979712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:33.979714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:33.979717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:33.979718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:33.979730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600943139349161:5030]
2025-10-10T14:32:33.979722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 632
2025-10-10T14:32:33.979733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:33.979743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:33.979746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.979749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.979787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:33.979797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:33.979801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:33.979803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:33.979813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:33.979828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:33.979849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.979989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:33.979997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:33.980012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:33.980113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 633 partition: 0 MaxSeqNo: 40 sessionId: src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0
2025-10-10T14:32:33.980456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9046f4fc-9940c369-9ed4333d-b3111cf3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:33.983097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0] Write session: try to update token
2025-10-10T14:32:33.983112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:33.996950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId: src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:33.998308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:33.998325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:33.998330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:33.998332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:33.998341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600943139349161:5030]
2025-10-10T14:32:33.998346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600943139349161:5030]
2025-10-10T14:32:33.998350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600943139349161:5030]
2025-10-10T14:32:33.998399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:33.998406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:33.998408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:33.998420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:33.998435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:33.998444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:33.998537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:33.999614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:34.059449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600948216527674:5983]
2025-10-10T14:32:34.059725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 632, pipe: [1:7559600948216527674:5983]
2025-10-10T14:32:34.103183Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:34.103559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.103572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.103613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216527674:5983], now have 1 active actors on pipe
2025-10-10T14:32:34.103796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:34.103831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:34.103844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:34.103858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:34.103899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600948216527674:5983]
2025-10-10T14:32:34.103904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 633 reason: error at write: Disconnected sessionId: src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0
2025-10-10T14:32:34.104101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 633 sessionId: src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0 is DEAD
2025-10-10T14:32:34.104276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:34.104291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0] Write session will restart in 0.009646s
2025-10-10T14:32:34.104316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0] Write session: Do CDS request
2025-10-10T14:32:34.104323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:34.114955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.115062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:34.115076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 634
2025-10-10T14:32:34.115215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.115254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:34.115259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:34.115263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:34.115739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 634 sessionId:  describe result for acl check
2025-10-10T14:32:34.115777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:34.115785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:34.115787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:34.115794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600948216527794:6170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:34.116293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600948216527794:6170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:34.118216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600948216527794:6170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:34.118482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:34.120725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:34.120810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600948216527794:6170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:34.120823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600948216527794:6170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:34.120826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600948216527794:6170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:34.120835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:34.120916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:34.120925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:34.120935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:34.120981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:34.121019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600947434316674:5032]
2025-10-10T14:32:34.121470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:34.121762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:34.121804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:34.122031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:34.122072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.122077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.122077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.122078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.122079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.122080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.122081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.122081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.122082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.122083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.122083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.122084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.122085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.122089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.122098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.122101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.122103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.122105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.122110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.122114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.122118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.122122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.122126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.122129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.122134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.122138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.122145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.122151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.122156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.122160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.122164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.122167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.122169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.122172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.122175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.122179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.122181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.122184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.122187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.122190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.122193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.122197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.122200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.122203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.122206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.122210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.122212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.122216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.122218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.122221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.122224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.122227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.122251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:34.124524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:34.124821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:34.124831Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:34.124832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:34.124836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:34.124841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 633 [2:7559600947434316674:5032]
2025-10-10T14:32:34.124850Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:34.124863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:34.124877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.124879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.124880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.124890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:34.124896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:34.124903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:34.124945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.124951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.124952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.124954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:34.125021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:34.125027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.125036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.125047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.125064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:34.125087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216527879:6170], now have 1 active actors on pipe
2025-10-10T14:32:34.125093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216527675:2438], now have 1 active actors on pipe
2025-10-10T14:32:34.125099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600947434316669:5032]
2025-10-10T14:32:34.125101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600947434316669:5032]
2025-10-10T14:32:34.125103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600947434316669:5032]
2025-10-10T14:32:34.125113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:34.125124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:34.125134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:34.125137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:34.125140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:34.125145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:34.125147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:34.125158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600947434316669:5032]
2025-10-10T14:32:34.125163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:34.125165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:34.125167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 633
2025-10-10T14:32:34.125168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 633
2025-10-10T14:32:34.125228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.125236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.125265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ac05347-f753590d-3762964e-e6d8c74d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:34.125275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.125278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.125279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:34.125289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.125298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:34.125310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.125480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.125490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.125506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.125595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 634 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ac05347-f753590d-3762964e-e6d8c74d_0
2025-10-10T14:32:34.126054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c849e344-70c7c0be-230a3e40-a2e7b5fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ac05347-f753590d-3762964e-e6d8c74d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:34.128902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac05347-f753590d-3762964e-e6d8c74d_0] Write session: try to update token
2025-10-10T14:32:34.128921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac05347-f753590d-3762964e-e6d8c74d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:34.143115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId: src_id|7ac05347-f753590d-3762964e-e6d8c74d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:34.144911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:34.144927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:34.144929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:34.144931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:34.144939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600947434316669:5032]
2025-10-10T14:32:34.144943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600947434316669:5032]
2025-10-10T14:32:34.144945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600947434316669:5032]
2025-10-10T14:32:34.144988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:34.144998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:34.145002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.145003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:34.145006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:34.145011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:34.145138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:34.145627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:34.203826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600948216527903:5983]
2025-10-10T14:32:34.204060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 633, pipe: [1:7559600948216527903:5983]
2025-10-10T14:32:34.251999Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:34.252438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.252456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.252500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216527903:5983], now have 1 active actors on pipe
2025-10-10T14:32:34.252674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:34.252710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:34.252731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:34.252757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600948216527903:5983]
2025-10-10T14:32:34.252784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 634 reason: error at write: Disconnected sessionId: src_id|7ac05347-f753590d-3762964e-e6d8c74d_0
2025-10-10T14:32:34.252802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:34.252976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 634 sessionId: src_id|7ac05347-f753590d-3762964e-e6d8c74d_0 is DEAD
2025-10-10T14:32:34.253090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac05347-f753590d-3762964e-e6d8c74d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:34.253101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac05347-f753590d-3762964e-e6d8c74d_0] Write session will restart in 0.009817s
2025-10-10T14:32:34.253125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac05347-f753590d-3762964e-e6d8c74d_0] Write session: Do CDS request
2025-10-10T14:32:34.253159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac05347-f753590d-3762964e-e6d8c74d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:34.263873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac05347-f753590d-3762964e-e6d8c74d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.263963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:34.263976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 635
2025-10-10T14:32:34.264120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.264148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:34.264155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:34.264159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:34.264548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 635 sessionId:  describe result for acl check
2025-10-10T14:32:34.264590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:34.264599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:34.264601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:34.264608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600948216528078:6175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:34.265020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:34.265172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600948216528078:6175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:34.266988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600948216528078:6175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:34.267310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:34.267471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:34.267480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:34.267489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:34.267526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:34.267560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600947434316899:5035]
2025-10-10T14:32:34.267980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:34.268250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:34.268280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:34.268518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:34.268565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.268570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.268571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.268571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.268572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.268573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.268574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.268574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.268575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.268576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.268576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.268577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.268578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.268582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.268590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.268592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.268595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.268597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.268599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.268601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.268604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.268606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.268608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.268610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.268612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.268614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.268620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.268625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.268630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.268633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.268636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.268639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.268643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.268647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.268649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.268653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.268655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.268658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.268661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.268664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.268667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.268670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.268673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.268676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.268678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.268682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.268684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.268687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.268690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.268694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.268696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.268699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.268723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:34.269549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600948216528078:6175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:34.269562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600948216528078:6175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:34.269565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600948216528078:6175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:34.269573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:34.271026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:34.271474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:34.271486Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:34.271488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:34.271492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:34.271498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 634 [2:7559600947434316899:5035]
2025-10-10T14:32:34.271511Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:34.271545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:34.271554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.271558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.271560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.271578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:34.271589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:34.271598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:34.271898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.271906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.271909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.271912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:34.271982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:34.271989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.272002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.272015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.272036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:34.272064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528113:6175], now have 1 active actors on pipe
2025-10-10T14:32:34.272072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216527904:2438], now have 1 active actors on pipe
2025-10-10T14:32:34.272079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600947434316894:5035]
2025-10-10T14:32:34.272081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600947434316894:5035]
2025-10-10T14:32:34.272084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600947434316894:5035]
2025-10-10T14:32:34.272098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:34.272107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 634
2025-10-10T14:32:34.272117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:34.272113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 634
2025-10-10T14:32:34.272118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:34.272125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:34.272126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:34.272138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:34.272141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:34.272191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.272201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.272220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600947434316894:5035]
2025-10-10T14:32:34.272233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:34.272246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:34.272269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fe38c39-862231a9-e44baa3-5c777e85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:34.272283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.272287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.272292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:34.272303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.272315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:34.272343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.272483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.272494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.272516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.272600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 635 partition: 0 MaxSeqNo: 40 sessionId: src_id|2fe38c39-862231a9-e44baa3-5c777e85_0
2025-10-10T14:32:34.272965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac05347-f753590d-3762964e-e6d8c74d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2fe38c39-862231a9-e44baa3-5c777e85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:34.275807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe38c39-862231a9-e44baa3-5c777e85_0] Write session: try to update token
2025-10-10T14:32:34.275831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe38c39-862231a9-e44baa3-5c777e85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:34.289260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId: src_id|2fe38c39-862231a9-e44baa3-5c777e85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:34.290440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:34.290458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:34.290460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:34.290461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:34.290469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600947434316894:5035]
2025-10-10T14:32:34.290473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600947434316894:5035]
2025-10-10T14:32:34.290475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600947434316894:5035]
2025-10-10T14:32:34.290512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:34.290514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:34.290518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:34.290520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.290522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:34.290522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:34.290646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:34.291890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:34.352837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600948216528121:5983]
2025-10-10T14:32:34.353089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 634, pipe: [1:7559600948216528121:5983]
2025-10-10T14:32:34.405013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:34.405454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.405472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.405519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528121:5983], now have 1 active actors on pipe
2025-10-10T14:32:34.405722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:34.405780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600948216528121:5983]
2025-10-10T14:32:34.405794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:34.405798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:34.405810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:34.405852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 635 reason: error at write: Disconnected sessionId: src_id|2fe38c39-862231a9-e44baa3-5c777e85_0
2025-10-10T14:32:34.406023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 635 sessionId: src_id|2fe38c39-862231a9-e44baa3-5c777e85_0 is DEAD
2025-10-10T14:32:34.406171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe38c39-862231a9-e44baa3-5c777e85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:34.406182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe38c39-862231a9-e44baa3-5c777e85_0] Write session will restart in 0.006322s
2025-10-10T14:32:34.406205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe38c39-862231a9-e44baa3-5c777e85_0] Write session: Do CDS request
2025-10-10T14:32:34.406212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe38c39-862231a9-e44baa3-5c777e85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:34.413820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe38c39-862231a9-e44baa3-5c777e85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.413955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:34.413965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 636
2025-10-10T14:32:34.414063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.414104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:34.414114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:34.414122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:34.414455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 636 sessionId:  describe result for acl check
2025-10-10T14:32:34.414480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:34.414481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:34.414482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:34.414487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600948216528152:6179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:34.414946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600948216528152:6179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:34.417742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600948216528152:6179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:34.420628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600948216528152:6179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:34.420639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600948216528152:6179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:34.420642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600948216528152:6179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:34.420647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:34.422581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:34.425665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:34.425860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:34.425871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:34.425883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:34.425932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:34.425976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600947434317114:5037]
2025-10-10T14:32:34.427036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:34.427286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:34.427325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:34.427781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:34.427835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.427841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.427842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.427843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.427844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.427845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.427846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.427848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.427849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.427850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.427851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.427853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.427854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.427859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.427872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.427876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.427880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.427885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.427889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.427893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.427897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.427901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.427905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.427909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.427913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.427917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.427923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.427932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.427939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.427944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.427949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.427954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.427959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.427965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.427969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.427975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.427981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.427986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.427992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.428003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.428008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.428018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.428022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.428027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.428033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.428038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.428046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.428051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.428059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.428064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.428069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.428074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.428116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:34.430643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:34.430964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:34.430975Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:34.430977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:34.430981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:34.430986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 635 [2:7559600947434317114:5037]
2025-10-10T14:32:34.430997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:34.431013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:34.431016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.431019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.431021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.431034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:34.431046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:34.431057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:34.431206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.431214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.431216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.431218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:34.431283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:34.431291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.431302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.431314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.431338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:34.431362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528122:2438], now have 1 active actors on pipe
2025-10-10T14:32:34.431370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528308:6179], now have 1 active actors on pipe
2025-10-10T14:32:34.431377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600947434317109:5037]
2025-10-10T14:32:34.431379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600947434317109:5037]
2025-10-10T14:32:34.431382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600947434317109:5037]
2025-10-10T14:32:34.431395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:34.431407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:34.431413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:34.431415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:34.431405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 635
2025-10-10T14:32:34.431416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:34.431430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:34.431433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:34.431415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 635
2025-10-10T14:32:34.431470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.431479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.431493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600947434317109:5037]
2025-10-10T14:32:34.431504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:34.431512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:34.431534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:34.431545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.431549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.431551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:34.431563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.431579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:34.431602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.431741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.431749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.431763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.431848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 636 partition: 0 MaxSeqNo: 40 sessionId: src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0
2025-10-10T14:32:34.432218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe38c39-862231a9-e44baa3-5c777e85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:34.434742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0] Write session: try to update token
2025-10-10T14:32:34.434756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:34.449800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:34.449818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:34.449821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:34.449823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:34.449835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600947434317109:5037]
2025-10-10T14:32:34.449840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600947434317109:5037]
2025-10-10T14:32:34.449843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600947434317109:5037]
2025-10-10T14:32:34.449894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:34.449893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:34.449899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:34.449901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:34.449901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.449904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:34.450036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:34.456759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId: src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:34.459174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:34.505909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600948216528341:5983]
2025-10-10T14:32:34.506129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 635, pipe: [1:7559600948216528341:5983]
2025-10-10T14:32:34.553715Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:34.554174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.554200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.554228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528341:5983], now have 1 active actors on pipe
2025-10-10T14:32:34.554415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:34.554455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:34.554457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:34.554463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600948216528341:5983]
2025-10-10T14:32:34.554523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 636 reason: error at write: Disconnected sessionId: src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0
2025-10-10T14:32:34.554571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:34.554702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 636 sessionId: src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0 is DEAD
2025-10-10T14:32:34.554843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:34.554876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0] Write session will restart in 0.005465s
2025-10-10T14:32:34.554902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0] Write session: Do CDS request
2025-10-10T14:32:34.554912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:34.561828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.561887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:34.561897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 637
2025-10-10T14:32:34.562042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.562068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:34.562087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:34.562093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:34.562397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 637 sessionId:  describe result for acl check
2025-10-10T14:32:34.562427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:34.562432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:34.562434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:34.562438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600948216528385:6185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:34.562867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600948216528385:6185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:34.565214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600948216528385:6185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:34.567224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600948216528385:6185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:34.567235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600948216528385:6185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:34.567237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600948216528385:6185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:34.567252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:34.569989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:34.570346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:34.570510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:34.570520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:34.570529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:34.570570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:34.570600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600947434317330:5039]
2025-10-10T14:32:34.571089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:34.571333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:34.571370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:34.571677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:34.571727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.571732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.571733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.571733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.571734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.571735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.571735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.571736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.571737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.571737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.571738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.571738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.571739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.571744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.571756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.571760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.571764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.571769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.571773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.571777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.571781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.571785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.571790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.571794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.571798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.571802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.571808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.571816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.571829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.571838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.571847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.571857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.571861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.571867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.571876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.571881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.571889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.571895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.571903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.571912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.571917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.571926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.571931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.571936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.571945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.571950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.571959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.571964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.571968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.571977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.571982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.571987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.572025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:34.574219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:34.574579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:34.574591Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:34.574593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:34.574597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:34.574602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 636 [2:7559600947434317330:5039]
2025-10-10T14:32:34.574612Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:34.574627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:34.574634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.574637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.574639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.574655Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:34.574666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:34.574673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:34.574718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.574725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.574726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.574729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:34.574790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:34.574797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.574808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.574820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.574843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:34.574879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528561:6185], now have 1 active actors on pipe
2025-10-10T14:32:34.574886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528346:2438], now have 1 active actors on pipe
2025-10-10T14:32:34.574894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600947434317325:5039]
2025-10-10T14:32:34.574900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600947434317325:5039]
2025-10-10T14:32:34.574903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600947434317325:5039]
2025-10-10T14:32:34.574915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:34.574905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 636
2025-10-10T14:32:34.574929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:34.574932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:34.574909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 636
2025-10-10T14:32:34.574948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:34.574949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:34.574952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:34.574955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:34.574973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600947434317325:5039]
2025-10-10T14:32:34.574981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:34.574982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:34.575000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.575009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.575052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:34.575063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.575067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.575069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:34.575079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.575093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:34.575109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.575299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.575308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.575322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.575394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 637 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0
2025-10-10T14:32:34.575716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d9a0fa-f46101f9-a0bc797b-f790d583_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:34.578160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0] Write session: try to update token
2025-10-10T14:32:34.578174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:34.592586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId: src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:34.593241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:34.593261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:34.593263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:34.593268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:34.593277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600947434317325:5039]
2025-10-10T14:32:34.593282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600947434317325:5039]
2025-10-10T14:32:34.593286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600947434317325:5039]
2025-10-10T14:32:34.593327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:34.593346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:34.593352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:34.593355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:34.593362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.593364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:34.593499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:34.594933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:34.654391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600948216528579:5983]
2025-10-10T14:32:34.654613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 636, pipe: [1:7559600948216528579:5983]
2025-10-10T14:32:34.700934Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:34.701223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.701236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.701274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528579:5983], now have 1 active actors on pipe
2025-10-10T14:32:34.701461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:34.701539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:34.701551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:34.701554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:34.701591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600948216528579:5983]
2025-10-10T14:32:34.701613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 637 reason: error at write: Disconnected sessionId: src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0
2025-10-10T14:32:34.701798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 637 sessionId: src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0 is DEAD
2025-10-10T14:32:34.701982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:34.701999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0] Write session will restart in 0.007821s
2025-10-10T14:32:34.702017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0] Write session: Do CDS request
2025-10-10T14:32:34.702022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:34.710746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.710830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:34.710843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 638
2025-10-10T14:32:34.710993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.711037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:34.711047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:34.711051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:34.711382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 638 sessionId:  describe result for acl check
2025-10-10T14:32:34.711412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:34.711419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:34.711420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:34.711424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600948216528658:6189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:34.711862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600948216528658:6189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:34.714362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600948216528658:6189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:34.715427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:34.717650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:34.717840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:34.717852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:34.717863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:34.717917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:34.717957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600947434317560:5042]
2025-10-10T14:32:34.717950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600948216528658:6189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:34.717964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600948216528658:6189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:34.717968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600948216528658:6189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:34.717976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:34.718563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:34.718792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:34.718829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:34.719138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:34.719187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.719193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.719194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.719195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.719197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.719198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.719199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.719200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.719201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.719202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.719203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.719204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.719205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.719211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.719223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.719227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.719231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.719237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.719241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.719245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.719249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.719253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.719261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.719265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.719273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.719277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.719288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.719300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.719311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.719321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.719329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.719334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.719338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.719349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.719357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.719362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.719370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.719375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.719385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.719394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.719402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.719407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.719416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.719422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.719430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.719436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.719444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.719450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.719459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.719464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.719473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.719479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.719518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:34.721664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:34.722042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:34.722053Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:34.722055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:34.722059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:34.722064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 637 [2:7559600947434317560:5042]
2025-10-10T14:32:34.722075Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:34.722095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:34.722102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.722105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.722107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.722122Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:34.722133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:34.722140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:34.722202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.722220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.722226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.722229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:34.722288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:34.722295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.722306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.722323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.722342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:34.722365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528800:6189], now have 1 active actors on pipe
2025-10-10T14:32:34.722373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528580:2438], now have 1 active actors on pipe
2025-10-10T14:32:34.722379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600947434317546:5042]
2025-10-10T14:32:34.722385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600947434317546:5042]
2025-10-10T14:32:34.722387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600947434317546:5042]
2025-10-10T14:32:34.722399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:34.722416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:34.722415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:34.722418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:34.722420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:34.722436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:34.722443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:34.722423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 637
2025-10-10T14:32:34.722456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 637
2025-10-10T14:32:34.722461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600947434317546:5042]
2025-10-10T14:32:34.722468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:34.722469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:34.722492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.722501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.722550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:34.722563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.722567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.722569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:34.722579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.722589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:34.722606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.722718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.722725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.722750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.722827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 638 partition: 0 MaxSeqNo: 40 sessionId: src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0
2025-10-10T14:32:34.723145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8024a7b-eaba08e-8c87f23a-192fe387_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:34.725716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0] Write session: try to update token
2025-10-10T14:32:34.725731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:34.740853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:34.740870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:34.740872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:34.740873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:34.740881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600947434317546:5042]
2025-10-10T14:32:34.740886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600947434317546:5042]
2025-10-10T14:32:34.740889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600947434317546:5042]
2025-10-10T14:32:34.740928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:34.740933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.740934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:34.740933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:34.740942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:34.740946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:34.741033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId: src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:34.741089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:34.743631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:34.801855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600948216528824:5983]
2025-10-10T14:32:34.802111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 637, pipe: [1:7559600948216528824:5983]
2025-10-10T14:32:34.844146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:34.844477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.844490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.844534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528824:5983], now have 1 active actors on pipe
2025-10-10T14:32:34.844788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:34.844785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:34.844789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:34.844793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:34.844852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600948216528824:5983]
2025-10-10T14:32:34.844862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 638 reason: error at write: Disconnected sessionId: src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0
2025-10-10T14:32:34.845031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 638 sessionId: src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0 is DEAD
2025-10-10T14:32:34.845176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:34.845193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0] Write session will restart in 0.007235s
2025-10-10T14:32:34.845211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0] Write session: Do CDS request
2025-10-10T14:32:34.845216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:34.853805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.853916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:34.853928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 639
2025-10-10T14:32:34.854054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:34.854107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:34.854137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:34.854140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:34.854458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 639 sessionId:  describe result for acl check
2025-10-10T14:32:34.854494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:34.854498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:34.854501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:34.854507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600948216528897:6202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:34.854950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600948216528897:6202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:34.857410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600948216528897:6202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:34.858931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:34.861130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:34.861225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600948216528897:6202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:34.861236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600948216528897:6202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:34.861239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600948216528897:6202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:34.861254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:34.861352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:34.861367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:34.861380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:34.861437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:34.861479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600947434317803:5057]
2025-10-10T14:32:34.862129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:34.862379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:34.862419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:34.862744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:34.862795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.862801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.862802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.862803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.862804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.862806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.862807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.862808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.862809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.862810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.862812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.862813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.862814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.862820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.862834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.862838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.862842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.862850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.862854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.862871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.862879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.862883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.862891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.862895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.862900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.862904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.862911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.862920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:34.862931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.862941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:34.862950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.862960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:34.862968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.862978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:34.862987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.862996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:34.863001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.863011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:34.863015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.863025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:34.863034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.863040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:34.863049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.863056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:34.863064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.863073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:34.863080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.863089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.863098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.863107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.863116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.863125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.863170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:34.865403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:34.865893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:34.865908Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:34.865911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:34.865914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:34.865919Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 638 [2:7559600947434317803:5057]
2025-10-10T14:32:34.865931Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:34.865947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:34.865951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.865954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.865961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.865978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:34.865990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:34.865997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:34.866053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.866060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.866062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.866065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:34.866129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:34.866137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.866148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:34.866160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:34.866178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:34.866202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216529034:6202], now have 1 active actors on pipe
2025-10-10T14:32:34.866212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216528825:2438], now have 1 active actors on pipe
2025-10-10T14:32:34.866220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600947434317798:5057]
2025-10-10T14:32:34.866226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600947434317798:5057]
2025-10-10T14:32:34.866229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600947434317798:5057]
2025-10-10T14:32:34.866241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:34.866259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:34.866262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:34.866241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 638
2025-10-10T14:32:34.866266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:34.866268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:34.866281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:34.866284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:34.866245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 638
2025-10-10T14:32:34.866317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.866327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.866345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600947434317798:5057]
2025-10-10T14:32:34.866357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:34.866375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:34.866389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:34.866397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:34.866405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:34.866408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:34.866419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:34.866433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:34.866458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.866573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.866583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.866600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:34.866707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 639 partition: 0 MaxSeqNo: 40 sessionId: src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0
2025-10-10T14:32:34.867058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435bc1f8-1a04c625-d9d08ae-9149657d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:34.869535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0] Write session: try to update token
2025-10-10T14:32:34.869548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:34.884182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId: src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:34.884630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:34.884648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:34.884651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:34.884653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:34.884663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600947434317798:5057]
2025-10-10T14:32:34.884668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600947434317798:5057]
2025-10-10T14:32:34.884672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600947434317798:5057]
2025-10-10T14:32:34.884732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:34.884745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:34.884747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:34.884793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:34.884810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:34.884814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:34.884929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:34.886652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:34.945227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600948216529045:5983]
2025-10-10T14:32:34.945497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 638, pipe: [1:7559600948216529045:5983]
2025-10-10T14:32:34.993256Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:34.993849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:34.993870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:34.993919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216529045:5983], now have 1 active actors on pipe
2025-10-10T14:32:34.994136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:34.994178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:34.994200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:34.994253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 639 reason: error at write: Disconnected sessionId: src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0
2025-10-10T14:32:34.994443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600948216529045:5983]
2025-10-10T14:32:34.994461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 639 sessionId: src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0 is DEAD
2025-10-10T14:32:34.994483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:34.994624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:34.994635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0] Write session will restart in 0.007010s
2025-10-10T14:32:34.994663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0] Write session: Do CDS request
2025-10-10T14:32:34.994674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:35.002958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.003018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:35.003034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 640
2025-10-10T14:32:35.003188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.003218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:35.003226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:35.003230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:35.003703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 640 sessionId:  describe result for acl check
2025-10-10T14:32:35.003749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:35.003757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:35.003759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:35.003765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600952511496375:6206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:35.004382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600952511496375:6206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:35.007051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600952511496375:6206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:35.009205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600952511496375:6206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:35.009215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600952511496375:6206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:35.009219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600952511496375:6206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:35.009225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:35.010308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:35.012328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:35.012524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:35.012536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:35.012547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:35.012610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:35.012654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600951729285319:5059]
2025-10-10T14:32:35.013204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:35.013509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:35.013561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:35.013873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:35.013931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.013937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.013938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.013939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.013940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.013942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.013943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.013944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.013945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.013946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.013947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.013948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.013949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.013955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.013967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.013971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.013975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.013979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.013982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.013986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.013990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.013993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.013996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.014000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.014004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.014007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.014015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.014024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.014030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.014036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.014042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.014052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.014056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.014063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.014067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.014072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.014081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.014087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.014094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.014099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.014103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.014108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.014113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.014117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.014124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.014128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.014133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.014138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.014143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.014148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.014155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.014160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.014198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:35.016361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:35.016757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:35.016771Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:35.016773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:35.016776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:35.016782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 639 [2:7559600951729285319:5059]
2025-10-10T14:32:35.016794Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:35.016811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:35.016819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.016823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.016830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.016846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:35.016860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:35.016873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:35.016935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.016942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.016943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.016946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:35.017009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:35.017017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.017027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.017043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.017064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:35.017089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511496550:6206], now have 1 active actors on pipe
2025-10-10T14:32:35.017095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600948216529047:2438], now have 1 active actors on pipe
2025-10-10T14:32:35.017103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600951729285314:5059]
2025-10-10T14:32:35.017109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600951729285314:5059]
2025-10-10T14:32:35.017111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600951729285314:5059]
2025-10-10T14:32:35.017127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:35.017147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:35.017143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 639
2025-10-10T14:32:35.017152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:35.017152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 639
2025-10-10T14:32:35.017155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:35.017156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:35.017162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:35.017166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:35.017187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600951729285314:5059]
2025-10-10T14:32:35.017190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:35.017191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:35.017206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.017215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.017266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:35.017279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.017283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.017285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:35.017295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.017306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:35.017345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.017500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.017511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.017530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.017641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 640 partition: 0 MaxSeqNo: 40 sessionId: src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0
2025-10-10T14:32:35.018010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66c4502-4fdef196-5507eaf7-d85915b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:35.020594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0] Write session: try to update token
2025-10-10T14:32:35.020613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:35.034480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId: src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:35.035794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:35.035817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.035820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:35.035823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:35.035833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600951729285314:5059]
2025-10-10T14:32:35.035838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600951729285314:5059]
2025-10-10T14:32:35.035843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600951729285314:5059]
2025-10-10T14:32:35.035890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:35.035898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:35.035903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:35.035907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.035909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:35.035911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:35.036067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:35.036988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:35.094725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600952511496564:5983]
2025-10-10T14:32:35.094996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 639, pipe: [1:7559600952511496564:5983]
2025-10-10T14:32:35.142396Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:35.142959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.142974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.143015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511496564:5983], now have 1 active actors on pipe
2025-10-10T14:32:35.143183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:35.143283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600952511496564:5983]
2025-10-10T14:32:35.143298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:35.143301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:35.143309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:35.143369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 640 reason: error at write: Disconnected sessionId: src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0
2025-10-10T14:32:35.143544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 640 sessionId: src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0 is DEAD
2025-10-10T14:32:35.143701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:35.143710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0] Write session will restart in 0.009044s
2025-10-10T14:32:35.143734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0] Write session: Do CDS request
2025-10-10T14:32:35.143741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:35.153752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.153921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:35.153933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 641
2025-10-10T14:32:35.154037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.154063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:35.154071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:35.154074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:35.154442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 641 sessionId:  describe result for acl check
2025-10-10T14:32:35.154471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:35.154476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:35.154477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:35.154481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600952511496660:6210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:35.154937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600952511496660:6210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:35.157324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600952511496660:6210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:35.158296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:35.160868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:35.161019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600952511496660:6210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:35.161031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600952511496660:6210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:35.161045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600952511496660:6210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:35.161052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:35.161046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:35.161055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:35.161064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:35.161108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:35.161144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600951729285537:5061]
2025-10-10T14:32:35.161551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:35.161824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:35.161875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:35.162116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:35.162157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.162162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.162163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.162164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.162164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.162166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.162166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.162168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.162168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.162169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.162170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.162171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.162171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.162175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.162185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.162187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.162190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.162192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.162197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.162199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.162201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.162204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.162206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.162209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.162211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.162213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.162219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.162225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.162230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.162233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.162237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.162240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.162244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.162247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.162249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.162252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.162255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.162258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.162260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.162263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.162266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.162269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.162272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.162275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.162279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.162288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.162291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.162294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.162296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.162299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.162302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.162305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.162327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:35.164542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:35.164974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:35.164985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:35.164986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:35.164989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:35.164994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 640 [2:7559600951729285537:5061]
2025-10-10T14:32:35.165003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:35.165016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:35.165024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.165027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.165028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.165041Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:35.165046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:35.165052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:35.165105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.165113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.165115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.165118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:35.165173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:35.165179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.165187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.165193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.165207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:35.165226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600951729285532:5061]
2025-10-10T14:32:35.165230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600951729285532:5061]
2025-10-10T14:32:35.165232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600951729285532:5061]
2025-10-10T14:32:35.165238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:35.165248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:35.165250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511496566:2438], now have 1 active actors on pipe
2025-10-10T14:32:35.165255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511496777:6210], now have 1 active actors on pipe
2025-10-10T14:32:35.165257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:35.165259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:35.165260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:35.165268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:35.165271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:35.165294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600951729285532:5061]
2025-10-10T14:32:35.165298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:35.165283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 640
2025-10-10T14:32:35.165307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:35.165292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 640
2025-10-10T14:32:35.165321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.165342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.165370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:35.165380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.165383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.165385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:35.165394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.165406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:35.165419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.165544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.165554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.165572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.165664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 641 partition: 0 MaxSeqNo: 40 sessionId: src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0
2025-10-10T14:32:35.166028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5a81d9-e7792be6-85b3fc1a-e4ba4d25_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:35.168653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0] Write session: try to update token
2025-10-10T14:32:35.168668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:35.182713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId: src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:35.184571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:35.184593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.184596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:35.184597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:35.184605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600951729285532:5061]
2025-10-10T14:32:35.184608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600951729285532:5061]
2025-10-10T14:32:35.184610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600951729285532:5061]
2025-10-10T14:32:35.184654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:35.184660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.184662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:35.184681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:35.184699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:35.184703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:35.184828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:35.185444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:35.243156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600952511496800:5983]
2025-10-10T14:32:35.243476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 640, pipe: [1:7559600952511496800:5983]
2025-10-10T14:32:35.291266Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:35.291585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.291597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.291632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511496800:5983], now have 1 active actors on pipe
2025-10-10T14:32:35.291805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:35.291929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:35.291934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:35.291938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:35.291984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600952511496800:5983]
2025-10-10T14:32:35.292000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 641 reason: error at write: Disconnected sessionId: src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0
2025-10-10T14:32:35.292226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 641 sessionId: src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0 is DEAD
2025-10-10T14:32:35.292405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:35.292414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0] Write session will restart in 0.009535s
2025-10-10T14:32:35.292433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0] Write session: Do CDS request
2025-10-10T14:32:35.292440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:35.302857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.302950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:35.302963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 642
2025-10-10T14:32:35.303108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.303151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:35.303161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:35.303166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:35.303613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 642 sessionId:  describe result for acl check
2025-10-10T14:32:35.303652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:35.303659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:35.303661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:35.303667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600952511496914:6215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:35.304124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600952511496914:6215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:35.306299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600952511496914:6215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:35.307353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:35.309800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:35.310008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:35.310019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:35.310030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:35.310079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:35.310097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600952511496914:6215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:35.310121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600951729285771:5064]
2025-10-10T14:32:35.310113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600952511496914:6215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:35.310118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600952511496914:6215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:35.310126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:35.310619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:35.310944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:35.310980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:35.311195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:35.311232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.311237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.311238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.311238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.311239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.311240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.311241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.311241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.311242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.311242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.311243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.311244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.311245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.311248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.311257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.311259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.311262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.311264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.311266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.311268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.311271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.311273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.311276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.311278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.311280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.311283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.311288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.311293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.311298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.311301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.311304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.311307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.311309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.311312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.311315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.311318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.311321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.311324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.311327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.311330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.311333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.311337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.311339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.311343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.311345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.311348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.311351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.311354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.311357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.311360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.311363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.311366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.311389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:35.313544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:35.313820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:35.313829Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:35.313830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:35.313833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:35.313838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 641 [2:7559600951729285771:5064]
2025-10-10T14:32:35.313846Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:35.313858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:35.313860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.313862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.313863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.313875Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:35.313895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:35.313905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:35.313954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.313962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.313963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.313965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:35.314112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:35.314120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.314131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.314142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.314164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:35.314189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497013:6215], now have 1 active actors on pipe
2025-10-10T14:32:35.314195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511496801:2438], now have 1 active actors on pipe
2025-10-10T14:32:35.314201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600951729285765:5064]
2025-10-10T14:32:35.314203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600951729285765:5064]
2025-10-10T14:32:35.314204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600951729285765:5064]
2025-10-10T14:32:35.314212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:35.314223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:35.314224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:35.314227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:35.314229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:35.314237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:35.314239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:35.314252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.314256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.314282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600951729285765:5064]
2025-10-10T14:32:35.314290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:35.314301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:35.314305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:35.314311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.314314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.314315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:35.314323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.314331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:35.314359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.314157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 641
2025-10-10T14:32:35.314158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 641
2025-10-10T14:32:35.314522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.314530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.314544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.314632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 642 partition: 0 MaxSeqNo: 40 sessionId: src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0
2025-10-10T14:32:35.315030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3062b0d-b324282d-70f13fed-7a53cde9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:35.317554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0] Write session: try to update token
2025-10-10T14:32:35.317567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:35.330782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId: src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:35.332911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:35.332927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.332928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:35.332930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:35.332937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600951729285765:5064]
2025-10-10T14:32:35.332941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600951729285765:5064]
2025-10-10T14:32:35.332943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600951729285765:5064]
2025-10-10T14:32:35.332976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:35.332981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:35.332981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:35.332984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:35.332986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.332987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:35.333115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:35.333416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:35.392203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600952511497024:5983]
2025-10-10T14:32:35.392497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 641, pipe: [1:7559600952511497024:5983]
2025-10-10T14:32:35.436925Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:35.437143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.437155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.437194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497024:5983], now have 1 active actors on pipe
2025-10-10T14:32:35.437378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:35.437394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:35.437417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600952511497024:5983]
2025-10-10T14:32:35.437440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:35.437519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 642 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0
2025-10-10T14:32:35.437731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 642 sessionId: src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0 is DEAD
2025-10-10T14:32:35.437880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:35.437890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0] Write session will restart in 0.007448s
2025-10-10T14:32:35.437910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0] Write session: Do CDS request
2025-10-10T14:32:35.437916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:35.447008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.447088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:35.447102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 643
2025-10-10T14:32:35.447268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.447303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:35.447313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:35.447317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:35.447787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 643 sessionId:  describe result for acl check
2025-10-10T14:32:35.447823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:35.447831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:35.447833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:35.447840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600952511497114:6219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:35.448401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600952511497114:6219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:35.451036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600952511497114:6219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:35.452265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:35.454479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:35.454654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:35.454664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:35.454673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:35.454713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:35.454742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600951729285993:5066]
2025-10-10T14:32:35.454752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600952511497114:6219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:35.454767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600952511497114:6219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:35.454770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600952511497114:6219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:35.454779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:35.455199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:35.455420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:35.455452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:35.455655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:35.455691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.455695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.455696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.455697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.455698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.455698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.455699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.455700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.455700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.455701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.455701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.455702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.455703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.455707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.455716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.455718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.455721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.455723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.455725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.455727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.455730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.455732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.455735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.455737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.455739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.455742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.455746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.455751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.455756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.455759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.455762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.455765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.455768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.455771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.455774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.455777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.455779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.455783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.455785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.455788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.455791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.455794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.455797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.455800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.455802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.455807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.455809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.455812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.455815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.455818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.455821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.455824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.455845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:35.457969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:35.458452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:35.458461Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:35.458462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:35.458465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:35.458469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 642 [2:7559600951729285993:5066]
2025-10-10T14:32:35.458477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:35.458489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:35.458491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.458493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.458494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.458507Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:35.458512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:35.458518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:35.458557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.458563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.458565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.458566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:35.458627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:35.458635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.458655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.458671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.458690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:35.458711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497238:6219], now have 1 active actors on pipe
2025-10-10T14:32:35.458717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497025:2438], now have 1 active actors on pipe
2025-10-10T14:32:35.458723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600951729285988:5066]
2025-10-10T14:32:35.458725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600951729285988:5066]
2025-10-10T14:32:35.458726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600951729285988:5066]
2025-10-10T14:32:35.458736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:35.458746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:35.458759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:35.458761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:35.458765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:35.458765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:35.458767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:35.458782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600951729285988:5066]
2025-10-10T14:32:35.458788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:35.458782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 642
2025-10-10T14:32:35.458808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:35.458785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 642
2025-10-10T14:32:35.458839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.458847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.458881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:35.458892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.458894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.458896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:35.458904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.458913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:35.458922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.459034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.459040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.459051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.459157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 643 partition: 0 MaxSeqNo: 40 sessionId: src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0
2025-10-10T14:32:35.459517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cca0c8-6ec82b10-fb9e819e-7033b1b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:35.462076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0] Write session: try to update token
2025-10-10T14:32:35.462095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:35.475680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId: src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:35.476882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:35.476899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.476903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:35.476904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:35.476914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600951729285988:5066]
2025-10-10T14:32:35.476918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600951729285988:5066]
2025-10-10T14:32:35.476922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600951729285988:5066]
2025-10-10T14:32:35.476969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:35.476969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:35.476974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:35.476977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:35.476978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.476979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:35.477096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:35.478480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:35.537629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600952511497250:5983]
2025-10-10T14:32:35.537946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 642, pipe: [1:7559600952511497250:5983]
2025-10-10T14:32:35.581252Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:35.581568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.581581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.581622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497250:5983], now have 1 active actors on pipe
2025-10-10T14:32:35.581780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:35.581863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600952511497250:5983]
2025-10-10T14:32:35.581883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:35.581906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:35.581963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 643 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0
2025-10-10T14:32:35.582190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 643 sessionId: src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0 is DEAD
2025-10-10T14:32:35.582329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:35.582341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0] Write session will restart in 0.005887s
2025-10-10T14:32:35.582365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0] Write session: Do CDS request
2025-10-10T14:32:35.582383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:35.589795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.589850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:35.589861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 644
2025-10-10T14:32:35.590021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.590058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:35.590068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:35.590073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:35.590532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 644 sessionId:  describe result for acl check
2025-10-10T14:32:35.590562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:35.590566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:35.590568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:35.590573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600952511497300:6225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:35.591038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600952511497300:6225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:35.593917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600952511497300:6225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:35.596198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:35.596503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600952511497300:6225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:35.596518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600952511497300:6225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:35.596523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600952511497300:6225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:35.596531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:35.599032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:35.599262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:35.599273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:35.599286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:35.599340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:35.599383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600951729286217:5068]
2025-10-10T14:32:35.599987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:35.600307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:35.600353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:35.600680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:35.600738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.600744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.600745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.600746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.600747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.600748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.600750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.600751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.600753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.600754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.600755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.600756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.600758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.600763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.600776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.600779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.600783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.600786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.600790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.600794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.600798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.600802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.600806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.600811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.600815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.600819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.600826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.600835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.600841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.600846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.600851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.600856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.600861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.600866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.600871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.600877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.600888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.600894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.600898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.600903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.600908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.600913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.600920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.600926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.600930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.600935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.600945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.600950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.600955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.600964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.600970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.600975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.601018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:35.603386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:35.603861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:35.603871Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:35.603873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:35.603876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:35.603881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 643 [2:7559600951729286217:5068]
2025-10-10T14:32:35.603891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:35.603904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:35.603907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.603909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.603911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.603925Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:35.603935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:35.603941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:35.603990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.603996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.603997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.603999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:35.604052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:35.604058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.604065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.604072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.604082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:35.604102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600951729286211:5068]
2025-10-10T14:32:35.604104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600951729286211:5068]
2025-10-10T14:32:35.604106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600951729286211:5068]
2025-10-10T14:32:35.604111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:35.604120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:35.604125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497474:6225], now have 1 active actors on pipe
2025-10-10T14:32:35.604129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:35.604130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:35.604131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:35.604147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:35.604154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:35.604160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497260:2438], now have 1 active actors on pipe
2025-10-10T14:32:35.604182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600951729286211:5068]
2025-10-10T14:32:35.604193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:35.604214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:35.604226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 643
2025-10-10T14:32:35.604239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 643
2025-10-10T14:32:35.604307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.604315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.604346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:35.604359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.604367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.604369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:35.604381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.604397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:35.604415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.604550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.604557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.604569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.604653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 644 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0
2025-10-10T14:32:35.605035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3634371b-b9aaeaa4-f09b58b-d5bf7014_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:35.607708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0] Write session: try to update token
2025-10-10T14:32:35.607726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:35.621586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId: src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:35.622624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:35.622644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.622646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:35.622648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:35.622657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600951729286211:5068]
2025-10-10T14:32:35.622660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600951729286211:5068]
2025-10-10T14:32:35.622662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600951729286211:5068]
2025-10-10T14:32:35.622702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:35.622708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.622709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:35.622716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:35.622724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:35.622730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:35.622836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:35.624225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:35.681992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600952511497489:5983]
2025-10-10T14:32:35.682281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 643, pipe: [1:7559600952511497489:5983]
2025-10-10T14:32:35.726883Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:35.727225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.727238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.727277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497489:5983], now have 1 active actors on pipe
2025-10-10T14:32:35.727446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:35.727544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:35.727552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:35.727592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600952511497489:5983]
2025-10-10T14:32:35.727621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 644 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0
2025-10-10T14:32:35.727797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 644 sessionId: src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0 is DEAD
2025-10-10T14:32:35.727963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:35.727973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0] Write session will restart in 0.008741s
2025-10-10T14:32:35.727993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0] Write session: Do CDS request
2025-10-10T14:32:35.727997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:35.737840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.737980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:35.737995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 645
2025-10-10T14:32:35.738105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.738139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:35.738149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:35.738154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:35.738624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 645 sessionId:  describe result for acl check
2025-10-10T14:32:35.738663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:35.738672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:35.738674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:35.738681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600952511497620:6229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:35.739284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600952511497620:6229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:35.741248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600952511497620:6229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:35.741350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:35.743588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:35.743753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:35.743763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:35.743772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:35.743808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:35.743809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600952511497620:6229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:35.743820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600952511497620:6229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:35.743823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600952511497620:6229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:35.743828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:35.743842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600951729286441:5071]
2025-10-10T14:32:35.744206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:35.744446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:35.744475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:35.744808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:35.744854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.744858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.744859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.744860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.744860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.744861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.744862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.744862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.744863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.744863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.744864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.744865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.744866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.744869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.744877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.744879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.744882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.744884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.744886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.744888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.744890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.744893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.744896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.744898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.744900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.744902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.744907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.744913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.744917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.744920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.744923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.744926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.744928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.744931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.744934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.744937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.744939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.744942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.744945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.744948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.744950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.744953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.744956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.744959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.744962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.744964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.744968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.744975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.744977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.744980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.744982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.744985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.745007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:35.747202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:35.747701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:35.747712Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:35.747714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:35.747716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:35.747721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 644 [2:7559600951729286441:5071]
2025-10-10T14:32:35.747728Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:35.747741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:35.747743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.747745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.747747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.747760Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:35.747769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:35.747775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:35.747821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.747828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.747830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.747832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:35.747883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:35.747889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.747897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.747904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.747914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:35.747933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497705:6229], now have 1 active actors on pipe
2025-10-10T14:32:35.747939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497490:2438], now have 1 active actors on pipe
2025-10-10T14:32:35.747944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600951729286436:5071]
2025-10-10T14:32:35.747946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600951729286436:5071]
2025-10-10T14:32:35.747947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600951729286436:5071]
2025-10-10T14:32:35.747959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:35.747970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:35.747982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:35.747982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:35.747985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:35.747986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:35.747988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:35.748009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600951729286436:5071]
2025-10-10T14:32:35.748025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:35.748029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:35.748031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 644
2025-10-10T14:32:35.748066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.748073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.748095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6037d7f-97a649c8-ed37099b-a67af490_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:35.748104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.748107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.748109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:35.748117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.748129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:35.748146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.748115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 644
2025-10-10T14:32:35.748286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.748292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.748304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.748397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 645 partition: 0 MaxSeqNo: 40 sessionId: src_id|b6037d7f-97a649c8-ed37099b-a67af490_0
2025-10-10T14:32:35.748818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec618b7-9ee6463d-710a20e-9afa67c7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b6037d7f-97a649c8-ed37099b-a67af490_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:35.751439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6037d7f-97a649c8-ed37099b-a67af490_0] Write session: try to update token
2025-10-10T14:32:35.751457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6037d7f-97a649c8-ed37099b-a67af490_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:35.760228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:35.760256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.760270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600951729286436:5071]
2025-10-10T14:32:35.760324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:35.760332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:35.760636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:35.760832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:35.760996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:35.761156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:35.761358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:35.761399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:35.765182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId: src_id|b6037d7f-97a649c8-ed37099b-a67af490_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:35.768252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:35.768497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.768520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.768571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:35.768663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:35.777187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:35.777204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.777208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:35.777209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:35.777219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600951729286436:5071]
2025-10-10T14:32:35.777222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600951729286436:5071]
2025-10-10T14:32:35.777224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600951729286436:5071]
2025-10-10T14:32:35.777271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:35.777274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:35.777283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.777285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:35.777286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:35.777288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:35.777441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:35.827932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600952511497741:5983]
2025-10-10T14:32:35.828228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 644, pipe: [1:7559600952511497741:5983]
2025-10-10T14:32:35.884529Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:35.891291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.891323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.891489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.891547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.891607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.891665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.892101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.892112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.892175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.892227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.892285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.892347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.892388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.892394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.892492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.892581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.892637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.892695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.892735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.892740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.892804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.892861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.892919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.892977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.893092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.893098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.893158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.893213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.893284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.893357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.893411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.893417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.893480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.893534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.893591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.893680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.893723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.893728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.893790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.893841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.893896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.893948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.893987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.893992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.894051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.894108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.894181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.894240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.894294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.894301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.894361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.894411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.894468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.894521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.894561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.894566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.894625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:35.894680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:35.894748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:35.894803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:35.894841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:35.894847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:35.894910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497741:5983], now have 1 active actors on pipe
2025-10-10T14:32:35.895194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:35.895257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:35.895265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:35.895296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 645 reason: error at write: Disconnected sessionId: src_id|b6037d7f-97a649c8-ed37099b-a67af490_0
2025-10-10T14:32:35.895283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:35.895533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 645 sessionId: src_id|b6037d7f-97a649c8-ed37099b-a67af490_0 is DEAD
2025-10-10T14:32:35.895612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600952511497741:5983]
2025-10-10T14:32:35.895656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6037d7f-97a649c8-ed37099b-a67af490_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:35.895668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6037d7f-97a649c8-ed37099b-a67af490_0] Write session will restart in 0.008096s
2025-10-10T14:32:35.895689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6037d7f-97a649c8-ed37099b-a67af490_0] Write session: Do CDS request
2025-10-10T14:32:35.895694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6037d7f-97a649c8-ed37099b-a67af490_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:35.904836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6037d7f-97a649c8-ed37099b-a67af490_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.904940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:35.904955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 646
2025-10-10T14:32:35.905093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:35.905130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:35.905141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:35.905144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:35.905662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 646 sessionId:  describe result for acl check
2025-10-10T14:32:35.905702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:35.905709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:35.905711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:35.905718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600952511497812:6242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:35.906251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600952511497812:6242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:35.909374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600952511497812:6242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:35.910727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:35.913174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:35.913354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:35.913363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:35.913372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:35.913412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:35.913443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600951729286704:5086]
2025-10-10T14:32:35.913598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600952511497812:6242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:35.913614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600952511497812:6242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:35.913618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600952511497812:6242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:35.913627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:35.913869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:35.914072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:35.914101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:35.914298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:35.914335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.914339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.914340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.914340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.914342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.914342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.914343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.914343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.914344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.914345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.914346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.914346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.914347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.914351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.914360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.914363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.914365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.914367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.914370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.914372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.914374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.914376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.914379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.914381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.914384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.914386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.914391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.914397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:35.914401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.914405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:35.914408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.914412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:35.914414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.914418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:35.914420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.914423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:35.914425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.914428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:35.914431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.914434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:35.914436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.914439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:35.914442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.914445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:35.914447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.914450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:35.914453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.914456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.914458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.914461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.914464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.914467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.914489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:35.916595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:35.916994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:35.917006Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:35.917007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:35.917010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:35.917014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 645 [2:7559600951729286704:5086]
2025-10-10T14:32:35.917021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:35.917034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:35.917035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.917037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.917039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.917050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:35.917055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:35.917061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:35.917100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.917106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.917107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.917109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:35.917162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:35.917168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.917176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:35.917182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:35.917191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:35.917206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497959:6242], now have 1 active actors on pipe
2025-10-10T14:32:35.917213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497742:2438], now have 1 active actors on pipe
2025-10-10T14:32:35.917218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600951729286699:5086]
2025-10-10T14:32:35.917219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600951729286699:5086]
2025-10-10T14:32:35.917221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600951729286699:5086]
2025-10-10T14:32:35.917230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:35.917239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:35.917247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:35.917249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:35.917250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:35.917250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:35.917252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:35.917267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600951729286699:5086]
2025-10-10T14:32:35.917270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:35.917271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:35.917271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 645
2025-10-10T14:32:35.917274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 645
2025-10-10T14:32:35.917313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.917320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.917363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:35.917372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:35.917375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:35.917376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:35.917384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:35.917394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:35.917409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.917536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.917542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.917553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:35.917674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 646 partition: 0 MaxSeqNo: 40 sessionId: src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0
2025-10-10T14:32:35.918000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6037d7f-97a649c8-ed37099b-a67af490_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:35.920523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0] Write session: try to update token
2025-10-10T14:32:35.920536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:35.927871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:35.927891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.927903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600951729286699:5086]
2025-10-10T14:32:35.927941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:35.927949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:35.928131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:35.928316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:35.928481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:35.928650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:35.928835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:35.928876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:35.933509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId: src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:35.935932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:35.936125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:35.936145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:35.936181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:35.936266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:35.944660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:35.944675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:35.944677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:35.944679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:35.944688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600951729286699:5086]
2025-10-10T14:32:35.944691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600951729286699:5086]
2025-10-10T14:32:35.944693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600951729286699:5086]
2025-10-10T14:32:35.944727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:35.944730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:35.944732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:35.944736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:35.944736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:35.944738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:35.944856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:35.995848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600952511497971:5983]
2025-10-10T14:32:35.996099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 645, pipe: [1:7559600952511497971:5983]
2025-10-10T14:32:36.050417Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:36.057538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.057567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.057725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.057782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.057848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.057907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.057952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.057960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.058028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.058094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.058153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.058218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.058259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.058265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.058327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.058382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.058442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.058502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.058550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.058559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.058625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.058683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.058740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.058800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.058845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.058853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.058932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.058988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.059049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.059116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.059160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.059166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.059230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.059288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.059347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.059420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.059469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.059478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.059544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.059613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.059680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.059740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.059781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.059786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.059851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.059915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.059974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.060068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.060115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.060123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.060187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.060243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.060300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.060367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.060409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.060416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.060478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.060549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.060615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.060682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.060739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.060745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.060787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600952511497971:5983], now have 1 active actors on pipe
2025-10-10T14:32:36.061037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600952511497971:5983]
2025-10-10T14:32:36.061070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:36.061072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:36.061106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 646 reason: error at write: Disconnected sessionId: src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0
2025-10-10T14:32:36.061151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:36.061269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:36.061317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 646 sessionId: src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0 is DEAD
2025-10-10T14:32:36.061481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:36.061493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0] Write session will restart in 0.008567s
2025-10-10T14:32:36.061518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0] Write session: Do CDS request
2025-10-10T14:32:36.061524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:36.070806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.070952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:36.070967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 647
2025-10-10T14:32:36.071082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.071123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:36.071134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:36.071138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:36.071785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 647 sessionId:  describe result for acl check
2025-10-10T14:32:36.071827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:36.071833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:36.071835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:36.071842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600956806465354:6246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:36.072395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600956806465354:6246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:36.075369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600956806465354:6246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:36.076127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:36.078380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:36.078594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:36.078603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:36.078612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:36.078624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600956806465354:6246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:36.078638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600956806465354:6246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:36.078641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600956806465354:6246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:36.078651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:36.078651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:36.078684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600956024254226:5088]
2025-10-10T14:32:36.079097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:36.079315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:36.079343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:36.079566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:36.079611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.079615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.079616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.079617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.079617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.079618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.079619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.079619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.079620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.079621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.079621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.079622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.079623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.079626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.079636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.079639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.079641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.079643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.079645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.079647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.079649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.079651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.079663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.079665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.079668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.079670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.079675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.079681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.079686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.079689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.079692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.079695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.079698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.079702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.079705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.079708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.079710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.079713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.079716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.079719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.079721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.079724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.079727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.079730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.079732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.079735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.079739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.079743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.079745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.079749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.079751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.079754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.079776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:36.082009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:36.082504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:36.082514Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:36.082515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:36.082518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:36.082523Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 646 [2:7559600956024254226:5088]
2025-10-10T14:32:36.082533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:36.082551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:36.082557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.082560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.082562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.082575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:36.082584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:36.082594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:36.082643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.082648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.082650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.082652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:36.082707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:36.082715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.082722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.082729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.082739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:36.082754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600956024254221:5088]
2025-10-10T14:32:36.082756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600956024254221:5088]
2025-10-10T14:32:36.082759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600956024254221:5088]
2025-10-10T14:32:36.082766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:36.082776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:36.082782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:36.082785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:36.082786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:36.082787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:36.082788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:36.082797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465484:6246], now have 1 active actors on pipe
2025-10-10T14:32:36.082800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465268:2438], now have 1 active actors on pipe
2025-10-10T14:32:36.082817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600956024254221:5088]
2025-10-10T14:32:36.082824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:36.082846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:36.082864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 646
2025-10-10T14:32:36.082868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 646
2025-10-10T14:32:36.082922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.082930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.082958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:36.082969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.082972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.082974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:36.082982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.082991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:36.083006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.083461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.083476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.083495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.083604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 647 partition: 0 MaxSeqNo: 40 sessionId: src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0
2025-10-10T14:32:36.083997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54c1366-4a55a211-e8000f88-4e4f9743_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:36.086716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0] Write session: try to update token
2025-10-10T14:32:36.086733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:36.100810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId: src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:36.101284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:36.101304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.101307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:36.101308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:36.101316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600956024254221:5088]
2025-10-10T14:32:36.101320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600956024254221:5088]
2025-10-10T14:32:36.101322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600956024254221:5088]
2025-10-10T14:32:36.101371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:36.101376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:36.101379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:36.101381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:36.101388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.101390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:36.101528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:36.103249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:36.161242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600956806465496:5983]
2025-10-10T14:32:36.161557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 646, pipe: [1:7559600956806465496:5983]
2025-10-10T14:32:36.207381Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:36.207766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.207777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.207818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465496:5983], now have 1 active actors on pipe
2025-10-10T14:32:36.207951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:36.208034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:36.208045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:36.208060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:36.208100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600956806465496:5983]
2025-10-10T14:32:36.208101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 647 reason: error at write: Disconnected sessionId: src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0
2025-10-10T14:32:36.208312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 647 sessionId: src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0 is DEAD
2025-10-10T14:32:36.208504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:36.208516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0] Write session will restart in 0.005742s
2025-10-10T14:32:36.208541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0] Write session: Do CDS request
2025-10-10T14:32:36.208551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:36.215679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.215842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:36.215855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 648
2025-10-10T14:32:36.215960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.215997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:36.216008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:36.216012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:36.216471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 648 sessionId:  describe result for acl check
2025-10-10T14:32:36.216505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:36.216512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:36.216514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:36.216520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600956806465549:6251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:36.217031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600956806465549:6251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:36.219335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600956806465549:6251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:36.221846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600956806465549:6251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:36.221858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600956806465549:6251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:36.221861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600956806465549:6251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:36.221868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:36.223106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:36.225427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:36.225592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:36.225601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:36.225611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:36.225649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:36.225681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600956024254466:5091]
2025-10-10T14:32:36.226084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:36.226334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:36.226365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:36.226596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:36.226639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.226643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.226644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.226645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.226645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.226646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.226647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.226647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.226648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.226648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.226649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.226650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.226650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.226654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.226663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.226665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.226667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.226669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.226671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.226674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.226676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.226678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.226680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.226682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.226684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.226686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.226692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.226697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.226702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.226706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.226708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.226712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.226714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.226717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.226720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.226723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.226726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.226729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.226732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.226735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.226738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.226741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.226745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.226749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.226751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.226754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.226757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.226761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.226763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.226766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.226769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.226772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.226795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:36.229117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:36.229588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:36.229600Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:36.229602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:36.229605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:36.229609Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 647 [2:7559600956024254466:5091]
2025-10-10T14:32:36.229617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:36.229632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:36.229634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.229636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.229637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.229650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:36.229656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:36.229661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:36.229703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.229709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.229711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.229712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:36.229763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:36.229769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.229776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.229783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.229793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:36.229812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465509:2438], now have 1 active actors on pipe
2025-10-10T14:32:36.229818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465724:6251], now have 1 active actors on pipe
2025-10-10T14:32:36.229824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600956024254461:5091]
2025-10-10T14:32:36.229825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600956024254461:5091]
2025-10-10T14:32:36.229826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600956024254461:5091]
2025-10-10T14:32:36.229836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:36.229848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:36.229852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:36.229854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:36.229855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:36.229861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:36.229864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:36.229880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600956024254461:5091]
2025-10-10T14:32:36.229889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:36.229893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:36.229890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 647
2025-10-10T14:32:36.229899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 647
2025-10-10T14:32:36.229929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.229936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.229962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:36.229971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.229974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.229976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:36.229984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.229993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:36.230006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.230159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.230165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.230177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.230274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 648 partition: 0 MaxSeqNo: 40 sessionId: src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0
2025-10-10T14:32:36.230638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e918fbe4-27dc47a6-91fe0f8b-b6adc487_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:36.233216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0] Write session: try to update token
2025-10-10T14:32:36.233232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:36.241321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:36.241353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.241364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600956024254461:5091]
2025-10-10T14:32:36.241412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:36.241432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:36.241575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:36.241711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.241831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.241959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.242145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:36.242195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:36.246919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId: src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:36.249528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:36.249726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.249746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.249785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:36.249889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:36.258248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:36.258266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.258268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:36.258270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:36.258279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600956024254461:5091]
2025-10-10T14:32:36.258282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600956024254461:5091]
2025-10-10T14:32:36.258285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600956024254461:5091]
2025-10-10T14:32:36.258321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:36.258321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:36.258327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.258327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:36.258328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:36.258331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:36.258447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:36.308167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600956806465742:5983]
2025-10-10T14:32:36.308394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 647, pipe: [1:7559600956806465742:5983]
2025-10-10T14:32:36.361257Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:36.368488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.368513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.368664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.368722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.368777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.368832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.369290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.369301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.369374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.369437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.369503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.369567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.369790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.369799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.369858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.369911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.369970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.370027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.370065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.370070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.370139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.370210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.370265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.370353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.370392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.370397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.370509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.370566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.370621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.370676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.370721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.370729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.370791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.370846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.370910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.370990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.371087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.371092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.371148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.371208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.371272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.371325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.371361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.371367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.371425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.371490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.371547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.371604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.371642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.371647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.371703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.371765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.371824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.371876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.371975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.371983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.372043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.372092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.372147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.372207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.372251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.372258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.372314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465742:5983], now have 1 active actors on pipe
2025-10-10T14:32:36.372610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:36.372668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:36.372669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600956806465742:5983]
2025-10-10T14:32:36.372681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:36.372689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:36.372709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 648 reason: error at write: Disconnected sessionId: src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0
2025-10-10T14:32:36.372925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 648 sessionId: src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0 is DEAD
2025-10-10T14:32:36.373071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:36.373088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0] Write session will restart in 0.006460s
2025-10-10T14:32:36.373107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0] Write session: Do CDS request
2025-10-10T14:32:36.373113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:36.380776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.380874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:36.380888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 649
2025-10-10T14:32:36.380999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.381034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:36.381045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:36.381050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:36.381584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 649 sessionId:  describe result for acl check
2025-10-10T14:32:36.381618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:36.381626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:36.381630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:36.381636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600956806465798:6257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:36.382202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600956806465798:6257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:36.385029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600956806465798:6257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:36.386712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:36.386903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600956806465798:6257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:36.386914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600956806465798:6257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:36.386917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600956806465798:6257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:36.386924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:36.388765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:36.388928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:36.388936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:36.388944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:36.388981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:36.389019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600956024254694:5093]
2025-10-10T14:32:36.389419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:36.389659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:36.389720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:36.389979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:36.390039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.390045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.390046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.390047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.390048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.390050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.390051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.390052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.390054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.390055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.390056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.390057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.390058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.390064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.390079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.390084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.390088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.390093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.390098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.390102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.390107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.390120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.390125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.390129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.390136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.390141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.390150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.390163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.390175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.390183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.390191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.390198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.390205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.390211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.390235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.390245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.390250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.390256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.390261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.390267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.390275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.390281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.390289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.390296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.390303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.390310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.390328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.390337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.390341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.390350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.390355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.390360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.390399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:36.392578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:36.393143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:36.393153Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:36.393154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:36.393157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:36.393162Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 648 [2:7559600956024254694:5093]
2025-10-10T14:32:36.393170Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:36.393183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:36.393185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.393187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.393189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.393202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:36.393213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:36.393219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:36.393267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.393273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.393274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.393276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:36.393325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:36.393349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.393356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.393362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.393374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:36.393393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465962:6257], now have 1 active actors on pipe
2025-10-10T14:32:36.393399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465743:2438], now have 1 active actors on pipe
2025-10-10T14:32:36.393405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600956024254688:5093]
2025-10-10T14:32:36.393407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600956024254688:5093]
2025-10-10T14:32:36.393409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600956024254688:5093]
2025-10-10T14:32:36.393419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:36.393434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:36.393447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:36.393450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:36.393453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:36.393453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:36.393454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:36.393476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600956024254688:5093]
2025-10-10T14:32:36.393482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:36.393474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 648
2025-10-10T14:32:36.393477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 648
2025-10-10T14:32:36.393512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.393513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:36.393519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.393542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:36.393551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.393554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.393556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:36.393564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.393576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:36.393587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.393743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.393749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.393760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.393842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 649 partition: 0 MaxSeqNo: 40 sessionId: src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0
2025-10-10T14:32:36.394266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8fc493a-e63beabe-a0e54a34-4cc34d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:36.396835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0] Write session: try to update token
2025-10-10T14:32:36.396852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:36.404048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:36.404065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.404073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600956024254688:5093]
2025-10-10T14:32:36.404111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:36.404120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:36.404301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:36.404463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.404584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.404703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.404887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:36.404921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:36.410017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId: src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:36.412470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:36.412658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.412675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.412704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:36.412803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:36.420932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:36.420949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.420951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:36.420952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:36.420964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600956024254688:5093]
2025-10-10T14:32:36.420966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600956024254688:5093]
2025-10-10T14:32:36.420968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600956024254688:5093]
2025-10-10T14:32:36.421003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:36.421005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:36.421008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.421010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:36.421011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:36.421017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:36.421122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:36.473036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600956806465974:5983]
2025-10-10T14:32:36.473285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 648, pipe: [1:7559600956806465974:5983]
2025-10-10T14:32:36.522480Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:36.528680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.528704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.528846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.528900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.528954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.529008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.529047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.529055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.529112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.529167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.529226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.529284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.529323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.529341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.529399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.529452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.529505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.529558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.529594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.529600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.529656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.529714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.529769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.529824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.529862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.529867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.529922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.529992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.530070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.530122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.530161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.530169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.530225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.530276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.530326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.530382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.530421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.530426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.530481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.530533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.530588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.530644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.530683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.530688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.530741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.530793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.530847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.530911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.530949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.530954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.531043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.531093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.531147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.531230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.531281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.531288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.531355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:36.531412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:36.531470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:36.531519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:36.531555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:36.531560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:36.531597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465974:5983], now have 1 active actors on pipe
2025-10-10T14:32:36.531848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:36.531861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:36.531862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600956806465974:5983]
2025-10-10T14:32:36.531882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:36.531902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 649 reason: error at write: Disconnected sessionId: src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0
2025-10-10T14:32:36.532121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 649 sessionId: src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0 is DEAD
2025-10-10T14:32:36.532199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:36.532262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:36.532273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0] Write session will restart in 0.005483s
2025-10-10T14:32:36.532298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0] Write session: Do CDS request
2025-10-10T14:32:36.532305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:36.538761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.538855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:36.538867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 650
2025-10-10T14:32:36.538981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.539024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:36.539033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:36.539037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:36.539444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 650 sessionId:  describe result for acl check
2025-10-10T14:32:36.539475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:36.539481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:36.539483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:36.539489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600956806466015:6261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:36.539963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600956806466015:6261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:36.542997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600956806466015:6261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:36.545227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:36.547328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:36.547493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:36.547502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:36.547510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:36.547510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600956806466015:6261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:36.547526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600956806466015:6261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:36.547529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600956806466015:6261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:36.547538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:36.547548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:36.547579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600956024254922:5095]
2025-10-10T14:32:36.547947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:36.548169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:36.548199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:36.548399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:36.548432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.548437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.548437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.548438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.548438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.548439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.548439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.548440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.548441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.548441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.548442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.548442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.548443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.548447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.548455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.548457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.548459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.548461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.548463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.548465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.548467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.548469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.548472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.548474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.548476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.548477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.548483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.548488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.548493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.548496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.548499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.548501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.548504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.548507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.548510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.548513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.548515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.548518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.548521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.548524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.548526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.548530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.548532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.548535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.548537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.548541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.548544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.548547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.548549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.548552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.548554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.548557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.548578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:36.550622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:36.551016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:36.551026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:36.551027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:36.551030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:36.551034Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 649 [2:7559600956024254922:5095]
2025-10-10T14:32:36.551043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:36.551055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:36.551057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.551059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.551060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.551072Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:36.551078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:36.551084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:36.551122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.551128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.551129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.551130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:36.551177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:36.551182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.551189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.551196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.551205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:36.551221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806465975:2438], now have 1 active actors on pipe
2025-10-10T14:32:36.551227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466195:6261], now have 1 active actors on pipe
2025-10-10T14:32:36.551233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600956024254917:5095]
2025-10-10T14:32:36.551234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600956024254917:5095]
2025-10-10T14:32:36.551236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600956024254917:5095]
2025-10-10T14:32:36.551245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:36.551255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:36.551257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:36.551263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:36.551264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:36.551266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:36.551279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:36.551284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 649
2025-10-10T14:32:36.551299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600956024254917:5095]
2025-10-10T14:32:36.551294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 649
2025-10-10T14:32:36.551305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:36.551316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:36.551329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.551332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.551356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:36.551366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.551370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.551371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:36.551379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.551390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:36.551407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.551551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.551559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.551571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.551666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 650 partition: 0 MaxSeqNo: 40 sessionId: src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0
2025-10-10T14:32:36.552036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e719eafd-4c6c38fe-1ebebda8-2de405da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:36.554725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0] Write session: try to update token
2025-10-10T14:32:36.554742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:36.567539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId: src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:36.569186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:36.569207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.569209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:36.569211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:36.569218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600956024254917:5095]
2025-10-10T14:32:36.569223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600956024254917:5095]
2025-10-10T14:32:36.569226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600956024254917:5095]
2025-10-10T14:32:36.569261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:36.569266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:36.569266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:36.569269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:36.569272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.569273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:36.569427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:36.570086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:36.632251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600956806466217:5983]
2025-10-10T14:32:36.632454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 649, pipe: [1:7559600956806466217:5983]
2025-10-10T14:32:36.672559Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:36.672776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.672788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.672826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466217:5983], now have 1 active actors on pipe
2025-10-10T14:32:36.673008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:36.673006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:36.673007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:36.673021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:36.673065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600956806466217:5983]
2025-10-10T14:32:36.673084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 650 reason: error at write: Disconnected sessionId: src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0
2025-10-10T14:32:36.673290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 650 sessionId: src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0 is DEAD
2025-10-10T14:32:36.673504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:36.673514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0] Write session will restart in 0.009811s
2025-10-10T14:32:36.673540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0] Write session: Do CDS request
2025-10-10T14:32:36.673546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:36.684998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.685057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:36.685071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 651
2025-10-10T14:32:36.685232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.685270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:36.685280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:36.685283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:36.685658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 651 sessionId:  describe result for acl check
2025-10-10T14:32:36.685688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:36.685692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:36.685694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:36.685698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600956806466407:6267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:36.686146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600956806466407:6267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:36.686769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:36.688280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600956806466407:6267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:36.689415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:36.689688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:36.689698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:36.689709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:36.689764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:36.689797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600956024255154:5098]
2025-10-10T14:32:36.690198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:36.690373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:36.690399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:36.690610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:36.690653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.690657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.690658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.690659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.690659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.690660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.690661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.690661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.690662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.690663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.690663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.690664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.690665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.690668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.690676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.690679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.690681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.690683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.690686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.690687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600956806466407:6267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:36.690701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600956806466407:6267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:36.690688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.690690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.690693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.690695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.690697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.690704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600956806466407:6267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:36.690699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.690710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:36.690701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.690706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.690711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.690716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.690719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.690723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.690726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.690729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.690732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.690735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.690739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.690741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.690744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.690747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.690750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.690752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.690755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.690758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.690761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.690763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.690767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.690770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.690773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.690775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.690778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.690780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.690783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.690804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:36.692866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:36.693148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:36.693156Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:36.693158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:36.693160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:36.693164Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 650 [2:7559600956024255154:5098]
2025-10-10T14:32:36.693172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:36.693183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:36.693188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.693190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.693192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.693203Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:36.693218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:36.693224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:36.693260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.693263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.693265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.693266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:36.693320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:36.693326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.693347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.693353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.693363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:36.693382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466441:6267], now have 1 active actors on pipe
2025-10-10T14:32:36.693386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466218:2438], now have 1 active actors on pipe
2025-10-10T14:32:36.693392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600956024255149:5098]
2025-10-10T14:32:36.693394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600956024255149:5098]
2025-10-10T14:32:36.693395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600956024255149:5098]
2025-10-10T14:32:36.693405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:36.693414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:36.693416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:36.693418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:36.693419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:36.693425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:36.693427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:36.693441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600956024255149:5098]
2025-10-10T14:32:36.693428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 650
2025-10-10T14:32:36.693428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 650
2025-10-10T14:32:36.693443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:36.693451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:36.693575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.693582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.693607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:36.693616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.693619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.693621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:36.693628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.693636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:36.693648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.693801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.693813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.693834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.693906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 651 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0
2025-10-10T14:32:36.694178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5da0886-c0e5c7b8-d786bfee-364f22c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:36.696892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0] Write session: try to update token
2025-10-10T14:32:36.696908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:36.710511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId: src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:36.712470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:36.712490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.712492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:36.712494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:36.712501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600956024255149:5098]
2025-10-10T14:32:36.712504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600956024255149:5098]
2025-10-10T14:32:36.712506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600956024255149:5098]
2025-10-10T14:32:36.712544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:36.712552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.712557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:36.712579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:36.712598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:36.712603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:36.712678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:36.712926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:36.773050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600956806466450:5983]
2025-10-10T14:32:36.773270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 650, pipe: [1:7559600956806466450:5983]
2025-10-10T14:32:36.813501Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:36.813847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.813860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.813897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466450:5983], now have 1 active actors on pipe
2025-10-10T14:32:36.814050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:36.814142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600956806466450:5983]
2025-10-10T14:32:36.814174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:36.814239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 651 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0
2025-10-10T14:32:36.814444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 651 sessionId: src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0 is DEAD
2025-10-10T14:32:36.814590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:36.814611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0] Write session will restart in 0.007156s
2025-10-10T14:32:36.814636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0] Write session: Do CDS request
2025-10-10T14:32:36.814626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:36.814642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:36.822925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.823013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:36.823027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 652
2025-10-10T14:32:36.823201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.823236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:36.823245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:36.823250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:36.823748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 652 sessionId:  describe result for acl check
2025-10-10T14:32:36.823782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:36.823788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:36.823791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:36.823798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600956806466543:6277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:36.824330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600956806466543:6277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:36.826695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600956806466543:6277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:36.827941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:36.830194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:36.830382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:36.830391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:36.830400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:36.830407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600956806466543:6277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:36.830420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600956806466543:6277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:36.830424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600956806466543:6277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:36.830431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:36.830440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:36.830475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600956024255397:5106]
2025-10-10T14:32:36.830870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:36.831684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:36.831727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:36.831950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:36.831984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.831989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.831990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.831990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.831991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.831992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.831992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.831993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.831994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.831994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.831995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.831996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.831996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.832001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.832008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.832011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.832013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.832015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.832018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.832020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.832022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.832025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.832038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.832041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.832043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.832045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.832050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.832056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.832061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.832064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.832067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.832071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.832073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.832076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.832080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.832083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.832086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.832089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.832091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.832094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.832097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.832100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.832102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.832105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.832107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.832110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.832112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.832115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.832118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.832121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.832123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.832126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.832148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:36.834346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:36.834679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:36.834691Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:36.834693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:36.834696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:36.834700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 651 [2:7559600956024255397:5106]
2025-10-10T14:32:36.834708Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:36.834733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:36.834740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.834742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.834743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.834754Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:36.834759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:36.834766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:36.834802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.834808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.834809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.834810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:36.834859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:36.834866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.834874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.834901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.834912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:36.834930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466689:6277], now have 1 active actors on pipe
2025-10-10T14:32:36.834937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466465:2438], now have 1 active actors on pipe
2025-10-10T14:32:36.834943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600956024255392:5106]
2025-10-10T14:32:36.834944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600956024255392:5106]
2025-10-10T14:32:36.834946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600956024255392:5106]
2025-10-10T14:32:36.834955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:36.834966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:36.834975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:36.834981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:36.834984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:36.834986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:36.834991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:36.835010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600956024255392:5106]
2025-10-10T14:32:36.835019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:36.835030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:36.835020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 651
2025-10-10T14:32:36.835023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 651
2025-10-10T14:32:36.835102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.835109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.835134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:36.835144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.835147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.835149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:36.835157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.835165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:36.835177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.835363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.835369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.835380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.835478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 652 partition: 0 MaxSeqNo: 40 sessionId: src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0
2025-10-10T14:32:36.835858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b4280cd-72c9a02d-cdf6d513-3462b6bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:36.838550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0] Write session: try to update token
2025-10-10T14:32:36.838566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:36.851218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId: src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:36.853448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:36.853465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.853467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:36.853468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:36.853475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600956024255392:5106]
2025-10-10T14:32:36.853478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600956024255392:5106]
2025-10-10T14:32:36.853481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600956024255392:5106]
2025-10-10T14:32:36.853520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:36.853526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.853528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:36.853531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:36.853537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:36.853542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:36.853659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:36.853717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:36.914388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600956806466708:5983]
2025-10-10T14:32:36.914674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 651, pipe: [1:7559600956806466708:5983]
2025-10-10T14:32:36.955307Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:36.955537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.955549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.955584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466708:5983], now have 1 active actors on pipe
2025-10-10T14:32:36.955751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:36.955804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600956806466708:5983]
2025-10-10T14:32:36.955808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:36.955811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:36.955836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:36.955861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 652 reason: error at write: Disconnected sessionId: src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0
2025-10-10T14:32:36.956043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 652 sessionId: src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0 is DEAD
2025-10-10T14:32:36.956215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:36.956226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0] Write session will restart in 0.008257s
2025-10-10T14:32:36.956268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0] Write session: Do CDS request
2025-10-10T14:32:36.956274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:36.965796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.966069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:36.966081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 653
2025-10-10T14:32:36.966211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:36.966245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:36.966255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:36.966259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:36.966619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 653 sessionId:  describe result for acl check
2025-10-10T14:32:36.966647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:36.966652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:36.966653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:36.966657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600956806466863:6284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:36.967102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600956806466863:6284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:36.968701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:36.968855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600956806466863:6284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:36.970569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:36.970708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:36.970717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:36.970724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:36.970757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:36.970921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600956024255654:5115]
2025-10-10T14:32:36.971165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600956806466863:6284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:36.971177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600956806466863:6284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:36.971181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600956806466863:6284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:36.971188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:36.971299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:36.971484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:36.971515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:36.971714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:36.971747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.971751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.971752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.971753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.971753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.971754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.971755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.971755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.971756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.971756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.971757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.971758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.971758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.971762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.971769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.971771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.971774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.971776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.971778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.971780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.971782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.971784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.971787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.971789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.971791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.971793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.971798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.971803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:36.971808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.971811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:36.971814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.971817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:36.971820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.971823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:36.971825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.971828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:36.971830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.971833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:36.971836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.971839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:36.971841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.971844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:36.971846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.971849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:36.971852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.971855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:36.971862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.971865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.971867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.971870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.971872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.971875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.971898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:36.973890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:36.974157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:36.974166Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:36.974167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:36.974169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:36.974173Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 652 [2:7559600956024255654:5115]
2025-10-10T14:32:36.974180Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:36.974191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:36.974195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.974197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.974198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.974209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:36.974218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:36.974224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:36.974262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.974266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.974267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.974269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:36.974315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:36.974322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:36.974333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:36.974344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:36.974365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:36.974384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466933:6284], now have 1 active actors on pipe
2025-10-10T14:32:36.974390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600956806466712:2438], now have 1 active actors on pipe
2025-10-10T14:32:36.974395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600956024255649:5115]
2025-10-10T14:32:36.974396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600956024255649:5115]
2025-10-10T14:32:36.974397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600956024255649:5115]
2025-10-10T14:32:36.974406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:36.974416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:36.974426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:36.974430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:36.974432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:36.974436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:36.974438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:36.974446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600956024255649:5115]
2025-10-10T14:32:36.974448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:36.974439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 652
2025-10-10T14:32:36.974448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 652
2025-10-10T14:32:36.974465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:36.974494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.974501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.974521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:36.974530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:36.974532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:36.974534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:36.974541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:36.974549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:36.974563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.974719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.974727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.974740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:36.974808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 653 partition: 0 MaxSeqNo: 40 sessionId: src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0
2025-10-10T14:32:36.975101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c29ae7b-6fefdb08-4accd2cc-628411b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:36.977542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0] Write session: try to update token
2025-10-10T14:32:36.977556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:36.989639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId: src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:36.990040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:36.990057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:36.990066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600956024255649:5115]
2025-10-10T14:32:36.990105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:36.990178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:36.990267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:36.990398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.990558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.990682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:36.990863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:36.990941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:36.991881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:36.992042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:36.992057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:36.992083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:36.992159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:37.001542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:37.001556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:37.001558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:37.001560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:37.001568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600956024255649:5115]
2025-10-10T14:32:37.001570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600956024255649:5115]
2025-10-10T14:32:37.001573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600956024255649:5115]
2025-10-10T14:32:37.001608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:37.001614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.001615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:37.001621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:37.001627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:37.001631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:37.001727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:37.056204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600961101434240:5983]
2025-10-10T14:32:37.056443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 652, pipe: [1:7559600961101434240:5983]
2025-10-10T14:32:37.103984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:37.110994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.111020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.111177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.111232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.111288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.111346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.111629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.111639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.111701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.111754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.111809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.112047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.112089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.112094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.112167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.112233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.112304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.112376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.112423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.112431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.112495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.112553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.112611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.112672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.112719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.112725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.112795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.112888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.112985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.113041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.113080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.113086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.113142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.113199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.113253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.113306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.113358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.113363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.113423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.113480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.113541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.113596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.113633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.113639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.113701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.113757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.113815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.113873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.113912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.113917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.113980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.114030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.114085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.114138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.114177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.114185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.114245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.114296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.114357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.114414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.114455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.114462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.114508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434240:5983], now have 1 active actors on pipe
2025-10-10T14:32:37.114711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:37.114713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600961101434240:5983]
2025-10-10T14:32:37.114722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:37.114732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:37.114746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 653 reason: error at write: Disconnected sessionId: src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0
2025-10-10T14:32:37.114965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 653 sessionId: src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0 is DEAD
2025-10-10T14:32:37.114962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:37.115115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:37.115127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0] Write session will restart in 0.006212s
2025-10-10T14:32:37.115152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0] Write session: Do CDS request
2025-10-10T14:32:37.115158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:37.122825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.122908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:37.122923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 654
2025-10-10T14:32:37.123043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.123088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:37.123096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:37.123100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:37.123474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 654 sessionId:  describe result for acl check
2025-10-10T14:32:37.123498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:37.123502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:37.123504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:37.123509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600961101434317:6288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:37.123968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600961101434317:6288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:37.126451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600961101434317:6288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:37.129874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:37.129934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600961101434317:6288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:37.129946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600961101434317:6288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:37.129948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600961101434317:6288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:37.129954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:37.130195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:37.130392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:37.130403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:37.130413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:37.130455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:37.130486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600960319223184:5117]
2025-10-10T14:32:37.130909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:37.131122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:37.131165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:37.131399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:37.131440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.131445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.131445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.131446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.131447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.131447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.131454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.131455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.131456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.131456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.131457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.131458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.131458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.131463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.131472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.131474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.131477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.131479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.131481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.131484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.131486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.131489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.131491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.131493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.131496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.131498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.131503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.131508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.131512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.131516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.131518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.131521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.131524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.131527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.131530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.131533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.131535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.131538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.131541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.131544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.131547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.131550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.131553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.131556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.131559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.131562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.131564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.131567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.131570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.131572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.131575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.131577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.131599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:37.133586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:37.133959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:37.133971Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:37.133972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:37.133975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:37.133979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 653 [2:7559600960319223184:5117]
2025-10-10T14:32:37.133990Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:37.134006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:37.134008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.134011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.134013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.134024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:37.134033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:37.134039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:37.134076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.134082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.134083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.134084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:37.134131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:37.134137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.134144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.134150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.134159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:37.134178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434241:2438], now have 1 active actors on pipe
2025-10-10T14:32:37.134184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434467:6288], now have 1 active actors on pipe
2025-10-10T14:32:37.134190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600960319223178:5117]
2025-10-10T14:32:37.134191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600960319223178:5117]
2025-10-10T14:32:37.134193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600960319223178:5117]
2025-10-10T14:32:37.134203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:37.134212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:37.134216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:37.134218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:37.134220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:37.134211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 653
2025-10-10T14:32:37.134225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:37.134227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:37.134246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600960319223178:5117]
2025-10-10T14:32:37.134221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 653
2025-10-10T14:32:37.134249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:37.134250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:37.134268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.134271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.134305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:37.134315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.134317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.134318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:37.134327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.134338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:37.134351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.134468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.134476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.134490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.134561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 654 partition: 0 MaxSeqNo: 40 sessionId: src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0
2025-10-10T14:32:37.134856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb4c88f-5c910a68-cbe6d883-e4ec6d3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:37.137477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0] Write session: try to update token
2025-10-10T14:32:37.137491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:37.150164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId: src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:37.152108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:37.152128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:37.152131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:37.152133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:37.152144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600960319223178:5117]
2025-10-10T14:32:37.152148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600960319223178:5117]
2025-10-10T14:32:37.152151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600960319223178:5117]
2025-10-10T14:32:37.152198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:37.152200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:37.152203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:37.152207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:37.152207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.152210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:37.152358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:37.152525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:37.214904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600961101434490:5983]
2025-10-10T14:32:37.215114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 653, pipe: [1:7559600961101434490:5983]
2025-10-10T14:32:37.257815Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:37.258080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.258093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.258131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434490:5983], now have 1 active actors on pipe
2025-10-10T14:32:37.258294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:37.258350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600961101434490:5983]
2025-10-10T14:32:37.258352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:37.258380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:37.258453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 654 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0
2025-10-10T14:32:37.258645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 654 sessionId: src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0 is DEAD
2025-10-10T14:32:37.258796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:37.258807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0] Write session will restart in 0.005901s
2025-10-10T14:32:37.258831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0] Write session: Do CDS request
2025-10-10T14:32:37.258837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:37.265831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.265894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:37.265913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 655
2025-10-10T14:32:37.266033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.266059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:37.266067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:37.266070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:37.266487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 655 sessionId:  describe result for acl check
2025-10-10T14:32:37.266513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:37.266517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:37.266519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:37.266523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600961101434524:6293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:37.266938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600961101434524:6293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:37.269637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600961101434524:6293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:37.272341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600961101434524:6293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:37.272355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600961101434524:6293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:37.272358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600961101434524:6293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:37.272365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:37.273317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:37.275706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:37.275884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:37.275895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:37.275906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:37.275956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:37.276119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600960319223430:5120]
2025-10-10T14:32:37.276576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:37.276851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:37.276885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:37.277125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:37.277176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.277182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.277183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.277184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.277186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.277187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.277188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.277189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.277190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.277191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.277193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.277194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.277195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.277201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.277210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.277215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.277219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.277222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.277226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.277230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.277234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.277238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.277244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.277248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.277252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.277256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.277263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.277272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.277278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.277284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.277288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.277294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.277298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.277303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.277309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.277315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.277320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.277325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.277346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.277351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.277361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.277366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.277370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.277375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.277380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.277385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.277389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.277400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.277404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.277407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.277409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.277412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.277434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:37.279575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:37.279986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:37.279999Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:37.280001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:37.280004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:37.280010Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 654 [2:7559600960319223430:5120]
2025-10-10T14:32:37.280021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:37.280037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:37.280040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.280044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.280046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.280062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:37.280069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:37.280081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:37.280132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.280139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.280141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.280144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:37.280209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:37.280218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.280229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.280242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.280265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:37.280288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434492:2438], now have 1 active actors on pipe
2025-10-10T14:32:37.280296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434714:6293], now have 1 active actors on pipe
2025-10-10T14:32:37.280305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600960319223425:5120]
2025-10-10T14:32:37.280311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600960319223425:5120]
2025-10-10T14:32:37.280314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600960319223425:5120]
2025-10-10T14:32:37.280327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:37.280344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:37.280349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:37.280352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:37.280331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 654
2025-10-10T14:32:37.280354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:37.280350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 654
2025-10-10T14:32:37.280363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:37.280366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:37.280397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.280406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.280424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600960319223425:5120]
2025-10-10T14:32:37.280436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:37.280454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:37.280464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:37.280471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.280475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.280478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:37.280488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.280503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:37.280530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.280672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.280682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.280697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.280780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 655 partition: 0 MaxSeqNo: 40 sessionId: src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0
2025-10-10T14:32:37.281160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb409b7-4287a5cd-c9b1e179-726bb219_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:37.283746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0] Write session: try to update token
2025-10-10T14:32:37.283762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:37.297215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId: src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:37.298535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:37.298555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:37.298557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:37.298562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:37.298570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600960319223425:5120]
2025-10-10T14:32:37.298573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600960319223425:5120]
2025-10-10T14:32:37.298576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600960319223425:5120]
2025-10-10T14:32:37.298616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:37.298622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.298623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:37.298629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:37.298636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:37.298641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:37.298757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:37.299613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:37.358276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600961101434729:5983]
2025-10-10T14:32:37.358506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 654, pipe: [1:7559600961101434729:5983]
2025-10-10T14:32:37.403306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:37.403580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.403596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.403645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434729:5983], now have 1 active actors on pipe
2025-10-10T14:32:37.403848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:37.403864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600961101434729:5983]
2025-10-10T14:32:37.403876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:37.403908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:37.403980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0
2025-10-10T14:32:37.404151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 655 sessionId: src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0 is DEAD
2025-10-10T14:32:37.404342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:37.404355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0] Write session will restart in 0.009212s
2025-10-10T14:32:37.404382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0] Write session: Do CDS request
2025-10-10T14:32:37.404389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:37.414808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.414907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:37.414919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 656
2025-10-10T14:32:37.415011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.415037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:37.415046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:37.415048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:37.415430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 656 sessionId:  describe result for acl check
2025-10-10T14:32:37.415456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:37.415460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:37.415461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:37.415466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600961101434887:6297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:37.415942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600961101434887:6297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:37.417313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:37.418095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600961101434887:6297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:37.419467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:37.419642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:37.419657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:37.419670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:37.419726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:37.419767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600960319223664:5122]
2025-10-10T14:32:37.420138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600961101434887:6297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:37.420163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600961101434887:6297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:37.420158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:37.420166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600961101434887:6297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:37.420173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:37.420378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:37.420419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:37.420675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:37.420714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.420719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.420719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.420720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.420721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.420721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.420722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.420722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.420723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.420724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.420724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.420725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.420725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.420729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.420737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.420739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.420741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.420743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.420746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.420748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.420750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.420752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.420754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.420756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.420758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.420760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.420765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.420771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.420776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.420779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.420782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.420785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.420787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.420790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.420794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.420798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.420801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.420804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.420809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.420814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.420819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.420824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.420828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.420833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.420838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.420841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.420843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.420846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.420848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.420851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.420854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.420857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.420878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:37.422968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:37.423379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:37.423392Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:37.423394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:37.423397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:37.423403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 655 [2:7559600960319223664:5122]
2025-10-10T14:32:37.423414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:37.423428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:37.423431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.423434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.423436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.423451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:37.423462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:37.423470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:37.423518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.423524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.423526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.423528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:37.423591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:37.423598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.423610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.423618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.423630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:37.423655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434730:2438], now have 1 active actors on pipe
2025-10-10T14:32:37.423663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434956:6297], now have 1 active actors on pipe
2025-10-10T14:32:37.423668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600960319223659:5122]
2025-10-10T14:32:37.423670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600960319223659:5122]
2025-10-10T14:32:37.423671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600960319223659:5122]
2025-10-10T14:32:37.423682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:37.423671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 655
2025-10-10T14:32:37.423692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:37.423680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 655
2025-10-10T14:32:37.423704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:37.423705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:37.423708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:37.423709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:37.423711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:37.423737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.423743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.423756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600960319223659:5122]
2025-10-10T14:32:37.423763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:37.423785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:37.423787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:37.423797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.423800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.423802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:37.423813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.423824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:37.423925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.424087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.424095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.424109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.424189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 656 partition: 0 MaxSeqNo: 40 sessionId: src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0
2025-10-10T14:32:37.424458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114e736c-47c90ec5-5ff35617-e7fde0dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:37.426919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0] Write session: try to update token
2025-10-10T14:32:37.426935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:37.439003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId: src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:37.441224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:37.441655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.441680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.441704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:37.441707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:37.441710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:37.441712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:37.441725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600960319223659:5122]
2025-10-10T14:32:37.441729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600960319223659:5122]
2025-10-10T14:32:37.441732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600960319223659:5122]
2025-10-10T14:32:37.441791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:37.441803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.441805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:37.441861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:37.441875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:37.441880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:37.441933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:37.504186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600961101434968:5983]
2025-10-10T14:32:37.504429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 655, pipe: [1:7559600961101434968:5983]
2025-10-10T14:32:37.547845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:37.548111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:37.548164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434968:5983], now have 1 active actors on pipe
2025-10-10T14:32:37.548236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:37.548444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600961101434968:5983]
2025-10-10T14:32:37.548477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:37.557475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:37.557488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:37.557512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 656 reason: error at write: Disconnected sessionId: src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0
2025-10-10T14:32:37.557650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 656 sessionId: src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0 is DEAD
2025-10-10T14:32:37.557786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:37.557799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0] Write session will restart in 0.005945s
2025-10-10T14:32:37.557824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0] Write session: Do CDS request
2025-10-10T14:32:37.557830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:37.564774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.564806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:37.564816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 657
2025-10-10T14:32:37.564944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.564977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:37.564986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:37.564990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:37.565414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 657 sessionId:  describe result for acl check
2025-10-10T14:32:37.565440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:37.565445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:37.565446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:37.565451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600961101435172:6303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:37.565883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600961101435172:6303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:37.566136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:37.568128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:37.568161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600961101435172:6303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:37.568306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:37.568318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:37.568330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:37.568378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:37.568417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600960319223900:5124]
2025-10-10T14:32:37.569009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:37.569238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:37.569278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:37.569557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:37.569601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.569608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.569609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.569610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.569612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.569613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.569614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.569615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.569617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.569618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.569619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.569620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.569622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.569627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.569636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.569638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.569641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.569643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.569645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.569647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.569649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.569651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.569653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.569656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.569658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.569660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.569667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.569673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.569677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.569680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.569683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.569686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.569693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.569696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.569698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.569701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.569703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.569710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.569713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.569716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.569719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.569729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.569738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.569742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.569751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.569756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.569765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.569770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.569777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.569781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.569784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.569790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.569821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:37.570241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600961101435172:6303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:37.570253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600961101435172:6303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:37.570255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600961101435172:6303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:37.570260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:37.571857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:37.572234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:37.572246Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:37.572248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:37.572251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:37.572256Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 656 [2:7559600960319223900:5124]
2025-10-10T14:32:37.572269Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:37.572282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:37.572289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.572293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.572296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.572312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:37.572323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:37.572330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:37.572378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.572384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.572386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.572389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:37.572446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:37.572454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.572461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.572467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.572477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:37.572495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101434969:2438], now have 1 active actors on pipe
2025-10-10T14:32:37.572499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101435207:6303], now have 1 active actors on pipe
2025-10-10T14:32:37.572504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600960319223895:5124]
2025-10-10T14:32:37.572505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600960319223895:5124]
2025-10-10T14:32:37.572507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600960319223895:5124]
2025-10-10T14:32:37.572516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:37.572527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:37.572530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:37.572532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:37.572534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:37.572548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:37.572535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 656
2025-10-10T14:32:37.572552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:37.572546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 656
2025-10-10T14:32:37.572578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.572585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.572600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600960319223895:5124]
2025-10-10T14:32:37.572608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:37.572616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:37.572629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:37.572637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.572639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.572641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:37.572648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.572655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:37.572669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.572786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.572796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.572810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.572886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 657 partition: 0 MaxSeqNo: 40 sessionId: src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0
2025-10-10T14:32:37.573098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85399d24-fbafdc9b-1b146f22-4afd8015_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:37.575459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0] Write session: try to update token
2025-10-10T14:32:37.575473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:37.587752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId: src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:37.590013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:37.590387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.590405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.590425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:37.590428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:37.590430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:37.590431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:37.590437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600960319223895:5124]
2025-10-10T14:32:37.590440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600960319223895:5124]
2025-10-10T14:32:37.590443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600960319223895:5124]
2025-10-10T14:32:37.590489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:37.590490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:37.590496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.590498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:37.590499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:37.590503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:37.590625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:37.648587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600961101435218:5983]
2025-10-10T14:32:37.648859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 656, pipe: [1:7559600961101435218:5983]
2025-10-10T14:32:37.695668Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:37.695997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:37.696048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101435218:5983], now have 1 active actors on pipe
2025-10-10T14:32:37.696124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:37.696233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600961101435218:5983]
2025-10-10T14:32:37.696262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:37.706138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:37.706152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:37.706177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 657 reason: error at write: Disconnected sessionId: src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0
2025-10-10T14:32:37.706362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 657 sessionId: src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0 is DEAD
2025-10-10T14:32:37.706502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:37.706509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0] Write session will restart in 0.006358s
2025-10-10T14:32:37.706535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0] Write session: Do CDS request
2025-10-10T14:32:37.706540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:37.713752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.713873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:37.713893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 658
2025-10-10T14:32:37.713978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.714008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:37.714014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:37.714017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:37.714401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 658 sessionId:  describe result for acl check
2025-10-10T14:32:37.714432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:37.714437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:37.714438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:37.714442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600961101435424:6307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:37.714969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600961101435424:6307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:37.715168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:37.717103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600961101435424:6307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:37.717258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:37.717432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:37.717443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:37.717455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:37.717504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:37.717543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600960319224139:5127]
2025-10-10T14:32:37.718141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:37.718398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:37.718426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:37.718630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:37.718726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.718731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.718732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.718732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.718733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.718734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.718735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.718735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.718736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.718737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.718737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.718738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.718739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.718742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.718752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.718756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.718760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.718764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.718768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.718772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.718776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.718781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.718783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.718786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.718788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.718790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.718795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.718803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.718810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.718816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.718820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.718828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.718836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.718842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.718852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.718860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.718866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.718871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.718880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.718885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.718904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.718910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.718915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.718922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.718926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.718934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.718938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.718942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.718946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.718950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.718958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.718962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.718997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:37.719135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600961101435424:6307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:37.719145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600961101435424:6307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:37.719148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600961101435424:6307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:37.719152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:37.721030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:37.721423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:37.721434Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:37.721437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:37.721440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:37.721445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 657 [2:7559600960319224139:5127]
2025-10-10T14:32:37.721455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:37.721469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:37.721473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.721476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.721478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.721492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:37.721500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:37.721511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:37.721565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.721572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.721574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.721576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:37.721627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:37.721633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.721640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.721646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.721655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:37.721673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600960319224134:5127]
2025-10-10T14:32:37.721679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600960319224134:5127]
2025-10-10T14:32:37.721680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600960319224134:5127]
2025-10-10T14:32:37.721686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:37.721695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:37.721697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101435219:2438], now have 1 active actors on pipe
2025-10-10T14:32:37.721700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101435458:6307], now have 1 active actors on pipe
2025-10-10T14:32:37.721703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:37.721706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:37.721706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:37.721716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:37.721718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:37.721732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600960319224134:5127]
2025-10-10T14:32:37.721741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:37.721741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 657
2025-10-10T14:32:37.721763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:37.721755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 657
2025-10-10T14:32:37.721832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.721839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.721861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:37.721873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.721877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.721879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:37.721889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.721902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:37.721914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.722051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.722057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.722071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.722132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 658 partition: 0 MaxSeqNo: 40 sessionId: src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0
2025-10-10T14:32:37.722389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52cef021-f0b007e-d0ff58f6-ad94aa73_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:37.724907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0] Write session: try to update token
2025-10-10T14:32:37.724921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:37.732705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:37.732718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:37.732726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600960319224134:5127]
2025-10-10T14:32:37.732766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:37.732765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:37.732930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:37.733066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:37.733220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:37.733393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:37.733661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:37.733697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:37.737853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId: src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:37.740144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:37.740328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.740343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.740374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:37.740433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:37.749241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:37.749255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:37.749258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:37.749260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:37.749270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600960319224134:5127]
2025-10-10T14:32:37.749274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600960319224134:5127]
2025-10-10T14:32:37.749277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600960319224134:5127]
2025-10-10T14:32:37.749316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:37.749322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:37.749326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.749342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:37.749343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:37.749346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:37.749473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:37.796550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600961101435466:5983]
2025-10-10T14:32:37.796783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 657, pipe: [1:7559600961101435466:5983]
2025-10-10T14:32:37.852637Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:37.858848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.858870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.859031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.859087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.859142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.859199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.859241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.859248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.859305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.859357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.859412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.859598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.859695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.859701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.859759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.859813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.859871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.859929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.859968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.859973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.860034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.860110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.860170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.860227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.860268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.860273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.860333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.860387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.860443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.860498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.860536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.860541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.860597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.860649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.860705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.860760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.860798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.860805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.860862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.860915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.860972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.861029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.861068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.861073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.861127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.861176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.861241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.861294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.861345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.861350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.861405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.861457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.861508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.861562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.861620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.861625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.861680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:37.861733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:37.861786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:37.861840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:37.861877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:37.861882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:37.861924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101435466:5983], now have 1 active actors on pipe
2025-10-10T14:32:37.862175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:37.862219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:37.862222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:37.862247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 658 reason: error at write: Disconnected sessionId: src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0
2025-10-10T14:32:37.862361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:37.862448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 658 sessionId: src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0 is DEAD
2025-10-10T14:32:37.862580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:37.862590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0] Write session will restart in 0.008301s
2025-10-10T14:32:37.862617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0] Write session: Do CDS request
2025-10-10T14:32:37.862622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:37.862619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600961101435466:5983]
2025-10-10T14:32:37.871797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.871874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:37.871886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 659
2025-10-10T14:32:37.872045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:37.872079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:37.872085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:37.872088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:37.872400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 659 sessionId:  describe result for acl check
2025-10-10T14:32:37.872443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:37.872448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:37.872449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:37.872453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600961101435594:6320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:37.872834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600961101435594:6320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:37.874319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600961101435594:6320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:37.876408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600961101435594:6320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:37.876421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600961101435594:6320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:37.876424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600961101435594:6320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:37.876431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:37.876492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:37.878684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:37.878855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:37.878865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:37.878876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:37.878939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:37.878976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600960319224417:5135]
2025-10-10T14:32:37.879555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:37.880030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:37.880086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:37.880428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:37.880480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.880485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.880485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.880486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.880487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.880487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.880488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.880489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.880490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.880491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.880491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.880492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.880493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.880497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.880504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.880507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.880509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.880511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.880513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.880515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.880518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.880520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.880522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.880524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.880526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.880528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.880534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.880539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:37.880544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.880548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:37.880550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.880553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:37.880556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.880561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:37.880565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.880571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:37.880575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.880581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:37.880585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.880589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:37.880591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.880605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:37.880608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.880611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:37.880614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.880617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:37.880619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.880622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.880625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.880628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.880630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.880633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.880655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:37.882736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:37.883260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:37.883272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:37.883274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:37.883277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:37.883282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 658 [2:7559600960319224417:5135]
2025-10-10T14:32:37.883294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:37.883309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:37.883313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.883316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.883317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.883333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:37.883345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:37.883352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:37.883409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.883416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.883418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.883421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:37.883481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:37.883488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.883500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:37.883512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:37.883532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:37.883556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101435481:2438], now have 1 active actors on pipe
2025-10-10T14:32:37.883564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101435720:6320], now have 1 active actors on pipe
2025-10-10T14:32:37.883572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600960319224411:5135]
2025-10-10T14:32:37.883574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600960319224411:5135]
2025-10-10T14:32:37.883576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600960319224411:5135]
2025-10-10T14:32:37.883589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:37.883588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 658
2025-10-10T14:32:37.883593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 658
2025-10-10T14:32:37.883607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:37.883614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:37.883617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:37.883619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:37.883627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:37.883631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:37.883664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.883672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.883687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600960319224411:5135]
2025-10-10T14:32:37.883697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:37.883715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:37.883733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:37.883745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:37.883749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:37.883751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:37.883761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:37.883776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:37.883800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.883933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.883942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.883959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:37.884047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 659 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0
2025-10-10T14:32:37.884312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d8dfb0-5533e84d-2f20ea32-7c6a797a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:37.886653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0] Write session: try to update token
2025-10-10T14:32:37.886666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:37.899262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId: src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:37.901712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:37.901864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:37.901879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:37.901883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:37.901885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:37.901894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600960319224411:5135]
2025-10-10T14:32:37.901898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600960319224411:5135]
2025-10-10T14:32:37.901902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600960319224411:5135]
2025-10-10T14:32:37.901956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:37.901964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:37.901969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:37.901970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:37.901975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:37.901989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:37.901999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:37.902003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:37.902138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:37.962949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600961101435732:5983]
2025-10-10T14:32:37.963174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 658, pipe: [1:7559600961101435732:5983]
2025-10-10T14:32:38.008651Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:38.009187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600961101435732:5983], now have 1 active actors on pipe
2025-10-10T14:32:38.009405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:38.009402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:38.009432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600961101435732:5983]
2025-10-10T14:32:38.009455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:38.009458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:38.009520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 659 reason: error at write: Disconnected sessionId: src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0
2025-10-10T14:32:38.009703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 659 sessionId: src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0 is DEAD
2025-10-10T14:32:38.009920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:38.009928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0] Write session will restart in 0.008109s
2025-10-10T14:32:38.009952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0] Write session: Do CDS request
2025-10-10T14:32:38.009958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:38.018815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.018940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:38.018954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 660
2025-10-10T14:32:38.019076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.019102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:38.019110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:38.019113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:38.019528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 660 sessionId:  describe result for acl check
2025-10-10T14:32:38.019564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:38.019571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:38.019572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:38.019578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600965396403116:6324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:38.020147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600965396403116:6324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:38.022516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600965396403116:6324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:38.023875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:38.025830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:38.026073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600965396403116:6324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:38.026084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600965396403116:6324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:38.026078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:38.026087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600965396403116:6324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:38.026092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:38.026089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:38.026100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:38.026148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:38.026180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600964614191951:5144]
2025-10-10T14:32:38.026816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:38.027069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:38.027110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:38.027413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:38.027463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.027469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.027470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.027471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.027472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.027473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.027474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.027475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.027477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.027478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.027479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.027480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.027481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.027484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.027492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.027494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.027497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.027499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.027501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.027504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.027506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.027508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.027511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.027513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.027515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.027518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.027524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.027529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.027534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.027537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.027540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.027550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.027559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.027569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.027577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.027583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.027591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.027594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.027601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.027604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.027606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.027609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.027612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.027615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.027622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.027625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.027627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.027630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.027633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.027636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.027642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.027645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.027668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:38.029670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:38.030110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:38.030124Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:38.030126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:38.030129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:38.030136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 659 [2:7559600964614191951:5144]
2025-10-10T14:32:38.030148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:38.030164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:38.030167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.030170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.030172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.030188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:38.030194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:38.030204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:38.030242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.030247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.030248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.030250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:38.030298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:38.030303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.030310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.030316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.030326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:38.030343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600964614191946:5144]
2025-10-10T14:32:38.030348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600964614191946:5144]
2025-10-10T14:32:38.030349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600964614191946:5144]
2025-10-10T14:32:38.030356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:38.030366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403030:2438], now have 1 active actors on pipe
2025-10-10T14:32:38.030365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:38.030368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:38.030370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:38.030371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403260:6324], now have 1 active actors on pipe
2025-10-10T14:32:38.030374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:38.030384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:38.030386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:38.030401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600964614191946:5144]
2025-10-10T14:32:38.030407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:38.030419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:38.030416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 659
2025-10-10T14:32:38.030417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 659
2025-10-10T14:32:38.030500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.030507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.030534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:38.030543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.030546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.030548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:38.030556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.030564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:38.030578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.030704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.030710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.030721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.030824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 660 partition: 0 MaxSeqNo: 40 sessionId: src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0
2025-10-10T14:32:38.031169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a6019d-813d8b90-bb728dda-cf6602ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:38.033874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0] Write session: try to update token
2025-10-10T14:32:38.033889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:38.048054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId: src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:38.049378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:38.049392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.049395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:38.049397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:38.049407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600964614191946:5144]
2025-10-10T14:32:38.049411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600964614191946:5144]
2025-10-10T14:32:38.049415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600964614191946:5144]
2025-10-10T14:32:38.049466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:38.049469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:38.049475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:38.049478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:38.049481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.049483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:38.049615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:38.050358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:38.109380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600965396403271:5983]
2025-10-10T14:32:38.109631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 659, pipe: [1:7559600965396403271:5983]
2025-10-10T14:32:38.155899Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:38.156378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.156393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.156432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403271:5983], now have 1 active actors on pipe
2025-10-10T14:32:38.156625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:38.156671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:38.156660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:38.156663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:38.156678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600965396403271:5983]
2025-10-10T14:32:38.156716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 660 reason: error at write: Disconnected sessionId: src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0
2025-10-10T14:32:38.156910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 660 sessionId: src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0 is DEAD
2025-10-10T14:32:38.157036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:38.157045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0] Write session will restart in 0.006613s
2025-10-10T14:32:38.157063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0] Write session: Do CDS request
2025-10-10T14:32:38.157071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:38.164821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.164910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:38.164922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 661
2025-10-10T14:32:38.165022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.165049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:38.165057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:38.165060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:38.165414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 661 sessionId:  describe result for acl check
2025-10-10T14:32:38.165440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:38.165445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:38.165446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:38.165450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600965396403327:6328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:38.165872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600965396403327:6328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:38.168281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600965396403327:6328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:38.170246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600965396403327:6328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:38.170256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600965396403327:6328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:38.170259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600965396403327:6328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:38.170265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:38.171306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:38.173499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:38.173690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:38.173702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:38.173714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:38.173767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:38.173805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600964614192192:5146]
2025-10-10T14:32:38.174412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:38.174681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:38.174720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:38.175041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:38.175096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.175102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.175103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.175104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.175106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.175107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.175108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.175110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.175111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.175112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.175113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.175114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.175116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.175121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.175134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.175138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.175142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.175146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.175151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.175155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.175159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.175163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.175167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.175171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.175175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.175178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.175186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.175195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.175206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.175216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.175225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.175235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.175244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.175254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.175262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.175272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.175279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.175286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.175295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.175304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.175313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.175318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.175327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.175336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.175345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.175351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.175359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.175364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.175373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.175378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.175383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.175389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.175432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:38.177613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:38.178089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:38.178100Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:38.178102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:38.178105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:38.178110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 660 [2:7559600964614192192:5146]
2025-10-10T14:32:38.178120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:38.178133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:38.178139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.178141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.178143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.178155Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:38.178161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:38.178171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:38.178225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.178233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.178235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.178237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:38.178299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:38.178306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.178314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.178320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.178330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:38.178345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600964614192187:5146]
2025-10-10T14:32:38.178350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600964614192187:5146]
2025-10-10T14:32:38.178352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600964614192187:5146]
2025-10-10T14:32:38.178359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:38.178369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:38.178373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403501:6328], now have 1 active actors on pipe
2025-10-10T14:32:38.178376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403273:2438], now have 1 active actors on pipe
2025-10-10T14:32:38.178377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:38.178380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:38.178385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:38.178401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:38.178410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:38.178429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600964614192187:5146]
2025-10-10T14:32:38.178438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:38.178452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:38.178456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 660
2025-10-10T14:32:38.178457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 660
2025-10-10T14:32:38.178513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.178524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.178551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:38.178561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.178564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.178566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:38.178575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.178583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:38.178607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.178759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.178767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.178781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.178863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 661 partition: 0 MaxSeqNo: 40 sessionId: src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0
2025-10-10T14:32:38.179241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79198999-f2efd8c1-cd9e93d2-838c5fca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:38.181853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0] Write session: try to update token
2025-10-10T14:32:38.181869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:38.189467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:38.189479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.189488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600964614192187:5146]
2025-10-10T14:32:38.189529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:38.189533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:38.189686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:38.189809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:38.189940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:38.190073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:38.190236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:38.190269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:38.196290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId: src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:38.198665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:38.198882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.198912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.198945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:38.199024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:38.206623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:38.206643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.206646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:38.206648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:38.206660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600964614192187:5146]
2025-10-10T14:32:38.206665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600964614192187:5146]
2025-10-10T14:32:38.206668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600964614192187:5146]
2025-10-10T14:32:38.206717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:38.206718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:38.206723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:38.206727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:38.206731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.206737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:38.206881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:38.256823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600965396403527:5983]
2025-10-10T14:32:38.256983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 660, pipe: [1:7559600965396403527:5983]
2025-10-10T14:32:38.313176Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:38.319718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.319742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.319895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.319952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.320009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.320071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.320113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.320120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.320181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.320250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.320317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.320415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.320459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.320464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.320542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.320594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.320651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.320761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.320800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.320805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.320865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.320967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.321053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.321111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.321151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.321156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.321215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.321267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.321321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.321393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.321434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.321439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.321497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.321551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.321606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.321660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.321698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.321704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.321759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.321808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.321864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.321919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.321957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.321962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.322016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.322069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.322124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.322179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.322221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.322226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.322284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.322336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.322390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.322444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.322481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.322486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.322541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.322595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.322663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.322734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.322789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.322796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.322843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403527:5983], now have 1 active actors on pipe
2025-10-10T14:32:38.323127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:38.323130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:38.323143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:38.323166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600965396403527:5983]
2025-10-10T14:32:38.323170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 661 reason: error at write: Disconnected sessionId: src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0
2025-10-10T14:32:38.323385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 661 sessionId: src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0 is DEAD
2025-10-10T14:32:38.323534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:38.323545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0] Write session will restart in 0.009136s
2025-10-10T14:32:38.323566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0] Write session: Do CDS request
2025-10-10T14:32:38.323571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:38.323667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:38.333902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.333944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:38.333957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 662
2025-10-10T14:32:38.334153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.334191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:38.334195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:38.334199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:38.334601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 662 sessionId:  describe result for acl check
2025-10-10T14:32:38.334626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:38.334631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:38.334632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:38.334636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600965396403678:6333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:38.335072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600965396403678:6333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:38.336974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600965396403678:6333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:38.337472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:38.339654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:38.339822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:38.339832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:38.339841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:38.339835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600965396403678:6333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:38.339847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600965396403678:6333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:38.339849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600965396403678:6333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:38.339855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:38.339883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:38.339925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600964614192444:5149]
2025-10-10T14:32:38.340503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:38.340760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:38.340799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:38.341106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:38.341158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.341165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.341166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.341166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.341167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.341168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.341168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.341169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.341169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.341170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.341171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.341171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.341172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.341176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.341184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.341187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.341189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.341191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.341194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.341196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.341198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.341200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.341204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.341206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.341208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.341211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.341216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.341222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.341226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.341229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.341232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.341235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.341237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.341240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.341243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.341246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.341249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.341252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.341255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.341258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.341260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.341263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.341266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.341269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.341272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.341275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.341278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.341282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.341286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.341291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.341295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.341300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.341350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:38.343504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:38.344210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:38.344223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:38.344225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:38.344229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:38.344234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 661 [2:7559600964614192444:5149]
2025-10-10T14:32:38.344248Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:38.344261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:38.344263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.344265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.344267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.344279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:38.344284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:38.344290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:38.344337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.344345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.344346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.344349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:38.344412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:38.344418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.344425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.344432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.344442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:38.344468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403762:6333], now have 1 active actors on pipe
2025-10-10T14:32:38.344476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403529:2438], now have 1 active actors on pipe
2025-10-10T14:32:38.344483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600964614192439:5149]
2025-10-10T14:32:38.344488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600964614192439:5149]
2025-10-10T14:32:38.344490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600964614192439:5149]
2025-10-10T14:32:38.344504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:38.344521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:38.344528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:38.344531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:38.344533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:38.344541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:38.344544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:38.344524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 661
2025-10-10T14:32:38.344524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 661
2025-10-10T14:32:38.344563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600964614192439:5149]
2025-10-10T14:32:38.344572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:38.344581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:38.344592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.344601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.344651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:38.344664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.344667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.344669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:38.344680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.344690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:38.344711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.344821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.344828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.344842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.344909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 662 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0
2025-10-10T14:32:38.345238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145ce984-9ac3f5af-38fe80ae-371fab42_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:38.347727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0] Write session: try to update token
2025-10-10T14:32:38.347742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:38.360118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId: src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:38.362469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:38.362505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:38.362521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.362525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:38.362527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:38.362536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600964614192439:5149]
2025-10-10T14:32:38.362541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600964614192439:5149]
2025-10-10T14:32:38.362544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600964614192439:5149]
2025-10-10T14:32:38.362587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:38.362592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:38.362596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:38.362600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:38.362600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.362602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:38.362731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:38.423226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600965396403773:5983]
2025-10-10T14:32:38.423400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 661, pipe: [1:7559600965396403773:5983]
2025-10-10T14:32:38.470580Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:38.470795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.470809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.470858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403773:5983], now have 1 active actors on pipe
2025-10-10T14:32:38.471050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:38.471114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:38.471117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:38.471127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:38.471173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600965396403773:5983]
2025-10-10T14:32:38.471185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 662 reason: error at write: Disconnected sessionId: src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0
2025-10-10T14:32:38.471378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 662 sessionId: src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0 is DEAD
2025-10-10T14:32:38.471499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:38.471509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0] Write session will restart in 0.009211s
2025-10-10T14:32:38.471531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0] Write session: Do CDS request
2025-10-10T14:32:38.471539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:38.481756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.481790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:38.481801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 663
2025-10-10T14:32:38.481960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.481987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:38.481995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:38.481998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:38.482343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 663 sessionId:  describe result for acl check
2025-10-10T14:32:38.482372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:38.482378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:38.482381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:38.482387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600965396403920:6337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:38.482813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600965396403920:6337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:38.484920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600965396403920:6337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:38.485389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:38.487306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:38.487448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:38.487460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:38.487471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:38.487479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600965396403920:6337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:38.487490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600965396403920:6337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:38.487493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600965396403920:6337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:38.487498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:38.487519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:38.487547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600964614192685:5151]
2025-10-10T14:32:38.488127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:38.488393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:38.488430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:38.488728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:38.488778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.488783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.488784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.488786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.488787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.488788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.488789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.488790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.488791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.488792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.488793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.488794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.488795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.488800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.488812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.488816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.488820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.488824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.488828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.488832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.488836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.488839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.488844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.488847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.488851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.488855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.488863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.488869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.488877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.488881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.488884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.488887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.488889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.488893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.488895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.488898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.488901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.488904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.488906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.488910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.488912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.488915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.488917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.488920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.488923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.488926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.488929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.488932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.488934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.488939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.488943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.488948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.488978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:38.491063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:38.491369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:38.491379Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:38.491381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:38.491383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:38.491388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 662 [2:7559600964614192685:5151]
2025-10-10T14:32:38.491395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:38.491408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:38.491410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.491412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.491413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.491425Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:38.491434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:38.491441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:38.491491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.491497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.491498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.491500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:38.491546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:38.491552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.491559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.491565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.491577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:38.491594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404008:6337], now have 1 active actors on pipe
2025-10-10T14:32:38.491600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396403775:2438], now have 1 active actors on pipe
2025-10-10T14:32:38.491605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600964614192680:5151]
2025-10-10T14:32:38.491606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600964614192680:5151]
2025-10-10T14:32:38.491608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600964614192680:5151]
2025-10-10T14:32:38.491617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:38.491627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:38.491640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:38.491640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:38.491643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:38.491644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:38.491645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:38.491637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 662
2025-10-10T14:32:38.491644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 662
2025-10-10T14:32:38.491663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600964614192680:5151]
2025-10-10T14:32:38.491670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:38.491672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:38.491689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.491697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.491734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:38.491743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.491746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.491747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:38.491758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.491773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:38.491792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.491904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.491911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.491925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.491994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 663 partition: 0 MaxSeqNo: 40 sessionId: src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0
2025-10-10T14:32:38.492259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee5f2bd0-6c14cc1d-e79bc523-fcdba80a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:38.494770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0] Write session: try to update token
2025-10-10T14:32:38.494783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:38.507428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId: src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:38.509391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:38.509405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.509407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:38.509408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:38.509415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600964614192680:5151]
2025-10-10T14:32:38.509418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600964614192680:5151]
2025-10-10T14:32:38.509421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600964614192680:5151]
2025-10-10T14:32:38.509457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:38.509465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.509466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:38.509469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:38.509475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:38.509479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:38.509586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:38.509846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:38.571187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600965396404026:5983]
2025-10-10T14:32:38.571422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 662, pipe: [1:7559600965396404026:5983]
2025-10-10T14:32:38.609356Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:38.609859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.609872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.609908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404026:5983], now have 1 active actors on pipe
2025-10-10T14:32:38.610074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:38.610187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:38.610217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600965396404026:5983]
2025-10-10T14:32:38.610228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:38.610300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 663 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0
2025-10-10T14:32:38.610489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 663 sessionId: src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0 is DEAD
2025-10-10T14:32:38.610624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:38.610631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0] Write session will restart in 0.005562s
2025-10-10T14:32:38.610655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0] Write session: Do CDS request
2025-10-10T14:32:38.610661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:38.617832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.617913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:38.617926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 664
2025-10-10T14:32:38.618060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.618087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:38.618092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:38.618096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:38.618439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 664 sessionId:  describe result for acl check
2025-10-10T14:32:38.618467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:38.618472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:38.618473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:38.618477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600965396404054:6343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:38.618951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600965396404054:6343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:38.621144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600965396404054:6343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:38.623775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600965396404054:6343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:38.623785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600965396404054:6343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:38.623788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600965396404054:6343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:38.623794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:38.626147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:38.628271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:38.628416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:38.628425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:38.628433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:38.628468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:38.628500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600964614192931:5154]
2025-10-10T14:32:38.628895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:38.629186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:38.629231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:38.629484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:38.629540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.629546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.629547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.629548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.629550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.629551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.629552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.629553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.629554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.629555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.629557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.629558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.629559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.629565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.629573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.629575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.629577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.629580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.629582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.629584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.629586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.629588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.629590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.629592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.629594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.629596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.629601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.629608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.629612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.629615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.629618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.629621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.629624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.629627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.629629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.629632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.629636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.629641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.629646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.629650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.629654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.629659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.629663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.629669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.629672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.629678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.629682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.629687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.629691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.629696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.629701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.629705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.629726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:38.631851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:38.632236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:38.632248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:38.632250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:38.632253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:38.632258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 663 [2:7559600964614192931:5154]
2025-10-10T14:32:38.632269Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:38.632282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:38.632284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.632287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.632288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.632300Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:38.632308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:38.632314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:38.632351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.632357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.632358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.632359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:38.632406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:38.632411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.632418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.632424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.632433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:38.632448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600964614192926:5154]
2025-10-10T14:32:38.632453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600964614192926:5154]
2025-10-10T14:32:38.632455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600964614192926:5154]
2025-10-10T14:32:38.632461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:38.632471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:38.632471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:38.632474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:38.632477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:38.632486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:38.632489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:38.632501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404221:6343], now have 1 active actors on pipe
2025-10-10T14:32:38.632504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404027:2438], now have 1 active actors on pipe
2025-10-10T14:32:38.632522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600964614192926:5154]
2025-10-10T14:32:38.632531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:38.632542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 663
2025-10-10T14:32:38.632558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:38.632543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 663
2025-10-10T14:32:38.632604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.632613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.632648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:38.632659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.632662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.632664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:38.632672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.632680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:38.632691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.632840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.632850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.632866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.632926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 664 partition: 0 MaxSeqNo: 40 sessionId: src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0
2025-10-10T14:32:38.633237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18445e50-ff7aa1-24f82d66-8b1ae2a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:38.635605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0] Write session: try to update token
2025-10-10T14:32:38.635618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:38.643211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:38.643225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.643233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600964614192926:5154]
2025-10-10T14:32:38.643286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:38.643292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:38.643457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:38.643590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:38.643709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:38.643831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:38.644126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:38.644159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:38.648799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId: src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:38.651181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:38.651359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.651379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.651416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:38.651505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:38.660138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:38.660153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.660156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:38.660158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:38.660169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600964614192926:5154]
2025-10-10T14:32:38.660173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600964614192926:5154]
2025-10-10T14:32:38.660177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600964614192926:5154]
2025-10-10T14:32:38.660217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:38.660223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:38.660224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:38.660227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:38.660231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.660233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:38.660356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:38.710461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600965396404276:5983]
2025-10-10T14:32:38.710744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 663, pipe: [1:7559600965396404276:5983]
2025-10-10T14:32:38.763599Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:38.770080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.770101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.770243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.770298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.770355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.770408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.770446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.770453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.770508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.770559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.770613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.770669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.770706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.770712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.770767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.770819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.770885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.770957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.770994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.771000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.771053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.771107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.771179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.771246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.771291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.771299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.771359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.771411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.771463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.771515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.771552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.771557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.771611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.771661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.771714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.771769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.771817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.771826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.771886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.771940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.771993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.772047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.772086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.772091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.772144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.772195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.772247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.772298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.772349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.772356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.772409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.772457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.772508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.772559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.772596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.772601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.772652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:38.772735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:38.772786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:38.772847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:38.772893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:38.772900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:38.772937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404276:5983], now have 1 active actors on pipe
2025-10-10T14:32:38.773105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:38.773116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:38.773116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600965396404276:5983]
2025-10-10T14:32:38.773135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:38.773142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 664 reason: error at write: Disconnected sessionId: src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0
2025-10-10T14:32:38.773315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 664 sessionId: src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0 is DEAD
2025-10-10T14:32:38.773427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:38.773435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0] Write session will restart in 0.009510s
2025-10-10T14:32:38.773459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0] Write session: Do CDS request
2025-10-10T14:32:38.773465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:38.773581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:38.783801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.783828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:38.783843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 665
2025-10-10T14:32:38.784038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.784066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:38.784073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:38.784076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:38.784485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 665 sessionId:  describe result for acl check
2025-10-10T14:32:38.784517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:38.784522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:38.784523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:38.784528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600965396404414:6347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:38.785222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600965396404414:6347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:38.787272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600965396404414:6347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:38.787851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:38.789900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:38.790060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:38.790071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:38.790082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:38.790129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:38.790169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600964614193174:5156]
2025-10-10T14:32:38.790152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600965396404414:6347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:38.790165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600965396404414:6347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:38.790168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600965396404414:6347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:38.790175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:38.790755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:38.790976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:38.791014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:38.791315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:38.791366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.791372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.791373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.791374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.791376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.791377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.791378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.791379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.791380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.791381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.791382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.791383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.791384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.791389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.791401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.791405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.791409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.791413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.791417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.791421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.791425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.791429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.791433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.791437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.791440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.791444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.791451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.791459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.791465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.791470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.791474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.791479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.791483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.791494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.791498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.791503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.791511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.791516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.791521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.791526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.791534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.791539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.791545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.791554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.791558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.791563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.791568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.791577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.791581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.791586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.791593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.791598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.791638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:38.793616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:38.794005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:38.794016Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:38.794018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:38.794021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:38.794026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 664 [2:7559600964614193174:5156]
2025-10-10T14:32:38.794036Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:38.794049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:38.794051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.794055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.794057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.794071Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:38.794083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:38.794090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:38.794134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.794140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.794142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.794144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:38.794211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:38.794218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.794230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.794242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.794264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:38.794263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 664
2025-10-10T14:32:38.794282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 664
2025-10-10T14:32:38.794286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404277:2438], now have 1 active actors on pipe
2025-10-10T14:32:38.794294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404512:6347], now have 1 active actors on pipe
2025-10-10T14:32:38.794301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600964614193169:5156]
2025-10-10T14:32:38.794303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600964614193169:5156]
2025-10-10T14:32:38.794305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600964614193169:5156]
2025-10-10T14:32:38.794314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:38.794320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:38.794322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:38.794323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:38.794328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:38.794344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:38.794352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:38.794374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.794383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.794409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600964614193169:5156]
2025-10-10T14:32:38.794420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:38.794432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:38.794439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:38.794447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.794450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.794452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:38.794462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.794476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:38.794506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.794635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.794642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.794655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.794711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 665 partition: 0 MaxSeqNo: 40 sessionId: src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0
2025-10-10T14:32:38.794972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d701d5-f57f0d58-f6feb19e-c79c22f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:38.797289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0] Write session: try to update token
2025-10-10T14:32:38.797301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:38.809794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId: src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:38.812125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:38.812234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:38.812251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.812254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:38.812256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:38.812266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600964614193169:5156]
2025-10-10T14:32:38.812270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600964614193169:5156]
2025-10-10T14:32:38.812273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600964614193169:5156]
2025-10-10T14:32:38.812300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:38.812305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:38.812309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:38.812322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.812331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.812351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:38.812364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.812367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:38.812492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:38.873257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600965396404537:5983]
2025-10-10T14:32:38.873432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 664, pipe: [1:7559600965396404537:5983]
2025-10-10T14:32:38.918862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:38.919196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404537:5983], now have 1 active actors on pipe
2025-10-10T14:32:38.919396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:38.919405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:38.919408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600965396404537:5983]
2025-10-10T14:32:38.919426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:38.919429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:38.919492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 665 reason: error at write: Disconnected sessionId: src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0
2025-10-10T14:32:38.919692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 665 sessionId: src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0 is DEAD
2025-10-10T14:32:38.919832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:38.919841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0] Write session will restart in 0.008457s
2025-10-10T14:32:38.919867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0] Write session: Do CDS request
2025-10-10T14:32:38.919873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:38.929830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.929935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:38.929949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 666
2025-10-10T14:32:38.930057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:38.930084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:38.930089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:38.930092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:38.930430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 666 sessionId:  describe result for acl check
2025-10-10T14:32:38.930454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:38.930460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:38.930461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:38.930466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600965396404674:6360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:38.930897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600965396404674:6360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:38.933079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600965396404674:6360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:38.933881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:38.936341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:38.936426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600965396404674:6360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:38.936439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600965396404674:6360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:38.936443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600965396404674:6360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:38.936450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:38.936526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:38.936538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:38.936551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:38.936608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:38.936647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600964614193457:5171]
2025-10-10T14:32:38.937145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:38.937416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:38.937449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:38.937685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:38.937726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.937731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.937732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.937733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.937733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.937734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.937735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.937735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.937736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.937737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.937737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.937738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.937738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.937742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.937750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.937753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.937756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.937758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.937760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.937762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.937765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.937767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.937769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.937772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.937774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.937776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.937781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.937787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:38.937791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.937794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:38.937797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.937800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:38.937804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.937810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:38.937814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.937818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:38.937821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.937826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:38.937830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.937835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:38.937839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.937844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:38.937849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.937855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:38.937859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.937864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:38.937868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.937871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.937874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.937877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.937879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.937882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.937904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:38.940037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:38.940303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:38.940312Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:38.940314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:38.940317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:38.940321Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 665 [2:7559600964614193457:5171]
2025-10-10T14:32:38.940328Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:38.940340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:38.940341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.940343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.940344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.940353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:38.940358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:38.940364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:38.940398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.940405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.940406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.940407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:38.940455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:38.940460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.940466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:38.940473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:38.940483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:38.940498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600964614193452:5171]
2025-10-10T14:32:38.940503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600964614193452:5171]
2025-10-10T14:32:38.940505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600964614193452:5171]
2025-10-10T14:32:38.940510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:38.940518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:38.940521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404785:6360], now have 1 active actors on pipe
2025-10-10T14:32:38.940524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600965396404552:2438], now have 1 active actors on pipe
2025-10-10T14:32:38.940525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:38.940527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:38.940531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:38.940546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:38.940555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:38.940543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 665
2025-10-10T14:32:38.940543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 665
2025-10-10T14:32:38.940584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.940591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.940601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600964614193452:5171]
2025-10-10T14:32:38.940608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:38.940622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:38.940630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbd9ea23-af7db695-7756b773-b52217e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:38.940635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:38.940637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:38.940639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:38.940646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:38.940654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:38.940673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.940804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.940812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.940827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:38.940908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 666 partition: 0 MaxSeqNo: 40 sessionId: src_id|cbd9ea23-af7db695-7756b773-b52217e3_0
2025-10-10T14:32:38.941244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee94b8-2221c6ab-7d8590ef-ee9341bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cbd9ea23-af7db695-7756b773-b52217e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:38.943826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd9ea23-af7db695-7756b773-b52217e3_0] Write session: try to update token
2025-10-10T14:32:38.943842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd9ea23-af7db695-7756b773-b52217e3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:38.956732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId: src_id|cbd9ea23-af7db695-7756b773-b52217e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:38.958996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:38.959531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:38.959553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:38.959577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:38.959580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:38.959583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:38.959584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:38.959593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600964614193452:5171]
2025-10-10T14:32:38.959597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600964614193452:5171]
2025-10-10T14:32:38.959601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600964614193452:5171]
2025-10-10T14:32:38.959641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:38.959654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:38.959658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:38.959658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:38.959665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:38.959667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:38.959789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:39.019714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600969691372093:5983]
2025-10-10T14:32:39.019947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 665, pipe: [1:7559600969691372093:5983]
2025-10-10T14:32:39.063744Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:39.064259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:39.064312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372093:5983], now have 1 active actors on pipe
2025-10-10T14:32:39.064407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:39.064479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600969691372093:5983]
2025-10-10T14:32:39.064498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:39.064500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:39.064506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:39.064569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 666 reason: error at write: Disconnected sessionId: src_id|cbd9ea23-af7db695-7756b773-b52217e3_0
2025-10-10T14:32:39.064715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 666 sessionId: src_id|cbd9ea23-af7db695-7756b773-b52217e3_0 is DEAD
2025-10-10T14:32:39.064858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd9ea23-af7db695-7756b773-b52217e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:39.064867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd9ea23-af7db695-7756b773-b52217e3_0] Write session will restart in 0.005836s
2025-10-10T14:32:39.064886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd9ea23-af7db695-7756b773-b52217e3_0] Write session: Do CDS request
2025-10-10T14:32:39.064891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd9ea23-af7db695-7756b773-b52217e3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:39.071808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd9ea23-af7db695-7756b773-b52217e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.071889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:39.071903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 667
2025-10-10T14:32:39.072040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.072072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:39.072083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:39.072087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:39.072409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 667 sessionId:  describe result for acl check
2025-10-10T14:32:39.072436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:39.072442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:39.072444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:39.072450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600969691372140:6364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:39.072870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600969691372140:6364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:39.075280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600969691372140:6364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:39.077822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600969691372140:6364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:39.077833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600969691372140:6364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:39.077845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600969691372140:6364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:39.077850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:39.079307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:39.081407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:39.081576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:39.081587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:39.081599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:39.081649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:39.081677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600968909160999:5173]
2025-10-10T14:32:39.082040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:39.082267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:39.082298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:39.082505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:39.082539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.082543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.082544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.082545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.082545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.082546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.082546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.082547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.082548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.082549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.082549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.082550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.082550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.082554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.082563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.082565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.082568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.082570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.082573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.082575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.082577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.082579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.082582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.082584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.082587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.082589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.082595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.082600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.082604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.082608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.082610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.082613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.082616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.082619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.082622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.082625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.082628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.082631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.082634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.082636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.082639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.082642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.082645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.082648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.082650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.082653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.082656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.082659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.082661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.082664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.082668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.082671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.082692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:39.084715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:39.085110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:39.085120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:39.085122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:39.085124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:39.085128Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 666 [2:7559600968909160999:5173]
2025-10-10T14:32:39.085138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:39.085153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:39.085156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.085160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.085162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.085176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:39.085188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:39.085194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:39.085234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.085240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.085241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.085242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:39.085294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:39.085301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.085310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.085326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.085357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:39.085382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372329:6364], now have 1 active actors on pipe
2025-10-10T14:32:39.085390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372094:2438], now have 1 active actors on pipe
2025-10-10T14:32:39.085396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600968909160994:5173]
2025-10-10T14:32:39.085403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600968909160994:5173]
2025-10-10T14:32:39.085405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600968909160994:5173]
2025-10-10T14:32:39.085419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:39.085410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 666
2025-10-10T14:32:39.085436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:39.085412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 666
2025-10-10T14:32:39.085436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:39.085439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:39.085440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:39.085456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:39.085458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:39.085478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600968909160994:5173]
2025-10-10T14:32:39.085489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:39.085492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:39.085503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.085511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.085555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88985409-29059bc0-34779ec-2379d467_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:39.085567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.085570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.085577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:39.085586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.085599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:39.085618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.085731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.085738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.085751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.085823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 667 partition: 0 MaxSeqNo: 40 sessionId: src_id|88985409-29059bc0-34779ec-2379d467_0
2025-10-10T14:32:39.086096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd9ea23-af7db695-7756b773-b52217e3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|88985409-29059bc0-34779ec-2379d467_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:39.088543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88985409-29059bc0-34779ec-2379d467_0] Write session: try to update token
2025-10-10T14:32:39.088555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88985409-29059bc0-34779ec-2379d467_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:39.100908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId: src_id|88985409-29059bc0-34779ec-2379d467_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:39.103171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:39.103187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:39.103189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:39.103190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:39.103198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600968909160994:5173]
2025-10-10T14:32:39.103200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600968909160994:5173]
2025-10-10T14:32:39.103203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600968909160994:5173]
2025-10-10T14:32:39.103240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:39.103250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.103249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:39.103252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:39.103255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:39.103258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:39.103266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:39.103364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:39.164662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600969691372344:5983]
2025-10-10T14:32:39.164872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 666, pipe: [1:7559600969691372344:5983]
2025-10-10T14:32:39.209120Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:39.209570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.209589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.209631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372344:5983], now have 1 active actors on pipe
2025-10-10T14:32:39.209777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:39.209867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:39.209873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:39.209878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:39.209912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600969691372344:5983]
2025-10-10T14:32:39.209935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 667 reason: error at write: Disconnected sessionId: src_id|88985409-29059bc0-34779ec-2379d467_0
2025-10-10T14:32:39.210107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 667 sessionId: src_id|88985409-29059bc0-34779ec-2379d467_0 is DEAD
2025-10-10T14:32:39.210260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88985409-29059bc0-34779ec-2379d467_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:39.210271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88985409-29059bc0-34779ec-2379d467_0] Write session will restart in 0.008285s
2025-10-10T14:32:39.210296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88985409-29059bc0-34779ec-2379d467_0] Write session: Do CDS request
2025-10-10T14:32:39.210301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88985409-29059bc0-34779ec-2379d467_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:39.219813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88985409-29059bc0-34779ec-2379d467_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.219861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:39.219872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 668
2025-10-10T14:32:39.220005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.220040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:39.220049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:39.220052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:39.220429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 668 sessionId:  describe result for acl check
2025-10-10T14:32:39.220458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:39.220465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:39.220466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:39.220472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600969691372459:6369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:39.220814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600969691372459:6369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:39.222949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600969691372459:6369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:39.224633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:39.226674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:39.226754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600969691372459:6369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:39.226771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600969691372459:6369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:39.226774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600969691372459:6369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:39.226779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:39.226827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:39.226838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:39.226849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:39.226895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:39.226938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600968909161257:5176]
2025-10-10T14:32:39.227511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:39.227710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:39.227748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:39.228048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:39.228098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.228103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.228104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.228105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.228106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.228107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.228108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.228109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.228110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.228111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.228112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.228113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.228115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.228120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.228131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.228136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.228140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.228144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.228148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.228152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.228156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.228160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.228164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.228168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.228172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.228175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.228183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.228191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.228198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.228204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.228208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.228214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.228217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.228223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.228227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.228232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.228236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.228241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.228246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.228252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.228258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.228262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.228268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.228278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.228281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.228287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.228291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.228296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.228301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.228306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.228310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.228315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.228358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:39.230426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:39.230777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:39.230789Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:39.230791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:39.230794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:39.230799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 667 [2:7559600968909161257:5176]
2025-10-10T14:32:39.230810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:39.230823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:39.230831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.230834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.230836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.230851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:39.230858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:39.230867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:39.230926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.230932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.230934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.230936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:39.230993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:39.231000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.231011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.231024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.231046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:39.231070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372595:6369], now have 1 active actors on pipe
2025-10-10T14:32:39.231079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372345:2438], now have 1 active actors on pipe
2025-10-10T14:32:39.231086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600968909161252:5176]
2025-10-10T14:32:39.231092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600968909161252:5176]
2025-10-10T14:32:39.231094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600968909161252:5176]
2025-10-10T14:32:39.231108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:39.231099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 667
2025-10-10T14:32:39.231100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 667
2025-10-10T14:32:39.231124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:39.231124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:39.231127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:39.231128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:39.231145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:39.231148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:39.231176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.231184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.231202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600968909161252:5176]
2025-10-10T14:32:39.231214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:39.231228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:39.231240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:39.231247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.231254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.231256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:39.231265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.231275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:39.231302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.231425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.231434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.231449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.231546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 668 partition: 0 MaxSeqNo: 40 sessionId: src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0
2025-10-10T14:32:39.231825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88985409-29059bc0-34779ec-2379d467_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:39.234353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0] Write session: try to update token
2025-10-10T14:32:39.234369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:39.247085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId: src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:39.249293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:39.249310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:39.249312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:39.249314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:39.249321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600968909161252:5176]
2025-10-10T14:32:39.249324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600968909161252:5176]
2025-10-10T14:32:39.249327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600968909161252:5176]
2025-10-10T14:32:39.249387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:39.249389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:39.249393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.249395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:39.249395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:39.249399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:39.249484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:39.249514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:39.308672Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:32:39.310018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600969691372607:5983]
2025-10-10T14:32:39.310263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 667, pipe: [1:7559600969691372607:5983]
2025-10-10T14:32:39.354086Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:39.354602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.354616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.354655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372607:5983], now have 1 active actors on pipe
2025-10-10T14:32:39.354822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:39.354923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600969691372607:5983]
2025-10-10T14:32:39.354951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:39.354964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:39.355071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 668 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0
2025-10-10T14:32:39.355334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 668 sessionId: src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0 is DEAD
2025-10-10T14:32:39.355447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:39.355457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0] Write session will restart in 0.007687s
2025-10-10T14:32:39.355478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0] Write session: Do CDS request
2025-10-10T14:32:39.355483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:39.363822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.363855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:39.363866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 669
2025-10-10T14:32:39.364021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.364046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:39.364056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:39.364060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:39.364424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 669 sessionId:  describe result for acl check
2025-10-10T14:32:39.364456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:39.364461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:39.364462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:39.364466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600969691372662:6373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:39.364884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600969691372662:6373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:39.367091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600969691372662:6373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:39.369399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600969691372662:6373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:39.369409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600969691372662:6373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:39.369412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600969691372662:6373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:39.369417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:39.370325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:39.372381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:39.372530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:39.372540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:39.372548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:39.372582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:39.372612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600968909161506:5178]
2025-10-10T14:32:39.372971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:39.373210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:39.373242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:39.373448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:39.373484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.373491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.373491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.373492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.373493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.373493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.373494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.373495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.373495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.373496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.373497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.373498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.373499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.373504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.373516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.373519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.373523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.373526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.373530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.373533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.373536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.373540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.373544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.373547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.373551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.373554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.373561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.373567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.373572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.373575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.373579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.373582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.373584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.373587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.373590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.373593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.373597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.373604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.373606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.373609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.373612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.373615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.373617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.373620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.373623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.373626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.373628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.373634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.373637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.373640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.373646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.373649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.373669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:39.375697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:39.376113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:39.376122Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:39.376123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:39.376126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:39.376131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 668 [2:7559600968909161506:5178]
2025-10-10T14:32:39.376138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:39.376149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:39.376153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.376155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.376157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.376168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:39.376176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:39.376186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:39.376222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.376227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.376228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.376230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:39.376287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:39.376294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.376304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.376318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.376338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:39.376361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372608:2438], now have 1 active actors on pipe
2025-10-10T14:32:39.376368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372844:6373], now have 1 active actors on pipe
2025-10-10T14:32:39.376376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600968909161501:5178]
2025-10-10T14:32:39.376382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600968909161501:5178]
2025-10-10T14:32:39.376384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600968909161501:5178]
2025-10-10T14:32:39.376371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 668
2025-10-10T14:32:39.376384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 668
2025-10-10T14:32:39.376395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:39.376409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:39.376418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:39.376422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:39.376424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:39.376429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:39.376431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:39.376438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600968909161501:5178]
2025-10-10T14:32:39.376440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:39.376448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:39.376456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.376459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.376488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:39.376497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.376499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.376504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:39.376511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.376518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:39.376534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.376667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.376673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.376688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.376763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 669 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0
2025-10-10T14:32:39.377121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead63dc0-5877840e-9ae4d407-25a2824c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:39.379629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0] Write session: try to update token
2025-10-10T14:32:39.379647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:39.392179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId: src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:39.394467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:39.394485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:39.394488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:39.394491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:39.394501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600968909161501:5178]
2025-10-10T14:32:39.394506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600968909161501:5178]
2025-10-10T14:32:39.394508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600968909161501:5178]
2025-10-10T14:32:39.394541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:39.394546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:39.394550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:39.394552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.394553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:39.394553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:39.394678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:39.394881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:39.454918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600969691372858:5983]
2025-10-10T14:32:39.455191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 668, pipe: [1:7559600969691372858:5983]
2025-10-10T14:32:39.499132Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:39.499545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.499564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.499604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372858:5983], now have 1 active actors on pipe
2025-10-10T14:32:39.499779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:39.499814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:39.499820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:39.499824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600969691372858:5983]
2025-10-10T14:32:39.499824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:39.499894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 669 reason: error at write: Disconnected sessionId: src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0
2025-10-10T14:32:39.500129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 669 sessionId: src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0 is DEAD
2025-10-10T14:32:39.500260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:39.500270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0] Write session will restart in 0.006986s
2025-10-10T14:32:39.500289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0] Write session: Do CDS request
2025-10-10T14:32:39.500295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:39.508927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.509004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:39.509019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 670
2025-10-10T14:32:39.509135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.509172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:39.509183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:39.509189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:39.509692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 670 sessionId:  describe result for acl check
2025-10-10T14:32:39.509755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:39.509766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:39.509768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:39.509775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600969691372936:6377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:39.510520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600969691372936:6377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:39.512894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600969691372936:6377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:39.514782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:39.517402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:39.517503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600969691372936:6377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:39.517515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600969691372936:6377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:39.517518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600969691372936:6377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:39.517524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:39.517621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:39.517634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:39.517646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:39.517700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:39.517743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600968909161754:5180]
2025-10-10T14:32:39.518359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:39.518631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:39.518670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:39.518888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:39.518950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.518957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.518958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.518959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.518961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.518962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.518963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.518963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.518964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.518965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.518966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.518966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.518967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.518971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.518980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.518983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.518985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.518987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.518989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.518991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.518993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.518996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.518998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.519000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.519002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.519005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.519012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.519018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.519022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.519026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.519028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.519032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.519034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.519038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.519040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.519043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.519046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.519051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.519058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.519062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.519066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.519069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.519072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.519079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.519081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.519084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.519087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.519090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.519093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.519096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.519099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.519102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.519126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:39.521356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:39.521779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:39.521790Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:39.521791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:39.521794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:39.521799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 669 [2:7559600968909161754:5180]
2025-10-10T14:32:39.521809Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:39.521830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:39.521831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.521834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.521836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.521853Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:39.521863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:39.521876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:39.521941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.521948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.521950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.521952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:39.522028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:39.522038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.522046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.522052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.522062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:39.522081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691372860:2438], now have 1 active actors on pipe
2025-10-10T14:32:39.522089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373099:6377], now have 1 active actors on pipe
2025-10-10T14:32:39.522097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600968909161749:5180]
2025-10-10T14:32:39.522099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600968909161749:5180]
2025-10-10T14:32:39.522102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600968909161749:5180]
2025-10-10T14:32:39.522116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:39.522125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:39.522131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:39.522134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:39.522135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:39.522131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 669
2025-10-10T14:32:39.522148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:39.522161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 669
2025-10-10T14:32:39.522152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:39.522173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600968909161749:5180]
2025-10-10T14:32:39.522176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:39.522178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:39.522203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.522213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.522242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:39.522253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.522258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.522260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:39.522268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.522283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:39.522308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.522459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.522468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.522483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.522564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 670 partition: 0 MaxSeqNo: 40 sessionId: src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0
2025-10-10T14:32:39.522884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7750a64-9fddbd0f-f1b87c5-43523e69_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:39.525735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0] Write session: try to update token
2025-10-10T14:32:39.525761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:39.540571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId: src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:39.541047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:39.541067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:39.541070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:39.541072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:39.541082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600968909161749:5180]
2025-10-10T14:32:39.541086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600968909161749:5180]
2025-10-10T14:32:39.541090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600968909161749:5180]
2025-10-10T14:32:39.541145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:39.541153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:39.541158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.541161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:39.541164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:39.541170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:39.541292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:39.543380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:39.599825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600969691373119:5983]
2025-10-10T14:32:39.600173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 669, pipe: [1:7559600969691373119:5983]
2025-10-10T14:32:39.650903Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:39.651677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.651694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.651753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373119:5983], now have 1 active actors on pipe
2025-10-10T14:32:39.651961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:39.651984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:39.652009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600969691373119:5983]
2025-10-10T14:32:39.652028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:39.652094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 670 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0
2025-10-10T14:32:39.652278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 670 sessionId: src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0 is DEAD
2025-10-10T14:32:39.652449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:39.652459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0] Write session will restart in 0.005640s
2025-10-10T14:32:39.652486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0] Write session: Do CDS request
2025-10-10T14:32:39.652491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:39.658764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.658844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:39.658856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 671
2025-10-10T14:32:39.658972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.659008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:39.659018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:39.659023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:39.659420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 671 sessionId:  describe result for acl check
2025-10-10T14:32:39.659457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:39.659464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:39.659466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:39.659472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600969691373144:6383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:39.660021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600969691373144:6383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:39.663106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600969691373144:6383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:39.665559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600969691373144:6383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:39.665578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600969691373144:6383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:39.665581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600969691373144:6383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:39.665587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:39.667752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:39.669870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:39.670026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:39.670036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:39.670045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:39.670089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:39.670119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600968909162007:5183]
2025-10-10T14:32:39.670512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:39.670756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:39.670786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:39.670999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:39.671036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.671042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.671043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.671043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.671044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.671045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.671045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.671046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.671046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.671047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.671048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.671048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.671049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.671052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.671061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.671063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.671066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.671068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.671070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.671073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.671075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.671077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.671080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.671082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.671084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.671086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.671091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.671097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.671102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.671105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.671108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.671111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.671114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.671117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.671120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.671123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.671125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.671128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.671131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.671135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.671137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.671140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.671143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.671146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.671148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.671151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.671154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.671157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.671159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.671162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.671165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.671167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.671189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:39.673272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:39.673761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:39.673774Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:39.673775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:39.673778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:39.673782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 670 [2:7559600968909162007:5183]
2025-10-10T14:32:39.673790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:39.673803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:39.673812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.673815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.673817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.673833Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:39.673845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:39.673859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:39.673901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.673904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.673905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.673907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:39.673954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:39.673959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.673967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.673974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.673984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:39.674002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373332:6383], now have 1 active actors on pipe
2025-10-10T14:32:39.674007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373124:2438], now have 1 active actors on pipe
2025-10-10T14:32:39.674013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600968909162001:5183]
2025-10-10T14:32:39.674015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600968909162001:5183]
2025-10-10T14:32:39.674016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600968909162001:5183]
2025-10-10T14:32:39.674026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:39.674038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:39.674044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:39.674048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:39.674049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:39.674051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:39.674053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:39.674056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 670
2025-10-10T14:32:39.674062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 670
2025-10-10T14:32:39.674150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600968909162001:5183]
2025-10-10T14:32:39.674159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:39.674169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:39.674186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.674195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.674233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:39.674246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.674249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.674250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:39.674258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.674267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:39.674282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.674398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.674403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.674414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.674495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 671 partition: 0 MaxSeqNo: 40 sessionId: src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0
2025-10-10T14:32:39.674872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eebffc6-f48bb0d8-7bd4e0ed-cf51a50f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:39.677393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0] Write session: try to update token
2025-10-10T14:32:39.677408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:39.689929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId: src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:39.692431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:39.693122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.693144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.693170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:39.693173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:39.693176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:39.693178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:39.693188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600968909162001:5183]
2025-10-10T14:32:39.693192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600968909162001:5183]
2025-10-10T14:32:39.693195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600968909162001:5183]
2025-10-10T14:32:39.693231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:39.693241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:39.693244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:39.693251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:39.693258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.693260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:39.693408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:39.752385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600969691373376:5983]
2025-10-10T14:32:39.752730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 670, pipe: [1:7559600969691373376:5983]
2025-10-10T14:32:39.801354Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:39.801559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:39.801614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373376:5983], now have 1 active actors on pipe
2025-10-10T14:32:39.801696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:39.801795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:39.801846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600969691373376:5983]
2025-10-10T14:32:39.810680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:39.810695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:39.810717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 671 reason: error at write: Disconnected sessionId: src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0
2025-10-10T14:32:39.810895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 671 sessionId: src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0 is DEAD
2025-10-10T14:32:39.811058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:39.811072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0] Write session will restart in 0.005590s
2025-10-10T14:32:39.811097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0] Write session: Do CDS request
2025-10-10T14:32:39.811103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:39.817860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.817974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:39.817989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 672
2025-10-10T14:32:39.818125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.818164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:39.818175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:39.818179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:39.818527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 672 sessionId:  describe result for acl check
2025-10-10T14:32:39.818558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:39.818561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:39.818562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:39.818566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600969691373588:6387] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:39.819135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600969691373588:6387] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:39.819686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:39.821417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600969691373588:6387] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:39.821752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:39.821930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:39.821939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:39.821950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:39.821996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:39.822037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600968909162256:5185]
2025-10-10T14:32:39.823089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:39.823353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:39.823395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:39.823484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600969691373588:6387] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:39.823495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600969691373588:6387] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:39.823497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600969691373588:6387] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:39.823503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:39.823705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:39.823754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.823760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.823761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.823762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.823763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.823764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.823766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.823767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.823768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.823769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.823770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.823771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.823772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.823777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.823789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.823794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.823798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.823802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.823806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.823810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.823814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.823817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.823823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.823828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.823837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.823841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.823847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.823860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.823866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.823876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.823885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.823890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.823895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.823900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.823904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.823910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.823918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.823924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.823931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.823936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.823944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.823950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.823959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.823964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.823969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.823974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.823978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.823983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.823986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.823992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.824000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.824005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.824050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:39.826148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:39.826657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:39.826666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:39.826667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:39.826670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:39.826674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 671 [2:7559600968909162256:5185]
2025-10-10T14:32:39.826682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:39.826692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:39.826697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.826700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.826701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.826715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:39.826728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:39.826739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:39.826778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.826783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.826784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.826786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:39.826841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:39.826847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.826858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.826869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.826891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:39.826924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373621:6387], now have 1 active actors on pipe
2025-10-10T14:32:39.826933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373378:2438], now have 1 active actors on pipe
2025-10-10T14:32:39.826938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600968909162251:5185]
2025-10-10T14:32:39.826939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600968909162251:5185]
2025-10-10T14:32:39.826941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600968909162251:5185]
2025-10-10T14:32:39.826950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:39.826960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:39.826970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:39.826972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:39.826976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:39.826964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 671
2025-10-10T14:32:39.826980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:39.826968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 671
2025-10-10T14:32:39.826981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:39.826989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600968909162251:5185]
2025-10-10T14:32:39.826991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:39.826994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:39.827012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.827015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.827039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:39.827051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.827057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.827059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:39.827066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.827077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:39.827092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.827248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.827256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.827272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.827349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 672 partition: 0 MaxSeqNo: 40 sessionId: src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0
2025-10-10T14:32:39.827650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11cc9b14-ff0a5b8b-91f9a74e-1e4b8c2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:39.830144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0] Write session: try to update token
2025-10-10T14:32:39.830160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:39.842889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId: src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:39.845081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:39.845101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:39.845104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:39.845106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:39.845118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600968909162251:5185]
2025-10-10T14:32:39.845122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600968909162251:5185]
2025-10-10T14:32:39.845126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600968909162251:5185]
2025-10-10T14:32:39.845179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:39.845184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:39.845189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.845191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:39.845191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:39.845195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:39.845326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:39.845629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:39.901894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600969691373631:5983]
2025-10-10T14:32:39.902139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 671, pipe: [1:7559600969691373631:5983]
2025-10-10T14:32:39.948917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:39.949137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.949148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.949184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373631:5983], now have 1 active actors on pipe
2025-10-10T14:32:39.949356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:39.949404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:39.949415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:39.949418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600969691373631:5983]
2025-10-10T14:32:39.949433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:39.949462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 672 reason: error at write: Disconnected sessionId: src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0
2025-10-10T14:32:39.949649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 672 sessionId: src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0 is DEAD
2025-10-10T14:32:39.949834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:39.949846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0] Write session will restart in 0.007903s
2025-10-10T14:32:39.949870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0] Write session: Do CDS request
2025-10-10T14:32:39.949877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:39.958817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.958882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:39.958893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 673
2025-10-10T14:32:39.959012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:39.959039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:39.959046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:39.959049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:39.959452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 673 sessionId:  describe result for acl check
2025-10-10T14:32:39.959481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:39.959483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:39.959485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:39.959491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600969691373736:6400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:39.959899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600969691373736:6400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:39.962326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600969691373736:6400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:39.964759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600969691373736:6400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:39.964770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600969691373736:6400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:39.964772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600969691373736:6400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:39.964777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:39.967633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:39.968031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:39.968177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:39.968186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:39.968194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:39.968228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:39.968266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600968909162548:5200]
2025-10-10T14:32:39.968685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:39.968946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:39.969015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:39.969265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:39.969304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.969308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.969309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.969310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.969310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.969311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.969312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.969313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.969314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.969314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.969315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.969316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.969316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.969321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.969342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.969345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.969347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.969349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.969352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.969354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.969356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.969359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.969361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.969363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.969365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.969367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.969374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.969380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:39.969385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.969388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:39.969391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.969395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:39.969398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.969401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:39.969403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.969406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:39.969409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.969413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:39.969415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.969419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:39.969421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.969425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:39.969428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.969431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:39.969434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.969437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:39.969440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.969443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.969445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.969454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.969457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.969460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.969489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:39.971599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:39.972065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:39.972074Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:39.972075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:39.972078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:39.972083Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 672 [2:7559600968909162548:5200]
2025-10-10T14:32:39.972090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:39.972103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:39.972109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.972111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.972112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.972124Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:39.972133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:39.972140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:39.972185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.972190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.972191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.972193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:39.972243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:39.972249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.972256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:39.972262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:39.972272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:39.972288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373901:6400], now have 1 active actors on pipe
2025-10-10T14:32:39.972294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600968909162543:5200]
2025-10-10T14:32:39.972295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600968909162543:5200]
2025-10-10T14:32:39.972297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600968909162543:5200]
2025-10-10T14:32:39.972308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:39.972316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600969691373660:2438], now have 1 active actors on pipe
2025-10-10T14:32:39.972322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:39.972327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:39.972332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:39.972334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:39.972335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:39.972338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:39.972350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600968909162543:5200]
2025-10-10T14:32:39.972356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:39.972358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:39.972371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 672
2025-10-10T14:32:39.972374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 672
2025-10-10T14:32:39.972500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.972508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.972535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a009afab-b3cf5860-6347955b-da4e0df4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:39.972545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:39.972547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:39.972549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:39.972557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:39.972565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:39.972580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.972725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:39.972731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:39.972743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:39.972818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 673 partition: 0 MaxSeqNo: 40 sessionId: src_id|a009afab-b3cf5860-6347955b-da4e0df4_0
2025-10-10T14:32:39.973088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb66fd4-fd88f882-afd85ccd-4fe5af4a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a009afab-b3cf5860-6347955b-da4e0df4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:39.975580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a009afab-b3cf5860-6347955b-da4e0df4_0] Write session: try to update token
2025-10-10T14:32:39.975595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a009afab-b3cf5860-6347955b-da4e0df4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:39.988291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId: src_id|a009afab-b3cf5860-6347955b-da4e0df4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:39.990188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:39.990205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:39.990207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:39.990209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:39.990216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600968909162543:5200]
2025-10-10T14:32:39.990220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600968909162543:5200]
2025-10-10T14:32:39.990223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600968909162543:5200]
2025-10-10T14:32:39.990262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:39.990263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:39.990268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:39.990270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:39.990271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:39.990273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:39.990402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:39.990749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:40.049354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600973986341212:5983]
2025-10-10T14:32:40.049605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 672, pipe: [1:7559600973986341212:5983]
2025-10-10T14:32:40.093234Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:40.093471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.093485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.093525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341212:5983], now have 1 active actors on pipe
2025-10-10T14:32:40.093699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:40.093763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600973986341212:5983]
2025-10-10T14:32:40.093787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:40.093790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:40.093855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 673 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a009afab-b3cf5860-6347955b-da4e0df4_0
2025-10-10T14:32:40.094028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 673 sessionId: src_id|a009afab-b3cf5860-6347955b-da4e0df4_0 is DEAD
2025-10-10T14:32:40.094167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009afab-b3cf5860-6347955b-da4e0df4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:40.094183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009afab-b3cf5860-6347955b-da4e0df4_0] Write session will restart in 0.008343s
2025-10-10T14:32:40.094202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009afab-b3cf5860-6347955b-da4e0df4_0] Write session: Do CDS request
2025-10-10T14:32:40.094208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009afab-b3cf5860-6347955b-da4e0df4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:40.103812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a009afab-b3cf5860-6347955b-da4e0df4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.103909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:40.103920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 674
2025-10-10T14:32:40.104041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.104070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:40.104077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:40.104080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:40.104498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 674 sessionId:  describe result for acl check
2025-10-10T14:32:40.104530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:40.104535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:40.104536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:40.104541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600973986341287:6404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:40.105042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600973986341287:6404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:40.107332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600973986341287:6404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:40.109765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600973986341287:6404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:40.109777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600973986341287:6404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:40.109779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600973986341287:6404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:40.109784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:40.110113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:40.112267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:40.112484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:40.112493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:40.112502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:40.112555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:40.112587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600973204130098:5202]
2025-10-10T14:32:40.112960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:40.113167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:40.113194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:40.113408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:40.113444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.113448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.113449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.113449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.113450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.113451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.113451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.113452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.113453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.113453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.113454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.113454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.113455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.113459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.113467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.113469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.113472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.113474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.113476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.113478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.113480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.113482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.113485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.113487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.113489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.113491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.113497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.113503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.113507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.113510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.113513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.113516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.113518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.113521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.113524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.113527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.113533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.113537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.113539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.113542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.113545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.113548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.113552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.113555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.113558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.113560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.113564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.113567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.113569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.113573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.113575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.113578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.113598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:40.115511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:40.115877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:40.115885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:40.115886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:40.115888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:40.115892Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 673 [2:7559600973204130098:5202]
2025-10-10T14:32:40.115899Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:40.115910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:40.115913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.115915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.115916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.115928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:40.115936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:40.115943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:40.115982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.115986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.115987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.115989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:40.116033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:40.116038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.116044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.116051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.116063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:40.116079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341456:6404], now have 1 active actors on pipe
2025-10-10T14:32:40.116086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341213:2438], now have 1 active actors on pipe
2025-10-10T14:32:40.116093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600973204130092:5202]
2025-10-10T14:32:40.116095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600973204130092:5202]
2025-10-10T14:32:40.116097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600973204130092:5202]
2025-10-10T14:32:40.116109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:40.116121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:40.116123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:40.116124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:40.116136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:40.116155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:40.116162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:40.116136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 673
2025-10-10T14:32:40.116140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 673
2025-10-10T14:32:40.116188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.116194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.116208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600973204130092:5202]
2025-10-10T14:32:40.116217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:40.116226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:40.116238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:40.116244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.116248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.116250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:40.116257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.116265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:40.116281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.116384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.116392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.116406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.116470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 674 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0
2025-10-10T14:32:40.116708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009afab-b3cf5860-6347955b-da4e0df4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:40.119051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0] Write session: try to update token
2025-10-10T14:32:40.119066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:40.131172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId: src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:40.133584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:40.133678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:40.133694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:40.133696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:40.133697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:40.133704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600973204130092:5202]
2025-10-10T14:32:40.133708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600973204130092:5202]
2025-10-10T14:32:40.133711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600973204130092:5202]
2025-10-10T14:32:40.133744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:40.133748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:40.133751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:40.133754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.133761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.133779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:40.133785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.133787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:40.133899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:40.193721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600973986341469:5983]
2025-10-10T14:32:40.194033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 673, pipe: [1:7559600973986341469:5983]
2025-10-10T14:32:40.236263Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:40.236650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341469:5983], now have 1 active actors on pipe
2025-10-10T14:32:40.236822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:40.236875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600973986341469:5983]
2025-10-10T14:32:40.236895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:40.236899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:40.236902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:40.236955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 674 reason: error at write: Disconnected sessionId: src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0
2025-10-10T14:32:40.237144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 674 sessionId: src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0 is DEAD
2025-10-10T14:32:40.237322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:40.237351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0] Write session will restart in 0.007075s
2025-10-10T14:32:40.237375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0] Write session: Do CDS request
2025-10-10T14:32:40.237382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:40.245748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.245860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:40.245871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 675
2025-10-10T14:32:40.245955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.245982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:40.245986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:40.245989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:40.246340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 675 sessionId:  describe result for acl check
2025-10-10T14:32:40.246371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:40.246374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:40.246376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:40.246380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600973986341542:6409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:40.246795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600973986341542:6409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:40.248908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600973986341542:6409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:40.251049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600973986341542:6409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:40.251059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600973986341542:6409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:40.251062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600973986341542:6409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:40.251068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:40.252624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:40.254969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:40.255136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:40.255145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:40.255154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:40.255190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:40.255223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600973204130363:5205]
2025-10-10T14:32:40.255603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:40.255868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:40.255895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:40.256252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:40.256295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.256300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.256301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.256302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.256302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.256303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.256304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.256304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.256305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.256306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.256307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.256307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.256308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.256311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.256320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.256322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.256324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.256327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.256329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.256331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.256334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.256336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.256338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.256341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.256343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.256345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.256351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.256356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.256361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.256364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.256367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.256371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.256373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.256377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.256380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.256383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.256385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.256390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.256393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.256396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.256399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.256402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.256404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.256407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.256410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.256413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.256415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.256418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.256421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.256424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.256426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.256429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.256452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:40.258547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:40.258967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:40.258976Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:40.258977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:40.258980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:40.258984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 674 [2:7559600973204130363:5205]
2025-10-10T14:32:40.258992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:40.259004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:40.259006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.259008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.259010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.259021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:40.259027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:40.259033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:40.259070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.259076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.259077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.259079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:40.259127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:40.259132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.259139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.259145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.259155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:40.259170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600973204130358:5205]
2025-10-10T14:32:40.259175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600973204130358:5205]
2025-10-10T14:32:40.259177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600973204130358:5205]
2025-10-10T14:32:40.259184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:40.259193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:40.259194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:40.259202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:40.259204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:40.259205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:40.259207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:40.259215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341724:6409], now have 1 active actors on pipe
2025-10-10T14:32:40.259217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341482:2438], now have 1 active actors on pipe
2025-10-10T14:32:40.259230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600973204130358:5205]
2025-10-10T14:32:40.259240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:40.259252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:40.259263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 674
2025-10-10T14:32:40.259263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 674
2025-10-10T14:32:40.259333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.259340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.259363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:40.259372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.259375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.259377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:40.259383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.259396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:40.259410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.259933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.259947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.259965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.260065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 675 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0
2025-10-10T14:32:40.260434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1e236d-5c82e522-c5a4a7a3-f1c9eef2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:40.262957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0] Write session: try to update token
2025-10-10T14:32:40.262974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:40.276112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId: src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:40.277346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:40.277362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:40.277364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:40.277366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:40.277373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600973204130358:5205]
2025-10-10T14:32:40.277376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600973204130358:5205]
2025-10-10T14:32:40.277379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600973204130358:5205]
2025-10-10T14:32:40.277418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:40.277422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:40.277424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.277425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:40.277428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:40.277432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:40.277547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:40.278731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:40.337080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600973986341739:5983]
2025-10-10T14:32:40.337357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 674, pipe: [1:7559600973986341739:5983]
2025-10-10T14:32:40.380315Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:40.380616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.380634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.380683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341739:5983], now have 1 active actors on pipe
2025-10-10T14:32:40.380866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:40.380919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600973986341739:5983]
2025-10-10T14:32:40.380954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:40.380955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:40.381028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 675 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0
2025-10-10T14:32:40.381234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 675 sessionId: src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0 is DEAD
2025-10-10T14:32:40.381357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:40.381367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0] Write session will restart in 0.006328s
2025-10-10T14:32:40.381385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0] Write session: Do CDS request
2025-10-10T14:32:40.381390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:40.388824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.388897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:40.388910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 676
2025-10-10T14:32:40.389035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.389063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:40.389070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:40.389073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:40.389406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 676 sessionId:  describe result for acl check
2025-10-10T14:32:40.389429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:40.389434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:40.389435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:40.389439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600973986341772:6413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:40.389887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600973986341772:6413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:40.391925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600973986341772:6413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:40.394642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600973986341772:6413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:40.394655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600973986341772:6413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:40.394658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600973986341772:6413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:40.394674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:40.396607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:40.399136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:40.399450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:40.399460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:40.399471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:40.399520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:40.399553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600973204130618:5207]
2025-10-10T14:32:40.399945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:40.400211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:40.400255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:40.400496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:40.400533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.400538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.400539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.400539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.400540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.400541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.400541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.400542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.400543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.400543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.400544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.400545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.400545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.400550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.400558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.400561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.400563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.400565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.400568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.400570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.400580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.400582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.400586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.400588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.400590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.400592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.400597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.400604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.400608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.400612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.400614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.400617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.400620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.400623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.400626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.400629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.400631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.400634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.400637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.400640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.400642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.400646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.400649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.400652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.400654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.400657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.400660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.400663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.400665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.400668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.400671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.400674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.400697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:40.402727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:40.403196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:40.403206Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:40.403208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:40.403211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:40.403215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 675 [2:7559600973204130618:5207]
2025-10-10T14:32:40.403222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:40.403233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:40.403235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.403237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.403238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.403250Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:40.403254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:40.403260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:40.403296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.403301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.403303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.403304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:40.403362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:40.403368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.403378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.403389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.403410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:40.403439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341953:6413], now have 1 active actors on pipe
2025-10-10T14:32:40.403446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341740:2438], now have 1 active actors on pipe
2025-10-10T14:32:40.403451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600973204130613:5207]
2025-10-10T14:32:40.403453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600973204130613:5207]
2025-10-10T14:32:40.403454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600973204130613:5207]
2025-10-10T14:32:40.403463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:40.403474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:40.403484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:40.403487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:40.403489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:40.403493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:40.403497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:40.403483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 675
2025-10-10T14:32:40.403485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 675
2025-10-10T14:32:40.403533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600973204130613:5207]
2025-10-10T14:32:40.403540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:40.403542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:40.403555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.403561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.403602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d68b6846-a5a90121-6defdc36-5f317b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:40.403612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.403614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.403616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:40.403624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.403632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:40.403644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.403799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.403806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.403820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.403907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 676 partition: 0 MaxSeqNo: 40 sessionId: src_id|d68b6846-a5a90121-6defdc36-5f317b4_0
2025-10-10T14:32:40.404212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e02f867-6b239ac2-22d64646-b04b5fcb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d68b6846-a5a90121-6defdc36-5f317b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:40.406670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b6846-a5a90121-6defdc36-5f317b4_0] Write session: try to update token
2025-10-10T14:32:40.406684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b6846-a5a90121-6defdc36-5f317b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:40.419557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId: src_id|d68b6846-a5a90121-6defdc36-5f317b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:40.421479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:40.421492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:40.421494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:40.421495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:40.421502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600973204130613:5207]
2025-10-10T14:32:40.421505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600973204130613:5207]
2025-10-10T14:32:40.421508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600973204130613:5207]
2025-10-10T14:32:40.421546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:40.421552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.421553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:40.421569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:40.421576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:40.421582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:40.421671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:40.421807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:40.480953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600973986341998:5983]
2025-10-10T14:32:40.481252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 675, pipe: [1:7559600973986341998:5983]
2025-10-10T14:32:40.523766Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:40.523998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.524011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.524049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341998:5983], now have 1 active actors on pipe
2025-10-10T14:32:40.524328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600973986341998:5983]
2025-10-10T14:32:40.524332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:40.524339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:40.524366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:40.524406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 676 reason: error at write: Disconnected sessionId: src_id|d68b6846-a5a90121-6defdc36-5f317b4_0
2025-10-10T14:32:40.524571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:40.524590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 676 sessionId: src_id|d68b6846-a5a90121-6defdc36-5f317b4_0 is DEAD
2025-10-10T14:32:40.524726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b6846-a5a90121-6defdc36-5f317b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:40.524746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b6846-a5a90121-6defdc36-5f317b4_0] Write session will restart in 0.005467s
2025-10-10T14:32:40.524765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b6846-a5a90121-6defdc36-5f317b4_0] Write session: Do CDS request
2025-10-10T14:32:40.524770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b6846-a5a90121-6defdc36-5f317b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:40.531798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b6846-a5a90121-6defdc36-5f317b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.531869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:40.531881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 677
2025-10-10T14:32:40.531993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.532019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:40.532027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:40.532030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:40.532382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 677 sessionId:  describe result for acl check
2025-10-10T14:32:40.532405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:40.532410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:40.532411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:40.532415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600973986342022:6417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:40.532849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600973986342022:6417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:40.534795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600973986342022:6417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:40.537508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600973986342022:6417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:40.537520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600973986342022:6417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:40.537530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600973986342022:6417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:40.537536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:40.540689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:40.542774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:40.542936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:40.542946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:40.542955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:40.542991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:40.543090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600973204130874:5209]
2025-10-10T14:32:40.543468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:40.543751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:40.543780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:40.543984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:40.544018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.544023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.544024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.544024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.544025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.544026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.544026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.544027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.544027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.544028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.544029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.544030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.544030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.544034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.544043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.544045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.544048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.544050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.544053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.544055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.544057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.544059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.544062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.544064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.544066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.544068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.544074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.544080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.544085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.544088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.544091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.544094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.544096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.544100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.544102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.544105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.544108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.544111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.544115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.544118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.544120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.544123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.544127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.544130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.544133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.544136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.544138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.544141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.544143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.544146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.544149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.544152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.544173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:40.546279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:40.546691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:40.546701Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:40.546702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:40.546705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:40.546710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 676 [2:7559600973204130874:5209]
2025-10-10T14:32:40.546718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:40.546730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:40.546733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.546735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.546736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.546744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:40.546749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:40.546757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:40.546794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.546800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.546801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.546803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:40.546850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:40.546856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.546862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.546869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.546878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:40.546897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600973204130869:5209]
2025-10-10T14:32:40.546903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600973204130869:5209]
2025-10-10T14:32:40.546905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600973204130869:5209]
2025-10-10T14:32:40.546927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:40.546931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:40.546934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:40.546936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:40.546948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986341999:2438], now have 1 active actors on pipe
2025-10-10T14:32:40.546952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342164:6417], now have 1 active actors on pipe
2025-10-10T14:32:40.546957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:40.546973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:40.546981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:40.547000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600973204130869:5209]
2025-10-10T14:32:40.547011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:40.546994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 676
2025-10-10T14:32:40.547007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 676
2025-10-10T14:32:40.547029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:40.547103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.547114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.547144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:40.547156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.547159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.547161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:40.547172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.547186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:40.547203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.547383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.547389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.547401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.547485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 677 partition: 0 MaxSeqNo: 40 sessionId: src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0
2025-10-10T14:32:40.547818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68b6846-a5a90121-6defdc36-5f317b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:40.550280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0] Write session: try to update token
2025-10-10T14:32:40.550295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:40.563334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId: src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:40.565233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:40.565252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:40.565255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:40.565257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:40.565266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600973204130869:5209]
2025-10-10T14:32:40.565271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600973204130869:5209]
2025-10-10T14:32:40.565274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600973204130869:5209]
2025-10-10T14:32:40.565309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:40.565312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:40.565315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:40.565318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:40.565319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.565320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:40.565546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:40.565936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:40.624321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600973986342268:5983]
2025-10-10T14:32:40.624540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 676, pipe: [1:7559600973986342268:5983]
2025-10-10T14:32:40.677414Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:40.678036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.678055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.678098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342268:5983], now have 1 active actors on pipe
2025-10-10T14:32:40.678270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:40.678355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:40.678381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600973986342268:5983]
2025-10-10T14:32:40.678416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:40.678491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 677 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0
2025-10-10T14:32:40.678681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 677 sessionId: src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0 is DEAD
2025-10-10T14:32:40.678859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:40.678869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0] Write session will restart in 0.007632s
2025-10-10T14:32:40.678887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0] Write session: Do CDS request
2025-10-10T14:32:40.678905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:40.687824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.687867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:40.687879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 678
2025-10-10T14:32:40.688023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.688062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:40.688070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:40.688073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:40.688483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 678 sessionId:  describe result for acl check
2025-10-10T14:32:40.688510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:40.688515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:40.688518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:40.688522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600973986342369:6423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:40.689008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600973986342369:6423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:40.691267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600973986342369:6423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:40.693110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:40.695205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:40.695280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600973986342369:6423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:40.695296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600973986342369:6423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:40.695299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600973986342369:6423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:40.695304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:40.695417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:40.695428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:40.695439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:40.695481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:40.695512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600973204131132:5212]
2025-10-10T14:32:40.695907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:40.696155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:40.696184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:40.696393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:40.696430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.696435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.696435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.696436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.696437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.696437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.696438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.696438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.696439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.696440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.696440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.696441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.696441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.696445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.696454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.696456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.696458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.696461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.696463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.696465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.696467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.696469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.696472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.696474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.696477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.696479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.696485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.696490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.696495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.696498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.696501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.696504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.696506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.696509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.696512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.696515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.696518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.696521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.696523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.696527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.696529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.696532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.696534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.696537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.696540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.696543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.696546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.696548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.696551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.696554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.696557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.696559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.696584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:40.698583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:40.698986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:40.698995Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:40.698996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:40.698999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:40.699003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 677 [2:7559600973204131132:5212]
2025-10-10T14:32:40.699010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:40.699020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:40.699022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.699024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.699025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.699037Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:40.699044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:40.699050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:40.699088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.699093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.699094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.699096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:40.699140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:40.699146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.699152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.699158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.699169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:40.699203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342521:6423], now have 1 active actors on pipe
2025-10-10T14:32:40.699210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342273:2438], now have 1 active actors on pipe
2025-10-10T14:32:40.699215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600973204131127:5212]
2025-10-10T14:32:40.699216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600973204131127:5212]
2025-10-10T14:32:40.699218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600973204131127:5212]
2025-10-10T14:32:40.699227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:40.699239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:40.699248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:40.699252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:40.699236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 677
2025-10-10T14:32:40.699253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:40.699239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 677
2025-10-10T14:32:40.699254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:40.699255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:40.699268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600973204131127:5212]
2025-10-10T14:32:40.699270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:40.699286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:40.699294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.699298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.699320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:40.699330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.699332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.699333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:40.699341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.699351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:40.699362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.699485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.699491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.699502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.699559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 678 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0
2025-10-10T14:32:40.699846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6912cb-fe08a942-926df773-8f4c96c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:40.703173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0] Write session: try to update token
2025-10-10T14:32:40.703188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:40.716013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId: src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:40.718341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:40.718704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.718726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.718749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:40.718752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:40.718755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:40.718757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:40.718766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600973204131127:5212]
2025-10-10T14:32:40.718770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600973204131127:5212]
2025-10-10T14:32:40.718776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600973204131127:5212]
2025-10-10T14:32:40.718815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:40.718829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:40.718832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:40.718837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:40.718843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.718846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:40.718976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:40.778435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600973986342532:5983]
2025-10-10T14:32:40.778616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 677, pipe: [1:7559600973986342532:5983]
2025-10-10T14:32:40.822426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:40.822738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:40.822816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342532:5983], now have 1 active actors on pipe
2025-10-10T14:32:40.822883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:40.823040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:40.823079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600973986342532:5983]
2025-10-10T14:32:40.831598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:40.831610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:40.831632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 678 reason: error at write: Disconnected sessionId: src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0
2025-10-10T14:32:40.831781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 678 sessionId: src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0 is DEAD
2025-10-10T14:32:40.831966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:40.831979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0] Write session will restart in 0.007431s
2025-10-10T14:32:40.832004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0] Write session: Do CDS request
2025-10-10T14:32:40.832010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:40.840955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.841092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:40.841114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 679
2025-10-10T14:32:40.841254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:40.841287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:40.841298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:40.841302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:40.841797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 679 sessionId:  describe result for acl check
2025-10-10T14:32:40.841836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:40.841838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:40.841842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:40.841848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600973986342646:6427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:40.842411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600973986342646:6427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:40.845341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600973986342646:6427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:40.846456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:40.848757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:40.848881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600973986342646:6427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:40.848896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600973986342646:6427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:40.848900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600973986342646:6427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:40.848909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:40.848959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:40.848970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:40.848983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:40.849032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:40.849086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600973204131390:5214]
2025-10-10T14:32:40.849676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:40.849915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:40.849956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:40.850284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:40.850336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.850342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.850343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.850345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.850346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.850347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.850349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.850350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.850351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.850352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.850354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.850355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.850356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.850361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.850377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.850381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.850385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.850388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.850392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.850396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.850400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.850404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.850408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.850412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.850416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.850421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.850428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.850439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:40.850445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.850453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:40.850458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.850463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:40.850467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.850472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:40.850479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.850484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:40.850489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.850494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:40.850500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.850505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:40.850511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.850516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:40.850523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.850528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:40.850532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.850543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:40.850547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.850552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.850557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.850561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.850568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.850573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.850615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:40.853453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:40.854843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:40.854858Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:40.854860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:40.854864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:40.854871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 678 [2:7559600973204131390:5214]
2025-10-10T14:32:40.854884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:40.854901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:40.854907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.854910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.854915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.854946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:40.854953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:40.854963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:40.855024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.855031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.855032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.855035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:40.855105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:40.855111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.855118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:40.855125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:40.855135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:40.855152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600973204131385:5214]
2025-10-10T14:32:40.855157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600973204131385:5214]
2025-10-10T14:32:40.855158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600973204131385:5214]
2025-10-10T14:32:40.855165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:40.855175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:40.855177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342783:6427], now have 1 active actors on pipe
2025-10-10T14:32:40.855181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342534:2438], now have 1 active actors on pipe
2025-10-10T14:32:40.855185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:40.855188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:40.855188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:40.855198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:40.855200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:40.855220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600973204131385:5214]
2025-10-10T14:32:40.855229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:40.855238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:40.855277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 678
2025-10-10T14:32:40.855279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 678
2025-10-10T14:32:40.855358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.855371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.855407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|812b3ea-4e81b505-54129ff3-227f75a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:40.855422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:40.855432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:40.855435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:40.855447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:40.855462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:40.855487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.855645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.855653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.855668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:40.855742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 679 partition: 0 MaxSeqNo: 40 sessionId: src_id|812b3ea-4e81b505-54129ff3-227f75a7_0
2025-10-10T14:32:40.856120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0a92e1-f8c0fdb0-5e5386e4-9bd8588d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|812b3ea-4e81b505-54129ff3-227f75a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:40.865968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:40.865984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:40.865991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600973204131385:5214]
2025-10-10T14:32:40.866035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:40.866036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:40.866189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:40.866311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:40.866357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|812b3ea-4e81b505-54129ff3-227f75a7_0] Write session: try to update token
2025-10-10T14:32:40.866375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|812b3ea-4e81b505-54129ff3-227f75a7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:40.866442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:40.866722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:40.866935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:40.866974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:40.883889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:40.883907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:40.883910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:40.883912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:40.883924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600973204131385:5214]
2025-10-10T14:32:40.883928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600973204131385:5214]
2025-10-10T14:32:40.883932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600973204131385:5214]
2025-10-10T14:32:40.883978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:40.883980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:40.883985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:40.883986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:40.883988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:40.883990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:40.884128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:40.885943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId: src_id|812b3ea-4e81b505-54129ff3-227f75a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:40.888311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:40.923328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600973986342794:5983]
2025-10-10T14:32:40.923611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 678, pipe: [1:7559600973986342794:5983]
2025-10-10T14:32:40.994275Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:40.994578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:40.994591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:40.994611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342794:5983], now have 1 active actors on pipe
2025-10-10T14:32:40.994790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:40.994854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:40.994859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:40.994900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600973986342794:5983]
2025-10-10T14:32:40.994953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 679 reason: status is not ok: tablet will be restarted right now sessionId: src_id|812b3ea-4e81b505-54129ff3-227f75a7_0
2025-10-10T14:32:40.995152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 679 sessionId: src_id|812b3ea-4e81b505-54129ff3-227f75a7_0 is DEAD
2025-10-10T14:32:40.995306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812b3ea-4e81b505-54129ff3-227f75a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:40.995317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812b3ea-4e81b505-54129ff3-227f75a7_0] Write session will restart in 0.009026s
2025-10-10T14:32:40.995354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812b3ea-4e81b505-54129ff3-227f75a7_0] Write session: Do CDS request
2025-10-10T14:32:40.995360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812b3ea-4e81b505-54129ff3-227f75a7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:41.005907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|812b3ea-4e81b505-54129ff3-227f75a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.005958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:41.005979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 680
2025-10-10T14:32:41.006154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.006183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:41.006190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:41.006194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:41.006720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 680 sessionId:  describe result for acl check
2025-10-10T14:32:41.006754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:41.006756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:41.006758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:41.006762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600978281310240:6440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:41.007244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600978281310240:6440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:41.009368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600978281310240:6440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:41.010796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:41.013285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:41.013388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600978281310240:6440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:41.013399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600978281310240:6440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:41.013402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600978281310240:6440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:41.013408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:41.013559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:41.013572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:41.013585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:41.013645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:41.013686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600977499098983:5229]
2025-10-10T14:32:41.014194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:41.014436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:41.014467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:41.014766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:41.014821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.014827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.014828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.014829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.014830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.014832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.014833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.014834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.014835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.014836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.014837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.014838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.014840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.014845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.014858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.014863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.014867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.014871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.014875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.014879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.014883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.014887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.014896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.014902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.014906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.014910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.014917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.014938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.014949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.014959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.014968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.014973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.014982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.014987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.014990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.014997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.015000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.015003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.015009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.015013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.015017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.015020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.015023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.015030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.015033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.015036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.015040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.015048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.015053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.015060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.015069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.015076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.015098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:41.017272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:41.017765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:41.017777Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:41.017779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:41.017782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:41.017787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 679 [2:7559600977499098983:5229]
2025-10-10T14:32:41.017798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:41.017818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:41.017824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.017828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.017830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.017848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:41.017861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:41.017872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:41.017925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.017931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.017933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.017936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:41.017996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:41.018003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.018015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.018027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.018050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:41.018073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310366:6440], now have 1 active actors on pipe
2025-10-10T14:32:41.018081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600973986342823:2438], now have 1 active actors on pipe
2025-10-10T14:32:41.018086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600977499098978:5229]
2025-10-10T14:32:41.018091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600977499098978:5229]
2025-10-10T14:32:41.018092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600977499098978:5229]
2025-10-10T14:32:41.018103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:41.018115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:41.018126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:41.018129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:41.018113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 679
2025-10-10T14:32:41.018132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:41.018139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 679
2025-10-10T14:32:41.018135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:41.018138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:41.018154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600977499098978:5229]
2025-10-10T14:32:41.018157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:41.018159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:41.018172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.018174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.018213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:41.018222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.018230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.018232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:41.018240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.018252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:41.018269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.018389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.018396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.018410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.018486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 680 partition: 0 MaxSeqNo: 40 sessionId: src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0
2025-10-10T14:32:41.018795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|812b3ea-4e81b505-54129ff3-227f75a7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:41.021457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0] Write session: try to update token
2025-10-10T14:32:41.021471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:41.036306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId: src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:41.037644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:41.037663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:41.037666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:41.037668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:41.037678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600977499098978:5229]
2025-10-10T14:32:41.037682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600977499098978:5229]
2025-10-10T14:32:41.037686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600977499098978:5229]
2025-10-10T14:32:41.037736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:41.037746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:41.037749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.037751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:41.037752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:41.037756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:41.037908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:41.038743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:41.094850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600978281310377:5983]
2025-10-10T14:32:41.095116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 679, pipe: [1:7559600978281310377:5983]
2025-10-10T14:32:41.141251Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:41.141618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.141630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.141666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310377:5983], now have 1 active actors on pipe
2025-10-10T14:32:41.141903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:41.141900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:41.141916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:41.141920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:41.141955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600978281310377:5983]
2025-10-10T14:32:41.141982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 680 reason: error at write: Disconnected sessionId: src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0
2025-10-10T14:32:41.142166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 680 sessionId: src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0 is DEAD
2025-10-10T14:32:41.142319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:41.142328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0] Write session will restart in 0.008320s
2025-10-10T14:32:41.142347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0] Write session: Do CDS request
2025-10-10T14:32:41.142352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:41.151784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.151904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:41.151916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 681
2025-10-10T14:32:41.152031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.152057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:41.152066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:41.152069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:41.152491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 681 sessionId:  describe result for acl check
2025-10-10T14:32:41.152523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:41.152528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:41.152529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:41.152534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600978281310472:6444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:41.153002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600978281310472:6444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:41.155513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600978281310472:6444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:41.157703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:41.157763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600978281310472:6444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:41.157774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600978281310472:6444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:41.157777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600978281310472:6444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:41.157782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:41.159926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:41.160104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:41.160115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:41.160126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:41.160175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:41.160217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600977499099244:5231]
2025-10-10T14:32:41.160813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:41.161080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:41.161120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:41.161442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:41.161492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.161498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.161499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.161500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.161501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.161502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.161504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.161505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.161506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.161507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.161508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.161510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.161510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.161516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.161530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.161534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.161538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.161542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.161550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.161553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.161562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.161566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.161570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.161578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.161582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.161590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.161598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.161613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.161624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.161634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.161643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.161648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.161657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.161666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.161671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.161680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.161688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.161693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.161702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.161712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.161720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.161729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.161737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.161744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.161753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.161762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.161771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.161781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.161788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.161794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.161802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.161807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.161845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:41.163988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:41.164507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:41.164522Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:41.164524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:41.164527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:41.164532Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 680 [2:7559600977499099244:5231]
2025-10-10T14:32:41.164543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:41.164555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:41.164557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.164559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.164561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.164572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:41.164582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:41.164588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:41.164629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.164635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.164637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.164638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:41.164685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:41.164691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.164699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.164705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.164715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:41.164732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310379:2438], now have 1 active actors on pipe
2025-10-10T14:32:41.164739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310631:6444], now have 1 active actors on pipe
2025-10-10T14:32:41.164747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600977499099238:5231]
2025-10-10T14:32:41.164750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600977499099238:5231]
2025-10-10T14:32:41.164752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600977499099238:5231]
2025-10-10T14:32:41.164765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:41.164782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:41.164782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:41.164785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:41.164787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:41.164797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:41.164800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:41.164794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 680
2025-10-10T14:32:41.164819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600977499099238:5231]
2025-10-10T14:32:41.164827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:41.164837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:41.164866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 680
2025-10-10T14:32:41.164930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.164942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.164969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb1ad2be-275dc425-b19b5d38-92940263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:41.164980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.164983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.164986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:41.164994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.165005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:41.165019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.165176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.165185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.165199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.165271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 681 partition: 0 MaxSeqNo: 40 sessionId: src_id|eb1ad2be-275dc425-b19b5d38-92940263_0
2025-10-10T14:32:41.165628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cacac50-ed6eed32-3d76024a-2d7cb065_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eb1ad2be-275dc425-b19b5d38-92940263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:41.168062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1ad2be-275dc425-b19b5d38-92940263_0] Write session: try to update token
2025-10-10T14:32:41.168075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1ad2be-275dc425-b19b5d38-92940263_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:41.175492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:41.175508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:41.175517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600977499099238:5231]
2025-10-10T14:32:41.175562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:41.175571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:41.175733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:41.175884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:41.176074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:41.176240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:41.176420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:41.176457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:41.180628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId: src_id|eb1ad2be-275dc425-b19b5d38-92940263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:41.182896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:41.183104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.183123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.183161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:41.183243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:41.192251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:41.192269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:41.192271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:41.192272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:41.192280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600977499099238:5231]
2025-10-10T14:32:41.192283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600977499099238:5231]
2025-10-10T14:32:41.192286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600977499099238:5231]
2025-10-10T14:32:41.192321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:41.192327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.192329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:41.192327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:41.192333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:41.192336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:41.192443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:41.242300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600978281310654:5983]
2025-10-10T14:32:41.242601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 680, pipe: [1:7559600978281310654:5983]
2025-10-10T14:32:41.299973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:41.309005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.309031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.309225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.309282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.309358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.309569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.309613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.309621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.309828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.309916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.310000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.310090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.310574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.310584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.310672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.310728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.310815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.310903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.310958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.310964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.311053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.311112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.311168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.311225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.311264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.311269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.311330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.311397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.311462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.311522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.311625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.311631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.311690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.311764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.311819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.311892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.311932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.311937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.311997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.312052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.312216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.312413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.312467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.312472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.312542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.312610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.312673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.312732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.312771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.312777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.312834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.312908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.312963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.313024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.313089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.313096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.313166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.313220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.313274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.313343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.313390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.313395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.313447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310654:5983], now have 1 active actors on pipe
2025-10-10T14:32:41.313763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:41.313776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:41.313779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:41.313816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 681 reason: error at write: Disconnected sessionId: src_id|eb1ad2be-275dc425-b19b5d38-92940263_0
2025-10-10T14:32:41.313828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600978281310654:5983]
2025-10-10T14:32:41.314008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:41.314059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 681 sessionId: src_id|eb1ad2be-275dc425-b19b5d38-92940263_0 is DEAD
2025-10-10T14:32:41.314234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1ad2be-275dc425-b19b5d38-92940263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:41.314246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1ad2be-275dc425-b19b5d38-92940263_0] Write session will restart in 0.008932s
2025-10-10T14:32:41.314270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1ad2be-275dc425-b19b5d38-92940263_0] Write session: Do CDS request
2025-10-10T14:32:41.314275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1ad2be-275dc425-b19b5d38-92940263_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:41.324798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1ad2be-275dc425-b19b5d38-92940263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.325105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:41.325116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 682
2025-10-10T14:32:41.325229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.325261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:41.325268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:41.325273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:41.325815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 682 sessionId:  describe result for acl check
2025-10-10T14:32:41.325846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:41.325851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:41.325853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:41.325858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600978281310768:6451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:41.326284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600978281310768:6451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:41.329092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600978281310768:6451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:41.330570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:41.332968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:41.332990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600978281310768:6451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:41.333008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600978281310768:6451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:41.333010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600978281310768:6451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:41.333016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:41.333164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:41.333175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:41.333187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:41.333242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:41.333280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600977499099516:5234]
2025-10-10T14:32:41.333873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:41.334134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:41.334178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:41.334593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:41.334652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.334659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.334660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.334661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.334662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.334663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.334665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.334666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.334667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.334668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.334670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.334671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.334672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.334676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.334684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.334686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.334688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.334690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.334692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.334694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.334696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.334698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.334701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.334703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.334705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.334706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.334711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.334717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.334721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.334725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.334727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.334730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.334733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.334736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.334738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.334742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.334744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.334749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.334754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.334762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.334767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.334776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.334779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.334783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.334786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.334789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.334793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.334796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.334804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.334809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.334818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.334828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.334854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:41.337247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:41.337568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:41.337580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:41.337583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:41.337587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:41.337592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 681 [2:7559600977499099516:5234]
2025-10-10T14:32:41.337600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:41.337613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:41.337619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.337621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.337622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.337634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:41.337643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:41.337650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:41.337688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.337694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.337695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.337697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:41.337750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:41.337756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.337762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.337769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.337778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:41.337800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600977499099511:5234]
2025-10-10T14:32:41.337807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600977499099511:5234]
2025-10-10T14:32:41.337809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600977499099511:5234]
2025-10-10T14:32:41.337823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:41.337840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310912:6451], now have 1 active actors on pipe
2025-10-10T14:32:41.337846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310659:2438], now have 1 active actors on pipe
2025-10-10T14:32:41.337852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:41.337852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:41.337855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:41.337857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:41.337863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:41.337865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:41.337883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600977499099511:5234]
2025-10-10T14:32:41.337892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:41.337900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:41.337890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 681
2025-10-10T14:32:41.337896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 681
2025-10-10T14:32:41.337920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.337926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.337952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:41.337962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.337965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.337966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:41.337979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.337992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:41.338010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.338139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.338149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.338164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.338267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 682 partition: 0 MaxSeqNo: 40 sessionId: src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0
2025-10-10T14:32:41.338580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1ad2be-275dc425-b19b5d38-92940263_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:41.341428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0] Write session: try to update token
2025-10-10T14:32:41.341446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:41.350027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:41.350044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:41.350056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600977499099511:5234]
2025-10-10T14:32:41.350103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:41.350120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:41.350336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:41.350470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:41.350599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:41.350730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:41.351024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:41.351070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:41.355523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId: src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:41.358149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:41.358360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.358379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.358417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:41.358506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:41.371456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:41.371474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:41.371476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:41.371478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:41.371489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600977499099511:5234]
2025-10-10T14:32:41.371492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600977499099511:5234]
2025-10-10T14:32:41.371496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600977499099511:5234]
2025-10-10T14:32:41.371536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:41.371541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:41.371541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:41.371543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:41.371548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.371550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:41.371685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:41.413832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600978281310923:5983]
2025-10-10T14:32:41.414118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 681, pipe: [1:7559600978281310923:5983]
2025-10-10T14:32:41.483259Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:41.490135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.490157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.490308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.490372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.490433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.490492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.490531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.490539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.490640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.490695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.490752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.490812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.490858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.490865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.490937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.490989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.491044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.491143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.491187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.491193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.491254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.491312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.491377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.491433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.491473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.491478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.491539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.491598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.491657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.491716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.491762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.491769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.491832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.491892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.491948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.492004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.492063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.492071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.492140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.492194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.492254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.492310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.492353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.492362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.492428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.492483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.492541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.492604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.492648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.492654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.492710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.492762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.492813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.492873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.492935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.492940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.492996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.493049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.493104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.493170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.493223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.493229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.493265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310923:5983], now have 1 active actors on pipe
2025-10-10T14:32:41.493478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600978281310923:5983]
2025-10-10T14:32:41.493515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:41.493931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:41.493941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:41.493969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 682 reason: error at write: Disconnected sessionId: src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0
2025-10-10T14:32:41.494170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 682 sessionId: src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0 is DEAD
2025-10-10T14:32:41.494222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:41.494308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:41.494314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0] Write session will restart in 0.005783s
2025-10-10T14:32:41.494332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0] Write session: Do CDS request
2025-10-10T14:32:41.494337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:41.500802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.500949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:41.500959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 683
2025-10-10T14:32:41.501042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.501074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:41.501081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:41.501084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:41.501413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 683 sessionId:  describe result for acl check
2025-10-10T14:32:41.501437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:41.501441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:41.501443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:41.501447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600978281310956:6455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:41.501854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600978281310956:6455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:41.504156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600978281310956:6455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:41.506726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600978281310956:6455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:41.506740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600978281310956:6455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:41.506743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600978281310956:6455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:41.506750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:41.510051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:41.512270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:41.512460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:41.512471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:41.512482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:41.512531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:41.512572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600977499099779:5236]
2025-10-10T14:32:41.513180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:41.513487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:41.513531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:41.513842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:41.513892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.513898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.513899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.513900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.513902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.513903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.513904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.513905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.513906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.513908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.513909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.513910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.513911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.513917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.513929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.513933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.513937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.513941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.513945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.513949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.513953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.513956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.513960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.513965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.513969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.513978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.513985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.513995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.514006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.514011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.514020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.514025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.514030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.514040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.514044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.514053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.514058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.514063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.514070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.514075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.514079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.514089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.514094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.514103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.514112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.514118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.514127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.514135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.514143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.514149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.514157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.514164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.514209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:41.516691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:41.517128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:41.517140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:41.517143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:41.517146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:41.517151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 682 [2:7559600977499099779:5236]
2025-10-10T14:32:41.517162Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:41.517178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:41.517186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.517189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.517191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.517206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:41.517215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:41.517224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:41.517278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.517285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.517287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.517290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:41.517374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:41.517382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.517394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.517410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.517432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:41.517459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311110:6455], now have 1 active actors on pipe
2025-10-10T14:32:41.517467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281310925:2438], now have 1 active actors on pipe
2025-10-10T14:32:41.517474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600977499099774:5236]
2025-10-10T14:32:41.517476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600977499099774:5236]
2025-10-10T14:32:41.517478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600977499099774:5236]
2025-10-10T14:32:41.517492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:41.517511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:41.517515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:41.517495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 682
2025-10-10T14:32:41.517519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:41.517508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 682
2025-10-10T14:32:41.517520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:41.517531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:41.517534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:41.517569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.517578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.517592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600977499099774:5236]
2025-10-10T14:32:41.517603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:41.517625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:41.517636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:41.517643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.517652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.517654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:41.517664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.517678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:41.517700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.517863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.517873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.517889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.517976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 683 partition: 0 MaxSeqNo: 40 sessionId: src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0
2025-10-10T14:32:41.518379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9281f18-d2a13d24-46b4fc1-8b5fa1b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:41.520882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0] Write session: try to update token
2025-10-10T14:32:41.520898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:41.534524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId: src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:41.536793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:41.537870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.537894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.537913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:41.537916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:41.537918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:41.537919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:41.537926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600977499099774:5236]
2025-10-10T14:32:41.537929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600977499099774:5236]
2025-10-10T14:32:41.537932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600977499099774:5236]
2025-10-10T14:32:41.537970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:41.537977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:41.537982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:41.537984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.537985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:41.537986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:41.538100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:41.593534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600978281311199:5983]
2025-10-10T14:32:41.593780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 682, pipe: [1:7559600978281311199:5983]
2025-10-10T14:32:41.641761Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:41.642177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:41.642247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311199:5983], now have 1 active actors on pipe
2025-10-10T14:32:41.642302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:41.642408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:41.642450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600978281311199:5983]
2025-10-10T14:32:41.650387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:41.650401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:41.650422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 683 reason: error at write: Disconnected sessionId: src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0
2025-10-10T14:32:41.650579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 683 sessionId: src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0 is DEAD
2025-10-10T14:32:41.650692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:41.650710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0] Write session will restart in 0.008888s
2025-10-10T14:32:41.650733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0] Write session: Do CDS request
2025-10-10T14:32:41.650738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:41.660800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.660860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:41.660876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 684
2025-10-10T14:32:41.661026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.661054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:41.661062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:41.661066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:41.661480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 684 sessionId:  describe result for acl check
2025-10-10T14:32:41.661513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:41.661519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:41.661521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:41.661528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600978281311396:6461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:41.662064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600978281311396:6461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:41.663771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:41.664612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600978281311396:6461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:41.666183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:41.666363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:41.666373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:41.666382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:41.666433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:41.666471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600977499100043:5239]
2025-10-10T14:32:41.666792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600978281311396:6461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:41.666815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600978281311396:6461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:41.666818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600978281311396:6461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:41.666823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:41.667034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:41.667332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:41.667376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:41.667634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:41.667680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.667685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.667686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.667687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.667687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.667688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.667688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.667689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.667690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.667690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.667691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.667691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.667692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.667696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.667704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.667706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.667709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.667711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.667714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.667716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.667718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.667721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.667723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.667725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.667727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.667730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.667734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.667740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.667744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.667748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.667750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.667753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.667756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.667759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.667761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.667765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.667768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.667770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.667773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.667776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.667779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.667781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.667784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.667788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.667792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.667797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.667802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.667807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.667811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.667817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.667821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.667826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.667861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:41.670472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:41.670774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:41.670785Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:41.670787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:41.670790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:41.670795Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 683 [2:7559600977499100043:5239]
2025-10-10T14:32:41.670806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:41.670825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:41.670832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.670835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.670837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.670853Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:41.670864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:41.670877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:41.670941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.670949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.670950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.670953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:41.671015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:41.671022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.671032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.671048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.671069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:41.671094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311204:2438], now have 1 active actors on pipe
2025-10-10T14:32:41.671101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311458:6461], now have 1 active actors on pipe
2025-10-10T14:32:41.671108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600977499100038:5239]
2025-10-10T14:32:41.671110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600977499100038:5239]
2025-10-10T14:32:41.671113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600977499100038:5239]
2025-10-10T14:32:41.671104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 683
2025-10-10T14:32:41.671124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 683
2025-10-10T14:32:41.671127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:41.671143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:41.671145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:41.671148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:41.671149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:41.671163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:41.671171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:41.671204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.671213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.671227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600977499100038:5239]
2025-10-10T14:32:41.671238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:41.671257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:41.671272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:41.671284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.671292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.671294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:41.671305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.671319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:41.671341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.671477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.671486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.671501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.671585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 684 partition: 0 MaxSeqNo: 40 sessionId: src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0
2025-10-10T14:32:41.671946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb0fb35-aa07f7d7-a0407702-bdf1b830_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:41.674433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0] Write session: try to update token
2025-10-10T14:32:41.674448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:41.686936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId: src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:41.689224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:41.689449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.689470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.689512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:41.689592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:41.693430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:41.693446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:41.693449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:41.693451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:41.693461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600977499100038:5239]
2025-10-10T14:32:41.693465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600977499100038:5239]
2025-10-10T14:32:41.693469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600977499100038:5239]
2025-10-10T14:32:41.693514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:41.693519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:41.693525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:41.693525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.693529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:41.693528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:41.693663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:41.742519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600978281311469:5983]
2025-10-10T14:32:41.742826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 683, pipe: [1:7559600978281311469:5983]
2025-10-10T14:32:41.805999Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:41.813250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.813275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.813455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.813513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.813573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.813638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.813681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.813688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.813748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.813843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.813912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.813978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.814018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.814024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.814090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.814148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.814234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.814295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.814334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.814340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.814401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.814461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.814518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.814574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.814615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.814621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.814684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.814770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.814860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.814919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.814971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.814978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.815042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.815130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.815190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.815249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.815291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.815296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.815356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.815412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.815471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.815529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.815573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.815581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.815641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.815694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.815751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.815806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.815860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.815866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.815934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.815989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.816045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.816100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.816157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.816164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.816226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.816280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.816338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.816394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.816445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.816451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.816516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311469:5983], now have 1 active actors on pipe
2025-10-10T14:32:41.816787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:41.816808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:41.816821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:41.816845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600978281311469:5983]
2025-10-10T14:32:41.816847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 684 reason: error at write: Disconnected sessionId: src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0
2025-10-10T14:32:41.817059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 684 sessionId: src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0 is DEAD
2025-10-10T14:32:41.817190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:41.817203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0] Write session will restart in 0.007922s
2025-10-10T14:32:41.817229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0] Write session: Do CDS request
2025-10-10T14:32:41.817235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:41.817451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:41.826969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.827039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:41.827054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 685
2025-10-10T14:32:41.827192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.827235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:41.827245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:41.827249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:41.827681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 685 sessionId:  describe result for acl check
2025-10-10T14:32:41.827713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:41.827717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:41.827718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:41.827723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600978281311538:6465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:41.828202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600978281311538:6465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:41.831304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600978281311538:6465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:41.833761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600978281311538:6465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:41.833771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600978281311538:6465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:41.833774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600978281311538:6465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:41.833781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:41.834834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:41.837493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:41.837694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:41.837705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:41.837717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:41.837768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:41.837811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600977499100308:5241]
2025-10-10T14:32:41.838236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:41.838501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:41.838532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:41.838901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:41.838963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.838969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.838971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.838972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.838973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.838974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.838975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.838976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.838977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.838979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.838980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.838981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.838983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.838987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.838999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.839002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.839004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.839006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.839009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.839011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.839013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.839015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.839017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.839019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.839021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.839023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.839029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.839035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:41.839040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.839043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:41.839045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.839049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:41.839051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.839054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:41.839057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.839060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:41.839062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.839066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:41.839068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.839071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:41.839074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.839077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:41.839079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.839083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:41.839085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.839088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:41.839091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.839094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.839098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.839101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.839104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.839106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.839128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:41.841758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:41.842066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:41.842078Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:41.842080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:41.842084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:41.842090Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 684 [2:7559600977499100308:5241]
2025-10-10T14:32:41.842102Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:41.842121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:41.842129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.842132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.842134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.842151Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:41.842162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:41.842169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:41.842225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.842232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.842234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.842236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:41.842302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:41.842310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.842321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:41.842337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:41.842358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:41.842382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311471:2438], now have 1 active actors on pipe
2025-10-10T14:32:41.842390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311724:6465], now have 1 active actors on pipe
2025-10-10T14:32:41.842397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600977499100303:5241]
2025-10-10T14:32:41.842404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600977499100303:5241]
2025-10-10T14:32:41.842406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600977499100303:5241]
2025-10-10T14:32:41.842419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:41.842417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 684
2025-10-10T14:32:41.842418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 684
2025-10-10T14:32:41.842438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:41.842439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:41.842454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:41.842459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:41.842457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:41.842466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:41.842508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.842520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.842535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600977499100303:5241]
2025-10-10T14:32:41.842548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:41.842563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:41.842579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:41.842587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:41.842592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:41.842595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:41.842605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:41.842618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:41.842639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.842803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.842811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.842827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:41.842913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 685 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0
2025-10-10T14:32:41.843305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7349f70-1fee1d49-84563a95-3ff2bd87_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:41.845961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0] Write session: try to update token
2025-10-10T14:32:41.845980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:41.859062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId: src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:41.861755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:41.861913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.861937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.863648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:41.863682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:41.863685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:41.863688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:41.863690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:41.863700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600977499100303:5241]
2025-10-10T14:32:41.863704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600977499100303:5241]
2025-10-10T14:32:41.863709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600977499100303:5241]
2025-10-10T14:32:41.863737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:41.863747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:41.863750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:41.863754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:41.863755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:41.863760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:41.863758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:41.863890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:41.917128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600978281311737:5983]
2025-10-10T14:32:41.917411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 684, pipe: [1:7559600978281311737:5983]
2025-10-10T14:32:41.970364Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:41.977928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:41.977951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:41.978101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.978154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.978211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.978270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.978310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.978318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.978378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.978432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.978493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.978551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.978596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.978602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.978659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.978746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.978808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.978865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.978904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.978909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.978989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.979061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.979120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.979177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.979215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.979220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.979278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.979331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.979390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.979459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.979499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.979505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.979562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.979636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.979690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.979746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.979787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.979794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.979852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.979907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.979964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.980019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.980056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.980061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.980117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.980170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.980226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.980280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.980330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.980338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.980397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.980469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.980526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.980595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.980634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.980639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.980733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:41.980814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:41.980866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:41.980919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:41.980957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:41.980964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:41.981008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311737:5983], now have 1 active actors on pipe
2025-10-10T14:32:41.981264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:41.981272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:41.981276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:41.981309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 685 reason: error at write: Disconnected sessionId: src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0
2025-10-10T14:32:41.981313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600978281311737:5983]
2025-10-10T14:32:41.981554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 685 sessionId: src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0 is DEAD
2025-10-10T14:32:41.981688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:41.981705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0] Write session will restart in 0.009773s
2025-10-10T14:32:41.981731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0] Write session: Do CDS request
2025-10-10T14:32:41.981736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:41.981924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:41.992966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.992997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:41.993013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 686
2025-10-10T14:32:41.993225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:41.993261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:41.993264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:41.993272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:41.993610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 686 sessionId:  describe result for acl check
2025-10-10T14:32:41.993638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:41.993644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:41.993645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:41.993649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600978281311880:6475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:41.994120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600978281311880:6475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:41.996893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600978281311880:6475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:41.998123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:42.000647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:42.000917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600978281311880:6475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:42.000932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600978281311880:6475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:42.000936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600978281311880:6475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:42.000944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:42.001012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:42.001026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:42.001039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:42.001106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:42.001139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600981794067882:5243]
2025-10-10T14:32:42.001744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:42.001968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:42.002007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:42.002367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:42.002423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.002429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.002430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.002432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.002433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.002434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.002436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.002437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.002438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.002439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.002440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.002441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.002443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.002449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.002471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.002476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.002480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.002484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.002488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.002492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.002496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.002504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.002508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.002512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.002517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.002520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.002531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.002544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.002554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.002560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.002564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.002569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.002574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.002580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.002597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.002607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.002616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.002625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.002633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.002643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.002651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.002658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.002667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.002673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.002681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.002686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.002696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.002701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.002705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.002710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.002715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.002719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.002760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:42.004972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:42.005401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:42.005419Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:42.005422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:42.005428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:42.005442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 685 [2:7559600981794067882:5243]
2025-10-10T14:32:42.005454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:42.005471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:42.005476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.005478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.005480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.005492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:42.005503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:42.005513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:42.005578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.005585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.005586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.005588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:42.005637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:42.005642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.005651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.005661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.005674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:42.005693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600978281311742:2438], now have 1 active actors on pipe
2025-10-10T14:32:42.005699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279302:6475], now have 1 active actors on pipe
2025-10-10T14:32:42.005705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600977499100580:5243]
2025-10-10T14:32:42.005709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600977499100580:5243]
2025-10-10T14:32:42.005711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600977499100580:5243]
2025-10-10T14:32:42.005722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:42.005733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:42.005734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:42.005745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:42.005747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:42.005749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:42.005750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:42.005747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 685
2025-10-10T14:32:42.005786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600977499100580:5243]
2025-10-10T14:32:42.005794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:42.005797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:42.005810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 685
2025-10-10T14:32:42.005854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.005863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.005885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:42.005894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.005900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.005901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:42.005910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.005922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:42.005939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.006108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.006118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.006138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.006215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 686 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0
2025-10-10T14:32:42.006611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b915c16-e794b6f7-5553aad0-8cebb3eb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:42.009177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0] Write session: try to update token
2025-10-10T14:32:42.009193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:42.023038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId: src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:42.024873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:42.024892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.024895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:42.024897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:42.024905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600977499100580:5243]
2025-10-10T14:32:42.024909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600977499100580:5243]
2025-10-10T14:32:42.024912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600977499100580:5243]
2025-10-10T14:32:42.024946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:42.024950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:42.024952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:42.024961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:42.024968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.024970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:42.025118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:42.025644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:42.081471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600982576279325:5983]
2025-10-10T14:32:42.081716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 685, pipe: [1:7559600982576279325:5983]
2025-10-10T14:32:42.129853Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:42.130071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.130085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.130123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279325:5983], now have 1 active actors on pipe
2025-10-10T14:32:42.130284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:42.130336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:42.130344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:42.130393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600982576279325:5983]
2025-10-10T14:32:42.130426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 686 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0
2025-10-10T14:32:42.130621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 686 sessionId: src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0 is DEAD
2025-10-10T14:32:42.130804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:42.130816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0] Write session will restart in 0.008199s
2025-10-10T14:32:42.130842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0] Write session: Do CDS request
2025-10-10T14:32:42.130848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:42.139860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.139945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:42.139961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 687
2025-10-10T14:32:42.140061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.140089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:42.140097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:42.140100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:42.140643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 687 sessionId:  describe result for acl check
2025-10-10T14:32:42.140673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:42.140678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:42.140679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:42.140684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600982576279391:6482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:42.141124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600982576279391:6482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:42.143695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600982576279391:6482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:42.146097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600982576279391:6482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:42.146109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600982576279391:6482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:42.146111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600982576279391:6482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:42.146118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:42.148333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:42.150888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:42.151088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:42.151099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:42.151111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:42.151168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:42.151229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600981794068174:5258]
2025-10-10T14:32:42.151705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:42.151940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:42.151971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:42.152356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:42.152412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.152417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.152418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.152419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.152419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.152420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.152420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.152421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.152422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.152422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.152423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.152424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.152424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.152428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.152436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.152439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.152441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.152443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.152445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.152447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.152449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.152451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.152455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.152459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.152463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.152466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.152474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.152481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.152492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.152498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.152504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.152513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.152521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.152527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.152535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.152543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.152552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.152561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.152567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.152570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.152573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.152576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.152578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.152581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.152584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.152590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.152593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.152596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.152599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.152602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.152608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.152611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.152646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:42.154768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:42.155102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:42.155114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:42.155115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:42.155118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:42.155122Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 686 [2:7559600981794068174:5258]
2025-10-10T14:32:42.155130Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:42.155142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:42.155144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.155146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.155148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.155160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:42.155174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:42.155182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:42.155225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.155231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.155232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.155234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:42.155284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:42.155292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.155302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.155319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.155336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:42.155354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279327:2438], now have 1 active actors on pipe
2025-10-10T14:32:42.155360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279561:6482], now have 1 active actors on pipe
2025-10-10T14:32:42.155366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600981794068168:5258]
2025-10-10T14:32:42.155367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600981794068168:5258]
2025-10-10T14:32:42.155370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600981794068168:5258]
2025-10-10T14:32:42.155379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:42.155392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:42.155396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:42.155399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:42.155400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:42.155405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:42.155410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:42.155429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600981794068168:5258]
2025-10-10T14:32:42.155437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:42.155439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:42.155428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 686
2025-10-10T14:32:42.155457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 686
2025-10-10T14:32:42.155492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.155499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.155521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:42.155530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.155533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.155534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:42.155542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.155550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:42.155562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.155699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.155705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.155719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.155794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 687 partition: 0 MaxSeqNo: 40 sessionId: src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0
2025-10-10T14:32:42.156155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e73a2c4-b3d7859-4a495ee8-41d599d3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:42.158730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0] Write session: try to update token
2025-10-10T14:32:42.158746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:42.172175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId: src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:42.174842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:42.175769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.175791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.175811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:42.175814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.175817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:42.175819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:42.175827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600981794068168:5258]
2025-10-10T14:32:42.175832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600981794068168:5258]
2025-10-10T14:32:42.175835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600981794068168:5258]
2025-10-10T14:32:42.175874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:42.175885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:42.175888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:42.175893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:42.175898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.175899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:42.176057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:42.230454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600982576279608:5983]
2025-10-10T14:32:42.230674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 686, pipe: [1:7559600982576279608:5983]
2025-10-10T14:32:42.280215Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:42.280427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:42.280480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279608:5983], now have 1 active actors on pipe
2025-10-10T14:32:42.280576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:42.280686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:42.280730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600982576279608:5983]
2025-10-10T14:32:42.289999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:42.290015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:42.290036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 687 reason: error at write: Disconnected sessionId: src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0
2025-10-10T14:32:42.290202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 687 sessionId: src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0 is DEAD
2025-10-10T14:32:42.290305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:42.290312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0] Write session will restart in 0.007750s
2025-10-10T14:32:42.290330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0] Write session: Do CDS request
2025-10-10T14:32:42.290335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:42.298883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.299001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:42.299015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 688
2025-10-10T14:32:42.299119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.299150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:42.299161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:42.299165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:42.299560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 688 sessionId:  describe result for acl check
2025-10-10T14:32:42.299591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:42.299598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:42.299599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:42.299604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600982576279781:6487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:42.300057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600982576279781:6487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:42.302215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:42.302591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600982576279781:6487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:42.305165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:42.305356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:42.305365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:42.305375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:42.305428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:42.305462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600981794068451:5261]
2025-10-10T14:32:42.305463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600982576279781:6487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:42.305476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600982576279781:6487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:42.305479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600982576279781:6487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:42.305486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:42.305906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:42.306117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:42.306148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:42.306370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:42.306407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.306412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.306413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.306413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.306414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.306414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.306415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.306416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.306417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.306417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.306418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.306419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.306420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.306423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.306432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.306435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.306437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.306440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.306442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.306445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.306447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.306449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.306452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.306454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.306457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.306459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.306466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.306471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.306476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.306479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.306482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.306485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.306488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.306491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.306494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.306497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.306500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.306503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.306506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.306510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.306513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.306516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.306519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.306522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.306524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.306527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.306530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.306533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.306536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.306539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.306543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.306546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.306567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:42.308794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:42.309153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:42.309163Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:42.309164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:42.309167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:42.309172Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 687 [2:7559600981794068451:5261]
2025-10-10T14:32:42.309181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:42.309195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:42.309203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.309205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.309207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.309220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:42.309225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:42.309236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:42.309279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.309284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.309286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.309288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:42.309364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:42.309372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.309381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.309388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.309399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:42.309420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279609:2438], now have 1 active actors on pipe
2025-10-10T14:32:42.309427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279867:6487], now have 1 active actors on pipe
2025-10-10T14:32:42.309433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600981794068446:5261]
2025-10-10T14:32:42.309434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600981794068446:5261]
2025-10-10T14:32:42.309436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600981794068446:5261]
2025-10-10T14:32:42.309445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:42.309461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:42.309465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:42.309470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:42.309471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:42.309477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:42.309479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:42.309502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600981794068446:5261]
2025-10-10T14:32:42.309510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:42.309512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:42.309501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 687
2025-10-10T14:32:42.309549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.309556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.309524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 687
2025-10-10T14:32:42.309580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b790f8-3700b84c-401daa90-841a208b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:42.309594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.309597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.309600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:42.309611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.309621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:42.309634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.309756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.309762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.309774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.309865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 688 partition: 0 MaxSeqNo: 40 sessionId: src_id|10b790f8-3700b84c-401daa90-841a208b_0
2025-10-10T14:32:42.310278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b5b3c3a-c41bebfa-ed99e52c-5b51a35b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|10b790f8-3700b84c-401daa90-841a208b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:42.312845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b790f8-3700b84c-401daa90-841a208b_0] Write session: try to update token
2025-10-10T14:32:42.312860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b790f8-3700b84c-401daa90-841a208b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:42.326723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId: src_id|10b790f8-3700b84c-401daa90-841a208b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:42.329154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:42.329836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.329858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.329879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:42.329882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.329885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:42.329887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:42.329895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600981794068446:5261]
2025-10-10T14:32:42.329900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600981794068446:5261]
2025-10-10T14:32:42.329903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600981794068446:5261]
2025-10-10T14:32:42.329948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:42.329963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:42.329963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:42.329967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:42.329972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.329975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:42.330129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:42.381014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600982576279879:5983]
2025-10-10T14:32:42.381255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 687, pipe: [1:7559600982576279879:5983]
2025-10-10T14:32:42.434148Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:42.434707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:42.434758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279879:5983], now have 1 active actors on pipe
2025-10-10T14:32:42.434826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:42.434977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600982576279879:5983]
2025-10-10T14:32:42.435011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:42.444749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:42.444765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:42.444791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 688 reason: error at write: Disconnected sessionId: src_id|10b790f8-3700b84c-401daa90-841a208b_0
2025-10-10T14:32:42.444963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 688 sessionId: src_id|10b790f8-3700b84c-401daa90-841a208b_0 is DEAD
2025-10-10T14:32:42.445083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b790f8-3700b84c-401daa90-841a208b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:42.445090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b790f8-3700b84c-401daa90-841a208b_0] Write session will restart in 0.007040s
2025-10-10T14:32:42.445111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b790f8-3700b84c-401daa90-841a208b_0] Write session: Do CDS request
2025-10-10T14:32:42.445118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b790f8-3700b84c-401daa90-841a208b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:42.452874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b790f8-3700b84c-401daa90-841a208b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.452997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:42.453013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 689
2025-10-10T14:32:42.453132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.453170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:42.453181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:42.453185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:42.453723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 689 sessionId:  describe result for acl check
2025-10-10T14:32:42.453764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:42.453770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:42.453772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:42.453779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600982576280107:6491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:42.454379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600982576280107:6491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:42.455155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:42.457214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600982576280107:6491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:42.458450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:42.458627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:42.458637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:42.458648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:42.458697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:42.458729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600981794068719:5263]
2025-10-10T14:32:42.459184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:42.459440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:42.459471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:42.459700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:42.459742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.459746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.459747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.459748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.459749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.459750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.459750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.459751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.459752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.459752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.459753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.459754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.459755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.459758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.459767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.459769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.459771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.459774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.459776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.459778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.459780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.459782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.459785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.459787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.459789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.459791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.459796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.459801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.459806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.459810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.459812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.459816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.459818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.459822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.459825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.459828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.459831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.459834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.459837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.459841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.459843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.459846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.459849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.459852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.459854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.459857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.459860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.459864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.459866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.459870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.459873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.459876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.459898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:42.459987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600982576280107:6491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:42.460003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600982576280107:6491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:42.460006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600982576280107:6491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:42.460015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:42.462144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:42.462758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:42.462768Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:42.462769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:42.462772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:42.462776Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 688 [2:7559600981794068719:5263]
2025-10-10T14:32:42.462785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:42.462797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:42.462798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.462800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.462802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.462814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:42.462819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:42.462825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:42.462874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.462879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.462880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.462882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:42.462931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:42.462946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.462955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.462965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.462978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:42.462996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600981794068714:5263]
2025-10-10T14:32:42.463001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600981794068714:5263]
2025-10-10T14:32:42.463002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600981794068714:5263]
2025-10-10T14:32:42.463008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:42.463018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280141:6491], now have 1 active actors on pipe
2025-10-10T14:32:42.463018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:42.463021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:42.463023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:42.463025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576279880:2438], now have 1 active actors on pipe
2025-10-10T14:32:42.463031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:42.463041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:42.463043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:42.463058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600981794068714:5263]
2025-10-10T14:32:42.463066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:42.463077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:42.463076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 688
2025-10-10T14:32:42.463098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 688
2025-10-10T14:32:42.463135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.463142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.463164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4adfc75c-8eabfa79-a0627971-eb571810_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:42.463174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.463176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.463178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:42.463186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.463196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:42.463210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.463357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.463368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.463390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.463462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 689 partition: 0 MaxSeqNo: 40 sessionId: src_id|4adfc75c-8eabfa79-a0627971-eb571810_0
2025-10-10T14:32:42.463722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b790f8-3700b84c-401daa90-841a208b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4adfc75c-8eabfa79-a0627971-eb571810_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:42.466281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4adfc75c-8eabfa79-a0627971-eb571810_0] Write session: try to update token
2025-10-10T14:32:42.466294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4adfc75c-8eabfa79-a0627971-eb571810_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:42.478877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId: src_id|4adfc75c-8eabfa79-a0627971-eb571810_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:42.481222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:42.481761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.481783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.481804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:42.481807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.481815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600981794068714:5263]
2025-10-10T14:32:42.481846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:42.481875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:42.482045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:42.482179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:42.482331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:42.482491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:42.482668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:42.482701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:42.482731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:42.482825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:42.495351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:42.495367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.495369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:42.495370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:42.495378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600981794068714:5263]
2025-10-10T14:32:42.495382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600981794068714:5263]
2025-10-10T14:32:42.495385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600981794068714:5263]
2025-10-10T14:32:42.495427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:42.495430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:42.495435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:42.495438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:42.495440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.495442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:42.495567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:42.535100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600982576280151:5983]
2025-10-10T14:32:42.535330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 688, pipe: [1:7559600982576280151:5983]
2025-10-10T14:32:42.600165Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:42.607092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.607115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.607268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.607328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.607388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.607447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.607492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.607499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.607562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.607619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.607679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.607740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.607895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.607902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.607966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.608045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.608113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.608179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.608219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.608225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.608289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.608385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.608475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.608543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.608584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.608591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.608655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.608711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.608770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.608830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.608879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.608889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.608956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.609010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.609069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.609130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.609173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.609181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.609258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.609317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.609393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.609452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.609510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.609515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.609577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.609633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.609692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.609752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.609795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.609797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.609857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.609915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.609975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.610032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.610072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.610078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.610137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:42.610193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:42.610252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:42.610324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:42.610367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:42.610372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:42.610414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280151:5983], now have 1 active actors on pipe
2025-10-10T14:32:42.610641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600982576280151:5983]
2025-10-10T14:32:42.610664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:42.610668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:42.610671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:42.610702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 689 reason: error at write: Disconnected sessionId: src_id|4adfc75c-8eabfa79-a0627971-eb571810_0
2025-10-10T14:32:42.610935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 689 sessionId: src_id|4adfc75c-8eabfa79-a0627971-eb571810_0 is DEAD
2025-10-10T14:32:42.611131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adfc75c-8eabfa79-a0627971-eb571810_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:42.611141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adfc75c-8eabfa79-a0627971-eb571810_0] Write session will restart in 0.009488s
2025-10-10T14:32:42.611161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adfc75c-8eabfa79-a0627971-eb571810_0] Write session: Do CDS request
2025-10-10T14:32:42.611166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adfc75c-8eabfa79-a0627971-eb571810_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:42.611313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:42.621866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4adfc75c-8eabfa79-a0627971-eb571810_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.622006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:42.622024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 690
2025-10-10T14:32:42.622397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.622439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:42.622450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:42.622453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:42.622882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 690 sessionId:  describe result for acl check
2025-10-10T14:32:42.622927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:42.622935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:42.622949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:42.622956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600982576280270:6497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:42.623612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600982576280270:6497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:42.626595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600982576280270:6497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:42.628604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:42.628710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600982576280270:6497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:42.628722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600982576280270:6497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:42.628726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600982576280270:6497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:42.628733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:42.629126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:42.629315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:42.629324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:42.629346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:42.629391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:42.629429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600981794068991:5266]
2025-10-10T14:32:42.630051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:42.631628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:42.631681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:42.632027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:42.632090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.632096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.632097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.632098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.632099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.632099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.632100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.632101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.632101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.632102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.632103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.632103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.632104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.632108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.632117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.632119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.632121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.632123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.632125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.632127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.632130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.632132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.632134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.632137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.632139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.632141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.632146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.632152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.632157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.632160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.632163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.632166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.632169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.632172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.632175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.632178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.632181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.632184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.632186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.632189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.632192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.632195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.632198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.632200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.632204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.632208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.632210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.632214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.632216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.632220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.632223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.632225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.632248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:42.634337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:42.634820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:42.634830Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:42.634831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:42.634835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:42.634839Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 689 [2:7559600981794068991:5266]
2025-10-10T14:32:42.634847Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:42.634859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:42.634861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.634863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.634864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.634878Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:42.634884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:42.634890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:42.634928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.634932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.634933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.634935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:42.635007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:42.635014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.635021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.635028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.635038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:42.635055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280159:2438], now have 1 active actors on pipe
2025-10-10T14:32:42.635062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280423:6497], now have 1 active actors on pipe
2025-10-10T14:32:42.635068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600981794068985:5266]
2025-10-10T14:32:42.635070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600981794068985:5266]
2025-10-10T14:32:42.635071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600981794068985:5266]
2025-10-10T14:32:42.635080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:42.635100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:42.635101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:42.635104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:42.635106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:42.635113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:42.635116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:42.635136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600981794068985:5266]
2025-10-10T14:32:42.635124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 689
2025-10-10T14:32:42.635142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:42.635130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 689
2025-10-10T14:32:42.635146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:42.635171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.635180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.635211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6383f62-56b46dc7-62b5975a-434455d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:42.635221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.635224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.635226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:42.635237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.635246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:42.635256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.635387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.635399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.635418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.635514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 690 partition: 0 MaxSeqNo: 40 sessionId: src_id|e6383f62-56b46dc7-62b5975a-434455d7_0
2025-10-10T14:32:42.635871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adfc75c-8eabfa79-a0627971-eb571810_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e6383f62-56b46dc7-62b5975a-434455d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:42.638357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6383f62-56b46dc7-62b5975a-434455d7_0] Write session: try to update token
2025-10-10T14:32:42.638377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6383f62-56b46dc7-62b5975a-434455d7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:42.652120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId: src_id|e6383f62-56b46dc7-62b5975a-434455d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:42.654182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:42.654200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.654202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:42.654205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:42.654214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600981794068985:5266]
2025-10-10T14:32:42.654219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600981794068985:5266]
2025-10-10T14:32:42.654223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600981794068985:5266]
2025-10-10T14:32:42.654271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:42.654276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:42.654279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.654282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:42.654283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:42.654287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:42.654430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:42.654651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:42.710700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600982576280435:5983]
2025-10-10T14:32:42.710970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 689, pipe: [1:7559600982576280435:5983]
2025-10-10T14:32:42.766359Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:42.766582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.766595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.766635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280435:5983], now have 1 active actors on pipe
2025-10-10T14:32:42.766805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:42.766887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:42.766922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600982576280435:5983]
2025-10-10T14:32:42.766926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:42.767004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 690 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6383f62-56b46dc7-62b5975a-434455d7_0
2025-10-10T14:32:42.767188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 690 sessionId: src_id|e6383f62-56b46dc7-62b5975a-434455d7_0 is DEAD
2025-10-10T14:32:42.767342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6383f62-56b46dc7-62b5975a-434455d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:42.767353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6383f62-56b46dc7-62b5975a-434455d7_0] Write session will restart in 0.009815s
2025-10-10T14:32:42.767379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6383f62-56b46dc7-62b5975a-434455d7_0] Write session: Do CDS request
2025-10-10T14:32:42.767385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6383f62-56b46dc7-62b5975a-434455d7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:42.778909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6383f62-56b46dc7-62b5975a-434455d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.778997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:42.779010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 691
2025-10-10T14:32:42.779146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.779173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:42.779180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:42.779183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:42.779618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 691 sessionId:  describe result for acl check
2025-10-10T14:32:42.779653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:42.779659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:42.779660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:42.779664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600982576280589:6501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:42.780088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600982576280589:6501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:42.782369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600982576280589:6501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:42.782976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:42.785211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:42.785404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:42.785418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:42.785430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:42.785468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600982576280589:6501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:42.785481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600982576280589:6501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:42.785485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600982576280589:6501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:42.785492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:42.785493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:42.785532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600981794069260:5268]
2025-10-10T14:32:42.786101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:42.786355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:42.786398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:42.786626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:42.786664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.786669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.786669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.786670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.786671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.786671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.786672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.786673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.786673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.786674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.786675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.786675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.786676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.786679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.786687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.786690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.786692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.786694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.786696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.786698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.786700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.786702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.786705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.786707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.786709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.786711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.786717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.786723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.786727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.786731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.786733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.786736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.786739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.786742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.786745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.786749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.786751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.786755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.786757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.786760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.786763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.786766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.786768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.786771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.786774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.786777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.786780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.786782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.786785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.786788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.786790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.786793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.786815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:42.788827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:42.789122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:42.789133Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:42.789135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:42.789137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:42.789142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 690 [2:7559600981794069260:5268]
2025-10-10T14:32:42.789150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:42.789162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:42.789167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.789169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.789170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.789181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:42.789186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:42.789194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:42.789248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.789256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.789258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.789259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:42.789353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:42.789361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.789373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.789390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.789410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:42.789435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280697:6501], now have 1 active actors on pipe
2025-10-10T14:32:42.789443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280436:2438], now have 1 active actors on pipe
2025-10-10T14:32:42.789450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600981794069254:5268]
2025-10-10T14:32:42.789452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600981794069254:5268]
2025-10-10T14:32:42.789455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600981794069254:5268]
2025-10-10T14:32:42.789445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 690
2025-10-10T14:32:42.789448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 690
2025-10-10T14:32:42.789463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:42.789476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:42.789481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:42.789489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:42.789491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:42.789492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:42.789496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:42.789528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.789538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.789551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600981794069254:5268]
2025-10-10T14:32:42.789563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:42.789574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:42.789594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:42.789600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.789607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.789608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:42.789616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.789624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:42.789643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.789775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.789786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.789801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.789879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 691 partition: 0 MaxSeqNo: 40 sessionId: src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0
2025-10-10T14:32:42.790169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6383f62-56b46dc7-62b5975a-434455d7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:42.792587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0] Write session: try to update token
2025-10-10T14:32:42.792599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:42.805858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId: src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:42.807469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:42.807489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.807493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:42.807495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:42.807504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600981794069254:5268]
2025-10-10T14:32:42.807509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600981794069254:5268]
2025-10-10T14:32:42.807514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600981794069254:5268]
2025-10-10T14:32:42.807564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:42.807566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:42.807572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:42.807576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:42.807577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.807579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:42.807725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:42.808436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:42.866897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600982576280709:5983]
2025-10-10T14:32:42.867152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 690, pipe: [1:7559600982576280709:5983]
2025-10-10T14:32:42.913786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:42.914401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.914415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.914455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280709:5983], now have 1 active actors on pipe
2025-10-10T14:32:42.914653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:42.914720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:42.914721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600982576280709:5983]
2025-10-10T14:32:42.914734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:42.914741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:42.914796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 691 reason: error at write: Disconnected sessionId: src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0
2025-10-10T14:32:42.915012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 691 sessionId: src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0 is DEAD
2025-10-10T14:32:42.915166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:42.915176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0] Write session will restart in 0.007136s
2025-10-10T14:32:42.915193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0] Write session: Do CDS request
2025-10-10T14:32:42.915198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:42.923831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.923923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:42.923937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 692
2025-10-10T14:32:42.924058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:42.924091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:42.924101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:42.924106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:42.924504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 692 sessionId:  describe result for acl check
2025-10-10T14:32:42.924538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:42.924545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:42.924547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:42.924552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600982576280767:6505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:42.925087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600982576280767:6505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:42.927755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600982576280767:6505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:42.930399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600982576280767:6505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:42.930412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600982576280767:6505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:42.930415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600982576280767:6505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:42.930422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:42.931516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:42.933726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:42.933913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:42.933922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:42.933931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:42.933981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:42.934013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600981794069531:5270]
2025-10-10T14:32:42.934416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:42.934675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:42.934726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:42.934965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:42.935018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.935022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.935023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.935023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.935024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.935025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.935026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.935027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.935028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.935028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.935029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.935029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.935030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.935034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.935043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.935045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.935048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.935050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.935052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.935055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.935057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.935059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.935061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.935064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.935066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.935068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.935073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.935078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:42.935083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.935086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:42.935089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.935092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:42.935102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.935106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:42.935108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.935111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:42.935114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.935125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:42.935131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.935134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:42.935137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.935140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:42.935144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.935147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:42.935149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.935153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:42.935159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.935162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.935165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.935170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.935173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.935180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.935202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:42.937300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:42.937608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:42.937617Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:42.937619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:42.937622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:42.937627Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 691 [2:7559600981794069531:5270]
2025-10-10T14:32:42.937634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:42.937646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:42.937648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.937651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.937652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.937665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:42.937669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:42.937675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:42.937715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.937721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.937722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.937724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:42.937905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 691
2025-10-10T14:32:42.937909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 691
2025-10-10T14:32:42.937965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:42.937972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.937980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:42.937986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:42.937997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:42.938018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280969:6505], now have 1 active actors on pipe
2025-10-10T14:32:42.938024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600982576280710:2438], now have 1 active actors on pipe
2025-10-10T14:32:42.938037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.938045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.938062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600981794069526:5270]
2025-10-10T14:32:42.938069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600981794069526:5270]
2025-10-10T14:32:42.938070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600981794069526:5270]
2025-10-10T14:32:42.938080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:42.938090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:42.938100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:42.938103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:42.938105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:42.938108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:42.938110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:42.938117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:42.938123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:42.938125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:42.938127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:42.938135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:42.938144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:42.938182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600981794069526:5270]
2025-10-10T14:32:42.938193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:42.938208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.938210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:42.938331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.938337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.938349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:42.938427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 692 partition: 0 MaxSeqNo: 40 sessionId: src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0
2025-10-10T14:32:42.938777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65fe28b-2f657f84-175ab75a-bc1d036f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:42.941484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0] Write session: try to update token
2025-10-10T14:32:42.941501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:42.949122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:42.949142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.949151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600981794069526:5270]
2025-10-10T14:32:42.949196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:42.949213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:42.949371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:42.949503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:42.949624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:42.949753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:42.949922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:42.949959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:42.954758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId: src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:42.957155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:42.957356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:42.957374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:42.957406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:42.957493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:42.966320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:42.966335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:42.966338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:42.966339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:42.966350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600981794069526:5270]
2025-10-10T14:32:42.966354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600981794069526:5270]
2025-10-10T14:32:42.966358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600981794069526:5270]
2025-10-10T14:32:42.966406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:42.966408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:42.966414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:42.966414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:42.966416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:42.966417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:42.966564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:43.014867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600986871248280:5983]
2025-10-10T14:32:43.015140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 691, pipe: [1:7559600986871248280:5983]
2025-10-10T14:32:43.069944Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:43.076609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.076632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.076780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.076835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.076892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.076949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.076989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.076997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.077091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.077146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.077202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.077263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.077303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.077308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.077383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.077435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.077511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.077571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.077610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.077615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.077674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.077728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.077787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.077845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.077885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.077893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.077950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.078005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.078060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.078117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.078162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.078167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.078228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.078282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.078341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.078397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.078439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.078444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.078503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.078554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.078612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.078667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.078705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.078713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.078769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.078822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.078879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.078950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.078995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.079000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.079056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.079110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.079165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.079221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.079262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.079267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.079322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:43.079373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:43.079427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:43.079481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:43.079520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:43.079526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:43.079565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871248280:5983], now have 1 active actors on pipe
2025-10-10T14:32:43.079857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:43.079868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600986871248280:5983]
2025-10-10T14:32:43.079892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:43.079895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:43.079920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 692 reason: error at write: Disconnected sessionId: src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0
2025-10-10T14:32:43.080111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 692 sessionId: src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0 is DEAD
2025-10-10T14:32:43.080254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:43.080264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0] Write session will restart in 0.007615s
2025-10-10T14:32:43.080290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0] Write session: Do CDS request
2025-10-10T14:32:43.080296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:43.080383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:43.088870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.088950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:43.088964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 693
2025-10-10T14:32:43.089082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.089123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:43.089129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:43.089133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:43.089710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 693 sessionId:  describe result for acl check
2025-10-10T14:32:43.089760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:43.089767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:43.089769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:43.089776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600986871248375:6518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:43.090361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600986871248375:6518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:43.093589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600986871248375:6518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:43.096449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600986871248375:6518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:43.096464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600986871248375:6518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:43.096467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600986871248375:6518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:43.096476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:43.096877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:43.099620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:43.099836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:43.099853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:43.099866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:43.099926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:43.099974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600986089037137:5285]
2025-10-10T14:32:43.100601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:43.100864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:43.100919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:43.101176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:43.101241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.101247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.101248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.101249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.101251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.101252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.101253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.101255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.101256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.101257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.101259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.101260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.101261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.101267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.101281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.101285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.101290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.101294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.101298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.101302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.101306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.101310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.101315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.101319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.101323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.101345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.101353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.101361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.101368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.101374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.101379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.101384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.101389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.101400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.101404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.101410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.101414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.101419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.101426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.101436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.101441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.101450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.101454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.101458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.101462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.101466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.101475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.101479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.101483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.101488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.101492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.101496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.101543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:43.103732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:43.104253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:43.104265Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:43.104266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:43.104269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:43.104276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 692 [2:7559600986089037137:5285]
2025-10-10T14:32:43.104284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:43.104302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:43.104307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.104309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.104311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.104322Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:43.104331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:43.104338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:43.104379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.104384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.104385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.104387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:43.104451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:43.104457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.104464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.104471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.104485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:43.104504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871248567:6518], now have 1 active actors on pipe
2025-10-10T14:32:43.104510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871248308:2438], now have 1 active actors on pipe
2025-10-10T14:32:43.104516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600986089037132:5285]
2025-10-10T14:32:43.104520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600986089037132:5285]
2025-10-10T14:32:43.104522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600986089037132:5285]
2025-10-10T14:32:43.104531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:43.104544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:43.104558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:43.104563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:43.104582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600986089037132:5285]
2025-10-10T14:32:43.104558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 692
2025-10-10T14:32:43.104590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:43.104561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 692
2025-10-10T14:32:43.104617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.104626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.104656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:43.104666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.104672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.104674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:43.104682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.104694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:43.104711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:43.104714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.104720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:43.104721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:43.104727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:43.104842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.104847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.104859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.104948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 693 partition: 0 MaxSeqNo: 40 sessionId: src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0
2025-10-10T14:32:43.105349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408f0189-b7a3ab89-db7c322b-31c39b93_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:43.107927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0] Write session: try to update token
2025-10-10T14:32:43.107949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:43.121433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId: src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:43.122869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:43.122886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:43.122888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:43.122890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:43.122897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600986089037132:5285]
2025-10-10T14:32:43.122901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600986089037132:5285]
2025-10-10T14:32:43.122903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600986089037132:5285]
2025-10-10T14:32:43.122939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:43.122940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:43.122953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:43.122956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:43.122960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.122961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:43.123102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:43.123837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:43.179739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600986871248580:5983]
2025-10-10T14:32:43.180028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 692, pipe: [1:7559600986871248580:5983]
2025-10-10T14:32:43.230380Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:43.230820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.230832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.230871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871248580:5983], now have 1 active actors on pipe
2025-10-10T14:32:43.231060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:43.231061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:43.231071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:43.231104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600986871248580:5983]
2025-10-10T14:32:43.231139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 693 reason: error at write: Disconnected sessionId: src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0
2025-10-10T14:32:43.231324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 693 sessionId: src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0 is DEAD
2025-10-10T14:32:43.231402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:43.231467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:43.231491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0] Write session will restart in 0.005553s
2025-10-10T14:32:43.231521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0] Write session: Do CDS request
2025-10-10T14:32:43.231529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:43.237803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.237873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:43.237887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 694
2025-10-10T14:32:43.237987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.238019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:43.238030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:43.238033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:43.238600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 694 sessionId:  describe result for acl check
2025-10-10T14:32:43.238634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:43.238650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:43.238651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:43.238657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600986871248617:6523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:43.239220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600986871248617:6523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:43.242147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600986871248617:6523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:43.245777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600986871248617:6523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:43.245789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600986871248617:6523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:43.245793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600986871248617:6523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:43.245801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:43.248912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:43.251704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:43.251879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:43.251890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:43.251902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:43.251954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:43.251991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600986089037422:5288]
2025-10-10T14:32:43.252596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:43.252844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:43.252883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:43.253197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:43.253254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.253260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.253261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.253262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.253263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.253264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.253265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.253266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.253268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.253268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.253270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.253270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.253271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.253277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.253291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.253295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.253299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.253303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.253307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.253311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.253315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.253319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.253323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.253327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.253346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.253350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.253357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.253366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.253372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.253378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.253385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.253390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.253395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.253406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.253410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.253415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.253424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.253429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.253434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.253443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.253447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.253452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.253462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.253467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.253476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.253481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.253486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.253492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.253500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.253505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.253510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.253517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.253556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:43.255693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:43.255972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:43.255981Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:43.255983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:43.255985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:43.255990Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 693 [2:7559600986089037422:5288]
2025-10-10T14:32:43.255998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:43.256019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:43.256026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.256029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.256031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.256042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:43.256050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:43.256057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:43.256100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.256106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.256109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.256112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:43.256170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:43.256178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.256189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.256207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.256221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:43.256240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871248789:6523], now have 1 active actors on pipe
2025-10-10T14:32:43.256248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871248594:2438], now have 1 active actors on pipe
2025-10-10T14:32:43.256255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600986089037417:5288]
2025-10-10T14:32:43.256257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600986089037417:5288]
2025-10-10T14:32:43.256259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600986089037417:5288]
2025-10-10T14:32:43.256272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:43.256285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:43.256288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:43.256293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:43.256294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:43.256303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:43.256307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:43.256288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 693
2025-10-10T14:32:43.256288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 693
2025-10-10T14:32:43.256334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600986089037417:5288]
2025-10-10T14:32:43.256349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:43.256361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:43.256362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.256367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.256405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:43.256415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.256417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.256419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:43.256426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.256435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:43.256447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.256584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.256593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.256606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.256689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 694 partition: 0 MaxSeqNo: 40 sessionId: src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0
2025-10-10T14:32:43.257035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6574f6b9-e6460de8-a69e1ee1-50e62346_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:43.259652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0] Write session: try to update token
2025-10-10T14:32:43.259670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:43.273304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId: src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:43.274505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:43.274528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:43.274531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:43.274533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:43.274542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600986089037417:5288]
2025-10-10T14:32:43.274546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600986089037417:5288]
2025-10-10T14:32:43.274550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600986089037417:5288]
2025-10-10T14:32:43.274591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:43.274599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:43.274606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:43.274607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.274610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:43.274610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:43.274756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:43.275878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:43.331267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600986871248871:5983]
2025-10-10T14:32:43.331492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 693, pipe: [1:7559600986871248871:5983]
2025-10-10T14:32:43.379593Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:43.379817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.379831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.379870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871248871:5983], now have 1 active actors on pipe
2025-10-10T14:32:43.380034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:43.380132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:43.380139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600986871248871:5983]
2025-10-10T14:32:43.380160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:43.380230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 694 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0
2025-10-10T14:32:43.380428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 694 sessionId: src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0 is DEAD
2025-10-10T14:32:43.380593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:43.380604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0] Write session will restart in 0.006794s
2025-10-10T14:32:43.380630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0] Write session: Do CDS request
2025-10-10T14:32:43.380637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:43.388883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.388980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:43.388996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 695
2025-10-10T14:32:43.389152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.389189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:43.389200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:43.389206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:43.389638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 695 sessionId:  describe result for acl check
2025-10-10T14:32:43.389667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:43.389672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:43.389673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:43.389679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600986871248937:6527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:43.390144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600986871248937:6527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:43.392192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600986871248937:6527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:43.395031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600986871248937:6527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:43.395042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600986871248937:6527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:43.395045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600986871248937:6527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:43.395051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:43.396935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:43.399557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:43.399746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:43.399757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:43.399769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:43.399821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:43.399864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600986089037696:5290]
2025-10-10T14:32:43.400482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:43.400746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:43.400792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:43.401107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:43.401160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.401166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.401167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.401169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.401170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.401171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.401172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.401173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.401175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.401176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.401177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.401178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.401179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.401185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.401199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.401203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.401207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.401211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.401216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.401220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.401226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.401230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.401234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.401243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.401246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.401255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.401262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.401275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.401285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.401292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.401301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.401306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.401314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.401319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.401325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.401344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.401352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.401355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.401358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.401361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.401363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.401366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.401371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.401376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.401380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.401385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.401389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.401395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.401399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.401402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.401409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.401412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.401434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:43.403582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:43.403912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:43.403925Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:43.403927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:43.403931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:43.403937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 694 [2:7559600986089037696:5290]
2025-10-10T14:32:43.403949Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:43.403971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:43.403981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.403985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.403987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.404003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:43.404010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:43.404019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:43.404069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.404074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.404076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.404078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:43.404135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:43.404140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.404152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.404168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.404190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:43.404217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871248872:2438], now have 1 active actors on pipe
2025-10-10T14:32:43.404225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249126:6527], now have 1 active actors on pipe
2025-10-10T14:32:43.404232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600986089037691:5290]
2025-10-10T14:32:43.404238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600986089037691:5290]
2025-10-10T14:32:43.404240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600986089037691:5290]
2025-10-10T14:32:43.404255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:43.404271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:43.404273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:43.404280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:43.404262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 694
2025-10-10T14:32:43.404282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:43.404286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:43.404266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 694
2025-10-10T14:32:43.404289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:43.404324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.404335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.404349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600986089037691:5290]
2025-10-10T14:32:43.404356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:43.404361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:43.404379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:43.404389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.404392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.404393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:43.404402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.404410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:43.404430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.404586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.404594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.404607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.404687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 695 partition: 0 MaxSeqNo: 40 sessionId: src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0
2025-10-10T14:32:43.405093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8430b60-8cdf762-66ee43e4-2c0691b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:43.407596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0] Write session: try to update token
2025-10-10T14:32:43.407612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:43.420703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId: src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:43.422958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:43.422976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:43.422979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:43.422981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:43.422991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600986089037691:5290]
2025-10-10T14:32:43.422996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600986089037691:5290]
2025-10-10T14:32:43.423000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600986089037691:5290]
2025-10-10T14:32:43.423042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:43.423048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:43.423054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:43.423055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.423057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:43.423058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:43.423202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:43.423266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:43.480258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600986871249149:5983]
2025-10-10T14:32:43.480513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 694, pipe: [1:7559600986871249149:5983]
2025-10-10T14:32:43.530978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:43.531268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.531285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.531326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249149:5983], now have 1 active actors on pipe
2025-10-10T14:32:43.531496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:43.531540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:43.531566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600986871249149:5983]
2025-10-10T14:32:43.531597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:43.531600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:43.531674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 695 reason: error at write: Disconnected sessionId: src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0
2025-10-10T14:32:43.531904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 695 sessionId: src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0 is DEAD
2025-10-10T14:32:43.532085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:43.532096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0] Write session will restart in 0.007199s
2025-10-10T14:32:43.532122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0] Write session: Do CDS request
2025-10-10T14:32:43.532128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:43.540912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.540994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:43.541010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 696
2025-10-10T14:32:43.541138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.541171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:43.541183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:43.541187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:43.541647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 696 sessionId:  describe result for acl check
2025-10-10T14:32:43.541679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:43.541685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:43.541686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:43.541692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600986871249219:6531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:43.542233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600986871249219:6531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:43.544911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600986871249219:6531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:43.547809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600986871249219:6531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:43.547823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600986871249219:6531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:43.547827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600986871249219:6531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:43.547836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:43.549827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:43.552139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:43.552337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:43.552347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:43.552359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:43.552408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:43.552455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600986089037972:5292]
2025-10-10T14:32:43.553065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:43.553303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:43.553359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:43.553627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:43.553667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.553672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.553673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.553673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.553674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.553674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.553675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.553676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.553676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.553677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.553678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.553678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.553679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.553683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.553691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.553693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.553695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.553697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.553700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.553702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.553704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.553706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.553708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.553710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.553712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.553714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.553721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.553727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.553732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.553735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.553738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.553741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.553743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.553747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.553749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.553752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.553755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.553759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.553765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.553769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.553771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.553775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.553777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.553781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.553787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.553790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.553793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.553801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.553803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.553807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.553815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.553825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.553858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:43.556076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:43.556691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:43.556706Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:43.556708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:43.556712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:43.556717Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 695 [2:7559600986089037972:5292]
2025-10-10T14:32:43.556729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:43.556744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:43.556751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.556753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.556755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.556766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:43.556777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:43.556786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:43.556843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.556851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.556853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.556855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:43.556916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:43.556924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.556935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.556953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.556975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:43.557000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249150:2438], now have 1 active actors on pipe
2025-10-10T14:32:43.557008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249413:6531], now have 1 active actors on pipe
2025-10-10T14:32:43.557015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600986089037967:5292]
2025-10-10T14:32:43.557018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600986089037967:5292]
2025-10-10T14:32:43.557020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600986089037967:5292]
2025-10-10T14:32:43.557032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:43.557044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:43.557047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:43.557049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:43.557055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:43.557071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:43.557074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:43.557060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 695
2025-10-10T14:32:43.557096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600986089037967:5292]
2025-10-10T14:32:43.557070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 695
2025-10-10T14:32:43.557105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:43.557108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:43.557187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.557197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.557225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:43.557239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.557246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.557248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:43.557260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.557274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:43.557292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.557458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.557469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.557486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.557570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 696 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0
2025-10-10T14:32:43.557942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9827876c-8fb68559-64aebf3e-9793b5e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:43.560582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0] Write session: try to update token
2025-10-10T14:32:43.560600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:43.574841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId: src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:43.575675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:43.575693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:43.575696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:43.575698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:43.575706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600986089037967:5292]
2025-10-10T14:32:43.575710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600986089037967:5292]
2025-10-10T14:32:43.575714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600986089037967:5292]
2025-10-10T14:32:43.575762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:43.575764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:43.575771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.575773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:43.575776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:43.575781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:43.575920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:43.577440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:43.631802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600986871249437:5983]
2025-10-10T14:32:43.632018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 695, pipe: [1:7559600986871249437:5983]
2025-10-10T14:32:43.680245Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:43.680571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.680584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.680622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249437:5983], now have 1 active actors on pipe
2025-10-10T14:32:43.680773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:43.680866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:43.680869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:43.680930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600986871249437:5983]
2025-10-10T14:32:43.680947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 696 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0
2025-10-10T14:32:43.681126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 696 sessionId: src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0 is DEAD
2025-10-10T14:32:43.681265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:43.681274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0] Write session will restart in 0.006519s
2025-10-10T14:32:43.681293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0] Write session: Do CDS request
2025-10-10T14:32:43.681299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:43.688857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.688889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:43.688899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 697
2025-10-10T14:32:43.689088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.689129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:43.689140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:43.689143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:43.689665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 697 sessionId:  describe result for acl check
2025-10-10T14:32:43.689699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:43.689705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:43.689707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:43.689713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600986871249488:6537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:43.690248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600986871249488:6537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:43.692631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600986871249488:6537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:43.695459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600986871249488:6537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:43.695470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600986871249488:6537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:43.695473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600986871249488:6537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:43.695479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:43.697527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:43.699915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:43.700117Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:43.700129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:43.700141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:43.700190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:43.700229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600986089038250:5295]
2025-10-10T14:32:43.700698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:43.700912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:43.700940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:43.701174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:43.701216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.701223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.701224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.701226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.701227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.701228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.701229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.701230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.701231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.701233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.701234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.701235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.701236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.701241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.701254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.701258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.701263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.701267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.701271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.701275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.701279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.701283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.701286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.701288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.701290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.701292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.701297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.701302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.701307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.701310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.701313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.701316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.701318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.701322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.701324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.701342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.701345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.701348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.701352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.701355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.701357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.701361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.701363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.701366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.701370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.701373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.701376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.701379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.701381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.701384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.701386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.701389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.701411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:43.703448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:43.703827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:43.703839Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:43.703841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:43.703844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:43.703850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 696 [2:7559600986089038250:5295]
2025-10-10T14:32:43.703861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:43.703878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:43.703884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.703886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.703888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.703900Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:43.703909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:43.703919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:43.703961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.703967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.703969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.703971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:43.704032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:43.704040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.704047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.704054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.704065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:43.704085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249439:2438], now have 1 active actors on pipe
2025-10-10T14:32:43.704099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600986089038245:5295]
2025-10-10T14:32:43.704105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600986089038245:5295]
2025-10-10T14:32:43.704107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600986089038245:5295]
2025-10-10T14:32:43.704119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:43.704129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:43.704131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249679:6537], now have 1 active actors on pipe
2025-10-10T14:32:43.704138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:43.704138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:43.704139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:43.704148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:43.704150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:43.704150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 696
2025-10-10T14:32:43.704167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600986089038245:5295]
2025-10-10T14:32:43.704160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 696
2025-10-10T14:32:43.704173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:43.704177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:43.704195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.704202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.704233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:43.704243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.704245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.704247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:43.704255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.704267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:43.704286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.704459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.704469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.704484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.704570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 697 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0
2025-10-10T14:32:43.704946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3b3d81-3ffb8b51-d3aa2474-49ab6a36_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:43.707427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0] Write session: try to update token
2025-10-10T14:32:43.707443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:43.720559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId: src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:43.722353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:43.722374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:43.722377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:43.722379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:43.722389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600986089038245:5295]
2025-10-10T14:32:43.722393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600986089038245:5295]
2025-10-10T14:32:43.722399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600986089038245:5295]
2025-10-10T14:32:43.722449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:43.722448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:43.722455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:43.722460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:43.722461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.722464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:43.722608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:43.723123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:43.781343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600986871249717:5983]
2025-10-10T14:32:43.781600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 696, pipe: [1:7559600986871249717:5983]
2025-10-10T14:32:43.829177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:43.829744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.829761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.829808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249717:5983], now have 1 active actors on pipe
2025-10-10T14:32:43.830027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:43.830018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:43.830033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600986871249717:5983]
2025-10-10T14:32:43.830069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:43.830072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:43.830134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 697 reason: error at write: Disconnected sessionId: src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0
2025-10-10T14:32:43.830360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 697 sessionId: src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0 is DEAD
2025-10-10T14:32:43.830503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:43.830513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0] Write session will restart in 0.008418s
2025-10-10T14:32:43.830532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0] Write session: Do CDS request
2025-10-10T14:32:43.830537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:43.839841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.839951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:43.839965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 698
2025-10-10T14:32:43.840094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.840130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:43.840140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:43.840149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:43.840574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 698 sessionId:  describe result for acl check
2025-10-10T14:32:43.840623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:43.840630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:43.840631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:43.840636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600986871249780:6541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:43.841089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600986871249780:6541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:43.843627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600986871249780:6541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:43.846068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600986871249780:6541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:43.846079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600986871249780:6541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:43.846082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600986871249780:6541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:43.846088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:43.848036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:43.850468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:43.850668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:43.850681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:43.850695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:43.850757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:43.850794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600986089038527:5297]
2025-10-10T14:32:43.851228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:43.851497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:43.851531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:43.851741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:43.851788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.851793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.851794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.851795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.851795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.851796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.851797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.851797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.851798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.851799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.851800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.851800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.851801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.851805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.851816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.851820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.851823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.851827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.851831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.851834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.851837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.851841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.851844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.851848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.851851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.851855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.851861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.851870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:43.851877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.851888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:43.851897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.851900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:43.851906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.851910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:43.851912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.851919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:43.851922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.851925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:43.851928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.851935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:43.851938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.851941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:43.851944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.851947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:43.851950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.851957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:43.851959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.851963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.851966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.851976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.851984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.851994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.852027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:43.854146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:43.854445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:43.854457Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:43.854459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:43.854463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:43.854469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 697 [2:7559600986089038527:5297]
2025-10-10T14:32:43.854484Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:43.854506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:43.854514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.854517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.854524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.854541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:43.854553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:43.854565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:43.854622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.854629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.854631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.854634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:43.854691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:43.854697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.854704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:43.854714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:43.854728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:43.854748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249960:6541], now have 1 active actors on pipe
2025-10-10T14:32:43.854754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249719:2438], now have 1 active actors on pipe
2025-10-10T14:32:43.854759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600986089038522:5297]
2025-10-10T14:32:43.854764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600986089038522:5297]
2025-10-10T14:32:43.854765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600986089038522:5297]
2025-10-10T14:32:43.854776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:43.854793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:43.854797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:43.854800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:43.854801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:43.854814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:43.854821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:43.854805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 697
2025-10-10T14:32:43.854822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 697
2025-10-10T14:32:43.854846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600986089038522:5297]
2025-10-10T14:32:43.854857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:43.854861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:43.854872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.854881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.854925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:43.854935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:43.854938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:43.854939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:43.854961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:43.854973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:43.854989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.855127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.855137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.855153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:43.855237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 698 partition: 0 MaxSeqNo: 40 sessionId: src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0
2025-10-10T14:32:43.855761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a1e1dd4-ad65d651-df3d3a64-1736acf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:43.858478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0] Write session: try to update token
2025-10-10T14:32:43.858496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:43.872022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId: src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:43.873055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:43.873075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:43.873079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:43.873081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:43.873090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600986089038522:5297]
2025-10-10T14:32:43.873094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600986089038522:5297]
2025-10-10T14:32:43.873098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600986089038522:5297]
2025-10-10T14:32:43.873145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:43.873160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:43.873163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:43.873277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:43.873289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:43.873292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:43.873297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:43.874716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:43.930326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600986871249998:5983]
2025-10-10T14:32:43.930595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 697, pipe: [1:7559600986871249998:5983]
2025-10-10T14:32:43.978444Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:43.979132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:43.979147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:43.979187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871249998:5983], now have 1 active actors on pipe
2025-10-10T14:32:43.979367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:43.979410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:43.979426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:43.979440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600986871249998:5983]
2025-10-10T14:32:43.979471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:43.979488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 698 reason: error at write: Disconnected sessionId: src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0
2025-10-10T14:32:43.979711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 698 sessionId: src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0 is DEAD
2025-10-10T14:32:43.979902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:43.979914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0] Write session will restart in 0.009545s
2025-10-10T14:32:43.979941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0] Write session: Do CDS request
2025-10-10T14:32:43.979951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:43.990852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.990935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:43.990950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 699
2025-10-10T14:32:43.991107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:43.991144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:43.991149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:43.991153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:43.991645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 699 sessionId:  describe result for acl check
2025-10-10T14:32:43.991685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:43.991691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:43.991694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:43.991702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600986871250107:6545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:43.992286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600986871250107:6545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:43.995572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600986871250107:6545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:43.997544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:44.000030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:44.000170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600986871250107:6545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:44.000183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600986871250107:6545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:44.000186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600986871250107:6545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:44.000194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:44.000233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:44.000245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:44.000256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:44.000309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:44.000349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600986089038804:5299]
2025-10-10T14:32:44.000925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:44.001172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:44.001213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:44.001507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:44.001562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.001568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.001569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.001570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.001571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.001573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.001574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.001575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.001575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.001576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.001577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.001577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.001578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.001581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.001594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.001597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.001601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.001605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.001609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.001613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.001618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.001622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.001626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.001630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.001637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.001641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.001653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.001666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.001674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.001680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.001684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.001690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.001698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.001704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.001713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.001722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.001731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.001736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.001742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.001752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.001760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.001766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.001775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.001780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.001784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.001790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.001794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.001804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.001808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.001813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.001818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.001823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.001859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:44.003982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:44.004567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:44.004580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:44.004582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:44.004586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:44.004592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 698 [2:7559600986089038804:5299]
2025-10-10T14:32:44.004604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:44.004626Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:44.004635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.004639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.004641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.004658Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:44.004666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:44.004678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:44.004736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.004743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.004745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.004748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:44.004811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:44.004819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.004831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.004847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.004868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:44.004892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871250269:6545], now have 1 active actors on pipe
2025-10-10T14:32:44.004896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600986871250000:2438], now have 1 active actors on pipe
2025-10-10T14:32:44.004903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600986089038799:5299]
2025-10-10T14:32:44.004910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600986089038799:5299]
2025-10-10T14:32:44.004912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600986089038799:5299]
2025-10-10T14:32:44.004925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:44.004940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:44.004943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:44.004951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:44.004952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:44.004959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:44.004962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:44.004941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 698
2025-10-10T14:32:44.004949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 698
2025-10-10T14:32:44.004984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600986089038799:5299]
2025-10-10T14:32:44.004996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:44.005001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:44.005020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.005029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.005082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:44.005094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.005101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.005104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:44.005115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.005129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:44.005149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.005276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.005283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.005297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.005407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 699 partition: 0 MaxSeqNo: 40 sessionId: src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0
2025-10-10T14:32:44.005806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9c2b8f7-8383d5ca-76002844-f8823cbe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:44.008458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0] Write session: try to update token
2025-10-10T14:32:44.008477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:44.021209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId: src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:44.023714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:44.023765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:44.023783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:44.023787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:44.023788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:44.023798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600986089038799:5299]
2025-10-10T14:32:44.023802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600986089038799:5299]
2025-10-10T14:32:44.023807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600986089038799:5299]
2025-10-10T14:32:44.023848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:44.023852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:44.023852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:44.023855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:44.023860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.023862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:44.023983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:44.079806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600991166217589:5983]
2025-10-10T14:32:44.080059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 698, pipe: [1:7559600991166217589:5983]
2025-10-10T14:32:44.131128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:44.131553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.131567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.131606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166217589:5983], now have 1 active actors on pipe
2025-10-10T14:32:44.131829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:44.131854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:44.131869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:44.131872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:44.131931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600991166217589:5983]
2025-10-10T14:32:44.131933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 699 reason: error at write: Disconnected sessionId: src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0
2025-10-10T14:32:44.132147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 699 sessionId: src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0 is DEAD
2025-10-10T14:32:44.132310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:44.132321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0] Write session will restart in 0.009822s
2025-10-10T14:32:44.132358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0] Write session: Do CDS request
2025-10-10T14:32:44.132364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:44.143911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.143984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:44.143998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 700
2025-10-10T14:32:44.144138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.144174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:44.144185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:44.144189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:44.144654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 700 sessionId:  describe result for acl check
2025-10-10T14:32:44.144686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:44.144690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:44.144691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:44.144696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600991166217705:6558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:44.145228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600991166217705:6558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:44.147829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600991166217705:6558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:44.149904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600991166217705:6558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:44.149919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600991166217705:6558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:44.149922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600991166217705:6558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:44.149938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:44.150301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:44.152757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:44.153074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:44.153085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:44.153095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:44.153143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:44.153177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600990384006417:5314]
2025-10-10T14:32:44.153755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:44.153971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:44.154014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:44.154329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:44.154383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.154388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.154389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.154391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.154392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.154392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.154394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.154395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.154396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.154397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.154398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.154399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.154400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.154405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.154419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.154423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.154427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.154431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.154436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.154440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.154444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.154448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.154454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.154458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.154461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.154465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.154472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.154481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.154488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.154494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.154498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.154504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.154509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.154519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.154528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.154532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.154541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.154545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.154549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.154556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.154567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.154572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.154583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.154589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.154598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.154607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.154618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.154624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.154632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.154639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.154648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.154657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.154702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:44.156852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:44.157362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:44.157373Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:44.157375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:44.157378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:44.157384Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 699 [2:7559600990384006417:5314]
2025-10-10T14:32:44.157396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:44.157418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:44.157425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.157428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.157431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.157447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:44.157458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:44.157469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:44.157524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.157531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.157533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.157535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:44.157600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:44.157608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.157619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.157632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.157654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:44.157679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166217601:2438], now have 1 active actors on pipe
2025-10-10T14:32:44.157691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166217871:6558], now have 1 active actors on pipe
2025-10-10T14:32:44.157698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600990384006412:5314]
2025-10-10T14:32:44.157701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600990384006412:5314]
2025-10-10T14:32:44.157703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600990384006412:5314]
2025-10-10T14:32:44.157718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:44.157730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:44.157740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:44.157743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:44.157746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:44.157730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 699
2025-10-10T14:32:44.157730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 699
2025-10-10T14:32:44.157751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:44.157758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:44.157780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600990384006412:5314]
2025-10-10T14:32:44.157787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:44.157798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:44.157808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.157813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.157858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:44.157871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.157874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.157876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:44.157890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.157904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:44.157926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.158069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.158080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.158097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.158194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 700 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0
2025-10-10T14:32:44.158609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f99483a3-6de46f0a-a2b8002f-f55873b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:44.161382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0] Write session: try to update token
2025-10-10T14:32:44.161401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:44.175114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId: src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:44.176733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:44.176755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:44.176758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:44.176760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:44.176769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600990384006412:5314]
2025-10-10T14:32:44.176774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600990384006412:5314]
2025-10-10T14:32:44.176777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600990384006412:5314]
2025-10-10T14:32:44.176815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:44.176825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:44.176829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:44.176833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.176833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:44.176836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:44.176998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:44.177719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:44.231877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600991166217895:5983]
2025-10-10T14:32:44.232134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 699, pipe: [1:7559600991166217895:5983]
2025-10-10T14:32:44.283987Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:44.284477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.284495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.284537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166217895:5983], now have 1 active actors on pipe
2025-10-10T14:32:44.284767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:44.284818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:44.284820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:44.284885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600991166217895:5983]
2025-10-10T14:32:44.284913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 700 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0
2025-10-10T14:32:44.285157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 700 sessionId: src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0 is DEAD
2025-10-10T14:32:44.285324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:44.285350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0] Write session will restart in 0.005086s
2025-10-10T14:32:44.285377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0] Write session: Do CDS request
2025-10-10T14:32:44.285384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:44.291893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.292009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:44.292025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 701
2025-10-10T14:32:44.292141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.292180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:44.292186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:44.292190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:44.292582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 701 sessionId:  describe result for acl check
2025-10-10T14:32:44.292616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:44.292621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:44.292623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:44.292627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600991166217916:6563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:44.293061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600991166217916:6563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:44.296131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600991166217916:6563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:44.299659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600991166217916:6563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:44.299675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600991166217916:6563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:44.299679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600991166217916:6563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:44.299688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:44.304379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:44.307435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:44.307837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:44.307847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:44.307857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:44.307906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:44.307942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600990384006709:5317]
2025-10-10T14:32:44.308368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:44.308635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:44.308675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:44.308930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:44.308975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.308981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.308982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.308982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.308983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.308984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.308985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.308985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.308986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.308987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.308987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.308988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.308989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.308993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.309001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.309004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.309006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.309008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.309011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.309013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.309016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.309018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.309022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.309024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.309027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.309029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.309037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.309046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.309052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.309059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.309064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.309074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.309081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.309091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.309104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.309109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.309113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.309123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.309133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.309141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.309144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.309151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.309154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.309158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.309164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.309167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.309170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.309173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.309176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.309179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.309182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.309185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.309220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:44.311641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:44.312243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:44.312260Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:44.312263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:44.312266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:44.312272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 700 [2:7559600990384006709:5317]
2025-10-10T14:32:44.312285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:44.312303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:44.312311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.312314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.312316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.312332Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:44.312344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:44.312352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:44.312418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.312428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.312430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.312432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:44.312496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:44.312504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.312515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.312530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.312545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:44.312572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218083:6563], now have 1 active actors on pipe
2025-10-10T14:32:44.312576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166217896:2438], now have 1 active actors on pipe
2025-10-10T14:32:44.312584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600990384006704:5317]
2025-10-10T14:32:44.312586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600990384006704:5317]
2025-10-10T14:32:44.312588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600990384006704:5317]
2025-10-10T14:32:44.312601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:44.312613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:44.312616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:44.312618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:44.312619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:44.312634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:44.312637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:44.312661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600990384006704:5317]
2025-10-10T14:32:44.312669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:44.312672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:44.312671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 700
2025-10-10T14:32:44.312676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 700
2025-10-10T14:32:44.312716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.312727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.312761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:44.312774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.312783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.312786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:44.312798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.312814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:44.312836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.313007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.313021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.313148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 701 partition: 0 MaxSeqNo: 40 sessionId: src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0
2025-10-10T14:32:44.313040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.313559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9343ea-9d712436-fd9ca38c-ab60f8c1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:44.316282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0] Write session: try to update token
2025-10-10T14:32:44.316299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:44.324225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:44.324251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:44.324260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600990384006704:5317]
2025-10-10T14:32:44.324293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:44.324302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:44.324460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:44.324587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:44.324709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:44.324830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:44.325033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:44.325069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:44.329946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId: src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:44.332463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:44.332718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.332745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.332788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:44.332891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:44.341762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:44.341785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:44.341787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:44.341790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:44.341800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600990384006704:5317]
2025-10-10T14:32:44.341804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600990384006704:5317]
2025-10-10T14:32:44.341808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600990384006704:5317]
2025-10-10T14:32:44.341847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:44.341849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:44.341857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.341858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:44.341859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:44.341861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:44.342025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:44.384942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600991166218179:5983]
2025-10-10T14:32:44.385237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 700, pipe: [1:7559600991166218179:5983]
2025-10-10T14:32:44.449741Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:44.456423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.456451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.456620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.456679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.456737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.456795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.456836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.456844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.456907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.456966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.457024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.457083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.457126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.457131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.457189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.457246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.457301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.457386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.457430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.457435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.457499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.457563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.457622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.457693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.457748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.457756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.457829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.457890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.457978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.458037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.458081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.458086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.458147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.458216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.458278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.458351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.458394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.458402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.458461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.458537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.458606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.458667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.458708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.458715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.458777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.458833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.458892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.458954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.459024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.459029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.459087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.459143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.459198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.459255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.459295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.459300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.459375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:44.459430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:44.459489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:44.459542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:44.459582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:44.459587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:44.459626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218179:5983], now have 1 active actors on pipe
2025-10-10T14:32:44.459899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600991166218179:5983]
2025-10-10T14:32:44.459914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:44.459918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:44.459934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:44.459954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 701 reason: error at write: Disconnected sessionId: src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0
2025-10-10T14:32:44.459984Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:32:44.460080Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 7 consumer shared/user session shared/user_1_7_5079797391769373891_v1 is DEAD
2025-10-10T14:32:44.460187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 701 sessionId: src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0 is DEAD
2025-10-10T14:32:44.460316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:44.460326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0] Write session will restart in 0.005450s
2025-10-10T14:32:44.460349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0] Write session: Do CDS request
2025-10-10T14:32:44.460354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:44.460320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:44.460435Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:32:44.460506Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600926741684630:5979] disconnected; active server actors: 1
2025-10-10T14:32:44.460517Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600926741684630:5979] client user disconnected session shared/user_1_7_5079797391769373891_v1
2025-10-10T14:32:44.460590Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:44.460596Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:44.460602Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009336s
2025-10-10T14:32:44.466846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.466969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:44.466986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 702
2025-10-10T14:32:44.467144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.467187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:44.467200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:44.467205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:44.467645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 702 sessionId:  describe result for acl check
2025-10-10T14:32:44.467688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:44.467695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:44.467697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:44.467703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600991166218205:6567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:44.468267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600991166218205:6567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:44.470689Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:32:44.470861Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:32:44.470872Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 8
2025-10-10T14:32:44.471064Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:44.471121Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:44.471206Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 auth for : user
2025-10-10T14:32:44.471382Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 Handle describe topics response
2025-10-10T14:32:44.471410Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 auth is DEAD
2025-10-10T14:32:44.471430Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:32:44.471713Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:32:44.471793Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_8_9837470934020682204_v1
2025-10-10T14:32:44.471842Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600991166218296:6571] connected; active server actors: 1
2025-10-10T14:32:44.471859Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559600991166218296:6571] session shared/user_1_8_9837470934020682204_v1
2025-10-10T14:32:44.471870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:32:44.471882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:32:44.471894Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_8_9837470934020682204_v1" (Sender=[1:7559600991166218276:6571], Pipe=[1:7559600991166218296:6571], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:44.471902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:44.471914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:32:44.471914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600991166218205:6567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:44.471927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_8_9837470934020682204_v1" (Sender=[1:7559600991166218276:6571], Pipe=[1:7559600991166218296:6571], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:44.471937Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_8_9837470934020682204_v1" sender [1:7559600991166218276:6571] lock partition 0 for ReadingSession "shared/user_1_8_9837470934020682204_v1" (Sender=[1:7559600991166218276:6571], Pipe=[1:7559600991166218296:6571], Partitions=[], ActiveFamilyCount=1) generation 1 step 8
2025-10-10T14:32:44.471945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:32:44.471949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000027s
2025-10-10T14:32:44.472151Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_8_9837470934020682204_v1" ClientId: "user" PipeClient { RawX1: 7559600991166218296 RawX2: 4503603922344363 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:32:44.472174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:32:44.475089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600991166218205:6567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:44.475102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600991166218205:6567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:44.475105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600991166218205:6567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:44.475113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:44.477995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:44.480450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:44.480622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:44.480633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:44.480642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:44.480695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:44.480729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600990384006991:5319]
2025-10-10T14:32:44.481208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:44.481469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:44.481510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:44.481821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:44.481868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.481874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.481875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.481876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.481877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.481879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.481880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.481881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.481882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.481884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.481885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.481886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.481887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.481893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.481906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.481911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.481915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.481919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.481923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.481931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.481935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.481943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.481948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.481956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.481960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.481968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.481975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.481985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.481993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.481997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.482001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.482004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.482007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.482013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.482016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.482019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.482026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.482031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.482040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.482045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.482050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.482058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.482061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.482068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.482070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.482075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.482083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.482087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.482095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.482100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.482107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.482112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.482145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:44.484285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:44.484722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:44.484736Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:44.484738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:44.484741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:44.484747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 701 [2:7559600990384006991:5319]
2025-10-10T14:32:44.484758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:44.484775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:44.484782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.484786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.484788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.484803Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:44.484815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:44.484827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:44.484880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.484887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.484889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.484891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:44.484951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:44.484959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.484970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.484983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.485005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:44.485029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218311:6574], now have 1 active actors on pipe
2025-10-10T14:32:44.485037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218407:6567], now have 1 active actors on pipe
2025-10-10T14:32:44.485039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218180:2438], now have 1 active actors on pipe
2025-10-10T14:32:44.485046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600990384006986:5319]
2025-10-10T14:32:44.485048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600990384006986:5319]
2025-10-10T14:32:44.485050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600990384006986:5319]
2025-10-10T14:32:44.485063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:44.485073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:44.485078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:44.485081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:44.485082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:44.485094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:44.485097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:44.485083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 701
2025-10-10T14:32:44.485087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 701, pipe: [1:7559600991166218311:6574]
2025-10-10T14:32:44.485111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 701
2025-10-10T14:32:44.485117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600990384006986:5319]
2025-10-10T14:32:44.485125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:44.485126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:44.485142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.485147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.485165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_8_9837470934020682204_v1 on pipe: [1:7559600991166218311:6574]
2025-10-10T14:32:44.485184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.485190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.485195Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_8_9837470934020682204_v1:1 with generation 701
2025-10-10T14:32:44.485220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.485229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.485235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:44.485252Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_8_9837470934020682204_v1
2025-10-10T14:32:44.485259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.485292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:44.485303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:32:44.485315Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:32:44.489657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:32:44.489681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:32:44.489689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.489699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.489705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:44.489718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.489734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:44.489745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:32:44.489757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:32:44.489777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.489922Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106764484 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:32:44.489944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:32:44.489988Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 sending to client partition status
2025-10-10T14:32:44.490001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.490012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.490030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.490129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 702 partition: 0 MaxSeqNo: 40 sessionId: src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0
2025-10-10T14:32:44.490409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|145daa1f-2abd69bc-a69186d8-d56d3890_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:44.492848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0] Write session: try to update token
2025-10-10T14:32:44.492860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:44.503296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:44.503316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:44.503319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:44.503321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:44.503331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600990384006986:5319]
2025-10-10T14:32:44.503336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600990384006986:5319]
2025-10-10T14:32:44.503340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600990384006986:5319]
2025-10-10T14:32:44.503385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:44.503386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:44.503393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.503395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:44.503396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:44.503399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:44.503527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:44.505644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId: src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:44.508034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:44.608355Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:44.608778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.608793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.609018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_8_9837470934020682204_v1
2025-10-10T14:32:44.609039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:44.609075Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_8_9837470934020682204_v1
2025-10-10T14:32:44.609065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:44.609081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:44.609084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:44.609134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600991166218311:6574]
2025-10-10T14:32:44.609144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 702 reason: error at write: Disconnected sessionId: src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0
2025-10-10T14:32:44.609370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 702 sessionId: src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0 is DEAD
2025-10-10T14:32:44.609585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:44.609597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0] Write session will restart in 0.007877s
2025-10-10T14:32:44.609624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0] Write session: Do CDS request
2025-10-10T14:32:44.609631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:44.618879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.618980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:44.618998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 703
2025-10-10T14:32:44.619172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.619216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:44.619221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:44.619225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:44.619718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 703 sessionId:  describe result for acl check
2025-10-10T14:32:44.619757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:44.619772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:44.619774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:44.619780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600991166218526:6577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:44.620329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600991166218526:6577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:44.623126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600991166218526:6577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:44.626529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600991166218526:6577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:44.626551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600991166218526:6577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:44.626555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600991166218526:6577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:44.626562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:44.628606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:44.631275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:44.631426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:44.631435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:44.631443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:44.631481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:44.631510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600990384007278:5322]
2025-10-10T14:32:44.631961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:44.632221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:44.632253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:44.632467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:44.632503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.632508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.632508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.632509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.632510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.632510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.632511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.632512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.632512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.632513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.632514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.632514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.632515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.632519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.632526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.632528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.632531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.632533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.632536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.632538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.632540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.632542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.632545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.632547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.632549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.632551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.632556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.632561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.632565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.632568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.632571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.632574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.632577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.632580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.632582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.632585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.632588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.632591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.632594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.632597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.632600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.632603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.632606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.632609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.632612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.632615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.632619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.632622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.632625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.632628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.632631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.632634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.632656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:44.634737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:44.635225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:44.635233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:44.635234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:44.635237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:44.635241Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 702 [2:7559600990384007278:5322]
2025-10-10T14:32:44.635250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:44.635261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:44.635263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.635264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.635266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.635279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:44.635284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:44.635290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:44.635327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.635333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.635334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.635336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:44.635383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:44.635390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.635397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.635407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.635440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:44.635465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218746:6577], now have 1 active actors on pipe
2025-10-10T14:32:44.635468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218485:2438], now have 1 active actors on pipe
2025-10-10T14:32:44.635476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600990384007273:5322]
2025-10-10T14:32:44.635483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600990384007273:5322]
2025-10-10T14:32:44.635485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600990384007273:5322]
2025-10-10T14:32:44.635497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:44.635505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:44.635508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:44.635509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:44.635513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:44.635527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:44.635534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:44.635518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 702
2025-10-10T14:32:44.635521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 702
2025-10-10T14:32:44.635561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600990384007273:5322]
2025-10-10T14:32:44.635569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:44.635574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:44.635581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.635588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.635625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:44.635635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.635638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.635640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:44.635647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.635655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:44.635670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.635824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.635833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.635848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.635940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 703 partition: 0 MaxSeqNo: 40 sessionId: src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0
2025-10-10T14:32:44.636319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5eacf26-735becad-5cb573c1-4ab328f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:44.638908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0] Write session: try to update token
2025-10-10T14:32:44.638924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:44.652090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId: src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:44.654664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:44.654893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.654916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.654942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:44.654952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:44.654955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:44.654971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:44.654986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600990384007273:5322]
2025-10-10T14:32:44.654996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600990384007273:5322]
2025-10-10T14:32:44.655002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600990384007273:5322]
2025-10-10T14:32:44.655052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:44.655064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:44.655069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:44.655072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:44.655079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.655087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:44.655221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:44.709069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600991166218773:6574]
2025-10-10T14:32:44.709323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 702, pipe: [1:7559600991166218773:6574]
2025-10-10T14:32:44.760651Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:44.761197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:44.761247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218773:6574], now have 1 active actors on pipe
2025-10-10T14:32:44.761321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:44.761489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600991166218773:6574]
2025-10-10T14:32:44.761532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:44.772522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:44.772536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:44.772562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 703 reason: error at write: Disconnected sessionId: src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0
2025-10-10T14:32:44.772739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 703 sessionId: src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0 is DEAD
2025-10-10T14:32:44.772902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:44.772915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0] Write session will restart in 0.005096s
2025-10-10T14:32:44.772940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0] Write session: Do CDS request
2025-10-10T14:32:44.772956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:44.778779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.778910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:44.778924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 704
2025-10-10T14:32:44.779048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.779084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:44.779096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:44.779100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:44.779467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 704 sessionId:  describe result for acl check
2025-10-10T14:32:44.779502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:44.779506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:44.779508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:44.779515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600991166218965:6581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:44.779940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600991166218965:6581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:44.782376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600991166218965:6581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:44.785000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:44.785158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600991166218965:6581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:44.785169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600991166218965:6581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:44.785172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600991166218965:6581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:44.785177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:44.785403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:44.785571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:44.785582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:44.785594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:44.785647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:44.785687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600990384007560:5324]
2025-10-10T14:32:44.786230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:44.786511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:44.786553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:44.786783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:44.786826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.786831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.786832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.786832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.786833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.786834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.786835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.786835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.786836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.786836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.786837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.786838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.786838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.786842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.786850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.786852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.786855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.786859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.786863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.786867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.786871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.786874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.786881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.786888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.786891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.786893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.786898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.786904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.786909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.786913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.786915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.786918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.786921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.786925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.786929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.786932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.786935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.786940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.786942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.786945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.786951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.786954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.786957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.786971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.786977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.786980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.786983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.786986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.786988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.786991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.786994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.786997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.787019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:44.789157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:44.789645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:44.789656Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:44.789658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:44.789662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:44.789667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 703 [2:7559600990384007560:5324]
2025-10-10T14:32:44.789680Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:44.789695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:44.789704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.789708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.789711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.789727Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:44.789734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:44.789740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:44.789796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.789802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.789804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.789807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:44.789865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:44.789872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.789883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.789898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.789918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:44.789942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166218774:2438], now have 1 active actors on pipe
2025-10-10T14:32:44.789950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166219048:6581], now have 1 active actors on pipe
2025-10-10T14:32:44.789957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600990384007554:5324]
2025-10-10T14:32:44.789959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600990384007554:5324]
2025-10-10T14:32:44.789961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600990384007554:5324]
2025-10-10T14:32:44.789973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:44.789983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:44.789988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:44.789991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 703
2025-10-10T14:32:44.789992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:44.790010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 703
2025-10-10T14:32:44.789994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:44.790002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:44.790005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:44.790024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600990384007554:5324]
2025-10-10T14:32:44.790027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:44.790029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:44.790051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.790056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.790093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:44.790105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.790109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.790116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:44.790127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.790141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:44.790164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.790319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.790327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.790342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.790448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 704 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0
2025-10-10T14:32:44.790776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e826c2d7-6a4e9091-37afeb8e-2bcf943d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:44.793476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0] Write session: try to update token
2025-10-10T14:32:44.793494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:44.806464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId: src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:44.808432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:44.808449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:44.808453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:44.808455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:44.808465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600990384007554:5324]
2025-10-10T14:32:44.808470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600990384007554:5324]
2025-10-10T14:32:44.808474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600990384007554:5324]
2025-10-10T14:32:44.808514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:44.808519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:44.808521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:44.808523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:44.808529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.808531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:44.808664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:44.808992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:44.861657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600991166219060:6574]
2025-10-10T14:32:44.861958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 703, pipe: [1:7559600991166219060:6574]
2025-10-10T14:32:44.920887Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:44.921256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.921268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.921308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166219060:6574], now have 1 active actors on pipe
2025-10-10T14:32:44.921488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:44.921614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:44.921614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600991166219060:6574]
2025-10-10T14:32:44.921626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:44.921636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:44.921683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 704 reason: error at write: Disconnected sessionId: src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0
2025-10-10T14:32:44.921890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 704 sessionId: src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0 is DEAD
2025-10-10T14:32:44.922057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:44.922068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0] Write session will restart in 0.008975s
2025-10-10T14:32:44.922094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0] Write session: Do CDS request
2025-10-10T14:32:44.922104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:44.931872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.931945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:44.931960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 705
2025-10-10T14:32:44.932100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:44.932137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:44.932151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:44.932154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:44.932556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 705 sessionId:  describe result for acl check
2025-10-10T14:32:44.932587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:44.932592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:44.932594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:44.932598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600991166219145:6585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:44.933018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600991166219145:6585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:44.935577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600991166219145:6585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:44.937845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600991166219145:6585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:44.937857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600991166219145:6585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:44.937860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600991166219145:6585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:44.937865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:44.938985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:44.941128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:44.941280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:44.941288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:44.941297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:44.941351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:44.941390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600990384007844:5326]
2025-10-10T14:32:44.941787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:44.942035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:44.942069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:44.942271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:44.942308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.942312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.942313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.942314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.942314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.942315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.942316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.942316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.942317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.942317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.942318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.942319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.942319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.942323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.942332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.942334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.942336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.942339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.942341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.942343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.942346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.942348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.942350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.942352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.942355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.942357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.942362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.942367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:44.942372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.942375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:44.942379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.942382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:44.942385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.942388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:44.942391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.942394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:44.942396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.942400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:44.942402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.942407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:44.942411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.942416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:44.942420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.942425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:44.942429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.942434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:44.942443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.942446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.942453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.942456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.942458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.942462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.942483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:44.944518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:44.944980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:44.944991Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:44.944993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:44.944996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:44.945002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 704 [2:7559600990384007844:5326]
2025-10-10T14:32:44.945013Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:44.945029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:44.945036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.945040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.945041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.945054Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:44.945063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:44.945069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:44.945108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.945113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.945114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.945116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:44.945174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:44.945184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.945193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:44.945203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:44.945219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:44.945243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166219333:6585], now have 1 active actors on pipe
2025-10-10T14:32:44.945251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600991166219061:2438], now have 1 active actors on pipe
2025-10-10T14:32:44.945258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600990384007839:5326]
2025-10-10T14:32:44.945263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600990384007839:5326]
2025-10-10T14:32:44.945264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600990384007839:5326]
2025-10-10T14:32:44.945276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:44.945292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:44.945293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:44.945295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:44.945296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:44.945312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:44.945318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:44.945316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 704
2025-10-10T14:32:44.945326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 704
2025-10-10T14:32:44.945355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600990384007839:5326]
2025-10-10T14:32:44.945362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:44.945364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:44.945384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.945393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.945478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:44.945492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:44.945495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:44.945497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:44.945505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:44.945514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:44.945540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.945701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:44.945710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:44.945725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:44.945811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 705 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0
2025-10-10T14:32:44.946158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d46b11e-13d3a0d3-8faed5ef-d98589e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:44.948756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0] Write session: try to update token
2025-10-10T14:32:44.948774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:44.967284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId: src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:44.968061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:44.968082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:44.968085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:44.968087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:44.968098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600990384007839:5326]
2025-10-10T14:32:44.968105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600990384007839:5326]
2025-10-10T14:32:44.968108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600990384007839:5326]
2025-10-10T14:32:44.968162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:44.968175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:44.968176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:44.968307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:44.968605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:44.968617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:44.968622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:44.969781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:45.021893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600995461186648:6574]
2025-10-10T14:32:45.022154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 704, pipe: [1:7559600995461186648:6574]
2025-10-10T14:32:45.073166Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:45.073773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.073787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.073827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461186648:6574], now have 1 active actors on pipe
2025-10-10T14:32:45.074071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:45.074071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600995461186648:6574]
2025-10-10T14:32:45.074082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:45.074087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:45.074101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:45.074152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 705 reason: error at write: Disconnected sessionId: src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0
2025-10-10T14:32:45.074374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 705 sessionId: src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0 is DEAD
2025-10-10T14:32:45.074527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:45.074541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0] Write session will restart in 0.008349s
2025-10-10T14:32:45.074564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0] Write session: Do CDS request
2025-10-10T14:32:45.074571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:45.083867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.084036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:45.084052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 706
2025-10-10T14:32:45.084194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.084232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:45.084242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:45.084246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:45.084681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 706 sessionId:  describe result for acl check
2025-10-10T14:32:45.084713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:45.084714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:45.084716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:45.084720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600995461186688:6589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:45.085269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600995461186688:6589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:45.088311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600995461186688:6589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:45.091374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600995461186688:6589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:45.091387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600995461186688:6589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:45.091389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600995461186688:6589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:45.091395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:45.093783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:45.094353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:45.094542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:45.094552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:45.094561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:45.094610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:45.094650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600994678975425:5328]
2025-10-10T14:32:45.095073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:45.097814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:45.097860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:45.098125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:45.098164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.098168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.098169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.098170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.098170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.098171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.098172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.098172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.098173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.098174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.098174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.098175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.098175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.098181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.098190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.098192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.098195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.098197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.098200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.098202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.098204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.098206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.098209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.098212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.098214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.098216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.098223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.098229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.098234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.098237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.098240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.098243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.098245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.098249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.098252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.098255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.098257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.098260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.098265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.098267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.098270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.098273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.098275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.098278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.098281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.098284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.098287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.098290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.098292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.098295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.098298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.098303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.098325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:45.100562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:45.101167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:45.101176Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:45.101178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:45.101181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:45.101186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 705 [2:7559600994678975425:5328]
2025-10-10T14:32:45.101195Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:45.101212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:45.101220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.101223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.101227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.101243Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:45.101257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:45.101268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:45.101319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.101324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.101325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.101349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:45.101413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:45.101419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.101429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.101444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.101464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:45.101490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461186649:2438], now have 1 active actors on pipe
2025-10-10T14:32:45.101498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461186882:6589], now have 1 active actors on pipe
2025-10-10T14:32:45.101506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600994678975420:5328]
2025-10-10T14:32:45.101514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600994678975420:5328]
2025-10-10T14:32:45.101515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600994678975420:5328]
2025-10-10T14:32:45.101533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:45.101548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:45.101564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:45.101573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:45.101580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:45.101584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:45.101586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:45.101546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 705
2025-10-10T14:32:45.101551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 705
2025-10-10T14:32:45.101601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600994678975420:5328]
2025-10-10T14:32:45.101609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:45.101620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:45.101640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.101650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.101692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:45.101702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.101705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.101707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:45.101720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.101736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:45.101759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.101912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.101919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.101934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.102018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 706 partition: 0 MaxSeqNo: 40 sessionId: src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0
2025-10-10T14:32:45.102429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea584a8e-9ba814b2-47a74cc3-2ef0c1f5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:45.105135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0] Write session: try to update token
2025-10-10T14:32:45.105151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:45.119321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId: src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:45.120192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:45.120204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:45.120206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:45.120207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:45.120214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600994678975420:5328]
2025-10-10T14:32:45.120218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600994678975420:5328]
2025-10-10T14:32:45.120220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600994678975420:5328]
2025-10-10T14:32:45.120259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:45.120268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.120274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:45.120278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:45.120284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:45.120289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:45.120403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:45.121868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:45.174633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600995461186964:6574]
2025-10-10T14:32:45.174927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 705, pipe: [1:7559600995461186964:6574]
2025-10-10T14:32:45.227705Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:45.228172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.228185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.228221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461186964:6574], now have 1 active actors on pipe
2025-10-10T14:32:45.228384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:45.228393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:45.228395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:45.228398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:45.228434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600995461186964:6574]
2025-10-10T14:32:45.228446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 706 reason: error at write: Disconnected sessionId: src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0
2025-10-10T14:32:45.228640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 706 sessionId: src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0 is DEAD
2025-10-10T14:32:45.228793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:45.228806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0] Write session will restart in 0.007841s
2025-10-10T14:32:45.228831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0] Write session: Do CDS request
2025-10-10T14:32:45.228837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:45.237839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.237879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:45.237891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 707
2025-10-10T14:32:45.238053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.238095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:45.238104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:45.238107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:45.238579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 707 sessionId:  describe result for acl check
2025-10-10T14:32:45.238615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:45.238622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:45.238624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:45.238629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600995461187040:6603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:45.239125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600995461187040:6603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:45.241344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600995461187040:6603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:45.243732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600995461187040:6603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:45.243743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600995461187040:6603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:45.243746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600995461187040:6603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:45.243753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:45.245408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:45.248084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:45.248257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:45.248265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:45.248274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:45.248315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:45.248344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600994678975760:5344]
2025-10-10T14:32:45.248723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:45.249011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:45.249038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:45.249236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:45.249274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.249278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.249279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.249280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.249280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.249281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.249281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.249282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.249283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.249283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.249284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.249284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.249285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.249289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.249297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.249300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.249302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.249304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.249308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.249312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.249315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.249319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.249323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.249327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.249345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.249349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.249356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.249364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.249370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.249375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.249384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.249390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.249399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.249404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.249413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.249418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.249424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.249427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.249431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.249434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.249437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.249440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.249444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.249447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.249450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.249456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.249459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.249462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.249465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.249468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.249471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.249474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.249499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:45.251764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:45.252328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:45.252338Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:45.252339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:45.252342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:45.252347Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 706 [2:7559600994678975760:5344]
2025-10-10T14:32:45.252354Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:45.252367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:45.252372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.252374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.252376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.252388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:45.252397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:45.252404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:45.252446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.252451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.252452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.252454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:45.252497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:45.252503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.252510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.252516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.252529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:45.252546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600994678975755:5344]
2025-10-10T14:32:45.252551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600994678975755:5344]
2025-10-10T14:32:45.252553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600994678975755:5344]
2025-10-10T14:32:45.252560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:45.252566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:45.252569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:45.252570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:45.252573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461186977:2438], now have 1 active actors on pipe
2025-10-10T14:32:45.252576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187222:6603], now have 1 active actors on pipe
2025-10-10T14:32:45.252582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:45.252593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:45.252598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:45.252614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600994678975755:5344]
2025-10-10T14:32:45.252622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:45.252638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 706
2025-10-10T14:32:45.252646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:45.252694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 706
2025-10-10T14:32:45.252729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.252737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.252761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12d0c327-5cd485bf-4b599250-f7c93562_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:45.252770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.252774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.252777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:45.252785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.252795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:45.252806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.252975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.252980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.252990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.253080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 707 partition: 0 MaxSeqNo: 40 sessionId: src_id|12d0c327-5cd485bf-4b599250-f7c93562_0
2025-10-10T14:32:45.253408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5ddf56-b29706-b7cfbf5a-16f0964_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12d0c327-5cd485bf-4b599250-f7c93562_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:45.256142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0c327-5cd485bf-4b599250-f7c93562_0] Write session: try to update token
2025-10-10T14:32:45.256159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0c327-5cd485bf-4b599250-f7c93562_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:45.269064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:45.269078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:45.269086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600994678975755:5344]
2025-10-10T14:32:45.269128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:45.269140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:45.269168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId: src_id|12d0c327-5cd485bf-4b599250-f7c93562_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:45.269289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:45.269439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:45.269569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:45.269692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:45.269869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:45.269902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:45.271603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:45.271773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.271786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.271815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:45.271890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:45.282903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:45.282916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:45.282918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:45.282920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:45.282928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600994678975755:5344]
2025-10-10T14:32:45.282931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600994678975755:5344]
2025-10-10T14:32:45.282934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600994678975755:5344]
2025-10-10T14:32:45.282980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:45.282986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:45.282988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.282991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:45.282991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:45.282994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:45.283121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:45.328599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600995461187266:6574]
2025-10-10T14:32:45.328834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 706, pipe: [1:7559600995461187266:6574]
2025-10-10T14:32:45.387208Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:45.394150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.394171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.394328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.394387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.394445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.394500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.394541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.394549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.394610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.394665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.394721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.394782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.394825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.394827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.394886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.394944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.395030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.395090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.395129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.395135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.395193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.395519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.395583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.395643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.395687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.395693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.395755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.395811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.395871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.395929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.395970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.395976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.396039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.396092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.396149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.396205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.396250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.396259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.396326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.396381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.396437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.396493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.396534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.396540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.396600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.396654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.396713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.396785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.396830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.396837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.396898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.396953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.397008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.397073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.397117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.397122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.397180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:45.397233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:45.397301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:45.397389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:45.397440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:45.397446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:45.397495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187266:6574], now have 1 active actors on pipe
2025-10-10T14:32:45.397721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:45.397737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600995461187266:6574]
2025-10-10T14:32:45.397778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:45.397782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:45.397812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 707 reason: error at write: Disconnected sessionId: src_id|12d0c327-5cd485bf-4b599250-f7c93562_0
2025-10-10T14:32:45.398036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 707 sessionId: src_id|12d0c327-5cd485bf-4b599250-f7c93562_0 is DEAD
2025-10-10T14:32:45.398136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:45.398226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0c327-5cd485bf-4b599250-f7c93562_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:45.398235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0c327-5cd485bf-4b599250-f7c93562_0] Write session will restart in 0.009997s
2025-10-10T14:32:45.398262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0c327-5cd485bf-4b599250-f7c93562_0] Write session: Do CDS request
2025-10-10T14:32:45.398267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0c327-5cd485bf-4b599250-f7c93562_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:45.409814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0c327-5cd485bf-4b599250-f7c93562_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.409900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:45.409917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 708
2025-10-10T14:32:45.410051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.410087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:45.410097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:45.410101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:45.410511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 708 sessionId:  describe result for acl check
2025-10-10T14:32:45.410551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:45.410558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:45.410559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:45.410565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600995461187393:6607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:45.411123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600995461187393:6607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:45.414339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600995461187393:6607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:45.415612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:45.418002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:45.418140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600995461187393:6607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:45.418151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600995461187393:6607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:45.418154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600995461187393:6607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:45.418161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:45.418185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:45.418196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:45.418208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:45.418257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:45.418297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600994678976045:5346]
2025-10-10T14:32:45.418901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:45.419150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:45.419189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:45.419499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:45.419582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.419588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.419590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.419591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.419592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.419593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.419594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.419596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.419597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.419598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.419599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.419601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.419602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.419607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.419620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.419624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.419629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.419633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.419642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.419646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.419657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.419661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.419666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.419670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.419673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.419677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.419686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.419700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.419711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.419721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.419730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.419739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.419747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.419753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.419761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.419767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.419775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.419784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.419789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.419794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.419798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.419807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.419816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.419825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.419833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.419841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.419849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.419854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.419858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.419867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.419871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.419880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.419925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:45.422271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:45.422980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:45.422994Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:45.422996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:45.423000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:45.423005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 707 [2:7559600994678976045:5346]
2025-10-10T14:32:45.423020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:45.423037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:45.423043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.423046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.423047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.423062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:45.423074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:45.423084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:45.423144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.423151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.423152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.423155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:45.423218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:45.423225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.423236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.423251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.423274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:45.423298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187546:6607], now have 1 active actors on pipe
2025-10-10T14:32:45.423306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187267:2438], now have 1 active actors on pipe
2025-10-10T14:32:45.423314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600994678976040:5346]
2025-10-10T14:32:45.423320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600994678976040:5346]
2025-10-10T14:32:45.423322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600994678976040:5346]
2025-10-10T14:32:45.423313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 707
2025-10-10T14:32:45.423337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 707
2025-10-10T14:32:45.423338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:45.423343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:45.423345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:45.423346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:45.423355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:45.423372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:45.423379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:45.423415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.423423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.423438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600994678976040:5346]
2025-10-10T14:32:45.423450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:45.423463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:45.423482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:45.423494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.423502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.423505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:45.423519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.423534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:45.423556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.423695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.423701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.423715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.423818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 708 partition: 0 MaxSeqNo: 40 sessionId: src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0
2025-10-10T14:32:45.424184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d0c327-5cd485bf-4b599250-f7c93562_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:45.426772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0] Write session: try to update token
2025-10-10T14:32:45.426788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:45.439989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId: src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:45.442432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:45.443454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.443477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.443501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:45.443508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:45.443511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:45.443513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:45.443521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600994678976040:5346]
2025-10-10T14:32:45.443526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600994678976040:5346]
2025-10-10T14:32:45.443529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600994678976040:5346]
2025-10-10T14:32:45.443572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:45.443585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:45.443588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:45.443590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:45.443598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.443601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:45.443732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:45.498060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600995461187558:6574]
2025-10-10T14:32:45.498330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 707, pipe: [1:7559600995461187558:6574]
2025-10-10T14:32:45.550232Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:45.550579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:45.550630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187558:6574], now have 1 active actors on pipe
2025-10-10T14:32:45.550729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:45.550770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600995461187558:6574]
2025-10-10T14:32:45.550800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:45.560796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:45.560810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:45.560837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 708 reason: error at write: Disconnected sessionId: src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0
2025-10-10T14:32:45.560961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 708 sessionId: src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0 is DEAD
2025-10-10T14:32:45.561122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:45.561131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0] Write session will restart in 0.006678s
2025-10-10T14:32:45.561157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0] Write session: Do CDS request
2025-10-10T14:32:45.561163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:45.568903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.569069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:45.569084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 709
2025-10-10T14:32:45.569228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.569262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:45.569272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:45.569275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:45.569776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 709 sessionId:  describe result for acl check
2025-10-10T14:32:45.569815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:45.569823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:45.569825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:45.569832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600995461187698:6613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:45.570473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600995461187698:6613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:45.573444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600995461187698:6613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:45.574843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:45.577452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:45.577658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:45.577668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:45.577681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:45.577705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600995461187698:6613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:45.577716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600995461187698:6613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:45.577719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600995461187698:6613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:45.577725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:45.577728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:45.577769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600994678976332:5348]
2025-10-10T14:32:45.578238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:45.578501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:45.578534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:45.578744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:45.578781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.578786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.578786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.578787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.578788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.578789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.578789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.578790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.578791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.578792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.578792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.578793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.578794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.578798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.578806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.578809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.578811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.578814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.578816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.578818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.578821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.578823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.578825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.578828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.578830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.578832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.578837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.578842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.578847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.578850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.578853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.578856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.578859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.578862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.578865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.578868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.578872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.578875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.578878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.578881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.578884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.578887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.578890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.578893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.578896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.578899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.578902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.578905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.578907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.578910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.578913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.578916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.578939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:45.581215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:45.581764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:45.581774Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:45.581775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:45.581778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:45.581783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 708 [2:7559600994678976332:5348]
2025-10-10T14:32:45.581792Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:45.581806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:45.581814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.581818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.581820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.581836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:45.581847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:45.581853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:45.581912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.581918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.581919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.581921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:45.581970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:45.581976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.581984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.581993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.582017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:45.582042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187844:6613], now have 1 active actors on pipe
2025-10-10T14:32:45.582050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187559:2438], now have 1 active actors on pipe
2025-10-10T14:32:45.582057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600994678976327:5348]
2025-10-10T14:32:45.582063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600994678976327:5348]
2025-10-10T14:32:45.582064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600994678976327:5348]
2025-10-10T14:32:45.582078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:45.582095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:45.582101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:45.582114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 708
2025-10-10T14:32:45.582104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:45.582107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:45.582117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 708
2025-10-10T14:32:45.582114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:45.582117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:45.582144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600994678976327:5348]
2025-10-10T14:32:45.582147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:45.582174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.582173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:45.582183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.582220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:45.582233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.582238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.582241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:45.582253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.582267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:45.582285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.582452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.582460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.582473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.582564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 709 partition: 0 MaxSeqNo: 40 sessionId: src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0
2025-10-10T14:32:45.582931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ddc1b75-edec5abb-4fe7f6dd-86ed1d6c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:45.585537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0] Write session: try to update token
2025-10-10T14:32:45.585551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:45.598965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId: src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:45.601407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:45.601919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.601938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.601961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:45.601969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:45.601972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:45.601974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:45.601982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600994678976327:5348]
2025-10-10T14:32:45.601994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600994678976327:5348]
2025-10-10T14:32:45.602001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600994678976327:5348]
2025-10-10T14:32:45.602045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:45.602057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:45.602061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:45.602061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:45.602069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.602071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:45.602196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:45.651141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600995461187860:6574]
2025-10-10T14:32:45.651407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 708, pipe: [1:7559600995461187860:6574]
2025-10-10T14:32:45.709325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:45.709694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:45.709748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187860:6574], now have 1 active actors on pipe
2025-10-10T14:32:45.709844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:45.709904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600995461187860:6574]
2025-10-10T14:32:45.709930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:45.709950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:45.709960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:45.710048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 709 reason: error at write: Disconnected sessionId: src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0
2025-10-10T14:32:45.710226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 709 sessionId: src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0 is DEAD
2025-10-10T14:32:45.710405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:45.710415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0] Write session will restart in 0.007796s
2025-10-10T14:32:45.710441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0] Write session: Do CDS request
2025-10-10T14:32:45.710447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:45.719911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.719989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:45.720022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 710
2025-10-10T14:32:45.720160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.720200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:45.720212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:45.720215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:45.720719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 710 sessionId:  describe result for acl check
2025-10-10T14:32:45.720754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:45.720760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:45.720762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:45.720768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600995461187934:6617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:45.721325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600995461187934:6617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:45.724331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600995461187934:6617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:45.727043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600995461187934:6617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:45.727056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600995461187934:6617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:45.727059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600995461187934:6617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:45.727066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:45.728546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:45.731319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:45.731521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:45.731536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:45.731548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:45.731599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:45.731643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600994678976623:5351]
2025-10-10T14:32:45.732274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:45.732554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:45.732598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:45.732906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:45.732960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.732966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.732967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.732968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.732970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.732971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.732972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.732973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.732974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.732976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.732977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.732978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.732979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.732985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.732999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.733003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.733008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.733012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.733016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.733020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.733024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.733028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.733032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.733036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.733040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.733044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.733052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.733060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.733067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.733073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.733080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.733085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.733089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.733094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.733099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.733104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.733110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.733121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.733127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.733132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.733136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.733141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.733146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.733153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.733157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.733162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.733167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.733172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.733180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.733185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.733189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.733195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.733234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:45.735522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:45.735923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:45.735934Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:45.735937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:45.735941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:45.735947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 709 [2:7559600994678976623:5351]
2025-10-10T14:32:45.735962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:45.735980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:45.735983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.735987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.735989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.736005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:45.736018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:45.736027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:45.736084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.736092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.736094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.736097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:45.736166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:45.736173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.736185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.736197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.736215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:45.736240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461187861:2438], now have 1 active actors on pipe
2025-10-10T14:32:45.736253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600994678976618:5351]
2025-10-10T14:32:45.736255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600994678976618:5351]
2025-10-10T14:32:45.736257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600994678976618:5351]
2025-10-10T14:32:45.736266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:45.736277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:45.736280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:45.736286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:45.736288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:45.736298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:45.736301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:45.736280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 709
2025-10-10T14:32:45.736307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461188138:6617], now have 1 active actors on pipe
2025-10-10T14:32:45.736323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 709
2025-10-10T14:32:45.736334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600994678976618:5351]
2025-10-10T14:32:45.736344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:45.736366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:45.736376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.736380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.736413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a31271e9-32b485f0-40087eb-1dba97b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:45.736425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.736429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.736432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:45.736442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.736455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:45.736471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.736600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.736609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.736629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.736721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 710 partition: 0 MaxSeqNo: 40 sessionId: src_id|a31271e9-32b485f0-40087eb-1dba97b3_0
2025-10-10T14:32:45.737145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cc66cc-a834b8d6-f0b64a62-f37c7e51_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a31271e9-32b485f0-40087eb-1dba97b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:45.739804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31271e9-32b485f0-40087eb-1dba97b3_0] Write session: try to update token
2025-10-10T14:32:45.739822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31271e9-32b485f0-40087eb-1dba97b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:45.753031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId: src_id|a31271e9-32b485f0-40087eb-1dba97b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:45.754823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:45.754839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:45.754842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:45.754844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:45.754853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600994678976618:5351]
2025-10-10T14:32:45.754858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600994678976618:5351]
2025-10-10T14:32:45.754862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600994678976618:5351]
2025-10-10T14:32:45.754896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:45.754901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:45.754904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:45.754912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:45.754921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.754924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:45.755082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:45.755571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:45.809877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600995461188153:6574]
2025-10-10T14:32:45.810176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 709, pipe: [1:7559600995461188153:6574]
2025-10-10T14:32:45.864146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:45.864908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.864923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.864968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461188153:6574], now have 1 active actors on pipe
2025-10-10T14:32:45.865140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:45.865178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:45.865193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:45.865208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600995461188153:6574]
2025-10-10T14:32:45.865225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:45.865258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 710 reason: error at write: Disconnected sessionId: src_id|a31271e9-32b485f0-40087eb-1dba97b3_0
2025-10-10T14:32:45.865504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 710 sessionId: src_id|a31271e9-32b485f0-40087eb-1dba97b3_0 is DEAD
2025-10-10T14:32:45.865694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31271e9-32b485f0-40087eb-1dba97b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:45.865702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31271e9-32b485f0-40087eb-1dba97b3_0] Write session will restart in 0.008223s
2025-10-10T14:32:45.865721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31271e9-32b485f0-40087eb-1dba97b3_0] Write session: Do CDS request
2025-10-10T14:32:45.865726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31271e9-32b485f0-40087eb-1dba97b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:45.874945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31271e9-32b485f0-40087eb-1dba97b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.875041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:45.875058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 711
2025-10-10T14:32:45.875195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:45.875230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:45.875241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:45.875244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:45.875725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 711 sessionId:  describe result for acl check
2025-10-10T14:32:45.875765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:45.875771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:45.875773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:45.875780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600995461188196:6621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:45.876386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600995461188196:6621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:45.879094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600995461188196:6621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:45.882139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600995461188196:6621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:45.882154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600995461188196:6621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:45.882158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600995461188196:6621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:45.882176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:45.885422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:45.888133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:45.888281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:45.888290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:45.888299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:45.888334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:45.888362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600994678976912:5353]
2025-10-10T14:32:45.889131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:45.889413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:45.889450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:45.889826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:45.889865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.889870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.889870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.889871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.889872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.889872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.889873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.889874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.889875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.889875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.889876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.889877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.889878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.889882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.889891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.889893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.889896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.889898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.889901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.889903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.889906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.889908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.889911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.889913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.889915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.889918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.889925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.889930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:45.889935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.889938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:45.889941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.889944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:45.889947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.889950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:45.889953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.889956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:45.889959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.889962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:45.889965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.889968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:45.889971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.889974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:45.889977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.889980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:45.889982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.889987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:45.889989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.889992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.889995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.889998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.890000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.890003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.890026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:45.892125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:45.892497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:45.892506Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:45.892508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:45.892510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:45.892515Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 710 [2:7559600994678976912:5353]
2025-10-10T14:32:45.892523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:45.892536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:45.892538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.892540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.892541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.892553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:45.892562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:45.892568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:45.892609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.892614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.892616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.892617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:45.892681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:45.892689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.892698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:45.892709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:45.892729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:45.892754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461188371:6621], now have 1 active actors on pipe
2025-10-10T14:32:45.892760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461188154:2438], now have 1 active actors on pipe
2025-10-10T14:32:45.892765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600994678976907:5353]
2025-10-10T14:32:45.892766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600994678976907:5353]
2025-10-10T14:32:45.892768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600994678976907:5353]
2025-10-10T14:32:45.892778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:45.892794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:45.892795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:45.892801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:45.892803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:45.892810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:45.892813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:45.892839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600994678976907:5353]
2025-10-10T14:32:45.892846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:45.892852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:45.892831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 710
2025-10-10T14:32:45.892835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 710
2025-10-10T14:32:45.892878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.892887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.892923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:45.892935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:45.892939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:45.892941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:45.892954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:45.892967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:45.892985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.893140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.893148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.893162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:45.893256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 711 partition: 0 MaxSeqNo: 40 sessionId: src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0
2025-10-10T14:32:45.893678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31271e9-32b485f0-40087eb-1dba97b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:45.896394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0] Write session: try to update token
2025-10-10T14:32:45.896411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:45.909710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId: src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:45.911926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:45.912942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:45.912964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:45.912988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:45.912991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:45.912994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:45.912996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:45.913004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600994678976907:5353]
2025-10-10T14:32:45.913009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600994678976907:5353]
2025-10-10T14:32:45.913014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600994678976907:5353]
2025-10-10T14:32:45.913049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:45.913058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:45.913061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:45.913073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:45.913085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:45.913087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:45.913214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:45.965495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600995461188447:6574]
2025-10-10T14:32:45.965756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 710, pipe: [1:7559600995461188447:6574]
2025-10-10T14:32:46.017898Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:46.018268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:46.018317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600995461188447:6574], now have 1 active actors on pipe
2025-10-10T14:32:46.018404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:46.018523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:46.018565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600995461188447:6574]
2025-10-10T14:32:46.018597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:46.018605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:46.018678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 711 reason: error at write: Disconnected sessionId: src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0
2025-10-10T14:32:46.018864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 711 sessionId: src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0 is DEAD
2025-10-10T14:32:46.019041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:46.019052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0] Write session will restart in 0.007488s
2025-10-10T14:32:46.019076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0] Write session: Do CDS request
2025-10-10T14:32:46.019083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:46.027829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.027892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:46.027908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 712
2025-10-10T14:32:46.028078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.028124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:46.028132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:46.028136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:46.028540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 712 sessionId:  describe result for acl check
2025-10-10T14:32:46.028568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:46.028573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:46.028574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:46.028579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600999756155797:6625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:46.029024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600999756155797:6625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:46.031632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600999756155797:6625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:46.034705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600999756155797:6625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:46.034718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600999756155797:6625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:46.034722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600999756155797:6625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:46.034730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:46.037150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:46.040182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:46.040398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:46.040408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:46.040421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:46.040475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:46.040517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600998973944498:5355]
2025-10-10T14:32:46.041144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:46.041430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:46.041470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:46.041714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:46.041756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.041761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.041762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.041763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.041763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.041764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.041765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.041766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.041767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.041767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.041768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.041769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.041769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.041773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.041783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.041786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.041788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.041791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.041793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.041795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.041797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.041800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.041802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.041805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.041807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.041809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.041815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.041821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.041826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.041829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.041832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.041834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.041838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.041843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.041847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.041852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.041857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.041862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.041867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.041872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.041874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.041878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.041882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.041889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.041892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.041895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.041898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.041901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.041905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.041911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.041914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.041917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.041940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:46.044166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:46.044566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:46.044579Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:46.044582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:46.044585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:46.044592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 711 [2:7559600998973944498:5355]
2025-10-10T14:32:46.044603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:46.044619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:46.044628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.044631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.044634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.044651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:46.044663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:46.044675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:46.044729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.044736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.044738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.044741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:46.044809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:46.044816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.044826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.044836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.044855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:46.044882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756155979:6625], now have 1 active actors on pipe
2025-10-10T14:32:46.044890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756155744:2438], now have 1 active actors on pipe
2025-10-10T14:32:46.044897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600998973944493:5355]
2025-10-10T14:32:46.044899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600998973944493:5355]
2025-10-10T14:32:46.044901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600998973944493:5355]
2025-10-10T14:32:46.044916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:46.044933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:46.044936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:46.044942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:46.044944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:46.044953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:46.044956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:46.044950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 711
2025-10-10T14:32:46.044978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600998973944493:5355]
2025-10-10T14:32:46.044955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 711
2025-10-10T14:32:46.044986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:46.044987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:46.045012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.045021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.045058Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:46.045070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.045078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.045080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:46.045091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.045107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:46.045132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.045284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.045293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.045312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.045423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 712 partition: 0 MaxSeqNo: 40 sessionId: src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0
2025-10-10T14:32:46.045787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be3edb91-46ddb869-fba48563-45ffe7e7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:46.048351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0] Write session: try to update token
2025-10-10T14:32:46.048369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:46.061707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId: src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:46.064304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:46.064574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:46.064593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:46.064596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:46.064597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:46.064609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600998973944493:5355]
2025-10-10T14:32:46.064613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600998973944493:5355]
2025-10-10T14:32:46.064617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600998973944493:5355]
2025-10-10T14:32:46.064659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:46.064670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:46.064674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:46.064675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.064685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.064708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:46.064721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.064728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:46.064868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:46.118601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600999756156037:6574]
2025-10-10T14:32:46.118887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 711, pipe: [1:7559600999756156037:6574]
2025-10-10T14:32:46.171815Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:46.172012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156037:6574], now have 1 active actors on pipe
2025-10-10T14:32:46.172157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:46.172237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:46.172293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600999756156037:6574]
2025-10-10T14:32:46.172313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:46.172515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 712 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0
2025-10-10T14:32:46.172740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 712 sessionId: src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0 is DEAD
2025-10-10T14:32:46.172878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:46.172904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0] Write session will restart in 0.007627s
2025-10-10T14:32:46.172928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0] Write session: Do CDS request
2025-10-10T14:32:46.172934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:46.181844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.181937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:46.181953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 713
2025-10-10T14:32:46.182088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.182135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:46.182143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:46.182147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:46.182529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 713 sessionId:  describe result for acl check
2025-10-10T14:32:46.182563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:46.182565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:46.182568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:46.182574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600999756156103:6635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:46.183091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600999756156103:6635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:46.185556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600999756156103:6635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:46.189434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600999756156103:6635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:46.189451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600999756156103:6635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:46.189466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600999756156103:6635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:46.189474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:46.192882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:46.196050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:46.196274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:46.196285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:46.196297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:46.196354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:46.196402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600998973944829:5363]
2025-10-10T14:32:46.197042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:46.197356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:46.197404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:46.197741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:46.197796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.197804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.197805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.197806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.197808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.197809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.197810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.197812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.197813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.197814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.197816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.197817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.197818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.197825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.197840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.197845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.197849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.197853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.197858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.197862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.197866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.197870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.197874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.197878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.197882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.197886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.197894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.197903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.197909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.197915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.197919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.197925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.197929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.197934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.197937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.197940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.197943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.197946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.197949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.197952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.197955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.197958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.197961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.197966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.197970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.197976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.197983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.197988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.197991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.197995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.197998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.198001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.198024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:46.200338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:46.200922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:46.200935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:46.200938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:46.200941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:46.200947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 712 [2:7559600998973944829:5363]
2025-10-10T14:32:46.200960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:46.200976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:46.200982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.200985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.200987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.201003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:46.201011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:46.201023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:46.201080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.201087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.201089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.201092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:46.201160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:46.201168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.201179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.201192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.201210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:46.201236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156052:2438], now have 1 active actors on pipe
2025-10-10T14:32:46.201244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156294:6635], now have 1 active actors on pipe
2025-10-10T14:32:46.201252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600998973944824:5363]
2025-10-10T14:32:46.201255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600998973944824:5363]
2025-10-10T14:32:46.201257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600998973944824:5363]
2025-10-10T14:32:46.201270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:46.201282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:46.201285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:46.201286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:46.201291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:46.201313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:46.201291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 712
2025-10-10T14:32:46.201321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:46.201327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 712
2025-10-10T14:32:46.201379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.201389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.201404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600998973944824:5363]
2025-10-10T14:32:46.201412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:46.201429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:46.201456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:46.201468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.201472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.201475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:46.201486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.201499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:46.201527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.201693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.201702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.201717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.201804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 713 partition: 0 MaxSeqNo: 40 sessionId: src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0
2025-10-10T14:32:46.202252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cabdf8c6-74e278b1-bee52cf3-428ce36_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:46.204887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0] Write session: try to update token
2025-10-10T14:32:46.204904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:46.219191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId: src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:46.220447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:46.220464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:46.220468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:46.220470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:46.220479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600998973944824:5363]
2025-10-10T14:32:46.220484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600998973944824:5363]
2025-10-10T14:32:46.220487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600998973944824:5363]
2025-10-10T14:32:46.220536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:46.220541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:46.220547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:46.220548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.220551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:46.220551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:46.220685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:46.221801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:46.272186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600999756156370:6574]
2025-10-10T14:32:46.272441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 712, pipe: [1:7559600999756156370:6574]
2025-10-10T14:32:46.327114Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:46.327631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.327649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.327705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156370:6574], now have 1 active actors on pipe
2025-10-10T14:32:46.327965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600999756156370:6574]
2025-10-10T14:32:46.327980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:46.327984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:46.327996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:46.328027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:46.328044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 713 reason: error at write: Disconnected sessionId: src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0
2025-10-10T14:32:46.328277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 713 sessionId: src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0 is DEAD
2025-10-10T14:32:46.328429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:46.328441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0] Write session will restart in 0.009627s
2025-10-10T14:32:46.328466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0] Write session: Do CDS request
2025-10-10T14:32:46.328476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:46.338834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.338957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:46.338969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 714
2025-10-10T14:32:46.339085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.339122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:46.339133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:46.339137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:46.339612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 714 sessionId:  describe result for acl check
2025-10-10T14:32:46.339647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:46.339653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:46.339654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:46.339659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600999756156447:6644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:46.340197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600999756156447:6644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:46.342972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600999756156447:6644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:46.345820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600999756156447:6644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:46.345833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600999756156447:6644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:46.345836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600999756156447:6644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:46.345844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:46.347874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:46.350387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:46.350587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:46.350597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:46.350609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:46.350656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:46.350694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600998973945134:5373]
2025-10-10T14:32:46.351313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:46.351630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:46.351672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:46.351981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:46.352032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.352038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.352040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.352041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.352042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.352043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.352045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.352046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.352047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.352048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.352049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.352050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.352051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.352057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.352069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.352072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.352076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.352080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.352084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.352087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.352091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.352095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.352100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.352103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.352107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.352110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.352117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.352124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.352130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.352135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.352139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.352144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.352149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.352154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.352163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.352168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.352173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.352180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.352185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.352195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.352200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.352205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.352209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.352214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.352223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.352228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.352232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.352237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.352241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.352246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.352253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.352258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.352299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:46.354562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:46.355052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:46.355063Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:46.355066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:46.355069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:46.355075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 713 [2:7559600998973945134:5373]
2025-10-10T14:32:46.355086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:46.355101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:46.355103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.355107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.355109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.355124Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:46.355132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:46.355143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:46.355199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.355206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.355208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.355210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:46.355276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:46.355283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.355292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.355302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.355320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:46.355345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600998973945129:5373]
2025-10-10T14:32:46.355351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600998973945129:5373]
2025-10-10T14:32:46.355353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600998973945129:5373]
2025-10-10T14:32:46.355369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:46.355386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156372:2438], now have 1 active actors on pipe
2025-10-10T14:32:46.355390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:46.355394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:46.355394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156642:6644], now have 1 active actors on pipe
2025-10-10T14:32:46.355396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:46.355404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:46.355420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:46.355427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:46.355435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 713
2025-10-10T14:32:46.355449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600998973945129:5373]
2025-10-10T14:32:46.355456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:46.355435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 713
2025-10-10T14:32:46.355469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:46.355496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.355506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.355535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:46.355547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.355551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.355554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:46.355564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.355578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:46.355593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.355816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.355825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.355840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.355924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 714 partition: 0 MaxSeqNo: 40 sessionId: src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0
2025-10-10T14:32:46.356291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ca7cb2-172aa88e-36f098d1-d325c233_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:46.359012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0] Write session: try to update token
2025-10-10T14:32:46.359030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:46.372711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId: src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:46.372903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:46.372921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:46.372932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559600998973945129:5373]
2025-10-10T14:32:46.372985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:46.372991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:46.373179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:46.373343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:46.373488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:46.373628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:46.373820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:46.373863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:46.375150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:46.375371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.375389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.375426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:46.375520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:46.384326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:46.384341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:46.384344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:46.384346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:46.384356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600998973945129:5373]
2025-10-10T14:32:46.384360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600998973945129:5373]
2025-10-10T14:32:46.384363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600998973945129:5373]
2025-10-10T14:32:46.384409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:46.384411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:46.384417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:46.384420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:46.384420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.384423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:46.384547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:46.428322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600999756156667:6574]
2025-10-10T14:32:46.428588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 713, pipe: [1:7559600999756156667:6574]
2025-10-10T14:32:46.489176Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:46.496331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.496354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.496522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.496592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.496652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.496711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.496753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.496761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.496830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.496887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.496956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.497024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.497064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.497070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.497131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.497191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.497262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.497324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.497378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.497384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.497446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.497506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.497565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.497627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.497667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.497673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.497734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.497790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.497852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.497926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.497974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.497981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.498044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.498101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.498160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.498218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.498258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.498263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.498323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.498379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.498452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.498532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.498583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.498590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.498666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.498743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.498816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.498889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.498946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.498952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.499021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.499081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.499138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.499197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.499248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.499257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.499313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:46.499368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:46.499424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:46.499481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:46.499520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:46.499526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:46.499566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156667:6574], now have 1 active actors on pipe
2025-10-10T14:32:46.499790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:46.499825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600999756156667:6574]
2025-10-10T14:32:46.499858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:46.499877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:46.499911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 714 reason: error at write: Disconnected sessionId: src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0
2025-10-10T14:32:46.500118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 714 sessionId: src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0 is DEAD
2025-10-10T14:32:46.500271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:46.500284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0] Write session will restart in 0.006218s
2025-10-10T14:32:46.500311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0] Write session: Do CDS request
2025-10-10T14:32:46.500317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:46.500397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:46.507765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.507887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:46.507902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 715
2025-10-10T14:32:46.508005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.508053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:46.508062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:46.508066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:46.508534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 715 sessionId:  describe result for acl check
2025-10-10T14:32:46.508582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:46.508590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:46.508592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:46.508597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600999756156705:6648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:46.509141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600999756156705:6648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:46.512667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600999756156705:6648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:46.515300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600999756156705:6648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:46.515314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600999756156705:6648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:46.515318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600999756156705:6648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:46.515326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:46.519488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:46.522392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:46.522602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:46.522615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:46.522626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:46.522677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:46.522723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600998973945428:5375]
2025-10-10T14:32:46.523170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:46.523462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:46.523500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:46.523760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:46.523803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.523808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.523809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.523810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.523810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.523811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.523812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.523812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.523813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.523814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.523814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.523815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.523816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.523820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.523829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.523832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.523834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.523836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.523839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.523841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.523843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.523846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.523848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.523851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.523853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.523857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.523865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.523874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.523880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.523886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.523891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.523896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.523900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.523904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.523908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.523913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.523916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.523920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.523925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.523930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.523934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.523940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.523944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.523950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.523955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.523963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.523966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.523973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.523975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.523978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.523981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.523984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.524009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:46.526186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:46.526653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:46.526665Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:46.526667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:46.526671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:46.526676Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 714 [2:7559600998973945428:5375]
2025-10-10T14:32:46.526689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:46.526710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:46.526718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.526721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.526723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.526739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:46.526751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:46.526763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:46.526818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.526825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.526827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.526830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:46.526893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:46.526900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.526912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.526923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.526943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:46.526970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156669:2438], now have 1 active actors on pipe
2025-10-10T14:32:46.526987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156883:6648], now have 1 active actors on pipe
2025-10-10T14:32:46.526995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600998973945423:5375]
2025-10-10T14:32:46.527002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600998973945423:5375]
2025-10-10T14:32:46.527004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600998973945423:5375]
2025-10-10T14:32:46.527016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:46.527034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:46.527033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:46.527036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:46.527038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:46.527054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:46.527062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:46.527041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 714
2025-10-10T14:32:46.527063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 714
2025-10-10T14:32:46.527087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600998973945423:5375]
2025-10-10T14:32:46.527099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:46.527111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:46.527115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.527120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.527165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|174092ca-221874c9-e1c409a3-4114df29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:46.527177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.527181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.527183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:46.527193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.527207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:46.527228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.527367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.527376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.527393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.527494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 715 partition: 0 MaxSeqNo: 40 sessionId: src_id|174092ca-221874c9-e1c409a3-4114df29_0
2025-10-10T14:32:46.527855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6dc3d5-e065be9e-b8560350-8eb8c77e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|174092ca-221874c9-e1c409a3-4114df29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:46.530618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|174092ca-221874c9-e1c409a3-4114df29_0] Write session: try to update token
2025-10-10T14:32:46.530637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|174092ca-221874c9-e1c409a3-4114df29_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:46.545272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId: src_id|174092ca-221874c9-e1c409a3-4114df29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:46.546605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:46.546624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:46.546627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:46.546630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:46.546640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600998973945423:5375]
2025-10-10T14:32:46.546645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600998973945423:5375]
2025-10-10T14:32:46.546649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600998973945423:5375]
2025-10-10T14:32:46.546702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:46.546701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:46.546708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:46.546712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:46.546713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.546717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:46.546904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:46.548111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:46.599897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600999756156977:6574]
2025-10-10T14:32:46.600176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 714, pipe: [1:7559600999756156977:6574]
2025-10-10T14:32:46.654179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:46.654742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.654756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.654794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156977:6574], now have 1 active actors on pipe
2025-10-10T14:32:46.654953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:46.655025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:46.655032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600999756156977:6574]
2025-10-10T14:32:46.655058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:46.655153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 715 reason: status is not ok: tablet will be restarted right now sessionId: src_id|174092ca-221874c9-e1c409a3-4114df29_0
2025-10-10T14:32:46.655399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 715 sessionId: src_id|174092ca-221874c9-e1c409a3-4114df29_0 is DEAD
2025-10-10T14:32:46.655559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174092ca-221874c9-e1c409a3-4114df29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:46.655571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174092ca-221874c9-e1c409a3-4114df29_0] Write session will restart in 0.007340s
2025-10-10T14:32:46.655598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174092ca-221874c9-e1c409a3-4114df29_0] Write session: Do CDS request
2025-10-10T14:32:46.655613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174092ca-221874c9-e1c409a3-4114df29_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:46.663895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|174092ca-221874c9-e1c409a3-4114df29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.663993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:46.664011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 716
2025-10-10T14:32:46.664156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.664195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:46.664201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:46.664204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:46.664595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 716 sessionId:  describe result for acl check
2025-10-10T14:32:46.664633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:46.664638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:46.664640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:46.664645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600999756157005:6654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:46.665160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600999756157005:6654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:46.668108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600999756157005:6654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:46.671650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600999756157005:6654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:46.671665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600999756157005:6654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:46.671669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600999756157005:6654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:46.671678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:46.676162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:46.679396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:46.679616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:46.679626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:46.679636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:46.679683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:46.679730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600998973945725:5378]
2025-10-10T14:32:46.680317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:46.680607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:46.680647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:46.680970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:46.681028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.681034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.681035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.681036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.681037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.681039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.681040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.681042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.681043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.681044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.681046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.681047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.681048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.681054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.681066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.681071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.681075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.681079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.681083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.681087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.681091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.681096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.681100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.681104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.681108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.681112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.681119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.681128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.681135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.681140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.681145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.681151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.681156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.681162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.681167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.681172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.681177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.681182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.681187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.681198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.681203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.681209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.681219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.681224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.681228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.681234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.681239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.681244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.681248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.681254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.681263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.681269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.681312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:46.683742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:46.684075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:46.684089Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:46.684092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:46.684095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:46.684102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 715 [2:7559600998973945725:5378]
2025-10-10T14:32:46.684114Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:46.684132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:46.684136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.684139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.684142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.684159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:46.684170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:46.684178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:46.684235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.684243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.684245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.684248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:46.684316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:46.684324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.684335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.684350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.684370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:46.684398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756156982:2438], now have 1 active actors on pipe
2025-10-10T14:32:46.684405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756157172:6654], now have 1 active actors on pipe
2025-10-10T14:32:46.684413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600998973945719:5378]
2025-10-10T14:32:46.684419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600998973945719:5378]
2025-10-10T14:32:46.684421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600998973945719:5378]
2025-10-10T14:32:46.684435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:46.684446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:46.684448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:46.684450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:46.684454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:46.684472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:46.684480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:46.684460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 715
2025-10-10T14:32:46.684502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600998973945719:5378]
2025-10-10T14:32:46.684512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:46.684474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 715
2025-10-10T14:32:46.684516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:46.684527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.684532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.684584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b4b1fb1-eac99583-19859524-c38b9466_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:46.684597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.684601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.684608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:46.684625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.684641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:46.684664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.684784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.684791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.684807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.684923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 716 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b4b1fb1-eac99583-19859524-c38b9466_0
2025-10-10T14:32:46.685291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|174092ca-221874c9-e1c409a3-4114df29_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b4b1fb1-eac99583-19859524-c38b9466_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:46.687879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4b1fb1-eac99583-19859524-c38b9466_0] Write session: try to update token
2025-10-10T14:32:46.687898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4b1fb1-eac99583-19859524-c38b9466_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:46.702351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId: src_id|8b4b1fb1-eac99583-19859524-c38b9466_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:46.703321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:46.703343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:46.703346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:46.703348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:46.703358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600998973945719:5378]
2025-10-10T14:32:46.703362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600998973945719:5378]
2025-10-10T14:32:46.703364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600998973945719:5378]
2025-10-10T14:32:46.703401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:46.703408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.703413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:46.703419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:46.703432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:46.703436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:46.703543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:46.704928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:46.755026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600999756157279:6574]
2025-10-10T14:32:46.755302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 715, pipe: [1:7559600999756157279:6574]
2025-10-10T14:32:46.810428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:46.810714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.810731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.810781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756157279:6574], now have 1 active actors on pipe
2025-10-10T14:32:46.810994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:46.811000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:46.811009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600999756157279:6574]
2025-10-10T14:32:46.811012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:46.811030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:46.811076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 716 reason: error at write: Disconnected sessionId: src_id|8b4b1fb1-eac99583-19859524-c38b9466_0
2025-10-10T14:32:46.811277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 716 sessionId: src_id|8b4b1fb1-eac99583-19859524-c38b9466_0 is DEAD
2025-10-10T14:32:46.811430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4b1fb1-eac99583-19859524-c38b9466_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:46.811441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4b1fb1-eac99583-19859524-c38b9466_0] Write session will restart in 0.008082s
2025-10-10T14:32:46.811466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4b1fb1-eac99583-19859524-c38b9466_0] Write session: Do CDS request
2025-10-10T14:32:46.811474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4b1fb1-eac99583-19859524-c38b9466_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:46.820880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4b1fb1-eac99583-19859524-c38b9466_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.820987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:46.821005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 717
2025-10-10T14:32:46.821106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.821141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:46.821151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:46.821155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:46.821582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 717 sessionId:  describe result for acl check
2025-10-10T14:32:46.821628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:46.821629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:46.821632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:46.821638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600999756157347:6658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:46.822202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600999756157347:6658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:46.824967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600999756157347:6658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:46.828052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600999756157347:6658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:46.828067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600999756157347:6658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:46.828070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600999756157347:6658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:46.828078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:46.830108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:46.832922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:46.833162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:46.833177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:46.833191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:46.833260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:46.833306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600998973946019:5380]
2025-10-10T14:32:46.833956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:46.834236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:46.834292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:46.834620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:46.834693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.834699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.834700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.834702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.834703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.834704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.834705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.834707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.834708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.834709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.834711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.834712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.834713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.834719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.834732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.834737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.834741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.834745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.834750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.834754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.834757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.834761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.834770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.834779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.834784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.834792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.834802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.834812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.834820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.834823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.834830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.834833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.834836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.834839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.834846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.834849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.834852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.834858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.834862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.834865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.834868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.834871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.834874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.834878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.834881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.834888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.834891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.834894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.834897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.834900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.834903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.834906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.834928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:46.837169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:46.837542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:46.837555Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:46.837558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:46.837563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:46.837569Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 716 [2:7559600998973946019:5380]
2025-10-10T14:32:46.837586Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:46.837609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:46.837616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.837620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.837622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.837640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:46.837652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:46.837666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:46.837731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.837738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.837740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.837743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:46.837816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:46.837825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.837838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.837854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.837874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:46.837901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756157281:2438], now have 1 active actors on pipe
2025-10-10T14:32:46.837910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756157558:6658], now have 1 active actors on pipe
2025-10-10T14:32:46.837919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600998973946014:5380]
2025-10-10T14:32:46.837927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600998973946014:5380]
2025-10-10T14:32:46.837929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600998973946014:5380]
2025-10-10T14:32:46.837939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:46.837910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 716
2025-10-10T14:32:46.837926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 716
2025-10-10T14:32:46.837957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:46.837960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:46.837969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:46.837971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:46.837977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:46.837980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:46.838004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.838014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.838055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600998973946014:5380]
2025-10-10T14:32:46.838068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:46.838079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:46.838093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:46.838106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.838114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.838121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:46.838133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.838149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:46.838187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.838381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.838393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.838413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.838522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 717 partition: 0 MaxSeqNo: 40 sessionId: src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0
2025-10-10T14:32:46.839010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4b1fb1-eac99583-19859524-c38b9466_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:46.841652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0] Write session: try to update token
2025-10-10T14:32:46.841669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:46.854691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId: src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:46.856909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:46.856924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:46.856926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:46.856928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:46.856935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600998973946014:5380]
2025-10-10T14:32:46.856941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600998973946014:5380]
2025-10-10T14:32:46.856944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600998973946014:5380]
2025-10-10T14:32:46.856985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:46.856996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.856998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:46.857155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:46.857250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:46.857261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:46.857264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:46.857372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:46.911164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559600999756157579:6574]
2025-10-10T14:32:46.911386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 716, pipe: [1:7559600999756157579:6574]
2025-10-10T14:32:46.960501Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:46.961149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.961162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.961199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756157579:6574], now have 1 active actors on pipe
2025-10-10T14:32:46.961365Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:46.961438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:46.961461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559600999756157579:6574]
2025-10-10T14:32:46.961484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:46.961559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 717 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0
2025-10-10T14:32:46.961779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 717 sessionId: src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0 is DEAD
2025-10-10T14:32:46.961961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:46.961972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0] Write session will restart in 0.008724s
2025-10-10T14:32:46.961997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0] Write session: Do CDS request
2025-10-10T14:32:46.962003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:46.971860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.972052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:46.972068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 718
2025-10-10T14:32:46.972216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:46.972255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:46.972265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:46.972269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:46.972848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 718 sessionId:  describe result for acl check
2025-10-10T14:32:46.972884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:46.972886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:46.972887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:46.972891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559600999756157657:6662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:46.973449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559600999756157657:6662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:46.976516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559600999756157657:6662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:46.979098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559600999756157657:6662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:46.979111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559600999756157657:6662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:46.979114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559600999756157657:6662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:46.979122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:46.980891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:46.983823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:46.984015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:46.984028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:46.984040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:46.984090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:46.984131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559600998973946316:5382]
2025-10-10T14:32:46.984760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:46.985035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:46.985078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:46.985408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:46.985462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.985467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.985469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.985470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.985472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.985473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.985474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.985476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.985477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.985478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.985479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.985481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.985482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.985487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.985501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.985506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.985510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.985514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.985518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.985522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.985526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.985536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.985540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.985544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.985548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.985552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.985565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.985578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:46.985589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.985599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:46.985607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.985613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:46.985621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.985627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:46.985635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.985641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:46.985650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.985659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:46.985669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.985675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:46.985683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.985689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:46.985698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.985703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:46.985708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.985717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:46.985722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.985727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.985732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.985738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.985747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.985756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.985801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:46.988012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:46.988323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:46.988334Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:46.988337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:46.988340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:46.988346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 717 [2:7559600998973946316:5382]
2025-10-10T14:32:46.988360Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:46.988383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:46.988390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.988393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.988396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.988413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:46.988425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:46.988437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:46.988495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.988502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.988504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.988506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:46.988576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:46.988584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:46.988595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:46.988612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:46.988634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:46.988658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756157865:6662], now have 1 active actors on pipe
2025-10-10T14:32:46.988666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559600999756157584:2438], now have 1 active actors on pipe
2025-10-10T14:32:46.988675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559600998973946311:5382]
2025-10-10T14:32:46.988681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559600998973946311:5382]
2025-10-10T14:32:46.988684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559600998973946311:5382]
2025-10-10T14:32:46.988697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:46.988709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:46.988716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:46.988732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:46.988732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:46.988734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:46.988739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:46.988718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 717
2025-10-10T14:32:46.988719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 717
2025-10-10T14:32:46.988760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559600998973946311:5382]
2025-10-10T14:32:46.988768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:46.988769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:46.988794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.988803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.988845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|844bb906-783d45ec-94bcd728-a5d45b34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:46.988856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:46.988863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:46.988866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:46.988881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:46.988895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:46.988922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.989047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:46.989054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:46.989067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:46.989138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 718 partition: 0 MaxSeqNo: 40 sessionId: src_id|844bb906-783d45ec-94bcd728-a5d45b34_0
2025-10-10T14:32:46.989557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56408761-6d533010-bc77d4ef-7fe2d92a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|844bb906-783d45ec-94bcd728-a5d45b34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:46.992208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844bb906-783d45ec-94bcd728-a5d45b34_0] Write session: try to update token
2025-10-10T14:32:46.992226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844bb906-783d45ec-94bcd728-a5d45b34_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:47.006566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId: src_id|844bb906-783d45ec-94bcd728-a5d45b34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:47.007966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:47.007981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.007983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:47.007984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:47.007992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559600998973946311:5382]
2025-10-10T14:32:47.007996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559600998973946311:5382]
2025-10-10T14:32:47.007999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559600998973946311:5382]
2025-10-10T14:32:47.008038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:47.008046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:47.008048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:47.008052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:47.008055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.008057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:47.008191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:47.009280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:47.061717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601004051125176:6574]
2025-10-10T14:32:47.062025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 717, pipe: [1:7559601004051125176:6574]
2025-10-10T14:32:47.111399Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:47.111748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.111760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.111798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125176:6574], now have 1 active actors on pipe
2025-10-10T14:32:47.111925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:47.112062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:47.112074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601004051125176:6574]
2025-10-10T14:32:47.112095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:47.112149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 718 reason: status is not ok: tablet will be restarted right now sessionId: src_id|844bb906-783d45ec-94bcd728-a5d45b34_0
2025-10-10T14:32:47.112368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 718 sessionId: src_id|844bb906-783d45ec-94bcd728-a5d45b34_0 is DEAD
2025-10-10T14:32:47.112610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844bb906-783d45ec-94bcd728-a5d45b34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:47.112622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844bb906-783d45ec-94bcd728-a5d45b34_0] Write session will restart in 0.006577s
2025-10-10T14:32:47.112647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844bb906-783d45ec-94bcd728-a5d45b34_0] Write session: Do CDS request
2025-10-10T14:32:47.112653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844bb906-783d45ec-94bcd728-a5d45b34_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:47.120893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844bb906-783d45ec-94bcd728-a5d45b34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.120964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:47.120983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 719
2025-10-10T14:32:47.121141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.121177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:47.121190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:47.121197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:47.121686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 719 sessionId:  describe result for acl check
2025-10-10T14:32:47.121726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:47.121733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:47.121735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:47.121741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601004051125215:6666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:47.122305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601004051125215:6666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:47.124983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601004051125215:6666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:47.128188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601004051125215:6666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:47.128202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601004051125215:6666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:47.128206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601004051125215:6666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:47.128215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:47.130838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:47.133460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:47.133663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:47.133675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:47.133687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:47.133735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:47.133775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601003268913910:5384]
2025-10-10T14:32:47.134397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:47.134627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:47.134668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:47.134996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:47.135052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.135059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.135072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.135078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.135079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.135081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.135082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.135083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.135085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.135086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.135087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.135088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.135089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.135095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.135109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.135113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.135118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.135122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.135126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.135130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.135134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.135138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.135142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.135151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.135155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.135163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.135171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.135184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.135190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.135198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.135208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.135216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.135221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.135226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.135231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.135240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.135245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.135250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.135254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.135260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.135264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.135273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.135283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.135293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.135301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.135306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.135314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.135320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.135329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.135336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.135345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.135354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.135401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:47.137565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:47.137855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:47.137866Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:47.137868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:47.137871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:47.137875Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 718 [2:7559601003268913910:5384]
2025-10-10T14:32:47.137884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:47.137898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:47.137906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.137909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.137911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.137928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:47.137942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:47.137951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:47.138003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.138010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.138012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.138015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:47.138074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:47.138081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.138087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.138097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.138109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:47.138128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125414:6666], now have 1 active actors on pipe
2025-10-10T14:32:47.138134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125177:2438], now have 1 active actors on pipe
2025-10-10T14:32:47.138140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601003268913905:5384]
2025-10-10T14:32:47.138142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601003268913905:5384]
2025-10-10T14:32:47.138143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601003268913905:5384]
2025-10-10T14:32:47.138153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:47.138166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:47.138171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:47.138174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:47.138176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:47.138180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:47.138182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:47.138200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601003268913905:5384]
2025-10-10T14:32:47.138208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:47.138224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:47.138210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 718
2025-10-10T14:32:47.138212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 718
2025-10-10T14:32:47.138295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.138304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.138327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f747244-3957322f-e7740f25-46f7fcbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:47.138337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.138339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.138341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:47.138351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.138359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:47.138372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.138534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.138540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.138550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.138640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 719 partition: 0 MaxSeqNo: 40 sessionId: src_id|f747244-3957322f-e7740f25-46f7fcbc_0
2025-10-10T14:32:47.139016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844bb906-783d45ec-94bcd728-a5d45b34_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f747244-3957322f-e7740f25-46f7fcbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:47.141492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f747244-3957322f-e7740f25-46f7fcbc_0] Write session: try to update token
2025-10-10T14:32:47.141505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f747244-3957322f-e7740f25-46f7fcbc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:47.149236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:47.149252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.149267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601003268913905:5384]
2025-10-10T14:32:47.149313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:47.149320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:47.149507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:47.149637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:47.149767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:47.149920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:47.150143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:47.150178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:47.154622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId: src_id|f747244-3957322f-e7740f25-46f7fcbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:47.157154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:47.157359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.157376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.157416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:47.157507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:47.166580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:47.166595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.166597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:47.166599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:47.166607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601003268913905:5384]
2025-10-10T14:32:47.166610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601003268913905:5384]
2025-10-10T14:32:47.166613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601003268913905:5384]
2025-10-10T14:32:47.166650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:47.166657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.166659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:47.166664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:47.166669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:47.166672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:47.166776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:47.212239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601004051125492:6574]
2025-10-10T14:32:47.212514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 718, pipe: [1:7559601004051125492:6574]
2025-10-10T14:32:47.274447Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:47.281108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.281131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.281284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.281353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.281413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.281469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.281516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.281527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.281590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.281645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.281703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.281764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.281804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.281809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.281870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.281942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.282001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.282058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.282097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.282104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.282162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.282218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.282275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.282335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.282373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.282378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.282436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.282491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.282544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.282601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.282644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.282649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.282707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.282760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.282816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.282869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.282961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.282967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.283031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.283083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.283141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.283198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.283238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.283246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.283301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.283355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.283411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.283467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.283521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.283527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.283587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.283642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.283700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.283752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.283794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.283799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.283857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.283908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.283963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.284019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.284058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.284063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.284100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125492:6574], now have 1 active actors on pipe
2025-10-10T14:32:47.284329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:47.284369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601004051125492:6574]
2025-10-10T14:32:47.284387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:47.284389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:47.284419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 719 reason: error at write: Disconnected sessionId: src_id|f747244-3957322f-e7740f25-46f7fcbc_0
2025-10-10T14:32:47.284626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 719 sessionId: src_id|f747244-3957322f-e7740f25-46f7fcbc_0 is DEAD
2025-10-10T14:32:47.284789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f747244-3957322f-e7740f25-46f7fcbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:47.284800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f747244-3957322f-e7740f25-46f7fcbc_0] Write session will restart in 0.005124s
2025-10-10T14:32:47.284818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f747244-3957322f-e7740f25-46f7fcbc_0] Write session: Do CDS request
2025-10-10T14:32:47.284822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f747244-3957322f-e7740f25-46f7fcbc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:47.284937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:47.290774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f747244-3957322f-e7740f25-46f7fcbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.290898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:47.290910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 720
2025-10-10T14:32:47.291065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.291105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:47.291115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:47.291119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:47.291548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 720 sessionId:  describe result for acl check
2025-10-10T14:32:47.291589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:47.291596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:47.291598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:47.291605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601004051125532:6680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:47.292167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601004051125532:6680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:47.294103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601004051125532:6680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:47.297432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601004051125532:6680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:47.297446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601004051125532:6680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:47.297450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601004051125532:6680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:47.297459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:47.304701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:47.307756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:47.308078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:47.308089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:47.308102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:47.308168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:47.308211Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601003268914259:5400]
2025-10-10T14:32:47.308895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:47.309237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:47.309286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:47.309564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:47.309605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.309611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.309612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.309613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.309614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.309615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.309616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.309616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.309617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.309618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.309619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.309620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.309620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.309625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.309643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.309646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.309648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.309651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.309653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.309655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.309658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.309660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.309663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.309665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.309667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.309670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.309676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.309682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.309688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.309691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.309694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.309697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.309702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.309705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.309708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.309711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.309713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.309717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.309720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.309723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.309726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.309729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.309732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.309736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.309739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.309742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.309745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.309748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.309751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.309754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.309757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.309760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.309783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:47.312175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:47.312465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:47.312475Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:47.312477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:47.312480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:47.312488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 719 [2:7559601003268914259:5400]
2025-10-10T14:32:47.312501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:47.312515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:47.312520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.312523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.312524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.312538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:47.312547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:47.312557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:47.312603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.312608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.312609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.312611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:47.312666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:47.312671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.312678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.312684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.312698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:47.312720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601003268914254:5400]
2025-10-10T14:32:47.312726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601003268914254:5400]
2025-10-10T14:32:47.312728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601003268914254:5400]
2025-10-10T14:32:47.312737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:47.312746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:47.312749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:47.312751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:47.312761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125516:2438], now have 1 active actors on pipe
2025-10-10T14:32:47.312765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125653:6680], now have 1 active actors on pipe
2025-10-10T14:32:47.312770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:47.312785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:47.312789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:47.312815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601003268914254:5400]
2025-10-10T14:32:47.312827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:47.312846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:47.312859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 719
2025-10-10T14:32:47.312879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 719
2025-10-10T14:32:47.312974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.312986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.313013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:47.313024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.313029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.313031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:47.313044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.313063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:47.313083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.313271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.313280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.313298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.313392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 720 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0
2025-10-10T14:32:47.313824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f747244-3957322f-e7740f25-46f7fcbc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:47.316581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0] Write session: try to update token
2025-10-10T14:32:47.316598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:47.330607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId: src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:47.332054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:47.332077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.332081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:47.332083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:47.332093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601003268914254:5400]
2025-10-10T14:32:47.332097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601003268914254:5400]
2025-10-10T14:32:47.332101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601003268914254:5400]
2025-10-10T14:32:47.332147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:47.332149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:47.332157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.332159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:47.332161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:47.332164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:47.332299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:47.332956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:47.384788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601004051125819:6574]
2025-10-10T14:32:47.385094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 719, pipe: [1:7559601004051125819:6574]
2025-10-10T14:32:47.452966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:47.453908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.453924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.453964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125819:6574], now have 1 active actors on pipe
2025-10-10T14:32:47.454204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:47.454237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:47.454249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:47.454251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:47.454293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601004051125819:6574]
2025-10-10T14:32:47.454310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 720 reason: error at write: Disconnected sessionId: src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0
2025-10-10T14:32:47.454527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 720 sessionId: src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0 is DEAD
2025-10-10T14:32:47.454632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:47.454639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0] Write session will restart in 0.005898s
2025-10-10T14:32:47.454663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0] Write session: Do CDS request
2025-10-10T14:32:47.454673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:47.461821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.461921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:47.461934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 721
2025-10-10T14:32:47.462049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.462085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:47.462089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:47.462092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:47.462496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 721 sessionId:  describe result for acl check
2025-10-10T14:32:47.462533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:47.462539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:47.462541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:47.462547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601004051125837:6684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:47.463097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601004051125837:6684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:47.465093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601004051125837:6684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:47.468528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601004051125837:6684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:47.468541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601004051125837:6684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:47.468545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601004051125837:6684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:47.468552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:47.474035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:47.476768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:47.476936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:47.476951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:47.476961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:47.477001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:47.477032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601003268914559:5402]
2025-10-10T14:32:47.477452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:47.477717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:47.477746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:47.477960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:47.477998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.478003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.478004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.478005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.478006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.478006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.478007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.478008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.478008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.478009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.478009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.478010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.478010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.478014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.478023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.478026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.478028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.478031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.478033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.478035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.478037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.478040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.478042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.478044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.478047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.478049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.478055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.478060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.478064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.478067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.478070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.478073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.478076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.478079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.478081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.478085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.478087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.478090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.478093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.478098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.478100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.478103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.478106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.478109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.478111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.478114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.478118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.478125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.478128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.478131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.478136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.478142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.478164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:47.480254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:47.480535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:47.480543Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:47.480544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:47.480547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:47.480551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 720 [2:7559601003268914559:5402]
2025-10-10T14:32:47.480559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:47.480571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:47.480576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.480578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.480580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.480592Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:47.480597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:47.480605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:47.480655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.480659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.480661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.480663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:47.480710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:47.480716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.480723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.480730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.480740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:47.480754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601003268914554:5402]
2025-10-10T14:32:47.480760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601003268914554:5402]
2025-10-10T14:32:47.480761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601003268914554:5402]
2025-10-10T14:32:47.480767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:47.480775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:47.480781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125820:2438], now have 1 active actors on pipe
2025-10-10T14:32:47.480782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:47.480783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:47.480783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051125967:6684], now have 1 active actors on pipe
2025-10-10T14:32:47.480788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:47.480798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:47.480804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:47.480822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601003268914554:5402]
2025-10-10T14:32:47.480833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:47.480847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:47.480862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 720
2025-10-10T14:32:47.480870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 720
2025-10-10T14:32:47.480919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.480927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.480952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:47.480962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.480968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.480969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:47.480977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.480989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:47.481004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.481171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.481178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.481193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.481289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 721 partition: 0 MaxSeqNo: 40 sessionId: src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0
2025-10-10T14:32:47.481713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea768d0f-e5a57b60-68cdb9a2-9c514205_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:47.484225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0] Write session: try to update token
2025-10-10T14:32:47.484242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:47.497604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId: src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:47.497766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:47.497782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.497793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601003268914554:5402]
2025-10-10T14:32:47.497844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:47.497863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:47.498026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:47.498169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:47.498312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:47.498455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:47.498649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:47.498686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:47.500026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:47.500225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.500241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.500278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:47.500381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:47.508982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:47.508997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.508999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:47.509001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:47.509010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601003268914554:5402]
2025-10-10T14:32:47.509013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601003268914554:5402]
2025-10-10T14:32:47.509016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601003268914554:5402]
2025-10-10T14:32:47.509048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:47.509054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.509055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:47.509063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:47.509069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:47.509073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:47.509171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:47.554241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601004051126124:6574]
2025-10-10T14:32:47.554564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 720, pipe: [1:7559601004051126124:6574]
2025-10-10T14:32:47.614054Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:47.622270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.622298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.622480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.622547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.622613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.622676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.622722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.622732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.622803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.622865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.622932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.623023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.623299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.623312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.623381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.623440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.623506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.623569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.623611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.623620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.623688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.623756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.623822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.623889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.623937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.623944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.624032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.624090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.624153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.624215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.624263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.624271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.624336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.624393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.624457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.624520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.624564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.624570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.624635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.624695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.624761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.624828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.624868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.624876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.624944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.625018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.625078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.625133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.625174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.625177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.625245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.625303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.625389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.625452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.625501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.625508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.625581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:47.625650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:47.625720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:47.625786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:47.625839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:47.625847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:47.625907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051126124:6574], now have 1 active actors on pipe
2025-10-10T14:32:47.626231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:47.626242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601004051126124:6574]
2025-10-10T14:32:47.626274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:47.626277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:47.626309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 721 reason: error at write: Disconnected sessionId: src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0
2025-10-10T14:32:47.626578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 721 sessionId: src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0 is DEAD
2025-10-10T14:32:47.626706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:47.626722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0] Write session will restart in 0.009866s
2025-10-10T14:32:47.626741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0] Write session: Do CDS request
2025-10-10T14:32:47.626746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:47.626769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:47.637857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.637902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:47.637916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 722
2025-10-10T14:32:47.638181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.638226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:47.638234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:47.638238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:47.638740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 722 sessionId:  describe result for acl check
2025-10-10T14:32:47.638773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:47.638780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:47.638782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:47.638789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601004051126226:6690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:47.639342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601004051126226:6690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:47.642529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601004051126226:6690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:47.644908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601004051126226:6690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:47.644918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601004051126226:6690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:47.644921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601004051126226:6690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:47.644927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:47.648942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:47.649358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:47.649541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:47.649551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:47.649564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:47.649657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:47.649687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601003268914862:5405]
2025-10-10T14:32:47.650082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:47.650335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:47.650374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:47.650598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:47.650647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.650653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.650654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.650655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.650655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.650656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.650657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.650657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.650658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.650658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.650659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.650660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.650660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.650664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.650673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.650675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.650678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.650680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.650682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.650684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.650686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.650689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.650691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.650693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.650695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.650697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.650703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.650708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.650714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.650717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.650720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.650723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.650726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.650729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.650732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.650735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.650737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.650740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.650743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.650746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.650748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.650751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.650754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.650757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.650759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.650762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.650765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.650769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.650771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.650774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.650777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.650780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.650803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:47.652935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:47.653207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:47.653214Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:47.653216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:47.653219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:47.653223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 721 [2:7559601003268914862:5405]
2025-10-10T14:32:47.653231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:47.653243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:47.653249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.653251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.653252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.653265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:47.653270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:47.653281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:47.653320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.653325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.653327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.653349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:47.653406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:47.653412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.653419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.653425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.653435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:47.653450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601003268914857:5405]
2025-10-10T14:32:47.653455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601003268914857:5405]
2025-10-10T14:32:47.653458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601003268914857:5405]
2025-10-10T14:32:47.653466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:47.653474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:47.653477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:47.653479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:47.653485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051126428:6690], now have 1 active actors on pipe
2025-10-10T14:32:47.653493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051126135:2438], now have 1 active actors on pipe
2025-10-10T14:32:47.653500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:47.653520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 721
2025-10-10T14:32:47.653536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 721
2025-10-10T14:32:47.653529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:47.653536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:47.653560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601003268914857:5405]
2025-10-10T14:32:47.653567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:47.653569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:47.653584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.653592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.653649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:47.653659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.653665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.653666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:47.653674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.653682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:47.653706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.653864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.653890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.653913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.654014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 722 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0
2025-10-10T14:32:47.654376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d44148-fb07a7b8-4b4e8fbb-32f924d1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:47.656796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0] Write session: try to update token
2025-10-10T14:32:47.656812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:47.670266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId: src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:47.672197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:47.672213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.672215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:47.672216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:47.672223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601003268914857:5405]
2025-10-10T14:32:47.672227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601003268914857:5405]
2025-10-10T14:32:47.672229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601003268914857:5405]
2025-10-10T14:32:47.672266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:47.672272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.672274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:47.672280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:47.672290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:47.672301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:47.672406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:47.672657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:47.726263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601004051126442:6574]
2025-10-10T14:32:47.726535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 721, pipe: [1:7559601004051126442:6574]
2025-10-10T14:32:47.782472Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:47.783201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.783216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.783255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051126442:6574], now have 1 active actors on pipe
2025-10-10T14:32:47.783426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:47.783512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601004051126442:6574]
2025-10-10T14:32:47.783532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:47.783535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:47.783540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:47.783587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 722 reason: error at write: Disconnected sessionId: src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0
2025-10-10T14:32:47.783787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 722 sessionId: src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0 is DEAD
2025-10-10T14:32:47.783942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:47.783953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0] Write session will restart in 0.005924s
2025-10-10T14:32:47.783972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0] Write session: Do CDS request
2025-10-10T14:32:47.783976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:47.790799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.790898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:47.790911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 723
2025-10-10T14:32:47.791039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.791076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:47.791086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:47.791091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:47.791519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 723 sessionId:  describe result for acl check
2025-10-10T14:32:47.791553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:47.791557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:47.791559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:47.791564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601004051126464:6694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:47.792039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601004051126464:6694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:47.794919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601004051126464:6694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:47.797857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601004051126464:6694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:47.797877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601004051126464:6694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:47.797880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601004051126464:6694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:47.797885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:47.802729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:47.805325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:47.805486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:47.805496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:47.805504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:47.805542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:47.805575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601003268915164:5407]
2025-10-10T14:32:47.805957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:47.806193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:47.806227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:47.806447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:47.806485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.806490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.806491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.806491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.806492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.806493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.806493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.806494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.806494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.806495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.806495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.806496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.806496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.806500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.806509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.806511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.806514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.806516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.806518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.806520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.806522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.806524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.806526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.806528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.806530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.806532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.806537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.806543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.806548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.806551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.806554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.806557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.806559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.806563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.806566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.806569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.806572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.806575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.806578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.806581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.806583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.806586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.806588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.806591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.806594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.806597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.806599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.806602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.806605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.806607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.806610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.806613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.806634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:47.808772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:47.809050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:47.809059Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:47.809060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:47.809063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:47.809079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 722 [2:7559601003268915164:5407]
2025-10-10T14:32:47.809091Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:47.809107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:47.809112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.809114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.809116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.809128Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:47.809134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:47.809144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:47.809196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.809201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.809202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.809204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:47.809269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:47.809277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.809287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.809296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.809311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:47.809348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051126443:2438], now have 1 active actors on pipe
2025-10-10T14:32:47.809361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601003268915159:5407]
2025-10-10T14:32:47.809363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601003268915159:5407]
2025-10-10T14:32:47.809365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601003268915159:5407]
2025-10-10T14:32:47.809374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:47.809380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051126609:6694], now have 1 active actors on pipe
2025-10-10T14:32:47.809387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:47.809396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:47.809398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:47.809401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:47.809405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:47.809407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:47.809414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601003268915159:5407]
2025-10-10T14:32:47.809415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:47.809418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:47.809427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 722
2025-10-10T14:32:47.809439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 722
2025-10-10T14:32:47.809509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.809524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.809551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5731efa7-877045d-52bf6385-9103bab3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:47.809558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.809561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.809563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:47.809573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.809584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:47.809595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.809778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.809790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.809819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.809919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 723 partition: 0 MaxSeqNo: 40 sessionId: src_id|5731efa7-877045d-52bf6385-9103bab3_0
2025-10-10T14:32:47.810299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a10aea8-3d812261-da9e95f9-ee0f9cdd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5731efa7-877045d-52bf6385-9103bab3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:47.812907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5731efa7-877045d-52bf6385-9103bab3_0] Write session: try to update token
2025-10-10T14:32:47.812922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5731efa7-877045d-52bf6385-9103bab3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:47.826481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId: src_id|5731efa7-877045d-52bf6385-9103bab3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:47.827861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:47.827874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.827877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:47.827878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:47.827886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601003268915159:5407]
2025-10-10T14:32:47.827890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601003268915159:5407]
2025-10-10T14:32:47.827892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601003268915159:5407]
2025-10-10T14:32:47.827931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:47.827937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.827939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:47.827944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:47.827950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:47.827954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:47.828067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:47.828976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:47.883465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601004051126748:6574]
2025-10-10T14:32:47.883787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 722, pipe: [1:7559601004051126748:6574]
2025-10-10T14:32:47.930980Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:47.931594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.931608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.931648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051126748:6574], now have 1 active actors on pipe
2025-10-10T14:32:47.931873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:47.931909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:47.931920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:47.931924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:47.931967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601004051126748:6574]
2025-10-10T14:32:47.931977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 723 reason: error at write: Disconnected sessionId: src_id|5731efa7-877045d-52bf6385-9103bab3_0
2025-10-10T14:32:47.932165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 723 sessionId: src_id|5731efa7-877045d-52bf6385-9103bab3_0 is DEAD
2025-10-10T14:32:47.932336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731efa7-877045d-52bf6385-9103bab3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:47.932343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731efa7-877045d-52bf6385-9103bab3_0] Write session will restart in 0.009270s
2025-10-10T14:32:47.932361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731efa7-877045d-52bf6385-9103bab3_0] Write session: Do CDS request
2025-10-10T14:32:47.932369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731efa7-877045d-52bf6385-9103bab3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:47.942825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5731efa7-877045d-52bf6385-9103bab3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.942920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:47.942936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 724
2025-10-10T14:32:47.943050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:47.943085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:47.943094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:47.943103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:47.943503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 724 sessionId:  describe result for acl check
2025-10-10T14:32:47.943544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:47.943549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:47.943550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:47.943554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601004051126848:6698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:47.943991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601004051126848:6698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:47.946865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601004051126848:6698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:47.949605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601004051126848:6698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:47.949621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601004051126848:6698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:47.949625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601004051126848:6698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:47.949632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:47.951295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:47.954286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:47.954494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:47.954505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:47.954517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:47.954585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:47.954628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601003268915467:5409]
2025-10-10T14:32:47.955287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:47.955586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:47.955651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:47.955988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:47.956063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.956069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.956070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.956071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.956072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.956073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.956074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.956075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.956076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.956077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.956078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.956079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.956081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.956087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.956099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.956103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.956106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.956110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.956113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.956116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.956121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.956124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.956128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.956132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.956135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.956139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.956147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.956155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:47.956161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.956166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:47.956169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.956179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:47.956183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.956193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:47.956202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.956206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:47.956210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.956215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:47.956219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.956224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:47.956228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.956233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:47.956238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.956243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:47.956253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.956258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:47.956263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.956272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.956276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.956280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.956290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.956295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.956356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:47.958636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:47.958946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:47.958958Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:47.958961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:47.958965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:47.958971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 723 [2:7559601003268915467:5409]
2025-10-10T14:32:47.958982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:47.959010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:47.959018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.959022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.959025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.959042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:47.959053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:47.959065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:47.959127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.959134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.959135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.959137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:47.959184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:47.959189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.959197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:47.959206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:47.959220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:47.959239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051126749:2438], now have 1 active actors on pipe
2025-10-10T14:32:47.959248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601004051127041:6698], now have 1 active actors on pipe
2025-10-10T14:32:47.959254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601003268915462:5409]
2025-10-10T14:32:47.959260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601003268915462:5409]
2025-10-10T14:32:47.959262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601003268915462:5409]
2025-10-10T14:32:47.959276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:47.959292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:47.959293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:47.959301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:47.959303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:47.959309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:47.959312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:47.959332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601003268915462:5409]
2025-10-10T14:32:47.959339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:47.959322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 723
2025-10-10T14:32:47.959347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:47.959336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 723
2025-10-10T14:32:47.959373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.959382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.959420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:47.959431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:47.959437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:47.959439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:47.959447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:47.959460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:47.959475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.959613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:47.959621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:47.959635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:47.959709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 724 partition: 0 MaxSeqNo: 40 sessionId: src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0
2025-10-10T14:32:47.960070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5731efa7-877045d-52bf6385-9103bab3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:47.962638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0] Write session: try to update token
2025-10-10T14:32:47.962652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:47.976172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId: src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:47.978700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:47.978725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:47.978729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:47.978731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:47.978743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601003268915462:5409]
2025-10-10T14:32:47.978747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601003268915462:5409]
2025-10-10T14:32:47.978751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601003268915462:5409]
2025-10-10T14:32:47.978799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:47.978812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:47.978814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:47.978822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:47.978837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:47.978841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:47.978851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:47.978950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:48.031944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601008346094351:6574]
2025-10-10T14:32:48.032242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 723, pipe: [1:7559601008346094351:6574]
2025-10-10T14:32:48.085656Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:48.086217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.086231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.086275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346094351:6574], now have 1 active actors on pipe
2025-10-10T14:32:48.086471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:48.086476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:48.086483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:48.086509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601008346094351:6574]
2025-10-10T14:32:48.086546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:48.086578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 724 reason: error at write: Disconnected sessionId: src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0
2025-10-10T14:32:48.086807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 724 sessionId: src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0 is DEAD
2025-10-10T14:32:48.087016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:48.087028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0] Write session will restart in 0.005170s
2025-10-10T14:32:48.087060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0] Write session: Do CDS request
2025-10-10T14:32:48.087065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:48.093857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.093914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:48.093929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 725
2025-10-10T14:32:48.094098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.094136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:48.094147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:48.094152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:48.094625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 725 sessionId:  describe result for acl check
2025-10-10T14:32:48.094656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:48.094663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:48.094664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:48.094671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601008346094372:6702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:48.095235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601008346094372:6702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:48.097949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601008346094372:6702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:48.101169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601008346094372:6702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:48.101184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601008346094372:6702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:48.101187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601008346094372:6702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:48.101196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:48.106810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:48.109601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:48.109782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:48.109792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:48.109800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:48.109840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:48.109872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601007563883067:5411]
2025-10-10T14:32:48.110306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:48.110580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:48.110617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:48.110856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:48.110900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.110903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.110904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.110905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.110905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.110906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.110907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.110908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.110908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.110909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.110910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.110911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.110912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.110916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.110925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.110928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.110930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.110933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.110935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.110937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.110940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.110942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.110944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.110946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.110949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.110951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.110957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.110963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.110969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.110972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.110975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.110978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.110985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.110988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.111001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.111006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.111012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.111015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.111018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.111021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.111028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.111031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.111034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.111039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.111042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.111048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.111051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.111054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.111057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.111060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.111062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.111069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.111091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:48.113323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:48.113817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:48.113830Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:48.113832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:48.113836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:48.113843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 724 [2:7559601007563883067:5411]
2025-10-10T14:32:48.113854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:48.113870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:48.113878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.113881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.113883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.113898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:48.113905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:48.113917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:48.113970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.113975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.113976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.113979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:48.114040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:48.114048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.114057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.114063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.114077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:48.114102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346094518:6702], now have 1 active actors on pipe
2025-10-10T14:32:48.114109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346094352:2438], now have 1 active actors on pipe
2025-10-10T14:32:48.114115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601007563883062:5411]
2025-10-10T14:32:48.114121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601007563883062:5411]
2025-10-10T14:32:48.114123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601007563883062:5411]
2025-10-10T14:32:48.114135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:48.114153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:48.114154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:48.114161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:48.114163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:48.114171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:48.114174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:48.114194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601007563883062:5411]
2025-10-10T14:32:48.114201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:48.114215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:48.114193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 724
2025-10-10T14:32:48.114270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 724
2025-10-10T14:32:48.114317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.114329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.114358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:48.114370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.114378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.114380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:48.114392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.114406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:48.114424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.114580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.114589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.114604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.114687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 725 partition: 0 MaxSeqNo: 40 sessionId: src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0
2025-10-10T14:32:48.115096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf4dab3-a619582a-ecdf5f69-9ffd6eab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:48.117670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0] Write session: try to update token
2025-10-10T14:32:48.117686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:48.131065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId: src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:48.133606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:48.133624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:48.133627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:48.133629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:48.133638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601007563883062:5411]
2025-10-10T14:32:48.133642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601007563883062:5411]
2025-10-10T14:32:48.133646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601007563883062:5411]
2025-10-10T14:32:48.133687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:48.133693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:48.133696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:48.133696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:48.133704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.133706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:48.133689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:48.133838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:48.186569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601008346094659:6574]
2025-10-10T14:32:48.186815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 724, pipe: [1:7559601008346094659:6574]
2025-10-10T14:32:48.240938Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:48.241221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.241232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.241267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346094659:6574], now have 1 active actors on pipe
2025-10-10T14:32:48.241443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:48.241493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601008346094659:6574]
2025-10-10T14:32:48.241521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:48.241580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 725 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0
2025-10-10T14:32:48.241709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 725 sessionId: src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0 is DEAD
2025-10-10T14:32:48.241861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:48.241943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:48.241951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0] Write session will restart in 0.008558s
2025-10-10T14:32:48.241969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0] Write session: Do CDS request
2025-10-10T14:32:48.241974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:48.251712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.251792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:48.251804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 726
2025-10-10T14:32:48.251924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.251956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:48.251965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:48.251969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:48.252319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 726 sessionId:  describe result for acl check
2025-10-10T14:32:48.252346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:48.252353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:48.252355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:48.252360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601008346094783:6713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:48.252794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601008346094783:6713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:48.255522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601008346094783:6713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:48.258223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601008346094783:6713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:48.258236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601008346094783:6713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:48.258239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601008346094783:6713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:48.258245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:48.258591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:48.260962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:48.261553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:48.261569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:48.261583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:48.261676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:48.261715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601007563883406:5420]
2025-10-10T14:32:48.262245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:48.262514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:48.262549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:48.262775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:48.262816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.262820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.262821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.262821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.262822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.262823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.262823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.262824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.262825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.262825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.262826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.262826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.262827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.262831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.262838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.262840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.262842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.262845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.262847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.262849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.262851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.262853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.262855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.262857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.262859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.262861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.262866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.262872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.262876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.262879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.262882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.262885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.262887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.262891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.262893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.262897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.262900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.262905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.262910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.262914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.262918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.262923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.262929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.262935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.262938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.262941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.262944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.262947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.262949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.262952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.262955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.262958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.262979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:48.265052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:48.265402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:48.265415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:48.265417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:48.265420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:48.265425Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 725 [2:7559601007563883406:5420]
2025-10-10T14:32:48.265434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:48.265446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:48.265448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.265450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.265451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.265462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:48.265468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:48.265474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:48.265510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.265516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.265517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.265518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:48.265572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:48.265579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.265590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.265606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.265623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:48.265640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346094978:6713], now have 1 active actors on pipe
2025-10-10T14:32:48.265646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346094685:2438], now have 1 active actors on pipe
2025-10-10T14:32:48.265652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601007563883396:5420]
2025-10-10T14:32:48.265653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601007563883396:5420]
2025-10-10T14:32:48.265655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601007563883396:5420]
2025-10-10T14:32:48.265665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:48.265674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:48.265676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:48.265677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:48.265682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:48.265681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 725
2025-10-10T14:32:48.265699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:48.265718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 725
2025-10-10T14:32:48.265705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:48.265730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.265737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.265747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601007563883396:5420]
2025-10-10T14:32:48.265753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:48.265754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:48.265778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:48.265791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.265799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.265801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:48.265811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.265821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:48.265947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.266089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.266097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.266111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.266193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 726 partition: 0 MaxSeqNo: 40 sessionId: src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0
2025-10-10T14:32:48.266535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe76d0b-ade7a22d-c88fa0d6-790c6c0b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:48.269248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0] Write session: try to update token
2025-10-10T14:32:48.269266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:48.283932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId: src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:48.284597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:48.284615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:48.284619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:48.284621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:48.284630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601007563883396:5420]
2025-10-10T14:32:48.284634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601007563883396:5420]
2025-10-10T14:32:48.284641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601007563883396:5420]
2025-10-10T14:32:48.284692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:48.284692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:48.284698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:48.284701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:48.284703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.284706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:48.284852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:48.286523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:48.341720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601008346095006:6574]
2025-10-10T14:32:48.342007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 725, pipe: [1:7559601008346095006:6574]
2025-10-10T14:32:48.390424Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:48.390840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.390859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.390904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095006:6574], now have 1 active actors on pipe
2025-10-10T14:32:48.391126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:48.391155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601008346095006:6574]
2025-10-10T14:32:48.391189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:48.391202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:48.391278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 726 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0
2025-10-10T14:32:48.391562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 726 sessionId: src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0 is DEAD
2025-10-10T14:32:48.391703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:48.391715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0] Write session will restart in 0.007849s
2025-10-10T14:32:48.391742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0] Write session: Do CDS request
2025-10-10T14:32:48.391748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:48.399236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:48.400750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:48.400960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.400947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:48.400960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:48.400971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:48.400986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:48.401002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 727
2025-10-10T14:32:48.401022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:48.401062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601007563883488:5429]
2025-10-10T14:32:48.401212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.401239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:48.401247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:48.401252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:48.401661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:48.401711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 727 sessionId:  describe result for acl check
2025-10-10T14:32:48.401745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:48.401752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:48.401754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:48.401760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601008346095026:6720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:48.401924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:48.401972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:48.402239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:48.402259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601008346095026:6720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:48.402285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.402291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.402292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.402293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.402295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.402298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.402299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.402300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.402301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.402303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.402304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.402305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.402306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.402312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.402323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.402325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.402328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.402330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.402332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.402334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.402337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.402339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.402341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.402343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.402346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.402348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.402353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.402359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.402364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.402368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.402371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.402374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.402377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.402380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.402383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.402386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.402389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.402392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.402396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.402400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.402405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.402415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.402420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.402429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.402437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.402443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.402450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.402453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.402455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.402458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.402461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.402470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.402492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:48.404726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601008346095026:6720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:48.404847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:48.405162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:48.405175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:48.405177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:48.405181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:48.405186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 726 [2:7559601007563883488:5429]
2025-10-10T14:32:48.405199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:48.405219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:48.405223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.405226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.405228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.405245Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:48.405253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:48.405261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:48.405344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.405355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.405357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.405359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:48.405429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:48.405437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.405449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.405463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.405484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:48.405509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095007:2438], now have 1 active actors on pipe
2025-10-10T14:32:48.405515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 726
2025-10-10T14:32:48.405523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601007563883483:5429]
2025-10-10T14:32:48.405525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601007563883483:5429]
2025-10-10T14:32:48.405527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601007563883483:5429]
2025-10-10T14:32:48.405540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:48.405555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:48.405558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:48.405562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:48.405564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:48.405573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:48.405581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:48.405609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601007563883483:5429]
2025-10-10T14:32:48.405620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:48.405634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:48.410703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601008346095026:6720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:48.410721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601008346095026:6720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:48.410726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601008346095026:6720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:48.410735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:48.411008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095064:6720], now have 1 active actors on pipe
2025-10-10T14:32:48.411043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 726
2025-10-10T14:32:48.411098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.411112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.411146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:48.411165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.411175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.411178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:48.411193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.411216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:48.411239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.411439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.411447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.411463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.411537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 727 partition: 0 MaxSeqNo: 40 sessionId: src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0
2025-10-10T14:32:48.411879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2987b827-5fe6524a-308a13fe-6eecbe08_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:48.414633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0] Write session: try to update token
2025-10-10T14:32:48.414649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:48.422913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:48.422930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:48.422939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601007563883483:5429]
2025-10-10T14:32:48.422991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:48.423004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:48.423223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:48.423372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:48.423519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:48.423674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:48.423905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:48.423953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:48.429148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId: src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:48.431825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:48.432024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.432046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.432085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:48.432173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:48.434415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:48.434436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:48.434438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:48.434440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:48.434450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601007563883483:5429]
2025-10-10T14:32:48.434454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601007563883483:5429]
2025-10-10T14:32:48.434458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601007563883483:5429]
2025-10-10T14:32:48.434499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:48.434504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:48.434511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:48.434512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.434514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:48.434514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:48.434659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:48.491166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601008346095068:6574]
2025-10-10T14:32:48.491444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 726, pipe: [1:7559601008346095068:6574]
2025-10-10T14:32:48.540608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:48.547851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.547877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.548042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.548099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.548163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.548234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.548301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.548314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.548431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.548563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.548694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.548816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.548890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.548903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.548980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.549049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.549129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.549206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.549259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.549268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.549424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.549518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.549598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.549700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.549751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.549759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.549858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.549963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.550069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.550158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.550209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.550218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.550292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.550378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.550482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.550554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.550605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.550614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.550687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.550765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.550842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.550917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.550969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.550978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.551065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.551134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.551203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.551275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.551323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.551331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.551399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.551461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.551520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.551584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.551628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.551635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.551705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:48.551770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:48.551835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:48.551902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:48.551945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:48.551953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:48.552008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095068:6574], now have 1 active actors on pipe
2025-10-10T14:32:48.552214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:48.552224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:48.552228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:48.552261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 727 reason: error at write: Disconnected sessionId: src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0
2025-10-10T14:32:48.552290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601008346095068:6574]
2025-10-10T14:32:48.552478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 727 sessionId: src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0 is DEAD
2025-10-10T14:32:48.552611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:48.552622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0] Write session will restart in 0.009130s
2025-10-10T14:32:48.552641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0] Write session: Do CDS request
2025-10-10T14:32:48.552645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:48.552933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:48.560633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:48.561993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:48.562212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:48.562230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:48.562244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:48.562322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:48.562371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601007563883546:5431]
2025-10-10T14:32:48.562835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.562838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:48.562967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:48.562980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 728
2025-10-10T14:32:48.563094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.563128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:48.563136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:48.563139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:48.563136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:48.563188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:48.563502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:48.563561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.563567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.563569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.563570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.563571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.563572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.563574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.563575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.563576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.563578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.563579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.563580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.563581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.563586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.563598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.563609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 728 sessionId:  describe result for acl check
2025-10-10T14:32:48.563602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.563606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.563611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.563616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.563620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.563624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.563647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:48.563654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:48.563628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.563633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.563636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.563656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:48.563640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.563662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601008346095093:6724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:48.563644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.563651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.563661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.563667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.563673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.563677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.563682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.563687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.563692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.563698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.563703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.563707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.563712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.563717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.563722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.563726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.563731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.563736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.563741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.563745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.563750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.563755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.563760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.563764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.563770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.563776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.563781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.563823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:48.564197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601008346095093:6724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:48.566123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:48.566469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:48.566492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:48.566494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:48.566500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:48.566507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 727 [2:7559601007563883546:5431]
2025-10-10T14:32:48.566520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:48.566542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:48.566561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.566568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.566571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.566587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:48.566599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:48.566606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:48.566665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.566672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.566674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.566677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:48.566740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:48.566748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.566759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.566770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.566786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:48.566812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095069:2438], now have 1 active actors on pipe
2025-10-10T14:32:48.566824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601007563883541:5431]
2025-10-10T14:32:48.566826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601007563883541:5431]
2025-10-10T14:32:48.566828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601007563883541:5431]
2025-10-10T14:32:48.566835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:48.566851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:48.566824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 727
2025-10-10T14:32:48.566854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:48.566860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:48.566863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:48.566870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:48.566876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:48.566900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601007563883541:5431]
2025-10-10T14:32:48.566912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:48.566924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:48.566994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601008346095093:6724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:48.572913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601008346095093:6724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:48.572927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601008346095093:6724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:48.572931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601008346095093:6724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:48.572940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:48.573163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095133:6724], now have 1 active actors on pipe
2025-10-10T14:32:48.573214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 727
2025-10-10T14:32:48.573289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.573303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.573352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:48.573369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.573375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.573378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:48.573391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.573413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:48.573435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.573598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.573606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.573621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.573707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 728 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0
2025-10-10T14:32:48.574048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|491c900f-91fabdb7-a35487d1-1db6bef2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:48.576672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0] Write session: try to update token
2025-10-10T14:32:48.576691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:48.585443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:48.585465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:48.585472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:48.585475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:48.585491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601007563883541:5431]
2025-10-10T14:32:48.585497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601007563883541:5431]
2025-10-10T14:32:48.585503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601007563883541:5431]
2025-10-10T14:32:48.585551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:48.585556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:48.585564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:48.585567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.585569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:48.585570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:48.585771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:48.590465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId: src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:48.592958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:48.652479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601008346095140:6574]
2025-10-10T14:32:48.652744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 727, pipe: [1:7559601008346095140:6574]
2025-10-10T14:32:48.689923Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:48.690219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.690232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.690268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095140:6574], now have 1 active actors on pipe
2025-10-10T14:32:48.690474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601008346095140:6574]
2025-10-10T14:32:48.690483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:48.690487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:48.690508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:48.690546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 728 reason: error at write: Disconnected sessionId: src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0
2025-10-10T14:32:48.690744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 728 sessionId: src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0 is DEAD
2025-10-10T14:32:48.690865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:48.690928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:48.690940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0] Write session will restart in 0.006801s
2025-10-10T14:32:48.690965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0] Write session: Do CDS request
2025-10-10T14:32:48.690971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:48.697082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:48.698415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:48.698586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:48.698597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:48.698609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:48.698656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:48.698699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601007563883607:5434]
2025-10-10T14:32:48.698798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.698894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:48.698907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 729
2025-10-10T14:32:48.699028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.699057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:48.699067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:48.699070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:48.699296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:48.699443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 729 sessionId:  describe result for acl check
2025-10-10T14:32:48.699485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:48.699491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:48.699493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:48.699498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601008346095163:6730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:48.699572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:48.699616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:48.699907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:48.699967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.699974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.699975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.699976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.699977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.699978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.699979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.699980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.699983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.699984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.699985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.699986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.699987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.700011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601008346095163:6730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:48.699993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.700005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.700009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.700013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.700016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.700022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.700026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.700030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.700034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.700037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.700041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.700046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.700050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.700057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.700064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.700071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.700078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.700082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.700088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.700092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.700097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.700101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.700107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.700111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.700116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.700121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.700127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.700130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.700135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.700140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.700145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.700148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.700153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.700157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.700162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.700166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.700170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.700174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.700179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.700218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:48.701968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601008346095163:6730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:48.702327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:48.702633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:48.702646Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:48.702648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:48.702652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:48.702657Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 728 [2:7559601007563883607:5434]
2025-10-10T14:32:48.702665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:48.702676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:48.702677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.702679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.702681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.702693Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:48.702705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:48.702721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:48.702771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.702776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.702777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.702779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:48.702823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:48.702829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.702836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.702843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.702856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:48.702874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095141:2438], now have 1 active actors on pipe
2025-10-10T14:32:48.702883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601007563883602:5434]
2025-10-10T14:32:48.702885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601007563883602:5434]
2025-10-10T14:32:48.702886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601007563883602:5434]
2025-10-10T14:32:48.702884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 728
2025-10-10T14:32:48.702896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:48.702911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:48.702911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:48.702914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:48.702916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:48.702930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:48.702933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:48.702956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601007563883602:5434]
2025-10-10T14:32:48.702968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:48.702979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:48.707246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601008346095163:6730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:48.707259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601008346095163:6730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:48.707262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601008346095163:6730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:48.707269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:48.707471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095199:6730], now have 1 active actors on pipe
2025-10-10T14:32:48.707511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 728
2025-10-10T14:32:48.707574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.707586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.707615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:48.707629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.707638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.707642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:48.707653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.707670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:48.707689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.707862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.707871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.707886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.707971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 729 partition: 0 MaxSeqNo: 40 sessionId: src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0
2025-10-10T14:32:48.708252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff833ca-eec8edd3-d296ee0b-723d4b27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:48.711114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0] Write session: try to update token
2025-10-10T14:32:48.711128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:48.721010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:48.721031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:48.721034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:48.721036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:48.721045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601007563883602:5434]
2025-10-10T14:32:48.721049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601007563883602:5434]
2025-10-10T14:32:48.721055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601007563883602:5434]
2025-10-10T14:32:48.721102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:48.721104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:48.721111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:48.721111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.721114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:48.721128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:48.721256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:48.725485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId: src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:48.728022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:48.790730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601008346095202:6574]
2025-10-10T14:32:48.790953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 728, pipe: [1:7559601008346095202:6574]
2025-10-10T14:32:48.825425Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:48.825663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.825676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.825714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095202:6574], now have 1 active actors on pipe
2025-10-10T14:32:48.825891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:48.825962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:48.825962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:48.825967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:48.826026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601008346095202:6574]
2025-10-10T14:32:48.826034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 729 reason: error at write: Disconnected sessionId: src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0
2025-10-10T14:32:48.826271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 729 sessionId: src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0 is DEAD
2025-10-10T14:32:48.826439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:48.826451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0] Write session will restart in 0.005212s
2025-10-10T14:32:48.826478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0] Write session: Do CDS request
2025-10-10T14:32:48.826484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:48.832895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.833019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:48.833034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 730
2025-10-10T14:32:48.833177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.833215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:48.833228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:48.833231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:48.833691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 730 sessionId:  describe result for acl check
2025-10-10T14:32:48.833725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:48.833731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:48.833733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:48.833740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601008346095223:6734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:48.834314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601008346095223:6734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:48.834440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:48.835984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:48.836180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:48.836191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:48.836201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:48.836245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:48.836253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601008346095223:6734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:48.836285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601007563883665:5436]
2025-10-10T14:32:48.836717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:48.836988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:48.837041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:48.837282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:48.837326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.837347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.837349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.837350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.837351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.837353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.837354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.837355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.837357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.837360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.837361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.837362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.837363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.837368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.837377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.837379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.837381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.837383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.837386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.837388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.837398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.837402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.837406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.837410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.837414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.837421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.837430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.837435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.837439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.837442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.837445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.837447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.837451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.837454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.837457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.837459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.837463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.837466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.837469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.837473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.837476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.837479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.837482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.837486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.837489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.837492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.837495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.837498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.837501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.837504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.837507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.837530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:48.839673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601008346095223:6734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:48.839684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601008346095223:6734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:48.839695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601008346095223:6734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:48.839702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:48.839779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:48.840114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:48.840124Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:48.840126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:48.840130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:48.840136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 729 [2:7559601007563883665:5436]
2025-10-10T14:32:48.840148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:48.840169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:48.840175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.840179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.840182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.840199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:48.840209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:48.840218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:48.840279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.840285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.840287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.840289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:48.840356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:48.840364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.840374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.840391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.840413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:48.840441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095259:6734], now have 1 active actors on pipe
2025-10-10T14:32:48.840449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095204:2438], now have 1 active actors on pipe
2025-10-10T14:32:48.840456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601007563883660:5436]
2025-10-10T14:32:48.840461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 729
2025-10-10T14:32:48.840458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601007563883660:5436]
2025-10-10T14:32:48.840460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601007563883660:5436]
2025-10-10T14:32:48.840473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:48.840469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 729
2025-10-10T14:32:48.840485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:48.840487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:48.840487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:48.840488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:48.840502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:48.840512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:48.840550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.840559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.840573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601007563883660:5436]
2025-10-10T14:32:48.840584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:48.840588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:48.840615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:48.840626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.840630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.840637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:48.840650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.840664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:48.840688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.840834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.840843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.840857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.840947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 730 partition: 0 MaxSeqNo: 40 sessionId: src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0
2025-10-10T14:32:48.841320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e207a4e9-cd8c778f-830412ac-5ec584d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:48.843938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0] Write session: try to update token
2025-10-10T14:32:48.843953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:48.858391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId: src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:48.859036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:48.859058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:48.859061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:48.859064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:48.859074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601007563883660:5436]
2025-10-10T14:32:48.859078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601007563883660:5436]
2025-10-10T14:32:48.859083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601007563883660:5436]
2025-10-10T14:32:48.859136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:48.859137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:48.859141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:48.859144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:48.859144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.859147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:48.859315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:48.861144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:48.926386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601008346095266:6574]
2025-10-10T14:32:48.926692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 729, pipe: [1:7559601008346095266:6574]
2025-10-10T14:32:48.965984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:48.966253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.966268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.966313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095266:6574], now have 1 active actors on pipe
2025-10-10T14:32:48.966567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:48.966582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:48.966597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601008346095266:6574]
2025-10-10T14:32:48.966619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:48.966675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 730 reason: error at write: Disconnected sessionId: src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0
2025-10-10T14:32:48.966761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:48.966861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 730 sessionId: src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0 is DEAD
2025-10-10T14:32:48.967032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:48.967044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0] Write session will restart in 0.005033s
2025-10-10T14:32:48.967069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0] Write session: Do CDS request
2025-10-10T14:32:48.967079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:48.972803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.972900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:48.972912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 731
2025-10-10T14:32:48.973024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:48.973060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:48.973080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:48.973084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:48.973498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 731 sessionId:  describe result for acl check
2025-10-10T14:32:48.973530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:48.973532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:48.973534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:48.973539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601008346095287:6738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:48.974076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601008346095287:6738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:48.974519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:48.975853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:48.975987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:48.975996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:48.976005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:48.976054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:48.976091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601007563883726:5438]
2025-10-10T14:32:48.976075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601008346095287:6738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:48.976596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:48.976825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:48.976867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:48.977087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:48.977139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.977145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.977146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.977146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.977147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.977148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.977148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.977149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.977150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.977152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.977153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.977153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.977154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.977158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.977165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.977167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.977169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.977172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.977174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.977176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.977178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.977181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.977183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.977185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.977187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.977189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.977194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.977200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:48.977204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.977207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:48.977210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.977213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:48.977215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.977218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:48.977221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.977224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:48.977226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.977229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:48.977232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.977237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:48.977243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.977248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:48.977253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.977259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:48.977263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.977268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:48.977272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.977275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.977278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.977281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.977283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.977286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.977308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:48.979327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601008346095287:6738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:48.979341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601008346095287:6738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:48.979345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601008346095287:6738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:48.979352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:48.979402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:48.979707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:48.979719Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:48.979721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:48.979724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:48.979729Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 730 [2:7559601007563883726:5438]
2025-10-10T14:32:48.979740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:48.979754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:48.979761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.979763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.979765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.979778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:48.979785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:48.979807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:48.979857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.979864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.979866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.979868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:48.979926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:48.979934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:48.979944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:48.979954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:48.979975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:48.979998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095324:6738], now have 1 active actors on pipe
2025-10-10T14:32:48.980007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601008346095268:2438], now have 1 active actors on pipe
2025-10-10T14:32:48.980015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601007563883721:5438]
2025-10-10T14:32:48.980017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601007563883721:5438]
2025-10-10T14:32:48.980019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601007563883721:5438]
2025-10-10T14:32:48.980032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:48.980045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:48.980049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:48.980054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:48.980056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:48.980065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:48.980068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:48.980040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 730
2025-10-10T14:32:48.980063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 730
2025-10-10T14:32:48.980089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601007563883721:5438]
2025-10-10T14:32:48.980100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:48.980101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:48.980124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.980129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.980161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:48.980173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:48.980177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:48.980179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:48.980189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:48.980199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:48.980220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.980337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:48.980345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:48.980361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:48.980443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 731 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0
2025-10-10T14:32:48.980730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246be903-2b4c266b-2a6a1ad4-4a2370b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:48.983177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0] Write session: try to update token
2025-10-10T14:32:48.983192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:48.996743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId: src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:49.003803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:49.003821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.003825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:49.003827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:49.003837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601007563883721:5438]
2025-10-10T14:32:49.003845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601007563883721:5438]
2025-10-10T14:32:49.003849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601007563883721:5438]
2025-10-10T14:32:49.003900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:49.003912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:49.003917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:49.003922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:49.003930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.003938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:49.004274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:49.006043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:49.066708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601012641062627:6574]
2025-10-10T14:32:49.066970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 730, pipe: [1:7559601012641062627:6574]
2025-10-10T14:32:49.112972Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:49.113312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.113344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.113391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062627:6574], now have 1 active actors on pipe
2025-10-10T14:32:49.113571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:49.113668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601012641062627:6574]
2025-10-10T14:32:49.113692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:49.113706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:49.113777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 731 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0
2025-10-10T14:32:49.113981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 731 sessionId: src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0 is DEAD
2025-10-10T14:32:49.114103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:49.114112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0] Write session will restart in 0.005996s
2025-10-10T14:32:49.114132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0] Write session: Do CDS request
2025-10-10T14:32:49.114137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:49.120812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.120928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:49.120942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 732
2025-10-10T14:32:49.121085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.121123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:49.121131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:49.121134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:49.121248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:49.121556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 732 sessionId:  describe result for acl check
2025-10-10T14:32:49.121592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:49.121599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:49.121601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:49.121607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601012641062651:6742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:49.122067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601012641062651:6742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:49.122717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:49.122885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:49.122897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:49.122909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:49.122958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:49.123000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601011858851084:5440]
2025-10-10T14:32:49.123608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:49.123836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:49.123871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:49.123922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601012641062651:6742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:49.124174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:49.124228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.124234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.124235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.124238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.124240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.124241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.124242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.124244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.124245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.124246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.124247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.124248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.124250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.124256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.124268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.124272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.124277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.124281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.124286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.124290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.124294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.124298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.124302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.124306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.124310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.124313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.124321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.124329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.124335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.124346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.124350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.124356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.124360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.124366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.124371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.124380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.124385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.124390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.124394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.124399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.124406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.124412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.124415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.124420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.124426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.124431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.124434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.124438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.124441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.124447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.124454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.124459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.124500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:49.126564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601012641062651:6742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:49.126578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601012641062651:6742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:49.126581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601012641062651:6742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:49.126588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:49.126656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:49.126975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:49.126986Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:49.126989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:49.126992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:49.126998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 731 [2:7559601011858851084:5440]
2025-10-10T14:32:49.127020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:49.127037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:49.127046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.127050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.127052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.127072Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:49.127084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:49.127092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:49.127149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.127156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.127158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.127161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:49.127222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:49.127229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.127242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.127254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.127273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:49.127299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062629:2438], now have 1 active actors on pipe
2025-10-10T14:32:49.127307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062687:6742], now have 1 active actors on pipe
2025-10-10T14:32:49.127314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601011858851079:5440]
2025-10-10T14:32:49.127316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601011858851079:5440]
2025-10-10T14:32:49.127318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601011858851079:5440]
2025-10-10T14:32:49.127331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:49.127322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 731
2025-10-10T14:32:49.127349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:49.127324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 731
2025-10-10T14:32:49.127350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:49.127353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:49.127355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:49.127370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:49.127373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:49.127420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.127430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.127444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601011858851079:5440]
2025-10-10T14:32:49.127455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:49.127462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:49.127485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28cfb751-5754dd34-2702614b-41070c3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:49.127498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.127503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.127507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:49.127517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.127529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:49.127550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.127682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.127692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.127708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.127826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 732 partition: 0 MaxSeqNo: 40 sessionId: src_id|28cfb751-5754dd34-2702614b-41070c3b_0
2025-10-10T14:32:49.128111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a5baa9-c185ea8b-37e837f-7b606771_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28cfb751-5754dd34-2702614b-41070c3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:49.130583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28cfb751-5754dd34-2702614b-41070c3b_0] Write session: try to update token
2025-10-10T14:32:49.130597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28cfb751-5754dd34-2702614b-41070c3b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:49.144653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId: src_id|28cfb751-5754dd34-2702614b-41070c3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:49.148360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:49.148378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.148380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:49.148382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:49.148390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601011858851079:5440]
2025-10-10T14:32:49.148393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601011858851079:5440]
2025-10-10T14:32:49.148396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601011858851079:5440]
2025-10-10T14:32:49.148434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:49.148434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:49.148440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:49.148441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.148442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:49.148457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:49.148579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:49.149891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:49.213627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601012641062694:6574]
2025-10-10T14:32:49.213880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 731, pipe: [1:7559601012641062694:6574]
2025-10-10T14:32:49.253135Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:49.253358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.253376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.253417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062694:6574], now have 1 active actors on pipe
2025-10-10T14:32:49.253598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:49.253622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:49.253612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:49.253636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:49.253672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 732 reason: error at write: Disconnected sessionId: src_id|28cfb751-5754dd34-2702614b-41070c3b_0
2025-10-10T14:32:49.253680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601012641062694:6574]
2025-10-10T14:32:49.253868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 732 sessionId: src_id|28cfb751-5754dd34-2702614b-41070c3b_0 is DEAD
2025-10-10T14:32:49.254041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28cfb751-5754dd34-2702614b-41070c3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:49.254053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28cfb751-5754dd34-2702614b-41070c3b_0] Write session will restart in 0.006112s
2025-10-10T14:32:49.254078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28cfb751-5754dd34-2702614b-41070c3b_0] Write session: Do CDS request
2025-10-10T14:32:49.254087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28cfb751-5754dd34-2702614b-41070c3b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:49.260759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:49.261792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28cfb751-5754dd34-2702614b-41070c3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.261878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:49.261889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 733
2025-10-10T14:32:49.261992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.262025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:49.262035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:49.262042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:49.262019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:49.262194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:49.262207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:49.262219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:49.262276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:49.262315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601011858851159:5443]
2025-10-10T14:32:49.262441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 733 sessionId:  describe result for acl check
2025-10-10T14:32:49.262476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:49.262482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:49.262484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:49.262489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601012641062731:6747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:49.262908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:49.263003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601012641062731:6747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:49.263205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:49.263251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:49.263574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:49.263628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.263637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.263638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.263639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.263640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.263641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.263642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.263644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.263645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.263646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.263647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.263648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.263649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.263655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.263667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.263671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.263675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.263679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.263683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.263687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.263696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.263700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.263704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.263708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.263712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.263720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.263727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.263740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.263752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.263758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.263767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.263772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.263776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.263781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.263786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.263791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.263800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.263806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.263812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.263817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.263821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.263826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.263830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.263840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.263845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.263850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.263854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.263859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.263863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.263869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.263873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.263883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.263920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:49.265194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601012641062731:6747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:49.266017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:49.266421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:49.266432Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:49.266434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:49.266438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:49.266443Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 732 [2:7559601011858851159:5443]
2025-10-10T14:32:49.266455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:49.266482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:49.266485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.266489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.266492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.266508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:49.266522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:49.266535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:49.266591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.266597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.266599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.266602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:49.266675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:49.266682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.266693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.266718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.266735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:49.266760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062707:2438], now have 1 active actors on pipe
2025-10-10T14:32:49.266742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 732
2025-10-10T14:32:49.266773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601011858851154:5443]
2025-10-10T14:32:49.266780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601011858851154:5443]
2025-10-10T14:32:49.266782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601011858851154:5443]
2025-10-10T14:32:49.266804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:49.266808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:49.266810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:49.266813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:49.266822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:49.266839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:49.266847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:49.266874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601011858851154:5443]
2025-10-10T14:32:49.266884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:49.266890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:49.267333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601012641062731:6747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:49.267346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601012641062731:6747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:49.267349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601012641062731:6747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:49.267355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:49.267503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062769:6747], now have 1 active actors on pipe
2025-10-10T14:32:49.267543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 732
2025-10-10T14:32:49.267587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.267597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.267634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:49.267645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.267654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.267660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:49.267672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.267688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:49.267714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.267901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.267913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.267943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.268022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 733 partition: 0 MaxSeqNo: 40 sessionId: src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0
2025-10-10T14:32:49.268325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28cfb751-5754dd34-2702614b-41070c3b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:49.270923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0] Write session: try to update token
2025-10-10T14:32:49.270938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:49.283457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:49.283478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.283491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601011858851154:5443]
2025-10-10T14:32:49.283533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:49.283537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:49.283691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:49.283824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.283956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.284085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.284276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:49.284320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:49.284607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId: src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:49.287312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:49.287500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.287520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.287558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:49.287620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:49.297160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:49.297177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.297180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:49.297182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:49.297191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601011858851154:5443]
2025-10-10T14:32:49.297195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601011858851154:5443]
2025-10-10T14:32:49.297198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601011858851154:5443]
2025-10-10T14:32:49.297238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:49.297243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:49.297246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:49.297246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:49.297253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.297256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:49.297414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:49.353930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601012641062797:6574]
2025-10-10T14:32:49.354149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 732, pipe: [1:7559601012641062797:6574]
2025-10-10T14:32:49.404154Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:49.410611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.410635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.410790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.410846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.410902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.410961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.411022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.411031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.411093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.411148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.411209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.411269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.411310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.411315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.411373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.411427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.411485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.411542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.411582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.411584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.411640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.411699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.411754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.411822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.411865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.411871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.411935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.411995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.412051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.412106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.412145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.412151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.412208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.412261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.412316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.412370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.412409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.412414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.412472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.412523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.412577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.412632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.412672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.412677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.412732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.412783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.412837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.412891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.412933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.412938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.412993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.413059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.413111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.413165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.413204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.413209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.413264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.413322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.413403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.413456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.413493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.413498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.413536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062797:6574], now have 1 active actors on pipe
2025-10-10T14:32:49.413752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:49.413763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601012641062797:6574]
2025-10-10T14:32:49.413767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:49.413788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:49.413797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 733 reason: error at write: Disconnected sessionId: src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0
2025-10-10T14:32:49.414167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:49.414176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0] Write session will restart in 0.008592s
2025-10-10T14:32:49.414201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0] Write session: Do CDS request
2025-10-10T14:32:49.414207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:49.414203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:49.414427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 733 sessionId: src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0 is DEAD
2025-10-10T14:32:49.422016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:49.423418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:49.423621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:49.423634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:49.423645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:49.423700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:49.423744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601011858851261:5458]
2025-10-10T14:32:49.423824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.423912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:49.423926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 734
2025-10-10T14:32:49.424024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.424052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:49.424061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:49.424069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:49.424398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:49.424452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 734 sessionId:  describe result for acl check
2025-10-10T14:32:49.424480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:49.424486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:49.424488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:49.424493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601012641062823:6760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:49.424668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:49.424714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:49.424991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601012641062823:6760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:49.425052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:49.425106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.425114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.425116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.425117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.425120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.425121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.425123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.425125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.425126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.425128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.425129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.425130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.425132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.425137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.425149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.425154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.425159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.425164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.425168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.425172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.425176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.425180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.425185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.425189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.425194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.425198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.425206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.425214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.425222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.425229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.425234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.425240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.425245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.425251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.425256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.425262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.425273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.425279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.425284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.425290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.425294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.425300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.425307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.425314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.425319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.425326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.425347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.425358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.425362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.425367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.425372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.425382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.425425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:49.426795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601012641062823:6760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:49.427503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:49.427818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:49.427831Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:49.427834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:49.427837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:49.427842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 733 [2:7559601011858851261:5458]
2025-10-10T14:32:49.427853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:49.427869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:49.427877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.427880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.427883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.427898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:49.427912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:49.427924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:49.427975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.427984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.427986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.427988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:49.428051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:49.428060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.428072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.428085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.428104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:49.428127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062798:2438], now have 1 active actors on pipe
2025-10-10T14:32:49.428140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601011858851256:5458]
2025-10-10T14:32:49.428146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601011858851256:5458]
2025-10-10T14:32:49.428149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601011858851256:5458]
2025-10-10T14:32:49.428157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:49.428173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 733
2025-10-10T14:32:49.428166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:49.428170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:49.428175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:49.428177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:49.428187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:49.428190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:49.428210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601011858851256:5458]
2025-10-10T14:32:49.428213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:49.428226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:49.432728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601012641062823:6760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:49.432741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601012641062823:6760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:49.432744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601012641062823:6760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:49.432751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:49.432939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062861:6760], now have 1 active actors on pipe
2025-10-10T14:32:49.433011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 733
2025-10-10T14:32:49.433082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.433095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.433126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13cec819-c667d599-4b69174e-a63cf69c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:49.433140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.433153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.433160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:49.433173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.433192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:49.433211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.433386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.433395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.433411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.433494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 734 partition: 0 MaxSeqNo: 40 sessionId: src_id|13cec819-c667d599-4b69174e-a63cf69c_0
2025-10-10T14:32:49.433775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20158015-ab59ea6d-7da60c5f-8a50aec0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|13cec819-c667d599-4b69174e-a63cf69c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:49.436306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cec819-c667d599-4b69174e-a63cf69c_0] Write session: try to update token
2025-10-10T14:32:49.436320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cec819-c667d599-4b69174e-a63cf69c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:49.438700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:49.438718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.438727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601011858851256:5458]
2025-10-10T14:32:49.438769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:49.438787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:49.438938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:49.439087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.439221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.439356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.439530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:49.439571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:49.449764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId: src_id|13cec819-c667d599-4b69174e-a63cf69c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:49.452282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:49.452482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.452507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.452548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:49.452634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:49.456025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:49.456045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.456048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:49.456050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:49.456060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601011858851256:5458]
2025-10-10T14:32:49.456064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601011858851256:5458]
2025-10-10T14:32:49.456071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601011858851256:5458]
2025-10-10T14:32:49.456106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:49.456116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:49.456125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.456126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:49.456128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:49.456131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:49.456263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:49.513658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601012641062865:6574]
2025-10-10T14:32:49.513854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 733, pipe: [1:7559601012641062865:6574]
2025-10-10T14:32:49.566312Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:49.573023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.573045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.573181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.573234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.573292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.573370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.573413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.573421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.573481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.573536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.573626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.573684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.573722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.573728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.573785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.573837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.573895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.573957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.573996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.574001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.574060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.574114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.574168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.574224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.574262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.574269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.574325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.574378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.574432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.574489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.574527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.574532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.574586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.574644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.574700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.574764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.574802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.574807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.574865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.574918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.574974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.575040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.575098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.575103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.575156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.575205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.575257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.575311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.575349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.575354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.575407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.575460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.575512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.575563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.575599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.575607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.575659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:49.575721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:49.575786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:49.575847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:49.575890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:49.575896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:49.575931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062865:6574], now have 1 active actors on pipe
2025-10-10T14:32:49.576129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601012641062865:6574]
2025-10-10T14:32:49.576160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:49.576241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:49.576255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:49.576284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 734 reason: error at write: Disconnected sessionId: src_id|13cec819-c667d599-4b69174e-a63cf69c_0
2025-10-10T14:32:49.576500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 734 sessionId: src_id|13cec819-c667d599-4b69174e-a63cf69c_0 is DEAD
2025-10-10T14:32:49.576664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cec819-c667d599-4b69174e-a63cf69c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:49.576675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cec819-c667d599-4b69174e-a63cf69c_0] Write session will restart in 0.006932s
2025-10-10T14:32:49.576699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cec819-c667d599-4b69174e-a63cf69c_0] Write session: Do CDS request
2025-10-10T14:32:49.576705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cec819-c667d599-4b69174e-a63cf69c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:49.576709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:49.583880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:49.584750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13cec819-c667d599-4b69174e-a63cf69c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.584870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:49.584882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 735
2025-10-10T14:32:49.585001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.585035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:49.585045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:49.585048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:49.585392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:49.585462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 735 sessionId:  describe result for acl check
2025-10-10T14:32:49.585495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:49.585503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:49.585505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:49.585511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601012641062899:6766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:49.585562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:49.585572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:49.585583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:49.585630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:49.585668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601011858851326:5460]
2025-10-10T14:32:49.586028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601012641062899:6766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:49.586262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:49.586527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:49.586569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:49.586881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:49.586934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.586940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.586941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.586942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.586943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.586944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.586945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.586946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.586948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.586949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.586950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.586951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.586952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.586958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.586969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.586973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.586977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.586980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.586986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.586990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.586994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.586998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.587003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.587015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.587019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.587025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.587031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.587038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.587045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.587050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.587054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.587058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.587062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.587067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.587071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.587077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.587081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.587086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.587090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.587095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.587105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.587109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.587113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.587118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.587125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.587130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.587139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.587144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.587150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.587160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.587164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.587174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.587215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:49.588602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601012641062899:6766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:49.589362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:49.589738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:49.589752Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:49.589755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:49.589758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:49.589763Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 734 [2:7559601011858851326:5460]
2025-10-10T14:32:49.589773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:49.589793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:49.589800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.589804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.589806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.589826Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:49.589839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:49.589846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:49.589894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.589901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.589902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.589905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:49.589963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:49.589970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.589980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.589998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.590018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:49.590043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062873:2438], now have 1 active actors on pipe
2025-10-10T14:32:49.590055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601011858851321:5460]
2025-10-10T14:32:49.590062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601011858851321:5460]
2025-10-10T14:32:49.590063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601011858851321:5460]
2025-10-10T14:32:49.590072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:49.590077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:49.590079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:49.590080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:49.590041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 734
2025-10-10T14:32:49.590090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:49.590111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:49.590118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:49.590144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601011858851321:5460]
2025-10-10T14:32:49.590157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:49.590173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:49.594409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601012641062899:6766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:49.594422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601012641062899:6766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:49.594425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601012641062899:6766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:49.594432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:49.594625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062937:6766], now have 1 active actors on pipe
2025-10-10T14:32:49.594670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 734
2025-10-10T14:32:49.594717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.594729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.594763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:49.594780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.594794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.594801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:49.594816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.594836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:49.594857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.594978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.594988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.595003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.595082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 735 partition: 0 MaxSeqNo: 40 sessionId: src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0
2025-10-10T14:32:49.595384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13cec819-c667d599-4b69174e-a63cf69c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:49.597928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0] Write session: try to update token
2025-10-10T14:32:49.597943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:49.608384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:49.608406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.608409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:49.608411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:49.608421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601011858851321:5460]
2025-10-10T14:32:49.608426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601011858851321:5460]
2025-10-10T14:32:49.608430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601011858851321:5460]
2025-10-10T14:32:49.608477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:49.608489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:49.608493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:49.608495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:49.608502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.608505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:49.608638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:49.611814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId: src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:49.614277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:49.676507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601012641062944:6574]
2025-10-10T14:32:49.676793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 734, pipe: [1:7559601012641062944:6574]
2025-10-10T14:32:49.735796Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:49.736217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.736238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.736294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062944:6574], now have 1 active actors on pipe
2025-10-10T14:32:49.736495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:49.736522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601012641062944:6574]
2025-10-10T14:32:49.736551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:49.736561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:49.736585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:49.736657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 735 reason: error at write: Disconnected sessionId: src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0
2025-10-10T14:32:49.736875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 735 sessionId: src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0 is DEAD
2025-10-10T14:32:49.737004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:49.737012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0] Write session will restart in 0.005200s
2025-10-10T14:32:49.737032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0] Write session: Do CDS request
2025-10-10T14:32:49.737037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:49.743843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.743921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:49.743934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 736
2025-10-10T14:32:49.744053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.744088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:49.744099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:49.744102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:49.744447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:49.744526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 736 sessionId:  describe result for acl check
2025-10-10T14:32:49.744561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:49.744567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:49.744569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:49.744575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601012641062971:6770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:49.745089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601012641062971:6770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:49.746916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601012641062971:6770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:49.747190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:49.747369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:49.747381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:49.747393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:49.747445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:49.747503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601011858851395:5463]
2025-10-10T14:32:49.748154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:49.748395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:49.748442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:49.748775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:49.748832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.748839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.748840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.748842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.748843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.748844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.748846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.748847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.748849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.748850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.748852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.748853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.748854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.748860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.748876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.748880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.748885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.748889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.748894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.748898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.748902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.748906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.748911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.748916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.748921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.748925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.748933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.748942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.748955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.748978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.748987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.748998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.749008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.749019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.749024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.749037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.749042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.749048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.749053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.749059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.749064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.749070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.749075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.749081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.749086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.749092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.749098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.749109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.749101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601012641062971:6770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:49.749113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.749112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601012641062971:6770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:49.749115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601012641062971:6770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:49.749119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.749121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:49.749124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.749129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.749177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:49.751724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:49.752139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:49.752152Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:49.752155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:49.752158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:49.752164Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 735 [2:7559601011858851395:5463]
2025-10-10T14:32:49.752176Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:49.752199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:49.752209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.752213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.752215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.752231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:49.752244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:49.752256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:49.752309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.752315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.752317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.752319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:49.752401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:49.752409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.752421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.752440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.752464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:49.752488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641063004:6770], now have 1 active actors on pipe
2025-10-10T14:32:49.752498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641062945:2438], now have 1 active actors on pipe
2025-10-10T14:32:49.752505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601011858851390:5463]
2025-10-10T14:32:49.752477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 735
2025-10-10T14:32:49.752507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601011858851390:5463]
2025-10-10T14:32:49.752509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601011858851390:5463]
2025-10-10T14:32:49.752480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 735
2025-10-10T14:32:49.752517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:49.752533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:49.752540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:49.752542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:49.752543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:49.752551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:49.752554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:49.752575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.752584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.752614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601011858851390:5463]
2025-10-10T14:32:49.752627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:49.752644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:49.752649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0e23828-94904d2-4e562e64-44efd663_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:49.752656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.752660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.752662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:49.752672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.752687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:49.752719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.752898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.752908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.752923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.753037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 736 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0e23828-94904d2-4e562e64-44efd663_0
2025-10-10T14:32:49.753321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a828d1-88cc43d2-bb8491f5-51b2c1fc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0e23828-94904d2-4e562e64-44efd663_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:49.755896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e23828-94904d2-4e562e64-44efd663_0] Write session: try to update token
2025-10-10T14:32:49.755911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e23828-94904d2-4e562e64-44efd663_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:49.771076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:49.771099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.771103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:49.771105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:49.771115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601011858851390:5463]
2025-10-10T14:32:49.771125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601011858851390:5463]
2025-10-10T14:32:49.771130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601011858851390:5463]
2025-10-10T14:32:49.771169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:49.771181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:49.771184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:49.771187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.771190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:49.771193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:49.771526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:49.775969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId: src_id|b0e23828-94904d2-4e562e64-44efd663_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:49.778406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:49.836754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601012641063014:6574]
2025-10-10T14:32:49.836999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 735, pipe: [1:7559601012641063014:6574]
2025-10-10T14:32:49.894689Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:49.895106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.895122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.895169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641063014:6574], now have 1 active actors on pipe
2025-10-10T14:32:49.895388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:49.895390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:49.895403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:49.895420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601012641063014:6574]
2025-10-10T14:32:49.895442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:49.895481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 736 reason: error at write: Disconnected sessionId: src_id|b0e23828-94904d2-4e562e64-44efd663_0
2025-10-10T14:32:49.895694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 736 sessionId: src_id|b0e23828-94904d2-4e562e64-44efd663_0 is DEAD
2025-10-10T14:32:49.895884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e23828-94904d2-4e562e64-44efd663_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:49.895896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e23828-94904d2-4e562e64-44efd663_0] Write session will restart in 0.008316s
2025-10-10T14:32:49.895921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e23828-94904d2-4e562e64-44efd663_0] Write session: Do CDS request
2025-10-10T14:32:49.895942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e23828-94904d2-4e562e64-44efd663_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:49.903727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:49.905145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:49.905326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:49.905357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:49.905369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:49.905421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:49.905466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601011858851462:5465]
2025-10-10T14:32:49.905898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e23828-94904d2-4e562e64-44efd663_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.905977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:49.905993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 737
2025-10-10T14:32:49.906125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:49.906157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:49.906148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:49.906166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:49.906170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:49.906466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:49.906517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:49.906604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 737 sessionId:  describe result for acl check
2025-10-10T14:32:49.906649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:49.906656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:49.906658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:49.906664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601012641063045:6774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:49.906850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:49.906908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.906919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.906920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.906922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.906923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.906925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.906927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.906928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.906929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.906931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.906932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.906934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.906935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.906941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.906954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.906959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.906964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.906969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.906974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.906978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.906983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.906989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.906994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.906998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.907003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.907007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.907028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.907044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:49.907056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.907062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:49.907068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.907079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:49.907088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.907099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:49.907109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.907118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:49.907123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.907133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:49.907138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.907145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:49.907149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.907155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:49.907160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.907165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:49.907174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.907180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:49.907185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.907195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.907203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.907213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.907223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.907233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.907252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601012641063045:6774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:49.907285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:49.909383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601012641063045:6774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:49.909609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:49.909930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:49.909947Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:49.909950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:49.909954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:49.909960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 736 [2:7559601011858851462:5465]
2025-10-10T14:32:49.909975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:49.909991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:49.909999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.910003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.910005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.910022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:49.910039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:49.910046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:49.910098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.910105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.910107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.910110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:49.910180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:49.910189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.910201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:49.910215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:49.910241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:49.910267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641063015:2438], now have 1 active actors on pipe
2025-10-10T14:32:49.910280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601011858851457:5465]
2025-10-10T14:32:49.910287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601011858851457:5465]
2025-10-10T14:32:49.910290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601011858851457:5465]
2025-10-10T14:32:49.910304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:49.910322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:49.910325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:49.910332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:49.910334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:49.910302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 736
2025-10-10T14:32:49.910344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:49.910347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:49.910376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601011858851457:5465]
2025-10-10T14:32:49.910389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:49.910394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:49.915390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601012641063045:6774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:49.915406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601012641063045:6774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:49.915410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601012641063045:6774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:49.915419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:49.915689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641063081:6774], now have 1 active actors on pipe
2025-10-10T14:32:49.915708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 736
2025-10-10T14:32:49.915763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.915774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.915805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3c98955-26489be-673362df-5210e6ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:49.915821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:49.915832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:49.915835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:49.915851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:49.915868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:49.915891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.916089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:49.916099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:49.916115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:49.916204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 737 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3c98955-26489be-673362df-5210e6ee_0
2025-10-10T14:32:49.916570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e23828-94904d2-4e562e64-44efd663_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3c98955-26489be-673362df-5210e6ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:49.919313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c98955-26489be-673362df-5210e6ee_0] Write session: try to update token
2025-10-10T14:32:49.919330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c98955-26489be-673362df-5210e6ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:49.927744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:49.927769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.927782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601011858851457:5465]
2025-10-10T14:32:49.927835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:49.927837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:49.928018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:49.928236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.928424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.928604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:49.928849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:49.928900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:49.936517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId: src_id|c3c98955-26489be-673362df-5210e6ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:49.938680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:49.938699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:49.938701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:49.938703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:49.938710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601011858851457:5465]
2025-10-10T14:32:49.938713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601011858851457:5465]
2025-10-10T14:32:49.938716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601011858851457:5465]
2025-10-10T14:32:49.938750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:49.938759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:49.938760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:49.938759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:49.938765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:49.938768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:49.938831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:49.938882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:49.995432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601012641063085:6574]
2025-10-10T14:32:49.995713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 736, pipe: [1:7559601012641063085:6574]
2025-10-10T14:32:50.046365Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:50.046760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.046776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.046801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601012641063085:6574], now have 1 active actors on pipe
2025-10-10T14:32:50.047040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:50.047021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:50.047037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:50.047042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601012641063085:6574]
2025-10-10T14:32:50.047063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:50.047108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 737 reason: error at write: Disconnected sessionId: src_id|c3c98955-26489be-673362df-5210e6ee_0
2025-10-10T14:32:50.047319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 737 sessionId: src_id|c3c98955-26489be-673362df-5210e6ee_0 is DEAD
2025-10-10T14:32:50.047521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c98955-26489be-673362df-5210e6ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:50.047533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c98955-26489be-673362df-5210e6ee_0] Write session will restart in 0.007403s
2025-10-10T14:32:50.047557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c98955-26489be-673362df-5210e6ee_0] Write session: Do CDS request
2025-10-10T14:32:50.047564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c98955-26489be-673362df-5210e6ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:50.055395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:50.055868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c98955-26489be-673362df-5210e6ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.055963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:50.055980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 738
2025-10-10T14:32:50.056069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.056095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:50.056104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:50.056107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:50.056482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 738 sessionId:  describe result for acl check
2025-10-10T14:32:50.056509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:50.056514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:50.056515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:50.056519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601016936030411:6778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:50.056772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:50.056942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:50.056944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601016936030411:6778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:50.056956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:50.056968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:50.057018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:50.057053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601016153818826:5467]
2025-10-10T14:32:50.057646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:50.057903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:50.057949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:50.058267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:50.058322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.058328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.058330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.058331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.058332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.058334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.058335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.058336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.058337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.058338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.058340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.058341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.058342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.058348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.058359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.058363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.058366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.058370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.058375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.058380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.058384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.058388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.058392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.058396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.058400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.058406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.058413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.058422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.058429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.058434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.058439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.058444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.058449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.058457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.058462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.058467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.058473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.058478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.058488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.058493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.058497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.058502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.058507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.058516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.058522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.058527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.058532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.058537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.058545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.058551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.058556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.058566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.058605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:50.058644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601016936030411:6778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:50.060803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:50.060957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601016936030411:6778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:50.060969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601016936030411:6778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:50.060972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601016936030411:6778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:50.060978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:50.061180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:50.061190Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:50.061192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:50.061197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:50.061202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 737 [2:7559601016153818826:5467]
2025-10-10T14:32:50.061210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:50.061228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:50.061231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.061234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.061236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.061252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:50.061258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:50.061266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:50.061312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.061317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.061318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.061320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:50.061398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:50.061406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.061413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.061420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.061430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:50.061452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030382:2438], now have 1 active actors on pipe
2025-10-10T14:32:50.061462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030445:6778], now have 1 active actors on pipe
2025-10-10T14:32:50.061470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601016153818821:5467]
2025-10-10T14:32:50.061476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601016153818821:5467]
2025-10-10T14:32:50.061478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601016153818821:5467]
2025-10-10T14:32:50.061492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:50.061490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 737
2025-10-10T14:32:50.061505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 737
2025-10-10T14:32:50.061508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:50.061511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:50.061519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:50.061521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:50.061529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:50.061532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:50.061566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.061575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.061588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601016153818821:5467]
2025-10-10T14:32:50.061599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:50.061612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:50.061628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:50.061644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.061652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.061653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:50.061665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.061680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:50.061706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.061829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.061836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.061853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.061921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 738 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0
2025-10-10T14:32:50.062216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c98955-26489be-673362df-5210e6ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:50.064696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0] Write session: try to update token
2025-10-10T14:32:50.064710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:50.078916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId: src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:50.080015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:50.080039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.080041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:50.080043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:50.080051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601016153818821:5467]
2025-10-10T14:32:50.080054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601016153818821:5467]
2025-10-10T14:32:50.080059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601016153818821:5467]
2025-10-10T14:32:50.080095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:50.080101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.080101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:50.080106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:50.080108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:50.080113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:50.080232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:50.081459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:50.147027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601016936030453:6574]
2025-10-10T14:32:50.147330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 737, pipe: [1:7559601016936030453:6574]
2025-10-10T14:32:50.184989Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:50.185322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.185351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.185392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030453:6574], now have 1 active actors on pipe
2025-10-10T14:32:50.185614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:50.185642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601016936030453:6574]
2025-10-10T14:32:50.185668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:50.185671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:50.185727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:50.185753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 738 reason: error at write: Disconnected sessionId: src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0
2025-10-10T14:32:50.185993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 738 sessionId: src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0 is DEAD
2025-10-10T14:32:50.186152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:50.186162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0] Write session will restart in 0.009389s
2025-10-10T14:32:50.186194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0] Write session: Do CDS request
2025-10-10T14:32:50.186215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:50.193806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:50.195236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:50.195422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:50.195434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:50.195445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:50.195494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:50.195537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601016153818895:5469]
2025-10-10T14:32:50.196150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:50.196419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:50.196462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:50.196776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:50.196835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.196842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.196843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.196844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.196862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.196845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.196847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.196848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.196849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.196850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.196851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.196853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.196855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.196856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.196862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.196876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.196880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.196884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.196888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.196893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.196897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.196901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.196905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.196909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.196913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.196917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.196921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.196929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.196940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.196948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.196953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.196961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.196967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.196971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.196975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.196980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.196950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:50.196984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.196989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.196993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.196967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 739
2025-10-10T14:32:50.196997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.197002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.197006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.197010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.197015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.197025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.197029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.197034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.197039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.197043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.197047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.197053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.197062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.197067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.197096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.197107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:50.197129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:50.197139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:50.197149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:50.197537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 739 sessionId:  describe result for acl check
2025-10-10T14:32:50.197576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:50.197585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:50.197587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:50.197594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601016936030489:6782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:50.198139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601016936030489:6782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:50.199413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:50.199727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:50.199743Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:50.199746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:50.199751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:50.199758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 738 [2:7559601016153818895:5469]
2025-10-10T14:32:50.199772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:50.199789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:50.199792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.199796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.199800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.199817Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:50.199829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:50.199837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:50.199892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.199898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.199900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.199903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:50.199968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:50.199976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.199988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.200008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.200030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:50.200057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030454:2438], now have 1 active actors on pipe
2025-10-10T14:32:50.200069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601016153818890:5469]
2025-10-10T14:32:50.200072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601016153818890:5469]
2025-10-10T14:32:50.200074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601016153818890:5469]
2025-10-10T14:32:50.200087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:50.200105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:50.200097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 738
2025-10-10T14:32:50.200123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601016936030489:6782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:50.200118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:50.200123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:50.200128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:50.200130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:50.200133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:50.200152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601016153818890:5469]
2025-10-10T14:32:50.200159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:50.200162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:50.204971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601016936030489:6782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:50.204987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601016936030489:6782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:50.204991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601016936030489:6782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:50.205000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:50.205282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030522:6782], now have 1 active actors on pipe
2025-10-10T14:32:50.205350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 738
2025-10-10T14:32:50.205425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.205439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.205474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|549b3723-1508291f-18fff504-4569e252_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:50.205492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.205503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.205506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:50.205521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.205545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:50.205570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.205778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.205786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.205804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.205908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 739 partition: 0 MaxSeqNo: 40 sessionId: src_id|549b3723-1508291f-18fff504-4569e252_0
2025-10-10T14:32:50.206327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e1ecbff-4711c901-971fe4c5-33c7f667_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|549b3723-1508291f-18fff504-4569e252_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:50.208768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549b3723-1508291f-18fff504-4569e252_0] Write session: try to update token
2025-10-10T14:32:50.208783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549b3723-1508291f-18fff504-4569e252_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:50.217606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:50.217630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.217642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601016153818890:5469]
2025-10-10T14:32:50.217702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:50.217703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:50.217955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:50.218171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:50.218365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:50.218570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:50.218882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:50.218939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:50.223697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId: src_id|549b3723-1508291f-18fff504-4569e252_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:50.226313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:50.226509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.226532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.228232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:50.228248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.228251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:50.228253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:50.228262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601016153818890:5469]
2025-10-10T14:32:50.228269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601016153818890:5469]
2025-10-10T14:32:50.228273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601016153818890:5469]
2025-10-10T14:32:50.228323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:50.228335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:50.228341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:50.228344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:50.228345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:50.228352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.228356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:50.228416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:50.228567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:50.285788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601016936030537:6574]
2025-10-10T14:32:50.286087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 738, pipe: [1:7559601016936030537:6574]
2025-10-10T14:32:50.337786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:50.346344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.346376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.346551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.346625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.346700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.346775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.346821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.346831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.346946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.347062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.347170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.347279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.347324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.347332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.347442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.347508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.347589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.347690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.347800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.347809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.347919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.348027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.348128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.348230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.348366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.348376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.348480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.348542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.348612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.348681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.348824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.348834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.348906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.348979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.349056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.349131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.349178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.349193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.349271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.349358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.349434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.349510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.349624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.349635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.349709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.349777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.349852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.349927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.350107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.350117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.350187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.350258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.350324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.350391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.350509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.350519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.350588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:50.350653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:50.350721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:50.350788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:50.350852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:50.350860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:50.350915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030537:6574], now have 1 active actors on pipe
2025-10-10T14:32:50.351123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601016936030537:6574]
2025-10-10T14:32:50.351162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:50.351172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:50.351197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 739 reason: error at write: Disconnected sessionId: src_id|549b3723-1508291f-18fff504-4569e252_0
2025-10-10T14:32:50.351445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 739 sessionId: src_id|549b3723-1508291f-18fff504-4569e252_0 is DEAD
2025-10-10T14:32:50.351590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549b3723-1508291f-18fff504-4569e252_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:50.351603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549b3723-1508291f-18fff504-4569e252_0] Write session will restart in 0.006760s
2025-10-10T14:32:50.351628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:50.351643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549b3723-1508291f-18fff504-4569e252_0] Write session: Do CDS request
2025-10-10T14:32:50.351649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549b3723-1508291f-18fff504-4569e252_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:50.351932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:50.359971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549b3723-1508291f-18fff504-4569e252_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.360053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:50.360070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 740
2025-10-10T14:32:50.360240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.360275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:50.360285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:50.360291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:50.360717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 740 sessionId:  describe result for acl check
2025-10-10T14:32:50.360750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:50.360754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:50.360756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:50.360763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601016936030595:6796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:50.361309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601016936030595:6796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:50.361459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:50.363300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601016936030595:6796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:50.363351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:50.363573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:50.363586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:50.363599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:50.363659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:50.363703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601016153819014:5480]
2025-10-10T14:32:50.364364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:50.364683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:50.364735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:50.365084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:50.365143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.365153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.365154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.365155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.365156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.365158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.365159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.365160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.365162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.365163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.365164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.365166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.365167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.365173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.365186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.365191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.365196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.365200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.365204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.365208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.365212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.365216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.365221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.365225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.365230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.365234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.365241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.365250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.365257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.365263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.365268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.365273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.365277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.365283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.365287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.365295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.365300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.365306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.365313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.365318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.365322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.365327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.365351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.365357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.365361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.365367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.365372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.365377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.365382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.365392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.365397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.365402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.365451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:50.366353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601016936030595:6796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:50.366368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601016936030595:6796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:50.366372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601016936030595:6796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:50.366382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:50.367840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:50.368248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:50.368259Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:50.368261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:50.368264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:50.368269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 739 [2:7559601016153819014:5480]
2025-10-10T14:32:50.368279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:50.368294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:50.368296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.368298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.368300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.368314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:50.368324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:50.368331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:50.368377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.368382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.368383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.368385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:50.368452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:50.368460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.368470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.368485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.368505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:50.368531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030556:2438], now have 1 active actors on pipe
2025-10-10T14:32:50.368541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030628:6796], now have 1 active actors on pipe
2025-10-10T14:32:50.368548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601016153818995:5480]
2025-10-10T14:32:50.368549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601016153818995:5480]
2025-10-10T14:32:50.368550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601016153818995:5480]
2025-10-10T14:32:50.368562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:50.368577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:50.368577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:50.368579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:50.368581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:50.368597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:50.368605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:50.368608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 739
2025-10-10T14:32:50.368630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601016153818995:5480]
2025-10-10T14:32:50.368629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 739
2025-10-10T14:32:50.368638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:50.368639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:50.368664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.368675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.368717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:50.368729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.368739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.368743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:50.368754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.368764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:50.368785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.368911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.368920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.368936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.369042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 740 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0
2025-10-10T14:32:50.369471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549b3723-1508291f-18fff504-4569e252_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:50.372185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0] Write session: try to update token
2025-10-10T14:32:50.372205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:50.387404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:50.387425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.387428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:50.387430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:50.387440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601016153818995:5480]
2025-10-10T14:32:50.387445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601016153818995:5480]
2025-10-10T14:32:50.387450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601016153818995:5480]
2025-10-10T14:32:50.387492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:50.387495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:50.387497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:50.387501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:50.387507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.387511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:50.387651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:50.388487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId: src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:50.391288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:50.451160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601016936030635:6574]
2025-10-10T14:32:50.451455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 739, pipe: [1:7559601016936030635:6574]
2025-10-10T14:32:50.494158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:50.494527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.494551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.494597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030635:6574], now have 1 active actors on pipe
2025-10-10T14:32:50.494810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:50.494884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:50.494898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:50.494913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601016936030635:6574]
2025-10-10T14:32:50.494935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:50.494962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 740 reason: error at write: Disconnected sessionId: src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0
2025-10-10T14:32:50.495175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 740 sessionId: src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0 is DEAD
2025-10-10T14:32:50.495338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:50.495346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0] Write session will restart in 0.005901s
2025-10-10T14:32:50.495370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0] Write session: Do CDS request
2025-10-10T14:32:50.495380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:50.502909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.502996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:50.503011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 741
2025-10-10T14:32:50.503160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.503195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:50.503204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:50.503208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:50.503357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:50.503660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 741 sessionId:  describe result for acl check
2025-10-10T14:32:50.503706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:50.503712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:50.503714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:50.503720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601016936030669:6800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:50.504260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601016936030669:6800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:50.504835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:50.505017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:50.505028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:50.505040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:50.505087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:50.505120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601016153819083:5487]
2025-10-10T14:32:50.505740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:50.505963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:50.506008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:50.506208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601016936030669:6800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:50.506319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:50.506370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.506375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.506377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.506378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.506379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.506381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.506382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.506384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.506385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.506386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.506388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.506389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.506390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.506396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.506408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.506413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.506418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.506422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.506426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.506430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.506434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.506438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.506445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.506449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.506453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.506457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.506463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.506471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.506482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.506488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.506498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.506503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.506514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.506519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.506528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.506533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.506543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.506548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.506553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.506558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.506562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.506568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.506572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.506577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.506582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.506591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.506596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.506601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.506610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.506615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.506620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.506629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.506670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:50.508769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601016936030669:6800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:50.508783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601016936030669:6800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:50.508787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601016936030669:6800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:50.508795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:50.508848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:50.509216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:50.509230Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:50.509232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:50.509235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:50.509241Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 740 [2:7559601016153819083:5487]
2025-10-10T14:32:50.509253Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:50.509270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:50.509278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.509281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.509284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.509299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:50.509313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:50.509320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:50.509392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.509398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.509400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.509404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:50.509484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:50.509493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.509503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.509513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.509526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:50.509552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030637:2438], now have 1 active actors on pipe
2025-10-10T14:32:50.509560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030703:6800], now have 1 active actors on pipe
2025-10-10T14:32:50.509568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601016153819078:5487]
2025-10-10T14:32:50.509570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601016153819078:5487]
2025-10-10T14:32:50.509574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601016153819078:5487]
2025-10-10T14:32:50.509587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:50.509579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 740
2025-10-10T14:32:50.509601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 740
2025-10-10T14:32:50.509602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:50.509603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:50.509612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:50.509614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:50.509619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:50.509622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:50.509643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601016153819078:5487]
2025-10-10T14:32:50.509656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:50.509661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:50.509679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.509688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.509741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:50.509756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.509760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.509762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:50.509775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.509791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:50.509811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.509953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.509965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.509984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.510087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 741 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0
2025-10-10T14:32:50.510427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c981bd-886f7d5e-e537226f-448f1f3c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:50.513092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0] Write session: try to update token
2025-10-10T14:32:50.513112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:50.527586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId: src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:50.528343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:50.528362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.528364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:50.528366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:50.528372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601016153819078:5487]
2025-10-10T14:32:50.528376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601016153819078:5487]
2025-10-10T14:32:50.528380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601016153819078:5487]
2025-10-10T14:32:50.528426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:50.528440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.528447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:50.528503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:50.528518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:50.528522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:50.528629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:50.530377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:50.595012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601016936030717:6574]
2025-10-10T14:32:50.595306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 740, pipe: [1:7559601016936030717:6574]
2025-10-10T14:32:50.633783Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:50.634005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.634032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.634078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030717:6574], now have 1 active actors on pipe
2025-10-10T14:32:50.634286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:50.634301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601016936030717:6574]
2025-10-10T14:32:50.634304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:50.634335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:50.634338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:50.634396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 741 reason: error at write: Disconnected sessionId: src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0
2025-10-10T14:32:50.634586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 741 sessionId: src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0 is DEAD
2025-10-10T14:32:50.634751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:50.634762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0] Write session will restart in 0.005983s
2025-10-10T14:32:50.634787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0] Write session: Do CDS request
2025-10-10T14:32:50.634793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:50.641734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.641818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:50.641830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 742
2025-10-10T14:32:50.641970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.642009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:50.642019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:50.642028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:50.642425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:50.642434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 742 sessionId:  describe result for acl check
2025-10-10T14:32:50.642466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:50.642468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:50.642470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:50.642476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601016936030754:6806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:50.643003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601016936030754:6806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:50.643798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:50.643971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:50.643983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:50.643993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:50.644049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:50.644089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601016153819156:5490]
2025-10-10T14:32:50.644634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:50.644878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:50.644924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:50.644925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601016936030754:6806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:50.645180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:50.645234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.645241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.645242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.645243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.645244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.645246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.645247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.645248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.645251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.645252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.645253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.645255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.645256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.645261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.645273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.645277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.645281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.645284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.645287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.645289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.645291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.645294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.645296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.645299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.645303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.645307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.645314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.645343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.645355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.645362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.645371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.645376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.645384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.645394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.645403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.645412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.645421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.645431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.645440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.645445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.645458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.645462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.645467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.645473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.645477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.645482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.645486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.645491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.645495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.645500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.645504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.645510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.645556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:50.647570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601016936030754:6806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:50.647583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601016936030754:6806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:50.647586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601016936030754:6806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:50.647593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:50.647684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:50.647993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:50.648006Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:50.648009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:50.648012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:50.648019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 741 [2:7559601016153819156:5490]
2025-10-10T14:32:50.648034Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:50.648053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:50.648061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.648064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.648066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.648081Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:50.648093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:50.648104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:50.648158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.648166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.648167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.648170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:50.648253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:50.648263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.648274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.648287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.648306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:50.648299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 741
2025-10-10T14:32:50.648309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 741
2025-10-10T14:32:50.648331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030789:6806], now have 1 active actors on pipe
2025-10-10T14:32:50.648342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030722:2438], now have 1 active actors on pipe
2025-10-10T14:32:50.648349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601016153819151:5490]
2025-10-10T14:32:50.648351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601016153819151:5490]
2025-10-10T14:32:50.648353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601016153819151:5490]
2025-10-10T14:32:50.648362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:50.648376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:50.648379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:50.648384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:50.648385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:50.648395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:50.648399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:50.648420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.648428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.648461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601016153819151:5490]
2025-10-10T14:32:50.648473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:50.648477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:50.648494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:50.648506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.648515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.648517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:50.648528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.648542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:50.648577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.648712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.648721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.648737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.648816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 742 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0
2025-10-10T14:32:50.649054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d2be0d-3faf6204-c505d28a-3ffe7ada_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:50.651472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0] Write session: try to update token
2025-10-10T14:32:50.651485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:50.664663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId: src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:50.666776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:50.666797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.666801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:50.666806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:50.666816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601016153819151:5490]
2025-10-10T14:32:50.666820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601016153819151:5490]
2025-10-10T14:32:50.666824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601016153819151:5490]
2025-10-10T14:32:50.666859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:50.666871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:50.666871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:50.666874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:50.666878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.666880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:50.667017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:50.667169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:50.734294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601016936030796:6574]
2025-10-10T14:32:50.734590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 741, pipe: [1:7559601016936030796:6574]
2025-10-10T14:32:50.774408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:50.774774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.774790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.774844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030796:6574], now have 1 active actors on pipe
2025-10-10T14:32:50.775078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:50.775138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601016936030796:6574]
2025-10-10T14:32:50.775148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:50.775171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:50.775226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 742 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0
2025-10-10T14:32:50.775445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 742 sessionId: src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0 is DEAD
2025-10-10T14:32:50.775600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:50.775612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0] Write session will restart in 0.005628s
2025-10-10T14:32:50.775636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0] Write session: Do CDS request
2025-10-10T14:32:50.775642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:50.782789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.782886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:50.782900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 743
2025-10-10T14:32:50.783015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.783057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:50.783067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:50.783075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:50.783100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:50.783502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 743 sessionId:  describe result for acl check
2025-10-10T14:32:50.783537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:50.783544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:50.783546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:50.783551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601016936030831:6810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:50.784053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601016936030831:6810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:50.784578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:50.784752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:50.784765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:50.784777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:50.784834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:50.784880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601016153819228:5492]
2025-10-10T14:32:50.785387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:50.785621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:50.785652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:50.785775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601016936030831:6810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:50.785860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:50.785897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.785901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.785902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.785903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.785903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.785904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.785905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.785905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.785906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.785907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.785907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.785908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.785909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.785913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.785920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.785922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.785925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.785927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.785929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.785932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.785935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.785938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.785942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.785946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.785950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.785953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.785962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.785971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.785978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.785988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.785997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.786005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.786008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.786011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.786017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.786020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.786023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.786027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.786033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.786036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.786039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.786046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.786048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.786051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.786054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.786061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.786063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.786066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.786072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.786075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.786077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.786080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.786102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:50.788066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601016936030831:6810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:50.788077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601016936030831:6810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:50.788080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601016936030831:6810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:50.788085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:50.788099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:50.788395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:50.788406Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:50.788408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:50.788412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:50.788419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 742 [2:7559601016153819228:5492]
2025-10-10T14:32:50.788427Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:50.788439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:50.788444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.788447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.788448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.788459Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:50.788470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:50.788476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:50.788514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.788519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.788520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.788522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:50.788567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:50.788573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.788579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.788585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.788598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:50.788618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030797:2438], now have 1 active actors on pipe
2025-10-10T14:32:50.788623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030865:6810], now have 1 active actors on pipe
2025-10-10T14:32:50.788629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601016153819223:5492]
2025-10-10T14:32:50.788630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601016153819223:5492]
2025-10-10T14:32:50.788631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601016153819223:5492]
2025-10-10T14:32:50.788641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:50.788650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:50.788653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:50.788654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:50.788661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:50.788660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 742
2025-10-10T14:32:50.788664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 742
2025-10-10T14:32:50.788676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:50.788683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:50.788698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601016153819223:5492]
2025-10-10T14:32:50.788704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:50.788705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:50.788722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.788729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.788756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:50.788765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.788767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.788769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:50.788777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.788789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:50.788805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.788935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.788941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.788952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.789042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 743 partition: 0 MaxSeqNo: 40 sessionId: src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0
2025-10-10T14:32:50.789298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff6a26f-e06c9758-a0e66091-4648d588_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:50.791716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0] Write session: try to update token
2025-10-10T14:32:50.791729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:50.805432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId: src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:50.806625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:50.806646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.806648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:50.806650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:50.806660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601016153819223:5492]
2025-10-10T14:32:50.806664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601016153819223:5492]
2025-10-10T14:32:50.806668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601016153819223:5492]
2025-10-10T14:32:50.806706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:50.806716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:50.806718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:50.806722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:50.806723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.806729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:50.806871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:50.808037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:50.875105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601016936030873:6574]
2025-10-10T14:32:50.875349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 742, pipe: [1:7559601016936030873:6574]
2025-10-10T14:32:50.913602Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:50.913868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.913881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.913921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030873:6574], now have 1 active actors on pipe
2025-10-10T14:32:50.914071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:50.914168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:50.914174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:50.914177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:50.914226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601016936030873:6574]
2025-10-10T14:32:50.914241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 743 reason: error at write: Disconnected sessionId: src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0
2025-10-10T14:32:50.914451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 743 sessionId: src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0 is DEAD
2025-10-10T14:32:50.914624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:50.914635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0] Write session will restart in 0.008699s
2025-10-10T14:32:50.914661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0] Write session: Do CDS request
2025-10-10T14:32:50.914669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:50.922225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:50.923545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:50.923717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:50.923728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:50.923738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:50.923782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:50.923829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601016153819301:5494]
2025-10-10T14:32:50.924209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:50.924458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:50.924492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:50.924725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:50.924784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.924791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.924792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.924793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.924795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.924796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.924797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.924798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.924800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.924801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.924802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.924804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.924805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.924809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.924818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.924820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.924823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.924825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.924827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.924829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.924831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.924833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.924835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.924837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.924839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.924841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.924847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.924852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:50.924859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.924864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:50.924898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.924869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.924873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:50.924877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.924883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:50.924887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.924893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:50.924897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.924902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:50.924907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.924912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:50.924917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.924922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:50.924929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.924932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:50.924935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.924938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:50.924941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.924945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.924947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.924950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.924952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.924955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.924977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:50.924974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:50.924987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 744
2025-10-10T14:32:50.925141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:50.925171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:50.925182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:50.925186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:50.925594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 744 sessionId:  describe result for acl check
2025-10-10T14:32:50.925626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:50.925628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:50.925630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:50.925635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601016936030913:6814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:50.926180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601016936030913:6814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:50.927055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:50.927346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:50.927357Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:50.927359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:50.927363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:50.927366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 743 [2:7559601016153819301:5494]
2025-10-10T14:32:50.927374Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:50.927385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:50.927391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.927393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.927394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.927405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:50.927412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:50.927419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:50.927459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.927464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.927465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.927466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:50.927512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:50.927520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.927527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:50.927532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:50.927542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:50.927557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030874:2438], now have 1 active actors on pipe
2025-10-10T14:32:50.927567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601016153819296:5494]
2025-10-10T14:32:50.927569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601016153819296:5494]
2025-10-10T14:32:50.927570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601016153819296:5494]
2025-10-10T14:32:50.927578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:50.927592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:50.927593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:50.927596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:50.927598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:50.927605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:50.927607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:50.927623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601016153819296:5494]
2025-10-10T14:32:50.927634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:50.927642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:50.927625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 743
2025-10-10T14:32:50.928162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601016936030913:6814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:50.933290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601016936030913:6814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:50.933304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601016936030913:6814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:50.933307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601016936030913:6814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:50.933315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:50.933582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601016936030947:6814], now have 1 active actors on pipe
2025-10-10T14:32:50.933624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 743
2025-10-10T14:32:50.933674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.933686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.933716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:50.933732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:50.933742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:50.933751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:50.933763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:50.933783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:50.933804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.933950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.933962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.933980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:50.934070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 744 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0
2025-10-10T14:32:50.934357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f56f2aa-e0d878fb-6cb25d2-11be385a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:50.937008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0] Write session: try to update token
2025-10-10T14:32:50.937025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:50.938149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:50.938160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.938168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601016153819296:5494]
2025-10-10T14:32:50.938208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:50.938212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:50.938366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:50.938504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:50.938628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:50.938750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:50.938928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:50.938969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:50.950984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId: src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:50.953381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:50.953553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:50.953576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:50.953615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:50.953669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:50.955360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:50.955374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:50.955376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:50.955377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:50.955384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601016153819296:5494]
2025-10-10T14:32:50.955387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601016153819296:5494]
2025-10-10T14:32:50.955392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601016153819296:5494]
2025-10-10T14:32:50.955424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:50.955427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:50.955432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:50.955435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:50.955437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:50.955440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:50.955559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:51.014335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601021230998247:6574]
2025-10-10T14:32:51.014653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 743, pipe: [1:7559601021230998247:6574]
2025-10-10T14:32:51.061857Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:51.068723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.068748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.068908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.068965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.069021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.069087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.069139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.069148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.069212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.069269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.069326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.069410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.069455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.069461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.069522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.069593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.069655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.069712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.069754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.069762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.069829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.069887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.069984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.070043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.070082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.070087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.070167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.070224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.070281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.070348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.070405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.070417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.070478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.070529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.070587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.070645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.070692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.070699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.070757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.070809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.070871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.070934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.070974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.070980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.071052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.071105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.071161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.071220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.071260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.071268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.071326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.071377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.071438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.071497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.071536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.071542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.071604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:51.071660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:51.071722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:51.071777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:51.071817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:51.071823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:51.071863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998247:6574], now have 1 active actors on pipe
2025-10-10T14:32:51.072065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:51.072096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:51.072100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:51.072134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601021230998247:6574]
2025-10-10T14:32:51.072145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 744 reason: error at write: Disconnected sessionId: src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0
2025-10-10T14:32:51.072380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 744 sessionId: src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0 is DEAD
2025-10-10T14:32:51.072541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:51.072553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0] Write session will restart in 0.005182s
2025-10-10T14:32:51.072587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0] Write session: Do CDS request
2025-10-10T14:32:51.072593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:51.072692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:51.078883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.078901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:51.078914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 745
2025-10-10T14:32:51.079148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.079186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:51.079207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:51.079215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:51.079587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 745 sessionId:  describe result for acl check
2025-10-10T14:32:51.079613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:51.079616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:51.079617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:51.079621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601021230998281:6818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:51.080521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601021230998281:6818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:51.080605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:51.082124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:51.082287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:51.082299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:51.082311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:51.082363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:51.082401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601020448786671:5496]
2025-10-10T14:32:51.082398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601021230998281:6818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:51.082904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:51.083185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:51.083219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:51.083525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:51.083589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.083596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.083599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.083600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.083602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.083603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.083604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.083605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.083607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.083608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.083609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.083610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.083612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.083617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.083630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.083634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.083638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.083642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.083646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.083650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.083654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.083658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.083662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.083666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.083670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.083674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.083681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.083690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.083696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.083701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.083706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.083711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.083716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.083723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.083727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.083732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.083737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.083742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.083746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.083752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.083761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.083766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.083771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.083776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.083786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.083791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.083796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.083801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.083805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.083813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.083817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.083825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.083847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:51.084571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601021230998281:6818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:51.084586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601021230998281:6818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:51.084589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601021230998281:6818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:51.084596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:51.086030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:51.086326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:51.086338Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:51.086341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:51.086344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:51.086350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 744 [2:7559601020448786671:5496]
2025-10-10T14:32:51.086358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:51.086369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:51.086371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.086373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.086375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.086386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:51.086392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:51.086403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:51.086439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.086444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.086445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.086447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:51.086499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:51.086505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.086512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.086518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.086527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:51.086544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998248:2438], now have 1 active actors on pipe
2025-10-10T14:32:51.086550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998318:6818], now have 1 active actors on pipe
2025-10-10T14:32:51.086556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601020448786666:5496]
2025-10-10T14:32:51.086558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601020448786666:5496]
2025-10-10T14:32:51.086559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601020448786666:5496]
2025-10-10T14:32:51.086568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:51.086577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:51.086588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:51.086590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:51.086591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:51.086592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:51.086593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:51.086608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601020448786666:5496]
2025-10-10T14:32:51.086610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:51.086605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 744
2025-10-10T14:32:51.086617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 744
2025-10-10T14:32:51.086618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:51.086645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.086650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.086679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b91349b2-4320f19-4eef7e74-31197ac9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:51.086686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.086695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.086697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:51.086706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.086717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:51.086748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.086869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.086875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.086890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.086969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 745 partition: 0 MaxSeqNo: 40 sessionId: src_id|b91349b2-4320f19-4eef7e74-31197ac9_0
2025-10-10T14:32:51.087294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e32ae72-ec8dc5dc-62ee68dc-173246cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b91349b2-4320f19-4eef7e74-31197ac9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:51.089848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91349b2-4320f19-4eef7e74-31197ac9_0] Write session: try to update token
2025-10-10T14:32:51.089866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91349b2-4320f19-4eef7e74-31197ac9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:51.103433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId: src_id|b91349b2-4320f19-4eef7e74-31197ac9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:51.104689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:51.104709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:51.104712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:51.104714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:51.104724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601020448786666:5496]
2025-10-10T14:32:51.104728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601020448786666:5496]
2025-10-10T14:32:51.104732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601020448786666:5496]
2025-10-10T14:32:51.104778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:51.104780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:51.104786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.104789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:51.104798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:51.104809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:51.104924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:51.106149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:51.172559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601021230998326:6574]
2025-10-10T14:32:51.172799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 744, pipe: [1:7559601021230998326:6574]
2025-10-10T14:32:51.209032Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:51.209263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.209276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.209322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998326:6574], now have 1 active actors on pipe
2025-10-10T14:32:51.209556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:51.209577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601021230998326:6574]
2025-10-10T14:32:51.209599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:51.209601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:51.209677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 745 reason: error at write: Disconnected sessionId: src_id|b91349b2-4320f19-4eef7e74-31197ac9_0
2025-10-10T14:32:51.209740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:51.209882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 745 sessionId: src_id|b91349b2-4320f19-4eef7e74-31197ac9_0 is DEAD
2025-10-10T14:32:51.210015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91349b2-4320f19-4eef7e74-31197ac9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:51.210025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91349b2-4320f19-4eef7e74-31197ac9_0] Write session will restart in 0.005730s
2025-10-10T14:32:51.210044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91349b2-4320f19-4eef7e74-31197ac9_0] Write session: Do CDS request
2025-10-10T14:32:51.210052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91349b2-4320f19-4eef7e74-31197ac9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:51.216856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91349b2-4320f19-4eef7e74-31197ac9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.216909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:51.216920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 746
2025-10-10T14:32:51.217057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.217099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:51.217110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:51.217113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:51.217535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 746 sessionId:  describe result for acl check
2025-10-10T14:32:51.217586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:51.217592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:51.217594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:51.217600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601021230998363:6822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:51.217723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:51.218082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601021230998363:6822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:51.219383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:51.219556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:51.219568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:51.219581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:51.219636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:51.219679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601020448786746:5498]
2025-10-10T14:32:51.219688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601021230998363:6822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:51.220293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:51.220547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:51.220591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:51.220907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:51.220956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.220962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.220963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.220965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.220966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.220967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.220968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.220969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.220971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.220972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.220973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.220975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.220976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.220981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.220993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.220997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.221001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.221007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.221011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.221015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.221019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.221023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.221027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.221030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.221034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.221037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.221044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.221052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.221059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.221064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.221068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.221078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.221082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.221089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.221094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.221105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.221109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.221119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.221124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.221130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.221139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.221146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.221151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.221156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.221161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.221166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.221170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.221175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.221180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.221189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.221193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.221198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.221237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:51.221673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601021230998363:6822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:51.221687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601021230998363:6822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:51.221690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601021230998363:6822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:51.221696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:51.223353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:51.223653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:51.223665Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:51.223668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:51.223671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:51.223676Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 745 [2:7559601020448786746:5498]
2025-10-10T14:32:51.223687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:51.223702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:51.223710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.223714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.223717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.223732Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:51.223739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:51.223746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:51.223795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.223802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.223804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.223806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:51.223864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:51.223871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.223882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.223898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.223922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:51.223948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998398:6822], now have 1 active actors on pipe
2025-10-10T14:32:51.223956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998327:2438], now have 1 active actors on pipe
2025-10-10T14:32:51.223963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601020448786741:5498]
2025-10-10T14:32:51.223965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601020448786741:5498]
2025-10-10T14:32:51.223967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601020448786741:5498]
2025-10-10T14:32:51.223952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 745
2025-10-10T14:32:51.223975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:51.223969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 745
2025-10-10T14:32:51.223987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:51.223999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:51.224003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:51.224006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:51.224010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:51.224013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:51.224037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.224047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.224064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601020448786741:5498]
2025-10-10T14:32:51.224075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:51.224092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:51.224109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e33876-19058947-2cd37612-91911223_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:51.224121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.224125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.224132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:51.224142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.224155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:51.224179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.224305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.224315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.224332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.224440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 746 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e33876-19058947-2cd37612-91911223_0
2025-10-10T14:32:51.224699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91349b2-4320f19-4eef7e74-31197ac9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e33876-19058947-2cd37612-91911223_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:51.227340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e33876-19058947-2cd37612-91911223_0] Write session: try to update token
2025-10-10T14:32:51.227354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e33876-19058947-2cd37612-91911223_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:51.240655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId: src_id|1e33876-19058947-2cd37612-91911223_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:51.242754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:51.242777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:51.242780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:51.242782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:51.242789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601020448786741:5498]
2025-10-10T14:32:51.242793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601020448786741:5498]
2025-10-10T14:32:51.242796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601020448786741:5498]
2025-10-10T14:32:51.242837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:51.242843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:51.242849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:51.242853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:51.242853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.242856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:51.242986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:51.243199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:51.309769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601021230998421:6574]
2025-10-10T14:32:51.310057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 745, pipe: [1:7559601021230998421:6574]
2025-10-10T14:32:51.352009Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:51.352368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.352387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.352427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998421:6574], now have 1 active actors on pipe
2025-10-10T14:32:51.352616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:51.352687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:51.352691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:51.352695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:51.352735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601021230998421:6574]
2025-10-10T14:32:51.352753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 746 reason: error at write: Disconnected sessionId: src_id|1e33876-19058947-2cd37612-91911223_0
2025-10-10T14:32:51.352955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 746 sessionId: src_id|1e33876-19058947-2cd37612-91911223_0 is DEAD
2025-10-10T14:32:51.353159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e33876-19058947-2cd37612-91911223_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:51.353169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e33876-19058947-2cd37612-91911223_0] Write session will restart in 0.009794s
2025-10-10T14:32:51.353187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e33876-19058947-2cd37612-91911223_0] Write session: Do CDS request
2025-10-10T14:32:51.353192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e33876-19058947-2cd37612-91911223_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:51.360231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:51.361691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:51.361878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:51.361889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:51.361901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:51.361952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:51.361997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601020448786834:5501]
2025-10-10T14:32:51.362591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:51.362862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:51.362903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:51.363230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:51.363282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.363288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.363289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.363291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.363292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.363293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.363294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.363294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.363295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.363297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.363298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.363299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.363300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.363306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.363319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.363322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.363327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.363330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.363334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.363342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.363345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.363349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.363353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.363357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.363361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.363365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.363372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.363380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.363386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.363391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.363398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.363404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.363410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.363415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.363425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.363430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.363434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.363439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.363448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.363453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.363457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.363465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.363469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.363477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.363481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.363488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.363492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.363501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.363505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.363511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.363516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.363522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.363561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:51.364019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e33876-19058947-2cd37612-91911223_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.364102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:51.364117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 747
2025-10-10T14:32:51.364213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.364236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:51.364244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:51.364250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:51.364645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 747 sessionId:  describe result for acl check
2025-10-10T14:32:51.364694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:51.364702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:51.364703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:51.364709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601021230998477:6835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:51.365238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601021230998477:6835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:51.365617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:51.365932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:51.365941Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:51.365943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:51.365946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:51.365950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 746 [2:7559601020448786834:5501]
2025-10-10T14:32:51.365958Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:51.365971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:51.365977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.365981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.365982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.365995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:51.366000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:51.366010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:51.366053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.366058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.366059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.366060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:51.366108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:51.366114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.366121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.366127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.366150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:51.366174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998422:2438], now have 1 active actors on pipe
2025-10-10T14:32:51.366186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601020448786829:5501]
2025-10-10T14:32:51.366190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601020448786829:5501]
2025-10-10T14:32:51.366176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 746
2025-10-10T14:32:51.366191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601020448786829:5501]
2025-10-10T14:32:51.366201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:51.366212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:51.366222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:51.366225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:51.366228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:51.366230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:51.366232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:51.366245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601020448786829:5501]
2025-10-10T14:32:51.366247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:51.366249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:51.367415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601021230998477:6835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:51.372580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601021230998477:6835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:51.372593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601021230998477:6835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:51.372596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601021230998477:6835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:51.372604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:51.373001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998510:6835], now have 1 active actors on pipe
2025-10-10T14:32:51.373050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 746
2025-10-10T14:32:51.373098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.373110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.373142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:51.373162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.373169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.373172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:51.373185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.373208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:51.373234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.373380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.373388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.373402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.373497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 747 partition: 0 MaxSeqNo: 40 sessionId: src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0
2025-10-10T14:32:51.373864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e33876-19058947-2cd37612-91911223_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:51.376493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0] Write session: try to update token
2025-10-10T14:32:51.376508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:51.383714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:51.383734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:51.383737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:51.383739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:51.383748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601020448786829:5501]
2025-10-10T14:32:51.383752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601020448786829:5501]
2025-10-10T14:32:51.383755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601020448786829:5501]
2025-10-10T14:32:51.383794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:51.383798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:51.383804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.383807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:51.383809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:51.383822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:51.383967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:51.390589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId: src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:51.393055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:51.453135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601021230998525:6574]
2025-10-10T14:32:51.453389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 746, pipe: [1:7559601021230998525:6574]
2025-10-10T14:32:51.491164Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:51.491558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.491574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.491599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998525:6574], now have 1 active actors on pipe
2025-10-10T14:32:51.491799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601021230998525:6574]
2025-10-10T14:32:51.491824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:51.491799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:51.491836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:51.491839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:51.491906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 747 reason: error at write: Disconnected sessionId: src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0
2025-10-10T14:32:51.492107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 747 sessionId: src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0 is DEAD
2025-10-10T14:32:51.492267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:51.492277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0] Write session will restart in 0.009299s
2025-10-10T14:32:51.492305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0] Write session: Do CDS request
2025-10-10T14:32:51.492310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:51.499215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:51.500534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:51.500706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:51.500718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:51.500729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:51.500775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:51.500816Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601020448786949:5516]
2025-10-10T14:32:51.501430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:51.501701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:51.501741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:51.502051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:51.502107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.502113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.502114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.502116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.502117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.502118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.502119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.502121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.502122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.502123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.502124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.502125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.502127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.502132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.502146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.502151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.502155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.502158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.502162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.502166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.502170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.502174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.502179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.502183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.502187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.502191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.502199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.502207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.502213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.502224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.502228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.502234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.502243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.502248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.502257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.502262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.502267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.502276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.502280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.502286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.502294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.502299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.502304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.502309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.502318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.502323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.502332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.502338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.502343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.502353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.502357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.502367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.502407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:51.502807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.503185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:51.503202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 748
2025-10-10T14:32:51.503316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.503348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:51.503359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:51.503363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:51.503728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 748 sessionId:  describe result for acl check
2025-10-10T14:32:51.503761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:51.503768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:51.503770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:51.503776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601021230998571:6842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:51.504286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601021230998571:6842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:51.504557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:51.504859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:51.504873Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:51.504875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:51.504878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:51.504884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 747 [2:7559601020448786949:5516]
2025-10-10T14:32:51.504894Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:51.504909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:51.504917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.504921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.504923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.504939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:51.504950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:51.504957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:51.505217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.505226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.505228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.505231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:51.505293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:51.505301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.505313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.505346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.505376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:51.505375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 747
2025-10-10T14:32:51.505414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998527:2438], now have 1 active actors on pipe
2025-10-10T14:32:51.505434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601020448786944:5516]
2025-10-10T14:32:51.505448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601020448786944:5516]
2025-10-10T14:32:51.505451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601020448786944:5516]
2025-10-10T14:32:51.505472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:51.505495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:51.505502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:51.505511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:51.505514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:51.505524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:51.505528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:51.505560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601020448786944:5516]
2025-10-10T14:32:51.505589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:51.505593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:51.506359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601021230998571:6842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:51.511528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601021230998571:6842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:51.511540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601021230998571:6842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:51.511543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601021230998571:6842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:51.511549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:51.511766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998604:6842], now have 1 active actors on pipe
2025-10-10T14:32:51.511832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 747
2025-10-10T14:32:51.511910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.511922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.511951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c16f6031-191f6285-900ad4e9-40b418e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:51.511967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.511972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.511975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:51.511987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.512007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:51.512030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.512234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.512243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.512258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.512369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 748 partition: 0 MaxSeqNo: 40 sessionId: src_id|c16f6031-191f6285-900ad4e9-40b418e1_0
2025-10-10T14:32:51.512679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da6c3eea-21087e05-2fde9e68-ca76a427_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c16f6031-191f6285-900ad4e9-40b418e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:51.515346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c16f6031-191f6285-900ad4e9-40b418e1_0] Write session: try to update token
2025-10-10T14:32:51.515362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c16f6031-191f6285-900ad4e9-40b418e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:51.523897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:51.523924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:51.523929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:51.523931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:51.523942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601020448786944:5516]
2025-10-10T14:32:51.523947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601020448786944:5516]
2025-10-10T14:32:51.523952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601020448786944:5516]
2025-10-10T14:32:51.524004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:51.524016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:51.524020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.524023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:51.524032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:51.524037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:51.524244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:51.529430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId: src_id|c16f6031-191f6285-900ad4e9-40b418e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:51.531806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:51.591875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601021230998614:6574]
2025-10-10T14:32:51.592131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 747, pipe: [1:7559601021230998614:6574]
2025-10-10T14:32:51.628411Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:51.628795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.628809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.628829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998614:6574], now have 1 active actors on pipe
2025-10-10T14:32:51.629019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:51.629031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601021230998614:6574]
2025-10-10T14:32:51.629128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:51.629137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:51.629197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 748 reason: error at write: Disconnected sessionId: src_id|c16f6031-191f6285-900ad4e9-40b418e1_0
2025-10-10T14:32:51.629417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 748 sessionId: src_id|c16f6031-191f6285-900ad4e9-40b418e1_0 is DEAD
2025-10-10T14:32:51.629565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c16f6031-191f6285-900ad4e9-40b418e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:51.629575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c16f6031-191f6285-900ad4e9-40b418e1_0] Write session will restart in 0.008302s
2025-10-10T14:32:51.629593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c16f6031-191f6285-900ad4e9-40b418e1_0] Write session: Do CDS request
2025-10-10T14:32:51.629598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c16f6031-191f6285-900ad4e9-40b418e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:51.630185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:51.635924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:51.637450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:51.637626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:51.637638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:51.637648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:51.637695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:51.637734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601020448787030:5519]
2025-10-10T14:32:51.638167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:51.638437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:51.638483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:51.638772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:51.638831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c16f6031-191f6285-900ad4e9-40b418e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.638845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.638853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.638854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.638856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.638857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.638859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.638860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.638860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.638861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.638861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.638862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.638863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.638863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.638867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.638876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.638878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.638880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.638882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.638884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.638926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:51.638941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 749
2025-10-10T14:32:51.638887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.638889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.638891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.638893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.638895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.638897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.638899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.638906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.638914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.638920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.638925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.638930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.638934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.638938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.638943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.638949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.638954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.638958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.638963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.638967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.638972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.638976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.638981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.638985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.638990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.638995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.639000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.639004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.639009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.639012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.639015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.639019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.639021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.639086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.639115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:51.639121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:51.639069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:51.639124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:51.639540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 749 sessionId:  describe result for acl check
2025-10-10T14:32:51.639577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:51.639585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:51.639588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:51.639594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601021230998663:6848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:51.640148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601021230998663:6848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:51.641138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:51.641509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:51.641522Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:51.641525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:51.641528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:51.641534Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 748 [2:7559601020448787030:5519]
2025-10-10T14:32:51.641546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:51.641562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:51.641565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.641569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.641571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.641588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:51.641601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:51.641614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:51.641664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.641671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.641673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.641677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:51.641738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:51.641745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.641756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.641773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.641794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:51.641820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998615:2438], now have 1 active actors on pipe
2025-10-10T14:32:51.641832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601020448787025:5519]
2025-10-10T14:32:51.641834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601020448787025:5519]
2025-10-10T14:32:51.641837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601020448787025:5519]
2025-10-10T14:32:51.641824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 748
2025-10-10T14:32:51.641849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:51.641862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:51.641865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:51.641867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:51.641867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:51.641883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:51.641891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:51.641917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601020448787025:5519]
2025-10-10T14:32:51.641928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:51.641934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:51.642542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601021230998663:6848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:51.648054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601021230998663:6848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:51.648070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601021230998663:6848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:51.648074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601021230998663:6848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:51.648083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:51.648322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998697:6848], now have 1 active actors on pipe
2025-10-10T14:32:51.648402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 748
2025-10-10T14:32:51.648551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.648566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.648601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:51.648620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.648632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.648635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:51.648651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.648672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:51.648696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.648864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.648873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.648888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.648968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 749 partition: 0 MaxSeqNo: 40 sessionId: src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0
2025-10-10T14:32:51.649373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c16f6031-191f6285-900ad4e9-40b418e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:51.652135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0] Write session: try to update token
2025-10-10T14:32:51.652162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:51.652816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:51.652843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:51.652855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601020448787025:5519]
2025-10-10T14:32:51.652897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:51.652909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:51.653184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:51.653412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:51.653618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:51.653814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:51.654089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:51.654145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:51.666457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId: src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:51.668984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:51.669868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.669891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.669912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:51.669915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:51.669916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:51.669917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:51.669924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601020448787025:5519]
2025-10-10T14:32:51.669927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601020448787025:5519]
2025-10-10T14:32:51.669931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601020448787025:5519]
2025-10-10T14:32:51.669976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:51.669982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:51.669990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.669992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:51.669992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:51.669996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:51.670115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:51.729098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601021230998700:6574]
2025-10-10T14:32:51.729383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 748, pipe: [1:7559601021230998700:6574]
2025-10-10T14:32:51.775310Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:51.775516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:51.775551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998700:6574], now have 1 active actors on pipe
2025-10-10T14:32:51.775656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:51.775788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601021230998700:6574]
2025-10-10T14:32:51.775815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:51.783341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:51.784356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:51.784368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:51.784386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 749 reason: error at write: Disconnected sessionId: src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0
2025-10-10T14:32:51.784519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 749 sessionId: src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0 is DEAD
2025-10-10T14:32:51.784669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:51.784675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0] Write session will restart in 0.009535s
2025-10-10T14:32:51.784693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0] Write session: Do CDS request
2025-10-10T14:32:51.784698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:51.787950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:51.788148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:51.788160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:51.788171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:51.788221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:51.788262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601020448787111:5521]
2025-10-10T14:32:51.789193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:51.789491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:51.789537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:51.789787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:51.789838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.789843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.789845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.789846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.789847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.789848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.789849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.789850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.789852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.789853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.789854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.789855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.789856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.789862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.789874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.789878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.789882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.789885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.789889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.789893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.789896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.789899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.789904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.789908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.789912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.789916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.789924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.789932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.789942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.789947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.789956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.789961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.789965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.789972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.789976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.789981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.789987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.789992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.789998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.790003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.790011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.790017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.790021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.790026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.790030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.790035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.790046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.790051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.790055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.790062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.790066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.790075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.790113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:51.792260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:51.792620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:51.792633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:51.792635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:51.792638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:51.792646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 749 [2:7559601020448787111:5521]
2025-10-10T14:32:51.792656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:51.792671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:51.792678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.792682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.792684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.792697Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:51.792709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:51.792716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:51.792763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.792769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.792771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.792774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:51.792832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:51.792840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.792851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.792863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.792884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:51.792908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998701:2438], now have 1 active actors on pipe
2025-10-10T14:32:51.792920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601020448787105:5521]
2025-10-10T14:32:51.792922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601020448787105:5521]
2025-10-10T14:32:51.792924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601020448787105:5521]
2025-10-10T14:32:51.792939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:51.792929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 749
2025-10-10T14:32:51.792955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:51.792957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:51.792966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:51.792969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:51.792972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:51.792975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:51.792999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601020448787105:5521]
2025-10-10T14:32:51.793011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:51.793023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:51.795807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.795907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:51.795920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 750
2025-10-10T14:32:51.796070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.796105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:51.796115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:51.796119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:51.796454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 750 sessionId:  describe result for acl check
2025-10-10T14:32:51.796481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:51.796486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:51.796487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:51.796491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601021230998751:6852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:51.796892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601021230998751:6852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:51.799452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601021230998751:6852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:51.805247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601021230998751:6852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:51.805260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601021230998751:6852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:51.805263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601021230998751:6852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:51.805271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:51.805484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998781:6852], now have 1 active actors on pipe
2025-10-10T14:32:51.805546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 749
2025-10-10T14:32:51.805635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.805649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.805677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:51.805693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.805701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.805702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:51.805713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.805728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:51.805746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.805942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.805956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.805967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.806033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 750 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0
2025-10-10T14:32:51.806329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6940cbb-a362e8e7-b56c6f2-773ffe9b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:51.808942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0] Write session: try to update token
2025-10-10T14:32:51.808956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:51.810986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:51.811003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:51.811006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:51.811008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:51.811019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601020448787105:5521]
2025-10-10T14:32:51.811023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601020448787105:5521]
2025-10-10T14:32:51.811039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601020448787105:5521]
2025-10-10T14:32:51.811084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:51.811090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:51.811096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:51.811097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.811099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:51.811101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:51.811229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:51.823040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId: src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:51.825368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:51.876032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601021230998784:6574]
2025-10-10T14:32:51.876258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 749, pipe: [1:7559601021230998784:6574]
2025-10-10T14:32:51.914138Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:51.914428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.914442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.914465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998784:6574], now have 1 active actors on pipe
2025-10-10T14:32:51.914626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:51.914685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601021230998784:6574]
2025-10-10T14:32:51.914701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:51.914706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:51.914717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:51.914769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 750 reason: error at write: Disconnected sessionId: src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0
2025-10-10T14:32:51.914987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 750 sessionId: src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0 is DEAD
2025-10-10T14:32:51.915178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:51.915196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0] Write session will restart in 0.007922s
2025-10-10T14:32:51.915214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0] Write session: Do CDS request
2025-10-10T14:32:51.915221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:51.923563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:51.923967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.924062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:51.924080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 751
2025-10-10T14:32:51.924250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:51.924286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:51.924299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:51.924307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:51.924793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 751 sessionId:  describe result for acl check
2025-10-10T14:32:51.924829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:51.924836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:51.924837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:51.924844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601021230998827:6856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:51.925080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:51.925306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:51.925320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:51.925345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:51.925402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:51.925412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601021230998827:6856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:51.925448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601020448787191:5523]
2025-10-10T14:32:51.925864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:51.926115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:51.926159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:51.926432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:51.926481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.926486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.926487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.926487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.926490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.926490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.926491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.926492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.926492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.926494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.926494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.926495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.926496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.926499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.926507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.926510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.926512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.926515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.926517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.926519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.926522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.926524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.926527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.926529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.926531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.926534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.926538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.926544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:51.926549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.926553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:51.926555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.926560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:51.926565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.926570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:51.926575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.926582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:51.926586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.926589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:51.926593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.926596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:51.926599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.926602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:51.926605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.926608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:51.926610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.926613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:51.926616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.926619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.926621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.926624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.926626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.926630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.926668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:51.927679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601021230998827:6856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:51.928945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:51.929254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:51.929268Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:51.929270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:51.929274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:51.929280Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 750 [2:7559601020448787191:5523]
2025-10-10T14:32:51.929296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:51.929319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:51.929325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.929345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.929347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.929366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:51.929381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:51.929393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:51.929436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.929441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.929443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.929444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:51.929508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:51.929517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.929525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:51.929531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:51.929549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:51.929575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998785:2438], now have 1 active actors on pipe
2025-10-10T14:32:51.929587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601020448787186:5523]
2025-10-10T14:32:51.929590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601020448787186:5523]
2025-10-10T14:32:51.929591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601020448787186:5523]
2025-10-10T14:32:51.929599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:51.929582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 750
2025-10-10T14:32:51.929610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:51.929613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:51.929621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:51.929623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:51.929630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:51.929633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:51.929661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601020448787186:5523]
2025-10-10T14:32:51.929673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:51.929686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:51.929958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601021230998827:6856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:51.929972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601021230998827:6856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:51.929976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601021230998827:6856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:51.929984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:51.930165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601021230998863:6856], now have 1 active actors on pipe
2025-10-10T14:32:51.930200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 750
2025-10-10T14:32:51.930246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.930257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.930283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:51.930293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:51.930299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:51.930301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:51.930310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:51.930319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:51.930334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.930468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:51.930480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:51.930495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:51.930577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 751 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0
2025-10-10T14:32:51.930968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d9cc356-44d4b9a4-f47b970e-7e58bf82_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:51.933892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0] Write session: try to update token
2025-10-10T14:32:51.933912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:51.947935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:51.947959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:51.947963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:51.947965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:51.947975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601020448787186:5523]
2025-10-10T14:32:51.947981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601020448787186:5523]
2025-10-10T14:32:51.947985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601020448787186:5523]
2025-10-10T14:32:51.948029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:51.948034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:51.948042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:51.948045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:51.948056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:51.948061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:51.948185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:51.948445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId: src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:51.951144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:52.014785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601025525966165:6574]
2025-10-10T14:32:52.015063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 750, pipe: [1:7559601025525966165:6574]
2025-10-10T14:32:52.055925Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:52.056206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.056218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.056257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966165:6574], now have 1 active actors on pipe
2025-10-10T14:32:52.056529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:52.056510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:52.056527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:52.056551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601025525966165:6574]
2025-10-10T14:32:52.056575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:52.056585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 751 reason: error at write: Disconnected sessionId: src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0
2025-10-10T14:32:52.056797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 751 sessionId: src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0 is DEAD
2025-10-10T14:32:52.056944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:52.056957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0] Write session will restart in 0.005902s
2025-10-10T14:32:52.056982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0] Write session: Do CDS request
2025-10-10T14:32:52.056988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:52.063788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.063909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:52.063922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:52.063938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 752
2025-10-10T14:32:52.064068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.064120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:52.064128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:52.064132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:52.064516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 752 sessionId:  describe result for acl check
2025-10-10T14:32:52.064547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:52.064553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:52.064555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:52.064559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601025525966209:6860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:52.064974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601025525966209:6860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:52.065397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:52.065539Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:52.065552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:52.065564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:52.065612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:52.065651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601024743754568:5525]
2025-10-10T14:32:52.066184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:52.066409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:52.066447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:52.066728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601025525966209:6860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:52.066761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:52.066814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.066821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.066822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.066825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.066826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.066827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.066828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.066829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.066830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.066831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.066832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.066833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.066834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.066839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.066850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.066854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.066858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.066863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.066867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.066870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.066874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.066878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.066883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.066887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.066891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.066895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.066902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.066911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.066917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.066923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.066927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.066932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.066936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.066942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.066947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.066952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.066956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.066961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.066966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.066971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.066975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.066981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.066986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.066991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.066995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.067001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.067009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.067014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.067018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.067022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.067026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.067044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.067084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:52.068974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601025525966209:6860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:52.068986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601025525966209:6860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:52.068989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601025525966209:6860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:52.068994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:52.069139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:52.069544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:52.069555Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:52.069557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:52.069560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:52.069566Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 751 [2:7559601024743754568:5525]
2025-10-10T14:32:52.069574Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:52.069588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:52.069590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.069592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.069594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.069605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:52.069613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:52.069619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:52.069655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.069661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.069663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.069666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:52.069723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:52.069728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.069738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.069747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.069767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:52.069791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966243:6860], now have 1 active actors on pipe
2025-10-10T14:32:52.069798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966166:2438], now have 1 active actors on pipe
2025-10-10T14:32:52.069805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601024743754563:5525]
2025-10-10T14:32:52.069807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601024743754563:5525]
2025-10-10T14:32:52.069809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601024743754563:5525]
2025-10-10T14:32:52.069823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:52.069835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:52.069821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 751
2025-10-10T14:32:52.069838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:52.069839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:52.069822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 751
2025-10-10T14:32:52.069841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:52.069854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:52.069858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:52.069894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.069901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.069913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601024743754563:5525]
2025-10-10T14:32:52.069921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:52.069930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:52.069951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b30b954-92cc46cc-c60c8de6-89436742_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:52.069963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.069966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.069968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:52.069979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.069989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:52.070012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.070126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.070134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.070148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.070237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 752 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b30b954-92cc46cc-c60c8de6-89436742_0
2025-10-10T14:32:52.070540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5658c5-4d922505-b07b4d0e-b9d85cf2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b30b954-92cc46cc-c60c8de6-89436742_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:52.073132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b30b954-92cc46cc-c60c8de6-89436742_0] Write session: try to update token
2025-10-10T14:32:52.073148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b30b954-92cc46cc-c60c8de6-89436742_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:52.086696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId: src_id|9b30b954-92cc46cc-c60c8de6-89436742_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:52.087653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:52.087670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.087673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:52.087677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:52.087687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601024743754563:5525]
2025-10-10T14:32:52.087692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601024743754563:5525]
2025-10-10T14:32:52.087695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601024743754563:5525]
2025-10-10T14:32:52.087743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:52.087748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:52.087749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:52.087754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:52.087755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.087758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:52.087908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:52.089154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:52.156620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601025525966251:6574]
2025-10-10T14:32:52.156915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 751, pipe: [1:7559601025525966251:6574]
2025-10-10T14:32:52.191567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:52.191803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.191816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.191858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966251:6574], now have 1 active actors on pipe
2025-10-10T14:32:52.192067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:52.192083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:52.192089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:52.192130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601025525966251:6574]
2025-10-10T14:32:52.192158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 752 reason: error at write: Disconnected sessionId: src_id|9b30b954-92cc46cc-c60c8de6-89436742_0
2025-10-10T14:32:52.192246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:52.192444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 752 sessionId: src_id|9b30b954-92cc46cc-c60c8de6-89436742_0 is DEAD
2025-10-10T14:32:52.192586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b30b954-92cc46cc-c60c8de6-89436742_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:52.192599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b30b954-92cc46cc-c60c8de6-89436742_0] Write session will restart in 0.007687s
2025-10-10T14:32:52.192626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b30b954-92cc46cc-c60c8de6-89436742_0] Write session: Do CDS request
2025-10-10T14:32:52.192633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b30b954-92cc46cc-c60c8de6-89436742_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:52.199748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:52.201383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:52.201565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:52.201576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:52.201585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:52.201626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:52.201658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601024743754651:5527]
2025-10-10T14:32:52.201924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b30b954-92cc46cc-c60c8de6-89436742_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.201987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:52.202002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 753
2025-10-10T14:32:52.202134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:52.202139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.202171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:52.202176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:52.202179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:52.202431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:52.202474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:52.202486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 753 sessionId:  describe result for acl check
2025-10-10T14:32:52.202512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:52.202518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:52.202520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:52.202525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601025525966298:6864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:52.202758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:52.202797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.202802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.202803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.202803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.202804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.202807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.202807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.202808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.202809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.202809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.202810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.202810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.202811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.202815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.202822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.202825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.202827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.202829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.202831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.202833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.202835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.202836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.202839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.202841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.202843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.202845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.202850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.202856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.202860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.202864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.202866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.202870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.202872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.202875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.202878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.202881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.202884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.202887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.202890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.202893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.202896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.202900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.202903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.202906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.202908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.202911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.202914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.202916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.202919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.202922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.202924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.202928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.202963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:52.202969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601025525966298:6864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:52.205100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601025525966298:6864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:52.205149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:52.205640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:52.205655Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:52.205657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:52.205661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:52.205668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 752 [2:7559601024743754651:5527]
2025-10-10T14:32:52.205682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:52.205700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:52.205710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.205714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.205717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.205733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:52.205741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:52.205752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:52.205811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.205820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.205822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.205825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:52.205900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:52.205907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.205919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.205931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.205951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:52.205978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966252:2438], now have 1 active actors on pipe
2025-10-10T14:32:52.205990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601024743754646:5527]
2025-10-10T14:32:52.205991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601024743754646:5527]
2025-10-10T14:32:52.205993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601024743754646:5527]
2025-10-10T14:32:52.205983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 752
2025-10-10T14:32:52.206001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:52.206007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:52.206009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:52.206010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:52.206017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:52.206033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:52.206040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:52.206069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601024743754646:5527]
2025-10-10T14:32:52.206081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:52.206097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:52.211030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601025525966298:6864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:52.211053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601025525966298:6864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:52.211057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601025525966298:6864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:52.211064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:52.211336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966334:6864], now have 1 active actors on pipe
2025-10-10T14:32:52.211381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 752
2025-10-10T14:32:52.211448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.211461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.211502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:52.211519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.211529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.211532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:52.211549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.211570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:52.211591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.211763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.211772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.211787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.211881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 753 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0
2025-10-10T14:32:52.212243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b30b954-92cc46cc-c60c8de6-89436742_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:52.214780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0] Write session: try to update token
2025-10-10T14:32:52.214793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:52.217604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:52.217626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.217639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601024743754646:5527]
2025-10-10T14:32:52.217682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:52.217692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:52.217952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:52.218111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.218276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.218441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.218666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:52.218710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:52.228843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId: src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:52.231384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:52.231570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.231591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.231630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:52.231715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:52.235025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:52.235050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.235052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:52.235054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:52.235067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601024743754646:5527]
2025-10-10T14:32:52.235071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601024743754646:5527]
2025-10-10T14:32:52.235074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601024743754646:5527]
2025-10-10T14:32:52.235108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:52.235113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:52.235118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:52.235121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.235121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:52.235122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:52.235256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:52.292314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601025525966349:6574]
2025-10-10T14:32:52.292597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 752, pipe: [1:7559601025525966349:6574]
2025-10-10T14:32:52.338595Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:52.345488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.345508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.345660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.345715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.345772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.345831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.345916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.345924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.345999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.346053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.346111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.346170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.346207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.346212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.346270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.346326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.346381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.346439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.346479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.346485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.346540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.346596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.346651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.346707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.346745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.346750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.346806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.346877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.346933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.346989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.347031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.347050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.347107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.347198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.347266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.347322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.347360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.347365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.347422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.347474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.347534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.347595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.347647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.347656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.347713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.347765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.347819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.347873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.347913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.347922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.347977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.348029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.348082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.348135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.348182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.348190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.348252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.348304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.348390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.348446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.348486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.348491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.348531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966349:6574], now have 1 active actors on pipe
2025-10-10T14:32:52.348893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601025525966349:6574]
2025-10-10T14:32:52.348936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:52.348941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:52.348969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 753 reason: error at write: Disconnected sessionId: src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0
2025-10-10T14:32:52.349032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:52.349190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 753 sessionId: src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0 is DEAD
2025-10-10T14:32:52.349360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:52.349373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0] Write session will restart in 0.005138s
2025-10-10T14:32:52.349399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0] Write session: Do CDS request
2025-10-10T14:32:52.349415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:52.349421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:52.355869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.355927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:52.355941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 754
2025-10-10T14:32:52.356103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.356158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:52.356170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:52.356176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:52.356599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:52.356633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 754 sessionId:  describe result for acl check
2025-10-10T14:32:52.356679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:52.356685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:52.356687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:52.356693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601025525966395:6869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:52.357622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601025525966395:6869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:52.358107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:52.358274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:52.358288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:52.358300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:52.358350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:52.358392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601024743754748:5530]
2025-10-10T14:32:52.358921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:52.359183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:52.359223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:52.359534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:52.359585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.359591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.359592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.359593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.359594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.359595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.359597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.359598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.359599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.359600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.359601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.359602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.359603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.359609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.359621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.359625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.359629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.359632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.359636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.359640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.359646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.359649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.359653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.359657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.359661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.359665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.359671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.359679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.359685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.359695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.359700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.359705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.359713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.359718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.359722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.359727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.359731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.359737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.359745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.359750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.359752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.359755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.359761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.359766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.359770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.359774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.359778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.359784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.359788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.359793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.359803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.359808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.359851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:52.360134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601025525966395:6869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:52.361924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:52.362358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:52.362369Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:52.362371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:52.362376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:52.362381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 753 [2:7559601024743754748:5530]
2025-10-10T14:32:52.362393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:52.362409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:52.362412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.362416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.362418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.362434Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:52.362446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:52.362455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:52.362510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601025525966395:6869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:52.362513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.362519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.362522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.362524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:52.362536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601025525966395:6869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:52.362540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601025525966395:6869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:52.362547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:52.362587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:52.362594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.362605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.362619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.362640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:52.362665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966351:2438], now have 1 active actors on pipe
2025-10-10T14:32:52.362677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601024743754743:5530]
2025-10-10T14:32:52.362679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601024743754743:5530]
2025-10-10T14:32:52.362654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 753
2025-10-10T14:32:52.362681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601024743754743:5530]
2025-10-10T14:32:52.362690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:52.362704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:52.362705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:52.362708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:52.362710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:52.362725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:52.362728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:52.362754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966429:6869], now have 1 active actors on pipe
2025-10-10T14:32:52.362761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601024743754743:5530]
2025-10-10T14:32:52.362768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:52.362761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 753
2025-10-10T14:32:52.362780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:52.362808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.362817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.362844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29996da8-de2ed3ac-306fc555-678c74c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:52.362855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.362860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.362863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:52.362879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.362890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:52.362906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.363052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.363060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.363074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.363136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 754 partition: 0 MaxSeqNo: 40 sessionId: src_id|29996da8-de2ed3ac-306fc555-678c74c4_0
2025-10-10T14:32:52.363448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cddc9fc-cffb4061-f136fce1-8c23d2a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29996da8-de2ed3ac-306fc555-678c74c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:52.366116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29996da8-de2ed3ac-306fc555-678c74c4_0] Write session: try to update token
2025-10-10T14:32:52.366135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29996da8-de2ed3ac-306fc555-678c74c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:52.373645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:52.373670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.373680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601024743754743:5530]
2025-10-10T14:32:52.373730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:52.373732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:52.373906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:52.374052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.374189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.374327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.374513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:52.374555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:52.379941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId: src_id|29996da8-de2ed3ac-306fc555-678c74c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:52.382516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:52.382724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.382746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.382787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:52.382957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:52.390441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:52.390455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.390459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:52.390461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:52.390473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601024743754743:5530]
2025-10-10T14:32:52.390477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601024743754743:5530]
2025-10-10T14:32:52.390480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601024743754743:5530]
2025-10-10T14:32:52.390523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:52.390527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:52.390528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:52.390531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:52.390535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.390537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:52.390667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:52.448953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601025525966460:6574]
2025-10-10T14:32:52.449194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 753, pipe: [1:7559601025525966460:6574]
2025-10-10T14:32:52.503072Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:52.511155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.511180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.511379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.511456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.511533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.511607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.511657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.511667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.511737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.511802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.511868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.511938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.511994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.512003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.512073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.512134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.512195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.512265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.512317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.512328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.512405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.512497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.512584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.512668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.512712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.512721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.512787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.512854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.512918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.512981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.513026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.513035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.513109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.513174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.513267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.513342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.513411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.513419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.513492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.513554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.513626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.513694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.513741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.513748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.513815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.513883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.513950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.514012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.514057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.514064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.514154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.514218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.514290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.514356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.514400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.514407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.514473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.514541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.514612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.514673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.514722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.514729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.514791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966460:6574], now have 1 active actors on pipe
2025-10-10T14:32:52.515068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601025525966460:6574]
2025-10-10T14:32:52.515097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:52.515101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:52.515110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:52.515127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 754 reason: error at write: Disconnected sessionId: src_id|29996da8-de2ed3ac-306fc555-678c74c4_0
2025-10-10T14:32:52.515350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 754 sessionId: src_id|29996da8-de2ed3ac-306fc555-678c74c4_0 is DEAD
2025-10-10T14:32:52.515482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29996da8-de2ed3ac-306fc555-678c74c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:52.515500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29996da8-de2ed3ac-306fc555-678c74c4_0] Write session will restart in 0.007761s
2025-10-10T14:32:52.515521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29996da8-de2ed3ac-306fc555-678c74c4_0] Write session: Do CDS request
2025-10-10T14:32:52.515526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29996da8-de2ed3ac-306fc555-678c74c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:52.515839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:52.523849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:52.524837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29996da8-de2ed3ac-306fc555-678c74c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.524904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:52.524918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 755
2025-10-10T14:32:52.525058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.525087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:52.525095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:52.525098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:52.525417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:52.525463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 755 sessionId:  describe result for acl check
2025-10-10T14:32:52.525491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:52.525496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:52.525498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:52.525503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601025525966508:6882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:52.525602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:52.525615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:52.525627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:52.525679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:52.525721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601024743754871:5545]
2025-10-10T14:32:52.525924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601025525966508:6882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:52.526329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:52.526626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:52.526670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:52.526994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:52.527075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.527082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.527083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.527084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.527085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.527086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.527087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.527089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.527090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.527091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.527092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.527094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.527095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.527101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.527112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.527116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.527120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.527123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.527128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.527132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.527135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.527139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.527143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.527147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.527151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.527155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.527164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.527172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.527178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.527183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.527191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.527196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.527200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.527210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.527214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.527218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.527222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.527231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.527236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.527240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.527244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.527249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.527257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.527265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.527269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.527274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.527278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.527283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.527288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.527295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.527299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.527308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.527348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:52.527689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601025525966508:6882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:52.529580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:52.529857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601025525966508:6882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:52.529869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601025525966508:6882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:52.529872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601025525966508:6882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:52.529878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:52.529939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:52.529952Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:52.529954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:52.529957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:52.529963Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 754 [2:7559601024743754871:5545]
2025-10-10T14:32:52.529976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:52.529999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:52.530007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.530009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.530012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.530027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:52.530039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:52.530046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:52.530105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.530112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.530114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.530116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:52.530184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:52.530191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.530202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.530214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.530236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:52.530261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966462:2438], now have 1 active actors on pipe
2025-10-10T14:32:52.530269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966542:6882], now have 1 active actors on pipe
2025-10-10T14:32:52.530276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601024743754866:5545]
2025-10-10T14:32:52.530272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 754
2025-10-10T14:32:52.530283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601024743754866:5545]
2025-10-10T14:32:52.530277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 754
2025-10-10T14:32:52.530285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601024743754866:5545]
2025-10-10T14:32:52.530294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:52.530307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:52.530319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:52.530322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:52.530324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:52.530327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:52.530331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:52.530367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.530377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.530391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601024743754866:5545]
2025-10-10T14:32:52.530403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:52.530419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:52.530437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:52.530449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.530455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.530458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:52.530469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.530483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:52.530508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.530630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.530637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.530652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.530722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 755 partition: 0 MaxSeqNo: 40 sessionId: src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0
2025-10-10T14:32:52.531010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29996da8-de2ed3ac-306fc555-678c74c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:52.533612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0] Write session: try to update token
2025-10-10T14:32:52.533628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:52.547170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId: src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:52.548682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:52.548700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.548703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:52.548705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:52.548715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601024743754866:5545]
2025-10-10T14:32:52.548722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601024743754866:5545]
2025-10-10T14:32:52.548727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601024743754866:5545]
2025-10-10T14:32:52.548764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:52.548775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:52.548782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:52.548783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.548784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:52.548785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:52.548932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:52.549575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:52.615363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601025525966561:6574]
2025-10-10T14:32:52.615642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 754, pipe: [1:7559601025525966561:6574]
2025-10-10T14:32:52.652864Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:52.653067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.653078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.653114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966561:6574], now have 1 active actors on pipe
2025-10-10T14:32:52.653273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:52.653355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601025525966561:6574]
2025-10-10T14:32:52.653377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:52.653384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:52.653454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 755 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0
2025-10-10T14:32:52.653661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 755 sessionId: src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0 is DEAD
2025-10-10T14:32:52.653816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:52.653828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0] Write session will restart in 0.006742s
2025-10-10T14:32:52.653851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0] Write session: Do CDS request
2025-10-10T14:32:52.653856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:52.660895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:52.661780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.661956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:52.661969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 756
2025-10-10T14:32:52.662086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.662113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:52.662122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:52.662126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:52.662346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:52.662458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 756 sessionId:  describe result for acl check
2025-10-10T14:32:52.662484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:52.662490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:52.662484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:52.662491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:52.662495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601025525966613:6888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:52.662493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:52.662502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:52.662538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:52.662568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601024743754958:5548]
2025-10-10T14:32:52.662900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601025525966613:6888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:52.662953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:52.663200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:52.663243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:52.663461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:52.663512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.663518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.663519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.663520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.663521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.663522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.663523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.663524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.663525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.663526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.663527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.663528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.663529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.663533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.663544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.663548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.663552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.663556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.663561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.663564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.663568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.663572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.663576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.663579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.663582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.663585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.663592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.663600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.663606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.663611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.663615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.663620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.663624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.663629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.663634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.663638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.663642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.663646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.663650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.663654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.663658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.663662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.663666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.663671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.663674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.663682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.663686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.663690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.663700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.663705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.663708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.663713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.663749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:52.664833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601025525966613:6888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:52.665842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:52.666123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:52.666132Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:52.666134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:52.666136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:52.666141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 755 [2:7559601024743754958:5548]
2025-10-10T14:32:52.666150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:52.666164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:52.666165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.666167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.666170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.666181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:52.666191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:52.666196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:52.666234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.666239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.666240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.666241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:52.666291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:52.666299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.666309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.666316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.666331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:52.666356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966566:2438], now have 1 active actors on pipe
2025-10-10T14:32:52.666367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601024743754953:5548]
2025-10-10T14:32:52.666370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601024743754953:5548]
2025-10-10T14:32:52.666374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601024743754953:5548]
2025-10-10T14:32:52.666387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:52.666379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 755
2025-10-10T14:32:52.666404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:52.666412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:52.666415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:52.666417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:52.666422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:52.666426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:52.666450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601024743754953:5548]
2025-10-10T14:32:52.666459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:52.666482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:52.667599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601025525966613:6888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:52.667610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601025525966613:6888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:52.667612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601025525966613:6888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:52.667618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:52.667774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966651:6888], now have 1 active actors on pipe
2025-10-10T14:32:52.667813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 755
2025-10-10T14:32:52.667852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.667862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.667886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:52.667897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.667900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.667902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:52.667910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.667920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:52.667934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.668074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.668081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.668094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.668181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 756 partition: 0 MaxSeqNo: 40 sessionId: src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0
2025-10-10T14:32:52.668518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9962dfbc-d12f4e5b-8aff3a4c-5478420d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:52.671123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0] Write session: try to update token
2025-10-10T14:32:52.671137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:52.677081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:52.677094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.677104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601024743754953:5548]
2025-10-10T14:32:52.677155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:52.677156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:52.677359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:52.677491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.677620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.677774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.677996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:52.678035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:52.683688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId: src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:52.686089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:52.686258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.686279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.686317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:52.686394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:52.693706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:52.693720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.693722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:52.693724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:52.693734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601024743754953:5548]
2025-10-10T14:32:52.693737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601024743754953:5548]
2025-10-10T14:32:52.693740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601024743754953:5548]
2025-10-10T14:32:52.693775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:52.693780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.693783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:52.693784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:52.693789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:52.693794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:52.693894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:52.753598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601025525966654:6574]
2025-10-10T14:32:52.753889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 755, pipe: [1:7559601025525966654:6574]
2025-10-10T14:32:52.793974Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:52.800324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.800347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.800494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.800549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.800608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.800663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.800702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.800710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.800768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.800819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.800874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.800931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.800969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.800975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.801044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.801110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.801182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.801251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.801295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.801301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.801388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.801441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.801495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.801551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.801591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.801597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.801652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.801704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.801761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.801815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.801854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.801860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.801916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.801967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.802020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.802075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.802115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.802121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.802185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.802236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.802290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.802373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.802418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.802424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.802478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.802528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.802586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.802640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.802678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.802683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.802740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.802793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.802847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.802899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.802947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.802952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.803006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.803069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.803124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.803179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.803217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.803222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.803258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966654:6574], now have 1 active actors on pipe
2025-10-10T14:32:52.803468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:52.803522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:52.803525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:52.803550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 756 reason: error at write: Disconnected sessionId: src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0
2025-10-10T14:32:52.803576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601025525966654:6574]
2025-10-10T14:32:52.803741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 756 sessionId: src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0 is DEAD
2025-10-10T14:32:52.803884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:52.803897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0] Write session will restart in 0.007304s
2025-10-10T14:32:52.803892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:52.803931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0] Write session: Do CDS request
2025-10-10T14:32:52.803937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:52.811898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:52.812846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.812920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:52.812949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 757
2025-10-10T14:32:52.813061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.813094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:52.813102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:52.813105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:52.813555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:52.813575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 757 sessionId:  describe result for acl check
2025-10-10T14:32:52.813619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:52.813626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:52.813628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:52.813634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601025525966704:6892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:52.813714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:52.813722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:52.813732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:52.813788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:52.813827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601024743755045:5550]
2025-10-10T14:32:52.814190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601025525966704:6892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:52.814242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:52.814555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:52.814620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:52.814965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:52.815016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.815021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.815022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.815023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.815025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.815025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.815026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.815027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.815028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.815029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.815030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.815031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.815031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.815038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.815058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.815061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.815065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.815068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.815073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.815076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.815079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.815083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.815086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.815090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.815093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.815096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.815104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.815111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.815119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.815127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.815132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.815142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.815146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.815150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.815154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.815158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.815161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.815166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.815169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.815174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.815177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.815181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.815185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.815195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.815198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.815202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.815210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.815214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.815218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.815222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.815226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.815230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.815267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:52.816929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601025525966704:6892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:52.817387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:52.817713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:52.817724Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:52.817726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:52.817730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:52.817735Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 756 [2:7559601024743755045:5550]
2025-10-10T14:32:52.817748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:52.817766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:52.817774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.817779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.817785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.817801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:52.817812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:52.817824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:52.817873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.817883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.817885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.817887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:52.817948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:52.818031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.818059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.818063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 756
2025-10-10T14:32:52.818075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.818098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:52.818128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966655:2438], now have 1 active actors on pipe
2025-10-10T14:32:52.818146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601024743755040:5550]
2025-10-10T14:32:52.818152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601024743755040:5550]
2025-10-10T14:32:52.818154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601024743755040:5550]
2025-10-10T14:32:52.818167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:52.818185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:52.818190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:52.818193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:52.818195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:52.818204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:52.818207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:52.818231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601024743755040:5550]
2025-10-10T14:32:52.818242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:52.818250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:52.823073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601025525966704:6892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:52.823087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601025525966704:6892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:52.823089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601025525966704:6892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:52.823096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:52.823289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966742:6892], now have 1 active actors on pipe
2025-10-10T14:32:52.823369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 756
2025-10-10T14:32:52.823425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.823436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.823460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:52.823473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.823477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.823478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:52.823499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.823516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:52.823533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.823695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.823701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.823711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.823784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 757 partition: 0 MaxSeqNo: 40 sessionId: src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0
2025-10-10T14:32:52.824177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|336c0d64-3c4da1d6-63490b6b-1262640b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:52.826745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0] Write session: try to update token
2025-10-10T14:32:52.826760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:52.829717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:52.829734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.829746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601024743755040:5550]
2025-10-10T14:32:52.829799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:52.829803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:52.830029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:52.830201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.830371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.830546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.830788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:52.830834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:52.840775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId: src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:52.843304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:52.843476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.843492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.843524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:52.843632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:52.849717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:52.849731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.849733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:52.849734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:52.849746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601024743755040:5550]
2025-10-10T14:32:52.849757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601024743755040:5550]
2025-10-10T14:32:52.849760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601024743755040:5550]
2025-10-10T14:32:52.849797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:52.849808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.849813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:52.849818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:52.849824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:52.849828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:52.849935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:52.903621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601025525966745:6574]
2025-10-10T14:32:52.903852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 756, pipe: [1:7559601025525966745:6574]
2025-10-10T14:32:52.952456Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:52.960435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.960457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.960636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.960704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.960770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.960840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.960885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.960897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.960970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.961032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.961104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.961173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.961219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.961227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.961296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.961382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.961444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.961513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.961558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.961567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.961633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.961695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.961760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.961830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.961874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.961881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.961996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.962058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.962128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.962190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.962241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.962249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.962316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.962379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.962444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.962510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.962553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.962560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.962628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.962691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.962761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.962827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.962876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.962886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.962956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.963020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.963091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.963161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.963206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.963212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.963280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.963343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.963408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.963469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.963516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.963524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.963590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:52.963648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:52.963710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:52.963771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:52.963817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:52.963824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:52.963886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966745:6574], now have 1 active actors on pipe
2025-10-10T14:32:52.964121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601025525966745:6574]
2025-10-10T14:32:52.964149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:52.964292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:52.964305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:52.964342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 757 reason: error at write: Disconnected sessionId: src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0
2025-10-10T14:32:52.964561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 757 sessionId: src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0 is DEAD
2025-10-10T14:32:52.964615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:52.964708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:52.964718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0] Write session will restart in 0.005328s
2025-10-10T14:32:52.964753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0] Write session: Do CDS request
2025-10-10T14:32:52.964759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:52.970817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.970977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:52.970993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 758
2025-10-10T14:32:52.971132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:52.971167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:52.971177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:52.971181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:52.971639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 758 sessionId:  describe result for acl check
2025-10-10T14:32:52.971678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:52.971684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:52.971686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:52.971692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601025525966786:6896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:52.972219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601025525966786:6896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:52.973429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:52.974326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601025525966786:6896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:52.975023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:52.975209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:52.975220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:52.975231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:52.975277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:52.975317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601024743755133:5552]
2025-10-10T14:32:52.975935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:52.976188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:52.976232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:52.976282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601025525966786:6896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:52.976295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601025525966786:6896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:52.976298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601025525966786:6896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:52.976305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:52.976542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:52.976591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.976596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.976597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.976598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.976600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.976601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.976602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.976603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.976604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.976605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.976608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.976609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.976610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.976615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.976627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.976631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.976635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.976639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.976643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.976647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.976653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.976656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.976665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.976669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.976677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.976681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.976692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.976701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:52.976707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.976717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:52.976721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.976726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:52.976732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.976737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:52.976746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.976751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:52.976755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.976760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:52.976765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.976770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:52.976774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.976780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:52.976788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.976793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:52.976801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.976806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:52.976815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.976820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.976829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.976838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.976847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.976854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.976897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:52.979024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:52.979357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:52.979367Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:52.979369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:52.979372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:52.979376Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 757 [2:7559601024743755133:5552]
2025-10-10T14:32:52.979384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:52.979396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:52.979398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.979400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.979402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.979414Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:52.979423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:52.979428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:52.979468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.979474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.979476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.979478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:52.979537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:52.979551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:52.979559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:52.979569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:52.979583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:52.979603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966749:2438], now have 1 active actors on pipe
2025-10-10T14:32:52.979609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601025525966828:6896], now have 1 active actors on pipe
2025-10-10T14:32:52.979615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601024743755128:5552]
2025-10-10T14:32:52.979617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601024743755128:5552]
2025-10-10T14:32:52.979618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601024743755128:5552]
2025-10-10T14:32:52.979627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:52.979641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:52.979654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:52.979656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:52.979660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:52.979660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:52.979662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:52.979680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601024743755128:5552]
2025-10-10T14:32:52.979687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:52.979702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:52.979677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 757
2025-10-10T14:32:52.979678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 757
2025-10-10T14:32:52.979723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.979732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.979760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a86b315d-924bcaf-bab991f2-24824962_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:52.979772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:52.979778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:52.979779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:52.979787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:52.979799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:52.979812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.979984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.979992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.980007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:52.980093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 758 partition: 0 MaxSeqNo: 40 sessionId: src_id|a86b315d-924bcaf-bab991f2-24824962_0
2025-10-10T14:32:52.980413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359133cf-a9b9512e-ebedbab2-dac54b1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a86b315d-924bcaf-bab991f2-24824962_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:52.982804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86b315d-924bcaf-bab991f2-24824962_0] Write session: try to update token
2025-10-10T14:32:52.982821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86b315d-924bcaf-bab991f2-24824962_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:52.996292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:52.996306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:52.996317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601024743755128:5552]
2025-10-10T14:32:52.996365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:52.996393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:52.996540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:52.996682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.996819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.996880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId: src_id|a86b315d-924bcaf-bab991f2-24824962_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:52.996949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:52.997136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:52.997174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:52.999356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:52.999557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:52.999572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:52.999601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:52.999696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:53.008432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:53.008447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:53.008450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:53.008452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:53.008463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601024743755128:5552]
2025-10-10T14:32:53.008466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601024743755128:5552]
2025-10-10T14:32:53.008469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601024743755128:5552]
2025-10-10T14:32:53.008514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:53.008514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:53.008520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:53.008525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.008527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:53.008540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:53.008652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:53.064395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601029820934133:6574]
2025-10-10T14:32:53.064679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 757, pipe: [1:7559601029820934133:6574]
2025-10-10T14:32:53.111066Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:53.117432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.117452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.117605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.117660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.117718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.117776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.117817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.117825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.117885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.117947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.118003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.118060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.118101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.118107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.118165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.118221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.118279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.118337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.118376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.118381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.118439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.118494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.118551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.118608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.118646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.118651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.118708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.118762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.118818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.118873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.118911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.118917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.118973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.119026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.119094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.119153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.119192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.119199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.119257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.119312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.119367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.119423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.119460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.119465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.119522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.119575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.119628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.119682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.119793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.119799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.119902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.120002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.120059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.120117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.120154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.120159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.120215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.120269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.120324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.120377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.120414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.120421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.120460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934133:6574], now have 1 active actors on pipe
2025-10-10T14:32:53.120762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:53.120794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601029820934133:6574]
2025-10-10T14:32:53.120823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:53.120833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:53.120862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 758 reason: error at write: Disconnected sessionId: src_id|a86b315d-924bcaf-bab991f2-24824962_0
2025-10-10T14:32:53.121101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 758 sessionId: src_id|a86b315d-924bcaf-bab991f2-24824962_0 is DEAD
2025-10-10T14:32:53.121230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86b315d-924bcaf-bab991f2-24824962_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:53.121239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86b315d-924bcaf-bab991f2-24824962_0] Write session will restart in 0.006551s
2025-10-10T14:32:53.121222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:53.121257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86b315d-924bcaf-bab991f2-24824962_0] Write session: Do CDS request
2025-10-10T14:32:53.121262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86b315d-924bcaf-bab991f2-24824962_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:53.128931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86b315d-924bcaf-bab991f2-24824962_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.128984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:53.128997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 759
2025-10-10T14:32:53.129197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.129231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:53.129242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:53.129245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:53.129387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:53.129676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 759 sessionId:  describe result for acl check
2025-10-10T14:32:53.129705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:53.129709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:53.129711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:53.129715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601029820934185:6900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:53.130142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601029820934185:6900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:53.130932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:53.131133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:53.131146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:53.131156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:53.131207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:53.131245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601029038722518:5554]
2025-10-10T14:32:53.131821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:53.132079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:53.132117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:53.132247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601029820934185:6900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:53.132413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:53.132462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.132467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.132469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.132470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.132471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.132472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.132473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.132474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.132476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.132477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.132478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.132479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.132480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.132485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.132497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.132501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.132506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.132509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.132513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.132522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.132527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.132535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.132539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.132547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.132551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.132554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.132562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.132570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.132576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.132581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.132590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.132595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.132603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.132608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.132616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.132621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.132629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.132634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.132643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.132648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.132652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.132661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.132666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.132674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.132683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.132688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.132696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.132705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.132713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.132722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.132731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.132740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.132782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:53.134792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601029820934185:6900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:53.134805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601029820934185:6900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:53.134808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601029820934185:6900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:53.134815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:53.134914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:53.135311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:53.135322Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:53.135324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:53.135327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:53.135332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 758 [2:7559601029038722518:5554]
2025-10-10T14:32:53.135345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:53.135362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:53.135373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.135376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.135379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.135394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:53.135402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:53.135409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:53.135458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.135466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.135468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.135470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:53.135532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:53.135541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.135551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.135561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.135580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:53.135607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934218:6900], now have 1 active actors on pipe
2025-10-10T14:32:53.135615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934135:2438], now have 1 active actors on pipe
2025-10-10T14:32:53.135621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601029038722513:5554]
2025-10-10T14:32:53.135624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601029038722513:5554]
2025-10-10T14:32:53.135626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601029038722513:5554]
2025-10-10T14:32:53.135640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:53.135637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 758
2025-10-10T14:32:53.135644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 758
2025-10-10T14:32:53.135658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:53.135659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:53.135662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:53.135664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:53.135678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:53.135681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:53.135715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.135724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.135738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601029038722513:5554]
2025-10-10T14:32:53.135749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:53.135762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:53.135780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:53.135792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.135795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.135797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:53.135806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.135821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:53.135844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.135980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.135987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.136000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.136075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 759 partition: 0 MaxSeqNo: 40 sessionId: src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0
2025-10-10T14:32:53.136394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86b315d-924bcaf-bab991f2-24824962_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:53.138998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0] Write session: try to update token
2025-10-10T14:32:53.139013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:53.153298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId: src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:53.154818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:53.154834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:53.154838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:53.154840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:53.154850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601029038722513:5554]
2025-10-10T14:32:53.154857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601029038722513:5554]
2025-10-10T14:32:53.154862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601029038722513:5554]
2025-10-10T14:32:53.154901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:53.154910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:53.154911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:53.154915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:53.154917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.154922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:53.155081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:53.155971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:53.221088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601029820934227:6574]
2025-10-10T14:32:53.221356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 758, pipe: [1:7559601029820934227:6574]
2025-10-10T14:32:53.260372Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:53.260604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.260616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.260655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934227:6574], now have 1 active actors on pipe
2025-10-10T14:32:53.260801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:53.260910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601029820934227:6574]
2025-10-10T14:32:53.260914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:53.260941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:53.261121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 759 reason: status is not ok: tablet will be restarted right now sessionId: src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0
2025-10-10T14:32:53.261367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 759 sessionId: src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0 is DEAD
2025-10-10T14:32:53.261496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:53.261520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0] Write session will restart in 0.008291s
2025-10-10T14:32:53.261545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0] Write session: Do CDS request
2025-10-10T14:32:53.261552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:53.269863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:53.270912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.270987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:53.271011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 760
2025-10-10T14:32:53.271140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.271176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:53.271187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:53.271195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:53.271319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:53.271496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:53.271507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:53.271519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:53.271544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 760 sessionId:  describe result for acl check
2025-10-10T14:32:53.271571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:53.271577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:53.271571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:53.271578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:53.271582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601029820934291:6905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:53.271612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601029038722620:5557]
2025-10-10T14:32:53.271990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601029820934291:6905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:53.272206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:53.272461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:53.272498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:53.272803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:53.272860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.272866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.272868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.272869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.272870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.272871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.272872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.272874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.272875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.272876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.272878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.272879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.272880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.272885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.272896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.272900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.272904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.272907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.272911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.272916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.272920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.272924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.272930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.272934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.272938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.272941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.272948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.272956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.272967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.272972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.272981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.272986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.272990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.273000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.273004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.273009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.273018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.273023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.273027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.273036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.273040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.273045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.273055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.273060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.273068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.273073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.273078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.273083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.273091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.273096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.273100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.273109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.273145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:53.274185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601029820934291:6905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:53.275317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:53.275647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:53.275659Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:53.275662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:53.275665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:53.275671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 759 [2:7559601029038722620:5557]
2025-10-10T14:32:53.275683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:53.275701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:53.275709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.275712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.275715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.275730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:53.275737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:53.275750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:53.275802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.275809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.275811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.275814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:53.275875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:53.275895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.275906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.275919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.275940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:53.275966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934240:2438], now have 1 active actors on pipe
2025-10-10T14:32:53.275979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601029038722615:5557]
2025-10-10T14:32:53.275950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 759
2025-10-10T14:32:53.275986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601029038722615:5557]
2025-10-10T14:32:53.275990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601029038722615:5557]
2025-10-10T14:32:53.275998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:53.276008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:53.276011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:53.276012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:53.276013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:53.276028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:53.276037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:53.276066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601029038722615:5557]
2025-10-10T14:32:53.276078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:53.276084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:53.276391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601029820934291:6905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:53.276405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601029820934291:6905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:53.276408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601029820934291:6905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:53.276415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:53.276608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934327:6905], now have 1 active actors on pipe
2025-10-10T14:32:53.276660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 759
2025-10-10T14:32:53.276705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.276716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.276745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:53.276757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.276762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.276764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:53.276775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.276791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:53.276811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.277019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.277028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.277043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.277120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 760 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0
2025-10-10T14:32:53.277480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|becc3dc8-633cb8a9-11ada168-6649dc66_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:53.280357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0] Write session: try to update token
2025-10-10T14:32:53.280377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:53.294587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId: src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:53.294709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:53.294725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:53.294728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:53.294730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:53.294740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601029038722615:5557]
2025-10-10T14:32:53.294744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601029038722615:5557]
2025-10-10T14:32:53.294751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601029038722615:5557]
2025-10-10T14:32:53.294788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:53.294797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:53.294800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:53.294804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.294809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:53.294812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:53.294956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:53.297159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:53.360832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601029820934333:6574]
2025-10-10T14:32:53.361057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 759, pipe: [1:7559601029820934333:6574]
2025-10-10T14:32:53.402272Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:53.402480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.402492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.402529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934333:6574], now have 1 active actors on pipe
2025-10-10T14:32:53.402670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:53.402664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:53.402683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601029820934333:6574]
2025-10-10T14:32:53.402704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:53.402707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:53.402774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 760 reason: error at write: Disconnected sessionId: src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0
2025-10-10T14:32:53.402967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 760 sessionId: src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0 is DEAD
2025-10-10T14:32:53.403136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:53.403147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0] Write session will restart in 0.005900s
2025-10-10T14:32:53.403165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0] Write session: Do CDS request
2025-10-10T14:32:53.403170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:53.409760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.409885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:53.409899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 761
2025-10-10T14:32:53.410019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.410052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:53.410062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:53.410066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:53.410418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 761 sessionId:  describe result for acl check
2025-10-10T14:32:53.410450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:53.410456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:53.410457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:53.410462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601029820934383:6909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:53.410871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601029820934383:6909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:53.410986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:53.412408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:53.412573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:53.412585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:53.412596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:53.412644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:53.412688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601029038722711:5559]
2025-10-10T14:32:53.412863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601029820934383:6909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:53.413188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:53.413434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:53.413477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:53.413720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:53.413759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.413764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.413764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.413765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.413766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.413767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.413767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.413768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.413769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.413770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.413771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.413771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.413772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.413776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.413784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.413786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.413788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.413790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.413793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.413795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.413797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.413799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.413801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.413804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.413807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.413809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.413814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.413820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.413824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.413827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.413833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.413836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.413839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.413843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.413848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.413853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.413856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.413867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.413875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.413881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.413890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.413896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.413902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.413905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.413908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.413914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.413917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.413920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.413923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.413926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.413929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.413932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.413952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:53.415816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601029820934383:6909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:53.415827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601029820934383:6909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:53.415830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601029820934383:6909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:53.415836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:53.415931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:53.416230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:53.416244Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:53.416246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:53.416250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:53.416255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 760 [2:7559601029038722711:5559]
2025-10-10T14:32:53.416263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:53.416278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:53.416283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.416285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.416287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.416299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:53.416308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:53.416314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:53.416361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.416370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.416372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.416374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:53.416432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:53.416440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.416452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.416469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.416491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:53.416521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934420:6909], now have 1 active actors on pipe
2025-10-10T14:32:53.416528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934334:2438], now have 1 active actors on pipe
2025-10-10T14:32:53.416535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601029038722706:5559]
2025-10-10T14:32:53.416537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601029038722706:5559]
2025-10-10T14:32:53.416512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 760
2025-10-10T14:32:53.416538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601029038722706:5559]
2025-10-10T14:32:53.416515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 760
2025-10-10T14:32:53.416545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:53.416555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:53.416559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:53.416562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:53.416563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:53.416566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:53.416570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:53.416586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.416593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.416616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601029038722706:5559]
2025-10-10T14:32:53.416624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:53.416635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:53.416639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|701cdf6-f03004f1-2270111e-b0ed4815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:53.416645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.416648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.416649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:53.416656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.416665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:53.416701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.416825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.416832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.416843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.417385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 761 partition: 0 MaxSeqNo: 40 sessionId: src_id|701cdf6-f03004f1-2270111e-b0ed4815_0
2025-10-10T14:32:53.417689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e5c661-c620cc22-867bac00-e30edd9e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|701cdf6-f03004f1-2270111e-b0ed4815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:53.420121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701cdf6-f03004f1-2270111e-b0ed4815_0] Write session: try to update token
2025-10-10T14:32:53.420137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701cdf6-f03004f1-2270111e-b0ed4815_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:53.432588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId: src_id|701cdf6-f03004f1-2270111e-b0ed4815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:53.435306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:53.435329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:53.435333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:53.435335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:53.435346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601029038722706:5559]
2025-10-10T14:32:53.435351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601029038722706:5559]
2025-10-10T14:32:53.435356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601029038722706:5559]
2025-10-10T14:32:53.435404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:53.435415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:53.435418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:53.435419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:53.435428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.435430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:53.435619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:53.436094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:53.502674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601029820934452:6574]
2025-10-10T14:32:53.502921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 760, pipe: [1:7559601029820934452:6574]
2025-10-10T14:32:53.539962Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:53.540255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.540268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.540307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934452:6574], now have 1 active actors on pipe
2025-10-10T14:32:53.540459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:53.540537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:53.540538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601029820934452:6574]
2025-10-10T14:32:53.540557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:53.540645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 761 reason: status is not ok: tablet will be restarted right now sessionId: src_id|701cdf6-f03004f1-2270111e-b0ed4815_0
2025-10-10T14:32:53.540850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 761 sessionId: src_id|701cdf6-f03004f1-2270111e-b0ed4815_0 is DEAD
2025-10-10T14:32:53.541013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701cdf6-f03004f1-2270111e-b0ed4815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:53.541023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701cdf6-f03004f1-2270111e-b0ed4815_0] Write session will restart in 0.006264s
2025-10-10T14:32:53.541041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701cdf6-f03004f1-2270111e-b0ed4815_0] Write session: Do CDS request
2025-10-10T14:32:53.541046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701cdf6-f03004f1-2270111e-b0ed4815_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:53.548890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701cdf6-f03004f1-2270111e-b0ed4815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.548982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:53.548995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 762
2025-10-10T14:32:53.549142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.549175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:53.549185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:53.549189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:53.549295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:53.549711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 762 sessionId:  describe result for acl check
2025-10-10T14:32:53.549747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:53.549754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:53.549757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:53.549763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601029820934506:6922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:53.550333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601029820934506:6922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:53.550924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:53.551155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:53.551166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:53.551179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:53.551241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:53.551294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601029038722840:5574]
2025-10-10T14:32:53.551915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:53.552167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:53.552209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:53.552433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:53.552473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.552478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.552479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.552480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.552480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.552481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.552482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.552482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.552483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.552484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.552484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.552485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.552486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.552490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.552498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.552500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.552503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.552505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.552507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.552510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.552512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.552514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.552518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.552521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.552523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.552525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.552530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.552536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.552541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.552545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.552547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.552550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.552553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.552556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.552559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.552561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.552564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.552567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.552570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.552576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.552579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.552562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601029820934506:6922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:53.552589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.552599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.552604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.552609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.552614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.552616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.552624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.552627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.552630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.552636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.552639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.552663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:53.554975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601029820934506:6922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:53.554989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601029820934506:6922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:53.554993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601029820934506:6922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:53.555001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:53.555026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:53.555357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:53.555373Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:53.555376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:53.555380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:53.555386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 761 [2:7559601029038722840:5574]
2025-10-10T14:32:53.555402Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:53.555423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:53.555432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.555436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.555438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.555458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:53.555471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:53.555484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:53.555545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.555552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.555554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.555557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:53.555618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:53.555626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.555637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.555650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.555665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:53.555692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934453:2438], now have 1 active actors on pipe
2025-10-10T14:32:53.555701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934540:6922], now have 1 active actors on pipe
2025-10-10T14:32:53.555708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601029038722835:5574]
2025-10-10T14:32:53.555710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601029038722835:5574]
2025-10-10T14:32:53.555715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601029038722835:5574]
2025-10-10T14:32:53.555729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:53.555728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 761
2025-10-10T14:32:53.555747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:53.555749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:53.555736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 761
2025-10-10T14:32:53.555756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:53.555758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:53.555765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:53.555769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:53.555807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.555814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.555826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601029038722835:5574]
2025-10-10T14:32:53.555835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:53.555842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:53.555862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:53.555871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.555875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.555877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:53.555887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.555899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:53.555914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.556047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.556053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.556064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.556138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 762 partition: 0 MaxSeqNo: 40 sessionId: src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0
2025-10-10T14:32:53.556506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701cdf6-f03004f1-2270111e-b0ed4815_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:53.559155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0] Write session: try to update token
2025-10-10T14:32:53.559172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:53.572687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId: src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:53.574357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:53.574378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:53.574381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:53.574383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:53.574396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601029038722835:5574]
2025-10-10T14:32:53.574404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601029038722835:5574]
2025-10-10T14:32:53.574407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601029038722835:5574]
2025-10-10T14:32:53.574445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:53.574451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:53.574457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:53.574461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:53.574468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.574471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:53.574624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:53.575404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:53.640902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601029820934560:6574]
2025-10-10T14:32:53.641181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 761, pipe: [1:7559601029820934560:6574]
2025-10-10T14:32:53.680262Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:53.680660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.680675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.680715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934560:6574], now have 1 active actors on pipe
2025-10-10T14:32:53.680918Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:53.680993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:53.681001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601029820934560:6574]
2025-10-10T14:32:53.681025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:53.681097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 762 reason: status is not ok: tablet will be restarted right now sessionId: src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0
2025-10-10T14:32:53.681301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 762 sessionId: src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0 is DEAD
2025-10-10T14:32:53.681475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:53.681482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0] Write session will restart in 0.005242s
2025-10-10T14:32:53.681508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0] Write session: Do CDS request
2025-10-10T14:32:53.681513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:53.687841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.687907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:53.687924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 763
2025-10-10T14:32:53.688068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.688111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:53.688122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:53.688130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:53.688561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 763 sessionId:  describe result for acl check
2025-10-10T14:32:53.688596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:53.688600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:53.688602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:53.688606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601029820934600:6928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:53.689071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601029820934600:6928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:53.690182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:53.690959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601029820934600:6928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:53.691729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:53.691912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:53.691922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:53.691931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:53.691974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:53.692008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601029038722935:5577]
2025-10-10T14:32:53.692427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:53.692704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:53.692755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:53.693035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601029820934600:6928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:53.693047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601029820934600:6928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:53.693050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601029820934600:6928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:53.693055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:53.693063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:53.693129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.693136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.693137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.693137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.693139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.693140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.693141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.693142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.693143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.693144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.693145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.693146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.693147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.693152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.693164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.693167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.693170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.693174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.693177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.693181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.693184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.693188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.693192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.693195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.693198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.693202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.693211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.693220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.693230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.693240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.693249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.693258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.693266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.693271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.693280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.693289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.693297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.693302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.693311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.693316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.693324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.693347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.693351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.693356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.693363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.693368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.693372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.693378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.693386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.693391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.693399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.693405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.693446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:53.695510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:53.695868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:53.695881Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:53.695883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:53.695887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:53.695893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 762 [2:7559601029038722935:5577]
2025-10-10T14:32:53.695908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:53.695928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:53.695931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.695934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.695936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.695952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:53.695966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:53.695974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:53.696031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.696037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.696039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.696042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:53.696107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:53.696114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.696125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.696137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.696159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:53.696184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934561:2438], now have 1 active actors on pipe
2025-10-10T14:32:53.696191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934647:6928], now have 1 active actors on pipe
2025-10-10T14:32:53.696198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601029038722929:5577]
2025-10-10T14:32:53.696200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601029038722929:5577]
2025-10-10T14:32:53.696202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601029038722929:5577]
2025-10-10T14:32:53.696197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 762
2025-10-10T14:32:53.696199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 762
2025-10-10T14:32:53.696214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:53.696224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:53.696227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:53.696228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:53.696233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:53.696249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:53.696257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:53.696272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.696281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.696314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601029038722929:5577]
2025-10-10T14:32:53.696325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:53.696340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:53.696348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b470892d-6cc08442-cbd8165b-2acc285a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:53.696357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.696364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.696366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:53.696376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.696391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:53.696429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.696556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.696565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.696583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.696667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 763 partition: 0 MaxSeqNo: 40 sessionId: src_id|b470892d-6cc08442-cbd8165b-2acc285a_0
2025-10-10T14:32:53.697002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746151fd-3bb71ad7-49eba04f-4d47539f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b470892d-6cc08442-cbd8165b-2acc285a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:53.699478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b470892d-6cc08442-cbd8165b-2acc285a_0] Write session: try to update token
2025-10-10T14:32:53.699494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b470892d-6cc08442-cbd8165b-2acc285a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:53.712562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId: src_id|b470892d-6cc08442-cbd8165b-2acc285a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:53.715167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:53.715641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.715663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.715686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:53.715689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:53.715693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:53.715695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:53.715705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601029038722929:5577]
2025-10-10T14:32:53.715709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601029038722929:5577]
2025-10-10T14:32:53.715713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601029038722929:5577]
2025-10-10T14:32:53.715752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:53.715764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:53.715767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:53.715776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:53.715783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.715786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:53.715917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:53.781185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601029820934656:6574]
2025-10-10T14:32:53.781447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 762, pipe: [1:7559601029820934656:6574]
2025-10-10T14:32:53.819749Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:53.819971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:53.820028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934656:6574], now have 1 active actors on pipe
2025-10-10T14:32:53.820108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:53.820215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:53.820268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601029820934656:6574]
2025-10-10T14:32:53.829594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:53.829609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:53.829632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 763 reason: error at write: Disconnected sessionId: src_id|b470892d-6cc08442-cbd8165b-2acc285a_0
2025-10-10T14:32:53.829794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 763 sessionId: src_id|b470892d-6cc08442-cbd8165b-2acc285a_0 is DEAD
2025-10-10T14:32:53.829968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b470892d-6cc08442-cbd8165b-2acc285a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:53.829981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b470892d-6cc08442-cbd8165b-2acc285a_0] Write session will restart in 0.006304s
2025-10-10T14:32:53.830007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b470892d-6cc08442-cbd8165b-2acc285a_0] Write session: Do CDS request
2025-10-10T14:32:53.830013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b470892d-6cc08442-cbd8165b-2acc285a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:53.834968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:53.837036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:53.837256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:53.837268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:53.837281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:53.837356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:53.837402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601029038723029:5579]
2025-10-10T14:32:53.837912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b470892d-6cc08442-cbd8165b-2acc285a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.837972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:53.837987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 764
2025-10-10T14:32:53.838013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:53.838155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:53.838180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:53.838190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:53.838194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:53.838319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:53.838369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:53.838707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:53.838724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 764 sessionId:  describe result for acl check
2025-10-10T14:32:53.838761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:53.838767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:53.838769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:53.838776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601029820934716:6932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:53.838772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.838781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.838782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.838784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.838785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.838786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.838788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.838789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.838790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.838791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.838793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.838794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.838795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.838802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.838814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.838818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.838822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.838825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.838829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.838832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.838835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.838839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.838842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.838847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.838850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.838854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.838864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.838873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:53.838879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.838884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:53.838889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.838894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:53.838898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.838904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:53.838909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.838914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:53.838921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.838932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:53.838936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.838942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:53.838950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.838955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:53.838960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.838965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:53.838973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.838978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:53.838982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.838990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.838995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.839004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.839009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.839019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.839080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:53.839312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601029820934716:6932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:53.841626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:53.841789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601029820934716:6932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:53.841961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:53.841975Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:53.841978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:53.841982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:53.841988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 763 [2:7559601029038723029:5579]
2025-10-10T14:32:53.842001Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:53.842022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:53.842030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.842034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.842037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.842064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:53.842078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:53.842094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:53.842154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.842162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.842164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.842167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:53.842234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:53.842242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.842253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:53.842265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:53.842279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:53.842305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601029038723024:5579]
2025-10-10T14:32:53.842313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601029038723024:5579]
2025-10-10T14:32:53.842314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601029038723024:5579]
2025-10-10T14:32:53.842327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:53.842347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934658:2438], now have 1 active actors on pipe
2025-10-10T14:32:53.842355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:53.842360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:53.842360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:53.842362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:53.842376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:53.842362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 763
2025-10-10T14:32:53.842384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:53.842418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601029038723024:5579]
2025-10-10T14:32:53.842431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:53.842445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:53.847613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601029820934716:6932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:53.847629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601029820934716:6932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:53.847634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601029820934716:6932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:53.847642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:53.847909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934751:6932], now have 1 active actors on pipe
2025-10-10T14:32:53.847950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 763
2025-10-10T14:32:53.848014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.848027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.848063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40d2e030-70491740-cfe7a4df-416bfecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:53.848083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:53.848090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:53.848093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:53.848107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:53.848130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:53.848158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.848326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.848345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.848364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:53.848443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 764 partition: 0 MaxSeqNo: 40 sessionId: src_id|40d2e030-70491740-cfe7a4df-416bfecb_0
2025-10-10T14:32:53.848841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b470892d-6cc08442-cbd8165b-2acc285a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|40d2e030-70491740-cfe7a4df-416bfecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:53.851433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d2e030-70491740-cfe7a4df-416bfecb_0] Write session: try to update token
2025-10-10T14:32:53.851451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d2e030-70491740-cfe7a4df-416bfecb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:53.860057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:53.860074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:53.860084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601029038723024:5579]
2025-10-10T14:32:53.860131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:53.860135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:53.860306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:53.860446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:53.860578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:53.860716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:53.860908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:53.860952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:53.865528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId: src_id|40d2e030-70491740-cfe7a4df-416bfecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:53.868080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:53.868445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.868467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.868509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:53.868619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:53.872232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:53.872247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:53.872254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:53.872256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:53.872265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601029038723024:5579]
2025-10-10T14:32:53.872269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601029038723024:5579]
2025-10-10T14:32:53.872272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601029038723024:5579]
2025-10-10T14:32:53.872316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:53.872317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:53.872323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:53.872327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:53.872329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:53.872331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:53.872465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:53.920466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601029820934754:6574]
2025-10-10T14:32:53.920712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 763, pipe: [1:7559601029820934754:6574]
2025-10-10T14:32:53.982791Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:53.989684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:53.989707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:53.989865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.989929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.989995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.990058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.990099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.990108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.990175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.990230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.990290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.990351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.990391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.990396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.990461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.990530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.990592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.990649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.990688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.990694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.990754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.990812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.990873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.990931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.990972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.990978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.991038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.991110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.991171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.991235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.991275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.991280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.991349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.991420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.991488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.991549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.991616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.991624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.991688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.991742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.991800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.991856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.991896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.991901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.991964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.992019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.992077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.992134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.992176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.992181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.992239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.992311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.992372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.992432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.992496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.992502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.992562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:53.992617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:53.992675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:53.992731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:53.992839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:53.992846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:53.992885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934754:6574], now have 1 active actors on pipe
2025-10-10T14:32:53.993086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:53.993105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:53.993108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:53.993135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 764 reason: error at write: Disconnected sessionId: src_id|40d2e030-70491740-cfe7a4df-416bfecb_0
2025-10-10T14:32:53.993154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601029820934754:6574]
2025-10-10T14:32:53.993343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 764 sessionId: src_id|40d2e030-70491740-cfe7a4df-416bfecb_0 is DEAD
2025-10-10T14:32:53.993490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d2e030-70491740-cfe7a4df-416bfecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:53.993499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d2e030-70491740-cfe7a4df-416bfecb_0] Write session will restart in 0.009416s
2025-10-10T14:32:53.993518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d2e030-70491740-cfe7a4df-416bfecb_0] Write session: Do CDS request
2025-10-10T14:32:53.993523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d2e030-70491740-cfe7a4df-416bfecb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:53.993784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:54.003046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:54.003853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d2e030-70491740-cfe7a4df-416bfecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.003912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:54.003933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 765
2025-10-10T14:32:54.004066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.004095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:54.004103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:54.004108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:54.004469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 765 sessionId:  describe result for acl check
2025-10-10T14:32:54.004502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:54.004507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:54.004508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:54.004513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601034115902108:6936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:54.004856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:54.004961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601034115902108:6936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:54.005079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:54.005099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:54.005118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:54.005204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:54.005259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601033333690420:5581]
2025-10-10T14:32:54.005804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:54.006062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:54.006107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:54.006366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:54.006404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.006409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.006409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.006410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.006411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.006412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.006412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.006413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.006414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.006414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.006415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.006416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.006418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.006422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.006429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.006432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.006434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.006436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.006438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.006440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.006442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.006445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.006447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.006449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.006451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.006453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.006458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.006464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.006468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.006471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.006474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.006477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.006480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.006483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.006485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.006488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.006492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.006495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.006498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.006500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.006503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.006506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.006509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.006514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.006519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.006524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.006528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.006534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.006538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.006541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.006544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.006548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.006584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:54.006790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601034115902108:6936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:54.008697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:54.008984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601034115902108:6936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:54.008996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601034115902108:6936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:54.008998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601034115902108:6936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:54.009004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:54.009035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:54.009047Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:54.009050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:54.009053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:54.009058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 764 [2:7559601033333690420:5581]
2025-10-10T14:32:54.009072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:54.009089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:54.009094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.009098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.009101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.009114Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:54.009123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:54.009129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:54.009170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.009175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.009176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.009178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:54.009228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:54.009233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.009240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.009246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.009259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:54.009279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902142:6936], now have 1 active actors on pipe
2025-10-10T14:32:54.009285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601029820934756:2438], now have 1 active actors on pipe
2025-10-10T14:32:54.009291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601033333690414:5581]
2025-10-10T14:32:54.009296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601033333690414:5581]
2025-10-10T14:32:54.009298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601033333690414:5581]
2025-10-10T14:32:54.009308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:54.009318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:54.009327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:54.009318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 764
2025-10-10T14:32:54.009345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:54.009326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 764
2025-10-10T14:32:54.009347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:54.009352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:54.009356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:54.009375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601033333690414:5581]
2025-10-10T14:32:54.009377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:54.009380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:54.009393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.009396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.009433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:54.009443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.009446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.009451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:54.009460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.009472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:54.009488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.009600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.009608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.009620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.009696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 765 partition: 0 MaxSeqNo: 40 sessionId: src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0
2025-10-10T14:32:54.010008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d2e030-70491740-cfe7a4df-416bfecb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:54.012489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0] Write session: try to update token
2025-10-10T14:32:54.012504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:54.025777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId: src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:54.027771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:54.027790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.027793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:54.027795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:54.027806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601033333690414:5581]
2025-10-10T14:32:54.027813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601033333690414:5581]
2025-10-10T14:32:54.027817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601033333690414:5581]
2025-10-10T14:32:54.027867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:54.027880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.027883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:54.027898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:54.027916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:54.027921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:54.028032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:54.028311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:54.093512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601034115902149:6574]
2025-10-10T14:32:54.093793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 764, pipe: [1:7559601034115902149:6574]
2025-10-10T14:32:54.133526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:54.133847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.133863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.133904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902149:6574], now have 1 active actors on pipe
2025-10-10T14:32:54.134063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:54.134116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601034115902149:6574]
2025-10-10T14:32:54.134118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:54.134122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:54.134150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:54.134182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 765 reason: error at write: Disconnected sessionId: src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0
2025-10-10T14:32:54.134381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 765 sessionId: src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0 is DEAD
2025-10-10T14:32:54.134515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:54.134532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0] Write session will restart in 0.006253s
2025-10-10T14:32:54.134552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0] Write session: Do CDS request
2025-10-10T14:32:54.134556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:54.141763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.141830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:54.141842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 766
2025-10-10T14:32:54.141937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.141967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:54.141975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:54.141978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:54.142411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 766 sessionId:  describe result for acl check
2025-10-10T14:32:54.142452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:54.142459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:54.142461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:54.142467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601034115902207:6940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:54.142671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:54.143080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601034115902207:6940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:54.144169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:54.144350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:54.144362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:54.144374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:54.144424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:54.144469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601033333690515:5583]
2025-10-10T14:32:54.144915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601034115902207:6940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:54.145050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:54.145368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:54.145409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:54.145741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:54.145794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.145801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.145802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.145803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.145804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.145806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.145807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.145808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.145809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.145811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.145812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.145813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.145814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.145820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.145832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.145836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.145840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.145844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.145849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.145853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.145857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.145861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.145865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.145869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.145873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.145877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.145885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.145893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.145900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.145906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.145917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.145922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.145927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.145936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.145942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.145948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.145952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.145961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.145967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.145972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.145980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.145985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.145989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.145998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.146002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.146008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.146017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.146022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.146026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.146036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.146040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.146045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.146091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:54.148088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601034115902207:6940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:54.148104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601034115902207:6940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:54.148111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601034115902207:6940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:54.148121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:54.148228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:54.148521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:54.148533Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:54.148534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:54.148537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:54.148542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 765 [2:7559601033333690515:5583]
2025-10-10T14:32:54.148550Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:54.148563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:54.148565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.148567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.148568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.148581Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:54.148591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:54.148597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:54.148638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.148644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.148645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.148646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:54.148698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:54.148704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.148711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.148717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.148727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:54.148748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902242:6940], now have 1 active actors on pipe
2025-10-10T14:32:54.148753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902150:2438], now have 1 active actors on pipe
2025-10-10T14:32:54.148759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601033333690510:5583]
2025-10-10T14:32:54.148762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601033333690510:5583]
2025-10-10T14:32:54.148763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601033333690510:5583]
2025-10-10T14:32:54.148774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:54.148787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:54.148794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:54.148797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:54.148799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:54.148800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:54.148802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:54.148796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 765
2025-10-10T14:32:54.148797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 765
2025-10-10T14:32:54.148819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601033333690510:5583]
2025-10-10T14:32:54.148825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:54.148828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:54.148844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.148851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.148880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ae6fb96-23f7c424-6777592c-7596788d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:54.148889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.148892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.148893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:54.148901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.148913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:54.148932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.149049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.149057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.149071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.149135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 766 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ae6fb96-23f7c424-6777592c-7596788d_0
2025-10-10T14:32:54.149460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23e4d53-fcbed64c-5a4896db-29f47648_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ae6fb96-23f7c424-6777592c-7596788d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:54.152260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae6fb96-23f7c424-6777592c-7596788d_0] Write session: try to update token
2025-10-10T14:32:54.152278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae6fb96-23f7c424-6777592c-7596788d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:54.166677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId: src_id|5ae6fb96-23f7c424-6777592c-7596788d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:54.167148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:54.167164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.167167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:54.167168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:54.167176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601033333690510:5583]
2025-10-10T14:32:54.167182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601033333690510:5583]
2025-10-10T14:32:54.167185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601033333690510:5583]
2025-10-10T14:32:54.167225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:54.167232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.167234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:54.167238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:54.167241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:54.167245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:54.167380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:54.169235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:54.234312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601034115902249:6574]
2025-10-10T14:32:54.234563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 765, pipe: [1:7559601034115902249:6574]
2025-10-10T14:32:54.273370Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:54.273734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.273747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.273788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902249:6574], now have 1 active actors on pipe
2025-10-10T14:32:54.273980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:54.273995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601034115902249:6574]
2025-10-10T14:32:54.274010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:54.274013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:54.274023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:54.274071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 766 reason: error at write: Disconnected sessionId: src_id|5ae6fb96-23f7c424-6777592c-7596788d_0
2025-10-10T14:32:54.274268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 766 sessionId: src_id|5ae6fb96-23f7c424-6777592c-7596788d_0 is DEAD
2025-10-10T14:32:54.274456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae6fb96-23f7c424-6777592c-7596788d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:54.274466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae6fb96-23f7c424-6777592c-7596788d_0] Write session will restart in 0.008074s
2025-10-10T14:32:54.274493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae6fb96-23f7c424-6777592c-7596788d_0] Write session: Do CDS request
2025-10-10T14:32:54.274503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae6fb96-23f7c424-6777592c-7596788d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:54.282722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:54.283915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae6fb96-23f7c424-6777592c-7596788d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.284021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:54.284040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 767
2025-10-10T14:32:54.284143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.284173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:54.284181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:54.284184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:54.284289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:54.284472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:54.284482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:54.284493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:54.284549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:54.284550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 767 sessionId:  describe result for acl check
2025-10-10T14:32:54.284577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:54.284579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:54.284580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:54.284595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601033333690624:5586]
2025-10-10T14:32:54.284585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601034115902320:6945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:54.285002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601034115902320:6945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:54.285186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:54.285505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:54.285546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:54.285857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:54.285925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.285932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.285933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.285934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.285936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.285937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.285938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.285939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.285940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.285941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.285942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.285944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.285945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.285951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.285963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.285967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.285971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.285975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.285979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.285983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.285987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.285991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.285996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.285999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.286003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.286007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.286014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.286022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.286029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.286034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.286039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.286044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.286048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.286054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.286063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.286068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.286072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.286081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.286086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.286091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.286095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.286100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.286104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.286109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.286114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.286119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.286123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.286133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.286137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.286142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.286151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.286156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.286195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:54.286727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601034115902320:6945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:54.288397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:54.288715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:54.288727Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:54.288729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:54.288733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:54.288739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 766 [2:7559601033333690624:5586]
2025-10-10T14:32:54.288750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:54.288774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:54.288781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.288784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.288786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.288801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:54.288813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:54.288825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:54.288878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.288885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.288886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.288889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:54.288953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:54.288960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.288971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.288983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.289003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:54.289027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902262:2438], now have 1 active actors on pipe
2025-10-10T14:32:54.289039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601033333690619:5586]
2025-10-10T14:32:54.289045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601033333690619:5586]
2025-10-10T14:32:54.289047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601033333690619:5586]
2025-10-10T14:32:54.289031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 766
2025-10-10T14:32:54.289057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:54.289069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:54.289072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:54.289074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:54.289075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:54.289086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601034115902320:6945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:54.289091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:54.289099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:54.289107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601034115902320:6945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:54.289118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601034115902320:6945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:54.289126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:54.289134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601033333690619:5586]
2025-10-10T14:32:54.289149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:54.289159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:54.289295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902354:6945], now have 1 active actors on pipe
2025-10-10T14:32:54.289310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 766
2025-10-10T14:32:54.289378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.289387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.289416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84782405-c70418e0-c964168d-ca02f9b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:54.289428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.289432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.289434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:54.289446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.289461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:54.289479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.289659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.289668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.289684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.289747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 767 partition: 0 MaxSeqNo: 40 sessionId: src_id|84782405-c70418e0-c964168d-ca02f9b7_0
2025-10-10T14:32:54.290099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae6fb96-23f7c424-6777592c-7596788d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84782405-c70418e0-c964168d-ca02f9b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:54.292699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84782405-c70418e0-c964168d-ca02f9b7_0] Write session: try to update token
2025-10-10T14:32:54.292714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84782405-c70418e0-c964168d-ca02f9b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:54.299991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:54.300011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.300024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601033333690619:5586]
2025-10-10T14:32:54.300064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:54.300076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:54.300251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:54.300401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:54.300540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:54.300681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:54.300953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:54.301023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:54.306276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId: src_id|84782405-c70418e0-c964168d-ca02f9b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:54.308684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:54.308894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.308915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.308967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:54.309044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:54.316197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:54.316211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.316214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:54.316222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:54.316230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601033333690619:5586]
2025-10-10T14:32:54.316233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601033333690619:5586]
2025-10-10T14:32:54.316237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601033333690619:5586]
2025-10-10T14:32:54.316274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:54.316279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:54.316283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.316284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:54.316285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:54.316288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:54.316412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:54.374088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601034115902362:6574]
2025-10-10T14:32:54.374330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 766, pipe: [1:7559601034115902362:6574]
2025-10-10T14:32:54.418152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:54.424806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.424831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.424988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.425042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.425102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.425158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.425198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.425208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.425268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.425323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.425393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.425457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.425498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.425504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.425565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.425619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.425676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.425734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.425842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.425852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.425912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.425973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.426034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.426092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.426131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.426133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.426192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.426245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.426302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.426364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.426404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.426409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.426470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.426534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.426595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.426654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.426694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.426700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.426760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.426813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.426873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.426943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.426993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.426999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.427068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.427124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.427185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.427242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.427282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.427287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.427350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.427402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.427458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.427512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.427552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.427557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.427612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:54.427675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:54.427734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:54.427788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:54.427826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:54.427832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:54.427874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902362:6574], now have 1 active actors on pipe
2025-10-10T14:32:54.428156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:54.428168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601034115902362:6574]
2025-10-10T14:32:54.428169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:54.428193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:54.428196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 767 reason: error at write: Disconnected sessionId: src_id|84782405-c70418e0-c964168d-ca02f9b7_0
2025-10-10T14:32:54.428424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 767 sessionId: src_id|84782405-c70418e0-c964168d-ca02f9b7_0 is DEAD
2025-10-10T14:32:54.428533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84782405-c70418e0-c964168d-ca02f9b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:54.428543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84782405-c70418e0-c964168d-ca02f9b7_0] Write session will restart in 0.009845s
2025-10-10T14:32:54.428567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84782405-c70418e0-c964168d-ca02f9b7_0] Write session: Do CDS request
2025-10-10T14:32:54.428573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84782405-c70418e0-c964168d-ca02f9b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:54.428710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:54.436502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:54.438093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:54.438286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:54.438298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:54.438309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:54.438363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:54.438406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601033333690722:5588]
2025-10-10T14:32:54.439032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:54.439304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:54.439349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:54.439686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:54.439749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.439755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.439756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.439757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.439758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.439759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.439761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.439762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.439763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.439764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.439765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.439766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.439767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.439773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.439786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.439791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.439795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.439799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.439803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.439807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.439811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.439815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.439819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.439823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.439827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.439831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.439841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84782405-c70418e0-c964168d-ca02f9b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.439839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.439852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.439859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.439864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.439874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.439883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.439892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.439902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.439911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.439921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.439930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.439937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.439946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.439951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.439959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.439965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.439943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:54.439974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.439956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 768
2025-10-10T14:32:54.439984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.439988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.439993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.439997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.440006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.440009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.440017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.440034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.440039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.440059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.440085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:54.440086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:54.440094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:54.440098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:54.440459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 768 sessionId:  describe result for acl check
2025-10-10T14:32:54.440485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:54.440490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:54.440491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:54.440496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601034115902427:6949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:54.441276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601034115902427:6949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:54.442270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:54.442640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:54.442654Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:54.442657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:54.442660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:54.442666Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 767 [2:7559601033333690722:5588]
2025-10-10T14:32:54.442678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:54.442698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:54.442705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.442708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.442711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.442730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:54.442743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:54.442750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:54.442807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.442814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.442816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.442818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:54.442881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:54.442888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.442899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.442912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.442934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:54.442955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902363:2438], now have 1 active actors on pipe
2025-10-10T14:32:54.442954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 767
2025-10-10T14:32:54.442968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601033333690717:5588]
2025-10-10T14:32:54.442973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601033333690717:5588]
2025-10-10T14:32:54.442975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601033333690717:5588]
2025-10-10T14:32:54.442985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:54.442992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:54.442994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:54.442997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:54.442999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:54.443014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:54.443022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:54.443049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601033333690717:5588]
2025-10-10T14:32:54.443075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:54.443083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:54.443203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601034115902427:6949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:54.448574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601034115902427:6949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:54.448587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601034115902427:6949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:54.448591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601034115902427:6949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:54.448598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:54.448899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 767
2025-10-10T14:32:54.449002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902460:6949], now have 1 active actors on pipe
2025-10-10T14:32:54.449035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.449042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.449078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3413510-fc986a2d-392953f1-dc02b664_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:54.449097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.449109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.449115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:54.449132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.449156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:54.449184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.449391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.449401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.449429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.449515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 768 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3413510-fc986a2d-392953f1-dc02b664_0
2025-10-10T14:32:54.449905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84782405-c70418e0-c964168d-ca02f9b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3413510-fc986a2d-392953f1-dc02b664_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:54.452693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3413510-fc986a2d-392953f1-dc02b664_0] Write session: try to update token
2025-10-10T14:32:54.452709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3413510-fc986a2d-392953f1-dc02b664_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:54.461621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:54.461642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.461646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:54.461649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:54.461659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601033333690717:5588]
2025-10-10T14:32:54.461664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601033333690717:5588]
2025-10-10T14:32:54.461668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601033333690717:5588]
2025-10-10T14:32:54.461721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:54.461725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:54.461730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:54.461734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:54.461737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.461740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:54.461874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:54.466458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId: src_id|e3413510-fc986a2d-392953f1-dc02b664_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:54.469083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:54.528191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601034115902490:6574]
2025-10-10T14:32:54.528388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 767, pipe: [1:7559601034115902490:6574]
2025-10-10T14:32:54.568285Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:54.568544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.568561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.568606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902490:6574], now have 1 active actors on pipe
2025-10-10T14:32:54.568810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:54.568797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601034115902490:6574]
2025-10-10T14:32:54.568816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:54.568828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:54.568831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:54.568893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 768 reason: error at write: Disconnected sessionId: src_id|e3413510-fc986a2d-392953f1-dc02b664_0
2025-10-10T14:32:54.569099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 768 sessionId: src_id|e3413510-fc986a2d-392953f1-dc02b664_0 is DEAD
2025-10-10T14:32:54.569250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3413510-fc986a2d-392953f1-dc02b664_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:54.569260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3413510-fc986a2d-392953f1-dc02b664_0] Write session will restart in 0.009933s
2025-10-10T14:32:54.569278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3413510-fc986a2d-392953f1-dc02b664_0] Write session: Do CDS request
2025-10-10T14:32:54.569294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3413510-fc986a2d-392953f1-dc02b664_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:54.577039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:54.578557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:54.578744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:54.578757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:54.578770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:54.578825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:54.578870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601033333690860:5603]
2025-10-10T14:32:54.579803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:54.580103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:54.580146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:54.580425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:54.580476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.580481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.580483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.580484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.580485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.580486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.580487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.580488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.580489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.580490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.580490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.580492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.580492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.580498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.580510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.580514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.580518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.580521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.580525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.580528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.580532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.580535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.580539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.580542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.580546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.580549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.580556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.580565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.580571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.580576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.580580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.580586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.580590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.580595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.580598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.580609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.580612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.580621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.580627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.580635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.580639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.580648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.580656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.580661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.580669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.580673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.580681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.580685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.580692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.580697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.580703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.580707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.580743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:54.580776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3413510-fc986a2d-392953f1-dc02b664_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.580792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:54.580809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 769
2025-10-10T14:32:54.580980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.581009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:54.581020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:54.581023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:54.581362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 769 sessionId:  describe result for acl check
2025-10-10T14:32:54.581393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:54.581394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:54.581395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:54.581399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601034115902565:6964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:54.581868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601034115902565:6964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:54.582829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:54.583200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:54.583212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:54.583213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:54.583216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:54.583220Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 768 [2:7559601033333690860:5603]
2025-10-10T14:32:54.583232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:54.583249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:54.583253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.583256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.583259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.583280Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:54.583290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:54.583295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:54.583345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.583353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.583354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.583357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:54.583407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:54.583412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.583419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.583428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.583440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:54.583460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902498:2438], now have 1 active actors on pipe
2025-10-10T14:32:54.583469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601033333690855:5603]
2025-10-10T14:32:54.583470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601033333690855:5603]
2025-10-10T14:32:54.583471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601033333690855:5603]
2025-10-10T14:32:54.583482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:54.583495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:54.583507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:54.583509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:54.583511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:54.583516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:54.583507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 768
2025-10-10T14:32:54.583520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:54.583542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601033333690855:5603]
2025-10-10T14:32:54.583547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:54.583550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:54.584099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601034115902565:6964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:54.589736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601034115902565:6964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:54.589749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601034115902565:6964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:54.589752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601034115902565:6964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:54.589759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:54.589975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902599:6964], now have 1 active actors on pipe
2025-10-10T14:32:54.590051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 768
2025-10-10T14:32:54.590139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.590152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.590186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:54.590214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.590224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.590231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:54.590244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.590266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:54.590287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.590468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.590478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.590494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.590567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 769 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0
2025-10-10T14:32:54.590922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3413510-fc986a2d-392953f1-dc02b664_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:54.593657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0] Write session: try to update token
2025-10-10T14:32:54.593675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:54.594055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:54.594070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.594081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601033333690855:5603]
2025-10-10T14:32:54.594122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:54.594140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:54.594298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:54.594445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:54.594582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:54.594721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:54.594904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:54.594939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:54.606516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId: src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:54.608950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:54.610263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.610281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.610302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:54.610304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.610306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:54.610307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:54.610314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601033333690855:5603]
2025-10-10T14:32:54.610320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601033333690855:5603]
2025-10-10T14:32:54.610323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601033333690855:5603]
2025-10-10T14:32:54.610368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:54.610370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:54.610376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:54.610378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.610379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:54.610380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:54.610494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:54.669007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601034115902608:6574]
2025-10-10T14:32:54.669271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 768, pipe: [1:7559601034115902608:6574]
2025-10-10T14:32:54.710863Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:54.711073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:54.711105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902608:6574], now have 1 active actors on pipe
2025-10-10T14:32:54.711199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:54.711244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601034115902608:6574]
2025-10-10T14:32:54.711263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:54.711294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:54.711298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:54.711373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 769 reason: error at write: Disconnected sessionId: src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0
2025-10-10T14:32:54.711526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 769 sessionId: src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0 is DEAD
2025-10-10T14:32:54.711686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:54.711698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0] Write session will restart in 0.006204s
2025-10-10T14:32:54.711723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0] Write session: Do CDS request
2025-10-10T14:32:54.711729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:54.718868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.718915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:54.718929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 770
2025-10-10T14:32:54.719082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.719120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:54.719132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:54.719136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:54.719362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:54.719586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 770 sessionId:  describe result for acl check
2025-10-10T14:32:54.719632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:54.719637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:54.719638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:54.719642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601034115902670:6968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:54.720043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601034115902670:6968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:54.720861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:54.721006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:54.721015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:54.721023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:54.721058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:54.721087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601033333690961:5606]
2025-10-10T14:32:54.721465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:54.721695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:54.721728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:54.721944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:54.721982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.721987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.721987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.721988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.721983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601034115902670:6968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:54.721988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.721989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.721990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.721990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.721991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.721992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.721992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.721993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.721993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.721997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.722005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.722007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.722009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.722011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.722014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.722016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.722018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.722019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.722022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.722023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.722025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.722027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.722032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.722037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.722042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.722046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.722049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.722052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.722055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.722058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.722061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.722065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.722067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.722070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.722073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.722076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.722078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.722081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.722084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.722087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.722090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.722093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.722095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.722098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.722100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.722103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.722106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.722109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.722131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:54.724202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:54.724284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601034115902670:6968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:54.724295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601034115902670:6968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:54.724298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601034115902670:6968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:54.724312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:54.724491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:54.724502Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:54.724503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:54.724505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:54.724518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 769 [2:7559601033333690961:5606]
2025-10-10T14:32:54.724525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:54.724539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:54.724544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.724546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.724548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.724561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:54.724570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:54.724577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:54.724630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.724638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.724640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.724642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:54.724691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:54.724706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.724716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.724725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.724735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:54.724753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902609:2438], now have 1 active actors on pipe
2025-10-10T14:32:54.724759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902704:6968], now have 1 active actors on pipe
2025-10-10T14:32:54.724764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601033333690956:5606]
2025-10-10T14:32:54.724766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601033333690956:5606]
2025-10-10T14:32:54.724768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601033333690956:5606]
2025-10-10T14:32:54.724776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:54.724789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:54.724794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 769
2025-10-10T14:32:54.724802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:54.724802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:54.724804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:54.724805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:54.724807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:54.724803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 769
2025-10-10T14:32:54.724820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601033333690956:5606]
2025-10-10T14:32:54.724822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:54.724824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:54.724862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.724869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.724899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15363f2d-1389769b-18c1bac-47531f80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:54.724910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.724914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.724916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:54.724923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.724931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:54.724945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.725107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.725113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.725124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.725196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 770 partition: 0 MaxSeqNo: 40 sessionId: src_id|15363f2d-1389769b-18c1bac-47531f80_0
2025-10-10T14:32:54.725543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a344044-4fb4190e-8ccab37d-463e21a3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|15363f2d-1389769b-18c1bac-47531f80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:54.728293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15363f2d-1389769b-18c1bac-47531f80_0] Write session: try to update token
2025-10-10T14:32:54.728311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15363f2d-1389769b-18c1bac-47531f80_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:54.742595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId: src_id|15363f2d-1389769b-18c1bac-47531f80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:54.744664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:54.744681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.744685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:54.744687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:54.744696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601033333690956:5606]
2025-10-10T14:32:54.744704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601033333690956:5606]
2025-10-10T14:32:54.744708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601033333690956:5606]
2025-10-10T14:32:54.744753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:54.744758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:54.744765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.744767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:54.744770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:54.744772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:54.744902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:54.745168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:54.811328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601034115902712:6574]
2025-10-10T14:32:54.811585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 769, pipe: [1:7559601034115902712:6574]
2025-10-10T14:32:54.859600Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:54.859951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.859966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.860005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902712:6574], now have 1 active actors on pipe
2025-10-10T14:32:54.860188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:54.860190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:54.860242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:54.860250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:54.860314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 770 reason: error at write: Disconnected sessionId: src_id|15363f2d-1389769b-18c1bac-47531f80_0
2025-10-10T14:32:54.860419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601034115902712:6574]
2025-10-10T14:32:54.860537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 770 sessionId: src_id|15363f2d-1389769b-18c1bac-47531f80_0 is DEAD
2025-10-10T14:32:54.860696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15363f2d-1389769b-18c1bac-47531f80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:54.860703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15363f2d-1389769b-18c1bac-47531f80_0] Write session will restart in 0.008557s
2025-10-10T14:32:54.860728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15363f2d-1389769b-18c1bac-47531f80_0] Write session: Do CDS request
2025-10-10T14:32:54.860735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15363f2d-1389769b-18c1bac-47531f80_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:54.868531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:54.870053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:54.870200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:54.870207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:54.870215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:54.870249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:54.870292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601033333691062:5608]
2025-10-10T14:32:54.870698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:54.870864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15363f2d-1389769b-18c1bac-47531f80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.870901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:54.870917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 771
2025-10-10T14:32:54.870953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:54.871010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:54.871102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:54.871132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:54.871143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:54.871151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:54.871268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:54.871336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.871341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.871342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.871343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.871343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.871344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.871344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.871345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.871346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.871346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.871347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.871347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.871348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.871352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.871361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.871363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.871366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.871368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.871370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.871372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.871374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.871376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.871379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.871381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.871383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.871385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.871390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.871397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:54.871402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.871406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:54.871408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.871412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:54.871414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.871417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:54.871420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.871423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:54.871426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.871429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:54.871432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.871435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:54.871438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.871441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:54.871443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.871447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:54.871449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.871453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:54.871455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.871459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.871461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.871464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.871467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.871470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.871492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:54.871530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 771 sessionId:  describe result for acl check
2025-10-10T14:32:54.871556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:54.871557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:54.871558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:54.871563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601034115902777:6972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:54.871983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601034115902777:6972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:54.873701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:54.873996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:54.874005Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:54.874006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:54.874011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:54.874015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 770 [2:7559601033333691062:5608]
2025-10-10T14:32:54.874025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:54.874040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:54.874045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.874047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.874048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.874060Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:54.874065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:54.874072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:54.874116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.874125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.874127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.874130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:54.874148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601034115902777:6972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:54.874180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:54.874186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.874193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:54.874200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:54.874209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:54.874228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902713:2438], now have 1 active actors on pipe
2025-10-10T14:32:54.874238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601033333691057:5608]
2025-10-10T14:32:54.874239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601033333691057:5608]
2025-10-10T14:32:54.874241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601033333691057:5608]
2025-10-10T14:32:54.874252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:54.874258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 770
2025-10-10T14:32:54.874261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:54.874262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:54.874268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:54.874270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:54.874272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:54.874274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:54.874294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601033333691057:5608]
2025-10-10T14:32:54.874296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:54.874297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:54.878686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601034115902777:6972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:54.878700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601034115902777:6972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:54.878704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601034115902777:6972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:54.878713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:54.878916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902813:6972], now have 1 active actors on pipe
2025-10-10T14:32:54.878974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 770
2025-10-10T14:32:54.879032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.879040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.879087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79ff821f-eb763b9c-19a77a15-efbba268_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:54.879098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:54.879106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:54.879108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:54.879119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:54.879137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:54.879155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.879331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.879346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.879373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:54.879476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 771 partition: 0 MaxSeqNo: 40 sessionId: src_id|79ff821f-eb763b9c-19a77a15-efbba268_0
2025-10-10T14:32:54.879793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15363f2d-1389769b-18c1bac-47531f80_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|79ff821f-eb763b9c-19a77a15-efbba268_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:54.882191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ff821f-eb763b9c-19a77a15-efbba268_0] Write session: try to update token
2025-10-10T14:32:54.882204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ff821f-eb763b9c-19a77a15-efbba268_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:54.892140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:54.892157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:54.892159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:54.892161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:54.892168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601033333691057:5608]
2025-10-10T14:32:54.892171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601033333691057:5608]
2025-10-10T14:32:54.892174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601033333691057:5608]
2025-10-10T14:32:54.892213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:54.892220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:54.892223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:54.892227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:54.892229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:54.892230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:54.892351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:54.895478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId: src_id|79ff821f-eb763b9c-19a77a15-efbba268_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:54.897833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:54.960326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601034115902817:6574]
2025-10-10T14:32:54.960532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 770, pipe: [1:7559601034115902817:6574]
2025-10-10T14:32:54.995350Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:54.995643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:54.995655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:54.995693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902817:6574], now have 1 active actors on pipe
2025-10-10T14:32:54.995859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:54.995901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601034115902817:6574]
2025-10-10T14:32:54.995907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:54.995939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:54.996012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 771 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79ff821f-eb763b9c-19a77a15-efbba268_0
2025-10-10T14:32:54.996224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 771 sessionId: src_id|79ff821f-eb763b9c-19a77a15-efbba268_0 is DEAD
2025-10-10T14:32:54.996370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ff821f-eb763b9c-19a77a15-efbba268_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:54.996379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ff821f-eb763b9c-19a77a15-efbba268_0] Write session will restart in 0.007932s
2025-10-10T14:32:54.996399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ff821f-eb763b9c-19a77a15-efbba268_0] Write session: Do CDS request
2025-10-10T14:32:54.996405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ff821f-eb763b9c-19a77a15-efbba268_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:55.004737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:55.005800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ff821f-eb763b9c-19a77a15-efbba268_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.005922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:55.005940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 772
2025-10-10T14:32:55.006084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.006120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:55.006130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:55.006149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:55.006395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:55.006546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:55.006554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:55.006562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:55.006548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 772 sessionId:  describe result for acl check
2025-10-10T14:32:55.006580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:55.006585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:55.006587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:55.006591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601038410870183:6976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:55.006609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:55.006652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601037628658463:5610]
2025-10-10T14:32:55.007008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601038410870183:6976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:55.007058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:55.007331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:55.007363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:55.007572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:55.007607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.007612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.007612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.007613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.007614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.007615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.007615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.007616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.007617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.007617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.007618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.007619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.007619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.007623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.007631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.007634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.007636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.007639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.007641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.007643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.007645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.007648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.007650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.007652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.007654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.007657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.007662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.007667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.007672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.007685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.007688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.007691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.007695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.007698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.007701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.007705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.007707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.007710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.007714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.007718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.007720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.007723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.007726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.007729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.007731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.007734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.007736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.007739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.007742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.007744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.007747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.007750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.007772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:55.008607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601038410870183:6976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:55.009811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:55.010101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:55.010109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:55.010110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:55.010113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:55.010118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 771 [2:7559601037628658463:5610]
2025-10-10T14:32:55.010126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:55.010138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:55.010143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.010146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.010147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.010162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:55.010171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:55.010183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:55.010240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.010252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.010254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.010256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:55.010308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:55.010313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.010320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.010335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.010348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:55.010366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601034115902824:2438], now have 1 active actors on pipe
2025-10-10T14:32:55.010376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601037628658458:5610]
2025-10-10T14:32:55.010381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601037628658458:5610]
2025-10-10T14:32:55.010382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601037628658458:5610]
2025-10-10T14:32:55.010391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:55.010389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 771
2025-10-10T14:32:55.010405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:55.010420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:55.010419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:55.010423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:55.010426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:55.010427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:55.010448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601037628658458:5610]
2025-10-10T14:32:55.010456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:55.010474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:55.011711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601038410870183:6976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:55.011721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601038410870183:6976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:55.011724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601038410870183:6976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:55.011730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:55.011922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870221:6976], now have 1 active actors on pipe
2025-10-10T14:32:55.011985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 771
2025-10-10T14:32:55.012040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.012051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.012075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:55.012086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.012090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.012091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:55.012102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.012115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:55.012141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.012241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.012247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.012258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.012326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 772 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0
2025-10-10T14:32:55.012646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ff821f-eb763b9c-19a77a15-efbba268_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:55.015147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0] Write session: try to update token
2025-10-10T14:32:55.015161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:55.027930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:55.027949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:55.027952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:55.027953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:55.027961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601037628658458:5610]
2025-10-10T14:32:55.027965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601037628658458:5610]
2025-10-10T14:32:55.027968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601037628658458:5610]
2025-10-10T14:32:55.028008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:55.028010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:55.028014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:55.028015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.028016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:55.028017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:55.028147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:55.028658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId: src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:55.031042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:55.096016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601038410870224:6574]
2025-10-10T14:32:55.096392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 771, pipe: [1:7559601038410870224:6574]
2025-10-10T14:32:55.132199Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:55.132509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.132522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.132561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870224:6574], now have 1 active actors on pipe
2025-10-10T14:32:55.132727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:55.132790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601038410870224:6574]
2025-10-10T14:32:55.132815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:55.132818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:55.132897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 772 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0
2025-10-10T14:32:55.133129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 772 sessionId: src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0 is DEAD
2025-10-10T14:32:55.133261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:55.133271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0] Write session will restart in 0.007498s
2025-10-10T14:32:55.133290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0] Write session: Do CDS request
2025-10-10T14:32:55.133295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:55.141370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:55.141810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.141846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:55.141861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 773
2025-10-10T14:32:55.142011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.142040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:55.142047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:55.142052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:55.142441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 773 sessionId:  describe result for acl check
2025-10-10T14:32:55.142472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:55.142477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:55.142478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:55.142482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601038410870290:6980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:55.142826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:55.142920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601038410870290:6980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:55.142976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:55.142986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:55.142994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:55.143037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:55.143087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601037628658565:5612]
2025-10-10T14:32:55.143474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:55.143749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:55.143791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:55.144011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:55.144045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.144049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.144050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.144051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.144051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.144052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.144052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.144053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.144054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.144054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.144055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.144055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.144056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.144059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.144067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.144069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.144072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.144074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.144077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.144079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.144081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.144084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.144086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.144089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.144091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.144093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.144098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.144104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.144110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.144115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.144119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.144123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.144128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.144133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.144138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.144142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.144145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.144149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.144152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.144155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.144157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.144160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.144163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.144166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.144168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.144171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.144174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.144177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.144179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.144183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.144185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.144188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.144212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:55.144848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601038410870290:6980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:55.146215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:55.146506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:55.146516Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:55.146517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:55.146519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:55.146524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 772 [2:7559601037628658565:5612]
2025-10-10T14:32:55.146531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:55.146543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:55.146548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.146551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.146552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.146564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:55.146582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:55.146591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:55.146627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.146633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.146634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.146636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:55.146730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:55.146743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.146754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.146765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.146774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:55.146793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870225:2438], now have 1 active actors on pipe
2025-10-10T14:32:55.146803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601037628658560:5612]
2025-10-10T14:32:55.146808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601037628658560:5612]
2025-10-10T14:32:55.146809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601037628658560:5612]
2025-10-10T14:32:55.146816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:55.146800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 772
2025-10-10T14:32:55.146826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:55.146836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:55.146839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:55.146841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:55.146846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:55.146848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:55.146864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601037628658560:5612]
2025-10-10T14:32:55.146871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:55.146873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:55.147156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601038410870290:6980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:55.147167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601038410870290:6980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:55.147170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601038410870290:6980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:55.147177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:55.147362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870326:6980], now have 1 active actors on pipe
2025-10-10T14:32:55.147405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 772
2025-10-10T14:32:55.147461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.147468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.147490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:55.147501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.147503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.147505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:55.147512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.147522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:55.147537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.147654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.147661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.147672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.147736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 773 partition: 0 MaxSeqNo: 40 sessionId: src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0
2025-10-10T14:32:55.147996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f41d32f-19e9e9b4-88ab176e-b8916ef5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:55.150499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0] Write session: try to update token
2025-10-10T14:32:55.150515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:55.163091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId: src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:55.164819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:55.164832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:55.164835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:55.164836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:55.164845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601037628658560:5612]
2025-10-10T14:32:55.164848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601037628658560:5612]
2025-10-10T14:32:55.164850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601037628658560:5612]
2025-10-10T14:32:55.164891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:55.164900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.164902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:55.164901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:55.164907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:55.164912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:55.165025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:55.165622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:55.233211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601038410870331:6574]
2025-10-10T14:32:55.233490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 772, pipe: [1:7559601038410870331:6574]
2025-10-10T14:32:55.266842Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:55.267101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.267117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.267162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870331:6574], now have 1 active actors on pipe
2025-10-10T14:32:55.267340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:55.267461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:55.267467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:55.267474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:55.267516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601038410870331:6574]
2025-10-10T14:32:55.267548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 773 reason: error at write: Disconnected sessionId: src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0
2025-10-10T14:32:55.267760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 773 sessionId: src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0 is DEAD
2025-10-10T14:32:55.267934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:55.267944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0] Write session will restart in 0.009194s
2025-10-10T14:32:55.267962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0] Write session: Do CDS request
2025-10-10T14:32:55.267967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:55.276989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:55.277860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.277979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:55.277995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 774
2025-10-10T14:32:55.278136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.278174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:55.278185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:55.278189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:55.278645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 774 sessionId:  describe result for acl check
2025-10-10T14:32:55.278685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:55.278691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:55.278693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:55.278700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601038410870409:6985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:55.278693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:55.278868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:55.278878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:55.278886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:55.278947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:55.278977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601037628658682:5615]
2025-10-10T14:32:55.279259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601038410870409:6985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:55.279367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:55.279593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:55.279622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:55.279825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:55.279862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.279866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.279867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.279867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.279868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.279869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.279870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.279871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.279871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.279872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.279873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.279873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.279874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.279878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.279886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.279889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.279891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.279893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.279895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.279898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.279900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.279902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.279904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.279906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.279908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.279910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.279915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.279920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.279925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.279929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.279932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.279935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.279937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.279940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.279943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.279946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.279949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.279952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.279955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.279961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.279965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.279970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.279974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.279980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.279984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.279988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.279999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.280004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.280013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.280022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.280025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.280029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.280052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:55.281090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601038410870409:6985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:55.282224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:55.282627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:55.282634Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:55.282636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:55.282639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:55.282644Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 773 [2:7559601037628658682:5615]
2025-10-10T14:32:55.282652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:55.282666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:55.282671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.282674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.282675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.282688Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:55.282699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:55.282708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:55.282749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.282754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.282755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.282757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:55.282805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:55.282813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.282821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.282827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.282837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:55.282852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870344:2438], now have 1 active actors on pipe
2025-10-10T14:32:55.282862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601037628658677:5615]
2025-10-10T14:32:55.282864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601037628658677:5615]
2025-10-10T14:32:55.282865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601037628658677:5615]
2025-10-10T14:32:55.282874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:55.282888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:55.282894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:55.282897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:55.282898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:55.282884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 773
2025-10-10T14:32:55.282902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:55.282904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:55.282925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601037628658677:5615]
2025-10-10T14:32:55.282930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:55.282932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:55.283526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601038410870409:6985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:55.283540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601038410870409:6985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:55.283543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601038410870409:6985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:55.283561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:55.283744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870445:6985], now have 1 active actors on pipe
2025-10-10T14:32:55.283771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 773
2025-10-10T14:32:55.283828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.283842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.283876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6367144d-65864212-becbdb0-22fcc987_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:55.283889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.283895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.283901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:55.283911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.283926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:55.283944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.284123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.284130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.284140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.284204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 774 partition: 0 MaxSeqNo: 40 sessionId: src_id|6367144d-65864212-becbdb0-22fcc987_0
2025-10-10T14:32:55.284577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da17706-eca79a02-4fa0a262-432e9f7f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6367144d-65864212-becbdb0-22fcc987_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:55.286965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6367144d-65864212-becbdb0-22fcc987_0] Write session: try to update token
2025-10-10T14:32:55.286984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6367144d-65864212-becbdb0-22fcc987_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:55.293637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:55.293652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:55.293661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601037628658677:5615]
2025-10-10T14:32:55.293705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:55.293707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:55.293879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:55.294016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:55.294144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:55.294269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:55.294466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:55.294507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:55.300488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId: src_id|6367144d-65864212-becbdb0-22fcc987_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:55.303079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:55.303288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.303310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.303350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:55.303455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:55.310535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:55.310552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:55.310555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:55.310557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:55.310567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601037628658677:5615]
2025-10-10T14:32:55.310571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601037628658677:5615]
2025-10-10T14:32:55.310577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601037628658677:5615]
2025-10-10T14:32:55.310615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:55.310620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:55.310622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.310623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:55.310625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:55.310628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:55.310744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:55.367900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601038410870451:6574]
2025-10-10T14:32:55.368185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 773, pipe: [1:7559601038410870451:6574]
2025-10-10T14:32:55.410673Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:55.416935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.416957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.417104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.417157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.417210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.417264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.417305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.417313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.417381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.417432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.417485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.417539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.417580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.417587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.417640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.417692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.417746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.417801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.417838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.417843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.417900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.417954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.418007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.418062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.418100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.418106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.418160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.418210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.418263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.418314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.418352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.418357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.418411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.418459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.418510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.418561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.418598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.418605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.418657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.418707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.418762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.418812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.418848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.418853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.418906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.418955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.419008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.419061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.419110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.419117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.419170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.419219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.419270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.419317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.419354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.419359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.419410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:55.419461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:55.419511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:55.419561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:55.419597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:55.419602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:55.419638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870451:6574], now have 1 active actors on pipe
2025-10-10T14:32:55.419913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:55.419933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601038410870451:6574]
2025-10-10T14:32:55.419966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:55.419975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:55.420003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 774 reason: error at write: Disconnected sessionId: src_id|6367144d-65864212-becbdb0-22fcc987_0
2025-10-10T14:32:55.420221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 774 sessionId: src_id|6367144d-65864212-becbdb0-22fcc987_0 is DEAD
2025-10-10T14:32:55.420349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6367144d-65864212-becbdb0-22fcc987_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:55.420360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6367144d-65864212-becbdb0-22fcc987_0] Write session will restart in 0.007058s
2025-10-10T14:32:55.420378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6367144d-65864212-becbdb0-22fcc987_0] Write session: Do CDS request
2025-10-10T14:32:55.420382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6367144d-65864212-becbdb0-22fcc987_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:55.420378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:55.428830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6367144d-65864212-becbdb0-22fcc987_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.428873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:55.428888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 775
2025-10-10T14:32:55.428954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:55.429054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.429091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:55.429094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:55.429098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:55.429544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 775 sessionId:  describe result for acl check
2025-10-10T14:32:55.429582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:55.429589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:55.429591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:55.429597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601038410870518:6989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:55.430159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601038410870518:6989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:55.430600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:55.430739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:55.430748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:55.430756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:55.430791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:55.430821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601037628658786:5617]
2025-10-10T14:32:55.431348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:55.431612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:55.431644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:55.431879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:55.431921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.431926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.431926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.431927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.431928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.431928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.431929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.431929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.431930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.431930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.431931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.431932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.431932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.431936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.431943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.431946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.431948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.431950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.431952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.431955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.431957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.431959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.431962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.431964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.431966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.431968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.431973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.431978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.431983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.431986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.431989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.431992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.431994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.431997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.432000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.432003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.432006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.432009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.432011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.432014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.432017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.432020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.432023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.432026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.432029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.432032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.432034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.432038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.432041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.432044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.432047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.432050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.432072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:55.432628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601038410870518:6989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:55.434115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:55.434394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:55.434405Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:55.434407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:55.434410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:55.434416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 774 [2:7559601037628658786:5617]
2025-10-10T14:32:55.434426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:55.434443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:55.434450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.434453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.434455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.434473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:55.434484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:55.434491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:55.434542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.434548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.434550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.434553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:55.434609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:55.434615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.434622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.434628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.434644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:55.434668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870452:2438], now have 1 active actors on pipe
2025-10-10T14:32:55.434679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601037628658780:5617]
2025-10-10T14:32:55.434682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601037628658780:5617]
2025-10-10T14:32:55.434684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601037628658780:5617]
2025-10-10T14:32:55.434710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:55.434716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:55.434719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:55.434722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:55.434728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:55.434718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 774
2025-10-10T14:32:55.434743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:55.434750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:55.434784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601037628658780:5617]
2025-10-10T14:32:55.434795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:55.434801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:55.434951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601038410870518:6989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:55.434965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601038410870518:6989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:55.434968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601038410870518:6989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:55.434975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:55.435216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870554:6989], now have 1 active actors on pipe
2025-10-10T14:32:55.435243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 774
2025-10-10T14:32:55.435295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.435305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.435330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:55.435340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.435347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.435349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:55.435358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.435367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:55.435382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.435516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.435524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.435539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.435610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 775 partition: 0 MaxSeqNo: 40 sessionId: src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0
2025-10-10T14:32:55.435869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6367144d-65864212-becbdb0-22fcc987_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:55.438402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0] Write session: try to update token
2025-10-10T14:32:55.438416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:55.451807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId: src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:55.452594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:55.452611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:55.452613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:55.452615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:55.452622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601037628658780:5617]
2025-10-10T14:32:55.452626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601037628658780:5617]
2025-10-10T14:32:55.452629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601037628658780:5617]
2025-10-10T14:32:55.452668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:55.452675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.452676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:55.452695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:55.452710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:55.452715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:55.452807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:55.454373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:55.519946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601038410870560:6574]
2025-10-10T14:32:55.520197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 774, pipe: [1:7559601038410870560:6574]
2025-10-10T14:32:55.554903Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:55.555256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.555269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.555303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870560:6574], now have 1 active actors on pipe
2025-10-10T14:32:55.555535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:55.555521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:55.555528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601038410870560:6574]
2025-10-10T14:32:55.555537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:55.555553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:55.555606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 775 reason: error at write: Disconnected sessionId: src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0
2025-10-10T14:32:55.555828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 775 sessionId: src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0 is DEAD
2025-10-10T14:32:55.555977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:55.555989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0] Write session will restart in 0.006833s
2025-10-10T14:32:55.556024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0] Write session: Do CDS request
2025-10-10T14:32:55.556031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:55.563905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.563984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:55.563997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 776
2025-10-10T14:32:55.564156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.564188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:55.564196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:55.564199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:55.564659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 776 sessionId:  describe result for acl check
2025-10-10T14:32:55.564696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:55.564702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:55.564703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:55.564709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601038410870656:7002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:55.565070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:55.565245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601038410870656:7002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:55.566875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:55.567048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:55.567060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:55.567082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:55.567140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:55.567141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601038410870656:7002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:55.567179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601037628658930:5627]
2025-10-10T14:32:55.567743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:55.567968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:55.568009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:55.568231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:55.568266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.568271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.568272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.568272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.568273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.568274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.568274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.568275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.568276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.568277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.568277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.568278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.568278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.568283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.568290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.568292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.568295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.568297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.568299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.568301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.568304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.568306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.568308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.568310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.568312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.568314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.568320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.568325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.568329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.568333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.568335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.568338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.568341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.568344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.568347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.568350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.568352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.568355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.568358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.568361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.568364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.568367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.568369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.568373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.568375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.568378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.568381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.568384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.568388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.568393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.568397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.568402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.568440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:55.570507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601038410870656:7002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:55.570523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601038410870656:7002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:55.570527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601038410870656:7002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:55.570535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:55.570551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:55.570957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:55.570972Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:55.570974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:55.570978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:55.570984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 775 [2:7559601037628658930:5627]
2025-10-10T14:32:55.570995Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:55.571007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:55.571013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.571017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.571019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.571032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:55.571040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:55.571049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:55.571109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.571115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.571116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.571118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:55.571168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:55.571175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.571182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.571189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.571198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:55.571214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601037628658913:5627]
2025-10-10T14:32:55.571221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601037628658913:5627]
2025-10-10T14:32:55.571223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601037628658913:5627]
2025-10-10T14:32:55.571235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:55.571247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870691:7002], now have 1 active actors on pipe
2025-10-10T14:32:55.571247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:55.571250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:55.571252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:55.571253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870587:2438], now have 1 active actors on pipe
2025-10-10T14:32:55.571260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:55.571270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:55.571272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:55.571286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 775
2025-10-10T14:32:55.571296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601037628658913:5627]
2025-10-10T14:32:55.571302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:55.571292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 775
2025-10-10T14:32:55.571317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:55.571327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.571330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.571365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cb70190-fd06cb62-434d6606-15b47d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:55.571375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.571378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.571380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:55.571388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.571398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:55.571409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.571519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.571525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.571537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.571620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 776 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cb70190-fd06cb62-434d6606-15b47d5_0
2025-10-10T14:32:55.571965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6179940-6c989a86-54ba4044-f6e9fb90_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cb70190-fd06cb62-434d6606-15b47d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:55.574591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb70190-fd06cb62-434d6606-15b47d5_0] Write session: try to update token
2025-10-10T14:32:55.574605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb70190-fd06cb62-434d6606-15b47d5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:55.588329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId: src_id|3cb70190-fd06cb62-434d6606-15b47d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:55.589561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:55.589576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:55.589579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:55.589581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:55.589590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601037628658913:5627]
2025-10-10T14:32:55.589595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601037628658913:5627]
2025-10-10T14:32:55.589599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601037628658913:5627]
2025-10-10T14:32:55.589651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:55.589659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:55.589665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.589666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:55.589668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:55.589670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:55.589812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:55.591017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:55.655619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601038410870704:6574]
2025-10-10T14:32:55.655893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 775, pipe: [1:7559601038410870704:6574]
2025-10-10T14:32:55.694859Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:55.695122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.695135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.695174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870704:6574], now have 1 active actors on pipe
2025-10-10T14:32:55.695332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:55.695411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:55.695414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:55.695424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:55.695462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601038410870704:6574]
2025-10-10T14:32:55.695482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 776 reason: error at write: Disconnected sessionId: src_id|3cb70190-fd06cb62-434d6606-15b47d5_0
2025-10-10T14:32:55.695681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 776 sessionId: src_id|3cb70190-fd06cb62-434d6606-15b47d5_0 is DEAD
2025-10-10T14:32:55.695841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb70190-fd06cb62-434d6606-15b47d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:55.695852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb70190-fd06cb62-434d6606-15b47d5_0] Write session will restart in 0.009996s
2025-10-10T14:32:55.695875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb70190-fd06cb62-434d6606-15b47d5_0] Write session: Do CDS request
2025-10-10T14:32:55.695886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb70190-fd06cb62-434d6606-15b47d5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:55.705120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:55.706660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:55.706852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb70190-fd06cb62-434d6606-15b47d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.706856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:55.706866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:55.706877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:55.706918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:55.706912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:55.706949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601037628659039:5635]
2025-10-10T14:32:55.706928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 777
2025-10-10T14:32:55.707133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.707165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:55.707175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:55.707179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:55.707391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:55.707586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:55.707595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 777 sessionId:  describe result for acl check
2025-10-10T14:32:55.707628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:55.707631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:55.707637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:55.707640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:55.707645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601038410870776:7008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:55.707832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:55.707881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.707887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.707888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.707889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.707891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.707892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.707893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.707894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.707895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.707896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.707897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.707898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.707899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.707904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.707916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.707920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.707924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.707928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.707932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.707935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.707938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.707941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.707945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.707947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.707950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.707954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.707961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.707972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.707983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.707992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.708000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.708004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.708013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.708018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.708023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.708028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.708035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.708038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.708041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.708048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.708050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.708053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.708059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.708063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.708066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.708069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.708072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.708078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.708080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.708083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.708086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.708092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.708115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:55.708147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601038410870776:7008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:55.710163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:55.710326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601038410870776:7008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:55.710576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:55.710588Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:55.710591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:55.710594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:55.710599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 776 [2:7559601037628659039:5635]
2025-10-10T14:32:55.710610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:55.710629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:55.710634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.710637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.710639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.710651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:55.710656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:55.710662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:55.710730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.710736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.710738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.710741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:55.710797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:55.710806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.710817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.710829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.710851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:55.710874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870705:2438], now have 1 active actors on pipe
2025-10-10T14:32:55.710883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601037628659034:5635]
2025-10-10T14:32:55.710885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601037628659034:5635]
2025-10-10T14:32:55.710886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601037628659034:5635]
2025-10-10T14:32:55.710896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:55.710892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 776
2025-10-10T14:32:55.710908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:55.710914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:55.710918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:55.710920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:55.710922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:55.710924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:55.710944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601037628659034:5635]
2025-10-10T14:32:55.710952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:55.710965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:55.715164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601038410870776:7008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:55.715177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601038410870776:7008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:55.715179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601038410870776:7008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:55.715186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:55.715389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870815:7008], now have 1 active actors on pipe
2025-10-10T14:32:55.715457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 776
2025-10-10T14:32:55.715505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.715516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.715551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb0f0a84-83d16317-4db85146-26f05ace_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:55.715568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.715574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.715576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:55.715589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.715604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:55.715621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.715762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.715768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.715778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.715847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 777 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb0f0a84-83d16317-4db85146-26f05ace_0
2025-10-10T14:32:55.716177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb70190-fd06cb62-434d6606-15b47d5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb0f0a84-83d16317-4db85146-26f05ace_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:55.718654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb0f0a84-83d16317-4db85146-26f05ace_0] Write session: try to update token
2025-10-10T14:32:55.718668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb0f0a84-83d16317-4db85146-26f05ace_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:55.728699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:55.728716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:55.728718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:55.728719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:55.728727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601037628659034:5635]
2025-10-10T14:32:55.728731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601037628659034:5635]
2025-10-10T14:32:55.728734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601037628659034:5635]
2025-10-10T14:32:55.728773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:55.728775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:55.728780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.728780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:55.728781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:55.728783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:55.728906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:55.732162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId: src_id|cb0f0a84-83d16317-4db85146-26f05ace_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:55.734907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:55.795385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601038410870819:6574]
2025-10-10T14:32:55.795666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 776, pipe: [1:7559601038410870819:6574]
2025-10-10T14:32:55.832273Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:55.832520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.832534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.832571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870819:6574], now have 1 active actors on pipe
2025-10-10T14:32:55.832802Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:55.832806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:55.832848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601038410870819:6574]
2025-10-10T14:32:55.832854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:55.832917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 777 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb0f0a84-83d16317-4db85146-26f05ace_0
2025-10-10T14:32:55.833097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 777 sessionId: src_id|cb0f0a84-83d16317-4db85146-26f05ace_0 is DEAD
2025-10-10T14:32:55.833271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb0f0a84-83d16317-4db85146-26f05ace_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:55.833283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb0f0a84-83d16317-4db85146-26f05ace_0] Write session will restart in 0.007126s
2025-10-10T14:32:55.833307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb0f0a84-83d16317-4db85146-26f05ace_0] Write session: Do CDS request
2025-10-10T14:32:55.833313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb0f0a84-83d16317-4db85146-26f05ace_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:55.841997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb0f0a84-83d16317-4db85146-26f05ace_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.842121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:55.842136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 778
2025-10-10T14:32:55.842293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.842333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:55.842342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:55.842346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:55.842798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 778 sessionId:  describe result for acl check
2025-10-10T14:32:55.842845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:55.842853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:55.842856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:55.842862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601038410870889:7012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:55.843422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601038410870889:7012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:55.844527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:55.845673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:55.845890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:55.845903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:55.845915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:55.845970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:55.846019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601037628659148:5637]
2025-10-10T14:32:55.846011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601038410870889:7012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:55.846548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:55.846808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:55.846859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:55.847141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:55.847194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.847199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.847199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.847200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.847202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.847204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.847205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.847206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.847206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.847207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.847209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.847209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.847211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.847215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.847225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.847228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.847231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.847234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.847236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.847238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.847242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.847244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.847246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.847250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.847253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.847255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.847260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.847267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.847273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.847277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.847280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.847284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.847287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.847290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.847295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.847298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.847301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.847306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.847308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.847311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.847316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.847321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.847325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.847328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.847331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.847334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.847336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.847340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.847343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.847347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.847350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.847352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.847378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:55.849324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601038410870889:7012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:55.849357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601038410870889:7012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:55.849360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601038410870889:7012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:55.849367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:55.849622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:55.850660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:55.850671Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:55.850672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:55.850675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:55.850678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 777 [2:7559601037628659148:5637]
2025-10-10T14:32:55.850686Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:55.850699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:55.850702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.850705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.850707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.850722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:55.850735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:55.850746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:55.850803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.850810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.850812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.850815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:55.850875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:55.850881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.850892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.850909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.850923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:55.850938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870821:2438], now have 1 active actors on pipe
2025-10-10T14:32:55.850944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870925:7012], now have 1 active actors on pipe
2025-10-10T14:32:55.850949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601037628659142:5637]
2025-10-10T14:32:55.850950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601037628659142:5637]
2025-10-10T14:32:55.850952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601037628659142:5637]
2025-10-10T14:32:55.850961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:55.850970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:55.850980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 777
2025-10-10T14:32:55.850979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:55.850981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 777
2025-10-10T14:32:55.850983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:55.850986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:55.850989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:55.850992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:55.851006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601037628659142:5637]
2025-10-10T14:32:55.851007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:55.851009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:55.851033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.851039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.851081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca667393-57feac63-3f6b6f93-580441d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:55.851094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.851096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.851098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:55.851106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.851115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:55.851132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.851246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.851254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.851267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.851362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 778 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca667393-57feac63-3f6b6f93-580441d2_0
2025-10-10T14:32:55.851627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb0f0a84-83d16317-4db85146-26f05ace_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca667393-57feac63-3f6b6f93-580441d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:55.860667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca667393-57feac63-3f6b6f93-580441d2_0] Write session: try to update token
2025-10-10T14:32:55.860688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca667393-57feac63-3f6b6f93-580441d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:55.869050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:55.869067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:55.869069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:55.869071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:55.869078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601037628659142:5637]
2025-10-10T14:32:55.869082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601037628659142:5637]
2025-10-10T14:32:55.869085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601037628659142:5637]
2025-10-10T14:32:55.869122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:55.869133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:55.869140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:55.869141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.869143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:55.869143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:55.869483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:55.879660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId: src_id|ca667393-57feac63-3f6b6f93-580441d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:55.882169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:55.933152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601038410870932:6574]
2025-10-10T14:32:55.933460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 777, pipe: [1:7559601038410870932:6574]
2025-10-10T14:32:55.973222Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:55.973567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.973584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.973604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870932:6574], now have 1 active actors on pipe
2025-10-10T14:32:55.973843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:55.973877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:55.973890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:55.973937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:55.973960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 778 reason: error at write: Disconnected sessionId: src_id|ca667393-57feac63-3f6b6f93-580441d2_0
2025-10-10T14:32:55.973995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601038410870932:6574]
2025-10-10T14:32:55.974187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 778 sessionId: src_id|ca667393-57feac63-3f6b6f93-580441d2_0 is DEAD
2025-10-10T14:32:55.974415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca667393-57feac63-3f6b6f93-580441d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:55.974430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca667393-57feac63-3f6b6f93-580441d2_0] Write session will restart in 0.006347s
2025-10-10T14:32:55.974479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca667393-57feac63-3f6b6f93-580441d2_0] Write session: Do CDS request
2025-10-10T14:32:55.974486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca667393-57feac63-3f6b6f93-580441d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:55.981904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca667393-57feac63-3f6b6f93-580441d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.981943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:55.981960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 779
2025-10-10T14:32:55.982181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:55.982218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:55.982228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:55.982232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:55.982676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 779 sessionId:  describe result for acl check
2025-10-10T14:32:55.982819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:55.982828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:55.982830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:55.982836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601038410871001:7016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:55.983346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601038410871001:7016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:55.983935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:55.985320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601038410871001:7016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:55.985640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:55.985850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:55.985860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:55.985872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:55.985931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:55.985974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601037628659256:5639]
2025-10-10T14:32:55.986557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:55.986797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:55.986840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:55.987168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:55.987225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.987231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.987232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.987233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.987234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.987235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.987236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.987238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.987239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.987240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.987241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.987242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.987243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.987248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.987260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.987265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.987269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.987272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.987276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.987280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.987283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.987287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.987290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.987293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.987301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.987305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.987315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.987328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:55.987334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.987340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:55.987346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.987358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:55.987362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.987368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:55.987372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.987377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:55.987381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.987385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:55.987390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.987394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:55.987398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.987402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:55.987407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.987412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:55.987416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.987421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:55.987426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.987431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.987441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.987447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.987455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.987460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.987502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:55.987980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601038410871001:7016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:55.987994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601038410871001:7016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:55.987998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601038410871001:7016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:55.988006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:55.989690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:55.990023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:55.990038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:55.990040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:55.990044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:55.990049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 778 [2:7559601037628659256:5639]
2025-10-10T14:32:55.990061Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:55.990077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:55.990080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.990083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.990087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.990105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:55.990114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:55.990126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:55.990177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.990184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.990186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.990189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:55.990252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:55.990260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:55.990271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:55.990284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:55.990305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:55.990330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410870933:2438], now have 1 active actors on pipe
2025-10-10T14:32:55.990338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601038410871038:7016], now have 1 active actors on pipe
2025-10-10T14:32:55.990345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601037628659251:5639]
2025-10-10T14:32:55.990348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601037628659251:5639]
2025-10-10T14:32:55.990350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601037628659251:5639]
2025-10-10T14:32:55.990360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:55.990364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 778
2025-10-10T14:32:55.990389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:55.990369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 778
2025-10-10T14:32:55.990393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:55.990397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:55.990399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:55.990410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:55.990418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:55.990454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.990463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.990479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601037628659251:5639]
2025-10-10T14:32:55.990492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:55.990503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:55.990521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13f64f44-a31477b6-918693c0-1720e182_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:55.990529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:55.990532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:55.990536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:55.990546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:55.990558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:55.990578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.990724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:55.990732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:55.990746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:55.990830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 779 partition: 0 MaxSeqNo: 40 sessionId: src_id|13f64f44-a31477b6-918693c0-1720e182_0
2025-10-10T14:32:55.991244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca667393-57feac63-3f6b6f93-580441d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|13f64f44-a31477b6-918693c0-1720e182_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:55.993935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f64f44-a31477b6-918693c0-1720e182_0] Write session: try to update token
2025-10-10T14:32:55.993953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f64f44-a31477b6-918693c0-1720e182_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:56.008386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId: src_id|13f64f44-a31477b6-918693c0-1720e182_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:56.009231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:56.009253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:56.009257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:56.009259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:56.009269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601037628659251:5639]
2025-10-10T14:32:56.009274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601037628659251:5639]
2025-10-10T14:32:56.009278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601037628659251:5639]
2025-10-10T14:32:56.009318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:56.009324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.009326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:56.009357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:56.009364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:56.009369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:56.009502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:56.011401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:56.073940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601042705838341:6574]
2025-10-10T14:32:56.074238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 778, pipe: [1:7559601042705838341:6574]
2025-10-10T14:32:56.113352Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:56.113742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.113754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.113792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838341:6574], now have 1 active actors on pipe
2025-10-10T14:32:56.113959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:56.113995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:56.114070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601042705838341:6574]
2025-10-10T14:32:56.114106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:56.114195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 779 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13f64f44-a31477b6-918693c0-1720e182_0
2025-10-10T14:32:56.114412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 779 sessionId: src_id|13f64f44-a31477b6-918693c0-1720e182_0 is DEAD
2025-10-10T14:32:56.114551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f64f44-a31477b6-918693c0-1720e182_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:56.114564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f64f44-a31477b6-918693c0-1720e182_0] Write session will restart in 0.005215s
2025-10-10T14:32:56.114589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f64f44-a31477b6-918693c0-1720e182_0] Write session: Do CDS request
2025-10-10T14:32:56.114595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f64f44-a31477b6-918693c0-1720e182_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:56.120757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f64f44-a31477b6-918693c0-1720e182_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.120887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:56.120900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 780
2025-10-10T14:32:56.121034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.121070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:56.121080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:56.121084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:56.121554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 780 sessionId:  describe result for acl check
2025-10-10T14:32:56.121591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:56.121593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:56.121595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:56.121601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601042705838376:7020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:56.122187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601042705838376:7020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:56.123670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:56.124559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601042705838376:7020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:56.125307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:56.125488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:56.125499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:56.125511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:56.125556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:56.125593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601041923626661:5641]
2025-10-10T14:32:56.126249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:56.126534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:56.126579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:56.126913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:56.126963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.126969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.126970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.126971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.126973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.126974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.126975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.126976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.126977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.126979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.126980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.126981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.126982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.126988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.127000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.127004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.127008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.127012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.127017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.127022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.127026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.127033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.127038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.127042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.127046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.127050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.127057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.127066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.127089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.127099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.127108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.127113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.127118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.127123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.127128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.127133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.127138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.127143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.127148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.127155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.127159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.127169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.127175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.127180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.127187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.127193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.127202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.127210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.127214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.127220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.127225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.127234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.127207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601042705838376:7020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:56.127221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601042705838376:7020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:56.127225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601042705838376:7020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:56.127231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:56.127276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:56.129384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:56.129680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:56.129691Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:56.129694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:56.129697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:56.129703Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 779 [2:7559601041923626661:5641]
2025-10-10T14:32:56.129714Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:56.129733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:56.129741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.129744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.129748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.129763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:56.129775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:56.129781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:56.129834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.129843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.129846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.129848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:56.129910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:56.129912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.129924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.129938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.129956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:56.129976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838445:7020], now have 1 active actors on pipe
2025-10-10T14:32:56.129984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838342:2438], now have 1 active actors on pipe
2025-10-10T14:32:56.129991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601041923626656:5641]
2025-10-10T14:32:56.129993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601041923626656:5641]
2025-10-10T14:32:56.129996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601041923626656:5641]
2025-10-10T14:32:56.130007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:56.130020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:56.130026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:56.130028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:56.130030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:56.130048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:56.130051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:56.130026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 779
2025-10-10T14:32:56.130026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 779
2025-10-10T14:32:56.130070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601041923626656:5641]
2025-10-10T14:32:56.130081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:56.130087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:56.130096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.130101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.130153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:56.130165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.130169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.130171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:56.130180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.130190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:56.130212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.130371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.130378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.130392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.130478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 780 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0
2025-10-10T14:32:56.130779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f64f44-a31477b6-918693c0-1720e182_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:56.133424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0] Write session: try to update token
2025-10-10T14:32:56.133439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:56.147518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId: src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:56.149019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:56.149043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:56.149049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:56.149051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:56.149061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601041923626656:5641]
2025-10-10T14:32:56.149065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601041923626656:5641]
2025-10-10T14:32:56.149068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601041923626656:5641]
2025-10-10T14:32:56.149110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:56.149116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:56.149121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:56.149122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.149124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:56.149125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:56.149347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:56.150044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:56.214214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601042705838455:6574]
2025-10-10T14:32:56.214568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 779, pipe: [1:7559601042705838455:6574]
2025-10-10T14:32:56.261955Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:56.262261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.262277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.262315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838455:6574], now have 1 active actors on pipe
2025-10-10T14:32:56.262626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:56.262631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:56.262642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:56.262677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601042705838455:6574]
2025-10-10T14:32:56.262705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 780 reason: error at write: Disconnected sessionId: src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0
2025-10-10T14:32:56.262814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:56.262956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 780 sessionId: src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0 is DEAD
2025-10-10T14:32:56.263058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:56.263064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0] Write session will restart in 0.009204s
2025-10-10T14:32:56.263093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0] Write session: Do CDS request
2025-10-10T14:32:56.263098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:56.271812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:56.273312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:56.273489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:56.273500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:56.273511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:56.273562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:56.273605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601041923626783:5644]
2025-10-10T14:32:56.273663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.273685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:56.273698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 781
2025-10-10T14:32:56.273832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.273873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:56.273883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:56.273887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:56.274032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:56.274267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:56.274303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:56.274308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 781 sessionId:  describe result for acl check
2025-10-10T14:32:56.274345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:56.274352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:56.274354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:56.274360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601042705838546:7027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:56.274560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:56.274615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.274620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.274621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.274622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.274623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.274625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.274626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.274627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.274628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.274629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.274630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.274631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.274632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.274638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.274649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.274652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.274656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.274659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.274663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.274667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.274671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.274675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.274679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.274683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.274687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.274690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.274697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.274707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.274714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.274723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.274731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.274736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.274744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.274749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.274754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.274761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.274765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.274770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.274774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.274779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.274787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.274792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.274797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.274805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.274807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.274810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.274815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.274818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.274820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.274823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.274826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.274829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.274851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:56.274895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601042705838546:7027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:56.277000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601042705838546:7027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:56.277026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:56.277462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:56.277473Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:56.277475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:56.277479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:56.277484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 780 [2:7559601041923626783:5644]
2025-10-10T14:32:56.277494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:56.277515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:56.277523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.277526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.277529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.277545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:56.277556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:56.277563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:56.277614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.277620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.277621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.277624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:56.277686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:56.277693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.277704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.277719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.277740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:56.277765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838468:2438], now have 1 active actors on pipe
2025-10-10T14:32:56.277776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601041923626778:5644]
2025-10-10T14:32:56.277783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601041923626778:5644]
2025-10-10T14:32:56.277786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601041923626778:5644]
2025-10-10T14:32:56.277769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 780
2025-10-10T14:32:56.277794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:56.277806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:56.277811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:56.277816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:56.277818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:56.277825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:56.277833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:56.277858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601041923626778:5644]
2025-10-10T14:32:56.277869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:56.277893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:56.282239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601042705838546:7027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:56.282255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601042705838546:7027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:56.282259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601042705838546:7027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:56.282267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:56.282520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838581:7027], now have 1 active actors on pipe
2025-10-10T14:32:56.282553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 780
2025-10-10T14:32:56.282619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.282631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.282664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9fea668-f4290fba-9e803e7e-7d064658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:56.282682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.282692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.282694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:56.282708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.282728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:56.282750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.282897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.282906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.282923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.283007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 781 partition: 0 MaxSeqNo: 40 sessionId: src_id|d9fea668-f4290fba-9e803e7e-7d064658_0
2025-10-10T14:32:56.283350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc254e6e-39d3ef53-2c9fb161-592f4e94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d9fea668-f4290fba-9e803e7e-7d064658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:56.285963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fea668-f4290fba-9e803e7e-7d064658_0] Write session: try to update token
2025-10-10T14:32:56.285982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fea668-f4290fba-9e803e7e-7d064658_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:56.296497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:56.296518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:56.296521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:56.296522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:56.296531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601041923626778:5644]
2025-10-10T14:32:56.296534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601041923626778:5644]
2025-10-10T14:32:56.296537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601041923626778:5644]
2025-10-10T14:32:56.296580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:56.296585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.296587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:56.296594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:56.296602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:56.296610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:56.296717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:56.299536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId: src_id|d9fea668-f4290fba-9e803e7e-7d064658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:56.302173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:56.362723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601042705838585:6574]
2025-10-10T14:32:56.363003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 780, pipe: [1:7559601042705838585:6574]
2025-10-10T14:32:56.399698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:56.399942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.399955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.400001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838585:6574], now have 1 active actors on pipe
2025-10-10T14:32:56.400165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:56.400203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601042705838585:6574]
2025-10-10T14:32:56.400221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:56.400241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:56.400329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 781 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9fea668-f4290fba-9e803e7e-7d064658_0
2025-10-10T14:32:56.400537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 781 sessionId: src_id|d9fea668-f4290fba-9e803e7e-7d064658_0 is DEAD
2025-10-10T14:32:56.400681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fea668-f4290fba-9e803e7e-7d064658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:56.400698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fea668-f4290fba-9e803e7e-7d064658_0] Write session will restart in 0.007163s
2025-10-10T14:32:56.400726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fea668-f4290fba-9e803e7e-7d064658_0] Write session: Do CDS request
2025-10-10T14:32:56.400731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fea668-f4290fba-9e803e7e-7d064658_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:56.408809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fea668-f4290fba-9e803e7e-7d064658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.408943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:56.408956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 782
2025-10-10T14:32:56.409055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.409087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:56.409097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:56.409101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:56.409096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:56.409537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 782 sessionId:  describe result for acl check
2025-10-10T14:32:56.409577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:56.409584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:56.409586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:56.409592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601042705838659:7031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:56.410137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601042705838659:7031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:56.410560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:56.410731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:56.410742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:56.410754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:56.410804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:56.410842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601041923626895:5646]
2025-10-10T14:32:56.411444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:56.411689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:56.411730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:56.412041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:56.412097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.412103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.412104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.412105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.412107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.412108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.412109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.412110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.412111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.412112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.412113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.412114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.412115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.412122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.412134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.412138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.412142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.412146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.412151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.412155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.412158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.412165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.412169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.412177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.412181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.412185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.412196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.412204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.412173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601042705838659:7031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:56.412211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.412221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.412229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.412234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.412243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.412249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.412258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.412263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.412268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.412275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.412280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.412287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.412291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.412297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.412302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.412308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.412313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.412323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.412329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.412338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.412342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.412352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.412360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.412367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.412407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:56.414506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:56.414543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601042705838659:7031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:56.414557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601042705838659:7031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:56.414561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601042705838659:7031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:56.414570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:56.414809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:56.414822Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:56.414825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:56.414829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:56.414834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 781 [2:7559601041923626895:5646]
2025-10-10T14:32:56.414845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:56.414863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:56.414865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.414870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.414872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.414889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:56.414902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:56.414911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:56.414959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.414965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.414967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.414970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:56.415033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:56.415041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.415063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.415088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.415110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:56.415137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838586:2438], now have 1 active actors on pipe
2025-10-10T14:32:56.415145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838693:7031], now have 1 active actors on pipe
2025-10-10T14:32:56.415151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601041923626890:5646]
2025-10-10T14:32:56.415154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601041923626890:5646]
2025-10-10T14:32:56.415156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601041923626890:5646]
2025-10-10T14:32:56.415168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:56.415182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:56.415187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:56.415190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:56.415158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 781
2025-10-10T14:32:56.415191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:56.415166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 781
2025-10-10T14:32:56.415203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:56.415206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:56.415242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.415247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.415260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601041923626890:5646]
2025-10-10T14:32:56.415273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:56.415302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:56.415306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2575621a-9bfba630-601ca60e-e5b7a945_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:56.415315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.415319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.415321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:56.415331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.415344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:56.415365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.415538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.415544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.415556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.415677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 782 partition: 0 MaxSeqNo: 40 sessionId: src_id|2575621a-9bfba630-601ca60e-e5b7a945_0
2025-10-10T14:32:56.416013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9fea668-f4290fba-9e803e7e-7d064658_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2575621a-9bfba630-601ca60e-e5b7a945_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:56.418618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2575621a-9bfba630-601ca60e-e5b7a945_0] Write session: try to update token
2025-10-10T14:32:56.418634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2575621a-9bfba630-601ca60e-e5b7a945_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:56.432306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId: src_id|2575621a-9bfba630-601ca60e-e5b7a945_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:56.433175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:56.433194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:56.433198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:56.433200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:56.433208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601041923626890:5646]
2025-10-10T14:32:56.433213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601041923626890:5646]
2025-10-10T14:32:56.433216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601041923626890:5646]
2025-10-10T14:32:56.433265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:56.433269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:56.433276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:56.433277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.433279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:56.433279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:56.433501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:56.435000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:56.500403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601042705838701:6574]
2025-10-10T14:32:56.500671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 781, pipe: [1:7559601042705838701:6574]
2025-10-10T14:32:56.538487Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:56.538842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.538862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.538906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838701:6574], now have 1 active actors on pipe
2025-10-10T14:32:56.539166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:56.539175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601042705838701:6574]
2025-10-10T14:32:56.539204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:56.539207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:56.539280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:56.539274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 782 reason: error at write: Disconnected sessionId: src_id|2575621a-9bfba630-601ca60e-e5b7a945_0
2025-10-10T14:32:56.539509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 782 sessionId: src_id|2575621a-9bfba630-601ca60e-e5b7a945_0 is DEAD
2025-10-10T14:32:56.539645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2575621a-9bfba630-601ca60e-e5b7a945_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:56.539657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2575621a-9bfba630-601ca60e-e5b7a945_0] Write session will restart in 0.009754s
2025-10-10T14:32:56.539682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2575621a-9bfba630-601ca60e-e5b7a945_0] Write session: Do CDS request
2025-10-10T14:32:56.539688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2575621a-9bfba630-601ca60e-e5b7a945_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:56.548127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:56.549585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:56.549740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:56.549752Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:56.549761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:56.549804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:56.549836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601041923627008:5648]
2025-10-10T14:32:56.550301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:56.550533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:56.550573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:56.550802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2575621a-9bfba630-601ca60e-e5b7a945_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.550874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:56.550917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.550924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.550919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:56.550934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 783
2025-10-10T14:32:56.550925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.550926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.550927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.550928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.550929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.550930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.550932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.550933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.550934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.550935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.550936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.550942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.550954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.550958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.550962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.550966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.550970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.550974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.550978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.550982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.550986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.550990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.550994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.550998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.551004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.551014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.551020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.551026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.551030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.551035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.551039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.551044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.551048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.551053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.551044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.551057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.551062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.551070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.551075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.551088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.551076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:56.551093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.551100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:56.551098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.551103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.551107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.551104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:56.551112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.551121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.551126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.551130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.551135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.551143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.551147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.551185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:56.551547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 783 sessionId:  describe result for acl check
2025-10-10T14:32:56.551582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:56.551588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:56.551590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:56.551597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601042705838781:7035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:56.552140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601042705838781:7035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:56.553278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:56.553698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:56.553709Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:56.553711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:56.553715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:56.553720Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 782 [2:7559601041923627008:5648]
2025-10-10T14:32:56.553732Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:56.553748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:56.553756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.553760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.553762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.553778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:56.553790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:56.553797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:56.553846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.553852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.553855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.553857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:56.553915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:56.553922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.553933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.553951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.553973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:56.553994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838702:2438], now have 1 active actors on pipe
2025-10-10T14:32:56.554002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601041923627003:5648]
2025-10-10T14:32:56.554009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601041923627003:5648]
2025-10-10T14:32:56.554002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 782
2025-10-10T14:32:56.554011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601041923627003:5648]
2025-10-10T14:32:56.554019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:56.554033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:56.554037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:56.554040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:56.554042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:56.554053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:56.554056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:56.554084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601041923627003:5648]
2025-10-10T14:32:56.554096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:56.554096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601042705838781:7035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:56.554106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:56.559464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601042705838781:7035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:56.559478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601042705838781:7035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:56.559482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601042705838781:7035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:56.559490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:56.559881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838817:7035], now have 1 active actors on pipe
2025-10-10T14:32:56.559930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 782
2025-10-10T14:32:56.560001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.560011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.560043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:56.560058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.560068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.560071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:56.560084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.560101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:56.560124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.560321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.560331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.560349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.560461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 783 partition: 0 MaxSeqNo: 40 sessionId: src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0
2025-10-10T14:32:56.560834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2575621a-9bfba630-601ca60e-e5b7a945_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:56.563366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0] Write session: try to update token
2025-10-10T14:32:56.563383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:56.571817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:56.571840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:56.571843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:56.571845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:56.571855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601041923627003:5648]
2025-10-10T14:32:56.571862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601041923627003:5648]
2025-10-10T14:32:56.571866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601041923627003:5648]
2025-10-10T14:32:56.571916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:56.571911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:56.571929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.571932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:56.571933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:56.571936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:56.572110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:56.576566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId: src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:56.579030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:56.639217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601042705838851:6574]
2025-10-10T14:32:56.639487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 782, pipe: [1:7559601042705838851:6574]
2025-10-10T14:32:56.681719Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:56.681942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.681955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.681994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838851:6574], now have 1 active actors on pipe
2025-10-10T14:32:56.682165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:56.682227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:56.682245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:56.682254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601042705838851:6574]
2025-10-10T14:32:56.682275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:56.682327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 783 reason: error at write: Disconnected sessionId: src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0
2025-10-10T14:32:56.682548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 783 sessionId: src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0 is DEAD
2025-10-10T14:32:56.682701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:56.682712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0] Write session will restart in 0.007761s
2025-10-10T14:32:56.682737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0] Write session: Do CDS request
2025-10-10T14:32:56.682743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:56.690894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:56.691801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.691964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:56.691979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 784
2025-10-10T14:32:56.692133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.692169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:56.692182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:56.692189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:56.692545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:56.692647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 784 sessionId:  describe result for acl check
2025-10-10T14:32:56.692680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:56.692684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:56.692685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:56.692693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601042705838928:7050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:56.692705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:56.692717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:56.692728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:56.692783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:56.692825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601041923627162:5664]
2025-10-10T14:32:56.693244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601042705838928:7050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:56.693413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:56.693655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:56.693695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:56.693996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:56.694046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.694052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.694054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.694055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.694056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.694057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.694058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.694059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.694061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.694062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.694063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.694064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.694065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.694071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.694082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.694086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.694090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.694094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.694098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.694102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.694106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.694109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.694114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.694118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.694121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.694125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.694132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.694140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.694147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.694157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.694162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.694171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.694179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.694188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.694196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.694201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.694206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.694215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.694224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.694234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.694242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.694247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.694256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.694262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.694270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.694275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.694282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.694287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.694295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.694299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.694307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.694314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.694357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:56.695287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601042705838928:7050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:56.696331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:56.696652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:56.696666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:56.696668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:56.696671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:56.696677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 783 [2:7559601041923627162:5664]
2025-10-10T14:32:56.696688Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:56.696701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:56.696704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.696707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.696709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.696723Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:56.696734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:56.696742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:56.696792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.696799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.696801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.696803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:56.696860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:56.696868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.696878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.696888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.696904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:56.696926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838853:2438], now have 1 active actors on pipe
2025-10-10T14:32:56.696937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601041923627157:5664]
2025-10-10T14:32:56.696941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601041923627157:5664]
2025-10-10T14:32:56.696943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601041923627157:5664]
2025-10-10T14:32:56.696955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:56.696967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:56.696973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:56.696976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:56.696978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:56.696987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:56.696994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:56.696988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 783
2025-10-10T14:32:56.697012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601041923627157:5664]
2025-10-10T14:32:56.697019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:56.697021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:56.697503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601042705838928:7050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:56.697514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601042705838928:7050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:56.697517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601042705838928:7050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:56.697532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:56.697708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838964:7050], now have 1 active actors on pipe
2025-10-10T14:32:56.697764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 783
2025-10-10T14:32:56.697812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.697822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.697849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d006b99-374a4882-66aafe66-b6a9a47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:56.697861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.697867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.697869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:56.697879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.697895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:56.697911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.698079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.698087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.698104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.698180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 784 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d006b99-374a4882-66aafe66-b6a9a47_0
2025-10-10T14:32:56.698474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77af67e5-6fe84111-d856e304-d41e0ecf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d006b99-374a4882-66aafe66-b6a9a47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:56.701040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006b99-374a4882-66aafe66-b6a9a47_0] Write session: try to update token
2025-10-10T14:32:56.701056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006b99-374a4882-66aafe66-b6a9a47_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:56.714518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:56.714538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:56.714542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:56.714544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:56.714557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601041923627157:5664]
2025-10-10T14:32:56.714561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601041923627157:5664]
2025-10-10T14:32:56.714564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601041923627157:5664]
2025-10-10T14:32:56.714612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:56.714616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:56.714622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:56.714624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.714625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:56.714626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:56.714749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:56.714879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId: src_id|5d006b99-374a4882-66aafe66-b6a9a47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:56.717528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:56.782706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601042705838969:6574]
2025-10-10T14:32:56.782938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 783, pipe: [1:7559601042705838969:6574]
2025-10-10T14:32:56.818534Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:56.818876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.818889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.818925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838969:6574], now have 1 active actors on pipe
2025-10-10T14:32:56.819073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:56.819086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:56.819098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:56.819107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601042705838969:6574]
2025-10-10T14:32:56.819127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:56.819162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 784 reason: error at write: Disconnected sessionId: src_id|5d006b99-374a4882-66aafe66-b6a9a47_0
2025-10-10T14:32:56.819357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 784 sessionId: src_id|5d006b99-374a4882-66aafe66-b6a9a47_0 is DEAD
2025-10-10T14:32:56.819475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006b99-374a4882-66aafe66-b6a9a47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:56.819484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006b99-374a4882-66aafe66-b6a9a47_0] Write session will restart in 0.008644s
2025-10-10T14:32:56.819503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006b99-374a4882-66aafe66-b6a9a47_0] Write session: Do CDS request
2025-10-10T14:32:56.819510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006b99-374a4882-66aafe66-b6a9a47_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:56.828390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:56.828838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006b99-374a4882-66aafe66-b6a9a47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.828907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:56.828923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 785
2025-10-10T14:32:56.829055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.829098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:56.829108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:56.829112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:56.829552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 785 sessionId:  describe result for acl check
2025-10-10T14:32:56.829590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:56.829597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:56.829598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:56.829606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601042705839047:7054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:56.830134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:56.830160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601042705839047:7054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:56.830297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:56.830308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:56.830319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:56.830366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:56.830402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601041923627277:5666]
2025-10-10T14:32:56.830981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:56.831223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:56.831263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:56.831556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:56.831601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.831607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.831608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.831609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.831610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.831611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.831612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.831613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.831614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.831615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.831616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.831617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.831618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.831624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.831634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.831637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.831641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.831645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.831649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.831652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.831656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.831659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.831663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.831666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.831669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.831673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.831679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.831691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.831701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.831711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.831719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.831723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.831731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.831735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.831719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601042705839047:7054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:56.831744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.831748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.831752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.831756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.831761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.831765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.831770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.831777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.831782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.831786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.831794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.831799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.831807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.831816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.831821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.831831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.831835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.831839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.831878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:56.833890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601042705839047:7054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:56.833901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601042705839047:7054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:56.833904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601042705839047:7054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:56.833917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:56.834046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:56.834474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:56.834490Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:56.834492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:56.834495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:56.834502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 784 [2:7559601041923627277:5666]
2025-10-10T14:32:56.834513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:56.834530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:56.834538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.834541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.834543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.834561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:56.834573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:56.834580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:56.834636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.834643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.834645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.834647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:56.834709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:56.834721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.834737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.834747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.834764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:56.834789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705839081:7054], now have 1 active actors on pipe
2025-10-10T14:32:56.834798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705838971:2438], now have 1 active actors on pipe
2025-10-10T14:32:56.834804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601041923627272:5666]
2025-10-10T14:32:56.834806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601041923627272:5666]
2025-10-10T14:32:56.834808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601041923627272:5666]
2025-10-10T14:32:56.834821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:56.834827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 784
2025-10-10T14:32:56.834833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 784
2025-10-10T14:32:56.834838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:56.834842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:56.834845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:56.834847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:56.834854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:56.834857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:56.834879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601041923627272:5666]
2025-10-10T14:32:56.834882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:56.834884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:56.834914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.834920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.834951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34780cc0-ac19da0f-1f823497-931059e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:56.834965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.834973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.834975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:56.834985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.834995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:56.835015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.835217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.835227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.835244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.835341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 785 partition: 0 MaxSeqNo: 40 sessionId: src_id|34780cc0-ac19da0f-1f823497-931059e5_0
2025-10-10T14:32:56.835670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d006b99-374a4882-66aafe66-b6a9a47_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34780cc0-ac19da0f-1f823497-931059e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:56.838208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34780cc0-ac19da0f-1f823497-931059e5_0] Write session: try to update token
2025-10-10T14:32:56.838225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34780cc0-ac19da0f-1f823497-931059e5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:56.851320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId: src_id|34780cc0-ac19da0f-1f823497-931059e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:56.853233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:56.853251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:56.853254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:56.853257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:56.853266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601041923627272:5666]
2025-10-10T14:32:56.853271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601041923627272:5666]
2025-10-10T14:32:56.853275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601041923627272:5666]
2025-10-10T14:32:56.853324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:56.853343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:56.853350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:56.853354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:56.853356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.853358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:56.853480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:56.853988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:56.919254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601042705839088:6574]
2025-10-10T14:32:56.919532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 784, pipe: [1:7559601042705839088:6574]
2025-10-10T14:32:56.960737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:56.961001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.961014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.961056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705839088:6574], now have 1 active actors on pipe
2025-10-10T14:32:56.961221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:56.961278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:56.961299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601042705839088:6574]
2025-10-10T14:32:56.961302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:56.961318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:56.961376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 785 reason: error at write: Disconnected sessionId: src_id|34780cc0-ac19da0f-1f823497-931059e5_0
2025-10-10T14:32:56.961591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 785 sessionId: src_id|34780cc0-ac19da0f-1f823497-931059e5_0 is DEAD
2025-10-10T14:32:56.961748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34780cc0-ac19da0f-1f823497-931059e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:56.961761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34780cc0-ac19da0f-1f823497-931059e5_0] Write session will restart in 0.008854s
2025-10-10T14:32:56.961786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34780cc0-ac19da0f-1f823497-931059e5_0] Write session: Do CDS request
2025-10-10T14:32:56.961792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34780cc0-ac19da0f-1f823497-931059e5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:56.971766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:56.971946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34780cc0-ac19da0f-1f823497-931059e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.972138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:56.972155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 786
2025-10-10T14:32:56.972288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:56.972323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:56.972333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:56.972337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:56.972692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 786 sessionId:  describe result for acl check
2025-10-10T14:32:56.972724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:56.972726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:56.972728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:56.972732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601042705839166:7058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:56.973192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601042705839166:7058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:56.973460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:56.973626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:56.973636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:56.973647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:56.973701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:56.973738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601041923627393:5668]
2025-10-10T14:32:56.974315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:56.974629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:56.974670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:56.974972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:56.975025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.975031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.975032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.975033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.975034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.975035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.975037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.975038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.975039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.975040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.975041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.975042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.975044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.975049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.975060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.975064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.975068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.975072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.975076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.975080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.975091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.975094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.975098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.975101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.975105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.975108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.975116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.975124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:56.975130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.975135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:56.975139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.975142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:56.975146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.975154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:56.975158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.975167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:56.975172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.975176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:56.975185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.975189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:56.975193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.975198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:56.975202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.975206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:56.975210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.975214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:56.975218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.975223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.975229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.975233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.975237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.975242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.975258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601042705839166:7058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:56.975278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:56.977520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:56.977621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601042705839166:7058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:56.977634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601042705839166:7058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:56.977636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601042705839166:7058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:56.977643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:56.977840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:56.977854Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:56.977856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:56.977860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:56.977865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 785 [2:7559601041923627393:5668]
2025-10-10T14:32:56.977877Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:56.977894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:56.977901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.977905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.977907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.977921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:56.977930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:56.977936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:56.977978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.977983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.977985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.977987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:56.978035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:56.978041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.978048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:56.978058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:56.978071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:56.978090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705839089:2438], now have 1 active actors on pipe
2025-10-10T14:32:56.978096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601042705839201:7058], now have 1 active actors on pipe
2025-10-10T14:32:56.978101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601041923627387:5668]
2025-10-10T14:32:56.978103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601041923627387:5668]
2025-10-10T14:32:56.978104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601041923627387:5668]
2025-10-10T14:32:56.978113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:56.978127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:56.978127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:56.978130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:56.978132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:56.978141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:56.978143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:56.978162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601041923627387:5668]
2025-10-10T14:32:56.978165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:56.978168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:56.978145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 785
2025-10-10T14:32:56.978149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 785
2025-10-10T14:32:56.978188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.978198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.978251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:56.978261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:56.978264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:56.978266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:56.978275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:56.978284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:56.978302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.978474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:56.978481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:56.978492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:56.978590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 786 partition: 0 MaxSeqNo: 40 sessionId: src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0
2025-10-10T14:32:56.978916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34780cc0-ac19da0f-1f823497-931059e5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:56.981519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0] Write session: try to update token
2025-10-10T14:32:56.981535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:56.995601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId: src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:56.996906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:56.996937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:56.996941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:56.996943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:56.996954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601041923627387:5668]
2025-10-10T14:32:56.996961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601041923627387:5668]
2025-10-10T14:32:56.996966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601041923627387:5668]
2025-10-10T14:32:56.997010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:56.997023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:56.997024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:56.997026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:56.997036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:56.997039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:56.997280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:56.998694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:57.061586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601047000806504:6574]
2025-10-10T14:32:57.061821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 785, pipe: [1:7559601047000806504:6574]
2025-10-10T14:32:57.100159Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:57.100391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.100403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.100440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806504:6574], now have 1 active actors on pipe
2025-10-10T14:32:57.100659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:57.100662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601047000806504:6574]
2025-10-10T14:32:57.100673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:57.100684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:57.100734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 786 reason: error at write: Disconnected sessionId: src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0
2025-10-10T14:32:57.100919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 786 sessionId: src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0 is DEAD
2025-10-10T14:32:57.101084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:57.101097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0] Write session will restart in 0.007132s
2025-10-10T14:32:57.101124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0] Write session: Do CDS request
2025-10-10T14:32:57.101131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:57.101205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:57.109867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.109985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:57.110001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 787
2025-10-10T14:32:57.110132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.110167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:57.110177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:57.110180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:57.110454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:57.110579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 787 sessionId:  describe result for acl check
2025-10-10T14:32:57.110614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:57.110622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:57.110624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:57.110630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601047000806582:7062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:57.111165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601047000806582:7062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:57.112463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:57.112636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:57.112644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:57.112656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:57.112709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:57.112748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601046218594805:5670]
2025-10-10T14:32:57.112834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601047000806582:7062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:57.113351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:57.113604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:57.113646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:57.113888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:57.113927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.113932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.113933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.113934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.113934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.113935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.113935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.113936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.113937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.113937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.113938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.113939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.113939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.113943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.113950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.113952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.113955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.113957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.113959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.113961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.113964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.113966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.113969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.113971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.113973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.113975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.113980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.113985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.113990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.113994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.113996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.113999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.114002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.114005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.114007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.114010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.114013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.114016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.114019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.114022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.114025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.114028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.114031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.114035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.114039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.114044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.114049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.114053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.114057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.114061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.114069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.114074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.114096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:57.116055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601047000806582:7062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:57.116071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601047000806582:7062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:57.116074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601047000806582:7062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:57.116080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:57.116222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:57.116617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:57.116631Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:57.116633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:57.116637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:57.116642Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 786 [2:7559601046218594805:5670]
2025-10-10T14:32:57.116656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:57.116676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:57.116685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.116688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.116690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.116706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:57.116721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:57.116728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:57.116777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.116784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.116786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.116788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:57.116844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:57.116853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.116864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.116876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.116897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:57.116921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806505:2438], now have 1 active actors on pipe
2025-10-10T14:32:57.116928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806617:7062], now have 1 active actors on pipe
2025-10-10T14:32:57.116935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601046218594799:5670]
2025-10-10T14:32:57.116938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601046218594799:5670]
2025-10-10T14:32:57.116925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 786
2025-10-10T14:32:57.116940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601046218594799:5670]
2025-10-10T14:32:57.116948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:57.116950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 786
2025-10-10T14:32:57.116961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:57.116966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:57.116971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:57.116973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:57.116981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:57.116985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:57.117004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.117012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.117043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601046218594799:5670]
2025-10-10T14:32:57.117055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:57.117064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:57.117073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|462e1596-474988c1-92b16eee-b1d3d77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:57.117079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.117087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.117089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:57.117100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.117113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:57.117146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.117277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.117286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.117301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.117405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 787 partition: 0 MaxSeqNo: 40 sessionId: src_id|462e1596-474988c1-92b16eee-b1d3d77_0
2025-10-10T14:32:57.117733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c559b6a-14cfaf69-e1013e70-9caf7537_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|462e1596-474988c1-92b16eee-b1d3d77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:57.120269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462e1596-474988c1-92b16eee-b1d3d77_0] Write session: try to update token
2025-10-10T14:32:57.120287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462e1596-474988c1-92b16eee-b1d3d77_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:57.133345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId: src_id|462e1596-474988c1-92b16eee-b1d3d77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:57.134623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:57.134643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.134649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:57.134651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:57.134660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601046218594799:5670]
2025-10-10T14:32:57.134664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601046218594799:5670]
2025-10-10T14:32:57.134667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601046218594799:5670]
2025-10-10T14:32:57.134712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:57.134717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:57.134724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.134724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:57.134726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:57.134727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:57.134863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:57.135998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:57.200833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601047000806625:6574]
2025-10-10T14:32:57.201100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 786, pipe: [1:7559601047000806625:6574]
2025-10-10T14:32:57.236346Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:57.236605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.236618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.236654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806625:6574], now have 1 active actors on pipe
2025-10-10T14:32:57.236837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:57.236880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601047000806625:6574]
2025-10-10T14:32:57.236886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:57.236917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:57.236987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 787 reason: status is not ok: tablet will be restarted right now sessionId: src_id|462e1596-474988c1-92b16eee-b1d3d77_0
2025-10-10T14:32:57.237192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 787 sessionId: src_id|462e1596-474988c1-92b16eee-b1d3d77_0 is DEAD
2025-10-10T14:32:57.237314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462e1596-474988c1-92b16eee-b1d3d77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:57.237340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462e1596-474988c1-92b16eee-b1d3d77_0] Write session will restart in 0.008646s
2025-10-10T14:32:57.237368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462e1596-474988c1-92b16eee-b1d3d77_0] Write session: Do CDS request
2025-10-10T14:32:57.237374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462e1596-474988c1-92b16eee-b1d3d77_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:57.246559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:57.246932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462e1596-474988c1-92b16eee-b1d3d77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.246942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:57.246956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 788
2025-10-10T14:32:57.247187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.247224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:57.247231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:57.247234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:57.247639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 788 sessionId:  describe result for acl check
2025-10-10T14:32:57.247670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:57.247673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:57.247674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:57.247679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601047000806704:7066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:57.248155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601047000806704:7066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:57.248295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:57.248467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:57.248477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:57.248489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:57.248545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:57.248584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601046218594925:5672]
2025-10-10T14:32:57.249175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:57.249484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:57.249538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:57.249625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601047000806704:7066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:57.249787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:57.249849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.249855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.249857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.249858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.249860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.249861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.249863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.249864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.249865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.249866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.249867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.249869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.249870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.249876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.249888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.249893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.249897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.249902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.249906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.249911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.249915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.249921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.249925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.249930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.249934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.249938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.249945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.249954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.249966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.249977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.249986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.249991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.249995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.250001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.250008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.250017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.250022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.250031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.250037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.250046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.250050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.250061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.250066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.250074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.250083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.250089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.250096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.250102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.250110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.250116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.250122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.250128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.250175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:57.252153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601047000806704:7066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:57.252165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601047000806704:7066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:57.252167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601047000806704:7066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:57.252173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:57.252302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:57.252843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:57.252855Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:57.252858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:57.252861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:57.252866Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 787 [2:7559601046218594925:5672]
2025-10-10T14:32:57.252878Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:57.252894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:57.252898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.252901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.252904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.252922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:57.252935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:57.252941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:57.252994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.253001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.253003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.253005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:57.253068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:57.253075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.253086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.253099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.253119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:57.253145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806626:2438], now have 1 active actors on pipe
2025-10-10T14:32:57.253157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601046218594917:5672]
2025-10-10T14:32:57.253160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601046218594917:5672]
2025-10-10T14:32:57.253162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601046218594917:5672]
2025-10-10T14:32:57.253170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:57.253182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806751:7066], now have 1 active actors on pipe
2025-10-10T14:32:57.253185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:57.253188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:57.253190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:57.253194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:57.253164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 787
2025-10-10T14:32:57.253209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:57.253192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 787
2025-10-10T14:32:57.253216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:57.253253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.253262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.253276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601046218594917:5672]
2025-10-10T14:32:57.253288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:57.253304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:57.253323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:57.253350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.253354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.253356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:57.253368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.253381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:57.253400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.253571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.253581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.253598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.253664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 788 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0
2025-10-10T14:32:57.253963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462e1596-474988c1-92b16eee-b1d3d77_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:57.256456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0] Write session: try to update token
2025-10-10T14:32:57.256470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:57.269078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId: src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:57.271189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:57.271205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.271208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:57.271210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:57.271220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601046218594917:5672]
2025-10-10T14:32:57.271223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601046218594917:5672]
2025-10-10T14:32:57.271226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601046218594917:5672]
2025-10-10T14:32:57.271263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:57.271269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:57.271272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:57.271275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:57.271282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.271284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:57.271435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:57.271714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:57.337017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601047000806759:6574]
2025-10-10T14:32:57.337268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 787, pipe: [1:7559601047000806759:6574]
2025-10-10T14:32:57.374950Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:57.375178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.375191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.375227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806759:6574], now have 1 active actors on pipe
2025-10-10T14:32:57.375430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:57.375482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:57.375497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:57.375501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601047000806759:6574]
2025-10-10T14:32:57.375518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:57.375559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 788 reason: error at write: Disconnected sessionId: src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0
2025-10-10T14:32:57.375752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 788 sessionId: src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0 is DEAD
2025-10-10T14:32:57.375893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:57.375901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0] Write session will restart in 0.009616s
2025-10-10T14:32:57.375926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0] Write session: Do CDS request
2025-10-10T14:32:57.375930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:57.385190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:57.386779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.386859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:57.386873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 789
2025-10-10T14:32:57.386999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.386997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:57.387024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:57.387031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:57.387034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:57.387181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:57.387192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:57.387203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:57.387249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:57.387288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601046218595053:5675]
2025-10-10T14:32:57.387380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 789 sessionId:  describe result for acl check
2025-10-10T14:32:57.387404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:57.387405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:57.387406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:57.387410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601047000806841:7071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:57.387812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601047000806841:7071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:57.387900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:57.388156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:57.388201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:57.388512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:57.388563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.388571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.388572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.388573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.388574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.388575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.388577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.388578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.388579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.388580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.388581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.388582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.388583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.388589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.388600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.388604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.388608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.388613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.388616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.388619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.388623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.388626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.388629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.388633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.388637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.388641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.388648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.388656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.388662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.388668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.388673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.388678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.388682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.388688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.388692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.388697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.388707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.388713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.388718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.388723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.388728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.388733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.388743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.388748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.388757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.388763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.388769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.388778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.388783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.388792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.388797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.388802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.388852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:57.389465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601047000806841:7071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:57.390853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:57.391244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:57.391255Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:57.391257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:57.391261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:57.391267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 788 [2:7559601046218595053:5675]
2025-10-10T14:32:57.391278Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:57.391294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:57.391297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.391300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.391302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.391318Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:57.391328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:57.391336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:57.391383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.391391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.391393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.391395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:57.391456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:57.391464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.391476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.391489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.391510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:57.391536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806760:2438], now have 1 active actors on pipe
2025-10-10T14:32:57.391547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601046218595048:5675]
2025-10-10T14:32:57.391550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601046218595048:5675]
2025-10-10T14:32:57.391552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601046218595048:5675]
2025-10-10T14:32:57.391564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:57.391581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:57.391589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:57.391592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:57.391594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:57.391602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:57.391605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:57.391590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 788
2025-10-10T14:32:57.391625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601046218595048:5675]
2025-10-10T14:32:57.391636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:57.391647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:57.391871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601047000806841:7071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:57.391882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601047000806841:7071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:57.391885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601047000806841:7071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:57.391890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:57.392064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806876:7071], now have 1 active actors on pipe
2025-10-10T14:32:57.392109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 788
2025-10-10T14:32:57.392165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.392176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.392204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ca40953-66d46222-4403f805-64771ef3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:57.392213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.392221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.392224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:57.392235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.392250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:57.392266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.392441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.392450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.392465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.392550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 789 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ca40953-66d46222-4403f805-64771ef3_0
2025-10-10T14:32:57.392926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cadbe9a-e4d2b66-a80db051-43eff5d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ca40953-66d46222-4403f805-64771ef3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:57.395487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca40953-66d46222-4403f805-64771ef3_0] Write session: try to update token
2025-10-10T14:32:57.395504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca40953-66d46222-4403f805-64771ef3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:57.401941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:57.401963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.401974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601046218595048:5675]
2025-10-10T14:32:57.402022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:57.402023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:57.402193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:57.402325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:57.402453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:57.402587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:57.402761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:57.402800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:57.408717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId: src_id|2ca40953-66d46222-4403f805-64771ef3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:57.411205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:57.411407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.411429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.411467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:57.411567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:57.419249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:57.419269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.419273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:57.419275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:57.419285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601046218595048:5675]
2025-10-10T14:32:57.419289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601046218595048:5675]
2025-10-10T14:32:57.419296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601046218595048:5675]
2025-10-10T14:32:57.419341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:57.419347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:57.419353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.419355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:57.419355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:57.419360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:57.419485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:57.475793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601047000806881:6574]
2025-10-10T14:32:57.476060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 788, pipe: [1:7559601047000806881:6574]
2025-10-10T14:32:57.528320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:57.535067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.535100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.535246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.535300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.535361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.535417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.535627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.535636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.535706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.535804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.535863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.535919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.535961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.535966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.536025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.536109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.536194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.536249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.536358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.536363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.536419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.536473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.536526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.536596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.536635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.536641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.536697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.536749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.536812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.536866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.536904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.536909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.536977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.537042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.537096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.537157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.537209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.537214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.537273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.537324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.537390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.537445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.537485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.537490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.537545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.537595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.537646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.537719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.537770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.537777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.537846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.537896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.537959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.538009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.538047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.538052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.538105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:57.538156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:57.538210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:57.538274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:57.538318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:57.538324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:57.538362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806881:6574], now have 1 active actors on pipe
2025-10-10T14:32:57.538598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601047000806881:6574]
2025-10-10T14:32:57.538599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:57.538604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:57.538629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 789 reason: error at write: Disconnected sessionId: src_id|2ca40953-66d46222-4403f805-64771ef3_0
2025-10-10T14:32:57.538631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:57.538837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 789 sessionId: src_id|2ca40953-66d46222-4403f805-64771ef3_0 is DEAD
2025-10-10T14:32:57.538891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:57.538979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca40953-66d46222-4403f805-64771ef3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:57.538990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca40953-66d46222-4403f805-64771ef3_0] Write session will restart in 0.008478s
2025-10-10T14:32:57.539015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca40953-66d46222-4403f805-64771ef3_0] Write session: Do CDS request
2025-10-10T14:32:57.539022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca40953-66d46222-4403f805-64771ef3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:57.548853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca40953-66d46222-4403f805-64771ef3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.548932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:57.548948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 790
2025-10-10T14:32:57.549112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.549149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:57.549161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:57.549165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:57.549655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 790 sessionId:  describe result for acl check
2025-10-10T14:32:57.549696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:57.549704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:57.549706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:57.549712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601047000806963:7075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:57.550018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:57.550272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601047000806963:7075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:57.551635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:57.551811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:57.551823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:57.551834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:57.551889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:57.551929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601046218595174:5677]
2025-10-10T14:32:57.552522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:57.552793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:57.552833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:57.553055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601047000806963:7075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:57.553141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:57.553194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.553200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.553201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.553202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.553204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.553205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.553206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.553207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.553209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.553210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.553211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.553212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.553214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.553219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.553232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.553236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.553240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.553244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.553248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.553252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.553261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.553265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.553273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.553277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.553286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.553290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.553300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.553313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.553325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.553353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.553357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.553363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.553367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.553372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.553377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.553382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.553386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.553391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.553396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.553401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.553405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.553411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.553415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.553421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.553426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.553431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.553435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.553440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.553444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.553454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.553460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.553465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.553506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:57.555658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:57.555685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601047000806963:7075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:57.555696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601047000806963:7075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:57.555699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601047000806963:7075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:57.555706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:57.555989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:57.556003Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:57.556005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:57.556008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:57.556014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 789 [2:7559601046218595174:5677]
2025-10-10T14:32:57.556026Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:57.556042Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:57.556046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.556050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.556052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.556067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:57.556079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:57.556086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:57.556144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.556151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.556153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.556156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:57.556226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:57.556235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.556246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.556259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.556281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:57.556307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806998:7075], now have 1 active actors on pipe
2025-10-10T14:32:57.556315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000806883:2438], now have 1 active actors on pipe
2025-10-10T14:32:57.556323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601046218595168:5677]
2025-10-10T14:32:57.556325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601046218595168:5677]
2025-10-10T14:32:57.556327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601046218595168:5677]
2025-10-10T14:32:57.556319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 789
2025-10-10T14:32:57.556323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 789
2025-10-10T14:32:57.556343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:57.556348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:57.556351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:57.556353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:57.556361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:57.556379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:57.556382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:57.556426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.556435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.556450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601046218595168:5677]
2025-10-10T14:32:57.556463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:57.556480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:57.556498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:57.556510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.556514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.556520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:57.556531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.556543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:57.556568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.556759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.556768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.556784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.556879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 790 partition: 0 MaxSeqNo: 40 sessionId: src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0
2025-10-10T14:32:57.557243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ca40953-66d46222-4403f805-64771ef3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:57.559890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0] Write session: try to update token
2025-10-10T14:32:57.559912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:57.574062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId: src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:57.574515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:57.574533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.574539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:57.574540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:57.574549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601046218595168:5677]
2025-10-10T14:32:57.574551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601046218595168:5677]
2025-10-10T14:32:57.574553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601046218595168:5677]
2025-10-10T14:32:57.574591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:57.574597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.574599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:57.574718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:57.574735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:57.574739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:57.574744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:57.576625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:57.638572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601047000807028:6574]
2025-10-10T14:32:57.638804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 789, pipe: [1:7559601047000807028:6574]
2025-10-10T14:32:57.677417Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:57.677694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.677707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.677746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807028:6574], now have 1 active actors on pipe
2025-10-10T14:32:57.677903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:57.677998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:57.678007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:57.678068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601047000807028:6574]
2025-10-10T14:32:57.678082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 790 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0
2025-10-10T14:32:57.678285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 790 sessionId: src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0 is DEAD
2025-10-10T14:32:57.678437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:57.678449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0] Write session will restart in 0.006255s
2025-10-10T14:32:57.678473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0] Write session: Do CDS request
2025-10-10T14:32:57.678479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:57.685759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.685847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:57.685861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 791
2025-10-10T14:32:57.686008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.686054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:57.686065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:57.686069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:57.686538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 791 sessionId:  describe result for acl check
2025-10-10T14:32:57.686572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:57.686578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:57.686580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:57.686586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601047000807120:7090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:57.687135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601047000807120:7090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:57.687519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:57.689480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:57.689665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:57.689677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:57.689670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601047000807120:7090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:57.689688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:57.689747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:57.689787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601046218595334:5693]
2025-10-10T14:32:57.690374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:57.690609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:57.690651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:57.690963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:57.691019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.691026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.691027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.691028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.691030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.691031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.691032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.691033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.691034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.691035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.691037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.691038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.691039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.691044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.691057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.691061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.691065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.691069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.691073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.691077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.691081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.691085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.691098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.691102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.691106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.691110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.691117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.691125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.691131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.691137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.691141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.691147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.691151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.691156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.691161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.691167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.691172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.691178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.691188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.691193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.691202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.691207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.691216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.691226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.691230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.691239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.691248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.691259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.691268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.691277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.691286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.691296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.691339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:57.691861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601047000807120:7090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:57.691875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601047000807120:7090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:57.691878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601047000807120:7090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:57.691885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:57.693384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:57.693753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:57.693762Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:57.693763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:57.693766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:57.693770Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 790 [2:7559601046218595334:5693]
2025-10-10T14:32:57.693778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:57.693791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:57.693795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.693798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.693799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.693820Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:57.693829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:57.693839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:57.693881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.693885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.693886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.693889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:57.693935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:57.693940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.693948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.693954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.693963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:57.693982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807041:2438], now have 1 active actors on pipe
2025-10-10T14:32:57.693988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807156:7090], now have 1 active actors on pipe
2025-10-10T14:32:57.694005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601046218595329:5693]
2025-10-10T14:32:57.694012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601046218595329:5693]
2025-10-10T14:32:57.694014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601046218595329:5693]
2025-10-10T14:32:57.694009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 790
2025-10-10T14:32:57.694030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 790
2025-10-10T14:32:57.694028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:57.694046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:57.694047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:57.694050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:57.694052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:57.694061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:57.694064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:57.694093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.694100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.694110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601046218595329:5693]
2025-10-10T14:32:57.694115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:57.694133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:57.694138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:57.694145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.694147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.694148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:57.694156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.694165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:57.694180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.694280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.694288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.694299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.694356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 791 partition: 0 MaxSeqNo: 40 sessionId: src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0
2025-10-10T14:32:57.694643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d618d6f-8828e88f-b224de0a-af4de7c5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:57.697206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0] Write session: try to update token
2025-10-10T14:32:57.697221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:57.710816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId: src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:57.712061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:57.712079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.712081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:57.712082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:57.712093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601046218595329:5693]
2025-10-10T14:32:57.712096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601046218595329:5693]
2025-10-10T14:32:57.712098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601046218595329:5693]
2025-10-10T14:32:57.712136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:57.712142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.712143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:57.712148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:57.712154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:57.712158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:57.712275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:57.713432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:57.778391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601047000807164:6574]
2025-10-10T14:32:57.778717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 790, pipe: [1:7559601047000807164:6574]
2025-10-10T14:32:57.814464Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:57.814775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.814788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.814825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807164:6574], now have 1 active actors on pipe
2025-10-10T14:32:57.814986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:57.815075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:57.815169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601047000807164:6574]
2025-10-10T14:32:57.815178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 791 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0
2025-10-10T14:32:57.815202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:57.815392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 791 sessionId: src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0 is DEAD
2025-10-10T14:32:57.815592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:57.815604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0] Write session will restart in 0.008059s
2025-10-10T14:32:57.815629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0] Write session: Do CDS request
2025-10-10T14:32:57.815636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:57.824844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.824896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:57.824911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 792
2025-10-10T14:32:57.825082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.825119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:57.825128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:57.825132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:57.825580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 792 sessionId:  describe result for acl check
2025-10-10T14:32:57.825616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:57.825625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:57.825626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:57.825633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601047000807247:7094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:57.826119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:57.826164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601047000807247:7094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:57.828113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:57.828298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:57.828310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:57.828321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:57.828370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:57.828411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601046218595457:5695]
2025-10-10T14:32:57.828608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601047000807247:7094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:57.829038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:57.829308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:57.829360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:57.829675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:57.829725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.829731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.829732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.829734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.829735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.829736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.829737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.829739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.829740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.829741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.829742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.829743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.829744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.829749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.829761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.829765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.829770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.829773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.829778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.829782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.829785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.829789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.829796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.829803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.829807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.829810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.829817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.829826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.829832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.829838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.829843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.829848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.829852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.829857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.829862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.829871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.829875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.829879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.829888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.829893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.829901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.829906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.829915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.829920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.829928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.829933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.829941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.829946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.829950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.829959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.829968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.829973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.830012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:57.832178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601047000807247:7094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:57.832196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601047000807247:7094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:57.832199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601047000807247:7094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:57.832211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:57.832207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:57.832649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:57.832660Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:57.832662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:57.832666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:57.832671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 791 [2:7559601046218595457:5695]
2025-10-10T14:32:57.832682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:57.832704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:57.832711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.832715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.832717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.832732Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:57.832744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:57.832753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:57.832808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.832815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.832830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.832833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:57.832892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:57.832900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.832911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.832923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.832940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:57.832961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807283:7094], now have 1 active actors on pipe
2025-10-10T14:32:57.832969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807166:2438], now have 1 active actors on pipe
2025-10-10T14:32:57.832975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601046218595450:5695]
2025-10-10T14:32:57.832978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601046218595450:5695]
2025-10-10T14:32:57.832979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601046218595450:5695]
2025-10-10T14:32:57.832973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 791
2025-10-10T14:32:57.832983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 791
2025-10-10T14:32:57.832996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:57.833003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:57.833005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:57.833007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:57.833012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:57.833027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:57.833034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:57.833065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.833074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.833091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601046218595450:5695]
2025-10-10T14:32:57.833101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:57.833114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:57.833129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:57.833141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.833149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.833151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:57.833161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.833175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:57.833199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.833403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.833411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.833424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.833525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 792 partition: 0 MaxSeqNo: 40 sessionId: src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0
2025-10-10T14:32:57.833882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3aa6425-ea5dc279-3e09a846-f44f51e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:57.836490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0] Write session: try to update token
2025-10-10T14:32:57.836506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:57.849300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId: src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:57.851157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:57.851176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.851178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:57.851180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:57.851189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601046218595450:5695]
2025-10-10T14:32:57.851192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601046218595450:5695]
2025-10-10T14:32:57.851194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601046218595450:5695]
2025-10-10T14:32:57.851233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:57.851239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.851238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:57.851240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:57.851243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:57.851249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:57.851404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:57.851932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:57.915612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601047000807290:6574]
2025-10-10T14:32:57.915897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 791, pipe: [1:7559601047000807290:6574]
2025-10-10T14:32:57.953465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:57.953700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.953713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.953750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807290:6574], now have 1 active actors on pipe
2025-10-10T14:32:57.953904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:57.953970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:57.953972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601047000807290:6574]
2025-10-10T14:32:57.953996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:57.954091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 792 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0
2025-10-10T14:32:57.954303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 792 sessionId: src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0 is DEAD
2025-10-10T14:32:57.954462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:57.954475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0] Write session will restart in 0.007276s
2025-10-10T14:32:57.954501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0] Write session: Do CDS request
2025-10-10T14:32:57.954507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:57.962798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.962912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:57.962926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 793
2025-10-10T14:32:57.963070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:57.963119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:57.963099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:57.963127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:57.963130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:57.963549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 793 sessionId:  describe result for acl check
2025-10-10T14:32:57.963587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:57.963593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:57.963596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:57.963602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601047000807375:7098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:57.964142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601047000807375:7098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:57.964753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:57.964934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:57.964944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:57.964953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:57.964998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:57.965029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601046218595578:5697]
2025-10-10T14:32:57.965459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:57.965685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:57.965727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:57.965929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:57.965958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601047000807375:7098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:57.965973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.965980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.965981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.965981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.965982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.965983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.965983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.965984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.965985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.965985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.965986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.965987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.965987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.965991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.965998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.966001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.966003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.966005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.966007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.966009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.966011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.966013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.966016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.966018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.966020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.966022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.966026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.966032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:57.966036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.966040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:57.966042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.966045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:57.966048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.966051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:57.966054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.966057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:57.966059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.966062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:57.966065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.966068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:57.966071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.966073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:57.966076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.966079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:57.966082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.966085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:57.966088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.966091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.966094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.966097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.966100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.966103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.966125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:57.968241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:57.968313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601047000807375:7098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:57.968327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601047000807375:7098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:57.968330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601047000807375:7098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:57.968337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:57.968560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:57.968570Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:57.968571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:57.968574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:57.968578Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 792 [2:7559601046218595578:5697]
2025-10-10T14:32:57.968587Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:57.968599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:57.968600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.968603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.968604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.968615Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:57.968628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:57.968635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:57.968672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.968678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.968679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.968680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:57.968734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:57.968742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.968749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:57.968755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:57.968765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:57.968780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807291:2438], now have 1 active actors on pipe
2025-10-10T14:32:57.968796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601047000807409:7098], now have 1 active actors on pipe
2025-10-10T14:32:57.968801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601046218595573:5697]
2025-10-10T14:32:57.968802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601046218595573:5697]
2025-10-10T14:32:57.968804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601046218595573:5697]
2025-10-10T14:32:57.968813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:57.968822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:57.968830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:57.968832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:57.968834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:57.968842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:57.968844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:57.968849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601046218595573:5697]
2025-10-10T14:32:57.968851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:57.968868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:57.968854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 792
2025-10-10T14:32:57.968860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 792
2025-10-10T14:32:57.968894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.968904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.968929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14fc4a23-90c16933-676f6d29-4cd072de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:57.968938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:57.968941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:57.968942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:57.968950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:57.968959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:57.968970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.969141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.969155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.969175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:57.969256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 793 partition: 0 MaxSeqNo: 40 sessionId: src_id|14fc4a23-90c16933-676f6d29-4cd072de_0
2025-10-10T14:32:57.969557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25148451-ecc6cf2f-15d278a8-56fba24f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|14fc4a23-90c16933-676f6d29-4cd072de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:57.972192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14fc4a23-90c16933-676f6d29-4cd072de_0] Write session: try to update token
2025-10-10T14:32:57.972209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14fc4a23-90c16933-676f6d29-4cd072de_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:57.985194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:57.985211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.985220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601046218595573:5697]
2025-10-10T14:32:57.985275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:57.985279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:57.985469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:57.985602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:57.985780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId: src_id|14fc4a23-90c16933-676f6d29-4cd072de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:57.985836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:57.985984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:57.986160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:57.986197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:57.988428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:57.988628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:57.988644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:57.988674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:57.988769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:57.997297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:57.997314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:57.997317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:57.997319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:57.997344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601046218595573:5697]
2025-10-10T14:32:57.997348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601046218595573:5697]
2025-10-10T14:32:57.997350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601046218595573:5697]
2025-10-10T14:32:57.997388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:57.997400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:57.997401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:57.997402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:57.997410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:57.997415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:57.997532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:58.054382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601051295774713:6574]
2025-10-10T14:32:58.054631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 792, pipe: [1:7559601051295774713:6574]
2025-10-10T14:32:58.099601Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:58.106109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.106135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.106284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.106337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.106392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.106478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.106524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.106538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.106615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.106682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.106750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.106821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.107224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.107233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.107291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.107340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.107396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.107452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.107491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.107496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.107552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.107607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.107659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.107715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.107753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.107758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.107816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.107881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.107942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.108001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.108039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.108043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.108100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.108178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.108234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.108287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.108326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.108331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.108389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.108439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.108495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.108548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.108588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.108593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.108650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.108705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.108759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.108815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.108853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.108859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.108916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.108967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.109019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.109072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.109109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.109114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.109167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.109219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.109272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.109325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.109376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.109381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.109420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295774713:6574], now have 1 active actors on pipe
2025-10-10T14:32:58.109703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:58.109721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601051295774713:6574]
2025-10-10T14:32:58.109759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:58.109768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:58.109799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 793 reason: error at write: Disconnected sessionId: src_id|14fc4a23-90c16933-676f6d29-4cd072de_0
2025-10-10T14:32:58.109910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:58.110085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 793 sessionId: src_id|14fc4a23-90c16933-676f6d29-4cd072de_0 is DEAD
2025-10-10T14:32:58.110198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fc4a23-90c16933-676f6d29-4cd072de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:58.110205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fc4a23-90c16933-676f6d29-4cd072de_0] Write session will restart in 0.009177s
2025-10-10T14:32:58.110236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fc4a23-90c16933-676f6d29-4cd072de_0] Write session: Do CDS request
2025-10-10T14:32:58.110242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fc4a23-90c16933-676f6d29-4cd072de_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:58.120116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:58.120914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14fc4a23-90c16933-676f6d29-4cd072de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.121019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:58.121039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 794
2025-10-10T14:32:58.121178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.121220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:58.121230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:58.121234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:58.121670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 794 sessionId:  describe result for acl check
2025-10-10T14:32:58.121707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:58.121713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:58.121715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:58.121722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601051295774800:7102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:58.121960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:58.122149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:58.122159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:58.122169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:58.122216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:58.122248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601050513562999:5699]
2025-10-10T14:32:58.122292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601051295774800:7102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:58.122646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:58.122900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:58.122934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:58.123168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:58.123210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.123215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.123215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.123216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.123217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.123217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.123218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.123219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.123219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.123220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.123220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.123221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.123222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.123225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.123233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.123235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.123238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.123240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.123243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.123245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.123247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.123249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.123252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.123254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.123256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.123258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.123263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.123269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.123274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.123277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.123280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.123283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.123285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.123289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.123291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.123294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.123296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.123299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.123302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.123305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.123307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.123310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.123313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.123316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.123318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.123321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.123324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.123327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.123329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.123332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.123336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.123340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.123361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:58.124869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601051295774800:7102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:58.125508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:58.125795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:58.125806Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:58.125807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:58.125810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:58.125814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 793 [2:7559601050513562999:5699]
2025-10-10T14:32:58.125822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:58.125835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:58.125837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.125840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.125841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.125862Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:58.125871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:58.125877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:58.125914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.125919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.125920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.125922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:58.125998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:58.126004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.126011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.126025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.126035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:58.126056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295774714:2438], now have 1 active actors on pipe
2025-10-10T14:32:58.126066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601050513562993:5699]
2025-10-10T14:32:58.126071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601050513562993:5699]
2025-10-10T14:32:58.126072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601050513562993:5699]
2025-10-10T14:32:58.126081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:58.126094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:58.126096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:58.126099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:58.126101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:58.126104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:58.126106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:58.126078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 793
2025-10-10T14:32:58.126127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601050513562993:5699]
2025-10-10T14:32:58.126138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:58.126144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:58.130722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601051295774800:7102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:58.130738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601051295774800:7102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:58.130743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601051295774800:7102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:58.130752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:58.130997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295774837:7102], now have 1 active actors on pipe
2025-10-10T14:32:58.131061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 793
2025-10-10T14:32:58.131120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.131134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.131176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7400332f-6084aee2-43b08c13-3fa4c130_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:58.131192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.131202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.131205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:58.131218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.131235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:58.131258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.131467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.131477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.131493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.131572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 794 partition: 0 MaxSeqNo: 40 sessionId: src_id|7400332f-6084aee2-43b08c13-3fa4c130_0
2025-10-10T14:32:58.131955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14fc4a23-90c16933-676f6d29-4cd072de_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7400332f-6084aee2-43b08c13-3fa4c130_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:58.134589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7400332f-6084aee2-43b08c13-3fa4c130_0] Write session: try to update token
2025-10-10T14:32:58.134603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7400332f-6084aee2-43b08c13-3fa4c130_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:58.144793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:58.144817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:58.144820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:58.144823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:58.144834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601050513562993:5699]
2025-10-10T14:32:58.144839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601050513562993:5699]
2025-10-10T14:32:58.144843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601050513562993:5699]
2025-10-10T14:32:58.144887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:58.144894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:58.144896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:58.144898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:58.144905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.144908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:58.145050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:58.150268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId: src_id|7400332f-6084aee2-43b08c13-3fa4c130_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:58.152714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:58.210005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601051295774841:6574]
2025-10-10T14:32:58.210262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 793, pipe: [1:7559601051295774841:6574]
2025-10-10T14:32:58.259425Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:58.259776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.259795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.259839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295774841:6574], now have 1 active actors on pipe
2025-10-10T14:32:58.260061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601051295774841:6574]
2025-10-10T14:32:58.260072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:58.260096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:58.260099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:58.260158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 794 reason: error at write: Disconnected sessionId: src_id|7400332f-6084aee2-43b08c13-3fa4c130_0
2025-10-10T14:32:58.260334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 794 sessionId: src_id|7400332f-6084aee2-43b08c13-3fa4c130_0 is DEAD
2025-10-10T14:32:58.260514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7400332f-6084aee2-43b08c13-3fa4c130_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:58.260527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7400332f-6084aee2-43b08c13-3fa4c130_0] Write session will restart in 0.008896s
2025-10-10T14:32:58.260555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7400332f-6084aee2-43b08c13-3fa4c130_0] Write session: Do CDS request
2025-10-10T14:32:58.260562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7400332f-6084aee2-43b08c13-3fa4c130_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:58.260857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:58.269988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:58.270804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7400332f-6084aee2-43b08c13-3fa4c130_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.270897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:58.270912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 795
2025-10-10T14:32:58.271041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.271076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:58.271104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:58.271108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:58.271510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 795 sessionId:  describe result for acl check
2025-10-10T14:32:58.271547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:58.271553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:58.271555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:58.271561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601051295774940:7107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:58.271698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:58.271868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:58.271878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:58.271889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:58.271939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:58.271982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601050513563134:5702]
2025-10-10T14:32:58.271976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601051295774940:7107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:58.272583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:58.272837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:58.272881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:58.273194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:58.273250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.273257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.273258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.273259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.273260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.273261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.273262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.273264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.273265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.273266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.273267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.273269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.273270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.273276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.273287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.273292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.273301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.273305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.273309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.273313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.273317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.273321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.273325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.273344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.273348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.273351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.273359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.273368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.273379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.273389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.273398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.273407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.273412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.273417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.273424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.273433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.273443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.273452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.273461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.273470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.273475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.273481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.273490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.273495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.273499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.273509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.273516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.273525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.273530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.273539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.273548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.273558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.273606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:58.273820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601051295774940:7107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:58.275898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:58.276023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601051295774940:7107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:58.276036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601051295774940:7107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:58.276039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601051295774940:7107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:58.276045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:58.276255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:58.276271Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:58.276273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:58.276277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:58.276282Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 794 [2:7559601050513563134:5702]
2025-10-10T14:32:58.276295Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:58.276310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:58.276318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.276322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.276324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.276345Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:58.276357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:58.276365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:58.276420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.276427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.276429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.276431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:58.276500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:58.276507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.276519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.276531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.276554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:58.276582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295774974:7107], now have 1 active actors on pipe
2025-10-10T14:32:58.276587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295774854:2438], now have 1 active actors on pipe
2025-10-10T14:32:58.276596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601050513563129:5702]
2025-10-10T14:32:58.276603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601050513563129:5702]
2025-10-10T14:32:58.276605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601050513563129:5702]
2025-10-10T14:32:58.276618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:58.276633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:58.276622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 794
2025-10-10T14:32:58.276635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:58.276625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 794
2025-10-10T14:32:58.276639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:58.276640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:58.276654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:58.276659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:58.276693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.276702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.276718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601050513563129:5702]
2025-10-10T14:32:58.276728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:58.276739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:58.276756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32db73ad-aa659f69-54566681-ad283447_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:58.276767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.276773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.276774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:58.276784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.276796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:58.276816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.276984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.276993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.277009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.277114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 795 partition: 0 MaxSeqNo: 40 sessionId: src_id|32db73ad-aa659f69-54566681-ad283447_0
2025-10-10T14:32:58.277410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7400332f-6084aee2-43b08c13-3fa4c130_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|32db73ad-aa659f69-54566681-ad283447_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:58.280036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32db73ad-aa659f69-54566681-ad283447_0] Write session: try to update token
2025-10-10T14:32:58.280050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32db73ad-aa659f69-54566681-ad283447_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:58.293567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId: src_id|32db73ad-aa659f69-54566681-ad283447_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:58.295443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:58.295470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:58.295473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:58.295475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:58.295487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601050513563129:5702]
2025-10-10T14:32:58.295491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601050513563129:5702]
2025-10-10T14:32:58.295494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601050513563129:5702]
2025-10-10T14:32:58.295545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:58.295559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.295566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:58.295687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:58.295701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:58.295705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:58.295705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:58.296207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:58.360525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601051295774982:6574]
2025-10-10T14:32:58.360842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 794, pipe: [1:7559601051295774982:6574]
2025-10-10T14:32:58.400155Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:58.400439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.400451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.400491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295774982:6574], now have 1 active actors on pipe
2025-10-10T14:32:58.400656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:58.400714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:58.400725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:58.400730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:58.400766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601051295774982:6574]
2025-10-10T14:32:58.400791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 795 reason: error at write: Disconnected sessionId: src_id|32db73ad-aa659f69-54566681-ad283447_0
2025-10-10T14:32:58.401011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 795 sessionId: src_id|32db73ad-aa659f69-54566681-ad283447_0 is DEAD
2025-10-10T14:32:58.401179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32db73ad-aa659f69-54566681-ad283447_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:58.401191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32db73ad-aa659f69-54566681-ad283447_0] Write session will restart in 0.007911s
2025-10-10T14:32:58.401229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32db73ad-aa659f69-54566681-ad283447_0] Write session: Do CDS request
2025-10-10T14:32:58.401235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32db73ad-aa659f69-54566681-ad283447_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:58.409847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32db73ad-aa659f69-54566681-ad283447_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.409987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:58.410007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 796
2025-10-10T14:32:58.410146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.410188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:58.410197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:58.410201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:58.410609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 796 sessionId:  describe result for acl check
2025-10-10T14:32:58.410649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:58.410656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:58.410658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:58.410664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601051295775068:7111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:58.411195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601051295775068:7111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:58.411176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:58.412878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:58.413064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:58.413075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:58.413086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:58.413107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601051295775068:7111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:58.413134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:58.413171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601050513563261:5704]
2025-10-10T14:32:58.413764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:58.414007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:58.414050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:58.414272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:58.414329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.414336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.414337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.414338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.414339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.414339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.414341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.414341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.414343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.414344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.414345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.414346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.414347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.414352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.414363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.414366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.414370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.414374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.414377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.414381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.414384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.414387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.414391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.414394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.414397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.414401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.414407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.414415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.414421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.414426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.414430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.414435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.414439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.414445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.414449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.414453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.414455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.414459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.414463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.414466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.414468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.414471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.414474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.414477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.414479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.414482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.414485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.414488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.414491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.414494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.414496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.414499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.414522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:58.416554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601051295775068:7111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:58.416569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601051295775068:7111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:58.416572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601051295775068:7111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:58.416580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:58.416612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:58.417071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:58.417086Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:58.417088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:58.417091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:58.417096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 795 [2:7559601050513563261:5704]
2025-10-10T14:32:58.417114Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:58.417134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:58.417141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.417144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.417151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.417168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:58.417179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:58.417192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:58.417254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.417261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.417263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.417266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:58.417347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:58.417354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.417366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.417382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.417404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:58.417433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295774983:2438], now have 1 active actors on pipe
2025-10-10T14:32:58.417437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775104:7111], now have 1 active actors on pipe
2025-10-10T14:32:58.417444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601050513563255:5704]
2025-10-10T14:32:58.417446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601050513563255:5704]
2025-10-10T14:32:58.417451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 795
2025-10-10T14:32:58.417448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601050513563255:5704]
2025-10-10T14:32:58.417456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 795
2025-10-10T14:32:58.417460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:58.417470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:58.417479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:58.417481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:58.417483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:58.417486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:58.417490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:58.417500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601050513563255:5704]
2025-10-10T14:32:58.417507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:58.417517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:58.417523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.417526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.417559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:58.417568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.417572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.417573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:58.417580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.417590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:58.417605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.417753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.417761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.417775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.417849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 796 partition: 0 MaxSeqNo: 40 sessionId: src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0
2025-10-10T14:32:58.418177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32db73ad-aa659f69-54566681-ad283447_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:58.420694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0] Write session: try to update token
2025-10-10T14:32:58.420710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:58.434076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId: src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:58.435130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:58.435151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:58.435154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:58.435156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:58.435165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601050513563255:5704]
2025-10-10T14:32:58.435170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601050513563255:5704]
2025-10-10T14:32:58.435174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601050513563255:5704]
2025-10-10T14:32:58.435223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:58.435230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.435233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:58.435237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:58.435244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:58.435257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:58.435385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:58.436609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:58.500805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601051295775112:6574]
2025-10-10T14:32:58.501052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 795, pipe: [1:7559601051295775112:6574]
2025-10-10T14:32:58.541090Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:58.541366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.541380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.541416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775112:6574], now have 1 active actors on pipe
2025-10-10T14:32:58.541602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:58.541616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:58.541632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601051295775112:6574]
2025-10-10T14:32:58.541655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:58.541678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 796 reason: error at write: Disconnected sessionId: src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0
2025-10-10T14:32:58.541770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:58.541898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 796 sessionId: src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0 is DEAD
2025-10-10T14:32:58.542088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:58.542099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0] Write session will restart in 0.009915s
2025-10-10T14:32:58.542125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0] Write session: Do CDS request
2025-10-10T14:32:58.542131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:58.551302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:58.552791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.552885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:58.552904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 797
2025-10-10T14:32:58.553024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.553061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:58.553070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:58.553050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:58.553074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:58.553220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:58.553229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:58.553238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:58.553280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:58.553312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601050513563387:5706]
2025-10-10T14:32:58.553512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 797 sessionId:  describe result for acl check
2025-10-10T14:32:58.553545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:58.553552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:58.553554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:58.553560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601051295775201:7115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:58.553739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:58.554016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:58.554075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:58.554146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601051295775201:7115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:58.554494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:58.554551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.554557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.554558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.554559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.554561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.554562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.554563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.554565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.554566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.554567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.554568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.554570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.554571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.554577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.554589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.554593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.554597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.554601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.554606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.554610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.554613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.554617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.554621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.554625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.554629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.554633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.554645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.554658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.554670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.554680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.554689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.554697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.554701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.554706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.554711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.554716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.554724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.554730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.554740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.554745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.554753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.554758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.554762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.554766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.554776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.554781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.554787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.554794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.554798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.554808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.554818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.554827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.554873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:58.555937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601051295775201:7115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:58.557175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:58.557539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:58.557551Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:58.557554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:58.557558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:58.557564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 796 [2:7559601050513563387:5706]
2025-10-10T14:32:58.557575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:58.557599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:58.557607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.557611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.557613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.557629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:58.557642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:58.557653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:58.557722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.557729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.557731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.557733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:58.557799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:58.557804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.557816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.557829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.557851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:58.557878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775113:2438], now have 1 active actors on pipe
2025-10-10T14:32:58.557892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601050513563382:5706]
2025-10-10T14:32:58.557896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601050513563382:5706]
2025-10-10T14:32:58.557898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601050513563382:5706]
2025-10-10T14:32:58.557897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 796
2025-10-10T14:32:58.557912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:58.557930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:58.557932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:58.557942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:58.557944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:58.557950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:58.557954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:58.557988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601050513563382:5706]
2025-10-10T14:32:58.558000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:58.558022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:58.558254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601051295775201:7115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:58.558267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601051295775201:7115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:58.558270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601051295775201:7115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:58.558278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:58.558479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775237:7115], now have 1 active actors on pipe
2025-10-10T14:32:58.558528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 796
2025-10-10T14:32:58.558590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.558601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.558630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e99b987-5671901e-60b02f2b-1a2e676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:58.558644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.558648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.558650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:58.558664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.558679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:58.558697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.558847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.558855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.558870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.558950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 797 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e99b987-5671901e-60b02f2b-1a2e676_0
2025-10-10T14:32:58.559315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489a724a-886fb37f-acf3e9d-7ee7c806_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e99b987-5671901e-60b02f2b-1a2e676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:58.561878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e99b987-5671901e-60b02f2b-1a2e676_0] Write session: try to update token
2025-10-10T14:32:58.561896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e99b987-5671901e-60b02f2b-1a2e676_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:58.568750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:58.568772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:58.568783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601050513563382:5706]
2025-10-10T14:32:58.568832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:58.568832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:58.569051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:58.569199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:58.569366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:58.569524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:58.569722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:58.569763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:58.575204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId: src_id|7e99b987-5671901e-60b02f2b-1a2e676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:58.577630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:58.577776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.577798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.577854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:58.577916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:58.586313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:58.586333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:58.586335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:58.586337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:58.586345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601050513563382:5706]
2025-10-10T14:32:58.586348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601050513563382:5706]
2025-10-10T14:32:58.586353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601050513563382:5706]
2025-10-10T14:32:58.586390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:58.586396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:58.586400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.586401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:58.586402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:58.586405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:58.586553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:58.641599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601051295775256:6574]
2025-10-10T14:32:58.641858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 796, pipe: [1:7559601051295775256:6574]
2025-10-10T14:32:58.688577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:58.696275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.696303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.696477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.696543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.696606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.696674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.697066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.697078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.697148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.697214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.697279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.697361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.697403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.697410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.697479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.697542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.697608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.697683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.697727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.697735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.697800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.697903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.697970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.698043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.698084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.698092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.698187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.698251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.698313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.698377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.698433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.698440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.698505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.698567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.698627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.698711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.698754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.698761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.698828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.698889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.698994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.699064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.699133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.699139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.699206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.699271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.699337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.699401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.699463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.699470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.699537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.699601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.699663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.699724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.699769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.699777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.699842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:58.699941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:58.700014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:58.700081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:58.700137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:58.700144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:58.700233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775256:6574], now have 1 active actors on pipe
2025-10-10T14:32:58.700483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601051295775256:6574]
2025-10-10T14:32:58.700533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:58.700540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:58.700570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 797 reason: error at write: Disconnected sessionId: src_id|7e99b987-5671901e-60b02f2b-1a2e676_0
2025-10-10T14:32:58.700800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 797 sessionId: src_id|7e99b987-5671901e-60b02f2b-1a2e676_0 is DEAD
2025-10-10T14:32:58.700856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:58.700967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:58.700985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e99b987-5671901e-60b02f2b-1a2e676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:58.700997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e99b987-5671901e-60b02f2b-1a2e676_0] Write session will restart in 0.007515s
2025-10-10T14:32:58.701032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e99b987-5671901e-60b02f2b-1a2e676_0] Write session: Do CDS request
2025-10-10T14:32:58.701039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e99b987-5671901e-60b02f2b-1a2e676_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:58.709819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e99b987-5671901e-60b02f2b-1a2e676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.709913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:58.709929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 798
2025-10-10T14:32:58.710066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.710103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:58.710114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:58.710118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:58.710489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 798 sessionId:  describe result for acl check
2025-10-10T14:32:58.710520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:58.710527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:58.710529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:58.710535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601051295775357:7127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:58.711039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601051295775357:7127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:58.711241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:58.713188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601051295775357:7127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:58.713397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:58.713603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:58.713615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:58.713628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:58.713680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:58.713721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601050513563531:5715]
2025-10-10T14:32:58.714333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:58.714590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:58.714633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:58.714949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:58.715012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.715018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.715019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.715020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.715021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.715022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.715024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.715025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.715026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.715027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.715028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.715029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.715031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.715036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.715047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.715051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.715055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.715059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.715063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.715068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.715072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.715075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.715079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.715083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.715088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.715092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.715111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.715120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.715127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.715132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.715137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.715142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.715147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.715152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.715170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.715176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.715179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.715190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.715195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.715200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.715209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.715214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.715219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.715229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.715233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.715238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.715242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.715249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.715253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.715258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.715267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.715272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.715312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:58.715666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601051295775357:7127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:58.715688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601051295775357:7127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:58.715694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601051295775357:7127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:58.715707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:58.717316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:58.717746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:58.717761Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:58.717764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:58.717768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:58.717774Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 797 [2:7559601050513563531:5715]
2025-10-10T14:32:58.717784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:58.717797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:58.717799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.717801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.717803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.717816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:58.717827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:58.717835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:58.717896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.717903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.717905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.717907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:58.717972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:58.717980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.717991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.718002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.718022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:58.718050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775271:2438], now have 1 active actors on pipe
2025-10-10T14:32:58.718058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775403:7127], now have 1 active actors on pipe
2025-10-10T14:32:58.718065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601050513563526:5715]
2025-10-10T14:32:58.718071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601050513563526:5715]
2025-10-10T14:32:58.718074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601050513563526:5715]
2025-10-10T14:32:58.718086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:58.718077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 797
2025-10-10T14:32:58.718104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:58.718111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:58.718114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:58.718118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:58.718127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:58.718130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:58.718136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 797
2025-10-10T14:32:58.718161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601050513563526:5715]
2025-10-10T14:32:58.718172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:58.718181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:58.718187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.718192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.718241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:58.718255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.718265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.718267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:58.718279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.718296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:58.718318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.718478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.718486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.718502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.718603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 798 partition: 0 MaxSeqNo: 40 sessionId: src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0
2025-10-10T14:32:58.718905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e99b987-5671901e-60b02f2b-1a2e676_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:58.721600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0] Write session: try to update token
2025-10-10T14:32:58.721619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:58.735038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId: src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:58.735992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:58.736019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:58.736023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:58.736025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:58.736037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601050513563526:5715]
2025-10-10T14:32:58.736042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601050513563526:5715]
2025-10-10T14:32:58.736046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601050513563526:5715]
2025-10-10T14:32:58.736088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:58.736100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:58.736103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:58.736108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.736109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:58.736111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:58.736256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:58.737595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:58.800840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601051295775411:6574]
2025-10-10T14:32:58.801145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 797, pipe: [1:7559601051295775411:6574]
2025-10-10T14:32:58.837905Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:58.838268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.838282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.838324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775411:6574], now have 1 active actors on pipe
2025-10-10T14:32:58.838504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:58.838558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601051295775411:6574]
2025-10-10T14:32:58.838573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:58.838591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:58.838667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 798 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0
2025-10-10T14:32:58.838883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 798 sessionId: src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0 is DEAD
2025-10-10T14:32:58.839064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:58.839076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0] Write session will restart in 0.008117s
2025-10-10T14:32:58.839114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0] Write session: Do CDS request
2025-10-10T14:32:58.839121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:58.848870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.849046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:58.849063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 799
2025-10-10T14:32:58.849098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:58.849175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.849212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:58.849223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:58.849227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:58.849669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 799 sessionId:  describe result for acl check
2025-10-10T14:32:58.849700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:58.849706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:58.849708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:58.849712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601051295775503:7134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:58.850170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601051295775503:7134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:58.850781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:58.850943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:58.850954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:58.850965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:58.851016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:58.851058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601050513563685:5724]
2025-10-10T14:32:58.851660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:58.851957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:58.852003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:58.852231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601051295775503:7134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:58.852299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:58.852367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.852373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.852374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.852375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.852376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.852377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.852378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.852379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.852381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.852382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.852383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.852384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.852385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.852391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.852403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.852407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.852411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.852415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.852419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.852422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.852425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.852429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.852433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.852437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.852441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.852445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.852452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.852465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.852476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.852486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.852495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.852504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.852509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.852514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.852523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.852533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.852541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.852546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.852555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.852564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.852573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.852582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.852592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.852601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.852610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.852619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.852624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.852633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.852641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.852650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.852654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.852663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.852708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:58.854684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601051295775503:7134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:58.854698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601051295775503:7134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:58.854702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601051295775503:7134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:58.854710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:58.854745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:58.855066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:58.855079Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:58.855081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:58.855085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:58.855090Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 798 [2:7559601050513563685:5724]
2025-10-10T14:32:58.855112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:58.855129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:58.855138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.855141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.855143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.855160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:58.855171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:58.855180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:58.855237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.855244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.855246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.855248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:58.855313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:58.855320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.855332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.855344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.855366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:58.855383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 798
2025-10-10T14:32:58.855393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775413:2438], now have 1 active actors on pipe
2025-10-10T14:32:58.855401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775537:7134], now have 1 active actors on pipe
2025-10-10T14:32:58.855409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601050513563679:5724]
2025-10-10T14:32:58.855415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601050513563679:5724]
2025-10-10T14:32:58.855417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601050513563679:5724]
2025-10-10T14:32:58.855426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:58.855420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 798
2025-10-10T14:32:58.855436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:58.855439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:58.855449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:58.855451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:58.855456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:58.855459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:58.855478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.855487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.855518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601050513563679:5724]
2025-10-10T14:32:58.855529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:58.855541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:58.855549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:58.855556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.855560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.855562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:58.855572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.855582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:58.855616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.855795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.855806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.855823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:58.855907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 799 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0
2025-10-10T14:32:58.856297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be0550-db7ac420-24003d9-c2e8ebd7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:58.858939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0] Write session: try to update token
2025-10-10T14:32:58.858957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:58.873274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId: src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:58.873802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:58.873826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:58.873830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:58.873832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:58.873842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601050513563679:5724]
2025-10-10T14:32:58.873846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601050513563679:5724]
2025-10-10T14:32:58.873850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601050513563679:5724]
2025-10-10T14:32:58.873897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:58.873911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.873913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:58.873922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:58.873940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:58.873945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:58.874048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:58.875752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:58.938579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601051295775544:6574]
2025-10-10T14:32:58.938825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 798, pipe: [1:7559601051295775544:6574]
2025-10-10T14:32:58.979571Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:58.979929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:58.979942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:58.979981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775544:6574], now have 1 active actors on pipe
2025-10-10T14:32:58.980174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:58.980159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:58.980177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601051295775544:6574]
2025-10-10T14:32:58.980202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:58.980217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:58.980275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 799 reason: error at write: Disconnected sessionId: src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0
2025-10-10T14:32:58.980498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 799 sessionId: src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0 is DEAD
2025-10-10T14:32:58.980700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:58.980713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0] Write session will restart in 0.009522s
2025-10-10T14:32:58.980740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0] Write session: Do CDS request
2025-10-10T14:32:58.980751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:58.989356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:58.991024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:58.991223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:58.991235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:58.991247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:58.991302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:58.991346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601050513563813:5726]
2025-10-10T14:32:58.991857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.991946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:58.991924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:58.991939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 800
2025-10-10T14:32:58.992075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:58.992105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:58.992115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:58.992119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:58.992213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:58.992258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:58.992462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 800 sessionId:  describe result for acl check
2025-10-10T14:32:58.992495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:58.992500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:58.992501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:58.992506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601051295775640:7138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:58.992579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:58.992629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.992635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.992636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.992637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.992638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.992639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.992640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.992642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.992643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.992644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.992645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.992646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.992647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.992653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.992665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.992669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.992674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.992678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.992682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.992686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.992689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.992693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.992698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.992702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.992706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.992710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.992716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.992724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:58.992730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.992736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:58.992740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.992745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:58.992750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.992755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:58.992759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.992766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:58.992771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.992777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:58.992787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.992792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:58.992796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.992807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:58.992812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.992817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:58.992821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.992826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:58.992830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.992836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.992840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.992845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.992849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.992854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.992890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:58.992953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601051295775640:7138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:58.994623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601051295775640:7138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:58.995007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:58.995456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:58.995470Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:58.995473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:58.995476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:58.995482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 799 [2:7559601050513563813:5726]
2025-10-10T14:32:58.995494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:58.995510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:58.995517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:58.995520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:58.995522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:58.995538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:58.995550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:58.995562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:58.995616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.995625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.995627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.995629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:58.995694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:58.995701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:58.995713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:58.995730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:58.995753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:58.995777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775546:2438], now have 1 active actors on pipe
2025-10-10T14:32:58.995760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 799
2025-10-10T14:32:58.995788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601050513563808:5726]
2025-10-10T14:32:58.995794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601050513563808:5726]
2025-10-10T14:32:58.995796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601050513563808:5726]
2025-10-10T14:32:58.995806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:58.995813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:58.995819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:58.995823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:58.995825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:58.995835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:58.995839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:58.995866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601050513563808:5726]
2025-10-10T14:32:58.995878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:58.995885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:58.999983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601051295775640:7138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:58.999998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601051295775640:7138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:59.000002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601051295775640:7138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:59.000021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:59.000242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601051295775675:7138], now have 1 active actors on pipe
2025-10-10T14:32:59.000273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 799
2025-10-10T14:32:59.000356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.000373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.000406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:59.000424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.000434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.000442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:59.000457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.000488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:59.000511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.000684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.000693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.000709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.000782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 800 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0
2025-10-10T14:32:59.001140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1b2701-acd294a8-2703584f-ceb40a16_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:59.003947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0] Write session: try to update token
2025-10-10T14:32:59.003963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:59.006809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:32:59.006828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:59.006838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601050513563808:5726]
2025-10-10T14:32:59.006881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:32:59.006890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:32:59.007066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:32:59.007224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:59.007365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:59.007503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:32:59.007694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:32:59.007737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:32:59.017587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId: src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:59.020174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:59.020372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.020394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.020435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:32:59.020516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:59.024004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:59.024021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:59.024024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:59.024025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:59.024036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601050513563808:5726]
2025-10-10T14:32:59.024039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601050513563808:5726]
2025-10-10T14:32:59.024041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601050513563808:5726]
2025-10-10T14:32:59.024080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:59.024091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.024098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:59.024142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:59.024155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:59.024159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:59.024229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:59.080411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601055590742974:6574]
2025-10-10T14:32:59.080696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 799, pipe: [1:7559601055590742974:6574]
2025-10-10T14:32:59.128615Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:59.135265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.135290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.135442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.135498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.135557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.135616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.135668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.135677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.135745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.135802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.135861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.135919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.135959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.135964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.136024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.136077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.136133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.136191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.136231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.136237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.136295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.136353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.136412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.136469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.136856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.136864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.136924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.136977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.137061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.137116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.137155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.137160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.137218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.137272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.137343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.137403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.137440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.137446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.137502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.137553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.137613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.137668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.137706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.137711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.137772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.137834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.137897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.137954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.137993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.137998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.138053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.138103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.138158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.138214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.138253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.138258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.138314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:32:59.138363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:32:59.138421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:32:59.138473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:32:59.138555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:32:59.138562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:32:59.138598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590742974:6574], now have 1 active actors on pipe
2025-10-10T14:32:59.138803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:59.138814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601055590742974:6574]
2025-10-10T14:32:59.138820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:59.138836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:59.138862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 800 reason: error at write: Disconnected sessionId: src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0
2025-10-10T14:32:59.139034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:59.139086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 800 sessionId: src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0 is DEAD
2025-10-10T14:32:59.139266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:59.139274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0] Write session will restart in 0.007436s
2025-10-10T14:32:59.139298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0] Write session: Do CDS request
2025-10-10T14:32:59.139313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:59.147872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.147950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:59.147970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 801
2025-10-10T14:32:59.148113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.148148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:59.148158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:59.148162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:59.148603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 801 sessionId:  describe result for acl check
2025-10-10T14:32:59.148636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:59.148642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:59.148644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:59.148649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601055590743066:7142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:59.149182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601055590743066:7142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:59.149172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:59.150896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:59.151115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:59.151126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:59.151138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:59.151193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:59.151233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601054808531241:5728]
2025-10-10T14:32:59.151824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:59.151858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601055590743066:7142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:59.152132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:59.152179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:59.152474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:59.152537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.152544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.152546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.152547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.152548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.152549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.152550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.152551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.152553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.152554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.152555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.152556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.152557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.152562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.152572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.152576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.152579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.152583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.152586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.152589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.152593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.152597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.152600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.152604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.152607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.152610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.152617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.152630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.152640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.152649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.152657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.152662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.152670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.152679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.152683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.152688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.152696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.152700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.152708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.152713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.152721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.152726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.152734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.152738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.152746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.152751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.152759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.152764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.152772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.152777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.152785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.152791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.152828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:59.154855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601055590743066:7142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:59.154868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601055590743066:7142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:59.154870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601055590743066:7142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:59.154877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:59.154970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:59.155301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:59.155316Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:59.155318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:59.155322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:59.155327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 800 [2:7559601054808531241:5728]
2025-10-10T14:32:59.155338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:59.155360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:59.155369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.155373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.155375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.155391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:59.155403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:59.155414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:59.155472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.155479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.155481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.155483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:59.155545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:59.155552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.155564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.155580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.155601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:59.155627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590742975:2438], now have 1 active actors on pipe
2025-10-10T14:32:59.155637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743102:7142], now have 1 active actors on pipe
2025-10-10T14:32:59.155644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601054808531235:5728]
2025-10-10T14:32:59.155647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601054808531235:5728]
2025-10-10T14:32:59.155649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601054808531235:5728]
2025-10-10T14:32:59.155662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:59.155677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:59.155681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:59.155684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:59.155686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:59.155648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 800
2025-10-10T14:32:59.155676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 800
2025-10-10T14:32:59.155693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:59.155702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:59.155740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.155748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.155762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601054808531235:5728]
2025-10-10T14:32:59.155775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:59.155799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:59.155807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:59.155815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.155819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.155821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:59.155832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.155850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:59.155875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.156036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.156046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.156062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.156177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 801 partition: 0 MaxSeqNo: 40 sessionId: src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0
2025-10-10T14:32:59.156513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7c522e-11330464-f6d8607d-b88a4b9f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:59.159250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0] Write session: try to update token
2025-10-10T14:32:59.159269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:59.173391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId: src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:59.174512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:59.174534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:59.174537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:59.174539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:59.174550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601054808531235:5728]
2025-10-10T14:32:59.174555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601054808531235:5728]
2025-10-10T14:32:59.174560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601054808531235:5728]
2025-10-10T14:32:59.174606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:59.174612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:59.174620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:59.174621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.174623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:59.174623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:59.174762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:59.175999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:59.239119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601055590743109:6574]
2025-10-10T14:32:59.239335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 800, pipe: [1:7559601055590743109:6574]
2025-10-10T14:32:59.282794Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:59.283245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.283260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.283298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743109:6574], now have 1 active actors on pipe
2025-10-10T14:32:59.283457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:59.283462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:59.283465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601055590743109:6574]
2025-10-10T14:32:59.283494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:59.283497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:59.283513Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:32:59.283568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 801 reason: error at write: Disconnected sessionId: src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0
2025-10-10T14:32:59.283632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 801 sessionId: src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0 is DEAD
2025-10-10T14:32:59.283730Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 8 consumer shared/user session shared/user_1_8_9837470934020682204_v1 is DEAD
2025-10-10T14:32:59.283854Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:32:59.283873Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600991166218296:6571] disconnected; active server actors: 1
2025-10-10T14:32:59.283879Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559600991166218296:6571] client user disconnected session shared/user_1_8_9837470934020682204_v1
2025-10-10T14:32:59.283959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:59.283969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0] Write session will restart in 0.009051s
2025-10-10T14:32:59.283989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0] Write session: Do CDS request
2025-10-10T14:32:59.283994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:59.284036Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:59.284042Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:32:59.284051Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.005426s
2025-10-10T14:32:59.290700Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:32:59.290903Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:32:59.290916Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 9
2025-10-10T14:32:59.291119Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:59.291183Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:32:59.291281Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 auth for : user
2025-10-10T14:32:59.291459Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 Handle describe topics response
2025-10-10T14:32:59.291495Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 auth is DEAD
2025-10-10T14:32:59.291504Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:32:59.291756Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:32:59.291853Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_9_10039576345619587468_v1
2025-10-10T14:32:59.291969Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601055590743148:7147] connected; active server actors: 1
2025-10-10T14:32:59.291988Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601055590743148:7147] session shared/user_1_9_10039576345619587468_v1
2025-10-10T14:32:59.292003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:32:59.292022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:32:59.292033Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_9_10039576345619587468_v1" (Sender=[1:7559601055590743134:7147], Pipe=[1:7559601055590743148:7147], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:59.292041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:32:59.292053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:32:59.292066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_9_10039576345619587468_v1" (Sender=[1:7559601055590743134:7147], Pipe=[1:7559601055590743148:7147], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:32:59.292077Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_9_10039576345619587468_v1" sender [1:7559601055590743134:7147] lock partition 0 for ReadingSession "shared/user_1_9_10039576345619587468_v1" (Sender=[1:7559601055590743134:7147], Pipe=[1:7559601055590743148:7147], Partitions=[], ActiveFamilyCount=1) generation 1 step 9
2025-10-10T14:32:59.292095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:32:59.292100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000039s
2025-10-10T14:32:59.292316Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 9 Session: "shared/user_1_9_10039576345619587468_v1" ClientId: "user" PipeClient { RawX1: 7559601055590743148 RawX2: 4503603922344939 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:32:59.292347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:32:59.293762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.293833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:59.293845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 802
2025-10-10T14:32:59.293944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.293976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:59.293980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:59.293984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:59.294351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 802 sessionId:  describe result for acl check
2025-10-10T14:32:59.294387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:59.294409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:59.294411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:59.294416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601055590743222:7151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:59.294944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601055590743222:7151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:59.294988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:59.296816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:59.296918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601055590743222:7151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:59.297022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:59.297034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:59.297048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:59.297110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:59.297153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601054808531386:5731]
2025-10-10T14:32:59.297789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:59.298140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:59.298190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:59.298470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:59.298535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.298542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.298543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.298544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.298545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.298547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.298548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.298549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.298551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.298552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.298553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.298555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.298556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.298572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.298583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.298587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.298591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.298595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.298598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.298602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.298606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.298610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.298614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.298618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.298622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.298626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.298634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.298655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.298665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.298670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.298674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.298679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.298683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.298688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.298693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.298699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.298707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.298714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.298730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.298740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.298743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.298748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.298753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.298758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.298762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.298768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.298773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.298783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.298787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.298792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.298801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.298806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.298846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:59.299703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601055590743222:7151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:59.299718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601055590743222:7151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:59.299721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601055590743222:7151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:59.299730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:59.301530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:59.302400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:59.302422Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:59.302425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:59.302430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:59.302438Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 801 [2:7559601054808531386:5731]
2025-10-10T14:32:59.302454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:59.302479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:59.302491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.302495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.302502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.302522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:59.302534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:59.302543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:59.302608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.302616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.302618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.302620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:59.302706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:59.302713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.302728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.302738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.302754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:59.302783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743172:7150], now have 1 active actors on pipe
2025-10-10T14:32:59.302791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743122:2438], now have 1 active actors on pipe
2025-10-10T14:32:59.302794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743256:7151], now have 1 active actors on pipe
2025-10-10T14:32:59.302802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601054808531380:5731]
2025-10-10T14:32:59.302804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601054808531380:5731]
2025-10-10T14:32:59.302807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601054808531380:5731]
2025-10-10T14:32:59.302821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:59.302830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:59.302836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:59.302837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:59.302819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 801
2025-10-10T14:32:59.302838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:59.302838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 801, pipe: [1:7559601055590743172:7150]
2025-10-10T14:32:59.302853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:59.302857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:59.302860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 801
2025-10-10T14:32:59.302893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601054808531380:5731]
2025-10-10T14:32:59.302906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:59.302912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:59.302925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.302935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.302958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.302966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.302974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_9_10039576345619587468_v1 on pipe: [1:7559601055590743172:7150]
2025-10-10T14:32:59.303067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:59.303070Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_9_10039576345619587468_v1:1 with generation 801
2025-10-10T14:32:59.303089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.303094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.303097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:59.303128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.303149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:59.303164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.303175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.303177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:59.303201Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_9_10039576345619587468_v1
2025-10-10T14:32:59.303211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.303263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.303283Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:32:59.303443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.303454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.303476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.303564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 802 partition: 0 MaxSeqNo: 40 sessionId: src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0
2025-10-10T14:32:59.304103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be56b7ec-1447d9c7-8c9ccd99-dacfce1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:59.306986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0] Write session: try to update token
2025-10-10T14:32:59.307011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:59.308050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:32:59.308098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:32:59.308119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.308130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.308132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.308149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:32:59.308174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:32:59.308461Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106779303 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:32:59.308486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:32:59.308538Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 sending to client partition status
2025-10-10T14:32:59.320848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId: src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:59.322130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:59.322146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:59.322149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:59.322151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:59.322161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601054808531380:5731]
2025-10-10T14:32:59.322169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601054808531380:5731]
2025-10-10T14:32:59.322172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601054808531380:5731]
2025-10-10T14:32:59.322224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:59.322224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:59.322230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:59.322234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:59.322235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.322237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:59.322380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:59.323344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:59.428471Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:59.428717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.428729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.428914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_9_10039576345619587468_v1
2025-10-10T14:32:59.428930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:59.428955Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_9_10039576345619587468_v1
2025-10-10T14:32:59.429027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:59.429038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601055590743172:7150]
2025-10-10T14:32:59.429042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:59.429057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:59.429107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 802 reason: error at write: Disconnected sessionId: src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0
2025-10-10T14:32:59.429308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 802 sessionId: src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0 is DEAD
2025-10-10T14:32:59.429457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:59.429469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0] Write session will restart in 0.005381s
2025-10-10T14:32:59.429490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0] Write session: Do CDS request
2025-10-10T14:32:59.429494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:59.435813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.435908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:59.435922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 803
2025-10-10T14:32:59.436055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.436092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:59.436102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:59.436105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:59.436460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 803 sessionId:  describe result for acl check
2025-10-10T14:32:59.436502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:59.436510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:59.436512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:59.436517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601055590743282:7155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:59.436944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601055590743282:7155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:59.439130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601055590743282:7155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:59.439804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:59.441667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:59.441710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601055590743282:7155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:59.441720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601055590743282:7155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:59.441722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601055590743282:7155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:59.441728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:59.441838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:59.441849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:59.441860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:59.441914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:59.441951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601054808531520:5733]
2025-10-10T14:32:59.442535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:59.442819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:59.442862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:59.443183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:59.443235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.443241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.443242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.443244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.443245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.443246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.443247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.443248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.443250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.443251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.443252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.443253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.443254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.443259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.443270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.443273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.443278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.443281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.443284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.443288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.443291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.443295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.443299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.443303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.443307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.443311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.443317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.443326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.443332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.443338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.443342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.443347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.443352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.443357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.443362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.443367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.443371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.443376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.443381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.443386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.443395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.443400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.443405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.443410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.443415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.443425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.443430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.443439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.443443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.443448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.443457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.443462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.443502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:59.445525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:59.445831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:59.445842Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:59.445843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:59.445846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:59.445850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 802 [2:7559601054808531520:5733]
2025-10-10T14:32:59.445859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:59.445874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:59.445881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.445884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.445887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.445901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:59.445909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:59.445914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:59.445958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.445965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.445967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.445970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:59.446019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:59.446026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.446036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.446051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.446074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:59.446098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743389:7155], now have 1 active actors on pipe
2025-10-10T14:32:59.446106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743265:2438], now have 1 active actors on pipe
2025-10-10T14:32:59.446113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601054808531514:5733]
2025-10-10T14:32:59.446116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601054808531514:5733]
2025-10-10T14:32:59.446118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601054808531514:5733]
2025-10-10T14:32:59.446131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:59.446148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:59.446149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:59.446152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:59.446155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:59.446162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:59.446165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:59.446184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601054808531514:5733]
2025-10-10T14:32:59.446191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:59.446162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 802
2025-10-10T14:32:59.446176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 802
2025-10-10T14:32:59.446204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:59.446217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.446226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.446259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:59.446271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.446276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.446277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:59.446286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.446294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:59.446305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.446453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.446463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.446478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.446561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 803 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0
2025-10-10T14:32:59.446854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68865f4f-68d27152-df6f95d3-e8d8d1cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:59.449752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0] Write session: try to update token
2025-10-10T14:32:59.449769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:59.462998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId: src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:59.464540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:59.464556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:59.464559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:59.464561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:59.464572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601054808531514:5733]
2025-10-10T14:32:59.464576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601054808531514:5733]
2025-10-10T14:32:59.464580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601054808531514:5733]
2025-10-10T14:32:59.464628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:59.464637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.464636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:59.464643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:59.464644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:59.464647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:59.464782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:59.465582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:59.529399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601055590743401:7150]
2025-10-10T14:32:59.529690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 802, pipe: [1:7559601055590743401:7150]
2025-10-10T14:32:59.575632Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:59.575952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.575964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.576003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743401:7150], now have 1 active actors on pipe
2025-10-10T14:32:59.576160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:59.576219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:59.576233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:59.576248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601055590743401:7150]
2025-10-10T14:32:59.576272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:59.576307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 803 reason: error at write: Disconnected sessionId: src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0
2025-10-10T14:32:59.576551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 803 sessionId: src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0 is DEAD
2025-10-10T14:32:59.576791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:59.576802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0] Write session will restart in 0.009087s
2025-10-10T14:32:59.576827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0] Write session: Do CDS request
2025-10-10T14:32:59.576835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:59.586923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.586983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:59.587001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 804
2025-10-10T14:32:59.587203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.587238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:59.587249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:59.587254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:59.587683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 804 sessionId:  describe result for acl check
2025-10-10T14:32:59.587726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:59.587733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:59.587735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:59.587741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601055590743502:7161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:59.588335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601055590743502:7161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:59.589466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:59.590435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601055590743502:7161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:59.591360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:59.591551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:59.591563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:59.591576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:59.591627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:59.591670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601054808531654:5735]
2025-10-10T14:32:59.592316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:59.592591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:59.592635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:59.592954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:59.593016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.592991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601055590743502:7161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:59.593023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.593007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601055590743502:7161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:59.593024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.593025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.593026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.593014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601055590743502:7161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:59.593027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.593023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:59.593028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.593029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.593030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.593031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.593033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.593034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.593035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.593041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.593052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.593056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.593059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.593063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.593066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.593069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.593072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.593076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.593080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.593083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.593087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.593091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.593100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.593108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.593113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.593118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.593122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.593127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.593131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.593137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.593141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.593145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.593149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.593154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.593158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.593162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.593167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.593171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.593176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.593181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.593186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.593191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.593196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.593200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.593204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.593209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.593213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.593226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.593269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:59.595426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:59.595782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:59.595793Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:59.595794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:59.595797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:59.595802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 803 [2:7559601054808531654:5735]
2025-10-10T14:32:59.595811Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:59.595825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:59.595829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.595832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.595835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.595851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:59.595860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:59.595868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:59.595924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.595932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.595934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.595938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:59.596003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:59.596010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.596021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.596030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.596044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:59.596064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743409:2438], now have 1 active actors on pipe
2025-10-10T14:32:59.596070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743538:7161], now have 1 active actors on pipe
2025-10-10T14:32:59.596076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601054808531649:5735]
2025-10-10T14:32:59.596078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601054808531649:5735]
2025-10-10T14:32:59.596079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601054808531649:5735]
2025-10-10T14:32:59.596100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:59.596114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:59.596118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:59.596121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:59.596122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:59.596127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:59.596130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:59.596148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601054808531649:5735]
2025-10-10T14:32:59.596154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:59.596156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:59.596134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 803
2025-10-10T14:32:59.596173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 803
2025-10-10T14:32:59.596222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.596231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.596254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:59.596264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.596266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.596269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:59.596283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.596299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:59.596311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.596579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.596590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.596610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.596683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 804 partition: 0 MaxSeqNo: 40 sessionId: src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0
2025-10-10T14:32:59.597066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fd0008-3fec8db9-b18d4973-7348693b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:59.599445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0] Write session: try to update token
2025-10-10T14:32:59.599460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:59.612970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId: src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:59.614152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:59.614169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:59.614172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:59.614175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:59.614183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601054808531649:5735]
2025-10-10T14:32:59.614188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601054808531649:5735]
2025-10-10T14:32:59.614193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601054808531649:5735]
2025-10-10T14:32:59.614236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:59.614243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:59.614248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:59.614252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.614253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:59.614254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:59.614394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:59.615645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:59.676359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601055590743551:7150]
2025-10-10T14:32:59.676656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 803, pipe: [1:7559601055590743551:7150]
2025-10-10T14:32:59.720797Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:59.721009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.721024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.721068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743551:7150], now have 1 active actors on pipe
2025-10-10T14:32:59.721282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:59.721301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:59.721399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:32:59.721422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601055590743551:7150]
2025-10-10T14:32:59.721477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 804 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0
2025-10-10T14:32:59.721704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 804 sessionId: src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0 is DEAD
2025-10-10T14:32:59.721827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:32:59.721838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0] Write session will restart in 0.005498s
2025-10-10T14:32:59.721858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0] Write session: Do CDS request
2025-10-10T14:32:59.721865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:59.728857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.728960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:59.728977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 805
2025-10-10T14:32:59.729123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.729172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:59.729190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:59.729195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:59.729606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 805 sessionId:  describe result for acl check
2025-10-10T14:32:59.729642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:59.729648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:59.729650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:59.729658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601055590743581:7171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:59.730211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601055590743581:7171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:59.732360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601055590743581:7171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:59.733801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:59.735848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:59.736058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:59.736057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601055590743581:7171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:59.736072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:59.736073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601055590743581:7171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:59.736077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601055590743581:7171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:59.736087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:59.736084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:59.736142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:59.736181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601054808531804:5744]
2025-10-10T14:32:59.736786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:59.737109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:59.737153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:59.737486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:59.737543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.737548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.737550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.737551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.737552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.737553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.737555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.737556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.737557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.737558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.737560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.737561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.737562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.737567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.737579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.737584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.737588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.737592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.737596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.737600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.737603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.737607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.737612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.737616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.737619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.737623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.737630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.737640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.737646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.737652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.737656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.737663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.737672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.737677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.737682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.737688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.737692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.737697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.737702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.737707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.737716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.737721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.737726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.737735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.737739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.737743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.737752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.737758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.737763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.737773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.737777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.737782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.737821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:59.740096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:59.740569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:59.740581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:59.740583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:59.740587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:59.740594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 804 [2:7559601054808531804:5744]
2025-10-10T14:32:59.740603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:59.740620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:59.740623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.740627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.740629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.740646Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:59.740655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:59.740661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:59.740699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.740705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.740706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.740708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:59.740760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:59.740765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.740773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.740779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.740789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:59.740814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743556:2438], now have 1 active actors on pipe
2025-10-10T14:32:59.740832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601054808531799:5744]
2025-10-10T14:32:59.740834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601054808531799:5744]
2025-10-10T14:32:59.740836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601054808531799:5744]
2025-10-10T14:32:59.740846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:59.740853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743690:7171], now have 1 active actors on pipe
2025-10-10T14:32:59.740860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:59.740860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:59.740863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:59.740865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:59.740880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:59.740883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:59.740906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601054808531799:5744]
2025-10-10T14:32:59.740914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:59.740916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:59.740887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 804
2025-10-10T14:32:59.740947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 804
2025-10-10T14:32:59.741014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.741024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.741051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|398bbe3a-76e01bb0-9979959f-81098067_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:59.741062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.741067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.741074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:59.741085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.741101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:59.741118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.741301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.741310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.741326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.741426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 805 partition: 0 MaxSeqNo: 40 sessionId: src_id|398bbe3a-76e01bb0-9979959f-81098067_0
2025-10-10T14:32:59.741792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cfe4802-5c5f68d7-7201b696-33284dd2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|398bbe3a-76e01bb0-9979959f-81098067_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:59.744449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|398bbe3a-76e01bb0-9979959f-81098067_0] Write session: try to update token
2025-10-10T14:32:59.744469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|398bbe3a-76e01bb0-9979959f-81098067_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:59.758461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId: src_id|398bbe3a-76e01bb0-9979959f-81098067_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:59.759631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:59.759649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:59.759652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:59.759654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:59.759665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601054808531799:5744]
2025-10-10T14:32:59.759669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601054808531799:5744]
2025-10-10T14:32:59.759673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601054808531799:5744]
2025-10-10T14:32:59.759702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:59.759708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:59.759712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:59.759715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:59.759722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.759725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:59.759874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:59.761014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:59.821772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601055590743714:7150]
2025-10-10T14:32:59.822021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 804, pipe: [1:7559601055590743714:7150]
2025-10-10T14:32:59.864386Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:32:59.864681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.864693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.864730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743714:7150], now have 1 active actors on pipe
2025-10-10T14:32:59.864916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:32:59.864971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:32:59.864979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:32:59.864985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:32:59.865026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601055590743714:7150]
2025-10-10T14:32:59.865046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 805 reason: error at write: Disconnected sessionId: src_id|398bbe3a-76e01bb0-9979959f-81098067_0
2025-10-10T14:32:59.865248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 805 sessionId: src_id|398bbe3a-76e01bb0-9979959f-81098067_0 is DEAD
2025-10-10T14:32:59.865401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398bbe3a-76e01bb0-9979959f-81098067_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:32:59.865413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398bbe3a-76e01bb0-9979959f-81098067_0] Write session will restart in 0.005790s
2025-10-10T14:32:59.865437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398bbe3a-76e01bb0-9979959f-81098067_0] Write session: Do CDS request
2025-10-10T14:32:59.865443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398bbe3a-76e01bb0-9979959f-81098067_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:32:59.872841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|398bbe3a-76e01bb0-9979959f-81098067_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.872915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:32:59.872927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 806
2025-10-10T14:32:59.873088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:32:59.873127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:32:59.873134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:32:59.873138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:32:59.873527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 806 sessionId:  describe result for acl check
2025-10-10T14:32:59.873562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:32:59.873569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:32:59.873571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:32:59.873579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601055590743764:7178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:32:59.874083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601055590743764:7178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:32:59.876002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601055590743764:7178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:32:59.875996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:32:59.877665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:32:59.877846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:32:59.877860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:32:59.877872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:32:59.877928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:32:59.877967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601054808531965:5753]
2025-10-10T14:32:59.878460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:32:59.878548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601055590743764:7178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:32:59.878561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601055590743764:7178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:32:59.878565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601055590743764:7178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:32:59.878572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:32:59.878718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:32:59.878752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:32:59.879032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:32:59.879088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.879095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.879096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.879097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.879098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.879099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.879100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.879102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.879103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.879104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.879105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.879107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.879108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.879125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.879137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.879142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.879146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.879149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.879154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.879158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.879162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.879166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.879170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.879174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.879178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.879181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.879188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.879196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:32:59.879203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.879208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:32:59.879212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.879218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:32:59.879222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.879227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:32:59.879233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.879243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:32:59.879247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.879251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:32:59.879256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.879260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:32:59.879262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.879266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:32:59.879270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.879276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:32:59.879279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.879282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:32:59.879285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.879288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.879294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.879297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.879300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.879303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.879326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:32:59.881519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:32:59.881832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:32:59.881845Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:32:59.881847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:32:59.881851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:32:59.881856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 805 [2:7559601054808531965:5753]
2025-10-10T14:32:59.881869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:32:59.881889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:32:59.881896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.881899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.881902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.881918Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:32:59.881930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:32:59.881942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:32:59.881998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.882004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.882006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.882008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:32:59.882077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:32:59.882084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.882095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:32:59.882112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:32:59.882133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:32:59.882158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743844:7178], now have 1 active actors on pipe
2025-10-10T14:32:59.882167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743715:2438], now have 1 active actors on pipe
2025-10-10T14:32:59.882174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601054808531959:5753]
2025-10-10T14:32:59.882176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601054808531959:5753]
2025-10-10T14:32:59.882178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601054808531959:5753]
2025-10-10T14:32:59.882192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:32:59.882182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 805
2025-10-10T14:32:59.882192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 805
2025-10-10T14:32:59.882205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:32:59.882211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:32:59.882216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:32:59.882218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:32:59.882226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:32:59.882229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:32:59.882268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.882277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.882292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601054808531959:5753]
2025-10-10T14:32:59.882303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:32:59.882312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:32:59.882336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3958abab-a58827b-c37758a8-c22dc1a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:32:59.882348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:32:59.882352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:32:59.882354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:32:59.882367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:32:59.882380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:32:59.882399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.882508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:32:59.882516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:32:59.882530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:32:59.882605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 806 partition: 0 MaxSeqNo: 40 sessionId: src_id|3958abab-a58827b-c37758a8-c22dc1a5_0
2025-10-10T14:32:59.882983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398bbe3a-76e01bb0-9979959f-81098067_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3958abab-a58827b-c37758a8-c22dc1a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:32:59.885548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3958abab-a58827b-c37758a8-c22dc1a5_0] Write session: try to update token
2025-10-10T14:32:59.885563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3958abab-a58827b-c37758a8-c22dc1a5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:32:59.898453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId: src_id|3958abab-a58827b-c37758a8-c22dc1a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:32:59.900886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:32:59.900956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:32:59.900972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:32:59.900975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:32:59.900976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:32:59.900983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601054808531959:5753]
2025-10-10T14:32:59.900986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601054808531959:5753]
2025-10-10T14:32:59.900989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601054808531959:5753]
2025-10-10T14:32:59.901026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:32:59.901026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:32:59.901032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:32:59.901035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:32:59.901039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:32:59.901042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:32:59.901167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:32:59.965140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601055590743853:7150]
2025-10-10T14:32:59.965410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 805, pipe: [1:7559601055590743853:7150]
2025-10-10T14:33:00.009106Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:00.009502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.009518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.009558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601055590743853:7150], now have 1 active actors on pipe
2025-10-10T14:33:00.009830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:00.009844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:00.009851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:00.009862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:00.009901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601055590743853:7150]
2025-10-10T14:33:00.009903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 806 reason: error at write: Disconnected sessionId: src_id|3958abab-a58827b-c37758a8-c22dc1a5_0
2025-10-10T14:33:00.010124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 806 sessionId: src_id|3958abab-a58827b-c37758a8-c22dc1a5_0 is DEAD
2025-10-10T14:33:00.010366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3958abab-a58827b-c37758a8-c22dc1a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:00.010376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3958abab-a58827b-c37758a8-c22dc1a5_0] Write session will restart in 0.005036s
2025-10-10T14:33:00.010401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3958abab-a58827b-c37758a8-c22dc1a5_0] Write session: Do CDS request
2025-10-10T14:33:00.010411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3958abab-a58827b-c37758a8-c22dc1a5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:00.016771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3958abab-a58827b-c37758a8-c22dc1a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.016861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:00.016879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 807
2025-10-10T14:33:00.016983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.017010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:00.017018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:00.017021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:00.017458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 807 sessionId:  describe result for acl check
2025-10-10T14:33:00.017496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:00.017501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:00.017503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:00.017507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601059885711165:7182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:00.017923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601059885711165:7182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:00.020285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601059885711165:7182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:00.022394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:00.024119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:00.024244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601059885711165:7182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:00.024263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601059885711165:7182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:00.024267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601059885711165:7182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:00.024275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:00.024332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:00.024345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:00.024358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:00.024413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:00.024453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601059103499398:5755]
2025-10-10T14:33:00.025050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:00.025363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:00.025404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:00.025707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:00.025760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.025765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.025766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.025767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.025768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.025769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.025770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.025772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.025773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.025774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.025775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.025776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.025777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.025783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.025798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.025802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.025806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.025810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.025814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.025818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.025822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.025826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.025830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.025834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.025838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.025841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.025849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.025857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.025869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.025874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.025883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.025888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.025893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.025902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.025906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.025911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.025919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.025923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.025928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.025933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.025937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.025942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.025947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.025957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.025961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.025967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.025976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.025982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.025991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.025996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.026001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.026010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.026052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:00.028433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:00.028769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:00.028784Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:00.028786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:00.028790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:00.028797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 806 [2:7559601059103499398:5755]
2025-10-10T14:33:00.028810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:00.028832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:00.028843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.028847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.028850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.028868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:00.028882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:00.028894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:00.028959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.028966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.028968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.028971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:00.029041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:00.029049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.029060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.029073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.029095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:00.029121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711279:7182], now have 1 active actors on pipe
2025-10-10T14:33:00.029129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711151:2438], now have 1 active actors on pipe
2025-10-10T14:33:00.029136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601059103499393:5755]
2025-10-10T14:33:00.029143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601059103499393:5755]
2025-10-10T14:33:00.029146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601059103499393:5755]
2025-10-10T14:33:00.029154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:00.029169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:00.029137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 806
2025-10-10T14:33:00.029171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:00.029145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 806
2025-10-10T14:33:00.029174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:00.029176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:00.029189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:00.029192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:00.029236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.029245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.029259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601059103499393:5755]
2025-10-10T14:33:00.029271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:00.029278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:00.029307Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7ac3504-775177e2-bdf3243-c02a140b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:00.029319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.029323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.029343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:00.029356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.029371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:00.029398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.029569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.029580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.029596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.029693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 807 partition: 0 MaxSeqNo: 40 sessionId: src_id|d7ac3504-775177e2-bdf3243-c02a140b_0
2025-10-10T14:33:00.030037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3958abab-a58827b-c37758a8-c22dc1a5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d7ac3504-775177e2-bdf3243-c02a140b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:00.032706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac3504-775177e2-bdf3243-c02a140b_0] Write session: try to update token
2025-10-10T14:33:00.032723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac3504-775177e2-bdf3243-c02a140b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:00.047340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId: src_id|d7ac3504-775177e2-bdf3243-c02a140b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:00.048731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:00.048748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.048751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:00.048753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:00.048764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601059103499393:5755]
2025-10-10T14:33:00.048768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601059103499393:5755]
2025-10-10T14:33:00.048772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601059103499393:5755]
2025-10-10T14:33:00.048822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:00.048828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:00.048835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:00.048835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.048838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:00.048839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:00.048981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:00.050028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:00.110016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601059885711290:7150]
2025-10-10T14:33:00.110291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 806, pipe: [1:7559601059885711290:7150]
2025-10-10T14:33:00.131523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:33:00.131554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-10T14:33:00.155128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:00.155503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.155516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.155555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711290:7150], now have 1 active actors on pipe
2025-10-10T14:33:00.155748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:00.155842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:00.155844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601059885711290:7150]
2025-10-10T14:33:00.155862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:00.155864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:00.155876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-10T14:33:00.155931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 807 reason: error at write: Disconnected sessionId: src_id|d7ac3504-775177e2-bdf3243-c02a140b_0
2025-10-10T14:33:00.156143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 807 sessionId: src_id|d7ac3504-775177e2-bdf3243-c02a140b_0 is DEAD
2025-10-10T14:33:00.156297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac3504-775177e2-bdf3243-c02a140b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:00.156307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac3504-775177e2-bdf3243-c02a140b_0] Write session will restart in 0.007630s
2025-10-10T14:33:00.156330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac3504-775177e2-bdf3243-c02a140b_0] Write session: Do CDS request
2025-10-10T14:33:00.156338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac3504-775177e2-bdf3243-c02a140b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:00.165024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac3504-775177e2-bdf3243-c02a140b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.165004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:00.165021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 808
2025-10-10T14:33:00.165286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.165348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:00.165359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:00.165363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:00.165808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 808 sessionId:  describe result for acl check
2025-10-10T14:33:00.165847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:00.165849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:00.165850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:00.165854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601059885711378:7186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:00.166302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601059885711378:7186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:00.167574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:00.168246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601059885711378:7186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:00.169243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:00.169426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:00.169437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:00.169448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:00.169498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:00.169538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601059103499537:5758]
2025-10-10T14:33:00.169999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:00.170241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:00.170282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:00.170469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601059885711378:7186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:00.170481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601059885711378:7186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:00.170485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601059885711378:7186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:00.170492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:00.170577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:00.170636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.170642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.170643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.170644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.170645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.170646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.170648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.170649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.170650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.170651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.170652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.170654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.170655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.170660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.170672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.170676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.170681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.170685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.170689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.170693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.170697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.170701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.170705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.170709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.170713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.170717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.170723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.170733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.170739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.170745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.170749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.170754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.170759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.170764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.170769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.170774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.170784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.170789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.170794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.170801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.170810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.170815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.170820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.170827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.170832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.170841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.170846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.170852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.170856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.170863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.170868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.170873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.170917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:00.173041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:00.173376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:00.173386Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:00.173387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:00.173390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:00.173394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 807 [2:7559601059103499537:5758]
2025-10-10T14:33:00.173402Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:00.173415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:00.173417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.173419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.173420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.173436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:00.173449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:00.173456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:00.173506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.173514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.173516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.173518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:00.173578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:00.173582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.173589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.173595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.173611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:00.173637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711294:2438], now have 1 active actors on pipe
2025-10-10T14:33:00.173645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711425:7186], now have 1 active actors on pipe
2025-10-10T14:33:00.173652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601059103499532:5758]
2025-10-10T14:33:00.173655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601059103499532:5758]
2025-10-10T14:33:00.173657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601059103499532:5758]
2025-10-10T14:33:00.173670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:00.173678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:00.173681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:00.173682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:00.173687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:00.173704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:00.173711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:00.173712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 807
2025-10-10T14:33:00.173735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601059103499532:5758]
2025-10-10T14:33:00.173742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:00.173724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 807
2025-10-10T14:33:00.173752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:00.173794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.173804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.173869Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:33:00.173906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:00.173918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.173922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.173924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:00.173934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.173950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:00.173981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.174048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 4 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:33:00.174137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.174144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:33:00.174147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.174165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.174245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 808 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0
2025-10-10T14:33:00.174574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ac3504-775177e2-bdf3243-c02a140b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:00.177186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0] Write session: try to update token
2025-10-10T14:33:00.177205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:00.191704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId: src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:00.193162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:00.193183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.193186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:00.193188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:00.193196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601059103499532:5758]
2025-10-10T14:33:00.193200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601059103499532:5758]
2025-10-10T14:33:00.193205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601059103499532:5758]
2025-10-10T14:33:00.193257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:00.193261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:00.193264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.193267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:00.193272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:00.193275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:00.193437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:00.194402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:00.255934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601059885711448:7150]
2025-10-10T14:33:00.256109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 807, pipe: [1:7559601059885711448:7150]
2025-10-10T14:33:00.312523Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:00.312823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.312840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.312890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711448:7150], now have 1 active actors on pipe
2025-10-10T14:33:00.313130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:00.313126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:00.313134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601059885711448:7150]
2025-10-10T14:33:00.313140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:00.313161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:00.313230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 808 reason: error at write: Disconnected sessionId: src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0
2025-10-10T14:33:00.313476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 808 sessionId: src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0 is DEAD
2025-10-10T14:33:00.313615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:00.313627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0] Write session will restart in 0.006894s
2025-10-10T14:33:00.313663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0] Write session: Do CDS request
2025-10-10T14:33:00.313671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:00.321833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.321947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:00.321962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 809
2025-10-10T14:33:00.322100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.322151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:00.322163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:00.322167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:00.322609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 809 sessionId:  describe result for acl check
2025-10-10T14:33:00.322657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:00.322665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:00.322668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:00.322674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601059885711510:7191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:00.323250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601059885711510:7191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:00.325485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:00.325537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601059885711510:7191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:00.327235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:00.327442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:00.327453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:00.327464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:00.327526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:00.327520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601059885711510:7191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:00.327567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601059103499688:5762]
2025-10-10T14:33:00.327532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601059885711510:7191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:00.327535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601059885711510:7191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:00.327541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:00.328158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:00.328415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:00.328458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:00.328775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:00.328838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.328844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.328845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.328846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.328848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.328849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.328850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.328851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.328852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.328853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.328854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.328855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.328857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.328861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.328874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.328878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.328882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.328887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.328891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.328895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.328899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.328904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.328909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.328913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.328917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.328920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.328927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.328936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.328943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.328949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.328953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.328958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.328963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.328968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.328973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.328978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.328987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.328992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.328997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.329002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.329005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.329011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.329021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.329026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.329031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.329037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.329041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.329049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.329053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.329058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.329063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.329068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.329111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:00.331229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:00.331545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:00.331559Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:00.331561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:00.331565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:00.331570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 808 [2:7559601059103499688:5762]
2025-10-10T14:33:00.331582Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:00.331599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:00.331602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.331605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.331608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.331623Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:00.331631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:00.331638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:00.331688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.331696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.331698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.331701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:00.331760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:00.331768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.331780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.331791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.331814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:00.331838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711454:2438], now have 1 active actors on pipe
2025-10-10T14:33:00.331847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711584:7191], now have 1 active actors on pipe
2025-10-10T14:33:00.331854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601059103499683:5762]
2025-10-10T14:33:00.331860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601059103499683:5762]
2025-10-10T14:33:00.331862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601059103499683:5762]
2025-10-10T14:33:00.331876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:00.331862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 808
2025-10-10T14:33:00.331888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:00.331866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 808
2025-10-10T14:33:00.331893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:00.331896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:00.331898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:00.331908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:00.331912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:00.331943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.331953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.331972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601059103499683:5762]
2025-10-10T14:33:00.331983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:00.331992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:00.332012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:00.332024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.332028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.332030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:00.332041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.332056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:00.332075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.332195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.332203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.332216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.332285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 809 partition: 0 MaxSeqNo: 40 sessionId: src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0
2025-10-10T14:33:00.332641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9902b2-a906b26c-f0d6a61c-9e90640b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:00.335209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0] Write session: try to update token
2025-10-10T14:33:00.335227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:00.348975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId: src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:00.351035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:00.351053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.351056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:00.351057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:00.351065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601059103499683:5762]
2025-10-10T14:33:00.351068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601059103499683:5762]
2025-10-10T14:33:00.351073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601059103499683:5762]
2025-10-10T14:33:00.351113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:00.351125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:00.351136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.351138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:00.351141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:00.351145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:00.351286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:00.351574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:00.413139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601059885711595:7150]
2025-10-10T14:33:00.413415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 808, pipe: [1:7559601059885711595:7150]
2025-10-10T14:33:00.456341Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:00.456748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.456763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.456811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711595:7150], now have 1 active actors on pipe
2025-10-10T14:33:00.456972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:00.456985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:00.457016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601059885711595:7150]
2025-10-10T14:33:00.457034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:00.457113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 809 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0
2025-10-10T14:33:00.457352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 809 sessionId: src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0 is DEAD
2025-10-10T14:33:00.457471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:00.457481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0] Write session will restart in 0.007990s
2025-10-10T14:33:00.457507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0] Write session: Do CDS request
2025-10-10T14:33:00.457513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:00.466853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.466961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:00.466976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 810
2025-10-10T14:33:00.467105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.467149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:00.467160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:00.467164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:00.467593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 810 sessionId:  describe result for acl check
2025-10-10T14:33:00.467626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:00.467628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:00.467630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:00.467636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601059885711697:7195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:00.467916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:00.468180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601059885711697:7195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:00.469718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:00.469894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:00.469905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:00.469917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:00.469975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:00.470013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601059103499828:5764]
2025-10-10T14:33:00.470261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601059885711697:7195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:00.470606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:00.470853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:00.470893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:00.471219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:00.471275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.471281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.471282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.471283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.471284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.471285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.471287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.471288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.471289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.471290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.471291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.471292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.471293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.471299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.471310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.471314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.471318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.471323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.471327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.471331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.471335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.471339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.471343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.471347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.471351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.471355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.471361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.471370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.471376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.471382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.471387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.471392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.471396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.471402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.471406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.471412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.471422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.471427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.471432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.471437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.471446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.471451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.471456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.471465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.471470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.471475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.471480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.471489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.471493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.471499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.471508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.471513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.471554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:00.471934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601059885711697:7195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:00.471945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601059885711697:7195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:00.471947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601059885711697:7195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:00.471952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:00.473607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:00.473934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:00.473945Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:00.473948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:00.473951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:00.473956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 809 [2:7559601059103499828:5764]
2025-10-10T14:33:00.473969Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:00.473990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:00.473997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.474001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.474003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.474018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:00.474031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:00.474042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:00.474092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.474099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.474101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.474103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:00.474255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:00.474264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.474276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.474255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 809
2025-10-10T14:33:00.474273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 809
2025-10-10T14:33:00.474290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.474314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:00.474340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711597:2438], now have 1 active actors on pipe
2025-10-10T14:33:00.474347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711732:7195], now have 1 active actors on pipe
2025-10-10T14:33:00.474368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.474377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.474396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601059103499822:5764]
2025-10-10T14:33:00.474402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601059103499822:5764]
2025-10-10T14:33:00.474404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601059103499822:5764]
2025-10-10T14:33:00.474417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:00.474435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:00.474440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:00.474443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:00.474445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:00.474455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:00.474458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:00.474475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:00.474487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.474496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.474498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:00.474509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.474525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:00.474557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601059103499822:5764]
2025-10-10T14:33:00.474568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:00.474576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:00.474582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.474708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.474714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.474727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.474803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 810 partition: 0 MaxSeqNo: 40 sessionId: src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0
2025-10-10T14:33:00.475116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf61ac6-6985cf5a-e23ada5-2197eac0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:00.477517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0] Write session: try to update token
2025-10-10T14:33:00.477530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:00.490813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId: src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:00.491302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:00.491321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.491334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601059103499822:5764]
2025-10-10T14:33:00.491383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:00.491387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:00.491556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:00.491710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:00.491860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:00.492009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:00.492192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:00.492230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:00.493536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:00.493743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.493761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.493813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:00.493903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:00.503328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:00.503346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.503349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:00.503351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:00.503361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601059103499822:5764]
2025-10-10T14:33:00.503366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601059103499822:5764]
2025-10-10T14:33:00.503370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601059103499822:5764]
2025-10-10T14:33:00.503405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:00.503409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:00.503413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:00.503417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:00.503424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.503427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:00.503560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:00.557005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601059885711739:7150]
2025-10-10T14:33:00.557248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 809, pipe: [1:7559601059885711739:7150]
2025-10-10T14:33:00.620013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:00.627721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.627744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.627897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.627955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.628015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.628072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.628116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.628124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.628187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.628247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.628304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.628362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.628402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.628408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.628466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.628522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.628580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.628638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.628677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.628682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.628763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.628822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.628878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.628946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.628987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.628989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.629048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.629102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.629175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.629231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.629271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.629277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.629350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.629406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.629462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.629519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.629559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.629564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.629624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.629679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.629736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.629799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.629838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.629843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.629901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.629954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.630013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.630069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.630111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.630115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.630176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.630228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.630281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.630336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.630376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.630380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.630438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:00.630491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:00.630545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:00.630600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:00.630641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:00.630646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:00.630703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711739:7150], now have 1 active actors on pipe
2025-10-10T14:33:00.630967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601059885711739:7150]
2025-10-10T14:33:00.630975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:00.630979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:00.630997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:00.631008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 810 reason: error at write: Disconnected sessionId: src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0
2025-10-10T14:33:00.631208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 810 sessionId: src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0 is DEAD
2025-10-10T14:33:00.631358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:00.631371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0] Write session will restart in 0.005921s
2025-10-10T14:33:00.631394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0] Write session: Do CDS request
2025-10-10T14:33:00.631401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:00.631695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:00.638898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.638963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:00.638982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 811
2025-10-10T14:33:00.639498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.639536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:00.639542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:00.639546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:00.640097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 811 sessionId:  describe result for acl check
2025-10-10T14:33:00.640137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:00.640140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:00.640142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:00.640148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601059885711785:7201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:00.640688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601059885711785:7201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:00.643637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:00.643644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601059885711785:7201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:00.645743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:00.645947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:00.645957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:00.645969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:00.646020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:00.646060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601059103499971:5767]
2025-10-10T14:33:00.646125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601059885711785:7201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:00.646140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601059885711785:7201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:00.646143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601059885711785:7201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:00.646151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:00.646693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:00.646949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:00.646984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:00.647293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:00.647344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.647350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.647351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.647352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.647353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.647354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.647356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.647357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.647358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.647359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.647360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.647361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.647363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.647368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.647380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.647385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.647389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.647393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.647397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.647401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.647405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.647409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.647413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.647417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.647421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.647425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.647431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.647439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.647445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.647451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.647459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.647464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.647469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.647474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.647478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.647483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.647489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.647494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.647499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.647504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.647508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.647514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.647524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.647529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.647533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.647539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.647543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.647549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.647553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.647561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.647566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.647571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.647618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:00.649997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:00.650434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:00.650444Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:00.650448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:00.650452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:00.650458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 810 [2:7559601059103499971:5767]
2025-10-10T14:33:00.650471Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:00.650494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:00.650503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.650507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.650509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.650526Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:00.650534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:00.650543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:00.650600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.650607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.650609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.650612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:00.650679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:00.650687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.650699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.650711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.650732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:00.650762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711748:2438], now have 1 active actors on pipe
2025-10-10T14:33:00.650769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711884:7201], now have 1 active actors on pipe
2025-10-10T14:33:00.650777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601059103499966:5767]
2025-10-10T14:33:00.650784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601059103499966:5767]
2025-10-10T14:33:00.650786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601059103499966:5767]
2025-10-10T14:33:00.650804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:00.650780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 810
2025-10-10T14:33:00.650811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:00.650829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 810
2025-10-10T14:33:00.650814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:00.650815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:00.650825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:00.650842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:00.650845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:00.650886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.650896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.650911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601059103499966:5767]
2025-10-10T14:33:00.650923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:00.650934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:00.650956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:00.650969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.650974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.650976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:00.650988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.651004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:00.651034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.651236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.651248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.651285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.651403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 811 partition: 0 MaxSeqNo: 40 sessionId: src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0
2025-10-10T14:33:00.651840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd4f1ef-c57f3cb1-b63aa932-881728ac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:00.654555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0] Write session: try to update token
2025-10-10T14:33:00.654577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:00.668585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId: src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:00.669815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:00.669829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.669832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:00.669833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:00.669841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601059103499966:5767]
2025-10-10T14:33:00.669844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601059103499966:5767]
2025-10-10T14:33:00.669847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601059103499966:5767]
2025-10-10T14:33:00.669889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:00.669897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.669896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:00.669899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:00.669903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:00.669908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:00.670034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:00.671222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:00.731071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601059885711895:7150]
2025-10-10T14:33:00.731364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 810, pipe: [1:7559601059885711895:7150]
2025-10-10T14:33:00.773750Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:00.773936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.773954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.773990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711895:7150], now have 1 active actors on pipe
2025-10-10T14:33:00.774217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601059885711895:7150]
2025-10-10T14:33:00.774256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:00.774259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:00.774315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 811 reason: error at write: Disconnected sessionId: src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0
2025-10-10T14:33:00.774358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:00.774540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 811 sessionId: src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0 is DEAD
2025-10-10T14:33:00.774686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:00.774698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0] Write session will restart in 0.007321s
2025-10-10T14:33:00.774708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:00.774722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0] Write session: Do CDS request
2025-10-10T14:33:00.774728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:00.782954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.783022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:00.783054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 812
2025-10-10T14:33:00.783192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.783228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:00.783245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:00.783250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:00.783640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 812 sessionId:  describe result for acl check
2025-10-10T14:33:00.783673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:00.783676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:00.783678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:00.783685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601059885711965:7211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:00.784197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601059885711965:7211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:00.786304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:00.786333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601059885711965:7211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:00.788492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:00.788651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:00.788661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:00.788670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:00.788709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:00.788740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601059103500125:5775]
2025-10-10T14:33:00.789074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601059885711965:7211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:00.789088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601059885711965:7211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:00.789092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601059885711965:7211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:00.789100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:00.789146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:00.789428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:00.789481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:00.789707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:00.789744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.789748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.789749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.789750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.789750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.789751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.789751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.789752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.789753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.789753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.789754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.789755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.789755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.789759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.789767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.789769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.789771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.789774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.789776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.789778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.789780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.789782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.789784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.789786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.789788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.789790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.789795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.789801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.789806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.789810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.789812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.789816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.789818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.789822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.789825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.789829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.789832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.789835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.789838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.789841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.789843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.789846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.789849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.789852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.789855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.789858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.789861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.789865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.789867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.789870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.789873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.789876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.789899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:00.792278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:00.792611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:00.792621Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:00.792622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:00.792626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:00.792631Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 811 [2:7559601059103500125:5775]
2025-10-10T14:33:00.792639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:00.792653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:00.792655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.792658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.792659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.792673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:00.792682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:00.792689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:00.792755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.792761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.792762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.792764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:00.792831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:00.792839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.792850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.792861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.792882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:00.792907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885712041:7211], now have 1 active actors on pipe
2025-10-10T14:33:00.792913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885711909:2438], now have 1 active actors on pipe
2025-10-10T14:33:00.792921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601059103500120:5775]
2025-10-10T14:33:00.792924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601059103500120:5775]
2025-10-10T14:33:00.792927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601059103500120:5775]
2025-10-10T14:33:00.792941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:00.792959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:00.792961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:00.792969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:00.792971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:00.792979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:00.792983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:00.792979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 811
2025-10-10T14:33:00.793008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601059103500120:5775]
2025-10-10T14:33:00.793014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 811
2025-10-10T14:33:00.793015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:00.793024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:00.793032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.793037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.793090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a2080c7-f2113179-6b713090-cc8bc559_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:00.793101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.793105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.793107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:00.793117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.793133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:00.793156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.793325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.793401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.793427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.793549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 812 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a2080c7-f2113179-6b713090-cc8bc559_0
2025-10-10T14:33:00.793942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30193cf2-3c018088-b53aafdb-27dfbef5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a2080c7-f2113179-6b713090-cc8bc559_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:00.796547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2080c7-f2113179-6b713090-cc8bc559_0] Write session: try to update token
2025-10-10T14:33:00.796570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2080c7-f2113179-6b713090-cc8bc559_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:00.810452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId: src_id|8a2080c7-f2113179-6b713090-cc8bc559_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:00.812069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:00.812089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.812092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:00.812095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:00.812103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601059103500120:5775]
2025-10-10T14:33:00.812108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601059103500120:5775]
2025-10-10T14:33:00.812112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601059103500120:5775]
2025-10-10T14:33:00.812160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:00.812169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:00.812172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.812175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:00.812177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:00.812182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:00.812313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:00.813116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:00.874449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601059885712064:7150]
2025-10-10T14:33:00.874747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 811, pipe: [1:7559601059885712064:7150]
2025-10-10T14:33:00.916198Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:00.916483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.916495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.916539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885712064:7150], now have 1 active actors on pipe
2025-10-10T14:33:00.916723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:00.916788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:00.916805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:00.916872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 812 reason: error at write: Disconnected sessionId: src_id|8a2080c7-f2113179-6b713090-cc8bc559_0
2025-10-10T14:33:00.917094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 812 sessionId: src_id|8a2080c7-f2113179-6b713090-cc8bc559_0 is DEAD
2025-10-10T14:33:00.917261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:00.917296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2080c7-f2113179-6b713090-cc8bc559_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:00.917306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2080c7-f2113179-6b713090-cc8bc559_0] Write session will restart in 0.008254s
2025-10-10T14:33:00.917299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601059885712064:7150]
2025-10-10T14:33:00.917325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2080c7-f2113179-6b713090-cc8bc559_0] Write session: Do CDS request
2025-10-10T14:33:00.917344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2080c7-f2113179-6b713090-cc8bc559_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:00.926941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2080c7-f2113179-6b713090-cc8bc559_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.927020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:00.927036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 813
2025-10-10T14:33:00.927183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:00.927218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:00.927229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:00.927234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:00.927664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 813 sessionId:  describe result for acl check
2025-10-10T14:33:00.927703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:00.927710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:00.927711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:00.927718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601059885712168:7218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:00.927827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:00.928270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601059885712168:7218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:00.929952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:00.930183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:00.930193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:00.930205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:00.930190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601059885712168:7218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:00.930255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:00.930289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601059103500292:5784]
2025-10-10T14:33:00.930725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:00.930979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:00.931008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:00.931260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:00.931319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.931324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.931324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.931325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.931326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.931326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.931327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.931328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.931329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.931330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.931331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.931331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.931332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.931338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.931350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.931353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.931358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.931361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.931365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.931369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.931373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.931377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.931381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.931385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.931389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.931393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.931400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.931408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:00.931416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.931422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:00.931426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.931432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:00.931436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.931441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:00.931445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.931448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:00.931450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.931453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:00.931456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.931459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:00.931461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.931464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:00.931468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.931471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:00.931473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.931476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:00.931479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.931481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.931484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.931487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.931490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.931493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.931515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:00.933839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601059885712168:7218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:00.933857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601059885712168:7218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:00.933839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:00.933860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601059885712168:7218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:00.933871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:00.934163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:00.934175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:00.934177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:00.934181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:00.934187Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 812 [2:7559601059103500292:5784]
2025-10-10T14:33:00.934201Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:00.934218Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:00.934225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.934229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.934231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.934253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:00.934263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:00.934269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:00.934313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.934318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.934319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.934321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:00.934375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:00.934381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.934389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:00.934395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:00.934409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:00.934429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885712065:2438], now have 1 active actors on pipe
2025-10-10T14:33:00.934438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601059103500286:5784]
2025-10-10T14:33:00.934440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601059103500286:5784]
2025-10-10T14:33:00.934442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601059103500286:5784]
2025-10-10T14:33:00.934451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:00.934458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601059885712203:7218], now have 1 active actors on pipe
2025-10-10T14:33:00.934464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:00.934468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:00.934475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:00.934477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:00.934478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:00.934480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:00.934500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601059103500286:5784]
2025-10-10T14:33:00.934503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:00.934505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:00.934515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 812
2025-10-10T14:33:00.934555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 812
2025-10-10T14:33:00.934697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.934705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.934728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:00.934738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:00.934743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:00.934748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:00.934757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:00.934771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:00.934785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.934919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.934924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.934935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:00.935017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 813 partition: 0 MaxSeqNo: 40 sessionId: src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0
2025-10-10T14:33:00.935432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2080c7-f2113179-6b713090-cc8bc559_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:00.938545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0] Write session: try to update token
2025-10-10T14:33:00.938569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:00.945452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:00.945467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.945479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601059103500286:5784]
2025-10-10T14:33:00.945529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:00.945527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:00.945687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:00.945820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:00.945944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:00.946072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:00.946246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:00.946279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:00.953383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId: src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:00.955907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:00.956098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:00.956128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:00.956176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:00.956276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:00.963021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:00.963039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:00.963043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:00.963045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:00.963055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601059103500286:5784]
2025-10-10T14:33:00.963059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601059103500286:5784]
2025-10-10T14:33:00.963063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601059103500286:5784]
2025-10-10T14:33:00.963101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:00.963109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:00.963113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:00.963116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:00.963117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:00.963119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:00.963280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:01.017287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601064180679507:7150]
2025-10-10T14:33:01.017537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 812, pipe: [1:7559601064180679507:7150]
2025-10-10T14:33:01.074508Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:01.082509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.082536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.082708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.082767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.082831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.082898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.082949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.082960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.083024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.083080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.083163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.083230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.083274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.083282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.083347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.083408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.083491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.083590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.083648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.083656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.083762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.083928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.083995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.084058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.084100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.084107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.084175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.084236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.084297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.084359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.084403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.084413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.084477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.084535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.084597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.084663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.084711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.084718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.084780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.084841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.084905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.084967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.085015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.085022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.085085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.085144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.085207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.085272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.085315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.085324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.085406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.085465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.085527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.085589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.085631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.085638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.085704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.085763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.085825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.085886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.085929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.085937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.085999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679507:7150], now have 1 active actors on pipe
2025-10-10T14:33:01.086200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:01.086214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601064180679507:7150]
2025-10-10T14:33:01.086251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:01.086254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:01.086297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 813 reason: error at write: Disconnected sessionId: src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0
2025-10-10T14:33:01.086511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 813 sessionId: src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0 is DEAD
2025-10-10T14:33:01.086668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:01.086678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0] Write session will restart in 0.008528s
2025-10-10T14:33:01.086703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0] Write session: Do CDS request
2025-10-10T14:33:01.086709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:01.086920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:01.096880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.097359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:01.097376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 814
2025-10-10T14:33:01.097522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.097562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:01.097574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:01.097578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:01.098040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 814 sessionId:  describe result for acl check
2025-10-10T14:33:01.098080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:01.098086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:01.098089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:01.098096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601064180679610:7222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:01.098668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601064180679610:7222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:01.099630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:01.100911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601064180679610:7222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:01.101505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:01.101717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:01.101728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:01.101740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:01.101795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:01.101833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601063398467731:5786]
2025-10-10T14:33:01.102417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:01.102691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:01.102731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:01.103041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:01.103101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.103107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.103108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.103109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.103110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.103111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.103112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.103113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.103114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.103115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.103116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.103117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.103118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.103134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.103145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.103149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.103152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.103155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.103159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.103162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.103166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.103169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.103173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.103176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.103179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.103183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.103190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.103198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.103205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.103211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.103216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.103221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.103225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.103230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.103235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.103240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.103243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.103249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.103258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.103263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.103271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.103276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.103279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.103285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.103289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.103298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.103307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.103317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.103325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.103330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.103335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.103340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.103379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:01.103398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601064180679610:7222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:01.103413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601064180679610:7222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:01.103417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601064180679610:7222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:01.103425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:01.105464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:01.105757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:01.105766Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:01.105767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:01.105770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:01.105775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 813 [2:7559601063398467731:5786]
2025-10-10T14:33:01.105783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:01.105796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:01.105799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.105803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.105805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.105822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:01.105834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:01.105846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:01.105898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.105905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.105907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.105909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:01.105961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:01.105966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.105973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.105979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.105989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:01.106007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601063398467726:5786]
2025-10-10T14:33:01.106011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601063398467726:5786]
2025-10-10T14:33:01.106013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601063398467726:5786]
2025-10-10T14:33:01.106019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:01.106030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:01.106043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:01.106047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:01.106047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:01.106050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:01.106051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:01.106076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679646:7222], now have 1 active actors on pipe
2025-10-10T14:33:01.106086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679508:2438], now have 1 active actors on pipe
2025-10-10T14:33:01.106089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601063398467726:5786]
2025-10-10T14:33:01.106097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:01.106123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:01.106147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 813
2025-10-10T14:33:01.106153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 813
2025-10-10T14:33:01.106219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.106230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.106259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:01.106271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.106274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.106276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:01.106287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.106304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:01.106321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.106480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.106488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.106504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.106583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 814 partition: 0 MaxSeqNo: 40 sessionId: src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0
2025-10-10T14:33:01.106940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bbe542-2618f9ed-1c18f732-8bf4bc21_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:01.109516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0] Write session: try to update token
2025-10-10T14:33:01.109530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:01.123731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId: src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:01.124705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:01.124723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:01.124726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:01.124727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:01.124736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601063398467726:5786]
2025-10-10T14:33:01.124739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601063398467726:5786]
2025-10-10T14:33:01.124742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601063398467726:5786]
2025-10-10T14:33:01.124791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:01.124796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:01.124803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:01.124805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.124807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:01.124808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:01.124942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:01.126460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:01.186250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601064180679656:7150]
2025-10-10T14:33:01.186534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 813, pipe: [1:7559601064180679656:7150]
2025-10-10T14:33:01.227400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:01.227785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.227798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.227838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679656:7150], now have 1 active actors on pipe
2025-10-10T14:33:01.228114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:01.228129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:01.228206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 814 reason: error at write: Disconnected sessionId: src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0
2025-10-10T14:33:01.228261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601064180679656:7150]
2025-10-10T14:33:01.228296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:01.228372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 814 sessionId: src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0 is DEAD
2025-10-10T14:33:01.228496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:01.228503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0] Write session will restart in 0.005392s
2025-10-10T14:33:01.228521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0] Write session: Do CDS request
2025-10-10T14:33:01.228525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:01.228569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:01.234920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.235003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:01.235018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 815
2025-10-10T14:33:01.235134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.235169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:01.235180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:01.235184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:01.235599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 815 sessionId:  describe result for acl check
2025-10-10T14:33:01.235643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:01.235650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:01.235652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:01.235658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601064180679671:7226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:01.236220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601064180679671:7226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:01.238802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601064180679671:7226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:01.240179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:01.242143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:01.242289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601064180679671:7226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:01.242305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601064180679671:7226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:01.242309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601064180679671:7226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:01.242318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:01.242363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:01.242374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:01.242386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:01.242446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:01.242498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601063398467875:5788]
2025-10-10T14:33:01.243121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:01.243438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:01.243481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:01.243788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:01.243840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.243846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.243847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.243848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.243849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.243850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.243852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.243853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.243854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.243855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.243857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.243858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.243859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.243865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.243876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.243880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.243884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.243888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.243892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.243896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.243900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.243904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.243908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.243912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.243916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.243920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.243927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.243936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.243942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.243947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.243958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.243963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.243972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.243978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.243987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.243993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.243998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.244007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.244011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.244016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.244026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.244032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.244041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.244046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.244055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.244060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.244064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.244069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.244077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.244082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.244087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.244091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.244131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:01.246369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:01.246704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:01.246719Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:01.246721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:01.246725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:01.246731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 814 [2:7559601063398467875:5788]
2025-10-10T14:33:01.246743Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:01.246760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:01.246763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.246767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.246769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.246798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:01.246805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:01.246817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:01.246868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.246875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.246878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.246880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:01.246949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:01.246956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.246979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.246998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.247016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:01.247040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679793:7226], now have 1 active actors on pipe
2025-10-10T14:33:01.247048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679657:2438], now have 1 active actors on pipe
2025-10-10T14:33:01.247055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601063398467870:5788]
2025-10-10T14:33:01.247059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601063398467870:5788]
2025-10-10T14:33:01.247061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601063398467870:5788]
2025-10-10T14:33:01.247073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:01.247091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:01.247094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:01.247097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:01.247099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:01.247112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:01.247116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:01.247080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 814
2025-10-10T14:33:01.247085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 814
2025-10-10T14:33:01.247160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.247169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.247189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601063398467870:5788]
2025-10-10T14:33:01.247202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:01.247219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:01.247238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:01.247246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.247254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.247256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:01.247267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.247282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:01.247307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.247459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.247468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.247484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.247579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 815 partition: 0 MaxSeqNo: 40 sessionId: src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0
2025-10-10T14:33:01.247976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3df1e8a0-2f2b9f07-5098772c-e8617018_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:01.250592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Write session: try to update token
2025-10-10T14:33:01.250608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:01.264342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId: src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:01.265836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:01.265854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:01.265857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:01.265859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:01.265868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601063398467870:5788]
2025-10-10T14:33:01.265872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601063398467870:5788]
2025-10-10T14:33:01.265876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601063398467870:5788]
2025-10-10T14:33:01.265921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:01.265920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:01.265926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:01.265930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:01.265934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.265936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:01.266073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:01.266968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:01.328577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601064180679830:7150]
2025-10-10T14:33:01.328836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 814, pipe: [1:7559601064180679830:7150]
2025-10-10T14:33:01.371949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:01.372402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.372421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.372484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679830:7150], now have 1 active actors on pipe
2025-10-10T14:33:01.372656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:01.372702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601064180679830:7150]
2025-10-10T14:33:01.372734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:01.372737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:01.372741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:01.372805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 815 reason: error at write: Disconnected sessionId: src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0
2025-10-10T14:33:01.373012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 815 sessionId: src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0 is DEAD
2025-10-10T14:33:01.373181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 125 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:33:01.373216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:01.373220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Write session will restart in 0.009850s
2025-10-10T14:33:01.373245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Write session: Do CDS request
2025-10-10T14:33:01.373251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:01.383844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.383903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:01.383920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 816
2025-10-10T14:33:01.384052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.384085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:01.384095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:01.384098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:01.384150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:01.384513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 816 sessionId:  describe result for acl check
2025-10-10T14:33:01.384548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:01.384555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:01.384556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:01.384564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601064180679939:7240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:01.385099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601064180679939:7240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:01.385917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:01.386078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:01.386088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:01.386099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:01.386151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:01.386191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601063398468032:5791]
2025-10-10T14:33:01.386757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:01.387047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:01.387090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:01.387165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601064180679939:7240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:01.387398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:01.387451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.387457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.387458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.387459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.387460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.387461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.387462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.387463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.387464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.387465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.387466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.387467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.387469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.387474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.387486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.387490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.387494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.387498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.387502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.387506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.387510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.387514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.387518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.387521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.387525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.387529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.387535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.387543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.387551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.387556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.387560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.387565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.387569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.387573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.387577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.387582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.387586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.387591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.387596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.387601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.387606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.387611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.387616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.387622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.387631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.387636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.387640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.387645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.387652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.387656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.387661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.387665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.387704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:01.389779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601064180679939:7240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:01.389793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601064180679939:7240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:01.389797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601064180679939:7240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:01.389805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:01.389898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:01.390214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:01.390226Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:01.390228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:01.390231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:01.390237Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 815 [2:7559601063398468032:5791]
2025-10-10T14:33:01.390247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:01.390264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:01.390272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.390275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.390277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.390293Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:01.390308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:01.390315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:01.390364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.390371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.390373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.390376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:01.390439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:01.390445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.390456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.390473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.390489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:01.390514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679972:7240], now have 1 active actors on pipe
2025-10-10T14:33:01.390522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679831:2438], now have 1 active actors on pipe
2025-10-10T14:33:01.390528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601063398468026:5791]
2025-10-10T14:33:01.390531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601063398468026:5791]
2025-10-10T14:33:01.390533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601063398468026:5791]
2025-10-10T14:33:01.390547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:01.390543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 815
2025-10-10T14:33:01.390564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:01.390570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:01.390573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:01.390555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 815
2025-10-10T14:33:01.390575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:01.390584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:01.390588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:01.390620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.390630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.390650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601063398468026:5791]
2025-10-10T14:33:01.390662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:01.390675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:01.390693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:01.390705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.390712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.390715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:01.390726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.390741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:01.390766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.390891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.390898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.390913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.390998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 816 partition: 0 MaxSeqNo: 40 sessionId: src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0
2025-10-10T14:33:01.391265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eede1e48-631dba84-3c65cf77-67ac76b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:01.393714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0] Write session: try to update token
2025-10-10T14:33:01.393727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:01.407354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId: src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:01.409752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:01.409768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:01.409770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:01.409772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:01.409780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601063398468026:5791]
2025-10-10T14:33:01.409783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601063398468026:5791]
2025-10-10T14:33:01.409786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601063398468026:5791]
2025-10-10T14:33:01.409824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:01.409830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.409820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:01.409831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:01.409839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:01.409849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:01.409854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:01.409955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:01.472927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601064180679980:7150]
2025-10-10T14:33:01.473225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 815, pipe: [1:7559601064180679980:7150]
2025-10-10T14:33:01.512481Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:01.512954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.512968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.513008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679980:7150], now have 1 active actors on pipe
2025-10-10T14:33:01.513263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:01.513311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:01.513314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:01.513326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:01.513379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601064180679980:7150]
2025-10-10T14:33:01.513405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 816 reason: error at write: Disconnected sessionId: src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0
2025-10-10T14:33:01.513678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 816 sessionId: src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0 is DEAD
2025-10-10T14:33:01.513852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:01.513865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0] Write session will restart in 0.005907s
2025-10-10T14:33:01.513890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0] Write session: Do CDS request
2025-10-10T14:33:01.513901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:01.520823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.520910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:01.520926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 817
2025-10-10T14:33:01.521064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.521125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:01.521138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:01.521142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:01.521594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 817 sessionId:  describe result for acl check
2025-10-10T14:33:01.521627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:01.521634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:01.521636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:01.521641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601064180680008:7244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:01.522191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601064180680008:7244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:01.524345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601064180680008:7244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:01.525218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:01.526948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:01.527124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:01.527141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:01.527150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:01.527197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:01.527247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601063398468178:5793]
2025-10-10T14:33:01.527247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601064180680008:7244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:01.527261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601064180680008:7244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:01.527265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601064180680008:7244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:01.527272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:01.527782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:01.528001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:01.528032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:01.528248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:01.528298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.528304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.528305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.528306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.528307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.528307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.528308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.528309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.528309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.528310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.528311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.528311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.528312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.528315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.528323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.528326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.528328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.528330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.528332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.528334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.528337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.528341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.528345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.528348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.528351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.528355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.528362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.528369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.528376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.528381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.528384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.528389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.528394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.528399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.528404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.528409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.528413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.528418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.528422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.528427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.528431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.528436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.528441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.528446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.528451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.528455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.528459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.528464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.528472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.528477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.528481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.528486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.528527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:01.530659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:01.530945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:01.530952Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:01.530953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:01.530956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:01.530961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 816 [2:7559601063398468178:5793]
2025-10-10T14:33:01.530969Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:01.530980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:01.530985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.530987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.530989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.531000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:01.531006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:01.531012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:01.531050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.531056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.531057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.531059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:01.531106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:01.531113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.531121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.531142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.531157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:01.531178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680119:7244], now have 1 active actors on pipe
2025-10-10T14:33:01.531186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180679981:2438], now have 1 active actors on pipe
2025-10-10T14:33:01.531194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601063398468172:5793]
2025-10-10T14:33:01.531198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601063398468172:5793]
2025-10-10T14:33:01.531200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601063398468172:5793]
2025-10-10T14:33:01.531212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:01.531227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:01.531231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:01.531234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:01.531227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 816
2025-10-10T14:33:01.531236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:01.531245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:01.531232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 816
2025-10-10T14:33:01.531248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:01.531268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601063398468172:5793]
2025-10-10T14:33:01.531275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:01.531277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:01.531291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.531301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.531399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:01.531412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.531415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.531416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:01.531426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.531438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:01.531463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.531595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.531603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.531617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.531691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 817 partition: 0 MaxSeqNo: 40 sessionId: src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0
2025-10-10T14:33:01.532092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b54560-ea9e8d9c-8ef98979-c687405b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:01.534775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0] Write session: try to update token
2025-10-10T14:33:01.534796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:01.549010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId: src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:01.549574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:01.549587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:01.549590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:01.549592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:01.549601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601063398468172:5793]
2025-10-10T14:33:01.549605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601063398468172:5793]
2025-10-10T14:33:01.549612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601063398468172:5793]
2025-10-10T14:33:01.549659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:01.549669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:01.549675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:01.549807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:01.549820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.549823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:01.549946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:01.551556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:01.613780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601064180680137:7150]
2025-10-10T14:33:01.614069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 816, pipe: [1:7559601064180680137:7150]
2025-10-10T14:33:01.654825Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:01.655054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.655067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.655110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680137:7150], now have 1 active actors on pipe
2025-10-10T14:33:01.655284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:01.655346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:01.655365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:01.655369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:01.655404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601064180680137:7150]
2025-10-10T14:33:01.655436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 817 reason: error at write: Disconnected sessionId: src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0
2025-10-10T14:33:01.655646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 817 sessionId: src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0 is DEAD
2025-10-10T14:33:01.655784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:01.655793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0] Write session will restart in 0.006896s
2025-10-10T14:33:01.655813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0] Write session: Do CDS request
2025-10-10T14:33:01.655819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:01.663914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.664002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:01.664021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 818
2025-10-10T14:33:01.664142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.664189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:01.664200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:01.664204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:01.664608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 818 sessionId:  describe result for acl check
2025-10-10T14:33:01.664642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:01.664649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:01.664651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:01.664656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601064180680248:7250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:01.665223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601064180680248:7250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:01.666099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:01.667435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601064180680248:7250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:01.667724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:01.667931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:01.667943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:01.667956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:01.668008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:01.668046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601063398468327:5796]
2025-10-10T14:33:01.668453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:01.668669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:01.668708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:01.668931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:01.668978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.668984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.668985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.668986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.668987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.668988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.668989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.668991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.668992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.668993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.668994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.668995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.668997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.669001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.669014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.669018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.669023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.669026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.669030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.669035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.669039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.669043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.669047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.669052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.669056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.669060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.669067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.669075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.669082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.669093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.669098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.669103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.669112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.669118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.669123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.669129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.669137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.669143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.669148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.669158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.669165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.669170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.669178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.669184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.669192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.669197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.669206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.669211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.669220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.669225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.669233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.669238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.669276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:01.669539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601064180680248:7250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:01.669552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601064180680248:7250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:01.669556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601064180680248:7250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:01.669562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:01.671324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:01.671636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:01.671645Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:01.671647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:01.671650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:01.671655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 817 [2:7559601063398468327:5796]
2025-10-10T14:33:01.671667Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:01.671683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:01.671690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.671693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.671696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.671713Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:01.671725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:01.671732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:01.671779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.671785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.671786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.671789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:01.671852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:01.671859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.671870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.671883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.671904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:01.671938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680285:7250], now have 1 active actors on pipe
2025-10-10T14:33:01.671946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680142:2438], now have 1 active actors on pipe
2025-10-10T14:33:01.671953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601063398468321:5796]
2025-10-10T14:33:01.671959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601063398468321:5796]
2025-10-10T14:33:01.671961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601063398468321:5796]
2025-10-10T14:33:01.671977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:01.671967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 817
2025-10-10T14:33:01.671994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:01.671969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 817
2025-10-10T14:33:01.672010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:01.672014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:01.672017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:01.672019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:01.672021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:01.672055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.672063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.672081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601063398468321:5796]
2025-10-10T14:33:01.672092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:01.672101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:01.672119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb392827-297b2fad-1246bece-d52f5b3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:01.672130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.672134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.672139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:01.672151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.672173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:01.672194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.672325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.672336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.672356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.672441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 818 partition: 0 MaxSeqNo: 40 sessionId: src_id|eb392827-297b2fad-1246bece-d52f5b3f_0
2025-10-10T14:33:01.672761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66bedfd5-98f98ec7-5b708e48-942e926c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eb392827-297b2fad-1246bece-d52f5b3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:01.675184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb392827-297b2fad-1246bece-d52f5b3f_0] Write session: try to update token
2025-10-10T14:33:01.675197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb392827-297b2fad-1246bece-d52f5b3f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:01.688189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId: src_id|eb392827-297b2fad-1246bece-d52f5b3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:01.690634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:01.690646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:01.690650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:01.690653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:01.690655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:01.690665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601063398468321:5796]
2025-10-10T14:33:01.690670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601063398468321:5796]
2025-10-10T14:33:01.690674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601063398468321:5796]
2025-10-10T14:33:01.690716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:01.690721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:01.690722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:01.690725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:01.690728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.690731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:01.690863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:01.755605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601064180680293:7150]
2025-10-10T14:33:01.755875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 817, pipe: [1:7559601064180680293:7150]
2025-10-10T14:33:01.796262Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:01.796672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.796685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.796724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680293:7150], now have 1 active actors on pipe
2025-10-10T14:33:01.796909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:01.796957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:01.796972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:01.796987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601064180680293:7150]
2025-10-10T14:33:01.797008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:01.797036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 818 reason: error at write: Disconnected sessionId: src_id|eb392827-297b2fad-1246bece-d52f5b3f_0
2025-10-10T14:33:01.797275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 818 sessionId: src_id|eb392827-297b2fad-1246bece-d52f5b3f_0 is DEAD
2025-10-10T14:33:01.797474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb392827-297b2fad-1246bece-d52f5b3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:01.797484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb392827-297b2fad-1246bece-d52f5b3f_0] Write session will restart in 0.005475s
2025-10-10T14:33:01.797504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb392827-297b2fad-1246bece-d52f5b3f_0] Write session: Do CDS request
2025-10-10T14:33:01.797508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb392827-297b2fad-1246bece-d52f5b3f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:01.803866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb392827-297b2fad-1246bece-d52f5b3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.803952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:01.803970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 819
2025-10-10T14:33:01.804079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.804114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:01.804124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:01.804128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:01.804558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 819 sessionId:  describe result for acl check
2025-10-10T14:33:01.804595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:01.804596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:01.804598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:01.804602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601064180680309:7254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:01.805069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601064180680309:7254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:01.807778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601064180680309:7254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:01.809736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:01.811568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:01.811749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:01.811761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:01.811772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:01.811825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:01.811857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601063398468487:5798]
2025-10-10T14:33:01.812041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601064180680309:7254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:01.812057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601064180680309:7254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:01.812061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601064180680309:7254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:01.812071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:01.812238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:01.812510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:01.812572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:01.812896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:01.812952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.812958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.812959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.812960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.812962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.812963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.812964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.812965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.812966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.812967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.812968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.812969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.812971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.812977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.812990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.812994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.812998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.813002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.813008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.813012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.813016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.813019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.813023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.813027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.813031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.813034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.813041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.813054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.813064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.813070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.813074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.813079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.813083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.813088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.813097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.813102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.813107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.813116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.813120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.813129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.813136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.813141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.813147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.813150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.813153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.813159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.813162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.813164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.813169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.813173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.813175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.813181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.813204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:01.815677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:01.816201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:01.816213Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:01.816216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:01.816220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:01.816226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 818 [2:7559601063398468487:5798]
2025-10-10T14:33:01.816240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:01.816259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:01.816263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.816266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.816269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.816288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:01.816301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:01.816313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:01.816379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.816385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.816387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.816390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:01.816457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:01.816464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.816477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.816493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.816515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:01.816544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680447:7254], now have 1 active actors on pipe
2025-10-10T14:33:01.816551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680295:2438], now have 1 active actors on pipe
2025-10-10T14:33:01.816558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601063398468473:5798]
2025-10-10T14:33:01.816565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601063398468473:5798]
2025-10-10T14:33:01.816567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601063398468473:5798]
2025-10-10T14:33:01.816580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:01.816597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:01.816596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:01.816599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:01.816601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:01.816619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:01.816622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:01.816657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601063398468473:5798]
2025-10-10T14:33:01.816665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:01.816676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:01.816651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 818
2025-10-10T14:33:01.816684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 818
2025-10-10T14:33:01.816700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.816710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.816741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:01.816754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.816762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.816765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:01.816776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.816791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:01.816809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.816993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.817002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.817020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.817122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 819 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0
2025-10-10T14:33:01.817532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb392827-297b2fad-1246bece-d52f5b3f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:01.820141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0] Write session: try to update token
2025-10-10T14:33:01.820160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:01.828464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:01.828487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:01.828500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601063398468473:5798]
2025-10-10T14:33:01.828544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:01.828551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:01.828749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:01.828882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:01.829051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:01.829188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:01.829392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:01.829435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:01.833668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId: src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:01.836154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:01.836361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.836385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.836424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:01.836510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:01.846100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:01.846118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:01.846122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:01.846124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:01.846136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601063398468473:5798]
2025-10-10T14:33:01.846139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601063398468473:5798]
2025-10-10T14:33:01.846141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601063398468473:5798]
2025-10-10T14:33:01.846169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:01.846174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:01.846176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:01.846178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:01.846181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.846185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:01.846349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:01.896916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601064180680470:7150]
2025-10-10T14:33:01.897199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 818, pipe: [1:7559601064180680470:7150]
2025-10-10T14:33:01.956588Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:01.963663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.963684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.963849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.963914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.963974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.964036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.964081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.964089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.964153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.964209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.964266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.964630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.964680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.964688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.964758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.964839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.964900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.964957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.964997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.965003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.965066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.965126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.965187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.965245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.965286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.965292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.965366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.965421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.965481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.965540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.965583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.965589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.965651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.965709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.965768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.965827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.965870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.965877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.965940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.965995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.966056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.966114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.966160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.966173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.966244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.966299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.966360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.966417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.966460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.966466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.966526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.966579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.966634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.966693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.966733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.966738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.966796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:01.966851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:01.966908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:01.966965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:01.967085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:01.967091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:01.967150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680470:7150], now have 1 active actors on pipe
2025-10-10T14:33:01.967373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:01.967393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601064180680470:7150]
2025-10-10T14:33:01.967425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:01.967434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:01.967463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 819 reason: error at write: Disconnected sessionId: src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0
2025-10-10T14:33:01.967679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 819 sessionId: src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0 is DEAD
2025-10-10T14:33:01.967739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:01.967841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:01.967852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0] Write session will restart in 0.007365s
2025-10-10T14:33:01.967888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0] Write session: Do CDS request
2025-10-10T14:33:01.967894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:01.976837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.976939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:01.976955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 820
2025-10-10T14:33:01.977061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:01.977089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:01.977109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:01.977116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:01.977782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 820 sessionId:  describe result for acl check
2025-10-10T14:33:01.977829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:01.977837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:01.977838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:01.977843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601064180680554:7267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:01.978281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601064180680554:7267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:01.979562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:01.980181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601064180680554:7267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:01.981435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:01.981594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:01.981605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:01.981616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:01.981671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:01.981712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601063398468663:5813]
2025-10-10T14:33:01.982131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:01.982323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:01.982358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:01.982414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601064180680554:7267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:01.982426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601064180680554:7267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:01.982429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601064180680554:7267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:01.982435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:01.982557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:01.982592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.982596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.982597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.982597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.982598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.982599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.982599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.982600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.982601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.982602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.982602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.982603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.982603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.982607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.982615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.982618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.982620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.982622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.982624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.982627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.982628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.982631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.982633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.982635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.982637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.982639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.982644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.982649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:01.982655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.982659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:01.982661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.982665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:01.982669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.982674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:01.982679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.982683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:01.982687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.982692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:01.982696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.982701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:01.982706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.982711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:01.982722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.982725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:01.982729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.982732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:01.982734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.982737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.982740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.982743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.982745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.982748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.982771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:01.984962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:01.985294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:01.985303Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:01.985305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:01.985307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:01.985312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 819 [2:7559601063398468663:5813]
2025-10-10T14:33:01.985321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:01.985354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:01.985356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.985358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.985360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.985373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:01.985380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:01.985387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:01.985433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.985445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.985446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.985448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:01.985498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:01.985504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:01.985511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:01.985518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:01.985529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:01.985556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680475:2438], now have 1 active actors on pipe
2025-10-10T14:33:01.985566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601063398468658:5813]
2025-10-10T14:33:01.985567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601063398468658:5813]
2025-10-10T14:33:01.985569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601063398468658:5813]
2025-10-10T14:33:01.985580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:01.985590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601064180680615:7267], now have 1 active actors on pipe
2025-10-10T14:33:01.985598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:01.985598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:01.985601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:01.985602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:01.985611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:01.985614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:01.985630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601063398468658:5813]
2025-10-10T14:33:01.985640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:01.985642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:01.985636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 819
2025-10-10T14:33:01.985643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 819
2025-10-10T14:33:01.985666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.985673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.985699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:01.985708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:01.985711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:01.985712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:01.985721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:01.985732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:01.985745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.985849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:01.985855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:01.985866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:01.985948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 820 partition: 0 MaxSeqNo: 40 sessionId: src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0
2025-10-10T14:33:01.986322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0d6fb88-38246c24-4bfab8b8-db725973_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:01.988900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0] Write session: try to update token
2025-10-10T14:33:01.988920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:02.003526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId: src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:02.004368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:02.004387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:02.004391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:02.004394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:02.004403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601063398468658:5813]
2025-10-10T14:33:02.004408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601063398468658:5813]
2025-10-10T14:33:02.004414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601063398468658:5813]
2025-10-10T14:33:02.004467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:02.004466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:02.004473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:02.004475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:02.004478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.004480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:02.004619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:02.006126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:02.067411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601068475647920:7150]
2025-10-10T14:33:02.067715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 819, pipe: [1:7559601068475647920:7150]
2025-10-10T14:33:02.115186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:02.115693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.115707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.115746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475647920:7150], now have 1 active actors on pipe
2025-10-10T14:33:02.115935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:02.116010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:02.116025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601068475647920:7150]
2025-10-10T14:33:02.116067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:02.116153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 820 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0
2025-10-10T14:33:02.116359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 820 sessionId: src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0 is DEAD
2025-10-10T14:33:02.116569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:02.116578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0] Write session will restart in 0.008133s
2025-10-10T14:33:02.116603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0] Write session: Do CDS request
2025-10-10T14:33:02.116610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:02.125896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.125996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:02.126013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 821
2025-10-10T14:33:02.126143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.126187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:02.126200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:02.126204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:02.126706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 821 sessionId:  describe result for acl check
2025-10-10T14:33:02.126737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:02.126743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:02.126744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:02.126748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601068475648023:7271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:02.127183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601068475648023:7271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:02.128529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:02.129298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601068475648023:7271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:02.130441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:02.130628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:02.130640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:02.130651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:02.130699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:02.130740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601067693436110:5815]
2025-10-10T14:33:02.131240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:02.131361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601068475648023:7271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:02.131377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601068475648023:7271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:02.131380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601068475648023:7271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:02.131387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:02.131476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:02.131513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:02.131755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:02.131806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.131812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.131813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.131814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.131815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.131816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.131817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.131819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.131820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.131821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.131822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.131823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.131824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.131829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.131841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.131844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.131848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.131852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.131856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.131859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.131862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.131866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.131870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.131874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.131878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.131882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.131888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.131896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.131903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.131909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.131913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.131918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.131922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.131927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.131931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.131936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.131941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.131946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.131956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.131961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.131965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.131970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.131974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.131980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.131988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.131993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.131998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.132003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.132009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.132014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.132023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.132028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.132050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:02.134243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:02.134591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:02.134601Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:02.134603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:02.134607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:02.134612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 820 [2:7559601067693436110:5815]
2025-10-10T14:33:02.134624Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:02.134639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:02.134647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.134650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.134653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.134668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:02.134679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:02.134690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:02.134739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.134747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.134748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.134751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:02.134821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:02.134827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.134834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.134841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.134851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:02.134874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475647921:2438], now have 1 active actors on pipe
2025-10-10T14:33:02.134880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648067:7271], now have 1 active actors on pipe
2025-10-10T14:33:02.134885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601067693436105:5815]
2025-10-10T14:33:02.134886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601067693436105:5815]
2025-10-10T14:33:02.134888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601067693436105:5815]
2025-10-10T14:33:02.134896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:02.134906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:02.134911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:02.134914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:02.134916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:02.134920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:02.134923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:02.134945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601067693436105:5815]
2025-10-10T14:33:02.134957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:02.134976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:02.134973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 820
2025-10-10T14:33:02.134982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 820
2025-10-10T14:33:02.135054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.135061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.135090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|307e858b-41271be1-88948fef-380523a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:02.135103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.135107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.135109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:02.135120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.135143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:02.135159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.135305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.135313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.135327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.135455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 821 partition: 0 MaxSeqNo: 40 sessionId: src_id|307e858b-41271be1-88948fef-380523a0_0
2025-10-10T14:33:02.135826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4ea082-4357697-1a6a91d3-c245beb9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|307e858b-41271be1-88948fef-380523a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:02.138560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307e858b-41271be1-88948fef-380523a0_0] Write session: try to update token
2025-10-10T14:33:02.138577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307e858b-41271be1-88948fef-380523a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:02.153103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId: src_id|307e858b-41271be1-88948fef-380523a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:02.153477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:02.153495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:02.153499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:02.153501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:02.153510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601067693436105:5815]
2025-10-10T14:33:02.153515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601067693436105:5815]
2025-10-10T14:33:02.153519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601067693436105:5815]
2025-10-10T14:33:02.153565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:02.153566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:02.153572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.153573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:02.153573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:02.153577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:02.153705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:02.155831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:02.216407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601068475648076:7150]
2025-10-10T14:33:02.216740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 820, pipe: [1:7559601068475648076:7150]
2025-10-10T14:33:02.260673Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:02.260879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.260896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.260936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648076:7150], now have 1 active actors on pipe
2025-10-10T14:33:02.261115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:02.261123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:02.261132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:02.261134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:02.261178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601068475648076:7150]
2025-10-10T14:33:02.261199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 821 reason: error at write: Disconnected sessionId: src_id|307e858b-41271be1-88948fef-380523a0_0
2025-10-10T14:33:02.261416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 821 sessionId: src_id|307e858b-41271be1-88948fef-380523a0_0 is DEAD
2025-10-10T14:33:02.261579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307e858b-41271be1-88948fef-380523a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:02.261589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307e858b-41271be1-88948fef-380523a0_0] Write session will restart in 0.006422s
2025-10-10T14:33:02.261613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307e858b-41271be1-88948fef-380523a0_0] Write session: Do CDS request
2025-10-10T14:33:02.261621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307e858b-41271be1-88948fef-380523a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:02.268871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|307e858b-41271be1-88948fef-380523a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.268954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:02.268970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 822
2025-10-10T14:33:02.269108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.269146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:02.269158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:02.269161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:02.269588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 822 sessionId:  describe result for acl check
2025-10-10T14:33:02.269624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:02.269631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:02.269633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:02.269639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601068475648174:7276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:02.270153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601068475648174:7276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:02.271407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:02.271927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601068475648174:7276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:02.273092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:02.273243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:02.273252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:02.273261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:02.273297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:02.273326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601067693436274:5818]
2025-10-10T14:33:02.273707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:02.273950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:02.273983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:02.274200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:02.274222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601068475648174:7276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:02.274236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.274247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601068475648174:7276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:02.274240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.274241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.274241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.274250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601068475648174:7276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:02.274258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:02.274242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.274243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.274243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.274244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.274244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.274245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.274246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.274246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.274247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.274251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.274258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.274261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.274263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.274265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.274267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.274269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.274271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.274273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.274275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.274277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.274279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.274281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.274286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.274291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.274296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.274300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.274302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.274305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.274307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.274310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.274313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.274316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.274318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.274322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.274324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.274327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.274329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.274333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.274336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.274338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.274341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.274344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.274346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.274349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.274351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.274354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.274356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.274359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.274383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:02.276341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:02.276640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:02.276651Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:02.276653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:02.276655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:02.276660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 821 [2:7559601067693436274:5818]
2025-10-10T14:33:02.276668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:02.276680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:02.276682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.276684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.276686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.276697Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:02.276706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:02.276713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:02.276750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.276755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.276756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.276758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:02.276819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:02.276826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.276836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.276851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.276870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:02.276895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648089:2438], now have 1 active actors on pipe
2025-10-10T14:33:02.276900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648234:7276], now have 1 active actors on pipe
2025-10-10T14:33:02.276905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601067693436268:5818]
2025-10-10T14:33:02.276907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601067693436268:5818]
2025-10-10T14:33:02.276908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601067693436268:5818]
2025-10-10T14:33:02.276919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:02.276931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:02.276935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:02.276938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:02.276938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 821
2025-10-10T14:33:02.276939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 821
2025-10-10T14:33:02.276940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:02.276946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:02.276950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:02.276970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601067693436268:5818]
2025-10-10T14:33:02.276973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:02.276974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:02.276993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.277003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.277041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:02.277053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.277068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.277075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:02.277086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.277095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:02.277115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.277311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.277320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.277348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.277453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 822 partition: 0 MaxSeqNo: 40 sessionId: src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0
2025-10-10T14:33:02.277815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|307e858b-41271be1-88948fef-380523a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:02.280466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0] Write session: try to update token
2025-10-10T14:33:02.280485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:02.294244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId: src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:02.295186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:02.295204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:02.295206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:02.295207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:02.295215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601067693436268:5818]
2025-10-10T14:33:02.295219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601067693436268:5818]
2025-10-10T14:33:02.295222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601067693436268:5818]
2025-10-10T14:33:02.295269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:02.295281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.295282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:02.295284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:02.295286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:02.295294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:02.295413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:02.296918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:02.361349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601068475648244:7150]
2025-10-10T14:33:02.361585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 821, pipe: [1:7559601068475648244:7150]
2025-10-10T14:33:02.367493Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 8 CurrentSessionLifetimeMs: 121120 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:33:02.398809Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:02.399209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.399222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.399267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648244:7150], now have 1 active actors on pipe
2025-10-10T14:33:02.399526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:02.399527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601068475648244:7150]
2025-10-10T14:33:02.399545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:02.399551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:02.399562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:02.399633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 822 reason: error at write: Disconnected sessionId: src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0
2025-10-10T14:33:02.399897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 822 sessionId: src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0 is DEAD
2025-10-10T14:33:02.400042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:02.400052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0] Write session will restart in 0.006563s
2025-10-10T14:33:02.400076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0] Write session: Do CDS request
2025-10-10T14:33:02.400082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:02.407901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.407977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:02.407996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 823
2025-10-10T14:33:02.408133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.408174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:02.408196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:02.408200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:02.408688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 823 sessionId:  describe result for acl check
2025-10-10T14:33:02.408725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:02.408731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:02.408733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:02.408739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601068475648282:7280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:02.409293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601068475648282:7280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:02.411494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601068475648282:7280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:02.412301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:02.414220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:02.414300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601068475648282:7280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:02.414313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601068475648282:7280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:02.414317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601068475648282:7280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:02.414325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:02.414380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:02.414394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:02.414405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:02.414453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:02.414495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601067693436427:5820]
2025-10-10T14:33:02.414885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:02.415127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:02.415175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:02.415396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:02.415449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.415455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.415456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.415458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.415459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.415460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.415461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.415462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.415464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.415465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.415466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.415467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.415469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.415474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.415488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.415493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.415497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.415501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.415505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.415509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.415513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.415518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.415524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.415528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.415532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.415541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.415548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.415562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.415572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.415577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.415582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.415587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.415596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.415602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.415610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.415615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.415623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.415629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.415638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.415644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.415652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.415657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.415665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.415671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.415678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.415684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.415691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.415697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.415704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.415710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.415715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.415723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.415759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:02.418016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:02.418355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:02.418368Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:02.418370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:02.418374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:02.418380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 822 [2:7559601067693436427:5820]
2025-10-10T14:33:02.418393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:02.418424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:02.418430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.418434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.418437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.418455Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:02.418466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:02.418477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:02.418528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.418534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.418536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.418538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:02.418601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:02.418607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.418619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.418635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.418656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:02.418680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648389:7280], now have 1 active actors on pipe
2025-10-10T14:33:02.418687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648245:2438], now have 1 active actors on pipe
2025-10-10T14:33:02.418695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601067693436422:5820]
2025-10-10T14:33:02.418700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601067693436422:5820]
2025-10-10T14:33:02.418702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601067693436422:5820]
2025-10-10T14:33:02.418716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:02.418725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:02.418733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:02.418734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:02.418735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:02.418749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:02.418757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:02.418728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 822
2025-10-10T14:33:02.418744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 822
2025-10-10T14:33:02.418785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601067693436422:5820]
2025-10-10T14:33:02.418795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:02.418800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:02.418815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.418824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.418871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:02.418884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.418888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.418890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:02.418903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.418917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:02.418938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.419058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.419070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.419090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.419187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 823 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0
2025-10-10T14:33:02.419587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e8e4e16-237e2202-df7b2cc9-32ab5f4e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:02.422254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0] Write session: try to update token
2025-10-10T14:33:02.422272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:02.435680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId: src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:02.437446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:02.437462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:02.437465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:02.437466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:02.437476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601067693436422:5820]
2025-10-10T14:33:02.437480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601067693436422:5820]
2025-10-10T14:33:02.437482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601067693436422:5820]
2025-10-10T14:33:02.437521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:02.437529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.437531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:02.437541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:02.437554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:02.437559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:02.437666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:02.438168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:02.499499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601068475648401:7150]
2025-10-10T14:33:02.499762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 822, pipe: [1:7559601068475648401:7150]
2025-10-10T14:33:02.543447Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:02.543743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.543757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.543797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648401:7150], now have 1 active actors on pipe
2025-10-10T14:33:02.543962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:02.544002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:02.544005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:02.544018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:02.544064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601068475648401:7150]
2025-10-10T14:33:02.544093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 823 reason: error at write: Disconnected sessionId: src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0
2025-10-10T14:33:02.544290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 823 sessionId: src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0 is DEAD
2025-10-10T14:33:02.544482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:02.544495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0] Write session will restart in 0.006104s
2025-10-10T14:33:02.544533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0] Write session: Do CDS request
2025-10-10T14:33:02.544542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:02.551847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.551949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:02.551962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 824
2025-10-10T14:33:02.552111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.552146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:02.552154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:02.552156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:02.552702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 824 sessionId:  describe result for acl check
2025-10-10T14:33:02.552745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:02.552751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:02.552753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:02.552759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601068475648504:7284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:02.553313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601068475648504:7284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:02.554559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:02.555258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601068475648504:7284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:02.556508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:02.556720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:02.556731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:02.556743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:02.556798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:02.556849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601067693436581:5822]
2025-10-10T14:33:02.557488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:02.557778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:02.557825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:02.557983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601068475648504:7284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:02.557997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601068475648504:7284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:02.558000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601068475648504:7284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:02.558008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:02.558122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:02.558178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.558184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.558185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.558187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.558188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.558199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.558200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.558201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.558203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.558204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.558205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.558206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.558207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.558214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.558226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.558231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.558235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.558239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.558243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.558247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.558250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.558254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.558270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.558274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.558278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.558281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.558288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.558300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.558311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.558317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.558322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.558327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.558331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.558336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.558341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.558347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.558350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.558356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.558360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.558365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.558370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.558383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.558387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.558393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.558397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.558402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.558407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.558412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.558416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.558421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.558426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.558431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.558469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:02.560671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:02.561187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:02.561203Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:02.561206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:02.561209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:02.561216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 823 [2:7559601067693436581:5822]
2025-10-10T14:33:02.561229Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:02.561246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:02.561249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.561253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.561256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.561275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:02.561289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:02.561297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:02.561372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.561381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.561384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.561387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:02.561456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:02.561465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.561478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.561494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.561517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:02.561543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648402:2438], now have 1 active actors on pipe
2025-10-10T14:33:02.561551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648557:7284], now have 1 active actors on pipe
2025-10-10T14:33:02.561559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601067693436576:5822]
2025-10-10T14:33:02.561563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601067693436576:5822]
2025-10-10T14:33:02.561566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601067693436576:5822]
2025-10-10T14:33:02.561584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:02.561574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 823
2025-10-10T14:33:02.561587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 823
2025-10-10T14:33:02.561603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:02.561608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:02.561611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:02.561613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:02.561625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:02.561633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:02.561655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.561665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.561705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601067693436576:5822]
2025-10-10T14:33:02.561719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:02.561728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:02.561742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17f788be-4a620525-f961dc45-b7db3943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:02.561755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.561759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.561766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:02.561778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.561794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:02.561839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.561993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.562005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.562029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.562112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 824 partition: 0 MaxSeqNo: 40 sessionId: src_id|17f788be-4a620525-f961dc45-b7db3943_0
2025-10-10T14:33:02.562470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1f3ca0-2b2b7c2c-4a8cadde-88a0dd39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|17f788be-4a620525-f961dc45-b7db3943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:02.565058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f788be-4a620525-f961dc45-b7db3943_0] Write session: try to update token
2025-10-10T14:33:02.565075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f788be-4a620525-f961dc45-b7db3943_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:02.578980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId: src_id|17f788be-4a620525-f961dc45-b7db3943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:02.580224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:02.580241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:02.580244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:02.580246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:02.580258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601067693436576:5822]
2025-10-10T14:33:02.580263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601067693436576:5822]
2025-10-10T14:33:02.580266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601067693436576:5822]
2025-10-10T14:33:02.580307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:02.580314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:02.580320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.580321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:02.580323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:02.580336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:02.580467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:02.581615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:02.644425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601068475648577:7150]
2025-10-10T14:33:02.644708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 823, pipe: [1:7559601068475648577:7150]
2025-10-10T14:33:02.687422Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:02.687710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.687723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.687759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648577:7150], now have 1 active actors on pipe
2025-10-10T14:33:02.687911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:02.687954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:02.687994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601068475648577:7150]
2025-10-10T14:33:02.688011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:02.688080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 824 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17f788be-4a620525-f961dc45-b7db3943_0
2025-10-10T14:33:02.688254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 824 sessionId: src_id|17f788be-4a620525-f961dc45-b7db3943_0 is DEAD
2025-10-10T14:33:02.688400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f788be-4a620525-f961dc45-b7db3943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:02.688412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f788be-4a620525-f961dc45-b7db3943_0] Write session will restart in 0.006774s
2025-10-10T14:33:02.688437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f788be-4a620525-f961dc45-b7db3943_0] Write session: Do CDS request
2025-10-10T14:33:02.688443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f788be-4a620525-f961dc45-b7db3943_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:02.696906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17f788be-4a620525-f961dc45-b7db3943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.697043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:02.697060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 825
2025-10-10T14:33:02.697230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.697279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:02.697290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:02.697303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:02.697787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 825 sessionId:  describe result for acl check
2025-10-10T14:33:02.697837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:02.697844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:02.697846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:02.697853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601068475648662:7290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:02.698432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601068475648662:7290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:02.699962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:02.700699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601068475648662:7290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:02.701832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:02.702022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:02.702035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:02.702052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:02.702110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:02.702151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601067693436738:5825]
2025-10-10T14:33:02.702697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:02.702810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601068475648662:7290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:02.702822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601068475648662:7290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:02.702825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601068475648662:7290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:02.702830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:02.702953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:02.703005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:02.703282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:02.703337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.703344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.703345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.703346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.703347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.703349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.703350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.703351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.703352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.703354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.703355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.703356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.703357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.703363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.703376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.703380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.703384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.703388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.703393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.703397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.703401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.703405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.703409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.703413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.703417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.703420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.703427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.703436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.703442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.703461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.703465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.703476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.703478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.703482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.703485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.703488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.703491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.703494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.703497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.703500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.703503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.703506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.703508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.703512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.703514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.703517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.703520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.703524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.703526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.703529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.703532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.703534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.703556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:02.705871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:02.706258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:02.706271Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:02.706274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:02.706278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:02.706284Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 824 [2:7559601067693436738:5825]
2025-10-10T14:33:02.706297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:02.706320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:02.706328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.706332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.706334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.706351Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:02.706364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:02.706372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:02.706425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.706432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.706434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.706437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:02.706503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:02.706511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.706521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.706536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.706558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:02.706585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648578:2438], now have 1 active actors on pipe
2025-10-10T14:33:02.706593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648726:7290], now have 1 active actors on pipe
2025-10-10T14:33:02.706601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601067693436733:5825]
2025-10-10T14:33:02.706607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601067693436733:5825]
2025-10-10T14:33:02.706609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601067693436733:5825]
2025-10-10T14:33:02.706623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:02.706642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:02.706643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:02.706647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:02.706649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:02.706662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:02.706665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:02.706649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 824
2025-10-10T14:33:02.706659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 824
2025-10-10T14:33:02.706689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601067693436733:5825]
2025-10-10T14:33:02.706699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:02.706706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:02.706712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.706721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.706775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:02.706789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.706793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.706801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:02.706813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.706828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:02.706850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.707011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.707019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.707034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.707110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 825 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0
2025-10-10T14:33:02.707521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17f788be-4a620525-f961dc45-b7db3943_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:02.710146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0] Write session: try to update token
2025-10-10T14:33:02.710163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:02.723511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId: src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:02.725924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:02.725946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:02.725949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:02.725951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:02.725960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601067693436733:5825]
2025-10-10T14:33:02.725964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601067693436733:5825]
2025-10-10T14:33:02.725966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601067693436733:5825]
2025-10-10T14:33:02.726014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:02.726014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:02.726019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:02.726023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:02.726025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.726028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:02.726138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:02.726160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:02.788298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601068475648735:7150]
2025-10-10T14:33:02.788564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 824, pipe: [1:7559601068475648735:7150]
2025-10-10T14:33:02.834916Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:02.835357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.835372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.835410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648735:7150], now have 1 active actors on pipe
2025-10-10T14:33:02.835575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:02.835596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:02.835577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:02.835582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:02.835640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601068475648735:7150]
2025-10-10T14:33:02.835660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 825 reason: error at write: Disconnected sessionId: src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0
2025-10-10T14:33:02.835880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 825 sessionId: src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0 is DEAD
2025-10-10T14:33:02.836045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:02.836056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0] Write session will restart in 0.007979s
2025-10-10T14:33:02.836081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0] Write session: Do CDS request
2025-10-10T14:33:02.836088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:02.844848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.844956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:02.844972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 826
2025-10-10T14:33:02.845093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.845124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:02.845145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:02.845149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:02.845594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 826 sessionId:  describe result for acl check
2025-10-10T14:33:02.845636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:02.845642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:02.845643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:02.845648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601068475648851:7294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:02.846112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601068475648851:7294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:02.847066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:02.847970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601068475648851:7294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:02.848852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:02.849078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:02.849091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:02.849110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:02.849177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:02.849212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601067693436893:5827]
2025-10-10T14:33:02.849749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:02.849992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:02.850048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:02.850227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601068475648851:7294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:02.850242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601068475648851:7294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:02.850245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601068475648851:7294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:02.850253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:02.850402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:02.850458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.850465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.850466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.850467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.850469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.850470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.850471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.850473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.850474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.850475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.850477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.850478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.850479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.850485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.850496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.850500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.850504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.850508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.850512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.850515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.850519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.850522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.850526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.850529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.850533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.850536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.850545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.850553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.850559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.850564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.850568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.850573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.850577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.850582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.850587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.850593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.850598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.850602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.850612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.850621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.850625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.850634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.850643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.850649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.850656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.850661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.850669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.850674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.850682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.850687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.850696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.850706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.850750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:02.852958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:02.853380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:02.853389Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:02.853391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:02.853395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:02.853401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 825 [2:7559601067693436893:5827]
2025-10-10T14:33:02.853412Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:02.853431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:02.853439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.853443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.853445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.853461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:02.853475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:02.853482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:02.853536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.853543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.853545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.853549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:02.853615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:02.853622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.853633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.853649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.853671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:02.853701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648737:2438], now have 1 active actors on pipe
2025-10-10T14:33:02.853714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648886:7294], now have 1 active actors on pipe
2025-10-10T14:33:02.853721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601067693436888:5827]
2025-10-10T14:33:02.853724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601067693436888:5827]
2025-10-10T14:33:02.853727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601067693436888:5827]
2025-10-10T14:33:02.853741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:02.853756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:02.853740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 825
2025-10-10T14:33:02.853743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 825
2025-10-10T14:33:02.853764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:02.853771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:02.853774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:02.853774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:02.853776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:02.853814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.853824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.853837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601067693436888:5827]
2025-10-10T14:33:02.853849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:02.853864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:02.853883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f66cb66-13b54cd3-335d042c-94502567_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:02.853894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.853902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.853904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:02.853915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.853930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:02.853954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.854108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.854119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.854137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.854233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 826 partition: 0 MaxSeqNo: 40 sessionId: src_id|1f66cb66-13b54cd3-335d042c-94502567_0
2025-10-10T14:33:02.854594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f1866b1-a6e24d3a-2dcb271e-8307c40f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1f66cb66-13b54cd3-335d042c-94502567_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:02.857234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f66cb66-13b54cd3-335d042c-94502567_0] Write session: try to update token
2025-10-10T14:33:02.857252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f66cb66-13b54cd3-335d042c-94502567_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:02.871166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId: src_id|1f66cb66-13b54cd3-335d042c-94502567_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:02.872400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:02.872425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:02.872428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:02.872430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:02.872439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601067693436888:5827]
2025-10-10T14:33:02.872445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601067693436888:5827]
2025-10-10T14:33:02.872449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601067693436888:5827]
2025-10-10T14:33:02.872494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:02.872503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:02.872507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:02.872510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:02.872512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.872516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:02.872697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:02.874376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:02.935745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601068475648919:7150]
2025-10-10T14:33:02.936054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 825, pipe: [1:7559601068475648919:7150]
2025-10-10T14:33:02.978322Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:02.978663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.978681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.978724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648919:7150], now have 1 active actors on pipe
2025-10-10T14:33:02.978957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:02.978959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601068475648919:7150]
2025-10-10T14:33:02.978973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:02.978980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:02.979043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 826 reason: error at write: Disconnected sessionId: src_id|1f66cb66-13b54cd3-335d042c-94502567_0
2025-10-10T14:33:02.979215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:02.979290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 826 sessionId: src_id|1f66cb66-13b54cd3-335d042c-94502567_0 is DEAD
2025-10-10T14:33:02.979463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f66cb66-13b54cd3-335d042c-94502567_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:02.979473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f66cb66-13b54cd3-335d042c-94502567_0] Write session will restart in 0.008805s
2025-10-10T14:33:02.979493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f66cb66-13b54cd3-335d042c-94502567_0] Write session: Do CDS request
2025-10-10T14:33:02.979501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f66cb66-13b54cd3-335d042c-94502567_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:02.989095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:02.989774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f66cb66-13b54cd3-335d042c-94502567_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.989860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:02.989874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 827
2025-10-10T14:33:02.990060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:02.990088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:02.990095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:02.990099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:02.990435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 827 sessionId:  describe result for acl check
2025-10-10T14:33:02.990460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:02.990465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:02.990467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:02.990471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601068475649039:7307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:02.990933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601068475649039:7307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:02.991019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:02.991180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:02.991189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:02.991199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:02.991244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:02.991276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601067693437087:5842]
2025-10-10T14:33:02.991710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:02.991928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:02.991958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:02.992176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:02.992215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.992220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.992220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.992221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.992221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.992222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.992223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.992223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.992224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.992224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.992225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.992226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.992226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.992230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.992237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.992240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.992242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.992244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.992246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.992248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.992250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.992252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.992254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.992256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.992258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.992260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.992265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.992271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:02.992276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.992279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:02.992283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.992286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:02.992289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.992292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:02.992295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.992298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:02.992301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.992304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:02.992307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.992310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:02.992312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.992315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:02.992318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.992321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:02.992324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.992327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:02.992330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.992333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.992336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.992339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.992341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.992344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.992365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:02.992856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601068475649039:7307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:02.994537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:02.994898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:02.994910Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:02.994911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:02.994914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:02.994918Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 826 [2:7559601067693437087:5842]
2025-10-10T14:33:02.994927Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:02.994939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:02.994944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.994947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.994948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.994960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:02.994965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:02.994975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:02.995013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.995018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.995019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.995021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:02.995069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:02.995075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:02.995082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:02.995089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:02.995102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:02.995116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475648921:2438], now have 1 active actors on pipe
2025-10-10T14:33:02.995126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601067693437081:5842]
2025-10-10T14:33:02.995127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601067693437081:5842]
2025-10-10T14:33:02.995129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601067693437081:5842]
2025-10-10T14:33:02.995138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:02.995161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:02.995161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:02.995163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:02.995165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:02.995175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:02.995177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:02.995163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601068475649039:7307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:02.995172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 826
2025-10-10T14:33:02.995179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601068475649039:7307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:02.995183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601068475649039:7307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:02.995197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601067693437081:5842]
2025-10-10T14:33:02.995191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:02.995205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:02.995207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:02.995369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601068475649073:7307], now have 1 active actors on pipe
2025-10-10T14:33:02.995405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 826
2025-10-10T14:33:02.995461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.995468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.995490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|729ee4a6-9472ec73-99387008-d9bc4111_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:02.995499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:02.995503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:02.995504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:02.995513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:02.995521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:02.995532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.995697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:02.995705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:02.995720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:02.995807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 827 partition: 0 MaxSeqNo: 40 sessionId: src_id|729ee4a6-9472ec73-99387008-d9bc4111_0
2025-10-10T14:33:02.996103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f66cb66-13b54cd3-335d042c-94502567_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|729ee4a6-9472ec73-99387008-d9bc4111_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:02.998741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729ee4a6-9472ec73-99387008-d9bc4111_0] Write session: try to update token
2025-10-10T14:33:02.998757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729ee4a6-9472ec73-99387008-d9bc4111_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:03.012928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId: src_id|729ee4a6-9472ec73-99387008-d9bc4111_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:03.013812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:03.013830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:03.013833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:03.013835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:03.013846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601067693437081:5842]
2025-10-10T14:33:03.013851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601067693437081:5842]
2025-10-10T14:33:03.013856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601067693437081:5842]
2025-10-10T14:33:03.013895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:03.013905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:03.013910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:03.013912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.013914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:03.013914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:03.014052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:03.015471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:03.079125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601072770616376:7150]
2025-10-10T14:33:03.079458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 826, pipe: [1:7559601072770616376:7150]
2025-10-10T14:33:03.119301Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:03.119827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.119845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.119888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616376:7150], now have 1 active actors on pipe
2025-10-10T14:33:03.120096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:03.120132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601072770616376:7150]
2025-10-10T14:33:03.120136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:03.120168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:03.120262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 827 reason: status is not ok: tablet will be restarted right now sessionId: src_id|729ee4a6-9472ec73-99387008-d9bc4111_0
2025-10-10T14:33:03.120479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 827 sessionId: src_id|729ee4a6-9472ec73-99387008-d9bc4111_0 is DEAD
2025-10-10T14:33:03.120602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729ee4a6-9472ec73-99387008-d9bc4111_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:03.120614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729ee4a6-9472ec73-99387008-d9bc4111_0] Write session will restart in 0.006734s
2025-10-10T14:33:03.120640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729ee4a6-9472ec73-99387008-d9bc4111_0] Write session: Do CDS request
2025-10-10T14:33:03.120647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729ee4a6-9472ec73-99387008-d9bc4111_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:03.128842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729ee4a6-9472ec73-99387008-d9bc4111_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.128916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:03.128930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 828
2025-10-10T14:33:03.129058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.129108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:03.129119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:03.129123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:03.129567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 828 sessionId:  describe result for acl check
2025-10-10T14:33:03.129600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:03.129607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:03.129608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:03.129614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601072770616473:7311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:03.130160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601072770616473:7311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:03.131526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:03.132316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601072770616473:7311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:03.133268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:03.133467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:03.133478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:03.133489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:03.133543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:03.133581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601071988404541:5844]
2025-10-10T14:33:03.134192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:03.134411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601072770616473:7311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:03.134426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601072770616473:7311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:03.134429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601072770616473:7311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:03.134436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:03.134430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:03.134472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:03.134808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:03.134860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.134867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.134868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.134869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.134870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.134872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.134873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.134874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.134875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.134876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.134878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.134879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.134880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.134885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.134898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.134902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.134906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.134909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.134912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.134917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.134920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.134924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.134928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.134932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.134935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.134940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.134947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.134955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.134963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.134969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.134973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.134979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.134983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.134988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.134993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.134997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.135001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.135007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.135011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.135016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.135020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.135025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.135030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.135035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.135044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.135049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.135053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.135063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.135071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.135076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.135084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.135089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.135133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:03.137259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:03.137740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:03.137751Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:03.137753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:03.137757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:03.137762Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 827 [2:7559601071988404541:5844]
2025-10-10T14:33:03.137773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:03.137802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:03.137811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.137815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.137818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.137835Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:03.137847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:03.137862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:03.137917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.137925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.137927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.137929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:03.137993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:03.138001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.138013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.138026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.138049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:03.138074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616529:7311], now have 1 active actors on pipe
2025-10-10T14:33:03.138082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616377:2438], now have 1 active actors on pipe
2025-10-10T14:33:03.138089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601071988404535:5844]
2025-10-10T14:33:03.138092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601071988404535:5844]
2025-10-10T14:33:03.138094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601071988404535:5844]
2025-10-10T14:33:03.138106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:03.138120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:03.138121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:03.138124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:03.138126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:03.138113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 827
2025-10-10T14:33:03.138141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:03.138148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:03.138126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 827
2025-10-10T14:33:03.138180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.138188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.138207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601071988404535:5844]
2025-10-10T14:33:03.138218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:03.138226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:03.138243Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:03.138253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.138257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.138259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:03.138270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.138286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:03.138309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.138459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.138467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.138481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.138564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 828 partition: 0 MaxSeqNo: 40 sessionId: src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0
2025-10-10T14:33:03.138896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729ee4a6-9472ec73-99387008-d9bc4111_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:03.141532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0] Write session: try to update token
2025-10-10T14:33:03.141550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:03.155380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId: src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:03.156707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:03.156724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:03.156726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:03.156728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:03.156736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601071988404535:5844]
2025-10-10T14:33:03.156738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601071988404535:5844]
2025-10-10T14:33:03.156741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601071988404535:5844]
2025-10-10T14:33:03.156779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:03.156783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:03.156786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.156787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:03.156789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:03.156793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:03.156908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:03.157870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:03.220434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601072770616538:7150]
2025-10-10T14:33:03.220755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 827, pipe: [1:7559601072770616538:7150]
2025-10-10T14:33:03.260928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:03.261289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.261304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.261365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616538:7150], now have 1 active actors on pipe
2025-10-10T14:33:03.261543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:03.261595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:03.261616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:03.261678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 828 reason: error at write: Disconnected sessionId: src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0
2025-10-10T14:33:03.261711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601072770616538:7150]
2025-10-10T14:33:03.261734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:03.261855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 828 sessionId: src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0 is DEAD
2025-10-10T14:33:03.261992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:03.262003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0] Write session will restart in 0.006506s
2025-10-10T14:33:03.262027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0] Write session: Do CDS request
2025-10-10T14:33:03.262035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:03.269856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.269921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:03.269937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 829
2025-10-10T14:33:03.270048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.270082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:03.270092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:03.270096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:03.270459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 829 sessionId:  describe result for acl check
2025-10-10T14:33:03.270495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:03.270499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:03.270501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:03.270505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601072770616600:7316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:03.270943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601072770616600:7316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:03.273153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601072770616600:7316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:03.273822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:03.275627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:03.275726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601072770616600:7316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:03.275738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601072770616600:7316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:03.275740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601072770616600:7316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:03.275746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:03.275804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:03.275815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:03.275827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:03.275875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:03.275912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601071988404712:5847]
2025-10-10T14:33:03.276486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:03.276770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:03.276832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:03.277165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:03.277214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.277220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.277221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.277222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.277224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.277225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.277226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.277229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.277230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.277231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.277232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.277233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.277234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.277241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.277254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.277258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.277262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.277266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.277270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.277274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.277278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.277282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.277286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.277297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.277301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.277304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.277311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.277320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.277326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.277350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.277357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.277362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.277367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.277372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.277377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.277381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.277386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.277391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.277396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.277414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.277422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.277427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.277435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.277444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.277453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.277464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.277472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.277481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.277488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.277493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.277504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.277512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.277550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:03.279671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:03.280157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:03.280172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:03.280175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:03.280179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:03.280185Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 828 [2:7559601071988404712:5847]
2025-10-10T14:33:03.280198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:03.280215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:03.280223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.280227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.280229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.280245Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:03.280256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:03.280264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:03.280321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.280328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.280330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.280332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:03.280400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:03.280409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.280420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.280438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.280453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:03.280476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616541:2438], now have 1 active actors on pipe
2025-10-10T14:33:03.280484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616701:7316], now have 1 active actors on pipe
2025-10-10T14:33:03.280491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601071988404706:5847]
2025-10-10T14:33:03.280493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601071988404706:5847]
2025-10-10T14:33:03.280495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601071988404706:5847]
2025-10-10T14:33:03.280510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:03.280527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:03.280532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:03.280513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 828
2025-10-10T14:33:03.280513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 828
2025-10-10T14:33:03.280537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:03.280539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:03.280547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:03.280549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:03.280584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601071988404706:5847]
2025-10-10T14:33:03.280595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:03.280602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:03.280610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.280615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.280662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:03.280677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.280685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.280687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:03.280699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.280713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:03.280739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.280871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.280881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.280896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.280961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 829 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0
2025-10-10T14:33:03.281363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c099683e-40c4042e-782b2e1f-d9892ce8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:03.283982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0] Write session: try to update token
2025-10-10T14:33:03.283999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:03.297518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId: src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:03.300245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:03.300269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:03.300261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:03.300272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:03.300275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:03.300286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601071988404706:5847]
2025-10-10T14:33:03.300290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601071988404706:5847]
2025-10-10T14:33:03.300294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601071988404706:5847]
2025-10-10T14:33:03.300343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:03.300347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:03.300353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:03.300356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.300357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:03.300358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:03.300508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:03.361703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601072770616713:7150]
2025-10-10T14:33:03.361954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 828, pipe: [1:7559601072770616713:7150]
2025-10-10T14:33:03.404732Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:03.405024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.405036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.405073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616713:7150], now have 1 active actors on pipe
2025-10-10T14:33:03.405267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:03.405338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:03.405342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:03.405356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:03.405390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601072770616713:7150]
2025-10-10T14:33:03.405416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 829 reason: error at write: Disconnected sessionId: src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0
2025-10-10T14:33:03.405627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 829 sessionId: src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0 is DEAD
2025-10-10T14:33:03.405777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:03.405788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0] Write session will restart in 0.009402s
2025-10-10T14:33:03.405821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0] Write session: Do CDS request
2025-10-10T14:33:03.405827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:03.416821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.416910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:03.416926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 830
2025-10-10T14:33:03.417068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.417090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:03.417116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:03.417134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:03.417143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:03.417559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 830 sessionId:  describe result for acl check
2025-10-10T14:33:03.417593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:03.417598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:03.417600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:03.417604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601072770616836:7320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:03.417997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601072770616836:7320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:03.418891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:03.419099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:03.419115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:03.419137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:03.419196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:03.419233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601071988404872:5849]
2025-10-10T14:33:03.419611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:03.419786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601072770616836:7320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:03.419840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:03.419867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:03.420092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:03.420144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.420151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.420152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.420154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.420155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.420156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.420157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.420158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.420159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.420160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.420162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.420163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.420164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.420169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.420182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.420184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.420186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.420188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.420190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.420192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.420194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.420196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.420198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.420200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.420202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.420204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.420209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.420214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.420219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.420222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.420224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.420228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.420230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.420233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.420236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.420239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.420241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.420244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.420247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.420250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.420253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.420256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.420258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.420261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.420264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.420267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.420270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.420273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.420277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.420282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.420286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.420290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.420329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:03.422431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601072770616836:7320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:03.422446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:03.422446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601072770616836:7320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:03.422449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601072770616836:7320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:03.422456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:03.422830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:03.422845Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:03.422847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:03.422850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:03.422855Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 829 [2:7559601071988404872:5849]
2025-10-10T14:33:03.422867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:03.422883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:03.422885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.422889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.422895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.422910Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:03.422917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:03.422928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:03.422982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.422989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.422991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.422993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:03.423052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:03.423061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.423072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.423084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.423102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:03.423136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616714:2438], now have 1 active actors on pipe
2025-10-10T14:33:03.423144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616869:7320], now have 1 active actors on pipe
2025-10-10T14:33:03.423150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601071988404866:5849]
2025-10-10T14:33:03.423152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601071988404866:5849]
2025-10-10T14:33:03.423153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601071988404866:5849]
2025-10-10T14:33:03.423167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:03.423175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:03.423178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:03.423179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:03.423180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:03.423195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:03.423198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:03.423188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 829
2025-10-10T14:33:03.423191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 829
2025-10-10T14:33:03.423215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601071988404866:5849]
2025-10-10T14:33:03.423222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:03.423223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:03.423242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.423250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.423289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21b436bd-e3016397-8698ed47-d475b759_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:03.423301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.423305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.423307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:03.423317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.423331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:03.423356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.423486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.423493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.423507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.423587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 830 partition: 0 MaxSeqNo: 40 sessionId: src_id|21b436bd-e3016397-8698ed47-d475b759_0
2025-10-10T14:33:03.423867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7bde5b-6dabd9a2-f205afdb-da6e5f6b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21b436bd-e3016397-8698ed47-d475b759_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:03.426333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21b436bd-e3016397-8698ed47-d475b759_0] Write session: try to update token
2025-10-10T14:33:03.426349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21b436bd-e3016397-8698ed47-d475b759_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:03.439613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId: src_id|21b436bd-e3016397-8698ed47-d475b759_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:03.441228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:03.441248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:03.441251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:03.441253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:03.441262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601071988404866:5849]
2025-10-10T14:33:03.441267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601071988404866:5849]
2025-10-10T14:33:03.441270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601071988404866:5849]
2025-10-10T14:33:03.441305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:03.441309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:03.441314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.441316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:03.441317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:03.441320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:03.441461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:03.442074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:03.505595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601072770616877:7150]
2025-10-10T14:33:03.505805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 829, pipe: [1:7559601072770616877:7150]
2025-10-10T14:33:03.546580Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:03.546927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.546941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.546979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616877:7150], now have 1 active actors on pipe
2025-10-10T14:33:03.547193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:03.547189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:03.547197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601072770616877:7150]
2025-10-10T14:33:03.547219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:03.547222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:03.547276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 830 reason: error at write: Disconnected sessionId: src_id|21b436bd-e3016397-8698ed47-d475b759_0
2025-10-10T14:33:03.547508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 830 sessionId: src_id|21b436bd-e3016397-8698ed47-d475b759_0 is DEAD
2025-10-10T14:33:03.547669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21b436bd-e3016397-8698ed47-d475b759_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:03.547680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21b436bd-e3016397-8698ed47-d475b759_0] Write session will restart in 0.008423s
2025-10-10T14:33:03.547705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21b436bd-e3016397-8698ed47-d475b759_0] Write session: Do CDS request
2025-10-10T14:33:03.547722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21b436bd-e3016397-8698ed47-d475b759_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:03.556834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21b436bd-e3016397-8698ed47-d475b759_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.556921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:03.556947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 831
2025-10-10T14:33:03.557075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.557111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:03.557120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:03.557124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:03.557587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 831 sessionId:  describe result for acl check
2025-10-10T14:33:03.557615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:03.557617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:03.557618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:03.557623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601072770616955:7324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:03.558077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601072770616955:7324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:03.560121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601072770616955:7324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:03.560161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:03.561930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:03.562129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:03.562140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:03.562152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:03.562202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:03.562241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601071988405033:5851]
2025-10-10T14:33:03.562439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601072770616955:7324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:03.562460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601072770616955:7324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:03.562464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601072770616955:7324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:03.562471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:03.562796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:03.563049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:03.563084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:03.563326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:03.563377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.563384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.563385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.563386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.563387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.563389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.563390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.563391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.563392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.563393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.563394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.563395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.563396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.563402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.563415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.563419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.563423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.563427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.563431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.563434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.563437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.563445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.563448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.563451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.563454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.563459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.563470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.563482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.563493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.563503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.563514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.563519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.563522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.563528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.563537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.563546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.563554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.563560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.563569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.563578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.563582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.563592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.563600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.563609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.563618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.563626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.563635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.563646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.563651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.563656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.563665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.563673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.563717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:03.565850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:03.566255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:03.566267Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:03.566270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:03.566273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:03.566280Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 830 [2:7559601071988405033:5851]
2025-10-10T14:33:03.566296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:03.566310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:03.566317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.566320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.566323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.566339Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:03.566348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:03.566358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:03.566413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.566420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.566422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.566425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:03.566488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:03.566495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.566506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.566522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.566543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:03.566568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770616878:2438], now have 1 active actors on pipe
2025-10-10T14:33:03.566575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617030:7324], now have 1 active actors on pipe
2025-10-10T14:33:03.566582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601071988405028:5851]
2025-10-10T14:33:03.566588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601071988405028:5851]
2025-10-10T14:33:03.566590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601071988405028:5851]
2025-10-10T14:33:03.566603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:03.566603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 830
2025-10-10T14:33:03.566614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 830
2025-10-10T14:33:03.566619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:03.566619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:03.566622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:03.566623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:03.566639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:03.566642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:03.566665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601071988405028:5851]
2025-10-10T14:33:03.566673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:03.566685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.566685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:03.566690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.566732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6603f85d-d543c027-9f9ff877-30c66a37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:03.566744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.566752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.566754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:03.566766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.566780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:03.566799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.566937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.566944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.566958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.567043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 831 partition: 0 MaxSeqNo: 40 sessionId: src_id|6603f85d-d543c027-9f9ff877-30c66a37_0
2025-10-10T14:33:03.567420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21b436bd-e3016397-8698ed47-d475b759_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6603f85d-d543c027-9f9ff877-30c66a37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:03.570000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6603f85d-d543c027-9f9ff877-30c66a37_0] Write session: try to update token
2025-10-10T14:33:03.570015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6603f85d-d543c027-9f9ff877-30c66a37_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:03.583055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId: src_id|6603f85d-d543c027-9f9ff877-30c66a37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:03.584730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:03.584753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:03.584757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:03.584759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:03.584768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601071988405028:5851]
2025-10-10T14:33:03.584772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601071988405028:5851]
2025-10-10T14:33:03.584776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601071988405028:5851]
2025-10-10T14:33:03.584815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:03.584825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:03.584827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:03.584830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:03.584834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.584836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:03.584975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:03.585646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:03.647406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601072770617052:7150]
2025-10-10T14:33:03.647679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 830, pipe: [1:7559601072770617052:7150]
2025-10-10T14:33:03.688800Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:03.689036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.689055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.689102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617052:7150], now have 1 active actors on pipe
2025-10-10T14:33:03.689296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:03.689312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:03.689317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:03.689369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601072770617052:7150]
2025-10-10T14:33:03.689385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 831 reason: error at write: Disconnected sessionId: src_id|6603f85d-d543c027-9f9ff877-30c66a37_0
2025-10-10T14:33:03.689387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:03.689611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 831 sessionId: src_id|6603f85d-d543c027-9f9ff877-30c66a37_0 is DEAD
2025-10-10T14:33:03.689753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6603f85d-d543c027-9f9ff877-30c66a37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:03.689764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6603f85d-d543c027-9f9ff877-30c66a37_0] Write session will restart in 0.009533s
2025-10-10T14:33:03.689789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6603f85d-d543c027-9f9ff877-30c66a37_0] Write session: Do CDS request
2025-10-10T14:33:03.689797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6603f85d-d543c027-9f9ff877-30c66a37_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:03.700804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:03.700887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6603f85d-d543c027-9f9ff877-30c66a37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.700955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:03.700969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 832
2025-10-10T14:33:03.701126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.701151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:03.701165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:03.701173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:03.701583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 832 sessionId:  describe result for acl check
2025-10-10T14:33:03.701619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:03.701625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:03.701628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:03.701633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601072770617177:7330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:03.702196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601072770617177:7330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:03.702595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:03.702810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:03.702823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:03.702835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:03.702893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:03.702935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601071988405197:5854]
2025-10-10T14:33:03.703450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:03.703751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:03.703797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:03.704049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:03.704099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.704105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.704107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.704108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.704109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.704110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.704111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.704112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.704114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.704115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.704116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.704117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.704118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.704123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.704134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.704137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.704141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.704144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.704148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.704151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.704155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.704158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.704165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.704168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.704172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.704170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601072770617177:7330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:03.704175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.704182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.704190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.704195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.704201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.704205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.704209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.704213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.704218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.704222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.704226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.704230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.704240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.704246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.704255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.704260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.704264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.704270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.704274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.704276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.704279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.704282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.704285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.704287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.704290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.704293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.704296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.704325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:03.706343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601072770617177:7330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:03.706357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601072770617177:7330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:03.706360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601072770617177:7330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:03.706368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:03.706479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:03.706766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:03.706778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:03.706780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:03.706784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:03.706790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 831 [2:7559601071988405197:5854]
2025-10-10T14:33:03.706888Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:03.706907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:03.706909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.706911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.706913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.706924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:03.706929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:03.706935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:03.706969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.706974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.706975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.706976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:03.707023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:03.707029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.707035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.707042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.707051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:03.707071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617210:7330], now have 1 active actors on pipe
2025-10-10T14:33:03.707079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617053:2438], now have 1 active actors on pipe
2025-10-10T14:33:03.707086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601071988405191:5854]
2025-10-10T14:33:03.707088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601071988405191:5854]
2025-10-10T14:33:03.707091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601071988405191:5854]
2025-10-10T14:33:03.707103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:03.707127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:03.707135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 831
2025-10-10T14:33:03.707131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:03.707141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:03.707143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:03.707146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 831
2025-10-10T14:33:03.707146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:03.707149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:03.707166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601071988405191:5854]
2025-10-10T14:33:03.707169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:03.707171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:03.707198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.707201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.707226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:03.707237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.707243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.707245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:03.707253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.707265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:03.707281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.707418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.707427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.707440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.707508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 832 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0
2025-10-10T14:33:03.707793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6603f85d-d543c027-9f9ff877-30c66a37_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:03.710407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0] Write session: try to update token
2025-10-10T14:33:03.710423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:03.723972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId: src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:03.724859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:03.724878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:03.724881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:03.724884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:03.724893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601071988405191:5854]
2025-10-10T14:33:03.724898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601071988405191:5854]
2025-10-10T14:33:03.724902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601071988405191:5854]
2025-10-10T14:33:03.724940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:03.724947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:03.724952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:03.724955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:03.724958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.724960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:03.725098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:03.726585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:03.789769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601072770617217:7150]
2025-10-10T14:33:03.790050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 831, pipe: [1:7559601072770617217:7150]
2025-10-10T14:33:03.830516Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:03.830796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.830808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.830845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617217:7150], now have 1 active actors on pipe
2025-10-10T14:33:03.831019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:03.831060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601072770617217:7150]
2025-10-10T14:33:03.831076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:03.831091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:03.831171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 832 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0
2025-10-10T14:33:03.831388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 832 sessionId: src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0 is DEAD
2025-10-10T14:33:03.831524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:03.831535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0] Write session will restart in 0.009943s
2025-10-10T14:33:03.831560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0] Write session: Do CDS request
2025-10-10T14:33:03.831566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:03.842400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:03.842913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.843014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:03.843030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 833
2025-10-10T14:33:03.843186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.843225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:03.843235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:03.843239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:03.843660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 833 sessionId:  describe result for acl check
2025-10-10T14:33:03.843698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:03.843704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:03.843708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:03.843715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601072770617344:7334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:03.844209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601072770617344:7334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:03.844200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:03.844371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:03.844382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:03.844394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:03.844436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:03.844468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601071988405359:5856]
2025-10-10T14:33:03.844948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:03.845306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:03.845366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:03.845653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:03.845719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.845726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.845727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.845728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.845729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.845730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.845732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.845732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.845734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.845735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.845736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.845737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.845737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.845743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.845752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.845756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.845759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.845762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.845766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.845769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.845772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.845775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.845779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.845782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.845785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.845788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.845795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.845809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.845818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.845823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.845830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.845835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.845842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.845846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.845854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.845858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.845861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.845866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.845871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.845875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.845879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.845884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.845887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.845891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.845895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.845899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.845903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.845907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.845911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.845920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.845924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.845932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.845963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:03.846522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601072770617344:7334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:03.848133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:03.848490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:03.848499Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:03.848500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:03.848503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:03.848507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 832 [2:7559601071988405359:5856]
2025-10-10T14:33:03.848517Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:03.848529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:03.848531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.848533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.848534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.848547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:03.848553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:03.848559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:03.848610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.848619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.848621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.848624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:03.848683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:03.848692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.848703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.848714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.848711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601072770617344:7334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:03.848729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601072770617344:7334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:03.848733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601072770617344:7334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:03.848741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:03.848735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:03.848761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617219:2438], now have 1 active actors on pipe
2025-10-10T14:33:03.848769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601071988405353:5856]
2025-10-10T14:33:03.848771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601071988405353:5856]
2025-10-10T14:33:03.848774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601071988405353:5856]
2025-10-10T14:33:03.848786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:03.848775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 832
2025-10-10T14:33:03.848795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:03.848800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:03.848802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:03.848804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:03.848811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:03.848813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:03.848833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601071988405353:5856]
2025-10-10T14:33:03.848842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:03.848846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:03.848865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617377:7334], now have 1 active actors on pipe
2025-10-10T14:33:03.848934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 832
2025-10-10T14:33:03.848976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.848984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.849007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:03.849016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.849019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.849020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:03.849028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.849037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:03.849050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.849169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.849177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.849191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.849256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 833 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0
2025-10-10T14:33:03.849595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a8b5a-2c7c3931-d7029c4-e5bb523_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:03.852097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0] Write session: try to update token
2025-10-10T14:33:03.852111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:03.865625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId: src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:03.866930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:03.866944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:03.866946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:03.866948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:03.866955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601071988405353:5856]
2025-10-10T14:33:03.866959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601071988405353:5856]
2025-10-10T14:33:03.866961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601071988405353:5856]
2025-10-10T14:33:03.867008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:03.867012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:03.867019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:03.867021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.867023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:03.867024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:03.867185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:03.868219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:03.931065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601072770617397:7150]
2025-10-10T14:33:03.931327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 832, pipe: [1:7559601072770617397:7150]
2025-10-10T14:33:03.971669Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:03.972079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.972091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.972134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617397:7150], now have 1 active actors on pipe
2025-10-10T14:33:03.972324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:03.972385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:03.972392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601072770617397:7150]
2025-10-10T14:33:03.972413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:03.972476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 833 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0
2025-10-10T14:33:03.972696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 833 sessionId: src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0 is DEAD
2025-10-10T14:33:03.972835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:03.972843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0] Write session will restart in 0.007100s
2025-10-10T14:33:03.972880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0] Write session: Do CDS request
2025-10-10T14:33:03.972886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:03.980858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.980983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:03.980996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 834
2025-10-10T14:33:03.981112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:03.981138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:03.981146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:03.981150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:03.981923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 834 sessionId:  describe result for acl check
2025-10-10T14:33:03.981961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:03.981967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:03.981969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:03.981974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601072770617480:7347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:03.982504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601072770617480:7347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:03.984265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:03.984525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601072770617480:7347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:03.986040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:03.986177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:03.986185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:03.986201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:03.986236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:03.986264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601071988405560:5871]
2025-10-10T14:33:03.986355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601072770617480:7347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:03.986368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601072770617480:7347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:03.986371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601072770617480:7347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:03.986377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:03.986650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:03.986894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:03.986927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:03.987187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:03.987227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.987231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.987232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.987233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.987233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.987234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.987234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.987235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.987236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.987236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.987237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.987238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.987238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.987242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.987250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.987253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.987255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.987258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.987260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.987262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.987265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.987267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.987269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.987272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.987274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.987276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.987281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.987287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:03.987292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.987295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:03.987298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.987301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:03.987303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.987306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:03.987309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.987312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:03.987315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.987318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:03.987320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.987323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:03.987326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.987329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:03.987332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.987335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:03.987339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.987341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:03.987344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.987347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.987349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.987352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.987356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.987359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.987380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:03.989514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:03.989790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:03.989797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:03.989798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:03.989801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:03.989805Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 833 [2:7559601071988405560:5871]
2025-10-10T14:33:03.989813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:03.989824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:03.989826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.989828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.989829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.989840Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:03.989850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:03.989859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:03.989901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.989906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.989907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.989909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:03.990050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:03.990056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:03.990063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:03.990069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:03.990081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:03.990065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 833
2025-10-10T14:33:03.990084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 833
2025-10-10T14:33:03.990105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617410:2438], now have 1 active actors on pipe
2025-10-10T14:33:03.990112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601072770617565:7347], now have 1 active actors on pipe
2025-10-10T14:33:03.990119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601071988405555:5871]
2025-10-10T14:33:03.990126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601071988405555:5871]
2025-10-10T14:33:03.990128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601071988405555:5871]
2025-10-10T14:33:03.990142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:03.990153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:03.990159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:03.990161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:03.990163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:03.990169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:03.990171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:03.990183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.990185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.990208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601071988405555:5871]
2025-10-10T14:33:03.990217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:03.990224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:03.990230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:03.990236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:03.990239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:03.990240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:03.990249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:03.990257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:03.990281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.990416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:03.990423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:03.990437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:03.990522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 834 partition: 0 MaxSeqNo: 40 sessionId: src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0
2025-10-10T14:33:03.990836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b08d645-86cc67c1-9e63bd12-ce5e351c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:03.993259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0] Write session: try to update token
2025-10-10T14:33:03.993275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:04.006920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId: src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:04.008932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:04.008946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:04.008949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:04.008950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:04.008959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601071988405555:5871]
2025-10-10T14:33:04.008963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601071988405555:5871]
2025-10-10T14:33:04.008966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601071988405555:5871]
2025-10-10T14:33:04.009005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:04.009011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.009010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:04.009012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:04.009018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:04.009021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:04.009133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:04.009573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:04.072396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601077065584872:7150]
2025-10-10T14:33:04.072707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 833, pipe: [1:7559601077065584872:7150]
2025-10-10T14:33:04.112082Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:04.112382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.112394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.112434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065584872:7150], now have 1 active actors on pipe
2025-10-10T14:33:04.112647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:04.112682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:04.112700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:04.112720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601077065584872:7150]
2025-10-10T14:33:04.112741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:04.112752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 834 reason: error at write: Disconnected sessionId: src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0
2025-10-10T14:33:04.112934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 834 sessionId: src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0 is DEAD
2025-10-10T14:33:04.113087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:04.113099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0] Write session will restart in 0.009904s
2025-10-10T14:33:04.113124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0] Write session: Do CDS request
2025-10-10T14:33:04.113140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:04.123834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.123873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:04.123893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 835
2025-10-10T14:33:04.124071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.124115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:04.124128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:04.124131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:04.124356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:04.124539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 835 sessionId:  describe result for acl check
2025-10-10T14:33:04.124579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:04.124585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:04.124587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:04.124595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601077065584998:7351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:04.125122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601077065584998:7351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:04.126306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:04.126444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:04.126453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:04.126461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:04.126514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:04.126544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601076283373021:5873]
2025-10-10T14:33:04.126916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:04.127024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601077065584998:7351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:04.127150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:04.127176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:04.127371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:04.127412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.127417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.127417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.127418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.127419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.127419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.127420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.127421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.127421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.127422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.127423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.127423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.127424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.127427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.127435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.127437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.127439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.127442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.127444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.127446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.127448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.127450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.127454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.127456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.127458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.127460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.127465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.127470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.127475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.127479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.127481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.127484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.127486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.127490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.127492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.127495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.127498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.127501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.127503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.127506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.127509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.127512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.127514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.127517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.127520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.127523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.127525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.127530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.127532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.127535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.127537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.127540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.127563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:04.129471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601077065584998:7351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:04.129484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601077065584998:7351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:04.129487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601077065584998:7351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:04.129494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:04.129518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:04.129980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:04.129987Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:04.129988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:04.129990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:04.129994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 834 [2:7559601076283373021:5873]
2025-10-10T14:33:04.130002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:04.130013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:04.130018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.130020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.130021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.130029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:04.130037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:04.130043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:04.130082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.130088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.130089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.130091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:04.130199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:04.130206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.130214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.130221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.130234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:04.130249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065584873:2438], now have 1 active actors on pipe
2025-10-10T14:33:04.130254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585034:7351], now have 1 active actors on pipe
2025-10-10T14:33:04.130250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 834
2025-10-10T14:33:04.130259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601076283373015:5873]
2025-10-10T14:33:04.130254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 834
2025-10-10T14:33:04.130260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601076283373015:5873]
2025-10-10T14:33:04.130261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601076283373015:5873]
2025-10-10T14:33:04.130272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:04.130284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:04.130286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:04.130289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:04.130291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:04.130300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:04.130303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:04.130334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.130342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.130354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601076283373015:5873]
2025-10-10T14:33:04.130364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:04.130382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:04.130388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1df107ea-923fb535-b372750e-65276105_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:04.130395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.130398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.130400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:04.130409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.130423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:04.130448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.130592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.130605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.130627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.130724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 835 partition: 0 MaxSeqNo: 40 sessionId: src_id|1df107ea-923fb535-b372750e-65276105_0
2025-10-10T14:33:04.130984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27a33c11-6f2da146-62a1c3c7-36087d32_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1df107ea-923fb535-b372750e-65276105_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:04.133533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df107ea-923fb535-b372750e-65276105_0] Write session: try to update token
2025-10-10T14:33:04.133548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df107ea-923fb535-b372750e-65276105_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:04.147481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId: src_id|1df107ea-923fb535-b372750e-65276105_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:04.149409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:04.149422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:04.149424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:04.149426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:04.149433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601076283373015:5873]
2025-10-10T14:33:04.149436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601076283373015:5873]
2025-10-10T14:33:04.149440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601076283373015:5873]
2025-10-10T14:33:04.149485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:04.149487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:04.149491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:04.149494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.149494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:04.149495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:04.149617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:04.150059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:04.212689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601077065585041:7150]
2025-10-10T14:33:04.212992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 834, pipe: [1:7559601077065585041:7150]
2025-10-10T14:33:04.256399Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:04.256621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.256632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.256670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585041:7150], now have 1 active actors on pipe
2025-10-10T14:33:04.256833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:04.256900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601077065585041:7150]
2025-10-10T14:33:04.256906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:04.256937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:04.257025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 835 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1df107ea-923fb535-b372750e-65276105_0
2025-10-10T14:33:04.257238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 835 sessionId: src_id|1df107ea-923fb535-b372750e-65276105_0 is DEAD
2025-10-10T14:33:04.257397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df107ea-923fb535-b372750e-65276105_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:04.257406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df107ea-923fb535-b372750e-65276105_0] Write session will restart in 0.006549s
2025-10-10T14:33:04.257431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df107ea-923fb535-b372750e-65276105_0] Write session: Do CDS request
2025-10-10T14:33:04.257437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df107ea-923fb535-b372750e-65276105_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:04.264765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1df107ea-923fb535-b372750e-65276105_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.264853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:04.264868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 836
2025-10-10T14:33:04.265081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.265129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:04.265138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:04.265142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:04.265540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 836 sessionId:  describe result for acl check
2025-10-10T14:33:04.265575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:04.265582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:04.265584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:04.265589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601077065585094:7356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:04.265994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601077065585094:7356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:04.267873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601077065585094:7356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:04.269246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:04.271343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:04.271474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601077065585094:7356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:04.271487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601077065585094:7356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:04.271491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601077065585094:7356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:04.271498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:04.271626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:04.271638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:04.271652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:04.271724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:04.271768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601076283373199:5875]
2025-10-10T14:33:04.272380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:04.272636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:04.272673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:04.272976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:04.273023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.273029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.273030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.273031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.273032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.273034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.273035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.273036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.273037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.273038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.273040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.273041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.273042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.273047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.273059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.273062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.273066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.273070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.273075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.273082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.273086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.273093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.273098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.273102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.273111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.273115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.273121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.273129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.273135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.273140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.273144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.273149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.273154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.273163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.273173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.273182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.273186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.273191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.273200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.273208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.273213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.273218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.273226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.273235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.273243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.273248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.273256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.273265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.273271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.273280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.273287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.273293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.273349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:04.275519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:04.275977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:04.275988Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:04.275990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:04.275993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:04.275999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 835 [2:7559601076283373199:5875]
2025-10-10T14:33:04.276010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:04.276027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:04.276034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.276038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.276040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.276057Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:04.276068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:04.276076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:04.276132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.276138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.276140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.276143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:04.276210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:04.276217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.276229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.276244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.276265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:04.276291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585211:7356], now have 1 active actors on pipe
2025-10-10T14:33:04.276299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585042:2438], now have 1 active actors on pipe
2025-10-10T14:33:04.276306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601076283373194:5875]
2025-10-10T14:33:04.276309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601076283373194:5875]
2025-10-10T14:33:04.276311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601076283373194:5875]
2025-10-10T14:33:04.276323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:04.276337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:04.276340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:04.276343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:04.276345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:04.276356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:04.276359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:04.276322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 835
2025-10-10T14:33:04.276352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 835
2025-10-10T14:33:04.276393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.276402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.276415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601076283373194:5875]
2025-10-10T14:33:04.276426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:04.276437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:04.276461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:04.276472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.276477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.276479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:04.276490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.276500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:04.276526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.276758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 836 partition: 0 MaxSeqNo: 40 sessionId: src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0
2025-10-10T14:33:04.276639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.276646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.276661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.277126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1df107ea-923fb535-b372750e-65276105_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:04.279571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0] Write session: try to update token
2025-10-10T14:33:04.279589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:04.292816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId: src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:04.294482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:04.294500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:04.294502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:04.294504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:04.294512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601076283373194:5875]
2025-10-10T14:33:04.294515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601076283373194:5875]
2025-10-10T14:33:04.294518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601076283373194:5875]
2025-10-10T14:33:04.294562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:04.294568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:04.294572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:04.294575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.294575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:04.294576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:04.294713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:04.295417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:04.357031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601077065585223:7150]
2025-10-10T14:33:04.357260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 835, pipe: [1:7559601077065585223:7150]
2025-10-10T14:33:04.396352Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:04.396707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.396720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.396757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585223:7150], now have 1 active actors on pipe
2025-10-10T14:33:04.396924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:04.397006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:04.397020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:04.397053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:04.397081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 836 reason: error at write: Disconnected sessionId: src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0
2025-10-10T14:33:04.397090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601077065585223:7150]
2025-10-10T14:33:04.397296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 836 sessionId: src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0 is DEAD
2025-10-10T14:33:04.397466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:04.397476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0] Write session will restart in 0.008671s
2025-10-10T14:33:04.397494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0] Write session: Do CDS request
2025-10-10T14:33:04.397502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:04.407888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.407963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:04.407982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 837
2025-10-10T14:33:04.408151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.408208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:04.408216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:04.408220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:04.408716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 837 sessionId:  describe result for acl check
2025-10-10T14:33:04.408752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:04.408761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:04.408765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:04.408772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601077065585349:7360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:04.409313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601077065585349:7360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:04.409493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:04.411070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601077065585349:7360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:04.411621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:04.411829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:04.411839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:04.411850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:04.411902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:04.411939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601076283373366:5878]
2025-10-10T14:33:04.412520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:04.412756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:04.412789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:04.412991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:04.413028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.413032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.413033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.413034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.413034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.413035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.413036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.413036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.413037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.413038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.413038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.413039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.413039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.413044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.413051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.413053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.413056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.413058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.413061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.413063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.413065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.413067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.413070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.413072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.413074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.413076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.413081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.413087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.413091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.413095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.413097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.413100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.413103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.413106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.413110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.413113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.413115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.413118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.413121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.413124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.413127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.413130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.413132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.413135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.413138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.413141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.413144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.413146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.413149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.413152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.413156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.413159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.413181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:04.413369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601077065585349:7360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:04.413384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601077065585349:7360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:04.413398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601077065585349:7360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:04.413405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:04.415279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:04.415690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:04.415701Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:04.415703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:04.415706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:04.415711Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 836 [2:7559601076283373366:5878]
2025-10-10T14:33:04.415722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:04.415750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:04.415758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.415761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.415763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.415778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:04.415784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:04.415792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:04.415841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.415848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.415849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.415852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:04.415913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:04.415920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.415931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.415948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.415970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:04.415994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585386:7360], now have 1 active actors on pipe
2025-10-10T14:33:04.416002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585224:2438], now have 1 active actors on pipe
2025-10-10T14:33:04.416008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601076283373361:5878]
2025-10-10T14:33:04.416011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601076283373361:5878]
2025-10-10T14:33:04.416013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601076283373361:5878]
2025-10-10T14:33:04.416026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:04.416038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:04.416028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 836
2025-10-10T14:33:04.416030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 836
2025-10-10T14:33:04.416054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:04.416061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:04.416061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:04.416065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:04.416066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:04.416093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.416103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.416121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601076283373361:5878]
2025-10-10T14:33:04.416132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:04.416143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:04.416163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:04.416174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.416177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.416180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:04.416189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.416198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:04.416221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.416361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.416368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.416392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.416480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 837 partition: 0 MaxSeqNo: 40 sessionId: src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0
2025-10-10T14:33:04.416809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c94f5c6a-7a3194c6-4fa9cf6b-733a4378_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:04.419532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0] Write session: try to update token
2025-10-10T14:33:04.419547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:04.432631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId: src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:04.434842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:04.434855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:04.434857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:04.434859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:04.434866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601076283373361:5878]
2025-10-10T14:33:04.434869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601076283373361:5878]
2025-10-10T14:33:04.434872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601076283373361:5878]
2025-10-10T14:33:04.434908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:04.434910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:04.434913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.434915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:04.434917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:04.434922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:04.435035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:04.435155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:04.497386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601077065585394:7150]
2025-10-10T14:33:04.497687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 836, pipe: [1:7559601077065585394:7150]
2025-10-10T14:33:04.538659Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:04.538964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.538981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.539025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585394:7150], now have 1 active actors on pipe
2025-10-10T14:33:04.539253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:04.539298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:04.539315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601077065585394:7150]
2025-10-10T14:33:04.539317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:04.539333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:04.539384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 837 reason: error at write: Disconnected sessionId: src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0
2025-10-10T14:33:04.539608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 837 sessionId: src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0 is DEAD
2025-10-10T14:33:04.539759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:04.539769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0] Write session will restart in 0.008936s
2025-10-10T14:33:04.539788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0] Write session: Do CDS request
2025-10-10T14:33:04.539792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:04.549851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.549939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:04.549956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 838
2025-10-10T14:33:04.550094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.550143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:04.550154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:04.550158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:04.550620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 838 sessionId:  describe result for acl check
2025-10-10T14:33:04.550658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:04.550663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:04.550665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:04.550671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601077065585513:7364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:04.551259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601077065585513:7364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:04.552294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:04.553634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601077065585513:7364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:04.554268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:04.554468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:04.554479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:04.554491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:04.554545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:04.554598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601076283373535:5880]
2025-10-10T14:33:04.555233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:04.555561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:04.555602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:04.555931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:04.556002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.556007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.556008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.556009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.556010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.556012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.556013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.556014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.556015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.556016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.556017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.556018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.556019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.556025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.556038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.556041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.556045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.556049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.556052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.556056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.556059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.556063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.556067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.556070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.556074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.556079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.556088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.556097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.556103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.556109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.556113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.556118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.556123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.556128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.556133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.556144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.556149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.556155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.556160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.556165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.556170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.556175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.556180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.556184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.556188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.556193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.556204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.556209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.556217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.556223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.556228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.556237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.556265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:04.556319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601077065585513:7364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:04.556334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601077065585513:7364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:04.556338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601077065585513:7364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:04.556346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:04.558406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:04.558879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:04.558888Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:04.558889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:04.558892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:04.558897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 837 [2:7559601076283373535:5880]
2025-10-10T14:33:04.558905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:04.558917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:04.558920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.558922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.558923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.558936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:04.558942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:04.558948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:04.558989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.558994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.558995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.558996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:04.559046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:04.559052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.559059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.559065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.559075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:04.559106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585397:2438], now have 1 active actors on pipe
2025-10-10T14:33:04.559115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601076283373530:5880]
2025-10-10T14:33:04.559117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601076283373530:5880]
2025-10-10T14:33:04.559118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601076283373530:5880]
2025-10-10T14:33:04.559129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:04.559138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585558:7364], now have 1 active actors on pipe
2025-10-10T14:33:04.559145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:04.559149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:04.559152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:04.559154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:04.559158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:04.559160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:04.559180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601076283373530:5880]
2025-10-10T14:33:04.559189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:04.559196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:04.559185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 837
2025-10-10T14:33:04.559188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 837
2025-10-10T14:33:04.559223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.559231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.559253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4036609-2df66eed-30fb046f-8825d867_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:04.559272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.559275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.559276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:04.559284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.559292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:04.559307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.559473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.559484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.559508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.559608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 838 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4036609-2df66eed-30fb046f-8825d867_0
2025-10-10T14:33:04.559974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f5e440-ca53c0d9-3d46bc3a-8f81c2aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4036609-2df66eed-30fb046f-8825d867_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:04.562650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4036609-2df66eed-30fb046f-8825d867_0] Write session: try to update token
2025-10-10T14:33:04.562668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4036609-2df66eed-30fb046f-8825d867_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:04.577106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId: src_id|f4036609-2df66eed-30fb046f-8825d867_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:04.578112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:04.578127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:04.578129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:04.578131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:04.578138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601076283373530:5880]
2025-10-10T14:33:04.578141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601076283373530:5880]
2025-10-10T14:33:04.578144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601076283373530:5880]
2025-10-10T14:33:04.578185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:04.578194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.578196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:04.578299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:04.578314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:04.578317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:04.578318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:04.579720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:04.639674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601077065585585:7150]
2025-10-10T14:33:04.639943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 837, pipe: [1:7559601077065585585:7150]
2025-10-10T14:33:04.688646Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:04.688979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.688994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.689037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585585:7150], now have 1 active actors on pipe
2025-10-10T14:33:04.689222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:04.689255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601077065585585:7150]
2025-10-10T14:33:04.689273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:04.689284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:04.689372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 838 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4036609-2df66eed-30fb046f-8825d867_0
2025-10-10T14:33:04.689593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 838 sessionId: src_id|f4036609-2df66eed-30fb046f-8825d867_0 is DEAD
2025-10-10T14:33:04.689745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4036609-2df66eed-30fb046f-8825d867_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:04.689758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4036609-2df66eed-30fb046f-8825d867_0] Write session will restart in 0.005342s
2025-10-10T14:33:04.689784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4036609-2df66eed-30fb046f-8825d867_0] Write session: Do CDS request
2025-10-10T14:33:04.689791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4036609-2df66eed-30fb046f-8825d867_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:04.695811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4036609-2df66eed-30fb046f-8825d867_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.695894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:04.695907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 839
2025-10-10T14:33:04.696051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.696106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:04.696112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:04.696116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:04.696555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 839 sessionId:  describe result for acl check
2025-10-10T14:33:04.696588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:04.696594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:04.696598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:04.696604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601077065585600:7370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:04.697065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601077065585600:7370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:04.699615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601077065585600:7370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:04.702338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601077065585600:7370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:04.702353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601077065585600:7370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:04.702357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601077065585600:7370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:04.702365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:04.702682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:04.704608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:04.704789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:04.704798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:04.704808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:04.704847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:04.704877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601076283373707:5883]
2025-10-10T14:33:04.705303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:04.705546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:04.705575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:04.705820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:04.705859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.705863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.705864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.705865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.705866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.705866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.705867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.705867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.705868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.705869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.705870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.705870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.705871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.705875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.705884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.705886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.705889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.705891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.705894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.705896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.705899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.705901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.705904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.705906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.705908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.705911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.705917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.705923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.705928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.705931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.705935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.705939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.705943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.705946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.705949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.705952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.705958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.705962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.705964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.705967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.705971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.705978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.705980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.705983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.705986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.705989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.705992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.705995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.706001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.706004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.706007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.706009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.706037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:04.708279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:04.708715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:04.708725Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:04.708727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:04.708730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:04.708736Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 838 [2:7559601076283373707:5883]
2025-10-10T14:33:04.708748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:04.708764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:04.708767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.708771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.708773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.708788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:04.708797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:04.708804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:04.708844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.708850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.708851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.708853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:04.708905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:04.708910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.708917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.708929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.708950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:04.708974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585745:7370], now have 1 active actors on pipe
2025-10-10T14:33:04.708982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585586:2438], now have 1 active actors on pipe
2025-10-10T14:33:04.708989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601076283373702:5883]
2025-10-10T14:33:04.708992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601076283373702:5883]
2025-10-10T14:33:04.708994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601076283373702:5883]
2025-10-10T14:33:04.709004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:04.709018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:04.709032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:04.709031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:04.709034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:04.709037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:04.709037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:04.709056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601076283373702:5883]
2025-10-10T14:33:04.709059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:04.709062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:04.709036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 838
2025-10-10T14:33:04.709041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 838
2025-10-10T14:33:04.709078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.709084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.709117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:04.709127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.709130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.709131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:04.709139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.709149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:04.709166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.709288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.709295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.709309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.709442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 839 partition: 0 MaxSeqNo: 40 sessionId: src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0
2025-10-10T14:33:04.709875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4036609-2df66eed-30fb046f-8825d867_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:04.712539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0] Write session: try to update token
2025-10-10T14:33:04.712555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:04.727179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId: src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:04.728648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:04.728667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:04.728672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:04.728675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:04.728685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601076283373702:5883]
2025-10-10T14:33:04.728690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601076283373702:5883]
2025-10-10T14:33:04.728698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601076283373702:5883]
2025-10-10T14:33:04.728736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:04.728742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:04.728746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:04.728749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:04.728759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.728762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:04.728886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:04.729751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:04.789202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601077065585757:7150]
2025-10-10T14:33:04.789527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 838, pipe: [1:7559601077065585757:7150]
2025-10-10T14:33:04.832568Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:04.832847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.832861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.832900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585757:7150], now have 1 active actors on pipe
2025-10-10T14:33:04.833077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:04.833201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:04.833201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:04.833306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 839 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0
2025-10-10T14:33:04.833361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601077065585757:7150]
2025-10-10T14:33:04.833539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 839 sessionId: src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0 is DEAD
2025-10-10T14:33:04.833701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:04.833714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0] Write session will restart in 0.009621s
2025-10-10T14:33:04.833738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0] Write session: Do CDS request
2025-10-10T14:33:04.833745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:04.844940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.845000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:04.845017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 840
2025-10-10T14:33:04.845188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.845226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:04.845237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:04.845241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:04.845416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:04.845656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 840 sessionId:  describe result for acl check
2025-10-10T14:33:04.845690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:04.845696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:04.845699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:04.845706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601077065585891:7374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:04.846217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601077065585891:7374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:04.847617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:04.847830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:04.847843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:04.847854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:04.847909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:04.847951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601076283373875:5885]
2025-10-10T14:33:04.848523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601077065585891:7374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:04.848575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:04.848865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:04.848906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:04.849208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:04.849262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.849268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.849269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.849270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.849271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.849273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.849274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.849275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.849276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.849277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.849278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.849279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.849281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.849286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.849299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.849303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.849307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.849311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.849316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.849320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.849324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.849328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.849349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.849353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.849356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.849360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.849368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.849376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.849383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.849389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.849398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.849403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.849412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.849418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.849424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.849433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.849437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.849443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.849452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.849457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.849461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.849466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.849471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.849476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.849481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.849486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.849495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.849500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.849504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.849509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.849517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.849522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.849561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:04.851736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601077065585891:7374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:04.851752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601077065585891:7374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:04.851755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601077065585891:7374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:04.851764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:04.851782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:04.852257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:04.852269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:04.852270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:04.852273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:04.852278Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 839 [2:7559601076283373875:5885]
2025-10-10T14:33:04.852285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:04.852298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:04.852300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.852303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.852304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.852317Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:04.852326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:04.852332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:04.852376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.852380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.852381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.852383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:04.852433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:04.852438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.852445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.852452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.852461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:04.852479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601076283373870:5885]
2025-10-10T14:33:04.852484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601076283373870:5885]
2025-10-10T14:33:04.852498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601076283373870:5885]
2025-10-10T14:33:04.852515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:04.852533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585924:7374], now have 1 active actors on pipe
2025-10-10T14:33:04.852532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:04.852535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:04.852537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585759:2438], now have 1 active actors on pipe
2025-10-10T14:33:04.852538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:04.852545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:04.852561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:04.852564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:04.852548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 839
2025-10-10T14:33:04.852567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 839
2025-10-10T14:33:04.852602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.852610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.852621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601076283373870:5885]
2025-10-10T14:33:04.852628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:04.852641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:04.852653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:04.852663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.852666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.852667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:04.852676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.852684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:04.852699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.852828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.852836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.852854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.852922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 840 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0
2025-10-10T14:33:04.853304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2eae54-4a2a8417-be7cf125-e6baf04c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:04.856009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0] Write session: try to update token
2025-10-10T14:33:04.856025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:04.869154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId: src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:04.871541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:04.871561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:04.871565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:04.871566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:04.871576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601076283373870:5885]
2025-10-10T14:33:04.871581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601076283373870:5885]
2025-10-10T14:33:04.871585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601076283373870:5885]
2025-10-10T14:33:04.871636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:04.871642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:04.871648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:04.871650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.871652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:04.871653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:04.871793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:04.871838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:04.933550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601077065585931:7150]
2025-10-10T14:33:04.933864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 839, pipe: [1:7559601077065585931:7150]
2025-10-10T14:33:04.976310Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:04.976507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.976523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.976561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585931:7150], now have 1 active actors on pipe
2025-10-10T14:33:04.976733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:04.976812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601077065585931:7150]
2025-10-10T14:33:04.976855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:04.976921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 840 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0
2025-10-10T14:33:04.977129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 840 sessionId: src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0 is DEAD
2025-10-10T14:33:04.977261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:04.977310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:04.977322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0] Write session will restart in 0.005392s
2025-10-10T14:33:04.977361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0] Write session: Do CDS request
2025-10-10T14:33:04.977367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:04.983913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.983914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:04.983927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 841
2025-10-10T14:33:04.984139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:04.984179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:04.984183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:04.984186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:04.984578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 841 sessionId:  describe result for acl check
2025-10-10T14:33:04.984611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:04.984618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:04.984620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:04.984625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601077065585978:7387] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:04.985072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601077065585978:7387] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:04.987897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601077065585978:7387] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:04.989325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:04.991382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:04.991576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:04.991588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:04.991598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:04.991647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:04.991689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601076283374083:5898]
2025-10-10T14:33:04.991692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601077065585978:7387] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:04.991705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601077065585978:7387] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:04.991708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601077065585978:7387] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:04.991715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:04.992313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:04.992605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:04.992654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:04.992979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:04.993037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.993044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.993045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.993046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.993047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.993049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.993050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.993051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.993052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.993053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.993055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.993056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.993057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.993063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.993076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.993080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.993084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.993088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.993093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.993097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.993101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.993105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.993113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.993117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.993126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.993130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.993138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.993151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:04.993162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.993172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:04.993180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.993186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:04.993194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.993204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:04.993213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.993220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:04.993228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.993233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:04.993242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.993252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:04.993260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.993265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:04.993274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.993286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:04.993294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.993300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:04.993308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.993318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.993326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.993346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.993351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.993360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.993402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:04.995654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:04.996097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:04.996108Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:04.996111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:04.996114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:04.996120Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 840 [2:7559601076283374083:5898]
2025-10-10T14:33:04.996131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:04.996151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:04.996159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.996162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.996165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.996180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:04.996192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:04.996204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:04.996257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.996266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.996268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.996271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:04.996331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:04.996338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:04.996349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:04.996365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:04.996381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:04.996406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065585946:2438], now have 1 active actors on pipe
2025-10-10T14:33:04.996415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601077065586118:7387], now have 1 active actors on pipe
2025-10-10T14:33:04.996422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601076283374078:5898]
2025-10-10T14:33:04.996425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601076283374078:5898]
2025-10-10T14:33:04.996427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601076283374078:5898]
2025-10-10T14:33:04.996439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:04.996419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 840
2025-10-10T14:33:04.996425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 840
2025-10-10T14:33:04.996457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:04.996464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:04.996468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:04.996470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:04.996479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:04.996482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:04.996514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.996524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.996542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601076283374078:5898]
2025-10-10T14:33:04.996553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:04.996563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:04.996582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:04.996595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:04.996598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:04.996601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:04.996612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:04.996627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:04.996650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.996800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:04.996809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:04.996825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:04.996919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 841 partition: 0 MaxSeqNo: 40 sessionId: src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0
2025-10-10T14:33:04.997284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cbf42fd-32bad6ee-afe1c552-7da2a3d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:05.000120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0] Write session: try to update token
2025-10-10T14:33:05.000142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:05.014696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId: src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:05.015755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:05.015777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.015781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:05.015783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:05.015792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601076283374078:5898]
2025-10-10T14:33:05.015798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601076283374078:5898]
2025-10-10T14:33:05.015802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601076283374078:5898]
2025-10-10T14:33:05.015854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:05.015861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:05.015867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:05.015868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.015870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:05.015871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:05.016065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:05.017463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:05.076943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601081360553425:7150]
2025-10-10T14:33:05.077254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 840, pipe: [1:7559601081360553425:7150]
2025-10-10T14:33:05.125033Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:05.125384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.125396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.125434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553425:7150], now have 1 active actors on pipe
2025-10-10T14:33:05.125625Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:05.125676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:05.125681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:05.125686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:05.125732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601081360553425:7150]
2025-10-10T14:33:05.125756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 841 reason: error at write: Disconnected sessionId: src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0
2025-10-10T14:33:05.125957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 841 sessionId: src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0 is DEAD
2025-10-10T14:33:05.126089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:05.126099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0] Write session will restart in 0.007995s
2025-10-10T14:33:05.126117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0] Write session: Do CDS request
2025-10-10T14:33:05.126125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:05.134851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.135133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:05.135150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 842
2025-10-10T14:33:05.135295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.135331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:05.135337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:05.135346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:05.135842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 842 sessionId:  describe result for acl check
2025-10-10T14:33:05.135886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:05.135894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:05.135896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:05.135903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601081360553556:7391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:05.136373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601081360553556:7391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:05.137537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:05.138273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601081360553556:7391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:05.139508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:05.139698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:05.139709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:05.139720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:05.139773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:05.139814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601080578341551:5902]
2025-10-10T14:33:05.140348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601081360553556:7391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:05.140360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601081360553556:7391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:05.140363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601081360553556:7391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:05.140370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:05.140413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:05.140678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:05.140719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:05.141028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:05.141082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.141088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.141089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.141090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.141091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.141092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.141094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.141095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.141096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.141097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.141098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.141099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.141101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.141106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.141120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.141124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.141128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.141132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.141136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.141140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.141144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.141148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.141153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.141156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.141165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.141169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.141176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.141185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.141192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.141198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.141202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.141214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.141223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.141228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.141233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.141238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.141246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.141252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.141260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.141265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.141273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.141278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.141287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.141293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.141298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.141303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.141308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.141316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.141321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.141326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.141349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.141353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.141394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:05.143631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:05.143942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:05.143954Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:05.143957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:05.143960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:05.143967Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 841 [2:7559601080578341551:5902]
2025-10-10T14:33:05.143979Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:05.144001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:05.144009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.144012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.144015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.144032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:05.144045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:05.144057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:05.144118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.144124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.144126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.144129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:05.144204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:05.144212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.144222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.144238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.144260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:05.144289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553590:7391], now have 1 active actors on pipe
2025-10-10T14:33:05.144293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553426:2438], now have 1 active actors on pipe
2025-10-10T14:33:05.144300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601080578341546:5902]
2025-10-10T14:33:05.144303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601080578341546:5902]
2025-10-10T14:33:05.144305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601080578341546:5902]
2025-10-10T14:33:05.144319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:05.144336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:05.144337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:05.144339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:05.144341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:05.144357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:05.144364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:05.144323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 841
2025-10-10T14:33:05.144324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 841
2025-10-10T14:33:05.144404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.144412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.144427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601080578341546:5902]
2025-10-10T14:33:05.144437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:05.144444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:05.144473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:05.144487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.144491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.144494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:05.144505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.144516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:05.144545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.144700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.144709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.144727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.144820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 842 partition: 0 MaxSeqNo: 40 sessionId: src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0
2025-10-10T14:33:05.145277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93a3567-e32683cd-1d5ef535-d2fcd147_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:05.147993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0] Write session: try to update token
2025-10-10T14:33:05.148011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:05.161965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId: src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:05.163511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:05.163528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.163532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:05.163534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:05.163545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601080578341546:5902]
2025-10-10T14:33:05.163549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601080578341546:5902]
2025-10-10T14:33:05.163554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601080578341546:5902]
2025-10-10T14:33:05.163606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:05.163620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.163623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:05.163690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:05.163707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:05.163725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:05.163767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:05.164542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:05.225926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601081360553601:7150]
2025-10-10T14:33:05.226174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 841, pipe: [1:7559601081360553601:7150]
2025-10-10T14:33:05.269837Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:05.270222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.270237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.270285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553601:7150], now have 1 active actors on pipe
2025-10-10T14:33:05.270478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:05.270498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:05.270505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601081360553601:7150]
2025-10-10T14:33:05.270540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:05.270584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 842 reason: error at write: Disconnected sessionId: src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0
2025-10-10T14:33:05.270730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:05.270816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 842 sessionId: src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0 is DEAD
2025-10-10T14:33:05.271015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:05.271028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0] Write session will restart in 0.005084s
2025-10-10T14:33:05.271064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0] Write session: Do CDS request
2025-10-10T14:33:05.271070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:05.277865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.277920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:05.277936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 843
2025-10-10T14:33:05.278087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.278115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:05.278123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:05.278126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:05.278511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 843 sessionId:  describe result for acl check
2025-10-10T14:33:05.278539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:05.278544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:05.278546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:05.278550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601081360553628:7396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:05.279071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601081360553628:7396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:05.281480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601081360553628:7396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:05.284079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:05.284300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601081360553628:7396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:05.284315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601081360553628:7396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:05.284319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601081360553628:7396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:05.284327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:05.285858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:05.286036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:05.286047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:05.286059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:05.286111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:05.286152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601080578341737:5905]
2025-10-10T14:33:05.286723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:05.286968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:05.287007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:05.287319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:05.287368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.287373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.287374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.287375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.287376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.287377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.287378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.287379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.287380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.287382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.287383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.287384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.287385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.287391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.287404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.287408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.287412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.287420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.287424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.287432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.287441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.287445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.287449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.287456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.287460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.287468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.287475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.287484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.287494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.287504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.287512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.287521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.287529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.287538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.287543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.287552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.287560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.287565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.287573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.287582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.287590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.287595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.287604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.287610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.287621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.287626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.287634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.287639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.287647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.287653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.287661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.287666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.287709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:05.289791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:05.290279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:05.290290Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:05.290293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:05.290297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:05.290302Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 842 [2:7559601080578341737:5905]
2025-10-10T14:33:05.290318Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:05.290337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:05.290344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.290348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.290355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.290371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:05.290383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:05.290395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:05.290454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.290460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.290462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.290465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:05.290525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:05.290532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.290544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.290560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.290581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:05.290606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553778:7396], now have 1 active actors on pipe
2025-10-10T14:33:05.290613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553614:2438], now have 1 active actors on pipe
2025-10-10T14:33:05.290620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601080578341731:5905]
2025-10-10T14:33:05.290622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601080578341731:5905]
2025-10-10T14:33:05.290625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601080578341731:5905]
2025-10-10T14:33:05.290638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:05.290652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:05.290654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:05.290662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:05.290664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:05.290658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 842
2025-10-10T14:33:05.290659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 842
2025-10-10T14:33:05.290668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:05.290672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:05.290691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601080578341731:5905]
2025-10-10T14:33:05.290694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:05.290696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:05.290719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.290724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.290760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:05.290775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.290778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.290781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:05.290791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.290806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:05.290831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.290956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.290964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.290979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.291073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 843 partition: 0 MaxSeqNo: 40 sessionId: src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0
2025-10-10T14:33:05.291477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|155acd51-7a57f3f5-e402e553-66e6aeaf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:05.294142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0] Write session: try to update token
2025-10-10T14:33:05.294180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:05.309151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:05.309172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.309175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:05.309177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:05.309192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601080578341731:5905]
2025-10-10T14:33:05.309196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601080578341731:5905]
2025-10-10T14:33:05.309200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601080578341731:5905]
2025-10-10T14:33:05.309244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:05.309250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:05.309252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:05.309255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:05.309259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.309262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:05.309279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId: src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:05.309425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:05.311876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:05.370841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601081360553790:7150]
2025-10-10T14:33:05.371140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 842, pipe: [1:7559601081360553790:7150]
2025-10-10T14:33:05.417957Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:05.418171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.418184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.418221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553790:7150], now have 1 active actors on pipe
2025-10-10T14:33:05.418436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:05.418489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601081360553790:7150]
2025-10-10T14:33:05.418498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:05.418502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:05.418525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:05.418556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 843 reason: error at write: Disconnected sessionId: src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0
2025-10-10T14:33:05.418793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 843 sessionId: src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0 is DEAD
2025-10-10T14:33:05.418924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:05.418948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0] Write session will restart in 0.006487s
2025-10-10T14:33:05.418972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0] Write session: Do CDS request
2025-10-10T14:33:05.418982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:05.426841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.427104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:05.427125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 844
2025-10-10T14:33:05.427245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.427282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:05.427294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:05.427298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:05.427729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 844 sessionId:  describe result for acl check
2025-10-10T14:33:05.427765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:05.427767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:05.427769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:05.427774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601081360553822:7400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:05.428233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601081360553822:7400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:05.430458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601081360553822:7400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:05.432356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:05.434349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:05.434538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:05.434549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:05.434561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:05.434549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601081360553822:7400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:05.434564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601081360553822:7400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:05.434567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601081360553822:7400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:05.434576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:05.434615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:05.434659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601080578341910:5907]
2025-10-10T14:33:05.435267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:05.435520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:05.435558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:05.435862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:05.435916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.435922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.435923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.435924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.435925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.435926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.435928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.435929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.435930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.435931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.435933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.435934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.435935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.435941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.435953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.435957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.435961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.435965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.435969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.435973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.435977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.435981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.435985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.435989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.435994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.435998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.436004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.436013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.436020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.436025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.436029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.436034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.436044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.436049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.436054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.436063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.436067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.436073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.436077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.436086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.436091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.436095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.436100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.436105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.436109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.436114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.436119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.436124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.436128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.436133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.436144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.436149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.436188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:05.438431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:05.438735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:05.438746Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:05.438747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:05.438751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:05.438755Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 843 [2:7559601080578341910:5907]
2025-10-10T14:33:05.438764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:05.438778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:05.438780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.438782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.438784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.438795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:05.438800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:05.438806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:05.438845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.438854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.438856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.438858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:05.438919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:05.438927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.438937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.438948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.438965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:05.438993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553956:7400], now have 1 active actors on pipe
2025-10-10T14:33:05.439002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553791:2438], now have 1 active actors on pipe
2025-10-10T14:33:05.439013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601080578341905:5907]
2025-10-10T14:33:05.439015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601080578341905:5907]
2025-10-10T14:33:05.439017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601080578341905:5907]
2025-10-10T14:33:05.439030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:05.439054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:05.439059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:05.439063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:05.439066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:05.439074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:05.439077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:05.439098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601080578341905:5907]
2025-10-10T14:33:05.439114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:05.439095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 843
2025-10-10T14:33:05.439120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:05.439099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 843
2025-10-10T14:33:05.439147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.439156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.439180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:05.439191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.439196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.439198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:05.439210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.439225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:05.439243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.439395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.439405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.439419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.439492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 844 partition: 0 MaxSeqNo: 40 sessionId: src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0
2025-10-10T14:33:05.439868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1615d5bb-c046b2f6-dd0d4c54-1893ba0a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:05.442503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0] Write session: try to update token
2025-10-10T14:33:05.442522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:05.450080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:05.450095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.450103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601080578341905:5907]
2025-10-10T14:33:05.450144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:05.450153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:05.450306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:05.450436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:05.450567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:05.450715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:05.450960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:05.451002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:05.456359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId: src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:05.458818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:05.458997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.459014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.459055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:05.459147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:05.467581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:05.467595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.467597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:05.467599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:05.467608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601080578341905:5907]
2025-10-10T14:33:05.467610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601080578341905:5907]
2025-10-10T14:33:05.467613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601080578341905:5907]
2025-10-10T14:33:05.467649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:05.467655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.467655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:05.467656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:05.467660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:05.467663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:05.467769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:05.518810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601081360553968:7150]
2025-10-10T14:33:05.519134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 843, pipe: [1:7559601081360553968:7150]
2025-10-10T14:33:05.573690Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:05.580453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.580475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.580624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.580680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.580749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.580812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.580852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.580859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.580921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.580977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.581033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.581092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.581133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.581138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.581199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.581266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.581351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.581413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.581453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.581459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.581523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.581585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.581643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.581704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.581747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.581756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.581826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.581885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.581945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.582002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.582049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.582057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.582120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.582175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.582238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.582302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.582344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.582352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.582409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.582463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.582543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.582602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.582640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.582645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.582708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.582768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.582831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.582891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.582942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.582947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.583007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.583075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.583131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.583186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.583225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.583230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.583290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:05.583350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:05.583413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:05.583471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:05.583509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:05.583515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:05.583559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553968:7150], now have 1 active actors on pipe
2025-10-10T14:33:05.583729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:05.583742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:05.583747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:05.583769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 844 reason: error at write: Disconnected sessionId: src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0
2025-10-10T14:33:05.583797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601081360553968:7150]
2025-10-10T14:33:05.583966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 844 sessionId: src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0 is DEAD
2025-10-10T14:33:05.584123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:05.584151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0] Write session will restart in 0.008737s
2025-10-10T14:33:05.584178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0] Write session: Do CDS request
2025-10-10T14:33:05.584184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:05.584381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:05.593894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.593981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:05.593998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 845
2025-10-10T14:33:05.594108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.594144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:05.594153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:05.594156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:05.594581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 845 sessionId:  describe result for acl check
2025-10-10T14:33:05.594627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:05.594633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:05.594635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:05.594642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601081360554087:7406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:05.595138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601081360554087:7406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:05.596696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:05.597256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601081360554087:7406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:05.598631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:05.598786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:05.598794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:05.598802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:05.598841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:05.598874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601080578342085:5909]
2025-10-10T14:33:05.599275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:05.599532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:05.599572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:05.599654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601081360554087:7406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:05.599667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601081360554087:7406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:05.599671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601081360554087:7406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:05.599678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:05.599830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:05.599870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.599874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.599875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.599875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.599876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.599877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.599877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.599878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.599878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.599879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.599880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.599880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.599881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.599884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.599892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.599894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.599897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.599899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.599901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.599904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.599906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.599908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.599910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.599913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.599915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.599917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.599922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.599931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.599937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.599943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.599947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.599952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.599955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.599958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.599961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.599964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.599966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.599969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.599973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.599976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.599979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.599982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.599984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.599987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.599990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.599992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.599995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.599998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.600000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.600004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.600006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.600009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.600031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:05.602128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:05.602511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:05.602526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:05.602540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:05.602548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:05.602554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 844 [2:7559601080578342085:5909]
2025-10-10T14:33:05.602564Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:05.602586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:05.602593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.602596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.602599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.602615Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:05.602621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:05.602634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:05.602687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.602694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.602696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.602699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:05.602760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:05.602767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.602778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.602790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.602809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:05.602833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360553978:2438], now have 1 active actors on pipe
2025-10-10T14:33:05.602842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360554146:7406], now have 1 active actors on pipe
2025-10-10T14:33:05.602849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601080578342080:5909]
2025-10-10T14:33:05.602851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601080578342080:5909]
2025-10-10T14:33:05.602853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601080578342080:5909]
2025-10-10T14:33:05.602864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:05.602874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:05.602878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:05.602881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:05.602882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:05.602892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:05.602895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:05.602880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 844
2025-10-10T14:33:05.602881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 844
2025-10-10T14:33:05.602915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601080578342080:5909]
2025-10-10T14:33:05.602922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:05.602923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:05.602948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.602956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.602989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|818db999-491c3c5-c1f7503-96af72e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:05.603000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.603003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.603005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:05.603017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.603026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:05.603062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.603188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.603195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.603210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.603293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 845 partition: 0 MaxSeqNo: 40 sessionId: src_id|818db999-491c3c5-c1f7503-96af72e8_0
2025-10-10T14:33:05.603664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6edd01bf-6d20e00f-6e1e908-d92da930_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|818db999-491c3c5-c1f7503-96af72e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:05.606403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818db999-491c3c5-c1f7503-96af72e8_0] Write session: try to update token
2025-10-10T14:33:05.606423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818db999-491c3c5-c1f7503-96af72e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:05.620949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId: src_id|818db999-491c3c5-c1f7503-96af72e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:05.622402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:05.622418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.622420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:05.622421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:05.622429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601080578342080:5909]
2025-10-10T14:33:05.622432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601080578342080:5909]
2025-10-10T14:33:05.622435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601080578342080:5909]
2025-10-10T14:33:05.622476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:05.622480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:05.622483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.622485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:05.622486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:05.622490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:05.622615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:05.623457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:05.684178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601081360554159:7150]
2025-10-10T14:33:05.684454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 844, pipe: [1:7559601081360554159:7150]
2025-10-10T14:33:05.724533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:05.724748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.724761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.724801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360554159:7150], now have 1 active actors on pipe
2025-10-10T14:33:05.724973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:05.724974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:05.724994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601081360554159:7150]
2025-10-10T14:33:05.725014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:05.725093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 845 reason: status is not ok: tablet will be restarted right now sessionId: src_id|818db999-491c3c5-c1f7503-96af72e8_0
2025-10-10T14:33:05.725290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 845 sessionId: src_id|818db999-491c3c5-c1f7503-96af72e8_0 is DEAD
2025-10-10T14:33:05.725465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818db999-491c3c5-c1f7503-96af72e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:05.725489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818db999-491c3c5-c1f7503-96af72e8_0] Write session will restart in 0.005642s
2025-10-10T14:33:05.725515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818db999-491c3c5-c1f7503-96af72e8_0] Write session: Do CDS request
2025-10-10T14:33:05.725522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818db999-491c3c5-c1f7503-96af72e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:05.732792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818db999-491c3c5-c1f7503-96af72e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.732875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:05.732892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 846
2025-10-10T14:33:05.733047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.733082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:05.733104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:05.733108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:05.733708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 846 sessionId:  describe result for acl check
2025-10-10T14:33:05.733741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:05.733747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:05.733748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:05.733756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601081360554200:7410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:05.734298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601081360554200:7410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:05.736559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601081360554200:7410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:05.737856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:05.739834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:05.740007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:05.740017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:05.740025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:05.740063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:05.740090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601080578342263:5912]
2025-10-10T14:33:05.740114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601081360554200:7410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:05.740134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601081360554200:7410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:05.740138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601081360554200:7410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:05.740146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:05.740472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:05.740711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:05.740740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:05.740964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:05.741005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.741010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.741010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.741011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.741012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.741012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.741013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.741014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.741015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.741015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.741016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.741016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.741017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.741020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.741029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.741032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.741034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.741037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.741039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.741041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.741043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.741046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.741048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.741050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.741053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.741055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.741060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.741065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.741069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.741072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.741075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.741078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.741080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.741083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.741086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.741089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.741092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.741095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.741098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.741101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.741104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.741107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.741109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.741112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.741115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.741118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.741120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.741123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.741125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.741128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.741131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.741134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.741155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:05.743288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:05.743614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:05.743625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:05.743627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:05.743631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:05.743636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 845 [2:7559601080578342263:5912]
2025-10-10T14:33:05.743648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:05.743665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:05.743672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.743675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.743678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.743693Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:05.743704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:05.743717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:05.743768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.743774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.743776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.743778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:05.743850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:05.743859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.743871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.743883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.743900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:05.743920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360554327:7410], now have 1 active actors on pipe
2025-10-10T14:33:05.743928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360554160:2438], now have 1 active actors on pipe
2025-10-10T14:33:05.743935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601080578342258:5912]
2025-10-10T14:33:05.743938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601080578342258:5912]
2025-10-10T14:33:05.743940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601080578342258:5912]
2025-10-10T14:33:05.743957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 845
2025-10-10T14:33:05.743961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:05.743963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 845
2025-10-10T14:33:05.743981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:05.743983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:05.743985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:05.743987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:05.743998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:05.744001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:05.744047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.744056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.744068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601080578342258:5912]
2025-10-10T14:33:05.744085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:05.744078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:05.744113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|875cfdf7-660dced5-b1b77381-24c69b95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:05.744126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.744130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.744132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:05.744142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.744156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:05.744176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.744306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.744312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.744324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.744412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 846 partition: 0 MaxSeqNo: 40 sessionId: src_id|875cfdf7-660dced5-b1b77381-24c69b95_0
2025-10-10T14:33:05.744797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818db999-491c3c5-c1f7503-96af72e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|875cfdf7-660dced5-b1b77381-24c69b95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:05.747419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875cfdf7-660dced5-b1b77381-24c69b95_0] Write session: try to update token
2025-10-10T14:33:05.747435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875cfdf7-660dced5-b1b77381-24c69b95_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:05.761044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId: src_id|875cfdf7-660dced5-b1b77381-24c69b95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:05.762103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:05.762118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.762120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:05.762121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:05.762129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601080578342258:5912]
2025-10-10T14:33:05.762132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601080578342258:5912]
2025-10-10T14:33:05.762135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601080578342258:5912]
2025-10-10T14:33:05.762175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:05.762174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:05.762179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:05.762181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.762182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:05.762183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:05.762317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:05.763596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:05.824960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601081360554339:7150]
2025-10-10T14:33:05.825212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 845, pipe: [1:7559601081360554339:7150]
2025-10-10T14:33:05.865515Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:05.865952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.865967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.866010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360554339:7150], now have 1 active actors on pipe
2025-10-10T14:33:05.866166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:05.866274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:05.866292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:05.866297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601081360554339:7150]
2025-10-10T14:33:05.866319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:05.866369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 846 reason: error at write: Disconnected sessionId: src_id|875cfdf7-660dced5-b1b77381-24c69b95_0
2025-10-10T14:33:05.866584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 846 sessionId: src_id|875cfdf7-660dced5-b1b77381-24c69b95_0 is DEAD
2025-10-10T14:33:05.866730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875cfdf7-660dced5-b1b77381-24c69b95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:05.866739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875cfdf7-660dced5-b1b77381-24c69b95_0] Write session will restart in 0.009494s
2025-10-10T14:33:05.866763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875cfdf7-660dced5-b1b77381-24c69b95_0] Write session: Do CDS request
2025-10-10T14:33:05.866777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875cfdf7-660dced5-b1b77381-24c69b95_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:05.877781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875cfdf7-660dced5-b1b77381-24c69b95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.877875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:05.877893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 847
2025-10-10T14:33:05.878019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:05.878054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:05.878064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:05.878068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:05.878486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 847 sessionId:  describe result for acl check
2025-10-10T14:33:05.878527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:05.878529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:05.878531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:05.878538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601081360554478:7414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:05.878764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:05.879108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601081360554478:7414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:05.880693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:05.880863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:05.880876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:05.880888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:05.880937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:05.880977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601080578342440:5914]
2025-10-10T14:33:05.881055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601081360554478:7414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:05.881595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:05.881848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:05.881895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:05.882199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:05.882248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.882254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.882255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.882256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.882257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.882259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.882260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.882261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.882262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.882263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.882264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.882266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.882267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.882272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.882284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.882288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.882292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.882296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.882300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.882303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.882312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.882316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.882324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.882328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.882335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.882339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.882350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.882363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:05.882373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.882382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:05.882388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.882394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:05.882401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.882406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:05.882415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.882424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:05.882430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.882439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:05.882444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.882449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:05.882457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.882462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:05.882470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.882475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:05.882484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.882490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:05.882498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.882503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.882511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.882515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.882524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.882533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.882573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:05.884523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601081360554478:7414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:05.884538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601081360554478:7414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:05.884541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601081360554478:7414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:05.884548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:05.884604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:05.884908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:05.884919Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:05.884921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:05.884925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:05.884930Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 846 [2:7559601080578342440:5914]
2025-10-10T14:33:05.884940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:05.884959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:05.884967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.884971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.884976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.884992Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:05.885003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:05.885015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:05.885063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.885068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.885070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.885073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:05.885137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:05.885145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.885155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:05.885165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:05.885179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:05.885205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360554512:7414], now have 1 active actors on pipe
2025-10-10T14:33:05.885214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360554340:2438], now have 1 active actors on pipe
2025-10-10T14:33:05.885221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601080578342435:5914]
2025-10-10T14:33:05.885223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601080578342435:5914]
2025-10-10T14:33:05.885225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601080578342435:5914]
2025-10-10T14:33:05.885239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:05.885255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:05.885243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 846
2025-10-10T14:33:05.885256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:05.885245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 846
2025-10-10T14:33:05.885261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:05.885263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:05.885274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:05.885276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:05.885296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601080578342435:5914]
2025-10-10T14:33:05.885308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:05.885321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:05.885364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.885373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.885403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:05.885416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:05.885419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:05.885422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:05.885435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:05.885444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:05.885462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.885616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.885625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.885641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:05.885717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 847 partition: 0 MaxSeqNo: 40 sessionId: src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0
2025-10-10T14:33:05.886003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875cfdf7-660dced5-b1b77381-24c69b95_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:05.888464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0] Write session: try to update token
2025-10-10T14:33:05.888477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:05.896410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:05.896431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.896442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601080578342435:5914]
2025-10-10T14:33:05.896500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:05.896538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:05.896797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:05.897011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:05.897234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:05.897488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:05.897704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:05.897743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:05.901979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId: src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:05.904623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:05.904815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:05.904830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:05.904863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:05.904945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:05.912941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:05.912956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:05.912959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:05.912960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:05.912968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601080578342435:5914]
2025-10-10T14:33:05.912971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601080578342435:5914]
2025-10-10T14:33:05.912976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601080578342435:5914]
2025-10-10T14:33:05.913011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:05.913014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:05.913015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:05.913019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:05.913019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:05.913020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:05.913138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:05.966307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601081360554520:7150]
2025-10-10T14:33:05.966582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 846, pipe: [1:7559601081360554520:7150]
2025-10-10T14:33:06.017208Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:06.024108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.024127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.024271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.024325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.024383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.024440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.024480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.024488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.024558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.024622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.024679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.024739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.024779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.024784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.024844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.024901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.024958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.025017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.025058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.025065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.025126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.025186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.025245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.025304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.025368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.025378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.025443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.025498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.025555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.025618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.025665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.025674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.025739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.025794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.025853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.025912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.025953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.025959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.026021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.026075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.026135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.026192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.026231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.026238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.026296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.026350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.026409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.026468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.026509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.026514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.026573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.026630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.026688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.026756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.026797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.026802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.026862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.026920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.026979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.027047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.027092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.027099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.027147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601081360554520:7150], now have 1 active actors on pipe
2025-10-10T14:33:06.027353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:06.027375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:06.027378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:06.027396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601081360554520:7150]
2025-10-10T14:33:06.027407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 847 reason: error at write: Disconnected sessionId: src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0
2025-10-10T14:33:06.027672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 847 sessionId: src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0 is DEAD
2025-10-10T14:33:06.027791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:06.027803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0] Write session will restart in 0.007676s
2025-10-10T14:33:06.027828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0] Write session: Do CDS request
2025-10-10T14:33:06.027835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:06.028126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:06.036879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.036965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:06.036982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 848
2025-10-10T14:33:06.037167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.037201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:06.037214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:06.037217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:06.037639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 848 sessionId:  describe result for acl check
2025-10-10T14:33:06.037678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:06.037686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:06.037688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:06.037694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601085655521948:7427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:06.038214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601085655521948:7427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:06.039707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:06.040296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601085655521948:7427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:06.042125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:06.042285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:06.042294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:06.042312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:06.042354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:06.042386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601084873309951:5924]
2025-10-10T14:33:06.042577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601085655521948:7427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:06.042590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601085655521948:7427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:06.042593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601085655521948:7427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:06.042601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:06.042767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:06.042979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:06.043006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:06.043243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:06.043287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.043291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.043292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.043293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.043293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.043294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.043295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.043295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.043296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.043297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.043297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.043298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.043299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.043302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.043310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.043313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.043315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.043317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.043320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.043322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.043324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.043326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.043328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.043330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.043332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.043334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.043339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.043345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.043349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.043353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.043356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.043359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.043361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.043364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.043367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.043371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.043374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.043377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.043380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.043383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.043385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.043388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.043391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.043394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.043396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.043399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.043402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.043404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.043407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.043410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.043413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.043416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.043439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:06.045593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:06.045890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:06.045899Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:06.045901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:06.045904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:06.045908Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 847 [2:7559601084873309951:5924]
2025-10-10T14:33:06.045916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:06.045928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:06.045930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.045932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.045934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.045945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:06.045952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:06.045958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:06.046004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.046011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.046013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.046014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:06.046064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:06.046070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.046076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.046083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.046101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:06.046120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601084873309946:5924]
2025-10-10T14:33:06.046126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601084873309946:5924]
2025-10-10T14:33:06.046127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601084873309946:5924]
2025-10-10T14:33:06.046134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:06.046144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:06.046147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522010:7427], now have 1 active actors on pipe
2025-10-10T14:33:06.046147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:06.046149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:06.046153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:06.046162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:06.046164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:06.046167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655521843:2438], now have 1 active actors on pipe
2025-10-10T14:33:06.046181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601084873309946:5924]
2025-10-10T14:33:06.046189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:06.046210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:06.046237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 847
2025-10-10T14:33:06.046252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 847
2025-10-10T14:33:06.046305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.046312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.046338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:06.046347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.046350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.046351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:06.046359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.046368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:06.046386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.046617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.046628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.046648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.046728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 848 partition: 0 MaxSeqNo: 40 sessionId: src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0
2025-10-10T14:33:06.047097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f199b9b5-5833d84c-a5e5bb4e-5ee6cbc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:06.049676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0] Write session: try to update token
2025-10-10T14:33:06.049693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:06.057504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:06.057518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:06.057526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601084873309946:5924]
2025-10-10T14:33:06.057566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:06.057574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:06.057719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:06.057860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:06.057982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:06.058118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:06.058299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:06.058340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:06.063285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId: src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:06.065927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:06.066201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.066219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.066259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:06.066356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:06.074358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:06.074373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:06.074376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:06.074377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:06.074388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601084873309946:5924]
2025-10-10T14:33:06.074393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601084873309946:5924]
2025-10-10T14:33:06.074396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601084873309946:5924]
2025-10-10T14:33:06.074441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:06.074441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:06.074446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:06.074451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:06.074453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.074456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:06.074578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:06.127551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601085655522025:7150]
2025-10-10T14:33:06.127838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 847, pipe: [1:7559601085655522025:7150]
2025-10-10T14:33:06.181153Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:06.188159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.188180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.188331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.188396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.188466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.188526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.188566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.188573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.188639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.188698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.188752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.188811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.188854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.188860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.188930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.188987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.189043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.189107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.189157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.189164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.189231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.189287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.189369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.189479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.189521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.189527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.189588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.189642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.189702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.189760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.189800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.189805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.189864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.189925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.189983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.190039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.190080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.190085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.190151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.190220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.190287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.190345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.190388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.190393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.190454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.190508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.190570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.190631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.190687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.190693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.190751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.190806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.190864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.190923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.190963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.190968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.191042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:06.191101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:06.191166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:06.191231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:06.191271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:06.191276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:06.191317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522025:7150], now have 1 active actors on pipe
2025-10-10T14:33:06.191519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:06.191522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601085655522025:7150]
2025-10-10T14:33:06.191534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:06.191544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:06.191573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 848 reason: error at write: Disconnected sessionId: src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0
2025-10-10T14:33:06.191788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 848 sessionId: src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0 is DEAD
2025-10-10T14:33:06.191970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:06.191980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0] Write session will restart in 0.008098s
2025-10-10T14:33:06.191998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0] Write session: Do CDS request
2025-10-10T14:33:06.192003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:06.192288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:06.200902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.200989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:06.201012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 849
2025-10-10T14:33:06.201159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.201198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:06.201209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:06.201213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:06.201825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 849 sessionId:  describe result for acl check
2025-10-10T14:33:06.201863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:06.201870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:06.201872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:06.201878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601085655522090:7431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:06.202530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601085655522090:7431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:06.205753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601085655522090:7431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:06.206305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:06.208382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:06.208573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:06.208584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:06.208596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:06.208654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:06.208658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601085655522090:7431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:06.208669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601085655522090:7431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:06.208672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601085655522090:7431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:06.208679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:06.208703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601084873310129:5931]
2025-10-10T14:33:06.209287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:06.209561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:06.209608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:06.209926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:06.209985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.209991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.209992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.209993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.209994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.209996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.209997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.209998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.209999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.210000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.210001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.210002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.210004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.210010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.210023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.210027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.210031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.210035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.210039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.210044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.210047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.210050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.210054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.210058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.210062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.210066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.210074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.210083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.210090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.210095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.210101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.210106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.210110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.210115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.210120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.210125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.210132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.210137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.210142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.210147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.210156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.210162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.210171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.210176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.210180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.210186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.210194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.210199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.210204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.210209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.210215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.210221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.210262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:06.212546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:06.212861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:06.212876Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:06.212878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:06.212883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:06.212889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 848 [2:7559601084873310129:5931]
2025-10-10T14:33:06.212904Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:06.212921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:06.212929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.212932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.212935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.212952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:06.212964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:06.212972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:06.213025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.213032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.213034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.213037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:06.213103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:06.213110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.213134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.213152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.213168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:06.213196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522028:2438], now have 1 active actors on pipe
2025-10-10T14:33:06.213204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522199:7431], now have 1 active actors on pipe
2025-10-10T14:33:06.213211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601084873310124:5931]
2025-10-10T14:33:06.213213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601084873310124:5931]
2025-10-10T14:33:06.213216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601084873310124:5931]
2025-10-10T14:33:06.213231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:06.213246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:06.213251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:06.213256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:06.213259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:06.213268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:06.213271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:06.213252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 848
2025-10-10T14:33:06.213254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 848
2025-10-10T14:33:06.213297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601084873310124:5931]
2025-10-10T14:33:06.213311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:06.213320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:06.213354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.213359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.213416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:06.213429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.213434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.213437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:06.213448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.213459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:06.213480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.213659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.213670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.213688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.213775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 849 partition: 0 MaxSeqNo: 40 sessionId: src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0
2025-10-10T14:33:06.214223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd2803e-265b9767-93f655d9-2115a8b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:06.216848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0] Write session: try to update token
2025-10-10T14:33:06.216867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:06.231225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId: src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:06.232594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:06.232618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:06.232621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:06.232623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:06.232633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601084873310124:5931]
2025-10-10T14:33:06.232637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601084873310124:5931]
2025-10-10T14:33:06.232641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601084873310124:5931]
2025-10-10T14:33:06.232686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:06.232693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:06.232700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:06.232702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.232704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:06.232705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:06.232847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:06.234066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:06.291914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601085655522225:7150]
2025-10-10T14:33:06.292230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 848, pipe: [1:7559601085655522225:7150]
2025-10-10T14:33:06.339438Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:06.339987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.340003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.340047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522225:7150], now have 1 active actors on pipe
2025-10-10T14:33:06.340262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:06.340319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601085655522225:7150]
2025-10-10T14:33:06.340353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:06.340364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:06.340443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 849 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0
2025-10-10T14:33:06.340681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 849 sessionId: src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0 is DEAD
2025-10-10T14:33:06.340825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:06.340835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0] Write session will restart in 0.005059s
2025-10-10T14:33:06.340859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0] Write session: Do CDS request
2025-10-10T14:33:06.340865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:06.346887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.346930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:06.346945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 850
2025-10-10T14:33:06.347143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.347187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:06.347196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:06.347199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:06.347592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 850 sessionId:  describe result for acl check
2025-10-10T14:33:06.347618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:06.347619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:06.347620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:06.347624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601085655522241:7438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:06.348039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601085655522241:7438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:06.351323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601085655522241:7438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:06.353810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:06.353916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601085655522241:7438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:06.353931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601085655522241:7438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:06.353935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601085655522241:7438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:06.353943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:06.356037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:06.356230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:06.356242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:06.356253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:06.356301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:06.356343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601084873310321:5934]
2025-10-10T14:33:06.356972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:06.357249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:06.357291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:06.357614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:06.357669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.357675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.357677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.357678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.357679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.357680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.357681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.357683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.357684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.357685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.357686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.357687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.357688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.357693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.357707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.357711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.357714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.357718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.357722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.357726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.357729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.357733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.357737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.357741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.357745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.357749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.357755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.357764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.357770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.357776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.357782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.357787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.357791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.357796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.357800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.357805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.357811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.357816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.357821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.357826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.357835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.357840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.357845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.357855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.357859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.357864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.357870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.357874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.357884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.357889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.357894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.357898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.357934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:06.360133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:06.360433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:06.360447Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:06.360449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:06.360452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:06.360458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 849 [2:7559601084873310321:5934]
2025-10-10T14:33:06.360469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:06.360485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:06.360488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.360491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.360494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.360509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:06.360522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:06.360533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:06.360589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.360596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.360597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.360600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:06.360661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:06.360671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.360681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.360692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.360709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:06.360734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522397:7438], now have 1 active actors on pipe
2025-10-10T14:33:06.360742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522227:2438], now have 1 active actors on pipe
2025-10-10T14:33:06.360750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601084873310315:5934]
2025-10-10T14:33:06.360752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601084873310315:5934]
2025-10-10T14:33:06.360754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601084873310315:5934]
2025-10-10T14:33:06.360766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:06.360778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:06.360772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 849
2025-10-10T14:33:06.360779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 849
2025-10-10T14:33:06.360782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:06.360787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:06.360789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:06.360798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:06.360801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:06.360833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.360843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.360863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601084873310315:5934]
2025-10-10T14:33:06.360874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:06.360882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:06.360906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:06.360918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.360925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.360927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:06.360939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.360953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:06.360976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.361084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.361093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.361108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.361205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 850 partition: 0 MaxSeqNo: 40 sessionId: src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0
2025-10-10T14:33:06.361589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b071ca43-1db5c12e-e1beeafe-cba513e7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:06.364160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0] Write session: try to update token
2025-10-10T14:33:06.364176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:06.378269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId: src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:06.379191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:06.379207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:06.379212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:06.379214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:06.379225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601084873310315:5934]
2025-10-10T14:33:06.379230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601084873310315:5934]
2025-10-10T14:33:06.379234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601084873310315:5934]
2025-10-10T14:33:06.379282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:06.379289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.379292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:06.379297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:06.379299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:06.379303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:06.379441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:06.380804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:06.440378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601085655522409:7150]
2025-10-10T14:33:06.440642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 849, pipe: [1:7559601085655522409:7150]
2025-10-10T14:33:06.486549Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:06.486827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.486844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.486891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522409:7150], now have 1 active actors on pipe
2025-10-10T14:33:06.487125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:06.487134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601085655522409:7150]
2025-10-10T14:33:06.487166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:06.487167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:06.487171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:06.487232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 850 reason: error at write: Disconnected sessionId: src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0
2025-10-10T14:33:06.487485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 850 sessionId: src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0 is DEAD
2025-10-10T14:33:06.487661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:06.487670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0] Write session will restart in 0.009683s
2025-10-10T14:33:06.487696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0] Write session: Do CDS request
2025-10-10T14:33:06.487702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:06.498918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.498980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:06.499012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 851
2025-10-10T14:33:06.499158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.499196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:06.499205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:06.499210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:06.499676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 851 sessionId:  describe result for acl check
2025-10-10T14:33:06.499717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:06.499726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:06.499728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:06.499736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601085655522552:7442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:06.500336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601085655522552:7442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:06.500444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:06.502380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601085655522552:7442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:06.502712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:06.502925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:06.502935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:06.502948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:06.503020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:06.503075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601084873310499:5936]
2025-10-10T14:33:06.503711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:06.503988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:06.504030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:06.504357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:06.504414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.504421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.504422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.504423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.504425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.504426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.504427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.504428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.504430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.504431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.504432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.504434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.504435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.504441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.504454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.504458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.504463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.504466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.504471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.504475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.504479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.504483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.504488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.504492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.504496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.504500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.504506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.504515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.504522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.504536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.504542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.504547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.504551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.504557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.504565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.504570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.504577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.504582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.504590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.504595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.504599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.504604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.504608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.504618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.504622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.504631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.504636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.504646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.504655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.504661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.504669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.504675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.504715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:06.505041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601085655522552:7442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:06.505056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601085655522552:7442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:06.505059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601085655522552:7442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:06.505067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:06.506856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:06.507190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:06.507202Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:06.507205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:06.507209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:06.507215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 850 [2:7559601084873310499:5936]
2025-10-10T14:33:06.507225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:06.507242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:06.507245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.507248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.507254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.507270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:06.507283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:06.507291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:06.507345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.507353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.507355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.507358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:06.507422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:06.507430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.507442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.507454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.507477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:06.507503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522587:7442], now have 1 active actors on pipe
2025-10-10T14:33:06.507507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522411:2438], now have 1 active actors on pipe
2025-10-10T14:33:06.507514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601084873310494:5936]
2025-10-10T14:33:06.507516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601084873310494:5936]
2025-10-10T14:33:06.507518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601084873310494:5936]
2025-10-10T14:33:06.507532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:06.507526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 850
2025-10-10T14:33:06.507545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:06.507547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:06.507550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 850
2025-10-10T14:33:06.507549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:06.507552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:06.507568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:06.507571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:06.507605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.507613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.507629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601084873310494:5936]
2025-10-10T14:33:06.507636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:06.507639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:06.507662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:06.507672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.507676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.507678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:06.507690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.507704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:06.507728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.507860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.507867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.507882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.507989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 851 partition: 0 MaxSeqNo: 40 sessionId: src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0
2025-10-10T14:33:06.508381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3134e655-90f0e2f0-c9387a96-2e769e59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:06.510985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0] Write session: try to update token
2025-10-10T14:33:06.511017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:06.525509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId: src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:06.526807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:06.526823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:06.526827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:06.526830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:06.526840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601084873310494:5936]
2025-10-10T14:33:06.526844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601084873310494:5936]
2025-10-10T14:33:06.526849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601084873310494:5936]
2025-10-10T14:33:06.526894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:06.526903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:06.526911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.526913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:06.526919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:06.526923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:06.527084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:06.528036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:06.587338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601085655522601:7150]
2025-10-10T14:33:06.587609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 850, pipe: [1:7559601085655522601:7150]
2025-10-10T14:33:06.631223Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:06.631581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.631594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.631633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522601:7150], now have 1 active actors on pipe
2025-10-10T14:33:06.631789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:06.631871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:06.631922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:06.631937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601085655522601:7150]
2025-10-10T14:33:06.632006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 851 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0
2025-10-10T14:33:06.632215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 851 sessionId: src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0 is DEAD
2025-10-10T14:33:06.632384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:06.632396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0] Write session will restart in 0.008034s
2025-10-10T14:33:06.632421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0] Write session: Do CDS request
2025-10-10T14:33:06.632427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:06.641854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.641989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:06.642009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 852
2025-10-10T14:33:06.642114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.642150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:06.642161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:06.642164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:06.642652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 852 sessionId:  describe result for acl check
2025-10-10T14:33:06.642691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:06.642697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:06.642698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:06.642705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601085655522725:7448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:06.643281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601085655522725:7448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:06.644294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:06.644987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601085655522725:7448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:06.646372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:06.646573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:06.646583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:06.646595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:06.646648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:06.646688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601084873310682:5939]
2025-10-10T14:33:06.647283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601085655522725:7448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:06.647295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601085655522725:7448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:06.647286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:06.647298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601085655522725:7448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:06.647304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:06.647514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:06.647555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:06.647776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:06.647821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.647828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.647829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.647830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.647831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.647832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.647834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.647835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.647836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.647837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.647838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.647839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.647840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.647846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.647857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.647861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.647865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.647869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.647873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.647877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.647880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.647884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.647886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.647888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.647890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.647892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.647897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.647902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.647906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.647910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.647913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.647917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.647919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.647922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.647925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.647927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.647930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.647933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.647936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.647938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.647941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.647943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.647946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.647949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.647951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.647954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.647957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.647960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.647962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.647965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.647969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.647974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.648010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:06.650085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:06.650415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:06.650425Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:06.650427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:06.650430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:06.650435Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 851 [2:7559601084873310682:5939]
2025-10-10T14:33:06.650446Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:06.650460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:06.650467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.650470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.650472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.650488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:06.650500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:06.650507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:06.650557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.650562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.650564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.650567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:06.650632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:06.650643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.650653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.650665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.650682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:06.650705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522779:7448], now have 1 active actors on pipe
2025-10-10T14:33:06.650713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522603:2438], now have 1 active actors on pipe
2025-10-10T14:33:06.650719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601084873310677:5939]
2025-10-10T14:33:06.650721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601084873310677:5939]
2025-10-10T14:33:06.650723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601084873310677:5939]
2025-10-10T14:33:06.650708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 851
2025-10-10T14:33:06.650711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 851
2025-10-10T14:33:06.650736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:06.650742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:06.650744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:06.650745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:06.650749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:06.650765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:06.650768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:06.650798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.650807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.650824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601084873310677:5939]
2025-10-10T14:33:06.650835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:06.650838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:06.650860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:06.650871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.650874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.650876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:06.650886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.650895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:06.650923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.651242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.651254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.651279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.651399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 852 partition: 0 MaxSeqNo: 40 sessionId: src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0
2025-10-10T14:33:06.651700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1180e33a-5309ef6-2afe9378-d1e8ba05_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:06.654374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0] Write session: try to update token
2025-10-10T14:33:06.654393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:06.668563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId: src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:06.669454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:06.669471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:06.669474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:06.669476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:06.669486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601084873310677:5939]
2025-10-10T14:33:06.669490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601084873310677:5939]
2025-10-10T14:33:06.669494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601084873310677:5939]
2025-10-10T14:33:06.669540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:06.669551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.669558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:06.669643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:06.669654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:06.669660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:06.669687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:06.671076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:06.732256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601085655522790:7150]
2025-10-10T14:33:06.732548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 851, pipe: [1:7559601085655522790:7150]
2025-10-10T14:33:06.774195Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:06.774422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.774435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.774475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522790:7150], now have 1 active actors on pipe
2025-10-10T14:33:06.774648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:06.774703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:06.774715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:06.774717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:06.774771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601085655522790:7150]
2025-10-10T14:33:06.774781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 852 reason: error at write: Disconnected sessionId: src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0
2025-10-10T14:33:06.775008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 852 sessionId: src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0 is DEAD
2025-10-10T14:33:06.775162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:06.775169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0] Write session will restart in 0.007965s
2025-10-10T14:33:06.775187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0] Write session: Do CDS request
2025-10-10T14:33:06.775195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:06.783839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.783932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:06.783947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 853
2025-10-10T14:33:06.784086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.784121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:06.784131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:06.784135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:06.784541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 853 sessionId:  describe result for acl check
2025-10-10T14:33:06.784574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:06.784576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:06.784578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:06.784584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601085655522854:7452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:06.785099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601085655522854:7452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:06.787532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601085655522854:7452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:06.788062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:06.789975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:06.790178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:06.790188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:06.790197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:06.790219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601085655522854:7452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:06.790232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601085655522854:7452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:06.790235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601085655522854:7452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:06.790242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:06.790241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:06.790272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601084873310864:5941]
2025-10-10T14:33:06.790708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:06.791054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:06.791112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:06.791482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:06.791539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.791545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.791547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.791548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.791549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.791550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.791551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.791552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.791553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.791555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.791556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.791557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.791558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.791563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.791576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.791581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.791585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.791589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.791593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.791597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.791601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.791605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.791609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.791613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.791617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.791621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.791628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.791637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.791644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.791650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.791654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.791658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.791664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.791673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.791678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.791687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.791692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.791697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.791701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.791711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.791715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.791720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.791729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.791734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.791738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.791743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.791752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.791756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.791763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.791772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.791778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.791783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.791835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:06.794049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:06.794518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:06.794532Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:06.794534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:06.794537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:06.794542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 852 [2:7559601084873310864:5941]
2025-10-10T14:33:06.794554Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:06.794569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:06.794572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.794576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.794578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.794594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:06.794601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:06.794608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:06.794658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.794665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.794667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.794670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:06.794733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:06.794741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.794753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.794765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.794787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:06.794812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522791:2438], now have 1 active actors on pipe
2025-10-10T14:33:06.794819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522965:7452], now have 1 active actors on pipe
2025-10-10T14:33:06.794826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601084873310859:5941]
2025-10-10T14:33:06.794828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601084873310859:5941]
2025-10-10T14:33:06.794831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601084873310859:5941]
2025-10-10T14:33:06.794850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 852
2025-10-10T14:33:06.794858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 852
2025-10-10T14:33:06.794843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:06.794862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:06.794869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:06.794873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:06.794875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:06.794878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:06.794881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:06.794900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601084873310859:5941]
2025-10-10T14:33:06.794903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:06.794910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:06.794919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.794923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.794972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:06.794984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.794988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.794990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:06.795010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.795025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:06.795046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.795197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.795207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.795220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.795310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 853 partition: 0 MaxSeqNo: 40 sessionId: src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0
2025-10-10T14:33:06.795648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471d882-68acfd75-b6a0b956-9a4f9c22_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:06.798224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0] Write session: try to update token
2025-10-10T14:33:06.798238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:06.812526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId: src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:06.813830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:06.813848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:06.813851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:06.813853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:06.813863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601084873310859:5941]
2025-10-10T14:33:06.813868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601084873310859:5941]
2025-10-10T14:33:06.813872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601084873310859:5941]
2025-10-10T14:33:06.813922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:06.813921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:06.813928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:06.813935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.813937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:06.813948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:06.814076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:06.815230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:06.875088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601085655522977:7150]
2025-10-10T14:33:06.875404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 852, pipe: [1:7559601085655522977:7150]
2025-10-10T14:33:06.917858Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:06.918190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.918204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.918245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522977:7150], now have 1 active actors on pipe
2025-10-10T14:33:06.918504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601085655522977:7150]
2025-10-10T14:33:06.918530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:06.918554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:06.918557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:06.918628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 853 reason: error at write: Disconnected sessionId: src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0
2025-10-10T14:33:06.918636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:06.918814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 853 sessionId: src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0 is DEAD
2025-10-10T14:33:06.919002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:06.919015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0] Write session will restart in 0.008257s
2025-10-10T14:33:06.919040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0] Write session: Do CDS request
2025-10-10T14:33:06.919047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:06.928879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.928944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:06.928960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 854
2025-10-10T14:33:06.929145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:06.929193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:06.929218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:06.929227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:06.929680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 854 sessionId:  describe result for acl check
2025-10-10T14:33:06.929720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:06.929727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:06.929729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:06.929735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601085655523076:7456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:06.930260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601085655523076:7456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:06.932260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:06.932415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601085655523076:7456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:06.934027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:06.934211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:06.934223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:06.934236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:06.934293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:06.934334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601084873311047:5943]
2025-10-10T14:33:06.934920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:06.935068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601085655523076:7456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:06.935088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601085655523076:7456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:06.935092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601085655523076:7456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:06.935099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:06.935201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:06.935245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:06.935564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:06.935623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.935631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.935632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.935633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.935634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.935635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.935636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.935637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.935639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.935640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.935641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.935642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.935643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.935649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.935662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.935666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.935670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.935674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.935679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.935682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.935686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.935690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.935694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.935698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.935701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.935705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.935712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.935722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:06.935727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.935733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:06.935743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.935748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:06.935752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.935758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:06.935763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.935768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:06.935772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.935782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:06.935789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.935799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:06.935808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.935816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:06.935825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.935830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:06.935839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.935845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:06.935849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.935855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.935864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.935869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.935876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.935885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.935924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:06.938160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:06.938715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:06.938729Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:06.938732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:06.938736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:06.938741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 853 [2:7559601084873311047:5943]
2025-10-10T14:33:06.938753Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:06.938775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:06.938778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.938781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.938783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.938795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:06.938809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:06.938816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:06.938868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.938876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.938878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.938881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:06.938942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:06.938951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.938962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:06.938978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:06.939012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:06.939037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655523155:7456], now have 1 active actors on pipe
2025-10-10T14:33:06.939046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601085655522978:2438], now have 1 active actors on pipe
2025-10-10T14:33:06.939054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601084873311042:5943]
2025-10-10T14:33:06.939061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601084873311042:5943]
2025-10-10T14:33:06.939063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601084873311042:5943]
2025-10-10T14:33:06.939077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:06.939080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 853
2025-10-10T14:33:06.939093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:06.939083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 853
2025-10-10T14:33:06.939094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:06.939101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:06.939104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:06.939110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:06.939113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:06.939135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601084873311042:5943]
2025-10-10T14:33:06.939143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:06.939144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:06.939158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.939167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.939218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:06.939231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:06.939235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:06.939242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:06.939253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:06.939265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:06.939287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.939441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.939451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.939469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:06.939583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 854 partition: 0 MaxSeqNo: 40 sessionId: src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0
2025-10-10T14:33:06.939923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|973fd789-589fe5db-377fae98-d5b6b3a6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:06.942348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0] Write session: try to update token
2025-10-10T14:33:06.942363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:06.955404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId: src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:06.957763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:06.957995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:06.958020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:06.958044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:06.958052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:06.958056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:06.958058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:06.958065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601084873311042:5943]
2025-10-10T14:33:06.958071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601084873311042:5943]
2025-10-10T14:33:06.958075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601084873311042:5943]
2025-10-10T14:33:06.958114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:06.958124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:06.958128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:06.958134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:06.958142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:06.958144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:06.958276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:07.018945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601089950490461:7150]
2025-10-10T14:33:07.019153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 853, pipe: [1:7559601089950490461:7150]
2025-10-10T14:33:07.067581Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:07.067824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:07.067874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950490461:7150], now have 1 active actors on pipe
2025-10-10T14:33:07.067941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:07.071544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601089950490461:7150]
2025-10-10T14:33:07.071570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:07.077178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:07.077192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:07.077217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 854 reason: error at write: Disconnected sessionId: src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0
2025-10-10T14:33:07.077406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 854 sessionId: src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0 is DEAD
2025-10-10T14:33:07.077524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:07.077531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0] Write session will restart in 0.007884s
2025-10-10T14:33:07.077555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0] Write session: Do CDS request
2025-10-10T14:33:07.077561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:07.086868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.086864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:07.086934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:07.086951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 855
2025-10-10T14:33:07.087124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.087160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:07.087181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:07.087190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:07.087592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 855 sessionId:  describe result for acl check
2025-10-10T14:33:07.087621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:07.087624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:07.087626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:07.087632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601089950490634:7469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:07.088166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601089950490634:7469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:07.089282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:07.089495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:07.089505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:07.089518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:07.089565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:07.089603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601089168278566:5952]
2025-10-10T14:33:07.090013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:07.090255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601089950490634:7469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:07.090277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:07.090379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:07.090667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:07.090713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.090718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.090718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.090719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.090719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.090720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.090721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.090721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.090722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.090723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.090723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.090724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.090724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.090728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.090735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.090738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.090740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.090742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.090744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.090746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.090748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.090751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.090753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.090755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.090757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.090759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.090764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.090770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.090775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.090779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.090781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.090784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.090787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.090790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.090792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.090795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.090797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.090800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.090803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.090806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.090811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.090816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.090820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.090825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.090828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.090833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.090837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.090842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.090845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.090850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.090854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.090858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.090896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:07.093009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601089950490634:7469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:07.093024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601089950490634:7469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:07.093028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601089950490634:7469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:07.093035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:07.093054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:07.093370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:07.093379Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:07.093381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:07.093384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:07.093390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 854 [2:7559601089168278566:5952]
2025-10-10T14:33:07.093401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:07.093423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:07.093426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.093430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.093432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.093447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:07.093454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:07.093468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:07.093518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.093528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.093530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.093533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:07.093604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:07.093611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.093717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 854
2025-10-10T14:33:07.093751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.093769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.093757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 854
2025-10-10T14:33:07.093788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:07.093813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950490481:2438], now have 1 active actors on pipe
2025-10-10T14:33:07.093820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950490664:7469], now have 1 active actors on pipe
2025-10-10T14:33:07.093836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.093845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.093864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601089168278561:5952]
2025-10-10T14:33:07.093871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601089168278561:5952]
2025-10-10T14:33:07.093873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601089168278561:5952]
2025-10-10T14:33:07.093886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:07.093904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:07.093904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:07.093908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:07.093910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:07.093925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:07.093928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:07.093950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfc78ad-79682e16-e8488a48-f96bec34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:07.093960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.093964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.093967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:07.093977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.093993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:07.094013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601089168278561:5952]
2025-10-10T14:33:07.094025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:07.094035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.094036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:07.094172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.094181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.094201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.094268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 855 partition: 0 MaxSeqNo: 40 sessionId: src_id|bfc78ad-79682e16-e8488a48-f96bec34_0
2025-10-10T14:33:07.094599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc06b30d-b248d0e5-2115155a-ca19ef10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bfc78ad-79682e16-e8488a48-f96bec34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:07.097195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc78ad-79682e16-e8488a48-f96bec34_0] Write session: try to update token
2025-10-10T14:33:07.097211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc78ad-79682e16-e8488a48-f96bec34_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:07.105383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:07.105401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:07.105412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601089168278561:5952]
2025-10-10T14:33:07.105459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:07.105462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:07.105636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:07.105792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:07.105929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:07.106066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:07.106250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:07.106293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:07.111007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId: src_id|bfc78ad-79682e16-e8488a48-f96bec34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:07.113520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:07.113683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.113703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.113742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:07.113826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:07.122248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:07.122262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:07.122265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:07.122266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:07.122275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601089168278561:5952]
2025-10-10T14:33:07.122278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601089168278561:5952]
2025-10-10T14:33:07.122281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601089168278561:5952]
2025-10-10T14:33:07.122317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:07.122322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.122328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:07.122331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:07.122339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:07.122344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:07.122441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:07.171534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601089950490672:7150]
2025-10-10T14:33:07.171793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 854, pipe: [1:7559601089950490672:7150]
2025-10-10T14:33:07.232671Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:07.239204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.239226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.239370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.239424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.239479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.239543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.239749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.239757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.239816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.239872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.239927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.239986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.240026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.240037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.240105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.240168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.240236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.240297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.240341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.240344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.240407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.240476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.240537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.240598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.240639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.240645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.240707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.240765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.240826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.240887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.240932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.240938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.241000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.241061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.241120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.241179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.241223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.241231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.241294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.241366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.241429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.241489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.241532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.241538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.241597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.241654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.241716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.241777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.241817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.241824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.241885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.241940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.241997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.242056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.242098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.242104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.242166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:07.242225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:07.242287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:07.242347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:07.242389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:07.242396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:07.242440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950490672:7150], now have 1 active actors on pipe
2025-10-10T14:33:07.242679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601089950490672:7150]
2025-10-10T14:33:07.242709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:07.242714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:07.242718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:07.242749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 855 reason: error at write: Disconnected sessionId: src_id|bfc78ad-79682e16-e8488a48-f96bec34_0
2025-10-10T14:33:07.242972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 855 sessionId: src_id|bfc78ad-79682e16-e8488a48-f96bec34_0 is DEAD
2025-10-10T14:33:07.243010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:07.243145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc78ad-79682e16-e8488a48-f96bec34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:07.243156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc78ad-79682e16-e8488a48-f96bec34_0] Write session will restart in 0.007270s
2025-10-10T14:33:07.243181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc78ad-79682e16-e8488a48-f96bec34_0] Write session: Do CDS request
2025-10-10T14:33:07.243188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc78ad-79682e16-e8488a48-f96bec34_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:07.251858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc78ad-79682e16-e8488a48-f96bec34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.251888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:07.251908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 856
2025-10-10T14:33:07.252091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.252117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:07.252125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:07.252129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:07.252619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 856 sessionId:  describe result for acl check
2025-10-10T14:33:07.252655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:07.252661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:07.252662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:07.252668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601089950490729:7473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:07.253202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601089950490729:7473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:07.256407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601089950490729:7473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:07.257015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:07.258936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:07.259130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:07.259137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:07.259147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:07.259187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:07.259219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601089168278752:5960]
2025-10-10T14:33:07.259233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601089950490729:7473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:07.259244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601089950490729:7473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:07.259247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601089950490729:7473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:07.259254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:07.259601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:07.259839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:07.259870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:07.260097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:07.260141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.260147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.260148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.260148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.260149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.260150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.260150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.260151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.260151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.260152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.260153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.260153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.260154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.260158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.260165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.260167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.260170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.260172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.260174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.260176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.260179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.260181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.260183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.260185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.260188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.260190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.260195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.260200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.260204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.260208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.260210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.260213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.260216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.260219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.260222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.260225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.260227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.260231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.260233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.260236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.260239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.260242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.260244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.260247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.260250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.260253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.260257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.260261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.260264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.260267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.260269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.260272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.260295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:07.262499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:07.262894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:07.262906Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:07.262908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:07.262912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:07.262918Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 855 [2:7559601089168278752:5960]
2025-10-10T14:33:07.262929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:07.262945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:07.262953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.262957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.262958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.262984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:07.262992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:07.263005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:07.263056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.263063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.263064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.263067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:07.263127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:07.263136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.263148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.263159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.263176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:07.263200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 855
2025-10-10T14:33:07.263218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 855
2025-10-10T14:33:07.263200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950490674:2438], now have 1 active actors on pipe
2025-10-10T14:33:07.263208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950490851:7473], now have 1 active actors on pipe
2025-10-10T14:33:07.263216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601089168278747:5960]
2025-10-10T14:33:07.263218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601089168278747:5960]
2025-10-10T14:33:07.263220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601089168278747:5960]
2025-10-10T14:33:07.263228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:07.263241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:07.263251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:07.263253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:07.263255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:07.263257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:07.263260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:07.263276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.263285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.263317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601089168278747:5960]
2025-10-10T14:33:07.263329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:07.263345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:07.263347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:07.263354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.263358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.263360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:07.263369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.263379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:07.263413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.263560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.263569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.263583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.263671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 856 partition: 0 MaxSeqNo: 40 sessionId: src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0
2025-10-10T14:33:07.264021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc78ad-79682e16-e8488a48-f96bec34_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:07.266594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0] Write session: try to update token
2025-10-10T14:33:07.266611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:07.280318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId: src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:07.281320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:07.281354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:07.281358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:07.281360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:07.281369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601089168278747:5960]
2025-10-10T14:33:07.281373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601089168278747:5960]
2025-10-10T14:33:07.281376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601089168278747:5960]
2025-10-10T14:33:07.281418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:07.281422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:07.281424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:07.281429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:07.281429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.281432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:07.281563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:07.282764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:07.343056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601089950490875:7150]
2025-10-10T14:33:07.343298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 855, pipe: [1:7559601089950490875:7150]
2025-10-10T14:33:07.383674Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:07.383997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.384008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.384048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950490875:7150], now have 1 active actors on pipe
2025-10-10T14:33:07.384209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:07.384273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601089950490875:7150]
2025-10-10T14:33:07.384273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:07.384277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:07.384318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:07.384339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 856 reason: error at write: Disconnected sessionId: src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0
2025-10-10T14:33:07.384605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 856 sessionId: src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0 is DEAD
2025-10-10T14:33:07.384709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:07.384718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0] Write session will restart in 0.007766s
2025-10-10T14:33:07.384737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0] Write session: Do CDS request
2025-10-10T14:33:07.384744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:07.393882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.393959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:07.393976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 857
2025-10-10T14:33:07.394130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.394164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:07.394175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:07.394179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:07.394606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 857 sessionId:  describe result for acl check
2025-10-10T14:33:07.394653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:07.394660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:07.394662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:07.394668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601089950490947:7478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:07.395242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601089950490947:7478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:07.397622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601089950490947:7478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:07.398020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:07.400108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:07.400308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:07.400320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:07.400331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:07.400382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:07.400426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601089168278951:5963]
2025-10-10T14:33:07.400428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601089950490947:7478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:07.400443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601089950490947:7478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:07.400447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601089950490947:7478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:07.400455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:07.401024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:07.401270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:07.401309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:07.401626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:07.401676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.401681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.401683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.401684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.401685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.401686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.401687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.401689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.401690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.401691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.401692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.401693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.401694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.401699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.401713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.401717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.401720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.401724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.401728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.401732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.401736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.401740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.401745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.401748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.401752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.401756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.401763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.401772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.401778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.401784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.401789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.401794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.401798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.401803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.401808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.401813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.401817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.401822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.401826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.401837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.401841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.401845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.401855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.401860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.401865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.401875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.401879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.401884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.401894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.401899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.401909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.401914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.401953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:07.404127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:07.404434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:07.404446Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:07.404448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:07.404451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:07.404456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 856 [2:7559601089168278951:5963]
2025-10-10T14:33:07.404469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:07.404488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:07.404498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.404502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.404504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.404520Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:07.404527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:07.404535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:07.404593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.404600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.404601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.404604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:07.404665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:07.404672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.404684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.404700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.404722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:07.404746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491054:7478], now have 1 active actors on pipe
2025-10-10T14:33:07.404754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950490876:2438], now have 1 active actors on pipe
2025-10-10T14:33:07.404763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601089168278946:5963]
2025-10-10T14:33:07.404769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601089168278946:5963]
2025-10-10T14:33:07.404771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601089168278946:5963]
2025-10-10T14:33:07.404780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:07.404764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 856
2025-10-10T14:33:07.404777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 856
2025-10-10T14:33:07.404794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:07.404798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:07.404801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:07.404804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:07.404815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:07.404818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:07.404840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.404851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.404881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601089168278946:5963]
2025-10-10T14:33:07.404894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:07.404919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14a28d59-587a6f28-cad6a696-4b45f100_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:07.404923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:07.404931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.404938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.404940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:07.404951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.404965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:07.404995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.405155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.405162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.405177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.405245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 857 partition: 0 MaxSeqNo: 40 sessionId: src_id|14a28d59-587a6f28-cad6a696-4b45f100_0
2025-10-10T14:33:07.405642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43eeba1a-eb1c05ed-70f3694e-f3b2716b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|14a28d59-587a6f28-cad6a696-4b45f100_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:07.408434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14a28d59-587a6f28-cad6a696-4b45f100_0] Write session: try to update token
2025-10-10T14:33:07.408453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14a28d59-587a6f28-cad6a696-4b45f100_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:07.422255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId: src_id|14a28d59-587a6f28-cad6a696-4b45f100_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:07.423366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:07.423385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:07.423388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:07.423390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:07.423400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601089168278946:5963]
2025-10-10T14:33:07.423405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601089168278946:5963]
2025-10-10T14:33:07.423409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601089168278946:5963]
2025-10-10T14:33:07.423448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:07.423453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:07.423456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:07.423473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:07.423486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.423489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:07.423615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:07.424625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:07.484371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601089950491066:7150]
2025-10-10T14:33:07.484646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 856, pipe: [1:7559601089950491066:7150]
2025-10-10T14:33:07.550751Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:07.551406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.551423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.551468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491066:7150], now have 1 active actors on pipe
2025-10-10T14:33:07.551691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:07.551712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601089950491066:7150]
2025-10-10T14:33:07.551718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:07.551748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:07.551761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:07.551825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 857 reason: error at write: Disconnected sessionId: src_id|14a28d59-587a6f28-cad6a696-4b45f100_0
2025-10-10T14:33:07.552040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 857 sessionId: src_id|14a28d59-587a6f28-cad6a696-4b45f100_0 is DEAD
2025-10-10T14:33:07.552256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14a28d59-587a6f28-cad6a696-4b45f100_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:07.552268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14a28d59-587a6f28-cad6a696-4b45f100_0] Write session will restart in 0.009396s
2025-10-10T14:33:07.552295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14a28d59-587a6f28-cad6a696-4b45f100_0] Write session: Do CDS request
2025-10-10T14:33:07.552302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14a28d59-587a6f28-cad6a696-4b45f100_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:07.562981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14a28d59-587a6f28-cad6a696-4b45f100_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.563036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:07.563057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 858
2025-10-10T14:33:07.563264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.563327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:07.563338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:07.563342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:07.563898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 858 sessionId:  describe result for acl check
2025-10-10T14:33:07.563944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:07.563951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:07.563954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:07.563961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601089950491176:7482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:07.564551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601089950491176:7482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:07.566698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601089950491176:7482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:07.566743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:07.568733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:07.568853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601089950491176:7482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:07.568867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601089950491176:7482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:07.568870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601089950491176:7482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:07.568878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:07.568942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:07.568956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:07.568968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:07.569031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:07.569075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601089168279139:5965]
2025-10-10T14:33:07.569694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:07.570033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:07.570090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:07.570417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:07.570489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.570496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.570497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.570499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.570500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.570501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.570502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.570504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.570505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.570506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.570508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.570509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.570510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.570516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.570529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.570534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.570538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.570542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.570546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.570551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.570555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.570559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.570565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.570569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.570573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.570578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.570585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.570602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.570613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.570620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.570629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.570635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.570644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.570650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.570660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.570665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.570674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.570679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.570689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.570693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.570698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.570703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.570712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.570718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.570722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.570728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.570734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.570741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.570746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.570756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.570760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.570765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.570811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:07.573234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:07.573806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:07.573823Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:07.573825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:07.573829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:07.573834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 857 [2:7559601089168279139:5965]
2025-10-10T14:33:07.573847Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:07.573869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:07.573876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.573879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.573882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.573897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:07.573909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:07.573919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:07.573979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.573986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.573988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.573991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:07.574053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:07.574060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.574072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.574089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.574111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:07.574138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491068:2438], now have 1 active actors on pipe
2025-10-10T14:33:07.574146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491251:7482], now have 1 active actors on pipe
2025-10-10T14:33:07.574154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601089168279134:5965]
2025-10-10T14:33:07.574156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601089168279134:5965]
2025-10-10T14:33:07.574158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601089168279134:5965]
2025-10-10T14:33:07.574170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:07.574173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 857
2025-10-10T14:33:07.574197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 857
2025-10-10T14:33:07.574182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:07.574188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:07.574202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:07.574204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:07.574205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:07.574208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:07.574245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.574256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.574275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601089168279134:5965]
2025-10-10T14:33:07.574287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:07.574299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:07.574323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:07.574336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.574344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.574351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:07.574364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.574380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:07.574406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.574536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.574557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.574576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.574676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 858 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0
2025-10-10T14:33:07.575090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14a28d59-587a6f28-cad6a696-4b45f100_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:07.578013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0] Write session: try to update token
2025-10-10T14:33:07.578030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:07.592622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId: src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:07.592898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:07.592917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:07.592920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:07.592922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:07.592932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601089168279134:5965]
2025-10-10T14:33:07.592937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601089168279134:5965]
2025-10-10T14:33:07.592941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601089168279134:5965]
2025-10-10T14:33:07.592993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:07.593006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.593014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:07.593028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:07.593041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:07.593046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:07.593144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:07.595235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:07.651778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601089950491270:7150]
2025-10-10T14:33:07.652056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 857, pipe: [1:7559601089950491270:7150]
2025-10-10T14:33:07.719590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:07.719920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.719936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.719990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491270:7150], now have 1 active actors on pipe
2025-10-10T14:33:07.720201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:07.720263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601089950491270:7150]
2025-10-10T14:33:07.720273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:07.720375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:07.720460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 858 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0
2025-10-10T14:33:07.720679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 858 sessionId: src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0 is DEAD
2025-10-10T14:33:07.720798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:07.720809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0] Write session will restart in 0.008599s
2025-10-10T14:33:07.720832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0] Write session: Do CDS request
2025-10-10T14:33:07.720837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:07.730849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.730927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:07.730951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 859
2025-10-10T14:33:07.731095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.731143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:07.731153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:07.731156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:07.731533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 859 sessionId:  describe result for acl check
2025-10-10T14:33:07.731563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:07.731568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:07.731570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:07.731576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601089950491366:7488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:07.732034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601089950491366:7488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:07.734094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601089950491366:7488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:07.734487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:07.736422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:07.736610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:07.736622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:07.736634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:07.736681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:07.736721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601089168279330:5968]
2025-10-10T14:33:07.736720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601089950491366:7488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:07.736734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601089950491366:7488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:07.736738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601089950491366:7488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:07.736746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:07.737382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:07.737797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:07.737842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:07.738171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:07.738222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.738228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.738230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.738231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.738232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.738234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.738235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.738236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.738238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.738239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.738241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.738242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.738243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.738249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.738262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.738267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.738273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.738277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.738282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.738286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.738290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.738295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.738301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.738305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.738309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.738314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.738322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.738331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.738340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.738346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.738351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.738356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.738361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.738367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.738372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.738377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.738387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.738393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.738403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.738408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.738416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.738421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.738431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.738437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.738446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.738452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.738463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.738469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.738474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.738480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.738485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.738492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.738539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:07.740875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:07.741244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:07.741256Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:07.741259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:07.741262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:07.741269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 858 [2:7559601089168279330:5968]
2025-10-10T14:33:07.741280Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:07.741302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:07.741305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.741307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.741309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.741321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:07.741350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:07.741366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:07.741420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.741428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.741430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.741433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:07.741495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:07.741502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.741513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.741531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.741553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:07.741577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491271:2438], now have 1 active actors on pipe
2025-10-10T14:33:07.741585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491452:7488], now have 1 active actors on pipe
2025-10-10T14:33:07.741593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601089168279325:5968]
2025-10-10T14:33:07.741595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601089168279325:5968]
2025-10-10T14:33:07.741597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601089168279325:5968]
2025-10-10T14:33:07.741610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:07.741628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:07.741634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:07.741637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:07.741639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:07.741615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 858
2025-10-10T14:33:07.741641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 858
2025-10-10T14:33:07.741645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:07.741653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:07.741685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.741694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.741709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601089168279325:5968]
2025-10-10T14:33:07.741720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:07.741735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:07.741756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6014ae8f-41464a39-3487df9f-5edde536_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:07.741767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.741771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.741774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:07.741784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.741795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:07.741819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.741975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.741985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.742000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.742082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 859 partition: 0 MaxSeqNo: 40 sessionId: src_id|6014ae8f-41464a39-3487df9f-5edde536_0
2025-10-10T14:33:07.742465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca39938-483dd934-9bc0ad70-bd011e9b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6014ae8f-41464a39-3487df9f-5edde536_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:07.745048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6014ae8f-41464a39-3487df9f-5edde536_0] Write session: try to update token
2025-10-10T14:33:07.745067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6014ae8f-41464a39-3487df9f-5edde536_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:07.758291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId: src_id|6014ae8f-41464a39-3487df9f-5edde536_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:07.760321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:07.760339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:07.760342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:07.760345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:07.760355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601089168279325:5968]
2025-10-10T14:33:07.760360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601089168279325:5968]
2025-10-10T14:33:07.760364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601089168279325:5968]
2025-10-10T14:33:07.760406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:07.760411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:07.760414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:07.760414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:07.760421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.760424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:07.760562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:07.760905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:07.820243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601089950491464:7150]
2025-10-10T14:33:07.820535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 858, pipe: [1:7559601089950491464:7150]
2025-10-10T14:33:07.882888Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:07.883272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.883286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.883332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491464:7150], now have 1 active actors on pipe
2025-10-10T14:33:07.883524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:07.883606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:07.883595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:07.883617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:07.883658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601089950491464:7150]
2025-10-10T14:33:07.883684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 859 reason: error at write: Disconnected sessionId: src_id|6014ae8f-41464a39-3487df9f-5edde536_0
2025-10-10T14:33:07.883886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 859 sessionId: src_id|6014ae8f-41464a39-3487df9f-5edde536_0 is DEAD
2025-10-10T14:33:07.884083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6014ae8f-41464a39-3487df9f-5edde536_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:07.884092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6014ae8f-41464a39-3487df9f-5edde536_0] Write session will restart in 0.006703s
2025-10-10T14:33:07.884129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6014ae8f-41464a39-3487df9f-5edde536_0] Write session: Do CDS request
2025-10-10T14:33:07.884138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6014ae8f-41464a39-3487df9f-5edde536_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:07.891864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6014ae8f-41464a39-3487df9f-5edde536_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.891927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:07.891942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 860
2025-10-10T14:33:07.892094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:07.892131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:07.892143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:07.892147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:07.892585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 860 sessionId:  describe result for acl check
2025-10-10T14:33:07.892625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:07.892632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:07.892649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:07.892655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601089950491501:7492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:07.893166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601089950491501:7492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:07.895808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601089950491501:7492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:07.897512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:07.899404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:07.899583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601089950491501:7492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:07.899598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601089950491501:7492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:07.899601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601089950491501:7492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:07.899609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:07.899611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:07.899631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:07.899643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:07.899698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:07.899746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601089168279520:5970]
2025-10-10T14:33:07.900390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:07.900675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:07.900719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:07.901031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:07.901082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.901088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.901090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.901091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.901092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.901094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.901095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.901096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.901097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.901098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.901099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.901101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.901102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.901107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.901119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.901123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.901127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.901130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.901134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.901138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.901142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.901146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.901150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.901154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.901158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.901162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.901169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.901177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:07.901184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.901195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:07.901199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.901210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:07.901215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.901220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:07.901230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.901236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:07.901240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.901246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:07.901250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.901256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:07.901261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.901266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:07.901274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.901280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:07.901288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.901293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:07.901301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.901306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.901314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.901319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.901328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.901347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.901388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:07.903635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:07.904012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:07.904023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:07.904034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:07.904042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:07.904047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 859 [2:7559601089168279520:5970]
2025-10-10T14:33:07.904058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:07.904073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:07.904081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.904084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.904086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.904102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:07.904114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:07.904126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:07.904175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.904182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.904184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.904186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:07.904248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:07.904255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.904275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:07.904291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:07.904313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:07.904338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491646:7492], now have 1 active actors on pipe
2025-10-10T14:33:07.904345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491465:2438], now have 1 active actors on pipe
2025-10-10T14:33:07.904352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601089168279515:5970]
2025-10-10T14:33:07.904358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601089168279515:5970]
2025-10-10T14:33:07.904361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601089168279515:5970]
2025-10-10T14:33:07.904351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 859
2025-10-10T14:33:07.904374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:07.904354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 859
2025-10-10T14:33:07.904391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:07.904393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:07.904400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:07.904401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:07.904410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:07.904414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:07.904449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.904459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.904474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601089168279515:5970]
2025-10-10T14:33:07.904485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:07.904489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:07.904509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:07.904520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:07.904529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:07.904531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:07.904541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:07.904556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:07.904580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.904709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:07.904717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:07.904730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:07.904812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 860 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0
2025-10-10T14:33:07.905167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6014ae8f-41464a39-3487df9f-5edde536_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:07.907865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0] Write session: try to update token
2025-10-10T14:33:07.907880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:07.921950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId: src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:07.923223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:07.923245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:07.923249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:07.923251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:07.923261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601089168279515:5970]
2025-10-10T14:33:07.923266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601089168279515:5970]
2025-10-10T14:33:07.923270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601089168279515:5970]
2025-10-10T14:33:07.923319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:07.923314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:07.923331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:07.923331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:07.923333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:07.923335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:07.923472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:07.924417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:07.983575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601089950491658:7150]
2025-10-10T14:33:07.983886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 859, pipe: [1:7559601089950491658:7150]
2025-10-10T14:33:08.034983Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:08.035400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.035412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.035451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601089950491658:7150], now have 1 active actors on pipe
2025-10-10T14:33:08.035672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:08.035708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:08.035726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:08.035734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601089950491658:7150]
2025-10-10T14:33:08.035751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:08.035794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 860 reason: error at write: Disconnected sessionId: src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0
2025-10-10T14:33:08.036002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 860 sessionId: src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0 is DEAD
2025-10-10T14:33:08.036150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:08.036161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0] Write session will restart in 0.007364s
2025-10-10T14:33:08.036179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0] Write session: Do CDS request
2025-10-10T14:33:08.036183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:08.044902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.044999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:08.045013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 861
2025-10-10T14:33:08.045143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.045182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:08.045192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:08.045196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:08.045723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 861 sessionId:  describe result for acl check
2025-10-10T14:33:08.045765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:08.045771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:08.045773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:08.045780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601094245459000:7496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:08.046341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601094245459000:7496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:08.049086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601094245459000:7496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:08.050801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:08.053272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:08.053446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601094245459000:7496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:08.053463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601094245459000:7496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:08.053467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601094245459000:7496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:08.053476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:08.053530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:08.053543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:08.053559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:08.053638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:08.053682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601093463247007:5972]
2025-10-10T14:33:08.054273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:08.054591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:08.054645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:08.054960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:08.055036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.055044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.055045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.055047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.055048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.055050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.055051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.055052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.055054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.055055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.055056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.055057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.055059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.055066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.055078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.055082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.055086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.055105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.055109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.055113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.055117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.055120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.055124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.055128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.055132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.055135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.055143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.055152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.055164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.055169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.055175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.055181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.055190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.055194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.055199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.055208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.055214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.055220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.055228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.055233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.055238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.055245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.055250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.055259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.055263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.055268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.055272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.055278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.055282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.055287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.055293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.055302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.055339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:08.057666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:08.058212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:08.058234Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:08.058237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:08.058241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:08.058247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 860 [2:7559601093463247007:5972]
2025-10-10T14:33:08.058262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:08.058279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:08.058301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.058305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.058307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.058328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:08.058339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:08.058346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:08.058402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.058409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.058411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.058414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:08.058480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:08.058491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.058503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.058513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.058528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:08.058556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245458955:2438], now have 1 active actors on pipe
2025-10-10T14:33:08.058564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459137:7496], now have 1 active actors on pipe
2025-10-10T14:33:08.058572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601093463247002:5972]
2025-10-10T14:33:08.058580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601093463247002:5972]
2025-10-10T14:33:08.058582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601093463247002:5972]
2025-10-10T14:33:08.058599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:08.058614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:08.058588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 860
2025-10-10T14:33:08.058618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:08.058626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:08.058594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 860
2025-10-10T14:33:08.058628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:08.058634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:08.058637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:08.058663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601093463247002:5972]
2025-10-10T14:33:08.058674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:08.058678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:08.058691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.058703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.058756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:08.058771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.058776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.058779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:08.058790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.058801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:08.058821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.058970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.058979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.058997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.059074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 861 partition: 0 MaxSeqNo: 40 sessionId: src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0
2025-10-10T14:33:08.059490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d284cb6-80f3c3a5-7d654b7d-1d5cb792_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:08.062175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0] Write session: try to update token
2025-10-10T14:33:08.062193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:08.076295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId: src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:08.077560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:08.077580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:08.077585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:08.077587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:08.077597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601093463247002:5972]
2025-10-10T14:33:08.077601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601093463247002:5972]
2025-10-10T14:33:08.077605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601093463247002:5972]
2025-10-10T14:33:08.077650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:08.077654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:08.077661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.077663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:08.077664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:08.077666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:08.077801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:08.078905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:08.136082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601094245459173:7150]
2025-10-10T14:33:08.136379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 860, pipe: [1:7559601094245459173:7150]
2025-10-10T14:33:08.182452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:08.182859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.182875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.182923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459173:7150], now have 1 active actors on pipe
2025-10-10T14:33:08.183143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601094245459173:7150]
2025-10-10T14:33:08.183179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:08.183146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:08.183151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:08.183178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:08.183216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 861 reason: error at write: Disconnected sessionId: src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0
2025-10-10T14:33:08.183439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 861 sessionId: src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0 is DEAD
2025-10-10T14:33:08.183597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:08.183610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0] Write session will restart in 0.009421s
2025-10-10T14:33:08.183634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0] Write session: Do CDS request
2025-10-10T14:33:08.183644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:08.193897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.193986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:08.194004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 862
2025-10-10T14:33:08.194153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.194187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:08.194198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:08.194202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:08.194696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 862 sessionId:  describe result for acl check
2025-10-10T14:33:08.194731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:08.194737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:08.194738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:08.194743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601094245459265:7509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:08.195343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601094245459265:7509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:08.197496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601094245459265:7509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:08.197952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:08.199877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:08.199970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601094245459265:7509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:08.199983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601094245459265:7509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:08.199986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601094245459265:7509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:08.199994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:08.200076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:08.200089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:08.200100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:08.200162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:08.200202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601093463247237:5987]
2025-10-10T14:33:08.200740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:08.201003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:08.201065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:08.201406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:08.201471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.201478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.201479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.201480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.201482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.201483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.201484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.201486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.201487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.201488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.201490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.201491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.201493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.201499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.201513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.201518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.201522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.201532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.201541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.201546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.201555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.201559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.201569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.201577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.201581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.201585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.201597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.201610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.201621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.201631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.201641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.201651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.201661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.201671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.201680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.201686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.201690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.201695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.201700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.201710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.201719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.201727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.201736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.201756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.201766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.201774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.201779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.201787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.201795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.201800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.201808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.201813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.201856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:08.204035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:08.204500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:08.204515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:08.204517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:08.204521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:08.204527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 861 [2:7559601093463247237:5987]
2025-10-10T14:33:08.204539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:08.204557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:08.204565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.204568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.204570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.204587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:08.204599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:08.204608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:08.204661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.204669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.204671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.204673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:08.204743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:08.204748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.204761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.204779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.204802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:08.204827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459357:7509], now have 1 active actors on pipe
2025-10-10T14:33:08.204837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459174:2438], now have 1 active actors on pipe
2025-10-10T14:33:08.204844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601093463247232:5987]
2025-10-10T14:33:08.204847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601093463247232:5987]
2025-10-10T14:33:08.204850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601093463247232:5987]
2025-10-10T14:33:08.204869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:08.204859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 861
2025-10-10T14:33:08.204869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 861
2025-10-10T14:33:08.204889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:08.204892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:08.204897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:08.204899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:08.204913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:08.204917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:08.204934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.204939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.204974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601093463247232:5987]
2025-10-10T14:33:08.204989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:08.205008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|147551ff-64305596-8de666b6-4af0d9bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:08.205011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:08.205021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.205025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.205027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:08.205038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.205053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:08.205102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.205308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.205322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.205355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.205449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 862 partition: 0 MaxSeqNo: 40 sessionId: src_id|147551ff-64305596-8de666b6-4af0d9bd_0
2025-10-10T14:33:08.205847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a03eb6f-e1208c38-3fef1280-f2e6d8c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|147551ff-64305596-8de666b6-4af0d9bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:08.208457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147551ff-64305596-8de666b6-4af0d9bd_0] Write session: try to update token
2025-10-10T14:33:08.208476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147551ff-64305596-8de666b6-4af0d9bd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:08.217028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:08.217051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:08.217061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601093463247232:5987]
2025-10-10T14:33:08.217111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:08.217110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:08.217282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:08.217446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:08.217580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:08.217718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:08.217900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:08.217943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:08.222837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId: src_id|147551ff-64305596-8de666b6-4af0d9bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:08.225437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:08.225662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.225685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.225726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:08.225813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:08.234218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:08.234236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:08.234239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:08.234240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:08.234249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601093463247232:5987]
2025-10-10T14:33:08.234252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601093463247232:5987]
2025-10-10T14:33:08.234256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601093463247232:5987]
2025-10-10T14:33:08.234301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:08.234302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:08.234308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.234308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:08.234309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:08.234313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:08.234434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:08.283080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601094245459380:7150]
2025-10-10T14:33:08.283315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 861, pipe: [1:7559601094245459380:7150]
2025-10-10T14:33:08.345781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:08.352993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.353018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.353161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.353217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.353274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.353350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.353396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.353404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.353466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.353523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.353583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.353641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.353683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.353690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.353749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.353802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.353873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.353936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.353974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.353982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.354038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.354094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.354148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.354202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.354240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.354245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.354303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.354367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.354426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.354481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.354520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.354529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.354586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.354650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.354713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.354767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.354806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.354811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.354869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.354920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.354991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.355047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.355086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.355091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.355152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.355212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.355273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.355327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.355365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.355370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.355428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.355486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.355544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.355602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.355640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.355645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.355701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.355753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.355811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.355876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.355923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.355930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.355974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459380:7150], now have 1 active actors on pipe
2025-10-10T14:33:08.356188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:08.356207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:08.356212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:08.356242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 862 reason: error at write: Disconnected sessionId: src_id|147551ff-64305596-8de666b6-4af0d9bd_0
2025-10-10T14:33:08.356249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601094245459380:7150]
2025-10-10T14:33:08.356400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 862 sessionId: src_id|147551ff-64305596-8de666b6-4af0d9bd_0 is DEAD
2025-10-10T14:33:08.356482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147551ff-64305596-8de666b6-4af0d9bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:08.356491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147551ff-64305596-8de666b6-4af0d9bd_0] Write session will restart in 0.006362s
2025-10-10T14:33:08.356514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147551ff-64305596-8de666b6-4af0d9bd_0] Write session: Do CDS request
2025-10-10T14:33:08.356519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147551ff-64305596-8de666b6-4af0d9bd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:08.356898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:08.363814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147551ff-64305596-8de666b6-4af0d9bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.363978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:08.363996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 863
2025-10-10T14:33:08.364146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.364186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:08.364197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:08.364201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:08.364714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 863 sessionId:  describe result for acl check
2025-10-10T14:33:08.364752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:08.364760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:08.364762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:08.364768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601094245459406:7514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:08.365381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601094245459406:7514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:08.368310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601094245459406:7514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:08.371197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601094245459406:7514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:08.371225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601094245459406:7514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:08.371228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601094245459406:7514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:08.371236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:08.371300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:08.373599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:08.373868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:08.373881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:08.373894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:08.373955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:08.373998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601093463247443:5990]
2025-10-10T14:33:08.374623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:08.374898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:08.374950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:08.375266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:08.375320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.375326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.375327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.375328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.375330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.375331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.375332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.375333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.375335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.375336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.375337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.375338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.375339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.375345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.375358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.375362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.375366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.375370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.375374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.375378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.375387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.375391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.375395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.375403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.375407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.375415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.375422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.375435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.375446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.375456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.375460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.375465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.375469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.375475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.375484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.375489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.375498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.375502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.375507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.375517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.375523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.375528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.375533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.375539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.375548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.375555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.375564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.375575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.375583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.375592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.375601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.375606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.375652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:08.377874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:08.378180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:08.378191Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:08.378193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:08.378196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:08.378202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 862 [2:7559601093463247443:5990]
2025-10-10T14:33:08.378214Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:08.378235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:08.378242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.378246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.378248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.378263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:08.378275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:08.378283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:08.378339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.378346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.378348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.378350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:08.378416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:08.378425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.378437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.378449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.378468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:08.378489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459566:7514], now have 1 active actors on pipe
2025-10-10T14:33:08.378498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459382:2438], now have 1 active actors on pipe
2025-10-10T14:33:08.378506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601093463247437:5990]
2025-10-10T14:33:08.378512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601093463247437:5990]
2025-10-10T14:33:08.378515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601093463247437:5990]
2025-10-10T14:33:08.378528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:08.378544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:08.378547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:08.378532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 862
2025-10-10T14:33:08.378553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:08.378546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 862
2025-10-10T14:33:08.378555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:08.378564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:08.378568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:08.378601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.378610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.378630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601093463247437:5990]
2025-10-10T14:33:08.378642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:08.378648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:08.378671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:08.378683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.378688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.378694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:08.378706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.378716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:08.378741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.378903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.378911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.378926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.379034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 863 partition: 0 MaxSeqNo: 40 sessionId: src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0
2025-10-10T14:33:08.379432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147551ff-64305596-8de666b6-4af0d9bd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:08.382098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0] Write session: try to update token
2025-10-10T14:33:08.382117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:08.398131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId: src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:08.398480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:08.398501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:08.398504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:08.398506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:08.398517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601093463247437:5990]
2025-10-10T14:33:08.398522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601093463247437:5990]
2025-10-10T14:33:08.398526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601093463247437:5990]
2025-10-10T14:33:08.398569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:08.398576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.398581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:08.398603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:08.398616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:08.398619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:08.398709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:08.400690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:08.456673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601094245459578:7150]
2025-10-10T14:33:08.456975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 862, pipe: [1:7559601094245459578:7150]
2025-10-10T14:33:08.508808Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:08.509296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.509312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.509377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459578:7150], now have 1 active actors on pipe
2025-10-10T14:33:08.509594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:08.509620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:08.509625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:08.509629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:08.509689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 863 reason: error at write: Disconnected sessionId: src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0
2025-10-10T14:33:08.509691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601094245459578:7150]
2025-10-10T14:33:08.509899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 863 sessionId: src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0 is DEAD
2025-10-10T14:33:08.510018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:08.510029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0] Write session will restart in 0.006413s
2025-10-10T14:33:08.510051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0] Write session: Do CDS request
2025-10-10T14:33:08.510060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:08.517865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.518112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:08.518131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 864
2025-10-10T14:33:08.518242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.518279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:08.518289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:08.518293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:08.518905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 864 sessionId:  describe result for acl check
2025-10-10T14:33:08.518968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:08.518970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:08.518974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:08.518980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601094245459633:7518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:08.519541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601094245459633:7518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:08.522203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601094245459633:7518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:08.523527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:08.525461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:08.525657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:08.525671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:08.525682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:08.525735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:08.525780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601093463247636:5992]
2025-10-10T14:33:08.525773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601094245459633:7518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:08.525788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601094245459633:7518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:08.525793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601094245459633:7518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:08.525801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:08.526436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:08.526708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:08.526764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:08.527033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:08.527083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.527089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.527091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.527092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.527093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.527094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.527095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.527095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.527096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.527097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.527098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.527098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.527099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.527103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.527111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.527113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.527115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.527117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.527119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.527122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.527134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.527136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.527139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.527141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.527143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.527146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.527152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.527159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.527165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.527169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.527171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.527174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.527177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.527180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.527183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.527187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.527189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.527192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.527195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.527198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.527200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.527203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.527206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.527209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.527211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.527215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.527217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.527229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.527233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.527238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.527242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.527247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.527277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:08.529545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:08.529880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:08.529893Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:08.529895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:08.529898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:08.529905Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 863 [2:7559601093463247636:5992]
2025-10-10T14:33:08.529917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:08.529934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:08.529937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.529940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.529941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.529954Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:08.529963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:08.529970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:08.530010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.530015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.530016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.530017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:08.530067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:08.530075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.530083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.530089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.530099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:08.530116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459580:2438], now have 1 active actors on pipe
2025-10-10T14:33:08.530118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459765:7518], now have 1 active actors on pipe
2025-10-10T14:33:08.530123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601093463247631:5992]
2025-10-10T14:33:08.530125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601093463247631:5992]
2025-10-10T14:33:08.530127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601093463247631:5992]
2025-10-10T14:33:08.530149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:08.530163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:08.530166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:08.530168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:08.530168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:08.530179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:08.530181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:08.530201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601093463247631:5992]
2025-10-10T14:33:08.530211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:08.530209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 863
2025-10-10T14:33:08.530231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:08.530251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 863
2025-10-10T14:33:08.530274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.530281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.530314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:08.530324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.530327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.530328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:08.530335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.530344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:08.530355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.530506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.530513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.530527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.530604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 864 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0
2025-10-10T14:33:08.530990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ade2f1ef-c5c0c145-1f33c68-a4e8468f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:08.533519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0] Write session: try to update token
2025-10-10T14:33:08.533533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:08.546588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId: src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:08.549219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:08.549458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.549478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.549497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:08.549500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:08.549503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:08.549505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:08.549514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601093463247631:5992]
2025-10-10T14:33:08.549518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601093463247631:5992]
2025-10-10T14:33:08.549522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601093463247631:5992]
2025-10-10T14:33:08.549558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:08.549571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:08.549576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.549578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:08.549578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:08.549581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:08.549693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:08.609738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601094245459783:7150]
2025-10-10T14:33:08.610011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 863, pipe: [1:7559601094245459783:7150]
2025-10-10T14:33:08.652303Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:08.652761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:08.652814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459783:7150], now have 1 active actors on pipe
2025-10-10T14:33:08.652911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:08.652995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:08.653045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601094245459783:7150]
2025-10-10T14:33:08.663963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:08.663979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:08.664005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 864 reason: error at write: Disconnected sessionId: src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0
2025-10-10T14:33:08.664177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 864 sessionId: src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0 is DEAD
2025-10-10T14:33:08.664334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:08.664342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0] Write session will restart in 0.008490s
2025-10-10T14:33:08.664376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0] Write session: Do CDS request
2025-10-10T14:33:08.664381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:08.670653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:08.673099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:08.673305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:08.673317Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:08.673342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:08.673406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:08.673451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601093463247832:5995]
2025-10-10T14:33:08.673809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.673940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:08.673957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 865
2025-10-10T14:33:08.674064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:08.674103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.674136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:08.674143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:08.674149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:08.674346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:08.674398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:08.674535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 865 sessionId:  describe result for acl check
2025-10-10T14:33:08.674570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:08.674572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:08.674574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:08.674580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601094245459947:7524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:08.674718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:08.674784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.674791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.674792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.674793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.674794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.674795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.674796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.674797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.674799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.674800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.674801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.674802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.674803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.674809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.674821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.674825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.674830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.674834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.674838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.674842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.674846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.674849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.674854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.674857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.674861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.674865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.674872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.674886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.674897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.674907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.674931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.674940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.674949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.674954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.674964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.674974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.674983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.674990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.675000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.675010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.675015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.675020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.675026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.675031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.675035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.675040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.675045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.675050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.675056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.675062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.675070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.675079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.675122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:08.675142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601094245459947:7524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:08.677251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:08.677567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601094245459947:7524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:08.677645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:08.677663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:08.677665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:08.677669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:08.677674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 864 [2:7559601093463247832:5995]
2025-10-10T14:33:08.677686Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:08.677702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:08.677706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.677709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.677712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.677726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:08.677739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:08.677747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:08.677945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.677954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.677956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.677959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:08.678026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:08.678034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.678046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.678061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.678080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:08.678106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459788:2438], now have 1 active actors on pipe
2025-10-10T14:33:08.678120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601093463247827:5995]
2025-10-10T14:33:08.678122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601093463247827:5995]
2025-10-10T14:33:08.678125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601093463247827:5995]
2025-10-10T14:33:08.678138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:08.678131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 864
2025-10-10T14:33:08.678155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:08.678158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:08.678165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:08.678167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:08.678176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:08.678179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:08.678209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601093463247827:5995]
2025-10-10T14:33:08.678222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:08.678235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:08.682775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601094245459947:7524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:08.682790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601094245459947:7524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:08.682794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601094245459947:7524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:08.682801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:08.683045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 864
2025-10-10T14:33:08.683039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459982:7524], now have 1 active actors on pipe
2025-10-10T14:33:08.683084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.683097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.683129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:08.683147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.683152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.683155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:08.683168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.683184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:08.683206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.683386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.683395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.683411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.683489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 865 partition: 0 MaxSeqNo: 40 sessionId: src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0
2025-10-10T14:33:08.683827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f8fd52-670c7922-13c978ae-4eb706a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:08.686263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0] Write session: try to update token
2025-10-10T14:33:08.686279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:08.688625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:08.688644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:08.688654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601093463247827:5995]
2025-10-10T14:33:08.688690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:08.688694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:08.688867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:08.689010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:08.689151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:08.689296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:08.689508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:08.689556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:08.699846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId: src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:08.702573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:08.702797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.702821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.702854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:08.702981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:08.705372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:08.705387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:08.705390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:08.705392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:08.705403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601093463247827:5995]
2025-10-10T14:33:08.705407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601093463247827:5995]
2025-10-10T14:33:08.705411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601093463247827:5995]
2025-10-10T14:33:08.705449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:08.705453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:08.705454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:08.705457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:08.705460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.705461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:08.705590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:08.753100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601094245459985:7150]
2025-10-10T14:33:08.753362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 864, pipe: [1:7559601094245459985:7150]
2025-10-10T14:33:08.808251Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:08.814940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.814983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.815159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.815219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.815284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.815346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.815626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.815636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.815697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.815761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.815816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.815893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.815933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.815938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.815998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.816052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.816107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.816163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.816204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.816210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.816268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.816332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.816399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.816457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.816617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.816623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.816682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.816736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.816804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.816869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.816907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.816913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.816970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.817023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.817078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.817135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.817174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.817179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.817237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.817290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.817368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.817428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.817473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.817480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.817537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.817590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.817645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.817700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.817739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.817744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.817800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.817855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.817910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.817969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.818010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.818015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.818072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:08.818124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:08.818179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:08.818234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:08.818276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:08.818281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:08.818322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459985:7150], now have 1 active actors on pipe
2025-10-10T14:33:08.818548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:08.818608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:08.818616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:08.818615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:08.818646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 865 reason: error at write: Disconnected sessionId: src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0
2025-10-10T14:33:08.818874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 865 sessionId: src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0 is DEAD
2025-10-10T14:33:08.818910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601094245459985:7150]
2025-10-10T14:33:08.819015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:08.819027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0] Write session will restart in 0.009359s
2025-10-10T14:33:08.819053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0] Write session: Do CDS request
2025-10-10T14:33:08.819059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:08.829874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.829927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:08.829946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 866
2025-10-10T14:33:08.830106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.830143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:08.830153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:08.830157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:08.830602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 866 sessionId:  describe result for acl check
2025-10-10T14:33:08.830651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:08.830658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:08.830662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:08.830671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601094245460092:7528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:08.831235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601094245460092:7528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:08.833053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:08.833706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601094245460092:7528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:08.835165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:08.835344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:08.835356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:08.835368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:08.835421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:08.835461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601093463248028:5997]
2025-10-10T14:33:08.835909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:08.836132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601094245460092:7528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:08.836145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601094245460092:7528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:08.836147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601094245460092:7528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:08.836154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:08.836164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:08.836199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:08.836422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:08.836463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.836468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.836469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.836470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.836470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.836471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.836472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.836472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.836473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.836473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.836474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.836475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.836475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.836479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.836490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.836495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.836498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.836502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.836506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.836510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.836514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.836518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.836522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.836524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.836526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.836528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.836534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.836539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.836544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.836547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.836550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.836553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.836555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.836559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.836561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.836564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.836567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.836571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.836575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.836578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.836581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.836584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.836586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.836589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.836592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.836595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.836597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.836600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.836603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.836606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.836608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.836611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.836633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:08.838766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:08.839287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:08.839299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:08.839301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:08.839304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:08.839308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 865 [2:7559601093463248028:5997]
2025-10-10T14:33:08.839316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:08.839330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:08.839336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.839339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.839340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.839353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:08.839361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:08.839367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:08.839409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.839414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.839415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.839417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:08.839480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:08.839488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.839500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.839516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.839537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:08.839562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245459987:2438], now have 1 active actors on pipe
2025-10-10T14:33:08.839569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245460176:7528], now have 1 active actors on pipe
2025-10-10T14:33:08.839574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601093463248023:5997]
2025-10-10T14:33:08.839576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601093463248023:5997]
2025-10-10T14:33:08.839577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601093463248023:5997]
2025-10-10T14:33:08.839594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:08.839611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:08.839610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:08.839622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:08.839624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:08.839633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:08.839636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:08.839656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601093463248023:5997]
2025-10-10T14:33:08.839646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 865
2025-10-10T14:33:08.839667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:08.839668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:08.839699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.839717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 865
2025-10-10T14:33:08.839711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.839738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:08.839750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.839754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.839756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:08.839769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.839784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:08.839807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.839945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.839957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.839975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.840056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 866 partition: 0 MaxSeqNo: 40 sessionId: src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0
2025-10-10T14:33:08.840397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165b45be-56e09ef0-ba4b8e2f-61bbfd84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:08.842972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0] Write session: try to update token
2025-10-10T14:33:08.842992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:08.856726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId: src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:08.858071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:08.858091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:08.858093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:08.858094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:08.858101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601093463248023:5997]
2025-10-10T14:33:08.858104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601093463248023:5997]
2025-10-10T14:33:08.858107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601093463248023:5997]
2025-10-10T14:33:08.858145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:08.858148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:08.858150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.858152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:08.858164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:08.858169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:08.858280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:08.859436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:08.918987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601094245460185:7150]
2025-10-10T14:33:08.919262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 865, pipe: [1:7559601094245460185:7150]
2025-10-10T14:33:08.961026Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:08.961250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.961264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.961302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245460185:7150], now have 1 active actors on pipe
2025-10-10T14:33:08.961468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:08.961587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601094245460185:7150]
2025-10-10T14:33:08.961598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:08.961622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:08.961701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 866 reason: status is not ok: tablet will be restarted right now sessionId: src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0
2025-10-10T14:33:08.961921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 866 sessionId: src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0 is DEAD
2025-10-10T14:33:08.962040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:08.962051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0] Write session will restart in 0.009925s
2025-10-10T14:33:08.962075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0] Write session: Do CDS request
2025-10-10T14:33:08.962091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:08.972900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.973001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:08.973019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 867
2025-10-10T14:33:08.973148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:08.973186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:08.973196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:08.973199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:08.973670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 867 sessionId:  describe result for acl check
2025-10-10T14:33:08.973709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:08.973715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:08.973717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:08.973723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601094245460333:7532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:08.974274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601094245460333:7532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:08.975310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:08.976090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601094245460333:7532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:08.977733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:08.977920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:08.977932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:08.977944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:08.977993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:08.978032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601093463248225:5999]
2025-10-10T14:33:08.978391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601094245460333:7532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:08.978404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601094245460333:7532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:08.978406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601094245460333:7532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:08.978412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:08.978618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:08.978879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:08.978934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:08.979235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:08.979286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.979292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.979293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.979294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.979296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.979297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.979298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.979299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.979300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.979301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.979302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.979303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.979305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.979310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.979323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.979327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.979331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.979335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.979339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.979343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.979346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.979349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.979353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.979357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.979361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.979364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.979371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.979379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:08.979386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.979392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:08.979396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.979401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:08.979405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.979411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:08.979415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.979420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:08.979431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.979436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:08.979441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.979445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:08.979454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.979459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:08.979463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.979469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:08.979473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.979479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:08.979485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.979489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.979493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.979498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.979504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.979509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.979548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:08.981825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:08.982132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:08.982143Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:08.982145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:08.982148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:08.982155Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 866 [2:7559601093463248225:5999]
2025-10-10T14:33:08.982167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:08.982182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:08.982189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.982192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.982194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.982210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:08.982222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:08.982233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:08.982284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.982290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.982293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.982296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:08.982356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:08.982362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:08.982373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:08.982390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:08.982411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:08.982438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245460375:7532], now have 1 active actors on pipe
2025-10-10T14:33:08.982450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601094245460186:2438], now have 1 active actors on pipe
2025-10-10T14:33:08.982446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 866
2025-10-10T14:33:08.982457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601093463248220:5999]
2025-10-10T14:33:08.982448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 866
2025-10-10T14:33:08.982460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601093463248220:5999]
2025-10-10T14:33:08.982461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601093463248220:5999]
2025-10-10T14:33:08.982471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:08.982485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:08.982489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:08.982492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:08.982493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:08.982501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:08.982504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:08.982546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.982554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.982569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601093463248220:5999]
2025-10-10T14:33:08.982580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:08.982586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:08.982609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48785e43-664b29b0-463d80c0-168e3c39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:08.982621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:08.982624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:08.982626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:08.982636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:08.982650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:08.982674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.982800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:08.982806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:08.982820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:08.982928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 867 partition: 0 MaxSeqNo: 40 sessionId: src_id|48785e43-664b29b0-463d80c0-168e3c39_0
2025-10-10T14:33:08.983288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|153bc94b-4e9b2b12-69dbeb5e-8bcb3fd7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48785e43-664b29b0-463d80c0-168e3c39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:08.985804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48785e43-664b29b0-463d80c0-168e3c39_0] Write session: try to update token
2025-10-10T14:33:08.985823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48785e43-664b29b0-463d80c0-168e3c39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:08.999289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId: src_id|48785e43-664b29b0-463d80c0-168e3c39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:09.001159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:09.001180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.001182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:09.001183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:09.001192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601093463248220:5999]
2025-10-10T14:33:09.001196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601093463248220:5999]
2025-10-10T14:33:09.001199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601093463248220:5999]
2025-10-10T14:33:09.001252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:09.001246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:09.001262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:09.001266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:09.001268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.001271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:09.001435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:09.002092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:09.061862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601098540427682:7150]
2025-10-10T14:33:09.062150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 866, pipe: [1:7559601098540427682:7150]
2025-10-10T14:33:09.112810Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:09.113200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.113214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.113250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540427682:7150], now have 1 active actors on pipe
2025-10-10T14:33:09.113436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:09.113546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:09.113551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601098540427682:7150]
2025-10-10T14:33:09.113572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:09.113640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 867 reason: status is not ok: tablet will be restarted right now sessionId: src_id|48785e43-664b29b0-463d80c0-168e3c39_0
2025-10-10T14:33:09.113856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 867 sessionId: src_id|48785e43-664b29b0-463d80c0-168e3c39_0 is DEAD
2025-10-10T14:33:09.113998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785e43-664b29b0-463d80c0-168e3c39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:09.114006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785e43-664b29b0-463d80c0-168e3c39_0] Write session will restart in 0.008298s
2025-10-10T14:33:09.114023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785e43-664b29b0-463d80c0-168e3c39_0] Write session: Do CDS request
2025-10-10T14:33:09.114027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785e43-664b29b0-463d80c0-168e3c39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:09.123868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48785e43-664b29b0-463d80c0-168e3c39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.123987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:09.124005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 868
2025-10-10T14:33:09.124142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.124179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:09.124193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:09.124197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:09.124628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 868 sessionId:  describe result for acl check
2025-10-10T14:33:09.124668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:09.124676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:09.124678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:09.124684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601098540427780:7538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:09.125118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601098540427780:7538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:09.127671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601098540427780:7538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:09.127847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:09.129753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:09.129911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:09.129920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:09.129930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:09.129969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:09.129998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601097758215732:6003]
2025-10-10T14:33:09.130040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601098540427780:7538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:09.130052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601098540427780:7538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:09.130055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601098540427780:7538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:09.130062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:09.130442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:09.130673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:09.130715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:09.131000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:09.131047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.131052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.131053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.131054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.131054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.131055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.131056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.131056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.131057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.131057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.131058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.131059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.131059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.131063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.131070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.131073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.131075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.131077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.131080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.131082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.131084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.131086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.131089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.131091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.131093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.131096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.131101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.131107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.131111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.131115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.131118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.131121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.131124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.131127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.131130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.131133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.131135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.131138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.131140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.131144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.131146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.131149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.131152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.131157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.131161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.131166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.131170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.131175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.131187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.131190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.131192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.131195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.131217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:09.133345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:09.133647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:09.133655Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:09.133657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:09.133660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:09.133664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 867 [2:7559601097758215732:6003]
2025-10-10T14:33:09.133672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:09.133684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:09.133686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.133688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.133689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.133700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:09.133706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:09.133711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:09.133746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.133752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.133753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.133755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:09.133801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:09.133809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.133819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.133829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.133848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:09.133873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540427683:2438], now have 1 active actors on pipe
2025-10-10T14:33:09.133880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540427884:7538], now have 1 active actors on pipe
2025-10-10T14:33:09.133887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601097758215727:6003]
2025-10-10T14:33:09.133889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601097758215727:6003]
2025-10-10T14:33:09.133891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601097758215727:6003]
2025-10-10T14:33:09.133904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:09.133919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:09.133920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:09.133930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:09.133932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:09.133935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:09.133938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:09.133927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 867
2025-10-10T14:33:09.133964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 867
2025-10-10T14:33:09.133957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601097758215727:6003]
2025-10-10T14:33:09.133965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:09.133967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:09.134026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.134035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.134063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:09.134075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.134083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.134085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:09.134095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.134110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:09.134126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.134306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.134317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.134332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.134460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 868 partition: 0 MaxSeqNo: 40 sessionId: src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0
2025-10-10T14:33:09.134825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785e43-664b29b0-463d80c0-168e3c39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:09.137374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0] Write session: try to update token
2025-10-10T14:33:09.137389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:09.150834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:09.150854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.150863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601097758215727:6003]
2025-10-10T14:33:09.150919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:09.150934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:09.151086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId: src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:09.151104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:09.151234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.151373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.151513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.151704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:09.151742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:09.153533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:09.153777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.153795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.153829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:09.153908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:09.162999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:09.163020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.163023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:09.163024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:09.163036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601097758215727:6003]
2025-10-10T14:33:09.163040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601097758215727:6003]
2025-10-10T14:33:09.163043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601097758215727:6003]
2025-10-10T14:33:09.163093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:09.163106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.163107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:09.163109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:09.163115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:09.163119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:09.163233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:09.213894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601098540427908:7150]
2025-10-10T14:33:09.214176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 867, pipe: [1:7559601098540427908:7150]
2025-10-10T14:33:09.265579Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:09.271976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.272001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.272154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.272207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.272267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.272323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.272370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.272379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.272441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.272507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.272563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.272622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.272661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.272667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.272727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.272782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.272836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.272893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.272936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.272942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.273001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.273058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.273114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.273173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.273212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.273217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.273275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.273351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.273415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.273469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.273510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.273517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.273586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.273641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.273698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.273754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.273794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.273799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.273857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.273912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.273968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.274023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.274064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.274069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.274130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.274184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.274243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.274299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.274337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.274343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.274398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.274450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.274504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.274567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.274684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.274691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.274750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.274803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.274859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.274933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.275073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.275079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.275118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540427908:7150], now have 1 active actors on pipe
2025-10-10T14:33:09.275317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:09.275396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601098540427908:7150]
2025-10-10T14:33:09.275428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:09.275444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:09.275475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 868 reason: error at write: Disconnected sessionId: src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0
2025-10-10T14:33:09.275697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 868 sessionId: src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0 is DEAD
2025-10-10T14:33:09.275831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:09.275844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0] Write session will restart in 0.006047s
2025-10-10T14:33:09.275868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0] Write session: Do CDS request
2025-10-10T14:33:09.275852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:09.275874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:09.282935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.283013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:09.283029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 869
2025-10-10T14:33:09.283210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.283257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:09.283266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:09.283271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:09.283682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 869 sessionId:  describe result for acl check
2025-10-10T14:33:09.283717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:09.283724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:09.283728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:09.283734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601098540427938:7550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:09.284278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601098540427938:7550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:09.287307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601098540427938:7550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:09.289843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601098540427938:7550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:09.289865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601098540427938:7550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:09.289868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601098540427938:7550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:09.289878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:09.290261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:09.292537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:09.292743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:09.292758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:09.292773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:09.292829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:09.292877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601097758215969:6017]
2025-10-10T14:33:09.293475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:09.294747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:09.294816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:09.295188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:09.295256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.295265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.295266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.295267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.295268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.295269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.295270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.295271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.295272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.295273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.295275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.295276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.295277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.295283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.295295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.295299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.295303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.295306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.295310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.295313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.295316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.295320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.295324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.295327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.295331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.295334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.295342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.295351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.295358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.295363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.295367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.295372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.295377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.295382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.295386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.295391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.295396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.295401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.295405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.295411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.295415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.295421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.295426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.295433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.295437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.295442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.295450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.295456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.295460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.295465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.295468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.295473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.295509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:09.298027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:09.298388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:09.298398Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:09.298399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:09.298402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:09.298407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 868 [2:7559601097758215969:6017]
2025-10-10T14:33:09.298416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:09.298428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:09.298430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.298432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.298433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.298446Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:09.298451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:09.298462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:09.298501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.298507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.298508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.298510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:09.298566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:09.298573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.298581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.298587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.298597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:09.298613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601097758215964:6017]
2025-10-10T14:33:09.298618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601097758215964:6017]
2025-10-10T14:33:09.298619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601097758215964:6017]
2025-10-10T14:33:09.298627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:09.298638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:09.298638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:09.298642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:09.298644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:09.298670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:09.298673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:09.298682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540427909:2438], now have 1 active actors on pipe
2025-10-10T14:33:09.298684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428110:7550], now have 1 active actors on pipe
2025-10-10T14:33:09.298700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601097758215964:6017]
2025-10-10T14:33:09.298708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:09.298724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:09.298748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 868
2025-10-10T14:33:09.298773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 868
2025-10-10T14:33:09.298837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.298845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.298869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:09.298881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.298884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.298886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:09.298907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.298922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:09.298936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.299086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.299091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.299102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.299194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 869 partition: 0 MaxSeqNo: 40 sessionId: src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0
2025-10-10T14:33:09.299614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ede8d4-d669a11c-17eb1f20-9f468eae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:09.302079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0] Write session: try to update token
2025-10-10T14:33:09.302096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:09.309765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:09.309786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.309795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601097758215964:6017]
2025-10-10T14:33:09.309840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:09.309866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:09.309997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:09.310152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.310285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.310423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.310624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:09.310674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:09.316314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId: src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:09.319062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:09.319308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.319335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.319387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:09.319509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:09.328618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:09.328638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.328640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:09.328642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:09.328650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601097758215964:6017]
2025-10-10T14:33:09.328654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601097758215964:6017]
2025-10-10T14:33:09.328656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601097758215964:6017]
2025-10-10T14:33:09.328696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:09.328697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:09.328703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:09.328704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.328707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:09.328708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:09.328837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:09.375683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601098540428123:7150]
2025-10-10T14:33:09.375995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 868, pipe: [1:7559601098540428123:7150]
2025-10-10T14:33:09.433682Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:09.441027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.441057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.441215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.441274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.441364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.441430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.441480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.441490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.441563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.441624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.441682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.441744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.441788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.441797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.441866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.441920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.441977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.442037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.442084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.442093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.442151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.442210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.442268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.442334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.442377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.442385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.442447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.442503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.442568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.442627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.442670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.442678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.442752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.442822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.442902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.442969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.443014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.443020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.443086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.443145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.443204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.443274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.443323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.443332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.443398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.443459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.443519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.443588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.443631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.443638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.443703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.443760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.443815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.443880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.443921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.443927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.443989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.444049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.444111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.444177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.444223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.444230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.444278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428123:7150], now have 1 active actors on pipe
2025-10-10T14:33:09.444521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:09.444594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:09.444606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:09.444651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 869 reason: error at write: Disconnected sessionId: src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0
2025-10-10T14:33:09.444806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601098540428123:7150]
2025-10-10T14:33:09.444882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 869 sessionId: src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0 is DEAD
2025-10-10T14:33:09.445016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:09.445024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0] Write session will restart in 0.007910s
2025-10-10T14:33:09.445042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0] Write session: Do CDS request
2025-10-10T14:33:09.445047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:09.445087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:09.453941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.454061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:09.454094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 870
2025-10-10T14:33:09.454253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.454296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:09.454307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:09.454311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:09.454795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 870 sessionId:  describe result for acl check
2025-10-10T14:33:09.454833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:09.454842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:09.454844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:09.454851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601098540428176:7554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:09.455449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601098540428176:7554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:09.458597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601098540428176:7554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:09.460021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:09.462412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:09.462653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:09.462669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:09.462683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:09.462675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601098540428176:7554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:09.462691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601098540428176:7554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:09.462695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601098540428176:7554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:09.462704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:09.462750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:09.462794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601097758216168:6019]
2025-10-10T14:33:09.463428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:09.463746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:09.463801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:09.464140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:09.464209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.464218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.464219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.464220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.464222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.464223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.464225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.464226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.464228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.464229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.464231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.464232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.464234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.464241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.464256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.464260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.464265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.464269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.464274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.464278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.464283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.464287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.464292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.464297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.464301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.464306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.464314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.464323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.464331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.464343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.464348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.464356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.464362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.464368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.464382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.464388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.464393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.464399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.464404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.464410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.464415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.464420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.464426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.464432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.464437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.464443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.464454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.464460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.464465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.464471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.464481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.464491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.464544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:09.467007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:09.467352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:09.467371Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:09.467374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:09.467378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:09.467388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 869 [2:7559601097758216168:6019]
2025-10-10T14:33:09.467401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:09.467424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:09.467433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.467436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.467439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.467456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:09.467468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:09.467476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:09.467531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.467539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.467541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.467544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:09.467615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:09.467623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.467636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.467650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.467673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:09.467700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428316:7554], now have 1 active actors on pipe
2025-10-10T14:33:09.467708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428124:2438], now have 1 active actors on pipe
2025-10-10T14:33:09.467717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601097758216163:6019]
2025-10-10T14:33:09.467725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601097758216163:6019]
2025-10-10T14:33:09.467727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601097758216163:6019]
2025-10-10T14:33:09.467743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:09.467760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:09.467764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:09.467768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:09.467770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:09.467784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:09.467792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:09.467814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601097758216163:6019]
2025-10-10T14:33:09.467822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:09.467803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 869
2025-10-10T14:33:09.467807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 869
2025-10-10T14:33:09.467848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:09.467857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.467862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.467897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:09.467911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.467921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.467924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:09.467935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.467951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:09.467976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.468132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.468141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.468158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.468267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 870 partition: 0 MaxSeqNo: 40 sessionId: src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0
2025-10-10T14:33:09.468685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0959826-54728ba6-f4020cd3-e10b7d5a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:09.471335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0] Write session: try to update token
2025-10-10T14:33:09.471350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:09.479039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:09.479058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.479069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601097758216163:6019]
2025-10-10T14:33:09.479110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:09.479120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:09.479298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:09.479448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.479587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.479734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:09.479935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:09.479985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:09.485952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId: src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:09.488754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:09.489219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.489241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.489277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:09.489404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:09.496756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:09.496775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.496777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:09.496778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:09.496787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601097758216163:6019]
2025-10-10T14:33:09.496790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601097758216163:6019]
2025-10-10T14:33:09.496793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601097758216163:6019]
2025-10-10T14:33:09.496835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:09.496840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.496842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:09.496851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:09.496858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:09.496862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:09.496965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:09.545173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601098540428328:7150]
2025-10-10T14:33:09.545527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 869, pipe: [1:7559601098540428328:7150]
2025-10-10T14:33:09.601428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:09.609388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.609415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.609603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.609672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.609735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.609802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.610018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.610029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.610098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.610158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.610232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.610301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.610345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.610353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.610419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.610480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.610543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.610610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.610653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.610660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.610727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.610791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.610860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.610931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.610975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.610983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.611047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.611112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.611186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.611253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.611298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.611307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.611374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.611448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.611514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.611581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.611628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.611635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.611703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.611764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.611831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.611901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.611944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.611951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.612017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.612078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.612140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.612201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.612257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.612265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.612330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.612391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.612454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.612524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.612573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.612585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.612651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:09.612714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:09.612779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:09.612848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:09.612897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:09.612905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:09.612973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428328:7150], now have 1 active actors on pipe
2025-10-10T14:33:09.613199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601098540428328:7150]
2025-10-10T14:33:09.613234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:09.613478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:09.613626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:09.613641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:09.613676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 870 reason: error at write: Disconnected sessionId: src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0
2025-10-10T14:33:09.613936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 870 sessionId: src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0 is DEAD
2025-10-10T14:33:09.614057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:09.614067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0] Write session will restart in 0.008748s
2025-10-10T14:33:09.614086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0] Write session: Do CDS request
2025-10-10T14:33:09.614091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:09.623969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.624052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:09.624072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 871
2025-10-10T14:33:09.624214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.624269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:09.624275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:09.624284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:09.624725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 871 sessionId:  describe result for acl check
2025-10-10T14:33:09.624764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:09.624773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:09.624775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:09.624782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601098540428416:7560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:09.625378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601098540428416:7560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:09.627926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601098540428416:7560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:09.628976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:09.631337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:09.631464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601098540428416:7560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:09.631480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601098540428416:7560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:09.631485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601098540428416:7560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:09.631494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:09.631562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:09.631579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:09.631595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:09.631657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:09.631704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601097758216371:6021]
2025-10-10T14:33:09.632335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:09.632645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:09.632701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:09.633024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:09.633102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.633113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.633115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.633116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.633117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.633118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.633120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.633121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.633122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.633123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.633124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.633126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.633127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.633133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.633147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.633152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.633156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.633160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.633164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.633168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.633173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.633176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.633181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.633185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.633189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.633193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.633201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.633210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.633218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.633223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.633227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.633233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.633237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.633243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.633248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.633253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.633258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.633264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.633268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.633274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.633278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.633284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.633289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.633294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.633306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.633311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.633322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.633327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.633355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.633362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.633371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.633377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.633426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:09.635780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:09.636108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:09.636129Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:09.636131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:09.636135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:09.636141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 870 [2:7559601097758216371:6021]
2025-10-10T14:33:09.636154Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:09.636178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:09.636189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.636193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.636195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.636213Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:09.636220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:09.636228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:09.636287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.636296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.636298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.636301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:09.636369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:09.636377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.636389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.636406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.636429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:09.636456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428531:7560], now have 1 active actors on pipe
2025-10-10T14:33:09.636465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428338:2438], now have 1 active actors on pipe
2025-10-10T14:33:09.636472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601097758216366:6021]
2025-10-10T14:33:09.636475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601097758216366:6021]
2025-10-10T14:33:09.636476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601097758216366:6021]
2025-10-10T14:33:09.636489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:09.636485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 870
2025-10-10T14:33:09.636510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:09.636498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 870
2025-10-10T14:33:09.636512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:09.636517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:09.636519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:09.636533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:09.636536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:09.636571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.636580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.636599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601097758216366:6021]
2025-10-10T14:33:09.636610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:09.636636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:09.636647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac791075-537e969c-300d8371-64172858_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:09.636654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.636664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.636666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:09.636679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.636691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:09.636721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.636852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.636862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.636878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.636952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 871 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac791075-537e969c-300d8371-64172858_0
2025-10-10T14:33:09.637376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15bd06b7-c1230477-44e29cab-60ec8c3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac791075-537e969c-300d8371-64172858_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:09.640014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac791075-537e969c-300d8371-64172858_0] Write session: try to update token
2025-10-10T14:33:09.640032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac791075-537e969c-300d8371-64172858_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:09.654113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId: src_id|ac791075-537e969c-300d8371-64172858_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:09.656233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:09.656254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.656258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:09.656260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:09.656269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601097758216366:6021]
2025-10-10T14:33:09.656273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601097758216366:6021]
2025-10-10T14:33:09.656277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601097758216366:6021]
2025-10-10T14:33:09.656327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:09.656335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:09.656340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.656341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:09.656342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:09.656345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:09.656479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:09.656610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:09.713609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601098540428546:7150]
2025-10-10T14:33:09.713937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 870, pipe: [1:7559601098540428546:7150]
2025-10-10T14:33:09.763982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:09.764224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.764237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.764277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428546:7150], now have 1 active actors on pipe
2025-10-10T14:33:09.764460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:09.764557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:09.764573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601098540428546:7150]
2025-10-10T14:33:09.764575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:09.764595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:09.764639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 871 reason: error at write: Disconnected sessionId: src_id|ac791075-537e969c-300d8371-64172858_0
2025-10-10T14:33:09.764855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 871 sessionId: src_id|ac791075-537e969c-300d8371-64172858_0 is DEAD
2025-10-10T14:33:09.765012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac791075-537e969c-300d8371-64172858_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:09.765032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac791075-537e969c-300d8371-64172858_0] Write session will restart in 0.006866s
2025-10-10T14:33:09.765050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac791075-537e969c-300d8371-64172858_0] Write session: Do CDS request
2025-10-10T14:33:09.765056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac791075-537e969c-300d8371-64172858_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:09.772887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac791075-537e969c-300d8371-64172858_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.773003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:09.773021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 872
2025-10-10T14:33:09.773143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.773172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:09.773176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:09.773180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:09.773902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 872 sessionId:  describe result for acl check
2025-10-10T14:33:09.773943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:09.773949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:09.773952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:09.773958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601098540428580:7564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:09.774530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601098540428580:7564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:09.776971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601098540428580:7564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:09.779422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:09.779596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601098540428580:7564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:09.779611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601098540428580:7564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:09.779615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601098540428580:7564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:09.779623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:09.781834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:09.782042Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:09.782057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:09.782070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:09.782122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:09.782165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601097758216574:6024]
2025-10-10T14:33:09.782663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:09.782963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:09.783009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:09.783316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:09.783370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.783377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.783378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.783379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.783381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.783382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.783383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.783384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.783385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.783387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.783388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.783389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.783390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.783396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.783410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.783415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.783419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.783423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.783426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.783428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.783430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.783432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.783434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.783436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.783438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.783441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.783447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.783452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.783457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.783460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.783463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.783466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.783469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.783472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.783477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.783483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.783487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.783493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.783498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.783502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.783505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.783507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.783510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.783513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.783516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.783519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.783522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.783525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.783527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.783530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.783533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.783536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.783557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:09.785905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:09.786230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:09.786245Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:09.786248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:09.786251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:09.786257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 871 [2:7559601097758216574:6024]
2025-10-10T14:33:09.786270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:09.786290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:09.786298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.786302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.786304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.786321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:09.786336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:09.786344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:09.786395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.786405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.786407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.786410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:09.786475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:09.786483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.786494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.786510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.786532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:09.786557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428740:7564], now have 1 active actors on pipe
2025-10-10T14:33:09.786565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428547:2438], now have 1 active actors on pipe
2025-10-10T14:33:09.786573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601097758216568:6024]
2025-10-10T14:33:09.786579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601097758216568:6024]
2025-10-10T14:33:09.786583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601097758216568:6024]
2025-10-10T14:33:09.786596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:09.786613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:09.786613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:09.786616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:09.786618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:09.786585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 871
2025-10-10T14:33:09.786633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:09.786590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 871
2025-10-10T14:33:09.786637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:09.786667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.786677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.786699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601097758216568:6024]
2025-10-10T14:33:09.786710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:09.786728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:09.786742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:09.786749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.786753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.786756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:09.786767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.786778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:09.787019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.787177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.787187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.787205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.787312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 872 partition: 0 MaxSeqNo: 40 sessionId: src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0
2025-10-10T14:33:09.787700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac791075-537e969c-300d8371-64172858_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:09.790136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0] Write session: try to update token
2025-10-10T14:33:09.790151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:09.803316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId: src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:09.804648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:09.804671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.804675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:09.804677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:09.804686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601097758216568:6024]
2025-10-10T14:33:09.804690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601097758216568:6024]
2025-10-10T14:33:09.804693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601097758216568:6024]
2025-10-10T14:33:09.804735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:09.804741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:09.804748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:09.804749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.804751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:09.804752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:09.804888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:09.805855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:09.864644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601098540428752:7150]
2025-10-10T14:33:09.864912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 871, pipe: [1:7559601098540428752:7150]
2025-10-10T14:33:09.908405Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:09.908636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.908648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.908689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428752:7150], now have 1 active actors on pipe
2025-10-10T14:33:09.908847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:09.908936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:09.908953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:09.908955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601098540428752:7150]
2025-10-10T14:33:09.908979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:09.909031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 872 reason: error at write: Disconnected sessionId: src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0
2025-10-10T14:33:09.909249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 872 sessionId: src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0 is DEAD
2025-10-10T14:33:09.909416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:09.909429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0] Write session will restart in 0.005550s
2025-10-10T14:33:09.909454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0] Write session: Do CDS request
2025-10-10T14:33:09.909460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:09.915828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.915965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:09.915978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 873
2025-10-10T14:33:09.916093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:09.916132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:09.916143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:09.916147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:09.916570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 873 sessionId:  describe result for acl check
2025-10-10T14:33:09.916610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:09.916612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:09.916614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:09.916620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601098540428774:7568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:09.917179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601098540428774:7568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:09.919783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601098540428774:7568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:09.922652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601098540428774:7568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:09.922669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601098540428774:7568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:09.922673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601098540428774:7568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:09.922683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:09.923183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:09.925378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:09.925579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:09.925591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:09.925603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:09.925656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:09.925698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601097758216777:6026]
2025-10-10T14:33:09.926303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:09.926584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:09.926627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:09.926942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:09.927008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.927015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.927017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.927018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.927019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.927020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.927022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.927023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.927024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.927025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.927027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.927028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.927029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.927035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.927048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.927051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.927055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.927058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.927062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.927072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.927076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.927084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.927089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.927097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.927102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.927110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.927117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.927132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:09.927139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.927149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:09.927158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.927163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:09.927172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.927177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:09.927186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.927196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:09.927204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.927209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:09.927218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.927227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:09.927232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.927241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:09.927250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.927258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:09.927262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.927271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:09.927281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.927286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.927295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.927300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.927308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.927314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.927356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:09.929640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:09.929969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:09.929981Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:09.929984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:09.929988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:09.929994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 872 [2:7559601097758216777:6026]
2025-10-10T14:33:09.930006Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:09.930030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:09.930037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.930041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.930048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.930065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:09.930078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:09.930090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:09.930145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.930152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.930154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.930157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:09.930222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:09.930229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.930241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:09.930258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:09.930282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:09.930309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428753:2438], now have 1 active actors on pipe
2025-10-10T14:33:09.930319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601098540428945:7568], now have 1 active actors on pipe
2025-10-10T14:33:09.930327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601097758216772:6026]
2025-10-10T14:33:09.930330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601097758216772:6026]
2025-10-10T14:33:09.930332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601097758216772:6026]
2025-10-10T14:33:09.930344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:09.930357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:09.930363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:09.930366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:09.930368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:09.930378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:09.930381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:09.930359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 872
2025-10-10T14:33:09.930400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 872
2025-10-10T14:33:09.930401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601097758216772:6026]
2025-10-10T14:33:09.930412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:09.930414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:09.930439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.930444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.930483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:09.930496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:09.930501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:09.930504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:09.930516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:09.930526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:09.930553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.930690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:09.930699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:09.930714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:09.930811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 873 partition: 0 MaxSeqNo: 40 sessionId: src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0
2025-10-10T14:33:09.931254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44dbcec0-9ee1c40a-74c733b7-903d850b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:09.933820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0] Write session: try to update token
2025-10-10T14:33:09.933835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:09.948089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId: src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:09.949461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:09.949481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:09.949484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:09.949486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:09.949496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601097758216772:6026]
2025-10-10T14:33:09.949501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601097758216772:6026]
2025-10-10T14:33:09.949505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601097758216772:6026]
2025-10-10T14:33:09.949550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:09.949555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:09.949554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:09.949557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:09.949560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:09.949565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:09.949688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:09.950816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:10.009039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601102835396260:7150]
2025-10-10T14:33:10.009343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 872, pipe: [1:7559601102835396260:7150]
2025-10-10T14:33:10.056747Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:10.057241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.057264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.057316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396260:7150], now have 1 active actors on pipe
2025-10-10T14:33:10.057560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:10.057596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:10.057608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601102835396260:7150]
2025-10-10T14:33:10.057630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:10.057704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0
2025-10-10T14:33:10.057919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 873 sessionId: src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0 is DEAD
2025-10-10T14:33:10.058084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:10.058096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0] Write session will restart in 0.005211s
2025-10-10T14:33:10.058121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0] Write session: Do CDS request
2025-10-10T14:33:10.058127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:10.064921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.064997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:10.065015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 874
2025-10-10T14:33:10.065209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.065266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:10.065277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:10.065281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:10.065757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 874 sessionId:  describe result for acl check
2025-10-10T14:33:10.065794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:10.065796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:10.065798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:10.065804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601102835396275:7572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:10.066315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601102835396275:7572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:10.069316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601102835396275:7572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:10.072564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601102835396275:7572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:10.072582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601102835396275:7572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:10.072586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601102835396275:7572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:10.072595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:10.074201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:10.076344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:10.076636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:10.076656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:10.076675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:10.076762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:10.076825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601102053184279:6028]
2025-10-10T14:33:10.077458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:10.077752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:10.077794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:10.078098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:10.078156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.078163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.078164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.078165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.078166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.078167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.078168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.078169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.078171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.078173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.078174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.078175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.078176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.078182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.078195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.078198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.078202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.078206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.078209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.078212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.078216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.078219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.078224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.078227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.078231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.078234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.078242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.078250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.078256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.078261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.078265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.078270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.078274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.078279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.078284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.078289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.078294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.078302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.078308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.078312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.078321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.078326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.078330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.078334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.078342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.078346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.078353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.078357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.078361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.078370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.078375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.078379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.078420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:10.080631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:10.081127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:10.081139Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:10.081141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:10.081144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:10.081149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 873 [2:7559601102053184279:6028]
2025-10-10T14:33:10.081159Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:10.081174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:10.081176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.081179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.081180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.081194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:10.081203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:10.081210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:10.081266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.081272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.081274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.081276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:10.081370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:10.081377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.081385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.081391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.081402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:10.081423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396261:2438], now have 1 active actors on pipe
2025-10-10T14:33:10.081431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396453:7572], now have 1 active actors on pipe
2025-10-10T14:33:10.081437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601102053184274:6028]
2025-10-10T14:33:10.081438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601102053184274:6028]
2025-10-10T14:33:10.081440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601102053184274:6028]
2025-10-10T14:33:10.081449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:10.081460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:10.081476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:10.081477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:10.081479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:10.081481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:10.081483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:10.081500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601102053184274:6028]
2025-10-10T14:33:10.081509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:10.081518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:10.081503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 873
2025-10-10T14:33:10.081523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 873
2025-10-10T14:33:10.081547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.081555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.081583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:10.081593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.081596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.081598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:10.081606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.081614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:10.081629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.081768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.081777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.081791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.081875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 874 partition: 0 MaxSeqNo: 40 sessionId: src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0
2025-10-10T14:33:10.082316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de412d1-90119f25-1ce4b52-5f1073d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:10.084959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0] Write session: try to update token
2025-10-10T14:33:10.084991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:10.097894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId: src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:10.100398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:10.100420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:10.100423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:10.100425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:10.100434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601102053184274:6028]
2025-10-10T14:33:10.100441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601102053184274:6028]
2025-10-10T14:33:10.100444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601102053184274:6028]
2025-10-10T14:33:10.100452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:10.100495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:10.100496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:10.100502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:10.100506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:10.100507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.100509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:10.100644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:10.158018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601102835396468:7150]
2025-10-10T14:33:10.158225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 873, pipe: [1:7559601102835396468:7150]
2025-10-10T14:33:10.214642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:10.214837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.214852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.214904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396468:7150], now have 1 active actors on pipe
2025-10-10T14:33:10.215047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:10.215113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:10.215134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601102835396468:7150]
2025-10-10T14:33:10.215150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:10.215205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 874 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0
2025-10-10T14:33:10.215391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 874 sessionId: src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0 is DEAD
2025-10-10T14:33:10.215505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:10.215515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0] Write session will restart in 0.009653s
2025-10-10T14:33:10.215532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0] Write session: Do CDS request
2025-10-10T14:33:10.215536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:10.225915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.226009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:10.226025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 875
2025-10-10T14:33:10.226142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.226182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:10.226193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:10.226197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:10.226627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 875 sessionId:  describe result for acl check
2025-10-10T14:33:10.226666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:10.226672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:10.226675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:10.226681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601102835396660:7585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:10.227504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601102835396660:7585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:10.227953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:10.229547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601102835396660:7585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:10.230158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:10.230350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:10.230364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:10.230377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:10.230431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:10.230472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601102053184521:6043]
2025-10-10T14:33:10.231056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:10.231341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:10.231389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:10.231696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:10.231744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601102835396660:7585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:10.231757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601102835396660:7585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:10.231760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.231761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601102835396660:7585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:10.231769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:10.231767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.231768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.231769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.231770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.231771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.231773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.231774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.231775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.231776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.231778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.231779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.231780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.231785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.231796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.231800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.231803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.231807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.231810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.231815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.231819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.231823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.231827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.231831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.231835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.231838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.231846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.231854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.231860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.231865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.231868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.231874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.231879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.231883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.231886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.231890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.231894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.231898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.231902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.231906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.231910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.231914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.231919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.231926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.231930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.231936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.231940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.231944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.231948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.231952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.231956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.231962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.232011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:10.234314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:10.234871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:10.234886Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:10.234888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:10.234891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:10.234897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 874 [2:7559601102053184521:6043]
2025-10-10T14:33:10.234908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:10.234920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:10.234922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.234924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.234925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.234938Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:10.234943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:10.234950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:10.234990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.234998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.234999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.235001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:10.235052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:10.235058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.235065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.235077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.235092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:10.235115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396496:2438], now have 1 active actors on pipe
2025-10-10T14:33:10.235127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601102053184516:6043]
2025-10-10T14:33:10.235129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601102053184516:6043]
2025-10-10T14:33:10.235130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601102053184516:6043]
2025-10-10T14:33:10.235139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:10.235146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396691:7585], now have 1 active actors on pipe
2025-10-10T14:33:10.235152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:10.235164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:10.235164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:10.235166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:10.235168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:10.235169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:10.235183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601102053184516:6043]
2025-10-10T14:33:10.235187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:10.235177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 874
2025-10-10T14:33:10.235189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:10.235178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 874
2025-10-10T14:33:10.235267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.235275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.235297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:10.235304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.235309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.235311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:10.235319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.235327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:10.235342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.235603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.235610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.235621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.235706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 875 partition: 0 MaxSeqNo: 40 sessionId: src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0
2025-10-10T14:33:10.236081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc6eda-d48b170-88abd664-40cd7ba6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:10.238726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0] Write session: try to update token
2025-10-10T14:33:10.238744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:10.252415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId: src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:10.252709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:10.252729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:10.252737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601102053184516:6043]
2025-10-10T14:33:10.252778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:10.252789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:10.252962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:10.253116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:10.253264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:10.253420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:10.253606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:10.253650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:10.254883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:10.255065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.255082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.255117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:10.255207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:10.263655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:10.263676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:10.263679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:10.263681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:10.263692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601102053184516:6043]
2025-10-10T14:33:10.263696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601102053184516:6043]
2025-10-10T14:33:10.263700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601102053184516:6043]
2025-10-10T14:33:10.263747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:10.263750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:10.263758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.263761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:10.263761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:10.263766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:10.263895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:10.315219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601102835396713:7150]
2025-10-10T14:33:10.315555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 874, pipe: [1:7559601102835396713:7150]
2025-10-10T14:33:10.369473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:10.376358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.376386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.376560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.376626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.376687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.376747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.376787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.376796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.376858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.376914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.376972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.377031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.377073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.377079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.377138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.377193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.377258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.377340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.377380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.377386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.377445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.377503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.377563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.377621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.377661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.377668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.377727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.377783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.377841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.377898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.377939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.377955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.378025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.378080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.378137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.378192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.378231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.378236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.378294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.378348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.378405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.378463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.378507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.378516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.378586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.378640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.378698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.378755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.378796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.378801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.378872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.378926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.378981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.379039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.379086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.379094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.379150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:10.379204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:10.379261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:10.379315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:10.379354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:10.379362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:10.379400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396713:7150], now have 1 active actors on pipe
2025-10-10T14:33:10.379684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:10.379685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601102835396713:7150]
2025-10-10T14:33:10.379703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:10.379727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:10.379733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 875 reason: error at write: Disconnected sessionId: src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0
2025-10-10T14:33:10.379957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 875 sessionId: src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0 is DEAD
2025-10-10T14:33:10.380103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:10.380113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0] Write session will restart in 0.009862s
2025-10-10T14:33:10.380130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0] Write session: Do CDS request
2025-10-10T14:33:10.380135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:10.380408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:10.390920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.390988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:10.391006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 876
2025-10-10T14:33:10.391187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.391225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:10.391236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:10.391240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:10.391668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 876 sessionId:  describe result for acl check
2025-10-10T14:33:10.391706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:10.391712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:10.391714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:10.391720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601102835396880:7590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:10.392245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601102835396880:7590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:10.392821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:10.394389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601102835396880:7590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:10.394977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:10.395189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:10.395205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:10.395217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:10.395273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:10.395315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601102053184739:6046]
2025-10-10T14:33:10.395874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:10.396176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:10.396226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:10.396529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:10.396601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.396608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.396609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.396610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.396611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.396612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.396613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.396615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.396616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.396617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.396618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.396619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.396620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.396626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.396638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.396643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.396647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.396651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.396658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601102835396880:7590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:10.396654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.396673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601102835396880:7590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:10.396658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.396677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601102835396880:7590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:10.396684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:10.396661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.396665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.396669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.396672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.396675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.396679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.396686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.396694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.396702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.396707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.396711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.396715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.396719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.396724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.396728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.396732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.396736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.396741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.396745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.396750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.396753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.396758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.396762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.396766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.396771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.396775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.396780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.396784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.396788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.396792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.396797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.396801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.396836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:10.399015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:10.399351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:10.399367Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:10.399370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:10.399374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:10.399380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 875 [2:7559601102053184739:6046]
2025-10-10T14:33:10.399398Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:10.399419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:10.399426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.399429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.399432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.399447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:10.399460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:10.399472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:10.399534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.399541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.399543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.399545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:10.399611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:10.399619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.399629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.399646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.399667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:10.399692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396715:2438], now have 1 active actors on pipe
2025-10-10T14:33:10.399702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396914:7590], now have 1 active actors on pipe
2025-10-10T14:33:10.399710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601102053184734:6046]
2025-10-10T14:33:10.399713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601102053184734:6046]
2025-10-10T14:33:10.399715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601102053184734:6046]
2025-10-10T14:33:10.399728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:10.399743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:10.399751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:10.399754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:10.399756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:10.399761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:10.399748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 875
2025-10-10T14:33:10.399765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:10.399752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 875
2025-10-10T14:33:10.399788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601102053184734:6046]
2025-10-10T14:33:10.399796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:10.399799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:10.399827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.399836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.399872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81fb5187-dd404da4-7156ae97-248c815b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:10.399884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.399893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.399895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:10.399907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.399923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:10.399949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.400125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.400135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.400153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.400274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 876 partition: 0 MaxSeqNo: 40 sessionId: src_id|81fb5187-dd404da4-7156ae97-248c815b_0
2025-10-10T14:33:10.400635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d1594f9-f136f595-21b0600e-5bb7bac6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|81fb5187-dd404da4-7156ae97-248c815b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:10.403362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb5187-dd404da4-7156ae97-248c815b_0] Write session: try to update token
2025-10-10T14:33:10.403388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb5187-dd404da4-7156ae97-248c815b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:10.417345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId: src_id|81fb5187-dd404da4-7156ae97-248c815b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:10.418861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:10.418883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:10.418887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:10.418888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:10.418899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601102053184734:6046]
2025-10-10T14:33:10.418903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601102053184734:6046]
2025-10-10T14:33:10.418907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601102053184734:6046]
2025-10-10T14:33:10.418953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:10.418959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:10.418967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:10.418968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.418970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:10.418971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:10.419115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:10.419894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:10.480073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601102835396924:7150]
2025-10-10T14:33:10.480329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 875, pipe: [1:7559601102835396924:7150]
2025-10-10T14:33:10.526426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:10.526888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.526905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.526953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396924:7150], now have 1 active actors on pipe
2025-10-10T14:33:10.527120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:10.527186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:10.527240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:10.527249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601102835396924:7150]
2025-10-10T14:33:10.527329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 876 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81fb5187-dd404da4-7156ae97-248c815b_0
2025-10-10T14:33:10.527544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 876 sessionId: src_id|81fb5187-dd404da4-7156ae97-248c815b_0 is DEAD
2025-10-10T14:33:10.527722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb5187-dd404da4-7156ae97-248c815b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:10.527735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb5187-dd404da4-7156ae97-248c815b_0] Write session will restart in 0.006870s
2025-10-10T14:33:10.527762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb5187-dd404da4-7156ae97-248c815b_0] Write session: Do CDS request
2025-10-10T14:33:10.527768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb5187-dd404da4-7156ae97-248c815b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:10.535808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb5187-dd404da4-7156ae97-248c815b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.535892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:10.535908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 877
2025-10-10T14:33:10.536035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.536071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:10.536081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:10.536085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:10.536611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 877 sessionId:  describe result for acl check
2025-10-10T14:33:10.536656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:10.536665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:10.536667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:10.536673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601102835396961:7594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:10.537226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601102835396961:7594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:10.539609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601102835396961:7594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:10.542016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:10.542078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601102835396961:7594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:10.542093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601102835396961:7594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:10.542097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601102835396961:7594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:10.542104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:10.544024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:10.544240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:10.544250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:10.544262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:10.544311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:10.544351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601102053184947:6048]
2025-10-10T14:33:10.544766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:10.544988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:10.545019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:10.545255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:10.545296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.545301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.545302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.545302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.545303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.545304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.545304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.545305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.545305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.545306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.545306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.545307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.545308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.545311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.545320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.545322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.545324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.545327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.545343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.545347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.545351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.545354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.545358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.545362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.545365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.545369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.545377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.545383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.545387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.545390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.545393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.545396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.545398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.545401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.545404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.545407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.545410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.545413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.545416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.545419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.545422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.545429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.545433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.545438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.545443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.545448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.545452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.545455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.545458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.545461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.545463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.545466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.545488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:10.547699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:10.548002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:10.548015Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:10.548017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:10.548021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:10.548027Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 876 [2:7559601102053184947:6048]
2025-10-10T14:33:10.548038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:10.548054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:10.548062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.548066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.548068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.548084Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:10.548096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:10.548109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:10.548158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.548165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.548167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.548170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:10.548247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:10.548254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.548265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.548281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.548303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:10.548329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397122:7594], now have 1 active actors on pipe
2025-10-10T14:33:10.548336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835396925:2438], now have 1 active actors on pipe
2025-10-10T14:33:10.548343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601102053184941:6048]
2025-10-10T14:33:10.548345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601102053184941:6048]
2025-10-10T14:33:10.548348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601102053184941:6048]
2025-10-10T14:33:10.548355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:10.548338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 876
2025-10-10T14:33:10.548348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 876
2025-10-10T14:33:10.548368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:10.548382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:10.548389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:10.548392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:10.548392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:10.548394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:10.548423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.548432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.548450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601102053184941:6048]
2025-10-10T14:33:10.548462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:10.548483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:10.548497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:10.548509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.548512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.548514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:10.548526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.548541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:10.548567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.548737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.548745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.548758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.548847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 877 partition: 0 MaxSeqNo: 40 sessionId: src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0
2025-10-10T14:33:10.549216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81fb5187-dd404da4-7156ae97-248c815b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:10.551945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0] Write session: try to update token
2025-10-10T14:33:10.551962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:10.566309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId: src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:10.568501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:10.568524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:10.568527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:10.568529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:10.568540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601102053184941:6048]
2025-10-10T14:33:10.568544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601102053184941:6048]
2025-10-10T14:33:10.568548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601102053184941:6048]
2025-10-10T14:33:10.568590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:10.568591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:10.568597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:10.568599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.568601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:10.568601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:10.568783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:10.568911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:10.627526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601102835397143:7150]
2025-10-10T14:33:10.627822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 876, pipe: [1:7559601102835397143:7150]
2025-10-10T14:33:10.673615Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:10.674122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.674136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.674173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397143:7150], now have 1 active actors on pipe
2025-10-10T14:33:10.674340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:10.674437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601102835397143:7150]
2025-10-10T14:33:10.674447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:10.674476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:10.674551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 877 reason: status is not ok: tablet will be restarted right now sessionId: src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0
2025-10-10T14:33:10.674779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 877 sessionId: src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0 is DEAD
2025-10-10T14:33:10.674997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:10.675008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0] Write session will restart in 0.008216s
2025-10-10T14:33:10.675034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0] Write session: Do CDS request
2025-10-10T14:33:10.675040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:10.684877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.684978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:10.684995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 878
2025-10-10T14:33:10.685102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.685137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:10.685148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:10.685151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:10.685691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 878 sessionId:  describe result for acl check
2025-10-10T14:33:10.685733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:10.685739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:10.685741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:10.685747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601102835397240:7600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:10.686313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601102835397240:7600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:10.688546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601102835397240:7600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:10.689265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:10.691539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:10.691742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:10.691753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:10.691765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:10.691818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:10.691856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601102053185156:6051]
2025-10-10T14:33:10.691853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601102835397240:7600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:10.691868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601102835397240:7600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:10.691871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601102835397240:7600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:10.691880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:10.692467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:10.692722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:10.692759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:10.693066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:10.693116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.693122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.693123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.693124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.693125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.693126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.693128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.693129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.693130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.693131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.693133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.693134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.693135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.693140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.693152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.693156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.693160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.693164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.693167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.693170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.693174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.693178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.693182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.693190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.693194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.693199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.693210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.693223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.693233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.693243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.693251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.693260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.693269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.693275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.693283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.693293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.693301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.693305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.693315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.693320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.693342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.693346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.693353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.693359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.693366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.693371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.693381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.693390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.693398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.693407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.693415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.693419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.693460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:10.695628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:10.696144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:10.696159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:10.696161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:10.696165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:10.696171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 877 [2:7559601102053185156:6051]
2025-10-10T14:33:10.696182Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:10.696202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:10.696209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.696213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.696215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.696235Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:10.696248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:10.696260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:10.696315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.696322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.696324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.696326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:10.696389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:10.696396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.696407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.696424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.696445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:10.696469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397148:2438], now have 1 active actors on pipe
2025-10-10T14:33:10.696476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397347:7600], now have 1 active actors on pipe
2025-10-10T14:33:10.696483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601102053185151:6051]
2025-10-10T14:33:10.696490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601102053185151:6051]
2025-10-10T14:33:10.696492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601102053185151:6051]
2025-10-10T14:33:10.696506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:10.696522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:10.696524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:10.696532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:10.696534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:10.696518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 877
2025-10-10T14:33:10.696541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:10.696525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 877
2025-10-10T14:33:10.696548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:10.696574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601102053185151:6051]
2025-10-10T14:33:10.696585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:10.696591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:10.696603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.696612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.696660Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dcec729-27606aa8-2f67a494-fec41a55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:10.696673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.696681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.696688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:10.696698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.696711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:10.696731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.696861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.696871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.696888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.696982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 878 partition: 0 MaxSeqNo: 40 sessionId: src_id|7dcec729-27606aa8-2f67a494-fec41a55_0
2025-10-10T14:33:10.697367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|200ca896-22dc3ce2-cfbf29af-c20db68b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7dcec729-27606aa8-2f67a494-fec41a55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:10.699994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcec729-27606aa8-2f67a494-fec41a55_0] Write session: try to update token
2025-10-10T14:33:10.700011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcec729-27606aa8-2f67a494-fec41a55_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:10.714008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId: src_id|7dcec729-27606aa8-2f67a494-fec41a55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:10.716136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:10.716157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:10.716160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:10.716163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:10.716172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601102053185151:6051]
2025-10-10T14:33:10.716177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601102053185151:6051]
2025-10-10T14:33:10.716180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601102053185151:6051]
2025-10-10T14:33:10.716219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:10.716230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:10.716233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:10.716237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:10.716238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.716241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:10.716375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:10.716484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:10.774471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601102835397358:7150]
2025-10-10T14:33:10.774807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 877, pipe: [1:7559601102835397358:7150]
2025-10-10T14:33:10.821017Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:10.821372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.821387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.821433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397358:7150], now have 1 active actors on pipe
2025-10-10T14:33:10.821625Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:10.821684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601102835397358:7150]
2025-10-10T14:33:10.821698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:10.821718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:10.821798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 878 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7dcec729-27606aa8-2f67a494-fec41a55_0
2025-10-10T14:33:10.822020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 878 sessionId: src_id|7dcec729-27606aa8-2f67a494-fec41a55_0 is DEAD
2025-10-10T14:33:10.822169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcec729-27606aa8-2f67a494-fec41a55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:10.822179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcec729-27606aa8-2f67a494-fec41a55_0] Write session will restart in 0.005637s
2025-10-10T14:33:10.822197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcec729-27606aa8-2f67a494-fec41a55_0] Write session: Do CDS request
2025-10-10T14:33:10.822201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcec729-27606aa8-2f67a494-fec41a55_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:10.828881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcec729-27606aa8-2f67a494-fec41a55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.828948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:10.828964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 879
2025-10-10T14:33:10.829100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.829139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:10.829150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:10.829158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:10.829850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 879 sessionId:  describe result for acl check
2025-10-10T14:33:10.829892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:10.829899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:10.829901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:10.829907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601102835397383:7604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:10.830479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601102835397383:7604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:10.833402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601102835397383:7604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:10.835959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601102835397383:7604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:10.835975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601102835397383:7604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:10.835979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601102835397383:7604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:10.835987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:10.836066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:10.838591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:10.838817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:10.838828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:10.838850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:10.838913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:10.838962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601102053185366:6053]
2025-10-10T14:33:10.839573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:10.839887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:10.839927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:10.840243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:10.840296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.840304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.840305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.840306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.840308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.840309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.840310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.840311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.840313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.840314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.840315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.840317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.840318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.840324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.840335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.840337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.840340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.840342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.840344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.840346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.840348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.840350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.840354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.840358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.840363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.840367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.840375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.840383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.840390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.840395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.840400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.840405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.840410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.840415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.840420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.840425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.840430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.840435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.840440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.840445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.840449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.840455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.840460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.840465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.840469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.840474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.840478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.840483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.840488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.840494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.840498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.840510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.840551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:10.842795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:10.843213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:10.843227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:10.843230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:10.843234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:10.843239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 878 [2:7559601102053185366:6053]
2025-10-10T14:33:10.843247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:10.843261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:10.843264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.843266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.843267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.843280Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:10.843285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:10.843291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:10.843332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.843340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.843342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.843345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:10.843417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:10.843424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.843435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.843445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.843467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:10.843492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397559:7604], now have 1 active actors on pipe
2025-10-10T14:33:10.843501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397360:2438], now have 1 active actors on pipe
2025-10-10T14:33:10.843509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601102053185360:6053]
2025-10-10T14:33:10.843516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601102053185360:6053]
2025-10-10T14:33:10.843519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601102053185360:6053]
2025-10-10T14:33:10.843532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:10.843550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:10.843552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:10.843555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:10.843557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:10.843564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:10.843566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:10.843584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601102053185360:6053]
2025-10-10T14:33:10.843565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 878
2025-10-10T14:33:10.843592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:10.843567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 878
2025-10-10T14:33:10.843607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:10.843620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.843623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.843649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80c42900-8840dfe4-3c942c6-cf228e21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:10.843662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.843665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.843667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:10.843675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.843684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:10.843694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.843837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.843846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.843859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.843941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 879 partition: 0 MaxSeqNo: 40 sessionId: src_id|80c42900-8840dfe4-3c942c6-cf228e21_0
2025-10-10T14:33:10.844346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dcec729-27606aa8-2f67a494-fec41a55_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80c42900-8840dfe4-3c942c6-cf228e21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:10.847056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c42900-8840dfe4-3c942c6-cf228e21_0] Write session: try to update token
2025-10-10T14:33:10.847074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c42900-8840dfe4-3c942c6-cf228e21_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:10.861378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId: src_id|80c42900-8840dfe4-3c942c6-cf228e21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:10.863708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:10.863731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:10.863734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:10.863736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:10.863746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601102053185360:6053]
2025-10-10T14:33:10.863751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601102053185360:6053]
2025-10-10T14:33:10.863755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601102053185360:6053]
2025-10-10T14:33:10.863808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:10.863814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:10.863820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:10.863821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.863823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:10.863824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:10.863967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:10.864043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:10.921896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601102835397571:7150]
2025-10-10T14:33:10.922201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 878, pipe: [1:7559601102835397571:7150]
2025-10-10T14:33:10.968052Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:10.968484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.968500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.968542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397571:7150], now have 1 active actors on pipe
2025-10-10T14:33:10.968706Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:10.968763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:10.968819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:10.968858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601102835397571:7150]
2025-10-10T14:33:10.968904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 879 reason: status is not ok: tablet will be restarted right now sessionId: src_id|80c42900-8840dfe4-3c942c6-cf228e21_0
2025-10-10T14:33:10.969120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 879 sessionId: src_id|80c42900-8840dfe4-3c942c6-cf228e21_0 is DEAD
2025-10-10T14:33:10.969296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c42900-8840dfe4-3c942c6-cf228e21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:10.969310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c42900-8840dfe4-3c942c6-cf228e21_0] Write session will restart in 0.007065s
2025-10-10T14:33:10.969358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c42900-8840dfe4-3c942c6-cf228e21_0] Write session: Do CDS request
2025-10-10T14:33:10.969366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c42900-8840dfe4-3c942c6-cf228e21_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:10.977867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c42900-8840dfe4-3c942c6-cf228e21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.977986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:10.978005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 880
2025-10-10T14:33:10.978145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:10.978184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:10.978192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:10.978195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:10.978646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 880 sessionId:  describe result for acl check
2025-10-10T14:33:10.978686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:10.978693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:10.978694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:10.978701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601102835397656:7608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:10.979247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601102835397656:7608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:10.981617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601102835397656:7608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:10.982545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:10.984599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:10.984798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:10.984814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:10.984827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:10.984895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:10.984881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601102835397656:7608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:10.984896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601102835397656:7608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:10.984899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601102835397656:7608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:10.984907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:10.984934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601102053185575:6055]
2025-10-10T14:33:10.985523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:10.985815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:10.985870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:10.986183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:10.986267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.986276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.986277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.986278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.986279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.986280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.986281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.986282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.986283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.986285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.986286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.986287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.986288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.986295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.986308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.986316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.986320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.986324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.986332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.986336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.986340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.986349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.986354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.986362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.986366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.986370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.986377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.986391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:10.986403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.986409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:10.986413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.986420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:10.986429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.986439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:10.986444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.986450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:10.986459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.986469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:10.986478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.986483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:10.986488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.986494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:10.986503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.986513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:10.986521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.986526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:10.986531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.986537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.986541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.986546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.986555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.986560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.986600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:10.988827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:10.989171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:10.989182Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:10.989183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:10.989186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:10.989190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 879 [2:7559601102053185575:6055]
2025-10-10T14:33:10.989199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:10.989210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:10.989216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.989218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.989219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.989230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:10.989235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:10.989242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:10.989285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.989289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.989291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.989292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:10.989356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:10.989361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:10.989368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:10.989374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:10.989383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:10.989403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397572:2438], now have 1 active actors on pipe
2025-10-10T14:33:10.989409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601102835397774:7608], now have 1 active actors on pipe
2025-10-10T14:33:10.989414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601102053185569:6055]
2025-10-10T14:33:10.989416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601102053185569:6055]
2025-10-10T14:33:10.989417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601102053185569:6055]
2025-10-10T14:33:10.989426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:10.989436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:10.989439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:10.989441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:10.989443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:10.989448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:10.989451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:10.989466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601102053185569:6055]
2025-10-10T14:33:10.989471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:10.989473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:10.989454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 879
2025-10-10T14:33:10.989471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 879
2025-10-10T14:33:10.989498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.989504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.989530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93facc80-c1861f92-4af7849f-88e2ea8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:10.989540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:10.989542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:10.989548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:10.989555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:10.989566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:10.989577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.989743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:10.989751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:10.989762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:10.989864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 880 partition: 0 MaxSeqNo: 40 sessionId: src_id|93facc80-c1861f92-4af7849f-88e2ea8_0
2025-10-10T14:33:10.990241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c42900-8840dfe4-3c942c6-cf228e21_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|93facc80-c1861f92-4af7849f-88e2ea8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:10.992910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93facc80-c1861f92-4af7849f-88e2ea8_0] Write session: try to update token
2025-10-10T14:33:10.992930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93facc80-c1861f92-4af7849f-88e2ea8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:11.007354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId: src_id|93facc80-c1861f92-4af7849f-88e2ea8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:11.008616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:11.008640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:11.008644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:11.008647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:11.008656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601102053185569:6055]
2025-10-10T14:33:11.008661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601102053185569:6055]
2025-10-10T14:33:11.008665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601102053185569:6055]
2025-10-10T14:33:11.008713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:11.008728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.008731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:11.008769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:11.008786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:11.008793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:11.008865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:11.010312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:11.068869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601107130365081:7150]
2025-10-10T14:33:11.069205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 879, pipe: [1:7559601107130365081:7150]
2025-10-10T14:33:11.114395Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:11.114694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.114707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.114747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365081:7150], now have 1 active actors on pipe
2025-10-10T14:33:11.115004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:11.115018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:11.115023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:11.115075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601107130365081:7150]
2025-10-10T14:33:11.115097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 880 reason: error at write: Disconnected sessionId: src_id|93facc80-c1861f92-4af7849f-88e2ea8_0
2025-10-10T14:33:11.115295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:11.115320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 880 sessionId: src_id|93facc80-c1861f92-4af7849f-88e2ea8_0 is DEAD
2025-10-10T14:33:11.115456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93facc80-c1861f92-4af7849f-88e2ea8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:11.115464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93facc80-c1861f92-4af7849f-88e2ea8_0] Write session will restart in 0.009556s
2025-10-10T14:33:11.115489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93facc80-c1861f92-4af7849f-88e2ea8_0] Write session: Do CDS request
2025-10-10T14:33:11.115495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93facc80-c1861f92-4af7849f-88e2ea8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:11.125901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93facc80-c1861f92-4af7849f-88e2ea8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.126016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:11.126038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 881
2025-10-10T14:33:11.126172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.126201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:11.126209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:11.126213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:11.126639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 881 sessionId:  describe result for acl check
2025-10-10T14:33:11.126679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:11.126686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:11.126688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:11.126694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601107130365178:7612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:11.127195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601107130365178:7612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:11.129189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601107130365178:7612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:11.130637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:11.132729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:11.132908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:11.132917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:11.132927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:11.132909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601107130365178:7612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:11.132926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601107130365178:7612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:11.132930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601107130365178:7612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:11.132939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:11.132967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:11.132999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601106348153081:6057]
2025-10-10T14:33:11.133418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:11.133732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:11.133788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:11.134043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:11.134096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.134100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.134101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.134102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.134103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.134103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.134104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.134105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.134105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.134106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.134107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.134107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.134108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.134112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.134120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.134122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.134125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.134127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.134129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.134132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.134134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.134136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.134139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.134149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.134151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.134154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.134159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.134165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.134171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.134176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.134181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.134185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.134190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.134194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.134199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.134204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.134209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.134214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.134219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.134222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.134225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.134228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.134231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.134234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.134237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.134240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.134242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.134245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.134249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.134252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.134254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.134257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.134280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:11.136480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:11.136777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:11.136786Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:11.136788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:11.136790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:11.136795Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 880 [2:7559601106348153081:6057]
2025-10-10T14:33:11.136803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:11.136817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:11.136823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.136825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.136827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.136849Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:11.136858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:11.136864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:11.136909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.136914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.136915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.136917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:11.136969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:11.136975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.136982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.136991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.137005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:11.137024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601106348153076:6057]
2025-10-10T14:33:11.137029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601106348153076:6057]
2025-10-10T14:33:11.137030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601106348153076:6057]
2025-10-10T14:33:11.137037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:11.137047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:11.137050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365284:7612], now have 1 active actors on pipe
2025-10-10T14:33:11.137053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365082:2438], now have 1 active actors on pipe
2025-10-10T14:33:11.137058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:11.137060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:11.137061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:11.137077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:11.137085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:11.137109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601106348153076:6057]
2025-10-10T14:33:11.137118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:11.137137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:11.137142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 880
2025-10-10T14:33:11.137150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 880
2025-10-10T14:33:11.137192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.137199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.137225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:11.137238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.137242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.137244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:11.137252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.137261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:11.137272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.137440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.137452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.137467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.137549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 881 partition: 0 MaxSeqNo: 40 sessionId: src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0
2025-10-10T14:33:11.137942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93facc80-c1861f92-4af7849f-88e2ea8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:11.140478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0] Write session: try to update token
2025-10-10T14:33:11.140492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:11.148581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:11.148602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:11.148626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601106348153076:6057]
2025-10-10T14:33:11.148672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:11.148671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:11.148840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:11.148971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:11.149100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:11.149233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:11.149425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:11.149462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:11.154212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId: src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:11.156851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:11.157081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.157098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.157136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:11.157227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:11.167466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:11.167484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:11.167487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:11.167488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:11.167498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601106348153076:6057]
2025-10-10T14:33:11.167501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601106348153076:6057]
2025-10-10T14:33:11.167505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601106348153076:6057]
2025-10-10T14:33:11.167545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:11.167549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:11.167552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:11.167554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:11.167558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.167560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:11.167681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:11.215289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601107130365300:7150]
2025-10-10T14:33:11.215519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 880, pipe: [1:7559601107130365300:7150]
2025-10-10T14:33:11.276223Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:11.283793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.283817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.283971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.284036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.284096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.284153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.284197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.284205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.284273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.284332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.284388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.284448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.284490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.284495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.284571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.284626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.284687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.284747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.284798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.284807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.284870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.284928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.284999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.285069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.285109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.285115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.285176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.285234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.285298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.285384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.285428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.285435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.285497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.285560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.285623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.285681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.285725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.285730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.285796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.285858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.285919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.285976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.286017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.286023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.286090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.286151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.286222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.286280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.286325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.286332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.286402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.286458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.286521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.286585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.286632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.286638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.286700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:11.286758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:11.286829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:11.286894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:11.286935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:11.286941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:11.286994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365300:7150], now have 1 active actors on pipe
2025-10-10T14:33:11.287262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:11.287276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:11.287282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:11.287311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 881 reason: error at write: Disconnected sessionId: src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0
2025-10-10T14:33:11.287346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601107130365300:7150]
2025-10-10T14:33:11.287497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 881 sessionId: src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0 is DEAD
2025-10-10T14:33:11.287719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:11.287729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0] Write session will restart in 0.007088s
2025-10-10T14:33:11.287749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0] Write session: Do CDS request
2025-10-10T14:33:11.287753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:11.287754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:11.295844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.295895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:11.295913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 882
2025-10-10T14:33:11.296048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.296092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:11.296100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:11.296103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:11.296540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 882 sessionId:  describe result for acl check
2025-10-10T14:33:11.296579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:11.296586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:11.296588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:11.296595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601107130365364:7628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:11.297152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601107130365364:7628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:11.299227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601107130365364:7628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:11.301299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601107130365364:7628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:11.301327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601107130365364:7628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:11.301345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601107130365364:7628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:11.301355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:11.303326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:11.305781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:11.306061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:11.306076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:11.306101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:11.306175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:11.306224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601106348153344:6073]
2025-10-10T14:33:11.306846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:11.307202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:11.307252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:11.307578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:11.307646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.307653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.307654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.307655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.307657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.307658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.307659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.307661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.307662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.307663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.307665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.307666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.307667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.307674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.307689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.307693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.307697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.307701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.307706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.307710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.307714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.307719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.307723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.307727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.307731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.307735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.307743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.307751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.307757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.307763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.307768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.307773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.307784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.307789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.307794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.307798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.307803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.307813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.307818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.307823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.307828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.307833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.307838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.307843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.307854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.307859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.307868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.307873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.307878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.307884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.307889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.307894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.307934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:11.310561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:11.311188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:11.311213Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:11.311216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:11.311219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:11.311226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 881 [2:7559601106348153344:6073]
2025-10-10T14:33:11.311240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:11.311259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:11.311267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.311271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.311274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.311291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:11.311304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:11.311313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:11.311379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.311386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.311388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.311391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:11.311458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:11.311469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.311481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.311492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.311510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:11.311532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365339:2438], now have 1 active actors on pipe
2025-10-10T14:33:11.311541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365521:7628], now have 1 active actors on pipe
2025-10-10T14:33:11.311549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601106348153339:6073]
2025-10-10T14:33:11.311555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601106348153339:6073]
2025-10-10T14:33:11.311556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601106348153339:6073]
2025-10-10T14:33:11.311567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:11.311581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:11.311583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:11.311595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:11.311595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:11.311597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:11.311597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:11.311621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601106348153339:6073]
2025-10-10T14:33:11.311623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:11.311633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:11.311639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 881
2025-10-10T14:33:11.311659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 881
2025-10-10T14:33:11.311768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.311784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.311814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:11.311826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.311830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.311832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:11.311844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.311859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:11.311873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.312064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.312071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.312082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.312169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 882 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0
2025-10-10T14:33:11.312573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ac7169b-d6f0fdf3-892b34f-23563e2a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:11.315355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0] Write session: try to update token
2025-10-10T14:33:11.315373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:11.329159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId: src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:11.330741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:11.330760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:11.330763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:11.330765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:11.330772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601106348153339:6073]
2025-10-10T14:33:11.330775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601106348153339:6073]
2025-10-10T14:33:11.330778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601106348153339:6073]
2025-10-10T14:33:11.330828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:11.330828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:11.330833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.330834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:11.330835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:11.330837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:11.330967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:11.331658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:11.387326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601107130365554:7150]
2025-10-10T14:33:11.387580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 881, pipe: [1:7559601107130365554:7150]
2025-10-10T14:33:11.435419Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:11.435892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.435910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.435956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365554:7150], now have 1 active actors on pipe
2025-10-10T14:33:11.436154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:11.436256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:11.436253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601107130365554:7150]
2025-10-10T14:33:11.436287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:11.436359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 882 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0
2025-10-10T14:33:11.436585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 882 sessionId: src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0 is DEAD
2025-10-10T14:33:11.436741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:11.436751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0] Write session will restart in 0.008952s
2025-10-10T14:33:11.436776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0] Write session: Do CDS request
2025-10-10T14:33:11.436800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:11.446985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.447237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:11.447260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 883
2025-10-10T14:33:11.447399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.447435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:11.447445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:11.447449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:11.448047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 883 sessionId:  describe result for acl check
2025-10-10T14:33:11.448090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:11.448091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:11.448093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:11.448102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601107130365644:7632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:11.448689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601107130365644:7632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:11.451239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601107130365644:7632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:11.452362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:11.454995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:11.455243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:11.455254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:11.455268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:11.455242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601107130365644:7632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:11.455265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601107130365644:7632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:11.455268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601107130365644:7632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:11.455276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:11.455318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:11.455356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601106348153556:6075]
2025-10-10T14:33:11.455849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:11.456192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:11.456234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:11.456449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:11.456488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.456493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.456494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.456495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.456495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.456496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.456497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.456497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.456498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.456499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.456500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.456500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.456501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.456505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.456514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.456516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.456519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.456521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.456524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.456526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.456528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.456530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.456533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.456535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.456539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.456543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.456551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.456560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.456566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.456572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.456575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.456578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.456581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.456584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.456587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.456592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.456599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.456608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.456612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.456620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.456624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.456633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.456642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.456649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.456658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.456667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.456672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.456677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.456681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.456691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.456701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.456710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.456734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:11.459226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:11.459864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:11.459878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:11.459880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:11.459883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:11.459891Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 882 [2:7559601106348153556:6075]
2025-10-10T14:33:11.459905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:11.459932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:11.459940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.459944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.459947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.459965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:11.459979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:11.459991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:11.460040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.460046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.460047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.460049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:11.460117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:11.460125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.460139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.460153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.460173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:11.460201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365761:7632], now have 1 active actors on pipe
2025-10-10T14:33:11.460214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601106348153551:6075]
2025-10-10T14:33:11.460220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601106348153551:6075]
2025-10-10T14:33:11.460222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601106348153551:6075]
2025-10-10T14:33:11.460237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:11.460250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365556:2438], now have 1 active actors on pipe
2025-10-10T14:33:11.460264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:11.460266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:11.460270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:11.460272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:11.460285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:11.460279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 882
2025-10-10T14:33:11.460294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:11.460286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 882
2025-10-10T14:33:11.460328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601106348153551:6075]
2025-10-10T14:33:11.460340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:11.460349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:11.460362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.460371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.460430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac48023d-36f260ee-ef4b46a-328edc08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:11.460444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.460449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.460451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:11.460463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.460478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:11.460503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.460649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.460657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.460672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.460747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 883 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac48023d-36f260ee-ef4b46a-328edc08_0
2025-10-10T14:33:11.461149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f511d70-f5d8c43e-ba8d13-c1e5eb3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac48023d-36f260ee-ef4b46a-328edc08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:11.463907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac48023d-36f260ee-ef4b46a-328edc08_0] Write session: try to update token
2025-10-10T14:33:11.463926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac48023d-36f260ee-ef4b46a-328edc08_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:11.478395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId: src_id|ac48023d-36f260ee-ef4b46a-328edc08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:11.479913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:11.479937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:11.479941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:11.479943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:11.479952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601106348153551:6075]
2025-10-10T14:33:11.479956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601106348153551:6075]
2025-10-10T14:33:11.479960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601106348153551:6075]
2025-10-10T14:33:11.480005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:11.480009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:11.480016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.480018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:11.480021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:11.480025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:11.480156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:11.481014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:11.536324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601107130365773:7150]
2025-10-10T14:33:11.536649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 882, pipe: [1:7559601107130365773:7150]
2025-10-10T14:33:11.589893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:11.590102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.590117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.590162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365773:7150], now have 1 active actors on pipe
2025-10-10T14:33:11.590314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:11.590352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:11.590353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:11.590357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:11.590426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 883 reason: error at write: Disconnected sessionId: src_id|ac48023d-36f260ee-ef4b46a-328edc08_0
2025-10-10T14:33:11.590431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601107130365773:7150]
2025-10-10T14:33:11.590598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 883 sessionId: src_id|ac48023d-36f260ee-ef4b46a-328edc08_0 is DEAD
2025-10-10T14:33:11.590735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac48023d-36f260ee-ef4b46a-328edc08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:11.590745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac48023d-36f260ee-ef4b46a-328edc08_0] Write session will restart in 0.008197s
2025-10-10T14:33:11.590764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac48023d-36f260ee-ef4b46a-328edc08_0] Write session: Do CDS request
2025-10-10T14:33:11.590771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac48023d-36f260ee-ef4b46a-328edc08_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:11.599810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac48023d-36f260ee-ef4b46a-328edc08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.599924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:11.599939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 884
2025-10-10T14:33:11.600047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.600083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:11.600091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:11.600094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:11.600482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 884 sessionId:  describe result for acl check
2025-10-10T14:33:11.600523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:11.600525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:11.600527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:11.600533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601107130365850:7638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:11.601082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601107130365850:7638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:11.603374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601107130365850:7638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:11.605596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:11.607835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601107130365850:7638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:11.607849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601107130365850:7638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:11.607852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601107130365850:7638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:11.607859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:11.607873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:11.608074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:11.608088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:11.608101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:11.608157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:11.608199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601106348153770:6077]
2025-10-10T14:33:11.608792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:11.609058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:11.609101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:11.609390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:11.609430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.609435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.609436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.609436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.609437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.609438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.609439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.609439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.609440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.609441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.609441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.609442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.609443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.609447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.609456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.609458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.609461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.609464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.609468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.609471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.609475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.609478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.609482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.609485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.609489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.609493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.609500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.609506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.609511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.609515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.609522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.609525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.609528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.609531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.609534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.609537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.609540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.609543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.609550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.609553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.609556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.609559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.609563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.609566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.609569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.609572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.609574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.609577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.609580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.609583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.609590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.609593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.609614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:11.611890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:11.612214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:11.612227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:11.612230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:11.612234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:11.612240Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 883 [2:7559601106348153770:6077]
2025-10-10T14:33:11.612251Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:11.612269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:11.612277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.612281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.612284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.612301Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:11.612312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:11.612324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:11.612382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.612389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.612392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.612395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:11.612461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:11.612468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.612480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.612495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.612517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:11.612544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365783:2438], now have 1 active actors on pipe
2025-10-10T14:33:11.612553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130365988:7638], now have 1 active actors on pipe
2025-10-10T14:33:11.612560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601106348153764:6077]
2025-10-10T14:33:11.612567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601106348153764:6077]
2025-10-10T14:33:11.612570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601106348153764:6077]
2025-10-10T14:33:11.612566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 883
2025-10-10T14:33:11.612576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 883
2025-10-10T14:33:11.612583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:11.612599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:11.612603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:11.612605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:11.612606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:11.612623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:11.612626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:11.612663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.612673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.612687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601106348153764:6077]
2025-10-10T14:33:11.612699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:11.612720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:11.612735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:11.612742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.612751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.612758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:11.612768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.612784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:11.612809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.612957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.612968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.612984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.613066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 884 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0
2025-10-10T14:33:11.613456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac48023d-36f260ee-ef4b46a-328edc08_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:11.616079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0] Write session: try to update token
2025-10-10T14:33:11.616095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:11.629994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId: src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:11.632113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:11.632139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:11.632142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:11.632144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:11.632154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601106348153764:6077]
2025-10-10T14:33:11.632159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601106348153764:6077]
2025-10-10T14:33:11.632163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601106348153764:6077]
2025-10-10T14:33:11.632216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:11.632216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:11.632222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:11.632229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:11.632229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.632232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:11.632368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:11.632660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:11.690444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601107130366003:7150]
2025-10-10T14:33:11.690799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 883, pipe: [1:7559601107130366003:7150]
2025-10-10T14:33:11.736464Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:11.736986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.737003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.737043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130366003:7150], now have 1 active actors on pipe
2025-10-10T14:33:11.737213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:11.737279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:11.737327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601107130366003:7150]
2025-10-10T14:33:11.737353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:11.737442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 884 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0
2025-10-10T14:33:11.737675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 884 sessionId: src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0 is DEAD
2025-10-10T14:33:11.737833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:11.737842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0] Write session will restart in 0.009321s
2025-10-10T14:33:11.737862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0] Write session: Do CDS request
2025-10-10T14:33:11.737866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:11.747878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.747951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:11.747968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 885
2025-10-10T14:33:11.748119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.748149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:11.748157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:11.748160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:11.748576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 885 sessionId:  describe result for acl check
2025-10-10T14:33:11.748606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:11.748609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:11.748610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:11.748614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601107130366079:7642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:11.749165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601107130366079:7642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:11.751492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601107130366079:7642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:11.753005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:11.755084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:11.755292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:11.755304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:11.755316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:11.755325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601107130366079:7642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:11.755342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601107130366079:7642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:11.755345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601107130366079:7642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:11.755354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:11.755366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:11.755409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601106348153986:6080]
2025-10-10T14:33:11.755793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:11.756038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:11.756071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:11.756334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:11.756380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.756385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.756386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.756387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.756387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.756388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.756389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.756390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.756390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.756391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.756392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.756393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.756393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.756397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.756405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.756407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.756410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.756412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.756414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.756416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.756418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.756420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.756423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.756425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.756427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.756429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.756434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.756440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.756445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.756449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.756452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.756455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.756458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.756461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.756464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.756467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.756471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.756474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.756477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.756480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.756482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.756486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.756488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.756491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.756494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.756497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.756499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.756502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.756505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.756508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.756510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.756514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.756536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:11.758713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:11.759338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:11.759354Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:11.759357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:11.759362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:11.759368Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 884 [2:7559601106348153986:6080]
2025-10-10T14:33:11.759381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:11.759398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:11.759409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.759412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.759415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.759431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:11.759444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:11.759457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:11.759517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.759524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.759526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.759529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:11.759595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:11.759603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.759614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.759631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.759654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:11.759681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130366004:2438], now have 1 active actors on pipe
2025-10-10T14:33:11.759690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130366210:7642], now have 1 active actors on pipe
2025-10-10T14:33:11.759699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601106348153981:6080]
2025-10-10T14:33:11.759701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601106348153981:6080]
2025-10-10T14:33:11.759703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601106348153981:6080]
2025-10-10T14:33:11.759719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:11.759727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 884
2025-10-10T14:33:11.759730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 884
2025-10-10T14:33:11.759738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:11.759740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:11.759752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:11.759755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:11.759757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:11.759761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:11.759789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601106348153981:6080]
2025-10-10T14:33:11.759797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:11.759802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:11.759816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.759821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.759873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65c1662c-60e08f58-aff84db-7368776a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:11.759890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.759899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.759901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:11.759913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.759925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:11.759952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.760062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.760071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.760088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.760183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 885 partition: 0 MaxSeqNo: 40 sessionId: src_id|65c1662c-60e08f58-aff84db-7368776a_0
2025-10-10T14:33:11.760527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62708f-c1accb9c-c772221a-ea2729ba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65c1662c-60e08f58-aff84db-7368776a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:11.763023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c1662c-60e08f58-aff84db-7368776a_0] Write session: try to update token
2025-10-10T14:33:11.763039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c1662c-60e08f58-aff84db-7368776a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:11.776433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId: src_id|65c1662c-60e08f58-aff84db-7368776a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:11.777716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:11.777737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:11.777739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:11.777740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:11.777747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601106348153981:6080]
2025-10-10T14:33:11.777750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601106348153981:6080]
2025-10-10T14:33:11.777753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601106348153981:6080]
2025-10-10T14:33:11.777792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:11.777801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:11.777804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.777805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:11.777807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:11.777811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:11.777941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:11.779004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:11.837404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601107130366222:7150]
2025-10-10T14:33:11.837710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 884, pipe: [1:7559601107130366222:7150]
2025-10-10T14:33:11.883434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:11.883793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.883807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.883845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130366222:7150], now have 1 active actors on pipe
2025-10-10T14:33:11.884078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:11.884058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:11.884084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601107130366222:7150]
2025-10-10T14:33:11.884110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:11.884112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:11.884170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 885 reason: error at write: Disconnected sessionId: src_id|65c1662c-60e08f58-aff84db-7368776a_0
2025-10-10T14:33:11.884358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 885 sessionId: src_id|65c1662c-60e08f58-aff84db-7368776a_0 is DEAD
2025-10-10T14:33:11.884535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c1662c-60e08f58-aff84db-7368776a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:11.884545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c1662c-60e08f58-aff84db-7368776a_0] Write session will restart in 0.009884s
2025-10-10T14:33:11.884563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c1662c-60e08f58-aff84db-7368776a_0] Write session: Do CDS request
2025-10-10T14:33:11.884568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c1662c-60e08f58-aff84db-7368776a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:11.895849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c1662c-60e08f58-aff84db-7368776a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.895886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:11.895905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 886
2025-10-10T14:33:11.896061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:11.896103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:11.896110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:11.896114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:11.896455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 886 sessionId:  describe result for acl check
2025-10-10T14:33:11.896481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:11.896486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:11.896487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:11.896491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601107130366392:7646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:11.896922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601107130366392:7646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:11.898177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:11.898612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601107130366392:7646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:11.900329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:11.900501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:11.900514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:11.900525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:11.900572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:11.900609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601106348154202:6082]
2025-10-10T14:33:11.900859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601107130366392:7646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:11.900870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601107130366392:7646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:11.900873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601107130366392:7646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:11.900879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:11.901222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:11.901534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:11.901584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:11.901896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:11.901950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.901956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.901957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.901959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.901960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.901961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.901962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.901963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.901964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.901966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.901967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.901968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.901969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.901974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.901987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.901991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.901999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.902003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.902007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.902012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.902016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.902020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.902024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.902028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.902032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.902036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.902043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.902056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:11.902067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.902073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:11.902078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.902088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:11.902097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.902106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:11.902115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.902125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:11.902134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.902143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:11.902148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.902154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:11.902158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.902168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:11.902177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.902183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:11.902191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.902197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:11.902201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.902211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.902220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.902229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.902238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.902247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.902293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:11.904529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:11.904855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:11.904871Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:11.904873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:11.904878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:11.904888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 885 [2:7559601106348154202:6082]
2025-10-10T14:33:11.904903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:11.904924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:11.904931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.904935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.904942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.904958Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:11.904973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:11.904981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:11.905038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.905046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.905048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.905051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:11.905119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:11.905127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.905139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:11.905154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:11.905178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:11.905204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130366223:2438], now have 1 active actors on pipe
2025-10-10T14:33:11.905213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130366430:7646], now have 1 active actors on pipe
2025-10-10T14:33:11.905221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601106348154197:6082]
2025-10-10T14:33:11.905228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601106348154197:6082]
2025-10-10T14:33:11.905231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601106348154197:6082]
2025-10-10T14:33:11.905244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:11.905263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:11.905268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:11.905273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:11.905275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:11.905253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 885
2025-10-10T14:33:11.905274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 885
2025-10-10T14:33:11.905284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:11.905291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:11.905313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601106348154197:6082]
2025-10-10T14:33:11.905321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:11.905323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:11.905368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.905377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.905416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|645da446-eea0a2a8-75f8f843-64f524e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:11.905429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:11.905437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:11.905440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:11.905451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:11.905462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:11.905490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.905703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:11.905713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:11.905729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:11.905801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 886 partition: 0 MaxSeqNo: 40 sessionId: src_id|645da446-eea0a2a8-75f8f843-64f524e9_0
2025-10-10T14:33:11.906248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c1662c-60e08f58-aff84db-7368776a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|645da446-eea0a2a8-75f8f843-64f524e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:11.908849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|645da446-eea0a2a8-75f8f843-64f524e9_0] Write session: try to update token
2025-10-10T14:33:11.908866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|645da446-eea0a2a8-75f8f843-64f524e9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:11.923219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId: src_id|645da446-eea0a2a8-75f8f843-64f524e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:11.924530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:11.924553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:11.924556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:11.924558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:11.924568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601106348154197:6082]
2025-10-10T14:33:11.924572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601106348154197:6082]
2025-10-10T14:33:11.924579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601106348154197:6082]
2025-10-10T14:33:11.924627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:11.924628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:11.924634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:11.924638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:11.924640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:11.924642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:11.924778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:11.925762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:11.984325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601107130366442:7150]
2025-10-10T14:33:11.984581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 885, pipe: [1:7559601107130366442:7150]
2025-10-10T14:33:12.030636Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:12.031237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.031257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.031303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601107130366442:7150], now have 1 active actors on pipe
2025-10-10T14:33:12.031484Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:12.031528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601107130366442:7150]
2025-10-10T14:33:12.031538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:12.031579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:12.031650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 886 reason: status is not ok: tablet will be restarted right now sessionId: src_id|645da446-eea0a2a8-75f8f843-64f524e9_0
2025-10-10T14:33:12.031846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 886 sessionId: src_id|645da446-eea0a2a8-75f8f843-64f524e9_0 is DEAD
2025-10-10T14:33:12.032011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645da446-eea0a2a8-75f8f843-64f524e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:12.032023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645da446-eea0a2a8-75f8f843-64f524e9_0] Write session will restart in 0.006705s
2025-10-10T14:33:12.032060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645da446-eea0a2a8-75f8f843-64f524e9_0] Write session: Do CDS request
2025-10-10T14:33:12.032066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645da446-eea0a2a8-75f8f843-64f524e9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:12.039913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|645da446-eea0a2a8-75f8f843-64f524e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.039997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:12.040020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 887
2025-10-10T14:33:12.040170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.040206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:12.040216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:12.040219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:12.040740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 887 sessionId:  describe result for acl check
2025-10-10T14:33:12.040779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:12.040786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:12.040788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:12.040794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601111425333794:7650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:12.041367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601111425333794:7650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:12.043966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601111425333794:7650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:12.045753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:12.047753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:12.047933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:12.047945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:12.047957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:12.047961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601111425333794:7650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:12.047976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601111425333794:7650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:12.047980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601111425333794:7650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:12.047989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:12.048007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:12.048046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601110643121715:6084]
2025-10-10T14:33:12.048643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:12.048910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:12.048952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:12.049272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:12.049349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.049356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.049357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.049358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.049359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.049360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.049361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.049362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.049364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.049365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.049366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.049367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.049368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.049374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.049388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.049392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.049396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.049400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.049405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.049409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.049413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.049417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.049421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.049425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.049429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.049432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.049441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.049450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.049456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.049462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.049466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.049471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.049475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.049482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.049486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.049491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.049495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.049505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.049510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.049515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.049524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.049529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.049533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.049543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.049547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.049552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.049556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.049562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.049570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.049575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.049579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.049584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.049628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:12.051886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:12.052436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:12.052453Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:12.052455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:12.052459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:12.052465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 886 [2:7559601110643121715:6084]
2025-10-10T14:33:12.052477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:12.052494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:12.052505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.052508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.052510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.052527Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:12.052538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:12.052545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:12.052612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.052619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.052621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.052624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:12.052687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:12.052694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.052706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.052719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.052739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:12.052766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425333947:7650], now have 1 active actors on pipe
2025-10-10T14:33:12.052774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425333739:2438], now have 1 active actors on pipe
2025-10-10T14:33:12.052781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601110643121710:6084]
2025-10-10T14:33:12.052783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601110643121710:6084]
2025-10-10T14:33:12.052785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601110643121710:6084]
2025-10-10T14:33:12.052799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:12.052816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:12.052817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:12.052821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:12.052823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:12.052835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:12.052843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:12.052865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601110643121710:6084]
2025-10-10T14:33:12.052866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 886
2025-10-10T14:33:12.052872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 886
2025-10-10T14:33:12.052880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:12.052887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:12.052909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.052914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.052947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:12.052961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.052964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.052967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:12.052981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.052991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:12.053013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.053210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.053219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.053237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.053365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 887 partition: 0 MaxSeqNo: 40 sessionId: src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0
2025-10-10T14:33:12.053753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|645da446-eea0a2a8-75f8f843-64f524e9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:12.056374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0] Write session: try to update token
2025-10-10T14:33:12.056391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:12.064397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:12.064413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:12.064424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601110643121710:6084]
2025-10-10T14:33:12.064474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:12.064479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:12.064654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:12.064799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:12.064945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:12.065089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:12.065284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:12.065348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:12.069986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId: src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:12.072576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:12.072771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.072789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.072842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:12.072929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:12.082493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:12.082510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:12.082513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:12.082514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:12.082526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601110643121710:6084]
2025-10-10T14:33:12.082530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601110643121710:6084]
2025-10-10T14:33:12.082533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601110643121710:6084]
2025-10-10T14:33:12.082579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:12.082580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:12.082587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:12.082591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.082591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:12.082594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:12.082722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:12.131790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601111425333958:7150]
2025-10-10T14:33:12.132035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 886, pipe: [1:7559601111425333958:7150]
2025-10-10T14:33:12.190381Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:12.197523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.197547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.197702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.197760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.197819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.197881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.197935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.197947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.198019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.198075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.198145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.198207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.198260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.198267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.198330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.198384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.198453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.198523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.198572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.198579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.198644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.198704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.198767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.198857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.198907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.198914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.198993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.199064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.199131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.199195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.199237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.199243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.199311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.199374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.199445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.199516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.199567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.199573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.199641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.199701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.199771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.199847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.199897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.199904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.199979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.200048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.200111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.200185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.200229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.200237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.200303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.200360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.200429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.200495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.200538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.200543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.200613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.200672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.200735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.200794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.200835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.200840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.200901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425333958:7150], now have 1 active actors on pipe
2025-10-10T14:33:12.201163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:12.201179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601111425333958:7150]
2025-10-10T14:33:12.201181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:12.201206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:12.201212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 887 reason: error at write: Disconnected sessionId: src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0
2025-10-10T14:33:12.201471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 887 sessionId: src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0 is DEAD
2025-10-10T14:33:12.201573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:12.201582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0] Write session will restart in 0.006060s
2025-10-10T14:33:12.201611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0] Write session: Do CDS request
2025-10-10T14:33:12.201617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:12.201972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:12.208893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.208907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:12.208926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 888
2025-10-10T14:33:12.209123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.209162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:12.209172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:12.209178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:12.209661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 888 sessionId:  describe result for acl check
2025-10-10T14:33:12.209697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:12.209704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:12.209706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:12.209713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601111425333975:7654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:12.210269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601111425333975:7654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:12.213853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601111425333975:7654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:12.217245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601111425333975:7654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:12.217264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601111425333975:7654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:12.217268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601111425333975:7654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:12.217287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:12.219057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:12.221388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:12.221580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:12.221590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:12.221602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:12.221655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:12.221696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601110643121934:6086]
2025-10-10T14:33:12.222310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:12.222571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:12.222610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:12.222926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:12.222982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.222988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.222989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.222990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.222992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.222993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.222994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.222995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.222996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.222997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.222998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.222999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.223000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.223005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.223018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.223022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.223026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.223030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.223034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.223038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.223041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.223044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.223048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.223051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.223054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.223057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.223066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.223074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.223080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.223090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.223095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.223100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.223105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.223114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.223118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.223124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.223133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.223142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.223151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.223160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.223168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.223173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.223182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.223192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.223200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.223205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.223214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.223224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.223229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.223234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.223242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.223251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.223294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:12.225621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:12.226094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:12.226105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:12.226107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:12.226111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:12.226117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 887 [2:7559601110643121934:6086]
2025-10-10T14:33:12.226128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:12.226150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:12.226157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.226161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.226163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.226179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:12.226191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:12.226202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:12.226261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.226268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.226271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.226274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:12.226337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:12.226345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.226358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.226371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.226390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:12.226410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425333960:2438], now have 1 active actors on pipe
2025-10-10T14:33:12.226419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334167:7654], now have 1 active actors on pipe
2025-10-10T14:33:12.226426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601110643121929:6086]
2025-10-10T14:33:12.226433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601110643121929:6086]
2025-10-10T14:33:12.226436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601110643121929:6086]
2025-10-10T14:33:12.226444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:12.226454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:12.226417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 887
2025-10-10T14:33:12.226457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:12.226459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:12.226462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:12.226432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 887
2025-10-10T14:33:12.226478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:12.226482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:12.226499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.226507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.226543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601110643121929:6086]
2025-10-10T14:33:12.226555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:12.226561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:12.226579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd9a011a-a84029b1-2a135109-e6af560f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:12.226591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.226599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.226601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:12.226613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.226628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:12.226667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.226817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.226825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.226840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.226927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 888 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd9a011a-a84029b1-2a135109-e6af560f_0
2025-10-10T14:33:12.227312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93963511-e0ff7bfb-2d15dd8c-68a6243e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd9a011a-a84029b1-2a135109-e6af560f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:12.229930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd9a011a-a84029b1-2a135109-e6af560f_0] Write session: try to update token
2025-10-10T14:33:12.229948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd9a011a-a84029b1-2a135109-e6af560f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:12.243941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId: src_id|bd9a011a-a84029b1-2a135109-e6af560f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:12.245683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:12.245708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:12.245712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:12.245714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:12.245724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601110643121929:6086]
2025-10-10T14:33:12.245728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601110643121929:6086]
2025-10-10T14:33:12.245732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601110643121929:6086]
2025-10-10T14:33:12.245786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:12.245788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:12.245796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.245799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:12.245800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:12.245804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:12.245934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:12.246602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:12.301274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601111425334205:7150]
2025-10-10T14:33:12.301689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 887, pipe: [1:7559601111425334205:7150]
2025-10-10T14:33:12.356669Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:12.357401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.357421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.357473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334205:7150], now have 1 active actors on pipe
2025-10-10T14:33:12.357721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:12.357738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:12.357753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:12.357751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:12.357816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601111425334205:7150]
2025-10-10T14:33:12.357821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 888 reason: error at write: Disconnected sessionId: src_id|bd9a011a-a84029b1-2a135109-e6af560f_0
2025-10-10T14:33:12.358070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 888 sessionId: src_id|bd9a011a-a84029b1-2a135109-e6af560f_0 is DEAD
2025-10-10T14:33:12.358277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd9a011a-a84029b1-2a135109-e6af560f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:12.358289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd9a011a-a84029b1-2a135109-e6af560f_0] Write session will restart in 0.008137s
2025-10-10T14:33:12.358321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd9a011a-a84029b1-2a135109-e6af560f_0] Write session: Do CDS request
2025-10-10T14:33:12.358327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd9a011a-a84029b1-2a135109-e6af560f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:12.367969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd9a011a-a84029b1-2a135109-e6af560f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.368252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:12.368270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 889
2025-10-10T14:33:12.368409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.368445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:12.368455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:12.368459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:12.369518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 889 sessionId:  describe result for acl check
2025-10-10T14:33:12.369553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:12.369558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:12.369559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:12.369564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601111425334256:7668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:12.370037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601111425334256:7668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:12.373237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601111425334256:7668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:12.376271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601111425334256:7668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:12.376286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601111425334256:7668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:12.376289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601111425334256:7668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:12.376297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:12.376509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:12.378962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:12.379190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:12.379202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:12.379214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:12.379264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:12.379305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601110643122202:6102]
2025-10-10T14:33:12.379945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:12.380234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:12.380273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:12.380618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:12.380670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.380676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.380677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.380678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.380679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.380681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.380682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.380683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.380684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.380685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.380686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.380688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.380689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.380694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.380706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.380711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.380715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.380718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.380722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.380726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.380730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.380734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.380738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.380742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.380746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.380750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.380758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.380766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.380773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.380778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.380783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.380788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.380792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.380797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.380801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.380807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.380811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.380816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.380820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.380825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.380834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.380839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.380844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.380849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.380858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.380863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.380867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.380872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.380880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.380885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.380890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.380896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.380939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:12.383801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:12.384278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:12.384289Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:12.384291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:12.384295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:12.384301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 888 [2:7559601110643122202:6102]
2025-10-10T14:33:12.384313Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:12.384330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:12.384335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.384339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.384341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.384357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:12.384366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:12.384374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:12.384435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.384444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.384445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.384448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:12.384512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:12.384520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.384531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.384547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.384565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:12.384590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334219:2438], now have 1 active actors on pipe
2025-10-10T14:33:12.384598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334428:7668], now have 1 active actors on pipe
2025-10-10T14:33:12.384605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601110643122196:6102]
2025-10-10T14:33:12.384612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601110643122196:6102]
2025-10-10T14:33:12.384615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601110643122196:6102]
2025-10-10T14:33:12.384627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:12.384643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:12.384651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:12.384658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:12.384660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:12.384662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:12.384661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:12.384670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 888
2025-10-10T14:33:12.384696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601110643122196:6102]
2025-10-10T14:33:12.384707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:12.384671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 888
2025-10-10T14:33:12.384709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:12.384733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.384738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.384773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec55194a-82004673-6976e7bc-447dbd15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:12.384786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.384789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.384791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:12.384802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.384816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:12.384836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.384979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.384988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.385003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.385088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 889 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec55194a-82004673-6976e7bc-447dbd15_0
2025-10-10T14:33:12.385472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd9a011a-a84029b1-2a135109-e6af560f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec55194a-82004673-6976e7bc-447dbd15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:12.388053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec55194a-82004673-6976e7bc-447dbd15_0] Write session: try to update token
2025-10-10T14:33:12.388076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec55194a-82004673-6976e7bc-447dbd15_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:12.402836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId: src_id|ec55194a-82004673-6976e7bc-447dbd15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:12.405354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:12.405691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.405711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.405761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:12.405876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:12.408424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:12.408441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:12.408444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:12.408447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:12.408456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601110643122196:6102]
2025-10-10T14:33:12.408460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601110643122196:6102]
2025-10-10T14:33:12.408464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601110643122196:6102]
2025-10-10T14:33:12.408511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:12.408513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:12.408522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:12.408525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:12.408526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.408528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:12.408656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:12.457936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601111425334440:7150]
2025-10-10T14:33:12.458263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 888, pipe: [1:7559601111425334440:7150]
2025-10-10T14:33:12.518912Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:12.527112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.527139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.527330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.527392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.527462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.527525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.527576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.527586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.527657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.527719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.527784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.527854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.527900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.527905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.527974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.528036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.528109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.528174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.528217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.528225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.528294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.528358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.528423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.528489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.528531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.528538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.528606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.528668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.528736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.528802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.528847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.528854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.528922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.528984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.529050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.529118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.529161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.529169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.529346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.529411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.529479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.529543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.529589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.529597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.529660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.529720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.529782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.529844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.529894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.529901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.530006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.530104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.530167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.530233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.530277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.530284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.530351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.530413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.530478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.530543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.530586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.530593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.530655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334440:7150], now have 1 active actors on pipe
2025-10-10T14:33:12.530965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:12.530973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601111425334440:7150]
2025-10-10T14:33:12.530983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:12.531009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:12.531015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 889 reason: error at write: Disconnected sessionId: src_id|ec55194a-82004673-6976e7bc-447dbd15_0
2025-10-10T14:33:12.531252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 889 sessionId: src_id|ec55194a-82004673-6976e7bc-447dbd15_0 is DEAD
2025-10-10T14:33:12.531378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec55194a-82004673-6976e7bc-447dbd15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:12.531390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec55194a-82004673-6976e7bc-447dbd15_0] Write session will restart in 0.007975s
2025-10-10T14:33:12.531414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec55194a-82004673-6976e7bc-447dbd15_0] Write session: Do CDS request
2025-10-10T14:33:12.531420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec55194a-82004673-6976e7bc-447dbd15_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:12.531758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:12.540880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec55194a-82004673-6976e7bc-447dbd15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.541087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:12.541109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 890
2025-10-10T14:33:12.541281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.541344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:12.541355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:12.541359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:12.541855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 890 sessionId:  describe result for acl check
2025-10-10T14:33:12.541909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:12.541916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:12.541919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:12.541927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601111425334497:7672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:12.542510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601111425334497:7672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:12.546031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601111425334497:7672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:12.548078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:12.550609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:12.550816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601111425334497:7672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:12.550833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601111425334497:7672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:12.550837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601111425334497:7672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:12.550849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:12.550846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:12.550862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:12.550874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:12.550935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:12.550993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601110643122420:6104]
2025-10-10T14:33:12.551595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:12.551909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:12.551959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:12.552251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:12.552303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.552309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.552310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.552311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.552312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.552313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.552314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.552315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.552316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.552318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.552319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.552320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.552321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.552326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.552339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.552343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.552346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.552350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.552355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.552359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.552363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.552366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.552371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.552375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.552379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.552382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.552388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.552393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.552398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.552401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.552404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.552407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.552410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.552413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.552416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.552421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.552426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.552430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.552434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.552439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.552443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.552448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.552452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.552457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.552468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.552473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.552477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.552482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.552486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.552491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.552501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.552506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.552545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:12.555157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:12.555514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:12.555527Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:12.555530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:12.555534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:12.555543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 889 [2:7559601110643122420:6104]
2025-10-10T14:33:12.555555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:12.555573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:12.555576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.555580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.555582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.555600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:12.555612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:12.555626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:12.555685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.555694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.555695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.555698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:12.555763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:12.555770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.555782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.555798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.555820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:12.555847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334654:7672], now have 1 active actors on pipe
2025-10-10T14:33:12.555855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334442:2438], now have 1 active actors on pipe
2025-10-10T14:33:12.555863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601110643122415:6104]
2025-10-10T14:33:12.555869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601110643122415:6104]
2025-10-10T14:33:12.555871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601110643122415:6104]
2025-10-10T14:33:12.555885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:12.555903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:12.555908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:12.555911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:12.555914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:12.555922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:12.555929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:12.555899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 889
2025-10-10T14:33:12.555900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 889
2025-10-10T14:33:12.555965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.555977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.555991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601110643122415:6104]
2025-10-10T14:33:12.555999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:12.556003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:12.556031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|579fca1b-c3597a47-5e37e900-602ede5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:12.556043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.556051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.556054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:12.556064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.556078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:12.556104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.556240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.556247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.556262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.556373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 890 partition: 0 MaxSeqNo: 40 sessionId: src_id|579fca1b-c3597a47-5e37e900-602ede5a_0
2025-10-10T14:33:12.556774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec55194a-82004673-6976e7bc-447dbd15_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|579fca1b-c3597a47-5e37e900-602ede5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:12.559458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|579fca1b-c3597a47-5e37e900-602ede5a_0] Write session: try to update token
2025-10-10T14:33:12.559478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|579fca1b-c3597a47-5e37e900-602ede5a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:12.573019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId: src_id|579fca1b-c3597a47-5e37e900-602ede5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:12.575565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:12.575762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.575782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.575826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:12.575906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:12.579082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:12.579099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:12.579102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:12.579104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:12.579114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601110643122415:6104]
2025-10-10T14:33:12.579119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601110643122415:6104]
2025-10-10T14:33:12.579122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601110643122415:6104]
2025-10-10T14:33:12.579162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:12.579166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:12.579173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:12.579173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.579175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:12.579175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:12.579303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:12.630983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601111425334672:7150]
2025-10-10T14:33:12.631293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 889, pipe: [1:7559601111425334672:7150]
2025-10-10T14:33:12.688869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:12.696218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.696246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.696406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.696461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.696519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.696576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.696622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.696630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.696690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.696745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.696803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.696863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.696909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.696918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.696987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.697057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.697125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.697197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.697247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.697257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.697323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.697401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.697456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.697515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.697559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.697567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.697638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.697691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.697747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.697800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.697846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.697855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.697914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.697974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.698029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.698086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.698130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.698135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.698194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.698246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.698302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.698366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.698406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.698411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.698468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.698523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.698581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.698646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.698687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.698692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.698752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.698816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.698878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.698936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.698978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.698986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.699045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.699106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.699165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.699223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.699264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.699269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.699327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334672:7150], now have 1 active actors on pipe
2025-10-10T14:33:12.699543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:12.699560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:12.699599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 890 reason: error at write: Disconnected sessionId: src_id|579fca1b-c3597a47-5e37e900-602ede5a_0
2025-10-10T14:33:12.699723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601111425334672:7150]
2025-10-10T14:33:12.699758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:12.699838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 890 sessionId: src_id|579fca1b-c3597a47-5e37e900-602ede5a_0 is DEAD
2025-10-10T14:33:12.699996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579fca1b-c3597a47-5e37e900-602ede5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:12.700005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579fca1b-c3597a47-5e37e900-602ede5a_0] Write session will restart in 0.007784s
2025-10-10T14:33:12.700025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579fca1b-c3597a47-5e37e900-602ede5a_0] Write session: Do CDS request
2025-10-10T14:33:12.700030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579fca1b-c3597a47-5e37e900-602ede5a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:12.700141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:12.708916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|579fca1b-c3597a47-5e37e900-602ede5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.709024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:12.709044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 891
2025-10-10T14:33:12.709210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.709269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:12.709280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:12.709285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:12.709773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 891 sessionId:  describe result for acl check
2025-10-10T14:33:12.709813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:12.709818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:12.709820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:12.709827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601111425334715:7678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:12.710382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601111425334715:7678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:12.713671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601111425334715:7678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:12.716078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601111425334715:7678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:12.716097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601111425334715:7678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:12.716101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601111425334715:7678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:12.716108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:12.716661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:12.718991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:12.719215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:12.719227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:12.719238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:12.719290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:12.719332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601110643122643:6107]
2025-10-10T14:33:12.719962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:12.720291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:12.720342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:12.720684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:12.720740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.720745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.720747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.720748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.720749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.720750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.720752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.720753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.720754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.720755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.720756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.720758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.720759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.720766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.720780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.720785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.720789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.720793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.720798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.720802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.720806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.720810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.720814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.720818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.720827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.720831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.720839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.720847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.720854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.720860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.720865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.720870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.720879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.720889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.720893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.720898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.720902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.720907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.720913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.720932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.720936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.720941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.720946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.720952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.720956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.720961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.720965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.720971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.720975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.720981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.720986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.720991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.721032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:12.723694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:12.724036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:12.724046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:12.724049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:12.724053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:12.724059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 890 [2:7559601110643122643:6107]
2025-10-10T14:33:12.724076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:12.724100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:12.724107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.724111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.724113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.724132Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:12.724143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:12.724156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:12.724221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.724227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.724229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.724231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:12.724302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:12.724311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.724323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.724336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.724351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:12.724381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334889:7678], now have 1 active actors on pipe
2025-10-10T14:33:12.724389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334677:2438], now have 1 active actors on pipe
2025-10-10T14:33:12.724397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601110643122638:6107]
2025-10-10T14:33:12.724400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601110643122638:6107]
2025-10-10T14:33:12.724403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601110643122638:6107]
2025-10-10T14:33:12.724416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:12.724433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:12.724434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:12.724441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:12.724445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:12.724450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:12.724454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:12.724478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601110643122638:6107]
2025-10-10T14:33:12.724485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:12.724492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:12.724466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 890
2025-10-10T14:33:12.724467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 890
2025-10-10T14:33:12.724517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.724528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.724574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:12.724586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.724594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.724597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:12.724609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.724620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:12.724641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.724799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.724808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.724825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.724912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 891 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0
2025-10-10T14:33:12.725279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|579fca1b-c3597a47-5e37e900-602ede5a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:12.727984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0] Write session: try to update token
2025-10-10T14:33:12.728019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:12.741420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId: src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:12.743933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:12.744151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.744175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.744220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:12.744314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:12.747787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:12.747802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:12.747805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:12.747806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:12.747814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601110643122638:6107]
2025-10-10T14:33:12.747817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601110643122638:6107]
2025-10-10T14:33:12.747820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601110643122638:6107]
2025-10-10T14:33:12.747860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:12.747870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.747872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:12.747875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:12.747880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:12.747882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:12.747999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:12.799953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601111425334901:7150]
2025-10-10T14:33:12.800225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 890, pipe: [1:7559601111425334901:7150]
2025-10-10T14:33:12.853802Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:12.860940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.860965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.861115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.861168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.861236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.861296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.861353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.861361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.861423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.861499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.861569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.861624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.861663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.861671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.861740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.861803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.861866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.861921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.861966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.861975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.862039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.862099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.862156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.862223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.862265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.862270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.862330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.862383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.862439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.862505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.862550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.862555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.862615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.862669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.862738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.862815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.862862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.862869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.862940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.863001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.863058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.863119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.863161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.863166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.863226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.863282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.863338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.863395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.863438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.863444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.863505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.863561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.863619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.863675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.863716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.863723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.863785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:12.863839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:12.863901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:12.863970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:12.864012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:12.864018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:12.864070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334901:7150], now have 1 active actors on pipe
2025-10-10T14:33:12.864405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601111425334901:7150]
2025-10-10T14:33:12.864428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:12.864468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:12.864477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:12.864509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 891 reason: error at write: Disconnected sessionId: src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0
2025-10-10T14:33:12.864723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 891 sessionId: src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0 is DEAD
2025-10-10T14:33:12.864919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:12.864932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0] Write session will restart in 0.007240s
2025-10-10T14:33:12.864959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0] Write session: Do CDS request
2025-10-10T14:33:12.864965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:12.865038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:12.873882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.874006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:12.874023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 892
2025-10-10T14:33:12.874161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:12.874194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:12.874204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:12.874207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:12.874665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 892 sessionId:  describe result for acl check
2025-10-10T14:33:12.874704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:12.874710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:12.874712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:12.874718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601111425334961:7682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:12.875260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601111425334961:7682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:12.878326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601111425334961:7682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:12.880115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:12.882318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:12.882480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601111425334961:7682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:12.882513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:12.882495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601111425334961:7682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:12.882523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:12.882499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601111425334961:7682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:12.882511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:12.882534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:12.882592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:12.882632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601110643122863:6109]
2025-10-10T14:33:12.883251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:12.883526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:12.883567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:12.883886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:12.883942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.883949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.883950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.883951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.883953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.883954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.883955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.883955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.883956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.883957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.883958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.883959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.883960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.883966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.883978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.883982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.883986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.883990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.883994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.883997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.884001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.884005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.884009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.884013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.884016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.884020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.884027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.884035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:12.884046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.884055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:12.884063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.884068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:12.884077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.884083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:12.884090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.884094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:12.884102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.884107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:12.884111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.884116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:12.884120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.884124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:12.884132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.884141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:12.884149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.884154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:12.884162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.884166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.884171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.884176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.884184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.884189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.884228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:12.886609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:12.887090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:12.887105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:12.887108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:12.887111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:12.887118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 891 [2:7559601110643122863:6109]
2025-10-10T14:33:12.887130Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:12.887147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:12.887150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.887153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.887156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.887173Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:12.887185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:12.887197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:12.887255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.887261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.887262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.887265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:12.887326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:12.887334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.887345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:12.887356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:12.887386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:12.887410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425335116:7682], now have 1 active actors on pipe
2025-10-10T14:33:12.887418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425334903:2438], now have 1 active actors on pipe
2025-10-10T14:33:12.887425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601110643122858:6109]
2025-10-10T14:33:12.887431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601110643122858:6109]
2025-10-10T14:33:12.887432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601110643122858:6109]
2025-10-10T14:33:12.887447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:12.887464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:12.887463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:12.887467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:12.887469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:12.887484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:12.887487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:12.887457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 891
2025-10-10T14:33:12.887458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 891
2025-10-10T14:33:12.887508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601110643122858:6109]
2025-10-10T14:33:12.887518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:12.887524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:12.887539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.887548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.887594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe09779e-474151a0-6d8f999f-d2416772_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:12.887605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:12.887613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:12.887616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:12.887626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:12.887640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:12.887660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.887818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:12.887830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:12.887854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:12.887957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 892 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe09779e-474151a0-6d8f999f-d2416772_0
2025-10-10T14:33:12.888326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f2ca71d-5e48dccc-98680436-ad262a0d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe09779e-474151a0-6d8f999f-d2416772_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:12.891180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe09779e-474151a0-6d8f999f-d2416772_0] Write session: try to update token
2025-10-10T14:33:12.891196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe09779e-474151a0-6d8f999f-d2416772_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:12.905903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId: src_id|fe09779e-474151a0-6d8f999f-d2416772_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:12.907952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:12.907976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:12.907979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:12.907982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:12.907991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601110643122858:6109]
2025-10-10T14:33:12.907996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601110643122858:6109]
2025-10-10T14:33:12.908000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601110643122858:6109]
2025-10-10T14:33:12.908055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:12.908055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:12.908062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:12.908068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:12.908068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:12.908071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:12.908222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:12.908728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:12.964819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601111425335127:7150]
2025-10-10T14:33:12.965092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 891, pipe: [1:7559601111425335127:7150]
2025-10-10T14:33:13.015981Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:13.016397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.016411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.016454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601111425335127:7150], now have 1 active actors on pipe
2025-10-10T14:33:13.016618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:13.016682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:13.016686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601111425335127:7150]
2025-10-10T14:33:13.016699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:13.016704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:13.016756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 892 reason: error at write: Disconnected sessionId: src_id|fe09779e-474151a0-6d8f999f-d2416772_0
2025-10-10T14:33:13.016937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 892 sessionId: src_id|fe09779e-474151a0-6d8f999f-d2416772_0 is DEAD
2025-10-10T14:33:13.017086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe09779e-474151a0-6d8f999f-d2416772_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:13.017098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe09779e-474151a0-6d8f999f-d2416772_0] Write session will restart in 0.005646s
2025-10-10T14:33:13.017122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe09779e-474151a0-6d8f999f-d2416772_0] Write session: Do CDS request
2025-10-10T14:33:13.017132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe09779e-474151a0-6d8f999f-d2416772_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:13.023916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe09779e-474151a0-6d8f999f-d2416772_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.024021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:13.024043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 893
2025-10-10T14:33:13.024199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.024251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:13.024259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:13.024262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:13.024698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 893 sessionId:  describe result for acl check
2025-10-10T14:33:13.024740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:13.024746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:13.024748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:13.024755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601115720302440:7686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:13.025359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601115720302440:7686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:13.028433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601115720302440:7686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:13.031969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601115720302440:7686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:13.031988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601115720302440:7686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:13.031992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601115720302440:7686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:13.032001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:13.033283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:13.035875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:13.036072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:13.036081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:13.036090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:13.036128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:13.036163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601114938090383:6111]
2025-10-10T14:33:13.036564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:13.036839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:13.036870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:13.037104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:13.037161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.037166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.037167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.037168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.037169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.037169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.037170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.037171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.037171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.037172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.037173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.037173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.037174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.037179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.037189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.037191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.037194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.037196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.037199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.037201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.037204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.037206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.037209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.037211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.037214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.037216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.037222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.037227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.037232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.037235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.037239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.037243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.037245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.037248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.037251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.037255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.037257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.037261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.037264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.037267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.037270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.037278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.037282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.037289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.037292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.037295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.037298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.037301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.037303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.037306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.037309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.037315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.037354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:13.040624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:13.040946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:13.040963Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:13.040965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:13.040970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:13.040978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 892 [2:7559601114938090383:6111]
2025-10-10T14:33:13.040993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:13.041013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:13.041022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.041026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.041034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.041055Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:13.041068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:13.041077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:13.041147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.041156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.041158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.041161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:13.041232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:13.041239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.041253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.041272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.041296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:13.041346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720302637:7686], now have 1 active actors on pipe
2025-10-10T14:33:13.041351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720302426:2438], now have 1 active actors on pipe
2025-10-10T14:33:13.041359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601114938090378:6111]
2025-10-10T14:33:13.041362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601114938090378:6111]
2025-10-10T14:33:13.041365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601114938090378:6111]
2025-10-10T14:33:13.041379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:13.041396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:13.041419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:13.041418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:13.041423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:13.041427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:13.041428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:13.041429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 892
2025-10-10T14:33:13.041469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601114938090378:6111]
2025-10-10T14:33:13.041437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 892
2025-10-10T14:33:13.041481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:13.041487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:13.041503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.041514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.041578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3217f244-87afb938-e5384c81-7da00a92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:13.041591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.041601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.041603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:13.041616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.041632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:13.041656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.041838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.041846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.041862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.041952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 893 partition: 0 MaxSeqNo: 40 sessionId: src_id|3217f244-87afb938-e5384c81-7da00a92_0
2025-10-10T14:33:13.042378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe09779e-474151a0-6d8f999f-d2416772_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3217f244-87afb938-e5384c81-7da00a92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:13.045215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3217f244-87afb938-e5384c81-7da00a92_0] Write session: try to update token
2025-10-10T14:33:13.045239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3217f244-87afb938-e5384c81-7da00a92_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:13.059618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId: src_id|3217f244-87afb938-e5384c81-7da00a92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:13.062109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:13.063393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.063418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.063444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:13.063452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:13.063455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:13.063458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:13.063468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601114938090378:6111]
2025-10-10T14:33:13.063472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601114938090378:6111]
2025-10-10T14:33:13.063475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601114938090378:6111]
2025-10-10T14:33:13.063522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:13.063532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:13.063535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:13.063535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:13.063542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.063544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:13.063667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:13.116885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601115720302651:7150]
2025-10-10T14:33:13.117168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 892, pipe: [1:7559601115720302651:7150]
2025-10-10T14:33:13.174345Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:13.174894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:13.174954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720302651:7150], now have 1 active actors on pipe
2025-10-10T14:33:13.175058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:13.175120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601115720302651:7150]
2025-10-10T14:33:13.175142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:13.175170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:13.175173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:13.175271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 893 reason: error at write: Disconnected sessionId: src_id|3217f244-87afb938-e5384c81-7da00a92_0
2025-10-10T14:33:13.175425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 893 sessionId: src_id|3217f244-87afb938-e5384c81-7da00a92_0 is DEAD
2025-10-10T14:33:13.175564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3217f244-87afb938-e5384c81-7da00a92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:13.175575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3217f244-87afb938-e5384c81-7da00a92_0] Write session will restart in 0.007323s
2025-10-10T14:33:13.175608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3217f244-87afb938-e5384c81-7da00a92_0] Write session: Do CDS request
2025-10-10T14:33:13.175613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3217f244-87afb938-e5384c81-7da00a92_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:13.183854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3217f244-87afb938-e5384c81-7da00a92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.183970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:13.183992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 894
2025-10-10T14:33:13.184110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.184139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:13.184147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:13.184150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:13.184865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 894 sessionId:  describe result for acl check
2025-10-10T14:33:13.184912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:13.184918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:13.184920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:13.184926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601115720302676:7690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:13.185523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601115720302676:7690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:13.188113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601115720302676:7690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:13.191379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601115720302676:7690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:13.191399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601115720302676:7690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:13.191403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601115720302676:7690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:13.191412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:13.193253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:13.195836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:13.196051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:13.196061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:13.196073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:13.196122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:13.196163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601114938090606:6113]
2025-10-10T14:33:13.196721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:13.196984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:13.197014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:13.197227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:13.197266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.197270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.197271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.197272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.197273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.197274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.197275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.197276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.197277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.197277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.197278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.197279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.197280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.197284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.197293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.197295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.197297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.197300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.197302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.197305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.197307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.197309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.197314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.197317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.197319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.197321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.197327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.197349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.197355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.197358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.197361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.197365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.197367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.197370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.197373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.197376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.197379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.197382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.197385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.197388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.197392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.197395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.197398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.197402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.197404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.197408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.197410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.197413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.197416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.197419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.197422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.197425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.197448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:13.199850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:13.200274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:13.200285Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:13.200287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:13.200291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:13.200298Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 893 [2:7559601114938090606:6113]
2025-10-10T14:33:13.200314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:13.200335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:13.200342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.200346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.200350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.200371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:13.200383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:13.200391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:13.200452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.200458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.200460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.200463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:13.200532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:13.200539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.200551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.200567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.200584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:13.200622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720302653:2438], now have 1 active actors on pipe
2025-10-10T14:33:13.200625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720302861:7690], now have 1 active actors on pipe
2025-10-10T14:33:13.200632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601114938090601:6113]
2025-10-10T14:33:13.200635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601114938090601:6113]
2025-10-10T14:33:13.200637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601114938090601:6113]
2025-10-10T14:33:13.200649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:13.200660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:13.200662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:13.200663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:13.200664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:13.200679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:13.200688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:13.200690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 893
2025-10-10T14:33:13.200721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 893
2025-10-10T14:33:13.200715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601114938090601:6113]
2025-10-10T14:33:13.200724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:13.200730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:13.200752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.200761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.200803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beca2313-2d94c5be-a9efde50-5b04342_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:13.200816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.200820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.200823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:13.201052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.201068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:13.201097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.201242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.201251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.201266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.201363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 894 partition: 0 MaxSeqNo: 40 sessionId: src_id|beca2313-2d94c5be-a9efde50-5b04342_0
2025-10-10T14:33:13.201764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3217f244-87afb938-e5384c81-7da00a92_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|beca2313-2d94c5be-a9efde50-5b04342_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:13.204748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beca2313-2d94c5be-a9efde50-5b04342_0] Write session: try to update token
2025-10-10T14:33:13.204770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beca2313-2d94c5be-a9efde50-5b04342_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:13.219229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId: src_id|beca2313-2d94c5be-a9efde50-5b04342_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:13.220839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:13.220856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:13.220859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:13.220862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:13.220869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601114938090601:6113]
2025-10-10T14:33:13.220873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601114938090601:6113]
2025-10-10T14:33:13.220876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601114938090601:6113]
2025-10-10T14:33:13.220918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:13.220921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:13.220924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.220926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:13.220927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:13.220932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:13.221058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:13.221939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:13.275082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601115720302879:7150]
2025-10-10T14:33:13.275428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 893, pipe: [1:7559601115720302879:7150]
2025-10-10T14:33:13.330748Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:13.331100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.331115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.331161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720302879:7150], now have 1 active actors on pipe
2025-10-10T14:33:13.331351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:13.331448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:13.331500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:13.331592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 894 reason: status is not ok: tablet will be restarted right now sessionId: src_id|beca2313-2d94c5be-a9efde50-5b04342_0
2025-10-10T14:33:13.331799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 894 sessionId: src_id|beca2313-2d94c5be-a9efde50-5b04342_0 is DEAD
2025-10-10T14:33:13.331935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beca2313-2d94c5be-a9efde50-5b04342_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:13.331947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beca2313-2d94c5be-a9efde50-5b04342_0] Write session will restart in 0.007240s
2025-10-10T14:33:13.331970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beca2313-2d94c5be-a9efde50-5b04342_0] Write session: Do CDS request
2025-10-10T14:33:13.331976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beca2313-2d94c5be-a9efde50-5b04342_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:13.331974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601115720302879:7150]
2025-10-10T14:33:13.340930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beca2313-2d94c5be-a9efde50-5b04342_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.341007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:13.341028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 895
2025-10-10T14:33:13.341214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.341261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:13.341273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:13.341277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:13.341749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 895 sessionId:  describe result for acl check
2025-10-10T14:33:13.341782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:13.341784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:13.341787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:13.341792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601115720302944:7701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:13.342349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601115720302944:7701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:13.345583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601115720302944:7701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:13.348716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601115720302944:7701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:13.348733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601115720302944:7701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:13.348736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601115720302944:7701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:13.348744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:13.349493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:13.352326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:13.352539Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:13.352551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:13.352562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:13.352621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:13.352661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601114938090862:6122]
2025-10-10T14:33:13.353354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:13.353836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:13.353895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:13.354229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:13.354279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.354286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.354287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.354288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.354291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.354292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.354293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.354294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.354295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.354296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.354298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.354299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.354300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.354305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.354312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.354315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.354317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.354319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.354322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.354324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.354326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.354328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.354330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.354333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.354335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.354337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.354342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.354348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.354352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.354355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.354358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.354361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.354363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.354366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.354369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.354372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.354374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.354377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.354380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.354383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.354385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.354388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.354391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.354393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.354396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.354399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.354401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.354404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.354406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.354409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.354413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.354416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.354437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:13.356684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:13.357005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:13.357017Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:13.357019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:13.357022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:13.357028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 894 [2:7559601114938090862:6122]
2025-10-10T14:33:13.357038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:13.357065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:13.357072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.357075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.357077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.357094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:13.357106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:13.357113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:13.357166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.357172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.357174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.357176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:13.357236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:13.357243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.357255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.357277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.357299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:13.357325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303119:7701], now have 1 active actors on pipe
2025-10-10T14:33:13.357349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720302906:2438], now have 1 active actors on pipe
2025-10-10T14:33:13.357357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601114938090850:6122]
2025-10-10T14:33:13.357363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601114938090850:6122]
2025-10-10T14:33:13.357364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601114938090850:6122]
2025-10-10T14:33:13.357379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:13.357396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:13.357396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:13.357399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:13.357402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:13.357415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:13.357418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:13.357398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 894
2025-10-10T14:33:13.357441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601114938090850:6122]
2025-10-10T14:33:13.357418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 894
2025-10-10T14:33:13.357448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:13.357451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:13.357469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.357474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.357526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:13.357537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.357542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.357547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:13.357558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.357567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:13.357588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.357791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.357804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.357828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.357922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 895 partition: 0 MaxSeqNo: 40 sessionId: src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0
2025-10-10T14:33:13.358277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beca2313-2d94c5be-a9efde50-5b04342_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:13.360928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0] Write session: try to update token
2025-10-10T14:33:13.360945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:13.375837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId: src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:13.377527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:13.377543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:13.377547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:13.377549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:13.377558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601114938090850:6122]
2025-10-10T14:33:13.377563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601114938090850:6122]
2025-10-10T14:33:13.377567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601114938090850:6122]
2025-10-10T14:33:13.377616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:13.377619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:13.377625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:13.377629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.377631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:13.377632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:13.377771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:13.378569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:13.432277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601115720303144:7150]
2025-10-10T14:33:13.432585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 894, pipe: [1:7559601115720303144:7150]
2025-10-10T14:33:13.487211Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:13.487788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.487802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.487842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303144:7150], now have 1 active actors on pipe
2025-10-10T14:33:13.488052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:13.488084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:13.488110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:13.488145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 895 reason: error at write: Disconnected sessionId: src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0
2025-10-10T14:33:13.488174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:13.488220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601115720303144:7150]
2025-10-10T14:33:13.488348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 895 sessionId: src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0 is DEAD
2025-10-10T14:33:13.488531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:13.488543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0] Write session will restart in 0.006506s
2025-10-10T14:33:13.488566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0] Write session: Do CDS request
2025-10-10T14:33:13.488572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:13.495898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.495966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:13.495985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 896
2025-10-10T14:33:13.496167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.496203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:13.496214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:13.496219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:13.496679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 896 sessionId:  describe result for acl check
2025-10-10T14:33:13.496718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:13.496727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:13.496730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:13.496736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601115720303160:7708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:13.497262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601115720303160:7708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:13.499641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601115720303160:7708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:13.503093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601115720303160:7708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:13.503108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601115720303160:7708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:13.503112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601115720303160:7708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:13.503121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:13.505136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:13.507379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:13.507600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:13.507616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:13.507628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:13.507679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:13.507724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601114938091106:6131]
2025-10-10T14:33:13.508398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:13.508724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:13.508769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:13.509106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:13.509158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.509165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.509166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.509167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.509169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.509170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.509171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.509172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.509174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.509175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.509176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.509178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.509179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.509185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.509200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.509204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.509209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.509213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.509217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.509222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.509226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.509231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.509236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.509241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.509245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.509250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.509258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.509268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.509275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.509286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.509290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.509301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.509306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.509314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.509325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.509349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.509355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.509361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.509366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.509377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.509383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.509393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.509403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.509412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.509421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.509426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.509430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.509435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.509441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.509449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.509454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.509459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.509500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:13.511911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:13.512248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:13.512261Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:13.512263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:13.512267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:13.512273Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 895 [2:7559601114938091106:6131]
2025-10-10T14:33:13.512289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:13.512311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:13.512323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.512326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.512329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.512347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:13.512355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:13.512362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:13.512423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.512432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.512434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.512436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:13.512642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 895
2025-10-10T14:33:13.512643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 895
2025-10-10T14:33:13.512728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:13.512737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.512749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.512762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.512785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:13.512812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303146:2438], now have 1 active actors on pipe
2025-10-10T14:33:13.512820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303352:7708], now have 1 active actors on pipe
2025-10-10T14:33:13.512839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.512848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.512872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601114938091101:6131]
2025-10-10T14:33:13.512878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601114938091101:6131]
2025-10-10T14:33:13.512880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601114938091101:6131]
2025-10-10T14:33:13.512894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:13.512911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:13.512911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:13.512915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:13.512917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:13.512932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:13.512935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:13.512954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:13.512965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.512969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.512976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:13.512987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.513001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:13.513034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601114938091101:6131]
2025-10-10T14:33:13.513046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:13.513054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:13.513057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.513225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.513244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.513260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.513367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 896 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0
2025-10-10T14:33:13.513763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f76ad9e2-9e9f669d-e764bed5-7089f931_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:13.516396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0] Write session: try to update token
2025-10-10T14:33:13.516414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:13.530958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId: src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:13.531126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:13.531146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:13.531158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601114938091101:6131]
2025-10-10T14:33:13.531204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:13.531212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:13.531388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:13.531542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:13.531688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:13.531828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:13.532026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:13.532060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:13.533544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:13.533748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.533764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.533801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:13.533890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:13.543604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:13.543626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:13.543629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:13.543631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:13.543642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601114938091101:6131]
2025-10-10T14:33:13.543646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601114938091101:6131]
2025-10-10T14:33:13.543650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601114938091101:6131]
2025-10-10T14:33:13.543691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:13.543697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.543698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:13.543697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:13.543705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:13.543709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:13.543813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:13.588417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601115720303381:7150]
2025-10-10T14:33:13.588688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 895, pipe: [1:7559601115720303381:7150]
2025-10-10T14:33:13.657994Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:13.665916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.665941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.666116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.666175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.666237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.666311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.666694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.666708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.666793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.666848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.666903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.666963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.667003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.667009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.667070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.667125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.667185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.667243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.667283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.667290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.667350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.667418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.667483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.667547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.667587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.667594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.667654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.667712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.667775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.667835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.667881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.667887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.667952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.668004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.668062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.668119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.668158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.668164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.668223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.668281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.668340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.668394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.668444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.668451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.668512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.668572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.668628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.668683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.668721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.668726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.668789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.668845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.668905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.668964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.669005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.669010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.669068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:13.669120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:13.669177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:13.669234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:13.669276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:13.669281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:13.669325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303381:7150], now have 1 active actors on pipe
2025-10-10T14:33:13.669540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:13.669557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:13.669565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601115720303381:7150]
2025-10-10T14:33:13.669588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:13.669592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 896 reason: error at write: Disconnected sessionId: src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0
2025-10-10T14:33:13.669729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:13.669832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 896 sessionId: src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0 is DEAD
2025-10-10T14:33:13.670001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:13.670023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0] Write session will restart in 0.006393s
2025-10-10T14:33:13.670048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0] Write session: Do CDS request
2025-10-10T14:33:13.670054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:13.677922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.677966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:13.677995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 897
2025-10-10T14:33:13.678162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.678201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:13.678211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:13.678215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:13.678648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 897 sessionId:  describe result for acl check
2025-10-10T14:33:13.678682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:13.678688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:13.678689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:13.678695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601115720303401:7714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:13.679252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601115720303401:7714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:13.682883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601115720303401:7714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:13.685993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601115720303401:7714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:13.686009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601115720303401:7714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:13.686014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601115720303401:7714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:13.686022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:13.687400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:13.689762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:13.689960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:13.689973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:13.689986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:13.690040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:13.690082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601114938091336:6134]
2025-10-10T14:33:13.690778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:13.691054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:13.691101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:13.691434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:13.691506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.691513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.691514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.691515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.691516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.691518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.691519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.691521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.691522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.691524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.691525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.691526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.691527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.691533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.691547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.691551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.691556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.691560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.691565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.691568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.691573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.691578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.691584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.691588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.691592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.691596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.691605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.691614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.691621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.691626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.691631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.691637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.691641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.691647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.691654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.691659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.691664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.691670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.691675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.691681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.691691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.691696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.691701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.691712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.691716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.691722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.691727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.691733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.691742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.691748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.691753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.691758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.691801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:13.694131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:13.694741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:13.694752Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:13.694754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:13.694758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:13.694764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 896 [2:7559601114938091336:6134]
2025-10-10T14:33:13.694776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:13.694792Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:13.694799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.694818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.694820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.694836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:13.694847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:13.694853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:13.694904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.694909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.694911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.694912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:13.694960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:13.694975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.694983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.694993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.695003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:13.695022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303387:2438], now have 1 active actors on pipe
2025-10-10T14:33:13.695028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303602:7714], now have 1 active actors on pipe
2025-10-10T14:33:13.695034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601114938091330:6134]
2025-10-10T14:33:13.695035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601114938091330:6134]
2025-10-10T14:33:13.695037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601114938091330:6134]
2025-10-10T14:33:13.695046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:13.695058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:13.695067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:13.695071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:13.695071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:13.695073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:13.695073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:13.695093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601114938091330:6134]
2025-10-10T14:33:13.695099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:13.695101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:13.695181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 896
2025-10-10T14:33:13.695183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 896
2025-10-10T14:33:13.695240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.695249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.695277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d73b238d-23a6b194-371ef994-94df1bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:13.695291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.695296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.695298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:13.695310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.695321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:13.695336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.695519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.695527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.695543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.695634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 897 partition: 0 MaxSeqNo: 40 sessionId: src_id|d73b238d-23a6b194-371ef994-94df1bc_0
2025-10-10T14:33:13.696011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e816819-db7c75a3-52f342a0-8b9503e6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d73b238d-23a6b194-371ef994-94df1bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:13.698596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b238d-23a6b194-371ef994-94df1bc_0] Write session: try to update token
2025-10-10T14:33:13.698614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b238d-23a6b194-371ef994-94df1bc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:13.712724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId: src_id|d73b238d-23a6b194-371ef994-94df1bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:13.715229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:13.715654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.715674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.715693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:13.715696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:13.715698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:13.715699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:13.715706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601114938091330:6134]
2025-10-10T14:33:13.715709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601114938091330:6134]
2025-10-10T14:33:13.715712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601114938091330:6134]
2025-10-10T14:33:13.715755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:13.715759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:13.715761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:13.715765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:13.715765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.715767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:13.715894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:13.769690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601115720303616:7150]
2025-10-10T14:33:13.769985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 896, pipe: [1:7559601115720303616:7150]
2025-10-10T14:33:13.825383Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:13.825689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:13.825774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303616:7150], now have 1 active actors on pipe
2025-10-10T14:33:13.825879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:13.826011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601115720303616:7150]
2025-10-10T14:33:13.826042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:13.835905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:13.835924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:13.835949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 897 reason: error at write: Disconnected sessionId: src_id|d73b238d-23a6b194-371ef994-94df1bc_0
2025-10-10T14:33:13.836169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 897 sessionId: src_id|d73b238d-23a6b194-371ef994-94df1bc_0 is DEAD
2025-10-10T14:33:13.836319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b238d-23a6b194-371ef994-94df1bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:13.836331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b238d-23a6b194-371ef994-94df1bc_0] Write session will restart in 0.006005s
2025-10-10T14:33:13.836357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b238d-23a6b194-371ef994-94df1bc_0] Write session: Do CDS request
2025-10-10T14:33:13.836363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b238d-23a6b194-371ef994-94df1bc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:13.843924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b238d-23a6b194-371ef994-94df1bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.844314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:13.844334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 898
2025-10-10T14:33:13.844454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.844487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:13.844498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:13.844502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:13.844975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 898 sessionId:  describe result for acl check
2025-10-10T14:33:13.845015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:13.845021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:13.845023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:13.845030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601115720303733:7718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:13.845600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601115720303733:7718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:13.848431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601115720303733:7718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:13.848977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:13.851328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:13.851493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601115720303733:7718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:13.851510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601115720303733:7718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:13.851513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601115720303733:7718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:13.851533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:13.851539Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:13.851553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:13.851564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:13.851616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:13.851808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601114938091562:6136]
2025-10-10T14:33:13.852423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:13.852669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:13.852713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:13.853026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:13.853081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.853087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.853088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.853090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.853091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.853092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.853093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.853094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.853096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.853097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.853098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.853099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.853101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.853106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.853119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.853123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.853128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.853132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.853136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.853140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.853144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.853148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.853152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.853156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.853160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.853164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.853172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.853180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:13.853187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.853203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:13.853208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.853213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:13.853217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.853223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:13.853227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.853233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:13.853240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.853247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:13.853256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.853261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:13.853265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.853270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:13.853275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.853280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:13.853286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.853291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:13.853297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.853303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.853307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.853312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.853316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.853325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.853380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:13.855839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:13.856400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:13.856427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:13.856434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:13.856438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:13.856444Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 897 [2:7559601114938091562:6136]
2025-10-10T14:33:13.856462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:13.856484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:13.856492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.856496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.856499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.856520Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:13.856536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:13.856551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:13.856629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.856638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.856641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.856644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:13.856729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:13.856739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.856753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:13.856764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:13.856781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:13.856804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303837:7718], now have 1 active actors on pipe
2025-10-10T14:33:13.856816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303618:2438], now have 1 active actors on pipe
2025-10-10T14:33:13.856826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601114938091557:6136]
2025-10-10T14:33:13.856829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601114938091557:6136]
2025-10-10T14:33:13.856831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601114938091557:6136]
2025-10-10T14:33:13.856848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:13.856861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:13.856864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:13.856866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:13.856873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:13.856900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:13.856912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:13.856909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 897
2025-10-10T14:33:13.856943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601114938091557:6136]
2025-10-10T14:33:13.856952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:13.856954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:13.857073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 897
2025-10-10T14:33:13.857134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.857148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.857181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:13.857197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:13.857204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:13.857213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:13.857227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:13.857246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:13.857265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.857518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.857531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.857559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:13.857652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 898 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0
2025-10-10T14:33:13.858075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73b238d-23a6b194-371ef994-94df1bc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:13.860696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0] Write session: try to update token
2025-10-10T14:33:13.860712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:13.874321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId: src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:13.875909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:13.875925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:13.875928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:13.875929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:13.875937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601114938091557:6136]
2025-10-10T14:33:13.875941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601114938091557:6136]
2025-10-10T14:33:13.875943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601114938091557:6136]
2025-10-10T14:33:13.875984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:13.875990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:13.875992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:13.875994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:13.876000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:13.876004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:13.876114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:13.876947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:13.926355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601115720303848:7150]
2025-10-10T14:33:13.926643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 897, pipe: [1:7559601115720303848:7150]
2025-10-10T14:33:13.984466Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:13.984809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:13.984824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:13.984869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303848:7150], now have 1 active actors on pipe
2025-10-10T14:33:13.985084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601115720303848:7150]
2025-10-10T14:33:13.985111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:13.985121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:13.985184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 898 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0
2025-10-10T14:33:13.985415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 898 sessionId: src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0 is DEAD
2025-10-10T14:33:13.985596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:13.985607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0] Write session will restart in 0.005085s
2025-10-10T14:33:13.985044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:13.985631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0] Write session: Do CDS request
2025-10-10T14:33:13.985645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:13.991890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.991963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:13.991982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 899
2025-10-10T14:33:13.992142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:13.992179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:13.992189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:13.992194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:13.992640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 899 sessionId:  describe result for acl check
2025-10-10T14:33:13.992675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:13.992682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:13.992684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:13.992690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601115720303863:7722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:13.993254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601115720303863:7722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:13.995728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601115720303863:7722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:14.000012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601115720303863:7722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:14.000029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601115720303863:7722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:14.000032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601115720303863:7722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:14.000041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:14.007758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:14.010309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:14.010696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:14.010720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:14.010735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:14.010799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:14.010843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601119233059088:6138]
2025-10-10T14:33:14.011507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:14.011903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:14.011960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:14.012302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:14.012372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.012379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.012381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.012382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.012384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.012386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.012387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.012389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.012390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.012391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.012393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.012394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.012395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.012402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.012414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.012418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.012421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.012425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.012428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.012431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.012435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.012438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.012442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.012445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.012449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.012453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.012461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.012470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.012477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.012484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.012488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.012493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.012496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.012502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.012509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.012514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.012519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.012523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.012527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.012531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.012535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.012539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.012543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.012547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.012551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.012555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.012559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.012564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.012567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.012572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.012575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.012580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.012615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:14.015260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:14.015821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:14.015835Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:14.015837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:14.015841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:14.015849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 898 [2:7559601119233059088:6138]
2025-10-10T14:33:14.015863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:14.015885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:14.015893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.015897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.015903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.015920Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:14.015932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:14.015941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:14.016013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.016020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.016023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.016026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:14.016094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:14.016101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.016114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.016130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.016151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:14.016178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601115720303850:2438], now have 1 active actors on pipe
2025-10-10T14:33:14.016186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271261:7722], now have 1 active actors on pipe
2025-10-10T14:33:14.016194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601119233059083:6138]
2025-10-10T14:33:14.016200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601119233059083:6138]
2025-10-10T14:33:14.016202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601119233059083:6138]
2025-10-10T14:33:14.016216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:14.016231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:14.016236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:14.016248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:14.016251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:14.016259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:14.016261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:14.016274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601119233059083:6138]
2025-10-10T14:33:14.016276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:14.016278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:14.016272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 898
2025-10-10T14:33:14.016309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 898
2025-10-10T14:33:14.016326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.016336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.016370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f80b64e0-f3836c85-b66b5454-3449f959_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:14.016382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.016390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.016393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:14.016403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.016418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:14.016437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.016602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.016610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.016624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.016714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 899 partition: 0 MaxSeqNo: 40 sessionId: src_id|f80b64e0-f3836c85-b66b5454-3449f959_0
2025-10-10T14:33:14.017148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b0546ec-e86ca44a-9bd12610-390c1aeb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f80b64e0-f3836c85-b66b5454-3449f959_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:14.019909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b64e0-f3836c85-b66b5454-3449f959_0] Write session: try to update token
2025-10-10T14:33:14.019930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b64e0-f3836c85-b66b5454-3449f959_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:14.034599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId: src_id|f80b64e0-f3836c85-b66b5454-3449f959_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:14.035993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:14.036011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:14.036015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:14.036017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:14.036026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601119233059083:6138]
2025-10-10T14:33:14.036030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601119233059083:6138]
2025-10-10T14:33:14.036034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601119233059083:6138]
2025-10-10T14:33:14.036084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:14.036095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.036096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:14.036100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:14.036104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:14.036107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:14.036268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:14.037354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:14.085074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601120015271377:7150]
2025-10-10T14:33:14.085400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 898, pipe: [1:7559601120015271377:7150]
2025-10-10T14:33:14.144471Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:14.144773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.144786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.144824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271377:7150], now have 1 active actors on pipe
2025-10-10T14:33:14.145003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:14.145095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601120015271377:7150]
2025-10-10T14:33:14.145108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:14.145111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:14.145127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:14.145166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 899 reason: error at write: Disconnected sessionId: src_id|f80b64e0-f3836c85-b66b5454-3449f959_0
2025-10-10T14:33:14.145411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 899 sessionId: src_id|f80b64e0-f3836c85-b66b5454-3449f959_0 is DEAD
2025-10-10T14:33:14.145551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b64e0-f3836c85-b66b5454-3449f959_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:14.145560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b64e0-f3836c85-b66b5454-3449f959_0] Write session will restart in 0.007754s
2025-10-10T14:33:14.145588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b64e0-f3836c85-b66b5454-3449f959_0] Write session: Do CDS request
2025-10-10T14:33:14.145596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b64e0-f3836c85-b66b5454-3449f959_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:14.154876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b64e0-f3836c85-b66b5454-3449f959_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.154969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:14.154988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 900
2025-10-10T14:33:14.155174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.155220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:14.155231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:14.155235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:14.155739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 900 sessionId:  describe result for acl check
2025-10-10T14:33:14.155781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:14.155787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:14.155789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:14.155796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601120015271447:7726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:14.156257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601120015271447:7726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:14.158850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601120015271447:7726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:14.161296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:14.161510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601120015271447:7726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:14.161527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601120015271447:7726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:14.161531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601120015271447:7726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:14.161540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:14.163549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:14.163816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:14.163830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:14.163854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:14.163913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:14.163953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601119233059317:6140]
2025-10-10T14:33:14.164611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:14.164880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:14.164921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:14.165227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:14.165278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.165285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.165286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.165287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.165289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.165290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.165292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.165293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.165294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.165295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.165296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.165297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.165299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.165304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.165317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.165322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.165326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.165345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.165349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.165353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.165357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.165361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.165365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.165369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.165377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.165382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.165390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.165401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.165412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.165422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.165431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.165440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.165445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.165450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.165454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.165460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.165464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.165473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.165483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.165488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.165497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.165502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.165510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.165517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.165525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.165531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.165539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.165545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.165550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.165557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.165561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.165570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.165620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:14.167890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:14.168450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:14.168463Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:14.168465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:14.168469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:14.168476Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 899 [2:7559601119233059317:6140]
2025-10-10T14:33:14.168488Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:14.168510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:14.168519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.168523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.168525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.168542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:14.168549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:14.168557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:14.168615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.168624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.168627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.168629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:14.168706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:14.168714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.168726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.168738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.168761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:14.168788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271600:7726], now have 1 active actors on pipe
2025-10-10T14:33:14.168796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271379:2438], now have 1 active actors on pipe
2025-10-10T14:33:14.168803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601119233059311:6140]
2025-10-10T14:33:14.168806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601119233059311:6140]
2025-10-10T14:33:14.168808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601119233059311:6140]
2025-10-10T14:33:14.168823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:14.168836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:14.168841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:14.168844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:14.168846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:14.168857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:14.168827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 899
2025-10-10T14:33:14.168861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:14.168834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 899
2025-10-10T14:33:14.168905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.168913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.168928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601119233059311:6140]
2025-10-10T14:33:14.168939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:14.168954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:14.168976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:14.168988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.168996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.168998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:14.169009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.169024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:14.169052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.169201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.169209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.169225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.169302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 900 partition: 0 MaxSeqNo: 40 sessionId: src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0
2025-10-10T14:33:14.169718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80b64e0-f3836c85-b66b5454-3449f959_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:14.172250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0] Write session: try to update token
2025-10-10T14:33:14.172267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:14.185996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId: src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:14.187472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:14.187487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:14.187489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:14.187490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:14.187498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601119233059311:6140]
2025-10-10T14:33:14.187503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601119233059311:6140]
2025-10-10T14:33:14.187506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601119233059311:6140]
2025-10-10T14:33:14.187547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:14.187555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.187558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:14.187562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:14.187564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:14.187569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:14.187686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:14.188640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:14.245353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601120015271611:7150]
2025-10-10T14:33:14.245623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 899, pipe: [1:7559601120015271611:7150]
2025-10-10T14:33:14.293872Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:14.294297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.294308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.294349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271611:7150], now have 1 active actors on pipe
2025-10-10T14:33:14.294559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:14.294585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:14.294589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:14.294620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601120015271611:7150]
2025-10-10T14:33:14.294662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 900 reason: error at write: Disconnected sessionId: src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0
2025-10-10T14:33:14.294900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 900 sessionId: src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0 is DEAD
2025-10-10T14:33:14.295060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:14.295071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0] Write session will restart in 0.007803s
2025-10-10T14:33:14.295102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0] Write session: Do CDS request
2025-10-10T14:33:14.295108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:14.295114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:14.303934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.304022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:14.304043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 901
2025-10-10T14:33:14.304206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.304254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:14.304265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:14.304269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:14.304702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 901 sessionId:  describe result for acl check
2025-10-10T14:33:14.304739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:14.304748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:14.304750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:14.304758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601120015271656:7730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:14.305361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601120015271656:7730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:14.308248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601120015271656:7730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:14.311119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601120015271656:7730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:14.311146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601120015271656:7730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:14.311149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601120015271656:7730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:14.311158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:14.311461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:14.314332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:14.314562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:14.314578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:14.314591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:14.314669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:14.314725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601119233059560:6142]
2025-10-10T14:33:14.315298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:14.315633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:14.315685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:14.316029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:14.316094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.316101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.316102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.316104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.316105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.316106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.316107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.316109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.316120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.316121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.316123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.316124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.316126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.316132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.316145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.316150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.316153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.316157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.316162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.316167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.316171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.316174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.316179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.316183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.316187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.316191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.316198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.316207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.316214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.316219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.316229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.316235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.316240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.316249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.316254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.316260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.316264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.316271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.316276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.316285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.316290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.316296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.316305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.316311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.316320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.316326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.316336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.316341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.316345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.316351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.316357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.316367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.316408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:14.318780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:14.319284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:14.319301Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:14.319304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:14.319308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:14.319315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 900 [2:7559601119233059560:6142]
2025-10-10T14:33:14.319327Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:14.319343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:14.319346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.319350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.319352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.319367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:14.319374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:14.319389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:14.319448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.319455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.319457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.319460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:14.319535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:14.319544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.319557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.319574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.319595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:14.319618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271612:2438], now have 1 active actors on pipe
2025-10-10T14:33:14.319627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271846:7730], now have 1 active actors on pipe
2025-10-10T14:33:14.319634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601119233059552:6142]
2025-10-10T14:33:14.319636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601119233059552:6142]
2025-10-10T14:33:14.319638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601119233059552:6142]
2025-10-10T14:33:14.319654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:14.319671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:14.319674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:14.319678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:14.319680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:14.319689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:14.319697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:14.319686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 900
2025-10-10T14:33:14.319720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601119233059552:6142]
2025-10-10T14:33:14.319727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:14.319729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:14.319699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 900
2025-10-10T14:33:14.319756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.319766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.319808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:14.319820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.319827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.319829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:14.319841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.319857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:14.319879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.319999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.320008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.320026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.320107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 901 partition: 0 MaxSeqNo: 40 sessionId: src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0
2025-10-10T14:33:14.320461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1affd0a9-b8d04cc7-159848b9-9fd31b41_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:14.323174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0] Write session: try to update token
2025-10-10T14:33:14.323191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:14.336442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId: src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:14.338925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:14.338915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:14.338933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:14.338936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:14.338938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:14.338949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601119233059552:6142]
2025-10-10T14:33:14.338952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601119233059552:6142]
2025-10-10T14:33:14.338954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601119233059552:6142]
2025-10-10T14:33:14.339001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:14.339004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:14.339008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.339010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:14.339011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:14.339015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:14.339143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:14.394817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601120015271881:7150]
2025-10-10T14:33:14.395038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 900, pipe: [1:7559601120015271881:7150]
2025-10-10T14:33:14.449327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:14.449627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.449641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.449683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271881:7150], now have 1 active actors on pipe
2025-10-10T14:33:14.449866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:14.449893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:14.449911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601120015271881:7150]
2025-10-10T14:33:14.449943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:14.449945Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:33:14.449946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:14.450030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 901 reason: error at write: Disconnected sessionId: src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0
2025-10-10T14:33:14.450115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 901 sessionId: src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0 is DEAD
2025-10-10T14:33:14.450190Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 9 consumer shared/user session shared/user_1_9_10039576345619587468_v1 is DEAD
2025-10-10T14:33:14.450379Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:33:14.450374Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601055590743148:7147] disconnected; active server actors: 1
2025-10-10T14:33:14.450383Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601055590743148:7147] client user disconnected session shared/user_1_9_10039576345619587468_v1
2025-10-10T14:33:14.450385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:14.450426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0] Write session will restart in 0.006582s
2025-10-10T14:33:14.450446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0] Write session: Do CDS request
2025-10-10T14:33:14.450451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:14.450547Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:33:14.450552Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:33:14.450558Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.005438s
2025-10-10T14:33:14.456742Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:33:14.456937Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:33:14.456953Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 10
2025-10-10T14:33:14.457118Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 10 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:33:14.457190Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:33:14.457281Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 auth for : user
2025-10-10T14:33:14.457496Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 Handle describe topics response
2025-10-10T14:33:14.457535Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 auth is DEAD
2025-10-10T14:33:14.457545Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:33:14.457677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.457721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:14.457734Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 902
2025-10-10T14:33:14.457809Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:33:14.457915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.457945Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_10_6118745172345690460_v1
2025-10-10T14:33:14.457942Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601120015271898:7744] connected; active server actors: 1
2025-10-10T14:33:14.457948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:14.457952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:14.457955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:14.457962Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601120015271898:7744] session shared/user_1_10_6118745172345690460_v1
2025-10-10T14:33:14.457973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:33:14.457984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:33:14.457996Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_10_6118745172345690460_v1" (Sender=[1:7559601120015271894:7744], Pipe=[1:7559601120015271898:7744], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:33:14.458006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:33:14.458019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:33:14.458034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_10_6118745172345690460_v1" (Sender=[1:7559601120015271894:7744], Pipe=[1:7559601120015271898:7744], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:33:14.458051Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_10_6118745172345690460_v1" sender [1:7559601120015271894:7744] lock partition 0 for ReadingSession "shared/user_1_10_6118745172345690460_v1" (Sender=[1:7559601120015271894:7744], Pipe=[1:7559601120015271898:7744], Partitions=[], ActiveFamilyCount=1) generation 1 step 10
2025-10-10T14:33:14.458059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:33:14.458064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000037s
2025-10-10T14:33:14.458253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 902 sessionId:  describe result for acl check
2025-10-10T14:33:14.458280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:14.458287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:14.458288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:14.458294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601120015271903:7747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:14.458297Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 10 Session: "shared/user_1_10_6118745172345690460_v1" ClientId: "user" PipeClient { RawX1: 7559601120015271898 RawX2: 4503603922345536 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:33:14.458314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:33:14.458846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601120015271903:7747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:14.461136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601120015271903:7747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:14.464406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601120015271903:7747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:14.464421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601120015271903:7747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:14.464425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601120015271903:7747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:14.464433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:14.468050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:14.470772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:14.471068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:14.471080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:14.471093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:14.471150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:14.471195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601119233059831:6158]
2025-10-10T14:33:14.471837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:14.472100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:14.472143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:14.472472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:14.472528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.472534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.472535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.472536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.472537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.472539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.472540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.472541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.472542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.472543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.472545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.472546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.472547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.472552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.472565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.472574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.472578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.472582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.472586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.472590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.472594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.472598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.472602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.472607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.472615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.472619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.472631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.472658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.472669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.472675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.472681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.472690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.472709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.472714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.472720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.472725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.472729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.472738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.472743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.472748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.472757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.472762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.472771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.472778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.472786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.472792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.472801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.472806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.472810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.472817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.472825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.472830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.472870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:14.475110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:14.475587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:14.475602Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:14.475605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:14.475609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:14.475614Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 901 [2:7559601119233059831:6158]
2025-10-10T14:33:14.475624Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:14.475646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:14.475653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.475657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.475663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.475678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:14.475701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:14.475713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:14.475770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.475777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.475780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.475783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:14.475853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:14.475860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.475871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.475888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.475920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:14.475946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272028:7747], now have 1 active actors on pipe
2025-10-10T14:33:14.475953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271883:2438], now have 1 active actors on pipe
2025-10-10T14:33:14.475955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015271904:7749], now have 1 active actors on pipe
2025-10-10T14:33:14.475961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601119233059826:6158]
2025-10-10T14:33:14.475962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601119233059826:6158]
2025-10-10T14:33:14.475964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601119233059826:6158]
2025-10-10T14:33:14.475957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 901
2025-10-10T14:33:14.475974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:14.475988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:14.475994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:14.475997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:14.475998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:14.475999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:14.476001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:14.475965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 901
2025-10-10T14:33:14.475994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 901, pipe: [1:7559601120015271904:7749]
2025-10-10T14:33:14.476032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.476045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.476057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601119233059826:6158]
2025-10-10T14:33:14.476067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:14.476074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.476079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.476081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:14.476084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_10_6118745172345690460_v1 on pipe: [1:7559601120015271904:7749]
2025-10-10T14:33:14.476115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:14.476122Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_10_6118745172345690460_v1:1 with generation 901
2025-10-10T14:33:14.476124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.476127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.476128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:14.476138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.476149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:14.476175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.476184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.476185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:14.476196Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_10_6118745172345690460_v1
2025-10-10T14:33:14.476201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.476222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.476241Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:33:14.476376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.476383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.476396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.476478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 902 partition: 0 MaxSeqNo: 40 sessionId: src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0
2025-10-10T14:33:14.476815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1001b42d-191929e5-f1fb3d5e-67fcf59f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:14.479574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0] Write session: try to update token
2025-10-10T14:33:14.479594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:14.480580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:33:14.480612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:33:14.480625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.480632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.480635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.480644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:33:14.480655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:33:14.480828Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106794476 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:33:14.480869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:33:14.480926Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 sending to client partition status
2025-10-10T14:33:14.493431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId: src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:14.495321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:14.495337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:14.495341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:14.495343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:14.495353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601119233059826:6158]
2025-10-10T14:33:14.495358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601119233059826:6158]
2025-10-10T14:33:14.495364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601119233059826:6158]
2025-10-10T14:33:14.495412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:14.495416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:14.495420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:14.495424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.495425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:14.495426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:14.495570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:14.496212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:14.605407Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:14.605938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.605955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.606213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_10_6118745172345690460_v1
2025-10-10T14:33:14.606233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:14.606251Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_10_6118745172345690460_v1
2025-10-10T14:33:14.606226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:14.606227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:14.606231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:14.606271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601120015271904:7749]
2025-10-10T14:33:14.606311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 902 reason: error at write: Disconnected sessionId: src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0
2025-10-10T14:33:14.606572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 902 sessionId: src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0 is DEAD
2025-10-10T14:33:14.606685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:14.606704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0] Write session will restart in 0.009832s
2025-10-10T14:33:14.606746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0] Write session: Do CDS request
2025-10-10T14:33:14.606752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:14.617917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.617997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:14.618011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 903
2025-10-10T14:33:14.618152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.618191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:14.618198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:14.618202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:14.618644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 903 sessionId:  describe result for acl check
2025-10-10T14:33:14.618680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:14.618695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:14.618697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:14.618715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601120015272214:7754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:14.619297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601120015272214:7754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:14.621753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601120015272214:7754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:14.624703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:14.624821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601120015272214:7754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:14.624833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601120015272214:7754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:14.624837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601120015272214:7754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:14.624845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:14.626918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:14.627156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:14.627166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:14.627192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:14.627250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:14.627293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601119233060069:6160]
2025-10-10T14:33:14.627900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:14.628184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:14.628245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:14.628590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:14.628651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.628658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.628659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.628660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.628662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.628664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.628665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.628666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.628668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.628669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.628670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.628671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.628672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.628679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.628692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.628697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.628701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.628706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.628710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.628714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.628718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.628723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.628728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.628732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.628736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.628740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.628748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.628758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.628770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.628776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.628781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.628789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.628794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.628800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.628807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.628813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.628817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.628823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.628832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.628838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.628844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.628850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.628857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.628863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.628868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.628876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.628883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.628889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.628896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.628902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.628907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.628915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.628958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:14.631145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:14.631894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:14.631906Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:14.631909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:14.631913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:14.631920Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 902 [2:7559601119233060069:6160]
2025-10-10T14:33:14.631934Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:14.631951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:14.631954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.631957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.631960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.631977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:14.631991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:14.632002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:14.632059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.632067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.632069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.632072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:14.632141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:14.632149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.632161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.632174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.632198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:14.632224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272362:7754], now have 1 active actors on pipe
2025-10-10T14:33:14.632233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272138:2438], now have 1 active actors on pipe
2025-10-10T14:33:14.632240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601119233060063:6160]
2025-10-10T14:33:14.632246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601119233060063:6160]
2025-10-10T14:33:14.632248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601119233060063:6160]
2025-10-10T14:33:14.632262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:14.632276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:14.632280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:14.632284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:14.632286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:14.632298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:14.632301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:14.632282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 902
2025-10-10T14:33:14.632288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 902
2025-10-10T14:33:14.632327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601119233060063:6160]
2025-10-10T14:33:14.632340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:14.632345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:14.632361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.632371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.632423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:14.632437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.632441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.632444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:14.632455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.632465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:14.632485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.632628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.632638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.632654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.632736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 903 partition: 0 MaxSeqNo: 40 sessionId: src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0
2025-10-10T14:33:14.633149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f0d02eb-2f047956-f0ab144a-cad01181_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:14.635708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0] Write session: try to update token
2025-10-10T14:33:14.635726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:14.649716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId: src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:14.651358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:14.651374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:14.651377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:14.651380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:14.651389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601119233060063:6160]
2025-10-10T14:33:14.651394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601119233060063:6160]
2025-10-10T14:33:14.651398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601119233060063:6160]
2025-10-10T14:33:14.651442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:14.651448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:14.651454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:14.651455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.651457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:14.651458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:14.651605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:14.652279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:14.706627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601120015272377:7749]
2025-10-10T14:33:14.706888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 902, pipe: [1:7559601120015272377:7749]
2025-10-10T14:33:14.757431Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:14.757726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.757744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.757795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272377:7749], now have 1 active actors on pipe
2025-10-10T14:33:14.757981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:14.757998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601120015272377:7749]
2025-10-10T14:33:14.758022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:14.758035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:14.758029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:14.758090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 903 reason: error at write: Disconnected sessionId: src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0
2025-10-10T14:33:14.758277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 903 sessionId: src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0 is DEAD
2025-10-10T14:33:14.758425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:14.758437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0] Write session will restart in 0.008024s
2025-10-10T14:33:14.758463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0] Write session: Do CDS request
2025-10-10T14:33:14.758473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:14.767836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.767972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:14.767985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 904
2025-10-10T14:33:14.768114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.768150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:14.768160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:14.768164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:14.768664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 904 sessionId:  describe result for acl check
2025-10-10T14:33:14.768699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:14.768706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:14.768708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:14.768714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601120015272439:7758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:14.769268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601120015272439:7758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:14.772071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601120015272439:7758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:14.774279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601120015272439:7758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:14.774292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601120015272439:7758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:14.774295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601120015272439:7758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:14.774303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:14.774545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:14.776710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:14.776924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:14.776933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:14.776943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:14.776987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:14.777019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601119233060303:6163]
2025-10-10T14:33:14.777462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:14.777755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:14.777811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:14.778153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:14.778217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.778223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.778224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.778226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.778227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.778228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.778229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.778230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.778231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.778233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.778234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.778235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.778236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.778242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.778255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.778259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.778263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.778266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.778271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.778274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.778278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.778282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.778286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.778290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.778293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.778298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.778305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.778318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.778329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.778339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.778347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.778352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.778361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.778370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.778379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.778383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.778387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.778392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.778397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.778415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.778425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.778432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.778436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.778441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.778445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.778451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.778455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.778460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.778464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.778473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.778489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.778498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.778537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:14.780727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:14.781149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:14.781159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:14.781161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:14.781165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:14.781171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 903 [2:7559601119233060303:6163]
2025-10-10T14:33:14.781181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:14.781196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:14.781204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.781207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.781209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.781224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:14.781239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:14.781250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:14.781302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.781308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.781309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.781312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:14.781391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:14.781398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.781410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.781425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.781455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:14.781479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272602:7758], now have 1 active actors on pipe
2025-10-10T14:33:14.781486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272378:2438], now have 1 active actors on pipe
2025-10-10T14:33:14.781493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601119233060297:6163]
2025-10-10T14:33:14.781499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601119233060297:6163]
2025-10-10T14:33:14.781501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601119233060297:6163]
2025-10-10T14:33:14.781513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:14.781530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:14.781516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 903
2025-10-10T14:33:14.781538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:14.781545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:14.781547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:14.781548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:14.781549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:14.781524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 903
2025-10-10T14:33:14.781567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601119233060297:6163]
2025-10-10T14:33:14.781575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:14.781576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:14.781591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.781601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.781655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:14.781667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.781671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.781673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:14.781684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.781694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:14.781710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.781856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.781863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.781876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.781959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 904 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0
2025-10-10T14:33:14.782311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d33d-4f7cf9e5-b31ae11f-8b11e82_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:14.784892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0] Write session: try to update token
2025-10-10T14:33:14.784907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:14.798627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId: src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:14.800192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:14.800211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:14.800215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:14.800217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:14.800226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601119233060297:6163]
2025-10-10T14:33:14.800231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601119233060297:6163]
2025-10-10T14:33:14.800235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601119233060297:6163]
2025-10-10T14:33:14.800280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:14.800283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:14.800291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.800291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:14.800293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:14.800295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:14.800431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:14.801242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:14.858208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601120015272615:7749]
2025-10-10T14:33:14.858431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 903, pipe: [1:7559601120015272615:7749]
2025-10-10T14:33:14.906423Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:14.906840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.906853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.906891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272615:7749], now have 1 active actors on pipe
2025-10-10T14:33:14.907119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601120015272615:7749]
2025-10-10T14:33:14.907160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:14.907163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:14.907167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:14.907163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:14.907248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 904 reason: error at write: Disconnected sessionId: src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0
2025-10-10T14:33:14.907529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 904 sessionId: src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0 is DEAD
2025-10-10T14:33:14.907686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:14.907699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0] Write session will restart in 0.008416s
2025-10-10T14:33:14.907724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0] Write session: Do CDS request
2025-10-10T14:33:14.907730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:14.916889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.916958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:14.916971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 905
2025-10-10T14:33:14.917126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:14.917153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:14.917160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:14.917163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:14.917716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 905 sessionId:  describe result for acl check
2025-10-10T14:33:14.917745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:14.917751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:14.917753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:14.917757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601120015272659:7762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:14.918209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601120015272659:7762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:14.921531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601120015272659:7762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:14.924310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601120015272659:7762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:14.924322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601120015272659:7762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:14.924325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601120015272659:7762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:14.924334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:14.925438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:14.927381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:14.927596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:14.927608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:14.927620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:14.927679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:14.927724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601119233060538:6165]
2025-10-10T14:33:14.928312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:14.928617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:14.928660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:14.929075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:14.929136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.929142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.929143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.929143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.929144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.929144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.929145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.929146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.929146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.929147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.929148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.929148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.929149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.929153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.929162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.929165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.929167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.929169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.929171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.929173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.929175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.929177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.929181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.929183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.929186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.929190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.929198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.929207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:14.929213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.929219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:14.929225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.929230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:14.929233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.929236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:14.929239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.929242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:14.929245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.929249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:14.929251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.929255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:14.929257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.929260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:14.929266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.929272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:14.929275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.929278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:14.929280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.929284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.929286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.929289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.929293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.929295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.929327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:14.931574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:14.931869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:14.931877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:14.931879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:14.931882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:14.931887Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 904 [2:7559601119233060538:6165]
2025-10-10T14:33:14.931895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:14.931908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:14.931913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.931915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.931917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.931930Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:14.931939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:14.931952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:14.931995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.932000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.932001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.932003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:14.932060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:14.932065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.932072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:14.932079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:14.932089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:14.932112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272840:7762], now have 1 active actors on pipe
2025-10-10T14:33:14.932119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601119233060533:6165]
2025-10-10T14:33:14.932124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601119233060533:6165]
2025-10-10T14:33:14.932125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601119233060533:6165]
2025-10-10T14:33:14.932135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:14.932144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601120015272616:2438], now have 1 active actors on pipe
2025-10-10T14:33:14.932154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:14.932155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:14.932158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:14.932160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:14.932179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:14.932184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:14.932200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601119233060533:6165]
2025-10-10T14:33:14.932206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:14.932215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:14.932190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 904
2025-10-10T14:33:14.932207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 904
2025-10-10T14:33:14.932230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.932237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.932370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:14.932380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:14.932383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:14.932385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:14.932393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:14.932401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:14.932416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.932543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:14.932549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:14.932560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:14.932659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 905 partition: 0 MaxSeqNo: 40 sessionId: src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0
2025-10-10T14:33:14.933004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b99395-720ee062-3db3b333-9e1d6cf6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:14.935445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0] Write session: try to update token
2025-10-10T14:33:14.935460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:14.948902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId: src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:14.950704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:14.950723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:14.950726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:14.950728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:14.950739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601119233060533:6165]
2025-10-10T14:33:14.950744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601119233060533:6165]
2025-10-10T14:33:14.950748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601119233060533:6165]
2025-10-10T14:33:14.950801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:14.950815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:14.950817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:14.950964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:14.951111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:14.951125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:14.951129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:14.951491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:15.007181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601124310240150:7749]
2025-10-10T14:33:15.007440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 904, pipe: [1:7559601124310240150:7749]
2025-10-10T14:33:15.055150Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:15.055537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.055555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.055606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240150:7749], now have 1 active actors on pipe
2025-10-10T14:33:15.055825Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:15.055840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:15.055853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:15.055857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:15.055900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601124310240150:7749]
2025-10-10T14:33:15.055936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 905 reason: error at write: Disconnected sessionId: src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0
2025-10-10T14:33:15.056134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 905 sessionId: src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0 is DEAD
2025-10-10T14:33:15.056283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:15.056293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0] Write session will restart in 0.009967s
2025-10-10T14:33:15.056318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0] Write session: Do CDS request
2025-10-10T14:33:15.056324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:15.067905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.067975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:15.067992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 906
2025-10-10T14:33:15.068159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.068194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:15.068205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:15.068209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:15.068683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 906 sessionId:  describe result for acl check
2025-10-10T14:33:15.068730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:15.068738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:15.068740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:15.068747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601124310240294:7766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:15.069346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601124310240294:7766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:15.071636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:15.071657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601124310240294:7766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:15.074080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:15.074321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:15.074331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:15.074344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:15.074325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601124310240294:7766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:15.074339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601124310240294:7766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:15.074343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601124310240294:7766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:15.074351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:15.074403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:15.074566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601123528028069:6167]
2025-10-10T14:33:15.075227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:15.075580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:15.075640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:15.075979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:15.076044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.076050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.076051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.076052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.076054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.076055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.076056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.076057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.076059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.076060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.076061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.076062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.076064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.076071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.076085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.076089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.076093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.076098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.076102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.076106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.076110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.076114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.076118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.076123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.076127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.076131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.076138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.076147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.076154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.076160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.076164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.076181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.076190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.076195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.076200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.076210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.076215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.076220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.076228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.076234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.076238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.076243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.076248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.076254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.076264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.076269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.076278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.076283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.076287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.076292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.076300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.076305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.076355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:15.078732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:15.079048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:15.079059Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:15.079062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:15.079067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:15.079074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 905 [2:7559601123528028069:6167]
2025-10-10T14:33:15.079086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:15.079108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:15.079115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.079119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.079122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.079138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:15.079152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:15.079159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:15.079218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.079226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.079228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.079231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:15.079299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:15.079307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.079318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.079335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.079357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:15.079395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240378:7766], now have 1 active actors on pipe
2025-10-10T14:33:15.079406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240151:2438], now have 1 active actors on pipe
2025-10-10T14:33:15.079413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601123528028064:6167]
2025-10-10T14:33:15.079416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601123528028064:6167]
2025-10-10T14:33:15.079418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601123528028064:6167]
2025-10-10T14:33:15.079431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:15.079445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:15.079447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:15.079435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 905
2025-10-10T14:33:15.079439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 905
2025-10-10T14:33:15.079449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:15.079451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:15.079462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:15.079465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:15.079493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601123528028064:6167]
2025-10-10T14:33:15.079496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:15.079499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:15.079526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.079536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.079573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:15.079584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.079588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.079592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:15.079604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.079619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:15.079640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.079781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.079789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.079803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.079917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 906 partition: 0 MaxSeqNo: 40 sessionId: src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0
2025-10-10T14:33:15.080339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f1b60e-e23f1a2d-4213677c-8d9bcd66_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:15.083053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0] Write session: try to update token
2025-10-10T14:33:15.083069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:15.096479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId: src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:15.098151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:15.098167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:15.098170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:15.098171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:15.098179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601123528028064:6167]
2025-10-10T14:33:15.098185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601123528028064:6167]
2025-10-10T14:33:15.098188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601123528028064:6167]
2025-10-10T14:33:15.098228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:15.098233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:15.098234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:15.098237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:15.098241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.098243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:15.098375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:15.099116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:15.156192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601124310240392:7749]
2025-10-10T14:33:15.156668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 905, pipe: [1:7559601124310240392:7749]
2025-10-10T14:33:15.209174Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:15.209575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.209587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.209628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240392:7749], now have 1 active actors on pipe
2025-10-10T14:33:15.209808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:15.209935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:15.209957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:15.209956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:15.210004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601124310240392:7749]
2025-10-10T14:33:15.210025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 906 reason: error at write: Disconnected sessionId: src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0
2025-10-10T14:33:15.210255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 906 sessionId: src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0 is DEAD
2025-10-10T14:33:15.210429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:15.210439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0] Write session will restart in 0.006409s
2025-10-10T14:33:15.210460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0] Write session: Do CDS request
2025-10-10T14:33:15.210467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:15.217882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.217936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:15.217948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 907
2025-10-10T14:33:15.218110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.218150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:15.218160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:15.218165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:15.218615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 907 sessionId:  describe result for acl check
2025-10-10T14:33:15.218654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:15.218661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:15.218675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:15.218682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601124310240413:7770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:15.219162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601124310240413:7770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:15.221792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601124310240413:7770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:15.224799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601124310240413:7770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:15.224812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601124310240413:7770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:15.224816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601124310240413:7770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:15.224827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:15.227499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:15.229739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:15.229937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:15.229947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:15.229959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:15.230008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:15.230051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601123528028307:6169]
2025-10-10T14:33:15.230749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:15.231021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:15.231063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:15.231385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:15.231440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.231447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.231448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.231449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.231451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.231452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.231454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.231455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.231457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.231458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.231460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.231461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.231462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.231468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.231482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.231487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.231492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.231496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.231501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.231506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.231511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.231515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.231520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.231524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.231529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.231533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.231542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.231551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.231559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.231566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.231575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.231582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.231588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.231594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.231599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.231605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.231610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.231616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.231621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.231627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.231632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.231638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.231643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.231649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.231654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.231664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.231669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.231675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.231684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.231691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.231700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.231706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.231753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:15.234080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:15.234386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:15.234395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:15.234397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:15.234400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:15.234406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 906 [2:7559601123528028307:6169]
2025-10-10T14:33:15.234415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:15.234430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:15.234432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.234435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.234436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.234448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:15.234457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:15.234464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:15.234514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.234519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.234520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.234522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:15.234590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:15.234596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.234603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.234609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.234619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:15.234636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240585:7770], now have 1 active actors on pipe
2025-10-10T14:33:15.234638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240393:2438], now have 1 active actors on pipe
2025-10-10T14:33:15.234644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601123528028302:6169]
2025-10-10T14:33:15.234646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601123528028302:6169]
2025-10-10T14:33:15.234647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601123528028302:6169]
2025-10-10T14:33:15.234656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:15.234679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:15.234688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:15.234693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:15.234696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:15.234697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:15.234699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:15.234717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601123528028302:6169]
2025-10-10T14:33:15.234720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:15.234721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:15.234739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 906
2025-10-10T14:33:15.234744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 906
2025-10-10T14:33:15.235010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.235021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.235054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:15.235069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.235072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.235075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:15.235086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.235097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:15.235109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.235273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.235279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.235290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.235379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 907 partition: 0 MaxSeqNo: 40 sessionId: src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0
2025-10-10T14:33:15.235769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b882a9d3-10a9f5f8-3f0696c5-e5d751f0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:15.238481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0] Write session: try to update token
2025-10-10T14:33:15.238499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:15.252379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId: src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:15.253417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:15.253436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:15.253440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:15.253441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:15.253452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601123528028302:6169]
2025-10-10T14:33:15.253456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601123528028302:6169]
2025-10-10T14:33:15.253460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601123528028302:6169]
2025-10-10T14:33:15.253507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:15.253511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:15.253516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.253517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:15.253518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:15.253521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:15.253655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:15.254973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:15.310265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601124310240638:7749]
2025-10-10T14:33:15.310475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 906, pipe: [1:7559601124310240638:7749]
2025-10-10T14:33:15.359645Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:15.359999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.360014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.360052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240638:7749], now have 1 active actors on pipe
2025-10-10T14:33:15.360209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:15.360253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601124310240638:7749]
2025-10-10T14:33:15.360316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:15.360323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:15.360338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:15.360385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 907 reason: error at write: Disconnected sessionId: src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0
2025-10-10T14:33:15.360597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 907 sessionId: src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0 is DEAD
2025-10-10T14:33:15.360764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:15.360774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0] Write session will restart in 0.007908s
2025-10-10T14:33:15.360793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0] Write session: Do CDS request
2025-10-10T14:33:15.360797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:15.369875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.369922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:15.369934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 908
2025-10-10T14:33:15.370097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.370143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:15.370153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:15.370157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:15.370672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 908 sessionId:  describe result for acl check
2025-10-10T14:33:15.370710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:15.370718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:15.370720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:15.370727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601124310240681:7775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:15.371282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601124310240681:7775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:15.373971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601124310240681:7775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:15.377105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601124310240681:7775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:15.377117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601124310240681:7775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:15.377121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601124310240681:7775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:15.377129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:15.378384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:15.381077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:15.381302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:15.381312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:15.381324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:15.381413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:15.381467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601123528028557:6172]
2025-10-10T14:33:15.382123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:15.382440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:15.382497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:15.382867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:15.382924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.382930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.382931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.382933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.382934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.382936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.382937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.382939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.382940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.382941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.382942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.382944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.382945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.382951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.382966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.382971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.382976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.382981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.382986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.382990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.382995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.383000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.383005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.383009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.383014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.383018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.383027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.383036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.383043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.383049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.383054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.383067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.383072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.383082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.383088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.383098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.383103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.383110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.383120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.383126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.383136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.383142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.383151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.383158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.383167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.383173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.383182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.383188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.383198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.383204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.383213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.383219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.383269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:15.385556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:15.386199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:15.386212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:15.386215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:15.386218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:15.386224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 907 [2:7559601123528028557:6172]
2025-10-10T14:33:15.386238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:15.386259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:15.386266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.386270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.386273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.386290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:15.386302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:15.386314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:15.386375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.386382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.386384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.386387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:15.386457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:15.386467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.386479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.386493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.386513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:15.386541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240646:2438], now have 1 active actors on pipe
2025-10-10T14:33:15.386549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240872:7775], now have 1 active actors on pipe
2025-10-10T14:33:15.386557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601123528028552:6172]
2025-10-10T14:33:15.386559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601123528028552:6172]
2025-10-10T14:33:15.386562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601123528028552:6172]
2025-10-10T14:33:15.386575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:15.386594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:15.386593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:15.386597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:15.386599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:15.386616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:15.386620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:15.386613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 907
2025-10-10T14:33:15.386615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 907
2025-10-10T14:33:15.386643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601123528028552:6172]
2025-10-10T14:33:15.386651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:15.386653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:15.386696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.386706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.386743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50ba7023-557c8c97-68e82abe-629fc635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:15.386757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.386761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.386764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:15.386775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.386785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:15.386812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.386963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.386974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.387001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.387084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 908 partition: 0 MaxSeqNo: 40 sessionId: src_id|50ba7023-557c8c97-68e82abe-629fc635_0
2025-10-10T14:33:15.387435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ee6116e-df42fb08-6d44f516-797e6c66_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50ba7023-557c8c97-68e82abe-629fc635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:15.390022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ba7023-557c8c97-68e82abe-629fc635_0] Write session: try to update token
2025-10-10T14:33:15.390038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ba7023-557c8c97-68e82abe-629fc635_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:15.404210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId: src_id|50ba7023-557c8c97-68e82abe-629fc635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:15.405606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:15.405627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:15.405630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:15.405633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:15.405643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601123528028552:6172]
2025-10-10T14:33:15.405648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601123528028552:6172]
2025-10-10T14:33:15.405652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601123528028552:6172]
2025-10-10T14:33:15.405691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:15.405703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:15.405704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:15.405708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:15.405711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.405713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:15.405848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:15.406862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:15.460285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601124310240911:7749]
2025-10-10T14:33:15.460491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 907, pipe: [1:7559601124310240911:7749]
2025-10-10T14:33:15.526953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:15.527361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.527377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.527423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240911:7749], now have 1 active actors on pipe
2025-10-10T14:33:15.527638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:15.527631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:15.527641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601124310240911:7749]
2025-10-10T14:33:15.527665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:15.527667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:15.527728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 908 reason: error at write: Disconnected sessionId: src_id|50ba7023-557c8c97-68e82abe-629fc635_0
2025-10-10T14:33:15.527901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 908 sessionId: src_id|50ba7023-557c8c97-68e82abe-629fc635_0 is DEAD
2025-10-10T14:33:15.528079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ba7023-557c8c97-68e82abe-629fc635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:15.528090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ba7023-557c8c97-68e82abe-629fc635_0] Write session will restart in 0.006386s
2025-10-10T14:33:15.528124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ba7023-557c8c97-68e82abe-629fc635_0] Write session: Do CDS request
2025-10-10T14:33:15.528133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ba7023-557c8c97-68e82abe-629fc635_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:15.535872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ba7023-557c8c97-68e82abe-629fc635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.535998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:15.536011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 909
2025-10-10T14:33:15.536120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.536157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:15.536168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:15.536172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:15.536641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 909 sessionId:  describe result for acl check
2025-10-10T14:33:15.536678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:15.536684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:15.536686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:15.536692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601124310240935:7788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:15.537449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601124310240935:7788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:15.539979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601124310240935:7788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:15.542970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601124310240935:7788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:15.542984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601124310240935:7788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:15.542987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601124310240935:7788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:15.542996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:15.545844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:15.548442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:15.548781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:15.548795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:15.548811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:15.548888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:15.548934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601123528028834:6187]
2025-10-10T14:33:15.549599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:15.549929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:15.549979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:15.550328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:15.550584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.550592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.550593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.550595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.550596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.550598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.550599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.550600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.550601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.550603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.550604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.550605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.550607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.550613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.550627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.550632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.550637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.550641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.550646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.550650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.550668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.550672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.550677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.550682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.550685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.550690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.550698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.550708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.550715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.550721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.550726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.550732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.550737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.550743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.550748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.550754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.550759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.550765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.550769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.550775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.550779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.550784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.550789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.550794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.550799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.550805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.550810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.550816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.550821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.550827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.550832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.550838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.550883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:15.553409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:15.553753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:15.553768Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:15.553770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:15.553774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:15.553781Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 908 [2:7559601123528028834:6187]
2025-10-10T14:33:15.553794Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:15.553813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:15.553816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.553820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.553822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.553841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:15.553849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:15.553857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:15.553923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.553930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.553932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.553935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:15.554008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:15.554017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.554030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.554041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.554064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:15.554087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310240912:2438], now have 1 active actors on pipe
2025-10-10T14:33:15.554091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310241116:7788], now have 1 active actors on pipe
2025-10-10T14:33:15.554098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601123528028829:6187]
2025-10-10T14:33:15.554101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601123528028829:6187]
2025-10-10T14:33:15.554103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601123528028829:6187]
2025-10-10T14:33:15.554119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:15.554132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:15.554133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:15.554135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:15.554138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:15.554149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:15.554152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:15.554156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 908
2025-10-10T14:33:15.554180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601123528028829:6187]
2025-10-10T14:33:15.554190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:15.554156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 908
2025-10-10T14:33:15.554192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:15.554231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.554242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.554281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:15.554294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.554298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.554301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:15.554312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.554322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:15.554339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.554525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.554535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.554552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.554633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 909 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0
2025-10-10T14:33:15.555047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ba7023-557c8c97-68e82abe-629fc635_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:15.557781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0] Write session: try to update token
2025-10-10T14:33:15.557802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:15.573287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId: src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:15.573664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:15.573684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:15.573690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:15.573693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:15.573703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601123528028829:6187]
2025-10-10T14:33:15.573707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601123528028829:6187]
2025-10-10T14:33:15.573711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601123528028829:6187]
2025-10-10T14:33:15.573759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:15.573760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:15.573768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.573771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:15.573771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:15.573775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:15.573909Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:15.575906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:15.627709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601124310241161:7749]
2025-10-10T14:33:15.628074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 908, pipe: [1:7559601124310241161:7749]
2025-10-10T14:33:15.693782Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:15.694121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.694136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.694177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310241161:7749], now have 1 active actors on pipe
2025-10-10T14:33:15.694400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:15.694410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:15.694411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:15.694461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 909 reason: error at write: Disconnected sessionId: src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0
2025-10-10T14:33:15.694462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601124310241161:7749]
2025-10-10T14:33:15.694557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:15.694629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 909 sessionId: src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0 is DEAD
2025-10-10T14:33:15.694794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:15.694804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0] Write session will restart in 0.008804s
2025-10-10T14:33:15.694822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0] Write session: Do CDS request
2025-10-10T14:33:15.694837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:15.704845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.704937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:15.704948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 910
2025-10-10T14:33:15.705069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.705096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:15.705114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:15.705120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:15.705537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 910 sessionId:  describe result for acl check
2025-10-10T14:33:15.705580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:15.705588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:15.705590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:15.705596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601124310241257:7794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:15.706167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601124310241257:7794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:15.708209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601124310241257:7794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:15.710603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:15.712871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:15.712923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601124310241257:7794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:15.712935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601124310241257:7794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:15.712938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601124310241257:7794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:15.712945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:15.713063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:15.713073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:15.713084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:15.713140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:15.713177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601123528029075:6190]
2025-10-10T14:33:15.713826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:15.714091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:15.714144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:15.714455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:15.714507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.714513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.714514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.714515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.714517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.714518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.714519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.714520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.714522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.714523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.714524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.714525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.714526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.714532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.714544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.714547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.714551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.714555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.714558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.714562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.714565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.714569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.714572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.714576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.714580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.714585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.714592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.714600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.714606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.714612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.714616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.714622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.714626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.714632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.714636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.714641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.714654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.714660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.714665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.714671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.714675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.714685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.714690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.714695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.714703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.714708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.714713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.714718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.714725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.714734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.714739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.714744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.714795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:15.716944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:15.717543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:15.717554Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:15.717556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:15.717559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:15.717565Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 909 [2:7559601123528029075:6190]
2025-10-10T14:33:15.717577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:15.717592Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:15.717595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.717599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.717601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.717617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:15.717629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:15.717636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:15.717690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.717699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.717701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.717703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:15.717767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:15.717775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.717786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.717803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.717825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:15.717851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310241397:7794], now have 1 active actors on pipe
2025-10-10T14:33:15.717858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310241165:2438], now have 1 active actors on pipe
2025-10-10T14:33:15.717866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601123528029070:6190]
2025-10-10T14:33:15.717871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601123528029070:6190]
2025-10-10T14:33:15.717874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601123528029070:6190]
2025-10-10T14:33:15.717886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:15.717900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:15.717904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:15.717908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:15.717910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:15.717918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:15.717921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:15.717897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 909
2025-10-10T14:33:15.717903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 909
2025-10-10T14:33:15.718054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601123528029070:6190]
2025-10-10T14:33:15.718066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:15.718080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:15.718087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.718091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.718136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:15.718149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.718156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.718159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:15.718169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.718183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:15.718205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.718353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.718362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.718377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.718478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 910 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0
2025-10-10T14:33:15.718842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e203a-379f97f0-2c7a72bc-43a5263c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:15.721274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0] Write session: try to update token
2025-10-10T14:33:15.721290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:15.734950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId: src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:15.737494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:15.737487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:15.737503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:15.737507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:15.737509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:15.737519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601123528029070:6190]
2025-10-10T14:33:15.737522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601123528029070:6190]
2025-10-10T14:33:15.737526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601123528029070:6190]
2025-10-10T14:33:15.737579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:15.737586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.737589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:15.737589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:15.737596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:15.737600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:15.737721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:15.794630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601124310241409:7749]
2025-10-10T14:33:15.794943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 909, pipe: [1:7559601124310241409:7749]
2025-10-10T14:33:15.851313Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:15.851583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.851599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.851644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310241409:7749], now have 1 active actors on pipe
2025-10-10T14:33:15.851868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:15.851888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:15.851901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:15.851915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601124310241409:7749]
2025-10-10T14:33:15.851940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:15.851973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 910 reason: error at write: Disconnected sessionId: src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0
2025-10-10T14:33:15.852155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 910 sessionId: src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0 is DEAD
2025-10-10T14:33:15.852302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:15.852312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0] Write session will restart in 0.009301s
2025-10-10T14:33:15.852337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0] Write session: Do CDS request
2025-10-10T14:33:15.852344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:15.862969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.863048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:15.863064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 911
2025-10-10T14:33:15.863223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:15.863258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:15.863276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:15.863280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:15.863749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 911 sessionId:  describe result for acl check
2025-10-10T14:33:15.863789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:15.863796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:15.863798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:15.863805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601124310241472:7798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:15.864396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601124310241472:7798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:15.867282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601124310241472:7798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:15.870196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601124310241472:7798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:15.870210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601124310241472:7798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:15.870213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601124310241472:7798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:15.870222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:15.870631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:15.873384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:15.873622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:15.873633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:15.873643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:15.873700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:15.873734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601123528029317:6192]
2025-10-10T14:33:15.874128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:15.874415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:15.874450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:15.874691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:15.874730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.874734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.874735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.874736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.874736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.874737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.874738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.874738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.874739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.874740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.874740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.874741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.874742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.874746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.874756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.874758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.874761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.874763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.874766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.874768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.874770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.874772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.874775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.874777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.874780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.874782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.874787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.874793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:15.874798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.874801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:15.874804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.874808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:15.874810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.874814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:15.874817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.874820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:15.874822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.874826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:15.874828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.874831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:15.874834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.874837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:15.874839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.874843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:15.874845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.874848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:15.874852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.874855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.874857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.874861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.874864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.874867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.874892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:15.877244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:15.877810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:15.877820Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:15.877822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:15.877826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:15.877831Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 910 [2:7559601123528029317:6192]
2025-10-10T14:33:15.877852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:15.877880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:15.877887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.877890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.877891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.877906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:15.877915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:15.877921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:15.877978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.877983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.877984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.877986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:15.878037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:15.878043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.878051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:15.878057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:15.878067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:15.878091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601123528029312:6192]
2025-10-10T14:33:15.878098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601123528029312:6192]
2025-10-10T14:33:15.878101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601123528029312:6192]
2025-10-10T14:33:15.878109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:15.878118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:15.878124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:15.878127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:15.878129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:15.878142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:15.878148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:15.878159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310241641:7798], now have 1 active actors on pipe
2025-10-10T14:33:15.878168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310241410:2438], now have 1 active actors on pipe
2025-10-10T14:33:15.878192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601123528029312:6192]
2025-10-10T14:33:15.878200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:15.878212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:15.878233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 910
2025-10-10T14:33:15.878286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 910
2025-10-10T14:33:15.878298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.878305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.878340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:15.878353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:15.878361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:15.878364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:15.878377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:15.878391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:15.878406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.878541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.878547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.878559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:15.878652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 911 partition: 0 MaxSeqNo: 40 sessionId: src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0
2025-10-10T14:33:15.879080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e2a132c-d5ff4412-3d7a975a-3ae8a382_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:15.881616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0] Write session: try to update token
2025-10-10T14:33:15.881634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:15.894325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:15.894340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:15.894351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601123528029312:6192]
2025-10-10T14:33:15.894394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:15.894402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:15.894562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:15.894724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:15.894868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:15.895001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:15.895261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:15.895308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:15.895719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId: src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:15.898318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:15.898551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:15.898567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:15.898602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:15.898706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:15.907134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:15.907150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:15.907153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:15.907155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:15.907167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601123528029312:6192]
2025-10-10T14:33:15.907171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601123528029312:6192]
2025-10-10T14:33:15.907175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601123528029312:6192]
2025-10-10T14:33:15.907225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:15.907227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:15.907233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:15.907237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:15.907238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:15.907240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:15.907371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:15.952343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601124310241653:7749]
2025-10-10T14:33:15.952627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 910, pipe: [1:7559601124310241653:7749]
2025-10-10T14:33:16.015622Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:16.022509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.022532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.022712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.022774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.022839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.022905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.022950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.022958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.023021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.023080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.023147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.023208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.023256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.023266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.023330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.023390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.023458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.023516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.023738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.023748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.023810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.023875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.023936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.023994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.024036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.024041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.024103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.024164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.024225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.024285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.024325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.024331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.024394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.024456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.024520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.024578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.024621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.024627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.024695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.024753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.024812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.024872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.024917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.024925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.024986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.025042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.025099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.025170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.025215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.025220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.025279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.025353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.025415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.025483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.025527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.025535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.025603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:16.025662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:16.025728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:16.025790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:16.025834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:16.025841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:16.025894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601124310241653:7749], now have 1 active actors on pipe
2025-10-10T14:33:16.026078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601124310241653:7749]
2025-10-10T14:33:16.026110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:16.026175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:16.026183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:16.026218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 911 reason: error at write: Disconnected sessionId: src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0
2025-10-10T14:33:16.026498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 911 sessionId: src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0 is DEAD
2025-10-10T14:33:16.026579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:16.026618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:16.026631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0] Write session will restart in 0.008005s
2025-10-10T14:33:16.026667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0] Write session: Do CDS request
2025-10-10T14:33:16.026673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:16.035953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.036050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:16.036079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 912
2025-10-10T14:33:16.036214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.036262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:16.036267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:16.036271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:16.036758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 912 sessionId:  describe result for acl check
2025-10-10T14:33:16.036812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:16.036819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:16.036822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:16.036829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601128605208996:7802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:16.037412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601128605208996:7802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:16.040161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601128605208996:7802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:16.043856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601128605208996:7802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:16.043871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601128605208996:7802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:16.043875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601128605208996:7802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:16.043883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:16.044878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:16.047677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:16.047860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:16.047869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:16.047878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:16.047922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:16.047958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601127822996855:6194]
2025-10-10T14:33:16.048463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:16.048761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:16.048805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:16.049140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:16.049195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.049201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.049201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.049202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.049203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.049204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.049204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.049205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.049206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.049206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.049207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.049207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.049208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.049214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.049228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.049232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.049237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.049240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.049243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.049247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.049251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.049255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.049260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.049264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.049268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.049272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.049279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.049285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.049290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.049294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.049297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.049300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.049302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.049306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.049308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.049312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.049314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.049318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.049321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.049324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.049327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.049354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.049359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.049364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.049370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.049374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.049376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.049381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.049384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.049387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.049390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.049393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.049422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:16.051968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:16.052570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:16.052582Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:16.052584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:16.052587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:16.052594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 911 [2:7559601127822996855:6194]
2025-10-10T14:33:16.052607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:16.052627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:16.052634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.052638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.052641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.052659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:16.052670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:16.052679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:16.052741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.052748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.052750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.052753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:16.052818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:16.052825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.052838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.052855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.052877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:16.052907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605208951:2438], now have 1 active actors on pipe
2025-10-10T14:33:16.052910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209182:7802], now have 1 active actors on pipe
2025-10-10T14:33:16.052918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601127822996850:6194]
2025-10-10T14:33:16.052921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601127822996850:6194]
2025-10-10T14:33:16.052923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601127822996850:6194]
2025-10-10T14:33:16.052939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:16.052958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:16.052958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:16.052961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:16.052963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:16.052979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:16.052987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:16.052961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 911
2025-10-10T14:33:16.052968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 911
2025-10-10T14:33:16.053023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601127822996850:6194]
2025-10-10T14:33:16.053034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:16.053045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:16.053056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.053065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.053122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:16.053133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.053141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.053143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:16.053159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.053180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:16.053210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.053392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.053404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.053424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.053525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 912 partition: 0 MaxSeqNo: 40 sessionId: src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0
2025-10-10T14:33:16.053950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37afe6bd-211d2c78-95d0afe0-fdd90130_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:16.056914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0] Write session: try to update token
2025-10-10T14:33:16.056940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:16.072139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId: src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:16.072807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:16.072831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:16.072834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:16.072837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:16.072847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601127822996850:6194]
2025-10-10T14:33:16.072852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601127822996850:6194]
2025-10-10T14:33:16.072857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601127822996850:6194]
2025-10-10T14:33:16.072907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:16.072922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.072924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:16.072965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:16.072979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:16.072983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:16.073068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:16.074879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:16.126421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601128605209197:7749]
2025-10-10T14:33:16.126767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 911, pipe: [1:7559601128605209197:7749]
2025-10-10T14:33:16.130744Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:33:16.186755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:16.187328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.187344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.187390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209197:7749], now have 1 active actors on pipe
2025-10-10T14:33:16.187600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:16.187639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601128605209197:7749]
2025-10-10T14:33:16.187663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:16.187687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:16.187770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 912 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0
2025-10-10T14:33:16.187990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 912 sessionId: src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0 is DEAD
2025-10-10T14:33:16.188167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:16.188181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0] Write session will restart in 0.006293s
2025-10-10T14:33:16.188217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0] Write session: Do CDS request
2025-10-10T14:33:16.188223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:16.195937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.196009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:16.196040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 913
2025-10-10T14:33:16.196202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.196237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:16.196248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:16.196252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:16.196724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 913 sessionId:  describe result for acl check
2025-10-10T14:33:16.196776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:16.196782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:16.196783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:16.196789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601128605209221:7806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:16.197386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601128605209221:7806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:16.200438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601128605209221:7806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:16.203557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601128605209221:7806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:16.203570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601128605209221:7806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:16.203573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601128605209221:7806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:16.203582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:16.205438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:16.208226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:16.208422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:16.208433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:16.208442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:16.208494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:16.208529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601127822997098:6196]
2025-10-10T14:33:16.208935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:16.209218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:16.209252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:16.209510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:16.209555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.209562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.209562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.209563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.209564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.209565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.209566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.209566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.209567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.209568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.209569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.209569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.209570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.209573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.209582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.209585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.209587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.209589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.209591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.209593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.209595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.209598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.209600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.209602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.209604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.209606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.209612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.209618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.209623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.209627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.209631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.209634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.209637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.209640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.209643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.209646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.209649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.209652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.209655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.209658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.209660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.209664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.209666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.209669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.209672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.209675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.209678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.209681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.209684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.209687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.209690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.209693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.209718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:16.212200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:16.213013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:16.213027Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:16.213029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:16.213033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:16.213040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 912 [2:7559601127822997098:6196]
2025-10-10T14:33:16.213057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:16.213075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:16.213078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.213082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.213084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.213102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:16.213114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:16.213124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:16.213188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.213198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.213200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.213203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:16.213428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 912
2025-10-10T14:33:16.213429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 912
2025-10-10T14:33:16.213272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:16.213280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.213292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.213305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.213322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:16.213380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209420:7806], now have 1 active actors on pipe
2025-10-10T14:33:16.213383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209198:2438], now have 1 active actors on pipe
2025-10-10T14:33:16.213392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601127822997093:6196]
2025-10-10T14:33:16.213394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601127822997093:6196]
2025-10-10T14:33:16.213396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601127822997093:6196]
2025-10-10T14:33:16.213405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:16.213417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:16.213421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:16.213420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:16.213423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:16.213437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:16.213441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:16.213554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601127822997093:6196]
2025-10-10T14:33:16.213563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:16.213570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:16.213590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.213595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.213637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:16.213645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.213650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.213653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:16.213663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.213675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:16.213696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.213883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.213893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.213908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.213981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 913 partition: 0 MaxSeqNo: 40 sessionId: src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0
2025-10-10T14:33:16.214393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da44fa9-85fb7955-c23f930c-9e2dde47_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:16.217117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0] Write session: try to update token
2025-10-10T14:33:16.217139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:16.231195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId: src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:16.233129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:16.233146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:16.233149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:16.233150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:16.233157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601127822997093:6196]
2025-10-10T14:33:16.233160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601127822997093:6196]
2025-10-10T14:33:16.233163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601127822997093:6196]
2025-10-10T14:33:16.233205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:16.233209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:16.233212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.233215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:16.233217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:16.233221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:16.233378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:16.233938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:16.287704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601128605209446:7749]
2025-10-10T14:33:16.288001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 912, pipe: [1:7559601128605209446:7749]
2025-10-10T14:33:16.342905Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:16.343117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.343127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.343163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209446:7749], now have 1 active actors on pipe
2025-10-10T14:33:16.343386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:16.343390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:16.343397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:16.343402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:16.343466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 913 reason: error at write: Disconnected sessionId: src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0
2025-10-10T14:33:16.343514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601128605209446:7749]
2025-10-10T14:33:16.343680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 913 sessionId: src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0 is DEAD
2025-10-10T14:33:16.343821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:16.343833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0] Write session will restart in 0.006999s
2025-10-10T14:33:16.343853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0] Write session: Do CDS request
2025-10-10T14:33:16.343858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:16.351851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.351934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:16.351948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 914
2025-10-10T14:33:16.352068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.352106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:16.352117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:16.352122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:16.352553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 914 sessionId:  describe result for acl check
2025-10-10T14:33:16.352591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:16.352600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:16.352602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:16.352609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601128605209476:7813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:16.353202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601128605209476:7813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:16.356332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601128605209476:7813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:16.359358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601128605209476:7813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:16.359378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601128605209476:7813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:16.359381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601128605209476:7813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:16.359390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:16.361935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:16.364577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:16.364786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:16.364797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:16.364809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:16.364860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:16.364903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601127822997354:6199]
2025-10-10T14:33:16.365544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:16.365821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:16.365866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:16.366187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:16.366242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.366248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.366249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.366251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.366252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.366253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.366255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.366256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.366257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.366258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.366259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.366260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.366262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.366267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.366281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.366285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.366289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.366293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.366297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.366301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.366305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.366309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.366313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.366317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.366321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.366325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.366335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.366344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.366355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.366366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.366373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.366382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.366387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.366392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.366397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.366402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.366406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.366416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.366425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.366435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.366444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.366450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.366458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.366468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.366472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.366477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.366482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.366491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.366499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.366504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.366513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.366518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.366560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:16.368872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:16.369218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:16.369229Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:16.369231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:16.369234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:16.369239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 913 [2:7559601127822997354:6199]
2025-10-10T14:33:16.369247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:16.369265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:16.369270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.369272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.369273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.369286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:16.369295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:16.369306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:16.369543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.369555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.369557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.369560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:16.369626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:16.369636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.369648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.369661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.369680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:16.369706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209667:7813], now have 1 active actors on pipe
2025-10-10T14:33:16.369716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209460:2438], now have 1 active actors on pipe
2025-10-10T14:33:16.369725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601127822997349:6199]
2025-10-10T14:33:16.369727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601127822997349:6199]
2025-10-10T14:33:16.369729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601127822997349:6199]
2025-10-10T14:33:16.369741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:16.369756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:16.369771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:16.369765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 913
2025-10-10T14:33:16.369773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:16.369778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:16.369766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 913
2025-10-10T14:33:16.369780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:16.369780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:16.369803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601127822997349:6199]
2025-10-10T14:33:16.369806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:16.369812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:16.369840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.369848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.369880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:16.369895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.369899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.369901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:16.369912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.369922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:16.369938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.370089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.370098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.370114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.370198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 914 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0
2025-10-10T14:33:16.370585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7392bdb2-68f82d84-465cf22f-3a9c7a5f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:16.373407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0] Write session: try to update token
2025-10-10T14:33:16.373425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:16.387274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId: src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:16.388950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:16.388970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:16.388973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:16.388975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:16.388987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601127822997349:6199]
2025-10-10T14:33:16.388991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601127822997349:6199]
2025-10-10T14:33:16.388995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601127822997349:6199]
2025-10-10T14:33:16.389043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:16.389052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:16.389055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.389057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:16.389058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:16.389062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:16.389191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:16.389862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:16.443872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601128605209706:7749]
2025-10-10T14:33:16.444171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 913, pipe: [1:7559601128605209706:7749]
2025-10-10T14:33:16.509985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:16.510370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.510390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.510436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209706:7749], now have 1 active actors on pipe
2025-10-10T14:33:16.510668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:16.510678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:16.510680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:16.510721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601128605209706:7749]
2025-10-10T14:33:16.510665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:16.510748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 914 reason: error at write: Disconnected sessionId: src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0
2025-10-10T14:33:16.510981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 914 sessionId: src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0 is DEAD
2025-10-10T14:33:16.511181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:16.511193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0] Write session will restart in 0.005156s
2025-10-10T14:33:16.511229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0] Write session: Do CDS request
2025-10-10T14:33:16.511238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:16.517865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.517963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:16.517976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 915
2025-10-10T14:33:16.518121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.518165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:16.518175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:16.518180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:16.518635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 915 sessionId:  describe result for acl check
2025-10-10T14:33:16.518674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:16.518680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:16.518682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:16.518688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601128605209749:7826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:16.519265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601128605209749:7826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:16.522237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601128605209749:7826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:16.525296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601128605209749:7826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:16.525311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601128605209749:7826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:16.525315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601128605209749:7826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:16.525347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:16.527869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:16.530483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:16.530715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:16.530726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:16.530752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:16.530814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:16.530857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601127822997637:6214]
2025-10-10T14:33:16.531500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:16.531785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:16.531831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:16.532146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:16.532200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.532206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.532208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.532209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.532210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.532212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.532213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.532215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.532216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.532217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.532219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.532220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.532221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.532227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.532241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.532246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.532250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.532254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.532258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.532262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.532266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.532270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.532274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.532281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.532285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.532289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.532298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.532306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.532314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.532321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.532329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.532335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.532340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.532350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.532355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.532361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.532369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.532373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.532377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.532382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.532388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.532393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.532398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.532408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.532411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.532416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.532419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.532424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.532428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.532433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.532441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.532446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.532485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:16.534931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:16.535428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:16.535444Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:16.535446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:16.535450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:16.535457Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 914 [2:7559601127822997637:6214]
2025-10-10T14:33:16.535469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:16.535486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:16.535489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.535492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.535495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.535511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:16.535519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:16.535534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:16.535595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.535602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.535604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.535606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:16.535669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:16.535676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.535686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.535701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.535720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:16.535747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209735:2438], now have 1 active actors on pipe
2025-10-10T14:33:16.535751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209944:7826], now have 1 active actors on pipe
2025-10-10T14:33:16.535758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601127822997632:6214]
2025-10-10T14:33:16.535760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601127822997632:6214]
2025-10-10T14:33:16.535762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601127822997632:6214]
2025-10-10T14:33:16.535774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:16.535787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:16.535764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 914
2025-10-10T14:33:16.535788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:16.535790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:16.535791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 914
2025-10-10T14:33:16.535793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:16.535804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:16.535807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:16.535835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601127822997632:6214]
2025-10-10T14:33:16.535846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:16.535852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:16.535876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.535885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.535933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:16.535945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.535948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.535950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:16.535961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.535976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:16.535992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.536159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.536167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.536180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.536287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 915 partition: 0 MaxSeqNo: 40 sessionId: src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0
2025-10-10T14:33:16.536685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4183e2b-c89996f1-e0681de3-4dcef27d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:16.539256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0] Write session: try to update token
2025-10-10T14:33:16.539271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:16.552963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId: src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:16.555274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:16.555298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:16.555302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:16.555304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:16.555313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601127822997632:6214]
2025-10-10T14:33:16.555319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601127822997632:6214]
2025-10-10T14:33:16.555323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601127822997632:6214]
2025-10-10T14:33:16.555375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:16.555379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:16.555381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:16.555387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:16.555388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.555390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:16.555537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:16.555639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:16.610767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601128605209990:7749]
2025-10-10T14:33:16.611076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 914, pipe: [1:7559601128605209990:7749]
2025-10-10T14:33:16.676078Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:16.676482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.676498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.676540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209990:7749], now have 1 active actors on pipe
2025-10-10T14:33:16.676785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601128605209990:7749]
2025-10-10T14:33:16.676873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:16.676797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:16.676991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:16.677068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 915 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0
2025-10-10T14:33:16.677320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 915 sessionId: src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0 is DEAD
2025-10-10T14:33:16.677480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:16.677489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0] Write session will restart in 0.006376s
2025-10-10T14:33:16.677508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0] Write session: Do CDS request
2025-10-10T14:33:16.677512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:16.684914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.684965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:16.684991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 916
2025-10-10T14:33:16.685126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.685174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:16.685184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:16.685189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:16.685645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 916 sessionId:  describe result for acl check
2025-10-10T14:33:16.685676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:16.685681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:16.685682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:16.685687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601128605210019:7832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:16.686140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601128605210019:7832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:16.688701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601128605210019:7832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:16.692309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601128605210019:7832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:16.692326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601128605210019:7832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:16.692330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601128605210019:7832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:16.692339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:16.695701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:16.698312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:16.698538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:16.698554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:16.698572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:16.698660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:16.698710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601127822997885:6217]
2025-10-10T14:33:16.699358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:16.699694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:16.699751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:16.700083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:16.700155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.700163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.700164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.700165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.700167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.700169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.700170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.700172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.700173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.700174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.700176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.700177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.700179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.700186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.700200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.700204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.700209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.700213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.700218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.700223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.700227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.700232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.700237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.700241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.700246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.700250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.700259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.700268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.700276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.700288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.700297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.700307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.700316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.700328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.700333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.700344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.700349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.700355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.700360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.700365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.700372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.700377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.700382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.700388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.700392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.700398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.700404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.700410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.700415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.700421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.700431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.700436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.700481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:16.702880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:16.703549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:16.703566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:16.703568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:16.703572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:16.703578Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 915 [2:7559601127822997885:6217]
2025-10-10T14:33:16.703591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:16.703607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:16.703615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.703619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.703622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.703637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:16.703650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:16.703662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:16.703723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.703733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.703735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.703738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:16.703802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:16.703808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.703820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.703832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.703851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:16.703872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605210182:7832], now have 1 active actors on pipe
2025-10-10T14:33:16.703875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605209996:2438], now have 1 active actors on pipe
2025-10-10T14:33:16.703883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601127822997880:6217]
2025-10-10T14:33:16.703886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601127822997880:6217]
2025-10-10T14:33:16.703888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601127822997880:6217]
2025-10-10T14:33:16.703902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:16.703917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:16.703921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:16.703927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:16.703929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:16.703937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:16.703940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:16.703963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601127822997880:6217]
2025-10-10T14:33:16.703963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 915
2025-10-10T14:33:16.703969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 915
2025-10-10T14:33:16.703972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:16.703974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:16.704008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.704013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.704052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc8c39e2-17281caf-190bfcad-601affd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:16.704066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.704070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.704073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:16.704084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.704095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:16.704116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.704242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.704248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.704260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.704359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 916 partition: 0 MaxSeqNo: 40 sessionId: src_id|bc8c39e2-17281caf-190bfcad-601affd7_0
2025-10-10T14:33:16.704759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63dc056-9b00e853-ae2e0989-6e338da6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bc8c39e2-17281caf-190bfcad-601affd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:16.707403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c39e2-17281caf-190bfcad-601affd7_0] Write session: try to update token
2025-10-10T14:33:16.707425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c39e2-17281caf-190bfcad-601affd7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:16.721547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId: src_id|bc8c39e2-17281caf-190bfcad-601affd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:16.723275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:16.723314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:16.723318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:16.723320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:16.723330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601127822997880:6217]
2025-10-10T14:33:16.723336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601127822997880:6217]
2025-10-10T14:33:16.723340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601127822997880:6217]
2025-10-10T14:33:16.723390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:16.723398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.723398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:16.723401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:16.723405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:16.723409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:16.723542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:16.724074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:16.777181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601128605210244:7749]
2025-10-10T14:33:16.777491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 915, pipe: [1:7559601128605210244:7749]
2025-10-10T14:33:16.832980Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:16.833295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.833309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.833365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605210244:7749], now have 1 active actors on pipe
2025-10-10T14:33:16.833552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:16.833608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:16.833643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601128605210244:7749]
2025-10-10T14:33:16.833670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:16.833753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 916 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc8c39e2-17281caf-190bfcad-601affd7_0
2025-10-10T14:33:16.834000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 916 sessionId: src_id|bc8c39e2-17281caf-190bfcad-601affd7_0 is DEAD
2025-10-10T14:33:16.834168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c39e2-17281caf-190bfcad-601affd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:16.834178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c39e2-17281caf-190bfcad-601affd7_0] Write session will restart in 0.006447s
2025-10-10T14:33:16.834204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c39e2-17281caf-190bfcad-601affd7_0] Write session: Do CDS request
2025-10-10T14:33:16.834210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c39e2-17281caf-190bfcad-601affd7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:16.841862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c39e2-17281caf-190bfcad-601affd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.841963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:16.841978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 917
2025-10-10T14:33:16.842090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:16.842127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:16.842137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:16.842150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:16.842622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 917 sessionId:  describe result for acl check
2025-10-10T14:33:16.842659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:16.842661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:16.842662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:16.842669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601128605210262:7836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:16.843211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601128605210262:7836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:16.845723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601128605210262:7836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:16.849448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601128605210262:7836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:16.849464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601128605210262:7836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:16.849468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601128605210262:7836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:16.849477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:16.852921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:16.855603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:16.855955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:16.855974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:16.855989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:16.856053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:16.856097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601127822998131:6219]
2025-10-10T14:33:16.856722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:16.857080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:16.857124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:16.857462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:16.857515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.857522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.857523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.857524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.857526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.857527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.857528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.857530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.857531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.857532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.857533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.857535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.857536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.857542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.857556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.857560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.857564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.857568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.857573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.857577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.857581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.857585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.857589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.857594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.857598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.857601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.857609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.857618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:16.857624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.857630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:16.857635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.857640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:16.857645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.857650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:16.857660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.857666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:16.857671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.857677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:16.857686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.857691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:16.857696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.857703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:16.857711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.857717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:16.857721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.857726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:16.857739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.857748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.857753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.857758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.857767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.857772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.857813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:16.860238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:16.860711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:16.860725Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:16.860727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:16.860731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:16.860737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 916 [2:7559601127822998131:6219]
2025-10-10T14:33:16.860751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:16.860771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:16.860781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.860785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.860788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.860804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:16.860815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:16.860823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:16.860883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.860891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.860893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.860895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:16.860965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:16.860972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.860994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:16.861010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:16.861032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:16.861059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605210246:2438], now have 1 active actors on pipe
2025-10-10T14:33:16.861066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605210439:7836], now have 1 active actors on pipe
2025-10-10T14:33:16.861074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601127822998126:6219]
2025-10-10T14:33:16.861077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601127822998126:6219]
2025-10-10T14:33:16.861079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601127822998126:6219]
2025-10-10T14:33:16.861091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:16.861109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:16.861110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:16.861121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:16.861123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:16.861126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:16.861129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:16.861154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601127822998126:6219]
2025-10-10T14:33:16.861163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:16.861171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:16.861153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 916
2025-10-10T14:33:16.861185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 916
2025-10-10T14:33:16.861203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.861213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.861245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:16.861252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:16.861256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:16.861258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:16.861270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:16.861286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:16.861303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.861457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.861467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.861483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:16.861566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 917 partition: 0 MaxSeqNo: 40 sessionId: src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0
2025-10-10T14:33:16.862002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8c39e2-17281caf-190bfcad-601affd7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:16.864671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0] Write session: try to update token
2025-10-10T14:33:16.864689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:16.878928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId: src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:16.878977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:16.878996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:16.879007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601127822998126:6219]
2025-10-10T14:33:16.879057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:16.879059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:16.879243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:16.879397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:16.879538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:16.879683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:16.879877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:16.879922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:16.881626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:16.881802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:16.881819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:16.881853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:16.881918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:16.890512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:16.890529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:16.890531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:16.890533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:16.890545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601127822998126:6219]
2025-10-10T14:33:16.890548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601127822998126:6219]
2025-10-10T14:33:16.890550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601127822998126:6219]
2025-10-10T14:33:16.890590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:16.890597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:16.890608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:16.890615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:16.890616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:16.890621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:16.890745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:16.933869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601128605210495:7749]
2025-10-10T14:33:16.934209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 916, pipe: [1:7559601128605210495:7749]
2025-10-10T14:33:16.999099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:17.006743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.006770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.006933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.007010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.007069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.007131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.007174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.007179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.007259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.007319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.007381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.007723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.007778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.007786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.007851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.007911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.007973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.008038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.008081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.008088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.008151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.008218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.008283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.008356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.008401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.008408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.008473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.008532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.008594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.008657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.008701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.008708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.008771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.008827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.008883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.008943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.008984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.008989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.009047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.009100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.009158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.009217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.009258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.009263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.009322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.009400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.009458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.009516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.009554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.009561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.009616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.009672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.009727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.009782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.009822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.009830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.009895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.009950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.010005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.010061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.010099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.010104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.010160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601128605210495:7749], now have 1 active actors on pipe
2025-10-10T14:33:17.010347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601128605210495:7749]
2025-10-10T14:33:17.010365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:17.010369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:17.010383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:17.010398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 917 reason: error at write: Disconnected sessionId: src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0
2025-10-10T14:33:17.010593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 917 sessionId: src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0 is DEAD
2025-10-10T14:33:17.010745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:17.010755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0] Write session will restart in 0.008948s
2025-10-10T14:33:17.010745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:17.010775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0] Write session: Do CDS request
2025-10-10T14:33:17.010780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:17.020928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.021021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:17.021036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 918
2025-10-10T14:33:17.021223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.021274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:17.021284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:17.021288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:17.021967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 918 sessionId:  describe result for acl check
2025-10-10T14:33:17.022002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:17.022004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:17.022007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:17.022013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601132900177841:7840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:17.022608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601132900177841:7840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:17.026197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601132900177841:7840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:17.029385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601132900177841:7840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:17.029402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601132900177841:7840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:17.029405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601132900177841:7840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:17.029414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:17.030534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:17.033240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:17.033568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:17.033581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:17.033594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:17.033660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:17.033707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601132117965676:6221]
2025-10-10T14:33:17.034210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:17.034557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:17.034618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:17.034894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:17.034952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.034957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.034958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.034959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.034960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.034962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.034963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.034964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.034965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.034966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.034968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.034969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.034970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.034976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.034990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.034994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.034999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.035003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.035008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.035011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.035015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.035019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.035024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.035028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.035032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.035036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.035044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.035053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.035061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.035065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.035069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.035072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.035075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.035078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.035081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.035084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.035087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.035090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.035093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.035096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.035099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.035102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.035106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.035108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.035111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.035114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.035118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.035121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.035123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.035126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.035129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.035132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.035154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:17.037773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:17.038531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:17.038547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:17.038550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:17.038555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:17.038562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 917 [2:7559601132117965676:6221]
2025-10-10T14:33:17.038577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:17.038610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:17.038623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.038628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.038631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.038654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:17.038672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:17.038689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:17.038776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.038786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.038788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.038790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:17.038874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:17.038884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.038897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.038913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.038930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:17.038963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178030:7840], now have 1 active actors on pipe
2025-10-10T14:33:17.038976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900177793:2438], now have 1 active actors on pipe
2025-10-10T14:33:17.038987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601132117965671:6221]
2025-10-10T14:33:17.038997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601132117965671:6221]
2025-10-10T14:33:17.039001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601132117965671:6221]
2025-10-10T14:33:17.039022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:17.039033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:17.039037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:17.039039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:17.039051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:17.039077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:17.039046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 917
2025-10-10T14:33:17.039086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:17.039142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.039153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.039146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 917
2025-10-10T14:33:17.039170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601132117965671:6221]
2025-10-10T14:33:17.039181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:17.039183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:17.039218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:17.039233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.039242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.039246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:17.039260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.039278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:17.039317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.039492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.039505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.039526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.039614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 918 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0
2025-10-10T14:33:17.040040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcc2d52-560b2ef9-c1522dc0-1d974924_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:17.042748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0] Write session: try to update token
2025-10-10T14:33:17.042772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:17.056736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId: src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:17.058068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:17.058089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:17.058093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:17.058095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:17.058106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601132117965671:6221]
2025-10-10T14:33:17.058110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601132117965671:6221]
2025-10-10T14:33:17.058114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601132117965671:6221]
2025-10-10T14:33:17.058167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:17.058182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:17.058185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:17.058189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:17.058190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.058192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:17.058339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:17.059390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:17.110505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601132900178044:7749]
2025-10-10T14:33:17.110789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 917, pipe: [1:7559601132900178044:7749]
2025-10-10T14:33:17.166168Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:17.166689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.166704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.166742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178044:7749], now have 1 active actors on pipe
2025-10-10T14:33:17.167012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601132900178044:7749]
2025-10-10T14:33:17.167027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:17.167032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:17.167046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:17.167119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 918 reason: error at write: Disconnected sessionId: src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0
2025-10-10T14:33:17.167116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:17.167319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 918 sessionId: src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0 is DEAD
2025-10-10T14:33:17.167507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:17.167535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0] Write session will restart in 0.006982s
2025-10-10T14:33:17.167560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0] Write session: Do CDS request
2025-10-10T14:33:17.167567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:17.175907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.176008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:17.176021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 919
2025-10-10T14:33:17.176157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.176194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:17.176204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:17.176208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:17.176665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 919 sessionId:  describe result for acl check
2025-10-10T14:33:17.176709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:17.176716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:17.176718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:17.176725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601132900178069:7844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:17.177301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601132900178069:7844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:17.179989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601132900178069:7844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:17.183053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601132900178069:7844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:17.183067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601132900178069:7844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:17.183071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601132900178069:7844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:17.183080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:17.185934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:17.188402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:17.188606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:17.188617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:17.188629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:17.188693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:17.188736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601132117965924:6223]
2025-10-10T14:33:17.189362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:17.189663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:17.189727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:17.190087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:17.190152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.190158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.190159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.190161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.190162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.190163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.190165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.190166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.190167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.190168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.190170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.190171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.190172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.190178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.190200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.190209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.190213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.190222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.190226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.190230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.190233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.190242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.190246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.190255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.190259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.190263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.190275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.190291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.190297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.190302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.190308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.190314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.190318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.190326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.190331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.190337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.190341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.190346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.190351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.190355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.190360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.190366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.190374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.190389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.190398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.190404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.190408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.190414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.190418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.190423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.190433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.190442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.190473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:17.192845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:17.193284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:17.193296Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:17.193298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:17.193303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:17.193311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 918 [2:7559601132117965924:6223]
2025-10-10T14:33:17.193324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:17.193373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:17.193381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.193399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.193406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.193426Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:17.193440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:17.193448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:17.193509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.193517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.193519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.193522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:17.193597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:17.193604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.193617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.193634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.193656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:17.193683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178236:7844], now have 1 active actors on pipe
2025-10-10T14:33:17.193691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178046:2438], now have 1 active actors on pipe
2025-10-10T14:33:17.193701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601132117965919:6223]
2025-10-10T14:33:17.193707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601132117965919:6223]
2025-10-10T14:33:17.193709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601132117965919:6223]
2025-10-10T14:33:17.193681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 918
2025-10-10T14:33:17.193683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 918
2025-10-10T14:33:17.193719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:17.193729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:17.193733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:17.193734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:17.193740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:17.193758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:17.193762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:17.193780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.193790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.193837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601132117965919:6223]
2025-10-10T14:33:17.193849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:17.193855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:17.193870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65d13646-c681368b-d0f9f877-b1235d67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:17.193884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.193892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.193895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:17.193907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.193923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:17.193966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.194111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.194123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.194147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.194236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 919 partition: 0 MaxSeqNo: 40 sessionId: src_id|65d13646-c681368b-d0f9f877-b1235d67_0
2025-10-10T14:33:17.194668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc88352-fb5f0fa9-b1f965b1-978bbb78_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65d13646-c681368b-d0f9f877-b1235d67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:17.197269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d13646-c681368b-d0f9f877-b1235d67_0] Write session: try to update token
2025-10-10T14:33:17.197289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d13646-c681368b-d0f9f877-b1235d67_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:17.212554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId: src_id|65d13646-c681368b-d0f9f877-b1235d67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:17.213366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:17.213386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:17.213389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:17.213392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:17.213402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601132117965919:6223]
2025-10-10T14:33:17.213407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601132117965919:6223]
2025-10-10T14:33:17.213411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601132117965919:6223]
2025-10-10T14:33:17.213463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:17.213473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:17.213479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.213480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:17.213481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:17.213483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:17.213640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:17.215262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:17.267170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601132900178297:7749]
2025-10-10T14:33:17.267492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 918, pipe: [1:7559601132900178297:7749]
2025-10-10T14:33:17.324708Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:17.325080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.325098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.325140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178297:7749], now have 1 active actors on pipe
2025-10-10T14:33:17.325409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601132900178297:7749]
2025-10-10T14:33:17.325436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:17.325436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:17.325440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:17.325508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 919 reason: error at write: Disconnected sessionId: src_id|65d13646-c681368b-d0f9f877-b1235d67_0
2025-10-10T14:33:17.325583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:17.325725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 919 sessionId: src_id|65d13646-c681368b-d0f9f877-b1235d67_0 is DEAD
2025-10-10T14:33:17.325901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d13646-c681368b-d0f9f877-b1235d67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:17.325913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d13646-c681368b-d0f9f877-b1235d67_0] Write session will restart in 0.006864s
2025-10-10T14:33:17.325939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d13646-c681368b-d0f9f877-b1235d67_0] Write session: Do CDS request
2025-10-10T14:33:17.325948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d13646-c681368b-d0f9f877-b1235d67_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:17.333943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65d13646-c681368b-d0f9f877-b1235d67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.334042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:17.334058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 920
2025-10-10T14:33:17.334171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.334221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:17.334235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:17.334243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:17.334720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 920 sessionId:  describe result for acl check
2025-10-10T14:33:17.334761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:17.334763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:17.334765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:17.334771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601132900178325:7849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:17.335344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601132900178325:7849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:17.337898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601132900178325:7849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:17.341497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601132900178325:7849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:17.341514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601132900178325:7849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:17.341518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601132900178325:7849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:17.341527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:17.345498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:17.348069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:17.348302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:17.348316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:17.348330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:17.348396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:17.348441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601132117966186:6226]
2025-10-10T14:33:17.349048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:17.349382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:17.349435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:17.349845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:17.349924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.349934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.349936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.349937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.349939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.349940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.349941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.349943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.349944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.349945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.349946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.349947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.349948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.349955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.349970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.349974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.349979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.349983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.349987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.349992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.349996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.350001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.350005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.350009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.350014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.350018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.350028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.350037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.350045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.350051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.350056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.350062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.350067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.350072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.350078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.350084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.350089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.350095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.350101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.350107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.350112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.350119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.350125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.350137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.350142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.350148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.350154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.350165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.350169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.350180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.350186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.350197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.350241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:17.352618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:17.352933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:17.352945Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:17.352947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:17.352951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:17.352957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 919 [2:7559601132117966186:6226]
2025-10-10T14:33:17.352970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:17.352989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:17.352994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.352997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.352999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.353011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:17.353017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:17.353024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:17.353069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.353077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.353079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.353083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:17.353152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:17.353159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.353170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.353182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.353200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:17.353231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178311:2438], now have 1 active actors on pipe
2025-10-10T14:33:17.353239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178482:7849], now have 1 active actors on pipe
2025-10-10T14:33:17.353246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601132117966181:6226]
2025-10-10T14:33:17.353248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601132117966181:6226]
2025-10-10T14:33:17.353250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601132117966181:6226]
2025-10-10T14:33:17.353262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:17.353275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:17.353280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:17.353284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:17.353286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:17.353290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:17.353292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:17.353310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601132117966181:6226]
2025-10-10T14:33:17.353316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:17.353288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 919
2025-10-10T14:33:17.353303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 919
2025-10-10T14:33:17.353350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:17.353544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.353557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.353590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:17.353602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.353606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.353609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:17.353619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.353630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:17.353648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.353827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.353846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.353867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.353974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 920 partition: 0 MaxSeqNo: 40 sessionId: src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0
2025-10-10T14:33:17.354385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65d13646-c681368b-d0f9f877-b1235d67_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:17.357063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0] Write session: try to update token
2025-10-10T14:33:17.357077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:17.364993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:17.365013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:17.365024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601132117966181:6226]
2025-10-10T14:33:17.365078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:17.365079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:17.365270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:17.365443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:17.365591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:17.365735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:17.365927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:17.365975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:17.372489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId: src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:17.375224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:17.375427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.375462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.375506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:17.375605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:17.383264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:17.383286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:17.383290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:17.383293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:17.383308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601132117966181:6226]
2025-10-10T14:33:17.383312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601132117966181:6226]
2025-10-10T14:33:17.383315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601132117966181:6226]
2025-10-10T14:33:17.383361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:17.383369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:17.383373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.383375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:17.383375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:17.383379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:17.383508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:17.425384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601132900178563:7749]
2025-10-10T14:33:17.425702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 919, pipe: [1:7559601132900178563:7749]
2025-10-10T14:33:17.490339Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:17.497431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.497456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.497630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.497690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.497749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.497807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.497856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.497863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.497927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.497992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.498064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.498138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.498181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.498187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.498249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.498306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.498366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.498434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.498482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.498490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.498560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.498628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.498688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.498745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.498786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.498792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.498852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.498906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.498965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.499027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.499077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.499084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.499144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.499204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.499265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.499326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.499369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.499377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.499446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.499503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.499571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.499634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.499676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.499682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.499741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.499795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.499851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.499910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.499949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.499956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.500015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.500077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.500141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.500199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.500248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.500255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.500315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.500381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.500442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.500498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.500543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.500550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.500601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178563:7749], now have 1 active actors on pipe
2025-10-10T14:33:17.500887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:17.500914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:17.500919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:17.500950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601132900178563:7749]
2025-10-10T14:33:17.500953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 920 reason: error at write: Disconnected sessionId: src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0
2025-10-10T14:33:17.501177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 920 sessionId: src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0 is DEAD
2025-10-10T14:33:17.501307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:17.501317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0] Write session will restart in 0.005437s
2025-10-10T14:33:17.501352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0] Write session: Do CDS request
2025-10-10T14:33:17.501359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:17.501662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:17.507888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.507991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:17.508003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 921
2025-10-10T14:33:17.508121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.508157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:17.508167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:17.508170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:17.508523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 921 sessionId:  describe result for acl check
2025-10-10T14:33:17.508551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:17.508556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:17.508557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:17.508562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601132900178584:7855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:17.508941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601132900178584:7855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:17.510866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601132900178584:7855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:17.514633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601132900178584:7855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:17.514646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601132900178584:7855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:17.514649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601132900178584:7855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:17.514656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:17.520296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:17.522941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:17.523197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:17.523210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:17.523222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:17.523301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:17.523342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601132117966450:6228]
2025-10-10T14:33:17.524012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:17.524330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:17.524377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:17.524741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:17.524803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.524809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.524811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.524812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.524813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.524815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.524816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.524817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.524818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.524819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.524821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.524822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.524823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.524829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.524841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.524845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.524849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.524853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.524857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.524861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.524865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.524869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.524874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.524878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.524882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.524887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.524894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.524903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.524909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.524915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.524919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.524924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.524931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.524936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.524940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.524951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.524955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.524969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.524978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.524983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.524987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.524997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.525002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.525007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.525015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.525021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.525029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.525034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.525039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.525048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.525052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.525058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.525102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:17.527433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:17.527973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:17.527985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:17.527986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:17.527989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:17.527996Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 920 [2:7559601132117966450:6228]
2025-10-10T14:33:17.528003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:17.528014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:17.528016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.528019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.528021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.528033Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:17.528041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:17.528048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:17.528093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.528098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.528100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.528101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:17.528150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:17.528155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.528162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.528169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.528182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:17.528200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601132117966445:6228]
2025-10-10T14:33:17.528205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601132117966445:6228]
2025-10-10T14:33:17.528206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601132117966445:6228]
2025-10-10T14:33:17.528213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:17.528224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:17.528225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178706:7855], now have 1 active actors on pipe
2025-10-10T14:33:17.528229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178565:2438], now have 1 active actors on pipe
2025-10-10T14:33:17.528234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:17.528235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:17.528237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:17.528243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:17.528245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:17.528263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601132117966445:6228]
2025-10-10T14:33:17.528268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:17.528276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:17.528356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 920
2025-10-10T14:33:17.528387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 920
2025-10-10T14:33:17.528426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.528441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.528477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:17.528508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.528512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.528514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:17.528526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.528546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:17.528569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.528712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.528722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.528738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.528840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 921 partition: 0 MaxSeqNo: 40 sessionId: src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0
2025-10-10T14:33:17.529209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431a0f4-69a6847a-83c549c0-b9d00629_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:17.532118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0] Write session: try to update token
2025-10-10T14:33:17.532137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:17.539724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:17.539749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:17.539763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601132117966445:6228]
2025-10-10T14:33:17.539814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:17.539821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:17.540042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:17.540222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:17.540393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:17.540568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:17.540802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:17.540856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:17.547477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId: src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:17.550178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:17.550350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.550372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.550409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:17.550486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:17.557628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:17.557646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:17.557648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:17.557649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:17.557656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601132117966445:6228]
2025-10-10T14:33:17.557660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601132117966445:6228]
2025-10-10T14:33:17.557663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601132117966445:6228]
2025-10-10T14:33:17.557697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:17.557698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:17.557702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:17.557703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.557705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:17.557705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:17.557831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:17.600960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601132900178852:7749]
2025-10-10T14:33:17.601237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 920, pipe: [1:7559601132900178852:7749]
2025-10-10T14:33:17.666818Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:17.674212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.674236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.674386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.674443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.674499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.674558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.674617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.674629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.674698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.674754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.674810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.674869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.674908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.674914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.674972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.675036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.675100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.675160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.675425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.675432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.675490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.675546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.675602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.675658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.675698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.675704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.675772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.675830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.675893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.675950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.675993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.675998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.676058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.676113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.676167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.676233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.676273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.676279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.676339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.676392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.676458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.676529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.676578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.676585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.676655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.676718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.676780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.676844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.676889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.676896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.676962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.677019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.677074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.677132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.677224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.677230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.677293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:17.677370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:17.677429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:17.677483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:17.677521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:17.677527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:17.677576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178852:7749], now have 1 active actors on pipe
2025-10-10T14:33:17.677918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:17.677919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:17.677931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:17.677962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 921 reason: error at write: Disconnected sessionId: src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0
2025-10-10T14:33:17.677972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601132900178852:7749]
2025-10-10T14:33:17.678117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:17.678184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 921 sessionId: src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0 is DEAD
2025-10-10T14:33:17.678316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:17.678325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0] Write session will restart in 0.005351s
2025-10-10T14:33:17.678350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0] Write session: Do CDS request
2025-10-10T14:33:17.678356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:17.684876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.684974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:17.684989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 922
2025-10-10T14:33:17.685112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.685149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:17.685158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:17.685161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:17.685597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 922 sessionId:  describe result for acl check
2025-10-10T14:33:17.685636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:17.685638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:17.685640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:17.685646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601132900178872:7868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:17.686170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601132900178872:7868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:17.689477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601132900178872:7868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:17.692639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601132900178872:7868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:17.692651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601132900178872:7868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:17.692665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601132900178872:7868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:17.692674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:17.696970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:17.699630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:17.699855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:17.699865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:17.699875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:17.699932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:17.699967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601132117966728:6244]
2025-10-10T14:33:17.700432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:17.700762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:17.700823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:17.701171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:17.701232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.701238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.701240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.701241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.701242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.701244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.701245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.701247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.701248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.701249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.701251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.701252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.701253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.701260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.701274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.701279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.701283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.701292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.701296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.701305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.701309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.701313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.701323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.701327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.701344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.701353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.701361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.701374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.701387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.701397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.701402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.701407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.701424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.701430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.701440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.701445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.701450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.701460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.701464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.701470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.701474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.701480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.701490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.701495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.701505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.701512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.701520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.701526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.701530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.701535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.701539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.701549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.701590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:17.704087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:17.704608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:17.704623Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:17.704625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:17.704629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:17.704635Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 921 [2:7559601132117966728:6244]
2025-10-10T14:33:17.704648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:17.704668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:17.704676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.704679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.704682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.704698Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:17.704710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:17.704718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:17.704774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.704781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.704783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.704786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:17.704852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:17.704860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.704871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.704884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.704904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:17.704930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900179027:7868], now have 1 active actors on pipe
2025-10-10T14:33:17.704938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900178858:2438], now have 1 active actors on pipe
2025-10-10T14:33:17.704946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601132117966723:6244]
2025-10-10T14:33:17.704948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601132117966723:6244]
2025-10-10T14:33:17.704951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601132117966723:6244]
2025-10-10T14:33:17.704963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:17.704981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:17.704982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:17.704985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:17.704987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:17.705002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:17.705006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:17.705011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 921
2025-10-10T14:33:17.705035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601132117966723:6244]
2025-10-10T14:33:17.705043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:17.705044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:17.705013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 921
2025-10-10T14:33:17.705059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.705064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.705119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:17.705133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.705137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.705140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:17.705152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.705168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:17.705185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.705316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.705324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.705351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.705438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 922 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0
2025-10-10T14:33:17.705873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cdb565-eea465cd-75e4deb9-1b4aeff3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:17.708669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0] Write session: try to update token
2025-10-10T14:33:17.708688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:17.723086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId: src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:17.724547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:17.724570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:17.724573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:17.724576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:17.724586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601132117966723:6244]
2025-10-10T14:33:17.724590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601132117966723:6244]
2025-10-10T14:33:17.724595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601132117966723:6244]
2025-10-10T14:33:17.724642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:17.724644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:17.724650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:17.724654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:17.724658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.724660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:17.724796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:17.725697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:17.778856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601132900179112:7749]
2025-10-10T14:33:17.779173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 921, pipe: [1:7559601132900179112:7749]
2025-10-10T14:33:17.837602Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:17.838124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.838142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.838187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900179112:7749], now have 1 active actors on pipe
2025-10-10T14:33:17.838361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:17.838355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601132900179112:7749]
2025-10-10T14:33:17.838356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:17.838360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:17.838392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:17.838424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 922 reason: error at write: Disconnected sessionId: src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0
2025-10-10T14:33:17.838636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 922 sessionId: src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0 is DEAD
2025-10-10T14:33:17.838807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:17.838819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0] Write session will restart in 0.007684s
2025-10-10T14:33:17.838843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0] Write session: Do CDS request
2025-10-10T14:33:17.838852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:17.847927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.848027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:17.848041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 923
2025-10-10T14:33:17.848175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:17.848211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:17.848217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:17.848223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:17.848709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 923 sessionId:  describe result for acl check
2025-10-10T14:33:17.848753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:17.848760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:17.848762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:17.848769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601132900179156:7872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:17.849370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601132900179156:7872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:17.852574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601132900179156:7872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:17.855885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601132900179156:7872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:17.855901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601132900179156:7872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:17.855905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601132900179156:7872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:17.855913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:17.857034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:17.860110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:17.860366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:17.860377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:17.860390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:17.860452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:17.860506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601132117966980:6246]
2025-10-10T14:33:17.861176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:17.861515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:17.861572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:17.861906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:17.861963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.861973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.861975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.861976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.861977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.861978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.861979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.861980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.861982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.861983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.861984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.861985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.861986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.861992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.862005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.862008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.862012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.862015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.862018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.862022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.862025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.862029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.862035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.862038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.862041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.862045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.862052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.862061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:17.862066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.862077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:17.862085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.862090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:17.862099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.862103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:17.862112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.862117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:17.862122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.862131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:17.862135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.862140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:17.862144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.862149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:17.862158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.862162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:17.862166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.862175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:17.862178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.862183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.862187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.862200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.862204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.862208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.862244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:17.864622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:17.864947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:17.864962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:17.864965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:17.864968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:17.864975Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 922 [2:7559601132117966980:6246]
2025-10-10T14:33:17.864986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:17.865004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:17.865011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.865014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.865017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.865035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:17.865047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:17.865053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:17.865107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.865114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.865116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.865118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:17.865180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:17.865191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.865201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:17.865211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:17.865225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:17.865251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900179363:7872], now have 1 active actors on pipe
2025-10-10T14:33:17.865258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900179114:2438], now have 1 active actors on pipe
2025-10-10T14:33:17.865267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601132117966975:6246]
2025-10-10T14:33:17.865273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601132117966975:6246]
2025-10-10T14:33:17.865275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601132117966975:6246]
2025-10-10T14:33:17.865290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:17.865302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 922
2025-10-10T14:33:17.865347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 922
2025-10-10T14:33:17.865305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:17.865314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:17.865317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:17.865320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:17.865325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:17.865349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:17.865375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601132117966975:6246]
2025-10-10T14:33:17.865378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:17.865380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:17.865402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.865412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.865460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:17.865472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:17.865476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:17.865479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:17.865490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:17.865501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:17.865523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.865715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.865729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.865754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:17.865839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 923 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0
2025-10-10T14:33:17.866251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f124ca7-44c3874c-16194e5e-a2e93d12_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:17.868863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0] Write session: try to update token
2025-10-10T14:33:17.868884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:17.883079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId: src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:17.885123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:17.885148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:17.885152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:17.885154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:17.885164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601132117966975:6246]
2025-10-10T14:33:17.885169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601132117966975:6246]
2025-10-10T14:33:17.885173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601132117966975:6246]
2025-10-10T14:33:17.885220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:17.885228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:17.885229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:17.885230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:17.885234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:17.885239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:17.885390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:17.885771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:17.938377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601132900179377:7749]
2025-10-10T14:33:17.938688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 922, pipe: [1:7559601132900179377:7749]
2025-10-10T14:33:17.993966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:17.994217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:17.994231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:17.994270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900179377:7749], now have 1 active actors on pipe
2025-10-10T14:33:17.994492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:17.994495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:17.994509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:17.994544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601132900179377:7749]
2025-10-10T14:33:17.994595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 923 reason: error at write: Disconnected sessionId: src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0
2025-10-10T14:33:17.994638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:17.994819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 923 sessionId: src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0 is DEAD
2025-10-10T14:33:17.994994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:17.995005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0] Write session will restart in 0.005285s
2025-10-10T14:33:17.995030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0] Write session: Do CDS request
2025-10-10T14:33:17.995036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:18.001792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.001865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:18.001879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 924
2025-10-10T14:33:18.002040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.002076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:18.002089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:18.002093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:18.002495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 924 sessionId:  describe result for acl check
2025-10-10T14:33:18.002534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:18.002539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:18.002541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:18.002545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601137195146689:7876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:18.002996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601137195146689:7876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:18.004965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601137195146689:7876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:18.007897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601137195146689:7876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:18.007909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601137195146689:7876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:18.007912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601137195146689:7876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:18.007921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:18.012550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:18.014706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:18.014907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:18.014920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:18.014932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:18.014990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:18.015036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601136412934529:6248]
2025-10-10T14:33:18.015477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:18.015754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:18.015798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:18.016081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:18.016140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.016149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.016150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.016151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.016152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.016153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.016155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.016156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.016157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.016158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.016159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.016160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.016161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.016167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.016180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.016184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.016188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.016192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.016196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.016200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.016204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.016208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.016212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.016217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.016220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.016224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.016232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.016240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.016246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.016258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.016268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.016277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.016281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.016289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.016293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.016298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.016307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.016313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.016324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.016333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.016337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.016342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.016346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.016350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.016354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.016359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.016368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.016373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.016383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.016393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.016401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.016410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.016455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:18.018750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:18.019061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:18.019074Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:18.019076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:18.019080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:18.019087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 923 [2:7559601136412934529:6248]
2025-10-10T14:33:18.019097Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:18.019115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:18.019118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.019122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.019124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.019139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:18.019146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:18.019159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:18.019213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.019223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.019225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.019228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:18.019291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:18.019300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.019312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.019331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.019353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:18.019373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601132900179379:2438], now have 1 active actors on pipe
2025-10-10T14:33:18.019381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195146809:7876], now have 1 active actors on pipe
2025-10-10T14:33:18.019386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601136412934524:6248]
2025-10-10T14:33:18.019388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601136412934524:6248]
2025-10-10T14:33:18.019389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601136412934524:6248]
2025-10-10T14:33:18.019399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 923
2025-10-10T14:33:18.019403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 923
2025-10-10T14:33:18.019400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:18.019415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:18.019421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:18.019424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:18.019426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:18.019430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:18.019433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:18.019479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.019486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.019500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601136412934524:6248]
2025-10-10T14:33:18.019512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:18.019525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:18.019545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18354b73-68043e10-5d3a7101-a69cc121_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:18.019557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.019560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.019567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:18.019576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.019588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:18.019609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.019758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.019764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.019776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.019878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 924 partition: 0 MaxSeqNo: 40 sessionId: src_id|18354b73-68043e10-5d3a7101-a69cc121_0
2025-10-10T14:33:18.020242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4ae03e-f9bab22f-ee96bb1c-9c363b0c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|18354b73-68043e10-5d3a7101-a69cc121_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:18.022932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18354b73-68043e10-5d3a7101-a69cc121_0] Write session: try to update token
2025-10-10T14:33:18.022950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18354b73-68043e10-5d3a7101-a69cc121_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:18.037190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId: src_id|18354b73-68043e10-5d3a7101-a69cc121_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:18.038978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:18.039008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:18.039012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:18.039014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:18.039024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601136412934524:6248]
2025-10-10T14:33:18.039028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601136412934524:6248]
2025-10-10T14:33:18.039032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601136412934524:6248]
2025-10-10T14:33:18.039084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:18.039092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.039095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:18.039174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:18.039190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:18.039206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:18.039242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:18.039973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:18.094538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601137195146931:7749]
2025-10-10T14:33:18.094805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 923, pipe: [1:7559601137195146931:7749]
2025-10-10T14:33:18.146826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:18.147273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.147288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.147328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195146931:7749], now have 1 active actors on pipe
2025-10-10T14:33:18.147547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:18.147604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601137195146931:7749]
2025-10-10T14:33:18.147623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:18.147635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:18.147718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 924 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18354b73-68043e10-5d3a7101-a69cc121_0
2025-10-10T14:33:18.147954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 924 sessionId: src_id|18354b73-68043e10-5d3a7101-a69cc121_0 is DEAD
2025-10-10T14:33:18.148101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18354b73-68043e10-5d3a7101-a69cc121_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:18.148114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18354b73-68043e10-5d3a7101-a69cc121_0] Write session will restart in 0.009779s
2025-10-10T14:33:18.148141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18354b73-68043e10-5d3a7101-a69cc121_0] Write session: Do CDS request
2025-10-10T14:33:18.148148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18354b73-68043e10-5d3a7101-a69cc121_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:18.158918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18354b73-68043e10-5d3a7101-a69cc121_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.158994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:18.159007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 925
2025-10-10T14:33:18.159170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.159205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:18.159215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:18.159219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:18.159734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 925 sessionId:  describe result for acl check
2025-10-10T14:33:18.159774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:18.159780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:18.159782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:18.159788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601137195147017:7880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:18.160395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601137195147017:7880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:18.162881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601137195147017:7880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:18.165242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601137195147017:7880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:18.165258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601137195147017:7880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:18.165263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601137195147017:7880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:18.165274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:18.165523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:18.167960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:18.168152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:18.168162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:18.168171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:18.168213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:18.168260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601136412934782:6250]
2025-10-10T14:33:18.168787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:18.169042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:18.169085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:18.169415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:18.169471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.169477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.169479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.169480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.169482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.169483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.169484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.169485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.169486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.169487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.169489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.169490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.169491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.169497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.169510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.169515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.169519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.169523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.169527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.169531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.169535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.169539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.169543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.169547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.169550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.169554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.169561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.169570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.169576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.169582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.169586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.169591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.169596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.169601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.169606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.169616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.169621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.169626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.169631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.169636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.169641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.169646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.169650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.169656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.169660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.169665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.169669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.169673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.169677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.169682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.169686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.169691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.169731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:18.172032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:18.172413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:18.172423Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:18.172425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:18.172428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:18.172433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 924 [2:7559601136412934782:6250]
2025-10-10T14:33:18.172441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:18.172454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:18.172456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.172459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.172461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.172473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:18.172478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:18.172485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:18.172533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.172537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.172538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.172540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:18.172592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:18.172597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.172604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.172610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.172620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:18.172635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601136412934776:6250]
2025-10-10T14:33:18.172640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601136412934776:6250]
2025-10-10T14:33:18.172641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601136412934776:6250]
2025-10-10T14:33:18.172648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:18.172658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195146933:2438], now have 1 active actors on pipe
2025-10-10T14:33:18.172659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:18.172661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:18.172664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:18.172664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147178:7880], now have 1 active actors on pipe
2025-10-10T14:33:18.172671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:18.172681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:18.172682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:18.172713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601136412934776:6250]
2025-10-10T14:33:18.172722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:18.172702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 924
2025-10-10T14:33:18.172712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 924
2025-10-10T14:33:18.172776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:18.172813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.172830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.172873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55d5e010-128dd56f-8519f149-55866790_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:18.172889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.172894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.172897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:18.172909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.172922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:18.172945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.173100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.173109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.173126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.173215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 925 partition: 0 MaxSeqNo: 40 sessionId: src_id|55d5e010-128dd56f-8519f149-55866790_0
2025-10-10T14:33:18.173630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18354b73-68043e10-5d3a7101-a69cc121_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55d5e010-128dd56f-8519f149-55866790_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:18.176235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55d5e010-128dd56f-8519f149-55866790_0] Write session: try to update token
2025-10-10T14:33:18.176254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55d5e010-128dd56f-8519f149-55866790_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:18.189816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:18.189838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:18.189851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601136412934776:6250]
2025-10-10T14:33:18.189904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:18.189912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:18.190088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:18.190239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:18.190339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId: src_id|55d5e010-128dd56f-8519f149-55866790_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:18.190377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:18.190522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:18.190898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:18.190945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:18.193288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:18.193510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.193527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.193566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:18.193662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:18.202430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:18.202450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:18.202454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:18.202456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:18.202467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601136412934776:6250]
2025-10-10T14:33:18.202472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601136412934776:6250]
2025-10-10T14:33:18.202475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601136412934776:6250]
2025-10-10T14:33:18.202521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:18.202520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:18.202527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:18.202532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:18.202537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.202539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:18.202687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:18.247620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601137195147190:7749]
2025-10-10T14:33:18.247872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 924, pipe: [1:7559601137195147190:7749]
2025-10-10T14:33:18.311717Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:18.319928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.319958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.320118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.320195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.320264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.320336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.320384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.320393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.320464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.320526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.320592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.320667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.320714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.320723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.320796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.320859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.320922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.320987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.321032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.321041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.321107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.321173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.321240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.321305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.321370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.321378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.321444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.321506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.321568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.321634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.321680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.321688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.321753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.321813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.321878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.321942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.321990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.321998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.322067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.322125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.322191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.322257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.322300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.322307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.322372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.322434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.322498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.322574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.322618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.322624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.322696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.322758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.322822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.322887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.322929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.322934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.322999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:18.323058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:18.323115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:18.323181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:18.323226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:18.323239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:18.323300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147190:7749], now have 1 active actors on pipe
2025-10-10T14:33:18.323516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:18.323518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601137195147190:7749]
2025-10-10T14:33:18.323545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:18.323548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:18.323575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 925 reason: error at write: Disconnected sessionId: src_id|55d5e010-128dd56f-8519f149-55866790_0
2025-10-10T14:33:18.323785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 925 sessionId: src_id|55d5e010-128dd56f-8519f149-55866790_0 is DEAD
2025-10-10T14:33:18.323976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d5e010-128dd56f-8519f149-55866790_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:18.323988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d5e010-128dd56f-8519f149-55866790_0] Write session will restart in 0.006104s
2025-10-10T14:33:18.324012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d5e010-128dd56f-8519f149-55866790_0] Write session: Do CDS request
2025-10-10T14:33:18.324018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d5e010-128dd56f-8519f149-55866790_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:18.324346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:18.330865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55d5e010-128dd56f-8519f149-55866790_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.330933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:18.330946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 926
2025-10-10T14:33:18.331118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.331154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:18.331164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:18.331168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:18.331606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 926 sessionId:  describe result for acl check
2025-10-10T14:33:18.331644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:18.331651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:18.331652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:18.331659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601137195147219:7885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:18.332226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601137195147219:7885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:18.335033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601137195147219:7885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:18.338278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601137195147219:7885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:18.338292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601137195147219:7885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:18.338296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601137195147219:7885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:18.338304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:18.343658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:18.346465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:18.346736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:18.346754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:18.346772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:18.346867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:18.346920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601136412935050:6253]
2025-10-10T14:33:18.347536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:18.347861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:18.347909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:18.348233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:18.348308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.348317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.348319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.348320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.348322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.348323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.348324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.348326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.348327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.348329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.348330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.348331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.348332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.348339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.348352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.348357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.348362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.348366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.348371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.348375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.348379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.348384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.348388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.348393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.348397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.348402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.348410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.348419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.348430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.348436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.348441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.348451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.348456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.348461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.348470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.348480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.348489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.348499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.348509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.348518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.348527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.348537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.348547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.348557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.348566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.348576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.348585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.348594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.348603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.348613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.348622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.348631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.348689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:18.351138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:18.351617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:18.351633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:18.351635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:18.351639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:18.351646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 925 [2:7559601136412935050:6253]
2025-10-10T14:33:18.351659Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:18.351677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:18.351681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.351684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.351686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.351703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:18.351715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:18.351727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:18.351782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.351788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.351790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.351793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:18.351861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:18.351872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.351884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.351896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.351913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:18.351939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147204:2438], now have 1 active actors on pipe
2025-10-10T14:33:18.351947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147336:7885], now have 1 active actors on pipe
2025-10-10T14:33:18.351956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601136412935045:6253]
2025-10-10T14:33:18.351959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601136412935045:6253]
2025-10-10T14:33:18.351961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601136412935045:6253]
2025-10-10T14:33:18.351978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:18.351990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:18.351993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:18.351995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:18.351998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:18.352014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:18.352023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:18.351986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 925
2025-10-10T14:33:18.351993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 925
2025-10-10T14:33:18.352058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.352068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.352087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601136412935045:6253]
2025-10-10T14:33:18.352095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:18.352115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:18.352131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:18.352144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.352152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.352155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:18.352166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.352182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:18.352206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.352322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.352328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.352339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.352416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 926 partition: 0 MaxSeqNo: 40 sessionId: src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0
2025-10-10T14:33:18.352786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55d5e010-128dd56f-8519f149-55866790_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:18.355495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0] Write session: try to update token
2025-10-10T14:33:18.355516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:18.369774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId: src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:18.371571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:18.371592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:18.371595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:18.371597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:18.371609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601136412935045:6253]
2025-10-10T14:33:18.371614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601136412935045:6253]
2025-10-10T14:33:18.371620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601136412935045:6253]
2025-10-10T14:33:18.371666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:18.371670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:18.371678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.371680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:18.371682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:18.371695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:18.371821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:18.372424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:18.423741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601137195147463:7749]
2025-10-10T14:33:18.423996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 925, pipe: [1:7559601137195147463:7749]
2025-10-10T14:33:18.482089Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:18.482583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.482598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.482638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147463:7749], now have 1 active actors on pipe
2025-10-10T14:33:18.482837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:18.482871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601137195147463:7749]
2025-10-10T14:33:18.482902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:18.482916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:18.482986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 926 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0
2025-10-10T14:33:18.483201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 926 sessionId: src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0 is DEAD
2025-10-10T14:33:18.483336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:18.483347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0] Write session will restart in 0.009552s
2025-10-10T14:33:18.483371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0] Write session: Do CDS request
2025-10-10T14:33:18.483377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:18.493814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.493969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:18.493983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 927
2025-10-10T14:33:18.494136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.494170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:18.494180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:18.494184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:18.494643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 927 sessionId:  describe result for acl check
2025-10-10T14:33:18.494676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:18.494687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:18.494688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:18.494694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601137195147572:7889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:18.495244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601137195147572:7889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:18.497655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601137195147572:7889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:18.499427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:18.502047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:18.502243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601137195147572:7889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:18.502257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601137195147572:7889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:18.502249Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:18.502261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601137195147572:7889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:18.502262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:18.502269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:18.502273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:18.502325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:18.502367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601136412935304:6255]
2025-10-10T14:33:18.502998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:18.503337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:18.503398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:18.503715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:18.503804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.503811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.503812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.503813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.503815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.503816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.503817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.503819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.503820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.503821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.503822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.503823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.503825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.503831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.503844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.503849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.503853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.503857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.503866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.503870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.503874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.503878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.503882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.503886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.503889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.503892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.503900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.503916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.503927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.503932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.503937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.503942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.503948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.503953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.503958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.503962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.503967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.503976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.503981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.503990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.503995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.504005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.504010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.504015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.504019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.504025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.504029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.504033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.504036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.504041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.504053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.504058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.504094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:18.506295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:18.506628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:18.506641Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:18.506643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:18.506647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:18.506652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 926 [2:7559601136412935304:6255]
2025-10-10T14:33:18.506663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:18.506679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:18.506687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.506691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.506693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.506708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:18.506716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:18.506727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:18.506782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.506795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.506798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.506800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:18.506862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:18.506870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.506880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.506898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.506920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:18.506946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147465:2438], now have 1 active actors on pipe
2025-10-10T14:33:18.506955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147713:7889], now have 1 active actors on pipe
2025-10-10T14:33:18.506962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601136412935299:6255]
2025-10-10T14:33:18.506968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601136412935299:6255]
2025-10-10T14:33:18.506971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601136412935299:6255]
2025-10-10T14:33:18.506984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:18.506996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:18.506979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 926
2025-10-10T14:33:18.507002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:18.506983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 926
2025-10-10T14:33:18.507004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:18.507006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:18.507018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:18.507022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:18.507057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.507070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.507084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601136412935299:6255]
2025-10-10T14:33:18.507093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:18.507111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:18.507128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:18.507141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.507149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.507151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:18.507162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.507177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:18.507202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.507375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.507383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.507398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.507482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 927 partition: 0 MaxSeqNo: 40 sessionId: src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0
2025-10-10T14:33:18.507833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cffa75-83525cd8-d669ceca-f28d6d17_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:18.510440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0] Write session: try to update token
2025-10-10T14:33:18.510458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:18.524373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId: src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:18.526517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:18.526552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:18.526555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:18.526556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:18.526564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601136412935299:6255]
2025-10-10T14:33:18.526567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601136412935299:6255]
2025-10-10T14:33:18.526570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601136412935299:6255]
2025-10-10T14:33:18.526607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:18.526611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:18.526614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:18.526621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:18.526629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.526632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:18.526764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:18.527059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:18.582966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601137195147744:7749]
2025-10-10T14:33:18.583214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 926, pipe: [1:7559601137195147744:7749]
2025-10-10T14:33:18.638562Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:18.638801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.638815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.638855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147744:7749], now have 1 active actors on pipe
2025-10-10T14:33:18.639078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:18.639154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601137195147744:7749]
2025-10-10T14:33:18.639155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:18.639187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:18.639265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 927 reason: status is not ok: tablet will be restarted right now sessionId: src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0
2025-10-10T14:33:18.639481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 927 sessionId: src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0 is DEAD
2025-10-10T14:33:18.639680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:18.639692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0] Write session will restart in 0.006913s
2025-10-10T14:33:18.639716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0] Write session: Do CDS request
2025-10-10T14:33:18.639721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:18.647841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.647915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:18.647939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 928
2025-10-10T14:33:18.648107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.648153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:18.648162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:18.648167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:18.648730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 928 sessionId:  describe result for acl check
2025-10-10T14:33:18.648764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:18.648771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:18.648773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:18.648779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601137195147783:7904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:18.649367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601137195147783:7904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:18.652189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601137195147783:7904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:18.655126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601137195147783:7904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:18.655137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601137195147783:7904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:18.655140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601137195147783:7904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:18.655146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:18.658988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:18.661391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:18.661601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:18.661613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:18.661626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:18.661687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:18.661733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601136412935603:6271]
2025-10-10T14:33:18.662399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:18.662703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:18.662751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:18.663090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:18.663151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.663157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.663158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.663159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.663161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.663162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.663163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.663164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.663165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.663166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.663168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.663169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.663170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.663176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.663189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.663193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.663198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.663202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.663207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.663211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.663215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.663219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.663225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.663229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.663234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.663238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.663247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.663256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.663262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.663269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.663273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.663284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.663293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.663304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.663314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.663323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.663329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.663335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.663344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.663350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.663359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.663369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.663379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.663385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.663389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.663395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.663400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.663406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.663416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.663421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.663426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.663431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.663478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:18.665720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:18.666134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:18.666149Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:18.666151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:18.666155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:18.666161Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 927 [2:7559601136412935603:6271]
2025-10-10T14:33:18.666173Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:18.666190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:18.666199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.666202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.666204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.666221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:18.666234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:18.666247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:18.666299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.666309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.666311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.666314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:18.666380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:18.666387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.666399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.666418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.666441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:18.666467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147757:2438], now have 1 active actors on pipe
2025-10-10T14:33:18.666476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195147946:7904], now have 1 active actors on pipe
2025-10-10T14:33:18.666484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601136412935598:6271]
2025-10-10T14:33:18.666486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601136412935598:6271]
2025-10-10T14:33:18.666489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601136412935598:6271]
2025-10-10T14:33:18.666502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:18.666521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:18.666521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:18.666524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:18.666526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:18.666538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 927
2025-10-10T14:33:18.666555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:18.666568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:18.666607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.666621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.666637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601136412935598:6271]
2025-10-10T14:33:18.666649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:18.666660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:18.666680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:18.666692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.666696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.666698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:18.666710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.666725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:18.666753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.666863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 927
2025-10-10T14:33:18.666884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.666894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.667181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.667300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 928 partition: 0 MaxSeqNo: 40 sessionId: src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0
2025-10-10T14:33:18.667683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473a15a6-2f66b3bd-b2132de1-9cde86bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:18.670385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0] Write session: try to update token
2025-10-10T14:33:18.670404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:18.684374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId: src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:18.686823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:18.686844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:18.686847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:18.686850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:18.686860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601136412935598:6271]
2025-10-10T14:33:18.686865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601136412935598:6271]
2025-10-10T14:33:18.686869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601136412935598:6271]
2025-10-10T14:33:18.686911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:18.686917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.686918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:18.686928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:18.686934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:18.686939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:18.686967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:18.687042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:18.739152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601137195148020:7749]
2025-10-10T14:33:18.739428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 927, pipe: [1:7559601137195148020:7749]
2025-10-10T14:33:18.792789Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:18.793203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.793214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.793251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195148020:7749], now have 1 active actors on pipe
2025-10-10T14:33:18.793437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:18.793495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:18.793538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601137195148020:7749]
2025-10-10T14:33:18.793547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:18.793624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 928 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0
2025-10-10T14:33:18.793829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 928 sessionId: src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0 is DEAD
2025-10-10T14:33:18.793989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:18.794000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0] Write session will restart in 0.006385s
2025-10-10T14:33:18.794024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0] Write session: Do CDS request
2025-10-10T14:33:18.794029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:18.801850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.801933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:18.801946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 929
2025-10-10T14:33:18.802084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.802131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:18.802141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:18.802145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:18.802610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 929 sessionId:  describe result for acl check
2025-10-10T14:33:18.802646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:18.802652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:18.802654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:18.802659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601137195148050:7908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:18.803136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601137195148050:7908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:18.806088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601137195148050:7908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:18.809531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601137195148050:7908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:18.809544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601137195148050:7908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:18.809547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601137195148050:7908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:18.809555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:18.810923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:18.813382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:18.813574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:18.813584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:18.813594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:18.813637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:18.813670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601136412935862:6273]
2025-10-10T14:33:18.814083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:18.814354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:18.814384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:18.814603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:18.814645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.814650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.814650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.814651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.814652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.814653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.814653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.814654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.814655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.814656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.814657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.814657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.814658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.814661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.814670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.814673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.814675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.814678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.814680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.814682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.814684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.814687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.814689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.814691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.814694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.814696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.814702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.814707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.814711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.814715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.814717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.814720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.814723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.814727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.814729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.814733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.814736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.814739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.814741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.814745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.814748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.814751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.814754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.814757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.814760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.814763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.814766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.814769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.814771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.814774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.814778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.814781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.814806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:18.817111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:18.817424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:18.817433Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:18.817434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:18.817438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:18.817443Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 928 [2:7559601136412935862:6273]
2025-10-10T14:33:18.817452Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:18.817466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:18.817471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.817474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.817476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.817490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:18.817499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:18.817505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:18.817554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.817560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.817563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.817565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:18.817622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:18.817628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.817638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.817652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.817672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:18.817695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195148269:7908], now have 1 active actors on pipe
2025-10-10T14:33:18.817705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601136412935857:6273]
2025-10-10T14:33:18.817707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601136412935857:6273]
2025-10-10T14:33:18.817708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601136412935857:6273]
2025-10-10T14:33:18.817718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:18.817728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195148022:2438], now have 1 active actors on pipe
2025-10-10T14:33:18.817738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:18.817745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:18.817748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:18.817750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:18.817754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:18.817757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:18.817769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601136412935857:6273]
2025-10-10T14:33:18.817771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:18.817773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:18.817777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 928
2025-10-10T14:33:18.817788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 928
2025-10-10T14:33:18.817891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.817902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.817930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd28f5b2-5a0207b1-185d665-464efe12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:18.817940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.817943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.817945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:18.817952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.817962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:18.817973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.818102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.818109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.818123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.818207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 929 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd28f5b2-5a0207b1-185d665-464efe12_0
2025-10-10T14:33:18.818624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c6b4d8-bae99670-912597b9-2cb1613f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd28f5b2-5a0207b1-185d665-464efe12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:18.821246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd28f5b2-5a0207b1-185d665-464efe12_0] Write session: try to update token
2025-10-10T14:33:18.821264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd28f5b2-5a0207b1-185d665-464efe12_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:18.835486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId: src_id|dd28f5b2-5a0207b1-185d665-464efe12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:18.837286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:18.837301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:18.837304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:18.837306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:18.837317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601136412935857:6273]
2025-10-10T14:33:18.837322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601136412935857:6273]
2025-10-10T14:33:18.837326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601136412935857:6273]
2025-10-10T14:33:18.837386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:18.837391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:18.837398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:18.837399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.837401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:18.837401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:18.837546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:18.838133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:18.893777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601137195148283:7749]
2025-10-10T14:33:18.894098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 928, pipe: [1:7559601137195148283:7749]
2025-10-10T14:33:18.947869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:18.948543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.948558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.948597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195148283:7749], now have 1 active actors on pipe
2025-10-10T14:33:18.948762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:18.948837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:18.948839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:18.948851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:18.948882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601137195148283:7749]
2025-10-10T14:33:18.948917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 929 reason: error at write: Disconnected sessionId: src_id|dd28f5b2-5a0207b1-185d665-464efe12_0
2025-10-10T14:33:18.949137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 929 sessionId: src_id|dd28f5b2-5a0207b1-185d665-464efe12_0 is DEAD
2025-10-10T14:33:18.949263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd28f5b2-5a0207b1-185d665-464efe12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:18.949272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd28f5b2-5a0207b1-185d665-464efe12_0] Write session will restart in 0.006613s
2025-10-10T14:33:18.949290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd28f5b2-5a0207b1-185d665-464efe12_0] Write session: Do CDS request
2025-10-10T14:33:18.949297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd28f5b2-5a0207b1-185d665-464efe12_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:18.956794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd28f5b2-5a0207b1-185d665-464efe12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.956920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:18.956932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 930
2025-10-10T14:33:18.957045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:18.957073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:18.957076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:18.957080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:18.957526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 930 sessionId:  describe result for acl check
2025-10-10T14:33:18.957571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:18.957573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:18.957575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:18.957582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601137195148301:7912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:18.958134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601137195148301:7912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:18.960630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601137195148301:7912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:18.963201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601137195148301:7912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:18.963217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601137195148301:7912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:18.963221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601137195148301:7912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:18.963229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:18.967273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:18.970049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:18.970257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:18.970268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:18.970281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:18.970341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:18.970383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601136412936122:6275]
2025-10-10T14:33:18.970949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:18.971246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:18.971290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:18.971567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:18.971614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.971621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.971622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.971622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.971623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.971623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.971624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.971625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.971625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.971626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.971627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.971627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.971628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.971633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.971641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.971644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.971646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.971648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.971650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.971652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.971654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.971656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.971659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.971661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.971663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.971665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.971670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.971676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:18.971680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.971684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:18.971686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.971689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:18.971692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.971695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:18.971698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.971701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:18.971704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.971707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:18.971710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.971713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:18.971716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.971721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:18.971726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.971731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:18.971734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.971740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:18.971747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.971752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.971757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.971763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.971767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.971772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.971814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:18.974105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:18.974766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:18.974777Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:18.974779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:18.974782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:18.974788Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 929 [2:7559601136412936122:6275]
2025-10-10T14:33:18.974801Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:18.974818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:18.974827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.974830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.974833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.974848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:18.974860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:18.974871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:18.974926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.974934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.974936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.974939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:18.975002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:18.975013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.975024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:18.975036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:18.975053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:18.975075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195148284:2438], now have 1 active actors on pipe
2025-10-10T14:33:18.975083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601137195148433:7912], now have 1 active actors on pipe
2025-10-10T14:33:18.975091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601136412936117:6275]
2025-10-10T14:33:18.975098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601136412936117:6275]
2025-10-10T14:33:18.975100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601136412936117:6275]
2025-10-10T14:33:18.975114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:18.975124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:18.975130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:18.975130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:18.975131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:18.975146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:18.975153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:18.975175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601136412936117:6275]
2025-10-10T14:33:18.975187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:18.975223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:18.975238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 929
2025-10-10T14:33:18.975267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 929
2025-10-10T14:33:18.975305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.975317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.975352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:18.975364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:18.975368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:18.975375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:18.975386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:18.975398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:18.975417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.975577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:18.975593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:18.975609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:18.975710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 930 partition: 0 MaxSeqNo: 40 sessionId: src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0
2025-10-10T14:33:18.976118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd28f5b2-5a0207b1-185d665-464efe12_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:18.978750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0] Write session: try to update token
2025-10-10T14:33:18.978770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:18.992959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId: src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:18.994202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:18.994220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:18.994223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:18.994225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:18.994235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601136412936117:6275]
2025-10-10T14:33:18.994239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601136412936117:6275]
2025-10-10T14:33:18.994244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601136412936117:6275]
2025-10-10T14:33:18.994291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:18.994299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:18.994301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:18.994307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:18.994315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:18.994320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:18.994442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:18.995599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:19.048927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601141490115843:7749]
2025-10-10T14:33:19.049253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 929, pipe: [1:7559601141490115843:7749]
2025-10-10T14:33:19.105033Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:19.105318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.105350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.105401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490115843:7749], now have 1 active actors on pipe
2025-10-10T14:33:19.105705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:19.105718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:19.105726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601141490115843:7749]
2025-10-10T14:33:19.105749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:19.105791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 930 reason: error at write: Disconnected sessionId: src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0
2025-10-10T14:33:19.105850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:19.106040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 930 sessionId: src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0 is DEAD
2025-10-10T14:33:19.106230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:19.106239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0] Write session will restart in 0.009956s
2025-10-10T14:33:19.106264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0] Write session: Do CDS request
2025-10-10T14:33:19.106270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:19.117958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.118017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:19.118034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 931
2025-10-10T14:33:19.118229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.118288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:19.118303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:19.118307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:19.118799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 931 sessionId:  describe result for acl check
2025-10-10T14:33:19.118851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:19.118860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:19.118863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:19.118870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601141490115926:7916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:19.119478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601141490115926:7916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:19.122842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601141490115926:7916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:19.126169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601141490115926:7916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:19.126184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601141490115926:7916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:19.126187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601141490115926:7916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:19.126196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:19.126394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:19.129361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:19.129589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:19.129602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:19.129614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:19.129667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:19.129720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601140707903679:6277]
2025-10-10T14:33:19.130326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:19.130692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:19.130730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:19.130977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:19.131035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.131042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.131043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.131045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.131046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.131047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.131048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.131049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.131050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.131051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.131053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.131054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.131056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.131063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.131076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.131079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.131083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.131087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.131090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.131094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.131098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.131101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.131105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.131108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.131112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.131115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.131126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.131134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.131141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.131146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.131150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.131155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.131159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.131164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.131168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.131172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.131177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.131184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.131188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.131193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.131198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.131203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.131208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.131213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.131216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.131221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.131226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.131231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.131241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.131245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.131249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.131253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.131291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:19.134047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:19.134526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:19.134538Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:19.134540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:19.134543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:19.134549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 930 [2:7559601140707903679:6277]
2025-10-10T14:33:19.134559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:19.134578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:19.134587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.134591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.134594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.134612Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:19.134624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:19.134637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:19.134692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.134699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.134701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.134704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:19.134780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:19.134788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.134801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.134814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.134838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:19.134865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116097:7916], now have 1 active actors on pipe
2025-10-10T14:33:19.134874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490115844:2438], now have 1 active actors on pipe
2025-10-10T14:33:19.134881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601140707903673:6277]
2025-10-10T14:33:19.134888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601140707903673:6277]
2025-10-10T14:33:19.134890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601140707903673:6277]
2025-10-10T14:33:19.134904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:19.134923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:19.134925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:19.134929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:19.134931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:19.134946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:19.134954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:19.134933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 930
2025-10-10T14:33:19.134936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 930
2025-10-10T14:33:19.134990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601140707903673:6277]
2025-10-10T14:33:19.135006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:19.135017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:19.135030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.135035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.135088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45890d84-475402c9-a14f353a-9c479446_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:19.135100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.135103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.135106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:19.135117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.135128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:19.135156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.135321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.135330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.135346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.135427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 931 partition: 0 MaxSeqNo: 40 sessionId: src_id|45890d84-475402c9-a14f353a-9c479446_0
2025-10-10T14:33:19.135876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff34d56-1f7fa6bc-72a5bddc-b969305c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45890d84-475402c9-a14f353a-9c479446_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:19.138593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45890d84-475402c9-a14f353a-9c479446_0] Write session: try to update token
2025-10-10T14:33:19.138617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45890d84-475402c9-a14f353a-9c479446_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:19.153245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId: src_id|45890d84-475402c9-a14f353a-9c479446_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:19.154774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:19.154794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:19.154798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:19.154800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:19.154810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601140707903673:6277]
2025-10-10T14:33:19.154814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601140707903673:6277]
2025-10-10T14:33:19.154818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601140707903673:6277]
2025-10-10T14:33:19.154862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:19.154868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.154876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:19.154881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:19.154888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:19.154893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:19.155009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:19.155920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:19.206058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601141490116109:7749]
2025-10-10T14:33:19.206351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 930, pipe: [1:7559601141490116109:7749]
2025-10-10T14:33:19.265077Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:19.265740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.265761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.265828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116109:7749], now have 1 active actors on pipe
2025-10-10T14:33:19.266035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:19.266038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:19.266049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:19.266054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601141490116109:7749]
2025-10-10T14:33:19.266074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:19.266131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 931 reason: error at write: Disconnected sessionId: src_id|45890d84-475402c9-a14f353a-9c479446_0
2025-10-10T14:33:19.266334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 931 sessionId: src_id|45890d84-475402c9-a14f353a-9c479446_0 is DEAD
2025-10-10T14:33:19.266506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45890d84-475402c9-a14f353a-9c479446_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:19.266538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45890d84-475402c9-a14f353a-9c479446_0] Write session will restart in 0.007016s
2025-10-10T14:33:19.266564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45890d84-475402c9-a14f353a-9c479446_0] Write session: Do CDS request
2025-10-10T14:33:19.266574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45890d84-475402c9-a14f353a-9c479446_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:19.274901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45890d84-475402c9-a14f353a-9c479446_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.274965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:19.274979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 932
2025-10-10T14:33:19.275149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.275194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:19.275202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:19.275207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:19.275702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 932 sessionId:  describe result for acl check
2025-10-10T14:33:19.275735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:19.275741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:19.275743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:19.275749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601141490116145:7920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:19.276292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601141490116145:7920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:19.278848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601141490116145:7920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:19.282168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601141490116145:7920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:19.282181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601141490116145:7920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:19.282184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601141490116145:7920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:19.282193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:19.284692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:19.285538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:19.285840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:19.285854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:19.285868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:19.285935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:19.285989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601140707903942:6279]
2025-10-10T14:33:19.286630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:19.286925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:19.286969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:19.287317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:19.287382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.287389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.287390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.287391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.287392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.287394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.287395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.287396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.287397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.287399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.287400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.287401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.287402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.287408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.287422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.287426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.287430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.287435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.287439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.287443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.287447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.287451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.287454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.287458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.287463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.287467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.287474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.287493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.287501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.287507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.287518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.287523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.287534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.287539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.287544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.287549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.287554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.287559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.287563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.287568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.287572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.287578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.287582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.287589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.287593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.287598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.287604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.287609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.287613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.287618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.287623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.287628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.287671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:19.289970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:19.290263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:19.290271Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:19.290273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:19.290275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:19.290280Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 931 [2:7559601140707903942:6279]
2025-10-10T14:33:19.290288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:19.290301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:19.290303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.290305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.290307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.290319Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:19.290330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:19.290337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:19.290388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.290393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.290395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.290397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:19.290628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 931
2025-10-10T14:33:19.290638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:19.290641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 931
2025-10-10T14:33:19.290650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.290660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.290672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.290690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:19.290715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116110:2438], now have 1 active actors on pipe
2025-10-10T14:33:19.290724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116342:7920], now have 1 active actors on pipe
2025-10-10T14:33:19.290731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601140707903936:6279]
2025-10-10T14:33:19.290738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601140707903936:6279]
2025-10-10T14:33:19.290740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601140707903936:6279]
2025-10-10T14:33:19.290750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:19.290768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:19.290775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:19.290778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:19.290780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:19.290782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:19.290784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:19.290816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.290822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.290834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601140707903936:6279]
2025-10-10T14:33:19.290843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:19.290854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:19.290869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:19.290879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.290883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.290886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:19.290897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.290909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:19.290927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.291099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.291109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.291126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.291214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 932 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0
2025-10-10T14:33:19.291628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45890d84-475402c9-a14f353a-9c479446_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:19.295225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0] Write session: try to update token
2025-10-10T14:33:19.295248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:19.311271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:19.311286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:19.311289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:19.311291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:19.311301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601140707903936:6279]
2025-10-10T14:33:19.311308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601140707903936:6279]
2025-10-10T14:33:19.311313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601140707903936:6279]
2025-10-10T14:33:19.311361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:19.311369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:19.311373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.311375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:19.311376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:19.311384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:19.311497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:19.312892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId: src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:19.323389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:19.366348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601141490116387:7749]
2025-10-10T14:33:19.366653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 931, pipe: [1:7559601141490116387:7749]
2025-10-10T14:33:19.418973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:19.419368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.419381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.419402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116387:7749], now have 1 active actors on pipe
2025-10-10T14:33:19.419621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:19.419667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:19.419671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601141490116387:7749]
2025-10-10T14:33:19.419674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:19.419729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 932 reason: error at write: Disconnected sessionId: src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0
2025-10-10T14:33:19.419937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 932 sessionId: src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0 is DEAD
2025-10-10T14:33:19.420122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:19.420135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0] Write session will restart in 0.007842s
2025-10-10T14:33:19.420171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0] Write session: Do CDS request
2025-10-10T14:33:19.420178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:19.420549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:19.428880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.428965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:19.428980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 933
2025-10-10T14:33:19.429088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.429123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:19.429133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:19.429137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:19.429573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 933 sessionId:  describe result for acl check
2025-10-10T14:33:19.429620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:19.429626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:19.429628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:19.429634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601141490116594:7925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:19.430141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601141490116594:7925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:19.432421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601141490116594:7925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:19.435037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601141490116594:7925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:19.435051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601141490116594:7925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:19.435054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601141490116594:7925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:19.435062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:19.436696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:19.437452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:19.437625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:19.437636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:19.437648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:19.437695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:19.437737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601140707904217:6282]
2025-10-10T14:33:19.438337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:19.438630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:19.438670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:19.438978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:19.439030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.439036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.439037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.439038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.439040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.439041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.439042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.439043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.439044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.439045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.439047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.439048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.439049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.439054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.439067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.439071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.439075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.439079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.439083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.439091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.439095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.439103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.439107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.439114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.439116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.439118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.439124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.439134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.439144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.439155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.439161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.439164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.439167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.439173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.439176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.439179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.439181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.439184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.439187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.439190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.439192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.439195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.439197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.439200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.439203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.439206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.439208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.439211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.439217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.439220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.439223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.439229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.439251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:19.441500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:19.441869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:19.441879Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:19.441880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:19.441883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:19.441888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 932 [2:7559601140707904217:6282]
2025-10-10T14:33:19.441901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:19.441918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:19.441926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.441928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.441929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.441943Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:19.441948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:19.441954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:19.441995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.442000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.442002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.442003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:19.442063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:19.442070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.442080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.442094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.442114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:19.442139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116851:7925], now have 1 active actors on pipe
2025-10-10T14:33:19.442146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116391:2438], now have 1 active actors on pipe
2025-10-10T14:33:19.442154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601140707904212:6282]
2025-10-10T14:33:19.442158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601140707904212:6282]
2025-10-10T14:33:19.442160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601140707904212:6282]
2025-10-10T14:33:19.442177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:19.442193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:19.442203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:19.442211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:19.442214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:19.442214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:19.442216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:19.442234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601140707904212:6282]
2025-10-10T14:33:19.442241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:19.442260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:19.442339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.442202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 932
2025-10-10T14:33:19.442282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 932
2025-10-10T14:33:19.442349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.442377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:19.442389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.442393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.442395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:19.442405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.442420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:19.442438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.442658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.442667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.442682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.442764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 933 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0
2025-10-10T14:33:19.443123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f914ff-404d1f09-b590cf3a-fbdc71e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:19.445644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0] Write session: try to update token
2025-10-10T14:33:19.445660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:19.453697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:19.453711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:19.453722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601140707904212:6282]
2025-10-10T14:33:19.453767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:19.453769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:19.453944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:19.454091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:19.454226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:19.454366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:19.454561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:19.454599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:19.459210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId: src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:19.461851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:19.462065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.462083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.462122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:19.462203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:19.471708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:19.471725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:19.471728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:19.471729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:19.471739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601140707904212:6282]
2025-10-10T14:33:19.471742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601140707904212:6282]
2025-10-10T14:33:19.471745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601140707904212:6282]
2025-10-10T14:33:19.471786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:19.471793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.471796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:19.471802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:19.471809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:19.471814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:19.471920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:19.519942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601141490116867:7749]
2025-10-10T14:33:19.520223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 932, pipe: [1:7559601141490116867:7749]
2025-10-10T14:33:19.578680Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:19.586075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.586098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.586232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.586290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.586349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.586404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.586446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.586456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.586542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.586630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.586685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.586744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.586784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.586792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.586850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.586902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.586957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.587014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.587056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.587062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.587120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.587177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.587234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.587289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.587328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.587334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.587393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.587465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.587527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.587582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.587621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.587626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.587694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.587758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.587814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.587867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.587909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.587915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.587972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.588025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.588083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.588138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.588178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.588183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.588240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.588292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.588346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.588400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.588438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.588443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.588503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.588569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.588623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.588680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.588719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.588726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.588785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:19.588836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:19.588899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:19.588960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:19.589000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:19.589005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:19.589043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116867:7749], now have 1 active actors on pipe
2025-10-10T14:33:19.589318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:19.589342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:19.589373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 933 reason: error at write: Disconnected sessionId: src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0
2025-10-10T14:33:19.589393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601141490116867:7749]
2025-10-10T14:33:19.589414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:19.589580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 933 sessionId: src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0 is DEAD
2025-10-10T14:33:19.589754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:19.589764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0] Write session will restart in 0.009147s
2025-10-10T14:33:19.589790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0] Write session: Do CDS request
2025-10-10T14:33:19.589807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:19.590088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:19.599967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.600053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:19.600079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 934
2025-10-10T14:33:19.600195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.600231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:19.600242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:19.600249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:19.600707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 934 sessionId:  describe result for acl check
2025-10-10T14:33:19.600743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:19.600749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:19.600751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:19.600757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601141490117063:7931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:19.601355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601141490117063:7931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:19.603847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601141490117063:7931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:19.606710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601141490117063:7931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:19.606724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601141490117063:7931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:19.606727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601141490117063:7931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:19.606736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:19.607757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:19.609047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:19.609247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:19.609257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:19.609270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:19.609321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:19.609376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601140707904494:6284]
2025-10-10T14:33:19.610001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:19.610326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:19.610369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:19.610687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:19.610743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.610749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.610750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.610751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.610752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.610754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.610755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.610756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.610757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.610759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.610760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.610761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.610762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.610768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.610780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.610784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.610788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.610792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.610796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.610800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.610805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.610809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.610813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.610817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.610821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.610824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.610831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.610839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.610846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.610851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.610855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.610860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.610865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.610870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.610877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.610882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.610887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.610897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.610901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.610907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.610911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.610922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.610926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.610932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.610940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.610945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.610950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.610959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.610963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.610968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.610974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.610983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.611022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:19.613284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:19.613685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:19.613697Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:19.613699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:19.613702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:19.613707Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 933 [2:7559601140707904494:6284]
2025-10-10T14:33:19.613719Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:19.613748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:19.613756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.613760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.613762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.613779Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:19.613790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:19.613797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:19.613857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.613863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.613865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.613867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:19.613943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:19.613950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.613963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.613979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.614006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:19.614032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490117339:7931], now have 1 active actors on pipe
2025-10-10T14:33:19.614040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490116875:2438], now have 1 active actors on pipe
2025-10-10T14:33:19.614048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601140707904480:6284]
2025-10-10T14:33:19.614054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601140707904480:6284]
2025-10-10T14:33:19.614057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601140707904480:6284]
2025-10-10T14:33:19.614073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:19.614087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:19.614091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:19.614074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 933
2025-10-10T14:33:19.614095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:19.614109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 933
2025-10-10T14:33:19.614097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:19.614118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:19.614121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:19.614149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601140707904480:6284]
2025-10-10T14:33:19.614159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:19.614171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:19.614173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.614177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.614221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:19.614234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.614239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.614245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:19.614257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.614272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:19.614296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.614416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.614423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.614438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.614563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 934 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0
2025-10-10T14:33:19.614950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f99573-4360d64a-e0e6670d-d4b43cb9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:19.617458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0] Write session: try to update token
2025-10-10T14:33:19.617474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:19.632114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId: src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:19.633541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:19.633557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:19.633560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:19.633561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:19.633569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601140707904480:6284]
2025-10-10T14:33:19.633572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601140707904480:6284]
2025-10-10T14:33:19.633575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601140707904480:6284]
2025-10-10T14:33:19.633615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:19.633621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.633623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:19.633697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:19.633710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:19.633714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:19.633753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:19.634916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:19.689424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601141490117377:7749]
2025-10-10T14:33:19.689739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 933, pipe: [1:7559601141490117377:7749]
2025-10-10T14:33:19.741575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:19.742082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.742096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.742134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490117377:7749], now have 1 active actors on pipe
2025-10-10T14:33:19.742401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:19.742415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:19.742422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:19.742460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601141490117377:7749]
2025-10-10T14:33:19.742511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 934 reason: error at write: Disconnected sessionId: src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0
2025-10-10T14:33:19.742713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 934 sessionId: src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0 is DEAD
2025-10-10T14:33:19.742855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:19.742864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0] Write session will restart in 0.007866s
2025-10-10T14:33:19.742888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0] Write session: Do CDS request
2025-10-10T14:33:19.742894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:19.742988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:19.751864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.751941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:19.751953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 935
2025-10-10T14:33:19.752106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.752142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:19.752149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:19.752153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:19.752575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 935 sessionId:  describe result for acl check
2025-10-10T14:33:19.752599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:19.752604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:19.752605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:19.752610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601141490117549:7944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:19.753162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601141490117549:7944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:19.755632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601141490117549:7944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:19.758183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601141490117549:7944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:19.758198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601141490117549:7944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:19.758202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601141490117549:7944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:19.758210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:19.759422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:19.760648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:19.760812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:19.760822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:19.760832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:19.760868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:19.760897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601140707904785:6300]
2025-10-10T14:33:19.761314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:19.761625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:19.761680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:19.762082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:19.762132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.762140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.762141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.762142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.762143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.762145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.762146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.762147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.762148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.762149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.762150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.762151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.762152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.762158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.762170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.762174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.762178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.762181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.762184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.762188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.762191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.762195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.762198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.762202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.762205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.762209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.762216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.762224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.762235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.762241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.762246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.762250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.762258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.762263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.762271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.762275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.762284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.762288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.762297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.762306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.762310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.762316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.762324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.762329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.762337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.762349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.762355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.762363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.762367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.762375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.762379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.762388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.762426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:19.764712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:19.765035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:19.765046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:19.765049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:19.765052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:19.765058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 934 [2:7559601140707904785:6300]
2025-10-10T14:33:19.765070Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:19.765090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:19.765097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.765100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.765103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.765117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:19.765126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:19.765132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:19.765180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.765187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.765189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.765191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:19.765259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:19.765269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.765281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.765293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.765310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:19.765352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490117838:7944], now have 1 active actors on pipe
2025-10-10T14:33:19.765361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490117378:2438], now have 1 active actors on pipe
2025-10-10T14:33:19.765368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601140707904780:6300]
2025-10-10T14:33:19.765371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601140707904780:6300]
2025-10-10T14:33:19.765373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601140707904780:6300]
2025-10-10T14:33:19.765387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:19.765378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 934
2025-10-10T14:33:19.765405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:19.765394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 934
2025-10-10T14:33:19.765408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:19.765413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:19.765417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:19.765426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:19.765432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:19.765471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.765481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.765495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601140707904780:6300]
2025-10-10T14:33:19.765508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:19.765525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:19.765543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:19.765554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.765559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.765566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:19.765576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.765591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:19.765614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.765796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.765805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.765820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.765912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 935 partition: 0 MaxSeqNo: 40 sessionId: src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0
2025-10-10T14:33:19.766330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd0b594b-d5d8b9ca-e27ea40a-6895757_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:19.769167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0] Write session: try to update token
2025-10-10T14:33:19.769183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:19.783915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId: src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:19.784921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:19.784935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:19.784939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:19.784941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:19.784953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601140707904780:6300]
2025-10-10T14:33:19.784958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601140707904780:6300]
2025-10-10T14:33:19.784962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601140707904780:6300]
2025-10-10T14:33:19.785011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:19.785010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:19.785016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:19.785021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:19.785024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.785026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:19.785159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:19.786416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:19.842471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601141490117853:7749]
2025-10-10T14:33:19.842725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 934, pipe: [1:7559601141490117853:7749]
2025-10-10T14:33:19.895932Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:19.896405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.896424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.896470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490117853:7749], now have 1 active actors on pipe
2025-10-10T14:33:19.896728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:19.896753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:19.896761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601141490117853:7749]
2025-10-10T14:33:19.896769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:19.896779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:19.896834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 935 reason: error at write: Disconnected sessionId: src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0
2025-10-10T14:33:19.897035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 935 sessionId: src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0 is DEAD
2025-10-10T14:33:19.897202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:19.897211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0] Write session will restart in 0.006735s
2025-10-10T14:33:19.897236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0] Write session: Do CDS request
2025-10-10T14:33:19.897244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:19.904864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.904948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:19.904962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 936
2025-10-10T14:33:19.905087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:19.905121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:19.905131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:19.905135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:19.905638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 936 sessionId:  describe result for acl check
2025-10-10T14:33:19.905674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:19.905680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:19.905682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:19.905687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601141490117897:7948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:19.906274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601141490117897:7948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:19.908686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601141490117897:7948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:19.911208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601141490117897:7948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:19.911222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601141490117897:7948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:19.911226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601141490117897:7948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:19.911234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:19.915208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:19.916141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:19.916320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:19.916335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:19.916348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:19.916399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:19.916440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601140707905052:6302]
2025-10-10T14:33:19.917098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:19.917431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:19.917476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:19.917779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:19.917839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.917846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.917847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.917848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.917849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.917850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.917851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.917852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.917853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.917854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.917855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.917857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.917857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.917863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.917875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.917878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.917882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.917885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.917888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.917891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.917894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.917897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.917901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.917904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.917907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.917910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.917918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.917926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:19.917933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.917937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:19.917943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.917947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:19.917950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.917955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:19.917959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.917963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:19.917966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.917970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:19.917975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.917979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:19.917983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.917987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:19.917991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.917995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:19.917998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.918003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:19.918006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.918010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.918014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.918019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.918022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.918027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.918059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:19.920262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:19.920882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:19.920900Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:19.920902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:19.920906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:19.920913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 935 [2:7559601140707905052:6302]
2025-10-10T14:33:19.920925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:19.920942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:19.920945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.920948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.920951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.920966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:19.920973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:19.920988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:19.921048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.921055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.921057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.921059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:19.921120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:19.921127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.921136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:19.921150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:19.921168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:19.921189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490118209:7948], now have 1 active actors on pipe
2025-10-10T14:33:19.921199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490117854:2438], now have 1 active actors on pipe
2025-10-10T14:33:19.921207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601140707905047:6302]
2025-10-10T14:33:19.921208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601140707905047:6302]
2025-10-10T14:33:19.921210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601140707905047:6302]
2025-10-10T14:33:19.921223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:19.921236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:19.921252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 935
2025-10-10T14:33:19.921239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:19.921243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:19.921259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 935
2025-10-10T14:33:19.921245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:19.921258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:19.921261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:19.921283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601140707905047:6302]
2025-10-10T14:33:19.921285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:19.921288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:19.921302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.921307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.921373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|230ad82d-9c07ba35-186e5135-78003486_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:19.921385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:19.921388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:19.921391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:19.921401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:19.921411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:19.921431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.921609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:19.921619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:19.921636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:19.921728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 936 partition: 0 MaxSeqNo: 40 sessionId: src_id|230ad82d-9c07ba35-186e5135-78003486_0
2025-10-10T14:33:19.922137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d13d0ab-7c440ed3-2c57bad7-f373357e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|230ad82d-9c07ba35-186e5135-78003486_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:19.924766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230ad82d-9c07ba35-186e5135-78003486_0] Write session: try to update token
2025-10-10T14:33:19.924783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230ad82d-9c07ba35-186e5135-78003486_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:19.939018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId: src_id|230ad82d-9c07ba35-186e5135-78003486_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:19.940449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:19.940470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:19.940474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:19.940476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:19.940499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601140707905047:6302]
2025-10-10T14:33:19.940505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601140707905047:6302]
2025-10-10T14:33:19.940509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601140707905047:6302]
2025-10-10T14:33:19.940562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:19.940566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:19.940573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:19.940575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:19.940576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:19.940578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:19.940726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:19.941676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:19.997135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601141490118330:7749]
2025-10-10T14:33:19.997436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 935, pipe: [1:7559601141490118330:7749]
2025-10-10T14:33:20.063976Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:20.064558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.064581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.064632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601141490118330:7749], now have 1 active actors on pipe
2025-10-10T14:33:20.064833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:20.064862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:20.064837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:20.064848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:20.064881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601141490118330:7749]
2025-10-10T14:33:20.064908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 936 reason: error at write: Disconnected sessionId: src_id|230ad82d-9c07ba35-186e5135-78003486_0
2025-10-10T14:33:20.065122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 936 sessionId: src_id|230ad82d-9c07ba35-186e5135-78003486_0 is DEAD
2025-10-10T14:33:20.065298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230ad82d-9c07ba35-186e5135-78003486_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:20.065309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230ad82d-9c07ba35-186e5135-78003486_0] Write session will restart in 0.008308s
2025-10-10T14:33:20.065356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230ad82d-9c07ba35-186e5135-78003486_0] Write session: Do CDS request
2025-10-10T14:33:20.065366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230ad82d-9c07ba35-186e5135-78003486_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:20.074937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230ad82d-9c07ba35-186e5135-78003486_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.074998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:20.075013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 937
2025-10-10T14:33:20.075179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.075220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:20.075226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:20.075231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:20.075740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 937 sessionId:  describe result for acl check
2025-10-10T14:33:20.075778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:20.075784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:20.075786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:20.075792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601145785085789:7952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:20.076355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601145785085789:7952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:20.078639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601145785085789:7952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:20.081282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601145785085789:7952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:20.081295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601145785085789:7952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:20.081298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601145785085789:7952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:20.081306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:20.082371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:20.083387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:20.083578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:20.083590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:20.083603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:20.083659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:20.083705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601145002872616:6304]
2025-10-10T14:33:20.084368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:20.084654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:20.084699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:20.085045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:20.085102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.085109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.085111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.085112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.085114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.085115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.085116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.085118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.085119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.085120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.085121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.085123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.085124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.085130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.085144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.085149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.085154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.085158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.085163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.085167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.085171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.085180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.085190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.085198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.085202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.085211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.085218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.085233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.085246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.085252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.085257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.085262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.085267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.085272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.085278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.085283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.085288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.085293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.085298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.085304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.085309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.085314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.085321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.085327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.085350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.085355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.085360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.085366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.085376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.085382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.085388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.085394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.085441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:20.087803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:20.088285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:20.088300Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:20.088302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:20.088306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:20.088313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 936 [2:7559601145002872616:6304]
2025-10-10T14:33:20.088326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:20.088343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:20.088352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.088356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.088362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.088379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:20.088392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:20.088405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:20.088468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.088475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.088477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.088480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:20.088553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:20.088561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.088574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.088590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.088614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:20.088641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785085627:2438], now have 1 active actors on pipe
2025-10-10T14:33:20.088649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785086090:7952], now have 1 active actors on pipe
2025-10-10T14:33:20.088657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601145002872610:6304]
2025-10-10T14:33:20.088658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601145002872610:6304]
2025-10-10T14:33:20.088660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601145002872610:6304]
2025-10-10T14:33:20.088674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:20.088693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:20.088694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:20.088702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:20.088705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:20.088711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:20.088715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 936
2025-10-10T14:33:20.088725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 936
2025-10-10T14:33:20.088715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:20.088746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601145002872610:6304]
2025-10-10T14:33:20.088749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:20.088751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:20.088767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.088776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.088830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:20.088843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.088852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.088856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:20.088869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.088885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:20.088908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.089035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.089044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.089059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.089132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 937 partition: 0 MaxSeqNo: 40 sessionId: src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0
2025-10-10T14:33:20.089535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230ad82d-9c07ba35-186e5135-78003486_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:20.092217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0] Write session: try to update token
2025-10-10T14:33:20.092236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:20.106557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId: src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:20.107783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:20.107800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:20.107802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:20.107803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:20.107815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601145002872610:6304]
2025-10-10T14:33:20.107819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601145002872610:6304]
2025-10-10T14:33:20.107822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601145002872610:6304]
2025-10-10T14:33:20.107865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:20.107868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:20.107872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.107874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:20.107874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:20.107880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:20.107999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:20.109222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:20.165077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601145785086104:7749]
2025-10-10T14:33:20.165405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 936, pipe: [1:7559601145785086104:7749]
2025-10-10T14:33:20.214783Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:20.215332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.215348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.215393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785086104:7749], now have 1 active actors on pipe
2025-10-10T14:33:20.215553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:20.215676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601145785086104:7749]
2025-10-10T14:33:20.215686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:20.215689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:20.215708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:20.215748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 937 reason: error at write: Disconnected sessionId: src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0
2025-10-10T14:33:20.215948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 937 sessionId: src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0 is DEAD
2025-10-10T14:33:20.216085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:20.216105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0] Write session will restart in 0.009179s
2025-10-10T14:33:20.216130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0] Write session: Do CDS request
2025-10-10T14:33:20.216136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:20.226841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.226962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:20.226984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 938
2025-10-10T14:33:20.227090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.227125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:20.227133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:20.227136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:20.227567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 938 sessionId:  describe result for acl check
2025-10-10T14:33:20.227612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:20.227620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:20.227622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:20.227628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601145785086419:7956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:20.228175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601145785086419:7956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:20.230504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601145785086419:7956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:20.231475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:20.232280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:20.232428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:20.232437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:20.232447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:20.232503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:20.232543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601145002872883:6306]
2025-10-10T14:33:20.232618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601145785086419:7956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:20.232631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601145785086419:7956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:20.232634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601145785086419:7956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:20.232641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:20.232992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:20.233240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:20.233272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:20.233503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:20.233557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.233562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.233563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.233563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.233564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.233565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.233565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.233566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.233567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.233567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.233568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.233569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.233569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.233573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.233580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.233583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.233585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.233587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.233589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.233591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.233593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.233595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.233597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.233600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.233602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.233604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.233608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.233614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.233619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.233622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.233625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.233628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.233631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.233634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.233636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.233640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.233642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.233645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.233648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.233651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.233653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.233656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.233659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.233662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.233664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.233667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.233670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.233673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.233676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.233679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.233682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.233685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.233706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:20.235910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:20.236285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:20.236293Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:20.236294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:20.236297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:20.236303Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 937 [2:7559601145002872883:6306]
2025-10-10T14:33:20.236311Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:20.236323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:20.236329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.236331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.236333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.236356Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:20.236365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:20.236371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:20.236422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.236429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.236443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.236444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:20.236604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 937
2025-10-10T14:33:20.236604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 937
2025-10-10T14:33:20.236668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:20.236677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.236689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.236696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.236710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:20.236733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785086571:7956], now have 1 active actors on pipe
2025-10-10T14:33:20.236747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785086105:2438], now have 1 active actors on pipe
2025-10-10T14:33:20.236758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.236764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.236782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601145002872878:6306]
2025-10-10T14:33:20.236787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601145002872878:6306]
2025-10-10T14:33:20.236788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601145002872878:6306]
2025-10-10T14:33:20.236797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:20.236808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:20.236812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:20.236815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:20.236816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:20.236821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:20.236824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:20.236838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76ff1d55-2fc19579-daa02c30-8984300e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:20.236847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.236850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.236851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:20.236859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.236868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:20.236891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601145002872878:6306]
2025-10-10T14:33:20.236899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:20.236906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:20.236907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.237042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.237055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.237086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.237181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 938 partition: 0 MaxSeqNo: 40 sessionId: src_id|76ff1d55-2fc19579-daa02c30-8984300e_0
2025-10-10T14:33:20.237547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b0ef65-d9ce7dd5-37fff6ad-895d3d46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|76ff1d55-2fc19579-daa02c30-8984300e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:20.239931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ff1d55-2fc19579-daa02c30-8984300e_0] Write session: try to update token
2025-10-10T14:33:20.239944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ff1d55-2fc19579-daa02c30-8984300e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:20.253559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId: src_id|76ff1d55-2fc19579-daa02c30-8984300e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:20.254228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:20.254244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:20.254255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601145002872878:6306]
2025-10-10T14:33:20.254302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:20.254309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:20.254492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:20.254632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:20.254771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:20.254907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:20.255095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:20.255136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:20.256140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:20.256324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.256339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.256372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:20.256451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:20.266723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:20.266740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:20.266743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:20.266745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:20.266755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601145002872878:6306]
2025-10-10T14:33:20.266760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601145002872878:6306]
2025-10-10T14:33:20.266764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601145002872878:6306]
2025-10-10T14:33:20.266806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:20.266810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:20.266814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:20.266817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.266818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:20.266820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:20.266948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:20.316157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601145785086583:7749]
2025-10-10T14:33:20.316442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 937, pipe: [1:7559601145785086583:7749]
2025-10-10T14:33:20.381221Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:20.389479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.389504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.389684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.389748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.389815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.389882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.389929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.389939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.390008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.390071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.390135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.390205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.390250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.390261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.390333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.390397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.390477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.390543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.390586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.390594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.390663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.390728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.390794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.390861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.390907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.390914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.390983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.391045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.391111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.391177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.391225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.391232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.391296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.391356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.391416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.391480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.391522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.391531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.391596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.391652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.391721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.391787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.391830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.391836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.391908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.391969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.392037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.392101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.392145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.392152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.392220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.392283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.392343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.392407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.392453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.392460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.392526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.392586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.392648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.392714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.392760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.392767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.392832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785086583:7749], now have 1 active actors on pipe
2025-10-10T14:33:20.393107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:20.393113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601145785086583:7749]
2025-10-10T14:33:20.393127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:20.393142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:20.393156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 938 reason: error at write: Disconnected sessionId: src_id|76ff1d55-2fc19579-daa02c30-8984300e_0
2025-10-10T14:33:20.393422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 938 sessionId: src_id|76ff1d55-2fc19579-daa02c30-8984300e_0 is DEAD
2025-10-10T14:33:20.393557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ff1d55-2fc19579-daa02c30-8984300e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:20.393568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ff1d55-2fc19579-daa02c30-8984300e_0] Write session will restart in 0.008452s
2025-10-10T14:33:20.393593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ff1d55-2fc19579-daa02c30-8984300e_0] Write session: Do CDS request
2025-10-10T14:33:20.393599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ff1d55-2fc19579-daa02c30-8984300e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:20.393969Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:20.402959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ff1d55-2fc19579-daa02c30-8984300e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.403065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:20.403082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 939
2025-10-10T14:33:20.403242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.403280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:20.403290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:20.403295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:20.403755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 939 sessionId:  describe result for acl check
2025-10-10T14:33:20.403799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:20.403807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:20.403809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:20.403816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601145785086748:7961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:20.404413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601145785086748:7961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:20.406871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601145785086748:7961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:20.409434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601145785086748:7961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:20.409448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601145785086748:7961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:20.409452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601145785086748:7961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:20.409468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:20.411872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:20.413022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:20.413210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:20.413222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:20.413233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:20.413289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:20.413348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601145002873165:6309]
2025-10-10T14:33:20.413951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:20.414242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:20.414285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:20.414600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:20.414663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.414670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.414671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.414672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.414673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.414674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.414675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.414676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.414678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.414679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.414680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.414681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.414682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.414688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.414703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.414708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.414712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.414717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.414721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.414726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.414730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.414735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.414740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.414744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.414749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.414753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.414761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.414770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.414777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.414788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.414793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.414804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.414809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.414814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.414819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.414824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.414834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.414840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.414849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.414855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.414864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.414869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.414880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.414886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.414895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.414901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.414910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.414916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.414922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.414931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.414936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.414946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.414990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:20.417279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:20.417602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:20.417613Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:20.417616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:20.417619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:20.417625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 938 [2:7559601145002873165:6309]
2025-10-10T14:33:20.417638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:20.417658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:20.417666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.417670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.417672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.417688Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:20.417701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:20.417709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:20.417761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.417769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.417771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.417773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:20.417834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:20.417841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.417852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.417870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.417891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:20.417916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785086596:2438], now have 1 active actors on pipe
2025-10-10T14:33:20.417924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785087061:7961], now have 1 active actors on pipe
2025-10-10T14:33:20.417931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601145002873160:6309]
2025-10-10T14:33:20.417937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601145002873160:6309]
2025-10-10T14:33:20.417939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601145002873160:6309]
2025-10-10T14:33:20.417953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:20.417965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:20.417972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:20.417972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:20.417974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:20.417988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:20.417992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:20.418011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601145002873160:6309]
2025-10-10T14:33:20.418019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:20.418021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:20.417991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 938
2025-10-10T14:33:20.417993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 938
2025-10-10T14:33:20.418045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.418054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.418091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:20.418103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.418111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.418113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:20.418124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.418138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:20.418165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.418335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.418344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.418361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.418483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 939 partition: 0 MaxSeqNo: 40 sessionId: src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0
2025-10-10T14:33:20.418918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ff1d55-2fc19579-daa02c30-8984300e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:20.421516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0] Write session: try to update token
2025-10-10T14:33:20.421537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:20.436061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId: src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:20.437427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:20.437444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:20.437447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:20.437449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:20.437460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601145002873160:6309]
2025-10-10T14:33:20.437464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601145002873160:6309]
2025-10-10T14:33:20.437468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601145002873160:6309]
2025-10-10T14:33:20.437496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:20.437502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:20.437506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:20.437512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:20.437520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.437523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:20.437657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:20.439091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:20.493296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601145785087076:7749]
2025-10-10T14:33:20.493611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 938, pipe: [1:7559601145785087076:7749]
2025-10-10T14:33:20.556839Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:20.557347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.557364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.557412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785087076:7749], now have 1 active actors on pipe
2025-10-10T14:33:20.557646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:20.557712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:20.557729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:20.557728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601145785087076:7749]
2025-10-10T14:33:20.557752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:20.557794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 939 reason: error at write: Disconnected sessionId: src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0
2025-10-10T14:33:20.558021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 939 sessionId: src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0 is DEAD
2025-10-10T14:33:20.558207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:20.558216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0] Write session will restart in 0.005548s
2025-10-10T14:33:20.558253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0] Write session: Do CDS request
2025-10-10T14:33:20.558259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:20.564915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.565056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:20.565072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 940
2025-10-10T14:33:20.565211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.565249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:20.565260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:20.565264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:20.565752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 940 sessionId:  describe result for acl check
2025-10-10T14:33:20.565794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:20.565801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:20.565804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:20.565811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601145785087093:7965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:20.566395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601145785087093:7965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:20.568758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601145785087093:7965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:20.571831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601145785087093:7965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:20.571845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601145785087093:7965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:20.571850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601145785087093:7965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:20.571859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:20.578038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:20.579217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:20.579405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:20.579417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:20.579429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:20.579480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:20.579522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601145002873435:6311]
2025-10-10T14:33:20.580153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:20.580474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:20.580518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:20.580858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:20.580919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.580927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.580928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.580929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.580930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.580932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.580933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.580934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.580935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.580936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.580938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.580939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.580940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.580946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.580960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.580964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.580968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.580972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.580977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.580981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.580985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.580988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.580993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.580997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.581001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.581005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.581013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.581021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.581028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.581033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.581038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.581043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.581048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.581054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.581058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.581064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.581068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.581074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.581079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.581084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.581100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.581106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.581111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.581116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.581125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.581130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.581134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.581139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.581144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.581148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.581154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.581159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.581204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:20.583524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:20.584137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:20.584151Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:20.584153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:20.584158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:20.584163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 939 [2:7559601145002873435:6311]
2025-10-10T14:33:20.584174Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:20.584194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:20.584197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.584201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.584204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.584222Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:20.584230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:20.584238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:20.584299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.584306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.584308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.584311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:20.584379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:20.584389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.584402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.584413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.584432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:20.584459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785087077:2438], now have 1 active actors on pipe
2025-10-10T14:33:20.584467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785087370:7965], now have 1 active actors on pipe
2025-10-10T14:33:20.584475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601145002873430:6311]
2025-10-10T14:33:20.584477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601145002873430:6311]
2025-10-10T14:33:20.584480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601145002873430:6311]
2025-10-10T14:33:20.584495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:20.584514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:20.584536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:20.584536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:20.584539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:20.584514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 939
2025-10-10T14:33:20.584543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:20.584543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:20.584567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601145002873430:6311]
2025-10-10T14:33:20.584519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 939
2025-10-10T14:33:20.584570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:20.584585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:20.584603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.584614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.584649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:20.584663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.584671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.584673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:20.584684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.584699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:20.584714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.584922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.584937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.584961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.585068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 940 partition: 0 MaxSeqNo: 40 sessionId: src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0
2025-10-10T14:33:20.585482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cd7af92-d4af536b-dd0e169b-395ac0a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:20.588165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0] Write session: try to update token
2025-10-10T14:33:20.588179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:20.603402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId: src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:20.604076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:20.604092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:20.604095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:20.604097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:20.604107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601145002873430:6311]
2025-10-10T14:33:20.604111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601145002873430:6311]
2025-10-10T14:33:20.604115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601145002873430:6311]
2025-10-10T14:33:20.604165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:20.604174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:20.604178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.604180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:20.604181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:20.604184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:20.604317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:20.606167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:20.658110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601145785087567:7749]
2025-10-10T14:33:20.658434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 939, pipe: [1:7559601145785087567:7749]
2025-10-10T14:33:20.717254Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:20.717629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.717643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.717679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785087567:7749], now have 1 active actors on pipe
2025-10-10T14:33:20.717825Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:20.717891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601145785087567:7749]
2025-10-10T14:33:20.717893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:20.717920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:20.717991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 940 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0
2025-10-10T14:33:20.718217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 940 sessionId: src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0 is DEAD
2025-10-10T14:33:20.718328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:20.718340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0] Write session will restart in 0.005063s
2025-10-10T14:33:20.718363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0] Write session: Do CDS request
2025-10-10T14:33:20.718369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:20.724793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.724860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:20.724874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 941
2025-10-10T14:33:20.725024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.725058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:20.725065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:20.725073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:20.725523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 941 sessionId:  describe result for acl check
2025-10-10T14:33:20.725553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:20.725560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:20.725562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:20.725567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601145785087652:7980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:20.726104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601145785087652:7980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:20.728316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601145785087652:7980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:20.730986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601145785087652:7980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:20.730999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601145785087652:7980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:20.731003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601145785087652:7980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:20.731011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:20.734235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:20.735313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:20.735542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:20.735555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:20.735568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:20.735621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:20.735663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601145002873746:6327]
2025-10-10T14:33:20.736288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:20.736565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:20.736610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:20.736925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:20.736983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.736989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.736990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.736992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.736993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.736994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.736995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.736996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.736997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.736999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.737000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.737001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.737002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.737008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.737020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.737024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.737029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.737033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.737038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.737042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.737046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.737051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.737055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.737060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.737064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.737069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.737076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.737086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.737093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.737098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.737103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.737109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.737114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.737120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.737125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.737132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.737139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.737145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.737150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.737155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.737160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.737165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.737170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.737181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.737186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.737192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.737196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.737201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.737208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.737213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.737218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.737224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.737267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:20.739562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:20.739873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:20.739885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:20.739887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:20.739892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:20.739898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 940 [2:7559601145002873746:6327]
2025-10-10T14:33:20.739911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:20.739928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:20.739937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.739941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.739944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.739960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:20.739972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:20.739981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:20.740036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.740043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.740045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.740047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:20.740239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 940
2025-10-10T14:33:20.740251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 940
2025-10-10T14:33:20.740375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:20.740385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.740398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.740413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.740435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:20.740460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785087595:2438], now have 1 active actors on pipe
2025-10-10T14:33:20.740468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785087977:7980], now have 1 active actors on pipe
2025-10-10T14:33:20.740488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.740498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.740517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601145002873741:6327]
2025-10-10T14:33:20.740524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601145002873741:6327]
2025-10-10T14:33:20.740527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601145002873741:6327]
2025-10-10T14:33:20.740539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:20.740552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:20.740555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:20.740562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:20.740564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:20.740573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:20.740576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:20.740596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:20.740609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.740613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.740615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:20.740625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.740639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:20.740666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601145002873741:6327]
2025-10-10T14:33:20.740678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:20.740690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:20.740692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.740870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.740877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.740892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.740975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 941 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0
2025-10-10T14:33:20.741351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59abab8c-ae91b936-7e4d755-c4d7eeef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:20.744070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0] Write session: try to update token
2025-10-10T14:33:20.744088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:20.752058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:20.752080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:20.752090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601145002873741:6327]
2025-10-10T14:33:20.752131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:20.752140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:20.752322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:20.752477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:20.752621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:20.752760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:20.752954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:20.752997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:20.758216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId: src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:20.760667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:20.760866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.760885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.760917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:20.760998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:20.769617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:20.769637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:20.769640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:20.769642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:20.769655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601145002873741:6327]
2025-10-10T14:33:20.769658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601145002873741:6327]
2025-10-10T14:33:20.769664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601145002873741:6327]
2025-10-10T14:33:20.769706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:20.769710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:20.769717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:20.769718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.769720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:20.769722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:20.769842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:20.817845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601145785088073:7749]
2025-10-10T14:33:20.818165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 940, pipe: [1:7559601145785088073:7749]
2025-10-10T14:33:20.880907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:20.889073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.889104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.889281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.889363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.889428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.889496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.889547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.889558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.889632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.889696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.889766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.889837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.889885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.889893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.889959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.890025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.890089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.890154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.890198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.890206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.890273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.890338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.890411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.890483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.890531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.890542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.890609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.890670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.890734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.890799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.890845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.890856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.890925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.890989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.891052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.891120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.891166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.891177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.891248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.891308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.891379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.891446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.891500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.891510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.891579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.891638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.891707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.891774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.891818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.891824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.891899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.891969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.892039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.892106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.892151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.892158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.892227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:20.892287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:20.892351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:20.892420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:20.892468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:20.892474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:20.892535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785088073:7749], now have 1 active actors on pipe
2025-10-10T14:33:20.892804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:20.892818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:20.892822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:20.892852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 941 reason: error at write: Disconnected sessionId: src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0
2025-10-10T14:33:20.892865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601145785088073:7749]
2025-10-10T14:33:20.893068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 941 sessionId: src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0 is DEAD
2025-10-10T14:33:20.893208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:20.893218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0] Write session will restart in 0.008143s
2025-10-10T14:33:20.893244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0] Write session: Do CDS request
2025-10-10T14:33:20.893250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:20.893449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:20.902966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.903066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:20.903081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 942
2025-10-10T14:33:20.903209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:20.903245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:20.903256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:20.903260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:20.903724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 942 sessionId:  describe result for acl check
2025-10-10T14:33:20.903761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:20.903767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:20.903769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:20.903775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601145785088212:7984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:20.904342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601145785088212:7984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:20.906857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601145785088212:7984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:20.909732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601145785088212:7984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:20.909744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601145785088212:7984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:20.909748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601145785088212:7984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:20.909755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:20.912590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:20.913779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:20.914088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:20.914100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:20.914114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:20.914179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:20.914237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601145002874018:6329]
2025-10-10T14:33:20.914898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:20.915194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:20.915241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:20.915566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:20.915624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.915631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.915632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.915634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.915635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.915636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.915638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.915639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.915640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.915642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.915643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.915644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.915646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.915653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.915668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.915672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.915677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.915681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.915690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.915699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.915708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.915717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.915723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.915728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.915732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.915739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.915752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.915761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:20.915773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.915784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:20.915788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.915798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:20.915803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.915826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:20.915836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.915846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:20.915855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.915865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:20.915874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.915880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:20.915890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.915900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:20.915909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.915915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:20.915920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.915925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:20.915939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.915945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.915950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.915956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.915962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.915968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.916011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:20.918350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:20.918674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:20.918689Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:20.918691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:20.918695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:20.918702Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 941 [2:7559601145002874018:6329]
2025-10-10T14:33:20.918714Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:20.918749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:20.918757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.918760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.918763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.918780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:20.918794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:20.918802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:20.918856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.918863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.918866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.918869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:20.918934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:20.918942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.918955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:20.918973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:20.918992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:20.919013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785088522:7984], now have 1 active actors on pipe
2025-10-10T14:33:20.919021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785088075:2438], now have 1 active actors on pipe
2025-10-10T14:33:20.919030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601145002874013:6329]
2025-10-10T14:33:20.919037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601145002874013:6329]
2025-10-10T14:33:20.919039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601145002874013:6329]
2025-10-10T14:33:20.919052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:20.919070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:20.919071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:20.919074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 941
2025-10-10T14:33:20.919081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:20.919076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 941
2025-10-10T14:33:20.919083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:20.919089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:20.919092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:20.919113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601145002874013:6329]
2025-10-10T14:33:20.919116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:20.919119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:20.919144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.919150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.919187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14f100fe-14767f15-80244b6-fc1797e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:20.919200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:20.919204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:20.919206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:20.919217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:20.919228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:20.919249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.919389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:20.919398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:20.919414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:20.919500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 942 partition: 0 MaxSeqNo: 40 sessionId: src_id|14f100fe-14767f15-80244b6-fc1797e0_0
2025-10-10T14:33:20.919908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b07fdb2-ea3e46fd-8b2de9ad-fb818e54_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|14f100fe-14767f15-80244b6-fc1797e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:20.922492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f100fe-14767f15-80244b6-fc1797e0_0] Write session: try to update token
2025-10-10T14:33:20.922511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f100fe-14767f15-80244b6-fc1797e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:20.936719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId: src_id|14f100fe-14767f15-80244b6-fc1797e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:20.938609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:20.938629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:20.938632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:20.938634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:20.938644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601145002874013:6329]
2025-10-10T14:33:20.938648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601145002874013:6329]
2025-10-10T14:33:20.938652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601145002874013:6329]
2025-10-10T14:33:20.938696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:20.938702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:20.938704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:20.938708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:20.938709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:20.938711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:20.938852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:20.939363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:20.992979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601145785088557:7749]
2025-10-10T14:33:20.993285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 941, pipe: [1:7559601145785088557:7749]
2025-10-10T14:33:21.045776Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:21.046381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.046397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.046453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601145785088557:7749], now have 1 active actors on pipe
2025-10-10T14:33:21.046660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:21.046680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601145785088557:7749]
2025-10-10T14:33:21.046685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:21.046689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:21.046712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:21.046757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 942 reason: error at write: Disconnected sessionId: src_id|14f100fe-14767f15-80244b6-fc1797e0_0
2025-10-10T14:33:21.046994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 942 sessionId: src_id|14f100fe-14767f15-80244b6-fc1797e0_0 is DEAD
2025-10-10T14:33:21.047185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f100fe-14767f15-80244b6-fc1797e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:21.047196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f100fe-14767f15-80244b6-fc1797e0_0] Write session will restart in 0.007107s
2025-10-10T14:33:21.047220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f100fe-14767f15-80244b6-fc1797e0_0] Write session: Do CDS request
2025-10-10T14:33:21.047226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f100fe-14767f15-80244b6-fc1797e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:21.055914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f100fe-14767f15-80244b6-fc1797e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.055988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:21.056003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 943
2025-10-10T14:33:21.056150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.056202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:21.056212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:21.056216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:21.056709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 943 sessionId:  describe result for acl check
2025-10-10T14:33:21.056748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:21.056755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:21.056758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:21.056764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601150080055985:7988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:21.057326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601150080055985:7988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:21.059780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601150080055985:7988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:21.062321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601150080055985:7988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:21.062339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601150080055985:7988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:21.062343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601150080055985:7988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:21.062352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:21.065499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:21.066715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:21.066922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:21.066939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:21.066954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:21.067013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:21.067060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601149297841587:6331]
2025-10-10T14:33:21.067700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:21.068028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:21.068088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:21.068436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:21.068510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.068517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.068518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.068519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.068520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.068522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.068523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.068525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.068526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.068527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.068529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.068530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.068531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.068538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.068552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.068556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.068560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.068564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.068568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.068571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.068575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.068579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.068584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.068587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.068591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.068595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.068603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.068612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.068619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.068625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.068635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.068642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.068653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.068664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.068673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.068684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.068688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.068699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.068704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.068711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.068720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.068727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.068732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.068738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.068742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.068748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.068757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.068763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.068771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.068776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.068785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.068791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.068836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:21.071305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:21.071665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:21.071681Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:21.071683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:21.071687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:21.071693Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 942 [2:7559601149297841587:6331]
2025-10-10T14:33:21.071706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:21.071729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:21.071737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.071741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.071744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.071763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:21.071776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:21.071787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:21.071850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.071859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.071861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.071864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:21.071934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:21.071943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.071955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.071971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.071990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:21.072016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080056294:7988], now have 1 active actors on pipe
2025-10-10T14:33:21.072025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080055854:2438], now have 1 active actors on pipe
2025-10-10T14:33:21.072033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601149297841582:6331]
2025-10-10T14:33:21.072036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601149297841582:6331]
2025-10-10T14:33:21.072038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601149297841582:6331]
2025-10-10T14:33:21.072053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:21.072068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:21.072089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:21.072089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:21.072092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:21.072093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:21.072095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:21.072116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601149297841582:6331]
2025-10-10T14:33:21.072089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 942
2025-10-10T14:33:21.072125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:21.072095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 942
2025-10-10T14:33:21.072137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:21.072168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.072177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.072208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:21.072220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.072224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.072227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:21.072238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.072253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:21.072273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.072419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.072427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.072440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.072512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 943 partition: 0 MaxSeqNo: 40 sessionId: src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0
2025-10-10T14:33:21.072932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f100fe-14767f15-80244b6-fc1797e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:21.075543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0] Write session: try to update token
2025-10-10T14:33:21.075559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:21.083456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:21.083477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:21.083488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601149297841582:6331]
2025-10-10T14:33:21.083531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:21.083535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:21.083695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:21.083828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:21.083961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:21.084108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:21.084297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:21.084332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:21.089730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId: src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:21.092275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:21.092931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.092953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.092994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:21.093073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:21.101614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:21.101630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:21.101632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:21.101634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:21.101642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601149297841582:6331]
2025-10-10T14:33:21.101645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601149297841582:6331]
2025-10-10T14:33:21.101648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601149297841582:6331]
2025-10-10T14:33:21.101686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:21.101691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:21.101693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.101695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:21.101698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:21.101702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:21.101852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:21.147081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601150080056337:7749]
2025-10-10T14:33:21.147355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 942, pipe: [1:7559601150080056337:7749]
2025-10-10T14:33:21.217130Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:21.224682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.224709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.224864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.224920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.224978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.225045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.225087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.225095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.225161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.225217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.225288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.225378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.225421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.225426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.225488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.225552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.225612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.225671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.225712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.225717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.225782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.225844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.225901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.225958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.226005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.226010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.226076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.226133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.226192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.226249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.226294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.226302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.226365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.226423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.226493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.226558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.226602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.226607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.226668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.226722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.226783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.226851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.226893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.226899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.226970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.227028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.227096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.227165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.227210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.227220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.227286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.227353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.227414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.227478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.227524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.227532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.227602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:21.227671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:21.227734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:21.227798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:21.227840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:21.227845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:21.227900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080056337:7749], now have 1 active actors on pipe
2025-10-10T14:33:21.228117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601150080056337:7749]
2025-10-10T14:33:21.228134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:21.228138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:21.228152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:21.228184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 943 reason: error at write: Disconnected sessionId: src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0
2025-10-10T14:33:21.228358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 943 sessionId: src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0 is DEAD
2025-10-10T14:33:21.228480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:21.228491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0] Write session will restart in 0.009097s
2025-10-10T14:33:21.228517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0] Write session: Do CDS request
2025-10-10T14:33:21.228523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:21.228840Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:21.238896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.238991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:21.239005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 944
2025-10-10T14:33:21.239118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.239154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:21.239166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:21.239175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:21.239621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 944 sessionId:  describe result for acl check
2025-10-10T14:33:21.239660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:21.239668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:21.239670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:21.239676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601150080056546:7992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:21.240280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601150080056546:7992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:21.243127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601150080056546:7992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:21.245524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601150080056546:7992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:21.245539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601150080056546:7992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:21.245543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601150080056546:7992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:21.245551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:21.246203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:21.247266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:21.247435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:21.247446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:21.247457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:21.247507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:21.247548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601149297841861:6333]
2025-10-10T14:33:21.248190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:21.248448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:21.248493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:21.248821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:21.248877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.248882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.248883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.248884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.248885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.248886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.248888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.248889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.248890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.248891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.248893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.248894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.248895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.248902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.248915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.248919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.248924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.248929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.248934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.248938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.248942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.248947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.248951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.248957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.248963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.248967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.248976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.248985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.248992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.249001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.249006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.249011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.249018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.249024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.249029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.249034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.249042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.249047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.249053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.249059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.249064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.249074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.249079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.249084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.249090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.249096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.249101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.249107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.249112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.249118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.249123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.249129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.249171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:21.251467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:21.251871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:21.251884Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:21.251886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:21.251890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:21.251896Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 943 [2:7559601149297841861:6333]
2025-10-10T14:33:21.251906Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:21.251918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:21.251920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.251922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.251923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.251936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:21.251942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:21.251948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:21.251991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.251997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.251998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.252000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:21.252049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:21.252055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.252062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.252069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.252079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:21.252098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601149297841856:6333]
2025-10-10T14:33:21.252103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601149297841856:6333]
2025-10-10T14:33:21.252104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601149297841856:6333]
2025-10-10T14:33:21.252111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:21.252123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:21.252125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080056339:2438], now have 1 active actors on pipe
2025-10-10T14:33:21.252127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:21.252128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:21.252129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:21.252139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:21.252141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:21.252144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080056809:7992], now have 1 active actors on pipe
2025-10-10T14:33:21.252160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601149297841856:6333]
2025-10-10T14:33:21.252168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:21.252176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:21.252197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 943
2025-10-10T14:33:21.252217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 943
2025-10-10T14:33:21.252243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.252251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.252274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:21.252283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.252286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.252288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:21.252295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.252303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:21.252314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.252462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.252470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.252485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.252581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 944 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0
2025-10-10T14:33:21.252982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9daa55c-a59a44fa-cbf74ef3-c5f69ab8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:21.255607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0] Write session: try to update token
2025-10-10T14:33:21.255625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:21.269789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId: src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:21.271815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:21.271831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:21.271834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:21.271835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:21.271843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601149297841856:6333]
2025-10-10T14:33:21.271846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601149297841856:6333]
2025-10-10T14:33:21.271848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601149297841856:6333]
2025-10-10T14:33:21.271889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:21.271898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.271899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:21.271906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:21.271913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:21.271918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:21.272025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:21.272372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:21.328312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601150080056838:7749]
2025-10-10T14:33:21.328695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 943, pipe: [1:7559601150080056838:7749]
2025-10-10T14:33:21.384526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:21.384806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.384821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.384869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080056838:7749], now have 1 active actors on pipe
2025-10-10T14:33:21.385077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:21.385106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:21.385119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:21.385123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:21.385167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601150080056838:7749]
2025-10-10T14:33:21.385183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 944 reason: error at write: Disconnected sessionId: src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0
2025-10-10T14:33:21.385380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 944 sessionId: src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0 is DEAD
2025-10-10T14:33:21.385513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:21.385522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0] Write session will restart in 0.009110s
2025-10-10T14:33:21.385547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0] Write session: Do CDS request
2025-10-10T14:33:21.385558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:21.395879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.395950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:21.395966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 945
2025-10-10T14:33:21.396154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.396199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:21.396210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:21.396214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:21.396672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 945 sessionId:  describe result for acl check
2025-10-10T14:33:21.396708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:21.396710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:21.396712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:21.396718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601150080057005:7999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:21.397290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601150080057005:7999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:21.399552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601150080057005:7999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:21.402763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601150080057005:7999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:21.402779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601150080057005:7999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:21.402783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601150080057005:7999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:21.402792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:21.404736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:21.406175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:21.406387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:21.406400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:21.406412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:21.406497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:21.406558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601149297842148:6336]
2025-10-10T14:33:21.407170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:21.407506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:21.407567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:21.407931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:21.407993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.408000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.408001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.408002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.408004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.408005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.408006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.408008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.408009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.408010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.408012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.408013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.408014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.408021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.408035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.408039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.408044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.408047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.408052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.408056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.408060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.408063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.408068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.408072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.408076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.408080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.408087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.408097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.408109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.408114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.408123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.408128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.408132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.408141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.408149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.408155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.408165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.408170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.408175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.408180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.408186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.408191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.408196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.408201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.408209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.408214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.408219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.408226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.408231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.408241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.408246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.408251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.408292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:21.410621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:21.410963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:21.410979Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:21.410982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:21.410986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:21.410993Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 944 [2:7559601149297842148:6336]
2025-10-10T14:33:21.411005Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:21.411024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:21.411027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.411031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.411033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.411051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:21.411066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:21.411076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:21.411135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.411146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.411148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.411150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:21.411221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:21.411229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.411241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.411251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.411273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:21.411299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080056839:2438], now have 1 active actors on pipe
2025-10-10T14:33:21.411309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080057306:7999], now have 1 active actors on pipe
2025-10-10T14:33:21.411318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601149297842143:6336]
2025-10-10T14:33:21.411324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601149297842143:6336]
2025-10-10T14:33:21.411325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601149297842143:6336]
2025-10-10T14:33:21.411389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 944
2025-10-10T14:33:21.411341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:21.411358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:21.411390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 944
2025-10-10T14:33:21.411370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:21.411373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:21.411373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:21.411376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:21.411376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:21.411406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601149297842143:6336]
2025-10-10T14:33:21.411409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:21.411412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:21.411436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.411441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.411484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:21.411501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.411505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.411507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:21.411519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.411535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:21.411564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.411720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.411729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.411747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.411872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 945 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0
2025-10-10T14:33:21.412293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f778eb9-d783cfaf-e31ba92a-7cca2d36_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:21.415006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0] Write session: try to update token
2025-10-10T14:33:21.415026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:21.429218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId: src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:21.430848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:21.430869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:21.430872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:21.430874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:21.430884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601149297842143:6336]
2025-10-10T14:33:21.430888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601149297842143:6336]
2025-10-10T14:33:21.430891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601149297842143:6336]
2025-10-10T14:33:21.430931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:21.430939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:21.430947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:21.430947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.430949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:21.430951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:21.431082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:21.431887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:21.485525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601150080057324:7749]
2025-10-10T14:33:21.485839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 944, pipe: [1:7559601150080057324:7749]
2025-10-10T14:33:21.551410Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:21.552122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.552141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.552202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080057324:7749], now have 1 active actors on pipe
2025-10-10T14:33:21.552443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:21.552448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:21.552453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:21.552458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:21.552512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 945 reason: error at write: Disconnected sessionId: src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0
2025-10-10T14:33:21.552630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601150080057324:7749]
2025-10-10T14:33:21.552721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 945 sessionId: src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0 is DEAD
2025-10-10T14:33:21.552905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:21.552917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0] Write session will restart in 0.009668s
2025-10-10T14:33:21.552942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0] Write session: Do CDS request
2025-10-10T14:33:21.552949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:21.563938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.564017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:21.564032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 946
2025-10-10T14:33:21.564175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.564204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:21.564209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:21.564215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:21.564745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 946 sessionId:  describe result for acl check
2025-10-10T14:33:21.564782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:21.564784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:21.564786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:21.564793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601150080057493:8003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:21.565391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601150080057493:8003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:21.568361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601150080057493:8003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:21.571843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601150080057493:8003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:21.571859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601150080057493:8003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:21.571863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601150080057493:8003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:21.571872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:21.574901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:21.576174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:21.576517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:21.576530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:21.576545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:21.576617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:21.576663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601149297842424:6338]
2025-10-10T14:33:21.577268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:21.577648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:21.577726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:21.578127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:21.578193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.578199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.578201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.578202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.578204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.578206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.578207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.578208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.578209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.578210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.578212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.578213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.578214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.578222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.578236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.578241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.578246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.578250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.578254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.578258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.578263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.578267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.578273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.578277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.578281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.578285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.578294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.578303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.578311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.578317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.578330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.578337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.578342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.578358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.578366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.578372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.578379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.578385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.578391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.578397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.578401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.578410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.578415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.578429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.578435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.578441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.578451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.578458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.578462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.578467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.578473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.578479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.578520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:21.581120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:21.581471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:21.581487Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:21.581490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:21.581495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:21.581503Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 945 [2:7559601149297842424:6338]
2025-10-10T14:33:21.581518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:21.581536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:21.581543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.581547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.581550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.581568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:21.581577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:21.581584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:21.581651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.581665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.581667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.581669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:21.581739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:21.581749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.581763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.581777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.581803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:21.581848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080057760:8003], now have 1 active actors on pipe
2025-10-10T14:33:21.581852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080057325:2438], now have 1 active actors on pipe
2025-10-10T14:33:21.581860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601149297842419:6338]
2025-10-10T14:33:21.581863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601149297842419:6338]
2025-10-10T14:33:21.581865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601149297842419:6338]
2025-10-10T14:33:21.581874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:21.581857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 945
2025-10-10T14:33:21.581889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:21.581865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 945
2025-10-10T14:33:21.581911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:21.581913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:21.581916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:21.581923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:21.581925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:21.581954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601149297842419:6338]
2025-10-10T14:33:21.581968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:21.581980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:21.581984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.581989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.582039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:21.582053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.582057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.582060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:21.582071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.582095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:21.582120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.582315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.582329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.582352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.582475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 946 partition: 0 MaxSeqNo: 40 sessionId: src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0
2025-10-10T14:33:21.582904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3155b3f-535b2c82-9efd131c-8990b4ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:21.585596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0] Write session: try to update token
2025-10-10T14:33:21.585614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:21.600361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId: src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:21.602517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:21.602537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:21.602541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:21.602543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:21.602554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601149297842419:6338]
2025-10-10T14:33:21.602559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601149297842419:6338]
2025-10-10T14:33:21.602566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601149297842419:6338]
2025-10-10T14:33:21.602628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:21.602641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.602643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:21.602748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:21.602763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:21.602767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:21.602788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:21.603117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:21.652964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601150080057822:7749]
2025-10-10T14:33:21.653277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 945, pipe: [1:7559601150080057822:7749]
2025-10-10T14:33:21.719447Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:21.719867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.719888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.719935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080057822:7749], now have 1 active actors on pipe
2025-10-10T14:33:21.720158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:21.720159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601150080057822:7749]
2025-10-10T14:33:21.720198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:21.720201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:21.720261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 946 reason: error at write: Disconnected sessionId: src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0
2025-10-10T14:33:21.720516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 946 sessionId: src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0 is DEAD
2025-10-10T14:33:21.720669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:21.720680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0] Write session will restart in 0.006980s
2025-10-10T14:33:21.720705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0] Write session: Do CDS request
2025-10-10T14:33:21.720711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:21.720710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:21.728894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.729026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:21.729040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 947
2025-10-10T14:33:21.729162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.729210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:21.729219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:21.729223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:21.729639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 947 sessionId:  describe result for acl check
2025-10-10T14:33:21.729684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:21.729690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:21.729692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:21.729698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601150080057943:8015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:21.730254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601150080057943:8015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:21.732535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601150080057943:8015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:21.735127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601150080057943:8015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:21.735142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601150080057943:8015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:21.735146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601150080057943:8015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:21.735154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:21.738186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:21.739284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:21.739488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:21.739498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:21.739510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:21.739574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:21.739614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601149297842716:6347]
2025-10-10T14:33:21.740239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:21.740526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:21.740568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:21.740882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:21.740939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.740946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.740947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.740948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.740949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.740951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.740952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.740954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.740955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.740956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.740957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.740959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.740960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.740966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.740978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.740983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.740987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.740991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.740994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.740997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.741001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.741005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.741010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.741014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.741018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.741022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.741029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.741037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.741044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.741050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.741054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.741060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.741067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.741072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.741077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.741081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.741086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.741091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.741101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.741107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.741111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.741117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.741122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.741132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.741136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.741142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.741147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.741156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.741161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.741166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.741170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.741174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.741213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:21.743775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:21.744230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:21.744244Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:21.744245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:21.744249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:21.744256Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 946 [2:7559601149297842716:6347]
2025-10-10T14:33:21.744270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:21.744288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:21.744296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.744300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.744302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.744320Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:21.744331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:21.744341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:21.744402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.744409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.744411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.744414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:21.744498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:21.744506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.744518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.744531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.744549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:21.744575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080058254:8015], now have 1 active actors on pipe
2025-10-10T14:33:21.744583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080057836:2438], now have 1 active actors on pipe
2025-10-10T14:33:21.744592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601149297842711:6347]
2025-10-10T14:33:21.744594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601149297842711:6347]
2025-10-10T14:33:21.744596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601149297842711:6347]
2025-10-10T14:33:21.744611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:21.744627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:21.744630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:21.744637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:21.744639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:21.744647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:21.744650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:21.744634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 946
2025-10-10T14:33:21.744677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601149297842711:6347]
2025-10-10T14:33:21.744683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:21.744684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:21.744699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.744670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 946
2025-10-10T14:33:21.744703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.744751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:21.744765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.744769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.744772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:21.744784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.744799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:21.744819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.744974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.744982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.744997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.745105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 947 partition: 0 MaxSeqNo: 40 sessionId: src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0
2025-10-10T14:33:21.745547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e048f5-a4baa9a0-1e19596f-45da5683_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:21.748333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0] Write session: try to update token
2025-10-10T14:33:21.748352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:21.763697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId: src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:21.764172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:21.764191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:21.764194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:21.764196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:21.764204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601149297842711:6347]
2025-10-10T14:33:21.764208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601149297842711:6347]
2025-10-10T14:33:21.764212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601149297842711:6347]
2025-10-10T14:33:21.764262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:21.764275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.764277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:21.764329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:21.764336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:21.764339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:21.764418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:21.766267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:21.820366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601150080058334:7749]
2025-10-10T14:33:21.820650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 946, pipe: [1:7559601150080058334:7749]
2025-10-10T14:33:21.874080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:21.874522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.874538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.874580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080058334:7749], now have 1 active actors on pipe
2025-10-10T14:33:21.874801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601150080058334:7749]
2025-10-10T14:33:21.874813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:21.874836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:21.874929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 947 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0
2025-10-10T14:33:21.874749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:21.875154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 947 sessionId: src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0 is DEAD
2025-10-10T14:33:21.875340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:21.875353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0] Write session will restart in 0.005417s
2025-10-10T14:33:21.875380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0] Write session: Do CDS request
2025-10-10T14:33:21.875386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:21.881811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.881913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:21.881927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 948
2025-10-10T14:33:21.882066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:21.882101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:21.882112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:21.882116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:21.882567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 948 sessionId:  describe result for acl check
2025-10-10T14:33:21.882601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:21.882608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:21.882610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:21.882616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601150080058380:8022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:21.883178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601150080058380:8022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:21.885704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601150080058380:8022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:21.887971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601150080058380:8022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:21.887986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601150080058380:8022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:21.887990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601150080058380:8022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:21.887998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:21.892104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:21.893324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:21.893530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:21.893541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:21.893552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:21.893600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:21.893640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601149297843019:6356]
2025-10-10T14:33:21.894293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:21.894592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:21.894636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:21.894964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:21.895019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.895025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.895027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.895028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.895030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.895031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.895032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.895034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.895035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.895037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.895038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.895039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.895040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.895046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.895060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.895065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.895069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.895073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.895078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.895082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.895086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.895090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.895096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.895100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.895105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.895109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.895116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.895126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:21.895132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.895138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:21.895148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.895154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:21.895159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.895165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:21.895170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.895175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:21.895180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.895186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:21.895190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.895197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:21.895206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.895211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:21.895216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.895225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:21.895234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.895239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:21.895248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.895254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.895258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.895269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.895273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.895283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.895324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:21.897705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:21.898189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:21.898205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:21.898207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:21.898212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:21.898219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 947 [2:7559601149297843019:6356]
2025-10-10T14:33:21.898231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:21.898250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:21.898253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.898257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.898260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.898278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:21.898291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:21.898300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:21.898357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.898365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.898367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.898370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:21.898450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:21.898459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.898472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:21.898485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:21.898508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:21.898534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080058692:8022], now have 1 active actors on pipe
2025-10-10T14:33:21.898542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080058335:2438], now have 1 active actors on pipe
2025-10-10T14:33:21.898550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601149297843014:6356]
2025-10-10T14:33:21.898556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601149297843014:6356]
2025-10-10T14:33:21.898559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601149297843014:6356]
2025-10-10T14:33:21.898574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:21.898592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:21.898594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:21.898608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:21.898610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:21.898612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:21.898616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:21.898593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 947
2025-10-10T14:33:21.898595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 947
2025-10-10T14:33:21.898653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.898662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.898682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601149297843014:6356]
2025-10-10T14:33:21.898693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:21.898699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:21.898726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:21.898744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:21.898748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:21.898751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:21.898763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:21.898773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:21.899096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.899258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:21.899266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:21.899283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:21.899381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 948 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0
2025-10-10T14:33:21.899823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c498fdee-8fee8938-63fc4bf3-1a0cf9c6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:21.902521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0] Write session: try to update token
2025-10-10T14:33:21.902539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:21.916366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId: src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:21.918036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:21.918062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:21.918067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:21.918069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:21.918078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601149297843014:6356]
2025-10-10T14:33:21.918083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601149297843014:6356]
2025-10-10T14:33:21.918086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601149297843014:6356]
2025-10-10T14:33:21.918138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:21.918138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:21.918154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:21.918155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:21.918157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:21.918164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:21.918295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:21.918945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:21.974990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601150080058823:7749]
2025-10-10T14:33:21.975275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 947, pipe: [1:7559601150080058823:7749]
2025-10-10T14:33:22.047299Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:22.047875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.047893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.047940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601150080058823:7749], now have 1 active actors on pipe
2025-10-10T14:33:22.048201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:22.048203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:22.048226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:22.048233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:22.048305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601150080058823:7749]
2025-10-10T14:33:22.048316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 948 reason: error at write: Disconnected sessionId: src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0
2025-10-10T14:33:22.048547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 948 sessionId: src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0 is DEAD
2025-10-10T14:33:22.048737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:22.048754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0] Write session will restart in 0.006413s
2025-10-10T14:33:22.048789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0] Write session: Do CDS request
2025-10-10T14:33:22.048805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:22.056939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.057045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:22.057059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 949
2025-10-10T14:33:22.057209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.057251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:22.057262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:22.057267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:22.057761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 949 sessionId:  describe result for acl check
2025-10-10T14:33:22.057797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:22.057803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:22.057806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:22.057813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601154375026216:8026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:22.058520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601154375026216:8026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:22.061366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601154375026216:8026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:22.064562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601154375026216:8026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:22.064576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601154375026216:8026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:22.064580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601154375026216:8026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:22.064589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:22.067341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:22.068314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:22.068566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:22.068578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:22.068593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:22.068654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:22.068703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601153592810594:6358]
2025-10-10T14:33:22.069297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:22.069649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:22.069697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:22.069944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:22.070006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.070013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.070014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.070015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.070016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.070018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.070019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.070020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.070021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.070022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.070024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.070025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.070026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.070033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.070045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.070049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.070057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.070062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.070066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.070070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.070073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.070077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.070083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.070087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.070091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.070095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.070105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.070115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.070121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.070132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.070141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.070146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.070151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.070157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.070165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.070171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.070179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.070187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.070191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.070197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.070202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.070211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.070219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.070225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.070234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.070238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.070246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.070256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.070260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.070270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.070274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.070283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.070330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:22.073006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:22.073511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:22.073522Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:22.073524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:22.073529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:22.073535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 948 [2:7559601153592810594:6358]
2025-10-10T14:33:22.073550Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:22.073570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:22.073574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.073578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.073581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.073600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:22.073628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:22.073642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:22.073712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.073720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.073723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.073725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:22.073802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:22.073811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.073824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.073842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.073866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:22.073894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375026120:2438], now have 1 active actors on pipe
2025-10-10T14:33:22.073898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375026562:8026], now have 1 active actors on pipe
2025-10-10T14:33:22.073906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601153592810589:6358]
2025-10-10T14:33:22.073914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601153592810589:6358]
2025-10-10T14:33:22.073917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601153592810589:6358]
2025-10-10T14:33:22.073935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:22.073947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:22.073950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:22.073953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:22.073956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:22.073937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 948
2025-10-10T14:33:22.073955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 948
2025-10-10T14:33:22.073975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:22.073984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:22.074026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.074036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.074052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601153592810589:6358]
2025-10-10T14:33:22.074065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:22.074071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:22.074096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:22.074109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.074118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.074121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:22.074133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.074149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:22.074180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.074322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.074332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.074348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.074459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 949 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0
2025-10-10T14:33:22.074851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf4c170-1dbae36f-d4f0efda-56410b13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:22.081022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0] Write session: try to update token
2025-10-10T14:33:22.081043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:22.095179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:22.095204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:22.095208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:22.095210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:22.095220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601153592810589:6358]
2025-10-10T14:33:22.095227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601153592810589:6358]
2025-10-10T14:33:22.095232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601153592810589:6358]
2025-10-10T14:33:22.095284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:22.095296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.095299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:22.095305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:22.095322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:22.095327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:22.095432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:22.095583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId: src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:22.098276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:22.148562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601154375026610:7749]
2025-10-10T14:33:22.148818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 948, pipe: [1:7559601154375026610:7749]
2025-10-10T14:33:22.203313Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:22.204171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.204193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.204246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375026610:7749], now have 1 active actors on pipe
2025-10-10T14:33:22.204494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:22.204494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:22.204518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:22.204523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:22.204552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601154375026610:7749]
2025-10-10T14:33:22.204587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 949 reason: error at write: Disconnected sessionId: src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0
2025-10-10T14:33:22.204831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 949 sessionId: src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0 is DEAD
2025-10-10T14:33:22.204963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:22.204974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0] Write session will restart in 0.009213s
2025-10-10T14:33:22.204999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0] Write session: Do CDS request
2025-10-10T14:33:22.205009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:22.215907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.216000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:22.216014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 950
2025-10-10T14:33:22.216214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.216266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:22.216277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:22.216281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:22.216720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 950 sessionId:  describe result for acl check
2025-10-10T14:33:22.216758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:22.216764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:22.216767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:22.216775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601154375026852:8030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:22.217417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601154375026852:8030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:22.219901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601154375026852:8030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:22.222535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601154375026852:8030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:22.222548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601154375026852:8030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:22.222552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601154375026852:8030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:22.222561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:22.224321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:22.225612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:22.225936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:22.225950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:22.225963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:22.226037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:22.226089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601153592810874:6360]
2025-10-10T14:33:22.226585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:22.226936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:22.227003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:22.227330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:22.227382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.227388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.227388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.227389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.227390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.227391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.227391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.227392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.227393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.227394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.227394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.227395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.227396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.227400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.227412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.227417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.227421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.227424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.227429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.227433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.227436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.227438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.227442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.227444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.227446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.227448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.227453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.227459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.227464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.227467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.227471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.227477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.227481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.227487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.227492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.227498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.227510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.227514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.227517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.227520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.227523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.227526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.227529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.227532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.227539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.227542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.227545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.227548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.227550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.227554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.227556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.227559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.227583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:22.229877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:22.230199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:22.230207Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:22.230208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:22.230211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:22.230216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 949 [2:7559601153592810874:6360]
2025-10-10T14:33:22.230224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:22.230237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:22.230239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.230241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.230242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.230255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:22.230263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:22.230270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:22.230329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.230335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.230336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.230338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:22.230581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 949
2025-10-10T14:33:22.230581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 949
2025-10-10T14:33:22.230681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:22.230693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.230706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.230719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.230742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:22.230771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375026611:2438], now have 1 active actors on pipe
2025-10-10T14:33:22.230779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375027086:8030], now have 1 active actors on pipe
2025-10-10T14:33:22.230793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.230802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.230826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601153592810869:6360]
2025-10-10T14:33:22.230833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601153592810869:6360]
2025-10-10T14:33:22.230835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601153592810869:6360]
2025-10-10T14:33:22.230848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:22.230859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:22.230862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:22.230864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:22.230868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:22.230883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:22.230891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:22.230911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed876f33-61f015f5-e718038b-7da90ffd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:22.230923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.230927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.230930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:22.230941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.230955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:22.230984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601153592810869:6360]
2025-10-10T14:33:22.230998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:22.231005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:22.231009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.231168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.231176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.231191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.231300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 950 partition: 0 MaxSeqNo: 40 sessionId: src_id|ed876f33-61f015f5-e718038b-7da90ffd_0
2025-10-10T14:33:22.231716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a559ba-f7aa979c-fa61a3d8-c5f34e84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ed876f33-61f015f5-e718038b-7da90ffd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:22.234741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed876f33-61f015f5-e718038b-7da90ffd_0] Write session: try to update token
2025-10-10T14:33:22.234758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed876f33-61f015f5-e718038b-7da90ffd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:22.242477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:22.242496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:22.242507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601153592810869:6360]
2025-10-10T14:33:22.242550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:22.242553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:22.242725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:22.242870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:22.243013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:22.243158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:22.243348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:22.243388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:22.249477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId: src_id|ed876f33-61f015f5-e718038b-7da90ffd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:22.251951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:22.252199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.252222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.252274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:22.252355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:22.260708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:22.260728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:22.260732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:22.260734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:22.260745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601153592810869:6360]
2025-10-10T14:33:22.260749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601153592810869:6360]
2025-10-10T14:33:22.260755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601153592810869:6360]
2025-10-10T14:33:22.260800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:22.260803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:22.260806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:22.260810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.260813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:22.260814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:22.260944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:22.304720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601154375027101:7749]
2025-10-10T14:33:22.305056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 949, pipe: [1:7559601154375027101:7749]
2025-10-10T14:33:22.371327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:22.378584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.378610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.378764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.378827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.378886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.378944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.378985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.378993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.379063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.379117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.379177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.379238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.379282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.379290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.379354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.379408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.379467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.379525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.379573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.379581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.379641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.379699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.379755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.379816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.379860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.379866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.379959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.380014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.380074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.380136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.380187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.380193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.380251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.380306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.380369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.380428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.380468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.380474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.380533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.380592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.380651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.380708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.380749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.380754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.380816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.380876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.380931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.380988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.381030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.381038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.381103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.381157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.381210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.381273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.381321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.381340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.381401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:22.381456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:22.381524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:22.381580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:22.381640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:22.381647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:22.381696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375027101:7749], now have 1 active actors on pipe
2025-10-10T14:33:22.381923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601154375027101:7749]
2025-10-10T14:33:22.381925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:22.381973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:22.381978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:22.382008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 950 reason: error at write: Disconnected sessionId: src_id|ed876f33-61f015f5-e718038b-7da90ffd_0
2025-10-10T14:33:22.382248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 950 sessionId: src_id|ed876f33-61f015f5-e718038b-7da90ffd_0 is DEAD
2025-10-10T14:33:22.382415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed876f33-61f015f5-e718038b-7da90ffd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:22.382424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed876f33-61f015f5-e718038b-7da90ffd_0] Write session will restart in 0.009140s
2025-10-10T14:33:22.382461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed876f33-61f015f5-e718038b-7da90ffd_0] Write session: Do CDS request
2025-10-10T14:33:22.382466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed876f33-61f015f5-e718038b-7da90ffd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:22.382639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:22.392874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed876f33-61f015f5-e718038b-7da90ffd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.392933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:22.392955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 951
2025-10-10T14:33:22.393090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.393123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:22.393133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:22.393137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:22.393631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 951 sessionId:  describe result for acl check
2025-10-10T14:33:22.393674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:22.393676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:22.393677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:22.393686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601154375027334:8035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:22.394255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601154375027334:8035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:22.396472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601154375027334:8035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:22.399068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601154375027334:8035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:22.399091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601154375027334:8035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:22.399095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601154375027334:8035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:22.399104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:22.399886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:22.401070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:22.401267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:22.401279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:22.401292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:22.401358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:22.401395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601153592811167:6363]
2025-10-10T14:33:22.401799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:22.402082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:22.402116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:22.402341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:22.402382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.402386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.402387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.402388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.402401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.402402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.402403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.402403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.402404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.402405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.402405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.402406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.402407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.402411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.402421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.402423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.402425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.402427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.402430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.402432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.402434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.402436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.402438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.402441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.402443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.402445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.402450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.402456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.402461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.402464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.402467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.402470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.402474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.402477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.402480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.402483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.402485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.402488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.402491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.402494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.402496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.402499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.402502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.402506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.402508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.402512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.402517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.402520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.402522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.402525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.402528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.402531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.402565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:22.404806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:22.405524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:22.405538Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:22.405541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:22.405544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:22.405550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 950 [2:7559601153592811167:6363]
2025-10-10T14:33:22.405563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:22.405580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:22.405584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.405587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.405590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.405607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:22.405622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:22.405636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:22.405696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.405704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.405706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.405708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:22.405773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:22.405780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.405792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.405804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.405824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:22.405851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375027592:8035], now have 1 active actors on pipe
2025-10-10T14:33:22.405859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375027114:2438], now have 1 active actors on pipe
2025-10-10T14:33:22.405868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601153592811162:6363]
2025-10-10T14:33:22.405875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601153592811162:6363]
2025-10-10T14:33:22.405877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601153592811162:6363]
2025-10-10T14:33:22.405890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:22.405905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:22.405907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:22.405910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:22.405912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:22.405921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:22.405924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:22.405947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601153592811162:6363]
2025-10-10T14:33:22.405925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 950
2025-10-10T14:33:22.405954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:22.405933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 950
2025-10-10T14:33:22.405956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:22.405971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.405977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.406040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:22.406055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.406060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.406063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:22.406075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.406095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:22.406119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.406266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.406276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.406294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.406423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 951 partition: 0 MaxSeqNo: 40 sessionId: src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0
2025-10-10T14:33:22.406832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed876f33-61f015f5-e718038b-7da90ffd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:22.409360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0] Write session: try to update token
2025-10-10T14:33:22.409374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:22.422957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId: src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:22.424568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:22.424588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:22.424590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:22.424591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:22.424598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601153592811162:6363]
2025-10-10T14:33:22.424602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601153592811162:6363]
2025-10-10T14:33:22.424604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601153592811162:6363]
2025-10-10T14:33:22.424643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:22.424649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.424650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:22.424669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:22.424689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:22.424695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:22.424768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:22.425468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:22.481887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601154375027606:7749]
2025-10-10T14:33:22.482150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 950, pipe: [1:7559601154375027606:7749]
2025-10-10T14:33:22.537361Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:22.537820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.537841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.537900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375027606:7749], now have 1 active actors on pipe
2025-10-10T14:33:22.538141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:22.538164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:22.538175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:22.538189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601154375027606:7749]
2025-10-10T14:33:22.538211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:22.538250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 951 reason: error at write: Disconnected sessionId: src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0
2025-10-10T14:33:22.538466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 951 sessionId: src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0 is DEAD
2025-10-10T14:33:22.538612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:22.538623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0] Write session will restart in 0.007984s
2025-10-10T14:33:22.538649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0] Write session: Do CDS request
2025-10-10T14:33:22.538667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:22.547863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.547910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:22.547934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 952
2025-10-10T14:33:22.548089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.548124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:22.548133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:22.548137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:22.548673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 952 sessionId:  describe result for acl check
2025-10-10T14:33:22.548706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:22.548713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:22.548716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:22.548725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601154375027722:8039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:22.549288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601154375027722:8039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:22.551573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601154375027722:8039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:22.554109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601154375027722:8039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:22.554125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601154375027722:8039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:22.554130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601154375027722:8039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:22.554138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:22.558436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:22.559721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:22.559933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:22.559945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:22.559957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:22.560007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:22.560053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601153592811449:6365]
2025-10-10T14:33:22.560740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:22.561054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:22.561101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:22.561459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:22.561519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.561526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.561528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.561529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.561531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.561533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.561534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.561535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.561537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.561539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.561540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.561541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.561543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.561549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.561564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.561569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.561574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.561579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.561583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.561588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.561592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.561597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.561601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.561606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.561610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.561614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.561623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.561632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.561645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.561652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.561657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.561663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.561673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.561678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.561688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.561694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.561703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.561708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.561714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.561724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.561731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.561741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.561746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.561754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.561759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.561767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.561777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.561783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.561792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.561799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.561809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.561815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.561867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:22.564260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:22.564595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:22.564611Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:22.564613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:22.564617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:22.564623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 951 [2:7559601153592811449:6365]
2025-10-10T14:33:22.564636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:22.564655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:22.564664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.564667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.564669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.564687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:22.564695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:22.564704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:22.564768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.564776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.564778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.564781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:22.564853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:22.564861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.564873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.564887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.564909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:22.564937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375027607:2438], now have 1 active actors on pipe
2025-10-10T14:33:22.564945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375027992:8039], now have 1 active actors on pipe
2025-10-10T14:33:22.564954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601153592811444:6365]
2025-10-10T14:33:22.564961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601153592811444:6365]
2025-10-10T14:33:22.564963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601153592811444:6365]
2025-10-10T14:33:22.564977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:22.564991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:22.564995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:22.565001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:22.565003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:22.564992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 951
2025-10-10T14:33:22.565012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:22.565016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:22.565038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 951
2025-10-10T14:33:22.565041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601153592811444:6365]
2025-10-10T14:33:22.565052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:22.565060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:22.565070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.565075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.565132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12054053-d7404ff4-f4abd58d-4e025853_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:22.565145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.565149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.565151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:22.565163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.565174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:22.565201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.565391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.565400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.565418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.565508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 952 partition: 0 MaxSeqNo: 40 sessionId: src_id|12054053-d7404ff4-f4abd58d-4e025853_0
2025-10-10T14:33:22.565977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297642a5-dc9923f6-d3c25688-ea686f6b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12054053-d7404ff4-f4abd58d-4e025853_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:22.568710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12054053-d7404ff4-f4abd58d-4e025853_0] Write session: try to update token
2025-10-10T14:33:22.568730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12054053-d7404ff4-f4abd58d-4e025853_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:22.582899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId: src_id|12054053-d7404ff4-f4abd58d-4e025853_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:22.584538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:22.584558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:22.584562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:22.584564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:22.584574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601153592811444:6365]
2025-10-10T14:33:22.584578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601153592811444:6365]
2025-10-10T14:33:22.584583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601153592811444:6365]
2025-10-10T14:33:22.584631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:22.584624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:22.584639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.584641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:22.584641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:22.584645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:22.584776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:22.585605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:22.638550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601154375028110:7749]
2025-10-10T14:33:22.638828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 951, pipe: [1:7559601154375028110:7749]
2025-10-10T14:33:22.699295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:22.699962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.699975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.700015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375028110:7749], now have 1 active actors on pipe
2025-10-10T14:33:22.700251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:22.700262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:22.700267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:22.700327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601154375028110:7749]
2025-10-10T14:33:22.700347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 952 reason: error at write: Disconnected sessionId: src_id|12054053-d7404ff4-f4abd58d-4e025853_0
2025-10-10T14:33:22.700394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:22.700567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 952 sessionId: src_id|12054053-d7404ff4-f4abd58d-4e025853_0 is DEAD
2025-10-10T14:33:22.700724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12054053-d7404ff4-f4abd58d-4e025853_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:22.700735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12054053-d7404ff4-f4abd58d-4e025853_0] Write session will restart in 0.008918s
2025-10-10T14:33:22.700760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12054053-d7404ff4-f4abd58d-4e025853_0] Write session: Do CDS request
2025-10-10T14:33:22.700766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12054053-d7404ff4-f4abd58d-4e025853_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:22.710927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12054053-d7404ff4-f4abd58d-4e025853_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.711005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:22.711022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 953
2025-10-10T14:33:22.711216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.711283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:22.711294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:22.711299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:22.711765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 953 sessionId:  describe result for acl check
2025-10-10T14:33:22.711807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:22.711815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:22.711817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:22.711824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601154375028346:8045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:22.712465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601154375028346:8045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:22.715167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601154375028346:8045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:22.717420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601154375028346:8045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:22.717436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601154375028346:8045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:22.717440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601154375028346:8045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:22.717448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:22.717762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:22.719152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:22.719389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:22.719401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:22.719413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:22.719486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:22.719527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601153592811734:6368]
2025-10-10T14:33:22.720035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:22.720308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:22.720352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:22.720638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:22.720685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.720689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.720690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.720691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.720691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.720692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.720693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.720693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.720694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.720695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.720695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.720696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.720697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.720700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.720710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.720712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.720714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.720717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.720719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.720721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.720724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.720726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.720729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.720732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.720735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.720739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.720747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.720755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.720762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.720765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.720768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.720771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.720774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.720779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.720783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.720788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.720794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.720799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.720803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.720808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.720813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.720818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.720823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.720828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.720830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.720834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.720839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.720844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.720848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.720854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.720858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.720863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.720890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:22.723266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:22.723607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:22.723623Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:22.723625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:22.723629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:22.723636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 952 [2:7559601153592811734:6368]
2025-10-10T14:33:22.723651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:22.723672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:22.723682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.723686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.723693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.723722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:22.723735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:22.723747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:22.723813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.723823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.723825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.723828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:22.723896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:22.723906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.723919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.723942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.723961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:22.723984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375028594:8045], now have 1 active actors on pipe
2025-10-10T14:33:22.723988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375028114:2438], now have 1 active actors on pipe
2025-10-10T14:33:22.723995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601153592811729:6368]
2025-10-10T14:33:22.723998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601153592811729:6368]
2025-10-10T14:33:22.724000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601153592811729:6368]
2025-10-10T14:33:22.724016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:22.724029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:22.724032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:22.724034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:22.724044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:22.724018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 952
2025-10-10T14:33:22.724027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 952
2025-10-10T14:33:22.724061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:22.724070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:22.724103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601153592811729:6368]
2025-10-10T14:33:22.724117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:22.724137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.724147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.724152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:22.724327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:22.724343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.724348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.724351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:22.724364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.724378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:22.724408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.724597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.724606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.724622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.724716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 953 partition: 0 MaxSeqNo: 40 sessionId: src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0
2025-10-10T14:33:22.725138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12054053-d7404ff4-f4abd58d-4e025853_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:22.727813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0] Write session: try to update token
2025-10-10T14:33:22.727831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:22.741812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId: src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:22.743227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:22.743246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:22.743250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:22.743253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:22.743263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601153592811729:6368]
2025-10-10T14:33:22.743267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601153592811729:6368]
2025-10-10T14:33:22.743271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601153592811729:6368]
2025-10-10T14:33:22.743318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:22.743323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:22.743328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:22.743330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.743332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:22.743333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:22.743471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:22.744507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:22.800320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601154375028620:7749]
2025-10-10T14:33:22.800620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 952, pipe: [1:7559601154375028620:7749]
2025-10-10T14:33:22.856951Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:22.857251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.857274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.857346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375028620:7749], now have 1 active actors on pipe
2025-10-10T14:33:22.857578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:22.857621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601154375028620:7749]
2025-10-10T14:33:22.857624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:22.857628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:22.857652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:22.857691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 953 reason: error at write: Disconnected sessionId: src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0
2025-10-10T14:33:22.857893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 953 sessionId: src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0 is DEAD
2025-10-10T14:33:22.858054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:22.858066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0] Write session will restart in 0.005693s
2025-10-10T14:33:22.858091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0] Write session: Do CDS request
2025-10-10T14:33:22.858105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:22.864957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.865010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:22.865028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 954
2025-10-10T14:33:22.865387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:22.865425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:22.865435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:22.865439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:22.865890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 954 sessionId:  describe result for acl check
2025-10-10T14:33:22.865925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:22.865932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:22.865934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:22.865940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601154375028665:8058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:22.866463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601154375028665:8058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:22.868543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601154375028665:8058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:22.871432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601154375028665:8058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:22.871445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601154375028665:8058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:22.871449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601154375028665:8058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:22.871458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:22.876269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:22.877635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:22.877812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:22.877822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:22.877834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:22.877881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:22.877923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601153592812054:6383]
2025-10-10T14:33:22.878595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:22.878874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:22.878917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:22.879248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:22.879296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.879303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.879304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.879305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.879307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.879308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.879309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.879310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.879312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.879313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.879314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.879315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.879316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.879322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.879336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.879345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.879350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.879359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.879363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.879372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.879376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.879385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.879390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.879394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.879398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.879402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.879414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.879423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:22.879430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.879436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:22.879445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.879456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:22.879465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.879473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:22.879481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.879492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:22.879501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.879506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:22.879511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.879522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:22.879530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.879539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:22.879550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.879557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:22.879561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.879566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:22.879572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.879578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.879582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.879588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.879592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.879597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.879638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:22.881949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:22.882663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:22.882675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:22.882678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:22.882682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:22.882689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 953 [2:7559601153592812054:6383]
2025-10-10T14:33:22.882702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:22.882719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:22.882727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.882730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.882733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.882762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:22.882777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:22.882785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:22.882838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.882845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.882847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.882850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:22.882915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:22.882924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.882936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:22.882949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:22.882968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:22.882995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375028632:2438], now have 1 active actors on pipe
2025-10-10T14:33:22.883005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375028954:8058], now have 1 active actors on pipe
2025-10-10T14:33:22.883013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601153592812049:6383]
2025-10-10T14:33:22.883018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601153592812049:6383]
2025-10-10T14:33:22.883020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601153592812049:6383]
2025-10-10T14:33:22.883035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:22.883053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:22.883053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:22.883056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:22.883058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:22.883069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:22.883044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 953
2025-10-10T14:33:22.883072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:22.883094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601153592812049:6383]
2025-10-10T14:33:22.883098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:22.883100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:22.883151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 953
2025-10-10T14:33:22.883237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.883249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.883280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:22.883292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:22.883296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:22.883299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:22.883313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:22.883324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:22.883344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.883495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.883502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.883516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:22.883595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 954 partition: 0 MaxSeqNo: 40 sessionId: src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0
2025-10-10T14:33:22.883973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35e53ff5-fd2113f4-91678829-29b1d9dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:22.886572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0] Write session: try to update token
2025-10-10T14:33:22.886591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:22.894573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:22.894588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:22.894600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601153592812049:6383]
2025-10-10T14:33:22.894652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:22.894658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:22.894832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:22.894971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:22.895102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:22.895243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:22.895430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:22.895476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:22.901674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId: src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:22.904264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:22.904472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:22.904508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:22.904550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:22.904643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:22.913262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:22.913283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:22.913286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:22.913289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:22.913301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601153592812049:6383]
2025-10-10T14:33:22.913306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601153592812049:6383]
2025-10-10T14:33:22.913309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601153592812049:6383]
2025-10-10T14:33:22.913376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:22.913381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:22.913384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:22.913388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:22.913404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:22.913412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:22.913540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:22.958035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601154375029125:7749]
2025-10-10T14:33:22.958336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 953, pipe: [1:7559601154375029125:7749]
2025-10-10T14:33:23.035932Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:23.044393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.044427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.044610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.044676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.044743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.044810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.045086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.045101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.045173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.045234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.045298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.045385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.045435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.045445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.045512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.045571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.045636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.045701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.045745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.045753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.045822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.045887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.045953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.046015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.046061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.046071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.046137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.046198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.046269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.046334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.046391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.046398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.046468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.046529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.046593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.046659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.046705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.046712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.046778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.046840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.046905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.046968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.047015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.047022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.047087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.047147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.047212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.047277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.047324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.047331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.047397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.047456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.047519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.047582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.047711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.047719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.047785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:23.047846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:23.047910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:23.047976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:23.048022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:23.048029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:23.048095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601154375029125:7749], now have 1 active actors on pipe
2025-10-10T14:33:23.048343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:23.048355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:23.048357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:23.048402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 954 reason: error at write: Disconnected sessionId: src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0
2025-10-10T14:33:23.048419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601154375029125:7749]
2025-10-10T14:33:23.048699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 954 sessionId: src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0 is DEAD
2025-10-10T14:33:23.048804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:23.048815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0] Write session will restart in 0.007530s
2025-10-10T14:33:23.048853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0] Write session: Do CDS request
2025-10-10T14:33:23.048860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:23.049155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:23.057959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.058019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:23.058034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 955
2025-10-10T14:33:23.058241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.058281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:23.058293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:23.058298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:23.058783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 955 sessionId:  describe result for acl check
2025-10-10T14:33:23.058822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:23.058832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:23.058834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:23.058843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601158669996484:8062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:23.059465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601158669996484:8062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:23.062313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601158669996484:8062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:23.065260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601158669996484:8062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:23.065270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601158669996484:8062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:23.065274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601158669996484:8062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:23.065283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:23.070378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:23.072327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:23.072541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:23.072553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:23.072565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:23.072618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:23.072675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601157887779635:6385]
2025-10-10T14:33:23.073344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:23.073667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:23.073711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:23.074044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:23.074105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.074112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.074113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.074114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.074116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.074117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.074118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.074120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.074121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.074123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.074124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.074125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.074126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.074132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.074145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.074150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.074153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.074158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.074162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.074166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.074171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.074174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.074179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.074183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.074187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.074190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.074198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.074207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.074214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.074219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.074224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.074229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.074234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.074239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.074253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.074259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.074263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.074268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.074273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.074278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.074282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.074287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.074292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.074297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.074302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.074307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.074312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.074317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.074323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.074328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.074333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.074340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.074407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:23.076970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:23.077641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:23.077655Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:23.077657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:23.077660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:23.077669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 954 [2:7559601157887779635:6385]
2025-10-10T14:33:23.077682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:23.077699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:23.077708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.077711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.077714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.077731Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:23.077739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:23.077747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:23.077806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.077813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.077815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.077818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:23.077884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:23.077894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.077907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.077919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.077938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:23.077959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601157887779630:6385]
2025-10-10T14:33:23.077966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601157887779630:6385]
2025-10-10T14:33:23.077968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601157887779630:6385]
2025-10-10T14:33:23.077977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:23.077988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:23.077992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:23.077994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:23.077998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:23.078016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:23.078025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:23.078036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669996424:2438], now have 1 active actors on pipe
2025-10-10T14:33:23.078040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669996772:8062], now have 1 active actors on pipe
2025-10-10T14:33:23.078069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 954
2025-10-10T14:33:23.078071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 954
2025-10-10T14:33:23.078076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601157887779630:6385]
2025-10-10T14:33:23.078086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:23.078099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:23.078124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.078129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.078164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:23.078177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.078180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.078185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:23.078196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.078212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:23.078228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.078419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.078434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.078460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.078590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 955 partition: 0 MaxSeqNo: 40 sessionId: src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0
2025-10-10T14:33:23.078993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904e39bc-9359ddf-ebd60b9d-60ae24c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:23.081717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0] Write session: try to update token
2025-10-10T14:33:23.081736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:23.095902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId: src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:23.097925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:23.097952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:23.097956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:23.097959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:23.097970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601157887779630:6385]
2025-10-10T14:33:23.097976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601157887779630:6385]
2025-10-10T14:33:23.097979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601157887779630:6385]
2025-10-10T14:33:23.098034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:23.098042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:23.098043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:23.098048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:23.098052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.098055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:23.098192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:23.098657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:23.148456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601158669996919:7749]
2025-10-10T14:33:23.148753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 954, pipe: [1:7559601158669996919:7749]
2025-10-10T14:33:23.220747Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:23.221216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.221232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.221281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669996919:7749], now have 1 active actors on pipe
2025-10-10T14:33:23.221492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:23.221515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:23.221522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601158669996919:7749]
2025-10-10T14:33:23.221540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:23.221543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:23.221605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 955 reason: error at write: Disconnected sessionId: src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0
2025-10-10T14:33:23.221794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 955 sessionId: src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0 is DEAD
2025-10-10T14:33:23.221990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:23.221998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0] Write session will restart in 0.007182s
2025-10-10T14:33:23.222023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0] Write session: Do CDS request
2025-10-10T14:33:23.222029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:23.230946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.231002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:23.231020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 956
2025-10-10T14:33:23.231212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.231252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:23.231262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:23.231266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:23.231740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 956 sessionId:  describe result for acl check
2025-10-10T14:33:23.231774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:23.231780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:23.231782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:23.231788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601158669997018:8066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:23.232375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601158669997018:8066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:23.234763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601158669997018:8066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:23.237164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601158669997018:8066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:23.237176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601158669997018:8066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:23.237179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601158669997018:8066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:23.237188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:23.241214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:23.242464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:23.242656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:23.242667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:23.242679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:23.242728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:23.242768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601157887779920:6387]
2025-10-10T14:33:23.243408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:23.243723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:23.243757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:23.244075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:23.244124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.244130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.244132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.244133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.244134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.244136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.244137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.244138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.244139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.244140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.244142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.244143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.244144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.244150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.244163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.244167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.244171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.244175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.244179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.244183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.244187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.244191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.244195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.244199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.244202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.244206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.244214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.244223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.244229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.244235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.244239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.244250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.244254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.244264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.244269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.244278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.244283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.244287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.244296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.244301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.244305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.244311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.244319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.244325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.244329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.244338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.244343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.244353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.244358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.244365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.244369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.244380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.244420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:23.246703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:23.247144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:23.247158Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:23.247160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:23.247164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:23.247170Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 955 [2:7559601157887779920:6387]
2025-10-10T14:33:23.247183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:23.247203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:23.247210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.247213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.247216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.247232Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:23.247243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:23.247252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:23.247312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.247321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.247323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.247326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:23.247392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:23.247399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.247409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.247426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.247444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:23.247469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669997314:8066], now have 1 active actors on pipe
2025-10-10T14:33:23.247473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669996920:2438], now have 1 active actors on pipe
2025-10-10T14:33:23.247481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601157887779915:6387]
2025-10-10T14:33:23.247484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601157887779915:6387]
2025-10-10T14:33:23.247486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601157887779915:6387]
2025-10-10T14:33:23.247499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:23.247513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:23.247522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:23.247525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:23.247527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:23.247534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:23.247538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:23.247557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601157887779915:6387]
2025-10-10T14:33:23.247565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:23.247545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 955
2025-10-10T14:33:23.247568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:23.247548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 955
2025-10-10T14:33:23.247588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.247597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.247635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:23.247647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.247650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.247653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:23.247665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.247679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:23.247701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.247872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.247881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.247895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.247982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 956 partition: 0 MaxSeqNo: 40 sessionId: src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0
2025-10-10T14:33:23.248385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ef60c9-effcc043-eb79d121-d0f823d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:23.251077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0] Write session: try to update token
2025-10-10T14:33:23.251094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:23.264856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId: src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:23.266909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:23.266929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:23.266932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:23.266934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:23.266943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601157887779915:6387]
2025-10-10T14:33:23.266948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601157887779915:6387]
2025-10-10T14:33:23.266951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601157887779915:6387]
2025-10-10T14:33:23.267000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:23.267004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:23.267010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:23.267012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.267014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:23.267014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:23.267156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:23.267592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:23.321534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601158669997417:7749]
2025-10-10T14:33:23.321784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 955, pipe: [1:7559601158669997417:7749]
2025-10-10T14:33:23.376508Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:23.377276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.377297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.377359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669997417:7749], now have 1 active actors on pipe
2025-10-10T14:33:23.377547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:23.377560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:23.377565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:23.377584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:23.377608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601158669997417:7749]
2025-10-10T14:33:23.377660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 956 reason: error at write: Disconnected sessionId: src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0
2025-10-10T14:33:23.377867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 956 sessionId: src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0 is DEAD
2025-10-10T14:33:23.378035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:23.378044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0] Write session will restart in 0.007022s
2025-10-10T14:33:23.378063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0] Write session: Do CDS request
2025-10-10T14:33:23.378071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:23.385820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.385887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:23.385901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 957
2025-10-10T14:33:23.386069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.386107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:23.386117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:23.386121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:23.386523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 957 sessionId:  describe result for acl check
2025-10-10T14:33:23.386562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:23.386568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:23.386570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:23.386576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601158669997539:8071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:23.387227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601158669997539:8071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:23.389855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601158669997539:8071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:23.392362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601158669997539:8071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:23.392372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601158669997539:8071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:23.392375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601158669997539:8071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:23.392382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:23.394848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:23.396363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:23.396543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:23.396554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:23.396566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:23.396629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:23.396667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601157887780218:6390]
2025-10-10T14:33:23.397288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:23.397583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:23.397625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:23.397940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:23.397994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.398000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.398001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.398003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.398004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.398005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.398006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.398008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.398009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.398010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.398011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.398012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.398013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.398019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.398033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.398037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.398041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.398045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.398049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.398054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.398057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.398066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.398070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.398078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.398082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.398090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.398097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.398111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.398117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.398123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.398127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.398133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.398137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.398142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.398146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.398152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.398158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.398163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.398169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.398174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.398182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.398187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.398196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.398200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.398208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.398211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.398215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.398223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.398227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.398237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.398245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.398254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.398281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:23.400489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:23.400971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:23.400984Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:23.400986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:23.400990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:23.400996Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 956 [2:7559601157887780218:6390]
2025-10-10T14:33:23.401009Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:23.401026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:23.401033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.401037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.401039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.401056Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:23.401068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:23.401076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:23.401133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.401139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.401141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.401144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:23.401209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:23.401218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.401230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.401242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.401266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:23.401287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669997430:2438], now have 1 active actors on pipe
2025-10-10T14:33:23.401295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669997889:8071], now have 1 active actors on pipe
2025-10-10T14:33:23.401303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601157887780213:6390]
2025-10-10T14:33:23.401305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601157887780213:6390]
2025-10-10T14:33:23.401307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601157887780213:6390]
2025-10-10T14:33:23.401323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:23.401352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:23.401354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:23.401357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:23.401359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:23.401375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:23.401379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:23.401341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 956
2025-10-10T14:33:23.401357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 956
2025-10-10T14:33:23.401430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.401441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.401455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601157887780213:6390]
2025-10-10T14:33:23.401469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:23.401485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:23.401503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71d849db-e408edf0-90041d80-5d04261b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:23.401515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.401519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.401526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:23.401537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.401548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:23.401571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.401707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.401722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.401764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.401868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 957 partition: 0 MaxSeqNo: 40 sessionId: src_id|71d849db-e408edf0-90041d80-5d04261b_0
2025-10-10T14:33:23.402287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fc4e069-fe8cc5fd-221bc6c9-500ec36b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71d849db-e408edf0-90041d80-5d04261b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:23.404800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d849db-e408edf0-90041d80-5d04261b_0] Write session: try to update token
2025-10-10T14:33:23.404818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d849db-e408edf0-90041d80-5d04261b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:23.418144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId: src_id|71d849db-e408edf0-90041d80-5d04261b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:23.420370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:23.420393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:23.420396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:23.420398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:23.420408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601157887780213:6390]
2025-10-10T14:33:23.420413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601157887780213:6390]
2025-10-10T14:33:23.420417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601157887780213:6390]
2025-10-10T14:33:23.420460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:23.420471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.420470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:23.420473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:23.420477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:23.420483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:23.420589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:23.420658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:23.477725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601158669997927:7749]
2025-10-10T14:33:23.478051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 956, pipe: [1:7559601158669997927:7749]
2025-10-10T14:33:23.534206Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:23.534587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.534608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.534669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669997927:7749], now have 1 active actors on pipe
2025-10-10T14:33:23.534875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:23.534865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:23.534910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601158669997927:7749]
2025-10-10T14:33:23.534917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:23.534920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:23.534975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 957 reason: error at write: Disconnected sessionId: src_id|71d849db-e408edf0-90041d80-5d04261b_0
2025-10-10T14:33:23.535161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 957 sessionId: src_id|71d849db-e408edf0-90041d80-5d04261b_0 is DEAD
2025-10-10T14:33:23.535310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d849db-e408edf0-90041d80-5d04261b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:23.535322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d849db-e408edf0-90041d80-5d04261b_0] Write session will restart in 0.007037s
2025-10-10T14:33:23.535346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d849db-e408edf0-90041d80-5d04261b_0] Write session: Do CDS request
2025-10-10T14:33:23.535356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d849db-e408edf0-90041d80-5d04261b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:23.543929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d849db-e408edf0-90041d80-5d04261b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.544027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:23.544041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 958
2025-10-10T14:33:23.544191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.544242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:23.544252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:23.544257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:23.544755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 958 sessionId:  describe result for acl check
2025-10-10T14:33:23.544798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:23.544805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:23.544807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:23.544814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601158669998058:8075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:23.545429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601158669998058:8075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:23.548001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601158669998058:8075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:23.550524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601158669998058:8075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:23.550539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601158669998058:8075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:23.550543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601158669998058:8075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:23.550550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:23.552590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:23.554098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:23.554281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:23.554293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:23.554305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:23.554364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:23.554405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601157887780505:6392]
2025-10-10T14:33:23.555017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:23.555337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:23.555395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:23.555732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:23.555787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.555793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.555794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.555795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.555797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.555798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.555799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.555800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.555802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.555803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.555804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.555806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.555807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.555813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.555827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.555832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.555836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.555845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.555849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.555857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.555862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.555870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.555880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.555889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.555893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.555897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.555906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.555922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.555929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.555934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.555939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.555944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.555950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.555955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.555959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.555965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.555969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.555974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.555979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.555985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.555989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.555994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.556000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.556005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.556010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.556015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.556019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.556024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.556029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.556035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.556039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.556044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.556085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:23.558341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:23.558855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:23.558868Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:23.558870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:23.558874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:23.558881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 957 [2:7559601157887780505:6392]
2025-10-10T14:33:23.558894Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:23.558912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:23.558920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.558924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.558927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.558943Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:23.558957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:23.558966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:23.559020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.559029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.559032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.559034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:23.559104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:23.559112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.559124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.559141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.559164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:23.559193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669998393:8075], now have 1 active actors on pipe
2025-10-10T14:33:23.559205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601157887780500:6392]
2025-10-10T14:33:23.559208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601157887780500:6392]
2025-10-10T14:33:23.559210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601157887780500:6392]
2025-10-10T14:33:23.559221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:23.559228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:23.559232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:23.559234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:23.559235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669997928:2438], now have 1 active actors on pipe
2025-10-10T14:33:23.559243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:23.559260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:23.559263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:23.559285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601157887780500:6392]
2025-10-10T14:33:23.559294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:23.559264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 957
2025-10-10T14:33:23.559303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:23.559274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 957
2025-10-10T14:33:23.559322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.559332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.559371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|283edf14-db404235-acd3e338-80d0ea27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:23.559387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.559391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.559393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:23.559404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.559414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:23.559431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.559558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.559561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.559574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.559666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 958 partition: 0 MaxSeqNo: 40 sessionId: src_id|283edf14-db404235-acd3e338-80d0ea27_0
2025-10-10T14:33:23.560045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d849db-e408edf0-90041d80-5d04261b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|283edf14-db404235-acd3e338-80d0ea27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:23.562853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283edf14-db404235-acd3e338-80d0ea27_0] Write session: try to update token
2025-10-10T14:33:23.562875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283edf14-db404235-acd3e338-80d0ea27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:23.577969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId: src_id|283edf14-db404235-acd3e338-80d0ea27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:23.578797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:23.578818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:23.578821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:23.578823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:23.578832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601157887780500:6392]
2025-10-10T14:33:23.578837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601157887780500:6392]
2025-10-10T14:33:23.578841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601157887780500:6392]
2025-10-10T14:33:23.578895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:23.578898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:23.578905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:23.578906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.578909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:23.578909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:23.579057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:23.580561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:23.634886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601158669998435:7749]
2025-10-10T14:33:23.635177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 957, pipe: [1:7559601158669998435:7749]
2025-10-10T14:33:23.691309Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:23.691674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.691687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.691729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669998435:7749], now have 1 active actors on pipe
2025-10-10T14:33:23.691943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:23.691988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601158669998435:7749]
2025-10-10T14:33:23.692034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:23.692036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:23.692038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:23.692101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 958 reason: error at write: Disconnected sessionId: src_id|283edf14-db404235-acd3e338-80d0ea27_0
2025-10-10T14:33:23.692322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 958 sessionId: src_id|283edf14-db404235-acd3e338-80d0ea27_0 is DEAD
2025-10-10T14:33:23.692446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283edf14-db404235-acd3e338-80d0ea27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:23.692457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283edf14-db404235-acd3e338-80d0ea27_0] Write session will restart in 0.009194s
2025-10-10T14:33:23.692483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283edf14-db404235-acd3e338-80d0ea27_0] Write session: Do CDS request
2025-10-10T14:33:23.692489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283edf14-db404235-acd3e338-80d0ea27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:23.702918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283edf14-db404235-acd3e338-80d0ea27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.702978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:23.702994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 959
2025-10-10T14:33:23.703177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.703216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:23.703226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:23.703231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:23.703691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 959 sessionId:  describe result for acl check
2025-10-10T14:33:23.703728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:23.703735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:23.703736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:23.703744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601158669998635:8081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:23.704309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601158669998635:8081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:23.706852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601158669998635:8081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:23.709298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601158669998635:8081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:23.709312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601158669998635:8081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:23.709316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601158669998635:8081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:23.709324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:23.711644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:23.713481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:23.713691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:23.713707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:23.713719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:23.713770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:23.713814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601157887780795:6395]
2025-10-10T14:33:23.714460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:23.714749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:23.714794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:23.715108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:23.715167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.715174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.715176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.715177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.715178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.715179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.715180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.715182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.715183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.715184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.715185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.715186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.715187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.715192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.715205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.715208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.715212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.715216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.715220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.715224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.715228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.715232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.715236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.715240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.715244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.715248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.715256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.715267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.715275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.715281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.715290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.715295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.715304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.715312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.715322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.715329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.715333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.715339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.715348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.715353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.715362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.715367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.715376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.715382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.715385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.715396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.715401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.715409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.715413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.715419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.715423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.715429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.715473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:23.717876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:23.718652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:23.718668Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:23.718670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:23.718674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:23.718680Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 958 [2:7559601157887780795:6395]
2025-10-10T14:33:23.718692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:23.718710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:23.718713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.718717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.718720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.718736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:23.718744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:23.718752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:23.718811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.718819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.718821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.718823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:23.718896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:23.718905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.718917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.718935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.718957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:23.718982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669998439:2438], now have 1 active actors on pipe
2025-10-10T14:33:23.718986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669998913:8081], now have 1 active actors on pipe
2025-10-10T14:33:23.718994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601157887780789:6395]
2025-10-10T14:33:23.719001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601157887780789:6395]
2025-10-10T14:33:23.719003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601157887780789:6395]
2025-10-10T14:33:23.719017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:23.719031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:23.719035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:23.719035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:23.719037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:23.719050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:23.719058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:23.719056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 958
2025-10-10T14:33:23.719082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601157887780789:6395]
2025-10-10T14:33:23.719057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 958
2025-10-10T14:33:23.719090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:23.719093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:23.719112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.719121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.719161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c594a70-e777deec-58219400-7a8a7934_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:23.719171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.719175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.719177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:23.719189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.719204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:23.719230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.719362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.719371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.719386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.719483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 959 partition: 0 MaxSeqNo: 40 sessionId: src_id|c594a70-e777deec-58219400-7a8a7934_0
2025-10-10T14:33:23.719851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283edf14-db404235-acd3e338-80d0ea27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c594a70-e777deec-58219400-7a8a7934_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:23.722457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c594a70-e777deec-58219400-7a8a7934_0] Write session: try to update token
2025-10-10T14:33:23.722473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c594a70-e777deec-58219400-7a8a7934_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:23.736227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId: src_id|c594a70-e777deec-58219400-7a8a7934_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:23.738496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:23.738518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:23.738522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:23.738524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:23.738534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601157887780789:6395]
2025-10-10T14:33:23.738539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601157887780789:6395]
2025-10-10T14:33:23.738544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601157887780789:6395]
2025-10-10T14:33:23.738584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:23.738594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:23.738596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:23.738598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:23.738603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.738606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:23.738765Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:23.739088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:23.792100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601158669998937:7749]
2025-10-10T14:33:23.792388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 958, pipe: [1:7559601158669998937:7749]
2025-10-10T14:33:23.848813Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:23.849400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.849417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.849467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669998937:7749], now have 1 active actors on pipe
2025-10-10T14:33:23.849704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:23.849750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601158669998937:7749]
2025-10-10T14:33:23.849786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:23.849862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 959 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c594a70-e777deec-58219400-7a8a7934_0
2025-10-10T14:33:23.850084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 959 sessionId: src_id|c594a70-e777deec-58219400-7a8a7934_0 is DEAD
2025-10-10T14:33:23.850271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c594a70-e777deec-58219400-7a8a7934_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:23.850294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c594a70-e777deec-58219400-7a8a7934_0] Write session will restart in 0.009963s
2025-10-10T14:33:23.850321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c594a70-e777deec-58219400-7a8a7934_0] Write session: Do CDS request
2025-10-10T14:33:23.850327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c594a70-e777deec-58219400-7a8a7934_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:23.850306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:23.861931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c594a70-e777deec-58219400-7a8a7934_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.862151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:23.862163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 960
2025-10-10T14:33:23.862275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:23.862309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:23.862322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:23.862326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:23.862734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 960 sessionId:  describe result for acl check
2025-10-10T14:33:23.862766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:23.862774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:23.862776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:23.862781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601158669999169:8091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:23.863306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601158669999169:8091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:23.865097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601158669999169:8091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:23.867615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601158669999169:8091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:23.867629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601158669999169:8091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:23.867632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601158669999169:8091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:23.867640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:23.870066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:23.871792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:23.871952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:23.871964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:23.871973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:23.872014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:23.872047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601157887781122:6403]
2025-10-10T14:33:23.872487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:23.872844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:23.872892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:23.873203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:23.873262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.873269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.873271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.873272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.873273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.873274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.873275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.873276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.873278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.873279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.873280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.873281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.873282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.873288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.873300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.873304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.873309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.873313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.873317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.873321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.873325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.873347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.873351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.873355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.873359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.873363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.873373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.873381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:23.873389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.873400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:23.873404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.873409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:23.873416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.873421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:23.873426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.873432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:23.873437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.873442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:23.873451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.873456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:23.873461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.873471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:23.873475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.873480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:23.873485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.873494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:23.873499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.873508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.873514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.873523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.873532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.873538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.873579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:23.875989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:23.876441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:23.876456Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:23.876459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:23.876463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:23.876469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 959 [2:7559601157887781122:6403]
2025-10-10T14:33:23.876483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:23.876502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:23.876510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.876526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.876532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.876549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:23.876562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:23.876573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:23.876636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.876644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.876646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.876648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:23.876718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:23.876727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.876739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:23.876752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:23.876776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:23.876798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669999426:8091], now have 1 active actors on pipe
2025-10-10T14:33:23.876820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669998952:2438], now have 1 active actors on pipe
2025-10-10T14:33:23.876832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601157887781117:6403]
2025-10-10T14:33:23.876839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601157887781117:6403]
2025-10-10T14:33:23.876841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601157887781117:6403]
2025-10-10T14:33:23.876853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:23.876868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:23.876868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:23.876872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:23.876866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 959
2025-10-10T14:33:23.876874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:23.876873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 959
2025-10-10T14:33:23.876890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:23.876893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:23.876918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601157887781117:6403]
2025-10-10T14:33:23.876930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:23.876940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:23.877065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.877075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.877105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c413440c-360a8583-99966a04-67a015e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:23.877117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:23.877127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:23.877130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:23.877141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:23.877157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:23.877175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.877390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.877405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.877430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:23.877523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 960 partition: 0 MaxSeqNo: 40 sessionId: src_id|c413440c-360a8583-99966a04-67a015e5_0
2025-10-10T14:33:23.877900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c594a70-e777deec-58219400-7a8a7934_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c413440c-360a8583-99966a04-67a015e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:23.880390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c413440c-360a8583-99966a04-67a015e5_0] Write session: try to update token
2025-10-10T14:33:23.880408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c413440c-360a8583-99966a04-67a015e5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:23.888401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:23.888419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:23.888431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601157887781117:6403]
2025-10-10T14:33:23.888481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:23.888486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:23.888685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:23.888836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:23.889010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:23.889155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:23.889360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:23.889402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:23.894470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId: src_id|c413440c-360a8583-99966a04-67a015e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:23.897053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:23.897301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:23.897346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:23.897389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:23.897474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:23.907324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:23.907346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:23.907349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:23.907350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:23.907359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601157887781117:6403]
2025-10-10T14:33:23.907363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601157887781117:6403]
2025-10-10T14:33:23.907365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601157887781117:6403]
2025-10-10T14:33:23.907402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:23.907408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:23.907409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:23.907409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:23.907415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:23.907420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:23.907536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:23.949782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601158669999462:7749]
2025-10-10T14:33:23.950074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 959, pipe: [1:7559601158669999462:7749]
2025-10-10T14:33:24.016664Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:24.024741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.024771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.024960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.025023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.025083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.025143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.025185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.025192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.025256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.025318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.025400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.025462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.025502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.025509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.025571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.025626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.025688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.025747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.025789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.025796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.025855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.025911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.025967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.026023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.026063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.026065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.026134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.026191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.026251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.026308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.026361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.026372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.026435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.026492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.026547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.026608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.026651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.026658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.026718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.026777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.026848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.026906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.026970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.026978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.027042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.027098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.027159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.027217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.027260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.027265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.027322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.027379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.027436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.027494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.027535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.027542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.027611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.027677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.027736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.027792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.027834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.027839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.027894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601158669999462:7749], now have 1 active actors on pipe
2025-10-10T14:33:24.028137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:24.028139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:24.028150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:24.028175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601158669999462:7749]
2025-10-10T14:33:24.028184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 960 reason: error at write: Disconnected sessionId: src_id|c413440c-360a8583-99966a04-67a015e5_0
2025-10-10T14:33:24.028377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 960 sessionId: src_id|c413440c-360a8583-99966a04-67a015e5_0 is DEAD
2025-10-10T14:33:24.028522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c413440c-360a8583-99966a04-67a015e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:24.028536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c413440c-360a8583-99966a04-67a015e5_0] Write session will restart in 0.005697s
2025-10-10T14:33:24.028573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c413440c-360a8583-99966a04-67a015e5_0] Write session: Do CDS request
2025-10-10T14:33:24.028580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c413440c-360a8583-99966a04-67a015e5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:24.028929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:24.035944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c413440c-360a8583-99966a04-67a015e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.036041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:24.036059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 961
2025-10-10T14:33:24.036184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.036227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:24.036240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:24.036243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:24.036761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 961 sessionId:  describe result for acl check
2025-10-10T14:33:24.036797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:24.036804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:24.036806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:24.036812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601162964966823:8098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:24.037395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601162964966823:8098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:24.040916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601162964966823:8098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:24.044662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601162964966823:8098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:24.044681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601162964966823:8098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:24.044685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601162964966823:8098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:24.044695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:24.049144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:24.051172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:24.051373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:24.051382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:24.051392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:24.051443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:24.051489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601162182748710:6412]
2025-10-10T14:33:24.052044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:24.052434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:24.052502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:24.052884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:24.052960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.052966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.052968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.052970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.052971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.052972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.052973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.052975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.052976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.052978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.052979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.052980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.052981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.052989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.053003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.053007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.053011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.053015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.053018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.053022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.053025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.053028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.053033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.053037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.053041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.053045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.053052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.053061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.053069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.053075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.053086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.053096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.053100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.053106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.053117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.053122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.053127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.053132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.053142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.053151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.053156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.053166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.053175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.053185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.053197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.053207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.053215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.053221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.053229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.053235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.053242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.053251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.053287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:24.055862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:24.056227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:24.056246Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:24.056249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:24.056253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:24.056260Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 960 [2:7559601162182748710:6412]
2025-10-10T14:33:24.056274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:24.056292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:24.056296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.056301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.056303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.056321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:24.056336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:24.056344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:24.056408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.056415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.056418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.056420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:24.056496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:24.056505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.056518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.056536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.056554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:24.056583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964966760:2438], now have 1 active actors on pipe
2025-10-10T14:33:24.056592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964967152:8098], now have 1 active actors on pipe
2025-10-10T14:33:24.056601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601162182748705:6412]
2025-10-10T14:33:24.056608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601162182748705:6412]
2025-10-10T14:33:24.056611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601162182748705:6412]
2025-10-10T14:33:24.056624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:24.056642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:24.056644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:24.056654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:24.056657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:24.056662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:24.056665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:24.056701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601162182748705:6412]
2025-10-10T14:33:24.056680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 960
2025-10-10T14:33:24.056705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:24.056680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 960
2025-10-10T14:33:24.056708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:24.056747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.056759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.056803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:24.056817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.056822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.056826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:24.056838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.056853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:24.056873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.057041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.057052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.057067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.057182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 961 partition: 0 MaxSeqNo: 40 sessionId: src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0
2025-10-10T14:33:24.057610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c413440c-360a8583-99966a04-67a015e5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:24.060268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0] Write session: try to update token
2025-10-10T14:33:24.060283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:24.075198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId: src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:24.076899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:24.076924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:24.076928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:24.076930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:24.076940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601162182748705:6412]
2025-10-10T14:33:24.076944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601162182748705:6412]
2025-10-10T14:33:24.076952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601162182748705:6412]
2025-10-10T14:33:24.076998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:24.077004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:24.077011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.077014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:24.077019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:24.077022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:24.077155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:24.077772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:24.128468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601162964967261:7749]
2025-10-10T14:33:24.128739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 960, pipe: [1:7559601162964967261:7749]
2025-10-10T14:33:24.200066Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:24.200675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.200693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.200740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964967261:7749], now have 1 active actors on pipe
2025-10-10T14:33:24.200968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:24.200963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:24.200980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:24.201003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601162964967261:7749]
2025-10-10T14:33:24.201024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:24.201048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 961 reason: error at write: Disconnected sessionId: src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0
2025-10-10T14:33:24.201251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 961 sessionId: src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0 is DEAD
2025-10-10T14:33:24.201409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:24.201418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0] Write session will restart in 0.006220s
2025-10-10T14:33:24.201444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0] Write session: Do CDS request
2025-10-10T14:33:24.201454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:24.208931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.209022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:24.209035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 962
2025-10-10T14:33:24.209220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.209268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:24.209279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:24.209284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:24.209821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 962 sessionId:  describe result for acl check
2025-10-10T14:33:24.209860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:24.209866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:24.209869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:24.209875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601162964967307:8102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:24.210338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601162964967307:8102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:24.212573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601162964967307:8102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:24.215711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601162964967307:8102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:24.215724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601162964967307:8102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:24.215728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601162964967307:8102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:24.215736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:24.220888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:24.222615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:24.222808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:24.222821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:24.222832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:24.222884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:24.222924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601162182749002:6414]
2025-10-10T14:33:24.223338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:24.223572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:24.223606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:24.223807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:24.223846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.223851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.223852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.223853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.223853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.223854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.223855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.223855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.223856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.223857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.223857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.223858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.223859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.223863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.223871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.223874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.223876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.223879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.223881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.223883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.223886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.223888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.223892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.223894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.223896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.223900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.223908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.223917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.223923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.223928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.223933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.223938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.223941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.223945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.223947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.223950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.223953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.223957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.223959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.223962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.223965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.223969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.223971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.223974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.223977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.223980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.223983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.223986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.223989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.223992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.223994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.223998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.224020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:24.226314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:24.226928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:24.226944Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:24.226946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:24.226949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:24.226957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 961 [2:7559601162182749002:6414]
2025-10-10T14:33:24.226972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:24.226989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:24.226996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.226999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.227002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.227020Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:24.227032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:24.227041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:24.227091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.227097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.227099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.227102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:24.227160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:24.227166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.227178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.227194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.227214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:24.227234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601162182748997:6414]
2025-10-10T14:33:24.227241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601162182748997:6414]
2025-10-10T14:33:24.227243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601162182748997:6414]
2025-10-10T14:33:24.227251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:24.227261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:24.227269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964967263:2438], now have 1 active actors on pipe
2025-10-10T14:33:24.227274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:24.227275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:24.227276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:24.227293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:24.227298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:24.227305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964967597:8102], now have 1 active actors on pipe
2025-10-10T14:33:24.227325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601162182748997:6414]
2025-10-10T14:33:24.227335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:24.227339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:24.227342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 961
2025-10-10T14:33:24.227380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.227369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 961
2025-10-10T14:33:24.227389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.227420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:24.227433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.227437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.227442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:24.227455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.227466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:24.227481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.227665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.227679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.227703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.227789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 962 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0
2025-10-10T14:33:24.228208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2b1395a-11d37843-7a3723b2-eed306f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:24.230739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0] Write session: try to update token
2025-10-10T14:33:24.230753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:24.238832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:24.238857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:24.238869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601162182748997:6414]
2025-10-10T14:33:24.238916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:24.238919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:24.239096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:24.239265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:24.239417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:24.239566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:24.239771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:24.239816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:24.244732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId: src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:24.247314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:24.247521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.247546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.247589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:24.247702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:24.257992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:24.258012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:24.258016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:24.258019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:24.258029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601162182748997:6414]
2025-10-10T14:33:24.258034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601162182748997:6414]
2025-10-10T14:33:24.258038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601162182748997:6414]
2025-10-10T14:33:24.258084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:24.258096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.258097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:24.258103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:24.258103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:24.258107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:24.258237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:24.300992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601162964967766:7749]
2025-10-10T14:33:24.301244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 961, pipe: [1:7559601162964967766:7749]
2025-10-10T14:33:24.366934Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:24.375458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.375490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.375661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.375723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.375783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.375850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.375903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.375913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.375988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.376047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.376124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.376199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.376248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.376257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.376327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.376394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.376461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.376531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.376581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.376589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.376663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.376727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.376799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.376867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.376910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.376918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.376988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.377055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.377117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.377187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.377234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.377239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.377310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.377398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.377467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.377532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.377582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.377590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.377662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.377723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.377792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.377858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.377906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.377914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.377981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.378045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.378109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.378178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.378225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.378232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.378303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.378378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.378447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.378516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.378561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.378568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.378637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.378704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.378771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.378838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.378884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.378891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.378964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964967766:7749], now have 1 active actors on pipe
2025-10-10T14:33:24.379328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:24.379351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:24.379357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:24.379382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 962 reason: error at write: Disconnected sessionId: src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0
2025-10-10T14:33:24.379420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601162964967766:7749]
2025-10-10T14:33:24.379596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 962 sessionId: src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0 is DEAD
2025-10-10T14:33:24.379756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:24.379777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0] Write session will restart in 0.005657s
2025-10-10T14:33:24.379805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0] Write session: Do CDS request
2025-10-10T14:33:24.379812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:24.380145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:24.386809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.386899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:24.386913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 963
2025-10-10T14:33:24.387051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.387099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:24.387109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:24.387112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:24.387498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 963 sessionId:  describe result for acl check
2025-10-10T14:33:24.387531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:24.387533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:24.387534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:24.387539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601162964967823:8107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:24.388071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601162964967823:8107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:24.390369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601162964967823:8107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:24.392775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601162964967823:8107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:24.392796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601162964967823:8107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:24.392800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601162964967823:8107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:24.392807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:24.398122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:24.399850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:24.400040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:24.400050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:24.400063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:24.400113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:24.400147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601162182749307:6417]
2025-10-10T14:33:24.400811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:24.401174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:24.401228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:24.401804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:24.401904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.401914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.401916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.401917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.401918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.401920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.401922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.401923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.401925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.401926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.401927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.401928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.401930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.401937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.401950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.401955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.401960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.401964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.401969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.401973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.401977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.401982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.401987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.401991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.401995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.402000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.402009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.402018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.402026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.402032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.402038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.402043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.402048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.402053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.402059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.402065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.402079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.402085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.402093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.402098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.402110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.402115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.402123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.402130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.402140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.402144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.402149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.402154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.402158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.402164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.402169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.402174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.402220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:24.404596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:24.404881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:24.404891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:24.404892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:24.404895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:24.404900Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 962 [2:7559601162182749307:6417]
2025-10-10T14:33:24.404908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:24.404921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:24.404927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.404929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.404931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.404943Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:24.404952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:24.404959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:24.405003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.405011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.405013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.405015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:24.405084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:24.405093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.405106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.405123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.405136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:24.405157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964967780:2438], now have 1 active actors on pipe
2025-10-10T14:33:24.405163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964968083:8107], now have 1 active actors on pipe
2025-10-10T14:33:24.405170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601162182749302:6417]
2025-10-10T14:33:24.405171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601162182749302:6417]
2025-10-10T14:33:24.405173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601162182749302:6417]
2025-10-10T14:33:24.405182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:24.405193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:24.405193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:24.405196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:24.405197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:24.405203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:24.405205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:24.405224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601162182749302:6417]
2025-10-10T14:33:24.405196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 962
2025-10-10T14:33:24.405227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 962
2025-10-10T14:33:24.405228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:24.405228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:24.405255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.405265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.405298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d67156e3-39e77184-1bc66c28-1caa4460_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:24.405311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.405317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.405320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:24.405348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.405362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:24.405386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.405539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.405550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.405566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.405646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 963 partition: 0 MaxSeqNo: 40 sessionId: src_id|d67156e3-39e77184-1bc66c28-1caa4460_0
2025-10-10T14:33:24.406038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3bfcd5a-4f975f6d-1cf3bdbd-b2b703b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d67156e3-39e77184-1bc66c28-1caa4460_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:24.408684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67156e3-39e77184-1bc66c28-1caa4460_0] Write session: try to update token
2025-10-10T14:33:24.408703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67156e3-39e77184-1bc66c28-1caa4460_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:24.422344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId: src_id|d67156e3-39e77184-1bc66c28-1caa4460_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:24.424281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:24.424298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:24.424301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:24.424302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:24.424309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601162182749302:6417]
2025-10-10T14:33:24.424315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601162182749302:6417]
2025-10-10T14:33:24.424318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601162182749302:6417]
2025-10-10T14:33:24.424357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:24.424363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.424355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:24.424365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:24.424368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:24.424371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:24.424487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:24.424847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:24.479678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601162964968283:7749]
2025-10-10T14:33:24.480001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 962, pipe: [1:7559601162964968283:7749]
2025-10-10T14:33:24.537509Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:24.538114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.538129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.538178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964968283:7749], now have 1 active actors on pipe
2025-10-10T14:33:24.538406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:24.538478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:24.538483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601162964968283:7749]
2025-10-10T14:33:24.538494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:24.538513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:24.538554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 963 reason: error at write: Disconnected sessionId: src_id|d67156e3-39e77184-1bc66c28-1caa4460_0
2025-10-10T14:33:24.538755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 963 sessionId: src_id|d67156e3-39e77184-1bc66c28-1caa4460_0 is DEAD
2025-10-10T14:33:24.538907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67156e3-39e77184-1bc66c28-1caa4460_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:24.538918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67156e3-39e77184-1bc66c28-1caa4460_0] Write session will restart in 0.006479s
2025-10-10T14:33:24.538937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67156e3-39e77184-1bc66c28-1caa4460_0] Write session: Do CDS request
2025-10-10T14:33:24.538942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67156e3-39e77184-1bc66c28-1caa4460_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:24.546922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67156e3-39e77184-1bc66c28-1caa4460_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.546966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:24.546981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 964
2025-10-10T14:33:24.547166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.547205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:24.547216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:24.547220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:24.547664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 964 sessionId:  describe result for acl check
2025-10-10T14:33:24.547714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:24.547723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:24.547725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:24.547732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601162964968379:8111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:24.548347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601162964968379:8111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:24.550633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601162964968379:8111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:24.553135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601162964968379:8111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:24.553151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601162964968379:8111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:24.553155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601162964968379:8111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:24.553163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:24.557050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:24.558739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:24.558926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:24.558937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:24.558946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:24.558987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:24.559016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601162182749602:6419]
2025-10-10T14:33:24.559473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:24.559723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:24.559759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:24.559987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:24.560035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.560040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.560040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.560041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.560042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.560043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.560043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.560044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.560045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.560045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.560046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.560047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.560047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.560051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.560060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.560063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.560065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.560067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.560069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.560072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.560074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.560076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.560080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.560082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.560085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.560087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.560094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.560103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.560109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.560115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.560120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.560125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.560130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.560134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.560138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.560141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.560143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.560147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.560149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.560153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.560156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.560159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.560162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.560165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.560168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.560172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.560175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.560178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.560181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.560186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.560188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.560192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.560216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:24.562608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:24.563074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:24.563084Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:24.563085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:24.563088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:24.563093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 963 [2:7559601162182749602:6419]
2025-10-10T14:33:24.563106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:24.563125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:24.563133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.563137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.563139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.563157Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:24.563169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:24.563177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:24.563236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.563242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.563245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.563247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:24.563315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:24.563322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.563334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.563346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.563368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:24.563393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964968664:8111], now have 1 active actors on pipe
2025-10-10T14:33:24.563402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964968286:2438], now have 1 active actors on pipe
2025-10-10T14:33:24.563410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601162182749597:6419]
2025-10-10T14:33:24.563417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601162182749597:6419]
2025-10-10T14:33:24.563418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601162182749597:6419]
2025-10-10T14:33:24.563434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:24.563453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:24.563469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:24.563475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:24.563478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:24.563480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:24.563482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:24.563459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 963
2025-10-10T14:33:24.563463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 963
2025-10-10T14:33:24.563508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601162182749597:6419]
2025-10-10T14:33:24.563518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:24.563521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:24.563547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.563553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.563595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|210f00da-d62fafe9-2901457a-3c724096_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:24.563609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.563617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.563619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:24.563631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.563646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:24.563667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.563856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.563864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.563878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.563981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 964 partition: 0 MaxSeqNo: 40 sessionId: src_id|210f00da-d62fafe9-2901457a-3c724096_0
2025-10-10T14:33:24.564398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67156e3-39e77184-1bc66c28-1caa4460_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|210f00da-d62fafe9-2901457a-3c724096_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:24.566984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|210f00da-d62fafe9-2901457a-3c724096_0] Write session: try to update token
2025-10-10T14:33:24.567000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|210f00da-d62fafe9-2901457a-3c724096_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:24.580743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId: src_id|210f00da-d62fafe9-2901457a-3c724096_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:24.582577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:24.582592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:24.582595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:24.582596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:24.582604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601162182749597:6419]
2025-10-10T14:33:24.582607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601162182749597:6419]
2025-10-10T14:33:24.582610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601162182749597:6419]
2025-10-10T14:33:24.582656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:24.582654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:24.582661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:24.582664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.582666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:24.582666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:24.582797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:24.583398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:24.638416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601162964968802:7749]
2025-10-10T14:33:24.638707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 963, pipe: [1:7559601162964968802:7749]
2025-10-10T14:33:24.699752Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:24.700509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.700526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.700568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964968802:7749], now have 1 active actors on pipe
2025-10-10T14:33:24.700801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:24.700791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601162964968802:7749]
2025-10-10T14:33:24.700824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:24.700833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:24.700836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:24.700886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 964 reason: error at write: Disconnected sessionId: src_id|210f00da-d62fafe9-2901457a-3c724096_0
2025-10-10T14:33:24.701109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 964 sessionId: src_id|210f00da-d62fafe9-2901457a-3c724096_0 is DEAD
2025-10-10T14:33:24.701276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210f00da-d62fafe9-2901457a-3c724096_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:24.701296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210f00da-d62fafe9-2901457a-3c724096_0] Write session will restart in 0.009113s
2025-10-10T14:33:24.701319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210f00da-d62fafe9-2901457a-3c724096_0] Write session: Do CDS request
2025-10-10T14:33:24.701344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210f00da-d62fafe9-2901457a-3c724096_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:24.711904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|210f00da-d62fafe9-2901457a-3c724096_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.711966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:24.711983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 965
2025-10-10T14:33:24.712156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.712196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:24.712207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:24.712211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:24.712684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 965 sessionId:  describe result for acl check
2025-10-10T14:33:24.712721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:24.712731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:24.712733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:24.712739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601162964969004:8117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:24.713348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601162964969004:8117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:24.715901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601162964969004:8117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:24.718575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601162964969004:8117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:24.718590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601162964969004:8117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:24.718594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601162964969004:8117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:24.718603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:24.720212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:24.721518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:24.721687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:24.721698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:24.721707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:24.721746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:24.721777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601162182749899:6422]
2025-10-10T14:33:24.722458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:24.722746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:24.722779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:24.723010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:24.723054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.723059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.723060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.723060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.723061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.723062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.723062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.723063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.723064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.723065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.723066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.723066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.723067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.723071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.723084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.723088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.723092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.723095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.723098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.723102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.723106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.723110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.723114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.723116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.723118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.723120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.723126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.723132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.723136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.723140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.723143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.723146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.723149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.723152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.723154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.723158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.723162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.723165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.723167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.723170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.723173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.723176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.723178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.723181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.723189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.723192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.723195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.723198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.723204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.723207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.723209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.723212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.723238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:24.725458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:24.726143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:24.726153Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:24.726155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:24.726158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:24.726163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 964 [2:7559601162182749899:6422]
2025-10-10T14:33:24.726172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:24.726184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:24.726186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.726188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.726190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.726202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:24.726208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:24.726214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:24.726258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.726264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.726266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.726268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:24.726341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:24.726347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.726355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.726361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.726371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:24.726392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964969296:8117], now have 1 active actors on pipe
2025-10-10T14:33:24.726397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601162182749894:6422]
2025-10-10T14:33:24.726399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601162182749894:6422]
2025-10-10T14:33:24.726400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601162182749894:6422]
2025-10-10T14:33:24.726410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:24.726416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964968806:2438], now have 1 active actors on pipe
2025-10-10T14:33:24.726423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:24.726429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:24.726432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:24.726434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:24.726436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:24.726438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:24.726455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601162182749894:6422]
2025-10-10T14:33:24.726460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:24.726463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:24.726485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 964
2025-10-10T14:33:24.726502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 964
2025-10-10T14:33:24.726567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.726574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.726597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:24.726606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.726609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.726614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:24.726622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.726634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:24.726647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.726796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.726803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.726816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.726888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 965 partition: 0 MaxSeqNo: 40 sessionId: src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0
2025-10-10T14:33:24.727263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210f00da-d62fafe9-2901457a-3c724096_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:24.729871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0] Write session: try to update token
2025-10-10T14:33:24.729889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:24.737839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:24.737852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:24.737863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601162182749894:6422]
2025-10-10T14:33:24.737905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:24.737913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:24.738082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:24.738231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:24.738383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:24.738521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:24.738696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:24.738733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:24.743973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId: src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:24.746543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:24.746726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.746750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.746783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:24.746870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:24.756841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:24.756858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:24.756861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:24.756864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:24.756874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601162182749894:6422]
2025-10-10T14:33:24.756878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601162182749894:6422]
2025-10-10T14:33:24.756882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601162182749894:6422]
2025-10-10T14:33:24.756924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:24.756937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:24.756938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:24.756942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:24.756946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.756948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:24.757073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:24.800730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601162964969310:7749]
2025-10-10T14:33:24.801083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 964, pipe: [1:7559601162964969310:7749]
2025-10-10T14:33:24.867061Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:24.875165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.875187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.875348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.875418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.875486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.875555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.875602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.875614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.875690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.875754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.875820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.875891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.875939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.875949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.876017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.876077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.876140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.876205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.876253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.876260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.876327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.876390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.876452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.876514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.876560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.876566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.876631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.876693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.876756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.876822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.876866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.876876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.876945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.877004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.877068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.877129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.877174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.877182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.877247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.877308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.877388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.877451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.877513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.877522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.877588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.877647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.877710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.877773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.877818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.877825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.877889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.877947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.878007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.878067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.878110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.878117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.878180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:24.878240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:24.878314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:24.878376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:24.878421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:24.878424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:24.878484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964969310:7749], now have 1 active actors on pipe
2025-10-10T14:33:24.878745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:24.878756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:24.878779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 965 reason: error at write: Disconnected sessionId: src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0
2025-10-10T14:33:24.878991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 965 sessionId: src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0 is DEAD
2025-10-10T14:33:24.879117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:24.879140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0] Write session will restart in 0.007975s
2025-10-10T14:33:24.879167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0] Write session: Do CDS request
2025-10-10T14:33:24.879173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:24.879222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:24.879272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601162964969310:7749]
2025-10-10T14:33:24.879286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:24.887895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.888204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:24.888217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 966
2025-10-10T14:33:24.888340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:24.888382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:24.888386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:24.888390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:24.888805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 966 sessionId:  describe result for acl check
2025-10-10T14:33:24.888837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:24.888843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:24.888847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:24.888852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601162964969449:8127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:24.889426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601162964969449:8127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:24.891934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601162964969449:8127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:24.894647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601162964969449:8127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:24.894670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601162964969449:8127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:24.894673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601162964969449:8127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:24.894681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:24.897832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:24.899416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:24.899603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:24.899613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:24.899624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:24.899675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:24.899727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601162182750208:6430]
2025-10-10T14:33:24.900347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:24.900639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:24.900681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:24.900989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:24.901053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.901062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.901063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.901064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.901065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.901065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.901067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.901068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.901069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.901070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.901071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.901072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.901073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.901079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.901091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.901095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.901100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.901104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.901108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.901112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.901115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.901119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.901124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.901128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.901132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.901136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.901143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.901151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:24.901158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.901163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:24.901167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.901171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:24.901175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.901182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:24.901191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.901196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:24.901199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.901208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:24.901212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.901217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:24.901225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.901230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:24.901239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.901250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:24.901259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.901268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:24.901277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.901282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.901290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.901296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.901300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.901305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.901368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:24.903683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:24.904382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:24.904395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:24.904397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:24.904401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:24.904406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 965 [2:7559601162182750208:6430]
2025-10-10T14:33:24.904419Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:24.904437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:24.904446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.904449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.904452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.904470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:24.904483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:24.904492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:24.904546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.904553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.904555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.904558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:24.904620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:24.904628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.904638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:24.904649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:24.904666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:24.904692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964969325:2438], now have 1 active actors on pipe
2025-10-10T14:33:24.904702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964969754:8127], now have 1 active actors on pipe
2025-10-10T14:33:24.904710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601162182750203:6430]
2025-10-10T14:33:24.904717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601162182750203:6430]
2025-10-10T14:33:24.904719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601162182750203:6430]
2025-10-10T14:33:24.904732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:24.904749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:24.904743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 965
2025-10-10T14:33:24.904750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:24.904758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:24.904760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:24.904785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 965
2025-10-10T14:33:24.904769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:24.904772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:24.904800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601162182750203:6430]
2025-10-10T14:33:24.904803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:24.904805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:24.904825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.904834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.904872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:24.904885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:24.904888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:24.904891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:24.904902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:24.904912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:24.904929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.905062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:24.905070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:24.905085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:24.905185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 966 partition: 0 MaxSeqNo: 40 sessionId: src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0
2025-10-10T14:33:24.905555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc136e1b-2a363e8a-9af8fccf-db3c7a50_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:24.908207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0] Write session: try to update token
2025-10-10T14:33:24.908222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:24.922439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId: src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:24.923776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:24.923793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:24.923796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:24.923798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:24.923807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601162182750203:6430]
2025-10-10T14:33:24.923812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601162182750203:6430]
2025-10-10T14:33:24.923816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601162182750203:6430]
2025-10-10T14:33:24.923863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:24.923863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:24.923870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:24.923874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:24.923876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:24.923878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:24.924013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:24.924889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:24.979392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601162964969846:7749]
2025-10-10T14:33:24.979644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 965, pipe: [1:7559601162964969846:7749]
2025-10-10T14:33:25.034233Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:25.034502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.034517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.034562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601162964969846:7749], now have 1 active actors on pipe
2025-10-10T14:33:25.034731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:25.034851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:25.034921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601162964969846:7749]
2025-10-10T14:33:25.034930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:25.035004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 966 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0
2025-10-10T14:33:25.035198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 966 sessionId: src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0 is DEAD
2025-10-10T14:33:25.035319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:25.035331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0] Write session will restart in 0.007100s
2025-10-10T14:33:25.035358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0] Write session: Do CDS request
2025-10-10T14:33:25.035364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:25.043909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.043963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:25.043980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 967
2025-10-10T14:33:25.044124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.044160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:25.044170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:25.044175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:25.044582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 967 sessionId:  describe result for acl check
2025-10-10T14:33:25.044617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:25.044623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:25.044625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:25.044631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601167259937237:8134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:25.045148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601167259937237:8134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:25.048037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601167259937237:8134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:25.050857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601167259937237:8134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:25.050871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601167259937237:8134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:25.050875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601167259937237:8134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:25.050883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:25.055715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:25.057600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:25.057809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:25.057826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:25.057839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:25.057892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:25.057937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601166477717828:6439]
2025-10-10T14:33:25.058521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:25.058878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:25.058934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:25.059288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:25.059373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.059385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.059386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.059387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.059389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.059390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.059392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.059394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.059396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.059397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.059398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.059400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.059401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.059408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.059423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.059428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.059433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.059437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.059442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.059447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.059452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.059456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.059462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.059466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.059470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.059474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.059483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.059492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.059499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.059505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.059511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.059521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.059526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.059532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.059538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.059543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.059548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.059554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.059566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.059573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.059584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.059591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.059602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.059608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.059617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.059624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.059630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.059642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.059647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.059653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.059658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.059664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.059717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:25.062227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:25.062614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:25.062627Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:25.062630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:25.062635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:25.062642Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 966 [2:7559601166477717828:6439]
2025-10-10T14:33:25.062657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:25.062676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:25.062680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.062684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.062692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.062711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:25.062725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:25.062733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:25.062793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.062803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.062805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.062808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:25.062881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:25.062889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.062902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.062914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.062937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:25.062966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259937144:2438], now have 1 active actors on pipe
2025-10-10T14:33:25.062974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259937523:8134], now have 1 active actors on pipe
2025-10-10T14:33:25.062982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601166477717823:6439]
2025-10-10T14:33:25.062984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601166477717823:6439]
2025-10-10T14:33:25.062987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601166477717823:6439]
2025-10-10T14:33:25.063005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:25.063024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:25.063032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:25.063036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:25.063037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:25.063046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:25.063050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:25.063034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 966
2025-10-10T14:33:25.063077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601166477717823:6439]
2025-10-10T14:33:25.063084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 966
2025-10-10T14:33:25.063091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:25.063105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:25.063134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.063148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.063186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:25.063199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.063203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.063205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:25.063217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.063228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:25.063249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.063396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.063405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.063421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.063513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 967 partition: 0 MaxSeqNo: 40 sessionId: src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0
2025-10-10T14:33:25.063938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dac6455-1fedb58d-b61ea81e-c3a64c7e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:25.066567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0] Write session: try to update token
2025-10-10T14:33:25.066586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:25.080579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId: src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:25.082315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:25.082339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:25.082343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:25.082345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:25.082356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601166477717823:6439]
2025-10-10T14:33:25.082361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601166477717823:6439]
2025-10-10T14:33:25.082365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601166477717823:6439]
2025-10-10T14:33:25.082420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:25.082419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:25.082425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:25.082428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:25.082437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.082440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:25.082598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:25.083274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:25.135059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601167259937650:7749]
2025-10-10T14:33:25.135301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 966, pipe: [1:7559601167259937650:7749]
2025-10-10T14:33:25.191777Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:25.192551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.192570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.192622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259937650:7749], now have 1 active actors on pipe
2025-10-10T14:33:25.192847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:25.192864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:25.192931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601167259937650:7749]
2025-10-10T14:33:25.192959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:25.193151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 967 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0
2025-10-10T14:33:25.193324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 967 sessionId: src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0 is DEAD
2025-10-10T14:33:25.193529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:25.193544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0] Write session will restart in 0.009042s
2025-10-10T14:33:25.193575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0] Write session: Do CDS request
2025-10-10T14:33:25.193583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:25.203996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.204104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:25.204122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 968
2025-10-10T14:33:25.204283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.204326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:25.204338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:25.204342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:25.204811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 968 sessionId:  describe result for acl check
2025-10-10T14:33:25.204849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:25.204855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:25.204858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:25.204865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601167259937772:8138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:25.205487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601167259937772:8138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:25.208220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601167259937772:8138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:25.211653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601167259937772:8138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:25.211666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601167259937772:8138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:25.211670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601167259937772:8138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:25.211678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:25.217845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:25.219812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:25.220021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:25.220031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:25.220041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:25.220092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:25.220133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601166477718126:6441]
2025-10-10T14:33:25.220572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:25.220833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:25.220877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:25.221183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:25.221245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.221251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.221252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.221253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.221255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.221256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.221257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.221259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.221260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.221262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.221263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.221264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.221265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.221271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.221284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.221288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.221292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.221296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.221301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.221305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.221309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.221313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.221316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.221318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.221321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.221323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.221346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.221356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.221362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.221368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.221372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.221377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.221381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.221386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.221391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.221396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.221401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.221407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.221412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.221417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.221422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.221427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.221432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.221437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.221443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.221449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.221459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.221464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.221469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.221478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.221483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.221489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.221534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:25.224000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:25.224516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:25.224529Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:25.224532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:25.224536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:25.224542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 967 [2:7559601166477718126:6441]
2025-10-10T14:33:25.224555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:25.224573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:25.224576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.224580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.224583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.224600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:25.224612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:25.224621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:25.224687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.224694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.224696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.224699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:25.224766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:25.224775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.224788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.224801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.224818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:25.224907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 967
2025-10-10T14:33:25.224846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259937652:2438], now have 1 active actors on pipe
2025-10-10T14:33:25.224929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 967
2025-10-10T14:33:25.224856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259938031:8138], now have 1 active actors on pipe
2025-10-10T14:33:25.224864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601166477718121:6441]
2025-10-10T14:33:25.224867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601166477718121:6441]
2025-10-10T14:33:25.224869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601166477718121:6441]
2025-10-10T14:33:25.224885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:25.224901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:25.224913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:25.224917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:25.224919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:25.224920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:25.224924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:25.224954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601166477718121:6441]
2025-10-10T14:33:25.224957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:25.224959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:25.224997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.225002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.225036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:25.225044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.225054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.225058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:25.225072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.225085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:25.225104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.225294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.225308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.225345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.225474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 968 partition: 0 MaxSeqNo: 40 sessionId: src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0
2025-10-10T14:33:25.225880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb20094-170d64e9-8f8d984a-921cb8d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:25.228593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0] Write session: try to update token
2025-10-10T14:33:25.228615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:25.242587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId: src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:25.244835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:25.244857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:25.244861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:25.244864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:25.244875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601166477718121:6441]
2025-10-10T14:33:25.244879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601166477718121:6441]
2025-10-10T14:33:25.244887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601166477718121:6441]
2025-10-10T14:33:25.244945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:25.244952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:25.244958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.244960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:25.244961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:25.244964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:25.245121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:25.245365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:25.293262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601167259938159:7749]
2025-10-10T14:33:25.293579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 967, pipe: [1:7559601167259938159:7749]
2025-10-10T14:33:25.359536Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:25.360209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.360226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.360274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259938159:7749], now have 1 active actors on pipe
2025-10-10T14:33:25.360491Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:25.360531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601167259938159:7749]
2025-10-10T14:33:25.360534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:25.360569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:25.360648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 968 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0
2025-10-10T14:33:25.360872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 968 sessionId: src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0 is DEAD
2025-10-10T14:33:25.361098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:25.361122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0] Write session will restart in 0.007651s
2025-10-10T14:33:25.361155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0] Write session: Do CDS request
2025-10-10T14:33:25.361173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:25.370049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.370019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:25.370037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 969
2025-10-10T14:33:25.370344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.370404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:25.370414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:25.370419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:25.370890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 969 sessionId:  describe result for acl check
2025-10-10T14:33:25.370933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:25.370941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:25.370943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:25.370950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601167259938284:8143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:25.371621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601167259938284:8143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:25.373962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601167259938284:8143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:25.377391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601167259938284:8143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:25.377415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601167259938284:8143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:25.377422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601167259938284:8143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:25.377436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:25.383027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:25.384643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:25.384837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:25.384849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:25.384862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:25.384914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:25.384963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601166477718437:6444]
2025-10-10T14:33:25.385592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:25.385870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:25.385915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:25.386221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:25.386289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.386295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.386296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.386297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.386298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.386299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.386300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.386301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.386302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.386303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.386304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.386306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.386307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.386312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.386325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.386329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.386332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.386336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.386340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.386344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.386348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.386352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.386356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.386360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.386364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.386368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.386375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.386384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.386391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.386397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.386401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.386406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.386409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.386414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.386418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.386423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.386426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.386431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.386436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.386441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.386445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.386450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.386454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.386459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.386463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.386468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.386472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.386477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.386483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.386488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.386495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.386500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.386538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:25.388893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:25.389378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:25.389392Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:25.389394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:25.389399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:25.389405Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 968 [2:7559601166477718437:6444]
2025-10-10T14:33:25.389417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:25.389435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:25.389439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.389442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.389445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.389461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:25.389473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:25.389480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:25.389544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.389552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.389554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.389557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:25.389622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:25.389633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.389644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.389655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.389671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:25.389692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259938173:2438], now have 1 active actors on pipe
2025-10-10T14:33:25.389700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259938514:8143], now have 1 active actors on pipe
2025-10-10T14:33:25.389706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601166477718432:6444]
2025-10-10T14:33:25.389709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601166477718432:6444]
2025-10-10T14:33:25.389712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601166477718432:6444]
2025-10-10T14:33:25.389724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:25.389735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:25.389738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:25.389739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:25.389744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:25.389759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:25.389762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:25.389772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 968
2025-10-10T14:33:25.389782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 968
2025-10-10T14:33:25.389786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601166477718432:6444]
2025-10-10T14:33:25.389796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:25.389812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:25.389842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.389847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.389888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:25.389901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.389905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.389907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:25.389920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.389935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:25.389954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.390075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.390081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.390097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.390220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 969 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0
2025-10-10T14:33:25.390677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3327ff35-1a7b7315-31e5ef3-e91f391_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:25.393467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0] Write session: try to update token
2025-10-10T14:33:25.393489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:25.409358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId: src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:25.409631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:25.409646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:25.409649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:25.409651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:25.409660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601166477718432:6444]
2025-10-10T14:33:25.409664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601166477718432:6444]
2025-10-10T14:33:25.409667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601166477718432:6444]
2025-10-10T14:33:25.409706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:25.409709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:25.409716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:25.409717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.409719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:25.409719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:25.409851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:25.412268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:25.460705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601167259938681:7749]
2025-10-10T14:33:25.461092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 968, pipe: [1:7559601167259938681:7749]
2025-10-10T14:33:25.525131Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:25.525901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.525925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.525975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259938681:7749], now have 1 active actors on pipe
2025-10-10T14:33:25.526225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:25.526254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601167259938681:7749]
2025-10-10T14:33:25.526293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:25.526296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:25.526361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 969 reason: error at write: Disconnected sessionId: src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0
2025-10-10T14:33:25.526472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:25.526569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 969 sessionId: src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0 is DEAD
2025-10-10T14:33:25.526757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:25.526779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0] Write session will restart in 0.005693s
2025-10-10T14:33:25.526803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0] Write session: Do CDS request
2025-10-10T14:33:25.526811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:25.533855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.533935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:25.533948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 970
2025-10-10T14:33:25.534112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.534157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:25.534168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:25.534172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:25.534633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 970 sessionId:  describe result for acl check
2025-10-10T14:33:25.534671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:25.534677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:25.534679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:25.534685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601167259938728:8147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:25.535247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601167259938728:8147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:25.537455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601167259938728:8147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:25.540243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601167259938728:8147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:25.540258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601167259938728:8147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:25.540261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601167259938728:8147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:25.540269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:25.545945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:25.547822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:25.548040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:25.548051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:25.548063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:25.548115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:25.548156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601166477718738:6446]
2025-10-10T14:33:25.548783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:25.549047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:25.549088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:25.549410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:25.549468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.549474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.549476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.549477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.549478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.549480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.549481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.549482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.549483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.549484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.549486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.549487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.549488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.549494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.549508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.549513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.549517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.549521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.549525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.549530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.549534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.549538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.549542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.549546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.549550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.549554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.549562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.549571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.549577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.549583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.549588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.549598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.549601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.549606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.549610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.549615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.549619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.549623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.549627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.549633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.549642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.549647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.549652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.549662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.549666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.549671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.549676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.549685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.549690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.549700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.549704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.549711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.549759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:25.552024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:25.552461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:25.552473Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:25.552475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:25.552479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:25.552485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 969 [2:7559601166477718738:6446]
2025-10-10T14:33:25.552498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:25.552518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:25.552526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.552530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.552535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.552548Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:25.552557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:25.552567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:25.552610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.552615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.552616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.552618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:25.552679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:25.552687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.552698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.552714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.552729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:25.552750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259938683:2438], now have 1 active actors on pipe
2025-10-10T14:33:25.552758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259939016:8147], now have 1 active actors on pipe
2025-10-10T14:33:25.552765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601166477718733:6446]
2025-10-10T14:33:25.552768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601166477718733:6446]
2025-10-10T14:33:25.552769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601166477718733:6446]
2025-10-10T14:33:25.552782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:25.552800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:25.552799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:25.552803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:25.552804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:25.552820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:25.552827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:25.552816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 969
2025-10-10T14:33:25.552820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 969
2025-10-10T14:33:25.552847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601166477718733:6446]
2025-10-10T14:33:25.552854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:25.552857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:25.552884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.552893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.552931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:25.552946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.552950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.552952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:25.552963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.552974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:25.552995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.553143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.553149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.553160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.553266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 970 partition: 0 MaxSeqNo: 40 sessionId: src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0
2025-10-10T14:33:25.553661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee98f750-b34242ea-d1d59615-7c49ec4d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:25.556444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0] Write session: try to update token
2025-10-10T14:33:25.556469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:25.572401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:25.572419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:25.572424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:25.572426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:25.572438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601166477718733:6446]
2025-10-10T14:33:25.572443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601166477718733:6446]
2025-10-10T14:33:25.572447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601166477718733:6446]
2025-10-10T14:33:25.572499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:25.572503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:25.572507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.572509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:25.572509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:25.572513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:25.572654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:25.572799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId: src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:25.575447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:25.626572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601167259939199:7749]
2025-10-10T14:33:25.626821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 969, pipe: [1:7559601167259939199:7749]
2025-10-10T14:33:25.685616Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:25.686534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.686555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.686602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259939199:7749], now have 1 active actors on pipe
2025-10-10T14:33:25.686805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:25.686848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:25.686851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601167259939199:7749]
2025-10-10T14:33:25.686860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:25.686872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:25.686926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 970 reason: error at write: Disconnected sessionId: src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0
2025-10-10T14:33:25.687136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 970 sessionId: src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0 is DEAD
2025-10-10T14:33:25.687284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:25.687291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0] Write session will restart in 0.005610s
2025-10-10T14:33:25.687317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0] Write session: Do CDS request
2025-10-10T14:33:25.687327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:25.693871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.693984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:25.694001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 971
2025-10-10T14:33:25.694139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.694184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:25.694195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:25.694199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:25.694674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 971 sessionId:  describe result for acl check
2025-10-10T14:33:25.694707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:25.694715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:25.694717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:25.694723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601167259939238:8153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:25.695245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601167259939238:8153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:25.698109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601167259939238:8153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:25.701037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601167259939238:8153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:25.701062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601167259939238:8153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:25.701066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601167259939238:8153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:25.701076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:25.707119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:25.708796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:25.709049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:25.709061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:25.709076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:25.709151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:25.709198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601166477719041:6449]
2025-10-10T14:33:25.709819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:25.710128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:25.710180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:25.710547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:25.710627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.710635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.710636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.710638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.710639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.710640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.710642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.710643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.710645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.710646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.710648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.710649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.710651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.710657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.710673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.710678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.710683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.710686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.710690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.710694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.710698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.710702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.710706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.710710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.710714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.710717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.710727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.710736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.710743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.710749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.710754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.710766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.710771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.710783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.710787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.710792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.710796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.710802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.710807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.710812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.710817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.710822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.710827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.710833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.710837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.710843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.710848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.710853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.710857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.710862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.710869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.710875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.710933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:25.713437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:25.714032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:25.714050Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:25.714053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:25.714058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:25.714064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 970 [2:7559601166477719041:6449]
2025-10-10T14:33:25.714079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:25.714103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:25.714113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.714117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.714119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.714139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:25.714147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:25.714158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:25.714230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.714245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.714247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.714250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:25.714342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:25.714350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.714363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.714380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.714398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:25.714428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259939205:2438], now have 1 active actors on pipe
2025-10-10T14:33:25.714438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259939538:8153], now have 1 active actors on pipe
2025-10-10T14:33:25.714446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601166477719036:6449]
2025-10-10T14:33:25.714453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601166477719036:6449]
2025-10-10T14:33:25.714455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601166477719036:6449]
2025-10-10T14:33:25.714471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:25.714486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:25.714489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:25.714493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:25.714495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:25.714509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:25.714518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:25.714494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 970
2025-10-10T14:33:25.714498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 970
2025-10-10T14:33:25.714551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601166477719036:6449]
2025-10-10T14:33:25.714563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:25.714569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:25.714583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.714594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.714656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12406381-2dfa848f-1d649c28-3f3be815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:25.714669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.714675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.714677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:25.714689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.714706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:25.714733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.714880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.714889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.714907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.714990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 971 partition: 0 MaxSeqNo: 40 sessionId: src_id|12406381-2dfa848f-1d649c28-3f3be815_0
2025-10-10T14:33:25.715392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbffffb-ac91c0fd-a2efef3a-cf23ec96_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12406381-2dfa848f-1d649c28-3f3be815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:25.718159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12406381-2dfa848f-1d649c28-3f3be815_0] Write session: try to update token
2025-10-10T14:33:25.718180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12406381-2dfa848f-1d649c28-3f3be815_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:25.732458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId: src_id|12406381-2dfa848f-1d649c28-3f3be815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:25.734344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:25.734362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:25.734366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:25.734368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:25.734379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601166477719036:6449]
2025-10-10T14:33:25.734385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601166477719036:6449]
2025-10-10T14:33:25.734389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601166477719036:6449]
2025-10-10T14:33:25.734441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:25.734449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.734452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:25.734462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:25.734489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:25.734500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:25.734593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:25.735323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:25.786829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601167259939715:7749]
2025-10-10T14:33:25.787149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 970, pipe: [1:7559601167259939715:7749]
2025-10-10T14:33:25.848110Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:25.848781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.848798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.848844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259939715:7749], now have 1 active actors on pipe
2025-10-10T14:33:25.849053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:25.849113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:25.849114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601167259939715:7749]
2025-10-10T14:33:25.849143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:25.849301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 971 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12406381-2dfa848f-1d649c28-3f3be815_0
2025-10-10T14:33:25.849521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 971 sessionId: src_id|12406381-2dfa848f-1d649c28-3f3be815_0 is DEAD
2025-10-10T14:33:25.849655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12406381-2dfa848f-1d649c28-3f3be815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:25.849666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12406381-2dfa848f-1d649c28-3f3be815_0] Write session will restart in 0.009948s
2025-10-10T14:33:25.849703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12406381-2dfa848f-1d649c28-3f3be815_0] Write session: Do CDS request
2025-10-10T14:33:25.849709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12406381-2dfa848f-1d649c28-3f3be815_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:25.860935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12406381-2dfa848f-1d649c28-3f3be815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.861039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:25.861057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 972
2025-10-10T14:33:25.861240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:25.861288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:25.861295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:25.861299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:25.861762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 972 sessionId:  describe result for acl check
2025-10-10T14:33:25.861799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:25.861805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:25.861807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:25.861814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601167259939989:8157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:25.862402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601167259939989:8157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:25.864667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601167259939989:8157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:25.867320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601167259939989:8157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:25.867331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601167259939989:8157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:25.867334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601167259939989:8157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:25.867342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:25.870397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:25.870896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:25.871079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:25.871091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:25.871103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:25.871152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:25.871194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601166477719343:6451]
2025-10-10T14:33:25.871844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:25.872141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:25.872182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:25.872509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:25.872566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.872572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.872573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.872575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.872576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.872578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.872579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.872580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.872581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.872582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.872584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.872585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.872587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.872592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.872608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.872612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.872617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.872621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.872625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.872630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.872634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.872639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.872643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.872647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.872651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.872655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.872663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.872672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:25.872680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.872685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:25.872690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.872701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:25.872706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.872712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:25.872721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.872727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:25.872732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.872742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:25.872747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.872753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:25.872763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.872768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:25.872774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.872784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:25.872788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.872795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:25.872804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.872810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.872819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.872824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.872830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.872836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.872884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:25.875264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:25.875755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:25.875770Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:25.875772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:25.875776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:25.875782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 971 [2:7559601166477719343:6451]
2025-10-10T14:33:25.875794Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:25.875810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:25.875812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.875815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.875816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.875828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:25.875836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:25.875842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:25.875891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.875899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.875900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.875903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:25.875965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:25.875971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.875978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:25.875985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:25.875995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:25.876011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259940214:8157], now have 1 active actors on pipe
2025-10-10T14:33:25.876021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601166477719338:6451]
2025-10-10T14:33:25.876023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601166477719338:6451]
2025-10-10T14:33:25.876025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601166477719338:6451]
2025-10-10T14:33:25.876032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:25.876041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259939717:2438], now have 1 active actors on pipe
2025-10-10T14:33:25.876048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:25.876048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:25.876051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:25.876054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:25.876061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:25.876064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:25.876086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601166477719338:6451]
2025-10-10T14:33:25.876093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:25.876100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:25.876109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 971
2025-10-10T14:33:25.876110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 971
2025-10-10T14:33:25.876173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.876181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.876205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c44934a2-4598cab8-d6487654-37029df8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:25.876214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:25.876217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:25.876220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:25.876231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:25.876247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:25.876260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.876427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.876436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.876452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:25.876533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 972 partition: 0 MaxSeqNo: 40 sessionId: src_id|c44934a2-4598cab8-d6487654-37029df8_0
2025-10-10T14:33:25.876959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12406381-2dfa848f-1d649c28-3f3be815_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c44934a2-4598cab8-d6487654-37029df8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:25.879485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c44934a2-4598cab8-d6487654-37029df8_0] Write session: try to update token
2025-10-10T14:33:25.879501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c44934a2-4598cab8-d6487654-37029df8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:25.892920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId: src_id|c44934a2-4598cab8-d6487654-37029df8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:25.895534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:25.895622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:25.895639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:25.895642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:25.895645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:25.895654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601166477719338:6451]
2025-10-10T14:33:25.895658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601166477719338:6451]
2025-10-10T14:33:25.895662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601166477719338:6451]
2025-10-10T14:33:25.895695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:25.895709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:25.895713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:25.895721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:25.895735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:25.895756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:25.895769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:25.895772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:25.895908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:25.949132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601167259940241:7749]
2025-10-10T14:33:25.949398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 971, pipe: [1:7559601167259940241:7749]
2025-10-10T14:33:26.005375Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:26.006211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601167259940241:7749], now have 1 active actors on pipe
2025-10-10T14:33:26.006434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:26.006473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:26.006478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601167259940241:7749]
2025-10-10T14:33:26.006487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:26.006511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:26.006574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 972 reason: error at write: Disconnected sessionId: src_id|c44934a2-4598cab8-d6487654-37029df8_0
2025-10-10T14:33:26.006801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 972 sessionId: src_id|c44934a2-4598cab8-d6487654-37029df8_0 is DEAD
2025-10-10T14:33:26.006974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44934a2-4598cab8-d6487654-37029df8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:26.006984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44934a2-4598cab8-d6487654-37029df8_0] Write session will restart in 0.006928s
2025-10-10T14:33:26.007003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44934a2-4598cab8-d6487654-37029df8_0] Write session: Do CDS request
2025-10-10T14:33:26.007008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44934a2-4598cab8-d6487654-37029df8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:26.014924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c44934a2-4598cab8-d6487654-37029df8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.014964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:26.014979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 973
2025-10-10T14:33:26.015155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.015199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:26.015206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:26.015209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:26.015660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 973 sessionId:  describe result for acl check
2025-10-10T14:33:26.015699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:26.015706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:26.015707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:26.015714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601171554907606:8170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:26.016275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601171554907606:8170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:26.018915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601171554907606:8170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:26.021521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601171554907606:8170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:26.021535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601171554907606:8170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:26.021539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601171554907606:8170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:26.021547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:26.027683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:26.029617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:26.029815Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:26.029826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:26.029840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:26.029898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:26.029942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601170772686980:6466]
2025-10-10T14:33:26.030623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:26.030923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:26.030967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:26.031292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:26.031346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.031352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.031353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.031355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.031356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.031358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.031359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.031360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.031362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.031363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.031365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.031366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.031367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.031373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.031388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.031393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.031397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.031401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.031406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.031410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.031415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.031418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.031423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.031433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.031438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.031443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.031456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.031470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.031483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.031494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.031498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.031503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.031507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.031511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.031515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.031519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.031523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.031528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.031532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.031536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.031540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.031544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.031547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.031552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.031555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.031559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.031564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.031568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.031579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.031589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.031593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.031598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.031634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:26.033953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:26.034598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:26.034609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:26.034611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:26.034614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:26.034620Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 972 [2:7559601170772686980:6466]
2025-10-10T14:33:26.034631Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:26.034645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:26.034650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.034653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.034654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.034669Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:26.034681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:26.034690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:26.034753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.034762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.034764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.034767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:26.034835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:26.034844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.034857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.034874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.034892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:26.034919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554907894:8170], now have 1 active actors on pipe
2025-10-10T14:33:26.034927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554907550:2438], now have 1 active actors on pipe
2025-10-10T14:33:26.034935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601170772686975:6466]
2025-10-10T14:33:26.034941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601170772686975:6466]
2025-10-10T14:33:26.034944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601170772686975:6466]
2025-10-10T14:33:26.034951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 972
2025-10-10T14:33:26.034958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:26.034957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 972
2025-10-10T14:33:26.034969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:26.034972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:26.034974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:26.034981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:26.034998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:26.035002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:26.035041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.035060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.035084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601170772686975:6466]
2025-10-10T14:33:26.035098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:26.035114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:26.035135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:26.035149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.035155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.035162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:26.035176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.035194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:26.035218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.035365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.035377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.035396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.035526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 973 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0
2025-10-10T14:33:26.035933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44934a2-4598cab8-d6487654-37029df8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:26.038608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0] Write session: try to update token
2025-10-10T14:33:26.038628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:26.053677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId: src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:26.054384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:26.054405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.054409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:26.054411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:26.054420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601170772686975:6466]
2025-10-10T14:33:26.054426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601170772686975:6466]
2025-10-10T14:33:26.054429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601170772686975:6466]
2025-10-10T14:33:26.054483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:26.054490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:26.054496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.054497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:26.054500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:26.054502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:26.054633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:26.056342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:26.106850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601171554908062:7749]
2025-10-10T14:33:26.107192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 972, pipe: [1:7559601171554908062:7749]
2025-10-10T14:33:26.168887Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:26.169359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.169378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.169435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554908062:7749], now have 1 active actors on pipe
2025-10-10T14:33:26.169641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:26.169718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:26.169732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:26.169734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:26.169795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601171554908062:7749]
2025-10-10T14:33:26.169796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 973 reason: error at write: Disconnected sessionId: src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0
2025-10-10T14:33:26.170002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 973 sessionId: src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0 is DEAD
2025-10-10T14:33:26.170221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:26.170234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0] Write session will restart in 0.006634s
2025-10-10T14:33:26.170283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0] Write session: Do CDS request
2025-10-10T14:33:26.170291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:26.177865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.177991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:26.178008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 974
2025-10-10T14:33:26.178172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.178219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:26.178233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:26.178237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:26.178857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 974 sessionId:  describe result for acl check
2025-10-10T14:33:26.178946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:26.178953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:26.178958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:26.178966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601171554908131:8174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:26.179633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601171554908131:8174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:26.182477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601171554908131:8174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:26.185017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601171554908131:8174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:26.185032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601171554908131:8174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:26.185035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601171554908131:8174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:26.185043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:26.190184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:26.192116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:26.192322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:26.192335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:26.192347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:26.192409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:26.192455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601170772687284:6468]
2025-10-10T14:33:26.193070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:26.193366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:26.193409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:26.193719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:26.193774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.193780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.193781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.193782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.193784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.193786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.193788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.193789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.193791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.193792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.193793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.193794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.193795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.193802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.193816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.193821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.193825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.193829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.193833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.193836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.193841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.193845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.193849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.193853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.193857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.193862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.193870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.193880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.193887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.193893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.193901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.193907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.193911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.193917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.193922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.193927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.193933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.193939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.193949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.193954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.193958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.193963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.193970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.193976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.193984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.193990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.193999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.194005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.194009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.194021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.194025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.194035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.194076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:26.196729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:26.197211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:26.197223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:26.197225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:26.197230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:26.197236Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 973 [2:7559601170772687284:6468]
2025-10-10T14:33:26.197250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:26.197268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:26.197271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.197275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.197278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.197298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:26.197312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:26.197320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:26.197401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.197410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.197412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.197414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:26.197487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:26.197496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.197506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.197517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.197533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:26.197563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554908064:2438], now have 1 active actors on pipe
2025-10-10T14:33:26.197572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601170772687279:6468]
2025-10-10T14:33:26.197574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601170772687279:6468]
2025-10-10T14:33:26.197577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601170772687279:6468]
2025-10-10T14:33:26.197590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:26.197600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554908426:8174], now have 1 active actors on pipe
2025-10-10T14:33:26.197609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:26.197610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:26.197614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:26.197616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:26.197626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:26.197630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:26.197659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601170772687279:6468]
2025-10-10T14:33:26.197672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:26.197683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 973
2025-10-10T14:33:26.197681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:26.197718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.197723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.197752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:26.197765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.197770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.197773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:26.197784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.197800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:26.197819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.197888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 973
2025-10-10T14:33:26.197943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.197951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.197967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.198071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 974 partition: 0 MaxSeqNo: 40 sessionId: src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0
2025-10-10T14:33:26.198524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3901287-4abb9125-8b14ae23-4b5f572e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:26.201268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0] Write session: try to update token
2025-10-10T14:33:26.201289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:26.216487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId: src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:26.217972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:26.217991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.217993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:26.217994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:26.218002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601170772687279:6468]
2025-10-10T14:33:26.218005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601170772687279:6468]
2025-10-10T14:33:26.218007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601170772687279:6468]
2025-10-10T14:33:26.218048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:26.218054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.218056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:26.218059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:26.218068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:26.218073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:26.218186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:26.219238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:26.270160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601171554908577:7749]
2025-10-10T14:33:26.270534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 973, pipe: [1:7559601171554908577:7749]
2025-10-10T14:33:26.334501Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:26.334999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.335015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.335060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554908577:7749], now have 1 active actors on pipe
2025-10-10T14:33:26.335267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:26.335295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:26.335306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601171554908577:7749]
2025-10-10T14:33:26.335334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:26.335337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:26.335403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 974 reason: error at write: Disconnected sessionId: src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0
2025-10-10T14:33:26.335778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:26.335787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0] Write session will restart in 0.008695s
2025-10-10T14:33:26.335814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0] Write session: Do CDS request
2025-10-10T14:33:26.335819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:26.335615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 974 sessionId: src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0 is DEAD
2025-10-10T14:33:26.345965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.346048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:26.346066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 975
2025-10-10T14:33:26.346228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.346273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:26.346284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:26.346288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:26.346698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 975 sessionId:  describe result for acl check
2025-10-10T14:33:26.346734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:26.346741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:26.346743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:26.346748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601171554908763:8181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:26.347264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601171554908763:8181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:26.349864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601171554908763:8181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:26.352846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601171554908763:8181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:26.352859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601171554908763:8181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:26.352862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601171554908763:8181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:26.352870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:26.356522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:26.358430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:26.359082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:26.359094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:26.359106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:26.359166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:26.359226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601170772687610:6470]
2025-10-10T14:33:26.359755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:26.360063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:26.360106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:26.360387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:26.360440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.360446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.360448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.360449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.360450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.360451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.360452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.360454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.360455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.360456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.360457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.360458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.360459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.360465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.360479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.360483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.360487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.360490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.360495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.360498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.360502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.360505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.360509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.360513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.360516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.360520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.360528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.360536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.360543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.360548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.360553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.360559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.360563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.360569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.360574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.360580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.360590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.360595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.360600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.360604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.360607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.360612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.360615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.360620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.360624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.360633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.360639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.360644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.360651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.360655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.360658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.360662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.360699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:26.363021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:26.363532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:26.363547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:26.363550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:26.363553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:26.363560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 974 [2:7559601170772687610:6470]
2025-10-10T14:33:26.363572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:26.363589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:26.363597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.363601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.363603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.363623Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:26.363634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:26.363642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:26.363704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.363712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.363714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.363716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:26.363781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:26.363788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.363801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.363813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.363833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:26.363859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909051:8181], now have 1 active actors on pipe
2025-10-10T14:33:26.363866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554908582:2438], now have 1 active actors on pipe
2025-10-10T14:33:26.363874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601170772687600:6470]
2025-10-10T14:33:26.363880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601170772687600:6470]
2025-10-10T14:33:26.363882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601170772687600:6470]
2025-10-10T14:33:26.363896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:26.363913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:26.363909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:26.363923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:26.363925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:26.363932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:26.363935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:26.363956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601170772687600:6470]
2025-10-10T14:33:26.363963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:26.363964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:26.363953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 974
2025-10-10T14:33:26.364011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 974
2025-10-10T14:33:26.364075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.364087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.364118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63063ce6-4157d04f-31882015-654df340_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:26.364131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.364135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.364138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:26.364149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.364160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:26.364180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.364367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.364375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.364389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.364508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 975 partition: 0 MaxSeqNo: 40 sessionId: src_id|63063ce6-4157d04f-31882015-654df340_0
2025-10-10T14:33:26.364893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af5bdbe-a96f26ea-4d3b184c-755ee3d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63063ce6-4157d04f-31882015-654df340_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:26.367679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63063ce6-4157d04f-31882015-654df340_0] Write session: try to update token
2025-10-10T14:33:26.367698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63063ce6-4157d04f-31882015-654df340_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:26.375274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:26.375295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.375308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601170772687600:6470]
2025-10-10T14:33:26.375358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:26.375363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:26.375545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:26.375703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.375853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.375995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.376189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:26.376240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:26.381985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId: src_id|63063ce6-4157d04f-31882015-654df340_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:26.384644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:26.384900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.384929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.384974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:26.385077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:26.393006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:26.393029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.393033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:26.393035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:26.393046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601170772687600:6470]
2025-10-10T14:33:26.393055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601170772687600:6470]
2025-10-10T14:33:26.393059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601170772687600:6470]
2025-10-10T14:33:26.393108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:26.393113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:26.393120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.393123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:26.393125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:26.393130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:26.393267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:26.435562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601171554909112:7749]
2025-10-10T14:33:26.435863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 974, pipe: [1:7559601171554909112:7749]
2025-10-10T14:33:26.508459Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:26.516880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.516905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.517080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.517155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.517225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.517295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.517862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.517882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.517950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.518016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.518079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.518151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.518198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.518207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.518288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.518352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.518421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.518495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.518545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.518554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.518629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.518703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.518772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.518841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.518887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.518895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.518961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.519024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.519092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.519158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.519208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.519217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.519285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.519352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.519414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.519478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.519526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.519536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.519602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.519667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.519736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.519803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.519850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.519858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.519923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.519985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.520052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.520118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.520163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.520172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.520236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.520299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.520363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.520429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.520479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.520487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.520562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.520625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.520693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.520762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.520809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.520818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.520888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909112:7749], now have 1 active actors on pipe
2025-10-10T14:33:26.521192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:26.521207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:26.521225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601171554909112:7749]
2025-10-10T14:33:26.521264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:26.521525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:26.521610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 975 reason: error at write: Disconnected sessionId: src_id|63063ce6-4157d04f-31882015-654df340_0
2025-10-10T14:33:26.521833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 975 sessionId: src_id|63063ce6-4157d04f-31882015-654df340_0 is DEAD
2025-10-10T14:33:26.522037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63063ce6-4157d04f-31882015-654df340_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:26.522048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63063ce6-4157d04f-31882015-654df340_0] Write session will restart in 0.006440s
2025-10-10T14:33:26.522084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63063ce6-4157d04f-31882015-654df340_0] Write session: Do CDS request
2025-10-10T14:33:26.522090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63063ce6-4157d04f-31882015-654df340_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:26.528715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:26.529951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63063ce6-4157d04f-31882015-654df340_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.529984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:26.530047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:26.530061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 976
2025-10-10T14:33:26.530212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.530221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:26.530243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:26.530257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:26.530270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:26.530281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:26.530286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:26.530317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:26.530369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601170772687667:6473]
2025-10-10T14:33:26.530816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 976 sessionId:  describe result for acl check
2025-10-10T14:33:26.530854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:26.530856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:26.530858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:26.530864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601171554909135:8185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:26.531053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:26.531401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:26.531403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601171554909135:8185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:26.531453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:26.531804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:26.531858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.531865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.531866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.531867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.531869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.531870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.531871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.531873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.531874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.531876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.531877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.531878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.531879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.531886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.531899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.531903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.531908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.531913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.531917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.531922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.531926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.531930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.531934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.531939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.531944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.531948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.531955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.531964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.531970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.531977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.531983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.531990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.532000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.532006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.532011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.532016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.532025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.532030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.532035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.532045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.532050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.532056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.532066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.532072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.532081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.532087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.532097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.532102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.532107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.532112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.532117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.532122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.532168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:26.534090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601171554909135:8185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:26.534666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:26.535047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:26.535109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:26.535116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:26.535121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:26.535127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 975 [2:7559601170772687667:6473]
2025-10-10T14:33:26.535143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:26.535163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:26.535170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.535174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.535176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.535193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:26.535206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:26.535213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:26.535270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.535277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.535279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.535281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:26.535350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:26.535359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.535372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.535385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.535405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:26.535430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909115:2438], now have 1 active actors on pipe
2025-10-10T14:33:26.535442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601170772687662:6473]
2025-10-10T14:33:26.535445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601170772687662:6473]
2025-10-10T14:33:26.535447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601170772687662:6473]
2025-10-10T14:33:26.535461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:26.535479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:26.535480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:26.535484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:26.535486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:26.535502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:26.535511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:26.535502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 975
2025-10-10T14:33:26.535534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601170772687662:6473]
2025-10-10T14:33:26.535545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:26.535552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:26.540643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601171554909135:8185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:26.540658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601171554909135:8185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:26.540662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601171554909135:8185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:26.540678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:26.540952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909173:8185], now have 1 active actors on pipe
2025-10-10T14:33:26.541006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 975
2025-10-10T14:33:26.541057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.541074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.541111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:26.541128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.541139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.541141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:26.541154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.541171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:26.541193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.541372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.541380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.541396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.541495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 976 partition: 0 MaxSeqNo: 40 sessionId: src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0
2025-10-10T14:33:26.541895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63063ce6-4157d04f-31882015-654df340_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:26.544623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0] Write session: try to update token
2025-10-10T14:33:26.544643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:26.552893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:26.552910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.552923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601170772687662:6473]
2025-10-10T14:33:26.552971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:26.552976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:26.553145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:26.553287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.553450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.553583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.553866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:26.553916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:26.559212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId: src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:26.562141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:26.562395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.562418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.562459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:26.562565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:26.566033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:26.566060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.566064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:26.566066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:26.566078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601170772687662:6473]
2025-10-10T14:33:26.566083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601170772687662:6473]
2025-10-10T14:33:26.566088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601170772687662:6473]
2025-10-10T14:33:26.566147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:26.566146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:26.566153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:26.566157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:26.566162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.566165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:26.566363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:26.621381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601171554909183:7749]
2025-10-10T14:33:26.621620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 975, pipe: [1:7559601171554909183:7749]
2025-10-10T14:33:26.678756Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:26.685490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.685516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.685668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.685725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.685784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.685843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.686081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.686090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.686151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.686205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.686278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.686344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.686383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.686391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.686450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.686504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.686561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.686629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.686670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.686676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.686736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.686792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.686847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.686902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.686942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.686948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.687004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.687059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.687115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.687173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.687217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.687225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.687283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.687335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.687391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.687450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.687490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.687495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.687553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.687606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.687669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.687726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.687766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.687784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.687845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.687897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.687956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.688013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.688055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.688062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.688119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.688167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.688222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.688278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.688317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.688323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.688380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.688432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.688488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.688544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.688585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.688591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.688634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909183:7749], now have 1 active actors on pipe
2025-10-10T14:33:26.688887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601171554909183:7749]
2025-10-10T14:33:26.688892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:26.688896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:26.688915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:26.688932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 976 reason: error at write: Disconnected sessionId: src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0
2025-10-10T14:33:26.689159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 976 sessionId: src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0 is DEAD
2025-10-10T14:33:26.689243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:26.689316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:26.689349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0] Write session will restart in 0.005629s
2025-10-10T14:33:26.689374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0] Write session: Do CDS request
2025-10-10T14:33:26.689379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:26.695833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.695928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:26.695952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 977
2025-10-10T14:33:26.696067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.696060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:26.696112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:26.696121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:26.696125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:26.696550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 977 sessionId:  describe result for acl check
2025-10-10T14:33:26.696586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:26.696593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:26.696596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:26.696603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601171554909208:8191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:26.697153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601171554909208:8191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:26.697230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:26.697456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:26.697470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:26.697485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:26.697563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:26.697619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601170772687727:6476]
2025-10-10T14:33:26.698201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:26.698472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:26.698531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:26.698849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:26.698936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.698946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.698947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.698948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.698950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.698951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.698952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.698953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.698955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.698956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.698957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.698959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.698961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.698967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.698979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.698984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.698988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.698992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.698997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.699001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.699005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.699009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.699014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.699019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.699023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.699028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.699036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.699045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.699052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.699058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.699063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.699075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.699081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.699090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.699095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.699100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.699110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.699116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.699125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.699130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.699138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.699143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.699148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.699153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.699158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.699163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.699167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.699172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.699176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.699182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.699186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.699195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.699235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:26.699689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601171554909208:8191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:26.701471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:26.701898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:26.701912Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:26.701915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:26.701918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:26.701924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 976 [2:7559601170772687727:6476]
2025-10-10T14:33:26.701936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:26.701958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:26.701969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.701972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.701974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.701990Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:26.702000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:26.702008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:26.702077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.702085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.702087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.702090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:26.702160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:26.702168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.702180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.702196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.702218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:26.702251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909188:2438], now have 1 active actors on pipe
2025-10-10T14:33:26.702265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601170772687722:6476]
2025-10-10T14:33:26.702267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601170772687722:6476]
2025-10-10T14:33:26.702269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601170772687722:6476]
2025-10-10T14:33:26.702295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:26.702293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 976
2025-10-10T14:33:26.702300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:26.702303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:26.702305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:26.702315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:26.702333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:26.702336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:26.702371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601170772687722:6476]
2025-10-10T14:33:26.702385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:26.702406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:26.702531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601171554909208:8191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:26.702542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601171554909208:8191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:26.702545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601171554909208:8191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:26.702553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:26.702761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909244:8191], now have 1 active actors on pipe
2025-10-10T14:33:26.702797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 976
2025-10-10T14:33:26.702861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.702873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.702907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:26.702936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.702945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.702947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:26.702960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.702974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:26.702996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.703157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.703171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.703193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.703324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 977 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0
2025-10-10T14:33:26.703665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d11ca7-2089523b-d0ee69bb-7f0e4bb6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:26.706291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0] Write session: try to update token
2025-10-10T14:33:26.706311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:26.720641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId: src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:26.721907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:26.721933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.721937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:26.721940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:26.721951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601170772687722:6476]
2025-10-10T14:33:26.721956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601170772687722:6476]
2025-10-10T14:33:26.721963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601170772687722:6476]
2025-10-10T14:33:26.722019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:26.722026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:26.722034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:26.722038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:26.722044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.722052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:26.722201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:26.723309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:26.788820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601171554909249:7749]
2025-10-10T14:33:26.789023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 976, pipe: [1:7559601171554909249:7749]
2025-10-10T14:33:26.834429Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:26.834749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.834770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.834820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909249:7749], now have 1 active actors on pipe
2025-10-10T14:33:26.835068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:26.835106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601171554909249:7749]
2025-10-10T14:33:26.835109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:26.835113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:26.835140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:26.835177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 977 reason: error at write: Disconnected sessionId: src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0
2025-10-10T14:33:26.835378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 977 sessionId: src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0 is DEAD
2025-10-10T14:33:26.835595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:26.835608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0] Write session will restart in 0.009275s
2025-10-10T14:33:26.835632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0] Write session: Do CDS request
2025-10-10T14:33:26.835641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:26.842565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:26.843867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:26.844110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:26.844121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:26.844134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:26.844204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:26.844253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601170772687786:6478]
2025-10-10T14:33:26.844901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:26.845240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:26.845297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:26.845662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:26.845724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.845730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.845731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.845732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.845733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.845735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.845737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.845738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.845739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.845741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.845742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.845744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.845745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.845752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.845766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.845770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.845775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.845778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.845783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.845787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.845791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.845795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.845799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.845802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.845806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.845810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.845818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.845828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:26.845835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.845841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:26.845850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.845855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:26.845859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.845864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:26.845868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.845873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:26.845878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.845883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:26.845892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.845897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:26.845901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.845906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:26.845936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.845926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.845939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:26.845943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.845948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:26.845953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.845958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.845961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.845966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.845973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.845982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.846021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:26.846009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:26.846024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 978
2025-10-10T14:33:26.846160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:26.846194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:26.846205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:26.846210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:26.846676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 978 sessionId:  describe result for acl check
2025-10-10T14:33:26.846715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:26.846725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:26.846727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:26.846733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601171554909277:5192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:26.847288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601171554909277:5192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:26.848604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:26.849008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:26.849021Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:26.849024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:26.849029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:26.849035Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 977 [2:7559601170772687786:6478]
2025-10-10T14:33:26.849066Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:26.849091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:26.849099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.849104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.849106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.849125Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:26.849137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:26.849145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:26.849168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601171554909277:5192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:26.849206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.849214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.849216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.849219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:26.849305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:26.849312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.849345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:26.849362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:26.849380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:26.849402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601170772687781:6478]
2025-10-10T14:33:26.849409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601170772687781:6478]
2025-10-10T14:33:26.849411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601170772687781:6478]
2025-10-10T14:33:26.849421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:26.849435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:26.849436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:26.849453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:26.849457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:26.849458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:26.849459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:26.849469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909251:2438], now have 1 active actors on pipe
2025-10-10T14:33:26.849498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601170772687781:6478]
2025-10-10T14:33:26.849514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:26.849522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:26.849581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 977
2025-10-10T14:33:26.855630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601171554909277:5192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:26.855645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601171554909277:5192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:26.855649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601171554909277:5192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:26.855659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:26.855920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909323:5192], now have 1 active actors on pipe
2025-10-10T14:33:26.855989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 977
2025-10-10T14:33:26.856044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.856056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.856089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:26.856106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:26.856116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:26.856118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:26.856135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:26.856158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:26.856182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.856324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.856336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.856350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:26.856433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 978 partition: 0 MaxSeqNo: 40 sessionId: src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0
2025-10-10T14:33:26.856843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b75f43a-21ba500b-5b76e30c-13ce8765_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:26.859542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0] Write session: try to update token
2025-10-10T14:33:26.859563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:26.860733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:26.860749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.860760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601170772687781:6478]
2025-10-10T14:33:26.860802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:26.860808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:26.860982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:26.861125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.861263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.861430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:26.861614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:26.861653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:26.873469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId: src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:26.875924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:26.876129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.876158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.876192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:26.876354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:26.879029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:26.879043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:26.879045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:26.879050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:26.879057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601170772687781:6478]
2025-10-10T14:33:26.879061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601170772687781:6478]
2025-10-10T14:33:26.879065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601170772687781:6478]
2025-10-10T14:33:26.879112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:26.879118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:26.879122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:26.879125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:26.879125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:26.879129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:26.879248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:26.935229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601171554909326:7749]
2025-10-10T14:33:26.935489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 977, pipe: [1:7559601171554909326:7749]
2025-10-10T14:33:26.989709Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:26.997232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:26.997255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:26.997433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.997491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.997551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.997620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.997662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.997672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.997737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.997802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.997872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.997942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.997992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.998001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.998070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.998136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.998197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.998266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.998307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.998317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.998392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.998455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.998518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.998585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.998635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.998645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.998712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.998770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.998842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.998905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.998952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.998963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.999029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.999091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.999159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.999224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.999269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.999277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.999344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.999406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.999475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.999535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.999577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.999583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.999656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:26.999712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:26.999775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:26.999848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:26.999896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:26.999904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:26.999972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.000039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.000103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.000170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.000215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.000222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.000284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.000341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.000408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.000469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.000512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.000521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.000577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601171554909326:7749], now have 1 active actors on pipe
2025-10-10T14:33:27.000775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:27.000823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601171554909326:7749]
2025-10-10T14:33:27.000843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:27.000844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:27.000867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 978 reason: error at write: Disconnected sessionId: src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0
2025-10-10T14:33:27.001095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 978 sessionId: src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0 is DEAD
2025-10-10T14:33:27.001220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:27.001228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0] Write session will restart in 0.005585s
2025-10-10T14:33:27.001252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0] Write session: Do CDS request
2025-10-10T14:33:27.001259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:27.001644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:27.007710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:27.007892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.007961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:27.007975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 979
2025-10-10T14:33:27.008104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.008137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:27.008147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:27.008151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:27.008608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 979 sessionId:  describe result for acl check
2025-10-10T14:33:27.008649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:27.008657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:27.008659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:27.008665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601175849876674:5189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:27.008951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:27.009170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:27.009180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:27.009192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:27.009207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601175849876674:5189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:27.009255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:27.009300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601175067655180:6491]
2025-10-10T14:33:27.009944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:27.010379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:27.010439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:27.010761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:27.010818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.010824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.010825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.010826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.010827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.010829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.010830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.010832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.010833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.010836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.010837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.010838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.010840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.010846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.010859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.010863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.010868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.010871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.010875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.010879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.010883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.010887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.010892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.010897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.010901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.010906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.010915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.010924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.010936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.010945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.010953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.010958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.010963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.010972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.010976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.010982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.010986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.010992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.010996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.011002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.011005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.011011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.011016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.011024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.011028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.011037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.011042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.011050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.011055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.011059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.011064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.011075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.011115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:27.011306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601175849876674:5189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:27.013481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:27.013657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601175849876674:5189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:27.013671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601175849876674:5189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:27.013675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601175849876674:5189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:27.013683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:27.013792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:27.013802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:27.013804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:27.013806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:27.013811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 978 [2:7559601175067655180:6491]
2025-10-10T14:33:27.013819Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:27.013833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:27.013835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.013837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.013839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.013852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:27.013859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:27.013866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:27.013922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.013929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.013930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.013931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:27.013984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:27.013990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.013997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.014004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.014014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:27.014050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876641:2438], now have 1 active actors on pipe
2025-10-10T14:33:27.014059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876705:5189], now have 1 active actors on pipe
2025-10-10T14:33:27.014067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601175067655175:6491]
2025-10-10T14:33:27.014068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601175067655175:6491]
2025-10-10T14:33:27.014070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601175067655175:6491]
2025-10-10T14:33:27.014081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:27.014099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:27.014100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:27.014103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:27.014105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:27.014113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:27.014116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:27.014142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601175067655175:6491]
2025-10-10T14:33:27.014146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:27.014115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 978
2025-10-10T14:33:27.014121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 978
2025-10-10T14:33:27.014147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:27.014162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.014167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.014225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:27.014237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.014241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.014242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:27.014249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.014258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:27.014273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.014423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.014431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.014444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.014502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 979 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0
2025-10-10T14:33:27.014846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc02d87-e166535e-4c9f5f3d-852d2f33_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:27.017510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0] Write session: try to update token
2025-10-10T14:33:27.017528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:27.031502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId: src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:27.033478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:27.033497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.033500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:27.033502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:27.033515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601175067655175:6491]
2025-10-10T14:33:27.033519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601175067655175:6491]
2025-10-10T14:33:27.033523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601175067655175:6491]
2025-10-10T14:33:27.033568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:27.033574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:27.033576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:27.033578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:27.033587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.033590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:27.033731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:27.034258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:27.101142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601175849876712:7749]
2025-10-10T14:33:27.101523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 978, pipe: [1:7559601175849876712:7749]
2025-10-10T14:33:27.140532Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:27.140822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.140833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.140870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876712:7749], now have 1 active actors on pipe
2025-10-10T14:33:27.141043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:27.141113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:27.141172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601175849876712:7749]
2025-10-10T14:33:27.141183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:27.141282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 979 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0
2025-10-10T14:33:27.141488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 979 sessionId: src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0 is DEAD
2025-10-10T14:33:27.141672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:27.141683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0] Write session will restart in 0.009744s
2025-10-10T14:33:27.141701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0] Write session: Do CDS request
2025-10-10T14:33:27.141707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:27.148010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:27.149269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:27.149518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:27.149529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:27.149543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:27.149603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:27.149649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601175067655240:6495]
2025-10-10T14:33:27.150296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:27.150586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:27.150634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:27.150903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:27.150966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.150973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.150974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.150976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.150978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.150979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.150980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.150982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.150983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.150984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.150986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.150988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.150989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.150995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.151004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.151007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.151009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.151011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.151014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.151016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.151018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.151020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.151023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.151025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.151027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.151029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.151048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.151055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.151060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.151063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.151066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.151070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.151072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.151076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.151079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.151082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.151084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.151087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.151091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.151094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.151097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.151100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.151102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.151106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.151109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.151113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.151116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.151119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.151121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.151124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.151126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.151129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.151153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:27.152893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.152960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:27.152975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 980
2025-10-10T14:33:27.153138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.153165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:27.153172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:27.153175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:27.153590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 980 sessionId:  describe result for acl check
2025-10-10T14:33:27.153625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:27.153631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:27.153633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:27.153638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:27.153639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601175849876742:5184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:27.153934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:27.153946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:27.153947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:27.153950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:27.153955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 979 [2:7559601175067655240:6495]
2025-10-10T14:33:27.153964Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:27.153979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:27.153981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.153983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.153985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.153998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:27.154003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:27.154009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:27.154053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.154060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.154069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601175849876742:5184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:27.154062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.154064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:27.154112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:27.154119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.154126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.154132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.154141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:27.154173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876714:2438], now have 1 active actors on pipe
2025-10-10T14:33:27.154184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601175067655235:6495]
2025-10-10T14:33:27.154185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601175067655235:6495]
2025-10-10T14:33:27.154186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601175067655235:6495]
2025-10-10T14:33:27.154195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:27.154204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:27.154221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:27.154224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:27.154226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:27.154235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:27.154238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:27.154230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 979
2025-10-10T14:33:27.154262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601175067655235:6495]
2025-10-10T14:33:27.154274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:27.154280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:27.156418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601175849876742:5184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:27.162676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601175849876742:5184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:27.162692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601175849876742:5184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:27.162696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601175849876742:5184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:27.162705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:27.162949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876775:5184], now have 1 active actors on pipe
2025-10-10T14:33:27.163110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 979
2025-10-10T14:33:27.163200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.163219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.163253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:27.163271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.163282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.163297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:27.163316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.163340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:27.163366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.163515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.163522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.163537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.163649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 980 partition: 0 MaxSeqNo: 40 sessionId: src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0
2025-10-10T14:33:27.164070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7314ab4-3de75f5d-e71cfc68-2efacefd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:27.165202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:27.165218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.165228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601175067655235:6495]
2025-10-10T14:33:27.165272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:27.165279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:27.165464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:27.165606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.165760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.165924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.166113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:27.166153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:27.166864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0] Write session: try to update token
2025-10-10T14:33:27.166883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:27.181569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId: src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:27.183055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:27.183078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.183082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:27.183085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:27.183097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601175067655235:6495]
2025-10-10T14:33:27.183100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601175067655235:6495]
2025-10-10T14:33:27.183104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601175067655235:6495]
2025-10-10T14:33:27.183157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:27.183156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:27.183163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:27.183167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:27.183171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.183174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:27.183316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:27.184317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1010 14:33:27.189448410 2320540 chttp2_transport.cc:1143]             ipv4:127.0.0.1:7170: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-10T14:33:27.190934Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:33:27.241408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601175849876778:7749]
2025-10-10T14:33:27.241712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 979, pipe: [1:7559601175849876778:7749]
2025-10-10T14:33:27.296091Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:27.296471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.296489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.296516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876778:7749], now have 1 active actors on pipe
2025-10-10T14:33:27.296768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601175849876778:7749]
2025-10-10T14:33:27.296791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:27.296769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:27.296807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:27.296809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:27.296877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 980 reason: error at write: Disconnected sessionId: src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0
2025-10-10T14:33:27.297087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 980 sessionId: src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0 is DEAD
2025-10-10T14:33:27.297252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:27.297264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0] Write session will restart in 0.005240s
2025-10-10T14:33:27.297287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0] Write session: Do CDS request
2025-10-10T14:33:27.297293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:27.303177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:27.303888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.303972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:27.303988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 981
2025-10-10T14:33:27.304156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.304191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:27.304197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:27.304201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:27.304398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:27.304589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:27.304600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:27.304613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:27.304665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:27.304677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 981 sessionId:  describe result for acl check
2025-10-10T14:33:27.304719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:27.304709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601175067655302:6497]
2025-10-10T14:33:27.304726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:27.304728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:27.304733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601175849876803:5180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:27.305159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:27.305369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601175849876803:5180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:27.305424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:27.305473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:27.305761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:27.305817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.305823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.305825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.305826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.305827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.305828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.305829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.305831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.305832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.305833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.305835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.305836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.305837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.305842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.305854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.305859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.305863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.305867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.305872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.305877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.305881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.305885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.305888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.305890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.305892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.305895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.305901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.305907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.305912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.305915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.305918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.305921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.305923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.305926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.305929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.305932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.305935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.305938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.305941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.305946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.305950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.305955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.305959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.305964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.305967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.305973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.305977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.305983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.305987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.305992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.305997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.306002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.306040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:27.307617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601175849876803:5180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:27.308516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:27.308829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:27.308841Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:27.308844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:27.308848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:27.308856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 980 [2:7559601175067655302:6497]
2025-10-10T14:33:27.308873Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:27.308891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:27.308897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.308900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.308902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.308915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:27.308930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:27.308940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:27.308989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.308995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.308996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.308998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:27.309063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:27.309069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.309077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.309084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.309095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:27.309116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876779:2438], now have 1 active actors on pipe
2025-10-10T14:33:27.309129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601175067655297:6497]
2025-10-10T14:33:27.309136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601175067655297:6497]
2025-10-10T14:33:27.309138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601175067655297:6497]
2025-10-10T14:33:27.309150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:27.309164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:27.309165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:27.309168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:27.309171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:27.309178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:27.309182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:27.309167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 980
2025-10-10T14:33:27.309217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601175067655297:6497]
2025-10-10T14:33:27.309225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:27.309235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:27.313444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601175849876803:5180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:27.313468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601175849876803:5180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:27.313472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601175849876803:5180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:27.313481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:27.313772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876842:5180], now have 1 active actors on pipe
2025-10-10T14:33:27.313811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 980
2025-10-10T14:33:27.313897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.313921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.313963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e891859-d41aed7-82b6537b-c6885175_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:27.313982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.313993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.313996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:27.314015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.314038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:27.314061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.314275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.314285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.314303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.314412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 981 partition: 0 MaxSeqNo: 40 sessionId: src_id|e891859-d41aed7-82b6537b-c6885175_0
2025-10-10T14:33:27.314844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e706e295-3c9656f0-3173a7d3-e9a3b739_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e891859-d41aed7-82b6537b-c6885175_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:27.317594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e891859-d41aed7-82b6537b-c6885175_0] Write session: try to update token
2025-10-10T14:33:27.317618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e891859-d41aed7-82b6537b-c6885175_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:27.321056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:27.321078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.321090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601175067655297:6497]
2025-10-10T14:33:27.321133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:27.321142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:27.321316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:27.321485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.321629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.321780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.321984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:27.322031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:27.331987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId: src_id|e891859-d41aed7-82b6537b-c6885175_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:27.334558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:27.334793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.334827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.334874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:27.334961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:27.339302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:27.339322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.339328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:27.339330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:27.339342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601175067655297:6497]
2025-10-10T14:33:27.339345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601175067655297:6497]
2025-10-10T14:33:27.339349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601175067655297:6497]
2025-10-10T14:33:27.339399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:27.339411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.339410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:27.339418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:27.339422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:27.339427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:27.339559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:27.397081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601175849876857:7749]
2025-10-10T14:33:27.397445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 980, pipe: [1:7559601175849876857:7749]
2025-10-10T14:33:27.450392Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:27.457603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.457625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.457795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.457857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.457931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.457993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.458038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.458045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.458109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.458169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.458240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.458324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.458376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.458383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.458447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.458504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.458574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.458639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.458687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.458693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.458768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.458835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.458901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.458974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.459023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.459031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.459108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.459177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.459238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.459297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.459351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.459361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.459441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.459503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.459565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.459632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.459682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.459689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.459757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.459823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.459893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.459960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.460006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.460018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.460087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.460147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.460208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.460269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.460311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.460317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.460384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.460451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.460516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.460574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.460621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.460635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.460700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.460761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.460823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.460893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.460939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.460946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.461015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876857:7749], now have 1 active actors on pipe
2025-10-10T14:33:27.461379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:27.461393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:27.461427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 981 reason: error at write: Disconnected sessionId: src_id|e891859-d41aed7-82b6537b-c6885175_0
2025-10-10T14:33:27.461684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 981 sessionId: src_id|e891859-d41aed7-82b6537b-c6885175_0 is DEAD
2025-10-10T14:33:27.461690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:27.461743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601175849876857:7749]
2025-10-10T14:33:27.461825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e891859-d41aed7-82b6537b-c6885175_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:27.461838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e891859-d41aed7-82b6537b-c6885175_0] Write session will restart in 0.009882s
2025-10-10T14:33:27.461864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e891859-d41aed7-82b6537b-c6885175_0] Write session: Do CDS request
2025-10-10T14:33:27.461871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e891859-d41aed7-82b6537b-c6885175_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:27.462138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:27.468767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:27.469897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:27.470137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:27.470149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:27.470163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:27.470242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:27.470294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601175067655378:6500]
2025-10-10T14:33:27.470914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:27.471256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:27.471325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:27.471609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:27.471656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.471661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.471662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.471663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.471663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.471664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.471665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.471674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.471675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.471676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.471677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.471678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.471678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.471685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.471694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.471697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.471699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.471701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.471704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.471706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.471708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.471710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.471712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.471714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.471716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.471718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.471724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.471730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.471735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.471738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.471741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.471744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.471746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.471749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.471752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.471755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.471758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.471761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.471765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.471771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.471776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.471781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.471785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.471790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.471794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.471798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.471802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.471808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.471811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.471816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.471820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.471824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.471854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:27.472909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e891859-d41aed7-82b6537b-c6885175_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.472982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:27.472995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 982
2025-10-10T14:33:27.473194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.473243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:27.473254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:27.473259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:27.473742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 982 sessionId:  describe result for acl check
2025-10-10T14:33:27.473780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:27.473787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:27.473789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:27.473796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601175849876889:5171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:27.474349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:27.474415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601175849876889:5171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:27.474689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:27.474700Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:27.474703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:27.474707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:27.474714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 981 [2:7559601175067655378:6500]
2025-10-10T14:33:27.474737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:27.474758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:27.474765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.474769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.474772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.474788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:27.474801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:27.474813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:27.474875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.474881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.474883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.474885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:27.474954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:27.474962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.474976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.474986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.475001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:27.475024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876858:2438], now have 1 active actors on pipe
2025-10-10T14:33:27.475032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601175067655372:6500]
2025-10-10T14:33:27.475034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601175067655372:6500]
2025-10-10T14:33:27.475036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601175067655372:6500]
2025-10-10T14:33:27.475038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 981
2025-10-10T14:33:27.475060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:27.475075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:27.475078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:27.475079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:27.475079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:27.475094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:27.475098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:27.475127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601175067655372:6500]
2025-10-10T14:33:27.475135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:27.475149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:27.476571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601175849876889:5171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:27.483205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601175849876889:5171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:27.483222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601175849876889:5171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:27.483226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601175849876889:5171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:27.483236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:27.483552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876922:5171], now have 1 active actors on pipe
2025-10-10T14:33:27.483599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 981
2025-10-10T14:33:27.483678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.483693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.483733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:27.483752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.483761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.483764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:27.483780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.483806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:27.483847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.484014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.484023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.484038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.484121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 982 partition: 0 MaxSeqNo: 40 sessionId: src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0
2025-10-10T14:33:27.484569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e891859-d41aed7-82b6537b-c6885175_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:27.487107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:27.487144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.487161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601175067655372:6500]
2025-10-10T14:33:27.487221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:27.487215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:27.487496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:27.487699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.487898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.487995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0] Write session: try to update token
2025-10-10T14:33:27.488018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:27.488068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.488351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:27.488409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:27.503402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId: src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:27.505111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:27.505133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.505138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:27.505140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:27.505153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601175067655372:6500]
2025-10-10T14:33:27.505158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601175067655372:6500]
2025-10-10T14:33:27.505162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601175067655372:6500]
2025-10-10T14:33:27.505215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:27.505222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:27.505228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.505229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:27.505231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:27.505232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:27.505421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:27.506141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:27.561945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601175849876925:7749]
2025-10-10T14:33:27.562291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 981, pipe: [1:7559601175849876925:7749]
2025-10-10T14:33:27.615679Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:27.615962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.615976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.615997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876925:7749], now have 1 active actors on pipe
2025-10-10T14:33:27.616161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:27.616225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:27.616276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:27.616283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:27.616304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601175849876925:7749]
2025-10-10T14:33:27.616348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 982 reason: error at write: Disconnected sessionId: src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0
2025-10-10T14:33:27.616575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 982 sessionId: src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0 is DEAD
2025-10-10T14:33:27.616721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:27.616740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0] Write session will restart in 0.008120s
2025-10-10T14:33:27.616766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0] Write session: Do CDS request
2025-10-10T14:33:27.616773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:27.623635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:27.624974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:27.625326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:27.625355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:27.625366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:27.625435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:27.625472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601175067655442:6502]
2025-10-10T14:33:27.625904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.626033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:27.626047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 983
2025-10-10T14:33:27.626080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:27.626170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.626212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:27.626216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:27.626219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:27.626499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:27.626554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 983 sessionId:  describe result for acl check
2025-10-10T14:33:27.626564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:27.626586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:27.626593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:27.626595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:27.626599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601175849876961:5166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:27.626904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:27.626969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.626975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.626977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.626978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.626979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.626981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.626982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.626984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.626985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.626986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.626988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.626989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.626991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.626999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.627014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.627019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.627023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.627027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.627031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.627036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.627041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.627045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.627076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601175849876961:5166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:27.627050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.627053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.627057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.627061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.627069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.627078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.627084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.627090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.627095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.627100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.627104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.627110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.627114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.627120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.627124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.627137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.627144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.627149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.627154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.627161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.627166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.627172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.627176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.627183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.627187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.627192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.627196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.627201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.627205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.627211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.627252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:27.629618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601175849876961:5166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:27.629864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:27.630293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:27.630306Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:27.630308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:27.630312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:27.630319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 982 [2:7559601175067655442:6502]
2025-10-10T14:33:27.630335Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:27.630357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:27.630367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.630371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.630373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.630392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:27.630399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:27.630407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:27.630484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.630492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.630494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.630497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:27.630567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:27.630576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.630588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.630603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.630624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:27.630655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876933:2438], now have 1 active actors on pipe
2025-10-10T14:33:27.630665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601175067655437:6502]
2025-10-10T14:33:27.630667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601175067655437:6502]
2025-10-10T14:33:27.630669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601175067655437:6502]
2025-10-10T14:33:27.630683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:27.630697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:27.630685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 982
2025-10-10T14:33:27.630703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:27.630706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:27.630708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:27.630720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:27.630724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:27.630770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601175067655437:6502]
2025-10-10T14:33:27.630782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:27.630789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:27.636103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601175849876961:5166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:27.636122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601175849876961:5166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:27.636127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601175849876961:5166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:27.636137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:27.636513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849876996:5166], now have 1 active actors on pipe
2025-10-10T14:33:27.636583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 982
2025-10-10T14:33:27.636736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.636756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.636805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:27.636824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.636835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.636838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:27.636852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.636872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:27.636893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.637143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.637156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.637179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.637278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 983 partition: 0 MaxSeqNo: 40 sessionId: src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0
2025-10-10T14:33:27.637652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d19c6e-ef2a5621-b25220ee-1e3cb83b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:27.640066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0] Write session: try to update token
2025-10-10T14:33:27.640084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:27.642319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:27.642339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.642354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601175067655437:6502]
2025-10-10T14:33:27.642403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:27.642403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:27.642572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:27.642714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.642871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.643021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.643216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:27.643264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:27.653628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId: src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:27.656220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:27.656451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.656483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.656531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:27.656619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:27.660016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:27.660036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.660040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:27.660045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:27.660056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601175067655437:6502]
2025-10-10T14:33:27.660060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601175067655437:6502]
2025-10-10T14:33:27.660066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601175067655437:6502]
2025-10-10T14:33:27.660106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:27.660112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.660111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:27.660114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:27.660118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:27.660123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:27.660245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:27.716558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601175849877004:7749]
2025-10-10T14:33:27.716859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 982, pipe: [1:7559601175849877004:7749]
2025-10-10T14:33:27.768929Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:27.776176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.776207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.776378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.776439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.776510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.776572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.777070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.777083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.777152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.777209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.777275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.777355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.777404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.777411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.777482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.777546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.777625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.777691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.777739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.777746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.777817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.777888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.777954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.778020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.778079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.778086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.778155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.778228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.778291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.778368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.778420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.778428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.778499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.778564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.778629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.778694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.778742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.778748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.778816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.778879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.778947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.779012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.779056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.779062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.779130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.779191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.779256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.779317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.779364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.779371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.779440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.779501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.779562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.779624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.779668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.779675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.779738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:27.779809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:27.779873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:27.779941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:27.779986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:27.779993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:27.780055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849877004:7749], now have 1 active actors on pipe
2025-10-10T14:33:27.780326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601175849877004:7749]
2025-10-10T14:33:27.780337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:27.780367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:27.780370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:27.780415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 983 reason: error at write: Disconnected sessionId: src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0
2025-10-10T14:33:27.780559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:27.780649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 983 sessionId: src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0 is DEAD
2025-10-10T14:33:27.780819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:27.780831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0] Write session will restart in 0.005910s
2025-10-10T14:33:27.780858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0] Write session: Do CDS request
2025-10-10T14:33:27.780865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:27.787919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.787999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:27.788014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 984
2025-10-10T14:33:27.788175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.788213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:27.788226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:27.788230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:27.788646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:27.788682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 984 sessionId:  describe result for acl check
2025-10-10T14:33:27.788720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:27.788726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:27.788727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:27.788734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601175849877031:5155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:27.789345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601175849877031:5155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:27.790045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:27.790268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:27.790280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:27.790293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:27.790356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:27.790405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601175067655509:6505]
2025-10-10T14:33:27.791031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:27.791345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:27.791415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:27.791754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:27.791800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.791805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.791806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.791806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.791807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.791808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.791809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.791809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.791810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.791811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.791812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.791812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.791814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.791820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.791828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.791831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.791833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.791836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.791838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.791841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.791843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.791845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.791847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.791850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.791853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.791857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.791864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.791872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.791878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.791899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.791905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.791910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.791914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.791919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.791923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.791929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.791932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.791937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.791942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.791945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601175849877031:5155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:27.791947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.791952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.791955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.791958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.791962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.791966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.791969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.791972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.791976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.791978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.791981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.791983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.791986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.792008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:27.794575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:27.794632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601175849877031:5155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:27.794646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601175849877031:5155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:27.794650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601175849877031:5155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:27.794659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:27.794924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:27.794937Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:27.794939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:27.794944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:27.794950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 983 [2:7559601175067655509:6505]
2025-10-10T14:33:27.794963Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:27.794985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:27.794995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.794998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.795000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.795019Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:27.795032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:27.795060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:27.795125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.795133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.795135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.795139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:27.795207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:27.795215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.795227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.795239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.795257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:27.795282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849877066:5155], now have 1 active actors on pipe
2025-10-10T14:33:27.795303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849877005:2438], now have 1 active actors on pipe
2025-10-10T14:33:27.795316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601175067655504:6505]
2025-10-10T14:33:27.795318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601175067655504:6505]
2025-10-10T14:33:27.795320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601175067655504:6505]
2025-10-10T14:33:27.795335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:27.795325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 983
2025-10-10T14:33:27.795341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 983
2025-10-10T14:33:27.795355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:27.795366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:27.795371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:27.795373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:27.795374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:27.795378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:27.795419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.795428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.795447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601175067655504:6505]
2025-10-10T14:33:27.795458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:27.795473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:27.795489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:27.795501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.795505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.795507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:27.795520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.795536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:27.795564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.795741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.795752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.795770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.795892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 984 partition: 0 MaxSeqNo: 40 sessionId: src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0
2025-10-10T14:33:27.796306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaec3908-ff660e96-40b29693-d2f6fd9a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:27.799120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0] Write session: try to update token
2025-10-10T14:33:27.799141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:27.813442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId: src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:27.815817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:27.815855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.815860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:27.815863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:27.815874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601175067655504:6505]
2025-10-10T14:33:27.815883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601175067655504:6505]
2025-10-10T14:33:27.815888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601175067655504:6505]
2025-10-10T14:33:27.815938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:27.815948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:27.815956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.815959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:27.815960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:27.815964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:27.816178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:27.817074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:27.880380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601175849877074:7749]
2025-10-10T14:33:27.880637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 983, pipe: [1:7559601175849877074:7749]
2025-10-10T14:33:27.924780Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:27.925055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.925070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.925111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849877074:7749], now have 1 active actors on pipe
2025-10-10T14:33:27.925353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:27.925407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601175849877074:7749]
2025-10-10T14:33:27.925433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:27.925435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:27.925440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:27.925501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 984 reason: error at write: Disconnected sessionId: src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0
2025-10-10T14:33:27.925722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 984 sessionId: src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0 is DEAD
2025-10-10T14:33:27.925901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:27.925913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0] Write session will restart in 0.006471s
2025-10-10T14:33:27.925939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0] Write session: Do CDS request
2025-10-10T14:33:27.925946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:27.932909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:27.933864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.934026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:27.934039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 985
2025-10-10T14:33:27.934152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:27.934199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:27.934236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:27.934245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:27.934249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:27.934358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:27.934369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:27.934380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:27.934430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:27.934474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601175067655574:6507]
2025-10-10T14:33:27.934633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 985 sessionId:  describe result for acl check
2025-10-10T14:33:27.934660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:27.934662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:27.934663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:27.934667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601175849877103:5148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:27.935025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:27.935122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601175849877103:5148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:27.935366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:27.935415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:27.935705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:27.935763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.935765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.935766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.935767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.935769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.935770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.935774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.935775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.935776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.935777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.935779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.935780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.935781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.935788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.935800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.935804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.935808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.935812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.935816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.935820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.935825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.935829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.935834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.935838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.935842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.935845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.935852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.935861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:27.935868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.935873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:27.935876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.935879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:27.935882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.935885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:27.935888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.935891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:27.935894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.935898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:27.935904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.935912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:27.935916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.935920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:27.935927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.935932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:27.935937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.935942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:27.935947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.935955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.935959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.935964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.935968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.935974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.936018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:27.937009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601175849877103:5148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:27.938237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:27.938593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:27.938606Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:27.938608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:27.938612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:27.938617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 984 [2:7559601175067655574:6507]
2025-10-10T14:33:27.938648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:27.938671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:27.938679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.938682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.938685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.938701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:27.938715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:27.938722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:27.938788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.938795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.938798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.938800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:27.938865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:27.938876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.938888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:27.938897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:27.938878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601175849877103:5148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:27.938915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:27.938892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601175849877103:5148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:27.938896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601175849877103:5148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:27.938904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:27.938941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849877075:2438], now have 1 active actors on pipe
2025-10-10T14:33:27.938953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601175067655569:6507]
2025-10-10T14:33:27.938955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601175067655569:6507]
2025-10-10T14:33:27.938957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601175067655569:6507]
2025-10-10T14:33:27.938970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:27.938985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:27.938988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:27.938995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:27.938997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:27.939004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:27.939007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:27.939032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601175067655569:6507]
2025-10-10T14:33:27.939028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 984
2025-10-10T14:33:27.939044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:27.939053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:27.939168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601175849877143:5148], now have 1 active actors on pipe
2025-10-10T14:33:27.939210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 984
2025-10-10T14:33:27.939255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.939266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.939295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:27.939307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:27.939314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:27.939318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:27.939331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:27.939341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:27.939356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.939522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.939533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.939548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:27.939658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 985 partition: 0 MaxSeqNo: 40 sessionId: src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0
2025-10-10T14:33:27.940007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73b5b8bf-13e568bd-9c29470c-51bbfe46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:27.942677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0] Write session: try to update token
2025-10-10T14:33:27.942694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:27.950617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:27.950637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.950648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601175067655569:6507]
2025-10-10T14:33:27.950704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:27.950727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:27.950895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:27.951045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.951188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.951336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:27.951540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:27.951584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:27.957651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId: src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:27.960244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:27.960467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:27.960502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:27.960557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:27.960640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:27.969967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:27.969992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:27.969995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:27.970001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:27.970012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601175067655569:6507]
2025-10-10T14:33:27.970017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601175067655569:6507]
2025-10-10T14:33:27.970022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601175067655569:6507]
2025-10-10T14:33:27.970084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:27.970084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:27.970093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:27.970094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:27.970096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:27.970097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:27.970273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:28.025807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601180144844462:7749]
2025-10-10T14:33:28.026032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 984, pipe: [1:7559601180144844462:7749]
2025-10-10T14:33:28.086385Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:28.095785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.095816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.096013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.096082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.096158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.096227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.096286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.096294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.096375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.096441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.096518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.096593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.096762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.096777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.096854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.096924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.096997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.097065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.097116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.097121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.097205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.097272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.097356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.097434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.097499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.097505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.097588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.097663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.097742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.097821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.097884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.097892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.097992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.098055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.098121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.098207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.098263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.098269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.098796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.098861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.098933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.099008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.099181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.099206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.099284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.099341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.099411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.099474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.099524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.099532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.099592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.099648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.099705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.099762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.099807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.099814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.099873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:28.099927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:28.099984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:28.100043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:28.100084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:28.100091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:28.100160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844462:7749], now have 1 active actors on pipe
2025-10-10T14:33:28.100427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601180144844462:7749]
2025-10-10T14:33:28.100452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:28.100455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:28.100459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:28.100505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 985 reason: error at write: Disconnected sessionId: src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0
2025-10-10T14:33:28.100730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 985 sessionId: src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0 is DEAD
2025-10-10T14:33:28.100725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:28.100854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:28.100866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0] Write session will restart in 0.005141s
2025-10-10T14:33:28.100893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0] Write session: Do CDS request
2025-10-10T14:33:28.100899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:28.106925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.106976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:28.106991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 986
2025-10-10T14:33:28.107157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.107194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:28.107199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:28.107203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:28.107650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 986 sessionId:  describe result for acl check
2025-10-10T14:33:28.107690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:28.107692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:28.107694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:28.107700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601180144844503:5131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:28.108210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:28.108308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601180144844503:5131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:28.109292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:28.109488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:28.109501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:28.109513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:28.109567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:28.109610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601179362622975:6522]
2025-10-10T14:33:28.110085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:28.110266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601180144844503:5131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:28.110403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:28.110452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:28.110698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:28.110746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.110754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.110756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.110757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.110758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.110759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.110760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.110761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.110763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.110764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.110765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.110767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.110768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.110774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.110786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.110791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.110795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.110799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.110804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.110807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.110809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.110811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.110814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.110816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.110818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.110820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.110826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.110833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.110839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.110842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.110845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.110849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.110852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.110855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.110858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.110861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.110865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.110868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.110871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.110874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.110876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.110881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.110884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.110887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.110890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.110893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.110896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.110899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.110902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.110905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.110908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.110912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.110934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:28.113233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601180144844503:5131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:28.113248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601180144844503:5131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:28.113252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601180144844503:5131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:28.113261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:28.113265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:28.113581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:28.113596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:28.113599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:28.113603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:28.113611Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 985 [2:7559601179362622975:6522]
2025-10-10T14:33:28.113619Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:28.113634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:28.113635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.113638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.113639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.113652Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:28.113659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:28.113673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:28.113712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.113720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.113721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.113723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:28.113794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:28.113802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.113809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.113816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.113829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:28.113856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844474:2438], now have 1 active actors on pipe
2025-10-10T14:33:28.113866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844539:5131], now have 1 active actors on pipe
2025-10-10T14:33:28.113872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601179362622970:6522]
2025-10-10T14:33:28.113873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601179362622970:6522]
2025-10-10T14:33:28.113875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601179362622970:6522]
2025-10-10T14:33:28.113885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:28.113895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:28.113909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:28.113912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:28.113913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:28.113915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:28.113902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 985
2025-10-10T14:33:28.113916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 985
2025-10-10T14:33:28.113915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:28.113942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601179362622970:6522]
2025-10-10T14:33:28.113945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:28.113947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:28.113974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.113978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.114018Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:28.114032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.114036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.114040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:28.114050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.114066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:28.114095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.114267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.114283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.114303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.114386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 986 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0
2025-10-10T14:33:28.114799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6cfe3-74b8e65c-df41b831-94dd7e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:28.117262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0] Write session: try to update token
2025-10-10T14:33:28.117280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:28.130917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId: src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:28.133068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:28.133091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:28.133095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:28.133098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:28.133108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601179362622970:6522]
2025-10-10T14:33:28.133113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601179362622970:6522]
2025-10-10T14:33:28.133118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601179362622970:6522]
2025-10-10T14:33:28.133178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:28.133183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:28.133188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.133191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:28.133202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:28.133207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:28.133370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:28.133616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:28.200407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601180144844546:7749]
2025-10-10T14:33:28.200712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 985, pipe: [1:7559601180144844546:7749]
2025-10-10T14:33:28.252116Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:28.252532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.252548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.252587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844546:7749], now have 1 active actors on pipe
2025-10-10T14:33:28.252875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:28.252852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601180144844546:7749]
2025-10-10T14:33:28.252857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:28.252894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:28.252898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:28.252981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 986 reason: error at write: Disconnected sessionId: src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0
2025-10-10T14:33:28.253183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 986 sessionId: src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0 is DEAD
2025-10-10T14:33:28.253347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:28.253358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0] Write session will restart in 0.008104s
2025-10-10T14:33:28.253384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0] Write session: Do CDS request
2025-10-10T14:33:28.253392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:28.260230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:28.261442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:28.261607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:28.261617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:28.261625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:28.261665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:28.261712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601179362623043:6524]
2025-10-10T14:33:28.262400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:28.262698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:28.262737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:28.262894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.262949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:28.262963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 987
2025-10-10T14:33:28.263049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:28.263095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.263097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.263101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.263102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.263103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.263104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.263106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.263107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.263108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.263130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:28.263139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:28.263143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:28.263110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.263111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.263112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.263113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.263114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.263119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.263130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.263134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.263138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.263142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.263146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.263151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.263155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.263158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.263162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.263165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.263169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.263173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.263179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.263187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.263191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.263196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.263200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.263205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.263209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.263214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.263218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.263222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.263227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.263232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.263236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.263240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.263244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.263255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.263259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.263263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.263267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.263272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.263276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.263281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.263289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.263294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.263303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.263308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.263344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:28.263639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 987 sessionId:  describe result for acl check
2025-10-10T14:33:28.263690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:28.263700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:28.263702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:28.263710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601180144844581:5128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:28.264292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601180144844581:5128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:28.265803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:28.266204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:28.266216Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:28.266219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:28.266225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:28.266232Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 986 [2:7559601179362623043:6524]
2025-10-10T14:33:28.266245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:28.266260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:28.266263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.266265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.266268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.266282Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:28.266290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:28.266296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:28.266294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601180144844581:5128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:28.266353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.266362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.266364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.266366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:28.266442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:28.266449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.266462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.266478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.266501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:28.266523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844547:2438], now have 1 active actors on pipe
2025-10-10T14:33:28.266534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601179362623038:6524]
2025-10-10T14:33:28.266537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601179362623038:6524]
2025-10-10T14:33:28.266539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601179362623038:6524]
2025-10-10T14:33:28.266551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:28.266552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 986
2025-10-10T14:33:28.266563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:28.266575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:28.266579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:28.266582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:28.266583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:28.266586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:28.266608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601179362623038:6524]
2025-10-10T14:33:28.266616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:28.266619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:28.271242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601180144844581:5128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:28.271256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601180144844581:5128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:28.271259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601180144844581:5128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:28.271277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:28.271526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844615:5128], now have 1 active actors on pipe
2025-10-10T14:33:28.271614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 986
2025-10-10T14:33:28.271704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.271714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.271754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:28.271766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.271772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.271775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:28.271785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.271802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:28.271821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.272044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.272053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.272067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.272147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 987 partition: 0 MaxSeqNo: 40 sessionId: src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0
2025-10-10T14:33:28.272502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ac05e7c-22f9415d-e640bec4-474934e7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:28.275169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0] Write session: try to update token
2025-10-10T14:33:28.275186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:28.286028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:28.286052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:28.286060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:28.286062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:28.286073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601179362623038:6524]
2025-10-10T14:33:28.286082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601179362623038:6524]
2025-10-10T14:33:28.286086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601179362623038:6524]
2025-10-10T14:33:28.286140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:28.286153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.286155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:28.286151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:28.286184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:28.286204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:28.286339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:28.289879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId: src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:28.292392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:28.352974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601180144844631:7749]
2025-10-10T14:33:28.353276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 986, pipe: [1:7559601180144844631:7749]
2025-10-10T14:33:28.407808Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:28.408128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.408142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.408188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844631:7749], now have 1 active actors on pipe
2025-10-10T14:33:28.408423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:28.408484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:28.408485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:28.408489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:28.408560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601180144844631:7749]
2025-10-10T14:33:28.408577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 987 reason: error at write: Disconnected sessionId: src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0
2025-10-10T14:33:28.408830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 987 sessionId: src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0 is DEAD
2025-10-10T14:33:28.409021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:28.409033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0] Write session will restart in 0.009320s
2025-10-10T14:33:28.409058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0] Write session: Do CDS request
2025-10-10T14:33:28.409064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:28.415643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:28.416806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:28.417014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:28.417024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:28.417034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:28.417076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:28.417122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601179362623124:6527]
2025-10-10T14:33:28.417775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:28.418124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:28.418201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:28.418528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:28.418588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.418595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.418596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.418597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.418598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.418599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.418600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.418601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.418602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.418605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.418606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.418607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.418607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.418612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.418621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.418624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.418626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.418629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.418632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.418635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.418637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.418640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.418643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.418645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.418647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.418650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.418656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.418662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.418666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.418670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.418673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.418676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.418679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.418682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.418686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.418689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.418692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.418695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.418698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.418701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.418705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.418709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.418712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.418715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.418718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.418722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.418724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.418727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.418730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.418733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.418736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.418740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.418764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:28.419938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.420038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:28.420054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 988
2025-10-10T14:33:28.420202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.420235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:28.420245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:28.420257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:28.420722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 988 sessionId:  describe result for acl check
2025-10-10T14:33:28.420765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:28.420771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:28.420773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:28.420779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601180144844668:5118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:28.421271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:28.421283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601180144844668:5118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:28.421621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:28.421633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:28.421635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:28.421638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:28.421645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 987 [2:7559601179362623124:6527]
2025-10-10T14:33:28.421655Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:28.421669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:28.421671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.421675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.421677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.421691Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:28.421703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:28.421709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:28.421758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.421765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.421767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.421769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:28.421830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:28.421838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.421845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.421852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.421863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:28.421884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601179362623119:6527]
2025-10-10T14:33:28.421901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601179362623119:6527]
2025-10-10T14:33:28.421902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601179362623119:6527]
2025-10-10T14:33:28.421915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:28.421935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844632:2438], now have 1 active actors on pipe
2025-10-10T14:33:28.421936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:28.421939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:28.421941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:28.421951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:28.421968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:28.421958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 987
2025-10-10T14:33:28.421978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:28.422014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601179362623119:6527]
2025-10-10T14:33:28.422026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:28.422036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:28.423455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601180144844668:5118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:28.428791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601180144844668:5118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:28.428804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601180144844668:5118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:28.428808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601180144844668:5118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:28.428815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:28.429085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844701:5118], now have 1 active actors on pipe
2025-10-10T14:33:28.429160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 987
2025-10-10T14:33:28.429234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.429252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.429296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:28.429319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.429326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.429343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:28.429359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.429378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:28.429402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.429616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.429633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.429662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.429775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 988 partition: 0 MaxSeqNo: 40 sessionId: src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0
2025-10-10T14:33:28.430177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d856f5-52c1240c-3e2db2c1-963af5aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:28.433047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0] Write session: try to update token
2025-10-10T14:33:28.433067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:28.433470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:28.433491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:28.433503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601179362623119:6527]
2025-10-10T14:33:28.433554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:28.433567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:28.433736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:28.433897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:28.434042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:28.434204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:28.434403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:28.434454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:28.448229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId: src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:28.450854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:28.451732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.451763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.451789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:28.451793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:28.451796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:28.451799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:28.451810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601179362623119:6527]
2025-10-10T14:33:28.451814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601179362623119:6527]
2025-10-10T14:33:28.451818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601179362623119:6527]
2025-10-10T14:33:28.451857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:28.451869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:28.451873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:28.451878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:28.451890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.451897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:28.452029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:28.508632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601180144844705:7749]
2025-10-10T14:33:28.508945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 987, pipe: [1:7559601180144844705:7749]
2025-10-10T14:33:28.569596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:28.569976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:28.570022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844705:7749], now have 1 active actors on pipe
2025-10-10T14:33:28.570341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:28.570396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601180144844705:7749]
2025-10-10T14:33:28.570528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:28.570624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:28.570632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:28.570711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 988 reason: error at write: Disconnected sessionId: src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0
2025-10-10T14:33:28.570905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 988 sessionId: src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0 is DEAD
2025-10-10T14:33:28.571090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:28.571113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0] Write session will restart in 0.005551s
2025-10-10T14:33:28.571138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0] Write session: Do CDS request
2025-10-10T14:33:28.571145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:28.577927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.577978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:28.577995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 989
2025-10-10T14:33:28.578193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.578224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:28.578232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:28.578235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:28.578668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 989 sessionId:  describe result for acl check
2025-10-10T14:33:28.578705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:28.578711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:28.578713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:28.578720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601180144844740:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:28.579092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:28.579269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601180144844740:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:28.580683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:28.580873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:28.580882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:28.580891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:28.580934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:28.580975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601179362623194:6529]
2025-10-10T14:33:28.581472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:28.581749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601180144844740:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:28.581869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:28.581949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:28.582245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:28.582288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.582289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.582292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.582293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.582294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.582294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.582295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.582296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.582297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.582298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.582299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.582300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.582301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.582306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.582315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.582318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.582320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.582323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.582326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.582328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.582331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.582333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.582336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.582339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.582343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.582345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.582351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.582356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.582360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.582364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.582369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.582373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.582376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.582382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.582385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.582388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.582393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.582397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.582400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.582403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.582406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.582409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.582412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.582415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.582419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.582422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.582425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.582428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.582431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.582434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.582437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.582442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.582466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:28.584849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601180144844740:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:28.584864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601180144844740:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:28.584867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601180144844740:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:28.584876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:28.584919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:28.585392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:28.585407Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:28.585409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:28.585413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:28.585420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 988 [2:7559601179362623194:6529]
2025-10-10T14:33:28.585434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:28.585450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:28.585470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.585473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.585476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.585492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:28.585506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:28.585513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:28.585570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.585577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.585579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.585581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:28.585656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:28.585666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.585677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.585688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.585704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:28.585724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844777:5115], now have 1 active actors on pipe
2025-10-10T14:33:28.585727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844706:2438], now have 1 active actors on pipe
2025-10-10T14:33:28.585734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601179362623189:6529]
2025-10-10T14:33:28.585737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601179362623189:6529]
2025-10-10T14:33:28.585741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601179362623189:6529]
2025-10-10T14:33:28.585761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:28.585752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 988
2025-10-10T14:33:28.585781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:28.585778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 988
2025-10-10T14:33:28.585788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:28.585794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:28.585796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:28.585800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:28.585803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:28.585827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601179362623189:6529]
2025-10-10T14:33:28.585835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:28.585838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:28.585850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.585854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.585905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:28.585916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.585920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.585922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:28.585930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.585940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:28.585960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.586118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.586125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.586138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.586259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 989 partition: 0 MaxSeqNo: 40 sessionId: src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0
2025-10-10T14:33:28.586655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b765fa-b752d9e9-c612f8ee-e9c3024c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:28.589285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0] Write session: try to update token
2025-10-10T14:33:28.589303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:28.604491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId: src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:28.605656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:28.605680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:28.605683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:28.605685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:28.605701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601179362623189:6529]
2025-10-10T14:33:28.605705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601179362623189:6529]
2025-10-10T14:33:28.605710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601179362623189:6529]
2025-10-10T14:33:28.605768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:28.605781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.605781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:28.605784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:28.605789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:28.605796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:28.605957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:28.607430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:28.670431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601180144844794:7749]
2025-10-10T14:33:28.670731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 988, pipe: [1:7559601180144844794:7749]
2025-10-10T14:33:28.728324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:28.728705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.728722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.728765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844794:7749], now have 1 active actors on pipe
2025-10-10T14:33:28.729007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:28.729055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:28.729037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601180144844794:7749]
2025-10-10T14:33:28.729065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:28.729068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:28.729153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 989 reason: error at write: Disconnected sessionId: src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0
2025-10-10T14:33:28.729385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 989 sessionId: src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0 is DEAD
2025-10-10T14:33:28.729554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:28.729567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0] Write session will restart in 0.005371s
2025-10-10T14:33:28.729605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0] Write session: Do CDS request
2025-10-10T14:33:28.729610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:28.735966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.735998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:28.736013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 990
2025-10-10T14:33:28.736196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.736234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:28.736243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:28.736247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:28.736652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 990 sessionId:  describe result for acl check
2025-10-10T14:33:28.736685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:28.736687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:28.736689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:28.736696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601180144844825:5108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:28.737270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601180144844825:5108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:28.737391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:28.738908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:28.739184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:28.739195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:28.739208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:28.739273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:28.739317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601179362623267:6532]
2025-10-10T14:33:28.739704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601180144844825:5108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:28.739967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:28.740320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:28.740398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:28.740856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:28.740931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.740938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.740939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.740940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.740941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.740943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.740944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.740945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.740947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.740948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.740949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.740950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.740951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.740958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.740971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.740976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.740980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.740984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.740988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.740992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.740997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.741001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.741007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.741012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.741016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.741019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.741026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.741035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.741042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.741048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.741053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.741058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.741063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.741068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.741074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.741080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.741084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.741090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.741096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.741102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.741106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.741111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.741127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.741138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.741144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.741149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.741159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.741164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.741169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.741178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.741185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.741194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.741245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:28.743773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:28.743781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601180144844825:5108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:28.743798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601180144844825:5108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:28.743803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601180144844825:5108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:28.743812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:28.744109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:28.744120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:28.744123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:28.744128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:28.744134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 989 [2:7559601179362623267:6532]
2025-10-10T14:33:28.744148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:28.744165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:28.744174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.744177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.744179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.744195Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:28.744209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:28.744216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:28.744276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.744283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.744285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.744288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:28.744373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:28.744381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.744406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.744423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.744445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:28.744472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844795:2438], now have 1 active actors on pipe
2025-10-10T14:33:28.744476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844862:5108], now have 1 active actors on pipe
2025-10-10T14:33:28.744483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601179362623262:6532]
2025-10-10T14:33:28.744485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601179362623262:6532]
2025-10-10T14:33:28.744488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601179362623262:6532]
2025-10-10T14:33:28.744503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:28.744483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 989
2025-10-10T14:33:28.744503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 989
2025-10-10T14:33:28.744522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:28.744527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:28.744531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:28.744534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:28.744543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:28.744551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:28.744596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.744606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.744624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601179362623262:6532]
2025-10-10T14:33:28.744637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:28.744657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:28.744671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:28.744679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.744699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.744701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:28.744711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.744722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:28.744747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.744914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.744923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.744941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.745076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 990 partition: 0 MaxSeqNo: 40 sessionId: src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0
2025-10-10T14:33:28.745554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ecb6fe-4074667-8dd75aa4-ad96f3ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:28.748428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0] Write session: try to update token
2025-10-10T14:33:28.748452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:28.764061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId: src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:28.765252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:28.765276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:28.765280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:28.765282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:28.765292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601179362623262:6532]
2025-10-10T14:33:28.765297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601179362623262:6532]
2025-10-10T14:33:28.765305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601179362623262:6532]
2025-10-10T14:33:28.765369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:28.765379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:28.765385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:28.765387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.765389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:28.765391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:28.765551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:28.766889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:28.829083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601180144844879:7749]
2025-10-10T14:33:28.829299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 989, pipe: [1:7559601180144844879:7749]
2025-10-10T14:33:28.882292Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:28.882684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.882701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.882748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844879:7749], now have 1 active actors on pipe
2025-10-10T14:33:28.882982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:28.883007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:28.883025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601180144844879:7749]
2025-10-10T14:33:28.883049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:28.883051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:28.883116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 990 reason: error at write: Disconnected sessionId: src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0
2025-10-10T14:33:28.883354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 990 sessionId: src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0 is DEAD
2025-10-10T14:33:28.883529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:28.883540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0] Write session will restart in 0.008900s
2025-10-10T14:33:28.883565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0] Write session: Do CDS request
2025-10-10T14:33:28.883575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:28.890582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:28.891942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:28.892153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:28.892166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:28.892180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:28.892233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:28.892281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601179362623339:6534]
2025-10-10T14:33:28.892907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:28.893208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:28.893258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:28.893598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:28.893663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.893669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.893670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.893672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.893673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.893674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.893676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.893677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.893678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.893680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.893681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.893682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.893683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.893689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.893702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.893706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.893711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.893715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.893719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.893723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.893727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.893732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.893736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.893740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.893744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.893748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.893756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.893767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:28.893773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.893778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:28.893782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.893787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:28.893793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.893799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:28.893804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.893810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:28.893815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.893820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:28.893830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.893835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:28.893840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.893845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:28.893850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.893860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:28.893864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.893869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:28.893878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.893883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.893886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.893891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.893900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.893905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.893960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.893947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:28.894051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:28.894075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 991
2025-10-10T14:33:28.894234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:28.894268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:28.894277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:28.894282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:28.894757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 991 sessionId:  describe result for acl check
2025-10-10T14:33:28.894809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:28.894815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:28.894817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:28.894823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601180144844919:5105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:28.895426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601180144844919:5105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:28.896347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:28.896668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:28.896681Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:28.896684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:28.896688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:28.896694Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 990 [2:7559601179362623339:6534]
2025-10-10T14:33:28.896706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:28.896728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:28.896732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.896735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.896738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.896754Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:28.896768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:28.896775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:28.896853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.896859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.896861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.896864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:28.896939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:28.896947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.896959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:28.896976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:28.896998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:28.897026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844880:2438], now have 1 active actors on pipe
2025-10-10T14:33:28.897034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601179362623334:6534]
2025-10-10T14:33:28.897036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601179362623334:6534]
2025-10-10T14:33:28.897038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601179362623334:6534]
2025-10-10T14:33:28.897027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 990
2025-10-10T14:33:28.897053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:28.897073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:28.897075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:28.897078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:28.897080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:28.897091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:28.897094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:28.897127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601179362623334:6534]
2025-10-10T14:33:28.897140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:28.897161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:28.897733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601180144844919:5105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:28.902372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601180144844919:5105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:28.902387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601180144844919:5105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:28.902391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601180144844919:5105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:28.902399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:28.902622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844956:5105], now have 1 active actors on pipe
2025-10-10T14:33:28.902688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 990
2025-10-10T14:33:28.902761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.902774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.902807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:28.902825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:28.902831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:28.902839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:28.902854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:28.902877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:28.902898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.903098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.903113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.903139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:28.903243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 991 partition: 0 MaxSeqNo: 40 sessionId: src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0
2025-10-10T14:33:28.903674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c0735e-71eabe16-11999e00-4f4cc24b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:28.906318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0] Write session: try to update token
2025-10-10T14:33:28.906336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:28.908640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:28.908657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:28.908668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601179362623334:6534]
2025-10-10T14:33:28.908703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:28.908715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:28.908887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:28.909025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:28.909157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:28.909285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:28.909488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:28.909531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:28.920933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId: src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:28.923629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:28.923955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:28.923980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:28.924023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:28.924127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:28.926644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:28.926661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:28.926668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:28.926670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:28.926681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601179362623334:6534]
2025-10-10T14:33:28.926684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601179362623334:6534]
2025-10-10T14:33:28.926688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601179362623334:6534]
2025-10-10T14:33:28.926738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:28.926738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:28.926743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:28.926746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:28.926750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:28.926753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:28.926884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:28.983241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601180144844960:7749]
2025-10-10T14:33:28.983564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 990, pipe: [1:7559601180144844960:7749]
2025-10-10T14:33:29.050324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:29.059198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.059227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.059392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.059457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.059523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.059586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.059631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.059641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.059709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.059770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.059837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.059905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.059948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.059959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.060025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.060086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.060151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.060216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.060258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.060266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.060331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.060396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.060459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.060903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.060952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.060959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.061028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.061089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.061155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.061218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.061267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.061276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.061359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.061418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.061481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.061546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.061590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.061598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.061668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.061728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.061796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.061861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.061906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.061913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.061978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.062042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.062106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.062182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.062226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.062233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.062296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.062356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.062422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.062480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.062526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.062534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.062598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:29.062658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:29.062720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:29.062786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:29.062836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:29.062843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:29.062906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601180144844960:7749], now have 1 active actors on pipe
2025-10-10T14:33:29.063183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601180144844960:7749]
2025-10-10T14:33:29.063222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:29.063225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:29.063256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 991 reason: error at write: Disconnected sessionId: src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0
2025-10-10T14:33:29.063518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 991 sessionId: src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0 is DEAD
2025-10-10T14:33:29.063654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:29.063662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0] Write session will restart in 0.006809s
2025-10-10T14:33:29.063687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0] Write session: Do CDS request
2025-10-10T14:33:29.063693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:29.063715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:29.064168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:29.071990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.072071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:29.072103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 992
2025-10-10T14:33:29.072188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:29.072331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.072370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:29.072381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:29.072385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:29.072809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 992 sessionId:  describe result for acl check
2025-10-10T14:33:29.072844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:29.072850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:29.072851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:29.072858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601184439812307:5092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:29.073467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601184439812307:5092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:29.073857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:29.074126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:29.074155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:29.074171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:29.074240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:29.074289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601183657590721:6542]
2025-10-10T14:33:29.074930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:29.075351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:29.075378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601184439812307:5092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:29.075445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:29.075862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:29.075927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.075937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.075938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.075940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.075941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.075943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.075950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.075951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.075954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.075955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.075956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.075958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.075959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.075967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.075978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.075982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.075989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.075993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.075997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.076001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.076005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.076008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.076013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.076017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.076020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.076024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.076032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.076043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.076050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.076056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.076062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.076068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.076073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.076079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.076084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.076090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.076094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.076100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.076105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.076111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.076116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.076122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.076137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.076150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.076155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.076160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.076166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.076172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.076183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.076188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.076195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.076200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.076247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:29.078686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601184439812307:5092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:29.078700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601184439812307:5092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:29.078704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601184439812307:5092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:29.078713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:29.078844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:29.079261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:29.079275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:29.079278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:29.079282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:29.079292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 991 [2:7559601183657590721:6542]
2025-10-10T14:33:29.079307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:29.079340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:29.079351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.079355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.079357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.079373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:29.079380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:29.079394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:29.079466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.079475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.079478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.079483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:29.079561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:29.079571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.079583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.079595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.079619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:29.079648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812340:5092], now have 1 active actors on pipe
2025-10-10T14:33:29.079658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812271:2438], now have 1 active actors on pipe
2025-10-10T14:33:29.079665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601183657590716:6542]
2025-10-10T14:33:29.079667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601183657590716:6542]
2025-10-10T14:33:29.079669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601183657590716:6542]
2025-10-10T14:33:29.079682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:29.079694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:29.079714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:29.079717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:29.079695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 991
2025-10-10T14:33:29.079718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:29.079725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 991
2025-10-10T14:33:29.079721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:29.079721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:29.079751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601183657590716:6542]
2025-10-10T14:33:29.079761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:29.079764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:29.079781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.079791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.079842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:29.079856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.079861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.079863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:29.079872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.079884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:29.079914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.080167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.080185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.080207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.080330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 992 partition: 0 MaxSeqNo: 40 sessionId: src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0
2025-10-10T14:33:29.080731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|726f9f17-5c53d418-d65bf1d0-dc6e8094_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:29.083552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0] Write session: try to update token
2025-10-10T14:33:29.083566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:29.100313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:29.100339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:29.100343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:29.100345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:29.100358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601183657590716:6542]
2025-10-10T14:33:29.100363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601183657590716:6542]
2025-10-10T14:33:29.100366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601183657590716:6542]
2025-10-10T14:33:29.100418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:29.100428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.100431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:29.100432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:29.100440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:29.100445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:29.100751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:29.100751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId: src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:29.104320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:29.163471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601184439812360:7749]
2025-10-10T14:33:29.163697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 991, pipe: [1:7559601184439812360:7749]
2025-10-10T14:33:29.223360Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:29.223674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.223689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.223730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812360:7749], now have 1 active actors on pipe
2025-10-10T14:33:29.223958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:29.224088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:29.224103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:29.224176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 992 reason: error at write: Disconnected sessionId: src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0
2025-10-10T14:33:29.224228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601184439812360:7749]
2025-10-10T14:33:29.224287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:29.224412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 992 sessionId: src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0 is DEAD
2025-10-10T14:33:29.224585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:29.224595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0] Write session will restart in 0.006003s
2025-10-10T14:33:29.224617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0] Write session: Do CDS request
2025-10-10T14:33:29.224625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:29.231840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.231928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:29.231941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 993
2025-10-10T14:33:29.232096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.232095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:29.232132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:29.232142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:29.232146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:29.232639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 993 sessionId:  describe result for acl check
2025-10-10T14:33:29.232679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:29.232684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:29.232686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:29.232692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601184439812397:5078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:29.233256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601184439812397:5078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:29.233441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:29.233630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:29.233641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:29.233649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:29.233692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:29.233737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601183657590821:6551]
2025-10-10T14:33:29.234212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:29.234515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:29.234545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:29.234756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:29.234799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.234806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.234806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.234807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.234808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.234809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.234810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.234810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.234812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.234813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.234813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.234814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.234815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.234818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.234826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.234829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.234832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.234834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.234837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.234839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.234841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.234843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.234846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.234848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.234850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.234852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.234860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.234864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.234869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.234873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.234876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.234881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.234884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.234888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.234892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.234896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.234899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.234904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.234909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.234912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.234915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.234918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.234921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.234925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.234928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.234931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.234934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.234937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.234940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.234944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.234947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.234950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.234974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:29.235527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601184439812397:5078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:29.237314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:29.237805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:29.237821Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:29.237827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:29.237833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:29.237840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 992 [2:7559601183657590821:6551]
2025-10-10T14:33:29.237856Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:29.237873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:29.237883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.237887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.237890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.237905Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:29.237916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:29.237923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:29.237987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.237995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.237998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.238000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:29.238072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:29.238084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.238096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.238108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.238124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:29.238156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812361:2438], now have 1 active actors on pipe
2025-10-10T14:33:29.238169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601183657590816:6551]
2025-10-10T14:33:29.238172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601183657590816:6551]
2025-10-10T14:33:29.238173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601183657590816:6551]
2025-10-10T14:33:29.238188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:29.238201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:29.238210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:29.238214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:29.238216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:29.238224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:29.238227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:29.238251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601183657590816:6551]
2025-10-10T14:33:29.238264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:29.238276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:29.238379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601184439812397:5078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:29.238392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601184439812397:5078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:29.238396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601184439812397:5078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:29.238404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:29.238447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 992
2025-10-10T14:33:29.238578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812431:5078], now have 1 active actors on pipe
2025-10-10T14:33:29.238621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 992
2025-10-10T14:33:29.238662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.238673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.238696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:29.238710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.238714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.238717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:29.238726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.238742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:29.238764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.238920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.238929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.238941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.239013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 993 partition: 0 MaxSeqNo: 40 sessionId: src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0
2025-10-10T14:33:29.239365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|421970b-bfed35b6-aeba3b6f-f7f01c55_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:29.241819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0] Write session: try to update token
2025-10-10T14:33:29.241835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:29.255764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId: src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:29.257131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:29.257155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:29.257160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:29.257161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:29.257170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601183657590816:6551]
2025-10-10T14:33:29.257174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601183657590816:6551]
2025-10-10T14:33:29.257178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601183657590816:6551]
2025-10-10T14:33:29.257226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:29.257232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:29.257234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:29.257239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:29.257242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.257244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:29.257431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:29.258387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:29.324204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601184439812438:7749]
2025-10-10T14:33:29.324544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 992, pipe: [1:7559601184439812438:7749]
2025-10-10T14:33:29.370910Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:29.371219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.371235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.371284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812438:7749], now have 1 active actors on pipe
2025-10-10T14:33:29.371550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:29.371575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601184439812438:7749]
2025-10-10T14:33:29.371614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:29.371619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:29.371622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:29.371700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 993 reason: error at write: Disconnected sessionId: src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0
2025-10-10T14:33:29.371930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 993 sessionId: src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0 is DEAD
2025-10-10T14:33:29.372117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:29.372128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0] Write session will restart in 0.005445s
2025-10-10T14:33:29.372147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0] Write session: Do CDS request
2025-10-10T14:33:29.372154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:29.378872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.378980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:29.378995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 994
2025-10-10T14:33:29.379127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.379166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:29.379174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:29.379179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:29.379653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 994 sessionId:  describe result for acl check
2025-10-10T14:33:29.379693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:29.379701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:29.379703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:29.379710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601184439812487:5074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:29.379827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:29.380322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601184439812487:5074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:29.381192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:29.381471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:29.381484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:29.381497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:29.381557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:29.381611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601183657590907:6554]
2025-10-10T14:33:29.382336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:29.382450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601184439812487:5074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:29.382641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:29.382685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:29.382950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:29.383009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.383017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.383019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.383021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.383023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.383025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.383027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.383029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.383033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.383035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.383036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.383038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.383039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.383045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.383059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.383064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.383068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.383070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.383073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.383076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.383078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.383081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.383084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.383086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.383089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.383091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.383097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.383102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.383108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.383112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.383115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.383119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.383122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.383126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.383130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.383133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.383136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.383140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.383144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.383149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.383152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.383156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.383161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.383165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.383170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.383173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.383177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.383181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.383184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.383188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.383194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.383200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.383246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:29.385757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601184439812487:5074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:29.385782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601184439812487:5074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:29.385786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601184439812487:5074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:29.385794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:29.386069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:29.386556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:29.386572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:29.386575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:29.386579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:29.386587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 993 [2:7559601183657590907:6554]
2025-10-10T14:33:29.386604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:29.386622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:29.386626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.386630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.386633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.386653Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:29.386671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:29.386679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:29.386757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.386770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.386772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.386777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:29.386861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:29.386873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.386886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.386898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.386923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:29.386951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812451:2438], now have 1 active actors on pipe
2025-10-10T14:33:29.386961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812522:5074], now have 1 active actors on pipe
2025-10-10T14:33:29.386969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601183657590902:6554]
2025-10-10T14:33:29.386971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601183657590902:6554]
2025-10-10T14:33:29.386974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601183657590902:6554]
2025-10-10T14:33:29.386994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:29.386989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 993
2025-10-10T14:33:29.387008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 993
2025-10-10T14:33:29.387013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:29.387020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:29.387028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:29.387030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:29.387037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:29.387041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:29.387096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601183657590902:6554]
2025-10-10T14:33:29.387113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:29.387129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.387130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:29.387139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.387193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60dcf359-85de6348-302c1ab3-1101497f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:29.387208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.387212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.387214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:29.387226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.387238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:29.387268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.387450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.387461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.387478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.387568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 994 partition: 0 MaxSeqNo: 40 sessionId: src_id|60dcf359-85de6348-302c1ab3-1101497f_0
2025-10-10T14:33:29.387949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d25bb8f1-eae7c76e-350bc0c2-fdcd9984_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|60dcf359-85de6348-302c1ab3-1101497f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:29.390721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60dcf359-85de6348-302c1ab3-1101497f_0] Write session: try to update token
2025-10-10T14:33:29.390739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60dcf359-85de6348-302c1ab3-1101497f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:29.405320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId: src_id|60dcf359-85de6348-302c1ab3-1101497f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:29.407928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:29.408576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.408606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.408626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:29.408629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:29.408631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:29.408638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:29.408646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601183657590902:6554]
2025-10-10T14:33:29.408650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601183657590902:6554]
2025-10-10T14:33:29.408654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601183657590902:6554]
2025-10-10T14:33:29.408703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:29.408718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:29.408718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:29.408722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:29.408725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.408726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:29.408899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:29.471695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601184439812530:7749]
2025-10-10T14:33:29.472040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 993, pipe: [1:7559601184439812530:7749]
2025-10-10T14:33:29.533403Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:29.533715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:29.533778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812530:7749], now have 1 active actors on pipe
2025-10-10T14:33:29.533869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:29.534048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601184439812530:7749]
2025-10-10T14:33:29.534084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:29.543169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:29.543923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:29.543934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:29.543969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 994 reason: error at write: Disconnected sessionId: src_id|60dcf359-85de6348-302c1ab3-1101497f_0
2025-10-10T14:33:29.544123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 994 sessionId: src_id|60dcf359-85de6348-302c1ab3-1101497f_0 is DEAD
2025-10-10T14:33:29.544260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60dcf359-85de6348-302c1ab3-1101497f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:29.544270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60dcf359-85de6348-302c1ab3-1101497f_0] Write session will restart in 0.008491s
2025-10-10T14:33:29.544298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60dcf359-85de6348-302c1ab3-1101497f_0] Write session: Do CDS request
2025-10-10T14:33:29.544306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60dcf359-85de6348-302c1ab3-1101497f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:29.548918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:29.549189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:29.549202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:29.549214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:29.549280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:29.549353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601183657590984:6556]
2025-10-10T14:33:29.550302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:29.550608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:29.550664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:29.551111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:29.551184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.551192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.551193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.551195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.551196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.551198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.551200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.551202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.551204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.551206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.551207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.551209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.551210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.551217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.551229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.551233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.551242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.551246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.551251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.551255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.551260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.551265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.551273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.551278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.551282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.551287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.551297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.551306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.551312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.551318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.551324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.551330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.551334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.551339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.551343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.551346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.551349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.551353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.551357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.551361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.551364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.551368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.551378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.551382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.551386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.551389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.551398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.551402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.551411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.551415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.551419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.551422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.551452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:29.553879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60dcf359-85de6348-302c1ab3-1101497f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.554196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:29.554208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:29.554225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 995
2025-10-10T14:33:29.554349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.554400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:29.554412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:29.554417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:29.554661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:29.554675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:29.554678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:29.554682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:29.554688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 994 [2:7559601183657590984:6556]
2025-10-10T14:33:29.554703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:29.554719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:29.554727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.554730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.554731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.554744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:29.554750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:29.554756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:29.554821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.554834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.554836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.554840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:29.554902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:29.554912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.554920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.554926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.554936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:29.554935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 995 sessionId:  describe result for acl check
2025-10-10T14:33:29.554957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601183657590978:6556]
2025-10-10T14:33:29.554964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601183657590978:6556]
2025-10-10T14:33:29.554965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601183657590978:6556]
2025-10-10T14:33:29.554973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:29.554973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:29.554984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:29.554979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:29.554987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:29.554981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:29.554987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601184439812575:5066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:29.554991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:29.554993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:29.554994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:29.554996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:29.555005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812531:2438], now have 1 active actors on pipe
2025-10-10T14:33:29.555029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601183657590978:6556]
2025-10-10T14:33:29.555030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 994
2025-10-10T14:33:29.555037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:29.555059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:29.555626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601184439812575:5066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:29.558404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601184439812575:5066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:29.564322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601184439812575:5066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:29.564339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601184439812575:5066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:29.564343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601184439812575:5066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:29.564354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:29.564633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812608:5066], now have 1 active actors on pipe
2025-10-10T14:33:29.564701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 994
2025-10-10T14:33:29.564775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.564794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.564846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:29.564864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.564870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.564873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:29.564900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.564926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:29.564965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.565143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.565152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.565168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.565283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 995 partition: 0 MaxSeqNo: 40 sessionId: src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0
2025-10-10T14:33:29.565724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60dcf359-85de6348-302c1ab3-1101497f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:29.568427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0] Write session: try to update token
2025-10-10T14:33:29.568445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:29.574851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:29.574872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:29.574876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:29.574881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:29.574892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601183657590978:6556]
2025-10-10T14:33:29.574899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601183657590978:6556]
2025-10-10T14:33:29.574903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601183657590978:6556]
2025-10-10T14:33:29.574959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:29.574972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.574975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:29.574972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:29.575000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:29.575005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:29.575110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:29.583034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId: src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:29.586034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:29.633998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601184439812621:7749]
2025-10-10T14:33:29.634285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 994, pipe: [1:7559601184439812621:7749]
2025-10-10T14:33:29.687432Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:29.687805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.687821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.687846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812621:7749], now have 1 active actors on pipe
2025-10-10T14:33:29.688062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:29.688067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:29.688102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601184439812621:7749]
2025-10-10T14:33:29.688119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:29.688128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:29.688208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 995 reason: error at write: Disconnected sessionId: src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0
2025-10-10T14:33:29.688417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 995 sessionId: src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0 is DEAD
2025-10-10T14:33:29.688597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:29.688605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0] Write session will restart in 0.008766s
2025-10-10T14:33:29.688630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0] Write session: Do CDS request
2025-10-10T14:33:29.688640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:29.696914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:29.698314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:29.698545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:29.698556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:29.698569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:29.698625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:29.698673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601183657591062:6559]
2025-10-10T14:33:29.699002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.699071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:29.699087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 996
2025-10-10T14:33:29.699244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.699289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:29.699299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:29.699304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:29.699322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:29.699616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:29.699665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:29.699781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 996 sessionId:  describe result for acl check
2025-10-10T14:33:29.699819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:29.699826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:29.699828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:29.699834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601184439812666:5063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:29.699987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:29.700044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.700050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.700052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.700053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.700054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.700056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.700057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.700058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.700059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.700060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.700061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.700062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.700064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.700071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.700083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.700088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.700092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.700096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.700102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.700106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.700110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.700114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.700120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.700124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.700129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.700132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.700139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.700148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.700155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.700160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.700164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.700169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.700173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.700178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.700183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.700188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.700192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.700197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.700201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.700206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.700210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.700216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.700221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.700227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.700231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.700237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.700243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.700249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.700253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.700259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.700270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.700276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.700323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:29.700406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601184439812666:5063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:29.702601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601184439812666:5063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:29.702892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:29.703239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:29.703255Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:29.703257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:29.703261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:29.703267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 995 [2:7559601183657591062:6559]
2025-10-10T14:33:29.703282Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:29.703298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:29.703302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.703306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.703308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.703325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:29.703338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:29.703346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:29.703406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.703414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.703416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.703420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:29.703489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:29.703502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.703514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.703525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.703541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:29.703567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812625:2438], now have 1 active actors on pipe
2025-10-10T14:33:29.703580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601183657591057:6559]
2025-10-10T14:33:29.703587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601183657591057:6559]
2025-10-10T14:33:29.703589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601183657591057:6559]
2025-10-10T14:33:29.703604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:29.703593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 995
2025-10-10T14:33:29.703618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:29.703619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:29.703622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:29.703625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:29.703643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:29.703646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:29.703681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601183657591057:6559]
2025-10-10T14:33:29.703693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:29.703705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:29.708741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601184439812666:5063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:29.708756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601184439812666:5063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:29.708760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601184439812666:5063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:29.708769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:29.709017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812702:5063], now have 1 active actors on pipe
2025-10-10T14:33:29.709067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 995
2025-10-10T14:33:29.709122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.709145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.709182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:29.709200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.709205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.709217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:29.709232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.709255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:29.709288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.709500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.709513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.709537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.709625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 996 partition: 0 MaxSeqNo: 40 sessionId: src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0
2025-10-10T14:33:29.709998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc1b606-94598786-c02c4b1e-df577a2e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:29.712805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0] Write session: try to update token
2025-10-10T14:33:29.712822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:29.721282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:29.721302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:29.721317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601183657591057:6559]
2025-10-10T14:33:29.721385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:29.721393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:29.721577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:29.721724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:29.721872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:29.722015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:29.722252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:29.722299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:29.729077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId: src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:29.731726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:29.733372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.733397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.733422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:29.733428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:29.733431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:29.733434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:29.733443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601183657591057:6559]
2025-10-10T14:33:29.733447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601183657591057:6559]
2025-10-10T14:33:29.733451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601183657591057:6559]
2025-10-10T14:33:29.733500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:29.733510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:29.733514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:29.733517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.733518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:29.733520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:29.733647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:29.788109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601184439812706:7749]
2025-10-10T14:33:29.788429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 995, pipe: [1:7559601184439812706:7749]
2025-10-10T14:33:29.850688Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:29.850999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:29.851040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812706:7749], now have 1 active actors on pipe
2025-10-10T14:33:29.851162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:29.851235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601184439812706:7749]
2025-10-10T14:33:29.851257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:29.851280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:29.851282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:29.851392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 996 reason: error at write: Disconnected sessionId: src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0
2025-10-10T14:33:29.851574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 996 sessionId: src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0 is DEAD
2025-10-10T14:33:29.851735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:29.851747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0] Write session will restart in 0.008708s
2025-10-10T14:33:29.851779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0] Write session: Do CDS request
2025-10-10T14:33:29.851786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:29.860002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:29.861418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:29.861658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:29.861671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:29.861685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:29.861752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:29.861814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601183657591140:6561]
2025-10-10T14:33:29.861909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.862075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:29.862095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 997
2025-10-10T14:33:29.862299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:29.862344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:29.862364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:29.862377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:29.862471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:29.862813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 997 sessionId:  describe result for acl check
2025-10-10T14:33:29.862812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:29.862852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:29.862861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:29.862863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:29.862869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601184439812749:5058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:29.862871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:29.863206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:29.863278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.863285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.863287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.863288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.863290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.863291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.863293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.863294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.863296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.863298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.863299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.863300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.863302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.863309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.863322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.863327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.863333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.863339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.863344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.863348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.863353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.863356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.863362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.863366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.863370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.863375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.863404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.863415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:29.863427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.863433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:29.863443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.863449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:29.863459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.863466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:29.863476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.863456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601184439812749:5058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:29.863482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:29.863491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.863498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:29.863503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.863509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:29.863514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.863520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:29.863526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.863538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:29.863547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.863554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:29.863561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.863569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.863578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.863584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.863594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.863599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.863670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:29.865992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601184439812749:5058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:29.866095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:29.866519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:29.866536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:29.866539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:29.866543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:29.866549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 996 [2:7559601183657591140:6561]
2025-10-10T14:33:29.866563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:29.866582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:29.866586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.866589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.866592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.866609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:29.866622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:29.866634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:29.866695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.866703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.866705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.866708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:29.866774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:29.866782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.866796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:29.866809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:29.866832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:29.866862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812707:2438], now have 1 active actors on pipe
2025-10-10T14:33:29.866875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601183657591135:6561]
2025-10-10T14:33:29.866877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601183657591135:6561]
2025-10-10T14:33:29.866879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601183657591135:6561]
2025-10-10T14:33:29.866893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:29.866897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:29.866899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:29.866901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:29.866907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:29.866924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:29.866931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:29.866956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601183657591135:6561]
2025-10-10T14:33:29.866959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:29.866971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:29.866898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 996
2025-10-10T14:33:29.872218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601184439812749:5058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:29.872235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601184439812749:5058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:29.872239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601184439812749:5058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:29.872249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:29.872660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812785:5058], now have 1 active actors on pipe
2025-10-10T14:33:29.872868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.872891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.872941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:29.872961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:29.872968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:29.872978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:29.872993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:29.872778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 996
2025-10-10T14:33:29.873014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:29.873040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.873294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.873318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.873371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:29.873501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 997 partition: 0 MaxSeqNo: 40 sessionId: src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0
2025-10-10T14:33:29.873912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95aa42f3-6ea8abd1-7ca61bd6-c0017fbe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:29.876859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0] Write session: try to update token
2025-10-10T14:33:29.876881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:29.878714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:29.878731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:29.878743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601183657591135:6561]
2025-10-10T14:33:29.878786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:29.878796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:29.878982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:29.879132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:29.879280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:29.879451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:29.879666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:29.879712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:29.891975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId: src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:29.894586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:29.894855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:29.894881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:29.894931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:29.895024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:29.897053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:29.897075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:29.897079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:29.897081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:29.897092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601183657591135:6561]
2025-10-10T14:33:29.897096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601183657591135:6561]
2025-10-10T14:33:29.897099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601183657591135:6561]
2025-10-10T14:33:29.897154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:29.897156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:29.897162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:29.897167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:29.897168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:29.897170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:29.897309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:29.952430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601184439812789:7749]
2025-10-10T14:33:29.952720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 996, pipe: [1:7559601184439812789:7749]
2025-10-10T14:33:30.018860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:30.027129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.027160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.027340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.027409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.027480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.027546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.027769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.027782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.027851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.027916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.027981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.028046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.028089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.028100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.028168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.028231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.028296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.028365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.028412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.028420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.028488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.028553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.028620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.028685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.028729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.028738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.028803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.028865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.028942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.029007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.029051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.029059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.029128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.029189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.029252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.029319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.029382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.029391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.029457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.029515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.029585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.029650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.029695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.029703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.029772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.029835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.029902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.029970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.030020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.030028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.030112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.030175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.030240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.030305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.030349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.030357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.030425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:30.030487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:30.030551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:30.030611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:30.030945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:30.030954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:30.031023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601184439812789:7749], now have 1 active actors on pipe
2025-10-10T14:33:30.031294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601184439812789:7749]
2025-10-10T14:33:30.031315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:30.031319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:30.031331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:30.031354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 997 reason: error at write: Disconnected sessionId: src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0
2025-10-10T14:33:30.031545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 997 sessionId: src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0 is DEAD
2025-10-10T14:33:30.031658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:30.031690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:30.031699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0] Write session will restart in 0.008934s
2025-10-10T14:33:30.031725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0] Write session: Do CDS request
2025-10-10T14:33:30.031732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:30.040061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:30.041632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:30.041894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:30.041909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:30.041925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:30.041994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.041998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:30.042052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601187952558515:6563]
2025-10-10T14:33:30.042142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:30.042159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 998
2025-10-10T14:33:30.042301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.042332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:30.042338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:30.042344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:30.042705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:30.042722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 998 sessionId:  describe result for acl check
2025-10-10T14:33:30.042758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:30.042764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:30.042768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:30.042773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601188734780128:5047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:30.043041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:30.043101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:30.043465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:30.043547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.043555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.043557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.043558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.043559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.043561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.043562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.043563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.043564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.043566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.043567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.043568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.043571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.043579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.043591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.043595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.043600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.043604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.043609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.043613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.043618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.043622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.043627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.043631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.043635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.043640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.043647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.043657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.043663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.043676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.043680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.043687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.043698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.043704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.043710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.043716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.043720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.043731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.043736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.043741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.043750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.043755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.043761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.043769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.043774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.043779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.043744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601188734780128:5047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:30.043784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.043789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.043793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.043798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.043803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.043808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.043849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:30.046359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:30.046709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:30.046722Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:30.046725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:30.046729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:30.046735Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 997 [2:7559601187952558515:6563]
2025-10-10T14:33:30.046749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:30.046767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:30.046771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.046774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.046777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.046795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:30.046808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:30.046802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601188734780128:5047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:30.046818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:30.046882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.046890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.046893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.046896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:30.046964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:30.046972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.046985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.047000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.047021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:30.047043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780086:2438], now have 1 active actors on pipe
2025-10-10T14:33:30.047055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601187952558510:6563]
2025-10-10T14:33:30.047061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601187952558510:6563]
2025-10-10T14:33:30.047063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601187952558510:6563]
2025-10-10T14:33:30.047077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:30.047091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:30.047096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:30.047100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:30.047103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:30.047100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 997
2025-10-10T14:33:30.047111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:30.047114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:30.047141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601187952558510:6563]
2025-10-10T14:33:30.047149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:30.047151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:30.054172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601188734780128:5047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:30.054189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601188734780128:5047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:30.054194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601188734780128:5047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:30.054203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:30.054500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780166:5047], now have 1 active actors on pipe
2025-10-10T14:33:30.054551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 997
2025-10-10T14:33:30.054639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.054654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.054694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:30.054713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.054724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.054732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:30.054753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.054780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:30.054808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.055023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.055034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.055053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.055158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 998 partition: 0 MaxSeqNo: 40 sessionId: src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0
2025-10-10T14:33:30.055582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92b0e72a-19196f1c-b4967bf7-ad4f5a76_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:30.058471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0] Write session: try to update token
2025-10-10T14:33:30.058491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:30.058890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:30.058916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.058928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601187952558510:6563]
2025-10-10T14:33:30.058977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:30.058977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:30.059172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:30.059316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.059460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.059603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.059797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:30.059843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:30.073280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId: src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:30.076288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:30.077248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.077277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.077298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:30.077300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.077302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:30.077304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:30.077311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601187952558510:6563]
2025-10-10T14:33:30.077314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601187952558510:6563]
2025-10-10T14:33:30.077317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601187952558510:6563]
2025-10-10T14:33:30.077379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:30.077389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.077391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:30.077405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:30.077412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:30.077416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:30.077517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:30.131637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:33:30.131663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-10T14:33:30.131770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601188734780186:7749]
2025-10-10T14:33:30.132415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 997, pipe: [1:7559601188734780186:7749]
2025-10-10T14:33:30.192875Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:30.193301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:30.193362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780186:7749], now have 1 active actors on pipe
2025-10-10T14:33:30.193464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:30.193544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:30.193565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-10T14:33:30.193605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601188734780186:7749]
2025-10-10T14:33:30.202273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:30.203847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:30.204092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:30.204103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:30.204116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:30.204177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:30.204223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601187952558633:6579]
2025-10-10T14:33:30.204861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:30.205190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:30.205173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:30.205185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:30.205211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 998 reason: error at write: Disconnected sessionId: src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0
2025-10-10T14:33:30.205265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:30.205390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 998 sessionId: src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0 is DEAD
2025-10-10T14:33:30.205564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:30.205572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0] Write session will restart in 0.006421s
2025-10-10T14:33:30.205597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0] Write session: Do CDS request
2025-10-10T14:33:30.205604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:30.205626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:30.205686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.205692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.205695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.205696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.205697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.205698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.205699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.205700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.205700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.205701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.205702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.205702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.205703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.205707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.205717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.205720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.205722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.205725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.205728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.205732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.205736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.205740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.205744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.205748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.205752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.205756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.205765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.205775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.205781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.205787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.205792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.205796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.205799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.205802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.205808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.205814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.205819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.205824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.205829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.205835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.205846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.205861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.205870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.205875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.205880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.205885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.205896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.205901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.205906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.205911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.205916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.205921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.205957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:30.212988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.213491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:30.213510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 999
2025-10-10T14:33:30.213662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.213701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:30.213712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:30.213716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:30.214225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 999 sessionId:  describe result for acl check
2025-10-10T14:33:30.214265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:30.214269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:30.214271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:30.214278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601188734780246:5030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:30.214508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:30.214883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601188734780246:5030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:30.215023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:30.215037Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:30.215040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:30.215044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:30.215050Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 998 [2:7559601187952558633:6579]
2025-10-10T14:33:30.215064Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:30.215083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:30.215088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.215092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.215102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.215124Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:30.215137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:30.215145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:30.215215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.215223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.215224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.215227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:30.215306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:30.215317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.215328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.215340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.215356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:30.215384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780198:2438], now have 1 active actors on pipe
2025-10-10T14:33:30.215399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601187952558628:6579]
2025-10-10T14:33:30.215402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601187952558628:6579]
2025-10-10T14:33:30.215405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601187952558628:6579]
2025-10-10T14:33:30.215418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:30.215431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:30.215434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:30.215450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:30.215452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:30.215452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:30.215456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:30.215443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 998
2025-10-10T14:33:30.215497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601187952558628:6579]
2025-10-10T14:33:30.215506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:30.215510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:30.215607Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:33:30.215828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 5 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:33:30.215881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:33:30.217791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601188734780246:5030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:30.224468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601188734780246:5030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:30.224484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601188734780246:5030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:30.224490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601188734780246:5030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:30.224499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:30.224771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780282:5030], now have 1 active actors on pipe
2025-10-10T14:33:30.224818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 998
2025-10-10T14:33:30.224890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.224907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.224951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:30.224970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.224982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.224984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:30.225000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.225026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:30.225053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.225197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.225207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.225222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.225368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 999 partition: 0 MaxSeqNo: 40 sessionId: src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0
2025-10-10T14:33:30.225727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87ebc746-e88b99d8-4480e4c6-aa919c51_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:30.228720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0] Write session: try to update token
2025-10-10T14:33:30.228740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:30.235652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:30.235677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.235680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:30.235682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:30.235693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601187952558628:6579]
2025-10-10T14:33:30.235713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601187952558628:6579]
2025-10-10T14:33:30.235722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601187952558628:6579]
2025-10-10T14:33:30.235782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:30.235796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.235800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:30.235948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:30.237403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:30.237421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:30.237426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:30.244102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId: src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:30.246824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:30.294029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601188734780286:7749]
2025-10-10T14:33:30.294451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 998, pipe: [1:7559601188734780286:7749]
2025-10-10T14:33:30.354574Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:30.354920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.354943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.354967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780286:7749], now have 1 active actors on pipe
2025-10-10T14:33:30.355184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:30.355189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:30.355227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:30.355229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:30.355238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601188734780286:7749]
2025-10-10T14:33:30.355299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 999 reason: error at write: Disconnected sessionId: src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0
2025-10-10T14:33:30.355494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 999 sessionId: src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0 is DEAD
2025-10-10T14:33:30.355639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:30.355650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0] Write session will restart in 0.005264s
2025-10-10T14:33:30.355675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0] Write session: Do CDS request
2025-10-10T14:33:30.355681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:30.361869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.362049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:30.362071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1000
2025-10-10T14:33:30.362189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.362225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:30.362235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:30.362239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:30.362698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1000 sessionId:  describe result for acl check
2025-10-10T14:33:30.362737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:30.362746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:30.362748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:30.362755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601188734780343:5025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:30.363199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:30.363354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601188734780343:5025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:30.364673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:30.364883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:30.364896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:30.364908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:30.364966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:30.365023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601187952558726:6583]
2025-10-10T14:33:30.365635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601188734780343:5025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:30.365656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:30.365952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:30.366003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:30.366344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:30.366418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.366425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.366426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.366428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.366429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.366430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.366431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.366433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.366434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.366435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.366437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.366439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.366440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.366446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.366460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.366465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.366468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.366472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.366476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.366479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.366482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.366486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.366491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.366495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.366498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.366501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.366508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.366518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.366524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.366529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.366533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.366538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.366541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.366546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.366551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.366555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.366560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.366564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.366568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.366573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.366577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.366581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.366585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.366590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.366594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.366601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.366606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.366617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.366621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.366626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.366635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.366640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.366671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:30.367433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601188734780343:5025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:30.367444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601188734780343:5025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:30.367447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601188734780343:5025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:30.367454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:30.369100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:30.369501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:30.369513Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:30.369514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:30.369518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:30.369523Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 999 [2:7559601187952558726:6583]
2025-10-10T14:33:30.369532Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:30.369545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:30.369548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.369551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.369553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.369571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:30.369585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:30.369597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:30.369655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.369664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.369665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.369668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:30.369730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:30.369738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.369747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.369764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.369781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:30.369803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780302:2438], now have 1 active actors on pipe
2025-10-10T14:33:30.369812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780383:5025], now have 1 active actors on pipe
2025-10-10T14:33:30.369820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601187952558721:6583]
2025-10-10T14:33:30.369822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601187952558721:6583]
2025-10-10T14:33:30.369824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601187952558721:6583]
2025-10-10T14:33:30.369841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:30.369845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 999
2025-10-10T14:33:30.369861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:30.369849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 999
2025-10-10T14:33:30.369863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:30.369865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:30.369867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:30.369880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:30.369883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:30.369925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.369935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.369951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601187952558721:6583]
2025-10-10T14:33:30.369960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:30.369980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:30.369999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4d4249a-f979f268-14283d9e-81e3d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:30.370012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.370018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.370020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:30.370033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.370049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:30.370084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.370247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.370256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.370272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.370371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1000 partition: 0 MaxSeqNo: 40 sessionId: src_id|e4d4249a-f979f268-14283d9e-81e3d2_0
2025-10-10T14:33:30.370826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d431bed-11df452a-c3a07d9b-77f301c5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e4d4249a-f979f268-14283d9e-81e3d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:30.373665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d4249a-f979f268-14283d9e-81e3d2_0] Write session: try to update token
2025-10-10T14:33:30.373687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d4249a-f979f268-14283d9e-81e3d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:30.388446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId: src_id|e4d4249a-f979f268-14283d9e-81e3d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:30.389738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:30.389763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.389767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:30.389769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:30.389782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601187952558721:6583]
2025-10-10T14:33:30.389786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601187952558721:6583]
2025-10-10T14:33:30.389792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601187952558721:6583]
2025-10-10T14:33:30.389835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:30.389840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:30.389847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.389850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:30.389852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:30.389857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:30.389977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:30.391130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:30.455233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601188734780395:7749]
2025-10-10T14:33:30.455551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 999, pipe: [1:7559601188734780395:7749]
2025-10-10T14:33:30.497244Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:30.497590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.497604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.497644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780395:7749], now have 1 active actors on pipe
2025-10-10T14:33:30.497835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:30.497873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:30.497884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:30.497889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601188734780395:7749]
2025-10-10T14:33:30.497913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:30.497962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1000 reason: error at write: Disconnected sessionId: src_id|e4d4249a-f979f268-14283d9e-81e3d2_0
2025-10-10T14:33:30.498214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1000 sessionId: src_id|e4d4249a-f979f268-14283d9e-81e3d2_0 is DEAD
2025-10-10T14:33:30.498369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d4249a-f979f268-14283d9e-81e3d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:30.498380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d4249a-f979f268-14283d9e-81e3d2_0] Write session will restart in 0.007197s
2025-10-10T14:33:30.498405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d4249a-f979f268-14283d9e-81e3d2_0] Write session: Do CDS request
2025-10-10T14:33:30.498415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d4249a-f979f268-14283d9e-81e3d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:30.506030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:30.506912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d4249a-f979f268-14283d9e-81e3d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.507028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:30.507043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1001
2025-10-10T14:33:30.507186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.507233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:30.507244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:30.507247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:30.507696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:30.507776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1001 sessionId:  describe result for acl check
2025-10-10T14:33:30.507815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:30.507821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:30.507823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:30.507830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601188734780440:5015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:30.507948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:30.507962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:30.507974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:30.508025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:30.508063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601187952558807:6585]
2025-10-10T14:33:30.508415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601188734780440:5015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:30.508468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:30.508780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:30.508826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:30.509124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:30.509194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.509201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.509202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.509204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.509205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.509206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.509207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.509208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.509209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.509210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.509211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.509213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.509214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.509220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.509232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.509237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.509241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.509244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.509247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.509251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.509254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.509258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.509262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.509265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.509269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.509273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.509282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.509290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.509297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.509302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.509306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.509311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.509315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.509320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.509324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.509344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.509349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.509353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.509358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.509363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.509369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.509380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.509384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.509390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.509394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.509398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.509403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.509410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.509414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.509420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.509429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.509434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.509476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:30.510706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601188734780440:5015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:30.512013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:30.512312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:30.512323Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:30.512324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:30.512327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:30.512334Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1000 [2:7559601187952558807:6585]
2025-10-10T14:33:30.512346Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:30.512363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:30.512368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.512371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.512375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.512388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:30.512393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:30.512400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:30.512442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.512447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.512448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.512450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:30.512515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:30.512523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.512533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.512546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.512561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:30.512588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780396:2438], now have 1 active actors on pipe
2025-10-10T14:33:30.512601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601187952558802:6585]
2025-10-10T14:33:30.512608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601187952558802:6585]
2025-10-10T14:33:30.512602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1000
2025-10-10T14:33:30.512610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601187952558802:6585]
2025-10-10T14:33:30.512627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:30.512643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:30.512652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:30.512658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:30.512661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:30.512675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:30.512678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:30.512688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601187952558802:6585]
2025-10-10T14:33:30.512693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:30.512705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:30.513278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601188734780440:5015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:30.513294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601188734780440:5015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:30.513298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601188734780440:5015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:30.513319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:30.513556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780476:5015], now have 1 active actors on pipe
2025-10-10T14:33:30.513628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1000
2025-10-10T14:33:30.513684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.513695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.513726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0523a7c-16383f43-667957c8-21dc8046_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:30.513739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.513744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.513746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:30.513760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.513777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:30.513796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.513927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.513934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.513949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.514029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1001 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0523a7c-16383f43-667957c8-21dc8046_0
2025-10-10T14:33:30.514418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d4249a-f979f268-14283d9e-81e3d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0523a7c-16383f43-667957c8-21dc8046_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:30.517004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0523a7c-16383f43-667957c8-21dc8046_0] Write session: try to update token
2025-10-10T14:33:30.517023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0523a7c-16383f43-667957c8-21dc8046_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:30.531205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId: src_id|e0523a7c-16383f43-667957c8-21dc8046_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:30.532004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:30.532023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.532027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:30.532029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:30.532039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601187952558802:6585]
2025-10-10T14:33:30.532044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601187952558802:6585]
2025-10-10T14:33:30.532049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601187952558802:6585]
2025-10-10T14:33:30.532097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:30.532104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:30.532111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:30.532113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.532116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:30.532117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:30.532267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:30.534051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:30.598071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601188734780489:7749]
2025-10-10T14:33:30.598432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1000, pipe: [1:7559601188734780489:7749]
2025-10-10T14:33:30.648217Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:30.648549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.648565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.648608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780489:7749], now have 1 active actors on pipe
2025-10-10T14:33:30.648836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:30.648865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601188734780489:7749]
2025-10-10T14:33:30.648896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:30.648895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:30.648899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:30.648926Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:33:30.648963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1001 reason: error at write: Disconnected sessionId: src_id|e0523a7c-16383f43-667957c8-21dc8046_0
2025-10-10T14:33:30.649043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1001 sessionId: src_id|e0523a7c-16383f43-667957c8-21dc8046_0 is DEAD
2025-10-10T14:33:30.649058Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 10 consumer shared/user session shared/user_1_10_6118745172345690460_v1 is DEAD
2025-10-10T14:33:30.649153Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601120015271898:7744] disconnected; active server actors: 1
2025-10-10T14:33:30.649162Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601120015271898:7744] client user disconnected session shared/user_1_10_6118745172345690460_v1
2025-10-10T14:33:30.649366Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:33:30.649366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0523a7c-16383f43-667957c8-21dc8046_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:30.649390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0523a7c-16383f43-667957c8-21dc8046_0] Write session will restart in 0.007187s
2025-10-10T14:33:30.649416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0523a7c-16383f43-667957c8-21dc8046_0] Write session: Do CDS request
2025-10-10T14:33:30.649422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0523a7c-16383f43-667957c8-21dc8046_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:30.649522Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:33:30.649527Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:33:30.649533Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.008248s
2025-10-10T14:33:30.656528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:30.657818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0523a7c-16383f43-667957c8-21dc8046_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.657809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:30.657940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:30.657953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1002
2025-10-10T14:33:30.658022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:30.658036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:30.658048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:30.658111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:30.658097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.658130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:30.658136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:30.658140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:30.658153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601187952558890:6588]
2025-10-10T14:33:30.658593Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:33:30.658630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1002 sessionId:  describe result for acl check
2025-10-10T14:33:30.658669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:30.658675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:30.658678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:30.658683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601188734780538:5012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:30.658697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:30.658725Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:33:30.658740Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 11
2025-10-10T14:33:30.658883Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 11 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:33:30.658934Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:33:30.658972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:30.659016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:30.659018Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 auth for : user
2025-10-10T14:33:30.659109Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 Handle describe topics response
2025-10-10T14:33:30.659131Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 auth is DEAD
2025-10-10T14:33:30.659149Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:33:30.659244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601188734780538:5012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:30.659268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:30.659315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.659319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.659320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.659320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.659321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.659322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.659322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.659323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.659324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.659324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.659325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.659326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.659326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.659330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.659339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.659341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.659344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.659346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.659348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.659350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.659354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.659356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.659359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.659361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.659363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.659365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.659373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.659380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.659387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.659393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.659397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.659402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.659407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.659410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.659410Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:33:30.659414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.659417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.659419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.659423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.659426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.659429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.659433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.659438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.659444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.659449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.659453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.659459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.659463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.659468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.659472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.659477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.659480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.659484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.659500Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_11_13846048693422084033_v1
2025-10-10T14:33:30.659505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:30.659512Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601188734780546:5009] connected; active server actors: 1
2025-10-10T14:33:30.659528Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601188734780546:5009] session shared/user_1_11_13846048693422084033_v1
2025-10-10T14:33:30.659538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:33:30.659567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:33:30.659578Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_11_13846048693422084033_v1" (Sender=[1:7559601188734780539:5009], Pipe=[1:7559601188734780546:5009], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:33:30.659582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:33:30.659594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:33:30.659617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_11_13846048693422084033_v1" (Sender=[1:7559601188734780539:5009], Pipe=[1:7559601188734780546:5009], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:33:30.659631Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_11_13846048693422084033_v1" sender [1:7559601188734780539:5009] lock partition 0 for ReadingSession "shared/user_1_11_13846048693422084033_v1" (Sender=[1:7559601188734780539:5009], Pipe=[1:7559601188734780546:5009], Partitions=[], ActiveFamilyCount=1) generation 1 step 11
2025-10-10T14:33:30.659647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:33:30.659655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000045s
2025-10-10T14:33:30.659839Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 11 Session: "shared/user_1_11_13846048693422084033_v1" ClientId: "user" PipeClient { RawX1: 7559601188734780546 RawX2: 4503603922342801 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:33:30.659863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:33:30.661662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601188734780538:5012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:30.661766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:30.662099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:30.662112Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:30.662114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:30.662117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:30.662123Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1001 [2:7559601187952558890:6588]
2025-10-10T14:33:30.662134Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:30.662149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:30.662152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.662155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.662158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.662176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:30.662189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:30.662202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:30.662259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.662267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.662268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.662271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:30.662332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:30.662338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.662350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.662364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.662387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:30.662408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780493:2438], now have 1 active actors on pipe
2025-10-10T14:33:30.662411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780554:4999], now have 1 active actors on pipe
2025-10-10T14:33:30.662430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1001
2025-10-10T14:33:30.662418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601187952558885:6588]
2025-10-10T14:33:30.662448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1001, pipe: [1:7559601188734780554:4999]
2025-10-10T14:33:30.662427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601187952558885:6588]
2025-10-10T14:33:30.662429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601187952558885:6588]
2025-10-10T14:33:30.662447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:30.662461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:30.662473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:30.662477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:30.662478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:30.662480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:30.662480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:30.662515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.662525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.662538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_11_13846048693422084033_v1 on pipe: [1:7559601188734780554:4999]
2025-10-10T14:33:30.662560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601187952558885:6588]
2025-10-10T14:33:30.662571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:30.662581Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_11_13846048693422084033_v1:1 with generation 1001
2025-10-10T14:33:30.662591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:30.662593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.662597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.662600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:30.662618Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_11_13846048693422084033_v1
2025-10-10T14:33:30.662620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.662664Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:33:30.665740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:33:30.665767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:33:30.665776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.665779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.665782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.665788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:33:30.665801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:33:30.665934Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106810661 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:33:30.665951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:33:30.665988Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 sending to client partition status
2025-10-10T14:33:30.667779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601188734780538:5012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:30.667792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601188734780538:5012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:30.667796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601188734780538:5012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:30.667805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:30.668054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780583:5012], now have 1 active actors on pipe
2025-10-10T14:33:30.668093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1001
2025-10-10T14:33:30.668157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.668173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.668205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:30.668221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.668231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.668235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:30.668248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.668268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:30.668286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.668469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.668477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.668492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.668605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1002 partition: 0 MaxSeqNo: 40 sessionId: src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0
2025-10-10T14:33:30.668891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0523a7c-16383f43-667957c8-21dc8046_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:30.671573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0] Write session: try to update token
2025-10-10T14:33:30.671591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:30.681895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:30.681915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.681918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:30.681921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:30.681934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601187952558885:6588]
2025-10-10T14:33:30.681939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601187952558885:6588]
2025-10-10T14:33:30.681943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601187952558885:6588]
2025-10-10T14:33:30.681993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:30.681995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:30.682000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.682002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:30.682003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:30.682007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:30.682155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:30.686091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId: src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:30.688657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:30.795697Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:30.796004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.796022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.796300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_11_13846048693422084033_v1
2025-10-10T14:33:30.796320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:30.796299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:30.796325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:30.796330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:30.796354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601188734780554:4999]
2025-10-10T14:33:30.796349Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_11_13846048693422084033_v1
2025-10-10T14:33:30.796421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1002 reason: error at write: Disconnected sessionId: src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0
2025-10-10T14:33:30.796637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1002 sessionId: src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0 is DEAD
2025-10-10T14:33:30.796766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:30.796776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0] Write session will restart in 0.008905s
2025-10-10T14:33:30.796797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0] Write session: Do CDS request
2025-10-10T14:33:30.796802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:30.803935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:30.805197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:30.805403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:30.805415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:30.805429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:30.805493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:30.805541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601187952558976:6590]
2025-10-10T14:33:30.806165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:30.806486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:30.806536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:30.806793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:30.806851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.806858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.806871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.806859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.806860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.806862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.806865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.806866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.806867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.806868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.806869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.806870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.806871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.806873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.806879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.806892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.806896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.806900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.806904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.806908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.806912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.806916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.806920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.806924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.806928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.806932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.806936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.806945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.806936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:30.806953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.806950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1003
2025-10-10T14:33:30.806960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.806965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.806970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.806975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.806979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.806983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.806985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.806989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.806994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.806997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.807000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.807003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.807006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.807009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.807012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.807017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.807021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.807026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.807029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.807034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.807040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.807045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.807047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.807050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.807073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:30.807153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.807186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:30.807196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:30.807200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:30.807609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1003 sessionId:  describe result for acl check
2025-10-10T14:33:30.807642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:30.807643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:30.807645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:30.807651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601188734780638:5001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:30.808160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601188734780638:5001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:30.809370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:30.809683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:30.809693Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:30.809695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:30.809698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:30.809703Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1002 [2:7559601187952558976:6590]
2025-10-10T14:33:30.809711Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:30.809723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:30.809725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.809727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.809729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.809741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:30.809747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:30.809755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:30.809797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.809803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.809804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.809806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:30.809857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:30.809864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.809871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.809880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.809889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:30.809906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601187952558971:6590]
2025-10-10T14:33:30.809911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601187952558971:6590]
2025-10-10T14:33:30.809913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601187952558971:6590]
2025-10-10T14:33:30.809922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:30.809931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:30.809935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:30.809937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:30.809939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780588:2438], now have 1 active actors on pipe
2025-10-10T14:33:30.809948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:30.809964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:30.809972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:30.809993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601187952558971:6590]
2025-10-10T14:33:30.810005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:30.809990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1002
2025-10-10T14:33:30.810020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:30.810506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601188734780638:5001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:30.816865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601188734780638:5001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:30.816881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601188734780638:5001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:30.816886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601188734780638:5001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:30.816897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:30.817167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780672:5001], now have 1 active actors on pipe
2025-10-10T14:33:30.817202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1002
2025-10-10T14:33:30.817286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.817300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.817349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:30.817369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.817380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.817386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:30.817406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.817431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:30.817459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.817705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.817714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.817730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.817828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1003 partition: 0 MaxSeqNo: 40 sessionId: src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0
2025-10-10T14:33:30.818268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2506a0e-4f1e4975-43d9e16d-8b50d810_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:30.821097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0] Write session: try to update token
2025-10-10T14:33:30.821116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:30.821306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:30.821324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.821353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601187952558971:6590]
2025-10-10T14:33:30.821404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:30.821415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:30.821583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:30.821733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.821879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.822019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.822218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:30.822260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:30.836119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId: src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:30.838699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:30.839350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.839376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.839396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:30.839398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.839401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:30.839402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:30.839410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601187952558971:6590]
2025-10-10T14:33:30.839413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601187952558971:6590]
2025-10-10T14:33:30.839416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601187952558971:6590]
2025-10-10T14:33:30.839463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:30.839465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:30.839470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.839472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:30.839479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:30.839484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:30.839595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:30.896581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601188734780676:4999]
2025-10-10T14:33:30.896865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1002, pipe: [1:7559601188734780676:4999]
2025-10-10T14:33:30.950778Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:30.951264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:30.951300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780676:4999], now have 1 active actors on pipe
2025-10-10T14:33:30.951486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:30.951655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601188734780676:4999]
2025-10-10T14:33:30.951680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:30.960526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:30.962102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:30.962383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:30.962397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:30.962411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:30.962474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:30.962524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601187952559060:6592]
2025-10-10T14:33:30.963175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:30.963504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:30.963513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:30.963527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:30.963557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:30.963555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1003 reason: error at write: Disconnected sessionId: src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0
2025-10-10T14:33:30.963782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1003 sessionId: src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0 is DEAD
2025-10-10T14:33:30.963887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:30.963895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0] Write session will restart in 0.009023s
2025-10-10T14:33:30.963919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0] Write session: Do CDS request
2025-10-10T14:33:30.963925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:30.963934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:30.963999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.964008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.964009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.964010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.964012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.964013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.964014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.964015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.964017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.964018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.964019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.964020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.964022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.964028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.964042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.964047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.964051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.964055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.964059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.964065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.964069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.964073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.964079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.964083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.964087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.964091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.964099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.964108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:30.964114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.964120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:30.964124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.964130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:30.964135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.964141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:30.964147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.964158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:30.964162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.964172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:30.964181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.964187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:30.964196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.964203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:30.964211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.964216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:30.964221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.964226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:30.964245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.964254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.964258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.964268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.964278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.964287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.964344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:30.972009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:30.972523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:30.972542Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:30.972547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:30.972551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:30.972558Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1003 [2:7559601187952559060:6592]
2025-10-10T14:33:30.972572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:30.972592Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:30.972602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.972607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.972610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.972628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:30.972641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:30.972653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:30.972721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.972756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.972759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.972761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:30.972835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:30.972845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:30.972856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:30.972866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:30.972887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:30.972916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780680:2438], now have 1 active actors on pipe
2025-10-10T14:33:30.972929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601187952559055:6592]
2025-10-10T14:33:30.972931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601187952559055:6592]
2025-10-10T14:33:30.972933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601187952559055:6592]
2025-10-10T14:33:30.972947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:30.972960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:30.972964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:30.972965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:30.972967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:30.972981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:30.972985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:30.973025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601187952559055:6592]
2025-10-10T14:33:30.973040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:30.973046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:30.973307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1003
2025-10-10T14:33:30.977893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.977916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:30.977929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1004
2025-10-10T14:33:30.978119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:30.978158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:30.978172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:30.978181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:30.978640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1004 sessionId:  describe result for acl check
2025-10-10T14:33:30.978679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:30.978685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:30.978687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:30.978693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601188734780736:4992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:30.979272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601188734780736:4992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:30.982335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601188734780736:4992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:30.984280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:30.984296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:30.984303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601187952559055:6592]
2025-10-10T14:33:30.984342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:30.984400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:30.984501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:30.984641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.984767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.984900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:30.985086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:30.985126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:30.988149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601188734780736:4992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:30.988165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601188734780736:4992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:30.988169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601188734780736:4992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:30.988178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:30.988431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601188734780764:4992], now have 1 active actors on pipe
2025-10-10T14:33:30.988488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1003
2025-10-10T14:33:30.988593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.988608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.988648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:30.988670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:30.988680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:30.988683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:30.988714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:30.988739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:30.988765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.988964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:30.988972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:30.988987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:30.989063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1004 partition: 0 MaxSeqNo: 40 sessionId: src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0
2025-10-10T14:33:30.989498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a28c5fad-dc84f5a8-7501fe37-6e1f2f01_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:30.992116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0] Write session: try to update token
2025-10-10T14:33:30.992132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:31.002733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:31.002752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.002754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:31.002756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:31.002767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601187952559055:6592]
2025-10-10T14:33:31.002770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601187952559055:6592]
2025-10-10T14:33:31.002773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601187952559055:6592]
2025-10-10T14:33:31.002812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:31.002819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.002820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:31.002820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:31.002827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:31.002841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:31.002963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:31.007892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId: src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:31.010623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:31.051736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601193029748062:4999]
2025-10-10T14:33:31.052091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1003, pipe: [1:7559601193029748062:4999]
2025-10-10T14:33:31.119695Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:31.120069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.120086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.120109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748062:4999], now have 1 active actors on pipe
2025-10-10T14:33:31.120340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:31.120353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:31.120374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601193029748062:4999]
2025-10-10T14:33:31.120408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:31.120433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1004 reason: error at write: Disconnected sessionId: src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0
2025-10-10T14:33:31.120632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1004 sessionId: src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0 is DEAD
2025-10-10T14:33:31.120381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:31.120776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:31.120789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0] Write session will restart in 0.009615s
2025-10-10T14:33:31.120814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0] Write session: Do CDS request
2025-10-10T14:33:31.120824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:31.130784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:31.131936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.132138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:31.132153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1005
2025-10-10T14:33:31.132289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.132328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:31.132339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:31.132343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:31.132581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:31.132821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:31.132833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:31.132846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:31.132878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1005 sessionId:  describe result for acl check
2025-10-10T14:33:31.132912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:31.132923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:31.132931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:31.132933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:31.132940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601193029748113:4984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:31.133004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601192247526442:6594]
2025-10-10T14:33:31.133602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601193029748113:4984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:31.133670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:31.134363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:31.134424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:31.134786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:31.134850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.134858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.134859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.134860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.134864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.134865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.134867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.134868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.134870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.134871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.134873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.134874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.134875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.134883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.134895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.134899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.134904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.134908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.134913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.134917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.134921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.134925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.134930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.134935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.134939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.134943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.134951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.134960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.134967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.134973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.134980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.134986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.134991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.134997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.135003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.135010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.135015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.135020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.135025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.135031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.135035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.135041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.135046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.135051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.135056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.135061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.135074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.135079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.135084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.135090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.135094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.135100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.135146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:31.135805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601193029748113:4984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:31.137692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:31.138178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:31.138193Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:31.138196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:31.138200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:31.138206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1004 [2:7559601192247526442:6594]
2025-10-10T14:33:31.138221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:31.138240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:31.138273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.138281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.138284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.138302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:31.138313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:31.138320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:31.138381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.138388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.138390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.138392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:31.138415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601193029748113:4984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:31.138431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601193029748113:4984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:31.138435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601193029748113:4984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:31.138443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:31.138481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:31.138488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.138500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.138519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.138543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:31.138572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748064:2438], now have 1 active actors on pipe
2025-10-10T14:33:31.138584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601192247526436:6594]
2025-10-10T14:33:31.138591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601192247526436:6594]
2025-10-10T14:33:31.138593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601192247526436:6594]
2025-10-10T14:33:31.138584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1004
2025-10-10T14:33:31.138605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:31.138624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:31.138643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:31.138647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:31.138650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:31.138650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:31.138652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:31.138680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748146:4984], now have 1 active actors on pipe
2025-10-10T14:33:31.138694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601192247526436:6594]
2025-10-10T14:33:31.138708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:31.138714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:31.138750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1004
2025-10-10T14:33:31.138830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.138845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.138879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:31.138902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.138913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.138915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:31.138928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.138946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:31.138966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.139195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.139207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.139229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.139337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1005 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0
2025-10-10T14:33:31.139724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1efa0b82-238905df-f8b0ac5f-4ce5bef8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:31.142455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0] Write session: try to update token
2025-10-10T14:33:31.142473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:31.150398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:31.150415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.150426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601192247526436:6594]
2025-10-10T14:33:31.150471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:31.150485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:31.150664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:31.150813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.150967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.151111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.151303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:31.151349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:31.159354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId: src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:31.161967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:31.162201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.162225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.162282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:31.162367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:31.169975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:31.169997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.170001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:31.170003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:31.170014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601192247526436:6594]
2025-10-10T14:33:31.170018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601192247526436:6594]
2025-10-10T14:33:31.170022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601192247526436:6594]
2025-10-10T14:33:31.170292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:31.170312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.170314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:31.170481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:31.173388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:31.173406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:31.173410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:31.220669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601193029748167:4999]
2025-10-10T14:33:31.221128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1004, pipe: [1:7559601193029748167:4999]
2025-10-10T14:33:31.287783Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:31.296134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.296162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.296352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.296420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.296496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.296564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.296896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.296908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.296978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.297042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.297109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.297179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.297226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.297235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.297305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.297384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.297461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.297532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.297578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.297584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.297656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.297916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.297987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.298062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.298108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.298116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.298190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.298254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.298322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.298466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.298535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.298543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.298611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.298685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.298756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.298828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.298877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.298885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.298957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.299022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.299095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.299166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.299220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.299228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.299304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.299378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.299455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.299525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.299580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.299587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.299661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.299722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.299797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.299866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.299913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.299920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.299995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.300062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.300133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.300199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.300250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.300259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.300337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748167:4999], now have 1 active actors on pipe
2025-10-10T14:33:31.300619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601193029748167:4999]
2025-10-10T14:33:31.300640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:31.300658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:31.300661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:31.300692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1005 reason: error at write: Disconnected sessionId: src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0
2025-10-10T14:33:31.300891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1005 sessionId: src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0 is DEAD
2025-10-10T14:33:31.300924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:31.301043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:31.301066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0] Write session will restart in 0.008372s
2025-10-10T14:33:31.301089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0] Write session: Do CDS request
2025-10-10T14:33:31.301095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:31.310582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:31.310899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.311037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:31.311053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1006
2025-10-10T14:33:31.311189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.311226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:31.311236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:31.311240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:31.312002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:31.312226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1006 sessionId:  describe result for acl check
2025-10-10T14:33:31.312230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:31.312244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:31.312267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:31.312258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:31.312270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:31.312272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:31.312278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601193029748232:4968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:31.312319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:31.312373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601192247526566:6609]
2025-10-10T14:33:31.312858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601193029748232:4968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:31.312948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:31.313264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:31.313324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:31.313718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:31.313781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.313788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.313790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.313791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.313793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.313794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.313795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.313796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.313798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.313799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.313801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.313802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.313805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.313812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.313824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.313828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.313833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.313837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.313841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.313845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.313849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.313853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.313858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.313862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.313874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.313877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.313885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.313895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.313906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.313911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.313914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.313918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.313922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.313926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.313930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.313935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.313939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.313945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.313950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.313956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.313960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.313965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.313970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.313976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.313980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.313986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.313990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.313995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.313999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.314004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.314024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.314030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.314083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:31.315424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601193029748232:4968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:31.316484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:31.317005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:31.317019Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:31.317021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:31.317025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:31.317031Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1005 [2:7559601192247526566:6609]
2025-10-10T14:33:31.317045Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:31.317069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:31.317073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.317077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.317079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.317099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:31.317112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:31.317120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:31.317180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.317188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.317190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.317193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:31.317272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:31.317282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.317294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.317304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.317320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:31.317357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748182:2438], now have 1 active actors on pipe
2025-10-10T14:33:31.317371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601192247526561:6609]
2025-10-10T14:33:31.317373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601192247526561:6609]
2025-10-10T14:33:31.317375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601192247526561:6609]
2025-10-10T14:33:31.317388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:31.317401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:31.317406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:31.317411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:31.317414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:31.317423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:31.317427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:31.317409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1005
2025-10-10T14:33:31.317455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601192247526561:6609]
2025-10-10T14:33:31.317464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:31.317466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:31.319025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601193029748232:4968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:31.319046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601193029748232:4968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:31.319050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601193029748232:4968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:31.319058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:31.319299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748270:4968], now have 1 active actors on pipe
2025-10-10T14:33:31.319366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1005
2025-10-10T14:33:31.319441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.319454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.319490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:31.319507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.319528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.319535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:31.319551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.319572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:31.319603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.319765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.319775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.319790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.319882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1006 partition: 0 MaxSeqNo: 40 sessionId: src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0
2025-10-10T14:33:31.320307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d06dd90-9fc6a39-147d03bf-3e96c6df_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:31.323053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0] Write session: try to update token
2025-10-10T14:33:31.323072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:31.335606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:31.335632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.335644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601192247526561:6609]
2025-10-10T14:33:31.335705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:31.335717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:31.335912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:31.336069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.336219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.336377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.336604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:31.336652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:31.338580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId: src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:31.341240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:31.341475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.341510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.341565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:31.341682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:31.347575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:31.347599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.347603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:31.347609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:31.347620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601192247526561:6609]
2025-10-10T14:33:31.347628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601192247526561:6609]
2025-10-10T14:33:31.347632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601192247526561:6609]
2025-10-10T14:33:31.347674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:31.347682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:31.347689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:31.347690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.347692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:31.347696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:31.347922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:31.400915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601193029748287:4999]
2025-10-10T14:33:31.401231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1005, pipe: [1:7559601193029748287:4999]
2025-10-10T14:33:31.460072Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:31.467985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.468018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.468183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.468248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.468318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.468380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.468424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.468432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.468510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.468575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.468639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.468709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.468761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.468769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.468834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.468891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.468960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.469027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.469073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.469081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.469146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.469206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.469267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.469354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.469400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.469406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.469473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.469538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.469603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.469669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.469711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.469721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.469793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.469856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.469916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.469985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.470040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.470059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.470131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.470199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.470270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.470336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.470379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.470390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.470461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.470519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.470591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.470658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.470705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.470713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.470784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.470844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.470909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.470983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.471028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.471035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.471106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.471168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.471233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.471297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.471338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.471343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.471395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748287:4999], now have 1 active actors on pipe
2025-10-10T14:33:31.471738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:31.471752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:31.471785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1006 reason: error at write: Disconnected sessionId: src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0
2025-10-10T14:33:31.472025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1006 sessionId: src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0 is DEAD
2025-10-10T14:33:31.472114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601193029748287:4999]
2025-10-10T14:33:31.472150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:31.472197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:31.472207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0] Write session will restart in 0.007402s
2025-10-10T14:33:31.472226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0] Write session: Do CDS request
2025-10-10T14:33:31.472231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:31.472411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:31.479748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:31.480902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.480992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:31.481006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1007
2025-10-10T14:33:31.481015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:31.481191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.481207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:31.481217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:31.481230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:31.481229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:31.481243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:31.481246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:31.481281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:31.481342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601192247526667:6612]
2025-10-10T14:33:31.481678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1007 sessionId:  describe result for acl check
2025-10-10T14:33:31.481712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:31.481718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:31.481720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:31.481725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601193029748339:4962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:31.481997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:31.482275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601193029748339:4962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:31.482335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:31.482384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:31.482745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:31.482813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.482820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.482821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.482823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.482824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.482825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.482827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.482828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.482829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.482830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.482832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.482833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.482834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.482840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.482852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.482857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.482862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.482866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.482871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.482875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.482879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.482883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.482887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.482891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.482895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.482899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.482907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.482915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.482921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.482926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.482931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.482936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.482940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.482945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.482950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.482955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.482960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.482965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.482970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.482975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.482980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.482985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.482990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.482995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.483000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.483006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.483011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.483023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.483027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.483033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.483037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.483042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.483090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:31.484574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601193029748339:4962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:31.485442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:31.485766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:31.485780Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:31.485782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:31.485786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:31.485792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1006 [2:7559601192247526667:6612]
2025-10-10T14:33:31.485803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:31.485820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:31.485824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.485827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.485829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.485844Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:31.485851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:31.485858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:31.485920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.485927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.485929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.485934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:31.485998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:31.486008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.486019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.486030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.486046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:31.486084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748288:2438], now have 1 active actors on pipe
2025-10-10T14:33:31.486096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601192247526662:6612]
2025-10-10T14:33:31.486103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601192247526662:6612]
2025-10-10T14:33:31.486105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601192247526662:6612]
2025-10-10T14:33:31.486118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:31.486130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:31.486136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:31.486141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:31.486138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1006
2025-10-10T14:33:31.486143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:31.486152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:31.486155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:31.486176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601192247526662:6612]
2025-10-10T14:33:31.486180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:31.486184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:31.490678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601193029748339:4962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:31.490695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601193029748339:4962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:31.490699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601193029748339:4962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:31.490708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:31.490960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748376:4962], now have 1 active actors on pipe
2025-10-10T14:33:31.491003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1006
2025-10-10T14:33:31.491160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.491175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.491208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:31.491226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.491236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.491240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:31.491253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.491272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:31.491296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.491588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.491610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.491639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.491787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1007 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0
2025-10-10T14:33:31.492232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b4586-b4bce2f0-78b8d9e5-41edc9ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:31.495016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0] Write session: try to update token
2025-10-10T14:33:31.495036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:31.498167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:31.498188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.498198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601192247526662:6612]
2025-10-10T14:33:31.498256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:31.498265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:31.498437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:31.498579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.498719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.498861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.499054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:31.499096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:31.510363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId: src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:31.513093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:31.513366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.513391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.513444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:31.513552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:31.516777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:31.516802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.516809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:31.516811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:31.516825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601192247526662:6612]
2025-10-10T14:33:31.516831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601192247526662:6612]
2025-10-10T14:33:31.516834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601192247526662:6612]
2025-10-10T14:33:31.516884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:31.516886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:31.516895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.516897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:31.516902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:31.516907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:31.517043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:31.572440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601193029748380:4999]
2025-10-10T14:33:31.572739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1006, pipe: [1:7559601193029748380:4999]
2025-10-10T14:33:31.632849Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:31.649926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.649959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.650166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.650244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.650313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.650387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.650436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.650446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.650519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.650590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.650666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.650738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.650792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.650801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.650880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.650955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.651028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.651097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.651147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.651154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.651233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.651304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.651387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.651463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.651515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.651528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.651607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.651677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.651755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.651828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.651877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.651884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.651964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.652033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.652104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.652176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.652224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.652232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.652302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.652370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.652442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.652516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.652566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.652575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.652649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.652720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.652794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.652866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.652916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.652924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.652995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.653068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.653137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.653213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.653262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.653270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.653366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.653438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.653507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.653578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.653629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.653637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.653711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748380:4999], now have 1 active actors on pipe
2025-10-10T14:33:31.653939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:31.653949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601193029748380:4999]
2025-10-10T14:33:31.653981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:31.653984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:31.654013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1007 reason: error at write: Disconnected sessionId: src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0
2025-10-10T14:33:31.654261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1007 sessionId: src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0 is DEAD
2025-10-10T14:33:31.654394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:31.654404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0] Write session will restart in 0.007256s
2025-10-10T14:33:31.654429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0] Write session: Do CDS request
2025-10-10T14:33:31.654436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:31.654930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:31.662915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.663016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:31.663031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1008
2025-10-10T14:33:31.663186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:31.663192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.663232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:31.663238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:31.663243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:31.663697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1008 sessionId:  describe result for acl check
2025-10-10T14:33:31.663739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:31.663746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:31.663748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:31.663755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601193029748443:4950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:31.664341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601193029748443:4950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:31.664808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:31.665038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:31.665050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:31.665063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:31.665120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:31.665165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601192247526758:6615]
2025-10-10T14:33:31.665725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:31.665984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:31.666029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:31.666369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:31.666437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.666443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.666444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.666446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.666447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.666448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.666449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.666451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.666452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.666453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.666454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.666456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.666457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.666463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.666476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.666481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.666485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.666489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.666493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.666496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.666499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.666503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.666507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.666510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.666513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.666517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.666526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.666535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.666541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.666547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.666551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.666557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.666561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.666573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.666578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.666583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.666588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.666593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.666598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.666604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.666608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.666613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.666618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.666624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.666628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.666643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.666651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.666655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.666659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.666664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.666668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.666678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.666713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:31.666826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601193029748443:4950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:31.669134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:31.669564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:31.669581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:31.669584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:31.669588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:31.669596Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1007 [2:7559601192247526758:6615]
2025-10-10T14:33:31.669609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:31.669630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:31.669638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.669642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.669644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.669665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:31.669677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:31.669684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:31.669751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.669758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.669760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.669762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:31.669834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:31.669842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.669854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.669871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.669893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:31.669919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748392:2438], now have 1 active actors on pipe
2025-10-10T14:33:31.669932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601192247526753:6615]
2025-10-10T14:33:31.669938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601192247526753:6615]
2025-10-10T14:33:31.669940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601192247526753:6615]
2025-10-10T14:33:31.669954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:31.669968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:31.669971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:31.669973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:31.669975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:31.669992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:31.670000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:31.670011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1007
2025-10-10T14:33:31.670029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601192247526753:6615]
2025-10-10T14:33:31.670014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601193029748443:4950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:31.670022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601193029748443:4950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:31.670026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601193029748443:4950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:31.670039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:31.670035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:31.670082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:31.670307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748476:4950], now have 1 active actors on pipe
2025-10-10T14:33:31.670365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1007
2025-10-10T14:33:31.670394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.670406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.670438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:31.670453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.670457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.670459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:31.670472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.670485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:31.670501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.670667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.670676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.670691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.670780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1008 partition: 0 MaxSeqNo: 40 sessionId: src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0
2025-10-10T14:33:31.671185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef2cf557-f6b7a74f-881dfa6e-19dd4711_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:31.673790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0] Write session: try to update token
2025-10-10T14:33:31.673806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:31.687273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:31.687295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.687309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601192247526753:6615]
2025-10-10T14:33:31.687364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:31.687375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:31.687550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:31.687700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.687846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.687988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.688196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:31.688243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:31.688585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId: src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:31.696293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:31.696533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.696557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.696601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:31.696732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:31.705235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:31.705260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.705264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:31.705269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:31.705281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601192247526753:6615]
2025-10-10T14:33:31.705284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601192247526753:6615]
2025-10-10T14:33:31.705288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601192247526753:6615]
2025-10-10T14:33:31.705360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:31.705362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:31.705371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.705373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:31.705377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:31.705381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:31.705510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:31.754186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601193029748485:4999]
2025-10-10T14:33:31.754525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1007, pipe: [1:7559601193029748485:4999]
2025-10-10T14:33:31.823222Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:31.831652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.831688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.831889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.831962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.832035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.832110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.832158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.832168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.832238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.832312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.832384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.832457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.832511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.832514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.832584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.832696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.832767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.832836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.832883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.832891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.832961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.833032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.833098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.833173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.833217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.833224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.833297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.833381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.833452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.833518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.833569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.833577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.833648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.833712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.833776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.833843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.833886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.833894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.833967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.834030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.834113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.834188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.834238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.834247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.834317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.834386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.834457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.834535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.834585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.834593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.834672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.834740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.834811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.834882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.834932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.834940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.835015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:31.835082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:31.835156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:31.835228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:31.835283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:31.835291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:31.835362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748485:4999], now have 1 active actors on pipe
2025-10-10T14:33:31.835595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601193029748485:4999]
2025-10-10T14:33:31.835626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:31.836023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:31.836036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:31.836090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1008 reason: error at write: Disconnected sessionId: src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0
2025-10-10T14:33:31.836327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1008 sessionId: src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0 is DEAD
2025-10-10T14:33:31.836474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:31.836486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0] Write session will restart in 0.008279s
2025-10-10T14:33:31.836517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0] Write session: Do CDS request
2025-10-10T14:33:31.836523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:31.836589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:31.844457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:31.845862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:31.845941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.846008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:31.846025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1009
2025-10-10T14:33:31.846081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:31.846096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:31.846108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:31.846163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:31.846180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:31.846210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601192247526849:6617]
2025-10-10T14:33:31.846212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:31.846219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:31.846223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:31.846617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1009 sessionId:  describe result for acl check
2025-10-10T14:33:31.846656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:31.846661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:31.846663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:31.846670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601193029748539:4947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:31.846809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:31.847099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:31.847146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:31.847244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601193029748539:4947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:31.847496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:31.847564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.847571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.847572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.847573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.847574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.847576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.847577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.847578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.847579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.847580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.847581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.847583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.847584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.847590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.847605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.847609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.847613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.847616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.847620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.847624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.847627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.847630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.847634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.847637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.847640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.847643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.847650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.847658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:31.847664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.847669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:31.847674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.847679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:31.847689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.847694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:31.847705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.847711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:31.847715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.847720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:31.847724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.847729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:31.847734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.847740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:31.847744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.847750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:31.847754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.847760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:31.847764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.847770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.847774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.847779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.847789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.847794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.847833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:31.849771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601193029748539:4947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:31.850327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:31.850652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:31.850665Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:31.850668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:31.850672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:31.850677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1008 [2:7559601192247526849:6617]
2025-10-10T14:33:31.850689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:31.850708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:31.850711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.850715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.850718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.850736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:31.850749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:31.850761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:31.850821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.850829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.850833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.850835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:31.850901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:31.850910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.850920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:31.850929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:31.850950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:31.850978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748487:2438], now have 1 active actors on pipe
2025-10-10T14:33:31.850986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601192247526844:6617]
2025-10-10T14:33:31.850990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601192247526844:6617]
2025-10-10T14:33:31.850992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601192247526844:6617]
2025-10-10T14:33:31.851010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1008
2025-10-10T14:33:31.851010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:31.851042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:31.851057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:31.851060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:31.851084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601192247526844:6617]
2025-10-10T14:33:31.851087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:31.851096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:31.851100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:31.851102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:31.851109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:31.856143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601193029748539:4947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:31.856159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601193029748539:4947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:31.856164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601193029748539:4947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:31.856173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:31.856430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748577:4947], now have 1 active actors on pipe
2025-10-10T14:33:31.856484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1008
2025-10-10T14:33:31.856577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.856599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.856633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:31.856645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:31.856656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:31.856660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:31.856674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:31.856695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:31.856719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.856932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.856940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.856964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:31.857061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1009 partition: 0 MaxSeqNo: 40 sessionId: src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0
2025-10-10T14:33:31.857438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a0758ae-46df7ef3-154a2572-eafbd4c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:31.860338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0] Write session: try to update token
2025-10-10T14:33:31.860359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:31.862626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:31.862648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.862659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601192247526844:6617]
2025-10-10T14:33:31.862701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:31.862715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:31.862914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:31.863077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.863237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.863388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:31.863592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:31.863646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:31.875227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId: src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:31.877939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:31.878249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:31.878279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:31.878353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:31.878488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:31.882061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:31.882077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:31.882080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:31.882084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:31.882095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601192247526844:6617]
2025-10-10T14:33:31.882099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601192247526844:6617]
2025-10-10T14:33:31.882106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601192247526844:6617]
2025-10-10T14:33:31.882156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:31.882155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:31.882162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:31.882169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:31.882169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:31.882173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:31.882701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:31.935977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601193029748581:4999]
2025-10-10T14:33:31.936280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1008, pipe: [1:7559601193029748581:4999]
2025-10-10T14:33:31.995005Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:32.002469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.002497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.002650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.002709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.002778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.002839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.003142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.003152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.003217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.003275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.003334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.003399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.003522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.003531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.003735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.003800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.004012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.004222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.004340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.004346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.004557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.004776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.004839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.005091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.005226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.005233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.005487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.005553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.005612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.005679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.005731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.005738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.005805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.006060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.006296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.006542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.006590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.006598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.006842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.006903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.006972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.007039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.007082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.007092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.007158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.007408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.007671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.007734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.007862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.007870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.007934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.008180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.008431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.008679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.008807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.008815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.009058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:32.009118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:32.009180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:32.009243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:32.009289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:32.009296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:32.009371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601193029748581:4999], now have 1 active actors on pipe
2025-10-10T14:33:32.009607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:32.009620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601193029748581:4999]
2025-10-10T14:33:32.009653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:32.009656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:32.009692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1009 reason: error at write: Disconnected sessionId: src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0
2025-10-10T14:33:32.009888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1009 sessionId: src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0 is DEAD
2025-10-10T14:33:32.010067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:32.010077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0] Write session will restart in 0.005899s
2025-10-10T14:33:32.010107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0] Write session: Do CDS request
2025-10-10T14:33:32.010113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:32.010141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:32.016844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.016955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:32.016969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1010
2025-10-10T14:33:32.017355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.017391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:32.017407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:32.017414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:32.017832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1010 sessionId:  describe result for acl check
2025-10-10T14:33:32.017883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:32.017885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:32.017887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:32.017893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601197324715930:4942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:32.018268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:32.018442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601197324715930:4942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:32.020431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:32.020623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:32.020638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:32.020651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:32.020714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:32.020757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601196542494236:6619]
2025-10-10T14:33:32.021056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601197324715930:4942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:32.021359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:32.021656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:32.021705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:32.022047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:32.022106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.022112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.022113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.022114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.022115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.022117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.022118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.022120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.022121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.022122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.022123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.022124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.022126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.022131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.022144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.022148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.022152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.022160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.022165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.022172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.022176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.022180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.022194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.022202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.022205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.022208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.022221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.022234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.022241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.022251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.022256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.022265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.022269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.022274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.022283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.022289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.022293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.022298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.022303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.022307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.022317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.022325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.022333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.022338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.022346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.022350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.022359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.022369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.022373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.022378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.022385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.022394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.022435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:32.024648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601197324715930:4942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:32.024662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601197324715930:4942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:32.024665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601197324715930:4942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:32.024674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:32.024679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:32.025087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:32.025101Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:32.025104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:32.025107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:32.025112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1009 [2:7559601196542494236:6619]
2025-10-10T14:33:32.025123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:32.025140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:32.025147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.025150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.025152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.025167Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:32.025180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:32.025187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:32.025239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.025245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.025247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.025249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:32.025323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:32.025347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.025356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.025369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.025386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:32.025411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324715878:2438], now have 1 active actors on pipe
2025-10-10T14:33:32.025418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324715966:4942], now have 1 active actors on pipe
2025-10-10T14:33:32.025426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601196542494231:6619]
2025-10-10T14:33:32.025428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601196542494231:6619]
2025-10-10T14:33:32.025431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601196542494231:6619]
2025-10-10T14:33:32.025444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:32.025461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:32.025470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:32.025473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:32.025457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1009
2025-10-10T14:33:32.025475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:32.025479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:32.025467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1009
2025-10-10T14:33:32.025482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:32.025501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601196542494231:6619]
2025-10-10T14:33:32.025507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:32.025510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:32.025523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.025531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.025580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e7cf155-312f294-a7a65b45-88082737_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:32.025595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.025598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.025601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:32.025611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.025621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:32.025643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.025767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.025775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.025790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.025896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1010 partition: 0 MaxSeqNo: 40 sessionId: src_id|6e7cf155-312f294-a7a65b45-88082737_0
2025-10-10T14:33:32.026273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25dc11d8-7c67be4-f5d6556-728f28eb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6e7cf155-312f294-a7a65b45-88082737_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:32.028849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cf155-312f294-a7a65b45-88082737_0] Write session: try to update token
2025-10-10T14:33:32.028866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cf155-312f294-a7a65b45-88082737_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:32.044684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:32.044704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.044708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:32.044710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:32.044721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601196542494231:6619]
2025-10-10T14:33:32.044725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601196542494231:6619]
2025-10-10T14:33:32.044729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601196542494231:6619]
2025-10-10T14:33:32.044781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:32.044797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.044798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:32.044800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:32.044804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:32.044809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:32.045042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:32.048535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId: src_id|6e7cf155-312f294-a7a65b45-88082737_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:32.051532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:32.110047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601197324715974:4999]
2025-10-10T14:33:32.110437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1009, pipe: [1:7559601197324715974:4999]
2025-10-10T14:33:32.156825Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:32.157242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.157263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.157311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324715974:4999], now have 1 active actors on pipe
2025-10-10T14:33:32.157580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:32.157595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:32.157667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1010 reason: error at write: Disconnected sessionId: src_id|6e7cf155-312f294-a7a65b45-88082737_0
2025-10-10T14:33:32.157734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601197324715974:4999]
2025-10-10T14:33:32.157767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:32.157836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:32.157889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1010 sessionId: src_id|6e7cf155-312f294-a7a65b45-88082737_0 is DEAD
2025-10-10T14:33:32.158077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cf155-312f294-a7a65b45-88082737_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:32.158089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cf155-312f294-a7a65b45-88082737_0] Write session will restart in 0.005544s
2025-10-10T14:33:32.158115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cf155-312f294-a7a65b45-88082737_0] Write session: Do CDS request
2025-10-10T14:33:32.158124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cf155-312f294-a7a65b45-88082737_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:32.164861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cf155-312f294-a7a65b45-88082737_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.164964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:32.164981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1011
2025-10-10T14:33:32.165103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.165139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:32.165149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:32.165153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:32.165662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1011 sessionId:  describe result for acl check
2025-10-10T14:33:32.165700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:32.165707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:32.165709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:32.165715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601197324716026:4931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:32.166337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601197324716026:4931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:32.166857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:32.168515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601197324716026:4931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:32.168722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:32.168944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:32.168956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:32.168969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:32.169041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:32.169084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601196542494328:6621]
2025-10-10T14:33:32.169677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:32.169982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:32.170041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:32.170368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:32.170436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.170446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.170447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.170448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.170450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.170451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.170452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.170453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.170454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.170455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.170456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.170460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.170461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.170466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.170480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.170484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.170488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.170492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.170496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.170500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.170503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.170507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.170511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.170515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.170518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.170522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.170529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.170537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.170545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.170550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.170556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.170561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.170566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.170570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.170575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.170579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.170585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.170591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.170595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.170601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.170607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.170617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.170623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.170628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.170638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.170643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.170648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.170653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.170662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.170667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.170672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.170676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.170715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:32.171465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601197324716026:4931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:32.171492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601197324716026:4931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:32.171496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601197324716026:4931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:32.171505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:32.173352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:32.173764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:32.173778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:32.173781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:32.173786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:32.173792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1010 [2:7559601196542494328:6621]
2025-10-10T14:33:32.173805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:32.173824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:32.173833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.173837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.173840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.173857Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:32.173865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:32.173872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:32.173945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.173951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.173953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.173956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:32.174033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:32.174041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.174053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.174069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.174092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:32.174119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324715975:2438], now have 1 active actors on pipe
2025-10-10T14:33:32.174127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716063:4931], now have 1 active actors on pipe
2025-10-10T14:33:32.174135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601196542494322:6621]
2025-10-10T14:33:32.174137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601196542494322:6621]
2025-10-10T14:33:32.174139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601196542494322:6621]
2025-10-10T14:33:32.174152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:32.174165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:32.174168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:32.174171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:32.174174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:32.174191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:32.174199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:32.174183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1010
2025-10-10T14:33:32.174187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1010
2025-10-10T14:33:32.174233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601196542494322:6621]
2025-10-10T14:33:32.174244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:32.174252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:32.174280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.174290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.174327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:32.174345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.174350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.174355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:32.174366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.174377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:32.174399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.174533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.174542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.174559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.174653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1011 partition: 0 MaxSeqNo: 40 sessionId: src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0
2025-10-10T14:33:32.175057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cf155-312f294-a7a65b45-88082737_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:32.177839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0] Write session: try to update token
2025-10-10T14:33:32.177861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:32.193581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId: src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:32.193995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:32.194016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.194033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:32.194035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:32.194045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601196542494322:6621]
2025-10-10T14:33:32.194050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601196542494322:6621]
2025-10-10T14:33:32.194054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601196542494322:6621]
2025-10-10T14:33:32.194107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:32.194107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:32.194113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:32.194116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.194118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:32.194119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:32.194267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:32.196167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:32.258040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601197324716084:4999]
2025-10-10T14:33:32.258348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1010, pipe: [1:7559601197324716084:4999]
2025-10-10T14:33:32.307517Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:32.307951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.307968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.308018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716084:4999], now have 1 active actors on pipe
2025-10-10T14:33:32.308245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:32.308286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:32.308307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601197324716084:4999]
2025-10-10T14:33:32.308332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:32.308510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1011 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0
2025-10-10T14:33:32.308709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1011 sessionId: src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0 is DEAD
2025-10-10T14:33:32.308880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:32.308891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0] Write session will restart in 0.009777s
2025-10-10T14:33:32.308916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0] Write session: Do CDS request
2025-10-10T14:33:32.308922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:32.317192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:32.318595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:32.318778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:32.318787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:32.318796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:32.318836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:32.318883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601196542494458:6636]
2025-10-10T14:33:32.319290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:32.319556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:32.319599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:32.319811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:32.319850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.319885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.319857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.319858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.319858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.319859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.319860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.319861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.319861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.319862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.319863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.319863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.319864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.319865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.319869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.319892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.319896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.319899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.319902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.319906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.319909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.319912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.319916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.319923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.319927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.319931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.319934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.319943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.319951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.319955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.319983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:32.319959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.319998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1012
2025-10-10T14:33:32.319961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.319965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.319967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.319970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.319973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.319977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.319980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.319983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.319985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.319989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.319991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.319994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.319997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.320000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.320004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.320007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.320009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.320013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.320015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.320018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.320021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.320024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.320047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:32.320154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.320185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:32.320195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:32.320199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:32.320609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1012 sessionId:  describe result for acl check
2025-10-10T14:33:32.320643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:32.320645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:32.320646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:32.320652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601197324716156:4910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:32.321186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601197324716156:4910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:32.322452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:32.322852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:32.322866Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:32.322869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:32.322872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:32.322878Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1011 [2:7559601196542494458:6636]
2025-10-10T14:33:32.322891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:32.322912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:32.322923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.322926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.322929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.322962Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:32.322973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:32.322981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:32.323042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.323052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.323054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.323057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:32.323125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:32.323132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.323143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.323158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.323179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:32.323206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716096:2438], now have 1 active actors on pipe
2025-10-10T14:33:32.323219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601196542494453:6636]
2025-10-10T14:33:32.323221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601196542494453:6636]
2025-10-10T14:33:32.323223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601196542494453:6636]
2025-10-10T14:33:32.323236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:32.323229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1011
2025-10-10T14:33:32.323251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:32.323274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:32.323280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:32.323282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:32.323285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:32.323287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:32.323310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601196542494453:6636]
2025-10-10T14:33:32.323324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:32.323361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:32.323399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601197324716156:4910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:32.327758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601197324716156:4910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:32.327771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601197324716156:4910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:32.327775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601197324716156:4910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:32.327784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:32.327989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716189:4910], now have 1 active actors on pipe
2025-10-10T14:33:32.328041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1011
2025-10-10T14:33:32.328098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.328110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.328137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:32.328155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.328167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.328176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:32.328187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.328206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:32.328225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.328401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.328413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.328437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.328538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1012 partition: 0 MaxSeqNo: 40 sessionId: src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0
2025-10-10T14:33:32.328929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8931f8-61d116ad-82d8e5ea-d4e1ee85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:32.331540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0] Write session: try to update token
2025-10-10T14:33:32.331561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:32.343083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:32.343105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.343109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:32.343111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:32.343123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601196542494453:6636]
2025-10-10T14:33:32.343128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601196542494453:6636]
2025-10-10T14:33:32.343138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601196542494453:6636]
2025-10-10T14:33:32.343189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:32.343193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:32.343199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:32.343201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.343203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:32.343204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:32.343363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:32.347203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId: src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:32.349916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:32.408539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601197324716205:4999]
2025-10-10T14:33:32.408914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1011, pipe: [1:7559601197324716205:4999]
2025-10-10T14:33:32.454907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:32.455241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.455256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.455318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716205:4999], now have 1 active actors on pipe
2025-10-10T14:33:32.455566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:32.455566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:32.455578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:32.455629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601197324716205:4999]
2025-10-10T14:33:32.455650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1012 reason: error at write: Disconnected sessionId: src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0
2025-10-10T14:33:32.455927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:32.456026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:32.456037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0] Write session will restart in 0.009317s
2025-10-10T14:33:32.456073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0] Write session: Do CDS request
2025-10-10T14:33:32.456079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:32.456094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1012 sessionId: src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0 is DEAD
2025-10-10T14:33:32.464678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:32.466129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:32.466328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:32.466341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:32.466354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:32.466406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:32.466451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601196542494564:6639]
2025-10-10T14:33:32.466931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.467006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:32.467019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1013
2025-10-10T14:33:32.467049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:32.467146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.467196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:32.467205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:32.467209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:32.467369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:32.467415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:32.467649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1013 sessionId:  describe result for acl check
2025-10-10T14:33:32.467687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:32.467693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:32.467695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:32.467713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601197324716265:4899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:32.467739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:32.467800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.467807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.467808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.467809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.467811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.467811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.467812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.467813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.467814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.467815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.467816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.467817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.467818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.467825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.467838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.467842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.467846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.467850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.467855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.467859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.467864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.467868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.467873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.467877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.467881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.467885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.467892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.467901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.467908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.467915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.467921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.467926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.467930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.467937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.467944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.467949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.467958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.467964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.467968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.467974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.467978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.467983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.467987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.467993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.467997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.468002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.468006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.468012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.468016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.468022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.468031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.468036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.468084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:32.468286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601197324716265:4899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:32.470415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:32.470661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601197324716265:4899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:32.470754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:32.470771Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:32.470774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:32.470778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:32.470784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1012 [2:7559601196542494564:6639]
2025-10-10T14:33:32.470798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:32.470815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:32.470820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.470832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.470834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.470853Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:32.470861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:32.470874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:32.470941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.470947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.470948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.470950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:32.471011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:32.471020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.471032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.471045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.471062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:32.471089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716206:2438], now have 1 active actors on pipe
2025-10-10T14:33:32.471103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601196542494559:6639]
2025-10-10T14:33:32.471109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601196542494559:6639]
2025-10-10T14:33:32.471111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601196542494559:6639]
2025-10-10T14:33:32.471125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:32.471140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:32.471140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1012
2025-10-10T14:33:32.471162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:32.471162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:32.471165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:32.471168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:32.471169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:32.471192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601196542494559:6639]
2025-10-10T14:33:32.471195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:32.471197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:32.476227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601197324716265:4899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:32.476241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601197324716265:4899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:32.476244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601197324716265:4899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:32.476254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:32.476526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716300:4899], now have 1 active actors on pipe
2025-10-10T14:33:32.476744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1012
2025-10-10T14:33:32.476816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.476842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.476879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:32.476907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.476917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.476920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:32.476934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.476953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:32.476983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.477214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.477227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.477252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.477346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1013 partition: 0 MaxSeqNo: 40 sessionId: src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0
2025-10-10T14:33:32.477750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a5596f-ecb2f9c3-a66121cc-d825e669_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:32.480687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0] Write session: try to update token
2025-10-10T14:33:32.480707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:32.482656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:32.482680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.482691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601196542494559:6639]
2025-10-10T14:33:32.482730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:32.482741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:32.482921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:32.483069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:32.483206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:32.483385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:32.483645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:32.483692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:32.497193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId: src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:32.499946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:32.501211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.501243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.501271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:32.501281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.501285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:32.501287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:32.501296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601196542494559:6639]
2025-10-10T14:33:32.501302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601196542494559:6639]
2025-10-10T14:33:32.501306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601196542494559:6639]
2025-10-10T14:33:32.501366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:32.501382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:32.501386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:32.501387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:32.501395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.501397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:32.501529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:32.555986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601197324716304:4999]
2025-10-10T14:33:32.556276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1012, pipe: [1:7559601197324716304:4999]
2025-10-10T14:33:32.617973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:32.618329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:32.618373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716304:4999], now have 1 active actors on pipe
2025-10-10T14:33:32.618485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:32.618557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601197324716304:4999]
2025-10-10T14:33:32.618589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:32.618590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:32.618598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:32.618677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1013 reason: error at write: Disconnected sessionId: src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0
2025-10-10T14:33:32.618861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1013 sessionId: src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0 is DEAD
2025-10-10T14:33:32.619012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:32.619025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0] Write session will restart in 0.005614s
2025-10-10T14:33:32.619053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0] Write session: Do CDS request
2025-10-10T14:33:32.619058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:32.625912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.626030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:32.626045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1014
2025-10-10T14:33:32.626187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.626222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:32.626231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:32.626235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:32.626755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1014 sessionId:  describe result for acl check
2025-10-10T14:33:32.626795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:32.626797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:32.626799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:32.626805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601197324716366:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:32.627390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601197324716366:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:32.628101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:32.629666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:32.629866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:32.629879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601197324716366:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:32.629876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:32.629886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:32.629947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:32.629981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601196542494661:6641]
2025-10-10T14:33:32.630508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:32.630833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:32.630879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:32.631222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:32.631275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.631279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.631280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.631281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.631282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.631282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.631283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.631284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.631285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.631286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.631286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.631287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.631288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.631293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.631302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.631307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.631310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.631316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.631320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.631323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.631326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.631330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.631335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.631338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.631343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.631347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.631354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.631362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.631369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.631373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.631376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.631379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.631381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.631385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.631388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.631391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.631394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.631398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.631401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.631404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.631406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.631409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.631413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.631416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.631419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.631422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.631424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.631427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.631431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.631434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.631436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.631440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.631463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:32.633888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:32.633902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601197324716366:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:32.633917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601197324716366:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:32.633921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601197324716366:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:32.633930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:32.634276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:32.634292Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:32.634295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:32.634299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:32.634306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1013 [2:7559601196542494661:6641]
2025-10-10T14:33:32.634319Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:32.634337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:32.634348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.634351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.634354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.634372Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:32.634385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:32.634398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:32.634466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.634473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.634475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.634478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:32.634561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:32.634570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.634584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.634596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.634612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:32.634620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1013
2025-10-10T14:33:32.634621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1013
2025-10-10T14:33:32.634640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716403:4891], now have 1 active actors on pipe
2025-10-10T14:33:32.634651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716312:2438], now have 1 active actors on pipe
2025-10-10T14:33:32.634660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601196542494654:6641]
2025-10-10T14:33:32.634663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601196542494654:6641]
2025-10-10T14:33:32.634665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601196542494654:6641]
2025-10-10T14:33:32.634682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:32.634694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:32.634697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:32.634698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:32.634699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:32.634714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:32.634717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:32.634739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.634749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.634791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601196542494654:6641]
2025-10-10T14:33:32.634803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:32.634809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:32.634824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:32.634831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.634839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.634842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:32.634854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.634869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:32.634908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.635055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.635066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.635091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.635223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1014 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0
2025-10-10T14:33:32.635644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2244a51f-da3a3f13-291cbdc2-2a1543cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:32.638290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0] Write session: try to update token
2025-10-10T14:33:32.638307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:32.652883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId: src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:32.654289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:32.654309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.654312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:32.654314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:32.654328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601196542494654:6641]
2025-10-10T14:33:32.654332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601196542494654:6641]
2025-10-10T14:33:32.654338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601196542494654:6641]
2025-10-10T14:33:32.654382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:32.654398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:32.654401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:32.654403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:32.654409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.654412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:32.654555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:32.655642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:32.718799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601197324716414:4999]
2025-10-10T14:33:32.719040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1013, pipe: [1:7559601197324716414:4999]
2025-10-10T14:33:32.771952Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:32.772363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.772382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.772433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716414:4999], now have 1 active actors on pipe
2025-10-10T14:33:32.772694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601197324716414:4999]
2025-10-10T14:33:32.772697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:32.772703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:32.772725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:32.772773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1014 reason: error at write: Disconnected sessionId: src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0
2025-10-10T14:33:32.773026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1014 sessionId: src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0 is DEAD
2025-10-10T14:33:32.773191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:32.773198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0] Write session will restart in 0.007486s
2025-10-10T14:33:32.773224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0] Write session: Do CDS request
2025-10-10T14:33:32.773231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:32.772648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:32.781874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.781966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:32.781993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1015
2025-10-10T14:33:32.782155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.782207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:32.782216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:32.782222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:32.782649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1015 sessionId:  describe result for acl check
2025-10-10T14:33:32.782695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:32.782702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:32.782703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:32.782710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601197324716472:4889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:32.782805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:32.783305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601197324716472:4889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:32.784614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:32.784836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:32.784847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:32.784859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:32.784915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:32.784977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601196542494758:6644]
2025-10-10T14:33:32.785320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601197324716472:4889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:32.785616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:32.785956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:32.786018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:32.786341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:32.786434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.786442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.786443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.786444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.786446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.786447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.786448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.786449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.786450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.786452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.786453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.786454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.786455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.786461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.786474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.786478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.786482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.786485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.786490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.786494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.786497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.786501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.786506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.786510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.786514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.786519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.786527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.786536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.786564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.786578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.786582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.786587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.786592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.786598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.786603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.786607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.786611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.786615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.786619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.786624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.786628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.786634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.786639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.786645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.786650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.786655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.786660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.786665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.786669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.786675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.786679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.786691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.786748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:32.789165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601197324716472:4889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:32.789180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601197324716472:4889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:32.789184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601197324716472:4889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:32.789193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:32.789625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:32.790012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:32.790028Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:32.790031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:32.790035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:32.790042Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1014 [2:7559601196542494758:6644]
2025-10-10T14:33:32.790055Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:32.790075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:32.790086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.790090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.790093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.790112Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:32.790124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:32.790132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:32.790193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.790201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.790203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.790205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:32.790293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:32.790302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.790314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.790326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.790355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:32.790385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716507:4889], now have 1 active actors on pipe
2025-10-10T14:33:32.790394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716415:2438], now have 1 active actors on pipe
2025-10-10T14:33:32.790402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601196542494751:6644]
2025-10-10T14:33:32.790404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601196542494751:6644]
2025-10-10T14:33:32.790406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601196542494751:6644]
2025-10-10T14:33:32.790423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:32.790416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1014
2025-10-10T14:33:32.790419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1014
2025-10-10T14:33:32.790447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:32.790469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:32.790473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:32.790473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:32.790476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:32.790478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:32.790507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601196542494751:6644]
2025-10-10T14:33:32.790511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:32.790513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:32.790528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.790533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.790585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf35a4a-21733763-9156f833-14fd9982_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:32.790601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.790607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.790610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:32.790621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.790633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:32.790663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.790837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.790850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.790868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.790966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1015 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf35a4a-21733763-9156f833-14fd9982_0
2025-10-10T14:33:32.791371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3093b1c-ecd5b9eb-73175a87-1f7abf3b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf35a4a-21733763-9156f833-14fd9982_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:32.794274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf35a4a-21733763-9156f833-14fd9982_0] Write session: try to update token
2025-10-10T14:33:32.794297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf35a4a-21733763-9156f833-14fd9982_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:32.810180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:32.810202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.810205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:32.810208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:32.810220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601196542494751:6644]
2025-10-10T14:33:32.810224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601196542494751:6644]
2025-10-10T14:33:32.810231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601196542494751:6644]
2025-10-10T14:33:32.810280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:32.810286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.810287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:32.810290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:32.810294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:32.810299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:32.810426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:32.812716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId: src_id|cf35a4a-21733763-9156f833-14fd9982_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:32.815550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:32.872869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601197324716514:4999]
2025-10-10T14:33:32.873355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1014, pipe: [1:7559601197324716514:4999]
2025-10-10T14:33:32.924619Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:32.925019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.925036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.925082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716514:4999], now have 1 active actors on pipe
2025-10-10T14:33:32.925312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:32.925325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:32.925341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:32.925382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601197324716514:4999]
2025-10-10T14:33:32.925419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1015 reason: error at write: Disconnected sessionId: src_id|cf35a4a-21733763-9156f833-14fd9982_0
2025-10-10T14:33:32.925567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:32.925616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1015 sessionId: src_id|cf35a4a-21733763-9156f833-14fd9982_0 is DEAD
2025-10-10T14:33:32.925762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf35a4a-21733763-9156f833-14fd9982_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:32.925770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf35a4a-21733763-9156f833-14fd9982_0] Write session will restart in 0.008027s
2025-10-10T14:33:32.925794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf35a4a-21733763-9156f833-14fd9982_0] Write session: Do CDS request
2025-10-10T14:33:32.925801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf35a4a-21733763-9156f833-14fd9982_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:32.933966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:32.934904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf35a4a-21733763-9156f833-14fd9982_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.935122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:32.935148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1016
2025-10-10T14:33:32.935266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:32.935315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:32.935325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:32.935329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:32.935447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:32.935647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:32.935659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:32.935671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:32.935735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:32.935780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601196542494854:6646]
2025-10-10T14:33:32.935799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1016 sessionId:  describe result for acl check
2025-10-10T14:33:32.935836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:32.935838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:32.935840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:32.935847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601197324716575:4886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:32.936312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:32.936438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601197324716575:4886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:32.936699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:32.936755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:32.937079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:32.937172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.937181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.937182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.937182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.937183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.937184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.937185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.937187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.937188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.937189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.937190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.937191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.937192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.937198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.937210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.937213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.937217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.937221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.937224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.937228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.937232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.937236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.937240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.937244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.937248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.937251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.937259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.937269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:32.937275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.937281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:32.937287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.937293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:32.937298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.937304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:32.937309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.937315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:32.937319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.937325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:32.937346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.937351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:32.937356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.937361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:32.937366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.937371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:32.937375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.937380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:32.937386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.937392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.937397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.937401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.937406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.937410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.937448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:32.938510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601197324716575:4886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:32.939866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:32.940198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:32.940212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:32.940214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:32.940219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:32.940226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1015 [2:7559601196542494854:6646]
2025-10-10T14:33:32.940241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:32.940258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:32.940262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.940265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.940274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.940292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:32.940299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:32.940311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:32.940373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.940382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.940384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.940386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:32.940463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:32.940474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.940498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:32.940516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:32.940534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:32.940562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601196542494849:6646]
2025-10-10T14:33:32.940570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601196542494849:6646]
2025-10-10T14:33:32.940572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601196542494849:6646]
2025-10-10T14:33:32.940587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:32.940600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:32.940604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716516:2438], now have 1 active actors on pipe
2025-10-10T14:33:32.940612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:32.940613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:32.940613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:32.940629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:32.940632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:32.940641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1015
2025-10-10T14:33:32.940673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601196542494849:6646]
2025-10-10T14:33:32.940687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:32.940689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:32.941327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601197324716575:4886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:32.941357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601197324716575:4886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:32.941361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601197324716575:4886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:32.941370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:32.941690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601197324716611:4886], now have 1 active actors on pipe
2025-10-10T14:33:32.941738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1015
2025-10-10T14:33:32.941817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.941829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.941862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|290a9ac2-89651c8f-b88a438a-71e33645_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:32.941878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:32.941883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:32.941886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:32.941910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:32.941929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:32.941946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.942158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.942169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.942187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:32.942285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1016 partition: 0 MaxSeqNo: 40 sessionId: src_id|290a9ac2-89651c8f-b88a438a-71e33645_0
2025-10-10T14:33:32.942726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf35a4a-21733763-9156f833-14fd9982_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|290a9ac2-89651c8f-b88a438a-71e33645_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:32.945496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|290a9ac2-89651c8f-b88a438a-71e33645_0] Write session: try to update token
2025-10-10T14:33:32.945516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|290a9ac2-89651c8f-b88a438a-71e33645_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:32.956000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:32.956024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.956036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601196542494849:6646]
2025-10-10T14:33:32.956079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:32.956089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:32.956264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:32.956414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:32.956561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:32.956708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:32.956922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:32.956970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:32.961436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId: src_id|290a9ac2-89651c8f-b88a438a-71e33645_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:32.964119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:32.964350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:32.964378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:32.964421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:32.964500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:32.974737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:32.974761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:32.974765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:32.974770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:32.974781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601196542494849:6646]
2025-10-10T14:33:32.974786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601196542494849:6646]
2025-10-10T14:33:32.974792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601196542494849:6646]
2025-10-10T14:33:32.974832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:32.974839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:32.974842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:32.974844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:32.974851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:32.974855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:32.975030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:33.025496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601201619683912:4999]
2025-10-10T14:33:33.025823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1015, pipe: [1:7559601201619683912:4999]
2025-10-10T14:33:33.096653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:33.105307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.105358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.105543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.105617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.105696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.105767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.105816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.105826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.105895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.105960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.106043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.106115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.106163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.106172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.106243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.106345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.106446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.106518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.106564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.106574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.106649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.106718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.106781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.106877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.106925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.106933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.107005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.107091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.107162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.107232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.107283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.107291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.107394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.107458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.107527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.107634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.107690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.107701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.107776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.107889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.107959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.108024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.108071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.108079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.108149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.108216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.108286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.108351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.108412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.108420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.108484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.108549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.108612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.108682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.108731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.108741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.108807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.108869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.108935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.109001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.109049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.109057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.109122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619683912:4999], now have 1 active actors on pipe
2025-10-10T14:33:33.109396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:33.109466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601201619683912:4999]
2025-10-10T14:33:33.109566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:33.109579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:33.109611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1016 reason: error at write: Disconnected sessionId: src_id|290a9ac2-89651c8f-b88a438a-71e33645_0
2025-10-10T14:33:33.109852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1016 sessionId: src_id|290a9ac2-89651c8f-b88a438a-71e33645_0 is DEAD
2025-10-10T14:33:33.109959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290a9ac2-89651c8f-b88a438a-71e33645_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:33.109970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290a9ac2-89651c8f-b88a438a-71e33645_0] Write session will restart in 0.007204s
2025-10-10T14:33:33.110003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290a9ac2-89651c8f-b88a438a-71e33645_0] Write session: Do CDS request
2025-10-10T14:33:33.110009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290a9ac2-89651c8f-b88a438a-71e33645_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:33.110416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:33.119132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|290a9ac2-89651c8f-b88a438a-71e33645_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.119157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:33.119215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:33.119231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1017
2025-10-10T14:33:33.119384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.119423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:33.119433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:33.119437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:33.119902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1017 sessionId:  describe result for acl check
2025-10-10T14:33:33.119937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:33.119938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:33.119942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:33.119948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601201619683975:4883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:33.120510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601201619683975:4883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:33.120820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:33.121026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:33.121038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:33.121050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:33.121109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:33.121152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601200837462249:6648]
2025-10-10T14:33:33.121843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:33.122230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:33.122286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:33.122640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:33.122696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.122703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.122704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.122706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.122707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.122708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.122710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.122711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.122712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.122714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.122715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.122716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.122718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.122724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.122736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.122740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.122744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.122748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.122752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.122756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.122760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.122764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.122768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.122772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.122776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.122780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.122789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.122798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.122806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.122812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.122816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.122822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.122826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.122831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.122836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.122842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.122847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.122852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.122858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.122864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.122875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.122881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.122886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.122896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.122903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.122913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.122918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.122928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.122933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.122943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.122947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.122953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.123005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:33.123372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601201619683975:4883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:33.125415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:33.126025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:33.126041Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:33.126044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:33.126047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:33.126056Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1016 [2:7559601200837462249:6648]
2025-10-10T14:33:33.126069Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:33.126086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:33.126089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.126093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.126095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.126113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:33.126121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:33.126128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:33.126174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601201619683975:4883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:33.126189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601201619683975:4883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:33.126192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601201619683975:4883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:33.126190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.126201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:33.126205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.126207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.126209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:33.126283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:33.126291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.126304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.126320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.126341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:33.126368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619683915:2438], now have 1 active actors on pipe
2025-10-10T14:33:33.126380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601200837462243:6648]
2025-10-10T14:33:33.126384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601200837462243:6648]
2025-10-10T14:33:33.126390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601200837462243:6648]
2025-10-10T14:33:33.126405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:33.126396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1016
2025-10-10T14:33:33.126429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:33.126439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:33.126443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:33.126447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:33.126447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:33.126451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:33.126487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684009:4883], now have 1 active actors on pipe
2025-10-10T14:33:33.126490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601200837462243:6648]
2025-10-10T14:33:33.126497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:33.126526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1016
2025-10-10T14:33:33.126524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:33.126591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.126604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.126634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:33.126650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.126658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.126660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:33.126671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.126686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:33.126705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.126837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.126846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.126861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.126949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1017 partition: 0 MaxSeqNo: 40 sessionId: src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0
2025-10-10T14:33:33.127313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290a9ac2-89651c8f-b88a438a-71e33645_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:33.130021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0] Write session: try to update token
2025-10-10T14:33:33.130041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:33.146648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId: src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:33.146896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:33.146921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.146925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:33.146929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:33.146939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601200837462243:6648]
2025-10-10T14:33:33.146943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601200837462243:6648]
2025-10-10T14:33:33.146948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601200837462243:6648]
2025-10-10T14:33:33.146999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:33.147011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:33.147014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.147018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:33.147019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:33.147023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:33.147160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:33.149260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:33.209818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601201619684017:4999]
2025-10-10T14:33:33.210154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1016, pipe: [1:7559601201619684017:4999]
2025-10-10T14:33:33.256185Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:33.256474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.256489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.256537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684017:4999], now have 1 active actors on pipe
2025-10-10T14:33:33.256737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:33.256819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601201619684017:4999]
2025-10-10T14:33:33.256849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:33.256904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:33.256988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1017 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0
2025-10-10T14:33:33.257197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1017 sessionId: src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0 is DEAD
2025-10-10T14:33:33.257388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:33.257401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0] Write session will restart in 0.008102s
2025-10-10T14:33:33.257426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0] Write session: Do CDS request
2025-10-10T14:33:33.257433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:33.265352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:33.266754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:33.266920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.266964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:33.266975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:33.266987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:33.267010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:33.267026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1018
2025-10-10T14:33:33.267037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:33.267083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601200837462347:6650]
2025-10-10T14:33:33.267147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.267178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:33.267188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:33.267193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:33.267599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1018 sessionId:  describe result for acl check
2025-10-10T14:33:33.267632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:33.267638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:33.267640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:33.267646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601201619684079:4874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:33.267720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:33.268049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:33.268090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:33.268213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601201619684079:4874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:33.268385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:33.268437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.268444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.268445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.268446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.268447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.268449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.268450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.268451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.268452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.268453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.268454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.268455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.268456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.268461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.268472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.268476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.268479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.268483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.268486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.268489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.268493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.268496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.268500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.268503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.268506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.268510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.268517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.268525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.268531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.268535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.268540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.268545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.268548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.268553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.268557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.268561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.268566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.268570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.268575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.268579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.268583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.268588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.268592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.268598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.268607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.268611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.268616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.268621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.268624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.268633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.268638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.268642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.268677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:33.270370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601201619684079:4874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:33.271173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:33.271761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:33.271777Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:33.271779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:33.271783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:33.271791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1017 [2:7559601200837462347:6650]
2025-10-10T14:33:33.271805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:33.271825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:33.271828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.271832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.271834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.271851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:33.271868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:33.271875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:33.271940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.271942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.271944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.271947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:33.272018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:33.272021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.272033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.272044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.272060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:33.272084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684018:2438], now have 1 active actors on pipe
2025-10-10T14:33:33.272092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601200837462342:6650]
2025-10-10T14:33:33.272098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601200837462342:6650]
2025-10-10T14:33:33.272101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601200837462342:6650]
2025-10-10T14:33:33.272117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:33.272132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:33.272138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:33.272142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:33.272144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:33.272151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:33.272156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:33.272185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601200837462342:6650]
2025-10-10T14:33:33.272194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:33.272199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:33.272264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1017
2025-10-10T14:33:33.273732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601201619684079:4874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:33.273747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601201619684079:4874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:33.273751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601201619684079:4874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:33.273759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:33.274098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1017
2025-10-10T14:33:33.274117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684117:4874], now have 1 active actors on pipe
2025-10-10T14:33:33.274161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.274168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.274201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:33.274218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.274230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.274232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:33.274253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.274275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:33.274299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.274664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.274677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.274699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.274777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1018 partition: 0 MaxSeqNo: 40 sessionId: src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0
2025-10-10T14:33:33.275165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4266d6c7-5ed41e7b-16f55070-fe78fd75_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:33.277845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0] Write session: try to update token
2025-10-10T14:33:33.277863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:33.290988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:33.291012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.291024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601200837462342:6650]
2025-10-10T14:33:33.291090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:33.291106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:33.291333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:33.291561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.291731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.291899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.292121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:33.292182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:33.294671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId: src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:33.297603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:33.298056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.298083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.298127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:33.298364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:33.303661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:33.303682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.303686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:33.303688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:33.303698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601200837462342:6650]
2025-10-10T14:33:33.303702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601200837462342:6650]
2025-10-10T14:33:33.303706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601200837462342:6650]
2025-10-10T14:33:33.303757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:33.303758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:33.303761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:33.303765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:33.303765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.303768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:33.303912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:33.356731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601201619684155:4999]
2025-10-10T14:33:33.356907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1017, pipe: [1:7559601201619684155:4999]
2025-10-10T14:33:33.417652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:33.425349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.425382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.425562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.425630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.425697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.425765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.426188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.426205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.426277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.426342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.426406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.426481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.426524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.426532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.426599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.426664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.426727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.426791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.426834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.426841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.426909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.427146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.427220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.427284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.427326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.427335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.427406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.427471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.427536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.427599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.427666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.427674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.427742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.427806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.427872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.427939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.427984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.427991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.428062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.428127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.428192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.428257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.428304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.428310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.428382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.428446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.428511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.428576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.428621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.428628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.428697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.428761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.428868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.428934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.428980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.428988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.429060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.429125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.429190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.429257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.429307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.429313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.429402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684155:4999], now have 1 active actors on pipe
2025-10-10T14:33:33.429653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601201619684155:4999]
2025-10-10T14:33:33.429681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:33.429681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:33.429684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:33.429713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1018 reason: error at write: Disconnected sessionId: src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0
2025-10-10T14:33:33.429930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1018 sessionId: src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0 is DEAD
2025-10-10T14:33:33.429989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:33.430328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:33.430340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0] Write session will restart in 0.009038s
2025-10-10T14:33:33.430366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0] Write session: Do CDS request
2025-10-10T14:33:33.430372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:33.439960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:33.440927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.441165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:33.441179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1019
2025-10-10T14:33:33.441351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.441354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:33.441399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:33.441411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:33.441415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:33.441699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:33.441712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:33.441725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:33.441789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:33.441831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601200837462498:6666]
2025-10-10T14:33:33.441862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1019 sessionId:  describe result for acl check
2025-10-10T14:33:33.441896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:33.441898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:33.441900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:33.441906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601201619684222:4858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:33.442368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601201619684222:4858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:33.442451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:33.442748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:33.442793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:33.443116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:33.443179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.443186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.443187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.443188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.443189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.443191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.443192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.443193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.443195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.443196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.443198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.443199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.443200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.443207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.443218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.443223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.443227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.443231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.443235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.443239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.443243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.443247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.443252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.443256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.443260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.443264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.443272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.443281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.443287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.443292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.443297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.443302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.443307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.443312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.443317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.443322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.443327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.443333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.443338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.443343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.443348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.443353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.443357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.443363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.443367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.443371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.443378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.443383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.443387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.443392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.443395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.443400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.443441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:33.444775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601201619684222:4858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:33.445704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:33.446320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:33.446335Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:33.446337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:33.446341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:33.446347Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1018 [2:7559601200837462498:6666]
2025-10-10T14:33:33.446361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:33.446393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:33.446401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.446404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.446407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.446424Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:33.446436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:33.446444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:33.446520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.446530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.446534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.446536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:33.446604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:33.446611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.446623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.446636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.446659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:33.446683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684158:2438], now have 1 active actors on pipe
2025-10-10T14:33:33.446696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601200837462492:6666]
2025-10-10T14:33:33.446698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601200837462492:6666]
2025-10-10T14:33:33.446701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601200837462492:6666]
2025-10-10T14:33:33.446718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:33.446740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:33.446732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1018
2025-10-10T14:33:33.446749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:33.446753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:33.446756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:33.446758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:33.446761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:33.446795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601200837462492:6666]
2025-10-10T14:33:33.446808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:33.446813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:33.447561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601201619684222:4858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:33.447575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601201619684222:4858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:33.447579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601201619684222:4858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:33.447588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:33.447808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684257:4858], now have 1 active actors on pipe
2025-10-10T14:33:33.447853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1018
2025-10-10T14:33:33.447937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.447953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.447988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2844d019-f370a16d-2fb66b5-79e92515_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:33.448005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.448014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.448017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:33.448030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.448051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:33.448075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.448283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.448291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.448305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.448430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1019 partition: 0 MaxSeqNo: 40 sessionId: src_id|2844d019-f370a16d-2fb66b5-79e92515_0
2025-10-10T14:33:33.448874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c2d573-9e770367-da9b5e71-eb636f7e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2844d019-f370a16d-2fb66b5-79e92515_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:33.451884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2844d019-f370a16d-2fb66b5-79e92515_0] Write session: try to update token
2025-10-10T14:33:33.451907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2844d019-f370a16d-2fb66b5-79e92515_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:33.458373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:33.458393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.458409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601200837462492:6666]
2025-10-10T14:33:33.458456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:33.458464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:33.458648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:33.458806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.458950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.459098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.459301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:33.459356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:33.467377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId: src_id|2844d019-f370a16d-2fb66b5-79e92515_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:33.470486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:33.470725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.470768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.470815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:33.470908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:33.476471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:33.476493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.476496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:33.476498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:33.476509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601200837462492:6666]
2025-10-10T14:33:33.476514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601200837462492:6666]
2025-10-10T14:33:33.476518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601200837462492:6666]
2025-10-10T14:33:33.476558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:33.476564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:33.476566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:33.476568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:33.476573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.476576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:33.476716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:33.529822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601201619684262:4999]
2025-10-10T14:33:33.530222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1018, pipe: [1:7559601201619684262:4999]
2025-10-10T14:33:33.587375Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:33.594701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.594736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.594891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.594953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.595014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.595073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.595115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.595127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.595187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.595243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.595300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.595358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.595398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.595403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.595469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.595528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.595584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.595640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.595681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.595687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.595746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.595827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.595888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.595976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.596016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.596021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.596108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.596163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.596223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.596280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.596319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.596324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.596381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.596450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.596513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.596578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.596619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.596625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.596686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.596741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.596797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.596859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.596900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.596905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.596964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.597023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.597087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.597143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.597183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.597192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.597258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.597311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.597385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.597452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.597515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.597523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.597583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.597635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.597688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.597745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.597782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.597787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.597839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684262:4999], now have 1 active actors on pipe
2025-10-10T14:33:33.598052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:33.598063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601201619684262:4999]
2025-10-10T14:33:33.598091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:33.598093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:33.598125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1019 reason: error at write: Disconnected sessionId: src_id|2844d019-f370a16d-2fb66b5-79e92515_0
2025-10-10T14:33:33.598332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1019 sessionId: src_id|2844d019-f370a16d-2fb66b5-79e92515_0 is DEAD
2025-10-10T14:33:33.598509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2844d019-f370a16d-2fb66b5-79e92515_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:33.598520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2844d019-f370a16d-2fb66b5-79e92515_0] Write session will restart in 0.008220s
2025-10-10T14:33:33.598545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2844d019-f370a16d-2fb66b5-79e92515_0] Write session: Do CDS request
2025-10-10T14:33:33.598552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2844d019-f370a16d-2fb66b5-79e92515_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:33.598724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:33.606996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:33.607963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2844d019-f370a16d-2fb66b5-79e92515_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.608004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:33.608017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1020
2025-10-10T14:33:33.608205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.608255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:33.608266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:33.608274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:33.608433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:33.608687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:33.608699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:33.608712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:33.608741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1020 sessionId:  describe result for acl check
2025-10-10T14:33:33.608771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:33.608780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:33.608786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:33.608788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:33.608793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601201619684334:4848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:33.608813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601200837462598:6668]
2025-10-10T14:33:33.609322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601201619684334:4848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:33.609455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:33.609795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:33.609839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:33.610172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:33.610282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.610291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.610292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.610294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.610295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.610296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.610298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.610299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.610300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.610301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.610303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.610304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.610305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.610311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.610323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.610327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.610331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.610335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.610340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.610344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.610348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.610351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.610356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.610361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.610365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.610368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.610375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.610384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.610392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.610397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.610402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.610406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.610411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.610416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.610421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.610425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.610429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.610434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.610438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.610444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.610448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.610453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.610458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.610463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.610467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.610473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.610478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.610483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.610487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.610492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.610496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.610501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.610541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:33.612061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601201619684334:4848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:33.612807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:33.613124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:33.613136Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:33.613138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:33.613142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:33.613147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1019 [2:7559601200837462598:6668]
2025-10-10T14:33:33.613159Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:33.613174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:33.613177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.613181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.613183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.613199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:33.613212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:33.613222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:33.613277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.613283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.613286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.613289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:33.613366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:33.613376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.613387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.613403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.613425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:33.613480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684271:2438], now have 1 active actors on pipe
2025-10-10T14:33:33.613496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601200837462593:6668]
2025-10-10T14:33:33.613502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601200837462593:6668]
2025-10-10T14:33:33.613504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601200837462593:6668]
2025-10-10T14:33:33.613500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1019
2025-10-10T14:33:33.613517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:33.613536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:33.613544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:33.613554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:33.613555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:33.613556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:33.613559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:33.613586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601200837462593:6668]
2025-10-10T14:33:33.613599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:33.613618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:33.617947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601201619684334:4848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:33.617961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601201619684334:4848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:33.617964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601201619684334:4848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:33.618007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:33.618273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684372:4848], now have 1 active actors on pipe
2025-10-10T14:33:33.618349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1019
2025-10-10T14:33:33.618436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.618448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.618490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:33.618506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.618515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.618518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:33.618531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.618553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:33.618576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.618735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.618743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.618759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.618845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1020 partition: 0 MaxSeqNo: 40 sessionId: src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0
2025-10-10T14:33:33.619264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2844d019-f370a16d-2fb66b5-79e92515_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:33.622090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0] Write session: try to update token
2025-10-10T14:33:33.622110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:33.625343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:33.625361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.625374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601200837462593:6668]
2025-10-10T14:33:33.625423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:33.625423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:33.625636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:33.625784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.625926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.626098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.626290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:33.626333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:33.636913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId: src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:33.639707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:33.639946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.639971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.640014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:33.640107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:33.643033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:33.643057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.643061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:33.643063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:33.643075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601200837462593:6668]
2025-10-10T14:33:33.643079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601200837462593:6668]
2025-10-10T14:33:33.643083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601200837462593:6668]
2025-10-10T14:33:33.643131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:33.643133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:33.643139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.643140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:33.643142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:33.643144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:33.643280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:33.698260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601201619684378:4999]
2025-10-10T14:33:33.698533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1019, pipe: [1:7559601201619684378:4999]
2025-10-10T14:33:33.758284Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:33.766491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.766521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.766710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.766774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.766839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.766903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.767157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.767172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.767243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.767303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.767362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.767432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.767480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.767489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.767571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.767629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.767700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.767768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.767815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.767822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.767896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.767955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.768020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.768105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.768151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.768158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.768225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.768288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.768356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.768420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.768466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.768473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.768540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.768600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.768666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.768727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.768772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.768775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.768842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.768909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.768975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.769041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.769088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.769095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.769163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.769233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.769303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.769387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.769593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.769602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.769671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.769733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.769796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.769860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.770162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.770169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.770238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.770300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.770363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.770431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.770475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.770481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.770550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684378:4999], now have 1 active actors on pipe
2025-10-10T14:33:33.770804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:33.770843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:33.770850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601201619684378:4999]
2025-10-10T14:33:33.770883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:33.770949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1020 reason: status is not ok: tablet will be restarted right now sessionId: src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0
2025-10-10T14:33:33.771218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1020 sessionId: src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0 is DEAD
2025-10-10T14:33:33.771383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:33.771395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0] Write session will restart in 0.005875s
2025-10-10T14:33:33.771420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0] Write session: Do CDS request
2025-10-10T14:33:33.771426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:33.778892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.778923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:33.778940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1021
2025-10-10T14:33:33.779139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.779198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:33.779211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:33.779215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:33.779699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1021 sessionId:  describe result for acl check
2025-10-10T14:33:33.779732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:33.779738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:33.779740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:33.779745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601201619684434:4845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:33.780260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601201619684434:4845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:33.781388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:33.782732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601201619684434:4845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:33.782839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:33.783076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:33.783088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:33.783101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:33.783152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:33.783194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601200837462703:6671]
2025-10-10T14:33:33.783842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:33.784118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:33.784161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:33.784484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:33.784556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.784563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.784564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.784565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.784567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.784568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.784569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.784570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.784571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.784572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.784573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.784574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.784575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.784581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.784594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.784599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.784603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.784607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.784611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.784616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.784620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.784624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.784628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.784632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.784636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.784639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.784646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.784654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.784661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.784666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.784671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.784682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.784686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.784691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.784699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.784704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.784708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.784713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.784724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.784729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.784737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.784742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.784748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.784757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.784761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.784767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.784776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.784781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.784786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.784797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.784802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.784806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.784848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:33.785427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601201619684434:4845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:33.785440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601201619684434:4845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:33.785443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601201619684434:4845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:33.785452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:33.787210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:33.787536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:33.787547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:33.787550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:33.787554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:33.787560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1020 [2:7559601200837462703:6671]
2025-10-10T14:33:33.787572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:33.787589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:33.787592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.787596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.787598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.787614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:33.787626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:33.787633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:33.787693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.787700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.787703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.787706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:33.787772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:33.787785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.787797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.787811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.787830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:33.787856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684380:2438], now have 1 active actors on pipe
2025-10-10T14:33:33.787865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684479:4845], now have 1 active actors on pipe
2025-10-10T14:33:33.787872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601200837462697:6671]
2025-10-10T14:33:33.787876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601200837462697:6671]
2025-10-10T14:33:33.787878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601200837462697:6671]
2025-10-10T14:33:33.787892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:33.787906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:33.787910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:33.787917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:33.787919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:33.787928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:33.787931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:33.787916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1020
2025-10-10T14:33:33.787955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601200837462697:6671]
2025-10-10T14:33:33.787970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1020
2025-10-10T14:33:33.787974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:33.787986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:33.788012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.788021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.788051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:33.788066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.788070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.788072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:33.788084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.788099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:33.788116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.788374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.788382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.788397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.788504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1021 partition: 0 MaxSeqNo: 40 sessionId: src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0
2025-10-10T14:33:33.788928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a4465-39e74ef-2e1c0a2e-33be709b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:33.791930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0] Write session: try to update token
2025-10-10T14:33:33.791953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:33.804992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:33.805026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.805039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601200837462697:6671]
2025-10-10T14:33:33.805093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:33.805096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:33.805267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:33.805425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.805576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.805719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.805905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:33.805947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:33.806574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId: src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:33.809108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:33.809308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.809347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.809385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:33.809465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:33.816255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:33.816274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.816277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:33.816279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:33.816288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601200837462697:6671]
2025-10-10T14:33:33.816292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601200837462697:6671]
2025-10-10T14:33:33.816296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601200837462697:6671]
2025-10-10T14:33:33.816339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:33.816343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:33.816345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:33.816349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:33.816351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.816354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:33.816483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:33.870808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601201619684486:4999]
2025-10-10T14:33:33.871174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1020, pipe: [1:7559601201619684486:4999]
2025-10-10T14:33:33.924506Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:33.932103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.932136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.932314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.932378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.932450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.932518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.932898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.932910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.932978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.933038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.933103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.933166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.933215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.933222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.933286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.933396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.933470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.933544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.933591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.933598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.933667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.933734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.933800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.933866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.933908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.933915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.933992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.934057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.934121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.934226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.934328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.934335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.934400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.934462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.934531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.934596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.934635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.934641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.934701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.934761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.934832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.934903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.935013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.935021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.935092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.935153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.935225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.935294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.935341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.935349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.935415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.935476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.935540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.935607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.935651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.935658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.935722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:33.935779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:33.935844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:33.935916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:33.935957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:33.935964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:33.936031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684486:4999], now have 1 active actors on pipe
2025-10-10T14:33:33.936300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:33.936333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:33.936337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:33.936358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601201619684486:4999]
2025-10-10T14:33:33.936371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1021 reason: error at write: Disconnected sessionId: src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0
2025-10-10T14:33:33.936588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1021 sessionId: src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0 is DEAD
2025-10-10T14:33:33.936649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:33.936775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:33.936784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0] Write session will restart in 0.008069s
2025-10-10T14:33:33.936809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0] Write session: Do CDS request
2025-10-10T14:33:33.936814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:33.945830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.945839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:33.945930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:33.945945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1022
2025-10-10T14:33:33.946089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:33.946123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:33.946133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:33.946140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:33.946583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1022 sessionId:  describe result for acl check
2025-10-10T14:33:33.946621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:33.946627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:33.946629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:33.946635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601201619684553:4839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:33.947182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601201619684553:4839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:33.947224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:33.947409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:33.947418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:33.947428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:33.947472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:33.947503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601200837462805:6673]
2025-10-10T14:33:33.947893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:33.948190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:33.948227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:33.948464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:33.948504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.948509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.948509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.948510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.948511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.948512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.948512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.948513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.948514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.948514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.948515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.948516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.948517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.948522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.948533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.948537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.948541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.948545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.948548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.948550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.948552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.948556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.948560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.948563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.948566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.948571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.948577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.948587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:33.948593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.948599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:33.948602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.948606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:33.948609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.948612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:33.948615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.948618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:33.948620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.948623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:33.948626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.948629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:33.948632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.948635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:33.948638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.948641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:33.948644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.948647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:33.948649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.948653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.948655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.948658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.948661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.948664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.948685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:33.949708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601201619684553:4839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:33.951815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:33.952159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:33.952172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:33.952175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:33.952179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:33.952184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1021 [2:7559601200837462805:6673]
2025-10-10T14:33:33.952197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:33.952216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:33.952224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.952236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.952239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.952256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:33.952268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:33.952280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:33.952336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.952343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.952345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.952349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:33.952417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:33.952425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.952438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:33.952453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:33.952475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:33.952500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684488:2438], now have 1 active actors on pipe
2025-10-10T14:33:33.952512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601200837462800:6673]
2025-10-10T14:33:33.952518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601200837462800:6673]
2025-10-10T14:33:33.952520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601200837462800:6673]
2025-10-10T14:33:33.952533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:33.952547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:33.952522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1021
2025-10-10T14:33:33.952552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:33.952557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:33.952560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:33.952568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:33.952572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:33.952601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601200837462800:6673]
2025-10-10T14:33:33.952612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:33.952622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:33.954133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601201619684553:4839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:33.954147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601201619684553:4839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:33.954151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601201619684553:4839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:33.954160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:33.954429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601201619684591:4839], now have 1 active actors on pipe
2025-10-10T14:33:33.954470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1021
2025-10-10T14:33:33.954521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.954533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.954567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cfa8f69-bac6c025-fde58169-966ad602_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:33.954583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:33.954589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:33.954592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:33.954607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:33.954628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:33.954649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.954796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.954804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.954819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:33.954908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1022 partition: 0 MaxSeqNo: 40 sessionId: src_id|2cfa8f69-bac6c025-fde58169-966ad602_0
2025-10-10T14:33:33.955321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae37497a-e5c6ae82-60c6fc7f-ee6dc0a2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2cfa8f69-bac6c025-fde58169-966ad602_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:33.957982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cfa8f69-bac6c025-fde58169-966ad602_0] Write session: try to update token
2025-10-10T14:33:33.958002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cfa8f69-bac6c025-fde58169-966ad602_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:33.963893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:33.963911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.963923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601200837462800:6673]
2025-10-10T14:33:33.963972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:33.963984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:33.964189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:33.964327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.964459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.964590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:33.964790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:33.964837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:33.972136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId: src_id|2cfa8f69-bac6c025-fde58169-966ad602_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:33.974722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:33.974921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:33.974947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:33.974992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:33.975056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:33.981921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:33.981939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:33.981941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:33.981943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:33.981952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601200837462800:6673]
2025-10-10T14:33:33.981966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601200837462800:6673]
2025-10-10T14:33:33.981972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601200837462800:6673]
2025-10-10T14:33:33.982011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:33.982017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:33.982019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:33.982022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:33.982028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:33.982033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:33.982142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:34.036704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601205914651890:4999]
2025-10-10T14:33:34.037043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1021, pipe: [1:7559601205914651890:4999]
2025-10-10T14:33:34.096211Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:34.104217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.104247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.104433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.104498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.104560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.104622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.104665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.104679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.104746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.104811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.104873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.104938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.104986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.104996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.105066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.105130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.105195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.105257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.105302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.105309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.105394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.105457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.105519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.105583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.105629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.105636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.105703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.105771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.105837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.105893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.105940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.105947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.106024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.106086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.106153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.106220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.106262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.106269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.106334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.106394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.106456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.106517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.106565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.106572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.106638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.106698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.106761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.106825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.106874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.106880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.106948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.107016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.107077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.107140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.107186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.107194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.107257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.107320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.107381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.107447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.107488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.107495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.107557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914651890:4999], now have 1 active actors on pipe
2025-10-10T14:33:34.107822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601205914651890:4999]
2025-10-10T14:33:34.107863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:34.107866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:34.107897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1022 reason: error at write: Disconnected sessionId: src_id|2cfa8f69-bac6c025-fde58169-966ad602_0
2025-10-10T14:33:34.107916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:34.108121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1022 sessionId: src_id|2cfa8f69-bac6c025-fde58169-966ad602_0 is DEAD
2025-10-10T14:33:34.108306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cfa8f69-bac6c025-fde58169-966ad602_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:34.108319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cfa8f69-bac6c025-fde58169-966ad602_0] Write session will restart in 0.009589s
2025-10-10T14:33:34.108345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cfa8f69-bac6c025-fde58169-966ad602_0] Write session: Do CDS request
2025-10-10T14:33:34.108350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cfa8f69-bac6c025-fde58169-966ad602_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:34.108520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:34.118952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cfa8f69-bac6c025-fde58169-966ad602_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.118978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:34.118991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1023
2025-10-10T14:33:34.119188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.119224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:34.119229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:34.119237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:34.119677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1023 sessionId:  describe result for acl check
2025-10-10T14:33:34.119721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:34.119729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:34.119731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:34.119738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601205914651958:4827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:34.120026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:34.120347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601205914651958:4827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:34.121885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:34.122127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:34.122139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:34.122152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:34.122220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:34.122260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601205132430206:6675]
2025-10-10T14:33:34.122918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:34.123163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:34.123203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:34.123231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601205914651958:4827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:34.123533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:34.123590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.123596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.123607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.123613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.123614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.123615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.123617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.123618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.123619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.123621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.123622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.123623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.123625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.123631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.123644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.123649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.123653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.123657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.123662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.123666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.123671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.123675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.123680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.123685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.123689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.123693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.123702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.123712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.123719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.123725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.123734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.123740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.123745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.123753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.123762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.123768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.123777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.123783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.123793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.123798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.123807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.123813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.123818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.123829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.123834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.123840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.123845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.123851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.123855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.123861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.123865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.123871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.123913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:34.126139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601205914651958:4827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:34.126153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601205914651958:4827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:34.126166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601205914651958:4827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:34.126175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:34.126213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:34.126539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:34.126552Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:34.126554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:34.126558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:34.126563Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1022 [2:7559601205132430206:6675]
2025-10-10T14:33:34.126576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:34.126600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:34.126606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.126610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.126612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.126631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:34.126644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:34.126656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:34.126716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.126724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.126728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.126731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:34.126797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:34.126807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.126819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.126828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.126846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:34.126873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914651892:2438], now have 1 active actors on pipe
2025-10-10T14:33:34.126881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914651993:4827], now have 1 active actors on pipe
2025-10-10T14:33:34.126891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601205132430200:6675]
2025-10-10T14:33:34.126897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601205132430200:6675]
2025-10-10T14:33:34.126899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601205132430200:6675]
2025-10-10T14:33:34.126915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:34.126918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1022
2025-10-10T14:33:34.126929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:34.126930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:34.126936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:34.126938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:34.126949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:34.126952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:34.126957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1022
2025-10-10T14:33:34.126981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601205132430200:6675]
2025-10-10T14:33:34.126989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:34.126991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:34.127018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.127027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.127064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fcc02ae-58fbb146-c802ae24-22418806_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:34.127077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.127080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.127082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:34.127094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.127108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:34.127131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.127305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.127317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.127334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.127462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1023 partition: 0 MaxSeqNo: 40 sessionId: src_id|5fcc02ae-58fbb146-c802ae24-22418806_0
2025-10-10T14:33:34.127872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cfa8f69-bac6c025-fde58169-966ad602_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5fcc02ae-58fbb146-c802ae24-22418806_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:34.130596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcc02ae-58fbb146-c802ae24-22418806_0] Write session: try to update token
2025-10-10T14:33:34.130618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcc02ae-58fbb146-c802ae24-22418806_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:34.146704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId: src_id|5fcc02ae-58fbb146-c802ae24-22418806_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:34.146574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:34.146599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:34.146603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:34.146608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:34.146620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601205132430200:6675]
2025-10-10T14:33:34.146624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601205132430200:6675]
2025-10-10T14:33:34.146628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601205132430200:6675]
2025-10-10T14:33:34.146684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:34.146692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.146695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:34.146693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:34.146701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:34.146706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:34.146873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:34.149468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:34.208222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601205914652000:4999]
2025-10-10T14:33:34.208559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1022, pipe: [1:7559601205914652000:4999]
2025-10-10T14:33:34.260057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:34.260317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.260331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.260369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652000:4999], now have 1 active actors on pipe
2025-10-10T14:33:34.260586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:34.260598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601205914652000:4999]
2025-10-10T14:33:34.260655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:34.260664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:34.260730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1023 reason: error at write: Disconnected sessionId: src_id|5fcc02ae-58fbb146-c802ae24-22418806_0
2025-10-10T14:33:34.260715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:34.260922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1023 sessionId: src_id|5fcc02ae-58fbb146-c802ae24-22418806_0 is DEAD
2025-10-10T14:33:34.261107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcc02ae-58fbb146-c802ae24-22418806_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:34.261118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcc02ae-58fbb146-c802ae24-22418806_0] Write session will restart in 0.008177s
2025-10-10T14:33:34.261142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcc02ae-58fbb146-c802ae24-22418806_0] Write session: Do CDS request
2025-10-10T14:33:34.261149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcc02ae-58fbb146-c802ae24-22418806_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:34.268935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:34.270354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:34.270531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:34.270543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:34.270554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:34.270602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:34.270799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcc02ae-58fbb146-c802ae24-22418806_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.270642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601205132430310:6677]
2025-10-10T14:33:34.270954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:34.270969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1024
2025-10-10T14:33:34.271105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.271136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:34.271147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:34.271151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:34.271283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:34.271558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1024 sessionId:  describe result for acl check
2025-10-10T14:33:34.271569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:34.271588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:34.271593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:34.271594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:34.271601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601205914652071:4829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:34.271611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:34.271928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:34.271986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.271993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.271994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.271995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.271996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.271997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.271998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.272000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.272001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.272002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.272003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.272004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.272005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.272011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.272022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.272026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.272031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.272035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.272057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601205914652071:4829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:34.272039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.272043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.272047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.272051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.272055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.272059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.272063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.272067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.272074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.272082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.272089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.272096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.272102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.272107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.272111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.272116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.272121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.272126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.272130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.272135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.272140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.272145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.272150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.272155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.272159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.272164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.272168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.272173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.272184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.272191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.272195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.272205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.272209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.272215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.272256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:34.274113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601205914652071:4829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:34.274598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:34.274898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:34.274911Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:34.274914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:34.274917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:34.274924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1023 [2:7559601205132430310:6677]
2025-10-10T14:33:34.274935Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:34.274952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:34.274961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.274964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.274966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.274985Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:34.274998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:34.275006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:34.275073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.275080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.275082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.275084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:34.275155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:34.275162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.275173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.275187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.275217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:34.275242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652002:2438], now have 1 active actors on pipe
2025-10-10T14:33:34.275255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601205132430305:6677]
2025-10-10T14:33:34.275258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601205132430305:6677]
2025-10-10T14:33:34.275260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601205132430305:6677]
2025-10-10T14:33:34.275272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:34.275286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:34.275287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:34.275277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1023
2025-10-10T14:33:34.275290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:34.275292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:34.275307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:34.275310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:34.275338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601205132430305:6677]
2025-10-10T14:33:34.275349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:34.275355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:34.279667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601205914652071:4829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:34.279681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601205914652071:4829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:34.279684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601205914652071:4829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:34.279694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:34.279917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652107:4829], now have 1 active actors on pipe
2025-10-10T14:33:34.280032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1023
2025-10-10T14:33:34.280096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.280110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.280150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:34.280167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.280177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.280180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:34.280194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.280215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:34.280238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.280459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.280469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.280484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.280571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1024 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0
2025-10-10T14:33:34.280893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcc02ae-58fbb146-c802ae24-22418806_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:34.283649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0] Write session: try to update token
2025-10-10T14:33:34.283669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:34.286640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:34.286661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:34.286671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601205132430305:6677]
2025-10-10T14:33:34.286720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:34.286720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:34.286889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:34.287036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:34.287175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:34.287320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:34.287514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:34.287566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:34.298810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId: src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:34.301581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:34.301794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.301823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.301866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:34.301975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:34.304777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:34.304801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:34.304804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:34.304806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:34.304818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601205132430305:6677]
2025-10-10T14:33:34.304822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601205132430305:6677]
2025-10-10T14:33:34.304829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601205132430305:6677]
2025-10-10T14:33:34.304873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:34.304881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:34.304886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:34.304889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.304891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:34.304892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:34.305023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:34.360778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601205914652134:4999]
2025-10-10T14:33:34.360993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1023, pipe: [1:7559601205914652134:4999]
2025-10-10T14:33:34.418107Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:34.425113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.425138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.425288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.425362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.425420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.425478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.425523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.425535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.425602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.425659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.425716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.425787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.425826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.425833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.425892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.425960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.426023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.426089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.426128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.426134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.426192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.426246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.426309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.426364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.426401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.426406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.426465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.426515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.426576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.426630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.426668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.426674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.426731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.426784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.426847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.426905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.426945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.426950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.427006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.427062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.427125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.427176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.427218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.427223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.427280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.427331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.427389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.427445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.427485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.427491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.427548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.427604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.427665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.427719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.427758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.427763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.427822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:34.427881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:34.427951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:34.428010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:34.428063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:34.428069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:34.428116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652134:4999], now have 1 active actors on pipe
2025-10-10T14:33:34.428399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:34.428404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601205914652134:4999]
2025-10-10T14:33:34.428412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:34.428424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:34.428444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1024 reason: error at write: Disconnected sessionId: src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0
2025-10-10T14:33:34.428661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1024 sessionId: src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0 is DEAD
2025-10-10T14:33:34.428816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:34.428826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0] Write session will restart in 0.005833s
2025-10-10T14:33:34.428852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0] Write session: Do CDS request
2025-10-10T14:33:34.428858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:34.429064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:34.435872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.435956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:34.435970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1025
2025-10-10T14:33:34.436123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.436164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:34.436169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:34.436173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:34.436653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1025 sessionId:  describe result for acl check
2025-10-10T14:33:34.436695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:34.436701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:34.436703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:34.436710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601205914652213:4804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:34.437312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601205914652213:4804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:34.438028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:34.439499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:34.439700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:34.439713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:34.439724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:34.439773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:34.439814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601205132430466:6693]
2025-10-10T14:33:34.440012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601205914652213:4804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:34.440457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:34.440877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:34.440942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:34.441291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:34.441399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.441408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.441409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.441410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.441412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.441413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.441414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.441415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.441417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.441418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.441419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.441420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.441422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.441428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.441441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.441444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.441448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.441452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.441456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.441459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.441463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.441467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.441472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.441476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.441479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.441498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.441506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.441520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.441526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.441532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.441536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.441542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.441546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.441551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.441554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.441560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.441563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.441567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.441571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.441585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.441596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.441601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.441610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.441615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.441620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.441629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.441633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.441638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.441646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.441652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.441660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.441665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.441702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:34.444069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601205914652213:4804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:34.444085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601205914652213:4804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:34.444089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601205914652213:4804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:34.444098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:34.444107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:34.444435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:34.444450Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:34.444453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:34.444457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:34.444466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1024 [2:7559601205132430466:6693]
2025-10-10T14:33:34.444479Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:34.444497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:34.444506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.444509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.444512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.444531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:34.444543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:34.444555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:34.444627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.444634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.444636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.444638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:34.444708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:34.444715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.444727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.444743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.444760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:34.444787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652148:2438], now have 1 active actors on pipe
2025-10-10T14:33:34.444795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652250:4804], now have 1 active actors on pipe
2025-10-10T14:33:34.444804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601205132430461:6693]
2025-10-10T14:33:34.444810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601205132430461:6693]
2025-10-10T14:33:34.444812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601205132430461:6693]
2025-10-10T14:33:34.444826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:34.444818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1024
2025-10-10T14:33:34.444818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1024
2025-10-10T14:33:34.444845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:34.444858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:34.444866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:34.444869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:34.444870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:34.444871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:34.444925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.444934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.444949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601205132430461:6693]
2025-10-10T14:33:34.444962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:34.445000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:34.445007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:34.445013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.445016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.445018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:34.445029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.445045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:34.445071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.445251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.445260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.445276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.445443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1025 partition: 0 MaxSeqNo: 40 sessionId: src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0
2025-10-10T14:33:34.445865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5389-b2c98d75-47f2c45-aeb15860_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:34.448525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0] Write session: try to update token
2025-10-10T14:33:34.448543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:34.463192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId: src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:34.465031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:34.465054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:34.465057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:34.465059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:34.465070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601205132430461:6693]
2025-10-10T14:33:34.465075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601205132430461:6693]
2025-10-10T14:33:34.465080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601205132430461:6693]
2025-10-10T14:33:34.465127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:34.465131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:34.465140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.465142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:34.465143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:34.465148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:34.465359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:34.465975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:34.528741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601205914652259:4999]
2025-10-10T14:33:34.529047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1024, pipe: [1:7559601205914652259:4999]
2025-10-10T14:33:34.582555Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:34.582813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.582827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.582864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652259:4999], now have 1 active actors on pipe
2025-10-10T14:33:34.583083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:34.583152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601205914652259:4999]
2025-10-10T14:33:34.583175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:34.583177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:34.583271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1025 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0
2025-10-10T14:33:34.583491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1025 sessionId: src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0 is DEAD
2025-10-10T14:33:34.583650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:34.583662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0] Write session will restart in 0.005542s
2025-10-10T14:33:34.583687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0] Write session: Do CDS request
2025-10-10T14:33:34.583693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:34.590911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.590995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:34.591011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1026
2025-10-10T14:33:34.591139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.591185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:34.591197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:34.591200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:34.591565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1026 sessionId:  describe result for acl check
2025-10-10T14:33:34.591593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:34.591594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:34.591596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:34.591601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601205914652336:4797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:34.592166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601205914652336:4797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:34.592343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:34.593957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:34.594158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:34.594169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:34.594182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:34.594235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:34.594248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601205914652336:4797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:34.594276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601205132430574:6695]
2025-10-10T14:33:34.594905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:34.595174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:34.595223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:34.595512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:34.595559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.595564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.595564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.595565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.595566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.595566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.595567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.595568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.595569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.595570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.595570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.595571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.595572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.595575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.595584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.595587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.595589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.595591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.595594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.595596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.595598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.595602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.595607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.595611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.595614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.595618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.595625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.595632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.595637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.595640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.595643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.595646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.595649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.595653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.595656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.595659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.595661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.595665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.595668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.595671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.595674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.595678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.595681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.595684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.595686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.595690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.595692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.595695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.595698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.595701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.595704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.595707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.595729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:34.598069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601205914652336:4797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:34.598080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601205914652336:4797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:34.598084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601205914652336:4797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:34.598091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:34.598134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:34.598480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:34.598497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:34.598499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:34.598503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:34.598510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1025 [2:7559601205132430574:6695]
2025-10-10T14:33:34.598522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:34.598540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:34.598551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.598558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.598560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.598577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:34.598589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:34.598598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:34.598650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.598656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.598658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.598661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:34.598738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:34.598746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.598757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.598768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.598786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:34.598813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652266:2438], now have 1 active actors on pipe
2025-10-10T14:33:34.598820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652376:4797], now have 1 active actors on pipe
2025-10-10T14:33:34.598828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601205132430569:6695]
2025-10-10T14:33:34.598834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601205132430569:6695]
2025-10-10T14:33:34.598836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601205132430569:6695]
2025-10-10T14:33:34.598850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:34.598867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1025
2025-10-10T14:33:34.598889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1025
2025-10-10T14:33:34.598862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:34.598868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:34.598873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:34.598884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:34.598894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:34.598899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:34.598930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601205132430569:6695]
2025-10-10T14:33:34.598936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:34.598938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:34.598950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.598960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.599008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:34.599022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.599026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.599029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:34.599039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.599049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:34.599065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.599212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.599224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.599248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.599329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1026 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0
2025-10-10T14:33:34.599690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd17e32-2debbeb6-c9a568d2-c4bb5215_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:34.602321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0] Write session: try to update token
2025-10-10T14:33:34.602337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:34.616627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId: src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:34.617852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:34.617880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:34.617883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:34.617885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:34.617895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601205132430569:6695]
2025-10-10T14:33:34.617903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601205132430569:6695]
2025-10-10T14:33:34.617907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601205132430569:6695]
2025-10-10T14:33:34.617970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:34.617973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:34.617981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.617983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:34.617987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:34.617991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:34.618118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:34.619458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:34.683352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601205914652386:4999]
2025-10-10T14:33:34.683695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1025, pipe: [1:7559601205914652386:4999]
2025-10-10T14:33:34.737161Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:34.737476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.737491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.737538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652386:4999], now have 1 active actors on pipe
2025-10-10T14:33:34.737799Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:34.737833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601205914652386:4999]
2025-10-10T14:33:34.737846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:34.737875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:34.737964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1026 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0
2025-10-10T14:33:34.738160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1026 sessionId: src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0 is DEAD
2025-10-10T14:33:34.738382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:34.738394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0] Write session will restart in 0.006066s
2025-10-10T14:33:34.738419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0] Write session: Do CDS request
2025-10-10T14:33:34.738425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:34.745862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.745967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:34.745980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1027
2025-10-10T14:33:34.746111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.746147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:34.746154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:34.746157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:34.746521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1027 sessionId:  describe result for acl check
2025-10-10T14:33:34.746548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:34.746549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:34.746551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:34.746556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601205914652457:4791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:34.746686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:34.747095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601205914652457:4791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:34.748371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:34.748557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:34.748568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:34.748580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:34.748632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:34.748671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601205132430684:6698]
2025-10-10T14:33:34.749312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:34.749396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601205914652457:4791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:34.749579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:34.749622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:34.749964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:34.750021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.750027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.750028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.750029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.750031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.750032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.750033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.750035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.750037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.750038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.750039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.750040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.750042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.750047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.750061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.750066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.750070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.750074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.750079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.750083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.750088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.750091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.750096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.750099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.750103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.750107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.750113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.750122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.750128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.750133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.750137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.750142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.750146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.750151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.750156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.750161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.750165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.750170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.750174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.750179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.750183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.750188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.750193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.750197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.750201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.750206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.750211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.750215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.750220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.750234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.750239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.750244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.750287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:34.752538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601205914652457:4791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:34.752551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601205914652457:4791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:34.752555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601205914652457:4791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:34.752564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:34.752652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:34.753074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:34.753090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:34.753092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:34.753095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:34.753102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1026 [2:7559601205132430684:6698]
2025-10-10T14:33:34.753114Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:34.753130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:34.753139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.753144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.753146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.753162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:34.753169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:34.753181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:34.753237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.753244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.753246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.753248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:34.753314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:34.753322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.753351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.753366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.753384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:34.753409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652492:4791], now have 1 active actors on pipe
2025-10-10T14:33:34.753422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652388:2438], now have 1 active actors on pipe
2025-10-10T14:33:34.753430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601205132430679:6698]
2025-10-10T14:33:34.753432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601205132430679:6698]
2025-10-10T14:33:34.753435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601205132430679:6698]
2025-10-10T14:33:34.753449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:34.753464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:34.753468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:34.753471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:34.753463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1026
2025-10-10T14:33:34.753482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1026
2025-10-10T14:33:34.753473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:34.753477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:34.753480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:34.753504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601205132430679:6698]
2025-10-10T14:33:34.753507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:34.753510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:34.753522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.753527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.753575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c78adc74-5ac6096f-262cebfb-6981d415_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:34.753587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.753590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.753592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:34.753603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.753613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:34.753635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.753853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.753870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.753893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.754021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1027 partition: 0 MaxSeqNo: 40 sessionId: src_id|c78adc74-5ac6096f-262cebfb-6981d415_0
2025-10-10T14:33:34.754387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ab8b4c5-3fc66df4-2b5b5231-47f2f55a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c78adc74-5ac6096f-262cebfb-6981d415_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:34.756942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78adc74-5ac6096f-262cebfb-6981d415_0] Write session: try to update token
2025-10-10T14:33:34.756958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78adc74-5ac6096f-262cebfb-6981d415_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:34.770908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId: src_id|c78adc74-5ac6096f-262cebfb-6981d415_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:34.773275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:34.774719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.774752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.774776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:34.774788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:34.774792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:34.774794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:34.774804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601205132430679:6698]
2025-10-10T14:33:34.774812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601205132430679:6698]
2025-10-10T14:33:34.774818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601205132430679:6698]
2025-10-10T14:33:34.774871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:34.774882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:34.774886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:34.774889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.774889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:34.774892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:34.775029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:34.837987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601205914652499:4999]
2025-10-10T14:33:34.838277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1026, pipe: [1:7559601205914652499:4999]
2025-10-10T14:33:34.886878Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:34.887147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:34.887215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652499:4999], now have 1 active actors on pipe
2025-10-10T14:33:34.887315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:34.887376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601205914652499:4999]
2025-10-10T14:33:34.887406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:34.887418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:34.887422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:34.887506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1027 reason: error at write: Disconnected sessionId: src_id|c78adc74-5ac6096f-262cebfb-6981d415_0
2025-10-10T14:33:34.887688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1027 sessionId: src_id|c78adc74-5ac6096f-262cebfb-6981d415_0 is DEAD
2025-10-10T14:33:34.887841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78adc74-5ac6096f-262cebfb-6981d415_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:34.887852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78adc74-5ac6096f-262cebfb-6981d415_0] Write session will restart in 0.009524s
2025-10-10T14:33:34.887878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78adc74-5ac6096f-262cebfb-6981d415_0] Write session: Do CDS request
2025-10-10T14:33:34.887883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78adc74-5ac6096f-262cebfb-6981d415_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:34.896539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:34.898022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:34.898244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:34.898256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:34.898268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:34.898322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:34.898364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601205132430794:6700]
2025-10-10T14:33:34.898962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78adc74-5ac6096f-262cebfb-6981d415_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.898990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:34.899017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:34.899033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1028
2025-10-10T14:33:34.899215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:34.899252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:34.899263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:34.899268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:34.899327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:34.899384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:34.899693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1028 sessionId:  describe result for acl check
2025-10-10T14:33:34.899705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:34.899730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:34.899763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.899737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:34.899739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:34.899769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.899744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601205914652574:4785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:34.899771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.899772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.899773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.899774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.899775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.899776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.899777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.899778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.899779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.899781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.899782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.899788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.899800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.899804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.899808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.899812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.899816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.899820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.899824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.899827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.899832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.899835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.899839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.899842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.899851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.899860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:34.899865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.899870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:34.899873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.899878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:34.899882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.899887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:34.899892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.899896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:34.899901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.899907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:34.899912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.899924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:34.899927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.899932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:34.899942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.899947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:34.899951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.899955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:34.899960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.899964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.899968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.899974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.899978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.899983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.900018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:34.900391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601205914652574:4785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:34.902528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601205914652574:4785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:34.902555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:34.902915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:34.902934Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:34.902936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:34.902939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:34.902946Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1027 [2:7559601205132430794:6700]
2025-10-10T14:33:34.902959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:34.902984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:34.902987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.902991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.902996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.903013Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:34.903025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:34.903039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:34.903103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.903110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.903111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.903114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:34.903181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:34.903188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.903198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:34.903209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:34.903228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:34.903253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652501:2438], now have 1 active actors on pipe
2025-10-10T14:33:34.903266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601205132430789:6700]
2025-10-10T14:33:34.903268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601205132430789:6700]
2025-10-10T14:33:34.903261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1027
2025-10-10T14:33:34.903270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601205132430789:6700]
2025-10-10T14:33:34.903282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:34.903296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:34.903297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:34.903300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:34.903302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:34.903311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:34.903322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:34.903352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601205132430789:6700]
2025-10-10T14:33:34.903365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:34.903370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:34.908316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601205914652574:4785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:34.908340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601205914652574:4785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:34.908344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601205914652574:4785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:34.908355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:34.908638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652609:4785], now have 1 active actors on pipe
2025-10-10T14:33:34.908681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1027
2025-10-10T14:33:34.908760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.908780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.908814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:34.908830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:34.908838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:34.908843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:34.908860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:34.908883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:34.908920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.909098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.909107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.909123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:34.909195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1028 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0
2025-10-10T14:33:34.909621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78adc74-5ac6096f-262cebfb-6981d415_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:34.912340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0] Write session: try to update token
2025-10-10T14:33:34.912357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:34.920089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:34.920110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:34.920121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601205132430789:6700]
2025-10-10T14:33:34.920177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:34.920190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:34.920363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:34.920541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:34.920689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:34.920831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:34.921020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:34.921064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:34.926837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId: src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:34.929525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:34.929746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:34.929774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:34.929816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:34.929913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:34.932536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:34.932555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:34.932559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:34.932561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:34.932571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601205132430789:6700]
2025-10-10T14:33:34.932575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601205132430789:6700]
2025-10-10T14:33:34.932579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601205132430789:6700]
2025-10-10T14:33:34.932630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:34.932642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:34.932642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:34.932644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:34.932647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:34.932651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:34.932780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:34.987452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601205914652612:4999]
2025-10-10T14:33:34.987780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1027, pipe: [1:7559601205914652612:4999]
2025-10-10T14:33:35.044722Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:35.053127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.053161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.053386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.053460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.053533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.053607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.053844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.053875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.053969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.054035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.054103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.054176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.054226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.054234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.054302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.054367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.054434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.054503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.054553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.054560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.054628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.054692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.054759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.054827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.054917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.054927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.054997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.055059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.055127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.055190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.055240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.055249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.055317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.055381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.055443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.055509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.055557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.055564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.055635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.055696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.055765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.055831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.055879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.055888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.055953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.056014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.056079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.056147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.056194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.056201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.056270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.056329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.056392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.056458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.056506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.056514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.056582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:35.056645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:35.056709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:35.056782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:35.056829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:35.056836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:35.056895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601205914652612:4999], now have 1 active actors on pipe
2025-10-10T14:33:35.057136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:35.057150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:35.057191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1028 reason: error at write: Disconnected sessionId: src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0
2025-10-10T14:33:35.057232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601205914652612:4999]
2025-10-10T14:33:35.057267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:35.057449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1028 sessionId: src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0 is DEAD
2025-10-10T14:33:35.057581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:35.057593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0] Write session will restart in 0.007244s
2025-10-10T14:33:35.057632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0] Write session: Do CDS request
2025-10-10T14:33:35.057638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:35.057760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:35.065911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.065994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:35.066009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1029
2025-10-10T14:33:35.066262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.066322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:35.066346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:35.066355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:35.066836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1029 sessionId:  describe result for acl check
2025-10-10T14:33:35.066874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:35.066880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:35.066882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:35.066889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601210209619979:4777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:35.067471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601210209619979:4777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:35.068141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:35.069900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:35.070143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:35.070160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:35.070174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:35.070237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:35.070300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601209427398200:6702]
2025-10-10T14:33:35.070513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601210209619979:4777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:35.070971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:35.071311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:35.071365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:35.071717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:35.071795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.071807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.071808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.071809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.071811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.071812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.071814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.071815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.071816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.071818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.071819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.071821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.071822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.071829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.071844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.071849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.071854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.071858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.071863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.071868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.071872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.071877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.071882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.071887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.071891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.071895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.071903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.071912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.071919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.071926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.071931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.071937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.071941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.071947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.071953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.071959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.071964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.071971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.071977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.071982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.071994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.072000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.072012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.072022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.072026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.072030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.072034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.072039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.072044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.072050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.072061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.072068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.072118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:35.074547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:35.074591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601210209619979:4777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:35.074607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601210209619979:4777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:35.074611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601210209619979:4777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:35.074619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:35.074871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:35.074891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:35.074893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:35.074897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:35.074904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1028 [2:7559601209427398200:6702]
2025-10-10T14:33:35.074918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:35.074937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:35.074945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.074949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.074951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.074969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:35.074981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:35.074989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:35.075047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.075049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.075051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.075053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:35.075123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:35.075133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.075159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.075176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.075196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:35.075223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209619910:2438], now have 1 active actors on pipe
2025-10-10T14:33:35.075231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620017:4777], now have 1 active actors on pipe
2025-10-10T14:33:35.075240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601209427398194:6702]
2025-10-10T14:33:35.075247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601209427398194:6702]
2025-10-10T14:33:35.075249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601209427398194:6702]
2025-10-10T14:33:35.075245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1028
2025-10-10T14:33:35.075261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1028
2025-10-10T14:33:35.075264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:35.075286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:35.075293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:35.075296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:35.075298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:35.075302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:35.075305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:35.075350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.075360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.075375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601209427398194:6702]
2025-10-10T14:33:35.075387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:35.075393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:35.075420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:35.075433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.075436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.075445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:35.075457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.075473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:35.075498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.075654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.075663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.075726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.075827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1029 partition: 0 MaxSeqNo: 40 sessionId: src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0
2025-10-10T14:33:35.076240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5bc9a38-3dbfae5-b28239e4-fa10fbb9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:35.078891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0] Write session: try to update token
2025-10-10T14:33:35.078910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:35.093833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId: src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:35.095262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:35.095287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:35.095291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:35.095293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:35.095302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601209427398194:6702]
2025-10-10T14:33:35.095308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601209427398194:6702]
2025-10-10T14:33:35.095311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601209427398194:6702]
2025-10-10T14:33:35.095359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:35.095373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.095376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:35.095509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:35.095597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:35.095624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:35.095629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:35.096566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:35.157407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601210209620025:4999]
2025-10-10T14:33:35.157698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1028, pipe: [1:7559601210209620025:4999]
2025-10-10T14:33:35.206372Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:35.206693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.206705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.206750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620025:4999], now have 1 active actors on pipe
2025-10-10T14:33:35.206953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:35.206997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601210209620025:4999]
2025-10-10T14:33:35.207013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:35.207017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:35.207081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1029 reason: error at write: Disconnected sessionId: src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0
2025-10-10T14:33:35.207334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:35.207348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1029 sessionId: src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0 is DEAD
2025-10-10T14:33:35.207494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:35.207506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0] Write session will restart in 0.005072s
2025-10-10T14:33:35.207532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0] Write session: Do CDS request
2025-10-10T14:33:35.207538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:35.213898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.214008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:35.214022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1030
2025-10-10T14:33:35.214149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.214193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:35.214203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:35.214208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:35.214737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1030 sessionId:  describe result for acl check
2025-10-10T14:33:35.214773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:35.214779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:35.214781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:35.214787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601210209620070:4774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:35.215348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601210209620070:4774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:35.216955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:35.217318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601210209620070:4774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:35.218565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:35.218777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:35.218788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:35.218801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:35.218857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:35.218901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601209427398309:6704]
2025-10-10T14:33:35.219520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:35.219799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:35.219850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:35.220098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601210209620070:4774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:35.220112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601210209620070:4774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:35.220116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601210209620070:4774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:35.220125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:35.220162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:35.220221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.220227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.220228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.220230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.220231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.220232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.220234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.220235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.220236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.220237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.220239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.220240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.220241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.220246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.220258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.220262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.220267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.220270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.220275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.220279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.220283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.220287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.220291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.220295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.220299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.220303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.220310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.220319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.220325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.220336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.220340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.220345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.220350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.220354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.220364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.220370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.220374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.220380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.220389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.220394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.220402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.220407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.220417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.220422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.220431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.220436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.220441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.220450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.220454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.220459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.220464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.220469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.220508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:35.222873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:35.223205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:35.223219Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:35.223221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:35.223225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:35.223231Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1029 [2:7559601209427398309:6704]
2025-10-10T14:33:35.223243Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:35.223262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:35.223269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.223273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.223275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.223291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:35.223303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:35.223315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:35.223367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.223374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.223375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.223378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:35.223446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:35.223454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.223465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.223479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.223502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:35.223528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620132:4774], now have 1 active actors on pipe
2025-10-10T14:33:35.223536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620026:2438], now have 1 active actors on pipe
2025-10-10T14:33:35.223544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601209427398304:6704]
2025-10-10T14:33:35.223550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601209427398304:6704]
2025-10-10T14:33:35.223552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601209427398304:6704]
2025-10-10T14:33:35.223567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:35.223584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:35.223590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:35.223595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:35.223597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:35.223604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:35.223578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1029
2025-10-10T14:33:35.223607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:35.223583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1029
2025-10-10T14:33:35.223636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601209427398304:6704]
2025-10-10T14:33:35.223644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:35.223646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:35.223663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.223672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.223719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69af2509-41109e8d-8105d035-71899699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:35.223731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.223735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.223739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:35.223755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.223769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:35.223790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.223938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.223947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.223962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.224064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1030 partition: 0 MaxSeqNo: 40 sessionId: src_id|69af2509-41109e8d-8105d035-71899699_0
2025-10-10T14:33:35.224445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ab9c5-f42b5d76-c8e54db1-f5f43b01_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|69af2509-41109e8d-8105d035-71899699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:35.227181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69af2509-41109e8d-8105d035-71899699_0] Write session: try to update token
2025-10-10T14:33:35.227199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69af2509-41109e8d-8105d035-71899699_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:35.242016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId: src_id|69af2509-41109e8d-8105d035-71899699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:35.243258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:35.243279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:35.243283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:35.243285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:35.243295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601209427398304:6704]
2025-10-10T14:33:35.243299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601209427398304:6704]
2025-10-10T14:33:35.243306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601209427398304:6704]
2025-10-10T14:33:35.243349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:35.243358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.243359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:35.243358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:35.243365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:35.243369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:35.243498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:35.244767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:35.306939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601210209620141:4999]
2025-10-10T14:33:35.307278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1029, pipe: [1:7559601210209620141:4999]
2025-10-10T14:33:35.353142Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:35.353529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.353547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.353596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620141:4999], now have 1 active actors on pipe
2025-10-10T14:33:35.353860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601210209620141:4999]
2025-10-10T14:33:35.353860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:35.353865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:35.353892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:35.353953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1030 reason: error at write: Disconnected sessionId: src_id|69af2509-41109e8d-8105d035-71899699_0
2025-10-10T14:33:35.354090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:35.354183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1030 sessionId: src_id|69af2509-41109e8d-8105d035-71899699_0 is DEAD
2025-10-10T14:33:35.354355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69af2509-41109e8d-8105d035-71899699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:35.354367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69af2509-41109e8d-8105d035-71899699_0] Write session will restart in 0.006258s
2025-10-10T14:33:35.354393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69af2509-41109e8d-8105d035-71899699_0] Write session: Do CDS request
2025-10-10T14:33:35.354410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69af2509-41109e8d-8105d035-71899699_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:35.361899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69af2509-41109e8d-8105d035-71899699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.361980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:35.362004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1031
2025-10-10T14:33:35.362177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.362223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:35.362234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:35.362238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:35.362708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1031 sessionId:  describe result for acl check
2025-10-10T14:33:35.362744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:35.362746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:35.362747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:35.362753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601210209620208:4769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:35.363302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601210209620208:4769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:35.364707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:35.365324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601210209620208:4769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:35.366185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:35.366376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:35.366387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:35.366397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:35.366443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:35.366484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601209427398421:6706]
2025-10-10T14:33:35.367081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:35.367372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:35.367412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:35.367728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:35.367782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.367789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.367790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.367791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.367793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.367794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.367795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.367796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.367797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.367798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.367799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.367800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.367801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.367807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.367819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.367822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.367826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.367830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.367833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.367837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.367840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.367844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.367848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.367852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.367856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.367859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.367867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.367875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.367881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.367886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.367890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.367895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.367899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.367903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.367908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.367913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.367916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.367921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.367925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.367930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.367934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.367938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.367943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.367947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.367952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.367957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.367962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.367966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.367970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.367976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.367980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.367984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.368021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:35.368019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601210209620208:4769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:35.368034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601210209620208:4769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:35.368038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601210209620208:4769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:35.368047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:35.370388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:35.370772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:35.370789Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:35.370791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:35.370796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:35.370803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1030 [2:7559601209427398421:6706]
2025-10-10T14:33:35.370817Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:35.370837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:35.370840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.370844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.370846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.370864Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:35.370871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:35.370879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:35.370945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.370954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.370956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.370958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:35.371034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:35.371042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.371053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.371068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.371088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:35.371115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620248:4769], now have 1 active actors on pipe
2025-10-10T14:33:35.371124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620142:2438], now have 1 active actors on pipe
2025-10-10T14:33:35.371131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601209427398415:6706]
2025-10-10T14:33:35.371133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601209427398415:6706]
2025-10-10T14:33:35.371136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601209427398415:6706]
2025-10-10T14:33:35.371166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1030
2025-10-10T14:33:35.371168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1030
2025-10-10T14:33:35.371149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:35.371169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:35.371179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:35.371182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:35.371184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:35.371184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:35.371188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:35.371217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601209427398415:6706]
2025-10-10T14:33:35.371219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:35.371222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:35.371240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.371245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.371300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:35.371309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.371319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.371322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:35.371332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.371344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:35.371366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.371566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.371583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.371608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.371703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1031 partition: 0 MaxSeqNo: 40 sessionId: src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0
2025-10-10T14:33:35.372155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69af2509-41109e8d-8105d035-71899699_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:35.374941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0] Write session: try to update token
2025-10-10T14:33:35.374961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:35.390523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId: src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:35.391324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:35.391348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:35.391351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:35.391353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:35.391362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601209427398415:6706]
2025-10-10T14:33:35.391366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601209427398415:6706]
2025-10-10T14:33:35.391370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601209427398415:6706]
2025-10-10T14:33:35.391445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:35.391466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.391477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:35.391499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:35.391514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:35.391519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:35.391735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:35.393303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:35.453952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601210209620294:4999]
2025-10-10T14:33:35.454325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1030, pipe: [1:7559601210209620294:4999]
2025-10-10T14:33:35.506293Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:35.506811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.506826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.506864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620294:4999], now have 1 active actors on pipe
2025-10-10T14:33:35.507064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:35.507079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:35.507091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:35.507134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:35.507148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601210209620294:4999]
2025-10-10T14:33:35.507159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1031 reason: error at write: Disconnected sessionId: src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0
2025-10-10T14:33:35.507392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1031 sessionId: src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0 is DEAD
2025-10-10T14:33:35.507536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:35.507547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0] Write session will restart in 0.008595s
2025-10-10T14:33:35.507571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0] Write session: Do CDS request
2025-10-10T14:33:35.507577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:35.516985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:35.517877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.517971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:35.517986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1032
2025-10-10T14:33:35.518151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.518205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:35.518215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:35.518218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:35.518675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1032 sessionId:  describe result for acl check
2025-10-10T14:33:35.518716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:35.518723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:35.518725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:35.518732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601210209620370:4751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:35.519236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:35.519360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601210209620370:4751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:35.519447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:35.519459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:35.519471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:35.519534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:35.519578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601209427398583:6722]
2025-10-10T14:33:35.520040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:35.520357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:35.520409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:35.520719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:35.520784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.520791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.520792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.520794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.520795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.520796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.520797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.520798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.520799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.520800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.520801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.520803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.520804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.520810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.520822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.520825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.520829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.520833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.520836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.520840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.520844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.520848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.520852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.520855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.520859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.520863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.520870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.520879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.520885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.520892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.520896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.520902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.520906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.520911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.520916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.520920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.520924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.520929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.520933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.520937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.520941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.520945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.520950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.520954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.520958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.520963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.520967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.520972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.520976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.520980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.520985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.520989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.521026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:35.521605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601210209620370:4751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:35.523543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:35.524031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:35.524049Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:35.524052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:35.524056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:35.524064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1031 [2:7559601209427398583:6722]
2025-10-10T14:33:35.524079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:35.524098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:35.524101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.524105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.524107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.524126Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:35.524134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:35.524145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:35.524214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.524221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.524223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.524226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:35.524295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:35.524300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.524313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.524326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.524319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601210209620370:4751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:35.524334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601210209620370:4751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:35.524338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601210209620370:4751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:35.524346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:35.524345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:35.524373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620295:2438], now have 1 active actors on pipe
2025-10-10T14:33:35.524382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601209427398577:6722]
2025-10-10T14:33:35.524385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601209427398577:6722]
2025-10-10T14:33:35.524387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601209427398577:6722]
2025-10-10T14:33:35.524404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:35.524419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:35.524424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:35.524427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:35.524429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:35.524436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:35.524439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:35.524475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601209427398577:6722]
2025-10-10T14:33:35.524488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:35.524481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1031
2025-10-10T14:33:35.524520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:35.524599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620404:4751], now have 1 active actors on pipe
2025-10-10T14:33:35.524653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1031
2025-10-10T14:33:35.524698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.524708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.524739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:35.524751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.524759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.524762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:35.524776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.524794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:35.524809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.524972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.524986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.525011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.525094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1032 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0
2025-10-10T14:33:35.525524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb03348-c67c885b-48a19fde-9f9db2de_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:35.528364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0] Write session: try to update token
2025-10-10T14:33:35.528387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:35.542744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId: src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:35.543742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:35.543768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:35.543771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:35.543773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:35.543785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601209427398577:6722]
2025-10-10T14:33:35.543789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601209427398577:6722]
2025-10-10T14:33:35.543793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601209427398577:6722]
2025-10-10T14:33:35.543833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:35.543841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.543844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:35.543845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:35.543852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:35.543857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:35.543981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:35.545449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:35.607500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601210209620421:4999]
2025-10-10T14:33:35.607750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1031, pipe: [1:7559601210209620421:4999]
2025-10-10T14:33:35.656824Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:35.657409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.657431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.657478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620421:4999], now have 1 active actors on pipe
2025-10-10T14:33:35.657727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:35.657742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:35.657757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:35.657799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601210209620421:4999]
2025-10-10T14:33:35.657829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:35.657830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1032 reason: error at write: Disconnected sessionId: src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0
2025-10-10T14:33:35.658057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1032 sessionId: src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0 is DEAD
2025-10-10T14:33:35.658241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:35.658250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0] Write session will restart in 0.005751s
2025-10-10T14:33:35.658270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0] Write session: Do CDS request
2025-10-10T14:33:35.658277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:35.664904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.664969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:35.664984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1033
2025-10-10T14:33:35.665201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.665238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:35.665248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:35.665252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:35.665806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1033 sessionId:  describe result for acl check
2025-10-10T14:33:35.665844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:35.665851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:35.665854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:35.665861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601210209620498:4735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:35.666462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601210209620498:4735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:35.667357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:35.668572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601210209620498:4735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:35.668908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:35.669115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:35.669125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:35.669137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:35.669199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:35.669247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601209427398697:6725]
2025-10-10T14:33:35.669874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:35.670246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:35.670293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:35.670617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:35.670675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.670680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.670681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.670683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.670684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.670685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.670686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.670688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.670689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.670690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.670691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.670692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.670693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.670700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.670714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.670717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.670721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.670725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.670729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.670733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.670737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.670741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.670746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.670749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.670753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.670756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.670764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.670773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.670779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.670785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.670794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.670799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.670804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.670814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.670819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.670829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.670835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.670845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.670849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.670859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.670863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.670872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.670877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.670883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.670892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.670898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.670906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.670912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.670918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.670925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.670933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.670939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.670980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:35.671149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601210209620498:4735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:35.671163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601210209620498:4735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:35.671167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601210209620498:4735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:35.671175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:35.673388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:35.673857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:35.673871Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:35.673874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:35.673878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:35.673884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1032 [2:7559601209427398697:6725]
2025-10-10T14:33:35.673921Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:35.673942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:35.673953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.673956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.673961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.673978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:35.673987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:35.673995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:35.674052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.674060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.674061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.674064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:35.674131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:35.674139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.674151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.674163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.674181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:35.674207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620425:2438], now have 1 active actors on pipe
2025-10-10T14:33:35.674216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620534:4735], now have 1 active actors on pipe
2025-10-10T14:33:35.674223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601209427398692:6725]
2025-10-10T14:33:35.674225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601209427398692:6725]
2025-10-10T14:33:35.674228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601209427398692:6725]
2025-10-10T14:33:35.674243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:35.674265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:35.674265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:35.674268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:35.674270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:35.674285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:35.674261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1032
2025-10-10T14:33:35.674289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:35.674288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1032
2025-10-10T14:33:35.674315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601209427398692:6725]
2025-10-10T14:33:35.674326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:35.674335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:35.674351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.674362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.674415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:35.674427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.674431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.674434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:35.674446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.674462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:35.674485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.674645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.674659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.674683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.674776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1033 partition: 0 MaxSeqNo: 40 sessionId: src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0
2025-10-10T14:33:35.675204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c405a28-51ac2d73-7b8f9005-3f44e311_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:35.677986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0] Write session: try to update token
2025-10-10T14:33:35.678005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:35.692420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId: src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:35.694373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:35.694395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:35.694399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:35.694401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:35.694410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601209427398692:6725]
2025-10-10T14:33:35.694414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601209427398692:6725]
2025-10-10T14:33:35.694418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601209427398692:6725]
2025-10-10T14:33:35.694467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:35.694469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:35.694474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:35.694475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.694478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:35.694479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:35.694622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:35.695083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:35.757982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601210209620543:4999]
2025-10-10T14:33:35.758261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1032, pipe: [1:7559601210209620543:4999]
2025-10-10T14:33:35.809049Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:35.809404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.809425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.809473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620543:4999], now have 1 active actors on pipe
2025-10-10T14:33:35.809708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:35.809769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601210209620543:4999]
2025-10-10T14:33:35.809776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:35.809805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:35.809877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1033 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0
2025-10-10T14:33:35.810091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1033 sessionId: src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0 is DEAD
2025-10-10T14:33:35.810277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:35.810287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0] Write session will restart in 0.005000s
2025-10-10T14:33:35.810314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0] Write session: Do CDS request
2025-10-10T14:33:35.810320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:35.816824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.816920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:35.816940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1034
2025-10-10T14:33:35.817098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.817154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:35.817165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:35.817169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:35.817748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1034 sessionId:  describe result for acl check
2025-10-10T14:33:35.817782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:35.817789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:35.817791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:35.817797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601210209620597:4730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:35.818424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601210209620597:4730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:35.819836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:35.820467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601210209620597:4730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:35.821345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:35.821558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:35.821576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:35.821588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:35.821652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:35.821694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601209427398811:6727]
2025-10-10T14:33:35.822290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:35.822591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:35.822630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:35.822951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:35.823008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.823016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.823017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.823018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.823019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.823020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.823021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.823022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.823023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.823024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.823025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.823026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.823027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.823032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.823046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.823050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.823053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.823057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.823061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.823064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.823069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.823072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.823077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.823081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.823085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.823090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.823099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.823108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.823115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.823121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.823126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.823131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.823135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.823140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.823144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.823149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.823153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.823159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.823164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.823170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.823175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.823175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601210209620597:4730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:35.823180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.823189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601210209620597:4730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:35.823190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.823193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601210209620597:4730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:35.823195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.823202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:35.823199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.823204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.823208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.823212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.823216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.823221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.823227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.823232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.823277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:35.825602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:35.825960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:35.825972Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:35.825975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:35.825979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:35.825986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1033 [2:7559601209427398811:6727]
2025-10-10T14:33:35.825998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:35.826021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:35.826029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.826032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.826036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.826052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:35.826064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:35.826072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:35.826133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.826140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.826142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.826144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:35.826217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:35.826225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.826236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.826265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.826288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:35.826314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620653:4730], now have 1 active actors on pipe
2025-10-10T14:33:35.826323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620544:2438], now have 1 active actors on pipe
2025-10-10T14:33:35.826330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601209427398806:6727]
2025-10-10T14:33:35.826336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601209427398806:6727]
2025-10-10T14:33:35.826339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601209427398806:6727]
2025-10-10T14:33:35.826352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:35.826370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:35.826372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:35.826376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:35.826379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:35.826390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:35.826394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:35.826383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1033
2025-10-10T14:33:35.826420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601209427398806:6727]
2025-10-10T14:33:35.826428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:35.826418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1033
2025-10-10T14:33:35.826437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:35.826444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.826453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.826505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c516966-112833ad-84ded9f4-6f9c3246_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:35.826517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.826521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.826528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:35.826539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.826552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:35.826576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.826739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.826746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.826761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.826864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1034 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c516966-112833ad-84ded9f4-6f9c3246_0
2025-10-10T14:33:35.827284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c6e0e3-7c16cd4c-9c2e3d12-61397b63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c516966-112833ad-84ded9f4-6f9c3246_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:35.830055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c516966-112833ad-84ded9f4-6f9c3246_0] Write session: try to update token
2025-10-10T14:33:35.830073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c516966-112833ad-84ded9f4-6f9c3246_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:35.847107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId: src_id|4c516966-112833ad-84ded9f4-6f9c3246_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:35.847472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:35.847490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:35.847494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:35.847495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:35.847504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601209427398806:6727]
2025-10-10T14:33:35.847508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601209427398806:6727]
2025-10-10T14:33:35.847512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601209427398806:6727]
2025-10-10T14:33:35.847564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:35.847564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:35.847570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:35.847574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:35.847576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.847578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:35.847715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:35.849782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:35.910104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601210209620663:4999]
2025-10-10T14:33:35.910393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1033, pipe: [1:7559601210209620663:4999]
2025-10-10T14:33:35.968011Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:35.968456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.968479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.968530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620663:4999], now have 1 active actors on pipe
2025-10-10T14:33:35.968794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:35.969114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:35.969185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:35.969216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1034 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c516966-112833ad-84ded9f4-6f9c3246_0
2025-10-10T14:33:35.969242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601210209620663:4999]
2025-10-10T14:33:35.969444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1034 sessionId: src_id|4c516966-112833ad-84ded9f4-6f9c3246_0 is DEAD
2025-10-10T14:33:35.969607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c516966-112833ad-84ded9f4-6f9c3246_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:35.969619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c516966-112833ad-84ded9f4-6f9c3246_0] Write session will restart in 0.008912s
2025-10-10T14:33:35.969646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c516966-112833ad-84ded9f4-6f9c3246_0] Write session: Do CDS request
2025-10-10T14:33:35.969653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c516966-112833ad-84ded9f4-6f9c3246_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:35.979154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:35.979925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c516966-112833ad-84ded9f4-6f9c3246_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.979980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:35.979996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1035
2025-10-10T14:33:35.980137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:35.980177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:35.980182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:35.980185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:35.980675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1035 sessionId:  describe result for acl check
2025-10-10T14:33:35.980714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:35.980716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:35.980718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:35.980724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601210209620745:4726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:35.981006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:35.981227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:35.981239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:35.981252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:35.981325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:35.981378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601209427398926:6729]
2025-10-10T14:33:35.981312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601210209620745:4726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:35.982016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:35.982367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:35.982441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:35.982793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:35.982853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.982859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.982860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.982861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.982862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.982864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.982865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.982866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.982867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.982869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.982870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.982871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.982872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.982878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.982890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.982894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.982897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.982901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.982905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.982909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.982913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.982918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.982922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.982926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.982930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.982934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.982941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.982950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:35.982956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.982962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:35.982967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.982972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:35.982976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.982982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:35.982987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.983000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:35.983006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.983016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:35.983021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.983027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:35.983031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.983036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:35.983041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.983046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:35.983051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.983057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:35.983061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.983067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.983073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.983082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.983087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.983091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.983134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:35.985579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:35.986063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:35.986079Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:35.986082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:35.986086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:35.986091Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1034 [2:7559601209427398926:6729]
2025-10-10T14:33:35.986104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:35.986122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:35.986130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.986133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.986135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.986156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:35.986168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:35.986175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:35.986249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.986257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.986258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.986261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:35.986330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:35.986338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:35.986351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:35.986365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:35.986384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:35.986415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620667:2438], now have 1 active actors on pipe
2025-10-10T14:33:35.986427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601209427398921:6729]
2025-10-10T14:33:35.986430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601209427398921:6729]
2025-10-10T14:33:35.986432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601209427398921:6729]
2025-10-10T14:33:35.986446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:35.986486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1034
2025-10-10T14:33:35.986459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:35.986462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:35.986464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:35.986467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:35.986486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:35.986489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:35.986515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601209427398921:6729]
2025-10-10T14:33:35.986523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:35.986541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:35.986972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601210209620745:4726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:35.993324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601210209620745:4726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:35.993360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601210209620745:4726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:35.993364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601210209620745:4726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:35.993375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:35.993698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601210209620780:4726], now have 1 active actors on pipe
2025-10-10T14:33:35.993735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1034
2025-10-10T14:33:35.993806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.993823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.993906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6208217b-bb434e68-fce0c026-4876d713_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:35.993926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:35.993934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:35.993938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:35.993960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:35.993986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:35.994019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.994275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:35.994294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:35.994320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:35.994419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1035 partition: 0 MaxSeqNo: 40 sessionId: src_id|6208217b-bb434e68-fce0c026-4876d713_0
2025-10-10T14:33:35.994872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c516966-112833ad-84ded9f4-6f9c3246_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6208217b-bb434e68-fce0c026-4876d713_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:35.997753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6208217b-bb434e68-fce0c026-4876d713_0] Write session: try to update token
2025-10-10T14:33:35.997773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6208217b-bb434e68-fce0c026-4876d713_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:36.006371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:36.006393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:36.006397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:36.006400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:36.006411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601209427398921:6729]
2025-10-10T14:33:36.006416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601209427398921:6729]
2025-10-10T14:33:36.006421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601209427398921:6729]
2025-10-10T14:33:36.006474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:36.006473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:36.006480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:36.006482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.006484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:36.006485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:36.006621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:36.012874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId: src_id|6208217b-bb434e68-fce0c026-4876d713_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:36.015634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:36.069276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601214504588080:4999]
2025-10-10T14:33:36.069551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1034, pipe: [1:7559601214504588080:4999]
2025-10-10T14:33:36.128114Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:36.128428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.128445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.128469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588080:4999], now have 1 active actors on pipe
2025-10-10T14:33:36.128699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:36.128724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:36.128777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:36.128857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1035 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6208217b-bb434e68-fce0c026-4876d713_0
2025-10-10T14:33:36.129036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601214504588080:4999]
2025-10-10T14:33:36.129052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1035 sessionId: src_id|6208217b-bb434e68-fce0c026-4876d713_0 is DEAD
2025-10-10T14:33:36.129217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6208217b-bb434e68-fce0c026-4876d713_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:36.129226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6208217b-bb434e68-fce0c026-4876d713_0] Write session will restart in 0.007721s
2025-10-10T14:33:36.129252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6208217b-bb434e68-fce0c026-4876d713_0] Write session: Do CDS request
2025-10-10T14:33:36.129258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6208217b-bb434e68-fce0c026-4876d713_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:36.137851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6208217b-bb434e68-fce0c026-4876d713_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.137925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:36.137940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1036
2025-10-10T14:33:36.138108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.138150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:36.138160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:36.138164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:36.138299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:36.138565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1036 sessionId:  describe result for acl check
2025-10-10T14:33:36.138600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:36.138601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:36.138603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:36.138608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601214504588160:4724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:36.139159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601214504588160:4724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:36.139928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:36.140112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:36.140122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:36.140133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:36.140192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:36.140230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601213722366338:6731]
2025-10-10T14:33:36.140811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:36.141063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:36.141102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:36.141399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:36.141426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601214504588160:4724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:36.141459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.141465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.141466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.141468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.141469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.141470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.141471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.141472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.141473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.141474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.141475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.141476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.141477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.141483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.141495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.141499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.141503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.141505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.141507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.141509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.141512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.141514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.141516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.141518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.141520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.141522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.141528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.141534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.141540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.141545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.141549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.141554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.141558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.141562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.141567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.141571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.141575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.141581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.141585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.141590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.141594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.141599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.141603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.141608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.141612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.141618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.141622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.141627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.141631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.141636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.141641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.141646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.141687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:36.143879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601214504588160:4724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:36.143893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601214504588160:4724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:36.143897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601214504588160:4724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:36.143905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:36.143986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:36.144415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:36.144427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:36.144429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:36.144432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:36.144438Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1035 [2:7559601213722366338:6731]
2025-10-10T14:33:36.144452Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:36.144470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:36.144474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.144477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.144479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.144495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:36.144502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:36.144509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:36.144575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.144584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.144586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.144588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:36.144657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:36.144664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.144675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.144693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.144711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:36.144734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588195:4724], now have 1 active actors on pipe
2025-10-10T14:33:36.144744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588082:2438], now have 1 active actors on pipe
2025-10-10T14:33:36.144752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601213722366333:6731]
2025-10-10T14:33:36.144754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601213722366333:6731]
2025-10-10T14:33:36.144756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601213722366333:6731]
2025-10-10T14:33:36.144769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:36.144760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1035
2025-10-10T14:33:36.144772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1035
2025-10-10T14:33:36.144783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:36.144798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:36.144802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:36.144805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:36.144806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:36.144807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:36.144841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.144850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.144870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601213722366333:6731]
2025-10-10T14:33:36.144882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:36.144898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:36.144914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b761124-1e080b45-7a047171-1ffca133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:36.144922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.144926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.144928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:36.144940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.144958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:36.144985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.145172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.145180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.145196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.145302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1036 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b761124-1e080b45-7a047171-1ffca133_0
2025-10-10T14:33:36.145665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6208217b-bb434e68-fce0c026-4876d713_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b761124-1e080b45-7a047171-1ffca133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:36.148333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b761124-1e080b45-7a047171-1ffca133_0] Write session: try to update token
2025-10-10T14:33:36.148349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b761124-1e080b45-7a047171-1ffca133_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:36.162347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId: src_id|1b761124-1e080b45-7a047171-1ffca133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:36.163655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:36.163673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:36.163675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:36.163678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:36.163690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601213722366333:6731]
2025-10-10T14:33:36.163694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601213722366333:6731]
2025-10-10T14:33:36.163699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601213722366333:6731]
2025-10-10T14:33:36.163747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:36.163757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:36.163759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.163762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:36.163764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:36.163769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:36.163895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:36.165097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:36.229066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601214504588203:4999]
2025-10-10T14:33:36.229574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1035, pipe: [1:7559601214504588203:4999]
2025-10-10T14:33:36.276697Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:36.276955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.276975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.277027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588203:4999], now have 1 active actors on pipe
2025-10-10T14:33:36.277277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:36.277290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:36.277303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601214504588203:4999]
2025-10-10T14:33:36.277300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:36.277324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:36.277388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1036 reason: error at write: Disconnected sessionId: src_id|1b761124-1e080b45-7a047171-1ffca133_0
2025-10-10T14:33:36.277593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1036 sessionId: src_id|1b761124-1e080b45-7a047171-1ffca133_0 is DEAD
2025-10-10T14:33:36.277737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b761124-1e080b45-7a047171-1ffca133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:36.277746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b761124-1e080b45-7a047171-1ffca133_0] Write session will restart in 0.006733s
2025-10-10T14:33:36.277771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b761124-1e080b45-7a047171-1ffca133_0] Write session: Do CDS request
2025-10-10T14:33:36.277779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b761124-1e080b45-7a047171-1ffca133_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:36.285831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b761124-1e080b45-7a047171-1ffca133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.285969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:36.285984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1037
2025-10-10T14:33:36.286104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.286154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:36.286164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:36.286168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:36.286696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1037 sessionId:  describe result for acl check
2025-10-10T14:33:36.286738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:36.286746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:36.286748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:36.286755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601214504588282:4712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:36.287370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601214504588282:4712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:36.288332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:36.289391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601214504588282:4712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:36.290461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:36.290707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:36.290720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:36.290733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:36.290789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:36.290838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601213722366456:6733]
2025-10-10T14:33:36.291452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:36.291789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:36.291862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:36.292220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:36.292278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.292284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.292286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.292287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.292288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.292290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.292291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.292292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.292294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.292295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.292296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.292298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.292299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.292306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.292319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.292324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.292328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.292341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.292350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.292354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.292362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.292366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.292371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.292374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.292378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.292382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.292390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.292399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.292410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.292416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.292425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.292431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.292435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.292442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.292450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.292455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.292460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.292465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.292469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.292475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.292479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.292485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.292491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.292497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.292501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.292506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.292517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.292522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.292527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.292538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.292543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.292553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.292595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:36.292786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601214504588282:4712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:36.292799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601214504588282:4712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:36.292802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601214504588282:4712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:36.292809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:36.295096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:36.295409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:36.295419Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:36.295422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:36.295426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:36.295433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1036 [2:7559601213722366456:6733]
2025-10-10T14:33:36.295447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:36.295465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:36.295469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.295472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.295475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.295493Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:36.295500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:36.295508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:36.295609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.295618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.295621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.295623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:36.295696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:36.295703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.295716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.295727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.295745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:36.295776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588319:4712], now have 1 active actors on pipe
2025-10-10T14:33:36.295782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588204:2438], now have 1 active actors on pipe
2025-10-10T14:33:36.295791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601213722366450:6733]
2025-10-10T14:33:36.295794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601213722366450:6733]
2025-10-10T14:33:36.295796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601213722366450:6733]
2025-10-10T14:33:36.295817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:36.295841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:36.295845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:36.295822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1036
2025-10-10T14:33:36.295849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:36.295843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1036
2025-10-10T14:33:36.295851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:36.295858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:36.295861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:36.295892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601213722366450:6733]
2025-10-10T14:33:36.295904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:36.295910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:36.295926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.295935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.295987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:36.296000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.296007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.296019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:36.296042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.296066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:36.296109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.296299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.296312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.296332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.296426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1037 partition: 0 MaxSeqNo: 40 sessionId: src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0
2025-10-10T14:33:36.296818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b761124-1e080b45-7a047171-1ffca133_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:36.299480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0] Write session: try to update token
2025-10-10T14:33:36.299498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:36.314089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId: src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:36.315548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:36.315571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:36.315574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:36.315576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:36.315587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601213722366450:6733]
2025-10-10T14:33:36.315591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601213722366450:6733]
2025-10-10T14:33:36.315598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601213722366450:6733]
2025-10-10T14:33:36.315648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:36.315651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:36.315657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:36.315661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:36.315661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.315663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:36.315807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:36.316690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:36.377518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601214504588340:4999]
2025-10-10T14:33:36.377740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1036, pipe: [1:7559601214504588340:4999]
2025-10-10T14:33:36.427950Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:36.428373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.428390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.428436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588340:4999], now have 1 active actors on pipe
2025-10-10T14:33:36.428723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601214504588340:4999]
2025-10-10T14:33:36.428724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:36.428729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:36.428766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:36.428801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1037 reason: error at write: Disconnected sessionId: src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0
2025-10-10T14:33:36.428673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:36.429023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1037 sessionId: src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0 is DEAD
2025-10-10T14:33:36.429199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:36.429209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0] Write session will restart in 0.008669s
2025-10-10T14:33:36.429234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0] Write session: Do CDS request
2025-10-10T14:33:36.429240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:36.438908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.438977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:36.438991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1038
2025-10-10T14:33:36.439685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:36.439151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.439209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:36.439215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:36.439219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:36.439583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1038 sessionId:  describe result for acl check
2025-10-10T14:33:36.439622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:36.439624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:36.439626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:36.439632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601214504588435:4695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:36.440144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601214504588435:4695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:36.441143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:36.441347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:36.441357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:36.441369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:36.441423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:36.441462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601213722366599:6736]
2025-10-10T14:33:36.442067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:36.442313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:36.442293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601214504588435:4695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:36.442369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:36.442720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:36.442806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.442810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.442811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.442812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.442813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.442814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.442815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.442816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.442818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.442819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.442822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.442823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.442824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.442830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.442842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.442846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.442850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.442854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.442858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.442862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.442865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.442868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.442872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.442875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.442878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.442881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.442888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.442896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.442902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.442907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.442911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.442915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.442919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.442923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.442926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.442930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.442934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.442938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.442942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.442946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.442950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.442955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.442959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.442963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.442967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.442979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.442984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.442992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.442996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.443002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.443010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.443015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.443049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:36.445316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601214504588435:4695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:36.445343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601214504588435:4695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:36.445346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601214504588435:4695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:36.445355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:36.445371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:36.445805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:36.445815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:36.445817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:36.445821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:36.445828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1037 [2:7559601213722366599:6736]
2025-10-10T14:33:36.445840Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:36.445856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:36.445859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.445875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.445877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.445894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:36.445901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:36.445909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:36.445959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.445966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.445967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.445970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:36.446038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:36.446045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.446064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.446079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.446101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:36.446124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588342:2438], now have 1 active actors on pipe
2025-10-10T14:33:36.446132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588469:4695], now have 1 active actors on pipe
2025-10-10T14:33:36.446160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1037
2025-10-10T14:33:36.446200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1037
2025-10-10T14:33:36.446139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601213722366593:6736]
2025-10-10T14:33:36.446147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601213722366593:6736]
2025-10-10T14:33:36.446149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601213722366593:6736]
2025-10-10T14:33:36.446164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:36.446170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:36.446173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:36.446175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:36.446177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:36.446193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:36.446196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:36.446221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601213722366593:6736]
2025-10-10T14:33:36.446224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:36.446226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:36.446242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.446247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.446281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:36.446291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.446300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.446302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:36.446312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.446327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:36.446353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.446553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.446562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.446577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.446741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1038 partition: 0 MaxSeqNo: 40 sessionId: src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0
2025-10-10T14:33:36.447108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2b8b21-7c6c865d-565fcbbb-764b2b65_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:36.449845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0] Write session: try to update token
2025-10-10T14:33:36.449876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:36.465121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId: src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:36.466175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:36.466188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:36.466192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:36.466193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:36.466203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601213722366593:6736]
2025-10-10T14:33:36.466207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601213722366593:6736]
2025-10-10T14:33:36.466211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601213722366593:6736]
2025-10-10T14:33:36.466261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:36.466269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.466272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:36.466272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:36.466279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:36.466284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:36.466418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:36.467862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:36.529120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601214504588488:4999]
2025-10-10T14:33:36.529467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1037, pipe: [1:7559601214504588488:4999]
2025-10-10T14:33:36.579893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:36.580212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.580238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.580290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588488:4999], now have 1 active actors on pipe
2025-10-10T14:33:36.580519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:36.580529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:36.580553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601214504588488:4999]
2025-10-10T14:33:36.580569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:36.580572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:36.580648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1038 reason: error at write: Disconnected sessionId: src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0
2025-10-10T14:33:36.580863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1038 sessionId: src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0 is DEAD
2025-10-10T14:33:36.581032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:36.581043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0] Write session will restart in 0.008289s
2025-10-10T14:33:36.581069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0] Write session: Do CDS request
2025-10-10T14:33:36.581078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:36.590664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:36.590922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.592076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:36.592089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1039
2025-10-10T14:33:36.592239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.592236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:36.592286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:36.592297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:36.592302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:36.592489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:36.592504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:36.592519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:36.592585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:36.592628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601213722366744:6751]
2025-10-10T14:33:36.592708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1039 sessionId:  describe result for acl check
2025-10-10T14:33:36.592744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:36.592750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:36.592752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:36.592758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601214504588580:4689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:36.593245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:36.593316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601214504588580:4689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:36.593621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:36.593686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:36.594016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:36.594098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.594107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.594108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.594110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.594111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.594113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.594114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.594115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.594116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.594118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.594119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.594120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.594121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.594127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.594138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.594142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.594146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.594150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.594153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.594156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.594160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.594163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.594168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.594171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.594175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.594178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.594188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.594196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.594203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.594207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.594212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.594216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.594220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.594225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.594229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.594235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.594238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.594243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.594246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.594251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.594255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.594259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.594263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.594267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.594271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.594276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.594280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.594285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.594289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.594294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.594301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.594307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.594346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:36.596051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601214504588580:4689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:36.596756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:36.597178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:36.597188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:36.597190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:36.597194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:36.597202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1038 [2:7559601213722366744:6751]
2025-10-10T14:33:36.597214Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:36.597231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:36.597234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.597238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.597240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.597256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:36.597268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:36.597276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:36.597356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.597362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.597365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.597367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:36.597436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:36.597444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.597455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.597472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.597492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:36.597512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601213722366738:6751]
2025-10-10T14:33:36.597520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601213722366738:6751]
2025-10-10T14:33:36.597522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601213722366738:6751]
2025-10-10T14:33:36.597534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:36.597542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:36.597545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:36.597547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:36.597549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588490:2438], now have 1 active actors on pipe
2025-10-10T14:33:36.597559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:36.597575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:36.597578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:36.597600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601213722366738:6751]
2025-10-10T14:33:36.597607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:36.597615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:36.597627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1038
2025-10-10T14:33:36.599013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601214504588580:4689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:36.599025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601214504588580:4689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:36.599029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601214504588580:4689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:36.599038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:36.599289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588617:4689], now have 1 active actors on pipe
2025-10-10T14:33:36.599331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1038
2025-10-10T14:33:36.599408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.599421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.599453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:36.599482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.599490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.599493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:36.599505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.599520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:36.599553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.599714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.599740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.599758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.599841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1039 partition: 0 MaxSeqNo: 40 sessionId: src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0
2025-10-10T14:33:36.600218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b52816-51a5fec0-2839cce2-2177bcfa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:36.602945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0] Write session: try to update token
2025-10-10T14:33:36.602966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:36.614853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:36.614870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:36.614881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601213722366738:6751]
2025-10-10T14:33:36.614932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:36.615114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:36.615255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:36.615390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:36.615520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:36.615700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:36.615740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:36.615987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:36.617291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId: src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:36.620038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:36.620361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.620380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.620421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:36.620505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:36.627856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:36.627872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:36.627876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:36.627878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:36.627889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601213722366738:6751]
2025-10-10T14:33:36.627893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601213722366738:6751]
2025-10-10T14:33:36.627897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601213722366738:6751]
2025-10-10T14:33:36.627947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:36.627948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:36.627958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:36.627959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.627962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:36.627962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:36.628097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:36.680693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601214504588623:4999]
2025-10-10T14:33:36.681066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1038, pipe: [1:7559601214504588623:4999]
2025-10-10T14:33:36.740490Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:36.748332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.748360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.748540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.748609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.748679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.748740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.748782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.748787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.748855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.748915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.748976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.749036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.749080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.749082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.749152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.749208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.749266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.749326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.749478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.749481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.749548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.749644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.749710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.751876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:36.751888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:36.751893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:36.751925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1039 reason: error at write: Disconnected sessionId: src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0
2025-10-10T14:33:36.751946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601214504588623:4999]
2025-10-10T14:33:36.752324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:36.752333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0] Write session will restart in 0.007769s
2025-10-10T14:33:36.752358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0] Write session: Do CDS request
2025-10-10T14:33:36.752364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:36.752159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1039 sessionId: src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0 is DEAD
2025-10-10T14:33:36.749774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.749823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.749825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.749905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.749962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.750020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.750081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.750139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.750142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.750209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.750264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.750322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.750380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.750421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.750424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.750491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.750544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.750607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.750670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.750709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.750712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.750783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.750838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.750896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.750955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.750996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.750998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.751062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.751119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.751180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.751238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.751277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.751279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.751349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:36.751407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:36.751467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:36.751530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:36.751569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:36.751572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:36.751638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588623:4999], now have 1 active actors on pipe
2025-10-10T14:33:36.752646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:36.760889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.760965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:36.760993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1040
2025-10-10T14:33:36.761161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.761209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:36.761219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:36.761223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:36.762000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1040 sessionId:  describe result for acl check
2025-10-10T14:33:36.762041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:36.762057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:36.762059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:36.762066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601214504588688:4683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:36.762666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601214504588688:4683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:36.764770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:36.766306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601214504588688:4683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:36.766422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:36.766643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:36.766657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:36.766671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:36.766739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:36.766786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601213722366867:6754]
2025-10-10T14:33:36.767364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:36.767698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:36.767754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:36.768088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:36.768167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.768175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.768176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.768177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.768178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.768180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.768181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.768182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.768183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.768184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.768185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.768187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.768188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.768195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.768208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.768212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.768215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.768232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.768236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.768240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.768243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.768247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.768251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.768255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.768258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.768262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.768270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.768279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.768285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.768290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.768294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.768299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.768304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.768310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.768321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.768326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.768330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.768335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.768340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.768346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.768356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.768361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.768371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.768376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.768381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.768394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.768403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.768409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.768417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.768422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.768431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.768436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.768479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:36.770653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601214504588688:4683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:36.770668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601214504588688:4683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:36.770672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601214504588688:4683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:36.770681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:36.770965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:36.771338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:36.771350Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:36.771352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:36.771356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:36.771364Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1039 [2:7559601213722366867:6754]
2025-10-10T14:33:36.771377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:36.771399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:36.771402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.771405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.771408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.771424Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:36.771436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:36.771448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:36.771505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.771512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.771514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.771516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:36.771581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:36.771588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.771600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.771616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.771638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:36.771665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588743:4683], now have 1 active actors on pipe
2025-10-10T14:33:36.771669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588625:2438], now have 1 active actors on pipe
2025-10-10T14:33:36.771677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601213722366862:6754]
2025-10-10T14:33:36.771679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601213722366862:6754]
2025-10-10T14:33:36.771682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601213722366862:6754]
2025-10-10T14:33:36.771696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:36.771711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:36.771713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:36.771718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:36.771721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:36.771707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1039
2025-10-10T14:33:36.771741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1039
2025-10-10T14:33:36.771745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:36.771752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:36.771789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.771798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.771811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601213722366862:6754]
2025-10-10T14:33:36.771825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:36.771849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:36.771852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:36.771860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.771864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.771867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:36.771878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.771890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:36.771916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.772113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.772120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.772140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.772225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1040 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0
2025-10-10T14:33:36.772607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dae05acc-8ba6b3b8-1a895a16-52f0d611_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:36.775265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0] Write session: try to update token
2025-10-10T14:33:36.775284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:36.789578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId: src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:36.791200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:36.791219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:36.791222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:36.791224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:36.791236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601213722366862:6754]
2025-10-10T14:33:36.791239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601213722366862:6754]
2025-10-10T14:33:36.791243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601213722366862:6754]
2025-10-10T14:33:36.791286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:36.791291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:36.791295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:36.791297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:36.791304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.791306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:36.791453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:36.792298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:36.852171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601214504588750:4999]
2025-10-10T14:33:36.852501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1039, pipe: [1:7559601214504588750:4999]
2025-10-10T14:33:36.902746Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:36.903037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.903056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.903107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588750:4999], now have 1 active actors on pipe
2025-10-10T14:33:36.903313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:36.903325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:36.903344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:36.903395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601214504588750:4999]
2025-10-10T14:33:36.903397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1040 reason: error at write: Disconnected sessionId: src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0
2025-10-10T14:33:36.903637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1040 sessionId: src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0 is DEAD
2025-10-10T14:33:36.903808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:36.903817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0] Write session will restart in 0.009312s
2025-10-10T14:33:36.903836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0] Write session: Do CDS request
2025-10-10T14:33:36.903840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:36.904104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:36.913964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.914590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:36.916657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:36.916876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:36.916887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:36.916900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:36.916976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:36.917019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601213722366989:6756]
2025-10-10T14:33:36.914074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:36.914093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1041
2025-10-10T14:33:36.914228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:36.914260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:36.914266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:36.914272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:36.914753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1041 sessionId:  describe result for acl check
2025-10-10T14:33:36.914781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:36.914783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:36.914785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:36.914791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601214504588835:4679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:36.915343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601214504588835:4679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:36.917635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:36.917898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601214504588835:4679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:36.917978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:36.918027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:36.918355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:36.918410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.918416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.918418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.918419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.918420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.918421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.918423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.918424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.918425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.918426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.918427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.918429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.918430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.918437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.918450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.918454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.918458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.918462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.918466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.918470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.918474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.918478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.918482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.918487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.918491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.918495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.918502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.918511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:36.918517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.918523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:36.918528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.918533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:36.918537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.918543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:36.918548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.918553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:36.918562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.918567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:36.918572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.918585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:36.918589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.918595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:36.918600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.918605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:36.918609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.918617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:36.918621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.918626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.918630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.918636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.918641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.918646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.918684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:36.921044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601214504588835:4679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:36.921062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601214504588835:4679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:36.921066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601214504588835:4679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:36.921075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:36.921118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:36.921460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:36.921471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:36.921474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:36.921478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:36.921484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1040 [2:7559601213722366989:6756]
2025-10-10T14:33:36.921497Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:36.921517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:36.921524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.921528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.921530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.921548Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:36.921555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:36.921565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:36.921627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.921635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.921637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.921639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:36.921709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:36.921716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.921727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:36.921743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:36.921761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:36.921789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588870:4679], now have 1 active actors on pipe
2025-10-10T14:33:36.921793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601214504588752:2438], now have 1 active actors on pipe
2025-10-10T14:33:36.921800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601213722366983:6756]
2025-10-10T14:33:36.921803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601213722366983:6756]
2025-10-10T14:33:36.921805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601213722366983:6756]
2025-10-10T14:33:36.921817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:36.921833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:36.921836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:36.921842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:36.921857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:36.921863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:36.921838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1040
2025-10-10T14:33:36.921867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:36.921843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1040
2025-10-10T14:33:36.921893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601213722366983:6756]
2025-10-10T14:33:36.921896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:36.921899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:36.921911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.921921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.921973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a151733-3f9ba9c3-7e994745-f633a686_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:36.921985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:36.921991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:36.921993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:36.922005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:36.922020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:36.922043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.922201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:36.922217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:36.922244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:36.922326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1041 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a151733-3f9ba9c3-7e994745-f633a686_0
2025-10-10T14:33:36.922701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3aec81c-3b9b3938-a33c80e2-d13d1927_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a151733-3f9ba9c3-7e994745-f633a686_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:36.925461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a151733-3f9ba9c3-7e994745-f633a686_0] Write session: try to update token
2025-10-10T14:33:36.925482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a151733-3f9ba9c3-7e994745-f633a686_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:36.940328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId: src_id|3a151733-3f9ba9c3-7e994745-f633a686_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:36.940847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:36.940867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:36.940870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:36.940872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:36.940881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601213722366983:6756]
2025-10-10T14:33:36.940887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601213722366983:6756]
2025-10-10T14:33:36.940891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601213722366983:6756]
2025-10-10T14:33:36.940934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:36.940939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:36.940947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:36.940949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:36.940951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:36.940955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:36.941096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:36.943528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:37.003751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601218799556173:4999]
2025-10-10T14:33:37.004054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1040, pipe: [1:7559601218799556173:4999]
2025-10-10T14:33:37.057056Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:37.057385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.057397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.057460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556173:4999], now have 1 active actors on pipe
2025-10-10T14:33:37.057740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:37.057754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:37.057825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1041 reason: error at write: Disconnected sessionId: src_id|3a151733-3f9ba9c3-7e994745-f633a686_0
2025-10-10T14:33:37.058031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1041 sessionId: src_id|3a151733-3f9ba9c3-7e994745-f633a686_0 is DEAD
2025-10-10T14:33:37.058185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a151733-3f9ba9c3-7e994745-f633a686_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:37.058201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a151733-3f9ba9c3-7e994745-f633a686_0] Write session will restart in 0.009683s
2025-10-10T14:33:37.058176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:37.058209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601218799556173:4999]
2025-10-10T14:33:37.058229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a151733-3f9ba9c3-7e994745-f633a686_0] Write session: Do CDS request
2025-10-10T14:33:37.058247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a151733-3f9ba9c3-7e994745-f633a686_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:37.057723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:37.068924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a151733-3f9ba9c3-7e994745-f633a686_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.069012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:37.069028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1042
2025-10-10T14:33:37.069259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.069300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:37.069310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:37.069314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:37.069711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:37.069781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1042 sessionId:  describe result for acl check
2025-10-10T14:33:37.069825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:37.069831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:37.069833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:37.069840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601218799556260:4674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:37.070422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601218799556260:4674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:37.071567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:37.071795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:37.071807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:37.071819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:37.071877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:37.071923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601218017334408:6758]
2025-10-10T14:33:37.072551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:37.072900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:37.072951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601218799556260:4674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:37.072974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:37.073356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:37.073430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.073437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.073438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.073440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.073441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.073443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.073444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.073445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.073446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.073447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.073449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.073450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.073451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.073458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.073470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.073475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.073479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.073484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.073489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.073493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.073497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.073501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.073506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.073509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.073514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.073518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.073526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.073535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.073543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.073549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.073554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.073560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.073565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.073570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.073575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.073580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.073585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.073590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.073594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.073599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.073603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.073609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.073614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.073619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.073626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.073631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.073645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.073651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.073656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.073661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.073666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.073671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.073711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:37.076190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601218799556260:4674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:37.076206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601218799556260:4674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:37.076210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601218799556260:4674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:37.076220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:37.076218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:37.076604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:37.076615Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:37.076618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:37.076621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:37.076628Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1041 [2:7559601218017334408:6758]
2025-10-10T14:33:37.076642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:37.076663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:37.076671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.076675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.076677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.076694Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:37.076701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:37.076708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:37.076767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.076769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.076771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.076773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:37.076981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:37.076991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.077015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.076997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1041
2025-10-10T14:33:37.077033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.077030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1041
2025-10-10T14:33:37.077056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:37.077083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556294:4674], now have 1 active actors on pipe
2025-10-10T14:33:37.077093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556175:2438], now have 1 active actors on pipe
2025-10-10T14:33:37.077112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.077122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.077142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601218017334402:6758]
2025-10-10T14:33:37.077148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601218017334402:6758]
2025-10-10T14:33:37.077150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601218017334402:6758]
2025-10-10T14:33:37.077165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:37.077178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:37.077183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:37.077186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:37.077188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:37.077199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:37.077203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:37.077222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:37.077235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.077239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.077241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:37.077253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.077265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:37.077300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601218017334402:6758]
2025-10-10T14:33:37.077308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:37.077316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:37.077320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.077655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.077675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.077697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.077794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1042 partition: 0 MaxSeqNo: 40 sessionId: src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0
2025-10-10T14:33:37.078220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a151733-3f9ba9c3-7e994745-f633a686_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:37.080965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0] Write session: try to update token
2025-10-10T14:33:37.080986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:37.095726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId: src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:37.097201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:37.097216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:37.097219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:37.097221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:37.097230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601218017334402:6758]
2025-10-10T14:33:37.097236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601218017334402:6758]
2025-10-10T14:33:37.097239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601218017334402:6758]
2025-10-10T14:33:37.097293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:37.097301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.097302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:37.097308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:37.097313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:37.097315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:37.097510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:37.098369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:37.158389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601218799556301:4999]
2025-10-10T14:33:37.158747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1041, pipe: [1:7559601218799556301:4999]
2025-10-10T14:33:37.213803Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:37.214178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.214200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.214245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556301:4999], now have 1 active actors on pipe
2025-10-10T14:33:37.214441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:37.214455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:37.214463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:37.214520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601218799556301:4999]
2025-10-10T14:33:37.214548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1042 reason: error at write: Disconnected sessionId: src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0
2025-10-10T14:33:37.214620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:37.214786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1042 sessionId: src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0 is DEAD
2025-10-10T14:33:37.214956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:37.214968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0] Write session will restart in 0.009653s
2025-10-10T14:33:37.214993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0] Write session: Do CDS request
2025-10-10T14:33:37.215004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:37.224981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:37.226022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.226030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:37.226050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1043
2025-10-10T14:33:37.226238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.226275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:37.226287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:37.226290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:37.226783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:37.226782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1043 sessionId:  describe result for acl check
2025-10-10T14:33:37.226825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:37.226827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:37.226829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:37.226836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601218799556391:4660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:37.226997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:37.227009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:37.227022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:37.227082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:37.227129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601218017334533:6760]
2025-10-10T14:33:37.227518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601218799556391:4660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:37.227564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:37.227866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:37.227917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:37.228250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:37.228313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.228314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.228316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.228317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.228318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.228320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.228321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.228322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.228323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.228336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.228337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.228338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.228339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.228346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.228358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.228362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.228366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.228370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.228374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.228387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.228391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.228395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.228399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.228403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.228407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.228411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.228419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.228427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.228433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.228439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.228444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.228449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.228456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.228461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.228466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.228471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.228476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.228481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.228486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.228491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.228496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.228501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.228505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.228511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.228515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.228521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.228526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.228531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.228535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.228540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.228545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.228550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.228598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:37.229574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601218799556391:4660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:37.231549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:37.232082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:37.232093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:37.232096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:37.232100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:37.232106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1042 [2:7559601218017334533:6760]
2025-10-10T14:33:37.232119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:37.232136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:37.232140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.232143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.232147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.232164Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:37.232175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:37.232183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:37.232243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.232253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.232255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.232257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:37.232329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:37.232339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.232350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.232361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.232376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:37.232397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556304:2438], now have 1 active actors on pipe
2025-10-10T14:33:37.232409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601218017334527:6760]
2025-10-10T14:33:37.232411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601218017334527:6760]
2025-10-10T14:33:37.232413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601218017334527:6760]
2025-10-10T14:33:37.232427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:37.232441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:37.232450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:37.232454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:37.232456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:37.232461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:37.232464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:37.232464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1042
2025-10-10T14:33:37.232489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601218017334527:6760]
2025-10-10T14:33:37.232500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:37.232518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:37.232975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601218799556391:4660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:37.232989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601218799556391:4660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:37.232993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601218799556391:4660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:37.233001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:37.233202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556426:4660], now have 1 active actors on pipe
2025-10-10T14:33:37.233241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1042
2025-10-10T14:33:37.233304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.233314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.233357Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74cd07a-74e0b379-14acc412-40145d75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:37.233377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.233381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.233384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:37.233396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.233409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:37.233430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.233599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.233612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.233645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.233754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1043 partition: 0 MaxSeqNo: 40 sessionId: src_id|74cd07a-74e0b379-14acc412-40145d75_0
2025-10-10T14:33:37.234173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|797ab6b6-7bac16bd-d029302b-b9baae74_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|74cd07a-74e0b379-14acc412-40145d75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:37.245122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd07a-74e0b379-14acc412-40145d75_0] Write session: try to update token
2025-10-10T14:33:37.245144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd07a-74e0b379-14acc412-40145d75_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:37.249416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:37.249432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:37.249443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601218017334527:6760]
2025-10-10T14:33:37.249496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:37.249497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:37.249670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:37.249956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:37.250257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:37.250583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:37.250764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:37.250809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:37.263721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:37.263749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:37.263755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:37.263758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:37.263782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601218017334527:6760]
2025-10-10T14:33:37.263789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601218017334527:6760]
2025-10-10T14:33:37.263796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601218017334527:6760]
2025-10-10T14:33:37.263865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:37.263870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:37.263878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:37.263881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.263884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:37.263886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:37.264099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:37.264458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId: src_id|74cd07a-74e0b379-14acc412-40145d75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:37.267307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:37.314524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601218799556431:4999]
2025-10-10T14:33:37.314813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1042, pipe: [1:7559601218799556431:4999]
2025-10-10T14:33:37.378944Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:37.379367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.379392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.379417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556431:4999], now have 1 active actors on pipe
2025-10-10T14:33:37.379555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:37.379568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:37.379634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:37.379640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1043 reason: error at write: Disconnected sessionId: src_id|74cd07a-74e0b379-14acc412-40145d75_0
2025-10-10T14:33:37.379860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1043 sessionId: src_id|74cd07a-74e0b379-14acc412-40145d75_0 is DEAD
2025-10-10T14:33:37.379932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601218799556431:4999]
2025-10-10T14:33:37.379954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:37.380046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd07a-74e0b379-14acc412-40145d75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:37.380062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd07a-74e0b379-14acc412-40145d75_0] Write session will restart in 0.008995s
2025-10-10T14:33:37.380095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd07a-74e0b379-14acc412-40145d75_0] Write session: Do CDS request
2025-10-10T14:33:37.380109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd07a-74e0b379-14acc412-40145d75_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:37.390450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:37.390895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd07a-74e0b379-14acc412-40145d75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.391045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:37.391061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1044
2025-10-10T14:33:37.391204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.391240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:37.391246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:37.391249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:37.391693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1044 sessionId:  describe result for acl check
2025-10-10T14:33:37.391735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:37.391741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:37.391743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:37.391749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601218799556532:4656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:37.392192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:37.392353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601218799556532:4656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:37.392405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:37.392418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:37.392430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:37.392485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:37.392526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601218017334669:6763]
2025-10-10T14:33:37.393126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:37.393523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:37.393587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:37.393971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:37.394064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.394070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.394071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.394072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.394074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.394075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.394076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.394078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.394079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.394080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.394081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.394083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.394084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.394091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.394104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.394108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.394112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.394115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.394119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.394122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.394126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.394129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.394133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.394137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.394140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.394144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.394152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.394161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.394167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.394173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.394177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.394182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.394187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.394191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.394196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.394201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.394205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.394212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.394217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.394222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.394227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.394233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.394243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.394248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.394252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.394258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.394268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.394274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.394283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.394288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.394297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.394302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.394341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:37.395136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601218799556532:4656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:37.396831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:37.397216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:37.397229Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:37.397231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:37.397235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:37.397242Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1043 [2:7559601218017334669:6763]
2025-10-10T14:33:37.397255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:37.397274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:37.397278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.397282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.397285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.397303Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:37.397319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:37.397347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:37.397411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.397419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.397422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.397424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:37.397500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:37.397510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.397522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.397534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.397549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:37.397579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556443:2438], now have 1 active actors on pipe
2025-10-10T14:33:37.397592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601218017334664:6763]
2025-10-10T14:33:37.397598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601218017334664:6763]
2025-10-10T14:33:37.397600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601218017334664:6763]
2025-10-10T14:33:37.397605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1043
2025-10-10T14:33:37.397615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:37.397630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:37.397634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:37.397634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:37.397636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:37.397651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:37.397654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:37.397687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601218017334664:6763]
2025-10-10T14:33:37.397700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:37.397726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:37.397757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601218799556532:4656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:37.397774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601218799556532:4656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:37.397778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601218799556532:4656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:37.397788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:37.398014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556566:4656], now have 1 active actors on pipe
2025-10-10T14:33:37.398080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1043
2025-10-10T14:33:37.398168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.398179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.398210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:37.398225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.398233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.398235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:37.398250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.398269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:37.398286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.398443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.398452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.398471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.398562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1044 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0
2025-10-10T14:33:37.399009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74cd07a-74e0b379-14acc412-40145d75_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:37.401789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0] Write session: try to update token
2025-10-10T14:33:37.401808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:37.409177Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:37.409202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:37.409213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601218017334664:6763]
2025-10-10T14:33:37.409257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:37.409267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:37.410199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:37.410773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:37.410901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:37.411033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:37.411203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:37.411252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:37.417177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId: src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:37.420011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:37.420366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.420387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.420428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:37.420530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:37.426987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:37.427006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:37.427010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:37.427012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:37.427022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601218017334664:6763]
2025-10-10T14:33:37.427025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601218017334664:6763]
2025-10-10T14:33:37.427029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601218017334664:6763]
2025-10-10T14:33:37.427078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:37.427086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.427088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:37.427089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:37.427098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:37.427102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:37.427217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:37.480403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601218799556573:4999]
2025-10-10T14:33:37.480775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1043, pipe: [1:7559601218799556573:4999]
2025-10-10T14:33:37.541687Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:37.549954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.549979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.550163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.550237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.550304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.550375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.550826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.550843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.550912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.550972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.551035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.551149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.551219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.551227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.551331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.551446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.551510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.551577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.551622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.551631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.551734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.551838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.551908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.551976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.552021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.552028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.552100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.552205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.552302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.552363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.552405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.552412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.552483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.552551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.552621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.552691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.552753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.552760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.552834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.552894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.552958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.553023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.553081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.553089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.553153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.553215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.553279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.553357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.553415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.553422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.553486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.553543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.553608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.553671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.553719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.553726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.553793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:37.553905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:37.553973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:37.554041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:37.554100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:37.554112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:37.554175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556573:4999], now have 1 active actors on pipe
2025-10-10T14:33:37.554391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:37.554424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601218799556573:4999]
2025-10-10T14:33:37.554452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:37.554461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:37.554492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1044 reason: error at write: Disconnected sessionId: src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0
2025-10-10T14:33:37.554621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:37.554731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1044 sessionId: src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0 is DEAD
2025-10-10T14:33:37.554837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:37.554850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0] Write session will restart in 0.008328s
2025-10-10T14:33:37.554891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0] Write session: Do CDS request
2025-10-10T14:33:37.554897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:37.565004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.565095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:37.565114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1045
2025-10-10T14:33:37.565248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.565302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:37.565308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:37.565312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:37.565788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1045 sessionId:  describe result for acl check
2025-10-10T14:33:37.565836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:37.565844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:37.565846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:37.565853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601218799556690:4639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:37.565921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:37.566425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601218799556690:4639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:37.567906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:37.568152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:37.568161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:37.568173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:37.568239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:37.568297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601218017334834:6778]
2025-10-10T14:33:37.568400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601218799556690:4639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:37.568943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:37.569346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:37.569398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:37.569739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:37.569798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.569806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.569807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.569808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.569809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.569811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.569812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.569814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.569815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.569817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.569818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.569819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.569820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.569839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.569852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.569855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.569859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.569863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.569867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.569871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.569875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.569879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.569883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.569887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.569891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.569895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.569903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.569912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.569919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.569924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.569929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.569934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.569938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.569944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.569948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.569954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.569966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.569971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.569976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.569981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.569991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.569996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.570005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.570010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.570015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.570025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.570029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.570036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.570040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.570046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.570055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.570060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.570108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:37.572621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601218799556690:4639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:37.572636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601218799556690:4639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:37.572640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601218799556690:4639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:37.572649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:37.572688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:37.573223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:37.573235Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:37.573237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:37.573241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:37.573246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1044 [2:7559601218017334834:6778]
2025-10-10T14:33:37.573259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:37.573276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:37.573288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.573292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.573295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.573313Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:37.573320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:37.573355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:37.573430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.573439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.573441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.573443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:37.573511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:37.573519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.573531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.573548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.573567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:37.573594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556721:4639], now have 1 active actors on pipe
2025-10-10T14:33:37.573602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556602:2438], now have 1 active actors on pipe
2025-10-10T14:33:37.573609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601218017334829:6778]
2025-10-10T14:33:37.573612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601218017334829:6778]
2025-10-10T14:33:37.573614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601218017334829:6778]
2025-10-10T14:33:37.573628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:37.573614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1044
2025-10-10T14:33:37.573639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:37.573643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:37.573632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1044
2025-10-10T14:33:37.573647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:37.573649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:37.573659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:37.573662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:37.573704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.573712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.573726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601218017334829:6778]
2025-10-10T14:33:37.573737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:37.573751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:37.573771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:37.573783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.573787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.573792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:37.573804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.573819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:37.573856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.574064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.574072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.574086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.574177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1045 partition: 0 MaxSeqNo: 40 sessionId: src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0
2025-10-10T14:33:37.574539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0172e7-b3b09929-86eb67ee-85da4f8e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:37.577195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0] Write session: try to update token
2025-10-10T14:33:37.577214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:37.593273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId: src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:37.593841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:37.593862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:37.593866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:37.593868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:37.593877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601218017334829:6778]
2025-10-10T14:33:37.593882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601218017334829:6778]
2025-10-10T14:33:37.593885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601218017334829:6778]
2025-10-10T14:33:37.593932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:37.593936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:37.593938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:37.593942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:37.593945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.593947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:37.594098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:37.595966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:37.654457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601218799556735:4999]
2025-10-10T14:33:37.654638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1044, pipe: [1:7559601218799556735:4999]
2025-10-10T14:33:37.706010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:37.706278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.706292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.706340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556735:4999], now have 1 active actors on pipe
2025-10-10T14:33:37.706569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:37.706795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601218799556735:4999]
2025-10-10T14:33:37.706807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:37.706827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:37.706892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1045 reason: status is not ok: tablet will be restarted right now sessionId: src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0
2025-10-10T14:33:37.707134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1045 sessionId: src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0 is DEAD
2025-10-10T14:33:37.707298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:37.707309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0] Write session will restart in 0.007952s
2025-10-10T14:33:37.707336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0] Write session: Do CDS request
2025-10-10T14:33:37.707341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:37.716862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:37.716957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.717019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:37.717035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1046
2025-10-10T14:33:37.717204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.717242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:37.717254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:37.717257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:37.717728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1046 sessionId:  describe result for acl check
2025-10-10T14:33:37.717773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:37.717779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:37.717781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:37.717789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601218799556830:4626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:37.718449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601218799556830:4626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:37.718580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:37.718797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:37.718810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:37.718823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:37.718879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:37.718924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601218017334963:6781]
2025-10-10T14:33:37.719577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:37.719878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:37.719920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:37.720257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:37.720310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.720319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.720321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.720322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.720323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.720325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.720326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.720327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.720329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.720330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.720331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.720332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.720333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.720339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.720352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.720356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.720361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.720366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.720370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.720375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.720379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.720384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.720389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.720394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.720398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.720402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.720409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.720418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.720425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.720431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.720438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.720443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.720448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.720453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.720458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.720464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.720469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.720474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.720479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.720485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.720499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.720505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.720510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.720516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.720521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.720526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.720533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.720539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.720544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.720550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.720536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601218799556830:4626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:37.720555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.720561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.720606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:37.723283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:37.723345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601218799556830:4626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:37.723359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601218799556830:4626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:37.723362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601218799556830:4626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:37.723370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:37.723654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:37.723671Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:37.723673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:37.723677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:37.723684Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1045 [2:7559601218017334963:6781]
2025-10-10T14:33:37.723698Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:37.723717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:37.723720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.723723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.723726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.723745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:37.723760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:37.723768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:37.723830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.723839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.723841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.723845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:37.723919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:37.723927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.723939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.723950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.723966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:37.723989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556740:2438], now have 1 active actors on pipe
2025-10-10T14:33:37.723992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556864:4626], now have 1 active actors on pipe
2025-10-10T14:33:37.724001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601218017334957:6781]
2025-10-10T14:33:37.724004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601218017334957:6781]
2025-10-10T14:33:37.724006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601218017334957:6781]
2025-10-10T14:33:37.724020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:37.724033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:37.724036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:37.724039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:37.724041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:37.724059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:37.724063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:37.724068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1045
2025-10-10T14:33:37.724073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1045
2025-10-10T14:33:37.724095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601218017334957:6781]
2025-10-10T14:33:37.724113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:37.724138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:37.724249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.724260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.724294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:37.724308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.724316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.724319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:37.724330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.724344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:37.724364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.724561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.724570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.724590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.724730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1046 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0
2025-10-10T14:33:37.725137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|686dad17-e89fc427-9ed9ae79-2bcafec1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:37.728011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0] Write session: try to update token
2025-10-10T14:33:37.728034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:37.742756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId: src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:37.743676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:37.743701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:37.743704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:37.743707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:37.743719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601218017334957:6781]
2025-10-10T14:33:37.743725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601218017334957:6781]
2025-10-10T14:33:37.743730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601218017334957:6781]
2025-10-10T14:33:37.743790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:37.743789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:37.743797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:37.743801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:37.743807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.743810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:37.744004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:37.745846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:37.807067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601218799556871:4999]
2025-10-10T14:33:37.807369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1045, pipe: [1:7559601218799556871:4999]
2025-10-10T14:33:37.852646Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:37.853080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.853095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.853139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556871:4999], now have 1 active actors on pipe
2025-10-10T14:33:37.853372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:37.853389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:37.853412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601218799556871:4999]
2025-10-10T14:33:37.853424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:37.853426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:37.853502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1046 reason: error at write: Disconnected sessionId: src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0
2025-10-10T14:33:37.853718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1046 sessionId: src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0 is DEAD
2025-10-10T14:33:37.853856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:37.853866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0] Write session will restart in 0.005827s
2025-10-10T14:33:37.853891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0] Write session: Do CDS request
2025-10-10T14:33:37.853896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:37.860914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.861080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:37.861094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1047
2025-10-10T14:33:37.861251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:37.861302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:37.861312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:37.861316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:37.861833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1047 sessionId:  describe result for acl check
2025-10-10T14:33:37.861865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:37.861867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:37.861871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:37.861877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601218799556928:4618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:37.862451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601218799556928:4618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:37.864283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:37.864437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601218799556928:4618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:37.865875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:37.866109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:37.866120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:37.866135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:37.866198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:37.866246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601218017335090:6783]
2025-10-10T14:33:37.866870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:37.867166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:37.867152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601218799556928:4618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:37.867167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601218799556928:4618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:37.867171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601218799556928:4618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:37.867179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:37.867229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:37.867586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:37.867653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.867661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.867662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.867664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.867665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.867666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.867668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.867669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.867671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.867672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.867673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.867674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.867676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.867683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.867697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.867701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.867706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.867710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.867715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.867719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.867723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.867727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.867732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.867736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.867740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.867744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.867751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.867759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:37.867765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.867770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:37.867775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.867780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:37.867784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.867789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:37.867794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.867800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:37.867804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.867810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:37.867816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.867821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:37.867826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.867831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:37.867837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.867842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:37.867847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.867851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:37.867855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.867861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.867865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.867871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.867883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.867888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.867941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:37.870394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:37.870739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:37.870757Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:37.870760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:37.870763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:37.870772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1046 [2:7559601218017335090:6783]
2025-10-10T14:33:37.870785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:37.870810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:37.870818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.870822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.870824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.870856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:37.870868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:37.870876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:37.870939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.870947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.870949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.870952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:37.871022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:37.871031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.871042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:37.871053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:37.871075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:37.871100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556994:4618], now have 1 active actors on pipe
2025-10-10T14:33:37.871108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799556872:2438], now have 1 active actors on pipe
2025-10-10T14:33:37.871116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601218017335084:6783]
2025-10-10T14:33:37.871122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601218017335084:6783]
2025-10-10T14:33:37.871124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601218017335084:6783]
2025-10-10T14:33:37.871142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:37.871160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:37.871165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:37.871169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:37.871170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:37.871183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:37.871187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:37.871177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1046
2025-10-10T14:33:37.871179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1046
2025-10-10T14:33:37.871216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601218017335084:6783]
2025-10-10T14:33:37.871224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:37.871225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:37.871242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.871251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.871306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:37.871319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:37.871328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:37.871330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:37.871342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:37.871357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:37.871380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.871666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.871681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:37.871699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:37.871784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1047 partition: 0 MaxSeqNo: 40 sessionId: src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0
2025-10-10T14:33:37.872209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2ca9c4-4f1d0add-d53392cd-54cca215_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:37.874912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0] Write session: try to update token
2025-10-10T14:33:37.874933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:37.889120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId: src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:37.890096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:37.890114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:37.890117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:37.890120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:37.890129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601218017335084:6783]
2025-10-10T14:33:37.890134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601218017335084:6783]
2025-10-10T14:33:37.890138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601218017335084:6783]
2025-10-10T14:33:37.890185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:37.890187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:37.890193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:37.890195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:37.890198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:37.890198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:37.890335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:37.891665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:37.953488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601218799557004:4999]
2025-10-10T14:33:37.953727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1046, pipe: [1:7559601218799557004:4999]
2025-10-10T14:33:37.999600Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:37.999948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:37.999965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.000011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601218799557004:4999], now have 1 active actors on pipe
2025-10-10T14:33:38.000251Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:38.000279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:38.000294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:38.000307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601218799557004:4999]
2025-10-10T14:33:38.000337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:38.000361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1047 reason: error at write: Disconnected sessionId: src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0
2025-10-10T14:33:38.000557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1047 sessionId: src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0 is DEAD
2025-10-10T14:33:38.000699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:38.000712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0] Write session will restart in 0.005331s
2025-10-10T14:33:38.000737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0] Write session: Do CDS request
2025-10-10T14:33:38.000746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:38.006909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.006972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:38.006987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1048
2025-10-10T14:33:38.007167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.007225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:38.007235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:38.007239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:38.007756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1048 sessionId:  describe result for acl check
2025-10-10T14:33:38.007795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:38.007803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:38.007805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:38.007811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601223094524335:4616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:38.008429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601223094524335:4616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:38.010793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:38.010818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601223094524335:4616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:38.012645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:38.012854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:38.012868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:38.012880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:38.012931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:38.012970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601222312302515:6785]
2025-10-10T14:33:38.013519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601223094524335:4616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:38.013533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601223094524335:4616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:38.013538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601223094524335:4616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:38.013545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:38.013601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:38.013918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:38.013976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:38.014317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:38.014388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.014395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.014396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.014397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.014398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.014399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.014400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.014402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.014403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.014404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.014405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.014407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.014408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.014413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.014426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.014431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.014435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.014439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.014443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.014447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.014451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.014455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.014459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.014462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.014467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.014471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.014479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.014487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.014494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.014500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.014505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.014510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.014515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.014520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.014525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.014530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.014535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.014540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.014546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.014551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.014555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.014564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.014569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.014574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.014579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.014587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.014596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.014605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.014613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.014619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.014623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.014629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.014654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:38.017091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:38.017600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:38.017612Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:38.017614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:38.017618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:38.017625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1047 [2:7559601222312302515:6785]
2025-10-10T14:33:38.017638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:38.017657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:38.017661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.017664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.017667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.017684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:38.017691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:38.017704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:38.017765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.017775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.017778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.017780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:38.017859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:38.017867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.017880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.017908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.017932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:38.017953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524422:4616], now have 1 active actors on pipe
2025-10-10T14:33:38.017957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524301:2438], now have 1 active actors on pipe
2025-10-10T14:33:38.017964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601222312302509:6785]
2025-10-10T14:33:38.017968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601222312302509:6785]
2025-10-10T14:33:38.017970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601222312302509:6785]
2025-10-10T14:33:38.017987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:38.017983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1047
2025-10-10T14:33:38.018006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:38.017998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1047
2025-10-10T14:33:38.018026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:38.018029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:38.018029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:38.018033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:38.018035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:38.018054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601222312302509:6785]
2025-10-10T14:33:38.018062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:38.018074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:38.018103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.018113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.018144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:38.018157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.018161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.018163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:38.018176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.018191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:38.018210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.018348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.018355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.018370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.018466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1048 partition: 0 MaxSeqNo: 40 sessionId: src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0
2025-10-10T14:33:38.018922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524c59d4-fbe44e7d-a3c75b33-a53a894c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:38.021934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0] Write session: try to update token
2025-10-10T14:33:38.021953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:38.029842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:38.029862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:38.029876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601222312302509:6785]
2025-10-10T14:33:38.029927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:38.029937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:38.030185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:38.030356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:38.030520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:38.030662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:38.030853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:38.030900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:38.037671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId: src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:38.040289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:38.040511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.040531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.040579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:38.040675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:38.047804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:38.047823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:38.047826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:38.047828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:38.047840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601222312302509:6785]
2025-10-10T14:33:38.047845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601222312302509:6785]
2025-10-10T14:33:38.047849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601222312302509:6785]
2025-10-10T14:33:38.047889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:38.047895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:38.047897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:38.047903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:38.047905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.047908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:38.048047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:38.100441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601223094524434:4999]
2025-10-10T14:33:38.100803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1047, pipe: [1:7559601223094524434:4999]
2025-10-10T14:33:38.162795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:38.170134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.170163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.170345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.170408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.170472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.170540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.170587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.170599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.170667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.170725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.170790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.170860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.171316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.171329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.171443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.171546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.171649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.171741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.171783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.171790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.171882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.171947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.172010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.172076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.172120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.172128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.172194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.172259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.172320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.172380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.172422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.172430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.172533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.172622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.172686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.172755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.172811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.172818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.172884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.172943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.173003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.173060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.173108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.173113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.173172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.173227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.173289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.173366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.173410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.173416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.173477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.173535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.173595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.173660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.173706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.173716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.173783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.173857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.173923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.173983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.174037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.174044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.174112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524434:4999], now have 1 active actors on pipe
2025-10-10T14:33:38.174377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601223094524434:4999]
2025-10-10T14:33:38.174394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:38.174399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:38.174416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:38.174432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1048 reason: error at write: Disconnected sessionId: src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0
2025-10-10T14:33:38.174651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1048 sessionId: src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0 is DEAD
2025-10-10T14:33:38.174729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:38.174802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:38.174815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0] Write session will restart in 0.008703s
2025-10-10T14:33:38.174850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0] Write session: Do CDS request
2025-10-10T14:33:38.174856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:38.184924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.184992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:38.185019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1049
2025-10-10T14:33:38.185163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.185228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:38.185243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:38.185248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:38.185378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:38.185694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1049 sessionId:  describe result for acl check
2025-10-10T14:33:38.185738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:38.185744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:38.185746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:38.185753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601223094524528:4609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:38.186325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601223094524528:4609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:38.187203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:38.187353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:38.187361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:38.187370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:38.187405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:38.187437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601222312302645:6787]
2025-10-10T14:33:38.187854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:38.188137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:38.188180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:38.188384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:38.188418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.188422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.188423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.188424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.188424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.188425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.188426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.188426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.188427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.188427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.188428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.188428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.188429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.188433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.188440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.188442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.188445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.188447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.188449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.188452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.188454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.188456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.188458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.188461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.188463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.188465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.188469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.188474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.188479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.188482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.188484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.188488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.188492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.188497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.188501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.188506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.188509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.188514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.188517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.188522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.188525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.188529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.188533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.188538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.188542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.188548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.188554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.188559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.188562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.188566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.188570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.188574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.188603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:38.189112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601223094524528:4609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:38.190819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:38.191131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:38.191142Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:38.191145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:38.191148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:38.191156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1048 [2:7559601222312302645:6787]
2025-10-10T14:33:38.191168Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:38.191189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:38.191195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.191199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.191201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.191216Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:38.191224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:38.191231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:38.191284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.191295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.191297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.191300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:38.191423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:38.191430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.191441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.191452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.191472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:38.191473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1048
2025-10-10T14:33:38.191499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524435:2438], now have 1 active actors on pipe
2025-10-10T14:33:38.191513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601222312302639:6787]
2025-10-10T14:33:38.191515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601222312302639:6787]
2025-10-10T14:33:38.191517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601222312302639:6787]
2025-10-10T14:33:38.191526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:38.191534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:38.191542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:38.191543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:38.191547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:38.191559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:38.191562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:38.191596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601222312302639:6787]
2025-10-10T14:33:38.191609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:38.191614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:38.191752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601223094524528:4609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:38.191766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601223094524528:4609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:38.191769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601223094524528:4609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:38.191788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:38.191963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524564:4609], now have 1 active actors on pipe
2025-10-10T14:33:38.191996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1048
2025-10-10T14:33:38.192039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.192049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.192080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:38.192093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.192099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.192101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:38.192115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.192131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:38.192150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.192444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.192458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.192483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.192587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1049 partition: 0 MaxSeqNo: 40 sessionId: src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0
2025-10-10T14:33:38.192939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff7eb2-b02dc2d1-709330e8-45e77419_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:38.195651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0] Write session: try to update token
2025-10-10T14:33:38.195669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:38.211150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:38.211170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:38.211173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:38.211176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:38.211186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601222312302639:6787]
2025-10-10T14:33:38.211194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601222312302639:6787]
2025-10-10T14:33:38.211197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601222312302639:6787]
2025-10-10T14:33:38.211251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:38.211250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:38.211237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId: src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:38.211257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:38.211262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:38.211267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.211269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:38.211426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:38.214275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:38.274497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601223094524570:4999]
2025-10-10T14:33:38.274803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1048, pipe: [1:7559601223094524570:4999]
2025-10-10T14:33:38.318958Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:38.319605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.319624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.319673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524570:4999], now have 1 active actors on pipe
2025-10-10T14:33:38.319911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:38.319904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:38.319922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:38.319952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601223094524570:4999]
2025-10-10T14:33:38.319973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:38.319986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1049 reason: error at write: Disconnected sessionId: src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0
2025-10-10T14:33:38.320204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1049 sessionId: src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0 is DEAD
2025-10-10T14:33:38.320374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:38.320383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0] Write session will restart in 0.006497s
2025-10-10T14:33:38.320411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0] Write session: Do CDS request
2025-10-10T14:33:38.320421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:38.327826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.327925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:38.327943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1050
2025-10-10T14:33:38.328079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.328125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:38.328137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:38.328142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:38.328656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1050 sessionId:  describe result for acl check
2025-10-10T14:33:38.328699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:38.328705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:38.328708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:38.328714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601223094524644:4602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:38.329238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601223094524644:4602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:38.330547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:38.331301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601223094524644:4602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:38.332349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:38.332549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:38.332560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:38.332573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:38.332624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:38.332663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601222312302776:6789]
2025-10-10T14:33:38.333227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:38.333554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:38.333599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:38.333930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:38.333991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.333997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.333998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.333999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.334000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.334002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.334003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.334004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.334005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.334006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.334007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.334008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.334010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.334015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.334027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.334031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.334035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.334039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.334042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.334045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.334049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.334052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.334057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.334060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.334064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.334067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.334075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.334084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.334090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.334095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.334099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.334104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.334109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.334090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601223094524644:4602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:38.334114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.334122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.334118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601223094524644:4602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:38.334126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.334122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601223094524644:4602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:38.334130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.334131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:38.334135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.334143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.334149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.334153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.334158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.334169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.334173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.334178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.334183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.334192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.334197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.334201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.334205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.334218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.334222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.334258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:38.336454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:38.336942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:38.336957Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:38.336959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:38.336963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:38.336969Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1049 [2:7559601222312302776:6789]
2025-10-10T14:33:38.336982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:38.337000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:38.337008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.337011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.337013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.337031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:38.337043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:38.337050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:38.337115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.337123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.337125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.337128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:38.337196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:38.337203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.337215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.337228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.337258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:38.337289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524571:2438], now have 1 active actors on pipe
2025-10-10T14:33:38.337297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524696:4602], now have 1 active actors on pipe
2025-10-10T14:33:38.337305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601222312302770:6789]
2025-10-10T14:33:38.337307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601222312302770:6789]
2025-10-10T14:33:38.337309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601222312302770:6789]
2025-10-10T14:33:38.337323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:38.337319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1049
2025-10-10T14:33:38.337361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:38.337362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1049
2025-10-10T14:33:38.337360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:38.337363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:38.337366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:38.337381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:38.337384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:38.337427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.337437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.337452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601222312302770:6789]
2025-10-10T14:33:38.337465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:38.337488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:38.337503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:38.337513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.337522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.337524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:38.337535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.337549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:38.337579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.337809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.337821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.337837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.337979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1050 partition: 0 MaxSeqNo: 40 sessionId: src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0
2025-10-10T14:33:38.338353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9168ab39-c96c7d17-a479f7f0-881d44ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:38.341045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0] Write session: try to update token
2025-10-10T14:33:38.341076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:38.355662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId: src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:38.357058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:38.357079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:38.357082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:38.357084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:38.357094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601222312302770:6789]
2025-10-10T14:33:38.357099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601222312302770:6789]
2025-10-10T14:33:38.357103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601222312302770:6789]
2025-10-10T14:33:38.357153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:38.357162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.357170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:38.357229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:38.357243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:38.357248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:38.357363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:38.358658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:38.419926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601223094524718:4999]
2025-10-10T14:33:38.420271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1049, pipe: [1:7559601223094524718:4999]
2025-10-10T14:33:38.476376Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:38.477065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.477083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.477138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524718:4999], now have 1 active actors on pipe
2025-10-10T14:33:38.477462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601223094524718:4999]
2025-10-10T14:33:38.477470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:38.477508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:38.477514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:38.477637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1050 reason: error at write: Disconnected sessionId: src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0
2025-10-10T14:33:38.477645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:38.477883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1050 sessionId: src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0 is DEAD
2025-10-10T14:33:38.478063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:38.478074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0] Write session will restart in 0.005900s
2025-10-10T14:33:38.478109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0] Write session: Do CDS request
2025-10-10T14:33:38.478116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:38.484951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.485159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:38.485173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1051
2025-10-10T14:33:38.485317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.485383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:38.485394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:38.485398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:38.486045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1051 sessionId:  describe result for acl check
2025-10-10T14:33:38.486083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:38.486092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:38.486094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:38.486100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601223094524734:4599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:38.486718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601223094524734:4599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:38.489769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601223094524734:4599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:38.490851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:38.492511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:38.492760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:38.492774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:38.492786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:38.492848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:38.492877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601223094524734:4599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:38.492893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601222312302920:6792]
2025-10-10T14:33:38.492892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601223094524734:4599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:38.492896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601223094524734:4599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:38.492906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:38.493578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:38.493907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:38.493958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:38.494335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:38.494405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.494412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.494414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.494415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.494416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.494417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.494418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.494420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.494421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.494422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.494423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.494424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.494425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.494431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.494447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.494451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.494455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.494459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.494463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.494466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.494470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.494474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.494478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.494482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.494486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.494491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.494498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.494508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.494513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.494517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.494520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.494523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.494525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.494529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.494532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.494536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.494538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.494541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.494544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.494548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.494550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.494554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.494559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.494562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.494566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.494570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.494573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.494576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.494578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.494582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.494584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.494588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.494613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:38.497552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:38.498141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:38.498152Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:38.498154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:38.498159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:38.498165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1050 [2:7559601222312302920:6792]
2025-10-10T14:33:38.498178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:38.498194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:38.498200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.498202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.498204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.498220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:38.498232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:38.498245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:38.498327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.498332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.498333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.498335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:38.498395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:38.498401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.498409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.498415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.498430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:38.498450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601222312302915:6792]
2025-10-10T14:33:38.498456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601222312302915:6792]
2025-10-10T14:33:38.498459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601222312302915:6792]
2025-10-10T14:33:38.498467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:38.498477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:38.498480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:38.498482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:38.498486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:38.498502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:38.498505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:38.498517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524843:4599], now have 1 active actors on pipe
2025-10-10T14:33:38.498521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524719:2438], now have 1 active actors on pipe
2025-10-10T14:33:38.498541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601222312302915:6792]
2025-10-10T14:33:38.498555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:38.498577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1050
2025-10-10T14:33:38.498602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1050
2025-10-10T14:33:38.498598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:38.498676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.498684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.498721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:38.498730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.498734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.498737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:38.498764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.498776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:38.498795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.498932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.498940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.498954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.499027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1051 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0
2025-10-10T14:33:38.499439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a17c80-4bb256ad-efccb46f-df4e110a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:38.502284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0] Write session: try to update token
2025-10-10T14:33:38.502309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:38.513228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:38.513243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:38.513255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601222312302915:6792]
2025-10-10T14:33:38.513302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:38.513307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:38.513504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:38.513651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:38.513809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:38.513950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:38.514145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:38.514193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:38.517665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId: src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:38.520305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:38.520574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.520595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.520647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:38.520765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:38.537020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:38.537039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:38.537042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:38.537045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:38.537056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601222312302915:6792]
2025-10-10T14:33:38.537060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601222312302915:6792]
2025-10-10T14:33:38.537064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601222312302915:6792]
2025-10-10T14:33:38.537119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:38.537120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:38.537126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.537129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:38.537129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:38.537137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:38.537270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:38.577614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601223094524868:4999]
2025-10-10T14:33:38.577920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1050, pipe: [1:7559601223094524868:4999]
2025-10-10T14:33:38.652638Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:38.660772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.660799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.660990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.661061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.661133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.661201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.661249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.661258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.661353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.661469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.661590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.661664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.661709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.661712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.661795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.661852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.661952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.662012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.662062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.662070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.662137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.662208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.662278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.662373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.662416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.662425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.662501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.662569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.662641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.662705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.662750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.662753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.662825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.662884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.662960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.663025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.663083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.663086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.663157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.663212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.663277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.663340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.663390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.663393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.663467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.663525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.663599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.663719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.663773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.663776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.663881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.663942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.664006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.664071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.664116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.664119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.664187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.664249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.664309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.664373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.664415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.664417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.664486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524868:4999], now have 1 active actors on pipe
2025-10-10T14:33:38.665610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:38.665622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601223094524868:4999]
2025-10-10T14:33:38.665652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:38.665656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:38.665686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1051 reason: error at write: Disconnected sessionId: src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0
2025-10-10T14:33:38.665887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:38.665919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1051 sessionId: src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0 is DEAD
2025-10-10T14:33:38.666080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:38.666090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0] Write session will restart in 0.007690s
2025-10-10T14:33:38.666114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0] Write session: Do CDS request
2025-10-10T14:33:38.666120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:38.674968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.675055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:38.675074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1052
2025-10-10T14:33:38.675231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.675275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:38.675286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:38.675290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:38.675758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1052 sessionId:  describe result for acl check
2025-10-10T14:33:38.675798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:38.675804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:38.675806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:38.675812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601223094524975:4578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:38.676386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601223094524975:4578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:38.677558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:38.678652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601223094524975:4578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:38.679372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:38.679603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:38.679614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:38.679626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:38.679678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:38.679724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601222312303094:6808]
2025-10-10T14:33:38.680373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:38.680669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:38.680713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:38.681011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:38.681079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.681086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.681086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.681087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.681089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.681090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.681091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.681088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601223094524975:4578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:38.681092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.681093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.681113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601223094524975:4578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:38.681094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.681116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601223094524975:4578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:38.681095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.681096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.681124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:38.681097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.681103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.681114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.681118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.681121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.681125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.681128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.681131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.681134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.681137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.681141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.681144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.681147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.681150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.681157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.681164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.681170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.681175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.681178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.681182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.681186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.681190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.681194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.681199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.681203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.681207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.681212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.681215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.681219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.681223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.681227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.681232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.681236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.681240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.681244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.681249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.681252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.681258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.681263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.681267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.681306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:38.683846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:38.684151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:38.684162Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:38.684164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:38.684167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:38.684172Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1051 [2:7559601222312303094:6808]
2025-10-10T14:33:38.684180Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:38.684193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:38.684196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.684200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.684202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.684220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:38.684232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:38.684243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:38.684284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.684290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.684291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.684293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:38.684349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:38.684357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.684366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.684377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.684397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:38.684424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094524891:2438], now have 1 active actors on pipe
2025-10-10T14:33:38.684432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094525018:4578], now have 1 active actors on pipe
2025-10-10T14:33:38.684440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601222312303088:6808]
2025-10-10T14:33:38.684447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601222312303088:6808]
2025-10-10T14:33:38.684448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601222312303088:6808]
2025-10-10T14:33:38.684473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:38.684488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:38.684493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:38.684496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:38.684498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:38.684508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:38.684511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:38.684503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1051
2025-10-10T14:33:38.684511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1051
2025-10-10T14:33:38.684543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601222312303088:6808]
2025-10-10T14:33:38.684552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:38.684554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:38.684579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.684588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.684624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f091aae-aabb34a-a4d71e6-8b211850_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:38.684636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.684644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.684646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:38.684657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.684672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:38.684692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.684828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.684857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.684882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.685021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1052 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f091aae-aabb34a-a4d71e6-8b211850_0
2025-10-10T14:33:38.685414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ecc2d43-92702069-71e4bacf-e739e00f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f091aae-aabb34a-a4d71e6-8b211850_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:38.687992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f091aae-aabb34a-a4d71e6-8b211850_0] Write session: try to update token
2025-10-10T14:33:38.688017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f091aae-aabb34a-a4d71e6-8b211850_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:38.702225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId: src_id|6f091aae-aabb34a-a4d71e6-8b211850_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:38.704802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:38.704957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.704979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.706766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:38.706804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:38.706807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:38.706811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:38.706813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:38.706822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601222312303088:6808]
2025-10-10T14:33:38.706827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601222312303088:6808]
2025-10-10T14:33:38.706831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601222312303088:6808]
2025-10-10T14:33:38.706861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:38.706871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:38.706874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:38.706888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:38.706878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:38.706879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.706881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:38.707023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:38.766036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601223094525028:4999]
2025-10-10T14:33:38.766364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1051, pipe: [1:7559601223094525028:4999]
2025-10-10T14:33:38.821849Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:38.829721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.829756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.829954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.830029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.830097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.830172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.830227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.830241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.830320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.830384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.830454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.830528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.830574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.830582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.830658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.830724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.830791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.830865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.830911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.830918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.830991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.831060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.831136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.831251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.831298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.831306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.831380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.831453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.831526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.831643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.831692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.831701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.831774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.831837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.831901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.832016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.832067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.832080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.832150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.832218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.832285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.832379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.832443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.832457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.832531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.832596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.832664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.832730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.832773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.832779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.832850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.832917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.832982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.833056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.833107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.833116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.833187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:38.833251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:38.833318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:38.833406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:38.833452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:38.833459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:38.833526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094525028:4999], now have 1 active actors on pipe
2025-10-10T14:33:38.833755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:38.833768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:38.833815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1052 reason: error at write: Disconnected sessionId: src_id|6f091aae-aabb34a-a4d71e6-8b211850_0
2025-10-10T14:33:38.833881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601223094525028:4999]
2025-10-10T14:33:38.833922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:38.834038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1052 sessionId: src_id|6f091aae-aabb34a-a4d71e6-8b211850_0 is DEAD
2025-10-10T14:33:38.834168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f091aae-aabb34a-a4d71e6-8b211850_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:38.834180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f091aae-aabb34a-a4d71e6-8b211850_0] Write session will restart in 0.006095s
2025-10-10T14:33:38.834205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f091aae-aabb34a-a4d71e6-8b211850_0] Write session: Do CDS request
2025-10-10T14:33:38.834212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f091aae-aabb34a-a4d71e6-8b211850_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:38.834742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:38.841916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f091aae-aabb34a-a4d71e6-8b211850_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.842027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:38.842042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1053
2025-10-10T14:33:38.842169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.842208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:38.842218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:38.842222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:38.842799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1053 sessionId:  describe result for acl check
2025-10-10T14:33:38.842838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:38.842844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:38.842846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:38.842853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601223094525099:4576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:38.843440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601223094525099:4576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:38.845362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:38.846580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601223094525099:4576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:38.847035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:38.847291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:38.847306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:38.847321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:38.847387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:38.847432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601222312303228:6810]
2025-10-10T14:33:38.847990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:38.848366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:38.848415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:38.848756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:38.848818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.848825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.848826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.848827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.848829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.848830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.848831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.848831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.848833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.848834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.848835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.848836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.848837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.848843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.848856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.848860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.848864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.848869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.848873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.848877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.848881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.848885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.848889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.848892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.848896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.848900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.848908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.848917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:38.848924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.848929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:38.848932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.848938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:38.848942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.848946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:38.848951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.848956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:38.848961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.848965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:38.848970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.848977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:38.848983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.848988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:38.848998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.849004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:38.849008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.849018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:38.849022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.849027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.849032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.849037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.849046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.849053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.849094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:38.849157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601223094525099:4576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:38.849169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601223094525099:4576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:38.849173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601223094525099:4576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:38.849181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:38.851898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:38.852220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:38.852233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:38.852235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:38.852240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:38.852246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1052 [2:7559601222312303228:6810]
2025-10-10T14:33:38.852263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:38.852285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:38.852292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.852296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.852299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.852328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:38.852339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:38.852348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:38.852405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.852412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.852415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.852418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:38.852493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:38.852501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.852513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:38.852524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:38.852540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:38.852568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094525029:2438], now have 1 active actors on pipe
2025-10-10T14:33:38.852576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094525158:4576], now have 1 active actors on pipe
2025-10-10T14:33:38.852584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601222312303222:6810]
2025-10-10T14:33:38.852587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601222312303222:6810]
2025-10-10T14:33:38.852590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601222312303222:6810]
2025-10-10T14:33:38.852592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1052
2025-10-10T14:33:38.852606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:38.852599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1052
2025-10-10T14:33:38.852625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:38.852630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:38.852634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:38.852641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:38.852645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:38.852646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:38.852677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601222312303222:6810]
2025-10-10T14:33:38.852689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:38.852703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.852713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.852731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:38.852765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:38.852778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:38.852783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:38.852785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:38.852797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:38.852808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:38.852831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.853006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.853019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.853041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:38.853248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1053 partition: 0 MaxSeqNo: 40 sessionId: src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0
2025-10-10T14:33:38.853716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f091aae-aabb34a-a4d71e6-8b211850_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:38.856434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0] Write session: try to update token
2025-10-10T14:33:38.856451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:38.873618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId: src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:38.875562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:38.875579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:38.875583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:38.875585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:38.875594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601222312303222:6810]
2025-10-10T14:33:38.875599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601222312303222:6810]
2025-10-10T14:33:38.875602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601222312303222:6810]
2025-10-10T14:33:38.875654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:38.875658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:38.875661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:38.875664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:38.875667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:38.875672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:38.875803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:38.876333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:38.933969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601223094525168:4999]
2025-10-10T14:33:38.934293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1052, pipe: [1:7559601223094525168:4999]
2025-10-10T14:33:38.988955Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:38.989468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:38.989483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:38.989528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094525168:4999], now have 1 active actors on pipe
2025-10-10T14:33:38.989715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:38.989732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:38.989724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601223094525168:4999]
2025-10-10T14:33:38.989749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:38.989755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:38.989920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1053 reason: error at write: Disconnected sessionId: src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0
2025-10-10T14:33:38.990107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1053 sessionId: src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0 is DEAD
2025-10-10T14:33:38.990273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:38.990289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0] Write session will restart in 0.008719s
2025-10-10T14:33:38.990308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0] Write session: Do CDS request
2025-10-10T14:33:38.990313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:38.999682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:38.999843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:38.999951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:38.999965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1054
2025-10-10T14:33:39.000097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.000131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:39.000143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:39.000147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:39.000591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1054 sessionId:  describe result for acl check
2025-10-10T14:33:39.000625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:39.000631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:39.000633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:39.000639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601227389492561:4571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:39.001186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601227389492561:4571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:39.001245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:39.001431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:39.001442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:39.001455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:39.001506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:39.001543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601226607270658:6812]
2025-10-10T14:33:39.002232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:39.002514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:39.002575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:39.002924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:39.002999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.003003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.003005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.003006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.003007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.003008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.003009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.003011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.003012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.003013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.003014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.003015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.003017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.003023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.003035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.003039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.003044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.003048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.003052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.003056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.003061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.003065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.003070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.003074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.003079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.003082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.003090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.003099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.003106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.003112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.003117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.003123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.003128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.003134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.003146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.003151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.003157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.003167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.003172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.003177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.003182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.003187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.003191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.003197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.003201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.003212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.003216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.003221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.003230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.003235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.003240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.003246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.003286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:39.003481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601227389492561:4571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:39.005845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601227389492561:4571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:39.005858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601227389492561:4571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:39.005862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601227389492561:4571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:39.005870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:39.005901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:39.006211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:39.006223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:39.006226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:39.006230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:39.006235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1053 [2:7559601226607270658:6812]
2025-10-10T14:33:39.006244Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:39.006258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:39.006260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.006262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.006264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.006278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:39.006288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:39.006294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:39.006337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.006343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.006344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.006346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:39.006397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:39.006404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.006411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.006418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.006427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:39.006450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601222312303357:6812]
2025-10-10T14:33:39.006457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601222312303357:6812]
2025-10-10T14:33:39.006459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601222312303357:6812]
2025-10-10T14:33:39.006473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:39.006485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601223094525169:2438], now have 1 active actors on pipe
2025-10-10T14:33:39.006488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:39.006491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:39.006492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:39.006493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492596:4571], now have 1 active actors on pipe
2025-10-10T14:33:39.006500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:39.006517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:39.006521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:39.006538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1053
2025-10-10T14:33:39.006550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601222312303357:6812]
2025-10-10T14:33:39.006561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1053
2025-10-10T14:33:39.006569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:39.006580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:39.006602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.006607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.006645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:39.006657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.006661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.006663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:39.006673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.006688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:39.006713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.006866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.006880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.006905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.006988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1054 partition: 0 MaxSeqNo: 40 sessionId: src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0
2025-10-10T14:33:39.007388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e03eb8c7-fcc5aee-e0037f38-99245d94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:39.010186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0] Write session: try to update token
2025-10-10T14:33:39.010206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:39.024818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId: src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:39.027378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:39.027677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.027700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.027744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:39.027841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:39.030501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:39.030522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:39.030525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:39.030527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:39.030536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601222312303357:6812]
2025-10-10T14:33:39.030541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601222312303357:6812]
2025-10-10T14:33:39.030545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601222312303357:6812]
2025-10-10T14:33:39.030589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:39.030593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:39.030595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:39.030600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:39.030601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.030603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:39.030741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:39.090103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601227389492604:4999]
2025-10-10T14:33:39.090358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1053, pipe: [1:7559601227389492604:4999]
2025-10-10T14:33:39.144822Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:39.153026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.153057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.153243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.153308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.153445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.153522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.153570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.153581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.153658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.153723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.153806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.153890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.153940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.153948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.154017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.154085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.154153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.154223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.154271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.154278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.154350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.154418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.154484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.154550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.154599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.154606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.154677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.154742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.154810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.154880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.154929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.154936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.155006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.155073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.155146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.155213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.155263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.155271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.155342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.155401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.155464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.155533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.155580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.155592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.155669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.155738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.155807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.155874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.155924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.155931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.156000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.156064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.156136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.156205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.156250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.156257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.156325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:39.156394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:39.156463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:39.156534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:39.156583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:39.156592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:39.156654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492604:4999], now have 1 active actors on pipe
2025-10-10T14:33:39.156882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:39.156883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601227389492604:4999]
2025-10-10T14:33:39.156921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:39.156924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:39.156952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1054 reason: error at write: Disconnected sessionId: src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0
2025-10-10T14:33:39.157168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1054 sessionId: src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0 is DEAD
2025-10-10T14:33:39.157304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:39.157314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0] Write session will restart in 0.005323s
2025-10-10T14:33:39.157352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0] Write session: Do CDS request
2025-10-10T14:33:39.157359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:39.157821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:39.163926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.164005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:39.164021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1055
2025-10-10T14:33:39.164234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.164276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:39.164288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:39.164292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:39.164788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1055 sessionId:  describe result for acl check
2025-10-10T14:33:39.164832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:39.164840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:39.164843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:39.164850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601227389492620:4565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:39.165461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601227389492620:4565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:39.168445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601227389492620:4565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:39.171674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601227389492620:4565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:39.171694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:39.171691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601227389492620:4565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:39.171695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601227389492620:4565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:39.171704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:39.173848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:39.174118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:39.174130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:39.174145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:39.174223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:39.174284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601226607270796:6814]
2025-10-10T14:33:39.174911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:39.175245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:39.175306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:39.175654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:39.175708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.175715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.175716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.175717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.175719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.175720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.175721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.175723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.175724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.175726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.175727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.175728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.175729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.175736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.175750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.175754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.175758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.175762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.175766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.175770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.175774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.175778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.175783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.175787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.175791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.175795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.175803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.175812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.175818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.175824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.175828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.175833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.175838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.175843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.175848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.175854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.175859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.175864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.175869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.175875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.175879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.175885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.175890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.175895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.175900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.175905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.175909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.175915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.175921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.175927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.175932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.175937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.175980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:39.178976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:39.179563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:39.179577Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:39.179580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:39.179584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:39.179592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1054 [2:7559601226607270796:6814]
2025-10-10T14:33:39.179606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:39.179631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:39.179639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.179643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.179645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.179663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:39.179676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:39.179685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:39.179752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.179763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.179765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.179767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:39.179839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:39.179848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.179861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.179872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.179890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:39.179918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601226607270790:6814]
2025-10-10T14:33:39.179925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601226607270790:6814]
2025-10-10T14:33:39.179927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601226607270790:6814]
2025-10-10T14:33:39.179937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:39.179949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:39.179958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:39.179959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492605:2438], now have 1 active actors on pipe
2025-10-10T14:33:39.179960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:39.179966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492732:4565], now have 1 active actors on pipe
2025-10-10T14:33:39.179972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:39.179991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:39.180001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:39.180034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601226607270790:6814]
2025-10-10T14:33:39.180024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1054
2025-10-10T14:33:39.180044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:39.180055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:39.180074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1054
2025-10-10T14:33:39.180174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.180186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.180221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2398ac68-699c158b-46fda24e-58ca678a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:39.180236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.180240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.180243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:39.180257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.180269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:39.180285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.180471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.180484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.180504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.180594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1055 partition: 0 MaxSeqNo: 40 sessionId: src_id|2398ac68-699c158b-46fda24e-58ca678a_0
2025-10-10T14:33:39.181026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c84794-fe4e25f6-6a004368-1d7ffe65_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2398ac68-699c158b-46fda24e-58ca678a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:39.183729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2398ac68-699c158b-46fda24e-58ca678a_0] Write session: try to update token
2025-10-10T14:33:39.183754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2398ac68-699c158b-46fda24e-58ca678a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:39.199248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId: src_id|2398ac68-699c158b-46fda24e-58ca678a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:39.200839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:39.200858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:39.200862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:39.200864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:39.200875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601226607270790:6814]
2025-10-10T14:33:39.200880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601226607270790:6814]
2025-10-10T14:33:39.200884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601226607270790:6814]
2025-10-10T14:33:39.200936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:39.200943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:39.200946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.200948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:39.200951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:39.200956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:39.201082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:39.202146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:39.257031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601227389492745:4999]
2025-10-10T14:33:39.257269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1054, pipe: [1:7559601227389492745:4999]
2025-10-10T14:33:39.308092Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:39.308381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.308396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.308446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492745:4999], now have 1 active actors on pipe
2025-10-10T14:33:39.308712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:39.308712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:39.308743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:39.308748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:39.308779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601227389492745:4999]
2025-10-10T14:33:39.308813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1055 reason: error at write: Disconnected sessionId: src_id|2398ac68-699c158b-46fda24e-58ca678a_0
2025-10-10T14:33:39.309032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1055 sessionId: src_id|2398ac68-699c158b-46fda24e-58ca678a_0 is DEAD
2025-10-10T14:33:39.309224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2398ac68-699c158b-46fda24e-58ca678a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:39.309238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2398ac68-699c158b-46fda24e-58ca678a_0] Write session will restart in 0.007117s
2025-10-10T14:33:39.309266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2398ac68-699c158b-46fda24e-58ca678a_0] Write session: Do CDS request
2025-10-10T14:33:39.309273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2398ac68-699c158b-46fda24e-58ca678a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:39.317948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2398ac68-699c158b-46fda24e-58ca678a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.318049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:39.318069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1056
2025-10-10T14:33:39.318175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.318211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:39.318221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:39.318240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:39.318771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1056 sessionId:  describe result for acl check
2025-10-10T14:33:39.318815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:39.318817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:39.318819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:39.318827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601227389492842:4556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:39.319436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601227389492842:4556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:39.320075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:39.321582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601227389492842:4556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:39.321849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:39.322058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:39.322069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:39.322081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:39.322139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:39.322184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601226607270931:6816]
2025-10-10T14:33:39.322851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:39.323125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:39.323167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:39.323504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:39.323561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.323567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.323569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.323570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.323571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.323572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.323573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.323575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.323576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.323577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.323578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.323579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.323580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.323585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.323597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.323601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.323605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.323609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.323614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.323617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.323621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.323624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.323628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.323631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.323635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.323639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.323645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.323654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.323659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.323665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.323669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.323674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.323678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.323683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.323687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.323692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.323696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.323701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.323705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.323710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.323714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.323719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.323723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.323728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.323733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.323738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.323742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.323747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.323751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.323756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.323761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.323765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.323803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:39.324315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601227389492842:4556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:39.324328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601227389492842:4556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:39.324332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601227389492842:4556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:39.324340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:39.326446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:39.326771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:39.326782Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:39.326785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:39.326789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:39.326795Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1055 [2:7559601226607270931:6816]
2025-10-10T14:33:39.326806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:39.326828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:39.326831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.326834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.326836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.326852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:39.326859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:39.326866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:39.326920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.326927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.326929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.326931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:39.326996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:39.327003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.327013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.327024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.327044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:39.327069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492879:4556], now have 1 active actors on pipe
2025-10-10T14:33:39.327076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492746:2438], now have 1 active actors on pipe
2025-10-10T14:33:39.327083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601226607270925:6816]
2025-10-10T14:33:39.327085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601226607270925:6816]
2025-10-10T14:33:39.327086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601226607270925:6816]
2025-10-10T14:33:39.327099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:39.327112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:39.327116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:39.327120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:39.327123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:39.327132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:39.327135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:39.327156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601226607270925:6816]
2025-10-10T14:33:39.327132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1055
2025-10-10T14:33:39.327167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:39.327173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:39.327222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1055
2025-10-10T14:33:39.327277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.327291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.327325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:39.327338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.327347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.327349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:39.327365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.327391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:39.327411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.327601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.327615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.327640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.327757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1056 partition: 0 MaxSeqNo: 40 sessionId: src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0
2025-10-10T14:33:39.328130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2398ac68-699c158b-46fda24e-58ca678a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:39.330726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0] Write session: try to update token
2025-10-10T14:33:39.330746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:39.344765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId: src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:39.347424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:39.347904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.347928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.347955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:39.347959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:39.347962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:39.347965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:39.347973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601226607270925:6816]
2025-10-10T14:33:39.347977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601226607270925:6816]
2025-10-10T14:33:39.347981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601226607270925:6816]
2025-10-10T14:33:39.348028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:39.348042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:39.348043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:39.348047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:39.348050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.348052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:39.348191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:39.409125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601227389492899:4999]
2025-10-10T14:33:39.409506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1055, pipe: [1:7559601227389492899:4999]
2025-10-10T14:33:39.460416Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:39.460704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:39.460773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492899:4999], now have 1 active actors on pipe
2025-10-10T14:33:39.460875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:39.460950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:39.461005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601227389492899:4999]
2025-10-10T14:33:39.461048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:39.461054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:39.461083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1056 reason: error at write: Disconnected sessionId: src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0
2025-10-10T14:33:39.461245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1056 sessionId: src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0 is DEAD
2025-10-10T14:33:39.461430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:39.461443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0] Write session will restart in 0.006722s
2025-10-10T14:33:39.461468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0] Write session: Do CDS request
2025-10-10T14:33:39.461475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:39.469947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.470027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:39.470041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1057
2025-10-10T14:33:39.470213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.470251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:39.470262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:39.470265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:39.470806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1057 sessionId:  describe result for acl check
2025-10-10T14:33:39.470845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:39.470851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:39.470853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:39.470860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601227389492996:4554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:39.471351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601227389492996:4554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:39.472549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:39.473553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601227389492996:4554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:39.474365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:39.474587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:39.474599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:39.474612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:39.474667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:39.474706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601226607271081:6819]
2025-10-10T14:33:39.475346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:39.475646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:39.475691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:39.476005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:39.476056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.476062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.476063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.476064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.476066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.476067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.476068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.476069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.476070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.476072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.476073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.476074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.476075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.476080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.476093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.476097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.476101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.476105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.476109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.476113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.476117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.476121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.476126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.476130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.476134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.476138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.476144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.476153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.476164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.476170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.476179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.476184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.476188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.476193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.476202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.476207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.476212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.476218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.476227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.476232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.476236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.476246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.476250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.476256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.476262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.476269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.476277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.476283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.476287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.476292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.476300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.476306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.476345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:39.477055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601227389492996:4554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:39.477068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601227389492996:4554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:39.477071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601227389492996:4554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:39.477079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:39.478967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:39.479436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:39.479452Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:39.479454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:39.479458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:39.479463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1056 [2:7559601226607271081:6819]
2025-10-10T14:33:39.479475Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:39.479492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:39.479500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.479504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.479506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.479524Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:39.479537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:39.479549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:39.479608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.479615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.479618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.479621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:39.479697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:39.479706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.479719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.479732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.479753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:39.479783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389492900:2438], now have 1 active actors on pipe
2025-10-10T14:33:39.479791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493034:4554], now have 1 active actors on pipe
2025-10-10T14:33:39.479800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601226607271075:6819]
2025-10-10T14:33:39.479806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601226607271075:6819]
2025-10-10T14:33:39.479808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601226607271075:6819]
2025-10-10T14:33:39.479823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:39.479802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1056
2025-10-10T14:33:39.479802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1056
2025-10-10T14:33:39.479835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:39.479837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:39.479843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:39.479846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:39.479854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:39.479858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:39.479897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.479907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.479921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601226607271075:6819]
2025-10-10T14:33:39.479935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:39.479955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:39.479969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|987e476d-f4207268-3c086abe-d14219c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:39.479981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.479990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.479992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:39.480003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.480020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:39.480055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.480191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.480201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.480220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.480326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1057 partition: 0 MaxSeqNo: 40 sessionId: src_id|987e476d-f4207268-3c086abe-d14219c8_0
2025-10-10T14:33:39.480734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9018acfb-8076eb52-da0f2a59-ba8ed1b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|987e476d-f4207268-3c086abe-d14219c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:39.483545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|987e476d-f4207268-3c086abe-d14219c8_0] Write session: try to update token
2025-10-10T14:33:39.483564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|987e476d-f4207268-3c086abe-d14219c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:39.498768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId: src_id|987e476d-f4207268-3c086abe-d14219c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:39.501478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:39.501912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.501938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.501965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:39.501968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:39.501972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:39.501974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:39.501982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601226607271075:6819]
2025-10-10T14:33:39.501987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601226607271075:6819]
2025-10-10T14:33:39.501991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601226607271075:6819]
2025-10-10T14:33:39.502030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:39.502042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:39.502046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:39.502059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:39.502068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.502070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:39.502213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:39.561154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601227389493042:4999]
2025-10-10T14:33:39.561433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1056, pipe: [1:7559601227389493042:4999]
2025-10-10T14:33:39.611225Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:39.611679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:39.611745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493042:4999], now have 1 active actors on pipe
2025-10-10T14:33:39.611855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:39.623050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:39.623600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:39.623613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:39.623640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1057 reason: error at write: Disconnected sessionId: src_id|987e476d-f4207268-3c086abe-d14219c8_0
2025-10-10T14:33:39.623858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1057 sessionId: src_id|987e476d-f4207268-3c086abe-d14219c8_0 is DEAD
2025-10-10T14:33:39.623960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987e476d-f4207268-3c086abe-d14219c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:39.623971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987e476d-f4207268-3c086abe-d14219c8_0] Write session will restart in 0.009692s
2025-10-10T14:33:39.623999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987e476d-f4207268-3c086abe-d14219c8_0] Write session: Do CDS request
2025-10-10T14:33:39.624005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987e476d-f4207268-3c086abe-d14219c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:39.624033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:39.624068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601227389493042:4999]
2025-10-10T14:33:39.629811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:39.630105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:39.630117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:39.630131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:39.630190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:39.630242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601226607271233:6827]
2025-10-10T14:33:39.630841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:39.631282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:39.631331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:39.631673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:39.631739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.631746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.631747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.631748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.631750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.631751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.631752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.631754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.631755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.631756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.631758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.631759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.631760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.631766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.631779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.631783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.631788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.631792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.631795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.631798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.631802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.631806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.631810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.631814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.631819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.631823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.631830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.631839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.631845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.631851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.631855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.631861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.631865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.631871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.631876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.631881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.631887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.631892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.631897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.631903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.631907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.631913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.631917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.631923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.631934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.631940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.631949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.631955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.631960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.631965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.631977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.631989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.632032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:39.634760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:39.634943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|987e476d-f4207268-3c086abe-d14219c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.635079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:39.635095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1058
2025-10-10T14:33:39.635214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.635254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:39.635265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:39.635269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:39.635330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:39.635351Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:39.635354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:39.635357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:39.635364Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1057 [2:7559601226607271233:6827]
2025-10-10T14:33:39.635378Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:39.635396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:39.635405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.635409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.635411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.635427Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:39.635439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:39.635451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:39.635528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.635535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.635539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.635541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:39.635622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:39.635632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.635645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.635656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.635673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:39.635650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1058 sessionId:  describe result for acl check
2025-10-10T14:33:39.635690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:39.635696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493161:2438], now have 1 active actors on pipe
2025-10-10T14:33:39.635692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:39.635694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:39.635699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601227389493169:4541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:39.635706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601226607271227:6827]
2025-10-10T14:33:39.635713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601226607271227:6827]
2025-10-10T14:33:39.635715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601226607271227:6827]
2025-10-10T14:33:39.635728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:39.635749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:39.635757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:39.635761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:39.635748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1057
2025-10-10T14:33:39.635764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:39.635772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:39.635775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:39.635813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601226607271227:6827]
2025-10-10T14:33:39.635824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:39.635844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:39.636247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601227389493169:4541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:39.638791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601227389493169:4541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:39.644495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601227389493169:4541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:39.644512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601227389493169:4541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:39.644516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601227389493169:4541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:39.644524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:39.644763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493213:4541], now have 1 active actors on pipe
2025-10-10T14:33:39.644874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1057
2025-10-10T14:33:39.644953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.644972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.645006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:39.645022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.645026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.645028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:39.645043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.645063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:39.645102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.645281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.645294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.645318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.645427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1058 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0
2025-10-10T14:33:39.645838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|987e476d-f4207268-3c086abe-d14219c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:39.648401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:39.648413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:39.648423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601226607271227:6827]
2025-10-10T14:33:39.648472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:39.648471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:39.648561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0] Write session: try to update token
2025-10-10T14:33:39.648577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:39.648652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:39.648792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:39.648934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:39.649080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:39.649389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:39.649437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:39.662477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId: src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:39.664940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:39.666750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.666777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.666802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:39.666805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:39.666808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:39.666811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:39.666821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601226607271227:6827]
2025-10-10T14:33:39.666825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601226607271227:6827]
2025-10-10T14:33:39.666829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601226607271227:6827]
2025-10-10T14:33:39.666884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:39.666891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:39.666899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:39.666899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.666902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:39.666904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:39.667088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:39.724499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601227389493220:4999]
2025-10-10T14:33:39.724817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1057, pipe: [1:7559601227389493220:4999]
2025-10-10T14:33:39.782704Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:39.783043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:39.783089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493220:4999], now have 1 active actors on pipe
2025-10-10T14:33:39.783180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:39.783303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601227389493220:4999]
2025-10-10T14:33:39.783332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:39.794691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:39.794800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:39.794814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:39.794840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1058 reason: error at write: Disconnected sessionId: src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0
2025-10-10T14:33:39.795008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1058 sessionId: src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0 is DEAD
2025-10-10T14:33:39.795183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:39.795196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0] Write session will restart in 0.009384s
2025-10-10T14:33:39.795221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0] Write session: Do CDS request
2025-10-10T14:33:39.795230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:39.799919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:39.800179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:39.800190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:39.800204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:39.800267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:39.800320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601226607271400:6837]
2025-10-10T14:33:39.800867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:39.801137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:39.801187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:39.801485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:39.801551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.801557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.801558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.801560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.801561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.801562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.801563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.801564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.801565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.801567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.801568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.801569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.801571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.801577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.801590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.801596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.801600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.801604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.801608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.801612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.801615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.801620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.801624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.801627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.801631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.801635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.801643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.801651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.801658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.801663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.801667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.801672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.801676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.801682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.801691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.801697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.801705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.801710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.801719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.801725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.801733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.801750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.801756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.801766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.801770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.801778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.801787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.801792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.801796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.801802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.801811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.801816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.801860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:39.804376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:39.804855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:39.804866Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:39.804868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:39.804871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:39.804877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1058 [2:7559601226607271400:6837]
2025-10-10T14:33:39.804885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:39.804899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:39.804902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.804905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.804906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.804920Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:39.804929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:39.804936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:39.804990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.804998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.805000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.805003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:39.805072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:39.805080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.805091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.805106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.805123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:39.805150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493221:2438], now have 1 active actors on pipe
2025-10-10T14:33:39.805163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601226607271394:6837]
2025-10-10T14:33:39.805165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601226607271394:6837]
2025-10-10T14:33:39.805168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601226607271394:6837]
2025-10-10T14:33:39.805180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:39.805191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:39.805193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:39.805196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:39.805197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:39.805175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1058
2025-10-10T14:33:39.805212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:39.805220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:39.805244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601226607271394:6837]
2025-10-10T14:33:39.805252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:39.805261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:39.805939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.806014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:39.806028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1059
2025-10-10T14:33:39.806183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.806215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:39.806225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:39.806229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:39.806682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1059 sessionId:  describe result for acl check
2025-10-10T14:33:39.806723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:39.806730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:39.806732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:39.806738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601227389493333:4529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:39.807308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601227389493333:4529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:39.810248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601227389493333:4529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:39.816961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601227389493333:4529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:39.816976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601227389493333:4529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:39.816980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601227389493333:4529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:39.816989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:39.817285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493362:4529], now have 1 active actors on pipe
2025-10-10T14:33:39.817376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1058
2025-10-10T14:33:39.817425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.817440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.817476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:39.817494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.817504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.817507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:39.817523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.817550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:39.817577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.817780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.817794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.817816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.817899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1059 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0
2025-10-10T14:33:39.818349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d608926-1ac07d17-65e986dc-e66aa9a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:39.821026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0] Write session: try to update token
2025-10-10T14:33:39.821044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:39.826134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:39.826156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:39.826159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:39.826162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:39.826176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601226607271394:6837]
2025-10-10T14:33:39.826180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601226607271394:6837]
2025-10-10T14:33:39.826183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601226607271394:6837]
2025-10-10T14:33:39.826235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:39.826239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:39.826243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.826246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:39.826246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:39.826250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:39.826392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:39.835668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId: src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:39.838376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:39.883707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601227389493365:4999]
2025-10-10T14:33:39.883998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1058, pipe: [1:7559601227389493365:4999]
2025-10-10T14:33:39.944025Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:39.944379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.944396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.944420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493365:4999], now have 1 active actors on pipe
2025-10-10T14:33:39.944631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:39.944656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:39.944671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:39.944731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1059 reason: error at write: Disconnected sessionId: src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0
2025-10-10T14:33:39.944759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:39.944827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601227389493365:4999]
2025-10-10T14:33:39.944976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1059 sessionId: src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0 is DEAD
2025-10-10T14:33:39.945153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:39.945162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0] Write session will restart in 0.008288s
2025-10-10T14:33:39.945202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0] Write session: Do CDS request
2025-10-10T14:33:39.945211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:39.954935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.955052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:39.955067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1060
2025-10-10T14:33:39.955222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:39.955258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:39.955269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:39.955273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:39.955690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1060 sessionId:  describe result for acl check
2025-10-10T14:33:39.955726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:39.955728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:39.955730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:39.955736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601227389493471:4525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:39.956303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601227389493471:4525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:39.956908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:39.958723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:39.958741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601227389493471:4525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:39.958965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:39.958978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:39.958992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:39.959049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:39.959098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601226607271543:6839]
2025-10-10T14:33:39.959723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:39.960041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:39.960086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:39.960413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:39.960469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.960475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.960477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.960478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.960479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.960481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.960482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.960483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.960484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.960486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.960487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.960488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.960489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.960495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.960509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.960513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.960517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.960521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.960525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.960529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.960533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.960537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.960543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.960547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.960551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.960555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.960562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.960571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:39.960577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.960583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:39.960587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.960593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:39.960598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.960603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:39.960607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.960613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:39.960617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.960622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:39.960627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.960633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:39.960637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.960647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:39.960652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.960657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:39.960662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.960667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:39.960676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.960684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.960688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.960696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.960701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.960711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.960751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:39.961328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601227389493471:4525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:39.961359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601227389493471:4525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:39.961364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601227389493471:4525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:39.961373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:39.963502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:39.964063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:39.964080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:39.964082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:39.964087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:39.964096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1059 [2:7559601226607271543:6839]
2025-10-10T14:33:39.964110Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:39.964129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:39.964133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.964138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.964140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.964159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:39.964173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:39.964186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:39.964250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.964258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.964261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.964264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:39.964334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:39.964346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.964359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:39.964371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:39.964390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:39.964414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493367:2438], now have 1 active actors on pipe
2025-10-10T14:33:39.964427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601227389493505:4525], now have 1 active actors on pipe
2025-10-10T14:33:39.964435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601226607271538:6839]
2025-10-10T14:33:39.964438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601226607271538:6839]
2025-10-10T14:33:39.964440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601226607271538:6839]
2025-10-10T14:33:39.964454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:39.964469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:39.964470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:39.964472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:39.964474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:39.964469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1059
2025-10-10T14:33:39.964489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:39.964472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1059
2025-10-10T14:33:39.964493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:39.964524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601226607271538:6839]
2025-10-10T14:33:39.964540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:39.964548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:39.964563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.964573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.964627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:39.964643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:39.964647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:39.964649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:39.964660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:39.964677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:39.964702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.964874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:39.964883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:39.964901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:39.965031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1060 partition: 0 MaxSeqNo: 40 sessionId: src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0
2025-10-10T14:33:39.965494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b562f4c-b8bde8b3-54788976-1a7cdb4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:39.968098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0] Write session: try to update token
2025-10-10T14:33:39.968118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:39.982276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId: src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:39.984131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:39.984157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:39.984161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:39.984163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:39.984173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601226607271538:6839]
2025-10-10T14:33:39.984178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601226607271538:6839]
2025-10-10T14:33:39.984182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601226607271538:6839]
2025-10-10T14:33:39.984228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:39.984234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:39.984242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:39.984244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:39.984244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:39.984248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:39.984393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:39.984975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:40.045031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601231684460813:4999]
2025-10-10T14:33:40.045357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1059, pipe: [1:7559601231684460813:4999]
2025-10-10T14:33:40.098497Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:40.098847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.098865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.098911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684460813:4999], now have 1 active actors on pipe
2025-10-10T14:33:40.099133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:40.099131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:40.099162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601231684460813:4999]
2025-10-10T14:33:40.099182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:40.099186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:40.099263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1060 reason: error at write: Disconnected sessionId: src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0
2025-10-10T14:33:40.099491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1060 sessionId: src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0 is DEAD
2025-10-10T14:33:40.099639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:40.099646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0] Write session will restart in 0.009481s
2025-10-10T14:33:40.099667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0] Write session: Do CDS request
2025-10-10T14:33:40.099672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:40.111059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.111145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:40.111160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1061
2025-10-10T14:33:40.111299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.111342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:40.111348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:40.111353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:40.111792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1061 sessionId:  describe result for acl check
2025-10-10T14:33:40.111821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:40.111823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:40.111825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:40.111832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601231684460919:4516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:40.112438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601231684460919:4516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:40.113969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:40.114787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601231684460919:4516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:40.116058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:40.116309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:40.116321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:40.116334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:40.116399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:40.116442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601230902238982:6841]
2025-10-10T14:33:40.117041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:40.117379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:40.117444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:40.117471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601231684460919:4516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:40.117486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601231684460919:4516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:40.117490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601231684460919:4516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:40.117499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:40.117811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:40.117883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.117890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.117891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.117892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.117894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.117895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.117896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.117898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.117899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.117900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.117901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.117903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.117904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.117911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.117924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.117929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.117933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.117937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.117941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.117945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.117950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.117954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.117958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.117962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.117966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.117970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.117979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.117989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.117995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.118001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.118007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.118012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.118016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.118022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.118026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.118032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.118036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.118042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.118048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.118053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.118062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.118068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.118073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.118079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.118084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.118090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.118095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.118100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.118110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.118116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.118122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.118132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.118175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:40.120753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:40.121300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:40.121326Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:40.121343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:40.121347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:40.121355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1060 [2:7559601230902238982:6841]
2025-10-10T14:33:40.121370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:40.121390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:40.121403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.121407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.121410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.121427Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:40.121436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:40.121444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:40.121521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.121529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.121531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.121534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:40.121616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:40.121624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.121637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.121658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.121673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:40.121698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684460815:2438], now have 1 active actors on pipe
2025-10-10T14:33:40.121709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684460951:4516], now have 1 active actors on pipe
2025-10-10T14:33:40.121718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601230902238977:6841]
2025-10-10T14:33:40.121721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601230902238977:6841]
2025-10-10T14:33:40.121723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601230902238977:6841]
2025-10-10T14:33:40.121749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:40.121750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1060
2025-10-10T14:33:40.121769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1060
2025-10-10T14:33:40.121765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:40.121772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:40.121777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:40.121779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:40.121787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:40.121791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:40.121837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601230902238977:6841]
2025-10-10T14:33:40.121842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:40.121844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:40.121872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.121878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.121919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:40.121927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.121931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.121934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:40.121958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.121970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:40.121989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.122234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.122247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.122273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.122440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1061 partition: 0 MaxSeqNo: 40 sessionId: src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0
2025-10-10T14:33:40.122891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b12784ac-b5b00f6b-ea986c97-1d35df10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:40.125725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0] Write session: try to update token
2025-10-10T14:33:40.125760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:40.140582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId: src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:40.140943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:40.140961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:40.140963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:40.140965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:40.140973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601230902238977:6841]
2025-10-10T14:33:40.140978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601230902238977:6841]
2025-10-10T14:33:40.140985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601230902238977:6841]
2025-10-10T14:33:40.141035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:40.141044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.141045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:40.141047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:40.141052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:40.141056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:40.141205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:40.143350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:40.199126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601231684460960:4999]
2025-10-10T14:33:40.199518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1060, pipe: [1:7559601231684460960:4999]
2025-10-10T14:33:40.253465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:40.253827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.253848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.253898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684460960:4999], now have 1 active actors on pipe
2025-10-10T14:33:40.254127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:40.254192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:40.254196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601231684460960:4999]
2025-10-10T14:33:40.254221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:40.254314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1061 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0
2025-10-10T14:33:40.254512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1061 sessionId: src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0 is DEAD
2025-10-10T14:33:40.254626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:40.254636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0] Write session will restart in 0.005229s
2025-10-10T14:33:40.254655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0] Write session: Do CDS request
2025-10-10T14:33:40.254660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:40.260862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.260907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:40.260921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1062
2025-10-10T14:33:40.261101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.261138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:40.261148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:40.261152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:40.261615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1062 sessionId:  describe result for acl check
2025-10-10T14:33:40.261663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:40.261670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:40.261672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:40.261677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601231684461005:4512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:40.262248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601231684461005:4512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:40.264788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601231684461005:4512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:40.265775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:40.267404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:40.267586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:40.267597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:40.267609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:40.267662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:40.267702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601230902239124:6843]
2025-10-10T14:33:40.267747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601231684461005:4512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:40.267764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601231684461005:4512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:40.267768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601231684461005:4512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:40.267776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:40.268289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:40.268567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:40.268611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:40.268923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:40.268976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.268981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.268982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.268984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.268985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.268986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.268987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.268988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.268989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.268990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.268992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.268993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.268994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.268999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.269011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.269015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.269019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.269023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.269026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.269030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.269033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.269037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.269041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.269044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.269048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.269051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.269058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.269066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.269073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.269078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.269084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.269096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.269100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.269105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.269109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.269113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.269117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.269121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.269126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.269130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.269134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.269139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.269148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.269154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.269159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.269164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.269168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.269173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.269178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.269183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.269187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.269192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.269229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:40.271524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:40.271997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:40.272013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:40.272015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:40.272030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:40.272041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1061 [2:7559601230902239124:6843]
2025-10-10T14:33:40.272054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:40.272075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:40.272082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.272086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.272088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.272105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:40.272118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:40.272129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:40.272187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.272194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.272196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.272199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:40.272263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:40.272271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.272283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.272298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.272321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:40.272342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684460982:2438], now have 1 active actors on pipe
2025-10-10T14:33:40.272351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461117:4512], now have 1 active actors on pipe
2025-10-10T14:33:40.272358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601230902239118:6843]
2025-10-10T14:33:40.272361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601230902239118:6843]
2025-10-10T14:33:40.272363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601230902239118:6843]
2025-10-10T14:33:40.272376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:40.272371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1061
2025-10-10T14:33:40.272393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:40.272388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1061
2025-10-10T14:33:40.272394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:40.272396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:40.272398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:40.272414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:40.272417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:40.272470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.272479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.272494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601230902239118:6843]
2025-10-10T14:33:40.272505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:40.272533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:40.272534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f517975b-b358da90-b2af451a-45bc0e63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:40.272541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.272544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.272547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:40.272558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.272568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:40.272589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.272737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.272744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.272758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.272834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1062 partition: 0 MaxSeqNo: 40 sessionId: src_id|f517975b-b358da90-b2af451a-45bc0e63_0
2025-10-10T14:33:40.273226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8e9aec-8de6592e-dd13c08a-65455bc9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f517975b-b358da90-b2af451a-45bc0e63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:40.275859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f517975b-b358da90-b2af451a-45bc0e63_0] Write session: try to update token
2025-10-10T14:33:40.275875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f517975b-b358da90-b2af451a-45bc0e63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:40.290471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId: src_id|f517975b-b358da90-b2af451a-45bc0e63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:40.292043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:40.292065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:40.292068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:40.292070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:40.292081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601230902239118:6843]
2025-10-10T14:33:40.292087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601230902239118:6843]
2025-10-10T14:33:40.292091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601230902239118:6843]
2025-10-10T14:33:40.292147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:40.292154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:40.292160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.292160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:40.292163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:40.292165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:40.292316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:40.293226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:40.354268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601231684461128:4999]
2025-10-10T14:33:40.354591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1061, pipe: [1:7559601231684461128:4999]
2025-10-10T14:33:40.402843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:40.403096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.403111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.403149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461128:4999], now have 1 active actors on pipe
2025-10-10T14:33:40.403372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:40.403381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601231684461128:4999]
2025-10-10T14:33:40.403393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:40.403429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:40.403504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1062 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f517975b-b358da90-b2af451a-45bc0e63_0
2025-10-10T14:33:40.403738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1062 sessionId: src_id|f517975b-b358da90-b2af451a-45bc0e63_0 is DEAD
2025-10-10T14:33:40.403881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f517975b-b358da90-b2af451a-45bc0e63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:40.403891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f517975b-b358da90-b2af451a-45bc0e63_0] Write session will restart in 0.007904s
2025-10-10T14:33:40.403914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f517975b-b358da90-b2af451a-45bc0e63_0] Write session: Do CDS request
2025-10-10T14:33:40.403921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f517975b-b358da90-b2af451a-45bc0e63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:40.412912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f517975b-b358da90-b2af451a-45bc0e63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.412960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:40.412978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1063
2025-10-10T14:33:40.413155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.413195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:40.413201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:40.413212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:40.413659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1063 sessionId:  describe result for acl check
2025-10-10T14:33:40.413701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:40.413708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:40.413710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:40.413716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601231684461245:4507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:40.414306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601231684461245:4507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:40.415232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:40.416964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601231684461245:4507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:40.417033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:40.417240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:40.417253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:40.417267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:40.417382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:40.417431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601230902239280:6846]
2025-10-10T14:33:40.418044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:40.418367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:40.418416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:40.418716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:40.418772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.418778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.418779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.418780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.418781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.418782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.418784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.418785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.418786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.418787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.418789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.418790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.418792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.418799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.418812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.418816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.418820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.418825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.418829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.418832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.418836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.418840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.418843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.418847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.418851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.418854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.418861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.418871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.418878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.418883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.418888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.418893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.418898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.418903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.418911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.418917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.418926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.418931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.418936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.418946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.418950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.418957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.418963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.418968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.418976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.418981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.418990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.418994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.418997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.419000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.419002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.419005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.419030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:40.421483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:40.421489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601231684461245:4507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:40.421507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601231684461245:4507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:40.421511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601231684461245:4507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:40.421520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:40.422077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:40.422091Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:40.422093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:40.422098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:40.422104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1062 [2:7559601230902239280:6846]
2025-10-10T14:33:40.422118Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:40.422136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:40.422139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.422143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.422146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.422163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:40.422170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:40.422177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:40.422237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.422249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.422251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.422254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:40.422350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:40.422358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.422372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.422389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.422411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:40.422440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461282:4507], now have 1 active actors on pipe
2025-10-10T14:33:40.422447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461142:2438], now have 1 active actors on pipe
2025-10-10T14:33:40.422455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601230902239274:6846]
2025-10-10T14:33:40.422457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601230902239274:6846]
2025-10-10T14:33:40.422459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601230902239274:6846]
2025-10-10T14:33:40.422449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1062
2025-10-10T14:33:40.422468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:40.422450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1062
2025-10-10T14:33:40.422486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:40.422486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:40.422489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:40.422492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:40.422508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:40.422511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:40.422564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.422575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.422591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601230902239274:6846]
2025-10-10T14:33:40.422605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:40.422648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:40.422649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:40.422662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.422666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.422668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:40.422680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.422692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:40.422716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.422949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.422965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.422988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.423162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1063 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0
2025-10-10T14:33:40.423593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f517975b-b358da90-b2af451a-45bc0e63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:40.426446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0] Write session: try to update token
2025-10-10T14:33:40.426464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:40.440493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId: src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:40.442353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:40.442380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:40.442384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:40.442386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:40.442395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601230902239274:6846]
2025-10-10T14:33:40.442401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601230902239274:6846]
2025-10-10T14:33:40.442405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601230902239274:6846]
2025-10-10T14:33:40.442452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:40.442456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:40.442464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.442466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:40.442467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:40.442471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:40.442628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:40.443373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:40.503775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601231684461289:4999]
2025-10-10T14:33:40.504119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1062, pipe: [1:7559601231684461289:4999]
2025-10-10T14:33:40.558235Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:40.558581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.558601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.558650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461289:4999], now have 1 active actors on pipe
2025-10-10T14:33:40.558933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:40.558948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:40.558963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601231684461289:4999]
2025-10-10T14:33:40.558988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:40.558886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:40.559027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1063 reason: error at write: Disconnected sessionId: src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0
2025-10-10T14:33:40.559248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1063 sessionId: src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0 is DEAD
2025-10-10T14:33:40.559411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:40.559422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0] Write session will restart in 0.006889s
2025-10-10T14:33:40.559449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0] Write session: Do CDS request
2025-10-10T14:33:40.559458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:40.567916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.567992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:40.568020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1064
2025-10-10T14:33:40.568211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.568263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:40.568274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:40.568279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:40.568827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1064 sessionId:  describe result for acl check
2025-10-10T14:33:40.568869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:40.568880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:40.568882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:40.568890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601231684461376:4504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:40.569523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601231684461376:4504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:40.571676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:40.572022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601231684461376:4504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:40.574083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:40.574398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:40.574420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:40.574442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:40.574530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:40.574599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601230902239425:6848]
2025-10-10T14:33:40.574642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601231684461376:4504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:40.574658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601231684461376:4504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:40.574662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601231684461376:4504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:40.574672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:40.575340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:40.575686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:40.575740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:40.576107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:40.576163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.576171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.576172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.576173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.576193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.576195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.576196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.576198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.576199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.576201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.576202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.576203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.576205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.576211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.576225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.576231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.576236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.576240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.576245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.576249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.576254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.576258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.576262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.576267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.576271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.576275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.576282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.576293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.576299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.576305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.576310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.576320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.576326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.576332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.576337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.576343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.576353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.576359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.576364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.576370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.576375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.576381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.576386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.576392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.576396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.576402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.576408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.576413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.576422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.576428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.576433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.576438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.576483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:40.579050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:40.579652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:40.579666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:40.579669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:40.579672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:40.579679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1063 [2:7559601230902239425:6848]
2025-10-10T14:33:40.579691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:40.579708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:40.579711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.579714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.579717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.579734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:40.579741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:40.579749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:40.579816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.579823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.579825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.579828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:40.579896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:40.579905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.579918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.579934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.579955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:40.579987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461428:4504], now have 1 active actors on pipe
2025-10-10T14:33:40.579996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461290:2438], now have 1 active actors on pipe
2025-10-10T14:33:40.580005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601230902239420:6848]
2025-10-10T14:33:40.580006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601230902239420:6848]
2025-10-10T14:33:40.580009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601230902239420:6848]
2025-10-10T14:33:40.580021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:40.580038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:40.580042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:40.580045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:40.580047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:40.580060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:40.580063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:40.580045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1063
2025-10-10T14:33:40.580046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1063
2025-10-10T14:33:40.580094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601230902239420:6848]
2025-10-10T14:33:40.580108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:40.580129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.580133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:40.580134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.580186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26d32a3c-18918d7b-6e051179-cd503b91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:40.580200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.580206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.580209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:40.580221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.580238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:40.580261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.580425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.580440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.580463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.580578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1064 partition: 0 MaxSeqNo: 40 sessionId: src_id|26d32a3c-18918d7b-6e051179-cd503b91_0
2025-10-10T14:33:40.580977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72582b-a953da2-cbcff409-cec4b7a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26d32a3c-18918d7b-6e051179-cd503b91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:40.583749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d32a3c-18918d7b-6e051179-cd503b91_0] Write session: try to update token
2025-10-10T14:33:40.583769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d32a3c-18918d7b-6e051179-cd503b91_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:40.598105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId: src_id|26d32a3c-18918d7b-6e051179-cd503b91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:40.599335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:40.599355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:40.599359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:40.599361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:40.599368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601230902239420:6848]
2025-10-10T14:33:40.599371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601230902239420:6848]
2025-10-10T14:33:40.599374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601230902239420:6848]
2025-10-10T14:33:40.599412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:40.599419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.599420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:40.599434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:40.599441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:40.599444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:40.599568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:40.600813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:40.658890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601231684461466:4999]
2025-10-10T14:33:40.659191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1063, pipe: [1:7559601231684461466:4999]
2025-10-10T14:33:40.714841Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:40.715213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.715231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.715279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461466:4999], now have 1 active actors on pipe
2025-10-10T14:33:40.715488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:40.715513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:40.715517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:40.715546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601231684461466:4999]
2025-10-10T14:33:40.715598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1064 reason: error at write: Disconnected sessionId: src_id|26d32a3c-18918d7b-6e051179-cd503b91_0
2025-10-10T14:33:40.715527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:40.715846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1064 sessionId: src_id|26d32a3c-18918d7b-6e051179-cd503b91_0 is DEAD
2025-10-10T14:33:40.716030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d32a3c-18918d7b-6e051179-cd503b91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:40.716052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d32a3c-18918d7b-6e051179-cd503b91_0] Write session will restart in 0.007424s
2025-10-10T14:33:40.716074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d32a3c-18918d7b-6e051179-cd503b91_0] Write session: Do CDS request
2025-10-10T14:33:40.716079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d32a3c-18918d7b-6e051179-cd503b91_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:40.725008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d32a3c-18918d7b-6e051179-cd503b91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.725003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:40.725018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1065
2025-10-10T14:33:40.726371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.726420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:40.726432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:40.726437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:40.726904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1065 sessionId:  describe result for acl check
2025-10-10T14:33:40.726942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:40.726949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:40.726950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:40.726957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601231684461586:4482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:40.727715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601231684461586:4482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:40.727920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:40.729748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:40.729953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:40.729965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:40.729977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:40.730034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:40.730077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601230902239611:6864]
2025-10-10T14:33:40.730141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601231684461586:4482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:40.730552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:40.730844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:40.730901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:40.731287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:40.731363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.731371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.731372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.731373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.731374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.731375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.731376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.731377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.731379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.731380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.731381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.731383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.731384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.731390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.731403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.731406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.731410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.731414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.731418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.731422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.731426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.731430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.731434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.731438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.731441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.731445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.731454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.731462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.731469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.731474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.731479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.731484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.731491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.731497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.731503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.731510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.731514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.731524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.731529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.731535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.731539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.731544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.731549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.731560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.731565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.731570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.731575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.731580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.731586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.731591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.731596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.731601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.731650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:40.734021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601231684461586:4482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:40.734037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601231684461586:4482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:40.734040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601231684461586:4482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:40.734048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:40.734132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:40.734547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:40.734560Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:40.734562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:40.734566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:40.734572Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1064 [2:7559601230902239611:6864]
2025-10-10T14:33:40.734586Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:40.734606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:40.734614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.734618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.734620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.734637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:40.734650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:40.734662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:40.734731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.734741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.734743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.734746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:40.734824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:40.734841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.734852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.734868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.734890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:40.734917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461620:4482], now have 1 active actors on pipe
2025-10-10T14:33:40.734926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461481:2438], now have 1 active actors on pipe
2025-10-10T14:33:40.734933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601230902239605:6864]
2025-10-10T14:33:40.734936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601230902239605:6864]
2025-10-10T14:33:40.734937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601230902239605:6864]
2025-10-10T14:33:40.734953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:40.734967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:40.734962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1064
2025-10-10T14:33:40.734965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1064
2025-10-10T14:33:40.734982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:40.734989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:40.734992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:40.734992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:40.734994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:40.735015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601230902239605:6864]
2025-10-10T14:33:40.735018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:40.735020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:40.735035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.735047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.735104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:40.735116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.735122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.735129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:40.735140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.735167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:40.735194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.735367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.735380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.735403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.735495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1065 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0
2025-10-10T14:33:40.735855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d32a3c-18918d7b-6e051179-cd503b91_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:40.738620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0] Write session: try to update token
2025-10-10T14:33:40.738642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:40.753040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId: src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:40.754878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:40.754901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:40.754904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:40.754905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:40.754913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601230902239605:6864]
2025-10-10T14:33:40.754917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601230902239605:6864]
2025-10-10T14:33:40.754921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601230902239605:6864]
2025-10-10T14:33:40.754971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:40.754979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.754982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:40.754991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:40.754999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:40.755004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:40.755126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:40.755835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:40.815566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601231684461628:4999]
2025-10-10T14:33:40.815927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1064, pipe: [1:7559601231684461628:4999]
2025-10-10T14:33:40.869567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:40.869948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.869965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.870011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461628:4999], now have 1 active actors on pipe
2025-10-10T14:33:40.870241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:40.870274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601231684461628:4999]
2025-10-10T14:33:40.870294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:40.870310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:40.870312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:40.870369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1065 reason: error at write: Disconnected sessionId: src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0
2025-10-10T14:33:40.870574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1065 sessionId: src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0 is DEAD
2025-10-10T14:33:40.870740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:40.870750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0] Write session will restart in 0.008731s
2025-10-10T14:33:40.870776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0] Write session: Do CDS request
2025-10-10T14:33:40.870785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:40.880919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.880989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:40.881006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1066
2025-10-10T14:33:40.881158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:40.881192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:40.881198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:40.881202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:40.881686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1066 sessionId:  describe result for acl check
2025-10-10T14:33:40.881737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:40.881744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:40.881746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:40.881752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601231684461737:4479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:40.882338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601231684461737:4479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:40.882438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:40.884171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:40.884445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:40.884462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:40.884475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:40.884560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:40.884605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601230902239758:6866]
2025-10-10T14:33:40.884669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601231684461737:4479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:40.885192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:40.885461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:40.885507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:40.885829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:40.885891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.885898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.885899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.885901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.885902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.885904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.885905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.885906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.885908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.885909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.885910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.885911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.885912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.885918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.885931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.885935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.885939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.885943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.885947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.885951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.885960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.885964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.885968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.885976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.885980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.885988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.885995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.886003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:40.886010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.886016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:40.886026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.886031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:40.886035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.886043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:40.886051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.886056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:40.886066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.886075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:40.886084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.886090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:40.886098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.886103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:40.886108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.886113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:40.886117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.886122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:40.886127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.886132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.886137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.886146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.886155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.886160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.886205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:40.888571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:40.888606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601231684461737:4479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:40.888620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601231684461737:4479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:40.888624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601231684461737:4479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:40.888632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:40.889137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:40.889155Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:40.889159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:40.889162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:40.889168Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1065 [2:7559601230902239758:6866]
2025-10-10T14:33:40.889179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:40.889196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:40.889201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.889205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.889207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.889223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:40.889238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:40.889245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:40.889301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.889306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.889308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.889311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:40.889402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:40.889412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.889424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:40.889435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:40.889450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:40.889473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461773:4479], now have 1 active actors on pipe
2025-10-10T14:33:40.889482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461630:2438], now have 1 active actors on pipe
2025-10-10T14:33:40.889490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601230902239752:6866]
2025-10-10T14:33:40.889493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601230902239752:6866]
2025-10-10T14:33:40.889495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601230902239752:6866]
2025-10-10T14:33:40.889512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:40.889524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:40.889528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:40.889530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:40.889530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:40.889547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:40.889555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:40.889538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1065
2025-10-10T14:33:40.889567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1065
2025-10-10T14:33:40.889585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601230902239752:6866]
2025-10-10T14:33:40.889597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:40.889598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:40.889615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.889624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.889677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:40.889694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:40.889699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:40.889713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:40.889724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:40.889738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:40.890014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1066 partition: 0 MaxSeqNo: 40 sessionId: src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0
2025-10-10T14:33:40.889761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.889917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:40.889921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:40.889940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:40.890428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf54b7d2-3d119863-51a30ace-c484fcf4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:40.893099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0] Write session: try to update token
2025-10-10T14:33:40.893117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:40.907694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId: src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:40.909211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:40.909238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:40.909242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:40.909245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:40.909255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601230902239752:6866]
2025-10-10T14:33:40.909260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601230902239752:6866]
2025-10-10T14:33:40.909264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601230902239752:6866]
2025-10-10T14:33:40.909316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:40.909315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:40.909322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:40.909324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:40.909326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:40.909327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:40.909496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:40.910448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:40.970681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601231684461781:4999]
2025-10-10T14:33:40.970942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1065, pipe: [1:7559601231684461781:4999]
2025-10-10T14:33:41.021417Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:41.021728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.021743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.021792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601231684461781:4999], now have 1 active actors on pipe
2025-10-10T14:33:41.021985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:41.022041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:41.022054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:41.022053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601231684461781:4999]
2025-10-10T14:33:41.022071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:41.022127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1066 reason: error at write: Disconnected sessionId: src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0
2025-10-10T14:33:41.022353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1066 sessionId: src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0 is DEAD
2025-10-10T14:33:41.022517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:41.022526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0] Write session will restart in 0.006047s
2025-10-10T14:33:41.022552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0] Write session: Do CDS request
2025-10-10T14:33:41.022558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:41.029811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.029945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:41.029961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1067
2025-10-10T14:33:41.030111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.030148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:41.030154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:41.030158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:41.030646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1067 sessionId:  describe result for acl check
2025-10-10T14:33:41.030685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:41.030691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:41.030694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:41.030700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601235979429148:4473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:41.031265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601235979429148:4473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:41.033613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601235979429148:4473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:41.033837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:41.035506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:41.035703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:41.035715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:41.035728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:41.035785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:41.035854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601235197207202:6868]
2025-10-10T14:33:41.036349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601235979429148:4473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:41.036362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601235979429148:4473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:41.036366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601235979429148:4473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:41.036373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:41.036506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:41.036753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:41.036799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:41.037118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:41.037179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.037186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.037187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.037188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.037190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.037191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.037192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.037193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.037195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.037196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.037197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.037198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.037200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.037206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.037219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.037223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.037227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.037230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.037234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.037237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.037240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.037244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.037249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.037253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.037257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.037261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.037269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.037277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.037283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.037289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.037293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.037299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.037303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.037308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.037313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.037318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.037323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.037343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.037350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.037355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.037360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.037365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.037371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.037381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.037386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.037391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.037400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.037406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.037411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.037421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.037425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.037431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.037470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:41.039850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:41.040293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:41.040305Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:41.040307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:41.040311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:41.040317Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1066 [2:7559601235197207202:6868]
2025-10-10T14:33:41.040329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:41.040346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:41.040349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.040352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.040355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.040373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:41.040385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:41.040392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:41.040452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.040458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.040460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.040463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:41.040529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:41.040537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.040548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.040565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.040587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:41.040618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1066
2025-10-10T14:33:41.040625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1066
2025-10-10T14:33:41.040627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429078:2438], now have 1 active actors on pipe
2025-10-10T14:33:41.040639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429218:4473], now have 1 active actors on pipe
2025-10-10T14:33:41.040647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601235197207196:6868]
2025-10-10T14:33:41.040649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601235197207196:6868]
2025-10-10T14:33:41.040652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601235197207196:6868]
2025-10-10T14:33:41.040666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:41.040680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:41.040688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:41.040692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:41.040694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:41.040699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:41.040702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:41.040736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.040746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.040765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601235197207196:6868]
2025-10-10T14:33:41.040777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:41.040798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:41.040806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:41.040816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.040820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.040827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:41.040838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.040852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:41.040949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.041219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.041233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.041256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.041382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1067 partition: 0 MaxSeqNo: 40 sessionId: src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0
2025-10-10T14:33:41.041861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaae31d7-8f26a7a5-a25a469a-5f945545_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:41.044509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0] Write session: try to update token
2025-10-10T14:33:41.044527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:41.059384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId: src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:41.060992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:41.061020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:41.061024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:41.061026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:41.061038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601235197207196:6868]
2025-10-10T14:33:41.061044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601235197207196:6868]
2025-10-10T14:33:41.061050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601235197207196:6868]
2025-10-10T14:33:41.061107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:41.061113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:41.061121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:41.061125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.061125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:41.061127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:41.061316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:41.062709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:41.122264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601235979429230:4999]
2025-10-10T14:33:41.122549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1066, pipe: [1:7559601235979429230:4999]
2025-10-10T14:33:41.174556Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:41.174931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.174950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.175000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429230:4999], now have 1 active actors on pipe
2025-10-10T14:33:41.175226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:41.175256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601235979429230:4999]
2025-10-10T14:33:41.175294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:41.175296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:41.175367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1067 reason: error at write: Disconnected sessionId: src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0
2025-10-10T14:33:41.175600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1067 sessionId: src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0 is DEAD
2025-10-10T14:33:41.175712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:41.175754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:41.175766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0] Write session will restart in 0.006903s
2025-10-10T14:33:41.175800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0] Write session: Do CDS request
2025-10-10T14:33:41.175809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:41.183944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.184064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:41.184079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1068
2025-10-10T14:33:41.184237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.184283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:41.184293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:41.184297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:41.184797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1068 sessionId:  describe result for acl check
2025-10-10T14:33:41.184833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:41.184842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:41.184844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:41.184849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601235979429276:4469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:41.185436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601235979429276:4469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:41.188084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601235979429276:4469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:41.188568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:41.190469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:41.190814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:41.190831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:41.190847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:41.190918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:41.190964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601235197207350:6870]
2025-10-10T14:33:41.191197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601235979429276:4469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:41.191213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601235979429276:4469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:41.191217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601235979429276:4469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:41.191225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:41.191574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:41.191909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:41.191955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:41.192268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:41.192347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.192355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.192356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.192357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.192358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.192359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.192361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.192362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.192363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.192364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.192366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.192367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.192368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.192376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.192390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.192394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.192398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.192403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.192413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.192421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.192430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.192434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.192442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.192451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.192459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.192464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.192473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.192485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.192492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.192502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.192507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.192512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.192521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.192528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.192537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.192543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.192547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.192551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.192556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.192561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.192565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.192570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.192576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.192582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.192586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.192592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.192597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.192602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.192611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.192615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.192619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.192623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.192662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:41.195151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:41.195657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:41.195672Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:41.195675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:41.195679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:41.195685Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1067 [2:7559601235197207350:6870]
2025-10-10T14:33:41.195697Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:41.195717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:41.195725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.195728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.195730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.195747Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:41.195756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:41.195767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:41.195826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.195835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.195838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.195841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:41.195908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:41.195915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.195926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.195937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.195953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:41.195984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429372:4469], now have 1 active actors on pipe
2025-10-10T14:33:41.195988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429231:2438], now have 1 active actors on pipe
2025-10-10T14:33:41.195996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601235197207345:6870]
2025-10-10T14:33:41.195998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601235197207345:6870]
2025-10-10T14:33:41.196001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601235197207345:6870]
2025-10-10T14:33:41.196015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:41.196027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:41.196029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:41.196030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:41.196032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:41.196045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:41.196053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:41.196032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1067
2025-10-10T14:33:41.196032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1067
2025-10-10T14:33:41.196080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601235197207345:6870]
2025-10-10T14:33:41.196089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:41.196091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:41.196109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.196118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.196168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fddd75a-26ca161d-9651733e-52688db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:41.196181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.196188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.196191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:41.196200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.196214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:41.196235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.196388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.196405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.196430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.196524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1068 partition: 0 MaxSeqNo: 40 sessionId: src_id|4fddd75a-26ca161d-9651733e-52688db6_0
2025-10-10T14:33:41.196969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bb99d7-b99ba9c3-6af06a72-4c290fb0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4fddd75a-26ca161d-9651733e-52688db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:41.199906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fddd75a-26ca161d-9651733e-52688db6_0] Write session: try to update token
2025-10-10T14:33:41.199930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fddd75a-26ca161d-9651733e-52688db6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:41.215224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId: src_id|4fddd75a-26ca161d-9651733e-52688db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:41.216097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:41.216120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:41.216124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:41.216126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:41.216136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601235197207345:6870]
2025-10-10T14:33:41.216143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601235197207345:6870]
2025-10-10T14:33:41.216147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601235197207345:6870]
2025-10-10T14:33:41.216192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:41.216198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:41.216205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.216206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:41.216208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:41.216215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:41.216348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:41.217894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:41.275350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601235979429384:4999]
2025-10-10T14:33:41.275675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1067, pipe: [1:7559601235979429384:4999]
2025-10-10T14:33:41.329052Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:41.329315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.329350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.329395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429384:4999], now have 1 active actors on pipe
2025-10-10T14:33:41.329630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:41.329654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601235979429384:4999]
2025-10-10T14:33:41.329678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:41.329779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1068 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4fddd75a-26ca161d-9651733e-52688db6_0
2025-10-10T14:33:41.329977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1068 sessionId: src_id|4fddd75a-26ca161d-9651733e-52688db6_0 is DEAD
2025-10-10T14:33:41.330150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fddd75a-26ca161d-9651733e-52688db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:41.330165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fddd75a-26ca161d-9651733e-52688db6_0] Write session will restart in 0.008152s
2025-10-10T14:33:41.330191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fddd75a-26ca161d-9651733e-52688db6_0] Write session: Do CDS request
2025-10-10T14:33:41.330197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fddd75a-26ca161d-9651733e-52688db6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:41.329604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:41.339907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fddd75a-26ca161d-9651733e-52688db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.340019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:41.340032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1069
2025-10-10T14:33:41.340201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.340238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:41.340247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:41.340251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:41.340726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1069 sessionId:  describe result for acl check
2025-10-10T14:33:41.340762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:41.340772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:41.340773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:41.340780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601235979429497:4452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:41.341344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601235979429497:4452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:41.341348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:41.343266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:41.343462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:41.343474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:41.343486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:41.343537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:41.343599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601235197207500:6872]
2025-10-10T14:33:41.343643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601235979429497:4452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:41.344228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:41.344575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:41.344633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:41.344997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:41.345059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.345069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.345070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.345071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.345072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.345074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.345075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.345076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.345077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.345078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.345080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.345081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.345081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.345088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.345100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.345104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.345109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.345113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.345117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.345121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.345125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.345129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.345134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.345138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.345142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.345146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.345154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.345162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.345169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.345175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.345179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.345185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.345191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.345196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.345201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.345206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.345210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.345215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.345220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.345225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.345230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.345245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.345250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.345255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.345265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.345271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.345275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.345285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.345290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.345295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.345304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.345309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.345358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:41.346169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601235979429497:4452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:41.346182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601235979429497:4452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:41.346186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601235979429497:4452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:41.346194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:41.347783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:41.348256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:41.348270Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:41.348272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:41.348288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:41.348295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1068 [2:7559601235197207500:6872]
2025-10-10T14:33:41.348308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:41.348325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:41.348333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.348337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.348339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.348357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:41.348369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:41.348380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:41.348449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.348456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.348458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.348461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:41.348527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:41.348534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.348546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.348556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.348574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:41.348597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429388:2438], now have 1 active actors on pipe
2025-10-10T14:33:41.348603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429534:4452], now have 1 active actors on pipe
2025-10-10T14:33:41.348610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601235197207494:6872]
2025-10-10T14:33:41.348612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601235197207494:6872]
2025-10-10T14:33:41.348614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601235197207494:6872]
2025-10-10T14:33:41.348627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:41.348640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:41.348642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:41.348650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:41.348652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:41.348658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:41.348662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:41.348654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1068
2025-10-10T14:33:41.348659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1068
2025-10-10T14:33:41.348694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601235197207494:6872]
2025-10-10T14:33:41.348707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:41.348715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:41.348724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.348728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.348783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef08b65a-d310ff46-72b85d80-9177e755_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:41.348798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.348802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.348804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:41.348820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.348830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:41.348855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.349045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.349057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.349079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.349176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1069 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef08b65a-d310ff46-72b85d80-9177e755_0
2025-10-10T14:33:41.349621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fddd75a-26ca161d-9651733e-52688db6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef08b65a-d310ff46-72b85d80-9177e755_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:41.352411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef08b65a-d310ff46-72b85d80-9177e755_0] Write session: try to update token
2025-10-10T14:33:41.352429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef08b65a-d310ff46-72b85d80-9177e755_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:41.367115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId: src_id|ef08b65a-d310ff46-72b85d80-9177e755_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:41.369645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:41.369668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:41.369672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:41.369674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:41.369695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601235197207494:6872]
2025-10-10T14:33:41.369700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601235197207494:6872]
2025-10-10T14:33:41.369703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601235197207494:6872]
2025-10-10T14:33:41.369764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:41.369774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:41.369778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.369780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:41.369781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:41.369785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:41.369907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:41.369948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:41.429997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601235979429554:4999]
2025-10-10T14:33:41.430320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1068, pipe: [1:7559601235979429554:4999]
2025-10-10T14:33:41.486230Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:41.486568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.486582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.486625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429554:4999], now have 1 active actors on pipe
2025-10-10T14:33:41.486811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:41.486914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:41.486962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601235979429554:4999]
2025-10-10T14:33:41.486965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:41.487060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1069 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef08b65a-d310ff46-72b85d80-9177e755_0
2025-10-10T14:33:41.487300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1069 sessionId: src_id|ef08b65a-d310ff46-72b85d80-9177e755_0 is DEAD
2025-10-10T14:33:41.487457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef08b65a-d310ff46-72b85d80-9177e755_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:41.487472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef08b65a-d310ff46-72b85d80-9177e755_0] Write session will restart in 0.009349s
2025-10-10T14:33:41.487492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef08b65a-d310ff46-72b85d80-9177e755_0] Write session: Do CDS request
2025-10-10T14:33:41.487496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef08b65a-d310ff46-72b85d80-9177e755_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:41.498186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef08b65a-d310ff46-72b85d80-9177e755_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.498240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:41.498258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1070
2025-10-10T14:33:41.498449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.498491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:41.498503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:41.498507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:41.498945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1070 sessionId:  describe result for acl check
2025-10-10T14:33:41.498984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:41.498990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:41.498992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:41.498998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601235979429667:4447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:41.499567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601235979429667:4447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:41.499611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:41.501642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:41.501698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601235979429667:4447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:41.501879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:41.501890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:41.501903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:41.501966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:41.502013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601235197207663:6875]
2025-10-10T14:33:41.502739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:41.503050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:41.503095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:41.503412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:41.503474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.503482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.503483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.503485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.503486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.503487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.503488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.503489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.503491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.503492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.503493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.503495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.503496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.503502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.503514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.503519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.503523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.503527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.503531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.503535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.503539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.503544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.503548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.503553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.503557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.503561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.503569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.503578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.503584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.503590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.503594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.503599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.503603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.503608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.503619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.503624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.503633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.503639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.503645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.503655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.503659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.503665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.503672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.503678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.503687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.503692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.503697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.503706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.503711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.503716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.503724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.503730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.503773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:41.504394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601235979429667:4447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:41.504407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601235979429667:4447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:41.504411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601235979429667:4447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:41.504419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:41.506261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:41.506670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:41.506688Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:41.506690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:41.506694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:41.506700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1069 [2:7559601235197207663:6875]
2025-10-10T14:33:41.506711Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:41.506729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:41.506732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.506736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.506739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.506758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:41.506771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:41.506779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:41.506837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.506844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.506846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.506848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:41.506912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:41.506922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.506934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.506946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.506964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:41.506992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429702:4447], now have 1 active actors on pipe
2025-10-10T14:33:41.506995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429555:2438], now have 1 active actors on pipe
2025-10-10T14:33:41.507003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601235197207658:6875]
2025-10-10T14:33:41.507005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601235197207658:6875]
2025-10-10T14:33:41.507007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601235197207658:6875]
2025-10-10T14:33:41.507021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:41.507039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:41.507050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:41.507053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:41.507056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:41.507060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:41.507063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:41.507037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1069
2025-10-10T14:33:41.507066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1069
2025-10-10T14:33:41.507090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601235197207658:6875]
2025-10-10T14:33:41.507098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:41.507100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:41.507124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.507133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.507179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88069697-5c9c51a6-4964294c-7a1636b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:41.507192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.507196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.507198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:41.507209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.507225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:41.507248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.507404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.507412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.507427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.507537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1070 partition: 0 MaxSeqNo: 40 sessionId: src_id|88069697-5c9c51a6-4964294c-7a1636b9_0
2025-10-10T14:33:41.507946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef08b65a-d310ff46-72b85d80-9177e755_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|88069697-5c9c51a6-4964294c-7a1636b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:41.510643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88069697-5c9c51a6-4964294c-7a1636b9_0] Write session: try to update token
2025-10-10T14:33:41.510663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88069697-5c9c51a6-4964294c-7a1636b9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:41.525134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId: src_id|88069697-5c9c51a6-4964294c-7a1636b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:41.527018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:41.527045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:41.527048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:41.527051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:41.527060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601235197207658:6875]
2025-10-10T14:33:41.527065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601235197207658:6875]
2025-10-10T14:33:41.527069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601235197207658:6875]
2025-10-10T14:33:41.527125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:41.527128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:41.527136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:41.527140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.527141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:41.527143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:41.527285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:41.527963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:41.587115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601235979429713:4999]
2025-10-10T14:33:41.587448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1069, pipe: [1:7559601235979429713:4999]
2025-10-10T14:33:41.641790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:41.642172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.642188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.642235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429713:4999], now have 1 active actors on pipe
2025-10-10T14:33:41.642461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:41.642485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:41.642498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:41.642517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601235979429713:4999]
2025-10-10T14:33:41.642554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:41.642567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1070 reason: error at write: Disconnected sessionId: src_id|88069697-5c9c51a6-4964294c-7a1636b9_0
2025-10-10T14:33:41.642802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1070 sessionId: src_id|88069697-5c9c51a6-4964294c-7a1636b9_0 is DEAD
2025-10-10T14:33:41.642985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88069697-5c9c51a6-4964294c-7a1636b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:41.642997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88069697-5c9c51a6-4964294c-7a1636b9_0] Write session will restart in 0.008945s
2025-10-10T14:33:41.643021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88069697-5c9c51a6-4964294c-7a1636b9_0] Write session: Do CDS request
2025-10-10T14:33:41.643027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88069697-5c9c51a6-4964294c-7a1636b9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:41.652932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88069697-5c9c51a6-4964294c-7a1636b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.653035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:41.653051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1071
2025-10-10T14:33:41.653203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.653241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:41.653249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:41.653253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:41.653746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1071 sessionId:  describe result for acl check
2025-10-10T14:33:41.653800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:41.653806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:41.653807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:41.653815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601235979429832:4440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:41.654365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601235979429832:4440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:41.654432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:41.656145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:41.656332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:41.656341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:41.656352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:41.656408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:41.656454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601235197207817:6878]
2025-10-10T14:33:41.656608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601235979429832:4440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:41.657116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:41.657559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:41.657629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:41.657992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:41.658072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.658079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.658080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.658081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.658083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.658084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.658085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.658086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.658087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.658088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.658089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.658090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.658091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.658097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.658120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.658124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.658128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.658131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.658135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.658138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.658142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.658146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.658150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.658153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.658157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.658160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.658167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.658175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.658181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.658201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.658210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.658215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.658220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.658230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.658234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.658238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.658242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.658247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.658251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.658256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.658260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.658265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.658271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.658275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.658284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.658288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.658292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.658297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.658302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.658307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.658316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.658320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.658356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:41.660631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601235979429832:4440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:41.660644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601235979429832:4440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:41.660648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601235979429832:4440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:41.660657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:41.660695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:41.661084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:41.661101Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:41.661103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:41.661107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:41.661113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1070 [2:7559601235197207817:6878]
2025-10-10T14:33:41.661125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:41.661141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:41.661145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.661148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.661150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.661167Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:41.661174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:41.661181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:41.661247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.661254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.661256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.661259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:41.661425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1070
2025-10-10T14:33:41.661439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1070
2025-10-10T14:33:41.661435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:41.661446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.661457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.661467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.661485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:41.661520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429871:4440], now have 1 active actors on pipe
2025-10-10T14:33:41.661525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429720:2438], now have 1 active actors on pipe
2025-10-10T14:33:41.661543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.661548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.661566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601235197207812:6878]
2025-10-10T14:33:41.661567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601235197207812:6878]
2025-10-10T14:33:41.661569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601235197207812:6878]
2025-10-10T14:33:41.661580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:41.661591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:41.661596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:41.661599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:41.661601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:41.661602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:41.661604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:41.661620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|185551a6-e745e004-9770f219-3f56bf61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:41.661625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.661628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.661630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:41.661638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.661648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:41.661671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601235197207812:6878]
2025-10-10T14:33:41.661690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:41.661699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.661712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:41.661983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.661993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.662015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.662095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1071 partition: 0 MaxSeqNo: 40 sessionId: src_id|185551a6-e745e004-9770f219-3f56bf61_0
2025-10-10T14:33:41.662467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88069697-5c9c51a6-4964294c-7a1636b9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|185551a6-e745e004-9770f219-3f56bf61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:41.665139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185551a6-e745e004-9770f219-3f56bf61_0] Write session: try to update token
2025-10-10T14:33:41.665157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185551a6-e745e004-9770f219-3f56bf61_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:41.679127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:41.679149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:41.679161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601235197207812:6878]
2025-10-10T14:33:41.679217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:41.679232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:41.679422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:41.679573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:41.679712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:41.679844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:41.680041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:41.680084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:41.679758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId: src_id|185551a6-e745e004-9770f219-3f56bf61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:41.682677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:41.682911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.682933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.682987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:41.683071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:41.691091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:41.691112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:41.691115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:41.691116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:41.691126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601235197207812:6878]
2025-10-10T14:33:41.691131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601235197207812:6878]
2025-10-10T14:33:41.691135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601235197207812:6878]
2025-10-10T14:33:41.691184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:41.691187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:41.691192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.691194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:41.691194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:41.691197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:41.691326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:41.742783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601235979429902:4999]
2025-10-10T14:33:41.743102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1070, pipe: [1:7559601235979429902:4999]
2025-10-10T14:33:41.805960Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:41.814029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.814059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.814233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.814297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.814363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.814432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.814691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.814704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.814773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.814830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.814886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.814960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.815002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.815010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.815075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.815176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.815241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.815306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.815350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.815359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.815432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.815705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.815776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.815841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.815890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.815898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.815967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.816031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.816096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.816166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.816212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.816220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.816291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.816354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.816420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.816485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.816533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.816540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.816613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.816678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.816747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.816867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.816926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.816934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.817043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.817147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.817216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.817290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.817354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.817363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.817433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.817493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.818330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:41.818347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:41.818348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601235979429902:4999]
2025-10-10T14:33:41.818380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:41.818383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1071 reason: error at write: Disconnected sessionId: src_id|185551a6-e745e004-9770f219-3f56bf61_0
2025-10-10T14:33:41.818641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1071 sessionId: src_id|185551a6-e745e004-9770f219-3f56bf61_0 is DEAD
2025-10-10T14:33:41.818717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185551a6-e745e004-9770f219-3f56bf61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:41.818727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185551a6-e745e004-9770f219-3f56bf61_0] Write session will restart in 0.006492s
2025-10-10T14:33:41.818753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185551a6-e745e004-9770f219-3f56bf61_0] Write session: Do CDS request
2025-10-10T14:33:41.818759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185551a6-e745e004-9770f219-3f56bf61_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:41.817556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.817634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.817690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.817695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.817760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:41.817819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:41.817875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:41.817929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:41.817967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:41.817972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:41.818033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429902:4999], now have 1 active actors on pipe
2025-10-10T14:33:41.818429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:41.826883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185551a6-e745e004-9770f219-3f56bf61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.827023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:41.827039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1072
2025-10-10T14:33:41.827160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.827196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:41.827206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:41.827211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:41.827648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1072 sessionId:  describe result for acl check
2025-10-10T14:33:41.827689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:41.827696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:41.827698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:41.827704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601235979429961:4424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:41.828560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601235979429961:4424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:41.831547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601235979429961:4424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:41.831678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:41.833652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:41.833884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:41.833896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:41.833909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:41.833960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:41.834005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601235197208008:6893]
2025-10-10T14:33:41.834596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601235979429961:4424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:41.834610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601235979429961:4424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:41.834615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601235979429961:4424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:41.834623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:41.834696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:41.835047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:41.835106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:41.835450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:41.835509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.835519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.835521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.835522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.835523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.835524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.835525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.835526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.835527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.835529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.835530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.835531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.835532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.835539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.835552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.835557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.835561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.835565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.835569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.835573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.835577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.835581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.835586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.835590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.835594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.835598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.835606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.835615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.835621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.835628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.835632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.835638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.835642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.835648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.835653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.835658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.835662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.835668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.835673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.835679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.835683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.835689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.835694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.835699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.835703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.835709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.835714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.835720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.835725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.835730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.835736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.835741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.835783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:41.838285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:41.838924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:41.838942Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:41.838945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:41.838949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:41.838956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1071 [2:7559601235197208008:6893]
2025-10-10T14:33:41.838970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:41.838989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:41.839009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.839017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.839020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.839040Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:41.839053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:41.839061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:41.839127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.839136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.839138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.839140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:41.839215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:41.839223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.839236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.839250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.839273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:41.839301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979430050:4424], now have 1 active actors on pipe
2025-10-10T14:33:41.839313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979429904:2438], now have 1 active actors on pipe
2025-10-10T14:33:41.839321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601235197208003:6893]
2025-10-10T14:33:41.839325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601235197208003:6893]
2025-10-10T14:33:41.839322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1071
2025-10-10T14:33:41.839328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601235197208003:6893]
2025-10-10T14:33:41.839336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:41.839351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:41.839351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:41.839354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:41.839361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1071
2025-10-10T14:33:41.839357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:41.839369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:41.839372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:41.839419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.839430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.839451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601235197208003:6893]
2025-10-10T14:33:41.839466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:41.839485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:41.839503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:41.839510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.839515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.839517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:41.839530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.839545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:41.839570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.839736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.839745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.839759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.839877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1072 partition: 0 MaxSeqNo: 40 sessionId: src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0
2025-10-10T14:33:41.840348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185551a6-e745e004-9770f219-3f56bf61_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:41.843209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0] Write session: try to update token
2025-10-10T14:33:41.843229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:41.858044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId: src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:41.859304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:41.859328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:41.859331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:41.859333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:41.859343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601235197208003:6893]
2025-10-10T14:33:41.859348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601235197208003:6893]
2025-10-10T14:33:41.859352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601235197208003:6893]
2025-10-10T14:33:41.859401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:41.859399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:41.859407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:41.859411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:41.859415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.859417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:41.859548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:41.860670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:41.918400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601235979430062:4999]
2025-10-10T14:33:41.918729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1071, pipe: [1:7559601235979430062:4999]
2025-10-10T14:33:41.966176Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:41.966413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.966426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.966466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979430062:4999], now have 1 active actors on pipe
2025-10-10T14:33:41.966700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:41.966731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:41.966792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:41.966823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601235979430062:4999]
2025-10-10T14:33:41.966877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1072 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0
2025-10-10T14:33:41.967110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1072 sessionId: src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0 is DEAD
2025-10-10T14:33:41.967263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:41.967274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0] Write session will restart in 0.009675s
2025-10-10T14:33:41.967299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0] Write session: Do CDS request
2025-10-10T14:33:41.967305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:41.977899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.977952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:41.977966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1073
2025-10-10T14:33:41.978144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:41.978183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:41.978193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:41.978197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:41.978329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:41.978765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1073 sessionId:  describe result for acl check
2025-10-10T14:33:41.978802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:41.978809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:41.978811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:41.978817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601235979430180:4410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:41.979362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601235979430180:4410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:41.980030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:41.980229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:41.980240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:41.980253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:41.980308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:41.980348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601235197208162:6895]
2025-10-10T14:33:41.980990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:41.981286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:41.981309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601235979430180:4410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:41.981348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:41.981694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:41.981757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.981764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.981765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.981766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.981767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.981769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.981770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.981771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.981772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.981774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.981775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.981776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.981777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.981783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.981795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.981799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.981804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.981808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.981812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.981816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.981820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.981824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.981828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.981832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.981836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.981840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.981846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.981855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:41.981862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.981867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:41.981872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.981877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:41.981881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.981886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:41.981890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.981896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:41.981900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.981905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:41.981910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.981914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:41.981917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.981920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:41.981922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.981926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:41.981928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.981932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:41.981934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.981937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.981940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.981944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.981946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.981949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.981976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:41.984149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601235979430180:4410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:41.984164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601235979430180:4410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:41.984167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601235979430180:4410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:41.984175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:41.984232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:41.984554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:41.984566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:41.984569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:41.984573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:41.984578Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1072 [2:7559601235197208162:6895]
2025-10-10T14:33:41.984590Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:41.984606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:41.984613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.984617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.984619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.984636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:41.984647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:41.984655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:41.984730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.984737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.984739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.984741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:41.984804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:41.984811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:41.984822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:41.984839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:41.984861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:41.984894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979430213:4410], now have 1 active actors on pipe
2025-10-10T14:33:41.984902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601235979430063:2438], now have 1 active actors on pipe
2025-10-10T14:33:41.984909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601235197208156:6895]
2025-10-10T14:33:41.984912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601235197208156:6895]
2025-10-10T14:33:41.984914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601235197208156:6895]
2025-10-10T14:33:41.984914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1072
2025-10-10T14:33:41.984924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1072
2025-10-10T14:33:41.984937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:41.984951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:41.984955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:41.984962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:41.984965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:41.984972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:41.984976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:41.985000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601235197208156:6895]
2025-10-10T14:33:41.985012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:41.985025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:41.985031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.985036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.985084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:41.985097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:41.985104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:41.985107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:41.985118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:41.985132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:41.985154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.985298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:41.985313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:41.985355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:41.985482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1073 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0
2025-10-10T14:33:41.985897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50abd1f7-a683e340-1a2d0d37-f5440c4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:41.988651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0] Write session: try to update token
2025-10-10T14:33:41.988672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:42.003757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId: src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:42.004585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:42.004605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.004608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:42.004611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:42.004621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601235197208156:6895]
2025-10-10T14:33:42.004628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601235197208156:6895]
2025-10-10T14:33:42.004632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601235197208156:6895]
2025-10-10T14:33:42.004682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:42.004684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:42.004692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.004695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:42.004697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:42.004702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:42.004848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:42.006499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:42.066884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601240274397517:4999]
2025-10-10T14:33:42.067173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1072, pipe: [1:7559601240274397517:4999]
2025-10-10T14:33:42.129255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:42.129828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.129844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.129893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274397517:4999], now have 1 active actors on pipe
2025-10-10T14:33:42.130111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:42.130133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:42.130171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601240274397517:4999]
2025-10-10T14:33:42.130189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:42.130269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1073 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0
2025-10-10T14:33:42.130501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1073 sessionId: src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0 is DEAD
2025-10-10T14:33:42.130687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:42.130698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0] Write session will restart in 0.009050s
2025-10-10T14:33:42.130738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0] Write session: Do CDS request
2025-10-10T14:33:42.130745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:42.140999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.141089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:42.141106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1074
2025-10-10T14:33:42.141242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.141279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:42.141289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:42.141293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:42.141788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1074 sessionId:  describe result for acl check
2025-10-10T14:33:42.141829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:42.141835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:42.141838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:42.141844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601240274397633:4413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:42.142457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601240274397633:4413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:42.142695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:42.144838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601240274397633:4413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:42.144873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:42.145132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:42.145147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:42.145179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:42.145261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:42.145363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601239492175613:6897]
2025-10-10T14:33:42.146031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:42.146399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:42.146453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:42.146807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:42.146865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.146871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.146873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.146875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.146876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.146878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.146879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.146881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.146882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.146884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.146886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.146887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.146889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.146896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.146912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.146917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.146921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.146926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.146930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.146935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.146940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.146944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.146951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.146955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.146959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.146964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.146972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.146986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.146997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.147004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.147013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.147021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.147031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.147037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.147046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.147052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.147061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.147067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.147077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.147083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.147088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.147094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.147103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.147109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.147120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.147126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.147135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.147141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.147150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.147156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.147166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.147172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.147222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:42.148066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601240274397633:4413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:42.148083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601240274397633:4413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:42.148087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601240274397633:4413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:42.148097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:42.149778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:42.150355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:42.150380Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:42.150383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:42.150387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:42.150394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1073 [2:7559601239492175613:6897]
2025-10-10T14:33:42.150407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:42.150424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:42.150432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.150436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.150438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.150458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:42.150471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:42.150478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:42.150540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.150547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.150549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.150552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:42.150626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:42.150634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.150648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.150660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.150681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:42.150711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274397518:2438], now have 1 active actors on pipe
2025-10-10T14:33:42.150719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274397669:4413], now have 1 active actors on pipe
2025-10-10T14:33:42.150726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601239492175608:6897]
2025-10-10T14:33:42.150729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601239492175608:6897]
2025-10-10T14:33:42.150731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601239492175608:6897]
2025-10-10T14:33:42.150744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:42.150759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:42.150763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:42.150764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:42.150764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:42.150780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:42.150784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:42.150775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1073
2025-10-10T14:33:42.150820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601239492175608:6897]
2025-10-10T14:33:42.150827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:42.150781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1073
2025-10-10T14:33:42.150838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:42.150871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.150880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.150920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8a08077-9c5c763-8d794665-a25fad78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:42.150932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.150936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.150939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:42.150952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.150967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:42.150985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.151153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.151167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.151191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.151300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1074 partition: 0 MaxSeqNo: 40 sessionId: src_id|d8a08077-9c5c763-8d794665-a25fad78_0
2025-10-10T14:33:42.151751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b307c67-1199bbcf-1df280e9-3086f7d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d8a08077-9c5c763-8d794665-a25fad78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:42.154403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a08077-9c5c763-8d794665-a25fad78_0] Write session: try to update token
2025-10-10T14:33:42.154421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a08077-9c5c763-8d794665-a25fad78_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:42.168559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId: src_id|d8a08077-9c5c763-8d794665-a25fad78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:42.173516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:42.178956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.178999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.179027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:42.179030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.179036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:42.179038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:42.179049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601239492175608:6897]
2025-10-10T14:33:42.179055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601239492175608:6897]
2025-10-10T14:33:42.179061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601239492175608:6897]
2025-10-10T14:33:42.179124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:42.179132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:42.179136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:42.179139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:42.179149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.179155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:42.179302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:42.230237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601240274397676:4999]
2025-10-10T14:33:42.230581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1073, pipe: [1:7559601240274397676:4999]
2025-10-10T14:33:42.292400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:42.292928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:42.292992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274397676:4999], now have 1 active actors on pipe
2025-10-10T14:33:42.293091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:42.293211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601240274397676:4999]
2025-10-10T14:33:42.293246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:42.305624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:42.305641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:42.305680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1074 reason: error at write: Disconnected sessionId: src_id|d8a08077-9c5c763-8d794665-a25fad78_0
2025-10-10T14:33:42.305853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1074 sessionId: src_id|d8a08077-9c5c763-8d794665-a25fad78_0 is DEAD
2025-10-10T14:33:42.306038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a08077-9c5c763-8d794665-a25fad78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:42.306049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a08077-9c5c763-8d794665-a25fad78_0] Write session will restart in 0.009296s
2025-10-10T14:33:42.306074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a08077-9c5c763-8d794665-a25fad78_0] Write session: Do CDS request
2025-10-10T14:33:42.306080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a08077-9c5c763-8d794665-a25fad78_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:42.312406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:42.314571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:42.314930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:42.314943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:42.314956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:42.315046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:42.315099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601239492175769:6899]
2025-10-10T14:33:42.315703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:42.316056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:42.316130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:42.316482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:42.316559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.316565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.316567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.316568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.316568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.316569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.316571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.316572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.316573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.316574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.316576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.316577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.316578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.316585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.316598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.316603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.316606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.316610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.316614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.316618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.316621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.316625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.316629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.316633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.316637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.316640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.316649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.316658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.316664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.316669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.316674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.316678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.316683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.316687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.316692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.316701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.316705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.316710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.316714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.316723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.316726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.316731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.316735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.316739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.316754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.316758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.316762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.316767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.316772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.316776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.316781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.316785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.316831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:42.317022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a08077-9c5c763-8d794665-a25fad78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.317416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:42.317435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1075
2025-10-10T14:33:42.317575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.317614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:42.317620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:42.317624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:42.318172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1075 sessionId:  describe result for acl check
2025-10-10T14:33:42.318209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:42.318216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:42.318219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:42.318225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601240274397802:4402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:42.318936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601240274397802:4402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:42.319564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:42.320117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:42.320132Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:42.320134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:42.320138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:42.320145Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1074 [2:7559601239492175769:6899]
2025-10-10T14:33:42.320158Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:42.320177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:42.320180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.320184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.320187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.320206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:42.320219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:42.320231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:42.320306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.320314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.320316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.320319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:42.320492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:42.320501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.320514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.320513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1074
2025-10-10T14:33:42.320533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.320556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:42.320581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274397678:2438], now have 1 active actors on pipe
2025-10-10T14:33:42.320597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601239492175764:6899]
2025-10-10T14:33:42.320599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601239492175764:6899]
2025-10-10T14:33:42.320601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601239492175764:6899]
2025-10-10T14:33:42.320616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:42.320638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:42.320640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:42.320650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:42.320660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:42.320665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:42.320669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:42.320704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601239492175764:6899]
2025-10-10T14:33:42.320717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:42.320732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:42.322066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601240274397802:4402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:42.329223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601240274397802:4402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:42.329239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601240274397802:4402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:42.329243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601240274397802:4402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:42.329252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:42.329528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274397835:4402], now have 1 active actors on pipe
2025-10-10T14:33:42.329580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1074
2025-10-10T14:33:42.329679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.329697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.329743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3e4241a-2150346-252e9214-ccd33ac6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:42.329763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.329777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.329780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:42.329795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.329821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:42.329861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.330011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.330022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.330040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.330164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1075 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3e4241a-2150346-252e9214-ccd33ac6_0
2025-10-10T14:33:42.330586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a08077-9c5c763-8d794665-a25fad78_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3e4241a-2150346-252e9214-ccd33ac6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:42.334354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e4241a-2150346-252e9214-ccd33ac6_0] Write session: try to update token
2025-10-10T14:33:42.334378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e4241a-2150346-252e9214-ccd33ac6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:42.339532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:42.339549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.339561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601239492175764:6899]
2025-10-10T14:33:42.339619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:42.339620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:42.339802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:42.339955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.340109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.340261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.340458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:42.340503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:42.349974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId: src_id|f3e4241a-2150346-252e9214-ccd33ac6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:42.352513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:42.353094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.353126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.353151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:42.353155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.353159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:42.353161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:42.353171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601239492175764:6899]
2025-10-10T14:33:42.353184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601239492175764:6899]
2025-10-10T14:33:42.353188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601239492175764:6899]
2025-10-10T14:33:42.353248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:42.353253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:42.353262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.353265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:42.353265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:42.353272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:42.353434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:42.393528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601240274397850:4999]
2025-10-10T14:33:42.393740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1074, pipe: [1:7559601240274397850:4999]
2025-10-10T14:33:42.469029Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:42.469346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:42.469395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274397850:4999], now have 1 active actors on pipe
2025-10-10T14:33:42.469496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:42.469548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:42.469593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:42.469602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:42.469630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601240274397850:4999]
2025-10-10T14:33:42.469695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1075 reason: error at write: Disconnected sessionId: src_id|f3e4241a-2150346-252e9214-ccd33ac6_0
2025-10-10T14:33:42.469932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1075 sessionId: src_id|f3e4241a-2150346-252e9214-ccd33ac6_0 is DEAD
2025-10-10T14:33:42.470102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e4241a-2150346-252e9214-ccd33ac6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:42.470114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e4241a-2150346-252e9214-ccd33ac6_0] Write session will restart in 0.008920s
2025-10-10T14:33:42.470139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e4241a-2150346-252e9214-ccd33ac6_0] Write session: Do CDS request
2025-10-10T14:33:42.470146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e4241a-2150346-252e9214-ccd33ac6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:42.479911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e4241a-2150346-252e9214-ccd33ac6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.480008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:42.480022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1076
2025-10-10T14:33:42.480162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.480198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:42.480209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:42.480213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:42.480679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1076 sessionId:  describe result for acl check
2025-10-10T14:33:42.480712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:42.480718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:42.480720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:42.480728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601240274397969:4401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:42.481293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601240274397969:4401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:42.481468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:42.483252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:42.483464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:42.483484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:42.483497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:42.483511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601240274397969:4401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:42.483555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:42.483598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601239492175938:6902]
2025-10-10T14:33:42.484238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:42.484504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:42.484549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:42.484860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:42.484935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.484941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.484942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.484943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.484944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.484945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.484947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.484948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.484949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.484950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.484951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.484952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.484953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.484959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.484971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.484975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.484978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.484981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.484985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.484988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.484991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.484994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.484998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.485001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.485005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.485009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.485016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.485026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.485031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.485036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.485040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.485044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.485049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.485054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.485058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.485063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.485068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.485073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.485080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.485085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.485089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.485095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.485099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.485104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.485109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.485115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.485120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.485126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.485136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.485141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.485146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.485154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.485192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:42.485830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601240274397969:4401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:42.485844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601240274397969:4401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:42.485847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601240274397969:4401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:42.485855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:42.487929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:42.488306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:42.488317Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:42.488320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:42.488324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:42.488330Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1075 [2:7559601239492175938:6902]
2025-10-10T14:33:42.488343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:42.488365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:42.488372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.488376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.488378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.488396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:42.488408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:42.488416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:42.488642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.488654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.488656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.488659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:42.488736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:42.488747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.488759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.488772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.488792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:42.488814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274397852:2438], now have 1 active actors on pipe
2025-10-10T14:33:42.488819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398005:4401], now have 1 active actors on pipe
2025-10-10T14:33:42.488826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601239492175933:6902]
2025-10-10T14:33:42.488829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601239492175933:6902]
2025-10-10T14:33:42.488832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601239492175933:6902]
2025-10-10T14:33:42.488846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:42.488854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1075
2025-10-10T14:33:42.488864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:42.488866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:42.488856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1075
2025-10-10T14:33:42.488875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:42.488878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:42.488883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:42.488886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:42.488923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601239492175933:6902]
2025-10-10T14:33:42.488936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:42.488942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:42.488950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.488958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.489008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:42.489021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.489030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.489032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:42.489044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.489059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:42.489082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.489210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.489218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.489234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.489306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1076 partition: 0 MaxSeqNo: 40 sessionId: src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0
2025-10-10T14:33:42.489747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3e4241a-2150346-252e9214-ccd33ac6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:42.492440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0] Write session: try to update token
2025-10-10T14:33:42.492456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:42.506686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId: src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:42.509469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:42.509517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:42.509538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.509541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:42.509543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:42.509553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601239492175933:6902]
2025-10-10T14:33:42.509559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601239492175933:6902]
2025-10-10T14:33:42.509562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601239492175933:6902]
2025-10-10T14:33:42.509605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:42.509607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:42.509612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:42.509614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.509617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:42.509617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:42.509760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:42.569691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601240274398013:4999]
2025-10-10T14:33:42.569957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1075, pipe: [1:7559601240274398013:4999]
2025-10-10T14:33:42.616892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:42.617214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.617228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.617271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398013:4999], now have 1 active actors on pipe
2025-10-10T14:33:42.617478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:42.617490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:42.617496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601240274398013:4999]
2025-10-10T14:33:42.617523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:42.617526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:42.617585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1076 reason: error at write: Disconnected sessionId: src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0
2025-10-10T14:33:42.617816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1076 sessionId: src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0 is DEAD
2025-10-10T14:33:42.617971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:42.617982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0] Write session will restart in 0.006709s
2025-10-10T14:33:42.618005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0] Write session: Do CDS request
2025-10-10T14:33:42.618013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:42.625996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.626098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:42.626114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1077
2025-10-10T14:33:42.626267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.626306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:42.626316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:42.626320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:42.626812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1077 sessionId:  describe result for acl check
2025-10-10T14:33:42.626854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:42.626861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:42.626863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:42.626869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601240274398108:4393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:42.627490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601240274398108:4393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:42.629443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:42.629693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601240274398108:4393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:42.631579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:42.631830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:42.631842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:42.631854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:42.631909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:42.631952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601239492176096:6904]
2025-10-10T14:33:42.632366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601240274398108:4393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:42.632380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601240274398108:4393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:42.632383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601240274398108:4393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:42.632392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:42.632583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:42.632836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:42.632876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:42.633197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:42.633269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.633274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.633275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.633276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.633277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.633278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.633279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.633280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.633280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.633281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.633282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.633282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.633283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.633288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.633297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.633300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.633302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.633305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.633307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.633310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.633312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.633314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.633317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.633319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.633323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.633327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.633359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.633369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.633376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.633382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.633387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.633393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.633398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.633403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.633408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.633413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.633420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.633431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.633437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.633442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.633446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.633451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.633456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.633462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.633466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.633472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.633479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.633492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.633496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.633501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.633512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.633517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.633568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:42.636371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:42.636947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:42.636957Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:42.636959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:42.636962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:42.636967Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1076 [2:7559601239492176096:6904]
2025-10-10T14:33:42.636977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:42.636991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:42.636994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.636996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.636998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.637012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:42.637018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:42.637025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:42.637076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.637082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.637083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.637085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:42.637140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:42.637146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.637154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.637161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.637175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:42.637194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601239492176091:6904]
2025-10-10T14:33:42.637199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601239492176091:6904]
2025-10-10T14:33:42.637201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601239492176091:6904]
2025-10-10T14:33:42.637210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:42.637222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:42.637224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398021:2438], now have 1 active actors on pipe
2025-10-10T14:33:42.637228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:42.637235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:42.637238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:42.637238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:42.637241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:42.637245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398171:4393], now have 1 active actors on pipe
2025-10-10T14:33:42.637268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601239492176091:6904]
2025-10-10T14:33:42.637274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:42.637284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:42.637325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1076
2025-10-10T14:33:42.637371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1076
2025-10-10T14:33:42.637412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.637420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.637446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:42.637455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.637459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.637461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:42.637469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.637484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:42.637498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.637715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.637723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.637739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.637851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1077 partition: 0 MaxSeqNo: 40 sessionId: src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0
2025-10-10T14:33:42.638250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0fdf2-8228a01a-b042c3c2-8e52cb1f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:42.640815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0] Write session: try to update token
2025-10-10T14:33:42.640831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:42.650091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:42.650106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.650117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601239492176091:6904]
2025-10-10T14:33:42.650164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:42.650180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:42.650347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:42.650485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.650614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.650738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.650917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:42.650955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:42.655338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId: src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:42.657863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:42.658058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.658083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.658125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:42.658220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:42.670675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:42.670696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.670698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:42.670700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:42.670709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601239492176091:6904]
2025-10-10T14:33:42.670712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601239492176091:6904]
2025-10-10T14:33:42.670717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601239492176091:6904]
2025-10-10T14:33:42.670752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:42.670758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.670760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:42.670763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:42.670769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:42.670774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:42.670880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:42.717697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601240274398185:4999]
2025-10-10T14:33:42.718053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1076, pipe: [1:7559601240274398185:4999]
2025-10-10T14:33:42.780128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:42.788399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.788434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.788610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.788678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.788746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.788809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.789083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.789100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.789166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.789229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.789360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.789430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.789474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.789482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.789549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.789616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.789695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.789759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.789805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.789813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.789879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.789944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.790013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.790079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.790125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.790128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.790194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.790258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.790324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.790392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.790438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.790445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.790516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.790579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.790644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.790706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.790750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.790761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.790831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.790895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.790960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.791024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.791075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.791082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.791154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.791216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.791277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.791341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.791385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.791393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.791460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.791522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.791586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.791652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.791694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.791702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.791767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.791828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.791891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.791958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.792004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.792014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.792150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398185:4999], now have 1 active actors on pipe
2025-10-10T14:33:42.792338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601240274398185:4999]
2025-10-10T14:33:42.792364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:42.792403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:42.792410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:42.792439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1077 reason: error at write: Disconnected sessionId: src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0
2025-10-10T14:33:42.792668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1077 sessionId: src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0 is DEAD
2025-10-10T14:33:42.792795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:42.792801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0] Write session will restart in 0.005614s
2025-10-10T14:33:42.792826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0] Write session: Do CDS request
2025-10-10T14:33:42.792830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:42.792988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:42.799896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.799948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:42.799960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1078
2025-10-10T14:33:42.800131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.800166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:42.800175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:42.800179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:42.800590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1078 sessionId:  describe result for acl check
2025-10-10T14:33:42.800620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:42.800622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:42.800624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:42.800632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601240274398269:4375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:42.801152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601240274398269:4375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:42.802968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601240274398269:4375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:42.803748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:42.805521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:42.805745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:42.805822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601240274398269:4375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:42.805835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601240274398269:4375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:42.805839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601240274398269:4375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:42.805754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:42.805846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:42.805764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:42.805807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:42.805837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601239492176294:6915]
2025-10-10T14:33:42.806213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:42.806481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:42.806526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:42.806765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:42.806814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.806820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.806821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.806822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.806823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.806823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.806824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.806824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.806825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.806825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.806826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.806827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.806827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.806831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.806847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.806849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.806851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.806853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.806856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.806858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.806860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.806862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.806865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.806867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.806869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.806871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.806876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.806881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.806886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.806889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.806892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.806895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.806898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.806901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.806904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.806907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.806909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.806912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.806915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.806918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.806920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.806923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.806926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.806929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.806931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.806935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.806937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.806940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.806944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.806947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.806949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.806952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.806974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:42.809162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:42.809659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:42.809673Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:42.809675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:42.809679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:42.809685Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1077 [2:7559601239492176294:6915]
2025-10-10T14:33:42.809697Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:42.809714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:42.809723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.809726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.809728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.809745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:42.809752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:42.809765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:42.809823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.809829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.809831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.809834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:42.809898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:42.809906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.809914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.809934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.809950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:42.809977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398202:2438], now have 1 active actors on pipe
2025-10-10T14:33:42.809987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398362:4375], now have 1 active actors on pipe
2025-10-10T14:33:42.809994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601239492176288:6915]
2025-10-10T14:33:42.809997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601239492176288:6915]
2025-10-10T14:33:42.809999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601239492176288:6915]
2025-10-10T14:33:42.810013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:42.810033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:42.810044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1077
2025-10-10T14:33:42.810049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:42.810049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:42.810052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:42.810054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:42.810056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:42.810082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601239492176288:6915]
2025-10-10T14:33:42.810091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:42.810092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:42.810117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1077
2025-10-10T14:33:42.810148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.810157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.810185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd49378f-5979058e-8d72ced8-b566e723_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:42.810196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.810205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.810207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:42.810218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.810232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:42.810248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.810387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.810415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.810443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.810589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1078 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd49378f-5979058e-8d72ced8-b566e723_0
2025-10-10T14:33:42.810969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd7f949-d765ba73-6cca3bd8-257f4dac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd49378f-5979058e-8d72ced8-b566e723_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:42.813583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd49378f-5979058e-8d72ced8-b566e723_0] Write session: try to update token
2025-10-10T14:33:42.813600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd49378f-5979058e-8d72ced8-b566e723_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:42.821879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:42.821903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.821914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601239492176288:6915]
2025-10-10T14:33:42.821968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:42.821983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:42.822174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:42.822320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.822458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.822595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:42.822796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:42.822833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:42.827752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId: src_id|bd49378f-5979058e-8d72ced8-b566e723_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:42.830398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:42.830642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.830668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.830710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:42.830801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:42.840747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:42.840770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:42.840773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:42.840775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:42.840787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601239492176288:6915]
2025-10-10T14:33:42.840791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601239492176288:6915]
2025-10-10T14:33:42.840795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601239492176288:6915]
2025-10-10T14:33:42.840841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:42.840842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:42.840849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.840849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:42.840851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:42.840853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:42.840985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:42.892205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601240274398373:4999]
2025-10-10T14:33:42.892498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1077, pipe: [1:7559601240274398373:4999]
2025-10-10T14:33:42.953977Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:42.961424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.961454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.961612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.961688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.961759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.961818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.961866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.961874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.961935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.961997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.962059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.962126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.962164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.962171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.962243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.962305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.962369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.962428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.962468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.962475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.962543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.962601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.962659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.962719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.962769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.962775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.962835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.962891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.962950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.963008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.963048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.963055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.963114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.963169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.963226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.963284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.963325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.963331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.963389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.963443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.963500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.963563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.963613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.963621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.963686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.963738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.963801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.963866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.963905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.963910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.963969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.964022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.964081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.964135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.964176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.964183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.964244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:42.964309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:42.964372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:42.964433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:42.964479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:42.964481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:42.964537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398373:4999], now have 1 active actors on pipe
2025-10-10T14:33:42.964795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:42.964826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601240274398373:4999]
2025-10-10T14:33:42.964858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:42.964868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:42.964899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1078 reason: error at write: Disconnected sessionId: src_id|bd49378f-5979058e-8d72ced8-b566e723_0
2025-10-10T14:33:42.965155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1078 sessionId: src_id|bd49378f-5979058e-8d72ced8-b566e723_0 is DEAD
2025-10-10T14:33:42.965324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd49378f-5979058e-8d72ced8-b566e723_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:42.965350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd49378f-5979058e-8d72ced8-b566e723_0] Write session will restart in 0.005807s
2025-10-10T14:33:42.965376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd49378f-5979058e-8d72ced8-b566e723_0] Write session: Do CDS request
2025-10-10T14:33:42.965382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd49378f-5979058e-8d72ced8-b566e723_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:42.965460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:42.972921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd49378f-5979058e-8d72ced8-b566e723_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.973025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:42.973040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1079
2025-10-10T14:33:42.973210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:42.973249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:42.973255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:42.973258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:42.973738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1079 sessionId:  describe result for acl check
2025-10-10T14:33:42.973778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:42.973781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:42.973783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:42.973787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601240274398449:4367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:42.974234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601240274398449:4367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:42.976870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601240274398449:4367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:42.976965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:42.978948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:42.979193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:42.979206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:42.979220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:42.979277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:42.979324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601239492176453:6922]
2025-10-10T14:33:42.979329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601240274398449:4367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:42.979344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601240274398449:4367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:42.979348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601240274398449:4367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:42.979356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:42.979933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:42.980274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:42.980339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:42.980711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:42.980810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.980818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.980819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.980821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.980822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.980823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.980824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.980825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.980826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.980827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.980828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.980830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.980831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.980837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.980850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.980854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.980859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.980863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.980867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.980870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.980873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.980877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.980881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.980885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.980888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.980892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.980900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.980908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:42.980915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.980920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:42.980924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.980929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:42.980932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.980937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:42.980942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.980946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:42.980950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.980956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:42.980961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.980965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:42.980970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.980975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:42.980979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.980991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:42.980995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.981000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:42.981005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.981009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.981013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.981018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.981021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.981026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.981061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:42.983782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:42.984177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:42.984195Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:42.984198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:42.984202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:42.984208Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1078 [2:7559601239492176453:6922]
2025-10-10T14:33:42.984221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:42.984240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:42.984250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.984253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.984256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.984274Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:42.984281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:42.984289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:42.984349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.984359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.984361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.984364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:42.984432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:42.984440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:42.984452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:42.984463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:42.984479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:42.984502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398378:2438], now have 1 active actors on pipe
2025-10-10T14:33:42.984512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601240274398527:4367], now have 1 active actors on pipe
2025-10-10T14:33:42.984521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601239492176448:6922]
2025-10-10T14:33:42.984528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601239492176448:6922]
2025-10-10T14:33:42.984530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601239492176448:6922]
2025-10-10T14:33:42.984544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:42.984557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:42.984566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:42.984567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:42.984569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:42.984582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:42.984559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1078
2025-10-10T14:33:42.984586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:42.984596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1078
2025-10-10T14:33:42.984610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601239492176448:6922]
2025-10-10T14:33:42.984614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:42.984616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:42.984640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.984652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.984703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a4be313-948243f0-25058236-45e2abf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:42.984716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:42.984720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:42.984722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:42.984738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:42.984754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:42.984777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.984970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:42.984982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:42.985002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:42.985116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1079 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a4be313-948243f0-25058236-45e2abf2_0
2025-10-10T14:33:42.985527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd49378f-5979058e-8d72ced8-b566e723_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a4be313-948243f0-25058236-45e2abf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:42.988631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4be313-948243f0-25058236-45e2abf2_0] Write session: try to update token
2025-10-10T14:33:42.988650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4be313-948243f0-25058236-45e2abf2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:43.004545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId: src_id|8a4be313-948243f0-25058236-45e2abf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:43.004971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:43.004993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:43.004997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:43.004999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:43.005009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601239492176448:6922]
2025-10-10T14:33:43.005013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601239492176448:6922]
2025-10-10T14:33:43.005019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601239492176448:6922]
2025-10-10T14:33:43.005076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:43.005089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.005091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:43.005107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:43.005124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:43.005128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:43.005244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:43.007380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:43.064804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601244569365835:4999]
2025-10-10T14:33:43.065139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1078, pipe: [1:7559601244569365835:4999]
2025-10-10T14:33:43.118110Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:43.118391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.118413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.118462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569365835:4999], now have 1 active actors on pipe
2025-10-10T14:33:43.118659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601244569365835:4999]
2025-10-10T14:33:43.118659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:43.118691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:43.118695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:43.118693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:43.118754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1079 reason: error at write: Disconnected sessionId: src_id|8a4be313-948243f0-25058236-45e2abf2_0
2025-10-10T14:33:43.118964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1079 sessionId: src_id|8a4be313-948243f0-25058236-45e2abf2_0 is DEAD
2025-10-10T14:33:43.119172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4be313-948243f0-25058236-45e2abf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:43.119191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4be313-948243f0-25058236-45e2abf2_0] Write session will restart in 0.006912s
2025-10-10T14:33:43.119242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4be313-948243f0-25058236-45e2abf2_0] Write session: Do CDS request
2025-10-10T14:33:43.119258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4be313-948243f0-25058236-45e2abf2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:43.127985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4be313-948243f0-25058236-45e2abf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.128165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:43.128182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1080
2025-10-10T14:33:43.128355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.128394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:43.128405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:43.128409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:43.128913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1080 sessionId:  describe result for acl check
2025-10-10T14:33:43.128958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:43.128965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:43.128967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:43.128974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601244569365923:4358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:43.129584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601244569365923:4358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:43.131687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:43.131895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601244569365923:4358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:43.133629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:43.133856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:43.133873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:43.133888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:43.133960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:43.134006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601243787143909:6924]
2025-10-10T14:33:43.134468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601244569365923:4358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:43.134481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601244569365923:4358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:43.134484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601244569365923:4358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:43.134493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:43.134669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:43.134955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:43.135006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:43.135344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:43.135418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.135426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.135427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.135428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.135429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.135431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.135432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.135433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.135435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.135436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.135437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.135439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.135440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.135446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.135460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.135464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.135468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.135472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.135476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.135480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.135484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.135488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.135492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.135496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.135499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.135503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.135512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.135521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.135528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.135533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.135537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.135542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.135554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.135560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.135570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.135575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.135584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.135589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.135594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.135604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.135608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.135613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.135622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.135627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.135631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.135636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.135646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.135652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.135660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.135665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.135670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.135675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.135721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:43.138066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:43.138599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:43.138612Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:43.138614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:43.138618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:43.138625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1079 [2:7559601243787143909:6924]
2025-10-10T14:33:43.138637Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:43.138654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:43.138657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.138661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.138663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.138679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:43.138692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:43.138704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:43.138760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.138767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.138769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.138771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:43.138842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:43.138850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.138862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.138880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.138902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:43.138927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569365991:4358], now have 1 active actors on pipe
2025-10-10T14:33:43.138935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569365838:2438], now have 1 active actors on pipe
2025-10-10T14:33:43.138945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601243787143904:6924]
2025-10-10T14:33:43.138947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601243787143904:6924]
2025-10-10T14:33:43.138950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601243787143904:6924]
2025-10-10T14:33:43.138968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:43.138982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:43.138999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:43.139003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:43.139007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:43.138980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1079
2025-10-10T14:33:43.139013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:43.139015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:43.139028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601243787143904:6924]
2025-10-10T14:33:43.139018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1079
2025-10-10T14:33:43.139031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:43.139056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:43.139059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.139064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.139099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:43.139113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.139117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.139119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:43.139130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.139140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:43.139155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.139318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.139327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.139343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.139446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1080 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0
2025-10-10T14:33:43.139909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4be313-948243f0-25058236-45e2abf2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:43.142569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0] Write session: try to update token
2025-10-10T14:33:43.142588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:43.157393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId: src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:43.159294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:43.159336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:43.159340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:43.159342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:43.159354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601243787143904:6924]
2025-10-10T14:33:43.159360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601243787143904:6924]
2025-10-10T14:33:43.159365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601243787143904:6924]
2025-10-10T14:33:43.159416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:43.159419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:43.159427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.159429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:43.159435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:43.159440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:43.159577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:43.160241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:43.218896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601244569366002:4999]
2025-10-10T14:33:43.219208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1079, pipe: [1:7559601244569366002:4999]
2025-10-10T14:33:43.277419Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:43.277892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.277913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.277961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366002:4999], now have 1 active actors on pipe
2025-10-10T14:33:43.278169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:43.278201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601244569366002:4999]
2025-10-10T14:33:43.278220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:43.278223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:43.278216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:43.278295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1080 reason: error at write: Disconnected sessionId: src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0
2025-10-10T14:33:43.278512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1080 sessionId: src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0 is DEAD
2025-10-10T14:33:43.278679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:43.278691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0] Write session will restart in 0.009298s
2025-10-10T14:33:43.278721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0] Write session: Do CDS request
2025-10-10T14:33:43.278728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:43.288916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.288928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:43.288943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1081
2025-10-10T14:33:43.289180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.289225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:43.289235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:43.289239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:43.289666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1081 sessionId:  describe result for acl check
2025-10-10T14:33:43.289700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:43.289706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:43.289708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:43.289714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601244569366126:4356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:43.290085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:43.290279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601244569366126:4356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:43.292008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:43.292201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:43.292216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:43.292238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:43.292294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:43.292335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601243787144070:6926]
2025-10-10T14:33:43.292749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601244569366126:4356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:43.292940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:43.293243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:43.293287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:43.293631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:43.293705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.293711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.293712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.293714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.293715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.293716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.293717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.293718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.293719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.293720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.293721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.293723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.293724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.293729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.293742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.293745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.293749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.293753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.293757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.293761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.293764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.293768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.293772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.293775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.293778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.293781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.293789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.293797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.293802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.293807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.293810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.293815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.293820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.293825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.293829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.293833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.293837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.293841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.293846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.293850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.293854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.293858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.293862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.293867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.293871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.293875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.293880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.293884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.293887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.293893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.293897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.293901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.293935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:43.296200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601244569366126:4356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:43.296215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601244569366126:4356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:43.296218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601244569366126:4356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:43.296227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:43.296259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:43.296573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:43.296586Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:43.296589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:43.296593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:43.296599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1080 [2:7559601243787144070:6926]
2025-10-10T14:33:43.296610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:43.296629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:43.296633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.296636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.296638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.296655Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:43.296667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:43.296674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:43.296734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.296743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.296745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.296747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:43.296811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:43.296820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.296831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.296843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.296866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:43.296895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366162:4356], now have 1 active actors on pipe
2025-10-10T14:33:43.296905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366004:2438], now have 1 active actors on pipe
2025-10-10T14:33:43.296913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601243787144064:6926]
2025-10-10T14:33:43.296915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601243787144064:6926]
2025-10-10T14:33:43.296917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601243787144064:6926]
2025-10-10T14:33:43.296933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:43.296948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:43.296952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1080
2025-10-10T14:33:43.296955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1080
2025-10-10T14:33:43.296960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:43.296964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:43.296968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:43.296974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:43.296976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:43.296989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601243787144064:6926]
2025-10-10T14:33:43.296992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:43.297009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:43.297038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.297043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.297073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d87f935-562b4272-c68c5337-5888b922_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:43.297087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.297091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.297093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:43.297105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.297117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:43.297134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.297287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.297296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.297310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.297444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1081 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d87f935-562b4272-c68c5337-5888b922_0
2025-10-10T14:33:43.297837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5b1270-5d283a19-1aaa4e29-cf8f9e28_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d87f935-562b4272-c68c5337-5888b922_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:43.300737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87f935-562b4272-c68c5337-5888b922_0] Write session: try to update token
2025-10-10T14:33:43.300757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87f935-562b4272-c68c5337-5888b922_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:43.309223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:43.309252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:43.309268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601243787144064:6926]
2025-10-10T14:33:43.309323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:43.309350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:43.309648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:43.310002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:43.310184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:43.310400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:43.310737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:43.310806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:43.315995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId: src_id|5d87f935-562b4272-c68c5337-5888b922_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:43.318958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:43.319210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.319234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.319286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:43.319400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:43.327318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:43.327341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:43.327345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:43.327347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:43.327358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601243787144064:6926]
2025-10-10T14:33:43.327362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601243787144064:6926]
2025-10-10T14:33:43.327366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601243787144064:6926]
2025-10-10T14:33:43.327413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:43.327418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:43.327425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:43.327427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.327430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:43.327432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:43.327562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:43.378166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601244569366169:4999]
2025-10-10T14:33:43.378542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1080, pipe: [1:7559601244569366169:4999]
2025-10-10T14:33:43.445036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:43.453414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.453448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.453638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.453696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.453754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.453812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.454161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.454171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.454241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.454314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.454390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.454456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.454506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.454514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.454590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.454658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.454738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.454805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.454852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.454860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.454931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.455004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.455071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.455135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.455188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.455197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.455264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.455334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.455402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.455471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.455519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.455528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.455599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.455673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.455748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.455817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.455862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.455874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.455947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.456012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.456080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.456144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.456193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.456201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.456267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.456323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.456389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.456458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.456504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.456510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.456578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.456641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.456705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.456769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.456814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.456824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.456890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:43.456960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:43.457027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:43.457096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:43.457157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:43.457164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:43.457260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366169:4999], now have 1 active actors on pipe
2025-10-10T14:33:43.457592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601244569366169:4999]
2025-10-10T14:33:43.457629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:43.457695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:43.457708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:43.457743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1081 reason: error at write: Disconnected sessionId: src_id|5d87f935-562b4272-c68c5337-5888b922_0
2025-10-10T14:33:43.457988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1081 sessionId: src_id|5d87f935-562b4272-c68c5337-5888b922_0 is DEAD
2025-10-10T14:33:43.458158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87f935-562b4272-c68c5337-5888b922_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:43.458183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87f935-562b4272-c68c5337-5888b922_0] Write session will restart in 0.009118s
2025-10-10T14:33:43.458209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87f935-562b4272-c68c5337-5888b922_0] Write session: Do CDS request
2025-10-10T14:33:43.458216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87f935-562b4272-c68c5337-5888b922_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:43.458313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:43.468975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87f935-562b4272-c68c5337-5888b922_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.469038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:43.469056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1082
2025-10-10T14:33:43.469290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.469359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:43.469369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:43.469373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:43.469794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1082 sessionId:  describe result for acl check
2025-10-10T14:33:43.469831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:43.469839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:43.469841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:43.469847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601244569366259:4351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:43.470401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601244569366259:4351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:43.472837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601244569366259:4351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:43.472961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:43.475280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:43.475516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:43.475527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:43.475540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:43.475614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601244569366259:4351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:43.475628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601244569366259:4351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:43.475631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601244569366259:4351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:43.475606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:43.475648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601243787144244:6929]
2025-10-10T14:33:43.475640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:43.476291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:43.476574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:43.476614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:43.476942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:43.476995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.477002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.477003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.477004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.477006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.477007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.477008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.477009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.477011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.477012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.477013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.477015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.477016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.477021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.477035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.477039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.477043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.477047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.477050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.477055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.477058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.477063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.477067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.477071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.477075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.477079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.477086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.477095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.477103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.477109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.477113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.477118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.477123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.477129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.477139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.477144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.477149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.477159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.477165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.477171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.477179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.477185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.477190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.477199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.477204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.477214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.477219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.477229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.477233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.477239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.477248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.477254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.477299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:43.479664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:43.480049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:43.480067Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:43.480069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:43.480073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:43.480079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1081 [2:7559601243787144244:6929]
2025-10-10T14:33:43.480092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:43.480115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:43.480122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.480125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.480128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.480145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:43.480156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:43.480167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:43.480224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.480233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.480236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.480239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:43.480310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:43.480318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.480331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.480343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.480366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:43.480390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366183:2438], now have 1 active actors on pipe
2025-10-10T14:33:43.480398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366339:4351], now have 1 active actors on pipe
2025-10-10T14:33:43.480407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601243787144239:6929]
2025-10-10T14:33:43.480414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601243787144239:6929]
2025-10-10T14:33:43.480416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601243787144239:6929]
2025-10-10T14:33:43.480430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:43.480449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:43.480446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1081
2025-10-10T14:33:43.480449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:43.480452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:43.480468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1081
2025-10-10T14:33:43.480455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:43.480470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:43.480473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:43.480506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.480513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.480533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601243787144239:6929]
2025-10-10T14:33:43.480544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:43.480551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:43.480575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:43.480587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.480591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.480593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:43.480605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.480622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:43.480650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.480815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.480825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.480845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.480940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1082 partition: 0 MaxSeqNo: 40 sessionId: src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0
2025-10-10T14:33:43.481355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d87f935-562b4272-c68c5337-5888b922_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:43.484037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0] Write session: try to update token
2025-10-10T14:33:43.484055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:43.498083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId: src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:43.500859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:43.500951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:43.500979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:43.500985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:43.500989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:43.501003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601243787144239:6929]
2025-10-10T14:33:43.501011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601243787144239:6929]
2025-10-10T14:33:43.501022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601243787144239:6929]
2025-10-10T14:33:43.501058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:43.501081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:43.501084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.501085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:43.501093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.501115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:43.501129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.501132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:43.501290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:43.557830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601244569366350:4999]
2025-10-10T14:33:43.558132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1081, pipe: [1:7559601244569366350:4999]
2025-10-10T14:33:43.608159Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:43.608462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366350:4999], now have 1 active actors on pipe
2025-10-10T14:33:43.608714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:43.608751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601244569366350:4999]
2025-10-10T14:33:43.608768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:43.608774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:43.608839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1082 reason: error at write: Disconnected sessionId: src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0
2025-10-10T14:33:43.608980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:43.609046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1082 sessionId: src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0 is DEAD
2025-10-10T14:33:43.609230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:43.609238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0] Write session will restart in 0.008234s
2025-10-10T14:33:43.609265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0] Write session: Do CDS request
2025-10-10T14:33:43.609272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:43.618951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.619044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:43.619063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1083
2025-10-10T14:33:43.619215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.619258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:43.619269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:43.619273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:43.619688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1083 sessionId:  describe result for acl check
2025-10-10T14:33:43.619731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:43.619736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:43.619738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:43.619744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601244569366483:4337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:43.620296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601244569366483:4337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:43.620285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:43.622131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:43.622325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:43.622336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:43.622348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:43.622339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601244569366483:4337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:43.622403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:43.622446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601243787144408:6931]
2025-10-10T14:33:43.622967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:43.623284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:43.623353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:43.623703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:43.623763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.623769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.623770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.623771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.623772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.623773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.623775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.623776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.623778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.623779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.623780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.623781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.623782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.623788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.623800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.623805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.623809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.623813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.623817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.623821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.623824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.623829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.623833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.623837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.623841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.623845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.623852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.623860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.623867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.623873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.623879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.623884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.623893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.623898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.623903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.623912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.623917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.623922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.623926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.623931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.623936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.623941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.623946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.623950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.623959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.623964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.623969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.623974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.623978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.623994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.624004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.624009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.624053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:43.626472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601244569366483:4337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:43.626502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601244569366483:4337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:43.626506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601244569366483:4337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:43.626478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:43.626516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:43.626883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:43.626897Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:43.626899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:43.626903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:43.626911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1082 [2:7559601243787144408:6931]
2025-10-10T14:33:43.626923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:43.626941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:43.626944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.626948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.626950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.626968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:43.626980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:43.626989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:43.627064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.627074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.627076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.627079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:43.627146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:43.627155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.627167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.627178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.627198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:43.627222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366359:2438], now have 1 active actors on pipe
2025-10-10T14:33:43.627226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366519:4337], now have 1 active actors on pipe
2025-10-10T14:33:43.627233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601243787144402:6931]
2025-10-10T14:33:43.627235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601243787144402:6931]
2025-10-10T14:33:43.627237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601243787144402:6931]
2025-10-10T14:33:43.627252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:43.627266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:43.627271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:43.627274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:43.627263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1082
2025-10-10T14:33:43.627278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1082
2025-10-10T14:33:43.627290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:43.627308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:43.627313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:43.627351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601243787144402:6931]
2025-10-10T14:33:43.627361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:43.627362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:43.627385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.627390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.627429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:43.627443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.627447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.627450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:43.627462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.627480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:43.627508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.627628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.627637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.627653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.627764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1083 partition: 0 MaxSeqNo: 40 sessionId: src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0
2025-10-10T14:33:43.628155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7366d4ce-a1f64c5f-aebe5849-684f45a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:43.630797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0] Write session: try to update token
2025-10-10T14:33:43.630815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:43.646913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId: src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:43.649549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:43.651448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.651479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.651518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:43.651527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:43.651530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:43.651532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:43.651541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601243787144402:6931]
2025-10-10T14:33:43.651546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601243787144402:6931]
2025-10-10T14:33:43.651550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601243787144402:6931]
2025-10-10T14:33:43.651597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:43.651611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:43.651612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:43.651617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:43.651619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.651622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:43.651753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:43.708890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601244569366529:4999]
2025-10-10T14:33:43.709227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1082, pipe: [1:7559601244569366529:4999]
2025-10-10T14:33:43.764287Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:43.764664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:43.764726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366529:4999], now have 1 active actors on pipe
2025-10-10T14:33:43.764819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:43.764932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601244569366529:4999]
2025-10-10T14:33:43.764971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:43.776244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:43.776258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:43.776284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1083 reason: error at write: Disconnected sessionId: src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0
2025-10-10T14:33:43.776475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1083 sessionId: src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0 is DEAD
2025-10-10T14:33:43.776564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:43.776575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0] Write session will restart in 0.008575s
2025-10-10T14:33:43.776599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0] Write session: Do CDS request
2025-10-10T14:33:43.776606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:43.782514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:43.784408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:43.784657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:43.784671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:43.784686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:43.784753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:43.784798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601243787144574:6934]
2025-10-10T14:33:43.785442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:43.785780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:43.785835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:43.786156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:43.786239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.786247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.786248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.786249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.786250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.786251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.786253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.786254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.786255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.786256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.786258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.786259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.786260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.786267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.786281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.786285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.786289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.786294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.786298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.786301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.786304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.786308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.786312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.786315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.786318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.786322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.786332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.786341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.786347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.786353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.786357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.786369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.786374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.786380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.786390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.786395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.786404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.786409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.786414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.786425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.786430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.786435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.786444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.786449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.786458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.786462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.786467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.786472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.786481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.786486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.786491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.786501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.786537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:43.786893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.787038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:43.787053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1084
2025-10-10T14:33:43.787170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.787204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:43.787209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:43.787222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:43.787645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1084 sessionId:  describe result for acl check
2025-10-10T14:33:43.787676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:43.787682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:43.787684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:43.787690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601244569366663:4328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:43.788247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601244569366663:4328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:43.788980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:43.789406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:43.789418Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:43.789421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:43.789425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:43.789431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1083 [2:7559601243787144574:6934]
2025-10-10T14:33:43.789444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:43.789460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:43.789463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.789467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.789469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.789486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:43.789498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:43.789506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:43.789565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.789572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.789574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.789586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:43.789675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:43.789685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.789696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.789706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.789722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:43.789761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366531:2438], now have 1 active actors on pipe
2025-10-10T14:33:43.789774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601243787144569:6934]
2025-10-10T14:33:43.789776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601243787144569:6934]
2025-10-10T14:33:43.789778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601243787144569:6934]
2025-10-10T14:33:43.789791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:43.789803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:43.789806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:43.789806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:43.789809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:43.789792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1083
2025-10-10T14:33:43.789822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:43.789826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:43.789855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601243787144569:6934]
2025-10-10T14:33:43.789865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:43.789872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:43.790790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601244569366663:4328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:43.797012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601244569366663:4328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:43.797032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601244569366663:4328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:43.797037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601244569366663:4328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:43.797048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:43.797321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366698:4328], now have 1 active actors on pipe
2025-10-10T14:33:43.797410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1083
2025-10-10T14:33:43.797480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.797494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.797527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:43.797544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.797555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.797562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:43.797577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.797611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:43.797635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.797830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.797844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.797862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.797958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1084 partition: 0 MaxSeqNo: 40 sessionId: src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0
2025-10-10T14:33:43.798371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3763b6c-74080ae1-fafdb064-bb9afcae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:43.801201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0] Write session: try to update token
2025-10-10T14:33:43.801217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:43.809425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:43.809445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:43.809449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:43.809451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:43.809461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601243787144569:6934]
2025-10-10T14:33:43.809466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601243787144569:6934]
2025-10-10T14:33:43.809470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601243787144569:6934]
2025-10-10T14:33:43.809512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:43.809518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:43.809520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:43.809528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.809530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:43.809532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:43.809698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:43.821215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId: src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:43.824072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:43.865040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601244569366724:4999]
2025-10-10T14:33:43.865301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1083, pipe: [1:7559601244569366724:4999]
2025-10-10T14:33:43.922565Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:43.922910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.922925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.922946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366724:4999], now have 1 active actors on pipe
2025-10-10T14:33:43.923186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:43.923199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:43.923233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:43.923238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:43.923255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601244569366724:4999]
2025-10-10T14:33:43.923300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1084 reason: error at write: Disconnected sessionId: src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0
2025-10-10T14:33:43.923536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1084 sessionId: src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0 is DEAD
2025-10-10T14:33:43.923751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:43.923763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0] Write session will restart in 0.009242s
2025-10-10T14:33:43.923787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0] Write session: Do CDS request
2025-10-10T14:33:43.923794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:43.933892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.933998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:43.934015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1085
2025-10-10T14:33:43.934139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:43.934176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:43.934186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:43.934190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:43.934639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1085 sessionId:  describe result for acl check
2025-10-10T14:33:43.934681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:43.934691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:43.934693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:43.934699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601244569366844:4314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:43.935250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601244569366844:4314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:43.936632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:43.937612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601244569366844:4314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:43.938389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:43.938629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:43.938643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:43.938656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:43.938711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:43.938751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601243787144778:6949]
2025-10-10T14:33:43.939275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:43.939585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:43.939632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:43.939899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601244569366844:4314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:43.939913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601244569366844:4314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:43.939916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601244569366844:4314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:43.939925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:43.939953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:43.940006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.940013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.940014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.940015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.940015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.940016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.940017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.940017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.940018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.940019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.940019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.940020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.940021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.940025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.940033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.940035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.940038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.940040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.940042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.940044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.940046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.940048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.940051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.940055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.940058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.940062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.940069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.940078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:43.940084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.940090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:43.940094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.940100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:43.940104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.940109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:43.940114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.940120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:43.940125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.940130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:43.940135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.940140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:43.940144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.940148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:43.940152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.940157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:43.940162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.940167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:43.940172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.940177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.940182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.940187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.940191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.940197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.940239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:43.942793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:43.943185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:43.943199Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:43.943202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:43.943206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:43.943212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1084 [2:7559601243787144778:6949]
2025-10-10T14:33:43.943224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:43.943243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:43.943251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.943254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.943257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.943275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:43.943283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:43.943296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:43.943358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.943364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.943367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.943369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:43.943437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:43.943445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.943458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:43.943475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:43.943497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:43.943524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366726:2438], now have 1 active actors on pipe
2025-10-10T14:33:43.943534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601244569366886:4314], now have 1 active actors on pipe
2025-10-10T14:33:43.943542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601243787144773:6949]
2025-10-10T14:33:43.943544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601243787144773:6949]
2025-10-10T14:33:43.943546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601243787144773:6949]
2025-10-10T14:33:43.943555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:43.943569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:43.943548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1084
2025-10-10T14:33:43.943570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:43.943572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:43.943560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1084
2025-10-10T14:33:43.943574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:43.943584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:43.943588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:43.943629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.943639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.943653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601243787144773:6949]
2025-10-10T14:33:43.943669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:43.943675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:43.943697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:43.943709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:43.943713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:43.943720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:43.943730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:43.943746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:43.943773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.943932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:43.943939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:43.943955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:43.944064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1085 partition: 0 MaxSeqNo: 40 sessionId: src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0
2025-10-10T14:33:43.944480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d764ac02-6371b5e4-2d8fbd6e-63857a8a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:43.947449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0] Write session: try to update token
2025-10-10T14:33:43.947469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:43.962798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId: src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:43.962988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:43.963009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:43.963012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:43.963015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:43.963024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601243787144773:6949]
2025-10-10T14:33:43.963029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601243787144773:6949]
2025-10-10T14:33:43.963034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601243787144773:6949]
2025-10-10T14:33:43.963080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:43.963085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:43.963093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:43.963095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:43.963095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:43.963101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:43.963241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:43.965510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:44.023257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601248864334191:4999]
2025-10-10T14:33:44.023560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1084, pipe: [1:7559601248864334191:4999]
2025-10-10T14:33:44.075510Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:44.076062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.076088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.076147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334191:4999], now have 1 active actors on pipe
2025-10-10T14:33:44.076417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:44.076460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601248864334191:4999]
2025-10-10T14:33:44.076460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:44.076466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:44.076508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:44.076541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1085 reason: error at write: Disconnected sessionId: src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0
2025-10-10T14:33:44.076773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1085 sessionId: src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0 is DEAD
2025-10-10T14:33:44.076942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:44.076952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0] Write session will restart in 0.008455s
2025-10-10T14:33:44.076990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0] Write session: Do CDS request
2025-10-10T14:33:44.077000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:44.086948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.086987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:44.087006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1086
2025-10-10T14:33:44.087204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.087253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:44.087267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:44.087278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:44.087764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1086 sessionId:  describe result for acl check
2025-10-10T14:33:44.087801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:44.087807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:44.087808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:44.087815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601248864334319:4309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:44.088338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601248864334319:4309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:44.089243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:44.090288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601248864334319:4309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:44.091366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:44.091646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:44.091660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:44.091674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:44.091743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:44.091793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601248082112241:6951]
2025-10-10T14:33:44.092414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:44.092773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:44.092830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:44.093121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601248864334319:4309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:44.093136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601248864334319:4309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:44.093139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601248864334319:4309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:44.093147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:44.093359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:44.093436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.093445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.093447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.093448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.093450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.093451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.093452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.093454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.093456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.093457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.093459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.093461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.093462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.093470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.093486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.093493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.093501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.093508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.093512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.093518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.093523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.093532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.093536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.093540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.093544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.093548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.093561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.093570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.093581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.093598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.093614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.093620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.093628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.093634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.093639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.093644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.093648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.093653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.093659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.093668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.093673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.093679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.093688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.093693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.093702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.093707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.093728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.093738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.093744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.093751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.093755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.093761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.093807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:44.096295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:44.096618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:44.096631Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:44.096634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:44.096638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:44.096643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1085 [2:7559601248082112241:6951]
2025-10-10T14:33:44.096657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:44.096675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:44.096684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.096688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.096690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.096706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:44.096716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:44.096723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:44.096782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.096790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.096793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.096795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:44.096866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:44.096875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.096887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.096899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.096917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:44.096937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334354:4309], now have 1 active actors on pipe
2025-10-10T14:33:44.096945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334193:2438], now have 1 active actors on pipe
2025-10-10T14:33:44.096953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601248082112236:6951]
2025-10-10T14:33:44.096960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601248082112236:6951]
2025-10-10T14:33:44.096962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601248082112236:6951]
2025-10-10T14:33:44.096975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:44.096990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:44.096992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:44.096995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:44.096997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:44.097013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:44.097017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:44.097014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1085
2025-10-10T14:33:44.097042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601248082112236:6951]
2025-10-10T14:33:44.097052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:44.097054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:44.097075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.097081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.097017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1085
2025-10-10T14:33:44.097130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:44.097144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.097152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.097154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:44.097165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.097179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:44.097208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.097396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.097410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.097435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.097532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1086 partition: 0 MaxSeqNo: 40 sessionId: src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0
2025-10-10T14:33:44.097948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fedb4d3-899299d5-e6971a80-dad2d99c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:44.100505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0] Write session: try to update token
2025-10-10T14:33:44.100522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:44.115812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:44.115835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:44.115838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:44.115840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:44.115850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601248082112236:6951]
2025-10-10T14:33:44.115855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601248082112236:6951]
2025-10-10T14:33:44.115859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601248082112236:6951]
2025-10-10T14:33:44.115904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:44.115912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.115915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:44.115929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:44.115936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:44.115941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:44.116050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:44.117672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId: src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:44.120393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:44.176842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601248864334363:4999]
2025-10-10T14:33:44.177161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1085, pipe: [1:7559601248864334363:4999]
2025-10-10T14:33:44.228375Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:44.228662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.228678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.228724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334363:4999], now have 1 active actors on pipe
2025-10-10T14:33:44.228962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:44.228965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:44.229026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601248864334363:4999]
2025-10-10T14:33:44.229221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:44.229303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1086 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0
2025-10-10T14:33:44.229516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1086 sessionId: src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0 is DEAD
2025-10-10T14:33:44.229705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:44.229716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0] Write session will restart in 0.005943s
2025-10-10T14:33:44.229752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0] Write session: Do CDS request
2025-10-10T14:33:44.229759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:44.236912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.237019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:44.237034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1087
2025-10-10T14:33:44.237154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.237200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:44.237208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:44.237211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:44.237634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1087 sessionId:  describe result for acl check
2025-10-10T14:33:44.237671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:44.237677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:44.237679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:44.237685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601248864334404:4299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:44.238264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601248864334404:4299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:44.240710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601248864334404:4299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:44.242276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:44.244130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:44.244354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:44.244367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:44.244380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:44.244444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:44.244488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601248082112409:6953]
2025-10-10T14:33:44.244514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601248864334404:4299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:44.244528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601248864334404:4299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:44.244532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601248864334404:4299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:44.244541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:44.244965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:44.245244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:44.245277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:44.245547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:44.245612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.245619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.245619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.245620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.245621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.245622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.245622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.245623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.245624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.245624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.245625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.245626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.245626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.245631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.245640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.245643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.245645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.245647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.245649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.245652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.245654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.245656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.245659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.245661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.245663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.245665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.245671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.245676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.245681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.245684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.245687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.245690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.245692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.245696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.245698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.245702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.245705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.245708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.245711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.245715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.245717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.245720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.245724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.245727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.245729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.245732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.245735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.245738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.245741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.245744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.245746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.245749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.245772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:44.248055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:44.248529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:44.248541Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:44.248543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:44.248547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:44.248551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1086 [2:7559601248082112409:6953]
2025-10-10T14:33:44.248560Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:44.248574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:44.248580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.248582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.248584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.248596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:44.248605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:44.248611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:44.248656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.248662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.248663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.248665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:44.248716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:44.248722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.248732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.248743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.248764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:44.248788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601248082112404:6953]
2025-10-10T14:33:44.248794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601248082112404:6953]
2025-10-10T14:33:44.248795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601248082112404:6953]
2025-10-10T14:33:44.248805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:44.248817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334525:4299], now have 1 active actors on pipe
2025-10-10T14:33:44.248823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334364:2438], now have 1 active actors on pipe
2025-10-10T14:33:44.248824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:44.248828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:44.248830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:44.248831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:44.248841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:44.248843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:44.248865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601248082112404:6953]
2025-10-10T14:33:44.248876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:44.248886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:44.248885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1086
2025-10-10T14:33:44.248886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1086
2025-10-10T14:33:44.248956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.248964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.248987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|945de1-272c0894-3318790b-d31d1e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:44.248997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.249000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.249001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:44.249009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.249018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:44.249032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.249196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.249205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.249217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.249314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1087 partition: 0 MaxSeqNo: 40 sessionId: src_id|945de1-272c0894-3318790b-d31d1e0_0
2025-10-10T14:33:44.249742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6580335b-8b5d3764-3d7e8ec9-dacf53f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|945de1-272c0894-3318790b-d31d1e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:44.252497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945de1-272c0894-3318790b-d31d1e0_0] Write session: try to update token
2025-10-10T14:33:44.252520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945de1-272c0894-3318790b-d31d1e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:44.266795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId: src_id|945de1-272c0894-3318790b-d31d1e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:44.267846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:44.267868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:44.267871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:44.267873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:44.267881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601248082112404:6953]
2025-10-10T14:33:44.267886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601248082112404:6953]
2025-10-10T14:33:44.267890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601248082112404:6953]
2025-10-10T14:33:44.267938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:44.267946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.267948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:44.267959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:44.267979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:44.267984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:44.268083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:44.269367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:44.329407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601248864334536:4999]
2025-10-10T14:33:44.329773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1086, pipe: [1:7559601248864334536:4999]
2025-10-10T14:33:44.379392Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:44.379683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.379703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.379746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334536:4999], now have 1 active actors on pipe
2025-10-10T14:33:44.379967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:44.380011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:44.380024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:44.380026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:44.380524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945de1-272c0894-3318790b-d31d1e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:44.380541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945de1-272c0894-3318790b-d31d1e0_0] Write session will restart in 0.005073s
2025-10-10T14:33:44.380074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601248864334536:4999]
2025-10-10T14:33:44.380090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1087 reason: error at write: Disconnected sessionId: src_id|945de1-272c0894-3318790b-d31d1e0_0
2025-10-10T14:33:44.380311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1087 sessionId: src_id|945de1-272c0894-3318790b-d31d1e0_0 is DEAD
2025-10-10T14:33:44.380579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945de1-272c0894-3318790b-d31d1e0_0] Write session: Do CDS request
2025-10-10T14:33:44.380588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945de1-272c0894-3318790b-d31d1e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:44.386891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|945de1-272c0894-3318790b-d31d1e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.387011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:44.387027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1088
2025-10-10T14:33:44.387193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.387251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:44.387262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:44.387266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:44.387849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1088 sessionId:  describe result for acl check
2025-10-10T14:33:44.387884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:44.387891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:44.387893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:44.387901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601248864334569:4286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:44.388449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601248864334569:4286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:44.391374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601248864334569:4286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:44.392902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:44.394771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:44.394975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:44.394987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:44.395000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:44.395057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:44.395098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601248082112578:6955]
2025-10-10T14:33:44.395212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601248864334569:4286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:44.395225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601248864334569:4286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:44.395228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601248864334569:4286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:44.395237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:44.395683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:44.396009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:44.396070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:44.396422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:44.396481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.396487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.396489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.396490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.396492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.396494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.396495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.396497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.396498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.396499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.396501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.396502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.396504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.396510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.396521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.396526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.396529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.396533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.396537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.396540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.396543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.396546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.396550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.396554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.396557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.396561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.396570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.396578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.396584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.396589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.396593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.396598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.396602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.396607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.396611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.396616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.396620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.396624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.396628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.396634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.396638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.396643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.396646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.396651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.396655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.396659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.396663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.396668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.396672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.396677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.396681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.396690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.396750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:44.399127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:44.399560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:44.399575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:44.399577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:44.399580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:44.399586Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1087 [2:7559601248082112578:6955]
2025-10-10T14:33:44.399598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:44.399620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:44.399628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.399632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.399635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.399651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:44.399659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:44.399666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:44.399724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.399746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.399749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.399751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:44.399818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:44.399827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.399839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.399851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.399868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:44.399894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334537:2438], now have 1 active actors on pipe
2025-10-10T14:33:44.399903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334698:4286], now have 1 active actors on pipe
2025-10-10T14:33:44.399911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601248082112573:6955]
2025-10-10T14:33:44.399914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601248082112573:6955]
2025-10-10T14:33:44.399916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601248082112573:6955]
2025-10-10T14:33:44.399931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:44.399950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:44.399965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1087
2025-10-10T14:33:44.399974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1087
2025-10-10T14:33:44.399963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:44.399971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:44.399975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:44.399980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:44.399982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:44.400002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601248082112573:6955]
2025-10-10T14:33:44.400006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:44.400015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:44.400054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.400065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.400092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|729cf50a-217dc775-52384878-31170991_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:44.400106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.400115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.400117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:44.400128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.400144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:44.400162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.400310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.400321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.400337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.400454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1088 partition: 0 MaxSeqNo: 40 sessionId: src_id|729cf50a-217dc775-52384878-31170991_0
2025-10-10T14:33:44.400866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|945de1-272c0894-3318790b-d31d1e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|729cf50a-217dc775-52384878-31170991_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:44.403595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729cf50a-217dc775-52384878-31170991_0] Write session: try to update token
2025-10-10T14:33:44.403618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729cf50a-217dc775-52384878-31170991_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:44.417326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:44.417367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:44.417380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601248082112573:6955]
2025-10-10T14:33:44.417429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:44.417435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:44.417623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:44.417777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:44.417913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:44.418048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:44.418252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:44.418296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:44.419654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId: src_id|729cf50a-217dc775-52384878-31170991_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:44.422174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:44.422383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.422416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.422457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:44.422534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:44.430210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:44.430231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:44.430234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:44.430236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:44.430248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601248082112573:6955]
2025-10-10T14:33:44.430252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601248082112573:6955]
2025-10-10T14:33:44.430255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601248082112573:6955]
2025-10-10T14:33:44.430305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:44.430309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:44.430316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:44.430318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.430320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:44.430321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:44.430453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:44.480459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601248864334722:4999]
2025-10-10T14:33:44.480772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1087, pipe: [1:7559601248864334722:4999]
2025-10-10T14:33:44.539520Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:44.547023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.547047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.547200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.547266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.547334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.547401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.547452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.547462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.547533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.547595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.547662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.547733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.547781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.547789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.547864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.547937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.548010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.548080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.548130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.548138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.548209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.548274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.548340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.548414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.548459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.548467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.548542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.548610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.548679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.548747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.548799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.548807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.548878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.548943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.549011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.549070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.549110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.549115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.549178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.549234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.549294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.549380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.549422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.549427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.549490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.549545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.549617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.549675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.549715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.549720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.549782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.549835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.549892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.549951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.549991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.549997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.550056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:44.550109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:44.550177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:44.550238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:44.550278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:44.550283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:44.550332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334722:4999], now have 1 active actors on pipe
2025-10-10T14:33:44.550509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:44.550553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601248864334722:4999]
2025-10-10T14:33:44.550753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:44.550762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:44.550793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1088 reason: error at write: Disconnected sessionId: src_id|729cf50a-217dc775-52384878-31170991_0
2025-10-10T14:33:44.551001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1088 sessionId: src_id|729cf50a-217dc775-52384878-31170991_0 is DEAD
2025-10-10T14:33:44.551146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729cf50a-217dc775-52384878-31170991_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:44.551155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729cf50a-217dc775-52384878-31170991_0] Write session will restart in 0.009015s
2025-10-10T14:33:44.551183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729cf50a-217dc775-52384878-31170991_0] Write session: Do CDS request
2025-10-10T14:33:44.551189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729cf50a-217dc775-52384878-31170991_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:44.551324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:44.561907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729cf50a-217dc775-52384878-31170991_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.562007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:44.562023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1089
2025-10-10T14:33:44.562151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.562190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:44.562196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:44.562200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:44.562671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1089 sessionId:  describe result for acl check
2025-10-10T14:33:44.562708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:44.562710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:44.562712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:44.562718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601248864334858:4292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:44.563280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601248864334858:4292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:44.564339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:44.565796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601248864334858:4292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:44.566228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:44.566426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:44.566437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:44.566449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:44.566501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:44.566544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601248082112761:6958]
2025-10-10T14:33:44.567184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:44.567448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:44.567489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:44.567802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:44.567857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.567863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.567864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.567865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.567866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.567868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.567869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.567870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.567872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.567873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.567874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.567875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.567877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.567882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.567895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.567900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.567904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.567909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.567913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.567917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.567922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.567926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.567931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.567935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.567939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.567943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.567950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.567965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.567975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.567981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.567990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.567996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.568006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.568012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.568021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.568027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.568036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.568042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.568051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.568057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.568066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.568071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.568077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.568087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.568091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.568101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.568106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.568111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.568120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.568125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.568135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.568141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.568186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:44.568602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601248864334858:4292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:44.568618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601248864334858:4292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:44.568622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601248864334858:4292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:44.568631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:44.570539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:44.570878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:44.570891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:44.570893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:44.570897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:44.570903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1088 [2:7559601248082112761:6958]
2025-10-10T14:33:44.570915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:44.570932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:44.570935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.570938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.570941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.570958Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:44.570966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:44.570979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:44.571042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.571050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.571053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.571056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:44.571124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:44.571131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.571144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.571156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.571181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:44.571208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334894:4292], now have 1 active actors on pipe
2025-10-10T14:33:44.571215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334725:2438], now have 1 active actors on pipe
2025-10-10T14:33:44.571223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601248082112756:6958]
2025-10-10T14:33:44.571230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601248082112756:6958]
2025-10-10T14:33:44.571232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601248082112756:6958]
2025-10-10T14:33:44.571214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1088
2025-10-10T14:33:44.571242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:44.571215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1088
2025-10-10T14:33:44.571256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:44.571274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:44.571278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:44.571282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:44.571282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:44.571284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:44.571322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.571333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.571347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601248082112756:6958]
2025-10-10T14:33:44.571365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:44.571378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:44.571399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:44.571412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.571416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.571419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:44.571431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.571442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:44.571468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.571629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.571638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.571654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.573406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1089 partition: 0 MaxSeqNo: 40 sessionId: src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0
2025-10-10T14:33:44.573879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729cf50a-217dc775-52384878-31170991_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:44.576636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0] Write session: try to update token
2025-10-10T14:33:44.576657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:44.591072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:44.591090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:44.591094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:44.591096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:44.591105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601248082112756:6958]
2025-10-10T14:33:44.591109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601248082112756:6958]
2025-10-10T14:33:44.591113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601248082112756:6958]
2025-10-10T14:33:44.591160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:44.591165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:44.591166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:44.591169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:44.591173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.591175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:44.591187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId: src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:44.591308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:44.593830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:44.650970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601248864334908:4999]
2025-10-10T14:33:44.651327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1088, pipe: [1:7559601248864334908:4999]
2025-10-10T14:33:44.710909Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:44.711367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.711386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.711436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334908:4999], now have 1 active actors on pipe
2025-10-10T14:33:44.711668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:44.711663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601248864334908:4999]
2025-10-10T14:33:44.711670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:44.711675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:44.711708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:44.711741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1089 reason: error at write: Disconnected sessionId: src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0
2025-10-10T14:33:44.711999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1089 sessionId: src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0 is DEAD
2025-10-10T14:33:44.712161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:44.712169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0] Write session will restart in 0.007204s
2025-10-10T14:33:44.712195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0] Write session: Do CDS request
2025-10-10T14:33:44.712201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:44.721846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.721952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:44.721968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1090
2025-10-10T14:33:44.722094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.722131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:44.722139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:44.722142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:44.722645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1090 sessionId:  describe result for acl check
2025-10-10T14:33:44.722683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:44.722689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:44.722691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:44.722698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601248864335029:4284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:44.723261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601248864335029:4284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:44.724725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:44.725865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601248864335029:4284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:44.726632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:44.726822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:44.726836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:44.726849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:44.726907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:44.726946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601248082112934:6961]
2025-10-10T14:33:44.727569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:44.727868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:44.727914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:44.728216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:44.728284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.728280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601248864335029:4284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:44.728290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.728293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601248864335029:4284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:44.728291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.728296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601248864335029:4284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:44.728303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:44.728292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.728293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.728294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.728296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.728297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.728298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.728299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.728300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.728301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.728302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.728308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.728320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.728324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.728327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.728330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.728333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.728337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.728340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.728344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.728349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.728352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.728356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.728360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.728366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.728375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.728381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.728387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.728391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.728396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.728400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.728405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.728410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.728415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.728419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.728425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.728430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.728435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.728439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.728444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.728455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.728460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.728469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.728473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.728478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.728488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.728493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.728498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.728502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.728508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.728546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:44.730808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:44.731123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:44.731134Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:44.731136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:44.731139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:44.731144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1089 [2:7559601248082112934:6961]
2025-10-10T14:33:44.731154Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:44.731176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:44.731183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.731186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.731188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.731205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:44.731216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:44.731228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:44.731297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.731305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.731307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.731309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:44.731373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:44.731379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.731480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1089
2025-10-10T14:33:44.731485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1089
2025-10-10T14:33:44.731390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.731415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.731428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:44.731449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864334912:2438], now have 1 active actors on pipe
2025-10-10T14:33:44.731453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864335077:4284], now have 1 active actors on pipe
2025-10-10T14:33:44.731460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601248082112929:6961]
2025-10-10T14:33:44.731462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601248082112929:6961]
2025-10-10T14:33:44.731463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601248082112929:6961]
2025-10-10T14:33:44.731481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:44.731496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:44.731498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:44.731501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:44.731503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:44.731514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:44.731517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:44.731541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601248082112929:6961]
2025-10-10T14:33:44.731544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:44.731553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:44.731564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.731569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.731613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f45400b6-6e68a852-519c5a6d-643771d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:44.731628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.731631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.731633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:44.731643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.731652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:44.731668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.731835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.731847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.731870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.731978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1090 partition: 0 MaxSeqNo: 40 sessionId: src_id|f45400b6-6e68a852-519c5a6d-643771d6_0
2025-10-10T14:33:44.732327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d04c6c0-e6f544b8-81e96111-ced42350_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f45400b6-6e68a852-519c5a6d-643771d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:44.735055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45400b6-6e68a852-519c5a6d-643771d6_0] Write session: try to update token
2025-10-10T14:33:44.735073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45400b6-6e68a852-519c5a6d-643771d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:44.749249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId: src_id|f45400b6-6e68a852-519c5a6d-643771d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:44.751156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:44.751172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:44.751175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:44.751177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:44.751187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601248082112929:6961]
2025-10-10T14:33:44.751191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601248082112929:6961]
2025-10-10T14:33:44.751195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601248082112929:6961]
2025-10-10T14:33:44.751245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:44.751254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.751257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:44.751261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:44.751263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:44.751267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:44.751406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:44.751908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:44.811705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601248864335087:4999]
2025-10-10T14:33:44.811965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1089, pipe: [1:7559601248864335087:4999]
2025-10-10T14:33:44.859765Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:44.860379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.860395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.860440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864335087:4999], now have 1 active actors on pipe
2025-10-10T14:33:44.860651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:44.860755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601248864335087:4999]
2025-10-10T14:33:44.860783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:44.860836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:44.860923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1090 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f45400b6-6e68a852-519c5a6d-643771d6_0
2025-10-10T14:33:44.861135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1090 sessionId: src_id|f45400b6-6e68a852-519c5a6d-643771d6_0 is DEAD
2025-10-10T14:33:44.861286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45400b6-6e68a852-519c5a6d-643771d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:44.861296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45400b6-6e68a852-519c5a6d-643771d6_0] Write session will restart in 0.007562s
2025-10-10T14:33:44.861320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45400b6-6e68a852-519c5a6d-643771d6_0] Write session: Do CDS request
2025-10-10T14:33:44.861326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45400b6-6e68a852-519c5a6d-643771d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:44.869900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45400b6-6e68a852-519c5a6d-643771d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.869945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:44.869969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1091
2025-10-10T14:33:44.870174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:44.870210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:44.870220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:44.870224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:44.870643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1091 sessionId:  describe result for acl check
2025-10-10T14:33:44.870680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:44.870682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:44.870684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:44.870690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601248864335170:4273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:44.871239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601248864335170:4273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:44.873808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601248864335170:4273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:44.874728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:44.876785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:44.877040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:44.877051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:44.877065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:44.877116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:44.877162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601248082113119:6969]
2025-10-10T14:33:44.877190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601248864335170:4273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:44.877208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601248864335170:4273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:44.877212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601248864335170:4273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:44.877222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:44.877796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:44.878057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:44.878102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:44.878403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:44.878468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.878474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.878475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.878476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.878478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.878479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.878480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.878482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.878483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.878484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.878485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.878487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.878488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.878493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.878506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.878510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.878514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.878518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.878522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.878526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.878530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.878534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.878538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.878542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.878546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.878550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.878557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.878566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:44.878572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.878578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:44.878583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.878588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:44.878592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.878597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:44.878602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.878607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:44.878613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.878627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:44.878631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.878637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:44.878641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.878648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:44.878657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.878662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:44.878669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.878675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:44.878684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.878690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.878699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.878704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.878713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.878722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.878762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:44.881178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:44.881694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:44.881706Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:44.881709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:44.881712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:44.881718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1090 [2:7559601248082113119:6969]
2025-10-10T14:33:44.881730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:44.881759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:44.881766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.881770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.881772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.881787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:44.881799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:44.881810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:44.881870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.881881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.881883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.881886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:44.881953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:44.881960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.881972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:44.881986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:44.882006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:44.882032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864335264:4273], now have 1 active actors on pipe
2025-10-10T14:33:44.882041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864335101:2438], now have 1 active actors on pipe
2025-10-10T14:33:44.882048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601248082113114:6969]
2025-10-10T14:33:44.882051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601248082113114:6969]
2025-10-10T14:33:44.882052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601248082113114:6969]
2025-10-10T14:33:44.882066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:44.882082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:44.882089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:44.882094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:44.882095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:44.882097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:44.882090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1090
2025-10-10T14:33:44.882100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:44.882126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1090
2025-10-10T14:33:44.882124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601248082113114:6969]
2025-10-10T14:33:44.882127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:44.882132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:44.882150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.882160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.882203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29244095-1182299-67300c28-198e2bba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:44.882218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:44.882222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:44.882225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:44.882238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:44.882250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:44.882274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.882409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:44.882417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:44.882435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:44.882513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1091 partition: 0 MaxSeqNo: 40 sessionId: src_id|29244095-1182299-67300c28-198e2bba_0
2025-10-10T14:33:44.882899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45400b6-6e68a852-519c5a6d-643771d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29244095-1182299-67300c28-198e2bba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:44.885554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29244095-1182299-67300c28-198e2bba_0] Write session: try to update token
2025-10-10T14:33:44.885582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29244095-1182299-67300c28-198e2bba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:44.900896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId: src_id|29244095-1182299-67300c28-198e2bba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:44.901391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:44.901407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:44.901411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:44.901413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:44.901422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601248082113114:6969]
2025-10-10T14:33:44.901426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601248082113114:6969]
2025-10-10T14:33:44.901429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601248082113114:6969]
2025-10-10T14:33:44.901477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:44.901480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:44.901488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:44.901490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:44.901491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:44.901494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:44.901657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:44.903519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:44.960714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601248864335288:4999]
2025-10-10T14:33:44.961024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1090, pipe: [1:7559601248864335288:4999]
2025-10-10T14:33:45.013349Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:45.013778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.013796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.013846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601248864335288:4999], now have 1 active actors on pipe
2025-10-10T14:33:45.014059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:45.014060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:45.014081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:45.014085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:45.014160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1091 reason: error at write: Disconnected sessionId: src_id|29244095-1182299-67300c28-198e2bba_0
2025-10-10T14:33:45.014222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601248864335288:4999]
2025-10-10T14:33:45.014398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1091 sessionId: src_id|29244095-1182299-67300c28-198e2bba_0 is DEAD
2025-10-10T14:33:45.014555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29244095-1182299-67300c28-198e2bba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:45.014565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29244095-1182299-67300c28-198e2bba_0] Write session will restart in 0.008625s
2025-10-10T14:33:45.014591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29244095-1182299-67300c28-198e2bba_0] Write session: Do CDS request
2025-10-10T14:33:45.014597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29244095-1182299-67300c28-198e2bba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:45.024959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29244095-1182299-67300c28-198e2bba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.025058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:45.025073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1092
2025-10-10T14:33:45.025191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.025237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:45.025246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:45.025250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:45.025701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1092 sessionId:  describe result for acl check
2025-10-10T14:33:45.025743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:45.025750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:45.025752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:45.025759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601253159302719:4264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:45.026169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:45.026309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601253159302719:4264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:45.028181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:45.028239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601253159302719:4264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:45.028417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:45.028429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:45.028441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:45.028502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:45.028544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601252377080612:6978]
2025-10-10T14:33:45.029145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:45.029425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:45.029470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:45.029781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:45.029833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.029838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.029839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.029840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.029840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.029841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.029842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.029842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.029843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.029844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.029844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.029845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.029846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.029850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.029858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.029860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.029863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.029865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.029867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.029869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.029872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.029874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.029877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.029879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.029881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.029883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.029889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.029897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.029903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.029908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.029913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.029918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.029922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.029927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.029932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.029937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.029939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.029942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.029945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.029948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.029951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.029954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.029957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.029960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.029962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.029966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.029971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.029978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.029982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.029987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.029991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.029996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.030034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:45.030557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601253159302719:4264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:45.030574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601253159302719:4264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:45.030577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601253159302719:4264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:45.030585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:45.032323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:45.032683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:45.032696Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:45.032699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:45.032703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:45.032710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1091 [2:7559601252377080612:6978]
2025-10-10T14:33:45.032721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:45.032740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:45.032743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.032746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.032749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.032765Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:45.032780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:45.032788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:45.032848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.032856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.032858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.032860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:45.032941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:45.032949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.032961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.032974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.032989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:45.033016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159302754:4264], now have 1 active actors on pipe
2025-10-10T14:33:45.033024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159302585:2438], now have 1 active actors on pipe
2025-10-10T14:33:45.033032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601252377080607:6978]
2025-10-10T14:33:45.033034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601252377080607:6978]
2025-10-10T14:33:45.033036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601252377080607:6978]
2025-10-10T14:33:45.033050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:45.033050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1091
2025-10-10T14:33:45.033066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:45.033053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1091
2025-10-10T14:33:45.033068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:45.033071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:45.033074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:45.033086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:45.033090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:45.033126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.033136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.033150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601252377080607:6978]
2025-10-10T14:33:45.033161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:45.033171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:45.033195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:45.033207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.033214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.033221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:45.033233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.033249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:45.033274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.033405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.033412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.033429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.033517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1092 partition: 0 MaxSeqNo: 40 sessionId: src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0
2025-10-10T14:33:45.033969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29244095-1182299-67300c28-198e2bba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:45.036786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0] Write session: try to update token
2025-10-10T14:33:45.036806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:45.051831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId: src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:45.053395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:45.053412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:45.053417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:45.053419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:45.053429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601252377080607:6978]
2025-10-10T14:33:45.053433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601252377080607:6978]
2025-10-10T14:33:45.053437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601252377080607:6978]
2025-10-10T14:33:45.053490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:45.053499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.053501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:45.053640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:45.053659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:45.053666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:45.053670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:45.054540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:45.114295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601253159302762:4999]
2025-10-10T14:33:45.114597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1091, pipe: [1:7559601253159302762:4999]
2025-10-10T14:33:45.160818Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:45.161229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.161247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.161293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159302762:4999], now have 1 active actors on pipe
2025-10-10T14:33:45.161539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:45.161580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:45.161600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:45.161604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:45.161642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601253159302762:4999]
2025-10-10T14:33:45.161667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1092 reason: error at write: Disconnected sessionId: src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0
2025-10-10T14:33:45.161884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1092 sessionId: src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0 is DEAD
2025-10-10T14:33:45.162059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:45.162070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0] Write session will restart in 0.009120s
2025-10-10T14:33:45.162097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0] Write session: Do CDS request
2025-10-10T14:33:45.162103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:45.173003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.173096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:45.173114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1093
2025-10-10T14:33:45.173286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.173324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:45.173348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:45.173353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:45.173809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1093 sessionId:  describe result for acl check
2025-10-10T14:33:45.173845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:45.173852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:45.173854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:45.173861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601253159302902:4259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:45.174463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601253159302902:4259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:45.174753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:45.176902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:45.177132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601253159302902:4259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:45.177235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:45.177244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:45.177255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:45.177304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:45.177364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601252377080785:6980]
2025-10-10T14:33:45.177900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:45.178259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:45.178334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:45.178716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:45.178780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.178790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.178791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.178792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.178793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.178795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.178796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.178797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.178798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.178800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.178801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.178802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.178803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.178810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.178824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.178828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.178832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.178836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.178839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.178843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.178847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.178851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.178856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.178859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.178863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.178867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.178875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.178884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.178892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.178897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.178901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.178906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.178911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.178916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.178921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.178927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.178932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.178938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.178943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.178948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.178953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.178958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.178963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.178969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.178974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.178979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.178984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.178989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.178994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.178998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.179002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.179007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.179049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:45.181264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601253159302902:4259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:45.181278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601253159302902:4259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:45.181282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601253159302902:4259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:45.181292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:45.181494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:45.182001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:45.182011Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:45.182014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:45.182018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:45.182025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1092 [2:7559601252377080785:6980]
2025-10-10T14:33:45.182038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:45.182055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:45.182062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.182066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.182069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.182096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:45.182107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:45.182115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:45.182180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.182187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.182189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.182192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:45.182277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:45.182285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.182296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.182306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.182322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:45.182348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159302937:4259], now have 1 active actors on pipe
2025-10-10T14:33:45.182356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159302767:2438], now have 1 active actors on pipe
2025-10-10T14:33:45.182364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601252377080780:6980]
2025-10-10T14:33:45.182372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601252377080780:6980]
2025-10-10T14:33:45.182374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601252377080780:6980]
2025-10-10T14:33:45.182387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:45.182389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1092
2025-10-10T14:33:45.182393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1092
2025-10-10T14:33:45.182400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:45.182405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:45.182411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:45.182414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:45.182422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:45.182425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:45.182454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601252377080780:6980]
2025-10-10T14:33:45.182470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:45.182489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:45.182502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.182507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.182545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:45.182557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.182565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.182567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:45.182581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.182595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:45.182622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.182742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.182749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.182765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.182869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1093 partition: 0 MaxSeqNo: 40 sessionId: src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0
2025-10-10T14:33:45.183345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ccd51e4-c94fc22b-cdcd2ce6-5c82447f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:45.185999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0] Write session: try to update token
2025-10-10T14:33:45.186015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:45.200224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId: src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:45.202123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:45.202142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:45.202146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:45.202148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:45.202157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601252377080780:6980]
2025-10-10T14:33:45.202164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601252377080780:6980]
2025-10-10T14:33:45.202168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601252377080780:6980]
2025-10-10T14:33:45.202218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:45.202220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:45.202226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.202227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:45.202228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:45.202233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:45.202376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:45.203049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:45.261791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601253159302944:4999]
2025-10-10T14:33:45.262117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1092, pipe: [1:7559601253159302944:4999]
2025-10-10T14:33:45.312766Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:45.313253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.313272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.313321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159302944:4999], now have 1 active actors on pipe
2025-10-10T14:33:45.313581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:45.313600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:45.313630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601253159302944:4999]
2025-10-10T14:33:45.313639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:45.313667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:45.313669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1093 reason: error at write: Disconnected sessionId: src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0
2025-10-10T14:33:45.313923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1093 sessionId: src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0 is DEAD
2025-10-10T14:33:45.314100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:45.314111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0] Write session will restart in 0.007086s
2025-10-10T14:33:45.314137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0] Write session: Do CDS request
2025-10-10T14:33:45.314147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:45.322991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.323064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:45.323081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1094
2025-10-10T14:33:45.323253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.323292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:45.323304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:45.323308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:45.323874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1094 sessionId:  describe result for acl check
2025-10-10T14:33:45.323912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:45.323919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:45.323921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:45.323928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601253159303021:4256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:45.324525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601253159303021:4256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:45.327142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601253159303021:4256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:45.327676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:45.329973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:45.330155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601253159303021:4256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:45.330170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601253159303021:4256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:45.330173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601253159303021:4256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:45.330183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:45.330200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:45.330217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:45.330231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:45.330299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:45.330361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601252377080960:6982]
2025-10-10T14:33:45.330983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:45.331326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:45.331382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:45.331808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:45.331887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.331896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.331898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.331899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.331901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.331902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.331903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.331904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.331906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.331907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.331909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.331910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.331911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.331918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.331932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.331936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.331940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.331944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.331949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.331953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.331957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.331962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.331967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.331971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.331976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.331979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.331987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.331998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.332005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.332011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.332017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.332023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.332028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.332034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.332039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.332045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.332050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.332055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.332061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.332067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.332080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.332085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.332090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.332096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.332102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.332107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.332119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.332124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.332134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.332139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.332149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.332155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.332202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:45.334607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:45.335136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:45.335149Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:45.335152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:45.335157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:45.335163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1093 [2:7559601252377080960:6982]
2025-10-10T14:33:45.335177Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:45.335196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:45.335205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.335209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.335212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.335230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:45.335243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:45.335256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:45.335316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.335324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.335326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.335329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:45.335401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:45.335410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.335423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.335440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.335463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:45.335491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303113:4256], now have 1 active actors on pipe
2025-10-10T14:33:45.335499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159302946:2438], now have 1 active actors on pipe
2025-10-10T14:33:45.335508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601252377080955:6982]
2025-10-10T14:33:45.335515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601252377080955:6982]
2025-10-10T14:33:45.335518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601252377080955:6982]
2025-10-10T14:33:45.335531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:45.335544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:45.335551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:45.335551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:45.335553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:45.335531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1093
2025-10-10T14:33:45.335569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:45.335577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:45.335537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1093
2025-10-10T14:33:45.335606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601252377080955:6982]
2025-10-10T14:33:45.335618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:45.335622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:45.335642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.335652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.335710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:45.335727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.335731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.335734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:45.335745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.335757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:45.335777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.335936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.335945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.335962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.336052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1094 partition: 0 MaxSeqNo: 40 sessionId: src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0
2025-10-10T14:33:45.336499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|599a0b1a-4f289fee-1dfd60c9-ad8135da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:45.339247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0] Write session: try to update token
2025-10-10T14:33:45.339267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:45.353715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId: src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:45.355586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:45.355609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:45.355614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:45.355616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:45.355627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601252377080955:6982]
2025-10-10T14:33:45.355633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601252377080955:6982]
2025-10-10T14:33:45.355642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601252377080955:6982]
2025-10-10T14:33:45.355701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:45.355704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:45.355710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:45.355715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:45.355716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.355718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:45.355913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:45.357038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:45.413843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601253159303136:4999]
2025-10-10T14:33:45.414249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1093, pipe: [1:7559601253159303136:4999]
2025-10-10T14:33:45.462503Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:45.462921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.462934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.462982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303136:4999], now have 1 active actors on pipe
2025-10-10T14:33:45.463197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:45.463269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:45.463274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601253159303136:4999]
2025-10-10T14:33:45.463296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:45.463366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1094 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0
2025-10-10T14:33:45.463601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1094 sessionId: src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0 is DEAD
2025-10-10T14:33:45.463802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:45.463814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0] Write session will restart in 0.005814s
2025-10-10T14:33:45.463852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0] Write session: Do CDS request
2025-10-10T14:33:45.463859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:45.470845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.471006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:45.471024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1095
2025-10-10T14:33:45.471169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.471210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:45.471216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:45.471220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:45.471824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1095 sessionId:  describe result for acl check
2025-10-10T14:33:45.471866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:45.471872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:45.471874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:45.471881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601253159303166:4242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:45.472459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601253159303166:4242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:45.475017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601253159303166:4242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:45.477518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601253159303166:4242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:45.477531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601253159303166:4242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:45.477548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601253159303166:4242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:45.477558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:45.478049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:45.480068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:45.480281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:45.480292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:45.480304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:45.480356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:45.480399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601252377081149:6985]
2025-10-10T14:33:45.481046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:45.481406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:45.481465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:45.481840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:45.481915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.481922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.481923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.481925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.481926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.481927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.481929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.481930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.481932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.481933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.481934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.481935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.481936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.481943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.481956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.481961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.481965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.481970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.481974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.481978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.481982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.481986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.481991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.481995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.481999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.482003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.482013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.482026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.482039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.482045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.482062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.482067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.482072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.482078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.482082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.482087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.482091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.482097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.482102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.482107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.482112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.482118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.482122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.482134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.482140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.482149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.482158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.482168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.482176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.482184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.482193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.482198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.482250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:45.484569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:45.484984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:45.484995Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:45.484997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:45.485001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:45.485008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1094 [2:7559601252377081149:6985]
2025-10-10T14:33:45.485020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:45.485039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:45.485042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.485049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.485051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.485069Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:45.485076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:45.485082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:45.485123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.485129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.485130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.485132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:45.485196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:45.485204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.485214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.485225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.485241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:45.485270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303303:4242], now have 1 active actors on pipe
2025-10-10T14:33:45.485273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303138:2438], now have 1 active actors on pipe
2025-10-10T14:33:45.485281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601252377081144:6985]
2025-10-10T14:33:45.485283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601252377081144:6985]
2025-10-10T14:33:45.485286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601252377081144:6985]
2025-10-10T14:33:45.485300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:45.485313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:45.485325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:45.485345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:45.485347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:45.485352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:45.485356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:45.485341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1094
2025-10-10T14:33:45.485327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1094
2025-10-10T14:33:45.485385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601252377081144:6985]
2025-10-10T14:33:45.485394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:45.485395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:45.485420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.485431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.485468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:45.485483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.485487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.485490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:45.485501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.485512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:45.485549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.485704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.485711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.485727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.485802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1095 partition: 0 MaxSeqNo: 40 sessionId: src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0
2025-10-10T14:33:45.486200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d52bc189-fa09e17c-62978ada-b0f6f425_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:45.488950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0] Write session: try to update token
2025-10-10T14:33:45.488967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:45.503713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId: src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:45.505270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:45.505290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:45.505293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:45.505295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:45.505306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601252377081144:6985]
2025-10-10T14:33:45.505313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601252377081144:6985]
2025-10-10T14:33:45.505317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601252377081144:6985]
2025-10-10T14:33:45.505383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:45.505394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:45.505404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.505406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:45.505410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:45.505415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:45.505572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:45.506489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:45.563352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601253159303317:4999]
2025-10-10T14:33:45.563654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1094, pipe: [1:7559601253159303317:4999]
2025-10-10T14:33:45.616901Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:45.617290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.617305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.617371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303317:4999], now have 1 active actors on pipe
2025-10-10T14:33:45.617596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:45.617597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601253159303317:4999]
2025-10-10T14:33:45.617615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:45.617643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:45.617619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:45.617679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1095 reason: error at write: Disconnected sessionId: src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0
2025-10-10T14:33:45.617864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1095 sessionId: src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0 is DEAD
2025-10-10T14:33:45.618002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:45.618012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0] Write session will restart in 0.005441s
2025-10-10T14:33:45.618037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0] Write session: Do CDS request
2025-10-10T14:33:45.618046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:45.624901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.624966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:45.624982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1096
2025-10-10T14:33:45.625099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.625133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:45.625143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:45.625147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:45.625615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1096 sessionId:  describe result for acl check
2025-10-10T14:33:45.625650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:45.625657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:45.625658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:45.625664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601253159303351:4239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:45.626217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601253159303351:4239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:45.628993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601253159303351:4239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:45.631276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:45.633560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:45.633806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601253159303351:4239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:45.633807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:45.633820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:45.633823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601253159303351:4239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:45.633832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:45.633827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601253159303351:4239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:45.633837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:45.633888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:45.633933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601252377081325:6987]
2025-10-10T14:33:45.634519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:45.634843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:45.634888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:45.635199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:45.635255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.635261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.635262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.635263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.635264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.635265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.635266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.635267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.635268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.635270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.635271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.635272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.635273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.635280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.635293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.635297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.635301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.635305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.635309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.635312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.635316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.635320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.635324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.635328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.635332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.635335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.635344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.635352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.635359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.635364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.635369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.635374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.635379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.635384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.635389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.635394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.635406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.635412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.635416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.635427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.635431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.635437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.635445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.635451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.635455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.635460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.635465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.635471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.635480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.635485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.635490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.635499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.635540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:45.637993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:45.638328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:45.638341Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:45.638343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:45.638347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:45.638354Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1095 [2:7559601252377081325:6987]
2025-10-10T14:33:45.638370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:45.638389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:45.638392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.638396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.638399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.638417Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:45.638425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:45.638433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:45.638491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.638498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.638501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.638503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:45.638578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:45.638586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.638596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.638610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.638627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:45.638655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303493:4239], now have 1 active actors on pipe
2025-10-10T14:33:45.638663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303323:2438], now have 1 active actors on pipe
2025-10-10T14:33:45.638672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601252377081320:6987]
2025-10-10T14:33:45.638678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601252377081320:6987]
2025-10-10T14:33:45.638680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601252377081320:6987]
2025-10-10T14:33:45.638695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:45.638710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:45.638714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:45.638724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:45.638726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:45.638738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1095
2025-10-10T14:33:45.638733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:45.638737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:45.638758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1095
2025-10-10T14:33:45.638768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601252377081320:6987]
2025-10-10T14:33:45.638770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:45.638773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:45.638788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.638798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.638930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:45.638945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.638949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.638951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:45.638963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.638974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:45.638999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.639178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.639187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.639204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.639290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1096 partition: 0 MaxSeqNo: 40 sessionId: src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0
2025-10-10T14:33:45.639702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b076f716-ba85dca7-bb7737d0-fbc1a411_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:45.642308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0] Write session: try to update token
2025-10-10T14:33:45.642329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:45.657038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId: src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:45.658317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:45.658336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:45.658340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:45.658342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:45.658354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601252377081320:6987]
2025-10-10T14:33:45.658360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601252377081320:6987]
2025-10-10T14:33:45.658364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601252377081320:6987]
2025-10-10T14:33:45.658413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:45.658426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:45.658430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:45.658439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:45.658448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.658451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:45.658632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:45.660063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:45.717984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601253159303507:4999]
2025-10-10T14:33:45.718278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1095, pipe: [1:7559601253159303507:4999]
2025-10-10T14:33:45.766489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:45.766995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.767010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.767059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303507:4999], now have 1 active actors on pipe
2025-10-10T14:33:45.767250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:45.767352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601253159303507:4999]
2025-10-10T14:33:45.767408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:45.767502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1096 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0
2025-10-10T14:33:45.767646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:45.767813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1096 sessionId: src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0 is DEAD
2025-10-10T14:33:45.767955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:45.767967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0] Write session will restart in 0.007272s
2025-10-10T14:33:45.767993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0] Write session: Do CDS request
2025-10-10T14:33:45.767999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:45.776925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.777009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:45.777024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1097
2025-10-10T14:33:45.777202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.777239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:45.777249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:45.777252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:45.778109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1097 sessionId:  describe result for acl check
2025-10-10T14:33:45.778147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:45.778149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:45.778150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:45.778157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601253159303613:4230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:45.778724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601253159303613:4230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:45.780713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:45.780847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601253159303613:4230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:45.782578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:45.782776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:45.782786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:45.782798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:45.782852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:45.782891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601252377081505:6990]
2025-10-10T14:33:45.783004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601253159303613:4230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:45.783028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601253159303613:4230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:45.783032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601253159303613:4230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:45.783039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:45.783476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:45.783733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:45.783775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:45.784074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:45.784128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.784134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.784135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.784136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.784137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.784138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.784139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.784140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.784142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.784143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.784144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.784145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.784146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.784152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.784165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.784169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.784173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.784177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.784180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.784184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.784187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.784191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.784197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.784201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.784205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.784209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.784216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.784224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.784230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.784235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.784240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.784245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.784249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.784254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.784258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.784263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.784267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.784272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.784277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.784282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.784286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.784293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.784302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.784308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.784312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.784318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.784327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.784332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.784336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.784342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.784346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.784352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.784392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:45.786941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:45.787328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:45.787343Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:45.787346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:45.787349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:45.787355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1096 [2:7559601252377081505:6990]
2025-10-10T14:33:45.787366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:45.787391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:45.787394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.787397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.787399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.787415Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:45.787423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:45.787430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:45.787483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.787491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.787492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.787495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:45.787562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:45.787568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.787578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.787588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.787606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:45.787631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303678:4230], now have 1 active actors on pipe
2025-10-10T14:33:45.787638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303508:2438], now have 1 active actors on pipe
2025-10-10T14:33:45.787645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601252377081500:6990]
2025-10-10T14:33:45.787647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601252377081500:6990]
2025-10-10T14:33:45.787649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601252377081500:6990]
2025-10-10T14:33:45.787661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:45.787675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:45.787682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:45.787685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:45.787687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:45.787693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:45.787696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:45.787717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601252377081500:6990]
2025-10-10T14:33:45.787725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:45.787731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:45.787725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1096
2025-10-10T14:33:45.787757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.787726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1096
2025-10-10T14:33:45.787766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.787800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:45.787812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.787815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.787817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:45.787828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.787842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:45.787856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.788022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.788035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.788057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.788153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1097 partition: 0 MaxSeqNo: 40 sessionId: src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0
2025-10-10T14:33:45.788544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d905f9f5-9cec2c29-57277941-2d1b9700_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:45.791322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0] Write session: try to update token
2025-10-10T14:33:45.791343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:45.805603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId: src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:45.806685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:45.806702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:45.806706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:45.806708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:45.806717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601252377081500:6990]
2025-10-10T14:33:45.806722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601252377081500:6990]
2025-10-10T14:33:45.806726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601252377081500:6990]
2025-10-10T14:33:45.806771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:45.806772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:45.806778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.806778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:45.806781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:45.806783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:45.806918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:45.808347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:45.867486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601253159303690:4999]
2025-10-10T14:33:45.867755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1096, pipe: [1:7559601253159303690:4999]
2025-10-10T14:33:45.921864Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:45.922275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.922291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.922337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303690:4999], now have 1 active actors on pipe
2025-10-10T14:33:45.922534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:45.922552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:45.922634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1097 reason: error at write: Disconnected sessionId: src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0
2025-10-10T14:33:45.922692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:45.922858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1097 sessionId: src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0 is DEAD
2025-10-10T14:33:45.923045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:45.923057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0] Write session will restart in 0.008690s
2025-10-10T14:33:45.923061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:45.923080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0] Write session: Do CDS request
2025-10-10T14:33:45.923095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:45.923110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601253159303690:4999]
2025-10-10T14:33:45.932915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.933148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:45.933177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1098
2025-10-10T14:33:45.933292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:45.933347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:45.933357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:45.933362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:45.933769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1098 sessionId:  describe result for acl check
2025-10-10T14:33:45.933811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:45.933822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:45.933824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:45.933831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601253159303807:4215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:45.934421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601253159303807:4215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:45.936261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:45.936742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601253159303807:4215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:45.938594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:45.938810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:45.938821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:45.938832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:45.938881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:45.938938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601252377081697:6998]
2025-10-10T14:33:45.939346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601253159303807:4215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:45.939360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601253159303807:4215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:45.939364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601253159303807:4215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:45.939373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:45.939550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:45.939830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:45.939871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:45.940176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:45.940231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.940236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.940238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.940239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.940240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.940241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.940242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.940243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.940245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.940246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.940247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.940248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.940249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.940255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.940267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.940270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.940274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.940277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.940280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.940284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.940287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.940291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.940294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.940298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.940302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.940305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.940312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.940321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:45.940328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.940332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:45.940337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.940342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:45.940345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.940350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:45.940354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.940359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:45.940363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.940368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:45.940372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.940377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:45.940380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.940386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:45.940389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.940394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:45.940398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.940402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:45.940406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.940410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.940414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.940419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.940423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.940427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.940463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:45.943067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:45.943618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:45.943632Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:45.943634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:45.943637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:45.943644Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1097 [2:7559601252377081697:6998]
2025-10-10T14:33:45.943656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:45.943675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:45.943684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.943687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.943690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.943707Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:45.943714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:45.943722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:45.943778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.943785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.943787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.943789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:45.943856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:45.943866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.943876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:45.943887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:45.943902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:45.943923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303704:2438], now have 1 active actors on pipe
2025-10-10T14:33:45.943927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601253159303874:4215], now have 1 active actors on pipe
2025-10-10T14:33:45.943935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601252377081692:6998]
2025-10-10T14:33:45.943941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601252377081692:6998]
2025-10-10T14:33:45.943943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601252377081692:6998]
2025-10-10T14:33:45.943956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:45.943970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:45.943975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:45.943979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:45.943962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1097
2025-10-10T14:33:45.943981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:45.943990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:45.943978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1097
2025-10-10T14:33:45.943994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:45.944028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601252377081692:6998]
2025-10-10T14:33:45.944040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:45.944054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.944063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.944079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:45.944112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dbe05b5-57bc1537-998c19df-43578209_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:45.944125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:45.944133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:45.944135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:45.944147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:45.944161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:45.944181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.944558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:45.944569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:45.944585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:45.944701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1098 partition: 0 MaxSeqNo: 40 sessionId: src_id|5dbe05b5-57bc1537-998c19df-43578209_0
2025-10-10T14:33:45.945170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c28ebd28-fb25707a-d52a0523-7eb9b13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5dbe05b5-57bc1537-998c19df-43578209_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:45.947983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbe05b5-57bc1537-998c19df-43578209_0] Write session: try to update token
2025-10-10T14:33:45.948006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbe05b5-57bc1537-998c19df-43578209_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:45.963843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:45.963862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:45.963866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:45.963868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:45.963879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601252377081692:6998]
2025-10-10T14:33:45.963885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601252377081692:6998]
2025-10-10T14:33:45.963889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601252377081692:6998]
2025-10-10T14:33:45.963939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:45.963938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:45.963945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:45.963947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:45.963950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:45.963950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:45.964096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:45.964910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId: src_id|5dbe05b5-57bc1537-998c19df-43578209_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:45.967761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:46.023117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601257454271194:4999]
2025-10-10T14:33:46.023414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1097, pipe: [1:7559601257454271194:4999]
2025-10-10T14:33:46.076386Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:46.076729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.076745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.076797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271194:4999], now have 1 active actors on pipe
2025-10-10T14:33:46.076976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:46.076998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:46.077017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:46.077024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:46.077077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601257454271194:4999]
2025-10-10T14:33:46.077080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1098 reason: error at write: Disconnected sessionId: src_id|5dbe05b5-57bc1537-998c19df-43578209_0
2025-10-10T14:33:46.077319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1098 sessionId: src_id|5dbe05b5-57bc1537-998c19df-43578209_0 is DEAD
2025-10-10T14:33:46.077472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbe05b5-57bc1537-998c19df-43578209_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:46.077488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbe05b5-57bc1537-998c19df-43578209_0] Write session will restart in 0.009108s
2025-10-10T14:33:46.077507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbe05b5-57bc1537-998c19df-43578209_0] Write session: Do CDS request
2025-10-10T14:33:46.077523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbe05b5-57bc1537-998c19df-43578209_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:46.087941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbe05b5-57bc1537-998c19df-43578209_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.088025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:46.088042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1099
2025-10-10T14:33:46.088188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.088229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:46.088246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:46.088250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:46.088856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1099 sessionId:  describe result for acl check
2025-10-10T14:33:46.088901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:46.088908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:46.088910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:46.088917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601257454271335:4208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:46.089551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601257454271335:4208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:46.090052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:46.091726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601257454271335:4208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:46.092165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:46.092376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:46.092388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:46.092400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:46.092461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:46.092506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601256672049198:7007]
2025-10-10T14:33:46.093113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:46.093416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:46.093463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:46.093789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:46.093852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.093863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.093864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.093865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.093867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.093868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.093869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.093871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.093872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.093873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.093875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.093876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.093877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.093883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.093896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.093900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.093904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.093909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.093913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.093917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.093920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.093924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.093929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.093933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.093936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.093940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.093947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.093956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.093963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.093968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.093973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.093978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.093982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.093988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.093992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.093997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.094001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.094007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.094011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.094016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.094021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.094028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.094039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.094044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.094048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.094054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.094063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.094068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.094074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.094085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.094090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.094103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.094144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:46.094447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601257454271335:4208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:46.094458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601257454271335:4208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:46.094460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601257454271335:4208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:46.094467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:46.096565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:46.097250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:46.097264Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:46.097266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:46.097270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:46.097277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1098 [2:7559601256672049198:7007]
2025-10-10T14:33:46.097290Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:46.097309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:46.097318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.097322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.097325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.097361Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:46.097370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:46.097382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:46.097442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.097450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.097453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.097455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:46.097534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:46.097542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.097555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.097567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.097590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:46.097615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601256672049193:7007]
2025-10-10T14:33:46.097622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601256672049193:7007]
2025-10-10T14:33:46.097624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601256672049193:7007]
2025-10-10T14:33:46.097639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:46.097653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:46.097659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271371:4208], now have 1 active actors on pipe
2025-10-10T14:33:46.097662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:46.097663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271195:2438], now have 1 active actors on pipe
2025-10-10T14:33:46.097664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:46.097671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:46.097688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:46.097691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:46.097726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601256672049193:7007]
2025-10-10T14:33:46.097740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:46.097730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1098
2025-10-10T14:33:46.097735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1098
2025-10-10T14:33:46.097760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:46.097783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.097795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.097828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:46.097841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.097847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.097850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:46.097860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.097875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:46.097894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.098025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.098032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.098046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.098126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1099 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0
2025-10-10T14:33:46.098570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbe05b5-57bc1537-998c19df-43578209_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:46.101105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0] Write session: try to update token
2025-10-10T14:33:46.101127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:46.109224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:46.109242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:46.109253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601256672049193:7007]
2025-10-10T14:33:46.109305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:46.109310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:46.109499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:46.109659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:46.109811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:46.109960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:46.110153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:46.110198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:46.116320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId: src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:46.118768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:46.118948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.118971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.119022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:46.119089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:46.127185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:46.127205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:46.127208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:46.127211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:46.127222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601256672049193:7007]
2025-10-10T14:33:46.127226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601256672049193:7007]
2025-10-10T14:33:46.127230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601256672049193:7007]
2025-10-10T14:33:46.127275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:46.127280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:46.127288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:46.127288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.127291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:46.127292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:46.127429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:46.177222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601257454271379:4999]
2025-10-10T14:33:46.177550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1098, pipe: [1:7559601257454271379:4999]
2025-10-10T14:33:46.240424Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:46.249437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.249467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.249676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.249745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.249814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.249886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.250033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.250044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.250119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.250189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.250253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.250315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.250368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.250377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.250450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.250514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.250581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.250648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.250696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.250703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.250772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.250840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.250901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.250964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.251017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.251025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.251093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.251153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.251218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.251286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.251339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.251348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.251423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.251487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.251551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.251622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.251668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.251675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.251749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.251816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.251881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.251946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.251995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.252004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.252074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.252138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.252207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.252274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.252435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.252442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.252517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.252579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.252643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.252712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.252759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.252767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.252834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.252897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.252959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.253034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.253083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.253092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.253164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271379:4999], now have 1 active actors on pipe
2025-10-10T14:33:46.253437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601257454271379:4999]
2025-10-10T14:33:46.253452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:46.253482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:46.253485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:46.253529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1099 reason: error at write: Disconnected sessionId: src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0
2025-10-10T14:33:46.253788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1099 sessionId: src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0 is DEAD
2025-10-10T14:33:46.253995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:46.254007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0] Write session will restart in 0.008548s
2025-10-10T14:33:46.254036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0] Write session: Do CDS request
2025-10-10T14:33:46.254043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:46.254459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:46.264065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.264069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:46.264093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1100
2025-10-10T14:33:46.264314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.264361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:46.264367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:46.264378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:46.264854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1100 sessionId:  describe result for acl check
2025-10-10T14:33:46.264904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:46.264911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:46.264913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:46.264920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601257454271480:4203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:46.265546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601257454271480:4203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:46.267984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:46.268280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601257454271480:4203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:46.269893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:46.270138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:46.270150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:46.270163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:46.270221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:46.270270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601256672049379:7009]
2025-10-10T14:33:46.270915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:46.271096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601257454271480:4203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:46.271109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601257454271480:4203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:46.271112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601257454271480:4203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:46.271120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:46.271235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:46.271280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:46.271617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:46.271678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.271684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.271686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.271687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.271688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.271689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.271691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.271692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.271694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.271695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.271697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.271698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.271700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.271706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.271721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.271725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.271729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.271733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.271738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.271742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.271746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.271751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.271755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.271759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.271763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.271766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.271774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.271785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.271794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.271800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.271804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.271810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.271814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.271820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.271825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.271830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.271834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.271839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.271844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.271850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.271854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.271859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.271864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.271869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.271873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.271879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.271883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.271888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.271892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.271898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.271902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.271914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.271958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:46.274429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:46.275027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:46.275036Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:46.275038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:46.275042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:46.275049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1099 [2:7559601256672049379:7009]
2025-10-10T14:33:46.275059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:46.275083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:46.275088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.275090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.275092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.275110Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:46.275118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:46.275130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:46.275182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.275187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.275188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.275189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:46.275243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:46.275248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.275256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.275272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.275293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:46.275318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601256672049374:7009]
2025-10-10T14:33:46.275325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601256672049374:7009]
2025-10-10T14:33:46.275327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601256672049374:7009]
2025-10-10T14:33:46.275337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:46.275347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:46.275350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:46.275352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:46.275361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271555:4203], now have 1 active actors on pipe
2025-10-10T14:33:46.275372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:46.275388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:46.275395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:46.275401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271380:2438], now have 1 active actors on pipe
2025-10-10T14:33:46.275444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601256672049374:7009]
2025-10-10T14:33:46.275456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:46.275445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1099
2025-10-10T14:33:46.275477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:46.275462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1099
2025-10-10T14:33:46.275549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.275562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.275597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:46.275612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.275622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.275625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:46.275637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.275651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:46.275670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.275836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.275849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.275873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.275956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1100 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0
2025-10-10T14:33:46.276407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec00f435-c271dcf8-a1adca58-58ef4ea7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:46.279316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0] Write session: try to update token
2025-10-10T14:33:46.279337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:46.287116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:46.287133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:46.287145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601256672049374:7009]
2025-10-10T14:33:46.287191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:46.287201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:46.287382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:46.287532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:46.287686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:46.287835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:46.288045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:46.288095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:46.297289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId: src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:46.299997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:46.300310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.300336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.300378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:46.300482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:46.305437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:46.305458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:46.305462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:46.305464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:46.305476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601256672049374:7009]
2025-10-10T14:33:46.305481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601256672049374:7009]
2025-10-10T14:33:46.305487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601256672049374:7009]
2025-10-10T14:33:46.305557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:46.305565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.305568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:46.305599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:46.305615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:46.305621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:46.305728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:46.353376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601257454271569:4999]
2025-10-10T14:33:46.353649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1099, pipe: [1:7559601257454271569:4999]
2025-10-10T14:33:46.414856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:46.422513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.422544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.422733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.422807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.422879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.422953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.423006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.423016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.423094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.423161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.423233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.423311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.423355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.423362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.423428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.423487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.423558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.423618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.423658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.423667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.423731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.423786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.423843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.423898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.423937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.423942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.424000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.424055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.424112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.424167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.424211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.424222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.424290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.424346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.424403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.424459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.424500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.424506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.424565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.424620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.424678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.424733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.424773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.424779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.424838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.424890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.424946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.425002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.425042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.425047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.425104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.425157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.425213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.425267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.425306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.425311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.425391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:46.425448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:46.425516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:46.425571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:46.425612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:46.425617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:46.425667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271569:4999], now have 1 active actors on pipe
2025-10-10T14:33:46.425892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:46.425906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:46.425911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:46.425938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1100 reason: error at write: Disconnected sessionId: src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0
2025-10-10T14:33:46.425964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601257454271569:4999]
2025-10-10T14:33:46.426176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1100 sessionId: src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0 is DEAD
2025-10-10T14:33:46.426327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:46.426338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0] Write session will restart in 0.005114s
2025-10-10T14:33:46.426363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0] Write session: Do CDS request
2025-10-10T14:33:46.426369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:46.426565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:46.432902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.432999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:46.433014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1101
2025-10-10T14:33:46.433124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.433161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:46.433167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:46.433171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:46.433638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1101 sessionId:  describe result for acl check
2025-10-10T14:33:46.433680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:46.433687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:46.433689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:46.433695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601257454271601:4190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:46.434275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601257454271601:4190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:46.436961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601257454271601:4190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:46.439673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601257454271601:4190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:46.439688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601257454271601:4190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:46.439692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601257454271601:4190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:46.439700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:46.440282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:46.442185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:46.442380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:46.442392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:46.442406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:46.442466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:46.442525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601256672049574:7012]
2025-10-10T14:33:46.443133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:46.443554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:46.443612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:46.443961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:46.444033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.444039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.444040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.444041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.444043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.444044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.444045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.444047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.444048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.444049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.444050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.444051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.444052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.444059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.444073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.444094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.444101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.444105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.444109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.444114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.444118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.444122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.444140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.444144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.444148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.444156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.444165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.444178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.444184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.444190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.444199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.444206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.444215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.444225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.444234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.444239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.444247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.444253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.444258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.444268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.444276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.444287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.444296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.444301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.444309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.444315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.444319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.444325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.444335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.444340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.444344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.444349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.444392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:46.446937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:46.447281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:46.447295Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:46.447297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:46.447301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:46.447308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1100 [2:7559601256672049574:7012]
2025-10-10T14:33:46.447321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:46.447338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:46.447342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.447346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.447349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.447367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:46.447380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:46.447388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:46.447449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.447460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.447462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.447465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:46.447642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:46.447653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.447665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.447679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.447698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:46.447724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271755:4190], now have 1 active actors on pipe
2025-10-10T14:33:46.447732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271582:2438], now have 1 active actors on pipe
2025-10-10T14:33:46.447740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601256672049569:7012]
2025-10-10T14:33:46.447744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601256672049569:7012]
2025-10-10T14:33:46.447722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1100
2025-10-10T14:33:46.447723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1100
2025-10-10T14:33:46.447747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601256672049569:7012]
2025-10-10T14:33:46.447762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:46.447776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:46.447780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:46.447783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:46.447785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:46.447796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:46.447800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:46.447840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.447851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.447869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601256672049569:7012]
2025-10-10T14:33:46.447880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:46.447885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:46.447912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|befefebd-218f021-c9335827-d48fc4c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:46.447921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.447929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.447933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:46.447944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.447959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:46.447989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.448144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.448151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.448166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.448271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1101 partition: 0 MaxSeqNo: 40 sessionId: src_id|befefebd-218f021-c9335827-d48fc4c2_0
2025-10-10T14:33:46.448659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb886d24-a8eeae1e-29d06b15-62bdbe95_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|befefebd-218f021-c9335827-d48fc4c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:46.451391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befefebd-218f021-c9335827-d48fc4c2_0] Write session: try to update token
2025-10-10T14:33:46.451408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befefebd-218f021-c9335827-d48fc4c2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:46.465924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId: src_id|befefebd-218f021-c9335827-d48fc4c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:46.468179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:46.468200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:46.468203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:46.468206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:46.468217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601256672049569:7012]
2025-10-10T14:33:46.468222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601256672049569:7012]
2025-10-10T14:33:46.468225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601256672049569:7012]
2025-10-10T14:33:46.468275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:46.468273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:46.468283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.468284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:46.468286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:46.468288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:46.468424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:46.468637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:46.525909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601257454271769:4999]
2025-10-10T14:33:46.526227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1100, pipe: [1:7559601257454271769:4999]
2025-10-10T14:33:46.579343Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:46.579848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.579864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.579911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271769:4999], now have 1 active actors on pipe
2025-10-10T14:33:46.580134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:46.580670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befefebd-218f021-c9335827-d48fc4c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:46.580681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befefebd-218f021-c9335827-d48fc4c2_0] Write session will restart in 0.009531s
2025-10-10T14:33:46.580706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befefebd-218f021-c9335827-d48fc4c2_0] Write session: Do CDS request
2025-10-10T14:33:46.580177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:46.580713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befefebd-218f021-c9335827-d48fc4c2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:46.580200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:46.580274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1101 reason: error at write: Disconnected sessionId: src_id|befefebd-218f021-c9335827-d48fc4c2_0
2025-10-10T14:33:46.580348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601257454271769:4999]
2025-10-10T14:33:46.580366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:46.580395Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:33:46.580477Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 11 consumer shared/user session shared/user_1_11_13846048693422084033_v1 is DEAD
2025-10-10T14:33:46.580504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1101 sessionId: src_id|befefebd-218f021-c9335827-d48fc4c2_0 is DEAD
2025-10-10T14:33:46.580746Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:33:46.580604Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601188734780546:5009] disconnected; active server actors: 1
2025-10-10T14:33:46.580608Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601188734780546:5009] client user disconnected session shared/user_1_11_13846048693422084033_v1
2025-10-10T14:33:46.580788Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:33:46.580793Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:33:46.580803Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009393s
2025-10-10T14:33:46.590857Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:33:46.591109Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:33:46.591121Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 12
2025-10-10T14:33:46.591325Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 12 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:33:46.591413Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:33:46.591530Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 auth for : user
2025-10-10T14:33:46.591703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:46.591712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1102
2025-10-10T14:33:46.591726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befefebd-218f021-c9335827-d48fc4c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.591754Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 Handle describe topics response
2025-10-10T14:33:46.591803Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 auth is DEAD
2025-10-10T14:33:46.591816Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:33:46.591934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.591970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:46.591975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:46.591979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:46.592119Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:33:46.592195Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601257454271898:4184] connected; active server actors: 1
2025-10-10T14:33:46.592213Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601257454271898:4184] session shared/user_1_12_2092695052603809663_v1
2025-10-10T14:33:46.592223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:33:46.592235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:33:46.592249Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_12_2092695052603809663_v1" (Sender=[1:7559601257454271859:4184], Pipe=[1:7559601257454271898:4184], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:33:46.592253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:33:46.592270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:33:46.592279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_12_2092695052603809663_v1" (Sender=[1:7559601257454271859:4184], Pipe=[1:7559601257454271898:4184], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:33:46.592296Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_12_2092695052603809663_v1
2025-10-10T14:33:46.592292Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_12_2092695052603809663_v1" sender [1:7559601257454271859:4184] lock partition 0 for ReadingSession "shared/user_1_12_2092695052603809663_v1" (Sender=[1:7559601257454271859:4184], Pipe=[1:7559601257454271898:4184], Partitions=[], ActiveFamilyCount=1) generation 1 step 12
2025-10-10T14:33:46.592304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:33:46.592309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-10T14:33:46.592314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1102 sessionId:  describe result for acl check
2025-10-10T14:33:46.592338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:46.592348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:46.592349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:46.592355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601257454271901:4180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:46.592529Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 12 Session: "shared/user_1_12_2092695052603809663_v1" ClientId: "user" PipeClient { RawX1: 7559601257454271898 RawX2: 4503603922341976 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:33:46.592551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:33:46.592932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601257454271901:4180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:46.594763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:46.594996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601257454271901:4180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:46.596756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:46.596978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:46.596988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:46.597016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:46.597078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:46.597124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601256672049757:7014]
2025-10-10T14:33:46.597781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:46.597859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601257454271901:4180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:46.597872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601257454271901:4180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:46.597876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601257454271901:4180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:46.597885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:46.598118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:46.598175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:46.598491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:46.598582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.598590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.598591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.598592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.598593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.598594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.598596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.598597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.598598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.598599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.598600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.598601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.598602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.598608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.598622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.598626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.598630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.598634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.598638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.598643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.598646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.598650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.598655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.598670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.598673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.598677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.598685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.598694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.598700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.598706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.598715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.598720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.598725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.598730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.598736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.598754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.598762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.598768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.598777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.598782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.598788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.598797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.598802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.598806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.598815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.598819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.598823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.598832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.598837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.598861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.598870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.598874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.598914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:46.601411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:46.601833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:46.601846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:46.601848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:46.601853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:46.601860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1101 [2:7559601256672049757:7014]
2025-10-10T14:33:46.601873Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:46.601896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:46.601904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.601908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.601911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.601929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:46.601937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:46.601945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:46.601998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.602005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.602007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.602010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:46.602076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:46.602086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.602097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.602107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.602122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:46.602144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271957:4180], now have 1 active actors on pipe
2025-10-10T14:33:46.602153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271770:2438], now have 1 active actors on pipe
2025-10-10T14:33:46.602156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271914:4179], now have 1 active actors on pipe
2025-10-10T14:33:46.602165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601256672049752:7014]
2025-10-10T14:33:46.602167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601256672049752:7014]
2025-10-10T14:33:46.602169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601256672049752:7014]
2025-10-10T14:33:46.602183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:46.602194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:46.602197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:46.602197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:46.602199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:46.602213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:46.602198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1101
2025-10-10T14:33:46.602198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1101, pipe: [1:7559601257454271914:4179]
2025-10-10T14:33:46.602221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1101
2025-10-10T14:33:46.602217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:46.602243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601256672049752:7014]
2025-10-10T14:33:46.602245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:46.602248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:46.602264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.602269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.602284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_12_2092695052603809663_v1 on pipe: [1:7559601257454271914:4179]
2025-10-10T14:33:46.602312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.602318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.602323Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_12_2092695052603809663_v1:1 with generation 1101
2025-10-10T14:33:46.602353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.602364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.602366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:46.602382Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_12_2092695052603809663_v1
2025-10-10T14:33:46.602389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.602424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3491373-7540939a-c610d36a-39c07e40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:46.602433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:33:46.602441Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:33:46.605630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:33:46.605662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:33:46.605672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.605678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.605694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:46.605712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.605727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:46.605734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:33:46.605748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:33:46.605786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.605932Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106826601 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:33:46.605956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:33:46.605993Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 sending to client partition status
2025-10-10T14:33:46.606017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.606034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.606062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.606207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1102 partition: 0 MaxSeqNo: 40 sessionId: src_id|3491373-7540939a-c610d36a-39c07e40_0
2025-10-10T14:33:46.606533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befefebd-218f021-c9335827-d48fc4c2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3491373-7540939a-c610d36a-39c07e40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:46.609233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3491373-7540939a-c610d36a-39c07e40_0] Write session: try to update token
2025-10-10T14:33:46.609252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3491373-7540939a-c610d36a-39c07e40_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:46.621594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:46.621613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:46.621616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:46.621618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:46.621629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601256672049752:7014]
2025-10-10T14:33:46.621635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601256672049752:7014]
2025-10-10T14:33:46.621638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601256672049752:7014]
2025-10-10T14:33:46.621695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:46.621701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:46.621708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.621709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:46.621711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:46.621713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:46.621860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:46.623940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId: src_id|3491373-7540939a-c610d36a-39c07e40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:46.626656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:46.732321Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:46.732898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.732917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.733191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:46.733206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:46.733214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601257454271914:4179]
2025-10-10T14:33:46.733274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:46.733278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1102 reason: error at write: Disconnected sessionId: src_id|3491373-7540939a-c610d36a-39c07e40_0
2025-10-10T14:33:46.733427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_12_2092695052603809663_v1
2025-10-10T14:33:46.733450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:46.733481Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_12_2092695052603809663_v1
2025-10-10T14:33:46.733523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1102 sessionId: src_id|3491373-7540939a-c610d36a-39c07e40_0 is DEAD
2025-10-10T14:33:46.733673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3491373-7540939a-c610d36a-39c07e40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:46.733685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3491373-7540939a-c610d36a-39c07e40_0] Write session will restart in 0.005195s
2025-10-10T14:33:46.733722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3491373-7540939a-c610d36a-39c07e40_0] Write session: Do CDS request
2025-10-10T14:33:46.733728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3491373-7540939a-c610d36a-39c07e40_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:46.739906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3491373-7540939a-c610d36a-39c07e40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.739949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:46.739965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1103
2025-10-10T14:33:46.740183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.740231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:46.740241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:46.740246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:46.740710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1103 sessionId:  describe result for acl check
2025-10-10T14:33:46.740750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:46.740762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:46.740764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:46.740770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601257454271992:4174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:46.741398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601257454271992:4174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:46.743948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601257454271992:4174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:46.746833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601257454271992:4174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:46.746860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601257454271992:4174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:46.746864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601257454271992:4174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:46.746872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:46.746970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:46.749046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:46.749259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:46.749272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:46.749282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:46.749352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:46.749396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601256672049946:7017]
2025-10-10T14:33:46.750042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:46.750420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:46.750465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:46.750785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:46.750844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.750849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.750851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.750852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.750853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.750854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.750855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.750857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.750858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.750859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.750860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.750862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.750863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.750869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.750882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.750887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.750891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.750895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.750898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.750902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.750905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.750908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.750912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.750916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.750920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.750923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.750932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.750941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.750947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.750953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.750957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.750970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.750974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.750985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.750990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.750997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.751001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.751006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.751016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.751022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.751041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.751051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.751056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.751067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.751071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.751080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.751085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.751090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.751099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.751104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.751113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.751118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.751163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:46.753610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:46.754061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:46.754073Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:46.754076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:46.754080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:46.754087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1102 [2:7559601256672049946:7017]
2025-10-10T14:33:46.754101Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:46.754131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:46.754134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.754137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.754140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.754158Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:46.754170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:46.754178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:46.754254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.754261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.754263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.754266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:46.754340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:46.754348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.754360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.754374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.754397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:46.754423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454272152:4174], now have 1 active actors on pipe
2025-10-10T14:33:46.754431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454271977:2438], now have 1 active actors on pipe
2025-10-10T14:33:46.754438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601256672049940:7017]
2025-10-10T14:33:46.754440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601256672049940:7017]
2025-10-10T14:33:46.754443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601256672049940:7017]
2025-10-10T14:33:46.754457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:46.754474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:46.754476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:46.754478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:46.754480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:46.754471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1102
2025-10-10T14:33:46.754493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:46.754471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1102
2025-10-10T14:33:46.754501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:46.754529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601256672049940:7017]
2025-10-10T14:33:46.754536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:46.754538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:46.754561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.754572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.754808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:46.754825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.754829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.754839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:46.754850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.754868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:46.754896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.755179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.755194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.755220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.755353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1103 partition: 0 MaxSeqNo: 40 sessionId: src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0
2025-10-10T14:33:46.755759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3491373-7540939a-c610d36a-39c07e40_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:46.758473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0] Write session: try to update token
2025-10-10T14:33:46.758492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:46.771999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId: src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:46.773718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:46.773736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:46.773738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:46.773740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:46.773750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601256672049940:7017]
2025-10-10T14:33:46.773753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601256672049940:7017]
2025-10-10T14:33:46.773756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601256672049940:7017]
2025-10-10T14:33:46.773796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:46.773803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.773804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:46.773881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:46.773894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:46.773901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:46.773933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:46.774657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:46.833603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601257454272165:4179]
2025-10-10T14:33:46.833869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1102, pipe: [1:7559601257454272165:4179]
2025-10-10T14:33:46.881130Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:46.881494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.881510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.881549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454272165:4179], now have 1 active actors on pipe
2025-10-10T14:33:46.881764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:46.881833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601257454272165:4179]
2025-10-10T14:33:46.881842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:46.881847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:46.881864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:46.881909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1103 reason: error at write: Disconnected sessionId: src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0
2025-10-10T14:33:46.882141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1103 sessionId: src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0 is DEAD
2025-10-10T14:33:46.882335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:46.882343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0] Write session will restart in 0.005361s
2025-10-10T14:33:46.882370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0] Write session: Do CDS request
2025-10-10T14:33:46.882376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:46.888891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.888999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:46.889016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1104
2025-10-10T14:33:46.889176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:46.889211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:46.889222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:46.889226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:46.889636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1104 sessionId:  describe result for acl check
2025-10-10T14:33:46.889671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:46.889676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:46.889677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:46.889682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601257454272204:4170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:46.890147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601257454272204:4170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:46.892888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601257454272204:4170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:46.894631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:46.896639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:46.896844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:46.896854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:46.896866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:46.896918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:46.896960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601256672050131:7019]
2025-10-10T14:33:46.897006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601257454272204:4170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:46.897021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601257454272204:4170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:46.897024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601257454272204:4170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:46.897034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:46.897561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:46.897846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:46.897882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:46.898148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:46.898206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.898212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.898213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.898214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.898215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.898216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.898218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.898219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.898220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.898221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.898222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.898224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.898225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.898231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.898244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.898248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.898252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.898256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.898260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.898265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.898268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.898272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.898277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.898280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.898284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.898288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.898295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.898304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:46.898310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.898316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:46.898319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.898323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:46.898327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.898330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:46.898332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.898335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:46.898338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.898341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:46.898343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.898346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:46.898349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.898352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:46.898355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.898358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:46.898360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.898364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:46.898366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.898369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.898372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.898375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.898378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.898381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.898403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:46.900645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:46.900938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:46.900953Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:46.900955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:46.900959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:46.900965Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1103 [2:7559601256672050131:7019]
2025-10-10T14:33:46.900973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:46.900984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:46.900987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.900990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.900991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.901005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:46.901021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:46.901028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:46.901079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.901085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.901087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.901089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:46.901151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:46.901157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.901163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:46.901173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:46.901205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:46.901227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454272166:2438], now have 1 active actors on pipe
2025-10-10T14:33:46.901233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454272342:4170], now have 1 active actors on pipe
2025-10-10T14:33:46.901239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601256672050126:7019]
2025-10-10T14:33:46.901240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601256672050126:7019]
2025-10-10T14:33:46.901242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601256672050126:7019]
2025-10-10T14:33:46.901251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:46.901261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:46.901266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:46.901271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:46.901273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:46.901285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1103
2025-10-10T14:33:46.901288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1103
2025-10-10T14:33:46.901275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:46.901278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:46.901298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601256672050126:7019]
2025-10-10T14:33:46.901310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:46.901325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:46.901353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.901362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.901398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:46.901410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:46.901413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:46.901415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:46.901423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:46.901431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:46.901447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.901568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:46.901576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:46.901589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:46.901684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1104 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0
2025-10-10T14:33:46.902059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|862b98ed-6c98ccee-fee4b531-2990c5cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:46.904735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0] Write session: try to update token
2025-10-10T14:33:46.904754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:46.919172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId: src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:46.920650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:46.920670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:46.920672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:46.920674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:46.920682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601256672050126:7019]
2025-10-10T14:33:46.920685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601256672050126:7019]
2025-10-10T14:33:46.920689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601256672050126:7019]
2025-10-10T14:33:46.920731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:46.920738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:46.920740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:46.920743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:46.920750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:46.920754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:46.920872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:46.922005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:46.982120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601257454272367:4179]
2025-10-10T14:33:46.982399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1103, pipe: [1:7559601257454272367:4179]
2025-10-10T14:33:47.030535Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:47.031044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.031059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.031105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601257454272367:4179], now have 1 active actors on pipe
2025-10-10T14:33:47.031330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:47.031333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:47.031347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:47.031359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:47.031402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1104 reason: error at write: Disconnected sessionId: src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0
2025-10-10T14:33:47.031419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601257454272367:4179]
2025-10-10T14:33:47.031616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1104 sessionId: src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0 is DEAD
2025-10-10T14:33:47.031756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:47.031769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0] Write session will restart in 0.005007s
2025-10-10T14:33:47.031794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0] Write session: Do CDS request
2025-10-10T14:33:47.031802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:47.037930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.038020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:47.038039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1105
2025-10-10T14:33:47.038219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.038259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:47.038265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:47.038272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:47.038923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1105 sessionId:  describe result for acl check
2025-10-10T14:33:47.038960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:47.038967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:47.038968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:47.038974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601261749239699:4150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:47.039527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601261749239699:4150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:47.042857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601261749239699:4150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:47.045609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:47.045822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601261749239699:4150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:47.045839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601261749239699:4150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:47.045842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601261749239699:4150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:47.045851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:47.048050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:47.048300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:47.048313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:47.048326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:47.048384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:47.048424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601260967017652:7034]
2025-10-10T14:33:47.049046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:47.049425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:47.049475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:47.049811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:47.049881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.049887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.049889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.049890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.049891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.049893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.049894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.049895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.049896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.049898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.049900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.049901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.049902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.049908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.049922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.049926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.049931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.049935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.049939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.049944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.049948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.049952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.049958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.049962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.049966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.049970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.049979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.049988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.049996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.050002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.050011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.050016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.050020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.050026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.050031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.050036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.050041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.050046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.050051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.050057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.050067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.050073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.050078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.050084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.050090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.050101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.050105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.050111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.050116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.050122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.050131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.050136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.050177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:47.052729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:47.053031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:47.053045Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:47.053048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:47.053052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:47.053059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1104 [2:7559601260967017652:7034]
2025-10-10T14:33:47.053076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:47.053095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:47.053103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.053106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.053109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.053127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:47.053142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:47.053154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:47.053217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.053224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.053225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.053228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:47.053296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:47.053303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.053315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.053350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.053375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:47.053399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749239675:2438], now have 1 active actors on pipe
2025-10-10T14:33:47.053408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749239852:4150], now have 1 active actors on pipe
2025-10-10T14:33:47.053416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601260967017646:7034]
2025-10-10T14:33:47.053418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601260967017646:7034]
2025-10-10T14:33:47.053420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601260967017646:7034]
2025-10-10T14:33:47.053433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:47.053439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1104
2025-10-10T14:33:47.053450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:47.053449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:47.053452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:47.053455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:47.053471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:47.053475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:47.053520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601260967017646:7034]
2025-10-10T14:33:47.053475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1104
2025-10-10T14:33:47.053527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:47.053542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:47.053551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.053556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.053691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:47.053705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.053713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.053722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:47.053734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.053749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:47.053776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.053988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.053997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.054015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.054157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1105 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0
2025-10-10T14:33:47.054618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4bf4f9-8ec64cb8-39f0bdd7-3fd835b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:47.057291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0] Write session: try to update token
2025-10-10T14:33:47.057309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:47.071900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId: src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:47.073509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:47.073524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:47.073527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:47.073529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:47.073537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601260967017646:7034]
2025-10-10T14:33:47.073540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601260967017646:7034]
2025-10-10T14:33:47.073542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601260967017646:7034]
2025-10-10T14:33:47.073581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:47.073587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.073588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:47.073593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:47.073600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:47.073605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:47.073732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:47.074839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:47.131605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601261749239865:4179]
2025-10-10T14:33:47.131914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1104, pipe: [1:7559601261749239865:4179]
2025-10-10T14:33:47.183909Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:47.184427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.184452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.184494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749239865:4179], now have 1 active actors on pipe
2025-10-10T14:33:47.184631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:47.184657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601261749239865:4179]
2025-10-10T14:33:47.184699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:47.184695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:47.184719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:47.184844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1105 reason: error at write: Disconnected sessionId: src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0
2025-10-10T14:33:47.185076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1105 sessionId: src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0 is DEAD
2025-10-10T14:33:47.185243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:47.185254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0] Write session will restart in 0.009468s
2025-10-10T14:33:47.185290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0] Write session: Do CDS request
2025-10-10T14:33:47.185297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:47.195924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.196003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:47.196020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1106
2025-10-10T14:33:47.196149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.196196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:47.196206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:47.196210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:47.196774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1106 sessionId:  describe result for acl check
2025-10-10T14:33:47.196821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:47.196828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:47.196830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:47.196836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601261749239993:4144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:47.197470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601261749239993:4144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:47.200179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601261749239993:4144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:47.198917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:47.201364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:47.201597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:47.201616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:47.201629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:47.201694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:47.201740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601260967017838:7036]
2025-10-10T14:33:47.202348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:47.202659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:47.202713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:47.203039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601261749239993:4144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:47.203057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:47.203054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601261749239993:4144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:47.203057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601261749239993:4144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:47.203066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:47.203108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.203115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.203117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.203118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.203119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.203120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.203121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.203123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.203124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.203125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.203126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.203127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.203128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.203134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.203147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.203151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.203154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.203158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.203163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.203167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.203170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.203174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.203178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.203181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.203184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.203188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.203198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.203206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.203212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.203216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.203220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.203225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.203229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.203233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.203237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.203243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.203247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.203251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.203256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.203261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.203264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.203269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.203273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.203277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.203282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.203286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.203291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.203295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.203299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.203304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.203308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.203313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.203350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:47.205846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:47.206170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:47.206181Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:47.206184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:47.206188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:47.206195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1105 [2:7559601260967017838:7036]
2025-10-10T14:33:47.206209Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:47.206227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:47.206234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.206238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.206240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.206258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:47.206266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:47.206274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:47.206333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.206342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.206344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.206347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:47.206426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:47.206432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.206443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.206453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.206474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:47.206496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749239866:2438], now have 1 active actors on pipe
2025-10-10T14:33:47.206504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240047:4144], now have 1 active actors on pipe
2025-10-10T14:33:47.206511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601260967017832:7036]
2025-10-10T14:33:47.206513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601260967017832:7036]
2025-10-10T14:33:47.206516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601260967017832:7036]
2025-10-10T14:33:47.206530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:47.206547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:47.206550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1105
2025-10-10T14:33:47.206549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:47.206558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1105
2025-10-10T14:33:47.206553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:47.206555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:47.206568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:47.206571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:47.206610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601260967017832:7036]
2025-10-10T14:33:47.206616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:47.206630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.206632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:47.206635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.206684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82317780-edde93f7-f1924d43-583c9563_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:47.206697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.206701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.206704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:47.206715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.206730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:47.206750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.206984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.206992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.207009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.207087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1106 partition: 0 MaxSeqNo: 40 sessionId: src_id|82317780-edde93f7-f1924d43-583c9563_0
2025-10-10T14:33:47.207501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a5b023-3d5a5117-1a6ffb5-871c536c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82317780-edde93f7-f1924d43-583c9563_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:47.210247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82317780-edde93f7-f1924d43-583c9563_0] Write session: try to update token
2025-10-10T14:33:47.210270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82317780-edde93f7-f1924d43-583c9563_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:47.225745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId: src_id|82317780-edde93f7-f1924d43-583c9563_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:47.226140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:47.226163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:47.226166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:47.226168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:47.226177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601260967017832:7036]
2025-10-10T14:33:47.226181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601260967017832:7036]
2025-10-10T14:33:47.226185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601260967017832:7036]
2025-10-10T14:33:47.226231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:47.226231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:47.226238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:47.226242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:47.226243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.226246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:47.226383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:47.228459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:47.284696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601261749240056:4179]
2025-10-10T14:33:47.285035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1105, pipe: [1:7559601261749240056:4179]
2025-10-10T14:33:47.336498Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:47.337131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.337150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.337202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240056:4179], now have 1 active actors on pipe
2025-10-10T14:33:47.337444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:47.337457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:47.337484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:47.337494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601261749240056:4179]
2025-10-10T14:33:47.337514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:47.337552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1106 reason: error at write: Disconnected sessionId: src_id|82317780-edde93f7-f1924d43-583c9563_0
2025-10-10T14:33:47.337754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1106 sessionId: src_id|82317780-edde93f7-f1924d43-583c9563_0 is DEAD
2025-10-10T14:33:47.337948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82317780-edde93f7-f1924d43-583c9563_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:47.337973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82317780-edde93f7-f1924d43-583c9563_0] Write session will restart in 0.005453s
2025-10-10T14:33:47.337999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82317780-edde93f7-f1924d43-583c9563_0] Write session: Do CDS request
2025-10-10T14:33:47.338009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82317780-edde93f7-f1924d43-583c9563_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:47.344900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82317780-edde93f7-f1924d43-583c9563_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.345308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:47.345325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1107
2025-10-10T14:33:47.345504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.345554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:47.345568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:47.345571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:47.346100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1107 sessionId:  describe result for acl check
2025-10-10T14:33:47.346138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:47.346145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:47.346147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:47.346154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601261749240092:4141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:47.346769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601261749240092:4141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:47.349931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601261749240092:4141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:47.352325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601261749240092:4141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:47.352340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601261749240092:4141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:47.352344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601261749240092:4141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:47.352353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:47.352414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:47.354805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:47.355063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:47.355073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:47.355085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:47.355148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:47.355198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601260967018026:7038]
2025-10-10T14:33:47.355841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:47.356386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:47.356443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:47.356784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:47.356858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.356864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.356865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.356866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.356867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.356868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.356869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.356870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.356872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.356872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.356874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.356875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.356876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.356883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.356895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.356899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.356902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.356906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.356910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.356913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.356917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.356920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.356924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.356927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.356931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.356934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.356943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.356951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.356957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.356962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.356966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.356970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.356974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.356979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.356983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.356988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.356992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.356996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.357001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.357005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.357009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.357014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.357019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.357024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.357027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.357032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.357036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.357041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.357045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.357050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.357054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.357060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.357096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:47.359680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:47.360195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:47.360212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:47.360215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:47.360219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:47.360226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1106 [2:7559601260967018026:7038]
2025-10-10T14:33:47.360241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:47.360259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:47.360263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.360268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.360270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.360288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:47.360299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:47.360321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:47.360385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.360394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.360408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.360410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:47.360483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:47.360491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.360503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.360525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.360544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:47.360574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240237:4141], now have 1 active actors on pipe
2025-10-10T14:33:47.360583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240058:2438], now have 1 active actors on pipe
2025-10-10T14:33:47.360591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601260967018020:7038]
2025-10-10T14:33:47.360599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601260967018020:7038]
2025-10-10T14:33:47.360601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601260967018020:7038]
2025-10-10T14:33:47.360617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:47.360630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1106
2025-10-10T14:33:47.360633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1106
2025-10-10T14:33:47.360637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:47.360645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:47.360648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:47.360650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:47.360660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:47.360664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:47.360695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601260967018020:7038]
2025-10-10T14:33:47.360699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:47.360709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:47.360724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.360729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.360785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:47.360798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.360802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.360810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:47.360824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.360840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:47.360862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.361047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.361077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.361115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.361251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1107 partition: 0 MaxSeqNo: 40 sessionId: src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0
2025-10-10T14:33:47.361690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82317780-edde93f7-f1924d43-583c9563_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:47.364382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0] Write session: try to update token
2025-10-10T14:33:47.364401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:47.378071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId: src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:47.380561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:47.380584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:47.380588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:47.380590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:47.380601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601260967018020:7038]
2025-10-10T14:33:47.380606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601260967018020:7038]
2025-10-10T14:33:47.380611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601260967018020:7038]
2025-10-10T14:33:47.380662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:47.380667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:47.380674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.380675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:47.380677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:47.380683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:47.380776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:47.380821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:47.437781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601261749240261:4179]
2025-10-10T14:33:47.438073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1106, pipe: [1:7559601261749240261:4179]
2025-10-10T14:33:47.499456Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:47.499873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.499891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.499942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240261:4179], now have 1 active actors on pipe
2025-10-10T14:33:47.500166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601261749240261:4179]
2025-10-10T14:33:47.500183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:47.500188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:47.500197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:47.500205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:47.500261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1107 reason: error at write: Disconnected sessionId: src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0
2025-10-10T14:33:47.500511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1107 sessionId: src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0 is DEAD
2025-10-10T14:33:47.500711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:47.500737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0] Write session will restart in 0.005048s
2025-10-10T14:33:47.500764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0] Write session: Do CDS request
2025-10-10T14:33:47.500773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:47.506903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.507033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:47.507053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1108
2025-10-10T14:33:47.507199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.507248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:47.507258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:47.507263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:47.507757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1108 sessionId:  describe result for acl check
2025-10-10T14:33:47.507805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:47.507808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:47.507811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:47.507818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601261749240278:4129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:47.508457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601261749240278:4129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:47.511368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601261749240278:4129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:47.514196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601261749240278:4129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:47.514209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601261749240278:4129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:47.514213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601261749240278:4129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:47.514221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:47.515214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:47.517033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:47.517247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:47.517258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:47.517269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:47.517319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:47.517378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601260967018226:7041]
2025-10-10T14:33:47.517983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:47.518265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:47.518322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:47.518648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:47.518708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.518714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.518716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.518716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.518718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.518719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.518720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.518721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.518722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.518723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.518724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.518725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.518726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.518732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.518744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.518749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.518754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.518758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.518761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.518765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.518768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.518771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.518775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.518778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.518782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.518786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.518793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.518802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.518809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.518814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.518819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.518824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.518829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.518834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.518838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.518843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.518847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.518853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.518858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.518863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.518868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.518873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.518878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.518883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.518886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.518892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.518897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.518901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.518905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.518916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.518921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.518930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.518966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:47.521208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:47.521564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:47.521577Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:47.521580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:47.521584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:47.521590Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1107 [2:7559601260967018226:7041]
2025-10-10T14:33:47.521601Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:47.521617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:47.521625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.521629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.521632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.521649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:47.521661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:47.521673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:47.521729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.521737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.521739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.521741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:47.521805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:47.521815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.521826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.521837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.521852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:47.521874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240442:4129], now have 1 active actors on pipe
2025-10-10T14:33:47.521883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240263:2438], now have 1 active actors on pipe
2025-10-10T14:33:47.521890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601260967018221:7041]
2025-10-10T14:33:47.521897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601260967018221:7041]
2025-10-10T14:33:47.521898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601260967018221:7041]
2025-10-10T14:33:47.521915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:47.521934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:47.521950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:47.521955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:47.521957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:47.521959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:47.521950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1107
2025-10-10T14:33:47.521961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:47.521981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601260967018221:7041]
2025-10-10T14:33:47.521984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:47.521958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1107
2025-10-10T14:33:47.522003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:47.522020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.522029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.522060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:47.522072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.522077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.522079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:47.522090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.522102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:47.522125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.522262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.522270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.522285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.522368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1108 partition: 0 MaxSeqNo: 40 sessionId: src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0
2025-10-10T14:33:47.522761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c2f741-265d732d-1c69eef4-923cc4a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:47.525267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0] Write session: try to update token
2025-10-10T14:33:47.525283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:47.539370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:47.539386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:47.539397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601260967018221:7041]
2025-10-10T14:33:47.539444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:47.539450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:47.539494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId: src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:47.539637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:47.539796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:47.539948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:47.540106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:47.540310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:47.540351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:47.542127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:47.542316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.542333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.542369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:47.542449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:47.551731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:47.551756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:47.551760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:47.551762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:47.551773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601260967018221:7041]
2025-10-10T14:33:47.551778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601260967018221:7041]
2025-10-10T14:33:47.551782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601260967018221:7041]
2025-10-10T14:33:47.551821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:47.551827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:47.551830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:47.551833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:47.551841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.551846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:47.551971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:47.600067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601261749240460:4179]
2025-10-10T14:33:47.600322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1107, pipe: [1:7559601261749240460:4179]
2025-10-10T14:33:47.671313Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:47.680301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.680342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.680532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.680602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.680668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.680738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.680793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.680804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.680877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.680942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.681011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.681091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.681140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.681148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.681220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.681290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.681380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.681449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.681512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.681522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.681599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.681664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.681730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.681799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.681848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.681857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.681928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.681992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.682061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.682134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.682185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.682196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.682267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.682330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.682396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.682463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.682511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.682520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.682588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.682648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.682719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.682785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.682833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.682846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.682912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.682973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.683038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.683102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.683146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.683158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.683223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.683281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.683345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.683415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.683464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.683472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.683540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:47.683601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:47.683669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:47.683734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:47.683780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:47.683789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:47.683858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240460:4179], now have 1 active actors on pipe
2025-10-10T14:33:47.684121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601261749240460:4179]
2025-10-10T14:33:47.684148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:47.684152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:47.684153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:47.684185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1108 reason: error at write: Disconnected sessionId: src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0
2025-10-10T14:33:47.684486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1108 sessionId: src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0 is DEAD
2025-10-10T14:33:47.684574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:47.684585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0] Write session will restart in 0.007364s
2025-10-10T14:33:47.684610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0] Write session: Do CDS request
2025-10-10T14:33:47.684616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:47.685219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:47.692922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.693014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:47.693030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1109
2025-10-10T14:33:47.693191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.693231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:47.693241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:47.693245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:47.693738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1109 sessionId:  describe result for acl check
2025-10-10T14:33:47.693777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:47.693784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:47.693786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:47.693792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601261749240534:4126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:47.694378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601261749240534:4126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:47.698299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601261749240534:4126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:47.699199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:47.701556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:47.701994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601261749240534:4126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:47.702010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601261749240534:4126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:47.702012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601261749240534:4126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:47.702020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:47.701950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:47.701966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:47.701981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:47.702054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:47.702092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601260967018419:7044]
2025-10-10T14:33:47.702699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:47.703099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:47.703178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:47.703525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:47.703609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.703615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.703617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.703618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.703619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.703621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.703622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.703623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.703624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.703625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.703626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.703628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.703629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.703636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.703650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.703654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.703658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.703662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.703665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.703669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.703672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.703675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.703679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.703682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.703686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.703689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.703699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.703707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.703715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.703722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.703727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.703732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.703741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.703746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.703750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.703756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.703763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.703767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.703772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.703777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.703782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.703786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.703792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.703809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.703818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.703823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.703828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.703834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.703842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.703846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.703851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.703861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.703898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:47.706526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:47.707392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:47.707408Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:47.707411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:47.707414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:47.707421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1108 [2:7559601260967018419:7044]
2025-10-10T14:33:47.707434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:47.707454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:47.707458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.707462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.707464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.707483Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:47.707496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:47.707504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:47.707570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.707577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.707580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.707583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:47.707649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:47.707656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.707667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.707681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.707699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:47.707727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240468:2438], now have 1 active actors on pipe
2025-10-10T14:33:47.707735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240650:4126], now have 1 active actors on pipe
2025-10-10T14:33:47.707743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601260967018413:7044]
2025-10-10T14:33:47.707751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601260967018413:7044]
2025-10-10T14:33:47.707753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601260967018413:7044]
2025-10-10T14:33:47.707768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:47.707781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:47.707785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:47.707791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:47.707793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:47.707799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:47.707803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:47.707797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1108
2025-10-10T14:33:47.707802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1108
2025-10-10T14:33:47.707847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601260967018413:7044]
2025-10-10T14:33:47.707856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:47.707862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:47.707873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.707878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.707935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:47.707948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.707952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.707955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:47.707969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.707979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:47.708007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.708190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.708196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.708212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.708301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1109 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0
2025-10-10T14:33:47.708712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f472f0-71faa88b-f50607d-7a1eda4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:47.711437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0] Write session: try to update token
2025-10-10T14:33:47.711457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:47.727324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:47.727341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:47.727344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:47.727345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:47.727353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601260967018413:7044]
2025-10-10T14:33:47.727356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601260967018413:7044]
2025-10-10T14:33:47.727359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601260967018413:7044]
2025-10-10T14:33:47.727400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:47.727406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:47.727408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:47.727410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:47.727415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.727419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:47.727544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:47.727546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId: src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:47.729999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:47.784399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601261749240661:4179]
2025-10-10T14:33:47.784653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1108, pipe: [1:7559601261749240661:4179]
2025-10-10T14:33:47.839219Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:47.839517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.839532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.839582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240661:4179], now have 1 active actors on pipe
2025-10-10T14:33:47.839814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:47.839820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:47.839848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601261749240661:4179]
2025-10-10T14:33:47.839883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:47.840084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0
2025-10-10T14:33:47.840359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1109 sessionId: src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0 is DEAD
2025-10-10T14:33:47.840521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:47.840532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0] Write session will restart in 0.007599s
2025-10-10T14:33:47.840558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0] Write session: Do CDS request
2025-10-10T14:33:47.840564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:47.849917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.849991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:47.850022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1110
2025-10-10T14:33:47.850143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:47.850183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:47.850189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:47.850201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:47.850739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1110 sessionId:  describe result for acl check
2025-10-10T14:33:47.850782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:47.850791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:47.850794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:47.850800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601261749240784:4119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:47.851439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601261749240784:4119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:47.853433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:47.853503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601261749240784:4119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:47.855415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:47.855635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:47.855647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:47.855659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:47.855717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:47.855787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601260967018609:7046]
2025-10-10T14:33:47.856264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601261749240784:4119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:47.856278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601261749240784:4119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:47.856282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601261749240784:4119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:47.856291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:47.856337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:47.856615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:47.856658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:47.856950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:47.857034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.857039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.857040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.857040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.857041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.857042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.857043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.857044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.857044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.857045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.857046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.857046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.857047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.857051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.857060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.857062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.857065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.857067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.857070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.857072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.857074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.857077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.857079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.857081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.857084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.857086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.857092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.857097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:47.857104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.857107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:47.857110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.857113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:47.857116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.857119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:47.857122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.857125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:47.857128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.857131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:47.857134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.857137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:47.857140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.857143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:47.857146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.857149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:47.857152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.857155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:47.857158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.857161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.857164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.857167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.857170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.857173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.857205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:47.859647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:47.860244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:47.860257Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:47.860260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:47.860264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:47.860273Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1109 [2:7559601260967018609:7046]
2025-10-10T14:33:47.860286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:47.860308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:47.860319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.860323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.860325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.860344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:47.860358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:47.860365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:47.860436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.860443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.860445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.860448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:47.860521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:47.860528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.860539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:47.860555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:47.860572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:47.860600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240663:2438], now have 1 active actors on pipe
2025-10-10T14:33:47.860609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240846:4119], now have 1 active actors on pipe
2025-10-10T14:33:47.860616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601260967018604:7046]
2025-10-10T14:33:47.860618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601260967018604:7046]
2025-10-10T14:33:47.860620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601260967018604:7046]
2025-10-10T14:33:47.860635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:47.860650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:47.860627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1109
2025-10-10T14:33:47.860663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1109
2025-10-10T14:33:47.860672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:47.860671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:47.860675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:47.860678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:47.860679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:47.860726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.860738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.860753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601260967018604:7046]
2025-10-10T14:33:47.860762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:47.860772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:47.860799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:47.860812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:47.860821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:47.860823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:47.860836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:47.860848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:47.860869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.861047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.861055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.861072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:47.861171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1110 partition: 0 MaxSeqNo: 40 sessionId: src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0
2025-10-10T14:33:47.861670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6c2c3b-1d00ecde-f3f83851-ce7bf030_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:47.864483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0] Write session: try to update token
2025-10-10T14:33:47.864503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:47.879550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId: src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:47.880801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:47.880826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:47.880830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:47.880832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:47.880842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601260967018604:7046]
2025-10-10T14:33:47.880847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601260967018604:7046]
2025-10-10T14:33:47.880851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601260967018604:7046]
2025-10-10T14:33:47.880901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:47.880908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:47.880915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:47.880917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:47.880919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:47.880920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:47.882368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:47.881068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:47.940033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601261749240857:4179]
2025-10-10T14:33:47.940342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1109, pipe: [1:7559601261749240857:4179]
2025-10-10T14:33:47.994780Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:47.995206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:47.995222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:47.995268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240857:4179], now have 1 active actors on pipe
2025-10-10T14:33:47.995493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:47.995494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:47.995499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:47.995520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:47.995547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601261749240857:4179]
2025-10-10T14:33:47.995583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1110 reason: error at write: Disconnected sessionId: src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0
2025-10-10T14:33:47.995779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1110 sessionId: src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0 is DEAD
2025-10-10T14:33:47.995969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:47.995990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0] Write session will restart in 0.008934s
2025-10-10T14:33:47.996014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0] Write session: Do CDS request
2025-10-10T14:33:47.996020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:48.006056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.006058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:48.006076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1111
2025-10-10T14:33:48.006325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.006363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:48.006383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:48.006387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:48.006968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1111 sessionId:  describe result for acl check
2025-10-10T14:33:48.007009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:48.007013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:48.007015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:48.007021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601266044208301:4104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:48.007596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601266044208301:4104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:48.009710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:48.009986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601266044208301:4104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:48.011632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:48.011977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:48.011991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:48.012005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:48.012080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:48.012126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601265261986109:7050]
2025-10-10T14:33:48.012431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601266044208301:4104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:48.012444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601266044208301:4104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:48.012448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601266044208301:4104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:48.012457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:48.012719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:48.013019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:48.013062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:48.013398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:48.013472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.013479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.013480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.013481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.013482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.013483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.013485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.013486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.013487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.013488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.013490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.013491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.013492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.013498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.013509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.013514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.013518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.013522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.013526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.013530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.013534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.013538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.013543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.013546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.013550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.013554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.013564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.013572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.013578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.013584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.013588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.013593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.013597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.013603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.013608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.013613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.013626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.013631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.013635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.013647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.013651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.013656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.013665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.013669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.013672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.013677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.013681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.013691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.013695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.013700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.013704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.013708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.013744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:48.016244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:48.016673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:48.016684Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:48.016686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:48.016689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:48.016696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1110 [2:7559601265261986109:7050]
2025-10-10T14:33:48.016707Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:48.016724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:48.016729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.016732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.016735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.016752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:48.016760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:48.016768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:48.016829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.016840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.016842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.016845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:48.016926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:48.016934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.016945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.016962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.016983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:48.017011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208351:4104], now have 1 active actors on pipe
2025-10-10T14:33:48.017019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601261749240861:2438], now have 1 active actors on pipe
2025-10-10T14:33:48.017026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601265261986104:7050]
2025-10-10T14:33:48.017033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601265261986104:7050]
2025-10-10T14:33:48.017035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601265261986104:7050]
2025-10-10T14:33:48.017049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:48.017071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:48.017072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:48.017075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:48.017077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:48.017087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:48.017095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:48.017087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1110
2025-10-10T14:33:48.017118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601265261986104:7050]
2025-10-10T14:33:48.017124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1110
2025-10-10T14:33:48.017133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:48.017149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:48.017156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.017160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.017210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|350a4d56-6f372837-e5bbb894-6e16647f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:48.017224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.017233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.017236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:48.017248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.017265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:48.017297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.017460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.017469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.017487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.017574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1111 partition: 0 MaxSeqNo: 40 sessionId: src_id|350a4d56-6f372837-e5bbb894-6e16647f_0
2025-10-10T14:33:48.018098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cb8a60-343c21df-71f50b0d-dc71938e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|350a4d56-6f372837-e5bbb894-6e16647f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:48.020821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350a4d56-6f372837-e5bbb894-6e16647f_0] Write session: try to update token
2025-10-10T14:33:48.020841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350a4d56-6f372837-e5bbb894-6e16647f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:48.035191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId: src_id|350a4d56-6f372837-e5bbb894-6e16647f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:48.038151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:48.036408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:48.036429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:48.036434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:48.036436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:48.036445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601265261986104:7050]
2025-10-10T14:33:48.036451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601265261986104:7050]
2025-10-10T14:33:48.036454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601265261986104:7050]
2025-10-10T14:33:48.036505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:48.036510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:48.036512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:48.036516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:48.036518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.036521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:48.036680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:48.095706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601266044208374:4179]
2025-10-10T14:33:48.095999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1110, pipe: [1:7559601266044208374:4179]
2025-10-10T14:33:48.146574Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:48.146871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.146885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.146934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208374:4179], now have 1 active actors on pipe
2025-10-10T14:33:48.147156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:48.147186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601266044208374:4179]
2025-10-10T14:33:48.147210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:48.147213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:48.147174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:48.147271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1111 reason: error at write: Disconnected sessionId: src_id|350a4d56-6f372837-e5bbb894-6e16647f_0
2025-10-10T14:33:48.147478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1111 sessionId: src_id|350a4d56-6f372837-e5bbb894-6e16647f_0 is DEAD
2025-10-10T14:33:48.147642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a4d56-6f372837-e5bbb894-6e16647f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:48.147651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a4d56-6f372837-e5bbb894-6e16647f_0] Write session will restart in 0.009085s
2025-10-10T14:33:48.147675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a4d56-6f372837-e5bbb894-6e16647f_0] Write session: Do CDS request
2025-10-10T14:33:48.147684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a4d56-6f372837-e5bbb894-6e16647f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:48.157858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350a4d56-6f372837-e5bbb894-6e16647f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.157973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:48.157990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1112
2025-10-10T14:33:48.158110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.158155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:48.158165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:48.158170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:48.158628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1112 sessionId:  describe result for acl check
2025-10-10T14:33:48.158684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:48.158688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:48.158690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:48.158697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601266044208518:4095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:48.159308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601266044208518:4095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:48.160810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:48.161926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601266044208518:4095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:48.162841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:48.163019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:48.163029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:48.163037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:48.163079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:48.163112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601265261986326:7063]
2025-10-10T14:33:48.163506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:48.163767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:48.163824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:48.164067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:48.164112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.164118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.164118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.164119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.164120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.164120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.164121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.164122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.164122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.164123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.164124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.164124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.164125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.164129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.164137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.164140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.164142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.164144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.164147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.164149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.164151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.164153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.164155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.164158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.164160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.164162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.164167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.164173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.164178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.164181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.164186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.164189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.164192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.164195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.164198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.164201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.164204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.164207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.164209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.164213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.164215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.164218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.164221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.164224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.164227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.164239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.164241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.164244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.164247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.164250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.164252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.164255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.164278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:48.164837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601266044208518:4095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:48.164853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601266044208518:4095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:48.164856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601266044208518:4095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:48.164864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:48.166652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:48.167311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:48.167330Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:48.167333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:48.167337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:48.167343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1111 [2:7559601265261986326:7063]
2025-10-10T14:33:48.167355Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:48.167374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:48.167378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.167382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.167384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.167401Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:48.167415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:48.167423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:48.167484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.167492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.167495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.167498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:48.167582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:48.167590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.167604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.167620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.167640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:48.167669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208565:4095], now have 1 active actors on pipe
2025-10-10T14:33:48.167677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208376:2438], now have 1 active actors on pipe
2025-10-10T14:33:48.167685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601265261986321:7063]
2025-10-10T14:33:48.167688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601265261986321:7063]
2025-10-10T14:33:48.167690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601265261986321:7063]
2025-10-10T14:33:48.167706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:48.167722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:48.167726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:48.167728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:48.167716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1111
2025-10-10T14:33:48.167730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:48.167716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1111
2025-10-10T14:33:48.167758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:48.167761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:48.167805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.167817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.167838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601265261986321:7063]
2025-10-10T14:33:48.167852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:48.167863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:48.167885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:48.167898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.167908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.167910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:48.167923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.167938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:48.167968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.168146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.168158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.168179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.168304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1112 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0
2025-10-10T14:33:48.168721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a4d56-6f372837-e5bbb894-6e16647f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:48.171556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0] Write session: try to update token
2025-10-10T14:33:48.171574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:48.186010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId: src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:48.187418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:48.187445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:48.187449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:48.187452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:48.187462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601265261986321:7063]
2025-10-10T14:33:48.187466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601265261986321:7063]
2025-10-10T14:33:48.187471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601265261986321:7063]
2025-10-10T14:33:48.187527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:48.187531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:48.187538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:48.187540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.187542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:48.187543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:48.187685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:48.188651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:48.247252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601266044208572:4179]
2025-10-10T14:33:48.247521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1111, pipe: [1:7559601266044208572:4179]
2025-10-10T14:33:48.298912Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:48.299321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.299339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.299387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208572:4179], now have 1 active actors on pipe
2025-10-10T14:33:48.299609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:48.299624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:48.299651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:48.299699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1112 reason: error at write: Disconnected sessionId: src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0
2025-10-10T14:33:48.299704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601266044208572:4179]
2025-10-10T14:33:48.299766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:48.299948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1112 sessionId: src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0 is DEAD
2025-10-10T14:33:48.300148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:48.300158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0] Write session will restart in 0.007198s
2025-10-10T14:33:48.300182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0] Write session: Do CDS request
2025-10-10T14:33:48.300188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:48.308926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.308990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:48.309005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1113
2025-10-10T14:33:48.309177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.309215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:48.309228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:48.309232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:48.309718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1113 sessionId:  describe result for acl check
2025-10-10T14:33:48.309757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:48.309763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:48.309765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:48.309771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601266044208669:4091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:48.310297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601266044208669:4091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:48.312805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601266044208669:4091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:48.313185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:48.315367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:48.315505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601266044208669:4091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:48.315518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601266044208669:4091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:48.315521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601266044208669:4091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:48.315529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:48.315582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:48.315594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:48.315606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:48.315664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:48.315706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601265261986519:7065]
2025-10-10T14:33:48.316309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:48.316587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:48.316635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:48.316945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:48.317007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.317013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.317014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.317016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.317017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.317018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.317019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.317021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.317022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.317023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.317024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.317025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.317027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.317032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.317046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.317050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.317055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.317059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.317063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.317067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.317071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.317075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.317079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.317083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.317087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.317091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.317098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.317106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.317118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.317124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.317133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.317138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.317149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.317154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.317159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.317165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.317169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.317178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.317184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.317194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.317199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.317203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.317207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.317219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.317228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.317233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.317242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.317247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.317255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.317260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.317265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.317270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.317311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:48.319727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:48.320448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:48.320464Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:48.320466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:48.320470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:48.320477Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1112 [2:7559601265261986519:7065]
2025-10-10T14:33:48.320490Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:48.320508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:48.320517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.320521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.320524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.320542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:48.320555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:48.320568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:48.320637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.320648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.320651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.320654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:48.320722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:48.320730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.320744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.320756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.320779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:48.320806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208574:2438], now have 1 active actors on pipe
2025-10-10T14:33:48.320818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208760:4091], now have 1 active actors on pipe
2025-10-10T14:33:48.320826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601265261986514:7065]
2025-10-10T14:33:48.320828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601265261986514:7065]
2025-10-10T14:33:48.320830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601265261986514:7065]
2025-10-10T14:33:48.320844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:48.320857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:48.320859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:48.320861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:48.320863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:48.320875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:48.320879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:48.320911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601265261986514:7065]
2025-10-10T14:33:48.320919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:48.320921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:48.320878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1112
2025-10-10T14:33:48.321034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1112
2025-10-10T14:33:48.321070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.321081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.321115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:48.321127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.321131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.321138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:48.321151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.321166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:48.321186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.321355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.321363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.321378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.321500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1113 partition: 0 MaxSeqNo: 40 sessionId: src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0
2025-10-10T14:33:48.321948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d379bb3-4f85b728-b6ff5e74-88e8bab6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:48.324698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0] Write session: try to update token
2025-10-10T14:33:48.324718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:48.332014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:48.332030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:48.332045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601265261986514:7065]
2025-10-10T14:33:48.332097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:48.332264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:48.332411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:48.332550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:48.332690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:48.332876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:48.332921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:48.332996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:48.338821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId: src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:48.341378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:48.341761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.341785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.341837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:48.341934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:48.349511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:48.349529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:48.349531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:48.349533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:48.349544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601265261986514:7065]
2025-10-10T14:33:48.349548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601265261986514:7065]
2025-10-10T14:33:48.349552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601265261986514:7065]
2025-10-10T14:33:48.349598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:48.349605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.349607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:48.349608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:48.349615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:48.349619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:48.349736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:48.399789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601266044208771:4179]
2025-10-10T14:33:48.400076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1112, pipe: [1:7559601266044208771:4179]
2025-10-10T14:33:48.457317Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:48.465137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.465178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.465380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.465457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.465525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.465596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.465642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.465654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.465725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.465793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.465861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.465931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.465978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.465989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.466062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.466129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.466194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.466258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.466303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.466306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.466375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.466444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.466510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.466587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.466635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.466643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.466712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.466779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.466847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.466914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.466959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.466966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.467039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.467102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.467175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.467242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.467290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.467303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.467378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.467443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.467507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.467577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.467624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.467633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.467704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.467763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.467826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.467893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.467937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.467944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.468010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.468077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.468146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.468211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.468259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.468266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.468336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:48.468398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:48.468464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:48.468526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:48.468579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:48.468586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:48.468651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208771:4179], now have 1 active actors on pipe
2025-10-10T14:33:48.468893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:48.468986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:48.468995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:48.469038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1113 reason: error at write: Disconnected sessionId: src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0
2025-10-10T14:33:48.469226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601266044208771:4179]
2025-10-10T14:33:48.469299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1113 sessionId: src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0 is DEAD
2025-10-10T14:33:48.469485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:48.469497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0] Write session will restart in 0.008071s
2025-10-10T14:33:48.469530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0] Write session: Do CDS request
2025-10-10T14:33:48.469535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:48.469919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:48.478911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.479010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:48.479028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1114
2025-10-10T14:33:48.479157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.479195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:48.479200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:48.479204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:48.479701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1114 sessionId:  describe result for acl check
2025-10-10T14:33:48.479744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:48.479752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:48.479754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:48.479760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601266044208870:4084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:48.480338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601266044208870:4084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:48.483001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601266044208870:4084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:48.483727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:48.485947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:48.486181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:48.486196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:48.486209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:48.486266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:48.486285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601266044208870:4084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:48.486302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601266044208870:4084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:48.486306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601266044208870:4084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:48.486316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:48.486312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601265261986725:7068]
2025-10-10T14:33:48.486952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:48.487273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:48.487331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:48.487686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:48.487748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.487754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.487756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.487757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.487758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.487759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.487761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.487762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.487763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.487765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.487766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.487767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.487769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.487775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.487788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.487793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.487797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.487801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.487805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.487809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.487813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.487817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.487822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.487827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.487831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.487835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.487842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.487864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.487876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.487881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.487890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.487896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.487905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.487910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.487920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.487926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.487935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.487940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.487945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.487954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.487959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.487970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.487974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.487980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.487985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.487990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.487995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.488000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.488005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.488010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.488018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.488024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.488063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:48.490576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:48.491036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:48.491052Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:48.491054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:48.491058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:48.491065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1113 [2:7559601265261986725:7068]
2025-10-10T14:33:48.491077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:48.491094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:48.491097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.491101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.491103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.491127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:48.491141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:48.491150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:48.491206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.491213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.491215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.491218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:48.491292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:48.491299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.491312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.491328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.491362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:48.491387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208973:4084], now have 1 active actors on pipe
2025-10-10T14:33:48.491395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208785:2438], now have 1 active actors on pipe
2025-10-10T14:33:48.491402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601265261986720:7068]
2025-10-10T14:33:48.491408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601265261986720:7068]
2025-10-10T14:33:48.491411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601265261986720:7068]
2025-10-10T14:33:48.491423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:48.491437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:48.491437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:48.491440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:48.491442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:48.491455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:48.491458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:48.491438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1113
2025-10-10T14:33:48.491440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1113
2025-10-10T14:33:48.491487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601265261986720:7068]
2025-10-10T14:33:48.491494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:48.491496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:48.491523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.491532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.491569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:48.491581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.491585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.491587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:48.491598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.491612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:48.491636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.491834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.491848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.491873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.492105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1114 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0
2025-10-10T14:33:48.492530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc2c8fc-6f6a39c2-1e1f8ae1-9ab8dcc9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:48.495383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0] Write session: try to update token
2025-10-10T14:33:48.495403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:48.511502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:48.511517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:48.511520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:48.511522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:48.511530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601265261986720:7068]
2025-10-10T14:33:48.511537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601265261986720:7068]
2025-10-10T14:33:48.511541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601265261986720:7068]
2025-10-10T14:33:48.511588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:48.511595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:48.511595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:48.511598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:48.511603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.511605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:48.511741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:48.512121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId: src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:48.514902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:48.569311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601266044208984:4179]
2025-10-10T14:33:48.569631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1113, pipe: [1:7559601266044208984:4179]
2025-10-10T14:33:48.624128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:48.624717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.624736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.624782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208984:4179], now have 1 active actors on pipe
2025-10-10T14:33:48.625030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:48.625024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601266044208984:4179]
2025-10-10T14:33:48.625042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:48.625048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:48.625054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:48.625115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1114 reason: error at write: Disconnected sessionId: src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0
2025-10-10T14:33:48.625389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1114 sessionId: src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0 is DEAD
2025-10-10T14:33:48.625576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:48.625587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0] Write session will restart in 0.006288s
2025-10-10T14:33:48.625612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0] Write session: Do CDS request
2025-10-10T14:33:48.625617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:48.632994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.633130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:48.633148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1115
2025-10-10T14:33:48.633289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.633352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:48.633364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:48.633368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:48.633866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1115 sessionId:  describe result for acl check
2025-10-10T14:33:48.633903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:48.633908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:48.633910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:48.633916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601266044209015:4077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:48.634471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601266044209015:4077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:48.637297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601266044209015:4077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:48.640060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601266044209015:4077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:48.640074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601266044209015:4077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:48.640078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601266044209015:4077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:48.640087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:48.640978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:48.643061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:48.643315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:48.643326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:48.643349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:48.643410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:48.643455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601265261986923:7070]
2025-10-10T14:33:48.644064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:48.644401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:48.644452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:48.644770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:48.644825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.644830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.644832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.644833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.644834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.644836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.644837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.644838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.644839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.644840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.644841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.644843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.644844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.644849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.644864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.644867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.644871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.644875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.644878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.644882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.644885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.644889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.644893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.644897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.644900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.644904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.644911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.644920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.644926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.644930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.644935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.644939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.644943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.644960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.644970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.644974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.644978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.644983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.644987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.644991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.644999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.645004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.645009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.645015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.645019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.645024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.645030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.645036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.645039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.645044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.645051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.645055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.645091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:48.647688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:48.648712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:48.648734Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:48.648738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:48.648742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:48.648750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1114 [2:7559601265261986923:7070]
2025-10-10T14:33:48.648773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:48.648809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:48.648822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.648828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.648831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.648858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:48.648876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:48.648886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:48.648987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.649003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.649006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.649010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:48.649134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:48.649149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.649167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.649179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.649199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:48.649233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044208990:2438], now have 1 active actors on pipe
2025-10-10T14:33:48.649251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044209177:4077], now have 1 active actors on pipe
2025-10-10T14:33:48.649262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601265261986918:7070]
2025-10-10T14:33:48.649275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601265261986918:7070]
2025-10-10T14:33:48.649278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601265261986918:7070]
2025-10-10T14:33:48.649254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1114
2025-10-10T14:33:48.649292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:48.649256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1114
2025-10-10T14:33:48.649304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:48.649307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:48.649309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:48.649321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:48.649362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:48.649372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:48.649408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.649439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.649515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601265261986918:7070]
2025-10-10T14:33:48.649539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:48.649573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:48.649599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.649606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.649609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:48.649611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:48.649628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.649647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:48.649718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.649953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.649975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.650009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.650106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1115 partition: 0 MaxSeqNo: 40 sessionId: src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0
2025-10-10T14:33:48.650641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef06e3f1-d46bda12-2c1c86a7-cc678b39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:48.653760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0] Write session: try to update token
2025-10-10T14:33:48.653781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:48.668105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId: src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:48.669595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:48.669615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:48.669618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:48.669620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:48.669631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601265261986918:7070]
2025-10-10T14:33:48.669635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601265261986918:7070]
2025-10-10T14:33:48.669640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601265261986918:7070]
2025-10-10T14:33:48.669690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:48.669700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:48.669707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.669707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:48.669709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:48.669716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:48.669851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:48.671109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:48.724951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601266044209193:4179]
2025-10-10T14:33:48.725300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1114, pipe: [1:7559601266044209193:4179]
2025-10-10T14:33:48.782956Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:48.783244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.783267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.783315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044209193:4179], now have 1 active actors on pipe
2025-10-10T14:33:48.783582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:48.783602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:48.783650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:48.783660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601266044209193:4179]
2025-10-10T14:33:48.783662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:48.783728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1115 reason: error at write: Disconnected sessionId: src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0
2025-10-10T14:33:48.783947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1115 sessionId: src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0 is DEAD
2025-10-10T14:33:48.784077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:48.784087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0] Write session will restart in 0.006770s
2025-10-10T14:33:48.784107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0] Write session: Do CDS request
2025-10-10T14:33:48.784114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:48.791895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.791959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:48.791975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1116
2025-10-10T14:33:48.792138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.792172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:48.792183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:48.792187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:48.792662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1116 sessionId:  describe result for acl check
2025-10-10T14:33:48.792713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:48.792721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:48.792725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:48.792731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601266044209237:4072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:48.793387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601266044209237:4072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:48.795700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601266044209237:4072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:48.798424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:48.800402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:48.800579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601266044209237:4072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:48.800592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601266044209237:4072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:48.800610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:48.800595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601266044209237:4072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:48.800604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:48.800624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:48.800638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:48.800700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:48.800760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601265261987118:7073]
2025-10-10T14:33:48.801411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:48.801722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:48.801772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:48.802095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:48.802150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.802156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.802157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.802158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.802160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.802161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.802162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.802164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.802165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.802166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.802168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.802169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.802170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.802175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.802189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.802193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.802197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.802201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.802205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.802209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.802213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.802217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.802222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.802226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.802230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.802234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.802242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.802250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.802257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.802263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.802267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.802273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.802277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.802282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.802287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.802292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.802303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.802308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.802313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.802318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.802326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.802331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.802336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.802341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.802345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.802350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.802357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.802367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.802371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.802382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.802386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.802391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.802435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:48.804776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:48.805324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:48.805352Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:48.805354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:48.805357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:48.805363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1115 [2:7559601265261987118:7073]
2025-10-10T14:33:48.805374Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:48.805390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:48.805393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.805397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.805400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.805430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:48.805442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:48.805449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:48.805511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.805518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.805520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.805522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:48.805590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:48.805598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.805610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.805625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.805645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:48.805671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044209384:4072], now have 1 active actors on pipe
2025-10-10T14:33:48.805679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044209194:2438], now have 1 active actors on pipe
2025-10-10T14:33:48.805686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601265261987113:7073]
2025-10-10T14:33:48.805695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601265261987113:7073]
2025-10-10T14:33:48.805697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601265261987113:7073]
2025-10-10T14:33:48.805714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:48.805733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:48.805744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:48.805748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:48.805750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:48.805754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:48.805725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1115
2025-10-10T14:33:48.805757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:48.805726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1115
2025-10-10T14:33:48.805792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.805803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.805817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601265261987113:7073]
2025-10-10T14:33:48.805825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:48.805837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:48.805860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:48.805874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.805878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.805881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:48.805892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.805909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:48.805935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.806107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.806114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.806129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.806227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1116 partition: 0 MaxSeqNo: 40 sessionId: src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0
2025-10-10T14:33:48.806647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08921a0-825cf4dd-2a31a91e-87e7acf0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:48.809453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0] Write session: try to update token
2025-10-10T14:33:48.809473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:48.823645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId: src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:48.825464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:48.825482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:48.825486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:48.825488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:48.825498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601265261987113:7073]
2025-10-10T14:33:48.825502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601265261987113:7073]
2025-10-10T14:33:48.825506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601265261987113:7073]
2025-10-10T14:33:48.825551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:48.825556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:48.825565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.825566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:48.825568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:48.825571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:48.825720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:48.826329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:48.883658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601266044209395:4179]
2025-10-10T14:33:48.883929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1115, pipe: [1:7559601266044209395:4179]
2025-10-10T14:33:48.935727Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:48.936162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.936178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.936225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044209395:4179], now have 1 active actors on pipe
2025-10-10T14:33:48.936453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:48.936480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:48.936480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601266044209395:4179]
2025-10-10T14:33:48.936496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:48.936501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:48.936573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1116 reason: error at write: Disconnected sessionId: src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0
2025-10-10T14:33:48.936819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1116 sessionId: src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0 is DEAD
2025-10-10T14:33:48.936997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:48.937010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0] Write session will restart in 0.009613s
2025-10-10T14:33:48.937034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0] Write session: Do CDS request
2025-10-10T14:33:48.937041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:48.947951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.948026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:48.948042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1117
2025-10-10T14:33:48.948216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:48.948272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:48.948281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:48.948285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:48.948697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1117 sessionId:  describe result for acl check
2025-10-10T14:33:48.948735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:48.948742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:48.948744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:48.948751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601266044209519:4069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:48.949308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601266044209519:4069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:48.951903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:48.952355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601266044209519:4069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:48.954110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:48.954341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:48.954352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:48.954376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:48.954435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:48.954491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601265261987315:7075]
2025-10-10T14:33:48.955007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:48.955016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601266044209519:4069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:48.955031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601266044209519:4069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:48.955035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601266044209519:4069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:48.955043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:48.955259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:48.955300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:48.955537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:48.955592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.955597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.955598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.955598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.955599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.955600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.955600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.955601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.955602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.955603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.955603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.955604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.955605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.955608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.955617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.955619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.955621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.955623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.955625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.955627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.955629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.955631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.955633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.955635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.955637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.955639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.955644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.955650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:48.955654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.955658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:48.955660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.955663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:48.955666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.955670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:48.955673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.955676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:48.955678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.955681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:48.955684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.955687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:48.955689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.955692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:48.955695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.955702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:48.955704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.955708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:48.955711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.955714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.955716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.955719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.955724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.955727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.955748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:48.957957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:48.958448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:48.958458Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:48.958459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:48.958462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:48.958467Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1116 [2:7559601265261987315:7075]
2025-10-10T14:33:48.958475Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:48.958488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:48.958493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.958495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.958496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.958509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:48.958518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:48.958528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:48.958575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.958580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.958582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.958583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:48.958648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:48.958655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.958662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:48.958670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:48.958683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:48.958709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044209586:4069], now have 1 active actors on pipe
2025-10-10T14:33:48.958717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601266044209396:2438], now have 1 active actors on pipe
2025-10-10T14:33:48.958723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601265261987310:7075]
2025-10-10T14:33:48.958725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601265261987310:7075]
2025-10-10T14:33:48.958726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601265261987310:7075]
2025-10-10T14:33:48.958735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:48.958745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:48.958754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:48.958755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:48.958766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1116
2025-10-10T14:33:48.958757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:48.958771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1116
2025-10-10T14:33:48.958758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:48.958760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:48.958774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601265261987310:7075]
2025-10-10T14:33:48.958777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:48.958783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:48.958817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.958822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.958857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:48.958869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:48.958872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:48.958874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:48.958884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:48.958900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:48.958918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.959054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:48.959060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:48.959072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:48.959153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1117 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0
2025-10-10T14:33:48.959551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c485eb63-d337ce2-37f2f9a-ee91e3a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:48.962145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0] Write session: try to update token
2025-10-10T14:33:48.962160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:48.975738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId: src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:48.978343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:48.978366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:48.978370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:48.978372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:48.978382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601265261987310:7075]
2025-10-10T14:33:48.978386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601265261987310:7075]
2025-10-10T14:33:48.978394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601265261987310:7075]
2025-10-10T14:33:48.978442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:48.978444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:48.978451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:48.978454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:48.978454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:48.978456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:48.978456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:48.978605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:49.036722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601270339176894:4179]
2025-10-10T14:33:49.036917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1116, pipe: [1:7559601270339176894:4179]
2025-10-10T14:33:49.089106Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:49.089739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.089758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.089805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339176894:4179], now have 1 active actors on pipe
2025-10-10T14:33:49.090001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:49.090097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601270339176894:4179]
2025-10-10T14:33:49.090132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:49.090212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1117 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0
2025-10-10T14:33:49.090448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1117 sessionId: src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0 is DEAD
2025-10-10T14:33:49.090664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:49.090675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0] Write session will restart in 0.009980s
2025-10-10T14:33:49.090698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0] Write session: Do CDS request
2025-10-10T14:33:49.090704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:49.090730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:49.101960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.102040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:49.102057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1118
2025-10-10T14:33:49.102251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.102305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:49.102316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:49.102327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:49.102757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1118 sessionId:  describe result for acl check
2025-10-10T14:33:49.102799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:49.102806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:49.102808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:49.102815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601270339177081:4049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:49.103375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601270339177081:4049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:49.103788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:49.105297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601270339177081:4049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:49.106085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:49.106301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:49.106312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:49.106324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:49.106377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:49.106435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601269556954848:7084]
2025-10-10T14:33:49.106906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:49.107168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:49.107200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:49.107425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:49.107477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.107487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.107488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.107489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.107490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.107492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.107493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.107494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.107495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.107496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.107497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.107499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.107500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.107506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.107519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.107523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.107527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.107532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.107536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.107540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.107543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.107548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.107552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.107556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.107559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.107563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.107572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.107581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.107589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.107595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.107600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.107604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.107611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.107616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.107622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.107627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.107640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.107645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.107657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.107662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.107667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.107677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.107682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.107687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.107691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.107697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.107701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.107705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.107708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.107712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.107714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.107717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.107740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:49.108070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601270339177081:4049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:49.108084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601270339177081:4049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:49.108088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601270339177081:4049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:49.108096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:49.110096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:49.110411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:49.110424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:49.110426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:49.110430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:49.110436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1117 [2:7559601269556954848:7084]
2025-10-10T14:33:49.110449Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:49.110465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:49.110472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.110476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.110479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.110495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:49.110506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:49.110516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:49.110575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.110582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.110584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.110587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:49.110752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1117
2025-10-10T14:33:49.110778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1117
2025-10-10T14:33:49.110848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:49.110857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.110869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.110882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.110905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:49.110933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339176908:2438], now have 1 active actors on pipe
2025-10-10T14:33:49.110941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177114:4049], now have 1 active actors on pipe
2025-10-10T14:33:49.110962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.110974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.110993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601269556954843:7084]
2025-10-10T14:33:49.110995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601269556954843:7084]
2025-10-10T14:33:49.110997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601269556954843:7084]
2025-10-10T14:33:49.111010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:49.111024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:49.111029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:49.111033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:49.111035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:49.111045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:49.111049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:49.111071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:49.111083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.111087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.111089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:49.111100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.111112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:49.111142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601269556954843:7084]
2025-10-10T14:33:49.111154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:49.111170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.111174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:49.111310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.111319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.111335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.111436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1118 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0
2025-10-10T14:33:49.111866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e7bab3-471fa19d-78893ce1-9b5f829b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:49.114458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0] Write session: try to update token
2025-10-10T14:33:49.114477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:49.128481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:49.128502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:49.128517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601269556954843:7084]
2025-10-10T14:33:49.128572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:49.128574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:49.128755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:49.128904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:49.128998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId: src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:49.129053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:49.129220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:49.129458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:49.129502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:49.131548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:49.131765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.131783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.131822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:49.131906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:49.140508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:49.140527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:49.140530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:49.140532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:49.140543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601269556954843:7084]
2025-10-10T14:33:49.140546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601269556954843:7084]
2025-10-10T14:33:49.140550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601269556954843:7084]
2025-10-10T14:33:49.140595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:49.140597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:49.140603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:49.140603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.140606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:49.140607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:49.140741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:49.190351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601270339177123:4179]
2025-10-10T14:33:49.190668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1117, pipe: [1:7559601270339177123:4179]
2025-10-10T14:33:49.252649Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:49.259689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.259715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.259870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.259932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.259990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.260064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.260108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.260116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.260180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.260246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.260309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.260382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.260424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.260432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.260492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.260555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.260616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.260672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.260712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.260718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.260782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.260844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.260902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.260957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.260998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.261003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.261073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.261131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.261198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.261255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.261301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.261310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.261391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.261461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.261518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.261582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.261630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.261640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.261703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.261759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.261825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.261889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.261931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.261940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.262004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.262066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.262129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.262190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.262232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.262239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.262307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.262374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.262436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.262500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.262542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.262549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.262614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:49.262674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:49.262738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:49.262797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:49.262845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:49.262848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:49.262895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177123:4179], now have 1 active actors on pipe
2025-10-10T14:33:49.263068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:49.263072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:49.263076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:49.263107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1118 reason: error at write: Disconnected sessionId: src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0
2025-10-10T14:33:49.263142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601270339177123:4179]
2025-10-10T14:33:49.263343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1118 sessionId: src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0 is DEAD
2025-10-10T14:33:49.263512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:49.263523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0] Write session will restart in 0.007441s
2025-10-10T14:33:49.263566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0] Write session: Do CDS request
2025-10-10T14:33:49.263573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:49.263890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:49.271860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.271986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:49.271998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1119
2025-10-10T14:33:49.272094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.272141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:49.272154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:49.272162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:49.272576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1119 sessionId:  describe result for acl check
2025-10-10T14:33:49.272612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:49.272620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:49.272624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:49.272628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601270339177197:4045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:49.273181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601270339177197:4045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:49.275588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601270339177197:4045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:49.276780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:49.278803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:49.278985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:49.278996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:49.279007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:49.279056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:49.279095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601269556955048:7092]
2025-10-10T14:33:49.279097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601270339177197:4045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:49.279108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601270339177197:4045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:49.279110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601270339177197:4045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:49.279117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:49.279533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:49.279750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:49.279799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:49.280092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:49.280152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.280158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.280159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.280160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.280161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.280162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.280164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.280165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.280166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.280167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.280169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.280170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.280171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.280176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.280188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.280192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.280196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.280200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.280204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.280207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.280212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.280215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.280219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.280223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.280227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.280231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.280237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.280246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.280252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.280257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.280263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.280271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.280275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.280279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.280283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.280292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.280295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.280300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.280305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.280309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.280315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.280320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.280328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.280333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.280336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.280341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.280345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.280352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.280356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.280360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.280369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.280373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.280406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:49.282654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:49.283153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:49.283164Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:49.283166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:49.283170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:49.283175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1118 [2:7559601269556955048:7092]
2025-10-10T14:33:49.283186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:49.283202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:49.283205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.283208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.283210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.283225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:49.283232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:49.283239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:49.283295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.283302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.283304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.283307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:49.283369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:49.283377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.283386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.283402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.283424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:49.283450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177125:2438], now have 1 active actors on pipe
2025-10-10T14:33:49.283458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177316:4045], now have 1 active actors on pipe
2025-10-10T14:33:49.283465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601269556955043:7092]
2025-10-10T14:33:49.283468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601269556955043:7092]
2025-10-10T14:33:49.283470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601269556955043:7092]
2025-10-10T14:33:49.283483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:49.283495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:49.283505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:49.283508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:49.283509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:49.283515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:49.283518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:49.283485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1118
2025-10-10T14:33:49.283524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1118
2025-10-10T14:33:49.283544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601269556955043:7092]
2025-10-10T14:33:49.283552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:49.283556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:49.283567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.283572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.283620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60227d06-1af7613f-c1ac7555-ad05400e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:49.283631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.283637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.283639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:49.283649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.283660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:49.283681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.283848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.283856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.283870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.283964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1119 partition: 0 MaxSeqNo: 40 sessionId: src_id|60227d06-1af7613f-c1ac7555-ad05400e_0
2025-10-10T14:33:49.284353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc217b97-f24e1d6d-9c7eab35-3bc82504_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|60227d06-1af7613f-c1ac7555-ad05400e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:49.287174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60227d06-1af7613f-c1ac7555-ad05400e_0] Write session: try to update token
2025-10-10T14:33:49.287194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60227d06-1af7613f-c1ac7555-ad05400e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:49.301699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId: src_id|60227d06-1af7613f-c1ac7555-ad05400e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:49.302735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:49.302755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:49.302758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:49.302760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:49.302771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601269556955043:7092]
2025-10-10T14:33:49.302775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601269556955043:7092]
2025-10-10T14:33:49.302779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601269556955043:7092]
2025-10-10T14:33:49.302830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:49.302832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:49.302838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.302839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:49.302840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:49.302849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:49.302990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:49.304445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:49.363419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601270339177329:4179]
2025-10-10T14:33:49.363741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1118, pipe: [1:7559601270339177329:4179]
2025-10-10T14:33:49.414847Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:49.415235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.415255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.415302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177329:4179], now have 1 active actors on pipe
2025-10-10T14:33:49.415475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:49.415485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601270339177329:4179]
2025-10-10T14:33:49.415506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:49.415512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:49.415586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1119 reason: error at write: Disconnected sessionId: src_id|60227d06-1af7613f-c1ac7555-ad05400e_0
2025-10-10T14:33:49.415806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1119 sessionId: src_id|60227d06-1af7613f-c1ac7555-ad05400e_0 is DEAD
2025-10-10T14:33:49.415941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60227d06-1af7613f-c1ac7555-ad05400e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:49.415952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60227d06-1af7613f-c1ac7555-ad05400e_0] Write session will restart in 0.006344s
2025-10-10T14:33:49.415987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60227d06-1af7613f-c1ac7555-ad05400e_0] Write session: Do CDS request
2025-10-10T14:33:49.415993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60227d06-1af7613f-c1ac7555-ad05400e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:49.415796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:49.423978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60227d06-1af7613f-c1ac7555-ad05400e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.424050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:49.424065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1120
2025-10-10T14:33:49.424227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.424261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:49.424271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:49.424275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:49.424825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1120 sessionId:  describe result for acl check
2025-10-10T14:33:49.424862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:49.424868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:49.424870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:49.424876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601270339177395:4035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:49.425437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601270339177395:4035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:49.428527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601270339177395:4035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:49.430016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:49.431965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:49.432165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:49.432177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:49.432202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:49.432253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:49.432277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601270339177395:4035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:49.432291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601270339177395:4035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:49.432295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601269556955261:7095]
2025-10-10T14:33:49.432294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601270339177395:4035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:49.432302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:49.432762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:49.433028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:49.433059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:49.433292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:49.433356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.433363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.433364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.433365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.433366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.433367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.433367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.433368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.433369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.433369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.433370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.433371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.433371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.433375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.433384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.433386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.433389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.433391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.433404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.433407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.433411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.433415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.433419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.433422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.433426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.433429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.433437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.433445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.433451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.433457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.433464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.433467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.433470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.433473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.433476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.433479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.433481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.433485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.433487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.433490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.433494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.433497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.433499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.433502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.433505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.433508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.433510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.433513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.433519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.433523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.433526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.433529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.433556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:49.435776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:49.436069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:49.436078Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:49.436080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:49.436083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:49.436088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1119 [2:7559601269556955261:7095]
2025-10-10T14:33:49.436096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:49.436109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:49.436111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.436115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.436118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.436134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:49.436146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:49.436155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:49.436205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.436210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.436212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.436214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:49.436264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:49.436270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.436277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.436291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.436309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:49.436335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177535:4035], now have 1 active actors on pipe
2025-10-10T14:33:49.436344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177342:2438], now have 1 active actors on pipe
2025-10-10T14:33:49.436351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601269556955256:7095]
2025-10-10T14:33:49.436354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601269556955256:7095]
2025-10-10T14:33:49.436356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601269556955256:7095]
2025-10-10T14:33:49.436370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:49.436384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:49.436390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:49.436393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:49.436395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:49.436399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:49.436401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:49.436392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1119
2025-10-10T14:33:49.436424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601269556955256:7095]
2025-10-10T14:33:49.436427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:49.436401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1119
2025-10-10T14:33:49.436429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:49.436454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.436465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.436501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:49.436513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.436518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.436520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:49.436532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.436547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:49.436569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.436730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.436744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.436767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.436886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1120 partition: 0 MaxSeqNo: 40 sessionId: src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0
2025-10-10T14:33:49.437326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60227d06-1af7613f-c1ac7555-ad05400e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:49.440115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0] Write session: try to update token
2025-10-10T14:33:49.440135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:49.454747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId: src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:49.456730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:49.456756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:49.456760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:49.456763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:49.456772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601269556955256:7095]
2025-10-10T14:33:49.456777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601269556955256:7095]
2025-10-10T14:33:49.456781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601269556955256:7095]
2025-10-10T14:33:49.456834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:49.456842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:49.456847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.456850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:49.456850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:49.456854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:49.456989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:49.458271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:49.515456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601270339177547:4179]
2025-10-10T14:33:49.515747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1119, pipe: [1:7559601270339177547:4179]
2025-10-10T14:33:49.574040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:49.574705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.574725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.574775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177547:4179], now have 1 active actors on pipe
2025-10-10T14:33:49.575029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:49.575051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:49.575066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:49.575065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601270339177547:4179]
2025-10-10T14:33:49.575088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:49.575155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1120 reason: error at write: Disconnected sessionId: src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0
2025-10-10T14:33:49.575399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1120 sessionId: src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0 is DEAD
2025-10-10T14:33:49.575582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:49.575594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0] Write session will restart in 0.005312s
2025-10-10T14:33:49.575633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0] Write session: Do CDS request
2025-10-10T14:33:49.575642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:49.581879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.581978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:49.582004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1121
2025-10-10T14:33:49.582129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.582167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:49.582178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:49.582181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:49.582748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1121 sessionId:  describe result for acl check
2025-10-10T14:33:49.582792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:49.582794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:49.582796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:49.582802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601270339177572:4026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:49.583359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601270339177572:4026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:49.585998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601270339177572:4026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:49.588952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601270339177572:4026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:49.588967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601270339177572:4026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:49.588971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601270339177572:4026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:49.588980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:49.590159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:49.592307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:49.592526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:49.592538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:49.592554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:49.592622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:49.592677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601269556955463:7097]
2025-10-10T14:33:49.593324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:49.593748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:49.593809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:49.594148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:49.594244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.594253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.594255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.594256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.594257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.594258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.594260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.594261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.594262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.594264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.594265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.594266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.594267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.594273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.594286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.594291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.594295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.594298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.594302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.594306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.594310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.594314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.594319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.594323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.594327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.594332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.594342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.594359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.594371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.594377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.594387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.594393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.594398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.594403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.594411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.594421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.594426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.594436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.594441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.594446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.594456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.594461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.594471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.594477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.594486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.594491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.594496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.594502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.594510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.594516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.594521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.594533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.594574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:49.596911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:49.597404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:49.597420Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:49.597423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:49.597428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:49.597435Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1120 [2:7559601269556955463:7097]
2025-10-10T14:33:49.597448Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:49.597466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:49.597474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.597478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.597480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.597497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:49.597511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:49.597523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:49.597581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.597590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.597593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.597595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:49.597667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:49.597682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.597695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.597709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.597728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:49.597749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177743:4026], now have 1 active actors on pipe
2025-10-10T14:33:49.597759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177548:2438], now have 1 active actors on pipe
2025-10-10T14:33:49.597767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601269556955458:7097]
2025-10-10T14:33:49.597775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601269556955458:7097]
2025-10-10T14:33:49.597778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601269556955458:7097]
2025-10-10T14:33:49.597791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:49.597802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:49.597810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:49.597811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:49.597812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:49.597828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:49.597831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:49.597855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601269556955458:7097]
2025-10-10T14:33:49.597865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:49.597829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1120
2025-10-10T14:33:49.597871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1120
2025-10-10T14:33:49.597888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:49.598128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.598146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.598192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dba3375-f734a416-a6af4c38-931b92e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:49.598209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.598213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.598216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:49.598229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.598242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:49.598266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.598447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.598458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.598476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.598597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1121 partition: 0 MaxSeqNo: 40 sessionId: src_id|7dba3375-f734a416-a6af4c38-931b92e9_0
2025-10-10T14:33:49.599031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8f14d05-1ccada27-58bc8529-41f8a98e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7dba3375-f734a416-a6af4c38-931b92e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:49.601687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dba3375-f734a416-a6af4c38-931b92e9_0] Write session: try to update token
2025-10-10T14:33:49.601705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dba3375-f734a416-a6af4c38-931b92e9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:49.615758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId: src_id|7dba3375-f734a416-a6af4c38-931b92e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:49.617308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:49.617357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:49.617360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:49.617363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:49.617373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601269556955458:7097]
2025-10-10T14:33:49.617379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601269556955458:7097]
2025-10-10T14:33:49.617384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601269556955458:7097]
2025-10-10T14:33:49.617445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:49.617449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:49.617459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.617460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:49.617461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:49.617465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:49.617620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:49.618451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:49.675241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601270339177762:4179]
2025-10-10T14:33:49.675585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1120, pipe: [1:7559601270339177762:4179]
2025-10-10T14:33:49.736172Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:49.736645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.736664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.736708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177762:4179], now have 1 active actors on pipe
2025-10-10T14:33:49.736944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:49.736960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:49.736959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:49.737008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601270339177762:4179]
2025-10-10T14:33:49.737045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1121 reason: error at write: Disconnected sessionId: src_id|7dba3375-f734a416-a6af4c38-931b92e9_0
2025-10-10T14:33:49.737263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1121 sessionId: src_id|7dba3375-f734a416-a6af4c38-931b92e9_0 is DEAD
2025-10-10T14:33:49.737448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dba3375-f734a416-a6af4c38-931b92e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:49.737458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dba3375-f734a416-a6af4c38-931b92e9_0] Write session will restart in 0.008858s
2025-10-10T14:33:49.737453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:49.737482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dba3375-f734a416-a6af4c38-931b92e9_0] Write session: Do CDS request
2025-10-10T14:33:49.737491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dba3375-f734a416-a6af4c38-931b92e9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:49.747901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dba3375-f734a416-a6af4c38-931b92e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.747959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:49.747976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1122
2025-10-10T14:33:49.748106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.748142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:49.748152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:49.748156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:49.748592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1122 sessionId:  describe result for acl check
2025-10-10T14:33:49.748632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:49.748639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:49.748642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:49.748648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601270339177885:4023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:49.749231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601270339177885:4023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:49.751503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601270339177885:4023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:49.751957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:49.754067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:49.754309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:49.754321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:49.754335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:49.754386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601270339177885:4023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:49.754401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601270339177885:4023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:49.754405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601270339177885:4023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:49.754414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:49.754409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:49.754469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601269556955667:7100]
2025-10-10T14:33:49.755043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:49.755346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:49.755400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:49.755819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:49.755880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.755887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.755888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.755889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.755890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.755892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.755893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.755894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.755896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.755897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.755898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.755900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.755901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.755908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.755922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.755926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.755930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.755934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.755939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.755943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.755946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.755950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.755955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.755959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.755963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.755968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.755975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.755984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.755991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.756001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.756006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.756015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.756020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.756030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.756036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.756045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.756049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.756055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.756062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.756068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.756072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.756082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.756086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.756093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.756102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.756107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.756116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.756122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.756134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.756139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.756143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.756149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.756190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:49.758454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:49.759114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:49.759127Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:49.759130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:49.759133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:49.759140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1121 [2:7559601269556955667:7100]
2025-10-10T14:33:49.759152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:49.759175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:49.759178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.759181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.759184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.759201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:49.759213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:49.759228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:49.759290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.759297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.759300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.759302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:49.759373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:49.759382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.759395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.759409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.759429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:49.759455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177763:2438], now have 1 active actors on pipe
2025-10-10T14:33:49.759463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177958:4023], now have 1 active actors on pipe
2025-10-10T14:33:49.759471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601269556955662:7100]
2025-10-10T14:33:49.759474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601269556955662:7100]
2025-10-10T14:33:49.759476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601269556955662:7100]
2025-10-10T14:33:49.759490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:49.759504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:49.759512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:49.759521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:49.759522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:49.759523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:49.759525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:49.759506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1121
2025-10-10T14:33:49.759517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1121
2025-10-10T14:33:49.759548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601269556955662:7100]
2025-10-10T14:33:49.759556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:49.759558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:49.759573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.759584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.759636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:49.759649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.759653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.759660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:49.759671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.759686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:49.759708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.759895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.759904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.759919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.759997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1122 partition: 0 MaxSeqNo: 40 sessionId: src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0
2025-10-10T14:33:49.760373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dba3375-f734a416-a6af4c38-931b92e9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:49.763061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0] Write session: try to update token
2025-10-10T14:33:49.763082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:49.777151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId: src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:49.779103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:49.779123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:49.779127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:49.779129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:49.779139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601269556955662:7100]
2025-10-10T14:33:49.779144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601269556955662:7100]
2025-10-10T14:33:49.779148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601269556955662:7100]
2025-10-10T14:33:49.779195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:49.779200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:49.779207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:49.779209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.779212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:49.779212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:49.779346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:49.779950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:49.836994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601270339177970:4179]
2025-10-10T14:33:49.837292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1121, pipe: [1:7559601270339177970:4179]
2025-10-10T14:33:49.890554Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:49.890853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.890871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.890921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177970:4179], now have 1 active actors on pipe
2025-10-10T14:33:49.891148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:49.891194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:49.891209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:49.891276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1122 reason: error at write: Disconnected sessionId: src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0
2025-10-10T14:33:49.891501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601270339177970:4179]
2025-10-10T14:33:49.891535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1122 sessionId: src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0 is DEAD
2025-10-10T14:33:49.891545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:49.891704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:49.891713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0] Write session will restart in 0.009198s
2025-10-10T14:33:49.891739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0] Write session: Do CDS request
2025-10-10T14:33:49.891749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:49.901973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.905485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:49.905501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1123
2025-10-10T14:33:49.905644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:49.905676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:49.905682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:49.905686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:49.905931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:49.906129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1123 sessionId:  describe result for acl check
2025-10-10T14:33:49.906166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:49.906173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:49.906174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:49.906181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601270339178137:4017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:49.906735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601270339178137:4017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:49.908463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:49.908691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:49.908703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:49.908715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:49.908773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:49.908810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601269556955872:7102]
2025-10-10T14:33:49.909374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601270339178137:4017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:49.909451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:49.909778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:49.909833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:49.910148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:49.910212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.910219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.910220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.910221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.910223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.910224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.910225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.910226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.910228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.910229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.910230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.910232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.910233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.910238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.910252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.910256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.910260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.910264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.910269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.910272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.910277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.910290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.910295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.910299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.910303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.910306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.910315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.910324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:49.910330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.910336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:49.910349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.910359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:49.910364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.910369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:49.910380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.910386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:49.910394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.910400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:49.910404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.910409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:49.910413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.910418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:49.910423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.910429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:49.910434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.910439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:49.910444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.910453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.910457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.910462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.910479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.910488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.910528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:49.912990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:49.912971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601270339178137:4017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:49.912986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601270339178137:4017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:49.912989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601270339178137:4017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:49.912998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:49.913417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:49.913432Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:49.913435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:49.913438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:49.913446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1122 [2:7559601269556955872:7102]
2025-10-10T14:33:49.913460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:49.913480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:49.913488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.913492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.913495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.913512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:49.913519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:49.913528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:49.913595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.913602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.913604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.913607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:49.913673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:49.913681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.913693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:49.913699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:49.913709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:49.913729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339178171:4017], now have 1 active actors on pipe
2025-10-10T14:33:49.913732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339177971:2438], now have 1 active actors on pipe
2025-10-10T14:33:49.913740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601269556955867:7102]
2025-10-10T14:33:49.913743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601269556955867:7102]
2025-10-10T14:33:49.913745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601269556955867:7102]
2025-10-10T14:33:49.913757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:49.913778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:49.913787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:49.913791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:49.913793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:49.913799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:49.913802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:49.913827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601269556955867:7102]
2025-10-10T14:33:49.913837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:49.913872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:49.913899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1122
2025-10-10T14:33:49.913935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1122
2025-10-10T14:33:49.913972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.913983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.914028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:49.914041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:49.914049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:49.914052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:49.914064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:49.914080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:49.914098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.914273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:49.914281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:49.914297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:49.914412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1123 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0
2025-10-10T14:33:49.914822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce477946-8dd83d69-31b1ecaa-343d3919_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:49.917698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0] Write session: try to update token
2025-10-10T14:33:49.917721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:49.932699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId: src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:49.935098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:49.935124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:49.935128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:49.935130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:49.935140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601269556955867:7102]
2025-10-10T14:33:49.935147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601269556955867:7102]
2025-10-10T14:33:49.935152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601269556955867:7102]
2025-10-10T14:33:49.935197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:49.935201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:49.935205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:49.935207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:49.935215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:49.935217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:49.935364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:49.935535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:49.991592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601270339178179:4179]
2025-10-10T14:33:49.991912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1122, pipe: [1:7559601270339178179:4179]
2025-10-10T14:33:50.051326Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:50.051786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.051804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.051852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601270339178179:4179], now have 1 active actors on pipe
2025-10-10T14:33:50.052075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:50.052652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:50.052107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601270339178179:4179]
2025-10-10T14:33:50.052663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0] Write session will restart in 0.006519s
2025-10-10T14:33:50.052147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:50.052149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:50.052213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1123 reason: error at write: Disconnected sessionId: src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0
2025-10-10T14:33:50.052254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:50.052720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0] Write session: Do CDS request
2025-10-10T14:33:50.052731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:50.052458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1123 sessionId: src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0 is DEAD
2025-10-10T14:33:50.060851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.060889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:50.060903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1124
2025-10-10T14:33:50.061090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.061121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:50.061131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:50.061135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:50.061628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1124 sessionId:  describe result for acl check
2025-10-10T14:33:50.061667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:50.061668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:50.061670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:50.061676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601274634145491:4010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:50.062237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601274634145491:4010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:50.064894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601274634145491:4010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:50.067882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601274634145491:4010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:50.067897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601274634145491:4010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:50.067901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601274634145491:4010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:50.067910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:50.070230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:50.072465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:50.072721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:50.072733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:50.072747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:50.072809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:50.072853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601273851923374:7104]
2025-10-10T14:33:50.073530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:50.073834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:50.073895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:50.074258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:50.074317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.074323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.074325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.074326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.074327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.074328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.074329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.074331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.074332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.074333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.074334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.074336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.074337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.074344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.074357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.074362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.074366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.074371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.074376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.074380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.074384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.074388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.074394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.074398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.074402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.074406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.074414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.074429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.074440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.074447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.074453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.074459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.074468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.074474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.074483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.074489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.074497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.074503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.074510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.074515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.074522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.074527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.074533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.074538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.074543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.074550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.074556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.074564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.074570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.074577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.074584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.074597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.074642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:50.077270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:50.077678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:50.077689Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:50.077691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:50.077695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:50.077702Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1123 [2:7559601273851923374:7104]
2025-10-10T14:33:50.077719Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:50.077745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:50.077752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.077756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.077759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.077778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:50.077792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:50.077801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:50.077859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.077870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.077872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.077875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:50.077965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:50.077974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.077987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.078000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.078020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:50.078047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634145655:4010], now have 1 active actors on pipe
2025-10-10T14:33:50.078055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634145476:2438], now have 1 active actors on pipe
2025-10-10T14:33:50.078063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601273851923369:7104]
2025-10-10T14:33:50.078069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601273851923369:7104]
2025-10-10T14:33:50.078072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601273851923369:7104]
2025-10-10T14:33:50.078091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:50.078110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:50.078115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:50.078123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:50.078126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:50.078129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:50.078133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:50.078158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601273851923369:7104]
2025-10-10T14:33:50.078170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:50.078131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1123
2025-10-10T14:33:50.078134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1123
2025-10-10T14:33:50.078178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:50.078330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.078342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.078374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33ae1e81-14643fa6-23c1079-c8a52283_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:50.078386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.078390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.078392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:50.078405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.078421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:50.078436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.078656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.078668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.078685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.078793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1124 partition: 0 MaxSeqNo: 40 sessionId: src_id|33ae1e81-14643fa6-23c1079-c8a52283_0
2025-10-10T14:33:50.079274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c639d6-a83b1282-8f2c280-7a43ce6b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|33ae1e81-14643fa6-23c1079-c8a52283_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:50.082313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33ae1e81-14643fa6-23c1079-c8a52283_0] Write session: try to update token
2025-10-10T14:33:50.082335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33ae1e81-14643fa6-23c1079-c8a52283_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:50.096764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:50.096786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:50.096796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601273851923369:7104]
2025-10-10T14:33:50.096852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:50.097038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:50.097190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:50.097386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:50.097538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:50.097751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:50.097796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:50.098760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId: src_id|33ae1e81-14643fa6-23c1079-c8a52283_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:50.099483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:50.101365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:50.101558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.101579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.101615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:50.101712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:50.109178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:50.109201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:50.109204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:50.109206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:50.109217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601273851923369:7104]
2025-10-10T14:33:50.109221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601273851923369:7104]
2025-10-10T14:33:50.109225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601273851923369:7104]
2025-10-10T14:33:50.109276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:50.109278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:50.109285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.109288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:50.109291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:50.109295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:50.109516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:50.152400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601274634145709:4179]
2025-10-10T14:33:50.152662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1123, pipe: [1:7559601274634145709:4179]
2025-10-10T14:33:50.222279Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:50.230267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.230297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.230471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.230537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.230602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.230674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.230904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.230916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.230988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.231048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.231111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.231178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.231221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.231228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.231295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.231362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.231425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.231491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.231536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.231543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.231608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.231938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.232003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.232067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.232112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.232119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.232185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.232248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.232311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.232377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.232422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.232429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.232493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.232554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.232617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.232686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.232736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.232743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.232811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.232874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.232940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.233007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.233049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.233063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.233132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.233191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.233255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.233325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.233406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.233414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.233484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.233543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.233605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.233669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.233720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.233723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.233794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.233855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.233921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.233979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.234024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.234032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.234089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634145709:4179], now have 1 active actors on pipe
2025-10-10T14:33:50.234296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:50.234314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601274634145709:4179]
2025-10-10T14:33:50.234338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:50.234587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:50.234760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:50.234803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1124 reason: error at write: Disconnected sessionId: src_id|33ae1e81-14643fa6-23c1079-c8a52283_0
2025-10-10T14:33:50.235062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1124 sessionId: src_id|33ae1e81-14643fa6-23c1079-c8a52283_0 is DEAD
2025-10-10T14:33:50.235222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33ae1e81-14643fa6-23c1079-c8a52283_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:50.235230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33ae1e81-14643fa6-23c1079-c8a52283_0] Write session will restart in 0.007949s
2025-10-10T14:33:50.235256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33ae1e81-14643fa6-23c1079-c8a52283_0] Write session: Do CDS request
2025-10-10T14:33:50.235262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33ae1e81-14643fa6-23c1079-c8a52283_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:50.244926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33ae1e81-14643fa6-23c1079-c8a52283_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.245042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:50.245060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1125
2025-10-10T14:33:50.245213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.245250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:50.245262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:50.245266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:50.245770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1125 sessionId:  describe result for acl check
2025-10-10T14:33:50.245806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:50.245810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:50.245813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:50.245819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601274634145828:3984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:50.246471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601274634145828:3984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:50.248610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601274634145828:3984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:50.248842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:50.251022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:50.251257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:50.251269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:50.251292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:50.251335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601274634145828:3984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:50.251357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601274634145828:3984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:50.251361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601274634145828:3984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:50.251360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:50.251370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:50.251403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601273851923618:7119]
2025-10-10T14:33:50.252194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:50.252478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:50.252522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:50.252851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:50.252915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.252921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.252922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.252923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.252924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.252925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.252927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.252928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.252929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.252930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.252931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.252932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.252933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.252939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.252953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.252957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.252961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.252965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.252968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.252972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.252976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.252980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.252984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.252988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.252992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.252996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.253003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.253012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.253019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.253025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.253031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.253036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.253041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.253046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.253051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.253056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.253060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.253066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.253070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.253075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.253089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.253095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.253105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.253110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.253114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.253124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.253128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.253132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.253136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.253141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.253149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.253155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.253198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:50.255522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:50.255832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:50.255846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:50.255849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:50.255853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:50.255859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1124 [2:7559601273851923618:7119]
2025-10-10T14:33:50.255870Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:50.255886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:50.255891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.255895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.255897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.255914Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:50.255927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:50.255934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:50.255994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.256001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.256003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.256005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:50.256067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:50.256077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.256088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.256104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.256125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:50.256152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634145908:3984], now have 1 active actors on pipe
2025-10-10T14:33:50.256160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634145711:2438], now have 1 active actors on pipe
2025-10-10T14:33:50.256169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601273851923612:7119]
2025-10-10T14:33:50.256176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601273851923612:7119]
2025-10-10T14:33:50.256178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601273851923612:7119]
2025-10-10T14:33:50.256191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:50.256208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:50.256209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:50.256212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:50.256214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:50.256224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:50.256200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1124
2025-10-10T14:33:50.256227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:50.256214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1124
2025-10-10T14:33:50.256248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601273851923612:7119]
2025-10-10T14:33:50.256255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:50.256257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:50.256282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.256293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.256331Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:50.256344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.256348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.256355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:50.256365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.256380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:50.256405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.256535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.256542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.256558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.256643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1125 partition: 0 MaxSeqNo: 40 sessionId: src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0
2025-10-10T14:33:50.257051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33ae1e81-14643fa6-23c1079-c8a52283_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:50.259698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0] Write session: try to update token
2025-10-10T14:33:50.259715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:50.273736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId: src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:50.275674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:50.275696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:50.275699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:50.275701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:50.275711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601273851923612:7119]
2025-10-10T14:33:50.275716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601273851923612:7119]
2025-10-10T14:33:50.275719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601273851923612:7119]
2025-10-10T14:33:50.275773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:50.275795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:50.275815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:50.275820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:50.276084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.276096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:50.276244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:50.276491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:50.334663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601274634145920:4179]
2025-10-10T14:33:50.334993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1124, pipe: [1:7559601274634145920:4179]
2025-10-10T14:33:50.387183Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:50.387684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.387704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.387767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634145920:4179], now have 1 active actors on pipe
2025-10-10T14:33:50.388007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:50.388039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:50.388053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:50.388124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1125 reason: error at write: Disconnected sessionId: src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0
2025-10-10T14:33:50.388343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601274634145920:4179]
2025-10-10T14:33:50.388362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1125 sessionId: src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0 is DEAD
2025-10-10T14:33:50.388381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:50.388533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:50.388543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0] Write session will restart in 0.006136s
2025-10-10T14:33:50.388569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0] Write session: Do CDS request
2025-10-10T14:33:50.388578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:50.395948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.396044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:50.396073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1126
2025-10-10T14:33:50.396230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.396267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:50.396281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:50.396284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:50.396709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1126 sessionId:  describe result for acl check
2025-10-10T14:33:50.396746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:50.396752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:50.396754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:50.396769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601274634145947:3985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:50.397292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601274634145947:3985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:50.399872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601274634145947:3985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:50.403051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601274634145947:3985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:50.403068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601274634145947:3985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:50.403072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601274634145947:3985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:50.403081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:50.404338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:50.406795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:50.407039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:50.407050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:50.407064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:50.407122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:50.407172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601273851923826:7121]
2025-10-10T14:33:50.407804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:50.408139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:50.408206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:50.408552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:50.408613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.408619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.408621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.408622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.408623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.408624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.408625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.408626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.408628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.408629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.408630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.408631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.408632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.408638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.408651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.408655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.408658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.408662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.408666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.408670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.408674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.408677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.408681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.408685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.408688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.408692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.408700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.408709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.408716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.408721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.408725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.408729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.408733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.408738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.408742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.408747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.408751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.408756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.408760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.408765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.408769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.408774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.408779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.408784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.408788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.408792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.408797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.408802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.408807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.408812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.408816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.408821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.408856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:50.411444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:50.411884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:50.411905Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:50.411907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:50.411911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:50.411918Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1125 [2:7559601273851923826:7121]
2025-10-10T14:33:50.411933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:50.411953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:50.411962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.411966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.411969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.411987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:50.412000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:50.412012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:50.412078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.412087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.412089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.412092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:50.412173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:50.412182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.412194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.412205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.412226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:50.412254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634145921:2438], now have 1 active actors on pipe
2025-10-10T14:33:50.412263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146117:3985], now have 1 active actors on pipe
2025-10-10T14:33:50.412270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601273851923821:7121]
2025-10-10T14:33:50.412273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601273851923821:7121]
2025-10-10T14:33:50.412256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1125
2025-10-10T14:33:50.412275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601273851923821:7121]
2025-10-10T14:33:50.412263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1125
2025-10-10T14:33:50.412287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:50.412296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:50.412299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:50.412301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:50.412303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:50.412321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:50.412325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:50.412342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.412347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.412393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601273851923821:7121]
2025-10-10T14:33:50.412407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:50.412422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:50.412426Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:50.412434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.412439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.412442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:50.412454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.412465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:50.412507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.412638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.412652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.412676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.412751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1126 partition: 0 MaxSeqNo: 40 sessionId: src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0
2025-10-10T14:33:50.413173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f02ee34-36f37c85-df43cd06-4a8c7308_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:50.415932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0] Write session: try to update token
2025-10-10T14:33:50.415955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:50.424502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:50.424528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:50.424543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601273851923821:7121]
2025-10-10T14:33:50.424594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:50.424606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:50.424832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:50.424988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:50.425128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:50.425274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:50.425658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:50.425716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:50.431284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId: src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:50.434108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:50.434347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.434388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.434431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:50.434556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:50.442856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:50.442879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:50.442883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:50.442885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:50.442897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601273851923821:7121]
2025-10-10T14:33:50.442901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601273851923821:7121]
2025-10-10T14:33:50.442905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601273851923821:7121]
2025-10-10T14:33:50.442952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:50.442954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:50.442961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:50.442962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.442964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:50.442965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:50.443098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:50.488801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601274634146144:4179]
2025-10-10T14:33:50.489178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1125, pipe: [1:7559601274634146144:4179]
2025-10-10T14:33:50.558306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:50.566446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.566474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.566662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.566732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.566797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.566861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.566907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.566917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.566981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.567041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.567104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.567170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.567215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.567225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.567293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.567366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.567432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.567493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.567546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.567554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.567619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.567680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.567740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.567801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.567844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.567852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.567917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.567977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.568034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.568088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.568130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.568135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.568201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.568264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.568320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.568375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.568415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.568420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.568478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.568531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.568586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.568644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.568687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.568692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.568748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.568798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.568855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.568910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.568948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.568953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.569009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.569059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.569111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.569175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.569218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.569224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.569284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:50.569370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:50.569427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:50.569490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:50.569532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:50.569538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:50.569594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146144:4179], now have 1 active actors on pipe
2025-10-10T14:33:50.569843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601274634146144:4179]
2025-10-10T14:33:50.569843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:50.569884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:50.569888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:50.569917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1126 reason: error at write: Disconnected sessionId: src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0
2025-10-10T14:33:50.570196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1126 sessionId: src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0 is DEAD
2025-10-10T14:33:50.570291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:50.570304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0] Write session will restart in 0.008367s
2025-10-10T14:33:50.570328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0] Write session: Do CDS request
2025-10-10T14:33:50.570334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:50.570506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:50.579918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.580025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:50.580043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1127
2025-10-10T14:33:50.580163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.580200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:50.580212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:50.580215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:50.580652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1127 sessionId:  describe result for acl check
2025-10-10T14:33:50.580693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:50.580700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:50.580701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:50.580708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601274634146219:3976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:50.581250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601274634146219:3976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:50.584133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601274634146219:3976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:50.585626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:50.587922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:50.588247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:50.588260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:50.588275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:50.588274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601274634146219:3976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:50.588289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601274634146219:3976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:50.588293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601274634146219:3976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:50.588302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:50.588344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:50.588404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601273851924045:7124]
2025-10-10T14:33:50.589022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:50.589303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:50.589372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:50.589709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:50.589771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.589776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.589778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.589779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.589780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.589782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.589783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.589784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.589786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.589787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.589788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.589789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.589791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.589796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.589809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.589813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.589818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.589821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.589826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.589830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.589834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.589838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.589842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.589846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.589850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.589854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.589861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.589870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.589877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.589883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.589888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.589893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.589897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.589903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.589913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.589918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.589922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.589928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.589933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.589938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.589942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.589947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.589952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.589957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.589966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.589971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.589976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.589981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.589985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.589990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.590000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.590005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.590048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:50.592449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:50.592781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:50.592795Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:50.592797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:50.592801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:50.592809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1126 [2:7559601273851924045:7124]
2025-10-10T14:33:50.592821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:50.592838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:50.592849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.592853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.592856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.592872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:50.592879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:50.592887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:50.592946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.592953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.592955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.592958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:50.593026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:50.593033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.593044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.593055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.593076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:50.593105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146349:3976], now have 1 active actors on pipe
2025-10-10T14:33:50.593109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146146:2438], now have 1 active actors on pipe
2025-10-10T14:33:50.593116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601273851924040:7124]
2025-10-10T14:33:50.593118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601273851924040:7124]
2025-10-10T14:33:50.593120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601273851924040:7124]
2025-10-10T14:33:50.593133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:50.593150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:50.593158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:50.593162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:50.593164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:50.593167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:50.593170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:50.593157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1126
2025-10-10T14:33:50.593192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601273851924040:7124]
2025-10-10T14:33:50.593181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1126
2025-10-10T14:33:50.593200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:50.593202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:50.593227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.593236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.593273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfc21327-797a6878-e1910fa-1877cafc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:50.593287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.593291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.593299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:50.593309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.593321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:50.593373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.593533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.593541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.593557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.593690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1127 partition: 0 MaxSeqNo: 40 sessionId: src_id|bfc21327-797a6878-e1910fa-1877cafc_0
2025-10-10T14:33:50.594099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|808e3f23-9b02342d-10ed7bd6-2ef48b37_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bfc21327-797a6878-e1910fa-1877cafc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:50.596684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc21327-797a6878-e1910fa-1877cafc_0] Write session: try to update token
2025-10-10T14:33:50.596699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc21327-797a6878-e1910fa-1877cafc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:50.610828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId: src_id|bfc21327-797a6878-e1910fa-1877cafc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:50.612309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:50.612331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:50.612334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:50.612336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:50.612345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601273851924040:7124]
2025-10-10T14:33:50.612350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601273851924040:7124]
2025-10-10T14:33:50.612356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601273851924040:7124]
2025-10-10T14:33:50.612412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:50.612422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.612428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:50.612428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:50.612436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:50.612441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:50.612584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:50.613625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:50.670052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601274634146366:4179]
2025-10-10T14:33:50.670370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1126, pipe: [1:7559601274634146366:4179]
2025-10-10T14:33:50.721812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:50.722286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.722301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.722348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146366:4179], now have 1 active actors on pipe
2025-10-10T14:33:50.722528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:50.722569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601274634146366:4179]
2025-10-10T14:33:50.722574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:50.722604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:50.722679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1127 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfc21327-797a6878-e1910fa-1877cafc_0
2025-10-10T14:33:50.722878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1127 sessionId: src_id|bfc21327-797a6878-e1910fa-1877cafc_0 is DEAD
2025-10-10T14:33:50.723039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc21327-797a6878-e1910fa-1877cafc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:50.723049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc21327-797a6878-e1910fa-1877cafc_0] Write session will restart in 0.007721s
2025-10-10T14:33:50.723067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc21327-797a6878-e1910fa-1877cafc_0] Write session: Do CDS request
2025-10-10T14:33:50.723071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc21327-797a6878-e1910fa-1877cafc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:50.731980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc21327-797a6878-e1910fa-1877cafc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.732032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:50.732053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1128
2025-10-10T14:33:50.732232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.732269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:50.732279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:50.732282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:50.732751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1128 sessionId:  describe result for acl check
2025-10-10T14:33:50.732793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:50.732800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:50.732803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:50.732808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601274634146431:3973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:50.733441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601274634146431:3973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:50.735957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601274634146431:3973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:50.738240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601274634146431:3973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:50.738253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601274634146431:3973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:50.738257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601274634146431:3973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:50.738265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:50.738255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:50.740617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:50.740863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:50.740873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:50.740886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:50.740941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:50.740985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601273851924257:7127]
2025-10-10T14:33:50.741632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:50.741945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:50.741992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:50.742299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:50.742356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.742363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.742364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.742365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.742366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.742368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.742369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.742370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.742371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.742372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.742373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.742374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.742376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.742382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.742394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.742398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.742401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.742404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.742408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.742411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.742414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.742418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.742422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.742425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.742429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.742432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.742441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.742449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.742455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.742460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.742465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.742470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.742474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.742479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.742484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.742488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.742492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.742497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.742501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.742506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.742510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.742517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.742522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.742528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.742532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.742537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.742542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.742547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.742552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.742557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.742565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.742570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.742609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:50.745210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:50.745585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:50.745598Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:50.745600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:50.745604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:50.745610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1127 [2:7559601273851924257:7127]
2025-10-10T14:33:50.745623Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:50.745641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:50.745649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.745653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.745656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.745674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:50.745682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:50.745694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:50.745750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.745759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.745761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.745764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:50.745836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:50.745844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.745855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.745868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.745890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:50.745915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146367:2438], now have 1 active actors on pipe
2025-10-10T14:33:50.745924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146567:3973], now have 1 active actors on pipe
2025-10-10T14:33:50.745944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601273851924251:7127]
2025-10-10T14:33:50.745950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601273851924251:7127]
2025-10-10T14:33:50.745952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601273851924251:7127]
2025-10-10T14:33:50.745966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:50.745986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:50.745987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:50.745993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:50.745995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:50.746002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:50.746006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:50.746032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601273851924251:7127]
2025-10-10T14:33:50.746039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:50.746046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:50.746053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1127
2025-10-10T14:33:50.746062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1127
2025-10-10T14:33:50.746115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.746128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.746162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae500316-c7470218-c5e4cee6-7e44825e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:50.746175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.746179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.746181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:50.746195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.746206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:50.746226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.746375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.746384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.746399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.746513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1128 partition: 0 MaxSeqNo: 40 sessionId: src_id|ae500316-c7470218-c5e4cee6-7e44825e_0
2025-10-10T14:33:50.746954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc21327-797a6878-e1910fa-1877cafc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ae500316-c7470218-c5e4cee6-7e44825e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:50.749769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae500316-c7470218-c5e4cee6-7e44825e_0] Write session: try to update token
2025-10-10T14:33:50.749791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae500316-c7470218-c5e4cee6-7e44825e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:50.764449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId: src_id|ae500316-c7470218-c5e4cee6-7e44825e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:50.765825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:50.765848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:50.765851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:50.765853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:50.765862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601273851924251:7127]
2025-10-10T14:33:50.765866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601273851924251:7127]
2025-10-10T14:33:50.765869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601273851924251:7127]
2025-10-10T14:33:50.765922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:50.765935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.765937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:50.766088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:50.767325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:50.767485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:50.767511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:50.767538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:50.822587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601274634146580:4179]
2025-10-10T14:33:50.822871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1127, pipe: [1:7559601274634146580:4179]
2025-10-10T14:33:50.876705Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:50.876977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.876993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.877037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146580:4179], now have 1 active actors on pipe
2025-10-10T14:33:50.877218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:50.877281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601274634146580:4179]
2025-10-10T14:33:50.877288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:50.877318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:50.877435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1128 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae500316-c7470218-c5e4cee6-7e44825e_0
2025-10-10T14:33:50.877649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1128 sessionId: src_id|ae500316-c7470218-c5e4cee6-7e44825e_0 is DEAD
2025-10-10T14:33:50.877829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae500316-c7470218-c5e4cee6-7e44825e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:50.877841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae500316-c7470218-c5e4cee6-7e44825e_0] Write session will restart in 0.008509s
2025-10-10T14:33:50.877880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae500316-c7470218-c5e4cee6-7e44825e_0] Write session: Do CDS request
2025-10-10T14:33:50.877886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae500316-c7470218-c5e4cee6-7e44825e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:50.887913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae500316-c7470218-c5e4cee6-7e44825e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.889169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:50.889185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1129
2025-10-10T14:33:50.889367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:50.889421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:50.889432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:50.889436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:50.889870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1129 sessionId:  describe result for acl check
2025-10-10T14:33:50.889906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:50.889913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:50.889915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:50.889920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601274634146707:3970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:50.890473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601274634146707:3970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:50.892761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601274634146707:3970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:50.892773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:50.895179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:50.895401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:50.895415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:50.895427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:50.895388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601274634146707:3970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:50.895399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601274634146707:3970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:50.895403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601274634146707:3970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:50.895412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:50.895490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:50.895533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601273851924466:7129]
2025-10-10T14:33:50.896128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:50.896458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:50.896512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:50.896844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:50.896910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.896912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.896913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.896914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.896915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.896916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.896917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.896919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.896920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.896921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.896923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.896924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.896925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.896931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.896945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.896950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.896954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.896958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.896962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.896967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.896980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.896985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.896991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.896994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.896998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.897002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.897010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.897019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:50.897026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.897037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:50.897042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.897052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:50.897057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.897063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:50.897068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.897073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:50.897077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.897083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:50.897088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.897099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:50.897104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.897114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:50.897119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.897125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:50.897130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.897136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:50.897141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.897146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.897150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.897156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.897160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.897166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.897210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:50.899653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:50.900338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:50.900352Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:50.900354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:50.900358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:50.900364Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1128 [2:7559601273851924466:7129]
2025-10-10T14:33:50.900377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:50.900395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:50.900398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.900401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.900404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.900421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:50.900434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:50.900446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:50.900501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.900508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.900511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.900514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:50.900578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:50.900585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.900597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:50.900612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:50.900632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:50.900658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146581:2438], now have 1 active actors on pipe
2025-10-10T14:33:50.900667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146783:3970], now have 1 active actors on pipe
2025-10-10T14:33:50.900675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601273851924461:7129]
2025-10-10T14:33:50.900681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601273851924461:7129]
2025-10-10T14:33:50.900683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601273851924461:7129]
2025-10-10T14:33:50.900696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:50.900711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:50.900722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:50.900731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:50.900734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:50.900735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:50.900703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1128
2025-10-10T14:33:50.900737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:50.900744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1128
2025-10-10T14:33:50.900765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601273851924461:7129]
2025-10-10T14:33:50.900773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:50.900775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:50.900793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.900803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.900840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a382507-4d52c754-c983d489-40b42b9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:50.900852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:50.900860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:50.900863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:50.900873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:50.900887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:50.900908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.901028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:50.901037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:50.901052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:50.901125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1129 partition: 0 MaxSeqNo: 40 sessionId: src_id|a382507-4d52c754-c983d489-40b42b9e_0
2025-10-10T14:33:50.901586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae500316-c7470218-c5e4cee6-7e44825e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a382507-4d52c754-c983d489-40b42b9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:50.904332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a382507-4d52c754-c983d489-40b42b9e_0] Write session: try to update token
2025-10-10T14:33:50.904352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a382507-4d52c754-c983d489-40b42b9e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:50.920005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId: src_id|a382507-4d52c754-c983d489-40b42b9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:50.920068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:50.920087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:50.920091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:50.920093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:50.920101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601273851924461:7129]
2025-10-10T14:33:50.920106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601273851924461:7129]
2025-10-10T14:33:50.920110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601273851924461:7129]
2025-10-10T14:33:50.920161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:50.920163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:50.920170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:50.920175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:50.920177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:50.920174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:50.920331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:50.922742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:50.977224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601274634146795:4179]
2025-10-10T14:33:50.977547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1128, pipe: [1:7559601274634146795:4179]
2025-10-10T14:33:51.034456Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:51.034905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.034924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.034969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601274634146795:4179], now have 1 active actors on pipe
2025-10-10T14:33:51.035234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:51.035633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a382507-4d52c754-c983d489-40b42b9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:51.035645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a382507-4d52c754-c983d489-40b42b9e_0] Write session will restart in 0.007396s
2025-10-10T14:33:51.035671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a382507-4d52c754-c983d489-40b42b9e_0] Write session: Do CDS request
2025-10-10T14:33:51.035199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:51.035212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:51.035677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a382507-4d52c754-c983d489-40b42b9e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:51.035213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:51.035262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601274634146795:4179]
2025-10-10T14:33:51.035278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1129 reason: error at write: Disconnected sessionId: src_id|a382507-4d52c754-c983d489-40b42b9e_0
2025-10-10T14:33:51.035485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1129 sessionId: src_id|a382507-4d52c754-c983d489-40b42b9e_0 is DEAD
2025-10-10T14:33:51.043943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a382507-4d52c754-c983d489-40b42b9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.044017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:51.044034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1130
2025-10-10T14:33:51.044223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.044262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:51.044274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:51.044278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:51.044788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1130 sessionId:  describe result for acl check
2025-10-10T14:33:51.044839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:51.044845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:51.044848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:51.044854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601278929114133:3966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:51.045487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601278929114133:3966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:51.048547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601278929114133:3966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:51.058224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601278929114133:3966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:51.058242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601278929114133:3966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:51.058246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601278929114133:3966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:51.058256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:51.058265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:51.063736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:51.064005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:51.064021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:51.064035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:51.064104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:51.064156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601278146891974:7131]
2025-10-10T14:33:51.064868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:51.065231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:51.065307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:51.065720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:51.065784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.065791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.065793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.065794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.065796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.065797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.065799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.065801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.065803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.065804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.065806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.065807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.065809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.065816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.065832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.065837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.065842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.065847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.065852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.065857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.065862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.065867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.065872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.065877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.065882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.065887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.065895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.065911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.065923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.065930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.065935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.065941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.065946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.065952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.065958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.065965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.065979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.065985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.065991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.065997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.066004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.066015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.066020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.066031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.066042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.066049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.066060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.066076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.066087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.066094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.066104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.066110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.066162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:51.068845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:51.069159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:51.069173Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:51.069176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:51.069180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:51.069188Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1129 [2:7559601278146891974:7131]
2025-10-10T14:33:51.069202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:51.069221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:51.069224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.069228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.069230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.069248Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:51.069264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:51.069277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:51.069373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.069382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.069384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.069387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:51.069601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:51.069613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.069627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.069640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.069615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1129
2025-10-10T14:33:51.069634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1129
2025-10-10T14:33:51.069660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:51.069692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114294:3966], now have 1 active actors on pipe
2025-10-10T14:33:51.069701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114092:2438], now have 1 active actors on pipe
2025-10-10T14:33:51.069711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601278146891968:7131]
2025-10-10T14:33:51.069713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601278146891968:7131]
2025-10-10T14:33:51.069716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601278146891968:7131]
2025-10-10T14:33:51.069730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:51.069748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:51.069756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.069759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:51.069761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:51.069762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.069779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:51.069797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:51.069804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:51.069846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a80294d-a75a2b2-265a70e4-20720429_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:51.069859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.069863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.069866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:51.069879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.069891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:51.069899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601278146891968:7131]
2025-10-10T14:33:51.069913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:51.069926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:51.069940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.070147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.070173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.070202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.070301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1130 partition: 0 MaxSeqNo: 40 sessionId: src_id|7a80294d-a75a2b2-265a70e4-20720429_0
2025-10-10T14:33:51.070720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a382507-4d52c754-c983d489-40b42b9e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7a80294d-a75a2b2-265a70e4-20720429_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:51.073327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a80294d-a75a2b2-265a70e4-20720429_0] Write session: try to update token
2025-10-10T14:33:51.073370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a80294d-a75a2b2-265a70e4-20720429_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:51.087937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId: src_id|7a80294d-a75a2b2-265a70e4-20720429_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:51.090289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:51.090315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:51.090319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:51.090322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:51.090333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601278146891968:7131]
2025-10-10T14:33:51.090338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601278146891968:7131]
2025-10-10T14:33:51.090343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601278146891968:7131]
2025-10-10T14:33:51.090392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:51.090396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:51.090405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.090408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:51.090411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:51.090415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:51.090560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:51.090898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:51.135443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601278929114307:4179]
2025-10-10T14:33:51.135809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1129, pipe: [1:7559601278929114307:4179]
2025-10-10T14:33:51.204923Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:51.205232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.205251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.205310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114307:4179], now have 1 active actors on pipe
2025-10-10T14:33:51.205567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:51.205580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:51.205594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:51.205599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601278929114307:4179]
2025-10-10T14:33:51.205619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:51.205654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1130 reason: error at write: Disconnected sessionId: src_id|7a80294d-a75a2b2-265a70e4-20720429_0
2025-10-10T14:33:51.205865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1130 sessionId: src_id|7a80294d-a75a2b2-265a70e4-20720429_0 is DEAD
2025-10-10T14:33:51.206006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a80294d-a75a2b2-265a70e4-20720429_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:51.206017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a80294d-a75a2b2-265a70e4-20720429_0] Write session will restart in 0.006601s
2025-10-10T14:33:51.206041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a80294d-a75a2b2-265a70e4-20720429_0] Write session: Do CDS request
2025-10-10T14:33:51.206051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a80294d-a75a2b2-265a70e4-20720429_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:51.213969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a80294d-a75a2b2-265a70e4-20720429_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.214058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:51.214073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1131
2025-10-10T14:33:51.214246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.214305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:51.214313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:51.214317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:51.214786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1131 sessionId:  describe result for acl check
2025-10-10T14:33:51.214827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:51.214829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:51.214831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:51.214837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601278929114379:3946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:51.215426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601278929114379:3946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:51.218796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601278929114379:3946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:51.221711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601278929114379:3946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:51.221729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601278929114379:3946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:51.221733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601278929114379:3946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:51.221742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:51.221961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:51.224299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:51.224620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:51.224633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:51.224647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:51.224711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:51.224759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601278146892224:7146]
2025-10-10T14:33:51.225423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:51.225847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:51.225909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:51.226263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:51.226329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.226336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.226337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.226339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.226340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.226341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.226342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.226344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.226345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.226346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.226347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.226349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.226350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.226356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.226368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.226373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.226376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.226380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.226383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.226387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.226390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.226394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.226398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.226402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.226405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.226417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.226426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.226435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.226441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.226446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.226451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.226457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.226461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.226466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.226471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.226476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.226480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.226484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.226489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.226494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.226497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.226502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.226507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.226512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.226516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.226521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.226525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.226530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.226535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.226539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.226544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.226557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.226594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:51.229357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:51.229714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:51.229731Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:51.229735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:51.229739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:51.229746Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1130 [2:7559601278146892224:7146]
2025-10-10T14:33:51.229758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:51.229787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:51.229795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.229799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.229802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.229820Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:51.229831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:51.229839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:51.229909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.229919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.229921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.229924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:51.229995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:51.230003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.230018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.230036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.230059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:51.230087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601278146892218:7146]
2025-10-10T14:33:51.230094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601278146892218:7146]
2025-10-10T14:33:51.230097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601278146892218:7146]
2025-10-10T14:33:51.230107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:51.230124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:51.230127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:51.230130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:51.230133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:51.230145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:51.230149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:51.230188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114535:3946], now have 1 active actors on pipe
2025-10-10T14:33:51.230200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114335:2438], now have 1 active actors on pipe
2025-10-10T14:33:51.230203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601278146892218:7146]
2025-10-10T14:33:51.230211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:51.230231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:51.230322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.230332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.230366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:51.230378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.230382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.230389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:51.230401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.230413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:51.230437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.230625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.230651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.230676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.231084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a80294d-a75a2b2-265a70e4-20720429_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:51.230245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1130
2025-10-10T14:33:51.230280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1130
2025-10-10T14:33:51.230772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1131 partition: 0 MaxSeqNo: 40 sessionId: src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0
2025-10-10T14:33:51.233877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0] Write session: try to update token
2025-10-10T14:33:51.233897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:51.248323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId: src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:51.250429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:51.250456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:51.250459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:51.250461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:51.250469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601278146892218:7146]
2025-10-10T14:33:51.250474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601278146892218:7146]
2025-10-10T14:33:51.250476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601278146892218:7146]
2025-10-10T14:33:51.250523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:51.250530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.250530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:51.250532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:51.250537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:51.250541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:51.250668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:51.251103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:51.305952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601278929114551:4179]
2025-10-10T14:33:51.306251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1130, pipe: [1:7559601278929114551:4179]
2025-10-10T14:33:51.365505Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:51.366217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.366241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.366291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114551:4179], now have 1 active actors on pipe
2025-10-10T14:33:51.366544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:51.366558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:51.366571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:51.366596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601278929114551:4179]
2025-10-10T14:33:51.366618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:51.366648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1131 reason: error at write: Disconnected sessionId: src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0
2025-10-10T14:33:51.366875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1131 sessionId: src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0 is DEAD
2025-10-10T14:33:51.367012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:51.367022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0] Write session will restart in 0.005501s
2025-10-10T14:33:51.367046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0] Write session: Do CDS request
2025-10-10T14:33:51.367054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:51.373896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.373970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:51.373989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1132
2025-10-10T14:33:51.374162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.374211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:51.374218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:51.374222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:51.374660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1132 sessionId:  describe result for acl check
2025-10-10T14:33:51.374700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:51.374707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:51.374710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:51.374716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601278929114573:3935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:51.375316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601278929114573:3935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:51.378711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601278929114573:3935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:51.382592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601278929114573:3935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:51.382612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601278929114573:3935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:51.382616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601278929114573:3935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:51.382625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:51.384141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:51.386341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:51.386576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:51.386590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:51.386602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:51.386654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:51.386702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601278146892437:7148]
2025-10-10T14:33:51.387350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:51.387600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:51.387638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:51.387949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:51.388000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.388006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.388007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.388008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.388009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.388010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.388012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.388013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.388014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.388015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.388017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.388018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.388019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.388024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.388038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.388042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.388046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.388050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.388054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.388059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.388062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.388066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.388072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.388076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.388079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.388083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.388091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.388100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.388106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.388111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.388118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.388123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.388128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.388133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.388138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.388144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.388148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.388153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.388158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.388163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.388172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.388177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.388192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.388202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.388206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.388216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.388222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.388231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.388235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.388240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.388245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.388255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.388297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:51.390631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:51.391102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:51.391119Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:51.391121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:51.391126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:51.391132Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1131 [2:7559601278146892437:7148]
2025-10-10T14:33:51.391146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:51.391163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:51.391169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.391172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.391173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.391187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:51.391193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:51.391199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:51.391245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.391252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.391253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.391255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:51.391312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:51.391319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.391330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.391343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.391359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:51.391388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114553:2438], now have 1 active actors on pipe
2025-10-10T14:33:51.391397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114755:3935], now have 1 active actors on pipe
2025-10-10T14:33:51.391403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601278146892432:7148]
2025-10-10T14:33:51.391405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601278146892432:7148]
2025-10-10T14:33:51.391407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601278146892432:7148]
2025-10-10T14:33:51.391434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:51.391438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:51.391443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:51.391435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1131
2025-10-10T14:33:51.391445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:51.391463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1131
2025-10-10T14:33:51.391453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:51.391469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:51.391473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:51.391511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.391519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.391533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601278146892432:7148]
2025-10-10T14:33:51.391547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:51.391564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:51.391582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:51.391594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.391597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.391605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:51.391616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.391626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:51.391647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.391858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.391876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.391900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.392001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1132 partition: 0 MaxSeqNo: 40 sessionId: src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0
2025-10-10T14:33:51.392420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7974c084-f0ec13c5-21f45a0-eaee55a3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:51.395102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0] Write session: try to update token
2025-10-10T14:33:51.395122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:51.409231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId: src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:51.411310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:51.411338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:51.411342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:51.411345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:51.411356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601278146892432:7148]
2025-10-10T14:33:51.411361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601278146892432:7148]
2025-10-10T14:33:51.411370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601278146892432:7148]
2025-10-10T14:33:51.411424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:51.411432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.411435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:51.411506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:51.411521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:51.411525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:51.411579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:51.412035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:51.466659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601278929114782:4179]
2025-10-10T14:33:51.466995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1131, pipe: [1:7559601278929114782:4179]
2025-10-10T14:33:51.531528Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:51.532018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.532043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.532096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114782:4179], now have 1 active actors on pipe
2025-10-10T14:33:51.532327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:51.532460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:51.532526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601278929114782:4179]
2025-10-10T14:33:51.532554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:51.532637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1132 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0
2025-10-10T14:33:51.532886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1132 sessionId: src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0 is DEAD
2025-10-10T14:33:51.533013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:51.533024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0] Write session will restart in 0.007157s
2025-10-10T14:33:51.533051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0] Write session: Do CDS request
2025-10-10T14:33:51.533057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:51.541969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.542046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:51.542065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1133
2025-10-10T14:33:51.542250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.542312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:51.542324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:51.542329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:51.542752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1133 sessionId:  describe result for acl check
2025-10-10T14:33:51.542794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:51.542801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:51.542803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:51.542810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601278929114845:3934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:51.543427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601278929114845:3934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:51.547553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601278929114845:3934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:51.548640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:51.551008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:51.551267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:51.551279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:51.551293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:51.551356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:51.551338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601278929114845:3934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:51.551356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601278929114845:3934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:51.551360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601278929114845:3934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:51.551369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:51.551404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601278146892662:7151]
2025-10-10T14:33:51.552019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:51.552305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:51.552353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:51.552789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:51.552861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.552868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.552869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.552870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.552872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.552873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.552874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.552876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.552877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.552878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.552879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.552880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.552882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.552888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.552902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.552906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.552910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.552915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.552919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.552923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.552927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.552930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.552935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.552939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.552944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.552948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.552956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.552964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.552972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.552977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.552982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.552993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.552999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.553004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.553009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.553014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.553019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.553024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.553029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.553035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.553039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.553044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.553049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.553060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.553064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.553070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.553075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.553080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.553087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.553093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.553100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.553107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.553150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:51.555770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:51.556394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:51.556410Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:51.556412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:51.556417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:51.556424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1132 [2:7559601278146892662:7151]
2025-10-10T14:33:51.556441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:51.556461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:51.556470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.556473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.556476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.556495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:51.556508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:51.556521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:51.556593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.556601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.556603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.556606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:51.556679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:51.556687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.556699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.556714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.556736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:51.556764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114783:2438], now have 1 active actors on pipe
2025-10-10T14:33:51.556773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929114990:3934], now have 1 active actors on pipe
2025-10-10T14:33:51.556781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601278146892657:7151]
2025-10-10T14:33:51.556784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601278146892657:7151]
2025-10-10T14:33:51.556786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601278146892657:7151]
2025-10-10T14:33:51.556800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:51.556814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:51.556819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:51.556825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:51.556827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:51.556837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:51.556840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:51.556875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601278146892657:7151]
2025-10-10T14:33:51.556894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:51.556923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:51.556895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1132
2025-10-10T14:33:51.556906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1132
2025-10-10T14:33:51.556989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.557004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.557039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d45563c9-a24443d2-caf23969-60c821cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:51.557065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.557071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.557073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:51.557087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.557101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:51.557135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.557296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.557310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.557405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.557874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1133 partition: 0 MaxSeqNo: 40 sessionId: src_id|d45563c9-a24443d2-caf23969-60c821cf_0
2025-10-10T14:33:51.558352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7573b06b-bd8799c-8a3bfa30-cb26aa50_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d45563c9-a24443d2-caf23969-60c821cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:51.561113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45563c9-a24443d2-caf23969-60c821cf_0] Write session: try to update token
2025-10-10T14:33:51.561136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45563c9-a24443d2-caf23969-60c821cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:51.576251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:51.576276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:51.576289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601278146892657:7151]
2025-10-10T14:33:51.576345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:51.576354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:51.576547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:51.576709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:51.576860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:51.577013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:51.577226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:51.577273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:51.577377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId: src_id|d45563c9-a24443d2-caf23969-60c821cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:51.580122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:51.580321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.580342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.580375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:51.580492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:51.588941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:51.588966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:51.588969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:51.588973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:51.588981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601278146892657:7151]
2025-10-10T14:33:51.588984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601278146892657:7151]
2025-10-10T14:33:51.588987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601278146892657:7151]
2025-10-10T14:33:51.589036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:51.589048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.589051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:51.589050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:51.589056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:51.589060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:51.589182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:51.632594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601278929115007:4179]
2025-10-10T14:33:51.632876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1132, pipe: [1:7559601278929115007:4179]
2025-10-10T14:33:51.702497Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:51.710655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.710685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.710863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.710929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.710998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.711069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.711120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.711133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.711204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.711263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.711329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.711400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.711443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.711451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.711520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.711582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.711650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.711722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.711769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.711778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.711843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.711907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.711975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.712038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.712079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.712086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.712153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.712212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.712279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.712346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.712392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.712399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.712461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.712525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.712587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.712655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.712699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.712706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.712773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.712836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.712906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.712969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.713014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.713023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.713088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.713147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.713209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.713272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.713324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.713347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.713411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.713471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.713533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.713594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.713641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.713648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.713716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:51.713781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:51.713844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:51.713908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:51.713959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:51.713969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:51.714027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929115007:4179], now have 1 active actors on pipe
2025-10-10T14:33:51.714241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:51.714253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:51.714258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:51.714302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601278929115007:4179]
2025-10-10T14:33:51.714305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1133 reason: error at write: Disconnected sessionId: src_id|d45563c9-a24443d2-caf23969-60c821cf_0
2025-10-10T14:33:51.714607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1133 sessionId: src_id|d45563c9-a24443d2-caf23969-60c821cf_0 is DEAD
2025-10-10T14:33:51.714680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45563c9-a24443d2-caf23969-60c821cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:51.714690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45563c9-a24443d2-caf23969-60c821cf_0] Write session will restart in 0.005675s
2025-10-10T14:33:51.714725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45563c9-a24443d2-caf23969-60c821cf_0] Write session: Do CDS request
2025-10-10T14:33:51.714731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45563c9-a24443d2-caf23969-60c821cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:51.715133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:51.721979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45563c9-a24443d2-caf23969-60c821cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.722024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:51.722039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1134
2025-10-10T14:33:51.722244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.722288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:51.722300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:51.722305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:51.722893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1134 sessionId:  describe result for acl check
2025-10-10T14:33:51.722931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:51.722938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:51.722940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:51.722946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601278929115041:3928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:51.723508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601278929115041:3928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:51.726429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601278929115041:3928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:51.729624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601278929115041:3928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:51.729637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601278929115041:3928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:51.729640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601278929115041:3928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:51.729658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:51.730895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:51.733255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:51.733528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:51.733541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:51.733551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:51.733602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:51.733638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601278146892880:7154]
2025-10-10T14:33:51.734058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:51.734360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:51.734409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:51.734704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:51.734752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.734755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.734756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.734757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.734758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.734759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.734760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.734761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.734762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.734763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.734764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.734766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.734767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.734772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.734786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.734791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.734795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.734799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.734804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.734808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.734811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.734815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.734820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.734824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.734827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.734829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.734838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.734843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.734848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.734852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.734854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.734857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.734861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.734864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.734867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.734870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.734873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.734876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.734879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.734882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.734884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.734888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.734890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.734893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.734896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.734900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.734905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.734911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.734915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.734921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.734925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.734930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.734968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:51.737432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:51.738023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:51.738035Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:51.738037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:51.738041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:51.738046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1133 [2:7559601278146892880:7154]
2025-10-10T14:33:51.738059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:51.738077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:51.738085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.738089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.738091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.738108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:51.738121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:51.738130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:51.738191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.738198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.738200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.738203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:51.738270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:51.738277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.738289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.738307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.738328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:51.738358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929115012:2438], now have 1 active actors on pipe
2025-10-10T14:33:51.738368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929115216:3928], now have 1 active actors on pipe
2025-10-10T14:33:51.738376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601278146892875:7154]
2025-10-10T14:33:51.738378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601278146892875:7154]
2025-10-10T14:33:51.738380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601278146892875:7154]
2025-10-10T14:33:51.738390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:51.738407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:51.738422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:51.738413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:51.738426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:51.738428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:51.738430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:51.738452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601278146892875:7154]
2025-10-10T14:33:51.738456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:51.738448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1133
2025-10-10T14:33:51.738461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1133
2025-10-10T14:33:51.738481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:51.738492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.738497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.738529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:51.738537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.738541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.738544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:51.738557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.738568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:51.738584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.738736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.738747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.738764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.738887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1134 partition: 0 MaxSeqNo: 40 sessionId: src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0
2025-10-10T14:33:51.739309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45563c9-a24443d2-caf23969-60c821cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:51.742072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0] Write session: try to update token
2025-10-10T14:33:51.742092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:51.756782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId: src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:51.758207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:51.758227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:51.758230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:51.758232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:51.758240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601278146892875:7154]
2025-10-10T14:33:51.758244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601278146892875:7154]
2025-10-10T14:33:51.758247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601278146892875:7154]
2025-10-10T14:33:51.758290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:51.758297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.758299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:51.758428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:51.758462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:51.758476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:51.758480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:51.759421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:51.814366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601278929115231:4179]
2025-10-10T14:33:51.814694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1133, pipe: [1:7559601278929115231:4179]
2025-10-10T14:33:51.870643Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:51.870985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.870998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.871044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929115231:4179], now have 1 active actors on pipe
2025-10-10T14:33:51.871221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:51.871271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:51.871287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:51.871296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601278929115231:4179]
2025-10-10T14:33:51.871317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:51.871366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1134 reason: error at write: Disconnected sessionId: src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0
2025-10-10T14:33:51.871597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1134 sessionId: src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0 is DEAD
2025-10-10T14:33:51.871782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:51.871794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0] Write session will restart in 0.005111s
2025-10-10T14:33:51.871828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0] Write session: Do CDS request
2025-10-10T14:33:51.871839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:51.878266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.878322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:51.878337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1135
2025-10-10T14:33:51.878542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:51.878599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:51.878609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:51.878613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:51.879097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1135 sessionId:  describe result for acl check
2025-10-10T14:33:51.879135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:51.879138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:51.879142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:51.879148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601278929115250:3908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:51.879736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601278929115250:3908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:51.882616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601278929115250:3908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:51.885857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601278929115250:3908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:51.885870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601278929115250:3908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:51.885873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601278929115250:3908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:51.885882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:51.887298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:51.889409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:51.889628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:51.889643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:51.889656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:51.889725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:51.889773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601278146893097:7156]
2025-10-10T14:33:51.890403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:51.890772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:51.890820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:51.891140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:51.891211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.891218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.891220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.891221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.891222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.891224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.891225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.891226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.891227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.891229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.891230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.891231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.891233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.891240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.891254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.891259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.891263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.891267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.891272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.891276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.891280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.891284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.891288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.891293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.891297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.891301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.891310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.891319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:51.891325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.891331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:51.891336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.891341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:51.891346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.891351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:51.891361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.891365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:51.891370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.891383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:51.891389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.891394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:51.891399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.891405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:51.891410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.891421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:51.891426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.891436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:51.891441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.891451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.891456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.891466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.891471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.891482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.891527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:51.893907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:51.894496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:51.894515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:51.894518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:51.894521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:51.894527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1134 [2:7559601278146893097:7156]
2025-10-10T14:33:51.894539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:51.894556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:51.894560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.894563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.894566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.894582Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:51.894590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:51.894603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:51.894661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.894673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.894675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.894678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:51.894742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:51.894749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.894762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:51.894779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:51.894801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:51.894826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929115232:2438], now have 1 active actors on pipe
2025-10-10T14:33:51.894834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929115437:3908], now have 1 active actors on pipe
2025-10-10T14:33:51.894841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601278146893091:7156]
2025-10-10T14:33:51.894849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601278146893091:7156]
2025-10-10T14:33:51.894851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601278146893091:7156]
2025-10-10T14:33:51.894865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:51.894876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:51.894879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:51.894881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:51.894884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:51.894900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:51.894909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:51.894886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1134
2025-10-10T14:33:51.894915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1134
2025-10-10T14:33:51.894939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601278146893091:7156]
2025-10-10T14:33:51.894952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:51.894958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:51.894967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.894973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.895023Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:51.895036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:51.895040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:51.895042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:51.895053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:51.895064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:51.895084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.895261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:51.895271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:51.895288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:51.895417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1135 partition: 0 MaxSeqNo: 40 sessionId: src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0
2025-10-10T14:33:51.895827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97b20ed-99e1e468-f28cb019-200dfdaf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:51.898582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0] Write session: try to update token
2025-10-10T14:33:51.898602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:51.913778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId: src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:51.914853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:51.914876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:51.914880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:51.914882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:51.914891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601278146893091:7156]
2025-10-10T14:33:51.914896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601278146893091:7156]
2025-10-10T14:33:51.914900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601278146893091:7156]
2025-10-10T14:33:51.914950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:51.914952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:51.914963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:51.914965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:51.914969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:51.914974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:51.915103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:51.916547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:51.971544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601278929115451:4179]
2025-10-10T14:33:51.971819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1134, pipe: [1:7559601278929115451:4179]
2025-10-10T14:33:52.035304Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:52.035564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.035580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.035624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601278929115451:4179], now have 1 active actors on pipe
2025-10-10T14:33:52.035797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:52.035852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601278929115451:4179]
2025-10-10T14:33:52.035858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:52.035863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:52.035894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:52.035927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1135 reason: error at write: Disconnected sessionId: src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0
2025-10-10T14:33:52.036120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1135 sessionId: src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0 is DEAD
2025-10-10T14:33:52.036245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:52.036256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0] Write session will restart in 0.006832s
2025-10-10T14:33:52.036280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0] Write session: Do CDS request
2025-10-10T14:33:52.036289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:52.043924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.043996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:52.044013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1136
2025-10-10T14:33:52.044188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.044228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:52.044240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:52.044244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:52.044720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1136 sessionId:  describe result for acl check
2025-10-10T14:33:52.044760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:52.044767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:52.044769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:52.044794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601283224082772:3918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:52.045422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601283224082772:3918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:52.048561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601283224082772:3918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:52.051884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601283224082772:3918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:52.051899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601283224082772:3918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:52.051903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601283224082772:3918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:52.051912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:52.053800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:52.056062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:52.056290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:52.056300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:52.056313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:52.056375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:52.056418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601282441860610:7158]
2025-10-10T14:33:52.057036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:52.057417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:52.057482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:52.057841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:52.057899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.057905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.057907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.057908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.057910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.057911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.057913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.057915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.057916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.057917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.057919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.057920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.057922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.057928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.057943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.057948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.057952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.057957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.057961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.057978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.057982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.057986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.057992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.058002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.058007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.058011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.058019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.058029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.058040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.058047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.058053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.058059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.058064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.058069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.058080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.058086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.058095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.058101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.058106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.058113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.058122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.058129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.058138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.058145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.058151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.058157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.058162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.058168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.058178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.058185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.058196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.058202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.058252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:52.060966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:52.061400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:52.061409Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:52.061412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:52.061416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:52.061423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1135 [2:7559601282441860610:7158]
2025-10-10T14:33:52.061437Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:52.061457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:52.061461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.061465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.061468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.061488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:52.061495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:52.061504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:52.061568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.061578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.061580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.061584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:52.061656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:52.061664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.061677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.061691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.061717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:52.061741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224082954:3918], now have 1 active actors on pipe
2025-10-10T14:33:52.061749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224082748:2438], now have 1 active actors on pipe
2025-10-10T14:33:52.061758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601282441860605:7158]
2025-10-10T14:33:52.061765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601282441860605:7158]
2025-10-10T14:33:52.061768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601282441860605:7158]
2025-10-10T14:33:52.061781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:52.061796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:52.061802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:52.061805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:52.061808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:52.061820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:52.061830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:52.061866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601282441860605:7158]
2025-10-10T14:33:52.061881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:52.061863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1135
2025-10-10T14:33:52.061899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1135
2025-10-10T14:33:52.061958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:52.061984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.061990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.062024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:52.062040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.062045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.062048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:52.062062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.062074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:52.062090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.062268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.062282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.062308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.062417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1136 partition: 0 MaxSeqNo: 40 sessionId: src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0
2025-10-10T14:33:52.062835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535eb96b-f05bbefe-68cdb745-5f65f7e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:52.065505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0] Write session: try to update token
2025-10-10T14:33:52.065525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:52.073824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:52.073838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:52.073851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601282441860605:7158]
2025-10-10T14:33:52.073901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:52.073910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:52.074077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:52.074225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:52.074363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:52.074510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:52.074704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:52.074750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:52.080634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId: src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:52.083291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:52.083519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.083539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.083584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:52.083658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:52.092087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:52.092105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:52.092109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:52.092111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:52.092123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601282441860605:7158]
2025-10-10T14:33:52.092127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601282441860605:7158]
2025-10-10T14:33:52.092134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601282441860605:7158]
2025-10-10T14:33:52.092182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:52.092190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.092193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:52.092198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:52.092205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:52.092210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:52.092335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:52.135886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601283224082969:4179]
2025-10-10T14:33:52.136305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1135, pipe: [1:7559601283224082969:4179]
2025-10-10T14:33:52.207422Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:52.215572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.215604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.215773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.215840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.215905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.215973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.216019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.216035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.216108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.216164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.216234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.216303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.216351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.216361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.216426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.216489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.216567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.216635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.216679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.216687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.216753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.216824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.216889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.216956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.217002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.217009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.217083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.217152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.217221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.217283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.217357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.217366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.217432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.217496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.217560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.217623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.217668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.217675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.217741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.217800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.217867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.217931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.217975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.217983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.218046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.218108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.218176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.218249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.218293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.218300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.218368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.218428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.218497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.218563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.218607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.218616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.218694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:52.218758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:52.218825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:52.218889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:52.218932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:52.218938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:52.219042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224082969:4179], now have 1 active actors on pipe
2025-10-10T14:33:52.219322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:52.219338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:52.219370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1136 reason: error at write: Disconnected sessionId: src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0
2025-10-10T14:33:52.219604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1136 sessionId: src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0 is DEAD
2025-10-10T14:33:52.219763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:52.219774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0] Write session will restart in 0.007520s
2025-10-10T14:33:52.219799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0] Write session: Do CDS request
2025-10-10T14:33:52.219807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:52.219869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:52.219933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601283224082969:4179]
2025-10-10T14:33:52.220212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:52.228961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.229240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:52.229260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1137
2025-10-10T14:33:52.229433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.229478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:52.229487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:52.229491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:52.229964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1137 sessionId:  describe result for acl check
2025-10-10T14:33:52.230001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:52.230007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:52.230010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:52.230017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601283224083039:3900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:52.230647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601283224083039:3900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:52.233650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601283224083039:3900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:52.236467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601283224083039:3900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:52.236480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601283224083039:3900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:52.236484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601283224083039:3900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:52.236492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:52.237498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:52.239987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:52.240264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:52.240276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:52.240289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:52.240354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:52.240397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601282441860841:7166]
2025-10-10T14:33:52.241121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:52.241486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:52.241536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:52.241879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:52.241943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.241950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.241951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.241952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.241954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.241956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.241957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.241959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.241960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.241961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.241962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.241963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.241964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.241971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.241984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.241988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.241993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.241997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.242001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.242006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.242010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.242014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.242019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.242024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.242028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.242032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.242040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.242049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.242055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.242062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.242066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.242072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.242077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.242083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.242088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.242093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.242099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.242104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.242109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.242115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.242120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.242126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.242132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.242138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.242143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.242149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.242154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.242161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.242175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.242180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.242202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.242206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.242243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:52.244630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:52.244958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:52.244972Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:52.244974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:52.244977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:52.244983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1136 [2:7559601282441860841:7166]
2025-10-10T14:33:52.244996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:52.245013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:52.245021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.245024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.245026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.245042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:52.245054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:52.245064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:52.245120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.245127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.245129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.245131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:52.245198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:52.245205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.245217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.245232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.245253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:52.245282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224082986:2438], now have 1 active actors on pipe
2025-10-10T14:33:52.245290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083197:3900], now have 1 active actors on pipe
2025-10-10T14:33:52.245308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601282441860836:7166]
2025-10-10T14:33:52.245315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601282441860836:7166]
2025-10-10T14:33:52.245317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601282441860836:7166]
2025-10-10T14:33:52.245302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1136
2025-10-10T14:33:52.245326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:52.245345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1136
2025-10-10T14:33:52.245350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:52.245353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:52.245355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:52.245368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:52.245385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:52.245389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:52.245426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.245436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.245455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601282441860836:7166]
2025-10-10T14:33:52.245466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:52.245473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:52.245494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:52.245507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.245515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.245517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:52.245529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.245552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:52.245584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.246112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.246123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.246143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.246228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1137 partition: 0 MaxSeqNo: 40 sessionId: src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0
2025-10-10T14:33:52.246594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a8e24d-b5faeb42-d311a28c-16a89fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:52.249284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0] Write session: try to update token
2025-10-10T14:33:52.249311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:52.263424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId: src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:52.264658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:52.264678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:52.264681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:52.264683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:52.264692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601282441860836:7166]
2025-10-10T14:33:52.264697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601282441860836:7166]
2025-10-10T14:33:52.264700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601282441860836:7166]
2025-10-10T14:33:52.264748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:52.264754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:52.264756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.264759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:52.264761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:52.264766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:52.264898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:52.266345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:52.320202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601283224083223:4179]
2025-10-10T14:33:52.320520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1136, pipe: [1:7559601283224083223:4179]
2025-10-10T14:33:52.384120Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:52.384596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.384613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.384661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083223:4179], now have 1 active actors on pipe
2025-10-10T14:33:52.384865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601283224083223:4179]
2025-10-10T14:33:52.384869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:52.384873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:52.384920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:52.384949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1137 reason: error at write: Disconnected sessionId: src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0
2025-10-10T14:33:52.385003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:52.385162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1137 sessionId: src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0 is DEAD
2025-10-10T14:33:52.385375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:52.385402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0] Write session will restart in 0.006540s
2025-10-10T14:33:52.385427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0] Write session: Do CDS request
2025-10-10T14:33:52.385449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:52.392805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.393000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:52.393017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1138
2025-10-10T14:33:52.393169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.393221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:52.393232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:52.393236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:52.393749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1138 sessionId:  describe result for acl check
2025-10-10T14:33:52.393787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:52.393793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:52.393795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:52.393802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601283224083262:3896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:52.394368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601283224083262:3896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:52.396971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601283224083262:3896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:52.401213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601283224083262:3896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:52.401229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601283224083262:3896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:52.401233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601283224083262:3896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:52.401242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:52.401308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:52.404110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:52.404345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:52.404368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:52.404381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:52.404446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:52.404489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601282441861085:7175]
2025-10-10T14:33:52.405126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:52.405464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:52.405514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:52.405830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:52.405896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.405902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.405904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.405905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.405906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.405908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.405909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.405910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.405911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.405912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.405914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.405915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.405917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.405923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.405937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.405941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.405946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.405950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.405954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.405958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.405962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.405967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.405971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.405975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.405980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.405984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.405992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.406001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.406009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.406019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.406023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.406029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.406033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.406039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.406044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.406049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.406053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.406058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.406063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.406068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.406071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.406076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.406080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.406087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.406096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.406102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.406106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.406110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.406114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.406119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.406129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.406133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.406175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:52.408568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:52.408876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:52.408887Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:52.408890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:52.408894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:52.408901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1137 [2:7559601282441861085:7175]
2025-10-10T14:33:52.408913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:52.408931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:52.408938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.408942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.408944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.408962Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:52.408974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:52.408982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:52.409048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.409056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.409057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.409060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:52.409128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:52.409138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.409151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.409163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.409189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:52.409217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083434:3896], now have 1 active actors on pipe
2025-10-10T14:33:52.409225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083224:2438], now have 1 active actors on pipe
2025-10-10T14:33:52.409233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601282441861079:7175]
2025-10-10T14:33:52.409235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601282441861079:7175]
2025-10-10T14:33:52.409237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601282441861079:7175]
2025-10-10T14:33:52.409252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:52.409270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:52.409272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:52.409277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:52.409280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:52.409298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:52.409301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:52.409274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1137
2025-10-10T14:33:52.409281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1137
2025-10-10T14:33:52.409343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601282441861079:7175]
2025-10-10T14:33:52.409353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:52.409356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:52.409373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.409378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.409429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:52.409444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.409448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.409450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:52.409462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.409478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:52.409501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.409631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.409638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.409653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.409733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1138 partition: 0 MaxSeqNo: 40 sessionId: src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0
2025-10-10T14:33:52.410137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa8e2f1c-d174b94a-9e2f6965-83e85ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:52.412777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0] Write session: try to update token
2025-10-10T14:33:52.412795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:52.427714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId: src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:52.430797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:52.431020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:52.431047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:52.431051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:52.431053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:52.431063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601282441861079:7175]
2025-10-10T14:33:52.431069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601282441861079:7175]
2025-10-10T14:33:52.431076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601282441861079:7175]
2025-10-10T14:33:52.431145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.431128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:52.431156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:52.431160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:52.431167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.431192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:52.431201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.431203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:52.431365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:52.486249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601283224083459:4179]
2025-10-10T14:33:52.486604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1137, pipe: [1:7559601283224083459:4179]
2025-10-10T14:33:52.546253Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:52.546943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083459:4179], now have 1 active actors on pipe
2025-10-10T14:33:52.547080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:52.547145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:52.547146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601283224083459:4179]
2025-10-10T14:33:52.547163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:52.547167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:52.547227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1138 reason: error at write: Disconnected sessionId: src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0
2025-10-10T14:33:52.547432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1138 sessionId: src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0 is DEAD
2025-10-10T14:33:52.547626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:52.547635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0] Write session will restart in 0.008591s
2025-10-10T14:33:52.547660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0] Write session: Do CDS request
2025-10-10T14:33:52.547666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:52.557982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.558043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:52.558061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1139
2025-10-10T14:33:52.558217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.558273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:52.558282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:52.558286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:52.559037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1139 sessionId:  describe result for acl check
2025-10-10T14:33:52.559077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:52.559079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:52.559081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:52.559088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601283224083526:3888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:52.559656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601283224083526:3888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:52.562064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601283224083526:3888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:52.567021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:52.567121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601283224083526:3888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:52.567141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601283224083526:3888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:52.567145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601283224083526:3888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:52.567156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:52.569961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:52.570204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:52.570229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:52.570244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:52.570310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:52.570356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601282441861317:7178]
2025-10-10T14:33:52.570980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:52.571309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:52.571358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:52.571719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:52.571790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.571797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.571799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.571800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.571801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.571802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.571804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.571805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.571806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.571808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.571809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.571810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.571812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.571817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.571832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.571836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.571840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.571844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.571849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.571853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.571857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.571861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.571866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.571870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.571874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.571878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.571887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.571896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.571904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.571914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.571919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.571929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.571933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.571938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.571942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.571946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.571950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.571955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.571960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.571966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.571970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.571976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.571984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.571990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.571994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.572000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.572005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.572010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.572015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.572020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.572025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.572032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.572079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:52.574633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:52.575052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:52.575063Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:52.575066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:52.575070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:52.575076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1138 [2:7559601282441861317:7178]
2025-10-10T14:33:52.575090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:52.575109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:52.575117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.575120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.575123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.575141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:52.575148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:52.575157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:52.575220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.575226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.575228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.575231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:52.575297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:52.575304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.575315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.575330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.575353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:52.575379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083460:2438], now have 1 active actors on pipe
2025-10-10T14:33:52.575386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083671:3888], now have 1 active actors on pipe
2025-10-10T14:33:52.575395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601282441861310:7178]
2025-10-10T14:33:52.575397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601282441861310:7178]
2025-10-10T14:33:52.575399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601282441861310:7178]
2025-10-10T14:33:52.575413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:52.575428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:52.575432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:52.575437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:52.575439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:52.575449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:52.575452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:52.575443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1138
2025-10-10T14:33:52.575469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1138
2025-10-10T14:33:52.575480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601282441861310:7178]
2025-10-10T14:33:52.575488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:52.575490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:52.575505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.575514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.575565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:52.575578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.575582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.575585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:52.575596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.575606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:52.575623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.575750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.575759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.575774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.575850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1139 partition: 0 MaxSeqNo: 40 sessionId: src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0
2025-10-10T14:33:52.576221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75e3a2d1-a5ee4293-949f49fb-5e45dcf2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:52.578923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0] Write session: try to update token
2025-10-10T14:33:52.578942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:52.594251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId: src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:52.595539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:52.595555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:52.595558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:52.595560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:52.595569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601282441861310:7178]
2025-10-10T14:33:52.595573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601282441861310:7178]
2025-10-10T14:33:52.595577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601282441861310:7178]
2025-10-10T14:33:52.595629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:52.595630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:52.595637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:52.595641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:52.595642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.595645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:52.595789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:52.596936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:52.647331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601283224083693:4179]
2025-10-10T14:33:52.647616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1138, pipe: [1:7559601283224083693:4179]
2025-10-10T14:33:52.713343Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:52.713622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.713639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.713686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083693:4179], now have 1 active actors on pipe
2025-10-10T14:33:52.713920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:52.713934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:52.713941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:52.713987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601283224083693:4179]
2025-10-10T14:33:52.713997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:52.714017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1139 reason: error at write: Disconnected sessionId: src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0
2025-10-10T14:33:52.714219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1139 sessionId: src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0 is DEAD
2025-10-10T14:33:52.714381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:52.714393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0] Write session will restart in 0.008687s
2025-10-10T14:33:52.714418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0] Write session: Do CDS request
2025-10-10T14:33:52.714425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:52.723900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.724000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:52.724018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1140
2025-10-10T14:33:52.724186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.724234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:52.724247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:52.724252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:52.725519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1140 sessionId:  describe result for acl check
2025-10-10T14:33:52.725565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:52.725567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:52.725569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:52.725576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601283224083770:3881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:52.726202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601283224083770:3881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:52.731220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601283224083770:3881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:52.732100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:52.734443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:52.734622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601283224083770:3881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:52.734639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601283224083770:3881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:52.734642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601283224083770:3881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:52.734663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:52.734652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:52.734679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:52.734694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:52.734764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:52.734813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601282441861539:7181]
2025-10-10T14:33:52.735438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:52.735763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:52.735822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:52.736151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:52.736219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.736226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.736227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.736228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.736229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.736231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.736232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.736233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.736234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.736235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.736236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.736237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.736239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.736245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.736258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.736262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.736266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.736270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.736273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.736277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.736281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.736284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.736288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.736292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.736296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.736299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.736307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.736316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.736322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.736327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.736333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.736338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.736342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.736348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.736352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.736358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.736362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.736367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.736373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.736378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.736382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.736386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.736390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.736395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.736400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.736405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.736410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.736415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.736419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.736424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.736428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.736434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.736473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:52.738782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:52.739393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:52.739406Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:52.739408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:52.739413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:52.739419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1139 [2:7559601282441861539:7181]
2025-10-10T14:33:52.739432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:52.739451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:52.739460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.739463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.739466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.739484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:52.739497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:52.739504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:52.739565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.739573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.739575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.739577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:52.739651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:52.739664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.739677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.739689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.739706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:52.739732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083697:2438], now have 1 active actors on pipe
2025-10-10T14:33:52.739742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083911:3881], now have 1 active actors on pipe
2025-10-10T14:33:52.739751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601282441861534:7181]
2025-10-10T14:33:52.739753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601282441861534:7181]
2025-10-10T14:33:52.739755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601282441861534:7181]
2025-10-10T14:33:52.739770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:52.739764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1139
2025-10-10T14:33:52.739782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1139
2025-10-10T14:33:52.739783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:52.739790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:52.739805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:52.739807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:52.739807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:52.739810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:52.739852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.739859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.739874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601282441861534:7181]
2025-10-10T14:33:52.739886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:52.739903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:52.739918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:52.739928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.739938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.739940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:52.739952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.739969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:52.739996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.740164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.740172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.740189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.740311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1140 partition: 0 MaxSeqNo: 40 sessionId: src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0
2025-10-10T14:33:52.740714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c99ab5f3-a08b3317-f82dd1fd-ea15b11d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:52.743535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0] Write session: try to update token
2025-10-10T14:33:52.743555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:52.757933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId: src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:52.759504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:52.759521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:52.759524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:52.759526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:52.759536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601282441861534:7181]
2025-10-10T14:33:52.759541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601282441861534:7181]
2025-10-10T14:33:52.759545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601282441861534:7181]
2025-10-10T14:33:52.759591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:52.759594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:52.759598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:52.759602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:52.759603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.759605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:52.759745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:52.760545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:52.814284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601283224083923:4179]
2025-10-10T14:33:52.814595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1139, pipe: [1:7559601283224083923:4179]
2025-10-10T14:33:52.871550Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:52.871944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.871959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.871999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083923:4179], now have 1 active actors on pipe
2025-10-10T14:33:52.872255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:52.872240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:52.872288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601283224083923:4179]
2025-10-10T14:33:52.872291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:52.872294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:52.872355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1140 reason: error at write: Disconnected sessionId: src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0
2025-10-10T14:33:52.872536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1140 sessionId: src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0 is DEAD
2025-10-10T14:33:52.872679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:52.872690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0] Write session will restart in 0.009373s
2025-10-10T14:33:52.872715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0] Write session: Do CDS request
2025-10-10T14:33:52.872724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:52.882978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.883059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:52.883074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1141
2025-10-10T14:33:52.883208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:52.883254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:52.883262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:52.883267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:52.883703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1141 sessionId:  describe result for acl check
2025-10-10T14:33:52.883737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:52.883745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:52.883746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:52.883753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601283224084021:3874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:52.884329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601283224084021:3874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:52.887042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601283224084021:3874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:52.888647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:52.891014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:52.891226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:52.891239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:52.891251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:52.891306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:52.891354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601282441861761:7183]
2025-10-10T14:33:52.891365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601283224084021:3874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:52.891383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601283224084021:3874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:52.891387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601283224084021:3874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:52.891396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:52.891990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:52.892258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:52.892304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:52.892787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:52.892870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.892876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.892878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.892879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.892880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.892881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.892883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.892884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.892885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.892886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.892888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.892889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.892890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.892896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.892910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.892914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.892918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.892922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.892927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.892931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.892935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.892939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.892943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.892947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.892951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.892955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.892962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.892971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:52.892977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.892983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:52.892987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.892993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:52.893005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.893011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:52.893017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.893021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:52.893025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.893031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:52.893036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.893045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:52.893050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.893056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:52.893065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.893071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:52.893082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.893087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:52.893096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.893101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.893106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.893113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.893119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.893129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.893169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:52.895557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:52.895870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:52.895882Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:52.895884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:52.895887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:52.895894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1140 [2:7559601282441861761:7183]
2025-10-10T14:33:52.895908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:52.895925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:52.895932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.895935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.895938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.895954Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:52.895966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:52.895979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:52.896030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.896037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.896039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.896042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:52.896111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:52.896118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.896130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:52.896146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:52.896172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:52.896194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224084138:3874], now have 1 active actors on pipe
2025-10-10T14:33:52.896197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224083924:2438], now have 1 active actors on pipe
2025-10-10T14:33:52.896205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601282441861756:7183]
2025-10-10T14:33:52.896207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601282441861756:7183]
2025-10-10T14:33:52.896209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601282441861756:7183]
2025-10-10T14:33:52.896223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:52.896239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:52.896244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:52.896248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:52.896250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:52.896259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:52.896243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1140
2025-10-10T14:33:52.896263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:52.896285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601282441861756:7183]
2025-10-10T14:33:52.896246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1140
2025-10-10T14:33:52.896290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:52.896298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:52.896328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.896338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.896377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84bbf811-40e36e80-ec021302-6df6a18c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:52.896390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:52.896396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:52.896400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:52.896412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:52.896428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:52.896448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.896639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:52.896651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:52.896671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:52.896777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1141 partition: 0 MaxSeqNo: 40 sessionId: src_id|84bbf811-40e36e80-ec021302-6df6a18c_0
2025-10-10T14:33:52.897164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d7d0d3-2658e909-b7f7cf01-a1595819_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84bbf811-40e36e80-ec021302-6df6a18c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:52.899867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbf811-40e36e80-ec021302-6df6a18c_0] Write session: try to update token
2025-10-10T14:33:52.899884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbf811-40e36e80-ec021302-6df6a18c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:52.914241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId: src_id|84bbf811-40e36e80-ec021302-6df6a18c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:52.915994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:52.916015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:52.916019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:52.916020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:52.916030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601282441861756:7183]
2025-10-10T14:33:52.916036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601282441861756:7183]
2025-10-10T14:33:52.916043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601282441861756:7183]
2025-10-10T14:33:52.916097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:52.916105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:52.916110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:52.916113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:52.916118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:52.916141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:52.916252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:52.917231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:52.972489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601283224084150:4179]
2025-10-10T14:33:52.972789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1140, pipe: [1:7559601283224084150:4179]
2025-10-10T14:33:53.028493Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:53.029132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.029151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.029202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601283224084150:4179], now have 1 active actors on pipe
2025-10-10T14:33:53.029450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:53.029520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:53.029528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:53.029532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:53.029576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601283224084150:4179]
2025-10-10T14:33:53.029607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1141 reason: error at write: Disconnected sessionId: src_id|84bbf811-40e36e80-ec021302-6df6a18c_0
2025-10-10T14:33:53.029841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1141 sessionId: src_id|84bbf811-40e36e80-ec021302-6df6a18c_0 is DEAD
2025-10-10T14:33:53.030037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbf811-40e36e80-ec021302-6df6a18c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:53.030048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbf811-40e36e80-ec021302-6df6a18c_0] Write session will restart in 0.005067s
2025-10-10T14:33:53.030074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbf811-40e36e80-ec021302-6df6a18c_0] Write session: Do CDS request
2025-10-10T14:33:53.030094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbf811-40e36e80-ec021302-6df6a18c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:53.036944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbf811-40e36e80-ec021302-6df6a18c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.037030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:53.037050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1142
2025-10-10T14:33:53.037212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.037247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:53.037255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:53.037316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:53.037871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1142 sessionId:  describe result for acl check
2025-10-10T14:33:53.037913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:53.037920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:53.037923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:53.037930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601287519051466:3866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:53.038584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601287519051466:3866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:53.042163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601287519051466:3866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:53.045861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601287519051466:3866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:53.045878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601287519051466:3866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:53.045882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601287519051466:3866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:53.045893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:53.048228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:53.050712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:53.050947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:53.050958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:53.050971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:53.051029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:53.051075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601286736829281:7185]
2025-10-10T14:33:53.051743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:53.052052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:53.052105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:53.052439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:53.052504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.052510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.052511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.052512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.052514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.052515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.052517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.052518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.052520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.052521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.052523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.052524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.052525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.052533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.052546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.052551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.052555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.052560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.052564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.052569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.052573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.052578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.052583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.052588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.052592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.052596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.052605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.052616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.052626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.052633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.052641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.052648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.052656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.052661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.052666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.052672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.052676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.052682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.052691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.052697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.052703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.052716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.052721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.052727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.052731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.052736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.052741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.052746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.052750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.052756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.052761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.052766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.052807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:53.055540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:53.055859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:53.055870Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:53.055873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:53.055877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:53.055883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1141 [2:7559601286736829281:7185]
2025-10-10T14:33:53.055908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:53.055929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:53.055933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.055936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.055939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.055956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:53.055965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:53.055973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:53.056034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.056042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.056044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.056047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:53.056118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:53.056128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.056141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.056154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.056172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:53.056198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519051657:3866], now have 1 active actors on pipe
2025-10-10T14:33:53.056208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519051447:2438], now have 1 active actors on pipe
2025-10-10T14:33:53.056216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601286736829276:7185]
2025-10-10T14:33:53.056223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601286736829276:7185]
2025-10-10T14:33:53.056225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601286736829276:7185]
2025-10-10T14:33:53.056239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:53.056258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:53.056267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:53.056272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:53.056275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:53.056279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:53.056283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:53.056281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1141
2025-10-10T14:33:53.056312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601286736829276:7185]
2025-10-10T14:33:53.056320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:53.056283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1141
2025-10-10T14:33:53.056325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:53.056347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.056357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.056399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:53.056412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.056417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.056419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:53.056431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.056441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:53.056463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.056699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.056716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.056738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.056851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1142 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0
2025-10-10T14:33:53.057311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bbf811-40e36e80-ec021302-6df6a18c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:53.060039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0] Write session: try to update token
2025-10-10T14:33:53.060057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:53.074567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId: src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:53.076480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:53.076499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:53.076503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:53.076505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:53.076515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601286736829276:7185]
2025-10-10T14:33:53.076520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601286736829276:7185]
2025-10-10T14:33:53.076524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601286736829276:7185]
2025-10-10T14:33:53.076583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:53.076595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.076595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:53.076597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:53.076602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:53.076606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:53.076739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:53.078005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:53.129650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601287519051673:4179]
2025-10-10T14:33:53.129967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1141, pipe: [1:7559601287519051673:4179]
2025-10-10T14:33:53.193647Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:53.194154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.194174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.194232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519051673:4179], now have 1 active actors on pipe
2025-10-10T14:33:53.194518Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:53.194506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601287519051673:4179]
2025-10-10T14:33:53.194519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:53.194523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:53.194542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:53.194593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1142 reason: error at write: Disconnected sessionId: src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0
2025-10-10T14:33:53.194829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1142 sessionId: src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0 is DEAD
2025-10-10T14:33:53.195013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:53.195025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0] Write session will restart in 0.005947s
2025-10-10T14:33:53.195052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0] Write session: Do CDS request
2025-10-10T14:33:53.195062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:53.201841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.201999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:53.202015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1143
2025-10-10T14:33:53.202142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.202182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:53.202194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:53.202198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:53.202711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1143 sessionId:  describe result for acl check
2025-10-10T14:33:53.202753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:53.202760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:53.202762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:53.202770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601287519051699:3858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:53.203324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601287519051699:3858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:53.206190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601287519051699:3858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:53.210180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601287519051699:3858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:53.210199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601287519051699:3858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:53.210203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601287519051699:3858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:53.210212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:53.211404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:53.214063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:53.214310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:53.214323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:53.214338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:53.214428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:53.214484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601286736829505:7187]
2025-10-10T14:33:53.215062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:53.215424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:53.215479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:53.215797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:53.215881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.215888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.215890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.215891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.215892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.215893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.215894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.215896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.215897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.215898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.215899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.215901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.215902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.215908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.215921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.215925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.215930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.215934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.215938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.215942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.215946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.215949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.215954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.215957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.215961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.215965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.215976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.215984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.215997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.216003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.216012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.216018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.216025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.216030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.216036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.216046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.216051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.216057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.216066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.216072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.216076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.216085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.216092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.216101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.216106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.216116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.216121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.216125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.216129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.216134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.216142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.216147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.216193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:53.218801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:53.219370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:53.219383Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:53.219386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:53.219391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:53.219397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1142 [2:7559601286736829505:7187]
2025-10-10T14:33:53.219411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:53.219430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:53.219438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.219442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.219445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.219463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:53.219471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:53.219485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:53.219560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.219569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.219571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.219574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:53.219639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:53.219646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.219658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.219674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.219690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:53.219710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601286736829500:7187]
2025-10-10T14:33:53.219713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601286736829500:7187]
2025-10-10T14:33:53.219715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601286736829500:7187]
2025-10-10T14:33:53.219724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:53.219733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:53.219739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519051675:2438], now have 1 active actors on pipe
2025-10-10T14:33:53.219746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519051889:3858], now have 1 active actors on pipe
2025-10-10T14:33:53.219751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:53.219751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:53.219753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:53.219767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:53.219770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:53.219798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601286736829500:7187]
2025-10-10T14:33:53.219807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:53.219814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:53.219846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1142
2025-10-10T14:33:53.219863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1142
2025-10-10T14:33:53.219915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.219924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.219956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:53.219968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.219971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.219974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:53.219988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.219999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:53.220013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.220208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.220219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.220237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.220355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1143 partition: 0 MaxSeqNo: 40 sessionId: src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0
2025-10-10T14:33:53.220802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a59fae-4bd26444-13191bbd-1ae08dab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:53.223758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0] Write session: try to update token
2025-10-10T14:33:53.223779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:53.238080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId: src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:53.239278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:53.239296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:53.239299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:53.239301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:53.239312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601286736829500:7187]
2025-10-10T14:33:53.239316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601286736829500:7187]
2025-10-10T14:33:53.239320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601286736829500:7187]
2025-10-10T14:33:53.239373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:53.239386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.239388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:53.239456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:53.239471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:53.239476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:53.239530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:53.240717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:53.294549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601287519051915:4179]
2025-10-10T14:33:53.294825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1142, pipe: [1:7559601287519051915:4179]
2025-10-10T14:33:53.355775Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:53.356185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.356206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.356260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519051915:4179], now have 1 active actors on pipe
2025-10-10T14:33:53.356475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:53.356478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:53.356493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:53.356510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601287519051915:4179]
2025-10-10T14:33:53.356530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:53.356556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1143 reason: error at write: Disconnected sessionId: src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0
2025-10-10T14:33:53.356752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1143 sessionId: src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0 is DEAD
2025-10-10T14:33:53.356915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:53.356925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0] Write session will restart in 0.005882s
2025-10-10T14:33:53.356960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0] Write session: Do CDS request
2025-10-10T14:33:53.356969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:53.363911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.363995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:53.364012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1144
2025-10-10T14:33:53.364208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.364250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:53.364261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:53.364265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:53.364757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1144 sessionId:  describe result for acl check
2025-10-10T14:33:53.364814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:53.364824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:53.364826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:53.364833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601287519051943:3848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:53.365450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601287519051943:3848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:53.368668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601287519051943:3848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:53.373756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601287519051943:3848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:53.373773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601287519051943:3848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:53.373777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601287519051943:3848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:53.373786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:53.375864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:53.378234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:53.378488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:53.378501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:53.378517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:53.378600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:53.378646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601286736829767:7202]
2025-10-10T14:33:53.379275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:53.379680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:53.379758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:53.380135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:53.380200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.380206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.380207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.380208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.380210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.380211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.380212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.380214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.380215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.380216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.380217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.380227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.380229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.380235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.380250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.380254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.380259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.380263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.380267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.380271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.380275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.380279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.380284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.380288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.380292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.380295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.380304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.380314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.380321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.380327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.380344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.380354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.380359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.380365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.380373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.380378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.380387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.380392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.380398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.380404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.380408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.380414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.380424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.380430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.380434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.380438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.380445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.380450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.380459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.380464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.380469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.380474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.380518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:53.384679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:53.385423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:53.385435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:53.385439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:53.385443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:53.385451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1143 [2:7559601286736829767:7202]
2025-10-10T14:33:53.385466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:53.385488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:53.385491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.385495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.385497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.385518Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:53.385525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:53.385533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:53.385611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.385619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.385621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.385624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:53.385701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:53.385710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.385725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.385735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.385750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:53.385776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519051928:2438], now have 1 active actors on pipe
2025-10-10T14:33:53.385786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052142:3848], now have 1 active actors on pipe
2025-10-10T14:33:53.385794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601286736829761:7202]
2025-10-10T14:33:53.385796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601286736829761:7202]
2025-10-10T14:33:53.385798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601286736829761:7202]
2025-10-10T14:33:53.385813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:53.385846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1143
2025-10-10T14:33:53.385826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:53.385830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:53.385831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:53.385832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:53.385848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:53.385852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:53.386024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1143
2025-10-10T14:33:53.386039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601286736829761:7202]
2025-10-10T14:33:53.386052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:53.386083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:53.386096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.386101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.386137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:53.386151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.386162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.386169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:53.386183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.386199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:53.386218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.386429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.386443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.386470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.386652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1144 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0
2025-10-10T14:33:53.387153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84fdd4ea-95ea8e6f-1adc028a-20a26037_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:53.390016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0] Write session: try to update token
2025-10-10T14:33:53.390035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:53.407105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:53.407123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:53.407127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:53.407129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:53.407141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601286736829761:7202]
2025-10-10T14:33:53.407149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601286736829761:7202]
2025-10-10T14:33:53.407153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601286736829761:7202]
2025-10-10T14:33:53.407200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:53.407208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:53.407212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:53.407215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.407217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:53.407218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:53.407390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:53.407841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId: src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:53.410622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:53.456894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601287519052168:4179]
2025-10-10T14:33:53.457238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1143, pipe: [1:7559601287519052168:4179]
2025-10-10T14:33:53.525566Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:53.525878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.525897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.525946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052168:4179], now have 1 active actors on pipe
2025-10-10T14:33:53.526233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:53.526247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:53.526256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601287519052168:4179]
2025-10-10T14:33:53.526288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:53.526325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1144 reason: error at write: Disconnected sessionId: src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0
2025-10-10T14:33:53.526575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1144 sessionId: src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0 is DEAD
2025-10-10T14:33:53.526679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:53.526738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:53.526746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0] Write session will restart in 0.006137s
2025-10-10T14:33:53.526769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0] Write session: Do CDS request
2025-10-10T14:33:53.526775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:53.533897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.534029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:53.534046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1145
2025-10-10T14:33:53.534190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.534250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:53.534261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:53.534265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:53.534720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1145 sessionId:  describe result for acl check
2025-10-10T14:33:53.534767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:53.534775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:53.534777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:53.534783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601287519052196:3840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:53.535423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601287519052196:3840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:53.538314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601287519052196:3840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:53.541489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601287519052196:3840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:53.541516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601287519052196:3840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:53.541520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601287519052196:3840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:53.541533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:53.544585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:53.547209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:53.547529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:53.547549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:53.547564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:53.547632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:53.547680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601286736830004:7205]
2025-10-10T14:33:53.548326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:53.549268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:53.549326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:53.549701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:53.549777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.549784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.549785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.549787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.549788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.549790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.549791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.549793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.549794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.549795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.549797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.549798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.549799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.549806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.549819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.549824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.549839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.549843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.549847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.549852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.549856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.549861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.549865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.549868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.549872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.549876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.549884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.549893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.549900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.549912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.549917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.549927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.549932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.549942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.549947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.549956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.549961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.549971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.549976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.549986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.549991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.549999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.550011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.550022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.550026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.550031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.550041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.550047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.550051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.550057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.550062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.550068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.550125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:53.553179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:53.553798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:53.553814Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:53.553816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:53.553820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:53.553827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1144 [2:7559601286736830004:7205]
2025-10-10T14:33:53.553840Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:53.553864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:53.553872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.553876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.553878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.553895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:53.553910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:53.553919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:53.553992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.553994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.553997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.553999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:53.554073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:53.554076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.554090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.554101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.554118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:53.554140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052361:3840], now have 1 active actors on pipe
2025-10-10T14:33:53.554144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052170:2438], now have 1 active actors on pipe
2025-10-10T14:33:53.554152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601286736829999:7205]
2025-10-10T14:33:53.554155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601286736829999:7205]
2025-10-10T14:33:53.554159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601286736829999:7205]
2025-10-10T14:33:53.554168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:53.554177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:53.554180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:53.554182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:53.554185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:53.554203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:53.554207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:53.554235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601286736829999:7205]
2025-10-10T14:33:53.554245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:53.554251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:53.554412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1144
2025-10-10T14:33:53.554443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1144
2025-10-10T14:33:53.554620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.554638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.554678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:53.554693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.554702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.554705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:53.554718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.554736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:53.554760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.555012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.555026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.555049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.555223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1145 partition: 0 MaxSeqNo: 40 sessionId: src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0
2025-10-10T14:33:53.555634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba2a2791-a7a3bfa2-46b7bda5-6d8f304e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:53.558273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0] Write session: try to update token
2025-10-10T14:33:53.558290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:53.574995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId: src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:53.577867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:53.578111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.578146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.578191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:53.578307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:53.588879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:53.588900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:53.588903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:53.588905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:53.588917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601286736829999:7205]
2025-10-10T14:33:53.588924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601286736829999:7205]
2025-10-10T14:33:53.588928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601286736829999:7205]
2025-10-10T14:33:53.588977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:53.588976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:53.588983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:53.588984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.588986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:53.588988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:53.589121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:53.626297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601287519052407:4179]
2025-10-10T14:33:53.626614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1144, pipe: [1:7559601287519052407:4179]
2025-10-10T14:33:53.705632Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:53.713348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.713375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.713556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.713621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.713686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.713758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.714026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.714038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.714111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.714184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.714254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.714323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.714367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.714375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.714440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.714506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.714568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.714627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.714672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.714680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.714752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.714809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.714869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.714928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.714969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.714976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.715045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.715101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.715168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.715225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.715274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.715281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.715342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.715402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.715462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.715529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.715573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.715580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.715649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.715707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.715769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.715838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.715883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.715890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.715960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.716023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.716088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.716166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.716212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.716219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.716293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.716357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.716421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.716485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.716534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.716542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.716610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:53.716679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:53.716741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:53.716807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:53.716852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:53.716859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:53.716924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052407:4179], now have 1 active actors on pipe
2025-10-10T14:33:53.717152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:53.717154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601287519052407:4179]
2025-10-10T14:33:53.717167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:53.717179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:53.717202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1145 reason: error at write: Disconnected sessionId: src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0
2025-10-10T14:33:53.717458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1145 sessionId: src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0 is DEAD
2025-10-10T14:33:53.717668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:53.717687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0] Write session will restart in 0.006841s
2025-10-10T14:33:53.717713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0] Write session: Do CDS request
2025-10-10T14:33:53.717719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:53.717851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:53.725944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.726064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:53.726080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1146
2025-10-10T14:33:53.726250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.726286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:53.726297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:53.726301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:53.726735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1146 sessionId:  describe result for acl check
2025-10-10T14:33:53.726786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:53.726794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:53.726796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:53.726802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601287519052466:3835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:53.727362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601287519052466:3835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:53.730473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601287519052466:3835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:53.733404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601287519052466:3835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:53.733419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601287519052466:3835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:53.733423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601287519052466:3835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:53.733433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:53.734007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:53.736312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:53.736556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:53.736566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:53.736579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:53.736638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:53.736682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601286736830232:7208]
2025-10-10T14:33:53.737152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:53.737463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:53.737523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:53.737798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:53.737857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.737862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.737864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.737865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.737866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.737868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.737869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.737870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.737872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.737874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.737876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.737877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.737883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.737896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.737901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.737906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.737910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.737915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.737918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.737923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.737928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.737933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.737942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.737946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.737951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.737960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.737973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.737983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.737990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.737998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.738003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.738007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.738012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.738017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.738023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.738028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.738033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.738038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.738047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.738052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.738062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.738067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.738077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.738082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.738091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.738098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.738107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.738112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.738117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.738125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.738131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.738174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:53.740614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:53.741065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:53.741078Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:53.741081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:53.741085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:53.741091Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1145 [2:7559601286736830232:7208]
2025-10-10T14:33:53.741105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:53.741131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:53.741138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.741142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.741145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.741162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:53.741174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:53.741183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:53.741253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.741260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.741262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.741264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:53.741346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:53.741354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.741367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.741384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.741405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:53.741432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052413:2438], now have 1 active actors on pipe
2025-10-10T14:33:53.741442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052630:3835], now have 1 active actors on pipe
2025-10-10T14:33:53.741450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601286736830227:7208]
2025-10-10T14:33:53.741453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601286736830227:7208]
2025-10-10T14:33:53.741455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601286736830227:7208]
2025-10-10T14:33:53.741471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:53.741462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1145
2025-10-10T14:33:53.741477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:53.741464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1145
2025-10-10T14:33:53.741480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:53.741481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:53.741487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:53.741505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:53.741508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:53.741552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.741557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.741574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601286736830227:7208]
2025-10-10T14:33:53.741588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:53.741602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:53.741629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e373126-c06afc08-b32a5d77-4f90256d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:53.741642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.741646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.741654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:53.741666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.741681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:53.741708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.741867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.741875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.741889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.742091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1146 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e373126-c06afc08-b32a5d77-4f90256d_0
2025-10-10T14:33:53.742518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20a6090a-496ecba8-c0f3ff73-347dae63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e373126-c06afc08-b32a5d77-4f90256d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:53.745320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e373126-c06afc08-b32a5d77-4f90256d_0] Write session: try to update token
2025-10-10T14:33:53.745365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e373126-c06afc08-b32a5d77-4f90256d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:53.759574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId: src_id|8e373126-c06afc08-b32a5d77-4f90256d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:53.761757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:53.761779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:53.761782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:53.761784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:53.761795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601286736830227:7208]
2025-10-10T14:33:53.761799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601286736830227:7208]
2025-10-10T14:33:53.761805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601286736830227:7208]
2025-10-10T14:33:53.761855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:53.761858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:53.761862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:53.761865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.761867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:53.761868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:53.762013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:53.762363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:53.817298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601287519052644:4179]
2025-10-10T14:33:53.817608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1145, pipe: [1:7559601287519052644:4179]
2025-10-10T14:33:53.875499Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:53.875874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.875891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.875942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052644:4179], now have 1 active actors on pipe
2025-10-10T14:33:53.876142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:53.876194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:53.876194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:53.876199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:53.876263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1146 reason: error at write: Disconnected sessionId: src_id|8e373126-c06afc08-b32a5d77-4f90256d_0
2025-10-10T14:33:53.876270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601287519052644:4179]
2025-10-10T14:33:53.876494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1146 sessionId: src_id|8e373126-c06afc08-b32a5d77-4f90256d_0 is DEAD
2025-10-10T14:33:53.876647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e373126-c06afc08-b32a5d77-4f90256d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:53.876659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e373126-c06afc08-b32a5d77-4f90256d_0] Write session will restart in 0.006525s
2025-10-10T14:33:53.876684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e373126-c06afc08-b32a5d77-4f90256d_0] Write session: Do CDS request
2025-10-10T14:33:53.876695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e373126-c06afc08-b32a5d77-4f90256d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:53.884910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e373126-c06afc08-b32a5d77-4f90256d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.884987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:53.885002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1147
2025-10-10T14:33:53.885146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:53.885192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:53.885202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:53.885206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:53.885671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1147 sessionId:  describe result for acl check
2025-10-10T14:33:53.885710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:53.885712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:53.885713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:53.885720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601287519052705:3827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:53.886271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601287519052705:3827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:53.889141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601287519052705:3827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:53.891547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601287519052705:3827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:53.891561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601287519052705:3827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:53.891565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601287519052705:3827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:53.891572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:53.891592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:53.894070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:53.894296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:53.894307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:53.894319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:53.894376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:53.894418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601286736830459:7210]
2025-10-10T14:33:53.895035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:53.895358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:53.895402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:53.895718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:53.895778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.895784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.895786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.895787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.895788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.895790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.895791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.895792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.895793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.895794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.895796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.895797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.895798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.895804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.895818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.895822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.895827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.895831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.895835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.895839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.895843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.895847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.895851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.895856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.895860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.895864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.895872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.895881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:53.895888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.895893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:53.895898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.895903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:53.895908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.895913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:53.895918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.895923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:53.895932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.895937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:53.895942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.895947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:53.895952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.895957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:53.895962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.895972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:53.895977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.895982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:53.895991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.895997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.896006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.896011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.896016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.896026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.896066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:53.898555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:53.898937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:53.898950Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:53.898952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:53.898955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:53.898961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1146 [2:7559601286736830459:7210]
2025-10-10T14:33:53.898975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:53.898991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:53.898999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.899002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.899005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.899022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:53.899032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:53.899038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:53.899101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.899106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.899107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.899109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:53.899158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:53.899174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.899186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:53.899202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:53.899222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:53.899242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052645:2438], now have 1 active actors on pipe
2025-10-10T14:33:53.899248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052864:3827], now have 1 active actors on pipe
2025-10-10T14:33:53.899254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601286736830453:7210]
2025-10-10T14:33:53.899255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601286736830453:7210]
2025-10-10T14:33:53.899257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601286736830453:7210]
2025-10-10T14:33:53.899266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:53.899276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:53.899290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:53.899296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:53.899293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1146
2025-10-10T14:33:53.899314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:53.899301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1146
2025-10-10T14:33:53.899315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601286736830453:7210]
2025-10-10T14:33:53.899317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:53.899325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:53.899327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:53.899334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:53.899360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.899367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.899390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:53.899401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:53.899405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:53.899412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:53.899423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:53.899439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:53.899458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.899657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.899673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.899700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:53.899835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1147 partition: 0 MaxSeqNo: 40 sessionId: src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0
2025-10-10T14:33:53.900275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e373126-c06afc08-b32a5d77-4f90256d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:53.903183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0] Write session: try to update token
2025-10-10T14:33:53.903206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:53.916650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:53.916667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:53.916678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601286736830453:7210]
2025-10-10T14:33:53.916741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:53.916744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:53.916917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:53.917080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:53.917218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:53.917394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:53.917591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:53.917637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:53.918013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId: src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:53.920518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:53.921025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:53.921043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:53.921082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:53.921168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:53.928798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:53.928816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:53.928820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:53.928822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:53.928832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601286736830453:7210]
2025-10-10T14:33:53.928836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601286736830453:7210]
2025-10-10T14:33:53.928840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601286736830453:7210]
2025-10-10T14:33:53.928883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:53.928887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:53.928890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:53.928894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:53.928895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:53.928897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:53.929031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:53.976513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601287519052877:4179]
2025-10-10T14:33:53.976790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1146, pipe: [1:7559601287519052877:4179]
2025-10-10T14:33:54.044101Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:54.052940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.052974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.053157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.053216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.053298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.053388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.053743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.053758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.053827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.053895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.053959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.054033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.054081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.054089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.054157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.054221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.054283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.054347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.054389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.054396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.054462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.054529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.054599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.054673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.054720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.054729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.054794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.054855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.054917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.054980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.055024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.055031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.055098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.055162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.055221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.055291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.055335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.055344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.055410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.055474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.055540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.055611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.055657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.055664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.055728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.055790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.055854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.055915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.055957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.055964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.056032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.056089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.056151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.056214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.056260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.056270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.056343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.056416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.056489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.056558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.056604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.056612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.056673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601287519052877:4179], now have 1 active actors on pipe
2025-10-10T14:33:54.056941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:54.056969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601287519052877:4179]
2025-10-10T14:33:54.056999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:54.057002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:54.057034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1147 reason: error at write: Disconnected sessionId: src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0
2025-10-10T14:33:54.057276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1147 sessionId: src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0 is DEAD
2025-10-10T14:33:54.057381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:54.057434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:54.057463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0] Write session will restart in 0.007437s
2025-10-10T14:33:54.057489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0] Write session: Do CDS request
2025-10-10T14:33:54.057495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:54.065921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.066028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:54.066044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1148
2025-10-10T14:33:54.066191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.066227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:54.066238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:54.066243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:54.066704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1148 sessionId:  describe result for acl check
2025-10-10T14:33:54.066745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:54.066751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:54.066752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:54.066759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601291814020205:3820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:54.067352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601291814020205:3820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:54.070810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601291814020205:3820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:54.074240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601291814020205:3820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:54.074255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601291814020205:3820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:54.074259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601291814020205:3820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:54.074268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:54.074809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:54.077140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:54.077513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:54.077526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:54.077541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:54.077620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:54.077668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601291031797983:7212]
2025-10-10T14:33:54.078375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:54.078743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:54.078793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:54.079144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:54.079205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.079212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.079213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.079215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.079216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.079218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.079219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.079221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.079222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.079223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.079225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.079226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.079227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.079233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.079247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.079252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.079256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.079260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.079264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.079269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.079273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.079278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.079283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.079287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.079291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.079296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.079304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.079314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.079321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.079331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.079337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.079343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.079347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.079353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.079358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.079363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.079368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.079374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.079384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.079389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.079399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.079405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.079411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.079424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.079435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.079441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.079450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.079456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.079465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.079471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.079480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.079486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.079529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:54.082097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:54.082819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:54.082831Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:54.082834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:54.082838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:54.082844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1147 [2:7559601291031797983:7212]
2025-10-10T14:33:54.082857Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:54.082875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:54.082881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.082885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.082888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.082906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:54.082914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:54.082928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:54.082989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.082997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.083000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.083002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:54.083072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:54.083080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.083092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.083104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.083128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:54.083155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020394:3820], now have 1 active actors on pipe
2025-10-10T14:33:54.083165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020175:2438], now have 1 active actors on pipe
2025-10-10T14:33:54.083172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601291031797978:7212]
2025-10-10T14:33:54.083179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601291031797978:7212]
2025-10-10T14:33:54.083181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601291031797978:7212]
2025-10-10T14:33:54.083196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:54.083215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:54.083216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1147
2025-10-10T14:33:54.083218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:54.083220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:54.083219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1147
2025-10-10T14:33:54.083222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:54.083237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:54.083240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:54.083272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601291031797978:7212]
2025-10-10T14:33:54.083286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:54.083290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:54.083435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.083446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.083482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:54.083496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.083503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.083505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:54.083518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.083534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:54.083554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.083704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.083712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.083727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.083825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1148 partition: 0 MaxSeqNo: 40 sessionId: src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0
2025-10-10T14:33:54.084296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55301fc4-d07e5fe5-1aadda88-d2c7b20e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:54.087042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0] Write session: try to update token
2025-10-10T14:33:54.087066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:54.101431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId: src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:54.104072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:54.105809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.105835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.105861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:54.105864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:54.105867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:54.105869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:54.105878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601291031797978:7212]
2025-10-10T14:33:54.105883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601291031797978:7212]
2025-10-10T14:33:54.105887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601291031797978:7212]
2025-10-10T14:33:54.105934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:54.105947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:54.105951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:54.105953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:54.105961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.105964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:54.106094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:54.157217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601291814020408:4179]
2025-10-10T14:33:54.157539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1147, pipe: [1:7559601291814020408:4179]
2025-10-10T14:33:54.220430Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:54.220701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:54.220766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020408:4179], now have 1 active actors on pipe
2025-10-10T14:33:54.220856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:54.221051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601291814020408:4179]
2025-10-10T14:33:54.221084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:54.232609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:54.232625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:54.232654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1148 reason: error at write: Disconnected sessionId: src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0
2025-10-10T14:33:54.232826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1148 sessionId: src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0 is DEAD
2025-10-10T14:33:54.232980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:54.232988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0] Write session will restart in 0.007273s
2025-10-10T14:33:54.233012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0] Write session: Do CDS request
2025-10-10T14:33:54.233019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:54.241905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.241981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:54.241999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1149
2025-10-10T14:33:54.242137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.242170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:54.242181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:54.242186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:54.242654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1149 sessionId:  describe result for acl check
2025-10-10T14:33:54.242694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:54.242696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:54.242698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:54.242705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601291814020601:3816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:54.243299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601291814020601:3816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:54.243643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:54.245913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601291814020601:3816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:54.246492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:54.246721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:54.246734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:54.246746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:54.246816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:54.246862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601291031798211:7214]
2025-10-10T14:33:54.247472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:54.247816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:54.247881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:54.248209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:54.248293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.248301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.248302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.248304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.248305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.248307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.248309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.248310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.248311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.248313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.248314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.248315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.248317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.248323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.248336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.248340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.248345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.248349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.248354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.248358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.248363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.248367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.248372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.248376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.248381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.248385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.248394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.248404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.248418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.248423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.248427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.248431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.248436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.248442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.248446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.248451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.248456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.248460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.248466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.248470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.248474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.248479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.248483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.248488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.248493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.248498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.248504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.248516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.248520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.248530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.248535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.248540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.248588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601291814020601:3816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:54.248603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601291814020601:3816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:54.248607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601291814020601:3816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:54.248595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:54.248615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:54.251118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:54.251562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:54.251582Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:54.251584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:54.251588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:54.251595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1148 [2:7559601291031798211:7214]
2025-10-10T14:33:54.251607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:54.251629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:54.251637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.251641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.251648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.251665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:54.251677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:54.251689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:54.251752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.251760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.251762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.251765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:54.251842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:54.251850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.251862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.251874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.251891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:54.251911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020409:2438], now have 1 active actors on pipe
2025-10-10T14:33:54.251919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020634:3816], now have 1 active actors on pipe
2025-10-10T14:33:54.251928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601291031798206:7214]
2025-10-10T14:33:54.251930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601291031798206:7214]
2025-10-10T14:33:54.251932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601291031798206:7214]
2025-10-10T14:33:54.251942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:54.251960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:54.251963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:54.251966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:54.251967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:54.251980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:54.251983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:54.251988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1148
2025-10-10T14:33:54.252008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601291031798206:7214]
2025-10-10T14:33:54.251992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1148
2025-10-10T14:33:54.252015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:54.252027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:54.252044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.252053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.252093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:54.252105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.252112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.252114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:54.252125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.252150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:54.252177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.252326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.252340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.252360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.252445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1149 partition: 0 MaxSeqNo: 40 sessionId: src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0
2025-10-10T14:33:54.252869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2935cc-8c5fc9a5-3f09e8e7-1ce9b5ac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:54.255700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0] Write session: try to update token
2025-10-10T14:33:54.255719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:54.269594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId: src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:54.271348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:54.271368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:54.271371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:54.271373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:54.271382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601291031798206:7214]
2025-10-10T14:33:54.271387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601291031798206:7214]
2025-10-10T14:33:54.271391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601291031798206:7214]
2025-10-10T14:33:54.271441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:54.271444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:54.271452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.271455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:54.271455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:54.271459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:54.271592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:54.272250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:54.321115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601291814020657:4179]
2025-10-10T14:33:54.321467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1148, pipe: [1:7559601291814020657:4179]
2025-10-10T14:33:54.389260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:54.389668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.389683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.389734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020657:4179], now have 1 active actors on pipe
2025-10-10T14:33:54.389941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:54.391288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601291814020657:4179]
2025-10-10T14:33:54.391290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:54.391320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:54.391377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1149 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0
2025-10-10T14:33:54.391586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1149 sessionId: src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0 is DEAD
2025-10-10T14:33:54.393564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:54.393577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0] Write session will restart in 0.008015s
2025-10-10T14:33:54.393603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0] Write session: Do CDS request
2025-10-10T14:33:54.393609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:54.402996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.403051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:54.403070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1150
2025-10-10T14:33:54.403239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.403276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:54.403287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:54.403290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:54.404090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1150 sessionId:  describe result for acl check
2025-10-10T14:33:54.404134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:54.404142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:54.404144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:54.404150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601291814020695:3791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:54.404743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601291814020695:3791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:54.407739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601291814020695:3791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:54.411734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601291814020695:3791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:54.411749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601291814020695:3791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:54.411753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601291814020695:3791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:54.411762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:54.414705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:54.417175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:54.417443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:54.417455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:54.417467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:54.417535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:54.417581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601291031798481:7229]
2025-10-10T14:33:54.418232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:54.418554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:54.418598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:54.418912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:54.418971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.418979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.418981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.418982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.418983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.418985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.418986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.418987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.418988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.418990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.418991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.418992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.418993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.418999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.419012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.419016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.419020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.419024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.419028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.419032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.419035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.419039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.419043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.419047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.419051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.419054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.419062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.419070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.419077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.419082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.419086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.419091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.419095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.419100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.419105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.419110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.419114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.419120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.419125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.419129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.419136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.419141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.419145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.419150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.419154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.419160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.419164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.419169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.419174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.419184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.419189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.419194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.419232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:54.421835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:54.422290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:54.422306Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:54.422308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:54.422312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:54.422318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1149 [2:7559601291031798481:7229]
2025-10-10T14:33:54.422331Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:54.422349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:54.422357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.422361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.422363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.422381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:54.422391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:54.422399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:54.422460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.422467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.422469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.422472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:54.422659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:54.422671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.422665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1149
2025-10-10T14:33:54.422685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1149
2025-10-10T14:33:54.422683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.422695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.422712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:54.422739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020870:3791], now have 1 active actors on pipe
2025-10-10T14:33:54.422743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020669:2438], now have 1 active actors on pipe
2025-10-10T14:33:54.422758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.422763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.422785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601291031798476:7229]
2025-10-10T14:33:54.422787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601291031798476:7229]
2025-10-10T14:33:54.422789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601291031798476:7229]
2025-10-10T14:33:54.422798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:54.422817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:54.422818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:54.422822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:54.422824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:54.422835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:54.422846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:54.422868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46afdc32-c08b4d80-d6d354d2-de816582_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:54.422881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.422887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.422895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:54.422908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.422920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:54.422959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601291031798476:7229]
2025-10-10T14:33:54.422971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:54.422980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:54.422983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.423163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.423177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.423199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.423307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1150 partition: 0 MaxSeqNo: 40 sessionId: src_id|46afdc32-c08b4d80-d6d354d2-de816582_0
2025-10-10T14:33:54.423731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7e8133d-571bfb3-b089fbfe-35effdfb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|46afdc32-c08b4d80-d6d354d2-de816582_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:54.426508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46afdc32-c08b4d80-d6d354d2-de816582_0] Write session: try to update token
2025-10-10T14:33:54.426527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46afdc32-c08b4d80-d6d354d2-de816582_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:54.443777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:54.443800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:54.443804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:54.443806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:54.443818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601291031798476:7229]
2025-10-10T14:33:54.443824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601291031798476:7229]
2025-10-10T14:33:54.443828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601291031798476:7229]
2025-10-10T14:33:54.443885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:54.443905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.443907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:54.444071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:54.444774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId: src_id|46afdc32-c08b4d80-d6d354d2-de816582_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:54.445443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:54.445458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:54.445464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:54.447489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:54.491616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601291814020916:4179]
2025-10-10T14:33:54.491924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1149, pipe: [1:7559601291814020916:4179]
2025-10-10T14:33:54.563236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:54.563594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.563610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.563657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020916:4179], now have 1 active actors on pipe
2025-10-10T14:33:54.563875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:54.563939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601291814020916:4179]
2025-10-10T14:33:54.563943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:54.563947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:54.563976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:54.564022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1150 reason: error at write: Disconnected sessionId: src_id|46afdc32-c08b4d80-d6d354d2-de816582_0
2025-10-10T14:33:54.564269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1150 sessionId: src_id|46afdc32-c08b4d80-d6d354d2-de816582_0 is DEAD
2025-10-10T14:33:54.564446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46afdc32-c08b4d80-d6d354d2-de816582_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:54.564459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46afdc32-c08b4d80-d6d354d2-de816582_0] Write session will restart in 0.005867s
2025-10-10T14:33:54.564485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46afdc32-c08b4d80-d6d354d2-de816582_0] Write session: Do CDS request
2025-10-10T14:33:54.564492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46afdc32-c08b4d80-d6d354d2-de816582_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:54.571965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46afdc32-c08b4d80-d6d354d2-de816582_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.573427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:54.573445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1151
2025-10-10T14:33:54.573616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.573668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:54.573683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:54.573689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:54.574295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1151 sessionId:  describe result for acl check
2025-10-10T14:33:54.574333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:54.574340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:54.574342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:54.574349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601291814020960:3787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:54.574910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601291814020960:3787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:54.577974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601291814020960:3787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:54.581746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601291814020960:3787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:54.581764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601291814020960:3787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:54.581768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601291814020960:3787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:54.581778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:54.583491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:54.586028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:54.586269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:54.586280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:54.586291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:54.586353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:54.586397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601291031798726:7232]
2025-10-10T14:33:54.587051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:54.587428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:54.587486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:54.588010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:54.588082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.588092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.588093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.588095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.588096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.588097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.588099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.588100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.588101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.588102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.588104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.588105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.588106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.588113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.588127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.588131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.588136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.588140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.588144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.588148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.588152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.588156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.588161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.588165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.588169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.588173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.588181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.588190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.588197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.588204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.588208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.588218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.588223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.588228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.588233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.588238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.588247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.588252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.588262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.588268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.588272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.588282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.588286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.588292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.588301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.588307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.588311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.588317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.588321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.588326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.588331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.588337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.588400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:54.590959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:54.591284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:54.591297Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:54.591300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:54.591304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:54.591311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1150 [2:7559601291031798726:7232]
2025-10-10T14:33:54.591328Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:54.591351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:54.591358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.591362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.591364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.591381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:54.591394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:54.591403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:54.591474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.591481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.591483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.591485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:54.591685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1150
2025-10-10T14:33:54.591745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1150
2025-10-10T14:33:54.591795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:54.591803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.591816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.591828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.591854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:54.591879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814020921:2438], now have 1 active actors on pipe
2025-10-10T14:33:54.591888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814021142:3787], now have 1 active actors on pipe
2025-10-10T14:33:54.591907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.591918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.591938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601291031798721:7232]
2025-10-10T14:33:54.591946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601291031798721:7232]
2025-10-10T14:33:54.591948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601291031798721:7232]
2025-10-10T14:33:54.591965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:54.591983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:54.591987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:54.591991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:54.591993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:54.592003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:54.592007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:54.592029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:54.592042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.592051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.592054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:54.592067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.592084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:54.592121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601291031798721:7232]
2025-10-10T14:33:54.592138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:54.592150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.592154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:54.592344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.592353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.592370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.592489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1151 partition: 0 MaxSeqNo: 40 sessionId: src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0
2025-10-10T14:33:54.592914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46afdc32-c08b4d80-d6d354d2-de816582_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:54.595809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0] Write session: try to update token
2025-10-10T14:33:54.595827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:54.610219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:54.610234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:54.610244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601291031798721:7232]
2025-10-10T14:33:54.610291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:54.610302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:54.610403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId: src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:54.610471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:54.610622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:54.610775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:54.610928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:54.611238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:54.611281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:54.613074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:54.613315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.613345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.613382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:54.613457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:54.621989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:54.622008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:54.622011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:54.622012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:54.622023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601291031798721:7232]
2025-10-10T14:33:54.622026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601291031798721:7232]
2025-10-10T14:33:54.622030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601291031798721:7232]
2025-10-10T14:33:54.622077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:54.622076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:54.622084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:54.622089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:54.622094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.622097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:54.622227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:54.664122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601291814021169:4179]
2025-10-10T14:33:54.664411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1150, pipe: [1:7559601291814021169:4179]
2025-10-10T14:33:54.738873Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:54.747062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.747093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.747280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.747358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.747427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.747500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.747551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.747566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.747639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.747711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.747779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.747852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.747901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.747909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.747978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.748044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.748110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.748181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.748230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.748238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.748310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.748380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.748446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.748517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.748562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.748571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.748642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.748712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.748781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.748854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.748902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.748912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.748983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.749048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.749119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.749191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.749253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.749261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.749356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.749422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.749489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.749554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.749602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.749611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.749685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.749754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.749822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.749889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.749935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.749944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.750011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.750069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.750135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.750202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.750252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.750261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.750330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:54.750393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:54.750460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:54.750522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:54.750575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:54.750587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:54.750654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814021169:4179], now have 1 active actors on pipe
2025-10-10T14:33:54.750919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:54.750933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:54.750966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1151 reason: error at write: Disconnected sessionId: src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0
2025-10-10T14:33:54.751189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1151 sessionId: src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0 is DEAD
2025-10-10T14:33:54.751211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:54.751262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601291814021169:4179]
2025-10-10T14:33:54.751309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:54.751319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0] Write session will restart in 0.008877s
2025-10-10T14:33:54.751344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0] Write session: Do CDS request
2025-10-10T14:33:54.751351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:54.751798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:54.765875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.765957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:54.765988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1152
2025-10-10T14:33:54.766186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.766226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:54.766245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:54.766254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:54.766736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1152 sessionId:  describe result for acl check
2025-10-10T14:33:54.766779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:54.766782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:54.766783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:54.766791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601291814021364:3779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:54.767372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601291814021364:3779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:54.768182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:54.770415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601291814021364:3779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:54.770712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:54.770928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:54.770941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:54.770960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:54.771030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:54.771085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601291031798960:7235]
2025-10-10T14:33:54.771716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:54.772045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:54.772096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:54.772438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:54.772511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.772518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.772520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.772521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.772522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.772523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.772525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.772527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.772528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.772529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.772530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.772532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.772533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.772539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.772552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.772557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.772562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.772566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.772570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.772574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.772578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.772582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.772586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.772591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.772594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.772599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.772609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.772618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.772624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.772629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.772634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.772639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.772643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.772648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.772652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.772657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.772661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.772666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.772687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.772692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.772697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.772703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.772709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.772715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.772719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.772726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.772730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.772737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.772742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.772748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.772758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.772763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.772808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:54.773414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601291814021364:3779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:54.773427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601291814021364:3779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:54.773430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601291814021364:3779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:54.773437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:54.775239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:54.775671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:54.775691Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:54.775694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:54.775698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:54.775704Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1151 [2:7559601291031798960:7235]
2025-10-10T14:33:54.775718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:54.775737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:54.775739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.775743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.775746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.775762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:54.775770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:54.775785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:54.775848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.775855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.775858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.775861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:54.775924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:54.775933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.775945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.775959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.775978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:54.776007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814021171:2438], now have 1 active actors on pipe
2025-10-10T14:33:54.776016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814021400:3779], now have 1 active actors on pipe
2025-10-10T14:33:54.776024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601291031798955:7235]
2025-10-10T14:33:54.776030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601291031798955:7235]
2025-10-10T14:33:54.776033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601291031798955:7235]
2025-10-10T14:33:54.776048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:54.776039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1151
2025-10-10T14:33:54.776066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:54.776044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1151
2025-10-10T14:33:54.776070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:54.776076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:54.776078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:54.776088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:54.776091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:54.776143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.776153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.776168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601291031798955:7235]
2025-10-10T14:33:54.776185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:54.776217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:54.776218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:54.776230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.776234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.776237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:54.776250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.776264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:54.776291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.776461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.776469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.776485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.776563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1152 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0
2025-10-10T14:33:54.777042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65eb4a57-69629adc-a98d4c73-5f7ea777_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:54.779800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0] Write session: try to update token
2025-10-10T14:33:54.779824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:54.794656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId: src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:54.796247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:54.796270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:54.796273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:54.796276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:54.796285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601291031798955:7235]
2025-10-10T14:33:54.796290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601291031798955:7235]
2025-10-10T14:33:54.796293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601291031798955:7235]
2025-10-10T14:33:54.796349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:54.796351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:54.796358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:54.796363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.796363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:54.796365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:54.796501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:54.797248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:54.851537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601291814021408:4179]
2025-10-10T14:33:54.851767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1151, pipe: [1:7559601291814021408:4179]
2025-10-10T14:33:54.910594Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:54.911021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.911037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.911085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814021408:4179], now have 1 active actors on pipe
2025-10-10T14:33:54.911290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:54.911309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:54.911319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601291814021408:4179]
2025-10-10T14:33:54.911325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:54.911342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:54.911391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1152 reason: error at write: Disconnected sessionId: src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0
2025-10-10T14:33:54.911614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1152 sessionId: src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0 is DEAD
2025-10-10T14:33:54.911754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:54.911764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0] Write session will restart in 0.009714s
2025-10-10T14:33:54.911800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0] Write session: Do CDS request
2025-10-10T14:33:54.911808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:54.922919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.923050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:54.923067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1153
2025-10-10T14:33:54.923196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:54.923231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:54.923243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:54.923247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:54.923750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1153 sessionId:  describe result for acl check
2025-10-10T14:33:54.923789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:54.923798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:54.923800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:54.923807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601291814021496:3775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:54.924360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601291814021496:3775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:54.927603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601291814021496:3775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:54.930273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:54.930542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601291814021496:3775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:54.930556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601291814021496:3775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:54.930560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601291814021496:3775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:54.930569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:54.932613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:54.932838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:54.932848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:54.932860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:54.932923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:54.932965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601291031799195:7237]
2025-10-10T14:33:54.933592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:54.933859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:54.933897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:54.934202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:54.934254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.934259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.934260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.934261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.934263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.934264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.934265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.934266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.934267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.934268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.934270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.934271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.934272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.934278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.934292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.934296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.934300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.934304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.934308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.934312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.934316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.934320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.934324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.934328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.934332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.934336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.934343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.934351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:54.934358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.934363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:54.934368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.934373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:54.934377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.934382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:54.934387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.934393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:54.934397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.934402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:54.934407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.934412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:54.934416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.934421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:54.934426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.934431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:54.934450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.934460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:54.934464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.934469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.934479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.934484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.934489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.934498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.934536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:54.937019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:54.937376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:54.937387Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:54.937389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:54.937394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:54.937400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1152 [2:7559601291031799195:7237]
2025-10-10T14:33:54.937413Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:54.937431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:54.937439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.937443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.937445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.937463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:54.937488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:54.937500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:54.937555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.937561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.937563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.937566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:54.937631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:54.937643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.937653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:54.937665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:54.937682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:54.937704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814021409:2438], now have 1 active actors on pipe
2025-10-10T14:33:54.937713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601291814021635:3775], now have 1 active actors on pipe
2025-10-10T14:33:54.937721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601291031799189:7237]
2025-10-10T14:33:54.937723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601291031799189:7237]
2025-10-10T14:33:54.937725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601291031799189:7237]
2025-10-10T14:33:54.937738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:54.937752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:54.937756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:54.937758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:54.937759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:54.937774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:54.937782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:54.937766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1152
2025-10-10T14:33:54.937804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601291031799189:7237]
2025-10-10T14:33:54.937784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1152
2025-10-10T14:33:54.937815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:54.937820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:54.937836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.937845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.937892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:54.937903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:54.937907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:54.937909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:54.937920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:54.937935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:54.937960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.938119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:54.938126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:54.938140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:54.938220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1153 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0
2025-10-10T14:33:54.938658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f2c8-5fd6c3aa-67cdf51a-6211e669_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:54.941306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0] Write session: try to update token
2025-10-10T14:33:54.941325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:54.957587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:54.957609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:54.957612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:54.957614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:54.957625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601291031799189:7237]
2025-10-10T14:33:54.957629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601291031799189:7237]
2025-10-10T14:33:54.957634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601291031799189:7237]
2025-10-10T14:33:54.957678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:54.957683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:54.957691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:54.957693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:54.957694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:54.957697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:54.957830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:54.957993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId: src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:54.960637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:55.011276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601296108988948:4179]
2025-10-10T14:33:55.011592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1152, pipe: [1:7559601296108988948:4179]
2025-10-10T14:33:55.073438Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:55.074084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.074103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.074152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108988948:4179], now have 1 active actors on pipe
2025-10-10T14:33:55.074472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:55.074475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601296108988948:4179]
2025-10-10T14:33:55.074504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:55.074586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1153 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0
2025-10-10T14:33:55.074378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:55.074806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1153 sessionId: src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0 is DEAD
2025-10-10T14:33:55.075176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:55.075200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0] Write session will restart in 0.007274s
2025-10-10T14:33:55.075226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0] Write session: Do CDS request
2025-10-10T14:33:55.075232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:55.083961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.084039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:55.084059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1154
2025-10-10T14:33:55.084197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.084232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:55.084243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:55.084247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:55.084680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1154 sessionId:  describe result for acl check
2025-10-10T14:33:55.084720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:55.084727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:55.084729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:55.084735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601296108989003:3771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:55.085318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601296108989003:3771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:55.088022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601296108989003:3771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:55.091670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601296108989003:3771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:55.091686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601296108989003:3771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:55.091691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601296108989003:3771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:55.091702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:55.092173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:55.094839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:55.095080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:55.095093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:55.095107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:55.095168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:55.095226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601295326766728:7239]
2025-10-10T14:33:55.095872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:55.096220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:55.096263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:55.096593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:55.096661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.096668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.096669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.096670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.096671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.096672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.096674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.096675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.096676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.096677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.096679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.096680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.096681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.096686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.096700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.096705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.096709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.096713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.096716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.096721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.096725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.096729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.096735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.096739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.096743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.096747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.096755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.096764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.096772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.096777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.096783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.096787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.096791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.096796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.096800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.096806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.096810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.096815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.096819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.096825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.096829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.096834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.096839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.096845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.096849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.096855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.096860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.096865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.096870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.096875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.096880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.096885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.096926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:55.099454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:55.099969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:55.099980Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:55.099983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:55.100002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:55.100012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1153 [2:7559601295326766728:7239]
2025-10-10T14:33:55.100025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:55.100046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:55.100054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.100057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.100059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.100076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:55.100096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:55.100109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:55.100169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.100176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.100179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.100181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:55.100246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:55.100254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.100266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.100282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.100304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:55.100329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108988949:2438], now have 1 active actors on pipe
2025-10-10T14:33:55.100337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989174:3771], now have 1 active actors on pipe
2025-10-10T14:33:55.100344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601295326766722:7239]
2025-10-10T14:33:55.100346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601295326766722:7239]
2025-10-10T14:33:55.100348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601295326766722:7239]
2025-10-10T14:33:55.100364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:55.100382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:55.100384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:55.100388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:55.100390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:55.100403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:55.100406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:55.100429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601295326766722:7239]
2025-10-10T14:33:55.100397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1153
2025-10-10T14:33:55.100436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:55.100404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1153
2025-10-10T14:33:55.100438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:55.100458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.100464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.100507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:55.100520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.100525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.100527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:55.100541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.100553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:55.100579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.100756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.100769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.100794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.100895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1154 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0
2025-10-10T14:33:55.101365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ebdb732-8fc33e1a-595e42c5-e220891d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:55.104191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0] Write session: try to update token
2025-10-10T14:33:55.104210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:55.119133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId: src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:55.120221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:55.120241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:55.120244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:55.120246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:55.120256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601295326766722:7239]
2025-10-10T14:33:55.120263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601295326766722:7239]
2025-10-10T14:33:55.120268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601295326766722:7239]
2025-10-10T14:33:55.120317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:55.120319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:55.120327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.120330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:55.120331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:55.120336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:55.120472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:55.122105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:55.174638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601296108989188:4179]
2025-10-10T14:33:55.174941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1153, pipe: [1:7559601296108989188:4179]
2025-10-10T14:33:55.237126Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:55.237666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.237686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.237735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989188:4179], now have 1 active actors on pipe
2025-10-10T14:33:55.237951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:55.237966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:55.237983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601296108989188:4179]
2025-10-10T14:33:55.238010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:55.238094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1154 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0
2025-10-10T14:33:55.238333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1154 sessionId: src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0 is DEAD
2025-10-10T14:33:55.238492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:55.238502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0] Write session will restart in 0.007275s
2025-10-10T14:33:55.238527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0] Write session: Do CDS request
2025-10-10T14:33:55.238534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:55.246909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.246989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:55.247007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1155
2025-10-10T14:33:55.247218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.247295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:55.247306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:55.247310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:55.247733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1155 sessionId:  describe result for acl check
2025-10-10T14:33:55.247777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:55.247779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:55.247781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:55.247786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601296108989235:3767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:55.248391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601296108989235:3767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:55.251496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601296108989235:3767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:55.255227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601296108989235:3767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:55.255252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601296108989235:3767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:55.255256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601296108989235:3767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:55.255263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:55.256336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:55.258969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:55.259217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:55.259229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:55.259244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:55.259311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:55.259370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601295326766964:7241]
2025-10-10T14:33:55.260034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:55.260332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:55.260379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:55.260710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:55.260786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.260793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.260794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.260795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.260797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.260798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.260799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.260801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.260802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.260804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.260805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.260807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.260808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.260815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.260829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.260834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.260838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.260842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.260846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.260849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.260854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.260858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.260862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.260867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.260871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.260876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.260885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.260894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.260902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.260908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.260914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.260920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.260925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.260931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.260943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.260949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.260963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.260969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.260975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.260981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.260986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.260993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.260997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.261004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.261009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.261014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.261019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.261023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.261029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.261035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.261041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.261052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.261089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:55.263638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:55.264109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:55.264123Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:55.264125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:55.264129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:55.264136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1154 [2:7559601295326766964:7241]
2025-10-10T14:33:55.264148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:55.264175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:55.264178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.264182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.264185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.264202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:55.264216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:55.264224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:55.264285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.264292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.264295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.264297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:55.264366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:55.264375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.264388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.264400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.264424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:55.264452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989414:3767], now have 1 active actors on pipe
2025-10-10T14:33:55.264462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989189:2438], now have 1 active actors on pipe
2025-10-10T14:33:55.264470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601295326766959:7241]
2025-10-10T14:33:55.264473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601295326766959:7241]
2025-10-10T14:33:55.264475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601295326766959:7241]
2025-10-10T14:33:55.264491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:55.264507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:55.264496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1154
2025-10-10T14:33:55.264497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1154
2025-10-10T14:33:55.264507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:55.264512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:55.264514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:55.264524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:55.264527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:55.264567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.264573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.264592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601295326766959:7241]
2025-10-10T14:33:55.264601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:55.264613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:55.264635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a7c6e08-eff44ac3-897ae778-38217911_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:55.264644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.264655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.264657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:55.264670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.264681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:55.264710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.264871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.264879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.264896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.265001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1155 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a7c6e08-eff44ac3-897ae778-38217911_0
2025-10-10T14:33:55.265462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9eafe-e3ece63c-42c8d047-c9705d4c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a7c6e08-eff44ac3-897ae778-38217911_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:55.268303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7c6e08-eff44ac3-897ae778-38217911_0] Write session: try to update token
2025-10-10T14:33:55.268324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7c6e08-eff44ac3-897ae778-38217911_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:55.282621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId: src_id|8a7c6e08-eff44ac3-897ae778-38217911_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:55.284359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:55.284395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:55.284399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:55.284401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:55.284412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601295326766959:7241]
2025-10-10T14:33:55.284417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601295326766959:7241]
2025-10-10T14:33:55.284421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601295326766959:7241]
2025-10-10T14:33:55.284468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:55.284472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:55.284480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:55.284481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.284483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:55.284484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:55.284625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:55.285272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:55.338776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601296108989429:4179]
2025-10-10T14:33:55.339209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1154, pipe: [1:7559601296108989429:4179]
2025-10-10T14:33:55.402559Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:55.403033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.403053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.403097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989429:4179], now have 1 active actors on pipe
2025-10-10T14:33:55.403321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:55.403788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601296108989429:4179]
2025-10-10T14:33:55.403819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:55.403910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1155 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a7c6e08-eff44ac3-897ae778-38217911_0
2025-10-10T14:33:55.404134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1155 sessionId: src_id|8a7c6e08-eff44ac3-897ae778-38217911_0 is DEAD
2025-10-10T14:33:55.404753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7c6e08-eff44ac3-897ae778-38217911_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:55.404763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7c6e08-eff44ac3-897ae778-38217911_0] Write session will restart in 0.008859s
2025-10-10T14:33:55.404799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7c6e08-eff44ac3-897ae778-38217911_0] Write session: Do CDS request
2025-10-10T14:33:55.404806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7c6e08-eff44ac3-897ae778-38217911_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:55.404329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:55.414962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7c6e08-eff44ac3-897ae778-38217911_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.415061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:55.415077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1156
2025-10-10T14:33:55.415244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.415298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:55.415309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:55.415314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:55.415918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1156 sessionId:  describe result for acl check
2025-10-10T14:33:55.415959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:55.415965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:55.415967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:55.415975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601296108989530:3739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:55.416558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601296108989530:3739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:55.419085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601296108989530:3739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:55.422240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601296108989530:3739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:55.422257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601296108989530:3739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:55.422260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601296108989530:3739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:55.422270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:55.423078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:55.425866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:55.426098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:55.426113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:55.426128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:55.426194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:55.426237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601295326767251:7251]
2025-10-10T14:33:55.426882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:55.427269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:55.427325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:55.427675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:55.427726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.427732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.427733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.427735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.427736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.427737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.427738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.427740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.427741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.427742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.427743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.427744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.427745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.427752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.427765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.427769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.427773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.427777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.427781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.427785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.427788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.427792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.427797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.427801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.427805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.427808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.427816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.427824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.427831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.427836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.427843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.427849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.427853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.427858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.427863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.427868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.427872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.427877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.427881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.427886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.427891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.427895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.427900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.427905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.427909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.427914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.427918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.427923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.427928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.427939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.427944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.427949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.427987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:55.430520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:55.431202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:55.431217Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:55.431219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:55.431222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:55.431228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1155 [2:7559601295326767251:7251]
2025-10-10T14:33:55.431240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:55.431267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:55.431280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.431283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.431286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.431302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:55.431310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:55.431318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:55.431377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.431386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.431388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.431390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:55.431451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:55.431460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.431471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.431483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.431501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:55.431523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989681:3739], now have 1 active actors on pipe
2025-10-10T14:33:55.431527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989446:2438], now have 1 active actors on pipe
2025-10-10T14:33:55.431534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601295326767234:7251]
2025-10-10T14:33:55.431536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601295326767234:7251]
2025-10-10T14:33:55.431538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601295326767234:7251]
2025-10-10T14:33:55.431553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:55.431567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:55.431583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:55.431592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:55.431616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601295326767234:7251]
2025-10-10T14:33:55.431624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:55.431770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:55.431781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:55.431784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:55.431791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:55.431848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.431859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.431893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:55.431905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.431910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.431913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:55.431924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.431935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:55.431951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.432302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.432328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.432353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.432987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a7c6e08-eff44ac3-897ae778-38217911_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:55.431654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1155
2025-10-10T14:33:55.431684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1155
2025-10-10T14:33:55.432474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1156 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0
2025-10-10T14:33:55.435910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0] Write session: try to update token
2025-10-10T14:33:55.435931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:55.451156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId: src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:55.452126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:55.452143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:55.452148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:55.452150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:55.452159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601295326767234:7251]
2025-10-10T14:33:55.452164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601295326767234:7251]
2025-10-10T14:33:55.452168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601295326767234:7251]
2025-10-10T14:33:55.452219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:55.452232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.452235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:55.452378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:55.453403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:55.453416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:55.453421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:55.454091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:55.503854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601296108989707:4179]
2025-10-10T14:33:55.504212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1155, pipe: [1:7559601296108989707:4179]
2025-10-10T14:33:55.568262Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:55.568756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.568772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.568819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989707:4179], now have 1 active actors on pipe
2025-10-10T14:33:55.569042Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:55.569074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:55.569091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:55.569122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601296108989707:4179]
2025-10-10T14:33:55.569151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:55.569153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1156 reason: error at write: Disconnected sessionId: src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0
2025-10-10T14:33:55.569549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:55.569561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0] Write session will restart in 0.006896s
2025-10-10T14:33:55.569527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1156 sessionId: src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0 is DEAD
2025-10-10T14:33:55.569586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0] Write session: Do CDS request
2025-10-10T14:33:55.569595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:55.577948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.578089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:55.578107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1157
2025-10-10T14:33:55.578243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.578280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:55.578290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:55.578295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:55.578800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1157 sessionId:  describe result for acl check
2025-10-10T14:33:55.578835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:55.578842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:55.578844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:55.578850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601296108989762:3734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:55.579442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601296108989762:3734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:55.582122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601296108989762:3734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:55.585664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601296108989762:3734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:55.585682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601296108989762:3734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:55.585686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601296108989762:3734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:55.585696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:55.587479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:55.590105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:55.590339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:55.590352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:55.590366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:55.590450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:55.590496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601295326767489:7259]
2025-10-10T14:33:55.591198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:55.591535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:55.591585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:55.592049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:55.592144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.592153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.592155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.592156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.592157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.592158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.592160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.592161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.592162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.592164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.592165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.592166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.592167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.592174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.592188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.592192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.592197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.592201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.592205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.592208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.592212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.592215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.592221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.592224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.592228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.592231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.592240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.592248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.592254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.592260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.592265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.592270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.592274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.592279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.592283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.592288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.592294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.592300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.592306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.592311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.592316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.592322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.592328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.592334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.592339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.592346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.592352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.592358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.592364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.592370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.592376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.592382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.592472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:55.594875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:55.595481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:55.595494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:55.595496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:55.595501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:55.595507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1156 [2:7559601295326767489:7259]
2025-10-10T14:33:55.595518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:55.595536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:55.595539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.595543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.595546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.595562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:55.595576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:55.595589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:55.595658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.595664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.595666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.595669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:55.595737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:55.595745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.595757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.595771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.595790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:55.595816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989708:2438], now have 1 active actors on pipe
2025-10-10T14:33:55.595825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989944:3734], now have 1 active actors on pipe
2025-10-10T14:33:55.595832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601295326767484:7259]
2025-10-10T14:33:55.595839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601295326767484:7259]
2025-10-10T14:33:55.595842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601295326767484:7259]
2025-10-10T14:33:55.595856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:55.595869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:55.595875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:55.595879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:55.595881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:55.595892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:55.595896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:55.595885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1156
2025-10-10T14:33:55.595917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601295326767484:7259]
2025-10-10T14:33:55.595927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:55.595928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:55.595890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1156
2025-10-10T14:33:55.595958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.595967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.596009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5798e16-b314140e-9287364-bb019ef0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:55.596022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.596026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.596029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:55.596041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.596057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:55.596084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.596283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.596296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.596318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.596412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1157 partition: 0 MaxSeqNo: 40 sessionId: src_id|a5798e16-b314140e-9287364-bb019ef0_0
2025-10-10T14:33:55.596838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0466ac7-bcc93a19-15963145-9b4db76a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a5798e16-b314140e-9287364-bb019ef0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:55.599595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5798e16-b314140e-9287364-bb019ef0_0] Write session: try to update token
2025-10-10T14:33:55.599615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5798e16-b314140e-9287364-bb019ef0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:55.613625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId: src_id|a5798e16-b314140e-9287364-bb019ef0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:55.615096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:55.615120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:55.615124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:55.615126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:55.615136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601295326767484:7259]
2025-10-10T14:33:55.615142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601295326767484:7259]
2025-10-10T14:33:55.615146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601295326767484:7259]
2025-10-10T14:33:55.615201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:55.615200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:55.615206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:55.615209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:55.615217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.615220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:55.615384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:55.616296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:55.669146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601296108989967:4179]
2025-10-10T14:33:55.669477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1156, pipe: [1:7559601296108989967:4179]
2025-10-10T14:33:55.730699Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:55.731022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.731035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.731075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989967:4179], now have 1 active actors on pipe
2025-10-10T14:33:55.731248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:55.731297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:55.731343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601296108989967:4179]
2025-10-10T14:33:55.731346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:55.731435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1157 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5798e16-b314140e-9287364-bb019ef0_0
2025-10-10T14:33:55.731592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1157 sessionId: src_id|a5798e16-b314140e-9287364-bb019ef0_0 is DEAD
2025-10-10T14:33:55.731766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5798e16-b314140e-9287364-bb019ef0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:55.731778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5798e16-b314140e-9287364-bb019ef0_0] Write session will restart in 0.007345s
2025-10-10T14:33:55.731820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5798e16-b314140e-9287364-bb019ef0_0] Write session: Do CDS request
2025-10-10T14:33:55.731827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5798e16-b314140e-9287364-bb019ef0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:55.740935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5798e16-b314140e-9287364-bb019ef0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.741016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:55.741031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1158
2025-10-10T14:33:55.741259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.741307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:55.741319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:55.741323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:55.741817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1158 sessionId:  describe result for acl check
2025-10-10T14:33:55.741859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:55.741866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:55.741876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:55.741884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601296108990029:3727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:55.742495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601296108990029:3727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:55.745657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601296108990029:3727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:55.748846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601296108990029:3727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:55.748864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601296108990029:3727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:55.748868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601296108990029:3727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:55.748877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:55.749288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:55.751752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:55.751999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:55.752014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:55.752027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:55.752098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:55.752145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601295326767730:7262]
2025-10-10T14:33:55.752664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:55.753011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:55.753081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:55.753447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:55.753599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.753607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.753608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.753610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.753611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.753612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.753614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.753615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.753616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.753618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.753619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.753620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.753622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.753628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.753642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.753646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.753650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.753654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.753658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.753663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.753667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.753671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.753675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.753679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.753683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.753687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.753695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.753704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.753710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.753716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.753721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.753727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.753731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.753750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.753755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.753767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.753771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.753777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.753781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.753786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.753790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.753796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.753800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.753805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.753810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.753815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.753819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.753825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.753829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.753834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.753839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.753844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.753884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:55.756282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:55.756861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:55.756876Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:55.756879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:55.756883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:55.756892Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1157 [2:7559601295326767730:7262]
2025-10-10T14:33:55.756905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:55.756924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:55.756927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.756931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.756933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.756961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:55.756974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:55.756983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:55.757046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.757053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.757055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.757058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:55.757127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:55.757135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.757147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.757160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.757197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:55.757227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108989968:2438], now have 1 active actors on pipe
2025-10-10T14:33:55.757251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108990198:3727], now have 1 active actors on pipe
2025-10-10T14:33:55.757262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601295326767725:7262]
2025-10-10T14:33:55.757267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601295326767725:7262]
2025-10-10T14:33:55.757269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601295326767725:7262]
2025-10-10T14:33:55.757284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:55.757304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:55.757304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1157
2025-10-10T14:33:55.757309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:55.757307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1157
2025-10-10T14:33:55.757313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:55.757315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:55.757358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:55.757362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:55.757403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.757414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.757432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601295326767725:7262]
2025-10-10T14:33:55.757444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:55.757453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:55.757478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3db35695-20ae1074-46648a84-bc60845d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:55.757491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.757495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.757498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:55.757508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.757520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:55.757549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.757723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.757735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.757751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.757853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1158 partition: 0 MaxSeqNo: 40 sessionId: src_id|3db35695-20ae1074-46648a84-bc60845d_0
2025-10-10T14:33:55.758278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5798e16-b314140e-9287364-bb019ef0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3db35695-20ae1074-46648a84-bc60845d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:55.761057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db35695-20ae1074-46648a84-bc60845d_0] Write session: try to update token
2025-10-10T14:33:55.761075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db35695-20ae1074-46648a84-bc60845d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:55.775674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId: src_id|3db35695-20ae1074-46648a84-bc60845d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:55.777849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:55.777867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:55.777870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:55.777871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:55.777880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601295326767725:7262]
2025-10-10T14:33:55.777883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601295326767725:7262]
2025-10-10T14:33:55.777891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601295326767725:7262]
2025-10-10T14:33:55.777943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:55.777947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:55.777955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:55.777956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.777960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:55.777959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:55.778100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:55.778629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:55.831512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601296108990211:4179]
2025-10-10T14:33:55.831801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1157, pipe: [1:7559601296108990211:4179]
2025-10-10T14:33:55.895772Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:55.896202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.896220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.896268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108990211:4179], now have 1 active actors on pipe
2025-10-10T14:33:55.896550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:55.896578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601296108990211:4179]
2025-10-10T14:33:55.896579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:55.896612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:55.896702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1158 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3db35695-20ae1074-46648a84-bc60845d_0
2025-10-10T14:33:55.896924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1158 sessionId: src_id|3db35695-20ae1074-46648a84-bc60845d_0 is DEAD
2025-10-10T14:33:55.897078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db35695-20ae1074-46648a84-bc60845d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:55.897090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db35695-20ae1074-46648a84-bc60845d_0] Write session will restart in 0.005653s
2025-10-10T14:33:55.897115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db35695-20ae1074-46648a84-bc60845d_0] Write session: Do CDS request
2025-10-10T14:33:55.897133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db35695-20ae1074-46648a84-bc60845d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:55.903921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db35695-20ae1074-46648a84-bc60845d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.904065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:55.904080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1159
2025-10-10T14:33:55.904201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:55.904235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:55.904245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:55.904249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:55.904676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1159 sessionId:  describe result for acl check
2025-10-10T14:33:55.904716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:55.904723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:55.904725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:55.904731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601296108990229:3721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:55.905350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601296108990229:3721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:55.908669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601296108990229:3721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:55.912155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601296108990229:3721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:55.912173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601296108990229:3721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:55.912177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601296108990229:3721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:55.912187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:55.915073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:55.917812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:55.918054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:55.918075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:55.918089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:55.918150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:55.918195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601295326767971:7264]
2025-10-10T14:33:55.918818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:55.919190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:55.919238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:55.919570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:55.919631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.919637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.919639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.919640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.919641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.919643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.919644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.919645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.919647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.919648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.919649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.919650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.919652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.919658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.919672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.919676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.919680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.919685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.919689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.919693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.919697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.919701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.919706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.919710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.919714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.919718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.919725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.919734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:55.919741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.919747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:55.919751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.919757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:55.919761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.919766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:55.919777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.919782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:55.919793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.919798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:55.919809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.919815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:55.919823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.919830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:55.919834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.919845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:55.919849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.919860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:55.919865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.919874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.919880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.919889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.919894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.919903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.919945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:55.922476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:55.922811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:55.922827Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:55.922830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:55.922833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:55.922840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1158 [2:7559601295326767971:7264]
2025-10-10T14:33:55.922853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:55.922871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:55.922874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.922878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.922880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.922899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:55.922907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:55.922916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:55.922981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.922991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.922993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.922996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:55.923075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:55.923085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.923097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:55.923110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:55.923129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:55.923152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108990212:2438], now have 1 active actors on pipe
2025-10-10T14:33:55.923156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108990403:3721], now have 1 active actors on pipe
2025-10-10T14:33:55.923164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601295326767966:7264]
2025-10-10T14:33:55.923167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601295326767966:7264]
2025-10-10T14:33:55.923169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601295326767966:7264]
2025-10-10T14:33:55.923183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:55.923205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:55.923200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1158
2025-10-10T14:33:55.923215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:55.923221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1158
2025-10-10T14:33:55.923235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:55.923237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:55.923238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:55.923240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:55.923265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601295326767966:7264]
2025-10-10T14:33:55.923273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:55.923275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:55.923400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.923411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.923467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:55.923481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:55.923489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:55.923492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:55.923504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:55.923521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:55.923552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.923730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:55.923739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:55.923753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:55.923852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1159 partition: 0 MaxSeqNo: 40 sessionId: src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0
2025-10-10T14:33:55.924308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db35695-20ae1074-46648a84-bc60845d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:55.927085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0] Write session: try to update token
2025-10-10T14:33:55.927103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:55.942021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId: src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:55.943379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:55.943403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:55.943407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:55.943409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:55.943419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601295326767966:7264]
2025-10-10T14:33:55.943424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601295326767966:7264]
2025-10-10T14:33:55.943428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601295326767966:7264]
2025-10-10T14:33:55.943482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:55.943489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:55.943495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:55.943497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:55.943497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:55.943501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:55.943654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:55.944860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:55.996900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601296108990456:4179]
2025-10-10T14:33:55.997211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1158, pipe: [1:7559601296108990456:4179]
2025-10-10T14:33:56.060838Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:56.061459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.061476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.061521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601296108990456:4179], now have 1 active actors on pipe
2025-10-10T14:33:56.061764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:56.061776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601296108990456:4179]
2025-10-10T14:33:56.061812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:56.061815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:56.061900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1159 reason: error at write: Disconnected sessionId: src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0
2025-10-10T14:33:56.061993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:56.062118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1159 sessionId: src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0 is DEAD
2025-10-10T14:33:56.062300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:56.062309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0] Write session will restart in 0.009761s
2025-10-10T14:33:56.062335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0] Write session: Do CDS request
2025-10-10T14:33:56.062345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:56.072970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.073056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:56.073073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1160
2025-10-10T14:33:56.073247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.073286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:56.073292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:56.073295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:56.073891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1160 sessionId:  describe result for acl check
2025-10-10T14:33:56.073928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:56.073935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:56.073937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:56.073943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601300403957833:3713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:56.074531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601300403957833:3713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:56.077367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601300403957833:3713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:56.080482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601300403957833:3713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:56.080498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601300403957833:3713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:56.080501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601300403957833:3713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:56.080510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:56.080621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:56.083076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:56.083301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:56.083314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:56.083328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:56.083386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:56.083430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601299621735508:7266]
2025-10-10T14:33:56.084084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:56.084419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:56.084485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:56.084837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:56.084900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.084910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.084912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.084913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.084915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.084916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.084918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.084919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.084920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.084921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.084923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.084924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.084925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.084932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.084945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.084949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.084954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.084957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.084962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.084966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.084971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.084975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.084980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.084984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.084988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.084992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.085000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.085009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.085016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.085022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.085035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.085041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.085046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.085051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.085056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.085061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.085065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.085086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.085091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.085097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.085102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.085112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.085117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.085140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.085150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.085155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.085171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.085181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.085186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.085192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.085201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.085206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.085249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:56.087708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:56.088174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:56.088187Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:56.088189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:56.088194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:56.088202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1159 [2:7559601299621735508:7266]
2025-10-10T14:33:56.088218Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:56.088241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:56.088249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.088253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.088256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.088274Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:56.088282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:56.088294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:56.088371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.088378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.088380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.088383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:56.088454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:56.088461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.088474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.088486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.088505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:56.088535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403957753:2438], now have 1 active actors on pipe
2025-10-10T14:33:56.088543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403957986:3713], now have 1 active actors on pipe
2025-10-10T14:33:56.088551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601299621735502:7266]
2025-10-10T14:33:56.088553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601299621735502:7266]
2025-10-10T14:33:56.088556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601299621735502:7266]
2025-10-10T14:33:56.088572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:56.088591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:56.088603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:56.088606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:56.088608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:56.088611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:56.088587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1159
2025-10-10T14:33:56.088614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:56.088648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601299621735502:7266]
2025-10-10T14:33:56.088656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:56.088665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:56.088693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.088705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.088681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1159
2025-10-10T14:33:56.088743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:56.088755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.088764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.088767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:56.088780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.088791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:56.088811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.093563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.093585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.093621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.093752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1160 partition: 0 MaxSeqNo: 40 sessionId: src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0
2025-10-10T14:33:56.094203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346477fe-a5ff0e35-3ac186ed-9ca6f29b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:56.096859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0] Write session: try to update token
2025-10-10T14:33:56.096879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:56.108460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:56.108482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.108486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:56.108488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:56.108499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601299621735502:7266]
2025-10-10T14:33:56.108503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601299621735502:7266]
2025-10-10T14:33:56.108507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601299621735502:7266]
2025-10-10T14:33:56.108551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:56.108553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:56.108561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.108563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:56.108566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:56.108571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:56.108732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:56.110826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId: src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:56.113553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:56.161708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601300403957999:4179]
2025-10-10T14:33:56.161980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1159, pipe: [1:7559601300403957999:4179]
2025-10-10T14:33:56.224349Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:56.225007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.225032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.225098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403957999:4179], now have 1 active actors on pipe
2025-10-10T14:33:56.225372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:56.225386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601300403957999:4179]
2025-10-10T14:33:56.225416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:56.225419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:56.225519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1160 reason: error at write: Disconnected sessionId: src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0
2025-10-10T14:33:56.225601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:56.225743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1160 sessionId: src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0 is DEAD
2025-10-10T14:33:56.225900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:56.225911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0] Write session will restart in 0.007531s
2025-10-10T14:33:56.225937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0] Write session: Do CDS request
2025-10-10T14:33:56.225959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:56.234819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.234900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:56.234928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1161
2025-10-10T14:33:56.235095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.235130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:56.235141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:56.235145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:56.235601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1161 sessionId:  describe result for acl check
2025-10-10T14:33:56.235635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:56.235638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:56.235640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:56.235646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601300403958041:3707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:56.236220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601300403958041:3707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:56.239066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601300403958041:3707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:56.242279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601300403958041:3707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:56.242297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601300403958041:3707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:56.242301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601300403958041:3707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:56.242309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:56.244736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:56.247565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:56.247793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:56.247805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:56.247816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:56.247866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:56.247911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601299621735750:7268]
2025-10-10T14:33:56.248521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:56.248858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:56.248931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:56.249306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:56.249385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.249392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.249394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.249395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.249396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.249398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.249399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.249400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.249402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.249403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.249404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.249405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.249407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.249413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.249426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.249430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.249433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.249437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.249441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.249445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.249449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.249454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.249459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.249463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.249467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.249471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.249480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.249488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.249500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.249505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.249512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.249517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.249526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.249532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.249541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.249546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.249551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.249561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.249566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.249575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.249579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.249585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.249589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.249596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.249604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.249609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.249614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.249619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.249623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.249628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.249632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.249637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.249680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:56.252333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:56.253040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:56.253052Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:56.253054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:56.253058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:56.253065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1160 [2:7559601299621735750:7268]
2025-10-10T14:33:56.253080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:56.253099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:56.253103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.253107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.253109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.253126Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:56.253141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:56.253148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:56.253218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.253230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.253232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.253235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:56.253307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:56.253316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.253328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.253354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.253371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:56.253399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958210:3707], now have 1 active actors on pipe
2025-10-10T14:33:56.253413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601299621735745:7268]
2025-10-10T14:33:56.253416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601299621735745:7268]
2025-10-10T14:33:56.253418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601299621735745:7268]
2025-10-10T14:33:56.253430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:56.253444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958000:2438], now have 1 active actors on pipe
2025-10-10T14:33:56.253447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:56.253451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:56.253453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:56.253456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:56.253473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:56.253476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:56.253511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601299621735745:7268]
2025-10-10T14:33:56.253523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:56.253548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:56.253582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1160
2025-10-10T14:33:56.253584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1160
2025-10-10T14:33:56.253645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.253662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.253697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:56.253711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.253720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.253722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:56.253736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.253756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:56.253792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.253966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.253978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.254001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.254119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1161 partition: 0 MaxSeqNo: 40 sessionId: src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0
2025-10-10T14:33:56.254520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26814aab-be9d7ad0-4a3b95fd-ca4701cd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:56.257274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0] Write session: try to update token
2025-10-10T14:33:56.257292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:56.271291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:56.271317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.271329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601299621735745:7268]
2025-10-10T14:33:56.271389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:56.271396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:56.271586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:56.271666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId: src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:56.271731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.271902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.272041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.272250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:56.272299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:56.274377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:56.274578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.274596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.274633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:56.274700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:56.283693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:56.283711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.283715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:56.283716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:56.283727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601299621735745:7268]
2025-10-10T14:33:56.283731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601299621735745:7268]
2025-10-10T14:33:56.283735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601299621735745:7268]
2025-10-10T14:33:56.283779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:56.283782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:56.283789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.283792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:56.283794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:56.283799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:56.283934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:56.325611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601300403958249:4179]
2025-10-10T14:33:56.325975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1160, pipe: [1:7559601300403958249:4179]
2025-10-10T14:33:56.400709Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:56.409237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.409268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.412740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601300403958249:4179]
2025-10-10T14:33:56.412786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:56.412789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:56.412820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1161 reason: error at write: Disconnected sessionId: src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0
2025-10-10T14:33:56.413074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1161 sessionId: src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0 is DEAD
2025-10-10T14:33:56.413279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:56.413353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:56.413367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0] Write session will restart in 0.008228s
2025-10-10T14:33:56.409442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.409513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.409573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.413393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0] Write session: Do CDS request
2025-10-10T14:33:56.409639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.409679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.413399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:56.409684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.409753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.409814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.409874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.409938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.409978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.409982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.410048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.410104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.410163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.410221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.410259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.410262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.410330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.410390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.410452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.410513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.410553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.410556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.410623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.410679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.410740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.410801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.410841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.410844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.410911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.410969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.411028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.411085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.411211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.411214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.411278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.411332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.411389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.411449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.411487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.411490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.411555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.411613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.411670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.411731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.411773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.411775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.411844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.411903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.411963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.412025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.412064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.412067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.412137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.412194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.412258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.412318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.412359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.412362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.412427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958249:4179], now have 1 active actors on pipe
2025-10-10T14:33:56.414089Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:56.422974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.423185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:56.423207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1162
2025-10-10T14:33:56.423365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.423405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:56.423412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:56.423417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:56.423937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1162 sessionId:  describe result for acl check
2025-10-10T14:33:56.423982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:56.423984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:56.423987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:56.423996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601300403958312:3694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:56.424657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601300403958312:3694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:56.427826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601300403958312:3694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:56.431915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601300403958312:3694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:56.431941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601300403958312:3694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:56.431946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601300403958312:3694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:56.431956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:56.432733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:56.435552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:56.435835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:56.435852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:56.435866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:56.435954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:56.436000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601299621736018:7276]
2025-10-10T14:33:56.436644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:56.437037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:56.437093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:56.437456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:56.437507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.437509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.437510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.437511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.437512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.437514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.437515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.437516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.437518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.437519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.437520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.437521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.437523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.437529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.437552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.437556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.437560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.437564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.437569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.437573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.437577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.437581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.437586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.437590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.437593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.437597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.437604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.437613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.437620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.437625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.437630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.437635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.437640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.437645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.437649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.437654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.437658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.437664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.437668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.437674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.437678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.437683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.437688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.437693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.437698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.437703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.437708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.437714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.437718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.437723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.437728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.437732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.437772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:56.440458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:56.440893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:56.440906Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:56.440908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:56.440913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:56.440920Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1161 [2:7559601299621736018:7276]
2025-10-10T14:33:56.440933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:56.440951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:56.440955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.440958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.440961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.440979Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:56.440992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:56.441001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:56.441064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.441071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.441072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.441075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:56.441142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:56.441163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.441175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.441187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.441204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:56.441227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958496:3694], now have 1 active actors on pipe
2025-10-10T14:33:56.441230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958257:2438], now have 1 active actors on pipe
2025-10-10T14:33:56.441238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601299621736012:7276]
2025-10-10T14:33:56.441241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601299621736012:7276]
2025-10-10T14:33:56.441315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1161
2025-10-10T14:33:56.441368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1161
2025-10-10T14:33:56.441243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601299621736012:7276]
2025-10-10T14:33:56.441257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:56.441270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:56.441284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:56.441286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:56.441287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:56.441289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:56.441290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:56.441324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601299621736012:7276]
2025-10-10T14:33:56.441343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:56.441345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:56.441378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.441384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.441415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:56.441422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.441427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.441429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:56.441441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.441451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:56.441476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.441610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.441616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.441630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.441699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1162 partition: 0 MaxSeqNo: 40 sessionId: src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0
2025-10-10T14:33:56.442122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c9d523-50e12a9b-8b257ef7-3fa6d165_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:56.445886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0] Write session: try to update token
2025-10-10T14:33:56.445909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:56.461280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:56.461305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.461308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:56.461310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:56.461319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601299621736012:7276]
2025-10-10T14:33:56.461324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601299621736012:7276]
2025-10-10T14:33:56.461345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601299621736012:7276]
2025-10-10T14:33:56.461385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:56.461392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:56.461395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:56.461398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:56.461406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.461411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:56.461569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:56.464645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId: src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:56.467649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:56.512983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601300403958534:4179]
2025-10-10T14:33:56.513263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1161, pipe: [1:7559601300403958534:4179]
2025-10-10T14:33:56.577938Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:56.578612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.578634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.578689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958534:4179], now have 1 active actors on pipe
2025-10-10T14:33:56.578903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:56.579046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:56.579071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:56.579117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601300403958534:4179]
2025-10-10T14:33:56.579163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1162 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0
2025-10-10T14:33:56.579380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1162 sessionId: src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0 is DEAD
2025-10-10T14:33:56.579559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:56.579570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0] Write session will restart in 0.008670s
2025-10-10T14:33:56.579594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0] Write session: Do CDS request
2025-10-10T14:33:56.579600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:56.593853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.593915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:56.593931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1163
2025-10-10T14:33:56.594672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.594724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:56.594738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:56.594742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:56.595228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1163 sessionId:  describe result for acl check
2025-10-10T14:33:56.595268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:56.595274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:56.595276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:56.595283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601300403958715:3685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:56.595829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601300403958715:3685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:56.598199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601300403958715:3685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:56.598580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:56.601079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:56.601320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:56.601345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:56.601359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:56.601422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:56.601464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601299621736285:7286]
2025-10-10T14:33:56.601472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601300403958715:3685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:56.601489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601300403958715:3685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:56.601494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601300403958715:3685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:56.601502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:56.602095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:56.602450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:56.602512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:56.602869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:56.602960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.602967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.602968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.602969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.602970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.602971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.602973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.602974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.602975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.602976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.602977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.602978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.602979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.602985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.602998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.603002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.603006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.603009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.603014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.603018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.603022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.603026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.603043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.603047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.603051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.603055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.603063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.603072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.603083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.603089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.603098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.603103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.603108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.603113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.603122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.603127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.603132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.603141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.603146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.603151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.603155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.603161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.603171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.603176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.603184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.603190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.603194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.603204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.603208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.603218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.603222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.603233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.603274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:56.605931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:56.606364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:56.606378Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:56.606380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:56.606384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:56.606390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1162 [2:7559601299621736285:7286]
2025-10-10T14:33:56.606404Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:56.606422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:56.606425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.606429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.606431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.606448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:56.606461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:56.606469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:56.606533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.606539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.606542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.606544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:56.606612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:56.606618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.606626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.606632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.606646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:56.606670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958535:2438], now have 1 active actors on pipe
2025-10-10T14:33:56.606678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958777:3685], now have 1 active actors on pipe
2025-10-10T14:33:56.606687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601299621736280:7286]
2025-10-10T14:33:56.606689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601299621736280:7286]
2025-10-10T14:33:56.606691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601299621736280:7286]
2025-10-10T14:33:56.606704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:56.606718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:56.606721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:56.606724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:56.606724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:56.606734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:56.606737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:56.606762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601299621736280:7286]
2025-10-10T14:33:56.606777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:56.606770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1162
2025-10-10T14:33:56.606793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:56.606777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1162
2025-10-10T14:33:56.606820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.606830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.606863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:56.606872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.606875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.606877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:56.606890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.606907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:56.606926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.607087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.607094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.607113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.607209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1163 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0
2025-10-10T14:33:56.607650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99f54406-9abca1de-7ec3d60c-a2ce46a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:56.610352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0] Write session: try to update token
2025-10-10T14:33:56.610369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:56.624288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId: src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:56.626536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:56.626559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.626562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:56.626565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:56.626577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601299621736280:7286]
2025-10-10T14:33:56.626583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601299621736280:7286]
2025-10-10T14:33:56.626587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601299621736280:7286]
2025-10-10T14:33:56.626632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:56.626639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:56.626640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:56.626644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:56.626647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.626649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:56.626788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:56.626991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:56.678881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601300403958792:4179]
2025-10-10T14:33:56.679218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1162, pipe: [1:7559601300403958792:4179]
2025-10-10T14:33:56.743442Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:56.743744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.743759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.743803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958792:4179], now have 1 active actors on pipe
2025-10-10T14:33:56.744020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:56.744071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:56.744088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:56.744119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601300403958792:4179]
2025-10-10T14:33:56.744152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:56.744159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1163 reason: error at write: Disconnected sessionId: src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0
2025-10-10T14:33:56.744370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1163 sessionId: src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0 is DEAD
2025-10-10T14:33:56.744562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:56.744572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0] Write session will restart in 0.006928s
2025-10-10T14:33:56.744598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0] Write session: Do CDS request
2025-10-10T14:33:56.744607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:56.752947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.753041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:56.753057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1164
2025-10-10T14:33:56.753230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.753280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:56.753291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:56.753296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:56.753829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1164 sessionId:  describe result for acl check
2025-10-10T14:33:56.753868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:56.753877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:56.753879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:56.753899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601300403958826:3668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:56.754410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601300403958826:3668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:56.757302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601300403958826:3668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:56.760904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601300403958826:3668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:56.760917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601300403958826:3668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:56.760920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601300403958826:3668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:56.760928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:56.763001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:56.765369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:56.765584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:56.765596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:56.765609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:56.765662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:56.765709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601299621736532:7289]
2025-10-10T14:33:56.766341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:56.766679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:56.766724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:56.767052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:56.767112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.767119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.767120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.767121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.767122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.767124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.767125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.767127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.767128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.767129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.767130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.767132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.767133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.767139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.767152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.767157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.767161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.767165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.767169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.767173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.767177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.767180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.767184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.767188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.767192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.767195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.767202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.767211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.767217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.767222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.767228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.767233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.767237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.767242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.767246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.767251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.767256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.767262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.767267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.767272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.767277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.767282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.767286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.767292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.767296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.767301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.767306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.767311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.767315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.767320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.767325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.767333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.767385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:56.769824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:56.770143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:56.770156Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:56.770158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:56.770162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:56.770168Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1163 [2:7559601299621736532:7289]
2025-10-10T14:33:56.770180Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:56.770197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:56.770201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.770205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.770207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.770223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:56.770234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:56.770247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:56.770308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.770315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.770317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.770320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:56.770396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:56.770403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.770417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.770434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.770452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:56.770478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403959020:3668], now have 1 active actors on pipe
2025-10-10T14:33:56.770485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403958793:2438], now have 1 active actors on pipe
2025-10-10T14:33:56.770492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601299621736527:7289]
2025-10-10T14:33:56.770495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601299621736527:7289]
2025-10-10T14:33:56.770496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601299621736527:7289]
2025-10-10T14:33:56.770511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:56.770529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:56.770524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1163
2025-10-10T14:33:56.770525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1163
2025-10-10T14:33:56.770542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:56.770545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:56.770548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:56.770556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:56.770558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:56.770574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601299621736527:7289]
2025-10-10T14:33:56.770577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:56.770579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:56.770709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.770719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.770751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:56.770762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.770767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.770770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:56.770784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.770795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:56.770817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.771034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.771044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.771061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.771192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1164 partition: 0 MaxSeqNo: 40 sessionId: src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0
2025-10-10T14:33:56.771613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4cba9bb-c6cd82e0-35d601c2-51731ef7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:56.774383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0] Write session: try to update token
2025-10-10T14:33:56.774403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:56.788885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:56.788908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.788934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601299621736527:7289]
2025-10-10T14:33:56.788990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:56.788992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:56.789186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:56.789367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.789513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.789657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.789856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:56.789905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:56.792663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId: src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:56.795344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:56.795982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.796005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.796046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:56.796155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:56.801470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:56.801491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.801494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:56.801496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:56.801507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601299621736527:7289]
2025-10-10T14:33:56.801512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601299621736527:7289]
2025-10-10T14:33:56.801516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601299621736527:7289]
2025-10-10T14:33:56.801564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:56.801571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:56.801575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:56.801577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:56.801585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.801587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:56.801718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:56.844248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601300403959042:4179]
2025-10-10T14:33:56.844508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1163, pipe: [1:7559601300403959042:4179]
2025-10-10T14:33:56.917265Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:56.925877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.925908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.926103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.926172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.926249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.926318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.926627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.926638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.926714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.926782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.926854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.926940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.926991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.926996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.927074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.927141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.927240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.927314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.927368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.927378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.927457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.927535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.927605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.927679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.927734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.927742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.927824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.927898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.927968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.928039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.928086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.928095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.928164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.928238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.928307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.928374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.928422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.928430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.928505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.928569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.928649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.928721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.928837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.928848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.928918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.928983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.929050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.929120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.929181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.929189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.929264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.929350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.929426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.929497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.929545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.929552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.929630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:56.929696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:56.929768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:56.930171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:56.930242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601300403959042:4179]
2025-10-10T14:33:56.930622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:56.931074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:56.931095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0] Write session will restart in 0.006795s
2025-10-10T14:33:56.930638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:56.930670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1164 reason: error at write: Disconnected sessionId: src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0
2025-10-10T14:33:56.930898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1164 sessionId: src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0 is DEAD
2025-10-10T14:33:56.931132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0] Write session: Do CDS request
2025-10-10T14:33:56.931139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:56.929840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:56.929892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:56.929895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:56.929962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403959042:4179], now have 1 active actors on pipe
2025-10-10T14:33:56.930887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:56.938954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.939020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:56.939037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1165
2025-10-10T14:33:56.939243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:56.939282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:56.939295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:56.939299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:56.939818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1165 sessionId:  describe result for acl check
2025-10-10T14:33:56.939863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:56.939873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:56.939875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:56.939882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601300403959068:3659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:56.940472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601300403959068:3659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:56.943633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601300403959068:3659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:56.947575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601300403959068:3659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:56.947590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601300403959068:3659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:56.947593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601300403959068:3659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:56.947601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:56.949701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:56.952205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:56.952458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:56.952469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:56.952481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:56.952533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:56.952597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601299621736777:7291]
2025-10-10T14:33:56.953208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:56.953588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:56.953634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:56.953942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:56.953995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.954004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.954005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.954006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.954007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.954008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.954009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.954011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.954012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.954013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.954015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.954016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.954017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.954022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.954036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.954040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.954044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.954048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.954052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.954056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.954059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.954063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.954067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.954071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.954075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.954079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.954087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.954095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:56.954101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.954107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:56.954111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.954116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:56.954121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.954126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:56.954131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.954136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:56.954141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.954146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:56.954150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.954156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:56.954160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.954165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:56.954171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.954176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:56.954180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.954186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:56.954190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.954196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.954201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.954208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.954215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.954221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.954265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:56.956700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:56.957022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:56.957033Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:56.957035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:56.957039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:56.957045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1164 [2:7559601299621736777:7291]
2025-10-10T14:33:56.957057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:56.957075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:56.957083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.957087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.957090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.957107Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:56.957119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:56.957141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:56.957203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.957210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.957212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.957214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:56.957457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1164
2025-10-10T14:33:56.957469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1164
2025-10-10T14:33:56.957612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:56.957622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.957634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:56.957647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:56.957665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:56.957692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403959276:3659], now have 1 active actors on pipe
2025-10-10T14:33:56.957699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601300403959044:2438], now have 1 active actors on pipe
2025-10-10T14:33:56.957714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.957724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.957748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601299621736772:7291]
2025-10-10T14:33:56.957754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601299621736772:7291]
2025-10-10T14:33:56.957756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601299621736772:7291]
2025-10-10T14:33:56.957769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:56.957787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:56.957786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:56.957790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:56.957792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:56.957803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:56.957806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:56.957829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:56.957841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:56.957845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:56.957847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:56.957859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:56.957874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:56.957906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601299621736772:7291]
2025-10-10T14:33:56.957913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:56.957920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:56.957926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.958092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.958100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.958114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:56.958209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1165 partition: 0 MaxSeqNo: 40 sessionId: src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0
2025-10-10T14:33:56.958595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d5d6a6-a9408cf-9c25bdbc-4f2f3056_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:56.961477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0] Write session: try to update token
2025-10-10T14:33:56.961496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:56.976006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:56.976030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.976043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601299621736772:7291]
2025-10-10T14:33:56.976101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:56.976106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:56.976290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:56.976446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.976569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId: src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:56.976598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.976753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:56.976972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:56.977028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:56.979316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:56.979506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:56.979524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:56.979571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:56.979639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:56.988099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:56.988117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:56.988120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:56.988122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:56.988134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601299621736772:7291]
2025-10-10T14:33:56.988138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601299621736772:7291]
2025-10-10T14:33:56.988142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601299621736772:7291]
2025-10-10T14:33:56.988188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:56.988191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:56.988195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:56.988199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:56.988199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:56.988201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:56.988339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:57.030588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601304698926590:4179]
2025-10-10T14:33:57.030848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1164, pipe: [1:7559601304698926590:4179]
2025-10-10T14:33:57.106000Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:57.114435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.114467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.114651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.114722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.114793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.114867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.114925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.114930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.114998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.115064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.115128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.115203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.115252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.115266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.115338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.115397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.115458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.115523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.115564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.115567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.115644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.115721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.115792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.115868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.115924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.115936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.116011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.116084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.116149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.116218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.116274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.116283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.116355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.116418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.116493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.116565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.116612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.116620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.116696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.116759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.116828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.116902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.116952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.116965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.117039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.117107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.117194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.117266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.117311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.117322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.117414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.117486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.117558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.117632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.117679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.117688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.117762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:57.117825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:57.117893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:57.117964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:57.118012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:57.118020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:57.118096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698926590:4179], now have 1 active actors on pipe
2025-10-10T14:33:57.118337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601304698926590:4179]
2025-10-10T14:33:57.118352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:57.118355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:57.118381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:57.118389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1165 reason: error at write: Disconnected sessionId: src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0
2025-10-10T14:33:57.118616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1165 sessionId: src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0 is DEAD
2025-10-10T14:33:57.118760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:57.118771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0] Write session will restart in 0.008816s
2025-10-10T14:33:57.118804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0] Write session: Do CDS request
2025-10-10T14:33:57.118810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:57.119188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:57.128955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.129495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:57.129524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1166
2025-10-10T14:33:57.129714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.129753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:57.129774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:57.129783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:57.130349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1166 sessionId:  describe result for acl check
2025-10-10T14:33:57.130393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:57.130400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:57.130402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:57.130409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601304698926665:3654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:57.131084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601304698926665:3654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:57.134993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601304698926665:3654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:57.137806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:57.137815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601304698926665:3654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:57.137832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601304698926665:3654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:57.137836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601304698926665:3654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:57.137845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:57.140090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:57.140312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:57.140324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:57.140336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:57.140393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:57.140440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601303916704319:7293]
2025-10-10T14:33:57.141061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:57.141412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:57.141470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:57.141785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:57.141864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.141873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.141874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.141876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.141877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.141878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.141879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.141880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.141882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.141883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.141884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.141886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.141887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.141893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.141906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.141910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.141914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.141918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.141922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.141926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.141930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.141934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.141938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.141943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.141946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.141951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.141959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.141968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.141974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.141980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.141985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.141990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.141994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.141999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.142004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.142009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.142013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.142018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.142031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.142036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.142040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.142045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.142050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.142055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.142059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.142066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.142076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.142081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.142090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.142095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.142099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.142109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.142148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:57.144569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:57.144878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:57.144891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:57.144893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:57.144897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:57.144903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1165 [2:7559601303916704319:7293]
2025-10-10T14:33:57.144915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:57.144932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:57.144940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.144943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.144946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.144962Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:57.144973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:57.144985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:57.145040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.145047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.145049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.145052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:57.145116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:57.145136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.145148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.145160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.145176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:57.145204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698926830:3654], now have 1 active actors on pipe
2025-10-10T14:33:57.145213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698926592:2438], now have 1 active actors on pipe
2025-10-10T14:33:57.145220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601303916704313:7293]
2025-10-10T14:33:57.145223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601303916704313:7293]
2025-10-10T14:33:57.145225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601303916704313:7293]
2025-10-10T14:33:57.145237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:57.145257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:57.145261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:57.145264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:57.145266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:57.145272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:57.145274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:57.145271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1165
2025-10-10T14:33:57.145296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601303916704313:7293]
2025-10-10T14:33:57.145304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:57.145306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:57.145277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1165
2025-10-10T14:33:57.145349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.145358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.145397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddd4d262-83972b04-c45cf16b-2061647f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:57.145409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.145413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.145416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:57.145429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.145445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:57.145467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.145652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.145666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.145691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.145787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1166 partition: 0 MaxSeqNo: 40 sessionId: src_id|ddd4d262-83972b04-c45cf16b-2061647f_0
2025-10-10T14:33:57.146198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c729ae-a414f73e-97ef724f-39bb6b36_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ddd4d262-83972b04-c45cf16b-2061647f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:57.148785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4d262-83972b04-c45cf16b-2061647f_0] Write session: try to update token
2025-10-10T14:33:57.148802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4d262-83972b04-c45cf16b-2061647f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:57.162955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId: src_id|ddd4d262-83972b04-c45cf16b-2061647f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:57.164819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:57.164842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:57.164845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:57.164848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:57.164858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601303916704313:7293]
2025-10-10T14:33:57.164863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601303916704313:7293]
2025-10-10T14:33:57.164868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601303916704313:7293]
2025-10-10T14:33:57.164912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:57.164916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:57.164928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:57.164928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.164930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:57.164931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:57.165087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:57.165652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:57.218518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601304698926843:4179]
2025-10-10T14:33:57.218827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1165, pipe: [1:7559601304698926843:4179]
2025-10-10T14:33:57.280847Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:57.281315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.281343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.281394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698926843:4179], now have 1 active actors on pipe
2025-10-10T14:33:57.281615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:57.281616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:57.281644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601304698926843:4179]
2025-10-10T14:33:57.281668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:57.281670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:57.281728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1166 reason: error at write: Disconnected sessionId: src_id|ddd4d262-83972b04-c45cf16b-2061647f_0
2025-10-10T14:33:57.281964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1166 sessionId: src_id|ddd4d262-83972b04-c45cf16b-2061647f_0 is DEAD
2025-10-10T14:33:57.282118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4d262-83972b04-c45cf16b-2061647f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:57.282126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4d262-83972b04-c45cf16b-2061647f_0] Write session will restart in 0.007458s
2025-10-10T14:33:57.282153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4d262-83972b04-c45cf16b-2061647f_0] Write session: Do CDS request
2025-10-10T14:33:57.282162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4d262-83972b04-c45cf16b-2061647f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:57.290910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4d262-83972b04-c45cf16b-2061647f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.290997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:57.291011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1167
2025-10-10T14:33:57.291164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.291209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:57.291220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:57.291224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:57.291681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1167 sessionId:  describe result for acl check
2025-10-10T14:33:57.291722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:57.291728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:57.291730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:57.291737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601304698926903:3080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:57.292310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601304698926903:3080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:57.294754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601304698926903:3080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:57.297554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601304698926903:3080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:57.297568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601304698926903:3080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:57.297571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601304698926903:3080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:57.297580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:57.299209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:57.302151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:57.302407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:57.302423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:57.302438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:57.302544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:57.302594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601303916704566:7295]
2025-10-10T14:33:57.303195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:57.303532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:57.303591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:57.303919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:57.303999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.304003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.304005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.304006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.304007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.304009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.304010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.304012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.304013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.304014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.304016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.304017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.304018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.304024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.304037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.304041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.304046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.304050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.304054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.304058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.304061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.304065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.304070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.304074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.304078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.304082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.304091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.304101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.304107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.304113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.304118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.304124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.304128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.304134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.304140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.304156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.304161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.304166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.304172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.304177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.304182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.304187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.304192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.304198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.304209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.304220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.304224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.304235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.304245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.304256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.304266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.304276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.304324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:57.306704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:57.307008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:57.307023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:57.307025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:57.307029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:57.307035Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1166 [2:7559601303916704566:7295]
2025-10-10T14:33:57.307046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:57.307065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:57.307068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.307072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.307074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.307091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:57.307101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:57.307110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:57.307162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.307171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.307173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.307176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:57.307242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:57.307250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.307261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.307274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.307295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:57.307321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698926844:2438], now have 1 active actors on pipe
2025-10-10T14:33:57.307330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927081:3080], now have 1 active actors on pipe
2025-10-10T14:33:57.307338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601303916704561:7295]
2025-10-10T14:33:57.307340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601303916704561:7295]
2025-10-10T14:33:57.307342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601303916704561:7295]
2025-10-10T14:33:57.307347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1166
2025-10-10T14:33:57.307368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1166
2025-10-10T14:33:57.307356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:57.307369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:57.307372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:57.307374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:57.307374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:57.307392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:57.307395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:57.307435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.307445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.307459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601303916704561:7295]
2025-10-10T14:33:57.307472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:57.307489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:57.307510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:57.307523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.307528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.307530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:57.307541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.307551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:57.307581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.307737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.307745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.307760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.307856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1167 partition: 0 MaxSeqNo: 40 sessionId: src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0
2025-10-10T14:33:57.308278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4d262-83972b04-c45cf16b-2061647f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:57.310990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0] Write session: try to update token
2025-10-10T14:33:57.311011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:57.325706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId: src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:57.327630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:57.327651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:57.327655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:57.327657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:57.327667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601303916704561:7295]
2025-10-10T14:33:57.327671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601303916704561:7295]
2025-10-10T14:33:57.327675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601303916704561:7295]
2025-10-10T14:33:57.327728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:57.327736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.327736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:57.327742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:57.327744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:57.327750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:57.327883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:57.328478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:57.381812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601304698927096:4179]
2025-10-10T14:33:57.382157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1166, pipe: [1:7559601304698927096:4179]
2025-10-10T14:33:57.444639Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:57.445362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.445386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.445435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927096:4179], now have 1 active actors on pipe
2025-10-10T14:33:57.445666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:57.445690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:57.445705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:57.445710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:57.445754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601304698927096:4179]
2025-10-10T14:33:57.445782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1167 reason: error at write: Disconnected sessionId: src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0
2025-10-10T14:33:57.446025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1167 sessionId: src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0 is DEAD
2025-10-10T14:33:57.446215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:57.446226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0] Write session will restart in 0.008161s
2025-10-10T14:33:57.446259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0] Write session: Do CDS request
2025-10-10T14:33:57.446266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:57.455956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.455992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:57.456021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1168
2025-10-10T14:33:57.456188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.456225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:57.456237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:57.456246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:57.456971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1168 sessionId:  describe result for acl check
2025-10-10T14:33:57.457013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:57.457020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:57.457022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:57.457027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601304698927189:3645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:57.457674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601304698927189:3645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:57.460241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601304698927189:3645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:57.462978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601304698927189:3645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:57.462995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601304698927189:3645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:57.462998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601304698927189:3645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:57.463007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:57.464337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:57.466933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:57.467217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:57.467237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:57.467252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:57.467323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:57.467374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601303916704831:7298]
2025-10-10T14:33:57.468068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:57.468482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:57.468561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:57.468947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:57.469031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.469039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.469040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.469042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.469043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.469044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.469045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.469046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.469048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.469049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.469051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.469052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.469056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.469063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.469074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.469078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.469082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.469086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.469089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.469092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.469096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.469100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.469104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.469120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.469123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.469127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.469135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.469144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.469150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.469155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.469159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.469167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.469172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.469176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.469181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.469186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.469192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.469199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.469220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.469227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.469232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.469239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.469246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.469253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.469260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.469268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.469275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.469281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.469287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.469308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.469313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.469318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.469378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:57.471999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:57.472414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:57.472435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:57.472439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:57.472445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:57.472455Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1167 [2:7559601303916704831:7298]
2025-10-10T14:33:57.472471Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:57.472490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:57.472499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.472503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.472505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.472524Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:57.472537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:57.472546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:57.472639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.472651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.472655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.472658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:57.472741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:57.472757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.472770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.472784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.472806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:57.472846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927109:2438], now have 1 active actors on pipe
2025-10-10T14:33:57.472854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927347:3645], now have 1 active actors on pipe
2025-10-10T14:33:57.472862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601303916704821:7298]
2025-10-10T14:33:57.472824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1167
2025-10-10T14:33:57.472864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601303916704821:7298]
2025-10-10T14:33:57.472873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1167
2025-10-10T14:33:57.472866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601303916704821:7298]
2025-10-10T14:33:57.472878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:57.472894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:57.472896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:57.472900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:57.472902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:57.472911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:57.472915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:57.472962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.472973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.472989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601303916704821:7298]
2025-10-10T14:33:57.473002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:57.473017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:57.473042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:57.473055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.473064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.473067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:57.473085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.473122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:57.473159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.473355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.473368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.473385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.473520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1168 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0
2025-10-10T14:33:57.473916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f535c9-84966f60-343c42bc-81c9ee19_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:57.476733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0] Write session: try to update token
2025-10-10T14:33:57.476752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:57.492897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId: src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:57.493536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:57.493559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:57.493562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:57.493564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:57.493573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601303916704821:7298]
2025-10-10T14:33:57.493579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601303916704821:7298]
2025-10-10T14:33:57.493584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601303916704821:7298]
2025-10-10T14:33:57.493634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:57.493637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:57.493645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.493647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:57.493651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:57.493656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:57.493809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:57.495835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:57.545679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601304698927385:4179]
2025-10-10T14:33:57.545976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1167, pipe: [1:7559601304698927385:4179]
2025-10-10T14:33:57.602805Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:57.603068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.603084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.603129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927385:4179], now have 1 active actors on pipe
2025-10-10T14:33:57.603296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:57.603345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:57.603350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:57.603357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601304698927385:4179]
2025-10-10T14:33:57.603355Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:57.603410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1168 reason: error at write: Disconnected sessionId: src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0
2025-10-10T14:33:57.603646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1168 sessionId: src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0 is DEAD
2025-10-10T14:33:57.603807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:57.603816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0] Write session will restart in 0.007682s
2025-10-10T14:33:57.603852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0] Write session: Do CDS request
2025-10-10T14:33:57.603862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:57.612948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.613030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:57.613045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1169
2025-10-10T14:33:57.613195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.613235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:57.613246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:57.613250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:57.613893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1169 sessionId:  describe result for acl check
2025-10-10T14:33:57.613937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:57.613945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:57.613946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:57.613952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601304698927448:3627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:57.614509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601304698927448:3627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:57.617414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601304698927448:3627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:57.620574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601304698927448:3627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:57.620598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601304698927448:3627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:57.620602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601304698927448:3627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:57.620610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:57.621297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:57.623668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:57.623887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:57.623905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:57.623919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:57.623978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:57.624023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601303916705115:7313]
2025-10-10T14:33:57.624682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:57.625004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:57.625053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:57.625414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:57.625486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.625493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.625494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.625496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.625497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.625498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.625500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.625501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.625502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.625504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.625505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.625506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.625508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.625514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.625527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.625532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.625537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.625541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.625545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.625550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.625554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.625558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.625562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.625566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.625570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.625574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.625583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.625592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.625598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.625605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.625610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.625616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.625620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.625626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.625632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.625637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.625642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.625647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.625652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.625657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.625667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.625672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.625677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.625687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.625692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.625702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.625707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.625712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.625718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.625724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.625728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.625739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.625779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:57.628159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:57.628495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:57.628506Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:57.628508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:57.628512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:57.628518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1168 [2:7559601303916705115:7313]
2025-10-10T14:33:57.628529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:57.628557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:57.628565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.628569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.628572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.628589Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:57.628602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:57.628610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:57.628670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.628679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.628681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.628684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:57.628750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:57.628758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.628771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.628783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.628801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:57.628822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927391:2438], now have 1 active actors on pipe
2025-10-10T14:33:57.628830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927631:3627], now have 1 active actors on pipe
2025-10-10T14:33:57.628838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601303916705110:7313]
2025-10-10T14:33:57.628840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601303916705110:7313]
2025-10-10T14:33:57.628843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601303916705110:7313]
2025-10-10T14:33:57.628858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:57.628877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:57.628880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:57.628884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:57.628887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:57.628896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:57.628900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:57.628885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1168
2025-10-10T14:33:57.628936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601303916705110:7313]
2025-10-10T14:33:57.628947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:57.628953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:57.628994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.628946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1168
2025-10-10T14:33:57.629004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.629041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9310360-80396248-607bfc29-8350e57b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:57.629054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.629064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.629066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:57.629078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.629094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:57.629137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.629341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.629354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.629371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.629489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1169 partition: 0 MaxSeqNo: 40 sessionId: src_id|f9310360-80396248-607bfc29-8350e57b_0
2025-10-10T14:33:57.629955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca5cf0c-4b259bd0-b5974661-3fad278d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f9310360-80396248-607bfc29-8350e57b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:57.632798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9310360-80396248-607bfc29-8350e57b_0] Write session: try to update token
2025-10-10T14:33:57.632823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9310360-80396248-607bfc29-8350e57b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:57.647274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId: src_id|f9310360-80396248-607bfc29-8350e57b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:57.648746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:57.648770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:57.648773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:57.648775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:57.648785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601303916705110:7313]
2025-10-10T14:33:57.648790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601303916705110:7313]
2025-10-10T14:33:57.648795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601303916705110:7313]
2025-10-10T14:33:57.648845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:57.648857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.648857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:57.648860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:57.648865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:57.648874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:57.649000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:57.649949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:57.703375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601304698927648:4179]
2025-10-10T14:33:57.703726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1168, pipe: [1:7559601304698927648:4179]
2025-10-10T14:33:57.764146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:57.764722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.764737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.764782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927648:4179], now have 1 active actors on pipe
2025-10-10T14:33:57.764985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:57.765049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:57.765062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:57.765080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601304698927648:4179]
2025-10-10T14:33:57.765122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:57.765147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1169 reason: error at write: Disconnected sessionId: src_id|f9310360-80396248-607bfc29-8350e57b_0
2025-10-10T14:33:57.765352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1169 sessionId: src_id|f9310360-80396248-607bfc29-8350e57b_0 is DEAD
2025-10-10T14:33:57.765504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9310360-80396248-607bfc29-8350e57b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:57.765514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9310360-80396248-607bfc29-8350e57b_0] Write session will restart in 0.009155s
2025-10-10T14:33:57.765532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9310360-80396248-607bfc29-8350e57b_0] Write session: Do CDS request
2025-10-10T14:33:57.765540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9310360-80396248-607bfc29-8350e57b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:57.775886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9310360-80396248-607bfc29-8350e57b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.775968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:57.775991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1170
2025-10-10T14:33:57.776129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.776172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:57.776182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:57.776185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:57.776802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1170 sessionId:  describe result for acl check
2025-10-10T14:33:57.776838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:57.776845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:57.776847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:57.776854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601304698927744:3617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:57.777436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601304698927744:3617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:57.779733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601304698927744:3617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:57.781868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601304698927744:3617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:57.781882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601304698927744:3617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:57.781886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601304698927744:3617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:57.781893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:57.782567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:57.785077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:57.785297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:57.785315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:57.785383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:57.785470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:57.785532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601303916705368:7316]
2025-10-10T14:33:57.786144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:57.786496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:57.786565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:57.786910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:57.786965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.786972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.786973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.786975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.786976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.786977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.786978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.786979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.786980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.786982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.786983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.786984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.786985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.786992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.787005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.787009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.787014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.787018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.787023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.787027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.787032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.787036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.787041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.787045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.787050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.787061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.787069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.787082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.787095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.787101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.787106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.787112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.787117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.787123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.787130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.787136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.787145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.787150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.787156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.787161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.787172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.787178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.787183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.787191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.787195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.787201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.787206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.787214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.787219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.787229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.787234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.787240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.787293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:57.789653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:57.789952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:57.789965Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:57.789967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:57.789971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:57.789977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1169 [2:7559601303916705368:7316]
2025-10-10T14:33:57.789988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:57.790004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:57.790012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.790015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.790018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.790034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:57.790046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:57.790054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:57.790110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.790119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.790121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.790123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:57.790186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:57.790194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.790206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.790220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.790243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:57.790268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927893:3617], now have 1 active actors on pipe
2025-10-10T14:33:57.790276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927649:2438], now have 1 active actors on pipe
2025-10-10T14:33:57.790284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601303916705363:7316]
2025-10-10T14:33:57.790287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601303916705363:7316]
2025-10-10T14:33:57.790289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601303916705363:7316]
2025-10-10T14:33:57.790304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:57.790323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:57.790325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:57.790329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:57.790331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:57.790344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:57.790321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1169
2025-10-10T14:33:57.790348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:57.790323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1169
2025-10-10T14:33:57.790378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601303916705363:7316]
2025-10-10T14:33:57.790389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:57.790395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:57.790404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.790414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.790560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:57.790576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.790580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.790583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:57.790594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.790605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:57.790638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.790842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.790856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.790880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.790982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1170 partition: 0 MaxSeqNo: 40 sessionId: src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0
2025-10-10T14:33:57.791383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9310360-80396248-607bfc29-8350e57b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:57.794062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0] Write session: try to update token
2025-10-10T14:33:57.794081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:57.808196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId: src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:57.810285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:57.810309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:57.810312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:57.810315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:57.810324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601303916705363:7316]
2025-10-10T14:33:57.810329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601303916705363:7316]
2025-10-10T14:33:57.810334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601303916705363:7316]
2025-10-10T14:33:57.810384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:57.810393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.810394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:57.810401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:57.810401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:57.810405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:57.810546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:57.811127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:57.865202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601304698927907:4179]
2025-10-10T14:33:57.865576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1169, pipe: [1:7559601304698927907:4179]
2025-10-10T14:33:57.935542Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:57.936154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.936173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.936221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927907:4179], now have 1 active actors on pipe
2025-10-10T14:33:57.936425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:57.936458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601304698927907:4179]
2025-10-10T14:33:57.936494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:57.936532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:57.936627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0
2025-10-10T14:33:57.936866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1170 sessionId: src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0 is DEAD
2025-10-10T14:33:57.936993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:57.937002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0] Write session will restart in 0.007718s
2025-10-10T14:33:57.937028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0] Write session: Do CDS request
2025-10-10T14:33:57.937035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:57.945957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.946013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:57.946045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1171
2025-10-10T14:33:57.946221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:57.946262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:57.946268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:57.946272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:57.946763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1171 sessionId:  describe result for acl check
2025-10-10T14:33:57.946804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:57.946811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:57.946813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:57.946820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601304698927962:3613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:57.947411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601304698927962:3613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:57.950189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601304698927962:3613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:57.954732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601304698927962:3613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:57.954748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601304698927962:3613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:57.954753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601304698927962:3613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:57.954762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:57.956123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:57.958594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:57.958825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:57.958843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:57.958856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:57.958915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:57.958961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601303916705620:7318]
2025-10-10T14:33:57.959542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:57.959851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:57.959891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:57.960187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:57.960236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.960245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.960246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.960247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.960248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.960249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.960250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.960251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.960252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.960254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.960255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.960256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.960257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.960262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.960275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.960279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.960283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.960286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.960290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.960293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.960297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.960300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.960304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.960308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.960311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.960315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.960322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.960330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:57.960336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.960341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:57.960346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.960351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:57.960355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.960359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:57.960364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.960368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:57.960372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.960376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:57.960381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.960385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:57.960389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.960393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:57.960398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.960402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:57.960406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.960410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:57.960416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.960421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.960424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.960429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.960433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.960438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.960474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:57.962831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:57.963285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:57.963298Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:57.963300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:57.963304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:57.963311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1170 [2:7559601303916705620:7318]
2025-10-10T14:33:57.963325Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:57.963342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:57.963350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.963354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.963356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.963373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:57.963381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:57.963394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:57.963452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.963458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.963460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.963463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:57.963533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:57.963541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.963552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:57.963564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:57.963584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:57.963611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698928152:3613], now have 1 active actors on pipe
2025-10-10T14:33:57.963620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601304698927908:2438], now have 1 active actors on pipe
2025-10-10T14:33:57.963627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601303916705615:7318]
2025-10-10T14:33:57.963630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601303916705615:7318]
2025-10-10T14:33:57.963632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601303916705615:7318]
2025-10-10T14:33:57.963645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:57.963662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:57.963664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:57.963667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:57.963669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:57.963683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:57.963687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:57.963665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1170
2025-10-10T14:33:57.963697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1170
2025-10-10T14:33:57.963709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601303916705615:7318]
2025-10-10T14:33:57.963716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:57.963719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:57.963736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.963741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.963799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:57.963811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:57.963815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:57.963818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:57.963831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:57.963844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:57.963869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.964031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:57.964041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:57.964055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:57.964148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1171 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0
2025-10-10T14:33:57.964583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588af4b0-fc49765c-55ea22f4-56f2f69e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:57.967488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0] Write session: try to update token
2025-10-10T14:33:57.967508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:57.981982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId: src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:57.983608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:57.983638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:57.983642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:57.983644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:57.983655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601303916705615:7318]
2025-10-10T14:33:57.983660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601303916705615:7318]
2025-10-10T14:33:57.983664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601303916705615:7318]
2025-10-10T14:33:57.983718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:57.983715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:57.983732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:57.983734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:57.983735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:57.983739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:57.983879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:57.984757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:58.036714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601308993895462:4179]
2025-10-10T14:33:58.036972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1170, pipe: [1:7559601308993895462:4179]
2025-10-10T14:33:58.101045Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:58.101691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.101726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.101784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993895462:4179], now have 1 active actors on pipe
2025-10-10T14:33:58.102003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:58.102007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:58.102011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:58.102064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601308993895462:4179]
2025-10-10T14:33:58.102097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1171 reason: error at write: Disconnected sessionId: src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0
2025-10-10T14:33:58.102201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:58.102329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1171 sessionId: src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0 is DEAD
2025-10-10T14:33:58.102501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:58.102515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0] Write session will restart in 0.008773s
2025-10-10T14:33:58.102555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0] Write session: Do CDS request
2025-10-10T14:33:58.102564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:58.112977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.113068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:58.113093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1172
2025-10-10T14:33:58.113233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.113273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:58.113286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:58.113290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:58.113828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1172 sessionId:  describe result for acl check
2025-10-10T14:33:58.113870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:58.113879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:58.113881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:58.113887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601308993895532:3609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:58.114539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601308993895532:3609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:58.116872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601308993895532:3609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:58.119915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601308993895532:3609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:58.119930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601308993895532:3609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:58.119934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601308993895532:3609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:58.119943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:58.121369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:58.123823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:58.124069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:58.124080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:58.124092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:58.124142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:58.124186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601308211673169:7320]
2025-10-10T14:33:58.124841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:58.125170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:58.125239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:58.125607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:58.125688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.125695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.125697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.125698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.125699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.125700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.125702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.125703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.125704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.125705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.125716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.125717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.125719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.125725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.125738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.125742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.125746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.125750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.125755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.125759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.125763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.125766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.125771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.125775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.125779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.125783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.125792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.125801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.125808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.125813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.125818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.125830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.125834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.125839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.125844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.125850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.125854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.125860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.125865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.125875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.125879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.125885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.125891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.125901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.125906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.125911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.125916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.125921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.125925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.125932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.125936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.125941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.125983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:58.128415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:58.128850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:58.128864Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:58.128866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:58.128870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:58.128877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1171 [2:7559601308211673169:7320]
2025-10-10T14:33:58.128888Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:58.128906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:58.128910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.128913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.128916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.128933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:58.128945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:58.128952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:58.129014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.129023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.129025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.129028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:58.129120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:58.129130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.129142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.129152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.129168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:58.129195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993895706:3609], now have 1 active actors on pipe
2025-10-10T14:33:58.129204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993895463:2438], now have 1 active actors on pipe
2025-10-10T14:33:58.129213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601308211673164:7320]
2025-10-10T14:33:58.129220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601308211673164:7320]
2025-10-10T14:33:58.129222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601308211673164:7320]
2025-10-10T14:33:58.129240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:58.129245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1171
2025-10-10T14:33:58.129259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1171
2025-10-10T14:33:58.129259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:58.129261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:58.129268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:58.129270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:58.129277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:58.129280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:58.129306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601308211673164:7320]
2025-10-10T14:33:58.129314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:58.129327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:58.129350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.129355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.129669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:58.129693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.129697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.129699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:58.129712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.129725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:58.129759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.129945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.129955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.129973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.130078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1172 partition: 0 MaxSeqNo: 40 sessionId: src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0
2025-10-10T14:33:58.130533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5aff7f-6103ad05-669e5edc-f3af86a5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:58.133276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0] Write session: try to update token
2025-10-10T14:33:58.133297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:58.147898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId: src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:58.149299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:58.149321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:58.149325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:58.149327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:58.149378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601308211673164:7320]
2025-10-10T14:33:58.149386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601308211673164:7320]
2025-10-10T14:33:58.149390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601308211673164:7320]
2025-10-10T14:33:58.149447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:58.149464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.149467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:58.149529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:58.149546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:58.149551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:58.149610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:58.151093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:58.202065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601308993895720:4179]
2025-10-10T14:33:58.202356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1171, pipe: [1:7559601308993895720:4179]
2025-10-10T14:33:58.274654Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:58.275130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.275147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.275193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993895720:4179], now have 1 active actors on pipe
2025-10-10T14:33:58.275418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:58.275449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601308993895720:4179]
2025-10-10T14:33:58.275469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:58.275483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:58.275577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1172 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0
2025-10-10T14:33:58.275807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1172 sessionId: src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0 is DEAD
2025-10-10T14:33:58.276009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:33:58.276017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0] Write session will restart in 0.008983s
2025-10-10T14:33:58.276050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0] Write session: Do CDS request
2025-10-10T14:33:58.276056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:58.285954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.286235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:58.286253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1173
2025-10-10T14:33:58.286392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.286432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:58.286438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:58.286442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:58.287010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1173 sessionId:  describe result for acl check
2025-10-10T14:33:58.287062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:58.287069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:58.287071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:58.287077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601308993895803:3605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:58.287673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601308993895803:3605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:58.290810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601308993895803:3605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:58.293794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:58.293858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601308993895803:3605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:58.293883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601308993895803:3605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:58.293887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601308993895803:3605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:58.293897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:58.296458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:58.296686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:58.296699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:58.296713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:58.296768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:58.296812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601308211673423:7322]
2025-10-10T14:33:58.297459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:58.297784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:58.297835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:58.298174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:58.298243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.298250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.298251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.298252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.298254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.298256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.298257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.298258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.298260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.298261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.298262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.298263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.298264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.298270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.298284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.298289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.298293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.298297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.298301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.298305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.298308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.298313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.298317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.298321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.298325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.298329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.298338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.298347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.298354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.298365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.298370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.298380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.298384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.298390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.298394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.298400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.298410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.298416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.298425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.298431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.298435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.298445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.298449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.298455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.298464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.298469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.298478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.298484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.298492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.298497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.298502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.298511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.298549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:58.301251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:58.301818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:58.301833Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:58.301836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:58.301840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:58.301847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1172 [2:7559601308211673423:7322]
2025-10-10T14:33:58.301861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:58.301882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:58.301891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.301895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.301898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.301915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:58.301924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:58.301933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:58.302011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.302019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.302021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.302024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:58.302096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:58.302103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.302116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.302132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.302153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:58.302180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993895721:2438], now have 1 active actors on pipe
2025-10-10T14:33:58.302188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993895968:3605], now have 1 active actors on pipe
2025-10-10T14:33:58.302196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601308211673417:7322]
2025-10-10T14:33:58.302199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601308211673417:7322]
2025-10-10T14:33:58.302201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601308211673417:7322]
2025-10-10T14:33:58.302217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:58.302236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:58.302242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:58.302251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:58.302252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1172
2025-10-10T14:33:58.302255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:58.302275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1172
2025-10-10T14:33:58.302256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:58.302259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:58.302283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601308211673417:7322]
2025-10-10T14:33:58.302287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:58.302307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:58.302324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.302329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.302370Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:58.302387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.302392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.302395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:58.302409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.302420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:58.302433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.302616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.302628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.302644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.302744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1173 partition: 0 MaxSeqNo: 40 sessionId: src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0
2025-10-10T14:33:58.303212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bd6ad0-df76d29a-81c637be-dfa4048c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:58.306395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0] Write session: try to update token
2025-10-10T14:33:58.306416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:58.323005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:58.323028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:58.323032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:58.323034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:58.323046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601308211673417:7322]
2025-10-10T14:33:58.323052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601308211673417:7322]
2025-10-10T14:33:58.323057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601308211673417:7322]
2025-10-10T14:33:58.323114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:58.323130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.323133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:58.323143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:58.323166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:58.323179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:58.323290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:58.323536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId: src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:58.326339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:58.375640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601308993895980:4179]
2025-10-10T14:33:58.375975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1172, pipe: [1:7559601308993895980:4179]
2025-10-10T14:33:58.440907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:58.441566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.441587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.441632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993895980:4179], now have 1 active actors on pipe
2025-10-10T14:33:58.441851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601308993895980:4179]
2025-10-10T14:33:58.441885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:58.441918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:58.441927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:58.441983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1173 reason: error at write: Disconnected sessionId: src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0
2025-10-10T14:33:58.442211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1173 sessionId: src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0 is DEAD
2025-10-10T14:33:58.442358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:58.442374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0] Write session will restart in 0.007308s
2025-10-10T14:33:58.442410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0] Write session: Do CDS request
2025-10-10T14:33:58.442419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:58.442486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:58.451587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.451825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:58.451845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1174
2025-10-10T14:33:58.451985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.452025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:58.452037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:58.452041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:58.452540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1174 sessionId:  describe result for acl check
2025-10-10T14:33:58.452583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:58.452591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:58.452594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:58.452600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601308993896042:3600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:58.453257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601308993896042:3600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:58.457886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601308993896042:3600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:58.461154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601308993896042:3600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:58.461173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601308993896042:3600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:58.461177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601308993896042:3600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:58.461188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:58.461363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:58.464383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:58.464620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:58.464636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:58.464648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:58.464704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:58.464750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601308211673690:7325]
2025-10-10T14:33:58.465471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:58.465842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:58.465885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:58.466214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:58.466271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.466277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.466279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.466280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.466282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.466283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.466284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.466286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.466288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.466289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.466290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.466292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.466293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.466300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.466315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.466320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.466324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.466329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.466333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.466338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.466342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.466346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.466351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.466356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.466361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.466365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.466374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.466384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.466390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.466397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.466402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.466407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.466412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.466418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.466424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.466429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.466435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.466441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.466452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.466459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.466464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.466469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.466474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.466480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.466484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.466491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.466496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.466507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.466512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.466522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.466527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.466533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.466582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:58.469207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:58.469544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:58.469559Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:58.469562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:58.469567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:58.469574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1173 [2:7559601308211673690:7325]
2025-10-10T14:33:58.469588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:58.469606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:58.469614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.469618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.469621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.469640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:58.469653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:58.469661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:58.469732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.469741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.469743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.469746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:58.469819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:58.469828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.469839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.469853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.470027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1173
2025-10-10T14:33:58.470028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1173
2025-10-10T14:33:58.469873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:58.469903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601308211673684:7325]
2025-10-10T14:33:58.469905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601308211673684:7325]
2025-10-10T14:33:58.469908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601308211673684:7325]
2025-10-10T14:33:58.469917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:58.469928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:58.469932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:58.469934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993895993:2438], now have 1 active actors on pipe
2025-10-10T14:33:58.469935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:58.469941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896240:3600], now have 1 active actors on pipe
2025-10-10T14:33:58.469946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:58.469963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:58.469966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:58.469998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601308211673684:7325]
2025-10-10T14:33:58.470006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:58.470026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:58.470064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.470069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.470101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:58.470109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.470113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.470116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:58.470129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.470141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:58.470156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.470310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.470319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.470335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.470447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1174 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0
2025-10-10T14:33:58.470928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcf7edb-67db99c7-38d1950f-a280308b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:58.473724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0] Write session: try to update token
2025-10-10T14:33:58.473745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:58.488210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId: src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:58.489996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:58.490017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:58.490021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:58.490023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:58.490033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601308211673684:7325]
2025-10-10T14:33:58.490038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601308211673684:7325]
2025-10-10T14:33:58.490043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601308211673684:7325]
2025-10-10T14:33:58.490095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:58.490103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:58.490109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:58.490110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.490113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:58.490113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:58.490249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:58.491115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:58.542047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601308993896265:4179]
2025-10-10T14:33:58.542293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1173, pipe: [1:7559601308993896265:4179]
2025-10-10T14:33:58.615473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:58.616259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.616275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.616319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896265:4179], now have 1 active actors on pipe
2025-10-10T14:33:58.616520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601308993896265:4179]
2025-10-10T14:33:58.616520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:58.616525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:58.616552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:58.616587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1174 reason: error at write: Disconnected sessionId: src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0
2025-10-10T14:33:58.616646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:58.616817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1174 sessionId: src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0 is DEAD
2025-10-10T14:33:58.616976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:58.616987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0] Write session will restart in 0.008910s
2025-10-10T14:33:58.617011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0] Write session: Do CDS request
2025-10-10T14:33:58.617021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:58.626965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.627039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:58.627058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1175
2025-10-10T14:33:58.627210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.627249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:58.627259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:58.627263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:58.627860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1175 sessionId:  describe result for acl check
2025-10-10T14:33:58.627900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:58.627903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:58.627905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:58.627912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601308993896362:3578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:58.628488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601308993896362:3578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:58.631900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601308993896362:3578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:58.634962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601308993896362:3578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:58.634988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601308993896362:3578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:58.634991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601308993896362:3578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:58.635000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:58.635611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:58.637979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:58.638208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:58.638220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:58.638234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:58.638292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:58.638333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601308211673984:7340]
2025-10-10T14:33:58.638962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:58.639243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:58.639310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:58.639586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:58.639634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.639639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.639640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.639641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.639642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.639643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.639643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.639644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.639645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.639646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.639646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.639647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.639648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.639652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.639662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.639664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.639667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.639669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.639672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.639674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.639677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.639679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.639681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.639684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.639686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.639688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.639696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.639701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.639706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.639710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.639719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.639723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.639726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.639730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.639733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.639736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.639739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.639742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.639745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.639749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.639752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.639755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.639757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.639761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.639763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.639766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.639769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.639775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.639779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.639784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.639789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.639794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.639820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:58.642147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:58.642976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:58.642991Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:58.642994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:58.642998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:58.643004Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1174 [2:7559601308211673984:7340]
2025-10-10T14:33:58.643015Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:58.643034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:58.643038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.643042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.643045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.643062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:58.643074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:58.643082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:58.643151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.643160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.643162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.643164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:58.643232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:58.643240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.643253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.643265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.643287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:58.643313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896287:2438], now have 1 active actors on pipe
2025-10-10T14:33:58.643322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896535:3578], now have 1 active actors on pipe
2025-10-10T14:33:58.643330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601308211673979:7340]
2025-10-10T14:33:58.643332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601308211673979:7340]
2025-10-10T14:33:58.643334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601308211673979:7340]
2025-10-10T14:33:58.643349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:58.643366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:58.643368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:58.643374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:58.643377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:58.643385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:58.643389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:58.643422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601308211673979:7340]
2025-10-10T14:33:58.643431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:58.643434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:58.643409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1174
2025-10-10T14:33:58.643421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1174
2025-10-10T14:33:58.643463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.643473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.643514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:58.643528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.643537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.643540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:58.643553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.643568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:58.643595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.643757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.643765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.643780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.643879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1175 partition: 0 MaxSeqNo: 40 sessionId: src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0
2025-10-10T14:33:58.644333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fe39d6-b24a3e-339bfe79-bfcc3180_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:58.647057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0] Write session: try to update token
2025-10-10T14:33:58.647077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:58.661585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId: src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:58.662845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:58.662860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:58.662864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:58.662866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:58.662875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601308211673979:7340]
2025-10-10T14:33:58.662880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601308211673979:7340]
2025-10-10T14:33:58.662884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601308211673979:7340]
2025-10-10T14:33:58.662922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:58.662932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:58.662932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:58.662936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:58.662940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.662942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:58.663074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:58.664155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:58.716641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601308993896550:4179]
2025-10-10T14:33:58.716973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1174, pipe: [1:7559601308993896550:4179]
2025-10-10T14:33:58.780933Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:58.781368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.781383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.781423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896550:4179], now have 1 active actors on pipe
2025-10-10T14:33:58.781605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:58.781697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:58.781731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601308993896550:4179]
2025-10-10T14:33:58.781817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:58.781827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:58.781912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1175 reason: error at write: Disconnected sessionId: src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0
2025-10-10T14:33:58.782162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1175 sessionId: src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0 is DEAD
2025-10-10T14:33:58.782288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:58.782296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0] Write session will restart in 0.005735s
2025-10-10T14:33:58.782314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0] Write session: Do CDS request
2025-10-10T14:33:58.782323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:58.788908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.788989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:58.789003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1176
2025-10-10T14:33:58.789205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.789243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:58.789254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:58.789258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:58.789827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1176 sessionId:  describe result for acl check
2025-10-10T14:33:58.789865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:58.789872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:58.789874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:58.789880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601308993896576:3572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:58.790478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601308993896576:3572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:58.793887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601308993896576:3572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:58.797605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601308993896576:3572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:58.797620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601308993896576:3572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:58.797624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601308993896576:3572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:58.797634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:58.800565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:58.803184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:58.803402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:58.803414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:58.803424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:58.803470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:58.803504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601308211674243:7343]
2025-10-10T14:33:58.803920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:58.804342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:58.804392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:58.804713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:58.804773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.804778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.804779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.804780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.804782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.804783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.804785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.804786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.804787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.804788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.804789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.804791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.804792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.804797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.804811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.804815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.804819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.804823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.804827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.804831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.804835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.804839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.804843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.804845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.804848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.804850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.804856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.804861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.804866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.804869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.804872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.804875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.804877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.804881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.804883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.804886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.804889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.804892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.804896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.804901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.804905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.804910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.804916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.804921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.804925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.804931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.804935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.804938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.804941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.804944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.804946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.804949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.804974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:58.807480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:58.807977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:58.807990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:58.807992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:58.807996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:58.808002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1175 [2:7559601308211674243:7343]
2025-10-10T14:33:58.808030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:58.808050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:58.808058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.808061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.808063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.808079Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:58.808087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:58.808099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:58.808155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.808163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.808165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.808168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:58.808236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:58.808244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.808257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.808269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.808301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:58.808326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896551:2438], now have 1 active actors on pipe
2025-10-10T14:33:58.808334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896766:3572], now have 1 active actors on pipe
2025-10-10T14:33:58.808341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601308211674238:7343]
2025-10-10T14:33:58.808347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601308211674238:7343]
2025-10-10T14:33:58.808349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601308211674238:7343]
2025-10-10T14:33:58.808362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:58.808380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:58.808381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:58.808384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:58.808385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:58.808402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:58.808409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:58.808382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1175
2025-10-10T14:33:58.808432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601308211674238:7343]
2025-10-10T14:33:58.808443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:58.808448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:58.808615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1175
2025-10-10T14:33:58.808701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.808714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.808747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|659e6a8c-4330b516-713efc8-a72f2694_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:58.808760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.808765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.808768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:58.808793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.808810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:58.808829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.809004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.809012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.809026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.809183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1176 partition: 0 MaxSeqNo: 40 sessionId: src_id|659e6a8c-4330b516-713efc8-a72f2694_0
2025-10-10T14:33:58.809647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0448709-46c2d408-9a8b2b1b-a8240753_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|659e6a8c-4330b516-713efc8-a72f2694_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:58.812242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659e6a8c-4330b516-713efc8-a72f2694_0] Write session: try to update token
2025-10-10T14:33:58.812257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659e6a8c-4330b516-713efc8-a72f2694_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:58.825495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:58.825514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:58.825528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601308211674238:7343]
2025-10-10T14:33:58.825585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:58.825594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:58.825781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:58.825942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:58.826095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:58.826249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:58.826464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId: src_id|659e6a8c-4330b516-713efc8-a72f2694_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:58.826490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:58.826541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:58.829112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:58.829374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.829399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.829445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:58.829558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:58.838740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:58.838754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:58.838758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:58.838760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:58.838773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601308211674238:7343]
2025-10-10T14:33:58.838777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601308211674238:7343]
2025-10-10T14:33:58.838780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601308211674238:7343]
2025-10-10T14:33:58.838828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:58.838840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.838844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:58.838846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:58.838852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:58.838856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:58.838992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:58.881997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601308993896812:4179]
2025-10-10T14:33:58.882271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1175, pipe: [1:7559601308993896812:4179]
2025-10-10T14:33:58.954449Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:58.962213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.962242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.962430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.962496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.962565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.962634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.963093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.963106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.963180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.963249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.963319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.963388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.963433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.963440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.963515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.963582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.963648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.963717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.963764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.963776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.963846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.963915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.963980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.964049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.964094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.964100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.964177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.964245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.964307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.964372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.964420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.964427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.964496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.964560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.964627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.964694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.964739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.964745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.964811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.964871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.964938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.965006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.965054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.965075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.965142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.965208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.965280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.965362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.965407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.965415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.965482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.965542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.965621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.965686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.965822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.965829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.965895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:58.965957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:58.966026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:58.966094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:58.966142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:58.966149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:58.966211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896812:4179], now have 1 active actors on pipe
2025-10-10T14:33:58.966478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601308993896812:4179]
2025-10-10T14:33:58.966487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:58.966492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:58.966514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:58.966538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1176 reason: error at write: Disconnected sessionId: src_id|659e6a8c-4330b516-713efc8-a72f2694_0
2025-10-10T14:33:58.966785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1176 sessionId: src_id|659e6a8c-4330b516-713efc8-a72f2694_0 is DEAD
2025-10-10T14:33:58.966876Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:58.966929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659e6a8c-4330b516-713efc8-a72f2694_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:58.966941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659e6a8c-4330b516-713efc8-a72f2694_0] Write session will restart in 0.005242s
2025-10-10T14:33:58.966966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659e6a8c-4330b516-713efc8-a72f2694_0] Write session: Do CDS request
2025-10-10T14:33:58.966973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659e6a8c-4330b516-713efc8-a72f2694_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:58.973982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659e6a8c-4330b516-713efc8-a72f2694_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.974083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:58.974109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1177
2025-10-10T14:33:58.974325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:58.974380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:58.974395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:58.974399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:58.974881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1177 sessionId:  describe result for acl check
2025-10-10T14:33:58.974925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:58.974932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:58.974934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:58.974941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601308993896832:3563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:58.975547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601308993896832:3563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:58.979109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601308993896832:3563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:58.982515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601308993896832:3563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:58.982529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601308993896832:3563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:58.982533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601308993896832:3563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:58.982541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:58.986177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:58.988788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:58.989009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:58.989020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:58.989033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:58.989103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:58.989148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601308211674501:7345]
2025-10-10T14:33:58.989774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:58.990096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:58.990162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:58.990548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:58.990614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.990623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.990624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.990625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.990626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.990627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.990628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.990630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.990631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.990632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.990633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.990634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.990635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.990641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.990654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.990658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.990662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.990665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.990669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.990672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.990676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.990680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.990684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.990688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.990692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.990696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.990704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.990712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:58.990719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.990725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:58.990729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.990734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:58.990740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.990745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:58.990749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.990754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:58.990759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.990764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:58.990768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.990773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:58.990777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.990781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:58.990786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.990792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:58.990795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.990799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:58.990805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.990810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.990814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.990819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.990831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.990836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.990874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:58.993320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:58.993774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:58.993789Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:58.993792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:58.993796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:58.993803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1176 [2:7559601308211674501:7345]
2025-10-10T14:33:58.993815Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:58.993838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:58.993841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.993845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.993847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.993865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:58.993877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:58.993886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:58.993949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.993956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.993958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.993961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:58.994149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1176
2025-10-10T14:33:58.994165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1176
2025-10-10T14:33:58.994311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:58.994321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:58.994333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:58.994346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:58.994368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:58.994395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993897008:3563], now have 1 active actors on pipe
2025-10-10T14:33:58.994404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601308993896817:2438], now have 1 active actors on pipe
2025-10-10T14:33:58.994422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.994431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.994456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601308211674496:7345]
2025-10-10T14:33:58.994462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601308211674496:7345]
2025-10-10T14:33:58.994464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601308211674496:7345]
2025-10-10T14:33:58.994479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:58.994497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:58.994501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:58.994506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:58.994508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:58.994518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:58.994521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:58.994546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:58.994560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:58.994564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:58.994567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:58.994578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:58.994588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:58.994620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601308211674496:7345]
2025-10-10T14:33:58.994631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:58.994642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:58.994648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.994795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:58.994808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:58.994832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:58.994931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1177 partition: 0 MaxSeqNo: 40 sessionId: src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0
2025-10-10T14:33:58.995331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659e6a8c-4330b516-713efc8-a72f2694_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:58.997879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0] Write session: try to update token
2025-10-10T14:33:58.997895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:59.005720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:59.005738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.005748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601308211674496:7345]
2025-10-10T14:33:59.005787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:59.005794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:59.005960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:59.006093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.006224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.006362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.006562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:59.006609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:59.011545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId: src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:59.014122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:59.014309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.014336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.014373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:59.014478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:59.024156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:59.024171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.024175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:59.024177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:59.024188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601308211674496:7345]
2025-10-10T14:33:59.024192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601308211674496:7345]
2025-10-10T14:33:59.024195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601308211674496:7345]
2025-10-10T14:33:59.024241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:59.024244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:59.024247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:59.024251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:59.024252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.024254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:59.024390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:59.066798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601313288864371:4179]
2025-10-10T14:33:59.067071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1176, pipe: [1:7559601313288864371:4179]
2025-10-10T14:33:59.137985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:59.145722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.145746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.145923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.145988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.146054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.146120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.146164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.146177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.146251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.146315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.146379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.146447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.146495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.146504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.146582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.146648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.146717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.146783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.146828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.146836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.146904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.146970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.147033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.147105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.147149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.147157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.147227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.147294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.147360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.147420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.147464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.147475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.147547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.147609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.147672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.147737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.147784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.147792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.147860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.147922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.147991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.148056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.148102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.148109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.148178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.148249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.148315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.148381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.148429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.148437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.148512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.148576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.148646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.148717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.148765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.148773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.148856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.148923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.148991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.149074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.149126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.149133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.149199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288864371:4179], now have 1 active actors on pipe
2025-10-10T14:33:59.149460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601313288864371:4179]
2025-10-10T14:33:59.149477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:59.149482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:59.149514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:59.149517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1177 reason: error at write: Disconnected sessionId: src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0
2025-10-10T14:33:59.149766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1177 sessionId: src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0 is DEAD
2025-10-10T14:33:59.149921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:59.149934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0] Write session will restart in 0.006363s
2025-10-10T14:33:59.149961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0] Write session: Do CDS request
2025-10-10T14:33:59.149976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:59.150322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:59.157921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.157978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:59.158005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1178
2025-10-10T14:33:59.158150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.158191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:59.158204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:59.158207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:59.158654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1178 sessionId:  describe result for acl check
2025-10-10T14:33:59.158694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:59.158702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:59.158704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:59.158711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601313288864400:3559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:59.159286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601313288864400:3559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:59.162090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601313288864400:3559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:59.165750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601313288864400:3559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:59.165768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601313288864400:3559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:59.165772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601313288864400:3559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:59.165781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:59.168924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:59.171295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:59.171594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:59.171608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:59.171622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:59.171686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:59.171733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601312506642057:7347]
2025-10-10T14:33:59.172312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:59.172609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:59.172654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:59.172972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:59.173030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.173037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.173038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.173039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.173041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.173042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.173043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.173044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.173046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.173058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.173060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.173061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.173063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.173069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.173083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.173087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.173091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.173094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.173098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.173101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.173105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.173108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.173112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.173115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.173119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.173122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.173131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.173139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.173145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.173150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.173154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.173159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.173168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.173173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.173182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.173186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.173190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.173195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.173199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.173204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.173208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.173213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.173217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.173221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.173226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.173230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.173235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.173240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.173244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.173253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.173258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.173262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.173303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:59.175802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:59.176373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:59.176385Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:59.176388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:59.176391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:59.176397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1177 [2:7559601312506642057:7347]
2025-10-10T14:33:59.176409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:59.176427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:59.176435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.176438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.176441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.176458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:59.176470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:59.176478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:59.176539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.176547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.176549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.176552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:59.176618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:59.176628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.176641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.176653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.176671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:59.176694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288864581:3559], now have 1 active actors on pipe
2025-10-10T14:33:59.176702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288864374:2438], now have 1 active actors on pipe
2025-10-10T14:33:59.176710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601312506642052:7347]
2025-10-10T14:33:59.176713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601312506642052:7347]
2025-10-10T14:33:59.176715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601312506642052:7347]
2025-10-10T14:33:59.176728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:59.176743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:59.176746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1177
2025-10-10T14:33:59.176758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:59.176778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1177
2025-10-10T14:33:59.176761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:59.176763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:59.176763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:59.176767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:59.176790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601312506642052:7347]
2025-10-10T14:33:59.176794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:59.176815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:59.176829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.176838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.176869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2475712a-999f627a-c6189e28-ad982224_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:59.176882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.176886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.176888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:59.176899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.176912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:59.176931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.177117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.177129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.177153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.177258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1178 partition: 0 MaxSeqNo: 40 sessionId: src_id|2475712a-999f627a-c6189e28-ad982224_0
2025-10-10T14:33:59.177703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed8afe3e-ef9f85f1-d0e5f304-db822e90_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2475712a-999f627a-c6189e28-ad982224_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:59.180297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2475712a-999f627a-c6189e28-ad982224_0] Write session: try to update token
2025-10-10T14:33:59.180315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2475712a-999f627a-c6189e28-ad982224_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:59.188300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:59.188316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.188327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601312506642052:7347]
2025-10-10T14:33:59.188376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:59.188382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:59.188559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:59.188698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.188831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.188962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.189162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:59.189207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:59.194462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId: src_id|2475712a-999f627a-c6189e28-ad982224_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:59.197173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:59.197420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.197440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.197482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:59.197576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:59.206977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:59.206994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.206998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:59.207000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:59.207011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601312506642052:7347]
2025-10-10T14:33:59.207016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601312506642052:7347]
2025-10-10T14:33:59.207020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601312506642052:7347]
2025-10-10T14:33:59.207074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:59.207074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:59.207081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:59.207082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.207085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:59.207085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:59.207231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:59.249614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601313288864636:4179]
2025-10-10T14:33:59.249977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1177, pipe: [1:7559601313288864636:4179]
2025-10-10T14:33:59.323065Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:59.331668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.331699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.331885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.331952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.332021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.332086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.332137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.332146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.332214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.332273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.332332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.332393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.332436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.332442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.332510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.332578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.332652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.332724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.332774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.332782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.332857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.332932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.333006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.333095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.333144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.333152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.333230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.333301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.333390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.333462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.333514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.333522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.333596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.333664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.333733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.333802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.333856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.333863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.333936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.334004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.334077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.334143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.334191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.334199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.334273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.334333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.334397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.334459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.334501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.334507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.334572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.334627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.334692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.334752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.334794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.334799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.334864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.334929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.334994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.335066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.335112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.335118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.335174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288864636:4179], now have 1 active actors on pipe
2025-10-10T14:33:59.335395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601313288864636:4179]
2025-10-10T14:33:59.335431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:59.335493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:59.335505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:59.335536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1178 reason: error at write: Disconnected sessionId: src_id|2475712a-999f627a-c6189e28-ad982224_0
2025-10-10T14:33:59.335776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1178 sessionId: src_id|2475712a-999f627a-c6189e28-ad982224_0 is DEAD
2025-10-10T14:33:59.335927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2475712a-999f627a-c6189e28-ad982224_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:59.335939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2475712a-999f627a-c6189e28-ad982224_0] Write session will restart in 0.007768s
2025-10-10T14:33:59.335975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2475712a-999f627a-c6189e28-ad982224_0] Write session: Do CDS request
2025-10-10T14:33:59.335981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2475712a-999f627a-c6189e28-ad982224_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:59.336425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:59.345012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2475712a-999f627a-c6189e28-ad982224_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.345079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:59.345097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1179
2025-10-10T14:33:59.345281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.345323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:59.345349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:59.345356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:59.345965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1179 sessionId:  describe result for acl check
2025-10-10T14:33:59.346016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:59.346023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:59.346027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:59.346033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601313288864694:3556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:59.346614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601313288864694:3556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:59.350048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601313288864694:3556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:59.353533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601313288864694:3556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:59.353548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601313288864694:3556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:59.353551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601313288864694:3556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:59.353561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:59.355511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:59.358076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:59.358326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:59.358337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:59.358350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:59.358412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:59.358460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601312506642318:7349]
2025-10-10T14:33:59.359256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:59.359583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:59.359628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:59.359962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:59.360019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.360025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.360027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.360028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.360029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.360031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.360032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.360033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.360034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.360035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.360036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.360038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.360039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.360044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.360059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.360063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.360067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.360070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.360074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.360078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.360082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.360086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.360091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.360095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.360099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.360102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.360110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.360119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.360126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.360139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.360144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.360149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.360154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.360159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.360164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.360169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.360174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.360179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.360184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.360190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.360195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.360200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.360205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.360210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.360214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.360219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.360225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.360230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.360235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.360240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.360244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.360249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.360291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:59.362720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:59.363178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:59.363202Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:59.363205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:59.363208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:59.363215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1178 [2:7559601312506642318:7349]
2025-10-10T14:33:59.363226Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:59.363255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:59.363264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.363267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.363270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.363286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:59.363298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:59.363306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:59.363362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.363370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.363372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.363374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:59.363440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:59.363447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.363458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.363473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.363493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:59.363519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288864639:2438], now have 1 active actors on pipe
2025-10-10T14:33:59.363527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288864888:3556], now have 1 active actors on pipe
2025-10-10T14:33:59.363535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601312506642313:7349]
2025-10-10T14:33:59.363541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601312506642313:7349]
2025-10-10T14:33:59.363543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601312506642313:7349]
2025-10-10T14:33:59.363558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:59.363577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:59.363596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:59.363597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:59.363601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:59.363602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:59.363604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:59.363624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601312506642313:7349]
2025-10-10T14:33:59.363627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:59.363643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:59.363614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1178
2025-10-10T14:33:59.363614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1178
2025-10-10T14:33:59.363668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.363677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.363707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:59.363718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.363728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.363730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:59.363741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.363756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:59.363773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.363938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.363945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.363959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.364059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1179 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0
2025-10-10T14:33:59.364499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2475712a-999f627a-c6189e28-ad982224_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:59.367257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0] Write session: try to update token
2025-10-10T14:33:59.367280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:59.375235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:59.375254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.375266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601312506642313:7349]
2025-10-10T14:33:59.375323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:59.375326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:59.375527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:59.375681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.375830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.375995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.376195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:59.376247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:59.382096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId: src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:59.384697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:59.384929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.384952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.385004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:59.385111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:59.393411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:59.393428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.393430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:59.393431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:59.393440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601312506642313:7349]
2025-10-10T14:33:59.393443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601312506642313:7349]
2025-10-10T14:33:59.393446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601312506642313:7349]
2025-10-10T14:33:59.393483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:59.393489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.393491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:59.393493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:59.393505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:59.393509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:59.393606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:59.435793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601313288864902:4179]
2025-10-10T14:33:59.436085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1178, pipe: [1:7559601313288864902:4179]
2025-10-10T14:33:59.505545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:59.514756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.514804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.515104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.515257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.515411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.515573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.515661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.515680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.515834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.515981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.516126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.516284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.516368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.516381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.516520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.516594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.516670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.516746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.516810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.516820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.516895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.516970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.517054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.517130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.517180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.517188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.517261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.517348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.517424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.517496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.517544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.517552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.517632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.517740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.517855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.517978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.518051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.518060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.518150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.518216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.518291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.518367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.518416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.518427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.518503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.518572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.518639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.518705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.518751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.518759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.518829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.518894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.518959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.519026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.519084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.519092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.519166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.519236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.519306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.519381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.519429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.519437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.519506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288864902:4179], now have 1 active actors on pipe
2025-10-10T14:33:59.519720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601313288864902:4179]
2025-10-10T14:33:59.519723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:59.519727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:59.519757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:59.519772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1179 reason: error at write: Disconnected sessionId: src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0
2025-10-10T14:33:59.520077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1179 sessionId: src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0 is DEAD
2025-10-10T14:33:59.520143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:59.520166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0] Write session will restart in 0.008635s
2025-10-10T14:33:59.520194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0] Write session: Do CDS request
2025-10-10T14:33:59.520200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:59.520667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:59.529955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.530071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:59.530091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1180
2025-10-10T14:33:59.530242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.530290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:59.530301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:59.530307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:59.530787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1180 sessionId:  describe result for acl check
2025-10-10T14:33:59.530828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:59.530835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:59.530838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:59.530845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601313288864992:3548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:59.531419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601313288864992:3548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:59.534249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601313288864992:3548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:59.537224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601313288864992:3548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:59.537239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601313288864992:3548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:59.537243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601313288864992:3548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:59.537252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:59.538665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:59.541224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:59.541478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:59.541491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:59.541503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:59.541557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:59.541605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601312506642591:7352]
2025-10-10T14:33:59.542224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:59.542553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:59.542598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:59.542934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:59.542991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.542995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.542996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.542997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.542999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.543000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.543002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.543003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.543004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.543005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.543007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.543008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.543009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.543016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.543030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.543034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.543039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.543043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.543048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.543052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.543056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.543061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.543065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.543070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.543074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.543078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.543086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.543095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.543102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.543108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.543121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.543126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.543131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.543137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.543142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.543148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.543157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.543163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.543172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.543180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.543184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.543194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.543204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.543214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.543224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.543234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.543240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.543249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.543254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.543260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.543264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.543274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.543321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:59.545826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:59.546266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:59.546279Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:59.546281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:59.546285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:59.546292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1179 [2:7559601312506642591:7352]
2025-10-10T14:33:59.546306Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:59.546326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:59.546334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.546338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.546340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.546358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:59.546371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:59.546380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:59.546448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.546454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.546456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.546458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:59.546529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:59.546536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.546549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.546565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.546588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:59.546613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288864917:2438], now have 1 active actors on pipe
2025-10-10T14:33:59.546623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288865167:3548], now have 1 active actors on pipe
2025-10-10T14:33:59.546630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601312506642586:7352]
2025-10-10T14:33:59.546633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601312506642586:7352]
2025-10-10T14:33:59.546635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601312506642586:7352]
2025-10-10T14:33:59.546651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:59.546666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:59.546675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:59.546680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:59.546682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:59.546682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:59.546684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:59.546704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601312506642586:7352]
2025-10-10T14:33:59.546707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:59.546690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1179
2025-10-10T14:33:59.546691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1179
2025-10-10T14:33:59.546719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:59.546754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.546765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.546797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:59.546808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.546813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.546820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:59.546834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.546850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:59.546866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.546996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.547005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.547020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.547112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1180 partition: 0 MaxSeqNo: 40 sessionId: src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0
2025-10-10T14:33:59.547481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd077ed3-cbc5eb6-b675ee6-e78ce8a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:59.550162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0] Write session: try to update token
2025-10-10T14:33:59.550180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:59.563991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:33:59.564009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.564022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601312506642586:7352]
2025-10-10T14:33:59.564081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:33:59.564079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:33:59.564269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:33:59.564416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.564558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.564703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:33:59.564900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:33:59.564957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:33:59.565533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId: src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:59.568150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:59.568381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.568401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.568443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:33:59.568537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:33:59.577073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:59.577086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.577090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:59.577092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:59.577101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601312506642586:7352]
2025-10-10T14:33:59.577104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601312506642586:7352]
2025-10-10T14:33:59.577106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601312506642586:7352]
2025-10-10T14:33:59.577142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:59.577151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.577153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:59.577165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:59.577174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:59.577177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:59.577294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:59.619808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601313288865202:4179]
2025-10-10T14:33:59.619976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1179, pipe: [1:7559601313288865202:4179]
2025-10-10T14:33:59.690441Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:59.697805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.697829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.697985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.698046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.698104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.698166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.698217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.698226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.698289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.698359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.698420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.698487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.698532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.698537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.698603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.698665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.698735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.698800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.698846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.698853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.698918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.698981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.699046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.699111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.699156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.699166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.699235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.699298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.699360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.699426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.699488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.699499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.699610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.699734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.699848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.699981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.700031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.700039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.700108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.700166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.700233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.700309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.700357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.700365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.700439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.700507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.700577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.700649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.700697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.700707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.700777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.700845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.700914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.700994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.701062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.701071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.701156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:33:59.701235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:33:59.701322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:33:59.701411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:33:59.701466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:33:59.701477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:33:59.701539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288865202:4179], now have 1 active actors on pipe
2025-10-10T14:33:59.701764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601313288865202:4179]
2025-10-10T14:33:59.701769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:59.701817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:59.701822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:59.701848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1180 reason: error at write: Disconnected sessionId: src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0
2025-10-10T14:33:59.702047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1180 sessionId: src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0 is DEAD
2025-10-10T14:33:59.702148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:59.702159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0] Write session will restart in 0.007884s
2025-10-10T14:33:59.702184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0] Write session: Do CDS request
2025-10-10T14:33:59.702189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:59.702882Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:59.710922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.711089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:59.711122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1181
2025-10-10T14:33:59.711275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.711311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:59.711321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:59.711324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:59.711804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1181 sessionId:  describe result for acl check
2025-10-10T14:33:59.711842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:59.711849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:59.711851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:59.711858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601313288865278:3521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:59.712408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601313288865278:3521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:59.715365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601313288865278:3521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:59.718272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601313288865278:3521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:59.718282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601313288865278:3521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:59.718285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601313288865278:3521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:59.718292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:59.719671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:59.722418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:59.722654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:59.722670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:59.722683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:59.722754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:59.722799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601312506642893:7368]
2025-10-10T14:33:59.723457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:59.723767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:59.723816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:59.724165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:59.724236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.724243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.724244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.724245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.724247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.724248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.724249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.724250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.724252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.724253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.724254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.724255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.724257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.724263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.724277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.724281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.724286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.724290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.724295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.724299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.724303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.724307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.724312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.724316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.724320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.724324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.724333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.724347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.724354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.724364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.724373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.724379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.724384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.724389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.724394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.724404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.724408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.724414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.724423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.724428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.724433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.724443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.724448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.724458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.724462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.724467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.724472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.724478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.724483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.724493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.724497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.724506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.724544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:59.727143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:59.727845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:59.727860Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:59.727862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:59.727866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:59.727873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1180 [2:7559601312506642893:7368]
2025-10-10T14:33:59.727886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:59.727905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:59.727908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.727911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.727914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.727932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:59.727940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:59.727953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:59.728013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.728022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.728025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.728027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:59.728095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:59.728104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.728115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.728127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.728149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:59.728178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288865218:2438], now have 1 active actors on pipe
2025-10-10T14:33:59.728189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288865469:3521], now have 1 active actors on pipe
2025-10-10T14:33:59.728197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601312506642888:7368]
2025-10-10T14:33:59.728200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601312506642888:7368]
2025-10-10T14:33:59.728202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601312506642888:7368]
2025-10-10T14:33:59.728219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:59.728234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:59.728237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:59.728240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:59.728242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:59.728253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:59.728257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:59.728260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1180
2025-10-10T14:33:59.728260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1180
2025-10-10T14:33:59.728283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601312506642888:7368]
2025-10-10T14:33:59.728294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:59.728295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:59.728320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.728325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.728364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a918f495-f79ee01-6e542488-a828063c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:59.728380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.728386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.728388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:59.728400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.728411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:59.728431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.728575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.728581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.728597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.728693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1181 partition: 0 MaxSeqNo: 40 sessionId: src_id|a918f495-f79ee01-6e542488-a828063c_0
2025-10-10T14:33:59.729107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c687ba19-1a5845a3-b2982a09-5e65c133_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a918f495-f79ee01-6e542488-a828063c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:59.731824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a918f495-f79ee01-6e542488-a828063c_0] Write session: try to update token
2025-10-10T14:33:59.731844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a918f495-f79ee01-6e542488-a828063c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:59.747208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId: src_id|a918f495-f79ee01-6e542488-a828063c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:59.748246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:59.748262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.748265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:59.748267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:59.748289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601312506642888:7368]
2025-10-10T14:33:59.748294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601312506642888:7368]
2025-10-10T14:33:59.748298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601312506642888:7368]
2025-10-10T14:33:59.748349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:59.748354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:59.748360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.748361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:59.748362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:59.748366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:59.748504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:59.750041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:59.802024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601313288865484:4179]
2025-10-10T14:33:59.802358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1180, pipe: [1:7559601313288865484:4179]
2025-10-10T14:33:59.865672Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:33:59.866072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.866088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.866134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288865484:4179], now have 1 active actors on pipe
2025-10-10T14:33:59.866314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:33:59.866379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601313288865484:4179]
2025-10-10T14:33:59.866399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:33:59.866403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:33:59.866413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:33:59.866466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1181 reason: error at write: Disconnected sessionId: src_id|a918f495-f79ee01-6e542488-a828063c_0
2025-10-10T14:33:59.866704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1181 sessionId: src_id|a918f495-f79ee01-6e542488-a828063c_0 is DEAD
2025-10-10T14:33:59.866864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a918f495-f79ee01-6e542488-a828063c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:33:59.866875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a918f495-f79ee01-6e542488-a828063c_0] Write session will restart in 0.007206s
2025-10-10T14:33:59.866901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a918f495-f79ee01-6e542488-a828063c_0] Write session: Do CDS request
2025-10-10T14:33:59.866910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a918f495-f79ee01-6e542488-a828063c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:33:59.874954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a918f495-f79ee01-6e542488-a828063c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.875037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:33:59.875055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1182
2025-10-10T14:33:59.875202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:33:59.875237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:33:59.875248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:33:59.875251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:33:59.875704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1182 sessionId:  describe result for acl check
2025-10-10T14:33:59.875744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:33:59.875750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:33:59.875752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:33:59.875759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601313288865515:3524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:33:59.876324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601313288865515:3524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:33:59.879783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601313288865515:3524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:33:59.883348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601313288865515:3524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:33:59.883365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601313288865515:3524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:33:59.883368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601313288865515:3524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:33:59.883377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:33:59.886387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:33:59.888914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:33:59.889129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:33:59.889138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:33:59.889150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:33:59.889203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:33:59.889255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601312506643156:7370]
2025-10-10T14:33:59.889917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:33:59.890185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:33:59.890236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:33:59.890541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:33:59.890606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.890612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.890614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.890615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.890616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.890617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.890619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.890620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.890621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.890622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.890624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.890625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.890626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.890632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.890645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.890649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.890653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.890657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.890661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.890665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.890670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.890675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.890679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.890683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.890687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.890691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.890699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.890709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:33:59.890722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.890727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:33:59.890736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.890742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:33:59.890746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.890756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:33:59.890762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.890771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:33:59.890775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.890781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:33:59.890791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.890797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:33:59.890806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.890812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:33:59.890816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.890821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:33:59.890825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.890830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:33:59.890834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.890840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.890844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.890850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.890859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.890864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.890906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:33:59.893250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:33:59.893604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:33:59.893614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:33:59.893617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:33:59.893620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:33:59.893626Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1181 [2:7559601312506643156:7370]
2025-10-10T14:33:59.893638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:33:59.893656Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:33:59.893664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.893667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.893670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.893687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:33:59.893694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:33:59.893706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:33:59.893764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.893771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.893774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.893776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:33:59.893855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:33:59.893863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.893875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:33:59.893887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:33:59.893921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:33:59.893945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288865688:3524], now have 1 active actors on pipe
2025-10-10T14:33:59.893953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288865485:2438], now have 1 active actors on pipe
2025-10-10T14:33:59.893960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601312506643151:7370]
2025-10-10T14:33:59.893969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601312506643151:7370]
2025-10-10T14:33:59.893971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601312506643151:7370]
2025-10-10T14:33:59.893986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:33:59.893963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1181
2025-10-10T14:33:59.893964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1181
2025-10-10T14:33:59.894004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:33:59.894006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:33:59.894010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:33:59.894012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:33:59.894024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:33:59.894028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:33:59.894063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.894072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.894090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601312506643151:7370]
2025-10-10T14:33:59.894101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:33:59.894115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:33:59.894132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:33:59.894143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:33:59.894147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:33:59.894153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:33:59.894165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:33:59.894180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:33:59.894207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.894383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:33:59.894395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:33:59.894420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:33:59.894529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1182 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0
2025-10-10T14:33:59.894923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a918f495-f79ee01-6e542488-a828063c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:33:59.897607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0] Write session: try to update token
2025-10-10T14:33:59.897622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:33:59.911404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId: src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:33:59.914274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:33:59.914296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:33:59.914299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:33:59.914302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:33:59.914314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601312506643151:7370]
2025-10-10T14:33:59.914320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601312506643151:7370]
2025-10-10T14:33:59.914324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601312506643151:7370]
2025-10-10T14:33:59.914383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:33:59.914388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:33:59.914390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:33:59.914395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:33:59.914398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:33:59.914401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:33:59.914602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:33:59.915119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:33:59.966381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601313288865752:4179]
2025-10-10T14:33:59.966648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1181, pipe: [1:7559601313288865752:4179]
2025-10-10T14:34:00.026633Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:00.027359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.027374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.027417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601313288865752:4179], now have 1 active actors on pipe
2025-10-10T14:34:00.027649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:00.027701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:00.027704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:00.027691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:00.027734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601313288865752:4179]
2025-10-10T14:34:00.027761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1182 reason: error at write: Disconnected sessionId: src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0
2025-10-10T14:34:00.027995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1182 sessionId: src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0 is DEAD
2025-10-10T14:34:00.028149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:00.028157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0] Write session will restart in 0.008064s
2025-10-10T14:34:00.028182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0] Write session: Do CDS request
2025-10-10T14:34:00.028193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:00.037927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.037985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:00.038002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1183
2025-10-10T14:34:00.038201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.038238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:00.038249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:00.038252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:00.038983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1183 sessionId:  describe result for acl check
2025-10-10T14:34:00.039020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:00.039028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:00.039031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:00.039037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601317583833094:3515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:00.039645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601317583833094:3515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:00.043325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601317583833094:3515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:00.046981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601317583833094:3515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:00.047002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601317583833094:3515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:00.047006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601317583833094:3515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:00.047016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:00.048602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:00.051322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:00.051569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:00.051581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:00.051594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:00.051650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:00.051698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601316801610716:7372]
2025-10-10T14:34:00.052393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:00.052740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:00.052783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:00.053129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:00.053191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.053197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.053199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.053200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.053202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.053204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.053205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.053206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.053208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.053209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.053210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.053212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.053213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.053220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.053235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.053239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.053243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.053248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.053252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.053256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.053261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.053265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.053270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.053274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.053279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.053284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.053293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.053302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.053315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.053326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.053349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.053359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.053363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.053370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.053375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.053381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.053386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.053392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.053398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.053404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.053409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.053415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.053421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.053429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.053434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.053440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.053447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.053452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.053458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.053463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.053468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.053474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.053548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:00.056249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:00.056791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:00.056807Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:00.056810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:00.056814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:00.056822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1182 [2:7559601316801610716:7372]
2025-10-10T14:34:00.056838Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:00.056858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:00.056861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.056865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.056868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.056886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:00.056898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:00.056907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:00.056973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.056982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.056984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.056987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:00.057078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:00.057090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.057106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.057119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.057138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:00.057166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833302:3515], now have 1 active actors on pipe
2025-10-10T14:34:00.057179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601316801610711:7372]
2025-10-10T14:34:00.057186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601316801610711:7372]
2025-10-10T14:34:00.057189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601316801610711:7372]
2025-10-10T14:34:00.057202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:00.057215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:00.057216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833049:2438], now have 1 active actors on pipe
2025-10-10T14:34:00.057218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:00.057220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:00.057225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:00.057242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:00.057250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:00.057283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601316801610711:7372]
2025-10-10T14:34:00.057267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1182
2025-10-10T14:34:00.057296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:00.057279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1182
2025-10-10T14:34:00.057317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:00.057352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.057362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.057400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:00.057413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.057417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.057419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:00.057431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.057446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:00.057465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.057656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.057670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.057696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.057801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1183 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0
2025-10-10T14:34:00.058226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f6355f-c6fb72cc-a6a8bbc5-f86e9762_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:00.060867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0] Write session: try to update token
2025-10-10T14:34:00.060888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:00.076940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:00.076961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.076965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:00.076968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:00.076979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601316801610711:7372]
2025-10-10T14:34:00.076988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601316801610711:7372]
2025-10-10T14:34:00.076993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601316801610711:7372]
2025-10-10T14:34:00.077059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:00.077060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:00.077066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:00.077068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.077071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:00.077083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:00.077212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:00.077586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId: src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:00.080308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:00.127671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601317583833320:4179]
2025-10-10T14:34:00.127926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1182, pipe: [1:7559601317583833320:4179]
2025-10-10T14:34:00.131755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:34:00.131785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-10T14:34:00.202584Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:00.203220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.203237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.203288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833320:4179], now have 1 active actors on pipe
2025-10-10T14:34:00.203551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:00.203548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601317583833320:4179]
2025-10-10T14:34:00.203559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:00.203564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:00.203584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:00.203597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-10T14:34:00.203651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1183 reason: error at write: Disconnected sessionId: src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0
2025-10-10T14:34:00.203908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1183 sessionId: src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0 is DEAD
2025-10-10T14:34:00.204104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:00.204115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0] Write session will restart in 0.005175s
2025-10-10T14:34:00.204148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0] Write session: Do CDS request
2025-10-10T14:34:00.204154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:00.210870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.211021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:00.211036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1184
2025-10-10T14:34:00.211146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.211183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:00.211202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:00.211206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:00.211807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1184 sessionId:  describe result for acl check
2025-10-10T14:34:00.211849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:00.211857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:00.211863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:00.211869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601317583833346:3511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:00.212484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601317583833346:3511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:00.215200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601317583833346:3511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:00.219067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601317583833346:3511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:00.219092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601317583833346:3511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:00.219096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601317583833346:3511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:00.219105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:00.222510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:00.225099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:00.225297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:00.225311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:00.225322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:00.225390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:00.225433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601316801610982:7375]
2025-10-10T14:34:00.226092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:00.226419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:00.226463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:00.226791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:00.226845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.226851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.226852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.226854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.226855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.226856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.226858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.226859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.226861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.226862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.226863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.226865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.226866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.226872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.226886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.226891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.226895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.226899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.226904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.226909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.226918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.226923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.226932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.226941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.226950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.226954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.226962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.226975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.226986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.226992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.226997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.227007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.227016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.227023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.227032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.227039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.227048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.227053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.227058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.227068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.227073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.227083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.227092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.227101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.227110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.227120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.227129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.227139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.227148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.227158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.227168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.227177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.227224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:00.229642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:00.229955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:00.229971Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:00.229973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:00.229977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:00.229984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1183 [2:7559601316801610982:7375]
2025-10-10T14:34:00.230362Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:00.230389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:00.230393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.230413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.230421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.230437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:00.230449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:00.230462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:00.230518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.230525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.230527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.230530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:00.230602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:00.230610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.230622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.230641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.230664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:00.230691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833519:3511], now have 1 active actors on pipe
2025-10-10T14:34:00.230699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833321:2438], now have 1 active actors on pipe
2025-10-10T14:34:00.230707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601316801610977:7375]
2025-10-10T14:34:00.230714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601316801610977:7375]
2025-10-10T14:34:00.230716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601316801610977:7375]
2025-10-10T14:34:00.230730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:00.230739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:00.230741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:00.230743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:00.230756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1183
2025-10-10T14:34:00.230747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:00.230765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:00.230790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1183
2025-10-10T14:34:00.230768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:00.230791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601316801610977:7375]
2025-10-10T14:34:00.230794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:00.230795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:00.230812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.230817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.230888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:00.230900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.230904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.230907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:00.230919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.230934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:00.230999Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:34:00.231042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.231228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 6 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:34:00.231224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.231233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.231247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.231276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:34:00.231349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1184 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0
2025-10-10T14:34:00.231797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ee6fcd8-8335eba7-d87be1f3-1abc5760_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:00.234681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0] Write session: try to update token
2025-10-10T14:34:00.234703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:00.249237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId: src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:00.250169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:00.250192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.250196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:00.250198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:00.250207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601316801610977:7375]
2025-10-10T14:34:00.250213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601316801610977:7375]
2025-10-10T14:34:00.250217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601316801610977:7375]
2025-10-10T14:34:00.250268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:00.250276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.250278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:00.250412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:00.250476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:00.250491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:00.250495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:00.252119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:00.303818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601317583833594:4179]
2025-10-10T14:34:00.304208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1183, pipe: [1:7559601317583833594:4179]
2025-10-10T14:34:00.378064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:00.378342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.378356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.378400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833594:4179], now have 1 active actors on pipe
2025-10-10T14:34:00.378611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:00.378625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601317583833594:4179]
2025-10-10T14:34:00.378668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:00.378670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:00.378673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:00.378740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1184 reason: error at write: Disconnected sessionId: src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0
2025-10-10T14:34:00.379001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1184 sessionId: src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0 is DEAD
2025-10-10T14:34:00.379189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:00.379202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0] Write session will restart in 0.005382s
2025-10-10T14:34:00.379235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0] Write session: Do CDS request
2025-10-10T14:34:00.379245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:00.385909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.386803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:00.386819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1185
2025-10-10T14:34:00.386967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.387009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:00.387021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:00.387025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:00.387555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1185 sessionId:  describe result for acl check
2025-10-10T14:34:00.387594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:00.387601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:00.387604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:00.387610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601317583833623:3501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:00.388181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601317583833623:3501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:00.391758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601317583833623:3501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:00.395098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601317583833623:3501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:00.395118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601317583833623:3501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:00.395122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601317583833623:3501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:00.395132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:00.399034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:00.401714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:00.401937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:00.401949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:00.401961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:00.402020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:00.402064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601316801611250:7378]
2025-10-10T14:34:00.402680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:00.403009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:00.403060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:00.403398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:00.403460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.403466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.403468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.403469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.403470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.403471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.403473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.403474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.403475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.403476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.403477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.403478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.403480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.403486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.403499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.403504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.403508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.403512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.403516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.403520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.403524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.403528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.403532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.403536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.403540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.403543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.403552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.403561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.403568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.403573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.403577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.403582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.403586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.403592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.403601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.403606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.403612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.403618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.403623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.403632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.403637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.403643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.403657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.403661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.403666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.403671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.403683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.403689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.403697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.403703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.403708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.403717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.403760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:00.406259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:00.406582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:00.406598Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:00.406600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:00.406604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:00.406611Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1184 [2:7559601316801611250:7378]
2025-10-10T14:34:00.406625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:00.406646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:00.406653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.406657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.406659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.406676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:00.406689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:00.406699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:00.406761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.406768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.406770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.406773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:00.406841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:00.406848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.406860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.406874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.406896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:00.406924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833598:2438], now have 1 active actors on pipe
2025-10-10T14:34:00.406932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833795:3501], now have 1 active actors on pipe
2025-10-10T14:34:00.406939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601316801611244:7378]
2025-10-10T14:34:00.406945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601316801611244:7378]
2025-10-10T14:34:00.406947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601316801611244:7378]
2025-10-10T14:34:00.406961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:00.406978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:00.406980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:00.406982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:00.406984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:00.406995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:00.407003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:00.407025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601316801611244:7378]
2025-10-10T14:34:00.407033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:00.407010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1184
2025-10-10T14:34:00.407041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:00.407024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1184
2025-10-10T14:34:00.407061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.407068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.407104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:00.407117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.407121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.407125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:00.407137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.407153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:00.407171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.407337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.407345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.407362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.407473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1185 partition: 0 MaxSeqNo: 40 sessionId: src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0
2025-10-10T14:34:00.407907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7dd1e66-8255fe39-26e136b7-2d4e226b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:00.415152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0] Write session: try to update token
2025-10-10T14:34:00.415179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:00.428567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:00.428586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.428590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:00.428592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:00.428613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601316801611244:7378]
2025-10-10T14:34:00.428619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601316801611244:7378]
2025-10-10T14:34:00.428623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601316801611244:7378]
2025-10-10T14:34:00.428666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:00.428671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:00.428676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:00.428779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:00.428793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.428796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:00.428941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:00.430809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId: src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:00.439535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:00.478922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601317583833880:4179]
2025-10-10T14:34:00.479263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1184, pipe: [1:7559601317583833880:4179]
2025-10-10T14:34:00.546493Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:00.547324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.547342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.547368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833880:4179], now have 1 active actors on pipe
2025-10-10T14:34:00.547586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:00.547670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:00.547680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:00.547725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601317583833880:4179]
2025-10-10T14:34:00.547768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1185 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0
2025-10-10T14:34:00.548021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1185 sessionId: src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0 is DEAD
2025-10-10T14:34:00.548182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:00.548191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0] Write session will restart in 0.007078s
2025-10-10T14:34:00.548227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0] Write session: Do CDS request
2025-10-10T14:34:00.548233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:00.557043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.557100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:00.557116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1186
2025-10-10T14:34:00.557307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.557359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:00.557371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:00.557374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:00.557854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1186 sessionId:  describe result for acl check
2025-10-10T14:34:00.557895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:00.557899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:00.557900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:00.557907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601317583833920:3496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:00.558473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601317583833920:3496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:00.561988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601317583833920:3496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:00.565600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601317583833920:3496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:00.565620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601317583833920:3496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:00.565624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601317583833920:3496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:00.565634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:00.568905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:00.571932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:00.572216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:00.572231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:00.572248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:00.572328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:00.572382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601316801611529:7381]
2025-10-10T14:34:00.573032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:00.573377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:00.573428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:00.573777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:00.573844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.573851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.573852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.573853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.573854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.573856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.573858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.573859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.573861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.573862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.573863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.573864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.573866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.573872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.573887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.573892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.573897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.573901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.573906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.573910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.573915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.573920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.573924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.573928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.573932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.573937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.573945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.573953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.573960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.573966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.573971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.573976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.573981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.573985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.573991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.573996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.574000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.574006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.574016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.574021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.574026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.574031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.574036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.574041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.574045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.574050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.574054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.574058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.574063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.574068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.574074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.574080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.574125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:00.576718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:00.577084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:00.577099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:00.577102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:00.577106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:00.577113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1185 [2:7559601316801611529:7381]
2025-10-10T14:34:00.577129Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:00.577150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:00.577158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.577162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.577165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.577183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:00.577197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:00.577210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:00.577273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.577283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.577286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.577288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:00.577385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:00.577394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.577407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.577425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.577448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:00.577477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583834107:3496], now have 1 active actors on pipe
2025-10-10T14:34:00.577486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583833881:2438], now have 1 active actors on pipe
2025-10-10T14:34:00.577494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601316801611524:7381]
2025-10-10T14:34:00.577497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601316801611524:7381]
2025-10-10T14:34:00.577500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601316801611524:7381]
2025-10-10T14:34:00.577484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1185
2025-10-10T14:34:00.577511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:00.577513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1185
2025-10-10T14:34:00.577522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:00.577525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:00.577527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:00.577531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:00.577549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:00.577553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:00.577573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.577585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.577629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601316801611524:7381]
2025-10-10T14:34:00.577643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:00.577651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:00.577663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:00.577675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.577680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.577682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:00.577694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.577713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:00.578128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.578374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.578384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.578401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.578512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1186 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0
2025-10-10T14:34:00.578957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce659bf-ddbb601d-3a71b3f-53a63e28_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:00.581946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0] Write session: try to update token
2025-10-10T14:34:00.581974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:00.590173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:00.590194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.590205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601316801611524:7381]
2025-10-10T14:34:00.590251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:00.590258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:00.590430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:00.590570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.590709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.590835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.591027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:00.591078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:00.597840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId: src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:00.601040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:00.601238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.601264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.601317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:00.601418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:00.614665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:00.614686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.614691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:00.614693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:00.614704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601316801611524:7381]
2025-10-10T14:34:00.614709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601316801611524:7381]
2025-10-10T14:34:00.614713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601316801611524:7381]
2025-10-10T14:34:00.614765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:00.614767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:00.614775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.614777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:00.614779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:00.614784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:00.614939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:00.647898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601317583834171:4179]
2025-10-10T14:34:00.648295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1185, pipe: [1:7559601317583834171:4179]
2025-10-10T14:34:00.736114Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:00.744234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.744263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.744437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.744503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.744564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.744626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.744937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.744949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.745033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.745105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.745188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.745262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.745325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.745350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.745429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.745498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.745563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.745644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.745694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.745701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.745774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.745843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.745913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.745978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.746024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.746031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.746096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.746166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.746228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.746288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.746331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.746337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.746410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.746479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.746547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.746608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.746651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.746657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.746722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.746788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.746856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.746917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.746959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.746965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.747034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.747102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.747163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.747222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.747265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.747270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.747342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.747399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.747460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.747532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.747580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.747586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.747649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.747714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.747778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.747852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.747897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.747905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.747971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583834171:4179], now have 1 active actors on pipe
2025-10-10T14:34:00.748240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:00.748258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:00.748293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1186 reason: error at write: Disconnected sessionId: src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0
2025-10-10T14:34:00.748359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601317583834171:4179]
2025-10-10T14:34:00.748394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:00.748563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1186 sessionId: src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0 is DEAD
2025-10-10T14:34:00.748711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:00.748723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0] Write session will restart in 0.007911s
2025-10-10T14:34:00.748749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0] Write session: Do CDS request
2025-10-10T14:34:00.748754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:00.748755Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:00.757959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.758000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:00.758016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1187
2025-10-10T14:34:00.758208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.758252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:00.758264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:00.758268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:00.758794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1187 sessionId:  describe result for acl check
2025-10-10T14:34:00.758830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:00.758836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:00.758838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:00.758844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601317583834229:3479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:00.759733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601317583834229:3479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:00.762653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601317583834229:3479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:00.766256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601317583834229:3479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:00.766273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601317583834229:3479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:00.766277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601317583834229:3479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:00.766285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:00.769547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:00.772269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:00.772610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:00.772622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:00.772636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:00.772720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:00.772764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601316801611837:7397]
2025-10-10T14:34:00.773467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:00.773822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:00.773885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:00.774258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:00.774327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.774332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.774333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.774334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.774336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.774337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.774338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.774339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.774340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.774341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.774343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.774344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.774346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.774353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.774368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.774371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.774376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.774380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.774385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.774390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.774394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.774402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.774407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.774410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.774414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.774418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.774427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.774436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.774443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.774448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.774454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.774460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.774483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.774493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.774498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.774508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.774512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.774518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.774524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.774530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.774538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.774545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.774554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.774569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.774580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.774586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.774591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.774596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.774601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.774607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.774613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.774619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.774669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:00.777213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:00.777945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:00.777957Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:00.777959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:00.777963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:00.777970Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1186 [2:7559601316801611837:7397]
2025-10-10T14:34:00.777982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:00.778001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:00.778025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.778033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.778036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.778054Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:00.778067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:00.778075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:00.778142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.778149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.778151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.778153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:00.778219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:00.778228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.778239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.778250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.778266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:00.778290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583834400:3479], now have 1 active actors on pipe
2025-10-10T14:34:00.778299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601316801611832:7397]
2025-10-10T14:34:00.778302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601316801611832:7397]
2025-10-10T14:34:00.778304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601316801611832:7397]
2025-10-10T14:34:00.778320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:00.778334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583834187:2438], now have 1 active actors on pipe
2025-10-10T14:34:00.778343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:00.778353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:00.778360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:00.778363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:00.778364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:00.778367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:00.778392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601316801611832:7397]
2025-10-10T14:34:00.778400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:00.778409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:00.778403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1186
2025-10-10T14:34:00.778435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.778421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1186
2025-10-10T14:34:00.778447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.778484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:00.778496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.778501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.778503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:00.778519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.778530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:00.778548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.778733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.778746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.778770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.778948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1187 partition: 0 MaxSeqNo: 40 sessionId: src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0
2025-10-10T14:34:00.779403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c1dc726-6b281250-267d4702-ee8a2b95_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:00.782234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0] Write session: try to update token
2025-10-10T14:34:00.782255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:00.796931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId: src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:00.796963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:00.796979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.797007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601316801611832:7397]
2025-10-10T14:34:00.797064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:00.797068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:00.797284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:00.797477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.797655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.797852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.798112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:00.798154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:00.799928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:00.800133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.800151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.800205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:00.800292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:00.809562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:00.809580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.809584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:00.809586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:00.809598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601316801611832:7397]
2025-10-10T14:34:00.809603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601316801611832:7397]
2025-10-10T14:34:00.809607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601316801611832:7397]
2025-10-10T14:34:00.809658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:00.809666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.809668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:00.809802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:00.811100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:00.811113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:00.811117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:00.848609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601317583834459:4179]
2025-10-10T14:34:00.848944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1186, pipe: [1:7559601317583834459:4179]
2025-10-10T14:34:00.923060Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:00.931319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.931346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.931534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.931599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.931668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.931736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.931776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.931781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.931861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.931921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.931981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.932064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.932114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.932122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.932193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.932260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.932328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.932393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.932440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.932451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.932519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.932584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.932646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.932701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.932743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.932748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.932824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.932890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.932948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.933022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.933074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.933082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.933159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.933216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.933278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.933362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.933405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.933410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.933475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.933529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.933596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.933665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.933709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.933714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.933775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.933840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.933899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.933959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.934001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.934006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.934078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.934143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.934210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.934271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.934321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.934328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.934394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:00.934460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:00.934522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:00.934588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:00.934635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:00.934643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:00.934708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583834459:4179], now have 1 active actors on pipe
2025-10-10T14:34:00.934949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:00.934976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:00.934980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:00.935004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601317583834459:4179]
2025-10-10T14:34:00.935014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1187 reason: error at write: Disconnected sessionId: src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0
2025-10-10T14:34:00.935289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1187 sessionId: src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0 is DEAD
2025-10-10T14:34:00.935470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:00.935481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0] Write session will restart in 0.007967s
2025-10-10T14:34:00.935508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0] Write session: Do CDS request
2025-10-10T14:34:00.935515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:00.935667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:00.945006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.945114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:00.945138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1188
2025-10-10T14:34:00.945279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:00.945323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:00.945358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:00.945362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:00.945894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1188 sessionId:  describe result for acl check
2025-10-10T14:34:00.945934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:00.945943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:00.945945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:00.945953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601317583834527:3475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:00.946578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601317583834527:3475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:00.949546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601317583834527:3475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:00.954025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601317583834527:3475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:00.954045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601317583834527:3475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:00.954049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601317583834527:3475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:00.954059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:00.955521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:00.958260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:00.958448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:00.958460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:00.958472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:00.958529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:00.958573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601316801612106:7399]
2025-10-10T14:34:00.959013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:00.959336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:00.959397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:00.959741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:00.959830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.959837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.959839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.959840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.959841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.959843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.959844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.959845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.959846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.959848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.959849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.959850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.959852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.959859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.959874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.959877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.959882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.959886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.959890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.959894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.959898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.959902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.959908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.959912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.959915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.959919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.959930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.959938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:00.959945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.959957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:00.959961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.959970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:00.959974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.959979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:00.959985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.959990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:00.959994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.959999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:00.960003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.960008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:00.960012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.960017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:00.960027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.960032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:00.960043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.960053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:00.960057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.960062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.960067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.960073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.960079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.960083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.960123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:00.962539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:00.962848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:00.962862Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:00.962865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:00.962868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:00.962875Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1187 [2:7559601316801612106:7399]
2025-10-10T14:34:00.962886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:00.962908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:00.962915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.962918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.962921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.962937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:00.962949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:00.962961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:00.963016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.963023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.963025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.963028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:00.963204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:00.963213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.963225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:00.963240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:00.963186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1187
2025-10-10T14:34:00.963204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1187
2025-10-10T14:34:00.963261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:00.963287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583834719:3475], now have 1 active actors on pipe
2025-10-10T14:34:00.963295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601317583834461:2438], now have 1 active actors on pipe
2025-10-10T14:34:00.963315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.963327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.963347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601316801612101:7399]
2025-10-10T14:34:00.963354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601316801612101:7399]
2025-10-10T14:34:00.963356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601316801612101:7399]
2025-10-10T14:34:00.963372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:00.963388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:00.963392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:00.963397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:00.963398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:00.963409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:00.963413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:00.963434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:00.963447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:00.963452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:00.963455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:00.963466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:00.963481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:00.963508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601316801612101:7399]
2025-10-10T14:34:00.963520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:00.963529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:00.963536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.963670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.963681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.963701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:00.963772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1188 partition: 0 MaxSeqNo: 40 sessionId: src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0
2025-10-10T14:34:00.964200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb6bc770-a0bc6f0-870a34de-10c71d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:00.967067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0] Write session: try to update token
2025-10-10T14:34:00.967089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:00.974972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:00.975001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.975014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601316801612101:7399]
2025-10-10T14:34:00.975063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:00.975066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:00.975235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:00.975371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.975498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.975634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:00.975813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:00.975859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:00.981157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId: src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:00.983585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:00.983837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:00.983860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:00.983915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:00.983999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:00.993575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:00.993592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:00.993595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:00.993598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:00.993607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601316801612101:7399]
2025-10-10T14:34:00.993609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601316801612101:7399]
2025-10-10T14:34:00.993614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601316801612101:7399]
2025-10-10T14:34:00.993655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:00.993660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:00.993664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:00.993666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:00.993666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:00.993669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:00.993787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:01.034966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601321878802030:4179]
2025-10-10T14:34:01.035352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1187, pipe: [1:7559601321878802030:4179]
2025-10-10T14:34:01.107248Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:01.116422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.116452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.116641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.116706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.116772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.116843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.117169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.117181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.117258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.120363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601321878802030:4179]
2025-10-10T14:34:01.120373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:01.120378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:01.120413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1188 reason: error at write: Disconnected sessionId: src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0
2025-10-10T14:34:01.120416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:01.120662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1188 sessionId: src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0 is DEAD
2025-10-10T14:34:01.120848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:01.120861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0] Write session will restart in 0.005482s
2025-10-10T14:34:01.120889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0] Write session: Do CDS request
2025-10-10T14:34:01.120896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:01.117326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.117421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.117493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.117536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.117539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.117617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.117680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.117738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.117796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.117841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.117843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.117911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.117970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.118028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.118086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.118126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.118131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.118198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.118254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.118311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.118370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.118409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.118412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.118485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.118546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.118605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.118671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.118712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.118716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.118794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.118853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.118915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.118974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.119119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.119122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.119193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.119251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.119311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.119377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.119418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.119421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.119492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.119552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.119608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.119673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.119716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.119719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.119789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.119849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.119912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.119975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.120022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.120025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.120111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802030:4179], now have 1 active actors on pipe
2025-10-10T14:34:01.121068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:01.127927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.128037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:01.128056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1189
2025-10-10T14:34:01.128199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.128247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:01.128257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:01.128262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:01.128720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1189 sessionId:  describe result for acl check
2025-10-10T14:34:01.128761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:01.128767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:01.128769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:01.128776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601321878802048:3457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:01.129451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601321878802048:3457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:01.132935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601321878802048:3457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:01.136717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601321878802048:3457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:01.136734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601321878802048:3457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:01.136738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601321878802048:3457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:01.136748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:01.142118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:01.145181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:01.145458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:01.145469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:01.145481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:01.145539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:01.145587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601321096579672:7401]
2025-10-10T14:34:01.146220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:01.146577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:01.146631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:01.146963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:01.147026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.147034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.147035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.147036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.147037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.147039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.147040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.147041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.147043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.147044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.147045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.147047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.147048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.147054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.147068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.147072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.147076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.147081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.147086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.147090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.147094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.147097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.147102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.147106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.147110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.147114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.147122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.147131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.147137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.147143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.147149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.147155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.147159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.147165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.147170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.147175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.147180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.147187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.147197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.147202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.147209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.147219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.147224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.147229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.147233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.147243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.147248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.147257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.147261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.147266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.147272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.147282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.147318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:01.150000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:01.150344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:01.150357Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:01.150360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:01.150363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:01.150371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1188 [2:7559601321096579672:7401]
2025-10-10T14:34:01.150385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:01.150404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:01.150407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.150411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.150414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.150431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:01.150446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:01.150458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:01.150543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.150554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.150556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.150559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:01.150656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:01.150694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.150710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.150723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.150742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:01.150779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802190:3457], now have 1 active actors on pipe
2025-10-10T14:34:01.150784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802032:2438], now have 1 active actors on pipe
2025-10-10T14:34:01.150792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601321096579667:7401]
2025-10-10T14:34:01.150795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601321096579667:7401]
2025-10-10T14:34:01.150798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601321096579667:7401]
2025-10-10T14:34:01.150816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:01.150837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:01.150842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:01.150846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:01.150848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:01.150803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1188
2025-10-10T14:34:01.150804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1188
2025-10-10T14:34:01.150856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:01.150865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:01.150907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.150917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.150938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601321096579667:7401]
2025-10-10T14:34:01.150950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:01.150966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:01.150987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:01.150999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.151005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.151008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:01.151020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.151037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:01.151067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.151209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.151218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.151235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.151358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1189 partition: 0 MaxSeqNo: 40 sessionId: src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0
2025-10-10T14:34:01.151799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5899eee-ec0a69fd-af8c8a31-bd8f89c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:01.154559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0] Write session: try to update token
2025-10-10T14:34:01.154579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:01.168692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId: src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:01.170869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:01.170888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:01.170892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:01.170894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:01.170905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601321096579667:7401]
2025-10-10T14:34:01.170911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601321096579667:7401]
2025-10-10T14:34:01.170915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601321096579667:7401]
2025-10-10T14:34:01.170970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:01.170977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:01.170984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:01.170986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.170988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:01.170988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:01.171137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:01.171535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:01.220314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601321878802306:4179]
2025-10-10T14:34:01.220589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1188, pipe: [1:7559601321878802306:4179]
2025-10-10T14:34:01.287467Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:01.288458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.288477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.288531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802306:4179], now have 1 active actors on pipe
2025-10-10T14:34:01.288778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601321878802306:4179]
2025-10-10T14:34:01.288778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:01.288784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:01.288814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:01.288848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1189 reason: error at write: Disconnected sessionId: src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0
2025-10-10T14:34:01.288913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:01.289054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1189 sessionId: src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0 is DEAD
2025-10-10T14:34:01.289235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:01.289247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0] Write session will restart in 0.008043s
2025-10-10T14:34:01.289273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0] Write session: Do CDS request
2025-10-10T14:34:01.289284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:01.298898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.298963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:01.298979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1190
2025-10-10T14:34:01.299183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.299221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:01.299232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:01.299248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:01.299701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1190 sessionId:  describe result for acl check
2025-10-10T14:34:01.299741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:01.299743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:01.299745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:01.299751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601321878802384:3451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:01.300309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601321878802384:3451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:01.303360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601321878802384:3451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:01.306587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601321878802384:3451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:01.306602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601321878802384:3451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:01.306607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601321878802384:3451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:01.306615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:01.308028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:01.310741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:01.310968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:01.310981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:01.310994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:01.311051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:01.311095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601321096579943:7403]
2025-10-10T14:34:01.311705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:01.312106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:01.312167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:01.312533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:01.312596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.312603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.312604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.312605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.312607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.312608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.312609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.312611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.312612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.312614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.312615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.312616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.312618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.312624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.312638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.312642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.312647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.312651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.312655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.312659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.312663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.312667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.312672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.312676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.312680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.312684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.312692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.312701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.312708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.312718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.312721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.312724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.312727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.312730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.312734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.312737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.312739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.312743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.312746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.312749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.312752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.312756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.312758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.312762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.312767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.312772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.312782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.312787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.312796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.312806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.312814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.312817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.312840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:01.315413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:01.316284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:01.316298Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:01.316300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:01.316304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:01.316311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1189 [2:7559601321096579943:7403]
2025-10-10T14:34:01.316321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:01.316335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:01.316338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.316341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.316343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.316357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:01.316363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:01.316369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:01.316439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.316449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.316451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.316454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:01.316528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:01.316538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.316551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.316563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.316582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:01.316610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802582:3451], now have 1 active actors on pipe
2025-10-10T14:34:01.316618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802320:2438], now have 1 active actors on pipe
2025-10-10T14:34:01.316627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601321096579938:7403]
2025-10-10T14:34:01.316635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601321096579938:7403]
2025-10-10T14:34:01.316638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601321096579938:7403]
2025-10-10T14:34:01.316654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:01.316674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:01.316675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:01.316679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:01.316681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:01.316691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:01.316695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:01.316684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1189
2025-10-10T14:34:01.316688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1189
2025-10-10T14:34:01.316727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601321096579938:7403]
2025-10-10T14:34:01.316734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:01.316736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:01.316756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.316767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.316820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:01.316834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.316838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.316841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:01.316854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.316870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:01.316898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.317072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.317078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.317095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.317197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1190 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0
2025-10-10T14:34:01.317656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f73d29a7-6724a085-9b62b69d-1c4adf06_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:01.320508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Write session: try to update token
2025-10-10T14:34:01.320529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:01.335637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId: src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:01.336921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:01.336939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:01.336943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:01.336945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:01.336956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601321096579938:7403]
2025-10-10T14:34:01.336960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601321096579938:7403]
2025-10-10T14:34:01.336966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601321096579938:7403]
2025-10-10T14:34:01.337029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:01.337032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:01.337039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.337040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:01.337041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:01.337045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:01.337185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:01.338445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:01.388768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601321878802596:4179]
2025-10-10T14:34:01.389102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1189, pipe: [1:7559601321878802596:4179]
2025-10-10T14:34:01.449745Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:01.449955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.449971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.450016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802596:4179], now have 1 active actors on pipe
2025-10-10T14:34:01.450176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:01.450189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:01.450212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:01.450212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601321878802596:4179]
2025-10-10T14:34:01.450229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:01.450276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1190 reason: error at write: Disconnected sessionId: src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0
2025-10-10T14:34:01.450504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1190 sessionId: src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0 is DEAD
2025-10-10T14:34:01.450645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 132 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:34:01.450683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:01.450692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Write session will restart in 0.005822s
2025-10-10T14:34:01.450717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Write session: Do CDS request
2025-10-10T14:34:01.450724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:01.457904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.457971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:01.457986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1191
2025-10-10T14:34:01.458131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.458180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:01.458203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:01.458214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:01.458671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1191 sessionId:  describe result for acl check
2025-10-10T14:34:01.458715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:01.458717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:01.458719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:01.458725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601321878802638:3448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:01.459285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601321878802638:3448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:01.463141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601321878802638:3448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:01.466737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601321878802638:3448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:01.466752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601321878802638:3448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:01.466755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601321878802638:3448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:01.466765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:01.470308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:01.472923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:01.473209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:01.473222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:01.473238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:01.473318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:01.473390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601321096580228:7406]
2025-10-10T14:34:01.474042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:01.474366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:01.474423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:01.474802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:01.474867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.474874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.474876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.474877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.474878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.474879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.474880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.474882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.474883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.474884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.474885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.474886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.474888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.474894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.474909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.474914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.474919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.474923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.474928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.474932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.474936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.474940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.474945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.474949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.474953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.474956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.474964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.474973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.474980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.474986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.474990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.474995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.474999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.475005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.475009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.475013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.475017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.475023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.475029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.475037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.475042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.475051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.475055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.475061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.475071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.475076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.475082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.475094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.475098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.475104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.475109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.475114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.475154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:01.477531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:01.477856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:01.477868Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:01.477870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:01.477874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:01.477880Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1190 [2:7559601321096580228:7406]
2025-10-10T14:34:01.477893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:01.477910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:01.477914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.477918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.477920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.477937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:01.477950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:01.477962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:01.478017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.478027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.478030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.478032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:01.478100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:01.478108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.478120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.478134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.478156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:01.478175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601321096580223:7406]
2025-10-10T14:34:01.478178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601321096580223:7406]
2025-10-10T14:34:01.478180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601321096580223:7406]
2025-10-10T14:34:01.478193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:01.478206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:01.478207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802826:3448], now have 1 active actors on pipe
2025-10-10T14:34:01.478209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:01.478210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802609:2438], now have 1 active actors on pipe
2025-10-10T14:34:01.478212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:01.478218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:01.478234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:01.478237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:01.478259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601321096580223:7406]
2025-10-10T14:34:01.478261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:01.478253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1190
2025-10-10T14:34:01.478286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:01.478303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.478312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.478276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1190
2025-10-10T14:34:01.478345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d21fba04-52472a7f-4554898c-4057c54c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:01.478358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.478362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.478365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:01.478376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.478391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:01.478409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.478545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.478561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.478586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.478678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1191 partition: 0 MaxSeqNo: 40 sessionId: src_id|d21fba04-52472a7f-4554898c-4057c54c_0
2025-10-10T14:34:01.479090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e1a04b-9b2597a3-1b4d2bbc-62720569_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d21fba04-52472a7f-4554898c-4057c54c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:01.481786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21fba04-52472a7f-4554898c-4057c54c_0] Write session: try to update token
2025-10-10T14:34:01.481804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21fba04-52472a7f-4554898c-4057c54c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:01.490028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:01.490046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:01.490058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601321096580223:7406]
2025-10-10T14:34:01.490114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:01.490120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:01.490287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:01.490434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.490579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.490721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.490918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:01.490966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:01.507846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId: src_id|d21fba04-52472a7f-4554898c-4057c54c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:01.508627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:01.508646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:01.508650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:01.508652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:01.508665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601321096580223:7406]
2025-10-10T14:34:01.508669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601321096580223:7406]
2025-10-10T14:34:01.508673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601321096580223:7406]
2025-10-10T14:34:01.508725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:01.508731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:01.508738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:01.508742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:01.508742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.508744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:01.508884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:01.510653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:01.550554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601321878802885:4179]
2025-10-10T14:34:01.550911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1190, pipe: [1:7559601321878802885:4179]
2025-10-10T14:34:01.625902Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:01.626521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.626536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.626560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802885:4179], now have 1 active actors on pipe
2025-10-10T14:34:01.626843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601321878802885:4179]
2025-10-10T14:34:01.626848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:01.626853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:01.626886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:01.626923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1191 reason: error at write: Disconnected sessionId: src_id|d21fba04-52472a7f-4554898c-4057c54c_0
2025-10-10T14:34:01.627134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:01.627155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1191 sessionId: src_id|d21fba04-52472a7f-4554898c-4057c54c_0 is DEAD
2025-10-10T14:34:01.627333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21fba04-52472a7f-4554898c-4057c54c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:01.627341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21fba04-52472a7f-4554898c-4057c54c_0] Write session will restart in 0.009220s
2025-10-10T14:34:01.627370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21fba04-52472a7f-4554898c-4057c54c_0] Write session: Do CDS request
2025-10-10T14:34:01.627377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21fba04-52472a7f-4554898c-4057c54c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:01.637932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21fba04-52472a7f-4554898c-4057c54c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.638031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:01.638047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1192
2025-10-10T14:34:01.638196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.638244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:01.638255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:01.638259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:01.638743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1192 sessionId:  describe result for acl check
2025-10-10T14:34:01.638792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:01.638799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:01.638801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:01.638809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601321878802939:3440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:01.639452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601321878802939:3440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:01.643550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601321878802939:3440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:01.647375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601321878802939:3440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:01.647391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601321878802939:3440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:01.647395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601321878802939:3440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:01.647404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:01.650819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:01.655110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:01.655346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:01.655358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:01.655370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:01.655423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:01.655487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601321096580501:7408]
2025-10-10T14:34:01.656131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:01.656415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:01.656459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:01.656782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:01.656845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.656852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.656853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.656854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.656855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.656857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.656858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.656859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.656860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.656861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.656863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.656864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.656865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.656870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.656883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.656887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.656891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.656896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.656900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.656904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.656909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.656912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.656918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.656922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.656926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.656930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.656937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.656946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.656953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.656959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.656974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.656979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.656985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.656990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.657000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.657004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.657009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.657015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.657019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.657024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.657029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.657034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.657039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.657044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.657048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.657054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.657058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.657068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.657072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.657077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.657083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.657088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.657129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:01.660010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:01.660597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:01.660609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:01.660611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:01.660615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:01.660621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1191 [2:7559601321096580501:7408]
2025-10-10T14:34:01.660635Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:01.660653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:01.660660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.660663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.660666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.660683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:01.660695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:01.660708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:01.660773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.660780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.660782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.660785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:01.660852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:01.660862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.660870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.660877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.660886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:01.660906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601321096580496:7408]
2025-10-10T14:34:01.660910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601321096580496:7408]
2025-10-10T14:34:01.660912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601321096580496:7408]
2025-10-10T14:34:01.660926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:01.660943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878802893:2438], now have 1 active actors on pipe
2025-10-10T14:34:01.660948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:01.660951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:01.660951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878803133:3440], now have 1 active actors on pipe
2025-10-10T14:34:01.660954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:01.660960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:01.660986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:01.660990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:01.661014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601321096580496:7408]
2025-10-10T14:34:01.661028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:01.661036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:01.661036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1191
2025-10-10T14:34:01.661037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1191
2025-10-10T14:34:01.661075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.661089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.661117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:01.661130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.661134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.661138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:01.661152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.661171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:01.661193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.661381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.661389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.661405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.663255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1192 partition: 0 MaxSeqNo: 40 sessionId: src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0
2025-10-10T14:34:01.663674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21fba04-52472a7f-4554898c-4057c54c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:01.666391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0] Write session: try to update token
2025-10-10T14:34:01.666411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:01.675804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:01.675825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:01.675836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601321096580496:7408]
2025-10-10T14:34:01.675892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:01.675914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:01.676113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:01.676263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.676411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.676563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.676801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:01.676840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:01.685814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId: src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:01.688565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:01.688832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.688860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.688934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:01.689063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:01.692818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:01.692838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:01.692841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:01.692843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:01.692854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601321096580496:7408]
2025-10-10T14:34:01.692858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601321096580496:7408]
2025-10-10T14:34:01.692862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601321096580496:7408]
2025-10-10T14:34:01.692909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:01.692909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:01.692915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:01.692920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.692923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:01.692919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:01.693155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:01.727153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601321878803197:4179]
2025-10-10T14:34:01.727373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1191, pipe: [1:7559601321878803197:4179]
2025-10-10T14:34:01.813327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:01.822644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.822679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.822871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.822939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.823004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.823073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.823121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.823131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.823210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.823273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.823339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.823413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.823556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.823566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.823635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.823742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.823851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.823980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.824040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.824048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.824124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.824233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.824373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.824532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.824590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.824598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.824705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.824810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.824919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.825419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.825470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.825479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.825942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.826018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.826093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.826167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.826312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.826324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.826395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.826459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.826524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.826601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.826740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.826749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.826819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.826883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.826947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.827010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.827138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.827149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.827216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.827277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.827340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.827407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.827463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.827470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.827543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:01.827607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:01.827670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:01.827740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:01.827878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:01.827887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:01.827964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878803197:4179], now have 1 active actors on pipe
2025-10-10T14:34:01.828263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:01.828270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601321878803197:4179]
2025-10-10T14:34:01.828300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:01.828303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:01.828336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1192 reason: error at write: Disconnected sessionId: src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0
2025-10-10T14:34:01.828615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1192 sessionId: src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0 is DEAD
2025-10-10T14:34:01.828836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:01.828847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0] Write session will restart in 0.009088s
2025-10-10T14:34:01.828871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0] Write session: Do CDS request
2025-10-10T14:34:01.828877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:01.829270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:01.838907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.839011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:01.839028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1193
2025-10-10T14:34:01.839189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:01.839243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:01.839253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:01.839257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:01.839762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1193 sessionId:  describe result for acl check
2025-10-10T14:34:01.839801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:01.839809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:01.839811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:01.839817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601321878803253:3419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:01.840461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601321878803253:3419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:01.843332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601321878803253:3419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:01.846465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601321878803253:3419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:01.846494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601321878803253:3419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:01.846498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601321878803253:3419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:01.846507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:01.849070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:01.851593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:01.851836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:01.851851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:01.851865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:01.851937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:01.851988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601321096580816:7424]
2025-10-10T14:34:01.852638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:01.852975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:01.853030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:01.853396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:01.853480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.853487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.853488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.853490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.853491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.853493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.853494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.853495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.853496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.853498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.853499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.853500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.853501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.853509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.853524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.853528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.853533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.853538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.853542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.853547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.853551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.853556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.853560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.853564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.853568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.853572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.853584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.853599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:01.853610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.853618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:01.853623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.853629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:01.853639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.853645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:01.853656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.853662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:01.853667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.853673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:01.853685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.853690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:01.853700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.853706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:01.853716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.853722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:01.853731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.853738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:01.853749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.853754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.853758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.853763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.853771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.853777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.853822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:01.856419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:01.857323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:01.857353Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:01.857355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:01.857360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:01.857366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1192 [2:7559601321096580816:7424]
2025-10-10T14:34:01.857380Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:01.857403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:01.857411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.857416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.857418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.857436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:01.857449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:01.857457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:01.857514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.857521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.857523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.857525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:01.857598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:01.857605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.857617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:01.857629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:01.857648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:01.857676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878803448:3419], now have 1 active actors on pipe
2025-10-10T14:34:01.857687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878803200:2438], now have 1 active actors on pipe
2025-10-10T14:34:01.857694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601321096580811:7424]
2025-10-10T14:34:01.857696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601321096580811:7424]
2025-10-10T14:34:01.857697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601321096580811:7424]
2025-10-10T14:34:01.857709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:01.857720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:01.857728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:01.857731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:01.857731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:01.857733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:01.857734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:01.857756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601321096580811:7424]
2025-10-10T14:34:01.857763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:01.857746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1192
2025-10-10T14:34:01.857754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1192
2025-10-10T14:34:01.857786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:01.857808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.857817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.857845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfe3aef9-adda6290-53654296-77296e64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:01.857857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:01.857860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:01.857868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:01.857877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:01.857889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:01.857901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.858086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.858097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.858124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:01.858218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1193 partition: 0 MaxSeqNo: 40 sessionId: src_id|bfe3aef9-adda6290-53654296-77296e64_0
2025-10-10T14:34:01.858664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8661fd00-1974001f-2e6e4f28-4a46728d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bfe3aef9-adda6290-53654296-77296e64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:01.861563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe3aef9-adda6290-53654296-77296e64_0] Write session: try to update token
2025-10-10T14:34:01.861582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe3aef9-adda6290-53654296-77296e64_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:01.875554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:01.875575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:01.875588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601321096580811:7424]
2025-10-10T14:34:01.875635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:01.875636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:01.875844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:01.875997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.876158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.876307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:01.876523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:01.876567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:01.879661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId: src_id|bfe3aef9-adda6290-53654296-77296e64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:01.882441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:01.882648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:01.882670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:01.882714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:01.882829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:01.889221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:01.889249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:01.889254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:01.889255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:01.889269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601321096580811:7424]
2025-10-10T14:34:01.889275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601321096580811:7424]
2025-10-10T14:34:01.889279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601321096580811:7424]
2025-10-10T14:34:01.889350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:01.889353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:01.889362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:01.889364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:01.889365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:01.889369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:01.889553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:01.928435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601321878803477:4179]
2025-10-10T14:34:01.928780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1192, pipe: [1:7559601321878803477:4179]
2025-10-10T14:34:02.004695Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:02.013049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.013078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.013259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.013326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.013422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.013493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.013541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.013552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.013622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.013690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.013755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.013827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.013874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.013882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.013949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.014058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.014164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.014229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.014277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.014284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.014353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.014420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.014524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.014592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.014636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.014644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.014714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.014776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.014841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.014922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.014986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.014993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.015062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.015126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.015192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.015255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.015317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.015324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.015389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.015457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.015525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.015589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.015717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.015725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.015790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.015856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.015923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.015987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.016032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.016039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.016108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.016171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.016233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.016298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.016346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.016354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.016425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:02.016493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:02.016556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:02.016620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:02.016667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:02.016673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:02.016739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601321878803477:4179], now have 1 active actors on pipe
2025-10-10T14:34:02.016994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601321878803477:4179]
2025-10-10T14:34:02.017031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:02.017186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:02.017195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:02.017223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1193 reason: error at write: Disconnected sessionId: src_id|bfe3aef9-adda6290-53654296-77296e64_0
2025-10-10T14:34:02.017463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1193 sessionId: src_id|bfe3aef9-adda6290-53654296-77296e64_0 is DEAD
2025-10-10T14:34:02.017611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe3aef9-adda6290-53654296-77296e64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:02.017622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe3aef9-adda6290-53654296-77296e64_0] Write session will restart in 0.008065s
2025-10-10T14:34:02.017648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe3aef9-adda6290-53654296-77296e64_0] Write session: Do CDS request
2025-10-10T14:34:02.017654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe3aef9-adda6290-53654296-77296e64_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:02.017930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:02.026879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe3aef9-adda6290-53654296-77296e64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.026986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:02.027004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1194
2025-10-10T14:34:02.027596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.027635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:02.027647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:02.027651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:02.028207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1194 sessionId:  describe result for acl check
2025-10-10T14:34:02.028261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:02.028268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:02.028270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:02.028277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601326173770832:3415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:02.028887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601326173770832:3415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:02.031904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601326173770832:3415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:02.035002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601326173770832:3415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:02.035015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601326173770832:3415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:02.035018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601326173770832:3415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:02.035028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:02.037819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:02.040272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:02.040505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:02.040517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:02.040529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:02.040586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:02.040635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601325391548386:7426]
2025-10-10T14:34:02.041270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:02.041590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:02.041641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:02.041983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:02.042040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.042049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.042050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.042051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.042053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.042054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.042055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.042056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.042057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.042058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.042059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.042060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.042061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.042067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.042082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.042086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.042091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.042095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.042099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.042104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.042108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.042112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.042117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.042122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.042125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.042129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.042137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.042146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.042153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.042159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.042164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.042170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.042174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.042180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.042186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.042191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.042204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.042209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.042215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.042220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.042224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.042230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.042235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.042240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.042247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.042252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.042256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.042261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.042265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.042271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.042276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.042281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.042322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:02.044666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:02.044977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:02.044990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:02.044992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:02.044996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:02.045003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1193 [2:7559601325391548386:7426]
2025-10-10T14:34:02.045016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:02.045035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:02.045043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.045045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.045046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.045060Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:02.045065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:02.045071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:02.045116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.045122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.045123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.045125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:02.045322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:02.045346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.045355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.045361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1193
2025-10-10T14:34:02.045416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1193
2025-10-10T14:34:02.045368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.045390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:02.045414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173770776:2438], now have 1 active actors on pipe
2025-10-10T14:34:02.045418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771024:3415], now have 1 active actors on pipe
2025-10-10T14:34:02.045426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601325391548381:7426]
2025-10-10T14:34:02.045429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601325391548381:7426]
2025-10-10T14:34:02.045431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601325391548381:7426]
2025-10-10T14:34:02.045447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:02.045455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:02.045458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:02.045460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:02.045470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:02.045487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:02.045491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:02.045527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.045532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.045549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601325391548381:7426]
2025-10-10T14:34:02.045561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:02.045596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:02.045601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:02.045604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.045608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.045611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:02.045623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.045635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:02.045660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.045900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.045914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.045933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.046098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1194 partition: 0 MaxSeqNo: 40 sessionId: src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0
2025-10-10T14:34:02.046521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe3aef9-adda6290-53654296-77296e64_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:02.049217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0] Write session: try to update token
2025-10-10T14:34:02.049239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:02.063774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId: src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:02.065838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:02.065856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:02.065859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:02.065862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:02.065873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601325391548381:7426]
2025-10-10T14:34:02.065877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601325391548381:7426]
2025-10-10T14:34:02.065884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601325391548381:7426]
2025-10-10T14:34:02.065933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:02.065936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:02.065945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.065947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:02.065947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:02.065972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:02.066104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:02.066668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:02.117365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601326173771054:4179]
2025-10-10T14:34:02.117702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1193, pipe: [1:7559601326173771054:4179]
2025-10-10T14:34:02.181911Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:02.182392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.182409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.182458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771054:4179], now have 1 active actors on pipe
2025-10-10T14:34:02.182684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:02.182700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:02.182732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601326173771054:4179]
2025-10-10T14:34:02.182756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:02.182849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1194 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0
2025-10-10T14:34:02.183087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1194 sessionId: src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0 is DEAD
2025-10-10T14:34:02.183245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:02.183256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0] Write session will restart in 0.005365s
2025-10-10T14:34:02.183281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0] Write session: Do CDS request
2025-10-10T14:34:02.183287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:02.189906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.189968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:02.189983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1195
2025-10-10T14:34:02.190151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.190197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:02.190209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:02.190213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:02.190677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1195 sessionId:  describe result for acl check
2025-10-10T14:34:02.190719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:02.190727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:02.190729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:02.190736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601326173771075:3411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:02.191330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601326173771075:3411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:02.194191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601326173771075:3411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:02.198690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601326173771075:3411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:02.198706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601326173771075:3411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:02.198709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601326173771075:3411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:02.198730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:02.203470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:02.206321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:02.206553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:02.206567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:02.206580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:02.206635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:02.206688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601325391548661:7428]
2025-10-10T14:34:02.207329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:02.207631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:02.207679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:02.207999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:02.208058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.208064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.208066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.208067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.208069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.208070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.208071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.208072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.208074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.208075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.208076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.208077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.208078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.208084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.208098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.208102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.208106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.208111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.208116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.208120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.208124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.208128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.208133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.208137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.208141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.208145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.208152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.208161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.208167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.208173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.208178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.208184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.208189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.208201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.208205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.208211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.208215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.208220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.208225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.208230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.208234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.208240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.208246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.208251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.208261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.208266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.208270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.208276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.208281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.208294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.208299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.208305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.208347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:02.210892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:02.211220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:02.211247Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:02.211250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:02.211254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:02.211260Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1194 [2:7559601325391548661:7428]
2025-10-10T14:34:02.211273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:02.211290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:02.211293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.211296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.211299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.211316Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:02.211323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:02.211330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:02.211390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.211399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.211401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.211404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:02.211473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:02.211493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.211504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.211514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.211530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:02.211553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771056:2438], now have 1 active actors on pipe
2025-10-10T14:34:02.211569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771228:3411], now have 1 active actors on pipe
2025-10-10T14:34:02.211576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601325391548656:7428]
2025-10-10T14:34:02.211579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601325391548656:7428]
2025-10-10T14:34:02.211580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601325391548656:7428]
2025-10-10T14:34:02.211594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:02.211611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:02.211617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:02.211620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:02.211622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:02.211631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:02.211635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:02.211662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601325391548656:7428]
2025-10-10T14:34:02.211670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:02.211681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:02.211654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1194
2025-10-10T14:34:02.211677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1194
2025-10-10T14:34:02.211708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.211718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.211756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:02.211768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.211777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.211780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:02.211793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.211808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:02.211827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.211962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.211976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.211999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.212106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1195 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0
2025-10-10T14:34:02.212547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44f1d7bb-b51e275b-aacc0154-5dc71520_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:02.215636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0] Write session: try to update token
2025-10-10T14:34:02.215657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:02.230123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId: src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:02.231474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:02.231500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:02.231504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:02.231506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:02.231515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601325391548656:7428]
2025-10-10T14:34:02.231520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601325391548656:7428]
2025-10-10T14:34:02.231524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601325391548656:7428]
2025-10-10T14:34:02.231573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:02.231574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:02.231581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:02.231585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:02.231587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.231589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:02.231740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:02.232796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:02.282691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601326173771335:4179]
2025-10-10T14:34:02.282968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1194, pipe: [1:7559601326173771335:4179]
2025-10-10T14:34:02.347853Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:02.348587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.348608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.348651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771335:4179], now have 1 active actors on pipe
2025-10-10T14:34:02.348899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:02.348918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:02.348923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:02.348980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601326173771335:4179]
2025-10-10T14:34:02.348978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:02.349005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1195 reason: error at write: Disconnected sessionId: src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0
2025-10-10T14:34:02.349237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1195 sessionId: src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0 is DEAD
2025-10-10T14:34:02.349418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:02.349428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0] Write session will restart in 0.005499s
2025-10-10T14:34:02.349452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0] Write session: Do CDS request
2025-10-10T14:34:02.349458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:02.355915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.356018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:02.356034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1196
2025-10-10T14:34:02.356167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.356199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:02.356210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:02.356214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:02.356684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1196 sessionId:  describe result for acl check
2025-10-10T14:34:02.356718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:02.356719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:02.356720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:02.356725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601326173771352:3408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:02.357267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601326173771352:3408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:02.360122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601326173771352:3408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:02.363836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601326173771352:3408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:02.363851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601326173771352:3408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:02.363855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601326173771352:3408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:02.363864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:02.369872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:02.372745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:02.373035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:02.373045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:02.373060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:02.373122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:02.373171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601325391548937:7430]
2025-10-10T14:34:02.373852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:02.374210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:02.374280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:02.374637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:02.374716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.374725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.374727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.374728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.374730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.374731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.374732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.374734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.374735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.374736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.374738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.374739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.374740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.374747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.374763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.374767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.374772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.374777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.374781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.374786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.374791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.374796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.374801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.374806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.374810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.374815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.374824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.374834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.374841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.374847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.374852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.374858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.374863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.374869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.374875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.374881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.374887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.374893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.374898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.374905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.374909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.374915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.374921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.374936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.374941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.374951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.374957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.374967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.374973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.374981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.374990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.374997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.375048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:02.377728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:02.378159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:02.378171Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:02.378174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:02.378188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:02.378200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1195 [2:7559601325391548937:7430]
2025-10-10T14:34:02.378215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:02.378257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:02.378260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.378264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.378266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.378284Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:02.378297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:02.378311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:02.378373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.378381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.378383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.378386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:02.378456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:02.378464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.378476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.378489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.378511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:02.378538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771337:2438], now have 1 active actors on pipe
2025-10-10T14:34:02.378546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771498:3408], now have 1 active actors on pipe
2025-10-10T14:34:02.378555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601325391548932:7430]
2025-10-10T14:34:02.378562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601325391548932:7430]
2025-10-10T14:34:02.378564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601325391548932:7430]
2025-10-10T14:34:02.378578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:02.378595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:02.378598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:02.378598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:02.378600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:02.378614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:02.378618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:02.378608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1195
2025-10-10T14:34:02.378650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601325391548932:7430]
2025-10-10T14:34:02.378630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1195
2025-10-10T14:34:02.378659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:02.378660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:02.378678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.378683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.378733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:02.378746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.378750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.378752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:02.378767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.378784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:02.378806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.378958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.378968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.378984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.379083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1196 partition: 0 MaxSeqNo: 40 sessionId: src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0
2025-10-10T14:34:02.379521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d688ac8-4dda06b-ca40d179-bfe38143_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:02.382371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0] Write session: try to update token
2025-10-10T14:34:02.382392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:02.397209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId: src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:02.399428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:02.399450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:02.399454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:02.399456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:02.399466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601325391548932:7430]
2025-10-10T14:34:02.399474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601325391548932:7430]
2025-10-10T14:34:02.399478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601325391548932:7430]
2025-10-10T14:34:02.399530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:02.399530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:02.399537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:02.399538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.399540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:02.399543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:02.399689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:02.400102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:02.432519Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 11 CurrentSessionLifetimeMs: 181185 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:34:02.449089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601326173771617:4179]
2025-10-10T14:34:02.449413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1195, pipe: [1:7559601326173771617:4179]
2025-10-10T14:34:02.515852Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:02.516325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.516343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.516389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771617:4179], now have 1 active actors on pipe
2025-10-10T14:34:02.516597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:02.516603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:02.516604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:02.516608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:02.516670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601326173771617:4179]
2025-10-10T14:34:02.516689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1196 reason: error at write: Disconnected sessionId: src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0
2025-10-10T14:34:02.516908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1196 sessionId: src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0 is DEAD
2025-10-10T14:34:02.517086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:02.517096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0] Write session will restart in 0.005481s
2025-10-10T14:34:02.517122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0] Write session: Do CDS request
2025-10-10T14:34:02.517131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:02.523930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.524063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:02.524090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1197
2025-10-10T14:34:02.524217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.524256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:02.524267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:02.524271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:02.524697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1197 sessionId:  describe result for acl check
2025-10-10T14:34:02.524729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:02.524731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:02.524734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:02.524740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601326173771641:3402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:02.525363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601326173771641:3402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:02.527246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601326173771641:3402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:02.529784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601326173771641:3402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:02.529800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601326173771641:3402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:02.529804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601326173771641:3402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:02.529813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:02.541936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:02.545142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:02.545436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:02.545447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:02.545461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:02.545522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:02.545568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601325391549226:7433]
2025-10-10T14:34:02.546293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:02.546644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:02.546691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:02.547034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:02.547093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.547099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.547100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.547102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.547103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.547105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.547106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.547107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.547109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.547111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.547112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.547114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.547115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.547122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.547137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.547142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.547147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.547151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.547156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.547160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.547165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.547169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.547174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.547178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.547183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.547187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.547196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.547210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.547217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.547223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.547229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.547235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.547240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.547246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.547252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.547262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.547267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.547273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.547278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.547290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.547295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.547301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.547311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.547318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.547328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.547334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.547343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.547350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.547359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.547365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.547370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.547381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.547425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:02.550106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:02.550418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:02.550430Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:02.550433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:02.550438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:02.550446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1196 [2:7559601325391549226:7433]
2025-10-10T14:34:02.550463Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:02.550482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:02.550490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.550493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.550496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.550515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:02.550527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:02.550535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:02.550600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.550607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.550610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.550613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:02.550689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:02.550697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.550709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.550726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.550750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:02.550779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771631:2438], now have 1 active actors on pipe
2025-10-10T14:34:02.550788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771692:3402], now have 1 active actors on pipe
2025-10-10T14:34:02.550796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601325391549221:7433]
2025-10-10T14:34:02.550798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601325391549221:7433]
2025-10-10T14:34:02.550801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601325391549221:7433]
2025-10-10T14:34:02.550814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:02.550829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:02.550832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:02.550836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:02.550838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:02.550847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:02.550855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:02.550812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1196
2025-10-10T14:34:02.550884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601325391549221:7433]
2025-10-10T14:34:02.550891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:02.550840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1196
2025-10-10T14:34:02.550892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:02.550921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.550931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.550972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:02.550984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.550989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.550992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:02.551004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.551020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:02.551043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.551217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.551231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.551269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.551366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1197 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0
2025-10-10T14:34:02.551807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2162536b-a1779f48-fbe78b01-a642b9c7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:02.554523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0] Write session: try to update token
2025-10-10T14:34:02.554545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:02.568784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId: src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:02.571072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:02.571097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:02.571101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:02.571103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:02.571114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601325391549221:7433]
2025-10-10T14:34:02.571119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601325391549221:7433]
2025-10-10T14:34:02.571123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601325391549221:7433]
2025-10-10T14:34:02.571176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:02.571184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:02.571189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.571191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:02.571191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:02.571195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:02.571333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:02.571598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:02.617049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601326173771918:4179]
2025-10-10T14:34:02.617379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1196, pipe: [1:7559601326173771918:4179]
2025-10-10T14:34:02.685759Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:02.686058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.686078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.686126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771918:4179], now have 1 active actors on pipe
2025-10-10T14:34:02.686358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:02.686348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:02.686366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:02.686374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:02.686414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601326173771918:4179]
2025-10-10T14:34:02.686443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1197 reason: error at write: Disconnected sessionId: src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0
2025-10-10T14:34:02.686696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1197 sessionId: src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0 is DEAD
2025-10-10T14:34:02.686869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:02.686878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0] Write session will restart in 0.008564s
2025-10-10T14:34:02.686902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0] Write session: Do CDS request
2025-10-10T14:34:02.686924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:02.696999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.697101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:02.697119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1198
2025-10-10T14:34:02.697289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.697325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:02.697350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:02.697354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:02.697832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1198 sessionId:  describe result for acl check
2025-10-10T14:34:02.697882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:02.697888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:02.697890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:02.697897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601326173771980:3383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:02.698493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601326173771980:3383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:02.701466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601326173771980:3383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:02.705057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601326173771980:3383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:02.705073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601326173771980:3383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:02.705076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601326173771980:3383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:02.705086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:02.707653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:02.710510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:02.710748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:02.710760Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:02.710773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:02.710833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:02.710881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601325391549506:7436]
2025-10-10T14:34:02.711570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:02.711916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:02.711964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:02.712318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:02.712379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.712389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.712390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.712391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.712393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.712394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.712395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.712397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.712399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.712400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.712401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.712403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.712404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.712410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.712425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.712430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.712434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.712438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.712443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.712448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.712452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.712456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.712461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.712465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.712469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.712474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.712483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.712496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.712503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.712510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.712519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.712525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.712530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.712541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.712546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.712552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.712557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.712568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.712574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.712580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.712589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.712595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.712605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.712611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.712619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.712625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.712633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.712639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.712644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.712650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.712660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.712666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.712710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:02.715234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:02.716083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:02.716099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:02.716101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:02.716105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:02.716112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1197 [2:7559601325391549506:7436]
2025-10-10T14:34:02.716124Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:02.716156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:02.716159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.716163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.716171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.716187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:02.716201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:02.716215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:02.716277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.716284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.716287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.716289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:02.716360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:02.716368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.716380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.716394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.716417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:02.716444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173772176:3383], now have 1 active actors on pipe
2025-10-10T14:34:02.716452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173771923:2438], now have 1 active actors on pipe
2025-10-10T14:34:02.716460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601325391549501:7436]
2025-10-10T14:34:02.716467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601325391549501:7436]
2025-10-10T14:34:02.716469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601325391549501:7436]
2025-10-10T14:34:02.716483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:02.716498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:02.716502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:02.716507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:02.716509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:02.716518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:02.716522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:02.716545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601325391549501:7436]
2025-10-10T14:34:02.716552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:02.716542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1197
2025-10-10T14:34:02.716567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:02.716543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1197
2025-10-10T14:34:02.716584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.716590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.716631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:02.716644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.716653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.716655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:02.716666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.716681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:02.716701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.716888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.716896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.716911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.717047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1198 partition: 0 MaxSeqNo: 40 sessionId: src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0
2025-10-10T14:34:02.717505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3c0b0c-956245e0-4e50b2f8-a5c5eb02_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:02.720155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0] Write session: try to update token
2025-10-10T14:34:02.720172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:02.735224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId: src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:02.736102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:02.736124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:02.736128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:02.736130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:02.736142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601325391549501:7436]
2025-10-10T14:34:02.736146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601325391549501:7436]
2025-10-10T14:34:02.736149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601325391549501:7436]
2025-10-10T14:34:02.736194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:02.736199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:02.736207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.736211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:02.736212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:02.736217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:02.736395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:02.737985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:02.786476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601326173772230:4179]
2025-10-10T14:34:02.786725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1197, pipe: [1:7559601326173772230:4179]
2025-10-10T14:34:02.852419Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:02.852954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.852973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.853020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173772230:4179], now have 1 active actors on pipe
2025-10-10T14:34:02.853224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:02.853264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:02.853257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601326173772230:4179]
2025-10-10T14:34:02.853275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:02.853278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:02.853356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1198 reason: error at write: Disconnected sessionId: src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0
2025-10-10T14:34:02.853589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1198 sessionId: src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0 is DEAD
2025-10-10T14:34:02.853769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:02.853780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0] Write session will restart in 0.009935s
2025-10-10T14:34:02.853814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0] Write session: Do CDS request
2025-10-10T14:34:02.853820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:02.864917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.864979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:02.864998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1199
2025-10-10T14:34:02.865193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:02.865240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:02.865251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:02.865255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:02.865769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1199 sessionId:  describe result for acl check
2025-10-10T14:34:02.865811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:02.865818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:02.865821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:02.865829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601326173772316:3372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:02.866393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601326173772316:3372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:02.869300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601326173772316:3372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:02.872387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601326173772316:3372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:02.872403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601326173772316:3372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:02.872407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601326173772316:3372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:02.872416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:02.874323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:02.877254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:02.877570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:02.877582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:02.877594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:02.877650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:02.877694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601325391549824:7451]
2025-10-10T14:34:02.878303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:02.878659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:02.878730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:02.879152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:02.879261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.879273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.879275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.879276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.879278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.879279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.879280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.879282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.879283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.879284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.879285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.879286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.879287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.879295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.879312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.879317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.879322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.879327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.879332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.879335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.879338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.879342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.879347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.879351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.879355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.879360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.879372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.879383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:02.879392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.879399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:02.879406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.879412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:02.879417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.879423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:02.879428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.879433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:02.879437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.879442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:02.879447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.879452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:02.879457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.879462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:02.879467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.879473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:02.879477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.879482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:02.879487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.879493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.879499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.879519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.879526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.879532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.879577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:02.882212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:02.882675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:02.882698Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:02.882702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:02.882706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:02.882715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1198 [2:7559601325391549824:7451]
2025-10-10T14:34:02.882744Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:02.882768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:02.882776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.882780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.882782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.882800Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:02.882815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:02.882833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:02.882925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.882940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.882943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.882946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:02.883051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:02.883064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.883078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:02.883097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:02.883120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:02.883156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173772232:2438], now have 1 active actors on pipe
2025-10-10T14:34:02.883168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173772502:3372], now have 1 active actors on pipe
2025-10-10T14:34:02.883177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601325391549819:7451]
2025-10-10T14:34:02.883186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601325391549819:7451]
2025-10-10T14:34:02.883189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601325391549819:7451]
2025-10-10T14:34:02.883203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:02.883170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1198
2025-10-10T14:34:02.883201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1198
2025-10-10T14:34:02.883228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:02.883244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:02.883253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:02.883257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:02.883258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:02.883259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:02.883325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.883337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.883353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601325391549819:7451]
2025-10-10T14:34:02.883367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:02.883378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:02.883406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:02.883419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:02.883428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:02.883435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:02.883447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:02.883463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:02.883494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.883687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:02.883695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:02.883712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:02.883787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1199 partition: 0 MaxSeqNo: 40 sessionId: src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0
2025-10-10T14:34:02.884241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf0669d-3f75d8de-ff20b6ab-2b9e39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:02.887076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0] Write session: try to update token
2025-10-10T14:34:02.887095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:02.901441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId: src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:02.903338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:02.903358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:02.903361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:02.903363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:02.903374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601325391549819:7451]
2025-10-10T14:34:02.903379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601325391549819:7451]
2025-10-10T14:34:02.903384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601325391549819:7451]
2025-10-10T14:34:02.903432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:02.903434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:02.903442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:02.903445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:02.903450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:02.903454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:02.903622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:02.904142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:02.953404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601326173772516:4179]
2025-10-10T14:34:02.953633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1198, pipe: [1:7559601326173772516:4179]
2025-10-10T14:34:03.017628Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:03.018050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.018070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.018121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601326173772516:4179], now have 1 active actors on pipe
2025-10-10T14:34:03.018376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:03.018387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601326173772516:4179]
2025-10-10T14:34:03.018396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:03.018401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:03.018420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:03.018479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1199 reason: error at write: Disconnected sessionId: src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0
2025-10-10T14:34:03.018702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1199 sessionId: src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0 is DEAD
2025-10-10T14:34:03.018908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:03.018919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0] Write session will restart in 0.005839s
2025-10-10T14:34:03.018944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0] Write session: Do CDS request
2025-10-10T14:34:03.018953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:03.025932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.026036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:03.026060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1200
2025-10-10T14:34:03.026214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.026249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:03.026257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:03.026261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:03.026727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1200 sessionId:  describe result for acl check
2025-10-10T14:34:03.026776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:03.026783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:03.026785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:03.026791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601330468739831:3368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:03.027341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601330468739831:3368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:03.031193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601330468739831:3368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:03.034991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601330468739831:3368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:03.035008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601330468739831:3368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:03.035012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601330468739831:3368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:03.035022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:03.040283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:03.043415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:03.043668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:03.043679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:03.043692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:03.043749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:03.043796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601329686517401:7453]
2025-10-10T14:34:03.044440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:03.044820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:03.044885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:03.045227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:03.045276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.045281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.045282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.045283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.045284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.045285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.045285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.045286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.045287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.045288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.045289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.045290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.045290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.045295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.045305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.045307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.045309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.045312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.045314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.045316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.045318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.045321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.045325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.045327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.045348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.045353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.045362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.045369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.045375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.045378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.045381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.045385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.045388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.045391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.045394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.045399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.045404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.045409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.045413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.045420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.045424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.045430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.045435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.045440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.045447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.045450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.045455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.045460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.045465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.045469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.045476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.045482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.045522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:03.048115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:03.048627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:03.048639Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:03.048641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:03.048645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:03.048653Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1199 [2:7559601329686517401:7453]
2025-10-10T14:34:03.048668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:03.048694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:03.048701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.048715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.048717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.048738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:03.048751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:03.048759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:03.048822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.048829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.048831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.048835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:03.048904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:03.048912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.048934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.048945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.048960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:03.048986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468739987:3368], now have 1 active actors on pipe
2025-10-10T14:34:03.048991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468739814:2438], now have 1 active actors on pipe
2025-10-10T14:34:03.049000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601329686517396:7453]
2025-10-10T14:34:03.049003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601329686517396:7453]
2025-10-10T14:34:03.049006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601329686517396:7453]
2025-10-10T14:34:03.049019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:03.049033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:03.049035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:03.049037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:03.049039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:03.049052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:03.049056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:03.049089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601329686517396:7453]
2025-10-10T14:34:03.049073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1199
2025-10-10T14:34:03.049079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1199
2025-10-10T14:34:03.049099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:03.049108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:03.049133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.049143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.049187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:03.049199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.049203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.049206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:03.049219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.049234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:03.049255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.049430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.049439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.049455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.049537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1200 partition: 0 MaxSeqNo: 40 sessionId: src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0
2025-10-10T14:34:03.049984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edbd027-56fdc764-3a7c6267-d6037dcd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:03.052852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0] Write session: try to update token
2025-10-10T14:34:03.052873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:03.067587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId: src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:03.069739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:03.069762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.069766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:03.069768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:03.069778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601329686517396:7453]
2025-10-10T14:34:03.069786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601329686517396:7453]
2025-10-10T14:34:03.069791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601329686517396:7453]
2025-10-10T14:34:03.069839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:03.069843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:03.069850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:03.069854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:03.069856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.069859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:03.070015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:03.070408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:03.118798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601330468740098:4179]
2025-10-10T14:34:03.119074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1199, pipe: [1:7559601330468740098:4179]
2025-10-10T14:34:03.186654Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:03.186956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.186974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.187024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740098:4179], now have 1 active actors on pipe
2025-10-10T14:34:03.187252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:03.187230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:03.187260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601330468740098:4179]
2025-10-10T14:34:03.187287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:03.187290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:03.187369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1200 reason: error at write: Disconnected sessionId: src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0
2025-10-10T14:34:03.187606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1200 sessionId: src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0 is DEAD
2025-10-10T14:34:03.187771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:03.187783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0] Write session will restart in 0.006152s
2025-10-10T14:34:03.187808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0] Write session: Do CDS request
2025-10-10T14:34:03.187816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:03.194899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.194941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:03.194959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1201
2025-10-10T14:34:03.195156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.195192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:03.195203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:03.195208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:03.195713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1201 sessionId:  describe result for acl check
2025-10-10T14:34:03.195756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:03.195763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:03.195765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:03.195772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601330468740116:3362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:03.196353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601330468740116:3362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:03.199382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601330468740116:3362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:03.203683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601330468740116:3362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:03.203701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601330468740116:3362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:03.203705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601330468740116:3362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:03.203714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:03.209096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:03.212266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:03.212544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:03.212564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:03.212580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:03.212659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:03.212714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601329686517683:7455]
2025-10-10T14:34:03.213381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:03.213705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:03.213755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:03.214240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:03.214334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.214342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.214343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.214344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.214345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.214347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.214348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.214349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.214351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.214352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.214353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.214354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.214355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.214362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.214374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.214378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.214381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.214384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.214388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.214392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.214397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.214401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.214406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.214411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.214415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.214418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.214427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.214435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.214442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.214447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.214452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.214457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.214461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.214466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.214470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.214475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.214478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.214483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.214487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.214491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.214495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.214500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.214504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.214508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.214512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.214517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.214531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.214536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.214541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.214546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.214550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.214555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.214595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:03.217086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:03.217423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:03.217435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:03.217438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:03.217442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:03.217448Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1200 [2:7559601329686517683:7455]
2025-10-10T14:34:03.217460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:03.217478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:03.217482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.217485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.217487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.217503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:03.217511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:03.217518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:03.217576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.217584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.217586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.217589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:03.217656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:03.217664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.217674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.217689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.217705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:03.217726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740276:3362], now have 1 active actors on pipe
2025-10-10T14:34:03.217734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740100:2438], now have 1 active actors on pipe
2025-10-10T14:34:03.217742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601329686517678:7455]
2025-10-10T14:34:03.217744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601329686517678:7455]
2025-10-10T14:34:03.217746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601329686517678:7455]
2025-10-10T14:34:03.217764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:03.217781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:03.217796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:03.217804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:03.217804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:03.217807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:03.217809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:03.217828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601329686517678:7455]
2025-10-10T14:34:03.217835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:03.217837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:03.217827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1200
2025-10-10T14:34:03.217884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.217832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1200
2025-10-10T14:34:03.217893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.217923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eedf9648-114eb5c6-91883f08-72018a40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:03.217937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.217940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.217943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:03.217954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.217964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:03.217984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.218156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.218165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.218181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.218295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1201 partition: 0 MaxSeqNo: 40 sessionId: src_id|eedf9648-114eb5c6-91883f08-72018a40_0
2025-10-10T14:34:03.218746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd5f6d7-8f09ddd7-56e332ae-967abc1f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eedf9648-114eb5c6-91883f08-72018a40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:03.221666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf9648-114eb5c6-91883f08-72018a40_0] Write session: try to update token
2025-10-10T14:34:03.221686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf9648-114eb5c6-91883f08-72018a40_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:03.235884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:03.235911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.235923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601329686517678:7455]
2025-10-10T14:34:03.235980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:03.235986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:03.236175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:03.236338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.236471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId: src_id|eedf9648-114eb5c6-91883f08-72018a40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:03.236498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.236661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.236897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:03.236964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:03.239462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:03.239718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.239740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.239783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:03.239871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:03.249707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:03.249731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.249735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:03.249737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:03.249748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601329686517678:7455]
2025-10-10T14:34:03.249752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601329686517678:7455]
2025-10-10T14:34:03.249756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601329686517678:7455]
2025-10-10T14:34:03.249810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:03.249810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:03.249817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:03.249819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.249821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:03.249821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:03.249965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:03.287268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601330468740386:4179]
2025-10-10T14:34:03.287598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1200, pipe: [1:7559601330468740386:4179]
2025-10-10T14:34:03.366752Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:03.375283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.375319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.375504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.375574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.375642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.375715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.375772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.375787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.375859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.375923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.376034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.376108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.376155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.376167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.376237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.376301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.376375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.376436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.376539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.376543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.376610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.376811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.376872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.376949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.377085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.377088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.377157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.377215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.377300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.377465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.377513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.377525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.377593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.377656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.377724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.377790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.377837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.377846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.377911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.377977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.378042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.378106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.378167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.378174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.378240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.378347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.378425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.378490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.378536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.378545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.378609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.378674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.378740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.378805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.378851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.378859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.378927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.378990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.379051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.379117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.379164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.379171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.379242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740386:4179], now have 1 active actors on pipe
2025-10-10T14:34:03.379525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:03.379586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:03.379590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:03.379625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1201 reason: error at write: Disconnected sessionId: src_id|eedf9648-114eb5c6-91883f08-72018a40_0
2025-10-10T14:34:03.379788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601330468740386:4179]
2025-10-10T14:34:03.379821Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:34:03.379870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1201 sessionId: src_id|eedf9648-114eb5c6-91883f08-72018a40_0 is DEAD
2025-10-10T14:34:03.380020Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 12 consumer shared/user session shared/user_1_12_2092695052603809663_v1 is DEAD
2025-10-10T14:34:03.380042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf9648-114eb5c6-91883f08-72018a40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:03.380054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf9648-114eb5c6-91883f08-72018a40_0] Write session will restart in 0.008450s
2025-10-10T14:34:03.380081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf9648-114eb5c6-91883f08-72018a40_0] Write session: Do CDS request
2025-10-10T14:34:03.380083Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:34:03.380087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf9648-114eb5c6-91883f08-72018a40_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:03.380220Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:34:03.380229Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:34:03.380197Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601257454271898:4184] disconnected; active server actors: 1
2025-10-10T14:34:03.380237Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009295s
2025-10-10T14:34:03.380209Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601257454271898:4184] client user disconnected session shared/user_1_12_2092695052603809663_v1
2025-10-10T14:34:03.380309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:03.389878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf9648-114eb5c6-91883f08-72018a40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.389968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:03.389983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1202
2025-10-10T14:34:03.390165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.390203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:03.390213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:03.390217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:03.390652Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:34:03.390712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1202 sessionId:  describe result for acl check
2025-10-10T14:34:03.390750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:03.390757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:03.390758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:03.390764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601330468740436:3351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:03.390808Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:34:03.390821Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 13
2025-10-10T14:34:03.390981Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 13 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:34:03.391042Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:34:03.391124Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 auth for : user
2025-10-10T14:34:03.391224Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 Handle describe topics response
2025-10-10T14:34:03.391249Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 auth is DEAD
2025-10-10T14:34:03.391290Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:34:03.391326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601330468740436:3351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:03.391604Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:34:03.391721Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_13_7903164544811225891_v1
2025-10-10T14:34:03.391845Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601330468740450:3354] connected; active server actors: 1
2025-10-10T14:34:03.391950Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601330468740450:3354] session shared/user_1_13_7903164544811225891_v1
2025-10-10T14:34:03.391975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:34:03.391992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:34:03.392004Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_13_7903164544811225891_v1" (Sender=[1:7559601330468740438:3354], Pipe=[1:7559601330468740450:3354], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:34:03.392013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:34:03.392028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:34:03.392043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_13_7903164544811225891_v1" (Sender=[1:7559601330468740438:3354], Pipe=[1:7559601330468740450:3354], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:34:03.392053Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_13_7903164544811225891_v1" sender [1:7559601330468740438:3354] lock partition 0 for ReadingSession "shared/user_1_13_7903164544811225891_v1" (Sender=[1:7559601330468740438:3354], Pipe=[1:7559601330468740450:3354], Partitions=[], ActiveFamilyCount=1) generation 1 step 13
2025-10-10T14:34:03.392063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:34:03.392077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000040s
2025-10-10T14:34:03.392295Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 13 Session: "shared/user_1_13_7903164544811225891_v1" ClientId: "user" PipeClient { RawX1: 7559601330468740450 RawX2: 4503603922341146 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:34:03.392338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:34:03.394557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601330468740436:3351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:03.398463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601330468740436:3351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:03.398493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601330468740436:3351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:03.398496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601330468740436:3351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:03.398505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:03.403042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:03.405976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:03.406228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:03.406244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:03.406259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:03.406328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:03.406376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601329686517967:7457]
2025-10-10T14:34:03.407003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:03.407410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:03.407469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:03.407809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:03.407877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.407884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.407886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.407887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.407888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.407890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.407891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.407893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.407894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.407895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.407897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.407898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.407899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.407906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.407920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.407924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.407928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.407933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.407937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.407941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.407945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.407949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.407954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.407957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.407961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.407965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.407974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.407983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.407996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.408002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.408008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.408019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.408024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.408030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.408035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.408040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.408047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.408052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.408061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.408067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.408072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.408082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.408087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.408097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.408102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.408111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.408121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.408130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.408134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.408139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.408147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.408152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.408196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:03.410834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:03.411153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:03.411170Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:03.411172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:03.411177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:03.411184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1201 [2:7559601329686517967:7457]
2025-10-10T14:34:03.411199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:03.411222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:03.411230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.411235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.411238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.411256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:03.411269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:03.411282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:03.411350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.411358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.411361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.411364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:03.411438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:03.411446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.411458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.411475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.411495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:03.411523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740468:3347], now have 1 active actors on pipe
2025-10-10T14:34:03.411532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740389:2438], now have 1 active actors on pipe
2025-10-10T14:34:03.411535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740618:3351], now have 1 active actors on pipe
2025-10-10T14:34:03.411544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601329686517962:7457]
2025-10-10T14:34:03.411546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601329686517962:7457]
2025-10-10T14:34:03.411548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601329686517962:7457]
2025-10-10T14:34:03.411562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:03.411575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:03.411578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:03.411580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:03.411582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:03.411597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:03.411601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:03.411628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601329686517962:7457]
2025-10-10T14:34:03.411590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1201, pipe: [1:7559601330468740468:3347]
2025-10-10T14:34:03.411640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:03.411604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1201
2025-10-10T14:34:03.411635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1201
2025-10-10T14:34:03.411675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:03.411676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.411682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.411697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_13_7903164544811225891_v1 on pipe: [1:7559601330468740468:3347]
2025-10-10T14:34:03.411728Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_13_7903164544811225891_v1:1 with generation 1201
2025-10-10T14:34:03.411729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.411731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.411744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.411751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.411753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:03.411771Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_13_7903164544811225891_v1
2025-10-10T14:34:03.411779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.411818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:03.411828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:34:03.411832Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:34:03.416404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:34:03.416437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:34:03.416447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.416454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.416456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:03.416482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.416498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:03.416510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:34:03.416528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:34:03.416548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.416673Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106843411 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:34:03.416709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:34:03.416745Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 sending to client partition status
2025-10-10T14:34:03.416749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.416770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.416812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.416935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1202 partition: 0 MaxSeqNo: 40 sessionId: src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0
2025-10-10T14:34:03.417264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eedf9648-114eb5c6-91883f08-72018a40_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:03.420008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0] Write session: try to update token
2025-10-10T14:34:03.420024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:03.431410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:03.431433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.431437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:03.431439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:03.431449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601329686517962:7457]
2025-10-10T14:34:03.431453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601329686517962:7457]
2025-10-10T14:34:03.431457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601329686517962:7457]
2025-10-10T14:34:03.431505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:03.431508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:03.431512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:03.431515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.431517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:03.431518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:03.431655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:03.433447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId: src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:03.436181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:03.550341Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:03.551017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.551036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.551274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_13_7903164544811225891_v1
2025-10-10T14:34:03.551295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:03.551333Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_13_7903164544811225891_v1
2025-10-10T14:34:03.551334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:03.551351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:03.551372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601330468740468:3347]
2025-10-10T14:34:03.551871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:03.551886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0] Write session will restart in 0.006402s
2025-10-10T14:34:03.551912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0] Write session: Do CDS request
2025-10-10T14:34:03.551920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:03.551403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:03.551415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1202 reason: error at write: Disconnected sessionId: src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0
2025-10-10T14:34:03.551705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1202 sessionId: src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0 is DEAD
2025-10-10T14:34:03.559901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.559999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:03.560015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1203
2025-10-10T14:34:03.560195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.560240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:03.560253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:03.560258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:03.560855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1203 sessionId:  describe result for acl check
2025-10-10T14:34:03.560909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:03.560918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:03.560921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:03.560928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601330468740724:3344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:03.561584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601330468740724:3344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:03.564583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601330468740724:3344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:03.568356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601330468740724:3344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:03.568372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601330468740724:3344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:03.568376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601330468740724:3344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:03.568385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:03.574230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:03.576817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:03.577064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:03.577076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:03.577089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:03.577153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:03.577196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601329686518265:7460]
2025-10-10T14:34:03.577821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:03.578112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:03.578170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:03.578506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:03.578580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.578586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.578587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.578589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.578590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.578591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.578592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.578593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.578594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.578596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.578597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.578598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.578599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.578605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.578618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.578622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.578625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.578629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.578633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.578636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.578640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.578644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.578648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.578652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.578656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.578659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.578668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.578678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.578684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.578690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.578695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.578700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.578710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.578715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.578723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.578728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.578732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.578737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.578742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.578748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.578752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.578757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.578764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.578774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.578778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.578785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.578795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.578800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.578804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.578815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.578820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.578825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.578866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:03.581362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:03.581709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:03.581724Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:03.581727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:03.581731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:03.581737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1202 [2:7559601329686518265:7460]
2025-10-10T14:34:03.581750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:03.581769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:03.581778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.581782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.581784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.581801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:03.581814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:03.581825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:03.581885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.581892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.581894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.581897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:03.581966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:03.581974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.581987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.581998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.582015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:03.582037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740696:2438], now have 1 active actors on pipe
2025-10-10T14:34:03.582045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740863:3344], now have 1 active actors on pipe
2025-10-10T14:34:03.582053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601329686518260:7460]
2025-10-10T14:34:03.582059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601329686518260:7460]
2025-10-10T14:34:03.582062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601329686518260:7460]
2025-10-10T14:34:03.582075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:03.582087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:03.582093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:03.582099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:03.582101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:03.582109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:03.582112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:03.582119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1202
2025-10-10T14:34:03.582136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1202
2025-10-10T14:34:03.582135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601329686518260:7460]
2025-10-10T14:34:03.582142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:03.582151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:03.582174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.582179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.582212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:03.582225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.582230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.582232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:03.582245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.582261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:03.582279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.582504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.582517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.582540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.582629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1203 partition: 0 MaxSeqNo: 40 sessionId: src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0
2025-10-10T14:34:03.583034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aab7ac-9b6ac9d5-f21516d5-235faee1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:03.585989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0] Write session: try to update token
2025-10-10T14:34:03.586009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:03.600819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:03.600842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.600855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601329686518260:7460]
2025-10-10T14:34:03.600911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:03.600914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:03.601085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:03.601227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.601363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId: src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:03.601378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.601511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.601729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:03.601770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:03.603866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:03.604096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.604114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.604153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:03.604581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:03.612482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:03.612501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.612505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:03.612507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:03.612519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601329686518260:7460]
2025-10-10T14:34:03.612523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601329686518260:7460]
2025-10-10T14:34:03.612527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601329686518260:7460]
2025-10-10T14:34:03.612574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:03.612574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:03.612580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:03.612584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:03.612586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.612589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:03.612721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:03.651816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601330468740990:3347]
2025-10-10T14:34:03.652694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1202, pipe: [1:7559601330468740990:3347]
2025-10-10T14:34:03.727340Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:03.736397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.736427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.736621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.736703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.736778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.736851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.736919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.736929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.737009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.737078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.737147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.737217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.737267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.737277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.737391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.737490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.737557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.737624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.737667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.737676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.737749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.737823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.737894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.737966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.738013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.738025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.738097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.738164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.738237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.738306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.738354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.738363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.738434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.738502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.738610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.738723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.738786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.738797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.738867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.738930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.739002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.739072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.739119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.739127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.739199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.739266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.739334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.739403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.739450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.739457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.739527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.739627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.739695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.739766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.739811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.739818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.739889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:03.739951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:03.740017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:03.740122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:03.740184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:03.740191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:03.740263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740990:3347], now have 1 active actors on pipe
2025-10-10T14:34:03.740518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601330468740990:3347]
2025-10-10T14:34:03.740528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:03.740562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:03.740565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:03.740598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1203 reason: error at write: Disconnected sessionId: src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0
2025-10-10T14:34:03.740836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1203 sessionId: src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0 is DEAD
2025-10-10T14:34:03.740997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:03.741009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0] Write session will restart in 0.005455s
2025-10-10T14:34:03.741035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0] Write session: Do CDS request
2025-10-10T14:34:03.741042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:03.741604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:03.747981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.748022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:03.748036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1204
2025-10-10T14:34:03.748218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.748249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:03.748257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:03.748261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:03.748738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1204 sessionId:  describe result for acl check
2025-10-10T14:34:03.748773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:03.748780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:03.748784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:03.748791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601330468741011:3335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:03.749390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601330468741011:3335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:03.752444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601330468741011:3335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:03.756465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601330468741011:3335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:03.756480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601330468741011:3335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:03.756484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601330468741011:3335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:03.756492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:03.762355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:03.765253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:03.765511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:03.765526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:03.765541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:03.765617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:03.765671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601329686518552:7463]
2025-10-10T14:34:03.766317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:03.766647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:03.766695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:03.767016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:03.767082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.767091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.767092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.767093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.767094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.767095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.767096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.767097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.767099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.767100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.767101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.767103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.767104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.767109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.767123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.767127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.767131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.767134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.767138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.767142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.767145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.767149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.767153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.767157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.767160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.767164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.767172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.767181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.767187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.767193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.767199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.767204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.767208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.767213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.767217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.767222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.767226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.767231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.767236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.767240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.767244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.767249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.767253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.767259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.767264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.767269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.767275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.767280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.767284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.767290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.767303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.767308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.767350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:03.769877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:03.770340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:03.770358Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:03.770361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:03.770365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:03.770371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1203 [2:7559601329686518552:7463]
2025-10-10T14:34:03.770384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:03.770400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:03.770403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.770406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.770409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.770424Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:03.770436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:03.770445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:03.770503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.770509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.770522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.770533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:03.770596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:03.770602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.770613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.770625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.770655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:03.770683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468740995:2438], now have 1 active actors on pipe
2025-10-10T14:34:03.770686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468741158:3335], now have 1 active actors on pipe
2025-10-10T14:34:03.770694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601329686518547:7463]
2025-10-10T14:34:03.770696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601329686518547:7463]
2025-10-10T14:34:03.770698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601329686518547:7463]
2025-10-10T14:34:03.770711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:03.770724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:03.770731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:03.770736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:03.770738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:03.770752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:03.770755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:03.770731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1203
2025-10-10T14:34:03.770749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1203
2025-10-10T14:34:03.770782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601329686518547:7463]
2025-10-10T14:34:03.770795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:03.770802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:03.770811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.770816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.770864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:03.770877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.770881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.770883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:03.770895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.770912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:03.770929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.771089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.771096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.771110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.771211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1204 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0
2025-10-10T14:34:03.771605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92785f2a-ae0b13c5-56953d5f-9114fad0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:03.774367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0] Write session: try to update token
2025-10-10T14:34:03.774386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:03.788915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId: src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:03.790724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:03.790754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.790757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:03.790759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:03.790769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601329686518547:7463]
2025-10-10T14:34:03.790774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601329686518547:7463]
2025-10-10T14:34:03.790778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601329686518547:7463]
2025-10-10T14:34:03.790828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:03.790836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.790839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:03.790838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:03.790844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:03.790849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:03.790981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:03.791666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:03.840706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601330468741308:3347]
2025-10-10T14:34:03.840974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1203, pipe: [1:7559601330468741308:3347]
2025-10-10T14:34:03.908234Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:03.908787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.908803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.908851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468741308:3347], now have 1 active actors on pipe
2025-10-10T14:34:03.909085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:03.909095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:03.909117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601330468741308:3347]
2025-10-10T14:34:03.909138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:03.909141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:03.909215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1204 reason: error at write: Disconnected sessionId: src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0
2025-10-10T14:34:03.909431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1204 sessionId: src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0 is DEAD
2025-10-10T14:34:03.909601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:03.909611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0] Write session will restart in 0.007009s
2025-10-10T14:34:03.909636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0] Write session: Do CDS request
2025-10-10T14:34:03.909645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:03.918110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.918384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:03.918399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1205
2025-10-10T14:34:03.918508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:03.918551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:03.918561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:03.918566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:03.919032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1205 sessionId:  describe result for acl check
2025-10-10T14:34:03.919073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:03.919082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:03.919085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:03.919091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601330468741337:3322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:03.919777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601330468741337:3322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:03.923422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601330468741337:3322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:03.927531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601330468741337:3322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:03.927549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601330468741337:3322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:03.927552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601330468741337:3322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:03.927563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:03.930908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:03.933708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:03.933964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:03.933977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:03.933991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:03.934061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:03.934112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601329686518876:7478]
2025-10-10T14:34:03.934753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:03.935090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:03.935163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:03.935502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:03.935591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.935598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.935599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.935600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.935602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.935603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.935604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.935606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.935607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.935608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.935609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.935610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.935611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.935619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.935633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.935637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.935641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.935644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.935648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.935652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.935656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.935659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.935664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.935667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.935671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.935675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.935685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.935694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:03.935702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.935708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:03.935713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.935718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:03.935729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.935735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:03.935745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.935751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:03.935759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.935765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:03.935771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.935781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:03.935785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.935798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:03.935809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.935814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:03.935818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.935823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:03.935827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.935832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.935836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.935841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.935845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.935850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.935890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:03.938411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:03.938982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:03.938996Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:03.938998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:03.939002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:03.939008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1204 [2:7559601329686518876:7478]
2025-10-10T14:34:03.939024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:03.939041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:03.939048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.939052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.939054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.939073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:03.939097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:03.939105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:03.939162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.939169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.939171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.939173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:03.939256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:03.939263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.939275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:03.939292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:03.939314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:03.939345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468741539:3322], now have 1 active actors on pipe
2025-10-10T14:34:03.939349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601330468741309:2438], now have 1 active actors on pipe
2025-10-10T14:34:03.939357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601329686518871:7478]
2025-10-10T14:34:03.939359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601329686518871:7478]
2025-10-10T14:34:03.939361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601329686518871:7478]
2025-10-10T14:34:03.939378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:03.939396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:03.939421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:03.939425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:03.939419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1204
2025-10-10T14:34:03.939451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601329686518871:7478]
2025-10-10T14:34:03.939430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1204
2025-10-10T14:34:03.939459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:03.939518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:03.939530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:03.939532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:03.939540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:03.939644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.939671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.939724Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:03.939737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:03.939747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:03.939750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:03.939763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:03.939780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:03.939812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.940023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.940032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.940051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:03.940224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1205 partition: 0 MaxSeqNo: 40 sessionId: src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0
2025-10-10T14:34:03.940674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa24b66b-4de22fdd-9deb9e2d-c213ebf6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:03.943607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0] Write session: try to update token
2025-10-10T14:34:03.943628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:03.951196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:03.951217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.951228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601329686518871:7478]
2025-10-10T14:34:03.951279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:03.951308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:03.951447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:03.951578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.951703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.951832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:03.952010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:03.952042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:03.958197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId: src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:03.960895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:03.961127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:03.961162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:03.961203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:03.961290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:03.970837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:03.970863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:03.970866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:03.970868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:03.970881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601329686518871:7478]
2025-10-10T14:34:03.970886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601329686518871:7478]
2025-10-10T14:34:03.970890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601329686518871:7478]
2025-10-10T14:34:03.970938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:03.970946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:03.970946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:03.970950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:03.970954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:03.970957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:03.971093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:04.009171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601334763708896:3347]
2025-10-10T14:34:04.009484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1204, pipe: [1:7559601334763708896:3347]
2025-10-10T14:34:04.087477Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:04.096540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.096571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.096765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.096833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.096916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.096988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.097035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.097046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.097126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.097197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.097274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.097363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.097413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.097421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.097493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.097562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.097635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.097700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.097754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.097761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.097837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.097909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.097972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.098048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.098098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.098106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.098175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.098240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.098307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.098378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.098430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.098437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.098508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.098570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.098656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.098729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.098779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.098787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.098876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.098940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.099013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.099080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.099134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.099138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.099207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.099267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.099330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.099393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.099443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.099449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.099520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.099584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.099699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.099806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.099860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.099867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.099935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.099994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.100063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.100129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.100176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.100183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.100248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763708896:3347], now have 1 active actors on pipe
2025-10-10T14:34:04.100661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:04.100677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:04.100682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:04.100711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1205 reason: error at write: Disconnected sessionId: src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0
2025-10-10T14:34:04.100737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601334763708896:3347]
2025-10-10T14:34:04.100995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1205 sessionId: src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0 is DEAD
2025-10-10T14:34:04.101163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:04.101173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0] Write session will restart in 0.008928s
2025-10-10T14:34:04.101200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0] Write session: Do CDS request
2025-10-10T14:34:04.101207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:04.101517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:04.111979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.112052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:04.112068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1206
2025-10-10T14:34:04.112313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.112364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:04.112377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:04.112382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:04.112848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1206 sessionId:  describe result for acl check
2025-10-10T14:34:04.112896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:04.112898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:04.112901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:04.112907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601334763708957:3318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:04.113783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601334763708957:3318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:04.117756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601334763708957:3318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:04.121443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601334763708957:3318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:04.121461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601334763708957:3318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:04.121465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601334763708957:3318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:04.121475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:04.124588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:04.127756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:04.127985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:04.127996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:04.128010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:04.128067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:04.128110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601333981486460:7480]
2025-10-10T14:34:04.128767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:04.129114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:04.129176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:04.129538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:04.129611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.129618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.129619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.129620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.129622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.129624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.129625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.129627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.129628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.129629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.129630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.129632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.129633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.129640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.129654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.129658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.129663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.129667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.129670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.129674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.129679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.129683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.129688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.129692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.129696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.129700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.129709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.129718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.129725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.129731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.129736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.129741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.129745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.129751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.129762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.129767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.129777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.129782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.129792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.129797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.129802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.129807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.129812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.129817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.129822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.129827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.129836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.129841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.129845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.129850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.129855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.129860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.129901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:04.132368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:04.132945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:04.132961Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:04.132963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:04.132968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:04.132974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1205 [2:7559601333981486460:7480]
2025-10-10T14:34:04.132988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:04.133010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:04.133013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.133016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.133018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.133038Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:04.133052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:04.133063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:04.133129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.133136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.133138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.133141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:04.133213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:04.133222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.133235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.133247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.133265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:04.133296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763708898:2438], now have 1 active actors on pipe
2025-10-10T14:34:04.133304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709155:3318], now have 1 active actors on pipe
2025-10-10T14:34:04.133312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601333981486455:7480]
2025-10-10T14:34:04.133315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601333981486455:7480]
2025-10-10T14:34:04.133317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601333981486455:7480]
2025-10-10T14:34:04.133350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:04.133368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:04.133386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:04.133386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:04.133391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:04.133393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:04.133396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:04.133380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1205
2025-10-10T14:34:04.133410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1205
2025-10-10T14:34:04.133428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601333981486455:7480]
2025-10-10T14:34:04.133439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:04.133441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:04.133471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.133482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.133523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:04.133538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.133543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.133546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:04.133558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.133575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:04.133596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.133772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.133782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.133802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.133910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1206 partition: 0 MaxSeqNo: 40 sessionId: src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0
2025-10-10T14:34:04.134354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae54ec63-5a679b23-4caff91-f9651e5a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:04.137064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0] Write session: try to update token
2025-10-10T14:34:04.137082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:04.151312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId: src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:04.153952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:04.153975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:04.153979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:04.153981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:04.153991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601333981486455:7480]
2025-10-10T14:34:04.153996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601333981486455:7480]
2025-10-10T14:34:04.154000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601333981486455:7480]
2025-10-10T14:34:04.154055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:04.154062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:04.154068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.154070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:04.154071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:04.154075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:04.154257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:04.154212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:04.201171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601334763709189:3347]
2025-10-10T14:34:04.201507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1205, pipe: [1:7559601334763709189:3347]
2025-10-10T14:34:04.271275Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:04.271827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.271844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.271883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709189:3347], now have 1 active actors on pipe
2025-10-10T14:34:04.272139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:04.272166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601334763709189:3347]
2025-10-10T14:34:04.272169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:04.272197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:04.272269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0
2025-10-10T14:34:04.272488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1206 sessionId: src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0 is DEAD
2025-10-10T14:34:04.272667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:04.272682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0] Write session will restart in 0.008492s
2025-10-10T14:34:04.272715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0] Write session: Do CDS request
2025-10-10T14:34:04.272722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:04.282784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.282959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:04.282977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1207
2025-10-10T14:34:04.283114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.283149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:04.283159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:04.283163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:04.283585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1207 sessionId:  describe result for acl check
2025-10-10T14:34:04.283628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:04.283634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:04.283636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:04.283643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601334763709266:3312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:04.284159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601334763709266:3312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:04.286802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601334763709266:3312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:04.290389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601334763709266:3312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:04.290405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601334763709266:3312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:04.290409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601334763709266:3312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:04.290417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:04.291915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:04.294599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:04.294843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:04.294858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:04.294871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:04.294928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:04.294977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601333981486748:7482]
2025-10-10T14:34:04.295618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:04.295942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:04.295990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:04.296310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:04.296370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.296376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.296377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.296378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.296379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.296381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.296382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.296383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.296384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.296386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.296387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.296388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.296390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.296396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.296410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.296414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.296418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.296422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.296427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.296431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.296435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.296439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.296444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.296448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.296452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.296455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.296464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.296472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.296479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.296485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.296489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.296495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.296500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.296505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.296511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.296517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.296522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.296527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.296532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.296542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.296546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.296557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.296562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.296567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.296571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.296576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.296581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.296585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.296589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.296594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.296599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.296603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.296648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:04.299154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:04.299885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:04.299901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:04.299903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:04.299907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:04.299913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1206 [2:7559601333981486748:7482]
2025-10-10T14:34:04.299927Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:04.299945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:04.299953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.299957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.299959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.299978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:04.299990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:04.300002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:04.300064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.300072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.300074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.300077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:04.300144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:04.300153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.300164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.300179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.300200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:04.300228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709190:2438], now have 1 active actors on pipe
2025-10-10T14:34:04.300237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709468:3312], now have 1 active actors on pipe
2025-10-10T14:34:04.300245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601333981486743:7482]
2025-10-10T14:34:04.300247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601333981486743:7482]
2025-10-10T14:34:04.300250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601333981486743:7482]
2025-10-10T14:34:04.300262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:04.300272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:04.300275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:04.300277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:04.300282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:04.300298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:04.300306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:04.300305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1206
2025-10-10T14:34:04.300333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601333981486743:7482]
2025-10-10T14:34:04.300341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:04.300342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:04.300359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.300315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1206
2025-10-10T14:34:04.300364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.300416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:04.300430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.300437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.300440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:04.300452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.300467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:04.300491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.300679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.300694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.300720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.300858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1207 partition: 0 MaxSeqNo: 40 sessionId: src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0
2025-10-10T14:34:04.301296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d1b3e5-7cf064f8-1962bc57-35d1304_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:04.303879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0] Write session: try to update token
2025-10-10T14:34:04.303898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:04.319877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId: src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:04.320651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:04.320671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:04.320674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:04.320676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:04.320686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601333981486743:7482]
2025-10-10T14:34:04.320691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601333981486743:7482]
2025-10-10T14:34:04.320694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601333981486743:7482]
2025-10-10T14:34:04.320743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:04.320747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:04.320755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.320757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:04.320758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:04.320763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:04.320921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:04.322655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:04.372191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601334763709483:3347]
2025-10-10T14:34:04.372525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1206, pipe: [1:7559601334763709483:3347]
2025-10-10T14:34:04.435646Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:04.436166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.436182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.436231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709483:3347], now have 1 active actors on pipe
2025-10-10T14:34:04.436490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:04.436503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601334763709483:3347]
2025-10-10T14:34:04.436529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:04.436610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1207 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0
2025-10-10T14:34:04.436839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1207 sessionId: src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0 is DEAD
2025-10-10T14:34:04.437031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:04.437041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0] Write session will restart in 0.007044s
2025-10-10T14:34:04.437059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0] Write session: Do CDS request
2025-10-10T14:34:04.437064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:04.436444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:04.444934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.445017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:04.445037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1208
2025-10-10T14:34:04.445184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.445233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:04.445243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:04.445248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:04.445706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1208 sessionId:  describe result for acl check
2025-10-10T14:34:04.445745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:04.445751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:04.445753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:04.445759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601334763709509:3305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:04.446329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601334763709509:3305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:04.449471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601334763709509:3305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:04.452747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601334763709509:3305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:04.452765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601334763709509:3305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:04.452770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601334763709509:3305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:04.452778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:04.459062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:04.462148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:04.462364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:04.462380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:04.462392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:04.462445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:04.462491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601333981487049:7484]
2025-10-10T14:34:04.463177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:04.463503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:04.463543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:04.463887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:04.463942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.463949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.463950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.463951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.463953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.463954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.463955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.463957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.463958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.463960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.463961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.463963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.463964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.463971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.463984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.463989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.463994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.463999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.464003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.464008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.464012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.464016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.464021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.464025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.464030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.464034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.464042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.464051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.464063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.464069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.464074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.464080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.464084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.464090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.464096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.464107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.464112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.464123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.464128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.464134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.464154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.464161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.464166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.464172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.464177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.464183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.464187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.464193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.464198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.464204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.464208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.464214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.464260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:04.467246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:04.467664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:04.467678Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:04.467681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:04.467685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:04.467692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1207 [2:7559601333981487049:7484]
2025-10-10T14:34:04.467706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:04.468075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1207
2025-10-10T14:34:04.468081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1207
2025-10-10T14:34:04.467724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:04.467736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.467740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.467743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.467759Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:04.467767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:04.467776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:04.467835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.467837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.467839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.467842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:04.467922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:04.467925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.467938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.467951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.467970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:04.467993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709484:2438], now have 1 active actors on pipe
2025-10-10T14:34:04.467997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709639:3305], now have 1 active actors on pipe
2025-10-10T14:34:04.468006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601333981487044:7484]
2025-10-10T14:34:04.468008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601333981487044:7484]
2025-10-10T14:34:04.468011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601333981487044:7484]
2025-10-10T14:34:04.468025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:04.468040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:04.468056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:04.468060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:04.468086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601333981487044:7484]
2025-10-10T14:34:04.468089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:04.468101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:04.468104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:04.468107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:04.468113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:04.468241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.468247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.468282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b31d8187-50bfe70-d1994e44-eea00d70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:04.468289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.468293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.468295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:04.468305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.468318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:04.468335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.468511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.468522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.468537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.468625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1208 partition: 0 MaxSeqNo: 40 sessionId: src_id|b31d8187-50bfe70-d1994e44-eea00d70_0
2025-10-10T14:34:04.469054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d85e9-653e7959-f261c4e4-60bfa6a6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b31d8187-50bfe70-d1994e44-eea00d70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:04.471748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d8187-50bfe70-d1994e44-eea00d70_0] Write session: try to update token
2025-10-10T14:34:04.471766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d8187-50bfe70-d1994e44-eea00d70_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:04.486236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId: src_id|b31d8187-50bfe70-d1994e44-eea00d70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:04.488093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:04.488118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:04.488121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:04.488123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:04.488132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601333981487044:7484]
2025-10-10T14:34:04.488137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601333981487044:7484]
2025-10-10T14:34:04.488141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601333981487044:7484]
2025-10-10T14:34:04.488188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:04.488196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:04.488199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:04.488209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.488212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:04.488213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:04.488499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:04.488958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:04.536534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601334763709791:3347]
2025-10-10T14:34:04.536902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1207, pipe: [1:7559601334763709791:3347]
2025-10-10T14:34:04.605889Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:04.606529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.606549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.606594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709791:3347], now have 1 active actors on pipe
2025-10-10T14:34:04.606882Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:04.606966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:04.606982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601334763709791:3347]
2025-10-10T14:34:04.607008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:04.607096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1208 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b31d8187-50bfe70-d1994e44-eea00d70_0
2025-10-10T14:34:04.607300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1208 sessionId: src_id|b31d8187-50bfe70-d1994e44-eea00d70_0 is DEAD
2025-10-10T14:34:04.607514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d8187-50bfe70-d1994e44-eea00d70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:04.607527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d8187-50bfe70-d1994e44-eea00d70_0] Write session will restart in 0.006665s
2025-10-10T14:34:04.607552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d8187-50bfe70-d1994e44-eea00d70_0] Write session: Do CDS request
2025-10-10T14:34:04.607560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d8187-50bfe70-d1994e44-eea00d70_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:04.615943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d8187-50bfe70-d1994e44-eea00d70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.616114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:04.616130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1209
2025-10-10T14:34:04.616264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.616299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:04.616309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:04.616314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:04.616944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1209 sessionId:  describe result for acl check
2025-10-10T14:34:04.616986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:04.616988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:04.616990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:04.616996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601334763709838:3289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:04.617597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601334763709838:3289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:04.620641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601334763709838:3289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:04.624827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601334763709838:3289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:04.624844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601334763709838:3289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:04.624848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601334763709838:3289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:04.624857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:04.629050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:04.631850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:04.632117Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:04.632134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:04.632150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:04.632246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:04.632297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601333981487340:7487]
2025-10-10T14:34:04.633078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:04.633453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:04.633506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:04.633847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:04.633904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.633910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.633912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.633913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.633914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.633916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.633917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.633919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.633920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.633921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.633923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.633924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.633925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.633932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.633946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.633950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.633955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.633959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.633963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.633967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.633972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.633976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.633980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.633983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.633987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.633990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.633998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.634007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.634014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.634019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.634024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.634029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.634033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.634038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.634043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.634048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.634052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.634065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.634070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.634077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.634088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.634093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.634097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.634103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.634107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.634112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.634117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.634127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.634131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.634137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.634141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.634150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.634192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:04.636770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:04.637189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:04.637205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:04.637207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:04.637211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:04.637219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1208 [2:7559601333981487340:7487]
2025-10-10T14:34:04.637234Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:04.637254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:04.637258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.637261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.637264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.637283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:04.637292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:04.637306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:04.637398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.637411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.637415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.637417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:04.637506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:04.637516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.637529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.637546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.637562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:04.637586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763710020:3289], now have 1 active actors on pipe
2025-10-10T14:34:04.637595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763709802:2438], now have 1 active actors on pipe
2025-10-10T14:34:04.637603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601333981487335:7487]
2025-10-10T14:34:04.637610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601333981487335:7487]
2025-10-10T14:34:04.637613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601333981487335:7487]
2025-10-10T14:34:04.637629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:04.637644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1208
2025-10-10T14:34:04.637651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:04.637649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1208
2025-10-10T14:34:04.637674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:04.637679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:04.637688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:04.637692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:04.637694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:04.637714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601333981487335:7487]
2025-10-10T14:34:04.637718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:04.637720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:04.637750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.637765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.637822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:04.637836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.637847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.637850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:04.637865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.637879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:04.637921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.638083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.638093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.638109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.638217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1209 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0
2025-10-10T14:34:04.638645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31d8187-50bfe70-d1994e44-eea00d70_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:04.641847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0] Write session: try to update token
2025-10-10T14:34:04.641870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:04.656263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId: src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:04.657930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:04.657953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:04.657957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:04.657959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:04.657968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601333981487335:7487]
2025-10-10T14:34:04.657972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601333981487335:7487]
2025-10-10T14:34:04.657976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601333981487335:7487]
2025-10-10T14:34:04.658027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:04.658040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.658042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:04.658051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:04.658069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:04.658074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:04.658185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:04.659108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:04.707029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601334763710100:3347]
2025-10-10T14:34:04.707394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1208, pipe: [1:7559601334763710100:3347]
2025-10-10T14:34:04.774093Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:04.774665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.774682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.774725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763710100:3347], now have 1 active actors on pipe
2025-10-10T14:34:04.774939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:04.774978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601334763710100:3347]
2025-10-10T14:34:04.775003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:04.775019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:04.775081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1209 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0
2025-10-10T14:34:04.775301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1209 sessionId: src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0 is DEAD
2025-10-10T14:34:04.775495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:04.775506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0] Write session will restart in 0.009491s
2025-10-10T14:34:04.775527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0] Write session: Do CDS request
2025-10-10T14:34:04.775533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:04.785823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.785885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:04.785902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1210
2025-10-10T14:34:04.786087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.786125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:04.786134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:04.786138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:04.786746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1210 sessionId:  describe result for acl check
2025-10-10T14:34:04.786799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:04.786806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:04.786808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:04.786815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601334763710161:3285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:04.787395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601334763710161:3285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:04.790509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601334763710161:3285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:04.794104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601334763710161:3285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:04.794119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601334763710161:3285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:04.794123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601334763710161:3285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:04.794132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:04.797300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:04.799942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:04.800170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:04.800185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:04.800200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:04.800273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:04.800323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601333981487633:7490]
2025-10-10T14:34:04.800942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:04.801269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:04.801344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:04.801698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:04.801798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.801805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.801807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.801808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.801809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.801810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.801811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.801813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.801814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.801816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.801817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.801818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.801819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.801825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.801839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.801843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.801847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.801852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.801856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.801860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.801864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.801868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.801873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.801877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.801881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.801885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.801894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.801906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.801919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.801930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.801935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.801944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.801949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.801954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.801964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.801970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.801979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.801986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.801995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.802000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.802005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.802014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.802019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.802024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.802033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.802038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.802045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.802056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.802061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.802072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.802076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.802086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.802128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:04.804427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:04.804797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:04.804813Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:04.804815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:04.804819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:04.804825Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1209 [2:7559601333981487633:7490]
2025-10-10T14:34:04.804837Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:04.804869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:04.804878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.804882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.804884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.804902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:04.804915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:04.804924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:04.804986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.804994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.804996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.804999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:04.805202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:04.805214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.805195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1209
2025-10-10T14:34:04.805226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.805215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1209
2025-10-10T14:34:04.805237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.805257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:04.805280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763710101:2438], now have 1 active actors on pipe
2025-10-10T14:34:04.805289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763710337:3285], now have 1 active actors on pipe
2025-10-10T14:34:04.805307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.805316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.805351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601333981487628:7490]
2025-10-10T14:34:04.805358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601333981487628:7490]
2025-10-10T14:34:04.805360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601333981487628:7490]
2025-10-10T14:34:04.805373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:04.805389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:04.805393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:04.805399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:04.805401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:04.805410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:04.805414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:04.805434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|886496d3-19afc125-595f4786-fa63f96d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:04.805447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.805452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.805455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:04.805467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.805484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:04.805513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601333981487628:7490]
2025-10-10T14:34:04.805524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:04.805529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:04.805536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.805670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.805677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.805690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.805775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1210 partition: 0 MaxSeqNo: 40 sessionId: src_id|886496d3-19afc125-595f4786-fa63f96d_0
2025-10-10T14:34:04.806155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4465ca8-63cb3d1e-467cf7a8-65d9fb57_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|886496d3-19afc125-595f4786-fa63f96d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:04.808913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|886496d3-19afc125-595f4786-fa63f96d_0] Write session: try to update token
2025-10-10T14:34:04.808932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|886496d3-19afc125-595f4786-fa63f96d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:04.822202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:04.822220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:04.822230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601333981487628:7490]
2025-10-10T14:34:04.822276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:04.822282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:04.822458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:04.822496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId: src_id|886496d3-19afc125-595f4786-fa63f96d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:04.822617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:04.822810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:04.823009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:04.823286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:04.823343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:04.825486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:04.825697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.825711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.825740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:04.825819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:04.834448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:04.834472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:04.834475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:04.834477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:04.834488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601333981487628:7490]
2025-10-10T14:34:04.834492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601333981487628:7490]
2025-10-10T14:34:04.834496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601333981487628:7490]
2025-10-10T14:34:04.834540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:04.834552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:04.834554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.834556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:04.834557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:04.834565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:04.834699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:04.874959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601334763710410:3347]
2025-10-10T14:34:04.875241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1209, pipe: [1:7559601334763710410:3347]
2025-10-10T14:34:04.950158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:04.959063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.959095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.959281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.959361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.959435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.959505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.959561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.959573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.959648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.959714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.959787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.959854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.959968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.959975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.960044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.960108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.960171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.960241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.960285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.960293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.960365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.960430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.960496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.960563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.960609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.960616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.960685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.960750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.960817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.960892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.960937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.960944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.961015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.961080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.961144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.961211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.961262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.961269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.961353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.961418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.961484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.961552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.961600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.961607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.961674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.961741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.961808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.961876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.961919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.961926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.961995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.962055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.962121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.962192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.962238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.962245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.962310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:04.962369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:04.962430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:04.962491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:04.962540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:04.962548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:04.962605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763710410:3347], now have 1 active actors on pipe
2025-10-10T14:34:04.962792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:04.962809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:04.962842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1210 reason: error at write: Disconnected sessionId: src_id|886496d3-19afc125-595f4786-fa63f96d_0
2025-10-10T14:34:04.962848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:04.962916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601334763710410:3347]
2025-10-10T14:34:04.963100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1210 sessionId: src_id|886496d3-19afc125-595f4786-fa63f96d_0 is DEAD
2025-10-10T14:34:04.963269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886496d3-19afc125-595f4786-fa63f96d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:04.963280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886496d3-19afc125-595f4786-fa63f96d_0] Write session will restart in 0.005887s
2025-10-10T14:34:04.963317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886496d3-19afc125-595f4786-fa63f96d_0] Write session: Do CDS request
2025-10-10T14:34:04.963323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886496d3-19afc125-595f4786-fa63f96d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:04.963668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:04.970898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|886496d3-19afc125-595f4786-fa63f96d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.970996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:04.971013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1211
2025-10-10T14:34:04.971173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:04.971212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:04.971218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:04.971221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:04.971691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1211 sessionId:  describe result for acl check
2025-10-10T14:34:04.971732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:04.971734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:04.971736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:04.971743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601334763710441:3274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:04.972348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601334763710441:3274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:04.975730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601334763710441:3274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:04.979265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601334763710441:3274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:04.979281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601334763710441:3274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:04.979285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601334763710441:3274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:04.979293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:04.985008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:04.987828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:04.988018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:04.988029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:04.988039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:04.988092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:04.988127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601333981487963:7505]
2025-10-10T14:34:04.988559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:04.988875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:04.988908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:04.989273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:04.989326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.989347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.989349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.989350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.989351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.989352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.989354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.989354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.989355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.989356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.989356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.989357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.989358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.989362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.989371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.989373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.989375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.989377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.989380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.989382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.989384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.989386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.989390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.989392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.989394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.989396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.989403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.989409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:04.989413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.989418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:04.989423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.989428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:04.989432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.989436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:04.989440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.989445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:04.989449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.989453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:04.989458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.989463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:04.989467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.989471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:04.989476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.989481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:04.989486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.989491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:04.989495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.989500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.989504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.989509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.989514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.989518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.989549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:04.991855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:04.992185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:04.992196Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:04.992198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:04.992202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:04.992208Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1210 [2:7559601333981487963:7505]
2025-10-10T14:34:04.992219Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:04.992240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:04.992247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.992250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.992252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.992265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:04.992274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:04.992280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:04.992332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.992339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.992342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.992345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:04.992404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:04.992411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:04.992418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:04.992424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:04.992435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:04.992451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763710426:2438], now have 1 active actors on pipe
2025-10-10T14:34:04.992454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601334763710594:3274], now have 1 active actors on pipe
2025-10-10T14:34:04.992460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601333981487958:7505]
2025-10-10T14:34:04.992462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601333981487958:7505]
2025-10-10T14:34:04.992464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601333981487958:7505]
2025-10-10T14:34:04.992474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:04.992485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:04.992492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:04.992495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:04.992496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:04.992499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:04.992501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:04.992516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601333981487958:7505]
2025-10-10T14:34:04.992525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:04.992541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:04.992545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1210
2025-10-10T14:34:04.992572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1210
2025-10-10T14:34:04.992634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.992642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.992666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:04.992682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:04.992685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:04.992687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:04.992696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:04.992710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:04.992725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.997398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:04.997413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:04.997450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:04.997610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1211 partition: 0 MaxSeqNo: 40 sessionId: src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0
2025-10-10T14:34:04.998044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|886496d3-19afc125-595f4786-fa63f96d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:05.000728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0] Write session: try to update token
2025-10-10T14:34:05.000743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:05.012005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:05.012030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:05.012034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:05.012036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:05.012046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601333981487958:7505]
2025-10-10T14:34:05.012052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601333981487958:7505]
2025-10-10T14:34:05.012059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601333981487958:7505]
2025-10-10T14:34:05.012107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:05.012113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:05.012113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:05.012116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:05.012121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.012124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:05.012307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:05.015719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId: src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:05.018473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:05.062935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601339058678014:3347]
2025-10-10T14:34:05.063271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1210, pipe: [1:7559601339058678014:3347]
2025-10-10T14:34:05.124107Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:05.124780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.124796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.124839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678014:3347], now have 1 active actors on pipe
2025-10-10T14:34:05.125040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:05.125092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:05.125095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:05.125120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601339058678014:3347]
2025-10-10T14:34:05.125156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1211 reason: error at write: Disconnected sessionId: src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0
2025-10-10T14:34:05.125419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1211 sessionId: src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0 is DEAD
2025-10-10T14:34:05.125557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:05.125567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0] Write session will restart in 0.009496s
2025-10-10T14:34:05.125592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0] Write session: Do CDS request
2025-10-10T14:34:05.125600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:05.125725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:05.136003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.136113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:05.136129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1212
2025-10-10T14:34:05.136256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.136303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:05.136314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:05.136318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:05.136898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1212 sessionId:  describe result for acl check
2025-10-10T14:34:05.136945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:05.136947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:05.136951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:05.136957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601339058678075:3264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:05.137556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601339058678075:3264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:05.140198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601339058678075:3264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:05.143900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601339058678075:3264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:05.143915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601339058678075:3264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:05.143919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601339058678075:3264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:05.143928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:05.147042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:05.149646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:05.149822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:05.149831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:05.149841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:05.149880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:05.149911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601338276455552:7507]
2025-10-10T14:34:05.150310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:05.150584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:05.150618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:05.150870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:05.150915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.150921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.150922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.150922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.150923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.150924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.150925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.150926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.150926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.150927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.150927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.150928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.150929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.150932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.150941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.150944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.150946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.150948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.150950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.150952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.150954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.150956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.150959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.150961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.150963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.150965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.150972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.150977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.150981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.150985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.150988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.150991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.150993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.150996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.150999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.151002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.151005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.151008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.151011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.151014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.151016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.151020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.151024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.151029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.151033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.151039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.151042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.151047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.151051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.151056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.151060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.151065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.151090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:05.153368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:05.153641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:05.153649Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:05.153650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:05.153653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:05.153659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1211 [2:7559601338276455552:7507]
2025-10-10T14:34:05.153669Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:05.153683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:05.153688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.153691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.153692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.153705Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:05.153715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:05.153721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:05.153769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.153773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.153775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.153777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:05.153836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:05.153842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.153849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.153856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.153871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:05.153898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678016:2438], now have 1 active actors on pipe
2025-10-10T14:34:05.153902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678266:3264], now have 1 active actors on pipe
2025-10-10T14:34:05.153909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601338276455547:7507]
2025-10-10T14:34:05.153911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601338276455547:7507]
2025-10-10T14:34:05.153913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601338276455547:7507]
2025-10-10T14:34:05.153929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:05.153952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:05.153953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:05.153958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:05.153959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:05.153974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:05.153977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:05.154001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601338276455547:7507]
2025-10-10T14:34:05.154012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:05.154019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:05.154625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1211
2025-10-10T14:34:05.154634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1211
2025-10-10T14:34:05.154732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.154743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.154766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46bef731-4f691f86-4bdefb22-ce324c73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:05.154775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.154779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.154783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:05.154791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.154801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:05.154816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.154959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.154972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.154995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.155091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1212 partition: 0 MaxSeqNo: 40 sessionId: src_id|46bef731-4f691f86-4bdefb22-ce324c73_0
2025-10-10T14:34:05.155497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275e6a92-7a75531d-9f34fbec-ddd5fd51_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|46bef731-4f691f86-4bdefb22-ce324c73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:05.158115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46bef731-4f691f86-4bdefb22-ce324c73_0] Write session: try to update token
2025-10-10T14:34:05.158133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46bef731-4f691f86-4bdefb22-ce324c73_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:05.165558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:05.165577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:05.165588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601338276455547:7507]
2025-10-10T14:34:05.165630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:05.165638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:05.165847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:05.165990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:05.166135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:05.166280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:05.166476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:05.166518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:05.171165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId: src_id|46bef731-4f691f86-4bdefb22-ce324c73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:05.173988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:05.174163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.174186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.174227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:05.174341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:05.183465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:05.183489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:05.183492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:05.183495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:05.183505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601338276455547:7507]
2025-10-10T14:34:05.183509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601338276455547:7507]
2025-10-10T14:34:05.183513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601338276455547:7507]
2025-10-10T14:34:05.183561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:05.183561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:05.183569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:05.183573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:05.183574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.183577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:05.183701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:05.225145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601339058678313:3347]
2025-10-10T14:34:05.225424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1211, pipe: [1:7559601339058678313:3347]
2025-10-10T14:34:05.307484Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:05.316188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.316220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.316404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.316470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.316534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.316600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.316651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.316658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.316730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.316790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.316867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.316935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.316979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.316987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.317056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.317120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.317182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.317247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.317290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.317295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.317381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.317445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.317509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.317573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.317617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.317624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.317694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.317759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.317824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.317888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.317933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.317940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.318006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.318065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.318128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.318193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.318238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.318247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.318314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.318373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.318440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.318504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.318550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.318557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.318622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.318682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.318743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.318806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.318849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.318857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.318954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.319014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.319076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.319138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.319183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.319193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.319259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:05.319316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:05.319378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:05.319440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:05.319484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:05.319494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:05.319561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678313:3347], now have 1 active actors on pipe
2025-10-10T14:34:05.319834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:05.319860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601339058678313:3347]
2025-10-10T14:34:05.319861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:05.319884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:05.319895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1212 reason: error at write: Disconnected sessionId: src_id|46bef731-4f691f86-4bdefb22-ce324c73_0
2025-10-10T14:34:05.320124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1212 sessionId: src_id|46bef731-4f691f86-4bdefb22-ce324c73_0 is DEAD
2025-10-10T14:34:05.320339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46bef731-4f691f86-4bdefb22-ce324c73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:05.320350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46bef731-4f691f86-4bdefb22-ce324c73_0] Write session will restart in 0.006119s
2025-10-10T14:34:05.320376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46bef731-4f691f86-4bdefb22-ce324c73_0] Write session: Do CDS request
2025-10-10T14:34:05.320382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46bef731-4f691f86-4bdefb22-ce324c73_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:05.321050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:05.327934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46bef731-4f691f86-4bdefb22-ce324c73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.328021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:05.328041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1213
2025-10-10T14:34:05.328227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.328267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:05.328286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:05.328296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:05.328865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1213 sessionId:  describe result for acl check
2025-10-10T14:34:05.328901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:05.328907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:05.328909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:05.328916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601339058678340:3251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:05.329856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601339058678340:3251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:05.333319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601339058678340:3251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:05.336657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601339058678340:3251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:05.336677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601339058678340:3251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:05.336682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601339058678340:3251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:05.336691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:05.342506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:05.345622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:05.345865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:05.345877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:05.345889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:05.345949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:05.345994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601338276455847:7509]
2025-10-10T14:34:05.346673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:05.347022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:05.347086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:05.347460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:05.347521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.347528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.347529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.347530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.347532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.347533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.347534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.347536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.347538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.347539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.347541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.347542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.347543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.347551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.347564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.347569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.347573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.347577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.347581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.347586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.347590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.347594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.347599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.347603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.347607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.347611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.347619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.347628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.347635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.347640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.347645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.347650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.347655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.347660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.347666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.347671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.347676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.347682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.347687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.347692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.347697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.347702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.347707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.347712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.347717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.347730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.347735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.347740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.347749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.347755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.347760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.347769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.347813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:05.350342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:05.351235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:05.351248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:05.351251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:05.351255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:05.351272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1212 [2:7559601338276455847:7509]
2025-10-10T14:34:05.351284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:05.351303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:05.351312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.351315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.351318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.351335Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:05.351348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:05.351360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:05.351417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.351424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.351426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.351429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:05.351494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:05.351502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.351514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.351527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.351549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:05.351576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678500:3251], now have 1 active actors on pipe
2025-10-10T14:34:05.351584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678316:2438], now have 1 active actors on pipe
2025-10-10T14:34:05.351592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601338276455842:7509]
2025-10-10T14:34:05.351601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601338276455842:7509]
2025-10-10T14:34:05.351603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601338276455842:7509]
2025-10-10T14:34:05.351619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:05.351636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:05.351602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1212
2025-10-10T14:34:05.351640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:05.351645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:05.351650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:05.351643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1212
2025-10-10T14:34:05.351658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:05.351662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:05.351698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601338276455842:7509]
2025-10-10T14:34:05.351709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:05.351724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:05.351725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.351730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.351776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:05.351788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.351791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.351794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:05.351805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.351815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:05.351839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.352006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.352021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.352046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.352143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1213 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0
2025-10-10T14:34:05.352541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46bef731-4f691f86-4bdefb22-ce324c73_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:05.355306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0] Write session: try to update token
2025-10-10T14:34:05.355323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:05.369408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId: src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:05.371982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:05.372002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:05.372005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:05.372008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:05.372017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601338276455842:7509]
2025-10-10T14:34:05.372023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601338276455842:7509]
2025-10-10T14:34:05.372027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601338276455842:7509]
2025-10-10T14:34:05.372078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:05.372079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:05.372085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:05.372089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:05.372090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.372093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:05.372226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:05.372211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:05.420254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601339058678613:3347]
2025-10-10T14:34:05.420602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1212, pipe: [1:7559601339058678613:3347]
2025-10-10T14:34:05.482642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:05.482914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.482931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.482979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678613:3347], now have 1 active actors on pipe
2025-10-10T14:34:05.483206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:05.483198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601339058678613:3347]
2025-10-10T14:34:05.483236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:05.483238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:05.483241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:05.483297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1213 reason: error at write: Disconnected sessionId: src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0
2025-10-10T14:34:05.483539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1213 sessionId: src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0 is DEAD
2025-10-10T14:34:05.483754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:05.483764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0] Write session will restart in 0.006358s
2025-10-10T14:34:05.483788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0] Write session: Do CDS request
2025-10-10T14:34:05.483797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:05.491911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.491989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:05.492006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1214
2025-10-10T14:34:05.492170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.492207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:05.492218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:05.492222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:05.492737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1214 sessionId:  describe result for acl check
2025-10-10T14:34:05.492777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:05.492779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:05.492781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:05.492788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601339058678676:3260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:05.493380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601339058678676:3260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:05.495941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601339058678676:3260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:05.499750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601339058678676:3260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:05.499766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601339058678676:3260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:05.499770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601339058678676:3260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:05.499779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:05.503095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:05.505692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:05.505893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:05.505904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:05.505916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:05.505973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:05.506013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601338276456153:7512]
2025-10-10T14:34:05.506644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:05.506935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:05.506993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:05.507285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:05.507337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.507345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.507347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.507348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.507349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.507350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.507351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.507352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.507354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.507355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.507357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.507358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.507359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.507364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.507378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.507382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.507386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.507390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.507395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.507399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.507403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.507407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.507412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.507416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.507420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.507424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.507432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.507441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.507447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.507454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.507458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.507463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.507468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.507473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.507478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.507483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.507487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.507492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.507496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.507502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.507506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.507520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.507525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.507530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.507534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.507544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.507549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.507554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.507562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.507568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.507572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.507578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.507623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:05.509944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:05.510240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:05.510251Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:05.510253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:05.510256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:05.510261Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1213 [2:7559601338276456153:7512]
2025-10-10T14:34:05.510270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:05.510283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:05.510289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.510291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.510293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.510305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:05.510315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:05.510321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:05.510366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.510371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.510372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.510374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:05.510431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:05.510439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.510450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.510460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.510470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:05.510491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601338276456148:7512]
2025-10-10T14:34:05.510498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601338276456148:7512]
2025-10-10T14:34:05.510500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601338276456148:7512]
2025-10-10T14:34:05.510509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:05.510518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:05.510523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:05.510531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:05.510533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:05.510535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:05.510542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:05.510546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678859:3260], now have 1 active actors on pipe
2025-10-10T14:34:05.510549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678627:2438], now have 1 active actors on pipe
2025-10-10T14:34:05.510571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601338276456148:7512]
2025-10-10T14:34:05.510585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:05.510599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:05.510600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1213
2025-10-10T14:34:05.510604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1213
2025-10-10T14:34:05.510705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.510717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.510748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:05.510761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.510768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.510770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:05.510778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.510787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:05.510798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.510918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.510924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.510935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.511011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1214 partition: 0 MaxSeqNo: 40 sessionId: src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0
2025-10-10T14:34:05.511449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c6cff4-26fae3ce-6f69e493-16d07dc5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:05.514165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0] Write session: try to update token
2025-10-10T14:34:05.514185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:05.528704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId: src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:05.530387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:05.530405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:05.530407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:05.530409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:05.530416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601338276456148:7512]
2025-10-10T14:34:05.530420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601338276456148:7512]
2025-10-10T14:34:05.530424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601338276456148:7512]
2025-10-10T14:34:05.530466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:05.530477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.530479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:05.530484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:05.530503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:05.530507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:05.530637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:05.531532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:05.583588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601339058678925:3347]
2025-10-10T14:34:05.583929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1213, pipe: [1:7559601339058678925:3347]
2025-10-10T14:34:05.587762Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:34:05.643039Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:05.643886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.643903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.643957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678925:3347], now have 1 active actors on pipe
2025-10-10T14:34:05.644184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:05.644231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:05.644254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601339058678925:3347]
2025-10-10T14:34:05.644283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:05.644365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1214 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0
2025-10-10T14:34:05.644598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1214 sessionId: src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0 is DEAD
2025-10-10T14:34:05.644762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:05.644773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0] Write session will restart in 0.007661s
2025-10-10T14:34:05.644800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0] Write session: Do CDS request
2025-10-10T14:34:05.644808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:05.653937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.654014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:05.654034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1215
2025-10-10T14:34:05.654172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.654208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:05.654221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:05.654225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:05.654925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1215 sessionId:  describe result for acl check
2025-10-10T14:34:05.654962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:05.654970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:05.654972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:05.654978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601339058678980:3249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:05.655612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601339058678980:3249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:05.658347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601339058678980:3249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:05.661887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601339058678980:3249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:05.661905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601339058678980:3249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:05.661909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601339058678980:3249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:05.661918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:05.664455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:05.667090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:05.667298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:05.667310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:05.667324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:05.667383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:05.667432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601338276456449:7514]
2025-10-10T14:34:05.668070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:05.668370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:05.668419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:05.668743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:05.668813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.668820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.668833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.668835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.668836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.668837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.668839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.668840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.668841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.668842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.668844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.668845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.668846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.668852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.668866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.668870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.668874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.668878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.668883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.668887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.668891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.668895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.668900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.668903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.668907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.668912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.668920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.668932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.668939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.668950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.668955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.668960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.668965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.668970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.668978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.668983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.668988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.668993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.669001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.669006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.669012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.669017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.669024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.669030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.669034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.669041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.669046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.669053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.669058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.669064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.669075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.669080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.669123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:05.671615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:05.671944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:05.671958Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:05.671961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:05.671966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:05.671972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1214 [2:7559601338276456449:7514]
2025-10-10T14:34:05.671985Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:05.672003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:05.672013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.672017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.672019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.672036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:05.672044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:05.672051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:05.672111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.672119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.672121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.672124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:05.672196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:05.672204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.672216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.672228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.672250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:05.672276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058678934:2438], now have 1 active actors on pipe
2025-10-10T14:34:05.672285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058679188:3249], now have 1 active actors on pipe
2025-10-10T14:34:05.672292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601338276456444:7514]
2025-10-10T14:34:05.672295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601338276456444:7514]
2025-10-10T14:34:05.672298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601338276456444:7514]
2025-10-10T14:34:05.672312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:05.672300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1214
2025-10-10T14:34:05.672326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:05.672322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1214
2025-10-10T14:34:05.672331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:05.672337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:05.672339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:05.672350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:05.672353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:05.672392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.672402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.672419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601338276456444:7514]
2025-10-10T14:34:05.672434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:05.672470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|238da0a6-952a707d-5336eb18-cc02efd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:05.672473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:05.672483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.672488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.672491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:05.672502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.672519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:05.672550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.672724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.672733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.672749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.672870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1215 partition: 0 MaxSeqNo: 40 sessionId: src_id|238da0a6-952a707d-5336eb18-cc02efd0_0
2025-10-10T14:34:05.673397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d96b57-c4b056ba-ff5de2fd-6f2a6dff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|238da0a6-952a707d-5336eb18-cc02efd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:05.676044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238da0a6-952a707d-5336eb18-cc02efd0_0] Write session: try to update token
2025-10-10T14:34:05.676063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238da0a6-952a707d-5336eb18-cc02efd0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:05.690286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId: src_id|238da0a6-952a707d-5336eb18-cc02efd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:05.691558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:05.691579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:05.691582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:05.691584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:05.691594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601338276456444:7514]
2025-10-10T14:34:05.691598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601338276456444:7514]
2025-10-10T14:34:05.691603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601338276456444:7514]
2025-10-10T14:34:05.691655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:05.691661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:05.691669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:05.691671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.691673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:05.691674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:05.691818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:05.692963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:05.744361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601339058679236:3347]
2025-10-10T14:34:05.744670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1214, pipe: [1:7559601339058679236:3347]
2025-10-10T14:34:05.804602Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:05.805214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.805234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.805281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058679236:3347], now have 1 active actors on pipe
2025-10-10T14:34:05.805482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:05.805529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601339058679236:3347]
2025-10-10T14:34:05.805541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:05.805564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:05.805663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1215 reason: status is not ok: tablet will be restarted right now sessionId: src_id|238da0a6-952a707d-5336eb18-cc02efd0_0
2025-10-10T14:34:05.805900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1215 sessionId: src_id|238da0a6-952a707d-5336eb18-cc02efd0_0 is DEAD
2025-10-10T14:34:05.806042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238da0a6-952a707d-5336eb18-cc02efd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:05.806057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238da0a6-952a707d-5336eb18-cc02efd0_0] Write session will restart in 0.006210s
2025-10-10T14:34:05.806081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238da0a6-952a707d-5336eb18-cc02efd0_0] Write session: Do CDS request
2025-10-10T14:34:05.806087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238da0a6-952a707d-5336eb18-cc02efd0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:05.813939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238da0a6-952a707d-5336eb18-cc02efd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.814003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:05.814038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1216
2025-10-10T14:34:05.814197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.814236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:05.814248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:05.814252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:05.814728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1216 sessionId:  describe result for acl check
2025-10-10T14:34:05.814766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:05.814773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:05.814775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:05.814783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601339058679262:3245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:05.815408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601339058679262:3245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:05.819022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601339058679262:3245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:05.823075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601339058679262:3245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:05.823093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601339058679262:3245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:05.823097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601339058679262:3245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:05.823106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:05.828779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:05.831688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:05.831957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:05.831974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:05.831989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:05.832063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:05.832114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601338276456748:7517]
2025-10-10T14:34:05.832736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:05.833150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:05.833243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:05.833747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:05.833860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.833873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.833875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.833876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.833878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.833879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.833881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.833882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.833884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.833886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.833887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.833888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.833889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.833898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.833914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.833919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.833924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.833928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.833933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.833937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.833940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.833945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.833951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.833955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.833959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.833963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.833976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.833988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.833996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.834004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.834020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.834035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.834047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.834062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.834076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.834089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.834100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.834105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.834112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.834126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.834137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.834150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.834163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.834181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.834187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.834193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.834198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.834204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.834212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.834218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.834224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.834229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.834276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:05.837170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:05.838540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:05.838556Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:05.838559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:05.838564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:05.838572Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1215 [2:7559601338276456748:7517]
2025-10-10T14:34:05.838589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:05.838617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:05.838621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.838627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.838634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.838654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:05.838663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:05.838678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:05.838758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.838765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.838767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.838770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:05.838853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:05.838861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.838876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.838892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.838914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:05.838944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058679416:3245], now have 1 active actors on pipe
2025-10-10T14:34:05.838953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058679238:2438], now have 1 active actors on pipe
2025-10-10T14:34:05.838961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601338276456743:7517]
2025-10-10T14:34:05.838963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601338276456743:7517]
2025-10-10T14:34:05.838968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601338276456743:7517]
2025-10-10T14:34:05.838982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:05.838999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:05.839005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:05.839010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:05.839012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:05.839020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:05.839023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:05.838994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1215
2025-10-10T14:34:05.839013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1215
2025-10-10T14:34:05.839065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601338276456743:7517]
2025-10-10T14:34:05.839074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:05.839076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:05.839096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.839106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.839160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:05.839179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:05.839185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:05.839188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:05.839202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:05.839215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:05.839238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.839576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.839588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.839608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:05.839703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1216 partition: 0 MaxSeqNo: 40 sessionId: src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0
2025-10-10T14:34:05.840181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238da0a6-952a707d-5336eb18-cc02efd0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:05.842879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0] Write session: try to update token
2025-10-10T14:34:05.842901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:05.856101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId: src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:05.858606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:05.859136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:05.859161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:05.859186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:05.859190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:05.859193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:05.859195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:05.859204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601338276456743:7517]
2025-10-10T14:34:05.859208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601338276456743:7517]
2025-10-10T14:34:05.859212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601338276456743:7517]
2025-10-10T14:34:05.859267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:05.859273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:05.859281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.859284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:05.859285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:05.859288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:05.859426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:05.905612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601339058679551:3347]
2025-10-10T14:34:05.905923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1215, pipe: [1:7559601339058679551:3347]
2025-10-10T14:34:05.973208Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:05.973708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:05.973777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058679551:3347], now have 1 active actors on pipe
2025-10-10T14:34:05.973861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:05.973937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:05.973967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:05.973980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:05.973996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601339058679551:3347]
2025-10-10T14:34:05.974058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1216 reason: error at write: Disconnected sessionId: src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0
2025-10-10T14:34:05.974228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1216 sessionId: src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0 is DEAD
2025-10-10T14:34:05.974418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:05.974428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0] Write session will restart in 0.009379s
2025-10-10T14:34:05.974454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0] Write session: Do CDS request
2025-10-10T14:34:05.974460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:05.984961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.985004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:05.985022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1217
2025-10-10T14:34:05.985195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:05.985229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:05.985239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:05.985243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:05.985723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1217 sessionId:  describe result for acl check
2025-10-10T14:34:05.985765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:05.985774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:05.985777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:05.985783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601339058679654:3230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:05.986354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601339058679654:3230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:05.989284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601339058679654:3230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:05.992174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601339058679654:3230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:05.992191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601339058679654:3230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:05.992194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601339058679654:3230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:05.992204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:05.994078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:05.996872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:05.997074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:05.997091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:05.997104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:05.997155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:05.997199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601338276457084:7532]
2025-10-10T14:34:05.997883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:05.998200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:05.998249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:05.998593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:05.998651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.998658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.998659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.998660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.998662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.998663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.998665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.998666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.998667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.998669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.998670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.998671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.998673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.998679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.998694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.998699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.998704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.998708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.998712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.998716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.998720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.998725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.998730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.998735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.998739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.998743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.998751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.998761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:05.998768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.998774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:05.998779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.998784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:05.998794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.998800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:05.998810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.998816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:05.998826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.998831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:05.998842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.998847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:05.998852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.998858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:05.998863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.998873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:05.998877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.998888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:05.998893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.998898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:05.998908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.998914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:05.998924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.998929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:05.998978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:06.001542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:06.001984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:06.001998Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:06.002001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:06.002005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:06.002011Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1216 [2:7559601338276457084:7532]
2025-10-10T14:34:06.002023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:06.002040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:06.002043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.002048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.002050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.002066Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:06.002080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:06.002089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:06.002150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.002157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.002159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.002162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:06.002235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:06.002243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.002256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.002270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.002293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:06.002319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058679567:2438], now have 1 active actors on pipe
2025-10-10T14:34:06.002328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601339058679850:3230], now have 1 active actors on pipe
2025-10-10T14:34:06.002336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601338276457079:7532]
2025-10-10T14:34:06.002338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601338276457079:7532]
2025-10-10T14:34:06.002341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601338276457079:7532]
2025-10-10T14:34:06.002354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:06.002373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:06.002373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:06.002376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:06.002378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:06.002394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:06.002397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:06.002383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1216
2025-10-10T14:34:06.002425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601338276457079:7532]
2025-10-10T14:34:06.002393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1216
2025-10-10T14:34:06.002433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:06.002435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:06.002456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.002466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.002515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:06.002528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.002532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.002534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:06.002547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.002557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:06.002572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.002788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.002809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.002843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.002986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1217 partition: 0 MaxSeqNo: 40 sessionId: src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0
2025-10-10T14:34:06.003398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a77400-1bb0b6a2-e96e0e37-b62ac37c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:06.005916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0] Write session: try to update token
2025-10-10T14:34:06.005932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:06.021529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId: src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:06.022525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:06.022544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:06.022547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:06.022550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:06.022560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601338276457079:7532]
2025-10-10T14:34:06.022564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601338276457079:7532]
2025-10-10T14:34:06.022568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601338276457079:7532]
2025-10-10T14:34:06.022615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:06.022618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:06.022626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.022629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:06.022633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:06.022637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:06.022784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:06.024100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:06.074070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601343353647161:3347]
2025-10-10T14:34:06.074401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1216, pipe: [1:7559601343353647161:3347]
2025-10-10T14:34:06.147263Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:06.147792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.147809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.147854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647161:3347], now have 1 active actors on pipe
2025-10-10T14:34:06.148063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:06.148085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:06.148099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:06.148101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:06.148157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601343353647161:3347]
2025-10-10T14:34:06.148163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1217 reason: error at write: Disconnected sessionId: src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0
2025-10-10T14:34:06.148367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1217 sessionId: src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0 is DEAD
2025-10-10T14:34:06.148542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:06.148554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0] Write session will restart in 0.006447s
2025-10-10T14:34:06.148579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0] Write session: Do CDS request
2025-10-10T14:34:06.148585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:06.155873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.155940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:06.155955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1218
2025-10-10T14:34:06.156104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.156148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:06.156159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:06.156163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:06.156648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1218 sessionId:  describe result for acl check
2025-10-10T14:34:06.156679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:06.156681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:06.156682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:06.156688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601343353647188:3211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:06.157263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601343353647188:3211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:06.160919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601343353647188:3211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:06.164984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601343353647188:3211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:06.165011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601343353647188:3211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:06.165015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601343353647188:3211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:06.165026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:06.173013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:06.173622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:06.173830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:06.173846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:06.173859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:06.173911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:06.173957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601342571424679:7534]
2025-10-10T14:34:06.174642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:06.174981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:06.175041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:06.175375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:06.175470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.175478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.175480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.175481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.175482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.175484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.175485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.175486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.175487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.175489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.175490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.175491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.175493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.175499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.175513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.175518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.175523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.175528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.175531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.175535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.175540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.175544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.175548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.175552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.175556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.175559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.175568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.175583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.175594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.175605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.175614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.175620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.175625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.175634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.175645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.175656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.175661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.175667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.175678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.175683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.175688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.175693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.175698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.175704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.175708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.175713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.175719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.175724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.175728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.175734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.175738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.175743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.175792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:06.178124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:06.178593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:06.178609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:06.178612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:06.178616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:06.178623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1217 [2:7559601342571424679:7534]
2025-10-10T14:34:06.178638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:06.178663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:06.178667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.178670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.178673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.178690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:06.178703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:06.178714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:06.178775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.178782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.178785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.178788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:06.178859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:06.178866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.178879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.178896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.178920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:06.178943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647164:2438], now have 1 active actors on pipe
2025-10-10T14:34:06.178957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647363:3211], now have 1 active actors on pipe
2025-10-10T14:34:06.178966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601342571424674:7534]
2025-10-10T14:34:06.178970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601342571424674:7534]
2025-10-10T14:34:06.178972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601342571424674:7534]
2025-10-10T14:34:06.178986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:06.179002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:06.179005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:06.179008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:06.179010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:06.179019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:06.179023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:06.179008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1217
2025-10-10T14:34:06.179008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1217
2025-10-10T14:34:06.179046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601342571424674:7534]
2025-10-10T14:34:06.179055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:06.179068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:06.179084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.179091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.179128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:06.179141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.179150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.179153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:06.179170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.179185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:06.179212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.179389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.179401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.179420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.179532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1218 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0
2025-10-10T14:34:06.179917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f126efbd-2c80e3b2-cc7be1f9-a0294812_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:06.182724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0] Write session: try to update token
2025-10-10T14:34:06.182742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:06.196836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId: src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:06.198350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:06.198378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:06.198381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:06.198383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:06.198392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601342571424674:7534]
2025-10-10T14:34:06.198397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601342571424674:7534]
2025-10-10T14:34:06.198401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601342571424674:7534]
2025-10-10T14:34:06.198454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:06.198463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:06.198467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.198470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:06.198470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:06.198475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:06.198677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:06.199728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:06.248111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601343353647466:3347]
2025-10-10T14:34:06.248407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1217, pipe: [1:7559601343353647466:3347]
2025-10-10T14:34:06.318632Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:06.319321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.319344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.319393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647466:3347], now have 1 active actors on pipe
2025-10-10T14:34:06.319625Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:06.319662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601343353647466:3347]
2025-10-10T14:34:06.319682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:06.319686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:06.319694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:06.319756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1218 reason: error at write: Disconnected sessionId: src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0
2025-10-10T14:34:06.319974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1218 sessionId: src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0 is DEAD
2025-10-10T14:34:06.320177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:06.320188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0] Write session will restart in 0.007774s
2025-10-10T14:34:06.320215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0] Write session: Do CDS request
2025-10-10T14:34:06.320224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:06.328947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.329016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:06.329047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1219
2025-10-10T14:34:06.329210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.329255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:06.329266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:06.329270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:06.329819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1219 sessionId:  describe result for acl check
2025-10-10T14:34:06.329860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:06.329867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:06.329869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:06.329875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601343353647504:3213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:06.330453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601343353647504:3213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:06.334043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601343353647504:3213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:06.337932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601343353647504:3213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:06.337946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601343353647504:3213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:06.337963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601343353647504:3213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:06.337972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:06.342742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:06.345745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:06.345930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:06.345939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:06.345948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:06.345988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:06.346020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601342571424980:7536]
2025-10-10T14:34:06.346439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:06.346739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:06.346778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:06.347015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:06.347056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.347063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.347063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.347064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.347065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.347067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.347067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.347068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.347069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.347070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.347070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.347071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.347072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.347076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.347084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.347087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.347089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.347091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.347094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.347096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.347098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.347101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.347103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.347105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.347107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.347109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.347115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.347120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.347125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.347128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.347131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.347135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.347137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.347140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.347143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.347147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.347150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.347153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.347156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.347159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.347162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.347165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.347168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.347171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.347173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.347178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.347182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.347185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.347188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.347191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.347194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.347197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.347221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:06.349673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:06.350181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:06.350195Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:06.350197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:06.350200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:06.350207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1218 [2:7559601342571424980:7536]
2025-10-10T14:34:06.350221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:06.350237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:06.350240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.350244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.350246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.350277Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:06.350290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:06.350298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:06.350358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.350365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.350367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.350370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:06.350435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:06.350443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.350454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.350469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.350491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:06.350519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647677:3213], now have 1 active actors on pipe
2025-10-10T14:34:06.350528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647471:2438], now have 1 active actors on pipe
2025-10-10T14:34:06.350535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601342571424975:7536]
2025-10-10T14:34:06.350541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601342571424975:7536]
2025-10-10T14:34:06.350543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601342571424975:7536]
2025-10-10T14:34:06.350566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:06.350549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1218
2025-10-10T14:34:06.350554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1218
2025-10-10T14:34:06.350581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:06.350590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:06.350594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:06.350596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:06.350603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:06.350607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:06.350646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.350655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.350669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601342571424975:7536]
2025-10-10T14:34:06.350680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:06.350705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:06.350710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:06.350719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.350723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.350726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:06.350738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.350749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:06.350771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.350937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.350962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.350991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.351115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1219 partition: 0 MaxSeqNo: 40 sessionId: src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0
2025-10-10T14:34:06.351557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c88ac26-5c48f396-408de5b1-6dd8812b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:06.354273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0] Write session: try to update token
2025-10-10T14:34:06.354291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:06.368065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId: src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:06.370663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:06.370679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:06.370681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:06.370682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:06.370690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601342571424975:7536]
2025-10-10T14:34:06.370693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601342571424975:7536]
2025-10-10T14:34:06.370697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601342571424975:7536]
2025-10-10T14:34:06.370748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:06.370755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:06.370760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.370762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:06.370763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:06.370767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:06.370778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:06.370891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:06.419675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601343353647775:3347]
2025-10-10T14:34:06.419945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1218, pipe: [1:7559601343353647775:3347]
2025-10-10T14:34:06.485265Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:06.485792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.485812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.485861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647775:3347], now have 1 active actors on pipe
2025-10-10T14:34:06.486080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:06.486102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:06.486108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601343353647775:3347]
2025-10-10T14:34:06.486138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:06.486141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:06.486206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1219 reason: error at write: Disconnected sessionId: src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0
2025-10-10T14:34:06.486466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1219 sessionId: src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0 is DEAD
2025-10-10T14:34:06.486640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:06.486651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0] Write session will restart in 0.008544s
2025-10-10T14:34:06.486677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0] Write session: Do CDS request
2025-10-10T14:34:06.486687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:06.497000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.497083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:06.497100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1220
2025-10-10T14:34:06.497248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.497288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:06.497310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:06.497315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:06.497807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1220 sessionId:  describe result for acl check
2025-10-10T14:34:06.497852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:06.497858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:06.497860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:06.497867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601343353647843:3210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:06.498465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601343353647843:3210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:06.501626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601343353647843:3210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:06.505120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601343353647843:3210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:06.505139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601343353647843:3210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:06.505143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601343353647843:3210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:06.505153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:06.511040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:06.513658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:06.513894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:06.513909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:06.513925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:06.513995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:06.514039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601342571425293:7539]
2025-10-10T14:34:06.514701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:06.515017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:06.515080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:06.515425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:06.515484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.515490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.515491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.515492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.515493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.515494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.515496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.515497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.515498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.515500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.515501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.515503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.515504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.515511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.515525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.515530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.515534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.515538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.515542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.515547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.515551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.515555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.515560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.515564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.515567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.515571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.515580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.515589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.515595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.515601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.515606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.515612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.515616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.515620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.515625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.515630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.515634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.515639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.515644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.515649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.515654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.515660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.515665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.515670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.515675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.515681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.515685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.515691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.515695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.515701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.515705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.515710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.515751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:06.518350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:06.518658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:06.518672Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:06.518675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:06.518679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:06.518686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1219 [2:7559601342571425293:7539]
2025-10-10T14:34:06.518702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:06.518719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:06.518728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.518731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.518734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.518753Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:06.518761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:06.518774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:06.518832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.518842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.518844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.518847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:06.518917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:06.518927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.518939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.518953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.518972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:06.519002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647971:3210], now have 1 active actors on pipe
2025-10-10T14:34:06.519006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353647789:2438], now have 1 active actors on pipe
2025-10-10T14:34:06.519014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601342571425288:7539]
2025-10-10T14:34:06.519017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601342571425288:7539]
2025-10-10T14:34:06.519019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601342571425288:7539]
2025-10-10T14:34:06.519034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:06.519053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:06.519052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:06.519056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:06.519058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:06.519071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:06.519075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:06.519048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1219
2025-10-10T14:34:06.519085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1219
2025-10-10T14:34:06.519103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601342571425288:7539]
2025-10-10T14:34:06.519112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:06.519114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:06.519131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.519140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.519194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54d09250-37883eaa-ed29eea4-d0e21283_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:06.519206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.519211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.519218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:06.519229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.519244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:06.519266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.519429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.519438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.519453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.519587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1220 partition: 0 MaxSeqNo: 40 sessionId: src_id|54d09250-37883eaa-ed29eea4-d0e21283_0
2025-10-10T14:34:06.520068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e88f6cd3-9340706b-f2e8000d-8fc4ce4c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|54d09250-37883eaa-ed29eea4-d0e21283_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:06.522856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d09250-37883eaa-ed29eea4-d0e21283_0] Write session: try to update token
2025-10-10T14:34:06.522875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d09250-37883eaa-ed29eea4-d0e21283_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:06.537506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId: src_id|54d09250-37883eaa-ed29eea4-d0e21283_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:06.539288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:06.539313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:06.539317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:06.539319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:06.539330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601342571425288:7539]
2025-10-10T14:34:06.539334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601342571425288:7539]
2025-10-10T14:34:06.539339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601342571425288:7539]
2025-10-10T14:34:06.539395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:06.539393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:06.539401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:06.539412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.539414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:06.539415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:06.539576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:06.540281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:06.586069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601343353648094:3347]
2025-10-10T14:34:06.586330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1219, pipe: [1:7559601343353648094:3347]
2025-10-10T14:34:06.651638Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:06.652310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.652328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.652375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353648094:3347], now have 1 active actors on pipe
2025-10-10T14:34:06.652605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:06.652624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:06.652640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:06.652689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:06.652705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1220 reason: error at write: Disconnected sessionId: src_id|54d09250-37883eaa-ed29eea4-d0e21283_0
2025-10-10T14:34:06.652736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601343353648094:3347]
2025-10-10T14:34:06.652951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1220 sessionId: src_id|54d09250-37883eaa-ed29eea4-d0e21283_0 is DEAD
2025-10-10T14:34:06.653090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d09250-37883eaa-ed29eea4-d0e21283_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:06.653097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d09250-37883eaa-ed29eea4-d0e21283_0] Write session will restart in 0.005696s
2025-10-10T14:34:06.653133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d09250-37883eaa-ed29eea4-d0e21283_0] Write session: Do CDS request
2025-10-10T14:34:06.653139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d09250-37883eaa-ed29eea4-d0e21283_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:06.659868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d09250-37883eaa-ed29eea4-d0e21283_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.659967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:06.659985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1221
2025-10-10T14:34:06.660147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.660195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:06.660205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:06.660209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:06.660732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1221 sessionId:  describe result for acl check
2025-10-10T14:34:06.660773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:06.660780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:06.660782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:06.660798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601343353648116:3204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:06.661441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601343353648116:3204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:06.664629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601343353648116:3204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:06.668355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601343353648116:3204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:06.668370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601343353648116:3204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:06.668373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601343353648116:3204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:06.668382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:06.675524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:06.678385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:06.678625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:06.678642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:06.678656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:06.678734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:06.678785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601342571425597:7541]
2025-10-10T14:34:06.679481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:06.679841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:06.679910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:06.680257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:06.680346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.680353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.680354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.680355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.680357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.680358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.680359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.680360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.680361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.680363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.680364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.680365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.680366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.680373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.680387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.680391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.680396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.680400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.680405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.680409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.680413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.680417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.680423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.680427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.680432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.680436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.680444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.680453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.680459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.680470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.680474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.680479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.680488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.680491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.680494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.680498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.680500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.680504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.680507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.680510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.680513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.680516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.680519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.680522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.680525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.680528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.680531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.680534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.680537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.680540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.680543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.680546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.680571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:06.683001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:06.683826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:06.683841Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:06.683844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:06.683847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:06.683855Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1220 [2:7559601342571425597:7541]
2025-10-10T14:34:06.683871Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:06.683890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:06.683900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.683904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.683906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.683923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:06.683935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:06.683948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:06.684012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.684019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.684021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.684024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:06.684091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:06.684098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.684111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.684127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.684148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:06.684175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353648101:2438], now have 1 active actors on pipe
2025-10-10T14:34:06.684182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353648251:3204], now have 1 active actors on pipe
2025-10-10T14:34:06.684191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601342571425591:7541]
2025-10-10T14:34:06.684197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601342571425591:7541]
2025-10-10T14:34:06.684200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601342571425591:7541]
2025-10-10T14:34:06.684213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:06.684224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:06.684227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:06.684228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:06.684232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:06.684249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:06.684256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:06.684220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1220
2025-10-10T14:34:06.684237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1220
2025-10-10T14:34:06.684299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.684309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.684323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601342571425591:7541]
2025-10-10T14:34:06.684336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:06.684372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:06.684376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:06.684385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.684388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.684392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:06.684405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.684421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:06.684448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.684605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.684613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.684630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.684731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1221 partition: 0 MaxSeqNo: 40 sessionId: src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0
2025-10-10T14:34:06.685164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d09250-37883eaa-ed29eea4-d0e21283_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:06.687897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0] Write session: try to update token
2025-10-10T14:34:06.687917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:06.702506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId: src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:06.704419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:06.704446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:06.704449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:06.704451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:06.704462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601342571425591:7541]
2025-10-10T14:34:06.704466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601342571425591:7541]
2025-10-10T14:34:06.704470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601342571425591:7541]
2025-10-10T14:34:06.704525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:06.704539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.704541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:06.704696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:06.704746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:06.704763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:06.704767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:06.705397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:06.752997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601343353648409:3347]
2025-10-10T14:34:06.753311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1220, pipe: [1:7559601343353648409:3347]
2025-10-10T14:34:06.815582Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:06.816090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.816112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.816175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353648409:3347], now have 1 active actors on pipe
2025-10-10T14:34:06.816412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:06.816478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:06.816495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:06.816500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:06.816555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601343353648409:3347]
2025-10-10T14:34:06.816565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1221 reason: error at write: Disconnected sessionId: src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0
2025-10-10T14:34:06.816811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1221 sessionId: src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0 is DEAD
2025-10-10T14:34:06.816947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:06.816957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0] Write session will restart in 0.005589s
2025-10-10T14:34:06.816982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0] Write session: Do CDS request
2025-10-10T14:34:06.816991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:06.823879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.823957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:06.823973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1222
2025-10-10T14:34:06.824132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:06.824168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:06.824179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:06.824184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:06.824623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1222 sessionId:  describe result for acl check
2025-10-10T14:34:06.824660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:06.824662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:06.824665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:06.824670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601343353648426:3198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:06.825238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601343353648426:3198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:06.827743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601343353648426:3198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:06.831380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601343353648426:3198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:06.831393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601343353648426:3198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:06.831397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601343353648426:3198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:06.831405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:06.838056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:06.840833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:06.841046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:06.841058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:06.841070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:06.841131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:06.841174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601342571425899:7544]
2025-10-10T14:34:06.841822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:06.842118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:06.842165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:06.842486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:06.842540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.842547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.842548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.842549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.842551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.842552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.842553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.842554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.842555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.842556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.842557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.842559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.842560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.842565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.842578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.842582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.842585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.842588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.842592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.842595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.842599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.842603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.842607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.842611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.842615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.842619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.842628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.842637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:06.842643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.842649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:06.842653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.842659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:06.842663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.842669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:06.842673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.842678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:06.842683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.842688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:06.842693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.842699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:06.842703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.842708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:06.842718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.842724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:06.842728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.842733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:06.842743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.842748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.842754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.842759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.842768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.842773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.842812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:06.845089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:06.845519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:06.845531Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:06.845533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:06.845537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:06.845544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1221 [2:7559601342571425899:7544]
2025-10-10T14:34:06.845556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:06.845572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:06.845579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.845583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.845585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.845601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:06.845613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:06.845621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:06.845676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.845682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.845683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.845685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:06.845911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1221
2025-10-10T14:34:06.845911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1221
2025-10-10T14:34:06.846050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:06.846062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.846074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:06.846089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:06.846112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:06.846140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353648550:3198], now have 1 active actors on pipe
2025-10-10T14:34:06.846147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353648411:2438], now have 1 active actors on pipe
2025-10-10T14:34:06.846161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.846168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.846186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601342571425894:7544]
2025-10-10T14:34:06.846192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601342571425894:7544]
2025-10-10T14:34:06.846194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601342571425894:7544]
2025-10-10T14:34:06.846208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:06.846222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:06.846225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:06.846233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:06.846235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:06.846242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:06.846245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:06.846264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:06.846275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:06.846285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:06.846287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:06.846302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:06.846326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:06.846363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601342571425894:7544]
2025-10-10T14:34:06.846382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:06.846387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:06.846406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.846619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.846636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.846666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:06.846755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1222 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0
2025-10-10T14:34:06.847200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332a71f3-5acfe320-8c00645a-1c1c46bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:06.849857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0] Write session: try to update token
2025-10-10T14:34:06.849875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:06.863937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId: src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:06.866105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:06.866125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:06.866129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:06.866131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:06.866142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601342571425894:7544]
2025-10-10T14:34:06.866147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601342571425894:7544]
2025-10-10T14:34:06.866151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601342571425894:7544]
2025-10-10T14:34:06.866202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:06.866205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:06.866214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:06.866216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:06.866222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:06.866226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:06.866365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:06.866591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:06.916837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601343353648717:3347]
2025-10-10T14:34:06.917164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1221, pipe: [1:7559601343353648717:3347]
2025-10-10T14:34:06.987720Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:06.988180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:06.988199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:06.988242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353648717:3347], now have 1 active actors on pipe
2025-10-10T14:34:06.988430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:06.988434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:06.988452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601343353648717:3347]
2025-10-10T14:34:06.988476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:06.988557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1222 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0
2025-10-10T14:34:06.988774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1222 sessionId: src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0 is DEAD
2025-10-10T14:34:06.988980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:06.988994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0] Write session will restart in 0.009262s
2025-10-10T14:34:06.989019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0] Write session: Do CDS request
2025-10-10T14:34:06.989026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:06.999969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.000094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:07.000112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1223
2025-10-10T14:34:07.000283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.000328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:07.000339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:07.000343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:07.000990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1223 sessionId:  describe result for acl check
2025-10-10T14:34:07.001031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:07.001037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:07.001040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:07.001046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601347648616117:3174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:07.001669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601347648616117:3174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:07.004655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601347648616117:3174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:07.007951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601347648616117:3174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:07.007963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601347648616117:3174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:07.007966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601347648616117:3174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:07.007974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:07.011180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:07.013588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:07.014327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:07.014342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:07.014352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:07.014409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:07.014458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601346866393546:7559]
2025-10-10T14:34:07.014929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:07.015258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:07.015317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:07.015693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:07.015757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.015771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.015777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.015779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.015780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.015781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.015782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.015784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.015786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.015787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.015788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.015789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.015791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.015797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.015811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.015815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.015820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.015824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.015828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.015832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.015836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.015840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.015845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.015849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.015854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.015858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.015866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.015875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.015882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.015887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.015892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.015897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.015902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.015907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.015911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.015917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.015922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.015927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.015938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.015943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.015949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.015959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.015964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.015974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.015979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.015984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.015989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.015995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.015999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.016004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.016009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.016014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.016057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:07.018633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:07.018955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:07.018966Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:07.018968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:07.018972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:07.018978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1222 [2:7559601346866393546:7559]
2025-10-10T14:34:07.018992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:07.019011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:07.019019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.019021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.019023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.019038Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:07.019049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:07.019058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:07.019109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.019116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.019117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.019119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:07.019186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:07.019194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.019205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.019215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.019228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:07.019251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616305:3174], now have 1 active actors on pipe
2025-10-10T14:34:07.019260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601343353648746:2438], now have 1 active actors on pipe
2025-10-10T14:34:07.019268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601346866393532:7559]
2025-10-10T14:34:07.019270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601346866393532:7559]
2025-10-10T14:34:07.019272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601346866393532:7559]
2025-10-10T14:34:07.019287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:07.019300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:07.019305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:07.019320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:07.019321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:07.019322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:07.019326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:07.019354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601346866393532:7559]
2025-10-10T14:34:07.019361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:07.019366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:07.019337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1222
2025-10-10T14:34:07.019346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1222
2025-10-10T14:34:07.019644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.019659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.019700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:07.019714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.019722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.019725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:07.019738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.019755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:07.019775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.020042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.020057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.020094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.020188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1223 partition: 0 MaxSeqNo: 40 sessionId: src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0
2025-10-10T14:34:07.020632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab2b6d3-f6d548e7-639745b1-d0045a96_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:07.023434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0] Write session: try to update token
2025-10-10T14:34:07.023454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:07.037675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId: src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:07.039616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:07.039647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:07.039650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:07.039653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:07.039663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601346866393532:7559]
2025-10-10T14:34:07.039668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601346866393532:7559]
2025-10-10T14:34:07.039672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601346866393532:7559]
2025-10-10T14:34:07.039718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:07.039727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:07.039736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.039738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:07.039740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:07.039744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:07.039890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:07.040482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:07.088859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601347648616349:3347]
2025-10-10T14:34:07.089202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1222, pipe: [1:7559601347648616349:3347]
2025-10-10T14:34:07.157132Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:07.157606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.157623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.157670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616349:3347], now have 1 active actors on pipe
2025-10-10T14:34:07.157943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:07.157958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:07.157967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601347648616349:3347]
2025-10-10T14:34:07.157973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:07.157989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:07.158037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1223 reason: error at write: Disconnected sessionId: src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0
2025-10-10T14:34:07.158245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1223 sessionId: src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0 is DEAD
2025-10-10T14:34:07.158455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:07.158468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0] Write session will restart in 0.005385s
2025-10-10T14:34:07.158494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0] Write session: Do CDS request
2025-10-10T14:34:07.158500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:07.164938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.165003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:07.165020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1224
2025-10-10T14:34:07.165157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.165197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:07.165208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:07.165212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:07.165718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1224 sessionId:  describe result for acl check
2025-10-10T14:34:07.165753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:07.165757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:07.165759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:07.165766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601347648616371:3170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:07.166244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:07.166318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601347648616371:3170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:07.168030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:07.168289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:07.168306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:07.168322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:07.168400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:07.168446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601346866393602:7561]
2025-10-10T14:34:07.168878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601347648616371:3170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:07.169084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:07.169435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:07.169499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:07.169833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:07.169925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.169933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.169935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.169936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.169937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.169939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.169940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.169941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.169943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.169944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.169945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.169946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.169947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.169954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.169968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.169972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.169976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.169980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.169985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.169989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.169993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.169996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.170001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.170005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.170008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.170011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.170020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.170029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.170035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.170041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.170052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.170058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.170062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.170066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.170076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.170081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.170086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.170092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.170096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.170101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.170105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.170110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.170120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.170125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.170130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.170135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.170142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.170147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.170152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.170157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.170161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.170166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.170205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:07.172600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:07.172626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601347648616371:3170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:07.172640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601347648616371:3170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:07.172644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601347648616371:3170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:07.172653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:07.172955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:07.172973Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:07.172975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:07.172980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:07.172986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1223 [2:7559601346866393602:7561]
2025-10-10T14:34:07.172998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:07.173018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:07.173026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.173030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.173032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.173048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:07.173055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:07.173066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:07.173126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.173133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.173135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.173138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:07.173207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:07.173218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.173231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.173242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.173258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:07.173281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616407:3170], now have 1 active actors on pipe
2025-10-10T14:34:07.173285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616353:2438], now have 1 active actors on pipe
2025-10-10T14:34:07.173292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601346866393597:7561]
2025-10-10T14:34:07.173294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601346866393597:7561]
2025-10-10T14:34:07.173296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601346866393597:7561]
2025-10-10T14:34:07.173312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:07.173343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:07.173349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:07.173354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:07.173357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:07.173367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:07.173370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:07.173369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1223
2025-10-10T14:34:07.173395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601346866393597:7561]
2025-10-10T14:34:07.173405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:07.173407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:07.173370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1223
2025-10-10T14:34:07.173431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.173443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.173485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8abebd80-20ac5503-44d58e45-758918dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:07.173501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.173510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.173512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:07.173526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.173544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:07.173575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.173761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.173775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.173795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.173883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1224 partition: 0 MaxSeqNo: 40 sessionId: src_id|8abebd80-20ac5503-44d58e45-758918dc_0
2025-10-10T14:34:07.174289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23333ee-dd4058f8-93e71cc9-eddcf4c2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8abebd80-20ac5503-44d58e45-758918dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:07.176963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8abebd80-20ac5503-44d58e45-758918dc_0] Write session: try to update token
2025-10-10T14:34:07.176984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8abebd80-20ac5503-44d58e45-758918dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:07.192131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId: src_id|8abebd80-20ac5503-44d58e45-758918dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:07.192910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:07.192933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:07.192937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:07.192939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:07.192952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601346866393597:7561]
2025-10-10T14:34:07.192957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601346866393597:7561]
2025-10-10T14:34:07.192961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601346866393597:7561]
2025-10-10T14:34:07.193011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:07.193016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:07.193023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:07.193025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.193028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:07.193028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:07.193172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:07.194703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:07.258324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601347648616414:3347]
2025-10-10T14:34:07.258681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1223, pipe: [1:7559601347648616414:3347]
2025-10-10T14:34:07.309635Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:07.309979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.309994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.310041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616414:3347], now have 1 active actors on pipe
2025-10-10T14:34:07.310291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:07.310755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8abebd80-20ac5503-44d58e45-758918dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:07.310767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8abebd80-20ac5503-44d58e45-758918dc_0] Write session will restart in 0.009342s
2025-10-10T14:34:07.310791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8abebd80-20ac5503-44d58e45-758918dc_0] Write session: Do CDS request
2025-10-10T14:34:07.310798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8abebd80-20ac5503-44d58e45-758918dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:07.310284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:07.310294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601347648616414:3347]
2025-10-10T14:34:07.310320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:07.310322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:07.310385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1224 reason: error at write: Disconnected sessionId: src_id|8abebd80-20ac5503-44d58e45-758918dc_0
2025-10-10T14:34:07.310604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1224 sessionId: src_id|8abebd80-20ac5503-44d58e45-758918dc_0 is DEAD
2025-10-10T14:34:07.319994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:07.321903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8abebd80-20ac5503-44d58e45-758918dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.322086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:07.322161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:07.322191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1225
2025-10-10T14:34:07.322356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.322322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:07.322334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:07.322346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:07.322405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:07.322409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:07.322421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:07.322426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:07.322439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601346866393660:7563]
2025-10-10T14:34:07.322877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1225 sessionId:  describe result for acl check
2025-10-10T14:34:07.322924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:07.322933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:07.322936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:07.322942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601347648616437:3162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:07.323050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:07.323426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:07.323565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:07.323571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601347648616437:3162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:07.323991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:07.324084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.324093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.324094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.324096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.324097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.324098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.324113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.324114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.324115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.324117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.324118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.324121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.324122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.324129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.324140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.324144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.324148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.324152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.324156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.324160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.324163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.324169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.324173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.324177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.324181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.324184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.324193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.324209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.324222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.324235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.324248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.324260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.324275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.324286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.324291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.324303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.324312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.324318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.324323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.324331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.324335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.324345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.324351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.324357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.324361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.324367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.324377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.324382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.324391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.324397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.324407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.324412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.324462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:07.327168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:07.327282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601347648616437:3162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:07.327867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:07.327889Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:07.327892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:07.327897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:07.327906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1224 [2:7559601346866393660:7563]
2025-10-10T14:34:07.327923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:07.327946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:07.327962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.327968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.327971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.327995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:07.328017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:07.328026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:07.328121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.328140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.328142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.328145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:07.328254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:07.328272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.328288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.328301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.328328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:07.328360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1224
2025-10-10T14:34:07.328370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616416:2438], now have 1 active actors on pipe
2025-10-10T14:34:07.328391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601346866393654:7563]
2025-10-10T14:34:07.328395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601346866393654:7563]
2025-10-10T14:34:07.328398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601346866393654:7563]
2025-10-10T14:34:07.328411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:07.328419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:07.328422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:07.328423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:07.328435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:07.328456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:07.328461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:07.328513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601346866393654:7563]
2025-10-10T14:34:07.328541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:07.328570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:07.334140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601347648616437:3162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:07.334160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601347648616437:3162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:07.334174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601347648616437:3162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:07.334185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:07.334496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616474:3162], now have 1 active actors on pipe
2025-10-10T14:34:07.334566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1224
2025-10-10T14:34:07.334630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.334652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.334703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:07.334721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.334727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.334736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:07.334754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.334774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:07.334804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.335073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.335081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.335097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.335285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1225 partition: 0 MaxSeqNo: 40 sessionId: src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0
2025-10-10T14:34:07.335718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8abebd80-20ac5503-44d58e45-758918dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:07.338511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0] Write session: try to update token
2025-10-10T14:34:07.338532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:07.341211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:07.341236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:07.341248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601346866393654:7563]
2025-10-10T14:34:07.341302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:07.341303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:07.341522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:07.341685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:07.341837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:07.341987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:07.342209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:07.342258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:07.353371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId: src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:07.356098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:07.356359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.356384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.356440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:07.356544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:07.360428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:07.360450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:07.360453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:07.360455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:07.360465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601346866393654:7563]
2025-10-10T14:34:07.360470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601346866393654:7563]
2025-10-10T14:34:07.360474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601346866393654:7563]
2025-10-10T14:34:07.360530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:07.360535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:07.360541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:07.360545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.360545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:07.360548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:07.360676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:07.410410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601347648616477:3347]
2025-10-10T14:34:07.410737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1224, pipe: [1:7559601347648616477:3347]
2025-10-10T14:34:07.485892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:07.494019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.494048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.494219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.494278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.494340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.494401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.494824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.494837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.494913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.494974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.495034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.495181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.495296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.495306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.495374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.495455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.495517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.495578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.495623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.495631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.495695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.495757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.495819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.495883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.495925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.495934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.495999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.496058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.496123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.496184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.496253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.496261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.496324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.496383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.496447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.496508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.496550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.496558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.496622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.496682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.496750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.496820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.496875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.496882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.496945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.497002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.497061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.497122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.497165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.497172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.497232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.497290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.497368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.497429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.497482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.497490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.497554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:07.497612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:07.497672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:07.497732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:07.497775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:07.497782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:07.497846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616477:3347], now have 1 active actors on pipe
2025-10-10T14:34:07.498092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601347648616477:3347]
2025-10-10T14:34:07.498092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:07.498096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:07.498127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:07.498139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1225 reason: error at write: Disconnected sessionId: src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0
2025-10-10T14:34:07.498534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1225 sessionId: src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0 is DEAD
2025-10-10T14:34:07.498559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:07.498570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0] Write session will restart in 0.005336s
2025-10-10T14:34:07.498604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0] Write session: Do CDS request
2025-10-10T14:34:07.498611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:07.498671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:07.504931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.505163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:07.505181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1226
2025-10-10T14:34:07.505326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.505381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:07.505393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:07.505397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:07.505860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1226 sessionId:  describe result for acl check
2025-10-10T14:34:07.505901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:07.505907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:07.505909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:07.505916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601347648616511:3156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:07.506491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601347648616511:3156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:07.506528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:07.508177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:07.508389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:07.508400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:07.508412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:07.508464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:07.508509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601346866393729:7566]
2025-10-10T14:34:07.508703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601347648616511:3156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:07.509188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:07.509526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:07.509585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:07.509922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:07.509981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.509982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.509984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.509985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.509986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.509988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.509989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.509990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.509991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.509993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.509994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.509995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.509996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.510002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.510015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.510019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.510024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.510028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.510033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.510037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.510041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.510045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.510050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.510056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.510060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.510065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.510074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.510082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.510087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.510093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.510098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.510103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.510108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.510113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.510117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.510123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.510127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.510133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.510137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.510143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.510147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.510152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.510169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.510174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.510179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.510184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.510189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.510194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.510199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.510204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.510211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.510217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.510254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:07.512931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:07.512895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601347648616511:3156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:07.512914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601347648616511:3156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:07.512918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601347648616511:3156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:07.512927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:07.513293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:07.513313Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:07.513316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:07.513321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:07.513350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1225 [2:7559601346866393729:7566]
2025-10-10T14:34:07.513364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:07.513387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:07.513394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.513398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.513401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.513420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:07.513433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:07.513442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:07.513502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.513510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.513512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.513515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:07.513584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:07.513593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.513606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.513626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.513644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:07.513669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616492:2438], now have 1 active actors on pipe
2025-10-10T14:34:07.513678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616547:3156], now have 1 active actors on pipe
2025-10-10T14:34:07.513687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601346866393724:7566]
2025-10-10T14:34:07.513693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601346866393724:7566]
2025-10-10T14:34:07.513695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601346866393724:7566]
2025-10-10T14:34:07.513696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1225
2025-10-10T14:34:07.513707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1225
2025-10-10T14:34:07.513710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:07.513719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:07.513722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:07.513723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:07.513733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:07.513750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:07.513755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:07.513800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.513811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.513825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601346866393724:7566]
2025-10-10T14:34:07.513840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:07.513855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:07.513879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:07.513892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.513901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.513903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:07.513916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.513932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:07.513961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.514148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.514158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.514176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.514292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1226 partition: 0 MaxSeqNo: 40 sessionId: src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0
2025-10-10T14:34:07.514747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94169f5-40d2cf20-bfb7e9e2-fb4b1887_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:07.517497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0] Write session: try to update token
2025-10-10T14:34:07.517515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:07.534172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:07.534194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:07.534197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:07.534199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:07.534210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601346866393724:7566]
2025-10-10T14:34:07.534214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601346866393724:7566]
2025-10-10T14:34:07.534218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601346866393724:7566]
2025-10-10T14:34:07.534273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:07.534286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.534285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:07.534289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:07.534293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:07.534297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:07.534301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId: src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:07.534430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:07.537226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:07.598287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601347648616557:3347]
2025-10-10T14:34:07.598559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1225, pipe: [1:7559601347648616557:3347]
2025-10-10T14:34:07.649074Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:07.649513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.649531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.649577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616557:3347], now have 1 active actors on pipe
2025-10-10T14:34:07.649803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:07.649873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:07.649891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:07.649893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:07.649941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601347648616557:3347]
2025-10-10T14:34:07.649963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1226 reason: error at write: Disconnected sessionId: src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0
2025-10-10T14:34:07.650186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1226 sessionId: src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0 is DEAD
2025-10-10T14:34:07.650382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:07.650394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0] Write session will restart in 0.005871s
2025-10-10T14:34:07.650417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0] Write session: Do CDS request
2025-10-10T14:34:07.650423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:07.657924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.657980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:07.657995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1227
2025-10-10T14:34:07.658201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.658230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:07.658257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:07.658269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:07.658273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:07.658738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1227 sessionId:  describe result for acl check
2025-10-10T14:34:07.658774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:07.658781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:07.658783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:07.658789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601347648616583:3150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:07.659333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601347648616583:3150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:07.659916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:07.660111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:07.660123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:07.660136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:07.660194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:07.660232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601346866393788:7568]
2025-10-10T14:34:07.660858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:07.661120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:07.661168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:07.661515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:07.661577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.661586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.661587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.661588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.661590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.661591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.661592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.661594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.661595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.661597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.661598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.661599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.661600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.661608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.661621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.661627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.661632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.661636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.661640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.661644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.661647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.661649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.661651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.661654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.661658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.661662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.661670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.661678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.661684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.661690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.661695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.661700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.661704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.661710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.661715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.661720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.661725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.661731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.661736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.661748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.661752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.661762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.661766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.661777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.661771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601347648616583:3150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:07.661782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.661791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.661795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.661800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.661804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.661810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.661814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.661819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.661865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:07.664314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:07.664480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601347648616583:3150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:07.664494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601347648616583:3150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:07.664498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601347648616583:3150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:07.664506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:07.664681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:07.664692Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:07.664695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:07.664698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:07.664704Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1226 [2:7559601346866393788:7568]
2025-10-10T14:34:07.664718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:07.664745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:07.664749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.664769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.664771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.664788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:07.664800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:07.664808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:07.664874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.664883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.664885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.664888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:07.664956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:07.664966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.664980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.664996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.665020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:07.665043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616617:3150], now have 1 active actors on pipe
2025-10-10T14:34:07.665052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616561:2438], now have 1 active actors on pipe
2025-10-10T14:34:07.665072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601346866393783:7568]
2025-10-10T14:34:07.665053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1226
2025-10-10T14:34:07.665079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601346866393783:7568]
2025-10-10T14:34:07.665055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1226
2025-10-10T14:34:07.665082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601346866393783:7568]
2025-10-10T14:34:07.665091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:07.665107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:07.665126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:07.665129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:07.665132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:07.665137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:07.665140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:07.665176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.665187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.665207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601346866393783:7568]
2025-10-10T14:34:07.665218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:07.665238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:07.665251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:07.665264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.665274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.665277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:07.665288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.665306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:07.665393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.665541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.665551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.665571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.665640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1227 partition: 0 MaxSeqNo: 40 sessionId: src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0
2025-10-10T14:34:07.666008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5098c6f4-12af6976-9e652e92-a08c8ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:07.668800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0] Write session: try to update token
2025-10-10T14:34:07.668820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:07.683669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId: src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:07.685365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:07.685384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:07.685388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:07.685390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:07.685400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601346866393783:7568]
2025-10-10T14:34:07.685404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601346866393783:7568]
2025-10-10T14:34:07.685408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601346866393783:7568]
2025-10-10T14:34:07.685461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:07.685466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:07.685474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:07.685474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.685477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:07.685479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:07.685630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:07.686462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:07.753448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601347648616627:3347]
2025-10-10T14:34:07.753749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1226, pipe: [1:7559601347648616627:3347]
2025-10-10T14:34:07.802080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:07.802384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.802400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.802445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616627:3347], now have 1 active actors on pipe
2025-10-10T14:34:07.802591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:07.802688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601347648616627:3347]
2025-10-10T14:34:07.802724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:07.802822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0
2025-10-10T14:34:07.803045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:07.803053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1227 sessionId: src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0 is DEAD
2025-10-10T14:34:07.803318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:07.803335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0] Write session will restart in 0.007650s
2025-10-10T14:34:07.803354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0] Write session: Do CDS request
2025-10-10T14:34:07.803359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:07.810490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:07.811925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.811932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:07.812034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:07.812053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1228
2025-10-10T14:34:07.812144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:07.812156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:07.812168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:07.812192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.812224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:07.812235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:07.812239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:07.812228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:07.812276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601346866393850:7571]
2025-10-10T14:34:07.812662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1228 sessionId:  describe result for acl check
2025-10-10T14:34:07.812703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:07.812710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:07.812711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:07.812718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601347648616652:3137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:07.812903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:07.813221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:07.813265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:07.813308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601347648616652:3137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:07.813608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:07.813677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.813687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.813689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.813690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.813691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.813693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.813694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.813696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.813697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.813699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.813700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.813703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.813704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.813710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.813722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.813728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.813732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.813736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.813739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.813743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.813746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.813750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.813754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.813757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.813760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.813764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.813772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.813781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.813787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.813792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.813797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.813802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.813807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.813812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.813816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.813822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.813826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.813831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.813836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.813841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.813845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.813851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.813857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.813862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.813865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.813870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.813876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.813885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.813888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.813896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.813901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.813906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.813945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:07.815399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601347648616652:3137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:07.816240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:07.816672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:07.816685Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:07.816689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:07.816693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:07.816698Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1227 [2:7559601346866393850:7571]
2025-10-10T14:34:07.816710Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:07.816728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:07.817046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1227
2025-10-10T14:34:07.816744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.816762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.816765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.816787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:07.816793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:07.816801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:07.816868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.816870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.816875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.816878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:07.816943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:07.816947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.816959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.816971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.816989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:07.817011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616629:2438], now have 1 active actors on pipe
2025-10-10T14:34:07.817018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601346866393845:7571]
2025-10-10T14:34:07.817021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601346866393845:7571]
2025-10-10T14:34:07.817024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601346866393845:7571]
2025-10-10T14:34:07.817038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:07.817054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:07.817057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:07.817061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:07.817063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:07.817069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:07.817072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:07.817098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601346866393845:7571]
2025-10-10T14:34:07.817105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:07.817112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:07.822081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601347648616652:3137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:07.822097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601347648616652:3137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:07.822101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601347648616652:3137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:07.822110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:07.822406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616690:3137], now have 1 active actors on pipe
2025-10-10T14:34:07.822464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1227
2025-10-10T14:34:07.822542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.822557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.822608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c34b757d-5614c932-f62e0272-6cd6158c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:07.822628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.822634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.822637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:07.822652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.822676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:07.822701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.822859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.822867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.822881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.822984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1228 partition: 0 MaxSeqNo: 40 sessionId: src_id|c34b757d-5614c932-f62e0272-6cd6158c_0
2025-10-10T14:34:07.823439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21a8078b-2e25210a-53ac9e3a-ef7180f4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c34b757d-5614c932-f62e0272-6cd6158c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:07.826322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c34b757d-5614c932-f62e0272-6cd6158c_0] Write session: try to update token
2025-10-10T14:34:07.826340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c34b757d-5614c932-f62e0272-6cd6158c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:07.836687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:07.836713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:07.836717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:07.836720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:07.836730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601346866393845:7571]
2025-10-10T14:34:07.836736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601346866393845:7571]
2025-10-10T14:34:07.836740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601346866393845:7571]
2025-10-10T14:34:07.836805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:07.836808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:07.836815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:07.836817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.836819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:07.836820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:07.836957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:07.843697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId: src_id|c34b757d-5614c932-f62e0272-6cd6158c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:07.846355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:07.902928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601347648616693:3347]
2025-10-10T14:34:07.903283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1227, pipe: [1:7559601347648616693:3347]
2025-10-10T14:34:07.957123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:07.957428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.957450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.957476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616693:3347], now have 1 active actors on pipe
2025-10-10T14:34:07.957697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:07.957721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:07.957745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601347648616693:3347]
2025-10-10T14:34:07.957772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:07.957848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1228 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c34b757d-5614c932-f62e0272-6cd6158c_0
2025-10-10T14:34:07.958116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1228 sessionId: src_id|c34b757d-5614c932-f62e0272-6cd6158c_0 is DEAD
2025-10-10T14:34:07.958242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34b757d-5614c932-f62e0272-6cd6158c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:07.958254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34b757d-5614c932-f62e0272-6cd6158c_0] Write session will restart in 0.007118s
2025-10-10T14:34:07.958281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34b757d-5614c932-f62e0272-6cd6158c_0] Write session: Do CDS request
2025-10-10T14:34:07.958301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34b757d-5614c932-f62e0272-6cd6158c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:07.966768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:07.966916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c34b757d-5614c932-f62e0272-6cd6158c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.966940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:07.966968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1229
2025-10-10T14:34:07.967165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:07.967201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:07.967212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:07.967216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:07.967596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1229 sessionId:  describe result for acl check
2025-10-10T14:34:07.967632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:07.967637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:07.967638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:07.967643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601347648616721:3136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:07.968169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601347648616721:3136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:07.968404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:07.968626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:07.968637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:07.968649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:07.968710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:07.968759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601346866393911:7573]
2025-10-10T14:34:07.969394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:07.969776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:07.969823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:07.970139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:07.970198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.970205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.970207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.970208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.970209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.970210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.970211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.970212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.970214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.970215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.970216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.970218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.970219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.970226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.970239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.970243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.970247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.970251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.970255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.970259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.970263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.970267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.970271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.970276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.970280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.970284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.970291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.970300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:07.970309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.970315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:07.970320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.970326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:07.970330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.970335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:07.970339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.970344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:07.970348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.970354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:07.970359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.970364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:07.970369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.970374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:07.970385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.970391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:07.970396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.970405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:07.970410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.970415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.970420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.970425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.970429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.970435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.970415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601347648616721:3136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:07.970476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:07.972602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601347648616721:3136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:07.972617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601347648616721:3136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:07.972620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601347648616721:3136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:07.972629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:07.972711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:07.973045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:07.973058Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:07.973061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:07.973065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:07.973070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1228 [2:7559601346866393911:7573]
2025-10-10T14:34:07.973082Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:07.973103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:07.973111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.973115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.973117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.973134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:07.973143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:07.973157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:07.973214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.973220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.973223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.973225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:07.973290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:07.973297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.973308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:07.973320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:07.973363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:07.973395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616753:3136], now have 1 active actors on pipe
2025-10-10T14:34:07.973404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601347648616697:2438], now have 1 active actors on pipe
2025-10-10T14:34:07.973412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601346866393906:7573]
2025-10-10T14:34:07.973414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601346866393906:7573]
2025-10-10T14:34:07.973415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601346866393906:7573]
2025-10-10T14:34:07.973433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:07.973433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1228
2025-10-10T14:34:07.973437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1228
2025-10-10T14:34:07.973446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:07.973455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:07.973458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:07.973460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:07.973473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:07.973477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:07.973498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601346866393906:7573]
2025-10-10T14:34:07.973502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:07.973505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:07.973519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.973528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.973580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:07.973598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:07.973601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:07.973604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:07.973615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:07.973624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:07.973699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.973823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:07.973831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:07.973844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:07.973915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1229 partition: 0 MaxSeqNo: 40 sessionId: src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0
2025-10-10T14:34:07.974269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c34b757d-5614c932-f62e0272-6cd6158c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:07.977132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0] Write session: try to update token
2025-10-10T14:34:07.977152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:07.991582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId: src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:07.993261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:07.993291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:07.993294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:07.993296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:07.993306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601346866393906:7573]
2025-10-10T14:34:07.993313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601346866393906:7573]
2025-10-10T14:34:07.993320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601346866393906:7573]
2025-10-10T14:34:07.993369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:07.993384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:07.993387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:07.993389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:07.993397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:07.993405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:07.993557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:07.994460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:08.058080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601351943584080:3347]
2025-10-10T14:34:08.058400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1228, pipe: [1:7559601351943584080:3347]
2025-10-10T14:34:08.113570Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:08.114494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.114515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.114564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584080:3347], now have 1 active actors on pipe
2025-10-10T14:34:08.114801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:08.114793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:08.114810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:08.114840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601351943584080:3347]
2025-10-10T14:34:08.114862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:08.114901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1229 reason: error at write: Disconnected sessionId: src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0
2025-10-10T14:34:08.115144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1229 sessionId: src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0 is DEAD
2025-10-10T14:34:08.115312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:08.115325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0] Write session will restart in 0.009753s
2025-10-10T14:34:08.115352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0] Write session: Do CDS request
2025-10-10T14:34:08.115370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:08.123153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:08.124870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:08.125083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:08.125094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:08.125106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:08.125178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:08.125227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601351161361308:7588]
2025-10-10T14:34:08.125863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:08.125956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.125992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:08.126020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1230
2025-10-10T14:34:08.126214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.126198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:08.126251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:08.126251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:08.126258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:08.126261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:08.126572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:08.126636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.126642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.126643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.126645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.126646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.126647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.126648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.126649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.126651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.126652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.126653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.126654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.126656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.126661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.126674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.126678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.126683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.126687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.126691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.126695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1230 sessionId:  describe result for acl check
2025-10-10T14:34:08.126695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.126699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.126702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.126707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.126711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.126715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.126718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.126727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.126735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.126741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.126747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.126738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:08.126751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.126746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:08.126757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.126748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:08.126761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.126755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601351943584110:3116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:08.126766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.126771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.126777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.126781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.126787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.126792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.126799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.126804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.126809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.126813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.126819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.126823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.126828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.126833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.126837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.126842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.126847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.126852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.126863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.126904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:08.127377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601351943584110:3116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:08.129287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:08.129769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:08.129784Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:08.129787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:08.129790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:08.129795Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1229 [2:7559601351161361308:7588]
2025-10-10T14:34:08.129810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:08.129829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:08.129837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.129818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601351943584110:3116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:08.129843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.129845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.129862Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:08.129873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:08.129889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:08.129951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.129959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.129961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.129963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:08.130031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:08.130040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.130053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.130065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.130083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:08.130103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601351161361303:7588]
2025-10-10T14:34:08.130112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601351161361303:7588]
2025-10-10T14:34:08.130115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601351161361303:7588]
2025-10-10T14:34:08.130130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:08.130143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584081:2438], now have 1 active actors on pipe
2025-10-10T14:34:08.130149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:08.130153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:08.130166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:08.130168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:08.130168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:08.130171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:08.130173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1229
2025-10-10T14:34:08.130192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601351161361303:7588]
2025-10-10T14:34:08.130203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:08.130212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:08.135188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601351943584110:3116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:08.135205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601351943584110:3116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:08.135209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601351943584110:3116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:08.135218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:08.135460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584146:3116], now have 1 active actors on pipe
2025-10-10T14:34:08.135514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1229
2025-10-10T14:34:08.135575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.135589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.135624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:08.135642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.135648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.135650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:08.135678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.135695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:08.135720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.135887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.135895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.135910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.136001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1230 partition: 0 MaxSeqNo: 40 sessionId: src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0
2025-10-10T14:34:08.136429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6cb0729-d92ebad9-c8924f6c-cf3a7838_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:08.139162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0] Write session: try to update token
2025-10-10T14:34:08.139182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:08.141743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:08.141762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.141772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601351161361303:7588]
2025-10-10T14:34:08.141821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:08.141821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:08.141998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:08.142141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.142280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.142463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.142722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:08.142780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:08.153818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId: src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:08.156555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:08.156783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.156809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.156862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:08.156958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:08.159993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:08.160012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.160015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:08.160017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:08.160030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601351161361303:7588]
2025-10-10T14:34:08.160033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601351161361303:7588]
2025-10-10T14:34:08.160036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601351161361303:7588]
2025-10-10T14:34:08.160079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:08.160089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:08.160093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:08.160096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.160098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:08.160099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:08.160235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:08.215239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601351943584149:3347]
2025-10-10T14:34:08.215521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1229, pipe: [1:7559601351943584149:3347]
2025-10-10T14:34:08.273384Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:08.280691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.280721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.280894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.280952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.281011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.281078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.281229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.281237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.281315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.281392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.281451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.281514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.281555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.281564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.281634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.281691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.281749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.281813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.281857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.281865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.281942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.282239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.282304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.282374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.282418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.282425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.282490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.282549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.282615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.282680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.282725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.282733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.282807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.282870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.282930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.282992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.283037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.283042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.283107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.283175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.283244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.283302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.283344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.283354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.283420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.283474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.283532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.283587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.283647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.283654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.283716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.283779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.283852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.283920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.283968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.283973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.284034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.284090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.284157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.284217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.284258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.284263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.284332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584149:3347], now have 1 active actors on pipe
2025-10-10T14:34:08.284617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:08.284635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:08.284669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1230 reason: error at write: Disconnected sessionId: src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0
2025-10-10T14:34:08.284878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601351943584149:3347]
2025-10-10T14:34:08.284912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:08.284915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1230 sessionId: src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0 is DEAD
2025-10-10T14:34:08.284915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:08.285101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:08.285114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0] Write session will restart in 0.008203s
2025-10-10T14:34:08.285142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0] Write session: Do CDS request
2025-10-10T14:34:08.285150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:08.292416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:08.294121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:08.294344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:08.294357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:08.294369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:08.294418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:08.294463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601351161361373:7590]
2025-10-10T14:34:08.294918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.294987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:08.295001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1231
2025-10-10T14:34:08.295020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:08.295181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.295212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:08.295217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:08.295221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:08.295289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:08.295331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:08.295625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1231 sessionId:  describe result for acl check
2025-10-10T14:34:08.295640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:08.295656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:08.295664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:08.295666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:08.295672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601351943584179:3104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:08.295697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.295706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.295707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.295708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.295709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.295710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.295711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.295712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.295713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.295714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.295715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.295716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.295717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.295722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.295733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.295737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.295740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.295743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.295747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.295750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.295753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.295757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.295760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.295764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.295768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.295772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.295779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.295788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.295794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.295800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.295804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.295810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.295813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.295818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.295821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.295825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.295831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.295835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.295839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.295843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.295846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.295850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.295854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.295859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.295862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.295866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.295870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.295874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.295877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.295882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.295886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.295890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.295926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:08.296236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601351943584179:3104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:08.298431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:08.298761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601351943584179:3104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:08.298788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:08.298808Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:08.298810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:08.298814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:08.298819Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1230 [2:7559601351161361373:7590]
2025-10-10T14:34:08.298834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:08.298851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:08.298854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.298857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.298861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.298878Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:08.298890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:08.298897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:08.298952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.298959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.298960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.298963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:08.299024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:08.299032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.299042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.299052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.299067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:08.299092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601351161361368:7590]
2025-10-10T14:34:08.299098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601351161361368:7590]
2025-10-10T14:34:08.299101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601351161361368:7590]
2025-10-10T14:34:08.299114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:08.299127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:08.299132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584150:2438], now have 1 active actors on pipe
2025-10-10T14:34:08.299137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:08.299140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:08.299142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:08.299153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:08.299156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:08.299187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601351161361368:7590]
2025-10-10T14:34:08.299199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:08.299203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:08.299184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1230
2025-10-10T14:34:08.303999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601351943584179:3104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:08.304019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601351943584179:3104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:08.304023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601351943584179:3104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:08.304033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:08.304290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584215:3104], now have 1 active actors on pipe
2025-10-10T14:34:08.304418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1230
2025-10-10T14:34:08.304535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.304660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.304715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:08.304746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.304753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.304756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:08.304787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.304815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:08.304843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.305025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.305034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.305052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.305131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1231 partition: 0 MaxSeqNo: 40 sessionId: src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0
2025-10-10T14:34:08.305607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566780fc-7b3dc232-ceb9e09e-198576d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:08.308516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0] Write session: try to update token
2025-10-10T14:34:08.308538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:08.318948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:08.318968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.318972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:08.318976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:08.318986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601351161361368:7590]
2025-10-10T14:34:08.318990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601351161361368:7590]
2025-10-10T14:34:08.318994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601351161361368:7590]
2025-10-10T14:34:08.319047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:08.319052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:08.319054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.319057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:08.319058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:08.319063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:08.319214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:08.323834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId: src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:08.326409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:08.385231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601351943584218:3347]
2025-10-10T14:34:08.385514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1230, pipe: [1:7559601351943584218:3347]
2025-10-10T14:34:08.432267Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:08.432567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.432582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.432623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584218:3347], now have 1 active actors on pipe
2025-10-10T14:34:08.432830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:08.432939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601351943584218:3347]
2025-10-10T14:34:08.432985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:08.433055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1231 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0
2025-10-10T14:34:08.433075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:08.433265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1231 sessionId: src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0 is DEAD
2025-10-10T14:34:08.433443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:08.433454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0] Write session will restart in 0.007726s
2025-10-10T14:34:08.433481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0] Write session: Do CDS request
2025-10-10T14:34:08.433487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:08.441275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:08.442989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.443101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:08.443116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1232
2025-10-10T14:34:08.443188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:08.443387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:08.443399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:08.443410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:08.443465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:08.443553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601351161361437:7592]
2025-10-10T14:34:08.443957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:08.443259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.443294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:08.443301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:08.443315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:08.443713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1232 sessionId:  describe result for acl check
2025-10-10T14:34:08.443737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:08.443738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:08.444239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:08.443739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:08.443743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601351943584246:3100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:08.444288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601351943584246:3100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:08.444283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:08.444520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:08.444566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.444567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.444568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.444569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.444572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.444573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.444575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.444576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.444577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.444578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.444579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.444580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.444581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.444587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.444599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.444603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.444607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.444611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.444615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.444619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.444623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.444625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.444628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.444630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.444632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.444634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.444642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.444647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.444652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.444655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.444658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.444661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.444664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.444667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.444670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.444674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.444678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.444681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.444684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.444687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.444689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.444693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.444695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.444698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.444702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.444705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.444707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.444710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.444713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.444715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.444718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.444721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.444759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:08.447559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:08.447887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:08.447902Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:08.447905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:08.447908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:08.447917Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1231 [2:7559601351161361437:7592]
2025-10-10T14:34:08.447931Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:08.447948Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:08.447957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.447960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.447963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.447980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:08.447987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:08.447995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:08.448048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.448055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.448056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.448059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:08.448190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:08.448196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.448207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.448217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.448239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:08.448265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584219:2438], now have 1 active actors on pipe
2025-10-10T14:34:08.448278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601351161361432:7592]
2025-10-10T14:34:08.448280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601351161361432:7592]
2025-10-10T14:34:08.448282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601351161361432:7592]
2025-10-10T14:34:08.448273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1231
2025-10-10T14:34:08.448293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:08.448307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:08.448310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:08.448311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:08.448313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:08.448339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:08.448347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:08.448376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601351161361432:7592]
2025-10-10T14:34:08.448388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:08.448367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601351943584246:3100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:08.448400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:08.453423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601351943584246:3100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:08.453443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601351943584246:3100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:08.453447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601351943584246:3100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:08.453455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:08.453729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584283:3100], now have 1 active actors on pipe
2025-10-10T14:34:08.453767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1231
2025-10-10T14:34:08.453857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.453871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.453905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec18e634-ceeefdb1-6eb494da-5653088_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:08.453921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.453931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.453941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:08.453955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.453981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:08.454004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.454241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.454259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.454288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.454374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1232 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec18e634-ceeefdb1-6eb494da-5653088_0
2025-10-10T14:34:08.454800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdaf5297-fc477ab6-70dc5582-11413a1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec18e634-ceeefdb1-6eb494da-5653088_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:08.457531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec18e634-ceeefdb1-6eb494da-5653088_0] Write session: try to update token
2025-10-10T14:34:08.457545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec18e634-ceeefdb1-6eb494da-5653088_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:08.459965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:08.459981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.459991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601351161361432:7592]
2025-10-10T14:34:08.460038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:08.460050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:08.460235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:08.460388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.460535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.460688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.460974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:08.461018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:08.474031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId: src_id|ec18e634-ceeefdb1-6eb494da-5653088_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:08.476822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:08.478617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.478649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.478677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:08.478680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.478686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:08.478688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:08.478699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601351161361432:7592]
2025-10-10T14:34:08.478707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601351161361432:7592]
2025-10-10T14:34:08.478711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601351161361432:7592]
2025-10-10T14:34:08.478759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:08.478775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:08.478776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:08.478780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:08.478782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.478785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:08.478929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:08.533212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601351943584300:3347]
2025-10-10T14:34:08.533503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1231, pipe: [1:7559601351943584300:3347]
2025-10-10T14:34:08.603415Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:08.603742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:08.603776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584300:3347], now have 1 active actors on pipe
2025-10-10T14:34:08.603934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:08.604088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601351943584300:3347]
2025-10-10T14:34:08.604129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:08.613001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:08.614537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:08.614821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:08.614836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:08.614851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:08.614918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:08.614970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601351161361515:7595]
2025-10-10T14:34:08.615589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:08.615864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:08.615912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:08.616334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:08.616349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:08.616376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1232 reason: error at write: Disconnected sessionId: src_id|ec18e634-ceeefdb1-6eb494da-5653088_0
2025-10-10T14:34:08.616563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1232 sessionId: src_id|ec18e634-ceeefdb1-6eb494da-5653088_0 is DEAD
2025-10-10T14:34:08.616233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:08.616294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.616296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.616297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.616298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.616299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.616300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.616302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.616302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.616303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.616304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.616305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.616306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.616307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.616314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.616329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.616333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.616337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.616340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.616344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.616348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.616353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.616357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.616361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.616365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.616369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.616373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.616381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.616390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.616397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.616403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.616407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.616412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.616417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.616423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.616427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.616432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.616436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.616442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.616448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.616454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.616458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.616463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.616468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.616753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec18e634-ceeefdb1-6eb494da-5653088_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:08.616771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec18e634-ceeefdb1-6eb494da-5653088_0] Write session will restart in 0.008874s
2025-10-10T14:34:08.616474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.616478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.616485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.616490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.616495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.616499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.616504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.616508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.616514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.616802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec18e634-ceeefdb1-6eb494da-5653088_0] Write session: Do CDS request
2025-10-10T14:34:08.616551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:08.616809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec18e634-ceeefdb1-6eb494da-5653088_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:08.624398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:08.624992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:08.625009Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:08.625013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:08.625017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:08.625028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1232 [2:7559601351161361515:7595]
2025-10-10T14:34:08.625043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:08.625069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:08.625097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.625106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.625109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.625129Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:08.625142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:08.625154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:08.625228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.625236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.625239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.625241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:08.625318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:08.625347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.625364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.625377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.625395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:08.625420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584304:2438], now have 1 active actors on pipe
2025-10-10T14:34:08.625431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601351161361510:7595]
2025-10-10T14:34:08.625433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601351161361510:7595]
2025-10-10T14:34:08.625436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601351161361510:7595]
2025-10-10T14:34:08.625455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:08.625472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:08.625497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:08.625505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:08.625519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1232
2025-10-10T14:34:08.625555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601351161361510:7595]
2025-10-10T14:34:08.625568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:08.625616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:08.625629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:08.625632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:08.625641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:08.626963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec18e634-ceeefdb1-6eb494da-5653088_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.627030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:08.627044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1233
2025-10-10T14:34:08.627436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.627484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:08.627490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:08.627494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:08.627935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1233 sessionId:  describe result for acl check
2025-10-10T14:34:08.627976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:08.627983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:08.627985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:08.627991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601351943584344:3093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:08.629028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601351943584344:3093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:08.634503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601351943584344:3093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:08.637783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:08.637806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.637817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601351161361510:7595]
2025-10-10T14:34:08.637863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:08.637871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:08.638077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:08.638216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.638348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.638484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.638677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:08.638715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:08.639747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601351943584344:3093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:08.639767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601351943584344:3093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:08.639771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601351943584344:3093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:08.639781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:08.640097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584376:3093], now have 1 active actors on pipe
2025-10-10T14:34:08.640191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1232
2025-10-10T14:34:08.640313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.640330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.640365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77861bc6-788502a4-54564048-482da042_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:08.640383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.640394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.640400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:08.640434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.640460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:08.640493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.640673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.640682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.640708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.640845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1233 partition: 0 MaxSeqNo: 40 sessionId: src_id|77861bc6-788502a4-54564048-482da042_0
2025-10-10T14:34:08.641359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec18e634-ceeefdb1-6eb494da-5653088_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77861bc6-788502a4-54564048-482da042_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:08.644195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77861bc6-788502a4-54564048-482da042_0] Write session: try to update token
2025-10-10T14:34:08.644212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77861bc6-788502a4-54564048-482da042_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:08.656737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:08.656769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.656773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:08.656775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:08.656792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601351161361510:7595]
2025-10-10T14:34:08.656799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601351161361510:7595]
2025-10-10T14:34:08.656803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601351161361510:7595]
2025-10-10T14:34:08.656856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:08.656857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:08.656864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:08.656871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:08.656871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.656874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:08.657048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:08.658472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId: src_id|77861bc6-788502a4-54564048-482da042_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:08.661081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:08.704212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601351943584380:3347]
2025-10-10T14:34:08.704447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1232, pipe: [1:7559601351943584380:3347]
2025-10-10T14:34:08.773692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:08.774103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.774127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.774150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584380:3347], now have 1 active actors on pipe
2025-10-10T14:34:08.774372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:08.774397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:08.774429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:08.774431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601351943584380:3347]
2025-10-10T14:34:08.774449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:08.774514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1233 reason: error at write: Disconnected sessionId: src_id|77861bc6-788502a4-54564048-482da042_0
2025-10-10T14:34:08.774742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1233 sessionId: src_id|77861bc6-788502a4-54564048-482da042_0 is DEAD
2025-10-10T14:34:08.774932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77861bc6-788502a4-54564048-482da042_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:08.774945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77861bc6-788502a4-54564048-482da042_0] Write session will restart in 0.006972s
2025-10-10T14:34:08.774970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77861bc6-788502a4-54564048-482da042_0] Write session: Do CDS request
2025-10-10T14:34:08.774980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77861bc6-788502a4-54564048-482da042_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:08.782736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:08.782946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77861bc6-788502a4-54564048-482da042_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.782988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:08.783004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1234
2025-10-10T14:34:08.783196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.783244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:08.783268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:08.783277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:08.783755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1234 sessionId:  describe result for acl check
2025-10-10T14:34:08.783794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:08.783800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:08.783802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:08.783809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601351943584409:3081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:08.784335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:08.784367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601351943584409:3081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:08.784555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:08.784569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:08.784583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:08.784647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:08.784686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601351161361584:7598]
2025-10-10T14:34:08.785261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:08.785556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:08.785610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:08.785872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:08.785926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.785933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.785934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.785936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.785937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.785939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.785940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.785942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.785943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.785944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.785946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.785947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.785949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.785953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.785961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.785965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.785968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.785970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.785972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.785974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.785976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.785978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.785981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.785983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.785985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.785987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.785993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.785999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.786003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.786007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.786009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.786013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.786016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.786020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.786022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.786025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.786029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.786032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.786035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.786047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.786052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.786057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.786063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.786068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.786073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.786082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.786089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.786096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.786099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.786104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.786107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.786112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.786146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:08.786608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601351943584409:3081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:08.788400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:08.788764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:08.788778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:08.788780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:08.788783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:08.788789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1233 [2:7559601351161361584:7598]
2025-10-10T14:34:08.788802Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:08.788817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:08.788825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.788829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.788831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.788846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:08.788858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:08.788869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:08.788925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.788934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.788939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.788941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:08.789003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:08.789014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.789024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.789037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.789054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:08.789082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584381:2438], now have 1 active actors on pipe
2025-10-10T14:34:08.789095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601351161361579:7598]
2025-10-10T14:34:08.789097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601351161361579:7598]
2025-10-10T14:34:08.789099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601351161361579:7598]
2025-10-10T14:34:08.789086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1233
2025-10-10T14:34:08.789107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:08.789120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:08.789122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:08.789124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:08.789129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:08.789144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:08.789147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:08.789173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601351161361579:7598]
2025-10-10T14:34:08.789181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:08.789189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:08.789278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601351943584409:3081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:08.789289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601351943584409:3081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:08.789292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601351943584409:3081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:08.789298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:08.789509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584446:3081], now have 1 active actors on pipe
2025-10-10T14:34:08.789627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1233
2025-10-10T14:34:08.789687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.789698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.789727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|420629f-c77adf20-6813fbe0-2a146480_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:08.789741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.789745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.789747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:08.789758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.789770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:08.789789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.789917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.789924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.789937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.790052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1234 partition: 0 MaxSeqNo: 40 sessionId: src_id|420629f-c77adf20-6813fbe0-2a146480_0
2025-10-10T14:34:08.790424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77861bc6-788502a4-54564048-482da042_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|420629f-c77adf20-6813fbe0-2a146480_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:08.793016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420629f-c77adf20-6813fbe0-2a146480_0] Write session: try to update token
2025-10-10T14:34:08.793032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420629f-c77adf20-6813fbe0-2a146480_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:08.800688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:08.800708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.800737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601351161361579:7598]
2025-10-10T14:34:08.800785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:08.800791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:08.800974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:08.801129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.801270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.801438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:08.801632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:08.801678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:08.807058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId: src_id|420629f-c77adf20-6813fbe0-2a146480_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:08.809718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:08.809989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.810013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.810058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:08.810154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:08.819824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:08.819850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.819853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:08.819855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:08.819867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601351161361579:7598]
2025-10-10T14:34:08.819872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601351161361579:7598]
2025-10-10T14:34:08.819876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601351161361579:7598]
2025-10-10T14:34:08.819925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:08.819925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:08.819938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.819941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:08.819941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:08.819946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:08.820073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:08.874704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601351943584452:3347]
2025-10-10T14:34:08.875056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1233, pipe: [1:7559601351943584452:3347]
2025-10-10T14:34:08.937044Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:08.944669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.944705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.944885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.944957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.945029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.945105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.945161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.945170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.945250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.945314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.945401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.945699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.945753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.945762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.945836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.945898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.945960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.946025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.946071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.946074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.946145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.946213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.946279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.946354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.946400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.946407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.946477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.946538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.946602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.946667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.946710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.946716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.946787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.946847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.946904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.946962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.947016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.947024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.947087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.947152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.947222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.947287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.947338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.947346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.947422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.947483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.947547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.947610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.947652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.947658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.947734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.947801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.947865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.947935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.947990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.947998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.948066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:08.948126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:08.948190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:08.948260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:08.948307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:08.948314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:08.948387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584452:3347], now have 1 active actors on pipe
2025-10-10T14:34:08.948617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:08.948629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601351943584452:3347]
2025-10-10T14:34:08.948632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:08.948678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1234 reason: error at write: Disconnected sessionId: src_id|420629f-c77adf20-6813fbe0-2a146480_0
2025-10-10T14:34:08.948750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:08.948936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1234 sessionId: src_id|420629f-c77adf20-6813fbe0-2a146480_0 is DEAD
2025-10-10T14:34:08.949036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:08.949099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420629f-c77adf20-6813fbe0-2a146480_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:08.949112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420629f-c77adf20-6813fbe0-2a146480_0] Write session will restart in 0.005486s
2025-10-10T14:34:08.949139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420629f-c77adf20-6813fbe0-2a146480_0] Write session: Do CDS request
2025-10-10T14:34:08.949145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420629f-c77adf20-6813fbe0-2a146480_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:08.955871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420629f-c77adf20-6813fbe0-2a146480_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.955930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:08.955967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1235
2025-10-10T14:34:08.956141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:08.956188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:08.956193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:08.956202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:08.956683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1235 sessionId:  describe result for acl check
2025-10-10T14:34:08.956730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:08.956738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:08.956740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:08.956747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601351943584483:3082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:08.957230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:08.957315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601351943584483:3082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:08.959137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:08.959295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:08.959304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:08.959313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:08.959352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:08.959390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601351161361652:7600]
2025-10-10T14:34:08.959794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:08.960086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:08.960143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:08.960431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:08.960499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.960504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.960505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.960506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.960506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.960507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.960509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.960510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.960510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.960511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.960512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.960513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.960513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.960518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.960528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.960533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.960537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.960540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.960544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.960548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.960552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.960556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.960560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.960565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.960569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.960574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.960582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.960590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:08.960597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.960603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:08.960608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.960611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:08.960614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.960618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:08.960620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.960624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:08.960626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.960629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:08.960633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.960636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:08.960638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.960642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:08.960647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.960651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:08.960656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.960661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:08.960666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.960670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.960674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.960679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.960682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.960688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.960741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:08.960760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601351943584483:3082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:08.963052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:08.963338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601351943584483:3082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:08.963351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601351943584483:3082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:08.963362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601351943584483:3082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:08.963370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:08.963554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:08.963563Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:08.963567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:08.963570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:08.963576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1234 [2:7559601351161361652:7600]
2025-10-10T14:34:08.963589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:08.963605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:08.963613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.963618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.963620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.963636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:08.963651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:08.963658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:08.963706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.963711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.963713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.963714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:08.963765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:08.963772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.963782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:08.963798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:08.963813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:08.963839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584517:3082], now have 1 active actors on pipe
2025-10-10T14:34:08.963852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601351161361647:7600]
2025-10-10T14:34:08.963859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601351161361647:7600]
2025-10-10T14:34:08.963861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601351161361647:7600]
2025-10-10T14:34:08.963875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:08.963890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601351943584453:2438], now have 1 active actors on pipe
2025-10-10T14:34:08.963891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:08.963894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:08.963896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:08.963898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:08.963909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1234
2025-10-10T14:34:08.963913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:08.963915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1234
2025-10-10T14:34:08.963923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:08.963951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601351161361647:7600]
2025-10-10T14:34:08.963962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:08.963968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:08.963981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.963986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.964028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:08.964040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:08.964044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:08.964045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:08.964053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:08.964064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:08.964082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.964218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:08.964226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:08.964244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:08.964328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1235 partition: 0 MaxSeqNo: 40 sessionId: src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0
2025-10-10T14:34:08.964725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420629f-c77adf20-6813fbe0-2a146480_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:08.967402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0] Write session: try to update token
2025-10-10T14:34:08.967424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:08.981680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId: src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:08.983732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:08.983754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:08.983758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:08.983762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:08.983772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601351161361647:7600]
2025-10-10T14:34:08.983777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601351161361647:7600]
2025-10-10T14:34:08.983781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601351161361647:7600]
2025-10-10T14:34:08.983823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:08.983829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:08.983830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:08.983835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:08.983840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:08.983843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:08.983976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:08.984307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:09.048789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601356238551834:3347]
2025-10-10T14:34:09.049083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1234, pipe: [1:7559601356238551834:3347]
2025-10-10T14:34:09.099812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:09.100145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.100163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.100214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238551834:3347], now have 1 active actors on pipe
2025-10-10T14:34:09.100418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:09.100474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601356238551834:3347]
2025-10-10T14:34:09.100496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:09.100501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:09.100506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:09.100575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1235 reason: error at write: Disconnected sessionId: src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0
2025-10-10T14:34:09.100838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1235 sessionId: src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0 is DEAD
2025-10-10T14:34:09.100972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:09.100984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0] Write session will restart in 0.009328s
2025-10-10T14:34:09.101020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0] Write session: Do CDS request
2025-10-10T14:34:09.101027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:09.108855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:09.110321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:09.110531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:09.110543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:09.110556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:09.110618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:09.110658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601355456329056:7615]
2025-10-10T14:34:09.111289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:09.111597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:09.111642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:09.111942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.111941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:09.112012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.112017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.112019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.112020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.112021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.112023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.112024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.112026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.112027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.112029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.112031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.112032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.112033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.112039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.112053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.112057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.112063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.112067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.112040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:09.112057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1236
2025-10-10T14:34:09.112071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.112075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.112079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.112083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.112088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.112092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.112096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.112100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.112108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.112116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.112123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.112128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.112133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.112138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.112142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.112146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.112151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.112156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.112161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.112167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.112172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.112186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.112190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.112202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.112192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.112207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.112216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.112220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.112226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.112235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.112226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:09.112237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:09.112241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.112250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.112241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:09.112255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.112261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.112266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.112308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:09.112683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1236 sessionId:  describe result for acl check
2025-10-10T14:34:09.112741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:09.112748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:09.112750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:09.112756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601356238551885:3060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:09.113381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601356238551885:3060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:09.114786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:09.115216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:09.115232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:09.115234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:09.115238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:09.115246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1235 [2:7559601355456329056:7615]
2025-10-10T14:34:09.115261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:09.115282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:09.115293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.115297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.115299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.115318Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:09.115331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:09.115344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:09.115409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.115417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.115419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.115421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:09.115491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:09.115499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.115510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.115527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.115549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:09.115582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238551849:2438], now have 1 active actors on pipe
2025-10-10T14:34:09.115591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601355456329051:7615]
2025-10-10T14:34:09.115593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601355456329051:7615]
2025-10-10T14:34:09.115595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601355456329051:7615]
2025-10-10T14:34:09.115593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1235
2025-10-10T14:34:09.115610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:09.115629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:09.115631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:09.115634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:09.115637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:09.115650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:09.115653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:09.115686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601355456329051:7615]
2025-10-10T14:34:09.115699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:09.115717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:09.115981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601356238551885:3060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:09.122944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601356238551885:3060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:09.122963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601356238551885:3060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:09.122967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601356238551885:3060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:09.122977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:09.123259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238551915:3060], now have 1 active actors on pipe
2025-10-10T14:34:09.123295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1235
2025-10-10T14:34:09.123354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.123375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.123415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:09.123436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.123442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.123446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:09.123461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.123499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:09.123528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.123696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.123704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.123719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.123798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1236 partition: 0 MaxSeqNo: 40 sessionId: src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0
2025-10-10T14:34:09.124211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e2ac678-dc0b9829-c28e8fae-dd6b2ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:09.126997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0] Write session: try to update token
2025-10-10T14:34:09.127017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:09.127366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:09.127383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:09.127391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601355456329051:7615]
2025-10-10T14:34:09.127429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:09.127434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:09.127604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:09.127734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:09.127866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:09.128000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:09.128184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:09.128222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:09.141002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId: src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:09.143701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:09.143949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.143975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.144029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:09.144111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:09.145833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:09.145848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:09.145851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:09.145853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:09.145863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601355456329051:7615]
2025-10-10T14:34:09.145867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601355456329051:7615]
2025-10-10T14:34:09.145873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601355456329051:7615]
2025-10-10T14:34:09.145915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:09.145926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.145928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:09.145938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:09.145945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:09.145950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:09.146065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:09.200886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601356238551919:3347]
2025-10-10T14:34:09.201574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1235, pipe: [1:7559601356238551919:3347]
2025-10-10T14:34:09.260298Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:09.268368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.268396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.268570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.268630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.268692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.268774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.268823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.268840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.268907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.268965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.269026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.269103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.269147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.269154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.269219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.269280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.269364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.269426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.269468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.269474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.269541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.269604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.269663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.269727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.269772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.269778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.269843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.269908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.269967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.270029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.270076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.270083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.270145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.270204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.270265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.270326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.270371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.270379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.270439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.270491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.270546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.270610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.270650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.270658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.270717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.270772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.270831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.270886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.270926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.270931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.270990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.271054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.271112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.271168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.271209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.271215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.271272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:09.271326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:09.271388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:09.271443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:09.271480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:09.271485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:09.271537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238551919:3347], now have 1 active actors on pipe
2025-10-10T14:34:09.271839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601356238551919:3347]
2025-10-10T14:34:09.271850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:09.271854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:09.271881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:09.271887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1236 reason: error at write: Disconnected sessionId: src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0
2025-10-10T14:34:09.272137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1236 sessionId: src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0 is DEAD
2025-10-10T14:34:09.272263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:09.272311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:09.272320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0] Write session will restart in 0.009391s
2025-10-10T14:34:09.272359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0] Write session: Do CDS request
2025-10-10T14:34:09.272365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:09.280834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:09.282494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:09.282693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:09.282704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:09.282727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:09.282785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:09.282829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601355456329126:7617]
2025-10-10T14:34:09.282845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.282973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:09.283001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1237
2025-10-10T14:34:09.283127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.283160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:09.283170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:09.283173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:09.283441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:09.283550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1237 sessionId:  describe result for acl check
2025-10-10T14:34:09.283584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:09.283590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:09.283592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:09.283598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601356238551953:3056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:09.283694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:09.283737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:09.284055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:09.284120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.284127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.284128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.284137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601356238551953:3056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:09.284129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.284131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.284132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.284133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.284134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.284135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.284136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.284138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.284139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.284140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.284145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.284158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.284162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.284167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.284172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.284176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.284181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.284185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.284189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.284194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.284198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.284202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.284207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.284213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.284222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.284228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.284234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.284238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.284244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.284248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.284253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.284257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.284263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.284267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.284272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.284277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.284285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.284289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.284298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.284302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.284306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.284313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.284316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.284319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.284322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.284324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.284327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.284330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.284333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.284369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:09.286706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:09.286865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601356238551953:3056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:09.287019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:09.287032Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:09.287035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:09.287041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:09.287046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1236 [2:7559601355456329126:7617]
2025-10-10T14:34:09.287057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:09.287073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:09.287080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.287084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.287086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.287102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:09.287115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:09.287124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:09.287177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.287184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.287186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.287188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:09.287250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:09.287268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.287284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.287300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.287317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:09.287343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238551921:2438], now have 1 active actors on pipe
2025-10-10T14:34:09.287349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1236
2025-10-10T14:34:09.287356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601355456329121:7617]
2025-10-10T14:34:09.287365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601355456329121:7617]
2025-10-10T14:34:09.287367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601355456329121:7617]
2025-10-10T14:34:09.287382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:09.287401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:09.287404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:09.287407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:09.287409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:09.287421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:09.287424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:09.287449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601355456329121:7617]
2025-10-10T14:34:09.287460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:09.287475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:09.292156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601356238551953:3056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:09.292173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601356238551953:3056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:09.292177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601356238551953:3056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:09.292186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:09.292438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238551991:3056], now have 1 active actors on pipe
2025-10-10T14:34:09.292504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1236
2025-10-10T14:34:09.292576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.292590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.292626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52157738-b0f0682d-76584d4c-3da144b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:09.292644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.292656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.292658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:09.292674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.292709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:09.292732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.292924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.292933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.292948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.293034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1237 partition: 0 MaxSeqNo: 40 sessionId: src_id|52157738-b0f0682d-76584d4c-3da144b3_0
2025-10-10T14:34:09.293462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eed3ac8-3ae0aa82-822e67ac-b5d6f913_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|52157738-b0f0682d-76584d4c-3da144b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:09.296280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52157738-b0f0682d-76584d4c-3da144b3_0] Write session: try to update token
2025-10-10T14:34:09.296299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52157738-b0f0682d-76584d4c-3da144b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:09.308388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:09.308414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:09.308421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:09.308424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:09.308438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601355456329121:7617]
2025-10-10T14:34:09.308445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601355456329121:7617]
2025-10-10T14:34:09.308455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601355456329121:7617]
2025-10-10T14:34:09.308499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:09.308512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:09.308517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:09.308524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:09.308534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.308537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:09.308837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:09.311401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId: src_id|52157738-b0f0682d-76584d4c-3da144b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:09.314436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:09.371928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601356238551995:3347]
2025-10-10T14:34:09.372177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1236, pipe: [1:7559601356238551995:3347]
2025-10-10T14:34:09.424675Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:09.425110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.425125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.425173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238551995:3347], now have 1 active actors on pipe
2025-10-10T14:34:09.425394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:09.425458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:09.425494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:09.425505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601356238551995:3347]
2025-10-10T14:34:09.425586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1237 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52157738-b0f0682d-76584d4c-3da144b3_0
2025-10-10T14:34:09.425827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1237 sessionId: src_id|52157738-b0f0682d-76584d4c-3da144b3_0 is DEAD
2025-10-10T14:34:09.426026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52157738-b0f0682d-76584d4c-3da144b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:09.426039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52157738-b0f0682d-76584d4c-3da144b3_0] Write session will restart in 0.009269s
2025-10-10T14:34:09.426063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52157738-b0f0682d-76584d4c-3da144b3_0] Write session: Do CDS request
2025-10-10T14:34:09.426069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52157738-b0f0682d-76584d4c-3da144b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:09.434457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:09.436032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:09.436205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:09.436225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:09.436234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:09.436276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:09.436308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601355456329197:7619]
2025-10-10T14:34:09.436843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:09.436978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52157738-b0f0682d-76584d4c-3da144b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.437058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:09.437073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1238
2025-10-10T14:34:09.437216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:09.437241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.437281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:09.437284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:09.437294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:09.437298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:09.437614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:09.437688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.437720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1238 sessionId:  describe result for acl check
2025-10-10T14:34:09.437696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.437700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.437701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.437753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:09.437702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.437759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:09.437762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:09.437703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.437768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601356238552032:3052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:09.437704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.437705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.437706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.437707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.437708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.437709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.437710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.437716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.437728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.437732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.437736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.437739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.437743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.437747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.437751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.437754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.437758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.437762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.437766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.437769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.437778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.437786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.437793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.437798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.437802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.437807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.437812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.437819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.437826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.437831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.437835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.437841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.437846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.437851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.437854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.437859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.437863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.437868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.437872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.437876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.437880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.437885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.437889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.437895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.437899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.437903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.437955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:09.438325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601356238552032:3052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:09.440357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:09.440420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601356238552032:3052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:09.440691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:09.440719Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:09.440724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:09.440728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:09.440734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1237 [2:7559601355456329197:7619]
2025-10-10T14:34:09.440747Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:09.440763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:09.440770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.440774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.440777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.440796Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:09.440807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:09.440814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:09.440881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.440887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.440889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.440892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:09.440955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:09.440964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.440975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.440986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.441003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:09.441039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238551996:2438], now have 1 active actors on pipe
2025-10-10T14:34:09.441051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601355456329192:7619]
2025-10-10T14:34:09.441054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601355456329192:7619]
2025-10-10T14:34:09.441056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601355456329192:7619]
2025-10-10T14:34:09.441072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:09.441087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:09.441079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1237
2025-10-10T14:34:09.441103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:09.441109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:09.441111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:09.441112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:09.441114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:09.441133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601355456329192:7619]
2025-10-10T14:34:09.441136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:09.441139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:09.446099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601356238552032:3052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:09.446115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601356238552032:3052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:09.446119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601356238552032:3052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:09.446127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:09.446388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552067:3052], now have 1 active actors on pipe
2025-10-10T14:34:09.446445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1237
2025-10-10T14:34:09.446530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.446545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.446586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b6d3699-cfc80a59-67584725-8368fd57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:09.446606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.446611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.446614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:09.446628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.446648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:09.446683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.446899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.446911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.446946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.447025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1238 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b6d3699-cfc80a59-67584725-8368fd57_0
2025-10-10T14:34:09.447453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52157738-b0f0682d-76584d4c-3da144b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b6d3699-cfc80a59-67584725-8368fd57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:09.450105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6d3699-cfc80a59-67584725-8368fd57_0] Write session: try to update token
2025-10-10T14:34:09.450123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6d3699-cfc80a59-67584725-8368fd57_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:09.460945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:09.460964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:09.460969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:09.460972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:09.460981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601355456329192:7619]
2025-10-10T14:34:09.460986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601355456329192:7619]
2025-10-10T14:34:09.460990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601355456329192:7619]
2025-10-10T14:34:09.461039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:09.461042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:09.461049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:09.461053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.461054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:09.461056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:09.461206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:09.464317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId: src_id|9b6d3699-cfc80a59-67584725-8368fd57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:09.467081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:09.525438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601356238552083:3347]
2025-10-10T14:34:09.525718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1237, pipe: [1:7559601356238552083:3347]
2025-10-10T14:34:09.573774Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:09.574164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.574180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.574228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552083:3347], now have 1 active actors on pipe
2025-10-10T14:34:09.574465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:09.575028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6d3699-cfc80a59-67584725-8368fd57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:09.575040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6d3699-cfc80a59-67584725-8368fd57_0] Write session will restart in 0.007260s
2025-10-10T14:34:09.575065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6d3699-cfc80a59-67584725-8368fd57_0] Write session: Do CDS request
2025-10-10T14:34:09.575071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6d3699-cfc80a59-67584725-8368fd57_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:09.574503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:09.574520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:09.574530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601356238552083:3347]
2025-10-10T14:34:09.574551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:09.574580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1238 reason: error at write: Disconnected sessionId: src_id|9b6d3699-cfc80a59-67584725-8368fd57_0
2025-10-10T14:34:09.574802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1238 sessionId: src_id|9b6d3699-cfc80a59-67584725-8368fd57_0 is DEAD
2025-10-10T14:34:09.583547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:09.583895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6d3699-cfc80a59-67584725-8368fd57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.583935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:09.583953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1239
2025-10-10T14:34:09.584116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.584151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:09.584157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:09.584166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:09.584562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1239 sessionId:  describe result for acl check
2025-10-10T14:34:09.584597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:09.584599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:09.584601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:09.584606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601356238552118:3044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:09.585134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:09.585175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601356238552118:3044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:09.585348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:09.585361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:09.585374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:09.585447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:09.585491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601355456329281:7622]
2025-10-10T14:34:09.586066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:09.586342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:09.586399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:09.586724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:09.586789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.586794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.586796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.586797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.586798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.586799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.586800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.586802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.586803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.586805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.586806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.586807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.586808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.586814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.586827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.586831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.586834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.586838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.586842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.586846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.586850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.586854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.586857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.586861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.586865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.586868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.586877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.586885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.586896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.586901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.586909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.586914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.586919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.586929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.586934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.586943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.586947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.586952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.586961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.586966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.586976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.586981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.586985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.586991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.586998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.587004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.587008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.587014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.587022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.587029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.587038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.587043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.587088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:09.587295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601356238552118:3044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:09.589460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:09.589757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:09.589769Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:09.589771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:09.589774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:09.589782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1238 [2:7559601355456329281:7622]
2025-10-10T14:34:09.589794Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:09.589809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:09.589814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.589818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.589820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.589836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:09.589849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:09.589860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:09.589912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.589918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.589920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.589923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:09.589990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:09.589998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.590010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.590022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.590044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:09.590051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601356238552118:3044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:09.590070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552084:2438], now have 1 active actors on pipe
2025-10-10T14:34:09.590066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601356238552118:3044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:09.590083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601355456329276:7622]
2025-10-10T14:34:09.590085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601355456329276:7622]
2025-10-10T14:34:09.590087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601355456329276:7622]
2025-10-10T14:34:09.590071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601356238552118:3044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:09.590079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:09.590101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:09.590117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:09.590122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:09.590126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:09.590128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:09.590140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:09.590144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:09.590116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1238
2025-10-10T14:34:09.590166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601355456329276:7622]
2025-10-10T14:34:09.590175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:09.590178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:09.590268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552152:3044], now have 1 active actors on pipe
2025-10-10T14:34:09.590312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1238
2025-10-10T14:34:09.590425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.590435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.590467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:09.590480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.590488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.590491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:09.590503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.590520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:09.590551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.590741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.590751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.590773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.590856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1239 partition: 0 MaxSeqNo: 40 sessionId: src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0
2025-10-10T14:34:09.591226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6d3699-cfc80a59-67584725-8368fd57_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:09.594091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0] Write session: try to update token
2025-10-10T14:34:09.594111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:09.608267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId: src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:09.609675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:09.609691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:09.609694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:09.609695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:09.609705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601355456329276:7622]
2025-10-10T14:34:09.609710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601355456329276:7622]
2025-10-10T14:34:09.609714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601355456329276:7622]
2025-10-10T14:34:09.609764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:09.609773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:09.609775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.609780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:09.609781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:09.609784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:09.609917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:09.610886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:09.674427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601356238552170:3347]
2025-10-10T14:34:09.674677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1238, pipe: [1:7559601356238552170:3347]
2025-10-10T14:34:09.726682Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:09.726952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.726971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.727035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552170:3347], now have 1 active actors on pipe
2025-10-10T14:34:09.727263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:09.727292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601356238552170:3347]
2025-10-10T14:34:09.727312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:09.727327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:09.727413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1239 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0
2025-10-10T14:34:09.727654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1239 sessionId: src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0 is DEAD
2025-10-10T14:34:09.727820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:09.727832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0] Write session will restart in 0.006347s
2025-10-10T14:34:09.727858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0] Write session: Do CDS request
2025-10-10T14:34:09.727864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:09.736054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.736201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:09.736230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1240
2025-10-10T14:34:09.736347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.736382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:09.736392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:09.736395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:09.736426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:09.736834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1240 sessionId:  describe result for acl check
2025-10-10T14:34:09.736874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:09.736883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:09.736885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:09.736891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601356238552205:3038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:09.737480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601356238552205:3038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:09.738101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:09.738329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:09.738342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:09.738358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:09.738429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:09.738478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601355456329356:7625]
2025-10-10T14:34:09.739058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:09.739338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601356238552205:3038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:09.739370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:09.739423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:09.739790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:09.739861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.739868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.739869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.739870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.739871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.739873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.739874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.739876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.739877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.739878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.739879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.739882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.739884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.739891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.739904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.739908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.739912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.739916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.739920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.739924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.739928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.739932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.739936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.739940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.739944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.739948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.739956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.739964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.739971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.739976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.739981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.739986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.739991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.739998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.740008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.740014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.740018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.740023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.740030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.740041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.740045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.740051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.740056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.740062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.740066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.740072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.740077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.740086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.740091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.740096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.740105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.740111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.740157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:09.742435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601356238552205:3038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:09.742451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601356238552205:3038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:09.742454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601356238552205:3038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:09.742462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:09.742489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:09.742810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:09.742820Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:09.742823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:09.742827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:09.742833Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1239 [2:7559601355456329356:7625]
2025-10-10T14:34:09.742844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:09.742860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:09.742863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.742867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.742870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.742885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:09.742897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:09.742904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:09.742962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.742973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.742975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.742977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:09.743040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:09.743048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.743060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.743078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.743097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:09.743123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552171:2438], now have 1 active actors on pipe
2025-10-10T14:34:09.743132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552240:3038], now have 1 active actors on pipe
2025-10-10T14:34:09.743139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601355456329351:7625]
2025-10-10T14:34:09.743141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601355456329351:7625]
2025-10-10T14:34:09.743143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601355456329351:7625]
2025-10-10T14:34:09.743156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:09.743174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:09.743175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:09.743176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:09.743178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:09.743194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:09.743192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1239
2025-10-10T14:34:09.743198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:09.743194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1239
2025-10-10T14:34:09.743217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601355456329351:7625]
2025-10-10T14:34:09.743220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:09.743231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:09.743252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.743257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.743297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80590aae-8d5f672d-e78b8766-2a22875e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:09.743309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.743313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.743321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:09.743332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.743342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:09.743359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.743557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.743568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.743595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.743677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1240 partition: 0 MaxSeqNo: 40 sessionId: src_id|80590aae-8d5f672d-e78b8766-2a22875e_0
2025-10-10T14:34:09.744023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4851ae5b-cf362b2d-e34806ee-a2684ee7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80590aae-8d5f672d-e78b8766-2a22875e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:09.746763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80590aae-8d5f672d-e78b8766-2a22875e_0] Write session: try to update token
2025-10-10T14:34:09.746783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80590aae-8d5f672d-e78b8766-2a22875e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:09.762126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId: src_id|80590aae-8d5f672d-e78b8766-2a22875e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:09.762697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:09.762715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:09.762718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:09.762720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:09.762730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601355456329351:7625]
2025-10-10T14:34:09.762735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601355456329351:7625]
2025-10-10T14:34:09.762739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601355456329351:7625]
2025-10-10T14:34:09.762797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:09.762803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:09.762809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:09.762812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.762814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:09.762815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:09.762965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:09.764866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:09.827508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601356238552248:3347]
2025-10-10T14:34:09.827845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1239, pipe: [1:7559601356238552248:3347]
2025-10-10T14:34:09.886171Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:09.886523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.886537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.886583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552248:3347], now have 1 active actors on pipe
2025-10-10T14:34:09.886792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:09.886811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:09.886814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:09.886817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:09.886871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601356238552248:3347]
2025-10-10T14:34:09.886884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1240 reason: error at write: Disconnected sessionId: src_id|80590aae-8d5f672d-e78b8766-2a22875e_0
2025-10-10T14:34:09.887147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1240 sessionId: src_id|80590aae-8d5f672d-e78b8766-2a22875e_0 is DEAD
2025-10-10T14:34:09.887288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80590aae-8d5f672d-e78b8766-2a22875e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:09.887298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80590aae-8d5f672d-e78b8766-2a22875e_0] Write session will restart in 0.005857s
2025-10-10T14:34:09.887322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80590aae-8d5f672d-e78b8766-2a22875e_0] Write session: Do CDS request
2025-10-10T14:34:09.887332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80590aae-8d5f672d-e78b8766-2a22875e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:09.894950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80590aae-8d5f672d-e78b8766-2a22875e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.895006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:09.895021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1241
2025-10-10T14:34:09.895276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:09.895327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:09.895337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:09.895341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:09.895418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:09.895747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1241 sessionId:  describe result for acl check
2025-10-10T14:34:09.895776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:09.895782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:09.895784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:09.895788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601356238552285:3032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:09.896248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601356238552285:3032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:09.897034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:09.897225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:09.897236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:09.897248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:09.897298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:09.897358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601355456329430:7627]
2025-10-10T14:34:09.897880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:09.898157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601356238552285:3032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:09.898176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:09.898221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:09.898467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:09.898512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.898517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.898518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.898519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.898520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.898520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.898521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.898525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.898525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.898526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.898527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.898527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.898528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.898532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.898540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.898542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.898545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.898547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.898549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.898552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.898554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.898556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.898559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.898561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.898563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.898565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.898571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.898577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:09.898581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.898585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:09.898587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.898590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:09.898594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.898597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:09.898601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.898604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:09.898607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.898610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:09.898613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.898616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:09.898621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.898626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:09.898630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.898635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:09.898638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.898643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:09.898648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.898652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.898656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.898662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.898667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.898672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.898704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:09.901024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601356238552285:3032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:09.901042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601356238552285:3032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:09.901046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601356238552285:3032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:09.901055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:09.901092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:09.901432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:09.901446Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:09.901451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:09.901455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:09.901462Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1240 [2:7559601355456329430:7627]
2025-10-10T14:34:09.901474Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:09.901494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:09.901502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.901505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.901508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.901525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:09.901540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:09.901548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:09.901626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.901633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.901635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.901637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:09.901709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:09.901721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.901734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:09.901746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:09.901764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:09.901793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552249:2438], now have 1 active actors on pipe
2025-10-10T14:34:09.901805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552319:3032], now have 1 active actors on pipe
2025-10-10T14:34:09.901813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601355456329425:7627]
2025-10-10T14:34:09.901816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601355456329425:7627]
2025-10-10T14:34:09.901827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1240
2025-10-10T14:34:09.901818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601355456329425:7627]
2025-10-10T14:34:09.901833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1240
2025-10-10T14:34:09.901831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:09.901847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:09.901854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:09.901858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:09.901860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:09.901865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:09.901870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:09.901895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601355456329425:7627]
2025-10-10T14:34:09.901898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:09.901909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:09.901920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.901925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.901967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:09.901981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:09.901985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:09.901988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:09.902000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:09.902020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:09.902041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.902198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:09.902205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:09.902219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:09.902316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1241 partition: 0 MaxSeqNo: 40 sessionId: src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0
2025-10-10T14:34:09.902733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80590aae-8d5f672d-e78b8766-2a22875e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:09.905552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0] Write session: try to update token
2025-10-10T14:34:09.905570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:09.919573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId: src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:09.921540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:09.921557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:09.921560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:09.921562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:09.921571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601355456329425:7627]
2025-10-10T14:34:09.921575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601355456329425:7627]
2025-10-10T14:34:09.921578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601355456329425:7627]
2025-10-10T14:34:09.921629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:09.921629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:09.921636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:09.921637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:09.921639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:09.921641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:09.921776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:09.922327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:09.986756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601356238552332:3347]
2025-10-10T14:34:09.986982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1240, pipe: [1:7559601356238552332:3347]
2025-10-10T14:34:10.038444Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:10.038874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.038904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.038955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601356238552332:3347], now have 1 active actors on pipe
2025-10-10T14:34:10.039187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:10.039240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601356238552332:3347]
2025-10-10T14:34:10.039325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:10.039348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:10.039362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:10.039424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1241 reason: error at write: Disconnected sessionId: src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0
2025-10-10T14:34:10.039657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1241 sessionId: src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0 is DEAD
2025-10-10T14:34:10.039820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:10.039829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0] Write session will restart in 0.005348s
2025-10-10T14:34:10.039852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0] Write session: Do CDS request
2025-10-10T14:34:10.039856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:10.046863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.046941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:10.046961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1242
2025-10-10T14:34:10.047080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.047131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:10.047142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:10.047146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:10.047596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1242 sessionId:  describe result for acl check
2025-10-10T14:34:10.047635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:10.047637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:10.047640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:10.047645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601360533519663:3028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:10.048201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601360533519663:3028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:10.048876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:10.050353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601360533519663:3028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:10.050819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:10.051056Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:10.051069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:10.051082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:10.051144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:10.051190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601359751296803:7629]
2025-10-10T14:34:10.051769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:10.052086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:10.052133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:10.052473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:10.052534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.052543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.052544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.052545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.052547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.052548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.052549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.052550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.052551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.052552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.052554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.052555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.052556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.052562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.052575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.052579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.052582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.052589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.052593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.052597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.052600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.052604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.052608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.052612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.052615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.052619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.052626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.052635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.052641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.052647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.052651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.052657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.052661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.052667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.052684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.052691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.052695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.052700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.052704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.052708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.052713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.052718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.052722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.052728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.052733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.052738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.052742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.052747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.052753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.052758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.052762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.052767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.052807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:10.053010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601360533519663:3028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:10.053025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601360533519663:3028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:10.053029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601360533519663:3028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:10.053038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:10.055187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:10.055623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:10.055642Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:10.055644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:10.055649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:10.055655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1241 [2:7559601359751296803:7629]
2025-10-10T14:34:10.055669Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:10.055687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:10.055690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.055694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.055696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.055712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:10.055729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:10.055736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:10.055797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.055806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.055808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.055810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:10.055888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:10.055896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.055906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.055917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.055937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:10.055962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519629:2438], now have 1 active actors on pipe
2025-10-10T14:34:10.055970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519700:3028], now have 1 active actors on pipe
2025-10-10T14:34:10.055978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601359751296798:7629]
2025-10-10T14:34:10.055980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601359751296798:7629]
2025-10-10T14:34:10.055982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601359751296798:7629]
2025-10-10T14:34:10.055997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:10.056011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:10.056016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:10.056020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:10.055997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1241
2025-10-10T14:34:10.056022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:10.056032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:10.056021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1241
2025-10-10T14:34:10.056036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:10.056080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.056092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.056108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601359751296798:7629]
2025-10-10T14:34:10.056116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:10.056148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:10.056151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:10.056158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.056162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.056165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:10.056176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.056193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:10.056218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.056364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.056372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.056388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.056469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1242 partition: 0 MaxSeqNo: 40 sessionId: src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0
2025-10-10T14:34:10.056913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c312aa-efa110ae-bb6a81c8-1acf28b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:10.059661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0] Write session: try to update token
2025-10-10T14:34:10.059682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:10.074687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId: src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:10.075696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:10.075714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.075718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:10.075720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:10.075729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601359751296798:7629]
2025-10-10T14:34:10.075733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601359751296798:7629]
2025-10-10T14:34:10.075737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601359751296798:7629]
2025-10-10T14:34:10.075790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:10.075792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:10.075799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:10.075803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:10.075803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.075805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:10.075941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:10.077392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:10.139326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601360533519731:3347]
2025-10-10T14:34:10.139593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1241, pipe: [1:7559601360533519731:3347]
2025-10-10T14:34:10.192698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:10.193040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.193055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.193102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519731:3347], now have 1 active actors on pipe
2025-10-10T14:34:10.193375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:10.193385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:10.193412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601360533519731:3347]
2025-10-10T14:34:10.193436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:10.193516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1242 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0
2025-10-10T14:34:10.193732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1242 sessionId: src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0 is DEAD
2025-10-10T14:34:10.193894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:10.193906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0] Write session will restart in 0.007010s
2025-10-10T14:34:10.193932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0] Write session: Do CDS request
2025-10-10T14:34:10.193939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:10.201940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.202040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:10.202076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1243
2025-10-10T14:34:10.202202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.202238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:10.202252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:10.202256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:10.202708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1243 sessionId:  describe result for acl check
2025-10-10T14:34:10.202749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:10.202751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:10.202753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:10.202759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601360533519770:3013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:10.203121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:10.203357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601360533519770:3013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:10.205041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:10.205295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:10.205308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:10.205322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:10.205400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:10.205447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601359751296918:7644]
2025-10-10T14:34:10.205839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601360533519770:3013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:10.206083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:10.206402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:10.206468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:10.206821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:10.206905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.206915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.206917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.206918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.206919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.206920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.206921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.206923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.206924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.206925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.206926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.206928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.206929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.206937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.206950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.206954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.206959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.206963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.206968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.206972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.206976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.206982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.206986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.206990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.206994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.206998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.207006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.207015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.207022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.207028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.207032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.207039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.207044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.207049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.207056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.207062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.207067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.207078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.207083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.207089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.207099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.207104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.207109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.207114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.207119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.207128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.207134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.207144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.207149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.207158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.207163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.207173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.207214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:10.209713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601360533519770:3013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:10.209728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601360533519770:3013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:10.209731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601360533519770:3013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:10.209740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:10.209808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:10.210273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:10.210286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:10.210288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:10.210293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:10.210301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1242 [2:7559601359751296918:7644]
2025-10-10T14:34:10.210314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:10.210332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:10.210341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.210345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.210348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.210366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:10.210379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:10.210388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:10.210452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.210459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.210461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.210464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:10.210540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:10.210547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.210558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.210568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.210584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:10.210607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519733:2438], now have 1 active actors on pipe
2025-10-10T14:34:10.210614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519804:3013], now have 1 active actors on pipe
2025-10-10T14:34:10.210622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601359751296912:7644]
2025-10-10T14:34:10.210626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601359751296912:7644]
2025-10-10T14:34:10.210627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601359751296912:7644]
2025-10-10T14:34:10.210642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:10.210661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:10.210653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1242
2025-10-10T14:34:10.210673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:10.210666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1242
2025-10-10T14:34:10.210676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:10.210678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:10.210680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:10.210683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:10.210718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601359751296912:7644]
2025-10-10T14:34:10.210732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:10.210753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.210754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:10.210762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.210807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6083574-cd30e442-5e44851e-3188f333_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:10.210818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.210821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.210823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:10.210833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.210841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:10.210860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.211065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.211074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.211090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.211178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1243 partition: 0 MaxSeqNo: 40 sessionId: src_id|a6083574-cd30e442-5e44851e-3188f333_0
2025-10-10T14:34:10.211585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97dd0b7-7f430bc0-4278593e-4ffab7ea_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a6083574-cd30e442-5e44851e-3188f333_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:10.214286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6083574-cd30e442-5e44851e-3188f333_0] Write session: try to update token
2025-10-10T14:34:10.214304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6083574-cd30e442-5e44851e-3188f333_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:10.228532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId: src_id|a6083574-cd30e442-5e44851e-3188f333_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:10.230596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:10.230613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.230616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:10.230618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:10.230628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601359751296912:7644]
2025-10-10T14:34:10.230633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601359751296912:7644]
2025-10-10T14:34:10.230638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601359751296912:7644]
2025-10-10T14:34:10.230684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:10.230690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:10.230694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:10.230695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:10.230701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.230703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:10.230835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:10.231417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:10.293428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601360533519812:3347]
2025-10-10T14:34:10.293768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1242, pipe: [1:7559601360533519812:3347]
2025-10-10T14:34:10.342818Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:10.343103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.343118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.343164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519812:3347], now have 1 active actors on pipe
2025-10-10T14:34:10.343402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:10.343488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601360533519812:3347]
2025-10-10T14:34:10.343507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:10.343526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:10.343628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1243 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6083574-cd30e442-5e44851e-3188f333_0
2025-10-10T14:34:10.343835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1243 sessionId: src_id|a6083574-cd30e442-5e44851e-3188f333_0 is DEAD
2025-10-10T14:34:10.344022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6083574-cd30e442-5e44851e-3188f333_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:10.344033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6083574-cd30e442-5e44851e-3188f333_0] Write session will restart in 0.009354s
2025-10-10T14:34:10.344067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6083574-cd30e442-5e44851e-3188f333_0] Write session: Do CDS request
2025-10-10T14:34:10.344074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6083574-cd30e442-5e44851e-3188f333_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:10.351408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:10.352897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:10.353078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:10.353088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:10.353100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:10.353152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:10.353193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601359751296994:7646]
2025-10-10T14:34:10.353830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:10.354107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:10.354147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:10.354459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:10.354515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.354522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.354523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.354524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.354526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.354527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.354528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.354529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.354530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.354531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.354532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.354533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.354535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.354540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.354553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.354557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.354562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.354566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.354570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.354574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.354578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.354582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.354586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.354591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.354595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.354599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.354607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.354615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.354622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.354632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.354636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.354641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.354645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.354656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.354660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.354667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.354676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.354681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.354686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.354695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.354700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.354705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.354714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.354720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.354723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.354734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.354738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.354749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.354753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.354759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.354767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.354773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.354816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:10.354856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6083574-cd30e442-5e44851e-3188f333_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.354882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:10.354898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1244
2025-10-10T14:34:10.355104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.355136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:10.355146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:10.355150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:10.355586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1244 sessionId:  describe result for acl check
2025-10-10T14:34:10.355638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:10.355647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:10.355649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:10.355656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601360533519858:3003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:10.356220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601360533519858:3003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:10.357023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:10.357448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:10.357460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:10.357462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:10.357466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:10.357473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1243 [2:7559601359751296994:7646]
2025-10-10T14:34:10.357483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:10.357499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:10.357506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.357510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.357513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.357529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:10.357540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:10.357547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:10.357603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.357610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.357611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.357614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:10.357677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:10.357685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.357698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.357709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.357729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:10.357753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519814:2438], now have 1 active actors on pipe
2025-10-10T14:34:10.357764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601359751296989:7646]
2025-10-10T14:34:10.357767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601359751296989:7646]
2025-10-10T14:34:10.357769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601359751296989:7646]
2025-10-10T14:34:10.357757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1243
2025-10-10T14:34:10.357778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:10.357795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:10.357795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:10.357798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:10.357800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:10.357815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:10.357818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:10.357843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601359751296989:7646]
2025-10-10T14:34:10.357858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:10.357877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:10.358433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601360533519858:3003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:10.364639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601360533519858:3003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:10.364673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601360533519858:3003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:10.364677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601360533519858:3003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:10.364685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:10.364939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519891:3003], now have 1 active actors on pipe
2025-10-10T14:34:10.364999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1243
2025-10-10T14:34:10.365124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.365136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.365170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc487213-45d8a510-33cf60db-3939095c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:10.365186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.365206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.365212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:10.365228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.365251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:10.365276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.365448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.365456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.365472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.365570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1244 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc487213-45d8a510-33cf60db-3939095c_0
2025-10-10T14:34:10.365941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6083574-cd30e442-5e44851e-3188f333_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc487213-45d8a510-33cf60db-3939095c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:10.368643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc487213-45d8a510-33cf60db-3939095c_0] Write session: try to update token
2025-10-10T14:34:10.368659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc487213-45d8a510-33cf60db-3939095c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:10.369169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:10.369180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.369190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601359751296989:7646]
2025-10-10T14:34:10.369245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:10.369244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:10.369447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:10.369639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.369816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.369951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.370133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:10.370177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:10.382698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId: src_id|cc487213-45d8a510-33cf60db-3939095c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:10.385460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:10.385698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.385718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.385763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:10.385845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:10.387653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:10.387672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.387675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:10.387677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:10.387690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601359751296989:7646]
2025-10-10T14:34:10.387697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601359751296989:7646]
2025-10-10T14:34:10.387700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601359751296989:7646]
2025-10-10T14:34:10.387764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:10.387780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.387783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:10.387908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:10.387917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:10.387924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:10.387929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:10.443479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601360533519894:3347]
2025-10-10T14:34:10.443799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1243, pipe: [1:7559601360533519894:3347]
2025-10-10T14:34:10.503985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:10.512050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.512077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.512263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.512326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.512390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.512458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.512507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.512520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.512590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.512654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.512731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.512796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.512840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.512847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.512921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.512988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.513054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.513122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.513168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.513177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.513246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.513313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.513396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.513462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.513515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.513523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.513594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.513655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.513718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.513784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.513828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.513835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.513901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.513965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.514033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.514106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.514155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.514163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.514236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.514305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.514373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.514441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.514489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.514497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.514569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.514632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.514694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.514764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.514811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.514821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.514894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.514957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.515030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.515098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.515151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.515159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.515229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.515292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.515359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.515429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.515479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.515487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.515553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519894:3347], now have 1 active actors on pipe
2025-10-10T14:34:10.515755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:10.515773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:10.515805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1244 reason: error at write: Disconnected sessionId: src_id|cc487213-45d8a510-33cf60db-3939095c_0
2025-10-10T14:34:10.515820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601360533519894:3347]
2025-10-10T14:34:10.515861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:10.516044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1244 sessionId: src_id|cc487213-45d8a510-33cf60db-3939095c_0 is DEAD
2025-10-10T14:34:10.516213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc487213-45d8a510-33cf60db-3939095c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:10.516221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc487213-45d8a510-33cf60db-3939095c_0] Write session will restart in 0.006077s
2025-10-10T14:34:10.516246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc487213-45d8a510-33cf60db-3939095c_0] Write session: Do CDS request
2025-10-10T14:34:10.516261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc487213-45d8a510-33cf60db-3939095c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:10.516616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:10.523872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc487213-45d8a510-33cf60db-3939095c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.523917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:10.523931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1245
2025-10-10T14:34:10.524099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.524135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:10.524146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:10.524150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:10.524582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1245 sessionId:  describe result for acl check
2025-10-10T14:34:10.524619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:10.524625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:10.524627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:10.524633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601360533519948:2998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:10.524721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:10.525123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601360533519948:2998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:10.526507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:10.526707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:10.526719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:10.526731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:10.526778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:10.526819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601359751297084:7649]
2025-10-10T14:34:10.527456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:10.527683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:10.527721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:10.527736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601360533519948:2998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:10.528035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:10.528117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.528124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.528126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.528127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.528128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.528129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.528130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.528132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.528133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.528134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.528135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.528136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.528137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.528143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.528155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.528159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.528162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.528166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.528169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.528174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.528178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.528182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.528186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.528190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.528194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.528198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.528205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.528213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.528223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.528228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.528233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.528238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.528243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.528248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.528252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.528257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.528261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.528267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.528271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.528277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.528287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.528293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.528297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.528307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.528312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.528318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.528322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.528327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.528337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.528344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.528352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.528357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.528396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:10.530552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601360533519948:2998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:10.530566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601360533519948:2998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:10.530569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601360533519948:2998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:10.530576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:10.530625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:10.530952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:10.530963Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:10.530967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:10.530970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:10.530975Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1244 [2:7559601359751297084:7649]
2025-10-10T14:34:10.530987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:10.531003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:10.531013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.531016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.531018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.531034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:10.531042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:10.531049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:10.531100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.531107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.531109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.531111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:10.531172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:10.531178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.531190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.531206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.531227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:10.531266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519908:2438], now have 1 active actors on pipe
2025-10-10T14:34:10.531274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519983:2998], now have 1 active actors on pipe
2025-10-10T14:34:10.531282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601359751297079:7649]
2025-10-10T14:34:10.531266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1244
2025-10-10T14:34:10.531284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601359751297079:7649]
2025-10-10T14:34:10.531273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1244
2025-10-10T14:34:10.531286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601359751297079:7649]
2025-10-10T14:34:10.531295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:10.531307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:10.531318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:10.531325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:10.531325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:10.531327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:10.531328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:10.531370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.531380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.531398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601359751297079:7649]
2025-10-10T14:34:10.531408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:10.531415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:10.531444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44766b87-32d8b21a-920b1ff4-83834036_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:10.531457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.531464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.531466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:10.531475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.531486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:10.531511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.531663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.531669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.531680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.531770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1245 partition: 0 MaxSeqNo: 40 sessionId: src_id|44766b87-32d8b21a-920b1ff4-83834036_0
2025-10-10T14:34:10.532093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc487213-45d8a510-33cf60db-3939095c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44766b87-32d8b21a-920b1ff4-83834036_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:10.534669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44766b87-32d8b21a-920b1ff4-83834036_0] Write session: try to update token
2025-10-10T14:34:10.534685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44766b87-32d8b21a-920b1ff4-83834036_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:10.549096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId: src_id|44766b87-32d8b21a-920b1ff4-83834036_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:10.550959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:10.550977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.550981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:10.550983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:10.550993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601359751297079:7649]
2025-10-10T14:34:10.550998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601359751297079:7649]
2025-10-10T14:34:10.551002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601359751297079:7649]
2025-10-10T14:34:10.551046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:10.551052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:10.551058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:10.551060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.551062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:10.551063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:10.551202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:10.551851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:10.615997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601360533519999:3347]
2025-10-10T14:34:10.616336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1244, pipe: [1:7559601360533519999:3347]
2025-10-10T14:34:10.666671Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:10.666976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.666994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.667052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533519999:3347], now have 1 active actors on pipe
2025-10-10T14:34:10.667293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:10.667302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601360533519999:3347]
2025-10-10T14:34:10.667329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:10.667332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:10.667295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:10.667410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1245 reason: error at write: Disconnected sessionId: src_id|44766b87-32d8b21a-920b1ff4-83834036_0
2025-10-10T14:34:10.667652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1245 sessionId: src_id|44766b87-32d8b21a-920b1ff4-83834036_0 is DEAD
2025-10-10T14:34:10.667813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44766b87-32d8b21a-920b1ff4-83834036_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:10.667837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44766b87-32d8b21a-920b1ff4-83834036_0] Write session will restart in 0.009765s
2025-10-10T14:34:10.667861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44766b87-32d8b21a-920b1ff4-83834036_0] Write session: Do CDS request
2025-10-10T14:34:10.667870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44766b87-32d8b21a-920b1ff4-83834036_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:10.676704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:10.678336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:10.678575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:10.678586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:10.678598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:10.678659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:10.678706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601359751297165:7651]
2025-10-10T14:34:10.678960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44766b87-32d8b21a-920b1ff4-83834036_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.679020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:10.679036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1246
2025-10-10T14:34:10.679201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.679235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:10.679246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:10.679250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:10.679367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:10.679620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:10.679661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1246 sessionId:  describe result for acl check
2025-10-10T14:34:10.679666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:10.679699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:10.679705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:10.679707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:10.679712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601360533520048:2989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:10.679991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:10.680060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.680066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.680068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.680069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.680071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.680072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.680073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.680074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.680076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.680078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.680080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.680081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.680082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.680088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.680100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.680104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.680108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.680112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.680117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.680121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.680125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.680129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.680133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.680138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.680142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.680146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.680153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.680161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.680175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.680181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.680186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.680192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.680196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.680202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.680211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.680217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.680222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.680231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.680236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.680247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.680252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.680257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.680261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.680266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.680271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.680276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.680282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.680287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.680273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601360533520048:2989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:10.680296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.680301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.680306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.680311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.680363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:10.682625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601360533520048:2989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:10.682785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:10.683190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:10.683203Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:10.683205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:10.683209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:10.683215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1245 [2:7559601359751297165:7651]
2025-10-10T14:34:10.683223Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:10.683235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:10.683237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.683239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.683241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.683253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:10.683264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:10.683270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:10.683329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.683335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.683338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.683340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:10.683412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:10.683422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.683440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.683447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.683458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:10.683475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533520001:2438], now have 1 active actors on pipe
2025-10-10T14:34:10.683481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601359751297160:7651]
2025-10-10T14:34:10.683488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601359751297160:7651]
2025-10-10T14:34:10.683489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601359751297160:7651]
2025-10-10T14:34:10.683501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:10.683512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:10.683517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:10.683522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:10.683524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:10.683525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:10.683527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:10.683545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601359751297160:7651]
2025-10-10T14:34:10.683514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1245
2025-10-10T14:34:10.683563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:10.683568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:10.688556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601360533520048:2989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:10.688571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601360533520048:2989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:10.688575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601360533520048:2989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:10.688584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:10.688872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533520083:2989], now have 1 active actors on pipe
2025-10-10T14:34:10.688943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1245
2025-10-10T14:34:10.689010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.689024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.689057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|696fc93a-1fc75894-906424ad-23d2b708_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:10.689075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.689081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.689084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:10.689102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.689121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:10.689153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.689368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.689380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.689396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.689541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1246 partition: 0 MaxSeqNo: 40 sessionId: src_id|696fc93a-1fc75894-906424ad-23d2b708_0
2025-10-10T14:34:10.689943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44766b87-32d8b21a-920b1ff4-83834036_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|696fc93a-1fc75894-906424ad-23d2b708_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:10.692649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696fc93a-1fc75894-906424ad-23d2b708_0] Write session: try to update token
2025-10-10T14:34:10.692679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696fc93a-1fc75894-906424ad-23d2b708_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:10.694972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:10.694988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.694999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601359751297160:7651]
2025-10-10T14:34:10.695048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:10.695052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:10.695229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:10.695370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.695505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.695645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.695838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:10.695881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:10.707375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId: src_id|696fc93a-1fc75894-906424ad-23d2b708_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:10.710017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:10.710398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.710420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.710464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:10.710569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:10.713589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:10.713604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.713608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:10.713613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:10.713623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601359751297160:7651]
2025-10-10T14:34:10.713627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601359751297160:7651]
2025-10-10T14:34:10.713632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601359751297160:7651]
2025-10-10T14:34:10.713678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:10.713685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:10.713691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.713692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:10.713693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:10.713696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:10.713828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:10.767578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601360533520086:3347]
2025-10-10T14:34:10.767867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1245, pipe: [1:7559601360533520086:3347]
2025-10-10T14:34:10.824956Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:10.833443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.833475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.833665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.833725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.833784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.833847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.833960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.833969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.834030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.834085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.834147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.834206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.834247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.834252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.834315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.834376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.834444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.834504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.834546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.834552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.834624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.834692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.834751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.834811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.834971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.834985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.835097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.835195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.835292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.835409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.835459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.835469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.835545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.835618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.835736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.835841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.835898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.835907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.835981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.836055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.836132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.836210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.836273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.836284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.836365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.836434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.836515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.836595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.836663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.836671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.836756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.836836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.836910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.836990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.837046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.837053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.837133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:10.837211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:10.837296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:10.837395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:10.837447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:10.837455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:10.837523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533520086:3347], now have 1 active actors on pipe
2025-10-10T14:34:10.837762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:10.837805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:10.837809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:10.837831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601360533520086:3347]
2025-10-10T14:34:10.837843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1246 reason: error at write: Disconnected sessionId: src_id|696fc93a-1fc75894-906424ad-23d2b708_0
2025-10-10T14:34:10.838072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1246 sessionId: src_id|696fc93a-1fc75894-906424ad-23d2b708_0 is DEAD
2025-10-10T14:34:10.838243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696fc93a-1fc75894-906424ad-23d2b708_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:10.838253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696fc93a-1fc75894-906424ad-23d2b708_0] Write session will restart in 0.007066s
2025-10-10T14:34:10.838279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696fc93a-1fc75894-906424ad-23d2b708_0] Write session: Do CDS request
2025-10-10T14:34:10.838285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696fc93a-1fc75894-906424ad-23d2b708_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:10.838612Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:10.846572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:10.846892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|696fc93a-1fc75894-906424ad-23d2b708_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.846970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:10.846987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1247
2025-10-10T14:34:10.847140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:10.847176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:10.847186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:10.847190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:10.847619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1247 sessionId:  describe result for acl check
2025-10-10T14:34:10.847654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:10.847663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:10.847666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:10.847672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601360533520130:2984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:10.848006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:10.848199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:10.848210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:10.848222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:10.848219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601360533520130:2984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:10.848275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:10.848319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601359751297245:7654]
2025-10-10T14:34:10.848958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:10.849267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:10.849307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:10.849630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:10.849681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.849687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.849688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.849689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.849690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.849691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.849693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.849694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.849695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.849696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.849698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.849699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.849700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.849706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.849719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.849723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.849727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.849731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.849734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.849738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.849741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.849745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.849750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.849754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.849758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.849762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.849769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.849778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:10.849786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.849791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:10.849796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.849801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:10.849805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.849810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:10.849814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.849818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:10.849822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.849826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:10.849830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.849842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:10.849847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.849852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:10.849857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.849866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:10.849870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.849876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:10.849885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.849891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.849899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.849904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.849908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.849914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.849957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:10.850951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601360533520130:2984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:10.852318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:10.852712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:10.852723Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:10.852726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:10.852730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:10.852736Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1246 [2:7559601359751297245:7654]
2025-10-10T14:34:10.852748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:10.852767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:10.852770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.852773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.852775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.852791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:10.852799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:10.852807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:10.852859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.852867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.852868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.852871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:10.852935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:10.852943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.852954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:10.852970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:10.852993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:10.853018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533520088:2438], now have 1 active actors on pipe
2025-10-10T14:34:10.853030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601359751297240:7654]
2025-10-10T14:34:10.853036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601359751297240:7654]
2025-10-10T14:34:10.853038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601359751297240:7654]
2025-10-10T14:34:10.853052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:10.853056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1246
2025-10-10T14:34:10.853070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:10.853073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:10.853080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:10.853083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:10.853089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:10.853092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:10.853122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601359751297240:7654]
2025-10-10T14:34:10.853134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:10.853144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:10.853684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601360533520130:2984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:10.853698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601360533520130:2984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:10.853701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601360533520130:2984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:10.853710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:10.853910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533520167:2984], now have 1 active actors on pipe
2025-10-10T14:34:10.853986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1246
2025-10-10T14:34:10.854041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.854051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.854081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:10.854102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:10.854111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:10.854113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:10.854127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:10.854144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:10.854163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.854332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.854346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.854372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:10.854469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1247 partition: 0 MaxSeqNo: 40 sessionId: src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0
2025-10-10T14:34:10.854835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|696fc93a-1fc75894-906424ad-23d2b708_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:10.857457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0] Write session: try to update token
2025-10-10T14:34:10.857477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:10.864580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:10.864595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.864606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601359751297240:7654]
2025-10-10T14:34:10.864675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:10.864687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:10.864879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:10.865013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.865144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.865282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:10.865482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:10.865525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:10.871600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId: src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:10.874329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:10.874651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:10.874670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:10.874714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:10.874810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:10.883202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:10.883217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:10.883219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:10.883226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:10.883234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601359751297240:7654]
2025-10-10T14:34:10.883237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601359751297240:7654]
2025-10-10T14:34:10.883239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601359751297240:7654]
2025-10-10T14:34:10.883276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:10.883282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:10.883283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:10.883299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:10.883306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:10.883310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:10.883404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:10.938088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601360533520172:3347]
2025-10-10T14:34:10.938392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1246, pipe: [1:7559601360533520172:3347]
2025-10-10T14:34:10.993685Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:11.000314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.000334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.000490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.000544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.000616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.000687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.000729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.000738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.000799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.000858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.000923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.000980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.001026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.001030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.001095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.001157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.001221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.001286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.001350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.001360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.001424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.001479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.001535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.001608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.001658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.001664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.001731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.001792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.001855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.001915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.001956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.001963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.002029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.002094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.002157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.002218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.002259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.002264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.002321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.002372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.002437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.002499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.002543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.002549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.002608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.002665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.002725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.002780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.002819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.002828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.002896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.002955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.003008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.003063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.003103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.003111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.003174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.003233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.003291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.003346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.003386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.003393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.003446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601360533520172:3347], now have 1 active actors on pipe
2025-10-10T14:34:11.003707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:11.003778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601360533520172:3347]
2025-10-10T14:34:11.004165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:11.004179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:11.004209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1247 reason: error at write: Disconnected sessionId: src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0
2025-10-10T14:34:11.004383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:11.004480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1247 sessionId: src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0 is DEAD
2025-10-10T14:34:11.004608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:11.004620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0] Write session will restart in 0.008434s
2025-10-10T14:34:11.004653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0] Write session: Do CDS request
2025-10-10T14:34:11.004676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:11.011409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:11.013111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:11.013308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:11.013318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:11.013343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:11.013403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:11.013448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601364046264622:7656]
2025-10-10T14:34:11.013864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.013934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:11.013950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1248
2025-10-10T14:34:11.014028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:11.014090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.014131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:11.014142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:11.014146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:11.014306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:11.014350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:11.014539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1248 sessionId:  describe result for acl check
2025-10-10T14:34:11.014571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:11.014577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:11.014579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:11.014584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601364828487515:2979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:11.014666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:11.014719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.014725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.014726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.014727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.014728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.014729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.014730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.014731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.014732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.014734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.014735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.014736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.014738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.014744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.014757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.014774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.014780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.014784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.014788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.014792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.014796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.014800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.014805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.014809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.014813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.014817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.014825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.014834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.014841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.014847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.014856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.014861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.014866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.014872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.014881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.014886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.014891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.014898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.014903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.014912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.014916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.014922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.014930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.014935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.014941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.014949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.014955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.014964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.014968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.014974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.014978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.014987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.015028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:11.015126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601364828487515:2979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:11.017306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:11.017629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:11.017640Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:11.017643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:11.017646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:11.017654Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1247 [2:7559601364046264622:7656]
2025-10-10T14:34:11.017666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:11.017686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:11.017693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.017697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.017699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.017716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:11.017729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:11.017738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:11.017808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.017815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.017817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.017819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:11.017805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601364828487515:2979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:11.017881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:11.017891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.017902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.017916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.017940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:11.017962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487470:2438], now have 1 active actors on pipe
2025-10-10T14:34:11.017974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601364046264617:7656]
2025-10-10T14:34:11.017976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601364046264617:7656]
2025-10-10T14:34:11.017969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1247
2025-10-10T14:34:11.017978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601364046264617:7656]
2025-10-10T14:34:11.018000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:11.018004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:11.018007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:11.018009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:11.018019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:11.018036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:11.018041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:11.018072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601364046264617:7656]
2025-10-10T14:34:11.018082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:11.018088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:11.022957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601364828487515:2979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:11.022971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601364828487515:2979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:11.022975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601364828487515:2979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:11.022984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:11.023220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487551:2979], now have 1 active actors on pipe
2025-10-10T14:34:11.023252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1247
2025-10-10T14:34:11.023332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.023343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.023376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12f223d9-2f298c0a-42ef5147-d2891241_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:11.023406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.023418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.023421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:11.023436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.023453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:11.023474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.023654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.023666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.023680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.023791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1248 partition: 0 MaxSeqNo: 40 sessionId: src_id|12f223d9-2f298c0a-42ef5147-d2891241_0
2025-10-10T14:34:11.024196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|446ec57e-9bd14872-7ebdd1ba-82e8801e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12f223d9-2f298c0a-42ef5147-d2891241_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:11.026810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12f223d9-2f298c0a-42ef5147-d2891241_0] Write session: try to update token
2025-10-10T14:34:11.026829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12f223d9-2f298c0a-42ef5147-d2891241_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:11.029398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:11.029410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:11.029421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601364046264617:7656]
2025-10-10T14:34:11.029470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:11.029471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:11.029652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:11.029801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:11.029939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:11.030078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:11.030278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:11.030324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:11.040561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId: src_id|12f223d9-2f298c0a-42ef5147-d2891241_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:11.043143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:11.043346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.043364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.043409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:11.043483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:11.047319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:11.047333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:11.047338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:11.047342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:11.047350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601364046264617:7656]
2025-10-10T14:34:11.047353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601364046264617:7656]
2025-10-10T14:34:11.047355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601364046264617:7656]
2025-10-10T14:34:11.047392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:11.047398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.047399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:11.047401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:11.047407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:11.047411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:11.047526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:11.103982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601364828487555:3347]
2025-10-10T14:34:11.104258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1247, pipe: [1:7559601364828487555:3347]
2025-10-10T14:34:11.154596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:11.161153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.161173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.161315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.161394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.161452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.161508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.161550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.161557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.161618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.161671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.161727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.161785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.161826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.161833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.161894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.161948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.162005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.162061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.162170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.162176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.162232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.162288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.162342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.162397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.162437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.162442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.162499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.162553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.162607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.162661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.162843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.162850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.162906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.162965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.163022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.163079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.163117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.163122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.163181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.163233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.163293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.163347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.163385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.163390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.163462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.163519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.163575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.163629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.163677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.163687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.163754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.163808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.163862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.163918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.163957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.163962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.164020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:11.164073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:11.164126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:11.164179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:11.164223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:11.164228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:11.164268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487555:3347], now have 1 active actors on pipe
2025-10-10T14:34:11.164502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:11.164548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601364828487555:3347]
2025-10-10T14:34:11.164569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:11.164576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:11.164602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1248 reason: error at write: Disconnected sessionId: src_id|12f223d9-2f298c0a-42ef5147-d2891241_0
2025-10-10T14:34:11.164854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1248 sessionId: src_id|12f223d9-2f298c0a-42ef5147-d2891241_0 is DEAD
2025-10-10T14:34:11.164982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f223d9-2f298c0a-42ef5147-d2891241_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:11.164992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f223d9-2f298c0a-42ef5147-d2891241_0] Write session will restart in 0.006122s
2025-10-10T14:34:11.164974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:11.165026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f223d9-2f298c0a-42ef5147-d2891241_0] Write session: Do CDS request
2025-10-10T14:34:11.165032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f223d9-2f298c0a-42ef5147-d2891241_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:11.172937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12f223d9-2f298c0a-42ef5147-d2891241_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.173001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:11.173017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1249
2025-10-10T14:34:11.173002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:11.173191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.173229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:11.173240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:11.173243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:11.173733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1249 sessionId:  describe result for acl check
2025-10-10T14:34:11.173769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:11.173784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:11.173790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:11.173796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601364828487614:2962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:11.174355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601364828487614:2962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:11.174763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:11.174945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:11.174956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:11.174968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:11.175036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:11.175078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601364046264717:7664]
2025-10-10T14:34:11.175665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:11.175929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:11.175974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:11.176293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:11.176350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.176355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.176357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.176358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.176359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.176360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.176361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.176362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.176363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.176364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.176365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.176366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.176367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.176373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.176385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.176390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.176394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.176398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.176402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.176406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.176410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.176415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.176420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.176424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.176428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.176432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.176440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.176449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.176455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.176462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.176466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.176471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.176475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.176480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.176484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.176489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.176493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.176498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.176503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.176508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.176512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.176516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.176525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.176530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.176534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.176539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.176549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.176554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.176557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.176563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.176571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.176576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.176615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:11.176624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601364828487614:2962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:11.178873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601364828487614:2962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:11.178886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601364828487614:2962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:11.178889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601364828487614:2962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:11.178897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:11.178987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:11.179358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:11.179373Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:11.179375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:11.179381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:11.179386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1248 [2:7559601364046264717:7664]
2025-10-10T14:34:11.179397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:11.179417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:11.179425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.179429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.179432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.179448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:11.179462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:11.179469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:11.179533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.179540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.179542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.179545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:11.179610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:11.179618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.179631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.179648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.179669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:11.179695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487570:2438], now have 1 active actors on pipe
2025-10-10T14:34:11.179703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487647:2962], now have 1 active actors on pipe
2025-10-10T14:34:11.179710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601364046264712:7664]
2025-10-10T14:34:11.179712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601364046264712:7664]
2025-10-10T14:34:11.179716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601364046264712:7664]
2025-10-10T14:34:11.179729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:11.179712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1248
2025-10-10T14:34:11.179745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:11.179745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:11.179749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1248
2025-10-10T14:34:11.179749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:11.179751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:11.179765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:11.179768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:11.179812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.179825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.179839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601364046264712:7664]
2025-10-10T14:34:11.179848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:11.179861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:11.179884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:11.179897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.179905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.179907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:11.179918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.179934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:11.179962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.180271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.180284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.180304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.180390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1249 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0
2025-10-10T14:34:11.180780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12f223d9-2f298c0a-42ef5147-d2891241_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:11.183494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0] Write session: try to update token
2025-10-10T14:34:11.183513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:11.197294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId: src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:11.199566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:11.199581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:11.199584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:11.199585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:11.199593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601364046264712:7664]
2025-10-10T14:34:11.199596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601364046264712:7664]
2025-10-10T14:34:11.199598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601364046264712:7664]
2025-10-10T14:34:11.199650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:11.199658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.199658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:11.199662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:11.199665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:11.199669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:11.199786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:11.199930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:11.264726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601364828487666:3347]
2025-10-10T14:34:11.265017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1248, pipe: [1:7559601364828487666:3347]
2025-10-10T14:34:11.311129Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:11.311489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.311503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.311551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487666:3347], now have 1 active actors on pipe
2025-10-10T14:34:11.311843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:11.311854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:11.311877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:11.311880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:11.311901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601364828487666:3347]
2025-10-10T14:34:11.311944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1249 reason: error at write: Disconnected sessionId: src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0
2025-10-10T14:34:11.312164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1249 sessionId: src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0 is DEAD
2025-10-10T14:34:11.312361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:11.312373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0] Write session will restart in 0.006283s
2025-10-10T14:34:11.312398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0] Write session: Do CDS request
2025-10-10T14:34:11.312417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:11.319941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.319985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:11.320006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1250
2025-10-10T14:34:11.320198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.320235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:11.320247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:11.320251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:11.320706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1250 sessionId:  describe result for acl check
2025-10-10T14:34:11.320749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:11.320751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:11.320752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:11.320759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601364828487714:2949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:11.321312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:11.321349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601364828487714:2949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:11.322948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:11.323171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:11.323183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:11.323214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:11.323287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:11.323327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601364046264825:7673]
2025-10-10T14:34:11.323544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601364828487714:2949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:11.323793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:11.324079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:11.324141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:11.324597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:11.324738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.324747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.324748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.324749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.324750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.324751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.324752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.324754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.324755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.324756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.324757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.324758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.324762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.324770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.324784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.324788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.324792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.324796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.324799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.324803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.324806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.324810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.324813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.324817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.324820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.324823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.324831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.324840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.324847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.324859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.324864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.324869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.324879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.324884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.324889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.324893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.324897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.324906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.324911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.324916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.324925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.324930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.324938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.324944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.324948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.324952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.324956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.324961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.324964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.324970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.324975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.324980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.325019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:11.327301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:11.327310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601364828487714:2949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:11.327324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601364828487714:2949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:11.327327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601364828487714:2949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:11.327334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:11.327751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:11.327768Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:11.327771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:11.327775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:11.327782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1249 [2:7559601364046264825:7673]
2025-10-10T14:34:11.327797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:11.327818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:11.327821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.327825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.327827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.327846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:11.327862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:11.327877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:11.327945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.327951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.327954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.327956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:11.328025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:11.328033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.328046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.328064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.328088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:11.328117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487671:2438], now have 1 active actors on pipe
2025-10-10T14:34:11.328125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487750:2949], now have 1 active actors on pipe
2025-10-10T14:34:11.328110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1249
2025-10-10T14:34:11.328133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601364046264819:7673]
2025-10-10T14:34:11.328135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601364046264819:7673]
2025-10-10T14:34:11.328137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601364046264819:7673]
2025-10-10T14:34:11.328114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1249
2025-10-10T14:34:11.328146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:11.328157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:11.328159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:11.328161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:11.328166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:11.328182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:11.328193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:11.328231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.328241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.328255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601364046264819:7673]
2025-10-10T14:34:11.328267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:11.328287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:11.328302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:11.328310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.328315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.328321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:11.328333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.328348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:11.328372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.328507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.328515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.328529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.328615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1250 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0
2025-10-10T14:34:11.329009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d14be87-a24b86f7-94a35a9e-104a69dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:11.331683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0] Write session: try to update token
2025-10-10T14:34:11.331698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:11.346070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId: src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:11.347919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:11.347941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:11.347944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:11.347946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:11.347956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601364046264819:7673]
2025-10-10T14:34:11.347961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601364046264819:7673]
2025-10-10T14:34:11.347966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601364046264819:7673]
2025-10-10T14:34:11.348016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:11.348015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:11.348023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:11.348027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:11.348028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.348030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:11.348168Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:11.348714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:11.412194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601364828487757:3347]
2025-10-10T14:34:11.412479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1249, pipe: [1:7559601364828487757:3347]
2025-10-10T14:34:11.456973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:11.457353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.457370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.457415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487757:3347], now have 1 active actors on pipe
2025-10-10T14:34:11.457636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:11.457695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:11.457717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601364828487757:3347]
2025-10-10T14:34:11.457741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:11.457846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1250 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0
2025-10-10T14:34:11.458056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1250 sessionId: src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0 is DEAD
2025-10-10T14:34:11.458209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:11.458219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0] Write session will restart in 0.005046s
2025-10-10T14:34:11.458238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0] Write session: Do CDS request
2025-10-10T14:34:11.458243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:11.464810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.464912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:11.464930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1251
2025-10-10T14:34:11.465095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.465131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:11.465141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:11.465148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:11.465615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1251 sessionId:  describe result for acl check
2025-10-10T14:34:11.465654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:11.465660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:11.465662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:11.465669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601364828487802:2943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:11.466064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601364828487802:2943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:11.466274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:11.467592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601364828487802:2943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:11.468012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:11.468210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:11.468218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:11.468227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:11.468269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:11.468301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601364046264920:7675]
2025-10-10T14:34:11.468690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:11.468933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:11.468970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:11.469171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:11.469210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.469211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.469211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.469212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.469213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.469213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.469214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.469214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.469215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.469216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.469216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.469217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.469218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.469221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.469229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.469232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.469234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.469236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.469239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.469241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.469243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.469246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.469248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.469250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.469254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.469256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.469261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.469266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.469271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.469274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.469277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.469280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.469283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.469286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.469288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.469291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.469294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.469297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.469299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.469302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.469305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.469308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.469312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.469314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.469317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.469320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.469322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.469325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.469351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.469357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.469362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.469367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.469390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:11.470062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601364828487802:2943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:11.470076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601364828487802:2943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:11.470080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601364828487802:2943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:11.470088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:11.471649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:11.471969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:11.471980Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:11.471984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:11.471989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:11.471995Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1250 [2:7559601364046264920:7675]
2025-10-10T14:34:11.472008Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:11.472040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:11.472048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.472052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.472058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.472074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:11.472100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:11.472112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:11.472165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.472172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.472174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.472176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:11.472242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:11.472259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.472274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.472287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.472309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:11.472343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487838:2943], now have 1 active actors on pipe
2025-10-10T14:34:11.472352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487758:2438], now have 1 active actors on pipe
2025-10-10T14:34:11.472361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1250
2025-10-10T14:34:11.472359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601364046264904:7675]
2025-10-10T14:34:11.472365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1250
2025-10-10T14:34:11.472361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601364046264904:7675]
2025-10-10T14:34:11.472363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601364046264904:7675]
2025-10-10T14:34:11.472380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:11.472394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:11.472403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:11.472407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:11.472409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:11.472410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:11.472413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:11.472467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.472476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.472490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601364046264904:7675]
2025-10-10T14:34:11.472500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:11.472510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:11.472532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:11.472545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.472553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.472555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:11.472566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.472577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:11.472605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.472758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.472770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.472802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.472916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1251 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0
2025-10-10T14:34:11.473299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3074004-8d45fc34-d39cfdb2-f787fb81_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:11.476014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0] Write session: try to update token
2025-10-10T14:34:11.476031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:11.489485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId: src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:11.491494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:11.491511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:11.491515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:11.491517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:11.491526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601364046264904:7675]
2025-10-10T14:34:11.491531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601364046264904:7675]
2025-10-10T14:34:11.491535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601364046264904:7675]
2025-10-10T14:34:11.491580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:11.491585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:11.491587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:11.491595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.491597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:11.491601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:11.491733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:11.492072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:11.558115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601364828487858:3347]
2025-10-10T14:34:11.558433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1250, pipe: [1:7559601364828487858:3347]
2025-10-10T14:34:11.601895Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:11.602330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.602349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.602399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487858:3347], now have 1 active actors on pipe
2025-10-10T14:34:11.602636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:11.602703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:11.602708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601364828487858:3347]
2025-10-10T14:34:11.602729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:11.602799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1251 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0
2025-10-10T14:34:11.603026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1251 sessionId: src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0 is DEAD
2025-10-10T14:34:11.603224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:11.603231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0] Write session will restart in 0.005719s
2025-10-10T14:34:11.603251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0] Write session: Do CDS request
2025-10-10T14:34:11.603256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:11.609837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.609913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:11.609929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1252
2025-10-10T14:34:11.610068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.610114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:11.610125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:11.610129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:11.610560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1252 sessionId:  describe result for acl check
2025-10-10T14:34:11.610596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:11.610604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:11.610606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:11.610612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601364828487903:2937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:11.611138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601364828487903:2937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:11.612245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:11.613744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601364828487903:2937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:11.614056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:11.614268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:11.614280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:11.614292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:11.614349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:11.614390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601364046265004:7678]
2025-10-10T14:34:11.615011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:11.615314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:11.615358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:11.615660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:11.615725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.615731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.615732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.615733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.615734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.615736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.615737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.615738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.615739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.615740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.615741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.615742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.615744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.615749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.615763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.615767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.615771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.615776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.615780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.615784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.615790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.615794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.615798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.615802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.615805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.615809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.615816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.615825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.615836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.615842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.615846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.615852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.615860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.615865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.615870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.615880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.615885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.615890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.615900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.615905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.615910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.615919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.615924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.615930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.615938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.615943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.615948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.615954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.615959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.615967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.615972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.615978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.616020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:11.616057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601364828487903:2937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:11.616073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601364828487903:2937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:11.616077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601364828487903:2937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:11.616086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:11.618371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:11.618794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:11.618805Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:11.618807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:11.618811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:11.618817Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1251 [2:7559601364046265004:7678]
2025-10-10T14:34:11.618828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:11.618844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:11.618847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.618851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.618853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.618871Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:11.618882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:11.618890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:11.618951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.618959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.618961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.618963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:11.619026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:11.619033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.619046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.619062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.619082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:11.619107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487945:2937], now have 1 active actors on pipe
2025-10-10T14:34:11.619115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487862:2438], now have 1 active actors on pipe
2025-10-10T14:34:11.619123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601364046264999:7678]
2025-10-10T14:34:11.619125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601364046264999:7678]
2025-10-10T14:34:11.619127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601364046264999:7678]
2025-10-10T14:34:11.619142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:11.619160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:11.619163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:11.619168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:11.619170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:11.619181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:11.619184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:11.619167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1251
2025-10-10T14:34:11.619169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1251
2025-10-10T14:34:11.619206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601364046264999:7678]
2025-10-10T14:34:11.619216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:11.619219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:11.619244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.619248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.619282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:11.619294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.619298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.619300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:11.619311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.619324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:11.619347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.619506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.619520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.619561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.619663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1252 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0
2025-10-10T14:34:11.620063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5139b5-d0148ebb-ae440cda-cbca85e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:11.622772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0] Write session: try to update token
2025-10-10T14:34:11.622788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:11.636657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId: src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:11.638813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:11.638835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:11.638839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:11.638841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:11.638851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601364046264999:7678]
2025-10-10T14:34:11.638855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601364046264999:7678]
2025-10-10T14:34:11.638859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601364046264999:7678]
2025-10-10T14:34:11.638910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:11.638916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:11.638919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.638922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:11.638931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:11.638939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:11.639071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:11.639367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:11.703001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601364828487958:3347]
2025-10-10T14:34:11.703287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1251, pipe: [1:7559601364828487958:3347]
2025-10-10T14:34:11.748328Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:11.748571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.748584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.748633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487958:3347], now have 1 active actors on pipe
2025-10-10T14:34:11.748813Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:11.748905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:11.748933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:11.748967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601364828487958:3347]
2025-10-10T14:34:11.749043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1252 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0
2025-10-10T14:34:11.749293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1252 sessionId: src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0 is DEAD
2025-10-10T14:34:11.749491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:11.749503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0] Write session will restart in 0.006036s
2025-10-10T14:34:11.749527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0] Write session: Do CDS request
2025-10-10T14:34:11.749534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:11.757014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.757041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:11.757060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1253
2025-10-10T14:34:11.757264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.757346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:11.757362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:11.757365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:11.757850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1253 sessionId:  describe result for acl check
2025-10-10T14:34:11.757885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:11.757891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:11.757893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:11.757901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601364828488006:2929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:11.758301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:11.758528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601364828488006:2929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:11.760282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:11.760474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:11.760485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:11.760497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:11.760551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:11.760592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601364046265092:7681]
2025-10-10T14:34:11.760930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601364828488006:2929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:11.761229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:11.761561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:11.761614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:11.761943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:11.762013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.762020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.762021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.762022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.762024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.762025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.762026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.762028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.762029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.762030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.762032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.762033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.762036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.762042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.762054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.762059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.762063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.762067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.762072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.762076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.762080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.762084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.762089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.762093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.762097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.762101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.762108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.762117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.762129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.762136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.762145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.762151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.762161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.762166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.762171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.762176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.762181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.762188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.762198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.762203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.762213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.762219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.762228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.762241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.762250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.762261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.762270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.762281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.762290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.762300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.762306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.762312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.762355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:11.764701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601364828488006:2929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:11.764717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601364828488006:2929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:11.764721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601364828488006:2929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:11.764730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:11.764743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:11.765102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:11.765115Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:11.765117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:11.765121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:11.765128Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1252 [2:7559601364046265092:7681]
2025-10-10T14:34:11.765140Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:11.765156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:11.765165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.765169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.765172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.765188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:11.765201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:11.765214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:11.765275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.765282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.765284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.765287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:11.765370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:11.765380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.765392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.765410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.765432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:11.765458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828488041:2929], now have 1 active actors on pipe
2025-10-10T14:34:11.765467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828487959:2438], now have 1 active actors on pipe
2025-10-10T14:34:11.765475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601364046265087:7681]
2025-10-10T14:34:11.765482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601364046265087:7681]
2025-10-10T14:34:11.765484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601364046265087:7681]
2025-10-10T14:34:11.765498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:11.765494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1252
2025-10-10T14:34:11.765499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1252
2025-10-10T14:34:11.765514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:11.765520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:11.765524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:11.765526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:11.765536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:11.765544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:11.765584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.765593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.765608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601364046265087:7681]
2025-10-10T14:34:11.765624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:11.765643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:11.765661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:11.765674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.765684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.765686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:11.765697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.765713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:11.765743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.765975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.765984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.766002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.766088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1253 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0
2025-10-10T14:34:11.766478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1734d05-b18d4e74-a8226e47-c4b314c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:11.769228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0] Write session: try to update token
2025-10-10T14:34:11.769243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:11.785012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:11.785033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:11.785037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:11.785039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:11.785049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601364046265087:7681]
2025-10-10T14:34:11.785055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601364046265087:7681]
2025-10-10T14:34:11.785059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601364046265087:7681]
2025-10-10T14:34:11.785073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId: src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:11.785110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:11.785124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.785127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:11.785129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:11.785137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:11.785141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:11.785274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:11.787655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:11.848919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601364828488049:3347]
2025-10-10T14:34:11.849221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1252, pipe: [1:7559601364828488049:3347]
2025-10-10T14:34:11.899801Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:11.900138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.900156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.900203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828488049:3347], now have 1 active actors on pipe
2025-10-10T14:34:11.900451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:11.900442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601364828488049:3347]
2025-10-10T14:34:11.900463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:11.900467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:11.900476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:11.900548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1253 reason: error at write: Disconnected sessionId: src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0
2025-10-10T14:34:11.900767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1253 sessionId: src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0 is DEAD
2025-10-10T14:34:11.901143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:11.901153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0] Write session will restart in 0.007497s
2025-10-10T14:34:11.901180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0] Write session: Do CDS request
2025-10-10T14:34:11.901189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:11.909889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.909985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:11.909986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:11.910002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1254
2025-10-10T14:34:11.910138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:11.910171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:11.910182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:11.910185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:11.910633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1254 sessionId:  describe result for acl check
2025-10-10T14:34:11.910669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:11.910671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:11.910673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:11.910679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601364828488098:2915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:11.911237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601364828488098:2915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:11.911619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:11.911824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:11.911837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:11.911851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:11.911923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:11.911974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601364046265179:7683]
2025-10-10T14:34:11.912566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:11.913409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601364828488098:2915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:11.913633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:11.913696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:11.914055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:11.914129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.914138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.914139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.914140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.914142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.914143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.914144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.914145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.914146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.914148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.914149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.914150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.914152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.914159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.914172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.914176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.914180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.914184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.914190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.914194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.914198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.914202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.914207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.914212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.914216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.914220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.914228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.914237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:11.914244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.914250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:11.914255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.914260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:11.914265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.914270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:11.914276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.914281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:11.914285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.914291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:11.914295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.914300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:11.914304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.914309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:11.914314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.914319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:11.914323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.914329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:11.914342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.914347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.914356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.914362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.914372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.914378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.914422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:11.916732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601364828488098:2915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:11.916747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601364828488098:2915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:11.916751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601364828488098:2915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:11.916759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:11.916791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:11.917154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:11.917166Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:11.917168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:11.917172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:11.917179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1253 [2:7559601364046265179:7683]
2025-10-10T14:34:11.917192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:11.917208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:11.917217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.917223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.917225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.917244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:11.917256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:11.917283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:11.917367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.917375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.917377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.917379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:11.917450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:11.917458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.917469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:11.917486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:11.917508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:11.917536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828488133:2915], now have 1 active actors on pipe
2025-10-10T14:34:11.917545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601364828488050:2438], now have 1 active actors on pipe
2025-10-10T14:34:11.917552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601364046265174:7683]
2025-10-10T14:34:11.917556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601364046265174:7683]
2025-10-10T14:34:11.917557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601364046265174:7683]
2025-10-10T14:34:11.917575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:11.917569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1253
2025-10-10T14:34:11.917596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:11.917585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1253
2025-10-10T14:34:11.917598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:11.917602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:11.917604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:11.917615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:11.917618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:11.917658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.917668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.917683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601364046265174:7683]
2025-10-10T14:34:11.917696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:11.917710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:11.917735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:11.917748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:11.917752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:11.917754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:11.917766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:11.917777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:11.917799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.917980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:11.917989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:11.918007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:11.918087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1254 partition: 0 MaxSeqNo: 40 sessionId: src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0
2025-10-10T14:34:11.918488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f1441b4-b16a3dc0-d429ce50-dfaabf33_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:11.921243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0] Write session: try to update token
2025-10-10T14:34:11.921261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:11.935794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId: src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:11.937683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:11.937699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:11.937703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:11.937705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:11.937716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601364046265174:7683]
2025-10-10T14:34:11.937721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601364046265174:7683]
2025-10-10T14:34:11.937725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601364046265174:7683]
2025-10-10T14:34:11.937777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:11.937776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:11.937783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:11.937785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:11.937787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:11.937789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:11.937929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:11.938426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:12.000486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601369123455437:3347]
2025-10-10T14:34:12.000774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1253, pipe: [1:7559601369123455437:3347]
2025-10-10T14:34:12.051137Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:12.051470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.051484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.051535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455437:3347], now have 1 active actors on pipe
2025-10-10T14:34:12.051766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:12.051801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601369123455437:3347]
2025-10-10T14:34:12.051802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:12.051807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:12.051844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:12.051874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1254 reason: error at write: Disconnected sessionId: src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0
2025-10-10T14:34:12.052154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1254 sessionId: src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0 is DEAD
2025-10-10T14:34:12.052309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:12.052320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0] Write session will restart in 0.008325s
2025-10-10T14:34:12.052344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0] Write session: Do CDS request
2025-10-10T14:34:12.052350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:12.060005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:12.061979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.062083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:12.062100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1255
2025-10-10T14:34:12.062106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:12.062251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.062286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:12.062291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:12.062296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:12.062320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:12.062334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:12.062347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:12.062405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:12.062453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601368341232563:7685]
2025-10-10T14:34:12.062731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1255 sessionId:  describe result for acl check
2025-10-10T14:34:12.062769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:12.062773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:12.062775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:12.062781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601369123455488:2911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:12.063092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:12.063357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601369123455488:2911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:12.063396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:12.063443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:12.063757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:12.063823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.063829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.063830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.063831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.063832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.063833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.063834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.063835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.063836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.063837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.063839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.063840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.063841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.063847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.063858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.063863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.063867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.063871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.063875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.063879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.063883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.063888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.063894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.063898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.063902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.063905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.063912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.063920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.063926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.063932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.063936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.063942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.063948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.063954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.063958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.063970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.063974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.063980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.063985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.063990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.063995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.064007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.064012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.064021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.064026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.064031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.064040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.064044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.064048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.064053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.064062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.064067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.064110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:12.065499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601369123455488:2911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:12.066584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:12.066928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:12.066940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:12.066943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:12.066947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:12.066952Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1254 [2:7559601368341232563:7685]
2025-10-10T14:34:12.066965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:12.066982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:12.066985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.066988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.066992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.067010Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:12.067027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:12.067040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:12.067099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.067106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.067108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.067111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:12.067177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:12.067184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.067195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.067206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.067225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:12.067247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455438:2438], now have 1 active actors on pipe
2025-10-10T14:34:12.067257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601368341232558:7685]
2025-10-10T14:34:12.067262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601368341232558:7685]
2025-10-10T14:34:12.067266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601368341232558:7685]
2025-10-10T14:34:12.067279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:12.067294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:12.067295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:12.067300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:12.067302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:12.067281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1254
2025-10-10T14:34:12.067310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:12.067314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:12.067340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601368341232558:7685]
2025-10-10T14:34:12.067347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:12.067369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:12.069524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601369123455488:2911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:12.069539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601369123455488:2911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:12.069543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601369123455488:2911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:12.069551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:12.069781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455526:2911], now have 1 active actors on pipe
2025-10-10T14:34:12.069826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1254
2025-10-10T14:34:12.069886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.069898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.069941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:12.069957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.069976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.069982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:12.069996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.070019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:12.070036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.070214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.070234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.070258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.070331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1255 partition: 0 MaxSeqNo: 40 sessionId: src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0
2025-10-10T14:34:12.070765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19124fd-8398932a-ddf51f8c-aa0fafc6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:12.073473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0] Write session: try to update token
2025-10-10T14:34:12.073490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:12.078874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:12.078885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.078895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601368341232558:7685]
2025-10-10T14:34:12.078938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:12.078939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:12.079117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:12.079250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.079392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.079524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.079710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:12.079751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:12.087004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId: src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:12.089596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:12.089808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.089829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.089863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:12.089950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:12.096840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:12.096857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.096860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:12.096861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:12.096873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601368341232558:7685]
2025-10-10T14:34:12.096884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601368341232558:7685]
2025-10-10T14:34:12.096887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601368341232558:7685]
2025-10-10T14:34:12.096937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:12.096945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:12.096947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.096952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:12.096953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:12.096956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:12.097087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:12.152031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601369123455530:3347]
2025-10-10T14:34:12.152357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1254, pipe: [1:7559601369123455530:3347]
2025-10-10T14:34:12.207595Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:12.215335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.215364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.215537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.215608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.215672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.215741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.215799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.215804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.215873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.215939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.216011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.216081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.216125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.216133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.216203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.216275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.216357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.216429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.216475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.216483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.216560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.216649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.216717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.216787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.216832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.216841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.216907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.216970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.217036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.217105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.217153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.217161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.217230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.217297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.217387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.217452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.217494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.217501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.217568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.217625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.217687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.217752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.217796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.217798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.217865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.217925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.217987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.218123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.218170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.218180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.218312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.218436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.218505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.218571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.218615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.218626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.218697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.218764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.218831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.218903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.218943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.218952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.219034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455530:3347], now have 1 active actors on pipe
2025-10-10T14:34:12.219270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601369123455530:3347]
2025-10-10T14:34:12.219312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:12.219314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:12.219344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1255 reason: error at write: Disconnected sessionId: src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0
2025-10-10T14:34:12.219559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1255 sessionId: src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0 is DEAD
2025-10-10T14:34:12.219744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:12.219763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0] Write session will restart in 0.007546s
2025-10-10T14:34:12.219788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0] Write session: Do CDS request
2025-10-10T14:34:12.219794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:12.219774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:12.220087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:12.228978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.229028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:12.229045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1256
2025-10-10T14:34:12.229278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.229324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:12.229349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:12.229353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:12.229655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:12.229748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1256 sessionId:  describe result for acl check
2025-10-10T14:34:12.229783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:12.229790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:12.229792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:12.229798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601369123455594:2903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:12.230340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601369123455594:2903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:12.231743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:12.231965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:12.231980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:12.231993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:12.232047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:12.232092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601368341232670:7693]
2025-10-10T14:34:12.232205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601369123455594:2903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:12.232728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:12.233046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:12.233109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:12.233450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:12.233512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.233518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.233519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.233520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.233521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.233522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.233523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.233524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.233525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.233528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.233529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.233529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.233530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.233536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.233547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.233550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.233553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.233557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.233561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.233564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.233567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.233570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.233574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.233578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.233581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.233584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.233591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.233599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.233604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.233609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.233613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.233617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.233622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.233627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.233630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.233635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.233639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.233643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.233648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.233652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.233657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.233661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.233666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.233671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.233678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.233682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.233687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.233692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.233696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.233700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.233705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.233710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.233746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:12.235828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601369123455594:2903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:12.235845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601369123455594:2903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:12.235849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601369123455594:2903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:12.235857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:12.236157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:12.236481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:12.236498Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:12.236500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:12.236504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:12.236510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1255 [2:7559601368341232670:7693]
2025-10-10T14:34:12.236523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:12.236541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:12.236544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.236548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.236550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.236568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:12.236582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:12.236590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:12.236671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.236679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.236681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.236684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:12.236766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:12.236778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.236791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.236804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.236822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:12.236851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455628:2903], now have 1 active actors on pipe
2025-10-10T14:34:12.236859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455544:2438], now have 1 active actors on pipe
2025-10-10T14:34:12.236867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601368341232661:7693]
2025-10-10T14:34:12.236874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601368341232661:7693]
2025-10-10T14:34:12.236876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601368341232661:7693]
2025-10-10T14:34:12.236892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:12.236910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:12.236912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:12.236919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:12.236921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:12.236929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:12.236933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:12.236931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1255
2025-10-10T14:34:12.236962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601368341232661:7693]
2025-10-10T14:34:12.236972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:12.236974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:12.236970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1255
2025-10-10T14:34:12.236998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.237008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.237047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:12.237060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.237068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.237070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:12.237081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.237096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:12.237119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.237254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.237261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.237278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.237396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1256 partition: 0 MaxSeqNo: 40 sessionId: src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0
2025-10-10T14:34:12.237870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|925fbeb3-c4f4ae3b-f98aa056-fc5acbba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:12.240504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0] Write session: try to update token
2025-10-10T14:34:12.240524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:12.256295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId: src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:12.258187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:12.258215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.258219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:12.258223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:12.258233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601368341232661:7693]
2025-10-10T14:34:12.258239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601368341232661:7693]
2025-10-10T14:34:12.258244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601368341232661:7693]
2025-10-10T14:34:12.258299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:12.258306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:12.258306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:12.258311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:12.258315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.258318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:12.258526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:12.259396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:12.319466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601369123455648:3347]
2025-10-10T14:34:12.319811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1255, pipe: [1:7559601369123455648:3347]
2025-10-10T14:34:12.370285Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:12.370575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.370587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.370626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455648:3347], now have 1 active actors on pipe
2025-10-10T14:34:12.370818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:12.370886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:12.370900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:12.370902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:12.370943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601369123455648:3347]
2025-10-10T14:34:12.370979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1256 reason: error at write: Disconnected sessionId: src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0
2025-10-10T14:34:12.371192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1256 sessionId: src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0 is DEAD
2025-10-10T14:34:12.371325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:12.371336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0] Write session will restart in 0.009276s
2025-10-10T14:34:12.371362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0] Write session: Do CDS request
2025-10-10T14:34:12.371369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:12.380203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:12.381915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.381939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:12.382029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:12.382048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1257
2025-10-10T14:34:12.382161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:12.382172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:12.382184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:12.382193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.382227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:12.382242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:12.382238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:12.382243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:12.382285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601368341232781:7702]
2025-10-10T14:34:12.382687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1257 sessionId:  describe result for acl check
2025-10-10T14:34:12.382722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:12.382732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:12.382734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:12.382740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601369123455701:2895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:12.382765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:12.383072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:12.383113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:12.383325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:12.383339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601369123455701:2895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:12.383363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.383368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.383369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.383370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.383371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.383371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.383374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.383375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.383375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.383376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.383376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.383377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.383378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.383382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.383390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.383393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.383395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.383397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.383399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.383401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.383403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.383405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.383408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.383409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.383412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.383414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.383419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.383425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.383429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.383432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.383435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.383438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.383441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.383444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.383446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.383449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.383452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.383456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.383459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.383463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.383466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.383469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.383472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.383475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.383477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.383480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.383483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.383486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.383488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.383491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.383494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.383497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.383519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:12.385459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601369123455701:2895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:12.386040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:12.386510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:12.386524Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:12.386526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:12.386528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:12.386533Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1256 [2:7559601368341232781:7702]
2025-10-10T14:34:12.386543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:12.386556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:12.386560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.386563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.386564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.386577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:12.386582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:12.386588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:12.386648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.386653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.386655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.386657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:12.386726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:12.386738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.386750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.386761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.386779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:12.386809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455649:2438], now have 1 active actors on pipe
2025-10-10T14:34:12.386822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601368341232776:7702]
2025-10-10T14:34:12.386832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601368341232776:7702]
2025-10-10T14:34:12.386834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601368341232776:7702]
2025-10-10T14:34:12.386849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:12.386856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:12.386860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:12.386862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:12.386865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:12.386831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1256
2025-10-10T14:34:12.386881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:12.386890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:12.386920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601368341232776:7702]
2025-10-10T14:34:12.386928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:12.386935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:12.391429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601369123455701:2895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:12.391448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601369123455701:2895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:12.391452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601369123455701:2895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:12.391462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:12.391716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455739:2895], now have 1 active actors on pipe
2025-10-10T14:34:12.391780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1256
2025-10-10T14:34:12.391842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.391854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.391888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:12.391909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.391916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.391929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:12.391942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.391964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:12.391985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.392184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.392198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.392223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.392337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1257 partition: 0 MaxSeqNo: 40 sessionId: src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0
2025-10-10T14:34:12.392765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30144100-a6de5f0d-a7abc33c-ea962b18_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:12.395329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0] Write session: try to update token
2025-10-10T14:34:12.395346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:12.398570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:12.398583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.398594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601368341232776:7702]
2025-10-10T14:34:12.398643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:12.398653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:12.398823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:12.398973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.399113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.399257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.399447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:12.399494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:12.409967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId: src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:12.412608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:12.412874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.412893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.412930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:12.413017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:12.417239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:12.417254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.417258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:12.417263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:12.417276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601368341232776:7702]
2025-10-10T14:34:12.417280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601368341232776:7702]
2025-10-10T14:34:12.417283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601368341232776:7702]
2025-10-10T14:34:12.417347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:12.417347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:12.417354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:12.417356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.417358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:12.417358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:12.417496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:12.471317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601369123455742:3347]
2025-10-10T14:34:12.471576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1256, pipe: [1:7559601369123455742:3347]
2025-10-10T14:34:12.532448Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:12.540512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.540542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.540742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.540823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.540896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.540966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.541023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.541037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.541135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.541205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.541361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.541497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.541564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.541578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.541674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.541749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.541816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.541883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.541929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.541937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.542009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.542071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.542133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.542193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.542239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.542248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.542314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.542375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.542468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.542529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.542578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.542585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.542647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.542706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.542769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.542831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.542874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.542881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.542945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.543001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.543064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.543129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.543174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.543184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.543257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.543322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.543397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.543490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.543666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.543681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.543746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.543810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.543875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.543943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.543988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.543995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.544067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.544132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.544197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.544263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.544308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.544316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.544390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455742:3347], now have 1 active actors on pipe
2025-10-10T14:34:12.544641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:12.544657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:12.544661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:12.544684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1257 reason: error at write: Disconnected sessionId: src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0
2025-10-10T14:34:12.544715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601369123455742:3347]
2025-10-10T14:34:12.544907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1257 sessionId: src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0 is DEAD
2025-10-10T14:34:12.545070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:12.545081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0] Write session will restart in 0.007610s
2025-10-10T14:34:12.545107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0] Write session: Do CDS request
2025-10-10T14:34:12.545114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:12.545532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:12.553917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.554039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:12.554069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1258
2025-10-10T14:34:12.554219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.554255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:12.554266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:12.554270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:12.554772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1258 sessionId:  describe result for acl check
2025-10-10T14:34:12.554811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:12.554819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:12.554821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:12.554828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601369123455809:2881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:12.555003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:12.555409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601369123455809:2881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:12.556660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:12.556853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:12.556866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:12.556879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:12.556938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:12.556978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601368341232885:7705]
2025-10-10T14:34:12.557591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601369123455809:2881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:12.557670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:12.557926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:12.557968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:12.558299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:12.558356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.558362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.558363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.558365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.558366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.558367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.558368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.558370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.558371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.558372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.558375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.558376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.558377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.558383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.558396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.558400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.558404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.558408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.558412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.558416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.558419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.558423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.558427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.558431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.558435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.558439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.558445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.558454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.558461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.558467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.558472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.558478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.558483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.558489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.558495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.558500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.558511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.558517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.558527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.558533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.558542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.558548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.558554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.558564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.558569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.558579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.558585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.558595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.558600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.558609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.558614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.558621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.558667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:12.561100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601369123455809:2881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:12.561116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601369123455809:2881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:12.561120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601369123455809:2881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:12.561129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:12.561205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:12.561574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:12.561591Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:12.561594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:12.561598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:12.561604Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1257 [2:7559601368341232885:7705]
2025-10-10T14:34:12.561618Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:12.561636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:12.561644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.561648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.561653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.561670Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:12.561683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:12.561696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:12.561756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.561763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.561765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.561768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:12.561836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:12.561845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.561859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.561872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.561893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:12.561919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455756:2438], now have 1 active actors on pipe
2025-10-10T14:34:12.561928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455844:2881], now have 1 active actors on pipe
2025-10-10T14:34:12.561936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601368341232879:7705]
2025-10-10T14:34:12.561939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601368341232879:7705]
2025-10-10T14:34:12.561941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601368341232879:7705]
2025-10-10T14:34:12.561946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1257
2025-10-10T14:34:12.561952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1257
2025-10-10T14:34:12.561955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:12.561978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:12.561982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:12.561984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:12.561985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:12.562003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:12.562007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:12.562049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.562059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.562074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601368341232879:7705]
2025-10-10T14:34:12.562089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:12.562109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:12.562125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:12.562134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.562139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.562146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:12.562157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.562173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:12.562198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.562398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.562407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.562423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.562521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1258 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0
2025-10-10T14:34:12.562969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc255af-89e2e14d-ab71286b-10bc37e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:12.565659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0] Write session: try to update token
2025-10-10T14:34:12.565677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:12.580183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId: src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:12.581749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:12.581766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.581769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:12.581771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:12.581781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601368341232879:7705]
2025-10-10T14:34:12.581786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601368341232879:7705]
2025-10-10T14:34:12.581793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601368341232879:7705]
2025-10-10T14:34:12.581842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:12.581856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.581858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:12.581960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:12.581976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:12.581980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:12.581995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:12.583176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:12.645066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601369123455857:3347]
2025-10-10T14:34:12.645371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1257, pipe: [1:7559601369123455857:3347]
2025-10-10T14:34:12.699393Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:12.699872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.699903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.699966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455857:3347], now have 1 active actors on pipe
2025-10-10T14:34:12.700209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:12.700271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601369123455857:3347]
2025-10-10T14:34:12.700300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:12.700309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:12.700410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:12.700376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1258 reason: error at write: Disconnected sessionId: src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0
2025-10-10T14:34:12.700614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1258 sessionId: src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0 is DEAD
2025-10-10T14:34:12.700762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:12.700775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0] Write session will restart in 0.009907s
2025-10-10T14:34:12.700801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0] Write session: Do CDS request
2025-10-10T14:34:12.700807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:12.710521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:12.711936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.712259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:12.712482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:12.712493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:12.712506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:12.712015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:12.712034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1259
2025-10-10T14:34:12.712174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.712206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:12.712576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:12.712212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:12.712215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:12.712625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601368341232979:7708]
2025-10-10T14:34:12.713243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:12.712671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1259 sessionId:  describe result for acl check
2025-10-10T14:34:12.712720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:12.712722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:12.712724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:12.712730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601369123455916:2869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:12.713324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601369123455916:2869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:12.713609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:12.713660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:12.714008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:12.714062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.714068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.714070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.714071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.714072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.714074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.714075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.714076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.714077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.714078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.714080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.714081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.714082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.714088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.714100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.714105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.714109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.714113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.714117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.714121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.714125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.714129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.714135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.714138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.714142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.714145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.714152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.714159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.714165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.714171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.714175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.714183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.714187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.714192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.714201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.714206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.714211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.714216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.714220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.714225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.714228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.714231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.714234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.714237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.714239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.714242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.714245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.714248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.714251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.714254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.714258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.714263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.714303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:12.715945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601369123455916:2869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:12.716687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:12.717100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:12.717114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:12.717117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:12.717121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:12.717127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1258 [2:7559601368341232979:7708]
2025-10-10T14:34:12.717138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:12.717156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:12.717164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.717167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.717170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.717186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:12.717198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:12.717210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:12.717273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.717284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.717286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.717288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:12.717371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:12.717379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.717392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.717406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.717424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:12.717450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455861:2438], now have 1 active actors on pipe
2025-10-10T14:34:12.717463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601368341232973:7708]
2025-10-10T14:34:12.717470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601368341232973:7708]
2025-10-10T14:34:12.717472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601368341232973:7708]
2025-10-10T14:34:12.717475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1258
2025-10-10T14:34:12.717487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:12.717508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:12.717508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:12.717513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:12.717515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:12.717524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:12.717529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:12.717557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601368341232973:7708]
2025-10-10T14:34:12.717565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:12.717572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:12.719529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601369123455916:2869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:12.719544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601369123455916:2869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:12.719548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601369123455916:2869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:12.719557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:12.719797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455953:2869], now have 1 active actors on pipe
2025-10-10T14:34:12.719849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1258
2025-10-10T14:34:12.719913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.719924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.719956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:12.719972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.719981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.719984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:12.719995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.720009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:12.720037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.720181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.720190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.720203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.720307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1259 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0
2025-10-10T14:34:12.720686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab7ec8e8-112b3757-dc13e286-5ee5b9f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:12.723400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0] Write session: try to update token
2025-10-10T14:34:12.723418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:12.729101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:12.729121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.729133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601368341232973:7708]
2025-10-10T14:34:12.729183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:12.729203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:12.729371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:12.729498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.729636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.729780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.729955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:12.729991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:12.737551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId: src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:12.740140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:12.740407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.740426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.740464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:12.740559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:12.747460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:12.747479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.747482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:12.747487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:12.747499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601368341232973:7708]
2025-10-10T14:34:12.747503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601368341232973:7708]
2025-10-10T14:34:12.747507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601368341232973:7708]
2025-10-10T14:34:12.747547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:12.747555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:12.747557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:12.747560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:12.747562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.747565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:12.747698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:12.800227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601369123455956:3347]
2025-10-10T14:34:12.800547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1258, pipe: [1:7559601369123455956:3347]
2025-10-10T14:34:12.860709Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:12.868368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.868399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.868590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.868655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.868726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.868793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.868837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.868846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.868918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.868980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.869043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.869108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.869153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.869164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.869230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.869290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.869373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.869440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.869483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.869494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.869559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.869623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.869690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.869756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.869801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.869808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.869872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.869936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.870002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.870064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.870109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.870116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.870183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.870243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.870307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.870370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.870414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.870420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.870487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.870547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.870614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.870681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.870725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.870732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.870798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.870857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.870920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.870983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.871027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.871033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.871099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.871161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.871231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.871296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.871341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.871348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.871420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:12.871482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:12.871549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:12.871611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:12.871657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:12.871664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:12.871730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455956:3347], now have 1 active actors on pipe
2025-10-10T14:34:12.871988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:12.872014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601369123455956:3347]
2025-10-10T14:34:12.872048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:12.872051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:12.872086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1259 reason: error at write: Disconnected sessionId: src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0
2025-10-10T14:34:12.872358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1259 sessionId: src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0 is DEAD
2025-10-10T14:34:12.872549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:12.872559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0] Write session will restart in 0.007581s
2025-10-10T14:34:12.872596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0] Write session: Do CDS request
2025-10-10T14:34:12.872602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:12.872739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:12.881684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:12.881914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.883013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:12.883031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1260
2025-10-10T14:34:12.883144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:12.883179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:12.883191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:12.883195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:12.883389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:12.883594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:12.883605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:12.883618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:12.883672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:12.883681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1260 sessionId:  describe result for acl check
2025-10-10T14:34:12.883723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:12.883715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601368341233071:7710]
2025-10-10T14:34:12.883729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:12.883732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:12.883739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601369123456015:2870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:12.884315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:12.884331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601369123456015:2870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:12.884623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:12.884671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:12.885003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:12.885061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.885067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.885068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.885070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.885071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.885072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.885073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.885074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.885076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.885078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.885079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.885080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.885081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.885087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.885100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.885105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.885109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.885113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.885117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.885121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.885126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.885130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.885135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.885139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.885143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.885148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.885155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.885163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:12.885171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.885177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:12.885181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.885187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:12.885191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.885196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:12.885200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.885205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:12.885209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.885214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:12.885218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.885223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:12.885227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.885232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:12.885236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.885242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:12.885246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.885251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:12.885255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.885260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.885265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.885269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.885274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.885278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.885312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:12.887463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601369123456015:2870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:12.887769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:12.888113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:12.888128Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:12.888131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:12.888139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:12.888146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1259 [2:7559601368341233071:7710]
2025-10-10T14:34:12.888160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:12.888177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:12.888184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.888188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.888191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.888208Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:12.888216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:12.888232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:12.888293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.888301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.888304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.888306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:12.888377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:12.888386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.888399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:12.888413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:12.888437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:12.888468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123455958:2438], now have 1 active actors on pipe
2025-10-10T14:34:12.888482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601368341233066:7710]
2025-10-10T14:34:12.888485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601368341233066:7710]
2025-10-10T14:34:12.888487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601368341233066:7710]
2025-10-10T14:34:12.888502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:12.888494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1259
2025-10-10T14:34:12.888519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:12.888527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:12.888531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:12.888534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:12.888557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:12.888561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:12.888609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601368341233066:7710]
2025-10-10T14:34:12.888624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:12.888642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:12.893789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601369123456015:2870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:12.893804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601369123456015:2870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:12.893807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601369123456015:2870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:12.893816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:12.894079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123456052:2870], now have 1 active actors on pipe
2025-10-10T14:34:12.894127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1259
2025-10-10T14:34:12.894210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.894235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.894274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:12.894298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:12.894306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:12.894309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:12.894324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:12.894343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:12.894369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.894574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.894587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.894610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:12.894743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1260 partition: 0 MaxSeqNo: 40 sessionId: src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0
2025-10-10T14:34:12.895168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac646d7e-a2970a2c-830da0ca-ef9b9fb9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:12.897889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0] Write session: try to update token
2025-10-10T14:34:12.897907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:12.900296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:12.900317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.900327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601368341233066:7710]
2025-10-10T14:34:12.900372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:12.900381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:12.900566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:12.900733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.900879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.901030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:12.901226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:12.901274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:12.912684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId: src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:12.915377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:12.915634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:12.915656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:12.915721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:12.915834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:12.918682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:12.918699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:12.918703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:12.918705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:12.918716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601368341233066:7710]
2025-10-10T14:34:12.918720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601368341233066:7710]
2025-10-10T14:34:12.918723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601368341233066:7710]
2025-10-10T14:34:12.918772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:12.918773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:12.918780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:12.918785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:12.918785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:12.918788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:12.918929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:12.972248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601369123456055:3347]
2025-10-10T14:34:12.972476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1259, pipe: [1:7559601369123456055:3347]
2025-10-10T14:34:13.032594Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:13.040435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.040470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.040666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.040731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.040800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.040870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.040917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.040931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.041011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.041077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.041142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.041218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.041270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.041279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.041369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.041436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.041518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.041589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.041637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.041644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.041718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.041792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.041860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.041931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.041979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.041986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.042064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.042133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.042198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.042270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.042314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.042327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.042405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.042475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.042542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.042610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.042664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.042672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.042749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.042816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.042894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.042965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.043021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.043030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.043106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.043174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.043252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.043323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.043369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.043379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.043450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.043524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.043591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.043661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.043711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.043719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.043792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.043861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.043928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.043994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.044045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.044053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.044125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601369123456055:3347], now have 1 active actors on pipe
2025-10-10T14:34:13.044471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:13.044474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:13.044479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:13.044528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1260 reason: error at write: Disconnected sessionId: src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0
2025-10-10T14:34:13.044547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601369123456055:3347]
2025-10-10T14:34:13.044808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1260 sessionId: src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0 is DEAD
2025-10-10T14:34:13.044985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:13.044997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0] Write session will restart in 0.008159s
2025-10-10T14:34:13.045024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0] Write session: Do CDS request
2025-10-10T14:34:13.045030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:13.045286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:13.054995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.055142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:13.055361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:13.055378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1261
2025-10-10T14:34:13.055513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.055544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:13.055556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:13.055560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:13.056068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1261 sessionId:  describe result for acl check
2025-10-10T14:34:13.056148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:13.056158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:13.056160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:13.056167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601373418423410:2865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:13.056978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601373418423410:2865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:13.057345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:13.057573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:13.057583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:13.057594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:13.057648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:13.057694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601372636200462:7712]
2025-10-10T14:34:13.058326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:13.058603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:13.058646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:13.058986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:13.059046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.059052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.059054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.059055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.059057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.059058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.059060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.059061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.059062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.059064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.059065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.059067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.059068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.059074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.059088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.059094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.059098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.059102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.059107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.059111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.059115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.059119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.059124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.059129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.059133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.059137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.059144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.059158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.059165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.059176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.059181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.059190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.059194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.059200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.059204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.059210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.059219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.059225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.059234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.059240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.059248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.059254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.059260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.059269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.059274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.059282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.059291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.059297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.059305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.059311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.059320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.059326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.059371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:13.060232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601373418423410:2865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:13.061956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:13.062282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:13.062296Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:13.062299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:13.062303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:13.062311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1260 [2:7559601372636200462:7712]
2025-10-10T14:34:13.062326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:13.062350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:13.062354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.062358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.062360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.062380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:13.062393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:13.062406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:13.062463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.062469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.062473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.062476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:13.062546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:13.062554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.062565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.062580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.062599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:13.062628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601372636200456:7712]
2025-10-10T14:34:13.062630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601372636200456:7712]
2025-10-10T14:34:13.062632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601372636200456:7712]
2025-10-10T14:34:13.062646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:13.062661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:13.062666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423353:2438], now have 1 active actors on pipe
2025-10-10T14:34:13.062671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:13.062673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:13.062675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:13.062691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:13.062710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1260
2025-10-10T14:34:13.062695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:13.062723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601372636200456:7712]
2025-10-10T14:34:13.062726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:13.062729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:13.064346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601373418423410:2865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:13.064363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601373418423410:2865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:13.064367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601373418423410:2865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:13.064376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:13.064636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423448:2865], now have 1 active actors on pipe
2025-10-10T14:34:13.064705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1260
2025-10-10T14:34:13.064779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.064790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.064838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:13.064855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.064866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.064868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:13.064882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.064903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:13.064926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.065104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.065115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.065140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.065236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1261 partition: 0 MaxSeqNo: 40 sessionId: src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0
2025-10-10T14:34:13.065681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd3b3f-5547394c-960071c3-7d5d95db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:13.068464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0] Write session: try to update token
2025-10-10T14:34:13.068486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:13.074572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:13.074589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:13.074605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601372636200456:7712]
2025-10-10T14:34:13.074653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:13.074662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:13.074847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:13.074998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:13.075152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:13.075312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:13.075530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:13.075579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:13.083519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId: src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:13.086359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:13.086815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.086838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.086883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:13.086986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:13.092827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:13.092843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:13.092846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:13.092847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:13.092857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601372636200456:7712]
2025-10-10T14:34:13.092860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601372636200456:7712]
2025-10-10T14:34:13.092863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601372636200456:7712]
2025-10-10T14:34:13.092904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:13.092914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.092916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:13.092921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:13.092928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:13.092932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:13.093053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:13.144730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601373418423452:3347]
2025-10-10T14:34:13.145028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1260, pipe: [1:7559601373418423452:3347]
2025-10-10T14:34:13.206097Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:13.214696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.214727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.214914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.214982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.215060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.215128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.215179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.215196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.215269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.215338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.215402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.215476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.215523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.215532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.215602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.215666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.215734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.215805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.215850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.215857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.215926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.215992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.216055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.216119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.216165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.216171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.216238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.216300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.216365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.216434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.216481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.216488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.216560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.216638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.216712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.216783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.216831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.216839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.216911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.216980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.217051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.217114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.217257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.217265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.217351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.217414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.217482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.217546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.217592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.217599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.217670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.217733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.217798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.217865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.217910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.217917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.217985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:13.218053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:13.218122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:13.218196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:13.218239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:13.218246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:13.218318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423452:3347], now have 1 active actors on pipe
2025-10-10T14:34:13.218586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601373418423452:3347]
2025-10-10T14:34:13.218586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:13.218591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:13.218626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1261 reason: error at write: Disconnected sessionId: src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0
2025-10-10T14:34:13.218886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1261 sessionId: src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0 is DEAD
2025-10-10T14:34:13.219051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:13.219080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:13.219093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0] Write session will restart in 0.009171s
2025-10-10T14:34:13.219119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0] Write session: Do CDS request
2025-10-10T14:34:13.219126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:13.219453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:13.229401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:13.229886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.230000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:13.230017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1262
2025-10-10T14:34:13.230156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.230192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:13.230202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:13.230205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:13.230685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1262 sessionId:  describe result for acl check
2025-10-10T14:34:13.230738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:13.230741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:13.230743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:13.230749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601373418423511:2861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:13.231077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:13.231263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:13.231275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:13.231287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:13.231325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601373418423511:2861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:13.231347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:13.231403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601372636200557:7714]
2025-10-10T14:34:13.232051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:13.232303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:13.232352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:13.232701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:13.232787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.232794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.232795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.232796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.232797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.232798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.232800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.232801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.232802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.232803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.232804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.232806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.232807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.232813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.232824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.232829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.232833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.232837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.232841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.232846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.232850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.232854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.232858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.232864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.232868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.232872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.232879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.232887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.232893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.232897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.232901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.232905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.232909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.232913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.232917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.232922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.232926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.232930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.232934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.232938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.232942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.232946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.232957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.232962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.232971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.232976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.232981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.232986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.232995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.233001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.233010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.233016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.233062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:13.233720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601373418423511:2861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:13.235430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:13.235999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:13.236010Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:13.236013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:13.236018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:13.236023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1261 [2:7559601372636200557:7714]
2025-10-10T14:34:13.236035Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:13.236052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:13.236030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601373418423511:2861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:13.236057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.236045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601373418423511:2861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:13.236061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.236048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601373418423511:2861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:13.236063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.236080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:13.236056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:13.236087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:13.236097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:13.236152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.236159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.236162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.236164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:13.236232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:13.236239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.236252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.236266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.236288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:13.236313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423453:2438], now have 1 active actors on pipe
2025-10-10T14:34:13.236320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423545:2861], now have 1 active actors on pipe
2025-10-10T14:34:13.236329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601372636200551:7714]
2025-10-10T14:34:13.236332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601372636200551:7714]
2025-10-10T14:34:13.236334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601372636200551:7714]
2025-10-10T14:34:13.236350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:13.236353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1261
2025-10-10T14:34:13.236372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1261
2025-10-10T14:34:13.236364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:13.236370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:13.236384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:13.236387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:13.236388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:13.236392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:13.236421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601372636200551:7714]
2025-10-10T14:34:13.236433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:13.236447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:13.236452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.236456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.236501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:13.236514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.236523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.236525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:13.236536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.236546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:13.236581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.236700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.236708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.236722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.236809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1262 partition: 0 MaxSeqNo: 40 sessionId: src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0
2025-10-10T14:34:13.237175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46b3e5d-c50f300d-ee9e3557-ec1d5be4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:13.239853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0] Write session: try to update token
2025-10-10T14:34:13.239873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:13.254138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId: src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:13.256216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:13.256235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:13.256238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:13.256241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:13.256248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601372636200551:7714]
2025-10-10T14:34:13.256252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601372636200551:7714]
2025-10-10T14:34:13.256255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601372636200551:7714]
2025-10-10T14:34:13.256312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:13.256328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.256331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:13.256337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:13.256343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:13.256347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:13.256485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:13.257093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:13.318882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601373418423577:3347]
2025-10-10T14:34:13.319247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1261, pipe: [1:7559601373418423577:3347]
2025-10-10T14:34:13.373947Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:13.374488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.374504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.374553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423577:3347], now have 1 active actors on pipe
2025-10-10T14:34:13.374806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:13.374871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601373418423577:3347]
2025-10-10T14:34:13.374928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:13.375024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1262 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0
2025-10-10T14:34:13.375223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:13.375263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1262 sessionId: src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0 is DEAD
2025-10-10T14:34:13.375449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:13.375459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0] Write session will restart in 0.005966s
2025-10-10T14:34:13.375484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0] Write session: Do CDS request
2025-10-10T14:34:13.375490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:13.382872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.382962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:13.382980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1263
2025-10-10T14:34:13.383191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.383245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:13.383256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:13.383260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:13.383831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:13.384087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1263 sessionId:  describe result for acl check
2025-10-10T14:34:13.384131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:13.384138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:13.384140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:13.384148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601373418423636:2845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:13.384770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601373418423636:2845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:13.385765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:13.385991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:13.386003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:13.386016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:13.386076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:13.386119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601372636200690:7729]
2025-10-10T14:34:13.386748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:13.386840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601373418423636:2845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:13.387044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:13.387099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:13.387483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:13.387552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.387558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.387559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.387559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.387560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.387561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.387562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.387563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.387563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.387564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.387565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.387566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.387566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.387571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.387579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.387581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.387584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.387586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.387589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.387591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.387593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.387596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.387598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.387600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.387603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.387605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.387611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.387617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.387623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.387628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.387634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.387640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.387645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.387649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.387652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.387656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.387658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.387661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.387664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.387667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.387669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.387672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.387675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.387678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.387680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.387683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.387686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.387690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.387693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.387696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.387698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.387701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.387734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:13.390082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601373418423636:2845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:13.390079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:13.390096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601373418423636:2845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:13.390100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601373418423636:2845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:13.390109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:13.390410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:13.390421Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:13.390424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:13.390428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:13.390435Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1262 [2:7559601372636200690:7729]
2025-10-10T14:34:13.390445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:13.390459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:13.390465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.390471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.390473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.390491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:13.390504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:13.390511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:13.390564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.390570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.390571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.390572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:13.390623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:13.390628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.390635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.390641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.390651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:13.390670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601372636200685:7729]
2025-10-10T14:34:13.390675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601372636200685:7729]
2025-10-10T14:34:13.390677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601372636200685:7729]
2025-10-10T14:34:13.390683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:13.390692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:13.390694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:13.390694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423670:2845], now have 1 active actors on pipe
2025-10-10T14:34:13.390696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:13.390701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423578:2438], now have 1 active actors on pipe
2025-10-10T14:34:13.390707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:13.390722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:13.390729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:13.390753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601372636200685:7729]
2025-10-10T14:34:13.390762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:13.390761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1262
2025-10-10T14:34:13.390791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:13.390763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1262
2025-10-10T14:34:13.390846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.390858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.390887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d786e4a-fc80421b-16086998-936a3592_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:13.390899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.390904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.390911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:13.390924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.390940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:13.390957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.391075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.391083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.391101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.391171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1263 partition: 0 MaxSeqNo: 40 sessionId: src_id|8d786e4a-fc80421b-16086998-936a3592_0
2025-10-10T14:34:13.391560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fc6fa51-22df5f4a-ceb53a06-56dc133a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8d786e4a-fc80421b-16086998-936a3592_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:13.394441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d786e4a-fc80421b-16086998-936a3592_0] Write session: try to update token
2025-10-10T14:34:13.394465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d786e4a-fc80421b-16086998-936a3592_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:13.409444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId: src_id|8d786e4a-fc80421b-16086998-936a3592_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:13.410387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:13.410402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:13.410405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:13.410407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:13.410416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601372636200685:7729]
2025-10-10T14:34:13.410421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601372636200685:7729]
2025-10-10T14:34:13.410424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601372636200685:7729]
2025-10-10T14:34:13.410468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:13.410475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:13.410480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:13.410485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:13.410495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.410497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:13.410649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:13.412276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:13.475010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601373418423677:3347]
2025-10-10T14:34:13.475276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1262, pipe: [1:7559601373418423677:3347]
2025-10-10T14:34:13.522929Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:13.523386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.523401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.523450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423677:3347], now have 1 active actors on pipe
2025-10-10T14:34:13.523625Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:13.523729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601373418423677:3347]
2025-10-10T14:34:13.523744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:13.523769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:13.523846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1263 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d786e4a-fc80421b-16086998-936a3592_0
2025-10-10T14:34:13.524071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1263 sessionId: src_id|8d786e4a-fc80421b-16086998-936a3592_0 is DEAD
2025-10-10T14:34:13.524267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d786e4a-fc80421b-16086998-936a3592_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:13.524278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d786e4a-fc80421b-16086998-936a3592_0] Write session will restart in 0.009571s
2025-10-10T14:34:13.524303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d786e4a-fc80421b-16086998-936a3592_0] Write session: Do CDS request
2025-10-10T14:34:13.524308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d786e4a-fc80421b-16086998-936a3592_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:13.533881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:13.534934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d786e4a-fc80421b-16086998-936a3592_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.535016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:13.535032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1264
2025-10-10T14:34:13.535174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.535220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:13.535232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:13.535236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:13.535733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1264 sessionId:  describe result for acl check
2025-10-10T14:34:13.535776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:13.535782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:13.535784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:13.535791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601373418423751:2835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:13.535825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:13.536048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:13.536060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:13.536080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:13.536143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:13.536187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601372636200800:7732]
2025-10-10T14:34:13.536366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601373418423751:2835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:13.536829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:13.537134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:13.537192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:13.537602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:13.537664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.537670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.537671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.537672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.537674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.537675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.537677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.537678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.537680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.537681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.537682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.537683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.537685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.537692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.537705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.537709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.537714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.537718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.537722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.537727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.537731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.537735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.537740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.537744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.537748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.537754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.537760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.537769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.537776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.537781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.537785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.537791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.537795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.537802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.537807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.537813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.537817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.537823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.537832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.537837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.537843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.537848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.537853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.537858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.537863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.537868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.537873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.537878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.537887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.537892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.537897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.537902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.537949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:13.538351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601373418423751:2835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:13.540354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:13.540595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601373418423751:2835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:13.540606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601373418423751:2835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:13.540609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601373418423751:2835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:13.540616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:13.540717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:13.540729Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:13.540731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:13.540738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:13.540744Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1263 [2:7559601372636200800:7732]
2025-10-10T14:34:13.540756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:13.540774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:13.540776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.540779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.540780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.540793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:13.540816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:13.540829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:13.540894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.540900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.540901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.540903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:13.540966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:13.540972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.540981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.540988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.541002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:13.541023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423691:2438], now have 1 active actors on pipe
2025-10-10T14:34:13.541029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423784:2835], now have 1 active actors on pipe
2025-10-10T14:34:13.541037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601372636200794:7732]
2025-10-10T14:34:13.541038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601372636200794:7732]
2025-10-10T14:34:13.541040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601372636200794:7732]
2025-10-10T14:34:13.541052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:13.541061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:13.541064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:13.541066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:13.541070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:13.541059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1263
2025-10-10T14:34:13.541061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1263
2025-10-10T14:34:13.541088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:13.541095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:13.541132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.541138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.541150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601372636200794:7732]
2025-10-10T14:34:13.541155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:13.541163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:13.541181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:13.541186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.541190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.541192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:13.541200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.541210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:13.541227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.541353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.541361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.541375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.541470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1264 partition: 0 MaxSeqNo: 40 sessionId: src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0
2025-10-10T14:34:13.541825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d786e4a-fc80421b-16086998-936a3592_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:13.544529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0] Write session: try to update token
2025-10-10T14:34:13.544545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:13.558293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId: src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:13.560689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:13.560765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:13.560779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:13.560781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:13.560783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:13.560790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601372636200794:7732]
2025-10-10T14:34:13.560793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601372636200794:7732]
2025-10-10T14:34:13.560796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601372636200794:7732]
2025-10-10T14:34:13.560829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:13.560834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:13.560834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:13.560838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:13.560842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.560844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:13.560964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:13.624021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601373418423796:3347]
2025-10-10T14:34:13.624338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1263, pipe: [1:7559601373418423796:3347]
2025-10-10T14:34:13.671964Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:13.672235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.672251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.672297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423796:3347], now have 1 active actors on pipe
2025-10-10T14:34:13.672513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:13.672573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601373418423796:3347]
2025-10-10T14:34:13.672588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:13.672592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:13.672605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:13.672658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1264 reason: error at write: Disconnected sessionId: src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0
2025-10-10T14:34:13.672890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1264 sessionId: src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0 is DEAD
2025-10-10T14:34:13.673049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:13.673060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0] Write session will restart in 0.007008s
2025-10-10T14:34:13.673085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0] Write session: Do CDS request
2025-10-10T14:34:13.673094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:13.680978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.681101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:13.681121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1265
2025-10-10T14:34:13.681301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.681367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:13.681381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:13.681386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:13.681824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1265 sessionId:  describe result for acl check
2025-10-10T14:34:13.681859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:13.681867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:13.681869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:13.681876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601373418423859:2824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:13.682448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601373418423859:2824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:13.682761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:13.684692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:13.684869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601373418423859:2824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:13.684896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:13.684908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:13.684920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:13.684986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:13.685038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601372636200901:7734]
2025-10-10T14:34:13.685632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:13.685931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:13.685980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:13.686322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:13.686379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.686385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.686386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.686388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.686389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.686390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.686391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.686393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.686394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.686396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.686397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.686398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.686399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.686404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.686418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.686422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.686427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.686431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.686435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.686439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.686443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.686447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.686452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.686456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.686460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.686464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.686471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.686482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.686488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.686495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.686500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.686505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.686510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.686515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.686521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.686526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.686530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.686536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.686540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.686545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.686549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.686554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.686559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.686564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.686568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.686582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.686586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.686594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.686597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.686600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.686603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.686606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.686629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:13.688935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601373418423859:2824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:13.688950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601373418423859:2824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:13.688954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601373418423859:2824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:13.688963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:13.689001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:13.689350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:13.689363Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:13.689366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:13.689370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:13.689377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1264 [2:7559601372636200901:7734]
2025-10-10T14:34:13.689390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:13.689411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:13.689422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.689427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.689434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.689464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:13.689475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:13.689483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:13.689535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.689541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.689543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.689546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:13.689625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:13.689635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.689648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.689660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.689691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1264
2025-10-10T14:34:13.689713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1264
2025-10-10T14:34:13.689689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:13.689720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423802:2438], now have 1 active actors on pipe
2025-10-10T14:34:13.689724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423896:2824], now have 1 active actors on pipe
2025-10-10T14:34:13.689732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601372636200895:7734]
2025-10-10T14:34:13.689734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601372636200895:7734]
2025-10-10T14:34:13.689737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601372636200895:7734]
2025-10-10T14:34:13.689752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:13.689766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:13.689779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:13.689783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:13.689785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:13.689788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:13.689792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:13.689828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.689839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.689858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601372636200895:7734]
2025-10-10T14:34:13.689867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:13.689879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:13.689902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:13.689914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.689924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.689930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:13.689942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.689953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:13.689995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.690128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.690136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.690150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.690247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1265 partition: 0 MaxSeqNo: 40 sessionId: src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0
2025-10-10T14:34:13.690631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1fe23d-691221d-dc61867b-3b10e5f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:13.693237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0] Write session: try to update token
2025-10-10T14:34:13.693253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:13.707886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId: src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:13.709812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:13.709832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:13.709836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:13.709838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:13.709848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601372636200895:7734]
2025-10-10T14:34:13.709853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601372636200895:7734]
2025-10-10T14:34:13.709857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601372636200895:7734]
2025-10-10T14:34:13.709906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:13.709910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:13.709918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:13.709920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.709923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:13.709924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:13.710062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:13.710519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:13.773022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601373418423903:3347]
2025-10-10T14:34:13.773301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1264, pipe: [1:7559601373418423903:3347]
2025-10-10T14:34:13.822479Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:13.822862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.822874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.822918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423903:3347], now have 1 active actors on pipe
2025-10-10T14:34:13.823182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:13.823210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:13.823220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601373418423903:3347]
2025-10-10T14:34:13.823229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:13.823241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:13.823292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1265 reason: error at write: Disconnected sessionId: src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0
2025-10-10T14:34:13.823523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1265 sessionId: src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0 is DEAD
2025-10-10T14:34:13.823697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:13.823710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0] Write session will restart in 0.007004s
2025-10-10T14:34:13.823734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0] Write session: Do CDS request
2025-10-10T14:34:13.823740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:13.831956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.832084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:13.832115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1266
2025-10-10T14:34:13.832248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.832284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:13.832295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:13.832299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:13.832754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1266 sessionId:  describe result for acl check
2025-10-10T14:34:13.832789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:13.832797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:13.832799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:13.832806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601373418423965:2821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:13.833128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:13.833414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601373418423965:2821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:13.835187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:13.835410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:13.835422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:13.835435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:13.835492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:13.835540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601372636201000:7737]
2025-10-10T14:34:13.835561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601373418423965:2821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:13.836152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:13.836492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:13.836579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:13.837085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:13.837158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.837164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.837165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.837166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.837167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.837168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.837170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.837171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.837172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.837173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.837175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.837176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.837177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.837183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.837195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.837199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.837202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.837205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.837209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.837213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.837216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.837220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.837224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.837229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.837233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.837237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.837244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.837253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.837259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.837264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.837268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.837273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.837277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.837282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.837287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.837291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.837295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.837300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.837305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.837309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.837319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.837324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.837345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.837355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.837359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.837364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.837373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.837378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.837381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.837386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.837399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.837437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:13.839970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601373418423965:2821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:13.839992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601373418423965:2821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:13.839996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601373418423965:2821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:13.840016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:13.840047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:13.840406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:13.840423Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:13.840427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:13.840431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:13.840437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1265 [2:7559601372636201000:7737]
2025-10-10T14:34:13.840452Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:13.840476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:13.840483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.840487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.840489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.840507Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:13.840520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:13.840531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:13.840620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.840627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.840629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.840632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:13.840710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:13.840717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.840730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.840748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.840770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:13.840800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418424000:2821], now have 1 active actors on pipe
2025-10-10T14:34:13.840811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418423905:2438], now have 1 active actors on pipe
2025-10-10T14:34:13.840818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601372636200994:7737]
2025-10-10T14:34:13.840821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601372636200994:7737]
2025-10-10T14:34:13.840823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601372636200994:7737]
2025-10-10T14:34:13.840840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:13.840841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1265
2025-10-10T14:34:13.840857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:13.840860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:13.840848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1265
2025-10-10T14:34:13.840865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:13.840867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:13.840874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:13.840877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:13.840912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601372636200994:7737]
2025-10-10T14:34:13.840920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:13.840922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:13.840957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.840965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.840999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:13.841012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.841022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.841024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:13.841038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.841055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:13.841075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.841241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.841250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.841266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.841375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1266 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0
2025-10-10T14:34:13.841798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2ac0d77-723575c0-b229f4b-de4423b3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:13.844514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0] Write session: try to update token
2025-10-10T14:34:13.844534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:13.858231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId: src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:13.860878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:13.860896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:13.860900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:13.860902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:13.860912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601372636200994:7737]
2025-10-10T14:34:13.860917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601372636200994:7737]
2025-10-10T14:34:13.860921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601372636200994:7737]
2025-10-10T14:34:13.860970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:13.860975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:13.860983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.860988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:13.860999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:13.861004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:13.861136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:13.861237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:13.923539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601373418424007:3347]
2025-10-10T14:34:13.923821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1265, pipe: [1:7559601373418424007:3347]
2025-10-10T14:34:13.977905Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:13.978128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.978140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.978178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418424007:3347], now have 1 active actors on pipe
2025-10-10T14:34:13.978343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:13.978434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601373418424007:3347]
2025-10-10T14:34:13.978455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:13.978466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:13.978554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1266 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0
2025-10-10T14:34:13.978793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1266 sessionId: src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0 is DEAD
2025-10-10T14:34:13.978973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:13.978985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0] Write session will restart in 0.009869s
2025-10-10T14:34:13.979012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0] Write session: Do CDS request
2025-10-10T14:34:13.979017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:13.987589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:13.989149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:13.989412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:13.989423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:13.989436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:13.989499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:13.989547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601372636201098:7739]
2025-10-10T14:34:13.989971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.990039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:13.990055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1267
2025-10-10T14:34:13.990205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:13.990216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:13.990249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:13.990258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:13.990261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:13.990466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:13.990507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:13.990606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1267 sessionId:  describe result for acl check
2025-10-10T14:34:13.990635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:13.990640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:13.990641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:13.990645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601373418424074:2818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:13.990850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:13.990902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.990908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.990909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.990910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.990921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.990922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.990924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.990925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.990926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.990927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.990928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.990930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.990931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.990936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.990948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.990952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.990955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.990958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.990963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.990967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.990971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.990975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.990980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.990983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.990987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.990991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.990999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.991007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:13.991017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.991028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:13.991033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.991038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:13.991042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.991047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:13.991052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.991057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:13.991062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.991067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:13.991071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.991076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:13.991083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.991088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:13.991098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.991105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:13.991113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.991119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:13.991123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.991129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.991137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.991142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.991147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.991156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.991167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601373418424074:2818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:13.991196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:13.992939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601373418424074:2818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:13.993623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:13.993965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:13.993977Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:13.993980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:13.993983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:13.993989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1266 [2:7559601372636201098:7739]
2025-10-10T14:34:13.994002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:13.994021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:13.994028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.994032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.994034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.994050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:13.994062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:13.994070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:13.994127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.994134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.994136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.994140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:13.994299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:13.994306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:13.994318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:13.994335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:13.994317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1266
2025-10-10T14:34:13.994358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:13.994385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418424009:2438], now have 1 active actors on pipe
2025-10-10T14:34:13.994398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601372636201093:7739]
2025-10-10T14:34:13.994404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601372636201093:7739]
2025-10-10T14:34:13.994406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601372636201093:7739]
2025-10-10T14:34:13.994420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:13.994434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:13.994453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:13.994461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:13.994484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601372636201093:7739]
2025-10-10T14:34:13.994491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:13.994523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:13.994533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:13.994535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:13.994542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:13.995199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601373418424074:2818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:13.995217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601373418424074:2818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:13.995221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601373418424074:2818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:13.995229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:13.995429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601373418424109:2818], now have 1 active actors on pipe
2025-10-10T14:34:13.995478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1266
2025-10-10T14:34:13.995549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.995558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.995589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40a703a1-e752861f-b5653bd1-6f302e13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:13.995603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:13.995607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:13.995610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:13.995621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:13.995637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:13.995661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.995794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:13.995801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:13.995815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:13.995910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1267 partition: 0 MaxSeqNo: 40 sessionId: src_id|40a703a1-e752861f-b5653bd1-6f302e13_0
2025-10-10T14:34:13.996211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc55a4c8-dd83bfca-a9a0ea92-b9f24b45_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|40a703a1-e752861f-b5653bd1-6f302e13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:13.998832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a703a1-e752861f-b5653bd1-6f302e13_0] Write session: try to update token
2025-10-10T14:34:13.998849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a703a1-e752861f-b5653bd1-6f302e13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:14.013254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId: src_id|40a703a1-e752861f-b5653bd1-6f302e13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:14.014147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:14.014164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:14.014168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:14.014170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:14.014181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601372636201093:7739]
2025-10-10T14:34:14.014185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601372636201093:7739]
2025-10-10T14:34:14.014190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601372636201093:7739]
2025-10-10T14:34:14.014239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:14.014238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:14.014245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:14.014251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:14.014251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.014254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:14.014404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:14.016051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:14.078677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601377713391408:3347]
2025-10-10T14:34:14.078961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1266, pipe: [1:7559601377713391408:3347]
2025-10-10T14:34:14.130532Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:14.130802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.130818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.130866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391408:3347], now have 1 active actors on pipe
2025-10-10T14:34:14.131090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:14.131088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:14.131103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:14.131111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601377713391408:3347]
2025-10-10T14:34:14.131133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:14.131182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1267 reason: error at write: Disconnected sessionId: src_id|40a703a1-e752861f-b5653bd1-6f302e13_0
2025-10-10T14:34:14.131417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1267 sessionId: src_id|40a703a1-e752861f-b5653bd1-6f302e13_0 is DEAD
2025-10-10T14:34:14.131585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a703a1-e752861f-b5653bd1-6f302e13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:14.131597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a703a1-e752861f-b5653bd1-6f302e13_0] Write session will restart in 0.006177s
2025-10-10T14:34:14.131621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a703a1-e752861f-b5653bd1-6f302e13_0] Write session: Do CDS request
2025-10-10T14:34:14.131628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a703a1-e752861f-b5653bd1-6f302e13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:14.138948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a703a1-e752861f-b5653bd1-6f302e13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.139021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:14.139043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1268
2025-10-10T14:34:14.139220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.139288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:14.139303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:14.139307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:14.139865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1268 sessionId:  describe result for acl check
2025-10-10T14:34:14.139907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:14.139914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:14.139916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:14.139924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601377713391444:2814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:14.140560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601377713391444:2814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:14.142607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:14.142789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601377713391444:2814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:14.144425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:14.144652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:14.144664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:14.144678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:14.144738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:14.144781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601376931168496:7741]
2025-10-10T14:34:14.145632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:14.145991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:14.146046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:14.146350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601377713391444:2814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:14.146365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601377713391444:2814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:14.146369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601377713391444:2814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:14.146378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:14.146385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:14.146452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.146459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.146460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.146462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.146463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.146464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.146466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.146467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.146468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.146470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.146471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.146472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.146474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.146480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.146494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.146498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.146502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.146505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.146509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.146513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.146517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.146520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.146525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.146528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.146532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.146536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.146545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.146554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.146561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.146567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.146584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.146588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.146592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.146597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.146602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.146607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.146611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.146616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.146621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.146627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.146632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.146642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.146647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.146652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.146656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.146661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.146671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.146676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.146680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.146689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.146695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.146699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.146741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:14.149270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:14.149611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:14.149625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:14.149627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:14.149631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:14.149638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1267 [2:7559601376931168496:7741]
2025-10-10T14:34:14.149651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:14.149669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:14.149672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.149676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.149678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.149696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:14.149708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:14.149720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:14.149786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.149794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.149796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.149799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:14.149865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:14.149872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.149888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.149905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.149927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:14.149954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391409:2438], now have 1 active actors on pipe
2025-10-10T14:34:14.149962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391505:2814], now have 1 active actors on pipe
2025-10-10T14:34:14.149970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601376931168490:7741]
2025-10-10T14:34:14.149976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601376931168490:7741]
2025-10-10T14:34:14.149978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601376931168490:7741]
2025-10-10T14:34:14.149994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:14.149998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1267
2025-10-10T14:34:14.150014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:14.150000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1267
2025-10-10T14:34:14.150017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:14.150019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:14.150021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:14.150034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:14.150037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:14.150075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601376931168490:7741]
2025-10-10T14:34:14.150082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:14.150090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:14.150106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.150114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.150164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:14.150177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.150181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.150188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:14.150199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.150216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:14.150237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.150394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.150402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.150416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.150509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1268 partition: 0 MaxSeqNo: 40 sessionId: src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0
2025-10-10T14:34:14.150936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a703a1-e752861f-b5653bd1-6f302e13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:14.153790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0] Write session: try to update token
2025-10-10T14:34:14.153808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:14.168098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId: src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:14.169976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:14.169997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:14.170001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:14.170003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:14.170013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601376931168490:7741]
2025-10-10T14:34:14.170019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601376931168490:7741]
2025-10-10T14:34:14.170024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601376931168490:7741]
2025-10-10T14:34:14.170078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:14.170091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.170089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:14.170094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:14.170097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:14.170102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:14.170236Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:14.171059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:14.231244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601377713391514:3347]
2025-10-10T14:34:14.231510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1267, pipe: [1:7559601377713391514:3347]
2025-10-10T14:34:14.293982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:14.294340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.294359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.294405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391514:3347], now have 1 active actors on pipe
2025-10-10T14:34:14.294619Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:14.294675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:14.294686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601377713391514:3347]
2025-10-10T14:34:14.294710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:14.294783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0
2025-10-10T14:34:14.295079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1268 sessionId: src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0 is DEAD
2025-10-10T14:34:14.295189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:14.295213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0] Write session will restart in 0.009939s
2025-10-10T14:34:14.295238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0] Write session: Do CDS request
2025-10-10T14:34:14.295244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:14.305264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:14.306953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.307014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:14.307032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1269
2025-10-10T14:34:14.307179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:14.307403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:14.307416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:14.307428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:14.307486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:14.307527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601376931168610:7749]
2025-10-10T14:34:14.308137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:14.307216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.307274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:14.307288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:14.307292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:14.307688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1269 sessionId:  describe result for acl check
2025-10-10T14:34:14.307717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:14.307719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:14.307721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:14.307727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601377713391593:2795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:14.308296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601377713391593:2795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:14.308485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:14.308574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:14.308942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:14.309009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.309015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.309016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.309017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.309018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.309019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.309020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.309022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.309023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.309024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.309025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.309026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.309027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.309033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.309044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.309048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.309052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.309056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.309059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.309063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.309066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.309070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.309074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.309078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.309081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.309085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.309091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.309103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.309110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.309115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.309120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.309124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.309129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.309134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.309139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.309145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.309149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.309154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.309158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.309162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.309173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.309178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.309182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.309191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.309195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.309200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.309204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.309214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.309218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.309223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.309227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.309235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.309273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:14.310518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601377713391593:2795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:14.311655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:14.311988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:14.312003Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:14.312005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:14.312010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:14.312016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1268 [2:7559601376931168610:7749]
2025-10-10T14:34:14.312030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:14.312046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:14.312050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.312053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.312056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.312085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:14.312093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:14.312101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:14.312151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.312159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.312161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.312164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:14.312281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:14.312289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.312302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.312323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.312344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:14.312377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391515:2438], now have 1 active actors on pipe
2025-10-10T14:34:14.312391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1268
2025-10-10T14:34:14.312386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601376931168604:7749]
2025-10-10T14:34:14.312389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601376931168604:7749]
2025-10-10T14:34:14.312391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601376931168604:7749]
2025-10-10T14:34:14.312404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:14.312419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:14.312424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:14.312427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:14.312429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:14.312441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:14.312456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:14.312489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601376931168604:7749]
2025-10-10T14:34:14.312501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:14.312508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:14.314691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601377713391593:2795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:14.314706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601377713391593:2795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:14.314711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601377713391593:2795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:14.314721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:14.315259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391631:2795], now have 1 active actors on pipe
2025-10-10T14:34:14.315350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1268
2025-10-10T14:34:14.315463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.315476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.315511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|626d86a5-694b0619-337f356-b91efe1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:14.315531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.315539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.315542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:14.315558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.315587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:14.315613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.315829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.315837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.315853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.315943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1269 partition: 0 MaxSeqNo: 40 sessionId: src_id|626d86a5-694b0619-337f356-b91efe1c_0
2025-10-10T14:34:14.316404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18303559-b5354e1f-a0b99fc4-8baeeae8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|626d86a5-694b0619-337f356-b91efe1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:14.319153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|626d86a5-694b0619-337f356-b91efe1c_0] Write session: try to update token
2025-10-10T14:34:14.319172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|626d86a5-694b0619-337f356-b91efe1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:14.324106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:14.324129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:14.324141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601376931168604:7749]
2025-10-10T14:34:14.324203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:14.324205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:14.324392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:14.324550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:14.324687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:14.324832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:14.325057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:14.325105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:14.337073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId: src_id|626d86a5-694b0619-337f356-b91efe1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:14.339746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:14.339977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.339998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.340048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:14.340145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:14.342970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:14.342987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:14.342989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:14.342991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:14.343000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601376931168604:7749]
2025-10-10T14:34:14.343004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601376931168604:7749]
2025-10-10T14:34:14.343007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601376931168604:7749]
2025-10-10T14:34:14.343045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:14.343050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:14.343056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:14.343059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.343061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:14.343071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:14.343193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:14.395084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601377713391646:3347]
2025-10-10T14:34:14.395411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1268, pipe: [1:7559601377713391646:3347]
2025-10-10T14:34:14.457876Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:14.466332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.466364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.466553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.466620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.466698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.466767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.467230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.467245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.467322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.467385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.467452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.467524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.467571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.467581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.467654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.467720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.467790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.467864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.467911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.467914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.467986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.468056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.468122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.468190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.468235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.468247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.468314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.468377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.468442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.468508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.468567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.468575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.468645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.468710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.468775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.468843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.468888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.468898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.468969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.469032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.469104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.469171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.469216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.469223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.469291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.469375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.469440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.469506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.469551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.469560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.469628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.469690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.469753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.469814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.469872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.469880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.469945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.470006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.470066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.470129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.470174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.470181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.470249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391646:3347], now have 1 active actors on pipe
2025-10-10T14:34:14.470512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601377713391646:3347]
2025-10-10T14:34:14.470537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:14.470542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:14.470552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:14.470588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1269 reason: error at write: Disconnected sessionId: src_id|626d86a5-694b0619-337f356-b91efe1c_0
2025-10-10T14:34:14.470839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1269 sessionId: src_id|626d86a5-694b0619-337f356-b91efe1c_0 is DEAD
2025-10-10T14:34:14.470995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:14.471031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626d86a5-694b0619-337f356-b91efe1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:14.471044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626d86a5-694b0619-337f356-b91efe1c_0] Write session will restart in 0.006501s
2025-10-10T14:34:14.471069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626d86a5-694b0619-337f356-b91efe1c_0] Write session: Do CDS request
2025-10-10T14:34:14.471075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626d86a5-694b0619-337f356-b91efe1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:14.478981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|626d86a5-694b0619-337f356-b91efe1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.479086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:14.479102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1270
2025-10-10T14:34:14.479237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.479281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:14.479292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:14.479297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:14.479707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1270 sessionId:  describe result for acl check
2025-10-10T14:34:14.479744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:14.479750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:14.479752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:14.479758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601377713391687:2785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:14.480293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601377713391687:2785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:14.482339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:14.483058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601377713391687:2785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:14.484080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:14.484266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:14.484274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:14.484286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:14.484343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:14.484383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601376931168749:7758]
2025-10-10T14:34:14.484992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:14.485305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:14.485366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:14.485671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:14.485731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.485737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.485738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.485739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.485741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.485742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.485743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.485744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.485745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.485746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.485747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.485748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.485750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.485755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.485768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.485772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.485776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.485780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.485785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.485789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.485793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.485796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.485801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.485805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.485809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.485812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.485819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.485828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.485834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.485840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.485844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.485849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.485858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.485863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.485868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.485853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601377713391687:2785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:14.485868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601377713391687:2785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:14.485873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.485882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.485887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.485893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.485897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.485901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.485872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601377713391687:2785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:14.485892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:14.485906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.485912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.485917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.485921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.485926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.485932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.485938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.485942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.485948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.485952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.485957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.485996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:14.488328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:14.488711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:14.488724Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:14.488729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:14.488733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:14.488739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1269 [2:7559601376931168749:7758]
2025-10-10T14:34:14.488751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:14.488767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:14.488771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.488775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.488778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.488796Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:14.488820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:14.488831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:14.488886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.488894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.488896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.488899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:14.488960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:14.488968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.488980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.488994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.489010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:14.489038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391647:2438], now have 1 active actors on pipe
2025-10-10T14:34:14.489042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391758:2785], now have 1 active actors on pipe
2025-10-10T14:34:14.489049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601376931168743:7758]
2025-10-10T14:34:14.489051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601376931168743:7758]
2025-10-10T14:34:14.489053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601376931168743:7758]
2025-10-10T14:34:14.489068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:14.489082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:14.489085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:14.489088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:14.489090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:14.489104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:14.489108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:14.489098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1269
2025-10-10T14:34:14.489122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1269
2025-10-10T14:34:14.489130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601376931168743:7758]
2025-10-10T14:34:14.489138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:14.489149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:14.489166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.489175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.489213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:14.489225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.489229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.489232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:14.489242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.489253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:14.489276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.489405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.489413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.489428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.489519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1270 partition: 0 MaxSeqNo: 40 sessionId: src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0
2025-10-10T14:34:14.489873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626d86a5-694b0619-337f356-b91efe1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:14.492568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0] Write session: try to update token
2025-10-10T14:34:14.492582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:14.506105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId: src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:14.508502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:14.508539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:14.508542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:14.508544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:14.508555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601376931168743:7758]
2025-10-10T14:34:14.508560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601376931168743:7758]
2025-10-10T14:34:14.508565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601376931168743:7758]
2025-10-10T14:34:14.508615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:14.508623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:14.508631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.508632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:14.508633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:14.508636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:14.508779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:14.508799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:14.570660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601377713391771:3347]
2025-10-10T14:34:14.570980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1269, pipe: [1:7559601377713391771:3347]
2025-10-10T14:34:14.620685Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:14.621126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.621142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.621188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391771:3347], now have 1 active actors on pipe
2025-10-10T14:34:14.621408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:14.621423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:14.621429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601377713391771:3347]
2025-10-10T14:34:14.621449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:14.621462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:14.621502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1270 reason: error at write: Disconnected sessionId: src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0
2025-10-10T14:34:14.621719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1270 sessionId: src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0 is DEAD
2025-10-10T14:34:14.621934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:14.621942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0] Write session will restart in 0.009631s
2025-10-10T14:34:14.621968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0] Write session: Do CDS request
2025-10-10T14:34:14.621975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:14.631469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:14.632935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.633019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:14.633037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1271
2025-10-10T14:34:14.633180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.633228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:14.633239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:14.633243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:14.633370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:14.633597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:14.633611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:14.633624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:14.633688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:14.633695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1271 sessionId:  describe result for acl check
2025-10-10T14:34:14.633735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601376931168853:7761]
2025-10-10T14:34:14.633735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:14.633744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:14.633746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:14.633752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601377713391845:2777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:14.634314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601377713391845:2777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:14.634382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:14.634684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:14.634743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:14.634990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:14.635031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.635035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.635036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.635037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.635037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.635038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.635039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.635040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.635041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.635041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.635042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.635043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.635044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.635048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.635055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.635058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.635060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.635062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.635064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.635067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.635069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.635071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.635073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.635075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.635078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.635080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.635085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.635090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.635095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.635099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.635102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.635105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.635108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.635111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.635114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.635117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.635121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.635125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.635128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.635131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.635134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.635137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.635140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.635143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.635146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.635149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.635153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.635156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.635159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.635162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.635165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.635168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.635190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:14.636737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601377713391845:2777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:14.637647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:14.637989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:14.638003Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:14.638006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:14.638010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:14.638016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1270 [2:7559601376931168853:7761]
2025-10-10T14:34:14.638030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:14.638052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:14.638062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.638066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.638070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.638087Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:14.638100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:14.638127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:14.638189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.638197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.638199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.638202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:14.638276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:14.638284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.638299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.638319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.638342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:14.638368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391778:2438], now have 1 active actors on pipe
2025-10-10T14:34:14.638382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601376931168847:7761]
2025-10-10T14:34:14.638385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601376931168847:7761]
2025-10-10T14:34:14.638388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601376931168847:7761]
2025-10-10T14:34:14.638404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:14.638395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1270
2025-10-10T14:34:14.638424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:14.638428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:14.638432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:14.638434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:14.638449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:14.638458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:14.638491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601376931168847:7761]
2025-10-10T14:34:14.638505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:14.638518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:14.640601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601377713391845:2777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:14.640617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601377713391845:2777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:14.640622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601377713391845:2777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:14.640630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:14.640859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391882:2777], now have 1 active actors on pipe
2025-10-10T14:34:14.640916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1270
2025-10-10T14:34:14.640985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.640998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.641031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:14.641049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.641055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.641063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:14.641076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.641099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:14.641121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.641282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.641291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.641307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.641395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1271 partition: 0 MaxSeqNo: 40 sessionId: src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0
2025-10-10T14:34:14.641803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d54a4c41-184845d4-1fc4a423-46f9e86d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:14.644591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0] Write session: try to update token
2025-10-10T14:34:14.644608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:14.657896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:14.657918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:14.657922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:14.657924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:14.657936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601376931168847:7761]
2025-10-10T14:34:14.657943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601376931168847:7761]
2025-10-10T14:34:14.657948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601376931168847:7761]
2025-10-10T14:34:14.657992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:14.657998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:14.657999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:14.658003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:14.658006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.658009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:14.658176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:14.662924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId: src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:14.665588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:14.721732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601377713391889:3347]
2025-10-10T14:34:14.722010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1270, pipe: [1:7559601377713391889:3347]
2025-10-10T14:34:14.782391Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:14.782717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.782732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.782779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391889:3347], now have 1 active actors on pipe
2025-10-10T14:34:14.782994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:14.782976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601377713391889:3347]
2025-10-10T14:34:14.783028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:14.783080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:14.783164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1271 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0
2025-10-10T14:34:14.783520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:14.783529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0] Write session will restart in 0.008008s
2025-10-10T14:34:14.783385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1271 sessionId: src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0 is DEAD
2025-10-10T14:34:14.783556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0] Write session: Do CDS request
2025-10-10T14:34:14.783562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:14.791040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:14.792495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:14.792713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:14.792726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:14.792738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:14.792789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:14.792833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601376931168959:7764]
2025-10-10T14:34:14.792865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.792917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:14.792932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1272
2025-10-10T14:34:14.793077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.793117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:14.793127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:14.793134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:14.793482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1272 sessionId:  describe result for acl check
2025-10-10T14:34:14.793506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:14.793511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:14.793513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:14.793518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601377713391957:2774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:14.793967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:14.793988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601377713391957:2774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:14.794256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:14.794306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:14.794647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:14.794703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.794710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.794711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.794712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.794713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.794714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.794716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.794717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.794718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.794720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.794721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.794722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.794723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.794729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.794742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.794747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.794752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.794757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.794762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.794766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.794771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.794776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.794781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.794786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.794791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.794796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.794803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.794813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.794820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.794826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.794832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.794842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.794851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.794857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.794867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.794873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.794882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.794889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.794898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.794904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.794910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.794920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.794925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.794931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.794941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.794947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.794957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.794963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.794973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.794979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.794988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.794995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.795046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:14.795637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601377713391957:2774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:14.797234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:14.797653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:14.797668Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:14.797671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:14.797674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:14.797680Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1271 [2:7559601376931168959:7764]
2025-10-10T14:34:14.797692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:14.797714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:14.797722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.797726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.797728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.797743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:14.797756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:14.797769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:14.797826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.797834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.797836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.797838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:14.797900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:14.797908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.797921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.797934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.797958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:14.797983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391890:2438], now have 1 active actors on pipe
2025-10-10T14:34:14.797995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601376931168954:7764]
2025-10-10T14:34:14.798001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601376931168954:7764]
2025-10-10T14:34:14.798003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601376931168954:7764]
2025-10-10T14:34:14.798012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:14.797993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1271
2025-10-10T14:34:14.798026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:14.798028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:14.798032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:14.798035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:14.798047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:14.798050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:14.798076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601376931168954:7764]
2025-10-10T14:34:14.798088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:14.798082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601377713391957:2774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:14.798097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601377713391957:2774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:14.798101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601377713391957:2774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:14.798109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:14.798104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:14.798294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391990:2774], now have 1 active actors on pipe
2025-10-10T14:34:14.798313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1271
2025-10-10T14:34:14.798359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.798372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.798401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:14.798414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.798420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.798422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:14.798433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.798452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:14.798465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.798632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.798640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.798654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.798739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1272 partition: 0 MaxSeqNo: 40 sessionId: src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0
2025-10-10T14:34:14.799073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e1183c-ce6b699b-c62b17e-94b0212_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:14.801807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0] Write session: try to update token
2025-10-10T14:34:14.801826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:14.809226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:14.809249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:14.809260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601376931168954:7764]
2025-10-10T14:34:14.809307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:14.809310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:14.809511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:14.809652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:14.809791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:14.809926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:14.810109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:14.810152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:14.815673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId: src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:14.818446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:14.818670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.818690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.818730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:14.818800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:14.827204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:14.827223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:14.827227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:14.827231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:14.827242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601376931168954:7764]
2025-10-10T14:34:14.827247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601376931168954:7764]
2025-10-10T14:34:14.827253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601376931168954:7764]
2025-10-10T14:34:14.827279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:14.827285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:14.827293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:14.827294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:14.827301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.827304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:14.827430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:14.883034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601377713391998:3347]
2025-10-10T14:34:14.883363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1271, pipe: [1:7559601377713391998:3347]
2025-10-10T14:34:14.951949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:14.960335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.960370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.960564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.960630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.960695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.960761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.960809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.960819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.960912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.960976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.961039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.961110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.961160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.961168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.961236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.961302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.961388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.961455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.961497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.961504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.961569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.961635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.961698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.961762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.961806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.961814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.961892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.961980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.962053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.962126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.962175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.962183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.962257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.962318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.962379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.962439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.962484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.962492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.962555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.962614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.962678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.962746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.962793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.962800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.962864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.962924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.962986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.963047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.963094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.963104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.963168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.963231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.963302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.963371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.963416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.963427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.963493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:14.963553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:14.963617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:14.963681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:14.963725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:14.963732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:14.963791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713391998:3347], now have 1 active actors on pipe
2025-10-10T14:34:14.964013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601377713391998:3347]
2025-10-10T14:34:14.964017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:14.964021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:14.964047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:14.964054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1272 reason: error at write: Disconnected sessionId: src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0
2025-10-10T14:34:14.964296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1272 sessionId: src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0 is DEAD
2025-10-10T14:34:14.964457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:14.964465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0] Write session will restart in 0.008361s
2025-10-10T14:34:14.964491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0] Write session: Do CDS request
2025-10-10T14:34:14.964498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:14.964913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:14.973882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.973921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:14.973940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1273
2025-10-10T14:34:14.974124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:14.974165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:14.974176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:14.974180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:14.974391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:14.974648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1273 sessionId:  describe result for acl check
2025-10-10T14:34:14.974689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:14.974696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:14.974698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:14.974705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601377713392069:2769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:14.975277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601377713392069:2769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:14.976159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:14.976345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:14.976357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:14.976369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:14.976426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:14.976469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601376931169064:7766]
2025-10-10T14:34:14.977276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:14.977628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:14.977680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:14.977720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601377713392069:2769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:14.978026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:14.978084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.978094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.978096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.978097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.978099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.978100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.978101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.978102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.978104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.978105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.978107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.978108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.978110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.978116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.978129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.978134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.978139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.978144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.978148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.978153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.978158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.978162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.978167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.978172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.978176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.978181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.978188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.978201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:14.978209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.978215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:14.978220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.978226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:14.978231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.978237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:14.978247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.978254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:14.978264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.978270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:14.978275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.978281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:14.978286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.978291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:14.978302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.978308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:14.978314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.978323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:14.978333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.978346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.978351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.978359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.978364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.978372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.978425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:14.980630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601377713392069:2769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:14.980642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601377713392069:2769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:14.980646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601377713392069:2769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:14.980654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:14.980707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:14.981128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:14.981143Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:14.981148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:14.981151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:14.981157Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1272 [2:7559601376931169064:7766]
2025-10-10T14:34:14.981169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:14.981184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:14.981192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.981196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.981198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.981214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:14.981221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:14.981233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:14.981286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.981293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.981295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.981298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:14.981380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:14.981388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:14.981401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:14.981420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:14.981444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:14.981469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713392102:2769], now have 1 active actors on pipe
2025-10-10T14:34:14.981477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601377713392002:2438], now have 1 active actors on pipe
2025-10-10T14:34:14.981485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601376931169058:7766]
2025-10-10T14:34:14.981491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601376931169058:7766]
2025-10-10T14:34:14.981494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601376931169058:7766]
2025-10-10T14:34:14.981487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1272
2025-10-10T14:34:14.981509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:14.981493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1272
2025-10-10T14:34:14.981521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:14.981529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:14.981530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:14.981532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:14.981546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:14.981555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:14.981588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.981598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.981613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601376931169058:7766]
2025-10-10T14:34:14.981622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:14.981635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:14.981650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:14.981662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:14.981667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:14.981669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:14.981680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:14.981695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:14.981727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.981922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:14.981932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:14.981950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:14.982043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1273 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0
2025-10-10T14:34:14.982416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47c2cca-daa81dad-b04c6cdd-4985407e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:14.985003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0] Write session: try to update token
2025-10-10T14:34:14.985022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:14.999544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId: src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:15.001055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:15.001073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:15.001076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:15.001078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:15.001090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601376931169058:7766]
2025-10-10T14:34:15.001094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601376931169058:7766]
2025-10-10T14:34:15.001100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601376931169058:7766]
2025-10-10T14:34:15.001151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:15.001151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:15.001158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:15.001161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:15.001163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.001165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:15.001293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:15.002435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:15.064239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601382008359405:3347]
2025-10-10T14:34:15.064568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1272, pipe: [1:7559601382008359405:3347]
2025-10-10T14:34:15.113102Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:15.113418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.113434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.113481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359405:3347], now have 1 active actors on pipe
2025-10-10T14:34:15.113775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:15.113790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:15.113793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:15.113855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1273 reason: error at write: Disconnected sessionId: src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0
2025-10-10T14:34:15.113863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601382008359405:3347]
2025-10-10T14:34:15.113851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:15.114073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1273 sessionId: src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0 is DEAD
2025-10-10T14:34:15.114221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:15.114233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0] Write session will restart in 0.006341s
2025-10-10T14:34:15.114269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0] Write session: Do CDS request
2025-10-10T14:34:15.114277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:15.121889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.121973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:15.121995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1274
2025-10-10T14:34:15.122128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.122177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:15.122201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:15.122204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:15.122704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1274 sessionId:  describe result for acl check
2025-10-10T14:34:15.122741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:15.122747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:15.122749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:15.122755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601382008359476:2756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:15.123312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601382008359476:2756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:15.124073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:15.125758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601382008359476:2756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:15.125867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:15.126075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:15.126086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:15.126097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:15.126149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:15.126201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601381226136466:7768]
2025-10-10T14:34:15.126824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:15.127150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:15.127193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:15.127460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:15.127506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.127512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.127514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.127515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.127516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.127517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.127518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.127520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.127521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.127522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.127523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.127524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.127526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.127532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.127542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.127544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.127546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.127548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.127550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.127552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.127555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.127557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.127559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.127561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.127563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.127565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.127571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.127576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.127584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.127593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.127597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.127602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.127606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.127611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.127621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.127630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.127641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.127651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.127660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.127667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.127670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.127673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.127680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.127683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.127685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.127689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.127691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.127695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.127697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.127700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.127703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.127707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.127758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:15.128368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601382008359476:2756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:15.128387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601382008359476:2756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:15.128391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601382008359476:2756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:15.128398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:15.130137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:15.130545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:15.130565Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:15.130568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:15.130571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:15.130578Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1273 [2:7559601381226136466:7768]
2025-10-10T14:34:15.130591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:15.130610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:15.130614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.130618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.130621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.130638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:15.130652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:15.130659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:15.130715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.130724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.130726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.130730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:15.130805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:15.130817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.130831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.130844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.130863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:15.130891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359406:2438], now have 1 active actors on pipe
2025-10-10T14:34:15.130900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359513:2756], now have 1 active actors on pipe
2025-10-10T14:34:15.130908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601381226136460:7768]
2025-10-10T14:34:15.130911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601381226136460:7768]
2025-10-10T14:34:15.130913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601381226136460:7768]
2025-10-10T14:34:15.130910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1273
2025-10-10T14:34:15.130914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1273
2025-10-10T14:34:15.130928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:15.130938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:15.130941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:15.130943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:15.130950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:15.130968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:15.130971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:15.130989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.130999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.131040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601381226136460:7768]
2025-10-10T14:34:15.131053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:15.131058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:15.131074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|876812f3-c9adc7b0-a218e03c-9295de45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:15.131087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.131094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.131097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:15.131109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.131125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:15.131167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.131320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.131333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.131356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.131467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1274 partition: 0 MaxSeqNo: 40 sessionId: src_id|876812f3-c9adc7b0-a218e03c-9295de45_0
2025-10-10T14:34:15.131899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd458a23-6917485f-64ff3c23-4c7dce7a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|876812f3-c9adc7b0-a218e03c-9295de45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:15.134716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|876812f3-c9adc7b0-a218e03c-9295de45_0] Write session: try to update token
2025-10-10T14:34:15.134738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|876812f3-c9adc7b0-a218e03c-9295de45_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:15.149254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId: src_id|876812f3-c9adc7b0-a218e03c-9295de45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:15.150708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:15.150730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:15.150733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:15.150736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:15.150746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601381226136460:7768]
2025-10-10T14:34:15.150751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601381226136460:7768]
2025-10-10T14:34:15.150758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601381226136460:7768]
2025-10-10T14:34:15.150808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:15.150816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:15.150823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:15.150824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.150827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:15.150829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:15.150980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:15.152000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:15.213788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601382008359520:3347]
2025-10-10T14:34:15.214111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1273, pipe: [1:7559601382008359520:3347]
2025-10-10T14:34:15.267829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:15.268178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.268197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.268246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359520:3347], now have 1 active actors on pipe
2025-10-10T14:34:15.268519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:15.268534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:15.268539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:15.268546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:15.268599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601382008359520:3347]
2025-10-10T14:34:15.268623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1274 reason: error at write: Disconnected sessionId: src_id|876812f3-c9adc7b0-a218e03c-9295de45_0
2025-10-10T14:34:15.268856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1274 sessionId: src_id|876812f3-c9adc7b0-a218e03c-9295de45_0 is DEAD
2025-10-10T14:34:15.269033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876812f3-c9adc7b0-a218e03c-9295de45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:15.269045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876812f3-c9adc7b0-a218e03c-9295de45_0] Write session will restart in 0.006951s
2025-10-10T14:34:15.269069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876812f3-c9adc7b0-a218e03c-9295de45_0] Write session: Do CDS request
2025-10-10T14:34:15.269076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876812f3-c9adc7b0-a218e03c-9295de45_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:15.276923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|876812f3-c9adc7b0-a218e03c-9295de45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.277050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:15.277072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1275
2025-10-10T14:34:15.277202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.277241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:15.277252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:15.277256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:15.277770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1275 sessionId:  describe result for acl check
2025-10-10T14:34:15.277809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:15.277817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:15.277819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:15.277825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601382008359572:2759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:15.278396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601382008359572:2759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:15.280325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:15.281205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601382008359572:2759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:15.282383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:15.282605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:15.282616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:15.282628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:15.282684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:15.282727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601381226136573:7770]
2025-10-10T14:34:15.283379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:15.283435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601382008359572:2759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:15.283450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601382008359572:2759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:15.283453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601382008359572:2759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:15.283461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:15.283704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:15.283756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:15.284080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:15.284127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.284128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.284129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.284130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.284132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.284133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.284134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.284136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.284137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.284139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.284140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.284141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.284142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.284148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.284161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.284165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.284170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.284174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.284178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.284182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.284186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.284190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.284195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.284200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.284204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.284209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.284217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.284226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.284232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.284239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.284244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.284250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.284255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.284261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.284268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.284274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.284279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.284285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.284290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.284296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.284301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.284306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.284311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.284316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.284321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.284327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.284332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.284338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.284343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.284349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.284354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.284359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.284403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:15.286819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:15.287293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:15.287308Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:15.287310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:15.287315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:15.287320Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1274 [2:7559601381226136573:7770]
2025-10-10T14:34:15.287336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:15.287354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:15.287363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.287367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.287374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.287393Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:15.287406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:15.287419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:15.287476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.287486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.287488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.287491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:15.287559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:15.287567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.287580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.287593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.287612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:15.287642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359521:2438], now have 1 active actors on pipe
2025-10-10T14:34:15.287653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359623:2759], now have 1 active actors on pipe
2025-10-10T14:34:15.287661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601381226136567:7770]
2025-10-10T14:34:15.287664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601381226136567:7770]
2025-10-10T14:34:15.287667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601381226136567:7770]
2025-10-10T14:34:15.287683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:15.287697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:15.287689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1274
2025-10-10T14:34:15.287700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:15.287704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:15.287691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1274
2025-10-10T14:34:15.287707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:15.287719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:15.287723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:15.287749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601381226136567:7770]
2025-10-10T14:34:15.287759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:15.287774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:15.287782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.287787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.287841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:15.287853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.287858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.287860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:15.287871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.287886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:15.287909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.288086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.288094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.288109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.288192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1275 partition: 0 MaxSeqNo: 40 sessionId: src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0
2025-10-10T14:34:15.288681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|876812f3-c9adc7b0-a218e03c-9295de45_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:15.291628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0] Write session: try to update token
2025-10-10T14:34:15.291650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:15.310327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:15.310356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:15.310360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:15.310363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:15.310374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601381226136567:7770]
2025-10-10T14:34:15.310380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601381226136567:7770]
2025-10-10T14:34:15.310385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601381226136567:7770]
2025-10-10T14:34:15.310443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:15.310444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:15.310451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:15.310457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:15.310465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.310468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:15.310610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:15.313733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId: src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:15.316711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:15.369407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601382008359646:3347]
2025-10-10T14:34:15.369709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1274, pipe: [1:7559601382008359646:3347]
2025-10-10T14:34:15.426301Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:15.426541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.426549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.426590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359646:3347], now have 1 active actors on pipe
2025-10-10T14:34:15.426833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601382008359646:3347]
2025-10-10T14:34:15.426868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:15.426896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:15.426831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:15.427318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:15.427330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0] Write session will restart in 0.006913s
2025-10-10T14:34:15.427355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0] Write session: Do CDS request
2025-10-10T14:34:15.427362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:15.426974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1275 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0
2025-10-10T14:34:15.427161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1275 sessionId: src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0 is DEAD
2025-10-10T14:34:15.435899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.435964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:15.435982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1276
2025-10-10T14:34:15.436133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.436171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:15.436181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:15.436184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:15.436623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1276 sessionId:  describe result for acl check
2025-10-10T14:34:15.436670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:15.436677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:15.436679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:15.436685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601382008359727:2742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:15.437281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:15.437445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601382008359727:2742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:15.439301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:15.439536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:15.439549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:15.439562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:15.439601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601382008359727:2742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:15.439623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:15.439679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601381226136720:7785]
2025-10-10T14:34:15.440292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:15.440611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:15.440675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:15.441035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:15.441105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.441118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.441120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.441121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.441122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.441123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.441124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.441126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.441127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.441128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.441129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.441130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.441131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.441137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.441150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.441155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.441159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.441163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.441167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.441172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.441176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.441180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.441187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.441191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.441196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.441200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.441208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.441217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.441224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.441230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.441234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.441240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.441245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.441251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.441256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.441262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.441267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.441273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.441278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.441283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.441287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.441292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.441303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.441309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.441313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.441324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.441349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.441356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.441366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.441372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.441382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.441387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.441437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:15.442241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601382008359727:2742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:15.442267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601382008359727:2742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:15.442270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601382008359727:2742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:15.442278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:15.443831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:15.444172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:15.444188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:15.444191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:15.444194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:15.444200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1275 [2:7559601381226136720:7785]
2025-10-10T14:34:15.444212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:15.444230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:15.444240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.444244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.444246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.444266Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:15.444279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:15.444286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:15.444341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.444351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.444353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.444355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:15.444427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:15.444436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.444450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.444463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.444483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:15.444524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601381226136714:7785]
2025-10-10T14:34:15.444531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601381226136714:7785]
2025-10-10T14:34:15.444534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601381226136714:7785]
2025-10-10T14:34:15.444551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:15.444567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359658:2438], now have 1 active actors on pipe
2025-10-10T14:34:15.444569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:15.444572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:15.444574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:15.444577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359763:2742], now have 1 active actors on pipe
2025-10-10T14:34:15.444586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:15.444604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:15.444612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:15.444638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601381226136714:7785]
2025-10-10T14:34:15.444654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:15.444646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1275
2025-10-10T14:34:15.444660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1275
2025-10-10T14:34:15.444784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:15.444836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.444853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.444887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbad11a0-1f949110-258e3e-2b1a329c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:15.444900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.444904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.444911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:15.444923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.444941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:15.444956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.445113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.445125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.445141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.445241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1276 partition: 0 MaxSeqNo: 40 sessionId: src_id|bbad11a0-1f949110-258e3e-2b1a329c_0
2025-10-10T14:34:15.445622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eb3c159-c2f7eacb-2738b160-71cf848_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bbad11a0-1f949110-258e3e-2b1a329c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:15.448310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbad11a0-1f949110-258e3e-2b1a329c_0] Write session: try to update token
2025-10-10T14:34:15.448330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbad11a0-1f949110-258e3e-2b1a329c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:15.462464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId: src_id|bbad11a0-1f949110-258e3e-2b1a329c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:15.464840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:15.464861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:15.464866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:15.464868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:15.464879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601381226136714:7785]
2025-10-10T14:34:15.464884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601381226136714:7785]
2025-10-10T14:34:15.464888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601381226136714:7785]
2025-10-10T14:34:15.464942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:15.464960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.464963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:15.465121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:15.465368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:15.469394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:15.469412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:15.469417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:15.527091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601382008359783:3347]
2025-10-10T14:34:15.527435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1275, pipe: [1:7559601382008359783:3347]
2025-10-10T14:34:15.582385Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:15.582744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.582760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.582809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359783:3347], now have 1 active actors on pipe
2025-10-10T14:34:15.583025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:15.583128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:15.583161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601382008359783:3347]
2025-10-10T14:34:15.583185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:15.583287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1276 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bbad11a0-1f949110-258e3e-2b1a329c_0
2025-10-10T14:34:15.583481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1276 sessionId: src_id|bbad11a0-1f949110-258e3e-2b1a329c_0 is DEAD
2025-10-10T14:34:15.583680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbad11a0-1f949110-258e3e-2b1a329c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:15.583697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbad11a0-1f949110-258e3e-2b1a329c_0] Write session will restart in 0.009302s
2025-10-10T14:34:15.583722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbad11a0-1f949110-258e3e-2b1a329c_0] Write session: Do CDS request
2025-10-10T14:34:15.583728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbad11a0-1f949110-258e3e-2b1a329c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:15.593921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbad11a0-1f949110-258e3e-2b1a329c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.593925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:15.594184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:15.594212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1277
2025-10-10T14:34:15.594369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.594433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:15.594453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:15.594457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:15.594878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1277 sessionId:  describe result for acl check
2025-10-10T14:34:15.594911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:15.594917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:15.594919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:15.594926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601382008359857:2736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:15.595467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601382008359857:2736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:15.596134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:15.596334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:15.596346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:15.596371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:15.596441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:15.596495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601381226136842:7788]
2025-10-10T14:34:15.597161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:15.597457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:15.597508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:15.597879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:15.597935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.597941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.597943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.597944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.597946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.597948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.597949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.597950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.597952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.597953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.597954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.597955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.597957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.597963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.597976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.597981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.597985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.597990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.597995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.597999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.598004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.598008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.598013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.598018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.598022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.598027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.598034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.598043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.598056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.598062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.598067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.598073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.598077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.598057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601382008359857:2736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:15.598084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.598093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.598099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.598104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.598110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.598115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.598122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.598131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.598137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.598144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.598150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.598156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.598162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.598167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.598177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.598182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.598192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.598198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.598204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.598251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:15.600720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601382008359857:2736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:15.600736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601382008359857:2736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:15.600740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601382008359857:2736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:15.600750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:15.600807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:15.601269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:15.601283Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:15.601286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:15.601290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:15.601296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1276 [2:7559601381226136842:7788]
2025-10-10T14:34:15.601308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:15.601326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:15.601351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.601355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.601357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.601373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:15.601381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:15.601394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:15.601454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.601461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.601463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.601466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:15.601533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:15.601541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.601553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.601571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.601597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:15.601619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359784:2438], now have 1 active actors on pipe
2025-10-10T14:34:15.601623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359897:2736], now have 1 active actors on pipe
2025-10-10T14:34:15.601631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601381226136836:7788]
2025-10-10T14:34:15.601633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601381226136836:7788]
2025-10-10T14:34:15.601637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601381226136836:7788]
2025-10-10T14:34:15.601651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:15.601647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1276
2025-10-10T14:34:15.601666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1276
2025-10-10T14:34:15.601665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:15.601666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:15.601670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:15.601672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:15.601687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:15.601691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:15.601723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601381226136836:7788]
2025-10-10T14:34:15.601736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:15.601751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.601751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:15.601760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.601807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:15.601819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.601824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.601828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:15.601839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.601854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:15.601875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.602050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.602058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.602072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.602157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1277 partition: 0 MaxSeqNo: 40 sessionId: src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0
2025-10-10T14:34:15.602547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbad11a0-1f949110-258e3e-2b1a329c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:15.605316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0] Write session: try to update token
2025-10-10T14:34:15.605348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:15.619791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId: src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:15.621284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:15.621311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:15.621315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:15.621317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:15.621326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601381226136836:7788]
2025-10-10T14:34:15.621350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601381226136836:7788]
2025-10-10T14:34:15.621354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601381226136836:7788]
2025-10-10T14:34:15.621403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:15.621402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:15.621408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:15.621413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:15.621416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.621418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:15.621555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:15.622550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:15.683280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601382008359910:3347]
2025-10-10T14:34:15.683531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1276, pipe: [1:7559601382008359910:3347]
2025-10-10T14:34:15.739757Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:15.739992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.740005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.740051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359910:3347], now have 1 active actors on pipe
2025-10-10T14:34:15.740323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:15.740357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:15.740361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:15.740391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601382008359910:3347]
2025-10-10T14:34:15.740686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:15.740845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:15.740857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0] Write session will restart in 0.007799s
2025-10-10T14:34:15.740883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0] Write session: Do CDS request
2025-10-10T14:34:15.740890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:15.740444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1277 reason: error at write: Disconnected sessionId: src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0
2025-10-10T14:34:15.740687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1277 sessionId: src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0 is DEAD
2025-10-10T14:34:15.749951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.750048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:15.750067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1278
2025-10-10T14:34:15.750215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.750252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:15.750267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:15.750271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:15.750691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1278 sessionId:  describe result for acl check
2025-10-10T14:34:15.750726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:15.750735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:15.750738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:15.750744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601382008359982:2729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:15.751312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601382008359982:2729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:15.751489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:15.753398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:15.753592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:15.753604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:15.753617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:15.753667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:15.753672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601382008359982:2729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:15.753710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601381226136955:7791]
2025-10-10T14:34:15.754417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:15.754724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:15.754768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:15.755099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:15.755151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.755160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.755162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.755163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.755164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.755166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.755167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.755169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.755170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.755171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.755172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.755174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.755175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.755180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.755194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.755198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.755203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.755208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.755212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.755217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.755221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.755225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.755231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.755235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.755239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.755243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.755250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.755259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.755266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.755272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.755277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.755283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.755288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.755293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.755299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.755311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.755316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.755326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.755332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.755342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.755346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.755352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.755362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.755368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.755377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.755389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.755398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.755404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.755411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.755417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.755426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.755432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.755477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:15.756068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601382008359982:2729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:15.756083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601382008359982:2729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:15.756087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601382008359982:2729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:15.756094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:15.757885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:15.758199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:15.758213Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:15.758215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:15.758218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:15.758223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1277 [2:7559601381226136955:7791]
2025-10-10T14:34:15.758231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:15.758247Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:15.758250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.758253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.758255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.758273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:15.758285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:15.758293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:15.758352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.758358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.758359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.758361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:15.758447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:15.758456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.758467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.758482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.758504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:15.758533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008359911:2438], now have 1 active actors on pipe
2025-10-10T14:34:15.758541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008360019:2729], now have 1 active actors on pipe
2025-10-10T14:34:15.758550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601381226136949:7791]
2025-10-10T14:34:15.758558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601381226136949:7791]
2025-10-10T14:34:15.758560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601381226136949:7791]
2025-10-10T14:34:15.758573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:15.758590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:15.758601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1277
2025-10-10T14:34:15.758613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1277
2025-10-10T14:34:15.758607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:15.758613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:15.758619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:15.758623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:15.758625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:15.758638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601381226136949:7791]
2025-10-10T14:34:15.758642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:15.758647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:15.758670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.758681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.758724Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:15.758739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.758743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.758745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:15.758757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.758769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:15.758797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.758956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.758969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.758992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.759114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1278 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0
2025-10-10T14:34:15.759466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffefc73-d444bc22-feacbaad-8bbbdc92_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:15.762088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0] Write session: try to update token
2025-10-10T14:34:15.762105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:15.776913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId: src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:15.779141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:15.779170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:15.779175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:15.779177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:15.779188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601381226136949:7791]
2025-10-10T14:34:15.779194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601381226136949:7791]
2025-10-10T14:34:15.779199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601381226136949:7791]
2025-10-10T14:34:15.779259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:15.779265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:15.779278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.779278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:15.779280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:15.779283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:15.779483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:15.780466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:15.840473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601382008360027:3347]
2025-10-10T14:34:15.840801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1277, pipe: [1:7559601382008360027:3347]
2025-10-10T14:34:15.893378Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:15.893840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.893861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.893916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008360027:3347], now have 1 active actors on pipe
2025-10-10T14:34:15.894154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601382008360027:3347]
2025-10-10T14:34:15.894163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:15.894199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:15.894202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:15.894164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:15.894281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1278 reason: error at write: Disconnected sessionId: src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0
2025-10-10T14:34:15.894498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1278 sessionId: src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0 is DEAD
2025-10-10T14:34:15.894666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:15.894678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0] Write session will restart in 0.008738s
2025-10-10T14:34:15.894713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0] Write session: Do CDS request
2025-10-10T14:34:15.894719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:15.904403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:15.904983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.905056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:15.905076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1279
2025-10-10T14:34:15.905223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:15.905257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:15.905268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:15.905272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:15.905794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1279 sessionId:  describe result for acl check
2025-10-10T14:34:15.905838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:15.905846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:15.905847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:15.905854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601382008360102:2722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:15.906377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:15.906453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601382008360102:2722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:15.906584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:15.906598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:15.906610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:15.906676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:15.906751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601381226137067:7793]
2025-10-10T14:34:15.907365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:15.907651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:15.907718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:15.908067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:15.908137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.908144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.908145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.908146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.908147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.908149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.908150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.908151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.908152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.908154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.908155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.908156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.908157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.908164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.908177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.908181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.908185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.908190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.908194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.908198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.908202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.908206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.908211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.908215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.908218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.908222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.908230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.908239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:15.908246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.908252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:15.908257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.908262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:15.908267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.908272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:15.908282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.908288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:15.908298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.908303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:15.908308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.908318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:15.908323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.908329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:15.908335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.908341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:15.908345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.908351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:15.908361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.908367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.908375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.908382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.908392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.908397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.908444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:15.908552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601382008360102:2722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:15.910921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:15.911280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:15.911281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601382008360102:2722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:15.911294Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:15.911296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:15.911296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601382008360102:2722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:15.911299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:15.911300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601382008360102:2722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:15.911306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1278 [2:7559601381226137067:7793]
2025-10-10T14:34:15.911317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:15.911308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:15.911333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:15.911336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.911340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.911343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.911358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:15.911368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:15.911375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:15.911429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.911436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.911438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.911441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:15.911501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:15.911509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.911521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:15.911530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:15.911540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:15.911559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008360028:2438], now have 1 active actors on pipe
2025-10-10T14:34:15.911566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008360136:2722], now have 1 active actors on pipe
2025-10-10T14:34:15.911571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601381226137061:7793]
2025-10-10T14:34:15.911573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601381226137061:7793]
2025-10-10T14:34:15.911574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601381226137061:7793]
2025-10-10T14:34:15.911564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1278
2025-10-10T14:34:15.911566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1278
2025-10-10T14:34:15.911591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:15.911606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:15.911610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:15.911616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:15.911618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:15.911626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:15.911629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:15.911665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.911674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.911694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601381226137061:7793]
2025-10-10T14:34:15.911708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:15.911730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:15.911743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c663200-c53e33ad-eb513c4-186efc30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:15.911751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:15.911759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:15.911761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:15.911771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:15.911783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:15.911803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.911920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:15.911926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:15.911938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:15.912051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1279 partition: 0 MaxSeqNo: 40 sessionId: src_id|8c663200-c53e33ad-eb513c4-186efc30_0
2025-10-10T14:34:15.912416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb741dc-d7bd7b48-5309e334-809fe9c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8c663200-c53e33ad-eb513c4-186efc30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:15.915045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c663200-c53e33ad-eb513c4-186efc30_0] Write session: try to update token
2025-10-10T14:34:15.915064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c663200-c53e33ad-eb513c4-186efc30_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:15.929118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId: src_id|8c663200-c53e33ad-eb513c4-186efc30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:15.931341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:15.931361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:15.931365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:15.931367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:15.931377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601381226137061:7793]
2025-10-10T14:34:15.931385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601381226137061:7793]
2025-10-10T14:34:15.931389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601381226137061:7793]
2025-10-10T14:34:15.931444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:15.931443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:15.931451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:15.931455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:15.931458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:15.931460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:15.931614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:15.931806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:15.994547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601382008360144:3347]
2025-10-10T14:34:15.994895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1278, pipe: [1:7559601382008360144:3347]
2025-10-10T14:34:16.048239Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:16.048570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.048588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.048638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601382008360144:3347], now have 1 active actors on pipe
2025-10-10T14:34:16.048850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:16.048893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:16.048898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:16.048876Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:16.048914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601382008360144:3347]
2025-10-10T14:34:16.048979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1279 reason: error at write: Disconnected sessionId: src_id|8c663200-c53e33ad-eb513c4-186efc30_0
2025-10-10T14:34:16.049379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c663200-c53e33ad-eb513c4-186efc30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:16.049389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c663200-c53e33ad-eb513c4-186efc30_0] Write session will restart in 0.005684s
2025-10-10T14:34:16.049427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c663200-c53e33ad-eb513c4-186efc30_0] Write session: Do CDS request
2025-10-10T14:34:16.049433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c663200-c53e33ad-eb513c4-186efc30_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:16.049215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1279 sessionId: src_id|8c663200-c53e33ad-eb513c4-186efc30_0 is DEAD
2025-10-10T14:34:16.055918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c663200-c53e33ad-eb513c4-186efc30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.056068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:16.056088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1280
2025-10-10T14:34:16.056248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.056298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:16.056312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:16.056316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:16.056834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1280 sessionId:  describe result for acl check
2025-10-10T14:34:16.056873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:16.056880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:16.056882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:16.056889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601386303327461:2715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:16.057515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601386303327461:2715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:16.059811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601386303327461:2715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:16.062254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:16.063915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:16.064134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:16.064147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:16.064159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:16.064154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601386303327461:2715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:16.064171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601386303327461:2715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:16.064175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601386303327461:2715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:16.064185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:16.064212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:16.064257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601385521104476:7795]
2025-10-10T14:34:16.064924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:16.065217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:16.065259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:16.065605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:16.065669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.065675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.065676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.065677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.065679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.065680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.065681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.065682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.065684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.065685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.065686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.065688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.065689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.065696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.065710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.065714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.065719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.065723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.065728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.065733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.065737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.065741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.065746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.065751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.065755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.065759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.065768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.065777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.065785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.065790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.065795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.065802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.065806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.065812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.065817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.065824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.065829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.065836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.065841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.065846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.065851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.065856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.065862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.065867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.065878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.065884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.065894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.065899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.065903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.065909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.065914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.065920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.065973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:16.068424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:16.068921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:16.068937Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:16.068940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:16.068944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:16.068950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1279 [2:7559601385521104476:7795]
2025-10-10T14:34:16.068964Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:16.068983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:16.068992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.068996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.068999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.069017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:16.069029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:16.069043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:16.069113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.069124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.069126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.069129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:16.069210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:16.069219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.069231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.069246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.069268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:16.069297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327441:2438], now have 1 active actors on pipe
2025-10-10T14:34:16.069309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327553:2715], now have 1 active actors on pipe
2025-10-10T14:34:16.069317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601385521104471:7795]
2025-10-10T14:34:16.069321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601385521104471:7795]
2025-10-10T14:34:16.069323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601385521104471:7795]
2025-10-10T14:34:16.069353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:16.069367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:16.069370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:16.069371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:16.069373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:16.069389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:16.069394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:16.069366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1279
2025-10-10T14:34:16.069387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1279
2025-10-10T14:34:16.069446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.069465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.069484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601385521104471:7795]
2025-10-10T14:34:16.069498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:16.069508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:16.069534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:16.069542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.069549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.069552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:16.069565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.069577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:16.069606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.069779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.069794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.069814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.069945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1280 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0
2025-10-10T14:34:16.070373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c663200-c53e33ad-eb513c4-186efc30_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:16.072990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0] Write session: try to update token
2025-10-10T14:34:16.073010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:16.087396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId: src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:16.089528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:16.089553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.089557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:16.089559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:16.089569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601385521104471:7795]
2025-10-10T14:34:16.089575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601385521104471:7795]
2025-10-10T14:34:16.089579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601385521104471:7795]
2025-10-10T14:34:16.089638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:16.089644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:16.089647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.089650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:16.089652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:16.089657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:16.089826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:16.090608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:16.148702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601386303327565:3347]
2025-10-10T14:34:16.149005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1279, pipe: [1:7559601386303327565:3347]
2025-10-10T14:34:16.208404Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:16.208800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.208814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.208855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327565:3347], now have 1 active actors on pipe
2025-10-10T14:34:16.209080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:16.209115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:16.209193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601386303327565:3347]
2025-10-10T14:34:16.209277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:16.209284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:16.209370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1280 reason: error at write: Disconnected sessionId: src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0
2025-10-10T14:34:16.209621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1280 sessionId: src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0 is DEAD
2025-10-10T14:34:16.209788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:16.209799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0] Write session will restart in 0.006259s
2025-10-10T14:34:16.209824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0] Write session: Do CDS request
2025-10-10T14:34:16.209832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:16.216967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.217050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:16.217069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1281
2025-10-10T14:34:16.217193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.217235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:16.217242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:16.217247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:16.217770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1281 sessionId:  describe result for acl check
2025-10-10T14:34:16.217814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:16.217816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:16.217818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:16.217824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601386303327589:2711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:16.218402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601386303327589:2711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:16.220990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601386303327589:2711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:16.221224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:16.223149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:16.223369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:16.223393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:16.223411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:16.223478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:16.223522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601385521104589:7797]
2025-10-10T14:34:16.224174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:16.224229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601386303327589:2711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:16.224250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601386303327589:2711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:16.224254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601386303327589:2711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:16.224265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:16.224531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:16.224625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:16.225005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:16.225078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.225086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.225087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.225089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.225090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.225092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.225093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.225095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.225096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.225097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.225099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.225100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.225101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.225108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.225122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.225126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.225131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.225135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.225139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.225143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.225146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.225149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.225154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.225158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.225161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.225165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.225174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.225182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.225189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.225195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.225200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.225205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.225219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.225224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.225233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.225239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.225243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.225251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.225255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.225259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.225262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.225267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.225271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.225276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.225285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.225289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.225293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.225300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.225309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.225314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.225318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.225326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.225376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:16.227949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:16.228448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:16.228460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:16.228474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:16.228478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:16.228484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1280 [2:7559601385521104589:7797]
2025-10-10T14:34:16.228499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:16.228517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:16.228529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.228533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.228535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.228553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:16.228565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:16.228573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:16.228651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.228658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.228660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.228663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:16.228731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:16.228739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.228750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.228763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.228781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:16.228803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327674:2711], now have 1 active actors on pipe
2025-10-10T14:34:16.228814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327566:2438], now have 1 active actors on pipe
2025-10-10T14:34:16.228822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601385521104584:7797]
2025-10-10T14:34:16.228826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601385521104584:7797]
2025-10-10T14:34:16.228828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601385521104584:7797]
2025-10-10T14:34:16.228841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:16.228856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:16.228863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:16.228867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:16.228869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:16.228882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:16.228887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:16.228922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601385521104584:7797]
2025-10-10T14:34:16.228926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:16.228904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1280
2025-10-10T14:34:16.228908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1280
2025-10-10T14:34:16.228941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:16.228970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.228975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.229008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbca1222-764198a7-15c72fe4-b0af7173_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:16.229025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.229029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.229032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:16.229045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.229063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:16.229085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.229261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.229272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.229291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.229439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1281 partition: 0 MaxSeqNo: 40 sessionId: src_id|bbca1222-764198a7-15c72fe4-b0af7173_0
2025-10-10T14:34:16.229843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7450a2d-3fa60ac-7d489d73-b38db433_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bbca1222-764198a7-15c72fe4-b0af7173_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:16.232783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbca1222-764198a7-15c72fe4-b0af7173_0] Write session: try to update token
2025-10-10T14:34:16.232804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbca1222-764198a7-15c72fe4-b0af7173_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:16.240603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:16.240622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.240637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601385521104584:7797]
2025-10-10T14:34:16.240681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:16.240687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:16.240872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:16.241015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.241152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.241297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.241518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:16.241564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:16.247041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId: src_id|bbca1222-764198a7-15c72fe4-b0af7173_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:16.249540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:16.249732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.249752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.249792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:16.249893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:16.258643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:16.258660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.258663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:16.258665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:16.258676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601385521104584:7797]
2025-10-10T14:34:16.258680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601385521104584:7797]
2025-10-10T14:34:16.258684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601385521104584:7797]
2025-10-10T14:34:16.258731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:16.258739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.258744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:16.258750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:16.258757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:16.258760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:16.258876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:16.309408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601386303327687:3347]
2025-10-10T14:34:16.309744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1280, pipe: [1:7559601386303327687:3347]
2025-10-10T14:34:16.373367Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:16.381471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.381505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.381685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.381750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.381815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.381884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.382237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.382252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.382322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.382382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.382450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.382525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.382573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.382576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.382642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.382701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.382765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.382829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.382873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.382880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.382949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.383013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.383074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.383134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.383179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.383182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.383247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.383309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.383372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.383437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.383483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.383491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.383560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.383619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.383678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.383746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.383790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.383797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.383866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.383927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.383988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.384054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.384093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.384098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.384162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.384220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.384285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.384343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.384389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.384396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.384478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.384535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.384598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.384664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.384714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.384728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.384798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:16.384861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:16.384926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:16.384994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:16.385043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:16.385051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:16.385119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327687:3347], now have 1 active actors on pipe
2025-10-10T14:34:16.385385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601386303327687:3347]
2025-10-10T14:34:16.385417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:16.385431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:16.385436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:16.385467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1281 reason: error at write: Disconnected sessionId: src_id|bbca1222-764198a7-15c72fe4-b0af7173_0
2025-10-10T14:34:16.385716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1281 sessionId: src_id|bbca1222-764198a7-15c72fe4-b0af7173_0 is DEAD
2025-10-10T14:34:16.385879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbca1222-764198a7-15c72fe4-b0af7173_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:16.385889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbca1222-764198a7-15c72fe4-b0af7173_0] Write session will restart in 0.008790s
2025-10-10T14:34:16.385913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbca1222-764198a7-15c72fe4-b0af7173_0] Write session: Do CDS request
2025-10-10T14:34:16.385919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbca1222-764198a7-15c72fe4-b0af7173_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:16.385900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:16.395969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbca1222-764198a7-15c72fe4-b0af7173_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.396043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:16.396064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1282
2025-10-10T14:34:16.396188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.396239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:16.396250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:16.396253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:16.396972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:16.396761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1282 sessionId:  describe result for acl check
2025-10-10T14:34:16.396801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:16.396804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:16.396806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:16.396813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601386303327765:2700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:16.397582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601386303327765:2700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:16.399119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:16.399362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:16.399376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:16.399390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:16.399458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:16.399510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601385521104709:7799]
2025-10-10T14:34:16.400045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601386303327765:2700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:16.400113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:16.400421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:16.400494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:16.400868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:16.400956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.400964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.400965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.400966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.400968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.400969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.400970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.400972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.400973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.400975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.400976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.400977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.400978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.400986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.400999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.401003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.401007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.401011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.401015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.401018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.401023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.401027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.401031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.401035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.401040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.401044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.401052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.401060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.401068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.401075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.401080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.401085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.401091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.401097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.401102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.401107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.401111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.401116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.401123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.401137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.401142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.401147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.401152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.401157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.401161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.401166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.401170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.401175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.401179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.401184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.401188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.401193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.401235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:16.403693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:16.403750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601386303327765:2700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:16.403767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601386303327765:2700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:16.403771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601386303327765:2700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:16.403780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:16.404173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:16.404188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:16.404191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:16.404195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:16.404202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1281 [2:7559601385521104709:7799]
2025-10-10T14:34:16.404217Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:16.404234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:16.404242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.404246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.404248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.404267Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:16.404283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:16.404291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:16.404345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.404356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.404358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.404361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:16.404511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1281
2025-10-10T14:34:16.404517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1281
2025-10-10T14:34:16.404426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:16.404438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.404450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.404476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.404495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:16.404519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327803:2700], now have 1 active actors on pipe
2025-10-10T14:34:16.404523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327688:2438], now have 1 active actors on pipe
2025-10-10T14:34:16.404530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601385521104703:7799]
2025-10-10T14:34:16.404533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601385521104703:7799]
2025-10-10T14:34:16.404535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601385521104703:7799]
2025-10-10T14:34:16.404543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:16.404557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:16.404558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:16.404561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:16.404563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:16.404576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:16.404578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:16.404599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.404604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.404637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601385521104703:7799]
2025-10-10T14:34:16.404647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:16.404662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:16.404667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:16.404676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.404681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.404683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:16.404695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.404705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:16.404736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.404921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.404932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.404947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.405039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1282 partition: 0 MaxSeqNo: 40 sessionId: src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0
2025-10-10T14:34:16.405503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbca1222-764198a7-15c72fe4-b0af7173_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:16.408685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0] Write session: try to update token
2025-10-10T14:34:16.408702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:16.423583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId: src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:16.424768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:16.424796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.424800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:16.424802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:16.424813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601385521104703:7799]
2025-10-10T14:34:16.424817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601385521104703:7799]
2025-10-10T14:34:16.424821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601385521104703:7799]
2025-10-10T14:34:16.424870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:16.424882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:16.424885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:16.424890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:16.424891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.424893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:16.425098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:16.426799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:16.485599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601386303327832:3347]
2025-10-10T14:34:16.485902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1281, pipe: [1:7559601386303327832:3347]
2025-10-10T14:34:16.537378Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:16.537742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.537757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.537801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327832:3347], now have 1 active actors on pipe
2025-10-10T14:34:16.537997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:16.538025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:16.538035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:16.538090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601386303327832:3347]
2025-10-10T14:34:16.538107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1282 reason: error at write: Disconnected sessionId: src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0
2025-10-10T14:34:16.538320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1282 sessionId: src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0 is DEAD
2025-10-10T14:34:16.538416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:16.538501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:16.538509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0] Write session will restart in 0.009040s
2025-10-10T14:34:16.538546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0] Write session: Do CDS request
2025-10-10T14:34:16.538556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:16.548920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.548961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:16.549062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:16.549078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1283
2025-10-10T14:34:16.549267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.549325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:16.549355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:16.549360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:16.549798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1283 sessionId:  describe result for acl check
2025-10-10T14:34:16.549840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:16.549847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:16.549849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:16.549855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601386303327924:2683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:16.550421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601386303327924:2683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:16.550742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:16.550953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:16.550963Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:16.550975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:16.551035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:16.551072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601385521104870:7815]
2025-10-10T14:34:16.551660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:16.551952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:16.551999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:16.552319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:16.552393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.552401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.552402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.552403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.552404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.552406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.552407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.552408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.552409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.552410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.552411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.552412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.552413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.552419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.552431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.552434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.552438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.552442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.552446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.552449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.552464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.552469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.552473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.552476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.552480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.552484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.552491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.552500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.552506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.552511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.552515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.552519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.552524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.552528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.552532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.552537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.552540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.552545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.552549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.552553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.552557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.552561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.552565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.552570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.552574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.552578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.552583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.552588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.552593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.552598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.552603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.552608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.552643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:16.552697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601386303327924:2683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:16.554933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:16.555312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601386303327924:2683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:16.555327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601386303327924:2683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:16.555331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601386303327924:2683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:16.555340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:16.555442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:16.555456Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:16.555459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:16.555462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:16.555468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1282 [2:7559601385521104870:7815]
2025-10-10T14:34:16.555481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:16.555499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:16.555507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.555511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.555513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.555531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:16.555539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:16.555546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:16.555617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.555624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.555627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.555629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:16.555697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:16.555706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.555717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.555727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.555742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:16.555765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327957:2683], now have 1 active actors on pipe
2025-10-10T14:34:16.555769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327845:2438], now have 1 active actors on pipe
2025-10-10T14:34:16.555776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601385521104864:7815]
2025-10-10T14:34:16.555778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601385521104864:7815]
2025-10-10T14:34:16.555781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601385521104864:7815]
2025-10-10T14:34:16.555794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:16.555809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:16.555816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:16.555819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:16.555829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1282
2025-10-10T14:34:16.555841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1282
2025-10-10T14:34:16.555821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:16.555834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:16.555837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:16.555861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601385521104864:7815]
2025-10-10T14:34:16.555865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:16.555873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:16.555890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.555895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.555938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:16.555965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.555970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.555973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:16.555984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.555996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:16.556027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.556199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.556207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.556223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.556358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1283 partition: 0 MaxSeqNo: 40 sessionId: src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0
2025-10-10T14:34:16.556780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce75cc06-5afb48b5-28f6d95a-d558bb5b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:16.560482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0] Write session: try to update token
2025-10-10T14:34:16.560500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:16.576100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:16.576123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.576126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:16.576129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:16.576140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601385521104864:7815]
2025-10-10T14:34:16.576144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601385521104864:7815]
2025-10-10T14:34:16.576148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601385521104864:7815]
2025-10-10T14:34:16.576202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:16.576210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.576212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:16.576217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:16.576233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:16.576238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:16.576360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:16.576426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId: src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:16.579284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:16.638115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601386303327974:3347]
2025-10-10T14:34:16.638423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1282, pipe: [1:7559601386303327974:3347]
2025-10-10T14:34:16.692615Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:16.693137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.693153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.693200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327974:3347], now have 1 active actors on pipe
2025-10-10T14:34:16.693447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:16.693478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:16.693493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:16.693552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1283 reason: error at write: Disconnected sessionId: src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0
2025-10-10T14:34:16.693794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1283 sessionId: src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0 is DEAD
2025-10-10T14:34:16.693895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:16.693947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:16.693961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0] Write session will restart in 0.006312s
2025-10-10T14:34:16.693944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601386303327974:3347]
2025-10-10T14:34:16.693987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0] Write session: Do CDS request
2025-10-10T14:34:16.693993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:16.702149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.702246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:16.702264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1284
2025-10-10T14:34:16.702403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.702441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:16.702452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:16.702457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:16.702944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1284 sessionId:  describe result for acl check
2025-10-10T14:34:16.702986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:16.702991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:16.702993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:16.703000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601386303328036:2675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:16.703555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601386303328036:2675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:16.705043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:16.705942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601386303328036:2675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:16.707282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:16.707523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:16.707535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:16.707547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:16.707602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:16.707646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601385521104989:7818]
2025-10-10T14:34:16.708270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:16.708502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601386303328036:2675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:16.708521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601386303328036:2675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:16.708524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601386303328036:2675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:16.708533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:16.708647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:16.708697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:16.709030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:16.709090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.709097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.709098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.709100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.709101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.709102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.709103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.709104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.709106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.709107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.709108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.709109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.709110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.709116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.709130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.709134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.709138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.709142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.709146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.709151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.709155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.709159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.709163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.709166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.709170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.709174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.709182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.709191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.709198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.709204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.709209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.709214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.709218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.709223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.709227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.709233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.709237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.709243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.709248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.709254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.709258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.709263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.709269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.709274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.709280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.709285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.709290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.709296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.709301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.709306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.709311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.709317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.709377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:16.712031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:16.712699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:16.712730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:16.712734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:16.712738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:16.712745Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1283 [2:7559601385521104989:7818]
2025-10-10T14:34:16.712759Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:16.712780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:16.712790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.712794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.712796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.712815Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:16.712823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:16.712833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:16.712912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.712924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.712926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.712928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:16.713007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:16.713017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.713032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.713048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.713068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:16.713101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303328089:2675], now have 1 active actors on pipe
2025-10-10T14:34:16.713109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303327978:2438], now have 1 active actors on pipe
2025-10-10T14:34:16.713119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601385521104983:7818]
2025-10-10T14:34:16.713121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601385521104983:7818]
2025-10-10T14:34:16.713123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601385521104983:7818]
2025-10-10T14:34:16.713140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:16.713162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:16.713165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:16.713168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:16.713171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:16.713183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:16.713187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:16.713205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1283
2025-10-10T14:34:16.713220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601385521104983:7818]
2025-10-10T14:34:16.713235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:16.713251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1283
2025-10-10T14:34:16.713245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:16.713287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.713301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.713351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:16.713368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.713372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.713375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:16.713390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.713407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:16.713430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.713612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.713621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.713636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.713721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1284 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0
2025-10-10T14:34:16.714179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f686c8e1-6de141d4-c27a6924-8f2ad77d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:16.716933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0] Write session: try to update token
2025-10-10T14:34:16.716953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:16.724667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:16.724689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.724700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601385521104983:7818]
2025-10-10T14:34:16.724747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:16.724751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:16.724925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:16.725074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.725217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.725387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.725585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:16.725631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:16.742503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:16.742532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.742536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:16.742538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:16.742549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601385521104983:7818]
2025-10-10T14:34:16.742553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601385521104983:7818]
2025-10-10T14:34:16.742557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601385521104983:7818]
2025-10-10T14:34:16.742605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:16.742610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:16.742613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.742616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:16.742618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:16.742623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:16.742753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:16.742901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId: src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:16.745520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:16.794298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601386303328099:3347]
2025-10-10T14:34:16.794651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1283, pipe: [1:7559601386303328099:3347]
2025-10-10T14:34:16.855213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:16.855574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.855593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.855621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303328099:3347], now have 1 active actors on pipe
2025-10-10T14:34:16.855883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:16.856416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:16.856429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0] Write session will restart in 0.007326s
2025-10-10T14:34:16.855917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:16.856480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0] Write session: Do CDS request
2025-10-10T14:34:16.855949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:16.856491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:16.856003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601386303328099:3347]
2025-10-10T14:34:16.856018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1284 reason: error at write: Disconnected sessionId: src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0
2025-10-10T14:34:16.856024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:16.856253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1284 sessionId: src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0 is DEAD
2025-10-10T14:34:16.864987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.865123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:16.865142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1285
2025-10-10T14:34:16.865306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:16.865375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:16.865387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:16.865391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:16.865891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1285 sessionId:  describe result for acl check
2025-10-10T14:34:16.865933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:16.865939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:16.865941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:16.865949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601386303328177:2668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:16.866549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601386303328177:2668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:16.867470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:16.869422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601386303328177:2668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:16.869474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:16.869701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:16.869712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:16.869724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:16.869776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:16.869826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601385521105107:7820]
2025-10-10T14:34:16.870488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:16.870794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:16.870853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:16.871191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:16.871249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.871256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.871257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.871259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.871260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.871262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.871263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.871265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.871266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.871267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.871269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.871270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.871271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.871278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.871294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.871300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.871306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.871312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.871318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.871323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.871328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.871332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.871337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.871342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.871347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.871351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.871359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.871368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:16.871375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.871381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:16.871387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.871393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:16.871398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.871404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:16.871409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.871415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:16.871420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.871426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:16.871432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.871438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:16.871443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.871458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:16.871464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.871470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:16.871475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.871481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:16.871487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.871500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.871505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.871512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.871519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.871525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.871571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:16.872523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601386303328177:2668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:16.872539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601386303328177:2668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:16.872543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601386303328177:2668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:16.872552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:16.874140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:16.874468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:16.874484Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:16.874487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:16.874491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:16.874498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1284 [2:7559601385521105107:7820]
2025-10-10T14:34:16.874647Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:16.874672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:16.874677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.874693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.874695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.874716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:16.874730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:16.874738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:16.874802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.874810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.874812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.874815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:16.874887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:16.874895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.874908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:16.874924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:16.874948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:16.874975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303328214:2668], now have 1 active actors on pipe
2025-10-10T14:34:16.874985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303328100:2438], now have 1 active actors on pipe
2025-10-10T14:34:16.874993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601385521105101:7820]
2025-10-10T14:34:16.874995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601385521105101:7820]
2025-10-10T14:34:16.874997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601385521105101:7820]
2025-10-10T14:34:16.875012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:16.875027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:16.875028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:16.875031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:16.875033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:16.875044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:16.875047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:16.875059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1284
2025-10-10T14:34:16.875080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601385521105101:7820]
2025-10-10T14:34:16.875110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1284
2025-10-10T14:34:16.875099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:16.875116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:16.875156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.875167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.875197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|576113c-a4001de2-59e2792f-b42cea32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:16.875213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:16.875218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:16.875220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:16.875233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:16.875244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:16.875267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.875436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.875452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.875488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:16.875608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1285 partition: 0 MaxSeqNo: 40 sessionId: src_id|576113c-a4001de2-59e2792f-b42cea32_0
2025-10-10T14:34:16.876031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ec309a9-9fa6114a-ad7eeeab-95670a08_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|576113c-a4001de2-59e2792f-b42cea32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:16.878995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576113c-a4001de2-59e2792f-b42cea32_0] Write session: try to update token
2025-10-10T14:34:16.879019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576113c-a4001de2-59e2792f-b42cea32_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:16.887381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:16.887405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.887416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601385521105101:7820]
2025-10-10T14:34:16.887474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:16.887467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:16.887669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:16.887835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.888011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.888166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:16.888364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:16.888410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:16.895964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId: src_id|576113c-a4001de2-59e2792f-b42cea32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:16.898555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:16.898816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:16.898847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:16.898892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:16.898985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:16.906264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:16.906288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:16.906291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:16.906294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:16.906305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601385521105101:7820]
2025-10-10T14:34:16.906309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601385521105101:7820]
2025-10-10T14:34:16.906314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601385521105101:7820]
2025-10-10T14:34:16.906356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:16.906360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:16.906364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:16.906365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:16.906373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:16.906376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:16.906513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:16.956104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601386303328221:3347]
2025-10-10T14:34:16.956486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1284, pipe: [1:7559601386303328221:3347]
2025-10-10T14:34:17.022931Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:17.031164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.031197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.031385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.031452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.031518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.031586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.031635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.031644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.031713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.031777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.031837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.031911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.032381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.032393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.032471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.032534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.032600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.032664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.032709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.032716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.032782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.032857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.032917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.032982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.033027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.033036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.033102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.033169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.033235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.033300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.033364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.033371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.033439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.033510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.033573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.033634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.033682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.033692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.033759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.033825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.033892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.033955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.033999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.034010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.034079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.034140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.034199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.034264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.034314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.034326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.034391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.034451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.034513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.034579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.034623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.034630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.034698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:17.034763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:17.034829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:17.034897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:17.034943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:17.034950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:17.035020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601386303328221:3347], now have 1 active actors on pipe
2025-10-10T14:34:17.035224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:17.035254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601386303328221:3347]
2025-10-10T14:34:17.035293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:17.035304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:17.035337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1285 reason: error at write: Disconnected sessionId: src_id|576113c-a4001de2-59e2792f-b42cea32_0
2025-10-10T14:34:17.035635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1285 sessionId: src_id|576113c-a4001de2-59e2792f-b42cea32_0 is DEAD
2025-10-10T14:34:17.035663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:17.035720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576113c-a4001de2-59e2792f-b42cea32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:17.035735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576113c-a4001de2-59e2792f-b42cea32_0] Write session will restart in 0.007589s
2025-10-10T14:34:17.035773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576113c-a4001de2-59e2792f-b42cea32_0] Write session: Do CDS request
2025-10-10T14:34:17.035780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576113c-a4001de2-59e2792f-b42cea32_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:17.044950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|576113c-a4001de2-59e2792f-b42cea32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.045083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:17.045115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1286
2025-10-10T14:34:17.045270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.045315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:17.045326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:17.045340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:17.045820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1286 sessionId:  describe result for acl check
2025-10-10T14:34:17.045875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:17.045882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:17.045885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:17.045892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601390598295598:2664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:17.046544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601390598295598:2664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:17.047366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:17.049602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:17.049758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601390598295598:2664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:17.049852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:17.049864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:17.049876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:17.049944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:17.049990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601389816072522:7822]
2025-10-10T14:34:17.050624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:17.051096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:17.051154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:17.051505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:17.051566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.051568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.051569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.051570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.051572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.051573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.051575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.051576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.051577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.051579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.051580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.051581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.051582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.051589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.051602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.051606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.051611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.051615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.051619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.051623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.051627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.051632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.051636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.051640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.051644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.051648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.051667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.051675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.051682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.051687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.051692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.051697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.051701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.051707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.051712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.051717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.051722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.051728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.051732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.051737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.051741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.051750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.051755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.051772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.051777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.051783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.051788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.051795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.051799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.051804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.051809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.051814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.051857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:17.052794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601390598295598:2664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:17.052826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601390598295598:2664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:17.052830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601390598295598:2664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:17.052840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:17.054443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:17.054935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:17.054948Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:17.054951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:17.054955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:17.054962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1285 [2:7559601389816072522:7822]
2025-10-10T14:34:17.054975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:17.054994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:17.055002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.055006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.055009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.055027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:17.055035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:17.055047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:17.055110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.055117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.055120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.055123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:17.055190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:17.055200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.055213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.055225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.055248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:17.055274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295635:2664], now have 1 active actors on pipe
2025-10-10T14:34:17.055282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295520:2438], now have 1 active actors on pipe
2025-10-10T14:34:17.055291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601389816072517:7822]
2025-10-10T14:34:17.055298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601389816072517:7822]
2025-10-10T14:34:17.055300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601389816072517:7822]
2025-10-10T14:34:17.055314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:17.055330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:17.055337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:17.055341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:17.055343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:17.055351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:17.055355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:17.055363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1285
2025-10-10T14:34:17.055366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1285
2025-10-10T14:34:17.055387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601389816072517:7822]
2025-10-10T14:34:17.055402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:17.055422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:17.055441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.055446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.055481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:17.055493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.055496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.055499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:17.055515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.055531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:17.055551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.055839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.055850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.055868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.055965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1286 partition: 0 MaxSeqNo: 40 sessionId: src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0
2025-10-10T14:34:17.056428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|576113c-a4001de2-59e2792f-b42cea32_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:17.059259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0] Write session: try to update token
2025-10-10T14:34:17.059283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:17.077013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId: src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:17.079699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:17.080751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:17.080772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:17.080777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:17.080779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:17.080789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601389816072517:7822]
2025-10-10T14:34:17.080793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601389816072517:7822]
2025-10-10T14:34:17.080796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601389816072517:7822]
2025-10-10T14:34:17.080843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:17.080851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.080853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:17.080854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:17.080861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:17.080865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:17.080985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:17.135320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601390598295643:3347]
2025-10-10T14:34:17.135627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1285, pipe: [1:7559601390598295643:3347]
2025-10-10T14:34:17.196712Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:17.197134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.197158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.197208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295643:3347], now have 1 active actors on pipe
2025-10-10T14:34:17.197480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:17.197497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601390598295643:3347]
2025-10-10T14:34:17.197496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:17.197544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:17.197547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:17.197615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1286 reason: error at write: Disconnected sessionId: src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0
2025-10-10T14:34:17.197901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1286 sessionId: src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0 is DEAD
2025-10-10T14:34:17.198114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:17.198134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0] Write session will restart in 0.008426s
2025-10-10T14:34:17.198160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0] Write session: Do CDS request
2025-10-10T14:34:17.198166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:17.208274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.208349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:17.208368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1287
2025-10-10T14:34:17.208637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.208689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:17.208700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:17.208704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:17.209602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:17.209183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1287 sessionId:  describe result for acl check
2025-10-10T14:34:17.209224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:17.209226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:17.209228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:17.209235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601390598295725:2658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:17.209880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601390598295725:2658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:17.211532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:17.211763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:17.211774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:17.211785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:17.211837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:17.211880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601389816072642:7824]
2025-10-10T14:34:17.212239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601390598295725:2658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:17.212518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:17.212865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:17.212909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:17.213243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:17.213301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.213307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.213308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.213309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.213310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.213312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.213313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.213314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.213315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.213316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.213317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.213318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.213319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.213325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.213353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.213357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.213362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.213365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.213369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.213373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.213376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.213380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.213384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.213387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.213391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.213395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.213402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.213411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.213418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.213424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.213428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.213433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.213437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.213441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.213447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.213451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.213455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.213460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.213465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.213470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.213481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.213486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.213491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.213500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.213504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.213509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.213517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.213523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.213526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.213536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.213540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.213545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.213582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:17.215994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601390598295725:2658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:17.216011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601390598295725:2658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:17.216014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601390598295725:2658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:17.216022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:17.216066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:17.216387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:17.216398Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:17.216400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:17.216405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:17.216412Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1286 [2:7559601389816072642:7824]
2025-10-10T14:34:17.216424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:17.216457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:17.216464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.216467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.216470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.216488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:17.216500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:17.216508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:17.216564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.216571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.216573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.216575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:17.216643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:17.216649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.216659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.216669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.216687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:17.216709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295644:2438], now have 1 active actors on pipe
2025-10-10T14:34:17.216721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295760:2658], now have 1 active actors on pipe
2025-10-10T14:34:17.216728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601389816072636:7824]
2025-10-10T14:34:17.216732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601389816072636:7824]
2025-10-10T14:34:17.216733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601389816072636:7824]
2025-10-10T14:34:17.216746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:17.216760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:17.216760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:17.216763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:17.216766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:17.216774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:17.216778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:17.216775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1286
2025-10-10T14:34:17.216778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1286
2025-10-10T14:34:17.216803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601389816072636:7824]
2025-10-10T14:34:17.216810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:17.216813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:17.216830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.216839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.216900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:17.216912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.216916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.216919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:17.216930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.216940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:17.216956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.217148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.217157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.217170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.217239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1287 partition: 0 MaxSeqNo: 40 sessionId: src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0
2025-10-10T14:34:17.217682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332c6676-de2d44aa-b637ca32-e31ce1b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:17.220639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0] Write session: try to update token
2025-10-10T14:34:17.220661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:17.237381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId: src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:17.237696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:17.237714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:17.237717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:17.237720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:17.237732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601389816072636:7824]
2025-10-10T14:34:17.237736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601389816072636:7824]
2025-10-10T14:34:17.237740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601389816072636:7824]
2025-10-10T14:34:17.237792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:17.237805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.237807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:17.237805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:17.237813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:17.237817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:17.237948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:17.239985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:17.297600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601390598295768:3347]
2025-10-10T14:34:17.297910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1286, pipe: [1:7559601390598295768:3347]
2025-10-10T14:34:17.351234Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:17.351680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.351694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.351737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295768:3347], now have 1 active actors on pipe
2025-10-10T14:34:17.351961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:17.351976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:17.351996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:17.351997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:17.352052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601390598295768:3347]
2025-10-10T14:34:17.352060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1287 reason: error at write: Disconnected sessionId: src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0
2025-10-10T14:34:17.352268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1287 sessionId: src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0 is DEAD
2025-10-10T14:34:17.352458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:17.352470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0] Write session will restart in 0.005375s
2025-10-10T14:34:17.352494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0] Write session: Do CDS request
2025-10-10T14:34:17.352504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:17.358968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.359052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:17.359071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1288
2025-10-10T14:34:17.359215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.359268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:17.359279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:17.359283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:17.359829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1288 sessionId:  describe result for acl check
2025-10-10T14:34:17.359879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:17.359886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:17.359888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:17.359895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601390598295784:2651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:17.360471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601390598295784:2651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:17.363175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601390598295784:2651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:17.364300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:17.366073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:17.366188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601390598295784:2651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:17.366203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601390598295784:2651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:17.366218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601390598295784:2651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:17.366227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:17.366315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:17.366328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:17.366340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:17.366409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:17.366455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601389816072763:7826]
2025-10-10T14:34:17.367056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:17.367328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:17.367369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:17.367677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:17.367732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.367738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.367739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.367741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.367742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.367743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.367744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.367745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.367746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.367747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.367748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.367750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.367751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.367757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.367771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.367775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.367779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.367783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.367787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.367791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.367795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.367799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.367803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.367807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.367810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.367814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.367821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.367831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.367837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.367842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.367847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.367852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.367856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.367862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.367867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.367872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.367876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.367894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.367904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.367909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.367913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.367923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.367928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.367933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.367942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.367945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.367949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.367952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.367955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.367958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.367960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.367964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.368000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:17.370466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:17.370785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:17.370802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:17.370804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:17.370808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:17.370815Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1287 [2:7559601389816072763:7826]
2025-10-10T14:34:17.370828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:17.370847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:17.370851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.370855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.370858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.370875Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:17.370889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:17.370897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:17.370962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.370969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.370972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.370974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:17.371043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:17.371053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.371065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.371078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.371095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:17.371118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295882:2651], now have 1 active actors on pipe
2025-10-10T14:34:17.371128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295769:2438], now have 1 active actors on pipe
2025-10-10T14:34:17.371135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601389816072758:7826]
2025-10-10T14:34:17.371138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601389816072758:7826]
2025-10-10T14:34:17.371139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601389816072758:7826]
2025-10-10T14:34:17.371152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:17.371169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:17.371184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:17.371190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:17.371194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:17.371196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:17.371164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1287
2025-10-10T14:34:17.371198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:17.371163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1287
2025-10-10T14:34:17.371220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601389816072758:7826]
2025-10-10T14:34:17.371223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:17.371229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:17.371242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.371247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.371421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:17.371439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.371448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.371451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:17.371462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.371474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:17.371504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.371747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.371756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.371772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.371872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1288 partition: 0 MaxSeqNo: 40 sessionId: src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0
2025-10-10T14:34:17.372278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7276b-fc22da43-7e0ef04c-203aa5ab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:17.375014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0] Write session: try to update token
2025-10-10T14:34:17.375034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:17.391129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId: src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:17.391308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:17.391328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:17.391332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:17.391334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:17.391344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601389816072758:7826]
2025-10-10T14:34:17.391349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601389816072758:7826]
2025-10-10T14:34:17.391353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601389816072758:7826]
2025-10-10T14:34:17.391403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:17.391411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:17.391417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.391418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:17.391420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:17.391423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:17.391566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:17.394117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:17.452164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601390598295899:3347]
2025-10-10T14:34:17.452364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1287, pipe: [1:7559601390598295899:3347]
2025-10-10T14:34:17.508129Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:17.508539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.508558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.508608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295899:3347], now have 1 active actors on pipe
2025-10-10T14:34:17.509586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:17.509598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601390598295899:3347]
2025-10-10T14:34:17.509618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:17.509650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:17.509652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:17.509724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1288 reason: error at write: Disconnected sessionId: src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0
2025-10-10T14:34:17.509935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1288 sessionId: src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0 is DEAD
2025-10-10T14:34:17.510081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:17.510099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0] Write session will restart in 0.008208s
2025-10-10T14:34:17.510124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0] Write session: Do CDS request
2025-10-10T14:34:17.510130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:17.519924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.522558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:17.522576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1289
2025-10-10T14:34:17.522762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.522799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:17.522812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:17.522815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:17.523300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1289 sessionId:  describe result for acl check
2025-10-10T14:34:17.523352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:17.523360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:17.523361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:17.523369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601390598296016:2626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:17.524004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601390598296016:2626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:17.524715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:17.526390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601390598296016:2626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:17.526830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:17.527060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:17.527073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:17.527085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:17.527138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:17.527180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601389816072935:7842]
2025-10-10T14:34:17.527834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:17.528139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:17.528191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:17.528549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:17.528612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.528619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.528621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.528622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.528624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.528625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.528627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.528628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.528630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.528631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.528633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.528634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.528636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.528642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.528656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.528661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.528665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.528670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.528674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.528678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.528683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.528688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.528693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.528697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.528702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.528706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.528720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.528730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.528737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.528743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.528748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.528754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.528759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.528770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.528776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.528782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.528787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.528793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.528798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.528803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.528808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.528814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.528820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.528831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.528836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.528847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.528852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.528863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.528868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.528878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.528883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.528893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.528938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:17.529168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601390598296016:2626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:17.529183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601390598296016:2626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:17.529187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601390598296016:2626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:17.529195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:17.531342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:17.531994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:17.532008Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:17.532011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:17.532015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:17.532021Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1288 [2:7559601389816072935:7842]
2025-10-10T14:34:17.532037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:17.532055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:17.532058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.532062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.532066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.532083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:17.532096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:17.532105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:17.532165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.532172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.532174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.532177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:17.532245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:17.532253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.532265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.532276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.532298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:17.532324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598296049:2626], now have 1 active actors on pipe
2025-10-10T14:34:17.532332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598295934:2438], now have 1 active actors on pipe
2025-10-10T14:34:17.532339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601389816072930:7842]
2025-10-10T14:34:17.532346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601389816072930:7842]
2025-10-10T14:34:17.532348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601389816072930:7842]
2025-10-10T14:34:17.532362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:17.532379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:17.532384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:17.532387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:17.532389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:17.532399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:17.532402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:17.532381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1288
2025-10-10T14:34:17.532405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1288
2025-10-10T14:34:17.532437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601389816072930:7842]
2025-10-10T14:34:17.532445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:17.532447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:17.532473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.532485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.532523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:17.532536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.532540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.532542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:17.532555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.532570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:17.532598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.532763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.532779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.532804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.532914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1289 partition: 0 MaxSeqNo: 40 sessionId: src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0
2025-10-10T14:34:17.533310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df35f96-d3fdd91a-4a24e422-4124697a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:17.536016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0] Write session: try to update token
2025-10-10T14:34:17.536036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:17.551552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId: src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:17.552909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:17.552932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:17.552935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:17.552938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:17.552948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601389816072930:7842]
2025-10-10T14:34:17.552954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601389816072930:7842]
2025-10-10T14:34:17.552958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601389816072930:7842]
2025-10-10T14:34:17.553008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:17.553022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.553025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:17.553036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:17.553044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:17.553049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:17.553183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:17.554465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:17.609924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601390598296061:3347]
2025-10-10T14:34:17.610215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1288, pipe: [1:7559601390598296061:3347]
2025-10-10T14:34:17.668901Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:17.669198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.669219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.669265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598296061:3347], now have 1 active actors on pipe
2025-10-10T14:34:17.669516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:17.669547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:17.669532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:17.669647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:17.669705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601390598296061:3347]
2025-10-10T14:34:17.669731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1289 reason: error at write: Disconnected sessionId: src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0
2025-10-10T14:34:17.669940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1289 sessionId: src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0 is DEAD
2025-10-10T14:34:17.670090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:17.670101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0] Write session will restart in 0.007226s
2025-10-10T14:34:17.670126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0] Write session: Do CDS request
2025-10-10T14:34:17.670136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:17.679006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.679104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:17.679122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1290
2025-10-10T14:34:17.679251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.679289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:17.679300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:17.679304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:17.679831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1290 sessionId:  describe result for acl check
2025-10-10T14:34:17.679882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:17.679890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:17.679892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:17.679899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601390598296149:2623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:17.680513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601390598296149:2623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:17.681411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:17.682763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601390598296149:2623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:17.683490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:17.683724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:17.683736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:17.683748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:17.683805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:17.683859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601389816073060:7844]
2025-10-10T14:34:17.684514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:17.684860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:17.684937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:17.685262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:17.685354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.685361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.685362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.685363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.685364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.685365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.685367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.685367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.685369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.685370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.685371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.685373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.685379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601390598296149:2623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:17.685374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.685394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601390598296149:2623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:17.685380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.685398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601390598296149:2623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:17.685393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.685396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.685407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:17.685400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.685403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.685407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.685410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.685413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.685416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.685433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.685436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.685440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.685443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.685452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.685461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.685468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.685472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.685476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.685481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.685485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.685490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.685494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.685499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.685502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.685507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.685512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.685517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.685525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.685530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.685535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.685541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.685550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.685555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.685560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.685565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.685574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.685579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.685588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.685593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.685630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:17.687940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:17.688275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:17.688287Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:17.688288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:17.688303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:17.688308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1289 [2:7559601389816073060:7844]
2025-10-10T14:34:17.688316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:17.688328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:17.688330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.688332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.688334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.688347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:17.688355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:17.688361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:17.688428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.688435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.688436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.688438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:17.688489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:17.688493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.688500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.688507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.688519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:17.688541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601389816073054:7844]
2025-10-10T14:34:17.688547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601389816073054:7844]
2025-10-10T14:34:17.688549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601389816073054:7844]
2025-10-10T14:34:17.688559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:17.688568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:17.688572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:17.688574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:17.688578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:17.688593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:17.688600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:17.688611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598296186:2623], now have 1 active actors on pipe
2025-10-10T14:34:17.688618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598296066:2438], now have 1 active actors on pipe
2025-10-10T14:34:17.688639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601389816073054:7844]
2025-10-10T14:34:17.688651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:17.688660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:17.688656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1289
2025-10-10T14:34:17.688660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1289
2025-10-10T14:34:17.688822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.688833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.688862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b4b44f8-70b8776f-768d6136-822c5949_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:17.688875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.688879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.688881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:17.688893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.688908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:17.688925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.689096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.689104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.689119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.689218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1290 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b4b44f8-70b8776f-768d6136-822c5949_0
2025-10-10T14:34:17.689644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae8ba5b-74f22a06-baa8bfb0-82b32234_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b4b44f8-70b8776f-768d6136-822c5949_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:17.692401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4b44f8-70b8776f-768d6136-822c5949_0] Write session: try to update token
2025-10-10T14:34:17.692435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4b44f8-70b8776f-768d6136-822c5949_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:17.707653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId: src_id|1b4b44f8-70b8776f-768d6136-822c5949_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:17.708340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:17.708361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:17.708365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:17.708367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:17.708377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601389816073054:7844]
2025-10-10T14:34:17.708382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601389816073054:7844]
2025-10-10T14:34:17.708387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601389816073054:7844]
2025-10-10T14:34:17.708453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:17.708464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:17.708466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.708469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:17.708472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:17.708477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:17.708614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:17.710338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:17.769722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601390598296195:3347]
2025-10-10T14:34:17.770024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1289, pipe: [1:7559601390598296195:3347]
2025-10-10T14:34:17.830542Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:17.830980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.830996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.831045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598296195:3347], now have 1 active actors on pipe
2025-10-10T14:34:17.831275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:17.831306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:17.831322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:17.831401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1290 reason: error at write: Disconnected sessionId: src_id|1b4b44f8-70b8776f-768d6136-822c5949_0
2025-10-10T14:34:17.831481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601390598296195:3347]
2025-10-10T14:34:17.831500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:17.831668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1290 sessionId: src_id|1b4b44f8-70b8776f-768d6136-822c5949_0 is DEAD
2025-10-10T14:34:17.831809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4b44f8-70b8776f-768d6136-822c5949_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:17.831821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4b44f8-70b8776f-768d6136-822c5949_0] Write session will restart in 0.005128s
2025-10-10T14:34:17.831846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4b44f8-70b8776f-768d6136-822c5949_0] Write session: Do CDS request
2025-10-10T14:34:17.831853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4b44f8-70b8776f-768d6136-822c5949_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:17.837959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4b44f8-70b8776f-768d6136-822c5949_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.838051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:17.838072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1291
2025-10-10T14:34:17.838189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:17.838221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:17.838226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:17.838230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:17.838719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1291 sessionId:  describe result for acl check
2025-10-10T14:34:17.838751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:17.838753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:17.838755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:17.838761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601390598296210:2617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:17.839347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601390598296210:2617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:17.843147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601390598296210:2617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:17.846267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601390598296210:2617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:17.846286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601390598296210:2617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:17.846290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601390598296210:2617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:17.846300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:17.847435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:17.850142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:17.850426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:17.850442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:17.850456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:17.850517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:17.850567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601389816073185:7847]
2025-10-10T14:34:17.851222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:17.851577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:17.851650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:17.851990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:17.852049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.852051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.852052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.852053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.852055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.852056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.852058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.852059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.852061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.852062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.852064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.852065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.852067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.852073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.852088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.852093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.852098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.852102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.852107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.852111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.852116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.852120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.852124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.852129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.852133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.852137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.852146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.852156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:17.852163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.852169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:17.852175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.852181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:17.852186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.852193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:17.852198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.852204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:17.852209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.852215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:17.852221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.852227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:17.852231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.852238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:17.852243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.852248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:17.852254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.852261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:17.852269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.852275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.852279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.852285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.852289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.852295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.852338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:17.856302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1290
2025-10-10T14:34:17.855307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:17.856347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1290
2025-10-10T14:34:17.855895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:17.855900Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:17.855902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:17.855907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:17.855914Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1290 [2:7559601389816073185:7847]
2025-10-10T14:34:17.855929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:17.855950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:17.855955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.855959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.855961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.855983Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:17.855991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:17.855999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:17.856065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.856067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.856070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.856072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:17.856150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:17.856154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.856167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:17.856181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:17.856200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:17.856225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598296310:2617], now have 1 active actors on pipe
2025-10-10T14:34:17.856229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598296197:2438], now have 1 active actors on pipe
2025-10-10T14:34:17.856238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601389816073180:7847]
2025-10-10T14:34:17.856240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601389816073180:7847]
2025-10-10T14:34:17.856243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601389816073180:7847]
2025-10-10T14:34:17.856260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:17.856274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:17.856291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:17.856294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:17.856299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:17.856302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:17.856305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:17.856329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601389816073180:7847]
2025-10-10T14:34:17.856332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:17.856334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:17.856365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.856371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.856422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:17.856432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:17.856437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:17.856439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:17.856451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:17.856462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:17.856479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.856768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:17.856784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:17.856808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:17.857029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1291 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0
2025-10-10T14:34:17.857463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4b44f8-70b8776f-768d6136-822c5949_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:17.860459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0] Write session: try to update token
2025-10-10T14:34:17.860483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:17.879244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:17.879274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:17.879277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:17.879279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:17.879289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601389816073180:7847]
2025-10-10T14:34:17.879293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601389816073180:7847]
2025-10-10T14:34:17.879297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601389816073180:7847]
2025-10-10T14:34:17.879349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:17.879361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:17.879365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:17.879367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:17.879368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:17.879373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:17.880296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId: src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:17.879515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:17.883010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:17.932000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601390598296324:3347]
2025-10-10T14:34:17.932448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1290, pipe: [1:7559601390598296324:3347]
2025-10-10T14:34:18.001120Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:18.001431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.001446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.001496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601390598296324:3347], now have 1 active actors on pipe
2025-10-10T14:34:18.001753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601390598296324:3347]
2025-10-10T14:34:18.001807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:18.001810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:18.001873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1291 reason: error at write: Disconnected sessionId: src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0
2025-10-10T14:34:18.002082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1291 sessionId: src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0 is DEAD
2025-10-10T14:34:18.002151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:18.002275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:18.002284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0] Write session will restart in 0.005354s
2025-10-10T14:34:18.002302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0] Write session: Do CDS request
2025-10-10T14:34:18.002307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:18.001956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:18.008861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.009021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:18.009035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1292
2025-10-10T14:34:18.009149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.009174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:18.009178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:18.009183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:18.009605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1292 sessionId:  describe result for acl check
2025-10-10T14:34:18.009647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:18.009648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:18.009650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:18.009656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601394893263638:2613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:18.010272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601394893263638:2613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:18.013070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601394893263638:2613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:18.017303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601394893263638:2613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:18.017321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601394893263638:2613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:18.017326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601394893263638:2613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:18.017351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:18.018915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:18.020365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:18.020616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:18.020626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:18.020640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:18.020697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:18.020761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601394111040606:7849]
2025-10-10T14:34:18.021418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:18.021745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:18.021817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:18.022168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:18.022226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.022232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.022233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.022234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.022235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.022237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.022238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.022239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.022241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.022242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.022243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.022244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.022246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.022252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.022266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.022270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.022274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.022278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.022282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.022286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.022290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.022294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.022298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.022301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.022305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.022308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.022316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.022325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.022332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.022338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.022342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.022347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.022352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.022357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.022361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.022366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.022370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.022376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.022380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.022393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.022397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.022402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.022412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.022417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.022421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.022428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.022434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.022443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.022447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.022453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.022462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.022467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.022498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:18.025119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:18.025650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:18.025665Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:18.025667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:18.025671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:18.025678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1291 [2:7559601394111040606:7849]
2025-10-10T14:34:18.025691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:18.025711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:18.025719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.025722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.025725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.025743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:18.025757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:18.025765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:18.025827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.025836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.025838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.025841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:18.025911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:18.025918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.025939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.025954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.025975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:18.025997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893263736:2613], now have 1 active actors on pipe
2025-10-10T14:34:18.026004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893263622:2438], now have 1 active actors on pipe
2025-10-10T14:34:18.026012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601394111040601:7849]
2025-10-10T14:34:18.026019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601394111040601:7849]
2025-10-10T14:34:18.026022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601394111040601:7849]
2025-10-10T14:34:18.026037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:18.026052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:18.026073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:18.026081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:18.026115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601394111040601:7849]
2025-10-10T14:34:18.026122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:18.026310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1291
2025-10-10T14:34:18.026349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1291
2025-10-10T14:34:18.026444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:18.026457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:18.026460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:18.026468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:18.026659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.026673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.026710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:18.026726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.026731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.026733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:18.026746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.026760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:18.026778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.027073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.027081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.027098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.027227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1292 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0
2025-10-10T14:34:18.027648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9a6d643-6f715a76-8327b0b9-a4fdefb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:18.030500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0] Write session: try to update token
2025-10-10T14:34:18.030518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:18.046974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId: src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:18.049849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:18.050923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.050955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.050979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:18.050983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.050986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:18.050988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:18.050997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601394111040601:7849]
2025-10-10T14:34:18.051004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601394111040601:7849]
2025-10-10T14:34:18.051009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601394111040601:7849]
2025-10-10T14:34:18.051056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:18.051071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:18.051073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:18.051081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.051083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:18.051086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:18.051244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:18.101971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601394893263751:3347]
2025-10-10T14:34:18.102296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1291, pipe: [1:7559601394893263751:3347]
2025-10-10T14:34:18.166334Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:18.166663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:18.166727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893263751:3347], now have 1 active actors on pipe
2025-10-10T14:34:18.166817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:18.166988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601394893263751:3347]
2025-10-10T14:34:18.167021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:18.179260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:18.179372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:18.179388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:18.179415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1292 reason: error at write: Disconnected sessionId: src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0
2025-10-10T14:34:18.179597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1292 sessionId: src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0 is DEAD
2025-10-10T14:34:18.179750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:18.179761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0] Write session will restart in 0.007329s
2025-10-10T14:34:18.179786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0] Write session: Do CDS request
2025-10-10T14:34:18.179805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:18.188066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.188167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:18.188186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1293
2025-10-10T14:34:18.188328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.188366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:18.188373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:18.188378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:18.189017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:18.188948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1293 sessionId:  describe result for acl check
2025-10-10T14:34:18.188988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:18.188990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:18.189314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:18.189322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601394893263843:2610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:18.189641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:18.189659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:18.189677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:18.189786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:18.189837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601394111040731:7851]
2025-10-10T14:34:18.189901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601394893263843:2610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:18.190485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:18.191008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:18.191065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:18.191402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:18.191476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.191484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.191485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.191487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.191488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.191489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.191491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.191492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.191494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.191495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.191496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.191497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.191498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.191505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.191517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.191521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.191525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.191529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.191533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.191537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.191541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.191545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.191550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.191554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.191558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.191562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.191569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.191581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.191587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.191592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.191596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.191609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.191615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.191620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.191628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.191633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.191637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.191644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.191649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.191654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.191658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.191664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.191669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.191674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.191679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.191684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.191689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.191694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.191698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.191703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.191708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.191713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.191750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:18.192668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601394893263843:2610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:18.194348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:18.194854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:18.194867Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:18.194870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:18.194876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:18.194882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1292 [2:7559601394111040731:7851]
2025-10-10T14:34:18.194898Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:18.194916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:18.194920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.194924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.194926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.194945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:18.194969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:18.194982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:18.195042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.195050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.195053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.195055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:18.195126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:18.195135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.195149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.195165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.195189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:18.195218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893263753:2438], now have 1 active actors on pipe
2025-10-10T14:34:18.195227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601394111040726:7851]
2025-10-10T14:34:18.195234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601394111040726:7851]
2025-10-10T14:34:18.195235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601394111040726:7851]
2025-10-10T14:34:18.195254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:18.195273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:18.195274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:18.195278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:18.195263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1292
2025-10-10T14:34:18.195280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:18.195294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:18.195297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:18.195326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601394111040726:7851]
2025-10-10T14:34:18.195340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:18.195347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:18.195496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601394893263843:2610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:18.195520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601394893263843:2610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:18.195524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601394893263843:2610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:18.195533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:18.195750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893263877:2610], now have 1 active actors on pipe
2025-10-10T14:34:18.195821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1292
2025-10-10T14:34:18.195887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.195898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.195930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:18.195945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.195950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.195952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:18.195965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.195980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:18.195996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.196153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.196164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.196180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.196268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1293 partition: 0 MaxSeqNo: 40 sessionId: src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0
2025-10-10T14:34:18.196690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a62f5c9-858636a0-e24efc9-22b88af9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:18.199557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0] Write session: try to update token
2025-10-10T14:34:18.199579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:18.208320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:18.208345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.208357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601394111040726:7851]
2025-10-10T14:34:18.208415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:18.208427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:18.208652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:18.208809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.208992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.209145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.209435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:18.209486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:18.214569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId: src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:18.217162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:18.217421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.217456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.217509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:18.217638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:18.227602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:18.227643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.227647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:18.227649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:18.227668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601394111040726:7851]
2025-10-10T14:34:18.227672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601394111040726:7851]
2025-10-10T14:34:18.227677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601394111040726:7851]
2025-10-10T14:34:18.227732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:18.227745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.227746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:18.227752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:18.227752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:18.227757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:18.227911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:18.267371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601394893263883:3347]
2025-10-10T14:34:18.267728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1292, pipe: [1:7559601394893263883:3347]
2025-10-10T14:34:18.342479Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:18.350035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.350076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.350275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.350360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.350435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.350505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.350922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.350932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.351016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.351075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.351137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.351205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.351250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.351253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.351326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.351385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.351451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.351510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.351551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.351554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.351626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.351687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.351753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.351817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.351859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.351862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.351940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.352002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.352063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.352126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.352171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.352174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.352254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.352312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.352370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.352440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.352478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.352479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.352550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.352609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.352686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.352740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.352777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.352780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.352849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.352900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.352953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.353007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.353048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.353051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.353125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.353174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.353224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.353274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.353317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.353319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.353610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.353688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.353758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.353822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.353867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.353874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.353943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893263883:3347], now have 1 active actors on pipe
2025-10-10T14:34:18.354348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:18.354413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:18.354421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601394893263883:3347]
2025-10-10T14:34:18.354426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:18.354473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1293 reason: error at write: Disconnected sessionId: src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0
2025-10-10T14:34:18.354561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:18.354703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1293 sessionId: src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0 is DEAD
2025-10-10T14:34:18.357548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:18.357558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0] Write session will restart in 0.007596s
2025-10-10T14:34:18.357585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0] Write session: Do CDS request
2025-10-10T14:34:18.357592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:18.366897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.367032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:18.367053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1294
2025-10-10T14:34:18.367215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.367271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:18.367281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:18.367285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:18.367706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1294 sessionId:  describe result for acl check
2025-10-10T14:34:18.367745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:18.367751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:18.367754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:18.367761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601394893263975:2604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:18.368065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:18.368375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601394893263975:2604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:18.369677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:18.369892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:18.369903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:18.369916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:18.369973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:18.370024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601394111040858:7853]
2025-10-10T14:34:18.370625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:18.370929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:18.370985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:18.371133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601394893263975:2604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:18.371298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:18.371353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.371360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.371361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.371362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.371364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.371365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.371366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.371367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.371368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.371369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.371370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.371371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.371372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.371378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.371390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.371394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.371398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.371401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.371405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.371408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.371412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.371416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.371420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.371424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.371428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.371431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.371438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.371447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.371454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.371459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.371463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.371468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.371473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.371477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.371482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.371487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.371491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.371496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.371501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.371506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.371510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.371514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.371519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.371525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.371529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.371534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.371543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.371548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.371552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.371557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.371566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.371570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.371609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:18.374059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601394893263975:2604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:18.374079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601394893263975:2604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:18.374083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601394893263975:2604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:18.374093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:18.374101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:18.374600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:18.374618Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:18.374620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:18.374624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:18.374631Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1293 [2:7559601394111040858:7853]
2025-10-10T14:34:18.374645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:18.374663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:18.374667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.374670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.374673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.374691Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:18.374699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:18.374713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:18.374777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.374785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.374787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.374789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:18.374860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:18.374868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.374880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.374891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.374911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:18.374934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264008:2604], now have 1 active actors on pipe
2025-10-10T14:34:18.374943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893263885:2438], now have 1 active actors on pipe
2025-10-10T14:34:18.374952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601394111040853:7853]
2025-10-10T14:34:18.374955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601394111040853:7853]
2025-10-10T14:34:18.374957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601394111040853:7853]
2025-10-10T14:34:18.374971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:18.374989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:18.374992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:18.374992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:18.374995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:18.375008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:18.375012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:18.375002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1293
2025-10-10T14:34:18.375011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1293
2025-10-10T14:34:18.375046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601394111040853:7853]
2025-10-10T14:34:18.375059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:18.375076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:18.375223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.375236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.375273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:18.375287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.375292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.375299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:18.375311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.375325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:18.375346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.375509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.375521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.375546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.375659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1294 partition: 0 MaxSeqNo: 40 sessionId: src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0
2025-10-10T14:34:18.376102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28d815c1-b8ee4a70-2d310d6e-2daf8ab4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:18.379154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0] Write session: try to update token
2025-10-10T14:34:18.379176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:18.386893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:18.386915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.386928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601394111040853:7853]
2025-10-10T14:34:18.386981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:18.386985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:18.387177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:18.387334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.387476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.387624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.387814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:18.387859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:18.395948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId: src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:18.398671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:18.398887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.398915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.398970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:18.399101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:18.407912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:18.407934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.407938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:18.407940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:18.407956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601394111040853:7853]
2025-10-10T14:34:18.407960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601394111040853:7853]
2025-10-10T14:34:18.407963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601394111040853:7853]
2025-10-10T14:34:18.408015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:18.408017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:18.408025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:18.408029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:18.408030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.408032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:18.408178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:18.454996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601394893264016:3347]
2025-10-10T14:34:18.455359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1293, pipe: [1:7559601394893264016:3347]
2025-10-10T14:34:18.523428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:18.531683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.531714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.531889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.531952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.532023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.532104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.532152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.532160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.532233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.532304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.532373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.532695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.532744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.532753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.532827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.532892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.532958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.533029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.533080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.533084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.533157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.533223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.533291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.533376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.533424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.533431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.533504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.533569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.533644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.533719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.533773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.533776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.533844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.533911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.533972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.534034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.534080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.534082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.534157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.534216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.534284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.534353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.534397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.534401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.534471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.534527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.534589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.534652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.534691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.534694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.534762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.534820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.534878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.534944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.534988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.534991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.535064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.535124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.535185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.535246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.535292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.535294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.535626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264016:3347], now have 1 active actors on pipe
2025-10-10T14:34:18.537593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601394893264016:3347]
2025-10-10T14:34:18.537635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:18.537638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:18.537572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:18.537667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1294 reason: error at write: Disconnected sessionId: src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0
2025-10-10T14:34:18.537864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1294 sessionId: src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0 is DEAD
2025-10-10T14:34:18.538209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:18.538427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:18.538436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0] Write session will restart in 0.005217s
2025-10-10T14:34:18.538460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0] Write session: Do CDS request
2025-10-10T14:34:18.538465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:18.544922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.545587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:18.545607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1295
2025-10-10T14:34:18.549437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.549505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:18.549521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:18.549526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:18.550081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1295 sessionId:  describe result for acl check
2025-10-10T14:34:18.550118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:18.550127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:18.550129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:18.550135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601394893264106:2590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:18.550686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601394893264106:2590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:18.552704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601394893264106:2590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:18.553188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:18.555672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:18.555892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:18.555904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:18.555917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:18.555970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:18.556011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601394111041029:7862]
2025-10-10T14:34:18.556221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601394893264106:2590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:18.556238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601394893264106:2590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:18.556242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601394893264106:2590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:18.556265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:18.556667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:18.556997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:18.557066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:18.557422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:18.557482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.557490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.557491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.557492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.557493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.557494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.557495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.557496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.557497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.557498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.557498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.557499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.557500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.557507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.557518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.557521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.557525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.557528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.557532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.557537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.557541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.557544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.557547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.557551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.557554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.557558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.557565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.557574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.557580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.557585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.557589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.557594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.557598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.557603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.557607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.557612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.557615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.557622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.557627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.557632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.557636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.557642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.557646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.557651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.557664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.557668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.557672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.557676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.557680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.557686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.557689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.557695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.557736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:18.560269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:18.560713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:18.560730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:18.560733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:18.560737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:18.560743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1294 [2:7559601394111041029:7862]
2025-10-10T14:34:18.560755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:18.560774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:18.560783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.560787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.560790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.560808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:18.560820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:18.560829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:18.560889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.560897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.560899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.560902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:18.560974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:18.560982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.560995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.561011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.561034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:18.561060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264174:2590], now have 1 active actors on pipe
2025-10-10T14:34:18.561070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264044:2438], now have 1 active actors on pipe
2025-10-10T14:34:18.561078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601394111041010:7862]
2025-10-10T14:34:18.561085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601394111041010:7862]
2025-10-10T14:34:18.561089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601394111041010:7862]
2025-10-10T14:34:18.561104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:18.561117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:18.561120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:18.561122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:18.561123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:18.561140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:18.561131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1294
2025-10-10T14:34:18.561141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1294
2025-10-10T14:34:18.561145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:18.561186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601394111041010:7862]
2025-10-10T14:34:18.561194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:18.561202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:18.561208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.561214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.561262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:18.561270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.561274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.561276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:18.561289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.561300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:18.561318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.561536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.561549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.561568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.561660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1295 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0
2025-10-10T14:34:18.562894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f1c8a8e-158ebfd5-b8d2cf46-4d9349f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:18.565567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0] Write session: try to update token
2025-10-10T14:34:18.565589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:18.580431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId: src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:18.582796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:18.582827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.582831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:18.582833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:18.582843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601394111041010:7862]
2025-10-10T14:34:18.582850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601394111041010:7862]
2025-10-10T14:34:18.582854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601394111041010:7862]
2025-10-10T14:34:18.582910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:18.582910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:18.582917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:18.582921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:18.582926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.582929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:18.583079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:18.583215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:18.637514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601394893264192:3347]
2025-10-10T14:34:18.638013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1294, pipe: [1:7559601394893264192:3347]
2025-10-10T14:34:18.700651Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:18.700997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.701012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.701060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264192:3347], now have 1 active actors on pipe
2025-10-10T14:34:18.701326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:18.701344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601394893264192:3347]
2025-10-10T14:34:18.701386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:18.701684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:18.701755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1295 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0
2025-10-10T14:34:18.702139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:18.702150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0] Write session will restart in 0.009164s
2025-10-10T14:34:18.701964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1295 sessionId: src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0 is DEAD
2025-10-10T14:34:18.702175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0] Write session: Do CDS request
2025-10-10T14:34:18.702181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:18.713269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.713243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:18.713285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:18.713302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1296
2025-10-10T14:34:18.713519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.713574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:18.713585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:18.713589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:18.714046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1296 sessionId:  describe result for acl check
2025-10-10T14:34:18.714082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:18.714089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:18.714091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:18.714098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601394893264287:2576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:18.714687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601394893264287:2576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:18.715346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:18.715547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:18.715558Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:18.715570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:18.715631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:18.715671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601394111041167:7872]
2025-10-10T14:34:18.716333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:18.716709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:18.716760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:18.716965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601394893264287:2576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:18.717106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:18.717165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.717171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.717172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.717173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.717175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.717175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.717177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.717178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.717179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.717180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.717181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.717182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.717184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.717190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.717202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.717207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.717211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.717215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.717220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.717224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.717229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.717233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.717238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.717243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.717247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.717251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.717258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.717268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.717275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.717281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.717286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.717292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.717297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.717303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.717308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.717315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.717320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.717326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.717349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.717355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.717360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.717366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.717371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.717377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.717381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.717387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.717394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.717399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.717412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.717418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.717423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.717428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.717475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:18.719745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601394893264287:2576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:18.719761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601394893264287:2576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:18.719765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601394893264287:2576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:18.719774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:18.719877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:18.720216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:18.720232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:18.720234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:18.720239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:18.720245Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1295 [2:7559601394111041167:7872]
2025-10-10T14:34:18.720257Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:18.720275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:18.720283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.720287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.720289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.720307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:18.720315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:18.720329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:18.720408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.720417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.720419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.720422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:18.720488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:18.720497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.720509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.720528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.720545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:18.720573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601394111041161:7872]
2025-10-10T14:34:18.720580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601394111041161:7872]
2025-10-10T14:34:18.720582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601394111041161:7872]
2025-10-10T14:34:18.720596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:18.720610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:18.720632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:18.720639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:18.720640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:18.720643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:18.720645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:18.720665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601394111041161:7872]
2025-10-10T14:34:18.720673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:18.720728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:18.720773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264196:2438], now have 1 active actors on pipe
2025-10-10T14:34:18.720794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264321:2576], now have 1 active actors on pipe
2025-10-10T14:34:18.720834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1295
2025-10-10T14:34:18.720849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1295
2025-10-10T14:34:18.720874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.720885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.720930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cba03c22-647ee3ae-7415c144-f1719735_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:18.720944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.720948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.720951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:18.720963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.720983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:18.721005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.721178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.721185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.721200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.721287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1296 partition: 0 MaxSeqNo: 40 sessionId: src_id|cba03c22-647ee3ae-7415c144-f1719735_0
2025-10-10T14:34:18.721653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1e66ca7-457a6b77-8fe610d6-bb75ea51_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cba03c22-647ee3ae-7415c144-f1719735_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:18.724265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba03c22-647ee3ae-7415c144-f1719735_0] Write session: try to update token
2025-10-10T14:34:18.724283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba03c22-647ee3ae-7415c144-f1719735_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:18.731974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:18.732013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.732024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601394111041161:7872]
2025-10-10T14:34:18.732073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:18.732079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:18.732242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:18.732394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.732540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.732682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:18.732876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:18.732923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:18.741072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId: src_id|cba03c22-647ee3ae-7415c144-f1719735_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:18.743841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:18.744061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.744087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.744133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:18.744209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:18.750557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:18.750574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.750577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:18.750579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:18.750589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601394111041161:7872]
2025-10-10T14:34:18.750594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601394111041161:7872]
2025-10-10T14:34:18.750598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601394111041161:7872]
2025-10-10T14:34:18.750659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:18.750668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:18.750676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.750677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:18.750679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:18.750681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:18.750820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:18.801372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601394893264329:3347]
2025-10-10T14:34:18.801659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1295, pipe: [1:7559601394893264329:3347]
2025-10-10T14:34:18.863359Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:18.875510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.875542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.875722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.875789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.875855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.875919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.875967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.875979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.876048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.876111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.876173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.876240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.876283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.876289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.876355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.876424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.876489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.876552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.876598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.876608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.876675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.876745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.876812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.876881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.876925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.876932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.877000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.877062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.877131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.877195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.877259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.877266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.877345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.877405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.877465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.877530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.877572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.877580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.877642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.877705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.877765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.877827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.877871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.877877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.877944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.878004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.878067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.878135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.878181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.878187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.879084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:18.879103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:18.879107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:18.879149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601394893264329:3347]
2025-10-10T14:34:18.879151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1296 reason: error at write: Disconnected sessionId: src_id|cba03c22-647ee3ae-7415c144-f1719735_0
2025-10-10T14:34:18.879390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1296 sessionId: src_id|cba03c22-647ee3ae-7415c144-f1719735_0 is DEAD
2025-10-10T14:34:18.879656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba03c22-647ee3ae-7415c144-f1719735_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:18.879666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba03c22-647ee3ae-7415c144-f1719735_0] Write session will restart in 0.006847s
2025-10-10T14:34:18.879693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba03c22-647ee3ae-7415c144-f1719735_0] Write session: Do CDS request
2025-10-10T14:34:18.879701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba03c22-647ee3ae-7415c144-f1719735_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:18.878252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.878312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.878366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.878424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.878464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.878466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.878529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:18.878584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:18.878639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:18.878697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:18.878736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:18.878741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:18.878813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264329:3347], now have 1 active actors on pipe
2025-10-10T14:34:18.880017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:18.887976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba03c22-647ee3ae-7415c144-f1719735_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.888068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:18.888088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1297
2025-10-10T14:34:18.888215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:18.888252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:18.888272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:18.888280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:18.888804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1297 sessionId:  describe result for acl check
2025-10-10T14:34:18.888854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:18.888863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:18.888865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:18.888872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601394893264384:2574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:18.889480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601394893264384:2574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:18.892328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601394893264384:2574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:18.892401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:18.894263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:18.894478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:18.894490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:18.894503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:18.894556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:18.894597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601394111041297:7874]
2025-10-10T14:34:18.895084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601394893264384:2574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:18.895097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601394893264384:2574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:18.895100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601394893264384:2574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:18.895108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:18.895240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:18.895498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:18.895544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:18.895889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:18.895944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.895950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.895952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.895953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.895954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.895956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.895957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.895958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.895959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.895961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.895962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.895963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.895964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.895970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.895983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.895988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.895992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.895996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.896000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.896004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.896008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.896012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.896016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.896020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.896024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.896028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.896035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.896045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:18.896052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.896058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:18.896062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.896072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:18.896076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.896082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:18.896087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.896093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:18.896097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.896103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:18.896112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.896119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:18.896125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.896131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:18.896136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.896142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:18.896147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.896152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:18.896158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.896163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.896168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.896174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.896179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.896184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.896228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:18.898535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:18.898950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:18.898964Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:18.898966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:18.898970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:18.898978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1296 [2:7559601394111041297:7874]
2025-10-10T14:34:18.898991Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:18.899012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:18.899016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.899020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.899023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.899039Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:18.899052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:18.899060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:18.899114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.899121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.899124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.899127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:18.899193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:18.899200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.899212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:18.899227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:18.899248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:18.899273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264330:2438], now have 1 active actors on pipe
2025-10-10T14:34:18.899280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264453:2574], now have 1 active actors on pipe
2025-10-10T14:34:18.899289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601394111041292:7874]
2025-10-10T14:34:18.899291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601394111041292:7874]
2025-10-10T14:34:18.899294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601394111041292:7874]
2025-10-10T14:34:18.899303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:18.899286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1296
2025-10-10T14:34:18.899317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:18.899288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1296
2025-10-10T14:34:18.899328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:18.899336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:18.899337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:18.899339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:18.899340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:18.899381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.899390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.899404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601394111041292:7874]
2025-10-10T14:34:18.899416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:18.899420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:18.899444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:18.899456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:18.899459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:18.899462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:18.899472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:18.899484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:18.899509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.899641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:18.899651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:18.899666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:18.899762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1297 partition: 0 MaxSeqNo: 40 sessionId: src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0
2025-10-10T14:34:18.900212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba03c22-647ee3ae-7415c144-f1719735_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:18.903231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0] Write session: try to update token
2025-10-10T14:34:18.903251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:18.917847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId: src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:18.918614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:18.918635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:18.918637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:18.918642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:18.918649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601394111041292:7874]
2025-10-10T14:34:18.918652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601394111041292:7874]
2025-10-10T14:34:18.918655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601394111041292:7874]
2025-10-10T14:34:18.918704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:18.918715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:18.918717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:18.918719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:18.918722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:18.918740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:18.918871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:18.920657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:18.979535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601394893264465:3347]
2025-10-10T14:34:18.979840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1296, pipe: [1:7559601394893264465:3347]
2025-10-10T14:34:19.031105Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:19.031565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.031583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.031632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601394893264465:3347], now have 1 active actors on pipe
2025-10-10T14:34:19.031880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601394893264465:3347]
2025-10-10T14:34:19.031882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:19.031886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:19.031918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:19.031961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1297 reason: error at write: Disconnected sessionId: src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0
2025-10-10T14:34:19.032204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1297 sessionId: src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0 is DEAD
2025-10-10T14:34:19.032353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:19.032364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0] Write session will restart in 0.007732s
2025-10-10T14:34:19.032400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0] Write session: Do CDS request
2025-10-10T14:34:19.032408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:19.031834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:19.041000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.041038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:19.041058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1298
2025-10-10T14:34:19.041261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.041304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:19.041315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:19.041319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:19.041826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1298 sessionId:  describe result for acl check
2025-10-10T14:34:19.041866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:19.041872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:19.041875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:19.041881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601399188231827:2568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:19.042471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601399188231827:2568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:19.044503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601399188231827:2568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:19.044758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:19.046725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:19.046949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:19.046959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:19.046971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:19.047024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:19.047065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601398406008725:7876]
2025-10-10T14:34:19.047714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:19.047909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601399188231827:2568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:19.047926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601399188231827:2568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:19.047930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601399188231827:2568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:19.047939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:19.047975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:19.048020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:19.048355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:19.048430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.048436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.048437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.048438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.048439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.048441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.048442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.048443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.048444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.048446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.048447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.048449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.048450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.048456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.048468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.048473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.048476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.048480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.048484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.048488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.048493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.048497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.048501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.048505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.048509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.048513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.048521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.048530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.048536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.048547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.048552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.048562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.048566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.048572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.048581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.048586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.048591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.048596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.048600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.048606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.048610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.048616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.048620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.048626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.048630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.048635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.048639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.048643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.048651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.048656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.048660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.048669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.048710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:19.051296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:19.051705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:19.051733Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:19.051735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:19.051740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:19.051747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1297 [2:7559601398406008725:7876]
2025-10-10T14:34:19.051761Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:19.051780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:19.051788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.051792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.051794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.051813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:19.051827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:19.051839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:19.051912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.051923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.051925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.051929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:19.052016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:19.052024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.052036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.052052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.052072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:19.052104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188231762:2438], now have 1 active actors on pipe
2025-10-10T14:34:19.052108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188231887:2568], now have 1 active actors on pipe
2025-10-10T14:34:19.052116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601398406008720:7876]
2025-10-10T14:34:19.052119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601398406008720:7876]
2025-10-10T14:34:19.052121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601398406008720:7876]
2025-10-10T14:34:19.052137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:19.052125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1297
2025-10-10T14:34:19.052151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:19.052135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1297
2025-10-10T14:34:19.052155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:19.052158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:19.052161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:19.052180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:19.052185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:19.052248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.052261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.052277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601398406008720:7876]
2025-10-10T14:34:19.052296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:19.052307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:19.052336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:19.052352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.052357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.052360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:19.052388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.052409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:19.052441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.052630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.052639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.052658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.052748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1298 partition: 0 MaxSeqNo: 40 sessionId: src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0
2025-10-10T14:34:19.053163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77def71b-71e0fd71-41ab7d39-b1f3d8ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:19.055999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0] Write session: try to update token
2025-10-10T14:34:19.056020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:19.071376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId: src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:19.073527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:19.073545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:19.073550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:19.073552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:19.073563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601398406008720:7876]
2025-10-10T14:34:19.073571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601398406008720:7876]
2025-10-10T14:34:19.073574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601398406008720:7876]
2025-10-10T14:34:19.073619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:19.073624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:19.073626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:19.073628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:19.073634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.073636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:19.073780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:19.074197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:19.132116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601399188231896:3347]
2025-10-10T14:34:19.132412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1297, pipe: [1:7559601399188231896:3347]
2025-10-10T14:34:19.185353Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:19.185831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.185847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.185895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188231896:3347], now have 1 active actors on pipe
2025-10-10T14:34:19.186142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:19.186209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:19.186217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601399188231896:3347]
2025-10-10T14:34:19.186246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:19.186338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1298 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0
2025-10-10T14:34:19.186580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1298 sessionId: src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0 is DEAD
2025-10-10T14:34:19.186774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:19.186798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0] Write session will restart in 0.006185s
2025-10-10T14:34:19.186824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0] Write session: Do CDS request
2025-10-10T14:34:19.186830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:19.193908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.193988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:19.194007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1299
2025-10-10T14:34:19.194171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.194211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:19.194222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:19.194226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:19.194677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1299 sessionId:  describe result for acl check
2025-10-10T14:34:19.194722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:19.194729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:19.194730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:19.194737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601399188231913:2565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:19.195392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601399188231913:2565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:19.198512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601399188231913:2565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:19.201302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:19.201350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601399188231913:2565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:19.201367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601399188231913:2565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:19.201371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601399188231913:2565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:19.201381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:19.203336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:19.203597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:19.203609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:19.203621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:19.203686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:19.203733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601398406008858:7878]
2025-10-10T14:34:19.204354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:19.204727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:19.204776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:19.205103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:19.205164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.205165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.205166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.205167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.205169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.205170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.205171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.205173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.205174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.205175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.205176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.205177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.205178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.205185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.205197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.205201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.205205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.205208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.205212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.205216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.205219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.205223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.205227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.205230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.205234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.205237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.205244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.205253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.205259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.205265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.205269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.205274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.205278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.205283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.205287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.205292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.205296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.205300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.205305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.205309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.205313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.205318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.205322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.205327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.205354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.205365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.205369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.205375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.205379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.205384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.205391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.205395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.205430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:19.208769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1298
2025-10-10T14:34:19.208779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1298
2025-10-10T14:34:19.208026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:19.208384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:19.208390Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:19.208394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:19.208398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:19.208406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1298 [2:7559601398406008858:7878]
2025-10-10T14:34:19.208421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:19.208442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:19.208445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.208449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.208451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.208471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:19.208479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:19.208487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:19.208553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.208555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.208557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.208560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:19.208636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:19.208639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.208650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.208663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.208681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:19.208706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232021:2565], now have 1 active actors on pipe
2025-10-10T14:34:19.208710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188231898:2438], now have 1 active actors on pipe
2025-10-10T14:34:19.208718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601398406008852:7878]
2025-10-10T14:34:19.208720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601398406008852:7878]
2025-10-10T14:34:19.208722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601398406008852:7878]
2025-10-10T14:34:19.208732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:19.208742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:19.208746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:19.208748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:19.208749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:19.208765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:19.208768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:19.208805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601398406008852:7878]
2025-10-10T14:34:19.208808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:19.208811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:19.208832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.208837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.208948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:19.208957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.208961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.208963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:19.208974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.208988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:19.209005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.209303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.209317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.209366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.209513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1299 partition: 0 MaxSeqNo: 40 sessionId: src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0
2025-10-10T14:34:19.209963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bcb18af-e296a2da-4ed8c9f8-c079226_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:19.212732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0] Write session: try to update token
2025-10-10T14:34:19.212758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:19.228503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId: src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:19.229217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:19.229235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:19.229239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:19.229241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:19.229254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601398406008852:7878]
2025-10-10T14:34:19.229259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601398406008852:7878]
2025-10-10T14:34:19.229263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601398406008852:7878]
2025-10-10T14:34:19.229313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:19.229313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:19.229320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:19.229324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:19.229325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.229352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:19.229537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:19.231362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:19.286215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601399188232033:3347]
2025-10-10T14:34:19.286580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1298, pipe: [1:7559601399188232033:3347]
2025-10-10T14:34:19.353322Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:19.353792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.353810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.353859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232033:3347], now have 1 active actors on pipe
2025-10-10T14:34:19.355788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:19.356411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:19.356423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0] Write session will restart in 0.006405s
2025-10-10T14:34:19.355908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:19.355927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:19.356450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0] Write session: Do CDS request
2025-10-10T14:34:19.355947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:19.355998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601399188232033:3347]
2025-10-10T14:34:19.356457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:19.356004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1299 reason: error at write: Disconnected sessionId: src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0
2025-10-10T14:34:19.356224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1299 sessionId: src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0 is DEAD
2025-10-10T14:34:19.363884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.363971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:19.363989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1300
2025-10-10T14:34:19.364202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.364249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:19.364260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:19.364264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:19.364746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1300 sessionId:  describe result for acl check
2025-10-10T14:34:19.364780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:19.364788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:19.364790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:19.364796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601399188232051:2560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:19.365390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601399188232051:2560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:19.368423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601399188232051:2560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:19.370672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:19.370997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601399188232051:2560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:19.371012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601399188232051:2560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:19.371016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601399188232051:2560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:19.371025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:19.372697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:19.372914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:19.372926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:19.372939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:19.372996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:19.373036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601398406008991:7880]
2025-10-10T14:34:19.373700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:19.374037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:19.374085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:19.374442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:19.374508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.374516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.374517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.374518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.374519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.374520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.374522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.374523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.374525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.374526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.374528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.374530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.374531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.374538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.374553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.374558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.374563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.374568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.374573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.374577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.374582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.374586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.374592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.374597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.374601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.374606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.374615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.374624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.374632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.374649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.374655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.374662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.374667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.374673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.374680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.374686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.374696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.374703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.374712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.374723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.374728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.374734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.374740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.374746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.374754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.374761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.374769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.374774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.374781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.374787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.374793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.374801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.374851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:19.377364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:19.377693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:19.377713Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:19.377716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:19.377720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:19.377727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1299 [2:7559601398406008991:7880]
2025-10-10T14:34:19.377740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:19.377758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:19.377762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.377766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.377768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.377785Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:19.377792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:19.377799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:19.377858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.377867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.377870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.377873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:19.377959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:19.377970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.377983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.377995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.378013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:19.378036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232035:2438], now have 1 active actors on pipe
2025-10-10T14:34:19.378045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232160:2560], now have 1 active actors on pipe
2025-10-10T14:34:19.378053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601398406008985:7880]
2025-10-10T14:34:19.378057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601398406008985:7880]
2025-10-10T14:34:19.378060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601398406008985:7880]
2025-10-10T14:34:19.378076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:19.378094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:19.378099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:19.378110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:19.378111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:19.378113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:19.378114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:19.378099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1299
2025-10-10T14:34:19.378141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601398406008985:7880]
2025-10-10T14:34:19.378150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:19.378102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1299
2025-10-10T14:34:19.378152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:19.378168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.378178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.378229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab363b46-f2243971-14d56caf-adf757_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:19.378241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.378246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.378248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:19.378260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.378270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:19.378294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.378458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.378466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.378482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.378668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1300 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab363b46-f2243971-14d56caf-adf757_0
2025-10-10T14:34:19.379084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da3dc62-7c6b8c14-1ebbdda1-8a9aa69_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab363b46-f2243971-14d56caf-adf757_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:19.381843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab363b46-f2243971-14d56caf-adf757_0] Write session: try to update token
2025-10-10T14:34:19.381864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab363b46-f2243971-14d56caf-adf757_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:19.401155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:19.401175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:19.401180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:19.401182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:19.401192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601398406008985:7880]
2025-10-10T14:34:19.401198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601398406008985:7880]
2025-10-10T14:34:19.401202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601398406008985:7880]
2025-10-10T14:34:19.401253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:19.401253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:19.401259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:19.401263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.401264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:19.401266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:19.401425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:19.404642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId: src_id|ab363b46-f2243971-14d56caf-adf757_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:19.408150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:19.456216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601399188232172:3347]
2025-10-10T14:34:19.456517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1299, pipe: [1:7559601399188232172:3347]
2025-10-10T14:34:19.523108Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:19.523611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.523633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.523681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232172:3347], now have 1 active actors on pipe
2025-10-10T14:34:19.523900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:19.523924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:19.523925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601399188232172:3347]
2025-10-10T14:34:19.523966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:19.524059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab363b46-f2243971-14d56caf-adf757_0
2025-10-10T14:34:19.524297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1300 sessionId: src_id|ab363b46-f2243971-14d56caf-adf757_0 is DEAD
2025-10-10T14:34:19.524499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab363b46-f2243971-14d56caf-adf757_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:19.524511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab363b46-f2243971-14d56caf-adf757_0] Write session will restart in 0.005918s
2025-10-10T14:34:19.524536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab363b46-f2243971-14d56caf-adf757_0] Write session: Do CDS request
2025-10-10T14:34:19.524542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab363b46-f2243971-14d56caf-adf757_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:19.531879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab363b46-f2243971-14d56caf-adf757_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.532011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:19.532029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1301
2025-10-10T14:34:19.532217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.532264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:19.532291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:19.532300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:19.532874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1301 sessionId:  describe result for acl check
2025-10-10T14:34:19.532916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:19.532918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:19.532919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:19.532926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601399188232225:2552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:19.533525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601399188232225:2552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:19.535736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601399188232225:2552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:19.536415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:19.538548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:19.538762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:19.538772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:19.538785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:19.538846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:19.538829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601399188232225:2552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:19.538846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601399188232225:2552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:19.538849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601399188232225:2552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:19.538858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:19.538896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601398406009136:7883]
2025-10-10T14:34:19.539525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:19.539824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:19.539867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:19.540190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:19.540247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.540255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.540257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.540258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.540259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.540260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.540261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.540262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.540263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.540264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.540266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.540267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.540268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.540273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.540287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.540291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.540295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.540298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.540302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.540305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.540309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.540313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.540318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.540321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.540325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.540329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.540336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.540344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.540359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.540365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.540370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.540375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.540379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.540384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.540388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.540394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.540399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.540404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.540409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.540413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.540417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.540421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.540426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.540433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.540442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.540447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.540453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.540462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.540466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.540471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.540475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.540480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.540516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:19.542863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:19.543270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:19.543283Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:19.543286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:19.543290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:19.543295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1300 [2:7559601398406009136:7883]
2025-10-10T14:34:19.543308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:19.543327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:19.543330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.543333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.543336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.543352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:19.543359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:19.543374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:19.543458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.543465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.543467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.543470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:19.543541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:19.543551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.543564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.543575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.543591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:19.543615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232313:2552], now have 1 active actors on pipe
2025-10-10T14:34:19.543624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232186:2438], now have 1 active actors on pipe
2025-10-10T14:34:19.543631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601398406009131:7883]
2025-10-10T14:34:19.543634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601398406009131:7883]
2025-10-10T14:34:19.543636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601398406009131:7883]
2025-10-10T14:34:19.543651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:19.543669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:19.543671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:19.543678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:19.543688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:19.543692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:19.543693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:19.543667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1300
2025-10-10T14:34:19.543696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1300
2025-10-10T14:34:19.543724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601398406009131:7883]
2025-10-10T14:34:19.543732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:19.543734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:19.543750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.543761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.543817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:19.543832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.543836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.543839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:19.543853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.543871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:19.543898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.544126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.544139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.544161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.544265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1301 partition: 0 MaxSeqNo: 40 sessionId: src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0
2025-10-10T14:34:19.544761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab363b46-f2243971-14d56caf-adf757_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:19.547582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0] Write session: try to update token
2025-10-10T14:34:19.547601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:19.563293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:19.563308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:19.563311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:19.563313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:19.563323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601398406009131:7883]
2025-10-10T14:34:19.563327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601398406009131:7883]
2025-10-10T14:34:19.563331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601398406009131:7883]
2025-10-10T14:34:19.563381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:19.563395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.563401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:19.563411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:19.563425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:19.563429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:19.563548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:19.563290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId: src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:19.565962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:19.624140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601399188232353:3347]
2025-10-10T14:34:19.624434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1300, pipe: [1:7559601399188232353:3347]
2025-10-10T14:34:19.678608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:19.679064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.679079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.679126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232353:3347], now have 1 active actors on pipe
2025-10-10T14:34:19.679314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:19.679330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:19.679402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1301 reason: error at write: Disconnected sessionId: src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0
2025-10-10T14:34:19.679620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1301 sessionId: src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0 is DEAD
2025-10-10T14:34:19.679786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:19.679807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0] Write session will restart in 0.005898s
2025-10-10T14:34:19.679833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0] Write session: Do CDS request
2025-10-10T14:34:19.679841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:19.679754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601399188232353:3347]
2025-10-10T14:34:19.679785Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:34:19.679785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:19.679862Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 13 consumer shared/user session shared/user_1_13_7903164544811225891_v1 is DEAD
2025-10-10T14:34:19.679965Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601330468740450:3354] disconnected; active server actors: 1
2025-10-10T14:34:19.679975Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601330468740450:3354] client user disconnected session shared/user_1_13_7903164544811225891_v1
2025-10-10T14:34:19.679338Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:19.681547Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:34:19.681630Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:34:19.681634Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:34:19.681640Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009526s
2025-10-10T14:34:19.686860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.686949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:19.686969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1302
2025-10-10T14:34:19.687098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.687152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:19.687158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:19.687161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:19.687653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1302 sessionId:  describe result for acl check
2025-10-10T14:34:19.687683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:19.687685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:19.687687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:19.687693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601399188232374:2534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:19.688238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601399188232374:2534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:19.690574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601399188232374:2534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:19.691763Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:34:19.691993Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:34:19.692004Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 14
2025-10-10T14:34:19.692168Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 14 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:34:19.692239Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:34:19.692301Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 auth for : user
2025-10-10T14:34:19.692485Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 Handle describe topics response
2025-10-10T14:34:19.692516Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 auth is DEAD
2025-10-10T14:34:19.692525Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:34:19.692786Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:34:19.692881Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_14_6536244086887583778_v1
2025-10-10T14:34:19.692852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:19.692885Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601399188232485:2530] connected; active server actors: 1
2025-10-10T14:34:19.692899Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601399188232485:2530] session shared/user_1_14_6536244086887583778_v1
2025-10-10T14:34:19.692907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:34:19.692918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:34:19.692929Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_14_6536244086887583778_v1" (Sender=[1:7559601399188232478:2530], Pipe=[1:7559601399188232485:2530], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:34:19.692933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:34:19.692944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:34:19.692956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_14_6536244086887583778_v1" (Sender=[1:7559601399188232478:2530], Pipe=[1:7559601399188232485:2530], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:34:19.692966Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_14_6536244086887583778_v1" sender [1:7559601399188232478:2530] lock partition 0 for ReadingSession "shared/user_1_14_6536244086887583778_v1" (Sender=[1:7559601399188232478:2530], Pipe=[1:7559601399188232485:2530], Partitions=[], ActiveFamilyCount=1) generation 1 step 14
2025-10-10T14:34:19.692974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:34:19.692978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000027s
2025-10-10T14:34:19.693037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601399188232374:2534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:19.693043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601399188232374:2534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:19.693047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601399188232374:2534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:19.693055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:19.693190Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 14 Session: "shared/user_1_14_6536244086887583778_v1" ClientId: "user" PipeClient { RawX1: 7559601399188232485 RawX2: 4503603922340322 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:34:19.693246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:34:19.695418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:19.695632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:19.695646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:19.695659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:19.695721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:19.695776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601398406009312:7899]
2025-10-10T14:34:19.696398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:19.696720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:19.696772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:19.697102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:19.697168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.697176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.697178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.697179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.697180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.697181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.697183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.697184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.697185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.697186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.697188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.697189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.697190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.697197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.697211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.697215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.697218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.697221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.697225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.697228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.697232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.697235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.697239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.697242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.697245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.697248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.697258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.697267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.697273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.697278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.697282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.697288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.697292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.697297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.697301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.697307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.697311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.697316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.697321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.697326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.697343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.697349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.697353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.697358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.697362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.697367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.697372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.697377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.697381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.697392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.697397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.697401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.697441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:19.699949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:19.700399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:19.700411Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:19.700413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:19.700416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:19.700422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1301 [2:7559601398406009312:7899]
2025-10-10T14:34:19.700437Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:19.700454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:19.700457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.700460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.700463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.700482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:19.700496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:19.700504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:19.700570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.700577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.700579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.700581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:19.700655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:19.700663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.700676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.700686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.700706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:19.700734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232492:2527], now have 1 active actors on pipe
2025-10-10T14:34:19.700742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232359:2438], now have 1 active actors on pipe
2025-10-10T14:34:19.700745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232489:2534], now have 1 active actors on pipe
2025-10-10T14:34:19.700752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601398406009305:7899]
2025-10-10T14:34:19.700759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601398406009305:7899]
2025-10-10T14:34:19.700761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601398406009305:7899]
2025-10-10T14:34:19.700775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:19.700784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:19.700787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:19.700790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:19.700793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:19.700810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:19.700818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:19.700845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601398406009305:7899]
2025-10-10T14:34:19.700854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:19.700915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:19.700964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1301
2025-10-10T14:34:19.700990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1301, pipe: [1:7559601399188232492:2527]
2025-10-10T14:34:19.701006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1301
2025-10-10T14:34:19.701182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.701194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.701221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.701228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.701236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_14_6536244086887583778_v1 on pipe: [1:7559601399188232492:2527]
2025-10-10T14:34:19.701272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:19.701274Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_14_6536244086887583778_v1:1 with generation 1301
2025-10-10T14:34:19.701294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.701305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.701307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:19.701319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.701347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:19.701361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.701365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.701367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:19.701383Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_14_6536244086887583778_v1
2025-10-10T14:34:19.701390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.701420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.701441Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:34:19.701659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.701665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.701682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.701819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1302 partition: 0 MaxSeqNo: 40 sessionId: src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0
2025-10-10T14:34:19.705467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a17cee-f3a8d83c-9ba6bb3-f87565df_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:19.705870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:34:19.705920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:34:19.705934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.705942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.705945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.705954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:34:19.705970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:34:19.706128Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106859700 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:34:19.706154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:34:19.706192Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 sending to client partition status
2025-10-10T14:34:19.708185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0] Write session: try to update token
2025-10-10T14:34:19.708205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:19.720827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:19.720849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:19.720853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:19.720855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:19.720865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601398406009305:7899]
2025-10-10T14:34:19.720870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601398406009305:7899]
2025-10-10T14:34:19.720877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601398406009305:7899]
2025-10-10T14:34:19.720924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:19.720929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:19.720937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.720938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:19.720939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:19.720952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:19.721070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:19.731419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId: src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:19.734040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:19.837934Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:19.838703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.838729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.839071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_14_6536244086887583778_v1
2025-10-10T14:34:19.839087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:19.839108Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_14_6536244086887583778_v1
2025-10-10T14:34:19.841530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:19.841536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601399188232492:2527]
2025-10-10T14:34:19.841576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:19.841579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:19.841650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1302 reason: error at write: Disconnected sessionId: src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0
2025-10-10T14:34:19.841879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1302 sessionId: src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0 is DEAD
2025-10-10T14:34:19.842266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:19.842280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0] Write session will restart in 0.006668s
2025-10-10T14:34:19.842311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0] Write session: Do CDS request
2025-10-10T14:34:19.842320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:19.850831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.851023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:19.851046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1303
2025-10-10T14:34:19.851194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:19.851234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:19.851245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:19.851249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:19.851788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1303 sessionId:  describe result for acl check
2025-10-10T14:34:19.851832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:19.851841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:19.851843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:19.851850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601399188232548:2524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:19.852610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601399188232548:2524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:19.855628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:19.855737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601399188232548:2524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:19.857716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:19.857960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:19.857966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:19.857981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:19.858048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:19.858090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601398406009448:7901]
2025-10-10T14:34:19.858678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:19.858883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601399188232548:2524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:19.858899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601399188232548:2524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:19.858902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601399188232548:2524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:19.858912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:19.859059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:19.859125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:19.859469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:19.859564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.859571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.859572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.859573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.859574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.859576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.859577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.859578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.859579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.859580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.859582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.859583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.859584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.859591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.859603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.859607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.859611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.859614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.859618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.859622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.859625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.859629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.859634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.859638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.859641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.859646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.859654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.859662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:19.859669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.859674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:19.859679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.859685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:19.859689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.859694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:19.859701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.859712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:19.859717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.859722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:19.859732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.859737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:19.859741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.859747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:19.859756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.859761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:19.859773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.859778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:19.859787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.859792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.859801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.859807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.859814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.859823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.859864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:19.862920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:19.863766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:19.863779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:19.863782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:19.863786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:19.863792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1302 [2:7559601398406009448:7901]
2025-10-10T14:34:19.863805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:19.863825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:19.863828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.863831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.863834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.863852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:19.863860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:19.863867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:19.863939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.863946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.863950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.863953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:19.864034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:19.864041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.864052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:19.864063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:19.864083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:19.864111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601398406009443:7901]
2025-10-10T14:34:19.864118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601398406009443:7901]
2025-10-10T14:34:19.864120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601398406009443:7901]
2025-10-10T14:34:19.864134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:19.864229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1302
2025-10-10T14:34:19.864282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1302
2025-10-10T14:34:19.864154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232636:2524], now have 1 active actors on pipe
2025-10-10T14:34:19.864158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:19.864162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232506:2438], now have 1 active actors on pipe
2025-10-10T14:34:19.864163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:19.864166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:19.864171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:19.864186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:19.864189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:19.864220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601398406009443:7901]
2025-10-10T14:34:19.864227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:19.864245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:19.864417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.864429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.864464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:19.864482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:19.864486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:19.864490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:19.864503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:19.864514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:19.864531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.864711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:19.864718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:19.864734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:19.864861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1303 partition: 0 MaxSeqNo: 40 sessionId: src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0
2025-10-10T14:34:19.865324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5981ffe-577c3bfb-4e88103e-3a986a3d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:19.876451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0] Write session: try to update token
2025-10-10T14:34:19.876484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:19.885808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:19.885831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:19.885835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:19.885837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:19.885847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601398406009443:7901]
2025-10-10T14:34:19.885852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601398406009443:7901]
2025-10-10T14:34:19.885856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601398406009443:7901]
2025-10-10T14:34:19.885910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:19.885919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:19.885919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:19.885921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:19.885926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:19.885953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:19.886069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:19.894400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId: src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:19.897051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:19.941562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601399188232645:2527]
2025-10-10T14:34:19.941924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1302, pipe: [1:7559601399188232645:2527]
2025-10-10T14:34:20.002219Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:20.002549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.002565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.002590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601399188232645:2527], now have 1 active actors on pipe
2025-10-10T14:34:20.002828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:20.002863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:20.002868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601399188232645:2527]
2025-10-10T14:34:20.002883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:20.002901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:20.003005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1303 reason: error at write: Disconnected sessionId: src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0
2025-10-10T14:34:20.003233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1303 sessionId: src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0 is DEAD
2025-10-10T14:34:20.003385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:20.003396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0] Write session will restart in 0.007925s
2025-10-10T14:34:20.003421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0] Write session: Do CDS request
2025-10-10T14:34:20.003427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:20.012942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.013030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:20.013048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1304
2025-10-10T14:34:20.013173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.013225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:20.013238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:20.013242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:20.013705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1304 sessionId:  describe result for acl check
2025-10-10T14:34:20.013754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:20.013760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:20.013768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:20.013775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601403483200039:2520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:20.014342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601403483200039:2520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:20.014831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:20.016542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601403483200039:2520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:20.017226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:20.017567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:20.017573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:20.017589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:20.017681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:20.017719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601402700976880:7903]
2025-10-10T14:34:20.018317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:20.018754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:20.018823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:20.019205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:20.019296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.019305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.019306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.019307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.019308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.019310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.019311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.019312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.019313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.019314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.019316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.019317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.019318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.019325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.019338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.019342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.019346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.019350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.019353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.019357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.019375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.019380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.019385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.019395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.019399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.019403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.019414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.019423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.019432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.019443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.019448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.019458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.019463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.019470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.019475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.019480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.019485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.019491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.019508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.019519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.019524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.019530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.019540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.019546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.019555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.019561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.019567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.019572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.019577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.019582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.019587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.019593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.019636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:20.019637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601403483200039:2520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:20.019654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601403483200039:2520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:20.019657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601403483200039:2520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:20.019665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:20.022230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:20.022532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:20.022548Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:20.022552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:20.022555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:20.022562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1303 [2:7559601402700976880:7903]
2025-10-10T14:34:20.022575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:20.022599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:20.022607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.022611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.022613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.022632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:20.022645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:20.022657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:20.022725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.022733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.022735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.022738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:20.022816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:20.022825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.022836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.022852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.022873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:20.022900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200074:2520], now have 1 active actors on pipe
2025-10-10T14:34:20.022909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483199943:2438], now have 1 active actors on pipe
2025-10-10T14:34:20.022916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601402700976874:7903]
2025-10-10T14:34:20.022919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601402700976874:7903]
2025-10-10T14:34:20.022921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601402700976874:7903]
2025-10-10T14:34:20.022935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:20.022949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:20.022956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:20.022959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:20.022961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:20.022974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:20.022983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:20.023013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601402700976874:7903]
2025-10-10T14:34:20.023025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:20.023011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1303
2025-10-10T14:34:20.023011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1303
2025-10-10T14:34:20.023045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:20.023087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.023098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.023130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:20.023148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.023152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.023154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:20.023163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.023173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:20.023230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.023503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.023517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.023539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.023699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1304 partition: 0 MaxSeqNo: 40 sessionId: src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0
2025-10-10T14:34:20.024153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dfd71c-1e220a3-e3f430ac-7a4d577c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:20.027011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0] Write session: try to update token
2025-10-10T14:34:20.027031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:20.043607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:20.043626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:20.043630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:20.043631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:20.043642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601402700976874:7903]
2025-10-10T14:34:20.043647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601402700976874:7903]
2025-10-10T14:34:20.043652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601402700976874:7903]
2025-10-10T14:34:20.043709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:20.043712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:20.043718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:20.043723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:20.043726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.043730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:20.043921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:20.044052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId: src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:20.046982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:20.102883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601403483200083:2527]
2025-10-10T14:34:20.103185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1303, pipe: [1:7559601403483200083:2527]
2025-10-10T14:34:20.160781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:20.161192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.161220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.161274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200083:2527], now have 1 active actors on pipe
2025-10-10T14:34:20.161554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:20.162151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:20.162164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0] Write session will restart in 0.006554s
2025-10-10T14:34:20.161588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601403483200083:2527]
2025-10-10T14:34:20.161637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:20.162205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0] Write session: Do CDS request
2025-10-10T14:34:20.161640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:20.162212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:20.161728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1304 reason: error at write: Disconnected sessionId: src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0
2025-10-10T14:34:20.161887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:20.161973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1304 sessionId: src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0 is DEAD
2025-10-10T14:34:20.169928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.170021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:20.170040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1305
2025-10-10T14:34:20.170318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.170380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:20.170393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:20.170397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:20.171042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1305 sessionId:  describe result for acl check
2025-10-10T14:34:20.171087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:20.171094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:20.171096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:20.171102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601403483200126:2516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:20.171694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601403483200126:2516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:20.174267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601403483200126:2516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:20.174611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:20.176423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:20.176594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601403483200126:2516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:20.176611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601403483200126:2516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:20.176614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601403483200126:2516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:20.176622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:20.176631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:20.176644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:20.176656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:20.176720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:20.176757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601402700977017:7905]
2025-10-10T14:34:20.177385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:20.177643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:20.177675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:20.177990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:20.178040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.178045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.178046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.178047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.178047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.178048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.178049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.178050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.178050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.178051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.178052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.178052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.178053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.178057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.178066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.178069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.178071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.178074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.178076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.178078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.178081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.178083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.178085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.178088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.178090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.178092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.178098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.178104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.178108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.178111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.178114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.178117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.178119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.178123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.178126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.178129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.178132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.178136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.178138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.178141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.178144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.178147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.178150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.178153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.178155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.178158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.178160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.178163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.178166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.178169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.178171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.178174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.178197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:20.180743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:20.181051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:20.181063Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:20.181065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:20.181069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:20.181075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1304 [2:7559601402700977017:7905]
2025-10-10T14:34:20.181088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:20.181105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:20.181113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.181117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.181119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.181135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:20.181147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:20.181155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:20.181218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.181224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.181226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.181229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:20.181300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:20.181308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.181320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.181348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.181368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:20.181394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200215:2516], now have 1 active actors on pipe
2025-10-10T14:34:20.181401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200085:2438], now have 1 active actors on pipe
2025-10-10T14:34:20.181410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601402700977012:7905]
2025-10-10T14:34:20.181412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601402700977012:7905]
2025-10-10T14:34:20.181414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601402700977012:7905]
2025-10-10T14:34:20.181429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:20.181424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1304
2025-10-10T14:34:20.181426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1304
2025-10-10T14:34:20.181448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:20.181450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:20.181454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:20.181456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:20.181469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:20.181473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:20.181499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601402700977012:7905]
2025-10-10T14:34:20.181509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:20.181516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:20.181529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.181533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.181582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:20.181594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.181598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.181600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:20.181611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.181629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:20.181648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.181867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.181880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.181906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.181994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1305 partition: 0 MaxSeqNo: 40 sessionId: src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0
2025-10-10T14:34:20.182395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638874ec-50fb9979-8bbd74f-d9a0d1fc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:20.185233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0] Write session: try to update token
2025-10-10T14:34:20.185251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:20.200294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId: src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:20.201643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:20.201662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:20.201666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:20.201668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:20.201679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601402700977012:7905]
2025-10-10T14:34:20.201684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601402700977012:7905]
2025-10-10T14:34:20.201688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601402700977012:7905]
2025-10-10T14:34:20.201735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:20.201741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:20.201741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:20.201745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:20.201749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.201752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:20.201973Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:20.202908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:20.261595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601403483200226:2527]
2025-10-10T14:34:20.261924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1304, pipe: [1:7559601403483200226:2527]
2025-10-10T14:34:20.326701Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:20.327283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.327307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.327372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200226:2527], now have 1 active actors on pipe
2025-10-10T14:34:20.327599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:20.328031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:20.328110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601403483200226:2527]
2025-10-10T14:34:20.328134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:20.328231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1305 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0
2025-10-10T14:34:20.328453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1305 sessionId: src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0 is DEAD
2025-10-10T14:34:20.328724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:20.328733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0] Write session will restart in 0.008234s
2025-10-10T14:34:20.328758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0] Write session: Do CDS request
2025-10-10T14:34:20.328764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:20.337994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.338096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:20.338115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1306
2025-10-10T14:34:20.338251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.338294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:20.338300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:20.338304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:20.339016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1306 sessionId:  describe result for acl check
2025-10-10T14:34:20.339053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:20.339059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:20.339061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:20.339068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601403483200287:2507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:20.339700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601403483200287:2507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:20.342201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601403483200287:2507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:20.342625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:20.345010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:20.345284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:20.345304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:20.345316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:20.345398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:20.345442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601402700977155:7907]
2025-10-10T14:34:20.345215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601403483200287:2507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:20.345232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601403483200287:2507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:20.345236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601403483200287:2507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:20.345246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:20.346076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:20.346529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:20.346603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:20.346973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:20.347054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.347056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.347057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.347058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.347060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.347061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.347062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.347063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.347065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.347066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.347067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.347068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.347069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.347076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.347090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.347093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.347098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.347104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.347107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.347112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.347115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.347119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.347124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.347128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.347132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.347136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.347144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.347153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.347160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.347165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.347169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.347177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.347182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.347188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.347193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.347198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.347203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.347208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.347213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.347218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.347223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.347228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.347233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.347238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.347242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.347247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.347273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.347279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.347284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.347288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.347292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.347297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.347340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:20.349983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:20.350333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:20.350344Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:20.350347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:20.350352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:20.350359Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1305 [2:7559601402700977155:7907]
2025-10-10T14:34:20.350373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:20.350397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:20.350404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.350408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.350410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.350432Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:20.350445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:20.350458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:20.350526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.350533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.350536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.350538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:20.350610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:20.350620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.350633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.350646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.350663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:20.350687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200228:2438], now have 1 active actors on pipe
2025-10-10T14:34:20.350695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200360:2507], now have 1 active actors on pipe
2025-10-10T14:34:20.350704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601402700977150:7907]
2025-10-10T14:34:20.350706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601402700977150:7907]
2025-10-10T14:34:20.350708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601402700977150:7907]
2025-10-10T14:34:20.350721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:20.350739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:20.350744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:20.350747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:20.350749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:20.350756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:20.350759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:20.350786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601402700977150:7907]
2025-10-10T14:34:20.350796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:20.350767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1305
2025-10-10T14:34:20.350823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1305
2025-10-10T14:34:20.350803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:20.350987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.350996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.351044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:20.351054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.351059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.351061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:20.351075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.351091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:20.351108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.351350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.351367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.351387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.351487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1306 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0
2025-10-10T14:34:20.351910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5b3d5-5a392ca4-c46eeb8c-26426370_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:20.354728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0] Write session: try to update token
2025-10-10T14:34:20.354746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:20.369539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:20.369574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:20.369587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601402700977150:7907]
2025-10-10T14:34:20.369650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:20.369653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:20.369873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:20.370037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:20.370189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:20.370342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:20.370555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:20.370609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:20.373837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId: src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:20.376384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:20.376674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.376696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.376749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:20.378900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:20.387623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:20.387645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:20.387649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:20.387651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:20.387663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601402700977150:7907]
2025-10-10T14:34:20.387668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601402700977150:7907]
2025-10-10T14:34:20.387673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601402700977150:7907]
2025-10-10T14:34:20.387726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:20.387730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:20.387742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.387745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:20.387751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:20.387756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:20.387963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:20.428861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601403483200371:2527]
2025-10-10T14:34:20.429748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1305, pipe: [1:7559601403483200371:2527]
2025-10-10T14:34:20.515655Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:20.524072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.524101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.524283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.524355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.524417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.524477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.524520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.524526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.524592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.524657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.524748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.524849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.524891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.524896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.525006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.525069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.525125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.525186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.525225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.525228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.525293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.528135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:20.528151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:20.528193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1306 reason: error at write: Disconnected sessionId: src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0
2025-10-10T14:34:20.528428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1306 sessionId: src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0 is DEAD
2025-10-10T14:34:20.528618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:20.528632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0] Write session will restart in 0.009914s
2025-10-10T14:34:20.528581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:20.528636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601403483200371:2527]
2025-10-10T14:34:20.528660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0] Write session: Do CDS request
2025-10-10T14:34:20.528668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:20.525604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.525710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.525769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.525809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.525812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.525877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.525932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.525992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.526049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.526093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.526097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.526163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.526221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.526282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.526343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.526389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.526392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.526460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.526519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.526585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.526647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.526686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.526689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.526757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.526817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.526876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.526940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.527004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.527009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.527076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.527130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.527187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.527246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.527286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.527289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.527354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:20.527409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:20.527469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:20.527526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:20.527565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:20.527567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:20.527644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200371:2527], now have 1 active actors on pipe
2025-10-10T14:34:20.529372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:20.539875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.540094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:20.540113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1307
2025-10-10T14:34:20.540309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.540356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:20.540362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:20.540366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:20.540766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1307 sessionId:  describe result for acl check
2025-10-10T14:34:20.540797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:20.540801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:20.540805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:20.540811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601403483200449:2503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:20.541473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601403483200449:2503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:20.545385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:20.545487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601403483200449:2503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:20.547502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:20.547713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:20.547719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:20.547730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:20.547780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:20.547820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601402700977306:7910]
2025-10-10T14:34:20.548530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:20.548503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601403483200449:2503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:20.548523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601403483200449:2503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:20.548526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601403483200449:2503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:20.548536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:20.549012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:20.549059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:20.549410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:20.549465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.549466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.549467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.549469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.549470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.549472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.549473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.549475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.549476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.549477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.549479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.549480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.549482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.549488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.549502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.549506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.549511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.549516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.549521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.549525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.549530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.549534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.549540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.549544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.549548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.549553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.549560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.549570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.549578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.549584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.549589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.549595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.549600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.549607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.549611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.549618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.549623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.549629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.549635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.549641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.549646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.549651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.549657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.549663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.549667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.549672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.549678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.549701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.549707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.549713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.549719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.549725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.549773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:20.553067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:20.553417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:20.553421Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:20.553425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:20.553429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:20.553436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1306 [2:7559601402700977306:7910]
2025-10-10T14:34:20.553450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:20.553471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:20.553475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.553479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.553482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.553501Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:20.553509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:20.553517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:20.553579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.553582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.553584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.553587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:20.553662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:20.553665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.553677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.553690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.553710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:20.553733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601402700977301:7910]
2025-10-10T14:34:20.553736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601402700977301:7910]
2025-10-10T14:34:20.553738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601402700977301:7910]
2025-10-10T14:34:20.553755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:20.553770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:20.553788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:20.553791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:20.553820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601402700977301:7910]
2025-10-10T14:34:20.553823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:20.553831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:20.553834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:20.553837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:20.553845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:20.554088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200517:2503], now have 1 active actors on pipe
2025-10-10T14:34:20.554102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200386:2438], now have 1 active actors on pipe
2025-10-10T14:34:20.557432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1306
2025-10-10T14:34:20.557473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1306
2025-10-10T14:34:20.557804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.557823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.557863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:20.557877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.557883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.557886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:20.557902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.557922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:20.557945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.558391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.558406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.558439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.558593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1307 partition: 0 MaxSeqNo: 40 sessionId: src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0
2025-10-10T14:34:20.559184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0dd489-e8a74d41-5c317653-b1cee9a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:20.562069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0] Write session: try to update token
2025-10-10T14:34:20.562091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:20.578655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:20.578680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:20.578683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:20.578685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:20.578695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601402700977301:7910]
2025-10-10T14:34:20.578701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601402700977301:7910]
2025-10-10T14:34:20.578705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601402700977301:7910]
2025-10-10T14:34:20.578755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:20.578763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.578766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:20.578905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:20.580585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:20.580594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:20.580599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:20.582863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId: src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:20.585476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:20.628672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601403483200548:2527]
2025-10-10T14:34:20.629061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1306, pipe: [1:7559601403483200548:2527]
2025-10-10T14:34:20.720057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:20.721093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601403483200548:2527]
2025-10-10T14:34:20.721106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:20.721110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:20.721129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:20.721192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1307 reason: error at write: Disconnected sessionId: src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0
2025-10-10T14:34:20.720856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.720880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.720925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200548:2527], now have 1 active actors on pipe
2025-10-10T14:34:20.721425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1307 sessionId: src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0 is DEAD
2025-10-10T14:34:20.721571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:20.721583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0] Write session will restart in 0.009941s
2025-10-10T14:34:20.721520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:20.721609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0] Write session: Do CDS request
2025-10-10T14:34:20.721618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:20.732888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.733005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:20.733023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1308
2025-10-10T14:34:20.733179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.733218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:20.733240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:20.733244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:20.733642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1308 sessionId:  describe result for acl check
2025-10-10T14:34:20.733675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:20.733677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:20.733679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:20.733686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601403483200669:2479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:20.734273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601403483200669:2479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:20.734581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:20.736695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:20.736921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:20.736934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:20.736947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:20.737002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:20.737005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601403483200669:2479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:20.737047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601402700977487:7921]
2025-10-10T14:34:20.737689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:20.737996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:20.738036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:20.738333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:20.738400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.738407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.738408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.738409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.738410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.738411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.738412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.738413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.738413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.738414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.738416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.738417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.738418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.738423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.738435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.738439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.738443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.738447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.738451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.738455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.738459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.738463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.738467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.738472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.738475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.738480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.738486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.738495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.738502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.738508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.738513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.738518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.738522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.738527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.738531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.738536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.738546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.738552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.738560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.738565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.738569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.738575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.738584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.738589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.738593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.738598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.738607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.738612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.738620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.738626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.738630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.738634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.738669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:20.741032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601403483200669:2479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:20.741047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:20.741051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601403483200669:2479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:20.741055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601403483200669:2479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:20.741063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:20.741546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:20.741561Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:20.741563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:20.741567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:20.741573Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1307 [2:7559601402700977487:7921]
2025-10-10T14:34:20.741586Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:20.741602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:20.741606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.741609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.741611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.741629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:20.741636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:20.741643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:20.741702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.741712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.741714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.741716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:20.741784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:20.741803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.741815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.741827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.741842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:20.741869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200564:2438], now have 1 active actors on pipe
2025-10-10T14:34:20.741876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200702:2479], now have 1 active actors on pipe
2025-10-10T14:34:20.741884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601402700977482:7921]
2025-10-10T14:34:20.741886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601402700977482:7921]
2025-10-10T14:34:20.741888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601402700977482:7921]
2025-10-10T14:34:20.741903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:20.741921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:20.741922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:20.741926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:20.741928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:20.741941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:20.741945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:20.741970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601402700977482:7921]
2025-10-10T14:34:20.741957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1307
2025-10-10T14:34:20.741965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1307
2025-10-10T14:34:20.741986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:20.741992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:20.742023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.742029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.742071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:20.742084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.742088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.742094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:20.742106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.742121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:20.742140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.742294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.742303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.742320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.742417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1308 partition: 0 MaxSeqNo: 40 sessionId: src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0
2025-10-10T14:34:20.742828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc4f06b-85162979-c31bdd01-6c6e5a94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:20.745545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0] Write session: try to update token
2025-10-10T14:34:20.745565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:20.761628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:20.761646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:20.761650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:20.761652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:20.761667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601402700977482:7921]
2025-10-10T14:34:20.761672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601402700977482:7921]
2025-10-10T14:34:20.761676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601402700977482:7921]
2025-10-10T14:34:20.761730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:20.761737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:20.761745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:20.761746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.761748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:20.761749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:20.761903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:20.762828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId: src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:20.765583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:20.821195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601403483200710:2527]
2025-10-10T14:34:20.821514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1307, pipe: [1:7559601403483200710:2527]
2025-10-10T14:34:20.871233Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:20.871722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.871739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.871786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200710:2527], now have 1 active actors on pipe
2025-10-10T14:34:20.872029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:20.872037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:20.872041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:20.872089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601403483200710:2527]
2025-10-10T14:34:20.872104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1308 reason: error at write: Disconnected sessionId: src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0
2025-10-10T14:34:20.872361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1308 sessionId: src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0 is DEAD
2025-10-10T14:34:20.872532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:20.872550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0] Write session will restart in 0.009983s
2025-10-10T14:34:20.872575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0] Write session: Do CDS request
2025-10-10T14:34:20.872582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:20.872790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:20.883206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:20.883976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.883981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:20.883999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1309
2025-10-10T14:34:20.884222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:20.884260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:20.884266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:20.884270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:20.884745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1309 sessionId:  describe result for acl check
2025-10-10T14:34:20.884789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:20.884796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:20.884798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:20.884805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601403483200816:2469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:20.885045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:20.885260Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:20.885272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:20.885284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:20.885356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:20.885397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601403483200816:2469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:20.885402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601402700977628:7928]
2025-10-10T14:34:20.885937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:20.886215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:20.886253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:20.886558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:20.886616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.886621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.886622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.886622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.886623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.886631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.886632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.886633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.886634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.886634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.886635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.886636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.886636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.886640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.886648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.886651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.886655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.886658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.886662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.886665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.886668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.886672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.886676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.886680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.886683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.886687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.886694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.886703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:20.886709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.886714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:20.886718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.886723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:20.886726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.886731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:20.886735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.886742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:20.886746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.886750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:20.886754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.886759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:20.886773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.886782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:20.886787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.886792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:20.886796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.886805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:20.886810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.886818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.886820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.886823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.886826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.886829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.886854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:20.887647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601403483200816:2469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:20.889108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:20.889479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:20.889494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:20.889496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:20.889499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:20.889505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1308 [2:7559601402700977628:7928]
2025-10-10T14:34:20.889517Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:20.889534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:20.889537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.889540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.889542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.889560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:20.889576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:20.889584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:20.889641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.889649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.889651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.889653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:20.889720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:20.889727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.889735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:20.889741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:20.889751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:20.889772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200711:2438], now have 1 active actors on pipe
2025-10-10T14:34:20.889783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601402700977621:7928]
2025-10-10T14:34:20.889784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601402700977621:7928]
2025-10-10T14:34:20.889786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601402700977621:7928]
2025-10-10T14:34:20.889794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:20.889808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:20.889810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:20.889813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:20.889815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:20.889817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:20.889819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:20.889814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1308
2025-10-10T14:34:20.889837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601402700977621:7928]
2025-10-10T14:34:20.889839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:20.889849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:20.890000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601403483200816:2469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:20.890010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601403483200816:2469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:20.890013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601403483200816:2469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:20.890019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:20.890230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200851:2469], now have 1 active actors on pipe
2025-10-10T14:34:20.890270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1308
2025-10-10T14:34:20.890327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.890337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.890368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:20.890382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:20.890387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:20.890389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:20.890402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:20.890428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:20.890448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.890572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.890579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.890593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:20.890664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1309 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0
2025-10-10T14:34:20.890997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fa69ac6-a64eded7-758ff93f-78aa99af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:20.893684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0] Write session: try to update token
2025-10-10T14:34:20.893702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:20.901031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:20.901054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:20.901067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601402700977621:7928]
2025-10-10T14:34:20.901123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:20.901125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:20.901310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:20.901478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:20.901626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:20.901775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:20.901972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:20.902021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:20.907694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId: src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:20.910426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:20.910699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:20.910722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:20.910757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:20.910828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:20.918690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:20.918712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:20.918715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:20.918718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:20.918729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601402700977621:7928]
2025-10-10T14:34:20.918734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601402700977621:7928]
2025-10-10T14:34:20.918739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601402700977621:7928]
2025-10-10T14:34:20.918788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:20.918796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:20.918802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:20.918803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:20.918805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:20.918809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:20.919009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:20.972257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601403483200856:2527]
2025-10-10T14:34:20.972620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1308, pipe: [1:7559601403483200856:2527]
2025-10-10T14:34:21.030662Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:21.039119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.039149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.039346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.039422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.039494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.039571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.039617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.039622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.039700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.039767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.039833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.039899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.039948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.039950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.040025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.040091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.040161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.040222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.040263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.040267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.040364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.040479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.040543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.040610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.041297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.041303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.041548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.041655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.041732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.041806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.041856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.041866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.043870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601403483200856:2527]
2025-10-10T14:34:21.043894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:21.043900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:21.043908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:21.043946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1309 reason: error at write: Disconnected sessionId: src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0
2025-10-10T14:34:21.044195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1309 sessionId: src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0 is DEAD
2025-10-10T14:34:21.041940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.042017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.042085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.042148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.042189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.044627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:21.042192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.044639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0] Write session will restart in 0.006287s
2025-10-10T14:34:21.042268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.042333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.042399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.042465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.042507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.042510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.042577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.044666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0] Write session: Do CDS request
2025-10-10T14:34:21.042638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.042704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.042770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.044673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:21.042814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.042818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.042885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.042945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.043003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.043063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.043108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.043112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.043186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.043259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.043391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.043453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.043524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.043527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.043603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601403483200856:2527], now have 1 active actors on pipe
2025-10-10T14:34:21.044218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:21.051948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.052098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:21.052120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1310
2025-10-10T14:34:21.052326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.052369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:21.052381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:21.052387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:21.052824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1310 sessionId:  describe result for acl check
2025-10-10T14:34:21.052859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:21.052865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:21.052868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:21.052875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601407778168167:2464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:21.053609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601407778168167:2464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:21.057285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601407778168167:2464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:21.061801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601407778168167:2464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:21.061825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601407778168167:2464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:21.061829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601407778168167:2464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:21.061839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:21.062093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:21.064476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:21.064737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:21.064743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:21.064756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:21.064813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:21.064858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601406995945069:7930]
2025-10-10T14:34:21.065541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:21.065892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:21.065945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:21.066276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:21.066344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.066345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.066347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.066348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.066350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.066351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.066352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.066354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.066355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.066357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.066358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.066359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.066361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.066367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.066381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.066386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.066390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.066394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.066399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.066403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.066407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.066410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.066414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.066418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.066422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.066426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.066435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.066446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.066453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.066458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.066462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.066468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.066473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.066477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.066483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.066488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.066492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.066498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.066502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.066508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.066512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.066518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.066523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.066528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.066532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.066538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.066543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.066548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.066552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.066557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.066562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.066567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.066614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:21.069678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:21.070309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:21.070322Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:21.070325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:21.070329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:21.070336Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1309 [2:7559601406995945069:7930]
2025-10-10T14:34:21.070363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:21.070384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:21.070388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.070393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.070401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.070434Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:21.070448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:21.070458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:21.070526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.070535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.070537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.070540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:21.070616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:21.070621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.070634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.070651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.070673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:21.070701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601406995945063:7930]
2025-10-10T14:34:21.070708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601406995945063:7930]
2025-10-10T14:34:21.070710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601406995945063:7930]
2025-10-10T14:34:21.070724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:21.070744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:21.070765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:21.070772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:21.070807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601406995945063:7930]
2025-10-10T14:34:21.070814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:21.070840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:21.070852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:21.070855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:21.070862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:21.070948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168289:2464], now have 1 active actors on pipe
2025-10-10T14:34:21.070970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168154:2438], now have 1 active actors on pipe
2025-10-10T14:34:21.071062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1309
2025-10-10T14:34:21.071123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1309
2025-10-10T14:34:21.071191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.071205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.071252Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:21.071268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.071273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.071276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:21.071289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.071302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:21.071331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.071650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.071663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.071688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.071837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1310 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0
2025-10-10T14:34:21.072264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4356ae3-4512a812-6c5fb04e-215b1ee8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:21.075214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0] Write session: try to update token
2025-10-10T14:34:21.075238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:21.083837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:21.083860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:21.083873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601406995945063:7930]
2025-10-10T14:34:21.083943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:21.083978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:21.084197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:21.084411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:21.084597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:21.084789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:21.085035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:21.085080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:21.092535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId: src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:21.095289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:21.095669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.095691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.095738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:21.095821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:21.107458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:21.107476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:21.107479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:21.107482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:21.107494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601406995945063:7930]
2025-10-10T14:34:21.107499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601406995945063:7930]
2025-10-10T14:34:21.107503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601406995945063:7930]
2025-10-10T14:34:21.107553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:21.107561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:21.107564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:21.107565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:21.107572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.107575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:21.107710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:21.144294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601407778168302:2527]
2025-10-10T14:34:21.144605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1309, pipe: [1:7559601407778168302:2527]
2025-10-10T14:34:21.223555Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:21.231335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.231364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.231570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.231648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.231724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.231794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.231843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.231853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.231937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.232017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.232091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.232170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.232222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.232230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.232321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.232393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.232465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.232537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.232579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.232589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.232667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.232739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.232811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.232883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.232929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.232932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.233009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.233088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.233160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.233230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.233278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.233285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.233373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.233443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.233518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.233595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.233647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.233655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.233740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.233808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.233880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.233953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.233999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.234010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.234099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.234161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.234231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.234303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.234353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.234360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.234437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.234509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.234579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.234645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.234694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.234705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.234776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:21.234838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:21.234901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:21.234963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:21.235016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:21.235019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:21.235105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168302:2527], now have 1 active actors on pipe
2025-10-10T14:34:21.235516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601407778168302:2527]
2025-10-10T14:34:21.235557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:21.235560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:21.235592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1310 reason: error at write: Disconnected sessionId: src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0
2025-10-10T14:34:21.235771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1310 sessionId: src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0 is DEAD
2025-10-10T14:34:21.235929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:21.235635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:21.237575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:21.237586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0] Write session will restart in 0.009012s
2025-10-10T14:34:21.237611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0] Write session: Do CDS request
2025-10-10T14:34:21.237618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:21.247997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.249468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:21.249502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1311
2025-10-10T14:34:21.249670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.249716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:21.249722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:21.249727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:21.250201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1311 sessionId:  describe result for acl check
2025-10-10T14:34:21.250231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:21.250233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:21.250236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:21.250244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601407778168408:2458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:21.250996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601407778168408:2458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:21.251474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:21.253625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:21.253879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:21.253893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:21.253906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:21.253965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:21.254020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601406995945212:7932]
2025-10-10T14:34:21.254440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601407778168408:2458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:21.254619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:21.254992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:21.255049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:21.255440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:21.255495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.255496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.255498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.255499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.255501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.255502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.255503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.255505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.255506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.255507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.255508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.255510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.255511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.255518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.255532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.255537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.255541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.255545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.255549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.255553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.255558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.255562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.255568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.255572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.255576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.255580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.255588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.255597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.255604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.255610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.255615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.255620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.255625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.255631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.255636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.255641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.255646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.255651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.255656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.255661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.255665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.255671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.255675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.255681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.255685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.255691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.255696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.255701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.255707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.255713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.255717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.255722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.255763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:21.258247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601407778168408:2458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:21.258267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601407778168408:2458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:21.258271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601407778168408:2458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:21.258281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:21.258615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:21.259102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:21.259114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:21.259117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:21.259121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:21.259127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1310 [2:7559601406995945212:7932]
2025-10-10T14:34:21.259139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:21.259158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:21.259166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.259170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.259173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.259190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:21.259202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:21.259211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:21.259272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.259280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.259282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.259285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:21.259356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:21.259365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.259376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.259389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.259407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:21.259430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168444:2458], now have 1 active actors on pipe
2025-10-10T14:34:21.259439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168304:2438], now have 1 active actors on pipe
2025-10-10T14:34:21.259446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601406995945207:7932]
2025-10-10T14:34:21.259449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601406995945207:7932]
2025-10-10T14:34:21.259451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601406995945207:7932]
2025-10-10T14:34:21.259464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:21.259478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:21.259495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:21.259498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:21.259527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1310
2025-10-10T14:34:21.259566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1310
2025-10-10T14:34:21.259528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601406995945207:7932]
2025-10-10T14:34:21.259539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:21.259580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:21.259585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:21.259587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:21.259595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:21.259672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.259681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.259715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:21.259723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.259729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.259732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:21.259743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.259752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:21.259766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.259911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.259918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.259931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.260001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1311 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0
2025-10-10T14:34:21.260435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9fcfa76-75dd116c-80f70a76-185bf23_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:21.263216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0] Write session: try to update token
2025-10-10T14:34:21.263237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:21.281087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId: src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:21.282683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:21.282704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:21.282707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:21.282709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:21.282720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601406995945207:7932]
2025-10-10T14:34:21.282725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601406995945207:7932]
2025-10-10T14:34:21.282729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601406995945207:7932]
2025-10-10T14:34:21.282787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:21.282797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.282800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:21.282800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:21.282808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:21.282812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:21.282962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:21.283922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:21.337431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601407778168455:2527]
2025-10-10T14:34:21.338006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1310, pipe: [1:7559601407778168455:2527]
2025-10-10T14:34:21.400408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:21.400738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.400752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.400790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168455:2527], now have 1 active actors on pipe
2025-10-10T14:34:21.400972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:21.401075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601407778168455:2527]
2025-10-10T14:34:21.401104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:21.401108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:21.401182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1311 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0
2025-10-10T14:34:21.401447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1311 sessionId: src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0 is DEAD
2025-10-10T14:34:21.402303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:21.402314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0] Write session will restart in 0.006803s
2025-10-10T14:34:21.402338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0] Write session: Do CDS request
2025-10-10T14:34:21.402345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:21.409913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.410007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:21.410026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1312
2025-10-10T14:34:21.410191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.410248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:21.410258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:21.410263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:21.410759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1312 sessionId:  describe result for acl check
2025-10-10T14:34:21.410803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:21.410810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:21.410812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:21.410819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601407778168484:2449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:21.411428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601407778168484:2449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:21.415150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601407778168484:2449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:21.416901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:21.418932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:21.419156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:21.419168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:21.419180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:21.419233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:21.419273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601406995945357:7934]
2025-10-10T14:34:21.419327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601407778168484:2449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:21.419349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601407778168484:2449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:21.419353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601407778168484:2449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:21.419361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:21.419922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:21.420218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:21.420269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:21.420608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:21.420690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.420699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.420700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.420701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.420703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.420704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.420706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.420706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.420708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.420709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.420710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.420711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.420712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.420718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.420732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.420737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.420741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.420744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.420748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.420752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.420755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.420758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.420762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.420766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.420769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.420773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.420781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.420790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.420797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.420802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.420807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.420812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.420816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.420822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.420827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.420832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.420836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.420842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.420846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.420854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.420858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.420862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.420868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.420873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.420878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.420883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.420888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.420892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.420897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.420903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.420913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.420918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.420959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:21.423521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:21.423834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:21.423846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:21.423849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:21.423853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:21.423860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1311 [2:7559601406995945357:7934]
2025-10-10T14:34:21.423873Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:21.423897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:21.423900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.423903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.423906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.423923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:21.423936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:21.423947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:21.424006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.424013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.424016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.424019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:21.424088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:21.424097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.424108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.424122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.424141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:21.424185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168593:2449], now have 1 active actors on pipe
2025-10-10T14:34:21.424188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168456:2438], now have 1 active actors on pipe
2025-10-10T14:34:21.424196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601406995945352:7934]
2025-10-10T14:34:21.424198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601406995945352:7934]
2025-10-10T14:34:21.424201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601406995945352:7934]
2025-10-10T14:34:21.424217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:21.424231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:21.424232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1311
2025-10-10T14:34:21.424237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1311
2025-10-10T14:34:21.424249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:21.424254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:21.424257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:21.424261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:21.424263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:21.424299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601406995945352:7934]
2025-10-10T14:34:21.424303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:21.424310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:21.424321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.424331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.424385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50b9de0c-19777427-b39f6b88-1b498b68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:21.424399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.424420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.424426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:21.424438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.424454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:21.424476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.424655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.424670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.424705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.424820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1312 partition: 0 MaxSeqNo: 40 sessionId: src_id|50b9de0c-19777427-b39f6b88-1b498b68_0
2025-10-10T14:34:21.425262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d754ae-33fbb9cb-266c9858-854cea2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50b9de0c-19777427-b39f6b88-1b498b68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:21.427955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b9de0c-19777427-b39f6b88-1b498b68_0] Write session: try to update token
2025-10-10T14:34:21.427973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b9de0c-19777427-b39f6b88-1b498b68_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:21.442668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId: src_id|50b9de0c-19777427-b39f6b88-1b498b68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:21.444143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:21.444160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:21.444163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:21.444166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:21.444175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601406995945352:7934]
2025-10-10T14:34:21.444180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601406995945352:7934]
2025-10-10T14:34:21.444184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601406995945352:7934]
2025-10-10T14:34:21.444236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:21.444241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:21.444244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.444246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:21.444247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:21.444249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:21.444405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:21.445594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:21.501148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601407778168605:2527]
2025-10-10T14:34:21.501475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1311, pipe: [1:7559601407778168605:2527]
2025-10-10T14:34:21.559647Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:21.560227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.560244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.560299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168605:2527], now have 1 active actors on pipe
2025-10-10T14:34:21.560511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:21.560516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601407778168605:2527]
2025-10-10T14:34:21.560542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:21.560546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:21.560562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:21.560622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1312 reason: error at write: Disconnected sessionId: src_id|50b9de0c-19777427-b39f6b88-1b498b68_0
2025-10-10T14:34:21.560842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1312 sessionId: src_id|50b9de0c-19777427-b39f6b88-1b498b68_0 is DEAD
2025-10-10T14:34:21.561045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b9de0c-19777427-b39f6b88-1b498b68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:21.561067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b9de0c-19777427-b39f6b88-1b498b68_0] Write session will restart in 0.005003s
2025-10-10T14:34:21.561093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b9de0c-19777427-b39f6b88-1b498b68_0] Write session: Do CDS request
2025-10-10T14:34:21.561100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b9de0c-19777427-b39f6b88-1b498b68_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:21.566928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b9de0c-19777427-b39f6b88-1b498b68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.567303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:21.567335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1313
2025-10-10T14:34:21.567472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.567507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:21.567518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:21.567522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:21.567968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1313 sessionId:  describe result for acl check
2025-10-10T14:34:21.568012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:21.568014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:21.568016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:21.568022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601407778168633:2443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:21.568630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601407778168633:2443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:21.571495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601407778168633:2443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:21.574372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:21.576426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601407778168633:2443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:21.576413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:21.576445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601407778168633:2443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:21.576449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601407778168633:2443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:21.576458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:21.576646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:21.576660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:21.576672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:21.576725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:21.576768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601406995945516:7937]
2025-10-10T14:34:21.577401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:21.577716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:21.577771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:21.578088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:21.578146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.578152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.578153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.578155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.578156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.578157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.578159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.578160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.578161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.578163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.578164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.578166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.578167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.578173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.578186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.578190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.578193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.578197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.578200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.578203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.578206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.578210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.578213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.578216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.578220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.578223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.578231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.578240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.578246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.578252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.578257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.578262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.578267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.578272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.578277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.578283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.578287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.578292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.578297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.578303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.578308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.578313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.578318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.578323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.578328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.578333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.578344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.578349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.578353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.578358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.578363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.578368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.578409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:21.580818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:21.581464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:21.581477Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:21.581480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:21.581484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:21.581490Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1312 [2:7559601406995945516:7937]
2025-10-10T14:34:21.581507Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:21.581533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:21.581540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.581545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.581547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.581566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:21.581578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:21.581586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:21.581648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.581655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.581657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.581660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:21.581728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:21.581737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.581749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.581761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.581779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:21.581803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168756:2443], now have 1 active actors on pipe
2025-10-10T14:34:21.581811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168618:2438], now have 1 active actors on pipe
2025-10-10T14:34:21.581818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601406995945510:7937]
2025-10-10T14:34:21.581821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601406995945510:7937]
2025-10-10T14:34:21.581823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601406995945510:7937]
2025-10-10T14:34:21.581837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:21.581856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:21.581855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:21.581858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:21.581860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:21.581872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:21.581875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:21.581906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601406995945510:7937]
2025-10-10T14:34:21.581914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:21.581893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1312
2025-10-10T14:34:21.581916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:21.581908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1312
2025-10-10T14:34:21.581945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.581954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.581993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:21.582006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.582009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.582011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:21.582023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.582040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:21.582067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.582236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.582244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.582260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.582367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1313 partition: 0 MaxSeqNo: 40 sessionId: src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0
2025-10-10T14:34:21.582790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b9de0c-19777427-b39f6b88-1b498b68_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:21.585607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0] Write session: try to update token
2025-10-10T14:34:21.585626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:21.600523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId: src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:21.601485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:21.601507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:21.601510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:21.601512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:21.601521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601406995945510:7937]
2025-10-10T14:34:21.601526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601406995945510:7937]
2025-10-10T14:34:21.601531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601406995945510:7937]
2025-10-10T14:34:21.601589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:21.601601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.601604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:21.601748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:21.603365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:21.603508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:21.603523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:21.603527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:21.660884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601407778168773:2527]
2025-10-10T14:34:21.661223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1312, pipe: [1:7559601407778168773:2527]
2025-10-10T14:34:21.718652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:21.718935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.718954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.719003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168773:2527], now have 1 active actors on pipe
2025-10-10T14:34:21.719285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:21.719235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:21.719256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:21.719264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601407778168773:2527]
2025-10-10T14:34:21.719283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:21.719331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1313 reason: error at write: Disconnected sessionId: src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0
2025-10-10T14:34:21.719533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1313 sessionId: src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0 is DEAD
2025-10-10T14:34:21.719690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:21.719702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0] Write session will restart in 0.008364s
2025-10-10T14:34:21.719738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0] Write session: Do CDS request
2025-10-10T14:34:21.719747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:21.728912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.729027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:21.729049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1314
2025-10-10T14:34:21.729189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.729242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:21.729247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:21.729251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:21.729623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1314 sessionId:  describe result for acl check
2025-10-10T14:34:21.729653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:21.729655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:21.729656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:21.729662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601407778168803:2412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:21.730108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601407778168803:2412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:21.735255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601407778168803:2412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:21.738487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601407778168803:2412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:21.738521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601407778168803:2412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:21.738524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601407778168803:2412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:21.738534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:21.738583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:21.740822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:21.741038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:21.741052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:21.741065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:21.741125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:21.741311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601406995945678:7939]
2025-10-10T14:34:21.741994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:21.742391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:21.742441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:21.742767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:21.742824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.742830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.742831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.742832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.742833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.742834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.742835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.742836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.742837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.742838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.742839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.742840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.742841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.742847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.742857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.742860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.742864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.742867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.742870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.742873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.742876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.742879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.742883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.742886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.742890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.742893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.742899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.742907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.742913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.742918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.742922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.742927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.742931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.742935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.742939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.742943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.742946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.742951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.742957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.742962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.742965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.742970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.742974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.742978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.742982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.742986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.743002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.743006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.743010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.743015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.743019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.743023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.743055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:21.745624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:21.746051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:21.746066Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:21.746069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:21.746073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:21.746080Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1313 [2:7559601406995945678:7939]
2025-10-10T14:34:21.746092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:21.746113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:21.746117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.746120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.746122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.746139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:21.746152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:21.746160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:21.746218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.746229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.746231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.746234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:21.746303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:21.746312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.746323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.746334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.746350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:21.746388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601406995945672:7939]
2025-10-10T14:34:21.746395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601406995945672:7939]
2025-10-10T14:34:21.746397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601406995945672:7939]
2025-10-10T14:34:21.746411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:21.746428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168927:2412], now have 1 active actors on pipe
2025-10-10T14:34:21.746427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:21.746430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:21.746432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168777:2438], now have 1 active actors on pipe
2025-10-10T14:34:21.746433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:21.746441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:21.746457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:21.746460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:21.746487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601406995945672:7939]
2025-10-10T14:34:21.746502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:21.746508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:21.746623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1313
2025-10-10T14:34:21.746652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1313
2025-10-10T14:34:21.746826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.746838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.746882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:21.746895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.746900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.746902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:21.746914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.746927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:21.746948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.747121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.747130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.747146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.747265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1314 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0
2025-10-10T14:34:21.747754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3533cfff-83bc8348-624ff179-9a2ceb5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:21.750601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0] Write session: try to update token
2025-10-10T14:34:21.750619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:21.767201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:21.767221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:21.767225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:21.767226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:21.767236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601406995945672:7939]
2025-10-10T14:34:21.767241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601406995945672:7939]
2025-10-10T14:34:21.767244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601406995945672:7939]
2025-10-10T14:34:21.769382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId: src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:21.772134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:21.767296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:21.767308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.767310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:21.767457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:21.772301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:21.772307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:21.772311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:21.819599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601407778168952:2527]
2025-10-10T14:34:21.819901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1313, pipe: [1:7559601407778168952:2527]
2025-10-10T14:34:21.899063Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:21.899440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.899459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.899507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168952:2527], now have 1 active actors on pipe
2025-10-10T14:34:21.899743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:21.899760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:21.899764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:21.899812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601407778168952:2527]
2025-10-10T14:34:21.899839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:21.899842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1314 reason: error at write: Disconnected sessionId: src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0
2025-10-10T14:34:21.900219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:21.900235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0] Write session will restart in 0.008935s
2025-10-10T14:34:21.900055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1314 sessionId: src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0 is DEAD
2025-10-10T14:34:21.900262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0] Write session: Do CDS request
2025-10-10T14:34:21.900271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:21.911007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.911041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:21.911062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1315
2025-10-10T14:34:21.911309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:21.911347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:21.911359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:21.911375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:21.911811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1315 sessionId:  describe result for acl check
2025-10-10T14:34:21.911859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:21.911866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:21.911868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:21.911884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601407778169063:2389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:21.912500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601407778169063:2389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:21.913211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:21.915536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601407778169063:2389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:21.917493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:21.917816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:21.917828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:21.917843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:21.917913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:21.917975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601406995945850:7955]
2025-10-10T14:34:21.918612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:21.918803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601407778169063:2389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:21.918822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601407778169063:2389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:21.918826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601407778169063:2389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:21.918837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:21.919021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:21.919078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:21.919451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:21.919502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.919504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.919505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.919507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.919509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.919510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.919512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.919514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.919516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.919517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.919519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.919520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.919521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.919528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.919542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.919547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.919551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.919556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.919560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.919565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.919569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.919573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.919578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.919582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.919586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.919604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.919611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.919621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:21.919627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.919633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:21.919638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.919644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:21.919648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.919653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:21.919659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.919664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:21.919669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.919675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:21.919680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.919685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:21.919690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.919695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:21.919700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.919706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:21.919710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.919716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:21.919722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.919727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.919732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.919737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.919743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.919748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.919791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:21.922490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:21.922843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:21.922853Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:21.922856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:21.922860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:21.922867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1314 [2:7559601406995945850:7955]
2025-10-10T14:34:21.922880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:21.922897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:21.922900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.922904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.922906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.922923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:21.922938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:21.922945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:21.923002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.923009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.923011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.923014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:21.923080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:21.923085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.923097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:21.923110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:21.923147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:21.923170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778168954:2438], now have 1 active actors on pipe
2025-10-10T14:34:21.923174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778169095:2389], now have 1 active actors on pipe
2025-10-10T14:34:21.923181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601406995945845:7955]
2025-10-10T14:34:21.923184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601406995945845:7955]
2025-10-10T14:34:21.923186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601406995945845:7955]
2025-10-10T14:34:21.923199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1314
2025-10-10T14:34:21.923199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1314
2025-10-10T14:34:21.923199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:21.923214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:21.923218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:21.923220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:21.923229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:21.923246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:21.923250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:21.923277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601406995945845:7955]
2025-10-10T14:34:21.923284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:21.923291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:21.923302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.923312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.923361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:21.923374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:21.923378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:21.923381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:21.923392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:21.923402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:21.923419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.924010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:21.924020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:21.924035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:21.924158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1315 partition: 0 MaxSeqNo: 40 sessionId: src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0
2025-10-10T14:34:21.924584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e5747a-8b2bfc9a-6fdce29-332f0e96_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:21.927454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0] Write session: try to update token
2025-10-10T14:34:21.927474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:21.952370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId: src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:21.953197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:21.953216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:21.953220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:21.953222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:21.953232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601406995945845:7955]
2025-10-10T14:34:21.953236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601406995945845:7955]
2025-10-10T14:34:21.953240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601406995945845:7955]
2025-10-10T14:34:21.953290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:21.953307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:21.953309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:21.953313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:21.953320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:21.953324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:21.955137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:21.953479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:21.999823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601407778169106:2527]
2025-10-10T14:34:22.000116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1314, pipe: [1:7559601407778169106:2527]
2025-10-10T14:34:22.076426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:22.076837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.076853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.076899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601407778169106:2527], now have 1 active actors on pipe
2025-10-10T14:34:22.077129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:22.077175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601407778169106:2527]
2025-10-10T14:34:22.077186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:22.077189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:22.077277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1315 reason: error at write: Disconnected sessionId: src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0
2025-10-10T14:34:22.077181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:22.077506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1315 sessionId: src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0 is DEAD
2025-10-10T14:34:22.077638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:22.077647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0] Write session will restart in 0.006155s
2025-10-10T14:34:22.077681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0] Write session: Do CDS request
2025-10-10T14:34:22.077687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:22.084917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.085084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:22.085110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1316
2025-10-10T14:34:22.085245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.085292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:22.085303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:22.085306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:22.085835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1316 sessionId:  describe result for acl check
2025-10-10T14:34:22.085883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:22.085885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:22.085887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:22.085893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601412073136448:2392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:22.086487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601412073136448:2392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:22.089479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601412073136448:2392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:22.090156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:22.092460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:22.092681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:22.092691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:22.092700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:22.092746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:22.092782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601411290913294:7957]
2025-10-10T14:34:22.093283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:22.093761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:22.093831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:22.094176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:22.094245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.094253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.094255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.094256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.094257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.094258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.094260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.094261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.094262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.094263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.094264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.094265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.094266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.094273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.094285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.094289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.094293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.094296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.094300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.094303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.094306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.094310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.094314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.094317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.094321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.094324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.094333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.094342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.094349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.094354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.094373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.094378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.094383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.094388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.094391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.094297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601412073136448:2392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:22.094396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.094318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601412073136448:2392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:22.094399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.094322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601412073136448:2392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:22.094404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.094330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:22.094410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.094414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.094419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.094423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.094427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.094432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.094435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.094440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.094444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.094448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.094452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.094458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.094462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.094466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.094503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:22.096972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:22.097472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:22.097485Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:22.097497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:22.097501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:22.097508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1315 [2:7559601411290913294:7957]
2025-10-10T14:34:22.097522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:22.097541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:22.097544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.097548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.097551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.097567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:22.097574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:22.097586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:22.097648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.097655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.097658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.097660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:22.097728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:22.097736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.097746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.097757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.097776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:22.097797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136403:2438], now have 1 active actors on pipe
2025-10-10T14:34:22.097806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136547:2392], now have 1 active actors on pipe
2025-10-10T14:34:22.097814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601411290913289:7957]
2025-10-10T14:34:22.097820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601411290913289:7957]
2025-10-10T14:34:22.097822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601411290913289:7957]
2025-10-10T14:34:22.097836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:22.097852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:22.097855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:22.097861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:22.097866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:22.097871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:22.097848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1315
2025-10-10T14:34:22.097874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:22.097859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1315
2025-10-10T14:34:22.097915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.097926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.097941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601411290913289:7957]
2025-10-10T14:34:22.097954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:22.097966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:22.097991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:22.098004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.098010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.098012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:22.098024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.098040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:22.098074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.098215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.098237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.098262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.098346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1316 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0
2025-10-10T14:34:22.098860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95052f4-d2bbbea4-e8d684f9-439d7b17_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:22.101645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0] Write session: try to update token
2025-10-10T14:34:22.101665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:22.117546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId: src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:22.118171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:22.118191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:22.118194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:22.118196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:22.118205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601411290913289:7957]
2025-10-10T14:34:22.118210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601411290913289:7957]
2025-10-10T14:34:22.118218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601411290913289:7957]
2025-10-10T14:34:22.118270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:22.118269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:22.118277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:22.118282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:22.118283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.118285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:22.120206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:22.118427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:22.177487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601412073136557:2527]
2025-10-10T14:34:22.177776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1315, pipe: [1:7559601412073136557:2527]
2025-10-10T14:34:22.231717Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:22.232059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.232083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.232137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136557:2527], now have 1 active actors on pipe
2025-10-10T14:34:22.232401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601412073136557:2527]
2025-10-10T14:34:22.232434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:22.232438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:22.232439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:22.232424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:22.232521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1316 reason: error at write: Disconnected sessionId: src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0
2025-10-10T14:34:22.232770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1316 sessionId: src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0 is DEAD
2025-10-10T14:34:22.232927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:22.232939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0] Write session will restart in 0.007796s
2025-10-10T14:34:22.232965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0] Write session: Do CDS request
2025-10-10T14:34:22.232974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:22.241909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.244032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:22.244051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1317
2025-10-10T14:34:22.244204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.244237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:22.244244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:22.244247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:22.244679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1317 sessionId:  describe result for acl check
2025-10-10T14:34:22.244704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:22.244706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:22.244708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:22.244714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601412073136642:2384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:22.245272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601412073136642:2384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:22.247635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601412073136642:2384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:22.247630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:22.249732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:22.249968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:22.249978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:22.249991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:22.250045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:22.250089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601411290913445:7959]
2025-10-10T14:34:22.250307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601412073136642:2384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:22.250324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601412073136642:2384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:22.250329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601412073136642:2384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:22.250337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:22.250674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:22.251007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:22.251065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:22.251421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:22.251481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.251487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.251488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.251490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.251491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.251492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.251493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.251494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.251495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.251497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.251498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.251499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.251500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.251506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.251521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.251525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.251530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.251534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.251538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.251542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.251546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.251551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.251555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.251559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.251563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.251567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.251576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.251590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.251602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.251611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.251615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.251619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.251623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.251627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.251632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.251637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.251641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.251647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.251652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.251658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.251662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.251681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.251691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.251696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.251704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.251710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.251719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.251723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.251728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.251736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.251741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.251751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.251790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:22.254229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:22.254706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:22.254718Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:22.254721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:22.254725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:22.254730Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1316 [2:7559601411290913445:7959]
2025-10-10T14:34:22.254745Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:22.254762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:22.254766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.254769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.254772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.254788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:22.254812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:22.254824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:22.254879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.254885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.254887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.254890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:22.254955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:22.254962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.254973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.254997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.255018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:22.255042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601411290913440:7959]
2025-10-10T14:34:22.255049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601411290913440:7959]
2025-10-10T14:34:22.255052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601411290913440:7959]
2025-10-10T14:34:22.255062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:22.255070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:22.255072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:22.255073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:22.255081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:22.255102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:22.255109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:22.255121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136700:2384], now have 1 active actors on pipe
2025-10-10T14:34:22.255158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601411290913440:7959]
2025-10-10T14:34:22.255165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:22.255170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136558:2438], now have 1 active actors on pipe
2025-10-10T14:34:22.255175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:22.255202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.255212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.255159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1316
2025-10-10T14:34:22.255189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1316
2025-10-10T14:34:22.255243Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c31b7b19-56ef870-337ae433-6a8eb949_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:22.255255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.255263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.255265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:22.255277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.255292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:22.255310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.256661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1317 partition: 0 MaxSeqNo: 40 sessionId: src_id|c31b7b19-56ef870-337ae433-6a8eb949_0
2025-10-10T14:34:22.257055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a5a8d2a-79bfd62d-293e49cd-416d2525_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c31b7b19-56ef870-337ae433-6a8eb949_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:22.256305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.256317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.256337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.259786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31b7b19-56ef870-337ae433-6a8eb949_0] Write session: try to update token
2025-10-10T14:34:22.259806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31b7b19-56ef870-337ae433-6a8eb949_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:22.276192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:22.276209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:22.276213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:22.276215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:22.276225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601411290913440:7959]
2025-10-10T14:34:22.276230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601411290913440:7959]
2025-10-10T14:34:22.276234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601411290913440:7959]
2025-10-10T14:34:22.276304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:22.276311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:22.276315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:22.276316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:22.276330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.276333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:22.276472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:22.282876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId: src_id|c31b7b19-56ef870-337ae433-6a8eb949_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:22.285577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:22.333367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601412073136712:2527]
2025-10-10T14:34:22.333839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1316, pipe: [1:7559601412073136712:2527]
2025-10-10T14:34:22.392644Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:22.392924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.392941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.392988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136712:2527], now have 1 active actors on pipe
2025-10-10T14:34:22.393258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:22.393693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31b7b19-56ef870-337ae433-6a8eb949_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:22.393705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31b7b19-56ef870-337ae433-6a8eb949_0] Write session will restart in 0.005696s
2025-10-10T14:34:22.393729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31b7b19-56ef870-337ae433-6a8eb949_0] Write session: Do CDS request
2025-10-10T14:34:22.393172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:22.393736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31b7b19-56ef870-337ae433-6a8eb949_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:22.393230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:22.393233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:22.393313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1317 reason: error at write: Disconnected sessionId: src_id|c31b7b19-56ef870-337ae433-6a8eb949_0
2025-10-10T14:34:22.393399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601412073136712:2527]
2025-10-10T14:34:22.393529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1317 sessionId: src_id|c31b7b19-56ef870-337ae433-6a8eb949_0 is DEAD
2025-10-10T14:34:22.401908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31b7b19-56ef870-337ae433-6a8eb949_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.402035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:22.402053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1318
2025-10-10T14:34:22.402215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.402252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:22.402264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:22.402268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:22.402733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1318 sessionId:  describe result for acl check
2025-10-10T14:34:22.402773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:22.402782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:22.402784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:22.402790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601412073136726:2368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:22.403377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601412073136726:2368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:22.408290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601412073136726:2368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:22.412010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601412073136726:2368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:22.412028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601412073136726:2368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:22.412033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601412073136726:2368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:22.412042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:22.414659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:22.416792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:22.417024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:22.417037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:22.417050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:22.417135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:22.417185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601411290913597:7961]
2025-10-10T14:34:22.417909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:22.418334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:22.418392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:22.418740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:22.418818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.418819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.418820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.418821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.418823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.418824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.418825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.418826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.418827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.418828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.418830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.418831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.418832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.418838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.418850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.418853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.418857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.418861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.418864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.418868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.418871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.418875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.418879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.418882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.418885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.418889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.418898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.418907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.418913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.418919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.418922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.418927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.418932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.418937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.418942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.418947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.418951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.418956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.418960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.418966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.418970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.418975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.418979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.418984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.418987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.418992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.418996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.419002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.419006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.419011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.419015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.419019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.419059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:22.421714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:22.422904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1317
2025-10-10T14:34:22.422391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:22.422408Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:22.422411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:22.422415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:22.422422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1317 [2:7559601411290913597:7961]
2025-10-10T14:34:22.422436Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:22.422455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:22.422458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.422461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.422464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.422485Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:22.422492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:22.422501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:22.422566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.422568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.422571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.422573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:22.422649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:22.422992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1317
2025-10-10T14:34:22.422653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.422666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.422678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.422696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:22.422718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601411290913592:7961]
2025-10-10T14:34:22.422721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601411290913592:7961]
2025-10-10T14:34:22.422723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601411290913592:7961]
2025-10-10T14:34:22.422732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:22.422749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:22.422750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:22.422753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:22.422755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:22.422768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:22.422772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:22.422900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136840:2368], now have 1 active actors on pipe
2025-10-10T14:34:22.422904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136713:2438], now have 1 active actors on pipe
2025-10-10T14:34:22.422907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601411290913592:7961]
2025-10-10T14:34:22.422918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:22.422989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:22.423105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.423111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.423143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:22.423151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.423156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.423158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:22.423171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.423208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:22.423224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.423368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.423378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.423395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.423494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1318 partition: 0 MaxSeqNo: 40 sessionId: src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0
2025-10-10T14:34:22.423968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31b7b19-56ef870-337ae433-6a8eb949_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:22.426764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0] Write session: try to update token
2025-10-10T14:34:22.426782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:22.441599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:22.441623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:22.441636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601411290913592:7961]
2025-10-10T14:34:22.441702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:22.441705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:22.441890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:22.442031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:22.442166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:22.442290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:22.442881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:22.442923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:22.447188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId: src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:22.449881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:22.450153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.450175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.450236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:22.450347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:22.458686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:22.458708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:22.458716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:22.458718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:22.458729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601411290913592:7961]
2025-10-10T14:34:22.458733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601411290913592:7961]
2025-10-10T14:34:22.458737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601411290913592:7961]
2025-10-10T14:34:22.458787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:22.458787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:22.458793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:22.458798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:22.458800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.458802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:22.458933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:22.493374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601412073136868:2527]
2025-10-10T14:34:22.493824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1317, pipe: [1:7559601412073136868:2527]
2025-10-10T14:34:22.578050Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:22.586345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.586374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.586569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.586641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.586715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.586784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.587370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.587385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.587462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.587534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.587616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.587691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.587738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.587746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.587818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.587886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.587954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.588022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.588069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.588076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.588150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.588217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.588304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.588375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.588426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.588435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.588504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.588569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.588638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.588708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.588754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.588761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.588832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.588901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.588972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.589048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.589099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.589105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.589178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.589243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.589316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.589400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.589454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.589462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.589531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.589597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.589666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.589738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.589807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.589815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.589921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.590057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.590185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.590307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.590358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.590364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.590489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:22.590548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:22.590814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:22.590885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:22.590932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:22.590940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:22.591012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136868:2527], now have 1 active actors on pipe
2025-10-10T14:34:22.591570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:22.591773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:22.591782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0] Write session will restart in 0.009955s
2025-10-10T14:34:22.591817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0] Write session: Do CDS request
2025-10-10T14:34:22.591823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:22.591297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601412073136868:2527]
2025-10-10T14:34:22.591343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:22.591346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:22.591380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1318 reason: error at write: Disconnected sessionId: src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0
2025-10-10T14:34:22.591616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1318 sessionId: src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0 is DEAD
2025-10-10T14:34:22.591630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:22.602936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.603008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:22.603029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1319
2025-10-10T14:34:22.603173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.603220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:22.603231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:22.603236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:22.603659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1319 sessionId:  describe result for acl check
2025-10-10T14:34:22.603744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:22.603751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:22.603753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:22.603759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601412073136987:2372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:22.604371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601412073136987:2372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:22.605780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:22.606950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601412073136987:2372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:22.607891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:22.608197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:22.608210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:22.608223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:22.608296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:22.608338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601411290913760:7964]
2025-10-10T14:34:22.608909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:22.609185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:22.609231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:22.609315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601412073136987:2372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:22.609342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601412073136987:2372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:22.609346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601412073136987:2372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:22.609356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:22.609555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:22.609622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.609628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.609629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.609630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.609631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.609632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.609634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.609635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.609636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.609637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.609638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.609639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.609640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.609646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.609658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.609662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.609665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.609668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.609672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.609676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.609680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.609683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.609687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.609691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.609694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.609697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.609704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.609712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.609718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.609723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.609728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.609733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.609737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.609741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.609746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.609751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.609756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.609761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.609765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.609770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.609774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.609778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.609782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.609788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.609792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.609797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.609801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.609806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.609810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.609814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.609818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.609822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.609859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:22.612288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:22.612664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:22.612677Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:22.612680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:22.612684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:22.612690Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1318 [2:7559601411290913760:7964]
2025-10-10T14:34:22.612704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:22.612721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:22.612728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.612732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.612736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.612752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:22.612767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:22.612775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:22.612828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.612835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.612837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.612839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:22.613013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:22.613021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.613033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.613049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.613045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1318
2025-10-10T14:34:22.613066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:22.613093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073136882:2438], now have 1 active actors on pipe
2025-10-10T14:34:22.613047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1318
2025-10-10T14:34:22.613097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073137031:2372], now have 1 active actors on pipe
2025-10-10T14:34:22.613105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601411290913755:7964]
2025-10-10T14:34:22.613113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601411290913755:7964]
2025-10-10T14:34:22.613115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601411290913755:7964]
2025-10-10T14:34:22.613128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:22.613142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:22.613144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:22.613146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:22.613151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:22.613167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:22.613175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:22.613191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.613200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.613235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601411290913755:7964]
2025-10-10T14:34:22.613250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:22.613275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ca15d93-b3e44553-5937cd63-330fa488_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:22.613275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:22.613282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.613287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.613289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:22.613301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.613312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:22.613366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.613559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.613572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.613593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.613704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1319 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ca15d93-b3e44553-5937cd63-330fa488_0
2025-10-10T14:34:22.614081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32bc056-cea4749a-f2f1ce12-5fe50023_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ca15d93-b3e44553-5937cd63-330fa488_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:22.617037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca15d93-b3e44553-5937cd63-330fa488_0] Write session: try to update token
2025-10-10T14:34:22.617054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca15d93-b3e44553-5937cd63-330fa488_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:22.634387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:22.634411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:22.634415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:22.634417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:22.634429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601411290913755:7964]
2025-10-10T14:34:22.634435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601411290913755:7964]
2025-10-10T14:34:22.634440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601411290913755:7964]
2025-10-10T14:34:22.634500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:22.634515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.634518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:22.634682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:22.635243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:22.635249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:22.635257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:22.636802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId: src_id|7ca15d93-b3e44553-5937cd63-330fa488_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:22.639608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:22.693446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601412073137050:2527]
2025-10-10T14:34:22.693771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1318, pipe: [1:7559601412073137050:2527]
2025-10-10T14:34:22.748956Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:22.749366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.749383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.749431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073137050:2527], now have 1 active actors on pipe
2025-10-10T14:34:22.749743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601412073137050:2527]
2025-10-10T14:34:22.749744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:22.749784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:22.749787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:22.749854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1319 reason: error at write: Disconnected sessionId: src_id|7ca15d93-b3e44553-5937cd63-330fa488_0
2025-10-10T14:34:22.750093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1319 sessionId: src_id|7ca15d93-b3e44553-5937cd63-330fa488_0 is DEAD
2025-10-10T14:34:22.750152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:22.750253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca15d93-b3e44553-5937cd63-330fa488_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:22.750265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca15d93-b3e44553-5937cd63-330fa488_0] Write session will restart in 0.005999s
2025-10-10T14:34:22.750298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca15d93-b3e44553-5937cd63-330fa488_0] Write session: Do CDS request
2025-10-10T14:34:22.750308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca15d93-b3e44553-5937cd63-330fa488_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:22.757927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca15d93-b3e44553-5937cd63-330fa488_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.758011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:22.758031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1320
2025-10-10T14:34:22.758177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.758231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:22.758237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:22.758241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:22.758768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1320 sessionId:  describe result for acl check
2025-10-10T14:34:22.758808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:22.758815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:22.758817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:22.758824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601412073137075:2361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:22.759398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601412073137075:2361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:22.762120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601412073137075:2361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:22.765123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601412073137075:2361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:22.765142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601412073137075:2361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:22.765145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601412073137075:2361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:22.765126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:22.765210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:22.767451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:22.767705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:22.767717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:22.767729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:22.767793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:22.767840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601411290913916:7967]
2025-10-10T14:34:22.768452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:22.768755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:22.768810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:22.769176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:22.769237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.769238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.769239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.769240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.769242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.769243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.769244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.769245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.769246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.769248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.769249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.769250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.769251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.769257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.769271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.769275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.769280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.769284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.769288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.769292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.769296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.769300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.769305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.769309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.769313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.769317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.769325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.769346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.769352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.769358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.769363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.769368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.769372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.769378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.769383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.769388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.769393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.769398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.769403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.769408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.769414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.769419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.769423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.769428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.769432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.769437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.769442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.769447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.769451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.769456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.769461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.769466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.769507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:22.772224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:22.772785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:22.772797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:22.772800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:22.772804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:22.772810Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1319 [2:7559601411290913916:7967]
2025-10-10T14:34:22.772824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:22.772843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:22.772853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.772861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.772864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.772882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:22.772894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:22.772902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:22.772963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.772971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.772973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.772975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:22.773044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:22.773052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.773063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.773080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.773100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:22.773125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601411290913910:7967]
2025-10-10T14:34:22.773135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601411290913910:7967]
2025-10-10T14:34:22.773136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601411290913910:7967]
2025-10-10T14:34:22.773145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:22.773154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:22.773158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:22.773160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:22.773163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073137051:2438], now have 1 active actors on pipe
2025-10-10T14:34:22.773169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:22.773185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:22.773189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:22.773195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073137195:2361], now have 1 active actors on pipe
2025-10-10T14:34:22.773227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601411290913910:7967]
2025-10-10T14:34:22.773234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:22.773349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1319
2025-10-10T14:34:22.773403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1319
2025-10-10T14:34:22.777478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:22.777699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.777721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.777762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0669e58-c1f44986-1d26efea-82924162_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:22.777780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.777785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.777788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:22.777803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.777831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:22.777850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.781616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.781633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.781669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.781867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1320 partition: 0 MaxSeqNo: 40 sessionId: src_id|d0669e58-c1f44986-1d26efea-82924162_0
2025-10-10T14:34:22.782303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ca15d93-b3e44553-5937cd63-330fa488_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d0669e58-c1f44986-1d26efea-82924162_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:22.785080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0669e58-c1f44986-1d26efea-82924162_0] Write session: try to update token
2025-10-10T14:34:22.785102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0669e58-c1f44986-1d26efea-82924162_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:22.799391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:22.799409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:22.799412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:22.799413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:22.799422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601411290913910:7967]
2025-10-10T14:34:22.799427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601411290913910:7967]
2025-10-10T14:34:22.799430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601411290913910:7967]
2025-10-10T14:34:22.799477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:22.799479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:22.799486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:22.799489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:22.799489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.799491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:22.799623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:22.804624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId: src_id|d0669e58-c1f44986-1d26efea-82924162_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:22.807579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:22.849733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601412073137232:2527]
2025-10-10T14:34:22.850261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1319, pipe: [1:7559601412073137232:2527]
2025-10-10T14:34:22.915684Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:22.916174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.916195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.916267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073137232:2527], now have 1 active actors on pipe
2025-10-10T14:34:22.916502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:22.916512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601412073137232:2527]
2025-10-10T14:34:22.916536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:22.916538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:22.916613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1320 reason: error at write: Disconnected sessionId: src_id|d0669e58-c1f44986-1d26efea-82924162_0
2025-10-10T14:34:22.916837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1320 sessionId: src_id|d0669e58-c1f44986-1d26efea-82924162_0 is DEAD
2025-10-10T14:34:22.916968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0669e58-c1f44986-1d26efea-82924162_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:22.916979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0669e58-c1f44986-1d26efea-82924162_0] Write session will restart in 0.009837s
2025-10-10T14:34:22.917004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0669e58-c1f44986-1d26efea-82924162_0] Write session: Do CDS request
2025-10-10T14:34:22.917011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0669e58-c1f44986-1d26efea-82924162_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:22.916877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:22.927942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0669e58-c1f44986-1d26efea-82924162_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.928082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:22.928100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1321
2025-10-10T14:34:22.928235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:22.928273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:22.928279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:22.928283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:22.928695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1321 sessionId:  describe result for acl check
2025-10-10T14:34:22.928721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:22.928723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:22.928725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:22.928731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601412073137250:2337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:22.929280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601412073137250:2337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:22.932717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601412073137250:2337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:22.936376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:22.936543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601412073137250:2337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:22.936561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601412073137250:2337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:22.936565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601412073137250:2337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:22.936574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:22.938726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:22.938991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:22.939003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:22.939016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:22.939082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:22.939126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601411290914108:7982]
2025-10-10T14:34:22.939806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:22.940114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:22.940162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:22.940551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:22.940622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.940629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.940631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.940632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.940633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.940635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.940637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.940638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.940639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.940641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.940642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.940643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.940645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.940651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.940667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.940672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.940677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.940682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.940687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.940691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.940696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.940700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.940706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.940710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.940715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.940720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.940727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.940736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:22.940742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.940749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:22.940755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.940761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:22.940766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.940771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:22.940787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.940793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:22.940798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.940804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:22.940812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.940818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:22.940823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.940829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:22.940834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.940840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:22.940845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.940851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:22.940855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.940861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.940868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.940873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.940878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.940884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.940929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:22.943505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:22.943866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:22.943878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:22.943881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:22.943884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:22.943891Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1320 [2:7559601411290914108:7982]
2025-10-10T14:34:22.943902Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:22.943919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:22.943923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.943927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.943930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.943947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:22.943960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:22.943971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:22.944029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.944039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.944041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.944044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:22.944114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:22.944121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.944132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:22.944145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:22.944168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:22.944192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601411290914102:7982]
2025-10-10T14:34:22.944200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601411290914102:7982]
2025-10-10T14:34:22.944202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601411290914102:7982]
2025-10-10T14:34:22.944223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:22.944250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073137379:2337], now have 1 active actors on pipe
2025-10-10T14:34:22.944262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601412073137233:2438], now have 1 active actors on pipe
2025-10-10T14:34:22.944352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1320
2025-10-10T14:34:22.944352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1320
2025-10-10T14:34:22.944267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:22.944288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:22.944292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:22.944327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:22.944329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601411290914102:7982]
2025-10-10T14:34:22.944331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:22.944332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:22.944333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:22.944340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:22.944531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.944537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.944575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef894d43-51879bed-6ad88cd9-9309c677_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:22.944583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:22.944586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:22.944589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:22.944601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:22.944612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:22.944626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.949517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:22.949535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:22.949572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:22.949774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1321 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef894d43-51879bed-6ad88cd9-9309c677_0
2025-10-10T14:34:22.950240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0669e58-c1f44986-1d26efea-82924162_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef894d43-51879bed-6ad88cd9-9309c677_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:22.953102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef894d43-51879bed-6ad88cd9-9309c677_0] Write session: try to update token
2025-10-10T14:34:22.953127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef894d43-51879bed-6ad88cd9-9309c677_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:22.964213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:22.964235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:22.964253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:22.964255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:22.964266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601411290914102:7982]
2025-10-10T14:34:22.964270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601411290914102:7982]
2025-10-10T14:34:22.964274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601411290914102:7982]
2025-10-10T14:34:22.964325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:22.964324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:22.964332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:22.964334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:22.964337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:22.964337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:22.964483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:22.968971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId: src_id|ef894d43-51879bed-6ad88cd9-9309c677_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:22.971640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:23.016672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601416368104688:2527]
2025-10-10T14:34:23.017098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1320, pipe: [1:7559601416368104688:2527]
2025-10-10T14:34:23.079427Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:23.079887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.079904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.079954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368104688:2527], now have 1 active actors on pipe
2025-10-10T14:34:23.080206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601416368104688:2527]
2025-10-10T14:34:23.080218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:23.080222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:23.080249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:23.080389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1321 reason: error at write: Disconnected sessionId: src_id|ef894d43-51879bed-6ad88cd9-9309c677_0
2025-10-10T14:34:23.080576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:23.080581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1321 sessionId: src_id|ef894d43-51879bed-6ad88cd9-9309c677_0 is DEAD
2025-10-10T14:34:23.080763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef894d43-51879bed-6ad88cd9-9309c677_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:23.080775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef894d43-51879bed-6ad88cd9-9309c677_0] Write session will restart in 0.009020s
2025-10-10T14:34:23.080800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef894d43-51879bed-6ad88cd9-9309c677_0] Write session: Do CDS request
2025-10-10T14:34:23.080810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef894d43-51879bed-6ad88cd9-9309c677_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:23.090951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef894d43-51879bed-6ad88cd9-9309c677_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.091914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:23.091936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1322
2025-10-10T14:34:23.092110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.092151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:23.092163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:23.092167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:23.092788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1322 sessionId:  describe result for acl check
2025-10-10T14:34:23.092831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:23.092848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:23.092851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:23.092857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601416368104781:2329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:23.093507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601416368104781:2329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:23.095881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601416368104781:2329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:23.096935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:23.099849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:23.100093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:23.100105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:23.100118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:23.100188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:23.100211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601416368104781:2329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:23.100254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601415585881558:7984]
2025-10-10T14:34:23.100230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601416368104781:2329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:23.100252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601416368104781:2329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:23.100261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:23.100851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:23.101177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:23.101233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:23.101550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:23.101604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.101614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.101615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.101616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.101618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.101619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.101620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.101621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.101622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.101623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.101624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.101626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.101627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.101632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.101645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.101650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.101653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.101657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.101661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.101665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.101669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.101673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.101677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.101681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.101684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.101688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.101708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.101716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.101722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.101727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.101731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.101736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.101740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.101745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.101749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.101753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.101756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.101762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.101767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.101771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.101775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.101780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.101784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.101797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.101801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.101805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.101814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.101818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.101822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.101826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.101834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.101839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.101876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:23.104324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:23.104877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:23.104896Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:23.104899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:23.104903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:23.104909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1321 [2:7559601415585881558:7984]
2025-10-10T14:34:23.104923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:23.104941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:23.104948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.104952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.104955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.104972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:23.104984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:23.104994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:23.105076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.105085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.105087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.105090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:23.105159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:23.105171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.105184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.105198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.105213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:23.105237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368104836:2329], now have 1 active actors on pipe
2025-10-10T14:34:23.105252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601415585881553:7984]
2025-10-10T14:34:23.105260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601415585881553:7984]
2025-10-10T14:34:23.105262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601415585881553:7984]
2025-10-10T14:34:23.105354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1321
2025-10-10T14:34:23.105378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1321
2025-10-10T14:34:23.105278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:23.105298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368104689:2438], now have 1 active actors on pipe
2025-10-10T14:34:23.105304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:23.105322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:23.105326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:23.105371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601415585881553:7984]
2025-10-10T14:34:23.105374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:23.105381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:23.105386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:23.105388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:23.105397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:23.105448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.105453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.105482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:23.105490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.105496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.105498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:23.105511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.105522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:23.105540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.105779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.105783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.105808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.105904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1322 partition: 0 MaxSeqNo: 40 sessionId: src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0
2025-10-10T14:34:23.106334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef894d43-51879bed-6ad88cd9-9309c677_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:23.108994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0] Write session: try to update token
2025-10-10T14:34:23.109014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:23.126983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:23.127004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:23.127016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601415585881553:7984]
2025-10-10T14:34:23.127073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:23.127076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:23.127260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:23.127407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.127577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.127721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.127922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:23.127970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:23.128636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId: src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:23.131324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:23.131557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.131581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.131623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:23.131708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:23.149921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:23.149942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:23.149945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:23.149947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:23.149958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601415585881553:7984]
2025-10-10T14:34:23.149961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601415585881553:7984]
2025-10-10T14:34:23.149965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601415585881553:7984]
2025-10-10T14:34:23.150017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:23.150020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:23.150028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.150030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:23.150033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:23.150038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:23.150170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:23.180498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601416368104848:2527]
2025-10-10T14:34:23.180897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1321, pipe: [1:7559601416368104848:2527]
2025-10-10T14:34:23.265205Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:23.274149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.274181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.274375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.274450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.274524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.274592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.274643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.274654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.274732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.274798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.274862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.274935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.274986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.274997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.275073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.275138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.275203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.275319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.275374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.275380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.275511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.275583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.275654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.275727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.275772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.275782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.275855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.275917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.275981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.276045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.276095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.276103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.276176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.276261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.276337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.276401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.276446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.276449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.276524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.276587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.276654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.276720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.276762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.276765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.276840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.276903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.276967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.277034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.277083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.277086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.277166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.277231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.277295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.277519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.277575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.277590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.277663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.277735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.277809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.277882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.277938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.277948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.278022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368104848:2527], now have 1 active actors on pipe
2025-10-10T14:34:23.278889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:23.278906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0] Write session will restart in 0.009170s
2025-10-10T14:34:23.278935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0] Write session: Do CDS request
2025-10-10T14:34:23.278942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:23.279371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:23.278317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601416368104848:2527]
2025-10-10T14:34:23.278367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:23.278426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:23.278430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:23.278462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1322 reason: error at write: Disconnected sessionId: src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0
2025-10-10T14:34:23.278693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1322 sessionId: src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0 is DEAD
2025-10-10T14:34:23.289002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.289068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:23.289095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1323
2025-10-10T14:34:23.289226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.289262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:23.289270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:23.289273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:23.289747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1323 sessionId:  describe result for acl check
2025-10-10T14:34:23.289794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:23.289803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:23.289805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:23.289810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601416368104890:2316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:23.290412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601416368104890:2316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:23.295468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601416368104890:2316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:23.297602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:23.300505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:23.300678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601416368104890:2316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:23.300698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601416368104890:2316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:23.300701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601416368104890:2316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:23.300710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:23.300774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:23.300783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:23.300796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:23.300862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:23.300908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601415585881714:7986]
2025-10-10T14:34:23.301550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:23.301940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:23.301995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:23.302333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:23.302397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.302407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.302408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.302410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.302411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.302412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.302414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.302415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.302417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.302419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.302420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.302421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.302423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.302429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.302442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.302447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.302451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.302455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.302459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.302463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.302467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.302472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.302476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.302480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.302484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.302488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.302496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.302505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.302512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.302518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.302522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.302528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.302532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.302537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.302542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.302547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.302551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.302556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.302561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.302566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.302570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.302576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.302582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.302595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.302600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.302604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.302608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.302613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.302622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.302627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.302632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.302642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.302681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:23.305417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:23.305846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:23.305867Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:23.305870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:23.305875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:23.305885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1322 [2:7559601415585881714:7986]
2025-10-10T14:34:23.305901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:23.305921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:23.305930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.305934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.305937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.305955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:23.305969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:23.305977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:23.306049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.306057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.306060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.306063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:23.306144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:23.306156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.306170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.306184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.306203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:23.306230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601415585881709:7986]
2025-10-10T14:34:23.306238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601415585881709:7986]
2025-10-10T14:34:23.306240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601415585881709:7986]
2025-10-10T14:34:23.306254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:23.306270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105007:2316], now have 1 active actors on pipe
2025-10-10T14:34:23.306283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:23.306284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:23.306286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:23.306288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:23.306301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:23.306304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:23.306346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601415585881709:7986]
2025-10-10T14:34:23.306358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:23.306368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:23.306375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368104850:2438], now have 1 active actors on pipe
2025-10-10T14:34:23.306490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1322
2025-10-10T14:34:23.306494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1322
2025-10-10T14:34:23.306659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.306676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.306714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bff7ba5b-ee893389-4b070431-879647ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:23.306729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.306738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.306741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:23.306755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.306775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:23.306792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.307018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.307030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.307054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.307184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1323 partition: 0 MaxSeqNo: 40 sessionId: src_id|bff7ba5b-ee893389-4b070431-879647ba_0
2025-10-10T14:34:23.307700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bbe5ba-7dd207a6-39584bf7-49efbbcb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bff7ba5b-ee893389-4b070431-879647ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:23.310626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff7ba5b-ee893389-4b070431-879647ba_0] Write session: try to update token
2025-10-10T14:34:23.310650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff7ba5b-ee893389-4b070431-879647ba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:23.319683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:23.319705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:23.319719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601415585881709:7986]
2025-10-10T14:34:23.319778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:23.319784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:23.319973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:23.320134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.320303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.320454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.320667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:23.320718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:23.328516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId: src_id|bff7ba5b-ee893389-4b070431-879647ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:23.331477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:23.331720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.331741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.331785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:23.331870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:23.338642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:23.338664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:23.338668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:23.338671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:23.338683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601415585881709:7986]
2025-10-10T14:34:23.338690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601415585881709:7986]
2025-10-10T14:34:23.338695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601415585881709:7986]
2025-10-10T14:34:23.338755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:23.338768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:23.338772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.338775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:23.338776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:23.338781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:23.338945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:23.378662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601416368105019:2527]
2025-10-10T14:34:23.378971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1322, pipe: [1:7559601416368105019:2527]
2025-10-10T14:34:23.453902Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:23.461782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.461811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.461966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.462024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.462096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.462157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.462207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.462218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.462291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.462356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.462417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.462486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.462528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.462534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.462602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.462670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.462735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.462801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.462851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.462859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.462928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.462991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.463057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.463127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.463173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.463180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.463250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.463315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.463384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.463447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.463491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.463502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.463570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.463634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.463703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.463769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.463818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.463827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.463896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.463957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.464023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.464087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.464136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.464145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.464217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.464291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.464358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.464424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.464473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.464481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.464550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.464612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.464679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.464744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.464789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.464796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.464859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.464918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.464984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.465048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.465092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.465099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.465163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105019:2527], now have 1 active actors on pipe
2025-10-10T14:34:23.465446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:23.465465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:23.465501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1323 reason: error at write: Disconnected sessionId: src_id|bff7ba5b-ee893389-4b070431-879647ba_0
2025-10-10T14:34:23.465705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601416368105019:2527]
2025-10-10T14:34:23.465718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1323 sessionId: src_id|bff7ba5b-ee893389-4b070431-879647ba_0 is DEAD
2025-10-10T14:34:23.465758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:23.465869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff7ba5b-ee893389-4b070431-879647ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:23.465878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff7ba5b-ee893389-4b070431-879647ba_0] Write session will restart in 0.008047s
2025-10-10T14:34:23.465902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff7ba5b-ee893389-4b070431-879647ba_0] Write session: Do CDS request
2025-10-10T14:34:23.465915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff7ba5b-ee893389-4b070431-879647ba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:23.466356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:23.475017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff7ba5b-ee893389-4b070431-879647ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.475058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:23.475078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1324
2025-10-10T14:34:23.475313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.475373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:23.475383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:23.475387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:23.475838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1324 sessionId:  describe result for acl check
2025-10-10T14:34:23.475878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:23.475879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:23.475881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:23.475889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601416368105102:8192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:23.476478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601416368105102:8192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:23.479154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601416368105102:8192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:23.479209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:23.481533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:23.481789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:23.481801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:23.481778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601416368105102:8192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:23.481795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601416368105102:8192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:23.481810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601416368105102:8192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:23.481821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:23.481816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:23.481895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:23.481956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601415585881871:7988]
2025-10-10T14:34:23.482595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:23.482926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:23.483003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:23.483366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:23.483425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.483432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.483433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.483435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.483436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.483437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.483438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.483439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.483441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.483442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.483444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.483445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.483447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.483454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.483467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.483472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.483476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.483480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.483484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.483488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.483492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.483496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.483501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.483505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.483509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.483513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.483536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.483549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.483557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.483567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.483572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.483577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.483586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.483592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.483597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.483607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.483620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.483630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.483634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.483640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.483644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.483649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.483658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.483663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.483667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.483673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.483682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.483688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.483692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.483701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.483706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.483711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.483755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:23.486240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:23.486587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:23.486600Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:23.486603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:23.486608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:23.486615Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1323 [2:7559601415585881871:7988]
2025-10-10T14:34:23.486628Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:23.486646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:23.486650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.486653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.486656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.486673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:23.486686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:23.486694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:23.486764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.486771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.486773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.486775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:23.486850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:23.486857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.486870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.486886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.486905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:23.486932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105171:8192], now have 1 active actors on pipe
2025-10-10T14:34:23.486940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105021:2438], now have 1 active actors on pipe
2025-10-10T14:34:23.486948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601415585881866:7988]
2025-10-10T14:34:23.486956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601415585881866:7988]
2025-10-10T14:34:23.486958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601415585881866:7988]
2025-10-10T14:34:23.486983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:23.486985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:23.486988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:23.486990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:23.487000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:23.486990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1323
2025-10-10T14:34:23.487017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:23.487024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:23.486996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1323
2025-10-10T14:34:23.487072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.487083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.487098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601415585881866:7988]
2025-10-10T14:34:23.487105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:23.487114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:23.487136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea312f75-b79c1228-7627997a-743def68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:23.487149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.487153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.487156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:23.487167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.487178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:23.487203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.487405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.487424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.487452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.487575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1324 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea312f75-b79c1228-7627997a-743def68_0
2025-10-10T14:34:23.488103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff7ba5b-ee893389-4b070431-879647ba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea312f75-b79c1228-7627997a-743def68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:23.491045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea312f75-b79c1228-7627997a-743def68_0] Write session: try to update token
2025-10-10T14:34:23.491073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea312f75-b79c1228-7627997a-743def68_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:23.505953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId: src_id|ea312f75-b79c1228-7627997a-743def68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:23.507735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:23.507756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:23.507759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:23.507761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:23.507771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601415585881866:7988]
2025-10-10T14:34:23.507775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601415585881866:7988]
2025-10-10T14:34:23.507779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601415585881866:7988]
2025-10-10T14:34:23.507832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:23.507834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:23.507845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.507846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:23.507848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:23.507850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:23.507987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:23.508767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:23.566005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601416368105194:2527]
2025-10-10T14:34:23.566319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1323, pipe: [1:7559601416368105194:2527]
2025-10-10T14:34:23.630698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:23.631137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.631148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.631192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105194:2527], now have 1 active actors on pipe
2025-10-10T14:34:23.631462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:23.631481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:23.631563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1324 reason: error at write: Disconnected sessionId: src_id|ea312f75-b79c1228-7627997a-743def68_0
2025-10-10T14:34:23.631440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:23.631819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:23.631825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1324 sessionId: src_id|ea312f75-b79c1228-7627997a-743def68_0 is DEAD
2025-10-10T14:34:23.631869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601416368105194:2527]
2025-10-10T14:34:23.632970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea312f75-b79c1228-7627997a-743def68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:23.632982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea312f75-b79c1228-7627997a-743def68_0] Write session will restart in 0.006462s
2025-10-10T14:34:23.633008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea312f75-b79c1228-7627997a-743def68_0] Write session: Do CDS request
2025-10-10T14:34:23.633014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea312f75-b79c1228-7627997a-743def68_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:23.640941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea312f75-b79c1228-7627997a-743def68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.641036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:23.641057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1325
2025-10-10T14:34:23.641178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.641214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:23.641225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:23.641228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:23.641714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1325 sessionId:  describe result for acl check
2025-10-10T14:34:23.641755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:23.641762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:23.641764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:23.641771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601416368105251:8198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:23.642380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601416368105251:8198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:23.645942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601416368105251:8198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:23.646934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:23.649588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:23.649860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:23.649873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:23.649886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:23.649958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:23.649923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601416368105251:8198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:23.649945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601416368105251:8198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:23.649948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601416368105251:8198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:23.649959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:23.650008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601415585882041:7991]
2025-10-10T14:34:23.650682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:23.651103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:23.651168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:23.651519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:23.651602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.651608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.651609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.651611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.651612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.651613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.651615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.651616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.651617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.651619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.651620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.651621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.651622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.651628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.651641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.651645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.651648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.651652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.651656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.651659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.651663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.651666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.651670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.651674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.651677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.651681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.651690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.651699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.651705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.651731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.651744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.651749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.651753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.651758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.651762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.651767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.651773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.651777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.651782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.651786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.651790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.651796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.651800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.651805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.651809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.651814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.651818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.651823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.651827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.651832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.651836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.651841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.651889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:23.654494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:23.654842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:23.654862Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:23.654864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:23.654869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:23.654876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1324 [2:7559601415585882041:7991]
2025-10-10T14:34:23.654890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:23.654909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:23.654912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.654916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.654926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.654945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:23.654957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:23.654966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:23.655031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.655039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.655041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.655044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:23.655117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:23.655128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.655140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.655150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.655165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:23.655296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1324
2025-10-10T14:34:23.655299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1324
2025-10-10T14:34:23.655186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601415585882036:7991]
2025-10-10T14:34:23.655196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601415585882036:7991]
2025-10-10T14:34:23.655199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601415585882036:7991]
2025-10-10T14:34:23.655213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:23.655228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105202:2438], now have 1 active actors on pipe
2025-10-10T14:34:23.655231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105352:8198], now have 1 active actors on pipe
2025-10-10T14:34:23.655239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:23.655242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:23.655243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:23.655245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:23.655258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:23.655261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:23.655293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601415585882036:7991]
2025-10-10T14:34:23.655301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:23.655313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:23.655358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.655363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.655394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|231ff79-7a6c749-446e2853-615113d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:23.655401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.655405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.655408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:23.655421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.655432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:23.655446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.655608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.655619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.655634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.655860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1325 partition: 0 MaxSeqNo: 40 sessionId: src_id|231ff79-7a6c749-446e2853-615113d4_0
2025-10-10T14:34:23.656296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea312f75-b79c1228-7627997a-743def68_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|231ff79-7a6c749-446e2853-615113d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:23.659198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231ff79-7a6c749-446e2853-615113d4_0] Write session: try to update token
2025-10-10T14:34:23.659221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231ff79-7a6c749-446e2853-615113d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:23.667562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:23.667584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:23.667595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601415585882036:7991]
2025-10-10T14:34:23.667647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:23.667649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:23.667835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:23.667974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.668110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.668308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:23.668502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:23.668541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:23.675468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId: src_id|231ff79-7a6c749-446e2853-615113d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:23.678515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:23.678759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.678786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.678829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:23.678951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:23.687569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:23.687592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:23.687596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:23.687598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:23.687609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601415585882036:7991]
2025-10-10T14:34:23.687613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601415585882036:7991]
2025-10-10T14:34:23.687617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601415585882036:7991]
2025-10-10T14:34:23.687675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:23.687684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.687686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:23.687852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:23.689394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:23.689412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:23.689417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:23.731421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601416368105367:2527]
2025-10-10T14:34:23.731695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1324, pipe: [1:7559601416368105367:2527]
2025-10-10T14:34:23.801611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:23.810879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.810910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.811099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.811167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.811235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.811314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.811840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.811854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.811934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.811998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.812070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.812138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.812188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.812198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.812285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.812355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.812456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.812536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.812583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.812592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.812661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.812738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.812809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.812877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.812932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.812939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.813016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.813081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.813147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.813217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.813273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.813280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.813368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.813433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.813500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.813572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.813620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.813628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.813700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.813764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.813834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.813902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.813950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.813957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.814028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.814097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.814161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.814229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.814279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.814287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.814359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.814423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.814497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.814563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.814613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.814621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.814689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:23.814756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:23.814829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:23.814895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:23.814941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:23.814950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:23.815022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105367:2527], now have 1 active actors on pipe
2025-10-10T14:34:23.815293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:23.815304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601416368105367:2527]
2025-10-10T14:34:23.815350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:23.815354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:23.815390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1325 reason: error at write: Disconnected sessionId: src_id|231ff79-7a6c749-446e2853-615113d4_0
2025-10-10T14:34:23.815590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:23.815639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1325 sessionId: src_id|231ff79-7a6c749-446e2853-615113d4_0 is DEAD
2025-10-10T14:34:23.815772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231ff79-7a6c749-446e2853-615113d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:23.815783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231ff79-7a6c749-446e2853-615113d4_0] Write session will restart in 0.006604s
2025-10-10T14:34:23.815817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231ff79-7a6c749-446e2853-615113d4_0] Write session: Do CDS request
2025-10-10T14:34:23.815823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231ff79-7a6c749-446e2853-615113d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:23.823982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231ff79-7a6c749-446e2853-615113d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.824105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:23.824125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1326
2025-10-10T14:34:23.824277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.824326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:23.824346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:23.824350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:23.824844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1326 sessionId:  describe result for acl check
2025-10-10T14:34:23.824892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:23.824900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:23.824902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:23.824908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601416368105394:8202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:23.825519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601416368105394:8202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:23.828434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601416368105394:8202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:23.830422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:23.832887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:23.832952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601416368105394:8202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:23.832974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601416368105394:8202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:23.832978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601416368105394:8202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:23.832987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:23.833107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:23.833120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:23.833132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:23.833204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:23.833248Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601415585882202:7994]
2025-10-10T14:34:23.833867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:23.834203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:23.834267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:23.834575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:23.834633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.834640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.834641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.834644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.834645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.834646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.834647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.834648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.834648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.834649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.834650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.834651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.834652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.834657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.834665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.834668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.834670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.834672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.834674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.834676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.834679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.834681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.834683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.834685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.834687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.834689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.834696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.834702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.834707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.834710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.834713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.834716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.834719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.834722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.834725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.834728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.834731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.834734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.834737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.834740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.834744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.834748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.834751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.834756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.834760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.834766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.834770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.834776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.834780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.834785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.834791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.834795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.834825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:23.837592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:23.838004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:23.838018Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:23.838021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:23.838025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:23.838033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1325 [2:7559601415585882202:7994]
2025-10-10T14:34:23.838048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:23.838067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:23.838071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.838081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.838084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.838102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:23.838113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:23.838122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:23.838188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.838198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.838202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.838206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:23.838277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:23.838285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.838300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.838320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.838342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:23.838368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105521:8202], now have 1 active actors on pipe
2025-10-10T14:34:23.838372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105370:2438], now have 1 active actors on pipe
2025-10-10T14:34:23.838380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601415585882197:7994]
2025-10-10T14:34:23.838383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601415585882197:7994]
2025-10-10T14:34:23.838386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601415585882197:7994]
2025-10-10T14:34:23.838401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:23.838418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:23.838421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:23.838428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:23.838431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:23.838407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1325
2025-10-10T14:34:23.838438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:23.838441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:23.838445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1325
2025-10-10T14:34:23.838487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601415585882197:7994]
2025-10-10T14:34:23.838501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:23.838507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:23.838518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.838531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.838780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:23.838796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:23.838800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:23.838804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:23.838818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:23.838830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:23.838860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.839939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.839955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.839979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:23.840169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1326 partition: 0 MaxSeqNo: 40 sessionId: src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0
2025-10-10T14:34:23.840644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231ff79-7a6c749-446e2853-615113d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:23.843670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0] Write session: try to update token
2025-10-10T14:34:23.843692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:23.858530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:23.858554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:23.858558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:23.858559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:23.858570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601415585882197:7994]
2025-10-10T14:34:23.858573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601415585882197:7994]
2025-10-10T14:34:23.858577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601415585882197:7994]
2025-10-10T14:34:23.858631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:23.858635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:23.858642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.858644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:23.858647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:23.858654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:23.858787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:23.860596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId: src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:23.863601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:23.915219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601416368105556:2527]
2025-10-10T14:34:23.915569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1325, pipe: [1:7559601416368105556:2527]
2025-10-10T14:34:23.975865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:23.976488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:23.976519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:23.976581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105556:2527], now have 1 active actors on pipe
2025-10-10T14:34:23.977367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:23.977380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0] Write session will restart in 0.007957s
2025-10-10T14:34:23.976808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:23.977408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0] Write session: Do CDS request
2025-10-10T14:34:23.976868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:23.977417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:23.976962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1326 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0
2025-10-10T14:34:23.977040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601416368105556:2527]
2025-10-10T14:34:23.977183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1326 sessionId: src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0 is DEAD
2025-10-10T14:34:23.976802Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:23.986988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.987087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:23.987110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1327
2025-10-10T14:34:23.987309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:23.987355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:23.987362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:23.987365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:23.987902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1327 sessionId:  describe result for acl check
2025-10-10T14:34:23.987958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:23.987966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:23.987968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:23.987975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601416368105623:8215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:23.988595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601416368105623:8215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:23.991209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601416368105623:8215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:23.992461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:23.995896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601416368105623:8215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:23.995916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601416368105623:8215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:23.995921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601416368105623:8215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:23.995931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:23.994954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:23.995382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:23.995388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:23.995405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:23.995499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:23.995542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601415585882400:8009]
2025-10-10T14:34:23.996188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:23.996565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:23.996644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:23.997033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:23.997116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.997123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.997125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.997127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.997128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.997130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.997131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.997133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.997134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.997136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.997137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.997139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.997140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.997148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.997164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.997171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.997176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.997181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.997186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.997190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.997194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.997198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.997204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.997208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.997213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.997217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.997226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.997236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:23.997244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.997250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:23.997256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.997262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:23.997267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.997274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:23.997279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.997285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:23.997290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.997296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:23.997308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.997314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:23.997319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.997325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:23.997347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.997356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:23.997360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.997368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:23.997374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.997385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:23.997390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.997399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:23.997410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.997416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:23.997467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:23.999982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:24.000351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:24.000365Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:24.000368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:24.000373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:24.000380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1326 [2:7559601415585882400:8009]
2025-10-10T14:34:24.000394Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:24.000413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:24.000421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.000425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.000428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.000446Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:24.000459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:24.000467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:24.000544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.000552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.000555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.000558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:24.000633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:24.000646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.000660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.000673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.000693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:24.000716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105710:8215], now have 1 active actors on pipe
2025-10-10T14:34:24.000720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601416368105560:2438], now have 1 active actors on pipe
2025-10-10T14:34:24.000729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601415585882395:8009]
2025-10-10T14:34:24.000732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601415585882395:8009]
2025-10-10T14:34:24.000734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601415585882395:8009]
2025-10-10T14:34:24.000749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:24.000727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1326
2025-10-10T14:34:24.000760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:24.000764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:24.000766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:24.000766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:24.000735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1326
2025-10-10T14:34:24.000784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:24.000788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:24.000830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.000841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.000862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601415585882395:8009]
2025-10-10T14:34:24.000878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:24.000884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:24.000909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:24.000917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.000926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.000929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:24.000941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.000952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:24.000976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.001176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.001189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.001206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.001322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1327 partition: 0 MaxSeqNo: 40 sessionId: src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0
2025-10-10T14:34:24.001815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd71274-e54efd20-b0ac841-d54c47bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:24.004723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0] Write session: try to update token
2025-10-10T14:34:24.004744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:24.022073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId: src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:24.024923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:24.025182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.025209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.025254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:24.025408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:24.029694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:24.029717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:24.029720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:24.029723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:24.029735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601415585882395:8009]
2025-10-10T14:34:24.029740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601415585882395:8009]
2025-10-10T14:34:24.029756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601415585882395:8009]
2025-10-10T14:34:24.029810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:24.029819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.029821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:24.029976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:24.033725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:24.033744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:24.033748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:24.077017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601420663073017:2527]
2025-10-10T14:34:24.077308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1326, pipe: [1:7559601420663073017:2527]
2025-10-10T14:34:24.153615Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:24.162057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.162088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.162280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.162350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.162422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.162491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.162537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.162547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.162615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.162677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.162748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.162817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.162862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.162870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.162943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.163012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.163075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.163147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.163193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.163200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.163270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.163339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.163405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.163471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.163518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.163526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.163597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.163665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.163733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.163807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.163854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.163861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.163927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.163992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.164058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.164123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.164168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.164176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.164253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.164314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.164379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.164446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.164492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.164499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.164570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.164635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.164700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.164765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.164827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.164834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.165748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:24.165753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:24.165775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:24.165803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601420663073017:2527]
2025-10-10T14:34:24.165810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1327 reason: error at write: Disconnected sessionId: src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0
2025-10-10T14:34:24.166038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1327 sessionId: src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0 is DEAD
2025-10-10T14:34:24.166190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:24.166200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0] Write session will restart in 0.005714s
2025-10-10T14:34:24.166228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0] Write session: Do CDS request
2025-10-10T14:34:24.166234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:24.164900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.164967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.165026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.165087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.165128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.165130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.165200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:24.165259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:24.165321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:24.165405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:24.165447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:24.165451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:24.165521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073017:2527], now have 1 active actors on pipe
2025-10-10T14:34:24.166685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:24.172912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.173256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:24.173277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1328
2025-10-10T14:34:24.173456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.173493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:24.173503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:24.173508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:24.173998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1328 sessionId:  describe result for acl check
2025-10-10T14:34:24.174048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:24.174055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:24.174058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:24.174065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601420663073035:8219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:24.174629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601420663073035:8219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:24.179652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601420663073035:8219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:24.183088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:24.183226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601420663073035:8219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:24.183245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601420663073035:8219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:24.183249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601420663073035:8219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:24.183257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:24.185799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:24.186010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:24.186020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:24.186040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:24.186093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:24.186135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601419880849858:8011]
2025-10-10T14:34:24.186817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:24.187251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:24.187294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:24.187637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:24.187696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.187702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.187703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.187705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.187706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.187708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.187709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.187711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.187712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.187713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.187715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.187716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.187718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.187724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.187738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.187742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.187746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.187750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.187755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.187759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.187762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.187767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.187771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.187775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.187779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.187783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.187790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.187799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.187808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.187814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.187820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.187826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.187834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.187840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.187845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.187854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.187859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.187864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.187873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.187878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.187882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.187888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.187897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.187903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.187907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.187915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.187919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.187929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.187933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.187938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.187945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.187950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.187994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:24.190526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:24.190840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:24.190853Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:24.190855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:24.190859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:24.190866Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1327 [2:7559601419880849858:8011]
2025-10-10T14:34:24.190881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:24.190908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:24.190911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.190914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.190917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.190933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:24.190940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:24.190949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:24.191008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.191012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.191015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.191018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:24.191085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:24.191093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.191103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.191115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.191140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:24.191166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073172:8219], now have 1 active actors on pipe
2025-10-10T14:34:24.191174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073020:2438], now have 1 active actors on pipe
2025-10-10T14:34:24.191182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601419880849852:8011]
2025-10-10T14:34:24.191186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601419880849852:8011]
2025-10-10T14:34:24.191188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601419880849852:8011]
2025-10-10T14:34:24.191201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:24.191218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:24.191221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:24.191225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:24.191227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:24.191238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:24.191242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:24.191265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601419880849852:8011]
2025-10-10T14:34:24.191272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:24.191279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:24.191250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1327
2025-10-10T14:34:24.191258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1327
2025-10-10T14:34:24.191312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.191323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.191365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:24.191376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.191380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.191383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:24.191394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.191404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:24.191423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.191558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.191569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.191582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.191678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1328 partition: 0 MaxSeqNo: 40 sessionId: src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0
2025-10-10T14:34:24.192122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6fb459b-6ca6f158-d3bc213e-c6efa3b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:24.194828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0] Write session: try to update token
2025-10-10T14:34:24.194849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:24.211116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:24.211136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:24.211140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:24.211143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:24.211154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601419880849852:8011]
2025-10-10T14:34:24.211159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601419880849852:8011]
2025-10-10T14:34:24.211163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601419880849852:8011]
2025-10-10T14:34:24.211209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:24.211220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:24.211229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.211231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:24.211235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:24.211241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:24.211380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:24.214844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId: src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:24.217740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:24.265946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601420663073184:2527]
2025-10-10T14:34:24.266333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1327, pipe: [1:7559601420663073184:2527]
2025-10-10T14:34:24.327432Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:24.328138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.328160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.328246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073184:2527], now have 1 active actors on pipe
2025-10-10T14:34:24.328496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:24.328519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:24.328543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:24.328620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1328 reason: error at write: Disconnected sessionId: src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0
2025-10-10T14:34:24.328865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1328 sessionId: src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0 is DEAD
2025-10-10T14:34:24.329061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:24.329077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0] Write session will restart in 0.006920s
2025-10-10T14:34:24.329054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601420663073184:2527]
2025-10-10T14:34:24.329073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:24.329109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0] Write session: Do CDS request
2025-10-10T14:34:24.329116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:24.336985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.337052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:24.337080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1329
2025-10-10T14:34:24.337240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.337297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:24.337308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:24.337312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:24.337770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1329 sessionId:  describe result for acl check
2025-10-10T14:34:24.337804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:24.337811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:24.337813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:24.337820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601420663073221:8223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:24.338429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601420663073221:8223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:24.341720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601420663073221:8223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:24.343150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:24.345916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:24.346185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:24.346204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:24.346216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:24.346280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:24.346332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601419880850019:8013]
2025-10-10T14:34:24.346848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601420663073221:8223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:24.346868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601420663073221:8223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:24.346872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601420663073221:8223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:24.346882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:24.347007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:24.347309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:24.347362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:24.347706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:24.347778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.347785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.347786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.347787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.347789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.347790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.347792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.347793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.347795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.347796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.347797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.347799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.347800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.347807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.347821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.347826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.347830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.347833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.347837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.347841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.347845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.347849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.347854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.347858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.347862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.347865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.347874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.347884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.347891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.347897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.347902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.347908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.347913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.347919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.347932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.347938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.347943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.347948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.347953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.347960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.347965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.347971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.347975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.347980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.347985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.347991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.347995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.348001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.348005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.348011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.348016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.348021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.348062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:24.350951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:24.351406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:24.351427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:24.351430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:24.351435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:24.351442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1328 [2:7559601419880850019:8013]
2025-10-10T14:34:24.351457Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:24.351477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:24.351480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.351484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.351487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.351506Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:24.351520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:24.351528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:24.351591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.351598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.351601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.351604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:24.351681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:24.351688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.351700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.351715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.351733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:24.351762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073186:2438], now have 1 active actors on pipe
2025-10-10T14:34:24.351770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073340:8223], now have 1 active actors on pipe
2025-10-10T14:34:24.351780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601419880850014:8013]
2025-10-10T14:34:24.351787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601419880850014:8013]
2025-10-10T14:34:24.351789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601419880850014:8013]
2025-10-10T14:34:24.351805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:24.351820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:24.351842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:24.351846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:24.351856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:24.351860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:24.351862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:24.351878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601419880850014:8013]
2025-10-10T14:34:24.351869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1328
2025-10-10T14:34:24.351881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:24.351883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:24.351924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1328
2025-10-10T14:34:24.352062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.352075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.352118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:24.352132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.352137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.352144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:24.352167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.352184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:24.352219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.352646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.352658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.352686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.352829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1329 partition: 0 MaxSeqNo: 40 sessionId: src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0
2025-10-10T14:34:24.353292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d81ca7d-190299b9-5d411b22-569bd39c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:24.356019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0] Write session: try to update token
2025-10-10T14:34:24.356035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:24.372809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:24.372835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:24.372838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:24.372841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:24.372851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601419880850014:8013]
2025-10-10T14:34:24.372855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601419880850014:8013]
2025-10-10T14:34:24.372860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601419880850014:8013]
2025-10-10T14:34:24.372911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:24.372924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.372927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:24.372926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:24.372933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:24.372938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:24.373074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:24.377196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId: src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:24.380046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:24.432119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601420663073351:2527]
2025-10-10T14:34:24.432750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1328, pipe: [1:7559601420663073351:2527]
2025-10-10T14:34:24.486245Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:24.486743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.486757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.486801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073351:2527], now have 1 active actors on pipe
2025-10-10T14:34:24.487059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:24.487093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601420663073351:2527]
2025-10-10T14:34:24.487130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:24.487133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:24.487207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1329 reason: error at write: Disconnected sessionId: src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0
2025-10-10T14:34:24.487394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1329 sessionId: src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0 is DEAD
2025-10-10T14:34:24.487410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:24.489566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:24.489581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0] Write session will restart in 0.009888s
2025-10-10T14:34:24.489604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0] Write session: Do CDS request
2025-10-10T14:34:24.489617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:24.500838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.501346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:24.501372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1330
2025-10-10T14:34:24.501529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.501583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:24.501594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:24.501598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:24.502216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1330 sessionId:  describe result for acl check
2025-10-10T14:34:24.502269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:24.502272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:24.502274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:24.502281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601420663073361:8227] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:24.502970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601420663073361:8227] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:24.506136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601420663073361:8227] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:24.514140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601420663073361:8227] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:24.514161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601420663073361:8227] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:24.514165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601420663073361:8227] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:24.514176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:24.537936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:24.541974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:24.542246Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:24.542252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:24.542266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:24.542324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:24.542378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601419880850196:8015]
2025-10-10T14:34:24.542997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:24.543596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:24.543650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:24.543998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:24.544063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.544065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.544066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.544067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.544069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.544070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.544072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.544074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.544075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.544076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.544078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.544079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.544080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.544085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.544098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.544102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.544106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.544120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.544125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.544129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.544133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.544137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.544142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.544146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.544150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.544154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.544163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.544174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.544181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.544201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.544207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.544213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.544218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.544224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.544229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.544235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.544240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.544245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.544251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.544256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.544261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.544266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.544272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.544278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.544283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.544289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.544294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.544299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.544303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.544310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.544315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.544322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.544365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:24.553014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:24.553375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:24.553382Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:24.553385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:24.553390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:24.553398Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1329 [2:7559601419880850196:8015]
2025-10-10T14:34:24.553415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:24.553435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:24.553439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.553443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.553446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.553466Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:24.553475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:24.553482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:24.553547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.553549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.553551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.553555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:24.553622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:24.553625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.553637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.553649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.553665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:24.553686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601419880850191:8015]
2025-10-10T14:34:24.553689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601419880850191:8015]
2025-10-10T14:34:24.553691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601419880850191:8015]
2025-10-10T14:34:24.553705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:24.553722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:24.553737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:24.553741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:24.553783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601419880850191:8015]
2025-10-10T14:34:24.553786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:24.554122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:24.554130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:24.554132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:24.554138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:24.554472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073398:8227], now have 1 active actors on pipe
2025-10-10T14:34:24.554483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073353:2438], now have 1 active actors on pipe
2025-10-10T14:34:24.554796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.554806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.554851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|591de33a-618e27bb-f502141b-d998edc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:24.554861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.554865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.554868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:24.554880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.554894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:24.554915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.555246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.555255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.555272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.554617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1329
2025-10-10T14:34:24.554657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1329
2025-10-10T14:34:24.555759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1330 partition: 0 MaxSeqNo: 40 sessionId: src_id|591de33a-618e27bb-f502141b-d998edc1_0
2025-10-10T14:34:24.557632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a75f4d-1eeeebe9-4535a541-ac9fd896_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|591de33a-618e27bb-f502141b-d998edc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:24.560413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591de33a-618e27bb-f502141b-d998edc1_0] Write session: try to update token
2025-10-10T14:34:24.560435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591de33a-618e27bb-f502141b-d998edc1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:24.583339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId: src_id|591de33a-618e27bb-f502141b-d998edc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:24.586409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:24.586982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601420663073536:2527]
2025-10-10T14:34:24.587355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1329, pipe: [1:7559601420663073536:2527]
2025-10-10T14:34:24.588233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.588257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.588279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073536:2527], now have 1 active actors on pipe
2025-10-10T14:34:24.588292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:24.588300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:24.588304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:24.588306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:24.588314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601419880850191:8015]
2025-10-10T14:34:24.588318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601419880850191:8015]
2025-10-10T14:34:24.588322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601419880850191:8015]
2025-10-10T14:34:24.588381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:24.588391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:24.588397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:24.588398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.588400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:24.588401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:24.588538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:24.708867Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:24.709709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:24.709765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:24.709532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:24.709815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:24.709825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:24.709836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601420663073536:2527]
2025-10-10T14:34:24.709901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1330 reason: error at write: Disconnected sessionId: src_id|591de33a-618e27bb-f502141b-d998edc1_0
2025-10-10T14:34:24.710097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1330 sessionId: src_id|591de33a-618e27bb-f502141b-d998edc1_0 is DEAD
2025-10-10T14:34:24.710435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591de33a-618e27bb-f502141b-d998edc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:24.710447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591de33a-618e27bb-f502141b-d998edc1_0] Write session will restart in 0.008141s
2025-10-10T14:34:24.710477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591de33a-618e27bb-f502141b-d998edc1_0] Write session: Do CDS request
2025-10-10T14:34:24.710485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591de33a-618e27bb-f502141b-d998edc1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:24.723389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|591de33a-618e27bb-f502141b-d998edc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.723790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:24.723821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1331
2025-10-10T14:34:24.724129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.724190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:24.724196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:24.724199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:24.725478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1331 sessionId:  describe result for acl check
2025-10-10T14:34:24.725532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:24.725534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:24.725536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:24.725543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601420663073615:8233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:24.726152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601420663073615:8233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:24.729057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601420663073615:8233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:24.733221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:24.733415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601420663073615:8233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:24.733430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601420663073615:8233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:24.733434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601420663073615:8233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:24.733444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:24.735587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:24.735816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:24.735822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:24.735834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:24.735883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:24.735922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601419880850364:8018]
2025-10-10T14:34:24.736507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:24.736879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:24.736922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:24.737211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:24.737258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.737259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.737260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.737261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.737262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.737264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.737265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.737266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.737267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.737269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.737284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.737286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.737287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.737291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.737303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.737307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.737311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.737315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.737319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.737322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.737326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.737343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.737348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.737351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.737354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.737357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.737365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.737373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.737380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.737385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.737389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.737394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.737398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.737403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.737407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.737411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.737415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.737419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.737423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.737428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.737431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.737435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.737439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.737444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.737447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.737453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.737457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.737461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.737465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.737470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.737474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.737478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.737514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:24.740346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:24.740758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:24.740763Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:24.740765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:24.740768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:24.740775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1330 [2:7559601419880850364:8018]
2025-10-10T14:34:24.740788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:24.740805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:24.740809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.740813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.740815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.740832Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:24.740841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:24.740850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:24.740907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.740908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.740910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.740912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:24.740985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:24.740987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.740996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.741007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.741022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:24.741041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601419880850358:8018]
2025-10-10T14:34:24.741043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601419880850358:8018]
2025-10-10T14:34:24.741045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601419880850358:8018]
2025-10-10T14:34:24.741058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:24.741070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:24.741086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:24.741089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:24.741112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601419880850358:8018]
2025-10-10T14:34:24.741114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:24.741377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:24.741386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:24.741388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:24.741395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:24.741987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1330
2025-10-10T14:34:24.742022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1330
2025-10-10T14:34:24.743064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073550:2438], now have 1 active actors on pipe
2025-10-10T14:34:24.743076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073704:8233], now have 1 active actors on pipe
2025-10-10T14:34:24.743099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.743106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.743139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:24.743149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.743154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.743157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:24.743170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.743184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:24.743199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.743506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.743513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.743528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.744070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|591de33a-618e27bb-f502141b-d998edc1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:24.743660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1331 partition: 0 MaxSeqNo: 40 sessionId: src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0
2025-10-10T14:34:24.746835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0] Write session: try to update token
2025-10-10T14:34:24.746853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:24.763266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:24.763289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:24.763292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:24.763293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:24.763302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601419880850358:8018]
2025-10-10T14:34:24.763305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601419880850358:8018]
2025-10-10T14:34:24.763308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601419880850358:8018]
2025-10-10T14:34:24.763366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:24.763367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:24.763372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:24.763375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:24.763382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.763384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:24.763521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:24.767288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId: src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:24.770122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:24.810200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601420663073717:2527]
2025-10-10T14:34:24.810563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1330, pipe: [1:7559601420663073717:2527]
2025-10-10T14:34:24.875708Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:24.876019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.876029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.876077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073717:2527], now have 1 active actors on pipe
2025-10-10T14:34:24.876351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:24.876970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:24.877026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:24.877101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1331 reason: status is not ok: tablet will be restarted right now sessionId: src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0
2025-10-10T14:34:24.877306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1331 sessionId: src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0 is DEAD
2025-10-10T14:34:24.877370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601420663073717:2527]
2025-10-10T14:34:24.881442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:24.881456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0] Write session will restart in 0.005202s
2025-10-10T14:34:24.881483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0] Write session: Do CDS request
2025-10-10T14:34:24.881490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:24.889900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.892019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:24.892042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1332
2025-10-10T14:34:24.892224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:24.892278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:24.892284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:24.892288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:24.893084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1332 sessionId:  describe result for acl check
2025-10-10T14:34:24.893131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:24.893133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:24.893134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:24.893142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601420663073744:8237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:24.893774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601420663073744:8237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:24.899172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601420663073744:8237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:24.903309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601420663073744:8237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:24.903328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601420663073744:8237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:24.903332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601420663073744:8237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:24.903341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:24.905799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:24.907988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:24.908240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:24.908246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:24.908261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:24.908345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:24.908385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601419880850541:8021]
2025-10-10T14:34:24.909016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:24.910072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:24.910124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:24.910471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:24.910548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.910556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.910557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.910558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.910559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.910560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.910562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.910563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.910565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.910566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.910567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.910569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.910570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.910577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.910589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.910593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.910598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.910602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.910606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.910609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.910613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.910616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.910620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.910624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.910627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.910631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.910639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.910648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:24.910654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.910660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:24.910674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.910685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:24.910690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.910699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:24.910703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.910715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:24.910720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.910725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:24.910730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.910735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:24.910740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.910745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:24.910749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.910754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:24.910758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.910764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:24.910768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.910772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.910777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.910782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.910786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.910792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.910834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:24.919025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:24.919427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:24.919454Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:24.919461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:24.919465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:24.919472Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1331 [2:7559601419880850541:8021]
2025-10-10T14:34:24.919488Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:24.919510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:24.919518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.919522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.919524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.919543Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:24.919558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:24.919573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:24.919635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.919642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.919644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.919647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:24.919726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:24.919736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.919747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:24.919758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:24.919772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:24.919797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073886:8237], now have 1 active actors on pipe
2025-10-10T14:34:24.919805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073719:2438], now have 1 active actors on pipe
2025-10-10T14:34:24.919813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601419880850536:8021]
2025-10-10T14:34:24.919815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601419880850536:8021]
2025-10-10T14:34:24.919818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601419880850536:8021]
2025-10-10T14:34:24.919833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:24.919848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:24.919868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:24.919871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:24.919912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601419880850536:8021]
2025-10-10T14:34:24.919913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:24.919915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:24.919917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:24.919919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:24.919925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:24.924415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1331
2025-10-10T14:34:24.924465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1331
2025-10-10T14:34:24.924753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.924775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.924821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:24.924843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:24.924853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:24.924856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:24.924873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:24.924901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:24.924925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.928435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.928455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.928492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:24.928639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1332 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0
2025-10-10T14:34:24.929044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476f6c88-5c30fa0-7c110e02-4fd72a3c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:24.931779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0] Write session: try to update token
2025-10-10T14:34:24.931799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:24.948044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId: src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:24.950990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:24.952483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:24.952516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:24.952542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:24.952546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:24.952549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:24.952550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:24.952559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601419880850536:8021]
2025-10-10T14:34:24.952564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601419880850536:8021]
2025-10-10T14:34:24.952567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601419880850536:8021]
2025-10-10T14:34:24.952631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:24.952639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:24.952641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:24.952780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:24.952953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:24.952958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:24.952961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:24.975936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601420663073916:2527]
2025-10-10T14:34:24.976449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1331, pipe: [1:7559601420663073916:2527]
2025-10-10T14:34:25.092041Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:25.092426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:25.092494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601420663073916:2527], now have 1 active actors on pipe
2025-10-10T14:34:25.093160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:25.093173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0] Write session will restart in 0.009083s
2025-10-10T14:34:25.093205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0] Write session: Do CDS request
2025-10-10T14:34:25.093213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:25.092604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:25.092690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601420663073916:2527]
2025-10-10T14:34:25.092715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:25.092728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:25.092731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:25.092828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1332 reason: error at write: Disconnected sessionId: src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0
2025-10-10T14:34:25.093032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1332 sessionId: src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0 is DEAD
2025-10-10T14:34:25.103987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.105122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:25.105142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1333
2025-10-10T14:34:25.105432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.105477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:25.105488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:25.105492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:25.106037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1333 sessionId:  describe result for acl check
2025-10-10T14:34:25.106077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:25.106085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:25.106087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:25.106093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601424958041250:8250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:25.106661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601424958041250:8250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:25.110276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601424958041250:8250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:25.114657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601424958041250:8250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:25.114675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601424958041250:8250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:25.114679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601424958041250:8250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:25.114689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:25.115520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:25.117670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:25.117887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:25.117893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:25.117904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:25.117953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:25.117991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601424175818031:8036]
2025-10-10T14:34:25.118608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:25.118933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:25.118980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:25.119296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:25.119354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.119355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.119356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.119358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.119359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.119360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.119362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.119363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.119364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.119365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.119366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.119367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.119369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.119375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.119388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.119395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.119399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.119403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.119408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.119412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.119416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.119420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.119425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.119429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.119433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.119437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.119445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.119453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.119459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.119465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.119470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.119476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.119480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.119485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.119489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.119494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.119498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.119503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.119507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.119512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.119518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.119523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.119528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.119534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.119538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.119544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.119548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.119553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.119557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.119562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.119567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.119572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.119612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:25.122108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:25.122845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:25.122859Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:25.122862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:25.122865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:25.122874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1332 [2:7559601424175818031:8036]
2025-10-10T14:34:25.122887Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:25.122905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:25.122914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.122918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.122920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.122936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:25.122950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:25.122957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:25.123022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.123030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.123032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.123035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:25.123107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:25.123114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.123126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.123141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.123160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:25.123189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041371:8250], now have 1 active actors on pipe
2025-10-10T14:34:25.123200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041216:2438], now have 1 active actors on pipe
2025-10-10T14:34:25.123207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601424175818026:8036]
2025-10-10T14:34:25.123209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601424175818026:8036]
2025-10-10T14:34:25.123212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601424175818026:8036]
2025-10-10T14:34:25.123225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:25.123239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:25.123242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:25.123245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:25.123247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:25.123257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:25.123260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:25.123284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601424175818026:8036]
2025-10-10T14:34:25.123295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:25.123301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:25.123530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.123547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.123587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:25.123616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.123621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.123624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:25.123637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.123650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:25.123680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.123394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1332
2025-10-10T14:34:25.123443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1332
2025-10-10T14:34:25.123848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.123861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.123894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.124004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1333 partition: 0 MaxSeqNo: 40 sessionId: src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0
2025-10-10T14:34:25.124427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c8cbeb0-53cb1d95-af438740-e15b433c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:25.127211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0] Write session: try to update token
2025-10-10T14:34:25.127235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:25.148194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:25.148219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:25.148223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:25.148226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:25.149393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId: src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:25.148237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601424175818026:8036]
2025-10-10T14:34:25.148242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601424175818026:8036]
2025-10-10T14:34:25.148247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601424175818026:8036]
2025-10-10T14:34:25.148298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:25.148301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:25.148308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:25.148310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.148312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:25.148313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:25.148455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:25.152162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:25.192779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601424958041386:2527]
2025-10-10T14:34:25.193465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1332, pipe: [1:7559601424958041386:2527]
2025-10-10T14:34:25.299742Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:25.300046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.300063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.300111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041386:2527], now have 1 active actors on pipe
2025-10-10T14:34:25.300767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601424958041386:2527]
2025-10-10T14:34:25.300811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:25.300814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:25.300857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:25.300874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1333 reason: error at write: Disconnected sessionId: src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0
2025-10-10T14:34:25.301259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:25.301269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0] Write session will restart in 0.008102s
2025-10-10T14:34:25.300472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:25.301295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0] Write session: Do CDS request
2025-10-10T14:34:25.301302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:25.301068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1333 sessionId: src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0 is DEAD
2025-10-10T14:34:25.310948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.313801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:25.313820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1334
2025-10-10T14:34:25.314020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.314084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:25.314090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:25.314094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:25.314601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1334 sessionId:  describe result for acl check
2025-10-10T14:34:25.314642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:25.314643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:25.314645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:25.314652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601424958041481:8254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:25.315276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601424958041481:8254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:25.317550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:25.317603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601424958041481:8254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:25.320496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:25.320786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:25.320792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:25.320804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:25.320867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:25.320930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601424175818197:8038]
2025-10-10T14:34:25.320725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601424958041481:8254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:25.320747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601424958041481:8254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:25.320751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601424958041481:8254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:25.320761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:25.321596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:25.322248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:25.322311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:25.322677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:25.322741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.322749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.322750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.322752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.322753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.322755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.322756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.322757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.322759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.322760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.322761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.322763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.322764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.322771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.322784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.322788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.322792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.322796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.322799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.322803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.322807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.322811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.322816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.322819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.322823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.322827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.322835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.322845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.322852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.322857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.322862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.322868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.322873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.322878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.322883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.322889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.322894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.322899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.322905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.322910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.322915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.322921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.322926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.322931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.322935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.322949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.322953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.322958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.322963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.322968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.322973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.322979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.323021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:25.326266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:25.326640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:25.326657Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:25.326660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:25.326664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:25.326671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1333 [2:7559601424175818197:8038]
2025-10-10T14:34:25.326687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:25.326707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:25.326712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.326716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.326719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.326738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:25.326752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:25.326760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:25.326825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.326833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.326835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.326838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:25.327113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1333
2025-10-10T14:34:25.327178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1333
2025-10-10T14:34:25.326911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:25.326923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.326936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.326947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.326963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:25.326989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041389:2438], now have 1 active actors on pipe
2025-10-10T14:34:25.326993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041546:8254], now have 1 active actors on pipe
2025-10-10T14:34:25.327021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601424175818192:8038]
2025-10-10T14:34:25.327024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601424175818192:8038]
2025-10-10T14:34:25.327027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601424175818192:8038]
2025-10-10T14:34:25.327042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:25.327058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:25.327063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:25.327066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:25.327068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:25.327075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:25.327078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:25.327116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601424175818192:8038]
2025-10-10T14:34:25.327124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:25.327140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:25.327425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.327433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.327468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:25.327479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.327484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.327487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:25.327500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.327514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:25.327533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.329514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.329537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.329590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.330180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3363ec-eaf2c41b-2956f18e-b7fe1512_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:25.332910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0] Write session: try to update token
2025-10-10T14:34:25.332932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:25.329729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1334 partition: 0 MaxSeqNo: 40 sessionId: src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0
2025-10-10T14:34:25.348537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:25.348560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:25.348564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:25.348566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:25.348577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601424175818192:8038]
2025-10-10T14:34:25.348583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601424175818192:8038]
2025-10-10T14:34:25.348587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601424175818192:8038]
2025-10-10T14:34:25.348643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:25.348653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.348656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:25.348657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:25.348664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:25.348669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:25.348823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:25.351371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId: src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:25.354042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:25.401197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601424958041559:2527]
2025-10-10T14:34:25.401550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1333, pipe: [1:7559601424958041559:2527]
2025-10-10T14:34:25.464592Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:25.465124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.465137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.465192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041559:2527], now have 1 active actors on pipe
2025-10-10T14:34:25.466237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:25.465669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:25.466249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0] Write session will restart in 0.006708s
2025-10-10T14:34:25.465728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601424958041559:2527]
2025-10-10T14:34:25.465749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:25.465752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:25.465813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1334 reason: error at write: Disconnected sessionId: src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0
2025-10-10T14:34:25.466038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1334 sessionId: src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0 is DEAD
2025-10-10T14:34:25.466287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0] Write session: Do CDS request
2025-10-10T14:34:25.466294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:25.465662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:25.473909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.473994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:25.474012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1335
2025-10-10T14:34:25.474193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.474239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:25.474245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:25.474249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:25.474767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1335 sessionId:  describe result for acl check
2025-10-10T14:34:25.474805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:25.474810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:25.474812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:25.474818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601424958041575:8258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:25.475400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601424958041575:8258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:25.479463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601424958041575:8258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:25.483900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601424958041575:8258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:25.483917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601424958041575:8258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:25.483921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601424958041575:8258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:25.483931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:25.490428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:25.492785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:25.493065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:25.493081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:25.493095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:25.493157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:25.493210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601424175818368:8040]
2025-10-10T14:34:25.493941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:25.494303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:25.494354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:25.494700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:25.494768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.494775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.494776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.494777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.494779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.494781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.494783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.494784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.494785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.494787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.494788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.494790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.494791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.494798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.494812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.494817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.494822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.494828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.494832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.494837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.494841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.494846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.494851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.494856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.494861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.494865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.494874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.494883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.494890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.494897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.494902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.494913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.494919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.494925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.494932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.494940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.494945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.494952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.494960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.494967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.494977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.494984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.494989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.494998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.495003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.495009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.495016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.495022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.495031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.495037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.495042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.495053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.495101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:25.497709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:25.498060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:25.498074Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:25.498077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:25.498081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:25.498088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1334 [2:7559601424175818368:8040]
2025-10-10T14:34:25.498103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:25.498123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:25.498131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.498135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.498137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.498155Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:25.498168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:25.498181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:25.498243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.498250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.498253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.498256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:25.498329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:25.498338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.498350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.498364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.498388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:25.498436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041657:8258], now have 1 active actors on pipe
2025-10-10T14:34:25.498440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041560:2438], now have 1 active actors on pipe
2025-10-10T14:34:25.498448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601424175818363:8040]
2025-10-10T14:34:25.498459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601424175818363:8040]
2025-10-10T14:34:25.498461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601424175818363:8040]
2025-10-10T14:34:25.498475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:25.498488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:25.498495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:25.498498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:25.498503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:25.498513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:25.498517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:25.498484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1334
2025-10-10T14:34:25.498505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1334
2025-10-10T14:34:25.498545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601424175818363:8040]
2025-10-10T14:34:25.498562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:25.498573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:25.498597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.498607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.498653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:25.498665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.498670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.498673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:25.498684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.498700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:25.498720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.498924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.498939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.498973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.499073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1335 partition: 0 MaxSeqNo: 40 sessionId: src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0
2025-10-10T14:34:25.499481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd1081a-9d7771ff-edd7ef44-82478845_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:25.502131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0] Write session: try to update token
2025-10-10T14:34:25.502149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:25.517140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId: src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:25.519236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:25.519257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:25.519260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:25.519263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:25.519272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601424175818363:8040]
2025-10-10T14:34:25.519277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601424175818363:8040]
2025-10-10T14:34:25.519281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601424175818363:8040]
2025-10-10T14:34:25.519334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:25.519340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:25.519345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:25.519349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:25.519349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.519352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:25.519531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:25.519914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:25.565415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601424958041744:2527]
2025-10-10T14:34:25.566005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1334, pipe: [1:7559601424958041744:2527]
2025-10-10T14:34:25.637177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:25.639502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.639526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.639576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041744:2527], now have 1 active actors on pipe
2025-10-10T14:34:25.640333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:25.640351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:25.640414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1335 reason: error at write: Disconnected sessionId: src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0
2025-10-10T14:34:25.640804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:25.640817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0] Write session will restart in 0.008848s
2025-10-10T14:34:25.640843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0] Write session: Do CDS request
2025-10-10T14:34:25.640849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:25.640878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:25.640614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1335 sessionId: src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0 is DEAD
2025-10-10T14:34:25.640763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601424958041744:2527]
2025-10-10T14:34:25.640789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:25.650983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.651096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:25.651117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1336
2025-10-10T14:34:25.651254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.651291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:25.651302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:25.651307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:25.651802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1336 sessionId:  describe result for acl check
2025-10-10T14:34:25.651849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:25.651856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:25.651858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:25.651865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601424958041775:8264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:25.652495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601424958041775:8264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:25.655002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601424958041775:8264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:25.657911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601424958041775:8264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:25.657931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601424958041775:8264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:25.657935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601424958041775:8264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:25.657945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:25.659169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:25.661498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:25.661763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:25.661777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:25.661790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:25.661862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:25.661910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601424175818549:8043]
2025-10-10T14:34:25.662597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:25.662940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:25.662989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:25.663370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:25.663431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.663439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.663441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.663442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.663443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.663445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.663446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.663448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.663449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.663451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.663453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.663454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.663456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.663462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.663478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.663484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.663488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.663493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.663498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.663502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.663507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.663511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.663516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.663520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.663524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.663528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.663536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.663545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.663552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.663558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.663563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.663569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.663574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.663580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.663586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.663592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.663597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.663603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.663608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.663614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.663619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.663625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.663631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.663643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.663648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.663654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.663659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.663665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.663670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.663676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.663681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.663687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.663731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:25.666560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:25.667255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:25.667274Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:25.667276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:25.667281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:25.667287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1335 [2:7559601424175818549:8043]
2025-10-10T14:34:25.667300Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:25.667320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:25.667324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.667327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.667330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.667349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:25.667357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:25.667375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:25.667453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.667461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.667462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.667465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:25.667554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:25.667563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.667576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.667594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.667617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:25.667645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041910:8264], now have 1 active actors on pipe
2025-10-10T14:34:25.667659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601424175818544:8043]
2025-10-10T14:34:25.667665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601424175818544:8043]
2025-10-10T14:34:25.667667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601424175818544:8043]
2025-10-10T14:34:25.667681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:25.667695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041750:2438], now have 1 active actors on pipe
2025-10-10T14:34:25.667705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:25.667715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:25.667722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:25.667725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:25.667739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:25.667742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:25.667755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601424175818544:8043]
2025-10-10T14:34:25.667758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:25.667759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:25.667768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1335
2025-10-10T14:34:25.667813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1335
2025-10-10T14:34:25.667959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.667972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.668010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:25.668025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.668031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.668034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:25.668045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.668056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:25.668077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.668323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.668349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.668378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.668499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1336 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0
2025-10-10T14:34:25.668898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a18fea3a-2f0fcd00-e9fa9d99-62ec11a6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:25.671768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0] Write session: try to update token
2025-10-10T14:34:25.671790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:25.689107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:25.689133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:25.689136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:25.689138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:25.689148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601424175818544:8043]
2025-10-10T14:34:25.689152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601424175818544:8043]
2025-10-10T14:34:25.689157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601424175818544:8043]
2025-10-10T14:34:25.689205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:25.689215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:25.689218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.689220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:25.689223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:25.689228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:25.689387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:25.688734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId: src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:25.691429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:25.741010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601424958041927:2527]
2025-10-10T14:34:25.741291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1335, pipe: [1:7559601424958041927:2527]
2025-10-10T14:34:25.807084Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:25.807448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.807467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.807519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041927:2527], now have 1 active actors on pipe
2025-10-10T14:34:25.807783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:25.808301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:25.808314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0] Write session will restart in 0.009491s
2025-10-10T14:34:25.808341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0] Write session: Do CDS request
2025-10-10T14:34:25.808349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:25.807783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:25.807802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:25.807809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:25.807875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601424958041927:2527]
2025-10-10T14:34:25.807884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1336 reason: error at write: Disconnected sessionId: src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0
2025-10-10T14:34:25.808113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1336 sessionId: src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0 is DEAD
2025-10-10T14:34:25.819001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.819106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:25.819128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1337
2025-10-10T14:34:25.819308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:25.819350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:25.819357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:25.819361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:25.820045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1337 sessionId:  describe result for acl check
2025-10-10T14:34:25.820107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:25.820117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:25.820119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:25.820126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601424958042019:8268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:25.820731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601424958042019:8268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:25.823289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601424958042019:8268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:25.823894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:25.826007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:25.826246Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:25.826261Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:25.826276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:25.826369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:25.826420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601424175818720:8046]
2025-10-10T14:34:25.826414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601424958042019:8268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:25.826432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601424958042019:8268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:25.826436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601424958042019:8268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:25.826444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:25.827027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:25.827429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:25.827486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:25.827835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:25.827894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.827900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.827902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.827903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.827904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.827905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.827907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.827908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.827910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.827911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.827912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.827914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.827915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.827921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.827936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.827940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.827944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.827949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.827953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.827957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.827960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.827964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.827968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.827972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.827976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.827980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.827989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.827997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:25.828004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.828010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:25.828014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.828020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:25.828024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.828029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:25.828033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.828037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:25.828041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.828046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:25.828055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.828060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:25.828065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.828071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:25.828078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.828083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:25.828088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.828093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:25.828098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.828102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.828107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.828111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.828116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.828121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.828171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:25.830735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:25.831238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:25.831252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:25.831254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:25.831258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:25.831264Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1336 [2:7559601424175818720:8046]
2025-10-10T14:34:25.831278Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:25.831295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:25.831299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.831303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.831305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.831322Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:25.831334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:25.831348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:25.831401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.831408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.831410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.831413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:25.831664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1336
2025-10-10T14:34:25.831485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:25.831495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.831705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1336
2025-10-10T14:34:25.831507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:25.831519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:25.831536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:25.831556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601424175818715:8046]
2025-10-10T14:34:25.831559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601424175818715:8046]
2025-10-10T14:34:25.831561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601424175818715:8046]
2025-10-10T14:34:25.831569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:25.831578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:25.831583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:25.831585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:25.831586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958042092:8268], now have 1 active actors on pipe
2025-10-10T14:34:25.831592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:25.831608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:25.831610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:25.831616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958041928:2438], now have 1 active actors on pipe
2025-10-10T14:34:25.831636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601424175818715:8046]
2025-10-10T14:34:25.831643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:25.831650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:25.831806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.831823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.831875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:25.831890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:25.831906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:25.831913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:25.831926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:25.831944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:25.831967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.832237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.832247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.832268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:25.832399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1337 partition: 0 MaxSeqNo: 40 sessionId: src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0
2025-10-10T14:34:25.832840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc6e755e-1e81eba7-3e585f17-fea2c455_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:25.835673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0] Write session: try to update token
2025-10-10T14:34:25.835696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:25.852027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId: src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:25.855295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:25.855587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.855612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.855667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:25.855783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:25.858138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:25.858164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:25.858168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:25.858170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:25.858183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601424175818715:8046]
2025-10-10T14:34:25.858189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601424175818715:8046]
2025-10-10T14:34:25.858193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601424175818715:8046]
2025-10-10T14:34:25.858241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:25.858243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:25.858251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:25.858253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:25.858256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:25.858261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:25.858394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:25.907931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601424958042103:2527]
2025-10-10T14:34:25.908778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1336, pipe: [1:7559601424958042103:2527]
2025-10-10T14:34:25.980418Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:25.989182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:25.989212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:25.989424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.989492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.989560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.989626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.989947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.989959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.990035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.990108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.990171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.990240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.990286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.990294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.990366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.990434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.990498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.990563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.990610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.990618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.990689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.990759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.990823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.990889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.990939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.990941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.991009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.991066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.991126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.991187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.991234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.991237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.991305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.991366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.991429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.991494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.991537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.991540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.991615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.991674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.991740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.991804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.991846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.991850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.991921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.991981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.992042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.992105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.992391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.992395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.992463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.992520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.992580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.992642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.992682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.992685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.992758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:25.992818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:25.992877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:25.992938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:25.992981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:25.992984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:25.993066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958042103:2527], now have 1 active actors on pipe
2025-10-10T14:34:25.993684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:25.993700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:25.993731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1337 reason: error at write: Disconnected sessionId: src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0
2025-10-10T14:34:25.993782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:25.993968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1337 sessionId: src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0 is DEAD
2025-10-10T14:34:25.994144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:25.994157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0] Write session will restart in 0.008080s
2025-10-10T14:34:25.994182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0] Write session: Do CDS request
2025-10-10T14:34:25.994189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:25.994267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:25.994321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601424958042103:2527]
2025-10-10T14:34:26.003990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.004243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:26.004275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1338
2025-10-10T14:34:26.004427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.004466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:26.004471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:26.004474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:26.004915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1338 sessionId:  describe result for acl check
2025-10-10T14:34:26.004954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:26.004962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:26.004964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:26.004971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601429253009457:8278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:26.005563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601429253009457:8278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:26.008230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601429253009457:8278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:26.010637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:26.010945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601429253009457:8278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:26.010962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601429253009457:8278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:26.010965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601429253009457:8278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:26.010972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:26.013184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:26.013542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:26.013557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:26.013580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:26.013668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:26.013712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601428470786226:8054]
2025-10-10T14:34:26.014367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:26.014748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:26.014810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:26.015159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:26.015227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.015233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.015235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.015236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.015238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.015239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.015241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.015242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.015244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.015245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.015246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.015247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.015249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.015256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.015269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.015274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.015278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.015282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.015287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.015290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.015293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.015297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.015301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.015305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.015309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.015313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.015321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.015332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.015339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.015344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.015349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.015354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.015358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.015362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.015372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.015379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.015383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.015393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.015398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.015404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.015408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.015413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.015418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.015428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.015433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.015439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.015444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.015454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.015459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.015464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.015472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.015481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.015520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:26.020904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:26.021249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:26.021264Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:26.021267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:26.021271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:26.021279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1337 [2:7559601428470786226:8054]
2025-10-10T14:34:26.021301Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:26.021344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:26.021353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.021357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.021360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.021791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1337
2025-10-10T14:34:26.021394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:26.021409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:26.021419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:26.021490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.021492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.021862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1337
2025-10-10T14:34:26.021493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.021496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:26.021566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:26.021569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.021581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.021592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.021611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:26.021634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601428470786199:8054]
2025-10-10T14:34:26.021637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601428470786199:8054]
2025-10-10T14:34:26.021640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601428470786199:8054]
2025-10-10T14:34:26.021649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:26.021667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:26.021670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:26.021675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:26.021677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:26.021686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:26.021692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:26.021706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601424958042121:2438], now have 1 active actors on pipe
2025-10-10T14:34:26.021710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009580:8278], now have 1 active actors on pipe
2025-10-10T14:34:26.021751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601428470786199:8054]
2025-10-10T14:34:26.021760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:26.021778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:26.021978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.021988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.022025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c44667a0-7cea6c7a-67216274-70820f06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:26.022034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.022040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.022042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:26.022055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.022068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:26.022085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.022363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.022371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.022391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.022510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1338 partition: 0 MaxSeqNo: 40 sessionId: src_id|c44667a0-7cea6c7a-67216274-70820f06_0
2025-10-10T14:34:26.022970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c57cb-f552b4b8-fcdd3ed3-48b3d9a5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c44667a0-7cea6c7a-67216274-70820f06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:26.026422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c44667a0-7cea6c7a-67216274-70820f06_0] Write session: try to update token
2025-10-10T14:34:26.026449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c44667a0-7cea6c7a-67216274-70820f06_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:26.043029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId: src_id|c44667a0-7cea6c7a-67216274-70820f06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:26.046176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:26.046441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:26.046475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:26.046483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:26.046486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:26.046496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601428470786199:8054]
2025-10-10T14:34:26.046503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601428470786199:8054]
2025-10-10T14:34:26.046508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601428470786199:8054]
2025-10-10T14:34:26.046539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:26.046546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:26.046550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:26.046570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.046589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.046614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:26.046627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.046630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:26.046791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:26.094278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601429253009599:2527]
2025-10-10T14:34:26.094618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1337, pipe: [1:7559601429253009599:2527]
2025-10-10T14:34:26.163805Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:26.164184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009599:2527], now have 1 active actors on pipe
2025-10-10T14:34:26.164428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:26.165026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44667a0-7cea6c7a-67216274-70820f06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:26.165039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44667a0-7cea6c7a-67216274-70820f06_0] Write session will restart in 0.009696s
2025-10-10T14:34:26.164488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:26.164507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:26.164514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601429253009599:2527]
2025-10-10T14:34:26.164536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:26.164590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1338 reason: error at write: Disconnected sessionId: src_id|c44667a0-7cea6c7a-67216274-70820f06_0
2025-10-10T14:34:26.164827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1338 sessionId: src_id|c44667a0-7cea6c7a-67216274-70820f06_0 is DEAD
2025-10-10T14:34:26.165064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44667a0-7cea6c7a-67216274-70820f06_0] Write session: Do CDS request
2025-10-10T14:34:26.165073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44667a0-7cea6c7a-67216274-70820f06_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:26.176015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c44667a0-7cea6c7a-67216274-70820f06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.176108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:26.176129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1339
2025-10-10T14:34:26.176354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.176391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:26.176402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:26.176407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:26.177057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1339 sessionId:  describe result for acl check
2025-10-10T14:34:26.177097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:26.177106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:26.177107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:26.177115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601429253009679:8285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:26.177692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601429253009679:8285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:26.180237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601429253009679:8285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:26.181323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:26.183483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:26.183775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601429253009679:8285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:26.183792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601429253009679:8285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:26.183797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601429253009679:8285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:26.183805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:26.183711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:26.183727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:26.183740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:26.183804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:26.183843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601428470786397:8063]
2025-10-10T14:34:26.184452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:26.184726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:26.184764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:26.185042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:26.185114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.185121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.185121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.185123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.185124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.185125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.185126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.185127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.185128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.185129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.185131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.185132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.185133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.185138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.185151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.185154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.185158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.185162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.185166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.185171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.185174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.185178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.185182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.185185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.185188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.185191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.185198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.185206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.185212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.185217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.185221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.185226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.185230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.185235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.185240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.185244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.185249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.185253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.185264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.185269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.185274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.185278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.185282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.185287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.185292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.185299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.185303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.185308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.185326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.185366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.185371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.185376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.185412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:26.187888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:26.188426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:26.188442Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:26.188444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:26.188448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:26.188454Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1338 [2:7559601428470786397:8063]
2025-10-10T14:34:26.188466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:26.188486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:26.188493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.188496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.188499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.188516Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:26.188529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:26.188541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:26.188604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.188611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.188613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.188616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:26.188690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:26.188698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.188711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.188725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.188743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:26.188769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009766:8285], now have 1 active actors on pipe
2025-10-10T14:34:26.188779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009602:2438], now have 1 active actors on pipe
2025-10-10T14:34:26.188787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601428470786392:8063]
2025-10-10T14:34:26.188790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601428470786392:8063]
2025-10-10T14:34:26.188792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601428470786392:8063]
2025-10-10T14:34:26.188806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:26.188820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:26.188837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:26.188839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:26.188843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:26.188849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:26.188853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:26.188870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601428470786392:8063]
2025-10-10T14:34:26.188878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:26.188881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:26.188851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1338
2025-10-10T14:34:26.188852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1338
2025-10-10T14:34:26.188922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.188933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.188974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:26.188988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.188993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.188996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:26.189012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.189029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:26.189048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.189231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.189246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.189269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.189381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1339 partition: 0 MaxSeqNo: 40 sessionId: src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0
2025-10-10T14:34:26.189798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c44667a0-7cea6c7a-67216274-70820f06_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:26.192508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0] Write session: try to update token
2025-10-10T14:34:26.192528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:26.208833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:26.208856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:26.208860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:26.208862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:26.208874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601428470786392:8063]
2025-10-10T14:34:26.208879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601428470786392:8063]
2025-10-10T14:34:26.208887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601428470786392:8063]
2025-10-10T14:34:26.208944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:26.208945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:26.208951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:26.208953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.208956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:26.208956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:26.209136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:26.209151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId: src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:26.212220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:26.264833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601429253009777:2527]
2025-10-10T14:34:26.265208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1338, pipe: [1:7559601429253009777:2527]
2025-10-10T14:34:26.331951Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:26.332453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.332475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.332531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009777:2527], now have 1 active actors on pipe
2025-10-10T14:34:26.332828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:26.332879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:26.332953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601429253009777:2527]
2025-10-10T14:34:26.332981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:26.332988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:26.333062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1339 reason: error at write: Disconnected sessionId: src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0
2025-10-10T14:34:26.333312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1339 sessionId: src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0 is DEAD
2025-10-10T14:34:26.333487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:26.333497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0] Write session will restart in 0.009130s
2025-10-10T14:34:26.333525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0] Write session: Do CDS request
2025-10-10T14:34:26.333535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:26.345869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.347019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:26.347041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1340
2025-10-10T14:34:26.349552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.349630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:26.349637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:26.349641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:26.350092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1340 sessionId:  describe result for acl check
2025-10-10T14:34:26.350133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:26.350140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:26.350144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:26.350151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601429253009854:8291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:26.350730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601429253009854:8291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:26.357686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:26.358154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601429253009854:8291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:26.361374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:26.361639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:26.361653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:26.361666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:26.361728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:26.361770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601428470786570:8065]
2025-10-10T14:34:26.362213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:26.362665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:26.362752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:26.363044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601429253009854:8291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:26.363066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601429253009854:8291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:26.363069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601429253009854:8291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:26.363079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:26.363133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:26.363226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.363228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.363229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.363230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.363232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.363233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.363235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.363236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.363237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.363238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.363239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.363241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.363242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.363249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.363262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.363267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.363271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.363274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.363278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.363282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.363286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.363290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.363295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.363298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.363302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.363306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.363316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.363325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.363334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.363341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.363348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.363357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.363363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.363369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.363375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.363381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.363387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.363393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.363398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.363404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.363409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.363415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.363421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.363425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.363429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.363435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.363439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.363445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.363450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.363455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.363461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.363466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.363510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:26.366405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:26.366743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:26.366757Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:26.366759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:26.366764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:26.366771Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1339 [2:7559601428470786570:8065]
2025-10-10T14:34:26.366787Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:26.366810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:26.366818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.366822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.366825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.366848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:26.366859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:26.366867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:26.366928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.366930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.366933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.366936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:26.367022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:26.367033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.367046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.367057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.367074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:26.367099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009950:8291], now have 1 active actors on pipe
2025-10-10T14:34:26.367102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009782:2438], now have 1 active actors on pipe
2025-10-10T14:34:26.367109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601428470786565:8065]
2025-10-10T14:34:26.367112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601428470786565:8065]
2025-10-10T14:34:26.367114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601428470786565:8065]
2025-10-10T14:34:26.367128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:26.367148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:26.367156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:26.367164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:26.367168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:26.367169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:26.367171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:26.367197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601428470786565:8065]
2025-10-10T14:34:26.367210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:26.367226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:26.367409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1339
2025-10-10T14:34:26.367456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1339
2025-10-10T14:34:26.367641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.367656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.367700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22531649-b5851ae5-23c4615a-7fb644c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:26.367714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.367718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.367721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:26.367733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.367747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:26.367779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.368056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.368067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.368085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.368209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1340 partition: 0 MaxSeqNo: 40 sessionId: src_id|22531649-b5851ae5-23c4615a-7fb644c1_0
2025-10-10T14:34:26.368638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae9c83d-3fb2dce4-5741eb25-4a4ce182_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|22531649-b5851ae5-23c4615a-7fb644c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:26.371603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22531649-b5851ae5-23c4615a-7fb644c1_0] Write session: try to update token
2025-10-10T14:34:26.371627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22531649-b5851ae5-23c4615a-7fb644c1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:26.379698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:26.379725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:26.379737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601428470786565:8065]
2025-10-10T14:34:26.379792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:26.379986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:26.380163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:26.380325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:26.380478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:26.380688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:26.380736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:26.385888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:26.390153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId: src_id|22531649-b5851ae5-23c4615a-7fb644c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:26.393035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:26.393539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:26.393375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.393402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.393458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:26.407607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:26.407633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:26.407636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:26.407638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:26.407651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601428470786565:8065]
2025-10-10T14:34:26.407655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601428470786565:8065]
2025-10-10T14:34:26.407659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601428470786565:8065]
2025-10-10T14:34:26.407717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:26.407732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.407734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:26.407887Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:26.409520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:26.409539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:26.409544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:26.433268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601429253009959:2527]
2025-10-10T14:34:26.435346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1339, pipe: [1:7559601429253009959:2527]
2025-10-10T14:34:26.527973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:26.536423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.536447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.536618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.536682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.536746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.536813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.536861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.536870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.536943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.537011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.537088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.537162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.537211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.537221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.540059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:26.540130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601429253009959:2527]
2025-10-10T14:34:26.540261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:26.540275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:26.540307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1340 reason: error at write: Disconnected sessionId: src_id|22531649-b5851ae5-23c4615a-7fb644c1_0
2025-10-10T14:34:26.540537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1340 sessionId: src_id|22531649-b5851ae5-23c4615a-7fb644c1_0 is DEAD
2025-10-10T14:34:26.540694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22531649-b5851ae5-23c4615a-7fb644c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:26.540707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22531649-b5851ae5-23c4615a-7fb644c1_0] Write session will restart in 0.005405s
2025-10-10T14:34:26.540743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22531649-b5851ae5-23c4615a-7fb644c1_0] Write session: Do CDS request
2025-10-10T14:34:26.540750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22531649-b5851ae5-23c4615a-7fb644c1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:26.537293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.537375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.537435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.537511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.537554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.537557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.537628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.537691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.537752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.537814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.537859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.537862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.537934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.537994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.538059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.538123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.538164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.538168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.538238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.538301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.538366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.538429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.538472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.538474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.538543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.538605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.538672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.538742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.538790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.538793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.538871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.538937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.539000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.539062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.539107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.539113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.539186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.539250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.539314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.539379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.539423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.539425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.539498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:26.539563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:26.539634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:26.539705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:26.539751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:26.539754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:26.539832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009959:2527], now have 1 active actors on pipe
2025-10-10T14:34:26.541014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:26.546892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22531649-b5851ae5-23c4615a-7fb644c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.547032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:26.547052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1341
2025-10-10T14:34:26.547192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.547228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:26.547234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:26.547239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:26.547693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1341 sessionId:  describe result for acl check
2025-10-10T14:34:26.547733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:26.547735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:26.547737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:26.547743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601429253009987:8296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:26.548350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601429253009987:8296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:26.550574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601429253009987:8296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:26.557007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601429253009987:8296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:26.557028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601429253009987:8296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:26.557033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601429253009987:8296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:26.557043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:26.558743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:26.561162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:26.561577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:26.561598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:26.561616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:26.561713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:26.561773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601428470786757:8068]
2025-10-10T14:34:26.562425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:26.562814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:26.562876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:26.563218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:26.563314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.563323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.563325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.563326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.563328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.563329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.563331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.563332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.563333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.563335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.563336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.563338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.563339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.563347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.563360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.563364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.563369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.563372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.563377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.563381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.563385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.563389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.563394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.563398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.563402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.563406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.563415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.563434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.563445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.563450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.563460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.563465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.563470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.563476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.563482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.563487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.563491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.563503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.563508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.563518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.563523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.563528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.563533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.563538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.563543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.563548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.563552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.563559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.563563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.563573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.563578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.563588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.563633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:26.566259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:26.566834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:26.566851Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:26.566854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:26.566858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:26.566865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1340 [2:7559601428470786757:8068]
2025-10-10T14:34:26.566879Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:26.566897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:26.566905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.566908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.566910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.566922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:26.566927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:26.566934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:26.567001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.567007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.567009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.567011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:26.567065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:26.567072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.567079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.567085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.567094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:26.567109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601428470786752:8068]
2025-10-10T14:34:26.567111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601428470786752:8068]
2025-10-10T14:34:26.567112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601428470786752:8068]
2025-10-10T14:34:26.567119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:26.567133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253010137:8296], now have 1 active actors on pipe
2025-10-10T14:34:26.567138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:26.567142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:26.567146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:26.567149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:26.567161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:26.567165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:26.567171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253009974:2438], now have 1 active actors on pipe
2025-10-10T14:34:26.567196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601428470786752:8068]
2025-10-10T14:34:26.567203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:26.567209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:26.567267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1340
2025-10-10T14:34:26.567278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1340
2025-10-10T14:34:26.567394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.567406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.567441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:26.567456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.567460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.567462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:26.567474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.567487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:26.567504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.567703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.567715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.567737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.567871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1341 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0
2025-10-10T14:34:26.568296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22531649-b5851ae5-23c4615a-7fb644c1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:26.571386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0] Write session: try to update token
2025-10-10T14:34:26.571406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:26.587853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:26.587876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:26.587878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:26.587880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:26.587889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601428470786752:8068]
2025-10-10T14:34:26.587893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601428470786752:8068]
2025-10-10T14:34:26.587896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601428470786752:8068]
2025-10-10T14:34:26.587946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:26.587950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:26.587959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:26.587960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.587963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:26.587965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:26.588108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:26.598848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId: src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:26.601645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:26.640157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601429253010156:2527]
2025-10-10T14:34:26.640634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1340, pipe: [1:7559601429253010156:2527]
2025-10-10T14:34:26.703729Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:26.704087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.704105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.704143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253010156:2527], now have 1 active actors on pipe
2025-10-10T14:34:26.704418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:26.704782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601429253010156:2527]
2025-10-10T14:34:26.704799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:26.704827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:26.704890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0
2025-10-10T14:34:26.705115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1341 sessionId: src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0 is DEAD
2025-10-10T14:34:26.705291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:26.705302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0] Write session will restart in 0.009348s
2025-10-10T14:34:26.705341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0] Write session: Do CDS request
2025-10-10T14:34:26.705348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:26.715905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.716159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:26.716179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1342
2025-10-10T14:34:26.716346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.716391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:26.716397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:26.716401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:26.716924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1342 sessionId:  describe result for acl check
2025-10-10T14:34:26.716967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:26.716975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:26.716978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:26.716985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601429253010255:8301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:26.717574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601429253010255:8301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:26.720251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601429253010255:8301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:26.721258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:26.723901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:26.724188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:26.724205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:26.724220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:26.724301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:26.724352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601428470786931:8070]
2025-10-10T14:34:26.724945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:26.725285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:26.725357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:26.725696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:26.725782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.725790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.725791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.725793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.725794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.725796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.725797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.725798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.725800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.725801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.725802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.725803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.725804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.725811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.725826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.725831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.725835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.725839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.725843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.725847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.725851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.725854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.725857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.725860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.725864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.725867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.725875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.725884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.725890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.725896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.725900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.725906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.725910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.725916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.725921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.725926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.725930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.725937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.725942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.725947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.725951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.725956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.725961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.725966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.725970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.725974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.725979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.725983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.725987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.725992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.725996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.726001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.726038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:26.726690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601429253010255:8301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:26.726712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601429253010255:8301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:26.726716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601429253010255:8301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:26.726726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:26.728694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:26.729055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:26.729061Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:26.729064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:26.729069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:26.729076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1341 [2:7559601428470786931:8070]
2025-10-10T14:34:26.729091Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:26.729109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:26.729113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.729117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.729120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.729138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:26.729146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:26.729153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:26.729210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.729212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.729214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.729217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:26.729294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:26.729298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.729310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.729322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.729366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:26.729389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253010333:8301], now have 1 active actors on pipe
2025-10-10T14:34:26.729393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253010161:2438], now have 1 active actors on pipe
2025-10-10T14:34:26.729402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601428470786926:8070]
2025-10-10T14:34:26.729405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601428470786926:8070]
2025-10-10T14:34:26.729407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601428470786926:8070]
2025-10-10T14:34:26.729421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:26.729435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:26.729453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:26.729457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:26.729479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:26.729492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:26.729458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1341
2025-10-10T14:34:26.729494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:26.729502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1341
2025-10-10T14:34:26.729498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601428470786926:8070]
2025-10-10T14:34:26.729502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:26.729538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:26.729548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.729552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.729587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:26.729604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.729608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.729610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:26.729622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.729639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:26.729658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.729840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.729853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.729888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.730016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1342 partition: 0 MaxSeqNo: 40 sessionId: src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0
2025-10-10T14:34:26.730443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac9c76e-8232666d-38b32acc-47fdbd27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:26.733098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0] Write session: try to update token
2025-10-10T14:34:26.733118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:26.748864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId: src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:26.751616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:26.749944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:26.749968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:26.749972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:26.749975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:26.749984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601428470786926:8070]
2025-10-10T14:34:26.749988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601428470786926:8070]
2025-10-10T14:34:26.749992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601428470786926:8070]
2025-10-10T14:34:26.750042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:26.750041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:26.750049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:26.750051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.750053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:26.750054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:26.750194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:26.804963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601429253010340:2527]
2025-10-10T14:34:26.805391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1341, pipe: [1:7559601429253010340:2527]
2025-10-10T14:34:26.864709Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:26.865025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.865041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.865091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253010340:2527], now have 1 active actors on pipe
2025-10-10T14:34:26.865316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:26.865391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601429253010340:2527]
2025-10-10T14:34:26.865439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:26.865516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1342 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0
2025-10-10T14:34:26.865540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:26.865735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1342 sessionId: src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0 is DEAD
2025-10-10T14:34:26.866153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:26.866163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0] Write session will restart in 0.006644s
2025-10-10T14:34:26.866186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0] Write session: Do CDS request
2025-10-10T14:34:26.866193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:26.873823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.874193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:26.874214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1343
2025-10-10T14:34:26.874344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:26.874392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:26.874398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:26.874402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:26.874916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1343 sessionId:  describe result for acl check
2025-10-10T14:34:26.874955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:26.874964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:26.874966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:26.874973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601429253010367:8305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:26.875547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601429253010367:8305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:26.879713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601429253010367:8305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:26.886168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601429253010367:8305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:26.886188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601429253010367:8305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:26.886192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601429253010367:8305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:26.886202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:26.886552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:26.889302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:26.889571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:26.889588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:26.889601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:26.889661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:26.889714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601428470787110:8073]
2025-10-10T14:34:26.890323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:26.890705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:26.890762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:26.891118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:26.891177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.891183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.891185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.891187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.891188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.891190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.891191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.891193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.891194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.891195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.891197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.891199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.891200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.891207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.891222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.891227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.891232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.891237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.891241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.891245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.891250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.891255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.891260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.891264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.891270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.891274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.891283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.891293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:26.891301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.891307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:26.891313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.891319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:26.891325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.891338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:26.891344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.891349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:26.891354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.891360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:26.891366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.891372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:26.891377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.891382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:26.891388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.891394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:26.891400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.891405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:26.891412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.891418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.891430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.891436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.891441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.891447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.891490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:26.894463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:26.895234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:26.895248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:26.895251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:26.895256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:26.895263Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1342 [2:7559601428470787110:8073]
2025-10-10T14:34:26.895278Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:26.895299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:26.895306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.895310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.895313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.895333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:26.895345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:26.895354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:26.895421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.895429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.895431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.895433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:26.895509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:26.895518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.895530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:26.895546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:26.895566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:26.895594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253010342:2438], now have 1 active actors on pipe
2025-10-10T14:34:26.895602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253010508:8305], now have 1 active actors on pipe
2025-10-10T14:34:26.895611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601428470787103:8073]
2025-10-10T14:34:26.895618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601428470787103:8073]
2025-10-10T14:34:26.895621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601428470787103:8073]
2025-10-10T14:34:26.895637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:26.895656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:26.895678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:26.895686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:26.895720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:26.895725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601428470787103:8073]
2025-10-10T14:34:26.895728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:26.895731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:26.895740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:26.895748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:26.895690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1342
2025-10-10T14:34:26.895754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1342
2025-10-10T14:34:26.895856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.895867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.895899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:26.895914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:26.895923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:26.895926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:26.895939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:26.895952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:26.895968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.896295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1343 partition: 0 MaxSeqNo: 40 sessionId: src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0
2025-10-10T14:34:26.896741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dfb0185-9ffd19e9-7a621a84-12537ccd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:26.896158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.896169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.896187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:26.899329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0] Write session: try to update token
2025-10-10T14:34:26.899346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:26.907639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:26.907667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:26.907682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601428470787103:8073]
2025-10-10T14:34:26.907756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:26.908044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:26.908212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:26.908382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:26.908602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:26.908871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:26.908923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:26.913401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:26.917968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId: src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:26.920620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:26.920877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:26.920903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:26.920946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:26.921025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:26.928540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:26.928565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:26.928569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:26.928571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:26.928584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601428470787103:8073]
2025-10-10T14:34:26.928588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601428470787103:8073]
2025-10-10T14:34:26.928592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601428470787103:8073]
2025-10-10T14:34:26.928647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:26.928648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:26.928655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:26.928660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:26.928662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:26.928665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:26.928803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:26.965742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601429253010521:2527]
2025-10-10T14:34:26.966116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1342, pipe: [1:7559601429253010521:2527]
2025-10-10T14:34:27.042376Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:27.050914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.050947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.051130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.051200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.051270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.051345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.051386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.051390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.051462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.051521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.051580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.051644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.051686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.051694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.051762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.051819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.051880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.051940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.051978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.051981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.052052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.052137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.052197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.052257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.052296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.052300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.052362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.052419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.052480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.052541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.052584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.052588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.052659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.052717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.052772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.052831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.052873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.052876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.052946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.053002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.053064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.053128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.053174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.053176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.053240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.053300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.053565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.053634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.053686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.053694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.053761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.053824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.053894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.053957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.054001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.054008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.054077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.054139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.054205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.054271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.054316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.054323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.054421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601429253010521:2527], now have 1 active actors on pipe
2025-10-10T14:34:27.054697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601429253010521:2527]
2025-10-10T14:34:27.054760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:27.054825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:27.054834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:27.054865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1343 reason: error at write: Disconnected sessionId: src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0
2025-10-10T14:34:27.055101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1343 sessionId: src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0 is DEAD
2025-10-10T14:34:27.055249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:27.055258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0] Write session will restart in 0.008433s
2025-10-10T14:34:27.055287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0] Write session: Do CDS request
2025-10-10T14:34:27.055294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:27.055518Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:27.064928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.065006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:27.065033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1344
2025-10-10T14:34:27.065135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.065168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:27.065178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:27.065182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:27.065569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1344 sessionId:  describe result for acl check
2025-10-10T14:34:27.065607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:27.065609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:27.065610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:27.065616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601433547977867:8315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:27.066340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601433547977867:8315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:27.068683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601433547977867:8315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:27.071584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601433547977867:8315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:27.071611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601433547977867:8315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:27.071615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601433547977867:8315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:27.071624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:27.071954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:27.074698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:27.074935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:27.074948Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:27.074961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:27.075032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:27.075081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601432765754614:8081]
2025-10-10T14:34:27.075785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:27.076196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:27.076247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:27.076597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:27.076667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.076675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.076676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.076678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.076679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.076681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.076682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.076684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.076685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.076687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.076688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.076690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.076691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.076698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.076712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.076717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.076722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.076727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.076732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.076737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.076742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.076747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.076752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.076757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.076762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.076766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.076774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.076784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.076798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.076806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.076817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.076824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.076834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.076841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.076847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.076858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.076864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.076877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.076887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.076893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.076898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.076905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.076915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.076921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.076930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.076936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.076946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.076953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.076963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.076969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.076989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.076995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.077041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:27.079636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:27.080289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:27.080305Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:27.080307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:27.080312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:27.080319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1343 [2:7559601432765754614:8081]
2025-10-10T14:34:27.080334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:27.080353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:27.080364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.080368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.080371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.080388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:27.080395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:27.080404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:27.080462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.080471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.080473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.080476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:27.080547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:27.080558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.080571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.080585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.080604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:27.080632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978000:8315], now have 1 active actors on pipe
2025-10-10T14:34:27.080641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547977833:2438], now have 1 active actors on pipe
2025-10-10T14:34:27.080648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601432765754608:8081]
2025-10-10T14:34:27.080651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601432765754608:8081]
2025-10-10T14:34:27.080654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601432765754608:8081]
2025-10-10T14:34:27.080667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:27.080681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:27.080685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:27.080700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:27.080702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:27.080703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:27.080707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:27.080665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1343
2025-10-10T14:34:27.080706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1343
2025-10-10T14:34:27.080745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.080757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.080773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601432765754608:8081]
2025-10-10T14:34:27.080781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:27.080793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:27.080817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:27.080830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.080835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.080837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:27.080849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.080861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:27.080890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.081059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.081068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.081085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.081187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1344 partition: 0 MaxSeqNo: 40 sessionId: src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0
2025-10-10T14:34:27.081594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48e90ea1-d8fdb3b1-d0a6e861-f75ae194_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:27.084474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0] Write session: try to update token
2025-10-10T14:34:27.084497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:27.101300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId: src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:27.104116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:27.104444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.104490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.106651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:27.106702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:27.106705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:27.106708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:27.106711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:27.106720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601432765754608:8081]
2025-10-10T14:34:27.106726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601432765754608:8081]
2025-10-10T14:34:27.106731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601432765754608:8081]
2025-10-10T14:34:27.106771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:27.106780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:27.106789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:27.106789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.106792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:27.106794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:27.106984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:27.106835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:27.154655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601433547978024:2527]
2025-10-10T14:34:27.155156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1343, pipe: [1:7559601433547978024:2527]
2025-10-10T14:34:27.233669Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:27.244777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.244820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.245046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.245128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.245213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.245295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.245424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.245449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.245543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.245616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.245694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.245768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.245835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.245846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.245926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.245998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.246077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.246164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.246227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.246234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.246318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.246391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.246464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.246547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.246606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.246610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.246705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.246778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.246859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.246940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.247001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.247005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.247100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.247180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.247259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.247332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.247390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.247393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.247483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.247658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.247737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.247827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.247888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.247899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.247983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.248049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.248137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.248209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.248261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.248267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.248348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.248417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.248476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.248543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.248594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.248597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.248663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.248719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.248780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.248841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.248882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.248885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.248968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978024:2527], now have 1 active actors on pipe
2025-10-10T14:34:27.249401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:27.249421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:27.249434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601433547978024:2527]
2025-10-10T14:34:27.249452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1344 reason: error at write: Disconnected sessionId: src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0
2025-10-10T14:34:27.249460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:27.249571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:27.249661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1344 sessionId: src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0 is DEAD
2025-10-10T14:34:27.249994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:27.250005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0] Write session will restart in 0.009897s
2025-10-10T14:34:27.250030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0] Write session: Do CDS request
2025-10-10T14:34:27.250036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:27.260918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.261022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:27.261044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1345
2025-10-10T14:34:27.261221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.261269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:27.261279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:27.261283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:27.261790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1345 sessionId:  describe result for acl check
2025-10-10T14:34:27.261826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:27.261833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:27.261835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:27.261841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601433547978127:8322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:27.262375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601433547978127:8322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:27.266118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601433547978127:8322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:27.269163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601433547978127:8322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:27.269179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601433547978127:8322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:27.269183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601433547978127:8322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:27.269192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:27.266118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:27.269126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:27.269362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:27.269367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:27.269378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:27.269435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:27.269476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601432765754798:8090]
2025-10-10T14:34:27.270025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:27.270456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:27.270516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:27.270836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:27.270918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.270924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.270926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.270927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.270928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.270930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.270931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.270932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.270933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.270935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.270936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.270937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.270939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.270945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.270959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.270963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.270967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.270971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.270975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.270979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.270983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.270987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.270992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.270996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.271000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.271004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.271013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.271022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.271028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.271035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.271040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.271045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.271054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.271059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.271072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.271082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.271086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.271091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.271096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.271101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.271105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.271110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.271119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.271124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.271133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.271138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.271155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.271165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.271169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.271179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.271183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.271188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.271231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:27.273765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:27.274091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:27.274106Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:27.274109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:27.274113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:27.274119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1344 [2:7559601432765754798:8090]
2025-10-10T14:34:27.274132Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:27.274470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1344
2025-10-10T14:34:27.274489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1344
2025-10-10T14:34:27.274155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:27.274165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.274169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.274171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.274189Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:27.274197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:27.274206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:27.274260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.274263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.274264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.274267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:27.274341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:27.274344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.274690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.274703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.274735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:27.274759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978197:8322], now have 1 active actors on pipe
2025-10-10T14:34:27.274762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978027:2438], now have 1 active actors on pipe
2025-10-10T14:34:27.274781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.274786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.274806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601432765754792:8090]
2025-10-10T14:34:27.274808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601432765754792:8090]
2025-10-10T14:34:27.274810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601432765754792:8090]
2025-10-10T14:34:27.274825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:27.274840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:27.274840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:27.274843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:27.274845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:27.274857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:27.274860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:27.274881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:27.274888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.274892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.274895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:27.274906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.274916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:27.274943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601432765754792:8090]
2025-10-10T14:34:27.274952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:27.274963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.274966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:27.275194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.275205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.275220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.275305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1345 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0
2025-10-10T14:34:27.275738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44b8340e-2cdb7169-5542fa4f-5c24bd4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:27.278520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0] Write session: try to update token
2025-10-10T14:34:27.278540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:27.292448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:27.292469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:27.292483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601432765754792:8090]
2025-10-10T14:34:27.292535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:27.292537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:27.292705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:27.292842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:27.292966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:27.293095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:27.293278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:27.293317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:27.299078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId: src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:27.302168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:27.303118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.303143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.303200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:27.303298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:27.314004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:27.314028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:27.314031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:27.314033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:27.314045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601432765754792:8090]
2025-10-10T14:34:27.314049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601432765754792:8090]
2025-10-10T14:34:27.314054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601432765754792:8090]
2025-10-10T14:34:27.314103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:27.314104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:27.314110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.314111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:27.314112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:27.314115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:27.314255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:27.349714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601433547978209:2527]
2025-10-10T14:34:27.349999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1344, pipe: [1:7559601433547978209:2527]
2025-10-10T14:34:27.442893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:27.458819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.458850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.459015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.459072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.459149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.459217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.459578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.459584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.459653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.459707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.459765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.459825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.459864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.459866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.459930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.459993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.460062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.460135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.460175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.460177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.460249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.460311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.460372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.460445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.460584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.460586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.460652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.460702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.460755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.460810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.460847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.460849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.460911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.460970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.461043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.461102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.461149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.461151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.461229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.461292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.461426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.461498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.461539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.461541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.463721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:27.463750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601433547978209:2527]
2025-10-10T14:34:27.463770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:27.463780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1345 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0
2025-10-10T14:34:27.464005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1345 sessionId: src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0 is DEAD
2025-10-10T14:34:27.461603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.461666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.461720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.461774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.461811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.461813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.461876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.461933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.461995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.462052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.462089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.462091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.465414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:27.465431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0] Write session will restart in 0.005494s
2025-10-10T14:34:27.465456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0] Write session: Do CDS request
2025-10-10T14:34:27.465462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:27.462153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.462203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.462255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.462317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.462366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.462368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.462432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978209:2527], now have 1 active actors on pipe
2025-10-10T14:34:27.463416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:27.471909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.472271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:27.472298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1346
2025-10-10T14:34:27.472442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.472484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:27.472495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:27.472504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:27.473847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1346 sessionId:  describe result for acl check
2025-10-10T14:34:27.473889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:27.473896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:27.473898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:27.473905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601433547978244:8326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:27.474503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601433547978244:8326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:27.479581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601433547978244:8326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:27.482848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:27.485898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:27.486192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:27.486207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:27.486220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:27.486288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:27.486358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601432765754978:8092]
2025-10-10T14:34:27.486682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601433547978244:8326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:27.486704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601433547978244:8326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:27.486709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601433547978244:8326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:27.486719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:27.486935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:27.487859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:27.487928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:27.488317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:27.488401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.488408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.488409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.488411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.488412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.488413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.488414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.488415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.488416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.488418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.488419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.488420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.488421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.488428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.488441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.488444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.488448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.488451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.488456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.488459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.488463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.488467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.488471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.488474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.488477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.488480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.488490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.488499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.488505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.488510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.488513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.488518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.488522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.488527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.488532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.488536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.488542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.488546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.488550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.488554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.488559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.488564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.488569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.488573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.488577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.488581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.488586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.488590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.488594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.488598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.488603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.488608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.488643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:27.491361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:27.491705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:27.491720Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:27.491723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:27.491727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:27.491735Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1345 [2:7559601432765754978:8092]
2025-10-10T14:34:27.491750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:27.491781Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:27.491790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.491794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.491796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.491815Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:27.491827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:27.491836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:27.491906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.491915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.491917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.491920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:27.492140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:27.492151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.492165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.492177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.492200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:27.492186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1345
2025-10-10T14:34:27.492234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978382:8326], now have 1 active actors on pipe
2025-10-10T14:34:27.492225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1345
2025-10-10T14:34:27.492238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978211:2438], now have 1 active actors on pipe
2025-10-10T14:34:27.492248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601432765754973:8092]
2025-10-10T14:34:27.492250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601432765754973:8092]
2025-10-10T14:34:27.492253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601432765754973:8092]
2025-10-10T14:34:27.492268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:27.492289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:27.492304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:27.492308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:27.492310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:27.492314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:27.492318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:27.492355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601432765754973:8092]
2025-10-10T14:34:27.492364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:27.492415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:27.492473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.492484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.492529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:27.492549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.492554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.492557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:27.492573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.492588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:27.492614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.492920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1346 partition: 0 MaxSeqNo: 40 sessionId: src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0
2025-10-10T14:34:27.492796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.492806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.492822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.493382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8dcf18-56734e28-dc8d81db-aa2b6407_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:27.496152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0] Write session: try to update token
2025-10-10T14:34:27.496170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:27.505772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:27.505793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:27.505814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601432765754973:8092]
2025-10-10T14:34:27.505866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:27.505873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:27.506041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:27.506174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:27.506320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:27.506466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:27.506654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:27.506690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:27.518929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId: src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:27.521900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:27.522194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.522221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.522266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:27.522402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:27.526251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:27.526269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:27.526272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:27.526275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:27.526285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601432765754973:8092]
2025-10-10T14:34:27.526289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601432765754973:8092]
2025-10-10T14:34:27.526293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601432765754973:8092]
2025-10-10T14:34:27.526343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:27.526350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:27.526355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:27.526357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.526359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:27.526360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:27.526498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:27.563724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601433547978406:2527]
2025-10-10T14:34:27.564062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1345, pipe: [1:7559601433547978406:2527]
2025-10-10T14:34:27.670366Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:27.680373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.680408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.680607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.680674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.680880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.680953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.681452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.681469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.681549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.681623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.681690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.681760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.681809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.681812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.681881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.681939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.681997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.682057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.682098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.682102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.682169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.682227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.682295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.682359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.682419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.682423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.682491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.682550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.682615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.682684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.682733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.682736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.682807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.682870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.682934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.682999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.683045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.683048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.683124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.683188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.683257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.683321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.683365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.683368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.683440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.683498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.683558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.683644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.683710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.683712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.684129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.684209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.684275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.684339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.684381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.684385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.684458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:27.684516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:27.684582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:27.684646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:27.684692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:27.684696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:27.684782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978406:2527], now have 1 active actors on pipe
2025-10-10T14:34:27.685583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:27.687620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:27.687667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601433547978406:2527]
2025-10-10T14:34:27.688054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:27.688132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1346 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0
2025-10-10T14:34:27.688350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1346 sessionId: src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0 is DEAD
2025-10-10T14:34:27.688479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:27.688491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0] Write session will restart in 0.009635s
2025-10-10T14:34:27.688517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0] Write session: Do CDS request
2025-10-10T14:34:27.688526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:27.699783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.700366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:27.700385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1347
2025-10-10T14:34:27.700546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.700581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:27.700587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:27.700591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:27.701523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1347 sessionId:  describe result for acl check
2025-10-10T14:34:27.701561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:27.701568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:27.701570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:27.701576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601433547978505:8332] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:27.702141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601433547978505:8332] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:27.707810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601433547978505:8332] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:27.709233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:27.712211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:27.712484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:27.712498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:27.712511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:27.712580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:27.712623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601432765755171:8095]
2025-10-10T14:34:27.712892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601433547978505:8332] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:27.712911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601433547978505:8332] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:27.712914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601433547978505:8332] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:27.712923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:27.713261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:27.713723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:27.713797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:27.714139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:27.714194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.714195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.714196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.714197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.714198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.714199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.714201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.714202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.714203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.714204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.714205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.714206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.714208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.714215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.714227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.714231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.714235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.714238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.714242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.714246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.714250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.714253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.714257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.714261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.714264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.714268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.714276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.714284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.714291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.714297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.714301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.714307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.714311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.714317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.714322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.714327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.714332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.714337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.714342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.714348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.714352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.714357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.714363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.714368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.714373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.714378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.714382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.714387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.714391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.714398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.714402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.714408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.714447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:27.717188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:27.717832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:27.717845Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:27.717847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:27.717851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:27.717858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1346 [2:7559601432765755171:8095]
2025-10-10T14:34:27.717872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:27.717892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:27.717895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.717907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.717909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.717928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:27.717936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:27.717945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:27.718011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.718013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.718015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.718018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:27.718090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:27.718093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.718106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.718116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.718133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:27.718156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601432765755165:8095]
2025-10-10T14:34:27.718159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601432765755165:8095]
2025-10-10T14:34:27.718161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601432765755165:8095]
2025-10-10T14:34:27.718175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:27.718190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:27.718206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:27.718209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:27.718243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601432765755165:8095]
2025-10-10T14:34:27.718245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:27.718350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:27.718353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:27.718355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:27.718362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:27.718499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978590:8332], now have 1 active actors on pipe
2025-10-10T14:34:27.718515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978419:2438], now have 1 active actors on pipe
2025-10-10T14:34:27.718587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1346
2025-10-10T14:34:27.718596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1346
2025-10-10T14:34:27.718841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.718857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.718892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:27.718906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.718911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.718914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:27.718926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.718950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:27.718967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.719232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.719241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.719258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.719386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1347 partition: 0 MaxSeqNo: 40 sessionId: src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0
2025-10-10T14:34:27.719790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65a301b6-2d50e408-75dfbbc7-150f6d0b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:27.722522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0] Write session: try to update token
2025-10-10T14:34:27.722542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:27.738110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId: src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:27.740850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:27.741264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.741295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.741321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:27.741324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:27.741350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:27.741352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:27.741361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601432765755165:8095]
2025-10-10T14:34:27.741366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601432765755165:8095]
2025-10-10T14:34:27.741370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601432765755165:8095]
2025-10-10T14:34:27.741411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:27.741432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:27.741433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:27.741438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:27.741439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.741442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:27.741585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:27.788006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601433547978602:2527]
2025-10-10T14:34:27.788332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1346, pipe: [1:7559601433547978602:2527]
2025-10-10T14:34:27.863784Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:27.864225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:27.864283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978602:2527], now have 1 active actors on pipe
2025-10-10T14:34:27.864537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:27.864717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601433547978602:2527]
2025-10-10T14:34:27.864748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:27.877383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:27.877403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:27.877432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1347 reason: error at write: Disconnected sessionId: src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0
2025-10-10T14:34:27.877761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:27.877769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0] Write session will restart in 0.007594s
2025-10-10T14:34:27.877794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0] Write session: Do CDS request
2025-10-10T14:34:27.877801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:27.877612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1347 sessionId: src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0 is DEAD
2025-10-10T14:34:27.886890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.887224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:27.887243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1348
2025-10-10T14:34:27.887416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:27.887450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:27.887457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:27.887461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:27.887896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1348 sessionId:  describe result for acl check
2025-10-10T14:34:27.887927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:27.887929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:27.887931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:27.887939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601433547978659:8336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:27.888534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601433547978659:8336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:27.891802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601433547978659:8336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:27.893189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:27.896072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:27.896346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:27.896361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:27.896374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:27.896438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:27.896489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601432765755354:8098]
2025-10-10T14:34:27.896497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601433547978659:8336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:27.896515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601433547978659:8336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:27.896519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601433547978659:8336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:27.896529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:27.897184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:27.897550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:27.897602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:27.898006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:27.898085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.898094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.898095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.898096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.898097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.898099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.898100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.898101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.898102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.898104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.898105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.898106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.898108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.898114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.898129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.898134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.898138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.898143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.898148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.898152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.898156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.898161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.898165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.898170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.898175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.898179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.898186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.898195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:27.898202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.898208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:27.898213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.898219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:27.898224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.898230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:27.898236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.898242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:27.898246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.898253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:27.898258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.898264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:27.898269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.898275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:27.898281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.898287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:27.898292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.898304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:27.898309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.898315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.898324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.898330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.898339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.898345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.898391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:27.900920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:27.901506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:27.901521Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:27.901523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:27.901527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:27.901536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1347 [2:7559601432765755354:8098]
2025-10-10T14:34:27.901550Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:27.901568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:27.901577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.901581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.901584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.901601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:27.901609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:27.901617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:27.901677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.901685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.901687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.901689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:27.901761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:27.901769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.901782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:27.901795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:27.901818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:27.901843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601432765755349:8098]
2025-10-10T14:34:27.901854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601432765755349:8098]
2025-10-10T14:34:27.901856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601432765755349:8098]
2025-10-10T14:34:27.901866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:27.901875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:27.901878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:27.901881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:27.901882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:27.901898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:27.901902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:27.901913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978777:8336], now have 1 active actors on pipe
2025-10-10T14:34:27.901917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978604:2438], now have 1 active actors on pipe
2025-10-10T14:34:27.901940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601432765755349:8098]
2025-10-10T14:34:27.901954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:27.901955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1347
2025-10-10T14:34:27.901996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1347
2025-10-10T14:34:27.901971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:27.902094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.902104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.902135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:27.902148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:27.902157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:27.902159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:27.902171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:27.902188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:27.902213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.902445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:27.902459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:27.902476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:27.902576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1348 partition: 0 MaxSeqNo: 40 sessionId: src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0
2025-10-10T14:34:27.903035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b449b3-9416efdd-fe29fe6a-706e19e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:27.906011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0] Write session: try to update token
2025-10-10T14:34:27.906033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:27.922135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:27.922158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:27.922161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:27.922163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:27.922175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601432765755349:8098]
2025-10-10T14:34:27.922180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601432765755349:8098]
2025-10-10T14:34:27.922185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601432765755349:8098]
2025-10-10T14:34:27.922237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:27.922246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:27.924605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId: src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:27.922249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:27.922426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:27.924529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:27.924537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:27.924542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:27.927453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:27.964626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601433547978789:2527]
2025-10-10T14:34:27.964900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1347, pipe: [1:7559601433547978789:2527]
2025-10-10T14:34:28.038485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:28.038986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.039008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.039061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601433547978789:2527], now have 1 active actors on pipe
2025-10-10T14:34:28.039330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:28.039779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:28.039792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0] Write session will restart in 0.008466s
2025-10-10T14:34:28.039339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:28.039358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:28.039358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:28.039418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601433547978789:2527]
2025-10-10T14:34:28.039435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1348 reason: error at write: Disconnected sessionId: src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0
2025-10-10T14:34:28.039817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0] Write session: Do CDS request
2025-10-10T14:34:28.039636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1348 sessionId: src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0 is DEAD
2025-10-10T14:34:28.039825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:28.049912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.050081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:28.050101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1349
2025-10-10T14:34:28.050236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.050278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:28.050290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:28.050294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:28.050859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1349 sessionId:  describe result for acl check
2025-10-10T14:34:28.050910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:28.050914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:28.050916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:28.050923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601437842946168:8340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:28.051605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601437842946168:8340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:28.054652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:28.054072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601437842946168:8340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:28.057151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:28.057455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:28.057469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:28.057482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:28.057556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:28.057606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601437060722832:8100]
2025-10-10T14:34:28.058300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:28.058301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601437842946168:8340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:28.058320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601437842946168:8340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:28.058324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601437842946168:8340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:28.058333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:28.058565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:28.058609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:28.058941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:28.059003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.059010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.059011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.059013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.059014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.059016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.059017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.059019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.059020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.059022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.059023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.059025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.059027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.059033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.059048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.059053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.059057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.059062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.059067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.059071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.059076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.059080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.059086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.059090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.059095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.059099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.059108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.059117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.059124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.059130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.059135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.059141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.059148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.059158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.059164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.059169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.059180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.059186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.059191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.059197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.059202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.059214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.059219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.059230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.059235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.059241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.059246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.059252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.059256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.059262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.059267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.059278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.059323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:28.061929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:28.062674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:28.062692Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:28.062694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:28.062698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:28.062705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1348 [2:7559601437060722832:8100]
2025-10-10T14:34:28.062721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:28.062740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:28.062743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.062747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.062750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.062768Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:28.062777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:28.062786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:28.062851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.062859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.062862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.062865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:28.062938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:28.062948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.062960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.062973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.062991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:28.063019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946261:8340], now have 1 active actors on pipe
2025-10-10T14:34:28.063028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946087:2438], now have 1 active actors on pipe
2025-10-10T14:34:28.063035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601437060722827:8100]
2025-10-10T14:34:28.063038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601437060722827:8100]
2025-10-10T14:34:28.063040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601437060722827:8100]
2025-10-10T14:34:28.063053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:28.063066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:28.063072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:28.063087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:28.063088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:28.063091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:28.063094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:28.063126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601437060722827:8100]
2025-10-10T14:34:28.063141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:28.063146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:28.063168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1348
2025-10-10T14:34:28.063169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1348
2025-10-10T14:34:28.063291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.063302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.063333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:28.063348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.063354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.063356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:28.063368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.063380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:28.063395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.063572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.063581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.063596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.063691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1349 partition: 0 MaxSeqNo: 40 sessionId: src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0
2025-10-10T14:34:28.064120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292d247-8494205e-88779ed8-7a7ff5f3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:28.066947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0] Write session: try to update token
2025-10-10T14:34:28.066968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:28.074882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:28.074902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:28.074914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601437060722827:8100]
2025-10-10T14:34:28.074965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:28.075142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:28.075289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:28.075430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:28.075577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:28.075766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:28.075813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:28.076129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:28.090875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId: src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:28.093080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:28.093105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:28.093109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:28.093112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:28.093122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601437060722827:8100]
2025-10-10T14:34:28.093127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601437060722827:8100]
2025-10-10T14:34:28.093131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601437060722827:8100]
2025-10-10T14:34:28.093188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:28.093200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.093203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:28.093193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:28.093210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:28.093215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:28.093372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:28.093677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:28.139716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601437842946285:2527]
2025-10-10T14:34:28.140041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1348, pipe: [1:7559601437842946285:2527]
2025-10-10T14:34:28.217952Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:28.218311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.218327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.218353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946285:2527], now have 1 active actors on pipe
2025-10-10T14:34:28.218566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:28.218583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:28.218616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:28.218631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:28.218659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1349 reason: error at write: Disconnected sessionId: src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0
2025-10-10T14:34:28.218718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601437842946285:2527]
2025-10-10T14:34:28.218947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1349 sessionId: src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0 is DEAD
2025-10-10T14:34:28.219003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:28.219015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0] Write session will restart in 0.006803s
2025-10-10T14:34:28.219039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0] Write session: Do CDS request
2025-10-10T14:34:28.219048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:28.226983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.227094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:28.227121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1350
2025-10-10T14:34:28.227257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.227295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:28.227301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:28.227305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:28.227965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1350 sessionId:  describe result for acl check
2025-10-10T14:34:28.228008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:28.228012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:28.228014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:28.228020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601437842946326:8353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:28.228641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601437842946326:8353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:28.231122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601437842946326:8353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:28.234218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601437842946326:8353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:28.234245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601437842946326:8353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:28.234249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601437842946326:8353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:28.234257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:28.234813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:28.237061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:28.237282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:28.237292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:28.237304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:28.237372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:28.237417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601437060723054:8115]
2025-10-10T14:34:28.238062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:28.238392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:28.238451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:28.238807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:28.238877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.238885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.238886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.238888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.238889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.238890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.238891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.238893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.238894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.238895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.238896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.238897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.238899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.238905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.238918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.238922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.238926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.238930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.238934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.238938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.238942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.238945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.238950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.238953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.238956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.238960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.238968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.238977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.238983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.238988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.238992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.238996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.239000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.239005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.239009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.239015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.239019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.239024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.239028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.239032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.239036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.239040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.239045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.239050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.239054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.239059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.239064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.239069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.239073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.239078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.239082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.239087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.239125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:28.241595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:28.242003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:28.242023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:28.242026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:28.242029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:28.242036Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1349 [2:7559601437060723054:8115]
2025-10-10T14:34:28.242050Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:28.242068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:28.242071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.242075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.242077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.242094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:28.242103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:28.242110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:28.242177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.242185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.242187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.242190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:28.242263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:28.242270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.242282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.242297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.242318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:28.242344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946301:2438], now have 1 active actors on pipe
2025-10-10T14:34:28.242352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946472:8353], now have 1 active actors on pipe
2025-10-10T14:34:28.242360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601437060723049:8115]
2025-10-10T14:34:28.242367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601437060723049:8115]
2025-10-10T14:34:28.242371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601437060723049:8115]
2025-10-10T14:34:28.242388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:28.242408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:28.242412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:28.242416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:28.242418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:28.242424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:28.242428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:28.242400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1349
2025-10-10T14:34:28.242413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1349
2025-10-10T14:34:28.242457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601437060723049:8115]
2025-10-10T14:34:28.242467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:28.242469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:28.242490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.242495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.242548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:28.242556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.242560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.242563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:28.242574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.242587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:28.242604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.242836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.242850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.242873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.242961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1350 partition: 0 MaxSeqNo: 40 sessionId: src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0
2025-10-10T14:34:28.243391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ab3169b-368c0f40-1d5da4f-ae228f4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:28.245921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0] Write session: try to update token
2025-10-10T14:34:28.245940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:28.260925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId: src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:28.263116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:28.263142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:28.263146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:28.263148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:28.263157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601437060723049:8115]
2025-10-10T14:34:28.263162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601437060723049:8115]
2025-10-10T14:34:28.263166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601437060723049:8115]
2025-10-10T14:34:28.263217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:28.263226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:28.263233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:28.263233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.263236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:28.263237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:28.263385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:28.263594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:28.318951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601437842946484:2527]
2025-10-10T14:34:28.323765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1349, pipe: [1:7559601437842946484:2527]
2025-10-10T14:34:28.381358Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:28.381796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.381814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.381864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946484:2527], now have 1 active actors on pipe
2025-10-10T14:34:28.382100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:28.382205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601437842946484:2527]
2025-10-10T14:34:28.382259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:28.382347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1350 reason: status is not ok: tablet will be restarted right now sessionId: src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0
2025-10-10T14:34:28.382370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:28.382553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1350 sessionId: src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0 is DEAD
2025-10-10T14:34:28.382694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:28.382703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0] Write session will restart in 0.005873s
2025-10-10T14:34:28.382728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0] Write session: Do CDS request
2025-10-10T14:34:28.382734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:28.389880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.389999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:28.390022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1351
2025-10-10T14:34:28.390145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.390187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:28.390192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:28.390197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:28.390620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1351 sessionId:  describe result for acl check
2025-10-10T14:34:28.390651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:28.390653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:28.390655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:28.390661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601437842946502:8357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:28.391239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601437842946502:8357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:28.394549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601437842946502:8357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:28.398350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601437842946502:8357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:28.398368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601437842946502:8357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:28.398372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601437842946502:8357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:28.398381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:28.400432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:28.402306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:28.402548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:28.402559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:28.402573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:28.402628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:28.402669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601437060723238:8117]
2025-10-10T14:34:28.403282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:28.403592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:28.403638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:28.403969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:28.404029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.404036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.404037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.404038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.404040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.404041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.404042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.404043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.404044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.404046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.404047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.404048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.404049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.404056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.404078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.404082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.404086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.404089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.404094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.404098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.404102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.404105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.404109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.404113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.404117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.404120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.404129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.404139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.404145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.404152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.404156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.404166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.404171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.404181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.404187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.404197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.404201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.404211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.404216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.404222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.404226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.404232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.404236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.404242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.404251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.404258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.404267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.404272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.404281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.404286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.404293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.404298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.404343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:28.406925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:28.407298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:28.407311Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:28.407314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:28.407318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:28.407324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1350 [2:7559601437060723238:8117]
2025-10-10T14:34:28.407338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:28.407357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:28.407360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.407364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.407366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.407383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:28.407397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:28.407421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:28.407494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.407502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.407504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.407507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:28.407741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1350
2025-10-10T14:34:28.407768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1350
2025-10-10T14:34:28.407821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:28.407832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.407846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.407858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.407877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:28.407902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946660:8357], now have 1 active actors on pipe
2025-10-10T14:34:28.407911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946487:2438], now have 1 active actors on pipe
2025-10-10T14:34:28.407924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601437060723233:8117]
2025-10-10T14:34:28.407926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601437060723233:8117]
2025-10-10T14:34:28.407928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601437060723233:8117]
2025-10-10T14:34:28.407942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:28.407955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:28.407957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:28.407959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:28.407962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:28.407978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:28.407987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:28.408033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.408043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.408065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601437060723233:8117]
2025-10-10T14:34:28.408077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:28.408097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:28.408116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:28.408124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.408130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.408133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:28.408146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.408158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:28.408188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.408521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.408535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.408570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.408696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1351 partition: 0 MaxSeqNo: 40 sessionId: src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0
2025-10-10T14:34:28.409116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180ec2a8-4ec57cfe-c8fc13e7-673ca41f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:28.411913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0] Write session: try to update token
2025-10-10T14:34:28.411935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:28.427238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId: src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:28.428705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:28.428734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:28.428739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:28.428742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:28.428752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601437060723233:8117]
2025-10-10T14:34:28.428758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601437060723233:8117]
2025-10-10T14:34:28.428762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601437060723233:8117]
2025-10-10T14:34:28.428818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:28.428825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:28.428835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.428837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:28.428840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:28.428845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:28.429044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:28.430672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:28.482268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601437842946674:2527]
2025-10-10T14:34:28.482550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1350, pipe: [1:7559601437842946674:2527]
2025-10-10T14:34:28.544250Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:28.544654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.544671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.544716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946674:2527], now have 1 active actors on pipe
2025-10-10T14:34:28.544901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:28.544949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601437842946674:2527]
2025-10-10T14:34:28.544982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:28.545022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:28.545102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1351 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0
2025-10-10T14:34:28.545320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1351 sessionId: src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0 is DEAD
2025-10-10T14:34:28.545502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:28.545513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0] Write session will restart in 0.008847s
2025-10-10T14:34:28.545549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0] Write session: Do CDS request
2025-10-10T14:34:28.545556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:28.555923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.556490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:28.556512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1352
2025-10-10T14:34:28.556650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.556686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:28.556696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:28.556700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:28.557209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1352 sessionId:  describe result for acl check
2025-10-10T14:34:28.557252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:28.557256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:28.557258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:28.557265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601437842946822:8362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:28.557846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601437842946822:8362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:28.559284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:28.560022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601437842946822:8362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:28.561961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:28.562214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:28.562228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:28.562241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:28.562309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:28.562354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601437060723434:8120]
2025-10-10T14:34:28.562858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601437842946822:8362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:28.562875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601437842946822:8362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:28.562879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601437842946822:8362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:28.562888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:28.562984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:28.563344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:28.563401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:28.563732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:28.563804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.563811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.563812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.563814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.563815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.563816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.563818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.563819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.563821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.563822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.563823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.563824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.563826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.563832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.563846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.563850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.563855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.563859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.563863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.563868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.563872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.563876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.563880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.563884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.563888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.563892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.563900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.563909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.563917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.563928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.563937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.563943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.563947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.563952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.563957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.563962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.563966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.563972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.563981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.563987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.563991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.563997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.564006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.564011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.564015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.564019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.564028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.564033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.564037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.564041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.564051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.564067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.564119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:28.566664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:28.567081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:28.567094Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:28.567097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:28.567101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:28.567108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1351 [2:7559601437060723434:8120]
2025-10-10T14:34:28.567120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:28.567139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:28.567143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.567146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.567149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.567166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:28.567173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:28.567181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:28.567247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.567256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.567258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.567261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:28.567331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:28.567341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.567354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.567372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.567389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:28.567413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946865:8362], now have 1 active actors on pipe
2025-10-10T14:34:28.567416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946688:2438], now have 1 active actors on pipe
2025-10-10T14:34:28.567424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601437060723429:8120]
2025-10-10T14:34:28.567427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601437060723429:8120]
2025-10-10T14:34:28.567429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601437060723429:8120]
2025-10-10T14:34:28.567441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:28.567458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:28.567479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:28.567487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:28.567485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1351
2025-10-10T14:34:28.567486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1351
2025-10-10T14:34:28.567513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601437060723429:8120]
2025-10-10T14:34:28.567521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:28.567531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:28.567536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:28.567538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:28.567545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:28.567650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.567656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.567686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:28.567694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.567698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.567701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:28.567713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.567723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:28.567743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.567886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.567899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.567915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.568019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1352 partition: 0 MaxSeqNo: 40 sessionId: src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0
2025-10-10T14:34:28.568464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeec2924-335193b7-ae0fe3a4-53cb293c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:28.571279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0] Write session: try to update token
2025-10-10T14:34:28.571298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:28.579548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:28.579572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:28.579583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601437060723429:8120]
2025-10-10T14:34:28.579638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:28.579647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:28.579812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:28.579974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:28.580133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:28.580277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:28.580460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:28.580509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:28.586305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId: src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:28.588917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:28.589138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.589161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.589209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:28.589283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:28.597973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:28.597998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:28.598001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:28.598003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:28.598014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601437060723429:8120]
2025-10-10T14:34:28.598017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601437060723429:8120]
2025-10-10T14:34:28.598020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601437060723429:8120]
2025-10-10T14:34:28.598068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:28.598072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:28.598077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.598078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:28.598079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:28.598082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:28.598222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:28.645095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601437842946883:2527]
2025-10-10T14:34:28.645457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1351, pipe: [1:7559601437842946883:2527]
2025-10-10T14:34:28.711788Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:28.719718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.719751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.719934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.719995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.720074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.720137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.720187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.720194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.720264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.720331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.720395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.720786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.720833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.720841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.720908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.720969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.721034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.721103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.721152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.721159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.721286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.721373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.721438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.721500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.721551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.721561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.721629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.721697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.721757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.721822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.721868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.721877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.721947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.722010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.722077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.722138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.722182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.722190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.722256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.722318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.722391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.722458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.722504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.722512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.722579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.722645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.722713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.722782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.722835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.722843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.722912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.722975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.723039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.723111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.723156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.723163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.723232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:28.723302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:28.723876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:28.723893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:28.723944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1352 reason: error at write: Disconnected sessionId: src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0
2025-10-10T14:34:28.724193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1352 sessionId: src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0 is DEAD
2025-10-10T14:34:28.724238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601437842946883:2527]
2025-10-10T14:34:28.724270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:28.724398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:28.724405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0] Write session will restart in 0.007498s
2025-10-10T14:34:28.724442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0] Write session: Do CDS request
2025-10-10T14:34:28.724449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:28.723370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:28.723444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:28.723487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:28.723490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:28.723559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946883:2527], now have 1 active actors on pipe
2025-10-10T14:34:28.724304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:28.732925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.732996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:28.733011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1353
2025-10-10T14:34:28.733206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.733246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:28.733257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:28.733261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:28.733810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1353 sessionId:  describe result for acl check
2025-10-10T14:34:28.733851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:28.733857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:28.733859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:28.733865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601437842946926:8367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:28.734446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601437842946926:8367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:28.738063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601437842946926:8367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:28.740095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:28.742771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:28.742912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601437842946926:8367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:28.742929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601437842946926:8367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:28.742933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601437842946926:8367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:28.742943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:28.742994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:28.743006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:28.743019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:28.743072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:28.743114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601437060723622:8123]
2025-10-10T14:34:28.743773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:28.744216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:28.744275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:28.744630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:28.744687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.744695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.744697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.744698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.744699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.744701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.744702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.744703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.744705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.744707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.744709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.744710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.744711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.744718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.744734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.744739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.744744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.744748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.744752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.744756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.744760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.744764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.744770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.744774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.744778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.744782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.744790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.744800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.744808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.744814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.744820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.744825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.744830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.744836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.744841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.744846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.744851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.744857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.744862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.744868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.744873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.744878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.744883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.744901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.744906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.744912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.744917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.744924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.744933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.744940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.744950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.744965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.745011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:28.747724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:28.748302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:28.748319Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:28.748322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:28.748326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:28.748333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1352 [2:7559601437060723622:8123]
2025-10-10T14:34:28.748347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:28.748366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:28.748370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.748374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.748376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.748394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:28.748405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:28.748419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:28.748480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.748488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.748490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.748493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:28.748567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:28.748577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.748591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.748605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.748624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:28.748646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842946888:2438], now have 1 active actors on pipe
2025-10-10T14:34:28.748650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842947067:8367], now have 1 active actors on pipe
2025-10-10T14:34:28.748658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601437060723617:8123]
2025-10-10T14:34:28.748661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601437060723617:8123]
2025-10-10T14:34:28.748663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601437060723617:8123]
2025-10-10T14:34:28.748679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:28.748695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:28.748715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:28.748725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:28.748754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601437060723617:8123]
2025-10-10T14:34:28.748757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:28.748736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1352
2025-10-10T14:34:28.748736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1352
2025-10-10T14:34:28.748829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:28.748841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:28.748844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:28.748851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:28.748928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.748944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.748980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d050480-8860927b-d4655140-7ddd02b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:28.748996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.749001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.749009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:28.749023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.749037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:28.749069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.749223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.749232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.749250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.749392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1353 partition: 0 MaxSeqNo: 40 sessionId: src_id|2d050480-8860927b-d4655140-7ddd02b0_0
2025-10-10T14:34:28.749816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43fc101-79569a34-b3b54f5d-65854ba9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2d050480-8860927b-d4655140-7ddd02b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:28.752550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d050480-8860927b-d4655140-7ddd02b0_0] Write session: try to update token
2025-10-10T14:34:28.752575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d050480-8860927b-d4655140-7ddd02b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:28.769071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:28.769099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:28.769103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:28.769105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:28.769116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601437060723617:8123]
2025-10-10T14:34:28.769121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601437060723617:8123]
2025-10-10T14:34:28.769126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601437060723617:8123]
2025-10-10T14:34:28.769178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:28.769178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:28.769186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:28.769191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:28.769194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.769196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:28.769373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:28.772361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId: src_id|2d050480-8860927b-d4655140-7ddd02b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:28.775090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:28.824299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601437842947078:2527]
2025-10-10T14:34:28.824577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1352, pipe: [1:7559601437842947078:2527]
2025-10-10T14:34:28.888941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:28.889400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.889426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.889487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842947078:2527], now have 1 active actors on pipe
2025-10-10T14:34:28.889803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:28.889850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:28.889876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601437842947078:2527]
2025-10-10T14:34:28.889910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:28.889917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:28.889974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1353 reason: error at write: Disconnected sessionId: src_id|2d050480-8860927b-d4655140-7ddd02b0_0
2025-10-10T14:34:28.890164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1353 sessionId: src_id|2d050480-8860927b-d4655140-7ddd02b0_0 is DEAD
2025-10-10T14:34:28.893612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d050480-8860927b-d4655140-7ddd02b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:28.893626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d050480-8860927b-d4655140-7ddd02b0_0] Write session will restart in 0.008172s
2025-10-10T14:34:28.893652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d050480-8860927b-d4655140-7ddd02b0_0] Write session: Do CDS request
2025-10-10T14:34:28.893659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d050480-8860927b-d4655140-7ddd02b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:28.902873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d050480-8860927b-d4655140-7ddd02b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.903007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:28.903027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1354
2025-10-10T14:34:28.903157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:28.903195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:28.903208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:28.903217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:28.903692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1354 sessionId:  describe result for acl check
2025-10-10T14:34:28.903733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:28.903740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:28.903742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:28.903748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601437842947228:8371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:28.904323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601437842947228:8371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:28.905380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:28.907609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601437842947228:8371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:28.908323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:28.908540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:28.908545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:28.908556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:28.908607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:28.908643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601437060723809:8125]
2025-10-10T14:34:28.909266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:28.909609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:28.909656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:28.909991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:28.910059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.910066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.910067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.910069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.910070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.910071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.910073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.910074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.910076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.910077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.910078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.910079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.910080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.910086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.910099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.910104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.910108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.910112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.910117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.910121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.910125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.910130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.910135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.910139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.910143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.910147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.910160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.910169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:28.910176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.910182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:28.910193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.910199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:28.910204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.910210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:28.910216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.910221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:28.910226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.910233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:28.910238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.910244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:28.910249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.910254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:28.910259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.910265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:28.910269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.910275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:28.910282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.910287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.910296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.910302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.910307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.910312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.910354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:28.912619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601437842947228:8371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:28.912637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601437842947228:8371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:28.912641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601437842947228:8371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:28.912651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:28.913042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:28.913401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:28.913418Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:28.913420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:28.913424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:28.913431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1353 [2:7559601437060723809:8125]
2025-10-10T14:34:28.913443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:28.913463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:28.913466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.913469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.913472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.913489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:28.913502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:28.913509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:28.913572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.913579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.913581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.913584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:28.913650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:28.913658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.913671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:28.913699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:28.913727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:28.913750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601437060723804:8125]
2025-10-10T14:34:28.913757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601437060723804:8125]
2025-10-10T14:34:28.913759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601437060723804:8125]
2025-10-10T14:34:28.913768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:28.913779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:28.913782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:28.913787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:28.913790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:28.913801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:28.913804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:28.913815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842947080:2438], now have 1 active actors on pipe
2025-10-10T14:34:28.913823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842947264:8371], now have 1 active actors on pipe
2025-10-10T14:34:28.913846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601437060723804:8125]
2025-10-10T14:34:28.913837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1353
2025-10-10T14:34:28.913859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:28.913867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:28.913873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1353
2025-10-10T14:34:28.914023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.914033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.914064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9081a519-2871074c-8367d103-457e335e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:28.914076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:28.914081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:28.914088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:28.914100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:28.914117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:28.914137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.914397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:28.914409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:28.914433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:28.914531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1354 partition: 0 MaxSeqNo: 40 sessionId: src_id|9081a519-2871074c-8367d103-457e335e_0
2025-10-10T14:34:28.914929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d050480-8860927b-d4655140-7ddd02b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9081a519-2871074c-8367d103-457e335e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:28.917451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9081a519-2871074c-8367d103-457e335e_0] Write session: try to update token
2025-10-10T14:34:28.917468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9081a519-2871074c-8367d103-457e335e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:28.931543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId: src_id|9081a519-2871074c-8367d103-457e335e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:28.934500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:28.934148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:28.934168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:28.934172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:28.934174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:28.934183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601437060723804:8125]
2025-10-10T14:34:28.934189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601437060723804:8125]
2025-10-10T14:34:28.934193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601437060723804:8125]
2025-10-10T14:34:28.934248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:28.934258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:28.934260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:28.934263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:28.934271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:28.934278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:28.934416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:28.993667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601437842947271:2527]
2025-10-10T14:34:28.994047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1353, pipe: [1:7559601437842947271:2527]
2025-10-10T14:34:29.050787Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:29.051366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.051379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.051427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601437842947271:2527], now have 1 active actors on pipe
2025-10-10T14:34:29.051672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:29.052109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601437842947271:2527]
2025-10-10T14:34:29.052123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:29.052158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:29.052242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1354 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9081a519-2871074c-8367d103-457e335e_0
2025-10-10T14:34:29.052459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1354 sessionId: src_id|9081a519-2871074c-8367d103-457e335e_0 is DEAD
2025-10-10T14:34:29.054191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9081a519-2871074c-8367d103-457e335e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:29.054206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9081a519-2871074c-8367d103-457e335e_0] Write session will restart in 0.008349s
2025-10-10T14:34:29.054232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9081a519-2871074c-8367d103-457e335e_0] Write session: Do CDS request
2025-10-10T14:34:29.054237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9081a519-2871074c-8367d103-457e335e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:29.063969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9081a519-2871074c-8367d103-457e335e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.065471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:29.065493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1355
2025-10-10T14:34:29.065673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.065711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:29.065718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:29.065722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:29.066211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1355 sessionId:  describe result for acl check
2025-10-10T14:34:29.066264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:29.066274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:29.066276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:29.066283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601442137914717:8375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:29.066885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601442137914717:8375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:29.068463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:29.069358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601442137914717:8375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:29.071082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:29.071386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:29.071398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:29.071410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:29.071469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:29.071511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601441355691293:8127]
2025-10-10T14:34:29.072219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:29.072367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601442137914717:8375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:29.072386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601442137914717:8375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:29.072390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601442137914717:8375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:29.072399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:29.072517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:29.072564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:29.072889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:29.073182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.073190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.073191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.073193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.073194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.073196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.073197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.073199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.073200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.073202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.073203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.073205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.073206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.073214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.073229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.073234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.073239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.073243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.073248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.073252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.073256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.073261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.073266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.073270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.073275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.073279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.073288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.073303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.073312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.073319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.073327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.073354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.073364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.073370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.073376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.073384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.073389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.073395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.073400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.073405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.073410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.073416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.073441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.073453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.073458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.073464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.073468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.073473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.073476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.073481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.073484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.073489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.073531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:29.076251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:29.076573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:29.076584Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:29.076587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:29.076591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:29.076598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1354 [2:7559601441355691293:8127]
2025-10-10T14:34:29.076614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:29.076643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:29.076651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.076656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.076658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.076678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:29.076690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:29.076699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:29.076770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.076777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.076779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.076782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:29.076859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:29.076867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.076880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.076897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.076920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:29.076950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137914751:8375], now have 1 active actors on pipe
2025-10-10T14:34:29.076953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137914569:2438], now have 1 active actors on pipe
2025-10-10T14:34:29.076962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601441355691288:8127]
2025-10-10T14:34:29.076964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601441355691288:8127]
2025-10-10T14:34:29.076967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601441355691288:8127]
2025-10-10T14:34:29.076982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:29.076997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:29.077011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:29.077013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:29.077016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:29.077023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:29.077025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:29.077048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601441355691288:8127]
2025-10-10T14:34:29.077057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:29.077042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1354
2025-10-10T14:34:29.077074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:29.077090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.077095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.077127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:29.077135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.077145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.077148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:29.077160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.077143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1354
2025-10-10T14:34:29.077177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:29.077204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.077379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.077398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.077416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.077520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1355 partition: 0 MaxSeqNo: 40 sessionId: src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0
2025-10-10T14:34:29.077932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9081a519-2871074c-8367d103-457e335e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:29.080781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0] Write session: try to update token
2025-10-10T14:34:29.080800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:29.097232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId: src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:29.099425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:29.099442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:29.099446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:29.099448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:29.099459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601441355691288:8127]
2025-10-10T14:34:29.099463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601441355691288:8127]
2025-10-10T14:34:29.099467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601441355691288:8127]
2025-10-10T14:34:29.099523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:29.099536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.099538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:29.099543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:29.099550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:29.099555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:29.099678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:29.099986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:29.151942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601442137914760:2527]
2025-10-10T14:34:29.152273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1354, pipe: [1:7559601442137914760:2527]
2025-10-10T14:34:29.214312Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:29.214638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.214652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.214700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137914760:2527], now have 1 active actors on pipe
2025-10-10T14:34:29.214977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:29.215049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601442137914760:2527]
2025-10-10T14:34:29.215077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:29.215172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1355 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0
2025-10-10T14:34:29.214943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:29.215398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1355 sessionId: src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0 is DEAD
2025-10-10T14:34:29.215549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:29.215559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0] Write session will restart in 0.009824s
2025-10-10T14:34:29.215596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0] Write session: Do CDS request
2025-10-10T14:34:29.215602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:29.226950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.227035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:29.227069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1356
2025-10-10T14:34:29.227255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.227304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:29.227313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:29.227317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:29.227812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1356 sessionId:  describe result for acl check
2025-10-10T14:34:29.227854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:29.227861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:29.227863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:29.227881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601442137914820:8385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:29.228461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601442137914820:8385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:29.231167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601442137914820:8385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:29.234708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601442137914820:8385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:29.234726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601442137914820:8385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:29.234731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601442137914820:8385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:29.234740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:29.235233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:29.237325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:29.237569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:29.237579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:29.237592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:29.237651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:29.237694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601441355691514:8140]
2025-10-10T14:34:29.238325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:29.238623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:29.238682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:29.239016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:29.239075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.239083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.239084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.239085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.239086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.239087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.239088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.239089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.239091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.239092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.239093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.239094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.239095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.239101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.239113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.239117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.239121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.239124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.239128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.239132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.239136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.239148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.239152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.239156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.239160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.239163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.239170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.239178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.239185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.239190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.239195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.239201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.239205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.239211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.239215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.239220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.239225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.239230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.239234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.239240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.239244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.239250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.239254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.239259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.239263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.239269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.239273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.239279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.239283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.239288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.239293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.239298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.239338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:29.241683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:29.242008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:29.242018Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:29.242021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:29.242025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:29.242032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1355 [2:7559601441355691514:8140]
2025-10-10T14:34:29.242045Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:29.242063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:29.242070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.242074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.242087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.242106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:29.242113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:29.242121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:29.242185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.242192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.242194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.242196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:29.242400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:29.242409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.242392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1355
2025-10-10T14:34:29.242421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.242394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1355
2025-10-10T14:34:29.242439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.242463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:29.242491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137914954:8385], now have 1 active actors on pipe
2025-10-10T14:34:29.242500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137914775:2438], now have 1 active actors on pipe
2025-10-10T14:34:29.242515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.242525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.242550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601441355691509:8140]
2025-10-10T14:34:29.242560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601441355691509:8140]
2025-10-10T14:34:29.242562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601441355691509:8140]
2025-10-10T14:34:29.242575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:29.242588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:29.242599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:29.242602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:29.242604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:29.242606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:29.242610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:29.242629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b76c8db6-da98d2bf-459cde83-674aadda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:29.242637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.242645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.242649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:29.242661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.242671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:29.242718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601441355691509:8140]
2025-10-10T14:34:29.242731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:29.242739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:29.242746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.242902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.242911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.242926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.243027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1356 partition: 0 MaxSeqNo: 40 sessionId: src_id|b76c8db6-da98d2bf-459cde83-674aadda_0
2025-10-10T14:34:29.243442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7a41ad-6a941b3b-f3579db9-c0264fb8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b76c8db6-da98d2bf-459cde83-674aadda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:29.246260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76c8db6-da98d2bf-459cde83-674aadda_0] Write session: try to update token
2025-10-10T14:34:29.246278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76c8db6-da98d2bf-459cde83-674aadda_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:29.262677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:29.262694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:29.262698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:29.262701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:29.262711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601441355691509:8140]
2025-10-10T14:34:29.262716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601441355691509:8140]
2025-10-10T14:34:29.262720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601441355691509:8140]
2025-10-10T14:34:29.262775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:29.262778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:29.262786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.262790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:29.262801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:29.262806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:29.262966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:29.263775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId: src_id|b76c8db6-da98d2bf-459cde83-674aadda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:29.266504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:29.315468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601442137914978:2527]
2025-10-10T14:34:29.316422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1355, pipe: [1:7559601442137914978:2527]
2025-10-10T14:34:29.385774Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:29.386166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.386178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.386226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137914978:2527], now have 1 active actors on pipe
2025-10-10T14:34:29.386745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:29.393514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76c8db6-da98d2bf-459cde83-674aadda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:29.393532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76c8db6-da98d2bf-459cde83-674aadda_0] Write session will restart in 0.009434s
2025-10-10T14:34:29.393559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76c8db6-da98d2bf-459cde83-674aadda_0] Write session: Do CDS request
2025-10-10T14:34:29.393566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76c8db6-da98d2bf-459cde83-674aadda_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:29.392699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:29.392806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1356 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b76c8db6-da98d2bf-459cde83-674aadda_0
2025-10-10T14:34:29.393014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1356 sessionId: src_id|b76c8db6-da98d2bf-459cde83-674aadda_0 is DEAD
2025-10-10T14:34:29.393262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601442137914978:2527]
2025-10-10T14:34:29.393285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:29.405811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b76c8db6-da98d2bf-459cde83-674aadda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.407016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:29.407033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1357
2025-10-10T14:34:29.407196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.407240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:29.407245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:29.407251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:29.407807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1357 sessionId:  describe result for acl check
2025-10-10T14:34:29.407857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:29.407859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:29.407861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:29.407868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601442137915072:8392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:29.408527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601442137915072:8392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:29.411340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601442137915072:8392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:29.418388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601442137915072:8392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:29.418408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601442137915072:8392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:29.418412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601442137915072:8392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:29.418420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:29.418665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:29.421855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:29.422111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:29.422123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:29.422136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:29.422202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:29.422254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601441355691711:8144]
2025-10-10T14:34:29.422910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:29.423233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:29.423283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:29.423625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:29.423682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.423689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.423691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.423692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.423694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.423695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.423696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.423698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.423699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.423701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.423703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.423704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.423705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.423711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.423726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.423730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.423735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.423739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.423744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.423749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.423753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.423758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.423763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.423768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.423772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.423780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.423788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.423799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.423811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.423817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.423827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.423833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.423842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.423852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.423858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.423865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.423870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.423880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.423885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.423891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.423896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.423902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.423912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.423918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.423923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.423930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.423935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.423941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.423950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.423956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.423966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.423972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.424022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:29.426602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:29.427200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:29.427217Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:29.427219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:29.427223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:29.427230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1356 [2:7559601441355691711:8144]
2025-10-10T14:34:29.427243Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:29.427262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:29.427266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.427270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.427273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.427305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:29.427317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:29.427325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:29.427388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.427395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.427396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.427399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:29.427470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:29.427479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.427491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.427505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.427523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:29.427545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137914982:2438], now have 1 active actors on pipe
2025-10-10T14:34:29.427560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601441355691704:8144]
2025-10-10T14:34:29.427564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601441355691704:8144]
2025-10-10T14:34:29.427567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601441355691704:8144]
2025-10-10T14:34:29.427580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:29.427589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915161:8392], now have 1 active actors on pipe
2025-10-10T14:34:29.427595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:29.427599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:29.427601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:29.427603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:29.427619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:29.427622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:29.427642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1356
2025-10-10T14:34:29.427650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601441355691704:8144]
2025-10-10T14:34:29.427643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1356
2025-10-10T14:34:29.427660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:29.427684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:29.427701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.427706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.427741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:29.427757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.427761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.427764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:29.427775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.427786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:29.427802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.427976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.427985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.428000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.428099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1357 partition: 0 MaxSeqNo: 40 sessionId: src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0
2025-10-10T14:34:29.428530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b76c8db6-da98d2bf-459cde83-674aadda_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:29.431217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0] Write session: try to update token
2025-10-10T14:34:29.431237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:29.439729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:29.439747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:29.439758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601441355691704:8144]
2025-10-10T14:34:29.439815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:29.439836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:29.440009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:29.440162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:29.440299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:29.440436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:29.440617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:29.440663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:29.448457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId: src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:29.451134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:29.453550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.453571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.453624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:29.453738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:29.458726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:29.458750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:29.458753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:29.458755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:29.458766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601441355691704:8144]
2025-10-10T14:34:29.458771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601441355691704:8144]
2025-10-10T14:34:29.458775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601441355691704:8144]
2025-10-10T14:34:29.458828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:29.458833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:29.458839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:29.458842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.458843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:29.458844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:29.458985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:29.493451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601442137915173:2527]
2025-10-10T14:34:29.494701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1356, pipe: [1:7559601442137915173:2527]
2025-10-10T14:34:29.578467Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:29.587307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.587335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.587522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.587587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.587652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.587716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.587762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.587766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.587847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.587907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.587970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.588051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.588098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.588102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.588176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.588241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.588307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.588370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.588411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.588417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.588488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.588550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.588609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.588676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.588716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.588719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.588791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.588865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.588927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.588995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.589046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.589049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.589121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.589182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.589251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.589315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.589568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.589578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.589649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.589714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.589788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.589852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.589904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.589912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.589989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.590060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.590133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.591218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:29.591247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601442137915173:2527]
2025-10-10T14:34:29.590201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.591277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:29.591289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:29.590249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.590252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.590322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.590376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.590437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.590505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.590551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.590554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.590629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:29.590688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:29.590753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:29.590818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:29.591318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1357 reason: error at write: Disconnected sessionId: src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0
2025-10-10T14:34:29.590861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:29.590864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:29.590942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915173:2527], now have 1 active actors on pipe
2025-10-10T14:34:29.591562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1357 sessionId: src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0 is DEAD
2025-10-10T14:34:29.592202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:29.593640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:29.593653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0] Write session will restart in 0.005692s
2025-10-10T14:34:29.593679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0] Write session: Do CDS request
2025-10-10T14:34:29.593686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:29.601953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.602103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:29.602123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1358
2025-10-10T14:34:29.605712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.605772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:29.605784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:29.605789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:29.606333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1358 sessionId:  describe result for acl check
2025-10-10T14:34:29.606390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:29.606397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:29.606399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:29.606407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601442137915243:8397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:29.607003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601442137915243:8397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:29.610879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601442137915243:8397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:29.614042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601442137915243:8397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:29.614061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601442137915243:8397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:29.614065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601442137915243:8397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:29.614074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:29.615418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:29.618160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:29.618396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:29.618407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:29.618419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:29.618475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:29.618517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601441355691914:8147]
2025-10-10T14:34:29.619072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:29.619429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:29.619495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:29.619835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:29.619907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.619923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.619924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.619925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.619927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.619928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.619929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.619930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.619931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.619933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.619934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.619935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.619936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.619943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.619957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.619961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.619966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.619970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.619973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.619976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.619980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.619984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.619987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.619990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.619994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.619997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.620007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.620015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.620033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.620038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.620043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.620048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.620052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.620057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.620062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.620067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.620070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.620075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.620079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.620084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.620089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.620094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.620099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.620103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.620108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.620113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.620119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.620124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.620139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.620144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.620149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.620154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.620190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:29.622698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:29.623043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:29.623056Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:29.623059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:29.623062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:29.623069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1357 [2:7559601441355691914:8147]
2025-10-10T14:34:29.623084Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:29.623102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:29.623111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.623115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.623117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.623134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:29.623141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:29.623149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:29.623211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.623222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.623224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.623227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:29.623302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:29.623313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.623325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.623337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.623353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:29.623377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915188:2438], now have 1 active actors on pipe
2025-10-10T14:34:29.623381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915372:8397], now have 1 active actors on pipe
2025-10-10T14:34:29.623390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601441355691909:8147]
2025-10-10T14:34:29.623392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601441355691909:8147]
2025-10-10T14:34:29.623395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601441355691909:8147]
2025-10-10T14:34:29.623410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:29.623433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:29.623438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:29.623444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:29.623446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:29.623456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:29.623466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:29.623494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601441355691909:8147]
2025-10-10T14:34:29.623503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:29.623508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:29.623451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1357
2025-10-10T14:34:29.623497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1357
2025-10-10T14:34:29.623594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.623605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.623636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:29.623645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.623650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.623652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:29.623664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.623676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:29.623690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.623897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.623907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.623927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.624037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1358 partition: 0 MaxSeqNo: 40 sessionId: src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0
2025-10-10T14:34:29.624502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a80e00dd-99c6c43d-d602a733-a9ecaadb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:29.627315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0] Write session: try to update token
2025-10-10T14:34:29.627336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:29.645583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:29.645600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:29.645604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:29.645606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:29.645617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601441355691909:8147]
2025-10-10T14:34:29.645623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601441355691909:8147]
2025-10-10T14:34:29.645627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601441355691909:8147]
2025-10-10T14:34:29.645681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:29.645689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.645691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:29.645800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:29.645811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:29.645816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:29.645841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:29.656236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId: src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:29.658834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:29.691090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601442137915393:2527]
2025-10-10T14:34:29.691545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1357, pipe: [1:7559601442137915393:2527]
2025-10-10T14:34:29.759352Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:29.759813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.759832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.759877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915393:2527], now have 1 active actors on pipe
2025-10-10T14:34:29.760125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:29.760453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601442137915393:2527]
2025-10-10T14:34:29.760484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:29.760532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:29.760609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1358 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0
2025-10-10T14:34:29.760832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1358 sessionId: src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0 is DEAD
2025-10-10T14:34:29.760999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:29.761011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0] Write session will restart in 0.008907s
2025-10-10T14:34:29.761037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0] Write session: Do CDS request
2025-10-10T14:34:29.761044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:29.770909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.771025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:29.771045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1359
2025-10-10T14:34:29.771154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.771197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:29.771209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:29.771212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:29.771683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1359 sessionId:  describe result for acl check
2025-10-10T14:34:29.771726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:29.771733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:29.771735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:29.771740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601442137915403:8402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:29.772326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601442137915403:8402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:29.774555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601442137915403:8402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:29.779182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601442137915403:8402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:29.779202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601442137915403:8402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:29.779206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601442137915403:8402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:29.779215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:29.782317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:29.784556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:29.784772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:29.784784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:29.784796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:29.784850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:29.784895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601441355692108:8150]
2025-10-10T14:34:29.785559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:29.785913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:29.785973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:29.786362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:29.786438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.786445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.786446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.786448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.786449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.786451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.786453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.786455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.786456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.786457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.786459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.786460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.786462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.786469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.786484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.786489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.786494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.786498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.786503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.786507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.786512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.786517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.786522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.786526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.786530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.786535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.786544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.786561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.786573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.786580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.786587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.786599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.786604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.786610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.786615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.786624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.786629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.786635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.786640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.786646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.786651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.786657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.786663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.786669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.786674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.786680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.786685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.786691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.786696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.786703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.786707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.786712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.786755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:29.789272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:29.789647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:29.789660Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:29.789663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:29.789667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:29.789674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1358 [2:7559601441355692108:8150]
2025-10-10T14:34:29.789688Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:29.789707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:29.789711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.789716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.789718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.789734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:29.789752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:29.789765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:29.789827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.789834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.789836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.789839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:29.789981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:29.789991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.790002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.790013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.790037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:29.790063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915394:2438], now have 1 active actors on pipe
2025-10-10T14:34:29.790071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915529:8402], now have 1 active actors on pipe
2025-10-10T14:34:29.790080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601441355692103:8150]
2025-10-10T14:34:29.790082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601441355692103:8150]
2025-10-10T14:34:29.790085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601441355692103:8150]
2025-10-10T14:34:29.790068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1358
2025-10-10T14:34:29.790164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1358
2025-10-10T14:34:29.790099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:29.790120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:29.790125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:29.790128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:29.790130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:29.790137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:29.790140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:29.790179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.790184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.790199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601441355692103:8150]
2025-10-10T14:34:29.790210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:29.790227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:29.790242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e222d70-9833e1eb-56603143-21ec99c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:29.790250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.790254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.790257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:29.790269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.790281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:29.790312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.790516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.790526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.790545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.790647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1359 partition: 0 MaxSeqNo: 40 sessionId: src_id|5e222d70-9833e1eb-56603143-21ec99c0_0
2025-10-10T14:34:29.791086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2f89a6-65776f4d-1d4905c2-b373db0a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5e222d70-9833e1eb-56603143-21ec99c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:29.793848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e222d70-9833e1eb-56603143-21ec99c0_0] Write session: try to update token
2025-10-10T14:34:29.793868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e222d70-9833e1eb-56603143-21ec99c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:29.808713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId: src_id|5e222d70-9833e1eb-56603143-21ec99c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:29.811810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:29.812696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.812720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.812744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:29.812747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:29.812751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:29.812753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:29.812761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601441355692103:8150]
2025-10-10T14:34:29.812766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601441355692103:8150]
2025-10-10T14:34:29.812769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601441355692103:8150]
2025-10-10T14:34:29.812818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:29.812830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:29.812830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:29.812834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:29.812835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.812837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:29.812976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:29.860536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601442137915590:2527]
2025-10-10T14:34:29.860809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1358, pipe: [1:7559601442137915590:2527]
2025-10-10T14:34:29.927882Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:29.928408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:29.928478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915590:2527], now have 1 active actors on pipe
2025-10-10T14:34:29.928584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:29.928706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:29.928762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601442137915590:2527]
2025-10-10T14:34:29.928788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:29.928791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:29.928811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1359 reason: error at write: Disconnected sessionId: src_id|5e222d70-9833e1eb-56603143-21ec99c0_0
2025-10-10T14:34:29.929035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1359 sessionId: src_id|5e222d70-9833e1eb-56603143-21ec99c0_0 is DEAD
2025-10-10T14:34:29.929148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e222d70-9833e1eb-56603143-21ec99c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:29.929162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e222d70-9833e1eb-56603143-21ec99c0_0] Write session will restart in 0.006791s
2025-10-10T14:34:29.929187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e222d70-9833e1eb-56603143-21ec99c0_0] Write session: Do CDS request
2025-10-10T14:34:29.929194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e222d70-9833e1eb-56603143-21ec99c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:29.936882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e222d70-9833e1eb-56603143-21ec99c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.936965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:29.936986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1360
2025-10-10T14:34:29.937098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:29.937135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:29.937155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:29.937164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:29.937651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1360 sessionId:  describe result for acl check
2025-10-10T14:34:29.937694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:29.937705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:29.937707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:29.937715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601442137915613:8406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:29.938327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601442137915613:8406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:29.941649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601442137915613:8406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:29.945602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601442137915613:8406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:29.945619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601442137915613:8406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:29.945624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601442137915613:8406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:29.945633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:29.946764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:29.949051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:29.949288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:29.949298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:29.949310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:29.949382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:29.949421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601441355692301:8152]
2025-10-10T14:34:29.950029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:29.950476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:29.950553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:29.950886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:29.950965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.950966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.950967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.950969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.950970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.950971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.950972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.950974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.950975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.950976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.950976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.950977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.950978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.950986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.950999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.951002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.951006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.951010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.951013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.951016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.951020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.951023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.951028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.951031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.951035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.951039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.951049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.951058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:29.951065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.951070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:29.951074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.951078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:29.951082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.951100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:29.951104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.951109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:29.951113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.951119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:29.951123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.951127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:29.951131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.951136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:29.951141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.951145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:29.951149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.951153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:29.951157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.951161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.951165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.951169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.951174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.951178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.951219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:29.953790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:29.954193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:29.954205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:29.954207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:29.954211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:29.954218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1359 [2:7559601441355692301:8152]
2025-10-10T14:34:29.954232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:29.954250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:29.954265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.954273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.954276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.954294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:29.954312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:29.954319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:29.954379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.954387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.954389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.954392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:29.954454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:29.954459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.954467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:29.954476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:29.954491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:29.954517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601441355692296:8152]
2025-10-10T14:34:29.954523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601441355692296:8152]
2025-10-10T14:34:29.954524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601441355692296:8152]
2025-10-10T14:34:29.954537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:29.954551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:29.954552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915591:2438], now have 1 active actors on pipe
2025-10-10T14:34:29.954556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601442137915772:8406], now have 1 active actors on pipe
2025-10-10T14:34:29.954560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:29.954563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:29.954565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:29.954581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:29.954584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:29.954608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601441355692296:8152]
2025-10-10T14:34:29.954621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:29.954624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:29.954608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1359
2025-10-10T14:34:29.954658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1359
2025-10-10T14:34:29.954779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.954798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.954830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:29.954846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:29.954850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:29.954852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:29.954864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:29.954873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:29.954885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.955053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:29.955061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:29.955078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:29.955157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1360 partition: 0 MaxSeqNo: 40 sessionId: src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0
2025-10-10T14:34:29.955587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e222d70-9833e1eb-56603143-21ec99c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:29.958358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0] Write session: try to update token
2025-10-10T14:34:29.958379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:29.975455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:29.975474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:29.975477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:29.975479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:29.975491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601441355692296:8152]
2025-10-10T14:34:29.975496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601441355692296:8152]
2025-10-10T14:34:29.975500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601441355692296:8152]
2025-10-10T14:34:29.975557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:29.975566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:29.975569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:29.975575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:29.975576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:29.975580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:29.975719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:29.977776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId: src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:29.980466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:30.029020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601446432883084:2527]
2025-10-10T14:34:30.029276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1359, pipe: [1:7559601446432883084:2527]
2025-10-10T14:34:30.092467Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:30.092915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.092935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.092995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883084:2527], now have 1 active actors on pipe
2025-10-10T14:34:30.093244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601446432883084:2527]
2025-10-10T14:34:30.093279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:30.093254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:30.093316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:30.093347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:30.093793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:30.093809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0] Write session will restart in 0.007576s
2025-10-10T14:34:30.093844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0] Write session: Do CDS request
2025-10-10T14:34:30.093850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:30.093410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1360 reason: error at write: Disconnected sessionId: src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0
2025-10-10T14:34:30.093628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1360 sessionId: src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0 is DEAD
2025-10-10T14:34:30.102948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.103143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:30.103161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1361
2025-10-10T14:34:30.103322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.103380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:30.103392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:30.103396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:30.103956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1361 sessionId:  describe result for acl check
2025-10-10T14:34:30.104018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:30.104028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:30.104030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:30.104039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601446432883136:8410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:30.104609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601446432883136:8410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:30.106971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601446432883136:8410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:30.109302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:30.109497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601446432883136:8410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:30.109511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601446432883136:8410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:30.109514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601446432883136:8410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:30.109522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:30.111441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:30.111662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:30.111676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:30.111691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:30.111766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:30.111810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601445650659791:8154]
2025-10-10T14:34:30.112432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:30.112727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:30.112774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:30.113085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:30.113136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.113142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.113144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.113145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.113146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.113147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.113149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.113150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.113151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.113152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.113154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.113155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.113156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.113161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.113175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.113179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.113183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.113187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.113190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.113194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.113198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.113202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.113206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.113210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.113214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.113218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.113225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.113233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.113239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.113245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.113249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.113255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.113259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.113264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.113269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.113274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.113279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.113284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.113289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.113294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.113298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.113304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.113310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.113315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.113320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.113325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.113346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.113358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.113362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.113369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.113377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.113382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.113423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:30.115823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:30.116188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:30.116200Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:30.116203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:30.116207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:30.116214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1360 [2:7559601445650659791:8154]
2025-10-10T14:34:30.116227Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:30.116250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:30.116259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.116262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.116265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.116282Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:30.116293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:30.116306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:30.116360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.116367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.116369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.116372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:30.116615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1360
2025-10-10T14:34:30.116666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1360
2025-10-10T14:34:30.116444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:30.116454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.116466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.116479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.116495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:30.116517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883270:8410], now have 1 active actors on pipe
2025-10-10T14:34:30.116520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883085:2438], now have 1 active actors on pipe
2025-10-10T14:34:30.116528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601445650659785:8154]
2025-10-10T14:34:30.116530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601445650659785:8154]
2025-10-10T14:34:30.116533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601445650659785:8154]
2025-10-10T14:34:30.116548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:30.116565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:30.116569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:30.116571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:30.116573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:30.116589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:30.116592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:30.116613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601445650659785:8154]
2025-10-10T14:34:30.116621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:30.116624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:30.116649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.116654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.116686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c73f1d1-18717030-fe44c902-a706131a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:30.116692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.116696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.116698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:30.116709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.116718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:30.116729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.116967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.116974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.116989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.117075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1361 partition: 0 MaxSeqNo: 40 sessionId: src_id|c73f1d1-18717030-fe44c902-a706131a_0
2025-10-10T14:34:30.117513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79dcf536-f4dfa817-2ee6e519-eac72431_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c73f1d1-18717030-fe44c902-a706131a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:30.120171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f1d1-18717030-fe44c902-a706131a_0] Write session: try to update token
2025-10-10T14:34:30.120190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f1d1-18717030-fe44c902-a706131a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:30.131902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:34:30.131934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-10-10T14:34:30.132259Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:34:30.132545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 7 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:34:30.132594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:34:30.138873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId: src_id|c73f1d1-18717030-fe44c902-a706131a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:30.141574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:30.142514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.142536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.142562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:30.142565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:30.142569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:30.142571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:30.142580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601445650659785:8154]
2025-10-10T14:34:30.142585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601445650659785:8154]
2025-10-10T14:34:30.142589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601445650659785:8154]
2025-10-10T14:34:30.142632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:30.142645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:30.142650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:30.142652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:30.142661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.142664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:30.142814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:30.193366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601446432883287:2527]
2025-10-10T14:34:30.193730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1360, pipe: [1:7559601446432883287:2527]
2025-10-10T14:34:30.259089Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:30.259572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:30.259639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883287:2527], now have 1 active actors on pipe
2025-10-10T14:34:30.259718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:30.271486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601446432883287:2527]
2025-10-10T14:34:30.271530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:30.271541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-10T14:34:30.271638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:30.271649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:30.271674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1361 reason: error at write: Disconnected sessionId: src_id|c73f1d1-18717030-fe44c902-a706131a_0
2025-10-10T14:34:30.271839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1361 sessionId: src_id|c73f1d1-18717030-fe44c902-a706131a_0 is DEAD
2025-10-10T14:34:30.271976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f1d1-18717030-fe44c902-a706131a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:30.271989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f1d1-18717030-fe44c902-a706131a_0] Write session will restart in 0.009014s
2025-10-10T14:34:30.272032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f1d1-18717030-fe44c902-a706131a_0] Write session: Do CDS request
2025-10-10T14:34:30.272041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f1d1-18717030-fe44c902-a706131a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:30.281992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f1d1-18717030-fe44c902-a706131a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.282528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:30.282553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1362
2025-10-10T14:34:30.282792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.282833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:30.282838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:30.282843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:30.283275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1362 sessionId:  describe result for acl check
2025-10-10T14:34:30.283308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:30.283310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:30.283311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:30.283318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601446432883458:8420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:30.283878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601446432883458:8420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:30.285481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:30.286322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601446432883458:8420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:30.288476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:30.288714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:30.288727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:30.288741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:30.288805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:30.288847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601445650660017:8168]
2025-10-10T14:34:30.289497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:30.290096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:30.290174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:30.290518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601446432883458:8420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:30.290535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601446432883458:8420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:30.290539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601446432883458:8420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:30.290548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:30.290554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:30.290634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.290640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.290642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.290643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.290645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.290646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.290648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.290649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.290650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.290652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.290653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.290654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.290656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.290664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.290676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.290680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.290685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.290689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.290694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.290697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.290702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.290706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.290711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.290715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.290719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.290722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.290731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.290740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.290747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.290752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.290756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.290764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.290775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.290781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.290789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.290793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.290797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.290813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.290821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.290827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.290835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.290840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.290845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.290851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.290856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.290862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.290867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.290872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.290877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.290882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.290894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.290899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.290937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:30.293435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:30.293759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:30.293775Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:30.293777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:30.293781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:30.293787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1361 [2:7559601445650660017:8168]
2025-10-10T14:34:30.293800Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:30.293819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:30.293822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.293826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.293829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.293847Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:30.293862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:30.293870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:30.293935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.293943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.293945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.293947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:30.294016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:30.294028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.294039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.294051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.294068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:30.294091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601445650660012:8168]
2025-10-10T14:34:30.294098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601445650660012:8168]
2025-10-10T14:34:30.294100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601445650660012:8168]
2025-10-10T14:34:30.294113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:30.294131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883491:8420], now have 1 active actors on pipe
2025-10-10T14:34:30.294135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883347:2438], now have 1 active actors on pipe
2025-10-10T14:34:30.294146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:30.294167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:30.294174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:30.294207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1361
2025-10-10T14:34:30.294200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:30.294244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1361
2025-10-10T14:34:30.294202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601445650660012:8168]
2025-10-10T14:34:30.294205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:30.294216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:30.294219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:30.294226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:30.294472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.294487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.294537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:30.294547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.294552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.294554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:30.294566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.294579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:30.294630Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:34:30.294664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.294831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 8 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:34:30.294867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:34:30.294902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.294916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.294939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.295078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1362 partition: 0 MaxSeqNo: 40 sessionId: src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0
2025-10-10T14:34:30.295486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f1d1-18717030-fe44c902-a706131a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:30.298461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0] Write session: try to update token
2025-10-10T14:34:30.298483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:30.315440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:30.315460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:30.315464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:30.315470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:30.315481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601445650660012:8168]
2025-10-10T14:34:30.315486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601445650660012:8168]
2025-10-10T14:34:30.315490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601445650660012:8168]
2025-10-10T14:34:30.315551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:30.315560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.315563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:30.315735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:30.317397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:30.317415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:30.317420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:30.324239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId: src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:30.327134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:30.371783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601446432883515:2527]
2025-10-10T14:34:30.372249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1361, pipe: [1:7559601446432883515:2527]
2025-10-10T14:34:30.454170Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:30.454535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.454551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.454577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883515:2527], now have 1 active actors on pipe
2025-10-10T14:34:30.455017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:30.455589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:30.455602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0] Write session will restart in 0.008542s
2025-10-10T14:34:30.455040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:30.455058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:30.455140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1362 reason: error at write: Disconnected sessionId: src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0
2025-10-10T14:34:30.455371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1362 sessionId: src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0 is DEAD
2025-10-10T14:34:30.455630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0] Write session: Do CDS request
2025-10-10T14:34:30.455638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:30.455525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601446432883515:2527]
2025-10-10T14:34:30.455541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:30.465956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.466056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:30.466076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1363
2025-10-10T14:34:30.466258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.466319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:30.466347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:30.466356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:30.467006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1363 sessionId:  describe result for acl check
2025-10-10T14:34:30.467050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:30.467052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:30.467056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:30.467062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601446432883567:8427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:30.467659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601446432883567:8427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:30.472506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601446432883567:8427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:30.475438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:30.475831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601446432883567:8427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:30.475851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601446432883567:8427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:30.475855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601446432883567:8427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:30.475865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:30.478007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:30.478238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:30.478244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:30.478256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:30.478312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:30.478363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601445650660222:8173]
2025-10-10T14:34:30.478924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:30.479287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:30.479334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:30.479669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:30.479735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.479736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.479737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.479739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.479740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.479741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.479742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.479743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.479745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.479746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.479747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.479748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.479749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.479755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.479768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.479772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.479776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.479780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.479784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.479788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.479791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.479795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.479800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.479803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.479807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.479810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.479819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.479827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.479833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.479838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.479842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.479847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.479851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.479857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.479862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.479866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.479872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.479877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.479881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.479886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.479889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.479894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.479899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.479904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.479908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.479912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.479916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.479921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.479925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.479929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.479933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.479937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.479975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:30.487617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1362
2025-10-10T14:34:30.487627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1362
2025-10-10T14:34:30.486491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:30.487160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:30.487166Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:30.487168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:30.487172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:30.487180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1362 [2:7559601445650660222:8173]
2025-10-10T14:34:30.487197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:30.487217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:30.487221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.487225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.487228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.487246Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:30.487255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:30.487263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:30.487343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.487346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.487349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.487351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:30.487550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:30.487556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.487569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.487582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.487603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:30.487628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883708:8427], now have 1 active actors on pipe
2025-10-10T14:34:30.487632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883520:2438], now have 1 active actors on pipe
2025-10-10T14:34:30.487639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601445650660216:8173]
2025-10-10T14:34:30.487641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601445650660216:8173]
2025-10-10T14:34:30.487643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601445650660216:8173]
2025-10-10T14:34:30.487661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:30.487676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:30.487683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:30.487687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:30.487689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:30.487693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:30.487696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:30.487735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601445650660216:8173]
2025-10-10T14:34:30.487742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:30.487748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:30.487763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.487768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.487825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:30.487838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.487843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.487846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:30.487858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.487869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:30.487891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.488225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.488233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.488252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.488369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1363 partition: 0 MaxSeqNo: 40 sessionId: src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0
2025-10-10T14:34:30.488801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ebe4a0-4239317e-e41ed3b7-1d114496_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:30.491443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0] Write session: try to update token
2025-10-10T14:34:30.491463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:30.509752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:30.509772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:30.509775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:30.509777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:30.509786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601445650660216:8173]
2025-10-10T14:34:30.509790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601445650660216:8173]
2025-10-10T14:34:30.509795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601445650660216:8173]
2025-10-10T14:34:30.509843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:30.509854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.509857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:30.509863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:30.509873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:30.509879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:30.510026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:30.511472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId: src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:30.514207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:30.555869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601446432883732:2527]
2025-10-10T14:34:30.556299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1362, pipe: [1:7559601446432883732:2527]
2025-10-10T14:34:30.634706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:30.635186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.635208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.635272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883732:2527], now have 1 active actors on pipe
2025-10-10T14:34:30.635591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:30.635635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:30.635655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:30.635676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601446432883732:2527]
2025-10-10T14:34:30.635699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:30.635743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1363 reason: error at write: Disconnected sessionId: src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0
2025-10-10T14:34:30.635998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1363 sessionId: src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0 is DEAD
2025-10-10T14:34:30.636167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:30.636182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0] Write session will restart in 0.006147s
2025-10-10T14:34:30.636210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0] Write session: Do CDS request
2025-10-10T14:34:30.636216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:30.643979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.644135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:30.644173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1364
2025-10-10T14:34:30.644399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.644440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:30.644454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:30.644459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:30.644981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1364 sessionId:  describe result for acl check
2025-10-10T14:34:30.645022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:30.645037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:30.645044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:30.645051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601446432883755:8433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:30.645787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601446432883755:8433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:30.648840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601446432883755:8433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:30.652559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601446432883755:8433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:30.652587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601446432883755:8433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:30.652591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601446432883755:8433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:30.652602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:30.657651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:30.660199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:30.660550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:30.660564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:30.660578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:30.660641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:30.660692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601445650660431:8176]
2025-10-10T14:34:30.661314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:30.661814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:30.661904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:30.662281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:30.662372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.662380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.662381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.662382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.662383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.662385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.662386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.662387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.662389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.662390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.662391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.662392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.662394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.662414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.662429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.662433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.662438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.662442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.662446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.662450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.662454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.662458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.662463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.662467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.662471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.662474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.662484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.662493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.662500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.662506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.662511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.662517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.662521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.662527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.662532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.662536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.662541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.662546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.662552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.662557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.662562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.662567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.662572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.662577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.662582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.662587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.662592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.662599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.662604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.662609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.662614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.662619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.662659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:30.665430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:30.666159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:30.666170Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:30.666174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:30.666178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:30.666184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1363 [2:7559601445650660431:8176]
2025-10-10T14:34:30.666198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:30.666216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:30.666221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.666224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.666227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.666245Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:30.666251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:30.666258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:30.666314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.666323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.666324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.666326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:30.666381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:30.666388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.666397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.666404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.666414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:30.666431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601445650660426:8176]
2025-10-10T14:34:30.666439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601445650660426:8176]
2025-10-10T14:34:30.666441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601445650660426:8176]
2025-10-10T14:34:30.666450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:30.666463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:30.666469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:30.666472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:30.666473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:30.666474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:30.666475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:30.666487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883739:2438], now have 1 active actors on pipe
2025-10-10T14:34:30.666489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883871:8433], now have 1 active actors on pipe
2025-10-10T14:34:30.666511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601445650660426:8176]
2025-10-10T14:34:30.666517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:30.666534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:30.666538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1363
2025-10-10T14:34:30.666600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1363
2025-10-10T14:34:30.666798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.666814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.666847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9950105a-f88dec89-6eb57d77-936feb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:30.666862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.666869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.666873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:30.666962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.666982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:30.667013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.667248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.667260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.667282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.667457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1364 partition: 0 MaxSeqNo: 40 sessionId: src_id|9950105a-f88dec89-6eb57d77-936feb3_0
2025-10-10T14:34:30.667904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729f9f3a-c9e8a282-3c200f6c-e63ea048_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9950105a-f88dec89-6eb57d77-936feb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:30.670797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9950105a-f88dec89-6eb57d77-936feb3_0] Write session: try to update token
2025-10-10T14:34:30.670819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9950105a-f88dec89-6eb57d77-936feb3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:30.681281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:30.681307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:30.681320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601445650660426:8176]
2025-10-10T14:34:30.681386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:30.681401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:30.681624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:30.681798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:30.681966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:30.682135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:30.682466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:30.682520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:30.693361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId: src_id|9950105a-f88dec89-6eb57d77-936feb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:30.696073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:30.696364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.696392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.696447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:30.697456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:30.706030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:30.706054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:30.706063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:30.706066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:30.706079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601445650660426:8176]
2025-10-10T14:34:30.706083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601445650660426:8176]
2025-10-10T14:34:30.706088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601445650660426:8176]
2025-10-10T14:34:30.706149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:30.706164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.706172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:30.706343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:30.709164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:30.709181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:30.709186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:30.735558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601446432883943:2527]
2025-10-10T14:34:30.735895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1363, pipe: [1:7559601446432883943:2527]
2025-10-10T14:34:30.834255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:30.845210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.845235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.845467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.845546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.845625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.845705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.846408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.846425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.846510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.846587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.846674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.846766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.846824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.846833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.846934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.847019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.847104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.847192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.847247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.847250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.847343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.847421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.847497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.847574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.847635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.847639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.847725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.847802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.847882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.847961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.848032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.848036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.848131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.848205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.848283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.848366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.848429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.848432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.848524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.848590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.848677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.848760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.848816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.848825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.848917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.848994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.849072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.849151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.849213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.849216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.849308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.849571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.849653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.849740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.849803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.849810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.849902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:30.849976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:30.850055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:30.850132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:30.850190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:30.850200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:30.850738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:30.850745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:30.850748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:30.850798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1364 reason: error at write: Disconnected sessionId: src_id|9950105a-f88dec89-6eb57d77-936feb3_0
2025-10-10T14:34:30.850826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601446432883943:2527]
2025-10-10T14:34:30.851034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1364 sessionId: src_id|9950105a-f88dec89-6eb57d77-936feb3_0 is DEAD
2025-10-10T14:34:30.851239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9950105a-f88dec89-6eb57d77-936feb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:30.851249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9950105a-f88dec89-6eb57d77-936feb3_0] Write session will restart in 0.009309s
2025-10-10T14:34:30.851274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9950105a-f88dec89-6eb57d77-936feb3_0] Write session: Do CDS request
2025-10-10T14:34:30.851280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9950105a-f88dec89-6eb57d77-936feb3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:30.850281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883943:2527], now have 1 active actors on pipe
2025-10-10T14:34:30.851292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:30.861924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9950105a-f88dec89-6eb57d77-936feb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.862004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:30.862023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1365
2025-10-10T14:34:30.862521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:30.862563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:30.862574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:30.862578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:30.863186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1365 sessionId:  describe result for acl check
2025-10-10T14:34:30.863243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:30.863245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:30.863247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:30.863254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601446432884010:8437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:30.863955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601446432884010:8437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:30.866850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601446432884010:8437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:30.870297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601446432884010:8437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:30.870316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601446432884010:8437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:30.870320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601446432884010:8437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:30.870330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:30.870531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:30.873209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:30.873510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:30.873528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:30.873547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:30.873622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:30.873675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601445650660633:8179]
2025-10-10T14:34:30.874287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:30.874680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:30.874744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:30.875050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:30.875326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.875337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.875338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.875339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.875340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.875341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.875342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.875344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.875345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.875346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.875347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.875348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.875349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.875374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.875387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.875391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.875395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.875398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.875402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.875405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.875409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.875412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.875416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.875420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.875423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.875427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.875436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.875445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:30.875453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.875457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:30.875462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.875467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:30.875470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.875475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:30.875479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.875484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:30.875488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.875492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:30.875499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.875503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:30.875508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.875512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:30.875519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.875524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:30.875527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.875532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:30.875535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.875540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.875544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.875548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.875552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.875556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.875590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:30.878637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:30.878993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:30.879012Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:30.879015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:30.879019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:30.879026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1364 [2:7559601445650660633:8179]
2025-10-10T14:34:30.879042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:30.879063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:30.879066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.879071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.879074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.879092Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:30.879108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:30.879121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:30.879194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.879202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.879204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.879207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:30.879285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:30.879295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.879308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:30.879325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:30.879347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:30.879375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432884135:8437], now have 1 active actors on pipe
2025-10-10T14:34:30.879387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432883946:2438], now have 1 active actors on pipe
2025-10-10T14:34:30.879396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601445650660627:8179]
2025-10-10T14:34:30.879405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601445650660627:8179]
2025-10-10T14:34:30.879408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601445650660627:8179]
2025-10-10T14:34:30.879426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:30.879440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:30.879444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:30.879444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:30.879447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:30.879460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:30.879464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:30.879501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601445650660627:8179]
2025-10-10T14:34:30.879517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:30.879459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1364
2025-10-10T14:34:30.879484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1364
2025-10-10T14:34:30.879536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.879543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:30.879547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.879611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:30.879626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:30.879632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:30.879639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:30.879652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:30.879673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:30.879706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.879879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:30.879888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:30.879907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:30.880024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1365 partition: 0 MaxSeqNo: 40 sessionId: src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0
2025-10-10T14:34:30.880482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9950105a-f88dec89-6eb57d77-936feb3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:30.883483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0] Write session: try to update token
2025-10-10T14:34:30.883508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:30.899811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:30.899845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:30.899848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:30.899851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:30.899866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601445650660627:8179]
2025-10-10T14:34:30.899871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601445650660627:8179]
2025-10-10T14:34:30.899876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601445650660627:8179]
2025-10-10T14:34:30.899935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:30.899949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:30.899952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:30.900026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:30.900044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:30.900049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:30.900138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:30.900390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId: src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:30.903216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:30.951652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601446432884147:2527]
2025-10-10T14:34:30.952007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1364, pipe: [1:7559601446432884147:2527]
2025-10-10T14:34:31.027237Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:31.027611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.027626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.027667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601446432884147:2527], now have 1 active actors on pipe
2025-10-10T14:34:31.027987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601446432884147:2527]
2025-10-10T14:34:31.027992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:31.027997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:31.028032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:31.028099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:31.028083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1365 reason: error at write: Disconnected sessionId: src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0
2025-10-10T14:34:31.028282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1365 sessionId: src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0 is DEAD
2025-10-10T14:34:31.028459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:31.028472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0] Write session will restart in 0.006728s
2025-10-10T14:34:31.028496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0] Write session: Do CDS request
2025-10-10T14:34:31.028503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:31.036925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.037024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:31.037057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1366
2025-10-10T14:34:31.037214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.037250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:31.037262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:31.037266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:31.037962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1366 sessionId:  describe result for acl check
2025-10-10T14:34:31.038003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:31.038010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:31.038012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:31.038021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601450727851470:8441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:31.038618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601450727851470:8441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:31.041299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601450727851470:8441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:31.047496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:31.047397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601450727851470:8441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:31.047417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601450727851470:8441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:31.047422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601450727851470:8441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:31.047432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:31.051269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:31.051542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:31.051556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:31.051577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:31.051638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:31.051694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601449945628128:8181]
2025-10-10T14:34:31.052330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:31.052740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:31.052814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:31.053165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:31.053249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.053260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.053262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.053263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.053264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.053266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.053267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.053269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.053270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.053272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.053273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.053275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.053276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.053283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.053298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.053302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.053306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.053311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.053315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.053319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.053323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.053327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.053346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.053350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.053353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.053357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.053365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.053376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.053383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.053388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.053405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.053410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.053415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.053420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.053426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.053431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.053436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.053442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.053447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.053452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.053456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.053462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.053468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.053473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.053478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.053484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.053490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.053496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.053500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.053505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.053511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.053516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.053557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:31.056258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:31.056924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:31.056942Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:31.056945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:31.056949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:31.056956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1365 [2:7559601449945628128:8181]
2025-10-10T14:34:31.056986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:31.057007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:31.057016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.057020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.057023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.057046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:31.057059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:31.057071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:31.057149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.057158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.057161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.057164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:31.057245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:31.057249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.057261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.057271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.057286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:31.057310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727851635:8441], now have 1 active actors on pipe
2025-10-10T14:34:31.057314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727851445:2438], now have 1 active actors on pipe
2025-10-10T14:34:31.057322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601449945628122:8181]
2025-10-10T14:34:31.057326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601449945628122:8181]
2025-10-10T14:34:31.057343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601449945628122:8181]
2025-10-10T14:34:31.057359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:31.057377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:31.057379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:31.057382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:31.057384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:31.057392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:31.057396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:31.057433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601449945628122:8181]
2025-10-10T14:34:31.057442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:31.057448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:31.057526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1365
2025-10-10T14:34:31.057575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1365
2025-10-10T14:34:31.057680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.057690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.057724Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|472795dc-b6112bf6-e508c46e-db520652_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:31.057735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.057739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.057742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:31.057755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.057767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:31.057786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.058100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.058111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.058133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.058281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1366 partition: 0 MaxSeqNo: 40 sessionId: src_id|472795dc-b6112bf6-e508c46e-db520652_0
2025-10-10T14:34:31.058782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|139a001d-83b045b9-9c0441fe-60a25b3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|472795dc-b6112bf6-e508c46e-db520652_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:31.061596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472795dc-b6112bf6-e508c46e-db520652_0] Write session: try to update token
2025-10-10T14:34:31.061617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472795dc-b6112bf6-e508c46e-db520652_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:31.076863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId: src_id|472795dc-b6112bf6-e508c46e-db520652_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:31.077502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:31.077517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:31.077521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:31.077523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:31.077532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601449945628122:8181]
2025-10-10T14:34:31.077536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601449945628122:8181]
2025-10-10T14:34:31.077540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601449945628122:8181]
2025-10-10T14:34:31.077593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:31.077602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.077605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:31.077645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:31.077660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:31.077665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:31.079587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:31.077748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:31.128269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601450727851649:2527]
2025-10-10T14:34:31.128806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1365, pipe: [1:7559601450727851649:2527]
2025-10-10T14:34:31.196514Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:31.196927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.196947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.196995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727851649:2527], now have 1 active actors on pipe
2025-10-10T14:34:31.197233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:31.197243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:31.197258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:31.197321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1366 reason: error at write: Disconnected sessionId: src_id|472795dc-b6112bf6-e508c46e-db520652_0
2025-10-10T14:34:31.197573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1366 sessionId: src_id|472795dc-b6112bf6-e508c46e-db520652_0 is DEAD
2025-10-10T14:34:31.197683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601450727851649:2527]
2025-10-10T14:34:31.197723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:31.201602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472795dc-b6112bf6-e508c46e-db520652_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:31.201617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472795dc-b6112bf6-e508c46e-db520652_0] Write session will restart in 0.008839s
2025-10-10T14:34:31.201651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472795dc-b6112bf6-e508c46e-db520652_0] Write session: Do CDS request
2025-10-10T14:34:31.201662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472795dc-b6112bf6-e508c46e-db520652_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:31.212000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|472795dc-b6112bf6-e508c46e-db520652_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.212381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:31.212399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1367
2025-10-10T14:34:31.212561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.212609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:31.212616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:31.212620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:31.213136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1367 sessionId:  describe result for acl check
2025-10-10T14:34:31.213179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:31.213180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:31.213182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:31.213189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601450727851751:8445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:31.213952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601450727851751:8445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:31.218309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601450727851751:8445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:31.219575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:31.223277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601450727851751:8445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:31.223296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601450727851751:8445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:31.223300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601450727851751:8445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:31.223310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:31.222481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:31.222726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:31.222731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:31.222745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:31.222820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:31.222859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601449945628327:8183]
2025-10-10T14:34:31.223517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:31.223827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:31.223874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:31.224217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:31.224287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.224293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.224294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.224295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.224296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.224296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.224297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.224298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.224299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.224300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.224301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.224301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.224303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.224307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.224317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.224319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.224322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.224324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.224326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.224329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.224331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.224334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.224348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.224351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.224356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.224360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.224369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.224375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.224380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.224384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.224386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.224402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.224406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.224411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.224415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.224421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.224425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.224436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.224443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.224449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.224453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.224458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.224463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.224468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.224473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.224476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.224480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.224484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.224487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.224493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.224503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.224509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.224551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:31.227073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:31.227739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:31.227753Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:31.227755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:31.227759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:31.227766Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1366 [2:7559601449945628327:8183]
2025-10-10T14:34:31.227782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:31.227800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:31.227811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.227815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.227818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.227843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:31.227856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:31.227864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:31.227932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.227939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.227941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.227944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:31.228040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:31.228049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.228060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.228071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.228087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:31.228117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727851843:8445], now have 1 active actors on pipe
2025-10-10T14:34:31.228124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727851650:2438], now have 1 active actors on pipe
2025-10-10T14:34:31.228133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601449945628322:8183]
2025-10-10T14:34:31.228135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601449945628322:8183]
2025-10-10T14:34:31.228138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601449945628322:8183]
2025-10-10T14:34:31.228152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:31.228165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:31.228170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:31.228173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:31.228176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:31.228186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:31.228195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:31.228230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601449945628322:8183]
2025-10-10T14:34:31.228244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:31.228262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1366
2025-10-10T14:34:31.228288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:31.228310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1366
2025-10-10T14:34:31.228402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.228413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.228447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:31.228460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.228479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.228486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:31.228497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.228514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:31.228535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.228719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.228726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.228742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.228848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1367 partition: 0 MaxSeqNo: 40 sessionId: src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0
2025-10-10T14:34:31.229312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|472795dc-b6112bf6-e508c46e-db520652_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:31.232376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0] Write session: try to update token
2025-10-10T14:34:31.232397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:31.240380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:31.240406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:31.240417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601449945628322:8183]
2025-10-10T14:34:31.240470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:31.240548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:31.240635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:31.240797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:31.240930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:31.241062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:31.241549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:31.241598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:31.248516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId: src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:31.251202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:31.251412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.251433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.251474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:31.251598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:31.259472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:31.259494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:31.259497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:31.259499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:31.259512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601449945628322:8183]
2025-10-10T14:34:31.259516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601449945628322:8183]
2025-10-10T14:34:31.259520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601449945628322:8183]
2025-10-10T14:34:31.259572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:31.259582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:31.259588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.259590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:31.259592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:31.259594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:31.259752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:31.297758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601450727851862:2527]
2025-10-10T14:34:31.298158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1366, pipe: [1:7559601450727851862:2527]
2025-10-10T14:34:31.376481Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:31.386754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.386786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.386969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.387034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.387105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.387180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.387467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.387482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.387555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.387617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.387681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.388112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.388157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.388161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.388231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.388292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.388352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.388415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.388456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.388458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.388523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.388578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.388638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.388712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.388756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.388760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.388824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.388884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.388947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.389003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.389050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.389053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.389121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.389177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.389247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.389307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.391289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601450727851862:2527]
2025-10-10T14:34:31.391308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:31.391312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:31.391325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:31.391346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1367 reason: error at write: Disconnected sessionId: src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0
2025-10-10T14:34:31.391579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1367 sessionId: src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0 is DEAD
2025-10-10T14:34:31.389491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.389498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.389564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.389624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.389690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.389760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.389804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.389807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.389880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.389937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.390001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.390062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.390101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.390103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.390174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.390233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.390297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.390358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.390401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.390404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.390477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.390540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.390607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.390672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.390714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.390718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.390789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727851862:2527], now have 1 active actors on pipe
2025-10-10T14:34:31.391421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:31.393432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:31.393446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0] Write session will restart in 0.007403s
2025-10-10T14:34:31.393472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0] Write session: Do CDS request
2025-10-10T14:34:31.393479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:31.405836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.405915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:31.405934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1368
2025-10-10T14:34:31.406964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.407025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:31.407035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:31.407039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:31.407523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1368 sessionId:  describe result for acl check
2025-10-10T14:34:31.407562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:31.407568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:31.407570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:31.407576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601450727852010:8460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:31.408156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601450727852010:8460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:31.410686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601450727852010:8460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:31.411006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:31.413575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:31.413723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601450727852010:8460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:31.413740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601450727852010:8460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:31.413744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601450727852010:8460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:31.413753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:31.413831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:31.413847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:31.413862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:31.413938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:31.413986Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601449945628567:8198]
2025-10-10T14:34:31.414475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:31.414792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:31.414856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:31.415230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:31.415296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.415303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.415305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.415306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.415307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.415308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.415310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.415311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.415312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.415313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.415315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.415316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.415317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.415323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.415337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.415341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.415345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.415349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.415353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.415357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.415361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.415365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.415369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.415373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.415377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.415381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.415388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.415396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.415403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.415409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.415413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.415419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.415423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.415428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.415433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.415438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.415442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.415457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.415463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.415468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.415472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.415477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.415481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.415487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.415491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.415496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.415501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.415506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.415510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.415515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.415521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.415526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.415564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:31.418043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:31.418531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:31.418548Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:31.418550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:31.418554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:31.418562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1367 [2:7559601449945628567:8198]
2025-10-10T14:34:31.418574Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:31.418593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:31.418596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.418600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.418602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.418619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:31.418627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:31.418634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:31.418697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.418700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.418701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.418704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:31.418773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:31.418776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.418787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.418798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.418813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:31.418834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852074:8460], now have 1 active actors on pipe
2025-10-10T14:34:31.418838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727851886:2438], now have 1 active actors on pipe
2025-10-10T14:34:31.418845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601449945628562:8198]
2025-10-10T14:34:31.418848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601449945628562:8198]
2025-10-10T14:34:31.418850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601449945628562:8198]
2025-10-10T14:34:31.418866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:31.418880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:31.418887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:31.418892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:31.418946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1367
2025-10-10T14:34:31.418990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1367
2025-10-10T14:34:31.418895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:31.418895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:31.418900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:31.418934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601449945628562:8198]
2025-10-10T14:34:31.418943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:31.418951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:31.418985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.418990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.419025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:31.419033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.419038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.419040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:31.419054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.419064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:31.419085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.419274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.419283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.419309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.419414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1368 partition: 0 MaxSeqNo: 40 sessionId: src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0
2025-10-10T14:34:31.419983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82047917-6ee9bf79-c68b8e48-7361cc56_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:31.422689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0] Write session: try to update token
2025-10-10T14:34:31.422708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:31.443622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId: src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:31.447676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:31.449699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.449721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.451596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:31.451650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:31.451659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:31.451662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:31.451665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:31.451675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601449945628562:8198]
2025-10-10T14:34:31.451680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601449945628562:8198]
2025-10-10T14:34:31.451683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601449945628562:8198]
2025-10-10T14:34:31.451732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:31.451746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.451746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:31.451748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:31.451752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:31.451756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:31.451887Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:31.451901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:31.489765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601450727852087:2527]
2025-10-10T14:34:31.490065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1367, pipe: [1:7559601450727852087:2527]
2025-10-10T14:34:31.567414Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:31.576748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.576784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.576978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.577046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.577114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.577185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.577590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.577600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.577678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.577740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.577812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.577885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.577928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.577931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.578012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.578082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.578149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.578216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.578260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.578263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.578342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.578410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.578477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.578548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.578595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.578599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.578676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.578744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.578815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.578881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.578928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.578932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.579010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.579074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.579145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.579215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.579259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.579262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.579334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.579397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.579461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.579523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.580010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.580015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.580088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.580146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.580212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.580285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.580325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.580327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.580397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.580458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.580519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.580585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.580628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.580631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.580708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:31.580771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:31.580839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:31.580906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:31.580949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:31.580952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:31.581038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852087:2527], now have 1 active actors on pipe
2025-10-10T14:34:31.581618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601450727852087:2527]
2025-10-10T14:34:31.581664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:31.581683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:31.581688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:31.582084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:31.582097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0] Write session will restart in 0.007412s
2025-10-10T14:34:31.582137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0] Write session: Do CDS request
2025-10-10T14:34:31.582143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:31.581719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1368 reason: error at write: Disconnected sessionId: src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0
2025-10-10T14:34:31.581940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1368 sessionId: src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0 is DEAD
2025-10-10T14:34:31.582447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:31.593754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.593798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:31.593817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1369
2025-10-10T14:34:31.598313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.598369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:31.598375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:31.598380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:31.600694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1369 sessionId:  describe result for acl check
2025-10-10T14:34:31.600742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:31.600747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:31.600749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:31.600755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601450727852263:8465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:31.601366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601450727852263:8465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:31.603474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601450727852263:8465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:31.602102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:31.602427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:31.602610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:31.602615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:31.602627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:31.602699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:31.602761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601449945628781:8201]
2025-10-10T14:34:31.603371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:31.603837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:31.603882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:31.604248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:31.604312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.604313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.604315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.604316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.604317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.604318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.604320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.604321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.604322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.604323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.604325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.604326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.604328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.604334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.604348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.604353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.604357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.604361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.604365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.604370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.604374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.604378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.604382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.604386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.604391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.604394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.604402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.604411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.604418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.604424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.604428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.604434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.604439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.604444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.604449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.604455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.604459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.604465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.604472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.604478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.604483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.604487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.604493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.604498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.604503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.604509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.604513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.604519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.604537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.604544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.604549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.604554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.604595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:31.608338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601450727852263:8465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:31.608357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601450727852263:8465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:31.608361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601450727852263:8465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:31.608369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:31.609840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1368
2025-10-10T14:34:31.609875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1368
2025-10-10T14:34:31.609076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:31.609417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:31.609422Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:31.609424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:31.609428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:31.609435Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1368 [2:7559601449945628781:8201]
2025-10-10T14:34:31.609449Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:31.609469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:31.609473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.609477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.609479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.609499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:31.609507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:31.609515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:31.609578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.609581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.609583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.609585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:31.609663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:31.609666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.609678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.609689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.609706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:31.609728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601449945628776:8201]
2025-10-10T14:34:31.609730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601449945628776:8201]
2025-10-10T14:34:31.609733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601449945628776:8201]
2025-10-10T14:34:31.609742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:31.609751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:31.609754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:31.609756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:31.609757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:31.609773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:31.609776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:31.609788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852302:8465], now have 1 active actors on pipe
2025-10-10T14:34:31.609792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852101:2438], now have 1 active actors on pipe
2025-10-10T14:34:31.609825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601449945628776:8201]
2025-10-10T14:34:31.609836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:31.609841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:31.610119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.610135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.610170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:31.610185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.610194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.610197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:31.610209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.610222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:31.610243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.610430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.610439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.610458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.610633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1369 partition: 0 MaxSeqNo: 40 sessionId: src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0
2025-10-10T14:34:31.611048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d09b4b-dc4adacf-797d840f-1e5f7d0c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:31.613821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0] Write session: try to update token
2025-10-10T14:34:31.613846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:31.633201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:31.633222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:31.633226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:31.633228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:31.633237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601449945628776:8201]
2025-10-10T14:34:31.633243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601449945628776:8201]
2025-10-10T14:34:31.633247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601449945628776:8201]
2025-10-10T14:34:31.633303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:31.633317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.633319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:31.633515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:31.632184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId: src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:31.635077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:31.635210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:31.635224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:31.635233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:31.681748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601450727852316:2527]
2025-10-10T14:34:31.682048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1368, pipe: [1:7559601450727852316:2527]
2025-10-10T14:34:31.755332Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:31.755675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.755695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.755757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852316:2527], now have 1 active actors on pipe
2025-10-10T14:34:31.755999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:31.756245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:31.756266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:31.756329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1369 reason: error at write: Disconnected sessionId: src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0
2025-10-10T14:34:31.756399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601450727852316:2527]
2025-10-10T14:34:31.756440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:31.756560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1369 sessionId: src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0 is DEAD
2025-10-10T14:34:31.756729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:31.756740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0] Write session will restart in 0.008559s
2025-10-10T14:34:31.756765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0] Write session: Do CDS request
2025-10-10T14:34:31.756772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:31.766923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.767277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:31.767295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1370
2025-10-10T14:34:31.767501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.767552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:31.767563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:31.767567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:31.768082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1370 sessionId:  describe result for acl check
2025-10-10T14:34:31.768122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:31.768123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:31.768125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:31.768130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601450727852372:8470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:31.768606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601450727852372:8470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:31.771049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601450727852372:8470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:31.774699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601450727852372:8470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:31.774717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601450727852372:8470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:31.774721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601450727852372:8470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:31.774731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:31.775761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:31.778329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:31.778584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:31.778597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:31.778611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:31.778677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:31.778724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601449945628987:8204]
2025-10-10T14:34:31.779351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:31.779700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:31.779750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:31.780113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:31.780177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.780183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.780184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.780185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.780186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.780188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.780189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.780190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.780192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.780193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.780194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.780196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.780197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.780203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.780218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.780222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.780226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.780229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.780234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.780238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.780242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.780246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.780251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.780254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.780258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.780262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.780270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.780279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.780295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.780310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.780314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.780320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.780325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.780330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.780335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.780340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.780345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.780350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.780357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.780364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.780369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.780380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.780385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.780394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.780399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.780404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.780409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.780419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.780423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.780428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.780433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.780442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.780492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:31.783085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:31.783458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:31.783470Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:31.783473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:31.783477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:31.783484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1369 [2:7559601449945628987:8204]
2025-10-10T14:34:31.783499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:31.783517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:31.783525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.783530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.783533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.783551Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:31.783563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:31.783571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:31.783634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.783642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.783644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.783647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:31.783719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:31.783726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.783738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.783754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.783775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:31.783803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852509:8470], now have 1 active actors on pipe
2025-10-10T14:34:31.783821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852317:2438], now have 1 active actors on pipe
2025-10-10T14:34:31.783834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601449945628982:8204]
2025-10-10T14:34:31.783837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601449945628982:8204]
2025-10-10T14:34:31.783839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601449945628982:8204]
2025-10-10T14:34:31.783851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:31.783870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:31.783887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:31.783848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1369
2025-10-10T14:34:31.783895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:31.783858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1369
2025-10-10T14:34:31.783896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:31.783898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:31.783898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:31.783968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.783978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.783993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601449945628982:8204]
2025-10-10T14:34:31.784005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:31.784019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:31.784044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:31.784056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.784065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.784069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:31.784081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.784096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:31.784125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.784583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.784591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.784608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.784723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1370 partition: 0 MaxSeqNo: 40 sessionId: src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0
2025-10-10T14:34:31.785192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec1da59-1fe4d3f3-5401d750-e97b36d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:31.788071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0] Write session: try to update token
2025-10-10T14:34:31.788091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:31.804535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:31.804555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:31.804559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:31.804561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:31.804571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601449945628982:8204]
2025-10-10T14:34:31.804575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601449945628982:8204]
2025-10-10T14:34:31.804579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601449945628982:8204]
2025-10-10T14:34:31.804635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:31.804642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.804654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:31.804796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:31.809498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:31.809522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:31.809527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:31.810842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId: src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:31.813556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:31.856876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601450727852525:2527]
2025-10-10T14:34:31.857201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1369, pipe: [1:7559601450727852525:2527]
2025-10-10T14:34:31.921171Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:31.921659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.921677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.921725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852525:2527], now have 1 active actors on pipe
2025-10-10T14:34:31.921965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:31.921971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601450727852525:2527]
2025-10-10T14:34:31.921996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:31.922000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:31.922054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1370 reason: error at write: Disconnected sessionId: src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0
2025-10-10T14:34:31.922088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:31.922262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1370 sessionId: src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0 is DEAD
2025-10-10T14:34:31.922497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:31.922509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0] Write session will restart in 0.009623s
2025-10-10T14:34:31.922535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0] Write session: Do CDS request
2025-10-10T14:34:31.922546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:31.932926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.933042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:31.933062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1371
2025-10-10T14:34:31.933226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:31.933278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:31.933288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:31.933292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:31.933778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1371 sessionId:  describe result for acl check
2025-10-10T14:34:31.933822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:31.933830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:31.933832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:31.933839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601450727852603:8474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:31.934452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601450727852603:8474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:31.937178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601450727852603:8474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:31.939244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:31.941767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:31.941966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601450727852603:8474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:31.941988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601450727852603:8474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:31.941992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601450727852603:8474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:31.942001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:31.942014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:31.942025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:31.942038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:31.942098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:31.942150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601449945629190:8206]
2025-10-10T14:34:31.942759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:31.943107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:31.943169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:31.943524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:31.943601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.943614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.943615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.943617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.943618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.943619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.943621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.943622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.943623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.943625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.943626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.943627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.943629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.943635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.943651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.943655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.943659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.943662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.943666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.943670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.943674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.943677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.943681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.943685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.943688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.943692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.943700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.943708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:31.943716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.943721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:31.943725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.943731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:31.943735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.943746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:31.943750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.943755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:31.943759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.943764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:31.943768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.943773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:31.943777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.943787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:31.943792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.943801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:31.943805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.943811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:31.943819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.943826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.943834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.943839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.943848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.943853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.943895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:31.946497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:31.947262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:31.947280Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:31.947283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:31.947287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:31.947294Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1370 [2:7559601449945629190:8206]
2025-10-10T14:34:31.947309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:31.947329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:31.947338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.947342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.947344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.947367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:31.947380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:31.947388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:31.947457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.947468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.947471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.947473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:31.947552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:31.947562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.947574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:31.947584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:31.947601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:31.947630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601449945629185:8206]
2025-10-10T14:34:31.947638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601449945629185:8206]
2025-10-10T14:34:31.947640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601449945629185:8206]
2025-10-10T14:34:31.947650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:31.947663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:31.947666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:31.947668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:31.947669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:31.947686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:31.947690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:31.947702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852722:8474], now have 1 active actors on pipe
2025-10-10T14:34:31.947705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601450727852526:2438], now have 1 active actors on pipe
2025-10-10T14:34:31.947733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601449945629185:8206]
2025-10-10T14:34:31.947746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:31.947755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:31.947742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1370
2025-10-10T14:34:31.947743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1370
2025-10-10T14:34:31.947890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.947902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.947937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:31.947964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:31.947973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:31.947976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:31.947987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:31.948001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:31.948023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.948227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.948236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.948255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:31.948375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1371 partition: 0 MaxSeqNo: 40 sessionId: src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0
2025-10-10T14:34:31.948824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a1024f5-b11a81f9-f0eb1914-428f1118_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:31.952315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0] Write session: try to update token
2025-10-10T14:34:31.952337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:31.968467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId: src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:31.969902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:31.969917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:31.969927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601449945629185:8206]
2025-10-10T14:34:31.969979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:31.969993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:31.970169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:31.970324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:31.970516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:31.970665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:31.971082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:31.971135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:31.971427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:31.971655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:31.971666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:31.971694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:31.971769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:31.984845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:31.984866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:31.984870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:31.984872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:31.984885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601449945629185:8206]
2025-10-10T14:34:31.984892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601449945629185:8206]
2025-10-10T14:34:31.984896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601449945629185:8206]
2025-10-10T14:34:31.984947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:31.984954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:31.984957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:31.984955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:31.984962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:31.984966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:31.985106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:32.023079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601455022820030:2527]
2025-10-10T14:34:32.023659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1370, pipe: [1:7559601455022820030:2527]
2025-10-10T14:34:32.103512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:32.111846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.111875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.112079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.112145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.112217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.112296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.112345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.112354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.112432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.112501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.112572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.112652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.112706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.112715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.112797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.112866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.112937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.113003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.113048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.113056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.113140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.113284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.113388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.113456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.113503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.113513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.113589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.113654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.113731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.113800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.113851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.113859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.113928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.113997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.114068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.114133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.114181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.114188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.114257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.114320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.114393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.116316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:32.116332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:32.116364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1371 reason: error at write: Disconnected sessionId: src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0
2025-10-10T14:34:32.116606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1371 sessionId: src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0 is DEAD
2025-10-10T14:34:32.116773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:32.116785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0] Write session will restart in 0.005175s
2025-10-10T14:34:32.116811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0] Write session: Do CDS request
2025-10-10T14:34:32.116820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:32.116827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:32.116871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601455022820030:2527]
2025-10-10T14:34:32.114471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.114530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.114533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.114610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.114674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.114735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.114798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.114840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.114843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.114917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.114971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.115032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.115093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.115153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.115155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.115223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.115281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.115348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.115417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.115466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.115469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.115542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820030:2527], now have 1 active actors on pipe
2025-10-10T14:34:32.116817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:32.126039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.130088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:32.130106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1372
2025-10-10T14:34:32.130444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.130496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:32.130509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:32.130513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:32.130982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1372 sessionId:  describe result for acl check
2025-10-10T14:34:32.131037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:32.131046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:32.131048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:32.131056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601455022820198:8478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:32.131552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601455022820198:8478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:32.134712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601455022820198:8478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:32.133780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:32.136960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:32.137247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:32.137263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:32.137278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:32.137368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:32.137410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601454240596691:8208]
2025-10-10T14:34:32.137826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601455022820198:8478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:32.137854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601455022820198:8478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:32.137858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601455022820198:8478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:32.137867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:32.138073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:32.138428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:32.138483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:32.138816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:32.138874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.138880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.138881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.138883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.138884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.138885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.138887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.138888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.138889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.138890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.138892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.138893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.138894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.138901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.138914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.138918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.138922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.138926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.138930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.138934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.138938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.138942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.138947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.138951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.138955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.138958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.138966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.138976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.138983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.138989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.138993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.138998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.139003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.139008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.139014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.139019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.139028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.139033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.139038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.139043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.139052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.139058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.139066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.139071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.139077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.139083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.139092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.139097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.139101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.139107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.139115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.139121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.139166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:32.141806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:32.142138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:32.142151Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:32.142154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:32.142159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:32.142166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1371 [2:7559601454240596691:8208]
2025-10-10T14:34:32.142196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:32.142221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:32.142225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.142228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.142231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.142252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:32.142261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:32.142269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:32.142333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.142341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.142344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.142347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:32.142418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:32.142426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.142438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.142452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.142472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:32.142502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820229:8478], now have 1 active actors on pipe
2025-10-10T14:34:32.142511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820032:2438], now have 1 active actors on pipe
2025-10-10T14:34:32.142522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601454240596685:8208]
2025-10-10T14:34:32.142524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601454240596685:8208]
2025-10-10T14:34:32.142526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601454240596685:8208]
2025-10-10T14:34:32.142549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:32.142555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:32.142563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:32.142565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:32.142566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:32.142583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:32.142586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:32.142553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1371
2025-10-10T14:34:32.142564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1371
2025-10-10T14:34:32.142620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601454240596685:8208]
2025-10-10T14:34:32.142632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:32.142639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:32.142650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.142660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.142714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:32.142726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.142730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.142733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:32.142746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.142756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:32.142779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.142916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.142924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.142940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.143040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1372 partition: 0 MaxSeqNo: 40 sessionId: src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0
2025-10-10T14:34:32.143547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bb690cf-4eecd89-ced67e5e-1d3196a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:32.146354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0] Write session: try to update token
2025-10-10T14:34:32.146379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:32.163683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:32.163705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:32.163709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:32.163711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:32.163721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601454240596685:8208]
2025-10-10T14:34:32.163726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601454240596685:8208]
2025-10-10T14:34:32.163730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601454240596685:8208]
2025-10-10T14:34:32.163783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:32.163796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.163798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:32.163810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:32.163836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:32.163840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:32.163964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:32.164886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId: src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:32.167838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:32.217606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601455022820241:2527]
2025-10-10T14:34:32.218330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1371, pipe: [1:7559601455022820241:2527]
2025-10-10T14:34:32.278551Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:32.279150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.279161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.279210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820241:2527], now have 1 active actors on pipe
2025-10-10T14:34:32.279437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:32.279546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:32.279619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:32.279622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:32.279695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1372 reason: error at write: Disconnected sessionId: src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0
2025-10-10T14:34:32.279872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1372 sessionId: src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0 is DEAD
2025-10-10T14:34:32.280033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601455022820241:2527]
2025-10-10T14:34:32.280467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:32.280480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0] Write session will restart in 0.008502s
2025-10-10T14:34:32.280505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0] Write session: Do CDS request
2025-10-10T14:34:32.280516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:32.289953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.290046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:32.290069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1373
2025-10-10T14:34:32.290179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.290232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:32.290244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:32.290247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:32.291019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1373 sessionId:  describe result for acl check
2025-10-10T14:34:32.291055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:32.291062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:32.291064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:32.291071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601455022820270:8482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:32.291670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601455022820270:8482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:32.296356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601455022820270:8482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:32.299502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:32.305228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:32.305719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:32.305733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:32.305748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:32.305825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:32.305880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601454240596910:8210]
2025-10-10T14:34:32.306553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:32.309054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:32.309131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:32.309540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:32.309613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.309620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.309621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.309622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.309623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.309625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.309626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.309628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.309629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.309630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.309631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.309632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.309633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.309641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.309653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.309658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.309664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.309668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.309673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.309678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.309682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.309686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.309693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.309697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.309705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.309711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.309723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.309732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.309744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.309751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.309762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.309767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.309771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.309777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.309781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.309786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.309790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.309796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.309801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.309806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.309822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.309827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.309831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.309836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.309840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.309845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.309855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.309860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.309873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.309879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.309888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.309892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.309941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:32.309779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601455022820270:8482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:32.309804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601455022820270:8482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:32.309808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601455022820270:8482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:32.309818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:32.314758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:32.315259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:32.315272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:32.315278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:32.315282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:32.315290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1372 [2:7559601454240596910:8210]
2025-10-10T14:34:32.315305Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:32.315327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:32.315337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.315340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.315342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.315362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:32.315370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:32.315378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:32.315444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.315451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.315454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.315456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:32.315530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:32.315541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.315552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.315564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.315579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:32.315602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820443:8482], now have 1 active actors on pipe
2025-10-10T14:34:32.315606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820242:2438], now have 1 active actors on pipe
2025-10-10T14:34:32.315613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601454240596905:8210]
2025-10-10T14:34:32.315616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601454240596905:8210]
2025-10-10T14:34:32.315617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601454240596905:8210]
2025-10-10T14:34:32.315631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:32.315644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:32.315762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1372
2025-10-10T14:34:32.315800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1372
2025-10-10T14:34:32.315646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:32.315648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:32.315650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:32.315662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:32.315665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:32.315705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601454240596905:8210]
2025-10-10T14:34:32.315712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:32.315719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:32.315957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.315967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.316002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:32.316011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.316015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.316018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:32.316031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.316044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:32.316073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.316332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.316341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.316360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.316503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1373 partition: 0 MaxSeqNo: 40 sessionId: src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0
2025-10-10T14:34:32.316983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f4a98e1-a947c995-b63bf9b5-a97474f9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:32.320075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0] Write session: try to update token
2025-10-10T14:34:32.320098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:32.328403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:32.328426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:32.328437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601454240596905:8210]
2025-10-10T14:34:32.328491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:32.328695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:32.328850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:32.329003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:32.329152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:32.329382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:32.329428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:32.329557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:32.338827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId: src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:32.341810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:32.342132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.342154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.342206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:32.342319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:32.351688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:32.351706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:32.351710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:32.351712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:32.351724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601454240596905:8210]
2025-10-10T14:34:32.351728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601454240596905:8210]
2025-10-10T14:34:32.351731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601454240596905:8210]
2025-10-10T14:34:32.351774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:32.351777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:32.351784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.351786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:32.351795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:32.351799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:32.351946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:32.385427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601455022820465:2527]
2025-10-10T14:34:32.385970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1372, pipe: [1:7559601455022820465:2527]
2025-10-10T14:34:32.465370Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:32.474590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.474621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.474807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.474881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.474949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.475017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.475063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.475074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.475149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.475216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.475279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.475349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.475399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.475408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.475480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.475547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.475619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.475690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.475737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.475748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.475823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.475896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.475982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.476069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.476119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.476130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.476206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.476283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.476353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.476420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.476466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.476474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.476545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.476615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.476688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.476759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.476805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.476814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.476890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.476958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.477027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.477099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.477146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.477155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.477226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.477294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.477384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.477460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.477513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.477524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.477599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.477663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.477735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.477805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.477853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.477861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.477934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.478003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.478070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.478137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.478190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.478198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.478270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820465:2527], now have 1 active actors on pipe
2025-10-10T14:34:32.478569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:32.478589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601455022820465:2527]
2025-10-10T14:34:32.478591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:32.478610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:32.478626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1373 reason: error at write: Disconnected sessionId: src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0
2025-10-10T14:34:32.478980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:32.478990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0] Write session will restart in 0.009945s
2025-10-10T14:34:32.479029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0] Write session: Do CDS request
2025-10-10T14:34:32.479035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:32.478871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1373 sessionId: src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0 is DEAD
2025-10-10T14:34:32.479687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:32.491062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.492401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:32.492423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1374
2025-10-10T14:34:32.492589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.492644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:32.492656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:32.492661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:32.493095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1374 sessionId:  describe result for acl check
2025-10-10T14:34:32.493136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:32.493142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:32.493144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:32.493151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601455022820596:8495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:32.493808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601455022820596:8495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:32.496429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601455022820596:8495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:32.497055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:32.499618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:32.499785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601455022820596:8495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:32.499805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601455022820596:8495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:32.499810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601455022820596:8495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:32.499819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:32.499865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:32.499890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:32.499903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:32.499977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:32.500026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601454240597142:8225]
2025-10-10T14:34:32.500581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:32.501025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:32.501076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:32.501407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:32.501485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.501492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.501493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.501494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.501495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.501496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.501497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.501498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.501499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.501501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.501502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.501502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.501504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.501510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.501522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.501526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.501530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.501533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.501536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.501540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.501544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.501547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.501551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.501554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.501557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.501561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.501569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.501577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.501584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.501588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.501592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.501597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.501601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.501605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.501610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.501614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.501618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.501623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.501628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.501632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.501636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.501641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.501647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.501651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.501656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.501661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.501665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.501670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.501674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.501678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.501682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.501687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.501726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:32.504160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:32.504527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:32.504540Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:32.504542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:32.504547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:32.504553Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1373 [2:7559601454240597142:8225]
2025-10-10T14:34:32.504567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:32.504587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:32.504595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.504598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.504601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.504619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:32.504626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:32.504634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:32.504690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.504699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.504701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.504703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:32.504772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:32.504781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.504791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.504801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.504817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:32.504839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820479:2438], now have 1 active actors on pipe
2025-10-10T14:34:32.504846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820678:8495], now have 1 active actors on pipe
2025-10-10T14:34:32.504853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601454240597137:8225]
2025-10-10T14:34:32.504855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601454240597137:8225]
2025-10-10T14:34:32.504857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601454240597137:8225]
2025-10-10T14:34:32.504870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:32.504888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:32.504896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:32.504904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:32.504907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:32.504908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:32.504911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:32.504917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1373
2025-10-10T14:34:32.504932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601454240597137:8225]
2025-10-10T14:34:32.504941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:32.504953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:32.504976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1373
2025-10-10T14:34:32.505122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.505137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.505170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:32.505184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.505209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.505224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:32.505241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.505262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:32.505288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.505560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.505569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.505585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.505699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1374 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0
2025-10-10T14:34:32.509488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece8fcc1-2e9083d2-10a9003e-6f0bff53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:32.512364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0] Write session: try to update token
2025-10-10T14:34:32.512387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:32.524680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:32.524715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:32.524719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:32.524722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:32.524733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601454240597137:8225]
2025-10-10T14:34:32.524738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601454240597137:8225]
2025-10-10T14:34:32.524743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601454240597137:8225]
2025-10-10T14:34:32.524793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:32.524802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.524805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:32.524940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:32.527241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:32.527259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:32.527263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:32.531422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId: src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:32.534362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:32.578784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601455022820701:2527]
2025-10-10T14:34:32.579109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1373, pipe: [1:7559601455022820701:2527]
2025-10-10T14:34:32.640186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:32.640781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.640802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.640855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820701:2527], now have 1 active actors on pipe
2025-10-10T14:34:32.641117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:32.641164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:32.641191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:32.641294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1374 reason: error at write: Disconnected sessionId: src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0
2025-10-10T14:34:32.641455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601455022820701:2527]
2025-10-10T14:34:32.641716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:32.641732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0] Write session will restart in 0.005144s
2025-10-10T14:34:32.641478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:32.641757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0] Write session: Do CDS request
2025-10-10T14:34:32.641770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:32.641538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1374 sessionId: src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0 is DEAD
2025-10-10T14:34:32.647915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.648527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:32.648559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1375
2025-10-10T14:34:32.648709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.648754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:32.648766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:32.648770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:32.649294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1375 sessionId:  describe result for acl check
2025-10-10T14:34:32.649362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:32.649368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:32.649371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:32.649378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601455022820723:8501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:32.649976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601455022820723:8501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:32.652115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601455022820723:8501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:32.656623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601455022820723:8501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:32.656643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601455022820723:8501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:32.656648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601455022820723:8501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:32.656657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:32.666087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:32.668540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:32.668837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:32.668851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:32.668864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:32.668920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:32.668976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601454240597363:8228]
2025-10-10T14:34:32.669863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:32.670273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:32.670325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:32.670740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:32.670813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.670819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.670821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.670823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.670824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.670825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.670826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.670828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.670829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.670831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.670832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.670833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.670834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.670841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.670855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.670859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.670863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.670867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.670872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.670876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.670880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.670884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.670889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.670893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.670897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.670902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.670911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.670920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.670928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.670935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.670939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.670945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.670961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.670966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.670973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.670979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.670983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.670990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.670995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.671001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.671005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.671017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.671021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.671026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.671036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.671042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.671051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.671057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.671066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.671071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.671081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.671086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.671138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:32.674444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:32.674761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:32.674776Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:32.674780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:32.674784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:32.674792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1374 [2:7559601454240597363:8228]
2025-10-10T14:34:32.674806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:32.674832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:32.674835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.674839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.674841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.674861Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:32.674875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:32.674888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:32.674957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.674970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.674972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.674975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:32.675045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:32.675052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.675063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.675079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.675094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:32.675122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820829:8501], now have 1 active actors on pipe
2025-10-10T14:34:32.675130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820708:2438], now have 1 active actors on pipe
2025-10-10T14:34:32.675137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601454240597358:8228]
2025-10-10T14:34:32.675144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601454240597358:8228]
2025-10-10T14:34:32.675146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601454240597358:8228]
2025-10-10T14:34:32.675162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:32.675182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:32.675183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:32.675186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:32.675188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:32.675204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:32.675212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:32.675249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601454240597358:8228]
2025-10-10T14:34:32.675256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:32.675259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:32.675222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1374
2025-10-10T14:34:32.675281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.675290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.675234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1374
2025-10-10T14:34:32.675332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11fece76-d5edb56e-91f61d40-fccdb262_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:32.675345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.675348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.675351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:32.675365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.675382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:32.675413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.675581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.675594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.675630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.675760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1375 partition: 0 MaxSeqNo: 40 sessionId: src_id|11fece76-d5edb56e-91f61d40-fccdb262_0
2025-10-10T14:34:32.676285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52eb4f-e6f41a3c-47573e76-ae29a747_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|11fece76-d5edb56e-91f61d40-fccdb262_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:32.679264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fece76-d5edb56e-91f61d40-fccdb262_0] Write session: try to update token
2025-10-10T14:34:32.679296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fece76-d5edb56e-91f61d40-fccdb262_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:32.702766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId: src_id|11fece76-d5edb56e-91f61d40-fccdb262_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:32.705679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:32.705956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.705994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.706040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:32.706141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:32.716814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:32.716836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:32.716839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:32.716846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:32.716856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601454240597358:8228]
2025-10-10T14:34:32.716862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601454240597358:8228]
2025-10-10T14:34:32.716868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601454240597358:8228]
2025-10-10T14:34:32.716917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:32.716933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.716938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:32.716937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:32.716950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:32.716958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:32.717084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:32.741557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601455022820922:2527]
2025-10-10T14:34:32.741921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1374, pipe: [1:7559601455022820922:2527]
2025-10-10T14:34:32.830405Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:32.839395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.839433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.839661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.839746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.839830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.839925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.839978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.839994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.840083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.840164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.840246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.840330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.840389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.840392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.840470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.840544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.840616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.840678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.840729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.840736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.840809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.840868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.840928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.840990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.841026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.841029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.841092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.841147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.841204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.841271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.841311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.841313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.841429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.841501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.841570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.841635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.841687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.841696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.841767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.841830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.841905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.841972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.842019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.842026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.842097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.842164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.842233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.842304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.842352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.842359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.842428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.842493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.842556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.842816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.842858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.842864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.843072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:32.843135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:32.843194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:32.843259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:32.843324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:32.843332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:32.843391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820922:2527], now have 1 active actors on pipe
2025-10-10T14:34:32.845732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:32.845802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601455022820922:2527]
2025-10-10T14:34:32.845854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:32.845857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:32.845888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1375 reason: error at write: Disconnected sessionId: src_id|11fece76-d5edb56e-91f61d40-fccdb262_0
2025-10-10T14:34:32.846119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1375 sessionId: src_id|11fece76-d5edb56e-91f61d40-fccdb262_0 is DEAD
2025-10-10T14:34:32.846554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:32.846622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fece76-d5edb56e-91f61d40-fccdb262_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:32.846638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fece76-d5edb56e-91f61d40-fccdb262_0] Write session will restart in 0.007208s
2025-10-10T14:34:32.846666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fece76-d5edb56e-91f61d40-fccdb262_0] Write session: Do CDS request
2025-10-10T14:34:32.846673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fece76-d5edb56e-91f61d40-fccdb262_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:32.855001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fece76-d5edb56e-91f61d40-fccdb262_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.855043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:32.855074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1376
2025-10-10T14:34:32.855275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:32.855318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:32.855339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:32.855349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:32.855887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1376 sessionId:  describe result for acl check
2025-10-10T14:34:32.855945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:32.855947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:32.855952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:32.855960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601455022820940:8505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:32.856517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601455022820940:8505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:32.861858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601455022820940:8505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:32.867192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601455022820940:8505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:32.867222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601455022820940:8505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:32.867227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601455022820940:8505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:32.867238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:32.867219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:32.870395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:32.870670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:32.870686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:32.870701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:32.870776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:32.870842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601454240597576:8231]
2025-10-10T14:34:32.871492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:32.871881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:32.871968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:32.872333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:32.872401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.872408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.872410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.872411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.872412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.872414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.872415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.872416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.872418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.872419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.872420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.872421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.872423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.872429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.872443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.872447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.872451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.872456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.872470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.872474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.872478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.872482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.872489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.872492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.872496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.872499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.872508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.872516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:32.872524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.872530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:32.872535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.872540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:32.872545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.872551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:32.872557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.872563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:32.872569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.872574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:32.872579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.872584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:32.872589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.872595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:32.872600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.872606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:32.872610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.872616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:32.872620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.872626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.872631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.872637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.872642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.872652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.872710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:32.878020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:32.878491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:32.878503Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:32.878506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:32.878511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:32.878519Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1375 [2:7559601454240597576:8231]
2025-10-10T14:34:32.878535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:32.878556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:32.878564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.878568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.878570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.878591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:32.878605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:32.878614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:32.878683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.878691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.878693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.878696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:32.878771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:32.878779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.878791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:32.878815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:32.878837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:32.878865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022820925:2438], now have 1 active actors on pipe
2025-10-10T14:34:32.878873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022821123:8505], now have 1 active actors on pipe
2025-10-10T14:34:32.878882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601454240597570:8231]
2025-10-10T14:34:32.878884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601454240597570:8231]
2025-10-10T14:34:32.878886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601454240597570:8231]
2025-10-10T14:34:32.878900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:32.878915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:32.878935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:32.878943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:32.878987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601454240597570:8231]
2025-10-10T14:34:32.878994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:32.879168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:32.879179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:32.879185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:32.879192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:32.879266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.879278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.879313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:32.879326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:32.879335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:32.879338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:32.879350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:32.879366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:32.879389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.879999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.880008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.880026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:32.881419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fece76-d5edb56e-91f61d40-fccdb262_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:32.878994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1375
2025-10-10T14:34:32.879032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1375
2025-10-10T14:34:32.880161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1376 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0
2025-10-10T14:34:32.884197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0] Write session: try to update token
2025-10-10T14:34:32.884222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:32.900889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:32.900911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:32.900922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601454240597570:8231]
2025-10-10T14:34:32.900994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:32.901174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:32.901317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:32.901477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:32.901635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:32.902086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:32.902140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:32.902223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:32.902530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId: src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:32.905449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:32.906002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:32.906033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:32.906076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:32.906199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:32.924680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:32.924704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:32.924707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:32.924710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:32.924722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601454240597570:8231]
2025-10-10T14:34:32.924726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601454240597570:8231]
2025-10-10T14:34:32.924730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601454240597570:8231]
2025-10-10T14:34:32.924783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:32.924792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:32.924793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:32.924799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:32.924801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:32.924803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:32.924945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:32.945885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601455022821136:2527]
2025-10-10T14:34:32.946288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1375, pipe: [1:7559601455022821136:2527]
2025-10-10T14:34:33.041288Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:33.050033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.050066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.050256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.050317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.050377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.050438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.050486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.050491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.050565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.050623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.050683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.050743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.050780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.050784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.050855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.050913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.050973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.051032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.051072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.051076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.051144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.051217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.051292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.051403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.051450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.051458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.051525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.051584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.051652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.051717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.051769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.051777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.051844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.051921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.051986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.052051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.052093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.052100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.052165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.052227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.052295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.052361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.052407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.052415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.052486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.052549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.052614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.052678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.052723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.052732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.052798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.052861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.052924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.052992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.053057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.053064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.053133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.053195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.053260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.053323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.053388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.053396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.053464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601455022821136:2527], now have 1 active actors on pipe
2025-10-10T14:34:33.053759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:33.053785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601455022821136:2527]
2025-10-10T14:34:33.053817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:33.053820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:33.053853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1376 reason: error at write: Disconnected sessionId: src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0
2025-10-10T14:34:33.054110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1376 sessionId: src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0 is DEAD
2025-10-10T14:34:33.054265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:33.054274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0] Write session will restart in 0.007769s
2025-10-10T14:34:33.054314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0] Write session: Do CDS request
2025-10-10T14:34:33.054321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:33.054711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:33.062972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.063070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:33.063092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1377
2025-10-10T14:34:33.063225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.063265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:33.063277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:33.063281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:33.063848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1377 sessionId:  describe result for acl check
2025-10-10T14:34:33.063898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:33.063901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:33.063903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:33.063924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601459317788459:8509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:33.064546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601459317788459:8509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:33.067822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601459317788459:8509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:33.070988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601459317788459:8509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:33.071004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601459317788459:8509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:33.071008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601459317788459:8509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:33.071033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:33.074515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:33.075101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:33.075313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:33.075328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:33.075341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:33.075400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:33.075450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601458535565082:8233]
2025-10-10T14:34:33.076123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:33.076459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:33.076518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:33.076877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:33.076936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.076941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.076943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.076944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.076945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.076946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.076948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.076949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.076950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.076952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.076953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.076955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.076956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.076964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.076978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.076983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.076989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.076993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.076996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.077000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.077004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.077009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.077018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.077022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.077025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.077029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.077037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.077047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.077053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.077061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.077066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.077073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.077079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.077085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.077090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.077098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.077103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.077110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.077120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.077125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.077129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.077135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.077141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.077148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.077157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.077163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.077172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.077177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.077182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.077187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.077192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.077198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.077241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:33.079848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:33.080307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:33.080319Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:33.080321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:33.080325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:33.080333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1376 [2:7559601458535565082:8233]
2025-10-10T14:34:33.080347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:33.080366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:33.080374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.080378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.080380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.080399Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:33.080414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:33.080422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:33.080486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.080493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.080495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.080498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:33.080695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1376
2025-10-10T14:34:33.080695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1376
2025-10-10T14:34:33.080827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:33.080836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.080850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.080863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.080884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:33.080912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317788635:8509], now have 1 active actors on pipe
2025-10-10T14:34:33.080920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317788435:2438], now have 1 active actors on pipe
2025-10-10T14:34:33.080938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.080947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.080967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601458535565077:8233]
2025-10-10T14:34:33.080973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601458535565077:8233]
2025-10-10T14:34:33.080975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601458535565077:8233]
2025-10-10T14:34:33.080993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:33.081013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:33.081024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:33.081027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:33.081029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:33.081034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:33.081038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:33.081060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:33.081075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.081080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.081082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:33.081094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.081110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:33.081148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601458535565077:8233]
2025-10-10T14:34:33.081162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:33.081171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:33.081176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.081320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.081343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.081362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.081481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1377 partition: 0 MaxSeqNo: 40 sessionId: src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0
2025-10-10T14:34:33.081899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6cf8e9-5e92b308-7acd05f5-ece8af76_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:33.084626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0] Write session: try to update token
2025-10-10T14:34:33.084647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:33.094328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:33.094354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:33.094366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601458535565077:8233]
2025-10-10T14:34:33.094422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:33.094538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:33.094600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:33.094750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:33.094902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:33.095043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:33.095245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:33.095290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:33.099879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId: src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:33.102496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:33.102734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.102758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.102814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:33.102896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:33.118296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:33.118313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:33.118317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:33.118319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:33.118330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601458535565077:8233]
2025-10-10T14:34:33.118334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601458535565077:8233]
2025-10-10T14:34:33.118338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601458535565077:8233]
2025-10-10T14:34:33.118394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:33.118398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:33.118402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.118404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:33.118405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:33.118411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:33.118535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:33.153768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601459317788649:2527]
2025-10-10T14:34:33.154094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1376, pipe: [1:7559601459317788649:2527]
2025-10-10T14:34:33.237979Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:33.246902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.246938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.247119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.247194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.247262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.247329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.247376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.247385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.247459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.247531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.247597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.247674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.247722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.247730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.247799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.247863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.247949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.248017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.248067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.248071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.248143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.248206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.248266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.248326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.248368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.248371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.248442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.248501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.248565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.248627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.248667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.248672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.248744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.248804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.248869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.248937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.248984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.248987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.249057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.249116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.249176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.249237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.249279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.249282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.249500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.249570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.249636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.249702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.249751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.249758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.249826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.249892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.249957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.250025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.250075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.250083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.250152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.250215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.250284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.250348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.250392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.250399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.250465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317788649:2527], now have 1 active actors on pipe
2025-10-10T14:34:33.250736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:33.250765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:33.250799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1377 reason: error at write: Disconnected sessionId: src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0
2025-10-10T14:34:33.250807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601459317788649:2527]
2025-10-10T14:34:33.250826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:33.251063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1377 sessionId: src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0 is DEAD
2025-10-10T14:34:33.251212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:33.251224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0] Write session will restart in 0.006553s
2025-10-10T14:34:33.251260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0] Write session: Do CDS request
2025-10-10T14:34:33.251266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:33.251423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:33.258959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.259089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:33.259105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1378
2025-10-10T14:34:33.259288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.259335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:33.259347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:33.259351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:33.259839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1378 sessionId:  describe result for acl check
2025-10-10T14:34:33.259878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:33.259885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:33.259888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:33.259895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601459317788671:8513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:33.260489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601459317788671:8513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:33.265221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601459317788671:8513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:33.268592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601459317788671:8513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:33.268622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601459317788671:8513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:33.268625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601459317788671:8513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:33.268635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:33.268997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:33.271616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:33.271862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:33.271878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:33.271893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:33.271982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:33.272041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601458535565293:8235]
2025-10-10T14:34:33.272652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:33.273005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:33.273060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:33.273412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:33.273492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.273500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.273501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.273502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.273503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.273505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.273506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.273507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.273509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.273510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.273512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.273513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.273514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.273521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.273536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.273541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.273546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.273550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.273555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.273559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.273564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.273568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.273574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.273578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.273583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.273587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.273598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.273611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.273624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.273631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.273635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.273641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.273646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.273651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.273656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.273666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.273672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.273677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.273687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.273692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.273699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.273708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.273713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.273724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.273728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.273734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.273739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.273746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.273755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.273760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.273765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.273770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.273822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:33.276506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:33.276853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:33.276868Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:33.276871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:33.276874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:33.276881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1377 [2:7559601458535565293:8235]
2025-10-10T14:34:33.276896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:33.276917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:33.276925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.276929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.276932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.276949Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:33.276963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:33.276971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:33.277042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.277050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.277052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.277054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:33.277134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:33.277142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.277155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.277166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.277253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1377
2025-10-10T14:34:33.277323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1377
2025-10-10T14:34:33.277198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:33.277227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317788651:2438], now have 1 active actors on pipe
2025-10-10T14:34:33.277230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317788853:8513], now have 1 active actors on pipe
2025-10-10T14:34:33.277238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601458535565288:8235]
2025-10-10T14:34:33.277241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601458535565288:8235]
2025-10-10T14:34:33.277243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601458535565288:8235]
2025-10-10T14:34:33.277256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:33.277271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:33.277272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:33.277273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:33.277275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:33.277288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:33.277291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:33.277316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601458535565288:8235]
2025-10-10T14:34:33.277319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:33.277321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:33.277372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.277376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.277410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:33.277418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.277422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.277425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:33.277437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.277448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:33.277463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.277967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.277980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.277998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.278133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1378 partition: 0 MaxSeqNo: 40 sessionId: src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0
2025-10-10T14:34:33.278566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4d66f48-18c99ced-f2e75d54-11916a30_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:33.281526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0] Write session: try to update token
2025-10-10T14:34:33.281548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:33.296922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId: src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:33.299650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:33.300152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.300179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.302137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:33.302182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:33.302186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:33.302189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:33.302191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:33.302200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601458535565288:8235]
2025-10-10T14:34:33.302204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601458535565288:8235]
2025-10-10T14:34:33.302209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601458535565288:8235]
2025-10-10T14:34:33.302238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:33.302251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:33.302251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:33.302256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:33.302259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.302261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:33.302307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:33.302403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:33.350857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601459317788866:2527]
2025-10-10T14:34:33.351033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1377, pipe: [1:7559601459317788866:2527]
2025-10-10T14:34:33.425068Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:33.439997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.440033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.440326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.440406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.440475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.440551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.440836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.440847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.440927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.440996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.441063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.441130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.441186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.441199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.441276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.441364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.441428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.441497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.441549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.441552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.441629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.441702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.441774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.441840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.441894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.441906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.441977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.442043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.442114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.442181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.442229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.442232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.442308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.442378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.442450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.442519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.442567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.442574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.442643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.442705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.442780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.442843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.442894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.442901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.442968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.443034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.443104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.443172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.443216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.443219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.443285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.443350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.443417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.443483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.443527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.443534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.443604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:33.443858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:33.444116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:33.444186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:33.444237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:33.444244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:33.444324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317788866:2527], now have 1 active actors on pipe
2025-10-10T14:34:33.444652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601459317788866:2527]
2025-10-10T14:34:33.444719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:33.444728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:33.444767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1378 reason: error at write: Disconnected sessionId: src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0
2025-10-10T14:34:33.444940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:33.445052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1378 sessionId: src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0 is DEAD
2025-10-10T14:34:33.445193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:33.445205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0] Write session will restart in 0.009096s
2025-10-10T14:34:33.445236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0] Write session: Do CDS request
2025-10-10T14:34:33.445241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:33.445452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:33.455960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.456092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:33.456122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1379
2025-10-10T14:34:33.456260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.456311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:33.456321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:33.456325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:33.456917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1379 sessionId:  describe result for acl check
2025-10-10T14:34:33.456958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:33.456964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:33.456966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:33.456972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601459317788960:8526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:33.457608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601459317788960:8526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:33.460722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601459317788960:8526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:33.465878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:33.465896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601459317788960:8526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:33.465914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601459317788960:8526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:33.465919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601459317788960:8526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:33.465928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:33.468957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:33.469215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:33.469229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:33.469245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:33.469316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:33.469387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601458535565543:8248]
2025-10-10T14:34:33.470064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:33.470464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:33.470507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:33.470862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:33.470926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.470933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.470934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.470936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.470937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.470938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.470939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.470941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.470942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.470944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.470945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.470947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.470948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.470955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.470970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.470974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.470978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.470981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.470986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.470990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.470994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.470998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.471002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.471006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.471011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.471015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.471024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.471038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.471047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.471052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.471062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.471067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.471071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.471076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.471081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.471090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.471095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.471106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.471112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.471121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.471125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.471130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.471135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.471139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.471149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.471154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.471164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.471170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.471179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.471185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.471195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.471200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.471247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:33.474454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:33.474799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:33.474815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:33.474817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:33.474822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:33.474829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1378 [2:7559601458535565543:8248]
2025-10-10T14:34:33.474844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:33.474864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:33.474874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.474878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.474880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.474901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:33.474909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:33.474918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:33.474987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.474996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.474999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.475002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:33.475091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:33.475100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.475112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.475123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.475138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:33.475170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601458535565537:8248]
2025-10-10T14:34:33.475177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601458535565537:8248]
2025-10-10T14:34:33.475179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601458535565537:8248]
2025-10-10T14:34:33.475198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:33.475219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:33.475481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1378
2025-10-10T14:34:33.475538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1378
2025-10-10T14:34:33.476185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1379 partition: 0 MaxSeqNo: 40 sessionId: src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0
2025-10-10T14:34:33.475244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:33.475252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:33.475252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:33.475255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:33.475258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:33.475285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601458535565537:8248]
2025-10-10T14:34:33.475288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:33.475347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:33.475420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789095:8526], now have 1 active actors on pipe
2025-10-10T14:34:33.475426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317788883:2438], now have 1 active actors on pipe
2025-10-10T14:34:33.475703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.475710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.475746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:33.475757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.475763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.475766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:33.475779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.475792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:33.475806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.475976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.475980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.477553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bc37ea2-d0ab512-8c89519a-e1046802_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:33.476004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.483911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0] Write session: try to update token
2025-10-10T14:34:33.483938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:33.498335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId: src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:33.501282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:33.502087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.502118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.502144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:33.502147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:33.502150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:33.502152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:33.502162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601458535565537:8248]
2025-10-10T14:34:33.502166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601458535565537:8248]
2025-10-10T14:34:33.502170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601458535565537:8248]
2025-10-10T14:34:33.502235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:33.502248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.502250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:33.502391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:33.503440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:33.503455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:33.503459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:33.544925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601459317789107:2527]
2025-10-10T14:34:33.545221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1378, pipe: [1:7559601459317789107:2527]
2025-10-10T14:34:33.622190Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:33.623050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:33.623162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:33.623170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:33.623254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1379 reason: error at write: Disconnected sessionId: src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0
2025-10-10T14:34:33.622588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:33.622651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789107:2527], now have 1 active actors on pipe
2025-10-10T14:34:33.623386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601459317789107:2527]
2025-10-10T14:34:33.623414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:33.623428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1379 sessionId: src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0 is DEAD
2025-10-10T14:34:33.623587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:33.623598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0] Write session will restart in 0.007639s
2025-10-10T14:34:33.623621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0] Write session: Do CDS request
2025-10-10T14:34:33.623627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:33.632913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.633176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:33.633202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1380
2025-10-10T14:34:33.633719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.633777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:33.633790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:33.633794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:33.634346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1380 sessionId:  describe result for acl check
2025-10-10T14:34:33.634398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:33.634407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:33.634409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:33.634415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601459317789182:8532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:33.635021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601459317789182:8532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:33.639534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601459317789182:8532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:33.643675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601459317789182:8532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:33.643695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601459317789182:8532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:33.643697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601459317789182:8532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:33.643707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:33.645536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:33.647767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:33.648077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:33.648090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:33.648104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:33.648167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:33.648227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601458535565768:8253]
2025-10-10T14:34:33.648884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:33.649279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:33.649346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:33.649684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:33.649751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.649759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.649760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.649762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.649763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.649765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.649766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.649767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.649769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.649770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.649771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.649773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.649774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.649780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.649790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.649792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.649795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.649797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.649800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.649802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.649804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.649806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.649809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.649811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.649813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.649815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.649824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.649833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.649839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.649844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.649849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.649855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.649859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.649864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.649869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.649874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.649879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.649883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.649888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.649892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.649896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.649902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.649909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.649914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.649919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.649923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.649929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.649933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.649937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.649942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.649946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.649953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.649982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:33.653759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:33.654452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:33.654466Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:33.654469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:33.654473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:33.654480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1379 [2:7559601458535565768:8253]
2025-10-10T14:34:33.654494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:33.654513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:33.654516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.654520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.654522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.654540Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:33.654552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:33.654560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:33.654624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.654631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.654633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.654636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:33.654708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:33.654716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.654726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.654741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.654760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:33.654787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789330:8532], now have 1 active actors on pipe
2025-10-10T14:34:33.654795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789126:2438], now have 1 active actors on pipe
2025-10-10T14:34:33.654803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601458535565763:8253]
2025-10-10T14:34:33.654809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601458535565763:8253]
2025-10-10T14:34:33.654812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601458535565763:8253]
2025-10-10T14:34:33.654827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:33.654845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:33.654864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:33.654871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:33.654906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601458535565763:8253]
2025-10-10T14:34:33.654913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:33.654916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:33.654919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:33.654921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:33.654929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:33.654886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1379
2025-10-10T14:34:33.654898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1379
2025-10-10T14:34:33.655062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.655071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.655108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:33.655120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.655126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.655128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:33.655140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.655150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:33.655164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.655430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.655448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.655463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.655623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1380 partition: 0 MaxSeqNo: 40 sessionId: src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0
2025-10-10T14:34:33.656159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f76566-bd2f1bc3-f680d867-eb545820_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:33.659011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0] Write session: try to update token
2025-10-10T14:34:33.659033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:33.680026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId: src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:33.682482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:33.682503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:33.682507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:33.682509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:33.682519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601458535565763:8253]
2025-10-10T14:34:33.682524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601458535565763:8253]
2025-10-10T14:34:33.682527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601458535565763:8253]
2025-10-10T14:34:33.682584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:33.682596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.682586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:33.682599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:33.682605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:33.682610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:33.682742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:33.682821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:33.723613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601459317789348:2527]
2025-10-10T14:34:33.724030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1379, pipe: [1:7559601459317789348:2527]
2025-10-10T14:34:33.808630Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:33.809055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.809077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.809124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789348:2527], now have 1 active actors on pipe
2025-10-10T14:34:33.809489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:33.809508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:33.809584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1380 reason: error at write: Disconnected sessionId: src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0
2025-10-10T14:34:33.809598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:33.809350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:33.809651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601459317789348:2527]
2025-10-10T14:34:33.809785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1380 sessionId: src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0 is DEAD
2025-10-10T14:34:33.809995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:33.810005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0] Write session will restart in 0.007279s
2025-10-10T14:34:33.810041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0] Write session: Do CDS request
2025-10-10T14:34:33.810051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:33.818935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.819086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:33.819104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1381
2025-10-10T14:34:33.819261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:33.819308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:33.819318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:33.819322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:33.819753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1381 sessionId:  describe result for acl check
2025-10-10T14:34:33.819795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:33.819797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:33.819799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:33.819817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601459317789369:8536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:33.820413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601459317789369:8536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:33.824800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601459317789369:8536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:33.827953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601459317789369:8536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:33.827971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601459317789369:8536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:33.827975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601459317789369:8536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:33.827984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:33.829486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:33.831759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:33.832012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:33.832029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:33.832044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:33.832132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:33.832179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601458535565984:8256]
2025-10-10T14:34:33.832780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:33.833134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:33.833199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:33.833575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:33.833654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.833662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.833663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.833664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.833665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.833666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.833667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.833669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.833670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.833671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.833672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.833674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.833675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.833681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.833694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.833698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.833702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.833705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.833710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.833713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.833717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.833720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.833724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.833728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.833731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.833735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.833744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.833753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:33.833772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.833778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:33.833783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.833788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:33.833795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.833799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:33.833804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.833808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:33.833812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.833822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:33.833827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.833831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:33.833836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.833841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:33.833848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.833853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:33.833857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.833862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:33.833867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.833872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.833876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.833884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.833889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.833899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.833937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:33.836922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:33.837267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:33.837280Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:33.837282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:33.837286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:33.837293Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1380 [2:7559601458535565984:8256]
2025-10-10T14:34:33.837307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:33.837347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:33.837355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.837358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.837360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.837380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:33.837392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:33.837404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:33.837477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.837486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.837488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.837491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:33.837561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:33.837568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.837578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:33.837589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:33.837604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:33.837633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789351:2438], now have 1 active actors on pipe
2025-10-10T14:34:33.837642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789554:8536], now have 1 active actors on pipe
2025-10-10T14:34:33.837649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601458535565979:8256]
2025-10-10T14:34:33.837652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601458535565979:8256]
2025-10-10T14:34:33.837653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601458535565979:8256]
2025-10-10T14:34:33.837668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:33.837679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:33.837687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:33.837689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:33.837691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:33.837702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:33.837705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:33.837735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601458535565979:8256]
2025-10-10T14:34:33.837743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:33.837745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:33.837718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1380
2025-10-10T14:34:33.837720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1380
2025-10-10T14:34:33.837773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.837782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.837822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:33.837834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:33.837837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:33.837840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:33.837854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:33.837865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:33.837883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.838038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.838056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.838082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:33.838207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1381 partition: 0 MaxSeqNo: 40 sessionId: src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0
2025-10-10T14:34:33.838652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d0d291c-4b0e8768-c37f080e-9f4864dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:33.841511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0] Write session: try to update token
2025-10-10T14:34:33.841532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:33.857489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId: src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:33.860318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:33.861673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:33.861698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:33.861723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:33.861727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:33.861730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:33.861732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:33.861740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601458535565979:8256]
2025-10-10T14:34:33.861750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601458535565979:8256]
2025-10-10T14:34:33.861754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601458535565979:8256]
2025-10-10T14:34:33.861804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:33.861815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:33.861820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:33.861823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:33.861824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:33.861826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:33.861974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:33.909961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601459317789568:2527]
2025-10-10T14:34:33.910244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1380, pipe: [1:7559601459317789568:2527]
2025-10-10T14:34:33.979304Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:33.979771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:33.979839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789568:2527], now have 1 active actors on pipe
2025-10-10T14:34:33.979935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:33.981476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601459317789568:2527]
2025-10-10T14:34:33.981509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:33.994167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:33.994187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:33.994215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1381 reason: error at write: Disconnected sessionId: src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0
2025-10-10T14:34:33.994413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1381 sessionId: src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0 is DEAD
2025-10-10T14:34:33.994572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:33.994584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0] Write session will restart in 0.008667s
2025-10-10T14:34:33.994609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0] Write session: Do CDS request
2025-10-10T14:34:33.994615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:34.005791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.006217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:34.006235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1382
2025-10-10T14:34:34.006369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.006402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:34.006408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:34.006412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:34.006902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1382 sessionId:  describe result for acl check
2025-10-10T14:34:34.006946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:34.006948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:34.006949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:34.006956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601463612757045:8540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:34.007540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601463612757045:8540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:34.008971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:34.012359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:34.012689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:34.012710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:34.012731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:34.012805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:34.012861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601462830533494:8258]
2025-10-10T14:34:34.013473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601463612757045:8540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:34.013526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:34.013887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:34.013947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:34.014332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:34.014430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.014432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.014433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.014435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.014436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.014437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.014438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.014439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.014440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.014441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.014442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.014443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.014444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.014451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.014466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.014470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.014475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.014479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.014483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.014486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.014490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.014495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.014499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.014503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.014507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.014512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.014519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.014528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.014535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.014541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.014545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.014551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.014555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.014561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.014565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.014571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.014576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.014581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.014586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.014591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.014596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.014601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.014607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.014612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.014618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.014624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.014628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.014633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.014640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.014645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.014650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.014655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.014694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:34.018629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:34.018978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:34.018990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:34.018992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:34.018995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:34.019000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1381 [2:7559601462830533494:8258]
2025-10-10T14:34:34.019011Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:34.019025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:34.019027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.019029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.019031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.019046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:34.019055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:34.019063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:34.019109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.019116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.019117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.019119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:34.019176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:34.019182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.019190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.019196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.019207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:34.019224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601459317789575:2438], now have 1 active actors on pipe
2025-10-10T14:34:34.019231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601462830533488:8258]
2025-10-10T14:34:34.019233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601462830533488:8258]
2025-10-10T14:34:34.019234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601462830533488:8258]
2025-10-10T14:34:34.019243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:34.019254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:34.019263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:34.019265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:34.019288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601462830533488:8258]
2025-10-10T14:34:34.019289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:34.019292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:34.019293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:34.019295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:34.019302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:34.019648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1381
2025-10-10T14:34:34.020936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601463612757045:8540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:34.020958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601463612757045:8540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:34.020962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601463612757045:8540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:34.020973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:34.021486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757079:8540], now have 1 active actors on pipe
2025-10-10T14:34:34.022014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1381
2025-10-10T14:34:34.022161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.022180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.022215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a170983-55f77528-e5011322-77899755_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:34.022231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.022241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.022244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:34.022258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.022279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:34.022301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.022530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.022541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.022559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.022687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1382 partition: 0 MaxSeqNo: 40 sessionId: src_id|a170983-55f77528-e5011322-77899755_0
2025-10-10T14:34:34.023143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94b0cb9b-62b13d92-4f986f12-6940c0b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a170983-55f77528-e5011322-77899755_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:34.026186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a170983-55f77528-e5011322-77899755_0] Write session: try to update token
2025-10-10T14:34:34.026208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a170983-55f77528-e5011322-77899755_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:34.045451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId: src_id|a170983-55f77528-e5011322-77899755_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:34.049183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:34.050360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.050391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.050418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:34.050426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:34.050430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:34.050432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:34.050440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601462830533488:8258]
2025-10-10T14:34:34.050448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601462830533488:8258]
2025-10-10T14:34:34.050457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601462830533488:8258]
2025-10-10T14:34:34.050494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:34.050504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:34.050507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:34.050523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:34.050531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.050533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:34.050670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:34.081599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601463612757083:2527]
2025-10-10T14:34:34.081925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1381, pipe: [1:7559601463612757083:2527]
2025-10-10T14:34:34.185897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:34.186337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:34.186396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757083:2527], now have 1 active actors on pipe
2025-10-10T14:34:34.189453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:34.189551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601463612757083:2527]
2025-10-10T14:34:34.189585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:34.189600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:34.189603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:34.189685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1382 reason: error at write: Disconnected sessionId: src_id|a170983-55f77528-e5011322-77899755_0
2025-10-10T14:34:34.189841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1382 sessionId: src_id|a170983-55f77528-e5011322-77899755_0 is DEAD
2025-10-10T14:34:34.190048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a170983-55f77528-e5011322-77899755_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:34.190061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a170983-55f77528-e5011322-77899755_0] Write session will restart in 0.008693s
2025-10-10T14:34:34.190095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a170983-55f77528-e5011322-77899755_0] Write session: Do CDS request
2025-10-10T14:34:34.190101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a170983-55f77528-e5011322-77899755_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:34.200004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a170983-55f77528-e5011322-77899755_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.201697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:34.201729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1383
2025-10-10T14:34:34.201922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.201964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:34.201970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:34.201974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:34.202381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1383 sessionId:  describe result for acl check
2025-10-10T14:34:34.202422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:34.202428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:34.202430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:34.202437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601463612757099:8544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:34.202992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601463612757099:8544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:34.206495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601463612757099:8544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:34.210471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601463612757099:8544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:34.210496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601463612757099:8544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:34.210500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601463612757099:8544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:34.210510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:34.215334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:34.217879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:34.218117Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:34.218122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:34.218136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:34.218199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:34.218240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601462830533713:8260]
2025-10-10T14:34:34.218885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:34.219227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:34.219271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:34.219636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:34.219713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.219714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.219716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.219717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.219718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.219719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.219721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.219722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.219723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.219724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.219726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.219727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.219728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.219735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.219748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.219752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.219756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.219761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.219765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.219769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.219772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.219776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.219781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.219784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.219788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.219792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.219800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.219809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.219816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.219822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.219827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.219832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.219837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.219843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.219850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.219854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.219858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.219864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.219883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.219889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.219894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.219899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.219903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.219909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.219913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.219918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.219924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.219929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.219933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.219939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.219943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.219948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.219987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:34.223394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1382
2025-10-10T14:34:34.223413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1382
2025-10-10T14:34:34.224139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1383 partition: 0 MaxSeqNo: 40 sessionId: src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0
2025-10-10T14:34:34.224577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a170983-55f77528-e5011322-77899755_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:34.222686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:34.223034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:34.223039Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:34.223042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:34.223046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:34.223053Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1382 [2:7559601462830533713:8260]
2025-10-10T14:34:34.223067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:34.223086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:34.223089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.223092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.223095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.223112Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:34.223120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:34.223127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:34.223187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.223189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.223191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.223194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:34.223546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:34.223549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.223563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.223576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.223594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:34.223617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757086:2438], now have 1 active actors on pipe
2025-10-10T14:34:34.223621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757242:8544], now have 1 active actors on pipe
2025-10-10T14:34:34.223641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.223645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.223665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601462830533708:8260]
2025-10-10T14:34:34.223668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601462830533708:8260]
2025-10-10T14:34:34.223670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601462830533708:8260]
2025-10-10T14:34:34.223687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:34.223701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:34.223702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:34.223705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:34.223707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:34.223718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:34.223721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:34.223745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:34.223753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.223758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.223761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:34.223772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.223783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:34.223818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601462830533708:8260]
2025-10-10T14:34:34.223826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:34.223832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:34.223838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.224035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.224039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.224057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.227482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0] Write session: try to update token
2025-10-10T14:34:34.227499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:34.245505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:34.245526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:34.245539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601462830533708:8260]
2025-10-10T14:34:34.245609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:34.245794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:34.245938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:34.246422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId: src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:34.246081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:34.246220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:34.246397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:34.246437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:34.246520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:34.249308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:34.249663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.249686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.249729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:34.249856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:34.259146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:34.259168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:34.259172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:34.259174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:34.259186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601462830533708:8260]
2025-10-10T14:34:34.259190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601462830533708:8260]
2025-10-10T14:34:34.259195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601462830533708:8260]
2025-10-10T14:34:34.259250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:34.259268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.259270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:34.259281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:34.259290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:34.259294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:34.259406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:34.289856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601463612757304:2527]
2025-10-10T14:34:34.290152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1382, pipe: [1:7559601463612757304:2527]
2025-10-10T14:34:34.373988Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:34.382226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.382262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.382461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.382534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.382608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.382685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.382737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.382747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.382827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.382901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.382970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.383046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.383099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.383109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.383191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.383263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.383340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.383414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.383466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.383477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.383556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.383631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.383697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.383767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.383818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.383824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.383907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.383979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.384046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.384116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.384168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.384175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.384248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.384311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.384378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.384445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.384496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.384504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.384573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.384637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.384704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.384767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.384817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.384825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.384898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.384963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.385031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.385095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.385149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.385156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.385224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.385286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.385369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.385434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.385479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.385486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.385558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.385628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.385693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.385770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.385823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.385830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.385905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757304:2527], now have 1 active actors on pipe
2025-10-10T14:34:34.386203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:34.386219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601463612757304:2527]
2025-10-10T14:34:34.386251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:34.386253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:34.386283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1383 reason: error at write: Disconnected sessionId: src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0
2025-10-10T14:34:34.386539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1383 sessionId: src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0 is DEAD
2025-10-10T14:34:34.386676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:34.386687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0] Write session will restart in 0.005333s
2025-10-10T14:34:34.386731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0] Write session: Do CDS request
2025-10-10T14:34:34.386738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:34.386949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:34.392914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.393085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:34.393104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1384
2025-10-10T14:34:34.393273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.393319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:34.393347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:34.393350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:34.393832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1384 sessionId:  describe result for acl check
2025-10-10T14:34:34.393883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:34.393891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:34.393893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:34.393899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601463612757322:8548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:34.394478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601463612757322:8548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:34.399383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601463612757322:8548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:34.402417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601463612757322:8548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:34.402433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601463612757322:8548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:34.402437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601463612757322:8548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:34.402446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:34.405222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:34.407426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:34.407686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:34.407698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:34.407711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:34.407768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:34.407808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601462830533943:8262]
2025-10-10T14:34:34.408540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:34.408979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:34.409030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:34.409386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:34.409452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.409458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.409459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.409460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.409461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.409463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.409464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.409465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.409466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.409468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.409469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.409471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.409472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.409479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.409491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.409495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.409499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.409503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.409506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.409510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.409514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.409517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.409521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.409525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.409529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.409535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.409542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.409550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.409557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.409562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.409568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.409573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.409578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.409583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.409587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.409591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.409595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.409600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.409604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.409609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.409613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.409618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.409628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.409634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.409639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.409648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.409658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.409663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.409668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.409673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.409682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.409687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.409735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:34.415494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:34.415935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:34.415949Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:34.415952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:34.415959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:34.415966Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1383 [2:7559601462830533943:8262]
2025-10-10T14:34:34.415980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:34.416000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:34.416008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.416013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.416015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.416032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:34.416047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:34.416056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:34.416127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.416134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.416136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.416138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:34.416233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:34.416242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.416254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.416273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.416407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1383
2025-10-10T14:34:34.416461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1383
2025-10-10T14:34:34.416291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:34.416321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757307:2438], now have 1 active actors on pipe
2025-10-10T14:34:34.416325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757513:8548], now have 1 active actors on pipe
2025-10-10T14:34:34.416333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601462830533938:8262]
2025-10-10T14:34:34.416336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601462830533938:8262]
2025-10-10T14:34:34.416338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601462830533938:8262]
2025-10-10T14:34:34.416352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:34.416366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:34.416373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:34.416376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:34.416378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:34.416385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:34.416388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:34.416429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601462830533938:8262]
2025-10-10T14:34:34.416431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:34.416440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:34.416745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.416755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.416796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:34.416805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.416809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.416812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:34.416823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.416845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:34.416865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.417072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.417099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.417128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.417240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1384 partition: 0 MaxSeqNo: 40 sessionId: src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0
2025-10-10T14:34:34.417753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1612b979-dbf64e3e-d98f575a-2afb1396_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:34.420602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0] Write session: try to update token
2025-10-10T14:34:34.420623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:34.435875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId: src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:34.438337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:34.438361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:34.438364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:34.438366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:34.438376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601462830533938:8262]
2025-10-10T14:34:34.438381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601462830533938:8262]
2025-10-10T14:34:34.438387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601462830533938:8262]
2025-10-10T14:34:34.438442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:34.438441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:34.438447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:34.438451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:34.438456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.438458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:34.438603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:34.438829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:34.486552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601463612757541:2527]
2025-10-10T14:34:34.487921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1383, pipe: [1:7559601463612757541:2527]
2025-10-10T14:34:34.555121Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:34.555463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.555474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.555518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757541:2527], now have 1 active actors on pipe
2025-10-10T14:34:34.555774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:34.556341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:34.556394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601463612757541:2527]
2025-10-10T14:34:34.556413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:34.556482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1384 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0
2025-10-10T14:34:34.556674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1384 sessionId: src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0 is DEAD
2025-10-10T14:34:34.557371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:34.557384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0] Write session will restart in 0.006237s
2025-10-10T14:34:34.557423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0] Write session: Do CDS request
2025-10-10T14:34:34.557431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:34.564931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.565022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:34.565042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1385
2025-10-10T14:34:34.565185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.565221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:34.565226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:34.565230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:34.565697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1385 sessionId:  describe result for acl check
2025-10-10T14:34:34.565738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:34.565740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:34.565742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:34.565748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601463612757594:8562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:34.566319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601463612757594:8562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:34.568857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601463612757594:8562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:34.572637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601463612757594:8562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:34.572655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601463612757594:8562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:34.572659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601463612757594:8562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:34.572666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:34.575692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:34.578885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:34.579180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:34.579207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:34.579223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:34.579304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:34.579356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601462830534199:8278]
2025-10-10T14:34:34.579968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:34.580314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:34.580373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:34.580766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:34.580839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.580845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.580847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.580848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.580849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.580850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.580852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.580853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.580855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.580856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.580857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.580859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.580860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.580866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.580881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.580885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.580890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.580894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.580898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.580902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.580906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.580910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.580914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.580918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.580922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.580926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.580934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.580942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.580948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.580954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.580959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.580964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.580969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.580975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.580979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.580984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.580989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.580995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.580999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.581003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.581007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.581012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.581016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.581021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.581025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.581030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.581035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.581040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.581056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.581066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.581070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.581075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.581116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:34.583822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:34.585078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:34.585093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:34.585096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:34.585101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:34.585107Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1384 [2:7559601462830534199:8278]
2025-10-10T14:34:34.585122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:34.585141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:34.585152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.585156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.585158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.585175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:34.585188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:34.585202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:34.585283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.585289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.585291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.585294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:34.585373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:34.585384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.585396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.585408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.585425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:34.585452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757763:8562], now have 1 active actors on pipe
2025-10-10T14:34:34.585464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757567:2438], now have 1 active actors on pipe
2025-10-10T14:34:34.585473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601462830534194:8278]
2025-10-10T14:34:34.585475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601462830534194:8278]
2025-10-10T14:34:34.585477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601462830534194:8278]
2025-10-10T14:34:34.585490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:34.585501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:34.585505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:34.585512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:34.585515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:34.585521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:34.585525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:34.585518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1384
2025-10-10T14:34:34.585561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1384
2025-10-10T14:34:34.585559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601462830534194:8278]
2025-10-10T14:34:34.585570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:34.585586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.585591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.585597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:34.585652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b82af29-8438ef6f-ff407c86-ff087612_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:34.585668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.585673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.585676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:34.585687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.585703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:34.585733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.585970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.585985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.586007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.586194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1385 partition: 0 MaxSeqNo: 40 sessionId: src_id|5b82af29-8438ef6f-ff407c86-ff087612_0
2025-10-10T14:34:34.586605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde1898-493b0ecf-ae5a75da-22d90a72_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5b82af29-8438ef6f-ff407c86-ff087612_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:34.589323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b82af29-8438ef6f-ff407c86-ff087612_0] Write session: try to update token
2025-10-10T14:34:34.589362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b82af29-8438ef6f-ff407c86-ff087612_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:34.605264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId: src_id|5b82af29-8438ef6f-ff407c86-ff087612_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:34.607872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:34.608419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.608455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.608481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:34.608484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:34.608488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:34.608490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:34.608499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601462830534194:8278]
2025-10-10T14:34:34.608506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601462830534194:8278]
2025-10-10T14:34:34.608518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601462830534194:8278]
2025-10-10T14:34:34.608558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:34.608572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:34.608576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:34.608582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:34.608590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.608593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:34.608731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:34.653897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601463612757800:2527]
2025-10-10T14:34:34.654378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1384, pipe: [1:7559601463612757800:2527]
2025-10-10T14:34:34.728847Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:34.729137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:34.729218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757800:2527], now have 1 active actors on pipe
2025-10-10T14:34:34.729290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:34.729384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601463612757800:2527]
2025-10-10T14:34:34.729825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b82af29-8438ef6f-ff407c86-ff087612_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:34.729843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b82af29-8438ef6f-ff407c86-ff087612_0] Write session will restart in 0.009065s
2025-10-10T14:34:34.729870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b82af29-8438ef6f-ff407c86-ff087612_0] Write session: Do CDS request
2025-10-10T14:34:34.729413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:34.729875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b82af29-8438ef6f-ff407c86-ff087612_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:34.729423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:34.729424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:34.729513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1385 reason: error at write: Disconnected sessionId: src_id|5b82af29-8438ef6f-ff407c86-ff087612_0
2025-10-10T14:34:34.729686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1385 sessionId: src_id|5b82af29-8438ef6f-ff407c86-ff087612_0 is DEAD
2025-10-10T14:34:34.739995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b82af29-8438ef6f-ff407c86-ff087612_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.740210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:34.740229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1386
2025-10-10T14:34:34.740391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.740442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:34.740453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:34.740457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:34.741035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1386 sessionId:  describe result for acl check
2025-10-10T14:34:34.741074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:34.741080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:34.741085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:34.741092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601463612757865:8567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:34.741691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601463612757865:8567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:34.744603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601463612757865:8567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:34.747270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601463612757865:8567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:34.747285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601463612757865:8567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:34.747288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601463612757865:8567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:34.747296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:34.748067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:34.750192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:34.750402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:34.750413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:34.750424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:34.750480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:34.750519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601462830534420:8281]
2025-10-10T14:34:34.751164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:34.751465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:34.751534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:34.751845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:34.751949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.751957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.751959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.751960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.751961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.751962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.751963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.751965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.751966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.751967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.751969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.751970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.751971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.751977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.751990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.751994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.751998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.752002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.752006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.752010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.752014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.752017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.752022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.752025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.752029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.752032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.752041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.752049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.752056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.752061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.752066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.752071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.752075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.752081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.752092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.752097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.752101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.752106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.752111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.752116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.752121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.752126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.752130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.752135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.752146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.752151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.752155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.752164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.752182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.752192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.752196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.752201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.752245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:34.754714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:34.755172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:34.755188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:34.755191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:34.755195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:34.755201Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1385 [2:7559601462830534420:8281]
2025-10-10T14:34:34.755214Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:34.755236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:34.755244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.755247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.755250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.755277Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:34.755291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:34.755300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:34.755370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.755379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.755381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.755384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:34.755450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:34.755459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.755472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.755490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.755510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:34.755537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612758014:8567], now have 1 active actors on pipe
2025-10-10T14:34:34.755546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612757804:2438], now have 1 active actors on pipe
2025-10-10T14:34:34.755554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601462830534415:8281]
2025-10-10T14:34:34.755556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601462830534415:8281]
2025-10-10T14:34:34.755558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601462830534415:8281]
2025-10-10T14:34:34.755574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:34.755588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:34.755611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:34.755617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:34.755631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1385
2025-10-10T14:34:34.755638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1385
2025-10-10T14:34:34.755640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601462830534415:8281]
2025-10-10T14:34:34.755647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:34.755667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:34.755670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:34.755672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:34.755680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:34.755730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.755741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.755772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:34.755785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.755789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.755791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:34.755803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.755814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:34.755834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.755997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.756009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.756028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.756143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1386 partition: 0 MaxSeqNo: 40 sessionId: src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0
2025-10-10T14:34:34.756577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b82af29-8438ef6f-ff407c86-ff087612_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:34.759249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0] Write session: try to update token
2025-10-10T14:34:34.759269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:34.767944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:34.767966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:34.767979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601462830534415:8281]
2025-10-10T14:34:34.768035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:34.768037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:34.768281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:34.768462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:34.768615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:34.768765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:34.768983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:34.769040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:34.777484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId: src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:34.780360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.780400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.780454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:34.780126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:34.780547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:34.788047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:34.788092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:34.788099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:34.788102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:34.788114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601462830534415:8281]
2025-10-10T14:34:34.788119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601462830534415:8281]
2025-10-10T14:34:34.788123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601462830534415:8281]
2025-10-10T14:34:34.788168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:34.788181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:34.788185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:34.788193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:34.788201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.788205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:34.788375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:34.829505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601463612758028:2527]
2025-10-10T14:34:34.829839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1385, pipe: [1:7559601463612758028:2527]
2025-10-10T14:34:34.902694Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:34.911218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.911250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.911429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.911496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.911560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.911626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.912036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.912055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.912300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.912359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.912421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.912489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.912531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.912534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.912602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.912664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.912759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.912820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.912862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.912865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.912937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.913006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.913071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.913130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.913172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.913176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.913246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.913303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.913491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.913559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.913607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.913615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.913681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.913742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.913811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.913875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.913919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.913927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.913994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.914059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.914127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.914194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.914241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.914248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.914316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.914382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.914443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.914513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.914558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.914566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.914632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.914692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.915496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:34.915501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:34.915517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:34.915548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601463612758028:2527]
2025-10-10T14:34:34.915565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1386 reason: error at write: Disconnected sessionId: src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0
2025-10-10T14:34:34.915943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:34.915955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0] Write session will restart in 0.007481s
2025-10-10T14:34:34.915990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0] Write session: Do CDS request
2025-10-10T14:34:34.915996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:34.915796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1386 sessionId: src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0 is DEAD
2025-10-10T14:34:34.914756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.914826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.914868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.914871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.914942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:34.915000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:34.915062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:34.915124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:34.915166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:34.915169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:34.915238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612758028:2527], now have 1 active actors on pipe
2025-10-10T14:34:34.915728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:34.925930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.926027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:34.926050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1387
2025-10-10T14:34:34.929586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:34.929660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:34.929671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:34.929675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:34.930200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1387 sessionId:  describe result for acl check
2025-10-10T14:34:34.930240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:34.930242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:34.930244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:34.930250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601463612758161:8571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:34.930888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601463612758161:8571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:34.934582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601463612758161:8571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:34.936087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:34.939421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601463612758161:8571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:34.939441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601463612758161:8571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:34.939445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601463612758161:8571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:34.939454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:34.939206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:34.939444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:34.939450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:34.939462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:34.939529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:34.939569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601462830534639:8283]
2025-10-10T14:34:34.940210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:34.940520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:34.940588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:34.940955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:34.941030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.941031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.941033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.941034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.941035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.941036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.941037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.941039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.941040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.941041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.941043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.941044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.941046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.941052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.941064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.941069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.941074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.941078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.941083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.941087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.941091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.941095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.941100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.941104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.941109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.941113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.941121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.941130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:34.941137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.941142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:34.941146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.941152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:34.941156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.941162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:34.941167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.941172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:34.941176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.941180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:34.941184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.941189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:34.941193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.941198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:34.941203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.941209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:34.941215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.941220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:34.941225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.941230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.941237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.941242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.941246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.941252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.941294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:34.944342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:34.944792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:34.944806Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:34.944809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:34.944813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:34.944819Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1386 [2:7559601462830534639:8283]
2025-10-10T14:34:34.944834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:34.944858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:34.944866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.944870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.944872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.944890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:34.944901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:34.944909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:34.944967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.944976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.944978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.944980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:34.945054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:34.945062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.945075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:34.945088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:34.945111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:34.945137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612758242:8571], now have 1 active actors on pipe
2025-10-10T14:34:34.945147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601463612758030:2438], now have 1 active actors on pipe
2025-10-10T14:34:34.945154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601462830534634:8283]
2025-10-10T14:34:34.945157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601462830534634:8283]
2025-10-10T14:34:34.945159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601462830534634:8283]
2025-10-10T14:34:34.945172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:34.945187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:34.945233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1386
2025-10-10T14:34:34.945260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1386
2025-10-10T14:34:34.945196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:34.945203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:34.945206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:34.945207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:34.945209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:34.945233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601462830534634:8283]
2025-10-10T14:34:34.945243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:34.945260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:34.945288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.945292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.945343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:34.945352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:34.945356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:34.945358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:34.945370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:34.945380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:34.945403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.945695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:34.945709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:34.945729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:34.945843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1387 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0
2025-10-10T14:34:34.946302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72dcbd79-663cf047-ba859e6e-e17a394b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:34.949120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0] Write session: try to update token
2025-10-10T14:34:34.949139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:34.966798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:34.966820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:34.966824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:34.966826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:34.966837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601462830534634:8283]
2025-10-10T14:34:34.966842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601462830534634:8283]
2025-10-10T14:34:34.966845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601462830534634:8283]
2025-10-10T14:34:34.966898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:34.966899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:34.966907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:34.966912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:34.966913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:34.966916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:34.967071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:34.968267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId: src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:34.971369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:35.017538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601467907725550:2527]
2025-10-10T14:34:35.017840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1386, pipe: [1:7559601467907725550:2527]
2025-10-10T14:34:35.084276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:35.084727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.084744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.084793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907725550:2527], now have 1 active actors on pipe
2025-10-10T14:34:35.085100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:35.085124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601467907725550:2527]
2025-10-10T14:34:35.085130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:35.085135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:35.085173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:35.085203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1387 reason: error at write: Disconnected sessionId: src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0
2025-10-10T14:34:35.085447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1387 sessionId: src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0 is DEAD
2025-10-10T14:34:35.086094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:35.086106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0] Write session will restart in 0.005953s
2025-10-10T14:34:35.086133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0] Write session: Do CDS request
2025-10-10T14:34:35.086142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:35.093180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.093247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:35.093267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1388
2025-10-10T14:34:35.097012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.097078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:35.097084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:35.097089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:35.097648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1388 sessionId:  describe result for acl check
2025-10-10T14:34:35.097690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:35.097697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:35.097699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:35.097705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601467907725592:8575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:35.098310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601467907725592:8575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:35.102244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601467907725592:8575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:35.112849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:35.112965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601467907725592:8575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:35.112988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601467907725592:8575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:35.112992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601467907725592:8575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:35.113001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:35.115459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:35.115722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:35.115735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:35.115749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:35.115811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:35.115873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601467125502157:8285]
2025-10-10T14:34:35.116494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:35.116862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:35.116917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:35.117271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:35.117361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.117362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.117364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.117365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.117367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.117368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.117370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.117371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.117372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.117373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.117375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.117376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.117377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.117385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.117400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.117404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.117408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.117413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.117418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.117423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.117427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.117432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.117436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.117441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.117445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.117450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.117458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.117467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.117474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.117481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.117486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.117492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.117498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.117504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.117511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.117517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.117521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.117527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.117532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.117537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.117542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.117548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.117555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.117561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.117566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.117572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.117577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.117583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.117587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.117594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.117599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.117605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.117667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:35.121282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:35.121656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:35.121673Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:35.121676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:35.121680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:35.121687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1387 [2:7559601467125502157:8285]
2025-10-10T14:34:35.121702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:35.121722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:35.121732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.121735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.121738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.121757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:35.121770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:35.121778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:35.121846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.121855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.121857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.121860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:35.121935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:35.121948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.121961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.121975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.121995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:35.122093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1387
2025-10-10T14:34:35.122024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907725763:8575], now have 1 active actors on pipe
2025-10-10T14:34:35.122035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907725551:2438], now have 1 active actors on pipe
2025-10-10T14:34:35.122043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601467125502151:8285]
2025-10-10T14:34:35.122048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601467125502151:8285]
2025-10-10T14:34:35.122050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601467125502151:8285]
2025-10-10T14:34:35.122065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:35.122085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:35.122087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:35.122089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:35.122095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:35.122112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:35.122115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:35.122146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601467125502151:8285]
2025-10-10T14:34:35.122155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:35.122174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:35.122176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1387
2025-10-10T14:34:35.122528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.122542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.122575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:35.122591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.122596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.122598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:35.122612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.122623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:35.122638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.122810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.122826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.122850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.123073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1388 partition: 0 MaxSeqNo: 40 sessionId: src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0
2025-10-10T14:34:35.123549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c1c98a-65bd9548-72d8dc8f-b0528e3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:35.126250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0] Write session: try to update token
2025-10-10T14:34:35.126268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:35.143464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId: src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:35.142811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:35.142838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:35.142842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:35.142845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:35.142856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601467125502151:8285]
2025-10-10T14:34:35.142861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601467125502151:8285]
2025-10-10T14:34:35.142865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601467125502151:8285]
2025-10-10T14:34:35.142923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:35.142923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:35.142931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:35.142931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.142934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:35.142940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:35.143089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:35.146228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:35.185404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601467907725777:2527]
2025-10-10T14:34:35.185711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1387, pipe: [1:7559601467907725777:2527]
2025-10-10T14:34:35.259112Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:35.259713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.259733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.259795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907725777:2527], now have 1 active actors on pipe
2025-10-10T14:34:35.260097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:35.260108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601467907725777:2527]
2025-10-10T14:34:35.260116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:35.260160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:35.260164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:35.260225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1388 reason: error at write: Disconnected sessionId: src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0
2025-10-10T14:34:35.260432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1388 sessionId: src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0 is DEAD
2025-10-10T14:34:35.260580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:35.260588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0] Write session will restart in 0.009231s
2025-10-10T14:34:35.260615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0] Write session: Do CDS request
2025-10-10T14:34:35.260621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:35.270964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.271695Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:35.271716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1389
2025-10-10T14:34:35.271902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.271961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:35.271971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:35.271975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:35.272514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1389 sessionId:  describe result for acl check
2025-10-10T14:34:35.272553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:35.272559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:35.272561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:35.272568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601467907725852:8579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:35.273122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601467907725852:8579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:35.276298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601467907725852:8579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:35.279264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:35.281849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:35.282112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:35.282126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:35.282139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:35.282202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:35.282247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601467125502378:8287]
2025-10-10T14:34:35.282312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601467907725852:8579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:35.282346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601467907725852:8579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:35.282350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601467907725852:8579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:35.282360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:35.282877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:35.283178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:35.283226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:35.283564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:35.283640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.283646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.283648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.283649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.283650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.283651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.283652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.283653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.283654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.283655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.283657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.283658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.283659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.283665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.283678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.283682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.283685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.283689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.283692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.283697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.283700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.283703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.283707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.283710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.283714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.283718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.283725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.283734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.283741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.283747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.283752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.283757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.283760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.283765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.283770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.283774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.283779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.283783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.283788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.283793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.283797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.283801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.283805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.283809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.283815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.283821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.283826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.283832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.283849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.283855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.283860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.283872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.283915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:35.286561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:35.287302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:35.287317Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:35.287320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:35.287323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:35.287329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1388 [2:7559601467125502378:8287]
2025-10-10T14:34:35.287344Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:35.287364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:35.287373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.287376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.287378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.287397Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:35.287411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:35.287419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:35.287484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.287492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.287495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.287498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:35.287570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:35.287580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.287592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.287603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.287622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:35.287644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907725993:8579], now have 1 active actors on pipe
2025-10-10T14:34:35.287654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907725778:2438], now have 1 active actors on pipe
2025-10-10T14:34:35.287664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601467125502373:8287]
2025-10-10T14:34:35.287667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601467125502373:8287]
2025-10-10T14:34:35.287669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601467125502373:8287]
2025-10-10T14:34:35.287685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:35.287706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:35.287710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:35.287714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:35.287716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:35.287723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:35.287726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:35.287746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1388
2025-10-10T14:34:35.287746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1388
2025-10-10T14:34:35.287755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601467125502373:8287]
2025-10-10T14:34:35.287770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:35.287791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:35.287858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.287870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.287904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce075783-8bab7e62-b7b32479-5a359859_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:35.287917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.287928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.287930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:35.287942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.287958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:35.287979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.288177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.288201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.288224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.288320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1389 partition: 0 MaxSeqNo: 40 sessionId: src_id|ce075783-8bab7e62-b7b32479-5a359859_0
2025-10-10T14:34:35.288768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de529f32-153caf2-d1615fb3-de6dbb8c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ce075783-8bab7e62-b7b32479-5a359859_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:35.291444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce075783-8bab7e62-b7b32479-5a359859_0] Write session: try to update token
2025-10-10T14:34:35.291462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce075783-8bab7e62-b7b32479-5a359859_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:35.307231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId: src_id|ce075783-8bab7e62-b7b32479-5a359859_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:35.308388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:35.308407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:35.308410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:35.308413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:35.308424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601467125502373:8287]
2025-10-10T14:34:35.308429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601467125502373:8287]
2025-10-10T14:34:35.308433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601467125502373:8287]
2025-10-10T14:34:35.308484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:35.308497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.308500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:35.308636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:35.308640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:35.308665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:35.308669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:35.310101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:35.360427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601467907726005:2527]
2025-10-10T14:34:35.360728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1388, pipe: [1:7559601467907726005:2527]
2025-10-10T14:34:35.424517Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:35.424917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.424927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.424975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726005:2527], now have 1 active actors on pipe
2025-10-10T14:34:35.425361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:35.425408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:35.425414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:35.425418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:35.425470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601467907726005:2527]
2025-10-10T14:34:35.425485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1389 reason: error at write: Disconnected sessionId: src_id|ce075783-8bab7e62-b7b32479-5a359859_0
2025-10-10T14:34:35.425732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1389 sessionId: src_id|ce075783-8bab7e62-b7b32479-5a359859_0 is DEAD
2025-10-10T14:34:35.425907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce075783-8bab7e62-b7b32479-5a359859_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:35.425922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce075783-8bab7e62-b7b32479-5a359859_0] Write session will restart in 0.009911s
2025-10-10T14:34:35.425957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce075783-8bab7e62-b7b32479-5a359859_0] Write session: Do CDS request
2025-10-10T14:34:35.425968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce075783-8bab7e62-b7b32479-5a359859_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:35.438160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce075783-8bab7e62-b7b32479-5a359859_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.440630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:35.440648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1390
2025-10-10T14:34:35.440903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.440940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:35.440945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:35.440949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:35.441826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1390 sessionId:  describe result for acl check
2025-10-10T14:34:35.441866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:35.441868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:35.441869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:35.441876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601467907726087:8583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:35.442430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601467907726087:8583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:35.447504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601467907726087:8583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:35.450568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601467907726087:8583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:35.450588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601467907726087:8583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:35.450592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601467907726087:8583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:35.450601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:35.450842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:35.453984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:35.454230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:35.454246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:35.454261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:35.454329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:35.454375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601467125502604:8289]
2025-10-10T14:34:35.454986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:35.455406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:35.455453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:35.455768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:35.455847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.455857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.455858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.455859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.455860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.455862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.455863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.455864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.455866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.455867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.455868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.455869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.455871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.455877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.455891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.455895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.455899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.455903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.455907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.455911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.455915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.455918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.455923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.455927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.455930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.455934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.455943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.455952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.455958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.455963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.455973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.455978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.455986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.455992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.456001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.456008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.456016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.456022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.456026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.456031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.456038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.456045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.456050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.456059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.456063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.456073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.456078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.456083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.456088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.456093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.456101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.456114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.456163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:35.459432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:35.459866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:35.459880Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:35.459883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:35.459887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:35.459896Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1389 [2:7559601467125502604:8289]
2025-10-10T14:34:35.459911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:35.459934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:35.459942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.459946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.459948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.459965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:35.459972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:35.459980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:35.460046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.460057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.460058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.460061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:35.460177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:35.460185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.460198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.460211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.460234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:35.460258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726006:2438], now have 1 active actors on pipe
2025-10-10T14:34:35.460267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726221:8583], now have 1 active actors on pipe
2025-10-10T14:34:35.460275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601467125502596:8289]
2025-10-10T14:34:35.460278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601467125502596:8289]
2025-10-10T14:34:35.460279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601467125502596:8289]
2025-10-10T14:34:35.460301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1389
2025-10-10T14:34:35.460357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1389
2025-10-10T14:34:35.460295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:35.460314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:35.460317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:35.460318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:35.460321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:35.460335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:35.460338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:35.460376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601467125502596:8289]
2025-10-10T14:34:35.460381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:35.460384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:35.460437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.460442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.460481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:35.460489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.460492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.460494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:35.460506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.460517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:35.460545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.460740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.460753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.460770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.460918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1390 partition: 0 MaxSeqNo: 40 sessionId: src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0
2025-10-10T14:34:35.461318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce075783-8bab7e62-b7b32479-5a359859_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:35.464034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0] Write session: try to update token
2025-10-10T14:34:35.464056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:35.480081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId: src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:35.482556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:35.482585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:35.482589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:35.482591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:35.482600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601467125502596:8289]
2025-10-10T14:34:35.482605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601467125502596:8289]
2025-10-10T14:34:35.482608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601467125502596:8289]
2025-10-10T14:34:35.482663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:35.482678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:35.482680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.482683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:35.482685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:35.482689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:35.482832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:35.482987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:35.525826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601467907726247:2527]
2025-10-10T14:34:35.526095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1389, pipe: [1:7559601467907726247:2527]
2025-10-10T14:34:35.601922Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:35.602225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.602236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.602285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726247:2527], now have 1 active actors on pipe
2025-10-10T14:34:35.602545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:35.602573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601467907726247:2527]
2025-10-10T14:34:35.602604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:35.602607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:35.602672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1390 reason: error at write: Disconnected sessionId: src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0
2025-10-10T14:34:35.602919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1390 sessionId: src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0 is DEAD
2025-10-10T14:34:35.603104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:35.603117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0] Write session will restart in 0.009118s
2025-10-10T14:34:35.603142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0] Write session: Do CDS request
2025-10-10T14:34:35.603149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:35.602689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:35.617220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.617744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:35.617763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1391
2025-10-10T14:34:35.617884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.617932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:35.617942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:35.617946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:35.618397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1391 sessionId:  describe result for acl check
2025-10-10T14:34:35.618436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:35.618438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:35.618440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:35.618446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601467907726418:8597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:35.619883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601467907726418:8597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:35.621663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:35.622036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601467907726418:8597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:35.624519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:35.624786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:35.624800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:35.624813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:35.624874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:35.624924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601467125502875:8305]
2025-10-10T14:34:35.625281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601467907726418:8597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:35.625298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601467907726418:8597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:35.625302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601467907726418:8597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:35.625311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:35.625525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:35.625848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:35.625907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:35.626249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:35.626310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.626317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.626318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.626319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.626321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.626322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.626323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.626325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.626326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.626328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.626329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.626331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.626332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.626338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.626352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.626357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.626362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.626366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.626370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.626375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.626378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.626382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.626387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.626391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.626395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.626399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.626407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.626416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.626423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.626430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.626435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.626444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.626451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.626459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.626467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.626477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.626482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.626487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.626492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.626497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.626502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.626507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.626519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.626529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.626536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.626543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.626552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.626557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.626561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.626567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.626571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.626581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.626625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:35.629585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:35.630113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:35.630119Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:35.630121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:35.630125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:35.630131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1390 [2:7559601467125502875:8305]
2025-10-10T14:34:35.630145Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:35.630163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:35.630167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.630171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.630173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.630193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:35.630201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:35.630209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:35.630281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.630283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.630285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.630288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:35.630361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:35.630365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.630377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.630389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.630406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:35.630429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601467125502870:8305]
2025-10-10T14:34:35.630431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601467125502870:8305]
2025-10-10T14:34:35.630433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601467125502870:8305]
2025-10-10T14:34:35.630453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:35.630469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:35.630486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:35.630489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:35.630506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:35.630510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:35.630512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:35.630525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601467125502870:8305]
2025-10-10T14:34:35.630528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:35.630593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:35.630707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726495:8597], now have 1 active actors on pipe
2025-10-10T14:34:35.630713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726271:2438], now have 1 active actors on pipe
2025-10-10T14:34:35.630914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1390
2025-10-10T14:34:35.630916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1390
2025-10-10T14:34:35.631099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.631114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.631151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:35.631169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.631174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.631176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:35.631189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.631204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:35.631229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.631739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.631755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.631778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.631907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1391 partition: 0 MaxSeqNo: 40 sessionId: src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0
2025-10-10T14:34:35.632353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a0ab00-9db449db-9cfc8c83-7c0d02f3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:35.635251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0] Write session: try to update token
2025-10-10T14:34:35.635277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:35.651040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:35.651068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:35.651072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:35.651075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:35.651085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601467125502870:8305]
2025-10-10T14:34:35.651089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601467125502870:8305]
2025-10-10T14:34:35.651093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601467125502870:8305]
2025-10-10T14:34:35.651146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:35.651145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:35.651152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:35.651154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.651156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:35.651156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:35.651303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:35.654844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId: src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:35.657613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:35.702459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601467907726510:2527]
2025-10-10T14:34:35.702769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1390, pipe: [1:7559601467907726510:2527]
2025-10-10T14:34:35.764206Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:35.764666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.764685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.764736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726510:2527], now have 1 active actors on pipe
2025-10-10T14:34:35.765024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:35.765000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:35.765018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:35.765090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1391 reason: error at write: Disconnected sessionId: src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0
2025-10-10T14:34:35.765306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:35.765307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1391 sessionId: src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0 is DEAD
2025-10-10T14:34:35.765375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601467907726510:2527]
2025-10-10T14:34:35.765525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:35.765537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0] Write session will restart in 0.005255s
2025-10-10T14:34:35.765570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0] Write session: Do CDS request
2025-10-10T14:34:35.765577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:35.771920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.772035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:35.772053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1392
2025-10-10T14:34:35.772193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.772229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:35.772240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:35.772244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:35.772721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1392 sessionId:  describe result for acl check
2025-10-10T14:34:35.772759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:35.772765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:35.772768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:35.772774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601467907726526:8602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:35.773325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601467907726526:8602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:35.776359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601467907726526:8602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:35.779980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601467907726526:8602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:35.779999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601467907726526:8602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:35.780003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601467907726526:8602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:35.780013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:35.783324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:35.785795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:35.786037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:35.786048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:35.786061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:35.786122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:35.786164Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601467125503103:8308]
2025-10-10T14:34:35.786807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:35.787133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:35.787190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:35.787542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:35.787607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.787612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.787613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.787614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.787615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.787617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.787618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.787619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.787621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.787622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.787624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.787625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.787627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.787632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.787646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.787650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.787654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.787658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.787662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.787666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.787670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.787674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.787679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.787682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.787686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.787690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.787698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.787707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.787714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.787719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.787724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.787730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.787736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.787742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.787746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.787751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.787756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.787761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.787766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.787771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.787782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.787787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.787793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.787798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.787802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.787808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.787813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.787831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.787840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.787845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.787850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.787855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.787896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:35.790363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:35.790819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:35.790829Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:35.790832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:35.790844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:35.790851Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1391 [2:7559601467125503103:8308]
2025-10-10T14:34:35.790863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:35.790886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:35.790895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.790899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.790902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.790929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:35.790941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:35.790951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:35.791014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.791021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.791023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.791026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:35.791092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:35.791100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.791111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.791128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.791144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:35.791166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726678:8602], now have 1 active actors on pipe
2025-10-10T14:34:35.791174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726511:2438], now have 1 active actors on pipe
2025-10-10T14:34:35.791181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601467125503098:8308]
2025-10-10T14:34:35.791183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601467125503098:8308]
2025-10-10T14:34:35.791186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601467125503098:8308]
2025-10-10T14:34:35.791200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:35.791215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:35.791234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:35.791242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:35.791268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601467125503098:8308]
2025-10-10T14:34:35.791273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:35.791307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:35.791316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:35.791318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:35.791325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:35.791285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1391
2025-10-10T14:34:35.791291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1391
2025-10-10T14:34:35.791435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.791445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.791480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:35.791488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.791492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.791494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:35.791505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.791517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:35.791532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.791734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.791743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.791761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.791878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1392 partition: 0 MaxSeqNo: 40 sessionId: src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0
2025-10-10T14:34:35.792277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af15fe73-ce38f25d-a9214c6c-75d19ef0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:35.795074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0] Write session: try to update token
2025-10-10T14:34:35.795095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:35.811009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:35.811027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:35.811030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:35.811032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:35.811045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601467125503098:8308]
2025-10-10T14:34:35.811049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601467125503098:8308]
2025-10-10T14:34:35.811053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601467125503098:8308]
2025-10-10T14:34:35.811109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:35.811118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:35.811124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.811127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:35.811127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:35.811131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:35.811285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:35.811722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId: src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:35.814403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:35.869451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601467907726740:2527]
2025-10-10T14:34:35.869766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1391, pipe: [1:7559601467907726740:2527]
2025-10-10T14:34:35.925478Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:35.926052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.926063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.926112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726740:2527], now have 1 active actors on pipe
2025-10-10T14:34:35.926422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601467907726740:2527]
2025-10-10T14:34:35.926467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:35.926551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:35.926554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:35.926626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1392 reason: error at write: Disconnected sessionId: src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0
2025-10-10T14:34:35.926435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:35.926838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1392 sessionId: src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0 is DEAD
2025-10-10T14:34:35.927019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:35.927030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0] Write session will restart in 0.007442s
2025-10-10T14:34:35.927055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0] Write session: Do CDS request
2025-10-10T14:34:35.927065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:35.936972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.937381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:35.937415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1393
2025-10-10T14:34:35.937689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:35.937739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:35.937750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:35.937754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:35.938262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1393 sessionId:  describe result for acl check
2025-10-10T14:34:35.938320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:35.938330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:35.938332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:35.938339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601467907726791:8606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:35.938943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601467907726791:8606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:35.942185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601467907726791:8606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:35.945667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:35.948709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:35.948956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:35.948967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:35.948980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:35.949042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:35.949100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601467125503328:8310]
2025-10-10T14:34:35.949095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601467907726791:8606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:35.949116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601467907726791:8606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:35.949120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601467907726791:8606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:35.949130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:35.949699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:35.950136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:35.950203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:35.950571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:35.950641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.950643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.950644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.950645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.950646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.950647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.950648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.950649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.950651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.950652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.950654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.950655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.950656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.950662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.950675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.950678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.950682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.950685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.950688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.950691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.950695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.950698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.950702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.950705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.950708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.950711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.950720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.950728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:35.950734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.950739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:35.950745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.950750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:35.950754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.950758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:35.950766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.950770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:35.950775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.950779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:35.950785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.950789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:35.950793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.950797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:35.950802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.950806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:35.950809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.950814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:35.950818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.950823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.950826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.950831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.950835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.950840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.950892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:35.954972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:35.955458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:35.955474Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:35.955477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:35.955482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:35.955489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1392 [2:7559601467125503328:8310]
2025-10-10T14:34:35.955505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:35.955527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:35.955535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.955539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.955541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.955561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:35.955574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:35.955601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:35.955667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.955676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.955679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.955682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:35.955765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:35.955774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.955785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:35.955795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:35.955811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:35.955851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726957:8606], now have 1 active actors on pipe
2025-10-10T14:34:35.955860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601467907726741:2438], now have 1 active actors on pipe
2025-10-10T14:34:35.955870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601467125503323:8310]
2025-10-10T14:34:35.955874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601467125503323:8310]
2025-10-10T14:34:35.955876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601467125503323:8310]
2025-10-10T14:34:35.955893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:35.955906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:35.955914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:35.955916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:35.955927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:35.955933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:35.955936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:35.955933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1392
2025-10-10T14:34:35.955970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1392
2025-10-10T14:34:35.955977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601467125503323:8310]
2025-10-10T14:34:35.955991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:35.955997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:35.956141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.956153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.956190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90af7330-e3fcbc12-f89c619b-5e993607_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:35.956204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:35.956213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:35.956216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:35.956230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:35.956247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:35.956270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.956441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.956449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.956466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:35.956570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1393 partition: 0 MaxSeqNo: 40 sessionId: src_id|90af7330-e3fcbc12-f89c619b-5e993607_0
2025-10-10T14:34:35.957434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbddca81-d09f5b7c-506f8a2-c4ab9cb6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90af7330-e3fcbc12-f89c619b-5e993607_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:35.960211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90af7330-e3fcbc12-f89c619b-5e993607_0] Write session: try to update token
2025-10-10T14:34:35.960232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90af7330-e3fcbc12-f89c619b-5e993607_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:35.978576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:35.978592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:35.978605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601467125503323:8310]
2025-10-10T14:34:35.978836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId: src_id|90af7330-e3fcbc12-f89c619b-5e993607_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:35.978661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:35.978659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:35.978854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:35.979003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:35.979149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:35.979291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:35.979509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:35.979548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:35.981559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:35.982309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:35.982328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:35.982385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:35.982488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:35.997777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:35.997795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:35.997798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:35.997800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:35.997813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601467125503323:8310]
2025-10-10T14:34:35.997818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601467125503323:8310]
2025-10-10T14:34:35.997822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601467125503323:8310]
2025-10-10T14:34:35.997872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:35.997880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:35.997883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:35.998026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:35.998029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:35.998036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:35.998041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:36.026593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601472202694266:2527]
2025-10-10T14:34:36.027496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1392, pipe: [1:7559601472202694266:2527]
2025-10-10T14:34:36.118131Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:36.126864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.126898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.127093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.127163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.127232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.127312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.127366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.127370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.127443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.127504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.127562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.127636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.127684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.127686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.127773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.127867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.127957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.128061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.128132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.128136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.128250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.128335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.128427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.128544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.128618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.128623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.128721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.128803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.128895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.129028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.129094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.129100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.129176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.129234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.129296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.129670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.129764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.129783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.129924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.130071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.130232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.130386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.130469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.130483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.130616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.132679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601472202694266:2527]
2025-10-10T14:34:36.132722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:36.132724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:36.132727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:36.132761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1393 reason: error at write: Disconnected sessionId: src_id|90af7330-e3fcbc12-f89c619b-5e993607_0
2025-10-10T14:34:36.133246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90af7330-e3fcbc12-f89c619b-5e993607_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:36.133259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90af7330-e3fcbc12-f89c619b-5e993607_0] Write session will restart in 0.005986s
2025-10-10T14:34:36.133286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90af7330-e3fcbc12-f89c619b-5e993607_0] Write session: Do CDS request
2025-10-10T14:34:36.133292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90af7330-e3fcbc12-f89c619b-5e993607_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:36.133002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1393 sessionId: src_id|90af7330-e3fcbc12-f89c619b-5e993607_0 is DEAD
2025-10-10T14:34:36.130749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.130895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.131039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.131118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.131123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.131266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.131395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.131524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.131668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.131739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.131744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.131903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.132033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.132165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.132250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.132302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.132305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.132393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694266:2527], now have 1 active actors on pipe
2025-10-10T14:34:36.133883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:36.140891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90af7330-e3fcbc12-f89c619b-5e993607_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.141034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:36.141054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1394
2025-10-10T14:34:36.141298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.141367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:36.141373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:36.141378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:36.142017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1394 sessionId:  describe result for acl check
2025-10-10T14:34:36.142058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:36.142059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:36.142061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:36.142067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601472202694283:8610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:36.142681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601472202694283:8610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:36.155102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601472202694283:8610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:36.162955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601472202694283:8610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:36.162978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601472202694283:8610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:36.162982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601472202694283:8610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:36.162993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:36.177180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:36.180281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:36.180584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:36.180605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:36.180635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:36.180747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:36.180813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601471420470852:8312]
2025-10-10T14:34:36.181575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:36.182005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:36.182066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:36.182443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:36.182526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.182528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.182529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.182531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.182532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.182534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.182535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.182536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.182537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.182539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.182540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.182541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.182542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.182549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.182563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.182567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.182572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.182576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.182581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.182585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.182589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.182593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.182598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.182603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.182607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.182611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.182622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.182631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.182639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.182646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.182650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.182655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.182660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.182666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.182670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.182676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.182682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.182688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.182693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.182697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.182702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.182708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.182714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.182720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.182724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.182731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.182736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.182743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.182747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.182752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.182756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.182761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.182800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:36.188632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:36.189131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:36.189137Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:36.189139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:36.189143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:36.189151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1393 [2:7559601471420470852:8312]
2025-10-10T14:34:36.189167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:36.189189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:36.189194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.189197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.189201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.189221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:36.189229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:36.189238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:36.189303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.189305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.189307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.189310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:36.189408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:36.189411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.189423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.189432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.189447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:36.189468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601471420470846:8312]
2025-10-10T14:34:36.189471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601471420470846:8312]
2025-10-10T14:34:36.189473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601471420470846:8312]
2025-10-10T14:34:36.189481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:36.189498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:36.189505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:36.189509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:36.189511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:36.189513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:36.189517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:36.189528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694388:8610], now have 1 active actors on pipe
2025-10-10T14:34:36.189531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694268:2438], now have 1 active actors on pipe
2025-10-10T14:34:36.189569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601471420470846:8312]
2025-10-10T14:34:36.189579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:36.189777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:36.193457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1393
2025-10-10T14:34:36.193508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1393
2025-10-10T14:34:36.193588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.193608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.193658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:36.193671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.193681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.193685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:36.193716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.193738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:36.193763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.194095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.194103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.194125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.194425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1394 partition: 0 MaxSeqNo: 40 sessionId: src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0
2025-10-10T14:34:36.194977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90af7330-e3fcbc12-f89c619b-5e993607_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:36.197896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0] Write session: try to update token
2025-10-10T14:34:36.197917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:36.210989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:36.211007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:36.211011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:36.211013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:36.211023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601471420470846:8312]
2025-10-10T14:34:36.211026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601471420470846:8312]
2025-10-10T14:34:36.211029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601471420470846:8312]
2025-10-10T14:34:36.211086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:36.211089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:36.211094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.211096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:36.211096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:36.211100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:36.211227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:36.221043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId: src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:36.223972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:36.232916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601472202694499:2527]
2025-10-10T14:34:36.233399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1393, pipe: [1:7559601472202694499:2527]
2025-10-10T14:34:36.332010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:36.332495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.332513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.332538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694499:2527], now have 1 active actors on pipe
2025-10-10T14:34:36.332789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:36.332806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:36.332827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:36.332899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1394 reason: error at write: Disconnected sessionId: src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0
2025-10-10T14:34:36.333163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1394 sessionId: src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0 is DEAD
2025-10-10T14:34:36.333365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:36.333404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601472202694499:2527]
2025-10-10T14:34:36.333639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:36.333651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0] Write session will restart in 0.009830s
2025-10-10T14:34:36.333677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0] Write session: Do CDS request
2025-10-10T14:34:36.333687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:36.345134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.345070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:36.345089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1395
2025-10-10T14:34:36.346035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.346101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:36.346111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:36.346116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:36.346566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1395 sessionId:  describe result for acl check
2025-10-10T14:34:36.346608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:36.346614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:36.346616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:36.346622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601472202694604:8616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:36.352886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:36.355678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:36.355948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:36.355961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:36.355976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:36.356056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:36.356110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601471420471079:8314]
2025-10-10T14:34:36.356700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:36.357014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:36.357086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:36.347193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601472202694604:8616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:36.357450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:36.357535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.357541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.357542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.357543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.357545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.357546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.357547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.357548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.357550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.357551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.357552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.357553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.357554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.357561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.357573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.357576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.357580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.357583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.357587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.357591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.357594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.357598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.357603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.357606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.357610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.357613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.357623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.357631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.357638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.357643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.357647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.357652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.357656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.357661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.357665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.357682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.357691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.357696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.357700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.357705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.357708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.357713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.357717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.357722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.357725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.357730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.357735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.357740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.357744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.357748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.357752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.357757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.357793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:36.360339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:36.360733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:36.360746Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:36.360749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:36.360752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:36.360759Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1394 [2:7559601471420471079:8314]
2025-10-10T14:34:36.360779Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:36.360802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:36.360815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.360818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.360821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.360848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:36.360859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:36.360866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:36.360929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.360936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.360938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.360940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:36.361019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:36.361026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.361037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.361046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.361060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:36.361088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694732:8616], now have 1 active actors on pipe
2025-10-10T14:34:36.361096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601471420471074:8314]
2025-10-10T14:34:36.361098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601471420471074:8314]
2025-10-10T14:34:36.361101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601471420471074:8314]
2025-10-10T14:34:36.361113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:36.361122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694510:2438], now have 1 active actors on pipe
2025-10-10T14:34:36.361134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:36.361140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:36.361143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:36.361145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:36.361149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:36.361155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:36.361185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601471420471074:8314]
2025-10-10T14:34:36.361198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:36.351429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601472202694604:8616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:36.355972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601472202694604:8616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:36.355980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601472202694604:8616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:36.355983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601472202694604:8616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:36.355993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:36.361150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1394
2025-10-10T14:34:36.361171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1394
2025-10-10T14:34:36.362298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5baa432f-d078e3a6-c8ed612f-acd510cc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aaa0fc-58395b34-eeacb798-7a82d176_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:36.365175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa0fc-58395b34-eeacb798-7a82d176_0] Write session: try to update token
2025-10-10T14:34:36.365195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa0fc-58395b34-eeacb798-7a82d176_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:36.361835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1395 partition: 0 MaxSeqNo: 40 sessionId: src_id|aaa0fc-58395b34-eeacb798-7a82d176_0
2025-10-10T14:34:36.361225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:36.361363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.361371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.361420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaa0fc-58395b34-eeacb798-7a82d176_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:36.361430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.361434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.361438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:36.361451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.361465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:36.361494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.361623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.361626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.361642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.383573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:36.383593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:36.383598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:36.383600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:36.383609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601471420471074:8314]
2025-10-10T14:34:36.383614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601471420471074:8314]
2025-10-10T14:34:36.383618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601471420471074:8314]
2025-10-10T14:34:36.383673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:36.383681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.383684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:36.383692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:36.383700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:36.383705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:36.383846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:36.384246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId: src_id|aaa0fc-58395b34-eeacb798-7a82d176_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:36.387215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:36.433639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601472202694744:2527]
2025-10-10T14:34:36.433965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1394, pipe: [1:7559601472202694744:2527]
2025-10-10T14:34:36.508393Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:36.509030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.509053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.509103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694744:2527], now have 1 active actors on pipe
2025-10-10T14:34:36.509357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:36.510335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa0fc-58395b34-eeacb798-7a82d176_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:36.510348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa0fc-58395b34-eeacb798-7a82d176_0] Write session will restart in 0.006855s
2025-10-10T14:34:36.510374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa0fc-58395b34-eeacb798-7a82d176_0] Write session: Do CDS request
2025-10-10T14:34:36.510381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa0fc-58395b34-eeacb798-7a82d176_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:36.509720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:36.509854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1395 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aaa0fc-58395b34-eeacb798-7a82d176_0
2025-10-10T14:34:36.509892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601472202694744:2527]
2025-10-10T14:34:36.509908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:36.510114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1395 sessionId: src_id|aaa0fc-58395b34-eeacb798-7a82d176_0 is DEAD
2025-10-10T14:34:36.518927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa0fc-58395b34-eeacb798-7a82d176_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.519323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:36.519347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1396
2025-10-10T14:34:36.519464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.519495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:36.519515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:36.519520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:36.519994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1396 sessionId:  describe result for acl check
2025-10-10T14:34:36.520036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:36.520038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:36.520040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:36.520049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601472202694761:8620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:36.520662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601472202694761:8620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:36.531751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601472202694761:8620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:36.539424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601472202694761:8620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:36.539447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601472202694761:8620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:36.539451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601472202694761:8620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:36.539462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:36.550523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:36.551715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:36.551947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:36.551962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:36.551975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:36.552049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:36.552093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601471420471324:8322]
2025-10-10T14:34:36.552766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:36.553586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:36.553650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:36.554012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:36.554078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.554079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.554081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.554082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.554083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.554084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.554086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.554087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.554088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.554090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.554092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.554093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.554094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.554101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.554118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.554122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.554126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.554131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.554135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.554140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.554144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.554148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.554153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.554157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.554161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.554165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.554173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.554197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.554204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.554210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.554215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.554221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.554226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.554231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.554236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.554242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.554246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.554255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.554260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.554266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.554270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.554276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.554282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.554286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.554291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.554296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.554301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.554307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.554312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.554318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.554323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.554328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.554373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:36.558804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:36.559393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:36.559399Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:36.559402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:36.559406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:36.559414Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1395 [2:7559601471420471324:8322]
2025-10-10T14:34:36.559429Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:36.559448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:36.559452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.559456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.559458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.559477Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:36.559486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:36.559495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:36.559564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.559567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.559570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.559573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:36.559641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:36.559644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.559657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.559667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.559682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:36.559707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601471420471318:8322]
2025-10-10T14:34:36.559709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601471420471318:8322]
2025-10-10T14:34:36.559711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601471420471318:8322]
2025-10-10T14:34:36.559721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:36.559736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:36.559752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:36.559757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:36.559813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601471420471318:8322]
2025-10-10T14:34:36.559816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:36.560025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:36.560028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:36.560030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:36.560038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:36.560154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694746:2438], now have 1 active actors on pipe
2025-10-10T14:34:36.560158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202694887:8620], now have 1 active actors on pipe
2025-10-10T14:34:36.560362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1395
2025-10-10T14:34:36.560404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1395
2025-10-10T14:34:36.560640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.560652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.560684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:36.560694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.560698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.560701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:36.560713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.560728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:36.560745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.561217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.561221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.561243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.561442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1396 partition: 0 MaxSeqNo: 40 sessionId: src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0
2025-10-10T14:34:36.565674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa0fc-58395b34-eeacb798-7a82d176_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:36.568512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0] Write session: try to update token
2025-10-10T14:34:36.568539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:36.574702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:36.574723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:36.574735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601471420471318:8322]
2025-10-10T14:34:36.574786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:36.574792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:36.574985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:36.575134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:36.575283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:36.575434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:36.575643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:36.575704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:36.587160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId: src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:36.590259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:36.590514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.590537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.590591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:36.594617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:36.594633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:36.594636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:36.594637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:36.594646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601471420471318:8322]
2025-10-10T14:34:36.594649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601471420471318:8322]
2025-10-10T14:34:36.594653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601471420471318:8322]
2025-10-10T14:34:36.594704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:36.594708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:36.594710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:36.594714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:36.594716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.594718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:36.594876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:36.590690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:36.610354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601472202695004:2527]
2025-10-10T14:34:36.610729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1395, pipe: [1:7559601472202695004:2527]
2025-10-10T14:34:36.711224Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:36.711589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202695004:2527], now have 1 active actors on pipe
2025-10-10T14:34:36.719747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.719776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.719966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.720029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.720090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.720154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.720275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.720279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.720353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.720421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.720483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.720550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.720596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.720598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.720668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.720738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.720808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.720875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.720925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.720933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.720999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.721061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.721123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.721184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.721229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.721236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.721299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.721424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.721505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.721578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.721641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.721650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.721719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.721782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.723580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601472202695004:2527]
2025-10-10T14:34:36.723584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:36.723589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:36.723614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:36.723636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1396 reason: error at write: Disconnected sessionId: src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0
2025-10-10T14:34:36.723928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1396 sessionId: src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0 is DEAD
2025-10-10T14:34:36.724095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:36.724108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0] Write session will restart in 0.008012s
2025-10-10T14:34:36.724134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0] Write session: Do CDS request
2025-10-10T14:34:36.724140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:36.721865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.721940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.721996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.722000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.722070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.722127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.722195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.722265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.722308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.722312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.722387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.722448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.722512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.722575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.722619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.722622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.722695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.722758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.722823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.722886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.722927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.722930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.723001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:36.723066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:36.723131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:36.723229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:36.723273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:36.723276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:36.724476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:36.732913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.732997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:36.733017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1397
2025-10-10T14:34:36.733255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.733304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:36.733315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:36.733319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:36.733816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1397 sessionId:  describe result for acl check
2025-10-10T14:34:36.733859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:36.733865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:36.733868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:36.733874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601472202695054:8635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:36.734442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601472202695054:8635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:36.737447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601472202695054:8635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:36.741346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601472202695054:8635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:36.741369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601472202695054:8635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:36.741373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601472202695054:8635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:36.741383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:36.743389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:36.746387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:36.746654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:36.746665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:36.746678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:36.746736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:36.746782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601471420471593:8332]
2025-10-10T14:34:36.747452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:36.747837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:36.747890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:36.748261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:36.748330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.748336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.748337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.748339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.748340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.748341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.748343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.748344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.748345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.748346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.748348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.748349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.748351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.748358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.748372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.748377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.748382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.748386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.748391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.748395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.748399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.748403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.748407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.748411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.748416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.748420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.748429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.748438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.748445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.748451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.748456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.748463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.748468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.748481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.748486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.748491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.748498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.748502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.748507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.748512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.748517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.748525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.748537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.748543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.748552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.748557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.748562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.748567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.748571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.748577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.748582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.748587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.748634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:36.751357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:36.751940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:36.751951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:36.751954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:36.751958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:36.751978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1396 [2:7559601471420471593:8332]
2025-10-10T14:34:36.751991Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:36.752016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:36.752020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.752024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.752026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.752048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:36.752059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:36.752068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:36.752135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.752143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.752145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.752148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:36.752225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:36.752233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.752244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.752260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.752279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:36.752306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202695245:8635], now have 1 active actors on pipe
2025-10-10T14:34:36.752314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202695026:2438], now have 1 active actors on pipe
2025-10-10T14:34:36.752323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601471420471588:8332]
2025-10-10T14:34:36.752329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601471420471588:8332]
2025-10-10T14:34:36.752331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601471420471588:8332]
2025-10-10T14:34:36.752346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:36.752364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:36.752366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:36.752369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:36.752371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:36.752386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:36.752389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:36.752381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1396
2025-10-10T14:34:36.752420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601471420471588:8332]
2025-10-10T14:34:36.752388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1396
2025-10-10T14:34:36.752428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:36.752435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:36.752454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.752466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.752509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:36.752522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.752530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.752533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:36.752544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.752559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:36.752582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.752741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.752749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.752767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.752854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1397 partition: 0 MaxSeqNo: 40 sessionId: src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0
2025-10-10T14:34:36.753288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f2e0c9-5da3dc31-141d352b-9ae1576d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:36.756121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0] Write session: try to update token
2025-10-10T14:34:36.756146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:36.773202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:36.773224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:36.773227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:36.773229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:36.775277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId: src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:36.773241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601471420471588:8332]
2025-10-10T14:34:36.773247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601471420471588:8332]
2025-10-10T14:34:36.773251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601471420471588:8332]
2025-10-10T14:34:36.773310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:36.773315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:36.773318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.773321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:36.773323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:36.773343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:36.773490Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:36.778212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:36.821692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601472202695260:2527]
2025-10-10T14:34:36.821992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1396, pipe: [1:7559601472202695260:2527]
2025-10-10T14:34:36.892726Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:36.893255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.893273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.893324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202695260:2527], now have 1 active actors on pipe
2025-10-10T14:34:36.893577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:36.893607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:36.893609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:36.893628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:36.893673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601472202695260:2527]
2025-10-10T14:34:36.893710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1397 reason: error at write: Disconnected sessionId: src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0
2025-10-10T14:34:36.893950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1397 sessionId: src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0 is DEAD
2025-10-10T14:34:36.894120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:36.894133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0] Write session will restart in 0.009521s
2025-10-10T14:34:36.894167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0] Write session: Do CDS request
2025-10-10T14:34:36.894175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:36.905015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.905058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:36.905091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1398
2025-10-10T14:34:36.905290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:36.905371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:36.905384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:36.905388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:36.906040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1398 sessionId:  describe result for acl check
2025-10-10T14:34:36.906079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:36.906086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:36.906088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:36.906095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601472202695305:8639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:36.906691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601472202695305:8639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:36.912243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601472202695305:8639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:36.916924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601472202695305:8639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:36.916957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601472202695305:8639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:36.916961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601472202695305:8639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:36.916971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:36.919801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:36.923358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:36.923642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:36.923647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:36.923660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:36.923718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:36.923759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601471420471824:8335]
2025-10-10T14:34:36.924461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:36.924797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:36.924843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:36.925190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:36.925255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.925259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.925260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.925261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.925263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.925264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.925266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.925268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.925269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.925270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.925272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.925273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.925275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.925281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.925296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.925301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.925306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.925311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.925316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.925321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.925326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.925347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.925352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.925357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.925362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.925366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.925375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.925389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:36.925402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.925411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:36.925422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.925429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:36.925434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.925440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:36.925446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.925452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:36.925458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.925464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:36.925471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.925476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:36.925481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.925487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:36.925496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.925507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:36.925511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.925518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:36.925523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.925534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.925541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.925552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.925557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.925565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.925619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:36.928226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:36.928846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:36.928859Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:36.928862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:36.928866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:36.928877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1397 [2:7559601471420471824:8335]
2025-10-10T14:34:36.928891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:36.928911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:36.928914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.928918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.928921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.928941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:36.928948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:36.928957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:36.929022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.929031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.929033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.929037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:36.929112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:36.929120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.929134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:36.929149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:36.929172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:36.929268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1397
2025-10-10T14:34:36.929200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202695261:2438], now have 1 active actors on pipe
2025-10-10T14:34:36.929289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1397
2025-10-10T14:34:36.929208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202695482:8639], now have 1 active actors on pipe
2025-10-10T14:34:36.929217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601471420471819:8335]
2025-10-10T14:34:36.929219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601471420471819:8335]
2025-10-10T14:34:36.929222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601471420471819:8335]
2025-10-10T14:34:36.929241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:36.929256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:36.929258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:36.929262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:36.929264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:36.929273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:36.929277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:36.929310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601471420471819:8335]
2025-10-10T14:34:36.929313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:36.929316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:36.929371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.929376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.929413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:36.929427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:36.929432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:36.929435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:36.929448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:36.929459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:36.929474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.929666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:36.929676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:36.929693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:36.929894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1398 partition: 0 MaxSeqNo: 40 sessionId: src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0
2025-10-10T14:34:36.930317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2291fa-34cfe5bc-87ebd7aa-d0af6a08_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:36.933235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0] Write session: try to update token
2025-10-10T14:34:36.933259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:36.950498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:36.950522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:36.950526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:36.950528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:36.950540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601471420471819:8335]
2025-10-10T14:34:36.950545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601471420471819:8335]
2025-10-10T14:34:36.950550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601471420471819:8335]
2025-10-10T14:34:36.950603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:36.950611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:36.950615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:36.950655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:36.950667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:36.950671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:36.950764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:36.951318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId: src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:36.954093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:36.993753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601472202695497:2527]
2025-10-10T14:34:36.994088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1397, pipe: [1:7559601472202695497:2527]
2025-10-10T14:34:37.098984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:37.099583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.099598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.099654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601472202695497:2527], now have 1 active actors on pipe
2025-10-10T14:34:37.100315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:37.100336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:37.100409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1398 reason: error at write: Disconnected sessionId: src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0
2025-10-10T14:34:37.100619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1398 sessionId: src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0 is DEAD
2025-10-10T14:34:37.100644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:37.100693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601472202695497:2527]
2025-10-10T14:34:37.100968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:37.100974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0] Write session will restart in 0.009741s
2025-10-10T14:34:37.101000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0] Write session: Do CDS request
2025-10-10T14:34:37.101007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:37.101616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:37.111940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.112350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:37.112370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1399
2025-10-10T14:34:37.112518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.112550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:37.112556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:37.112569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:37.113188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1399 sessionId:  describe result for acl check
2025-10-10T14:34:37.113235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:37.113237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:37.113242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:37.113249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601476497662808:8643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:37.113856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601476497662808:8643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:37.122276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601476497662808:8643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:37.131546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601476497662808:8643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:37.131570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601476497662808:8643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:37.131574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601476497662808:8643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:37.131585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:37.137553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:37.140630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:37.140941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:37.140954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:37.140968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:37.141036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:37.141400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601475715439352:8337]
2025-10-10T14:34:37.142090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:37.142554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:37.142623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:37.143027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:37.143101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.143109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.143110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.143111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.143112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.143113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.143115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.143116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.143117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.143119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.143120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.143122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.143123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.143130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.143143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.143148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.143152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.143156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.143161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.143165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.143169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.143174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.143179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.143183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.143187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.143191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.143200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.143209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.143216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.143223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.143228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.143236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.143240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.143246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.143251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.143256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.143261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.143266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.143271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.143276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.143283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.143288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.143292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.143298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.143303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.143308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.143313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.143319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.143324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.143330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.143343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.143349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.143395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:37.146384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:37.147129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:37.147145Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:37.147148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:37.147153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:37.147160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1398 [2:7559601475715439352:8337]
2025-10-10T14:34:37.147175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:37.147199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:37.147207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.147211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.147214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.147234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:37.147247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:37.147257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:37.147327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.147338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.147341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.147345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:37.147422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:37.147430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.147446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.147463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.147488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:37.147517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497662795:2438], now have 1 active actors on pipe
2025-10-10T14:34:37.147525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497662957:8643], now have 1 active actors on pipe
2025-10-10T14:34:37.147533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601475715439347:8337]
2025-10-10T14:34:37.147540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601475715439347:8337]
2025-10-10T14:34:37.147542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601475715439347:8337]
2025-10-10T14:34:37.147557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:37.147577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:37.147584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:37.147589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:37.147592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:37.147594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:37.147599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:37.147612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1398
2025-10-10T14:34:37.147669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1398
2025-10-10T14:34:37.147690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601475715439347:8337]
2025-10-10T14:34:37.147708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:37.147719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:37.147791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.147804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.147838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:37.147848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.147854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.147862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:37.147875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.147893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:37.147915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.148154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.148168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.148191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.148327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1399 partition: 0 MaxSeqNo: 40 sessionId: src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0
2025-10-10T14:34:37.148796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7205c3c3-dc6b61d7-3f9feefa-be4b0a57_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:37.151757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0] Write session: try to update token
2025-10-10T14:34:37.151796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:37.160624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:37.160641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:37.160652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601475715439347:8337]
2025-10-10T14:34:37.160704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:37.160710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:37.160900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:37.161054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.161201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.161374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.161600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:37.161656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:37.172969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId: src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:37.176070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:37.176343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.176366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.176425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:37.176529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:37.181614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:37.181637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:37.181640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:37.181642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:37.181654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601475715439347:8337]
2025-10-10T14:34:37.181657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601475715439347:8337]
2025-10-10T14:34:37.181661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601475715439347:8337]
2025-10-10T14:34:37.181717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:37.181726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.181729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:37.181781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:37.181789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:37.181794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:37.181877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:37.201402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601476497663031:2527]
2025-10-10T14:34:37.201937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1398, pipe: [1:7559601476497663031:2527]
2025-10-10T14:34:37.301400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:37.301732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663031:2527], now have 1 active actors on pipe
2025-10-10T14:34:37.310335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.310364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.310572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.310656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.310733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.310806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.311521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.311541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.311623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.311693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.311759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.311848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.311905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.311908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.311979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.312043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.312113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.312182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.312230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.312237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.312304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.312374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.312454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.312518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.312567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.312574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.312647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.312713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.312774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.312839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.312888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.312896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.312968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.313032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.313101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.313169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.313217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.313222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.313292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.313373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.313441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.313505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.313553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.313559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.313634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.313699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.313764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.313828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.313874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.313881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.313953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.314014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.314078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.314154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.314199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.314206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.314274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.314334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.314400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.314463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.314510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.314517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.315260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:37.316673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:37.316722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:37.316734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601476497663031:2527]
2025-10-10T14:34:37.316775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1399 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0
2025-10-10T14:34:37.317026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1399 sessionId: src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0 is DEAD
2025-10-10T14:34:37.317180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:37.317199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0] Write session will restart in 0.008798s
2025-10-10T14:34:37.317226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0] Write session: Do CDS request
2025-10-10T14:34:37.317232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:37.326980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.327083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:37.327105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1400
2025-10-10T14:34:37.327337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.327392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:37.327398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:37.327402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:37.327989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1400 sessionId:  describe result for acl check
2025-10-10T14:34:37.328044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:37.328051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:37.328053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:37.328061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601476497663050:8647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:37.328651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601476497663050:8647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:37.332279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601476497663050:8647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:37.338381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601476497663050:8647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:37.338404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601476497663050:8647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:37.338408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601476497663050:8647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:37.338418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:37.340638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:37.343719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:37.343980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:37.343991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:37.344004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:37.344068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:37.344126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601475715439585:8339]
2025-10-10T14:34:37.344762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:37.345096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:37.345143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:37.345489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:37.345553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.345559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.345561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.345562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.345564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.345565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.345567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.345568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.345570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.345571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.345573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.345574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.345575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.345581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.345595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.345600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.345605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.345609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.345613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.345617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.345621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.345625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.345630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.345634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.345639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.345642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.345651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.345660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.345669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.345674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.345679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.345685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.345690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.345695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.345700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.345705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.345709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.345715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.345721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.345727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.345731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.345739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.345746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.345763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.345772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.345777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.345781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.345791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.345796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.345805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.345810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.345820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.345860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:37.348507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:37.348947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:37.348973Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:37.348975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:37.348980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:37.348986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1399 [2:7559601475715439585:8339]
2025-10-10T14:34:37.349000Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:37.349020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:37.349029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.349033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.349036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.349055Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:37.349069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:37.349082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:37.349143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.349151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.349153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.349155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:37.349361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:37.349369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.349381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.349392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.349391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1399
2025-10-10T14:34:37.349405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1399
2025-10-10T14:34:37.349414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:37.349441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663257:8647], now have 1 active actors on pipe
2025-10-10T14:34:37.349445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663035:2438], now have 1 active actors on pipe
2025-10-10T14:34:37.349453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601475715439580:8339]
2025-10-10T14:34:37.349455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601475715439580:8339]
2025-10-10T14:34:37.349457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601475715439580:8339]
2025-10-10T14:34:37.349475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:37.349490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:37.349493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:37.349494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.349495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:37.349499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.349523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:37.349546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:37.349549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:37.349596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb6abb12-b700c565-64114e92-b2a5f752_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:37.349608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.349615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.349618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:37.349629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.349645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:37.349654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601475715439580:8339]
2025-10-10T14:34:37.349666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:37.349678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:37.349692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.349920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.349929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.349946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.350091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1400 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb6abb12-b700c565-64114e92-b2a5f752_0
2025-10-10T14:34:37.350522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacf5719-eb920803-64f4a4d0-8af6c32d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb6abb12-b700c565-64114e92-b2a5f752_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:37.353301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6abb12-b700c565-64114e92-b2a5f752_0] Write session: try to update token
2025-10-10T14:34:37.353321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6abb12-b700c565-64114e92-b2a5f752_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:37.361981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:37.362005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:37.362017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601475715439580:8339]
2025-10-10T14:34:37.362065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:37.362071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:37.362300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:37.362457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.362647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.362794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.362985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:37.363031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:37.368414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId: src_id|fb6abb12-b700c565-64114e92-b2a5f752_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:37.371162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:37.371372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.371402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.371443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:37.371532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:37.381191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:37.381208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:37.381211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:37.381212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:37.381224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601475715439580:8339]
2025-10-10T14:34:37.381227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601475715439580:8339]
2025-10-10T14:34:37.381230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601475715439580:8339]
2025-10-10T14:34:37.381277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:37.381289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.381291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:37.381291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:37.381299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:37.381304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:37.381441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:37.417147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601476497663271:2527]
2025-10-10T14:34:37.417524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1399, pipe: [1:7559601476497663271:2527]
2025-10-10T14:34:37.502289Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:37.510355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.510386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.510576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.510645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.510715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.510785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.511219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.511237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.511314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.511381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.511447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.511516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.511561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.511568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.511637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.511698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.511782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.511849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.511892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.511899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.511968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.512036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.512102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.512166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.512212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.512224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.512293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.512357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.512420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.512484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.512528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.512535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.512602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.512663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.512725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.512789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.512833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.512841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.512912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.512978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.513043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.513109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.513153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.513160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.513225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.513285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.513370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.513435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.513486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.513496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.513565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.513627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.513688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.513752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.513800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.513807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.513879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:37.513944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:37.514432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:37.514433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:37.514449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:37.514489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601476497663271:2527]
2025-10-10T14:34:37.514493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1400 reason: error at write: Disconnected sessionId: src_id|fb6abb12-b700c565-64114e92-b2a5f752_0
2025-10-10T14:34:37.514748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1400 sessionId: src_id|fb6abb12-b700c565-64114e92-b2a5f752_0 is DEAD
2025-10-10T14:34:37.514919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6abb12-b700c565-64114e92-b2a5f752_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:37.514931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6abb12-b700c565-64114e92-b2a5f752_0] Write session will restart in 0.007487s
2025-10-10T14:34:37.514956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6abb12-b700c565-64114e92-b2a5f752_0] Write session: Do CDS request
2025-10-10T14:34:37.514963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6abb12-b700c565-64114e92-b2a5f752_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:37.514009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:37.514076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:37.514116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:37.514119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:37.514183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663271:2527], now have 1 active actors on pipe
2025-10-10T14:34:37.514849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:37.523957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6abb12-b700c565-64114e92-b2a5f752_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.524053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:37.524075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1401
2025-10-10T14:34:37.524883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.524930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:37.524941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:37.524946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:37.525490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1401 sessionId:  describe result for acl check
2025-10-10T14:34:37.525532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:37.525534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:37.525536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:37.525544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601476497663298:8651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:37.526177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601476497663298:8651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:37.529953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601476497663298:8651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:37.536115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601476497663298:8651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:37.536137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601476497663298:8651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:37.536141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601476497663298:8651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:37.536151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:37.539984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:37.543014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:37.543247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:37.543259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:37.543271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:37.543328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:37.543382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601475715439822:8341]
2025-10-10T14:34:37.543990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:37.544381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:37.544489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:37.544896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:37.544956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.544965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.544967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.544968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.544970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.544972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.544973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.544975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.544976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.544978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.544979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.544981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.544983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.544990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.545005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.545010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.545015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.545020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.545026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.545030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.545035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.545040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.545047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.545051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.545056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.545061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.545070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.545080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.545087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.545098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.545105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.545112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.545119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.545125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.545133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.545139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.545144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.545150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.545155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.545167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.545172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.545178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.545185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.545196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.545201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.545206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.545211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.545217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.545221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.545227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.545232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.545238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.545282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:37.547919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:37.548735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:37.548748Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:37.548750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:37.548754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:37.548761Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1400 [2:7559601475715439822:8341]
2025-10-10T14:34:37.548775Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:37.548796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:37.548799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.548804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.548807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.548828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:37.548843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:37.548851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:37.548917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.548925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.548926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.548930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:37.549003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:37.549011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.549024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.549036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.549054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:37.549082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663274:2438], now have 1 active actors on pipe
2025-10-10T14:34:37.549093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663466:8651], now have 1 active actors on pipe
2025-10-10T14:34:37.549101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601475715439817:8341]
2025-10-10T14:34:37.549103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601475715439817:8341]
2025-10-10T14:34:37.549105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601475715439817:8341]
2025-10-10T14:34:37.549119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:37.549134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:37.549135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:37.549142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:37.549144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:37.549152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:37.549155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:37.549137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1400
2025-10-10T14:34:37.549147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1400
2025-10-10T14:34:37.549191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601475715439817:8341]
2025-10-10T14:34:37.549203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:37.549209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:37.549224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.549239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.549299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|719eecad-3a37a018-da453d54-e6e9ac46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:37.549307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.549313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.549316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:37.549327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.549360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:37.549384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.549558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.549569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.549589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.549686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1401 partition: 0 MaxSeqNo: 40 sessionId: src_id|719eecad-3a37a018-da453d54-e6e9ac46_0
2025-10-10T14:34:37.550139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6abb12-b700c565-64114e92-b2a5f752_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|719eecad-3a37a018-da453d54-e6e9ac46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:37.553099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719eecad-3a37a018-da453d54-e6e9ac46_0] Write session: try to update token
2025-10-10T14:34:37.553121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719eecad-3a37a018-da453d54-e6e9ac46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:37.572335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId: src_id|719eecad-3a37a018-da453d54-e6e9ac46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:37.575226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:37.573099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:37.573122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:37.573125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:37.573127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:37.573137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601475715439817:8341]
2025-10-10T14:34:37.573141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601475715439817:8341]
2025-10-10T14:34:37.573146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601475715439817:8341]
2025-10-10T14:34:37.573196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:37.573201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:37.573204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:37.573208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:37.573209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.573211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:37.573407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:37.614793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601476497663526:2527]
2025-10-10T14:34:37.615133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1400, pipe: [1:7559601476497663526:2527]
2025-10-10T14:34:37.698297Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:37.698827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.698844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.698892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663526:2527], now have 1 active actors on pipe
2025-10-10T14:34:37.699152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:37.699141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:37.699160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:37.699237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1401 reason: error at write: Disconnected sessionId: src_id|719eecad-3a37a018-da453d54-e6e9ac46_0
2025-10-10T14:34:37.699454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1401 sessionId: src_id|719eecad-3a37a018-da453d54-e6e9ac46_0 is DEAD
2025-10-10T14:34:37.699546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601476497663526:2527]
2025-10-10T14:34:37.699581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:37.699633Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:34:37.699810Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 14 consumer shared/user session shared/user_1_14_6536244086887583778_v1 is DEAD
2025-10-10T14:34:37.699913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719eecad-3a37a018-da453d54-e6e9ac46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:37.699928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719eecad-3a37a018-da453d54-e6e9ac46_0] Write session will restart in 0.008838s
2025-10-10T14:34:37.699953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719eecad-3a37a018-da453d54-e6e9ac46_0] Write session: Do CDS request
2025-10-10T14:34:37.699960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719eecad-3a37a018-da453d54-e6e9ac46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:37.699960Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601399188232485:2530] disconnected; active server actors: 1
2025-10-10T14:34:37.699969Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601399188232485:2530] client user disconnected session shared/user_1_14_6536244086887583778_v1
2025-10-10T14:34:37.700200Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:34:37.700339Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:34:37.700346Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:34:37.700352Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.008502s
2025-10-10T14:34:37.709831Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:34:37.709948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719eecad-3a37a018-da453d54-e6e9ac46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.710071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:37.710076Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:34:37.710081Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 15
2025-10-10T14:34:37.710091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1402
2025-10-10T14:34:37.710319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.710351Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 15 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:34:37.710361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:37.710368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:37.710372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:37.710419Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:34:37.710534Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 auth for : user
2025-10-10T14:34:37.710648Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 Handle describe topics response
2025-10-10T14:34:37.710678Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 auth is DEAD
2025-10-10T14:34:37.710705Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:34:37.710873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1402 sessionId:  describe result for acl check
2025-10-10T14:34:37.710909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:37.710917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:37.710919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:37.710926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601476497663622:8667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:37.710999Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:34:37.711105Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_15_16242891699915448161_v1
2025-10-10T14:34:37.711509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601476497663622:8667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:37.711603Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601476497663625:8666] connected; active server actors: 1
2025-10-10T14:34:37.711620Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601476497663625:8666] session shared/user_1_15_16242891699915448161_v1
2025-10-10T14:34:37.711630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:34:37.711652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:34:37.711659Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_15_16242891699915448161_v1" (Sender=[1:7559601476497663606:8666], Pipe=[1:7559601476497663625:8666], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:34:37.711664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:34:37.711684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:34:37.711693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_15_16242891699915448161_v1" (Sender=[1:7559601476497663606:8666], Pipe=[1:7559601476497663625:8666], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:34:37.711703Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_15_16242891699915448161_v1" sender [1:7559601476497663606:8666] lock partition 0 for ReadingSession "shared/user_1_15_16242891699915448161_v1" (Sender=[1:7559601476497663606:8666], Pipe=[1:7559601476497663625:8666], Partitions=[], ActiveFamilyCount=1) generation 1 step 15
2025-10-10T14:34:37.711711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:34:37.711716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000028s
2025-10-10T14:34:37.711948Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 15 Session: "shared/user_1_15_16242891699915448161_v1" ClientId: "user" PipeClient { RawX1: 7559601476497663625 RawX2: 4503603922346458 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:34:37.711977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:34:37.716463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601476497663622:8667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:37.721034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601476497663622:8667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:37.721054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601476497663622:8667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:37.721059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601476497663622:8667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:37.721069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:37.722608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:37.725543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:37.725797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:37.725809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:37.725822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:37.725889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:37.726013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601475715440108:8357]
2025-10-10T14:34:37.726606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:37.727085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:37.727144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:37.727536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:37.727607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.727613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.727614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.727615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.727616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.727618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.727619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.727621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.727622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.727623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.727624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.727626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.727627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.727634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.727649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.727653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.727658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.727662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.727666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.727669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.727673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.727677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.727683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.727688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.727692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.727696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.727705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.727714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.727721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.727728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.727733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.727739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.727744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.727750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.727771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.727777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.727782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.727792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.727799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.727805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.727814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.727820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.727826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.727836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.727849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.727855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.727861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.727868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.727872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.727879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.727885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.727890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.727939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:37.732036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:37.732572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:37.732578Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:37.732581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:37.732585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:37.732592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1401 [2:7559601475715440108:8357]
2025-10-10T14:34:37.732606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:37.732629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:37.732633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.732637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.732640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.732660Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:37.732668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:37.732676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:37.732741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.732743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.732745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.732748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:37.732828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:37.732832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.732843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.732853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.732868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:37.732893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663640:8672], now have 1 active actors on pipe
2025-10-10T14:34:37.732902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601475715440103:8357]
2025-10-10T14:34:37.732904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601475715440103:8357]
2025-10-10T14:34:37.732906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601475715440103:8357]
2025-10-10T14:34:37.732920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:37.732929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663789:8667], now have 1 active actors on pipe
2025-10-10T14:34:37.732932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663561:2438], now have 1 active actors on pipe
2025-10-10T14:34:37.732936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:37.732939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:37.732941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:37.732942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:37.732955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:37.732959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:37.732995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601475715440103:8357]
2025-10-10T14:34:37.733004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:37.733051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:37.733236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.733244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.733260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_15_16242891699915448161_v1 on pipe: [1:7559601476497663640:8672]
2025-10-10T14:34:37.733300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.733314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.733316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:37.733356Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_15_16242891699915448161_v1
2025-10-10T14:34:37.733364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.733395Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:34:37.733037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1401, pipe: [1:7559601476497663640:8672]
2025-10-10T14:34:37.733099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1401
2025-10-10T14:34:37.733362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1401
2025-10-10T14:34:37.733511Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_15_16242891699915448161_v1:1 with generation 1401
2025-10-10T14:34:37.733526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.733530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.733553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:37.733560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:34:37.742358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:34:37.742415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:34:37.742427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.742436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.742446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:37.742462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.742493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:37.742509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:34:37.742525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:34:37.742548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.742691Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106877731 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:34:37.742728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:34:37.742767Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 sending to client partition status
2025-10-10T14:34:37.742779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.742806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.742842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.742976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1402 partition: 0 MaxSeqNo: 40 sessionId: src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0
2025-10-10T14:34:37.743322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719eecad-3a37a018-da453d54-e6e9ac46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:37.746247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0] Write session: try to update token
2025-10-10T14:34:37.746270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:37.748869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:37.748883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:37.748895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601475715440103:8357]
2025-10-10T14:34:37.748948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:37.748957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:37.749141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:37.749314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.749486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.749638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:37.749840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:37.749884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:37.762850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId: src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:37.765775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:37.767726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.767751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.767789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:37.767792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:37.767796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:37.767798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:37.767809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601475715440103:8357]
2025-10-10T14:34:37.767814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601475715440103:8357]
2025-10-10T14:34:37.767819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601475715440103:8357]
2025-10-10T14:34:37.767880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:37.767886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:37.767894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:37.767898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.767898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:37.767901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:37.768043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:37.896695Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:37.897035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:37.897213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:37.897271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601476497663640:8672]
2025-10-10T14:34:37.897289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:37.897249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_15_16242891699915448161_v1
2025-10-10T14:34:37.897298Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_15_16242891699915448161_v1
2025-10-10T14:34:37.897306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:37.897314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:37.897442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1402 reason: error at write: Disconnected sessionId: src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0
2025-10-10T14:34:37.897619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1402 sessionId: src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0 is DEAD
2025-10-10T14:34:37.897764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:37.897775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0] Write session will restart in 0.005037s
2025-10-10T14:34:37.897799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0] Write session: Do CDS request
2025-10-10T14:34:37.897809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:37.903929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.904003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:37.904020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1403
2025-10-10T14:34:37.904176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:37.904219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:37.904232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:37.904236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:37.904707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1403 sessionId:  describe result for acl check
2025-10-10T14:34:37.904750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:37.904757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:37.904759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:37.904766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601476497663821:8674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:37.905394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601476497663821:8674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:37.908365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601476497663821:8674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:37.911901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601476497663821:8674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:37.911918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601476497663821:8674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:37.911922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601476497663821:8674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:37.911931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:37.915836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:37.918804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:37.919053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:37.919066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:37.919080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:37.919145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:37.919380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601475715440348:8360]
2025-10-10T14:34:37.920027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:37.920387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:37.920444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:37.920818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:37.920889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.920895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.920896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.920898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.920899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.920900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.920901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.920902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.920904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.920905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.920906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.920907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.920908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.920914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.920927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.920931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.920935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.920938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.920942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.920946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.920949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.920953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.920957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.920961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.920965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.920969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.920979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.920987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:37.920993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.920998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:37.921002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.921007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:37.921011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.921016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:37.921020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.921028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:37.921032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.921038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:37.921044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.921056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:37.921060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.921065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:37.921074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.921079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:37.921083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.921089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:37.921095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.921100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.921104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.921109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.921115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.921120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.921167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:37.923731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:37.924279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:37.924290Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:37.924306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:37.924311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:37.924318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1402 [2:7559601475715440348:8360]
2025-10-10T14:34:37.924337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:37.924362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:37.924371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.924375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.924378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.924397Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:37.924410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:37.924418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:37.924482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.924489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.924491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.924494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:37.924562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:37.924572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.924584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:37.924595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:37.924613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:37.924639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663806:2438], now have 1 active actors on pipe
2025-10-10T14:34:37.924647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497663966:8674], now have 1 active actors on pipe
2025-10-10T14:34:37.924655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601475715440343:8360]
2025-10-10T14:34:37.924658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601475715440343:8360]
2025-10-10T14:34:37.924662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601475715440343:8360]
2025-10-10T14:34:37.924676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:37.924693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:37.924696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:37.924703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:37.924705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:37.924712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:37.924715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:37.924743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601475715440343:8360]
2025-10-10T14:34:37.924751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:37.924762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:37.924720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1402
2025-10-10T14:34:37.924730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1402
2025-10-10T14:34:37.924791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.924800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.924835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea397794-1a136365-44151134-32fa4469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:37.924847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:37.924852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:37.924854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:37.924865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:37.924875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:37.924894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.925052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:37.925059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:37.925074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:37.925158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1403 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea397794-1a136365-44151134-32fa4469_0
2025-10-10T14:34:37.925565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d6db1e-4b90b9ef-9f8284e2-e2527a30_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea397794-1a136365-44151134-32fa4469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:37.928333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea397794-1a136365-44151134-32fa4469_0] Write session: try to update token
2025-10-10T14:34:37.928354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea397794-1a136365-44151134-32fa4469_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:37.943010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId: src_id|ea397794-1a136365-44151134-32fa4469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:37.945129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:37.945147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:37.945151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:37.945153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:37.945162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601475715440343:8360]
2025-10-10T14:34:37.945170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601475715440343:8360]
2025-10-10T14:34:37.945174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601475715440343:8360]
2025-10-10T14:34:37.945227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:37.945229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:37.945237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:37.945240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:37.945241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:37.945242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:37.945406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:37.945689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:37.997283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601476497664046:8672]
2025-10-10T14:34:37.997613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1402, pipe: [1:7559601476497664046:8672]
2025-10-10T14:34:38.062756Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:38.063151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.063167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.063216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601476497664046:8672], now have 1 active actors on pipe
2025-10-10T14:34:38.063448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:38.063436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:38.063504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601476497664046:8672]
2025-10-10T14:34:38.063641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:38.063737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1403 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea397794-1a136365-44151134-32fa4469_0
2025-10-10T14:34:38.063965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1403 sessionId: src_id|ea397794-1a136365-44151134-32fa4469_0 is DEAD
2025-10-10T14:34:38.064133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea397794-1a136365-44151134-32fa4469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:38.064151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea397794-1a136365-44151134-32fa4469_0] Write session will restart in 0.005772s
2025-10-10T14:34:38.064177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea397794-1a136365-44151134-32fa4469_0] Write session: Do CDS request
2025-10-10T14:34:38.064184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea397794-1a136365-44151134-32fa4469_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:38.070945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea397794-1a136365-44151134-32fa4469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.071029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:38.071049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1404
2025-10-10T14:34:38.071219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.071259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:38.071275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:38.071279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:38.071714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1404 sessionId:  describe result for acl check
2025-10-10T14:34:38.071760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:38.071767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:38.071769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:38.071778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601480792631358:8678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:38.072351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601480792631358:8678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:38.075058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601480792631358:8678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:38.079666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601480792631358:8678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:38.079691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601480792631358:8678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:38.079696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601480792631358:8678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:38.079709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:38.083900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:38.086821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:38.087269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:38.087280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:38.087295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:38.087372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:38.087423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601480010407881:8362]
2025-10-10T14:34:38.088095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:38.088481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:38.088542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:38.088888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:38.088978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.088987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.088988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.088990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.088991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.088992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.088994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.088995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.088997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.088998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.089000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.089001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.089002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.089010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.089039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.089044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.089047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.089052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.089055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.089059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.089064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.089068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.089073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.089076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.089080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.089084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.089094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.089104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.089111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.089117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.089121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.089127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.089132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.089136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.089142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.089147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.089152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.089158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.089163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.089168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.089175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.089190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.089195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.089205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.089210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.089215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.089225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.089229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.089238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.089243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.089248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.089254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.089296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:38.092180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:38.092521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:38.092539Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:38.092542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:38.092546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:38.092554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1403 [2:7559601480010407881:8362]
2025-10-10T14:34:38.092570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:38.092590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:38.092598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.092602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.092605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.092625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:38.092653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:38.092662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:38.092728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.092736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.092738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.092742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:38.092815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:38.092824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.092837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.092850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.092868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:38.092898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792631517:8678], now have 1 active actors on pipe
2025-10-10T14:34:38.092907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792631343:2438], now have 1 active actors on pipe
2025-10-10T14:34:38.092916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601480010407876:8362]
2025-10-10T14:34:38.092918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601480010407876:8362]
2025-10-10T14:34:38.092921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601480010407876:8362]
2025-10-10T14:34:38.092937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:38.092955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:38.092954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:38.092958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:38.092960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:38.093021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1403
2025-10-10T14:34:38.093061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1403
2025-10-10T14:34:38.093216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:38.093227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:38.093273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.093283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.093302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601480010407876:8362]
2025-10-10T14:34:38.093314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:38.093321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:38.093373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:38.093387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.093395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.093398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:38.093410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.093422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:38.093455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.093806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.093821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.093847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.093953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1404 partition: 0 MaxSeqNo: 40 sessionId: src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0
2025-10-10T14:34:38.094396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea397794-1a136365-44151134-32fa4469_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:38.097170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0] Write session: try to update token
2025-10-10T14:34:38.097189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:38.112917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId: src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:38.114034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:38.114057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:38.114061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:38.114063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:38.114073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601480010407876:8362]
2025-10-10T14:34:38.114079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601480010407876:8362]
2025-10-10T14:34:38.114087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601480010407876:8362]
2025-10-10T14:34:38.114141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:38.114144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:38.114150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.114151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:38.114152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:38.114159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:38.114300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:38.115714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:38.163692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601480792631584:8672]
2025-10-10T14:34:38.164011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1403, pipe: [1:7559601480792631584:8672]
2025-10-10T14:34:38.236169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:38.236586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.236606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.236657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792631584:8672], now have 1 active actors on pipe
2025-10-10T14:34:38.236896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:38.237022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601480792631584:8672]
2025-10-10T14:34:38.237052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:38.237086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:38.237093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:38.237153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1404 reason: error at write: Disconnected sessionId: src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0
2025-10-10T14:34:38.237387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1404 sessionId: src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0 is DEAD
2025-10-10T14:34:38.241439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:38.241453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0] Write session will restart in 0.006000s
2025-10-10T14:34:38.241480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0] Write session: Do CDS request
2025-10-10T14:34:38.241486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:38.250304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.250473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:38.250495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1405
2025-10-10T14:34:38.250597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.250627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:38.250633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:38.250637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:38.251055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1405 sessionId:  describe result for acl check
2025-10-10T14:34:38.251086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:38.251088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:38.251090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:38.251097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601480792631629:8682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:38.251663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601480792631629:8682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:38.254930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601480792631629:8682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:38.258732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601480792631629:8682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:38.258753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601480792631629:8682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:38.258757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601480792631629:8682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:38.258766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:38.261904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:38.264722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:38.264966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:38.264978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:38.264990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:38.265045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:38.265111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601480010408119:8364]
2025-10-10T14:34:38.265747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:38.266141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:38.266204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:38.266584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:38.266654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.266660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.266662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.266663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.266665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.266666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.266668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.266669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.266671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.266672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.266673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.266675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.266676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.266683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.266697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.266702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.266707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.266711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.266715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.266719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.266723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.266727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.266733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.266737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.266741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.266745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.266754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.266763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.266771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.266776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.266781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.266786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.266795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.266802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.266809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.266815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.266824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.266830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.266838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.266844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.266849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.266854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.266863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.266873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.266878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.266888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.266897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.266903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.266912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.266918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.266924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.266930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.266981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:38.269589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:38.270295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:38.270308Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:38.270323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:38.270327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:38.270339Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1404 [2:7559601480010408119:8364]
2025-10-10T14:34:38.270354Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:38.270376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:38.270385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.270389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.270391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.270411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:38.270419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:38.270433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:38.270501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.270508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.270510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.270513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:38.270591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:38.270599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.270613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.270625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.270645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:38.270670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792631787:8682], now have 1 active actors on pipe
2025-10-10T14:34:38.270678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792631585:2438], now have 1 active actors on pipe
2025-10-10T14:34:38.270688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601480010408114:8364]
2025-10-10T14:34:38.270690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601480010408114:8364]
2025-10-10T14:34:38.270693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601480010408114:8364]
2025-10-10T14:34:38.270708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:38.270727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:38.270728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:38.270732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:38.270734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:38.270748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:38.270752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:38.270733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1404
2025-10-10T14:34:38.270737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1404
2025-10-10T14:34:38.270789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601480010408114:8364]
2025-10-10T14:34:38.270800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:38.270812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:38.270819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.270824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.270880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3445236-307f58e0-d13cca0a-5497b898_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:38.270893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.270897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.270900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:38.270914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.270925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:38.270954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.271154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.271166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.271190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.271285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1405 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3445236-307f58e0-d13cca0a-5497b898_0
2025-10-10T14:34:38.271730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6190e391-a7dd228f-d743f1ce-cb1fa740_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3445236-307f58e0-d13cca0a-5497b898_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:38.274586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3445236-307f58e0-d13cca0a-5497b898_0] Write session: try to update token
2025-10-10T14:34:38.274608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3445236-307f58e0-d13cca0a-5497b898_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:38.291837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId: src_id|c3445236-307f58e0-d13cca0a-5497b898_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:38.291999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:38.292021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:38.292025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:38.292028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:38.292038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601480010408114:8364]
2025-10-10T14:34:38.292043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601480010408114:8364]
2025-10-10T14:34:38.292048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601480010408114:8364]
2025-10-10T14:34:38.292102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:38.292109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:38.292117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:38.292117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.292120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:38.292122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:38.292274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:38.294855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:38.337231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601480792631828:8672]
2025-10-10T14:34:38.337802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1404, pipe: [1:7559601480792631828:8672]
2025-10-10T14:34:38.408682Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:38.409352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.409372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.409423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792631828:8672], now have 1 active actors on pipe
2025-10-10T14:34:38.409801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:38.410075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:38.410097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:38.410162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1405 reason: error at write: Disconnected sessionId: src_id|c3445236-307f58e0-d13cca0a-5497b898_0
2025-10-10T14:34:38.410379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1405 sessionId: src_id|c3445236-307f58e0-d13cca0a-5497b898_0 is DEAD
2025-10-10T14:34:38.410590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:38.410635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601480792631828:8672]
2025-10-10T14:34:38.413433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3445236-307f58e0-d13cca0a-5497b898_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:38.413449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3445236-307f58e0-d13cca0a-5497b898_0] Write session will restart in 0.007849s
2025-10-10T14:34:38.413477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3445236-307f58e0-d13cca0a-5497b898_0] Write session: Do CDS request
2025-10-10T14:34:38.413487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3445236-307f58e0-d13cca0a-5497b898_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:38.425874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3445236-307f58e0-d13cca0a-5497b898_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.426059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:38.426079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1406
2025-10-10T14:34:38.426180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.426219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:38.426225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:38.426228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:38.426765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1406 sessionId:  describe result for acl check
2025-10-10T14:34:38.426812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:38.426814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:38.426816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:38.426822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601480792631918:8686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:38.427417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601480792631918:8686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:38.431307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601480792631918:8686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:38.434116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601480792631918:8686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:38.434131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601480792631918:8686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:38.434134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601480792631918:8686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:38.434142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:38.434878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:38.437322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:38.437540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:38.437553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:38.437565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:38.437634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:38.437681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601480010408358:8366]
2025-10-10T14:34:38.438286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:38.438651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:38.438697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:38.439013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:38.439068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.439069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.439071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.439072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.439073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.439074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.439075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.439077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.439078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.439080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.439081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.439082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.439083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.439088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.439100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.439104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.439108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.439111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.439115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.439118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.439122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.439125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.439130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.439133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.439136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.439140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.439148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.439157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.439164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.439170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.439175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.439180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.439185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.439191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.439196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.439201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.439206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.439212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.439218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.439223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.439227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.439232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.439236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.439242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.439246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.439251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.439256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.439261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.439269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.439274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.439279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.439283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.439322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:38.441740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:38.442147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:38.442162Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:38.442164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:38.442168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:38.442174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1405 [2:7559601480010408358:8366]
2025-10-10T14:34:38.442188Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:38.442206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:38.442209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.442212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.442214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.442231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:38.442238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:38.442246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:38.442303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.442306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.442308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.442311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:38.442382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:38.442385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.442397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.442409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.442426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:38.442447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601480010408353:8366]
2025-10-10T14:34:38.442450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601480010408353:8366]
2025-10-10T14:34:38.442452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601480010408353:8366]
2025-10-10T14:34:38.442470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:38.442491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:38.442509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:38.442511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:38.442513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:38.442515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:38.442518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:38.442535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601480010408353:8366]
2025-10-10T14:34:38.442539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:38.442560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:38.442575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632059:8686], now have 1 active actors on pipe
2025-10-10T14:34:38.442580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792631829:2438], now have 1 active actors on pipe
2025-10-10T14:34:38.442731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1405
2025-10-10T14:34:38.442761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1405
2025-10-10T14:34:38.443126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.443138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.443172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b05a35ae-765841f2-7f523f11-3e46c007_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:38.443181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.443185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.443187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:38.443199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.443212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:38.443228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.444272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.444281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.444298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.444446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1406 partition: 0 MaxSeqNo: 40 sessionId: src_id|b05a35ae-765841f2-7f523f11-3e46c007_0
2025-10-10T14:34:38.444903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3445236-307f58e0-d13cca0a-5497b898_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b05a35ae-765841f2-7f523f11-3e46c007_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:38.447902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05a35ae-765841f2-7f523f11-3e46c007_0] Write session: try to update token
2025-10-10T14:34:38.447922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05a35ae-765841f2-7f523f11-3e46c007_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:38.461132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:38.461160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:38.461174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601480010408353:8366]
2025-10-10T14:34:38.461225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:38.461390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:38.461592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:38.461750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:38.461890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:38.462033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:38.462231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:38.462270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:38.464363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId: src_id|b05a35ae-765841f2-7f523f11-3e46c007_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:38.467219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:38.467459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.467482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.467528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:38.467613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:38.472913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:38.472933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:38.472937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:38.472939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:38.472952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601480010408353:8366]
2025-10-10T14:34:38.472956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601480010408353:8366]
2025-10-10T14:34:38.472960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601480010408353:8366]
2025-10-10T14:34:38.473014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:38.473019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:38.473023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.473025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:38.473031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:38.473036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:38.473169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:38.509283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601480792632073:8672]
2025-10-10T14:34:38.509595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1405, pipe: [1:7559601480792632073:8672]
2025-10-10T14:34:38.589315Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:38.597556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.597585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.597776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.597842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.597903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.597968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.598015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.598020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.598094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.598154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.598217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.598284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.598325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.598328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.598396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.598464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.598525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.598586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.598624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.598627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.598696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.598760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.598821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.598884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.598925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.598928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.598999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.599057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.599117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.599176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.599218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.599221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.599299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.599358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.599417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.599477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.599518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.599521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.599589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.599649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.599711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.599796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.599839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.599841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.599914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.599972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.600032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.600093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.600137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.600140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.600208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.601575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05a35ae-765841f2-7f523f11-3e46c007_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:38.601595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05a35ae-765841f2-7f523f11-3e46c007_0] Write session will restart in 0.006027s
2025-10-10T14:34:38.600265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.600322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.600380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.600425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.600427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.601631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05a35ae-765841f2-7f523f11-3e46c007_0] Write session: Do CDS request
2025-10-10T14:34:38.600492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:38.600550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:38.601638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05a35ae-765841f2-7f523f11-3e46c007_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:38.600617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:38.600687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:38.600733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:38.600736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:38.600814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632073:8672], now have 1 active actors on pipe
2025-10-10T14:34:38.602203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:38.601119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:38.601140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:38.601144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601480792632073:8672]
2025-10-10T14:34:38.601165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:38.601171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1406 reason: error at write: Disconnected sessionId: src_id|b05a35ae-765841f2-7f523f11-3e46c007_0
2025-10-10T14:34:38.601418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1406 sessionId: src_id|b05a35ae-765841f2-7f523f11-3e46c007_0 is DEAD
2025-10-10T14:34:38.608907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05a35ae-765841f2-7f523f11-3e46c007_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.608991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:38.609017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1407
2025-10-10T14:34:38.609143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.609190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:38.609201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:38.609205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:38.609750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1407 sessionId:  describe result for acl check
2025-10-10T14:34:38.609798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:38.609800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:38.609802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:38.609807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601480792632103:8691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:38.610472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601480792632103:8691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:38.613860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601480792632103:8691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:38.617465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601480792632103:8691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:38.617482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601480792632103:8691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:38.617486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601480792632103:8691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:38.617496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:38.621257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:38.624234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:38.624486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:38.624499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:38.624512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:38.624570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:38.624616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601480010408616:8369]
2025-10-10T14:34:38.625263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:38.625612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:38.625679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:38.626063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:38.626130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.626136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.626138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.626140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.626141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.626143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.626144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.626146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.626148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.626149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.626151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.626152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.626167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.626173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.626188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.626198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.626203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.626207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.626212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.626228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.626238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.626244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.626249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.626257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.626262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.626267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.626279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.626294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.626306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.626313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.626326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.626336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.626342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.626352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.626358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.626368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.626373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.626383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.626390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.626400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.626405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.626415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.626421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.626431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.626436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.626442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.626455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.626465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.626470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.626476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.626485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.626491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.626551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:38.629529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:38.630002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:38.630018Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:38.630021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:38.630025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:38.630032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1406 [2:7559601480010408616:8369]
2025-10-10T14:34:38.630047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:38.630067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:38.630070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.630075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.630077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.630098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:38.630110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:38.630118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:38.630181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.630190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.630193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.630195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:38.630267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:38.630276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.630289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.630307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.630335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:38.630362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632087:2438], now have 1 active actors on pipe
2025-10-10T14:34:38.630372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632282:8691], now have 1 active actors on pipe
2025-10-10T14:34:38.630380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601480010408609:8369]
2025-10-10T14:34:38.630383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601480010408609:8369]
2025-10-10T14:34:38.630385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601480010408609:8369]
2025-10-10T14:34:38.630399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:38.630429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1406
2025-10-10T14:34:38.630460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1406
2025-10-10T14:34:38.630415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:38.630426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:38.630429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:38.630431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:38.630441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:38.630444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:38.630478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601480010408609:8369]
2025-10-10T14:34:38.630485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:38.630492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:38.630672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.630697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.630735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:38.630752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.630770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.630777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:38.630791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.630809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:38.630829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.631035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.631048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.631071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.631174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1407 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0
2025-10-10T14:34:38.631606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05a35ae-765841f2-7f523f11-3e46c007_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:38.634436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0] Write session: try to update token
2025-10-10T14:34:38.634454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:38.652519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:38.652540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:38.652544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:38.652547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:38.652557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601480010408609:8369]
2025-10-10T14:34:38.652562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601480010408609:8369]
2025-10-10T14:34:38.652570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601480010408609:8369]
2025-10-10T14:34:38.655794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId: src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:38.652631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:38.652637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:38.652645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:38.652648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.652650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:38.652653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:38.652806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:38.658628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:38.701253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601480792632352:8672]
2025-10-10T14:34:38.701580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1406, pipe: [1:7559601480792632352:8672]
2025-10-10T14:34:38.780541Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:38.780940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.780974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.781025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632352:8672], now have 1 active actors on pipe
2025-10-10T14:34:38.781235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:38.781247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601480792632352:8672]
2025-10-10T14:34:38.781265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:38.781269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:38.781286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:38.781361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1407 reason: error at write: Disconnected sessionId: src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0
2025-10-10T14:34:38.781608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1407 sessionId: src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0 is DEAD
2025-10-10T14:34:38.781768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:38.781782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0] Write session will restart in 0.007471s
2025-10-10T14:34:38.781809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0] Write session: Do CDS request
2025-10-10T14:34:38.781819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:38.790969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.791038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:38.791055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1408
2025-10-10T14:34:38.791232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.791285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:38.791308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:38.791313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:38.791779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1408 sessionId:  describe result for acl check
2025-10-10T14:34:38.791816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:38.791819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:38.791821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:38.791827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601480792632382:8705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:38.792411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601480792632382:8705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:38.799353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601480792632382:8705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:38.802575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601480792632382:8705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:38.802592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601480792632382:8705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:38.802595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601480792632382:8705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:38.802603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:38.804047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:38.806502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:38.806714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:38.806726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:38.806738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:38.806794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:38.806836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601480010408891:8385]
2025-10-10T14:34:38.807464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:38.807828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:38.807873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:38.808104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:38.808142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.808143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.808145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.808145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.808147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.808148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.808149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.808150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.808150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.808151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.808153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.808153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.808154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.808160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.808172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.808176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.808180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.808184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.808188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.808202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.808205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.808207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.808210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.808212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.808214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.808216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.808223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.808229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.808234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.808238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.808241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.808244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.808247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.808250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.808253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.808256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.808259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.808262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.808265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.808268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.808271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.808274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.808277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.808280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.808282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.808285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.808288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.808291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.808294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.808297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.808300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.808303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.808329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:38.810603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:38.811089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:38.811099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:38.811100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:38.811103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:38.811109Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1407 [2:7559601480010408891:8385]
2025-10-10T14:34:38.811118Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:38.811131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:38.811133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.811135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.811136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.811150Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:38.811155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:38.811161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:38.811205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.811212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.811214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.811216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:38.811267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:38.811270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.811281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.811292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.811307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:38.811328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601480010408886:8385]
2025-10-10T14:34:38.811331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601480010408886:8385]
2025-10-10T14:34:38.811333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601480010408886:8385]
2025-10-10T14:34:38.811342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:38.811356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:38.811367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:38.811370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:38.811370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:38.811372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:38.811373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:38.811404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632594:8705], now have 1 active actors on pipe
2025-10-10T14:34:38.811408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632367:2438], now have 1 active actors on pipe
2025-10-10T14:34:38.811411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601480010408886:8385]
2025-10-10T14:34:38.811421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:38.811462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:38.811493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1407
2025-10-10T14:34:38.811539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1407
2025-10-10T14:34:38.811675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.811690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.811741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd782834-5797b02c-c752229a-c1655641_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:38.811755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.811759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.811761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:38.811773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.811798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:38.811818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.812451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.812459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.812475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.812580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1408 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd782834-5797b02c-c752229a-c1655641_0
2025-10-10T14:34:38.812996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cf3ca5d-7fc34dcc-f8032d05-be86e027_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd782834-5797b02c-c752229a-c1655641_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:38.815690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd782834-5797b02c-c752229a-c1655641_0] Write session: try to update token
2025-10-10T14:34:38.815707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd782834-5797b02c-c752229a-c1655641_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:38.831281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId: src_id|cd782834-5797b02c-c752229a-c1655641_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:38.833264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:38.833287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:38.833290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:38.833293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:38.833303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601480010408886:8385]
2025-10-10T14:34:38.833307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601480010408886:8385]
2025-10-10T14:34:38.833310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601480010408886:8385]
2025-10-10T14:34:38.833370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:38.833377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:38.833377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:38.833381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:38.833385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.833387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:38.833525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:38.834073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:38.881567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601480792632609:8672]
2025-10-10T14:34:38.881903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1407, pipe: [1:7559601480792632609:8672]
2025-10-10T14:34:38.950941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:38.951713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.951745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.951794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632609:8672], now have 1 active actors on pipe
2025-10-10T14:34:38.952378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:38.952743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd782834-5797b02c-c752229a-c1655641_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:38.952756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd782834-5797b02c-c752229a-c1655641_0] Write session will restart in 0.007830s
2025-10-10T14:34:38.952782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd782834-5797b02c-c752229a-c1655641_0] Write session: Do CDS request
2025-10-10T14:34:38.952789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd782834-5797b02c-c752229a-c1655641_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:38.952266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:38.952285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:38.952356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1408 reason: error at write: Disconnected sessionId: src_id|cd782834-5797b02c-c752229a-c1655641_0
2025-10-10T14:34:38.952588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1408 sessionId: src_id|cd782834-5797b02c-c752229a-c1655641_0 is DEAD
2025-10-10T14:34:38.952789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601480792632609:8672]
2025-10-10T14:34:38.952804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:38.961953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd782834-5797b02c-c752229a-c1655641_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.965423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:38.965445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1409
2025-10-10T14:34:38.969205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:38.969274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:38.969285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:38.969290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:38.969806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1409 sessionId:  describe result for acl check
2025-10-10T14:34:38.969847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:38.969849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:38.969851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:38.969858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601480792632671:8709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:38.970455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601480792632671:8709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:38.973287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601480792632671:8709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:38.976879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601480792632671:8709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:38.976897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601480792632671:8709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:38.976901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601480792632671:8709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:38.976911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:38.976928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:38.980135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:38.980386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:38.980397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:38.980409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:38.980464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:38.980506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601480010409133:8387]
2025-10-10T14:34:38.981176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:38.981556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:38.981617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:38.981995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:38.982063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.982069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.982070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.982072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.982073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.982074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.982075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.982077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.982078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.982079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.982081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.982082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.982083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.982090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.982104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.982109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.982113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.982117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.982121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.982125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.982130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.982134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.982139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.982143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.982147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.982151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.982159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.982168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:38.982175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.982181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:38.982188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.982193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:38.982198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.982204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:38.982209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.982214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:38.982221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.982226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:38.982238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.982244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:38.982248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.982254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:38.982263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.982277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:38.982287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.982294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:38.982303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.982308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.982313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.982322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.982326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.982332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.982371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:38.984996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:38.985724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:38.985738Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:38.985740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:38.985744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:38.985750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1408 [2:7559601480010409133:8387]
2025-10-10T14:34:38.985763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:38.985782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:38.985790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.985794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.985796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.985817Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:38.985824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:38.985838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:38.985903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.985910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.985912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.985915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:38.985985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:38.985993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:38.986005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:38.986021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:38.986041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:38.986071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632843:8709], now have 1 active actors on pipe
2025-10-10T14:34:38.986079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601480792632614:2438], now have 1 active actors on pipe
2025-10-10T14:34:38.986089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601480010409127:8387]
2025-10-10T14:34:38.986097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601480010409127:8387]
2025-10-10T14:34:38.986099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601480010409127:8387]
2025-10-10T14:34:38.986115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:38.986129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:38.986145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1408
2025-10-10T14:34:38.986145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:38.986155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:38.986159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:38.986162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:38.986164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:38.986186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601480010409127:8387]
2025-10-10T14:34:38.986189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:38.986199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:38.986207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.986213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.986264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48362951-c4929837-dfe30c2e-127cc7a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:38.986281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:38.986285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:38.986287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:38.986299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:38.986315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:38.986338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.986415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1408
2025-10-10T14:34:38.986570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:38.986582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:38.986604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:38.986772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1409 partition: 0 MaxSeqNo: 40 sessionId: src_id|48362951-c4929837-dfe30c2e-127cc7a7_0
2025-10-10T14:34:38.987195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd782834-5797b02c-c752229a-c1655641_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48362951-c4929837-dfe30c2e-127cc7a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:38.989999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48362951-c4929837-dfe30c2e-127cc7a7_0] Write session: try to update token
2025-10-10T14:34:38.990019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48362951-c4929837-dfe30c2e-127cc7a7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:39.005848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId: src_id|48362951-c4929837-dfe30c2e-127cc7a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:39.008769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:39.006766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:39.006786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:39.006789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:39.006791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:39.006801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601480010409127:8387]
2025-10-10T14:34:39.006805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601480010409127:8387]
2025-10-10T14:34:39.006810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601480010409127:8387]
2025-10-10T14:34:39.006863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:39.006863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:39.006870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.006870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:39.006872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:39.006874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:39.007023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:39.053038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601485087600153:8672]
2025-10-10T14:34:39.053575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1408, pipe: [1:7559601485087600153:8672]
2025-10-10T14:34:39.125005Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:39.125285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.125295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.125435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600153:8672], now have 1 active actors on pipe
2025-10-10T14:34:39.125832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:39.125872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601485087600153:8672]
2025-10-10T14:34:39.125911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:39.125914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:39.125979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1409 reason: error at write: Disconnected sessionId: src_id|48362951-c4929837-dfe30c2e-127cc7a7_0
2025-10-10T14:34:39.126244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:39.126268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1409 sessionId: src_id|48362951-c4929837-dfe30c2e-127cc7a7_0 is DEAD
2025-10-10T14:34:39.126415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48362951-c4929837-dfe30c2e-127cc7a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:39.126439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48362951-c4929837-dfe30c2e-127cc7a7_0] Write session will restart in 0.005181s
2025-10-10T14:34:39.126464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48362951-c4929837-dfe30c2e-127cc7a7_0] Write session: Do CDS request
2025-10-10T14:34:39.126473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48362951-c4929837-dfe30c2e-127cc7a7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:39.132952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48362951-c4929837-dfe30c2e-127cc7a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.133090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:39.133121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1410
2025-10-10T14:34:39.133415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.133476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:39.133483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:39.133487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:39.134378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1410 sessionId:  describe result for acl check
2025-10-10T14:34:39.134416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:39.134418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:39.134420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:39.134427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601485087600170:8713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:39.135001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601485087600170:8713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:39.141157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601485087600170:8713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:39.149822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601485087600170:8713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:39.149844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601485087600170:8713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:39.149848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601485087600170:8713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:39.149859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:39.158484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:39.158925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:39.159123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:39.159134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:39.159147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:39.159196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:39.159238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601484305376672:8389]
2025-10-10T14:34:39.159826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:39.161682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:39.161734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:39.162084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:39.162147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.162153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.162154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.162156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.162156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.162158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.162159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.162160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.162161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.162162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.162163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.162165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.162165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.162172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.162185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.162189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.162193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.162197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.162200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.162203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.162206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.162210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.162214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.162217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.162221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.162224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.162234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.162242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.162248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.162253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.162257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.162261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.162265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.162270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.162274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.162278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.162282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.162287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.162291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.162296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.162299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.162304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.162308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.162314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.162318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.162322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.162326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.162332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.162342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.162348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.162352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.162359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.162395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:39.165323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:39.165677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:39.165691Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:39.165694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:39.165698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:39.165705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1409 [2:7559601484305376672:8389]
2025-10-10T14:34:39.165720Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:39.165744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:39.165752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.165756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.165758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.165776Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:39.165792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:39.165800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:39.165865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.165871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.165874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.165876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:39.165948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:39.165956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.165967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.165977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.165998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:39.166022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600297:8713], now have 1 active actors on pipe
2025-10-10T14:34:39.166028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600155:2438], now have 1 active actors on pipe
2025-10-10T14:34:39.166036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601484305376666:8389]
2025-10-10T14:34:39.166038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601484305376666:8389]
2025-10-10T14:34:39.166040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601484305376666:8389]
2025-10-10T14:34:39.166053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:39.166170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1409
2025-10-10T14:34:39.166183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1409
2025-10-10T14:34:39.166070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:39.166072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:39.166076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:39.166078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:39.166089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:39.166092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:39.166122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601484305376666:8389]
2025-10-10T14:34:39.166130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:39.166149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:39.166310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.166316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.166346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6463b909-2581cdc7-127a757a-50d7bd25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:39.166353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.166357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.166360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:39.166371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.166383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:39.166397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.166592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.166595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.166611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.166733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1410 partition: 0 MaxSeqNo: 40 sessionId: src_id|6463b909-2581cdc7-127a757a-50d7bd25_0
2025-10-10T14:34:39.167195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48362951-c4929837-dfe30c2e-127cc7a7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6463b909-2581cdc7-127a757a-50d7bd25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:39.170094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6463b909-2581cdc7-127a757a-50d7bd25_0] Write session: try to update token
2025-10-10T14:34:39.170117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6463b909-2581cdc7-127a757a-50d7bd25_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:39.185922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId: src_id|6463b909-2581cdc7-127a757a-50d7bd25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:39.187738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:39.187761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:39.187765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:39.187766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:39.187777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601484305376666:8389]
2025-10-10T14:34:39.187781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601484305376666:8389]
2025-10-10T14:34:39.187785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601484305376666:8389]
2025-10-10T14:34:39.187836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:39.187850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.187850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:39.187852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:39.187857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:39.187862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:39.187996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:39.188719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:39.226044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601485087600402:8672]
2025-10-10T14:34:39.226365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1409, pipe: [1:7559601485087600402:8672]
2025-10-10T14:34:39.306333Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:39.307010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.307023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.307074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600402:8672], now have 1 active actors on pipe
2025-10-10T14:34:39.307349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:39.307341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:39.307359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:39.307416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601485087600402:8672]
2025-10-10T14:34:39.307423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1410 reason: error at write: Disconnected sessionId: src_id|6463b909-2581cdc7-127a757a-50d7bd25_0
2025-10-10T14:34:39.307433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:39.307647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1410 sessionId: src_id|6463b909-2581cdc7-127a757a-50d7bd25_0 is DEAD
2025-10-10T14:34:39.308592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6463b909-2581cdc7-127a757a-50d7bd25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:39.308602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6463b909-2581cdc7-127a757a-50d7bd25_0] Write session will restart in 0.008736s
2025-10-10T14:34:39.308628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6463b909-2581cdc7-127a757a-50d7bd25_0] Write session: Do CDS request
2025-10-10T14:34:39.308639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6463b909-2581cdc7-127a757a-50d7bd25_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:39.319792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6463b909-2581cdc7-127a757a-50d7bd25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.320695Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:39.320717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1411
2025-10-10T14:34:39.320856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.320889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:39.320895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:39.320899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:39.322172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1411 sessionId:  describe result for acl check
2025-10-10T14:34:39.322216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:39.322218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:39.322220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:39.322226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601485087600456:8717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:39.322812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601485087600456:8717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:39.327823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601485087600456:8717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:39.338303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:39.338133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601485087600456:8717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:39.338157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601485087600456:8717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:39.338161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601485087600456:8717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:39.338172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:39.341843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:39.342133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:39.342144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:39.342159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:39.342224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:39.342270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601484305376916:8391]
2025-10-10T14:34:39.342916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:39.343321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:39.343388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:39.343779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:39.343855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.343862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.343863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.343865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.343866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.343867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.343868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.343869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.343870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.343871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.343872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.343874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.343875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.343882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.343895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.343899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.343904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.343908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.343912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.343916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.343921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.343925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.343929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.343933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.343938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.343961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.343969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.343983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.343995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.344001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.344011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.344016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.344022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.344028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.344033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.344039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.344044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.344054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.344059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.344064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.344068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.344073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.344078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.344084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.344089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.344094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.344098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.344104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.344108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.344119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.344124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.344134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.344179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:39.346874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:39.347223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:39.347238Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:39.347241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:39.347245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:39.347253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1410 [2:7559601484305376916:8391]
2025-10-10T14:34:39.347266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:39.347284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:39.347288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.347292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.347294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.347312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:39.347319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:39.347327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:39.347386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.347391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.347393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.347396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:39.347483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:39.347492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.347504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.347514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.347533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:39.347554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601484305376910:8391]
2025-10-10T14:34:39.347561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601484305376910:8391]
2025-10-10T14:34:39.347564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601484305376910:8391]
2025-10-10T14:34:39.347581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:39.347600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:39.347619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:39.347629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:39.347636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:39.347639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:39.347642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:39.347659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601484305376910:8391]
2025-10-10T14:34:39.347662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:39.347749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:39.347915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600639:8717], now have 1 active actors on pipe
2025-10-10T14:34:39.347923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600404:2438], now have 1 active actors on pipe
2025-10-10T14:34:39.347969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1410
2025-10-10T14:34:39.348023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1410
2025-10-10T14:34:39.348065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.348079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.348120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:39.348136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.348142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.348154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:39.348171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.348185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:39.348204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.348514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.348525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.348546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.348635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1411 partition: 0 MaxSeqNo: 40 sessionId: src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0
2025-10-10T14:34:39.349107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6463b909-2581cdc7-127a757a-50d7bd25_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:39.351954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0] Write session: try to update token
2025-10-10T14:34:39.351975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:39.368579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId: src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:39.369145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:39.369162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:39.369165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:39.369167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:39.369177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601484305376910:8391]
2025-10-10T14:34:39.369184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601484305376910:8391]
2025-10-10T14:34:39.369188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601484305376910:8391]
2025-10-10T14:34:39.369238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:39.369245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:39.369252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:39.369253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.369255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:39.369259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:39.369422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:39.371495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:39.407832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601485087600652:8672]
2025-10-10T14:34:39.408175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1410, pipe: [1:7559601485087600652:8672]
2025-10-10T14:34:39.487321Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:39.488106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.488125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.488174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600652:8672], now have 1 active actors on pipe
2025-10-10T14:34:39.488395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:39.488996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:39.489089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1411 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0
2025-10-10T14:34:39.489493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:39.489502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0] Write session will restart in 0.006083s
2025-10-10T14:34:39.489529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0] Write session: Do CDS request
2025-10-10T14:34:39.489534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:39.489311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1411 sessionId: src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0 is DEAD
2025-10-10T14:34:39.489529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:39.489565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601485087600652:8672]
2025-10-10T14:34:39.498140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.498268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:39.498290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1412
2025-10-10T14:34:39.498427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.498463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:39.498476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:39.498480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:39.498936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1412 sessionId:  describe result for acl check
2025-10-10T14:34:39.498980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:39.498984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:39.498986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:39.498993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601485087600667:8721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:39.499569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601485087600667:8721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:39.503087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601485087600667:8721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:39.511142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601485087600667:8721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:39.511179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601485087600667:8721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:39.511183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601485087600667:8721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:39.511193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:39.514087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:39.516973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:39.517220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:39.517234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:39.517246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:39.517324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:39.517384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601484305377161:8393]
2025-10-10T14:34:39.518032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:39.518515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:39.518600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:39.518990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:39.519056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.519063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.519065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.519066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.519068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.519069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.519071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.519072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.519073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.519075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.519076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.519077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.519079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.519086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.519101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.519106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.519110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.519115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.519120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.519124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.519129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.519134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.519141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.519145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.519150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.519154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.519165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.519176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.519183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.519190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.519195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.519202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.519208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.519215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.519221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.519228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.519233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.519240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.519246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.519252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.519258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.519264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.519270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.519277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.519282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.519288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.519294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.519302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.519322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.519334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.519339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.519350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.519406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:39.522716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:39.523059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:39.523075Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:39.523078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:39.523082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:39.523090Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1411 [2:7559601484305377161:8393]
2025-10-10T14:34:39.523104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:39.523124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:39.523128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.523132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.523134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.523153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:39.523168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:39.523182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:39.523247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.523257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.523259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.523263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:39.523335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:39.523344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.523357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.523375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.523400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:39.523428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600654:2438], now have 1 active actors on pipe
2025-10-10T14:34:39.523437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600869:8721], now have 1 active actors on pipe
2025-10-10T14:34:39.523445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601484305377156:8393]
2025-10-10T14:34:39.523454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601484305377156:8393]
2025-10-10T14:34:39.523456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601484305377156:8393]
2025-10-10T14:34:39.523475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:39.523496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:39.523512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:39.523520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:39.523507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1411
2025-10-10T14:34:39.523555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601484305377156:8393]
2025-10-10T14:34:39.523563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:39.523533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1411
2025-10-10T14:34:39.523582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:39.523598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:39.523605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:39.523614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:39.523664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.523675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.523725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:39.523738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.523743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.523747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:39.523759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.523776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:39.523793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.524091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.524100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.524117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.524228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1412 partition: 0 MaxSeqNo: 40 sessionId: src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0
2025-10-10T14:34:39.524662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b8d5a6-9179b2d3-275c4970-525f5848_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:39.527719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0] Write session: try to update token
2025-10-10T14:34:39.527742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:39.545932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:39.545954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:39.545957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:39.545959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:39.545970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601484305377156:8393]
2025-10-10T14:34:39.545974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601484305377156:8393]
2025-10-10T14:34:39.545977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601484305377156:8393]
2025-10-10T14:34:39.546021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:39.546030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.546032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:39.546182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:39.547264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId: src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:39.549441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:39.549458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:39.549463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:39.549925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:39.589588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601485087600915:8672]
2025-10-10T14:34:39.590004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1411, pipe: [1:7559601485087600915:8672]
2025-10-10T14:34:39.669860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:39.670401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.670421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.670470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600915:8672], now have 1 active actors on pipe
2025-10-10T14:34:39.670697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:39.671187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:39.671293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1412 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0
2025-10-10T14:34:39.671518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1412 sessionId: src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0 is DEAD
2025-10-10T14:34:39.671720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:39.671732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0] Write session will restart in 0.008706s
2025-10-10T14:34:39.671762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0] Write session: Do CDS request
2025-10-10T14:34:39.671769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:39.671800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:39.671841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601485087600915:8672]
2025-10-10T14:34:39.685887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.686034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:39.686054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1413
2025-10-10T14:34:39.686188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.686225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:39.686235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:39.686239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:39.686835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1413 sessionId:  describe result for acl check
2025-10-10T14:34:39.686877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:39.686879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:39.686881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:39.686888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601485087600945:8727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:39.687491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601485087600945:8727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:39.690750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601485087600945:8727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:39.694759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601485087600945:8727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:39.694779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601485087600945:8727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:39.694783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601485087600945:8727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:39.694803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:39.703199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:39.706527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:39.706778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:39.706789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:39.706799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:39.706845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:39.706890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601484305377434:8396]
2025-10-10T14:34:39.707329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:39.707653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:39.707717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:39.708044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:39.708106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.708112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.708113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.708114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.708116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.708117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.708118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.708119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.708120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.708121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.708122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.708123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.708124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.708130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.708142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.708146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.708149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.708153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.708157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.708161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.708165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.708168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.708173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.708177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.708181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.708185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.708195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.708203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.708209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.708215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.708219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.708224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.708227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.708232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.708237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.708242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.708246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.708252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.708256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.708261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.708266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.708271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.708275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.708285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.708290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.708295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.708300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.708306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.708310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.708315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.708320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.708331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.708370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:39.711347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:39.711892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:39.711906Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:39.711908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:39.711913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:39.711921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1412 [2:7559601484305377434:8396]
2025-10-10T14:34:39.711936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:39.711953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:39.711961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.711965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.711967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.711984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:39.711994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:39.712007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:39.712069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.712076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.712078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.712081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:39.712147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:39.712154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.712166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.712184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.712200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:39.712224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087601067:8727], now have 1 active actors on pipe
2025-10-10T14:34:39.712233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087600927:2438], now have 1 active actors on pipe
2025-10-10T14:34:39.712241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601484305377427:8396]
2025-10-10T14:34:39.712244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601484305377427:8396]
2025-10-10T14:34:39.712246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601484305377427:8396]
2025-10-10T14:34:39.712262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:39.712277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:39.712297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:39.712302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:39.712304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:39.712305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:39.712296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1412
2025-10-10T14:34:39.712307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:39.712333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601484305377427:8396]
2025-10-10T14:34:39.712341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:39.712343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1412
2025-10-10T14:34:39.712357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:39.712358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.712363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.712410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:39.712423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.712427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.712429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:39.712439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.712454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:39.712474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.712651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.712660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.712678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.712784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1413 partition: 0 MaxSeqNo: 40 sessionId: src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0
2025-10-10T14:34:39.713229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45c350dd-c6ec7b8c-7aabd712-baa8aa83_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:39.715992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0] Write session: try to update token
2025-10-10T14:34:39.716012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:39.733363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:39.733383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:39.733388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:39.733390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:39.733400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601484305377427:8396]
2025-10-10T14:34:39.733404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601484305377427:8396]
2025-10-10T14:34:39.733408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601484305377427:8396]
2025-10-10T14:34:39.733460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:39.733457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:39.733464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:39.733468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:39.733468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.733471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:39.733610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:39.736209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId: src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:39.739243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:39.773475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601485087601191:8672]
2025-10-10T14:34:39.777699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1412, pipe: [1:7559601485087601191:8672]
2025-10-10T14:34:39.858138Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:39.858704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.858731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.858780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087601191:8672], now have 1 active actors on pipe
2025-10-10T14:34:39.859208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:39.859270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:39.859251Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:39.859273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:39.859336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1413 reason: error at write: Disconnected sessionId: src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0
2025-10-10T14:34:39.859542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1413 sessionId: src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0 is DEAD
2025-10-10T14:34:39.860006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601485087601191:8672]
2025-10-10T14:34:39.860538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:39.860549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0] Write session will restart in 0.005333s
2025-10-10T14:34:39.860574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0] Write session: Do CDS request
2025-10-10T14:34:39.860585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:39.868639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.868759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:39.868779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1414
2025-10-10T14:34:39.868957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:39.869010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:39.869015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:39.869019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:39.869543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1414 sessionId:  describe result for acl check
2025-10-10T14:34:39.869590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:39.869592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:39.869594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:39.869601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601485087601220:8740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:39.870188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601485087601220:8740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:39.872464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601485087601220:8740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:39.876825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601485087601220:8740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:39.876843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601485087601220:8740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:39.876848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601485087601220:8740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:39.876858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:39.892991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:39.897595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:39.897880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:39.897896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:39.897911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:39.897972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:39.898020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601484305377708:8412]
2025-10-10T14:34:39.898640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:39.900651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:39.900722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:39.901232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:39.901312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.901313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.901314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.901316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.901318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.901319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.901320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.901322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.901323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.901324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.901326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.901326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.901342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.901349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.901365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.901369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.901373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.901377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.901381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.901385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.901389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.901393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.901397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.901401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.901405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.901408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.901417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.901426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:39.901433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.901441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:39.901446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.901451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:39.901455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.901460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:39.901465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.901470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:39.901475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.901479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:39.901484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.901489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:39.901494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.901499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:39.901504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.901509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:39.901513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.901519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:39.901525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.901530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.901545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.901551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.901555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.901582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.901628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:39.909723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:39.910788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:39.910810Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:39.910813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:39.910817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:39.910826Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1413 [2:7559601484305377708:8412]
2025-10-10T14:34:39.910843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:39.910867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:39.910877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.910882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.910885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.910907Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:39.910921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:39.910937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:39.911016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.911024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.911026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.911029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:39.911121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:39.911136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.911151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:39.911163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:39.911182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:39.911211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601484305377703:8412]
2025-10-10T14:34:39.911222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601484305377703:8412]
2025-10-10T14:34:39.911224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601484305377703:8412]
2025-10-10T14:34:39.911244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:39.911263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:39.911281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:39.911284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:39.911292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:39.911295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:39.911298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:39.911339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601484305377703:8412]
2025-10-10T14:34:39.911351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:39.911393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:39.911565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1413
2025-10-10T14:34:39.911572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1413
2025-10-10T14:34:39.914007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087601295:8740], now have 1 active actors on pipe
2025-10-10T14:34:39.914027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087601205:2438], now have 1 active actors on pipe
2025-10-10T14:34:39.914051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.914059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.914114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:39.914127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:39.914133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:39.914136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:39.914153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:39.914174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:39.914198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.914574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.914588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.914615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:39.914743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1414 partition: 0 MaxSeqNo: 40 sessionId: src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0
2025-10-10T14:34:39.915164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d0219-b6174a4-c5b04fa7-ca54a93c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:39.917918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0] Write session: try to update token
2025-10-10T14:34:39.917938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:39.924001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:39.924019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:39.924029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601484305377703:8412]
2025-10-10T14:34:39.924073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:39.924085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:39.924253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:39.924400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:39.924562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:39.924721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:39.924921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:39.924969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:39.940228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId: src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:39.943017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:39.943953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:39.943982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:39.944008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:39.944011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:39.944014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:39.944016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:39.944029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601484305377703:8412]
2025-10-10T14:34:39.944035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601484305377703:8412]
2025-10-10T14:34:39.944040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601484305377703:8412]
2025-10-10T14:34:39.944104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:39.944087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:39.944111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:39.944112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:39.944115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:39.944118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:39.944255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:39.960290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601485087601456:8672]
2025-10-10T14:34:39.960973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1413, pipe: [1:7559601485087601456:8672]
2025-10-10T14:34:40.063945Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:40.064270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:40.064318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601485087601456:8672], now have 1 active actors on pipe
2025-10-10T14:34:40.064589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:40.064717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:40.064718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:40.064721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:40.064788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601485087601456:8672]
2025-10-10T14:34:40.065129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:40.065139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0] Write session will restart in 0.005871s
2025-10-10T14:34:40.065163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0] Write session: Do CDS request
2025-10-10T14:34:40.065169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:40.064817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1414 reason: error at write: Disconnected sessionId: src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0
2025-10-10T14:34:40.064990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1414 sessionId: src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0 is DEAD
2025-10-10T14:34:40.072055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.073666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:40.073686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1415
2025-10-10T14:34:40.073963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.074001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:40.074007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:40.074011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:40.074499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1415 sessionId:  describe result for acl check
2025-10-10T14:34:40.074537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:40.074542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:40.074544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:40.074551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601489382568774:8744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:40.075122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601489382568774:8744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:40.078703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601489382568774:8744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:40.084154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601489382568774:8744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:40.084180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601489382568774:8744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:40.084185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601489382568774:8744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:40.084198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:40.095124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:40.099340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:40.099643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:40.099649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:40.099663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:40.099763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:40.099808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601488600345254:8414]
2025-10-10T14:34:40.100452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:40.100908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:40.100962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:40.101371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:40.101438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.101440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.101441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.101443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.101445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.101447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.101448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.101450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.101451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.101453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.101455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.101456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.101458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.101466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.101482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.101487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.101492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.101497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.101516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.101521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.101526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.101530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.101536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.101540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.101545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.101550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.101560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.101570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.101577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.101584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.101610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.101623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.101628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.101635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.101641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.101647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.101654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.101660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.101666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.101678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.101684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.101695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.101701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.101713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.101718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.101725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.101735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.101741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.101750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.101756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.101766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.101772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.101821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:40.104714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:40.105473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:40.105489Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:40.105492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:40.105496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:40.105503Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1414 [2:7559601488600345254:8414]
2025-10-10T14:34:40.105518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:40.105887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1414
2025-10-10T14:34:40.105897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1414
2025-10-10T14:34:40.105539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:40.105550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.105554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.105557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.105576Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:40.105584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:40.105593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:40.105672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.105674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.105677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.105680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:40.105770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:40.105773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.105789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.105803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.105821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:40.105846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382568914:8744], now have 1 active actors on pipe
2025-10-10T14:34:40.105850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382568759:2438], now have 1 active actors on pipe
2025-10-10T14:34:40.105859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601488600345248:8414]
2025-10-10T14:34:40.105861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601488600345248:8414]
2025-10-10T14:34:40.105864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601488600345248:8414]
2025-10-10T14:34:40.105880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:40.105890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:40.105894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:40.105896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:40.105898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:40.105917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:40.105920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:40.105956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601488600345248:8414]
2025-10-10T14:34:40.105964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:40.105972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:40.105987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.105992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.106061Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42065617-fb53fd3c-f282420d-b94da17e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:40.106071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.106076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.106079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:40.106092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.106104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:40.106125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.108387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.108408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.108441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.108787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1415 partition: 0 MaxSeqNo: 40 sessionId: src_id|42065617-fb53fd3c-f282420d-b94da17e_0
2025-10-10T14:34:40.109411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cf6f16e-aea0e6af-f5e81213-18bce152_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|42065617-fb53fd3c-f282420d-b94da17e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:40.112208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42065617-fb53fd3c-f282420d-b94da17e_0] Write session: try to update token
2025-10-10T14:34:40.112227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42065617-fb53fd3c-f282420d-b94da17e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:40.126957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:40.126979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:40.126983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:40.126986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:40.126996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601488600345248:8414]
2025-10-10T14:34:40.127001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601488600345248:8414]
2025-10-10T14:34:40.127006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601488600345248:8414]
2025-10-10T14:34:40.127075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:40.127077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:40.127088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.127090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:40.127091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:40.127094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:40.127252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:40.130523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId: src_id|42065617-fb53fd3c-f282420d-b94da17e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:40.133408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:40.165790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601489382569011:8672]
2025-10-10T14:34:40.166239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1414, pipe: [1:7559601489382569011:8672]
2025-10-10T14:34:40.245064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:40.245613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.245629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.245676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569011:8672], now have 1 active actors on pipe
2025-10-10T14:34:40.246126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:40.246141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:40.246200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1415 reason: error at write: Disconnected sessionId: src_id|42065617-fb53fd3c-f282420d-b94da17e_0
2025-10-10T14:34:40.246421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1415 sessionId: src_id|42065617-fb53fd3c-f282420d-b94da17e_0 is DEAD
2025-10-10T14:34:40.246693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:40.246736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601489382569011:8672]
2025-10-10T14:34:40.247468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:40.249601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42065617-fb53fd3c-f282420d-b94da17e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:40.249611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42065617-fb53fd3c-f282420d-b94da17e_0] Write session will restart in 0.008283s
2025-10-10T14:34:40.249636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42065617-fb53fd3c-f282420d-b94da17e_0] Write session: Do CDS request
2025-10-10T14:34:40.249646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42065617-fb53fd3c-f282420d-b94da17e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:40.262001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42065617-fb53fd3c-f282420d-b94da17e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.262069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:40.262092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1416
2025-10-10T14:34:40.262239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.262275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:40.262281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:40.262284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:40.262756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1416 sessionId:  describe result for acl check
2025-10-10T14:34:40.262795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:40.262797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:40.262799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:40.262806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601489382569048:8748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:40.263376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601489382569048:8748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:40.266272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601489382569048:8748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:40.269991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601489382569048:8748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:40.270009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601489382569048:8748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:40.270013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601489382569048:8748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:40.270023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:40.276701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:40.279930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:40.280192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:40.280204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:40.280216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:40.280276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:40.280321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601488600345503:8416]
2025-10-10T14:34:40.280968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:40.281388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:40.281446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:40.281772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:40.281853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.281860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.281862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.281863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.281864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.281865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.281867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.281868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.281869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.281870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.281872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.281873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.281874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.281881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.281895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.281899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.281903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.281907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.281912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.281917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.281920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.281924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.281929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.281932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.281936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.281939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.281949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.281958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.281965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.281970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.281975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.281980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.281984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.281989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.281993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.282010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.282018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.282023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.282028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.282033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.282037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.282049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.282055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.282061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.282070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.282075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.282079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.282089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.282092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.282097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.282106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.282111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.282154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:40.286415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:40.287157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:40.287171Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:40.287173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:40.287177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:40.287185Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1415 [2:7559601488600345503:8416]
2025-10-10T14:34:40.287201Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:40.287222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:40.287227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.287230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.287232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.287251Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:40.287266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:40.287275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:40.287339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.287347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.287349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.287352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:40.287420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:40.287433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.287446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.287457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.287473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:40.287506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569202:8748], now have 1 active actors on pipe
2025-10-10T14:34:40.287510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569013:2438], now have 1 active actors on pipe
2025-10-10T14:34:40.287519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601488600345498:8416]
2025-10-10T14:34:40.287521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601488600345498:8416]
2025-10-10T14:34:40.287523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601488600345498:8416]
2025-10-10T14:34:40.287539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:40.287552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:40.287560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:40.287564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:40.287567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:40.287578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:40.287581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:40.287617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601488600345498:8416]
2025-10-10T14:34:40.287629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:40.287636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:40.287630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1415
2025-10-10T14:34:40.287637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1415
2025-10-10T14:34:40.287843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.287856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.287894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87d73ec9-6875d525-2231e014-c505b45a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:40.287910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.287915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.287918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:40.287932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.287948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:40.287979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.292680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1416 partition: 0 MaxSeqNo: 40 sessionId: src_id|87d73ec9-6875d525-2231e014-c505b45a_0
2025-10-10T14:34:40.293152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42065617-fb53fd3c-f282420d-b94da17e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|87d73ec9-6875d525-2231e014-c505b45a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:40.292405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.292431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.292481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.296090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d73ec9-6875d525-2231e014-c505b45a_0] Write session: try to update token
2025-10-10T14:34:40.296109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d73ec9-6875d525-2231e014-c505b45a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:40.308376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:40.308397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:40.308410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601488600345498:8416]
2025-10-10T14:34:40.308466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:40.308638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:40.308771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:40.308913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:40.309055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:40.309248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:40.309289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:40.309469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:40.324976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId: src_id|87d73ec9-6875d525-2231e014-c505b45a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:40.327934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:40.326064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:40.326086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:40.326090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:40.326091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:40.326103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601488600345498:8416]
2025-10-10T14:34:40.326108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601488600345498:8416]
2025-10-10T14:34:40.326112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601488600345498:8416]
2025-10-10T14:34:40.326171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:40.326180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.326179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:40.326182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:40.326185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:40.326189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:40.326334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:40.346814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601489382569266:8672]
2025-10-10T14:34:40.347362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1415, pipe: [1:7559601489382569266:8672]
2025-10-10T14:34:40.446145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:40.446148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:40.446165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:40.446197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601489382569266:8672]
2025-10-10T14:34:40.446254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1416 reason: error at write: Disconnected sessionId: src_id|87d73ec9-6875d525-2231e014-c505b45a_0
2025-10-10T14:34:40.446485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1416 sessionId: src_id|87d73ec9-6875d525-2231e014-c505b45a_0 is DEAD
2025-10-10T14:34:40.443811Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:40.444146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.444161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.444190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569266:8672], now have 1 active actors on pipe
2025-10-10T14:34:40.444581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:40.447266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d73ec9-6875d525-2231e014-c505b45a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:40.447278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d73ec9-6875d525-2231e014-c505b45a_0] Write session will restart in 0.008696s
2025-10-10T14:34:40.447314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d73ec9-6875d525-2231e014-c505b45a_0] Write session: Do CDS request
2025-10-10T14:34:40.447324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d73ec9-6875d525-2231e014-c505b45a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:40.456903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d73ec9-6875d525-2231e014-c505b45a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.457053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:40.457075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1417
2025-10-10T14:34:40.457239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.457289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:40.457299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:40.457304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:40.458023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1417 sessionId:  describe result for acl check
2025-10-10T14:34:40.458066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:40.458072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:40.458074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:40.458082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601489382569307:8752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:40.458686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601489382569307:8752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:40.462177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601489382569307:8752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:40.469048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601489382569307:8752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:40.469068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601489382569307:8752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:40.469071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601489382569307:8752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:40.469080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:40.477682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:40.478426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:40.478673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:40.478686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:40.478698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:40.478755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:40.478814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601488600345754:8418]
2025-10-10T14:34:40.479493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:40.480796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:40.480864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:40.481248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:40.481371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.481378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.481379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.481381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.481382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.481383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.481384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.481386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.481387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.481388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.481390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.481391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.481392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.481399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.481414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.481418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.481422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.481426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.481430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.481434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.481438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.481441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.481446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.481450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.481454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.481457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.481467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.481477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.481484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.481490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.481494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.481499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.481503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.481508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.481513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.481518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.481523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.481528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.481533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.481538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.481543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.481549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.481553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.481558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.481562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.481569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.481574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.481580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.481584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.481589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.481597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.481615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.481669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:40.484259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:40.485093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:40.485108Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:40.485111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:40.485115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:40.485121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1416 [2:7559601488600345754:8418]
2025-10-10T14:34:40.485135Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:40.485154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:40.485157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.485161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.485164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.485183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:40.485191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:40.485198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:40.485260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.485262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.485265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.485268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:40.485359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:40.485362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.485376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.485389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.485406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:40.485429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601488600345749:8418]
2025-10-10T14:34:40.485432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601488600345749:8418]
2025-10-10T14:34:40.485436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601488600345749:8418]
2025-10-10T14:34:40.485445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:40.485453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:40.485456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:40.485459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:40.485467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569268:2438], now have 1 active actors on pipe
2025-10-10T14:34:40.485474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:40.485489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:40.485492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:40.485498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569479:8752], now have 1 active actors on pipe
2025-10-10T14:34:40.485528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601488600345749:8418]
2025-10-10T14:34:40.485537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:40.485552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:40.485523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1416
2025-10-10T14:34:40.485561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1416
2025-10-10T14:34:40.485585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.485595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.485630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:40.485644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.485648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.485655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:40.485667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.485684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:40.485703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.485879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.485889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.485916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.486015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1417 partition: 0 MaxSeqNo: 40 sessionId: src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0
2025-10-10T14:34:40.486436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d73ec9-6875d525-2231e014-c505b45a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:40.489640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0] Write session: try to update token
2025-10-10T14:34:40.489661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:40.505770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:40.505793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:40.505797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:40.505800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:40.505810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601488600345749:8418]
2025-10-10T14:34:40.505814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601488600345749:8418]
2025-10-10T14:34:40.505817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601488600345749:8418]
2025-10-10T14:34:40.505869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:40.505869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:40.505875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:40.505877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.505880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:40.505880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:40.506016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:40.514936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId: src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:40.517727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:40.546491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601489382569522:8672]
2025-10-10T14:34:40.546811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1416, pipe: [1:7559601489382569522:8672]
2025-10-10T14:34:40.625152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:40.625435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.625451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.625476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569522:8672], now have 1 active actors on pipe
2025-10-10T14:34:40.625681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:40.626213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:40.626232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0] Write session will restart in 0.007361s
2025-10-10T14:34:40.625695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601489382569522:8672]
2025-10-10T14:34:40.625733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:40.625735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:40.626259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0] Write session: Do CDS request
2025-10-10T14:34:40.625736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:40.626266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:40.625809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1417 reason: error at write: Disconnected sessionId: src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0
2025-10-10T14:34:40.626032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1417 sessionId: src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0 is DEAD
2025-10-10T14:34:40.634923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.634986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:40.635005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1418
2025-10-10T14:34:40.635220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.635275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:40.635286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:40.635291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:40.635772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1418 sessionId:  describe result for acl check
2025-10-10T14:34:40.635806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:40.635812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:40.635815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:40.635821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601489382569567:8758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:40.636388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601489382569567:8758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:40.640058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601489382569567:8758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:40.646623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601489382569567:8758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:40.646649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601489382569567:8758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:40.646652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601489382569567:8758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:40.646663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:40.647398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:40.650132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:40.650384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:40.650395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:40.650407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:40.650463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:40.650503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601488600346017:8421]
2025-10-10T14:34:40.651139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:40.651488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:40.651557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:40.651912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:40.652000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.652007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.652008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.652009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.652010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.652011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.652012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.652014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.652015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.652016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.652017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.652018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.652020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.652027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.652040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.652044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.652049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.652053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.652058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.652062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.652066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.652070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.652074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.652078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.652082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.652085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.652093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.652101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.652107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.652112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.652117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.652123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.652127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.652133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.652144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.652149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.652152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.652157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.652161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.652165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.652174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.652179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.652183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.652188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.652192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.652205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.652209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.652219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.652223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.652242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.652252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.652257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.652299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:40.654942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:40.655638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:40.655653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:40.655655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:40.655659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:40.655679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1417 [2:7559601488600346017:8421]
2025-10-10T14:34:40.655691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:40.655705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:40.655711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.655714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.655715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.655733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:40.655741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:40.655750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:40.655811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.655820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.655822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.655824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:40.655893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:40.655899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.655907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.655914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.655924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:40.655946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601488600346012:8421]
2025-10-10T14:34:40.655948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601488600346012:8421]
2025-10-10T14:34:40.655950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601488600346012:8421]
2025-10-10T14:34:40.655956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:40.655968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:40.655970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:40.655973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:40.655976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:40.655983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:40.655987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:40.655998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569540:2438], now have 1 active actors on pipe
2025-10-10T14:34:40.656007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569784:8758], now have 1 active actors on pipe
2025-10-10T14:34:40.656036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601488600346012:8421]
2025-10-10T14:34:40.656054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:40.656067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:40.656093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1417
2025-10-10T14:34:40.656107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1417
2025-10-10T14:34:40.656224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.656242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.656285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:40.656299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.656303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.656306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:40.656318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.656330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:40.656349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.656517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.656525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.656543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.656710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1418 partition: 0 MaxSeqNo: 40 sessionId: src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0
2025-10-10T14:34:40.657153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99bc30cd-c33ed689-a3d1a547-ae3b6f58_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:40.659992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0] Write session: try to update token
2025-10-10T14:34:40.660013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:40.676782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:40.676804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:40.676808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:40.676810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:40.676821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601488600346012:8421]
2025-10-10T14:34:40.676826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601488600346012:8421]
2025-10-10T14:34:40.676830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601488600346012:8421]
2025-10-10T14:34:40.676883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:40.676892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.676895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:40.676906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:40.676921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:40.676926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:40.677054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:40.675211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId: src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:40.678111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:40.725722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601489382569801:8672]
2025-10-10T14:34:40.726010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1417, pipe: [1:7559601489382569801:8672]
2025-10-10T14:34:40.798822Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:40.799745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.799766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.799816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569801:8672], now have 1 active actors on pipe
2025-10-10T14:34:40.800058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:40.800759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:40.800772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0] Write session will restart in 0.006692s
2025-10-10T14:34:40.800809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0] Write session: Do CDS request
2025-10-10T14:34:40.800816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:40.800163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601489382569801:8672]
2025-10-10T14:34:40.800213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:40.800250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:40.800335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1418 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0
2025-10-10T14:34:40.800600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1418 sessionId: src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0 is DEAD
2025-10-10T14:34:40.808965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.809062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:40.809084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1419
2025-10-10T14:34:40.809274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:40.809325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:40.809687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:40.809701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:40.810151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1419 sessionId:  describe result for acl check
2025-10-10T14:34:40.810180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:40.810182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:40.810184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:40.810190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601489382569835:8768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:40.810857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601489382569835:8768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:40.815985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601489382569835:8768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:40.819510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601489382569835:8768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:40.819534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601489382569835:8768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:40.819538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601489382569835:8768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:40.819548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:40.821571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:40.824825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:40.825235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:40.825258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:40.825276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:40.825369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:40.825416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601488600346303:8430]
2025-10-10T14:34:40.826120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:40.826472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:40.826523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:40.826882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:40.826949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.826956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.826957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.826959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.826960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.826961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.826963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.826964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.826966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.826967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.826968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.826969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.826971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.826977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.826990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.826994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.826998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.827003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.827007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.827011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.827015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.827019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.827023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.827027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.827031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.827035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.827041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.827050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:40.827058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.827063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:40.827068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.827072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:40.827077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.827081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:40.827085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.827090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:40.827094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.827099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:40.827103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.827107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:40.827111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.827115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:40.827119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.827123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:40.827127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.827141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:40.827145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.827150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.827156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.827162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.827166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.827171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.827215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:40.829974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:40.830643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:40.830658Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:40.830661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:40.830665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:40.830672Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1418 [2:7559601488600346303:8430]
2025-10-10T14:34:40.830686Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:40.830705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:40.830714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.830717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.830720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.830738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:40.830751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:40.830763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:40.830825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.830833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.830835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.830838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:40.830910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:40.830920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.830932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:40.830944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:40.830962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:40.830987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382569806:2438], now have 1 active actors on pipe
2025-10-10T14:34:40.830997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382570054:8768], now have 1 active actors on pipe
2025-10-10T14:34:40.831004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601488600346298:8430]
2025-10-10T14:34:40.831007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601488600346298:8430]
2025-10-10T14:34:40.831009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601488600346298:8430]
2025-10-10T14:34:40.831025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:40.831046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:40.831063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:40.831066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:40.831103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601488600346298:8430]
2025-10-10T14:34:40.831111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:40.831165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:40.831179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:40.831184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:40.831192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:40.833428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1418
2025-10-10T14:34:40.833486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1418
2025-10-10T14:34:40.833654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.833679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.833728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:40.833746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:40.833752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:40.833754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:40.833770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:40.833789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:40.833813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.834103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.834118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.834153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:40.834327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1419 partition: 0 MaxSeqNo: 40 sessionId: src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0
2025-10-10T14:34:40.834763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76ea0e53-11205831-f93e9143-ff7e20d7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:40.837632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0] Write session: try to update token
2025-10-10T14:34:40.837653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:40.843396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:40.843422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:40.843434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601488600346298:8430]
2025-10-10T14:34:40.843489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:40.843506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:40.843700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:40.843867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:40.844017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:40.844171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:40.844380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:40.844437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:40.853346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId: src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:40.856182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:40.856392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.856416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.856457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:40.856574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:40.863115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:40.863141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:40.863145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:40.863147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:40.863161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601488600346298:8430]
2025-10-10T14:34:40.863166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601488600346298:8430]
2025-10-10T14:34:40.863172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601488600346298:8430]
2025-10-10T14:34:40.863241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:40.863258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:40.863261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:40.863464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:40.865463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:40.865481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:40.865485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:40.900307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601489382570082:8672]
2025-10-10T14:34:40.900623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1418, pipe: [1:7559601489382570082:8672]
2025-10-10T14:34:40.979647Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:40.987843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:40.987875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:40.988058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.988120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.988182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.988244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.988289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.988296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.988368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.988437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.988501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.988566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.988609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.988612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.988687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.988746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.988811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.988874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.988918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.988921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.988992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.989058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.989121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.989188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.989231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.989235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.989305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.989543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.991587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:40.991638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601489382570082:8672]
2025-10-10T14:34:40.991666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:40.991669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:40.991703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1419 reason: error at write: Disconnected sessionId: src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0
2025-10-10T14:34:40.991941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1419 sessionId: src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0 is DEAD
2025-10-10T14:34:40.992067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:40.992076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0] Write session will restart in 0.008618s
2025-10-10T14:34:40.992112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0] Write session: Do CDS request
2025-10-10T14:34:40.992118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:40.989621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.989692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.989732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.989735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.989813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.989874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.989938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.989999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.990041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.990044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.990115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.990180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.990246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.990308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.990348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.990351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.990422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.990475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.990534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.990594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.990636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.990638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.990716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.990772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.990828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.990889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.990931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.990933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.991005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:40.991062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:40.991122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:40.991178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:40.991236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:40.991240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:40.991311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382570082:8672], now have 1 active actors on pipe
2025-10-10T14:34:40.992483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:41.001953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.002065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:41.002087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1420
2025-10-10T14:34:41.002222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.002253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:41.002262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:41.002266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:41.002854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1420 sessionId:  describe result for acl check
2025-10-10T14:34:41.002897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:41.002903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:41.002905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:41.002911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601493677537417:8775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:41.003494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601493677537417:8775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:41.007073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601493677537417:8775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:41.012988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601493677537417:8775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:41.013006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601493677537417:8775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:41.013010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601493677537417:8775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:41.013020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:41.013985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:41.016473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:41.016711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:41.016724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:41.016737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:41.016802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:41.016859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601492895313859:8439]
2025-10-10T14:34:41.017533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:41.017813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:41.017862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:41.018200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:41.018260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.018267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.018268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.018270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.018271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.018273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.018274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.018275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.018277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.018278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.018279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.018281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.018282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.018288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.018303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.018311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.018316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.018320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.018328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.018333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.018337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.018345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.018349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.018357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.018362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.018366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.018375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.018383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.018395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.018401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.018405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.018411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.018416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.018421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.018425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.018431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.018435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.018447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.018451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.018457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.018461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.018467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.018471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.018477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.018482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.018487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.018497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.018508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.018517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.018523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.018531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.018539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.018587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:41.021485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:41.021969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:41.021983Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:41.021985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:41.021989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:41.021997Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1419 [2:7559601492895313859:8439]
2025-10-10T14:34:41.022010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:41.022031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:41.022034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.022038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.022040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.022059Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:41.022067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:41.022075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:41.022153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.022155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.022157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.022160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:41.022244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:41.022252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.022263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.022276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.022294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:41.022318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601489382570087:2438], now have 1 active actors on pipe
2025-10-10T14:34:41.022327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677537623:8775], now have 1 active actors on pipe
2025-10-10T14:34:41.022336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601492895313854:8439]
2025-10-10T14:34:41.022338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601492895313854:8439]
2025-10-10T14:34:41.022341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601492895313854:8439]
2025-10-10T14:34:41.022355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:41.022372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:41.022395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:41.022404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:41.022431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601492895313854:8439]
2025-10-10T14:34:41.022433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:41.022463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1419
2025-10-10T14:34:41.022514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1419
2025-10-10T14:34:41.022473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:41.022482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:41.022484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:41.022491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:41.022692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.022698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.022733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef599492-71140850-c8dd2a3b-f87d2973_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:41.022750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.022754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.022757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:41.022774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.022792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:41.022812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.023292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.023300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.023317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.023424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1420 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef599492-71140850-c8dd2a3b-f87d2973_0
2025-10-10T14:34:41.023859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d658fe0d-35d806b1-1a2808bf-f98f6d3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef599492-71140850-c8dd2a3b-f87d2973_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:41.026714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef599492-71140850-c8dd2a3b-f87d2973_0] Write session: try to update token
2025-10-10T14:34:41.026735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef599492-71140850-c8dd2a3b-f87d2973_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:41.043846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:41.043868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:41.043872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:41.043874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:41.043885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601492895313854:8439]
2025-10-10T14:34:41.043889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601492895313854:8439]
2025-10-10T14:34:41.043894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601492895313854:8439]
2025-10-10T14:34:41.043946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:41.043952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:41.043958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.043960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:41.043961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:41.043965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:41.044097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:41.044845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId: src_id|ef599492-71140850-c8dd2a3b-f87d2973_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:41.047506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:41.091794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601493677537640:8672]
2025-10-10T14:34:41.092163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1419, pipe: [1:7559601493677537640:8672]
2025-10-10T14:34:41.163034Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:41.163326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.163337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.163384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677537640:8672], now have 1 active actors on pipe
2025-10-10T14:34:41.163776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601493677537640:8672]
2025-10-10T14:34:41.163813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:41.163850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:41.163859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:41.163934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1420 reason: error at write: Disconnected sessionId: src_id|ef599492-71140850-c8dd2a3b-f87d2973_0
2025-10-10T14:34:41.163639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:41.164162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1420 sessionId: src_id|ef599492-71140850-c8dd2a3b-f87d2973_0 is DEAD
2025-10-10T14:34:41.164307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef599492-71140850-c8dd2a3b-f87d2973_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:41.164315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef599492-71140850-c8dd2a3b-f87d2973_0] Write session will restart in 0.008875s
2025-10-10T14:34:41.164335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef599492-71140850-c8dd2a3b-f87d2973_0] Write session: Do CDS request
2025-10-10T14:34:41.164342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef599492-71140850-c8dd2a3b-f87d2973_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:41.174843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef599492-71140850-c8dd2a3b-f87d2973_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.174940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:41.174970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1421
2025-10-10T14:34:41.175103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.175139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:41.175150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:41.175154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:41.175627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1421 sessionId:  describe result for acl check
2025-10-10T14:34:41.175676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:41.175678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:41.175680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:41.175686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601493677537659:8779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:41.176204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601493677537659:8779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:41.181449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601493677537659:8779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:41.185559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601493677537659:8779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:41.185580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601493677537659:8779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:41.185584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601493677537659:8779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:41.185593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:41.190278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:41.193468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:41.193721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:41.193732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:41.193744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:41.193797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:41.193840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601492895314113:8441]
2025-10-10T14:34:41.194477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:41.194794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:41.194848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:41.195195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:41.195251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.195256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.195258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.195259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.195260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.195261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.195262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.195263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.195264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.195266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.195267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.195268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.195269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.195275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.195287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.195290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.195294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.195297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.195301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.195304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.195307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.195310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.195314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.195318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.195321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.195324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.195332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.195341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.195347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.195352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.195358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.195363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.195366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.195371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.195375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.195381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.195385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.195389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.195393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.195397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.195401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.195406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.195409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.195414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.195418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.195422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.195426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.195430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.195434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.195438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.195442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.195446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.195481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:41.197908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:41.198672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:41.198686Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:41.198688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:41.198693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:41.198699Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1420 [2:7559601492895314113:8441]
2025-10-10T14:34:41.198713Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:41.198731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:41.198738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.198743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.198745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.198762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:41.198774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:41.198787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:41.198854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.198862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.198864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.198867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:41.198937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:41.198946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.198958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.198970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.198992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:41.199019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677537643:2438], now have 1 active actors on pipe
2025-10-10T14:34:41.199027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677537848:8779], now have 1 active actors on pipe
2025-10-10T14:34:41.199035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601492895314108:8441]
2025-10-10T14:34:41.199042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601492895314108:8441]
2025-10-10T14:34:41.199045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601492895314108:8441]
2025-10-10T14:34:41.199059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:41.199072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:41.199080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:41.199083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:41.199086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:41.199109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:41.199116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:41.199139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601492895314108:8441]
2025-10-10T14:34:41.199146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:41.199124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1420
2025-10-10T14:34:41.199145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1420
2025-10-10T14:34:41.199169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:41.199198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.199208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.199238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:41.199250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.199259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.199262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:41.199273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.199284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:41.199305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.199467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.199475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.199490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.199580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1421 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0
2025-10-10T14:34:41.200062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef599492-71140850-c8dd2a3b-f87d2973_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:41.202914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0] Write session: try to update token
2025-10-10T14:34:41.202932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:41.211237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:41.211254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:41.211266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601492895314108:8441]
2025-10-10T14:34:41.211313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:41.211319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:41.211493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:41.211641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:41.211794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:41.211941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:41.212128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:41.212174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:41.219179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId: src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:41.222255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:41.222686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.222711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.222754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:41.223078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:41.230859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:41.230881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:41.230884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:41.230887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:41.230899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601492895314108:8441]
2025-10-10T14:34:41.230902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601492895314108:8441]
2025-10-10T14:34:41.230906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601492895314108:8441]
2025-10-10T14:34:41.230963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:41.230962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:41.230969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:41.230971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.230974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:41.230974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:41.231112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:41.263839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601493677537901:8672]
2025-10-10T14:34:41.264192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1420, pipe: [1:7559601493677537901:8672]
2025-10-10T14:34:41.350856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:41.359223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.359254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.359439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.359501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.359565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.359628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.359693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.359698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.359771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.359829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.359892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.359957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.359998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.360001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.360073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.360129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.360192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.360255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.360299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.360302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.360373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.360433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.360496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.360562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.360604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.360606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.360677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.360735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.360798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.360863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.360905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.360908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.360981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.361040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.361112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.361198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.361246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.361250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.361589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.361655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.361717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.361778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.361819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.361822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.361893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.361950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.362008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.362071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.362113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.362116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.362184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.362241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.362298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.362357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.362399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.362402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.362472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.362530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.362590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.362652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.362693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.362696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.362762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677537901:8672], now have 1 active actors on pipe
2025-10-10T14:34:41.363929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:41.365467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:41.365486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:41.365519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1421 reason: error at write: Disconnected sessionId: src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0
2025-10-10T14:34:41.365716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1421 sessionId: src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0 is DEAD
2025-10-10T14:34:41.365764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601493677537901:8672]
2025-10-10T14:34:41.365796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:41.366070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:41.366081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0] Write session will restart in 0.008484s
2025-10-10T14:34:41.366108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0] Write session: Do CDS request
2025-10-10T14:34:41.366115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:41.375881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.376291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:41.376312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1422
2025-10-10T14:34:41.376428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.376475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:41.376487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:41.376492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:41.377785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1422 sessionId:  describe result for acl check
2025-10-10T14:34:41.377825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:41.377827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:41.377829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:41.377835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601493677537932:8785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:41.378406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601493677537932:8785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:41.383943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601493677537932:8785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:41.387253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601493677537932:8785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:41.387270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601493677537932:8785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:41.387274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601493677537932:8785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:41.387283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:41.393844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:41.397737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:41.398024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:41.398039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:41.398056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:41.398126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:41.398174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601492895314368:8443]
2025-10-10T14:34:41.398847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:41.399191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:41.399257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:41.399660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:41.399729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.399731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.399732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.399733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.399735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.399737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.399738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.399739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.399741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.399742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.399743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.399745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.399746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.399753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.399768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.399772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.399776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.399781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.399785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.399789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.399793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.399797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.399802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.399806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.399810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.399814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.399823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.399831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.399839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.399845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.399849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.399855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.399860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.399864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.399868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.399874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.399878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.399883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.399888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.399894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.399899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.399904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.399910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.399915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.399919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.399925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.399929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.399934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.399939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.399944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.399949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.399954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.400009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:41.402640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:41.403214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:41.403227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:41.403230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:41.403234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:41.403241Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1421 [2:7559601492895314368:8443]
2025-10-10T14:34:41.403257Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:41.403276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:41.403280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.403284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.403286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.403304Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:41.403314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:41.403322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:41.403382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.403389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.403391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.403394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:41.403470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:41.403478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.403489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.403500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.403515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:41.403541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538086:8785], now have 1 active actors on pipe
2025-10-10T14:34:41.403550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677537907:2438], now have 1 active actors on pipe
2025-10-10T14:34:41.403557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601492895314363:8443]
2025-10-10T14:34:41.403559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601492895314363:8443]
2025-10-10T14:34:41.403561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601492895314363:8443]
2025-10-10T14:34:41.403576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:41.403595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:41.403599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:41.403611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:41.403611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:41.403613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:41.403614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:41.403656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601492895314363:8443]
2025-10-10T14:34:41.403670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:41.403677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:41.404201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1421
2025-10-10T14:34:41.404235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1421
2025-10-10T14:34:41.404356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.404372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.404411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:41.404426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.404435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.404438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:41.404463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.404481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:41.404503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.405177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.405190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.405211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.405356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1422 partition: 0 MaxSeqNo: 40 sessionId: src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0
2025-10-10T14:34:41.405932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0ac7ee-6224caf4-a28d5537-c49c5760_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:41.408924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0] Write session: try to update token
2025-10-10T14:34:41.408946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:41.417675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:41.417710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:41.417723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601492895314363:8443]
2025-10-10T14:34:41.417786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:41.417790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:41.418045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:41.418247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:41.418388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:41.418587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:41.418840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:41.418903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:41.426624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId: src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:41.429346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:41.429603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.429624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.429677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:41.429901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:41.440040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:41.440072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:41.440076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:41.440078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:41.440089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601492895314363:8443]
2025-10-10T14:34:41.440094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601492895314363:8443]
2025-10-10T14:34:41.440098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601492895314363:8443]
2025-10-10T14:34:41.440149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:41.440157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.440160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:41.440159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:41.440165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:41.440172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:41.440298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:41.466067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601493677538165:8672]
2025-10-10T14:34:41.466593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1421, pipe: [1:7559601493677538165:8672]
2025-10-10T14:34:41.557626Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:41.567770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.567798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.567993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.568063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.568132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.568202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.568256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.568260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.568332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.568401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.568469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.568544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.568589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.568594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.568665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.568763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.568846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.568912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.568978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.568982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.569080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.569140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.569202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.569265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.569308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.569311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.569437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.569532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.569601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.569673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.569724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.569733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.569805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.569871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.569937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.570003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.570044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.570053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.570122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.570187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.570256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.570323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.570369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.570376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.570449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.570513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.570576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.570641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.570690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.570697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.570819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.571043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.571135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.571206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.571278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.571286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.571366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:41.571430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:41.571498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:41.571612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:41.571695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:41.571698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:41.571768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538165:8672], now have 1 active actors on pipe
2025-10-10T14:34:41.573350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:41.573519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:41.573537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:41.573568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1422 reason: error at write: Disconnected sessionId: src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0
2025-10-10T14:34:41.573678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:41.573717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601493677538165:8672]
2025-10-10T14:34:41.573788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1422 sessionId: src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0 is DEAD
2025-10-10T14:34:41.573967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:41.573978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0] Write session will restart in 0.007953s
2025-10-10T14:34:41.574001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0] Write session: Do CDS request
2025-10-10T14:34:41.574007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:41.582958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.583122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:41.583142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1423
2025-10-10T14:34:41.583282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.583318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:41.583337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:41.583345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:41.584019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1423 sessionId:  describe result for acl check
2025-10-10T14:34:41.584060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:41.584066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:41.584068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:41.584076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601493677538204:8790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:41.584711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601493677538204:8790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:41.588393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601493677538204:8790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:41.592566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601493677538204:8790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:41.592584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601493677538204:8790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:41.592588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601493677538204:8790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:41.592597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:41.596890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:41.599831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:41.600074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:41.600089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:41.600102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:41.600169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:41.600210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601492895314636:8446]
2025-10-10T14:34:41.600807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:41.601253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:41.601308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:41.601670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:41.601750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.601759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.601760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.601761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.601762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.601763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.601765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.601766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.601767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.601768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.601770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.601771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.601773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.601779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.601792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.601796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.601800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.601804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.601807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.601811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.601815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.601819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.601825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.601828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.601831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.601835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.601844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.601852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.601858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.601864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.601868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.601874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.601878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.601883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.601888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.601894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.601898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.601903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.601908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.601913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.601917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.601921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.601928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.601934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.601939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.601944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.601949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.601953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.601957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.601962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.601967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.601972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.602010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:41.604965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:41.605487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:41.605492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:41.605495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:41.605499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:41.605505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1422 [2:7559601492895314636:8446]
2025-10-10T14:34:41.605520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:41.605539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:41.605542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.605545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.605547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.605566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:41.605574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:41.605583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:41.605645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.605648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.605650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.605652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:41.605736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:41.605749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.605761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.605771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.605787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:41.605812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538170:2438], now have 1 active actors on pipe
2025-10-10T14:34:41.605815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538349:8790], now have 1 active actors on pipe
2025-10-10T14:34:41.605823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601492895314631:8446]
2025-10-10T14:34:41.605825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601492895314631:8446]
2025-10-10T14:34:41.605827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601492895314631:8446]
2025-10-10T14:34:41.605936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1422
2025-10-10T14:34:41.605992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1422
2025-10-10T14:34:41.605841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:41.605856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:41.605859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:41.605861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:41.605863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:41.605880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:41.605883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:41.605913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601492895314631:8446]
2025-10-10T14:34:41.605920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:41.605937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:41.606150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.606164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.606214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:41.606227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.606237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.606239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:41.606253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.606286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:41.606308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.606540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.606553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.606586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.606711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1423 partition: 0 MaxSeqNo: 40 sessionId: src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0
2025-10-10T14:34:41.607137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4863142f-36cf5188-d72b07bf-8fa93f9d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:41.610031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0] Write session: try to update token
2025-10-10T14:34:41.610053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:41.628282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId: src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:41.631089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:41.629898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:41.629921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:41.629924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:41.629926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:41.629938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601492895314631:8446]
2025-10-10T14:34:41.629942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601492895314631:8446]
2025-10-10T14:34:41.629946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601492895314631:8446]
2025-10-10T14:34:41.629996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:41.630003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.630005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:41.630097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:41.630105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:41.630108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:41.630143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:41.673448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601493677538447:8672]
2025-10-10T14:34:41.673752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1422, pipe: [1:7559601493677538447:8672]
2025-10-10T14:34:41.754556Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:41.754818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.754834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.754879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538447:8672], now have 1 active actors on pipe
2025-10-10T14:34:41.755064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:41.755161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:41.755260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:41.755267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1423 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0
2025-10-10T14:34:41.755313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601493677538447:8672]
2025-10-10T14:34:41.755501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1423 sessionId: src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0 is DEAD
2025-10-10T14:34:41.755680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:41.755688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0] Write session will restart in 0.005985s
2025-10-10T14:34:41.755716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0] Write session: Do CDS request
2025-10-10T14:34:41.755722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:41.762928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.763036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:41.763057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1424
2025-10-10T14:34:41.763218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.763271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:41.763282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:41.763287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:41.763784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1424 sessionId:  describe result for acl check
2025-10-10T14:34:41.763828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:41.763830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:41.763832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:41.763838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601493677538467:8795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:41.764378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601493677538467:8795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:41.767603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601493677538467:8795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:41.772566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601493677538467:8795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:41.772584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601493677538467:8795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:41.772587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601493677538467:8795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:41.772596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:41.781238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:41.784512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:41.784761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:41.784775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:41.784803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:41.784874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:41.784927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601492895314895:8449]
2025-10-10T14:34:41.785546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:41.786135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:41.786213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:41.786599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:41.786702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.786709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.786710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.786712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.786713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.786715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.786716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.786717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.786719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.786720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.786721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.786722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.786724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.786731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.786745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.786750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.786754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.786758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.786762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.786766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.786770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.786773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.786777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.786780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.786784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.786787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.786799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.786807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.786814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.786819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.786823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.786849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.786853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.786858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.786862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.786867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.786871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.786876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.786880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.786885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.786889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.786894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.786899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.786904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.786908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.786923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.786933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.786937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.786942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.786950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.786954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.786959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.787012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:41.789728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:41.790499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1423
2025-10-10T14:34:41.790499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1423
2025-10-10T14:34:41.790066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:41.790072Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:41.790075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:41.790080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:41.790086Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1423 [2:7559601492895314895:8449]
2025-10-10T14:34:41.790100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:41.790120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:41.790124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.790127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.790130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.790147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:41.790154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:41.790163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:41.790224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.790227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.790229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.790231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:41.790310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:41.790312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.790322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.790332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.790346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:41.790368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538574:8795], now have 1 active actors on pipe
2025-10-10T14:34:41.790371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538452:2438], now have 1 active actors on pipe
2025-10-10T14:34:41.790379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601492895314890:8449]
2025-10-10T14:34:41.790381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601492895314890:8449]
2025-10-10T14:34:41.790383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601492895314890:8449]
2025-10-10T14:34:41.790401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:41.790416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:41.790419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:41.790422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:41.790424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:41.790431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:41.790435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:41.790461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601492895314890:8449]
2025-10-10T14:34:41.790472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:41.790507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:41.790778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.790791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.790825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:41.790838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.790848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.790850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:41.790863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.790878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:41.790897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.791078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.791086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.791102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.791191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1424 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0
2025-10-10T14:34:41.791657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19de6e93-62dd5af5-550a1963-3be68bb3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:41.794675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0] Write session: try to update token
2025-10-10T14:34:41.794694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:41.811335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:41.811361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:41.811364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:41.811366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:41.811377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601492895314890:8449]
2025-10-10T14:34:41.811381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601492895314890:8449]
2025-10-10T14:34:41.811386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601492895314890:8449]
2025-10-10T14:34:41.811436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:41.811438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:41.811446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.811450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:41.811451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:41.811453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:41.811590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:41.811754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId: src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:41.814659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:41.855678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601493677538713:8672]
2025-10-10T14:34:41.856072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1423, pipe: [1:7559601493677538713:8672]
2025-10-10T14:34:41.931758Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:41.932190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.932208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.932256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538713:8672], now have 1 active actors on pipe
2025-10-10T14:34:41.932628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601493677538713:8672]
2025-10-10T14:34:41.932646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:41.932650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:41.932673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:41.932682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:41.932728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1424 reason: error at write: Disconnected sessionId: src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0
2025-10-10T14:34:41.932986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1424 sessionId: src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0 is DEAD
2025-10-10T14:34:41.933152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:41.933169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0] Write session will restart in 0.006931s
2025-10-10T14:34:41.933196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0] Write session: Do CDS request
2025-10-10T14:34:41.933203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:41.945190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.945202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:41.945223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1425
2025-10-10T14:34:41.946007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:41.946062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:41.946068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:41.946073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:41.946583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1425 sessionId:  describe result for acl check
2025-10-10T14:34:41.946628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:41.946634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:41.946636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:41.946644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601493677538810:8808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:41.947273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601493677538810:8808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:41.952671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601493677538810:8808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:41.957886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:41.957956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601493677538810:8808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:41.957973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601493677538810:8808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:41.957977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601493677538810:8808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:41.957987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:41.961639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:41.962006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:41.962012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:41.962026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:41.962095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:41.962137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601492895315191:8464]
2025-10-10T14:34:41.962754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:41.963121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:41.963173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:41.963501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:41.963564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.963570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.963572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.963572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.963574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.963575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.963576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.963577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.963579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.963580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.963582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.963583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.963584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.963590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.963604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.963608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.963612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.963616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.963630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.963633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.963638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.963641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.963645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.963648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.963652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.963656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.963665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.963674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:41.963681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.963687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:41.963691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.963697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:41.963701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.963705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:41.963710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.963714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:41.963719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.963724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:41.963729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.963734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:41.963739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.963744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:41.963749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.963755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:41.963759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.963765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:41.963769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.963774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.963778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.963782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.963787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.963881Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:34:41.963792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.963841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:41.966544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:41.966911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:41.966925Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:41.966928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:41.966933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:41.966940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1424 [2:7559601492895315191:8464]
2025-10-10T14:34:41.966956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:41.966976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:41.966980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.966985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.966988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.967007Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:41.967031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:41.967044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:41.967122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.967132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.967134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.967137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:41.967357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1424
2025-10-10T14:34:41.967393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1424
2025-10-10T14:34:41.967211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:41.967222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.967233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:41.967245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:41.967262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:41.967286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538741:2438], now have 1 active actors on pipe
2025-10-10T14:34:41.967291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601493677538987:8808], now have 1 active actors on pipe
2025-10-10T14:34:41.967298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601492895315185:8464]
2025-10-10T14:34:41.967301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601492895315185:8464]
2025-10-10T14:34:41.967304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601492895315185:8464]
2025-10-10T14:34:41.967317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:41.967330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:41.967333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:41.967334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:41.967336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:41.967350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:41.967353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:41.967389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601492895315185:8464]
2025-10-10T14:34:41.967393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:41.967394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:41.967588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.967599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.967643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:41.967652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:41.967657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:41.967660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:41.967673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:41.967687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:41.967702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.967947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:41.967961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:41.967985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:41.968073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1425 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0
2025-10-10T14:34:41.968553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0c6833-272dc59b-1c9431ff-434e2f7c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:41.971355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0] Write session: try to update token
2025-10-10T14:34:41.971378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:41.986568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId: src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:41.989161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:41.989192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:41.989196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:41.989197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:41.989208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601492895315185:8464]
2025-10-10T14:34:41.989214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601492895315185:8464]
2025-10-10T14:34:41.989219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601492895315185:8464]
2025-10-10T14:34:41.989281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:41.989288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:41.989288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:41.989293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:41.989301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:41.989304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:41.989714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:41.990132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:42.032838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601497972506296:8672]
2025-10-10T14:34:42.033211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1424, pipe: [1:7559601497972506296:8672]
2025-10-10T14:34:42.103981Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:42.104577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.104589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.104640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506296:8672], now have 1 active actors on pipe
2025-10-10T14:34:42.105046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601497972506296:8672]
2025-10-10T14:34:42.105084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:42.105121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:42.105124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:42.105181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1425 reason: error at write: Disconnected sessionId: src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0
2025-10-10T14:34:42.105434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1425 sessionId: src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0 is DEAD
2025-10-10T14:34:42.105740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:42.105715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:42.105751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0] Write session will restart in 0.009335s
2025-10-10T14:34:42.105784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0] Write session: Do CDS request
2025-10-10T14:34:42.105794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:42.116003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.116112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:42.116128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1426
2025-10-10T14:34:42.116251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.116291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:42.116302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:42.116307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:42.116828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1426 sessionId:  describe result for acl check
2025-10-10T14:34:42.116876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:42.116878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:42.116881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:42.116888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601497972506314:8812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:42.117546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601497972506314:8812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:42.123937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601497972506314:8812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:42.130844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601497972506314:8812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:42.130863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601497972506314:8812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:42.130868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601497972506314:8812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:42.130877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:42.132719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:42.136281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:42.136567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:42.136578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:42.136593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:42.136659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:42.136709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601497190282747:8466]
2025-10-10T14:34:42.137318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:42.137750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:42.137809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:42.138194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:42.138264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.138265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.138266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.138267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.138269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.138270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.138271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.138273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.138274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.138276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.138277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.138278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.138279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.138286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.138300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.138303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.138307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.138310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.138313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.138317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.138320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.138323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.138328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.138331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.138335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.138338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.138346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.138356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.138362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.138368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.138372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.138376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.138380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.138385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.138389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.138394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.138397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.138402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.138405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.138411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.138415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.138419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.138424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.138429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.138432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.138437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.138441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.138445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.138449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.138454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.138458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.138462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.138498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:42.141308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:42.141672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:42.141694Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:42.141696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:42.141701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:42.141708Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1425 [2:7559601497190282747:8466]
2025-10-10T14:34:42.141723Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:42.141745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:42.141749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.141753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.141755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.141786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:42.141795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:42.141804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:42.141874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.141881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.141883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.141886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:42.141968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:42.141970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.141982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.141996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.142014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:42.142037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506546:8812], now have 1 active actors on pipe
2025-10-10T14:34:42.142041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506298:2438], now have 1 active actors on pipe
2025-10-10T14:34:42.142049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601497190282741:8466]
2025-10-10T14:34:42.142051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601497190282741:8466]
2025-10-10T14:34:42.142053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601497190282741:8466]
2025-10-10T14:34:42.142068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:42.142083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:42.142084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:42.142087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:42.142089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:42.142101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:42.142106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:42.142142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601497190282741:8466]
2025-10-10T14:34:42.142150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:42.142183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:42.145431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1425
2025-10-10T14:34:42.145441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1425
2025-10-10T14:34:42.146172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1426 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0
2025-10-10T14:34:42.146650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7e691aa-8e28096c-c631b194-aef9ed0c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:42.145617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.145637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.145680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:42.145694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.145700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.145703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:42.145719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.145743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:42.145764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.146038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.146046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.146082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.149754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0] Write session: try to update token
2025-10-10T14:34:42.149775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:42.165238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:42.165263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:42.165266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:42.165268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:42.165280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601497190282741:8466]
2025-10-10T14:34:42.165285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601497190282741:8466]
2025-10-10T14:34:42.165290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601497190282741:8466]
2025-10-10T14:34:42.165367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:42.165375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.165378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:42.165531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:42.166286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:42.166293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:42.166299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:42.175660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId: src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:42.178516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:42.205392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601497972506561:8672]
2025-10-10T14:34:42.205676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1425, pipe: [1:7559601497972506561:8672]
2025-10-10T14:34:42.299867Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:42.300696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.300718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.300744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506561:8672], now have 1 active actors on pipe
2025-10-10T14:34:42.301105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:42.301191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1426 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0
2025-10-10T14:34:42.301397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601497972506561:8672]
2025-10-10T14:34:42.301415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:42.301631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1426 sessionId: src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0 is DEAD
2025-10-10T14:34:42.301002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:42.305425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:42.305438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0] Write session will restart in 0.005999s
2025-10-10T14:34:42.305465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0] Write session: Do CDS request
2025-10-10T14:34:42.305471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:42.312990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.313023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:42.313039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1427
2025-10-10T14:34:42.313252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.313288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:42.313294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:42.313298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:42.314113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1427 sessionId:  describe result for acl check
2025-10-10T14:34:42.314163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:42.314166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:42.314168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:42.314175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601497972506597:8816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:42.314784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601497972506597:8816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:42.316990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601497972506597:8816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:42.321839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601497972506597:8816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:42.321857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601497972506597:8816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:42.321861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601497972506597:8816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:42.321872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:42.329184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:42.332901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:42.333222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:42.333237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:42.333252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:42.333320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:42.333418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601497190283007:8468]
2025-10-10T14:34:42.334161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:42.335150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:42.335214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:42.335628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:42.335714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.335716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.335718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.335719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.335721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.335724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.335725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.335727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.335729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.335731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.335733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.335735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.335736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.335744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.335759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.335764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.335769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.335774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.335778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.335784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.335787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.335791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.335796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.335799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.335803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.335807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.335816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.335824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.335832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.335837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.335843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.335848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.335854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.335861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.335867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.335873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.335879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.335884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.335890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.335896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.335902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.335908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.335915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.335921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.335926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.335932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.335939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.335945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.335950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.335955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.335961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.335971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.336021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:42.339575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:42.340507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:42.340513Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:42.340516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:42.340520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:42.340530Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1426 [2:7559601497190283007:8468]
2025-10-10T14:34:42.340546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:42.340567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:42.340570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.341450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1426
2025-10-10T14:34:42.340574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.341449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1426
2025-10-10T14:34:42.340577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.340594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:42.340602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:42.340611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:42.340690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.340693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.340695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.340697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:42.340798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:42.340802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.340815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.340827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.340844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:42.340864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601497190283002:8468]
2025-10-10T14:34:42.340867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601497190283002:8468]
2025-10-10T14:34:42.340870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601497190283002:8468]
2025-10-10T14:34:42.340885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:42.340899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:42.340916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:42.340920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:42.340950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601497190283002:8468]
2025-10-10T14:34:42.340952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:42.341149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:42.341152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:42.341155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:42.341160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:42.341534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506711:8816], now have 1 active actors on pipe
2025-10-10T14:34:42.341540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506563:2438], now have 1 active actors on pipe
2025-10-10T14:34:42.341744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.341771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.341805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c1d5025-d987b5d7-c571d218-96704da0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:42.341825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.341830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.341834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:42.341845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.341857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:42.341875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.342179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.342191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.342207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.342322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1427 partition: 0 MaxSeqNo: 40 sessionId: src_id|5c1d5025-d987b5d7-c571d218-96704da0_0
2025-10-10T14:34:42.342752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d89fe78-7a5f8d7b-273c642f-147fb4d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5c1d5025-d987b5d7-c571d218-96704da0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:42.345543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1d5025-d987b5d7-c571d218-96704da0_0] Write session: try to update token
2025-10-10T14:34:42.345563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1d5025-d987b5d7-c571d218-96704da0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:42.363062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId: src_id|5c1d5025-d987b5d7-c571d218-96704da0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:42.361782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:42.361812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:42.361817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:42.361819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:42.361833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601497190283002:8468]
2025-10-10T14:34:42.361839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601497190283002:8468]
2025-10-10T14:34:42.361846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601497190283002:8468]
2025-10-10T14:34:42.361904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:42.361913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.361916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:42.362107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:42.364284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:42.364294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:42.364301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:42.365937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:42.401519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601497972506827:8672]
2025-10-10T14:34:42.401919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1426, pipe: [1:7559601497972506827:8672]
2025-10-10T14:34:42.504169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:42.504954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.504978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.505024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506827:8672], now have 1 active actors on pipe
2025-10-10T14:34:42.505444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:42.505504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:42.505508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:42.505518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601497972506827:8672]
2025-10-10T14:34:42.505593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1427 reason: error at write: Disconnected sessionId: src_id|5c1d5025-d987b5d7-c571d218-96704da0_0
2025-10-10T14:34:42.505825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1427 sessionId: src_id|5c1d5025-d987b5d7-c571d218-96704da0_0 is DEAD
2025-10-10T14:34:42.505965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1d5025-d987b5d7-c571d218-96704da0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:42.505977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1d5025-d987b5d7-c571d218-96704da0_0] Write session will restart in 0.008212s
2025-10-10T14:34:42.506005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1d5025-d987b5d7-c571d218-96704da0_0] Write session: Do CDS request
2025-10-10T14:34:42.506011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1d5025-d987b5d7-c571d218-96704da0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:42.505489Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:42.515948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1d5025-d987b5d7-c571d218-96704da0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.516305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:42.516322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1428
2025-10-10T14:34:42.516565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.516610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:42.516621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:42.516626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:42.517407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1428 sessionId:  describe result for acl check
2025-10-10T14:34:42.517446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:42.517447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:42.517449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:42.517456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601497972506855:8820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:42.518046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601497972506855:8820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:42.522224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601497972506855:8820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:42.528336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601497972506855:8820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:42.528355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601497972506855:8820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:42.528359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601497972506855:8820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:42.528371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:42.539421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:42.542709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:42.543016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:42.543022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:42.543036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:42.543099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:42.543145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601497190283269:8470]
2025-10-10T14:34:42.543783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:42.544134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:42.544189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:42.544523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:42.544599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.544600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.544602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.544603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.544604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.544623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.544624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.544626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.544627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.544628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.544629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.544630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.544632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.544640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.544653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.544657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.544661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.544665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.544669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.544673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.544676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.544680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.544684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.544688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.544692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.544695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.544705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.544714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.544722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.544727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.544732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.544738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.544742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.544747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.544752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.544757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.544762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.544769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.544774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.544779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.544784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.544788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.544793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.544798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.544804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.544809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.544814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.544820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.544824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.544830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.544834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.544838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.544877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:42.547636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:42.548010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:42.548027Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:42.548030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:42.548034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:42.548042Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1427 [2:7559601497190283269:8470]
2025-10-10T14:34:42.548058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:42.548080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:42.548083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.548088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.548091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.548108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:42.548117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:42.548132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:42.548202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.548210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.548213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.548216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:42.548293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:42.548299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.548313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.548341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.548369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:42.548401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506830:2438], now have 1 active actors on pipe
2025-10-10T14:34:42.548405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972506967:8820], now have 1 active actors on pipe
2025-10-10T14:34:42.548413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601497190283264:8470]
2025-10-10T14:34:42.548416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601497190283264:8470]
2025-10-10T14:34:42.548418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601497190283264:8470]
2025-10-10T14:34:42.548434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:42.548433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1427
2025-10-10T14:34:42.548449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:42.548450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1427
2025-10-10T14:34:42.548473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:42.548476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:42.548501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:42.548504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:42.548506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:42.548507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601497190283264:8470]
2025-10-10T14:34:42.548510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:42.548521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:42.548550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.548564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.548597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:42.548610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.548614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.548622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:42.548634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.548650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:42.548667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.549134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.549154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.549186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.549290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1428 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0
2025-10-10T14:34:42.549765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1d5025-d987b5d7-c571d218-96704da0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:42.552751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0] Write session: try to update token
2025-10-10T14:34:42.552773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:42.570201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId: src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:42.570698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:42.570723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:42.570729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:42.570731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:42.570742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601497190283264:8470]
2025-10-10T14:34:42.570748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601497190283264:8470]
2025-10-10T14:34:42.570753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601497190283264:8470]
2025-10-10T14:34:42.570817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:42.570834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.570843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:42.570881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:42.570898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:42.570903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:42.571060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:42.573669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:42.605797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601497972507106:8672]
2025-10-10T14:34:42.606123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1427, pipe: [1:7559601497972507106:8672]
2025-10-10T14:34:42.689529Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:42.690375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.690398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.690450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972507106:8672], now have 1 active actors on pipe
2025-10-10T14:34:42.690751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:42.690798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:42.690801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:42.690831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601497972507106:8672]
2025-10-10T14:34:42.690873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1428 reason: error at write: Disconnected sessionId: src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0
2025-10-10T14:34:42.691092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1428 sessionId: src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0 is DEAD
2025-10-10T14:34:42.691460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:42.691472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0] Write session will restart in 0.006078s
2025-10-10T14:34:42.691508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0] Write session: Do CDS request
2025-10-10T14:34:42.691514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:42.691458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:42.699053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.699144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:42.699159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1429
2025-10-10T14:34:42.699309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.699345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:42.699351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:42.699356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:42.699858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1429 sessionId:  describe result for acl check
2025-10-10T14:34:42.699895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:42.699902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:42.699915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:42.699926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601497972507132:8826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:42.700504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601497972507132:8826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:42.703097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601497972507132:8826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:42.708771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601497972507132:8826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:42.708792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601497972507132:8826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:42.708796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601497972507132:8826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:42.708806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:42.714395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:42.718330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:42.718609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:42.718625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:42.718638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:42.718707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:42.718756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601497190283543:8473]
2025-10-10T14:34:42.719464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:42.719837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:42.719880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:42.720219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:42.720276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.720282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.720284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.720286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.720287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.720289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.720290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.720292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.720294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.720295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.720296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.720298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.720299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.720305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.720319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.720323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.720327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.720332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.720337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.720341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.720345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.720349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.720354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.720358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.720362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.720366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.720374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.720383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.720395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.720401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.720406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.720411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.720416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.720422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.720427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.720432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.720441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.720447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.720452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.720461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.720466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.720472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.720477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.720486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.720493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.720502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.720507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.720512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.720522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.720528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.720532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.720537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.720578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:42.723887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:42.724731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:42.724747Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:42.724749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:42.724753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:42.724761Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1428 [2:7559601497190283543:8473]
2025-10-10T14:34:42.724777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:42.724797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:42.724804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.724807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.724810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.724829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:42.724838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:42.724845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:42.724917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.724926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.724928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.724930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:42.725007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:42.725017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.725030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.725041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.725060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:42.725082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601497190283538:8473]
2025-10-10T14:34:42.725090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601497190283538:8473]
2025-10-10T14:34:42.725094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601497190283538:8473]
2025-10-10T14:34:42.725105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:42.725114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:42.725118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:42.725120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:42.725121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:42.725137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:42.725140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:42.725152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972507282:8826], now have 1 active actors on pipe
2025-10-10T14:34:42.725156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972507117:2438], now have 1 active actors on pipe
2025-10-10T14:34:42.725192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601497190283538:8473]
2025-10-10T14:34:42.725206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:42.725230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:42.725392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1428
2025-10-10T14:34:42.725392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1428
2025-10-10T14:34:42.725464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.725480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.725519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:42.725537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.725542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.725544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:42.725558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.725571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:42.725596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.725788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.725796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.725810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.725910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1429 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0
2025-10-10T14:34:42.726341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b749d2-b4dc1f4a-2b7049d5-b64b039b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:42.729283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0] Write session: try to update token
2025-10-10T14:34:42.729303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:42.744836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId: src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:42.745730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:42.745751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:42.745755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:42.745757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:42.745767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601497190283538:8473]
2025-10-10T14:34:42.745771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601497190283538:8473]
2025-10-10T14:34:42.745776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601497190283538:8473]
2025-10-10T14:34:42.745828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:42.745837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.745836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:42.745840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:42.745843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:42.745848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:42.745982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:42.747812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:42.790619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601497972507382:8672]
2025-10-10T14:34:42.790957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1428, pipe: [1:7559601497972507382:8672]
2025-10-10T14:34:42.861490Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:42.861746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.861768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.861814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972507382:8672], now have 1 active actors on pipe
2025-10-10T14:34:42.862096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601497972507382:8672]
2025-10-10T14:34:42.862131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:42.862213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1429 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0
2025-10-10T14:34:42.862038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:42.862481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1429 sessionId: src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0 is DEAD
2025-10-10T14:34:42.862555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:42.862653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:42.862672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0] Write session will restart in 0.007109s
2025-10-10T14:34:42.862700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0] Write session: Do CDS request
2025-10-10T14:34:42.862706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:42.870996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.871056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:42.871074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1430
2025-10-10T14:34:42.871225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:42.871262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:42.871272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:42.871278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:42.871761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1430 sessionId:  describe result for acl check
2025-10-10T14:34:42.871800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:42.871807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:42.871809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:42.871815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601497972507392:8830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:42.872444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601497972507392:8830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:42.875278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601497972507392:8830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:42.878923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601497972507392:8830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:42.878940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601497972507392:8830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:42.878945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601497972507392:8830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:42.878954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:42.894692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:42.898573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:42.898887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:42.898908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:42.898925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:42.899011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:42.899063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601497190283821:8482]
2025-10-10T14:34:42.899853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:42.900367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:42.900434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:42.900780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:42.900862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.900869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.900870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.900871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.900873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.900874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.900875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.900877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.900878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.900879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.900881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.900882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.900883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.900890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.900903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.900907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.900911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.900914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.900918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.900922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.900926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.900930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.900934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.900938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.900941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.900945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.900954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.900963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:42.900969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.900975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:42.900981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.900985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:42.900989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.900994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:42.900998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.901003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:42.901007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.901012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:42.901017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.901021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:42.901036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.901041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:42.901048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.901053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:42.901057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.901062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:42.901066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.901071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.901075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.901080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.901084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.901089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.901127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:42.906632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:42.907313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:42.907326Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:42.907327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:42.907331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:42.907338Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1429 [2:7559601497190283821:8482]
2025-10-10T14:34:42.907354Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:42.907380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:42.907383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.907386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.907387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.907404Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:42.907419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:42.907429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:42.907499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.907507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.907509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.907511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:42.907579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:42.907587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.907612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:42.907626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:42.907647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:42.907676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601497190283816:8482]
2025-10-10T14:34:42.907685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601497190283816:8482]
2025-10-10T14:34:42.907687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601497190283816:8482]
2025-10-10T14:34:42.907703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:42.907719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:42.907727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972507429:8830], now have 1 active actors on pipe
2025-10-10T14:34:42.907729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:42.907731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:42.907734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:42.907750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:42.907758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:42.907765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972507384:2438], now have 1 active actors on pipe
2025-10-10T14:34:42.907799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601497190283816:8482]
2025-10-10T14:34:42.907808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:42.907821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1429
2025-10-10T14:34:42.907859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1429
2025-10-10T14:34:42.907828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:42.907942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.907952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.907991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:42.908010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:42.908017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:42.908020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:42.908033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:42.908046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:42.908077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.908285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:42.908296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:42.908311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:42.908419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1430 partition: 0 MaxSeqNo: 40 sessionId: src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0
2025-10-10T14:34:42.908881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c25488-914af0c4-98b3d00a-4a0972df_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:42.912007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0] Write session: try to update token
2025-10-10T14:34:42.912032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:42.931849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:42.931873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:42.931878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:42.931880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:42.931889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601497190283816:8482]
2025-10-10T14:34:42.931894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601497190283816:8482]
2025-10-10T14:34:42.931897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601497190283816:8482]
2025-10-10T14:34:42.931949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:42.931958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:42.931960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:42.932113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:42.932849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:42.932864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:42.932869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:42.930084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId: src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:42.932766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:42.962211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601497972507669:8672]
2025-10-10T14:34:42.962969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1429, pipe: [1:7559601497972507669:8672]
2025-10-10T14:34:43.048935Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:43.049861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.049880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.049926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601497972507669:8672], now have 1 active actors on pipe
2025-10-10T14:34:43.053628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:43.053630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:43.053635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:43.053689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601497972507669:8672]
2025-10-10T14:34:43.053696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1430 reason: error at write: Disconnected sessionId: src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0
2025-10-10T14:34:43.053878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1430 sessionId: src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0 is DEAD
2025-10-10T14:34:43.053572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:43.054256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:43.054266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0] Write session will restart in 0.006108s
2025-10-10T14:34:43.054290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0] Write session: Do CDS request
2025-10-10T14:34:43.054299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:43.061966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.062082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:43.062102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1431
2025-10-10T14:34:43.062236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.062285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:43.062297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:43.062301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:43.062852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1431 sessionId:  describe result for acl check
2025-10-10T14:34:43.062901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:43.062908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:43.062911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:43.062918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601502267474983:8843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:43.063630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601502267474983:8843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:43.067413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601502267474983:8843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:43.072610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601502267474983:8843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:43.072626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601502267474983:8843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:43.072629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601502267474983:8843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:43.072636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:43.082919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:43.086303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:43.086587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:43.086620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:43.086635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:43.086703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:43.086752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601501485251406:8491]
2025-10-10T14:34:43.087409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:43.087759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:43.087828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:43.088190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:43.088256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.088266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.088267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.088269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.088270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.088271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.088273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.088274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.088275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.088277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.088278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.088279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.088280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.088287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.088300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.088305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.088308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.088312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.088316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.088319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.088323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.088327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.088331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.088335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.088338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.088342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.088363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.088373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.088379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.088385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.088389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.088394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.088398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.088403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.088407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.088412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.088416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.088420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.088425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.088430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.088434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.088439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.088443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.088448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.088454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.088459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.088464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.088469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.088474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.088479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.088483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.088489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.088527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:43.093483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:43.094018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:43.094034Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:43.094037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:43.094042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:43.094049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1430 [2:7559601501485251406:8491]
2025-10-10T14:34:43.094067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:43.094089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:43.094097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.094101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.094103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.094123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:43.094137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:43.094150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:43.094225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.094231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.094233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.094237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:43.094318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:43.094325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.094337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.094348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.094364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:43.094391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475079:8843], now have 1 active actors on pipe
2025-10-10T14:34:43.094399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267474975:2438], now have 1 active actors on pipe
2025-10-10T14:34:43.094407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601501485251401:8491]
2025-10-10T14:34:43.094409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601501485251401:8491]
2025-10-10T14:34:43.094412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601501485251401:8491]
2025-10-10T14:34:43.094428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:43.094451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:43.094452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:43.094456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:43.094458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:43.094471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:43.094475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:43.094524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601501485251401:8491]
2025-10-10T14:34:43.094535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:43.094542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:43.094712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1430
2025-10-10T14:34:43.094745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1430
2025-10-10T14:34:43.094989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.095003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.095039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:43.095053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.095062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.095065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:43.095079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.095097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:43.095121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.095290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.095297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.095313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.095437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1431 partition: 0 MaxSeqNo: 40 sessionId: src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0
2025-10-10T14:34:43.095898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fb223d3-baae5a5b-b740c38-cbad1417_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:43.098830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0] Write session: try to update token
2025-10-10T14:34:43.098854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:43.109348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:43.109371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:43.109383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601501485251401:8491]
2025-10-10T14:34:43.109440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:43.109455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:43.109620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:43.109767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:43.109902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:43.110061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:43.110277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:43.110320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:43.116308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId: src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:43.119004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:43.119667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.119692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.119750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:43.119856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:43.128044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:43.128067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:43.128071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:43.128074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:43.128087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601501485251401:8491]
2025-10-10T14:34:43.128102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601501485251401:8491]
2025-10-10T14:34:43.128107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601501485251401:8491]
2025-10-10T14:34:43.128150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:43.128155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:43.128160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:43.128163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.128164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:43.128165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:43.128291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:43.157411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601502267475242:8672]
2025-10-10T14:34:43.157712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1430, pipe: [1:7559601502267475242:8672]
2025-10-10T14:34:43.241101Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:43.249925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.249956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.250138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.250207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.250280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.250350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.250400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.250411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.250482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.250546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.250605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.250676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.250724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.250732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.250804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.250873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.250941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.251012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.251063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.251071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.251141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.251208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.251277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.251343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.251390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.251398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.251467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.251532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.251611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.251675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.251725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.251732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.251800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.251867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.251937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.252005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.252052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.252058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.252126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.252186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.252252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.252317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.252364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.252372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.252440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.252500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.252568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.252636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.252682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.252689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.252756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.252815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.252878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.252943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.252988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.252995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.253066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.253127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.253189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.253253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.253362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.253373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.253441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475242:8672], now have 1 active actors on pipe
2025-10-10T14:34:43.254753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601502267475242:8672]
2025-10-10T14:34:43.254785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:43.254798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:43.254802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:43.254834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1431 reason: error at write: Disconnected sessionId: src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0
2025-10-10T14:34:43.254832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:43.257783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:43.257796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0] Write session will restart in 0.005979s
2025-10-10T14:34:43.257825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0] Write session: Do CDS request
2025-10-10T14:34:43.257833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:43.255037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1431 sessionId: src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0 is DEAD
2025-10-10T14:34:43.264941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.267880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:43.267908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1432
2025-10-10T14:34:43.268353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.268415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:43.268427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:43.268432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:43.268966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1432 sessionId:  describe result for acl check
2025-10-10T14:34:43.269015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:43.269018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:43.269019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:43.269026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601502267475261:8847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:43.269640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601502267475261:8847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:43.274119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601502267475261:8847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:43.277489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601502267475261:8847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:43.277504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601502267475261:8847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:43.277507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601502267475261:8847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:43.277517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:43.288807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:43.295133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:43.295410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:43.295429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:43.295444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:43.295524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:43.295573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601501485251671:8493]
2025-10-10T14:34:43.296178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:43.297122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:43.297179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:43.297587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:43.297675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.297683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.297685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.297686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.297687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.297689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.297690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.297691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.297692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.297694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.297695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.297696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.297697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.297704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.297718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.297721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.297726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.297730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.297734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.297738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.297742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.297746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.297751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.297754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.297759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.297763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.297771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.297781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.297788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.297793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.297798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.297803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.297807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.297812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.297818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.297823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.297828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.297833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.297838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.297843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.297847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.297851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.297856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.297860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.297864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.297870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.297877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.297892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.297896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.297901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.297905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.297910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.297947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:43.300657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:43.301187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:43.301202Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:43.301206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:43.301210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:43.301217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1431 [2:7559601501485251671:8493]
2025-10-10T14:34:43.301233Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:43.301257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:43.301265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.301269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.301271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.301290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:43.301303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:43.301313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:43.301403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.301412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.301414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.301417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:43.301496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:43.301507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.301521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.301534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.301553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:43.301583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475245:2438], now have 1 active actors on pipe
2025-10-10T14:34:43.301591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475348:8847], now have 1 active actors on pipe
2025-10-10T14:34:43.301600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601501485251666:8493]
2025-10-10T14:34:43.301603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601501485251666:8493]
2025-10-10T14:34:43.301605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601501485251666:8493]
2025-10-10T14:34:43.301620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:43.301638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:43.301639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:43.301707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1431
2025-10-10T14:34:43.301643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:43.301761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1431
2025-10-10T14:34:43.301645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:43.301661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:43.301666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:43.301695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601501485251666:8493]
2025-10-10T14:34:43.301706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:43.301724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:43.301836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.301842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.301873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:43.301888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.301897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.301900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:43.301913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.301926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:43.301948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.302157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.302166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.302182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.302349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1432 partition: 0 MaxSeqNo: 40 sessionId: src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0
2025-10-10T14:34:43.302901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2c9dbd6-958f5bf0-f576ea74-42a624f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:43.306584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0] Write session: try to update token
2025-10-10T14:34:43.306613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:43.325821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId: src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:43.328627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:43.328871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:43.328894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:43.328906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601501485251666:8493]
2025-10-10T14:34:43.328948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:43.328962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.328973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.329012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:43.329233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:43.329411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:43.329564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:43.329743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:43.330132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:43.330198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:43.330327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:43.330488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:43.337368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:43.337388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:43.337392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:43.337394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:43.337407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601501485251666:8493]
2025-10-10T14:34:43.337411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601501485251666:8493]
2025-10-10T14:34:43.337419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601501485251666:8493]
2025-10-10T14:34:43.337472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:43.337474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:43.337483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:43.337488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:43.337488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.337491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:43.337632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:43.354828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601502267475514:8672]
2025-10-10T14:34:43.355109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1431, pipe: [1:7559601502267475514:8672]
2025-10-10T14:34:43.455479Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:43.463846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.463878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.464058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.464122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.464188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.464254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.464300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.464315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.464382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.464446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.464512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.464575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.464622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.464626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.464695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.464758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.464824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.464888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.464932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.464943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.465008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.465073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.465133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.465197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.465242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.465249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.465316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.465393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.465456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.465524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.465570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.465577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.465643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.465703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.465767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.465828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.465874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.465882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.465945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.466006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.466072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.466135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.466179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.466187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.466255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.466315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.466382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.466447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.466491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.466499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.466562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.466623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.466682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.466742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.467397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:43.467409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:43.467413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:43.467447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1432 reason: error at write: Disconnected sessionId: src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0
2025-10-10T14:34:43.467477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601502267475514:8672]
2025-10-10T14:34:43.467682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1432 sessionId: src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0 is DEAD
2025-10-10T14:34:43.466790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.466801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.466866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:43.466921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:43.466977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:43.467037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:43.467077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:43.467080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:43.467149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475514:8672], now have 1 active actors on pipe
2025-10-10T14:34:43.467833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:43.467844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0] Write session will restart in 0.009313s
2025-10-10T14:34:43.467868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0] Write session: Do CDS request
2025-10-10T14:34:43.467874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:43.468587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:43.479060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.479340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:43.479366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1433
2025-10-10T14:34:43.479755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.479790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:43.479796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:43.479801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:43.480235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1433 sessionId:  describe result for acl check
2025-10-10T14:34:43.480273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:43.480276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:43.480278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:43.480284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601502267475557:8851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:43.480971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601502267475557:8851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:43.484832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601502267475557:8851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:43.489496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601502267475557:8851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:43.489514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601502267475557:8851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:43.489518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601502267475557:8851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:43.489528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:43.491437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:43.492272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:43.492457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:43.492461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:43.492473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:43.492520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:43.492560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601501485251938:8495]
2025-10-10T14:34:43.493182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:43.494884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:43.494966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:43.495422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:43.495491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.495498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.495499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.495500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.495501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.495503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.495504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.495506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.495507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.495508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.495510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.495511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.495512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.495519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.495532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.495535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.495539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.495543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.495547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.495550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.495554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.495558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.495562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.495566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.495571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.495584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.495602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.495611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.495617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.495623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.495627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.495633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.495644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.495650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.495654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.495659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.495668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.495673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.495677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.495682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.495691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.495696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.495700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.495705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.495710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.495720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.495725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.495730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.495734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.495739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.495743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.495748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.495787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:43.498221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:43.498540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:43.498553Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:43.498556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:43.498559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:43.498567Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1432 [2:7559601501485251938:8495]
2025-10-10T14:34:43.498579Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:43.498608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:43.498618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.498621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.498624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.498640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:43.498648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:43.498660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:43.498720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.498727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.498729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.498732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:43.498802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:43.498811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.498822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.498834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.498851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:43.498878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601501485251933:8495]
2025-10-10T14:34:43.498885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601501485251933:8495]
2025-10-10T14:34:43.498887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601501485251933:8495]
2025-10-10T14:34:43.498899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:43.498908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:43.498911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:43.498913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:43.498922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475516:2438], now have 1 active actors on pipe
2025-10-10T14:34:43.498934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:43.498956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:43.498964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:43.498970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475770:8851], now have 1 active actors on pipe
2025-10-10T14:34:43.498989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601501485251933:8495]
2025-10-10T14:34:43.499002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:43.499023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:43.498997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1432
2025-10-10T14:34:43.499120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.499131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.499105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1432
2025-10-10T14:34:43.499162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:43.499175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.499180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.499183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:43.499196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.499207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:43.499227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.499391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.499404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.499437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.499560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1433 partition: 0 MaxSeqNo: 40 sessionId: src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0
2025-10-10T14:34:43.499980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc3006b-a9521d39-4f61294e-dcc0a209_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:43.502916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0] Write session: try to update token
2025-10-10T14:34:43.502934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:43.518863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId: src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:43.520057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:43.520083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:43.520088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:43.520091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:43.520101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601501485251933:8495]
2025-10-10T14:34:43.520106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601501485251933:8495]
2025-10-10T14:34:43.520110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601501485251933:8495]
2025-10-10T14:34:43.520167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:43.520177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.520181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:43.520332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:43.521384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:43.521403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:43.521408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:43.521576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:43.567840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601502267475786:8672]
2025-10-10T14:34:43.568184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1432, pipe: [1:7559601502267475786:8672]
2025-10-10T14:34:43.635259Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:43.635942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.635960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.636005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475786:8672], now have 1 active actors on pipe
2025-10-10T14:34:43.636221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:43.636236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601502267475786:8672]
2025-10-10T14:34:43.636274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:43.636276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:43.636353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1433 reason: error at write: Disconnected sessionId: src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0
2025-10-10T14:34:43.636508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:43.636601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1433 sessionId: src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0 is DEAD
2025-10-10T14:34:43.636884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:43.636895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0] Write session will restart in 0.009164s
2025-10-10T14:34:43.636920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0] Write session: Do CDS request
2025-10-10T14:34:43.636929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:43.646930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.647055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:43.647069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1434
2025-10-10T14:34:43.647210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.647254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:43.647272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:43.647281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:43.647760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1434 sessionId:  describe result for acl check
2025-10-10T14:34:43.647794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:43.647803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:43.647812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:43.647825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601502267475819:8857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:43.648406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601502267475819:8857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:43.651305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601502267475819:8857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:43.656970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601502267475819:8857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:43.656985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601502267475819:8857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:43.656989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601502267475819:8857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:43.656999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:43.665761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:43.668975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:43.669252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:43.669265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:43.669278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:43.669350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:43.669409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601501485252217:8498]
2025-10-10T14:34:43.670062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:43.670388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:43.670437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:43.670765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:43.670829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.670836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.670837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.670838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.670839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.670841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.670842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.670843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.670844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.670845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.670846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.670847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.670848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.670854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.670867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.670871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.670875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.670879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.670883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.670887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.670891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.670894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.670898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.670902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.670905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.670909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.670917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.670926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.670937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.670942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.670946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.670951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.670955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.670971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.670981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.670987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.670996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.671001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.671011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.671016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.671025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.671030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.671035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.671040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.671045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.671054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.671058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.671068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.671072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.671077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.671086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.671091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.671136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:43.673942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:43.674288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:43.674303Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:43.674305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:43.674309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:43.674316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1433 [2:7559601501485252217:8498]
2025-10-10T14:34:43.674329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:43.674346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:43.674358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.674362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.674365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.674381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:43.674390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:43.674398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:43.674456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.674464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.674466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.674469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:43.674538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:43.674547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.674558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.674573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.674605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:43.674631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601501485252212:8498]
2025-10-10T14:34:43.674638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601501485252212:8498]
2025-10-10T14:34:43.674640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601501485252212:8498]
2025-10-10T14:34:43.674648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:43.674663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:43.674680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:43.674686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:43.674687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:43.674689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:43.674692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:43.674711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601501485252212:8498]
2025-10-10T14:34:43.674718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:43.674720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:43.674728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475804:2438], now have 1 active actors on pipe
2025-10-10T14:34:43.674732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267475899:8857], now have 1 active actors on pipe
2025-10-10T14:34:43.674794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1433
2025-10-10T14:34:43.674823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1433
2025-10-10T14:34:43.675015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.675027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.675070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:43.675086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.675091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.675093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:43.675105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.675429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:43.675458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.675699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.675712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.675736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.675828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1434 partition: 0 MaxSeqNo: 40 sessionId: src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0
2025-10-10T14:34:43.676229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|984cec12-e36c72cf-b6f427c-dbdaa6f5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:43.678891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0] Write session: try to update token
2025-10-10T14:34:43.678908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:43.696421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId: src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:43.695169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:43.695194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:43.695198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:43.695201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:43.695210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601501485252212:8498]
2025-10-10T14:34:43.695215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601501485252212:8498]
2025-10-10T14:34:43.695219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601501485252212:8498]
2025-10-10T14:34:43.695272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:43.695277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:43.695280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.695282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:43.695286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:43.695292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:43.695427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:43.699236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:43.736266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601502267476079:8672]
2025-10-10T14:34:43.736638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1433, pipe: [1:7559601502267476079:8672]
2025-10-10T14:34:43.808928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:43.809200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.809217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.809260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267476079:8672], now have 1 active actors on pipe
2025-10-10T14:34:43.809509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601502267476079:8672]
2025-10-10T14:34:43.809552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:43.809555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:43.809618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1434 reason: error at write: Disconnected sessionId: src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0
2025-10-10T14:34:43.809845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1434 sessionId: src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0 is DEAD
2025-10-10T14:34:43.810048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:43.810102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:43.813579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:43.813591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0] Write session will restart in 0.006514s
2025-10-10T14:34:43.813617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0] Write session: Do CDS request
2025-10-10T14:34:43.813626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:43.820959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.821053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:43.821068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1435
2025-10-10T14:34:43.821317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:43.821371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:43.821378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:43.821388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:43.821814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1435 sessionId:  describe result for acl check
2025-10-10T14:34:43.821850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:43.821852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:43.821854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:43.821859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601502267476112:8861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:43.822452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601502267476112:8861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:43.827450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601502267476112:8861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:43.830700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601502267476112:8861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:43.830714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601502267476112:8861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:43.830718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601502267476112:8861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:43.830727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:43.839137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:43.845709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:43.846002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:43.846016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:43.846030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:43.846091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:43.846132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601501485252488:8501]
2025-10-10T14:34:43.846797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:43.847956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:43.848016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:43.848371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:43.848436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.848443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.848444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.848446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.848447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.848449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.848451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.848453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.848454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.848456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.848457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.848458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.848460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.848467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.848480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.848485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.848490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.848494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.848498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.848502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.848507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.848516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.848521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.848525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.848529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.848533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.848542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.848551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:43.848557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.848563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:43.848568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.848574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:43.848579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.848584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:43.848590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.848595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:43.848600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.848606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:43.848611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.848617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:43.848622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.848628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:43.848634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.848641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:43.848646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.848652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:43.848657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.848663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.848667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.848673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.848678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.848683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.848726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:43.852180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:43.852936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:43.852955Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:43.852957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:43.852962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:43.852968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1434 [2:7559601501485252488:8501]
2025-10-10T14:34:43.852982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:43.853000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:43.853003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.853007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.853009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.853028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:43.853035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:43.853043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:43.853109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.853111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.853113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.853116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:43.853188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:43.853191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.853203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:43.853216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:43.853233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:43.853253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601501485252483:8501]
2025-10-10T14:34:43.853258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601501485252483:8501]
2025-10-10T14:34:43.853260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601501485252483:8501]
2025-10-10T14:34:43.853273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:43.853288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:43.853304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:43.853307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:43.853371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601501485252483:8501]
2025-10-10T14:34:43.853375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:43.853458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:43.853460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:43.853462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:43.853468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:43.853700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267476217:8861], now have 1 active actors on pipe
2025-10-10T14:34:43.853713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267476080:2438], now have 1 active actors on pipe
2025-10-10T14:34:43.854185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1434
2025-10-10T14:34:43.854229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1434
2025-10-10T14:34:43.854436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.854454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.854490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:43.854500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:43.854505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:43.854508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:43.854534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:43.854550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:43.854573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.854946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.854958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.854976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:43.855119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1435 partition: 0 MaxSeqNo: 40 sessionId: src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0
2025-10-10T14:34:43.857435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4cea9a1-7e96d644-e11c4d13-1832ce53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:43.860171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0] Write session: try to update token
2025-10-10T14:34:43.860191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:43.873759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:43.873785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:43.873789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:43.873791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:43.873801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601501485252483:8501]
2025-10-10T14:34:43.873806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601501485252483:8501]
2025-10-10T14:34:43.873809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601501485252483:8501]
2025-10-10T14:34:43.873862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:43.873867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:43.873872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:43.873874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:43.873875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:43.873877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:43.874015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:43.879272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId: src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:43.881897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:43.909835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601502267476353:8672]
2025-10-10T14:34:43.910142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1434, pipe: [1:7559601502267476353:8672]
2025-10-10T14:34:43.988348Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:43.988763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:43.988783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:43.988829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267476353:8672], now have 1 active actors on pipe
2025-10-10T14:34:43.989030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:43.989215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601502267476353:8672]
2025-10-10T14:34:43.989250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:43.989324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1435 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0
2025-10-10T14:34:43.989570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1435 sessionId: src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0 is DEAD
2025-10-10T14:34:43.989728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:43.989738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0] Write session will restart in 0.009564s
2025-10-10T14:34:43.989763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0] Write session: Do CDS request
2025-10-10T14:34:43.989740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:43.989770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:44.000925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.001515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:44.001531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1436
2025-10-10T14:34:44.001758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.001819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:44.001830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:44.001835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:44.002288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1436 sessionId:  describe result for acl check
2025-10-10T14:34:44.002330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:44.002335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:44.002337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:44.002344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601506562443728:8871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:44.002927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601506562443728:8871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:44.007536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601506562443728:8871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:44.011605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601506562443728:8871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:44.011620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601506562443728:8871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:44.011625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601506562443728:8871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:44.011633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:44.013863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:44.016844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:44.017073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:44.017087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:44.017100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:44.017154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:44.017200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601505780220084:8514]
2025-10-10T14:34:44.017831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:44.018260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:44.018318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:44.018839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:44.018930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.018938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.018940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.018941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.018942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.018943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.018945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.018946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.018947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.018948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.018950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.018951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.018952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.018959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.018971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.018975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.018979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.018982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.018987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.018992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.018996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.018999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.019004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.019007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.019010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.019014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.019022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.019031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.019038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.019043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.019047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.019052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.019056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.019061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.019065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.019069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.019073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.019078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.019082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.019087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.019091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.019096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.019101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.019107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.019110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.019116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.019121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.019125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.019129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.019134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.019138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.019143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.019181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:44.022618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:44.023328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:44.023342Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:44.023345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:44.023349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:44.023355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1435 [2:7559601505780220084:8514]
2025-10-10T14:34:44.023369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:44.023388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:44.023392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.023395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.023398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.023416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:44.023424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:44.023432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:44.023491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.023502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.023505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.023507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:44.023741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1435
2025-10-10T14:34:44.023746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1435
2025-10-10T14:34:44.023590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:44.023600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.023613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.023626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.023645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:44.023669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562443921:8871], now have 1 active actors on pipe
2025-10-10T14:34:44.023673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601502267476370:2438], now have 1 active actors on pipe
2025-10-10T14:34:44.023682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601505780220079:8514]
2025-10-10T14:34:44.023685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601505780220079:8514]
2025-10-10T14:34:44.023687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601505780220079:8514]
2025-10-10T14:34:44.023700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:44.023715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:44.023716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:44.023720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:44.023723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:44.023733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:44.023737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:44.023769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601505780220079:8514]
2025-10-10T14:34:44.023773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:44.023775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:44.023790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.023795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.023850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:44.023858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.023863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.023865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:44.023877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.023888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:44.023911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.024108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.024118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.024134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.024226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1436 partition: 0 MaxSeqNo: 40 sessionId: src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0
2025-10-10T14:34:44.024693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222eea-f86b65ea-5ac1b1f9-bf18b64d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:44.027501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0] Write session: try to update token
2025-10-10T14:34:44.027522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:44.043603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId: src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:44.044557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:44.044580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:44.044583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:44.044585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:44.044594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601505780220079:8514]
2025-10-10T14:34:44.044599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601505780220079:8514]
2025-10-10T14:34:44.044603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601505780220079:8514]
2025-10-10T14:34:44.044656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:44.044668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.044670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:44.044752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:44.044779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:44.044789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:44.044816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:44.046422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:44.093404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601506562443947:8672]
2025-10-10T14:34:44.093780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1435, pipe: [1:7559601506562443947:8672]
2025-10-10T14:34:44.163445Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:44.163965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.163985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.164031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562443947:8672], now have 1 active actors on pipe
2025-10-10T14:34:44.164273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:44.164476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:44.164494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:44.164511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:44.164554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1436 reason: error at write: Disconnected sessionId: src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0
2025-10-10T14:34:44.164570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601506562443947:8672]
2025-10-10T14:34:44.164770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1436 sessionId: src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0 is DEAD
2025-10-10T14:34:44.165100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:44.165109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0] Write session will restart in 0.007695s
2025-10-10T14:34:44.165146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0] Write session: Do CDS request
2025-10-10T14:34:44.165155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:44.175718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.175830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:44.175846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1437
2025-10-10T14:34:44.176000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.176046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:44.176057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:44.176061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:44.176538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1437 sessionId:  describe result for acl check
2025-10-10T14:34:44.176577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:44.176581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:44.176583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:44.176589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601506562443992:8878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:44.177156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601506562443992:8878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:44.181935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601506562443992:8878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:44.185141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601506562443992:8878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:44.185154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601506562443992:8878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:44.185157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601506562443992:8878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:44.185166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:44.187274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:44.190013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:44.190264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:44.190277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:44.190290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:44.190363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:44.190410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601505780220361:8518]
2025-10-10T14:34:44.191048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:44.191397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:44.191454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:44.191856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:44.191936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.191943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.191945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.191946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.191948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.191949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.191951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.191953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.191954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.191956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.191957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.191958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.191960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.191967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.191981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.191985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.191989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.191993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.191997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.192001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.192006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.192010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.192016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.192020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.192024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.192027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.192036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.192045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.192053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.192059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.192064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.192069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.192074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.192079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.192084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.192090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.192094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.192101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.192106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.192112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.192117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.192122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.192139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.192144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.192149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.192154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.192161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.192166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.192170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.192175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.192180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.192185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.192226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:44.194645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:44.195117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:44.195132Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:44.195134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:44.195137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:44.195143Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1436 [2:7559601505780220361:8518]
2025-10-10T14:34:44.195157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:44.195180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:44.195188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.195191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.195194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.195211Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:44.195223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:44.195233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:44.195294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.195302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.195304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.195307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:44.195383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:44.195390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.195414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.195428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.195449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:44.195476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444212:8878], now have 1 active actors on pipe
2025-10-10T14:34:44.195484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562443950:2438], now have 1 active actors on pipe
2025-10-10T14:34:44.195493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601505780220356:8518]
2025-10-10T14:34:44.195495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601505780220356:8518]
2025-10-10T14:34:44.195497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601505780220356:8518]
2025-10-10T14:34:44.195511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:44.195526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:44.195536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:44.195547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:44.195559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:44.195561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:44.195561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:44.195587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601505780220356:8518]
2025-10-10T14:34:44.195597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:44.195612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:44.195641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.195651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.195692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:44.195704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.195713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.195715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:44.195728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.195581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1436
2025-10-10T14:34:44.195743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:44.195621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1436
2025-10-10T14:34:44.195763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.195934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.195952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.195975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.196093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1437 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0
2025-10-10T14:34:44.196490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc03dc-2992f8a5-88f62327-c8b1d67c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:44.199230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0] Write session: try to update token
2025-10-10T14:34:44.199251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:44.214977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId: src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:44.217403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:44.217429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:44.217433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:44.217435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:44.217446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601505780220356:8518]
2025-10-10T14:34:44.217451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601505780220356:8518]
2025-10-10T14:34:44.217458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601505780220356:8518]
2025-10-10T14:34:44.217517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:44.217527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:44.217533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.217535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:44.217536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:44.217539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:44.217690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:44.218043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:44.265403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601506562444226:8672]
2025-10-10T14:34:44.269417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1436, pipe: [1:7559601506562444226:8672]
2025-10-10T14:34:44.333778Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:44.334309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.334333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.334386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444226:8672], now have 1 active actors on pipe
2025-10-10T14:34:44.334613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:44.334760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601506562444226:8672]
2025-10-10T14:34:44.334764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:44.334769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:44.334790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:44.334834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1437 reason: error at write: Disconnected sessionId: src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0
2025-10-10T14:34:44.335377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:44.335388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0] Write session will restart in 0.009296s
2025-10-10T14:34:44.335416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0] Write session: Do CDS request
2025-10-10T14:34:44.335423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:44.335031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1437 sessionId: src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0 is DEAD
2025-10-10T14:34:44.347527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.348259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:44.348272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1438
2025-10-10T14:34:44.348397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.348433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:44.348447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:44.348455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:44.348953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1438 sessionId:  describe result for acl check
2025-10-10T14:34:44.348991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:44.348997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:44.348999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:44.349006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601506562444245:8882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:44.349587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601506562444245:8882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:44.360412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601506562444245:8882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:44.366405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601506562444245:8882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:44.366421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601506562444245:8882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:44.366425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601506562444245:8882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:44.366436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:44.378282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:44.384483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:44.384778Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:44.384795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:44.384810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:44.384883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:44.384931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601505780220633:8520]
2025-10-10T14:34:44.385571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:44.385929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:44.385979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:44.386311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:44.386372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.386379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.386381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.386382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.386384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.386385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.386386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.386388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.386389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.386390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.386392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.386393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.386394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.386400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.386415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.386420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.386424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.386428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.386432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.386436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.386440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.386443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.386448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.386452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.386455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.386459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.386467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.386475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.386483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.386488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.386494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.386499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.386503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.386509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.386513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.386518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.386523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.386528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.386534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.386545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.386548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.386553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.386558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.386563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.386568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.386574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.386578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.386583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.386587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.386593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.386602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.386607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.386645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:44.389203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:44.389580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:44.389595Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:44.389597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:44.389601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:44.389608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1437 [2:7559601505780220633:8520]
2025-10-10T14:34:44.389622Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:44.389653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:44.389663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.389667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.389669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.389687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:44.389696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:44.389704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:44.389769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.389772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.389774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.389777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:44.389853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:44.389865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.389876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.389888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.389902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:44.389926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444389:8882], now have 1 active actors on pipe
2025-10-10T14:34:44.389929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444228:2438], now have 1 active actors on pipe
2025-10-10T14:34:44.389938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601505780220628:8520]
2025-10-10T14:34:44.389940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601505780220628:8520]
2025-10-10T14:34:44.389943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601505780220628:8520]
2025-10-10T14:34:44.389958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:44.389978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:44.389978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:44.389982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:44.389984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:44.390000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:44.390003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:44.390033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601505780220628:8520]
2025-10-10T14:34:44.390044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:44.390050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:44.393532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1437
2025-10-10T14:34:44.393581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1437
2025-10-10T14:34:44.393635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.393657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.393713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:44.393733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.393744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.393747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:44.393769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.393794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:44.393817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.394182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.394207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.394232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.394386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1438 partition: 0 MaxSeqNo: 40 sessionId: src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0
2025-10-10T14:34:44.394870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff8cc27-5f71e3ed-5903756e-20aec153_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:44.397876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0] Write session: try to update token
2025-10-10T14:34:44.397903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:44.405871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:44.405891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:44.405902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601505780220628:8520]
2025-10-10T14:34:44.405954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:44.405961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:44.406131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:44.406277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:44.406421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:44.406559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:44.406762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:44.406805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:44.419169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId: src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:44.422197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:44.422461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.422487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.422530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:44.422669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:44.430517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:44.430538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:44.430542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:44.430544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:44.430556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601505780220628:8520]
2025-10-10T14:34:44.430560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601505780220628:8520]
2025-10-10T14:34:44.430563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601505780220628:8520]
2025-10-10T14:34:44.430614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:44.430617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:44.430626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.430628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:44.430630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:44.430635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:44.430788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:44.435135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601506562444503:8672]
2025-10-10T14:34:44.435472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1437, pipe: [1:7559601506562444503:8672]
2025-10-10T14:34:44.544933Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:44.545460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444503:8672], now have 1 active actors on pipe
2025-10-10T14:34:44.553731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.553758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.553939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.554004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.554069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.554138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.554186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.554196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.554270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.554342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.554406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.554472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.554513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.554516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.554586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.554645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.554708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.554772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.554813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.554816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.554898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.554964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.555024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.555090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.555132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.555135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.555207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.555268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.555326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.555388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.555429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.555432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.555501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.555572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.555635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.555701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.555744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.555747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.555821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.555881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.555940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.556002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.556043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.556046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.556119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.556179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.556241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.556303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.556355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.556358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.556433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.556492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.556554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.556611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.556655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.556658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.556729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:44.556792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:44.556860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:44.556925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:44.556981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:44.556990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:44.557246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:44.557264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:44.557300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1438 reason: error at write: Disconnected sessionId: src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0
2025-10-10T14:34:44.557404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:44.557454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601506562444503:8672]
2025-10-10T14:34:44.557546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1438 sessionId: src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0 is DEAD
2025-10-10T14:34:44.557890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:44.557902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0] Write session will restart in 0.008711s
2025-10-10T14:34:44.557928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0] Write session: Do CDS request
2025-10-10T14:34:44.557934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:44.558357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:44.568103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.568172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:44.568188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1439
2025-10-10T14:34:44.568455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.568498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:44.568504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:44.568511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:44.569035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1439 sessionId:  describe result for acl check
2025-10-10T14:34:44.569074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:44.569077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:44.569079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:44.569087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601506562444525:8886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:44.569685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601506562444525:8886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:44.576788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601506562444525:8886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:44.581504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601506562444525:8886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:44.581522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601506562444525:8886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:44.581526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601506562444525:8886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:44.581536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:44.587835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:44.595362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:44.595647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:44.595662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:44.595677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:44.595741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:44.595785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601505780220918:8522]
2025-10-10T14:34:44.596466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:44.596804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:44.596848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:44.597170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:44.597240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.597247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.597248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.597250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.597251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.597252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.597254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.597256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.597257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.597258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.597260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.597261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.597262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.597269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.597283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.597288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.597292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.597296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.597301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.597305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.597308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.597313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.597317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.597321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.597326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.597345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.597354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.597363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.597369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.597374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.597377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.597383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.597387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.597392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.597397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.597402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.597406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.597411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.597416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.597422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.597426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.597432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.597445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.597450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.597454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.597459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.597464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.597469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.597474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.597485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.597493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.597507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.597548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:44.600354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:44.600822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:44.600835Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:44.600844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:44.600849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:44.600856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1438 [2:7559601505780220918:8522]
2025-10-10T14:34:44.600869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:44.600888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:44.600896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.600899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.600902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.600918Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:44.600926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:44.600935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:44.600993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.601000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.601003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.601006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:44.601080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:44.601088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.601100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.601114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.601133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:44.601160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444706:8886], now have 1 active actors on pipe
2025-10-10T14:34:44.601167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444508:2438], now have 1 active actors on pipe
2025-10-10T14:34:44.601175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601505780220913:8522]
2025-10-10T14:34:44.601178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601505780220913:8522]
2025-10-10T14:34:44.601180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601505780220913:8522]
2025-10-10T14:34:44.601195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:44.601210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:44.601212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:44.601220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:44.601222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:44.601228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:44.601231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:44.601223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1438
2025-10-10T14:34:44.601272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1438
2025-10-10T14:34:44.601262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601505780220913:8522]
2025-10-10T14:34:44.601270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:44.601272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:44.601286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.601292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.601360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:44.601372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.601377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.601379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:44.601390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.601404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:44.601423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.601589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.601602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.601627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.601732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1439 partition: 0 MaxSeqNo: 40 sessionId: src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0
2025-10-10T14:34:44.602112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b565552-beb6dbfc-f4b678c4-bf20f629_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:44.604855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0] Write session: try to update token
2025-10-10T14:34:44.604873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:44.620079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId: src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:44.622156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:44.622173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:44.622177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:44.622179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:44.622190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601505780220913:8522]
2025-10-10T14:34:44.622194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601505780220913:8522]
2025-10-10T14:34:44.622198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601505780220913:8522]
2025-10-10T14:34:44.622252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:44.622265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.622268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:44.622387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:44.622400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:44.622405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:44.622409Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:44.622745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:44.657859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601506562444803:8672]
2025-10-10T14:34:44.658207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1438, pipe: [1:7559601506562444803:8672]
2025-10-10T14:34:44.735251Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:44.735459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.735471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.735511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444803:8672], now have 1 active actors on pipe
2025-10-10T14:34:44.735878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:44.736222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601506562444803:8672]
2025-10-10T14:34:44.736265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:44.736694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:44.736706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0] Write session will restart in 0.007496s
2025-10-10T14:34:44.736730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0] Write session: Do CDS request
2025-10-10T14:34:44.736736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:44.736338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1439 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0
2025-10-10T14:34:44.736539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1439 sessionId: src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0 is DEAD
2025-10-10T14:34:44.736796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:44.745893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.746234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:44.746249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1440
2025-10-10T14:34:44.746351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.746384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:44.746393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:44.746397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:44.746759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1440 sessionId:  describe result for acl check
2025-10-10T14:34:44.746787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:44.746788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:44.746789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:44.746794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601506562444822:8892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:44.747215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601506562444822:8892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:44.750129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601506562444822:8892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:44.753484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601506562444822:8892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:44.753500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601506562444822:8892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:44.753503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601506562444822:8892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:44.753512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:44.762446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:44.765517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:44.765758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:44.765773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:44.765787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:44.765853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:44.765891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601505780221193:8525]
2025-10-10T14:34:44.766466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:44.766840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:44.766904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:44.767260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:44.767331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.767337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.767338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.767340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.767341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.767342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.767352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.767354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.767355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.767356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.767357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.767359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.767360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.767366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.767379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.767383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.767387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.767390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.767394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.767398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.767402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.767406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.767411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.767415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.767419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.767422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.767430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.767449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.767460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.767466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.767475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.767480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.767486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.767496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.767501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.767510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.767514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.767520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.767529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.767546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.767554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.767560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.767565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.767574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.767579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.767590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.767594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.767603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.767606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.767611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.767616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.767625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.767678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:44.770112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:44.770547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:44.770564Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:44.770566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:44.770569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:44.770576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1439 [2:7559601505780221193:8525]
2025-10-10T14:34:44.770588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:44.770607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:44.770611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.770614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.770617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.770634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:44.770647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:44.770657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:44.770721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.770728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.770730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.770733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:44.770813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:44.770822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.770834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.770846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.770861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:44.770890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444808:2438], now have 1 active actors on pipe
2025-10-10T14:34:44.770897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562444898:8892], now have 1 active actors on pipe
2025-10-10T14:34:44.770905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601505780221188:8525]
2025-10-10T14:34:44.770907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601505780221188:8525]
2025-10-10T14:34:44.770909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601505780221188:8525]
2025-10-10T14:34:44.770923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:44.770939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:44.770942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:44.770947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:44.770949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:44.770958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:44.770917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1439
2025-10-10T14:34:44.770961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:44.770967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1439
2025-10-10T14:34:44.770994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601505780221188:8525]
2025-10-10T14:34:44.771004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:44.771016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:44.771033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.771042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.771080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:44.771093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.771097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.771100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:44.771111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.771126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:44.771145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.771325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.771335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.771359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.771467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1440 partition: 0 MaxSeqNo: 40 sessionId: src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0
2025-10-10T14:34:44.771933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e10d53-cf617a52-c5e2ec60-737c3345_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:44.774699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0] Write session: try to update token
2025-10-10T14:34:44.774721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:44.788957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId: src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:44.789972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:44.789988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:44.789990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:44.789993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:44.790003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601505780221188:8525]
2025-10-10T14:34:44.790007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601505780221188:8525]
2025-10-10T14:34:44.790011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601505780221188:8525]
2025-10-10T14:34:44.790062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:44.790078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.790081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:44.790158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:44.790173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:44.790178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:44.790220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:44.791662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:44.836568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601506562445086:8672]
2025-10-10T14:34:44.836890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1439, pipe: [1:7559601506562445086:8672]
2025-10-10T14:34:44.899945Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:44.900510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.900527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.900578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562445086:8672], now have 1 active actors on pipe
2025-10-10T14:34:44.900752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:44.900817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:44.900818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:44.900832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:44.900862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601506562445086:8672]
2025-10-10T14:34:44.900906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1440 reason: error at write: Disconnected sessionId: src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0
2025-10-10T14:34:44.901128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1440 sessionId: src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0 is DEAD
2025-10-10T14:34:44.901282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:44.901294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0] Write session will restart in 0.008815s
2025-10-10T14:34:44.901318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0] Write session: Do CDS request
2025-10-10T14:34:44.901324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:44.911926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.912015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:44.912042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1441
2025-10-10T14:34:44.912143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:44.912178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:44.912184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:44.912187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:44.912768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1441 sessionId:  describe result for acl check
2025-10-10T14:34:44.912806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:44.912814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:44.912817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:44.912823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601506562445150:8896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:44.913397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601506562445150:8896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:44.916337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601506562445150:8896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:44.920011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601506562445150:8896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:44.920027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601506562445150:8896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:44.920032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601506562445150:8896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:44.920041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:44.921953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:44.924801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:44.925025Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:44.925038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:44.925049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:44.925106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:44.925154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601505780221467:8528]
2025-10-10T14:34:44.925740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:44.926066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:44.926133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:44.926766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:44.926851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.926856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.926858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.926859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.926860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.926862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.926863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.926864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.926866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.926867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.926868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.926869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.926870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.926878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.926892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.926896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.926900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.926905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.926909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.926912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.926916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.926920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.926924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.926928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.926933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.926938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.926945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.926957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:44.926963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.926970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:44.926979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.926984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:44.926988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.926994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:44.926999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.927004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:44.927008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.927014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:44.927020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.927029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:44.927033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.927055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:44.927064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.927070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:44.927074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.927079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:44.927084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.927089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.927094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.927099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.927104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.927109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.927149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:44.929514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:44.929862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:44.929876Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:44.929878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:44.929882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:44.929889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1440 [2:7559601505780221467:8528]
2025-10-10T14:34:44.929902Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:44.929926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:44.929934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.929938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.929941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.929959Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:44.929968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:44.929980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:44.930040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.930047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.930050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.930052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:44.930131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:44.930140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.930152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:44.930166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:44.930186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:44.930214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562445087:2438], now have 1 active actors on pipe
2025-10-10T14:34:44.930218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601506562445350:8896], now have 1 active actors on pipe
2025-10-10T14:34:44.930226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601505780221462:8528]
2025-10-10T14:34:44.930228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601505780221462:8528]
2025-10-10T14:34:44.930230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601505780221462:8528]
2025-10-10T14:34:44.930228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1440
2025-10-10T14:34:44.930261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:44.930264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:44.930243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1440
2025-10-10T14:34:44.930267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:44.930270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:44.930282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:44.930299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:44.930307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:44.930331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.930340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.930377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601505780221462:8528]
2025-10-10T14:34:44.930390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:44.930404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:44.930418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40e18919-d7f1523e-3c22900-9f430b39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:44.930425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:44.930433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:44.930436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:44.930449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:44.930465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:44.930507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.930676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.930690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.930717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:44.930827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1441 partition: 0 MaxSeqNo: 40 sessionId: src_id|40e18919-d7f1523e-3c22900-9f430b39_0
2025-10-10T14:34:44.931263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69fba0a6-e9ae2d06-5ea05fdf-42729aee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|40e18919-d7f1523e-3c22900-9f430b39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:44.934065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e18919-d7f1523e-3c22900-9f430b39_0] Write session: try to update token
2025-10-10T14:34:44.934087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e18919-d7f1523e-3c22900-9f430b39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:44.948786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId: src_id|40e18919-d7f1523e-3c22900-9f430b39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:44.948866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:44.948882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:44.948893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601505780221462:8528]
2025-10-10T14:34:44.948947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:44.948953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:44.949138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:44.949297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:44.949464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:44.949616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:44.949827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:44.949873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:44.951750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:44.951949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:44.951967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:44.952007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:44.952112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:44.959890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:44.959907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:44.959911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:44.959913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:44.959926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601505780221462:8528]
2025-10-10T14:34:44.959931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601505780221462:8528]
2025-10-10T14:34:44.959935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601505780221462:8528]
2025-10-10T14:34:44.959989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:44.959997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:44.959999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:44.960005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:44.960006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:44.960011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:44.960150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:45.000871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601510857412661:8672]
2025-10-10T14:34:45.001245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1440, pipe: [1:7559601510857412661:8672]
2025-10-10T14:34:45.072203Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:45.080942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.080972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.081162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.081236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.081308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.081402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.081456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.081465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.081539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.081605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.081675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.081746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.081799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.081802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.081873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.081944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.082009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.082078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.082123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.082133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.082199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.082268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.082335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.082402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.082446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.082453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.082519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.082583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.082651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.082715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.082764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.082771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.082838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.082903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.082967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.083033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.083078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.083085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.083156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.083220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.083290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.083360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.083405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.083412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.083479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.083561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.083631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.083702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.083753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.083760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.083832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.083900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.083971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.084040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.084085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.084093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.084162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.084228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.084295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.084365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.084413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.084420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.084487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857412661:8672], now have 1 active actors on pipe
2025-10-10T14:34:45.084753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:45.084768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:45.084811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1441 reason: error at write: Disconnected sessionId: src_id|40e18919-d7f1523e-3c22900-9f430b39_0
2025-10-10T14:34:45.085026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1441 sessionId: src_id|40e18919-d7f1523e-3c22900-9f430b39_0 is DEAD
2025-10-10T14:34:45.085042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:45.085084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601510857412661:8672]
2025-10-10T14:34:45.085193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e18919-d7f1523e-3c22900-9f430b39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:45.085204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e18919-d7f1523e-3c22900-9f430b39_0] Write session will restart in 0.009868s
2025-10-10T14:34:45.085228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e18919-d7f1523e-3c22900-9f430b39_0] Write session: Do CDS request
2025-10-10T14:34:45.085234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e18919-d7f1523e-3c22900-9f430b39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:45.085467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:45.095985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40e18919-d7f1523e-3c22900-9f430b39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.096112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:45.096129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1442
2025-10-10T14:34:45.096274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.096311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:45.096321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:45.096325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:45.096818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1442 sessionId:  describe result for acl check
2025-10-10T14:34:45.096859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:45.096864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:45.096866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:45.096873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601510857412746:8909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:45.097464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601510857412746:8909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:45.099814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601510857412746:8909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:45.103372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601510857412746:8909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:45.103388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601510857412746:8909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:45.103393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601510857412746:8909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:45.103402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:45.109849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:45.112849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:45.113093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:45.113106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:45.113119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:45.113174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:45.113219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601510075189076:8543]
2025-10-10T14:34:45.113852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:45.114188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:45.114237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:45.114558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:45.114628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.114635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.114636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.114637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.114638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.114640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.114641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.114642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.114643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.114644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.114645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.114646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.114647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.114654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.114668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.114672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.114676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.114680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.114684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.114688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.114692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.114696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.114700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.114704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.114707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.114711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.114720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.114729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.114735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.114740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.114744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.114748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.114752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.114757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.114761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.114765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.114769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.114774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.114779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.114789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.114794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.114799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.114807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.114812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.114816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.114821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.114825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.114830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.114835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.114844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.114849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.114858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.114895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:45.117389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:45.117794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:45.117809Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:45.117811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:45.117815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:45.117822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1441 [2:7559601510075189076:8543]
2025-10-10T14:34:45.117834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:45.117852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:45.117860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.117863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.117866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.117882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:45.117890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:45.117898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:45.117957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.117963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.117964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.117967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:45.118032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:45.118042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.118052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.118063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.118077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:45.118115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857412689:2438], now have 1 active actors on pipe
2025-10-10T14:34:45.118122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857412823:8909], now have 1 active actors on pipe
2025-10-10T14:34:45.118129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601510075189071:8543]
2025-10-10T14:34:45.118131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601510075189071:8543]
2025-10-10T14:34:45.118133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601510075189071:8543]
2025-10-10T14:34:45.118147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:45.118167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:45.118158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1441
2025-10-10T14:34:45.118184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1441
2025-10-10T14:34:45.118182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:45.118188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:45.118189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:45.118191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:45.118194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:45.118214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601510075189071:8543]
2025-10-10T14:34:45.118217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:45.118229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:45.118238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.118242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.118289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:45.118303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.118307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.118309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:45.118321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.118331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:45.118352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.118496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.118504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.118521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.118630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1442 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0
2025-10-10T14:34:45.119118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40e18919-d7f1523e-3c22900-9f430b39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:45.122548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0] Write session: try to update token
2025-10-10T14:34:45.122575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:45.137770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:45.137793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:45.137796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:45.137798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:45.137810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601510075189071:8543]
2025-10-10T14:34:45.137815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601510075189071:8543]
2025-10-10T14:34:45.137820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601510075189071:8543]
2025-10-10T14:34:45.137870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:45.137885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.137888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:45.137914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:45.137922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:45.137927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:45.138037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:45.139436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId: src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:45.142300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:45.185223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601510857412967:8672]
2025-10-10T14:34:45.185496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1441, pipe: [1:7559601510857412967:8672]
2025-10-10T14:34:45.252993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:45.253555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.253573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.253621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857412967:8672], now have 1 active actors on pipe
2025-10-10T14:34:45.254134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601510857412967:8672]
2025-10-10T14:34:45.254190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:45.254229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:45.254237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:45.254301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1442 reason: error at write: Disconnected sessionId: src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0
2025-10-10T14:34:45.254515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1442 sessionId: src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0 is DEAD
2025-10-10T14:34:45.254678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:45.254690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0] Write session will restart in 0.006736s
2025-10-10T14:34:45.254715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0] Write session: Do CDS request
2025-10-10T14:34:45.254721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:45.254365Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:45.262965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.263078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:45.263094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1443
2025-10-10T14:34:45.263214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.263250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:45.263261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:45.263265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:45.263787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1443 sessionId:  describe result for acl check
2025-10-10T14:34:45.263825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:45.263831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:45.263835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:45.263842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601510857412984:8913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:45.264412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601510857412984:8913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:45.267584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601510857412984:8913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:45.274982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601510857412984:8913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:45.275001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601510857412984:8913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:45.275005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601510857412984:8913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:45.275015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:45.277484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:45.281257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:45.281563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:45.281574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:45.281587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:45.281655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:45.281703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601510075189352:8545]
2025-10-10T14:34:45.282359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:45.282836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:45.282896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:45.283240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:45.283304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.283310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.283312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.283313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.283315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.283316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.283317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.283318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.283319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.283320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.283322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.283323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.283325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.283332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.283345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.283349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.283354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.283358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.283363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.283367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.283371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.283374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.283378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.283381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.283384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.283387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.283395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.283404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.283410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.283416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.283420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.283424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.283429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.283435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.283449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.283454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.283460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.283465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.283470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.283475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.283480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.283485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.283490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.283495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.283499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.283504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.283509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.283514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.283531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.283536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.283540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.283546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.283587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:45.286169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:45.286931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:45.286945Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:45.286947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:45.286951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:45.286959Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1442 [2:7559601510075189352:8545]
2025-10-10T14:34:45.286972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:45.286992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:45.286996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.286999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.287001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.287020Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:45.287028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:45.287042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:45.287105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.287112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.287114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.287117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:45.287182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:45.287190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.287202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.287214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.287231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:45.287251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601510075189347:8545]
2025-10-10T14:34:45.287253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601510075189347:8545]
2025-10-10T14:34:45.287256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601510075189347:8545]
2025-10-10T14:34:45.287265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:45.287274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:45.287277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:45.287279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:45.287281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:45.287297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:45.287300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:45.287311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857412969:2438], now have 1 active actors on pipe
2025-10-10T14:34:45.287315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413226:8913], now have 1 active actors on pipe
2025-10-10T14:34:45.287343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601510075189347:8545]
2025-10-10T14:34:45.287351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:45.287379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:45.287446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1442
2025-10-10T14:34:45.287499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1442
2025-10-10T14:34:45.287656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.287669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.287713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:45.287729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.287739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.287742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:45.287755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.287782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:45.287804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.288034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.288043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.288067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.288404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1443 partition: 0 MaxSeqNo: 40 sessionId: src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0
2025-10-10T14:34:45.288812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd054ef4-9b704d09-1bd29318-9aa0ac10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:45.291794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0] Write session: try to update token
2025-10-10T14:34:45.291813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:45.306428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId: src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:45.307148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:45.307165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:45.307170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:45.307171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:45.307180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601510075189347:8545]
2025-10-10T14:34:45.307186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601510075189347:8545]
2025-10-10T14:34:45.307190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601510075189347:8545]
2025-10-10T14:34:45.307242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:45.307256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.307259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:45.307279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:45.307308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:45.307314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:45.307416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:45.309108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:45.357424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601510857413249:8672]
2025-10-10T14:34:45.357775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1442, pipe: [1:7559601510857413249:8672]
2025-10-10T14:34:45.420411Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:45.420721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.420739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.420785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413249:8672], now have 1 active actors on pipe
2025-10-10T14:34:45.421039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601510857413249:8672]
2025-10-10T14:34:45.421042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:45.421090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:45.421093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:45.421169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1443 reason: error at write: Disconnected sessionId: src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0
2025-10-10T14:34:45.421424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1443 sessionId: src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0 is DEAD
2025-10-10T14:34:45.421814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:45.421930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:45.421940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0] Write session will restart in 0.008818s
2025-10-10T14:34:45.421963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0] Write session: Do CDS request
2025-10-10T14:34:45.421969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:45.432029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.432078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:45.432094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1444
2025-10-10T14:34:45.432299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.432340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:45.432358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:45.432368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:45.432841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1444 sessionId:  describe result for acl check
2025-10-10T14:34:45.432880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:45.432882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:45.432884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:45.432890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601510857413266:8917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:45.433452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601510857413266:8917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:45.436599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601510857413266:8917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:45.439909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601510857413266:8917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:45.439928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601510857413266:8917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:45.439932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601510857413266:8917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:45.439942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:45.447067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:45.450007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:45.450237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:45.450250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:45.450263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:45.450333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:45.450380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601510075189629:8547]
2025-10-10T14:34:45.451034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:45.451404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:45.451478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:45.451865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:45.451936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.451942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.451943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.451944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.451946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.451947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.451948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.451949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.451951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.451952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.451953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.451954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.451956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.451961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.451975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.451979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.451983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.451987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.451991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.451995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.451999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.452003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.452008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.452012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.452016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.452020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.452028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.452036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.452044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.452049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.452055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.452060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.452065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.452070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.452075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.452080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.452085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.452091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.452096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.452101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.452105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.452111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.452115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.452120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.452124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.452129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.452133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.452144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.452148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.452153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.452158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.452163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.452205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:45.454634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:45.454971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:45.454984Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:45.454987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:45.454991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:45.454998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1443 [2:7559601510075189629:8547]
2025-10-10T14:34:45.455010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:45.455029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:45.455037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.455041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.455044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.455062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:45.455075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:45.455084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:45.455145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.455152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.455154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.455157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:45.455221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:45.455230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.455241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.455254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.455268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:45.455290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413250:2438], now have 1 active actors on pipe
2025-10-10T14:34:45.455299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413379:8917], now have 1 active actors on pipe
2025-10-10T14:34:45.455307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601510075189624:8547]
2025-10-10T14:34:45.455312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601510075189624:8547]
2025-10-10T14:34:45.455314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601510075189624:8547]
2025-10-10T14:34:45.455328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:45.455341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:45.455346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:45.455349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:45.455351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:45.455362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:45.455366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:45.455346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1443
2025-10-10T14:34:45.455354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1443
2025-10-10T14:34:45.455390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601510075189624:8547]
2025-10-10T14:34:45.455399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:45.455401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:45.455422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.455427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.455825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:45.455841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.455845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.455848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:45.455860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.455872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:45.455904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.456100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.456112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.456129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.456191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1444 partition: 0 MaxSeqNo: 40 sessionId: src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0
2025-10-10T14:34:45.456593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e75f3733-5c96b9d5-6aeda69c-b980b2c7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:45.459289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0] Write session: try to update token
2025-10-10T14:34:45.459307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:45.473997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId: src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:45.475405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:45.475428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:45.475432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:45.475435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:45.475445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601510075189624:8547]
2025-10-10T14:34:45.475450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601510075189624:8547]
2025-10-10T14:34:45.475454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601510075189624:8547]
2025-10-10T14:34:45.475518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:45.475523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:45.475531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.475534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:45.475543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:45.475548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:45.475701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:45.477061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:45.521058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601510857413532:8672]
2025-10-10T14:34:45.521362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1443, pipe: [1:7559601510857413532:8672]
2025-10-10T14:34:45.596414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:45.596490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601510857413532:8672]
2025-10-10T14:34:45.596529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:45.596540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:45.596615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1444 reason: error at write: Disconnected sessionId: src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0
2025-10-10T14:34:45.595522Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:45.595828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.595839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.595889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413532:8672], now have 1 active actors on pipe
2025-10-10T14:34:45.596318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:45.596855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1444 sessionId: src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0 is DEAD
2025-10-10T14:34:45.597220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:45.597231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0] Write session will restart in 0.007077s
2025-10-10T14:34:45.597258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0] Write session: Do CDS request
2025-10-10T14:34:45.597269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:45.606004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.608138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:45.608153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1445
2025-10-10T14:34:45.608336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.608371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:45.608377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:45.608381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:45.608981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1445 sessionId:  describe result for acl check
2025-10-10T14:34:45.609014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:45.609016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:45.609018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:45.609025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601510857413562:8922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:45.609634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601510857413562:8922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:45.613026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601510857413562:8922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:45.619187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601510857413562:8922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:45.619205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601510857413562:8922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:45.619209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601510857413562:8922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:45.619219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:45.633147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:45.636725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:45.637023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:45.637035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:45.637049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:45.637115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:45.637162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601510075189919:8550]
2025-10-10T14:34:45.637833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:45.638204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:45.638253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:45.638580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:45.638639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.638645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.638646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.638648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.638649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.638650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.638652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.638653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.638654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.638656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.638658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.638659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.638660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.638667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.638681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.638686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.638690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.638694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.638698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.638702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.638706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.638710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.638714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.638718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.638722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.638727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.638735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.638745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.638751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.638757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.638769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.638775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.638780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.638785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.638790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.638795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.638800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.638807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.638812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.638817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.638822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.638827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.638831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.638836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.638845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.638850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.638855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.638860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.638864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.638869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.638874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.638879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.638918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:45.642653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:45.642998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:45.643012Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:45.643015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:45.643020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:45.643027Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1444 [2:7559601510075189919:8550]
2025-10-10T14:34:45.643042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:45.643840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1444
2025-10-10T14:34:45.644005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1444
2025-10-10T14:34:45.643063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:45.643075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.643079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.643081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.643100Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:45.643109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:45.643118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:45.643182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.643184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.643187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.643189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:45.643264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:45.643268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.643281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.643292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.643310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:45.643333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601510075189914:8550]
2025-10-10T14:34:45.643336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601510075189914:8550]
2025-10-10T14:34:45.643338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601510075189914:8550]
2025-10-10T14:34:45.643358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:45.643372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:45.643388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:45.643392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:45.643407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:45.643410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:45.643413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:45.643426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601510075189914:8550]
2025-10-10T14:34:45.643429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:45.643517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:45.644260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413545:2438], now have 1 active actors on pipe
2025-10-10T14:34:45.644272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413658:8922], now have 1 active actors on pipe
2025-10-10T14:34:45.644294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.644300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.644334Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2bd7847-25605c9b-1ab14921-585e9603_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:45.644347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.644352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.644359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:45.644373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.644385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:45.644408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.644938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.644946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.644966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.645106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1445 partition: 0 MaxSeqNo: 40 sessionId: src_id|a2bd7847-25605c9b-1ab14921-585e9603_0
2025-10-10T14:34:45.645626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83660be6-afbb0c01-8a5e9a8e-81718b0b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a2bd7847-25605c9b-1ab14921-585e9603_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:45.648564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd7847-25605c9b-1ab14921-585e9603_0] Write session: try to update token
2025-10-10T14:34:45.648590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd7847-25605c9b-1ab14921-585e9603_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:45.668045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId: src_id|a2bd7847-25605c9b-1ab14921-585e9603_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:45.670811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:45.671266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.671281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.671315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:45.671599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:45.678254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:45.678273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:45.678277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:45.678279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:45.678290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601510075189914:8550]
2025-10-10T14:34:45.678295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601510075189914:8550]
2025-10-10T14:34:45.678303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601510075189914:8550]
2025-10-10T14:34:45.678355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:45.678370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.678372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:45.678518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:45.681441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:45.681454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:45.681459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:45.696731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601510857413838:8672]
2025-10-10T14:34:45.697024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1444, pipe: [1:7559601510857413838:8672]
2025-10-10T14:34:45.795093Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:45.796117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413838:8672], now have 1 active actors on pipe
2025-10-10T14:34:45.804635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.804664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.804862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.804933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.805005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.805075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.805432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.805438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.805513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.805580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.805646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.805874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.805923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.805928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.806003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.806057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.806124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.806188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.806229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.806232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.806300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.806362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.806427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.806485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.806531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.806534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.806603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.806660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.806720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.806784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.806831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.806834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.806904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.806968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.807037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.807099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.807142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.807145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.807234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.807290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.807354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.807419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.807461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.807464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.807544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.807606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.807667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.807727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.807770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.807773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.807842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.807899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.807966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.808026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.808067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.808069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.808142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:45.808200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:45.808263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:45.808323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:45.808364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:45.808367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:45.808807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:45.809208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:45.809280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a2bd7847-25605c9b-1ab14921-585e9603_0
2025-10-10T14:34:45.809735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd7847-25605c9b-1ab14921-585e9603_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:45.809745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd7847-25605c9b-1ab14921-585e9603_0] Write session will restart in 0.006377s
2025-10-10T14:34:45.809786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd7847-25605c9b-1ab14921-585e9603_0] Write session: Do CDS request
2025-10-10T14:34:45.809794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd7847-25605c9b-1ab14921-585e9603_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:45.809523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1445 sessionId: src_id|a2bd7847-25605c9b-1ab14921-585e9603_0 is DEAD
2025-10-10T14:34:45.809724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:45.809741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601510857413838:8672]
2025-10-10T14:34:45.817949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd7847-25605c9b-1ab14921-585e9603_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.818016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:45.818034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1446
2025-10-10T14:34:45.818205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:45.818244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:45.818255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:45.818259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:45.818826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1446 sessionId:  describe result for acl check
2025-10-10T14:34:45.818874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:45.818881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:45.818883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:45.818894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601510857413858:8927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:45.819570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601510857413858:8927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:45.823312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601510857413858:8927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:45.829944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601510857413858:8927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:45.829964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601510857413858:8927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:45.829968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601510857413858:8927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:45.829979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:45.834003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:45.837383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:45.837664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:45.837679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:45.837694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:45.837757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:45.837806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601510075190200:8553]
2025-10-10T14:34:45.838421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:45.838891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:45.838965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:45.839326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:45.839390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.839397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.839398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.839400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.839401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.839403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.839404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.839406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.839407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.839408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.839410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.839411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.839412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.839419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.839433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.839437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.839441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.839445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.839449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.839453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.839456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.839460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.839464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.839468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.839471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.839476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.839484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.839493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:45.839513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.839519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:45.839524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.839529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:45.839535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.839542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:45.839546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.839551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:45.839556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.839561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:45.839567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.839572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:45.839576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.839581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:45.839586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.839591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:45.839597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.839602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:45.839610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.839615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.839619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.839624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.839629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.839634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.839673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:45.842373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:45.842729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:45.842741Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:45.842744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:45.842749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:45.842756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1445 [2:7559601510075190200:8553]
2025-10-10T14:34:45.842772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:45.842793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:45.842800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.842805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.842808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.842827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:45.842839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:45.842848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:45.842934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.842943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.842945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.842948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:45.843018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:45.843026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.843038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:45.843053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:45.843075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:45.843103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601510075190195:8553]
2025-10-10T14:34:45.843106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601510075190195:8553]
2025-10-10T14:34:45.843108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601510075190195:8553]
2025-10-10T14:34:45.843124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:45.843142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857413841:2438], now have 1 active actors on pipe
2025-10-10T14:34:45.843153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857414065:8927], now have 1 active actors on pipe
2025-10-10T14:34:45.843162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:45.843178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:45.843182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:45.843186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:45.843186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:45.843188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:45.843214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601510075190195:8553]
2025-10-10T14:34:45.843225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:45.843233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:45.843356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1445
2025-10-10T14:34:45.843373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1445
2025-10-10T14:34:45.843576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.843588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.843623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:45.843639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:45.843656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:45.843658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:45.843672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:45.843690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:45.843706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.843915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.843924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.843941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:45.844224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1446 partition: 0 MaxSeqNo: 40 sessionId: src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0
2025-10-10T14:34:45.844664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2bd7847-25605c9b-1ab14921-585e9603_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:45.847550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0] Write session: try to update token
2025-10-10T14:34:45.847582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:45.856231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:45.856250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:45.856262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601510075190195:8553]
2025-10-10T14:34:45.856319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:45.856526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:45.856682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:45.856835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:45.856992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:45.857218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:45.857263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:45.861489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:45.864297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId: src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:45.867314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:45.867725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:45.867572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:45.867593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:45.867639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:45.875401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:45.875419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:45.875423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:45.875425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:45.875439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601510075190195:8553]
2025-10-10T14:34:45.875443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601510075190195:8553]
2025-10-10T14:34:45.875451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601510075190195:8553]
2025-10-10T14:34:45.875521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:45.875527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:45.875530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:45.875671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:45.876421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:45.876427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:45.876432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:45.909697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601510857414122:8672]
2025-10-10T14:34:45.910020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1445, pipe: [1:7559601510857414122:8672]
2025-10-10T14:34:45.991289Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:46.010180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.010215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.010423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.010495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.010574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.010648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.010701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.010710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.010793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.010864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.010938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.011021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.011293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.011305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.011391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.011462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.011555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.011629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.011678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.011685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.011762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.011840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.011919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.011995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.012048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.012055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.012131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.012203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.012274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.012352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.012409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.012416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.012495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.012563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.012636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.012711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.012757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.012759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.012834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.012898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.012964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.013024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.013070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.013073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.013152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.013216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.013282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.015600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:46.013464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.013521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.013524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.013602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.013661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.013722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.013787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.013830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.013834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.013909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.013973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.014035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.014099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.014141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.014144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.014231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601510857414122:8672], now have 1 active actors on pipe
2025-10-10T14:34:46.015594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:46.015665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601510857414122:8672]
2025-10-10T14:34:46.015699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:46.015701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:46.015733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1446 reason: error at write: Disconnected sessionId: src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0
2025-10-10T14:34:46.015984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1446 sessionId: src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0 is DEAD
2025-10-10T14:34:46.016368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:46.016377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0] Write session will restart in 0.005448s
2025-10-10T14:34:46.016402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0] Write session: Do CDS request
2025-10-10T14:34:46.016408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:46.022994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.023031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:46.023048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1447
2025-10-10T14:34:46.023252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.023297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:46.023303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:46.023309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:46.023847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1447 sessionId:  describe result for acl check
2025-10-10T14:34:46.023889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:46.023895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:46.023897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:46.023904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601515152381430:8931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:46.024736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601515152381430:8931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:46.029729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601515152381430:8931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:46.040380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601515152381430:8931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:46.040401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601515152381430:8931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:46.040406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601515152381430:8931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:46.040415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:46.063952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:46.068087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:46.068380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:46.068387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:46.068401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:46.068485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:46.068532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601514370157791:8557]
2025-10-10T14:34:46.069185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:46.069806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:46.069868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:46.070223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:46.070287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.070289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.070290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.070292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.070293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.070295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.070296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.070297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.070299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.070300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.070301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.070302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.070304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.070311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.070341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.070346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.070350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.070354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.070358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.070361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.070365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.070369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.070373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.070377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.070381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.070385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.070393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.070403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.070410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.070418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.070423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.070439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.070444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.070450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.070455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.070460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.070467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.070472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.070478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.070483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.070488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.070492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.070497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.070502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.070506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.070513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.070518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.070523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.070527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.070532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.070537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.070542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.070583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:46.074420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:46.074937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:46.075068Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:46.075081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:46.075085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:46.075092Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1446 [2:7559601514370157791:8557]
2025-10-10T14:34:46.075108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:46.075130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:46.075139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.075142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.075145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.075168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:46.075184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:46.075192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:46.075268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.075276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.075279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.075281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:46.075362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:46.075370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.075386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.075397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.075412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:46.075439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601514370157786:8557]
2025-10-10T14:34:46.075441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601514370157786:8557]
2025-10-10T14:34:46.075443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601514370157786:8557]
2025-10-10T14:34:46.075458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:46.075473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:46.075508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:46.075519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:46.075567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601514370157786:8557]
2025-10-10T14:34:46.075575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:46.076066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1446
2025-10-10T14:34:46.076072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1446
2025-10-10T14:34:46.075954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:46.075963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:46.075965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:46.075972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:46.076957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152381465:8931], now have 1 active actors on pipe
2025-10-10T14:34:46.076975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152381423:2438], now have 1 active actors on pipe
2025-10-10T14:34:46.077001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.077013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.077056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:46.077079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.077085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.077087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:46.077102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.077120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:46.077140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.081323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.081363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.081405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.081523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1447 partition: 0 MaxSeqNo: 40 sessionId: src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0
2025-10-10T14:34:46.085732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50e0d0ef-95304947-3c6f15d9-ecdc13b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:46.088726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0] Write session: try to update token
2025-10-10T14:34:46.088749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:46.108697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:46.108719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:46.108723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:46.108725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:46.108735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601514370157786:8557]
2025-10-10T14:34:46.108740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601514370157786:8557]
2025-10-10T14:34:46.108744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601514370157786:8557]
2025-10-10T14:34:46.108803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:46.108811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.108814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:46.108970Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:46.113542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:46.113566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:46.113571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:46.115152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId: src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:46.121845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:46.121944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601515152381719:8672]
2025-10-10T14:34:46.122149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1446, pipe: [1:7559601515152381719:8672]
2025-10-10T14:34:46.228019Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:46.228382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.228392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.228418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152381719:8672], now have 1 active actors on pipe
2025-10-10T14:34:46.228733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:46.229934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:46.229947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0] Write session will restart in 0.008563s
2025-10-10T14:34:46.229973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0] Write session: Do CDS request
2025-10-10T14:34:46.229979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:46.229142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601515152381719:8672]
2025-10-10T14:34:46.229176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:46.229179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:46.229240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1447 reason: error at write: Disconnected sessionId: src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0
2025-10-10T14:34:46.229457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1447 sessionId: src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0 is DEAD
2025-10-10T14:34:46.229686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:46.240061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.240193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:46.240208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1448
2025-10-10T14:34:46.240436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.240475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:46.240482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:46.240486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:46.241396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1448 sessionId:  describe result for acl check
2025-10-10T14:34:46.241447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:46.241449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:46.241451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:46.241459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601515152381768:8944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:46.242080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601515152381768:8944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:46.252998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601515152381768:8944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:46.259535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601515152381768:8944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:46.259554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601515152381768:8944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:46.259558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601515152381768:8944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:46.259568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:46.262501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:46.265966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:46.266230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:46.266235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:46.266249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:46.266312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:46.266357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601514370158097:8570]
2025-10-10T14:34:46.266990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:46.267389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:46.267460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:46.267831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:46.267922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.267928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.267930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.267931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.267933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.267934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.267936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.267937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.267939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.267940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.267942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.267943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.267944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.267952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.267964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.267967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.267973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.267976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.267981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.267985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.267988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.267992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.267996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.268000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.268003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.268007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.268016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.268025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.268032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.268037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.268043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.268048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.268055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.268060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.268065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.268085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.268096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.268101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.268106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.268111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.268116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.268120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.268124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.268129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.268133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.268138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.268143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.268147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.268152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.268157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.268162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.268167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.268208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:46.274081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:46.274580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:46.274593Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:46.274595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:46.274599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:46.274607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1447 [2:7559601514370158097:8570]
2025-10-10T14:34:46.274622Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:46.274649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:46.274652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.274656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.274658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.274680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:46.274691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:46.274700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:46.274751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.274756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.274758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.274760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:46.274819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:46.274825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.274833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.274841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.274854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:46.274872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601514370158092:8570]
2025-10-10T14:34:46.274878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601514370158092:8570]
2025-10-10T14:34:46.274880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601514370158092:8570]
2025-10-10T14:34:46.274886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:46.274897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:46.274898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:46.274901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:46.274903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:46.274910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:46.274913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:46.274923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152381993:8944], now have 1 active actors on pipe
2025-10-10T14:34:46.274930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152381732:2438], now have 1 active actors on pipe
2025-10-10T14:34:46.274959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601514370158092:8570]
2025-10-10T14:34:46.274971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:46.274980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:46.275003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1447
2025-10-10T14:34:46.275009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1447
2025-10-10T14:34:46.275510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.275525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.275565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:46.275573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.275576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.275578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:46.275588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.275599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:46.275614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.275769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.275774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.275787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.275860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1448 partition: 0 MaxSeqNo: 40 sessionId: src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0
2025-10-10T14:34:46.276323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5cb2943-bf0e1526-886cab0-931c0c48_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:46.279139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0] Write session: try to update token
2025-10-10T14:34:46.279158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:46.294558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId: src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:46.297354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:46.297370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:46.297382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601514370158092:8570]
2025-10-10T14:34:46.297435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:46.297434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:46.297514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:46.297607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:46.297750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:46.297890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:46.298040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:46.298340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:46.298394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.298410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.298430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:46.298472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:46.298563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:46.313685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:46.313704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:46.313707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:46.313710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:46.313724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601514370158092:8570]
2025-10-10T14:34:46.313728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601514370158092:8570]
2025-10-10T14:34:46.313732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601514370158092:8570]
2025-10-10T14:34:46.313789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:46.313790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:46.313797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.313798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:46.313800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:46.313802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:46.313960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:46.326486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601515152382019:8672]
2025-10-10T14:34:46.326799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1447, pipe: [1:7559601515152382019:8672]
2025-10-10T14:34:46.430692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:46.438945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.438971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.439154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.439217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.439285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.439349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.439396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.439409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.439492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.439555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.439624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.439694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.439741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.439746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.439815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.439877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.439946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.440012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.440055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.440064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.440246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.440310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.440376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.440444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.440492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.440500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.440567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.440626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.440697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.440761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.440805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.440812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.440878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.440938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.441006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.441067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.441124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.441131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.441199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.441269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.441345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.441410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.441456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.441463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.441536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.441603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.441667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.441734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.441783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.441793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.441865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.441929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.441998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.442068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.442113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.442119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.442189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:46.442258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:46.442325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:46.442389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:46.442437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:46.442445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:46.442503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382019:8672], now have 1 active actors on pipe
2025-10-10T14:34:46.442756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:46.442769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:46.442804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1448 reason: error at write: Disconnected sessionId: src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0
2025-10-10T14:34:46.443021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1448 sessionId: src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0 is DEAD
2025-10-10T14:34:46.443136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:46.443148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0] Write session will restart in 0.009584s
2025-10-10T14:34:46.443174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0] Write session: Do CDS request
2025-10-10T14:34:46.443181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:46.443214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:46.443260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601515152382019:8672]
2025-10-10T14:34:46.443745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:46.453998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.454535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:46.454551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1449
2025-10-10T14:34:46.454794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.454833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:46.454840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:46.454844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:46.455262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1449 sessionId:  describe result for acl check
2025-10-10T14:34:46.455291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:46.455293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:46.455294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:46.455300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601515152382073:8950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:46.455887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601515152382073:8950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:46.459121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601515152382073:8950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:46.462892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601515152382073:8950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:46.462909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601515152382073:8950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:46.462914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601515152382073:8950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:46.462924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:46.466833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:46.470296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:46.470563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:46.470580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:46.470598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:46.470678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:46.470733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601514370158379:8572]
2025-10-10T14:34:46.471410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:46.471831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:46.471919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:46.472312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:46.472388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.472395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.472396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.472397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.472399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.472400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.472401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.472402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.472404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.472405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.472406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.472407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.472409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.472415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.472430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.472434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.472439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.472443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.472448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.472452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.472457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.472461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.472466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.472470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.472474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.472478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.472487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.472497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.472504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.472509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.472516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.472521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.472526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.472531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.472535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.472541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.472545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.472550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.472555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.472561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.472566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.472572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.472576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.472580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.472585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.472590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.472595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.472600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.472634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.472647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.472651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.472656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.472697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:46.477037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:46.477651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:46.477663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:46.477666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:46.477671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:46.477677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1448 [2:7559601514370158379:8572]
2025-10-10T14:34:46.477692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:46.477712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:46.477720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.477724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.477727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.477746Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:46.477759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:46.477771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:46.477836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.477843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.477845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.477848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:46.477920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:46.477927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.477940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.477958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.477976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:46.478004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382236:8950], now have 1 active actors on pipe
2025-10-10T14:34:46.478013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382021:2438], now have 1 active actors on pipe
2025-10-10T14:34:46.478021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601514370158374:8572]
2025-10-10T14:34:46.478028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601514370158374:8572]
2025-10-10T14:34:46.478031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601514370158374:8572]
2025-10-10T14:34:46.478044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:46.478058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:46.478061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:46.478072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:46.478073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:46.478091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:46.478100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:46.478134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601514370158374:8572]
2025-10-10T14:34:46.478146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:46.478153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:46.478167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1448
2025-10-10T14:34:46.478202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1448
2025-10-10T14:34:46.478300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.478310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.478359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2ad146-c894d3e8-351522a8-dda28421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:46.478372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.478376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.478379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:46.478391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.478402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:46.478417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.478662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.478671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.478687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.478775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1449 partition: 0 MaxSeqNo: 40 sessionId: src_id|f2ad146-c894d3e8-351522a8-dda28421_0
2025-10-10T14:34:46.479181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af9de66b-d10cfea0-65a7b665-82894c9e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f2ad146-c894d3e8-351522a8-dda28421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:46.481963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ad146-c894d3e8-351522a8-dda28421_0] Write session: try to update token
2025-10-10T14:34:46.481983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ad146-c894d3e8-351522a8-dda28421_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:46.498692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:46.498711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:46.498714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:46.498716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:46.498728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601514370158374:8572]
2025-10-10T14:34:46.498733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601514370158374:8572]
2025-10-10T14:34:46.498737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601514370158374:8572]
2025-10-10T14:34:46.498790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:46.498793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:46.498798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:46.498801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.498803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:46.498804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:46.498958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:46.500199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId: src_id|f2ad146-c894d3e8-351522a8-dda28421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:46.503257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:46.543578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601515152382306:8672]
2025-10-10T14:34:46.543876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1448, pipe: [1:7559601515152382306:8672]
2025-10-10T14:34:46.617811Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:46.618622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.618638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.618688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382306:8672], now have 1 active actors on pipe
2025-10-10T14:34:46.618972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601515152382306:8672]
2025-10-10T14:34:46.619007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:46.619012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:46.619011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:46.619015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:46.619088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1449 reason: error at write: Disconnected sessionId: src_id|f2ad146-c894d3e8-351522a8-dda28421_0
2025-10-10T14:34:46.619314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1449 sessionId: src_id|f2ad146-c894d3e8-351522a8-dda28421_0 is DEAD
2025-10-10T14:34:46.619466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ad146-c894d3e8-351522a8-dda28421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:46.619486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ad146-c894d3e8-351522a8-dda28421_0] Write session will restart in 0.006732s
2025-10-10T14:34:46.619520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ad146-c894d3e8-351522a8-dda28421_0] Write session: Do CDS request
2025-10-10T14:34:46.619525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ad146-c894d3e8-351522a8-dda28421_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:46.627947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ad146-c894d3e8-351522a8-dda28421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.628027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:46.628042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1450
2025-10-10T14:34:46.628197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.628245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:46.628264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:46.628272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:46.628771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1450 sessionId:  describe result for acl check
2025-10-10T14:34:46.628811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:46.628813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:46.628815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:46.628822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601515152382341:8955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:46.629411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601515152382341:8955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:46.632073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601515152382341:8955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:46.636694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601515152382341:8955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:46.636712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601515152382341:8955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:46.636716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601515152382341:8955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:46.636726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:46.645474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:46.652089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:46.652377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:46.652389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:46.652403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:46.652474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:46.652538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601514370158674:8575]
2025-10-10T14:34:46.653150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:46.653583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:46.653653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:46.654022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:46.654095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.654097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.654099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.654100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.654102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.654103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.654105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.654106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.654107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.654109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.654110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.654111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.654113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.654119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.654134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.654139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.654143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.654147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.654151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.654156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.654160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.654164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.654168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.654171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.654175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.654180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.654189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.654198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.654205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.654211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.654216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.654221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.654228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.654234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.654240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.654245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.654249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.654255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.654261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.654266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.654271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.654276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.654280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.654285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.654289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.654294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.654299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.654305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.654310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.654315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.654321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.654328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.654383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:46.657269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:46.658353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:46.658370Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:46.658372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:46.658376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:46.658383Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1449 [2:7559601514370158674:8575]
2025-10-10T14:34:46.658397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:46.658418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:46.658421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.658425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.658427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.658446Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:46.658458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:46.658466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:46.658537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.658546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.658548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.658550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:46.658628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:46.658638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.658652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.658663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.658680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:46.658704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382322:2438], now have 1 active actors on pipe
2025-10-10T14:34:46.658708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382458:8955], now have 1 active actors on pipe
2025-10-10T14:34:46.658716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601514370158669:8575]
2025-10-10T14:34:46.658719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601514370158669:8575]
2025-10-10T14:34:46.658721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601514370158669:8575]
2025-10-10T14:34:46.658741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:46.658757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:46.658764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:46.658771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:46.658775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:46.658775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:46.658778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:46.658810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601514370158669:8575]
2025-10-10T14:34:46.658818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:46.658823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:46.658842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1449
2025-10-10T14:34:46.658880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1449
2025-10-10T14:34:46.658915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.658926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.658958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:46.658971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.658975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.658978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:46.658989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.659005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:46.659023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.659193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.659206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.659233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.659342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1450 partition: 0 MaxSeqNo: 40 sessionId: src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0
2025-10-10T14:34:46.659810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ad146-c894d3e8-351522a8-dda28421_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:46.662586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0] Write session: try to update token
2025-10-10T14:34:46.662607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:46.678281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:46.678303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:46.678307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:46.678309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:46.678319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601514370158669:8575]
2025-10-10T14:34:46.678323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601514370158669:8575]
2025-10-10T14:34:46.678328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601514370158669:8575]
2025-10-10T14:34:46.678370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:46.678376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:46.678378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:46.678381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:46.678386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.678389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:46.678734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:46.682570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId: src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:46.685245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:46.719150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601515152382617:8672]
2025-10-10T14:34:46.719525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1449, pipe: [1:7559601515152382617:8672]
2025-10-10T14:34:46.787709Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:46.788204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.788224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.788271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382617:8672], now have 1 active actors on pipe
2025-10-10T14:34:46.788471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:46.788522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601515152382617:8672]
2025-10-10T14:34:46.788523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:46.788558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:46.788634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1450 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0
2025-10-10T14:34:46.788827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1450 sessionId: src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0 is DEAD
2025-10-10T14:34:46.789024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:46.789036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0] Write session will restart in 0.009647s
2025-10-10T14:34:46.789060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0] Write session: Do CDS request
2025-10-10T14:34:46.789067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:46.799947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.799982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:46.799998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1451
2025-10-10T14:34:46.800156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.800191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:46.800201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:46.800205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:46.800642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1451 sessionId:  describe result for acl check
2025-10-10T14:34:46.800680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:46.800687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:46.800689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:46.800694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601515152382688:8960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:46.801251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601515152382688:8960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:46.804159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601515152382688:8960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:46.807013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601515152382688:8960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:46.807029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601515152382688:8960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:46.807033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601515152382688:8960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:46.807041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:46.808875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:46.811446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:46.811677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:46.811688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:46.811700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:46.811756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:46.811796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601514370158960:8578]
2025-10-10T14:34:46.812351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:46.812665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:46.812720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:46.813045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:46.813123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.813131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.813132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.813133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.813135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.813136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.813137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.813138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.813139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.813140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.813141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.813142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.813144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.813150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.813164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.813168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.813173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.813177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.813181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.813185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.813189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.813193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.813197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.813201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.813204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.813208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.813219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.813227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.813235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.813240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.813245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.813250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.813254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.813260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.813265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.813269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.813273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.813285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.813289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.813295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.813299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.813305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.813309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.813313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.813317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.813321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.813347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.813356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.813361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.813366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.813373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.813378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.813421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:46.815941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:46.816394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:46.816406Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:46.816409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:46.816412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:46.816419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1450 [2:7559601514370158960:8578]
2025-10-10T14:34:46.816432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:46.816451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:46.816454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.816458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.816460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.816478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:46.816486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:46.816497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:46.816561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.816569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.816571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.816574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:46.816643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:46.816650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.816661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.816676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.816693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:46.816719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382893:8960], now have 1 active actors on pipe
2025-10-10T14:34:46.816728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382618:2438], now have 1 active actors on pipe
2025-10-10T14:34:46.816735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601514370158955:8578]
2025-10-10T14:34:46.816738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601514370158955:8578]
2025-10-10T14:34:46.816740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601514370158955:8578]
2025-10-10T14:34:46.816755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:46.816774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:46.816785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:46.816794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:46.816796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:46.816797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:46.816799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:46.816821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601514370158955:8578]
2025-10-10T14:34:46.816826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:46.816796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1450
2025-10-10T14:34:46.816808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1450
2025-10-10T14:34:46.816838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:46.817210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.817226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.817268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:46.817280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.817283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.817285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:46.817297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.817315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:46.817362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.817560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.817569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.817584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.817725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1451 partition: 0 MaxSeqNo: 40 sessionId: src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0
2025-10-10T14:34:46.818123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bd0495-d3ddf93a-80be0430-f36b6ab7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:46.821108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0] Write session: try to update token
2025-10-10T14:34:46.821127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:46.835892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:46.835913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:46.835916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:46.835918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:46.835928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601514370158955:8578]
2025-10-10T14:34:46.835932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601514370158955:8578]
2025-10-10T14:34:46.835937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601514370158955:8578]
2025-10-10T14:34:46.835990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:46.835998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.836001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:46.835993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:46.836012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:46.836017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:46.836150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:46.836607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId: src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:46.839015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:46.888640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601515152382907:8672]
2025-10-10T14:34:46.888959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1450, pipe: [1:7559601515152382907:8672]
2025-10-10T14:34:46.948263Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:46.948588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.948604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.948654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382907:8672], now have 1 active actors on pipe
2025-10-10T14:34:46.948904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:46.948949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:46.948964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:46.949035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1451 reason: error at write: Disconnected sessionId: src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0
2025-10-10T14:34:46.949091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601515152382907:8672]
2025-10-10T14:34:46.949218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:46.949242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1451 sessionId: src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0 is DEAD
2025-10-10T14:34:46.949419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:46.949430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0] Write session will restart in 0.007196s
2025-10-10T14:34:46.949458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0] Write session: Do CDS request
2025-10-10T14:34:46.949464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:46.957949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.958043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:46.958057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1452
2025-10-10T14:34:46.958195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:46.958232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:46.958242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:46.958246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:46.958638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1452 sessionId:  describe result for acl check
2025-10-10T14:34:46.958689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:46.958695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:46.958697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:46.958703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601515152382929:8964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:46.959231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601515152382929:8964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:46.963050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601515152382929:8964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:46.967003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601515152382929:8964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:46.967019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601515152382929:8964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:46.967022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601515152382929:8964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:46.967031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:46.971407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:46.974452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:46.974701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:46.974713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:46.974725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:46.974779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:46.974840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601514370159245:8580]
2025-10-10T14:34:46.975503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:46.975794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:46.975838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:46.976164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:46.976219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.976225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.976226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.976227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.976229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.976230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.976231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.976233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.976234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.976235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.976237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.976238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.976239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.976245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.976259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.976264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.976268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.976273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.976277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.976282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.976286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.976290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.976295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.976299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.976304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.976308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.976315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.976324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:46.976331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.976342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:46.976347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.976357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:46.976362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.976367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:46.976377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.976383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:46.976389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.976399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:46.976404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.976414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:46.976419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.976429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:46.976434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.976444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:46.976448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.976454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:46.976458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.976464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.976468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.976474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.976479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.976486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.976530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:46.978972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:46.979346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:46.979360Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:46.979363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:46.979367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:46.979373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1451 [2:7559601514370159245:8580]
2025-10-10T14:34:46.979401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:46.979425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:46.979428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.979431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.979433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.979450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:46.979459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:46.979479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:46.979544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.979551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.979554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.979556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:46.979631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:46.979638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:46.979649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:46.979666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:46.979686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:46.979713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152382908:2438], now have 1 active actors on pipe
2025-10-10T14:34:46.979725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601515152383109:8964], now have 1 active actors on pipe
2025-10-10T14:34:46.979733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601514370159240:8580]
2025-10-10T14:34:46.979735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601514370159240:8580]
2025-10-10T14:34:46.979737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601514370159240:8580]
2025-10-10T14:34:46.979752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:46.979766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:46.979776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:46.979781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:46.979781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:46.979783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:46.979784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:46.979801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1451
2025-10-10T14:34:46.979827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1451
2025-10-10T14:34:46.979811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601514370159240:8580]
2025-10-10T14:34:46.979824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:46.979831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:46.979858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.979863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.979898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:46.979906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:46.979910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:46.979913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:46.979925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:46.979940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:46.979959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.980118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:46.980127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:46.980143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:46.980241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1452 partition: 0 MaxSeqNo: 40 sessionId: src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0
2025-10-10T14:34:46.980707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cc77d5-8f9b08f4-62e9ee14-961c7e9a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:46.983810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0] Write session: try to update token
2025-10-10T14:34:46.983831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:46.998339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:46.998358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:46.998371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601514370159240:8580]
2025-10-10T14:34:46.998435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:46.998434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:46.998979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:46.999485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:46.999642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:46.999788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:46.999990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:47.000041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:47.003016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId: src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:47.005651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:47.006384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.006404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.006450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:47.006558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:47.010932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:47.010946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:47.010950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:47.010952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:47.010963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601514370159240:8580]
2025-10-10T14:34:47.010966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601514370159240:8580]
2025-10-10T14:34:47.010970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601514370159240:8580]
2025-10-10T14:34:47.011019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:47.011018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:47.011025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:47.011027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.011029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:47.011030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:47.011173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:47.048904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601519447350493:8672]
2025-10-10T14:34:47.049250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1451, pipe: [1:7559601519447350493:8672]
2025-10-10T14:34:47.124181Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:47.132241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.132267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.132445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.132519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.132589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.132662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.132712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.132720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.132794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.132863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.132934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.133008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.133056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.133062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.133181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.133285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.133367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.133436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.133487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.133490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.133644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.133715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.133826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.133931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.134066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.134073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.134145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.134209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.134278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.134344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.134485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.134491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.134564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.134630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.134701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.134771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.134822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.134831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.134903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.134971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.135041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.135109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.135157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.135163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.135233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.135300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.135367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.135438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.135496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.135503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.135575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.135640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.135712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.135782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.135829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.135836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.135904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:47.135971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:47.136037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:47.136103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:47.136162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:47.136170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:47.136228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447350493:8672], now have 1 active actors on pipe
2025-10-10T14:34:47.136419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:47.136456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601519447350493:8672]
2025-10-10T14:34:47.136485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:47.136488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:47.136516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1452 reason: error at write: Disconnected sessionId: src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0
2025-10-10T14:34:47.136726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1452 sessionId: src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0 is DEAD
2025-10-10T14:34:47.136877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:47.136902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0] Write session will restart in 0.009662s
2025-10-10T14:34:47.136927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0] Write session: Do CDS request
2025-10-10T14:34:47.136934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:47.137469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:47.147879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.147976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:47.147991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1453
2025-10-10T14:34:47.148136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.148181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:47.148191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:47.148195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:47.148771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1453 sessionId:  describe result for acl check
2025-10-10T14:34:47.148809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:47.148816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:47.148819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:47.148825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601519447350565:8968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:47.149425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601519447350565:8968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:47.158631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:47.159808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601519447350565:8968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:47.162235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:47.162489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:47.162503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:47.162515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:47.162581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:47.162624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601518665126857:8593]
2025-10-10T14:34:47.162616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601519447350565:8968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:47.162633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601519447350565:8968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:47.162636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601519447350565:8968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:47.162645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:47.163248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:47.163541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:47.163588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:47.163911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:47.163965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.163972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.163974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.163975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.163976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.163977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.163979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.163980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.163981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.163982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.163983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.163984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.163985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.163991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.164004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.164008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.164012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.164016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.164020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.164024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.164028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.164031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.164036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.164040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.164043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.164047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.164054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.164063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.164069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.164080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.164085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.164090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.164094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.164099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.164103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.164108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.164113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.164118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.164122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.164127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.164131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.164136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.164147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.164153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.164157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.164163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.164167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.164173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.164181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.164187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.164191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.164196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.164236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:47.166808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:47.167391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:47.167410Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:47.167412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:47.167416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:47.167423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1452 [2:7559601518665126857:8593]
2025-10-10T14:34:47.167436Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:47.167493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:47.167503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.167507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.167510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.167529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:47.167537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:47.167545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:47.167609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.167619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.167621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.167624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:47.167694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:47.167702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.167715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.167731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.167756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:47.167782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447350782:8968], now have 1 active actors on pipe
2025-10-10T14:34:47.167791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447350499:2438], now have 1 active actors on pipe
2025-10-10T14:34:47.167799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601518665126852:8593]
2025-10-10T14:34:47.167801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601518665126852:8593]
2025-10-10T14:34:47.167804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601518665126852:8593]
2025-10-10T14:34:47.167816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:47.167831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:47.167832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:47.167835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:47.167836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:47.167854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:47.167857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:47.167834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1452
2025-10-10T14:34:47.167876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1452
2025-10-10T14:34:47.167887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601518665126852:8593]
2025-10-10T14:34:47.167902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:47.167908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:47.168066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.168077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.168113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:47.168126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.168131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.168138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:47.168149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.168164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:47.168187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.168518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.168531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.168553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.168655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1453 partition: 0 MaxSeqNo: 40 sessionId: src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0
2025-10-10T14:34:47.169061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532fc312-b551c8e5-955b12c7-e81a24e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:47.171780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0] Write session: try to update token
2025-10-10T14:34:47.171800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:47.187434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:47.187469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:47.187473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:47.187475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:47.187499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601518665126852:8593]
2025-10-10T14:34:47.187504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601518665126852:8593]
2025-10-10T14:34:47.187508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601518665126852:8593]
2025-10-10T14:34:47.187555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:47.187559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:47.187566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.187569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:47.187571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:47.187575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:47.187706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:47.193867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId: src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:47.196501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:47.236811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601519447350809:8672]
2025-10-10T14:34:47.237119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1452, pipe: [1:7559601519447350809:8672]
2025-10-10T14:34:47.301791Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:47.302411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.302428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.302453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447350809:8672], now have 1 active actors on pipe
2025-10-10T14:34:47.302666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:47.302713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601519447350809:8672]
2025-10-10T14:34:47.302729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:47.302732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:47.302805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1453 reason: error at write: Disconnected sessionId: src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0
2025-10-10T14:34:47.303006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1453 sessionId: src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0 is DEAD
2025-10-10T14:34:47.303003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:47.303166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:47.303177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0] Write session will restart in 0.008570s
2025-10-10T14:34:47.303203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0] Write session: Do CDS request
2025-10-10T14:34:47.303213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:47.312957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.313081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:47.313099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1454
2025-10-10T14:34:47.313228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.313258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:47.313265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:47.313269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:47.313770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1454 sessionId:  describe result for acl check
2025-10-10T14:34:47.313810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:47.313818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:47.313819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:47.313825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601519447350845:8981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:47.314289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601519447350845:8981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:47.317448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601519447350845:8981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:47.323123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601519447350845:8981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:47.323141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601519447350845:8981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:47.323145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601519447350845:8981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:47.323156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:47.325118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:47.328254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:47.328495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:47.328505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:47.328518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:47.328578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:47.328627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601518665127152:8597]
2025-10-10T14:34:47.329258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:47.329674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:47.329738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:47.330059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:47.330126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.330132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.330133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.330135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.330136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.330138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.330139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.330140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.330142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.330143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.330144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.330146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.330147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.330154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.330168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.330172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.330177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.330181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.330185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.330189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.330194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.330198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.330203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.330207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.330211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.330216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.330223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.330232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.330240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.330246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.330258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.330264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.330269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.330275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.330280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.330285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.330291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.330296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.330302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.330307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.330312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.330318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.330323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.330329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.330335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.330340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.330345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.330354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.330359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.330364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.330372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.330377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.330434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:47.333712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:47.334092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:47.334097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:47.334100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:47.334104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:47.334112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1453 [2:7559601518665127152:8597]
2025-10-10T14:34:47.334129Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:47.334151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:47.334156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.334160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.334163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.334186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:47.334195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:47.334203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:47.334271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.334274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.334276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.334279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:47.334361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:47.334372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.334384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.334395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.334414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:47.334439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351088:8981], now have 1 active actors on pipe
2025-10-10T14:34:47.334449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447350812:2438], now have 1 active actors on pipe
2025-10-10T14:34:47.334457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601518665127147:8597]
2025-10-10T14:34:47.334460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601518665127147:8597]
2025-10-10T14:34:47.334462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601518665127147:8597]
2025-10-10T14:34:47.334478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:47.334502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:47.334507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:47.334511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:47.334513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:47.334524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:47.334527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:47.334565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601518665127147:8597]
2025-10-10T14:34:47.334574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:47.334577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:47.334538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1453
2025-10-10T14:34:47.334591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.334602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.334569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1453
2025-10-10T14:34:47.334665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e574e269-5003d895-524b9dec-e4cbac57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:47.334680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.334685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.334688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:47.334702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.334715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:47.334736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.335047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.335055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.335077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.335186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1454 partition: 0 MaxSeqNo: 40 sessionId: src_id|e574e269-5003d895-524b9dec-e4cbac57_0
2025-10-10T14:34:47.335611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7048e0f2-341f8b79-71bf1272-fa972e20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e574e269-5003d895-524b9dec-e4cbac57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:47.338398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e574e269-5003d895-524b9dec-e4cbac57_0] Write session: try to update token
2025-10-10T14:34:47.338420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e574e269-5003d895-524b9dec-e4cbac57_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:47.357104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:47.357129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:47.357133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:47.357135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:47.357148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601518665127147:8597]
2025-10-10T14:34:47.357157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601518665127147:8597]
2025-10-10T14:34:47.357160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601518665127147:8597]
2025-10-10T14:34:47.357215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:47.357223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.357223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:47.357226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:47.357230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:47.357234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:47.357390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:47.359682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId: src_id|e574e269-5003d895-524b9dec-e4cbac57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:47.362373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:47.402727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601519447351102:8672]
2025-10-10T14:34:47.403025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1453, pipe: [1:7559601519447351102:8672]
2025-10-10T14:34:47.472379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:47.472698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.472716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.472765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351102:8672], now have 1 active actors on pipe
2025-10-10T14:34:47.473014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:47.473027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:47.473037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:47.473087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601519447351102:8672]
2025-10-10T14:34:47.473102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1454 reason: error at write: Disconnected sessionId: src_id|e574e269-5003d895-524b9dec-e4cbac57_0
2025-10-10T14:34:47.473535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574e269-5003d895-524b9dec-e4cbac57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:47.473544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574e269-5003d895-524b9dec-e4cbac57_0] Write session will restart in 0.009226s
2025-10-10T14:34:47.473347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1454 sessionId: src_id|e574e269-5003d895-524b9dec-e4cbac57_0 is DEAD
2025-10-10T14:34:47.473583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574e269-5003d895-524b9dec-e4cbac57_0] Write session: Do CDS request
2025-10-10T14:34:47.473083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:47.473592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574e269-5003d895-524b9dec-e4cbac57_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:47.483984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e574e269-5003d895-524b9dec-e4cbac57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.484034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:47.484050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1455
2025-10-10T14:34:47.484204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.484241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:47.484254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:47.484258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:47.484739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1455 sessionId:  describe result for acl check
2025-10-10T14:34:47.484775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:47.484782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:47.484787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:47.484794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601519447351122:8985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:47.485396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601519447351122:8985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:47.489104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601519447351122:8985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:47.493733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601519447351122:8985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:47.493749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601519447351122:8985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:47.493753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601519447351122:8985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:47.493762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:47.497782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:47.500906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:47.501138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:47.501151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:47.501163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:47.501224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:47.501267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601518665127440:8599]
2025-10-10T14:34:47.501971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:47.502320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:47.502379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:47.502724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:47.502788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.502795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.502796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.502798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.502799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.502800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.502802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.502803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.502805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.502806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.502808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.502809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.502810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.502817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.502831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.502836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.502841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.502845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.502850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.502854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.502859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.502863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.502868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.502873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.502878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.502882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.502891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.502900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.502907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.502913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.502918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.502927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.502932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.502940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.502945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.502955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.502960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.502968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.502975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.502986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.502991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.503002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.503007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.503013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.503020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.503026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.503036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.503042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.503050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.503056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.503061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.503071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.503116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:47.505643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:47.505988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:47.506000Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:47.506004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:47.506008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:47.506014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1454 [2:7559601518665127440:8599]
2025-10-10T14:34:47.506027Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:47.506050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:47.506053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.506057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.506059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.506077Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:47.506085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:47.506094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:47.506156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.506165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.506167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.506170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:47.506243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:47.506252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.506265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.506279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.506303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:47.506330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351311:8985], now have 1 active actors on pipe
2025-10-10T14:34:47.506335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351104:2438], now have 1 active actors on pipe
2025-10-10T14:34:47.506343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601518665127435:8599]
2025-10-10T14:34:47.506350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601518665127435:8599]
2025-10-10T14:34:47.506353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601518665127435:8599]
2025-10-10T14:34:47.506366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:47.506385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:47.506390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:47.506394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:47.506396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:47.506404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:47.506407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:47.506391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1454
2025-10-10T14:34:47.506434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601518665127435:8599]
2025-10-10T14:34:47.506445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:47.506411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1454
2025-10-10T14:34:47.506451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:47.506464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.506473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.506530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:47.506543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.506547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.506550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:47.506561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.506572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:47.506600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.506789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.506798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.506815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.506926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1455 partition: 0 MaxSeqNo: 40 sessionId: src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0
2025-10-10T14:34:47.507325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574e269-5003d895-524b9dec-e4cbac57_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:47.510028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0] Write session: try to update token
2025-10-10T14:34:47.510048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:47.526444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:47.526465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:47.526469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:47.526471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:47.526483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601518665127435:8599]
2025-10-10T14:34:47.526488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601518665127435:8599]
2025-10-10T14:34:47.526492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601518665127435:8599]
2025-10-10T14:34:47.526544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:47.526549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:47.526553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.526557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:47.526558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:47.526562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:47.526744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:47.526842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId: src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:47.529736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:47.573249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601519447351396:8672]
2025-10-10T14:34:47.573787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1454, pipe: [1:7559601519447351396:8672]
2025-10-10T14:34:47.642517Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:47.643332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.643353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.643420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351396:8672], now have 1 active actors on pipe
2025-10-10T14:34:47.643677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:47.643691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:47.643754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1455 reason: error at write: Disconnected sessionId: src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0
2025-10-10T14:34:47.644003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1455 sessionId: src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0 is DEAD
2025-10-10T14:34:47.644042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601519447351396:8672]
2025-10-10T14:34:47.644067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:47.644185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:47.644196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0] Write session will restart in 0.009749s
2025-10-10T14:34:47.644220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0] Write session: Do CDS request
2025-10-10T14:34:47.644226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:47.644216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:47.654969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.657130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:47.657146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1456
2025-10-10T14:34:47.657364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.657417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:47.657438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:47.657448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:47.657989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1456 sessionId:  describe result for acl check
2025-10-10T14:34:47.658032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:47.658034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:47.658036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:47.658042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601519447351465:8991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:47.658653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601519447351465:8991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:47.664236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601519447351465:8991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:47.669651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:47.670090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601519447351465:8991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:47.670108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601519447351465:8991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:47.670112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601519447351465:8991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:47.670122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:47.673367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:47.673624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:47.673639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:47.673653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:47.673727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:47.673780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601518665127741:8602]
2025-10-10T14:34:47.674380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:47.674752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:47.674812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:47.675054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:47.675094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.675098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.675099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.675100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.675101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.675102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.675103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.675104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.675104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.675105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.675107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.675108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.675110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.675116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.675129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.675134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.675138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.675142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.675145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.675148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.675150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.675152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.675156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.675158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.675161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.675163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.675169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.675177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.675198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.675204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.675209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.675215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.675219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.675223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.675226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.675229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.675233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.675236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.675241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.675244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.675247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.675250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.675253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.675256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.675259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.675262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.675265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.675268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.675271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.675274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.675277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.675282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.675307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:47.677954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:47.678608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:47.678624Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:47.678627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:47.678630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:47.678637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1455 [2:7559601518665127741:8602]
2025-10-10T14:34:47.678652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:47.678672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:47.678679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.678682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.678684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.678703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:47.678717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:47.678726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:47.678787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.678794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.678796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.678799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:47.678874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:47.678883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.678895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.678910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.678930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:47.678957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351417:2438], now have 1 active actors on pipe
2025-10-10T14:34:47.678969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351699:8991], now have 1 active actors on pipe
2025-10-10T14:34:47.678979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601518665127735:8602]
2025-10-10T14:34:47.678981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601518665127735:8602]
2025-10-10T14:34:47.678984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601518665127735:8602]
2025-10-10T14:34:47.679011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:47.679026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:47.679028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:47.679040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:47.679042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:47.679045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:47.679050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:47.679082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601518665127735:8602]
2025-10-10T14:34:47.679086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:47.679095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:47.679066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1455
2025-10-10T14:34:47.679105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1455
2025-10-10T14:34:47.679173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.679186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.679227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f44312c8-130c236-64e6150d-cdb6024_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:47.679243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.679247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.679250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:47.679263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.679275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:47.679291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.679533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.679547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.679572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.679741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1456 partition: 0 MaxSeqNo: 40 sessionId: src_id|f44312c8-130c236-64e6150d-cdb6024_0
2025-10-10T14:34:47.680158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dfa0d3-ffd11441-adfcb9b-98b1683b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f44312c8-130c236-64e6150d-cdb6024_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:47.683083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44312c8-130c236-64e6150d-cdb6024_0] Write session: try to update token
2025-10-10T14:34:47.683102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44312c8-130c236-64e6150d-cdb6024_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:47.699555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:47.699573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:47.699577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:47.699579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:47.699589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601518665127735:8602]
2025-10-10T14:34:47.699593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601518665127735:8602]
2025-10-10T14:34:47.699597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601518665127735:8602]
2025-10-10T14:34:47.699648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:47.699650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:47.699657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:47.699658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.699660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:47.699662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:47.699814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:47.700298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId: src_id|f44312c8-130c236-64e6150d-cdb6024_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:47.703180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:47.744225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601519447351713:8672]
2025-10-10T14:34:47.744624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1455, pipe: [1:7559601519447351713:8672]
2025-10-10T14:34:47.816098Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:47.816825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.816840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.816888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351713:8672], now have 1 active actors on pipe
2025-10-10T14:34:47.817125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:47.817144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:47.817159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:47.817163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:47.817224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1456 reason: error at write: Disconnected sessionId: src_id|f44312c8-130c236-64e6150d-cdb6024_0
2025-10-10T14:34:47.817226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601519447351713:8672]
2025-10-10T14:34:47.817468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1456 sessionId: src_id|f44312c8-130c236-64e6150d-cdb6024_0 is DEAD
2025-10-10T14:34:47.817907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44312c8-130c236-64e6150d-cdb6024_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:47.817919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44312c8-130c236-64e6150d-cdb6024_0] Write session will restart in 0.005068s
2025-10-10T14:34:47.817945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44312c8-130c236-64e6150d-cdb6024_0] Write session: Do CDS request
2025-10-10T14:34:47.817956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44312c8-130c236-64e6150d-cdb6024_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:47.823960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44312c8-130c236-64e6150d-cdb6024_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.823997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:47.824013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1457
2025-10-10T14:34:47.824212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.824266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:47.824275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:47.824280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:47.824770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1457 sessionId:  describe result for acl check
2025-10-10T14:34:47.824808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:47.824816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:47.824818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:47.824824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601519447351728:8995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:47.825448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601519447351728:8995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:47.827810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601519447351728:8995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:47.830921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601519447351728:8995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:47.830933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601519447351728:8995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:47.830937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601519447351728:8995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:47.830946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:47.844150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:47.847230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:47.847475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:47.847490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:47.847505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:47.847584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:47.847633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601518665128033:8605]
2025-10-10T14:34:47.848290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:47.848660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:47.848719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:47.849108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:47.849165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.849172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.849173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.849174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.849175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.849177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.849178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.849179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.849189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.849190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.849191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.849193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.849194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.849200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.849214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.849218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.849222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.849226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.849230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.849234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.849238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.849242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.849247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.849251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.849254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.849258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.849266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.849285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:47.849292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.849298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:47.849303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.849308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:47.849313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.849318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:47.849324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.849342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:47.849347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.849353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:47.849359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.849364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:47.849368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.849373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:47.849378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.849383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:47.849387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.849392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:47.849397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.849402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.849412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.849416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.849420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.849426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.849468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:47.851918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:47.852264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:47.852276Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:47.852279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:47.852282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:47.852289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1456 [2:7559601518665128033:8605]
2025-10-10T14:34:47.852302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:47.852321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:47.852329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.852332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.852335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.852353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:47.852366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:47.852374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:47.852431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.852437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.852439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.852442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:47.852514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:47.852524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.852535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:47.852548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:47.852565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:47.852594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351771:8995], now have 1 active actors on pipe
2025-10-10T14:34:47.852603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447351715:2438], now have 1 active actors on pipe
2025-10-10T14:34:47.852611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601518665128028:8605]
2025-10-10T14:34:47.852617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601518665128028:8605]
2025-10-10T14:34:47.852619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601518665128028:8605]
2025-10-10T14:34:47.852634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:47.852663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:47.852665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:47.852674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:47.852676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:47.852684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:47.852687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:47.852676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1456
2025-10-10T14:34:47.852710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601518665128028:8605]
2025-10-10T14:34:47.852676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1456
2025-10-10T14:34:47.852718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:47.852727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:47.852750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.852760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.852797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78a5d738-a77b2e53-82116c52-251e21c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:47.852810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:47.852814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:47.852816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:47.852829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:47.852844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:47.852863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.853024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.853038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.853065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:47.853183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1457 partition: 0 MaxSeqNo: 40 sessionId: src_id|78a5d738-a77b2e53-82116c52-251e21c5_0
2025-10-10T14:34:47.853650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44312c8-130c236-64e6150d-cdb6024_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78a5d738-a77b2e53-82116c52-251e21c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:47.856509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a5d738-a77b2e53-82116c52-251e21c5_0] Write session: try to update token
2025-10-10T14:34:47.856532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a5d738-a77b2e53-82116c52-251e21c5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:47.872480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:47.872501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:47.872505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:47.872507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:47.872519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601518665128028:8605]
2025-10-10T14:34:47.872524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601518665128028:8605]
2025-10-10T14:34:47.872528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601518665128028:8605]
2025-10-10T14:34:47.872582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:47.872590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:47.872592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:47.872742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:47.874582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:47.874601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:47.874606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:47.873226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId: src_id|78a5d738-a77b2e53-82116c52-251e21c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:47.876162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:47.917268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601519447352008:8672]
2025-10-10T14:34:47.917675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1456, pipe: [1:7559601519447352008:8672]
2025-10-10T14:34:47.986300Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:47.986886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:47.986902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:47.986949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447352008:8672], now have 1 active actors on pipe
2025-10-10T14:34:47.987205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:47.987218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:47.987294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1457 reason: error at write: Disconnected sessionId: src_id|78a5d738-a77b2e53-82116c52-251e21c5_0
2025-10-10T14:34:47.987507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1457 sessionId: src_id|78a5d738-a77b2e53-82116c52-251e21c5_0 is DEAD
2025-10-10T14:34:47.987686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a5d738-a77b2e53-82116c52-251e21c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:47.987704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a5d738-a77b2e53-82116c52-251e21c5_0] Write session will restart in 0.005140s
2025-10-10T14:34:47.987689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:47.987676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601519447352008:8672]
2025-10-10T14:34:47.987728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a5d738-a77b2e53-82116c52-251e21c5_0] Write session: Do CDS request
2025-10-10T14:34:47.987735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a5d738-a77b2e53-82116c52-251e21c5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:47.987696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:47.993886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a5d738-a77b2e53-82116c52-251e21c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.993938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:47.993953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1458
2025-10-10T14:34:47.994114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:47.994147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:47.994153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:47.994158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:47.994608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1458 sessionId:  describe result for acl check
2025-10-10T14:34:47.994643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:47.994645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:47.994647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:47.994653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601519447352026:8999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:47.995140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601519447352026:8999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:47.997575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601519447352026:8999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:48.001788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601519447352026:8999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:48.001806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601519447352026:8999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:48.001810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601519447352026:8999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:48.001819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:48.009317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:48.012418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:48.012617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:48.012627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:48.012637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:48.012678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:48.012715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601522960095620:8607]
2025-10-10T14:34:48.013141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:48.013437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:48.013493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:48.013861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:48.013927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.013933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.013934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.013935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.013936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.013937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.013939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.013940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.013941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.013942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.013943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.013944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.013945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.013951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.013965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.013969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.013973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.013977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.013981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.013985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.013989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.013992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.013997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.014001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.014005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.014008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.014016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.014027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.014033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.014038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.014043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.014047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.014053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.014059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.014069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.014074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.014079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.014088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.014092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.014097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.014100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.014104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.014109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.014114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.014118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.014123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.014127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.014132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.014137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.014146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.014151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.014156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.014200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:48.016829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:48.017278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:48.017291Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:48.017294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:48.017299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:48.017308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1457 [2:7559601522960095620:8607]
2025-10-10T14:34:48.017323Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:48.017366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:48.017374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.017378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.017381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.017400Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:48.017407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:48.017420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:48.017482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.017489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.017491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.017494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:48.017569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:48.017579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.017592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.017602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.017626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:48.017653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601522960095615:8607]
2025-10-10T14:34:48.017658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601522960095615:8607]
2025-10-10T14:34:48.017661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601522960095615:8607]
2025-10-10T14:34:48.017673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:48.017687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:48.017691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:48.017695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:48.017700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:48.017704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:48.017707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:48.017754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601522960095615:8607]
2025-10-10T14:34:48.017757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:48.017758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:48.017768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742319438:8999], now have 1 active actors on pipe
2025-10-10T14:34:48.017781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601519447352013:2438], now have 1 active actors on pipe
2025-10-10T14:34:48.017875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1457
2025-10-10T14:34:48.017900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1457
2025-10-10T14:34:48.018057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.018068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.018101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:48.018114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.018132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.018139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:48.018151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.018163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:48.018183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.018412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.018426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.018450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.018549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1458 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0
2025-10-10T14:34:48.018959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a5d738-a77b2e53-82116c52-251e21c5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:48.021983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0] Write session: try to update token
2025-10-10T14:34:48.022004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:48.030154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:48.030175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.030188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601522960095615:8607]
2025-10-10T14:34:48.030254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:48.030583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:48.030826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.030905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:48.031149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.031381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.031849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:48.031927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:48.039853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId: src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:48.042617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:48.043053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.043079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.043124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:48.043227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:48.047893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:48.047909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.047912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:48.047914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:48.047926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601522960095615:8607]
2025-10-10T14:34:48.047931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601522960095615:8607]
2025-10-10T14:34:48.047935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601522960095615:8607]
2025-10-10T14:34:48.047981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:48.047987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:48.047989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:48.047991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:48.047994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.047997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:48.048175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:48.087788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601523742319600:8672]
2025-10-10T14:34:48.088175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1457, pipe: [1:7559601523742319600:8672]
2025-10-10T14:34:48.162886Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:48.171209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.171234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.171396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.171476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.171545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.171609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.171657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.171664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.171728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.171787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.171846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.171909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.171964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.171967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.172033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.172099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.172166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.172230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.172277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.172284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.172390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.172458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.172524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.172592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.172639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.172647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.172721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.172785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.172889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.172989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.173052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.173060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.173132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.173197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.173262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.173346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.173391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.173398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.173467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.173527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.173595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.175281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601523742319600:8672]
2025-10-10T14:34:48.175334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:48.175339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:48.175372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1458 reason: error at write: Disconnected sessionId: src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0
2025-10-10T14:34:48.175614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1458 sessionId: src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0 is DEAD
2025-10-10T14:34:48.175636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:48.175822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:48.175835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0] Write session will restart in 0.008605s
2025-10-10T14:34:48.175859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0] Write session: Do CDS request
2025-10-10T14:34:48.175865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:48.173688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.173741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.173744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.173850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.173943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.174040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.174170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.174226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.174229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.174359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.174488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.174546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.174610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.174670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.174673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.174739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.174795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.174858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.174914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.174969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.174976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.175044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742319600:8672], now have 1 active actors on pipe
2025-10-10T14:34:48.176247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:48.185870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.185972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:48.185987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1459
2025-10-10T14:34:48.186167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.186203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:48.186209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:48.186214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:48.188278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1459 sessionId:  describe result for acl check
2025-10-10T14:34:48.188318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:48.188323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:48.188325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:48.188331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601523742319657:9003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:48.188878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601523742319657:9003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:48.194842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601523742319657:9003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:48.200835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601523742319657:9003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:48.200852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601523742319657:9003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:48.200856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601523742319657:9003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:48.200865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:48.203689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:48.207289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:48.207556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:48.207562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:48.207575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:48.207632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:48.207671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601522960095945:8615]
2025-10-10T14:34:48.208318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:48.208691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:48.208737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:48.209086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:48.209153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.209162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.209163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.209164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.209166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.209167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.209168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.209170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.209171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.209173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.209174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.209176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.209178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.209184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.209198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.209203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.209208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.209213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.209217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.209221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.209226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.209230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.209235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.209239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.209243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.209247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.209257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.209266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.209273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.209279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.209284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.209290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.209296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.209301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.209305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.209310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.209315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.209321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.209328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.209349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.209354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.209359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.209364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.209369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.209374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.209380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.209386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.209392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.209396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.209402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.209407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.209419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.209463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:48.212061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:48.212979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:48.212992Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:48.212995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:48.212999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:48.213007Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1458 [2:7559601522960095945:8615]
2025-10-10T14:34:48.213021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:48.213040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:48.213048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.213052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.213054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.213073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:48.213089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:48.213097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:48.213165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.213172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.213175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.213177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:48.213251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:48.213259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.213272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.213295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.213311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:48.213354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742319866:9003], now have 1 active actors on pipe
2025-10-10T14:34:48.213367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601522960095940:8615]
2025-10-10T14:34:48.213370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601522960095940:8615]
2025-10-10T14:34:48.213372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601522960095940:8615]
2025-10-10T14:34:48.213387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:48.213395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:48.213400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:48.213403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:48.213404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:48.213420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:48.213424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:48.213431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742319603:2438], now have 1 active actors on pipe
2025-10-10T14:34:48.213465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601522960095940:8615]
2025-10-10T14:34:48.213475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:48.213478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:48.213494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.213503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.213412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1458
2025-10-10T14:34:48.213453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1458
2025-10-10T14:34:48.213557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:48.213571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.213575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.213578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:48.213590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.213603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:48.213624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.214014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.214026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.214046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.214131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1459 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0
2025-10-10T14:34:48.214525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ccb9ca-63698139-70b4491d-f715c7a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:48.217508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0] Write session: try to update token
2025-10-10T14:34:48.217527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:48.237180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId: src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:48.239299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:48.239316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.239320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:48.239322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:48.239332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601522960095940:8615]
2025-10-10T14:34:48.239336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601522960095940:8615]
2025-10-10T14:34:48.239340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601522960095940:8615]
2025-10-10T14:34:48.239388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:48.239396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.239399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:48.239460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:48.239473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:48.239490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:48.239556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:48.239911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:48.275608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601523742319911:8672]
2025-10-10T14:34:48.275891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1458, pipe: [1:7559601523742319911:8672]
2025-10-10T14:34:48.354113Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:48.354932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.354947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.354984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742319911:8672], now have 1 active actors on pipe
2025-10-10T14:34:48.355315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:48.355221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:48.355257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601523742319911:8672]
2025-10-10T14:34:48.355267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:48.355270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:48.355326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1459 reason: error at write: Disconnected sessionId: src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0
2025-10-10T14:34:48.355542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1459 sessionId: src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0 is DEAD
2025-10-10T14:34:48.357524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:48.357534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0] Write session will restart in 0.006087s
2025-10-10T14:34:48.357552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0] Write session: Do CDS request
2025-10-10T14:34:48.357560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:48.364917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.366610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:48.366625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1460
2025-10-10T14:34:48.366737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.366783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:48.366793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:48.366797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:48.367267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1460 sessionId:  describe result for acl check
2025-10-10T14:34:48.367305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:48.367307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:48.367309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:48.367315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601523742319993:9016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:48.367908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601523742319993:9016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:48.371062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601523742319993:9016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:48.374451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601523742319993:9016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:48.374465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601523742319993:9016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:48.374469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601523742319993:9016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:48.374477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:48.379609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:48.382551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:48.382774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:48.382787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:48.382801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:48.382867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:48.382919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601522960096245:8624]
2025-10-10T14:34:48.383575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:48.383909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:48.383977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:48.384309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:48.384365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.384371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.384372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.384373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.384375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.384376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.384378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.384379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.384380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.384382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.384383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.384384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.384385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.384391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.384405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.384409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.384413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.384417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.384422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.384426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.384430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.384435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.384440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.384444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.384449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.384452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.384460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.384469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.384479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.384486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.384495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.384501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.384507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.384512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.384519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.384527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.384534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.384540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.384549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.384554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.384562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.384566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.384571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.384577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.384581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.384587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.384593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.384597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.384602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.384610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.384618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.384627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.384666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:48.387185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:48.387522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:48.387536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:48.387539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:48.387543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:48.387549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1459 [2:7559601522960096245:8624]
2025-10-10T14:34:48.387563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:48.387582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:48.387586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.387591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.387594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.387613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:48.387620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:48.387629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:48.387693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.387699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.387701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.387704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:48.387778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:48.387786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.387799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.387811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.387832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:48.387853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320134:9016], now have 1 active actors on pipe
2025-10-10T14:34:48.387865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742319925:2438], now have 1 active actors on pipe
2025-10-10T14:34:48.387873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601522960096240:8624]
2025-10-10T14:34:48.387876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601522960096240:8624]
2025-10-10T14:34:48.387878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601522960096240:8624]
2025-10-10T14:34:48.387891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:48.387905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:48.387907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:48.387909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:48.387911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:48.387924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:48.387927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:48.387960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601522960096240:8624]
2025-10-10T14:34:48.387942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1459
2025-10-10T14:34:48.387955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1459
2025-10-10T14:34:48.387973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:48.387992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:48.388029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.388034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.388068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b67802f3-c1445100-c99c24a4-4769aab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:48.388075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.388079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.388081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:48.388096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.388107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:48.388123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.388293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.388305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.388330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.388455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1460 partition: 0 MaxSeqNo: 40 sessionId: src_id|b67802f3-c1445100-c99c24a4-4769aab7_0
2025-10-10T14:34:48.388928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e42a988-e8054ebf-e5d0add0-7d690a92_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b67802f3-c1445100-c99c24a4-4769aab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:48.392273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b67802f3-c1445100-c99c24a4-4769aab7_0] Write session: try to update token
2025-10-10T14:34:48.392296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b67802f3-c1445100-c99c24a4-4769aab7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:48.399582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:48.399604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.399615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601522960096240:8624]
2025-10-10T14:34:48.399671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:48.399674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:48.399855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:48.400007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.400162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.400350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.400566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:48.400614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:48.409418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId: src_id|b67802f3-c1445100-c99c24a4-4769aab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:48.412265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:48.412616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.412655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.412700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:48.412790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:48.418723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:48.418747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.418751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:48.418753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:48.418765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601522960096240:8624]
2025-10-10T14:34:48.418770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601522960096240:8624]
2025-10-10T14:34:48.418774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601522960096240:8624]
2025-10-10T14:34:48.418830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:48.418837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.418840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:48.419015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:48.421550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:48.421568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:48.421573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:48.455397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601523742320221:8672]
2025-10-10T14:34:48.455736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1459, pipe: [1:7559601523742320221:8672]
2025-10-10T14:34:48.547445Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:48.556593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.556629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.556838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.556904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.556971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.557045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.557113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.557124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.557192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.557252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.557319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.557436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.557482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.557493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.557588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.557651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.557713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.557773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.557813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.557815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.557881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.557947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.558008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.558076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.558122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.558132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.558196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.558262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.558332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.558396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.558442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.558451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.558521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.558582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.558647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.558710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.558755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.558763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.558830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.558891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.558963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.559028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.559072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.559080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.559145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.559204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.559266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.559331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.559375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.559382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.559460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.559520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.559581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.559646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.559689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.559696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.559762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.559820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.559880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.559940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.560056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.560064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.560130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320221:8672], now have 1 active actors on pipe
2025-10-10T14:34:48.560412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:48.560425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:48.560429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:48.560461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1460 reason: error at write: Disconnected sessionId: src_id|b67802f3-c1445100-c99c24a4-4769aab7_0
2025-10-10T14:34:48.560467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601523742320221:8672]
2025-10-10T14:34:48.560704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1460 sessionId: src_id|b67802f3-c1445100-c99c24a4-4769aab7_0 is DEAD
2025-10-10T14:34:48.560902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b67802f3-c1445100-c99c24a4-4769aab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:48.560914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b67802f3-c1445100-c99c24a4-4769aab7_0] Write session will restart in 0.008849s
2025-10-10T14:34:48.560938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b67802f3-c1445100-c99c24a4-4769aab7_0] Write session: Do CDS request
2025-10-10T14:34:48.560945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b67802f3-c1445100-c99c24a4-4769aab7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:48.561602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:48.570948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b67802f3-c1445100-c99c24a4-4769aab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.571741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:48.571758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1461
2025-10-10T14:34:48.571903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.571953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:48.571959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:48.571963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:48.572635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1461 sessionId:  describe result for acl check
2025-10-10T14:34:48.572677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:48.572679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:48.572680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:48.572687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601523742320281:9020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:48.573284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601523742320281:9020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:48.577452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601523742320281:9020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:48.580423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601523742320281:9020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:48.580438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601523742320281:9020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:48.580442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601523742320281:9020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:48.580452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:48.585471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:48.588472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:48.588707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:48.588719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:48.588732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:48.588784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:48.588839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601522960096539:8626]
2025-10-10T14:34:48.589507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:48.589882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:48.589950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:48.590314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:48.590370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.590377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.590378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.590380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.590382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.590383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.590385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.590386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.590387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.590389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.590390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.590392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.590393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.590399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.590413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.590417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.590422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.590427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.590431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.590436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.590440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.590445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.590449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.590454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.590459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.590463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.590471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.590481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.590493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.590499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.590519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.590529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.590534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.590545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.590550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.590581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.590586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.590596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.590605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.590612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.590621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.590628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.590637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.590644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.590654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.590661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.590666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.590673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.590677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.590684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.590688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.590695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.590734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:48.593251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:48.593569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:48.593583Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:48.593585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:48.593589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:48.593595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1460 [2:7559601522960096539:8626]
2025-10-10T14:34:48.593608Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:48.593629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:48.593636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.593640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.593642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.593659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:48.593667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:48.593680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:48.593738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.593745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.593748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.593750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:48.593818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:48.593826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.593837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.593849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.593867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:48.593890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320224:2438], now have 1 active actors on pipe
2025-10-10T14:34:48.593898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320433:9020], now have 1 active actors on pipe
2025-10-10T14:34:48.593906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601522960096534:8626]
2025-10-10T14:34:48.593914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601522960096534:8626]
2025-10-10T14:34:48.593916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601522960096534:8626]
2025-10-10T14:34:48.593930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:48.593904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1460
2025-10-10T14:34:48.593948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:48.593914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1460
2025-10-10T14:34:48.593950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:48.593969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:48.593973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:48.593974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:48.593977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:48.594013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.594022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.594036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601522960096534:8626]
2025-10-10T14:34:48.594049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:48.594066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:48.594086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|532a1236-96270528-66553f8a-f3b308c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:48.594095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.594103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.594105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:48.594117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.594132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:48.594158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.594328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.594342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.594366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.594468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1461 partition: 0 MaxSeqNo: 40 sessionId: src_id|532a1236-96270528-66553f8a-f3b308c8_0
2025-10-10T14:34:48.594868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b67802f3-c1445100-c99c24a4-4769aab7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|532a1236-96270528-66553f8a-f3b308c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:48.597525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532a1236-96270528-66553f8a-f3b308c8_0] Write session: try to update token
2025-10-10T14:34:48.597543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532a1236-96270528-66553f8a-f3b308c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:48.611873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId: src_id|532a1236-96270528-66553f8a-f3b308c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:48.614515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:48.615429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.615453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.615477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:48.615480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.615484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:48.615486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:48.615494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601522960096534:8626]
2025-10-10T14:34:48.615499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601522960096534:8626]
2025-10-10T14:34:48.615506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601522960096534:8626]
2025-10-10T14:34:48.615549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:48.615564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:48.615566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:48.615568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:48.615574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.615577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:48.615707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:48.660702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601523742320539:8672]
2025-10-10T14:34:48.661042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1460, pipe: [1:7559601523742320539:8672]
2025-10-10T14:34:48.735695Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:48.736298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:48.736358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320539:8672], now have 1 active actors on pipe
2025-10-10T14:34:48.736574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:48.736654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:48.736689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:48.736697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:48.736725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601523742320539:8672]
2025-10-10T14:34:48.736785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1461 reason: error at write: Disconnected sessionId: src_id|532a1236-96270528-66553f8a-f3b308c8_0
2025-10-10T14:34:48.736964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1461 sessionId: src_id|532a1236-96270528-66553f8a-f3b308c8_0 is DEAD
2025-10-10T14:34:48.737511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532a1236-96270528-66553f8a-f3b308c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:48.737523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532a1236-96270528-66553f8a-f3b308c8_0] Write session will restart in 0.005432s
2025-10-10T14:34:48.737548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532a1236-96270528-66553f8a-f3b308c8_0] Write session: Do CDS request
2025-10-10T14:34:48.737554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532a1236-96270528-66553f8a-f3b308c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:48.743891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|532a1236-96270528-66553f8a-f3b308c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.743994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:48.744021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1462
2025-10-10T14:34:48.744178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.744243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:48.744254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:48.744258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:48.744728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1462 sessionId:  describe result for acl check
2025-10-10T14:34:48.744767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:48.744769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:48.744771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:48.744777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601523742320559:9026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:48.745409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601523742320559:9026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:48.747958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601523742320559:9026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:48.752650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601523742320559:9026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:48.752668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601523742320559:9026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:48.752672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601523742320559:9026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:48.752681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:48.761589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:48.764947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:48.765184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:48.765197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:48.765209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:48.765267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:48.765312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601522960096848:8629]
2025-10-10T14:34:48.765806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:48.766162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:48.766212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:48.766450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:48.766492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.766497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.766498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.766498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.766499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.766500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.766501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.766502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.766503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.766503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.766504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.766504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.766505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.766509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.766518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.766521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.766523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.766525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.766527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.766529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.766531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.766534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.766536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.766538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.766540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.766542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.766548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.766556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.766562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.766567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.766572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.766577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.766581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.766587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.766590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.766594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.766596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.766599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.766602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.766605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.766608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.766612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.766614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.766617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.766620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.766623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.766627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.766631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.766636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.766640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.766645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.766651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.766682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:48.769186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:48.769574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:48.769592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:48.769595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:48.769613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:48.769621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1461 [2:7559601522960096848:8629]
2025-10-10T14:34:48.769635Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:48.769654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:48.769661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.769665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.769668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.769686Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:48.769699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:48.769709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:48.769773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.769781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.769782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.769785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:48.769860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:48.769867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.769880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.769899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.769914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:48.769939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320543:2438], now have 1 active actors on pipe
2025-10-10T14:34:48.769942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320667:9026], now have 1 active actors on pipe
2025-10-10T14:34:48.769950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601522960096843:8629]
2025-10-10T14:34:48.769953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601522960096843:8629]
2025-10-10T14:34:48.769955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601522960096843:8629]
2025-10-10T14:34:48.769971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:48.769989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:48.769989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:48.769992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:48.769994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:48.770011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:48.770014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:48.770009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1461
2025-10-10T14:34:48.770041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601522960096843:8629]
2025-10-10T14:34:48.770014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1461
2025-10-10T14:34:48.770055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:48.770069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:48.770112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.770123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.770157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:48.770172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.770176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.770178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:48.770190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.770202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:48.770218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.770418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.770430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.770455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.770571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1462 partition: 0 MaxSeqNo: 40 sessionId: src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0
2025-10-10T14:34:48.771027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|532a1236-96270528-66553f8a-f3b308c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:48.773800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0] Write session: try to update token
2025-10-10T14:34:48.773819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:48.781754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:48.781776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.781787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601522960096843:8629]
2025-10-10T14:34:48.781830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:48.781838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:48.782084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:48.782251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.782404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.782571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.782777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:48.782824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:48.788735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId: src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:48.791482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:48.791728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.791751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.791803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:48.791890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:48.799649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:48.799671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.799674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:48.799677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:48.799689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601522960096843:8629]
2025-10-10T14:34:48.799693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601522960096843:8629]
2025-10-10T14:34:48.799698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601522960096843:8629]
2025-10-10T14:34:48.799752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:48.799756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:48.799762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:48.799764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.799765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:48.799766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:48.799953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:48.836823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601523742320843:8672]
2025-10-10T14:34:48.837257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1461, pipe: [1:7559601523742320843:8672]
2025-10-10T14:34:48.914931Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:48.923651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.923689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.923914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.923988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.924056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.924129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.924419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.924431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.924504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.924582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.924651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.924727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.924772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.924779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.924850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.924929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.924996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.925067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.925115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.925123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.925199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.925266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.925358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.925437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.925507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.925514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.925600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.925705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.925771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.925839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.925903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.925911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.925978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.926056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.926120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.926187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.926240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.926248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.926314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.926377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.926484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.926580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.926628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.926633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.926696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.926753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.926828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.926892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.926954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.926962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.927030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.927091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.927160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.927229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.927277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.927283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.927357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:48.927430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:48.927496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:48.927559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:48.927608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:48.927617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:48.927679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320843:8672], now have 1 active actors on pipe
2025-10-10T14:34:48.927941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:48.927964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601523742320843:8672]
2025-10-10T14:34:48.928008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:48.928011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:48.928049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1462 reason: error at write: Disconnected sessionId: src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0
2025-10-10T14:34:48.928295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1462 sessionId: src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0 is DEAD
2025-10-10T14:34:48.928301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:48.928698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:48.928709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0] Write session will restart in 0.008924s
2025-10-10T14:34:48.928736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0] Write session: Do CDS request
2025-10-10T14:34:48.928742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:48.938930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.938994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:48.939024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1463
2025-10-10T14:34:48.939214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:48.939266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:48.939291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:48.939300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:48.939819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1463 sessionId:  describe result for acl check
2025-10-10T14:34:48.939863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:48.939873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:48.939876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:48.939883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601523742320881:9030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:48.940514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601523742320881:9030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:48.944752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601523742320881:9030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:48.948607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601523742320881:9030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:48.948623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601523742320881:9030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:48.948627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601523742320881:9030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:48.948637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:48.952361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:48.956019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:48.956278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:48.956290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:48.956302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:48.956368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:48.956413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601522960097144:8632]
2025-10-10T14:34:48.957074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:48.957396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:48.957439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:48.957751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:48.957822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.957829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.957830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.957832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.957833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.957834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.957835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.957836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.957838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.957839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.957840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.957841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.957842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.957848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.957862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.957867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.957871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.957875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.957880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.957884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.957888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.957892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.957897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.957901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.957906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.957910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.957917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.957926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:48.957932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.957937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:48.957941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.957946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:48.957950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.957963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:48.957968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.957977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:48.957981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.957991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:48.957995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.958006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:48.958010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.958020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:48.958024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.958034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:48.958038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.958048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:48.958052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.958057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.958062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.958067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.958071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.958077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.958117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:48.960542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:48.961040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:48.961055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:48.961058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:48.961061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:48.961068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1462 [2:7559601522960097144:8632]
2025-10-10T14:34:48.961080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:48.961098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:48.961100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.961104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.961106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.961122Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:48.961135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:48.961143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:48.961212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.961219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.961221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.961224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:48.961288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:48.961295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.961306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:48.961322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:48.961353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:48.961380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742321091:9030], now have 1 active actors on pipe
2025-10-10T14:34:48.961388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601523742320845:2438], now have 1 active actors on pipe
2025-10-10T14:34:48.961397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601522960097139:8632]
2025-10-10T14:34:48.961399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601522960097139:8632]
2025-10-10T14:34:48.961401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601522960097139:8632]
2025-10-10T14:34:48.961416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:48.961429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:48.961448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:48.961455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:48.961480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601522960097139:8632]
2025-10-10T14:34:48.961483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:48.961475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1462
2025-10-10T14:34:48.961531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:48.961544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:48.961547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:48.961555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:48.961566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1462
2025-10-10T14:34:48.962174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1463 partition: 0 MaxSeqNo: 40 sessionId: src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0
2025-10-10T14:34:48.962542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|147b6119-cab87ca4-8bbb5e72-65009fb6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:48.961676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.961688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.961729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:48.961738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:48.961742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:48.961745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:48.961756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:48.965259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0] Write session: try to update token
2025-10-10T14:34:48.961790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:48.961805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.962018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.965281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:48.962022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.962049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:48.972877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:48.972889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.972900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601522960097139:8632]
2025-10-10T14:34:48.972946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:48.972952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:48.973146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:48.973289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.973447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.973581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:48.973773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:48.973819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:48.979490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId: src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:48.982118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:48.983005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:48.982821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:48.982843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:48.982886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:48.990629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:48.990653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:48.990657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:48.990659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:48.990670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601522960097139:8632]
2025-10-10T14:34:48.990674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601522960097139:8632]
2025-10-10T14:34:48.990677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601522960097139:8632]
2025-10-10T14:34:48.990726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:48.990733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:48.990734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:48.990736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:48.990740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:48.990743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:48.990865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:49.027804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601528037288441:8672]
2025-10-10T14:34:49.028218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1462, pipe: [1:7559601528037288441:8672]
2025-10-10T14:34:49.110657Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:49.118791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.118823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.118998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.119066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.119129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.119199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.119250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.119261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.119328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.119392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.119472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.119538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.119583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.119587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.119653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.119714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.119778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.119842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.119886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.119895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.119960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.120023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.120088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.120151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.120193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.120203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.120275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.120337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.120401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.120464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.120506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.120514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.120581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.120637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.120696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.120758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.120800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.120809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.120875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.120934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.120996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.121059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.121124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.121131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.121195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.121255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.121315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.121394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.121524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.121531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.121594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.121652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.121719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.121789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.121834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.121841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.121904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.121963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.122024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.122088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.122142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.122150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.122212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037288441:8672], now have 1 active actors on pipe
2025-10-10T14:34:49.122460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:49.122471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:49.122476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:49.122509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1463 reason: error at write: Disconnected sessionId: src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0
2025-10-10T14:34:49.122531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601528037288441:8672]
2025-10-10T14:34:49.122733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1463 sessionId: src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0 is DEAD
2025-10-10T14:34:49.122881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:49.122894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0] Write session will restart in 0.007318s
2025-10-10T14:34:49.122919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0] Write session: Do CDS request
2025-10-10T14:34:49.122925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:49.123268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:49.132002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.132106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:49.132121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1464
2025-10-10T14:34:49.134346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.134399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:49.134409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:49.134413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:49.134820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1464 sessionId:  describe result for acl check
2025-10-10T14:34:49.134853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:49.134860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:49.134861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:49.134866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601528037288498:9034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:49.135436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601528037288498:9034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:49.140987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601528037288498:9034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:49.145000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601528037288498:9034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:49.145015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601528037288498:9034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:49.145020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601528037288498:9034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:49.145030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:49.145905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:49.149065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:49.149465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:49.149483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:49.149502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:49.149587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:49.149636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601527255064737:8634]
2025-10-10T14:34:49.150265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:49.150619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:49.150678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:49.151018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:49.151100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.151107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.151108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.151109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.151111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.151112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.151113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.151115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.151116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.151117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.151119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.151120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.151121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.151128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.151141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.151145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.151150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.151154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.151158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.151162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.151165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.151170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.151174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.151177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.151181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.151185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.151194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.151203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.151210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.151215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.151220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.151225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.151232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.151238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.151243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.151248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.151253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.151258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.151263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.151269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.151273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.151279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.151283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.151288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.151292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.151297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.151302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.151306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.151310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.151315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.151320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.151324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.151359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:49.157710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:49.158042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:49.158058Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:49.158061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:49.158065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:49.158074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1463 [2:7559601527255064737:8634]
2025-10-10T14:34:49.158089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:49.158109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:49.158117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.158121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.158124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.158143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:49.158156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:49.158164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:49.158233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.158242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.158244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.158247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:49.158341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:49.158353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.158364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.158374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.158390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:49.158419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037288731:9034], now have 1 active actors on pipe
2025-10-10T14:34:49.158428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037288443:2438], now have 1 active actors on pipe
2025-10-10T14:34:49.158435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601527255064732:8634]
2025-10-10T14:34:49.158438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601527255064732:8634]
2025-10-10T14:34:49.158440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601527255064732:8634]
2025-10-10T14:34:49.158455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:49.158468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:49.158488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:49.158496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:49.158526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:49.158507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1463
2025-10-10T14:34:49.158534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601527255064732:8634]
2025-10-10T14:34:49.158537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:49.158538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:49.158540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:49.158548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:49.158516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1463
2025-10-10T14:34:49.158691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.158704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.158736Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:49.158750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.158755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.158758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:49.158772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.158784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:49.158811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.158961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.158969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.158984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.159075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1464 partition: 0 MaxSeqNo: 40 sessionId: src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0
2025-10-10T14:34:49.159511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1b41e8-9696377b-944b7c97-4653a9af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:49.162299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0] Write session: try to update token
2025-10-10T14:34:49.162320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:49.170342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:49.170362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:49.170372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601527255064732:8634]
2025-10-10T14:34:49.170424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:49.170605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:49.170752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:49.170898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:49.171038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:49.171235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:49.171277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:49.173177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:49.178215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId: src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:49.180806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:49.184328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.184350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.184400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:49.186032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:49.192604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:49.192621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:49.192623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:49.192625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:49.192633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601527255064732:8634]
2025-10-10T14:34:49.192636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601527255064732:8634]
2025-10-10T14:34:49.192639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601527255064732:8634]
2025-10-10T14:34:49.192678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:49.192684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.192686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:49.192690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:49.192698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:49.192702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:49.192824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:49.222913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601528037288745:8672]
2025-10-10T14:34:49.224107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1463, pipe: [1:7559601528037288745:8672]
2025-10-10T14:34:49.306934Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:49.314402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.314430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.314616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.314684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.314751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.314824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.315252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.315257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.315329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.315384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.315458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.315516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.315554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.315555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.315631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.315690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.315746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.315801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.315838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.315840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.315915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.315981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.316037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.316099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.316141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.316144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.316207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.316260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.316317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.316380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.316440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.316444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.316522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.316578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.316636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.316698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.316741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.316745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.316809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.316865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.316920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.316983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.317031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.317035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.317103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.317164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.317223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.317281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.317579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.317589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.317663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.317724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.317786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.317852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.317896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.317898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.318015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.318084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.318150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.318213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.318279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.318282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.318364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037288745:8672], now have 1 active actors on pipe
2025-10-10T14:34:49.319000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:49.319376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:49.319413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0] Write session will restart in 0.009372s
2025-10-10T14:34:49.319437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0] Write session: Do CDS request
2025-10-10T14:34:49.319444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:49.318599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601528037288745:8672]
2025-10-10T14:34:49.318649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:49.318651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:49.318697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1464 reason: error at write: Disconnected sessionId: src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0
2025-10-10T14:34:49.318923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1464 sessionId: src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0 is DEAD
2025-10-10T14:34:49.319077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:49.331252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.331313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:49.331328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1465
2025-10-10T14:34:49.331502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.331543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:49.331555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:49.331558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:49.332030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1465 sessionId:  describe result for acl check
2025-10-10T14:34:49.332065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:49.332071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:49.332073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:49.332089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601528037288830:9047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:49.332680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601528037288830:9047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:49.339563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601528037288830:9047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:49.343030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601528037288830:9047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:49.343047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601528037288830:9047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:49.343051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601528037288830:9047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:49.343060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:49.344718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:49.347414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:49.347687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:49.347698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:49.347711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:49.347780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:49.347826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601527255065073:8647]
2025-10-10T14:34:49.348473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:49.348798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:49.348855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:49.349225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:49.349283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.349284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.349286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.349287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.349288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.349291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.349292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.349293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.349295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.349296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.349297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.349299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.349300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.349307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.349321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.349326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.349345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.349348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.349353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.349357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.349361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.349366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.349372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.349376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.349380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.349384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.349393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.349402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.349409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.349415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.349420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.349425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.349430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.349436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.349442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.349447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.349452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.349457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.349462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.349468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.349472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.349478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.349483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.349489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.349494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.349499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.349504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.349509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.349514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.349519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.349524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.349530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.349571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:49.352227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:49.352577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:49.352592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:49.352594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:49.352598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:49.352615Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1464 [2:7559601527255065073:8647]
2025-10-10T14:34:49.352632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:49.352653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:49.352662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.352666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.352668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.352687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:49.352702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:49.352711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:49.352775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.352800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.352806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.352810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:49.352897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:49.352905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.352916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.352928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.352950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:49.352979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289060:9047], now have 1 active actors on pipe
2025-10-10T14:34:49.352988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037288761:2438], now have 1 active actors on pipe
2025-10-10T14:34:49.352996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601527255065068:8647]
2025-10-10T14:34:49.352998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601527255065068:8647]
2025-10-10T14:34:49.353000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601527255065068:8647]
2025-10-10T14:34:49.353014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:49.353027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:49.353033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:49.353036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:49.353038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:49.353050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:49.353061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:49.353089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601527255065068:8647]
2025-10-10T14:34:49.353054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1464
2025-10-10T14:34:49.353100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:49.353107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:49.353254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1464
2025-10-10T14:34:49.353297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.353308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.353367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:49.353383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.353388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.353391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:49.353404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.353420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:49.353443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.353619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.353627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.353643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.353752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1465 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0
2025-10-10T14:34:49.354186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10619413-e6a046f-c3c2f5c0-69d829aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:49.356846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0] Write session: try to update token
2025-10-10T14:34:49.356863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:49.365573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:49.365598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:49.365610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601527255065068:8647]
2025-10-10T14:34:49.365665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:49.365715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:49.365860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:49.366033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:49.366187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:49.366334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:49.366560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:49.366608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:49.371537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId: src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:49.374085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:49.374363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.374396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.374442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:49.374602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:49.384238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:49.384260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:49.384263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:49.384265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:49.384276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601527255065068:8647]
2025-10-10T14:34:49.384279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601527255065068:8647]
2025-10-10T14:34:49.384283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601527255065068:8647]
2025-10-10T14:34:49.384332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:49.384339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.384342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:49.384397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:49.384409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:49.384413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:49.384473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:49.418952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601528037289073:8672]
2025-10-10T14:34:49.419257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1464, pipe: [1:7559601528037289073:8672]
2025-10-10T14:34:49.497700Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:49.506252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.506283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.506460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.506522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.506591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.506655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.506702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.506712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.506784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.506846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.506910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.506975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.507021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.507028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.507100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.507162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.507227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.507291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.507337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.507340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.507424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.507485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.507543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.507602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.507642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.507645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.507713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.507773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.507839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.507899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.508006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.508009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.508076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.508134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.508195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.508256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.508297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.508300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.508368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.508426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.508490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.508549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.508650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.508653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.508719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.508772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.508830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.508892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.508930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.508933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.508999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.509061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.509119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.509177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.509219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.509222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.509286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:49.509554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:49.509628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:49.509689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:49.509746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:49.509748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:49.509815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289073:8672], now have 1 active actors on pipe
2025-10-10T14:34:49.511264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:49.511592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601528037289073:8672]
2025-10-10T14:34:49.511634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:49.511681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1465 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0
2025-10-10T14:34:49.511873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1465 sessionId: src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0 is DEAD
2025-10-10T14:34:49.512008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:49.512277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:49.512286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0] Write session will restart in 0.006735s
2025-10-10T14:34:49.512310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0] Write session: Do CDS request
2025-10-10T14:34:49.512315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:49.523156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.523407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:49.523423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1466
2025-10-10T14:34:49.523537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.523572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:49.523581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:49.523586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:49.524012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1466 sessionId:  describe result for acl check
2025-10-10T14:34:49.524048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:49.524055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:49.524057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:49.524063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601528037289101:9051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:49.524637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601528037289101:9051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:49.529322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601528037289101:9051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:49.533791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601528037289101:9051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:49.533807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601528037289101:9051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:49.533812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601528037289101:9051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:49.533822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:49.541361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:49.545212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:49.545504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:49.545510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:49.545523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:49.545578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:49.545622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601527255065373:8651]
2025-10-10T14:34:49.546315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:49.546772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:49.546826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:49.547184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:49.547250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.547257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.547259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.547260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.547261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.547263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.547265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.547266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.547268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.547269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.547271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.547272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.547274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.547281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.547295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.547300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.547305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.547309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.547314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.547318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.547328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.547332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.547341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.547350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.547359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.547367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.547379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.547409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.547416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.547422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.547428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.547434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.547439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.547444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.547450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.547456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.547461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.547467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.547473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.547479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.547483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.547490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.547495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.547501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.547508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.547514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.547519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.547525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.547529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.547535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.547541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.547557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.547601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:49.553582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:49.553947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:49.553953Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:49.553956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:49.553972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:49.553980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1465 [2:7559601527255065373:8651]
2025-10-10T14:34:49.553997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:49.554018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:49.554022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.554026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.554029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.554049Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:49.554058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:49.554067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:49.554134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.554136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.554138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.554141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:49.554217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:49.554220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.554233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.554247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.554267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:49.554290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601527255065368:8651]
2025-10-10T14:34:49.554294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601527255065368:8651]
2025-10-10T14:34:49.554296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601527255065368:8651]
2025-10-10T14:34:49.554312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:49.554326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:49.554344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:49.554347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:49.554386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601527255065368:8651]
2025-10-10T14:34:49.554390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:49.554937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1465
2025-10-10T14:34:49.555054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1465
2025-10-10T14:34:49.554650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:49.554658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:49.554660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:49.554667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:49.555167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289264:9051], now have 1 active actors on pipe
2025-10-10T14:34:49.555177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289078:2438], now have 1 active actors on pipe
2025-10-10T14:34:49.555629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.555640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.555676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:49.555696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.555702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.555705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:49.555718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.555732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:49.555750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.555967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.555973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.556004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.556099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1466 partition: 0 MaxSeqNo: 40 sessionId: src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0
2025-10-10T14:34:49.556633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd1c6e9b-d122b88b-d2af1061-9bbaf9d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:49.559343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0] Write session: try to update token
2025-10-10T14:34:49.559367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:49.575688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:49.575713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:49.575717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:49.575719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:49.575730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601527255065368:8651]
2025-10-10T14:34:49.575735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601527255065368:8651]
2025-10-10T14:34:49.575742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601527255065368:8651]
2025-10-10T14:34:49.575802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:49.575808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:49.575815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:49.575817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.575820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:49.575820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:49.576008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:49.574838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId: src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:49.577823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:49.610903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601528037289394:8672]
2025-10-10T14:34:49.613611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1465, pipe: [1:7559601528037289394:8672]
2025-10-10T14:34:49.690053Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:49.690527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.690548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.690610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289394:8672], now have 1 active actors on pipe
2025-10-10T14:34:49.690822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:49.691801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:49.691814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0] Write session will restart in 0.005481s
2025-10-10T14:34:49.691849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0] Write session: Do CDS request
2025-10-10T14:34:49.691855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:49.691299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:49.691418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1466 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0
2025-10-10T14:34:49.691641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1466 sessionId: src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0 is DEAD
2025-10-10T14:34:49.691816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601528037289394:8672]
2025-10-10T14:34:49.691837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:49.699538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.699611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:49.699626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1467
2025-10-10T14:34:49.699845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.699896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:49.699902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:49.699906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:49.701789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1467 sessionId:  describe result for acl check
2025-10-10T14:34:49.701833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:49.701836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:49.701841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:49.701848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601528037289420:9057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:49.702430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601528037289420:9057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:49.706134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601528037289420:9057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:49.712781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601528037289420:9057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:49.712805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601528037289420:9057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:49.712809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601528037289420:9057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:49.712818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:49.724744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:49.728079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:49.728358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:49.728370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:49.728383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:49.728443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:49.728647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601527255065685:8654]
2025-10-10T14:34:49.729236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:49.729654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:49.729721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:49.730081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:49.730147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.730155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.730156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.730158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.730159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.730160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.730161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.730163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.730164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.730165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.730167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.730168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.730169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.730176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.730189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.730193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.730198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.730202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.730206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.730210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.730214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.730218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.730222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.730226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.730230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.730235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.730242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.730251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.730258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.730264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.730269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.730274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.730279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.730284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.730289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.730294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.730298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.730313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.730320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.730325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.730335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.730341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.730346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.730351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.730355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.730360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.730364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.730379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.730388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.730394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.730398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.730404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.730452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:49.733531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:49.733876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:49.733887Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:49.733889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:49.733893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:49.733901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1466 [2:7559601527255065685:8654]
2025-10-10T14:34:49.733915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:49.733933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:49.733938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.733942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.733944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.733964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:49.733980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:49.733993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:49.734054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.734061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.734063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.734066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:49.734140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:49.734147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.734158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.734170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.734189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:49.734216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289403:2438], now have 1 active actors on pipe
2025-10-10T14:34:49.734230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601527255065680:8654]
2025-10-10T14:34:49.734232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601527255065680:8654]
2025-10-10T14:34:49.734234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601527255065680:8654]
2025-10-10T14:34:49.734244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:49.734254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289545:9057], now have 1 active actors on pipe
2025-10-10T14:34:49.734253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:49.734257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:49.734259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:49.734262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:49.734278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:49.734285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:49.734313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601527255065680:8654]
2025-10-10T14:34:49.734320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:49.734303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1466
2025-10-10T14:34:49.734315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1466
2025-10-10T14:34:49.734332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:49.734351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.734361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.734397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92647051-e2c108e0-437d9391-be806dda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:49.734410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.734414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.734422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:49.734434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.734448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:49.734468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.734618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.734626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.734640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.734743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1467 partition: 0 MaxSeqNo: 40 sessionId: src_id|92647051-e2c108e0-437d9391-be806dda_0
2025-10-10T14:34:49.735182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f9db2e-fd834cb6-59c74500-b0f41754_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|92647051-e2c108e0-437d9391-be806dda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:49.737958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92647051-e2c108e0-437d9391-be806dda_0] Write session: try to update token
2025-10-10T14:34:49.737982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92647051-e2c108e0-437d9391-be806dda_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:49.753893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId: src_id|92647051-e2c108e0-437d9391-be806dda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:49.756434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:49.757704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.757733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.757757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:49.757761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:49.757764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:49.757767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:49.757775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601527255065680:8654]
2025-10-10T14:34:49.757780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601527255065680:8654]
2025-10-10T14:34:49.757784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601527255065680:8654]
2025-10-10T14:34:49.757833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:49.757843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:49.757847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:49.757851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:49.757851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.757854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:49.757995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:49.792211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601528037289708:8672]
2025-10-10T14:34:49.792513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1466, pipe: [1:7559601528037289708:8672]
2025-10-10T14:34:49.872189Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:49.873263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:49.873324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601528037289708:8672]
2025-10-10T14:34:49.873366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:49.873387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:49.873390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:49.873492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1467 reason: error at write: Disconnected sessionId: src_id|92647051-e2c108e0-437d9391-be806dda_0
2025-10-10T14:34:49.873707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1467 sessionId: src_id|92647051-e2c108e0-437d9391-be806dda_0 is DEAD
2025-10-10T14:34:49.873034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:49.873116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289708:8672], now have 1 active actors on pipe
2025-10-10T14:34:49.874048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92647051-e2c108e0-437d9391-be806dda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:49.874060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92647051-e2c108e0-437d9391-be806dda_0] Write session will restart in 0.007229s
2025-10-10T14:34:49.874086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92647051-e2c108e0-437d9391-be806dda_0] Write session: Do CDS request
2025-10-10T14:34:49.874093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92647051-e2c108e0-437d9391-be806dda_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:49.883018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92647051-e2c108e0-437d9391-be806dda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.883489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:49.883505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1468
2025-10-10T14:34:49.883649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:49.883697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:49.883709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:49.883713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:49.884465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1468 sessionId:  describe result for acl check
2025-10-10T14:34:49.884507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:49.884509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:49.884511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:49.884518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601528037289747:9061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:49.885066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601528037289747:9061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:49.889267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601528037289747:9061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:49.898530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601528037289747:9061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:49.898553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601528037289747:9061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:49.898557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601528037289747:9061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:49.898566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:49.902944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:49.906037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:49.906276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:49.906295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:49.906309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:49.906371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:49.906411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601527255065988:8657]
2025-10-10T14:34:49.907034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:49.907410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:49.907477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:49.907825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:49.907886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.907892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.907893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.907894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.907896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.907897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.907898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.907899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.907901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.907902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.907903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.907904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.907905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.907911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.907932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.907936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.907940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.907943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.907947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.907951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.907955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.907959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.907964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.907967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.907971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.907975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.907983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.907992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:49.907998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.908003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:49.908007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.908012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:49.908016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.908021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:49.908025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.908030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:49.908034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.908039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:49.908044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.908048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:49.908052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.908058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:49.908062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.908073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:49.908078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.908083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:49.908094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.908099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.908103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.908108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.908115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.908120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.908160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:49.910634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:49.910990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:49.911002Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:49.911005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:49.911009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:49.911016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1467 [2:7559601527255065988:8657]
2025-10-10T14:34:49.911030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:49.911052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:49.911064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.911068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.911071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.911091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:49.911099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:49.911107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:49.911166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.911174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.911176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.911178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:49.911250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:49.911259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.911271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:49.911283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:49.911301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:49.911328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601527255065983:8657]
2025-10-10T14:34:49.911336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601527255065983:8657]
2025-10-10T14:34:49.911338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601527255065983:8657]
2025-10-10T14:34:49.911348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:49.911357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:49.911364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:49.911367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:49.911379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:49.911391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:49.911400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:49.911411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289711:2438], now have 1 active actors on pipe
2025-10-10T14:34:49.911414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037289955:9061], now have 1 active actors on pipe
2025-10-10T14:34:49.911438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601527255065983:8657]
2025-10-10T14:34:49.911452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:49.911472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:49.911444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1467
2025-10-10T14:34:49.911472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1467
2025-10-10T14:34:49.911659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.911671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.911706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:49.911720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:49.911729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:49.911732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:49.911755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:49.911771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:49.911790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.912028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.912037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.912054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:49.912144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1468 partition: 0 MaxSeqNo: 40 sessionId: src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0
2025-10-10T14:34:49.912874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92647051-e2c108e0-437d9391-be806dda_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:49.916788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0] Write session: try to update token
2025-10-10T14:34:49.916811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:49.932387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId: src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:49.935279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:49.935720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:49.935748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:49.935772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:49.935776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:49.935780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:49.935782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:49.935790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601527255065983:8657]
2025-10-10T14:34:49.935794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601527255065983:8657]
2025-10-10T14:34:49.935798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601527255065983:8657]
2025-10-10T14:34:49.935832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:49.935845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:49.935849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:49.935859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:49.935872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:49.935875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:49.936043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:49.973411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601528037290017:8672]
2025-10-10T14:34:49.973771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1467, pipe: [1:7559601528037290017:8672]
2025-10-10T14:34:50.057653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:50.058404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:50.058471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601528037290017:8672], now have 1 active actors on pipe
2025-10-10T14:34:50.059650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:50.059662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0] Write session will restart in 0.008869s
2025-10-10T14:34:50.059686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0] Write session: Do CDS request
2025-10-10T14:34:50.059693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:50.059168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:50.059261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:50.059265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:50.059337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1468 reason: error at write: Disconnected sessionId: src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0
2025-10-10T14:34:50.059498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1468 sessionId: src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0 is DEAD
2025-10-10T14:34:50.059716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:50.059754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601528037290017:8672]
2025-10-10T14:34:50.069925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.070002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:50.070021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1469
2025-10-10T14:34:50.070266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.070304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:50.070315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:50.070319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:50.070825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1469 sessionId:  describe result for acl check
2025-10-10T14:34:50.070861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:50.070867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:50.070869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:50.070876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601532332257331:9065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:50.071571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601532332257331:9065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:50.080247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601532332257331:9065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:50.091285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601532332257331:9065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:50.091309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601532332257331:9065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:50.091313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601532332257331:9065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:50.091324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:50.107181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:50.110571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:50.110802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:50.110815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:50.110828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:50.110886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:50.110947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601531550033588:8659]
2025-10-10T14:34:50.111700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:50.112157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:50.112207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:50.112598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:50.112651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.112653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.112655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.112656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.112657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.112658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.112660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.112661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.112663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.112664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.112666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.112667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.112669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.112675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.112690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.112695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.112700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.112704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.112710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.112714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.112719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.112724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.112729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.112733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.112738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.112743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.112751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.112762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.112769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.112775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.112782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.112788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.112794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.112800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.112805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.112811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.112816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.112822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.112828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.112835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.112839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.112846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.112850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.112856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.112861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.112867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.112872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.112878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.112882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.112888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.112893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.112899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.112944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:50.116045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:50.116874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:50.116889Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:50.116892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:50.116896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:50.116904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1468 [2:7559601531550033588:8659]
2025-10-10T14:34:50.116919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:50.116938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:50.116942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.116946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.116948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.116967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:50.116975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:50.116990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:50.117061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.117068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.117070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.117072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:50.117142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:50.117150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.117164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.117186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.117202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:50.117224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332257473:9065], now have 1 active actors on pipe
2025-10-10T14:34:50.117228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332257316:2438], now have 1 active actors on pipe
2025-10-10T14:34:50.117235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601531550033583:8659]
2025-10-10T14:34:50.117237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601531550033583:8659]
2025-10-10T14:34:50.117239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601531550033583:8659]
2025-10-10T14:34:50.117254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:50.117267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:50.117270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:50.117274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:50.117276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:50.117286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:50.117289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:50.117300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1468
2025-10-10T14:34:50.117317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1468
2025-10-10T14:34:50.117319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601531550033583:8659]
2025-10-10T14:34:50.117326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:50.117346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:50.117379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.117384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.117413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:50.117421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.117425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.117427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:50.117438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.117450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:50.117464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.117708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.117719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.117738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.117853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1469 partition: 0 MaxSeqNo: 40 sessionId: src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0
2025-10-10T14:34:50.118651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9ad10c2-15cd7877-58c053b9-bbb20df1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:50.121434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0] Write session: try to update token
2025-10-10T14:34:50.121453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:50.136887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId: src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:50.134782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:50.134803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:50.134814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601531550033583:8659]
2025-10-10T14:34:50.134866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:50.135065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:50.135222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.135387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.135538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.135733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:50.135772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:50.137452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:50.139659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:50.139945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.139969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.140012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:50.140105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:50.158208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:50.158228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:50.158231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:50.158233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:50.158245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601531550033583:8659]
2025-10-10T14:34:50.158250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601531550033583:8659]
2025-10-10T14:34:50.158253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601531550033583:8659]
2025-10-10T14:34:50.158300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:50.158302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:50.158309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:50.158311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.158312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:50.158314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:50.158459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:50.159807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601532332257620:8672]
2025-10-10T14:34:50.160074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1468, pipe: [1:7559601532332257620:8672]
2025-10-10T14:34:50.286614Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:50.287290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332257620:8672], now have 1 active actors on pipe
2025-10-10T14:34:50.295514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.295540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.295720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.295788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.295859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.295931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.295983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.295988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.296064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.296130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.296198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.296272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.296317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.296319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.296395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.296455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.296534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.296605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.296647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.296650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.296722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.296784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.296843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.296907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.296951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.296954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.297029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.297110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.297177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.297242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.297287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.297289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.297517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.297589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.300490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:50.300019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:50.300530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0] Write session will restart in 0.009994s
2025-10-10T14:34:50.300074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601532332257620:8672]
2025-10-10T14:34:50.300079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:50.300556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0] Write session: Do CDS request
2025-10-10T14:34:50.300082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:50.300110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1469 reason: error at write: Disconnected sessionId: src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0
2025-10-10T14:34:50.300315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1469 sessionId: src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0 is DEAD
2025-10-10T14:34:50.300563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:50.297654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.297732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.297780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.297782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.297862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.297928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.297996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.298064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.298109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.298114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.298180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.298238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.298299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.298365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.298409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.298412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.298482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.298545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.298609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.298675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.298802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.298804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.298871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:50.298929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:50.298989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:50.299048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:50.299089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:50.299092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:50.300315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:50.313837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.313980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:50.313995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1470
2025-10-10T14:34:50.314193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.314226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:50.314233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:50.314237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:50.314967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1470 sessionId:  describe result for acl check
2025-10-10T14:34:50.315006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:50.315008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:50.315012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:50.315019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601532332257691:9069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:50.316082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601532332257691:9069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:50.322547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601532332257691:9069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:50.328030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601532332257691:9069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:50.328048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601532332257691:9069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:50.328052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601532332257691:9069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:50.328061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:50.331427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:50.335331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:50.335624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:50.335636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:50.335651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:50.335717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:50.335775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601531550033922:8672]
2025-10-10T14:34:50.336412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:50.336796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:50.336864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:50.337245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:50.337353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.337358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.337359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.337360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.337362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.337363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.337364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.337365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.337366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.337367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.337368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.337369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.337371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.337379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.337391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.337395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.337400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.337403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.337407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.337411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.337414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.337417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.337421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.337425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.337428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.337431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.337439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.337448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.337455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.337460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.337465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.337470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.337482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.337487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.337492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.337497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.337502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.337507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.337512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.337516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.337521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.337526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.337531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.337536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.337540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.337545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.337556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.337562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.337567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.337572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.337577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.337582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.337623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:50.345486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:50.346037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:50.346050Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:50.346053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:50.346057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:50.346064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1469 [2:7559601531550033922:8672]
2025-10-10T14:34:50.346078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:50.346099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:50.346108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.346112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.346114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.346133Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:50.346149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:50.346157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:50.346217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.346228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.346230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.346233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:50.346308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:50.346310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.346323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.346335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.346353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:50.346377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332257896:9069], now have 1 active actors on pipe
2025-10-10T14:34:50.346393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332257626:2438], now have 1 active actors on pipe
2025-10-10T14:34:50.346401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601531550033916:8672]
2025-10-10T14:34:50.346404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601531550033916:8672]
2025-10-10T14:34:50.346406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601531550033916:8672]
2025-10-10T14:34:50.346421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:50.346437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:50.346456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:50.346460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:50.346503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601531550033916:8672]
2025-10-10T14:34:50.346506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:50.346593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:50.346597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:50.346599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:50.346606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:50.346790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.346800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.346839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:50.346848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.346853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.346856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:50.346869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.346883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:50.346900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.347093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.347105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.347122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.347651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c048071b-caa4a0d1-7745d419-d4eff2c5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:50.346516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1469
2025-10-10T14:34:50.346556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1469
2025-10-10T14:34:50.347253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1470 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0
2025-10-10T14:34:50.351250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0] Write session: try to update token
2025-10-10T14:34:50.351270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:50.367456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:50.367475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:50.367478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:50.367481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:50.367490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601531550033916:8672]
2025-10-10T14:34:50.367495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601531550033916:8672]
2025-10-10T14:34:50.367500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601531550033916:8672]
2025-10-10T14:34:50.367555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:50.367562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:50.367564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.367566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:50.367579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:50.367583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:50.367713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:50.367240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId: src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:50.370019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:50.398184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601532332257954:8672]
2025-10-10T14:34:50.398734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1469, pipe: [1:7559601532332257954:8672]
2025-10-10T14:34:50.481757Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:50.482413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.482432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.482481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332257954:8672], now have 1 active actors on pipe
2025-10-10T14:34:50.482789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:50.482792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:50.482810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:50.482852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601532332257954:8672]
2025-10-10T14:34:50.482958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1470 reason: error at write: Disconnected sessionId: src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0
2025-10-10T14:34:50.483252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1470 sessionId: src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0 is DEAD
2025-10-10T14:34:50.483370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:50.483381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0] Write session will restart in 0.006008s
2025-10-10T14:34:50.483405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0] Write session: Do CDS request
2025-10-10T14:34:50.483411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:50.483738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:50.490928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.491009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:50.491024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1471
2025-10-10T14:34:50.491141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.491183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:50.491189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:50.491193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:50.491623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1471 sessionId:  describe result for acl check
2025-10-10T14:34:50.491656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:50.491658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:50.491659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:50.491666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601532332257971:9082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:50.492293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601532332257971:9082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:50.497264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601532332257971:9082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:50.502954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601532332257971:9082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:50.502973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601532332257971:9082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:50.502978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601532332257971:9082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:50.502986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:50.507751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:50.510942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:50.511224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:50.511241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:50.511256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:50.511365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:50.511427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601531550034233:8676]
2025-10-10T14:34:50.512061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:50.512461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:50.512522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:50.512840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:50.512904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.512913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.512915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.512916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.512917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.512918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.512919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.512921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.512922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.512924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.512925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.512927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.512928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.512935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.512949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.512953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.512957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.512961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.512965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.512969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.512973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.512977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.512981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.512985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.512989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.512993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.513000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.513009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.513015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.513020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.513025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.513031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.513036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.513040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.513045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.513052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.513056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.513060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.513065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.513070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.513074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.513078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.513083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.513088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.513092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.513097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.513101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.513106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.513110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.513115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.513121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.513125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.513161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:50.515878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:50.516252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:50.516266Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:50.516268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:50.516272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:50.516279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1470 [2:7559601531550034233:8676]
2025-10-10T14:34:50.516292Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:50.516312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:50.516320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.516324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.516326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.516343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:50.516352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:50.516359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:50.516424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.516433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.516435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.516437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:50.516695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1470
2025-10-10T14:34:50.516695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1470
2025-10-10T14:34:50.516515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:50.516527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.516538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.516548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.516563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:50.516585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332258173:9082], now have 1 active actors on pipe
2025-10-10T14:34:50.516589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332257956:2438], now have 1 active actors on pipe
2025-10-10T14:34:50.516596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601531550034228:8676]
2025-10-10T14:34:50.516599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601531550034228:8676]
2025-10-10T14:34:50.516603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601531550034228:8676]
2025-10-10T14:34:50.516617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:50.516633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:50.516648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:50.516652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:50.516677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601531550034228:8676]
2025-10-10T14:34:50.516679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:50.516727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:50.516730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:50.516732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:50.516739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:50.516905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.516917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.516949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:50.516962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.516967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.516974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:50.516986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.517005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:50.517023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.517194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.517203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.517221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.517371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1471 partition: 0 MaxSeqNo: 40 sessionId: src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0
2025-10-10T14:34:50.525444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1d27a7d-3c793241-99d7ba46-92b1461d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:50.528105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0] Write session: try to update token
2025-10-10T14:34:50.528125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:50.528448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:50.528465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:50.528479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601531550034228:8676]
2025-10-10T14:34:50.528527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:50.528534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:50.528698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:50.528838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.528974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.529116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.529308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:50.529375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:50.543911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId: src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:50.546641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:50.547973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.548004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.548031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:50.548034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:50.548037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:50.548039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:50.548050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601531550034228:8676]
2025-10-10T14:34:50.548054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601531550034228:8676]
2025-10-10T14:34:50.548060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601531550034228:8676]
2025-10-10T14:34:50.548110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:50.548122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:50.548125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:50.548129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:50.548130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.548133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:50.548268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:50.583285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601532332258264:8672]
2025-10-10T14:34:50.583753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1470, pipe: [1:7559601532332258264:8672]
2025-10-10T14:34:50.668348Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:50.669219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:50.669263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332258264:8672], now have 1 active actors on pipe
2025-10-10T14:34:50.669410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:50.669473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601532332258264:8672]
2025-10-10T14:34:50.669501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:50.669525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:50.669529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:50.669621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1471 reason: error at write: Disconnected sessionId: src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0
2025-10-10T14:34:50.669809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1471 sessionId: src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0 is DEAD
2025-10-10T14:34:50.669996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:50.670009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0] Write session will restart in 0.009192s
2025-10-10T14:34:50.670037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0] Write session: Do CDS request
2025-10-10T14:34:50.670044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:50.680967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.681038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:50.681053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1472
2025-10-10T14:34:50.681275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.681320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:50.681343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:50.681348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:50.681817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1472 sessionId:  describe result for acl check
2025-10-10T14:34:50.681861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:50.681872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:50.681874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:50.681881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601532332258337:9088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:50.682481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601532332258337:9088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:50.685831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601532332258337:9088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:50.689974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601532332258337:9088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:50.689996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601532332258337:9088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:50.690000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601532332258337:9088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:50.690014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:50.694417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:50.698098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:50.698370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:50.698384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:50.698400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:50.698917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:50.698974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601531550034556:8679]
2025-10-10T14:34:50.699609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:50.700011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:50.700087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:50.700457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:50.700542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.700548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.700550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.700551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.700553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.700554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.700556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.700557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.700558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.700560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.700561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.700562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.700563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.700570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.700584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.700589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.700593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.700597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.700601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.700605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.700609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.700613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.700617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.700621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.700624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.700629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.700638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.700647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.700654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.700659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.700663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.700668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.700673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.700684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.700689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.700695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.700703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.700709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.700718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.700723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.700727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.700733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.700742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.700748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.700752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.700758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.700763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.700768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.700773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.700778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.700788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.700793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.700833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:50.703376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:50.704353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:50.704367Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:50.704370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:50.704374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:50.704381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1471 [2:7559601531550034556:8679]
2025-10-10T14:34:50.704395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:50.704415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:50.704424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.704427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.704430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.704447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:50.704455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:50.704464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:50.704524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.704531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.704533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.704536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:50.704605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:50.704612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.704624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.704641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.704661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:50.704688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332258512:9088], now have 1 active actors on pipe
2025-10-10T14:34:50.704697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332258283:2438], now have 1 active actors on pipe
2025-10-10T14:34:50.704705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601531550034545:8679]
2025-10-10T14:34:50.704709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601531550034545:8679]
2025-10-10T14:34:50.704710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601531550034545:8679]
2025-10-10T14:34:50.704727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:50.704744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:50.704747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:50.704747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:50.704750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:50.704762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:50.704765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:50.704799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601531550034545:8679]
2025-10-10T14:34:50.704806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:50.704811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:50.704773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1471
2025-10-10T14:34:50.704777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1471
2025-10-10T14:34:50.704832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.704842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.704885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:50.704899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.704907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.704909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:50.704921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.704932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:50.704960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.705104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.705107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.705122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.705216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1472 partition: 0 MaxSeqNo: 40 sessionId: src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0
2025-10-10T14:34:50.705677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad85042f-cc72c41c-fe3eb759-ded75db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:50.708451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0] Write session: try to update token
2025-10-10T14:34:50.708473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:50.724266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId: src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:50.724890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:50.724912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:50.724916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:50.724918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:50.724930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601531550034545:8679]
2025-10-10T14:34:50.724935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601531550034545:8679]
2025-10-10T14:34:50.724940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601531550034545:8679]
2025-10-10T14:34:50.724988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:50.724997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:50.725003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.725004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:50.725005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:50.725012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:50.725162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:50.727435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:50.769567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601532332258598:8672]
2025-10-10T14:34:50.769880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1471, pipe: [1:7559601532332258598:8672]
2025-10-10T14:34:50.844269Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:50.844858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.844884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.844936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332258598:8672], now have 1 active actors on pipe
2025-10-10T14:34:50.845175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:50.845223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601532332258598:8672]
2025-10-10T14:34:50.845256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:50.845360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1472 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0
2025-10-10T14:34:50.845575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1472 sessionId: src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0 is DEAD
2025-10-10T14:34:50.845622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:50.845749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:50.845761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0] Write session will restart in 0.006969s
2025-10-10T14:34:50.845787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0] Write session: Do CDS request
2025-10-10T14:34:50.845794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:50.854011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.854132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:50.854148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1473
2025-10-10T14:34:50.854587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:50.854644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:50.854657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:50.854661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:50.855161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1473 sessionId:  describe result for acl check
2025-10-10T14:34:50.855203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:50.855210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:50.855212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:50.855220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601532332258613:9092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:50.855893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601532332258613:9092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:50.858597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601532332258613:9092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:50.862737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601532332258613:9092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:50.862757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601532332258613:9092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:50.862762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601532332258613:9092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:50.862776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:50.864291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:50.870516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:50.870818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:50.870830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:50.870843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:50.870912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:50.870975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601531550034621:8682]
2025-10-10T14:34:50.871748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:50.872309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:50.872422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:50.872816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:50.872895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.872903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.872905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.872906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.872908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.872910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.872911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.872913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.872915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.872917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.872918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.872920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.872921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.872930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.872945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.872950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.872955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.872960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.872965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.872970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.872975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.872979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.872985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.872989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.872994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.872998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.873009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.873018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:50.873026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.873033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:50.873039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.873045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:50.873050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.873056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:50.873062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.873068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:50.873074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.873080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:50.873092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.873113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:50.873122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.873129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:50.873140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.873146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:50.873156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.873162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:50.873173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.873179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.873184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.873195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.873201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.873211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.873260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:50.879510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:50.879878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:50.879891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:50.879894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:50.879899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:50.879907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1472 [2:7559601531550034621:8682]
2025-10-10T14:34:50.879923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:50.879949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:50.879956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.879960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.879963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.879984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:50.879996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:50.880010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:50.880081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.880093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.880095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.880098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:50.880172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:50.880181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.880193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:50.880210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:50.880225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:50.880256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332258599:2438], now have 1 active actors on pipe
2025-10-10T14:34:50.880260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332258648:9092], now have 1 active actors on pipe
2025-10-10T14:34:50.880268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601531550034615:8682]
2025-10-10T14:34:50.880271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601531550034615:8682]
2025-10-10T14:34:50.880273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601531550034615:8682]
2025-10-10T14:34:50.880287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:50.880301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:50.880306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:50.880306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:50.880308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:50.880321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:50.880325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:50.880371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601531550034615:8682]
2025-10-10T14:34:50.880386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:50.880392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:50.880444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1472
2025-10-10T14:34:50.880450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1472
2025-10-10T14:34:50.880618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.880632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.880676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:50.880692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:50.880697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:50.880701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:50.880714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:50.880727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:50.880755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.881080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.881090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.881120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:50.881295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1473 partition: 0 MaxSeqNo: 40 sessionId: src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0
2025-10-10T14:34:50.881848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6f4424b-2f31dcd0-eb901ca5-c8aa032e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:50.884789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0] Write session: try to update token
2025-10-10T14:34:50.884813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:50.892987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:50.893009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:50.893020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601531550034615:8682]
2025-10-10T14:34:50.893074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:50.893083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:50.893251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:50.893421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.893565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.893699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:50.894007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:50.894043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:50.901773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId: src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:50.904511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:50.904764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:50.904787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:50.904849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:50.904943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:50.912561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:50.912582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:50.912586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:50.912588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:50.912600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601531550034615:8682]
2025-10-10T14:34:50.912605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601531550034615:8682]
2025-10-10T14:34:50.912608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601531550034615:8682]
2025-10-10T14:34:50.912660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:50.912672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:50.912674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:50.912819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:50.915796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:50.915810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:50.915814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:50.945229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601532332258662:8672]
2025-10-10T14:34:50.945554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1472, pipe: [1:7559601532332258662:8672]
2025-10-10T14:34:51.029611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:51.038460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.038495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.038686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.038761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.038835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.038901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.038944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.038952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.039026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.039089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.039150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.039215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.039257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.039260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.039328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.039403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.039465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.039529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.039570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.039577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.039646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.039709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.039767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.039833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.039875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.039878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.039948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.040007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.040068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.040130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.040172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.040175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.040240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.040300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.040358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.040419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.040460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.040463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.040543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.040601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.040662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.040725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.040783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.040786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.040854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.040909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.040968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.041034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.041075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.041078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.041144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.041205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.041263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.041320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.041603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.041617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.041690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.041752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.041815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.041877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.041936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.041944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.042010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601532332258662:8672], now have 1 active actors on pipe
2025-10-10T14:34:51.043414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601532332258662:8672]
2025-10-10T14:34:51.043452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:51.043509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:51.043516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:51.043529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:51.043548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1473 reason: error at write: Disconnected sessionId: src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0
2025-10-10T14:34:51.043828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1473 sessionId: src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0 is DEAD
2025-10-10T14:34:51.043921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:51.043930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0] Write session will restart in 0.006127s
2025-10-10T14:34:51.043963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0] Write session: Do CDS request
2025-10-10T14:34:51.043970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:51.050919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.051272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:51.051288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1474
2025-10-10T14:34:51.051452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.051500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:51.051512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:51.051516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:51.052043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1474 sessionId:  describe result for acl check
2025-10-10T14:34:51.052080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:51.052084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:51.052086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:51.052092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601536627225979:9096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:51.052653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601536627225979:9096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:51.053345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:51.054683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:51.054926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:51.054939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:51.054952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:51.055011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:51.055050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601535845001973:8684]
2025-10-10T14:34:51.055446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601536627225979:9096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:51.055640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:51.056126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:51.056197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:51.056554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:51.056615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.056622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.056624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.056625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.056626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.056628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.056629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.056630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.056632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.056633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.056635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.056636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.056638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.056646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.056659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.056664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.056669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.056673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.056678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.056682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.056686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.056690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.056694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.056698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.056703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.056706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.056715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.056723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.056729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.056738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.056743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.056753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.056758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.056763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.056773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.056779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.056788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.056793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.056802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.056808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.056812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.056822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.056831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.056837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.056845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.056851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.056859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.056865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.056873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.056879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.056887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.056893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.056935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:51.059518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:51.059590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601536627225979:9096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:51.059606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601536627225979:9096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:51.059610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601536627225979:9096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:51.059620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:51.059900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:51.059919Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:51.059924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:51.059928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:51.059936Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1473 [2:7559601535845001973:8684]
2025-10-10T14:34:51.059951Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:51.059972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:51.059978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.059982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.059984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.060003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:51.060011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:51.060023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:51.060096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.060105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.060107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.060110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:51.060179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:51.060188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.060201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.060213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.060231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:51.060260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226014:9096], now have 1 active actors on pipe
2025-10-10T14:34:51.060264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627225961:2438], now have 1 active actors on pipe
2025-10-10T14:34:51.060271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601535845001968:8684]
2025-10-10T14:34:51.060284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601535845001968:8684]
2025-10-10T14:34:51.060291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601535845001968:8684]
2025-10-10T14:34:51.060307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:51.060322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:51.060325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:51.060329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:51.060331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:51.060339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:51.060342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:51.060373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601535845001968:8684]
2025-10-10T14:34:51.060386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:51.060404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:51.060374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1473
2025-10-10T14:34:51.060400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1473
2025-10-10T14:34:51.060482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.060497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.060535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:51.060548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.060553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.060558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:51.060570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.060582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:51.060599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.060823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.060832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.060851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.060971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1474 partition: 0 MaxSeqNo: 40 sessionId: src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0
2025-10-10T14:34:51.061389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529c10-7d60f0de-79d02de5-3fcf4800_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:51.064197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0] Write session: try to update token
2025-10-10T14:34:51.064222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:51.083248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId: src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:51.083503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:51.083518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.083528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601535845001968:8684]
2025-10-10T14:34:51.083580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:51.083775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:51.083939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.084111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.084265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.084473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:51.084508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:51.085567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:51.086125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:51.086709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.086728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.086775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:51.086867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:51.105660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:51.105686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.105690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:51.105692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:51.105702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601535845001968:8684]
2025-10-10T14:34:51.105706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601535845001968:8684]
2025-10-10T14:34:51.105715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601535845001968:8684]
2025-10-10T14:34:51.105793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:51.105803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:51.105806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:51.105811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:51.105811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.105814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:51.105966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:51.145504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601536627226022:8672]
2025-10-10T14:34:51.153426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1473, pipe: [1:7559601536627226022:8672]
2025-10-10T14:34:51.219844Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:51.228595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.228632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.228817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.228884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.228958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.229019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.229058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.229066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.229140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.229198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.229256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.229320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.229466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.229478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.229546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.229649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.229713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.232353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:51.232361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:51.232367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:51.232404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1474 reason: error at write: Disconnected sessionId: src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0
2025-10-10T14:34:51.232432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601536627226022:8672]
2025-10-10T14:34:51.232652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1474 sessionId: src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0 is DEAD
2025-10-10T14:34:51.232816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:51.232831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0] Write session will restart in 0.006715s
2025-10-10T14:34:51.232871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0] Write session: Do CDS request
2025-10-10T14:34:51.232879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:51.229783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.229829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.229833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.229902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.229962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.230025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.230094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.230134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.230137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.230207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.230265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.230332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.230397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.230438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.230441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.230507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.230562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.230621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.230679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.230723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.230726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.230794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.230853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.230914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.230971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.231011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.231014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.231081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.231139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.231228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.231287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.231341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.231345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.231416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.231475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.231537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.231597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.231638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.231641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.231708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.231768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.231834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.231898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.231946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.231949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.232032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226022:8672], now have 1 active actors on pipe
2025-10-10T14:34:51.233483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:51.240952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.241131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:51.241146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1475
2025-10-10T14:34:51.241287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.241355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:51.241366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:51.241370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:51.241827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1475 sessionId:  describe result for acl check
2025-10-10T14:34:51.241867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:51.241873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:51.241875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:51.241882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601536627226045:9100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:51.242149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:51.242529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601536627226045:9100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:51.243900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:51.244151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:51.244163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:51.244175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:51.244240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:51.244283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601535845002032:8686]
2025-10-10T14:34:51.244936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:51.245281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:51.245349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:51.245099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601536627226045:9100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:51.245696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:51.245755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.245762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.245763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.245764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.245766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.245767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.245768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.245769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.245771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.245772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.245773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.245775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.245776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.245782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.245797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.245801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.245806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.245810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.245817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.245821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.245826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.245830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.245834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.245838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.245842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.245846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.245853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.245863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.245869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.245875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.245888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.245894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.245899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.245904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.245909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.245915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.245920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.245925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.245929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.245935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.245940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.245945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.245950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.245956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.245960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.245972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.245977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.245982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.245987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.245993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.245997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.246003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.246044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:51.249236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601536627226045:9100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:51.249250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601536627226045:9100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:51.249254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601536627226045:9100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:51.249262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:51.249379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:51.249713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:51.249725Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:51.249727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:51.249732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:51.249738Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1474 [2:7559601535845002032:8686]
2025-10-10T14:34:51.249752Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:51.249775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:51.249785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.249789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.249793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.249810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:51.249817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:51.249825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:51.249881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.249889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.249891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.249894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:51.249963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:51.249970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.249983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.250000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.250023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:51.250053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226080:9100], now have 1 active actors on pipe
2025-10-10T14:34:51.250061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226025:2438], now have 1 active actors on pipe
2025-10-10T14:34:51.250069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601535845002027:8686]
2025-10-10T14:34:51.250072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601535845002027:8686]
2025-10-10T14:34:51.250074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601535845002027:8686]
2025-10-10T14:34:51.250088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:51.250106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:51.250103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1474
2025-10-10T14:34:51.250125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:51.250105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1474
2025-10-10T14:34:51.250126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:51.250130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:51.250132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:51.250133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:51.250159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601535845002027:8686]
2025-10-10T14:34:51.250162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:51.250164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:51.250191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.250199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.250251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21958fe-524c708f-200839ce-8f2a266a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:51.250264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.250268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.250269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:51.250280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.250294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:51.250313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.250867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.250881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.250904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.250999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1475 partition: 0 MaxSeqNo: 40 sessionId: src_id|21958fe-524c708f-200839ce-8f2a266a_0
2025-10-10T14:34:51.251348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c0ec8f-fed7ff88-3a8f7976-7acb354d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21958fe-524c708f-200839ce-8f2a266a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:51.254152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21958fe-524c708f-200839ce-8f2a266a_0] Write session: try to update token
2025-10-10T14:34:51.254171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21958fe-524c708f-200839ce-8f2a266a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:51.269096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId: src_id|21958fe-524c708f-200839ce-8f2a266a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:51.271505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:51.271528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.271532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:51.271536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:51.271547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601535845002027:8686]
2025-10-10T14:34:51.271555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601535845002027:8686]
2025-10-10T14:34:51.271558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601535845002027:8686]
2025-10-10T14:34:51.271612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:51.271620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.271620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:51.271623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:51.271628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:51.271633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:51.271782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:51.271945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:51.332314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601536627226090:8672]
2025-10-10T14:34:51.332719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1474, pipe: [1:7559601536627226090:8672]
2025-10-10T14:34:51.413225Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:51.413697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.413711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.413758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226090:8672], now have 1 active actors on pipe
2025-10-10T14:34:51.414117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:51.417751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601536627226090:8672]
2025-10-10T14:34:51.417787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:51.418349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21958fe-524c708f-200839ce-8f2a266a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:51.418361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21958fe-524c708f-200839ce-8f2a266a_0] Write session will restart in 0.005512s
2025-10-10T14:34:51.417834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:51.418387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21958fe-524c708f-200839ce-8f2a266a_0] Write session: Do CDS request
2025-10-10T14:34:51.417925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1475 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21958fe-524c708f-200839ce-8f2a266a_0
2025-10-10T14:34:51.418131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1475 sessionId: src_id|21958fe-524c708f-200839ce-8f2a266a_0 is DEAD
2025-10-10T14:34:51.418393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21958fe-524c708f-200839ce-8f2a266a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:51.425002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21958fe-524c708f-200839ce-8f2a266a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.425142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:51.425162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1476
2025-10-10T14:34:51.425347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.425386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:51.425399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:51.425404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:51.425970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1476 sessionId:  describe result for acl check
2025-10-10T14:34:51.426013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:51.426030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:51.426035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:51.426042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601536627226113:9112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:51.426622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601536627226113:9112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:51.431104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601536627226113:9112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:51.435434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:51.437949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:51.438357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:51.438364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:51.438378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:51.438444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:51.438484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601535845002125:8699]
2025-10-10T14:34:51.439124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:51.439815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:51.439893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:51.440131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601536627226113:9112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:51.440147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601536627226113:9112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:51.440152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601536627226113:9112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:51.440161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:51.440386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:51.440462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.440467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.440469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.440470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.440471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.440472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.440473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.440474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.440476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.440477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.440479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.440480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.440481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.440488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.440499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.440503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.440506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.440509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.440513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.440518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.440521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.440525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.440528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.440532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.440535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.440538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.440546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.440555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.440573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.440578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.440584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.440589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.440593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.440598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.440603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.440608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.440612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.440617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.440621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.440625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.440630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.440634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.440639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.440644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.440654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.440659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.440664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.440668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.440673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.440678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.440683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.440688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.440731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:51.443756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:51.444075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:51.444088Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:51.444091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:51.444094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:51.444102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1475 [2:7559601535845002125:8699]
2025-10-10T14:34:51.444117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:51.444135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:51.444145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.444152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.444155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.444183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:51.444190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:51.444198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:51.444256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.444263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.444265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.444267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:51.444336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:51.444344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.444355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.444369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.444387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:51.444413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601535845002120:8699]
2025-10-10T14:34:51.444418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601535845002120:8699]
2025-10-10T14:34:51.444421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601535845002120:8699]
2025-10-10T14:34:51.444431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:51.444447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:51.444463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:51.444466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:51.444496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601535845002120:8699]
2025-10-10T14:34:51.444503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:51.444663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:51.444673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:51.444675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:51.444680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:51.444931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226159:9112], now have 1 active actors on pipe
2025-10-10T14:34:51.444942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226105:2438], now have 1 active actors on pipe
2025-10-10T14:34:51.445192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1475
2025-10-10T14:34:51.445225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1475
2025-10-10T14:34:51.445532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.445548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.445586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d60efa90-3d62448c-206dadae-ccf5988b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:51.445604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.445614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.445617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:51.445631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.445646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:51.445669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.446289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.446305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.446330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.446477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1476 partition: 0 MaxSeqNo: 40 sessionId: src_id|d60efa90-3d62448c-206dadae-ccf5988b_0
2025-10-10T14:34:51.446905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21958fe-524c708f-200839ce-8f2a266a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d60efa90-3d62448c-206dadae-ccf5988b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:51.449824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60efa90-3d62448c-206dadae-ccf5988b_0] Write session: try to update token
2025-10-10T14:34:51.449844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60efa90-3d62448c-206dadae-ccf5988b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:51.469304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:51.469327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.469348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:51.469350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:51.469362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601535845002120:8699]
2025-10-10T14:34:51.469367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601535845002120:8699]
2025-10-10T14:34:51.469370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601535845002120:8699]
2025-10-10T14:34:51.469427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:51.469435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.469437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:51.469594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:51.477925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:51.477945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:51.477950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:51.479019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId: src_id|d60efa90-3d62448c-206dadae-ccf5988b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:51.482526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:51.518786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601536627226180:8672]
2025-10-10T14:34:51.520258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1475, pipe: [1:7559601536627226180:8672]
2025-10-10T14:34:51.589705Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:51.590193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.590209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.590239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226180:8672], now have 1 active actors on pipe
2025-10-10T14:34:51.590585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601536627226180:8672]
2025-10-10T14:34:51.590606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:51.590611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:51.590619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:51.590686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1476 reason: error at write: Disconnected sessionId: src_id|d60efa90-3d62448c-206dadae-ccf5988b_0
2025-10-10T14:34:51.590877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1476 sessionId: src_id|d60efa90-3d62448c-206dadae-ccf5988b_0 is DEAD
2025-10-10T14:34:51.590605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:51.591311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60efa90-3d62448c-206dadae-ccf5988b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:51.591349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60efa90-3d62448c-206dadae-ccf5988b_0] Write session will restart in 0.006770s
2025-10-10T14:34:51.591374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60efa90-3d62448c-206dadae-ccf5988b_0] Write session: Do CDS request
2025-10-10T14:34:51.591383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60efa90-3d62448c-206dadae-ccf5988b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:51.601231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d60efa90-3d62448c-206dadae-ccf5988b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.601703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:51.601719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1477
2025-10-10T14:34:51.601844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.601880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:51.601890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:51.601894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:51.602322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1477 sessionId:  describe result for acl check
2025-10-10T14:34:51.602359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:51.602365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:51.602367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:51.602373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601536627226217:9120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:51.602533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:51.602866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601536627226217:9120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:51.604386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:51.604617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:51.604630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:51.604643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:51.604703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:51.604752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601535845002205:8703]
2025-10-10T14:34:51.605430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:51.605161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601536627226217:9120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:51.605818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:51.605868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:51.606218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:51.606280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.606288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.606290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.606292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.606297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.606298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.606300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.606303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.606304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.606305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.606307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.606308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.606311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.606318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.606331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.606336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.606341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.606345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.606350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.606355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.606359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.606363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.606368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.606373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.606382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.606386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.606395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.606404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.606411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.606417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.606422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.606428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.606433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.606439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.606444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.606455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.606459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.606471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.606476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.606484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.606489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.606495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.606500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.606506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.606511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.606517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.606522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.606527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.606532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.606538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.606543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.606548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.606592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:51.609190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601536627226217:9120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:51.609205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601536627226217:9120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:51.609209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601536627226217:9120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:51.609218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:51.609798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:51.610133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:51.610138Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:51.610140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:51.610144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:51.610152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1476 [2:7559601535845002205:8703]
2025-10-10T14:34:51.610166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:51.610184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:51.610187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.610193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.610196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.610213Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:51.610224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:51.610233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:51.610292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.610294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.610296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.610299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:51.610371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:51.610374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.610387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.610400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.610420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:51.610443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226263:9120], now have 1 active actors on pipe
2025-10-10T14:34:51.610447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226182:2438], now have 1 active actors on pipe
2025-10-10T14:34:51.610455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601535845002199:8703]
2025-10-10T14:34:51.610457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601535845002199:8703]
2025-10-10T14:34:51.610459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601535845002199:8703]
2025-10-10T14:34:51.610473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:51.610488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:51.610491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:51.610495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:51.610497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:51.610505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:51.610508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:51.610532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601535845002199:8703]
2025-10-10T14:34:51.610539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:51.610774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1476
2025-10-10T14:34:51.610546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:51.610803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1476
2025-10-10T14:34:51.610852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.610861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.610909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:51.610934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.610945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.610948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:51.610961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.610978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:51.611007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.612471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.612487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.612512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.612622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1477 partition: 0 MaxSeqNo: 40 sessionId: src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0
2025-10-10T14:34:51.613101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d60efa90-3d62448c-206dadae-ccf5988b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:51.615899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0] Write session: try to update token
2025-10-10T14:34:51.615918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:51.622657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:51.622679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.622692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601535845002199:8703]
2025-10-10T14:34:51.622738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:51.622910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:51.623058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.623196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.623338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.623602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:51.623638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:51.623815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:51.638492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId: src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:51.641286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:51.641533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.641560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.641607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:51.641701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:51.651864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:51.651887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.651891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:51.651893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:51.651903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601535845002199:8703]
2025-10-10T14:34:51.651907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601535845002199:8703]
2025-10-10T14:34:51.651913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601535845002199:8703]
2025-10-10T14:34:51.651959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:51.651967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.651969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:51.652115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:51.653448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:51.653458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:51.653465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:51.688629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601536627226278:8672]
2025-10-10T14:34:51.688983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1476, pipe: [1:7559601536627226278:8672]
2025-10-10T14:34:51.775104Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:51.783572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.783602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.783784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.783851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.783918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.783987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.784038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.784047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.784125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.784193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.784265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.784337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.784376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.784378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.784447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.784509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.784596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.784663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.784699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.784702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.784768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.784826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.784884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.784939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.784975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.784977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.785038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.785101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.785156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.785209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.785254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.785257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.785321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.785497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.785575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.785645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.785694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.785697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.785771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.785833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.785899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.785966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.786013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.786020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.786090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.786156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.786223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.786291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.786336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.786343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.786412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.786477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.786540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.786609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.786654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.786661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.786726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:51.786790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:51.786885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:51.786953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:51.786994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:51.787003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:51.787070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226278:8672], now have 1 active actors on pipe
2025-10-10T14:34:51.787404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:51.787418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:51.787451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1477 reason: error at write: Disconnected sessionId: src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0
2025-10-10T14:34:51.787546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:51.787605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601536627226278:8672]
2025-10-10T14:34:51.787659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1477 sessionId: src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0 is DEAD
2025-10-10T14:34:51.787824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:51.787835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0] Write session will restart in 0.005378s
2025-10-10T14:34:51.787863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0] Write session: Do CDS request
2025-10-10T14:34:51.787869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:51.788164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:51.794973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.795070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:51.795090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1478
2025-10-10T14:34:51.795250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.795299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:51.795320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:51.795325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:51.795901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1478 sessionId:  describe result for acl check
2025-10-10T14:34:51.795943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:51.795945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:51.795952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:51.795958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601536627226299:9125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:51.796578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601536627226299:9125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:51.798564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:51.800431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:51.800550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601536627226299:9125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:51.800682Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:51.800695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:51.800709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:51.800768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:51.800829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601535845002269:8707]
2025-10-10T14:34:51.801535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:51.801975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:51.802034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:51.802447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:51.802506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.802513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.802514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.802515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.802517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.802519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.802520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.802522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.802523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.802525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.802527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.802529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.802530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.802536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.802550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.802555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.802560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.802564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.802568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.802573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.802577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.802581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.802586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.802592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.802596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.802600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.802608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.802617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.802624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.802630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.802634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.802640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.802646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.802659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.802664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.802670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.802675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.802680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.802685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.802690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.802694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.802700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.802705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.802711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.802721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.802726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.802732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.802742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.802746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.802756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.802760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.802766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.802810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:51.806137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601536627226299:9125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:51.806157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601536627226299:9125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:51.806161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601536627226299:9125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:51.806170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:51.807108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:51.807472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:51.807492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:51.807495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:51.807499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:51.807506Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1477 [2:7559601535845002269:8707]
2025-10-10T14:34:51.807520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:51.807539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:51.807542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.807546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.807549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.807568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:51.807576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:51.807584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:51.807647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.807658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.807660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.807663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:51.807743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:51.807752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.807764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.807781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.807798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:51.807902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1477
2025-10-10T14:34:51.807945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1477
2025-10-10T14:34:51.807842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226343:9125], now have 1 active actors on pipe
2025-10-10T14:34:51.807857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226284:2438], now have 1 active actors on pipe
2025-10-10T14:34:51.807865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601535845002263:8707]
2025-10-10T14:34:51.807867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601535845002263:8707]
2025-10-10T14:34:51.807869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601535845002263:8707]
2025-10-10T14:34:51.807886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:51.807902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:51.807907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:51.807912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:51.807914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:51.807917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:51.807921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:51.807959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601535845002263:8707]
2025-10-10T14:34:51.807966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:51.807982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:51.808138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.808147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.808182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:51.808191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.808196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.808198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:51.808210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.808220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:51.808239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.808524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.808532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.808548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.808658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1478 partition: 0 MaxSeqNo: 40 sessionId: src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0
2025-10-10T14:34:51.809069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef99c-bd1322fd-31f5f80b-2da16d89_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:51.811868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0] Write session: try to update token
2025-10-10T14:34:51.811888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:51.828353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId: src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:51.828472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:51.828496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.828500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:51.828502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:51.828512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601535845002263:8707]
2025-10-10T14:34:51.828517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601535845002263:8707]
2025-10-10T14:34:51.828522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601535845002263:8707]
2025-10-10T14:34:51.828569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:51.828574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:51.828583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.828585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:51.828586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:51.828590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:51.828738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:51.830988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:51.887830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601536627226351:8672]
2025-10-10T14:34:51.888112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1477, pipe: [1:7559601536627226351:8672]
2025-10-10T14:34:51.945154Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:51.945479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.945498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.945544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226351:8672], now have 1 active actors on pipe
2025-10-10T14:34:51.945809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:51.945877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601536627226351:8672]
2025-10-10T14:34:51.945899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:51.945810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:51.945997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1478 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0
2025-10-10T14:34:51.946208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1478 sessionId: src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0 is DEAD
2025-10-10T14:34:51.946381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:51.946392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0] Write session will restart in 0.005258s
2025-10-10T14:34:51.946429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0] Write session: Do CDS request
2025-10-10T14:34:51.946435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:51.953612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.953676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:51.953691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1479
2025-10-10T14:34:51.953947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:51.954000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:51.954006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:51.954010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:51.954532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1479 sessionId:  describe result for acl check
2025-10-10T14:34:51.954571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:51.954580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:51.954582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:51.954588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601536627226366:9129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:51.955158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601536627226366:9129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:51.957843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601536627226366:9129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:51.959001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:51.960882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:51.961133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:51.961147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:51.961160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:51.961221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:51.961270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601535845002332:8709]
2025-10-10T14:34:51.961396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601536627226366:9129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:51.961413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601536627226366:9129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:51.961418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601536627226366:9129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:51.961428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:51.961911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:51.962231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:51.962283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:51.962604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:51.962676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.962684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.962685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.962687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.962688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.962689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.962691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.962692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.962693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.962694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.962695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.962697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.962698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.962704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.962716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.962721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.962725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.962728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.962732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.962735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.962739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.962744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.962748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.962752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.962755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.962759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.962767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.962775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:51.962781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.962786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:51.962795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.962800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:51.962804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.962809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:51.962813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.962818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:51.962821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.962826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:51.962832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.962837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:51.962847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.962852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:51.962856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.962861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:51.962870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.962875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:51.962879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.962885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.962889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.962894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.962899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.962904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.962942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:51.966414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:51.966766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:51.966783Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:51.966786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:51.966790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:51.966797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1478 [2:7559601535845002332:8709]
2025-10-10T14:34:51.966811Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:51.966831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:51.966834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.966838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.966841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.966860Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:51.966874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:51.966887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:51.966974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.966982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.966984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.966987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:51.967074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:51.967084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.967095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:51.967108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:51.967125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:51.967148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226415:9129], now have 1 active actors on pipe
2025-10-10T14:34:51.967156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601535845002327:8709]
2025-10-10T14:34:51.967160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601535845002327:8709]
2025-10-10T14:34:51.967161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601535845002327:8709]
2025-10-10T14:34:51.967174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:51.967183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601536627226352:2438], now have 1 active actors on pipe
2025-10-10T14:34:51.967188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:51.967192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:51.967192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:51.967194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:51.967209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:51.967212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:51.967242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601535845002327:8709]
2025-10-10T14:34:51.967253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:51.967259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:51.967268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1478
2025-10-10T14:34:51.967303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1478
2025-10-10T14:34:51.967497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.967511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.967560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:51.967575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:51.967580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:51.967582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:51.967595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:51.967610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:51.967637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.967874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.967884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.967911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:51.968063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1479 partition: 0 MaxSeqNo: 40 sessionId: src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0
2025-10-10T14:34:51.968484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f24f1370-29d74aad-2c8b8d32-4df847b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:51.971286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0] Write session: try to update token
2025-10-10T14:34:51.971305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:51.979712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:51.979735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.979750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601535845002327:8709]
2025-10-10T14:34:51.979806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:51.979817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:51.980003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:51.980143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.980286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.980432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:51.980649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:51.980704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:51.992347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:51.992374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:51.992419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:51.989092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId: src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:51.991846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:51.992507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:51.999172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:51.999196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:51.999199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:51.999201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:51.999212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601535845002327:8709]
2025-10-10T14:34:51.999216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601535845002327:8709]
2025-10-10T14:34:51.999220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601535845002327:8709]
2025-10-10T14:34:51.999271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:51.999275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:51.999278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:51.999281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:51.999282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:51.999286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:51.999435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:52.046075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601540922193723:8672]
2025-10-10T14:34:52.046418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1478, pipe: [1:7559601540922193723:8672]
2025-10-10T14:34:52.111394Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:52.120056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.120089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.120263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.120332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.120399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.120464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.120517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.120527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.120598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.120663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.120725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.120796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.120836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.120839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.120908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.120966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.121028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.121094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.121136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.121139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.121213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.121273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.121357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.121420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.121474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.121482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.121568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.121636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.121707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.121773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.121822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.121829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.121899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.122003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.122067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.122131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.122178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.122186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.122253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.122317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.122384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.122454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.122501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.122510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.122578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.122641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.122712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.122779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.122823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.122830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.122899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.122960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.123026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.123096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.123156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.123165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.123236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.123313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.123390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.123490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.123532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.123540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.123602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193723:8672], now have 1 active actors on pipe
2025-10-10T14:34:52.123864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601540922193723:8672]
2025-10-10T14:34:52.123896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:52.123944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:52.123947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:52.123976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1479 reason: error at write: Disconnected sessionId: src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0
2025-10-10T14:34:52.124215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1479 sessionId: src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0 is DEAD
2025-10-10T14:34:52.124351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:52.124359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0] Write session will restart in 0.006135s
2025-10-10T14:34:52.124384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0] Write session: Do CDS request
2025-10-10T14:34:52.124390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:52.124618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:52.131875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.131952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:52.131965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1480
2025-10-10T14:34:52.132097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.132140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:52.132151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:52.132156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:52.132597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1480 sessionId:  describe result for acl check
2025-10-10T14:34:52.132630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:52.132632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:52.132634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:52.132641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601540922193749:9133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:52.133191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601540922193749:9133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:52.134449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:52.136290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:52.136516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:52.136528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:52.136540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:52.136599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:52.136643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601540139969692:8711]
2025-10-10T14:34:52.137114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601540922193749:9133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:52.137293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:52.137617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:52.137673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:52.138021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:52.138093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.138100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.138101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.138102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.138103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.138105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.138106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.138107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.138109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.138110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.138111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.138112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.138113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.138121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.138134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.138137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.138141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.138144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.138147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.138150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.138154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.138157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.138161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.138164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.138168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.138171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.138179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.138186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.138192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.138199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.138203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.138207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.138211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.138216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.138221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.138226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.138230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.138235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.138239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.138243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.138247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.138252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.138256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.138261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.138266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.138271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.138275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.138280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.138284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.138289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.138293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.138299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.138346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:52.140927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601540922193749:9133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:52.140945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601540922193749:9133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:52.140948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601540922193749:9133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:52.140956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:52.140968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:52.141290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:52.141310Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:52.141313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:52.141317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:52.141325Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1479 [2:7559601540139969692:8711]
2025-10-10T14:34:52.141373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:52.141396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:52.141405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.141409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.141411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.141430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:52.141443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:52.141450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:52.141509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.141516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.141518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.141522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:52.141590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:52.141597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.141611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.141632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.141652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:52.141684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193786:9133], now have 1 active actors on pipe
2025-10-10T14:34:52.141704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193725:2438], now have 1 active actors on pipe
2025-10-10T14:34:52.141712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601540139969686:8711]
2025-10-10T14:34:52.141719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601540139969686:8711]
2025-10-10T14:34:52.141721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601540139969686:8711]
2025-10-10T14:34:52.141734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:52.141737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1479
2025-10-10T14:34:52.141747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:52.141764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1479
2025-10-10T14:34:52.141748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:52.141760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:52.141763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:52.141768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:52.141772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:52.141802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601540139969686:8711]
2025-10-10T14:34:52.141814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:52.141823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:52.141930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.141945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.141981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:52.141995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.142003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.142006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:52.142019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.142047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:52.142068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.142270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.142280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.142301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.142410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1480 partition: 0 MaxSeqNo: 40 sessionId: src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0
2025-10-10T14:34:52.142804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21d295ca-4ca3b31d-c1b7f05d-c08a8c4a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:52.145640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0] Write session: try to update token
2025-10-10T14:34:52.145665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:52.164628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId: src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:52.166621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:52.166646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:52.166650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:52.166652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:52.166662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601540139969686:8711]
2025-10-10T14:34:52.166666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601540139969686:8711]
2025-10-10T14:34:52.166674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601540139969686:8711]
2025-10-10T14:34:52.167431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:52.166724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:52.166728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:52.166735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:52.166740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:52.166742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.166744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:52.166880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:52.224184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601540922193793:8672]
2025-10-10T14:34:52.224647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1479, pipe: [1:7559601540922193793:8672]
2025-10-10T14:34:52.288810Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:52.289113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.289130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.289177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193793:8672], now have 1 active actors on pipe
2025-10-10T14:34:52.289452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:52.289557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601540922193793:8672]
2025-10-10T14:34:52.289559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:52.289588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:52.289650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1480 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0
2025-10-10T14:34:52.289879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1480 sessionId: src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0 is DEAD
2025-10-10T14:34:52.290006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:52.290016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0] Write session will restart in 0.005735s
2025-10-10T14:34:52.290052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0] Write session: Do CDS request
2025-10-10T14:34:52.290059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:52.296855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.296980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:52.296996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1481
2025-10-10T14:34:52.297516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.297557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:52.297569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:52.297573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:52.298025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1481 sessionId:  describe result for acl check
2025-10-10T14:34:52.298063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:52.298069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:52.298071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:52.298077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601540922193802:9137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:52.298687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601540922193802:9137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:52.303360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601540922193802:9137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:52.306124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601540922193802:9137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:52.306142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601540922193802:9137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:52.306146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601540922193802:9137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:52.306155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:52.313525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:52.314234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:52.314463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:52.314475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:52.314488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:52.314549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:52.314598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601540139969758:8713]
2025-10-10T14:34:52.315277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:52.315643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:52.315702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:52.316056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:52.316122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.316123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.316125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.316126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.316128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.316129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.316131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.316133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.316135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.316136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.316138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.316139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.316140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.316147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.316162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.316167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.316171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.316179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.316184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.316188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.316194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.316199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.316203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.316207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.316211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.316215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.316223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.316232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.316239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.316244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.316250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.316256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.316261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.316267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.316271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.316276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.316280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.316287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.316292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.316297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.316301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.316306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.316310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.316316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.316320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.316326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.316331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.316336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.316344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.316350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.316355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.316362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.316408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:52.319111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:52.319475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:52.319488Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:52.319491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:52.319495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:52.319502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1480 [2:7559601540139969758:8713]
2025-10-10T14:34:52.319517Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:52.319555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:52.319565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.319569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.319571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.319590Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:52.319604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:52.319626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:52.319697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.319704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.319706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.319709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:52.319792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:52.319802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.319815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.319837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.319857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:52.319882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193839:9137], now have 1 active actors on pipe
2025-10-10T14:34:52.319892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193794:2438], now have 1 active actors on pipe
2025-10-10T14:34:52.319900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601540139969753:8713]
2025-10-10T14:34:52.319903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601540139969753:8713]
2025-10-10T14:34:52.319905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601540139969753:8713]
2025-10-10T14:34:52.319918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:52.319939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:52.319940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:52.319944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:52.319947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:52.319961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:52.319965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:52.320000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601540139969753:8713]
2025-10-10T14:34:52.320012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:52.320032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:52.320247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.320170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1480
2025-10-10T14:34:52.320265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.320203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1480
2025-10-10T14:34:52.320310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a387bf74-268e0bc2-cf4374f1-98765963_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:52.320325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.320334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.320337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:52.320350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.320367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:52.320401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.320606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.320620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.320636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.320734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1481 partition: 0 MaxSeqNo: 40 sessionId: src_id|a387bf74-268e0bc2-cf4374f1-98765963_0
2025-10-10T14:34:52.321197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d5c42-67122556-e78654b0-3d7c7b6f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a387bf74-268e0bc2-cf4374f1-98765963_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:52.324137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a387bf74-268e0bc2-cf4374f1-98765963_0] Write session: try to update token
2025-10-10T14:34:52.324157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a387bf74-268e0bc2-cf4374f1-98765963_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:52.332422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:52.332445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:52.332456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601540139969753:8713]
2025-10-10T14:34:52.332506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:52.332531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:52.332680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:52.332836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:52.332983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:52.333124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:52.333317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:52.333375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:52.342654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId: src_id|a387bf74-268e0bc2-cf4374f1-98765963_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:52.345517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:52.345759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.345785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.345828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:52.345978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:52.351520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:52.351544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:52.351547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:52.351552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:52.351563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601540139969753:8713]
2025-10-10T14:34:52.351568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601540139969753:8713]
2025-10-10T14:34:52.351572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601540139969753:8713]
2025-10-10T14:34:52.351624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:52.351627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:52.351632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.351633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:52.351635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:52.351639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:52.351781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:52.389584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601540922193863:8672]
2025-10-10T14:34:52.389889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1480, pipe: [1:7559601540922193863:8672]
2025-10-10T14:34:52.464424Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:52.474863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.474890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.475072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.475144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.475211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.475279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.475343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.475347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.475426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.475487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.475545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.475611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.475654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.475659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.475728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.475785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.475846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.475907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.476038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.476041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.476108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.476171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.476232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.476298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.476339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.476341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.476410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.476472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.476542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.476610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.476657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.476659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.476738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.476803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.476862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.476926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.476970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.476973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.477048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.477105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.477167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.477223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.477261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.477263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.477324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.477440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.477511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.477578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.477634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.477642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.477712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.477777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.477842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.477907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.477953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.477961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.478029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:52.478098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:52.478165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:52.478238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:52.478281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:52.478284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:52.478353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193863:8672], now have 1 active actors on pipe
2025-10-10T14:34:52.478650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601540922193863:8672]
2025-10-10T14:34:52.478686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:52.478689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:52.478718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1481 reason: error at write: Disconnected sessionId: src_id|a387bf74-268e0bc2-cf4374f1-98765963_0
2025-10-10T14:34:52.478923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1481 sessionId: src_id|a387bf74-268e0bc2-cf4374f1-98765963_0 is DEAD
2025-10-10T14:34:52.479061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a387bf74-268e0bc2-cf4374f1-98765963_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:52.479057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:52.479072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a387bf74-268e0bc2-cf4374f1-98765963_0] Write session will restart in 0.008403s
2025-10-10T14:34:52.479104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a387bf74-268e0bc2-cf4374f1-98765963_0] Write session: Do CDS request
2025-10-10T14:34:52.479110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a387bf74-268e0bc2-cf4374f1-98765963_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:52.479399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:52.488965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a387bf74-268e0bc2-cf4374f1-98765963_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.489038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:52.489054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1482
2025-10-10T14:34:52.489212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.489254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:52.489259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:52.489264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:52.489812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1482 sessionId:  describe result for acl check
2025-10-10T14:34:52.489847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:52.489852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:52.489853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:52.489862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601540922193906:9147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:52.490081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:52.490497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601540922193906:9147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:52.491803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:52.492042Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:52.492056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:52.492068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:52.492126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:52.492172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601540139969854:8726]
2025-10-10T14:34:52.492700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:52.493047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:52.493107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:52.493451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:52.493529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.493537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.493538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.493539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.493540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.493542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.493543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.493544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.493546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.493547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.493548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.493550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.493551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.493556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.493568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.493572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.493575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.493579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.493582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.493586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.493589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.493593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.493588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601540922193906:9147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:52.493598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.493601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.493605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.493608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.493615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.493623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.493628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.493636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.493640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.493647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.493651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.493656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.493661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.493665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.493668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.493673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.493677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.493682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.493686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.493690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.493694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.493699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.493702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.493707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.493712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.493716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.493720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.493725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.493729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.493733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.493768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:52.496593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601540922193906:9147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:52.496608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601540922193906:9147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:52.496611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601540922193906:9147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:52.496620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:52.496541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:52.496899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:52.496904Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:52.496906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:52.496910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:52.496916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1481 [2:7559601540139969854:8726]
2025-10-10T14:34:52.496929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:52.496948Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:52.496964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.496968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.496970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.496987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:52.496994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:52.497002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:52.497059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.497062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.497063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.497065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:52.497139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:52.497143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.497155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.497165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.497181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:52.497205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601540139969848:8726]
2025-10-10T14:34:52.497206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601540139969848:8726]
2025-10-10T14:34:52.497208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601540139969848:8726]
2025-10-10T14:34:52.497216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:52.497348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1481
2025-10-10T14:34:52.497383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1481
2025-10-10T14:34:52.497227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:52.497230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:52.497234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:52.497244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:52.497262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:52.497265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:52.497277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193879:2438], now have 1 active actors on pipe
2025-10-10T14:34:52.497281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193940:9147], now have 1 active actors on pipe
2025-10-10T14:34:52.497323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601540139969848:8726]
2025-10-10T14:34:52.497347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:52.497391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:52.497766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.497781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.497813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:52.497828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.497838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.497840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:52.497853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.497881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:52.497901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.498096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.498105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.498120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.500107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1482 partition: 0 MaxSeqNo: 40 sessionId: src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0
2025-10-10T14:34:52.501262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a387bf74-268e0bc2-cf4374f1-98765963_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:52.503920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0] Write session: try to update token
2025-10-10T14:34:52.503937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:52.520973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:52.520993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:52.520996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:52.520998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:52.521007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601540139969848:8726]
2025-10-10T14:34:52.521011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601540139969848:8726]
2025-10-10T14:34:52.521015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601540139969848:8726]
2025-10-10T14:34:52.521064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:52.521063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:52.521069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:52.521073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:52.521078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.521081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:52.521224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:52.525637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId: src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:52.528336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:52.579047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601540922193959:8672]
2025-10-10T14:34:52.579316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1481, pipe: [1:7559601540922193959:8672]
2025-10-10T14:34:52.635968Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:52.636487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.636509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.636558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193959:8672], now have 1 active actors on pipe
2025-10-10T14:34:52.636809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601540922193959:8672]
2025-10-10T14:34:52.636829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:52.636834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:52.636841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:52.636905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1482 reason: error at write: Disconnected sessionId: src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0
2025-10-10T14:34:52.636989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:52.637605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:52.637615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0] Write session will restart in 0.009484s
2025-10-10T14:34:52.637640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0] Write session: Do CDS request
2025-10-10T14:34:52.637645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:52.637106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1482 sessionId: src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0 is DEAD
2025-10-10T14:34:52.646512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:52.647952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.648000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:52.648034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1483
2025-10-10T14:34:52.648167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.648214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:52.648226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:52.648229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:52.648275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:52.648501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:52.648512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:52.648525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:52.648584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:52.648630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601540139969939:8731]
2025-10-10T14:34:52.648638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1483 sessionId:  describe result for acl check
2025-10-10T14:34:52.648691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:52.648698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:52.648729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:52.648740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601540922194009:9156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:52.649218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:52.649365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601540922194009:9156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:52.649567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:52.649635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:52.649971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:52.650037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.650044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.650046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.650047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.650048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.650050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.650051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.650053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.650054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.650055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.650058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.650060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.650061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.650068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.650080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.650084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.650087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.650091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.650096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.650099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.650103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.650107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.650112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.650115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.650119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.650122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.650132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.650140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.650152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.650157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.650163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.650168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.650173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.650177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.650181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.650186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.650191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.650196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.650212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.650221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.650224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.650229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.650233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.650238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.650241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.650246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.650250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.650255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.650258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.650262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.650266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.650270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.650308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:52.653469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601540922194009:9156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:52.653974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:52.654317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:52.654332Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:52.654338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:52.654343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:52.654350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1482 [2:7559601540139969939:8731]
2025-10-10T14:34:52.654364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:52.654382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:52.654390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.654394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.654396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.654415Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:52.654426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:52.654435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:52.654500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.654507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.654509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.654512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:52.654587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:52.654596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.654607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.654623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.654644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:52.654667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601540139969934:8731]
2025-10-10T14:34:52.654668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601540139969934:8731]
2025-10-10T14:34:52.654671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601540139969934:8731]
2025-10-10T14:34:52.654680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:52.654691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:52.654695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:52.654697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:52.654698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922193978:2438], now have 1 active actors on pipe
2025-10-10T14:34:52.654705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:52.654721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:52.654725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:52.654754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601540139969934:8731]
2025-10-10T14:34:52.654767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:52.654841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1482
2025-10-10T14:34:52.654842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:52.661027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601540922194009:9156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:52.661044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601540922194009:9156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:52.661049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601540922194009:9156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:52.661059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:52.661354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922194047:9156], now have 1 active actors on pipe
2025-10-10T14:34:52.661428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1482
2025-10-10T14:34:52.661570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.661584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.661620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:52.661642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.661652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.661655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:52.661672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.661708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:52.661733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.661956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.661976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.662015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.662105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1483 partition: 0 MaxSeqNo: 40 sessionId: src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0
2025-10-10T14:34:52.662545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5655891-ac8c272-85f8fa3d-e4b726cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:52.665395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0] Write session: try to update token
2025-10-10T14:34:52.665416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:52.674648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:52.674669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:52.674675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:52.674677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:52.674687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601540139969934:8731]
2025-10-10T14:34:52.674692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601540139969934:8731]
2025-10-10T14:34:52.674696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601540139969934:8731]
2025-10-10T14:34:52.674758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:52.674766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:52.674773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:52.674775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.674777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:52.674778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:52.674918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:52.681659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId: src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:52.684312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:52.736677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601540922194053:8672]
2025-10-10T14:34:52.736983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1482, pipe: [1:7559601540922194053:8672]
2025-10-10T14:34:52.787824Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:52.788224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.788242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.788277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922194053:8672], now have 1 active actors on pipe
2025-10-10T14:34:52.788497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:52.788496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601540922194053:8672]
2025-10-10T14:34:52.788514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:52.788519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:52.788534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:52.788594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1483 reason: error at write: Disconnected sessionId: src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0
2025-10-10T14:34:52.788808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1483 sessionId: src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0 is DEAD
2025-10-10T14:34:52.789003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:52.789012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0] Write session will restart in 0.006732s
2025-10-10T14:34:52.789036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0] Write session: Do CDS request
2025-10-10T14:34:52.789043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:52.796937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.797030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:52.797046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1484
2025-10-10T14:34:52.797188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.797248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:52.797259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:52.797263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:52.797716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:52.797995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1484 sessionId:  describe result for acl check
2025-10-10T14:34:52.798033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:52.798039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:52.798041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:52.798049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601540922194085:9160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:52.798648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601540922194085:9160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:52.799324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:52.799530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:52.799546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:52.799559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:52.799622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:52.799673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601540139970009:8734]
2025-10-10T14:34:52.800240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:52.800533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:52.800583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:52.800671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601540922194085:9160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:52.800883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:52.800958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.800965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.800967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.800968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.800969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.800970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.800971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.800972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.800974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.800975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.800976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.800977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.800978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.800985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.800997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.801002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.801006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.801010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.801013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.801017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.801021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.801025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.801030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.801034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.801038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.801042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.801051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.801060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.801067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.801072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.801076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.801081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.801087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.801092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.801096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.801101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.801105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.801110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.801117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.801122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.801135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.801140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.801145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.801150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.801155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.801160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.801164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.801170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.801174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.801179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.801184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.801188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.801230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:52.803475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601540922194085:9160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:52.803500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601540922194085:9160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:52.803504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601540922194085:9160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:52.803512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:52.803652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:52.803963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:52.803976Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:52.803978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:52.803982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:52.803988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1483 [2:7559601540139970009:8734]
2025-10-10T14:34:52.804003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:52.804024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:52.804032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.804036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.804038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.804055Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:52.804078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:52.804086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:52.804143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.804165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.804167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.804170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:52.804237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:52.804245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.804257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.804268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.804287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:52.804320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922194054:2438], now have 1 active actors on pipe
2025-10-10T14:34:52.804332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922194119:9160], now have 1 active actors on pipe
2025-10-10T14:34:52.804340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601540139970004:8734]
2025-10-10T14:34:52.804343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601540139970004:8734]
2025-10-10T14:34:52.804345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601540139970004:8734]
2025-10-10T14:34:52.804357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:52.804371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:52.804345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1483
2025-10-10T14:34:52.804376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:52.804380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:52.804391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1483
2025-10-10T14:34:52.804382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:52.804392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:52.804396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:52.804421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601540139970004:8734]
2025-10-10T14:34:52.804429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:52.804431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:52.804450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.804460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.804509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf210f12-14b71d49-35e80871-5f1699b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:52.804524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.804528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.804530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:52.804541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.804551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:52.804576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.804712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.804719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.804744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.804849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1484 partition: 0 MaxSeqNo: 40 sessionId: src_id|cf210f12-14b71d49-35e80871-5f1699b0_0
2025-10-10T14:34:52.805277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d961bed2-b12974d2-7b0964a2-f6dc7422_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cf210f12-14b71d49-35e80871-5f1699b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:52.808029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf210f12-14b71d49-35e80871-5f1699b0_0] Write session: try to update token
2025-10-10T14:34:52.808047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf210f12-14b71d49-35e80871-5f1699b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:52.822895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId: src_id|cf210f12-14b71d49-35e80871-5f1699b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:52.824507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:52.824533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:52.824537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:52.824539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:52.824551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601540139970004:8734]
2025-10-10T14:34:52.824558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601540139970004:8734]
2025-10-10T14:34:52.824564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601540139970004:8734]
2025-10-10T14:34:52.824620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:52.824643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.824645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:52.824868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:52.826263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:52.826398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:52.826411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:52.826415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:52.888794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601540922194126:8672]
2025-10-10T14:34:52.889089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1483, pipe: [1:7559601540922194126:8672]
2025-10-10T14:34:52.938008Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:52.938316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.938332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.938379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922194126:8672], now have 1 active actors on pipe
2025-10-10T14:34:52.938601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:52.938614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:52.938619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601540922194126:8672]
2025-10-10T14:34:52.938641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:52.938643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:52.938710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1484 reason: error at write: Disconnected sessionId: src_id|cf210f12-14b71d49-35e80871-5f1699b0_0
2025-10-10T14:34:52.938920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1484 sessionId: src_id|cf210f12-14b71d49-35e80871-5f1699b0_0 is DEAD
2025-10-10T14:34:52.939103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf210f12-14b71d49-35e80871-5f1699b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:52.939112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf210f12-14b71d49-35e80871-5f1699b0_0] Write session will restart in 0.006208s
2025-10-10T14:34:52.939137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf210f12-14b71d49-35e80871-5f1699b0_0] Write session: Do CDS request
2025-10-10T14:34:52.939145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf210f12-14b71d49-35e80871-5f1699b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:52.946873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf210f12-14b71d49-35e80871-5f1699b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.947005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:52.947023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1485
2025-10-10T14:34:52.947211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:52.947254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:52.947265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:52.947269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:52.947716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1485 sessionId:  describe result for acl check
2025-10-10T14:34:52.947752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:52.947761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:52.947763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:52.947769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601540922194157:9164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:52.948315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601540922194157:9164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:52.949043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:52.951099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601540922194157:9164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:52.953297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:52.953583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:52.953597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:52.953611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:52.953680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:52.953721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601540139970079:8736]
2025-10-10T14:34:52.954335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:52.954708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:52.954776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:52.955113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:52.955181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.955189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.955191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.955192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.955194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.955195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.955196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.955198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.955199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.955200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.955202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.955203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.955205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.955212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.955223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.955227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.955238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.955242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.955248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.955252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.955257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.955261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.955266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.955269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.955272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.955288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.955302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.955315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:52.955327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.955333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:52.955343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.955353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:52.955362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.955371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:52.955381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.955390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:52.955400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.955410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:52.955419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.955427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:52.955436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.955443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:52.955451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.955457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:52.955466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.955491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:52.955500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.955509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.955518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.955527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.955536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.955545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.955594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:52.958110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601540922194157:9164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:52.958126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601540922194157:9164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:52.958129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601540922194157:9164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:52.958143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:52.961764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:52.962093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:52.962110Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:52.962112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:52.962117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:52.962124Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1484 [2:7559601540139970079:8736]
2025-10-10T14:34:52.962142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:52.962169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:52.962177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.962182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.962185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.962204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:52.962217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:52.962229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:52.962293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.962300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.962302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.962304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:52.962380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:52.962388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.962400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:52.962413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:52.962434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:52.962472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601540139970073:8736]
2025-10-10T14:34:52.962479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601540139970073:8736]
2025-10-10T14:34:52.962481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601540139970073:8736]
2025-10-10T14:34:52.962494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:52.962511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:52.962531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:52.962539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:52.962561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:52.962574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:52.962576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601540139970073:8736]
2025-10-10T14:34:52.962577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:52.962578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:52.962585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:52.963178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922194127:2438], now have 1 active actors on pipe
2025-10-10T14:34:52.963192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601540922194191:9164], now have 1 active actors on pipe
2025-10-10T14:34:52.964843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1484
2025-10-10T14:34:52.964874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1484
2025-10-10T14:34:52.965117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.965137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.965177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:52.965195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:52.965205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:52.965212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:52.965238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:52.965260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:52.965282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.965501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:52.965512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:52.965535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:52.965687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1485 partition: 0 MaxSeqNo: 40 sessionId: src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0
2025-10-10T14:34:52.966076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf210f12-14b71d49-35e80871-5f1699b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:52.968702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0] Write session: try to update token
2025-10-10T14:34:52.968718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:52.988835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId: src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:52.991737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:52.990887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:52.990909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:52.990913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:52.990916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:52.990925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601540139970073:8736]
2025-10-10T14:34:52.990930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601540139970073:8736]
2025-10-10T14:34:52.990937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601540139970073:8736]
2025-10-10T14:34:52.990989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:52.990996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:52.990999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:52.991153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:52.991866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:52.991873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:52.991877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:53.038748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601545217161496:8672]
2025-10-10T14:34:53.039086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1484, pipe: [1:7559601545217161496:8672]
2025-10-10T14:34:53.102700Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:53.103131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.103149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.103198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161496:8672], now have 1 active actors on pipe
2025-10-10T14:34:53.103478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:53.107120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:53.107136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0] Write session will restart in 0.006104s
2025-10-10T14:34:53.107163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0] Write session: Do CDS request
2025-10-10T14:34:53.107171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:53.105574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:53.105641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601545217161496:8672]
2025-10-10T14:34:53.105665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:53.105767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1485 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0
2025-10-10T14:34:53.105966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1485 sessionId: src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0 is DEAD
2025-10-10T14:34:53.114892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.116456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:53.118505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:53.118759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:53.118767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:53.118781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:53.118845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:53.118879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601544434937445:8738]
2025-10-10T14:34:53.119505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:53.119867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:53.119937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:53.120254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:53.120321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.120327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.120328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.120329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.120330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.120331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.120332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.120333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.120335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.120336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.120337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.120338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.120339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.120345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.120357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.120360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.120364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.120368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.120372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.120376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.120382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.120386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.120390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.120393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.120396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.120399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.120409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.120417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.120424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.120429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.120433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.120437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.120442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.120448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.120452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.120456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.120460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.120464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.120468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.120473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.120476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.120481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.120486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.120490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.120494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.120499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.120503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.120508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.120511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.120516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.120520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.120525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.120563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:53.117669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:53.117685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1486
2025-10-10T14:34:53.117824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.117855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:53.117860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:53.117865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:53.118306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1486 sessionId:  describe result for acl check
2025-10-10T14:34:53.118339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:53.118341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:53.118345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:53.118352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601545217161531:9168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:53.118902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601545217161531:9168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:53.121149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601545217161531:9168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:53.123107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:53.123461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:53.123474Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:53.123478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:53.123483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:53.123488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1485 [2:7559601544434937445:8738]
2025-10-10T14:34:53.123502Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:53.123520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:53.123528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.123531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.123533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.123551Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:53.123563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:53.123571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:53.123629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.123637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.123638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.123641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:53.123711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:53.123722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.123732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.123742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.123757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:53.123784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161497:2438], now have 1 active actors on pipe
2025-10-10T14:34:53.123797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601544434937439:8738]
2025-10-10T14:34:53.123803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601544434937439:8738]
2025-10-10T14:34:53.123805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601544434937439:8738]
2025-10-10T14:34:53.123819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:53.123835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:53.123838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:53.123842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:53.123844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:53.123850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:53.123853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:53.123881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601544434937439:8738]
2025-10-10T14:34:53.123889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:53.123892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:53.124313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161566:9168], now have 1 active actors on pipe
2025-10-10T14:34:53.124463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.124480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.124512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:53.124526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.124531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.124533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:53.124545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.124573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:53.124594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.124875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.124884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.124901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.123812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1485
2025-10-10T14:34:53.124116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601545217161531:9168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:53.124122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601545217161531:9168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:53.124126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601545217161531:9168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:53.124134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:53.125379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8103cef-b259384d-a6d60121-78e0ef3d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:53.128258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0] Write session: try to update token
2025-10-10T14:34:53.128277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:53.124370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1485
2025-10-10T14:34:53.124972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1486 partition: 0 MaxSeqNo: 40 sessionId: src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0
2025-10-10T14:34:53.143561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:53.143590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.143594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:53.143596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:53.143607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601544434937439:8738]
2025-10-10T14:34:53.143616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601544434937439:8738]
2025-10-10T14:34:53.143620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601544434937439:8738]
2025-10-10T14:34:53.143673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:53.143687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.143689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:53.143825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:53.145394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:53.145411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:53.145416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:53.144771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId: src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:53.147355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:53.205726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601545217161572:8672]
2025-10-10T14:34:53.206041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1485, pipe: [1:7559601545217161572:8672]
2025-10-10T14:34:53.255439Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:53.255809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.255825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.255871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161572:8672], now have 1 active actors on pipe
2025-10-10T14:34:53.256086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:53.256234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601545217161572:8672]
2025-10-10T14:34:53.256269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:53.256354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1486 reason: status is not ok: tablet will be restarted right now sessionId: src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0
2025-10-10T14:34:53.256583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1486 sessionId: src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0 is DEAD
2025-10-10T14:34:53.256597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:53.256804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:53.256816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0] Write session will restart in 0.008388s
2025-10-10T14:34:53.256842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0] Write session: Do CDS request
2025-10-10T14:34:53.256849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:53.266172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:53.266921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.267023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:53.267039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1487
2025-10-10T14:34:53.267186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.267243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:53.267254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:53.267258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:53.267707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1487 sessionId:  describe result for acl check
2025-10-10T14:34:53.267742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:53.267748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:53.267750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:53.267756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601545217161607:9172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:53.268054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:53.268284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:53.268295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:53.268307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:53.268306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601545217161607:9172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:53.268360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:53.268408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601544434937516:8740]
2025-10-10T14:34:53.269053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:53.269350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:53.269395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:53.269723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:53.269795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.269801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.269802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.269804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.269805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.269807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.269808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.269809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.269811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.269812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.269814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.269815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.269817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.269823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.269835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.269840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.269844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.269849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.269853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.269857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.269861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.269866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.269871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.269875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.269879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.269883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.269890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.269899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.269910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.269916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.269927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.269934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.269943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.269949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.269958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.269964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.269975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.269980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.269985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.269991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.269997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.270004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.270013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.270019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.270023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.270029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.270034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.270039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.270043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.270051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.270055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.270064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.270107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:53.270869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601545217161607:9172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:53.272411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:53.272737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:53.272752Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:53.272754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:53.272757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:53.272763Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1486 [2:7559601544434937516:8740]
2025-10-10T14:34:53.272787Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:53.272809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:53.272816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.272819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.272823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.272840Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:53.272850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:53.272858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:53.272917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.272921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.272923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.272925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:53.272988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:53.272995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.273006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.273020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.273039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:53.273065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161573:2438], now have 1 active actors on pipe
2025-10-10T14:34:53.273077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601544434937510:8740]
2025-10-10T14:34:53.273083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601544434937510:8740]
2025-10-10T14:34:53.273085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601544434937510:8740]
2025-10-10T14:34:53.273098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:53.273115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:53.273115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:53.273118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:53.273119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:53.273133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:53.273140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:53.273102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1486
2025-10-10T14:34:53.273169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601544434937510:8740]
2025-10-10T14:34:53.273184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:53.273201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:53.274600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601545217161607:9172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:53.274614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601545217161607:9172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:53.274618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601545217161607:9172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:53.274626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:53.274859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161644:9172], now have 1 active actors on pipe
2025-10-10T14:34:53.274901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1486
2025-10-10T14:34:53.274981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.274992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.275024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44839c9-6ff0e18f-df9e439a-e8986476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:53.275047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.275057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.275059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:53.275071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.275089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:53.275111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.275318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.275326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.275342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.275446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1487 partition: 0 MaxSeqNo: 40 sessionId: src_id|44839c9-6ff0e18f-df9e439a-e8986476_0
2025-10-10T14:34:53.275797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|377a5b76-d64e11a4-1a63de08-73c2faa0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44839c9-6ff0e18f-df9e439a-e8986476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:53.278635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44839c9-6ff0e18f-df9e439a-e8986476_0] Write session: try to update token
2025-10-10T14:34:53.278657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44839c9-6ff0e18f-df9e439a-e8986476_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:53.284653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:53.284674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.284686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601544434937510:8740]
2025-10-10T14:34:53.284738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:53.284745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:53.284926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:53.285074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.285218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.285398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.285697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:53.285765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:53.296305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId: src_id|44839c9-6ff0e18f-df9e439a-e8986476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:53.299135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:53.299378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.299409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.299465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:53.299559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:53.303724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:53.303747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.303751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:53.303754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:53.303769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601544434937510:8740]
2025-10-10T14:34:53.303773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601544434937510:8740]
2025-10-10T14:34:53.303777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601544434937510:8740]
2025-10-10T14:34:53.303827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:53.303835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.303837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:53.303981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:53.305392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:53.305400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:53.305405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:53.357428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601545217161648:8672]
2025-10-10T14:34:53.357715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1486, pipe: [1:7559601545217161648:8672]
2025-10-10T14:34:53.428638Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:53.436819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.436851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.437030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.437106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.437177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.437247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.437295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.437307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.437400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.437462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.437528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.437596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.437645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.437652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.437715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.437778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.437842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.437905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.437949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.437956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.438022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.438090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.438158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.438222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.438268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.438278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.438346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.438414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.438481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.438546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.438589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.438596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.438665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.438730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.438803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.438866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.439024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.439034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.439101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.439168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.439238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.439319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.439365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.439373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.439441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.439504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.439569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.439633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.439678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.439685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.439752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.439815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.439875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.439941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.439984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.439990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.440058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.440131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.440204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.440269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.440317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.440327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.440533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161648:8672], now have 1 active actors on pipe
2025-10-10T14:34:53.440825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:53.440886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601545217161648:8672]
2025-10-10T14:34:53.440916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:53.440923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:53.440953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1487 reason: error at write: Disconnected sessionId: src_id|44839c9-6ff0e18f-df9e439a-e8986476_0
2025-10-10T14:34:53.441195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1487 sessionId: src_id|44839c9-6ff0e18f-df9e439a-e8986476_0 is DEAD
2025-10-10T14:34:53.441365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44839c9-6ff0e18f-df9e439a-e8986476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:53.441376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44839c9-6ff0e18f-df9e439a-e8986476_0] Write session will restart in 0.008694s
2025-10-10T14:34:53.441404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44839c9-6ff0e18f-df9e439a-e8986476_0] Write session: Do CDS request
2025-10-10T14:34:53.441411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44839c9-6ff0e18f-df9e439a-e8986476_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:53.441638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:53.450146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:53.451089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44839c9-6ff0e18f-df9e439a-e8986476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.451155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:53.451171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1488
2025-10-10T14:34:53.451345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.451391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:53.451400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:53.451404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:53.451956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:53.452228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:53.452243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:53.452259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:53.452332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:53.452375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601544434937600:8748]
2025-10-10T14:34:53.451859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1488 sessionId:  describe result for acl check
2025-10-10T14:34:53.451895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:53.451896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:53.451898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:53.451914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601545217161684:9176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:53.452498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601545217161684:9176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:53.452978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:53.453463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:53.453532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:53.453857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:53.453930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.453936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.453937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.453939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.453940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.453942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.453943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.453944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.453946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.453947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.453948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.453950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.453953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.453958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.453970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.453975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.453979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.453983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.453987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.453993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.453997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.454000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.454004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.454008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.454012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.454016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.454023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.454031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.454038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.454048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.454052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.454062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.454066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.454072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.454082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.454087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.454093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.454098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.454107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.454113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.454117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.454122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.454127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.454133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.454140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.454145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.454149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.454160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.454164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.454169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.454186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.454195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.454238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:53.455210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601545217161684:9176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:53.456760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:53.457083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:53.457098Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:53.457101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:53.457104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:53.457110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1487 [2:7559601544434937600:8748]
2025-10-10T14:34:53.457121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:53.457138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:53.457147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.457151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.457153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.457168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:53.457176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:53.457200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:53.457278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.457285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.457287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.457289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:53.457377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:53.457385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.457396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.457407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.457426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:53.457451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161650:2438], now have 1 active actors on pipe
2025-10-10T14:34:53.457463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601544434937595:8748]
2025-10-10T14:34:53.457469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601544434937595:8748]
2025-10-10T14:34:53.457471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601544434937595:8748]
2025-10-10T14:34:53.457484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:53.457497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:53.457500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:53.457473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1487
2025-10-10T14:34:53.457502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:53.457503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:53.457519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:53.457523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:53.457552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601544434937595:8748]
2025-10-10T14:34:53.457565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:53.457571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:53.458983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601545217161684:9176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:53.458996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601545217161684:9176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:53.458999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601545217161684:9176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:53.459007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:53.459242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161722:9176], now have 1 active actors on pipe
2025-10-10T14:34:53.459290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1487
2025-10-10T14:34:53.459376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.459387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.459435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:53.459450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.459455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.459457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:53.459469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.459499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:53.459521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.459708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.459720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.459745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.459837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1488 partition: 0 MaxSeqNo: 40 sessionId: src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0
2025-10-10T14:34:53.460226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44839c9-6ff0e18f-df9e439a-e8986476_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:53.462957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0] Write session: try to update token
2025-10-10T14:34:53.462977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:53.469535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:53.469559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.469572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601544434937595:8748]
2025-10-10T14:34:53.469613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:53.469628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:53.469884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:53.470093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.470296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.470504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.471373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:53.471443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:53.480559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId: src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:53.483314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:53.483579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.483605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.483657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:53.483759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:53.489852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:53.489872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.489877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:53.489879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:53.489891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601544434937595:8748]
2025-10-10T14:34:53.489909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601544434937595:8748]
2025-10-10T14:34:53.489914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601544434937595:8748]
2025-10-10T14:34:53.489965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:53.489971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:53.489979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.489982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:53.489992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:53.489998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:53.490136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:53.541691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601545217161739:8672]
2025-10-10T14:34:53.542268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1487, pipe: [1:7559601545217161739:8672]
2025-10-10T14:34:53.610687Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:53.618997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.619030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.619214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.619291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.619360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.619427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.619477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.619488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.619559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.619621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.619685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.619751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.619794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.619800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.619871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.619929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.619998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.620062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.620105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.620113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.620178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.620242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.620304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.620374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.620417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.620427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.620491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.620550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.620612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.620676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.620730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.620739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.620805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.620865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.620927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.620988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.621035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.621043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.621106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.621187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.621254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.621320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.621498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.621507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.621573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.621650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.621714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.621777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.621823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.621830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.621896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.621959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.622022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.622077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.622339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.622350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.622417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.622477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.622540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.622604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.622646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.622654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.622730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161739:8672], now have 1 active actors on pipe
2025-10-10T14:34:53.622929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601545217161739:8672]
2025-10-10T14:34:53.622942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:53.622947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:53.622959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:53.622992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1488 reason: error at write: Disconnected sessionId: src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0
2025-10-10T14:34:53.623180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:53.623216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1488 sessionId: src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0 is DEAD
2025-10-10T14:34:53.623396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:53.623420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0] Write session will restart in 0.008727s
2025-10-10T14:34:53.623446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0] Write session: Do CDS request
2025-10-10T14:34:53.623467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:53.632629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:53.633933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.634076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:53.634093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1489
2025-10-10T14:34:53.634206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.634251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:53.634262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:53.634268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:53.634397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:53.634628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:53.634640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:53.634653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:53.634717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:53.634713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1489 sessionId:  describe result for acl check
2025-10-10T14:34:53.634756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:53.634762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:53.634763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601544434937710:8758]
2025-10-10T14:34:53.634764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:53.634770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601545217161807:9190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:53.635375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601545217161807:9190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:53.635444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:53.635778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:53.635839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:53.636191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:53.636245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.636251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.636252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.636254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.636255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.636256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.636257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.636259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.636260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.636262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.636266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.636267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.636268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.636274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.636287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.636291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.636296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.636300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.636305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.636309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.636313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.636317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.636322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.636326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.636330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.636334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.636341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.636350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.636356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.636363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.636368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.636373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.636378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.636385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.636390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.636396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.636401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.636406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.636411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.636417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.636426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.636432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.636437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.636442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.636447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.636458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.636462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.636472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.636476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.636482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.636494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.636504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.636548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:53.637655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601545217161807:9190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:53.639850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:53.640061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601545217161807:9190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:53.640074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601545217161807:9190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:53.640077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601545217161807:9190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:53.640087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:53.640655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:53.640669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:53.640672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:53.640675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:53.640681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1488 [2:7559601544434937710:8758]
2025-10-10T14:34:53.640693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:53.640709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:53.640719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.640722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.640725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.640741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:53.640757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:53.640764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:53.640823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.640831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.640833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.640835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:53.640900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:53.640911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.640923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.640937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.640956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:53.640984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161838:9190], now have 1 active actors on pipe
2025-10-10T14:34:53.640993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161769:2438], now have 1 active actors on pipe
2025-10-10T14:34:53.641001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601544434937705:8758]
2025-10-10T14:34:53.641003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601544434937705:8758]
2025-10-10T14:34:53.641005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601544434937705:8758]
2025-10-10T14:34:53.641020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:53.641008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1488
2025-10-10T14:34:53.641039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:53.641017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1488
2025-10-10T14:34:53.641059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:53.641061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:53.641065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:53.641070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:53.641072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:53.641102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.641107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.641125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601544434937705:8758]
2025-10-10T14:34:53.641133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:53.641149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:53.641167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:53.641175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.641184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.641186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:53.641197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.641213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:53.641242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.641389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.641397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.641412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.641521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1489 partition: 0 MaxSeqNo: 40 sessionId: src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0
2025-10-10T14:34:53.641914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489fd1e5-1982d2d8-4a3102db-f616cd8a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:53.644593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0] Write session: try to update token
2025-10-10T14:34:53.644608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:53.660956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:53.660982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.660986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:53.660988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:53.660999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601544434937705:8758]
2025-10-10T14:34:53.661004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601544434937705:8758]
2025-10-10T14:34:53.661010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601544434937705:8758]
2025-10-10T14:34:53.661061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:53.661070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.661070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:53.661072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:53.661077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:53.661083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:53.661227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:53.659332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId: src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:53.662076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:53.723320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601545217161850:8672]
2025-10-10T14:34:53.723710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1488, pipe: [1:7559601545217161850:8672]
2025-10-10T14:34:53.775054Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:53.775499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.775517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.775567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161850:8672], now have 1 active actors on pipe
2025-10-10T14:34:53.776065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:53.776555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:53.776569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601545217161850:8672]
2025-10-10T14:34:53.776569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:53.776593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:53.776634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1489 reason: error at write: Disconnected sessionId: src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0
2025-10-10T14:34:53.777013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:53.777023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0] Write session will restart in 0.008622s
2025-10-10T14:34:53.777055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0] Write session: Do CDS request
2025-10-10T14:34:53.777062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:53.776838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1489 sessionId: src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0 is DEAD
2025-10-10T14:34:53.786460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:53.786997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.787071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:53.787089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1490
2025-10-10T14:34:53.787243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.787306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:53.787321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:53.787325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:53.787794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1490 sessionId:  describe result for acl check
2025-10-10T14:34:53.787833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:53.787840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:53.787842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:53.787849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601545217161899:9195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:53.788226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:53.788434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:53.788447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:53.788435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601545217161899:9195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:53.788459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:53.788522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:53.788582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601544434937786:8761]
2025-10-10T14:34:53.789187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:53.789618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:53.789667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:53.790014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:53.790081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.790087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.790088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.790089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.790090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.790091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.790093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.790094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.790095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.790096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.790098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.790099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.790100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.790107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.790119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.790123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.790127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.790131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.790135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.790138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.790142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.790145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.790152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.790155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.790158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.790162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.790170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.790178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.790184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.790189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.790194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.790199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.790203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.790209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.790214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.790219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.790224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.790230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.790244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.790249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.790254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.790259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.790264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.790268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.790272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.790276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.790279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.790283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.790287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.790291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.790295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.790300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.790336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:53.790549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601545217161899:9195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:53.793223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:53.793105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601545217161899:9195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:53.793121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601545217161899:9195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:53.793124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601545217161899:9195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:53.793133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:53.793587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:53.793604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:53.793606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:53.793610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:53.793616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1489 [2:7559601544434937786:8761]
2025-10-10T14:34:53.793629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:53.793649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:53.793652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.793656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.793659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.793680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:53.793687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:53.793694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:53.793756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.793765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.793767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.793769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:53.793840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:53.793850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.793861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.793872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.793886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:53.793913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161933:9195], now have 1 active actors on pipe
2025-10-10T14:34:53.793924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161852:2438], now have 1 active actors on pipe
2025-10-10T14:34:53.793932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601544434937781:8761]
2025-10-10T14:34:53.793934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601544434937781:8761]
2025-10-10T14:34:53.793938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601544434937781:8761]
2025-10-10T14:34:53.793951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:53.793967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:53.793982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:53.793991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:53.794023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601544434937781:8761]
2025-10-10T14:34:53.794030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:53.794033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:53.794007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1489
2025-10-10T14:34:53.794007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1489
2025-10-10T14:34:53.794037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:53.794039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:53.794047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:53.794119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.794128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.794160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:53.794174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.794178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.794180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:53.794192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.794203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:53.794218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.794418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.794427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.794442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.794526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1490 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0
2025-10-10T14:34:53.794950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd99c449-a6df707d-86b60f93-dcefbe21_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:53.797637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0] Write session: try to update token
2025-10-10T14:34:53.797656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:53.805833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:53.805853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.805865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601544434937781:8761]
2025-10-10T14:34:53.805913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:53.805922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:53.806143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:53.806340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.806607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.806781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:53.807023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:53.807079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:53.812903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId: src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:53.815627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:53.815880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.815905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.815949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:53.816071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:53.824068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:53.824092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.824095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:53.824097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:53.824109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601544434937781:8761]
2025-10-10T14:34:53.824113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601544434937781:8761]
2025-10-10T14:34:53.824117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601544434937781:8761]
2025-10-10T14:34:53.824166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:53.824174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:53.824178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.824182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:53.824181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:53.824187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:53.824311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:53.877459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601545217161941:8672]
2025-10-10T14:34:53.877771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1489, pipe: [1:7559601545217161941:8672]
2025-10-10T14:34:53.937267Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:53.945749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.945780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.945971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.946030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.946090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.946149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.946190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.946196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.946268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.946327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.946386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.946450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.946641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.946645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.946709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.946762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.946823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.946884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.946925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.946927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.946997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.947056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.947119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.947178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.947220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.947223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.947309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.947368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.947428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.947488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.947527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.947530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.947598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.947656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.947717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.947777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.947820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.947822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.947891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.947947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.948008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.948068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.948108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.948115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.948184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.948239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.948296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.948355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.948395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.948397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.949491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:53.949549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:53.949555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:53.949589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1490 reason: error at write: Disconnected sessionId: src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0
2025-10-10T14:34:53.949793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1490 sessionId: src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0 is DEAD
2025-10-10T14:34:53.950009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601545217161941:8672]
2025-10-10T14:34:53.948461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.948516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.948573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.948632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.948674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.948677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.948741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:53.948801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:53.948859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:53.948917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:53.948964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:53.948967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:53.949044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161941:8672], now have 1 active actors on pipe
2025-10-10T14:34:53.950110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:53.953709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:53.953719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0] Write session will restart in 0.005698s
2025-10-10T14:34:53.953746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0] Write session: Do CDS request
2025-10-10T14:34:53.953753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:53.960987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.961097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:53.961113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1491
2025-10-10T14:34:53.961273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:53.961310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:53.961320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:53.961324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:53.961732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1491 sessionId:  describe result for acl check
2025-10-10T14:34:53.961770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:53.961771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:53.961773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:53.961778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601545217161980:9199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:53.962287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601545217161980:9199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:53.965346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601545217161980:9199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:53.965588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:53.968176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601545217161980:9199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:53.968192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601545217161980:9199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:53.968196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601545217161980:9199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:53.968205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:53.969608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:53.969896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:53.969909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:53.969922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:53.969995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:53.970041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601544434937863:8763]
2025-10-10T14:34:53.970677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:53.971055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:53.971113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:53.971497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:53.971560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.971566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.971568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.971569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.971570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.971572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.971573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.971574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.971576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.971577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.971579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.971580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.971581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.971589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.971602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.971605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.971609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.971613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.971617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.971621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.971624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.971628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.971632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.971636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.971639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.971643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.971650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.971659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:53.971665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.971670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:53.971674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.971679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:53.971684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.971689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:53.971694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.971698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:53.971702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.971707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:53.971712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.971717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:53.971721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.971727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:53.971731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.971736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:53.971741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.971745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:53.971750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.971755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.971758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.971763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.971768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.971772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.971819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:53.974546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:53.974929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:53.974943Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:53.974945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:53.974949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:53.974956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1490 [2:7559601544434937863:8763]
2025-10-10T14:34:53.974970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:53.974991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:53.975001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.975004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.975007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.975026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:53.975034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:53.975042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:53.975107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.975109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.975111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.975114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:53.975181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:53.975183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.975194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:53.975205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:53.975222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:53.975255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217161942:2438], now have 1 active actors on pipe
2025-10-10T14:34:53.975258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601545217162009:9199], now have 1 active actors on pipe
2025-10-10T14:34:53.975268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601544434937857:8763]
2025-10-10T14:34:53.975270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601544434937857:8763]
2025-10-10T14:34:53.975272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601544434937857:8763]
2025-10-10T14:34:53.975285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:53.975295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:53.975298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:53.975299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:53.975300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:53.975315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:53.975318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:53.975349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601544434937857:8763]
2025-10-10T14:34:53.975355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:53.975364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1490
2025-10-10T14:34:53.975361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:53.975383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1490
2025-10-10T14:34:53.975593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.975608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.975654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:53.975666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:53.975671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:53.975673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:53.975685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:53.975698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:53.975719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.976026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:53.976036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:53.976059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:53.976224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1491 partition: 0 MaxSeqNo: 40 sessionId: src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0
2025-10-10T14:34:53.977459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9020c88-8fe5f78-39deb9aa-8cb8a1c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:53.980152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0] Write session: try to update token
2025-10-10T14:34:53.980170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:53.995032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:53.995050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:53.995059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:53.995061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:53.995069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601544434937857:8763]
2025-10-10T14:34:53.995074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601544434937857:8763]
2025-10-10T14:34:53.995078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601544434937857:8763]
2025-10-10T14:34:53.995132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:53.995132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:53.995140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:53.995145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:53.995146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:53.995149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:53.995297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:54.010108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId: src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:54.012770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:54.050010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601549512129316:8672]
2025-10-10T14:34:54.050385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1490, pipe: [1:7559601549512129316:8672]
2025-10-10T14:34:54.107050Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:54.107509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.107524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.107548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129316:8672], now have 1 active actors on pipe
2025-10-10T14:34:54.107892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:54.107815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:54.107828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:54.107889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1491 reason: error at write: Disconnected sessionId: src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0
2025-10-10T14:34:54.108107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1491 sessionId: src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0 is DEAD
2025-10-10T14:34:54.108171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601549512129316:8672]
2025-10-10T14:34:54.108276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:54.108305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0] Write session will restart in 0.009529s
2025-10-10T14:34:54.108209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:54.108331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0] Write session: Do CDS request
2025-10-10T14:34:54.108337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:54.117598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:54.118912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.119024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:54.119040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1492
2025-10-10T14:34:54.119214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.119283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:54.119294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:54.119299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:54.119654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:54.119834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1492 sessionId:  describe result for acl check
2025-10-10T14:34:54.119869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:54.119883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:54.119871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:54.119879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:54.119882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:54.119897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:54.119889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601549512129357:9203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:54.119969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:54.120021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601548729905234:8765]
2025-10-10T14:34:54.120478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601549512129357:9203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:54.120720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:54.121103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:54.121163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:54.121544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:54.121602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.121610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.121611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.121612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.121614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.121615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.121616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.121618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.121619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.121620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.121622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.121623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.121625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.121632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.121644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.121649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.121654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.121658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.121662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.121667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.121671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.121675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.121682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.121686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.121690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.121694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.121701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.121720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.121727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.121733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.121743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.121749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.121754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.121759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.121764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.121769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.121776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.121781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.121785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.121790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.121794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.121799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.121803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.121809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.121813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.121819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.121824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.121830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.121835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.121841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.121846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.121851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.121902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:54.122743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601549512129357:9203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:54.124235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:54.124628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:54.124641Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:54.124644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:54.124649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:54.124656Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1491 [2:7559601548729905234:8765]
2025-10-10T14:34:54.124668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:54.124684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:54.124692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.124696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.124698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.124715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:54.124723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:54.124737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:54.124796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.124802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.124804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.124806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:54.124873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:54.124883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.124896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.124908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.124926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:54.124948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129317:2438], now have 1 active actors on pipe
2025-10-10T14:34:54.124961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601548729905228:8765]
2025-10-10T14:34:54.124964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601548729905228:8765]
2025-10-10T14:34:54.124949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1491
2025-10-10T14:34:54.124965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601548729905228:8765]
2025-10-10T14:34:54.124978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:54.124993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:54.125009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:54.125014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:54.125018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:54.125021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:54.125024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:54.125043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601548729905228:8765]
2025-10-10T14:34:54.125046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:54.125048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:54.125683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601549512129357:9203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:54.125695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601549512129357:9203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:54.125699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601549512129357:9203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:54.125708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:54.126036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129392:9203], now have 1 active actors on pipe
2025-10-10T14:34:54.126097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1491
2025-10-10T14:34:54.126220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.126231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.126263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f96f0a4-fd654060-98447552-72de86ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:54.126277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.126286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.126288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:54.126303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.126316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:54.126334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.126491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.126498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.126512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.126625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1492 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f96f0a4-fd654060-98447552-72de86ca_0
2025-10-10T14:34:54.126986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c74f8bb-1a51fe8a-1a0fe35e-ff3a587e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f96f0a4-fd654060-98447552-72de86ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:54.129817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f96f0a4-fd654060-98447552-72de86ca_0] Write session: try to update token
2025-10-10T14:34:54.129838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f96f0a4-fd654060-98447552-72de86ca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:54.142377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:54.142394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:54.142407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601548729905228:8765]
2025-10-10T14:34:54.142461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:54.142643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:54.142782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.142914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.143049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.143260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:54.143305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:54.143327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:54.147082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId: src_id|7f96f0a4-fd654060-98447552-72de86ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:54.149663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:54.149900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.149921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.149963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:54.150053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:54.154486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:54.154503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:54.154506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:54.154508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:54.154519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601548729905228:8765]
2025-10-10T14:34:54.154523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601548729905228:8765]
2025-10-10T14:34:54.154526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601548729905228:8765]
2025-10-10T14:34:54.154571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:54.154580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:54.154586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:54.154589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.154591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:54.154594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:54.154726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:54.207685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601549512129398:8672]
2025-10-10T14:34:54.208051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1491, pipe: [1:7559601549512129398:8672]
2025-10-10T14:34:54.273568Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:54.282281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.282311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.282516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.282588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.282672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.282738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.283232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.283260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.283331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.283408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.283474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.283545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.283590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.283598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.283666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.283729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.283805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.283879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.283918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.283922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.283993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.284058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.284121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.284182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.284229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.284232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.284305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.284366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.284439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.284505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.284545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.284550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.284621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.284678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.284742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.284806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.284847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.284850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.284920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.284981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.285047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.285108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.285171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.285174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.285242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.285629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.285686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.285749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.285790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.285793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.285864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.285922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.285981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.286048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.286092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.286095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.286166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.286224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.286328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.286395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.286459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.286463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.286537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129398:8672], now have 1 active actors on pipe
2025-10-10T14:34:54.287971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f96f0a4-fd654060-98447552-72de86ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:54.287985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f96f0a4-fd654060-98447552-72de86ca_0] Write session will restart in 0.006684s
2025-10-10T14:34:54.288020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f96f0a4-fd654060-98447552-72de86ca_0] Write session: Do CDS request
2025-10-10T14:34:54.288026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f96f0a4-fd654060-98447552-72de86ca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:54.287493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601549512129398:8672]
2025-10-10T14:34:54.287535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:54.287537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:54.287570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1492 reason: error at write: Disconnected sessionId: src_id|7f96f0a4-fd654060-98447552-72de86ca_0
2025-10-10T14:34:54.287824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1492 sessionId: src_id|7f96f0a4-fd654060-98447552-72de86ca_0 is DEAD
2025-10-10T14:34:54.287987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:54.287464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:54.295941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f96f0a4-fd654060-98447552-72de86ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.297485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:54.297499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1493
2025-10-10T14:34:54.298757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:54.297660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.297700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:54.297706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:54.297709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:54.298127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1493 sessionId:  describe result for acl check
2025-10-10T14:34:54.298168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:54.298169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:54.298172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:54.298178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601549512129437:9207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:54.298729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601549512129437:9207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:54.300764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:54.300956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:54.300961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:54.300972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:54.301025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:54.301062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601548729905311:8767]
2025-10-10T14:34:54.301712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:54.302413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601549512129437:9207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:54.302135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:54.302175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:54.302497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:54.302547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.302549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.302550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.302551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.302553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.302554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.302555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.302558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.302559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.302561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.302562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.302563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.302564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.302570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.302582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.302586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.302591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.302595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.302599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.302603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.302606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.302610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.302614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.302618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.302623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.302626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.302633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.302641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.302648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.302653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.302658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.302664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.302669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.302674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.302679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.302684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.302689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.302695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.302703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.302708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.302713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.302719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.302724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.302729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.302735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.302740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.302746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.302751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.302757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.302763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.302767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.302773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.302814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:54.305756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601549512129437:9207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:54.305771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601549512129437:9207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:54.305775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601549512129437:9207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:54.305783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:54.306282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1492
2025-10-10T14:34:54.306309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1492
2025-10-10T14:34:54.305574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:54.305926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:54.305931Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:54.305933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:54.305937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:54.305946Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1492 [2:7559601548729905311:8767]
2025-10-10T14:34:54.305959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:54.305977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:54.305980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.305984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.305986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.306004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:54.306012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:54.306020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:54.306078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.306079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.306082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.306084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:54.306158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:54.306161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.306171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.306181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.306196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:54.306217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129474:9207], now have 1 active actors on pipe
2025-10-10T14:34:54.306220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129399:2438], now have 1 active actors on pipe
2025-10-10T14:34:54.306227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601548729905305:8767]
2025-10-10T14:34:54.306229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601548729905305:8767]
2025-10-10T14:34:54.306231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601548729905305:8767]
2025-10-10T14:34:54.306245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:54.306256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:54.306258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:54.306259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:54.306261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:54.306273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:54.306278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:54.306304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601548729905305:8767]
2025-10-10T14:34:54.306310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:54.306352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:54.306566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.306574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.306610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:54.306621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.306626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.306628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:54.306643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.306664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:54.306681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.309435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.309450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.309484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.310407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1493 partition: 0 MaxSeqNo: 40 sessionId: src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0
2025-10-10T14:34:54.313644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f96f0a4-fd654060-98447552-72de86ca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:54.316378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0] Write session: try to update token
2025-10-10T14:34:54.316406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:54.334698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId: src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:54.337288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:54.338687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.338709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.338734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:54.338739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:54.338743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:54.338745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:54.338753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601548729905305:8767]
2025-10-10T14:34:54.338757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601548729905305:8767]
2025-10-10T14:34:54.338764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601548729905305:8767]
2025-10-10T14:34:54.338814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:54.338830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:54.338836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:54.338836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.338839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:54.338841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:54.338986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:54.387988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601549512129481:8672]
2025-10-10T14:34:54.388300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1492, pipe: [1:7559601549512129481:8672]
2025-10-10T14:34:54.481374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:54.480317Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:54.480636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:54.480687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129481:8672], now have 1 active actors on pipe
2025-10-10T14:34:54.482149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:54.482202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601549512129481:8672]
2025-10-10T14:34:54.506105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:54.506116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:54.506144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1493 reason: error at write: Disconnected sessionId: src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0
2025-10-10T14:34:54.506294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1493 sessionId: src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0 is DEAD
2025-10-10T14:34:54.509475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:54.509490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0] Write session will restart in 0.005579s
2025-10-10T14:34:54.509515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0] Write session: Do CDS request
2025-10-10T14:34:54.509522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:54.515986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.520142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:54.520164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1494
2025-10-10T14:34:54.520366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.520403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:54.520408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:54.520412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:54.520926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1494 sessionId:  describe result for acl check
2025-10-10T14:34:54.520961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:54.520963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:54.520965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:54.520974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601549512129499:9211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:54.521577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601549512129499:9211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:54.525452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601549512129499:9211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:54.530438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601549512129499:9211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:54.530454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601549512129499:9211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:54.530458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601549512129499:9211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:54.530467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:54.532589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:54.534331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:54.534731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:54.534745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:54.534761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:54.534839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:54.534895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601548729905422:8775]
2025-10-10T14:34:54.535552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:54.537181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:54.537258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:54.537623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:54.537707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.537708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.537709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.537711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.537712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.537713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.537715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.537716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.537718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.537719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.537720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.537721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.537722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.537729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.537758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.537761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.537765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.537770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.537774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.537778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.537782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.537786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.537790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.537794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.537798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.537802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.537813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.537821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.537828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.537833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.537838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.537844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.537850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.537867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.537871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.537876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.537881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.537887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.537891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.537896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.537900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.537905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.537910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.537916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.537920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.537926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.537930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.537935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.537939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.537944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.537949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.537954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.537997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:54.540686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:54.541135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:54.541146Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:54.541149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:54.541153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:54.541161Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1493 [2:7559601548729905422:8775]
2025-10-10T14:34:54.541174Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:54.541192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:54.541200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.541204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.541206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.541223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:54.541231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:54.541239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:54.541302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.541305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.541308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.541311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:54.541401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:54.541411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.541424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.541437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.541458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:54.541484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601548729905417:8775]
2025-10-10T14:34:54.541491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601548729905417:8775]
2025-10-10T14:34:54.541493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601548729905417:8775]
2025-10-10T14:34:54.541503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:54.541511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:54.541514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:54.541516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:54.541520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:54.541536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:54.541539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:54.541550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129484:2438], now have 1 active actors on pipe
2025-10-10T14:34:54.541554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129553:9211], now have 1 active actors on pipe
2025-10-10T14:34:54.541578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601548729905417:8775]
2025-10-10T14:34:54.541587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:54.541665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1493
2025-10-10T14:34:54.541691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1493
2025-10-10T14:34:54.541892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:54.541947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.541959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.541990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:54.541999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.542002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.542006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:54.542018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.542030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:54.542045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.542442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.542458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.542483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.542600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1494 partition: 0 MaxSeqNo: 40 sessionId: src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0
2025-10-10T14:34:54.543035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ecf2c88-b40cb94c-bff2480c-c21643e7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:54.545787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0] Write session: try to update token
2025-10-10T14:34:54.545806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:54.563815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId: src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:54.564913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:54.564938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:54.564941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:54.564943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:54.564954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601548729905417:8775]
2025-10-10T14:34:54.564959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601548729905417:8775]
2025-10-10T14:34:54.564963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601548729905417:8775]
2025-10-10T14:34:54.565013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:54.565022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:54.565027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:54.565031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.565032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:54.565034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:54.565226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:54.566988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:54.582511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601549512129569:8672]
2025-10-10T14:34:54.582842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1493, pipe: [1:7559601549512129569:8672]
2025-10-10T14:34:54.682482Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:54.682850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.682860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.682905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129569:8672], now have 1 active actors on pipe
2025-10-10T14:34:54.683172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:54.683166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601549512129569:8672]
2025-10-10T14:34:54.683201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:54.683204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:54.683284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1494 reason: error at write: Disconnected sessionId: src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0
2025-10-10T14:34:54.683512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1494 sessionId: src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0 is DEAD
2025-10-10T14:34:54.683546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:54.685575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:54.685591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0] Write session will restart in 0.008116s
2025-10-10T14:34:54.685626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0] Write session: Do CDS request
2025-10-10T14:34:54.685635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:54.695053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.695041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:54.695056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1495
2025-10-10T14:34:54.695350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:54.695350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.695388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:54.695394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:54.695398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:54.695898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1495 sessionId:  describe result for acl check
2025-10-10T14:34:54.695940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:54.695947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:54.695949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:54.695957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601549512129659:9226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:54.696553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601549512129659:9226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:54.696942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:54.697154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:54.697166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:54.697178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:54.697237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:54.697284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601548729905518:8785]
2025-10-10T14:34:54.697957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:54.698250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:54.698296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:54.698618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:54.698676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.698682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.698683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.698685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.698687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.698688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.698689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.698691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.698692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.698693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.698694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.698696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.698697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.698703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.698719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.698723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.698728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.698732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.698736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.698741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.698745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.698749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.698754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.698758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.698763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.698767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.698774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.698787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.698795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.698802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.698814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.698819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.698824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.698829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.698835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.698840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.698845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.698850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.698856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.698861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.698867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.698873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.698878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.698884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.698889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.698896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.698900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.698906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.698916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.698921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.698926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.698932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.698984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:54.701533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:54.701994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:54.702005Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:54.702009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:54.702014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:54.702022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1494 [2:7559601548729905518:8785]
2025-10-10T14:34:54.702036Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:54.702065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:54.702073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.702076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.702079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.702098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:54.702111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:54.702123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:54.702197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.702203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.702204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.702207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:54.702274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:54.702281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.702292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.702307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.702328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:54.702354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129615:2438], now have 1 active actors on pipe
2025-10-10T14:34:54.702366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601548729905513:8785]
2025-10-10T14:34:54.702368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601548729905513:8785]
2025-10-10T14:34:54.702370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601548729905513:8785]
2025-10-10T14:34:54.702382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:54.702352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1494
2025-10-10T14:34:54.702389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:54.702392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:54.702393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:54.702435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:54.702457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:54.702464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:54.702504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601549512129659:9226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:54.702499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601548729905513:8785]
2025-10-10T14:34:54.702512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:54.702539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:54.707517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601549512129659:9226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:54.707534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601549512129659:9226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:54.707538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601549512129659:9226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:54.707547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:54.707872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129698:9226], now have 1 active actors on pipe
2025-10-10T14:34:54.707988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1494
2025-10-10T14:34:54.708082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.708099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.708137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:54.708155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.708162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.708164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:54.708179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.708202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:54.708226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.708368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.708375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.708390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.708493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1495 partition: 0 MaxSeqNo: 40 sessionId: src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0
2025-10-10T14:34:54.708900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4024d5ac-f9620ae3-2e0c7f23-35a4f06a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:54.711469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0] Write session: try to update token
2025-10-10T14:34:54.711486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:54.713683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:54.713699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:54.713712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601548729905513:8785]
2025-10-10T14:34:54.713759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:54.713762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:54.713933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:54.714085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.714217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.714350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.714546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:54.714585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:54.729872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId: src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:54.732503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:54.732830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.732852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.732893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:54.733014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:54.740086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:54.740103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:54.740106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:54.740108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:54.740120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601548729905513:8785]
2025-10-10T14:34:54.740124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601548729905513:8785]
2025-10-10T14:34:54.740131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601548729905513:8785]
2025-10-10T14:34:54.740179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:54.740181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:54.740187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.740189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:54.740191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:54.740194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:54.740333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:54.783180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601549512129701:8672]
2025-10-10T14:34:54.783554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1494, pipe: [1:7559601549512129701:8672]
2025-10-10T14:34:54.855667Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:54.864539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.864574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.864782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.864858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.864931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.865006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.865326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.865360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.865439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.865511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.865575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.865644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.865686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.865689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.865756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.865815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.865877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.865936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.865978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.865981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.866052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.866433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.869154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601549512129701:8672]
2025-10-10T14:34:54.869191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:54.869195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:54.869227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1495 reason: error at write: Disconnected sessionId: src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0
2025-10-10T14:34:54.866497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.866558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.866597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.866599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.866670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.866730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.866792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.866856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.866898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.866901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.866968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.867030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.867099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.867167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.867213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.867231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.867305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.867367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.867435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.867496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.867542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.867544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.869646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:54.867608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.867666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.867721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.867778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.867816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.867818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.867894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.867950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.868004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.868059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.868098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.868099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.868164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:54.868224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:54.869464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:54.868286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:54.868339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:54.868378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:54.868382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:54.868451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129701:8672], now have 1 active actors on pipe
2025-10-10T14:34:54.869237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:54.869654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0] Write session will restart in 0.005777s
2025-10-10T14:34:54.869776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0] Write session: Do CDS request
2025-10-10T14:34:54.869782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:54.869729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1495 sessionId: src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0 is DEAD
2025-10-10T14:34:54.876906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.877001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:54.877018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1496
2025-10-10T14:34:54.877213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:54.877255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:54.877265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:54.877270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:54.877770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1496 sessionId:  describe result for acl check
2025-10-10T14:34:54.877808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:54.877816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:54.877818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:54.877826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601549512129717:9230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:54.878452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601549512129717:9230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:54.881609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601549512129717:9230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:54.883326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:54.883623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601549512129717:9230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:54.883636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601549512129717:9230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:54.883640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601549512129717:9230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:54.883651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:54.885272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:54.885526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:54.885538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:54.885552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:54.885616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:54.885662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601548729905602:8788]
2025-10-10T14:34:54.886333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:54.886792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:54.886856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:54.887264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:54.887348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.887355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.887356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.887357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.887358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.887359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.887361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.887362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.887363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.887364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.887366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.887367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.887368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.887375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.887388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.887393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.887397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.887401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.887405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.887409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.887413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.887416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.887423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.887426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.887430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.887433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.887442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.887450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:54.887456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.887462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:54.887467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.887472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:54.887476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.887481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:54.887485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.887490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:54.887495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.887501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:54.887506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.887510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:54.887534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.887540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:54.887553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.887558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:54.887562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.887567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:54.887573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.887578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.887583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.887588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.887593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.887598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.887637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:54.890743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:54.891209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:54.891232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:54.891235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:54.891239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:54.891249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1495 [2:7559601548729905602:8788]
2025-10-10T14:34:54.891263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:54.891290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:54.891294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.891298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.891302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.891323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:54.891352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:54.891364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:54.891431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.891438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.891440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.891444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:54.891521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:54.891524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.891535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:54.891545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:54.891561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:54.891586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129704:2438], now have 1 active actors on pipe
2025-10-10T14:34:54.891594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129775:9230], now have 1 active actors on pipe
2025-10-10T14:34:54.891603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601548729905596:8788]
2025-10-10T14:34:54.891610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601548729905596:8788]
2025-10-10T14:34:54.891614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601548729905596:8788]
2025-10-10T14:34:54.891626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:54.891643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:54.891659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:54.891666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:54.891668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:54.891670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:54.891670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:54.891705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601548729905596:8788]
2025-10-10T14:34:54.891720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:54.891726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:54.891729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1495
2025-10-10T14:34:54.891741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1495
2025-10-10T14:34:54.891824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.891835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.891871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1081139-32dd8880-1236e795-d78e596c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:54.891885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:54.891890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:54.891892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:54.891906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:54.891917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:54.891933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.892087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.892097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.892112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:54.892234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1496 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1081139-32dd8880-1236e795-d78e596c_0
2025-10-10T14:34:54.892669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd60831d-7b4cb12-2dece1bb-d3b1b8ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1081139-32dd8880-1236e795-d78e596c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:54.895476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1081139-32dd8880-1236e795-d78e596c_0] Write session: try to update token
2025-10-10T14:34:54.895498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1081139-32dd8880-1236e795-d78e596c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:54.911443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:54.911461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:54.911473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601548729905596:8788]
2025-10-10T14:34:54.911531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:54.911548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:54.911674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId: src_id|b1081139-32dd8880-1236e795-d78e596c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:54.911728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:54.911884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.912034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.912187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:54.912392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:54.912448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:54.914374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:54.914540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:54.914556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:54.914604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:54.914690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:54.921530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:54.921549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:54.921552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:54.921554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:54.921565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601548729905596:8788]
2025-10-10T14:34:54.921569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601548729905596:8788]
2025-10-10T14:34:54.921573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601548729905596:8788]
2025-10-10T14:34:54.921616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:54.921623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:54.921631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:54.921631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:54.921635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:54.921638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:54.921785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:54.969537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601549512129792:8672]
2025-10-10T14:34:54.969779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1495, pipe: [1:7559601549512129792:8672]
2025-10-10T14:34:55.036010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:55.044046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.044078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.044255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.044316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.044384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.044449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.044712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.044724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.044792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.044860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.044933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.045007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.045051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.045059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.045134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.045200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.045269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.045353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.045399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.045406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.045475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.045543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.045608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.045679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.045726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.045735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.045803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.045874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.045941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.046007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.046060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.046067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.046133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.046194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.046259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.046323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.046368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.046375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.046443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.046511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.046572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.046633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.046680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.046687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.046759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.046828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.046895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.046967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.047019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.047027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.047095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.047155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.047228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.048091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601549512129792:8672]
2025-10-10T14:34:55.048136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:55.048140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:55.048180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1496 reason: error at write: Disconnected sessionId: src_id|b1081139-32dd8880-1236e795-d78e596c_0
2025-10-10T14:34:55.048418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1496 sessionId: src_id|b1081139-32dd8880-1236e795-d78e596c_0 is DEAD
2025-10-10T14:34:55.048570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1081139-32dd8880-1236e795-d78e596c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:55.048578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1081139-32dd8880-1236e795-d78e596c_0] Write session will restart in 0.008223s
2025-10-10T14:34:55.048617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1081139-32dd8880-1236e795-d78e596c_0] Write session: Do CDS request
2025-10-10T14:34:55.048623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1081139-32dd8880-1236e795-d78e596c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:55.048556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:55.047293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.047342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.047345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.047413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.047473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.047539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.047600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.047639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.047642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.047713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601549512129792:8672], now have 1 active actors on pipe
2025-10-10T14:34:55.048304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:55.057875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1081139-32dd8880-1236e795-d78e596c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.057927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:55.057943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1497
2025-10-10T14:34:55.058139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.058180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:55.058187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:55.058191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:55.058669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1497 sessionId:  describe result for acl check
2025-10-10T14:34:55.058723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:55.058729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:55.058731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:55.058737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601553807097133:9234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:55.058763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:55.059288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601553807097133:9234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:55.060820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:55.061073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:55.061087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:55.061100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:55.061174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:55.061213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601553024872982:8790]
2025-10-10T14:34:55.061821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:55.062166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:55.062223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:55.062339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601553807097133:9234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:55.062710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:55.062771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.062778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.062779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.062781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.062782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.062783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.062785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.062786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.062787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.062788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.062790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.062791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.062792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.062798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.062811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.062816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.062820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.062825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.062829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.062833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.062837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.062841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.062847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.062852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.062856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.062861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.062874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.062883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.062891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.062897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.062902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.062907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.062912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.062917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.062922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.062927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.062932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.062937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.062943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.062948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.062953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.062958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.062963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.062968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.062973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.062980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.062991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.062997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.063001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.063007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.063012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.063017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.063054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:55.065837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:55.065694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601553807097133:9234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:55.065708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601553807097133:9234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:55.065712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601553807097133:9234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:55.065722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:55.066257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:55.066272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:55.066274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:55.066278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:55.066285Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1496 [2:7559601553024872982:8790]
2025-10-10T14:34:55.066298Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:55.066614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1496
2025-10-10T14:34:55.066667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1496
2025-10-10T14:34:55.066321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:55.066330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.066334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.066336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.066353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:55.066360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:55.066368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:55.066427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.066429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.066431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.066434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:55.066503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:55.066505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.066519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.066529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.066545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:55.066569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097091:2438], now have 1 active actors on pipe
2025-10-10T14:34:55.066572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097168:9234], now have 1 active actors on pipe
2025-10-10T14:34:55.066579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601553024872976:8790]
2025-10-10T14:34:55.066581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601553024872976:8790]
2025-10-10T14:34:55.066583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601553024872976:8790]
2025-10-10T14:34:55.066598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:55.066613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:55.066615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:55.066618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:55.066620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:55.066628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:55.066631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:55.066658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601553024872976:8790]
2025-10-10T14:34:55.066664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:55.066689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:55.066703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.066708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.066739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:55.066747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.066752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.066754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:55.066767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.066779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:55.066793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.067151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.067162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.067181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.067317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1497 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0
2025-10-10T14:34:55.067707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1081139-32dd8880-1236e795-d78e596c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:55.070421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0] Write session: try to update token
2025-10-10T14:34:55.070442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:55.090709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:55.090732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.090735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:55.090738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:55.090749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601553024872976:8790]
2025-10-10T14:34:55.090753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601553024872976:8790]
2025-10-10T14:34:55.090757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601553024872976:8790]
2025-10-10T14:34:55.090810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:55.090811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:55.090818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:55.090819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.090822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:55.090823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:55.090972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:55.095178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId: src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:55.097972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:55.148241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601553807097176:8672]
2025-10-10T14:34:55.148601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1496, pipe: [1:7559601553807097176:8672]
2025-10-10T14:34:55.202637Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:55.203012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.203023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.203071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097176:8672], now have 1 active actors on pipe
2025-10-10T14:34:55.203328Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:55.209409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:55.209415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601553807097176:8672]
2025-10-10T14:34:55.209446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:55.209536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1497 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0
2025-10-10T14:34:55.209740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1497 sessionId: src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0 is DEAD
2025-10-10T14:34:55.210127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:55.210139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0] Write session will restart in 0.008565s
2025-10-10T14:34:55.210167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0] Write session: Do CDS request
2025-10-10T14:34:55.210174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:55.219973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.220775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:55.220807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:55.220824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1498
2025-10-10T14:34:55.220981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.221018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:55.221029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:55.221033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:55.221559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1498 sessionId:  describe result for acl check
2025-10-10T14:34:55.221595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:55.221597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:55.221599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:55.221606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601553807097220:9238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:55.222182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601553807097220:9238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:55.222463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:55.222715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:55.222724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:55.222737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:55.222799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:55.222860Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601553024873064:8792]
2025-10-10T14:34:55.223478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:55.223868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:55.223928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:55.224258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:55.224332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.224340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.224341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.224342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.224343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.224345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.224346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.224347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.224350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.224351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.224352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.224353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.224354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.224360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.224372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.224375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.224379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.224382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.224385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.224388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.224391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.224395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.224400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.224403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.224406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.224409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.224416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.224424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.224430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.224436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.224440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.224445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.224449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.224454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.224459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.224463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.224467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.224472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.224477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.224483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.224487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.224491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.224499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.224504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.224507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.224512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.224516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.224521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.224525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.224529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.224533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.224537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.224572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:55.224744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601553807097220:9238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:55.227228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:55.227539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:55.227551Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:55.227554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:55.227558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:55.227564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1497 [2:7559601553024873064:8792]
2025-10-10T14:34:55.227578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:55.227595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:55.227605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.227611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.227613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.227631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:55.227643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:55.227655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:55.227717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.227726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.227728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.227730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:55.227798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:55.227805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.227791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601553807097220:9238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:55.227807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601553807097220:9238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:55.227811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601553807097220:9238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:55.227817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.227820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:55.227835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.227853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:55.227875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097177:2438], now have 1 active actors on pipe
2025-10-10T14:34:55.227883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601553024873059:8792]
2025-10-10T14:34:55.227885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601553024873059:8792]
2025-10-10T14:34:55.227887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601553024873059:8792]
2025-10-10T14:34:55.227899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:55.227913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:55.227914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:55.227917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:55.227919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:55.227930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:55.227937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:55.227963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601553024873059:8792]
2025-10-10T14:34:55.227954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1497
2025-10-10T14:34:55.227971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:55.228073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:55.228164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097254:9238], now have 1 active actors on pipe
2025-10-10T14:34:55.228218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1497
2025-10-10T14:34:55.228300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.228311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.228342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e17a746b-925daa70-5c3405fc-a832599b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:55.228372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.228380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.228383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:55.228397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.228417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:55.228436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.228622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.228634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.228665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.228751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1498 partition: 0 MaxSeqNo: 40 sessionId: src_id|e17a746b-925daa70-5c3405fc-a832599b_0
2025-10-10T14:34:55.229222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea08b1a4-d8e7a8-ae457d47-f8287887_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e17a746b-925daa70-5c3405fc-a832599b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:55.232140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e17a746b-925daa70-5c3405fc-a832599b_0] Write session: try to update token
2025-10-10T14:34:55.232159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e17a746b-925daa70-5c3405fc-a832599b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:55.241044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:55.241059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.241079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601553024873059:8792]
2025-10-10T14:34:55.241130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:55.241122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:55.241357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:55.241519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.241687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.241838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.242084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:55.242137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:55.257981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId: src_id|e17a746b-925daa70-5c3405fc-a832599b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:55.259118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:55.259139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.259143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:55.259145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:55.259157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601553024873059:8792]
2025-10-10T14:34:55.259161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601553024873059:8792]
2025-10-10T14:34:55.259165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601553024873059:8792]
2025-10-10T14:34:55.259231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:55.259242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.259250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:55.259391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:55.260519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:55.260692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:55.260715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:55.260719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:55.309986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601553807097262:8672]
2025-10-10T14:34:55.310381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1497, pipe: [1:7559601553807097262:8672]
2025-10-10T14:34:55.373258Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:55.373684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.373702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.373728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097262:8672], now have 1 active actors on pipe
2025-10-10T14:34:55.373986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:55.374439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:55.374585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1498 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e17a746b-925daa70-5c3405fc-a832599b_0
2025-10-10T14:34:55.374789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1498 sessionId: src_id|e17a746b-925daa70-5c3405fc-a832599b_0 is DEAD
2025-10-10T14:34:55.374801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601553807097262:8672]
2025-10-10T14:34:55.374817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:55.374980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17a746b-925daa70-5c3405fc-a832599b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:55.374991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17a746b-925daa70-5c3405fc-a832599b_0] Write session will restart in 0.009678s
2025-10-10T14:34:55.375019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17a746b-925daa70-5c3405fc-a832599b_0] Write session: Do CDS request
2025-10-10T14:34:55.375026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17a746b-925daa70-5c3405fc-a832599b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:55.386323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e17a746b-925daa70-5c3405fc-a832599b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.386296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:55.386324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1499
2025-10-10T14:34:55.386745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.386803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:55.386814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:55.386819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:55.386981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:55.387276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1499 sessionId:  describe result for acl check
2025-10-10T14:34:55.387314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:55.387316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:55.387317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:55.387324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601553807097308:9242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:55.387912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601553807097308:9242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:55.388665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:55.388877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:55.388890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:55.388911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:55.388973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:55.389019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601553024873147:8794]
2025-10-10T14:34:55.389684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:55.390580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601553807097308:9242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:55.391021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:55.391082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:55.391457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:55.391524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.391541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.391543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.391544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.391545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.391549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.391552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.391553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.391554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.391555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.391556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.391558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.391559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.391566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.391579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.391584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.391588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.391593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.391597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.391611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.391624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.391627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.391632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.391636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.391639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.391643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.391651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.391660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.391668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.391673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.391679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.391685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.391689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.391694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.391699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.391704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.391715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.391721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.391730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.391734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.391738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.391743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.391747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.391751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.391754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.391761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.391766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.391771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.391781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.391786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.391797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.391802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.391845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:55.394386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:55.394546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601553807097308:9242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:55.394564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601553807097308:9242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:55.394568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601553807097308:9242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:55.394577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:55.394813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:55.394827Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:55.394830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:55.394835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:55.394842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1498 [2:7559601553024873147:8794]
2025-10-10T14:34:55.394856Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:55.394875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:55.394885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.394890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.394897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.394915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:55.394927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:55.394934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:55.395001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.395009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.395011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.395013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:55.395088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:55.395100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.395113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.395130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.395151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:55.395178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097263:2438], now have 1 active actors on pipe
2025-10-10T14:34:55.395186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097342:9242], now have 1 active actors on pipe
2025-10-10T14:34:55.395195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601553024873141:8794]
2025-10-10T14:34:55.395198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601553024873141:8794]
2025-10-10T14:34:55.395214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601553024873141:8794]
2025-10-10T14:34:55.395232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:55.395251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:55.395256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:55.395260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:55.395262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:55.395272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:55.395276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:55.395264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1498
2025-10-10T14:34:55.395314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1498
2025-10-10T14:34:55.395313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601553024873141:8794]
2025-10-10T14:34:55.395330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:55.395341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:55.395369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.395378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.395409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:55.395422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.395430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.395432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:55.395443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.395459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:55.395473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.395788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.395798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.395816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.396002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1499 partition: 0 MaxSeqNo: 40 sessionId: src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0
2025-10-10T14:34:55.396448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17a746b-925daa70-5c3405fc-a832599b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:55.399164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0] Write session: try to update token
2025-10-10T14:34:55.399183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:55.408444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:55.408462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.408473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601553024873141:8794]
2025-10-10T14:34:55.408522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:55.408701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:55.408847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.409003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.409140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.409348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:55.409393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:55.409513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:55.419167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId: src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:55.422019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:55.422260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.422279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.422324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:55.422440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:55.435534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:55.435553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.435570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:55.435572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:55.435587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601553024873141:8794]
2025-10-10T14:34:55.435591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601553024873141:8794]
2025-10-10T14:34:55.435594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601553024873141:8794]
2025-10-10T14:34:55.435639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:55.435651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.435653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:55.435654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:55.435662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:55.435666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:55.435785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:55.474365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601553807097350:8672]
2025-10-10T14:34:55.474661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1498, pipe: [1:7559601553807097350:8672]
2025-10-10T14:34:55.548028Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:55.556098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.556125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.556310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.556384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.556459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.556526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.556576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.556590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.556665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.556734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.556801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.556877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.556994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.556998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.557073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.557136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.557198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.557266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.557307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.557309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.559980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:55.560007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601553807097350:8672]
2025-10-10T14:34:55.560045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:55.560048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:55.560081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1499 reason: error at write: Disconnected sessionId: src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0
2025-10-10T14:34:55.560311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1499 sessionId: src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0 is DEAD
2025-10-10T14:34:55.560470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:55.560482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0] Write session will restart in 0.006841s
2025-10-10T14:34:55.560511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0] Write session: Do CDS request
2025-10-10T14:34:55.560518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:55.557459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.557524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.557586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.557647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.557689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.557691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.557761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.557824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.557885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.557949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.557990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.557993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.558059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.558117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.558175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.558235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.558272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.558275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.558344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.558405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.558468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.558528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.558568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.558571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.558645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.558701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.558764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.558829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.558870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.558874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.558940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.558998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.559057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.559118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.559157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.559159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.559238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.559301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.559362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.559419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.559460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.559463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.559537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097350:8672], now have 1 active actors on pipe
2025-10-10T14:34:55.560728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:55.568906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.568992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:55.569009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1500
2025-10-10T14:34:55.569178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.569227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:55.569236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:55.569241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:55.569722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1500 sessionId:  describe result for acl check
2025-10-10T14:34:55.569762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:55.569768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:55.569770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:55.569777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601553807097368:9246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:55.570352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601553807097368:9246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:55.573094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:55.573460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601553807097368:9246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:55.575084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:55.575331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:55.575345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:55.575359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:55.575425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:55.575480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601553024873244:8802]
2025-10-10T14:34:55.575950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601553807097368:9246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:55.575964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601553807097368:9246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:55.575969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601553807097368:9246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:55.576105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:55.575977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:55.576338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:55.576388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:55.576725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:55.576788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.576794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.576796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.576797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.576799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.576800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.576801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.576803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.576804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.576805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.576806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.576807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.576809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.576815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.576828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.576832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.576836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.576840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.576845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.576849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.576852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.576858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.576863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.576867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.576871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.576875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.576883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.576892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.576899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.576905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.576909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.576914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.576920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.576925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.576931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.576936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.576940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.576945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.576950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.576956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.576960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.576965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.576970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.576975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.576979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.576984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.576990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.576996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.577000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.577005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.577009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.577014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.577058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:55.579522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:55.579843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:55.579857Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:55.579859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:55.579863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:55.579868Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1499 [2:7559601553024873244:8802]
2025-10-10T14:34:55.579880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:55.579899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:55.579902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.579905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.579907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.579924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:55.579931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:55.579938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:55.580075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.580083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.580084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.580087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:55.580157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:55.580168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.580180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.580190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.580208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:55.580229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097353:2438], now have 1 active actors on pipe
2025-10-10T14:34:55.580233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097428:9246], now have 1 active actors on pipe
2025-10-10T14:34:55.580241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601553024873239:8802]
2025-10-10T14:34:55.580244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601553024873239:8802]
2025-10-10T14:34:55.580246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601553024873239:8802]
2025-10-10T14:34:55.580262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:55.580277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:55.580295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:55.580301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:55.580306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:55.580300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1499
2025-10-10T14:34:55.580348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1499
2025-10-10T14:34:55.580306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:55.580308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:55.580330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601553024873239:8802]
2025-10-10T14:34:55.580333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:55.580373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:55.580474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.580485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.580515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:55.580530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.580534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.580536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:55.580547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.580557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:55.580572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.580750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.580766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.580791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.580900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1500 partition: 0 MaxSeqNo: 40 sessionId: src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0
2025-10-10T14:34:55.581310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|399c7a1d-ca330483-fc9de4b9-1a875597_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:55.584117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0] Write session: try to update token
2025-10-10T14:34:55.584144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:55.599828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId: src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:55.600156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:55.600176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.600180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:55.600183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:55.600193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601553024873239:8802]
2025-10-10T14:34:55.600198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601553024873239:8802]
2025-10-10T14:34:55.600202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601553024873239:8802]
2025-10-10T14:34:55.600247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:55.600254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:55.600255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:55.600258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:55.600263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.600266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:55.600406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:55.602448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:55.660212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601553807097471:8672]
2025-10-10T14:34:55.660554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1499, pipe: [1:7559601553807097471:8672]
2025-10-10T14:34:55.719567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:55.719904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.719922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.719969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097471:8672], now have 1 active actors on pipe
2025-10-10T14:34:55.720197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:55.720223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:55.720235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:55.720309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1500 reason: error at write: Disconnected sessionId: src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0
2025-10-10T14:34:55.720520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1500 sessionId: src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0 is DEAD
2025-10-10T14:34:55.720600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:55.720653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601553807097471:8672]
2025-10-10T14:34:55.720672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:55.720681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0] Write session will restart in 0.005210s
2025-10-10T14:34:55.720709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0] Write session: Do CDS request
2025-10-10T14:34:55.720718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:55.726972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.727361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:55.727375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1501
2025-10-10T14:34:55.727498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.727546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:55.727557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:55.727561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:55.728006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1501 sessionId:  describe result for acl check
2025-10-10T14:34:55.728046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:55.728053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:55.728055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:55.728061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601553807097504:9261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:55.728630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601553807097504:9261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:55.732403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601553807097504:9261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:55.733396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:55.738963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:55.739217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601553807097504:9261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:55.739244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:55.739232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601553807097504:9261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:55.739257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:55.739271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:55.739236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601553807097504:9261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:55.739245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:55.739333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:55.739376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601553024873366:8812]
2025-10-10T14:34:55.739982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:55.740322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:55.740396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:55.740762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:55.740840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.740841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.740842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.740843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.740847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.740849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.740850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.740851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.740852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.740853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.740854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.740855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.740856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.740862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.740875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.740878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.740881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.740885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.740888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.740892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.740895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.740899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.740903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.740906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.740909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.740913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.740920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.740929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.740954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.740959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.740964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.740968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.740973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.740978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.740983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.740990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.740995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.741000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.741004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.741010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.741014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.741019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.741024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.741029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.741033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.741038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.741043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.741047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.741052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.741057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.741061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.741066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.741107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:55.743561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:55.743919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:55.743930Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:55.743932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:55.743935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:55.743941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1500 [2:7559601553024873366:8812]
2025-10-10T14:34:55.743953Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:55.743968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:55.743971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.743975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.743978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.743994Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:55.744008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:55.744019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:55.744073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.744082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.744084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.744086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:55.744147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:55.744155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.744165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.744175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.744189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:55.744214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097562:9261], now have 1 active actors on pipe
2025-10-10T14:34:55.744222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097489:2438], now have 1 active actors on pipe
2025-10-10T14:34:55.744229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601553024873361:8812]
2025-10-10T14:34:55.744231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601553024873361:8812]
2025-10-10T14:34:55.744234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601553024873361:8812]
2025-10-10T14:34:55.744247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:55.744264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:55.744263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:55.744266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:55.744268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:55.744282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:55.744285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:55.744277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1500
2025-10-10T14:34:55.744307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601553024873361:8812]
2025-10-10T14:34:55.744317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1500
2025-10-10T14:34:55.744315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:55.744337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:55.744357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.744362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.744390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e4a0759-b408fac7-5144f282-70d12b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:55.744404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.744412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.744414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:55.744424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.744433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:55.744445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.744614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.744622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.744635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.744731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1501 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e4a0759-b408fac7-5144f282-70d12b56_0
2025-10-10T14:34:55.745117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fdb5751-c03ae431-f3f5f341-355891e5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e4a0759-b408fac7-5144f282-70d12b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:55.748016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a0759-b408fac7-5144f282-70d12b56_0] Write session: try to update token
2025-10-10T14:34:55.748034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a0759-b408fac7-5144f282-70d12b56_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:55.757377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:55.757392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.757403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601553024873361:8812]
2025-10-10T14:34:55.757450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:55.757452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:55.757616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:55.757755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.757889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.758021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:55.758204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:55.758242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:55.766558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId: src_id|7e4a0759-b408fac7-5144f282-70d12b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:55.769283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:55.769595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.769629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.769673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:55.769782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:55.779679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:55.779700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.779704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:55.779706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:55.779718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601553024873361:8812]
2025-10-10T14:34:55.779722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601553024873361:8812]
2025-10-10T14:34:55.779730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601553024873361:8812]
2025-10-10T14:34:55.779786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:55.779799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.779801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:55.779805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:55.779812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:55.779816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:55.779933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:55.821009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601553807097575:8672]
2025-10-10T14:34:55.821242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1500, pipe: [1:7559601553807097575:8672]
2025-10-10T14:34:55.895362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:55.903524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.903551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.903740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.903816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.903889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.903959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.904015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.904025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.904102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.904173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.904244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.904311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.904355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.904363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.904436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.904499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.904565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.904633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.904680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.904691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.904761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.904825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.904891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.904956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.905004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.905011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.905080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.905144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.905208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.905277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.905324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.905347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.905425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.905493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.905561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.905629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.905676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.905686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.905756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.905809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.905883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.905950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.905999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.906006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.906071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.906141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.906212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.906278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.906326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.906333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.906404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.906471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.906539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.906609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.906651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.906659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.906726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:55.906787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:55.906849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:55.906915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:55.906962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:55.906971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:55.907056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097575:8672], now have 1 active actors on pipe
2025-10-10T14:34:55.907317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601553807097575:8672]
2025-10-10T14:34:55.907347Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:34:55.907603Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 15 consumer shared/user session shared/user_1_15_16242891699915448161_v1 is DEAD
2025-10-10T14:34:55.908239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:55.908299Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:34:55.907882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:55.908316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a0759-b408fac7-5144f282-70d12b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:55.907886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:55.908327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a0759-b408fac7-5144f282-70d12b56_0] Write session will restart in 0.005391s
2025-10-10T14:34:55.907913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1501 reason: error at write: Disconnected sessionId: src_id|7e4a0759-b408fac7-5144f282-70d12b56_0
2025-10-10T14:34:55.907984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1501 sessionId: src_id|7e4a0759-b408fac7-5144f282-70d12b56_0 is DEAD
2025-10-10T14:34:55.908041Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601476497663625:8666] disconnected; active server actors: 1
2025-10-10T14:34:55.908045Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601476497663625:8666] client user disconnected session shared/user_1_15_16242891699915448161_v1
2025-10-10T14:34:55.908069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:55.908354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a0759-b408fac7-5144f282-70d12b56_0] Write session: Do CDS request
2025-10-10T14:34:55.908360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a0759-b408fac7-5144f282-70d12b56_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:55.908409Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:34:55.908414Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:34:55.908422Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.007849s
2025-10-10T14:34:55.914934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a0759-b408fac7-5144f282-70d12b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.915024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:55.915049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1502
2025-10-10T14:34:55.915369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:55.915423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:55.915429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:55.915432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:55.915860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1502 sessionId:  describe result for acl check
2025-10-10T14:34:55.915897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:55.915903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:55.915905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:55.915911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601553807097592:9265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:55.916454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601553807097592:9265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:55.917367Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:34:55.917542Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:34:55.917553Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 16
2025-10-10T14:34:55.917734Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 16 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:34:55.917813Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:34:55.917905Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 auth for : user
2025-10-10T14:34:55.918259Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 Handle describe topics response
2025-10-10T14:34:55.918289Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 auth is DEAD
2025-10-10T14:34:55.918311Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:34:55.918580Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:34:55.918677Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_16_1129463353550367506_v1
2025-10-10T14:34:55.918663Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601553807097644:9269] connected; active server actors: 1
2025-10-10T14:34:55.918688Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601553807097644:9269] session shared/user_1_16_1129463353550367506_v1
2025-10-10T14:34:55.918698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:34:55.918710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:34:55.918721Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_16_1129463353550367506_v1" (Sender=[1:7559601553807097627:9269], Pipe=[1:7559601553807097644:9269], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:34:55.918727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:34:55.918738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:34:55.918751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_16_1129463353550367506_v1" (Sender=[1:7559601553807097627:9269], Pipe=[1:7559601553807097644:9269], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:34:55.918764Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_16_1129463353550367506_v1" sender [1:7559601553807097627:9269] lock partition 0 for ReadingSession "shared/user_1_16_1129463353550367506_v1" (Sender=[1:7559601553807097627:9269], Pipe=[1:7559601553807097644:9269], Partitions=[], ActiveFamilyCount=1) generation 1 step 16
2025-10-10T14:34:55.918772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:34:55.918777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000032s
2025-10-10T14:34:55.919304Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 16 Session: "shared/user_1_16_1129463353550367506_v1" ClientId: "user" PipeClient { RawX1: 7559601553807097644 RawX2: 4503603922347061 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:34:55.919338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:34:55.919493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601553807097592:9265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:55.920223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:55.922056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:55.922286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:55.922297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:55.922310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:55.922364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:55.922412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601553807097592:9265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:55.922427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601553807097592:9265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:55.922431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601553807097592:9265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:55.922440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:55.922413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601553024873456:8815]
2025-10-10T14:34:55.923040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:55.923358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:55.923404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:55.923748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:55.923805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.923810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.923814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.923815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.923816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.923817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.923819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.923820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.923821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.923822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.923823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.923825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.923826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.923831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.923844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.923848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.923851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.923855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.923859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.923863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.923867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.923871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.923875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.923878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.923882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.923885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.923894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.923902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:55.923914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.923920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:55.923929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.923934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:55.923938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.923944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:55.923953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.923957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:55.923961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.923967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:55.923972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.923977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:55.923981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.923985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:55.923990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.923995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:55.923999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.924004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:55.924009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.924020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.924024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.924029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.924032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.924038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.924077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:55.926648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:55.926986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:55.926990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:55.926992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:55.926995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:55.927000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1501 [2:7559601553024873456:8815]
2025-10-10T14:34:55.927012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:55.927026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:55.927029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.927031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.927032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.927047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:55.927053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:55.927059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:55.927103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.927104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.927105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.927107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:55.927172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:55.927174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.927181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:55.927207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:55.927217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:55.927233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601553024873451:8815]
2025-10-10T14:34:55.927234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601553024873451:8815]
2025-10-10T14:34:55.927235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601553024873451:8815]
2025-10-10T14:34:55.927248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:55.927258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:55.927267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:55.927269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:55.927292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601553024873451:8815]
2025-10-10T14:34:55.927293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:55.927302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:55.927305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:55.927307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:55.927314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:55.927547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097577:2438], now have 1 active actors on pipe
2025-10-10T14:34:55.927556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097662:9265], now have 1 active actors on pipe
2025-10-10T14:34:55.927558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601553807097648:9272], now have 1 active actors on pipe
2025-10-10T14:34:55.927565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1501
2025-10-10T14:34:55.927612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1501
2025-10-10T14:34:55.927638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1501, pipe: [1:7559601553807097648:9272]
2025-10-10T14:34:55.927675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.927682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.927697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.927701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.927706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_16_1129463353550367506_v1 on pipe: [1:7559601553807097648:9272]
2025-10-10T14:34:55.927726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24f4e841-ffe236db-2a63852e-57615e4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:55.927737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.927749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.927753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:55.927761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.927774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:55.927786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.927792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.927792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:55.927805Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_16_1129463353550367506_v1
2025-10-10T14:34:55.927809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.927828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.927842Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:34:55.927933Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_16_1129463353550367506_v1:1 with generation 1501
2025-10-10T14:34:55.928121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:55.928126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:55.928139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:55.928222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1502 partition: 0 MaxSeqNo: 40 sessionId: src_id|24f4e841-ffe236db-2a63852e-57615e4e_0
2025-10-10T14:34:55.928596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4a0759-b408fac7-5144f282-70d12b56_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24f4e841-ffe236db-2a63852e-57615e4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:55.931461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f4e841-ffe236db-2a63852e-57615e4e_0] Write session: try to update token
2025-10-10T14:34:55.931482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f4e841-ffe236db-2a63852e-57615e4e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:55.932251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:34:55.932291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:34:55.932304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:55.932307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:55.932320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:55.932332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:34:55.932347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:34:55.932526Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106895927 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:34:55.932546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:34:55.932583Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 sending to client partition status
2025-10-10T14:34:55.946997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:55.947020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:55.947023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:55.947028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:55.947038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601553024873451:8815]
2025-10-10T14:34:55.947042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601553024873451:8815]
2025-10-10T14:34:55.947046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601553024873451:8815]
2025-10-10T14:34:55.947098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:55.947106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:55.947110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:55.947277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:55.950806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:55.950826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:55.950830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:55.952249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId: src_id|24f4e841-ffe236db-2a63852e-57615e4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:55.955101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:56.063535Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:56.063811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.063827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.064071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:56.064100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:56.064104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:56.064129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601553807097648:9272]
2025-10-10T14:34:56.064183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1502 reason: error at write: Disconnected sessionId: src_id|24f4e841-ffe236db-2a63852e-57615e4e_0
2025-10-10T14:34:56.064457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1502 sessionId: src_id|24f4e841-ffe236db-2a63852e-57615e4e_0 is DEAD
2025-10-10T14:34:56.064100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_16_1129463353550367506_v1
2025-10-10T14:34:56.064122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:56.064443Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_16_1129463353550367506_v1
2025-10-10T14:34:56.064566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f4e841-ffe236db-2a63852e-57615e4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:56.064576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f4e841-ffe236db-2a63852e-57615e4e_0] Write session will restart in 0.005438s
2025-10-10T14:34:56.064604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f4e841-ffe236db-2a63852e-57615e4e_0] Write session: Do CDS request
2025-10-10T14:34:56.064610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f4e841-ffe236db-2a63852e-57615e4e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:56.073897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f4e841-ffe236db-2a63852e-57615e4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.073979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:56.073997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1503
2025-10-10T14:34:56.074184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.074231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:56.074243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:56.074248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:56.074688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1503 sessionId:  describe result for acl check
2025-10-10T14:34:56.074722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:56.074730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:56.074732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:56.074739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601558102064978:9273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:56.075338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601558102064978:9273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:56.078118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601558102064978:9273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:56.082029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601558102064978:9273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:56.082047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601558102064978:9273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:56.082064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601558102064978:9273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:56.082074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:56.092309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:56.095004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:56.095235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:56.095245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:56.095256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:56.095302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:56.095343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601557319840842:8817]
2025-10-10T14:34:56.095766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:56.096122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:56.096166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:56.096397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:56.096438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.096443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.096443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.096444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.096445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.096446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.096446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.096447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.096448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.096448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.096449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.096450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.096451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.096455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.096467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.096469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.096472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.096474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.096476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.096478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.096480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.096482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.096484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.096486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.096488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.096490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.096496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.096501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.096506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.096509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.096512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.096516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.096519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.096522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.096525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.096528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.096531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.096534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.096538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.096544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.096546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.096550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.096553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.096557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.096559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.096564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.096567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.096570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.096573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.096576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.096586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.096589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.096614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:56.099947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:56.100277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:56.100286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:56.100288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:56.100291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:56.100297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1502 [2:7559601557319840842:8817]
2025-10-10T14:34:56.100308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:56.100326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:56.100328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.100330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.100332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.100347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:56.100354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:56.100361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:56.100420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.100433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.100435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.100438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:56.100512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:56.100520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.100531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.100541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.100561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:56.100589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601557319840837:8817]
2025-10-10T14:34:56.100596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601557319840837:8817]
2025-10-10T14:34:56.100599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601557319840837:8817]
2025-10-10T14:34:56.100613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:56.100627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065011:9273], now have 1 active actors on pipe
2025-10-10T14:34:56.100632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102064971:2438], now have 1 active actors on pipe
2025-10-10T14:34:56.100636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:56.100647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:56.100650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:56.100677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601557319840837:8817]
2025-10-10T14:34:56.100682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:56.100724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:56.100734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:56.100736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:56.100744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:56.100749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1502
2025-10-10T14:34:56.100794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1502
2025-10-10T14:34:56.101009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.101021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.101066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50c4221-d4a42b42-86f8189-a3b04c94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:56.101081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.101085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.101088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:56.101100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.101117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:56.101138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.102237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.102251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.102281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.102465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1503 partition: 0 MaxSeqNo: 40 sessionId: src_id|50c4221-d4a42b42-86f8189-a3b04c94_0
2025-10-10T14:34:56.102918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f4e841-ffe236db-2a63852e-57615e4e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50c4221-d4a42b42-86f8189-a3b04c94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:56.105791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c4221-d4a42b42-86f8189-a3b04c94_0] Write session: try to update token
2025-10-10T14:34:56.105818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c4221-d4a42b42-86f8189-a3b04c94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:56.122977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId: src_id|50c4221-d4a42b42-86f8189-a3b04c94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:56.125639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:56.127045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.127073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.127105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:56.127114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:56.127118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:56.127123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:56.127131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601557319840837:8817]
2025-10-10T14:34:56.127135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601557319840837:8817]
2025-10-10T14:34:56.127140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601557319840837:8817]
2025-10-10T14:34:56.127197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:56.127211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:56.127215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:56.127217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:56.127225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.127227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:56.127365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:56.164034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601558102065062:9272]
2025-10-10T14:34:56.164310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1502, pipe: [1:7559601558102065062:9272]
2025-10-10T14:34:56.240442Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:56.240841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:56.240906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065062:9272], now have 1 active actors on pipe
2025-10-10T14:34:56.241026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:56.241597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601558102065062:9272]
2025-10-10T14:34:56.241628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:56.252842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:56.253093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:56.253130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1503 reason: error at write: Disconnected sessionId: src_id|50c4221-d4a42b42-86f8189-a3b04c94_0
2025-10-10T14:34:56.253269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1503 sessionId: src_id|50c4221-d4a42b42-86f8189-a3b04c94_0 is DEAD
2025-10-10T14:34:56.253596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c4221-d4a42b42-86f8189-a3b04c94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:56.253608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c4221-d4a42b42-86f8189-a3b04c94_0] Write session will restart in 0.009147s
2025-10-10T14:34:56.253631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c4221-d4a42b42-86f8189-a3b04c94_0] Write session: Do CDS request
2025-10-10T14:34:56.253637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c4221-d4a42b42-86f8189-a3b04c94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:56.263753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:56.264216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50c4221-d4a42b42-86f8189-a3b04c94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.264301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:56.264316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1504
2025-10-10T14:34:56.264549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.264596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:56.264601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:56.264606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:56.265006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1504 sessionId:  describe result for acl check
2025-10-10T14:34:56.265042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:56.265048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:56.265050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:56.265057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601558102065115:9277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:56.265524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:56.265623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601558102065115:9277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:56.265742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:56.265754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:56.265768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:56.265831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:56.265880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601557319840929:8819]
2025-10-10T14:34:56.266463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:56.266806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:56.266849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:56.267171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:56.267242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.267248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.267249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.267250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.267254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.267255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.267256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.267258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.267259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.267260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.267261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.267262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.267263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.267269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.267281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.267285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.267288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.267292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.267295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.267299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.267302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.267305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.267309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.267313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.267317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.267321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.267329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.267337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.267343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.267349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.267353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.267358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.267362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.267367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.267372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.267379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.267384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.267389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.267393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.267399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.267402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.267408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.267414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.267420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.267430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.267436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.267442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.267452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.267457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.267463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.267471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.267476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.267514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:56.268623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601558102065115:9277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:56.269957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:56.270304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:56.270318Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:56.270321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:56.270325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:56.270331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1503 [2:7559601557319840929:8819]
2025-10-10T14:34:56.270344Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:56.270367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:56.270374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.270378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.270380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.270397Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:56.270411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:56.270418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:56.270581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.270590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.270592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.270595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:56.270660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:56.270667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.270678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.270692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.270710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:56.270732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065063:2438], now have 1 active actors on pipe
2025-10-10T14:34:56.270744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601557319840924:8819]
2025-10-10T14:34:56.270752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601557319840924:8819]
2025-10-10T14:34:56.270754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601557319840924:8819]
2025-10-10T14:34:56.270768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:56.270783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:56.270794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:56.270796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:56.270799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:56.270815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:56.270820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:56.270847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601557319840924:8819]
2025-10-10T14:34:56.270850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:56.270853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:56.271551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065150:9277], now have 1 active actors on pipe
2025-10-10T14:34:56.271572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.271579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.271612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:56.271629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.271639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.271641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:56.271654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.271683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:56.271702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.271886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.271899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.271922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.272367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50c4221-d4a42b42-86f8189-a3b04c94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:56.275213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0] Write session: try to update token
2025-10-10T14:34:56.275237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:56.270768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1503
2025-10-10T14:34:56.271203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601558102065115:9277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:56.271211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601558102065115:9277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:56.271215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601558102065115:9277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:56.271223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:56.271451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1503
2025-10-10T14:34:56.272026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1504 partition: 0 MaxSeqNo: 40 sessionId: src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0
2025-10-10T14:34:56.290961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:56.290983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:56.290989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:56.290990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:56.290999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601557319840924:8819]
2025-10-10T14:34:56.291002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601557319840924:8819]
2025-10-10T14:34:56.291005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601557319840924:8819]
2025-10-10T14:34:56.291051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:56.291057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:56.291060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.291062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:56.291065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:56.291069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:56.291213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:56.291609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId: src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:56.294232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:56.341758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601558102065159:9272]
2025-10-10T14:34:56.342042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1503, pipe: [1:7559601558102065159:9272]
2025-10-10T14:34:56.403901Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:56.404238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.404254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.404303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065159:9272], now have 1 active actors on pipe
2025-10-10T14:34:56.404527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:56.404550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:56.404566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:56.404575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601558102065159:9272]
2025-10-10T14:34:56.404599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:56.404636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1504 reason: error at write: Disconnected sessionId: src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0
2025-10-10T14:34:56.404851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1504 sessionId: src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0 is DEAD
2025-10-10T14:34:56.405034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:56.405046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0] Write session will restart in 0.006661s
2025-10-10T14:34:56.405087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0] Write session: Do CDS request
2025-10-10T14:34:56.405094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:56.413949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.414073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:56.414089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1505
2025-10-10T14:34:56.414257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.414309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:56.414316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:56.414321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:56.414846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1505 sessionId:  describe result for acl check
2025-10-10T14:34:56.414887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:56.414890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:56.414892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:56.414899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601558102065208:9283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:56.415492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601558102065208:9283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:56.417953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:56.418520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601558102065208:9283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:56.420371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:56.420629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:56.420642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:56.420655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:56.420726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:56.420776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601557319841018:8821]
2025-10-10T14:34:56.421440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:56.421297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601558102065208:9283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:56.421311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601558102065208:9283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:56.421315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601558102065208:9283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:56.421325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:56.421728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:56.421787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:56.422103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:56.422190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.422200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.422201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.422203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.422203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.422204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.422206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.422208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.422210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.422211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.422212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.422213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.422214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.422221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.422234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.422237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.422241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.422244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.422248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.422252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.422256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.422260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.422265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.422269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.422273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.422277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.422298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.422307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.422314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.422321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.422326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.422331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.422335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.422340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.422344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.422350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.422354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.422366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.422371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.422381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.422385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.422391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.422400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.422406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.422414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.422421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.422431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.422435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.422444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.422449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.422458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.422463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.422505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:56.425320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:56.425663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:56.425680Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:56.425682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:56.425687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:56.425694Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1504 [2:7559601557319841018:8821]
2025-10-10T14:34:56.425708Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:56.425728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:56.425730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.425734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.425736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.425755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:56.425764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:56.425771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:56.425834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.425843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.425845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.425847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:56.425920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:56.425931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.425942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.425954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.425982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:56.426009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065241:9283], now have 1 active actors on pipe
2025-10-10T14:34:56.426016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065160:2438], now have 1 active actors on pipe
2025-10-10T14:34:56.426024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601557319841012:8821]
2025-10-10T14:34:56.426026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601557319841012:8821]
2025-10-10T14:34:56.426028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601557319841012:8821]
2025-10-10T14:34:56.426043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:56.426063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:56.426090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1504
2025-10-10T14:34:56.426084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:56.426087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:56.426107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:56.426135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1504
2025-10-10T14:34:56.426112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:56.426114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:56.426115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601557319841012:8821]
2025-10-10T14:34:56.426117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:56.426121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:56.426232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.426249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.426288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:56.426302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.426306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.426318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:56.426332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.426345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:56.426364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.426636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.426646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.426671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.426779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1505 partition: 0 MaxSeqNo: 40 sessionId: src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0
2025-10-10T14:34:56.427290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c921fe9-8db9f7a7-535e9a7e-eeb3b800_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:56.430083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0] Write session: try to update token
2025-10-10T14:34:56.430101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:56.447198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId: src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:56.450321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:56.450569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.450600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.450711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:56.450836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:56.453465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:56.453480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:56.453484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:56.453486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:56.453495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601557319841012:8821]
2025-10-10T14:34:56.453499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601557319841012:8821]
2025-10-10T14:34:56.453503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601557319841012:8821]
2025-10-10T14:34:56.453547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:56.453549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:56.453558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.453560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:56.453561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:56.453565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:56.453705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:56.504519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601558102065253:9272]
2025-10-10T14:34:56.504957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1504, pipe: [1:7559601558102065253:9272]
2025-10-10T14:34:56.565356Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:56.573570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.573597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.573784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.573850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.573924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.573989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.574039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.574049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.574119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.574190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.574260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.574328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.574374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.574386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.574456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.574519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.574584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.574661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.574713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.574724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.574797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.574860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.574930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.574998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.575048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.575056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.575133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.575213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.575293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.575372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.575426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.575434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.575508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.575570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.575641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.575710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.575761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.575772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.575846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.575904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.575973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.576042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.576086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.576089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.576169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.576231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.576296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.576364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.577374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601558102065253:9272]
2025-10-10T14:34:56.576405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.576409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.576480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.576542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.576609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.576678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.576718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.576721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.576794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:56.576851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:56.576912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:56.576973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:56.577014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:56.577017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:56.577088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065253:9272], now have 1 active actors on pipe
2025-10-10T14:34:56.577468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:56.577477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:56.577507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:56.577516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1505 reason: error at write: Disconnected sessionId: src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0
2025-10-10T14:34:56.577743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1505 sessionId: src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0 is DEAD
2025-10-10T14:34:56.577904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:56.577915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0] Write session will restart in 0.009132s
2025-10-10T14:34:56.577941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0] Write session: Do CDS request
2025-10-10T14:34:56.577948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:56.578473Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:56.587925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.588026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:56.588042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1506
2025-10-10T14:34:56.588171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.588208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:56.588213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:56.588219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:56.588595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1506 sessionId:  describe result for acl check
2025-10-10T14:34:56.588632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:56.588638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:56.588639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:56.588645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601558102065304:9287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:56.589171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601558102065304:9287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:56.589957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:56.592111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:56.592332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:56.592345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:56.592359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:56.592414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:56.592342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601558102065304:9287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:56.592459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601557319841121:8823]
2025-10-10T14:34:56.593127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:56.594433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:56.594489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:56.594888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601558102065304:9287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:56.594901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601558102065304:9287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:56.594905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601558102065304:9287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:56.594922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:56.594889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:56.594967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.594969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.594970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.594971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.594973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.594974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.594975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.594977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.594978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.594979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.594980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.594984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.594985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.594992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.595004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.595022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.595026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.595031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.595035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.595040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.595044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.595048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.595053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.595058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.595063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.595067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.595075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.595084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.595091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.595098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.595102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.595108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.595113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.595119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.595124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.595130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.595135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.595140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.595145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.595150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.595155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.595161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.595178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.595183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.595187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.595193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.595197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.595203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.595207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.595213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.595217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.595223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.595268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:56.597647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:56.598118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:56.598130Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:56.598132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:56.598136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:56.598143Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1505 [2:7559601557319841121:8823]
2025-10-10T14:34:56.598154Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:56.598170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:56.598178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.598182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.598184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.598201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:56.598213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:56.598221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:56.598284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.598293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.598295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.598298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:56.598374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:56.598382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.598394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.598413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.598436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:56.598530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1505
2025-10-10T14:34:56.598564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1505
2025-10-10T14:34:56.598462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065339:9287], now have 1 active actors on pipe
2025-10-10T14:34:56.598476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065254:2438], now have 1 active actors on pipe
2025-10-10T14:34:56.598484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601557319841116:8823]
2025-10-10T14:34:56.598487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601557319841116:8823]
2025-10-10T14:34:56.598490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601557319841116:8823]
2025-10-10T14:34:56.598505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:56.598519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:56.598531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:56.598536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:56.598536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:56.598538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:56.598539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:56.598561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601557319841116:8823]
2025-10-10T14:34:56.598564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:56.598572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:56.598594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.598599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.598630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:56.598638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.598642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.598644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:56.598656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.598667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:56.598685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.598860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.598869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.598883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.599000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1506 partition: 0 MaxSeqNo: 40 sessionId: src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0
2025-10-10T14:34:56.599410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a32c75-e9b1ecb7-33a8159e-9048243_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:56.602095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0] Write session: try to update token
2025-10-10T14:34:56.602114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:56.618912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:56.618929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:56.618932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:56.618934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:56.618944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601557319841116:8823]
2025-10-10T14:34:56.618948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601557319841116:8823]
2025-10-10T14:34:56.618951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601557319841116:8823]
2025-10-10T14:34:56.618997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:56.619006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.619009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:56.619008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:56.619015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:56.619019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:56.619177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:56.619390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId: src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:56.622052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:56.677570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601558102065366:9272]
2025-10-10T14:34:56.678163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1505, pipe: [1:7559601558102065366:9272]
2025-10-10T14:34:56.730974Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:56.731257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.731268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.731314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065366:9272], now have 1 active actors on pipe
2025-10-10T14:34:56.731579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:56.737495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601558102065366:9272]
2025-10-10T14:34:56.737537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:56.737634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1506 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0
2025-10-10T14:34:56.740305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:56.740320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0] Write session will restart in 0.008666s
2025-10-10T14:34:56.740347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0] Write session: Do CDS request
2025-10-10T14:34:56.740353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:56.737832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1506 sessionId: src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0 is DEAD
2025-10-10T14:34:56.738023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:56.750306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.750368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:56.750382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1507
2025-10-10T14:34:56.750618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.750658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:56.750663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:56.750669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:56.751735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1507 sessionId:  describe result for acl check
2025-10-10T14:34:56.751774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:56.751776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:56.751778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:56.751784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601558102065392:9299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:56.752300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601558102065392:9299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:56.754231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601558102065392:9299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:56.757925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601558102065392:9299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:56.757937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601558102065392:9299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:56.757941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601558102065392:9299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:56.757949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:56.761979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:56.764652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:56.764882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:56.764895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:56.764908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:56.764986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:56.765033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601557319841245:8837]
2025-10-10T14:34:56.765645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:56.766064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:56.766118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:56.766485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:56.766546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.766554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.766556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.766557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.766558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.766560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.766561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.766562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.766565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.766566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.766567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.766568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.766569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.766576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.766587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.766591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.766595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.766599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.766602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.766606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.766610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.766614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.766619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.766622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.766626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.766630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.766637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.766645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.766651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.766657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.766662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.766667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.766671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.766676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.766681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.766686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.766691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.766695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.766700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.766706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.766716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.766721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.766725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.766734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.766738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.766744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.766752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.766757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.766763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.766772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.766776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.766785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.766825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:56.769265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:56.769655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:56.769666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:56.769669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:56.769673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:56.769679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1506 [2:7559601557319841245:8837]
2025-10-10T14:34:56.769691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:56.769715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:56.769723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.769728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.769731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.769749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:56.769761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:56.769770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:56.769825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.769832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.769835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.769837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:56.769904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:56.769911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.769925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.769943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.769966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:56.769997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065427:9299], now have 1 active actors on pipe
2025-10-10T14:34:56.770006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065383:2438], now have 1 active actors on pipe
2025-10-10T14:34:56.770013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601557319841240:8837]
2025-10-10T14:34:56.770021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601557319841240:8837]
2025-10-10T14:34:56.770023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601557319841240:8837]
2025-10-10T14:34:56.770036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:56.770054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:56.770076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:56.770083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:56.770058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1506
2025-10-10T14:34:56.770064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1506
2025-10-10T14:34:56.770109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601557319841240:8837]
2025-10-10T14:34:56.770116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:56.770149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:56.770158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:56.770162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:56.770169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:56.770351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.770364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.770399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c646697f-22621fc2-ad07c9cd-176b131a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:56.770413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.770430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.770432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:56.770444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.770459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:56.770489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.770983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.770993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.771013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.771120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1507 partition: 0 MaxSeqNo: 40 sessionId: src_id|c646697f-22621fc2-ad07c9cd-176b131a_0
2025-10-10T14:34:56.771533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d10fd6-b77f392b-ae867a83-5bde8ac0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c646697f-22621fc2-ad07c9cd-176b131a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:56.774164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c646697f-22621fc2-ad07c9cd-176b131a_0] Write session: try to update token
2025-10-10T14:34:56.774180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c646697f-22621fc2-ad07c9cd-176b131a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:56.795780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:56.795798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:56.795803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:56.795805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:56.795815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601557319841240:8837]
2025-10-10T14:34:56.795820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601557319841240:8837]
2025-10-10T14:34:56.795824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601557319841240:8837]
2025-10-10T14:34:56.795875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:56.795882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.795885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:56.796021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:56.797396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:56.797404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:56.797409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:56.805378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId: src_id|c646697f-22621fc2-ad07c9cd-176b131a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:56.808025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:56.837825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601558102065489:9272]
2025-10-10T14:34:56.838405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1506, pipe: [1:7559601558102065489:9272]
2025-10-10T14:34:56.912692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:56.913035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.913053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.913078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065489:9272], now have 1 active actors on pipe
2025-10-10T14:34:56.913309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:56.913489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601558102065489:9272]
2025-10-10T14:34:56.913520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:56.913600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1507 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c646697f-22621fc2-ad07c9cd-176b131a_0
2025-10-10T14:34:56.913818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1507 sessionId: src_id|c646697f-22621fc2-ad07c9cd-176b131a_0 is DEAD
2025-10-10T14:34:56.913947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:56.918208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c646697f-22621fc2-ad07c9cd-176b131a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:56.918220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c646697f-22621fc2-ad07c9cd-176b131a_0] Write session will restart in 0.009667s
2025-10-10T14:34:56.918246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c646697f-22621fc2-ad07c9cd-176b131a_0] Write session: Do CDS request
2025-10-10T14:34:56.918252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c646697f-22621fc2-ad07c9cd-176b131a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:56.926407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:56.928410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:56.928635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:56.928650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:56.928663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:56.928715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:56.928764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601557319841342:8842]
2025-10-10T14:34:56.929415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:56.929717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:56.929766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:56.930107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:56.930175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.930176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.930177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.930181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.930182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.930183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.930184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.930185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.930187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.930188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.930189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.930190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.930191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.930197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.930210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.930214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.930217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.930220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.930224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.930227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.930231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.930235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.930240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.930243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.930247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.930251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.930259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.930268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:56.930274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.930280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:56.930285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.930290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:56.930295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.930300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:56.930307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.930312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:56.930316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.930322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:56.930327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.930332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:56.930336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.930342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:56.930346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.930351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:56.930356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.930362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:56.930368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.930375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.930380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.930385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.930391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.930396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.930434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:56.933853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c646697f-22621fc2-ad07c9cd-176b131a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.933204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:56.933696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:56.933700Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:56.933703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:56.933707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:56.933714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1507 [2:7559601557319841342:8842]
2025-10-10T14:34:56.933729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:56.933751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:56.933754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.933758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.933761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.933779Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:56.933787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:56.933796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:56.933869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.933872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.933874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.933876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:56.933949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:56.933952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.933965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:56.933979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:56.933999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:56.934020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601557319841337:8842]
2025-10-10T14:34:56.934022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601557319841337:8842]
2025-10-10T14:34:56.934024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601557319841337:8842]
2025-10-10T14:34:56.934039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:56.934055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:56.934073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:56.934076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:56.934085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:56.934088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:56.934090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:56.934111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601557319841337:8842]
2025-10-10T14:34:56.934116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:56.934175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:56.934250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065490:2438], now have 1 active actors on pipe
2025-10-10T14:34:56.934300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1507
2025-10-10T14:34:56.937024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:56.937042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1508
2025-10-10T14:34:56.937236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:56.937276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:56.937283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:56.937287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:56.937844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1508 sessionId:  describe result for acl check
2025-10-10T14:34:56.937886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:56.937888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:56.937890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:56.937897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601558102065554:9306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:56.938543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601558102065554:9306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:56.941180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601558102065554:9306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:56.953234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601558102065554:9306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:56.953255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601558102065554:9306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:56.953259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601558102065554:9306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:56.953268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:56.954279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1507
2025-10-10T14:34:56.954232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601558102065582:9306], now have 1 active actors on pipe
2025-10-10T14:34:56.954610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.954626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.954665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:56.954684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:56.954695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:56.954698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:56.954713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:56.954740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:56.954766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.954993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:56.955004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:56.955022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:56.955115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1508 partition: 0 MaxSeqNo: 40 sessionId: src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0
2025-10-10T14:34:56.955529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c646697f-22621fc2-ad07c9cd-176b131a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:56.958350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0] Write session: try to update token
2025-10-10T14:34:56.958376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:56.958795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:56.958814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:56.958817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:56.958819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:56.958829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601557319841337:8842]
2025-10-10T14:34:56.958834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601557319841337:8842]
2025-10-10T14:34:56.958839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601557319841337:8842]
2025-10-10T14:34:56.958892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:56.958900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:56.958903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:56.959052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:56.960909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:56.960924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:56.960930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:56.980486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId: src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:56.983123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:57.013506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601562397032883:9272]
2025-10-10T14:34:57.013990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1507, pipe: [1:7559601562397032883:9272]
2025-10-10T14:34:57.077225Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:57.078367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:57.078450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1508 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0
2025-10-10T14:34:57.078659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1508 sessionId: src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0 is DEAD
2025-10-10T14:34:57.078823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601562397032883:9272]
2025-10-10T14:34:57.078843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:57.079082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:57.079095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0] Write session will restart in 0.005454s
2025-10-10T14:34:57.079122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0] Write session: Do CDS request
2025-10-10T14:34:57.079129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:57.077699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.077716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.077741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397032883:9272], now have 1 active actors on pipe
2025-10-10T14:34:57.077970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:57.086036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.086063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:57.086079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1509
2025-10-10T14:34:57.086322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.086360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:57.086371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:57.086375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:57.087259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1509 sessionId:  describe result for acl check
2025-10-10T14:34:57.087295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:57.087298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:57.087300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:57.087307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601562397032897:9310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:57.087858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601562397032897:9310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:57.091541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601562397032897:9310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:57.093842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:57.094701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601562397032897:9310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:57.094717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601562397032897:9310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:57.094721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601562397032897:9310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:57.094734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:57.095980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:57.096229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:57.096245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:57.096258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:57.096327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:57.096378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601561614808733:8844]
2025-10-10T14:34:57.097020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:57.097509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:57.097566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:57.097911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:57.097982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.097983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.097984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.097986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.097987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.097988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.097990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.097991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.097992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.097994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.097995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.097996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.097998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.098005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.098019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.098022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.098026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.098029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.098033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.098037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.098041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.098045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.098049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.098053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.098056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.098060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.098069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.098079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.098089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.098095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.098099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.098103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.098107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.098112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.098116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.098121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.098125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.098130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.098135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.098140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.098144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.098149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.098154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.098160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.098165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.098171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.098176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.098182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.098186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.098191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.098196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.098202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.098241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:57.100970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:57.101441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:57.101454Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:57.101457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:57.101461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:57.101471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1508 [2:7559601561614808733:8844]
2025-10-10T14:34:57.101485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:57.101505Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:57.101509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.101513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.101515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.101534Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:57.101548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:57.101556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:57.101665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.101673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.101675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.101678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:57.101758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:57.101766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.101778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.101791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.101813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:57.101841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397032969:9310], now have 1 active actors on pipe
2025-10-10T14:34:57.101848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397032884:2438], now have 1 active actors on pipe
2025-10-10T14:34:57.101856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601561614808726:8844]
2025-10-10T14:34:57.101858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601561614808726:8844]
2025-10-10T14:34:57.101860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601561614808726:8844]
2025-10-10T14:34:57.101875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:57.101895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:57.101915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:57.101922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:57.101957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601561614808726:8844]
2025-10-10T14:34:57.101966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:57.101968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:57.101971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:57.101973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:57.101981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:57.101957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1508
2025-10-10T14:34:57.101992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1508
2025-10-10T14:34:57.102079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.102093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.102132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e14485a8-c61a43c7-c171c49c-beae268c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:57.102142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.102146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.102148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:57.102163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.102178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:57.102196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.102390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.102396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.102414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.102532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1509 partition: 0 MaxSeqNo: 40 sessionId: src_id|e14485a8-c61a43c7-c171c49c-beae268c_0
2025-10-10T14:34:57.102980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc054b-f40ae217-e0712ef2-5d2c9868_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e14485a8-c61a43c7-c171c49c-beae268c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:57.105822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14485a8-c61a43c7-c171c49c-beae268c_0] Write session: try to update token
2025-10-10T14:34:57.105843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14485a8-c61a43c7-c171c49c-beae268c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:57.124878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:57.124899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:57.124902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:57.124904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:57.124915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601561614808726:8844]
2025-10-10T14:34:57.124919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601561614808726:8844]
2025-10-10T14:34:57.124923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601561614808726:8844]
2025-10-10T14:34:57.124972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:57.124975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:57.124979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.124982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:57.124984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:57.124986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:57.125119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:57.130022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId: src_id|e14485a8-c61a43c7-c171c49c-beae268c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:57.132707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:57.178840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601562397032981:9272]
2025-10-10T14:34:57.179122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1508, pipe: [1:7559601562397032981:9272]
2025-10-10T14:34:57.238512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:57.238824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.238850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.238915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397032981:9272], now have 1 active actors on pipe
2025-10-10T14:34:57.239199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:57.240114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14485a8-c61a43c7-c171c49c-beae268c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:57.240126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14485a8-c61a43c7-c171c49c-beae268c_0] Write session will restart in 0.007765s
2025-10-10T14:34:57.240153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14485a8-c61a43c7-c171c49c-beae268c_0] Write session: Do CDS request
2025-10-10T14:34:57.240159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14485a8-c61a43c7-c171c49c-beae268c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:57.239595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:57.239665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601562397032981:9272]
2025-10-10T14:34:57.239685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:57.239758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1509 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e14485a8-c61a43c7-c171c49c-beae268c_0
2025-10-10T14:34:57.239953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1509 sessionId: src_id|e14485a8-c61a43c7-c171c49c-beae268c_0 is DEAD
2025-10-10T14:34:57.249079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14485a8-c61a43c7-c171c49c-beae268c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.249134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:57.249149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1510
2025-10-10T14:34:57.249312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.249379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:57.249389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:57.249393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:57.249877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1510 sessionId:  describe result for acl check
2025-10-10T14:34:57.249925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:57.249927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:57.249928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:57.249935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601562397033035:9314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:57.250518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601562397033035:9314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:57.251613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:57.252665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601562397033035:9314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:57.253762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:57.253982Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:57.253994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:57.254007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:57.254065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:57.254108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601561614808826:8846]
2025-10-10T14:34:57.254723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:57.255034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:57.255105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:57.255357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601562397033035:9314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:57.255372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601562397033035:9314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:57.255376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601562397033035:9314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:57.255385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:57.255460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:57.255522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.255529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.255531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.255532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.255533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.255534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.255535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.255536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.255537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.255538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.255540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.255541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.255542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.255548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.255562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.255566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.255570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.255573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.255577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.255581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.255584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.255588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.255592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.255595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.255599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.255602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.255613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.255622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.255629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.255635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.255639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.255644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.255648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.255654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.255659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.255664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.255669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.255674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.255679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.255686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.255690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.255695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.255700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.255706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.255710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.255714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.255719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.255723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.255728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.255734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.255739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.255744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.255800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:57.258317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:57.258822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:57.258836Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:57.258839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:57.258843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:57.258849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1509 [2:7559601561614808826:8846]
2025-10-10T14:34:57.258862Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:57.258881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:57.258889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.258893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.258896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.258914Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:57.258928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:57.258936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:57.258994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.259001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.259004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.259006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:57.259072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:57.259081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.259094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.259111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.259133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:57.259176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397032982:2438], now have 1 active actors on pipe
2025-10-10T14:34:57.259181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033070:9314], now have 1 active actors on pipe
2025-10-10T14:34:57.259188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601561614808821:8846]
2025-10-10T14:34:57.259190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601561614808821:8846]
2025-10-10T14:34:57.259192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601561614808821:8846]
2025-10-10T14:34:57.259205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:57.259218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:57.259240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:57.259247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:57.259281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601561614808821:8846]
2025-10-10T14:34:57.259288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:57.259266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1509
2025-10-10T14:34:57.259316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:57.259277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1509
2025-10-10T14:34:57.259329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:57.259331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:57.259339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:57.259472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.259486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.259521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62223f79-fd411651-7a95bf69-f61febd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:57.259545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.259555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.259558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:57.259571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.259598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:57.259618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.259882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.259894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.259916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.260075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1510 partition: 0 MaxSeqNo: 40 sessionId: src_id|62223f79-fd411651-7a95bf69-f61febd9_0
2025-10-10T14:34:57.260535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14485a8-c61a43c7-c171c49c-beae268c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62223f79-fd411651-7a95bf69-f61febd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:57.263359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62223f79-fd411651-7a95bf69-f61febd9_0] Write session: try to update token
2025-10-10T14:34:57.263381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62223f79-fd411651-7a95bf69-f61febd9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:57.271706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:57.271725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:57.271736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601561614808821:8846]
2025-10-10T14:34:57.271787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:57.271895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:57.271972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:57.272121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.272282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.272418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.272595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:57.272633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:57.280994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId: src_id|62223f79-fd411651-7a95bf69-f61febd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:57.283983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:57.284222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.284260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.284314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:57.284391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:57.289908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:57.289932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:57.289940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:57.289944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:57.289955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601561614808821:8846]
2025-10-10T14:34:57.289960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601561614808821:8846]
2025-10-10T14:34:57.289964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601561614808821:8846]
2025-10-10T14:34:57.290018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:57.290031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.290034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:57.290033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:57.290040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:57.290045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:57.290172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:57.341068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601562397033080:9272]
2025-10-10T14:34:57.342095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1509, pipe: [1:7559601562397033080:9272]
2025-10-10T14:34:57.407115Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:57.415708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.415744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.415942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.416015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.416092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.416165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.416218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.416229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.416309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.416379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.416450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.416523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.416568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.416576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.416654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.416721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.416789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.416857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.416903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.416910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.416978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.417051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.417116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.417182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.417230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.417238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.417308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.417394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.417469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.417537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.417587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.417590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.417659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.417720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.417780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.417839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.417890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.417892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.417966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.418025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.418143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.418209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.418249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.418251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.418325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.418387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.418455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.418514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.418559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.418562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.418637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.418699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.418759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.418823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.418865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.418868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.418936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.418994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.419054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.419117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.419172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.419175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.419252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033080:9272], now have 1 active actors on pipe
2025-10-10T14:34:57.420417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:57.421510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601562397033080:9272]
2025-10-10T14:34:57.421542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:57.421594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:57.421649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1510 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62223f79-fd411651-7a95bf69-f61febd9_0
2025-10-10T14:34:57.421857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1510 sessionId: src_id|62223f79-fd411651-7a95bf69-f61febd9_0 is DEAD
2025-10-10T14:34:57.425709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62223f79-fd411651-7a95bf69-f61febd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:57.425724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62223f79-fd411651-7a95bf69-f61febd9_0] Write session will restart in 0.008952s
2025-10-10T14:34:57.425753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62223f79-fd411651-7a95bf69-f61febd9_0] Write session: Do CDS request
2025-10-10T14:34:57.425760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62223f79-fd411651-7a95bf69-f61febd9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:57.437823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62223f79-fd411651-7a95bf69-f61febd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.436369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:57.438489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:57.438758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:57.438774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:57.438786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:57.438850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:57.438908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601561614808920:8848]
2025-10-10T14:34:57.439591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:57.440189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:57.440250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:57.440613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:57.440693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.440704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.440706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.440707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.440708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.440710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.440711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.440713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.440714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.440716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.440717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.440719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.440720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.440728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.440746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.440751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.440756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.440760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.440765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.440769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.440773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.440777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.440782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.440786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.440789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.440793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.440802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.440810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.440816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.440822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.440827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.440832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.440836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.440841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.440847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.440852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.440859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.440864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.440869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.440875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.440879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.440884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.440889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.440895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.440900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.440906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.440910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.440916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.440921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.440926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.440931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.440944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.440983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:57.441547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:57.441576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1511
2025-10-10T14:34:57.441753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.441803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:57.441816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:57.441820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:57.442241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1511 sessionId:  describe result for acl check
2025-10-10T14:34:57.442276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:57.442277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:57.442279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:57.442285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601562397033144:9318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:57.442875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601562397033144:9318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:57.444744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:57.445080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:57.445097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:57.445100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:57.445104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:57.445110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1510 [2:7559601561614808920:8848]
2025-10-10T14:34:57.445127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:57.445149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:57.445159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.445163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.445166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.445188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:57.445203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:57.445218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:57.445290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.445300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.445303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.445306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:57.445401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:57.445410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.445424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.445434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.445462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:57.445486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601561614808915:8848]
2025-10-10T14:34:57.445488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601561614808915:8848]
2025-10-10T14:34:57.445490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601561614808915:8848]
2025-10-10T14:34:57.445505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:57.445522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:57.445539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:57.445543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:57.445566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:57.445569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:57.445571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:57.445579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601561614808915:8848]
2025-10-10T14:34:57.445582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:57.445661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:57.445782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033081:2438], now have 1 active actors on pipe
2025-10-10T14:34:57.445785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1510
2025-10-10T14:34:57.446200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601562397033144:9318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:57.453215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62223f79-fd411651-7a95bf69-f61febd9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:57.451411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601562397033144:9318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:57.451430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601562397033144:9318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:57.451434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601562397033144:9318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:57.451443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:57.452215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033177:9318], now have 1 active actors on pipe
2025-10-10T14:34:57.452308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.452183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1510
2025-10-10T14:34:57.452331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.452369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:57.452384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.452391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.452787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1511 partition: 0 MaxSeqNo: 40 sessionId: src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0
2025-10-10T14:34:57.452394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:57.452421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.452445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:57.452470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.452645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.452650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.452667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.456076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0] Write session: try to update token
2025-10-10T14:34:57.456096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:57.458287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:57.458309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:57.458321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601561614808915:8848]
2025-10-10T14:34:57.458378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:57.458378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:57.458573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:57.458734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.458896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.459059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.459296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:57.459351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:57.474579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId: src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:57.477429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:57.478082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.478101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.478136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:57.480326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:57.480342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:57.480344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:57.480345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:57.480354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601561614808915:8848]
2025-10-10T14:34:57.480359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601561614808915:8848]
2025-10-10T14:34:57.480361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601561614808915:8848]
2025-10-10T14:34:57.480396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:57.480402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.480404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:57.480406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:57.480411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:57.480416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:57.480542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:57.478279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:57.521880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601562397033181:9272]
2025-10-10T14:34:57.522315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1510, pipe: [1:7559601562397033181:9272]
2025-10-10T14:34:57.598365Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:57.606640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.606676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.606879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.606947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.607024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.607094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.607156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.607166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.607238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.607310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.607379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.607448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.607500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.607509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.607590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.607661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.607719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.607780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.607825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.607828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.607901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.607962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.608024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.608082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.608122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.608125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.608195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.608256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.608325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.608388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.608431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.608433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.608501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.608556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.608614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.608680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.608724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.608727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.608795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.608854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.608919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.608979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.609020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.609022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.609094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.609155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.609218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.609281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.609323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.609325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.609420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.609476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.609535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.609603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.609659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.609668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.609737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.609801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.609872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.609932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.609973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.609976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.610045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033181:9272], now have 1 active actors on pipe
2025-10-10T14:34:57.610434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601562397033181:9272]
2025-10-10T14:34:57.610485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:57.610487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:57.610519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1511 reason: error at write: Disconnected sessionId: src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0
2025-10-10T14:34:57.610739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1511 sessionId: src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0 is DEAD
2025-10-10T14:34:57.610914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:57.610926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0] Write session will restart in 0.008173s
2025-10-10T14:34:57.610951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0] Write session: Do CDS request
2025-10-10T14:34:57.610958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:57.610910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:57.611223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:57.619824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.619911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:57.619928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1512
2025-10-10T14:34:57.620368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.620413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:57.620423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:57.620427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:57.621036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1512 sessionId:  describe result for acl check
2025-10-10T14:34:57.621071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:57.621078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:57.621080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:57.621086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601562397033210:9323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:57.621542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601562397033210:9323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:57.624545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601562397033210:9323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:57.627847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601562397033210:9323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:57.627871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601562397033210:9323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:57.627875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601562397033210:9323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:57.627884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:57.629500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:57.630039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:57.630226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:57.630231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:57.630242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:57.630288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:57.630325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601561614809030:8850]
2025-10-10T14:34:57.630943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:57.631502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:57.631559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:57.631872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:57.631932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.631939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.631940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.631941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.631942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.631943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.631945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.631946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.631947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.631948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.631949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.631950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.631951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.631957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.631970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.631974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.631978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.631982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.631987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.631991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.631995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.631999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.632003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.632008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.632011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.632015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.632023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.632029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.632034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.632038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.632041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.632044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.632048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.632051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.632055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.632058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.632061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.632064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.632066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.632069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.632072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.632074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.632077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.632080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.632082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.632085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.632088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.632091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.632095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.632100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.632104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.632109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.632153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:57.634677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:57.635125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:57.635149Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:57.635151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:57.635156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:57.635162Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1511 [2:7559601561614809030:8850]
2025-10-10T14:34:57.635176Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:57.635198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:57.635206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.635209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.635211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.635230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:57.635249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:57.635258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:57.635324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.635336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.635338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.635340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:57.635420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:57.635430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.635443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.635471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.635494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:57.635517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601561614809024:8850]
2025-10-10T14:34:57.635520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601561614809024:8850]
2025-10-10T14:34:57.635522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601561614809024:8850]
2025-10-10T14:34:57.635537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:57.635559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:57.635575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:57.635578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:57.635597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:57.635600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:57.635602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:57.635614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601561614809024:8850]
2025-10-10T14:34:57.635617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:57.635661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:57.635904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033182:2438], now have 1 active actors on pipe
2025-10-10T14:34:57.635916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033285:9323], now have 1 active actors on pipe
2025-10-10T14:34:57.635953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1511
2025-10-10T14:34:57.635953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1511
2025-10-10T14:34:57.636051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.636066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.636098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|742bacd6-6996931b-7e5b822d-b4298c16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:57.636118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.636123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.636125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:57.636139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.636153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:57.636180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.636359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.636370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.636393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.636566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1512 partition: 0 MaxSeqNo: 40 sessionId: src_id|742bacd6-6996931b-7e5b822d-b4298c16_0
2025-10-10T14:34:57.637251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a27952-8cb8d23c-8a62e39a-874b1785_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|742bacd6-6996931b-7e5b822d-b4298c16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:57.639937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|742bacd6-6996931b-7e5b822d-b4298c16_0] Write session: try to update token
2025-10-10T14:34:57.639956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|742bacd6-6996931b-7e5b822d-b4298c16_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:57.655492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId: src_id|742bacd6-6996931b-7e5b822d-b4298c16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:57.658438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:57.658702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.658727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.658851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:57.658771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:57.660642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:57.660647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:57.660650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:57.660652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:57.660663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601561614809024:8850]
2025-10-10T14:34:57.660667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601561614809024:8850]
2025-10-10T14:34:57.660671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601561614809024:8850]
2025-10-10T14:34:57.660725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:57.660719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:57.660734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.660735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:57.660738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:57.660740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:57.660885Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:57.710802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601562397033305:9272]
2025-10-10T14:34:57.711124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1511, pipe: [1:7559601562397033305:9272]
2025-10-10T14:34:57.777854Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:57.786030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.786060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.786241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.786313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.786385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.786455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.786889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.786904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.786981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.787043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.787109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.787191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.787244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.787246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.787319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.787378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.787440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.787502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.787544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.787547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.787619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.787690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.787754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.787817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.787858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.787861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.787933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.787994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.788057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.788117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.788161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.788164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.788233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.788292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.788355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.788420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.788462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.788465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.788535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.788595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.788664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.788725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.788768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.788771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.788843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.788900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.788960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.789022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.789060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.789063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.789130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.789185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.789246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.789308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.789566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.789576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.789641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.789696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.789753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.789810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.789853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.789856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.789954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033305:9272], now have 1 active actors on pipe
2025-10-10T14:34:57.790259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:57.790273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:57.790317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1512 reason: error at write: Disconnected sessionId: src_id|742bacd6-6996931b-7e5b822d-b4298c16_0
2025-10-10T14:34:57.790538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1512 sessionId: src_id|742bacd6-6996931b-7e5b822d-b4298c16_0 is DEAD
2025-10-10T14:34:57.790535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:57.790713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742bacd6-6996931b-7e5b822d-b4298c16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:57.790725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742bacd6-6996931b-7e5b822d-b4298c16_0] Write session will restart in 0.007073s
2025-10-10T14:34:57.790750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742bacd6-6996931b-7e5b822d-b4298c16_0] Write session: Do CDS request
2025-10-10T14:34:57.790756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742bacd6-6996931b-7e5b822d-b4298c16_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:57.790729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:57.790781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601562397033305:9272]
2025-10-10T14:34:57.798918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|742bacd6-6996931b-7e5b822d-b4298c16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.799050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:57.799067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1513
2025-10-10T14:34:57.799253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.799294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:57.799307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:57.799311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:57.799856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1513 sessionId:  describe result for acl check
2025-10-10T14:34:57.799894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:57.799902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:57.799904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:57.799911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601562397033348:9334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:57.800452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601562397033348:9334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:57.803530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601562397033348:9334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:57.803779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:57.806480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601562397033348:9334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:57.806493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601562397033348:9334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:57.806497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601562397033348:9334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:57.806505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:57.805843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:57.806076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:57.806082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:57.806094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:57.806153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:57.806192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601561614809160:8865]
2025-10-10T14:34:57.806806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:57.807193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:57.807253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:57.807611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:57.807690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.807699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.807701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.807702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.807703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.807705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.807706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.807707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.807709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.807710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.807711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.807712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.807713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.807721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.807733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.807737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.807741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.807745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.807750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.807754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.807757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.807761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.807765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.807769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.807773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.807776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.807784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.807793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:57.807800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.807806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:57.807810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.807817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:57.807821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.807826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:57.807831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.807836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:57.807841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.807846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:57.807850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.807856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:57.807860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.807865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:57.807869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.807874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:57.807879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.807884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:57.807889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.807894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.807899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.807906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.807910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.807915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.807969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:57.811231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1512
2025-10-10T14:34:57.811267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1512
2025-10-10T14:34:57.810511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:57.810829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:57.810834Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:57.810836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:57.810840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:57.810846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1512 [2:7559601561614809160:8865]
2025-10-10T14:34:57.810859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:57.810877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:57.810880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.810884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.810886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.810903Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:57.810910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:57.810917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:57.810977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.810978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.810980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.810983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:57.811058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:57.811061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.811072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:57.811082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:57.811096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:57.811118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033320:2438], now have 1 active actors on pipe
2025-10-10T14:34:57.811122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033408:9334], now have 1 active actors on pipe
2025-10-10T14:34:57.811142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601561614809155:8865]
2025-10-10T14:34:57.811143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601561614809155:8865]
2025-10-10T14:34:57.811145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601561614809155:8865]
2025-10-10T14:34:57.811160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:57.811174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:57.811189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:57.811192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:57.811233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601561614809155:8865]
2025-10-10T14:34:57.811235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:57.811258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:57.811261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:57.811263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:57.811271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:57.811480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.811505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.811540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:57.811556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:57.811559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:57.811562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:57.811592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:57.811604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:57.811621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.811847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.811857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.811873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:57.811987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1513 partition: 0 MaxSeqNo: 40 sessionId: src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0
2025-10-10T14:34:57.812522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|742bacd6-6996931b-7e5b822d-b4298c16_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:57.815208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0] Write session: try to update token
2025-10-10T14:34:57.815227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:57.822750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:57.822766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:57.822776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601561614809155:8865]
2025-10-10T14:34:57.822812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:57.822822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:57.822990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:57.823137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.823261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.823401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:57.823595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:57.823629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:57.831097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId: src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:57.833673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:57.835780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.835805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.835851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:57.835978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:57.842783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:57.842806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:57.842809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:57.842811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:57.842822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601561614809155:8865]
2025-10-10T14:34:57.842826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601561614809155:8865]
2025-10-10T14:34:57.842830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601561614809155:8865]
2025-10-10T14:34:57.842882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:57.842896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:57.842899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:57.843048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:57.845453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:57.845470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:57.845475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:57.890989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601562397033432:9272]
2025-10-10T14:34:57.891751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1512, pipe: [1:7559601562397033432:9272]
2025-10-10T14:34:57.974987Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:57.982735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:57.982763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:57.982940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.983001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.983070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.983142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.983190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.983200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.983270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.983334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.983397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.983474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.983524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.983532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.983602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.983666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.983732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.983795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.983839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.983846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.983912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.983978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.984043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.984105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.984148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.984155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.984223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.984282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.984343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.984408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.984450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.984457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.984524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.984581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.984642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.984708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.984758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.984761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.984826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.984884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.984941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.984999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.985046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.985049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.985115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.985168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.985230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.985291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.985415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.985423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.985491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.985551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.985611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.985674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.985719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.985733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.985797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:57.985855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:57.985924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:57.985987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:57.986032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:57.986039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:57.986100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033432:9272], now have 1 active actors on pipe
2025-10-10T14:34:57.986365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:57.986425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:57.986433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:57.986909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:57.986920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0] Write session will restart in 0.005411s
2025-10-10T14:34:57.986465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1513 reason: error at write: Disconnected sessionId: src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0
2025-10-10T14:34:57.986945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0] Write session: Do CDS request
2025-10-10T14:34:57.986705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1513 sessionId: src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0 is DEAD
2025-10-10T14:34:57.986927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601562397033432:9272]
2025-10-10T14:34:57.986953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:57.987148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:57.993888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.997582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:57.997605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1514
2025-10-10T14:34:57.997774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:57.997837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:57.997847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:57.997870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:57.998350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1514 sessionId:  describe result for acl check
2025-10-10T14:34:57.998388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:57.998394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:57.998396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:57.998403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601562397033497:9341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:57.998997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601562397033497:9341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:58.000183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:58.002250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:58.002255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601562397033497:9341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:58.002465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:58.002487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:58.002500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:58.002574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:58.002619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601565909776562:8869]
2025-10-10T14:34:58.003249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:58.003563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:58.003622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:58.003955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:58.004025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.004026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.004027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.004028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.004030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.004031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.004032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.004033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.004034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.004036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.004037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.004038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.004039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.004045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.004058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.004062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.004066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.004070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.004074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.004078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.004082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.004086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.004090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.004094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.004098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.004102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.004109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.004117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.004123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.004129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.004133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.004138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.004142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.004148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.004153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.004158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.004162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.004167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.004172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.004178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.004182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.004186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.004191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.004195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.004199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.004203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.004208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.004213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.004217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.004222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.004227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.004232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.004273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:58.004931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601562397033497:9341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:58.004945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601562397033497:9341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:58.004949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601562397033497:9341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:58.004958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:58.007452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1513
2025-10-10T14:34:58.007469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1513
2025-10-10T14:34:58.006705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:58.007049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:58.007053Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:58.007056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:58.007059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:58.007066Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1513 [2:7559601565909776562:8869]
2025-10-10T14:34:58.007079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:58.007096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:58.007099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.007103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.007106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.007135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:58.007142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:58.007151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:58.007222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.007224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.007226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.007229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:58.007295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:58.007298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.007308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.007320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.007337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:58.007359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601562397033437:2438], now have 1 active actors on pipe
2025-10-10T14:34:58.007363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692000824:9341], now have 1 active actors on pipe
2025-10-10T14:34:58.007371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601565909776557:8869]
2025-10-10T14:34:58.007373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601565909776557:8869]
2025-10-10T14:34:58.007375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601565909776557:8869]
2025-10-10T14:34:58.007388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:58.007402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:58.007403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:58.007406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:58.007408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:58.007419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:58.007422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:58.007445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601565909776557:8869]
2025-10-10T14:34:58.007456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:58.007466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:58.007497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.007503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.007534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:58.007542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.007549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.007551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:58.007563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.007576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:58.007590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.007773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.007779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.007803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.007914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1514 partition: 0 MaxSeqNo: 40 sessionId: src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0
2025-10-10T14:34:58.008351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91bf984f-eaf033e9-77e7f7b9-2d40c2d6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:58.011116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0] Write session: try to update token
2025-10-10T14:34:58.011148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:58.025983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:58.026006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:58.026018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601565909776557:8869]
2025-10-10T14:34:58.026076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:58.026272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:58.026440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:58.026604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:58.026764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:58.026979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:58.027031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:58.027165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:58.031294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId: src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:58.034009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:58.034264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.034286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.034344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:58.034449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:58.039341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:58.039358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:58.039362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:58.039364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:58.039375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601565909776557:8869]
2025-10-10T14:34:58.039379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601565909776557:8869]
2025-10-10T14:34:58.039383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601565909776557:8869]
2025-10-10T14:34:58.039433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:58.039439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:58.039445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:58.039447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.039450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:58.039452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:58.039593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:58.087140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601566692000831:9272]
2025-10-10T14:34:58.087446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1513, pipe: [1:7559601566692000831:9272]
2025-10-10T14:34:58.150558Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:58.159096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.159141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.159322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.159379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.159444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.159505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.159544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.159551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.159620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.159680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.159736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.159798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.159840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.159843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.159905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.159963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.160023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.160083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.160122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.160125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.160194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.160255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.160312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.160374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.160415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.160419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.160486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.160544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.160607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.160665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.160706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.160709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.160778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.160834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.160892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.160950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.160992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.160995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.161059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.161116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.161173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.161230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.161269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.161272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.161562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.161628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.161684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.161744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.161785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.161788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.161854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.161915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.161975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.162032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.162070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.162074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.162139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.162192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.162250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.162309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.162347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.162350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.162431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692000831:9272], now have 1 active actors on pipe
2025-10-10T14:34:58.163548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:58.163138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:58.163197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601566692000831:9272]
2025-10-10T14:34:58.163221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:58.163224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:58.163253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1514 reason: error at write: Disconnected sessionId: src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0
2025-10-10T14:34:58.163490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1514 sessionId: src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0 is DEAD
2025-10-10T14:34:58.165553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:58.165566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0] Write session will restart in 0.005277s
2025-10-10T14:34:58.165592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0] Write session: Do CDS request
2025-10-10T14:34:58.165599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:58.173810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.177566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:58.177586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1515
2025-10-10T14:34:58.177839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.177876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:58.177882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:58.177885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:58.178647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1515 sessionId:  describe result for acl check
2025-10-10T14:34:58.178687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:58.178689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:58.178692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:58.178699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601566692000895:9345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:58.179319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601566692000895:9345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:58.180372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:58.182737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:58.182935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601566692000895:9345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:58.182983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:58.182995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:58.183008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:58.183076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:58.183135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601565909776661:8871]
2025-10-10T14:34:58.183809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:58.184235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:58.184303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:58.184742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:58.184808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.184814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.184816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.184817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.184819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.184821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.184822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.184824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.184825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.184827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.184828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.184829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.184831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.184838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.184852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.184857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.184862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.184866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.184872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.184877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.184881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.184885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.184892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.184896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.184900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.184904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.184911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.184920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.184927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.184933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.184938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.184943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.184949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.184955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.184971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.184977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.184981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.184986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.184991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.184996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.185002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.185007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.185012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.185018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.185023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.185029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.185034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.185039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.185044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.185050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.185055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.185060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.185102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:58.187212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601566692000895:9345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:58.187227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601566692000895:9345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:58.187231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601566692000895:9345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:58.187241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:58.187860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:58.188200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:58.188216Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:58.188218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:58.188222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:58.188228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1514 [2:7559601565909776661:8871]
2025-10-10T14:34:58.188242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:58.188261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:58.188264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.188269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.188271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.188309Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:58.188322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:58.188330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:58.188398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.188405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.188407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.188410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:58.188491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:58.188499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.188512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.188545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.188569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:58.188605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692000834:2438], now have 1 active actors on pipe
2025-10-10T14:34:58.188613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692000928:9345], now have 1 active actors on pipe
2025-10-10T14:34:58.188621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601565909776656:8871]
2025-10-10T14:34:58.188628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601565909776656:8871]
2025-10-10T14:34:58.188631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601565909776656:8871]
2025-10-10T14:34:58.188644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:58.188658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:58.188661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:58.188663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:58.188663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:58.188680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:58.188688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:58.188718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601565909776656:8871]
2025-10-10T14:34:58.188729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:58.188737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:58.188632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1514
2025-10-10T14:34:58.188674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1514
2025-10-10T14:34:58.188943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.188956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.188988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:58.189002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.189017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.189024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:58.189037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.189050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:58.189074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.191289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.191303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.191330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.194182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1515 partition: 0 MaxSeqNo: 40 sessionId: src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0
2025-10-10T14:34:58.197457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5da57cdc-b5930e7f-9728c757-e4412b56_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:58.200118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0] Write session: try to update token
2025-10-10T14:34:58.200141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:58.217161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:58.217184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:58.217187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:58.217190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:58.217200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601565909776656:8871]
2025-10-10T14:34:58.217205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601565909776656:8871]
2025-10-10T14:34:58.217210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601565909776656:8871]
2025-10-10T14:34:58.217266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:58.217279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.217286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:58.217440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:58.220908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:58.220929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:58.220934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:58.229413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId: src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:58.232335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:58.263250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601566692000936:9272]
2025-10-10T14:34:58.263646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1514, pipe: [1:7559601566692000936:9272]
2025-10-10T14:34:58.334158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:58.334733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.334755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.334782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692000936:9272], now have 1 active actors on pipe
2025-10-10T14:34:58.335054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:58.335166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:58.335226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601566692000936:9272]
2025-10-10T14:34:58.335250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:58.335253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:58.335326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1515 reason: error at write: Disconnected sessionId: src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0
2025-10-10T14:34:58.335522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1515 sessionId: src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0 is DEAD
2025-10-10T14:34:58.335895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:58.335905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0] Write session will restart in 0.009505s
2025-10-10T14:34:58.335924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0] Write session: Do CDS request
2025-10-10T14:34:58.335929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:58.349067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.349469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:58.349483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1516
2025-10-10T14:34:58.353465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.353520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:58.353526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:58.353532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:58.354042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1516 sessionId:  describe result for acl check
2025-10-10T14:34:58.354075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:58.354278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:58.354288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:58.354295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601566692000973:9349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:58.354870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601566692000973:9349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:58.357765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601566692000973:9349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:58.359975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:58.362637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601566692000973:9349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:58.362652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601566692000973:9349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:58.362656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601566692000973:9349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:58.362666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:58.362388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:58.362626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:58.362631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:58.362644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:58.362702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:58.362746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601565909776761:8873]
2025-10-10T14:34:58.363343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:58.363726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:58.363771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:58.364108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:58.364173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.364174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.364175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.364176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.364177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.364178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.364180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.364181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.364182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.364183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.364185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.364186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.364187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.364194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.364208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.364212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.364216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.364218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.364220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.364223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.364225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.364227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.364229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.364231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.364233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.364235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.364243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.364249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.364254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.364257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.364260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.364263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.364266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.364269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.364272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.364275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.364278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.364281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.364285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.364288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.364291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.364294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.364299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.364302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.364305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.364308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.364311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.364314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.364317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.364320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.364323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.364326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.364348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:58.367107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:58.367501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:58.367513Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:58.367516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:58.367520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:58.367527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1515 [2:7559601565909776761:8873]
2025-10-10T14:34:58.367541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:58.367564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:58.367568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.367571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.367574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.367592Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:58.367610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:58.367618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:58.367680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.367688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.367689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.367692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:58.367763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:58.367771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.367782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.367797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.367815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:58.367844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001030:9349], now have 1 active actors on pipe
2025-10-10T14:34:58.367852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692000938:2438], now have 1 active actors on pipe
2025-10-10T14:34:58.367860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601565909776755:8873]
2025-10-10T14:34:58.367866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601565909776755:8873]
2025-10-10T14:34:58.367868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601565909776755:8873]
2025-10-10T14:34:58.367882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:58.367901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:58.367922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:58.367926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:58.367941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:58.367952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601565909776755:8873]
2025-10-10T14:34:58.367960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:58.367961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:58.367963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:58.367971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:58.368074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.368085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.368130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8a753be-4d171c2e-60535342-e119249e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:58.367937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1515
2025-10-10T14:34:58.368140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.368149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.368152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:58.367979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1515
2025-10-10T14:34:58.368166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.368181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:58.368202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.368565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.368576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.368609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.368700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1516 partition: 0 MaxSeqNo: 40 sessionId: src_id|c8a753be-4d171c2e-60535342-e119249e_0
2025-10-10T14:34:58.369116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b91bb4b2-4e4912ec-a6a820a7-bc27b8e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c8a753be-4d171c2e-60535342-e119249e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:58.371886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a753be-4d171c2e-60535342-e119249e_0] Write session: try to update token
2025-10-10T14:34:58.371907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a753be-4d171c2e-60535342-e119249e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:58.391021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId: src_id|c8a753be-4d171c2e-60535342-e119249e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:58.390212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:58.390232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:58.390246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601565909776755:8873]
2025-10-10T14:34:58.390298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:58.390471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:58.390603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:58.390726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:58.390846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:58.391021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:58.391055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:58.393316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:58.393778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:58.396353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.396377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.396418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:58.396541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:58.425192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.425227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.425459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.425532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.425598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.425672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.425717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.425727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.425794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.425857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.425924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.425990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.426420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.426432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.426499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.426561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.426631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.426696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.426740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.426752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.426818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.426879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.426940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.427002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.427043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.427046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.427124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.427180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.427240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.427298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.427336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.427339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.427411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.427473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.427532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.427588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.427628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.427630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.427700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.427759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.427955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.428021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.428066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.428074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.428142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.428204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.428263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.428324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.428366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.428369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.428436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.428493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.428555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.428615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.428655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.428658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.428723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:58.428779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:58.428835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:58.428891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:58.428931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:58.428933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:58.429005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:58.429008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:58.429010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:58.429012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:58.429020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601565909776755:8873]
2025-10-10T14:34:58.429023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601565909776755:8873]
2025-10-10T14:34:58.429027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601565909776755:8873]
2025-10-10T14:34:58.429082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:34:58.429082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:58.429089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:58.429093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:58.429147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.429168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.429170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:34:58.429206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:34:58.429219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:34:58.429222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:34:58.429225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:34:58.429228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:34:58.429712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:34:58.429731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:34:58.429737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:34:58.429741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:34:58.429747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:34:58.429750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:34:58.430207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:34:58.430218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:34:58.430223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:34:58.430226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:34:58.430230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:34:58.430233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:34:58.430681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:34:58.430694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:34:58.430699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:34:58.430702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:34:58.430705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:34:58.433425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:34:58.433445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:34:58.433460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760106898433
2025-10-10T14:34:58.433578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:34:58.433594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:34:58.433601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:34:58.433604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:34:58.433608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:34:58.433611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:34:58.434571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601566692001042:9272]
2025-10-10T14:34:58.434347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:34:58.434371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:34:58.434376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:34:58.434378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:34:58.434381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:34:58.434385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:34:58.434992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:34:58.435005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:34:58.435015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:34:58.435020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:34:58.435024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:34:58.435028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:34:58.435871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1515, pipe: [1:7559601566692001042:9272]
2025-10-10T14:34:58.435614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:34:58.435637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:34:58.435642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:34:58.436719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:34:58.436726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:34:58.436732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:34:58.436738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:34:58.436746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760106898435
2025-10-10T14:34:58.437033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:34:58.437046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:34:58.437052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:34:58.437055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:34:58.437059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:34:58.437063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:34:58.437703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:34:58.437729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:34:58.437735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:34:58.437740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:34:58.437744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:34:58.437748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:34:58.438175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:34:58.438195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.438311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760106898438
2025-10-10T14:34:58.442263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:58.442276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.442278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:58.442421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:58.557704Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:58.558062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001042:9272], now have 1 active actors on pipe
2025-10-10T14:34:58.558078Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:34:58.558105Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:34:58.558113Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:34:58.558122Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:34:58.558382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:58.563679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601566692001042:9272]
2025-10-10T14:34:58.563717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:58.563777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1516 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8a753be-4d171c2e-60535342-e119249e_0
2025-10-10T14:34:58.564032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:58.564328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a753be-4d171c2e-60535342-e119249e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:58.564341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a753be-4d171c2e-60535342-e119249e_0] Write session will restart in 0.005518s
2025-10-10T14:34:58.564370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a753be-4d171c2e-60535342-e119249e_0] Write session: Do CDS request
2025-10-10T14:34:58.564377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a753be-4d171c2e-60535342-e119249e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:58.564297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1516 sessionId: src_id|c8a753be-4d171c2e-60535342-e119249e_0 is DEAD
2025-10-10T14:34:58.570881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a753be-4d171c2e-60535342-e119249e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.570980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:58.570995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1517
2025-10-10T14:34:58.571137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.571172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:58.571178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:58.571183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:58.571734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1517 sessionId:  describe result for acl check
2025-10-10T14:34:58.571780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:58.571787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:58.571789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:58.571795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601566692001053:9353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:58.572431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601566692001053:9353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:58.576334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601566692001053:9353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:58.579941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601566692001053:9353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:58.579957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601566692001053:9353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:58.579961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601566692001053:9353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:58.579971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:58.583388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:58.585649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:58.585880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:58.585891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:58.585903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:58.585971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:58.586025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601565909776863:8875]
2025-10-10T14:34:58.586703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:58.589473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:58.589539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:58.589923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:58.590004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.590013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.590014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.590016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.590017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.590019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.590020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.590022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.590023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.590025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.590026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.590027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.590031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.590038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.590053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.590057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.590062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.590066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.590071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.590075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.590080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.590084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.590091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.590096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.590100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.590105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.590114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.590123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.590130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.590136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.590141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.590147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.590152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.590159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.590165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.590171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.590176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.590182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.590188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.590194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.590198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.590218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.590229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.590235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.590241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.590247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.590252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.590257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.590262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.590268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.590278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.590284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.590331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:58.592996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:58.593345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:58.593356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:58.593360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:58.593364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:58.593371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1516 [2:7559601565909776863:8875]
2025-10-10T14:34:58.593386Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:58.593405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:58.593409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.593412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.593415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.593433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:58.593442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:58.593450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:58.593526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.593534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.593536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.593539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:58.593609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:58.593617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.593630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.593644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.593669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:58.593698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001116:9353], now have 1 active actors on pipe
2025-10-10T14:34:58.593706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001045:2438], now have 1 active actors on pipe
2025-10-10T14:34:58.593716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601565909776858:8875]
2025-10-10T14:34:58.593718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601565909776858:8875]
2025-10-10T14:34:58.593721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601565909776858:8875]
2025-10-10T14:34:58.593735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:58.593754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:58.593770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:58.593778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:58.593781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:58.593781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:58.593783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:58.593785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1516
2025-10-10T14:34:58.593809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601565909776858:8875]
2025-10-10T14:34:58.593817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:58.593830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:58.593823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1516
2025-10-10T14:34:58.593890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.593900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.593930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:58.593943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.593947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.593950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:58.593962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.593977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:58.593993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.594160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.594173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.594199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.594323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1517 partition: 0 MaxSeqNo: 40 sessionId: src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0
2025-10-10T14:34:58.594725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a753be-4d171c2e-60535342-e119249e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:58.597621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0] Write session: try to update token
2025-10-10T14:34:58.597639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:58.615627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:58.615666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:58.615669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:58.615672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:58.615682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601565909776858:8875]
2025-10-10T14:34:58.615687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601565909776858:8875]
2025-10-10T14:34:58.615691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601565909776858:8875]
2025-10-10T14:34:58.615743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:58.615745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:58.615752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.615755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:58.615759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:58.615764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:58.615905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:58.615720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId: src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:58.618468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:58.663660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601566692001169:9272]
2025-10-10T14:34:58.664112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1516, pipe: [1:7559601566692001169:9272]
2025-10-10T14:34:58.730769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:58.731151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.731163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.731210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001169:9272], now have 1 active actors on pipe
2025-10-10T14:34:58.732108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601566692001169:9272]
2025-10-10T14:34:58.732280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:58.732319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:58.732322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:58.732378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1517 reason: error at write: Disconnected sessionId: src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0
2025-10-10T14:34:58.732589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1517 sessionId: src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0 is DEAD
2025-10-10T14:34:58.732745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:58.733567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:58.733579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0] Write session will restart in 0.007364s
2025-10-10T14:34:58.733602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0] Write session: Do CDS request
2025-10-10T14:34:58.733609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:58.745767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.746280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:58.746295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1518
2025-10-10T14:34:58.746501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.746533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:58.746538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:58.746543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:58.747112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1518 sessionId:  describe result for acl check
2025-10-10T14:34:58.747145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:58.747148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:58.747152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:58.747158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601566692001199:9359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:58.747716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601566692001199:9359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:58.750754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601566692001199:9359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:58.752690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:58.755028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:58.755275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:58.755281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:58.755294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:58.755349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:58.755387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601565909777009:8884]
2025-10-10T14:34:58.756021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:58.755391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601566692001199:9359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:58.755404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601566692001199:9359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:58.755408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601566692001199:9359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:58.755418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:58.756303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:58.756349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:58.756662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:58.756713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.756715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.756716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.756717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.756719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.756720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.756721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.756723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.756724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.756725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.756727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.756728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.756729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.756736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.756750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.756754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.756759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.756763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.756767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.756771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.756776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.756780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.756785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.756789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.756793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.756798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.756805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.756814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.756821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.756827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.756834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.756840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.756844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.756849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.756855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.756860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.756865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.756870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.756876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.756881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.756886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.756891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.756896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.756902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.756906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.756912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.756917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.756923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.756929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.756934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.756939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.756945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.756989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:58.759438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:58.759756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:58.759760Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:58.759761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:58.759765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:58.759772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1517 [2:7559601565909777009:8884]
2025-10-10T14:34:58.759785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:58.759803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:58.759806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.759813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.759815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.759827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:58.759833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:58.759838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:58.759886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.759888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.759890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.759893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:58.759959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:58.759962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.759985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.759994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.760010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:58.760032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601565909777004:8884]
2025-10-10T14:34:58.760035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601565909777004:8884]
2025-10-10T14:34:58.760037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601565909777004:8884]
2025-10-10T14:34:58.760049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:58.760064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:58.760081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:58.760085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:58.760111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601565909777004:8884]
2025-10-10T14:34:58.760113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:58.760984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:58.760991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:58.760992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:58.760997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:58.761260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1517
2025-10-10T14:34:58.761299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1517
2025-10-10T14:34:58.761384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001173:2438], now have 1 active actors on pipe
2025-10-10T14:34:58.761397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001268:9359], now have 1 active actors on pipe
2025-10-10T14:34:58.761417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.761423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.761472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7927a592-a5266e62-61c322a2-54dd77bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:58.761486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.761492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.761494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:58.761508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.761524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:58.761545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.761787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.761803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.761827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.762480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1518 partition: 0 MaxSeqNo: 40 sessionId: src_id|7927a592-a5266e62-61c322a2-54dd77bb_0
2025-10-10T14:34:58.762960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c8c540-2408ffcd-f0f3bcbc-9276934a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7927a592-a5266e62-61c322a2-54dd77bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:58.765679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7927a592-a5266e62-61c322a2-54dd77bb_0] Write session: try to update token
2025-10-10T14:34:58.765696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7927a592-a5266e62-61c322a2-54dd77bb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:58.784060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId: src_id|7927a592-a5266e62-61c322a2-54dd77bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:58.782228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:58.782248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:58.782251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:58.782253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:58.782263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601565909777004:8884]
2025-10-10T14:34:58.782267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601565909777004:8884]
2025-10-10T14:34:58.782271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601565909777004:8884]
2025-10-10T14:34:58.782322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:58.782322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:58.782330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:58.782330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.782332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:58.782333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:58.782470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:58.786756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:58.833391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601566692001294:9272]
2025-10-10T14:34:58.835618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1517, pipe: [1:7559601566692001294:9272]
2025-10-10T14:34:58.897759Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:58.898270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.898286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.898333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001294:9272], now have 1 active actors on pipe
2025-10-10T14:34:58.898561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:58.898576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601566692001294:9272]
2025-10-10T14:34:58.898615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:58.898619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:58.898704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1518 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7927a592-a5266e62-61c322a2-54dd77bb_0
2025-10-10T14:34:58.898908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1518 sessionId: src_id|7927a592-a5266e62-61c322a2-54dd77bb_0 is DEAD
2025-10-10T14:34:58.899030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7927a592-a5266e62-61c322a2-54dd77bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:58.899042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7927a592-a5266e62-61c322a2-54dd77bb_0] Write session will restart in 0.006413s
2025-10-10T14:34:58.899064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7927a592-a5266e62-61c322a2-54dd77bb_0] Write session: Do CDS request
2025-10-10T14:34:58.899069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7927a592-a5266e62-61c322a2-54dd77bb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:58.907024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7927a592-a5266e62-61c322a2-54dd77bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.907269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:58.907285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1519
2025-10-10T14:34:58.907467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:58.907514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:58.907527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:58.907531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:58.908030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1519 sessionId:  describe result for acl check
2025-10-10T14:34:58.908068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:58.908074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:58.908076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:58.908083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601566692001325:9372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:58.908690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601566692001325:9372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:58.912760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601566692001325:9372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:58.912890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:58.915580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601566692001325:9372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:58.915593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601566692001325:9372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:58.915596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601566692001325:9372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:58.915606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:58.914959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:58.915148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:58.915154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:58.915166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:58.915217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:58.915255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601565909777119:8894]
2025-10-10T14:34:58.915729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:58.915972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:58.916004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:58.916218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:58.916253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.916253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.916254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.916255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.916255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.916256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.916257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.916257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.916258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.916258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.916259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.916260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.916260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.916264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.916273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.916275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.916277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.916280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.916282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.916284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.916286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.916288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.916291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.916293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.916296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.916298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.916304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.916310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:58.916315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.916318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:58.916321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.916323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:58.916326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.916329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:58.916332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.916335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:58.916337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.916340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:58.916344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.916347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:58.916349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.916352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:58.916355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.916358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:58.916361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.916363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:58.916366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.916369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.916371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.916375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.916377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.916380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.916409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:58.918666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:58.918987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:58.919007Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:58.919013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:58.919016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:58.919022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1518 [2:7559601565909777119:8894]
2025-10-10T14:34:58.919037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:58.919057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:58.919065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.919069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.919071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.919102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:58.919115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:58.919131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:58.919183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.919193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.919194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.919196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:58.919263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:58.919270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.919281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:58.919297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:58.919319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:58.919342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601565909777114:8894]
2025-10-10T14:34:58.919344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601565909777114:8894]
2025-10-10T14:34:58.919345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601565909777114:8894]
2025-10-10T14:34:58.919364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:58.919372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:58.919375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:58.919377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:58.919382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:58.919396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:58.919401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:58.919411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001310:2438], now have 1 active actors on pipe
2025-10-10T14:34:58.919417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001401:9372], now have 1 active actors on pipe
2025-10-10T14:34:58.919436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601565909777114:8894]
2025-10-10T14:34:58.919448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:58.919472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:58.919480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1518
2025-10-10T14:34:58.919487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1518
2025-10-10T14:34:58.919575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.919593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.919625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:58.919634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:58.919638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:58.919642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:58.919656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:58.919668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:58.919683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.919813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:58.919823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:58.919836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:58.919963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1519 partition: 0 MaxSeqNo: 40 sessionId: src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0
2025-10-10T14:34:58.920341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7927a592-a5266e62-61c322a2-54dd77bb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:58.923055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0] Write session: try to update token
2025-10-10T14:34:58.923069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:58.940079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId: src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:58.939212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:58.939234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:58.939238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:58.939240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:58.939255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601565909777114:8894]
2025-10-10T14:34:58.939259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601565909777114:8894]
2025-10-10T14:34:58.939263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601565909777114:8894]
2025-10-10T14:34:58.939310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:58.939318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:58.939321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:58.939357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:58.939365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:58.939370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:58.939469Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:58.942884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:58.999002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601566692001414:9272]
2025-10-10T14:34:58.999290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1518, pipe: [1:7559601566692001414:9272]
2025-10-10T14:34:59.050718Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:59.051139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.051158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.051204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601566692001414:9272], now have 1 active actors on pipe
2025-10-10T14:34:59.051412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:59.051452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:59.051457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601566692001414:9272]
2025-10-10T14:34:59.051495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:59.051588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1519 reason: status is not ok: tablet will be restarted right now sessionId: src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0
2025-10-10T14:34:59.051797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1519 sessionId: src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0 is DEAD
2025-10-10T14:34:59.051963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:59.051974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0] Write session will restart in 0.007056s
2025-10-10T14:34:59.052008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0] Write session: Do CDS request
2025-10-10T14:34:59.052014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:59.059910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.059997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:59.060013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1520
2025-10-10T14:34:59.060162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.060204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:59.060214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:59.060219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:59.060665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1520 sessionId:  describe result for acl check
2025-10-10T14:34:59.060701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:59.060708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:59.060710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:59.060717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601570986968775:9376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:59.061273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601570986968775:9376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:59.061925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:59.063737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601570986968775:9376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:59.063743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:59.063999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:59.064016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:59.064032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:59.064136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:59.064202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601570204744519:8896]
2025-10-10T14:34:59.064828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:59.065285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:59.065352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:59.065679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:59.065739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.065745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.065747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.065748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.065749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.065750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.065751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.065752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.065753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.065754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.065755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.065756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.065757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.065763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.065775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.065779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.065784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.065788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.065792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.065796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.065800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.065804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.065818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.065821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.065825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.065829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.065836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.065845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.065851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.065857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.065861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.065867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.065883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.065888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.065893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.065898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.065902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.065907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.065912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.065917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.065921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.065927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.065933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.065938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.065942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.065947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.065951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.065956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.065959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.065964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.065968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.065973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.066008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:59.066305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601570986968775:9376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:59.066321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601570986968775:9376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:59.066324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601570986968775:9376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:59.066333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:59.068441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:59.068981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:59.068997Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:59.068999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:59.069003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:59.069010Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1519 [2:7559601570204744519:8896]
2025-10-10T14:34:59.069024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:59.069043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:59.069046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.069050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.069052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.069070Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:59.069082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:59.069093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:59.069150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.069157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.069159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.069162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:59.069229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:59.069236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.069248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.069265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.069287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:59.069314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986968712:2438], now have 1 active actors on pipe
2025-10-10T14:34:59.069327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601570204744513:8896]
2025-10-10T14:34:59.069349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601570204744513:8896]
2025-10-10T14:34:59.069351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601570204744513:8896]
2025-10-10T14:34:59.069365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:59.069376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986968812:9376], now have 1 active actors on pipe
2025-10-10T14:34:59.069377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:59.069380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:59.069382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:59.069389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:59.069404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:59.069410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:59.069425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1519
2025-10-10T14:34:59.069447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601570204744513:8896]
2025-10-10T14:34:59.069460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:59.069435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1519
2025-10-10T14:34:59.069474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:59.069497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.069507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.069541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:59.069553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.069557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.069563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:59.069577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.069592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:59.069606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.069754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.069761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.069776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.069881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1520 partition: 0 MaxSeqNo: 40 sessionId: src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0
2025-10-10T14:34:59.070305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143b89cf-6215f4c0-69b95c6e-d62425f3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:59.073097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0] Write session: try to update token
2025-10-10T14:34:59.073120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:59.081958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:59.081987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.081998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601570204744513:8896]
2025-10-10T14:34:59.082040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:59.082054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:59.082257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:59.082449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.082603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.082749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.082966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:59.083017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:59.092091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId: src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:59.094797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:59.095203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.095227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.095273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:59.095374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:59.102868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:59.102888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.102896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:59.102898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:59.102910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601570204744513:8896]
2025-10-10T14:34:59.102914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601570204744513:8896]
2025-10-10T14:34:59.102918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601570204744513:8896]
2025-10-10T14:34:59.102972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:59.102975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:59.102979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:59.102983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.102985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:59.102993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:59.103165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:59.153422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601570986968820:9272]
2025-10-10T14:34:59.153743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1519, pipe: [1:7559601570986968820:9272]
2025-10-10T14:34:59.207465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:59.214737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.214769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.214949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.215018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.215097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.215164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.215210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.215222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.215292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.215351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.215407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.215474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.215523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.215530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.215600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.215658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.215723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.215791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.215839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.215845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.215914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.215979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.216050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.216118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.216160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.216167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.216232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.216292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.216360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.216426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.216475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.216483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.216554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.216624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.216687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.216747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.216789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.216792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.216859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.216913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.216975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.217039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.217080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.217082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.217142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.217191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.217246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.217310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.217430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.217438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.217508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.217576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.217640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.217700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.217744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.217746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.217812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.217864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.217918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.217971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.218007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.218008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.218077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986968820:9272], now have 1 active actors on pipe
2025-10-10T14:34:59.219096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:59.219518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:59.219574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:59.219621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1520 reason: status is not ok: tablet will be restarted right now sessionId: src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0
2025-10-10T14:34:59.219857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1520 sessionId: src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0 is DEAD
2025-10-10T14:34:59.220012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601570986968820:9272]
2025-10-10T14:34:59.221552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:59.221564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0] Write session will restart in 0.009217s
2025-10-10T14:34:59.221591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0] Write session: Do CDS request
2025-10-10T14:34:59.221597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:59.232375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.232614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:59.232630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1521
2025-10-10T14:34:59.234121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.234176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:59.234188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:59.234192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:59.234625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1521 sessionId:  describe result for acl check
2025-10-10T14:34:59.234661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:59.234669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:59.234674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:59.234681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601570986968887:9380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:59.235254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601570986968887:9380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:59.237755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:59.241289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601570986968887:9380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:59.240059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:59.240312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:59.240318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:59.240331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:59.240388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:59.240430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601570204744624:8898]
2025-10-10T14:34:59.241021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:59.241451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:59.241496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:59.241789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:59.241868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.241876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.241878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.241879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.241880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.241882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.241883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.241884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.241886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.241887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.241888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.241889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.241890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.241897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.241910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.241915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.241918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.241922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.241925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.241929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.241933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.241936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.241941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.241945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.241948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.241952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.241962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.241971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.241979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.241984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.241996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.242001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.242008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.242021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.242026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.242032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.242036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.242042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.242050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.242056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.242067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.242072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.242078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.242088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.242093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.242100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.242112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.242119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.242138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.242152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.242166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.242176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.242220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:59.245461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:59.245785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:59.245788Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:59.245790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:59.245793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:59.245798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1520 [2:7559601570204744624:8898]
2025-10-10T14:34:59.245808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:59.245822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:59.245824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.245829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.245830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.245845Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:59.245851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:59.245856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:59.245898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.245899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.245900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.245902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:59.245956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:59.245958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.245964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.245971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.245981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:59.245998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601570204744619:8898]
2025-10-10T14:34:59.245999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601570204744619:8898]
2025-10-10T14:34:59.246001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601570204744619:8898]
2025-10-10T14:34:59.246010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:59.246021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:59.246031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:59.246034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:59.246054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601570204744619:8898]
2025-10-10T14:34:59.246055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:59.246212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:59.246223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:59.246225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:59.246229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:59.246727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1520
2025-10-10T14:34:59.246785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986968821:2438], now have 1 active actors on pipe
2025-10-10T14:34:59.248640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986968926:9380], now have 1 active actors on pipe
2025-10-10T14:34:59.248807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.248814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.248847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:59.248858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.248874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.248877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:59.248893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.248909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:59.248928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.249205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.249210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.249237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.247903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601570986968887:9380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:59.247925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601570986968887:9380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:59.247930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601570986968887:9380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:59.247939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:59.248578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1520
2025-10-10T14:34:59.249365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1521 partition: 0 MaxSeqNo: 40 sessionId: src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0
2025-10-10T14:34:59.253614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|406f1ed8-da243299-9108ddf5-7ec180ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:59.256443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0] Write session: try to update token
2025-10-10T14:34:59.256467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:59.258720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:59.258745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.258757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601570204744619:8898]
2025-10-10T14:34:59.258807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:59.258811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:59.258999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:59.259176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.259332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.259483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.259682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:59.259729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:59.275145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId: src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:59.277829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:59.279786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.279813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.279838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:59.279841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.279844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:59.279847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:59.279859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601570204744619:8898]
2025-10-10T14:34:59.279864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601570204744619:8898]
2025-10-10T14:34:59.279870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601570204744619:8898]
2025-10-10T14:34:59.279923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:59.279930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:59.279935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:59.279938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:59.279946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.279949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:59.280081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:59.318963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601570986968931:9272]
2025-10-10T14:34:59.319253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1520, pipe: [1:7559601570986968931:9272]
2025-10-10T14:34:59.408537Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:59.408963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:59.409011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986968931:9272], now have 1 active actors on pipe
2025-10-10T14:34:59.409722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:59.409733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0] Write session will restart in 0.007467s
2025-10-10T14:34:59.409758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0] Write session: Do CDS request
2025-10-10T14:34:59.409765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:59.409140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:59.409170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601570986968931:9272]
2025-10-10T14:34:59.409190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:59.409258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:59.409260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:59.409371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1521 reason: error at write: Disconnected sessionId: src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0
2025-10-10T14:34:59.409555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1521 sessionId: src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0 is DEAD
2025-10-10T14:34:59.418951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.419052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:59.419067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1522
2025-10-10T14:34:59.419206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.419253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:59.419258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:59.419263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:59.419713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1522 sessionId:  describe result for acl check
2025-10-10T14:34:59.419743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:59.419745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:59.419747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:59.419756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601570986968948:9384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:59.420316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601570986968948:9384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:59.423402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601570986968948:9384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:59.424152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:59.426347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:59.426620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601570986968948:9384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:59.426636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601570986968948:9384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:59.426640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601570986968948:9384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:59.426650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:59.426569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:59.426584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:59.426598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:59.426655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:59.426696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601570204744730:8900]
2025-10-10T14:34:59.427310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:59.427655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:59.427720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:59.428092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:59.428163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.428169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.428170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.428172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.428173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.428174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.428175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.428177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.428178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.428179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.428180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.428182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.428183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.428190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.428203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.428207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.428211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.428215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.428219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.428223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.428227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.428231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.428235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.428239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.428242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.428246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.428254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.428263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.428270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.428276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.428281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.428287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.428291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.428298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.428309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.428316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.428326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.428331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.428341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.428347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.428356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.428362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.428367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.428373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.428383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.428388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.428398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.428403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.428412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.428418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.428422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.428431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.428474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:59.430952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:59.431454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:59.431470Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:59.431473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:59.431477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:59.431483Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1521 [2:7559601570204744730:8900]
2025-10-10T14:34:59.431497Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:59.431516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:59.431519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.431523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.431526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.431547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:59.431555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:59.431563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:59.431625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.431627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.431629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.431632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:59.431722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:59.431726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.431738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.431752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.431770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:59.431792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601570204744725:8900]
2025-10-10T14:34:59.431794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601570204744725:8900]
2025-10-10T14:34:59.431796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601570204744725:8900]
2025-10-10T14:34:59.431811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:59.431827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:59.431844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:59.431848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:59.431869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:59.431874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:59.431876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:59.431879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601570204744725:8900]
2025-10-10T14:34:59.431882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:59.431885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:59.432043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986968933:2438], now have 1 active actors on pipe
2025-10-10T14:34:59.432054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969031:9384], now have 1 active actors on pipe
2025-10-10T14:34:59.432084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1521
2025-10-10T14:34:59.432106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1521
2025-10-10T14:34:59.432133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.432143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.432184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a52ca588-7f8a073d-697d3d5-501827a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:59.432198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.432208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.432211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:59.432225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.432251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:59.432273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.432447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.432456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.432473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.432566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1522 partition: 0 MaxSeqNo: 40 sessionId: src_id|a52ca588-7f8a073d-697d3d5-501827a2_0
2025-10-10T14:34:59.432948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17289a58-c78334b2-51d9e11c-17e7cd37_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a52ca588-7f8a073d-697d3d5-501827a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:59.435554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ca588-7f8a073d-697d3d5-501827a2_0] Write session: try to update token
2025-10-10T14:34:59.435573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ca588-7f8a073d-697d3d5-501827a2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:59.444264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:59.444285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.444296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601570204744725:8900]
2025-10-10T14:34:59.444347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:59.444350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:59.444528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:59.444668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.444822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.444969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.445168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:59.445209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:59.450229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId: src_id|a52ca588-7f8a073d-697d3d5-501827a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:59.452957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:59.453171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.453209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.453260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:59.453383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:59.462065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:59.462087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.462091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:59.462093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:59.462104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601570204744725:8900]
2025-10-10T14:34:59.462109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601570204744725:8900]
2025-10-10T14:34:59.462116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601570204744725:8900]
2025-10-10T14:34:59.462162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:59.462165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:59.462174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.462177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:59.462177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:59.462181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:59.462309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:59.509432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601570986969043:9272]
2025-10-10T14:34:59.509712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1521, pipe: [1:7559601570986969043:9272]
2025-10-10T14:34:59.575039Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:59.583052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.583099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.583288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.583367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.583449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.583520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.583561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.583566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.583646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.583713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.583780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.583847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.584065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.584069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.584139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.584205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.584280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.584350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.584394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.584398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.584483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.584563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.584675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.584797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.584842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.584846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.584932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.585007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.585122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.585247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.585292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.585295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.585630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.585719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.585789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.585848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.585888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.585891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.586000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.586133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.586266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.586405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.586473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.586478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.586613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.586738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.586861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.587000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.587084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.587090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.587226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.587354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.587471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.587607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.587678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.587683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.587819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.587947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.588075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.588214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.588286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.588291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.588401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969043:9272], now have 1 active actors on pipe
2025-10-10T14:34:59.588993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:59.589408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:59.589475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:59.589520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1522 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a52ca588-7f8a073d-697d3d5-501827a2_0
2025-10-10T14:34:59.589729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1522 sessionId: src_id|a52ca588-7f8a073d-697d3d5-501827a2_0 is DEAD
2025-10-10T14:34:59.589872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601570986969043:9272]
2025-10-10T14:34:59.593550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ca588-7f8a073d-697d3d5-501827a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:34:59.593562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ca588-7f8a073d-697d3d5-501827a2_0] Write session will restart in 0.009185s
2025-10-10T14:34:59.593591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ca588-7f8a073d-697d3d5-501827a2_0] Write session: Do CDS request
2025-10-10T14:34:59.593599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ca588-7f8a073d-697d3d5-501827a2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:59.604887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ca588-7f8a073d-697d3d5-501827a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.607662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:59.607677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1523
2025-10-10T14:34:59.607903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.607953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:59.607964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:59.607970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:59.609103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1523 sessionId:  describe result for acl check
2025-10-10T14:34:59.609142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:59.609149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:59.609151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:59.609158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601570986969064:9388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:59.609750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601570986969064:9388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:59.616500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:59.618163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:59.618384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:59.618390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:59.618402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:59.618451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:59.618491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601570204744837:8902]
2025-10-10T14:34:59.619178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:59.619005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601570986969064:9388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:59.619599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:59.619659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:59.620027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:59.620089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.620096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.620098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.620099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.620100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.620102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.620103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.620104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.620106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.620107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.620109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.620110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.620111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.620118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.620133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.620138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.620143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.620147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.620152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.620157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.620161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.620166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.620171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.620174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.620179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.620183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.620192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.620213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.620225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.620231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.620236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.620248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.620257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.620263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.620268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.620279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.620282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.620287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.620300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.620310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.620322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.620330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.620335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.620341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.620350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.620357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.620366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.620372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.620381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.620386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.620392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.620398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.620452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:59.623531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601570986969064:9388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:59.623544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601570986969064:9388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:59.623547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601570986969064:9388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:59.623555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:59.624396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:59.624833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:59.624839Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:59.624841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:59.624845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:59.624850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1522 [2:7559601570204744837:8902]
2025-10-10T14:34:59.624860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:59.624873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:59.624875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.624878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.624880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.624897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:59.624905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:59.624912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:59.624972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.624982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.624984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.624987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:59.625046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:59.625052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.625062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.625072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.625092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:59.625114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601570204744832:8902]
2025-10-10T14:34:59.625116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601570204744832:8902]
2025-10-10T14:34:59.625118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601570204744832:8902]
2025-10-10T14:34:59.625127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:59.625138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:59.625148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:59.625150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:59.625164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:59.625167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:59.625170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:59.625176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601570204744832:8902]
2025-10-10T14:34:59.625177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:59.625183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:59.625192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969147:9388], now have 1 active actors on pipe
2025-10-10T14:34:59.625199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969045:2438], now have 1 active actors on pipe
2025-10-10T14:34:59.625622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1522
2025-10-10T14:34:59.625648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1522
2025-10-10T14:34:59.625722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.625740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.625774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:59.625790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.625796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.625803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:59.625815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.625829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:59.626311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1523 partition: 0 MaxSeqNo: 40 sessionId: src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0
2025-10-10T14:34:59.626687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52ca588-7f8a073d-697d3d5-501827a2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:59.625848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.626092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.626096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.626127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.629551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0] Write session: try to update token
2025-10-10T14:34:59.629570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:59.648983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:59.649002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.649005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:59.649008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:59.649018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601570204744832:8902]
2025-10-10T14:34:59.649023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601570204744832:8902]
2025-10-10T14:34:59.649027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601570204744832:8902]
2025-10-10T14:34:59.649079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:59.649086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.649089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:59.649137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:59.649148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:59.649153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:59.649253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:59.650794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId: src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:59.653311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:59.689181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601570986969175:9272]
2025-10-10T14:34:59.689671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1522, pipe: [1:7559601570986969175:9272]
2025-10-10T14:34:59.762997Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:59.763317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.763339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.763386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969175:9272], now have 1 active actors on pipe
2025-10-10T14:34:59.763599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:59.763605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601570986969175:9272]
2025-10-10T14:34:59.763640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:59.763643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:59.763712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1523 reason: error at write: Disconnected sessionId: src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0
2025-10-10T14:34:59.763916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1523 sessionId: src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0 is DEAD
2025-10-10T14:34:59.763990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:59.765437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:59.765447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0] Write session will restart in 0.008594s
2025-10-10T14:34:59.765473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0] Write session: Do CDS request
2025-10-10T14:34:59.765483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:59.774951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.775040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:59.775057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1524
2025-10-10T14:34:59.775226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.775260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:59.775265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:59.775269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:59.775771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1524 sessionId:  describe result for acl check
2025-10-10T14:34:59.775811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:59.775813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:59.775818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:59.775825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601570986969249:9394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:59.776148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:59.776367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601570986969249:9394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:59.778345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:59.778583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:59.778588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:59.778602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:59.778667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:59.778720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601570204744972:8912]
2025-10-10T14:34:59.779330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:59.779648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:59.779700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:59.780048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:59.780129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.780137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.780102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601570986969249:9394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:59.780138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.780139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.780140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.780141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.780142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.780143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.780144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.780145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.780147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.780147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.780148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.780155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.780166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.780169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.780173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.780176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.780180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.780184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.780187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.780190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.780194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.780198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.780201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.780204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.780211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.780220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.780226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.780231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.780235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.780240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.780244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.780249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.780254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.780258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.780262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.780266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.780271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.780276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.780280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.780285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.780289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.780294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.780300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.780304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.780309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.780313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.780318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.780323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.780327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.780332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.780369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:59.783921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601570986969249:9394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:59.783938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601570986969249:9394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:59.783943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601570986969249:9394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:59.783953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:59.784129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:59.784880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1523
2025-10-10T14:34:59.784919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1523
2025-10-10T14:34:59.784470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:59.784483Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:59.784486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:59.784490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:59.784496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1523 [2:7559601570204744972:8912]
2025-10-10T14:34:59.784511Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:59.784528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:59.784532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.784535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.784538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.784555Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:59.784563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:59.784571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:59.784623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.784625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.784628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.784630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:59.784705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:59.784708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.784721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.784734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.784754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:59.784776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969179:2438], now have 1 active actors on pipe
2025-10-10T14:34:59.784780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969282:9394], now have 1 active actors on pipe
2025-10-10T14:34:59.784788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601570204744967:8912]
2025-10-10T14:34:59.784791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601570204744967:8912]
2025-10-10T14:34:59.784794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601570204744967:8912]
2025-10-10T14:34:59.784810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:59.784836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:59.784855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:59.784859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:59.784888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601570204744967:8912]
2025-10-10T14:34:59.784891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:59.784967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:59.784970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:59.784972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:59.784978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:59.785105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.785112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.785147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|920ca70-8fac3467-8ed0f495-2398410e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:59.785157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.785162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.785164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:59.785176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.785188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:59.785204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.785422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.785435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.785454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.785565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1524 partition: 0 MaxSeqNo: 40 sessionId: src_id|920ca70-8fac3467-8ed0f495-2398410e_0
2025-10-10T14:34:59.785989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|258ad867-22af32b5-9fa21483-8ee9c86b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|920ca70-8fac3467-8ed0f495-2398410e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:59.788657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|920ca70-8fac3467-8ed0f495-2398410e_0] Write session: try to update token
2025-10-10T14:34:59.788676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|920ca70-8fac3467-8ed0f495-2398410e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:59.796810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:59.796834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.796845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601570204744967:8912]
2025-10-10T14:34:59.796891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:59.796895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:59.797100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:59.797275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.797455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.797607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.797826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:59.797875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:59.804451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId: src_id|920ca70-8fac3467-8ed0f495-2398410e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:59.807015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:59.807270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.807293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.807334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:59.807456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:59.814405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:59.814426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.814430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:59.814432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:59.814443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601570204744967:8912]
2025-10-10T14:34:59.814447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601570204744967:8912]
2025-10-10T14:34:59.814451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601570204744967:8912]
2025-10-10T14:34:59.814500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:59.814501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:59.814509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.814511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:59.814513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:59.814515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:59.814657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:34:59.863965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601570986969291:9272]
2025-10-10T14:34:59.864258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1523, pipe: [1:7559601570986969291:9272]
2025-10-10T14:34:59.927517Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:34:59.935250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.935277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.935444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.935510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.935580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.935652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.935701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.935711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.935777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.935844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.935907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.935975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.936020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.936028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.936096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.936155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.936217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.936285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.936322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.936327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.936392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.936452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.936513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.936567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.936602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.936604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.936663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.936721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.936786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.936837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.936874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.936876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.936937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.936987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.937050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.937109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.937146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.937147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.937206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.937258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.937319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.937497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.937547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.937549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.937614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.937676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.938653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:34:59.938704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:34:59.938711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:34:59.938715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601570986969291:9272]
2025-10-10T14:34:59.938753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1524 reason: error at write: Disconnected sessionId: src_id|920ca70-8fac3467-8ed0f495-2398410e_0
2025-10-10T14:34:59.938988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1524 sessionId: src_id|920ca70-8fac3467-8ed0f495-2398410e_0 is DEAD
2025-10-10T14:34:59.939108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920ca70-8fac3467-8ed0f495-2398410e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:34:59.939119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920ca70-8fac3467-8ed0f495-2398410e_0] Write session will restart in 0.008759s
2025-10-10T14:34:59.939145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920ca70-8fac3467-8ed0f495-2398410e_0] Write session: Do CDS request
2025-10-10T14:34:59.939151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920ca70-8fac3467-8ed0f495-2398410e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:34:59.937740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.937805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.937844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.937847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.937909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.937956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.938005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.938066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.938106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.938108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.938170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:34:59.938220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:34:59.938270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:34:59.938319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:34:59.938358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:34:59.938361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:34:59.938423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969291:9272], now have 1 active actors on pipe
2025-10-10T14:34:59.939424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:34:59.948890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|920ca70-8fac3467-8ed0f495-2398410e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.949010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:34:59.949027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1525
2025-10-10T14:34:59.949514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:34:59.949568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:34:59.949579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:34:59.949583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:34:59.950078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1525 sessionId:  describe result for acl check
2025-10-10T14:34:59.950117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:34:59.950123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:34:59.950125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:34:59.950131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601570986969387:9407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:34:59.950705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601570986969387:9407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:34:59.953839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601570986969387:9407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:34:59.955447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:34:59.956131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:34:59.956384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:34:59.956395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:34:59.956406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:34:59.956463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:34:59.956509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601570204745106:8921]
2025-10-10T14:34:59.956614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601570986969387:9407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:34:59.956629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601570986969387:9407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:34:59.956633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601570986969387:9407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:34:59.956643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:34:59.957144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:34:59.957444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:34:59.957494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:34:59.957841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:34:59.957902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.957909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.957911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.957912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.957914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.957915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.957917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.957918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.957920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.957921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.957922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.957924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.957925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.957931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.957946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.957950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.957955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.957960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.957965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.957968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.957973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.957977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.957982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.957986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.957991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.957995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.958003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.958013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:34:59.958020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.958027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:34:59.958032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.958038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:34:59.958048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.958054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:34:59.958060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.958065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:34:59.958075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.958081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:34:59.958086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.958096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:34:59.958102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.958112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:34:59.958116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.958127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:34:59.958131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.958137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:34:59.958142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.958148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.958157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.958163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.958168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.958174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.958221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:34:59.960630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:34:59.960946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:34:59.960958Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:34:59.960960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:34:59.960964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:34:59.960970Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1524 [2:7559601570204745106:8921]
2025-10-10T14:34:59.960983Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:34:59.961000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:34:59.961008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.961012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.961014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.961032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:34:59.961044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:34:59.961053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:34:59.961109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.961116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.961119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.961121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:34:59.961185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:34:59.961193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.961215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:34:59.961230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:34:59.961252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:34:59.961279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969319:2438], now have 1 active actors on pipe
2025-10-10T14:34:59.961287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601570986969417:9407], now have 1 active actors on pipe
2025-10-10T14:34:59.961295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601570204745101:8921]
2025-10-10T14:34:59.961300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601570204745101:8921]
2025-10-10T14:34:59.961302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601570204745101:8921]
2025-10-10T14:34:59.961318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:34:59.961351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:34:59.961354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:34:59.961355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:34:59.961356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:34:59.961371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:34:59.961375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:34:59.961400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601570204745101:8921]
2025-10-10T14:34:59.961413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:34:59.961424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:34:59.961510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1524
2025-10-10T14:34:59.961561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1524
2025-10-10T14:34:59.961733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.961763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.961805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:34:59.961819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:34:59.961827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:34:59.961830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:34:59.961842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:34:59.961859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:34:59.961879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.962087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.962097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.962115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:34:59.962221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1525 partition: 0 MaxSeqNo: 40 sessionId: src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0
2025-10-10T14:34:59.962625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|920ca70-8fac3467-8ed0f495-2398410e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:34:59.965470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0] Write session: try to update token
2025-10-10T14:34:59.965488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:34:59.974130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:34:59.974152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.974164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601570204745101:8921]
2025-10-10T14:34:59.974216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:34:59.974222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:34:59.974400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:34:59.974548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.974694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.974838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:34:59.975036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:34:59.975095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:34:59.981413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId: src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:34:59.984023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:34:59.984343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:34:59.984367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:34:59.984410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:34:59.984513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:34:59.993520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:34:59.993540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:34:59.993543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:34:59.993545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:34:59.993557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601570204745101:8921]
2025-10-10T14:34:59.993562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601570204745101:8921]
2025-10-10T14:34:59.993565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601570204745101:8921]
2025-10-10T14:34:59.993616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:34:59.993624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:34:59.993626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:34:59.993633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:34:59.993636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:34:59.993637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:34:59.993769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:00.038832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601575281936725:9272]
2025-10-10T14:35:00.039450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1524, pipe: [1:7559601575281936725:9272]
2025-10-10T14:35:00.112280Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:00.120392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.120422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.120607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.120673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.120738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.120813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.120864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.120876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.120945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.121009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.121076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.121145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.121190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.121198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.121267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.121353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.123886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:00.123914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601575281936725:9272]
2025-10-10T14:35:00.123945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:00.123947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:00.123989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1525 reason: error at write: Disconnected sessionId: src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0
2025-10-10T14:35:00.124227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1525 sessionId: src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0 is DEAD
2025-10-10T14:35:00.121420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.121487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.121527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.121530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.121596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.121658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.121720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.121782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.121821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.121824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.121895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.121956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.122016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.122078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.122128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.122131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.122204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.122263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.122325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.122387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.122426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.122430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.122498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.122555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.122618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.122684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.122729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.122732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.122801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.122859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.122916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.122974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.123017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.123020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.123105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.123164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.123222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.123284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.123325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.123327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.123397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.123456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.123516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.123577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.123618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.123621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.123694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281936725:9272], now have 1 active actors on pipe
2025-10-10T14:35:00.124978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:00.126635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:00.126647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0] Write session will restart in 0.007102s
2025-10-10T14:35:00.126671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0] Write session: Do CDS request
2025-10-10T14:35:00.126678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:00.132049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:35:00.132083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-10T14:35:00.135071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.135143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:00.135163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1526
2025-10-10T14:35:00.137667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.137726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:00.137733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:00.137748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:00.138380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1526 sessionId:  describe result for acl check
2025-10-10T14:35:00.138417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:00.138419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:00.138421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:00.138428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601575281936801:9411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:00.139029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601575281936801:9411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:00.140003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:00.142095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601575281936801:9411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:00.143213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:00.143472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:00.143478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:00.143492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:00.143550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:00.143588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601574499712512:8923]
2025-10-10T14:35:00.144242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:00.144548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601575281936801:9411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:00.144563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601575281936801:9411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:00.144567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601575281936801:9411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:00.144577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:00.144728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:00.144815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:00.145232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:00.145348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.145352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.145353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.145354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.145356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.145357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.145359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.145360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.145362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.145363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.145365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.145366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.145367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.145376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.145391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.145395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.145399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.145404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.145408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.145412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.145416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.145420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.145425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.145429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.145434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.145438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.145449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.145459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.145467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.145473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.145478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.145484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.145488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.145494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.145500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.145506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.145511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.145517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.145523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.145528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.149306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1525
2025-10-10T14:35:00.149397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1525
2025-10-10T14:35:00.145534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.145539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.145544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.145550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.145555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.145561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.145567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.145573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.145578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.145583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.145588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.145594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.145634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:00.148424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:00.148782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:00.148787Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:00.148790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:00.148797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:00.148803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1525 [2:7559601574499712512:8923]
2025-10-10T14:35:00.148817Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:00.148835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:00.148838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.148842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.148844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.148860Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:00.148868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:00.148875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:00.148937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.148939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.148940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.148942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:00.149042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:00.149044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.149052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.149058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.149070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:00.149091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281936730:2438], now have 1 active actors on pipe
2025-10-10T14:35:00.149094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281936834:9411], now have 1 active actors on pipe
2025-10-10T14:35:00.149102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601574499712506:8923]
2025-10-10T14:35:00.149104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601574499712506:8923]
2025-10-10T14:35:00.149106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601574499712506:8923]
2025-10-10T14:35:00.149115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:00.149126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:00.149132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:00.149135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:00.149136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:00.149138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:00.149140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:00.149170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601574499712506:8923]
2025-10-10T14:35:00.149178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:00.149575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:00.149634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.149640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.149715Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:35:00.149750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:00.149765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.149770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.149777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:00.149789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.149800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:00.149815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.153803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.153823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.153855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.153674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 9 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:35:00.153751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:35:00.154178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1526 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0
2025-10-10T14:35:00.154604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c712ddc9-eb3381aa-805d1e88-690d14e9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:00.157302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0] Write session: try to update token
2025-10-10T14:35:00.157321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:00.171632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:00.171657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:00.171661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:00.171664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:00.171676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601574499712506:8923]
2025-10-10T14:35:00.171680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601574499712506:8923]
2025-10-10T14:35:00.171684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601574499712506:8923]
2025-10-10T14:35:00.171742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:00.171754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.171757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:00.171908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:00.173483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:00.173501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:00.173506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:00.172455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId: src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:00.175301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:00.224470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601575281936846:9272]
2025-10-10T14:35:00.224793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1525, pipe: [1:7559601575281936846:9272]
2025-10-10T14:35:00.289227Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:00.289671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.289689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.289736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281936846:9272], now have 1 active actors on pipe
2025-10-10T14:35:00.289977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:00.290036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:00.290043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601575281936846:9272]
2025-10-10T14:35:00.290068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-10T14:35:00.290071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:00.290151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1526 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0
2025-10-10T14:35:00.290359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1526 sessionId: src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0 is DEAD
2025-10-10T14:35:00.290486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:00.290498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0] Write session will restart in 0.007715s
2025-10-10T14:35:00.290522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0] Write session: Do CDS request
2025-10-10T14:35:00.290527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:00.299917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.300050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:00.300065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1527
2025-10-10T14:35:00.300239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.300278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:00.300298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:00.300307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:00.300746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1527 sessionId:  describe result for acl check
2025-10-10T14:35:00.300781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:00.300784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:00.300786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:00.300793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601575281936867:9415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:00.301349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601575281936867:9415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:00.303984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601575281936867:9415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:00.305041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:00.307374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:00.307648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:00.307659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:00.307671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:00.307746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:00.307791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601574499712624:8926]
2025-10-10T14:35:00.308412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:00.307671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601575281936867:9415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:00.307686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601575281936867:9415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:00.307691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601575281936867:9415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:00.307701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:00.308746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:00.308818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:00.309141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:00.309205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.309214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.309215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.309216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.309217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.309219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.309220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.309221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.309223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.309224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.309225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.309226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.309228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.309234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.309258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.309263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.309267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.309271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.309275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.309279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.309284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.309288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.309294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.309298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.309302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.309307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.309315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.309323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.309353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.309363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.309368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.309377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.309383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.309392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.309397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.309403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.309411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.309417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.309426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.309433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.309440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.309454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.309463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.309470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.309478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.309485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.309493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.309498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.309506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.309511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.309516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.309525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.309575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:00.316062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:00.316744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:00.316759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:00.316763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:00.316768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:00.316775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1526 [2:7559601574499712624:8926]
2025-10-10T14:35:00.316791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:00.316812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:00.316821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.316830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.316833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.316854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:00.316863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:00.316872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:00.316947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.316958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.316960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.316963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:00.317036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:00.317046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.317061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.317077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.317101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:00.317129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601574499712619:8926]
2025-10-10T14:35:00.317143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601574499712619:8926]
2025-10-10T14:35:00.317146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601574499712619:8926]
2025-10-10T14:35:00.317155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:00.317175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:00.317197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:00.317201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:00.317217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:00.317227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:00.317229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:00.317246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601574499712619:8926]
2025-10-10T14:35:00.317257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:00.317257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:00.317268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281936850:2438], now have 1 active actors on pipe
2025-10-10T14:35:00.317276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281936954:9415], now have 1 active actors on pipe
2025-10-10T14:35:00.317733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1526
2025-10-10T14:35:00.317779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1526
2025-10-10T14:35:00.317924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.317938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.318004Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:35:00.318053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:00.318067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.318077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.318080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:00.318093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.318111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:00.318136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.318285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 10 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:35:00.318325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:35:00.318768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.318780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.318803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.319009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1527 partition: 0 MaxSeqNo: 40 sessionId: src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0
2025-10-10T14:35:00.319538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2d2b4e-65e7ff5d-c136d022-90b5298_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:00.322715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0] Write session: try to update token
2025-10-10T14:35:00.322737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:00.336810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:00.336830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:00.336842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601574499712619:8926]
2025-10-10T14:35:00.336897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:00.337098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:00.337257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:00.337380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:00.337498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:00.337652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:00.337871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:00.337937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:00.345297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId: src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:00.348174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:00.348400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.348425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.348470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:00.348573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:00.350422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:00.350443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:00.350451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:00.350453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:00.350463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601574499712619:8926]
2025-10-10T14:35:00.350466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601574499712619:8926]
2025-10-10T14:35:00.350472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601574499712619:8926]
2025-10-10T14:35:00.350522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:00.350524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:00.350529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:00.350532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.350534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:00.350534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:00.350667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:00.390112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601575281936968:9272]
2025-10-10T14:35:00.390442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1526, pipe: [1:7559601575281936968:9272]
2025-10-10T14:35:00.466750Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:00.474856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.474892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.475084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.475159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.475221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.475294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.475339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.475344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.475423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.475482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.475544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.475614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.475657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.475661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.475733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.475798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.475856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.475917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.475960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.475966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.476039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.476096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.476160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.476260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.476298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.476302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.476366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.476417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.476471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.476538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.476579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.476581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.476645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.476707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.476770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.476842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.476885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.476888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.476946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.477006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.477071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.477134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.477176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.477179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.477252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.477312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.477393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.477459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.477500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.477504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.477576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.477652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.477726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.477793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.477844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.477853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.477923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:00.477993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:00.478063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:00.478131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:00.478182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:00.478190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:00.478263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281936968:9272], now have 1 active actors on pipe
2025-10-10T14:35:00.479586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:00.480065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:00.480077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0] Write session will restart in 0.005348s
2025-10-10T14:35:00.480103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0] Write session: Do CDS request
2025-10-10T14:35:00.480110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:00.479513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:00.479532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601575281936968:9272]
2025-10-10T14:35:00.479565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:00.479568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:00.479610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1527 reason: error at write: Disconnected sessionId: src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0
2025-10-10T14:35:00.479811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1527 sessionId: src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0 is DEAD
2025-10-10T14:35:00.486978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.487068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:00.487089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1528
2025-10-10T14:35:00.487291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.487338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:00.487349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:00.487357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:00.487766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1528 sessionId:  describe result for acl check
2025-10-10T14:35:00.487809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:00.487811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:00.487815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:00.487822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601575281936989:9419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:00.488409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601575281936989:9419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:00.492082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601575281936989:9419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:00.492933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:00.494731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:00.494991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:00.495000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:00.495013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:00.495082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:00.495128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601574499712738:8929]
2025-10-10T14:35:00.495198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601575281936989:9419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:00.495221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601575281936989:9419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:00.495225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601575281936989:9419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:00.495234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:00.495784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:00.496063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:00.496103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:00.496440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:00.496498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.496504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.496506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.496507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.496508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.496509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.496510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.496512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.496513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.496514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.496515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.496516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.496517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.496524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.496537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.496541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.496545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.496549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.496553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.496556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.496560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.496563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.496567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.496571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.496574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.496577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.496585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.496593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.496599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.496604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.496609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.496616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.496620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.496625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.496629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.496634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.496638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.496644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.496648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.496652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.496657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.496661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.496665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.496670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.496674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.496680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.496684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.496689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.496692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.496697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.496701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.496707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.496753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:00.499279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:00.499616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:00.499634Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:00.499637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:00.499640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:00.499649Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1527 [2:7559601574499712738:8929]
2025-10-10T14:35:00.499663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:00.499691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:00.499698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.499703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.499706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.499725Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:00.499738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:00.499746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:00.499808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.499820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.499821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.499824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:00.500011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1527
2025-10-10T14:35:00.500012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1527
2025-10-10T14:35:00.499893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:00.499902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.499915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.499927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.499944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:00.499966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281936974:2438], now have 1 active actors on pipe
2025-10-10T14:35:00.499970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937077:9419], now have 1 active actors on pipe
2025-10-10T14:35:00.499978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601574499712733:8929]
2025-10-10T14:35:00.499980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601574499712733:8929]
2025-10-10T14:35:00.499982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601574499712733:8929]
2025-10-10T14:35:00.499997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:00.500009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:00.500011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:00.500016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:00.500019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:00.500029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:00.500035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:00.500072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.500077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.500097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601574499712733:8929]
2025-10-10T14:35:00.500107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:00.500112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:00.500135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:00.500144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.500149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.500151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:00.500163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.500175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:00.500200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.500373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.500388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.500411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.500506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1528 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0
2025-10-10T14:35:00.500955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c33e54fc-654a2d0c-8e676b01-f6e6309d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:00.503686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0] Write session: try to update token
2025-10-10T14:35:00.503704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:00.518869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId: src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:00.520834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:00.520855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:00.520859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:00.520861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:00.520871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601574499712733:8929]
2025-10-10T14:35:00.520876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601574499712733:8929]
2025-10-10T14:35:00.520880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601574499712733:8929]
2025-10-10T14:35:00.520934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:00.520943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:00.520945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.520948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:00.520960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:00.520965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:00.521099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:00.521613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:00.579554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601575281937089:9272]
2025-10-10T14:35:00.579956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1527, pipe: [1:7559601575281937089:9272]
2025-10-10T14:35:00.639020Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:00.639440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.639460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.639503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937089:9272], now have 1 active actors on pipe
2025-10-10T14:35:00.640136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:00.640180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:00.640258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1528 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0
2025-10-10T14:35:00.640444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1528 sessionId: src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0 is DEAD
2025-10-10T14:35:00.640624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601575281937089:9272]
2025-10-10T14:35:00.639742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:00.641522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:00.641532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0] Write session will restart in 0.009099s
2025-10-10T14:35:00.641558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0] Write session: Do CDS request
2025-10-10T14:35:00.641565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:00.652018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.654200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:00.656814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:00.657080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:00.657093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:00.657106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:00.657170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:00.657222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601574499712862:8932]
2025-10-10T14:35:00.657869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:00.658288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:00.658338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:00.658658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:00.658715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.658716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.658717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.658718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.658719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.658720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.658722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.658723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.658724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.658725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.658726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.658727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.658728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.658734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.658746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.658750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.658753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.658757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.658760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.658764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.658767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.658771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.658778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.658782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.658786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.658789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.658798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.658806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.658814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.658818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.658823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.658828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.658833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.658837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.658843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.658847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.658852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.658857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.658862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.658866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.658870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.658876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.658880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.658899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.658903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.658909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.658913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.658918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.658922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.658926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.658930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.658936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.658976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:00.657713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:00.657728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1529
2025-10-10T14:35:00.661915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:00.662265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:00.662277Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:00.662279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:00.662284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:00.662291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1528 [2:7559601574499712862:8932]
2025-10-10T14:35:00.662305Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:00.662330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:00.662338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.662341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.662344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.662363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:00.662376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:00.662389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:00.662464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.662472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.662474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.662477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:00.662544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:00.662553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.662565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.662576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.662592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:00.662615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937106:2438], now have 1 active actors on pipe
2025-10-10T14:35:00.662623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601574499712856:8932]
2025-10-10T14:35:00.662625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601574499712856:8932]
2025-10-10T14:35:00.662627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601574499712856:8932]
2025-10-10T14:35:00.662644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:00.662659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:00.662676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:00.662679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:00.662709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601574499712856:8932]
2025-10-10T14:35:00.662716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:00.662717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:00.662719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:00.662721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:00.662727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:00.663017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.663092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:00.663098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:00.663103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:00.663157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1528
2025-10-10T14:35:00.663637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1529 sessionId:  describe result for acl check
2025-10-10T14:35:00.663665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:00.663667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:00.663669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:00.663674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601575281937191:9425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:00.664237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601575281937191:9425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:00.670977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601575281937191:9425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:00.680346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601575281937191:9425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:00.680363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601575281937191:9425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:00.680367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601575281937191:9425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:00.680377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:00.681179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1528
2025-10-10T14:35:00.685485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937221:9425], now have 1 active actors on pipe
2025-10-10T14:35:00.685541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.685550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.685595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bebae681-915a9665-406377a4-c56be88f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:00.685616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.685628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.685631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:00.685649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.685677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:00.685707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.690069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.690098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.690144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.690287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1529 partition: 0 MaxSeqNo: 40 sessionId: src_id|bebae681-915a9665-406377a4-c56be88f_0
2025-10-10T14:35:00.690750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f458f53-44435eb3-9f769032-f8ca06b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bebae681-915a9665-406377a4-c56be88f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:00.693600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:00.693626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:00.693630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:00.693632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:00.693643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601574499712856:8932]
2025-10-10T14:35:00.693648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601574499712856:8932]
2025-10-10T14:35:00.693652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601574499712856:8932]
2025-10-10T14:35:00.693709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:00.693718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.693723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:00.693725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:00.693730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:00.693734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:00.694070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bebae681-915a9665-406377a4-c56be88f_0] Write session: try to update token
2025-10-10T14:35:00.694097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bebae681-915a9665-406377a4-c56be88f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:00.693884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:00.712970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId: src_id|bebae681-915a9665-406377a4-c56be88f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:00.715604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:00.740780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601575281937228:9272]
2025-10-10T14:35:00.741132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1528, pipe: [1:7559601575281937228:9272]
2025-10-10T14:35:00.809843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:00.810155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.810170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.810192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937228:9272], now have 1 active actors on pipe
2025-10-10T14:35:00.810414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:00.811094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601575281937228:9272]
2025-10-10T14:35:00.811130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:00.811202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1529 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bebae681-915a9665-406377a4-c56be88f_0
2025-10-10T14:35:00.811602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bebae681-915a9665-406377a4-c56be88f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:00.811614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bebae681-915a9665-406377a4-c56be88f_0] Write session will restart in 0.009719s
2025-10-10T14:35:00.811638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bebae681-915a9665-406377a4-c56be88f_0] Write session: Do CDS request
2025-10-10T14:35:00.811643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bebae681-915a9665-406377a4-c56be88f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:00.811409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1529 sessionId: src_id|bebae681-915a9665-406377a4-c56be88f_0 is DEAD
2025-10-10T14:35:00.811590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:00.822879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bebae681-915a9665-406377a4-c56be88f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.823264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:00.823279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1530
2025-10-10T14:35:00.823400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.823433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:00.823438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:00.823442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:00.824016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1530 sessionId:  describe result for acl check
2025-10-10T14:35:00.824054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:00.824062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:00.824065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:00.824071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601575281937302:9429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:00.824654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601575281937302:9429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:00.826871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:00.827292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601575281937302:9429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:00.828775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:00.829001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:00.829013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:00.829026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:00.829097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:00.829140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601574499712979:8935]
2025-10-10T14:35:00.829815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:00.830129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601575281937302:9429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:00.830144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601575281937302:9429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:00.830148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601575281937302:9429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:00.830157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:00.830221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:00.830286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:00.830626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:00.830678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.830679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.830681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.830682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.830683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.830684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.830685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.830687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.830688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.830690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.830691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.830692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.830693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.830700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.830713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.830717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.830721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.830725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.830729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.830733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.830737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.830741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.830745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.830748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.830752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.830756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.830763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.830771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.830777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.830783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.830787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.830792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.830797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.830802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.830807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.830812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.830817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.830822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.830826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.830830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.830834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.830838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.830844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.830869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.830873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.830877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.830881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.830887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.830891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.830896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.830900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.830905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.830943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:00.834474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:00.834814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:00.834829Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:00.834831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:00.834835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:00.834842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1529 [2:7559601574499712979:8935]
2025-10-10T14:35:00.834857Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:00.834888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:00.834897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.834901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.834904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.834932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:00.834945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:00.834957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:00.835019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.835027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.835029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.835032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:00.835112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:00.835122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.835134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.835144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.835160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:00.835181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601574499712974:8935]
2025-10-10T14:35:00.835188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601574499712974:8935]
2025-10-10T14:35:00.835205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601574499712974:8935]
2025-10-10T14:35:00.835219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:00.835239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:00.835258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:00.835265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:00.835284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:00.835293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601574499712974:8935]
2025-10-10T14:35:00.835295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:00.835296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:00.835297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:00.835305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:00.835321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937230:2438], now have 1 active actors on pipe
2025-10-10T14:35:00.835327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937338:9429], now have 1 active actors on pipe
2025-10-10T14:35:00.835560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1529
2025-10-10T14:35:00.835567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1529
2025-10-10T14:35:00.835640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.835653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.835698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a350f55d-b763c62f-477b222c-f6244d10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:00.835712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:00.835716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:00.835718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:00.835731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:00.835743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:00.835758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.835961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.835970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.835987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:00.836135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1530 partition: 0 MaxSeqNo: 40 sessionId: src_id|a350f55d-b763c62f-477b222c-f6244d10_0
2025-10-10T14:35:00.836536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bebae681-915a9665-406377a4-c56be88f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a350f55d-b763c62f-477b222c-f6244d10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:00.839216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a350f55d-b763c62f-477b222c-f6244d10_0] Write session: try to update token
2025-10-10T14:35:00.839234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a350f55d-b763c62f-477b222c-f6244d10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:00.863831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:00.863854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:00.863857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:00.863860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:00.863870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601574499712974:8935]
2025-10-10T14:35:00.863875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601574499712974:8935]
2025-10-10T14:35:00.863879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601574499712974:8935]
2025-10-10T14:35:00.863931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:00.863948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.863960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:00.864107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:00.865428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:00.865449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:00.865453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:00.866908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId: src_id|a350f55d-b763c62f-477b222c-f6244d10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:00.869605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:00.910781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601575281937347:9272]
2025-10-10T14:35:00.911076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1529, pipe: [1:7559601575281937347:9272]
2025-10-10T14:35:00.977307Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:00.977858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:00.977876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:00.977923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937347:9272], now have 1 active actors on pipe
2025-10-10T14:35:00.978177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:00.978716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a350f55d-b763c62f-477b222c-f6244d10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:00.978727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a350f55d-b763c62f-477b222c-f6244d10_0] Write session will restart in 0.006226s
2025-10-10T14:35:00.978753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a350f55d-b763c62f-477b222c-f6244d10_0] Write session: Do CDS request
2025-10-10T14:35:00.978760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a350f55d-b763c62f-477b222c-f6244d10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:00.978193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:00.978206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:00.978289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1530 reason: error at write: Disconnected sessionId: src_id|a350f55d-b763c62f-477b222c-f6244d10_0
2025-10-10T14:35:00.978542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1530 sessionId: src_id|a350f55d-b763c62f-477b222c-f6244d10_0 is DEAD
2025-10-10T14:35:00.978699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601575281937347:9272]
2025-10-10T14:35:00.978726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:00.986317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a350f55d-b763c62f-477b222c-f6244d10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.986646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:00.986660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1531
2025-10-10T14:35:00.986998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:00.987050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:00.987061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:00.987065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:00.987457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1531 sessionId:  describe result for acl check
2025-10-10T14:35:00.987489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:00.987491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:00.987493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:00.987499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601575281937390:9442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:00.988263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601575281937390:9442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:00.991265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601575281937390:9442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:00.992111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:00.994158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:00.994397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:00.994408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:00.994420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:00.994490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:00.994486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601575281937390:9442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:00.994499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601575281937390:9442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:00.994503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601575281937390:9442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:00.994511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:00.994534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601574499713132:8948]
2025-10-10T14:35:00.995153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:00.995538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:00.995596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:00.995966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:00.996029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.996036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.996037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.996038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.996039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.996040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.996042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.996043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.996044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.996045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.996046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.996047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.996048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.996054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.996066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.996070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.996073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.996077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.996080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.996084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.996087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.996091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.996094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.996097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.996100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.996104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.996111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.996119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:00.996125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.996131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:00.996135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.996140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:00.996144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.996149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:00.996153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.996158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:00.996162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.996167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:00.996174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.996178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:00.996182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.996187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:00.996191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.996196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:00.996200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.996205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:00.996209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.996214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:00.996217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.996222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:00.996226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.996231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:00.996269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:01.001047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:01.001650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:01.001665Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:01.001667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:01.001671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:01.001678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1530 [2:7559601574499713132:8948]
2025-10-10T14:35:01.001690Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:01.001709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:01.001713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.001716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.001719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.001752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:01.001759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:01.001767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:01.001827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.001836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.001838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.001840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:01.001908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:01.001919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.001931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.001941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.001957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:01.001979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601574499713127:8948]
2025-10-10T14:35:01.001981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601574499713127:8948]
2025-10-10T14:35:01.001982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601574499713127:8948]
2025-10-10T14:35:01.001990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:01.002004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:01.002012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:01.002019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:01.002022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:01.002024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:01.002026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:01.002057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937480:9442], now have 1 active actors on pipe
2025-10-10T14:35:01.002067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601575281937365:2438], now have 1 active actors on pipe
2025-10-10T14:35:01.002069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601574499713127:8948]
2025-10-10T14:35:01.002072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:01.002074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:01.002419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1530
2025-10-10T14:35:01.002462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1530
2025-10-10T14:35:01.002518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.002530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.002567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:01.002575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.002580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.002582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:01.002596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.002609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:01.002626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.002842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.002851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.002867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.002972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1531 partition: 0 MaxSeqNo: 40 sessionId: src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0
2025-10-10T14:35:01.003401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a350f55d-b763c62f-477b222c-f6244d10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:01.006144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0] Write session: try to update token
2025-10-10T14:35:01.006162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:01.014085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:01.014108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.014120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601574499713127:8948]
2025-10-10T14:35:01.014164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:01.014170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:01.014342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:01.014488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.014622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.014757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.014948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:01.014991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:01.023088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId: src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:01.025607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:01.025817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.025841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.025884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:01.026061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:01.032690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:01.032712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.032715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:01.032717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:01.032729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601574499713127:8948]
2025-10-10T14:35:01.032733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601574499713127:8948]
2025-10-10T14:35:01.032737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601574499713127:8948]
2025-10-10T14:35:01.032788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:01.032787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:01.032795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:01.032796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.032798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:01.032800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:01.032937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:01.078750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601579576904787:9272]
2025-10-10T14:35:01.079080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1530, pipe: [1:7559601579576904787:9272]
2025-10-10T14:35:01.144377Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:01.152445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.152478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.152665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.152732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.152793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.152869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.152917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.152927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.153002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.153067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.153131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.153198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.153244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.153247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.153310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.153395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.153461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.153529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.153573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.153582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.153652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.153719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.153781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.153843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.153890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.153898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.153964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.154026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.154090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.154160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.154205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.154212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.154277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.154339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.154409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.154476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.154521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.154530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.154605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.154670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.154738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.154803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.154847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.154856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.154922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.154984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.155056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.155122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.155166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.155173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.155236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.155294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.155355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.155419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.155461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.155467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.155532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.155585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.155648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.155723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.155771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.155783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.155847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576904787:9272], now have 1 active actors on pipe
2025-10-10T14:35:01.156059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:01.156060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601579576904787:9272]
2025-10-10T14:35:01.156071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:01.156081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:01.156102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1531 reason: error at write: Disconnected sessionId: src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0
2025-10-10T14:35:01.156300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1531 sessionId: src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0 is DEAD
2025-10-10T14:35:01.156410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:01.156421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0] Write session will restart in 0.008382s
2025-10-10T14:35:01.156445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0] Write session: Do CDS request
2025-10-10T14:35:01.156451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:01.156795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:01.165878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.165915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:01.165929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1532
2025-10-10T14:35:01.166422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.166467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:01.166478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:01.166484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:01.166967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1532 sessionId:  describe result for acl check
2025-10-10T14:35:01.167003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:01.167009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:01.167011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:01.167016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601579576904865:9446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:01.167546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601579576904865:9446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:01.169795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:01.170260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601579576904865:9446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:01.171893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:01.172123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:01.172136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:01.172148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:01.172205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:01.172291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601578794680545:8952]
2025-10-10T14:35:01.172877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:01.173111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601579576904865:9446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:01.173124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601579576904865:9446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:01.173128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601579576904865:9446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:01.173136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:01.173160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:01.173223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:01.173542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:01.173611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.173618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.173619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.173620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.173621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.173622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.173623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.173624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.173625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.173626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.173627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.173629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.173630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.173636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.173648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.173652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.173655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.173659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.173663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.173667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.173671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.173674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.173678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.173682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.173685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.173689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.173696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.173704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.173712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.173718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.173722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.173727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.173730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.173735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.173739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.173756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.173762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.173767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.173777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.173781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.173786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.173791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.173799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.173804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.173807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.173812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.173821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.173825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.173829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.173837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.173841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.173850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.173888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:01.176207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:01.176527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:01.176540Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:01.176542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:01.176546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:01.176553Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1531 [2:7559601578794680545:8952]
2025-10-10T14:35:01.176567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:01.176590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:01.176593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.176597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.176599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.176617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:01.176629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:01.176636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:01.176695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.176701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.176703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.176706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:01.176772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:01.176780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.176791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.176807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.176823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:01.176845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576904900:9446], now have 1 active actors on pipe
2025-10-10T14:35:01.176854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576904790:2438], now have 1 active actors on pipe
2025-10-10T14:35:01.176862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601578794680540:8952]
2025-10-10T14:35:01.176869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601578794680540:8952]
2025-10-10T14:35:01.176871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601578794680540:8952]
2025-10-10T14:35:01.176888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:01.176903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:01.176922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:01.176934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:01.176935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:01.176937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:01.176939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:01.176920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1531
2025-10-10T14:35:01.176965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601578794680540:8952]
2025-10-10T14:35:01.176973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:01.176975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:01.176999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.177009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.177044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:01.177029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1531
2025-10-10T14:35:01.177057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.177066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.177068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:01.177079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.177097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:01.177122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.177268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.177275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.177290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.177409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1532 partition: 0 MaxSeqNo: 40 sessionId: src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0
2025-10-10T14:35:01.177841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df96e878-ee2d68f1-86a756a1-2ba54b8c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:01.180420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0] Write session: try to update token
2025-10-10T14:35:01.180439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:01.194524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId: src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:01.196014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:01.196037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.196040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:01.196041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:01.196051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601578794680540:8952]
2025-10-10T14:35:01.196056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601578794680540:8952]
2025-10-10T14:35:01.196059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601578794680540:8952]
2025-10-10T14:35:01.196107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:01.196119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.196121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:01.196206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:01.196222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:01.196229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:01.196264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:01.197111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:01.256408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601579576904909:9272]
2025-10-10T14:35:01.256701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1531, pipe: [1:7559601579576904909:9272]
2025-10-10T14:35:01.309183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:01.309195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:01.309196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:01.309241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601579576904909:9272]
2025-10-10T14:35:01.309258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1532 reason: error at write: Disconnected sessionId: src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0
2025-10-10T14:35:01.308584Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:01.308868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.308880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.308947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576904909:9272], now have 1 active actors on pipe
2025-10-10T14:35:01.309427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1532 sessionId: src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0 is DEAD
2025-10-10T14:35:01.309582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:01.309593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0] Write session will restart in 0.009136s
2025-10-10T14:35:01.309618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0] Write session: Do CDS request
2025-10-10T14:35:01.309625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:01.309420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:01.319980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.321568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:01.321584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1533
2025-10-10T14:35:01.321818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.321881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:01.321889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:01.321894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:01.322842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1533 sessionId:  describe result for acl check
2025-10-10T14:35:01.322882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:01.322898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:01.322909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:01.322916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601579576904957:9459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:01.323521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601579576904957:9459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:01.326312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601579576904957:9459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:01.327108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:01.328789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:01.328995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:01.329008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:01.329021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:01.329090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:01.329137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601578794680661:8954]
2025-10-10T14:35:01.329222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601579576904957:9459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:01.329239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601579576904957:9459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:01.329242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601579576904957:9459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:01.329252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:01.329829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:01.330192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:01.330245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:01.330606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:01.330666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.330675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.330676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.330677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.330679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.330680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.330682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.330683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.330685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.330686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.330687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.330689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.330690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.330696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.330710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.330715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.330719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.330724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.330728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.330733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.330736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.330740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.330745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.330750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.330754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.330759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.330766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.330778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.330792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.330798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.330807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.330813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.330819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.330825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.330835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.330841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.330850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.330856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.330866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.330871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.330891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.330900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.330905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.330911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.330915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.330921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.330925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.330931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.330936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.330942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.330947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.330967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.331007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:01.333544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:01.334003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:01.334017Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:01.334028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:01.334033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:01.334040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1532 [2:7559601578794680661:8954]
2025-10-10T14:35:01.334054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:01.334073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:01.334076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.334080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.334083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.334101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:01.334109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:01.334117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:01.334189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.334191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.334193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.334196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:01.334274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:01.334277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.334289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.334302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.334321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:01.334341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601578794680656:8954]
2025-10-10T14:35:01.334345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601578794680656:8954]
2025-10-10T14:35:01.334347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601578794680656:8954]
2025-10-10T14:35:01.334362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:01.334377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:01.334394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:01.334397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:01.334423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601578794680656:8954]
2025-10-10T14:35:01.334426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:01.334452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905033:9459], now have 1 active actors on pipe
2025-10-10T14:35:01.334477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:01.334481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:01.334482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:01.334491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:01.334589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1532
2025-10-10T14:35:01.334687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576904924:2438], now have 1 active actors on pipe
2025-10-10T14:35:01.334710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.334716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.334749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|123f974b-97e317ca-5367d448-cc97c17a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:01.334757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.334761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.334764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:01.334775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.334788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:01.334803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.334911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1532
2025-10-10T14:35:01.335530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.335541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.335570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.335670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1533 partition: 0 MaxSeqNo: 40 sessionId: src_id|123f974b-97e317ca-5367d448-cc97c17a_0
2025-10-10T14:35:01.336453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1027f4-fed4b825-ad22b3fa-9c1280d3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|123f974b-97e317ca-5367d448-cc97c17a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:01.339254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Write session: try to update token
2025-10-10T14:35:01.339276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:01.355719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:01.355741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.355745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:01.355747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:01.355757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601578794680656:8954]
2025-10-10T14:35:01.355762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601578794680656:8954]
2025-10-10T14:35:01.355766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601578794680656:8954]
2025-10-10T14:35:01.355811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:01.355818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:01.355820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:01.355822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:01.355828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.355831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:01.355984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:01.361956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId: src_id|123f974b-97e317ca-5367d448-cc97c17a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:01.364422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:01.409584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601579576905044:9272]
2025-10-10T14:35:01.410008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1532, pipe: [1:7559601579576905044:9272]
2025-10-10T14:35:01.488989Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:01.489407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.489427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.489474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905044:9272], now have 1 active actors on pipe
2025-10-10T14:35:01.489719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:01.489734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601579576905044:9272]
2025-10-10T14:35:01.489775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:01.489784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:01.489846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1533 reason: error at write: Disconnected sessionId: src_id|123f974b-97e317ca-5367d448-cc97c17a_0
2025-10-10T14:35:01.490056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1533 sessionId: src_id|123f974b-97e317ca-5367d448-cc97c17a_0 is DEAD
2025-10-10T14:35:01.490208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 153 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:35:01.490200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:01.490253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:01.490260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Write session will restart in 0.007704s
2025-10-10T14:35:01.490283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Write session: Do CDS request
2025-10-10T14:35:01.490290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:01.498934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.499034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:01.499050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1534
2025-10-10T14:35:01.499288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.499338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:01.499350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:01.499355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:01.499888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1534 sessionId:  describe result for acl check
2025-10-10T14:35:01.499923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:01.499930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:01.499932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:01.499939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601579576905121:9463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:01.500540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601579576905121:9463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:01.502023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:01.503637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601579576905121:9463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:01.504177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:01.504391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:01.504405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:01.504416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:01.504470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:01.504511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601578794680780:8956]
2025-10-10T14:35:01.505176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:01.505533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:01.505593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:01.505955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:01.506008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.506014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.506016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.506017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.506018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.506019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.506021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.506023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.506024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.506025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.506026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.506027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.506029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.506034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.506048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.506052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.506057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.506061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.506066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.506070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.506074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.506079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.506083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.506088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.506092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.506096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.506103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.506112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.506119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.506125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.506130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.506136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.506140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.506146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.506151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.506157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.506161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.506167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.506172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.506178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.506183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.506189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.506194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.506200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.506205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.506210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.506215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.506221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.506226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.506231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.506236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.506248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.506292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:01.506437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601579576905121:9463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:01.506451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601579576905121:9463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:01.506455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601579576905121:9463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:01.506464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:01.509642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1533
2025-10-10T14:35:01.509659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1533
2025-10-10T14:35:01.508906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:01.509231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:01.509236Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:01.509238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:01.509242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:01.509248Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1533 [2:7559601578794680780:8956]
2025-10-10T14:35:01.509263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:01.509282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:01.509285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.509289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.509292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.509310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:01.509318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:01.509326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:01.509402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.509404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.509405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.509408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:01.509477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:01.509480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.509490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.509500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.509516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:01.509538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905046:2438], now have 1 active actors on pipe
2025-10-10T14:35:01.509541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905160:9463], now have 1 active actors on pipe
2025-10-10T14:35:01.509549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601578794680773:8956]
2025-10-10T14:35:01.509551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601578794680773:8956]
2025-10-10T14:35:01.509553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601578794680773:8956]
2025-10-10T14:35:01.509569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:01.509584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:01.509599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:01.509603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:01.509625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601578794680773:8956]
2025-10-10T14:35:01.509628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:01.509661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:01.509664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:01.509666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:01.509673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:01.509866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.509881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.509913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43419baa-401120a6-cef531a6-ecb441b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:01.509936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.509944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.509947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:01.509959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.509978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:01.509993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.510171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.510178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.510194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.510314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1534 partition: 0 MaxSeqNo: 40 sessionId: src_id|43419baa-401120a6-cef531a6-ecb441b2_0
2025-10-10T14:35:01.510729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123f974b-97e317ca-5367d448-cc97c17a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43419baa-401120a6-cef531a6-ecb441b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:01.513666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43419baa-401120a6-cef531a6-ecb441b2_0] Write session: try to update token
2025-10-10T14:35:01.513688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43419baa-401120a6-cef531a6-ecb441b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:01.521301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:01.521325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.521355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601578794680773:8956]
2025-10-10T14:35:01.521410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:01.521583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:01.521590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:01.521738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.521877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.522020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.522214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:01.522255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:01.532990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId: src_id|43419baa-401120a6-cef531a6-ecb441b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:01.535550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:01.535839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.535864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.535907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:01.536022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:01.540668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:01.540694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.540698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:01.540700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:01.540712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601578794680773:8956]
2025-10-10T14:35:01.540716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601578794680773:8956]
2025-10-10T14:35:01.540721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601578794680773:8956]
2025-10-10T14:35:01.540775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:01.540775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:01.540781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:01.540784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.540787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:01.540795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:01.540923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:01.589648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601579576905168:9272]
2025-10-10T14:35:01.590028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1533, pipe: [1:7559601579576905168:9272]
2025-10-10T14:35:01.663177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:01.671489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.671519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.671702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.671766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.671833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.671894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.671939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.671949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.672017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.672072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.672129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.672187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.672228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.672231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.672296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.672351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.672411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.672467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.672504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.672508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.672577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.672634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.672691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.672748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.672789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.672792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.672856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.672912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.672970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.673029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.673069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.673072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.673139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.673193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.673251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.673310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.673533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.673546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.673611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.673671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.673732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.673796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.673835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.673837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.673901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.673958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.674016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.674076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.674115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.674118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.674181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.674235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.674291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.674348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.674387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.674390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.674456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:01.674510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:01.674567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:01.674620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:01.674752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:01.674755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:01.674823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905168:9272], now have 1 active actors on pipe
2025-10-10T14:35:01.676156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:01.676405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601579576905168:9272]
2025-10-10T14:35:01.676436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:01.676474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:01.676524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1534 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43419baa-401120a6-cef531a6-ecb441b2_0
2025-10-10T14:35:01.676763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1534 sessionId: src_id|43419baa-401120a6-cef531a6-ecb441b2_0 is DEAD
2025-10-10T14:35:01.676906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43419baa-401120a6-cef531a6-ecb441b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:01.676917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43419baa-401120a6-cef531a6-ecb441b2_0] Write session will restart in 0.008448s
2025-10-10T14:35:01.676949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43419baa-401120a6-cef531a6-ecb441b2_0] Write session: Do CDS request
2025-10-10T14:35:01.676955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43419baa-401120a6-cef531a6-ecb441b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:01.686924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43419baa-401120a6-cef531a6-ecb441b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.687209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:01.687223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1535
2025-10-10T14:35:01.687388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.687440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:01.687446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:01.687450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:01.688078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1535 sessionId:  describe result for acl check
2025-10-10T14:35:01.688121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:01.688124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:01.688126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:01.688133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601579576905269:9469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:01.688690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601579576905269:9469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:01.689310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:01.691663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601579576905269:9469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:01.691683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:01.691922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:01.691927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:01.691939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:01.691997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:01.692037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601578794680912:8959]
2025-10-10T14:35:01.692701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:01.693006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:01.693053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:01.693408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:01.693460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.693461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.693462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.693463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.693465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.693466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.693467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.693468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.693470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.693471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.693472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.693473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.693474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.693480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.693493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.693497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.693501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.693505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.693509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.693514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.693518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.693521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.693526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.693530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.693534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.693538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.693547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.693556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.693565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.693570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.693575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.693580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.693585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.693591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.693596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.693602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.693606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.693612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.693617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.693623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.693627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.693633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.693638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.693644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.693648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.693654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.693659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.693664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.693669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.693675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.693679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.693685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.693727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:01.694451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601579576905269:9469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:01.694466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601579576905269:9469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:01.694469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601579576905269:9469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:01.694491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:01.696071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:01.696444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:01.696459Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:01.696462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:01.696466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:01.696473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1534 [2:7559601578794680912:8959]
2025-10-10T14:35:01.696486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:01.696506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:01.696509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.696513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.696516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.696533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:01.696543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:01.696551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:01.696603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.696606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.696608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.696610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:01.696679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:01.696681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.696693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.696705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.696722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:01.696744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601578794680906:8959]
2025-10-10T14:35:01.696755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601578794680906:8959]
2025-10-10T14:35:01.696759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601578794680906:8959]
2025-10-10T14:35:01.696775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:01.696779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:01.696782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:01.696787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:01.696795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905188:2438], now have 1 active actors on pipe
2025-10-10T14:35:01.696799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905303:9469], now have 1 active actors on pipe
2025-10-10T14:35:01.696808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:01.696825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:01.696833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:01.696827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1534
2025-10-10T14:35:01.696858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601578794680906:8959]
2025-10-10T14:35:01.696864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:01.696866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:01.696883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1534
2025-10-10T14:35:01.696922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.696933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.696962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:01.696969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.696974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.696976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:01.696987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.696998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:01.697012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.697147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.697156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.697170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.697274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1535 partition: 0 MaxSeqNo: 40 sessionId: src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0
2025-10-10T14:35:01.697719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43419baa-401120a6-cef531a6-ecb441b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:01.700435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0] Write session: try to update token
2025-10-10T14:35:01.700454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:01.715695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId: src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:01.717249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:01.717273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.717277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:01.717279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:01.717289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601578794680906:8959]
2025-10-10T14:35:01.717293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601578794680906:8959]
2025-10-10T14:35:01.717300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601578794680906:8959]
2025-10-10T14:35:01.717359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:01.717374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:01.717375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:01.717379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:01.717382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.717384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:01.717523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:01.718431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:01.776602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601579576905313:9272]
2025-10-10T14:35:01.776918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1534, pipe: [1:7559601579576905313:9272]
2025-10-10T14:35:01.832430Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:01.832718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.832729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.832778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905313:9272], now have 1 active actors on pipe
2025-10-10T14:35:01.833076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:01.833611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:01.833623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0] Write session will restart in 0.005452s
2025-10-10T14:35:01.833100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:01.833647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0] Write session: Do CDS request
2025-10-10T14:35:01.833123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:01.833652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:01.833198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1535 reason: error at write: Disconnected sessionId: src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0
2025-10-10T14:35:01.833446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1535 sessionId: src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0 is DEAD
2025-10-10T14:35:01.833516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:01.833557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601579576905313:9272]
2025-10-10T14:35:01.839851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.839982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:01.839997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1536
2025-10-10T14:35:01.840130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:01.840161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:01.840167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:01.840172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:01.840568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1536 sessionId:  describe result for acl check
2025-10-10T14:35:01.840597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:01.840599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:01.840603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:01.840609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601579576905330:9473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:01.841184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601579576905330:9473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:01.846975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601579576905330:9473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:01.852899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:01.853080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601579576905330:9473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:01.853096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601579576905330:9473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:01.853100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601579576905330:9473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:01.853109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:01.855159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:01.855402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:01.855409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:01.855422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:01.855481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:01.855521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601578794681035:8962]
2025-10-10T14:35:01.856153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:01.856457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:01.856495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:01.856832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:01.856883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.856884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.856886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.856887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.856888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.856889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.856890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.856901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.856903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.856904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.856905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.856906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.856907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.856913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.856926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.856930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.856933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.856937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.856941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.856944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.856948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.856951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.856956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.856960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.856964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.856967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.856976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.856984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:01.856992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.856997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:01.857002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.857008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:01.857012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.857017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:01.857021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.857026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:01.857030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.857035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:01.857040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.857045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:01.857050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.857055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:01.857060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.857066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:01.857071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.857076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:01.857082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.857087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.857092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.857097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.857102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.857107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.857150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:01.860022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:01.860320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:01.860323Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:01.860325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:01.860328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:01.860333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1535 [2:7559601578794681035:8962]
2025-10-10T14:35:01.860343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:01.860357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:01.860359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.860362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.860363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.860376Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:01.860382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:01.860389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:01.860453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.860455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.860456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.860458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:01.860518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:01.860521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.860530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:01.860536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:01.860546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:01.860562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601578794681029:8962]
2025-10-10T14:35:01.860564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601578794681029:8962]
2025-10-10T14:35:01.860566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601578794681029:8962]
2025-10-10T14:35:01.860573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:01.860584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:01.860588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:01.860591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:01.860593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:01.860599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:01.860602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:01.860613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905315:2438], now have 1 active actors on pipe
2025-10-10T14:35:01.860616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905425:9473], now have 1 active actors on pipe
2025-10-10T14:35:01.860638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601578794681029:8962]
2025-10-10T14:35:01.860646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:01.860657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:01.860893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.860899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.860927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:01.860947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:01.860954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:01.860957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:01.860969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:01.860982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:01.861006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.861218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.861221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.861238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:01.860678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1535
2025-10-10T14:35:01.860690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1535
2025-10-10T14:35:01.864707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1536 partition: 0 MaxSeqNo: 40 sessionId: src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0
2025-10-10T14:35:01.865084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f7d6ae-19b97229-97668d08-8370d8ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:01.867845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0] Write session: try to update token
2025-10-10T14:35:01.867867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:01.880708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:01.880729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.880739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601578794681029:8962]
2025-10-10T14:35:01.880799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:01.880802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:01.880998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:01.881143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.881288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.881450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:01.881651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:01.881702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:01.887366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId: src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:01.890050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:01.890375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:01.890405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:01.890456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:01.890564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:01.893274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:01.893293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:01.893296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:01.893298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:01.893309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601578794681029:8962]
2025-10-10T14:35:01.893314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601578794681029:8962]
2025-10-10T14:35:01.893318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601578794681029:8962]
2025-10-10T14:35:01.893369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:01.893380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:01.893381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:01.893389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:01.893392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:01.893392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:01.893528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:01.933779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601579576905439:9272]
2025-10-10T14:35:01.934088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1535, pipe: [1:7559601579576905439:9272]
2025-10-10T14:35:02.006373Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:02.014251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.014283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.014455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.014522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.014582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.014650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.014692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.014699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.014773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.014832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.014893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.014955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.014995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.015011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.015085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.015143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.015206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.015269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.015308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.015310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.015385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.015445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.015502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.015561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.015601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.015604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.015676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.015734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.015809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.015869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.015906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.015909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.015975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.016030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.016088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.016145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.016189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.016193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.016261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.016319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.016379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.016439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.016479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.016482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.016548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.016604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.016659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.016715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.016755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.016757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.016825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.016886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.016944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.017002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.017048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.017050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.017118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:02.017176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:02.017237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:02.017294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:02.017590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:02.017604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:02.018313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:02.018369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:02.018374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:02.018403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1536 reason: error at write: Disconnected sessionId: src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0
2025-10-10T14:35:02.018606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1536 sessionId: src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0 is DEAD
2025-10-10T14:35:02.018767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:02.018778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0] Write session will restart in 0.005182s
2025-10-10T14:35:02.018770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601579576905439:9272]
2025-10-10T14:35:02.018805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0] Write session: Do CDS request
2025-10-10T14:35:02.018812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:02.017670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601579576905439:9272], now have 1 active actors on pipe
2025-10-10T14:35:02.018729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:02.024860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.024995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:02.025009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1537
2025-10-10T14:35:02.025204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.025266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:02.025275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:02.025280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:02.025952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1537 sessionId:  describe result for acl check
2025-10-10T14:35:02.026002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:02.026004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:02.026006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:02.026012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601583871872762:9483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:02.026756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601583871872762:9483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:02.030445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601583871872762:9483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:02.042134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601583871872762:9483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:02.042154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601583871872762:9483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:02.042158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601583871872762:9483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:02.042169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:02.042294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:02.044714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:02.044949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:02.044961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:02.044973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:02.045030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:02.045071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601583089648490:8975]
2025-10-10T14:35:02.045713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:02.046059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:02.046106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:02.046420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:02.046487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.046493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.046494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.046495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.046496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.046497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.046499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.046500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.046501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.046502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.046504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.046505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.046506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.046512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.046526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.046530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.046534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.046538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.046543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.046547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.046550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.046554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.046559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.046563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.046567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.046570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.046578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.046586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.046593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.046598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.046602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.046608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.046612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.046617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.046622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.046627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.046632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.046637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.046642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.046652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.046657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.046662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.046668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.046673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.046680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.046690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.046695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.046699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.046703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.046708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.046713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.046717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.046756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:02.049364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:02.049672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:02.049684Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:02.049686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:02.049690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:02.049697Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1536 [2:7559601583089648490:8975]
2025-10-10T14:35:02.049711Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:02.049735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:02.049747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.049750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.049752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.049772Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:02.049780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:02.049794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:02.049859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.049866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.049868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.049871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:02.049937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:02.049944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.049955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.049967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.049985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:02.050008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601583089648483:8975]
2025-10-10T14:35:02.050010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601583089648483:8975]
2025-10-10T14:35:02.050012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601583089648483:8975]
2025-10-10T14:35:02.050021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:02.050029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:02.050032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:02.050034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:02.050040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871872872:9483], now have 1 active actors on pipe
2025-10-10T14:35:02.050044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871872753:2438], now have 1 active actors on pipe
2025-10-10T14:35:02.050049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:02.050066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:02.050069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:02.050096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601583089648483:8975]
2025-10-10T14:35:02.050103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:02.050109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1536
2025-10-10T14:35:02.050116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1536
2025-10-10T14:35:02.050156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:02.050232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.050236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.050266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aca89a84-d12dd870-d0695923-9764d87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:02.050273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.050277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.050279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:02.050294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.050306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:02.050325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.050529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.050536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.050550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.050652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1537 partition: 0 MaxSeqNo: 40 sessionId: src_id|aca89a84-d12dd870-d0695923-9764d87_0
2025-10-10T14:35:02.053449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55495e0d-9b36119f-93857b2c-b73d1dae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aca89a84-d12dd870-d0695923-9764d87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:02.056538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aca89a84-d12dd870-d0695923-9764d87_0] Write session: try to update token
2025-10-10T14:35:02.056566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aca89a84-d12dd870-d0695923-9764d87_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:02.072460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:02.072481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:02.072485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:02.072486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:02.072501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601583089648483:8975]
2025-10-10T14:35:02.072505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601583089648483:8975]
2025-10-10T14:35:02.072509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601583089648483:8975]
2025-10-10T14:35:02.072564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:02.072576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.072578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:02.072585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:02.072591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:02.072596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:02.072725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:02.083431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId: src_id|aca89a84-d12dd870-d0695923-9764d87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:02.086351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:02.119117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601583871872885:9272]
2025-10-10T14:35:02.119434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1536, pipe: [1:7559601583871872885:9272]
2025-10-10T14:35:02.188008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601583871872885:9272]
2025-10-10T14:35:02.188039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:02.188181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:02.188195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:02.188258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1537 reason: error at write: Disconnected sessionId: src_id|aca89a84-d12dd870-d0695923-9764d87_0
2025-10-10T14:35:02.187213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:02.187570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.187581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.187630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871872885:9272], now have 1 active actors on pipe
2025-10-10T14:35:02.188108Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:02.188496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1537 sessionId: src_id|aca89a84-d12dd870-d0695923-9764d87_0 is DEAD
2025-10-10T14:35:02.188645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca89a84-d12dd870-d0695923-9764d87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:02.188657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca89a84-d12dd870-d0695923-9764d87_0] Write session will restart in 0.006007s
2025-10-10T14:35:02.188683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca89a84-d12dd870-d0695923-9764d87_0] Write session: Do CDS request
2025-10-10T14:35:02.188693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca89a84-d12dd870-d0695923-9764d87_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:02.195965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aca89a84-d12dd870-d0695923-9764d87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.196001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:02.196018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1538
2025-10-10T14:35:02.196194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.196232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:02.196238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:02.196242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:02.196734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1538 sessionId:  describe result for acl check
2025-10-10T14:35:02.196770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:02.196776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:02.196778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:02.196784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601583871872897:9490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:02.197358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601583871872897:9490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:02.200220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601583871872897:9490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:02.204453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601583871872897:9490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:02.204469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601583871872897:9490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:02.204472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601583871872897:9490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:02.204481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:02.206203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:02.208881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:02.209122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:02.209128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:02.209141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:02.209210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:02.209252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601583089648612:8979]
2025-10-10T14:35:02.209925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:02.210319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:02.210368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:02.210730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:02.210799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.210807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.210808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.210810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.210811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.210813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.210815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.210817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.210818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.210820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.210821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.210823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.210824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.210831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.210846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.210850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.210855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.210859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.210864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.210868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.210873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.210877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.210884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.210889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.210893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.210898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.210907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.210916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.210923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.210929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.210935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.210941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.210952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.210958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.210963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.210972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.210977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.210983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.210989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.211013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.211018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.211024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.211029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.211035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.211041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.211047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.211052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.211058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.211069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.211075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.211080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.211085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.211129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:02.214592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:02.214947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:02.214967Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:02.214970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:02.214975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:02.214983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1537 [2:7559601583089648612:8979]
2025-10-10T14:35:02.215015Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:02.215042Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:02.215052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.215056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.215058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.215090Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:02.215104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:02.215112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:02.215187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.215195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.215197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.215200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:02.215388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1537
2025-10-10T14:35:02.215426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1537
2025-10-10T14:35:02.215310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:02.215323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.215338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.215352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.215371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:02.215397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871872888:2438], now have 1 active actors on pipe
2025-10-10T14:35:02.215402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871872999:9490], now have 1 active actors on pipe
2025-10-10T14:35:02.215411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601583089648607:8979]
2025-10-10T14:35:02.215413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601583089648607:8979]
2025-10-10T14:35:02.215417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601583089648607:8979]
2025-10-10T14:35:02.215430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:02.215446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:02.215464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:02.215465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:02.215469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:02.215471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:02.215474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:02.215508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601583089648607:8979]
2025-10-10T14:35:02.215516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:02.215533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:02.215646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.215653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.215687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2835675-3702cf-ce3d114c-ba032a1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:02.215704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.215709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.215712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:02.215725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.215744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:02.215776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.215996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.216006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.216040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.216164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1538 partition: 0 MaxSeqNo: 40 sessionId: src_id|d2835675-3702cf-ce3d114c-ba032a1f_0
2025-10-10T14:35:02.216629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aca89a84-d12dd870-d0695923-9764d87_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d2835675-3702cf-ce3d114c-ba032a1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:02.219475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2835675-3702cf-ce3d114c-ba032a1f_0] Write session: try to update token
2025-10-10T14:35:02.219499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2835675-3702cf-ce3d114c-ba032a1f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:02.238178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:02.238205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:02.238209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:02.238212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:02.238223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601583089648607:8979]
2025-10-10T14:35:02.238227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601583089648607:8979]
2025-10-10T14:35:02.238232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601583089648607:8979]
2025-10-10T14:35:02.238292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:02.238306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.238314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:02.238318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:02.238326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:02.238340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:02.238458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:02.241955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId: src_id|d2835675-3702cf-ce3d114c-ba032a1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:02.244693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:02.288070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601583871873013:9272]
2025-10-10T14:35:02.288454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1537, pipe: [1:7559601583871873013:9272]
2025-10-10T14:35:02.359132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2835675-3702cf-ce3d114c-ba032a1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:02.359148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2835675-3702cf-ce3d114c-ba032a1f_0] Write session will restart in 0.008229s
2025-10-10T14:35:02.358597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:02.359172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2835675-3702cf-ce3d114c-ba032a1f_0] Write session: Do CDS request
2025-10-10T14:35:02.358652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601583871873013:9272]
2025-10-10T14:35:02.359179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2835675-3702cf-ce3d114c-ba032a1f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:02.358672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:02.358675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:02.358730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1538 reason: error at write: Disconnected sessionId: src_id|d2835675-3702cf-ce3d114c-ba032a1f_0
2025-10-10T14:35:02.358950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1538 sessionId: src_id|d2835675-3702cf-ce3d114c-ba032a1f_0 is DEAD
2025-10-10T14:35:02.357549Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:02.357916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.357927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.357974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873013:9272], now have 1 active actors on pipe
2025-10-10T14:35:02.359462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:02.368941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2835675-3702cf-ce3d114c-ba032a1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.368975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:02.368992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1539
2025-10-10T14:35:02.369177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.369214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:02.369233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:02.369237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:02.369705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1539 sessionId:  describe result for acl check
2025-10-10T14:35:02.369734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:02.369735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:02.369737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:02.369743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601583871873031:9494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:02.370300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601583871873031:9494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:02.375491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:02.375854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601583871873031:9494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:02.377977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:02.378216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:02.378232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:02.378244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:02.378302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:02.378345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601583089648734:8981]
2025-10-10T14:35:02.378963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:02.379376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:02.379424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:02.379777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:02.379830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.379832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.379833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.379834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.379835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.379836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.379837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.379839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.379840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.379841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.379843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.379844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.379845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.379851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.379866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.379870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.379874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.379879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.379883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.379888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.379892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.379896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.379901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.379905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.379910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.379914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.379922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.379931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.379938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.379945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.379952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.379957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.379962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.379968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.379973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.379979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.379984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.379990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.379995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.380001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.380006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.380012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.380017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.380023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.380027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.380033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.380038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.380044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.380049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.380054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.380059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.380065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.380109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:02.381022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601583871873031:9494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:02.381039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601583871873031:9494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:02.381043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601583871873031:9494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:02.381053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:02.382960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:02.383314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:02.383319Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:02.383321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:02.383325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:02.383332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1538 [2:7559601583089648734:8981]
2025-10-10T14:35:02.383345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:02.383365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:02.383368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.383371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.383374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.383392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:02.383400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:02.383408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:02.383470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.383472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.383474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.383477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:02.383552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:02.383554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.383565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.383577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.383595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:02.383636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873135:9494], now have 1 active actors on pipe
2025-10-10T14:35:02.383639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873015:2438], now have 1 active actors on pipe
2025-10-10T14:35:02.383647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601583089648729:8981]
2025-10-10T14:35:02.383649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601583089648729:8981]
2025-10-10T14:35:02.383651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601583089648729:8981]
2025-10-10T14:35:02.383665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:02.383681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:02.383697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:02.383701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:02.383726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601583089648729:8981]
2025-10-10T14:35:02.383728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:02.383763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:02.383767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:02.383770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:02.383777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:02.383959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1538
2025-10-10T14:35:02.383992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1538
2025-10-10T14:35:02.384173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.384186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.384223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:02.384233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.384237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.384240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:02.384252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.384264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:02.384281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.384535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.384542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.384558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.385104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2835675-3702cf-ce3d114c-ba032a1f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:02.387809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0] Write session: try to update token
2025-10-10T14:35:02.387831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:02.384641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1539 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0
2025-10-10T14:35:02.413183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:02.413204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:02.413206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:02.413208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:02.413216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601583089648729:8981]
2025-10-10T14:35:02.413220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601583089648729:8981]
2025-10-10T14:35:02.413223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601583089648729:8981]
2025-10-10T14:35:02.413266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:02.413272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.413273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:02.413423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:02.412354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId: src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:02.415170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:02.415356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:02.415370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:02.415374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:02.458583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601583871873142:9272]
2025-10-10T14:35:02.458890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1538, pipe: [1:7559601583871873142:9272]
2025-10-10T14:35:02.527493Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 15 CurrentSessionLifetimeMs: 241280 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:35:02.527713Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:02.528345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.528361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.528408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873142:9272], now have 1 active actors on pipe
2025-10-10T14:35:02.528686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:02.528694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:02.528698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:02.528738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601583871873142:9272]
2025-10-10T14:35:02.528771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1539 reason: error at write: Disconnected sessionId: src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0
2025-10-10T14:35:02.529144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:02.529155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0] Write session will restart in 0.005472s
2025-10-10T14:35:02.529178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0] Write session: Do CDS request
2025-10-10T14:35:02.529188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:02.528990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1539 sessionId: src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0 is DEAD
2025-10-10T14:35:02.528952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:02.536118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.536233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:02.536248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1540
2025-10-10T14:35:02.536409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.536456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:02.536466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:02.536470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:02.537004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1540 sessionId:  describe result for acl check
2025-10-10T14:35:02.537044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:02.537050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:02.537053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:02.537060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601583871873159:9498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:02.537660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601583871873159:9498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:02.541859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601583871873159:9498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:02.543672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:02.545296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:02.545521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601583871873159:9498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:02.545538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601583871873159:9498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:02.545542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601583871873159:9498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:02.545551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:02.545579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:02.545593Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:02.545605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:02.545684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:02.545730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601583089648858:8983]
2025-10-10T14:35:02.546324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:02.546624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:02.546685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:02.547069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:02.547132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.547141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.547142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.547143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.547144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.547145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.547146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.547148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.547149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.547150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.547151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.547153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.547154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.547160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.547174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.547178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.547183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.547187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.547192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.547195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.547199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.547203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.547208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.547212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.547216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.547220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.547228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.547236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.547243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.547248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.547252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.547258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.547263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.547268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.547273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.547279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.547283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.547288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.547293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.547298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.547304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.547310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.547325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.547333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.547341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.547347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.547352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.547362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.547366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.547372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.547380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.547386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.547434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:02.549911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:02.550231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:02.550243Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:02.550245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:02.550249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:02.550256Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1539 [2:7559601583089648858:8983]
2025-10-10T14:35:02.550268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:02.550285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:02.550289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.550292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.550295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.550314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:02.550321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:02.550333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:02.550392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.550401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.550403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.550406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:02.550476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:02.550483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.550494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.550506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.550523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:02.550550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873260:9498], now have 1 active actors on pipe
2025-10-10T14:35:02.550562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601583089648853:8983]
2025-10-10T14:35:02.550568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601583089648853:8983]
2025-10-10T14:35:02.550570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601583089648853:8983]
2025-10-10T14:35:02.550586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:02.550599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873144:2438], now have 1 active actors on pipe
2025-10-10T14:35:02.550599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:02.550603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:02.550605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:02.550608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:02.550625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:02.550632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:02.550660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601583089648853:8983]
2025-10-10T14:35:02.550673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:02.550689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1539
2025-10-10T14:35:02.550699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1539
2025-10-10T14:35:02.550698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:02.550758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.550769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.550803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:02.550815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.550821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.550826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:02.550838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.550855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:02.550872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.551045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.551053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.551068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.551148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1540 partition: 0 MaxSeqNo: 40 sessionId: src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0
2025-10-10T14:35:02.551573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0ad8e06-94c87061-93c6ed2b-35d3deb6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:02.554256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0] Write session: try to update token
2025-10-10T14:35:02.554274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:02.569183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId: src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:02.572032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:02.572645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.572670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.572694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:02.572698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:02.572702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:02.572704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:02.572712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601583089648853:8983]
2025-10-10T14:35:02.572721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601583089648853:8983]
2025-10-10T14:35:02.572725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601583089648853:8983]
2025-10-10T14:35:02.572763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:02.572776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:02.572780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:02.572784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:02.572791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.572793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:02.572933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:02.629064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601583871873272:9272]
2025-10-10T14:35:02.630171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1539, pipe: [1:7559601583871873272:9272]
2025-10-10T14:35:02.686612Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:02.687040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:02.687104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873272:9272], now have 1 active actors on pipe
2025-10-10T14:35:02.687182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:02.687304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:02.687368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601583871873272:9272]
2025-10-10T14:35:02.687369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:02.687372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:02.687390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1540 reason: error at write: Disconnected sessionId: src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0
2025-10-10T14:35:02.687557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1540 sessionId: src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0 is DEAD
2025-10-10T14:35:02.687731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:02.687744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0] Write session will restart in 0.006210s
2025-10-10T14:35:02.687770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0] Write session: Do CDS request
2025-10-10T14:35:02.687776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:02.694888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.695054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:02.695069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1541
2025-10-10T14:35:02.695202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.695234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:02.695246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:02.695250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:02.695681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1541 sessionId:  describe result for acl check
2025-10-10T14:35:02.695716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:02.695723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:02.695725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:02.695731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601583871873307:9504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:02.696299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601583871873307:9504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:02.699033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601583871873307:9504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:02.699364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:02.701298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:02.701534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:02.701547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:02.701560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:02.701616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:02.701693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601583089648995:8986]
2025-10-10T14:35:02.701933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601583871873307:9504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:02.701958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601583871873307:9504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:02.701962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601583871873307:9504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:02.701972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:02.702286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:02.702582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:02.702624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:02.702928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:02.703002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.703009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.703010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.703012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.703013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.703014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.703016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.703017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.703018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.703020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.703021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.703022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.703023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.703029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.703041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.703044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.703048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.703051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.703055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.703058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.703061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.703065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.703068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.703071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.703075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.703078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.703085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.703093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.703099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.703104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.703108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.703113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.703116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.703120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.703124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.703129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.703133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.703138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.703141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.703146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.703149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.703154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.703158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.703163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.703166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.703171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.703175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.703180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.703184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.703188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.703192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.703196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.703232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:02.705579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:02.705939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:02.705953Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:02.705955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:02.705959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:02.705965Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1540 [2:7559601583089648995:8986]
2025-10-10T14:35:02.705977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:02.705994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:02.706001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.706004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.706006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.706022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:02.706034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:02.706043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:02.706097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.706104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.706106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.706108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:02.706187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:02.706196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.706206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.706215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.706229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:02.706250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873290:2438], now have 1 active actors on pipe
2025-10-10T14:35:02.706257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873410:9504], now have 1 active actors on pipe
2025-10-10T14:35:02.706264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601583089648989:8986]
2025-10-10T14:35:02.706267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601583089648989:8986]
2025-10-10T14:35:02.706268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601583089648989:8986]
2025-10-10T14:35:02.706281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:02.706298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:02.706304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:02.706308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:02.706311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:02.706317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:02.706321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:02.706310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1540
2025-10-10T14:35:02.706340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601583089648989:8986]
2025-10-10T14:35:02.706351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:02.706316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1540
2025-10-10T14:35:02.706352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:02.706372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.706382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.706541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:02.706556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.706560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.706562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:02.706573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.706584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:02.706607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.706758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.706770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.706794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.706896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1541 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0
2025-10-10T14:35:02.707330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9571c34c-cf3a44c3-e4de5844-361ee88b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:02.709980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0] Write session: try to update token
2025-10-10T14:35:02.709998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:02.725763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:02.725786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:02.725789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:02.725791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:02.725806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601583089648989:8986]
2025-10-10T14:35:02.725811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601583089648989:8986]
2025-10-10T14:35:02.725815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601583089648989:8986]
2025-10-10T14:35:02.725863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:02.725871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:02.725877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:02.725877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.725880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:02.725881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:02.726012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:02.726486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId: src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:02.729061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:02.787807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601583871873421:9272]
2025-10-10T14:35:02.789568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1540, pipe: [1:7559601583871873421:9272]
2025-10-10T14:35:02.848118Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:02.848481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.848498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.849139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:02.849164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:02.849227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1541 reason: error at write: Disconnected sessionId: src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0
2025-10-10T14:35:02.848548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873421:9272], now have 1 active actors on pipe
2025-10-10T14:35:02.849295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:02.849741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:02.849751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0] Write session will restart in 0.008394s
2025-10-10T14:35:02.849777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0] Write session: Do CDS request
2025-10-10T14:35:02.849783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:02.849450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1541 sessionId: src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0 is DEAD
2025-10-10T14:35:02.849619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601583871873421:9272]
2025-10-10T14:35:02.849635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:02.861818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.861910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:02.861926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1542
2025-10-10T14:35:02.862100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:02.862133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:02.862139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:02.862143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:02.862522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1542 sessionId:  describe result for acl check
2025-10-10T14:35:02.862551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:02.862552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:02.862554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:02.862561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601583871873509:9508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:02.863111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601583871873509:9508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:02.866710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:02.867065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601583871873509:9508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:02.868924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:02.869168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:02.869178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:02.869192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:02.869252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:02.869292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601583089649123:8989]
2025-10-10T14:35:02.869862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:02.870297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:02.870351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:02.870458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601583871873509:9508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:02.870473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601583871873509:9508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:02.870476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601583871873509:9508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:02.870485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:02.870665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:02.870733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.870740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.870741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.870742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.870743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.870745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.870746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.870747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.870749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.870750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.870751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.870753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.870754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.870760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.870772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.870775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.870778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.870782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.870786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.870789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.870793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.870796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.870799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.870803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.870806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.870809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.870817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.870826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:02.870834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.870839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:02.870843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.870848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:02.870854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.870859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:02.870864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.870871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:02.870876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.870881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:02.870887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.870894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:02.870899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.870904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:02.870909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.870915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:02.870926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.870933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:02.870943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.870949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.870958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.870962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.870966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.870981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.871053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:02.873487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:02.874005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:02.874020Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:02.874022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:02.874026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:02.874031Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1541 [2:7559601583089649123:8989]
2025-10-10T14:35:02.874043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:02.874061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:02.874069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.874072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.874074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.874091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:02.874103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:02.874111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:02.874168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.874176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.874178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.874181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:02.874256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:02.874264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.874278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:02.874292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:02.874312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:02.874338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601583089649117:8989]
2025-10-10T14:35:02.874345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601583089649117:8989]
2025-10-10T14:35:02.874347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601583089649117:8989]
2025-10-10T14:35:02.874364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:02.874384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873423:2438], now have 1 active actors on pipe
2025-10-10T14:35:02.874392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:02.874396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873543:9508], now have 1 active actors on pipe
2025-10-10T14:35:02.874396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:02.874399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:02.874402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:02.874419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:02.874423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:02.874447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601583089649117:8989]
2025-10-10T14:35:02.874459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:02.874465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:02.874456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1541
2025-10-10T14:35:02.874497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1541
2025-10-10T14:35:02.874632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.874644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.874679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:02.874691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:02.874696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:02.874698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:02.874710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:02.874726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:02.874745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.874982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:02.874998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:02.875020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:02.875117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1542 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0
2025-10-10T14:35:02.875488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc1ae340-9f3ee44a-facaa17f-229510ff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:02.878228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Write session: try to update token
2025-10-10T14:35:02.878246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:02.887884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:02.887913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:02.887927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601583089649117:8989]
2025-10-10T14:35:02.887999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:02.888237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:02.888422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:02.888577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:02.888721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:02.888958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:02.888998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:02.889257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:02.904371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId: src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:02.907217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:02.905767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:02.905787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:02.905790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:02.905792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:02.905804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601583089649117:8989]
2025-10-10T14:35:02.905808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601583089649117:8989]
2025-10-10T14:35:02.905813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601583089649117:8989]
2025-10-10T14:35:02.905866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:02.905861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:02.905874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:02.905877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:02.905881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:02.905886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:02.906018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:02.949613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601583871873552:9272]
2025-10-10T14:35:02.950025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1541, pipe: [1:7559601583871873552:9272]
2025-10-10T14:35:03.021885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:03.021934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:03.021937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:03.021999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1542 reason: error at write: Disconnected sessionId: src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0
2025-10-10T14:35:03.021344Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:03.021644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.021655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.021680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601583871873552:9272], now have 1 active actors on pipe
2025-10-10T14:35:03.021873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:03.022213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1542 sessionId: src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0 is DEAD
2025-10-10T14:35:03.022299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601583871873552:9272]
2025-10-10T14:35:03.022575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:03.022587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Write session will restart in 0.006662s
2025-10-10T14:35:03.022612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Write session: Do CDS request
2025-10-10T14:35:03.022621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:03.033808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.036145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:03.037504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:03.037519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1543
2025-10-10T14:35:03.038225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:03.038480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:03.038494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:03.038507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:03.038563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:03.038611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601587384616577:9002]
2025-10-10T14:35:03.039287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:03.039589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:03.039637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:03.039962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:03.040021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.040028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.040029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.040030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.040031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.040032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.040034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.040035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.040037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.040038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.040039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.040040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.040042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.040048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.040063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.040069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.040074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.040082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.040086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.040095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.040099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.040108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.040117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.040121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.040130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.040137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.040150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.040163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.040170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.040176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.040181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.040189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.040194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.040200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.040205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.040210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.040215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.040220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.040225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.040230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.040234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.040239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.040245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.040250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.040254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.040260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.040264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.040269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.040273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.040277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.040282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.040287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.040332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:03.042941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:03.043331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:03.043348Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:03.043350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:03.043354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:03.043361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1542 [2:7559601587384616577:9002]
2025-10-10T14:35:03.043375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:03.043399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:03.043406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.043410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.043412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.043429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:03.043445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:03.043459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:03.043523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.043532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.043534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.043538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:03.043605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:03.043613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.043651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.043667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.043687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:03.043715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166840850:2438], now have 1 active actors on pipe
2025-10-10T14:35:03.043724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601587384616572:9002]
2025-10-10T14:35:03.043726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601587384616572:9002]
2025-10-10T14:35:03.043728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601587384616572:9002]
2025-10-10T14:35:03.043744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:03.043758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:03.043769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:03.043774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:03.043778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:03.043782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:03.043784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:03.043803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601587384616572:9002]
2025-10-10T14:35:03.043816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:03.043832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:03.041529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.041580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:03.041585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:03.041589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:03.045526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1542
2025-10-10T14:35:03.046050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1543 sessionId:  describe result for acl check
2025-10-10T14:35:03.046087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:03.046089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:03.046091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:03.046098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601588166840959:9512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:03.046686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601588166840959:9512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:03.055564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601588166840959:9512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:03.062963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601588166840959:9512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:03.063008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601588166840959:9512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:03.063012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601588166840959:9512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:03.063024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:03.064473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:03.064497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:03.064501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:03.064503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:03.064511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601587384616572:9002]
2025-10-10T14:35:03.064515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601587384616572:9002]
2025-10-10T14:35:03.064519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601587384616572:9002]
2025-10-10T14:35:03.064567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:03.064578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.064581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:03.064597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:03.064611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:03.064614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:03.064716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:03.064807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1542
2025-10-10T14:35:03.121619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601588166841004:9272]
2025-10-10T14:35:03.121995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1542, pipe: [1:7559601588166841004:9272]
2025-10-10T14:35:03.176513Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:03.176891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166840991:9512], now have 1 active actors on pipe
2025-10-10T14:35:03.176929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.176940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.176986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841004:9272], now have 1 active actors on pipe
2025-10-10T14:35:03.177233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:03.177272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:03.177281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601588166841004:9272]
2025-10-10T14:35:03.177302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1543 reason: pipe to partition's 0 tablet is dead #2 sessionId: 
2025-10-10T14:35:03.177303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:03.177529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1543 sessionId:  is DEAD
2025-10-10T14:35:03.177879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:35:03.177888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Write session will restart in 0.016265s
2025-10-10T14:35:03.177917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Write session: Do CDS request
2025-10-10T14:35:03.177923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:03.195943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.196328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:03.196350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1544
2025-10-10T14:35:03.196599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.196637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:03.196640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:03.196644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:03.197170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1544 sessionId:  describe result for acl check
2025-10-10T14:35:03.197216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:03.197218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:03.197220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:03.197228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601588166841097:9525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:03.197845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601588166841097:9525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:03.198362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:03.202030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601588166841097:9525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:03.203410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:03.203674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:03.203682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:03.203696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:03.203784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:03.203847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601587384616712:9006]
2025-10-10T14:35:03.204449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:03.204844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:03.204900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:03.205217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:03.205290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.205296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.205297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.205299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.205300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.205301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.205303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.205304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.205305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.205306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.205308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.205309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.205310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.205317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.205371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.205375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.205379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.205383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.205388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.205392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.205396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.205400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.205405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.205410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.205414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.205418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.205427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.205436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.205456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.205462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.205467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.205472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.205477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.205483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.205487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.205493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.205498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.205503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.205508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.205513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.205518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.205523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.205528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.205535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.205539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.205545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.205550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.205556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.205560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.205565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.205570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.205575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.205617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:03.205892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601588166841097:9525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:03.205909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601588166841097:9525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:03.205913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601588166841097:9525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:03.205922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:03.211455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1543
2025-10-10T14:35:03.211481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1543
2025-10-10T14:35:03.210388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:03.211003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:03.211010Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:03.211013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:03.211018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:03.211025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1543 [2:7559601587384616712:9006]
2025-10-10T14:35:03.211039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:03.211077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:03.211083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.211087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.211090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.211107Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:03.211115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:03.211123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:03.211187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.211189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.211192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.211195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:03.211269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:03.211272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.211289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.211302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.211322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:03.211344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601587384616707:9006]
2025-10-10T14:35:03.211347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601587384616707:9006]
2025-10-10T14:35:03.211349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601587384616707:9006]
2025-10-10T14:35:03.211359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:03.211368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:03.211372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:03.211374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:03.211374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:03.211392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:03.211395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:03.211408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841131:9525], now have 1 active actors on pipe
2025-10-10T14:35:03.211412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841006:2438], now have 1 active actors on pipe
2025-10-10T14:35:03.211444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601587384616707:9006]
2025-10-10T14:35:03.211456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:03.211548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:03.211976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.211993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.212030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:03.212044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.212050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.212054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:03.212067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.212085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:03.212104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.212590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.212605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.212625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.212749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1544 partition: 0 MaxSeqNo: 40 sessionId: src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0
2025-10-10T14:35:03.213196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e30f933-2bc15331-d33b3ae5-ca368a23_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:03.215826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0] Write session: try to update token
2025-10-10T14:35:03.215846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:03.226060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:03.226083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:03.226095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601587384616707:9006]
2025-10-10T14:35:03.226152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:03.226371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:03.226557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:03.226709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:03.226877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:03.227150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:03.227202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:03.227634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:03.239596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId: src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:03.242244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:03.242475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.242503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.242550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:03.242668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:03.254230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:03.254254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:03.254257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:03.254260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:03.254271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601587384616707:9006]
2025-10-10T14:35:03.254275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601587384616707:9006]
2025-10-10T14:35:03.254279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601587384616707:9006]
2025-10-10T14:35:03.254332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:03.254332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:03.254338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:03.254344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.254344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:03.254346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:03.254481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:03.274702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601588166841138:9272]
2025-10-10T14:35:03.275033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1543, pipe: [1:7559601588166841138:9272]
2025-10-10T14:35:03.430465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:03.438837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.438872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.439068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.439135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.439201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.439280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.439582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.439597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.439666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.439733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.439799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.439868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.439914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.439922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.439991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.440053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.440120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.440185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.440230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.440237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.440307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.440374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.440440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.440503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.440549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.440557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.440625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.440690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.440755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.440821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.440866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.440875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.440942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.441006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.441068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.441132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.441183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.441197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.441270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.441354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.441421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.441485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.441525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.441535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.441602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.441659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.441724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.441786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.441829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.441837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.441902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.441966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.442693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:03.442717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:03.442727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:03.442753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1544 reason: error at write: Disconnected sessionId: src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0
2025-10-10T14:35:03.442783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601588166841138:9272]
2025-10-10T14:35:03.443010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1544 sessionId: src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0 is DEAD
2025-10-10T14:35:03.442031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.442100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.442138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.442141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.442206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.442260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.442318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.442375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.442416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.442419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.442488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841138:9272], now have 1 active actors on pipe
2025-10-10T14:35:03.443228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:03.443239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0] Write session will restart in 0.009278s
2025-10-10T14:35:03.443265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0] Write session: Do CDS request
2025-10-10T14:35:03.443273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:03.443455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:03.455973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.456057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:03.456072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1545
2025-10-10T14:35:03.456197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.456239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:03.456244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:03.456248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:03.456883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1545 sessionId:  describe result for acl check
2025-10-10T14:35:03.456920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:03.456922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:03.456923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:03.456929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601588166841232:9529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:03.456063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:03.457488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601588166841232:9529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:03.457857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:03.458074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:03.458084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:03.458096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:03.458167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:03.458215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601587384616841:9008]
2025-10-10T14:35:03.458789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:03.459089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:03.459138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:03.459494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:03.459554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.459561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.459562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.459563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.459564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.459565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.459566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.459567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.459568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.459569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.459570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.459571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.459572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.459578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.459589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.459593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.459596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.459600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.459604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.459609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.459613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.459617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.459621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.459625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.459629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.459633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.459640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.459650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.459657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.459663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.459669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.459675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.459679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.459685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.459690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.459696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.459701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.459707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.459712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.459718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.459728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.459733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.459738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.459742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.459747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.459753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.459758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.459769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.459774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.459783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.459789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.459798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.459838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:03.459940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601588166841232:9529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:03.462434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:03.462754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:03.462769Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:03.462772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:03.462776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:03.462783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1544 [2:7559601587384616841:9008]
2025-10-10T14:35:03.462764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601588166841232:9529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:03.462777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601588166841232:9529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:03.462781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601588166841232:9529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:03.462790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:03.462796Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:03.462823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:03.462826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.462831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.462834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.462852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:03.462861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:03.462870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:03.462926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.462934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.462936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.462939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:03.463017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:03.463030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.463043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.463056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.463076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:03.463106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841267:9529], now have 1 active actors on pipe
2025-10-10T14:35:03.463119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841141:2438], now have 1 active actors on pipe
2025-10-10T14:35:03.463127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601587384616836:9008]
2025-10-10T14:35:03.463091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1544
2025-10-10T14:35:03.463129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601587384616836:9008]
2025-10-10T14:35:03.463131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1544
2025-10-10T14:35:03.463132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601587384616836:9008]
2025-10-10T14:35:03.463141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:03.463156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:03.463163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:03.463167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:03.463169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:03.463180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:03.463184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:03.463202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.463207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.463239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601587384616836:9008]
2025-10-10T14:35:03.463248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:03.463268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:03.463281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.463281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:03.463285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.463287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:03.463300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.463315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:03.463362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.463505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.463514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.463529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.463607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1545 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0
2025-10-10T14:35:03.464016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41594d7d-b1bdb1b0-1c802b56-fff5570_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:03.466869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0] Write session: try to update token
2025-10-10T14:35:03.466890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:03.481492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId: src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:03.484304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:03.484053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:03.484076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:03.484080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:03.484082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:03.484092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601587384616836:9008]
2025-10-10T14:35:03.484097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601587384616836:9008]
2025-10-10T14:35:03.484102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601587384616836:9008]
2025-10-10T14:35:03.484155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:03.484165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.484167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:03.484314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:03.484431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:03.484437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:03.484441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:03.543006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601588166841274:9272]
2025-10-10T14:35:03.543312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1544, pipe: [1:7559601588166841274:9272]
2025-10-10T14:35:03.602365Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:03.602734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.602751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.602797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841274:9272], now have 1 active actors on pipe
2025-10-10T14:35:03.603024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:03.603071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601588166841274:9272]
2025-10-10T14:35:03.603121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:03.603213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1545 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0
2025-10-10T14:35:03.603273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:03.603569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:03.603585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0] Write session will restart in 0.007985s
2025-10-10T14:35:03.603611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0] Write session: Do CDS request
2025-10-10T14:35:03.603618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:03.603409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1545 sessionId: src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0 is DEAD
2025-10-10T14:35:03.612964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.613013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:03.613044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1546
2025-10-10T14:35:03.613187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.613234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:03.613250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:03.613254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:03.613769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1546 sessionId:  describe result for acl check
2025-10-10T14:35:03.613805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:03.613809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:03.613811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:03.613817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601588166841334:9533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:03.614465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601588166841334:9533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:03.616736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:03.617431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601588166841334:9533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:03.618649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:03.618888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:03.618900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:03.618911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:03.618975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:03.619018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601587384616971:9010]
2025-10-10T14:35:03.619600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:03.619885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:03.619906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601588166841334:9533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:03.619927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:03.619920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601588166841334:9533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:03.619923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601588166841334:9533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:03.619932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:03.620237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:03.620294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.620298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.620299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.620300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.620302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.620303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.620304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.620305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.620306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.620308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.620309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.620310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.620311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.620317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.620331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.620335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.620339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.620343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.620347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.620351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.620355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.620358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.620364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.620368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.620372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.620376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.620383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.620391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.620397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.620403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.620408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.620418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.620423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.620428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.620433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.620437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.620441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.620451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.620458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.620464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.620468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.620473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.620478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.620483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.620487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.620492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.620496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.620501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.620506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.620511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.620516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.620521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.620561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:03.623239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:03.623552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:03.623562Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:03.623563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:03.623566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:03.623571Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1545 [2:7559601587384616971:9010]
2025-10-10T14:35:03.623580Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:03.623592Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:03.623595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.623597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.623599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.623611Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:03.623620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:03.623626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:03.623677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.623683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.623684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.623686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:03.623751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:03.623759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.623769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.623781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.623802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:03.623824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841275:2438], now have 1 active actors on pipe
2025-10-10T14:35:03.623834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841399:9533], now have 1 active actors on pipe
2025-10-10T14:35:03.623841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601587384616966:9010]
2025-10-10T14:35:03.623843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601587384616966:9010]
2025-10-10T14:35:03.623846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601587384616966:9010]
2025-10-10T14:35:03.623859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:03.623872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:03.623875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:03.623877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:03.623877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:03.623893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:03.623897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:03.623929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601587384616966:9010]
2025-10-10T14:35:03.623932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:03.623898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1545
2025-10-10T14:35:03.623927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1545
2025-10-10T14:35:03.623958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:03.623964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.623970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.624003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:03.624017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.624026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.624028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:03.624038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.624055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:03.624073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.624256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.624266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.624283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.624430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1546 partition: 0 MaxSeqNo: 40 sessionId: src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0
2025-10-10T14:35:03.624887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec66fc9-70f44b98-43428fe0-4bcaa86a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:03.627655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0] Write session: try to update token
2025-10-10T14:35:03.627676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:03.642632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId: src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:03.645393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:03.645471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:03.645488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:03.645491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:03.645493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:03.645502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601587384616966:9010]
2025-10-10T14:35:03.645507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601587384616966:9010]
2025-10-10T14:35:03.645512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601587384616966:9010]
2025-10-10T14:35:03.645544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:03.645550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:03.645570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:03.645571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.645580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.645602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:03.645615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.645618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:03.645749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:03.703236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601588166841431:9272]
2025-10-10T14:35:03.703505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1545, pipe: [1:7559601588166841431:9272]
2025-10-10T14:35:03.764624Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:03.765088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841431:9272], now have 1 active actors on pipe
2025-10-10T14:35:03.765304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:03.766117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:03.766130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0] Write session will restart in 0.009862s
2025-10-10T14:35:03.766156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0] Write session: Do CDS request
2025-10-10T14:35:03.766163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:03.765598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:03.765656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:03.765753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1546 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0
2025-10-10T14:35:03.765969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1546 sessionId: src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0 is DEAD
2025-10-10T14:35:03.766150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601588166841431:9272]
2025-10-10T14:35:03.776933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.777050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:03.777068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1547
2025-10-10T14:35:03.777402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.777465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:03.777471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:03.777475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:03.778069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1547 sessionId:  describe result for acl check
2025-10-10T14:35:03.778113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:03.778115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:03.778117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:03.778123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601588166841483:9539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:03.778752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601588166841483:9539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:03.782808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:03.784820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:03.785028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:03.785041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:03.785053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:03.781799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601588166841483:9539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:03.785186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601588166841483:9539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:03.785193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601588166841483:9539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:03.785198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601588166841483:9539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:03.785207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:03.785106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:03.785149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601587384617116:9014]
2025-10-10T14:35:03.785828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:03.786313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:03.786359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:03.786690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:03.786741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.786742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.786744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.786745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.786746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.786747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.786749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.786750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.786751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.786752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.786754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.786755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.786756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.786762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.786776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.786780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.786785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.786789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.786794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.786798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.786802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.786807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.786812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.786816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.786820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.786824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.786832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.786841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.786849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.786856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.786861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.786867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.786871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.786877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.786882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.786888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.786894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.786900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.786905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.786910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.786915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.786921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.786926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.786932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.786937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.786943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.786961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.786967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.786971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.786977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.786983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.786988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.787031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:03.792007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:03.792650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:03.792655Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:03.792658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:03.792662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:03.792669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1546 [2:7559601587384617116:9014]
2025-10-10T14:35:03.792684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:03.792702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:03.792705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.792709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.792712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.792731Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:03.792739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:03.792747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:03.792809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.792811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.792813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.792816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:03.792892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:03.792900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.792913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.792926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.792945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:03.792969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841432:2438], now have 1 active actors on pipe
2025-10-10T14:35:03.792973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841555:9539], now have 1 active actors on pipe
2025-10-10T14:35:03.792981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601587384617111:9014]
2025-10-10T14:35:03.792983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601587384617111:9014]
2025-10-10T14:35:03.792985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601587384617111:9014]
2025-10-10T14:35:03.793002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:03.793015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:03.793034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:03.793037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:03.793039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:03.793043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:03.793045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:03.793070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601587384617111:9014]
2025-10-10T14:35:03.793086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:03.793091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:03.793564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.793575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.793608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:03.793618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.793622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.793625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:03.793637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.793649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:03.793664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.793950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.793959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.793975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.793209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1546
2025-10-10T14:35:03.793219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1546
2025-10-10T14:35:03.794291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1547 partition: 0 MaxSeqNo: 40 sessionId: src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0
2025-10-10T14:35:03.794715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd9db0f-a14ad9b8-7f1f4cce-8aaa42ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:03.798068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0] Write session: try to update token
2025-10-10T14:35:03.798089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:03.806430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:03.806449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:03.806460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601587384617111:9014]
2025-10-10T14:35:03.806510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:03.806682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:03.806819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:03.806942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:03.807090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:03.807280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:03.807319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:03.807857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:03.812615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId: src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:03.815173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:03.815418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.815444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.815496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:03.817513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:03.838918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:03.838940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:03.838987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:03.838989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:03.839002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601587384617111:9014]
2025-10-10T14:35:03.839007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601587384617111:9014]
2025-10-10T14:35:03.839011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601587384617111:9014]
2025-10-10T14:35:03.839063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:03.839076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.839079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:03.839211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:03.840481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:03.840496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:03.840503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:03.866075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601588166841567:9272]
2025-10-10T14:35:03.866453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1546, pipe: [1:7559601588166841567:9272]
2025-10-10T14:35:03.957978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:03.966258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.966288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.966475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.966543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.966610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.966674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.966724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.966743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.966814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.966878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.966982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.967055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.967101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.967109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.967177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.967240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.967305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.967369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.967634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.967648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.967719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.967794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.967856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.967914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.967954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.967959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.968029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.968088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.968147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.968206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.968247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.968250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.968315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.968373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.968433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.968491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.968531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.968534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.968600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.968657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.968717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.968781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.968822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.968826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.968892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.968945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.969005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.969064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.969105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.969109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.969175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.969235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.969293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.969383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.969423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.969426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.969488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:03.969541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:03.969607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:03.969671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:03.969719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:03.969729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:03.969794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841567:9272], now have 1 active actors on pipe
2025-10-10T14:35:03.970047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:03.970050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601588166841567:9272]
2025-10-10T14:35:03.970061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:03.970070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:03.970105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1547 reason: error at write: Disconnected sessionId: src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0
2025-10-10T14:35:03.970342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1547 sessionId: src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0 is DEAD
2025-10-10T14:35:03.970504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:03.970526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0] Write session will restart in 0.008696s
2025-10-10T14:35:03.970550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0] Write session: Do CDS request
2025-10-10T14:35:03.970556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:03.970715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:03.980957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.981043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:03.981067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1548
2025-10-10T14:35:03.981251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:03.981291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:03.981302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:03.981306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:03.981774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1548 sessionId:  describe result for acl check
2025-10-10T14:35:03.981812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:03.981816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:03.981819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:03.981826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601588166841653:9543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:03.982452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601588166841653:9543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:03.984158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:03.985683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601588166841653:9543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:03.986560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:03.986865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:03.986878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:03.986893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:03.986979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:03.987031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601587384617248:9016]
2025-10-10T14:35:03.987657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:03.988344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:03.988401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:03.988736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:03.988810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.988817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.988819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.988820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.988821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.988823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.988634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601588166841653:9543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:03.988647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601588166841653:9543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:03.988824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.988825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.988827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.988828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.988651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601588166841653:9543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:03.988830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.988831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.988832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.988660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:03.988839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.988855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.988860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.988864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.988869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.988874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.988878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.988883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.988888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.988893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.988897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.988901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.988906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.988913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.988923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:03.988929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.988935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:03.988941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.988947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:03.988951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.988957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:03.988962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.988968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:03.988973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.988979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:03.988984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.988990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:03.988994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.989000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:03.989005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.989011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:03.989016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.989022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:03.989027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.989033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.989037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.989044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.989049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.989054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.989096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:03.991536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:03.991863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:03.991878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:03.991880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:03.991885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:03.991890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1547 [2:7559601587384617248:9016]
2025-10-10T14:35:03.991904Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:03.991922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:03.991930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.991934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.991937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.991955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:03.991962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:03.991976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:03.992042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.992049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.992051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.992053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:03.992131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:03.992139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:03.992151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:03.992167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:03.992189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:03.992214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841573:2438], now have 1 active actors on pipe
2025-10-10T14:35:03.992223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601588166841696:9543], now have 1 active actors on pipe
2025-10-10T14:35:03.992231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601587384617243:9016]
2025-10-10T14:35:03.992234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601587384617243:9016]
2025-10-10T14:35:03.992237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601587384617243:9016]
2025-10-10T14:35:03.992258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:03.992282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:03.992256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1547
2025-10-10T14:35:03.992259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1547
2025-10-10T14:35:03.992283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:03.992286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:03.992288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:03.992304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:03.992308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:03.992333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601587384617243:9016]
2025-10-10T14:35:03.992337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:03.992339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:03.992360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.992364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.992415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:03.992422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:03.992431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:03.992434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:03.992445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:03.992457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:03.992479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.992642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:03.992651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:03.992669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:03.992750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1548 partition: 0 MaxSeqNo: 40 sessionId: src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0
2025-10-10T14:35:03.993160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cac4538-82d70f28-f0b80802-20e3ed3b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:03.995939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0] Write session: try to update token
2025-10-10T14:35:03.995957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:04.010777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId: src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:04.012067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:04.012086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:04.012090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:04.012093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:04.012104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601587384617243:9016]
2025-10-10T14:35:04.012109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601587384617243:9016]
2025-10-10T14:35:04.012113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601587384617243:9016]
2025-10-10T14:35:04.012162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:04.012166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:04.012169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:04.012173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:04.012174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.012177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:04.012333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:04.013790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:04.070356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601592461809001:9272]
2025-10-10T14:35:04.070788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1547, pipe: [1:7559601592461809001:9272]
2025-10-10T14:35:04.126740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:04.127163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.127176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.127237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809001:9272], now have 1 active actors on pipe
2025-10-10T14:35:04.129712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:04.129734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:04.129795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601592461809001:9272]
2025-10-10T14:35:04.130321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:04.130334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0] Write session will restart in 0.008092s
2025-10-10T14:35:04.130361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0] Write session: Do CDS request
2025-10-10T14:35:04.130372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:04.129837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:04.129845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:04.129902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1548 reason: error at write: Disconnected sessionId: src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0
2025-10-10T14:35:04.130152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1548 sessionId: src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0 is DEAD
2025-10-10T14:35:04.139912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.140293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:04.140308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1549
2025-10-10T14:35:04.140446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.140484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:04.140496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:04.140500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:04.141012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1549 sessionId:  describe result for acl check
2025-10-10T14:35:04.141058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:04.141065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:04.141067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:04.141075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601592461809030:9553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:04.141725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601592461809030:9553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:04.150240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601592461809030:9553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:04.152040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:04.154967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:04.155233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:04.155246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:04.155260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:04.155328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:04.154891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601592461809030:9553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:04.155375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601591679584716:9029]
2025-10-10T14:35:04.154908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601592461809030:9553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:04.154913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601592461809030:9553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:04.154922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:04.156000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:04.156392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:04.156461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:04.156789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:04.156868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.156875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.156877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.156878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.156880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.156881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.156882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.156883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.156885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.156886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.156887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.156889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.156890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.156896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.156911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.156915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.156920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.156924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.156928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.156932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.156936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.156941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.156945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.156949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.156953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.156958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.156967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.156976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.156984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.156990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.156994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.156999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.157013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.157019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.157024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.157030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.157034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.157040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.157045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.157050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.157055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.157061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.157066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.157071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.157078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.157083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.157090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.157102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.157107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.157117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.157123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.157129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.157191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:04.159602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:04.160052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:04.160067Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:04.160069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:04.160074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:04.160080Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1548 [2:7559601591679584716:9029]
2025-10-10T14:35:04.160093Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:04.160111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:04.160115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.160119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.160121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.160139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:04.160151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:04.160160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:04.160218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.160225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.160227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.160230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:04.160298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:04.160306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.160317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.160334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.160356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:04.160383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809153:9553], now have 1 active actors on pipe
2025-10-10T14:35:04.160391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809016:2438], now have 1 active actors on pipe
2025-10-10T14:35:04.160399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601591679584710:9029]
2025-10-10T14:35:04.160401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601591679584710:9029]
2025-10-10T14:35:04.160403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601591679584710:9029]
2025-10-10T14:35:04.160416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:04.160436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:04.160439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:04.160443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:04.160445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:04.160457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:04.160461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:04.160440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1548
2025-10-10T14:35:04.160481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1548
2025-10-10T14:35:04.160486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601591679584710:9029]
2025-10-10T14:35:04.160501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:04.160527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:04.160988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.161001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.161046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:04.161060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.161069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.161075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:04.161088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.161106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:04.161125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.163586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.163608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.163630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.163928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1549 partition: 0 MaxSeqNo: 40 sessionId: src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0
2025-10-10T14:35:04.164317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10d3cfb1-9a89df2e-7328a030-55f2ceb1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:04.166912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0] Write session: try to update token
2025-10-10T14:35:04.166947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:04.181175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:04.181199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:04.181203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:04.181205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:04.181216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601591679584710:9029]
2025-10-10T14:35:04.181220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601591679584710:9029]
2025-10-10T14:35:04.181223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601591679584710:9029]
2025-10-10T14:35:04.181282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:04.181281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:04.181295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.181298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:04.181300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:04.181305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:04.181480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:04.183725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId: src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:04.186573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:04.230106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601592461809164:9272]
2025-10-10T14:35:04.230457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1548, pipe: [1:7559601592461809164:9272]
2025-10-10T14:35:04.293824Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:04.294208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.294224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.294270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809164:9272], now have 1 active actors on pipe
2025-10-10T14:35:04.294492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601592461809164:9272]
2025-10-10T14:35:04.294509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:04.294513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:04.294540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:04.294588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1549 reason: error at write: Disconnected sessionId: src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0
2025-10-10T14:35:04.294775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1549 sessionId: src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0 is DEAD
2025-10-10T14:35:04.294477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:04.294947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:04.294967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0] Write session will restart in 0.006611s
2025-10-10T14:35:04.294993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0] Write session: Do CDS request
2025-10-10T14:35:04.295002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:04.302864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.302958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:04.302971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1550
2025-10-10T14:35:04.303091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.303123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:04.303133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:04.303137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:04.303587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1550 sessionId:  describe result for acl check
2025-10-10T14:35:04.303623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:04.303629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:04.303632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:04.303640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601592461809199:9560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:04.304181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601592461809199:9560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:04.306733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601592461809199:9560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:04.307064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:04.308996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:04.309221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:04.309238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:04.309251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:04.309307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:04.309363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601591679584849:9033]
2025-10-10T14:35:04.309620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601592461809199:9560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:04.309635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601592461809199:9560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:04.309639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601592461809199:9560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:04.309647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:04.309958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:04.310263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:04.310318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:04.310638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:04.310697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.310716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.310717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.310719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.310721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.310722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.310724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.310725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.310726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.310727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.310728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.310729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.310730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.310737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.310750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.310754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.310758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.310762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.310766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.310770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.310774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.310778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.310783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.310786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.310790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.310794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.310802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.310811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.310818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.310823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.310827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.310832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.310836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.310841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.310846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.310850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.310854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.310859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.310863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.310868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.310879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.310885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.310894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.310899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.310908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.310913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.310922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.310926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.310951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.310956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.310961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.310966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.311002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:04.313522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:04.314071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:04.314087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:04.314089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:04.314093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:04.314100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1549 [2:7559601591679584849:9033]
2025-10-10T14:35:04.314115Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:04.314132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:04.314136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.314140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.314146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.314166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:04.314174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:04.314182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:04.314247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.314254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.314256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.314259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:04.314328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:04.314335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.314348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.314361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.314382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:04.314410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809292:9560], now have 1 active actors on pipe
2025-10-10T14:35:04.314423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601591679584844:9033]
2025-10-10T14:35:04.314427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601591679584844:9033]
2025-10-10T14:35:04.314429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601591679584844:9033]
2025-10-10T14:35:04.314442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:04.314457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809165:2438], now have 1 active actors on pipe
2025-10-10T14:35:04.314460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:04.314463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:04.314465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:04.314466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:04.314481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:04.314484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:04.314480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1549
2025-10-10T14:35:04.314510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1549
2025-10-10T14:35:04.314522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601591679584844:9033]
2025-10-10T14:35:04.314536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:04.314557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.314559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:04.314571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.314626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28fea2e3-4b7c1555-241232c4-53535380_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:04.314638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.314645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.314653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:04.314664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.314674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:04.314699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.314860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.314875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.314901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.315022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1550 partition: 0 MaxSeqNo: 40 sessionId: src_id|28fea2e3-4b7c1555-241232c4-53535380_0
2025-10-10T14:35:04.315405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dcbff5a-5c973296-7f98d10a-1132864b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28fea2e3-4b7c1555-241232c4-53535380_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:04.318272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28fea2e3-4b7c1555-241232c4-53535380_0] Write session: try to update token
2025-10-10T14:35:04.318295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28fea2e3-4b7c1555-241232c4-53535380_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:04.332474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:04.332498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:04.332510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601591679584844:9033]
2025-10-10T14:35:04.332569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:04.332569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:04.332769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:04.332916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:04.333063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:04.333150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId: src_id|28fea2e3-4b7c1555-241232c4-53535380_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:04.333205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:04.333466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:04.333517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:04.336115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:04.336365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.336386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.336436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:04.336559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:04.347263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:04.347288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:04.347291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:04.347293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:04.347305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601591679584844:9033]
2025-10-10T14:35:04.347309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601591679584844:9033]
2025-10-10T14:35:04.347316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601591679584844:9033]
2025-10-10T14:35:04.347368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:04.347370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:04.347377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.347380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:04.347389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:04.347394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:04.347528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:04.394448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601592461809303:9272]
2025-10-10T14:35:04.394746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1549, pipe: [1:7559601592461809303:9272]
2025-10-10T14:35:04.456169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:04.462841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.462869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.463035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.463089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.463146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.463202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.463243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.463254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.463326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.463389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.463445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.463503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.463553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.463564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.463626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.463677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.463731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.463793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.463834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.463840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.463900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.463959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.464023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.464087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.464128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.464134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.464191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.464241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.464301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.464362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.464407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.464414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.464472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.464521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.464582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.464642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.464682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.464689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.464752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.464813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.464873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.464935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.464977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.464984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.465049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.465104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.465161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.465223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.465261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.465268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.465341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.465394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.465451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.465504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.465541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.465547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.465607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:04.465659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:04.465711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:04.465764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:04.465804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:04.465811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:04.465858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809303:9272], now have 1 active actors on pipe
2025-10-10T14:35:04.466097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:04.466101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:04.466111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:04.466137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601592461809303:9272]
2025-10-10T14:35:04.466141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1550 reason: error at write: Disconnected sessionId: src_id|28fea2e3-4b7c1555-241232c4-53535380_0
2025-10-10T14:35:04.466344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1550 sessionId: src_id|28fea2e3-4b7c1555-241232c4-53535380_0 is DEAD
2025-10-10T14:35:04.466502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28fea2e3-4b7c1555-241232c4-53535380_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:04.466509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28fea2e3-4b7c1555-241232c4-53535380_0] Write session will restart in 0.009640s
2025-10-10T14:35:04.466541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28fea2e3-4b7c1555-241232c4-53535380_0] Write session: Do CDS request
2025-10-10T14:35:04.466546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28fea2e3-4b7c1555-241232c4-53535380_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:04.466646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:04.476901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28fea2e3-4b7c1555-241232c4-53535380_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.477011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:04.477026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1551
2025-10-10T14:35:04.477166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.477201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:04.477211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:04.477215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:04.477921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1551 sessionId:  describe result for acl check
2025-10-10T14:35:04.477962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:04.477966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:04.477968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:04.477974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601592461809403:9564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:04.477995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:04.478542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601592461809403:9564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:04.479809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:04.480009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:04.480021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:04.480033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:04.480099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:04.480138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601591679584984:9035]
2025-10-10T14:35:04.480738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:04.480999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:04.481040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:04.481278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601592461809403:9564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:04.481355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:04.481407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.481414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.481415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.481415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.481416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.481417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.481418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.481419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.481421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.481422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.481423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.481424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.481425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.481430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.481442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.481447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.481451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.481454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.481458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.481462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.481466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.481470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.481474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.481478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.481482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.481486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.481493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.481501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.481508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.481514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.481518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.481523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.481527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.481532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.481537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.481542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.481546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.481551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.481556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.481561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.481565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.481570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.481580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.481585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.481589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.481599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.481604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.481613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.481617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.481622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.481632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.481637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.481677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:04.483874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601592461809403:9564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:04.483888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601592461809403:9564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:04.483892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601592461809403:9564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:04.483901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:04.483981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:04.484440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:04.484454Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:04.484456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:04.484459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:04.484465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1550 [2:7559601591679584984:9035]
2025-10-10T14:35:04.484477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:04.484495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:04.484503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.484507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.484512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.484529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:04.484541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:04.484548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:04.484603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.484611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.484613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.484615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:04.484678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:04.484689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.484700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.484712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.484727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:04.484748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809305:2438], now have 1 active actors on pipe
2025-10-10T14:35:04.484757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809436:9564], now have 1 active actors on pipe
2025-10-10T14:35:04.484764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601591679584978:9035]
2025-10-10T14:35:04.484767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601591679584978:9035]
2025-10-10T14:35:04.484769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601591679584978:9035]
2025-10-10T14:35:04.484781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:04.484796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:04.484808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:04.484782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1550
2025-10-10T14:35:04.484813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:04.484816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:04.484808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1550
2025-10-10T14:35:04.484817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:04.484820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:04.484861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.484870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.484885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601591679584978:9035]
2025-10-10T14:35:04.484893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:04.484913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:04.484925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:04.484933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.484942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.484944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:04.484955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.484969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:04.484997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.485145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.485158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.485180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.485283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1551 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0
2025-10-10T14:35:04.485666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28fea2e3-4b7c1555-241232c4-53535380_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:04.488359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0] Write session: try to update token
2025-10-10T14:35:04.488378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:04.502990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId: src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:04.503786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:04.503807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:04.503810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:04.503812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:04.503821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601591679584978:9035]
2025-10-10T14:35:04.503825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601591679584978:9035]
2025-10-10T14:35:04.503829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601591679584978:9035]
2025-10-10T14:35:04.503879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:04.503880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:04.503891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.503893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:04.503898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:04.503903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:04.504032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:04.505452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:04.566473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601592461809448:9272]
2025-10-10T14:35:04.566766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1550, pipe: [1:7559601592461809448:9272]
2025-10-10T14:35:04.615879Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:04.616261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.616271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.616315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809448:9272], now have 1 active actors on pipe
2025-10-10T14:35:04.616711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601592461809448:9272]
2025-10-10T14:35:04.616628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:04.616939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:04.617037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:04.617057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1551 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0
2025-10-10T14:35:04.617263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1551 sessionId: src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0 is DEAD
2025-10-10T14:35:04.617600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:04.617614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0] Write session will restart in 0.008039s
2025-10-10T14:35:04.617640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0] Write session: Do CDS request
2025-10-10T14:35:04.617647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:04.626891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.626979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:04.626993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1552
2025-10-10T14:35:04.627172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.627209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:04.627221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:04.627226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:04.627680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1552 sessionId:  describe result for acl check
2025-10-10T14:35:04.627727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:04.627733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:04.627739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:04.627745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601592461809465:9568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:04.628308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601592461809465:9568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:04.630909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601592461809465:9568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:04.633375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:04.633702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601592461809465:9568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:04.633715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601592461809465:9568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:04.633719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601592461809465:9568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:04.633727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:04.635417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:04.635684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:04.635699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:04.635713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:04.635784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:04.635840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601591679585132:9037]
2025-10-10T14:35:04.636440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:04.636829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:04.636888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:04.637230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:04.637291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.637297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.637299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.637300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.637301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.637302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.637303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.637304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.637305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.637308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.637309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.637310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.637311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.637316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.637328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.637345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.637349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.637353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.637357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.637361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.637365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.637369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.637373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.637377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.637381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.637385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.637391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.637400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.637406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.637411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.637415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.637419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.637422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.637427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.637431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.637435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.637438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.637442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.637449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.637459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.637463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.637467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.637471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.637476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.637479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.637483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.637487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.637491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.637494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.637509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.637517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.637522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.637560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:04.640110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:04.640652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:04.640667Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:04.640670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:04.640674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:04.640681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1551 [2:7559601591679585132:9037]
2025-10-10T14:35:04.640694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:04.640713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:04.640717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.640720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.640723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.640743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:04.640757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:04.640769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:04.640841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.640847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.640850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.640852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:04.640915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:04.640923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.640935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.640951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.640973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:04.641000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809579:9568], now have 1 active actors on pipe
2025-10-10T14:35:04.641009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809449:2438], now have 1 active actors on pipe
2025-10-10T14:35:04.641017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601591679585116:9037]
2025-10-10T14:35:04.641023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601591679585116:9037]
2025-10-10T14:35:04.641025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601591679585116:9037]
2025-10-10T14:35:04.641039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:04.641054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:04.641058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:04.641059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:04.641060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:04.641075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:04.641085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:04.641127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.641138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.641033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1551
2025-10-10T14:35:04.641152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601591679585116:9037]
2025-10-10T14:35:04.641069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1551
2025-10-10T14:35:04.641165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:04.641177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:04.641196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:04.641207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.641213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.641215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:04.641226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.641244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:04.641270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.641453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.641466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.641487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.641605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1552 partition: 0 MaxSeqNo: 40 sessionId: src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0
2025-10-10T14:35:04.642075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca7c887f-521964df-ffeda45c-d1f74c71_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:04.644781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0] Write session: try to update token
2025-10-10T14:35:04.644801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:04.664053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:04.664075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:04.664079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:04.664081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:04.664091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601591679585116:9037]
2025-10-10T14:35:04.664096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601591679585116:9037]
2025-10-10T14:35:04.664100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601591679585116:9037]
2025-10-10T14:35:04.664151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:04.664159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.664163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:04.664303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:04.666844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId: src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:04.668281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:04.668303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:04.668307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:04.669699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:04.716463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601592461809612:9272]
2025-10-10T14:35:04.716809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1551, pipe: [1:7559601592461809612:9272]
2025-10-10T14:35:04.779595Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:04.779883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.779895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.779942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809612:9272], now have 1 active actors on pipe
2025-10-10T14:35:04.780395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:04.780767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601592461809612:9272]
2025-10-10T14:35:04.780795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:04.780825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:04.780828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:04.780887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1552 reason: error at write: Disconnected sessionId: src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0
2025-10-10T14:35:04.781087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1552 sessionId: src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0 is DEAD
2025-10-10T14:35:04.781283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:04.781296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0] Write session will restart in 0.006416s
2025-10-10T14:35:04.781323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0] Write session: Do CDS request
2025-10-10T14:35:04.781346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:04.788793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.797478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:04.797495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1553
2025-10-10T14:35:04.801501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.801555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:04.801561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:04.801567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:04.805739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1553 sessionId:  describe result for acl check
2025-10-10T14:35:04.805786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:04.805788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:04.805789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:04.805797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601592461809714:9574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:04.806354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601592461809714:9574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:04.806233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:04.808886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:04.809115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:04.809121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:04.809134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:04.809185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:04.809219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601591679585272:9041]
2025-10-10T14:35:04.809835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:04.810196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:04.810231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:04.810536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:04.810584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.810585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.810586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.810587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.810589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.810590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.810591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.810592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.810593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.810595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.810596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.810597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.810599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.810605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.810618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.810623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.810627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.810630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.810634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.810638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.810642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.810646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.810650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.810654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.810658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.810662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.810670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.810679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:04.810686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.810690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:04.810696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.810701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:04.810705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.810709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:04.810713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.810718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:04.810722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.810727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:04.810732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.810736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:04.810740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.810745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:04.810749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.810754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:04.810758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.810763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:04.810767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.810772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.810777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.810784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.810788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.810793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.810834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:04.813281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:04.813801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:04.813815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:04.813817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:04.813821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:04.813827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1552 [2:7559601591679585272:9041]
2025-10-10T14:35:04.813839Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:04.813859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:04.813862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.813866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.813868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.813886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:04.813899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:04.813906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:04.813975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.813983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.813985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.813987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:04.814058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:04.814067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.814078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:04.814090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:04.814113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:04.814139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809613:2438], now have 1 active actors on pipe
2025-10-10T14:35:04.814152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601591679585266:9041]
2025-10-10T14:35:04.814155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601591679585266:9041]
2025-10-10T14:35:04.814157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601591679585266:9041]
2025-10-10T14:35:04.814171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:04.814154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1552
2025-10-10T14:35:04.814183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:04.814186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:04.814187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:04.814187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:04.814205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:04.814211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:04.814242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601591679585266:9041]
2025-10-10T14:35:04.814253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:04.814272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:04.815686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601592461809714:9574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:04.821055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601592461809714:9574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:04.821074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601592461809714:9574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:04.821078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601592461809714:9574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:04.821088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:04.821416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809752:9574], now have 1 active actors on pipe
2025-10-10T14:35:04.821471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1552
2025-10-10T14:35:04.821558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.821576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.821613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:04.821631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:04.821638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:04.821641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:04.821667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:04.821688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:04.821711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.822013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.822021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.822039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:04.822175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1553 partition: 0 MaxSeqNo: 40 sessionId: src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0
2025-10-10T14:35:04.822634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6b3f8ca-dde6f359-22b68cdf-25a8cc00_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:04.825460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0] Write session: try to update token
2025-10-10T14:35:04.825481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:04.831717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:04.831736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:04.831746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601591679585266:9041]
2025-10-10T14:35:04.831795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:04.831824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:04.831964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:04.832100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:04.832235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:04.832372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:04.832581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:04.832616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:04.846745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:04.846769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:04.846773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:04.846777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:04.846789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601591679585266:9041]
2025-10-10T14:35:04.846792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601591679585266:9041]
2025-10-10T14:35:04.846795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601591679585266:9041]
2025-10-10T14:35:04.846843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:04.846844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:04.846850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:04.846852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:04.846852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:04.846857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:04.847005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:04.847875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId: src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:04.850350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:04.880862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601592461809755:9272]
2025-10-10T14:35:04.881214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1552, pipe: [1:7559601592461809755:9272]
2025-10-10T14:35:04.962596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:04.962998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:04.963009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:04.963034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809755:9272], now have 1 active actors on pipe
2025-10-10T14:35:04.963897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:04.963910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0] Write session will restart in 0.007776s
2025-10-10T14:35:04.963943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0] Write session: Do CDS request
2025-10-10T14:35:04.963951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:04.963319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:04.963402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601592461809755:9272]
2025-10-10T14:35:04.963436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:04.963439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:04.963504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1553 reason: error at write: Disconnected sessionId: src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0
2025-10-10T14:35:04.963634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:04.963734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1553 sessionId: src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0 is DEAD
2025-10-10T14:35:04.972874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.973232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:04.973249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1554
2025-10-10T14:35:04.973404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:04.973451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:04.973458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:04.973472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:04.974083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1554 sessionId:  describe result for acl check
2025-10-10T14:35:04.974123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:04.974128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:04.974130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:04.974137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601592461809768:9578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:04.974739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601592461809768:9578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:04.978011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601592461809768:9578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:04.986169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601592461809768:9578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:04.986188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601592461809768:9578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:04.986192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601592461809768:9578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:04.986202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:04.998585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:05.003356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:05.003573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:05.003577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:05.003586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:05.003630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:05.003659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601595974552707:9043]
2025-10-10T14:35:05.004049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:05.004550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:05.004594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:05.004809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:05.004849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.004854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.004855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.004856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.004857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.004857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.004858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.004859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.004860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.004861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.004861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.004862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.004863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.004867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.004876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.004879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.004881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.004883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.004885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.004887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.004889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.004892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.004894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.004896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.004899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.004901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.004906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.004912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.004917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.004921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.004924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.004927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.004930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.004933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.004937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.004941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.004943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.004947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.004950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.004953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.004956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.004959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.004962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.004965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.004968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.004971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.004974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.004978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.004981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.004984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.004986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.004990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.005015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:05.011056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1553
2025-10-10T14:35:05.011104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1553
2025-10-10T14:35:05.010312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:05.010627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:05.010633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:05.010635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:05.010640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:05.010647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1553 [2:7559601595974552707:9043]
2025-10-10T14:35:05.010661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:05.010682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:05.010685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.010690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.010692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.010710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:05.010719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:05.010727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:05.010784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.010786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.010789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.010792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:05.010865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:05.010868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.010880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.010893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.010925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:05.010947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601591679585405:9043]
2025-10-10T14:35:05.010949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601591679585405:9043]
2025-10-10T14:35:05.010952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601591679585405:9043]
2025-10-10T14:35:05.010961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:05.010971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:05.010977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:05.010978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:05.010980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:05.010992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:05.010995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:05.011006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809801:9578], now have 1 active actors on pipe
2025-10-10T14:35:05.011010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601592461809759:2438], now have 1 active actors on pipe
2025-10-10T14:35:05.011040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601591679585405:9043]
2025-10-10T14:35:05.011062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:05.011078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:05.011372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.011397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.011435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:05.011451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.011456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.011463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:05.011478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.011495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:05.011514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.011823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.011834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.011855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.012182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1554 partition: 0 MaxSeqNo: 40 sessionId: src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0
2025-10-10T14:35:05.012580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a43d45c-ecb60883-c8073dbc-a801a993_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:05.015505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0] Write session: try to update token
2025-10-10T14:35:05.015527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:05.031864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId: src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:05.034678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:05.035458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:05.035481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:05.035484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:05.035487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:05.035497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601591679585405:9043]
2025-10-10T14:35:05.035501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601591679585405:9043]
2025-10-10T14:35:05.035504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601591679585405:9043]
2025-10-10T14:35:05.035556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:05.035564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.035569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:05.035712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:05.036754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:05.036778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:05.036784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:05.063640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601596756777194:9272]
2025-10-10T14:35:05.063989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1553, pipe: [1:7559601596756777194:9272]
2025-10-10T14:35:05.160438Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:05.160908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.160927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.160974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777194:9272], now have 1 active actors on pipe
2025-10-10T14:35:05.161200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:05.161232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601596756777194:9272]
2025-10-10T14:35:05.161867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:05.161275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:05.161880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0] Write session will restart in 0.007312s
2025-10-10T14:35:05.161419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0
2025-10-10T14:35:05.161614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1554 sessionId: src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0 is DEAD
2025-10-10T14:35:05.161905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0] Write session: Do CDS request
2025-10-10T14:35:05.161798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:05.161911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:05.171022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.171071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:05.171088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1555
2025-10-10T14:35:05.171259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.171296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:05.171301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:05.171305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:05.171682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1555 sessionId:  describe result for acl check
2025-10-10T14:35:05.171718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:05.171725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:05.171726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:05.171731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601596756777250:9588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:05.172304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601596756777250:9588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:05.174984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601596756777250:9588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:05.176577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:05.178777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:05.179079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601596756777250:9588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:05.179098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601596756777250:9588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:05.179101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601596756777250:9588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:05.179111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:05.179003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:05.179016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:05.179027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:05.179084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:05.179133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601595974552876:9056]
2025-10-10T14:35:05.179769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:05.180073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:05.180118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:05.180466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:05.180537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.180548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.180549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.180550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.180551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.180552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.180554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.180555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.180556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.180557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.180558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.180559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.180560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.180567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.180579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.180583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.180587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.180591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.180595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.180599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.180603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.180607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.180611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.180615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.180619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.180623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.180629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.180639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.180646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.180652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.180656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.180662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.180666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.180671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.180676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.180681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.180686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.180690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.180695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.180701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.180705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.180710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.180715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.180721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.180725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.180730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.180734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.180739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.180743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.180748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.180753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.180760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.180800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:05.183448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:05.183978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:05.183992Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:05.183994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:05.183999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:05.184005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1554 [2:7559601595974552876:9056]
2025-10-10T14:35:05.184018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:05.184038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:05.184047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.184051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.184053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.184071Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:05.184084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:05.184092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:05.184160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.184168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.184169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.184172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:05.184251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:05.184260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.184273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.184288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.184307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:05.184339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777213:2438], now have 1 active actors on pipe
2025-10-10T14:35:05.184356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601595974552871:9056]
2025-10-10T14:35:05.184359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601595974552871:9056]
2025-10-10T14:35:05.184361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601595974552871:9056]
2025-10-10T14:35:05.184378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:05.184387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777340:9588], now have 1 active actors on pipe
2025-10-10T14:35:05.184390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:05.184393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:05.184395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:05.184396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:05.184413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:05.184417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:05.184445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601595974552871:9056]
2025-10-10T14:35:05.184450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:05.184464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1554
2025-10-10T14:35:05.184505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1554
2025-10-10T14:35:05.184508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:05.184687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.184702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.184734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:05.184748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.184752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.184755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:05.184768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.184786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:05.184802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.185129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.185140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.185161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.185293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1555 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0
2025-10-10T14:35:05.185727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|240fbf14-f7a544c7-540df7eb-9271c79e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:05.188414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0] Write session: try to update token
2025-10-10T14:35:05.188437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:05.205145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:05.205170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:05.205174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:05.205175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:05.205186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601595974552871:9056]
2025-10-10T14:35:05.205190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601595974552871:9056]
2025-10-10T14:35:05.205193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601595974552871:9056]
2025-10-10T14:35:05.205237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:05.205244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:05.205252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.205255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:05.205262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:05.205269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:05.205421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:05.208391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId: src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:05.211289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:05.261264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601596756777363:9272]
2025-10-10T14:35:05.261553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1554, pipe: [1:7559601596756777363:9272]
2025-10-10T14:35:05.330536Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:05.331022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.331044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.331094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777363:9272], now have 1 active actors on pipe
2025-10-10T14:35:05.331451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:05.331459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:05.331464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:05.331506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601596756777363:9272]
2025-10-10T14:35:05.331547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1555 reason: error at write: Disconnected sessionId: src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0
2025-10-10T14:35:05.331555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:05.331755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1555 sessionId: src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0 is DEAD
2025-10-10T14:35:05.331913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:05.331922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0] Write session will restart in 0.005761s
2025-10-10T14:35:05.331945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0] Write session: Do CDS request
2025-10-10T14:35:05.331954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:05.339289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.339395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:05.339413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1556
2025-10-10T14:35:05.339680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.339726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:05.339739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:05.339748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:05.340253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1556 sessionId:  describe result for acl check
2025-10-10T14:35:05.340292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:05.340299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:05.340302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:05.340309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601596756777381:9595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:05.340887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601596756777381:9595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:05.347040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:05.349387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:05.346187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601596756777381:9595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:05.349637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:05.349649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:05.349660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:05.349719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:05.349780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601595974553023:9060]
2025-10-10T14:35:05.350416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:05.350936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:05.350990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:05.351346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:05.351422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.351428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.351430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.351431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.351432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.351433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.351434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.351435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.351436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.351437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.351438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.351439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.351441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.351447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.351461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.351464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.351469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.351473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.351477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.351481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.351485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.351489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.351493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.351496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.351499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.351503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.351512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.351521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.351527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.351533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.351537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.351542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.351546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.351550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.351556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.351561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.351565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.351581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.351585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.351590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.351594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.351599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.351603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.351608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.351612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.351617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.351623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.351628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.351633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.351638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.351650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.351656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.351693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:05.351554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601596756777381:9595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:05.351569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601596756777381:9595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:05.351573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601596756777381:9595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:05.351583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:05.355672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1555
2025-10-10T14:35:05.355674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1555
2025-10-10T14:35:05.354561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:05.355153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:05.355159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:05.355161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:05.355165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:05.355173Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1555 [2:7559601595974553023:9060]
2025-10-10T14:35:05.355189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:05.355210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:05.355214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.355218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.355220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.355242Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:05.355251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:05.355259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:05.355329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.355332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.355334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.355337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:05.355418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:05.355422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.355437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.355450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.355469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:05.355497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601595974553018:9060]
2025-10-10T14:35:05.355499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601595974553018:9060]
2025-10-10T14:35:05.355501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601595974553018:9060]
2025-10-10T14:35:05.355512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:05.355521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:05.355525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:05.355527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:05.355531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777500:9595], now have 1 active actors on pipe
2025-10-10T14:35:05.355534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777366:2438], now have 1 active actors on pipe
2025-10-10T14:35:05.355540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:05.355557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:05.355561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:05.355599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601595974553018:9060]
2025-10-10T14:35:05.355609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:05.355836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:05.356018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.356037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.356073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:05.356083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.356088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.356091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:05.356108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.356122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:05.356139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.357587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1556 partition: 0 MaxSeqNo: 40 sessionId: src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0
2025-10-10T14:35:05.358006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77a3c6-6fbadb35-8e1d0acb-e0d1e40e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:05.356838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.356853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.356885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.360729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0] Write session: try to update token
2025-10-10T14:35:05.360748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:05.378021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:05.378044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:05.378048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:05.378050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:05.378061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601595974553018:9060]
2025-10-10T14:35:05.378065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601595974553018:9060]
2025-10-10T14:35:05.378070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601595974553018:9060]
2025-10-10T14:35:05.378112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:05.378120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.378123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:05.378265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:05.381505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:05.381530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:05.381535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:05.379759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId: src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:05.382608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:05.431746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601596756777509:9272]
2025-10-10T14:35:05.432044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1555, pipe: [1:7559601596756777509:9272]
2025-10-10T14:35:05.490676Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:05.490998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.491015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.491062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777509:9272], now have 1 active actors on pipe
2025-10-10T14:35:05.491428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601596756777509:9272]
2025-10-10T14:35:05.491460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:05.491461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:05.491465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:05.491541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1556 reason: error at write: Disconnected sessionId: src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0
2025-10-10T14:35:05.491510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:05.491763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1556 sessionId: src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0 is DEAD
2025-10-10T14:35:05.491920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:05.491930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0] Write session will restart in 0.009268s
2025-10-10T14:35:05.491964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0] Write session: Do CDS request
2025-10-10T14:35:05.491974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:05.502974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.503098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:05.503114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1557
2025-10-10T14:35:05.503239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.503292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:05.503303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:05.503307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:05.503735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1557 sessionId:  describe result for acl check
2025-10-10T14:35:05.503770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:05.503777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:05.503781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:05.503788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601596756777527:9599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:05.504384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601596756777527:9599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:05.506802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601596756777527:9599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:05.512573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601596756777527:9599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:05.512599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601596756777527:9599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:05.512603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601596756777527:9599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:05.512612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:05.515376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:05.517937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:05.518194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:05.518207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:05.518221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:05.518295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:05.518341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601595974553165:9062]
2025-10-10T14:35:05.518967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:05.519300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:05.519372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:05.519721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:05.519789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.519797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.519798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.519799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.519801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.519802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.519804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.519805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.519806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.519808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.519809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.519810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.519811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.519818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.519832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.519836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.519841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.519844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.519849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.519854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.519857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.519862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.519867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.519871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.519874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.519879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.519887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.519896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.519908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.519915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.519920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.519926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.519935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.519940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.519945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.519951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.519962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.519969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.519981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.519986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.519996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.520002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.520015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.520025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.520029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.520037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.520046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.520051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.520056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.520061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.520066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.520071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.520110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:05.522717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:05.523092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:05.523105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:05.523108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:05.523111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:05.523118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1556 [2:7559601595974553165:9062]
2025-10-10T14:35:05.523131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:05.523149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:05.523153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.523157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.523159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.523177Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:05.523221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:05.523235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:05.523304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.523312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.523314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.523317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:05.523383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:05.523390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.523401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.523413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.523433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:05.523460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777616:9599], now have 1 active actors on pipe
2025-10-10T14:35:05.523473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601595974553160:9062]
2025-10-10T14:35:05.523479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601595974553160:9062]
2025-10-10T14:35:05.523481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601595974553160:9062]
2025-10-10T14:35:05.523496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:05.523506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777511:2438], now have 1 active actors on pipe
2025-10-10T14:35:05.523518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:05.523541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:05.523548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:05.523552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:05.523562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:05.523565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:05.523579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601595974553160:9062]
2025-10-10T14:35:05.523582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:05.523584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:05.523598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.523611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.523550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1556
2025-10-10T14:35:05.523587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1556
2025-10-10T14:35:05.523667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:05.523680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.523684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.523686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:05.523697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.523708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:05.523731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.523885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.523891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.523905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.524033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1557 partition: 0 MaxSeqNo: 40 sessionId: src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0
2025-10-10T14:35:05.529490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c06478-7bd7c626-4fa784ee-75f0414e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:05.532118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0] Write session: try to update token
2025-10-10T14:35:05.532141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:05.542713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:05.542735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:05.542739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:05.542741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:05.542753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601595974553160:9062]
2025-10-10T14:35:05.542759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601595974553160:9062]
2025-10-10T14:35:05.542762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601595974553160:9062]
2025-10-10T14:35:05.542817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:05.542828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.542831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:05.542838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:05.542839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:05.542843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:05.542996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:05.548539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId: src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:05.551185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:05.591500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601596756777655:9272]
2025-10-10T14:35:05.591836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1556, pipe: [1:7559601596756777655:9272]
2025-10-10T14:35:05.653485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:05.653796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.653813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.653859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777655:9272], now have 1 active actors on pipe
2025-10-10T14:35:05.654076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:05.654111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:05.654127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601596756777655:9272]
2025-10-10T14:35:05.654131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:05.654134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:05.654587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:05.654602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0] Write session will restart in 0.008229s
2025-10-10T14:35:05.654200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1557 reason: error at write: Disconnected sessionId: src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0
2025-10-10T14:35:05.654418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1557 sessionId: src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0 is DEAD
2025-10-10T14:35:05.654627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0] Write session: Do CDS request
2025-10-10T14:35:05.654647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:05.664001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.664086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:05.664100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1558
2025-10-10T14:35:05.664287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.664334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:05.664340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:05.664343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:05.664851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1558 sessionId:  describe result for acl check
2025-10-10T14:35:05.664890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:05.664898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:05.664900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:05.664907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601596756777741:9605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:05.665515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601596756777741:9605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:05.667855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601596756777741:9605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:05.667920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:05.670585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601596756777741:9605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:05.670600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601596756777741:9605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:05.670604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601596756777741:9605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:05.670613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:05.669928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:05.670157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:05.670162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:05.670174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:05.670227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:05.670264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601595974553318:9065]
2025-10-10T14:35:05.670899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:05.671188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:05.671245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:05.671588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:05.671656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.671664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.671665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.671666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.671667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.671669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.671670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.671671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.671673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.671674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.671676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.671677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.671678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.671685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.671699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.671703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.671708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.671713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.671717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.671722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.671726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.671731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.671737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.671742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.671746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.671751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.671758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.671769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.671780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.671787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.671794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.671800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.671810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.671816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.671825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.671831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.671836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.671846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.671852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.671859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.671868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.671874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.671882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.671888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.671898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.671904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.671913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.671919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.671928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.671934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.671941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.671950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.671994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:05.674583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:05.675110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:05.675125Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:05.675127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:05.675131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:05.675137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1557 [2:7559601595974553318:9065]
2025-10-10T14:35:05.675151Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:05.675169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:05.675177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.675181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.675183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.675200Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:05.675212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:05.675225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:05.675287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.675295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.675297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.675300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:05.675369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:05.675378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.675390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.675403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.675423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:05.675450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777676:2438], now have 1 active actors on pipe
2025-10-10T14:35:05.675458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777810:9605], now have 1 active actors on pipe
2025-10-10T14:35:05.675466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601595974553313:9065]
2025-10-10T14:35:05.675473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601595974553313:9065]
2025-10-10T14:35:05.675476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601595974553313:9065]
2025-10-10T14:35:05.675490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:05.675509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:05.675531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:05.675540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:05.675564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601595974553313:9065]
2025-10-10T14:35:05.675571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:05.675585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1557
2025-10-10T14:35:05.675627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1557
2025-10-10T14:35:05.675711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:05.675721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:05.675723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:05.675730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:05.675802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.675808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.675842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:05.675850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.675855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.675858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:05.675869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.675881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:05.675897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.676303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.676312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.676329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.676450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1558 partition: 0 MaxSeqNo: 40 sessionId: src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0
2025-10-10T14:35:05.676825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83143e60-ef0f7809-c27b52fe-ae37dedd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:05.679852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0] Write session: try to update token
2025-10-10T14:35:05.679871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:05.698987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:05.699012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:05.699016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:05.699018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:05.699028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601595974553313:9065]
2025-10-10T14:35:05.699034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601595974553313:9065]
2025-10-10T14:35:05.699038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601595974553313:9065]
2025-10-10T14:35:05.699096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:05.699107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.699110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:05.699152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:05.699166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:05.699171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:05.699249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:05.702835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId: src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:05.705391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:05.754326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601596756777824:9272]
2025-10-10T14:35:05.754693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1557, pipe: [1:7559601596756777824:9272]
2025-10-10T14:35:05.821466Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:05.821771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.821782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.821832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777824:9272], now have 1 active actors on pipe
2025-10-10T14:35:05.822073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:05.822494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601596756777824:9272]
2025-10-10T14:35:05.822521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:05.822555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:05.822620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1558 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0
2025-10-10T14:35:05.822826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1558 sessionId: src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0 is DEAD
2025-10-10T14:35:05.825575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:05.825588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0] Write session will restart in 0.006047s
2025-10-10T14:35:05.825624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0] Write session: Do CDS request
2025-10-10T14:35:05.825630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:05.833947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.834027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:05.834046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1559
2025-10-10T14:35:05.834251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:05.834281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:05.834288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:05.834293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:05.834781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1559 sessionId:  describe result for acl check
2025-10-10T14:35:05.834815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:05.834829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:05.834831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:05.834839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601596756777840:9609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:05.835421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601596756777840:9609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:05.838229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601596756777840:9609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:05.841753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601596756777840:9609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:05.841771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601596756777840:9609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:05.841774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601596756777840:9609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:05.841784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:05.842446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:05.844971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:05.845232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:05.845243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:05.845257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:05.845317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:05.845390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601595974553464:9068]
2025-10-10T14:35:05.846059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:05.846404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:05.846465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:05.846859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:05.846958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.846966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.846967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.846969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.846970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.846971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.846973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.846974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.846976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.846977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.846978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.846979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.846981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.846988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.847002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.847007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.847011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.847015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.847019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.847024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.847028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.847032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.847038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.847042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.847046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.847050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.847059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.847068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:05.847075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.847081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:05.847086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.847091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:05.847095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.847101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:05.847111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.847116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:05.847121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.847126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:05.847131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.847136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:05.847141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.847147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:05.847152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.847161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:05.847166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.847171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:05.847178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.847188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.847194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.847200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.847215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.847225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.847277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:05.849993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:05.850372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:05.850383Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:05.850386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:05.850390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:05.850396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1558 [2:7559601595974553464:9068]
2025-10-10T14:35:05.850409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:05.850429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:05.850437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.850441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.850444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.850462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:05.850476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:05.850490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:05.850550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.850558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.850560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.850563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:05.850759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1558
2025-10-10T14:35:05.850790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1558
2025-10-10T14:35:05.850630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:05.850637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.850649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:05.850661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:05.850679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:05.850703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777960:9609], now have 1 active actors on pipe
2025-10-10T14:35:05.850706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777826:2438], now have 1 active actors on pipe
2025-10-10T14:35:05.850714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601595974553459:9068]
2025-10-10T14:35:05.850716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601595974553459:9068]
2025-10-10T14:35:05.850719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601595974553459:9068]
2025-10-10T14:35:05.850734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:05.850748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:05.850761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:05.850765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:05.850765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:05.850768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:05.850769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:05.850799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601595974553459:9068]
2025-10-10T14:35:05.850806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:05.850812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:05.850987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.851007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.851044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daf85ac5-495851fb-e8123197-bd35519f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:05.851058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:05.851065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:05.851071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:05.851084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:05.851102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:05.851120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.851369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.851386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.851408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:05.851529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1559 partition: 0 MaxSeqNo: 40 sessionId: src_id|daf85ac5-495851fb-e8123197-bd35519f_0
2025-10-10T14:35:05.853492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0c8dc9-ce8fdcb9-e9b02dbc-11cf4e03_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|daf85ac5-495851fb-e8123197-bd35519f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:05.856151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf85ac5-495851fb-e8123197-bd35519f_0] Write session: try to update token
2025-10-10T14:35:05.856189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf85ac5-495851fb-e8123197-bd35519f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:05.868506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:05.868524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:05.868536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601595974553459:9068]
2025-10-10T14:35:05.868595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:05.868595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:05.868789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:05.868951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:05.869097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:05.869247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:05.869491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:05.869542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:05.878618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId: src_id|daf85ac5-495851fb-e8123197-bd35519f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:05.881372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:05.881571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:05.881585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:05.881589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:05.881591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:05.881603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601595974553459:9068]
2025-10-10T14:35:05.881606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601595974553459:9068]
2025-10-10T14:35:05.881610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601595974553459:9068]
2025-10-10T14:35:05.881669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:05.881676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:05.881682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:05.881684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:05.881688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:05.881706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:05.881713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:05.881716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:05.881851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:05.922736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601596756777973:9272]
2025-10-10T14:35:05.923123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1558, pipe: [1:7559601596756777973:9272]
2025-10-10T14:35:05.998569Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:05.998945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777973:9272], now have 1 active actors on pipe
2025-10-10T14:35:05.999165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:05.999195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601596756777973:9272]
2025-10-10T14:35:05.999225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:05.999229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:05.999232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:05.999302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1559 reason: error at write: Disconnected sessionId: src_id|daf85ac5-495851fb-e8123197-bd35519f_0
2025-10-10T14:35:05.999531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1559 sessionId: src_id|daf85ac5-495851fb-e8123197-bd35519f_0 is DEAD
2025-10-10T14:35:05.999693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf85ac5-495851fb-e8123197-bd35519f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:05.999701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf85ac5-495851fb-e8123197-bd35519f_0] Write session will restart in 0.008493s
2025-10-10T14:35:05.999727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf85ac5-495851fb-e8123197-bd35519f_0] Write session: Do CDS request
2025-10-10T14:35:05.999733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf85ac5-495851fb-e8123197-bd35519f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:06.009944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daf85ac5-495851fb-e8123197-bd35519f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.010113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:06.010129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1560
2025-10-10T14:35:06.010278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.010328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:06.010333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:06.010338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:06.010905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1560 sessionId:  describe result for acl check
2025-10-10T14:35:06.010944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:06.010952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:06.010954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:06.010961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601601051745345:9613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:06.011589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601601051745345:9613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:06.014004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:06.014434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601601051745345:9613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:06.016205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:06.016453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:06.016467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:06.016480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:06.016557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:06.016602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601600269520903:9070]
2025-10-10T14:35:06.017108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601601051745345:9613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:06.017123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601601051745345:9613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:06.017127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601601051745345:9613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:06.017135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:06.017262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:06.017624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:06.017678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:06.018018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:06.018098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.018104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.018106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.018107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.018108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.018109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.018111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.018112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.018113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.018115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.018116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.018117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.018118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.018124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.018137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.018142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.018146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.018150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.018155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.018159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.018163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.018168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.018172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.018176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.018180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.018184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.018191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.018201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.018208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.018214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.018218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.018224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.018230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.018235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.018239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.018246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.018250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.018255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.018260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.018265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.018269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.018274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.018279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.018284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.018294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.018300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.018309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.018314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.018323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.018329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.018338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.018344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.018390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:06.020893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:06.021218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:06.021232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:06.021234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:06.021239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:06.021245Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1559 [2:7559601600269520903:9070]
2025-10-10T14:35:06.021259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:06.021283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:06.021291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.021295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.021298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.021315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:06.021327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:06.021356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:06.021415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.021423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.021426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.021429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:06.021501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:06.021510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.021522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.021534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.021557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:06.021586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745408:9613], now have 1 active actors on pipe
2025-10-10T14:35:06.021591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601596756777975:2438], now have 1 active actors on pipe
2025-10-10T14:35:06.021599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601600269520898:9070]
2025-10-10T14:35:06.021602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601600269520898:9070]
2025-10-10T14:35:06.021604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601600269520898:9070]
2025-10-10T14:35:06.021621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:06.021637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:06.021655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:06.021659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:06.021650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1559
2025-10-10T14:35:06.021663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1559
2025-10-10T14:35:06.021675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:06.021682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601600269520898:9070]
2025-10-10T14:35:06.021685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:06.021686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:06.021690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:06.021697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:06.021729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.021734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.021770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|838167c1-c94c9883-79b830ce-d109680e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:06.021785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.021789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.021792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:06.021804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.021815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:06.021837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.022060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.022070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.022092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.022219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1560 partition: 0 MaxSeqNo: 40 sessionId: src_id|838167c1-c94c9883-79b830ce-d109680e_0
2025-10-10T14:35:06.022615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daf85ac5-495851fb-e8123197-bd35519f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|838167c1-c94c9883-79b830ce-d109680e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:06.025317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838167c1-c94c9883-79b830ce-d109680e_0] Write session: try to update token
2025-10-10T14:35:06.025353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838167c1-c94c9883-79b830ce-d109680e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:06.033884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:06.033904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.033916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601600269520898:9070]
2025-10-10T14:35:06.033968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:06.033974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:06.034156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:06.034317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.034468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.034617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.034825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:06.034873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:06.040615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId: src_id|838167c1-c94c9883-79b830ce-d109680e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:06.043562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:06.043885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.043908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.043955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:06.044058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:06.054860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:06.054890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.054893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:06.054895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:06.054908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601600269520898:9070]
2025-10-10T14:35:06.054913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601600269520898:9070]
2025-10-10T14:35:06.054918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601600269520898:9070]
2025-10-10T14:35:06.054970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:06.054976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:06.054978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.054981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:06.054983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:06.054987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:06.055134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:06.099435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601601051745419:9272]
2025-10-10T14:35:06.099752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1559, pipe: [1:7559601601051745419:9272]
2025-10-10T14:35:06.175496Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:06.185350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.185375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.185745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.186014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.186084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.186149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.186289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.186301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.186379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.186443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.186698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.186772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.186922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.186935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.187200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.187461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.187729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.187795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.187845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.187848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.187923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.187989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.188055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.188123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.188255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.188263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.188516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.188774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.188843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.188907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.188954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.188962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.189031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.189095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.189378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.189643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.189689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.189698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.189770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.189839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.189904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.189969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.190015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.190026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.190096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.190162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.190226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.190295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.190348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.190357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.190609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.190847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.190927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.190993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.191036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.191043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.191117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.191181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.191248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.191312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.191355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.191366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.191429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745419:9272], now have 1 active actors on pipe
2025-10-10T14:35:06.191696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:06.191702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601601051745419:9272]
2025-10-10T14:35:06.191725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:06.191743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:06.191759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1560 reason: error at write: Disconnected sessionId: src_id|838167c1-c94c9883-79b830ce-d109680e_0
2025-10-10T14:35:06.191990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1560 sessionId: src_id|838167c1-c94c9883-79b830ce-d109680e_0 is DEAD
2025-10-10T14:35:06.192720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:06.193594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838167c1-c94c9883-79b830ce-d109680e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:06.193606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838167c1-c94c9883-79b830ce-d109680e_0] Write session will restart in 0.009992s
2025-10-10T14:35:06.193649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838167c1-c94c9883-79b830ce-d109680e_0] Write session: Do CDS request
2025-10-10T14:35:06.193658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838167c1-c94c9883-79b830ce-d109680e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:06.204982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838167c1-c94c9883-79b830ce-d109680e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.205387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:06.205406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1561
2025-10-10T14:35:06.205571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.205627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:06.205633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:06.205637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:06.206138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1561 sessionId:  describe result for acl check
2025-10-10T14:35:06.206292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:06.206189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:06.206197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:06.206200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:06.206208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601601051745532:9617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:06.206813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601601051745532:9617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:06.209511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:06.209783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:06.209793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:06.209807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:06.209818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601601051745532:9617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:06.209871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:06.209921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601600269521081:9083]
2025-10-10T14:35:06.210540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:06.210916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:06.210997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:06.211362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:06.211431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.211440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.211441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.211442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.211443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.211444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.211446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.211447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.211449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.211450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.211451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.211452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.211454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.211471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.211485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.211489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.211492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.211496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.211500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.211503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.211507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.211510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.211515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.211519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.211523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.211526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.211535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.211544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.211556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.211562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.211572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.211578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.211586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.211591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.211596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.211605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.211611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.211620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.211625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.211629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.211633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.211638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.211643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.211648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.211652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.211657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.211661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.211667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.211672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.211676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.211681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.211686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.211742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:06.212178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601601051745532:9617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:06.212194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601601051745532:9617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:06.212199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601601051745532:9617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:06.212208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:06.214393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:06.214829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:06.214843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:06.214846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:06.214850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:06.214856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1560 [2:7559601600269521081:9083]
2025-10-10T14:35:06.214882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:06.214903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:06.214907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.214910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.214912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.214931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:06.214945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:06.214953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:06.215025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.215035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.215037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.215040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:06.215112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:06.215120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.215133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.215150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.215171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:06.215201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745567:9617], now have 1 active actors on pipe
2025-10-10T14:35:06.215210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745425:2438], now have 1 active actors on pipe
2025-10-10T14:35:06.215219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601600269521075:9083]
2025-10-10T14:35:06.215222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601600269521075:9083]
2025-10-10T14:35:06.215224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601600269521075:9083]
2025-10-10T14:35:06.215238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:06.215250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1560
2025-10-10T14:35:06.215263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:06.215292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1560
2025-10-10T14:35:06.215284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:06.215287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:06.215286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:06.215290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:06.215293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:06.215323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601600269521075:9083]
2025-10-10T14:35:06.215337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:06.215360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:06.215482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.215492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.215529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1997c8-1f456413-2664a81d-2fe25116_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:06.215543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.215553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.215555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:06.215568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.215589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:06.215607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.215836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.215848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.215873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.216003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1561 partition: 0 MaxSeqNo: 40 sessionId: src_id|c1997c8-1f456413-2664a81d-2fe25116_0
2025-10-10T14:35:06.216412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838167c1-c94c9883-79b830ce-d109680e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c1997c8-1f456413-2664a81d-2fe25116_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:06.227952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1997c8-1f456413-2664a81d-2fe25116_0] Write session: try to update token
2025-10-10T14:35:06.227977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1997c8-1f456413-2664a81d-2fe25116_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:06.241216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:06.241235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.241239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:06.241241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:06.241252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601600269521075:9083]
2025-10-10T14:35:06.241257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601600269521075:9083]
2025-10-10T14:35:06.241261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601600269521075:9083]
2025-10-10T14:35:06.241314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:06.241316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:06.241323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:06.241327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:06.241360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.241365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:06.241528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:06.245888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId: src_id|c1997c8-1f456413-2664a81d-2fe25116_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:06.248746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:06.291903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601601051745603:9272]
2025-10-10T14:35:06.292305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1560, pipe: [1:7559601601051745603:9272]
2025-10-10T14:35:06.360907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:06.361243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.361256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.361301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745603:9272], now have 1 active actors on pipe
2025-10-10T14:35:06.361554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:06.362101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:06.362115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:06.362187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1561 reason: error at write: Disconnected sessionId: src_id|c1997c8-1f456413-2664a81d-2fe25116_0
2025-10-10T14:35:06.362406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1561 sessionId: src_id|c1997c8-1f456413-2664a81d-2fe25116_0 is DEAD
2025-10-10T14:35:06.362543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:06.362592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601601051745603:9272]
2025-10-10T14:35:06.365611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1997c8-1f456413-2664a81d-2fe25116_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:06.365626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1997c8-1f456413-2664a81d-2fe25116_0] Write session will restart in 0.006302s
2025-10-10T14:35:06.365661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1997c8-1f456413-2664a81d-2fe25116_0] Write session: Do CDS request
2025-10-10T14:35:06.365671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1997c8-1f456413-2664a81d-2fe25116_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:06.372987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1997c8-1f456413-2664a81d-2fe25116_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.373037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:06.373053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1562
2025-10-10T14:35:06.373250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.373296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:06.373307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:06.373312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:06.373840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1562 sessionId:  describe result for acl check
2025-10-10T14:35:06.373886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:06.373895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:06.373896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:06.373903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601601051745629:9632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:06.374471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601601051745629:9632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:06.378650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601601051745629:9632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:06.380862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:06.383090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:06.383321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:06.383333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:06.383346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:06.383412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:06.383468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601600269521234:9087]
2025-10-10T14:35:06.384066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:06.384115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601601051745629:9632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:06.384132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601601051745629:9632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:06.384137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601601051745629:9632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:06.384147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:06.384471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:06.384540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:06.384882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:06.384969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.384970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.384972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.384973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.384975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.384976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.384977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.384979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.384980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.384981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.384982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.384983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.384985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.384990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.385004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.385008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.385012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.385016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.385020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.385024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.385027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.385031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.385036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.385040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.385045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.385049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.385057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.385066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.385073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.385079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.385084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.385088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.385093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.385098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.385105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.385111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.385115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.385121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.385126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.385130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.385134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.385139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.385144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.385152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.385157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.385161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.385166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.385171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.385176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.385181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.385185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.385189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.385227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:06.388370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:06.388790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:06.388803Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:06.388806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:06.388824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:06.388831Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1561 [2:7559601600269521234:9087]
2025-10-10T14:35:06.388844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:06.388864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:06.388872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.388876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.388879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.388898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:06.388906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:06.388925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:06.388993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.389004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.389006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.389009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:06.389229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1561
2025-10-10T14:35:06.389231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1561
2025-10-10T14:35:06.389102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:06.389113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.389126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.389139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.389157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:06.389181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745752:9632], now have 1 active actors on pipe
2025-10-10T14:35:06.389185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745610:2438], now have 1 active actors on pipe
2025-10-10T14:35:06.389193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601600269521229:9087]
2025-10-10T14:35:06.389197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601600269521229:9087]
2025-10-10T14:35:06.389199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601600269521229:9087]
2025-10-10T14:35:06.389215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:06.389242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:06.389246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:06.389249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:06.389422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:06.389441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:06.389445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:06.389469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.389474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.389511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601600269521229:9087]
2025-10-10T14:35:06.389525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:06.389548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:06.389557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.389562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.389562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:06.389564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:06.389576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.389589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:06.389634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.389833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.389846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.389870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.390001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1562 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0
2025-10-10T14:35:06.390446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1997c8-1f456413-2664a81d-2fe25116_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:06.393230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0] Write session: try to update token
2025-10-10T14:35:06.393251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:06.409369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId: src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:06.409943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:06.409958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.409970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601600269521229:9087]
2025-10-10T14:35:06.410030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:06.410036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:06.410230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:06.410418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.410577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.410727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.410970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:06.411022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:06.412167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:06.412524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.412542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.412592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:06.412670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:06.423814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:06.423830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.423833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:06.423836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:06.423848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601600269521229:9087]
2025-10-10T14:35:06.423853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601600269521229:9087]
2025-10-10T14:35:06.423856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601600269521229:9087]
2025-10-10T14:35:06.423908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:06.423921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.423922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:06.423928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:06.423929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:06.423933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:06.424077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:06.461416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601601051745765:9272]
2025-10-10T14:35:06.461800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1561, pipe: [1:7559601601051745765:9272]
2025-10-10T14:35:06.541129Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:06.549817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.549842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.550030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.550100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.550170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.550234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.550278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.550283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.550368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.550436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.550499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.550620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.550661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.550665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.550739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.550805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.550885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.550961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.551007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.551010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.551084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.551151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.551217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.551286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.551329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.551332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.551403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.551462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.551527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.551588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.551630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.551633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.551778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.551867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.551932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.552001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.552057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.552061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.552135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.552199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.552266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.552328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.552373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.552376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.552448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.552510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.552574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.552639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.552689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.552694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.552769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.552827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.552892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.552956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.552994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.552997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.553069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.553129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.553190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.553251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.553292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.553295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.553628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745765:9272], now have 1 active actors on pipe
2025-10-10T14:35:06.553893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:06.553892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:06.553897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:06.553944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1562 reason: error at write: Disconnected sessionId: src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0
2025-10-10T14:35:06.553949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601601051745765:9272]
2025-10-10T14:35:06.554158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1562 sessionId: src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0 is DEAD
2025-10-10T14:35:06.554315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:06.554326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0] Write session will restart in 0.008922s
2025-10-10T14:35:06.554350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0] Write session: Do CDS request
2025-10-10T14:35:06.554357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:06.554601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:06.564958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.565018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:06.565033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1563
2025-10-10T14:35:06.565191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.565235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:06.565246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:06.565250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:06.565807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1563 sessionId:  describe result for acl check
2025-10-10T14:35:06.565853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:06.565864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:06.565867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:06.565873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601601051745874:9636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:06.566508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601601051745874:9636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:06.567279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:06.569481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:06.569583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601601051745874:9636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:06.569688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:06.569700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:06.569713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:06.569773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:06.569829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601600269521381:9089]
2025-10-10T14:35:06.570464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:06.570740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:06.570789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:06.571112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:06.571170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.571176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.571177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.571179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.571180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.571181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.571183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.571184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.571185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.571187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.571188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.571190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.571191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.571196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.571210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.571215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.571219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.571223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.571226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.571230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.571233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.571237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.571242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.571247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.571251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.571255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.571261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.571271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.571278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.571284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.571289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.571294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.571299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.571305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.571315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.571320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.571326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.571336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.571341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.571347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.571357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.571363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.571372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.571377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.571381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.571387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.571396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.571401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.571407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.571416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.571421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.571427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.571469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:06.573803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601601051745874:9636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:06.573819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601601051745874:9636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:06.573824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601601051745874:9636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:06.573834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:06.573853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:06.574158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:06.574175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:06.574178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:06.574182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:06.574189Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1562 [2:7559601600269521381:9089]
2025-10-10T14:35:06.574202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:06.574221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:06.574229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.574233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.574239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.574258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:06.574271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:06.574282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:06.574344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.574355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.574356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.574359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:06.574444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:06.574450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.574460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.574473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.574496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:06.574522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745911:9636], now have 1 active actors on pipe
2025-10-10T14:35:06.574530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745768:2438], now have 1 active actors on pipe
2025-10-10T14:35:06.574539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601600269521376:9089]
2025-10-10T14:35:06.574544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601600269521376:9089]
2025-10-10T14:35:06.574546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601600269521376:9089]
2025-10-10T14:35:06.574559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:06.574573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:06.574567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1562
2025-10-10T14:35:06.574575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:06.574578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:06.574570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1562
2025-10-10T14:35:06.574580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:06.574590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:06.574593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:06.574616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601600269521376:9089]
2025-10-10T14:35:06.574623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:06.574659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:06.574697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.574707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.574741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:06.574753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.574758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.574765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:06.574777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.574794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:06.574810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.574976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.574984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.574999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.575099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1563 partition: 0 MaxSeqNo: 40 sessionId: src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0
2025-10-10T14:35:06.575545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5dfde1-b575f09e-ae0c8e12-fc20874a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:06.578238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0] Write session: try to update token
2025-10-10T14:35:06.578256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:06.586891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:06.586906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.586919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601600269521376:9089]
2025-10-10T14:35:06.586973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:06.586981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:06.587160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:06.587305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.587445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.587584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:06.587785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:06.587833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:06.594516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId: src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:06.597629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.597398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:06.597650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.597704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:06.597782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:06.605362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:06.605378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.605382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:06.605384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:06.605395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601600269521376:9089]
2025-10-10T14:35:06.605399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601600269521376:9089]
2025-10-10T14:35:06.605404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601600269521376:9089]
2025-10-10T14:35:06.605454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:06.605453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:06.605460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:06.605462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.605464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:06.605465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:06.605590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:06.653887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601601051745935:9272]
2025-10-10T14:35:06.654153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1562, pipe: [1:7559601601051745935:9272]
2025-10-10T14:35:06.730419Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:06.738725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.738758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.738958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.739028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.739089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.739153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.739193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.739197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.739271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.739327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.739385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.739446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.739488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.739491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.739564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.739624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.739684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.739745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.739789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.739792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.739863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.739920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.739980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.740043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.740082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.740085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.740156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.740215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.740276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.740339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.740380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.740384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.740454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.740514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.740573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.740634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.740676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.740679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.740748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.740806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.740873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.740933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.740973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.740976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.741042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.741103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.741165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.741225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.741265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.741268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.741586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.741654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.741716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.741785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.741831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.741843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.741912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:06.741980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:06.742048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:06.742114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:06.742160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:06.742168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:06.742230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745935:9272], now have 1 active actors on pipe
2025-10-10T14:35:06.742452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:06.742466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:06.742478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601601051745935:9272]
2025-10-10T14:35:06.742499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:06.742499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1563 reason: error at write: Disconnected sessionId: src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0
2025-10-10T14:35:06.742716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1563 sessionId: src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0 is DEAD
2025-10-10T14:35:06.743477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:06.745430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:06.745443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0] Write session will restart in 0.008804s
2025-10-10T14:35:06.745471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0] Write session: Do CDS request
2025-10-10T14:35:06.745477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:06.755958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.756026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:06.756043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1564
2025-10-10T14:35:06.756219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.756273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:06.756284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:06.756289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:06.756770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1564 sessionId:  describe result for acl check
2025-10-10T14:35:06.756818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:06.756819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:06.756821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:06.756828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601601051746000:9642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:06.757410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601601051746000:9642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:06.759907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601601051746000:9642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:06.764181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601601051746000:9642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:06.764195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601601051746000:9642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:06.764198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601601051746000:9642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:06.764208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:06.765858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:06.767641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:06.767854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:06.767864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:06.767877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:06.767933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:06.767978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601600269521544:9092]
2025-10-10T14:35:06.768601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:06.768975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:06.769019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:06.769392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:06.769456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.769463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.769465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.769466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.769468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.769469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.769470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.769472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.769474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.769475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.769477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.769478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.769480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.769486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.769501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.769505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.769510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.769514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.769519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.769522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.769526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.769531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.769535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.769540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.769545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.769549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.769557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.769567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.769576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.769582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.769587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.769594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.769604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.769610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.769615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.769621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.769625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.769632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.769637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.769642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.769648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.769653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.769659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.769664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.769675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.769681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.769685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.769692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.769696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.769702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.769707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.769713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.769768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:06.772358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:06.772679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:06.772692Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:06.772695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:06.772698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:06.772705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1563 [2:7559601600269521544:9092]
2025-10-10T14:35:06.772718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:06.772741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:06.772744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.772748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.772751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.772770Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:06.772786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:06.772794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:06.772858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.772865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.772867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.772869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:06.772952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:06.772960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.772972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.772995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.773020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:06.773045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051746078:9642], now have 1 active actors on pipe
2025-10-10T14:35:06.773056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051745941:2438], now have 1 active actors on pipe
2025-10-10T14:35:06.773063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601600269521539:9092]
2025-10-10T14:35:06.773103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1563
2025-10-10T14:35:06.773136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1563
2025-10-10T14:35:06.773066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601600269521539:9092]
2025-10-10T14:35:06.773068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601600269521539:9092]
2025-10-10T14:35:06.773081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:06.773094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:06.773095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:06.773097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:06.773100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:06.773112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:06.773115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:06.773139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601600269521539:9092]
2025-10-10T14:35:06.773142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:06.773159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.773164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.773171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:06.773216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:06.773225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.773229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.773231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:06.773243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.773254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:06.773272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.773559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.773570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.773594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.773750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1564 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0
2025-10-10T14:35:06.774180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dfdb48c-3cd1192a-dab6bbc6-acb925ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:06.777142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0] Write session: try to update token
2025-10-10T14:35:06.777163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:06.793480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:06.793497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.793500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:06.793503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:06.793513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601600269521539:9092]
2025-10-10T14:35:06.793518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601600269521539:9092]
2025-10-10T14:35:06.793523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601600269521539:9092]
2025-10-10T14:35:06.793566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:06.793574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:06.793575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:06.793577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:06.793584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.793587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:06.793737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:06.803521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId: src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:06.806207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:06.842821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601601051746092:9272]
2025-10-10T14:35:06.843189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1563, pipe: [1:7559601601051746092:9272]
2025-10-10T14:35:06.912375Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:06.912930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.912949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.912976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051746092:9272], now have 1 active actors on pipe
2025-10-10T14:35:06.913225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601601051746092:9272]
2025-10-10T14:35:06.913256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:06.913293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:06.913398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1564 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0
2025-10-10T14:35:06.913192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:06.913605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1564 sessionId: src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0 is DEAD
2025-10-10T14:35:06.913773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:06.913785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0] Write session will restart in 0.008209s
2025-10-10T14:35:06.913819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0] Write session: Do CDS request
2025-10-10T14:35:06.913826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:06.922925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.923102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:06.923116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1565
2025-10-10T14:35:06.923236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:06.923266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:06.923279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:06.923283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:06.923752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1565 sessionId:  describe result for acl check
2025-10-10T14:35:06.923787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:06.923789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:06.923791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:06.923797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601601051746144:9646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:06.924378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601601051746144:9646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:06.927987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601601051746144:9646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:06.928997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:06.931331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:06.931640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601601051746144:9646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:06.931668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:06.931659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601601051746144:9646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:06.931685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:06.931663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601601051746144:9646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:06.931673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:06.931703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:06.931809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:06.931875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601600269521692:9095]
2025-10-10T14:35:06.932565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:06.932948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:06.933009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:06.933428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:06.933534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.933545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.933546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.933547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.933549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.933550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.933552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.933553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.933555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.933556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.933557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.933558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.933559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.933567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.933582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.933586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.933590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.933594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.933597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.933601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.933605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.933609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.933614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.933617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.933621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.933625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.933635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.933644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:06.933652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.933657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:06.933662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.933668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:06.933672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.933677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:06.933682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.933688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:06.933692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.933697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:06.933702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.933708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:06.933712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.933721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:06.933744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.933750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:06.933756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.933761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:06.933767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.933772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.933776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.933781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.933809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.933814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.933854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:06.936732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:06.937099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:06.937111Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:06.937114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:06.937119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:06.937127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1564 [2:7559601600269521692:9095]
2025-10-10T14:35:06.937143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:06.937164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:06.937167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.937171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.937173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.937193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:06.937206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:06.937219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:06.937289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.937297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.937299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.937302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:06.937403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:06.937411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.937422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:06.937431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:06.937449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:06.937473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051746235:9646], now have 1 active actors on pipe
2025-10-10T14:35:06.937482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601601051746094:2438], now have 1 active actors on pipe
2025-10-10T14:35:06.937490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601600269521687:9095]
2025-10-10T14:35:06.937497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601600269521687:9095]
2025-10-10T14:35:06.937500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601600269521687:9095]
2025-10-10T14:35:06.937515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:06.937525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1564
2025-10-10T14:35:06.937545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1564
2025-10-10T14:35:06.937534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:06.937536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:06.937540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:06.937542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:06.937554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:06.937558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:06.937606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.937611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.937627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601600269521687:9095]
2025-10-10T14:35:06.937637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:06.937673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:06.937681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:06.937689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:06.937694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:06.937696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:06.937708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:06.937726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:06.937756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.937964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:06.937974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:06.937994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:06.938108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1565 partition: 0 MaxSeqNo: 40 sessionId: src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0
2025-10-10T14:35:06.938517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8c4043-abd63990-4f7d82fd-2afafd59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:06.941301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0] Write session: try to update token
2025-10-10T14:35:06.941323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:06.957051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:06.957067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:06.957070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:06.957075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:06.957082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601600269521687:9095]
2025-10-10T14:35:06.957096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601600269521687:9095]
2025-10-10T14:35:06.957099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601600269521687:9095]
2025-10-10T14:35:06.957140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:06.957145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:06.957147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:06.957289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:06.957302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:06.957307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:06.957313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:06.957362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId: src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:06.960095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:07.013318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601605346713542:9272]
2025-10-10T14:35:07.013650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1564, pipe: [1:7559601605346713542:9272]
2025-10-10T14:35:07.069194Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:07.069515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.069534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.069597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346713542:9272], now have 1 active actors on pipe
2025-10-10T14:35:07.069896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:07.069898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601605346713542:9272]
2025-10-10T14:35:07.069928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:07.069931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:07.070008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1565 reason: error at write: Disconnected sessionId: src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0
2025-10-10T14:35:07.070083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:07.070219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1565 sessionId: src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0 is DEAD
2025-10-10T14:35:07.070348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:07.070360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0] Write session will restart in 0.006646s
2025-10-10T14:35:07.070386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0] Write session: Do CDS request
2025-10-10T14:35:07.070394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:07.081833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.081961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:07.081979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1566
2025-10-10T14:35:07.082171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.082218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:07.082253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:07.082261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:07.082706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1566 sessionId:  describe result for acl check
2025-10-10T14:35:07.082736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:07.082738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:07.082740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:07.082746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601605346713654:9650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:07.083310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601605346713654:9650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:07.085570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601605346713654:9650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:07.086441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:07.088938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:07.089188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:07.089199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:07.089211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:07.089269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:07.089267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601605346713654:9650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:07.089285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601605346713654:9650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:07.089289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601605346713654:9650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:07.089298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:07.089312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601604564489138:9097]
2025-10-10T14:35:07.089920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:07.090232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:07.090283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:07.090614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:07.090679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.090684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.090686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.090687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.090688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.090689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.090691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.090692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.090693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.090694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.090696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.090697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.090698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.090704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.090717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.090721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.090725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.090728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.090732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.090736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.090739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.090743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.090747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.090751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.090754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.090757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.090764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.090773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.090779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.090784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.090793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.090798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.090802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.090807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.090815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.090820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.090825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.090829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.090834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.090857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.090863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.090872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.090876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.090881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.090886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.090894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.090898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.090903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.090907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.090911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.090916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.090922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.090958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:07.093457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:07.093775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:07.093797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:07.093800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:07.093804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:07.093810Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1565 [2:7559601604564489138:9097]
2025-10-10T14:35:07.093823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:07.093841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:07.093847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.093851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.093854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.093873Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:07.093887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:07.093895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:07.093952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.093960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.093962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.093964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:07.094042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:07.094050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.094061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.094078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.094100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:07.094130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346713544:2438], now have 1 active actors on pipe
2025-10-10T14:35:07.094137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346713686:9650], now have 1 active actors on pipe
2025-10-10T14:35:07.094145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601604564489133:9097]
2025-10-10T14:35:07.094147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601604564489133:9097]
2025-10-10T14:35:07.094149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601604564489133:9097]
2025-10-10T14:35:07.094162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:07.094176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1565
2025-10-10T14:35:07.094183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1565
2025-10-10T14:35:07.094174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:07.094183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:07.094185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:07.094188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:07.094204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:07.094207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:07.094247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601604564489133:9097]
2025-10-10T14:35:07.094256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:07.094271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.094280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.094283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:07.094327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:07.094341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.094350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.094352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:07.094365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.094376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:07.094393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.094650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.094659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.094677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.094766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1566 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0
2025-10-10T14:35:07.095195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70cb0cb-2176ede0-9aee2b11-e4105698_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:07.097962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0] Write session: try to update token
2025-10-10T14:35:07.097979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:07.114141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:07.114155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:07.114159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:07.114161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:07.114172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601604564489133:9097]
2025-10-10T14:35:07.114177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601604564489133:9097]
2025-10-10T14:35:07.114184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601604564489133:9097]
2025-10-10T14:35:07.114236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:07.114248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:07.114250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:07.114254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:07.114256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.114259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:07.114403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:07.120476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId: src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:07.123150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:07.169950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601605346713697:9272]
2025-10-10T14:35:07.173575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1565, pipe: [1:7559601605346713697:9272]
2025-10-10T14:35:07.229924Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:07.230423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.230443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.230469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346713697:9272], now have 1 active actors on pipe
2025-10-10T14:35:07.230725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:07.230737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601605346713697:9272]
2025-10-10T14:35:07.230772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:07.230774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:07.230858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1566 reason: error at write: Disconnected sessionId: src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0
2025-10-10T14:35:07.230929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:07.231086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1566 sessionId: src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0 is DEAD
2025-10-10T14:35:07.233434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:07.233449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0] Write session will restart in 0.005719s
2025-10-10T14:35:07.233476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0] Write session: Do CDS request
2025-10-10T14:35:07.233485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:07.240911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.241036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:07.241054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1567
2025-10-10T14:35:07.241173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.241222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:07.241235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:07.241239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:07.241890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1567 sessionId:  describe result for acl check
2025-10-10T14:35:07.241926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:07.241929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:07.241931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:07.241938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601605346713735:9654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:07.242513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601605346713735:9654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:07.247071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601605346713735:9654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:07.249805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:07.252617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:07.252798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:07.252807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:07.252816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:07.252855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:07.253235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601605346713735:9654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:07.253251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601605346713735:9654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:07.253255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601605346713735:9654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:07.253264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:07.252890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601604564489320:9105]
2025-10-10T14:35:07.253487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:07.253782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:07.253853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:07.254151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:07.254223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.254232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.254233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.254234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.254235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.254237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.254238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.254239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.254240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.254242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.254243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.254244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.254245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.254252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.254265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.254270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.254274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.254278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.254281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.254284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.254288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.254291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.254295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.254299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.254302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.254305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.254315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.254323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.254329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.254334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.254338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.254342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.254346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.254351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.254355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.254360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.254364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.254369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.254373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.254378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.254382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.254386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.254391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.254396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.254420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.254429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.254434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.254439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.254443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.254448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.254452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.254458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.254500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:07.258454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:07.258933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:07.258946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:07.258949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:07.258954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:07.258961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1566 [2:7559601604564489320:9105]
2025-10-10T14:35:07.258978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:07.258999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:07.259003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.259007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.259010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.259030Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:07.259038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:07.259047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:07.259118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.259126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.259128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.259131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:07.259205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:07.259213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.259225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.259241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.259261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:07.259286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346713699:2438], now have 1 active actors on pipe
2025-10-10T14:35:07.259294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346713841:9654], now have 1 active actors on pipe
2025-10-10T14:35:07.259303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601604564489315:9105]
2025-10-10T14:35:07.259308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601604564489315:9105]
2025-10-10T14:35:07.259311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601604564489315:9105]
2025-10-10T14:35:07.259328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:07.259340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:07.259347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:07.259348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:07.259350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:07.259365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:07.259369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:07.259342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1566
2025-10-10T14:35:07.259412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601604564489315:9105]
2025-10-10T14:35:07.259367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1566
2025-10-10T14:35:07.259425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:07.259431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:07.259602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.259613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.259645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:07.259658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.259662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.259665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:07.259678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.259695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:07.259716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.259922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.259928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.259946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.260069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1567 partition: 0 MaxSeqNo: 40 sessionId: src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0
2025-10-10T14:35:07.260466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7738f9b-12a38790-cfadbfef-19d0a564_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:07.263276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0] Write session: try to update token
2025-10-10T14:35:07.263303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:07.278524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId: src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:07.279936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:07.279957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:07.279966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:07.279968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:07.279977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601604564489315:9105]
2025-10-10T14:35:07.279981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601604564489315:9105]
2025-10-10T14:35:07.279984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601604564489315:9105]
2025-10-10T14:35:07.280032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:07.280034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:07.280040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.280042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:07.280042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:07.280047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:07.280179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:07.281269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:07.330742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601605346713877:9272]
2025-10-10T14:35:07.334056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1566, pipe: [1:7559601605346713877:9272]
2025-10-10T14:35:07.396519Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:07.397011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.397028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.397073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346713877:9272], now have 1 active actors on pipe
2025-10-10T14:35:07.397424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:07.397485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:07.397493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:07.397553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1567 reason: error at write: Disconnected sessionId: src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0
2025-10-10T14:35:07.397776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1567 sessionId: src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0 is DEAD
2025-10-10T14:35:07.398084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:07.398094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0] Write session will restart in 0.006546s
2025-10-10T14:35:07.398122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0] Write session: Do CDS request
2025-10-10T14:35:07.398128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:07.398285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601605346713877:9272]
2025-10-10T14:35:07.397424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:07.405847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.406070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:07.406088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1568
2025-10-10T14:35:07.406183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.406219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:07.406230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:07.406234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:07.406821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1568 sessionId:  describe result for acl check
2025-10-10T14:35:07.406886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:07.406893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:07.406895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:07.406901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601605346713894:9667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:07.407508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601605346713894:9667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:07.411961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601605346713894:9667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:07.427074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601605346713894:9667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:07.427092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601605346713894:9667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:07.427096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601605346713894:9667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:07.427107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:07.427241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:07.431805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:07.432099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:07.432113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:07.432128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:07.432194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:07.432236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601604564489480:9114]
2025-10-10T14:35:07.432713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:07.433142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:07.433193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:07.433450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:07.433542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.433549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.433550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.433551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.433553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.433554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.433556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.433557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.433558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.433560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.433561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.433562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.433564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.433570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.433583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.433588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.433591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.433595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.433600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.433604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.433608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.433612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.433617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.433621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.433625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.433629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.433637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.433646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.433651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.433654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.433658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.433661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.433665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.433668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.433671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.433674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.433677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.433681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.433684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.433687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.433690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.433693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.433696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.433699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.433702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.433705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.433709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.433713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.433716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.433719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.433722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.433725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.433758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:07.436855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:07.437203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:07.437213Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:07.437216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:07.437220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:07.437228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1567 [2:7559601604564489480:9114]
2025-10-10T14:35:07.437241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:07.437260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:07.437263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.437267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.437270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.437288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:07.437296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:07.437305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:07.437383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.437391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.437393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.437396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:07.437460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:07.437463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.437475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.437488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.437505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:07.437526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601604564489474:9114]
2025-10-10T14:35:07.437528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601604564489474:9114]
2025-10-10T14:35:07.437531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601604564489474:9114]
2025-10-10T14:35:07.437553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:07.437571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:07.437571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:07.437573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:07.437576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:07.437586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:07.437589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:07.437632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601604564489474:9114]
2025-10-10T14:35:07.437635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:07.437664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:07.437790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1567
2025-10-10T14:35:07.437826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1567
2025-10-10T14:35:07.437858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714021:9667], now have 1 active actors on pipe
2025-10-10T14:35:07.437870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346713879:2438], now have 1 active actors on pipe
2025-10-10T14:35:07.438029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.438039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.438072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:07.438081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.438087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.438089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:07.438102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.438115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:07.438130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.438382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.438389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.438403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.438511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1568 partition: 0 MaxSeqNo: 40 sessionId: src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0
2025-10-10T14:35:07.438927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71051bfa-a87efc8e-a52add0a-4b866ceb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:07.441637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0] Write session: try to update token
2025-10-10T14:35:07.441660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:07.459397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:07.459417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:07.459421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:07.459423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:07.459433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601604564489474:9114]
2025-10-10T14:35:07.459437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601604564489474:9114]
2025-10-10T14:35:07.459441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601604564489474:9114]
2025-10-10T14:35:07.459493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:07.459502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:07.459508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:07.459510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:07.459521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.459524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:07.459661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:07.462093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId: src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:07.464679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:07.498201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601605346714035:9272]
2025-10-10T14:35:07.498576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1567, pipe: [1:7559601605346714035:9272]
2025-10-10T14:35:07.575000Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:07.575277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.575292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.575335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714035:9272], now have 1 active actors on pipe
2025-10-10T14:35:07.575560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:07.575626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601605346714035:9272]
2025-10-10T14:35:07.575634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:07.575638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:07.575656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:07.575704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1568 reason: error at write: Disconnected sessionId: src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0
2025-10-10T14:35:07.575914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1568 sessionId: src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0 is DEAD
2025-10-10T14:35:07.576057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:07.576069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0] Write session will restart in 0.007107s
2025-10-10T14:35:07.576094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0] Write session: Do CDS request
2025-10-10T14:35:07.576102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:07.584925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.585049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:07.585066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1569
2025-10-10T14:35:07.587336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.587400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:07.587405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:07.587410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:07.587871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1569 sessionId:  describe result for acl check
2025-10-10T14:35:07.587901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:07.587903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:07.587906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:07.587913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601605346714149:9671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:07.588475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601605346714149:9671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:07.589838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:07.591941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:07.592186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:07.592198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:07.592212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:07.592134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601605346714149:9671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:07.592274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:07.592321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601604564489632:9116]
2025-10-10T14:35:07.592940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:07.593303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:07.593435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:07.593774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:07.593839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.593845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.593847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.593848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.593850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.593851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.593853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.593854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.593856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.593857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.593859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.593870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.593871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.593878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.593892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.593896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.593901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.593905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.593909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.593914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.593918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.593923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.593928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.593932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.593936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.593941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.593949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.593959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.593975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.593981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.593987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.593993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.593998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.594003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.594009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.594015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.594025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.594030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.594035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.594040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.594045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.594050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.594061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.594066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.594070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.594076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.594080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.594086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.594091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.594096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.594100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.594106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.594154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:07.596581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601605346714149:9671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:07.596599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601605346714149:9671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:07.596603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601605346714149:9671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:07.596613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:07.596675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:07.597074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:07.597085Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:07.597088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:07.597092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:07.597098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1568 [2:7559601604564489632:9116]
2025-10-10T14:35:07.597113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:07.597132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:07.597140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.597144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.597147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.597165Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:07.597177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:07.597184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:07.597259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.597267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.597269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.597272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:07.597369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:07.597380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.597391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.597402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.597417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:07.597442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714187:9671], now have 1 active actors on pipe
2025-10-10T14:35:07.597446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714037:2438], now have 1 active actors on pipe
2025-10-10T14:35:07.597454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601604564489627:9116]
2025-10-10T14:35:07.597456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601604564489627:9116]
2025-10-10T14:35:07.597458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601604564489627:9116]
2025-10-10T14:35:07.597473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:07.597489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:07.597504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:07.597507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:07.597509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:07.597510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:07.597514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:07.597544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601604564489627:9116]
2025-10-10T14:35:07.597555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:07.597570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:07.597575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1568
2025-10-10T14:35:07.597576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1568
2025-10-10T14:35:07.597681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.597691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.597726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:07.597740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.597744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.597747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:07.597758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.597777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:07.597797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.597963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.597971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.597986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.598154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1569 partition: 0 MaxSeqNo: 40 sessionId: src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0
2025-10-10T14:35:07.598544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bd6a85c-fda85b18-3f2c463a-f1bb6c00_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:07.601373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0] Write session: try to update token
2025-10-10T14:35:07.601391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:07.609411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:07.609425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:07.609434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601604564489627:9116]
2025-10-10T14:35:07.609479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:07.609480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:07.609630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:07.609776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:07.609903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:07.610038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:07.610219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:07.610265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:07.616113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId: src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:07.618696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:07.618933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.618955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.619018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:07.619104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:07.627028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:07.627041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:07.627045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:07.627047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:07.627058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601604564489627:9116]
2025-10-10T14:35:07.627063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601604564489627:9116]
2025-10-10T14:35:07.627066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601604564489627:9116]
2025-10-10T14:35:07.627115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:07.627120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:07.627127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.627127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:07.627129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:07.627133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:07.627279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:07.675834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601605346714211:9272]
2025-10-10T14:35:07.676143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1568, pipe: [1:7559601605346714211:9272]
2025-10-10T14:35:07.738533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:07.746706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.746736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.746933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.747011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.747082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.747156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.747220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.747231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.747306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.747373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.747440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.747511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.747561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.747568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.747641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.747704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.747768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.747840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.747889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.747897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.747972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.748039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.748109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.748178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.748224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.748231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.748302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.748369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.748441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.748505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.748547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.748550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.748623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.748683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.748744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.748807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.748852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.748856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.748929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.748991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.749054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.749121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.749164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.749167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.749236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.749298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.749572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.749644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.749689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.749696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.749767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.751133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:07.751144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0] Write session will restart in 0.006695s
2025-10-10T14:35:07.751170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0] Write session: Do CDS request
2025-10-10T14:35:07.751177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:07.749827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.749901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.749962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.750003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.750005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.750078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.750136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.750201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.750261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.750304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.750307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.750383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714211:9272], now have 1 active actors on pipe
2025-10-10T14:35:07.751606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:07.750635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:07.750651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:07.750651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:07.750694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1569 reason: error at write: Disconnected sessionId: src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0
2025-10-10T14:35:07.750707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601605346714211:9272]
2025-10-10T14:35:07.750948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1569 sessionId: src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0 is DEAD
2025-10-10T14:35:07.758931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.759309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:07.759324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1570
2025-10-10T14:35:07.759440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.759477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:07.759483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:07.759487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:07.759927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1570 sessionId:  describe result for acl check
2025-10-10T14:35:07.759964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:07.759966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:07.759968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:07.759975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601605346714232:9677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:07.760637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601605346714232:9677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:07.763633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601605346714232:9677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:07.766868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601605346714232:9677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:07.766881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601605346714232:9677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:07.766885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601605346714232:9677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:07.766894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:07.767798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:07.769911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:07.770186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:07.770199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:07.770212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:07.770280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:07.770341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601604564489801:9119]
2025-10-10T14:35:07.770953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:07.771249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:07.771296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:07.771624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:07.771694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.771700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.771701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.771702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.771703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.771704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.771705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.771706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.771708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.771709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.771710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.771711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.771713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.771718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.771731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.771734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.771738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.771741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.771744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.771748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.771751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.771755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.771760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.771764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.771769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.771773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.771780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.771791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.771797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.771802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.771811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.771816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.771824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.771829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.771834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.771840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.771849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.771854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.771862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.771866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.771870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.771875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.771883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.771888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.771897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.771902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.771906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.771911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.771915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.771922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.771926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.771945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.771987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:07.774698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:07.775033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:07.775046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:07.775051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:07.775055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:07.775061Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1569 [2:7559601604564489801:9119]
2025-10-10T14:35:07.775074Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:07.775095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:07.775098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.775103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.775105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.775123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:07.775134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:07.775142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:07.775198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.775205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.775207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.775209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:07.775276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:07.775283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.775296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.775314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.775337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:07.775379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714216:2438], now have 1 active actors on pipe
2025-10-10T14:35:07.775387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714360:9677], now have 1 active actors on pipe
2025-10-10T14:35:07.775396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601604564489796:9119]
2025-10-10T14:35:07.775402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601604564489796:9119]
2025-10-10T14:35:07.775404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601604564489796:9119]
2025-10-10T14:35:07.775418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:07.775433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:07.775453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:07.775456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:07.775460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:07.775461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:07.775461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:07.775483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601604564489796:9119]
2025-10-10T14:35:07.775491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:07.775493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:07.775407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1569
2025-10-10T14:35:07.775454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1569
2025-10-10T14:35:07.775814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.775828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.775863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:07.775878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.775882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.775885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:07.775897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.775910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:07.775926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.776120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.776129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.776148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.776226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1570 partition: 0 MaxSeqNo: 40 sessionId: src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0
2025-10-10T14:35:07.776658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b10b8b0-84ceeaa7-831446e1-74493836_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:07.779600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0] Write session: try to update token
2025-10-10T14:35:07.779624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:07.789573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:07.789591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:07.789602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601604564489796:9119]
2025-10-10T14:35:07.789643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:07.790012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:07.790202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:07.790378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:07.790513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:07.790660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:07.790920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:07.790966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:07.801493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId: src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:07.804258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:07.804642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.804677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.804718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:07.809389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:07.815477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:07.815495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:07.815499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:07.815501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:07.815514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601604564489796:9119]
2025-10-10T14:35:07.815518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601604564489796:9119]
2025-10-10T14:35:07.815522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601604564489796:9119]
2025-10-10T14:35:07.815570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:07.815578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.815580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:07.815579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:07.815586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:07.815600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:07.815726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:07.851016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601605346714374:9272]
2025-10-10T14:35:07.851578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1569, pipe: [1:7559601605346714374:9272]
2025-10-10T14:35:07.934485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:07.942870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.942900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.943084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.943149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.943220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.943279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.943322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.943327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.943400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.943461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.943519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.943582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.943624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.943627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.943694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.943748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.943808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.943868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.943907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.943910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.943976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.944035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.944094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.944152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.944192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.944195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.944261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.944316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.944378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.944447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.944486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.944489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.944557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.944615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.944675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.944736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.944776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.944779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.944848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.944903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.944962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.945027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.945068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.945071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.945136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.945190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.945250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.945312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.946636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601605346714374:9272]
2025-10-10T14:35:07.946637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:07.946642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:07.946674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1570 reason: error at write: Disconnected sessionId: src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0
2025-10-10T14:35:07.946675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:07.946882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1570 sessionId: src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0 is DEAD
2025-10-10T14:35:07.947251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:07.947263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0] Write session will restart in 0.006796s
2025-10-10T14:35:07.947287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0] Write session: Do CDS request
2025-10-10T14:35:07.947294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:07.945645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.945653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.945718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.945770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.945825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.945881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.945920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.945923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.945986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:07.946043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:07.946099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:07.946154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:07.946199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:07.946202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:07.946269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714374:9272], now have 1 active actors on pipe
2025-10-10T14:35:07.947402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:07.955040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.955049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:07.955066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1571
2025-10-10T14:35:07.955291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:07.955329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:07.955334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:07.955338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:07.955838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1571 sessionId:  describe result for acl check
2025-10-10T14:35:07.955877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:07.955879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:07.955880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:07.955886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601605346714387:9681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:07.956470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601605346714387:9681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:07.959456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601605346714387:9681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:07.963962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601605346714387:9681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:07.963979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601605346714387:9681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:07.963983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601605346714387:9681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:07.963993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:07.972321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:07.974739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:07.975020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:07.975026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:07.975042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:07.975112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:07.975150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601604564489957:9122]
2025-10-10T14:35:07.975811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:07.976129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:07.976177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:07.976493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:07.976556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.976557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.976558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.976560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.976561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.976562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.976563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.976565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.976566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.976567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.976568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.976570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.976571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.976577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.976590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.976594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.976599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.976603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.976607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.976611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.976615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.976619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.976623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.976627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.976631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.976635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.976644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.976653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:07.976659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.976665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:07.976671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.976675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:07.976679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.976684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:07.976689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.976695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:07.976699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.976705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:07.976709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.976715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:07.976719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.976725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:07.976729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.976734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:07.976739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.976744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:07.976748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.976753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.976757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.976762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.976767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.976772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.976826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:07.979769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:07.980092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:07.980097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:07.980100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:07.980104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:07.980111Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1570 [2:7559601604564489957:9122]
2025-10-10T14:35:07.980124Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:07.980143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:07.980146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.980150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.980153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.980171Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:07.980179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:07.980187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:07.980250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.980252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.980255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.980257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:07.980329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:07.980332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:07.980345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:07.980357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:07.980373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:07.980395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714377:2438], now have 1 active actors on pipe
2025-10-10T14:35:07.980404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601604564489952:9122]
2025-10-10T14:35:07.980407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601604564489952:9122]
2025-10-10T14:35:07.980409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601604564489952:9122]
2025-10-10T14:35:07.980419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:07.980425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:07.980427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:07.980429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:07.980433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:07.980448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:07.980452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:07.980457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601605346714421:9681], now have 1 active actors on pipe
2025-10-10T14:35:07.980481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601604564489952:9122]
2025-10-10T14:35:07.980489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:07.980520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:07.981550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1570
2025-10-10T14:35:07.981592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1570
2025-10-10T14:35:07.981833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.981847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.981886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b432a373-e870654d-be73e0f3-eff2f857_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:07.981897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:07.981902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:07.981905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:07.981920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:07.981935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:07.981954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:07.989786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1571 partition: 0 MaxSeqNo: 40 sessionId: src_id|b432a373-e870654d-be73e0f3-eff2f857_0
2025-10-10T14:35:07.990502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af6ceb17-4b796a96-b06ed0ef-b90ec8da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b432a373-e870654d-be73e0f3-eff2f857_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:07.993301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b432a373-e870654d-be73e0f3-eff2f857_0] Write session: try to update token
2025-10-10T14:35:07.993323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b432a373-e870654d-be73e0f3-eff2f857_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:07.989532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:07.989554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:07.989597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.000388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:08.000408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:08.000412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:08.000414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:08.000425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601604564489952:9122]
2025-10-10T14:35:08.000429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601604564489952:9122]
2025-10-10T14:35:08.000433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601604564489952:9122]
2025-10-10T14:35:08.000490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:08.000499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:08.000505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.000505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:08.000507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:08.000509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:08.000637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:08.015931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId: src_id|b432a373-e870654d-be73e0f3-eff2f857_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:08.018676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:08.046542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601609641681831:9272]
2025-10-10T14:35:08.046833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1570, pipe: [1:7559601609641681831:9272]
2025-10-10T14:35:08.112621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:08.113193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.113210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.113238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641681831:9272], now have 1 active actors on pipe
2025-10-10T14:35:08.113733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:08.114002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601609641681831:9272]
2025-10-10T14:35:08.114038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:08.114112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1571 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b432a373-e870654d-be73e0f3-eff2f857_0
2025-10-10T14:35:08.114321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1571 sessionId: src_id|b432a373-e870654d-be73e0f3-eff2f857_0 is DEAD
2025-10-10T14:35:08.114449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:08.114510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b432a373-e870654d-be73e0f3-eff2f857_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:08.114521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b432a373-e870654d-be73e0f3-eff2f857_0] Write session will restart in 0.006716s
2025-10-10T14:35:08.114545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b432a373-e870654d-be73e0f3-eff2f857_0] Write session: Do CDS request
2025-10-10T14:35:08.114552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b432a373-e870654d-be73e0f3-eff2f857_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:08.125985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b432a373-e870654d-be73e0f3-eff2f857_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.126080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:08.126096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1572
2025-10-10T14:35:08.126326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.126370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:08.126381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:08.126385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:08.126928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1572 sessionId:  describe result for acl check
2025-10-10T14:35:08.126970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:08.126978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:08.126980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:08.126987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601609641681949:9685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:08.127575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601609641681949:9685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:08.128777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:08.131461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:08.131677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:08.131688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:08.131701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:08.131756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:08.131800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601608859457408:9124]
2025-10-10T14:35:08.132068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601609641681949:9685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:08.132448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:08.133089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:08.133150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:08.133525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:08.133595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.133602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.133604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.133605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.133607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.133608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.133610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.133611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.133612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.133613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.133615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.133616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.133617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.133624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.133638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.133643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.133648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.133652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.133655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.133659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.133662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.133665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.133669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.133673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.133677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.133681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.133689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.133699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.133706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.133712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.133716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.133722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.133727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.133734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.133738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.133745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.133750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.133755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.133761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.133767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.133772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.133777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.133782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.133788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.133792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.133799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.133803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.133810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.133824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.133828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.133833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.133838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.133879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:08.136487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601609641681949:9685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:08.136507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601609641681949:9685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:08.136511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601609641681949:9685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:08.136521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:08.136980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:08.137360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:08.137375Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:08.137377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:08.137382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:08.137390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1571 [2:7559601608859457408:9124]
2025-10-10T14:35:08.137406Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:08.137424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:08.137428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.137431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.137435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.137453Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:08.137460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:08.137469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:08.137544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.137552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.137554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.137557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:08.137631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:08.137634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.137647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.137664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.137681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:08.137715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601608859457402:9124]
2025-10-10T14:35:08.137718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601608859457402:9124]
2025-10-10T14:35:08.137720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601608859457402:9124]
2025-10-10T14:35:08.137734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:08.137749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641681833:2438], now have 1 active actors on pipe
2025-10-10T14:35:08.137752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641681984:9685], now have 1 active actors on pipe
2025-10-10T14:35:08.137761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:08.137768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:08.137772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:08.137774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:08.137776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:08.137780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:08.137818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601608859457402:9124]
2025-10-10T14:35:08.137830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:08.137864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:08.138237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1571
2025-10-10T14:35:08.138255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1571
2025-10-10T14:35:08.138422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.138437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.138488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:08.138504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.138518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.138521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:08.138536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.138550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:08.138569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.138732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.138740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.138753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.138859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1572 partition: 0 MaxSeqNo: 40 sessionId: src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0
2025-10-10T14:35:08.139379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b432a373-e870654d-be73e0f3-eff2f857_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:08.142274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0] Write session: try to update token
2025-10-10T14:35:08.142297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:08.158705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:08.158724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:08.158728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:08.158730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:08.158742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601608859457402:9124]
2025-10-10T14:35:08.158747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601608859457402:9124]
2025-10-10T14:35:08.158751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601608859457402:9124]
2025-10-10T14:35:08.158803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:08.158805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:08.158825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:08.158825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.158828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:08.158829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:08.158973Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:08.159944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId: src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:08.162607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:08.216453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601609641681992:9272]
2025-10-10T14:35:08.216884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1571, pipe: [1:7559601609641681992:9272]
2025-10-10T14:35:08.280572Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:08.281234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.281246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.281296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641681992:9272], now have 1 active actors on pipe
2025-10-10T14:35:08.282510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:08.282521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0] Write session will restart in 0.005997s
2025-10-10T14:35:08.282545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0] Write session: Do CDS request
2025-10-10T14:35:08.282552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:08.282922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:08.282035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601609641681992:9272]
2025-10-10T14:35:08.282068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:08.282103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:08.282106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:08.282164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1572 reason: error at write: Disconnected sessionId: src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0
2025-10-10T14:35:08.282350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1572 sessionId: src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0 is DEAD
2025-10-10T14:35:08.290649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.290804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:08.290833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1573
2025-10-10T14:35:08.291114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.291155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:08.291165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:08.291168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:08.291647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1573 sessionId:  describe result for acl check
2025-10-10T14:35:08.291699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:08.291706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:08.291708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:08.291714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601609641682004:9689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:08.292284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601609641682004:9689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:08.294860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601609641682004:9689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:08.302348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601609641682004:9689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:08.302365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601609641682004:9689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:08.302369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601609641682004:9689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:08.302379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:08.307053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:08.309613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:08.309839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:08.309844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:08.309856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:08.309911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:08.309950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601608859457597:9132]
2025-10-10T14:35:08.310519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:08.311131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:08.311187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:08.311537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:08.311603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.311612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.311613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.311615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.311616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.311618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.311619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.311621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.311622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.311623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.311625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.311626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.311627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.311633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.311648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.311652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.311656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.311660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.311664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.311667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.311671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.311675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.311679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.311683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.311688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.311692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.311714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.311725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.311734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.311740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.311745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.311751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.311756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.311762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.311767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.311772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.311777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.311782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.311787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.311793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.311798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.311803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.311808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.311813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.311818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.311823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.311828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.311833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.311837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.311842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.311848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.311853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.311902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:08.316216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:08.316891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:08.316911Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:08.316914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:08.316919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:08.316926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1572 [2:7559601608859457597:9132]
2025-10-10T14:35:08.316943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:08.316969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:08.316977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.316982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.316985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.317004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:08.317017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:08.317031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:08.317101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.317110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.317112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.317115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:08.317186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:08.317194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.317208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.317225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.317242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:08.317271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641681994:2438], now have 1 active actors on pipe
2025-10-10T14:35:08.317280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682093:9689], now have 1 active actors on pipe
2025-10-10T14:35:08.317287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601608859457592:9132]
2025-10-10T14:35:08.317294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601608859457592:9132]
2025-10-10T14:35:08.317297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601608859457592:9132]
2025-10-10T14:35:08.317310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:08.317323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:08.317380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1572
2025-10-10T14:35:08.317421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1572
2025-10-10T14:35:08.317350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:08.317350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:08.317358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:08.317369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:08.317373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:08.317413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601608859457592:9132]
2025-10-10T14:35:08.317417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:08.317419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:08.317451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.317457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.317502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|589f2f27-6441b210-4059eb20-9e7fe795_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:08.317511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.317515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.317518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:08.317530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.317544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:08.317564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.317778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.317790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.317815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.317935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1573 partition: 0 MaxSeqNo: 40 sessionId: src_id|589f2f27-6441b210-4059eb20-9e7fe795_0
2025-10-10T14:35:08.318402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d8a1db-a9be792-c7e6544f-231815c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|589f2f27-6441b210-4059eb20-9e7fe795_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:08.321214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|589f2f27-6441b210-4059eb20-9e7fe795_0] Write session: try to update token
2025-10-10T14:35:08.321238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|589f2f27-6441b210-4059eb20-9e7fe795_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:08.336035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId: src_id|589f2f27-6441b210-4059eb20-9e7fe795_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:08.338980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:08.339274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.339297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.339342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:08.339479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:08.343193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:08.343214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:08.343217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:08.343219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:08.343229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601608859457592:9132]
2025-10-10T14:35:08.343233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601608859457592:9132]
2025-10-10T14:35:08.343236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601608859457592:9132]
2025-10-10T14:35:08.343287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:08.343305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.343308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:08.343457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:08.344126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:08.344144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:08.344227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:08.383396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601609641682177:9272]
2025-10-10T14:35:08.383655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1572, pipe: [1:7559601609641682177:9272]
2025-10-10T14:35:08.464927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:08.473284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.473454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.473649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.473715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.473778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.473839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.474084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.474091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.474172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.474229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.474291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.474353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.474403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.474406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.474505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.474566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.474627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.474702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.474744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.474747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.474833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.474900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.474969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.475031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.475072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.475075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.475144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.475212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.475274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.475342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.475388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.475392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.475465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.475525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.475599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.475669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.475717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.475720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.475795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.475862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.475941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.476009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.476055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.476064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.477835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:08.477913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601609641682177:9272]
2025-10-10T14:35:08.477940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:08.477942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:08.477974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1573 reason: error at write: Disconnected sessionId: src_id|589f2f27-6441b210-4059eb20-9e7fe795_0
2025-10-10T14:35:08.478194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1573 sessionId: src_id|589f2f27-6441b210-4059eb20-9e7fe795_0 is DEAD
2025-10-10T14:35:08.476133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.476203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.476270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.476332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.476370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.476375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.476462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.476531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.476594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.476651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.476690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.476693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.476769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:08.476828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:08.476886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:08.476945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:08.476988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:08.476990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:08.477067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682177:9272], now have 1 active actors on pipe
2025-10-10T14:35:08.479200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|589f2f27-6441b210-4059eb20-9e7fe795_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:08.479214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|589f2f27-6441b210-4059eb20-9e7fe795_0] Write session will restart in 0.005612s
2025-10-10T14:35:08.479254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|589f2f27-6441b210-4059eb20-9e7fe795_0] Write session: Do CDS request
2025-10-10T14:35:08.479260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|589f2f27-6441b210-4059eb20-9e7fe795_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:08.479310Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:08.485914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|589f2f27-6441b210-4059eb20-9e7fe795_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.486594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:08.486611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1574
2025-10-10T14:35:08.486889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.486923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:08.486929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:08.486933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:08.487337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1574 sessionId:  describe result for acl check
2025-10-10T14:35:08.487367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:08.487369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:08.487371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:08.487378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601609641682188:9702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:08.487913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601609641682188:9702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:08.490667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601609641682188:9702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:08.494836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601609641682188:9702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:08.494851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601609641682188:9702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:08.494855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601609641682188:9702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:08.494865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:08.510251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:08.510800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:08.511014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:08.511025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:08.511037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:08.511092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:08.511137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601608859457762:9141]
2025-10-10T14:35:08.511753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:08.512086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:08.512133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:08.512484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:08.512540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.512547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.512548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.512550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.512552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.512553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.512554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.512555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.512557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.512558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.512559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.512560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.512562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.512567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.512579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.512584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.512588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.512592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.512596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.512600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.512604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.512608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.512612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.512616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.512620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.512624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.512632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.512641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.512647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.512653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.512657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.512662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.512667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.512672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.512677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.512682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.512685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.512690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.512696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.512701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.512707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.512712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.512717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.512722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.512726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.512731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.512736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.512741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.512745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.512750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.512754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.512759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.512798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:08.515234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:08.515549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:08.515560Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:08.515563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:08.515566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:08.515573Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1573 [2:7559601608859457762:9141]
2025-10-10T14:35:08.515586Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:08.515605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:08.515608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.515622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.515625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.515643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:08.515655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:08.515663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:08.515733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.515740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.515742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.515744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:08.515813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:08.515821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.515833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.515845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.515993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1573
2025-10-10T14:35:08.516005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1573
2025-10-10T14:35:08.515866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:08.515896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682225:9702], now have 1 active actors on pipe
2025-10-10T14:35:08.515900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682181:2438], now have 1 active actors on pipe
2025-10-10T14:35:08.515908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601608859457757:9141]
2025-10-10T14:35:08.515910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601608859457757:9141]
2025-10-10T14:35:08.515913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601608859457757:9141]
2025-10-10T14:35:08.515926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:08.515940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:08.515956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:08.515960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:08.515959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:08.515964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:08.515979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:08.515992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601608859457757:9141]
2025-10-10T14:35:08.515995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:08.515998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:08.516052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.516058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.516093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:08.516102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.516105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.516108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:08.516123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.516135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:08.516151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.516295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.516303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.516318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.516425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1574 partition: 0 MaxSeqNo: 40 sessionId: src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0
2025-10-10T14:35:08.516866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|589f2f27-6441b210-4059eb20-9e7fe795_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:08.519605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0] Write session: try to update token
2025-10-10T14:35:08.519628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:08.533997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:08.534013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:08.534023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601608859457757:9141]
2025-10-10T14:35:08.534072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:08.534255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:08.534393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:08.534531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:08.534670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:08.534866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:08.534900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:08.535080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:08.546369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId: src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:08.549048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:08.546944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:08.546965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:08.546969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:08.546971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:08.546982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601608859457757:9141]
2025-10-10T14:35:08.546986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601608859457757:9141]
2025-10-10T14:35:08.546991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601608859457757:9141]
2025-10-10T14:35:08.547042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:08.547042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:08.547051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:08.547051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.547053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:08.547063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:08.547191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:08.577991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601609641682343:9272]
2025-10-10T14:35:08.578457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1573, pipe: [1:7559601609641682343:9272]
2025-10-10T14:35:08.662715Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:08.663289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.663308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.663334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682343:9272], now have 1 active actors on pipe
2025-10-10T14:35:08.663588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:08.663561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:08.663593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601609641682343:9272]
2025-10-10T14:35:08.663623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:08.663625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:08.663690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1574 reason: error at write: Disconnected sessionId: src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0
2025-10-10T14:35:08.663896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1574 sessionId: src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0 is DEAD
2025-10-10T14:35:08.664066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:08.664077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0] Write session will restart in 0.007250s
2025-10-10T14:35:08.664113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0] Write session: Do CDS request
2025-10-10T14:35:08.664120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:08.672913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.673004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:08.673020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1575
2025-10-10T14:35:08.673172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.673210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:08.673216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:08.673221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:08.673776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1575 sessionId:  describe result for acl check
2025-10-10T14:35:08.673815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:08.673821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:08.673837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:08.673845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601609641682411:9708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:08.674412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601609641682411:9708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:08.677064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601609641682411:9708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:08.677689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:08.680693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:08.680937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:08.680950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:08.680963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:08.680980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601609641682411:9708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:08.680994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601609641682411:9708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:08.680997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601609641682411:9708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:08.681005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:08.681029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:08.681073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601608859457932:9144]
2025-10-10T14:35:08.681734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:08.682074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:08.682137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:08.682491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:08.682565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.682576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.682578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.682578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.682579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.682581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.682582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.682583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.682584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.682586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.682587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.682588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.682589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.682597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.682609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.682614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.682618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.682621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.682625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.682639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.682644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.682648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.682653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.682656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.682660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.682665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.682673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.682682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.682688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.682693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.682697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.682702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.682706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.682711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.682715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.682720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.682724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.682729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.682736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.682746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.682750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.682756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.682765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.682770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.682774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.682783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.682787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.682792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.682811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.682816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.682821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.682831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.682871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:08.685185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:08.685522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:08.685537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:08.685540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:08.685543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:08.685549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1574 [2:7559601608859457932:9144]
2025-10-10T14:35:08.685561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:08.685579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:08.685582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.685586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.685588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.685604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:08.685620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:08.685629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:08.685688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.685695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.685698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.685700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:08.685773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:08.685787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.685799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.685812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.685829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:08.685858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682513:9708], now have 1 active actors on pipe
2025-10-10T14:35:08.685890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1574
2025-10-10T14:35:08.685867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682362:2438], now have 1 active actors on pipe
2025-10-10T14:35:08.685878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601608859457927:9144]
2025-10-10T14:35:08.685881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601608859457927:9144]
2025-10-10T14:35:08.685882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601608859457927:9144]
2025-10-10T14:35:08.685894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:08.685912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:08.685928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:08.685932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:08.685944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:08.685947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:08.685950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:08.685954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601608859457927:9144]
2025-10-10T14:35:08.685957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:08.685966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:08.685986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.685997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.685969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1574
2025-10-10T14:35:08.686033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:08.686047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.686051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.686054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:08.686065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.686080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:08.686102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.686289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.686301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.686322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.686419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1575 partition: 0 MaxSeqNo: 40 sessionId: src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0
2025-10-10T14:35:08.686826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ec7fc1d-729e7cac-5666267e-c6917020_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:08.689756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0] Write session: try to update token
2025-10-10T14:35:08.689774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:08.704632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId: src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:08.705219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:08.705235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:08.705239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:08.705241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:08.705250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601608859457927:9144]
2025-10-10T14:35:08.705255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601608859457927:9144]
2025-10-10T14:35:08.705259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601608859457927:9144]
2025-10-10T14:35:08.705307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:08.705307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:08.705315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:08.705315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.705318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:08.705320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:08.707433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:08.705490Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:08.763874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601609641682528:9272]
2025-10-10T14:35:08.764158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1574, pipe: [1:7559601609641682528:9272]
2025-10-10T14:35:08.843673Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:08.844146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.844163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.844209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682528:9272], now have 1 active actors on pipe
2025-10-10T14:35:08.844567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:08.844576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:08.844581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:08.844624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601609641682528:9272]
2025-10-10T14:35:08.844652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1575 reason: error at write: Disconnected sessionId: src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0
2025-10-10T14:35:08.844651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:08.844874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1575 sessionId: src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0 is DEAD
2025-10-10T14:35:08.845592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:08.845611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0] Write session will restart in 0.007836s
2025-10-10T14:35:08.845636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0] Write session: Do CDS request
2025-10-10T14:35:08.845643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:08.855059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.855170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:08.855203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1576
2025-10-10T14:35:08.857579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:08.857632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:08.857638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:08.857642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:08.861869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:08.861738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1576 sessionId:  describe result for acl check
2025-10-10T14:35:08.861782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:08.861784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:08.861786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:08.861793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601609641682652:9712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:08.862357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601609641682652:9712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:08.865667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:08.865935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:08.865945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:08.865959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:08.866025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:08.866081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601608859458094:9147]
2025-10-10T14:35:08.866723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:08.867060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:08.867128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:08.866946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601609641682652:9712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:08.867474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:08.867545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.867552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.867553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.867554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.867555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.867557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.867558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.867559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.867560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.867561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.867562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.867564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.867565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.867571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.867585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.867589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.867593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.867596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.867600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.867604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.867607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.867611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.867626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.867630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.867633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.867637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.867644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.867653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:08.867660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.867665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:08.867669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.867674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:08.867678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.867683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:08.867688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.867693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:08.867697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.867702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:08.867717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.867724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:08.867728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.867733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:08.867738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.867743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:08.867747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.867752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:08.867757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.867762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.867772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.867777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.867781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.867786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.867828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:08.871792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:08.872420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:08.872435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:08.872438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:08.872442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:08.872449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1575 [2:7559601608859458094:9147]
2025-10-10T14:35:08.872463Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:08.872482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:08.872491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.872495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.872498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.872517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:08.872530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:08.872538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:08.871960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601609641682652:9712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:08.871979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601609641682652:9712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:08.871983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601609641682652:9712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:08.871993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:08.872609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.872617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.872619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.872622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:08.872696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:08.872705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.872722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:08.872739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:08.872754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:08.872783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682530:2438], now have 1 active actors on pipe
2025-10-10T14:35:08.872786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682685:9712], now have 1 active actors on pipe
2025-10-10T14:35:08.872794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601608859458089:9147]
2025-10-10T14:35:08.872796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601608859458089:9147]
2025-10-10T14:35:08.872798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601608859458089:9147]
2025-10-10T14:35:08.872966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1575
2025-10-10T14:35:08.872994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1575
2025-10-10T14:35:08.872815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:08.872834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:08.872850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:08.872851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:08.872854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:08.872855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:08.872856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:08.872898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601608859458089:9147]
2025-10-10T14:35:08.872908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:08.872919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:08.873119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.873129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.873171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:08.873190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:08.873195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:08.873198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:08.873215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:08.873228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:08.873247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.873486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:08.873495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:08.873511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:08.873633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1576 partition: 0 MaxSeqNo: 40 sessionId: src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0
2025-10-10T14:35:08.877640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf0c386-b88c77b7-98f74f21-7f1f8af2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:08.880405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0] Write session: try to update token
2025-10-10T14:35:08.880428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:08.885069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:08.885086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:08.885098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601608859458089:9147]
2025-10-10T14:35:08.885149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:08.885217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:08.885327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:08.885505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:08.885660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:08.885817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:08.886028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:08.886084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:08.904116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:08.904133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:08.904137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:08.904139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:08.904151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601608859458089:9147]
2025-10-10T14:35:08.904155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601608859458089:9147]
2025-10-10T14:35:08.904159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601608859458089:9147]
2025-10-10T14:35:08.904213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:08.904220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:08.904223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:08.902508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId: src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:08.905290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:08.904335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:08.904342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:08.904347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:08.904368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:08.944586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601609641682694:9272]
2025-10-10T14:35:08.944883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1575, pipe: [1:7559601609641682694:9272]
2025-10-10T14:35:09.015243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:09.015595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.015610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.015635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601609641682694:9272], now have 1 active actors on pipe
2025-10-10T14:35:09.015916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:09.015942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:09.015946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601609641682694:9272]
2025-10-10T14:35:09.015969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:09.016384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:09.016398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0] Write session will restart in 0.008302s
2025-10-10T14:35:09.016424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0] Write session: Do CDS request
2025-10-10T14:35:09.016430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:09.016008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1576 reason: error at write: Disconnected sessionId: src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0
2025-10-10T14:35:09.016240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1576 sessionId: src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0 is DEAD
2025-10-10T14:35:09.015851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:09.025976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.026189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:09.026204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1577
2025-10-10T14:35:09.026326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.026361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:09.026371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:09.026376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:09.026917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1577 sessionId:  describe result for acl check
2025-10-10T14:35:09.026970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:09.026975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:09.026979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:09.026985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601613936650082:9716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:09.027587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601613936650082:9716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:09.029375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:09.029692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601613936650082:9716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:09.031688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:09.031931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:09.031941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:09.031953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:09.032016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:09.032059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601613154425551:9149]
2025-10-10T14:35:09.032265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601613936650082:9716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:09.032278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601613936650082:9716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:09.032281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601613936650082:9716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:09.032290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:09.032642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:09.032957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:09.033009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:09.033358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:09.033426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.033432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.033433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.033434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.033436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.033437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.033438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.033440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.033441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.033442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.033443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.033444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.033445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.033451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.033464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.033468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.033472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.033475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.033480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.033483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.033487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.033491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.033495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.033499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.033502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.033506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.033513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.033522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.033528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.033534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.033538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.033543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.033547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.033552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.033557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.033561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.033566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.033571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.033576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.033581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.033586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.033591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.033595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.033600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.033605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.033610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.033623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.033628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.033633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.033638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.033642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.033647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.033685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:09.036059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:09.036630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:09.036640Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:09.036643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:09.036646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:09.036652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1576 [2:7559601613154425551:9149]
2025-10-10T14:35:09.036665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:09.036687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:09.036695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.036698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.036700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.036718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:09.036730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:09.036741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:09.036799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.036807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.036809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.036811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:09.036878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:09.036887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.036898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.036910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.036926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:09.036949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936649991:2438], now have 1 active actors on pipe
2025-10-10T14:35:09.036957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650144:9716], now have 1 active actors on pipe
2025-10-10T14:35:09.036966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601613154425546:9149]
2025-10-10T14:35:09.036968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601613154425546:9149]
2025-10-10T14:35:09.036970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601613154425546:9149]
2025-10-10T14:35:09.036987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:09.036994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1576
2025-10-10T14:35:09.037000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:09.037013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:09.037016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:09.037017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:09.037018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:09.037022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:09.037056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601613154425546:9149]
2025-10-10T14:35:09.037063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:09.037067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:09.037022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1576
2025-10-10T14:35:09.037084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.037092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.037143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:09.037154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.037158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.037160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:09.037170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.037187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:09.037211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.037375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.037385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.037400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.037496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1577 partition: 0 MaxSeqNo: 40 sessionId: src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0
2025-10-10T14:35:09.037835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230f3ad8-9cb0b698-ff3e2199-75fe13c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:09.040398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0] Write session: try to update token
2025-10-10T14:35:09.040416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:09.056319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId: src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:09.056511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:09.056530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:09.056534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:09.056536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:09.056546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601613154425546:9149]
2025-10-10T14:35:09.056552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601613154425546:9149]
2025-10-10T14:35:09.056556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601613154425546:9149]
2025-10-10T14:35:09.056609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:09.056612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:09.056620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:09.056622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.056624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:09.056625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:09.056767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:09.059167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:09.116117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601613936650156:9272]
2025-10-10T14:35:09.116471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1576, pipe: [1:7559601613936650156:9272]
2025-10-10T14:35:09.175629Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:09.175910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.175926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.175972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650156:9272], now have 1 active actors on pipe
2025-10-10T14:35:09.176219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:09.176778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:09.176790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0] Write session will restart in 0.005756s
2025-10-10T14:35:09.176816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0] Write session: Do CDS request
2025-10-10T14:35:09.176822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:09.176283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601613936650156:9272]
2025-10-10T14:35:09.176302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:09.176318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:09.176407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1577 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0
2025-10-10T14:35:09.176624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1577 sessionId: src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0 is DEAD
2025-10-10T14:35:09.183921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.183961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:09.183976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1578
2025-10-10T14:35:09.184187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.184251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:09.184261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:09.184266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:09.184742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1578 sessionId:  describe result for acl check
2025-10-10T14:35:09.184781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:09.184788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:09.184790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:09.184796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601613936650172:9720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:09.185379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601613936650172:9720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:09.188177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601613936650172:9720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:09.191051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601613936650172:9720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:09.191070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601613936650172:9720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:09.191074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601613936650172:9720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:09.191083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:09.191098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:09.193359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:09.193590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:09.193606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:09.193621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:09.193682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:09.193729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601613154425714:9151]
2025-10-10T14:35:09.194323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:09.194676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:09.194725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:09.195063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:09.195135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.195144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.195145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.195147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.195148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.195149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.195150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.195151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.195153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.195154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.195155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.195156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.195158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.195164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.195177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.195181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.195186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.195190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.195193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.195197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.195201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.195205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.195210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.195214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.195218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.195222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.195230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.195239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.195246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.195251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.195256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.195261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.195265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.195270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.195275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.195280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.195285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.195289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.195295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.195303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.195313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.195319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.195326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.195331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.195335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.195341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.195350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.195355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.195365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.195370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.195379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.195384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.195424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:09.197888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:09.198418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:09.198433Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:09.198435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:09.198439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:09.198445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1577 [2:7559601613154425714:9151]
2025-10-10T14:35:09.198460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:09.198477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:09.198481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.198484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.198486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.198503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:09.198512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:09.198520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:09.198578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.198588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.198590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.198592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:09.198660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:09.198668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.198680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.198692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.198713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:09.198740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650310:9720], now have 1 active actors on pipe
2025-10-10T14:35:09.198748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650157:2438], now have 1 active actors on pipe
2025-10-10T14:35:09.198756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601613154425708:9151]
2025-10-10T14:35:09.198758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601613154425708:9151]
2025-10-10T14:35:09.198762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601613154425708:9151]
2025-10-10T14:35:09.198776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:09.198806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:09.198809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:09.198814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:09.198816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:09.198825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:09.198796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1577
2025-10-10T14:35:09.198828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:09.198812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1577
2025-10-10T14:35:09.198855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601613154425708:9151]
2025-10-10T14:35:09.198858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:09.198860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:09.198873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.198884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.198936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:09.198949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.198954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.198957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:09.198973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.198988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:09.199015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.199163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.199170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.199187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.199293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1578 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0
2025-10-10T14:35:09.199724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24cb09ff-80f3a75e-5c1afff4-5e4b2b36_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:09.202477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0] Write session: try to update token
2025-10-10T14:35:09.202493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:09.219221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:09.219245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:09.219249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:09.219251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:09.219262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601613154425708:9151]
2025-10-10T14:35:09.219267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601613154425708:9151]
2025-10-10T14:35:09.219272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601613154425708:9151]
2025-10-10T14:35:09.219326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:09.219339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.219338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:09.219342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:09.219345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:09.219350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:09.219488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:09.224190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId: src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:09.226943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:09.276404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601613936650323:9272]
2025-10-10T14:35:09.276701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1577, pipe: [1:7559601613936650323:9272]
2025-10-10T14:35:09.340253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:09.340270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0] Write session will restart in 0.005506s
2025-10-10T14:35:09.340296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0] Write session: Do CDS request
2025-10-10T14:35:09.340304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:09.339750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601613936650323:9272]
2025-10-10T14:35:09.339795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:09.339798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:09.339885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1578 reason: error at write: Disconnected sessionId: src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0
2025-10-10T14:35:09.340107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:09.340117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1578 sessionId: src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0 is DEAD
2025-10-10T14:35:09.338940Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:09.339342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.339356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.339406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650323:9272], now have 1 active actors on pipe
2025-10-10T14:35:09.339837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:09.346903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.347080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:09.347095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1579
2025-10-10T14:35:09.347265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.347301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:09.347310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:09.347314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:09.348113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1579 sessionId:  describe result for acl check
2025-10-10T14:35:09.348153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:09.348161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:09.348163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:09.348169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601613936650334:9724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:09.348748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601613936650334:9724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:09.350936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601613936650334:9724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:09.356575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601613936650334:9724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:09.356591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601613936650334:9724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:09.356595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601613936650334:9724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:09.356604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:09.360628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:09.362766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:09.363008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:09.363017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:09.363029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:09.363082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:09.363126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601613154425908:9159]
2025-10-10T14:35:09.363646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:09.363922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:09.363990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:09.364274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:09.364329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.364334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.364335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.364337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.364338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.364339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.364340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.364341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.364343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.364344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.364345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.364347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.364347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.364353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.364366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.364370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.364375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.364378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.364382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.364386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.364389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.364393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.364398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.364402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.364406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.364410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.364418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.364428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.364435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.364445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.364452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.364461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.364467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.364476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.364481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.364490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.364493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.364498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.364505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.364510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.364515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.364521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.364530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.364535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.364543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.364549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.364557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.364562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.364570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.364575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.364580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.364589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.364627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:09.367057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:09.367360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:09.367371Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:09.367373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:09.367377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:09.367383Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1578 [2:7559601613154425908:9159]
2025-10-10T14:35:09.367395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:09.367413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:09.367421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.367425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.367427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.367444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:09.367456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:09.367464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:09.367526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.367532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.367534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.367537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:09.367605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:09.367625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.367640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.367656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.367678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:09.367703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650324:2438], now have 1 active actors on pipe
2025-10-10T14:35:09.367707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650436:9724], now have 1 active actors on pipe
2025-10-10T14:35:09.367715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601613154425903:9159]
2025-10-10T14:35:09.367717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601613154425903:9159]
2025-10-10T14:35:09.367720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601613154425903:9159]
2025-10-10T14:35:09.367734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:09.367748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:09.367752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:09.367755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:09.367757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:09.367769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:09.367772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:09.367748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1578
2025-10-10T14:35:09.367759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1578
2025-10-10T14:35:09.367800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601613154425903:9159]
2025-10-10T14:35:09.367811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:09.367818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:09.367826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.367831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.367882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:09.367893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.367897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.367899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:09.367911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.367925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:09.367945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.368101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.368112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.368126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.368209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1579 partition: 0 MaxSeqNo: 40 sessionId: src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0
2025-10-10T14:35:09.368566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5a02c8-f5832d55-93e06e9a-bb76e790_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:09.371186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0] Write session: try to update token
2025-10-10T14:35:09.371200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:09.387426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:09.387447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:09.387450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:09.387453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:09.387463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601613154425903:9159]
2025-10-10T14:35:09.387467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601613154425903:9159]
2025-10-10T14:35:09.387471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601613154425903:9159]
2025-10-10T14:35:09.387518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:09.387523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:09.387526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:09.387530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:09.387531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.387533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:09.387673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:09.389406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId: src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:09.392041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:09.439630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601613936650514:9272]
2025-10-10T14:35:09.440030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1578, pipe: [1:7559601613936650514:9272]
2025-10-10T14:35:09.508437Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:09.508918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.508937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.508986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650514:9272], now have 1 active actors on pipe
2025-10-10T14:35:09.509401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:09.509902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:09.509915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0] Write session will restart in 0.006854s
2025-10-10T14:35:09.509940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0] Write session: Do CDS request
2025-10-10T14:35:09.509946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:09.509309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:09.509354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601613936650514:9272]
2025-10-10T14:35:09.509376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:09.509379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:09.509442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1579 reason: error at write: Disconnected sessionId: src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0
2025-10-10T14:35:09.509666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1579 sessionId: src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0 is DEAD
2025-10-10T14:35:09.517912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.517943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:09.517960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1580
2025-10-10T14:35:09.518153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.518192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:09.518203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:09.518208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:09.518754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1580 sessionId:  describe result for acl check
2025-10-10T14:35:09.518803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:09.518810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:09.518812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:09.518818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601613936650532:9737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:09.519386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601613936650532:9737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:09.522348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601613936650532:9737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:09.524888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:09.525239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601613936650532:9737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:09.525254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601613936650532:9737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:09.525257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601613936650532:9737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:09.525266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:09.529086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:09.529373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:09.529387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:09.529401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:09.529469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:09.529511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601613154426079:9168]
2025-10-10T14:35:09.530168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:09.530480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:09.530526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:09.530860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:09.530927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.530935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.530936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.530937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.530939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.530940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.530941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.530943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.530944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.530945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.530947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.530948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.530950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.530957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.530971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.530975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.530980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.530984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.530989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.530993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.530998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.531003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.531007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.531012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.531016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.531021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.531030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.531039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.531046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.531053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.531058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.531064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.531069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.531075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.531080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.531086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.531091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.531097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.531104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.531110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.531115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.531124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.531135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.531141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.531146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.531152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.531157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.531163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.531168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.531174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.531180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.531186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.531234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:09.534220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:09.534744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:09.534757Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:09.534760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:09.534765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:09.534783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1579 [2:7559601613154426079:9168]
2025-10-10T14:35:09.534798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:09.534820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:09.534823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.534828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.534831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.534850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:09.534859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:09.534867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:09.534938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.534947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.534950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.534953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:09.535018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:09.535026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.535039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.535052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.535069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:09.535093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650516:2438], now have 1 active actors on pipe
2025-10-10T14:35:09.535102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650671:9737], now have 1 active actors on pipe
2025-10-10T14:35:09.535110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601613154426073:9168]
2025-10-10T14:35:09.535112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601613154426073:9168]
2025-10-10T14:35:09.535114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601613154426073:9168]
2025-10-10T14:35:09.535128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:09.535140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:09.535143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:09.535145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:09.535148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:09.535167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:09.535171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:09.535130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1579
2025-10-10T14:35:09.535145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1579
2025-10-10T14:35:09.535208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601613154426073:9168]
2025-10-10T14:35:09.535226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:09.535226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:09.535241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.535247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.535307Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:09.535323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.535327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.535330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:09.535341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.535367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:09.535386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.535597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.535606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.535622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.535748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1580 partition: 0 MaxSeqNo: 40 sessionId: src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0
2025-10-10T14:35:09.536200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb003988-ef6da69f-340949b7-ff9dbc58_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:09.538917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0] Write session: try to update token
2025-10-10T14:35:09.538936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:09.554046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId: src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:09.556812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:09.558248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.558277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.558303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:09.558306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:09.558310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:09.558313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:09.558323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601613154426073:9168]
2025-10-10T14:35:09.558328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601613154426073:9168]
2025-10-10T14:35:09.558331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601613154426073:9168]
2025-10-10T14:35:09.558394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:09.558395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:09.558402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:09.558406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:09.558411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.558414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:09.558554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:09.609761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601613936650685:9272]
2025-10-10T14:35:09.610094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1579, pipe: [1:7559601613936650685:9272]
2025-10-10T14:35:09.670892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:09.671366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:09.671424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650685:9272], now have 1 active actors on pipe
2025-10-10T14:35:09.672043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:09.672161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:09.672169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:09.672270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1580 reason: error at write: Disconnected sessionId: src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0
2025-10-10T14:35:09.672451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:09.672466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1580 sessionId: src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0 is DEAD
2025-10-10T14:35:09.672497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601613936650685:9272]
2025-10-10T14:35:09.672622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:09.672635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0] Write session will restart in 0.008264s
2025-10-10T14:35:09.672660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0] Write session: Do CDS request
2025-10-10T14:35:09.672666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:09.681952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.682059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:09.682075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1581
2025-10-10T14:35:09.682232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.682279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:09.682290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:09.682295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:09.682787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1581 sessionId:  describe result for acl check
2025-10-10T14:35:09.682824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:09.682826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:09.682829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:09.682834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601613936650720:9743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:09.683405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601613936650720:9743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:09.685508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601613936650720:9743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:09.689440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601613936650720:9743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:09.689462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601613936650720:9743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:09.689466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601613936650720:9743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:09.689475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:09.701671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:09.705256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:09.705556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:09.705580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:09.705601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:09.705679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:09.705728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601613154426258:9171]
2025-10-10T14:35:09.706298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:09.709747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:09.709827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:09.710231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:09.710300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.710302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.710303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.710305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.710307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.710309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.710310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.710311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.710313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.710314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.710316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.710317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.710318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.710326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.710340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.710345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.710349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.710354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.710358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.710362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.710367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.710371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.710375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.710379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.710384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.710388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.710397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.710407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.710413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.710419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.710424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.710430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.710435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.710441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.710447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.710452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.710471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.710482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.710487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.710494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.710498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.710504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.710510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.710515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.710520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.710525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.710530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.710535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.710551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.710563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.710568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.710574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.710620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:09.713507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:09.714170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:09.714183Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:09.714186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:09.714190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:09.714198Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1580 [2:7559601613154426258:9171]
2025-10-10T14:35:09.714212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:09.714233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:09.714242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.714245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.714248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.714268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:09.714282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:09.714295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:09.714362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.714372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.714375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.714378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:09.714453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:09.714461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.714474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.714493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.714518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:09.714541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650795:9743], now have 1 active actors on pipe
2025-10-10T14:35:09.714545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650707:2438], now have 1 active actors on pipe
2025-10-10T14:35:09.714554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601613154426250:9171]
2025-10-10T14:35:09.714556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601613154426250:9171]
2025-10-10T14:35:09.714559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601613154426250:9171]
2025-10-10T14:35:09.714568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:09.714587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:09.714587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:09.714590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:09.714592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:09.714606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:09.714610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:09.714640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601613154426250:9171]
2025-10-10T14:35:09.714653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:09.714688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:09.714911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1580
2025-10-10T14:35:09.714914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1580
2025-10-10T14:35:09.715259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.715270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.715306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:09.715334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.715344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.715347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:09.715363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.715376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:09.715408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.715664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.715673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.715689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.715805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1581 partition: 0 MaxSeqNo: 40 sessionId: src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0
2025-10-10T14:35:09.716226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d36c1a6d-625cbbb6-b7927024-470c806e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:09.719270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0] Write session: try to update token
2025-10-10T14:35:09.719292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:09.739449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:09.739469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:09.739473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:09.739476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:09.739487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601613154426250:9171]
2025-10-10T14:35:09.739508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601613154426250:9171]
2025-10-10T14:35:09.739513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601613154426250:9171]
2025-10-10T14:35:09.739566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:09.739575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.739578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:09.739621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:09.739635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:09.739640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:09.739720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:09.740309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId: src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:09.743119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:09.772505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601613936650879:9272]
2025-10-10T14:35:09.773257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1580, pipe: [1:7559601613936650879:9272]
2025-10-10T14:35:09.858918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:09.859332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.859343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.859390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650879:9272], now have 1 active actors on pipe
2025-10-10T14:35:09.859921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:09.860871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:09.860885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0] Write session will restart in 0.007152s
2025-10-10T14:35:09.860911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0] Write session: Do CDS request
2025-10-10T14:35:09.860917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:09.860198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:09.860212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:09.860277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1581 reason: error at write: Disconnected sessionId: src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0
2025-10-10T14:35:09.860477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1581 sessionId: src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0 is DEAD
2025-10-10T14:35:09.860621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601613936650879:9272]
2025-10-10T14:35:09.860634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:09.869943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.873682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:09.873699Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1582
2025-10-10T14:35:09.874087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:09.874130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:09.874136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:09.874140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:09.874599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1582 sessionId:  describe result for acl check
2025-10-10T14:35:09.874633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:09.874638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:09.874640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:09.874647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601613936650922:9747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:09.875229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601613936650922:9747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:09.883793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601613936650922:9747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:09.888097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601613936650922:9747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:09.888115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601613936650922:9747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:09.888119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601613936650922:9747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:09.888129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:09.889573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:09.896240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:09.896628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:09.896633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:09.896648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:09.896727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:09.896825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601613154426426:9174]
2025-10-10T14:35:09.897516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:09.898754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:09.898837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:09.899223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:09.899278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.899281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.899282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.899284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.899285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.899287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.899289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.899290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.899292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.899293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.899295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.899296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.899297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.899305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.899320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.899325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.899330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.899334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.899339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.899344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.899348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.899352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.899358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.899362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.899366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.899371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.899380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.899390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:09.899398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.899404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:09.899410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.899417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:09.899421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.899427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:09.899435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.899441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:09.899446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.899452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:09.899457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.899463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:09.899468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.899474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:09.899479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.899485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:09.899490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.899496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:09.899501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.899509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.899514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.899520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.899524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.899531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.899577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:09.905706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:09.906278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:09.906295Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:09.906299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:09.906303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:09.906311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1581 [2:7559601613154426426:9174]
2025-10-10T14:35:09.906329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:09.906353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:09.906361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.906365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.906368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.906388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:09.906402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:09.906416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:09.906485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.906493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.906496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.906499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:09.906577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:09.906589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.906602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:09.906787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1581
2025-10-10T14:35:09.906616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:09.906825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1581
2025-10-10T14:35:09.906635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:09.906659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601613154426420:9174]
2025-10-10T14:35:09.906662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601613154426420:9174]
2025-10-10T14:35:09.906665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601613154426420:9174]
2025-10-10T14:35:09.906678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:09.906686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:09.906689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:09.906694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:09.906697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936651037:9747], now have 1 active actors on pipe
2025-10-10T14:35:09.906702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936650881:2438], now have 1 active actors on pipe
2025-10-10T14:35:09.906708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:09.906727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:09.906731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:09.906787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601613154426420:9174]
2025-10-10T14:35:09.906796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:09.906803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:09.910292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.910314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.910371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27447173-e64c46c2-949403c4-c967c20e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:09.910390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:09.910397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:09.910400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:09.910416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:09.910437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:09.910460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.910774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.910784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.910809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:09.910929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1582 partition: 0 MaxSeqNo: 40 sessionId: src_id|27447173-e64c46c2-949403c4-c967c20e_0
2025-10-10T14:35:09.911429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d431b971-eafd0bb1-920bacdf-1f04a729_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|27447173-e64c46c2-949403c4-c967c20e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:09.914258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27447173-e64c46c2-949403c4-c967c20e_0] Write session: try to update token
2025-10-10T14:35:09.914277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27447173-e64c46c2-949403c4-c967c20e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:09.934548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId: src_id|27447173-e64c46c2-949403c4-c967c20e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:09.937490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:09.939774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:09.939233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:09.939263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:09.939305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:09.942949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:09.942970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:09.942974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:09.942976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:09.942987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601613154426420:9174]
2025-10-10T14:35:09.942992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601613154426420:9174]
2025-10-10T14:35:09.942998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601613154426420:9174]
2025-10-10T14:35:09.943056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:09.943065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:09.943068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:09.943265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:09.945656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:09.945667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:09.945672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:09.965400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601613936651052:9272]
2025-10-10T14:35:09.969866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1581, pipe: [1:7559601613936651052:9272]
2025-10-10T14:35:10.060897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:10.061347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601613936651052:9272], now have 1 active actors on pipe
2025-10-10T14:35:10.069883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.069910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.070107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.070178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.070258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.070329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.070727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.070748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.070842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.070911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.070983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.071064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.071112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.071115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.071198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.071274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.071395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.071466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.071512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.071517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.071617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.071701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.071771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.071839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.071884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.071890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.071978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.072087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.072182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.072266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.072317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.072320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.072415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.072520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.072597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.072667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.072752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.072757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.072875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.072962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.073052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.073127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.073790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.073803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.073969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.074061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.074162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.074267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.074318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.074326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.074423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.074557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.074627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.074784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.074877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.074890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.075023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.075092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.075166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.075251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.075383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.075395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.076020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601613936651052:9272]
2025-10-10T14:35:10.076067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:10.076071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:10.076109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1582 reason: error at write: Disconnected sessionId: src_id|27447173-e64c46c2-949403c4-c967c20e_0
2025-10-10T14:35:10.076411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1582 sessionId: src_id|27447173-e64c46c2-949403c4-c967c20e_0 is DEAD
2025-10-10T14:35:10.076513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:10.076926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:10.076949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27447173-e64c46c2-949403c4-c967c20e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:10.076964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27447173-e64c46c2-949403c4-c967c20e_0] Write session will restart in 0.005202s
2025-10-10T14:35:10.076996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27447173-e64c46c2-949403c4-c967c20e_0] Write session: Do CDS request
2025-10-10T14:35:10.077002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27447173-e64c46c2-949403c4-c967c20e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:10.085910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27447173-e64c46c2-949403c4-c967c20e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.088523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:10.088541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1583
2025-10-10T14:35:10.089448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.089495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:10.089500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:10.089504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:10.089955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1583 sessionId:  describe result for acl check
2025-10-10T14:35:10.089988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:10.089990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:10.089992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:10.089998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601618231618370:9751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:10.090608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601618231618370:9751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:10.106516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601618231618370:9751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:10.111854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601618231618370:9751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:10.111873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601618231618370:9751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:10.111877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601618231618370:9751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:10.111887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:10.115314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:10.118271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:10.118593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:10.118605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:10.118618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:10.118681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:10.118726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601617449393891:9176]
2025-10-10T14:35:10.119375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:10.119903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:10.119947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:10.120286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:10.120349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.120355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.120356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.120357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.120359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.120360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.120362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.120363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.120364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.120366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.120367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.120368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.120370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.120376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.120391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.120395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.120399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.120403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.120408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.120413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.120417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.120421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.120426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.120430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.120435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.120439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.120447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.120456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.120463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.120468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.120473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.120477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.120490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.120495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.120523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.120533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.120538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.120543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.120548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.120553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.120558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.120568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.120573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.120578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.120583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.120602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.120612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.120617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.120623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.120633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.120639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.120644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.120692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:10.123266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:10.123600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:10.123614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:10.123617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:10.123621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:10.123629Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1582 [2:7559601617449393891:9176]
2025-10-10T14:35:10.123643Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:10.123662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:10.123665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.123669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.123671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.123688Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:10.123697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:10.123705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:10.123783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.123785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.123787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.123790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:10.123864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:10.123867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.123879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.123893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.123911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:10.123935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618355:2438], now have 1 active actors on pipe
2025-10-10T14:35:10.124200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618508:9751], now have 1 active actors on pipe
2025-10-10T14:35:10.124211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601617449393886:9176]
2025-10-10T14:35:10.124214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601617449393886:9176]
2025-10-10T14:35:10.124216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601617449393886:9176]
2025-10-10T14:35:10.124234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:10.124250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:10.124264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:10.124269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:10.124270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:10.124272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:10.124273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:10.124301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601617449393886:9176]
2025-10-10T14:35:10.124309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:10.124329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:10.124565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.124576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.124607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:10.124622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.124626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.124629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:10.124641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.124653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:10.124668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.124299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1582
2025-10-10T14:35:10.124832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.124841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.124348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1582
2025-10-10T14:35:10.124858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.124969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1583 partition: 0 MaxSeqNo: 40 sessionId: src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0
2025-10-10T14:35:10.125417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27447173-e64c46c2-949403c4-c967c20e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:10.128028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0] Write session: try to update token
2025-10-10T14:35:10.128046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:10.141125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:10.141149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:10.141161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601617449393886:9176]
2025-10-10T14:35:10.141211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:10.141217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:10.141454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:10.141619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.141783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.141947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.142440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:10.142486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:10.145349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId: src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:10.148104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:10.148402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.148428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.148483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:10.148581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:10.169411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:10.169436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:10.169440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:10.169443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:10.169455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601617449393886:9176]
2025-10-10T14:35:10.169460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601617449393886:9176]
2025-10-10T14:35:10.169466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601617449393886:9176]
2025-10-10T14:35:10.169519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:10.169523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:10.169531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:10.169533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.169536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:10.169536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:10.169806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:10.176479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601618231618525:9272]
2025-10-10T14:35:10.177325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1582, pipe: [1:7559601618231618525:9272]
2025-10-10T14:35:10.295434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:10.303993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.304028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.304210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.304267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.304322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.304380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.304422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.304427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.304502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.304558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.304614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.304678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.304719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.304723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.304788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.304843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.304903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.304960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.304998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.305001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.305073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.305132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.305189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.305247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.305284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.305287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.305539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.305604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.305668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.305731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.307805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:10.307840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601618231618525:9272]
2025-10-10T14:35:10.307881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:10.307889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:10.307929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1583 reason: error at write: Disconnected sessionId: src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0
2025-10-10T14:35:10.308145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1583 sessionId: src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0 is DEAD
2025-10-10T14:35:10.308329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:10.308343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0] Write session will restart in 0.008118s
2025-10-10T14:35:10.308380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0] Write session: Do CDS request
2025-10-10T14:35:10.308387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:10.305777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.305788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.305866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.305930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.305988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.306047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.306087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.306090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.306158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.306215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.306277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.306334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.306378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.306382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.306449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.306507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.306565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.306621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.306658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.306662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.306740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.306817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.306885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.306947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.306988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.306991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.307070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.307137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.307203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.307262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.307305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.307308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.307377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618525:9272], now have 1 active actors on pipe
2025-10-10T14:35:10.308552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:10.317933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.318329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:10.318348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1584
2025-10-10T14:35:10.318540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.318578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:10.318584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:10.318588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:10.318965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1584 sessionId:  describe result for acl check
2025-10-10T14:35:10.319004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:10.319005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:10.319007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:10.319012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601618231618541:9755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:10.319470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601618231618541:9755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:10.323217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601618231618541:9755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:10.325903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601618231618541:9755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:10.325924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601618231618541:9755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:10.325927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601618231618541:9755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:10.325938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:10.334028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:10.340240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:10.340589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:10.340601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:10.340616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:10.340685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:10.340740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601617449394061:9178]
2025-10-10T14:35:10.341416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:10.341803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:10.341855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:10.342207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:10.342270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.342277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.342278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.342280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.342281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.342284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.342285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.342287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.342288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.342290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.342291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.342292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.342294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.342301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.342316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.342321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.342325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.342330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.342335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.342339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.342344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.342348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.342352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.342357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.342361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.342365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.342374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.342383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.342393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.342399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.342404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.342410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.342416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.342422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.342437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.342443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.342448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.342454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.342460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.342466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.342472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.342478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.342484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.342490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.342495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.342502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.342507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.342513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.342523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.342529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.342539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.342545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.342587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:10.346569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:10.347608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1583
2025-10-10T14:35:10.347602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1583
2025-10-10T14:35:10.346917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:10.346931Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:10.346935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:10.346939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:10.346945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1583 [2:7559601617449394061:9178]
2025-10-10T14:35:10.346959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:10.346978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:10.346981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.347000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.347003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.347022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:10.347031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:10.347041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:10.347107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.347110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.347112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.347115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:10.347190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:10.347193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.347214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.347226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.347242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:10.347263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601617449394056:9178]
2025-10-10T14:35:10.347266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601617449394056:9178]
2025-10-10T14:35:10.347269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601617449394056:9178]
2025-10-10T14:35:10.347289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:10.347304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:10.347320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:10.347323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:10.347348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:10.347354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601617449394056:9178]
2025-10-10T14:35:10.347354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:10.347357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:10.347357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:10.347385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:10.347894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618577:9755], now have 1 active actors on pipe
2025-10-10T14:35:10.347905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618528:2438], now have 1 active actors on pipe
2025-10-10T14:35:10.347923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.347933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.347971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:10.347984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.347993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.347996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:10.348011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.348027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:10.348049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.348258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.348264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.348281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.349181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|368a32e5-d85d89ca-c618752d-a79fb0cc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:10.348421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1584 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0
2025-10-10T14:35:10.352077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0] Write session: try to update token
2025-10-10T14:35:10.352095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:10.365356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:10.365375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:10.365385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601617449394056:9178]
2025-10-10T14:35:10.365439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:10.365441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:10.365639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:10.365790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.365938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.366082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.366282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:10.366329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:10.367645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId: src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:10.370793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.370813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.370863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:10.370351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:10.371088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:10.389550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:10.389571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:10.389574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:10.389576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:10.389589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601617449394056:9178]
2025-10-10T14:35:10.389593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601617449394056:9178]
2025-10-10T14:35:10.389598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601617449394056:9178]
2025-10-10T14:35:10.389653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:10.389660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.389663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:10.389797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:10.393901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:10.393922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:10.393926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:10.407870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601618231618700:9272]
2025-10-10T14:35:10.408163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1583, pipe: [1:7559601618231618700:9272]
2025-10-10T14:35:10.506372Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:10.514936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.514968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.515160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.515231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.515306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.515379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.515838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.515855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.515942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.516009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.516079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.516151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.516200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.516208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.516278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.516340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.516408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.516477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.516521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.516529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.516597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.516661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.516727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.516794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.516845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.516858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.516927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.516989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.517049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.517117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.517163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.517166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.517237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.517298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.517478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.517551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.517604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.517606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.517681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.517740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.517804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.517872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.517912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.517915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.517984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.518044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.518102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.518159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.518221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.518227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.518294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.518352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.518459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.518523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.518566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.518569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.518638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.518699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.518776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.518838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.518883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.518885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.518969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618700:9272], now have 1 active actors on pipe
2025-10-10T14:35:10.525627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:10.525919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601618231618700:9272]
2025-10-10T14:35:10.525959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:10.526004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1584 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0
2025-10-10T14:35:10.526199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1584 sessionId: src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0 is DEAD
2025-10-10T14:35:10.526312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:10.526324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0] Write session will restart in 0.007510s
2025-10-10T14:35:10.526348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0] Write session: Do CDS request
2025-10-10T14:35:10.526358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:10.526369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:10.534925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.535041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:10.535055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1585
2025-10-10T14:35:10.537531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.537596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:10.537608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:10.537613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:10.538133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1585 sessionId:  describe result for acl check
2025-10-10T14:35:10.538170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:10.538172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:10.538174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:10.538181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601618231618763:9768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:10.538777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601618231618763:9768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:10.541499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601618231618763:9768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:10.543630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:10.546187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:10.546435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:10.546447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:10.546460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:10.546520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:10.546563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601617449394267:9193]
2025-10-10T14:35:10.547443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:10.547800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:10.547849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:10.548213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:10.548275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.548281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.548283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.548284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.548285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.548286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.548288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.548289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.548290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.548291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.548293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.548294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.548295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.548302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.548315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.548319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.548323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.548327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.548331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.548333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.548335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.548337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.548340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.548342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.548344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.548346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.548354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.548360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.548365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.548370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.548374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.548379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.548383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.548395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.548401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.548410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.548414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.548419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.548424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.548434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.548438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.548443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.548451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.548456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.548460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.548465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.548470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.548484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.548492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.548497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.548503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.548513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.548552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:10.549968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601618231618763:9768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:10.549986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601618231618763:9768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:10.549990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601618231618763:9768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:10.550000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:10.551417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:10.551742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:10.551755Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:10.551758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:10.551762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:10.551770Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1584 [2:7559601617449394267:9193]
2025-10-10T14:35:10.551783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:10.551802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:10.551805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.551809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.551812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.551830Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:10.551843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:10.551856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:10.551921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.551930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.551932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.551935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:10.551999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:10.552006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.552018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.552032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.552057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:10.552083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601617449394262:9193]
2025-10-10T14:35:10.552090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601617449394262:9193]
2025-10-10T14:35:10.552092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601617449394262:9193]
2025-10-10T14:35:10.552105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:10.552121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618729:2438], now have 1 active actors on pipe
2025-10-10T14:35:10.552128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618891:9768], now have 1 active actors on pipe
2025-10-10T14:35:10.552136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:10.552140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:10.552142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:10.552152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:10.552171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:10.552180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:10.552209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601617449394262:9193]
2025-10-10T14:35:10.552217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:10.552219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:10.552320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.552333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.552367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:10.552382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.552387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.552177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1584
2025-10-10T14:35:10.552390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:10.552402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.552414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:10.552228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1584
2025-10-10T14:35:10.552431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.552720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.552732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.552754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.552848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1585 partition: 0 MaxSeqNo: 40 sessionId: src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0
2025-10-10T14:35:10.553260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac99d7a3-9cff93e8-95bd3d68-4f1e9bba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:10.555950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0] Write session: try to update token
2025-10-10T14:35:10.555967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:10.563553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:10.563570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:10.563580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601617449394262:9193]
2025-10-10T14:35:10.563628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:10.563635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:10.563859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:10.564021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.564152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.564283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:10.564462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:10.564502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:10.569873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId: src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:10.572504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:10.572724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.572745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.572787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:10.572939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:10.583453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:10.583471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:10.583475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:10.583477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:10.583489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601617449394262:9193]
2025-10-10T14:35:10.583494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601617449394262:9193]
2025-10-10T14:35:10.583499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601617449394262:9193]
2025-10-10T14:35:10.583547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:10.583549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:10.583554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:10.583559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:10.583559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.583562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:10.583707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:10.625485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601618231618899:9272]
2025-10-10T14:35:10.625727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1584, pipe: [1:7559601618231618899:9272]
2025-10-10T14:35:10.700743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:10.709347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.709374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.709559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.709623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.709692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.709756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.709805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.709819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.709887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.709945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.710002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.710063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.710102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.710106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.710176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.710233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.710298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.710356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.710402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.710408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.710477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.710919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.710979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.711038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.711078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.711081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.711149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.711208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.711266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.711326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.711369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.711371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.711437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.711491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.711545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.711601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.711702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.711705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.711770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.711823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.711883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.711938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.711976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.711979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.712045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.712102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.712163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.712223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.712263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.712267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.712332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.712388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.712445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.712500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.712541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.712545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.712609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:10.712663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:10.712720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:10.712776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:10.712813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:10.712816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:10.712900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618899:9272], now have 1 active actors on pipe
2025-10-10T14:35:10.713421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:10.713974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:10.713982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0] Write session will restart in 0.007750s
2025-10-10T14:35:10.714009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0] Write session: Do CDS request
2025-10-10T14:35:10.714016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:10.713518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:10.713573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:10.713576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:10.713606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1585 reason: error at write: Disconnected sessionId: src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0
2025-10-10T14:35:10.713820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1585 sessionId: src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0 is DEAD
2025-10-10T14:35:10.713956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601618231618899:9272]
2025-10-10T14:35:10.722862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.722940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:10.722954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1586
2025-10-10T14:35:10.723091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.723137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:10.723148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:10.723153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:10.723586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1586 sessionId:  describe result for acl check
2025-10-10T14:35:10.723637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:10.723639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:10.723642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:10.723648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601618231618936:9774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:10.724237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601618231618936:9774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:10.726643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601618231618936:9774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:10.731019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601618231618936:9774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:10.731034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601618231618936:9774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:10.731038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601618231618936:9774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:10.731048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:10.738195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:10.740366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:10.740670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:10.740685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:10.740698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:10.740758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:10.740801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601617449394450:9196]
2025-10-10T14:35:10.741467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:10.742008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:10.742060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:10.742408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:10.742468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.742476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.742478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.742479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.742481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.742482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.742484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.742485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.742486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.742487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.742489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.742490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.742491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.742498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.742514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.742519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.742523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.742528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.742533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.742537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.742541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.742546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.742551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.742555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.742560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.742565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.742573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.742582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.742590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.742597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.742603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.742610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.742615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.742622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.742627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.742633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.742638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.742644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.742649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.742655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.742659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.742665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.742671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.742677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.742681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.742687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.742691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.742698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.742702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.742707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.742713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.742719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.742777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:10.745501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:10.746311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:10.746327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:10.746329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:10.746333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:10.746343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1585 [2:7559601617449394450:9196]
2025-10-10T14:35:10.746358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:10.746377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:10.746385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.746390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.746393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.746411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:10.746423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:10.746432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:10.746497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.746505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.746507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.746510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:10.746585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:10.746594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.746606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.746619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.746638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:10.746659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601617449394445:9196]
2025-10-10T14:35:10.746663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601617449394445:9196]
2025-10-10T14:35:10.746665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601617449394445:9196]
2025-10-10T14:35:10.746679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:10.746694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:10.746711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:10.746714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:10.746755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601617449394445:9196]
2025-10-10T14:35:10.746760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:10.746892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:10.746894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:10.746897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:10.746903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:10.747251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618923:2438], now have 1 active actors on pipe
2025-10-10T14:35:10.747262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231618994:9774], now have 1 active actors on pipe
2025-10-10T14:35:10.747226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1585
2025-10-10T14:35:10.747269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1585
2025-10-10T14:35:10.747386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.747397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.747430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77377d6b-89526d5e-6c62c011-94b072ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:10.747444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.747449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.747452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:10.747464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.747482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:10.747504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.747804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.747810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.747825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.747960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1586 partition: 0 MaxSeqNo: 40 sessionId: src_id|77377d6b-89526d5e-6c62c011-94b072ba_0
2025-10-10T14:35:10.748399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62fbf7d6-14c843e1-c91165a0-b8fc12ab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77377d6b-89526d5e-6c62c011-94b072ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:10.751348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77377d6b-89526d5e-6c62c011-94b072ba_0] Write session: try to update token
2025-10-10T14:35:10.751374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77377d6b-89526d5e-6c62c011-94b072ba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:10.770532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:10.770547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:10.770550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:10.770552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:10.770563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601617449394445:9196]
2025-10-10T14:35:10.770569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601617449394445:9196]
2025-10-10T14:35:10.770573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601617449394445:9196]
2025-10-10T14:35:10.770621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:10.770628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.770630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:10.770779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:10.770947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:10.770951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:10.770956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:10.776948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId: src_id|77377d6b-89526d5e-6c62c011-94b072ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:10.779535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:10.814442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601618231619097:9272]
2025-10-10T14:35:10.814859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1585, pipe: [1:7559601618231619097:9272]
2025-10-10T14:35:10.888606Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:10.889354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:10.888912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.888920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.889394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:10.888961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231619097:9272], now have 1 active actors on pipe
2025-10-10T14:35:10.889398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:10.889421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601618231619097:9272]
2025-10-10T14:35:10.889422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:10.889461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1586 reason: error at write: Disconnected sessionId: src_id|77377d6b-89526d5e-6c62c011-94b072ba_0
2025-10-10T14:35:10.889668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1586 sessionId: src_id|77377d6b-89526d5e-6c62c011-94b072ba_0 is DEAD
2025-10-10T14:35:10.889965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77377d6b-89526d5e-6c62c011-94b072ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:10.889978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77377d6b-89526d5e-6c62c011-94b072ba_0] Write session will restart in 0.009630s
2025-10-10T14:35:10.890005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77377d6b-89526d5e-6c62c011-94b072ba_0] Write session: Do CDS request
2025-10-10T14:35:10.890014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77377d6b-89526d5e-6c62c011-94b072ba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:10.900876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77377d6b-89526d5e-6c62c011-94b072ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.901233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:10.901250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1587
2025-10-10T14:35:10.901413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:10.901465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:10.901472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:10.901476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:10.901956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1587 sessionId:  describe result for acl check
2025-10-10T14:35:10.901995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:10.902001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:10.902003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:10.902009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601618231619127:9778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:10.902576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601618231619127:9778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:10.906505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601618231619127:9778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:10.912035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601618231619127:9778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:10.912051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601618231619127:9778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:10.912055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601618231619127:9778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:10.912066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:10.915423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:10.917802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:10.918021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:10.918032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:10.918043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:10.918100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:10.918146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601617449394623:9199]
2025-10-10T14:35:10.918805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:10.919336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:10.919383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:10.919740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:10.919796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.919805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.919806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.919807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.919808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.919810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.919811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.919812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.919813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.919815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.919816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.919818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.919819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.919824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.919838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.919842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.919846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.919849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.919854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.919858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.919862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.919866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.919871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.919875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.919879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.919883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.919891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.919900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:10.919908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.919914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:10.919919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.919945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:10.919950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.919956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:10.919968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.919974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:10.919978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.919984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:10.919989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.919995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:10.920001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.920013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:10.920019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.920029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:10.920034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.920043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:10.920048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.920053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.920058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.920063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.920068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.920073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.920113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:10.923443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:10.923778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:10.923794Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:10.923797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:10.923802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:10.923808Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1586 [2:7559601617449394623:9199]
2025-10-10T14:35:10.923822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:10.923841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:10.923845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.923848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.923850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.923867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:10.923883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:10.923891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:10.923950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.923958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.923960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.923962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:10.924033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:10.924044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.924055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:10.924065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:10.924080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:10.924101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601617449394618:9199]
2025-10-10T14:35:10.924103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601617449394618:9199]
2025-10-10T14:35:10.924105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601617449394618:9199]
2025-10-10T14:35:10.924114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:10.924128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:10.924134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:10.924137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:10.924139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:10.924149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:10.924151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:10.924162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231619241:9778], now have 1 active actors on pipe
2025-10-10T14:35:10.924170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231619098:2438], now have 1 active actors on pipe
2025-10-10T14:35:10.924193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601617449394618:9199]
2025-10-10T14:35:10.924201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:10.924498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1586
2025-10-10T14:35:10.924530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1586
2025-10-10T14:35:10.924691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:10.924718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.924728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.924766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61896265-9a46ba2-3c86e20d-446560fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:10.924777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:10.924783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:10.924785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:10.924799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:10.924814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:10.924831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.925462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:10.925476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:10.925498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:10.925873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1587 partition: 0 MaxSeqNo: 40 sessionId: src_id|61896265-9a46ba2-3c86e20d-446560fa_0
2025-10-10T14:35:10.929467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77377d6b-89526d5e-6c62c011-94b072ba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|61896265-9a46ba2-3c86e20d-446560fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:10.932586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61896265-9a46ba2-3c86e20d-446560fa_0] Write session: try to update token
2025-10-10T14:35:10.932611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61896265-9a46ba2-3c86e20d-446560fa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:10.948443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:10.948463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:10.948466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:10.948468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:10.948478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601617449394618:9199]
2025-10-10T14:35:10.948482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601617449394618:9199]
2025-10-10T14:35:10.948486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601617449394618:9199]
2025-10-10T14:35:10.948537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:10.948545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:10.948553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:10.948692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:10.950349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:10.950367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:10.950371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:10.964825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId: src_id|61896265-9a46ba2-3c86e20d-446560fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:10.967480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:10.989507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601618231619274:9272]
2025-10-10T14:35:10.989958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1586, pipe: [1:7559601618231619274:9272]
2025-10-10T14:35:11.065984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:11.066454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.066469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.066490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601618231619274:9272], now have 1 active actors on pipe
2025-10-10T14:35:11.066714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:11.066758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:11.066816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601618231619274:9272]
2025-10-10T14:35:11.066836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:11.066941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1587 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61896265-9a46ba2-3c86e20d-446560fa_0
2025-10-10T14:35:11.067117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1587 sessionId: src_id|61896265-9a46ba2-3c86e20d-446560fa_0 is DEAD
2025-10-10T14:35:11.067303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61896265-9a46ba2-3c86e20d-446560fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:11.067316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61896265-9a46ba2-3c86e20d-446560fa_0] Write session will restart in 0.008497s
2025-10-10T14:35:11.067341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61896265-9a46ba2-3c86e20d-446560fa_0] Write session: Do CDS request
2025-10-10T14:35:11.067348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61896265-9a46ba2-3c86e20d-446560fa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:11.076904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61896265-9a46ba2-3c86e20d-446560fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.077014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:11.077030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1588
2025-10-10T14:35:11.077199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.077244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:11.077256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:11.077260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:11.078015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1588 sessionId:  describe result for acl check
2025-10-10T14:35:11.078062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:11.078069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:11.078071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:11.078077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601622526586597:9782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:11.078662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601622526586597:9782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:11.081949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601622526586597:9782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:11.085954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601622526586597:9782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:11.085968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601622526586597:9782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:11.085972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601622526586597:9782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:11.085981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:11.090218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:11.097582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:11.097855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:11.097866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:11.097880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:11.097940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:11.097990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601621744362091:9201]
2025-10-10T14:35:11.098623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:11.098972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:11.099038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:11.099378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:11.099440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.099447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.099448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.099450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.099451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.099452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.099454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.099455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.099457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.099458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.099459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.099461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.099462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.099468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.099482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.099486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.099491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.099495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.099499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.099503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.099508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.099512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.099516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.099520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.099524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.099527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.099536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.099545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.099551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.099557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.099565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.099570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.099575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.099581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.099585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.099591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.099600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.099605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.099610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.099615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.099620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.099625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.099630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.099635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.099639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.099644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.099648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.099652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.099656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.099662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.099665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.099670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.099710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:11.102350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:11.102922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:11.102935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:11.102938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:11.102941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:11.102948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1587 [2:7559601621744362091:9201]
2025-10-10T14:35:11.102961Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:11.102982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:11.102986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.102989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.102993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.103010Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:11.103019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:11.103033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:11.103109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.103117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.103119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.103122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:11.103193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:11.103202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.103213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.103223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.103239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:11.103262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601621744362085:9201]
2025-10-10T14:35:11.103265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601621744362085:9201]
2025-10-10T14:35:11.103267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601621744362085:9201]
2025-10-10T14:35:11.103277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:11.103285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:11.103288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:11.103291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:11.103292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:11.103309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:11.103312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:11.103324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526586734:9782], now have 1 active actors on pipe
2025-10-10T14:35:11.103328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526586571:2438], now have 1 active actors on pipe
2025-10-10T14:35:11.103355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601621744362085:9201]
2025-10-10T14:35:11.103364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:11.103378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1587
2025-10-10T14:35:11.103426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1587
2025-10-10T14:35:11.103438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:11.103709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.103719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.103756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:11.103766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.103771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.103774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:11.103786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.103807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:11.103825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.104119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.104130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.104153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.104372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1588 partition: 0 MaxSeqNo: 40 sessionId: src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0
2025-10-10T14:35:11.104806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61896265-9a46ba2-3c86e20d-446560fa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:11.107541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0] Write session: try to update token
2025-10-10T14:35:11.107562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:11.128926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId: src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:11.124466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:11.124485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:11.124488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:11.124491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:11.124502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601621744362085:9201]
2025-10-10T14:35:11.124508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601621744362085:9201]
2025-10-10T14:35:11.124513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601621744362085:9201]
2025-10-10T14:35:11.124568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:11.124577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.124579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:11.124757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:11.126328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:11.126335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:11.126341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:11.131668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:11.166285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601622526586748:9272]
2025-10-10T14:35:11.167904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1587, pipe: [1:7559601622526586748:9272]
2025-10-10T14:35:11.247010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:11.247446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.247463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.247514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526586748:9272], now have 1 active actors on pipe
2025-10-10T14:35:11.247744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:11.248082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:11.248162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1588 reason: status is not ok: tablet will be restarted right now sessionId: src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0
2025-10-10T14:35:11.248345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1588 sessionId: src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0 is DEAD
2025-10-10T14:35:11.248527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:11.248535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0] Write session will restart in 0.008620s
2025-10-10T14:35:11.248522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:11.248568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0] Write session: Do CDS request
2025-10-10T14:35:11.248574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:11.248560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601622526586748:9272]
2025-10-10T14:35:11.258956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.259031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:11.259049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1589
2025-10-10T14:35:11.259199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.259229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:11.259234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:11.259239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:11.259734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1589 sessionId:  describe result for acl check
2025-10-10T14:35:11.259767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:11.259769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:11.259771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:11.259787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601622526586839:9786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:11.260378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601622526586839:9786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:11.262284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601622526586839:9786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:11.262927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:11.264746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:11.265013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:11.265025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:11.265038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:11.265098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601622526586839:9786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:11.265110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601622526586839:9786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:11.265114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601622526586839:9786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:11.265122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:11.265100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:11.265143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601621744362263:9203]
2025-10-10T14:35:11.265786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:11.266183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:11.266276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:11.266687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:11.266804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.266816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.266817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.266818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.266820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.266821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.266822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.266823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.266825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.266826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.266827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.266828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.266829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.266836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.266850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.266854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.266859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.266862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.266866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.266870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.266874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.266878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.266882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.266886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.266889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.266893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.266902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.266912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.266918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.266924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.266929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.266934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.266938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.266943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.266948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.266953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.266957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.266962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.266967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.266972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.266977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.266982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.266987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.266992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.266997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.267002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.267007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.267012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.267017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.267022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.267030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.267041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.267081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:11.269598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:11.270224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:11.270242Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:11.270245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:11.270249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:11.270258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1588 [2:7559601621744362263:9203]
2025-10-10T14:35:11.270274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:11.270294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:11.270302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.270306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.270308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.270326Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:11.270339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:11.270351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:11.270411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.270418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.270420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.270424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:11.270493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:11.270502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.270515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.270531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.270554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:11.270578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526586915:9786], now have 1 active actors on pipe
2025-10-10T14:35:11.270582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526586751:2438], now have 1 active actors on pipe
2025-10-10T14:35:11.270590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601621744362258:9203]
2025-10-10T14:35:11.270592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601621744362258:9203]
2025-10-10T14:35:11.270595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601621744362258:9203]
2025-10-10T14:35:11.270608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:11.270620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:11.270623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:11.270625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:11.270626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:11.270643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:11.270651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:11.270677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601621744362258:9203]
2025-10-10T14:35:11.270686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:11.270688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:11.270642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1588
2025-10-10T14:35:11.270692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1588
2025-10-10T14:35:11.270829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.270844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.270874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:11.270885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.270890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.270893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:11.270905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.270922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:11.270943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.271122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.271143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.271173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.271282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1589 partition: 0 MaxSeqNo: 40 sessionId: src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0
2025-10-10T14:35:11.271674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29c60ce6-4a69b1db-a02aa348-a23d051c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:11.274366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0] Write session: try to update token
2025-10-10T14:35:11.274392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:11.289665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId: src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:11.289686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:11.289703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:11.289706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:11.289708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:11.289718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601621744362258:9203]
2025-10-10T14:35:11.289723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601621744362258:9203]
2025-10-10T14:35:11.289728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601621744362258:9203]
2025-10-10T14:35:11.289775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:11.289777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:11.289781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:11.289786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:11.289786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.289788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:11.289926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:11.292325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:11.348954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601622526586929:9272]
2025-10-10T14:35:11.349571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1588, pipe: [1:7559601622526586929:9272]
2025-10-10T14:35:11.399185Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:11.399431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.399445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.399484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526586929:9272], now have 1 active actors on pipe
2025-10-10T14:35:11.399697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601622526586929:9272]
2025-10-10T14:35:11.399727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:11.399734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:11.399660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:11.399829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1589 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0
2025-10-10T14:35:11.400041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1589 sessionId: src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0 is DEAD
2025-10-10T14:35:11.400241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:11.400274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0] Write session will restart in 0.008402s
2025-10-10T14:35:11.400302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0] Write session: Do CDS request
2025-10-10T14:35:11.400308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:11.409870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.410180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:11.410196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1590
2025-10-10T14:35:11.410334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.410370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:11.410380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:11.410385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:11.410966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1590 sessionId:  describe result for acl check
2025-10-10T14:35:11.411004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:11.411008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:11.411010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:11.411015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601622526586999:9792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:11.411557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601622526586999:9792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:11.414281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601622526586999:9792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:11.414876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:11.417013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:11.417233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:11.417246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:11.417259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:11.417320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:11.417308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601622526586999:9792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:11.417322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601622526586999:9792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:11.417326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601622526586999:9792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:11.417347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:11.417383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601621744362450:9207]
2025-10-10T14:35:11.417975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:11.418300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:11.418357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:11.418695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:11.418783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.418790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.418791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.418792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.418793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.418795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.418796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.418797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.418798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.418800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.418801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.418802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.418803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.418809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.418821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.418825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.418829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.418833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.418838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.418842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.418845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.418849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.418854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.418857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.418862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.418866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.418876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.418885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.418891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.418898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.418908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.418913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.418918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.418923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.418928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.418934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.418939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.418944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.418949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.418956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.418964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.418970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.418975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.418980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.418988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.418993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.419001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.419006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.419010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.419016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.419020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.419027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.419070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:11.421502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:11.422021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:11.422033Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:11.422035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:11.422038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:11.422044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1589 [2:7559601621744362450:9207]
2025-10-10T14:35:11.422056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:11.422073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:11.422081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.422096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.422103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.422119Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:11.422126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:11.422133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:11.422191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.422202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.422204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.422207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:11.422270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:11.422273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.422284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.422312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.422331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:11.422358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587097:9792], now have 1 active actors on pipe
2025-10-10T14:35:11.422366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526586930:2438], now have 1 active actors on pipe
2025-10-10T14:35:11.422373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601621744362445:9207]
2025-10-10T14:35:11.422375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601621744362445:9207]
2025-10-10T14:35:11.422378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601621744362445:9207]
2025-10-10T14:35:11.422393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:11.422410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:11.422417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:11.422421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:11.422423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:11.422429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:11.422433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:11.422457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601621744362445:9207]
2025-10-10T14:35:11.422468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:11.422485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:11.422620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1589
2025-10-10T14:35:11.422644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1589
2025-10-10T14:35:11.422755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.422766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.422798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:11.422807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.422811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.422813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:11.422825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.422837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:11.422853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.423071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.423102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.423129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.423519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1590 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0
2025-10-10T14:35:11.423943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff44087b-50a28c46-af11d39d-e5ecead6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:11.426795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0] Write session: try to update token
2025-10-10T14:35:11.426813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:11.446012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:11.446030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:11.446032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:11.446034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:11.446044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601621744362445:9207]
2025-10-10T14:35:11.446050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601621744362445:9207]
2025-10-10T14:35:11.446054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601621744362445:9207]
2025-10-10T14:35:11.446105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:11.446104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:11.446111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.446112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:11.446113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:11.446116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:11.446260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:11.446858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId: src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:11.449634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:11.500005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601622526587108:9272]
2025-10-10T14:35:11.500323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1589, pipe: [1:7559601622526587108:9272]
2025-10-10T14:35:11.560961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601622526587108:9272]
2025-10-10T14:35:11.560990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:11.560993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:11.560996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:11.560359Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:11.560665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.560674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.560715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587108:9272], now have 1 active actors on pipe
2025-10-10T14:35:11.561062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1590 reason: error at write: Disconnected sessionId: src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0
2025-10-10T14:35:11.561266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1590 sessionId: src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0 is DEAD
2025-10-10T14:35:11.561792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:11.561813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0] Write session will restart in 0.006556s
2025-10-10T14:35:11.561838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0] Write session: Do CDS request
2025-10-10T14:35:11.561845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:11.561879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:11.569946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.570296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:11.570312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1591
2025-10-10T14:35:11.570479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.570519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:11.570530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:11.570534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:11.571519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1591 sessionId:  describe result for acl check
2025-10-10T14:35:11.571556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:11.571558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:11.571560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:11.571567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601622526587160:9805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:11.572551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601622526587160:9805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:11.575956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601622526587160:9805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:11.580488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601622526587160:9805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:11.580505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601622526587160:9805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:11.580508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601622526587160:9805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:11.580519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:11.584646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:11.587415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:11.587650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:11.587662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:11.587674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:11.587734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:11.587780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601621744362651:9220]
2025-10-10T14:35:11.588447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:11.593792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:11.593894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:11.594503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:11.594591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.594599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.594600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.594602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.594603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.594604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.594606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.594607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.594608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.594609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.594611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.594613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.594614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.594622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.594634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.594638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.594642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.594646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.594649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.594653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.594657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.594661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.594667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.594671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.594675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.594679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.594689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.594698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.594705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.594723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.594728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.594734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.594738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.594744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.594749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.594754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.594758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.594765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.594770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.594776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.594780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.594785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.594790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.594797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.594802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.594807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.594812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.594817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.594822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.594827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.594831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.594836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.594878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:11.597656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:11.597993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:11.598023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:11.598026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:11.598031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:11.598038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1590 [2:7559601621744362651:9220]
2025-10-10T14:35:11.598051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:11.598072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:11.598080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.598084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.598087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.598116Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:11.598124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:11.598136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:11.598212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.598218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.598220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.598223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:11.598292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:11.598301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.598321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.598332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.598348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:11.598372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587136:2438], now have 1 active actors on pipe
2025-10-10T14:35:11.598380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587259:9805], now have 1 active actors on pipe
2025-10-10T14:35:11.598389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601621744362646:9220]
2025-10-10T14:35:11.598391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601621744362646:9220]
2025-10-10T14:35:11.598393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601621744362646:9220]
2025-10-10T14:35:11.598406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:11.598420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:11.598420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:11.598424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:11.598426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:11.598442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:11.598445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:11.598476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601621744362646:9220]
2025-10-10T14:35:11.598454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1590
2025-10-10T14:35:11.598484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:11.598495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:11.598476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1590
2025-10-10T14:35:11.598518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.598529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.598680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:11.598695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.598701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.598704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:11.598727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.598744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:11.598780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.598979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.598990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.599019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.599709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2f7477-c99fe63d-fe1f9393-40fd5487_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:11.602419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0] Write session: try to update token
2025-10-10T14:35:11.602437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:11.599267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1591 partition: 0 MaxSeqNo: 40 sessionId: src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0
2025-10-10T14:35:11.619612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:11.619636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:11.619640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:11.619643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:11.619653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601621744362646:9220]
2025-10-10T14:35:11.619657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601621744362646:9220]
2025-10-10T14:35:11.619661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601621744362646:9220]
2025-10-10T14:35:11.619714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:11.619729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.619732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:11.619805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:11.619832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:11.619837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:11.619875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:11.619699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId: src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:11.622356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:11.660797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601622526587331:9272]
2025-10-10T14:35:11.661072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1590, pipe: [1:7559601622526587331:9272]
2025-10-10T14:35:11.740108Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:11.740447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.740462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.740509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587331:9272], now have 1 active actors on pipe
2025-10-10T14:35:11.740728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:11.740815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:11.740870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601622526587331:9272]
2025-10-10T14:35:11.741393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:11.741403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0] Write session will restart in 0.006336s
2025-10-10T14:35:11.741441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0] Write session: Do CDS request
2025-10-10T14:35:11.741447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:11.740891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:11.740997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1591 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0
2025-10-10T14:35:11.741211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1591 sessionId: src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0 is DEAD
2025-10-10T14:35:11.748863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.748942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:11.748959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1592
2025-10-10T14:35:11.749079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.749132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:11.749143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:11.749146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:11.749912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1592 sessionId:  describe result for acl check
2025-10-10T14:35:11.749951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:11.749957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:11.749959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:11.749965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601622526587364:9811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:11.750511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601622526587364:9811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:11.753593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601622526587364:9811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:11.756443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:11.756531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601622526587364:9811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:11.756545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601622526587364:9811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:11.756548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601622526587364:9811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:11.756556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:11.758590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:11.758816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:11.758829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:11.758840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:11.758897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:11.758953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601621744362839:9223]
2025-10-10T14:35:11.759565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:11.759861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:11.759907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:11.760356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:11.760419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.760424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.760426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.760427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.760428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.760429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.760431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.760432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.760434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.760435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.760436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.760437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.760439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.760446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.760459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.760463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.760467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.760471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.760475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.760479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.760482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.760485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.760491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.760494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.760498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.760501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.760509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.760517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.760523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.760529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.760533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.760538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.760542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.760547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.760553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.760558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.760563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.760568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.760572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.760577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.760582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.760587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.760592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.760597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.760601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.760607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.760611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.760616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.760621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.760626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.760630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.760635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.760671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:11.763009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:11.763454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:11.763469Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:11.763471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:11.763475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:11.763482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1591 [2:7559601621744362839:9223]
2025-10-10T14:35:11.763496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:11.763513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:11.763522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.763526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.763528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.763545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:11.763559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:11.763567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:11.763624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.763632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.763634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.763637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:11.763704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:11.763712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.763724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.763745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.763764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:11.763792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587336:2438], now have 1 active actors on pipe
2025-10-10T14:35:11.763803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587504:9811], now have 1 active actors on pipe
2025-10-10T14:35:11.763811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601621744362833:9223]
2025-10-10T14:35:11.763815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601621744362833:9223]
2025-10-10T14:35:11.763817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601621744362833:9223]
2025-10-10T14:35:11.763831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:11.763820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1591
2025-10-10T14:35:11.763828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1591
2025-10-10T14:35:11.763845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:11.763848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:11.763851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:11.763853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:11.763867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:11.763870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:11.763893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601621744362833:9223]
2025-10-10T14:35:11.763903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:11.763914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:11.763940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.763950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.764003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:11.764017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.764022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.764024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:11.764035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.764046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:11.764069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.764206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.764217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.764239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.764347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1592 partition: 0 MaxSeqNo: 40 sessionId: src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0
2025-10-10T14:35:11.764737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be19fa14-bb832fc4-adcdbb4d-4f4d6b86_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:11.767356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0] Write session: try to update token
2025-10-10T14:35:11.767375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:11.781532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId: src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:11.784315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:11.783023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:11.783046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:11.783050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:11.783052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:11.783062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601621744362833:9223]
2025-10-10T14:35:11.783069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601621744362833:9223]
2025-10-10T14:35:11.783074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601621744362833:9223]
2025-10-10T14:35:11.783127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:11.783131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:11.783134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:11.783139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:11.783140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.783143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:11.783286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:11.840976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601622526587516:9272]
2025-10-10T14:35:11.841278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1591, pipe: [1:7559601622526587516:9272]
2025-10-10T14:35:11.898011Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:11.898358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.898387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.898437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587516:9272], now have 1 active actors on pipe
2025-10-10T14:35:11.898681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:11.898712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601622526587516:9272]
2025-10-10T14:35:11.898716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:11.898751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:11.898754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:11.898829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1592 reason: error at write: Disconnected sessionId: src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0
2025-10-10T14:35:11.899046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1592 sessionId: src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0 is DEAD
2025-10-10T14:35:11.899176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:11.899188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0] Write session will restart in 0.009438s
2025-10-10T14:35:11.899220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0] Write session: Do CDS request
2025-10-10T14:35:11.899228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:11.909929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.910031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:11.910047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1593
2025-10-10T14:35:11.910183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:11.910222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:11.910233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:11.910238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:11.910780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1593 sessionId:  describe result for acl check
2025-10-10T14:35:11.910823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:11.910831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:11.910832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:11.910837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601622526587614:9815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:11.911328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601622526587614:9815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:11.913766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:11.913773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601622526587614:9815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:11.915867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:11.916079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:11.916092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:11.916106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:11.916158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:11.916199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601621744363017:9226]
2025-10-10T14:35:11.916330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601622526587614:9815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:11.916343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601622526587614:9815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:11.916347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601622526587614:9815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:11.916354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:11.916806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:11.917142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:11.917200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:11.917537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:11.917633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.917640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.917641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.917642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.917644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.917644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.917645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.917646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.917647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.917649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.917650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.917650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.917651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.917657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.917669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.917673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.917677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.917680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.917684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.917696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.917699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.917702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.917706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.917709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.917713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.917716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.917725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.917732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:11.917739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.917744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:11.917749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.917753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:11.917758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.917762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:11.917773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.917778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:11.917787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.917793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:11.917798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.917809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:11.917813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.917823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:11.917828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.917839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:11.917844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.917854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:11.917859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.917868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.917872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.917877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.917888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.917897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.917932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:11.920364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:11.920722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:11.920731Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:11.920734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:11.920737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:11.920744Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1592 [2:7559601621744363017:9226]
2025-10-10T14:35:11.920757Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:11.920774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:11.920782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.920786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.920789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.920806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:11.920813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:11.920821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:11.920893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.920899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.920901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.920904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:11.920974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:11.920984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.920995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:11.921005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:11.921021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:11.921042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601621744363012:9226]
2025-10-10T14:35:11.921044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601621744363012:9226]
2025-10-10T14:35:11.921046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601621744363012:9226]
2025-10-10T14:35:11.921055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:11.921060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:11.921062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:11.921063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:11.921069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:11.921084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:11.921087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:11.921100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587687:9815], now have 1 active actors on pipe
2025-10-10T14:35:11.921103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587517:2438], now have 1 active actors on pipe
2025-10-10T14:35:11.921124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601621744363012:9226]
2025-10-10T14:35:11.921133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:11.921161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:11.921142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1592
2025-10-10T14:35:11.921161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1592
2025-10-10T14:35:11.921399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.921411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.921447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7eb70062-cc326094-c63268d4-24323e13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:11.921463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:11.921471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:11.921474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:11.921487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:11.921506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:11.921523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.921720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:11.921728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:11.921743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:11.921847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1593 partition: 0 MaxSeqNo: 40 sessionId: src_id|7eb70062-cc326094-c63268d4-24323e13_0
2025-10-10T14:35:11.922305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669f76d7-dd2afe84-eb5a30a5-417a1e63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7eb70062-cc326094-c63268d4-24323e13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:11.925261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb70062-cc326094-c63268d4-24323e13_0] Write session: try to update token
2025-10-10T14:35:11.925282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb70062-cc326094-c63268d4-24323e13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:11.942058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:11.942078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:11.942082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:11.942084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:11.942095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601621744363012:9226]
2025-10-10T14:35:11.942100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601621744363012:9226]
2025-10-10T14:35:11.942105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601621744363012:9226]
2025-10-10T14:35:11.944271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId: src_id|7eb70062-cc326094-c63268d4-24323e13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:11.942154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:11.942156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:11.942164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:11.942169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:11.942173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:11.942176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:11.942327Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:11.947143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:11.998669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601622526587698:9272]
2025-10-10T14:35:11.998962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1592, pipe: [1:7559601622526587698:9272]
2025-10-10T14:35:12.055520Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:12.055928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.055946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.055995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601622526587698:9272], now have 1 active actors on pipe
2025-10-10T14:35:12.056216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:12.056230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:12.056241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601622526587698:9272]
2025-10-10T14:35:12.056246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:12.056263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:12.056315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1593 reason: error at write: Disconnected sessionId: src_id|7eb70062-cc326094-c63268d4-24323e13_0
2025-10-10T14:35:12.056535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1593 sessionId: src_id|7eb70062-cc326094-c63268d4-24323e13_0 is DEAD
2025-10-10T14:35:12.056711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb70062-cc326094-c63268d4-24323e13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:12.056724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb70062-cc326094-c63268d4-24323e13_0] Write session will restart in 0.006290s
2025-10-10T14:35:12.056749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb70062-cc326094-c63268d4-24323e13_0] Write session: Do CDS request
2025-10-10T14:35:12.056766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb70062-cc326094-c63268d4-24323e13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:12.063954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb70062-cc326094-c63268d4-24323e13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.064054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:12.064071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1594
2025-10-10T14:35:12.064202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.064238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:12.064249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:12.064253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:12.064704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1594 sessionId:  describe result for acl check
2025-10-10T14:35:12.064744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:12.064752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:12.064753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:12.064762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601626821555010:9819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:12.065310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601626821555010:9819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:12.068402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601626821555010:9819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:12.071286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601626821555010:9819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:12.071299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601626821555010:9819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:12.071302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601626821555010:9819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:12.071311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:12.072581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:12.075081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:12.075351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:12.075363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:12.075377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:12.075446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:12.075512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601626039330492:9228]
2025-10-10T14:35:12.076164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:12.076487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:12.076539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:12.076867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:12.076947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.076955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.076956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.076957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.076959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.076960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.076961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.076962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.076964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.076965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.076966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.076968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.076969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.076975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.076989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.076993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.076997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.077000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.077004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.077008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.077012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.077016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.077020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.077023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.077027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.077031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.077039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.077048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.077055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.077061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.077066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.077071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.077075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.077080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.077095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.077100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.077104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.077109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.077113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.077119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.077128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.077134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.077144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.077149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.077158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.077164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.077173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.077179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.077187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.077193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.077201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.077210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.077250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:12.079943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:12.080625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:12.080638Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:12.080640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:12.080644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:12.080651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1593 [2:7559601626039330492:9228]
2025-10-10T14:35:12.080665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:12.080688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:12.080696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.080700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.080703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.080722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:12.080731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:12.080742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:12.080813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.080821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.080824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.080826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:12.080900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:12.080908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.080920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.080931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.080948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:12.080972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821554995:2438], now have 1 active actors on pipe
2025-10-10T14:35:12.080980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555162:9819], now have 1 active actors on pipe
2025-10-10T14:35:12.080989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601626039330487:9228]
2025-10-10T14:35:12.080991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601626039330487:9228]
2025-10-10T14:35:12.080993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601626039330487:9228]
2025-10-10T14:35:12.081014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:12.081029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:12.081051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:12.081058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:12.081098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1593
2025-10-10T14:35:12.081112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1593
2025-10-10T14:35:12.081098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601626039330487:9228]
2025-10-10T14:35:12.081106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:12.081119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:12.081122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:12.081124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:12.081131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:12.081216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.081225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.081266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:12.081276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.081281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.081283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:12.081300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.081316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:12.081350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.081540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.081553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.081569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.082090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1594 partition: 0 MaxSeqNo: 40 sessionId: src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0
2025-10-10T14:35:12.082544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eb70062-cc326094-c63268d4-24323e13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:12.085213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0] Write session: try to update token
2025-10-10T14:35:12.085232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:12.102793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId: src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:12.103870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:12.103891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:12.103895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:12.103898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:12.103908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601626039330487:9228]
2025-10-10T14:35:12.103913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601626039330487:9228]
2025-10-10T14:35:12.103918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601626039330487:9228]
2025-10-10T14:35:12.103968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:12.103972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:12.103976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:12.103980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.103983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:12.103988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:12.104139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:12.105712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:12.156366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601626821555177:9272]
2025-10-10T14:35:12.156641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1593, pipe: [1:7559601626821555177:9272]
2025-10-10T14:35:12.218461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:12.218905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.218926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.218978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555177:9272], now have 1 active actors on pipe
2025-10-10T14:35:12.219215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:12.219250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:12.219287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:12.219291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:12.219305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601626821555177:9272]
2025-10-10T14:35:12.219358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1594 reason: error at write: Disconnected sessionId: src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0
2025-10-10T14:35:12.219584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1594 sessionId: src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0 is DEAD
2025-10-10T14:35:12.219755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:12.219767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0] Write session will restart in 0.005252s
2025-10-10T14:35:12.219792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0] Write session: Do CDS request
2025-10-10T14:35:12.219801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:12.225893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.226003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:12.226029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1595
2025-10-10T14:35:12.226181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.226227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:12.226238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:12.226243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:12.226742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1595 sessionId:  describe result for acl check
2025-10-10T14:35:12.226784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:12.226793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:12.226795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:12.226802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601626821555190:9823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:12.227392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601626821555190:9823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:12.230243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601626821555190:9823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:12.236124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601626821555190:9823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:12.236142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601626821555190:9823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:12.236146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601626821555190:9823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:12.236157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:12.239072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:12.241888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:12.242161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:12.242174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:12.242187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:12.242244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:12.242508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601626039330671:9230]
2025-10-10T14:35:12.243202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:12.243527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:12.243572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:12.243909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:12.243964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.243970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.243971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.243973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.243975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.243976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.243977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.243979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.243980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.243981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.243983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.243984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.243986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.243992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.244006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.244011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.244015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.244019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.244024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.244028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.244032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.244037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.244041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.244045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.244049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.244054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.244062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.244071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.244077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.244086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.244091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.244101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.244106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.244118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.244123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.244132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.244139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.244144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.244155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.244160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.244165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.244170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.244176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.244181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.244185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.244191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.244198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.244203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.244212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.244217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.244222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.244230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.244274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:12.248113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:12.248454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:12.248471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:12.248475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:12.248479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:12.248487Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1594 [2:7559601626039330671:9230]
2025-10-10T14:35:12.248502Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:12.248522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:12.248533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.248537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.248540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.248558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:12.248565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:12.248573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:12.248635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.248646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.248649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.248652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:12.248727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:12.248736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.248749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.248898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1594
2025-10-10T14:35:12.248943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1594
2025-10-10T14:35:12.248766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.248792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:12.248815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555320:9823], now have 1 active actors on pipe
2025-10-10T14:35:12.248819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555178:2438], now have 1 active actors on pipe
2025-10-10T14:35:12.248828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601626039330666:9230]
2025-10-10T14:35:12.248830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601626039330666:9230]
2025-10-10T14:35:12.248833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601626039330666:9230]
2025-10-10T14:35:12.248847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:12.248858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:12.248861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:12.248863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:12.248864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:12.248881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:12.248886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:12.248923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601626039330666:9230]
2025-10-10T14:35:12.248926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:12.248928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:12.248946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.248952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.249009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:12.249017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.249021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.249024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:12.249035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.249047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:12.249069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.249275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.249288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.249312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.249688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1595 partition: 0 MaxSeqNo: 40 sessionId: src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0
2025-10-10T14:35:12.250107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9e95d7a-c701fe40-249a4aa0-2e023a94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:12.252736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0] Write session: try to update token
2025-10-10T14:35:12.252756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:12.269224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId: src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:12.269621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:12.269640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:12.269644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:12.269646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:12.269655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601626039330666:9230]
2025-10-10T14:35:12.269660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601626039330666:9230]
2025-10-10T14:35:12.269663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601626039330666:9230]
2025-10-10T14:35:12.269718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:12.269717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:12.269725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:12.269727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.269729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:12.269730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:12.269864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:12.271830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:12.319716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601626821555361:9272]
2025-10-10T14:35:12.320028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1594, pipe: [1:7559601626821555361:9272]
2025-10-10T14:35:12.381882Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:12.382321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.382339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.382389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555361:9272], now have 1 active actors on pipe
2025-10-10T14:35:12.382632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:12.382649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601626821555361:9272]
2025-10-10T14:35:12.382711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:12.382713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:12.382777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1595 reason: error at write: Disconnected sessionId: src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0
2025-10-10T14:35:12.382979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1595 sessionId: src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0 is DEAD
2025-10-10T14:35:12.383120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:12.383217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:12.383229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0] Write session will restart in 0.006569s
2025-10-10T14:35:12.383254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0] Write session: Do CDS request
2025-10-10T14:35:12.383262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:12.390959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.391031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:12.391046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1596
2025-10-10T14:35:12.391160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.391195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:12.391204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:12.391212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:12.391641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1596 sessionId:  describe result for acl check
2025-10-10T14:35:12.391673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:12.391679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:12.391681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:12.391687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601626821555374:9827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:12.392249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601626821555374:9827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:12.395087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601626821555374:9827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:12.401911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601626821555374:9827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:12.401929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601626821555374:9827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:12.401933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601626821555374:9827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:12.401944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:12.406169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:12.409882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:12.410174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:12.410187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:12.410199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:12.410258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:12.410307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601626039330851:9232]
2025-10-10T14:35:12.410933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:12.411269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:12.411318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:12.411674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:12.411736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.411741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.411743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.411744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.411746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.411747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.411749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.411751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.411752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.411754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.411755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.411757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.411758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.411764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.411778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.411782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.411786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.411789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.411793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.411796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.411800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.411805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.411810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.411814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.411818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.411822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.411830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.411839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.411847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.411853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.411858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.411864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.411868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.411875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.411884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.411890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.411900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.411906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.411911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.411921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.411925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.411931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.411939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.411947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.411956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.411961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.411972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.411978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.411987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.411993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.412003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.412009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.412051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:12.414671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:12.415317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:12.415332Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:12.415334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:12.415338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:12.415346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1595 [2:7559601626039330851:9232]
2025-10-10T14:35:12.415376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:12.415401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:12.415405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.415409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.415411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.415428Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:12.415452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:12.415465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:12.415527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.415533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.415535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.415538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:12.415608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:12.415617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.415629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.415643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.415661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:12.415683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601626039330846:9232]
2025-10-10T14:35:12.415691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601626039330846:9232]
2025-10-10T14:35:12.415694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601626039330846:9232]
2025-10-10T14:35:12.415708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:12.415727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555362:2438], now have 1 active actors on pipe
2025-10-10T14:35:12.415731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555532:9827], now have 1 active actors on pipe
2025-10-10T14:35:12.415739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:12.415757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:12.415760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:12.415791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601626039330846:9232]
2025-10-10T14:35:12.415793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:12.415797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:12.415799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:12.415799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:12.415807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:12.415933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.415944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.415975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:12.415982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.415987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.415989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:12.416001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.416013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:12.416027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.415826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1595
2025-10-10T14:35:12.415877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1595
2025-10-10T14:35:12.416297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.416306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.416322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.416439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1596 partition: 0 MaxSeqNo: 40 sessionId: src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0
2025-10-10T14:35:12.416860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6657ed3-34aac2af-2afe9de8-5690876e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:12.419660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0] Write session: try to update token
2025-10-10T14:35:12.419680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:12.435883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId: src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:12.438657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:12.440543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.440568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.440594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:12.440597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:12.440601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:12.440603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:12.440616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601626039330846:9232]
2025-10-10T14:35:12.440622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601626039330846:9232]
2025-10-10T14:35:12.440625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601626039330846:9232]
2025-10-10T14:35:12.440668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:12.440681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:12.440685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:12.440687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:12.440695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.440698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:12.440857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:12.483014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601626821555546:9272]
2025-10-10T14:35:12.483296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1595, pipe: [1:7559601626821555546:9272]
2025-10-10T14:35:12.557576Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:12.557877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:12.557939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555546:9272], now have 1 active actors on pipe
2025-10-10T14:35:12.558043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:12.558112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601626821555546:9272]
2025-10-10T14:35:12.558148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:12.558151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:12.558153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:12.558223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1596 reason: error at write: Disconnected sessionId: src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0
2025-10-10T14:35:12.558394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1596 sessionId: src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0 is DEAD
2025-10-10T14:35:12.558541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:12.558551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0] Write session will restart in 0.006978s
2025-10-10T14:35:12.558588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0] Write session: Do CDS request
2025-10-10T14:35:12.558594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:12.566916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.566985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:12.567001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1597
2025-10-10T14:35:12.567154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.567198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:12.567208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:12.567212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:12.567682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1597 sessionId:  describe result for acl check
2025-10-10T14:35:12.567731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:12.567736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:12.567738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:12.567744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601626821555576:9837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:12.568283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601626821555576:9837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:12.570777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601626821555576:9837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:12.575471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601626821555576:9837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:12.575490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601626821555576:9837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:12.575493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601626821555576:9837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:12.575504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:12.583494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:12.586197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:12.586455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:12.586468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:12.586481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:12.591937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1596
2025-10-10T14:35:12.591986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1596
2025-10-10T14:35:12.586705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:12.586751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601626039331063:9245]
2025-10-10T14:35:12.587407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:12.587775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:12.587841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:12.588179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:12.588251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.588252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.588253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.588255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.588256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.588257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.588259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.588260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.588261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.588262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.588263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.588264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.588266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.588272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.588284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.588289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.588293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.588297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.588301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.588304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.588308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.588311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.588317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.588321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.588325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.588329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.588338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.588346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.588353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.588359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.588363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.588368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.588373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.588378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.588383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.588388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.588391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.588396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.588400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.588404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.588408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.588414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.588418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.588423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.588427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.588433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.588437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.588442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.588446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.588451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.588456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.588461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.588503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:12.591119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:12.591551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:12.591556Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:12.591558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:12.591563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:12.591571Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1596 [2:7559601626039331063:9245]
2025-10-10T14:35:12.591583Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:12.591600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:12.591604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.591607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.591610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.591627Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:12.591636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:12.591644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:12.591700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.591701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.591703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.591705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:12.591778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:12.591781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.591791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.591801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.591816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:12.591837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601626039331058:9245]
2025-10-10T14:35:12.591839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601626039331058:9245]
2025-10-10T14:35:12.591841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601626039331058:9245]
2025-10-10T14:35:12.591850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:12.591878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:12.591881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:12.591882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555547:2438], now have 1 active actors on pipe
2025-10-10T14:35:12.591882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:12.591892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:12.591907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:12.591910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:12.591915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555664:9837], now have 1 active actors on pipe
2025-10-10T14:35:12.591943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601626039331058:9245]
2025-10-10T14:35:12.591951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:12.591962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:12.592010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.592015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.592044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:12.592051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.592448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1597 partition: 0 MaxSeqNo: 40 sessionId: src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0
2025-10-10T14:35:12.592055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.592057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:12.592069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.592080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:12.592093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.592283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.592286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.592304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.592882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dba8c5-f6521ba0-19194048-6e876a4d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:12.595623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0] Write session: try to update token
2025-10-10T14:35:12.595646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:12.604549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:12.604575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:12.604587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601626039331058:9245]
2025-10-10T14:35:12.604634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:12.604641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:12.604843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:12.604988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:12.605133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:12.605269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:12.605486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:12.605528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:12.613006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId: src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:12.615801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:12.616359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.616379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.616421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:12.616529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:12.623713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:12.623735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:12.623738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:12.623742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:12.623752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601626039331058:9245]
2025-10-10T14:35:12.623756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601626039331058:9245]
2025-10-10T14:35:12.623759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601626039331058:9245]
2025-10-10T14:35:12.623804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:12.623806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:12.623814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.623816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:12.623817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:12.623821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:12.623965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:12.658126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601626821555762:9272]
2025-10-10T14:35:12.658387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1596, pipe: [1:7559601626821555762:9272]
2025-10-10T14:35:12.739623Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:12.747657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.747689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.747856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.747925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.747998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.748066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.748474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.748489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.748565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.748628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.748696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.748760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.748800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.748806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.748870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.748943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.749013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.749082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.749127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.749135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.749206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.749505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.749578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.749648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.749697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.749705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.749778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.749842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.749915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.749983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.750032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.750039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.750112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.750181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.750250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.750324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.750377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.750385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.750456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.752028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:12.752034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601626821555762:9272]
2025-10-10T14:35:12.752073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:12.752076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:12.752107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1597 reason: error at write: Disconnected sessionId: src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0
2025-10-10T14:35:12.750519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.752534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:12.752563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0] Write session will restart in 0.005634s
2025-10-10T14:35:12.750594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.750657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.750711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.750714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.752602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0] Write session: Do CDS request
2025-10-10T14:35:12.750790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.752609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:12.750845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.750906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.750967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.751009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.751012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.751081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.751143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.751211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.751269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.751313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.751316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.751386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:12.751450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:12.751509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:12.751566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:12.751607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:12.751611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:12.751685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555762:9272], now have 1 active actors on pipe
2025-10-10T14:35:12.752174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:12.752358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1597 sessionId: src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0 is DEAD
2025-10-10T14:35:12.759970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.760058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:12.760072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1598
2025-10-10T14:35:12.760256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.760295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:12.760301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:12.760305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:12.760817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1598 sessionId:  describe result for acl check
2025-10-10T14:35:12.760858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:12.760860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:12.760862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:12.760868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601626821555795:9846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:12.761468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601626821555795:9846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:12.766601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601626821555795:9846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:12.770484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601626821555795:9846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:12.770501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601626821555795:9846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:12.770505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601626821555795:9846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:12.770515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:12.770553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:12.773225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:12.773463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:12.773485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:12.773498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:12.773557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:12.773601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601626039331266:9250]
2025-10-10T14:35:12.774225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:12.774637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:12.774724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:12.775075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:12.775140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.775148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.775150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.775151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.775152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.775153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.775154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.775155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.775157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.775158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.775170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.775171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.775172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.775179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.775191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.775195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.775198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.775201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.775205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.775208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.775211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.775214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.775219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.775222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.775225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.775229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.775237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.775248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.775254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.775259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.775264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.775269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.775273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.775278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.775283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.775288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.775291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.775296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.775300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.775305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.775309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.775314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.775318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.775324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.775329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.775334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.775339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.775343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.775347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.775352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.775356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.775361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.775399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:12.777900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:12.778415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:12.778432Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:12.778434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:12.778438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:12.778445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1597 [2:7559601626039331266:9250]
2025-10-10T14:35:12.778458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:12.778476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:12.778480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.778484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.778487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.778505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:12.778518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:12.778527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:12.778586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.778593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.778596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.778599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:12.778672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:12.778696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.778709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.778723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.778742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:12.778763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555953:9846], now have 1 active actors on pipe
2025-10-10T14:35:12.778773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555780:2438], now have 1 active actors on pipe
2025-10-10T14:35:12.778781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601626039331260:9250]
2025-10-10T14:35:12.778789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601626039331260:9250]
2025-10-10T14:35:12.778791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601626039331260:9250]
2025-10-10T14:35:12.778805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:12.778824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:12.778833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:12.778837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:12.778840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:12.778847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:12.778850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:12.778877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601626039331260:9250]
2025-10-10T14:35:12.778885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:12.778887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:12.778904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.778913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.778820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1597
2025-10-10T14:35:12.778968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:12.778844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1597
2025-10-10T14:35:12.778980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.778985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.778988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:12.778999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.779009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:12.779028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.779153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.779161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.779175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.779257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1598 partition: 0 MaxSeqNo: 40 sessionId: src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0
2025-10-10T14:35:12.779615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48f34f51-9c81f94f-8d1ed39c-41528855_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:12.782294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0] Write session: try to update token
2025-10-10T14:35:12.782312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:12.797913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId: src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:12.798341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:12.798361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:12.798365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:12.798368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:12.798377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601626039331260:9250]
2025-10-10T14:35:12.798381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601626039331260:9250]
2025-10-10T14:35:12.798387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601626039331260:9250]
2025-10-10T14:35:12.798435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:12.798435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:12.798444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:12.798448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.798448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:12.798451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:12.798594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:12.800522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:12.852175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601626821555965:9272]
2025-10-10T14:35:12.852554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1597, pipe: [1:7559601626821555965:9272]
2025-10-10T14:35:12.915703Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:12.916248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.916266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.916317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555965:9272], now have 1 active actors on pipe
2025-10-10T14:35:12.916618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:12.916621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601626821555965:9272]
2025-10-10T14:35:12.916626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:12.916631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:12.916665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:12.916702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1598 reason: error at write: Disconnected sessionId: src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0
2025-10-10T14:35:12.916930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1598 sessionId: src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0 is DEAD
2025-10-10T14:35:12.917122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:12.917131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0] Write session will restart in 0.009214s
2025-10-10T14:35:12.917158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0] Write session: Do CDS request
2025-10-10T14:35:12.917168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:12.929945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.933000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:12.933018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1599
2025-10-10T14:35:12.934258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:12.936784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:12.937021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:12.937035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:12.937048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:12.937112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:12.937160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601626039331448:9253]
2025-10-10T14:35:12.937457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:12.937509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:12.937524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:12.937536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:12.937812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:12.938202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:12.938275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:12.938634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:12.938720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.938727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.938729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.938730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.938731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.938732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.938733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.938734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.938736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.938737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.938738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.938740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.938741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.938748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.938761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.938765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.938769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.938773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.938777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.938782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.938786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.938789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.938794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.938798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.938802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.938806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.938815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.938824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:12.938838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.937955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1599 sessionId:  describe result for acl check
2025-10-10T14:35:12.937989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:12.937992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:12.937994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:12.938000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601626821556114:9850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:12.938544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601626821556114:9850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:12.938845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:12.938857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.938863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:12.938867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.938873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:12.938878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.938882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:12.938887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.938892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:12.938897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.938903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:12.938907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.938912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:12.938917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.938922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:12.938927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.938933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:12.938961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.938967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.938971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.938979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.938984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.938989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.939028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:12.941282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601626821556114:9850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:12.945777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601626821556114:9850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:12.945795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601626821556114:9850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:12.945798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601626821556114:9850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:12.945808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:12.945861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:12.946500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:12.946513Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:12.946515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:12.946519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:12.946526Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1598 [2:7559601626039331448:9253]
2025-10-10T14:35:12.946540Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:12.946558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:12.946568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.946572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.946574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.946594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:12.946609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:12.946618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:12.946692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.946699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.946701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.946704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:12.946782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:12.946791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.946804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:12.946822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:12.946904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:12.946897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1598
2025-10-10T14:35:12.946916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1598
2025-10-10T14:35:12.946938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821556147:9850], now have 1 active actors on pipe
2025-10-10T14:35:12.946948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601626821555967:2438], now have 1 active actors on pipe
2025-10-10T14:35:12.946957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601626039331443:9253]
2025-10-10T14:35:12.946960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601626039331443:9253]
2025-10-10T14:35:12.946963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601626039331443:9253]
2025-10-10T14:35:12.946972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:12.946984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:12.946987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:12.946990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:12.946992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:12.947009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:12.947018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:12.947037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.947046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.947096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601626039331443:9253]
2025-10-10T14:35:12.947120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:12.947126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:12.947141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:12.947155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:12.947164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:12.947167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:12.947179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:12.947196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:12.947247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.947451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:12.947466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:12.947490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:12.947589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1599 partition: 0 MaxSeqNo: 40 sessionId: src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0
2025-10-10T14:35:12.947993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8619e7f6-203f3739-3e21ea2a-4878078a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:12.950837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0] Write session: try to update token
2025-10-10T14:35:12.950859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:12.967126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:12.967145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:12.967149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:12.967151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:12.967160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601626039331443:9253]
2025-10-10T14:35:12.967165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601626039331443:9253]
2025-10-10T14:35:12.967168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601626039331443:9253]
2025-10-10T14:35:12.967218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:12.967226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:12.967228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:12.967228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:12.967235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:12.967239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:12.967365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:12.965529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId: src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:12.968161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:13.017059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601631116523450:9272]
2025-10-10T14:35:13.017356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1598, pipe: [1:7559601631116523450:9272]
2025-10-10T14:35:13.077796Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:13.078074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.078095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.078161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523450:9272], now have 1 active actors on pipe
2025-10-10T14:35:13.078410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:13.078417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:13.078424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:13.078464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601631116523450:9272]
2025-10-10T14:35:13.078490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1599 reason: error at write: Disconnected sessionId: src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0
2025-10-10T14:35:13.078408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:13.078727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1599 sessionId: src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0 is DEAD
2025-10-10T14:35:13.081435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:13.081450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0] Write session will restart in 0.008616s
2025-10-10T14:35:13.081476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0] Write session: Do CDS request
2025-10-10T14:35:13.081483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:13.090993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.091107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:13.091127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1600
2025-10-10T14:35:13.091273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.091314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:13.091327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:13.091332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:13.091802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1600 sessionId:  describe result for acl check
2025-10-10T14:35:13.091840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:13.091848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:13.091850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:13.091856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601631116523555:9854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:13.092411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601631116523555:9854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:13.094866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:13.094982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601631116523555:9854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:13.096977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:13.097190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:13.097203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:13.097215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:13.097270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:13.097316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601630334298928:9255]
2025-10-10T14:35:13.097515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601631116523555:9854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:13.097530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601631116523555:9854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:13.097533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601631116523555:9854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:13.097541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:13.097918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:13.098177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:13.098218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:13.098531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:13.098585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.098591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.098592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.098593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.098595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.098596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.098597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.098599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.098600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.098601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.098603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.098604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.098605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.098610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.098624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.098628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.098632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.098636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.098641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.098644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.098648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.098652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.098656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.098660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.098664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.098680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.098687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.098695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.098702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.098707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.098712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.098717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.098721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.098726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.098731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.098736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.098741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.098746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.098752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.098757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.098762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.098767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.098771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.098777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.098781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.098786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.098790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.098796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.098801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.098806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.098811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.098816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.098854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:13.101256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:13.101679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:13.101694Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:13.101696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:13.101700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:13.101706Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1599 [2:7559601630334298928:9255]
2025-10-10T14:35:13.101720Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:13.101737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:13.101741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.101744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.101746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.101764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:13.101779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:13.101787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:13.101852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.101860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.101862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.101865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:13.101938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:13.101946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.101957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.101969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.101990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:13.102018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523628:9854], now have 1 active actors on pipe
2025-10-10T14:35:13.102028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523452:2438], now have 1 active actors on pipe
2025-10-10T14:35:13.102037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601630334298923:9255]
2025-10-10T14:35:13.102043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601630334298923:9255]
2025-10-10T14:35:13.102045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601630334298923:9255]
2025-10-10T14:35:13.102059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:13.102078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:13.102096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:13.102099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:13.102127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601630334298923:9255]
2025-10-10T14:35:13.102135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:13.102139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:13.102142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:13.102144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:13.102152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:13.102244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.102254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.102291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:13.102304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.102315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.102318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:13.102331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.102341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:13.102358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.102511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.102518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.102532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.103119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21fe27b9-e3acea46-dbbf708a-e1c889b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:13.102146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1599
2025-10-10T14:35:13.102149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1599
2025-10-10T14:35:13.102633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1600 partition: 0 MaxSeqNo: 40 sessionId: src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0
2025-10-10T14:35:13.105817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0] Write session: try to update token
2025-10-10T14:35:13.105838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:13.121721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:13.121742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:13.121757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601630334298923:9255]
2025-10-10T14:35:13.121817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:13.121844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:13.124592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId: src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:13.123415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:13.123598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:13.123757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:13.123899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:13.124099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:13.124169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:13.127387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:13.127689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.127712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.127766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:13.128044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:13.138536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:13.138560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:13.138564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:13.138566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:13.138579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601630334298923:9255]
2025-10-10T14:35:13.138584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601630334298923:9255]
2025-10-10T14:35:13.138589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601630334298923:9255]
2025-10-10T14:35:13.138643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:13.138650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.138652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:13.138815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:13.141022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:13.141030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:13.141034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:13.178836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601631116523639:9272]
2025-10-10T14:35:13.179198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1599, pipe: [1:7559601631116523639:9272]
2025-10-10T14:35:13.260821Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:13.269206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.269242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.273295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:13.269504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.269570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.269635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.269697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.269739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.269744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.269814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.269869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.269936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.270000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.270042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.270045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.270114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.270172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.270236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.270297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.270340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.270343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.270418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.270481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.270543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.270604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.270649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.270653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.270735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.270795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.270855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.270914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.270954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.270957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.271026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.273364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1600 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0
2025-10-10T14:35:13.273407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:13.273452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601631116523639:9272]
2025-10-10T14:35:13.271084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.271145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.271210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.271255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.271258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.271326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.271382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.271444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.271505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.271547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.271549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.271617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.271676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.271738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.271797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.271843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.271846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.271913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.271969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.272030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.272089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.272131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.272134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.272202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.272260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.272323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.272383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.272423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.272426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.272514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523639:9272], now have 1 active actors on pipe
2025-10-10T14:35:13.272975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:13.273599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1600 sessionId: src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0 is DEAD
2025-10-10T14:35:13.273749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:13.273759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0] Write session will restart in 0.009389s
2025-10-10T14:35:13.273796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0] Write session: Do CDS request
2025-10-10T14:35:13.273803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:13.284956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.285038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:13.285067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1601
2025-10-10T14:35:13.285611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.285656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:13.285667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:13.285671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:13.286158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1601 sessionId:  describe result for acl check
2025-10-10T14:35:13.286198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:13.286200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:13.286202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:13.286207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601631116523759:9858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:13.286786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601631116523759:9858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:13.290106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601631116523759:9858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:13.290187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:13.293121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:13.293393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:13.293407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:13.293420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:13.293491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:13.293541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601630334299113:9257]
2025-10-10T14:35:13.293373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601631116523759:9858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:13.293391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601631116523759:9858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:13.293395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601631116523759:9858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:13.293404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:13.294163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:13.294467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:13.294524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:13.294881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:13.294967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.294976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.294978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.294979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.294980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.294981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.294982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.294984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.294985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.294986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.294987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.294989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.294990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.294998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.295012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.295016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.295021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.295025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.295029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.295033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.295037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.295041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.295047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.295051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.295055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.295060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.295068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.295083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.295095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.295106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.295111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.295122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.295127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.295133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.295138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.295143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.295148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.295153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.295160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.295166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.295175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.295180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.295188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.295193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.295202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.295208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.295217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.295223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.295232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.295237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.295249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.295254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.295303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:13.297763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:13.298760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:13.298775Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:13.298778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:13.298782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:13.298789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1600 [2:7559601630334299113:9257]
2025-10-10T14:35:13.298802Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:13.298820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:13.298824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.298827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.298829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.298846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:13.298860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:13.298869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:13.298935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.298942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.298944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.298947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:13.299006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:13.299015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.299029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.299041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.299057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:13.299078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601630334299108:9257]
2025-10-10T14:35:13.299085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601630334299108:9257]
2025-10-10T14:35:13.299088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601630334299108:9257]
2025-10-10T14:35:13.299097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:13.299107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:13.299110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:13.299112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:13.299116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:13.299132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:13.299140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:13.299152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523642:2438], now have 1 active actors on pipe
2025-10-10T14:35:13.299156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523819:9858], now have 1 active actors on pipe
2025-10-10T14:35:13.299181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601630334299108:9257]
2025-10-10T14:35:13.299191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:13.299198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:13.299203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1600
2025-10-10T14:35:13.299202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1600
2025-10-10T14:35:13.299274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.299285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.299315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:13.299328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.299333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.299335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:13.299347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.299363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:13.299383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.299589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.299608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.299654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.299804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1601 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0
2025-10-10T14:35:13.300233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebf46952-4572d7f2-85668786-cc2a1e3f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:13.303065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0] Write session: try to update token
2025-10-10T14:35:13.303087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:13.310763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:13.310781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:13.310793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601630334299108:9257]
2025-10-10T14:35:13.310841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:13.310845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:13.311024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:13.311181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:13.311334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:13.311485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:13.311681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:13.311719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:13.320752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId: src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:13.323601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:13.323847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.323875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.323935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:13.324083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:13.332178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:13.332200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:13.332203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:13.332205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:13.332216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601630334299108:9257]
2025-10-10T14:35:13.332220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601630334299108:9257]
2025-10-10T14:35:13.332224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601630334299108:9257]
2025-10-10T14:35:13.332271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:13.332272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:13.332279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.332279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:13.332281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:13.332283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:13.332412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:13.372877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601631116523830:9272]
2025-10-10T14:35:13.373235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1600, pipe: [1:7559601631116523830:9272]
2025-10-10T14:35:13.451705Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:13.460411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.460441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.460622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.460679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.460738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.460795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.460839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.460844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.460913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.460970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.461031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.461096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.461134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.461137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.461205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.461265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.461325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.461525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.461568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.461572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.461639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.461697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.461754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.461814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.461852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.461855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.461920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.461976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.462038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.462096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.462137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.462140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.462206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.462260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.462317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.462376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.462418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.462421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.462485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.462540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.462598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.462669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.462711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.462714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.462778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.462833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.462892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.462949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.462988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.462991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.463054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.463104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.463161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.463221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.463264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.463267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.463331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:13.463382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:13.463437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:13.463492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:13.463530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:13.463534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:13.463621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523830:9272], now have 1 active actors on pipe
2025-10-10T14:35:13.466513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:13.466548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0] Write session will restart in 0.007498s
2025-10-10T14:35:13.466574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0] Write session: Do CDS request
2025-10-10T14:35:13.466580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:13.467240Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:35:13.467341Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:35:13.467346Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:35:13.467359Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.008435s
2025-10-10T14:35:13.465635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:13.466024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:13.466080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:13.466139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0
2025-10-10T14:35:13.466349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601631116523830:9272]
2025-10-10T14:35:13.466359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1601 sessionId: src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0 is DEAD
2025-10-10T14:35:13.466376Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:35:13.466499Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 16 consumer shared/user session shared/user_1_16_1129463353550367506_v1 is DEAD
2025-10-10T14:35:13.467925Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601553807097644:9269] disconnected; active server actors: 1
2025-10-10T14:35:13.467930Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601553807097644:9269] client user disconnected session shared/user_1_16_1129463353550367506_v1
2025-10-10T14:35:13.474891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.474992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:13.475011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1602
2025-10-10T14:35:13.475141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.475175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:13.475181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:13.475186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:13.476107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1602 sessionId:  describe result for acl check
2025-10-10T14:35:13.476140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:13.476141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:13.476143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:13.476149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601631116523841:9862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:13.476718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601631116523841:9862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:13.478288Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:35:13.480117Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_17_5822207453619915188_v1
2025-10-10T14:35:13.478561Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:35:13.478572Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 17
2025-10-10T14:35:13.478836Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 17 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:35:13.478890Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:35:13.479319Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 auth for : user
2025-10-10T14:35:13.479546Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 Handle describe topics response
2025-10-10T14:35:13.479570Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 auth is DEAD
2025-10-10T14:35:13.479610Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:35:13.479905Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:35:13.480018Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601631116523865:9866] connected; active server actors: 1
2025-10-10T14:35:13.480038Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601631116523865:9866] session shared/user_1_17_5822207453619915188_v1
2025-10-10T14:35:13.480047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:35:13.480058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:35:13.480064Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_17_5822207453619915188_v1" (Sender=[1:7559601631116523855:9866], Pipe=[1:7559601631116523865:9866], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:35:13.480068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:35:13.480079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:35:13.480086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_17_5822207453619915188_v1" (Sender=[1:7559601631116523855:9866], Pipe=[1:7559601631116523865:9866], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:35:13.480089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601631116523841:9862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:13.480096Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_17_5822207453619915188_v1" sender [1:7559601631116523855:9866] lock partition 0 for ReadingSession "shared/user_1_17_5822207453619915188_v1" (Sender=[1:7559601631116523855:9866], Pipe=[1:7559601631116523865:9866], Partitions=[], ActiveFamilyCount=1) generation 1 step 17
2025-10-10T14:35:13.480105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:35:13.480111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-10-10T14:35:13.480325Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 17 Session: "shared/user_1_17_5822207453619915188_v1" ClientId: "user" PipeClient { RawX1: 7559601631116523865 RawX2: 4503603922347658 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:35:13.480341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:35:13.483624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601631116523841:9862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:13.483640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601631116523841:9862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:13.483643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601631116523841:9862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:13.483653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:13.498880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:13.502181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:13.502472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:13.502486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:13.502500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:13.502578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:13.502633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601630334299303:9259]
2025-10-10T14:35:13.503243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:13.507758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:13.507840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:13.508212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:13.508279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.508281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.508282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.508283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.508285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.508286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.508287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.508289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.508290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.508291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.508293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.508294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.508295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.508303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.508316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.508320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.508324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.508328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.508332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.508335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.508338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.508342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.508345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.508348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.508351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.508355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.508363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.508371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.508377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.508382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.508387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.508392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.508396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.508403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.508407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.508412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.508416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.508421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.508426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.508431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.508437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.508441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.508446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.508451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.508455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.508459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.508464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.508469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.508473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.508477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.508481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.508486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.508524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:13.512325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:13.512878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:13.512892Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:13.512895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:13.512899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:13.512907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1601 [2:7559601630334299303:9259]
2025-10-10T14:35:13.512921Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:13.512939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:13.512942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.512946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.512949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.512967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:13.512975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:13.512988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:13.513049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.513051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.513054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.513057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:13.513130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:13.513133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.513146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.513159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.513179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:13.513202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601630334299298:9259]
2025-10-10T14:35:13.513204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601630334299298:9259]
2025-10-10T14:35:13.513206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601630334299298:9259]
2025-10-10T14:35:13.513215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:13.513225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:13.513228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:13.513230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:13.513233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523883:9862], now have 1 active actors on pipe
2025-10-10T14:35:13.513240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:13.513257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:13.513261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:13.513266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523870:9869], now have 1 active actors on pipe
2025-10-10T14:35:13.513270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116523833:2438], now have 1 active actors on pipe
2025-10-10T14:35:13.513298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601630334299298:9259]
2025-10-10T14:35:13.513308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:13.513389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:13.513682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.513689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.513703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_17_5822207453619915188_v1 on pipe: [1:7559601631116523870:9869]
2025-10-10T14:35:13.513722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.513724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.513736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.513742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.513744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:13.513764Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_17_5822207453619915188_v1
2025-10-10T14:35:13.513766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.513805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b39bc89-c5e6c307-7646935-3c1428da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:13.513811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:35:13.513815Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:35:13.513939Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_17_5822207453619915188_v1:1 with generation 1601
2025-10-10T14:35:13.513433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1601, pipe: [1:7559601631116523870:9869]
2025-10-10T14:35:13.513467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1601
2025-10-10T14:35:13.513494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1601
2025-10-10T14:35:13.519250Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106913512 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:35:13.519273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:35:13.519317Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 sending to client partition status
2025-10-10T14:35:13.519552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1602 partition: 0 MaxSeqNo: 40 sessionId: src_id|3b39bc89-c5e6c307-7646935-3c1428da_0
2025-10-10T14:35:13.518647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:35:13.518695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:35:13.518706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.518715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.518718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:13.518732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.518750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:13.518759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:35:13.518774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:35:13.518790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.519377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.519385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.519411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.522305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be54da-cadc1c13-31ad195e-e7cbfa13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3b39bc89-c5e6c307-7646935-3c1428da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:13.524892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b39bc89-c5e6c307-7646935-3c1428da_0] Write session: try to update token
2025-10-10T14:35:13.524911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b39bc89-c5e6c307-7646935-3c1428da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:13.533614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:13.533634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:13.533637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:13.533640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:13.533650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601630334299298:9259]
2025-10-10T14:35:13.533654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601630334299298:9259]
2025-10-10T14:35:13.533661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601630334299298:9259]
2025-10-10T14:35:13.533712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:13.533719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.533722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:13.533861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:13.537624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:13.537645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:13.537649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:13.549286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId: src_id|3b39bc89-c5e6c307-7646935-3c1428da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:13.551998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:13.656553Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:13.656922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.656931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.657169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_17_5822207453619915188_v1
2025-10-10T14:35:13.657187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:13.657216Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_17_5822207453619915188_v1
2025-10-10T14:35:13.657255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:13.657270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:13.657358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1602 reason: error at write: Disconnected sessionId: src_id|3b39bc89-c5e6c307-7646935-3c1428da_0
2025-10-10T14:35:13.657566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1602 sessionId: src_id|3b39bc89-c5e6c307-7646935-3c1428da_0 is DEAD
2025-10-10T14:35:13.657752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601631116523870:9869]
2025-10-10T14:35:13.657768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:13.659753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b39bc89-c5e6c307-7646935-3c1428da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:13.659764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b39bc89-c5e6c307-7646935-3c1428da_0] Write session will restart in 0.006767s
2025-10-10T14:35:13.659784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b39bc89-c5e6c307-7646935-3c1428da_0] Write session: Do CDS request
2025-10-10T14:35:13.659789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b39bc89-c5e6c307-7646935-3c1428da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:13.667928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b39bc89-c5e6c307-7646935-3c1428da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.668008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:13.668025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1603
2025-10-10T14:35:13.668135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.668166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:13.668171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:13.668175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:13.669594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1603 sessionId:  describe result for acl check
2025-10-10T14:35:13.669638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:13.669649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:13.669651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:13.669656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601631116524085:9878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:13.670224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601631116524085:9878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:13.672313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601631116524085:9878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:13.678184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601631116524085:9878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:13.678200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601631116524085:9878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:13.678204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601631116524085:9878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:13.678213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:13.679823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:13.682227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:13.682479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:13.682491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:13.682504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:13.682569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:13.682625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601630334299537:9273]
2025-10-10T14:35:13.683295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:13.683671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:13.683736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:13.684084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:13.684159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.684166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.684167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.684168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.684169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.684170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.684172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.684173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.684174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.684175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.684176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.684178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.684179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.684185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.684198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.684202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.684206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.684210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.684214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.684218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.684223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.684226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.684231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.684235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.684239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.684243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.684251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.684260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.684273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.684279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.684283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.684289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.684293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.684302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.684308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.684318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.684322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.684327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.684332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.684338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.684342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.684348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.684353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.684358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.684363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.684373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.684378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.684383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.684392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.684397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.684406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.684411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.684453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:13.686982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:13.687401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:13.687414Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:13.687416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:13.687420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:13.687426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1602 [2:7559601630334299537:9273]
2025-10-10T14:35:13.687441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:13.687459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:13.687467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.687471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.687473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.687490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:13.687503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:13.687515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:13.687565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.687571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.687573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.687575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:13.687629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:13.687634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.687642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.687648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.687662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:13.687689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601630334299531:9273]
2025-10-10T14:35:13.687696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601630334299531:9273]
2025-10-10T14:35:13.687698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601630334299531:9273]
2025-10-10T14:35:13.687706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:13.687721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116524237:9878], now have 1 active actors on pipe
2025-10-10T14:35:13.687723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:13.687726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:13.687728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116524050:2438], now have 1 active actors on pipe
2025-10-10T14:35:13.687729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:13.687732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:13.687744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:13.687746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:13.687771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601630334299531:9273]
2025-10-10T14:35:13.687783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:13.687802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:13.689417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1602
2025-10-10T14:35:13.689448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1602
2025-10-10T14:35:13.690014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1603 partition: 0 MaxSeqNo: 40 sessionId: src_id|529557dd-b4d990d6-73a2c119-9dac4460_0
2025-10-10T14:35:13.690411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b39bc89-c5e6c307-7646935-3c1428da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|529557dd-b4d990d6-73a2c119-9dac4460_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:13.689542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.689558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.689598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|529557dd-b4d990d6-73a2c119-9dac4460_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:13.689609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.689614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.689616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:13.689629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.689645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:13.689666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.689919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.689923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.689940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.693152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529557dd-b4d990d6-73a2c119-9dac4460_0] Write session: try to update token
2025-10-10T14:35:13.693173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529557dd-b4d990d6-73a2c119-9dac4460_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:13.710085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:13.710116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:13.710122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:13.710124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:13.710138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601630334299531:9273]
2025-10-10T14:35:13.710146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601630334299531:9273]
2025-10-10T14:35:13.710151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601630334299531:9273]
2025-10-10T14:35:13.709496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId: src_id|529557dd-b4d990d6-73a2c119-9dac4460_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:13.712507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:13.710221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:13.710232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:13.710239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:13.710245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.710247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:13.710248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:13.710439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:13.757905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601631116524267:9869]
2025-10-10T14:35:13.758917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1602, pipe: [1:7559601631116524267:9869]
2025-10-10T14:35:13.829260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:13.829634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.829660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.829712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116524267:9869], now have 1 active actors on pipe
2025-10-10T14:35:13.829950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:13.829993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:13.830014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:13.830112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:13.830135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1603 reason: error at write: Disconnected sessionId: src_id|529557dd-b4d990d6-73a2c119-9dac4460_0
2025-10-10T14:35:13.830174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601631116524267:9869]
2025-10-10T14:35:13.830456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1603 sessionId: src_id|529557dd-b4d990d6-73a2c119-9dac4460_0 is DEAD
2025-10-10T14:35:13.833466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529557dd-b4d990d6-73a2c119-9dac4460_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:13.833479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529557dd-b4d990d6-73a2c119-9dac4460_0] Write session will restart in 0.005607s
2025-10-10T14:35:13.833505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529557dd-b4d990d6-73a2c119-9dac4460_0] Write session: Do CDS request
2025-10-10T14:35:13.833513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529557dd-b4d990d6-73a2c119-9dac4460_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:13.839905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529557dd-b4d990d6-73a2c119-9dac4460_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.839926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:13.839942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1604
2025-10-10T14:35:13.840166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:13.840231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:13.840242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:13.840267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:13.840839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1604 sessionId:  describe result for acl check
2025-10-10T14:35:13.840879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:13.840886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:13.840888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:13.840895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601631116524321:9885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:13.841474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601631116524321:9885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:13.844745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601631116524321:9885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:13.845816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:13.848179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:13.848432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:13.848445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:13.848459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:13.848539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:13.848583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601630334299733:9278]
2025-10-10T14:35:13.848586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601631116524321:9885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:13.848613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601631116524321:9885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:13.848617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601631116524321:9885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:13.848626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:13.849163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:13.849488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:13.849537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:13.849875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:13.849930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.849940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.849941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.849943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.849944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.849945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.849946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.849948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.849949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.849950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.849951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.849952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.849954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.849960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.849973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.849978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.849982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.849986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.849990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.849994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.849998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.850002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.850006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.850010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.850014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.850017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.850025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.850034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:13.850041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.850046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:13.850050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.850056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:13.850060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.850066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:13.850071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.850077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:13.850081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.850086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:13.850091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.850095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:13.850100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.850105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:13.850110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.850116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:13.850120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.850125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:13.850129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.850134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.850139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.850144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.850159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.850164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.850206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:13.852716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:13.853045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:13.853061Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:13.853064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:13.853067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:13.853074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1603 [2:7559601630334299733:9278]
2025-10-10T14:35:13.853088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:13.853108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:13.853119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.853123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.853125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.853142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:13.853150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:13.853158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:13.853218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.853230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.853232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.853234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:13.853307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:13.853317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.853349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:13.853362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:13.853386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:13.853414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116524269:2438], now have 1 active actors on pipe
2025-10-10T14:35:13.853423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116524450:9885], now have 1 active actors on pipe
2025-10-10T14:35:13.853432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601630334299728:9278]
2025-10-10T14:35:13.853434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601630334299728:9278]
2025-10-10T14:35:13.853437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601630334299728:9278]
2025-10-10T14:35:13.853452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:13.853472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:13.853482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:13.853486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:13.853488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:13.853496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:13.853499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:13.853523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601630334299728:9278]
2025-10-10T14:35:13.853526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:13.853457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1603
2025-10-10T14:35:13.853501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1603
2025-10-10T14:35:13.853536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:13.853667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.853678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.853710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5077689-7eec9183-535914a6-c089a6f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:13.853723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:13.853735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:13.853737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:13.853749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:13.853762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:13.853778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.854106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.854119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.854141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:13.854232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1604 partition: 0 MaxSeqNo: 40 sessionId: src_id|5077689-7eec9183-535914a6-c089a6f6_0
2025-10-10T14:35:13.854664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529557dd-b4d990d6-73a2c119-9dac4460_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5077689-7eec9183-535914a6-c089a6f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:13.857416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5077689-7eec9183-535914a6-c089a6f6_0] Write session: try to update token
2025-10-10T14:35:13.857433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5077689-7eec9183-535914a6-c089a6f6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:13.873043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:13.873067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:13.873070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:13.873073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:13.873084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601630334299728:9278]
2025-10-10T14:35:13.873090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601630334299728:9278]
2025-10-10T14:35:13.873095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601630334299728:9278]
2025-10-10T14:35:13.873149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:13.873164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:13.873162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:13.873166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:13.873169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:13.873174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:13.873304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:13.879590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId: src_id|5077689-7eec9183-535914a6-c089a6f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:13.882312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:13.930440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601631116524462:9869]
2025-10-10T14:35:13.930798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1603, pipe: [1:7559601631116524462:9869]
2025-10-10T14:35:13.988536Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:13.989092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:13.989110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:13.989135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116524462:9869], now have 1 active actors on pipe
2025-10-10T14:35:13.989362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:13.993402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:13.993423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601631116524462:9869]
2025-10-10T14:35:13.993453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:13.993544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1604 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5077689-7eec9183-535914a6-c089a6f6_0
2025-10-10T14:35:13.993988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5077689-7eec9183-535914a6-c089a6f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:13.994009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5077689-7eec9183-535914a6-c089a6f6_0] Write session will restart in 0.006023s
2025-10-10T14:35:13.994033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5077689-7eec9183-535914a6-c089a6f6_0] Write session: Do CDS request
2025-10-10T14:35:13.994039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5077689-7eec9183-535914a6-c089a6f6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:13.993768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1604 sessionId: src_id|5077689-7eec9183-535914a6-c089a6f6_0 is DEAD
2025-10-10T14:35:14.000879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5077689-7eec9183-535914a6-c089a6f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.000989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:14.001005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1605
2025-10-10T14:35:14.001151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.001200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:14.001206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:14.001212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:14.002126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1605 sessionId:  describe result for acl check
2025-10-10T14:35:14.002175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:14.002182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:14.002184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:14.002192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601635411491820:9889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:14.002832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601635411491820:9889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:14.007812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601635411491820:9889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:14.007896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:14.010563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:14.010828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:14.010841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:14.010853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:14.010912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:14.010969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601634629267218:9280]
2025-10-10T14:35:14.010945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601635411491820:9889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:14.010960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601635411491820:9889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:14.010963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601635411491820:9889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:14.010972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:14.011571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:14.011868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:14.011923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:14.012295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:14.012353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.012359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.012361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.012362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.012364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.012365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.012366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.012368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.012370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.012371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.012372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.012374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.012375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.012381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.012395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.012399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.012404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.012408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.012412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.012417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.012421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.012426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.012431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.012435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.012439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.012443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.012451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.012465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.012476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.012486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.012491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.012498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.012507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.012513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.012522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.012527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.012532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.012538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.012547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.012553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.012561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.012567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.012572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.012581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.012586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.012592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.012602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.012622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.012627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.012637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.012641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.012647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.012702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:14.015292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:14.015920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:14.015935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:14.015938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:14.015942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:14.015948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1604 [2:7559601634629267218:9280]
2025-10-10T14:35:14.015961Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:14.015980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:14.015985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.015989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.015991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.016010Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:14.016024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:14.016036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:14.016099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.016106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.016108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.016110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:14.016181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:14.016188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.016201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.016212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.016229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:14.016258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601634629267213:9280]
2025-10-10T14:35:14.016265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601634629267213:9280]
2025-10-10T14:35:14.016267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601634629267213:9280]
2025-10-10T14:35:14.016276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:14.016288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:14.016291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:14.016293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601631116524466:2438], now have 1 active actors on pipe
2025-10-10T14:35:14.016293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:14.016300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:14.016316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:14.016319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:14.016325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411491938:9889], now have 1 active actors on pipe
2025-10-10T14:35:14.016354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601634629267213:9280]
2025-10-10T14:35:14.016361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:14.016380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1604
2025-10-10T14:35:14.016384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1604
2025-10-10T14:35:14.016486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.016501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.016520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:14.016536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:14.016546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.016558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.016561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:14.016577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.016593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:14.016611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.016813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.016825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.016848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.017050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1605 partition: 0 MaxSeqNo: 40 sessionId: src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0
2025-10-10T14:35:14.017527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5077689-7eec9183-535914a6-c089a6f6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:14.020276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0] Write session: try to update token
2025-10-10T14:35:14.020294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:14.037117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:14.037140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:14.037143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:14.037145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:14.037156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601634629267213:9280]
2025-10-10T14:35:14.037161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601634629267213:9280]
2025-10-10T14:35:14.037164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601634629267213:9280]
2025-10-10T14:35:14.037219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:14.037218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:14.037225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:14.037230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:14.037234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.037238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:14.037421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:14.039700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId: src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:14.042260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:14.093782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601635411491950:9869]
2025-10-10T14:35:14.094203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1604, pipe: [1:7559601635411491950:9869]
2025-10-10T14:35:14.150146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:14.150448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.150464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.150513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411491950:9869], now have 1 active actors on pipe
2025-10-10T14:35:14.150807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:14.150816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601635411491950:9869]
2025-10-10T14:35:14.150856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:14.150908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:14.151009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1605 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0
2025-10-10T14:35:14.151235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1605 sessionId: src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0 is DEAD
2025-10-10T14:35:14.151398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:14.151410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0] Write session will restart in 0.008085s
2025-10-10T14:35:14.151434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0] Write session: Do CDS request
2025-10-10T14:35:14.151441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:14.160923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.161024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:14.161040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1606
2025-10-10T14:35:14.161181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.161226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:14.161236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:14.161240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:14.161738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1606 sessionId:  describe result for acl check
2025-10-10T14:35:14.161774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:14.161782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:14.161784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:14.161791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601635411492006:9893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:14.162368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601635411492006:9893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:14.164760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601635411492006:9893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:14.167457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:14.167649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601635411492006:9893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:14.167665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601635411492006:9893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:14.167669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601635411492006:9893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:14.167678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:14.169560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:14.169752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:14.169767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:14.169780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:14.169826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:14.169863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601634629267409:9282]
2025-10-10T14:35:14.170393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:14.170708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:14.170760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:14.171022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:14.171093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.171097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.171098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.171099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.171100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.171100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.171101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.171102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.171102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.171103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.171104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.171105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.171106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.171110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.171119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.171122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.171124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.171126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.171128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.171130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.171132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.171134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.171137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.171140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.171144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.171147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.171154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.171162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.171168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.171173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.171177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.171182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.171185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.171190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.171194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.171199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.171203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.171208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.171213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.171217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.171221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.171226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.171230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.171235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.171239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.171244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.171249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.171260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.171264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.171269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.171273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.171282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.171322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:14.173891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:14.174486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:14.174497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:14.174499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:14.174502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:14.174507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1605 [2:7559601634629267409:9282]
2025-10-10T14:35:14.174516Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:14.174529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:14.174531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.174533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.174534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.174558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:14.174565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:14.174573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:14.174620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.174626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.174628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.174629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:14.174694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:14.174699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.174707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.174713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.174722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:14.174738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601634629267403:9282]
2025-10-10T14:35:14.174740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601634629267403:9282]
2025-10-10T14:35:14.174741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601634629267403:9282]
2025-10-10T14:35:14.174746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:14.174757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:14.174766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:14.174768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:14.174790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601634629267403:9282]
2025-10-10T14:35:14.174792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:14.174801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:14.174805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:14.174807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:14.174815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:14.174828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411491951:2438], now have 1 active actors on pipe
2025-10-10T14:35:14.174831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492133:9893], now have 1 active actors on pipe
2025-10-10T14:35:14.174985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1605
2025-10-10T14:35:14.174985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1605
2025-10-10T14:35:14.175086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.175097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.175127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:14.175135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.175138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.175140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:14.175149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.175159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:14.175170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.175331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.175336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.175349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.175435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1606 partition: 0 MaxSeqNo: 40 sessionId: src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0
2025-10-10T14:35:14.175874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb501ef-7a8fadb0-a19a6740-43792dfb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:14.178766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0] Write session: try to update token
2025-10-10T14:35:14.178787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:14.196905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:14.196929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:14.196933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:14.196935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:14.196947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601634629267403:9282]
2025-10-10T14:35:14.196951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601634629267403:9282]
2025-10-10T14:35:14.196955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601634629267403:9282]
2025-10-10T14:35:14.197013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:14.197013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:14.197020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:14.197024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:14.197025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.197028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:14.197176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:14.198383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId: src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:14.201213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:14.251602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601635411492145:9869]
2025-10-10T14:35:14.251975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1605, pipe: [1:7559601635411492145:9869]
2025-10-10T14:35:14.319276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:14.319584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.319604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.319653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492145:9869], now have 1 active actors on pipe
2025-10-10T14:35:14.319878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601635411492145:9869]
2025-10-10T14:35:14.319888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:14.319910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:14.319912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:14.319981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1606 reason: error at write: Disconnected sessionId: src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0
2025-10-10T14:35:14.320234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1606 sessionId: src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0 is DEAD
2025-10-10T14:35:14.319874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:14.320450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:14.320461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0] Write session will restart in 0.007002s
2025-10-10T14:35:14.320496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0] Write session: Do CDS request
2025-10-10T14:35:14.320502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:14.328958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.329046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:14.329062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1607
2025-10-10T14:35:14.329194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.329227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:14.329238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:14.329241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:14.329719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1607 sessionId:  describe result for acl check
2025-10-10T14:35:14.329761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:14.329768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:14.329770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:14.329777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601635411492175:9897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:14.330347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601635411492175:9897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:14.333576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601635411492175:9897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:14.335747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:14.338234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:14.338425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601635411492175:9897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:14.338441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601635411492175:9897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:14.338445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601635411492175:9897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:14.338455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:14.338556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:14.338573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:14.338589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:14.338676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:14.338744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601634629267599:9284]
2025-10-10T14:35:14.339500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:14.339869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:14.339932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:14.340306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:14.340377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.340384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.340385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.340387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.340388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.340390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.340391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.340393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.340394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.340395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.340396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.340398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.340399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.340407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.340420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.340424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.340428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.340431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.340436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.340440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.340444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.340448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.340452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.340456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.340460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.340464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.340472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.340482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.340489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.340495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.340500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.340505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.340517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.340523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.340528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.340532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.340537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.340543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.340547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.340553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.340561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.340567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.340572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.340582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.340587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.340596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.340600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.340605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.340613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.340618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.340622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.340631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.340672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:14.343348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:14.343802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:14.343820Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:14.343822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:14.343826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:14.343833Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1606 [2:7559601634629267599:9284]
2025-10-10T14:35:14.343848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:14.343871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:14.343878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.343883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.343885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.343906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:14.343919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:14.343928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:14.344000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.344008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.344011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.344014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:14.344089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:14.344101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.344113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.344126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.344145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:14.344168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601634629267594:9284]
2025-10-10T14:35:14.344172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601634629267594:9284]
2025-10-10T14:35:14.344174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601634629267594:9284]
2025-10-10T14:35:14.344184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:14.344196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:14.344204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492330:9897], now have 1 active actors on pipe
2025-10-10T14:35:14.344210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:14.344213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:14.344214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492146:2438], now have 1 active actors on pipe
2025-10-10T14:35:14.344221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:14.344239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:14.344243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:14.344278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601634629267594:9284]
2025-10-10T14:35:14.344296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:14.344294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1606
2025-10-10T14:35:14.344315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:14.344298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1606
2025-10-10T14:35:14.344491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.344508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.344550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:14.344566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.344571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.344574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:14.344589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.344604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:14.344626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.344882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.344891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.344907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.345077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1607 partition: 0 MaxSeqNo: 40 sessionId: src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0
2025-10-10T14:35:14.345527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82446e6a-ed579ff2-55a8147b-9ce23765_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:14.348272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0] Write session: try to update token
2025-10-10T14:35:14.348292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:14.356150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:14.356171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:14.356184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601634629267594:9284]
2025-10-10T14:35:14.356227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:14.356235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:14.356444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:14.356669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:14.356897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:14.357127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:14.357473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:14.357536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:14.362740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId: src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:14.365292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:14.365560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.365585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.365644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:14.365745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:14.374504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:14.374527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:14.374531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:14.374534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:14.374545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601634629267594:9284]
2025-10-10T14:35:14.374549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601634629267594:9284]
2025-10-10T14:35:14.374554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601634629267594:9284]
2025-10-10T14:35:14.374595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:14.374602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.374604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:14.374609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:14.374623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:14.374640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:14.374759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:14.419911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601635411492342:9869]
2025-10-10T14:35:14.420266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1606, pipe: [1:7559601635411492342:9869]
2025-10-10T14:35:14.488250Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:14.496718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.496759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.496951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.497031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.497104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.497175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.497234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.497240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.497314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.500506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:14.500517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:14.500522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:14.500567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1607 reason: error at write: Disconnected sessionId: src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0
2025-10-10T14:35:14.500567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601635411492342:9869]
2025-10-10T14:35:14.500811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1607 sessionId: src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0 is DEAD
2025-10-10T14:35:14.501038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:14.501049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0] Write session will restart in 0.008587s
2025-10-10T14:35:14.501076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0] Write session: Do CDS request
2025-10-10T14:35:14.501082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:14.497438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.497512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.497582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.497736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.497741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.497816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.497878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.497942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.498001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.498043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.498046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.498119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.498183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.498244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.498308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.498350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.498354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.498424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.498481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.498543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.498644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.498688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.498692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.498761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.498817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.498877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.498933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.498981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.498984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.499053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.499109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.499168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.499228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.499265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.499269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.499334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.499392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.499448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.499515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.499558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.499561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.499632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.499690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.499748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.499810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.499857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.499861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.499928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:14.499982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:14.500039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:14.500096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:14.500134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:14.500137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:14.500207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492342:9869], now have 1 active actors on pipe
2025-10-10T14:35:14.501670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:14.510918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.511039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:14.511054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1608
2025-10-10T14:35:14.511185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.511222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:14.511227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:14.511231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:14.511626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1608 sessionId:  describe result for acl check
2025-10-10T14:35:14.511660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:14.511667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:14.511669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:14.511675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601635411492369:9901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:14.512239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601635411492369:9901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:14.515482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601635411492369:9901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:14.520488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601635411492369:9901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:14.520506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601635411492369:9901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:14.520511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601635411492369:9901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:14.520521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:14.529378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:14.531897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:14.532142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:14.532152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:14.532166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:14.532227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:14.532271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601634629267793:9286]
2025-10-10T14:35:14.532909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:14.533209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:14.533255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:14.533594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:14.533653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.533658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.533660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.533661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.533662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.533663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.533664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.533666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.533667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.533668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.533669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.533671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.533672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.533677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.533691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.533695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.533700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.533704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.533708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.533712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.533715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.533719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.533723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.533727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.533731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.533735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.533743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.533752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.533758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.533764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.533768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.533773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.533778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.533783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.533788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.533794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.533798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.533803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.533812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.533818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.533822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.533827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.533836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.533841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.533845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.533849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.533853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.533859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.533862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.533868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.533872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.533879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.533919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:14.536335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:14.536670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:14.536682Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:14.536685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:14.536689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:14.536696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1607 [2:7559601634629267793:9286]
2025-10-10T14:35:14.536710Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:14.536733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:14.536740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.536744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.536746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.536763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:14.536776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:14.536788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:14.536841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.536847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.536849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.536852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:14.536916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:14.536923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.536934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.536950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.536969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:14.536994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492425:9901], now have 1 active actors on pipe
2025-10-10T14:35:14.537002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492344:2438], now have 1 active actors on pipe
2025-10-10T14:35:14.537009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601634629267788:9286]
2025-10-10T14:35:14.537014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601634629267788:9286]
2025-10-10T14:35:14.537016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601634629267788:9286]
2025-10-10T14:35:14.537029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:14.537042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:14.537043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:14.537045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:14.537047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:14.537075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:14.537078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:14.537072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1607
2025-10-10T14:35:14.537102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601634629267788:9286]
2025-10-10T14:35:14.537113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:14.537074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1607
2025-10-10T14:35:14.537119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:14.537141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.537149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.537205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:14.537217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.537226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.537229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:14.537241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.537252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:14.537275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.537425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.537433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.537448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.537533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1608 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0
2025-10-10T14:35:14.537959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb03f0-f2ed29ad-28199861-1b7c8fb0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:14.540696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0] Write session: try to update token
2025-10-10T14:35:14.540715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:14.554894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId: src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:14.556310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:14.556334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:14.556337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:14.556339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:14.556349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601634629267788:9286]
2025-10-10T14:35:14.556354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601634629267788:9286]
2025-10-10T14:35:14.556358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601634629267788:9286]
2025-10-10T14:35:14.556405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:14.556403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:14.556410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:14.556417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:14.556420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.556422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:14.556551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:14.557524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:14.600647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601635411492544:9869]
2025-10-10T14:35:14.600963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1607, pipe: [1:7559601635411492544:9869]
2025-10-10T14:35:14.669444Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:14.670079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.670100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.670146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492544:9869], now have 1 active actors on pipe
2025-10-10T14:35:14.670323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:14.670317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:14.670332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:14.670396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1608 reason: error at write: Disconnected sessionId: src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0
2025-10-10T14:35:14.670414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601635411492544:9869]
2025-10-10T14:35:14.670436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:14.670591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1608 sessionId: src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0 is DEAD
2025-10-10T14:35:14.670797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:14.670809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0] Write session will restart in 0.008471s
2025-10-10T14:35:14.670837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0] Write session: Do CDS request
2025-10-10T14:35:14.670846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:14.680975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.681443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:14.681461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1609
2025-10-10T14:35:14.681592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.681638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:14.681649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:14.681653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:14.682146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1609 sessionId:  describe result for acl check
2025-10-10T14:35:14.682194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:14.682200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:14.682202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:14.682209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601635411492629:9907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:14.682770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601635411492629:9907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:14.685418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601635411492629:9907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:14.686830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:14.689117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:14.689310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:14.689322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:14.689354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:14.689416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:14.689468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601634629268028:9300]
2025-10-10T14:35:14.689489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601635411492629:9907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:14.689503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601635411492629:9907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:14.689507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601635411492629:9907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:14.689515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:14.690068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:14.690358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:14.690415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:14.690737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:14.690791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.690798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.690799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.690800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.690801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.690802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.690803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.690804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.690806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.690807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.690808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.690809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.690810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.690815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.690828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.690832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.690836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.690840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.690845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.690849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.690853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.690856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.690860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.690864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.690867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.690871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.690878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.690887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.690893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.690899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.690903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.690908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.690913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.690918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.690923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.690928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.690932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.690942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.690947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.690952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.690962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.690967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.690975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.690980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.690985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.690990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.690994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.690999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.691003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.691012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.691016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.691021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.691058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:14.693505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:14.694023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:14.694034Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:14.694036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:14.694039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:14.694045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1608 [2:7559601634629268028:9300]
2025-10-10T14:35:14.694057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:14.694074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:14.694081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.694084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.694086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.694102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:14.694113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:14.694125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:14.694175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.694181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.694183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.694186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:14.694256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:14.694263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.694273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.694287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.694304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:14.694330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492563:2438], now have 1 active actors on pipe
2025-10-10T14:35:14.694338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492749:9907], now have 1 active actors on pipe
2025-10-10T14:35:14.694345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601634629268023:9300]
2025-10-10T14:35:14.694347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601634629268023:9300]
2025-10-10T14:35:14.694349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601634629268023:9300]
2025-10-10T14:35:14.694360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:14.694360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1608
2025-10-10T14:35:14.694381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:14.694388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:14.694400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:14.694402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:14.694399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1608
2025-10-10T14:35:14.694405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:14.694408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:14.694436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601634629268023:9300]
2025-10-10T14:35:14.694446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:14.694459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:14.694460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.694465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.694507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:14.694521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.694524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.694526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:14.694537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.694552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:14.694573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.694697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.694704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.694718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.694813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1609 partition: 0 MaxSeqNo: 40 sessionId: src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0
2025-10-10T14:35:14.695231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd80985b-4fe87886-a7e3066a-799e2eba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:14.698110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0] Write session: try to update token
2025-10-10T14:35:14.698129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:14.712335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId: src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:14.713681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:14.713703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:14.713707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:14.713710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:14.713718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601634629268023:9300]
2025-10-10T14:35:14.713722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601634629268023:9300]
2025-10-10T14:35:14.713727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601634629268023:9300]
2025-10-10T14:35:14.713769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:14.713775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:14.713782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.713783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:14.713785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:14.713788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:14.713934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:14.714919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:14.770609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601635411492788:9869]
2025-10-10T14:35:14.770930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1608, pipe: [1:7559601635411492788:9869]
2025-10-10T14:35:14.831586Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:14.832002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.832018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.832067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492788:9869], now have 1 active actors on pipe
2025-10-10T14:35:14.832273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:14.832330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601635411492788:9869]
2025-10-10T14:35:14.832345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:14.832363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:14.832452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1609 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0
2025-10-10T14:35:14.832664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1609 sessionId: src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0 is DEAD
2025-10-10T14:35:14.832802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:14.832813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0] Write session will restart in 0.009454s
2025-10-10T14:35:14.832839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0] Write session: Do CDS request
2025-10-10T14:35:14.832845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:14.843973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.844037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:14.844052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1610
2025-10-10T14:35:14.844236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:14.844286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:14.844297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:14.844301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:14.844754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1610 sessionId:  describe result for acl check
2025-10-10T14:35:14.844792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:14.844798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:14.844808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:14.844814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601635411492859:9920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:14.845403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601635411492859:9920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:14.847613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601635411492859:9920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:14.850867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601635411492859:9920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:14.850882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601635411492859:9920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:14.850885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601635411492859:9920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:14.850894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:14.854932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:14.857237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:14.857472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:14.857486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:14.857499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:14.857557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:14.857612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601634629268232:9305]
2025-10-10T14:35:14.858250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:14.858546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:14.858591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:14.858927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:14.858997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.859003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.859005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.859006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.859008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.859009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.859010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.859012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.859013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.859015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.859016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.859017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.859019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.859025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.859050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.859055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.859059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.859064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.859068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.859073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.859077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.859081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.859086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.859091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.859095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.859099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.859117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.859131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:14.859139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.859145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:14.859150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.859163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:14.859167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.859173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:14.859179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.859184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:14.859189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.859194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:14.859199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.859205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:14.859210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.859216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:14.859221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.859227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:14.859231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.859237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:14.859242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.859247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.859254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.859259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.859264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.859270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.859310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:14.864455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:14.864814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:14.864829Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:14.864832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:14.864837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:14.864845Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1609 [2:7559601634629268232:9305]
2025-10-10T14:35:14.864860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:14.864881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:14.864889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.864894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.864897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.864916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:14.864929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:14.864942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:14.865002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.865011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.865013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.865016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:14.865258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1609
2025-10-10T14:35:14.865259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1609
2025-10-10T14:35:14.865396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:14.865406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.865420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:14.865433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:14.865452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:14.865484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492917:9920], now have 1 active actors on pipe
2025-10-10T14:35:14.865487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492789:2438], now have 1 active actors on pipe
2025-10-10T14:35:14.865507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.865512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.865536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601634629268227:9305]
2025-10-10T14:35:14.865544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601634629268227:9305]
2025-10-10T14:35:14.865546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601634629268227:9305]
2025-10-10T14:35:14.865561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:14.865573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:14.865581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:14.865583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:14.865584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:14.865600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:14.865605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:14.865629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:14.865643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:14.865647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:14.865650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:14.865661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:14.865679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:14.865726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601634629268227:9305]
2025-10-10T14:35:14.865738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:14.865749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:14.865758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.865950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:14.865958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:14.865974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:14.866056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1610 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0
2025-10-10T14:35:14.869437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8ad13b3-98391f1e-dbf609df-13d420ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:14.872060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0] Write session: try to update token
2025-10-10T14:35:14.872080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:14.895397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId: src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:14.895537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:14.895560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:14.895563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:14.895565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:14.895575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601634629268227:9305]
2025-10-10T14:35:14.895580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601634629268227:9305]
2025-10-10T14:35:14.895584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601634629268227:9305]
2025-10-10T14:35:14.895632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:14.895635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:14.895638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:14.895642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:14.895644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:14.895646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:14.895787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:14.898108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:14.932439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601635411492987:9869]
2025-10-10T14:35:14.932883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1609, pipe: [1:7559601635411492987:9869]
2025-10-10T14:35:15.014692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:15.015105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.015126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.015174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601635411492987:9869], now have 1 active actors on pipe
2025-10-10T14:35:15.015374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:15.015907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:15.015985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1610 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0
2025-10-10T14:35:15.016202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1610 sessionId: src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0 is DEAD
2025-10-10T14:35:15.016368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:15.016390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:15.016402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0] Write session will restart in 0.005318s
2025-10-10T14:35:15.016427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0] Write session: Do CDS request
2025-10-10T14:35:15.016417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601635411492987:9869]
2025-10-10T14:35:15.016443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:15.022968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.023042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:15.023056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1611
2025-10-10T14:35:15.023221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.023260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:15.023271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:15.023275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:15.023690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1611 sessionId:  describe result for acl check
2025-10-10T14:35:15.023724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:15.023728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:15.023730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:15.023736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601639706460300:9924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:15.024319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601639706460300:9924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:15.026979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601639706460300:9924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:15.030065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601639706460300:9924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:15.030082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601639706460300:9924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:15.030085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601639706460300:9924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:15.030096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:15.033131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:15.035880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:15.036166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:15.036177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:15.036190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:15.036254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:15.036300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601638924235723:9307]
2025-10-10T14:35:15.036982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:15.037457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:15.037519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:15.037890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:15.037947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.037953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.037955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.037956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.037958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.037959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.037961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.037962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.037964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.037965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.037967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.037968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.037969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.037975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.037990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.037994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.038011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.038016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.038020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.038025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.038029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.038034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.038039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.038043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.038048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.038052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.038060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.038070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.038082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.038088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.038099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.038105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.038110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.038117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.038127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.038133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.038164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.038175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.038181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.038186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.038191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.038197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.038202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.038213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.038218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.038226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.038238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.038243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.038248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.038254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.038259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.038265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.038308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:15.040990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:15.041388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:15.041403Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:15.041406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:15.041411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:15.041419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1610 [2:7559601638924235723:9307]
2025-10-10T14:35:15.041435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:15.041458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:15.041461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.041465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.041468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.041487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:15.041496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:15.041505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:15.041572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.041581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.041583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.041586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:15.041665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:15.041673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.041686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.041703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.041730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:15.041761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460441:9924], now have 1 active actors on pipe
2025-10-10T14:35:15.041768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460285:2438], now have 1 active actors on pipe
2025-10-10T14:35:15.041777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601638924235718:9307]
2025-10-10T14:35:15.041779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601638924235718:9307]
2025-10-10T14:35:15.041781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601638924235718:9307]
2025-10-10T14:35:15.041795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:15.041808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:15.041811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:15.041811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:15.041815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:15.041799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1610
2025-10-10T14:35:15.041827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:15.041801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1610
2025-10-10T14:35:15.041833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:15.041870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601638924235718:9307]
2025-10-10T14:35:15.041894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:15.041932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:15.042088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.042099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.042137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e21ec9d-77ac349f-71571a20-51066b82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:15.042151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.042156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.042163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:15.042176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.042189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:15.042208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.042767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.042783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.042809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.042940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1611 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e21ec9d-77ac349f-71571a20-51066b82_0
2025-10-10T14:35:15.043414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6ba29-ff5c1f0f-27e10c29-788c6c83_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e21ec9d-77ac349f-71571a20-51066b82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:15.047007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21ec9d-77ac349f-71571a20-51066b82_0] Write session: try to update token
2025-10-10T14:35:15.047032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21ec9d-77ac349f-71571a20-51066b82_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:15.055575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:15.055593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.055605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601638924235718:9307]
2025-10-10T14:35:15.055653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:15.055662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:15.055838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:15.055989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.056140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.056296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.056514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:15.056566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:15.063914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId: src_id|9e21ec9d-77ac349f-71571a20-51066b82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:15.066728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:15.066980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.067003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.067058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:15.067164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:15.077149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:15.077168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.077171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:15.077173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:15.077184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601638924235718:9307]
2025-10-10T14:35:15.077188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601638924235718:9307]
2025-10-10T14:35:15.077194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601638924235718:9307]
2025-10-10T14:35:15.077249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:15.077258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.077267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:15.077416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:15.078314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:15.078321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:15.078327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:15.116752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601639706460483:9869]
2025-10-10T14:35:15.117131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1610, pipe: [1:7559601639706460483:9869]
2025-10-10T14:35:15.191666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:15.200048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.200076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.200263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.200334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.200403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.200472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.200966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.200979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.201049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.201124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.201190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.201266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.201315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.201324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.201481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.201550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.201613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.201683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.201727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.201735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.201808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.201876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.201944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.202013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.202061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.202069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.202142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.202207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.202277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.202339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.202389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.202392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.202461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.202530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.202601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.202674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.202724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.202731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.202803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.202862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.202938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.203012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.203067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.203074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.203149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.203212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.203275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.203338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.203384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.203390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.203452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.203509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.203566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.203637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.203681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.203686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.203748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.203812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.203879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.203953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.204001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.204008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.204073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460483:9869], now have 1 active actors on pipe
2025-10-10T14:35:15.204309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:15.204327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601639706460483:9869]
2025-10-10T14:35:15.204357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:15.204361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:15.204391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1611 reason: error at write: Disconnected sessionId: src_id|9e21ec9d-77ac349f-71571a20-51066b82_0
2025-10-10T14:35:15.204632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1611 sessionId: src_id|9e21ec9d-77ac349f-71571a20-51066b82_0 is DEAD
2025-10-10T14:35:15.204853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21ec9d-77ac349f-71571a20-51066b82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:15.204865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21ec9d-77ac349f-71571a20-51066b82_0] Write session will restart in 0.006375s
2025-10-10T14:35:15.204894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21ec9d-77ac349f-71571a20-51066b82_0] Write session: Do CDS request
2025-10-10T14:35:15.204900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21ec9d-77ac349f-71571a20-51066b82_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:15.204638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:15.212970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21ec9d-77ac349f-71571a20-51066b82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.213049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:15.213066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1612
2025-10-10T14:35:15.213243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.213293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:15.213304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:15.213309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:15.213772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1612 sessionId:  describe result for acl check
2025-10-10T14:35:15.213822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:15.213831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:15.213833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:15.213840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601639706460504:9928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:15.214428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601639706460504:9928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:15.217502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601639706460504:9928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:15.221491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601639706460504:9928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:15.221513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601639706460504:9928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:15.221517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601639706460504:9928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:15.221527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:15.226255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:15.228754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:15.229007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:15.229018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:15.229029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:15.229086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:15.229140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601638924235919:9309]
2025-10-10T14:35:15.229768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:15.230263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:15.230326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:15.230738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:15.230818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.230819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.230821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.230822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.230823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.230825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.230826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.230827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.230842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.230843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.230845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.230846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.230847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.230855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.230870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.230875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.230879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.230883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.230887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.230891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.230905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.230909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.230914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.230918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.230923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.230927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.230936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.230947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.230953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.230959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.230966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.230972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.230977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.230983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.230988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.230993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.230999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.231005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.231014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.231019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.231023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.231027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.231031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.231038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.231042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.231047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.231051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.231055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.231060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.231065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.231069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.231074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.231114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:15.240388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:15.240873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:15.240886Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:15.240889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:15.240893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:15.240901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1611 [2:7559601638924235919:9309]
2025-10-10T14:35:15.240917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:15.240937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:15.240945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.240949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.240952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.240974Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:15.240988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:15.240996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:15.241068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.241076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.241079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.241082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:15.241157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:15.241167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.241179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.241190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.241206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:15.241230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460592:9928], now have 1 active actors on pipe
2025-10-10T14:35:15.241238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460489:2438], now have 1 active actors on pipe
2025-10-10T14:35:15.241247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601638924235914:9309]
2025-10-10T14:35:15.241254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601638924235914:9309]
2025-10-10T14:35:15.241256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601638924235914:9309]
2025-10-10T14:35:15.241272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:15.241291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:15.241296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:15.241301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:15.241304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:15.241311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:15.241315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:15.241376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601638924235914:9309]
2025-10-10T14:35:15.241393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:15.241395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:15.241371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1611
2025-10-10T14:35:15.241432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.241445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.241478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:15.241491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.241501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.241504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:15.241517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.241532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1611
2025-10-10T14:35:15.241536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:15.241560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.241769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.241778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.241795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.241880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1612 partition: 0 MaxSeqNo: 40 sessionId: src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0
2025-10-10T14:35:15.242336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21ec9d-77ac349f-71571a20-51066b82_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:15.245146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0] Write session: try to update token
2025-10-10T14:35:15.245167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:15.256265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:15.256293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.256308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601638924235914:9309]
2025-10-10T14:35:15.256357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:15.256364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:15.256558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:15.256712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.256856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.256995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.257203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:15.257244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:15.268397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId: src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:15.271045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:15.271308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.271335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.271378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:15.271480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:15.277128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:15.277153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.277157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:15.277160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:15.277172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601638924235914:9309]
2025-10-10T14:35:15.277177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601638924235914:9309]
2025-10-10T14:35:15.277181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601638924235914:9309]
2025-10-10T14:35:15.277240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:15.277240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:15.277248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:15.277252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:15.277255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.277258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:15.277439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:15.304653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601639706460688:9869]
2025-10-10T14:35:15.304990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1611, pipe: [1:7559601639706460688:9869]
2025-10-10T14:35:15.389731Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:15.397204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.397238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.397433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.400592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601639706460688:9869]
2025-10-10T14:35:15.400644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:15.400647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:15.400680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1612 reason: error at write: Disconnected sessionId: src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0
2025-10-10T14:35:15.400883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1612 sessionId: src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0 is DEAD
2025-10-10T14:35:15.401060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:15.397492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.397553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.397609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.397653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.397657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.397719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.397777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.397832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.397890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.397927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.397929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.397992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.398045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.398105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.398176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.398225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.398228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.398300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.398354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.398413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.398481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.398522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.398524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.398588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.398663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.398725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.398782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.398820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.398822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.398888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.398942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.398998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.399055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.399093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.399095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.399156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.399209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.399265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.399325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.399362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.399364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.399426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.399479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.399539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.399605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.399646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.399650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.399715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.399769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.399822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.399877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.399914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.399916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.399974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.400029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.400085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.400140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.400177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.400179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.400253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460688:9869], now have 1 active actors on pipe
2025-10-10T14:35:15.401670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:15.405211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:15.405226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0] Write session will restart in 0.006859s
2025-10-10T14:35:15.405246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0] Write session: Do CDS request
2025-10-10T14:35:15.405252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:15.413903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.416576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:15.416594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1613
2025-10-10T14:35:15.416773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.416841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:15.416848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:15.416852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:15.418072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1613 sessionId:  describe result for acl check
2025-10-10T14:35:15.418111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:15.418113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:15.418114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:15.418121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601639706460726:9932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:15.418688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601639706460726:9932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:15.422501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601639706460726:9932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:15.426521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601639706460726:9932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:15.426537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601639706460726:9932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:15.426541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601639706460726:9932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:15.426550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:15.428291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:15.431143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:15.431416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:15.431434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:15.431448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:15.431512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:15.431565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601638924236116:9311]
2025-10-10T14:35:15.432203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:15.432871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:15.432942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:15.433292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:15.433411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.433413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.433414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.433415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.433417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.433419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.433420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.433421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.433423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.433424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.433426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.433469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.433471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.433479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.433493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.433497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.433501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.433505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.433510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.433517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.433521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.433527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.433532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.433535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.433540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.433543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.433553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.433572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.433580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.433585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.433591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.433596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.433601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.433606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.433613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.433618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.433623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.433636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.433641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.433646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.433651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.433657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.433664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.433675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.433680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.433691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.433696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.433704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.433713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.433718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.433724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.433733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.433780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:15.436446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:15.437346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1612
2025-10-10T14:35:15.436895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:15.436901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:15.436903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:15.436907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:15.436913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1612 [2:7559601638924236116:9311]
2025-10-10T14:35:15.436928Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:15.436948Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:15.436952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.436955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.436958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.436977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:15.436985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:15.436994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:15.437061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.437063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.437066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.437068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:15.437142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:15.437146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.437159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.437170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.437186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:15.437209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601638924236111:9311]
2025-10-10T14:35:15.437212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601638924236111:9311]
2025-10-10T14:35:15.437213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601638924236111:9311]
2025-10-10T14:35:15.437223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:15.437241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460690:2438], now have 1 active actors on pipe
2025-10-10T14:35:15.437248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:15.437265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:15.437269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:15.437285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:15.437288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:15.437291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:15.437298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601638924236111:9311]
2025-10-10T14:35:15.437301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:15.437321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:15.437322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460876:9932], now have 1 active actors on pipe
2025-10-10T14:35:15.437904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1612
2025-10-10T14:35:15.438321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.438344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.438391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:15.438408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.438418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.438421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:15.438435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.438468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:15.438491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.440363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.440382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.440432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.440613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1613 partition: 0 MaxSeqNo: 40 sessionId: src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0
2025-10-10T14:35:15.441063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c38fb-8dcbb9bb-be9558ea-1bf198cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:15.444034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0] Write session: try to update token
2025-10-10T14:35:15.444056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:15.463017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:15.463039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.463043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:15.463045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:15.463056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601638924236111:9311]
2025-10-10T14:35:15.463060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601638924236111:9311]
2025-10-10T14:35:15.463064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601638924236111:9311]
2025-10-10T14:35:15.463112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:15.463119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.463121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:15.463125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:15.463133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:15.463138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:15.463254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:15.468142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId: src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:15.470661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:15.500750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601639706460891:9869]
2025-10-10T14:35:15.501106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1612, pipe: [1:7559601639706460891:9869]
2025-10-10T14:35:15.579383Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:15.579719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.579742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.579796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460891:9869], now have 1 active actors on pipe
2025-10-10T14:35:15.580180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601639706460891:9869]
2025-10-10T14:35:15.580224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:15.580226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:15.580290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1613 reason: error at write: Disconnected sessionId: src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0
2025-10-10T14:35:15.580444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:15.580512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1613 sessionId: src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0 is DEAD
2025-10-10T14:35:15.580653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:15.580670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0] Write session will restart in 0.009507s
2025-10-10T14:35:15.580694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0] Write session: Do CDS request
2025-10-10T14:35:15.580700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:15.580121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:15.591893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.595969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:15.595986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1614
2025-10-10T14:35:15.596216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.596262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:15.596272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:15.596276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:15.597066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1614 sessionId:  describe result for acl check
2025-10-10T14:35:15.597108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:15.597117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:15.597119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:15.597130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601639706460952:9936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:15.597689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601639706460952:9936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:15.601660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601639706460952:9936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:15.604474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601639706460952:9936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:15.604487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601639706460952:9936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:15.604491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601639706460952:9936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:15.604500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:15.606006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:15.608349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:15.608559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:15.608571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:15.608583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:15.608637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:15.608680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601638924236314:9313]
2025-10-10T14:35:15.609299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:15.609654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:15.609705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:15.610055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:15.610115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.610121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.610122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.610123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.610124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.610125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.610126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.610127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.610128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.610130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.610131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.610132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.610133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.610138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.610151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.610155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.610159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.610163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.610166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.610170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.610173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.610177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.610181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.610185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.610188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.610192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.610200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.610209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.610215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.610221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.610230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.610237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.610241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.610252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.610256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.610269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.610279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.610285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.610295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.610300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.610305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.610310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.610315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.610321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.610331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.610336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.610341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.610346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.610350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.610356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.610361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.610368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.610415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:15.612861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:15.613217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:15.613235Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:15.613238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:15.613242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:15.613248Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1613 [2:7559601638924236314:9313]
2025-10-10T14:35:15.613262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:15.613281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:15.613290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.613294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.613297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.613314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:15.613323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:15.613351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:15.613419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.613428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.613430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.613433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:15.613502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:15.613514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.613528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.613541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.613560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:15.613596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706461080:9936], now have 1 active actors on pipe
2025-10-10T14:35:15.613607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706460892:2438], now have 1 active actors on pipe
2025-10-10T14:35:15.613614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601638924236309:9313]
2025-10-10T14:35:15.613617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601638924236309:9313]
2025-10-10T14:35:15.613620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601638924236309:9313]
2025-10-10T14:35:15.613635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:15.613654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:15.613656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:15.613658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:15.613661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:15.613673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:15.613682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:15.613658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1613
2025-10-10T14:35:15.613670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1613
2025-10-10T14:35:15.613709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601638924236309:9313]
2025-10-10T14:35:15.613722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:15.613736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:15.613744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.613749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.613804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:15.613817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.613822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.613825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:15.613838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.613855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:15.613880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.614036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.614045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.614062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.614145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1614 partition: 0 MaxSeqNo: 40 sessionId: src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0
2025-10-10T14:35:15.614567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a053903a-ff09e3ad-baddac43-cc7c8da4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:15.617283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0] Write session: try to update token
2025-10-10T14:35:15.617300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:15.632613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId: src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:15.635021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:15.635043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.635046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:15.635048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:15.635059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601638924236309:9313]
2025-10-10T14:35:15.635063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601638924236309:9313]
2025-10-10T14:35:15.635067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601638924236309:9313]
2025-10-10T14:35:15.635114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:15.635118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:15.635125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.635127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:15.635129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:15.635143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:15.635269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:15.635434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:15.680429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601639706461114:9869]
2025-10-10T14:35:15.680635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1613, pipe: [1:7559601639706461114:9869]
2025-10-10T14:35:15.747856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:15.748178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.748201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.748248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706461114:9869], now have 1 active actors on pipe
2025-10-10T14:35:15.748455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:15.748505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:15.748520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:15.748589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1614 reason: error at write: Disconnected sessionId: src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0
2025-10-10T14:35:15.748847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1614 sessionId: src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0 is DEAD
2025-10-10T14:35:15.748992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:15.749001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0] Write session will restart in 0.007080s
2025-10-10T14:35:15.749029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0] Write session: Do CDS request
2025-10-10T14:35:15.749035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:15.749042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:15.749088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601639706461114:9869]
2025-10-10T14:35:15.756907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.758282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:15.758299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1615
2025-10-10T14:35:15.758684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.758723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:15.758728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:15.758732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:15.759146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1615 sessionId:  describe result for acl check
2025-10-10T14:35:15.759178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:15.759184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:15.759186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:15.759192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601639706461164:9948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:15.759776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601639706461164:9948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:15.762265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601639706461164:9948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:15.765269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601639706461164:9948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:15.765285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601639706461164:9948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:15.765289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601639706461164:9948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:15.765297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:15.766551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:15.769041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:15.769285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:15.769297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:15.769310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:15.769377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:15.769421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601638924236558:9327]
2025-10-10T14:35:15.769990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:15.770285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:15.770335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:15.770658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:15.770722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.770728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.770729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.770731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.770732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.770734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.770735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.770736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.770738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.770739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.770740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.770742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.770743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.770749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.770762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.770766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.770770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.770773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.770776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.770780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.770783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.770786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.770791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.770794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.770798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.770802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.770810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.770818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.770824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.770829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.770833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.770838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.770842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.770847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.770851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.770856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.770860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.770865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.770869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.770874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.770878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.770883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.770887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.770898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.770902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.770907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.770934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.770945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.770950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.770960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.770964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.770968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.771004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:15.774028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:15.774519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:15.774536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:15.774538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:15.774542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:15.774547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1614 [2:7559601638924236558:9327]
2025-10-10T14:35:15.774560Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:15.774577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:15.774580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.774583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.774597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.774619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:15.774630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:15.774642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:15.774713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.774721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.774723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.774725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:15.774789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:15.774797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.774806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.774818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.774831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:15.774853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706461318:9948], now have 1 active actors on pipe
2025-10-10T14:35:15.774856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706461131:2438], now have 1 active actors on pipe
2025-10-10T14:35:15.774863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601638924236551:9327]
2025-10-10T14:35:15.774865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601638924236551:9327]
2025-10-10T14:35:15.774867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601638924236551:9327]
2025-10-10T14:35:15.774881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:15.774894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:15.774905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:15.774914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:15.774916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:15.774917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:15.774918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:15.774945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601638924236551:9327]
2025-10-10T14:35:15.774957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:15.774949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1614
2025-10-10T14:35:15.774980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1614
2025-10-10T14:35:15.774994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:15.775131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.775147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.775186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:15.775195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.775199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.775201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:15.775214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.775227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:15.775243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.775430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.775442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.775481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.775895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1615 partition: 0 MaxSeqNo: 40 sessionId: src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0
2025-10-10T14:35:15.776311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036da63-6a160b2e-b83c7da1-56b445f5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:15.779106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0] Write session: try to update token
2025-10-10T14:35:15.779125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:15.787759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:15.787779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.787790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601638924236551:9327]
2025-10-10T14:35:15.787829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:15.787840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:15.788013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:15.788159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.788300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.788455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:15.788690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:15.788737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:15.799287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId: src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:15.802178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:15.802514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.802558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.802638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:15.802727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:15.807379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:15.807404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.807408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:15.807410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:15.807421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601638924236551:9327]
2025-10-10T14:35:15.807424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601638924236551:9327]
2025-10-10T14:35:15.807428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601638924236551:9327]
2025-10-10T14:35:15.807479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:15.807493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.807497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:15.807500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:15.807504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:15.807510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:15.807649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:15.848916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601639706461345:9869]
2025-10-10T14:35:15.853603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1614, pipe: [1:7559601639706461345:9869]
2025-10-10T14:35:15.923202Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:15.931857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.931915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.932161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.932258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.932406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.932488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.932551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.932567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.932713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.932820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.932913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.932996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.933061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.933066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.933183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.933259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.933498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.933604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.933662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.933676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.933762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.933894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.933978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.934103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.934183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.934204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.934308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.934390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.934480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.934626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.934692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.934703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.934805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.934938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.935051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.935142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.935202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.935216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.935340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.935431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.935530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.935661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.935731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.935735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.935824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.935899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.935988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.936115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.936167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.936171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.936281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.936407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.936507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.936591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.936642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.936647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.936748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:15.936870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:15.936937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:15.937065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:15.937136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:15.937141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:15.937242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706461345:9869], now have 1 active actors on pipe
2025-10-10T14:35:15.938043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601639706461345:9869]
2025-10-10T14:35:15.938091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:15.938094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:15.938125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1615 reason: error at write: Disconnected sessionId: src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0
2025-10-10T14:35:15.938408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1615 sessionId: src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0 is DEAD
2025-10-10T14:35:15.938669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:15.938777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:15.941597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:15.941611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0] Write session will restart in 0.007248s
2025-10-10T14:35:15.941639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0] Write session: Do CDS request
2025-10-10T14:35:15.941646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:15.952240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.952359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:15.952375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1616
2025-10-10T14:35:15.952553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:15.952591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:15.952604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:15.952608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:15.953127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1616 sessionId:  describe result for acl check
2025-10-10T14:35:15.953170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:15.953177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:15.953179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:15.953185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601639706461439:9955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:15.953781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601639706461439:9955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:15.956973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601639706461439:9955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:15.957882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:15.960924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:15.961261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601639706461439:9955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:15.961277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601639706461439:9955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:15.961280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601639706461439:9955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:15.961272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:15.961290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:15.961286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:15.961298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:15.961374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:15.961422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601638924236764:9332]
2025-10-10T14:35:15.962029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:15.962351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:15.962412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:15.962742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:15.962814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.962821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.962823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.962824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.962826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.962827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.962828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.962830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.962831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.962832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.962834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.962835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.962836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.962844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.962857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.962861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.962865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.962869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.962872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.962875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.962879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.962882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.962887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.962891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.962895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.962899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.962908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.962916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:15.962922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.962926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:15.962930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.962935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:15.962940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.962945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:15.962949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.962954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:15.962958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.962963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:15.962967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.962972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:15.962976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.962980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:15.962984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.962989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:15.962993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.962997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:15.963001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.963006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.963010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.963014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.963017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.963022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.963058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:15.965475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:15.965813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:15.965827Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:15.965829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:15.965833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:15.965841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1615 [2:7559601638924236764:9332]
2025-10-10T14:35:15.965853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:15.965875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:15.965884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.965887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.965890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.965907Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:15.965914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:15.965923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:15.965984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.965991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.965993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.965996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:15.966075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:15.966083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.966093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:15.966103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:15.966117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:15.966147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706461349:2438], now have 1 active actors on pipe
2025-10-10T14:35:15.966155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601639706461538:9955], now have 1 active actors on pipe
2025-10-10T14:35:15.966162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601638924236758:9332]
2025-10-10T14:35:15.966171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601638924236758:9332]
2025-10-10T14:35:15.966173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601638924236758:9332]
2025-10-10T14:35:15.966188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:15.966201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:15.966205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:15.966209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:15.966211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:15.966220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:15.966223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:15.966234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1615
2025-10-10T14:35:15.966250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601638924236758:9332]
2025-10-10T14:35:15.966259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:15.966272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:15.966290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.966300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.966299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1615
2025-10-10T14:35:15.966336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:15.966349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:15.966353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:15.966356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:15.966367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:15.966382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:15.966400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.966544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:15.966553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:15.966569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:15.966742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1616 partition: 0 MaxSeqNo: 40 sessionId: src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0
2025-10-10T14:35:15.967155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c2fd0-b8effafc-916bcc24-7d72ad31_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:15.969913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0] Write session: try to update token
2025-10-10T14:35:15.969933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:15.984181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId: src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:15.985945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:15.985966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:15.985970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:15.985972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:15.985983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601638924236758:9332]
2025-10-10T14:35:15.985987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601638924236758:9332]
2025-10-10T14:35:15.985991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601638924236758:9332]
2025-10-10T14:35:15.986041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:15.986045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:15.986049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:15.986052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:15.986053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:15.986057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:15.986188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:15.987060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:16.038359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601644001428846:9869]
2025-10-10T14:35:16.038688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1615, pipe: [1:7559601644001428846:9869]
2025-10-10T14:35:16.097127Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:16.097632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.097649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.097696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001428846:9869], now have 1 active actors on pipe
2025-10-10T14:35:16.097911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:16.097952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:16.097958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601644001428846:9869]
2025-10-10T14:35:16.097983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:16.098075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1616 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0
2025-10-10T14:35:16.098301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1616 sessionId: src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0 is DEAD
2025-10-10T14:35:16.098438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:16.098449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0] Write session will restart in 0.009299s
2025-10-10T14:35:16.098472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0] Write session: Do CDS request
2025-10-10T14:35:16.098478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:16.108942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.108995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:16.109010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1617
2025-10-10T14:35:16.109172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.109218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:16.109225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:16.109230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:16.109762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1617 sessionId:  describe result for acl check
2025-10-10T14:35:16.109804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:16.109813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:16.109815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:16.109822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601644001428909:9959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:16.110374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601644001428909:9959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:16.114645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601644001428909:9959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:16.116602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:16.119533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:16.119723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601644001428909:9959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:16.119745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601644001428909:9959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:16.119749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601644001428909:9959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:16.119759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:16.119819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:16.119831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:16.119844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:16.119900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:16.119946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601643219204261:9334]
2025-10-10T14:35:16.120564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:16.120936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:16.121005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:16.121373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:16.121435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.121443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.121444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.121446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.121447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.121448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.121450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.121451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.121453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.121455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.121456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.121457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.121458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.121464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.121477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.121481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.121486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.121489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.121493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.121497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.121502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.121506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.121509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.121513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.121517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.121520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.121528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.121536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.121544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.121550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.121555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.121559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.121564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.121569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.121575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.121580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.121584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.121588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.121593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.121598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.121602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.121609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.121614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.121619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.121623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.121628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.121633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.121638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.121643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.121648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.121655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.121665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.121706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:16.124306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:16.124650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:16.124662Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:16.124664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:16.124669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:16.124675Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1616 [2:7559601643219204261:9334]
2025-10-10T14:35:16.124695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:16.124717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:16.124725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.124729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.124732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.124751Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:16.124762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:16.124774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:16.124851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.124859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.124861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.124864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:16.124935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:16.124942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.124954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.124970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.124991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:16.125019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429040:9959], now have 1 active actors on pipe
2025-10-10T14:35:16.125027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001428847:2438], now have 1 active actors on pipe
2025-10-10T14:35:16.125034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601643219204256:9334]
2025-10-10T14:35:16.125037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601643219204256:9334]
2025-10-10T14:35:16.125039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601643219204256:9334]
2025-10-10T14:35:16.125051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:16.125056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1616
2025-10-10T14:35:16.125057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1616
2025-10-10T14:35:16.125068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:16.125068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:16.125072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:16.125075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:16.125090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:16.125094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:16.125137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.125146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.125165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601643219204256:9334]
2025-10-10T14:35:16.125177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:16.125195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:16.125217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:16.125225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.125229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.125231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:16.125242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.125253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:16.125278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.125421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.125435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.125457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.125544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1617 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0
2025-10-10T14:35:16.125951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37e7f5a-6d2d3fce-7136ddda-9ae4fa3e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:16.128900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0] Write session: try to update token
2025-10-10T14:35:16.128920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:16.144528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:16.144556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:16.144559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:16.144562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:16.144574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601643219204256:9334]
2025-10-10T14:35:16.144580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601643219204256:9334]
2025-10-10T14:35:16.144584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601643219204256:9334]
2025-10-10T14:35:16.144638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:16.144640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:16.144646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:16.144650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:16.144650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.144653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:16.144791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:16.145073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId: src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:16.147646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:16.198117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601644001429052:9869]
2025-10-10T14:35:16.198498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1616, pipe: [1:7559601644001429052:9869]
2025-10-10T14:35:16.255997Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:16.256651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.256687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.256765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429052:9869], now have 1 active actors on pipe
2025-10-10T14:35:16.257038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:16.257081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601644001429052:9869]
2025-10-10T14:35:16.257113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:16.257118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:16.257119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:16.257198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1617 reason: error at write: Disconnected sessionId: src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0
2025-10-10T14:35:16.257413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1617 sessionId: src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0 is DEAD
2025-10-10T14:35:16.257611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:16.257620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0] Write session will restart in 0.007007s
2025-10-10T14:35:16.257646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0] Write session: Do CDS request
2025-10-10T14:35:16.257652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:16.269202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.269748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:16.269767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1618
2025-10-10T14:35:16.269939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.269990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:16.270001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:16.270006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:16.270493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1618 sessionId:  describe result for acl check
2025-10-10T14:35:16.270530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:16.270532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:16.270534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:16.270541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601644001429134:9963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:16.271136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601644001429134:9963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:16.273878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601644001429134:9963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:16.277410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601644001429134:9963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:16.277426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601644001429134:9963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:16.277430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601644001429134:9963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:16.277439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:16.278146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:16.280711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:16.280954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:16.280976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:16.280989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:16.281054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:16.281097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601643219204464:9336]
2025-10-10T14:35:16.281703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:16.282126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:16.282185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:16.282527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:16.282610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.282617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.282618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.282619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.282621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.282622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.282623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.282625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.282626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.282628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.282629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.282630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.282632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.282639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.282653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.282658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.282663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.282668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.282672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.282676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.282681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.282685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.282691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.282696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.282701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.282705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.282713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.282727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.282739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.282750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.282755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.282765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.282770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.282777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.282783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.282788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.282794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.282799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.282811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.282817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.282822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.282828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.282846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.282852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.282857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.282863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.282868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.282880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.282885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.282891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.282895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.282905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.282948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:16.291023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1617
2025-10-10T14:35:16.291037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1617
2025-10-10T14:35:16.291444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1618 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0
2025-10-10T14:35:16.291884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3442be6-65090855-baf8d4bb-9c2ee32b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:16.290199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:16.290555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:16.290560Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:16.290563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:16.290567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:16.290586Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1617 [2:7559601643219204464:9336]
2025-10-10T14:35:16.290601Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:16.290634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:16.290638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.290642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.290645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.290666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:16.290675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:16.290684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:16.290753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.290755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.290757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.290760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:16.290835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:16.290838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.290860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.290871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.290887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:16.290909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429245:9963], now have 1 active actors on pipe
2025-10-10T14:35:16.290913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429053:2438], now have 1 active actors on pipe
2025-10-10T14:35:16.290921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601643219204459:9336]
2025-10-10T14:35:16.290923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601643219204459:9336]
2025-10-10T14:35:16.290926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601643219204459:9336]
2025-10-10T14:35:16.290941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:16.290955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:16.290958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:16.290959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:16.290962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:16.290975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:16.290980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:16.291023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601643219204459:9336]
2025-10-10T14:35:16.291030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:16.291054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:16.291090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.291096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.291133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:16.291141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.291145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.291148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:16.291160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.291172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:16.291187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.291315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.291319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.291334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.294599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0] Write session: try to update token
2025-10-10T14:35:16.294619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:16.303362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:16.303380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:16.303388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601643219204459:9336]
2025-10-10T14:35:16.303425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:16.303432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:16.303587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:16.303711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:16.303839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:16.303972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:16.304222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:16.304258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:16.313295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId: src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:16.316001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:16.316372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.316398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.316443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:16.316559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:16.323516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:16.323544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:16.323549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:16.323551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:16.323564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601643219204459:9336]
2025-10-10T14:35:16.323569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601643219204459:9336]
2025-10-10T14:35:16.323573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601643219204459:9336]
2025-10-10T14:35:16.323631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:16.323648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.323655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:16.323838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:16.325067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:16.325088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:16.325093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:16.357380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601644001429262:9869]
2025-10-10T14:35:16.357728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1617, pipe: [1:7559601644001429262:9869]
2025-10-10T14:35:16.440045Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:16.448491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.448521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.448715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.448784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.448858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.448927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.448980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.448990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.449059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.449126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.449194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.449266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.449312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.449321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.449413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.449479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.449546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.452158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:16.452228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601644001429262:9869]
2025-10-10T14:35:16.452268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:16.452275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:16.452312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1618 reason: error at write: Disconnected sessionId: src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0
2025-10-10T14:35:16.452538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1618 sessionId: src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0 is DEAD
2025-10-10T14:35:16.452707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:16.452716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0] Write session will restart in 0.006823s
2025-10-10T14:35:16.452741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0] Write session: Do CDS request
2025-10-10T14:35:16.452748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:16.449612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.449662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.449664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.449734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.449796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.449858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.449920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.449961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.449964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.450035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.450096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.450154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.450213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.450258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.450261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.450326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.450381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.450439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.450500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.450544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.450547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.450624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.450679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.450738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.450798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.450839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.450842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.450910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.450966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.451023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.451083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.451122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.451125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.451192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.451248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.451307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.451365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.451404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.451408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.451476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.451532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.451590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.451650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.451712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.451715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.451795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429262:9869], now have 1 active actors on pipe
2025-10-10T14:35:16.452939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:16.460981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.461057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:16.461073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1619
2025-10-10T14:35:16.461233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.461272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:16.461283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:16.461287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:16.461754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1619 sessionId:  describe result for acl check
2025-10-10T14:35:16.461799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:16.461806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:16.461808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:16.461815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601644001429291:9969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:16.462428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601644001429291:9969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:16.465827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601644001429291:9969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:16.468698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601644001429291:9969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:16.468712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601644001429291:9969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:16.468716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601644001429291:9969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:16.468726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:16.468735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:16.471132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:16.471354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:16.471366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:16.471379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:16.471448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:16.471519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601643219204667:9338]
2025-10-10T14:35:16.472128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:16.472468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:16.472516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:16.472858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:16.472931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.472938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.472939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.472940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.472941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.472943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.472944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.472945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.472947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.472948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.472949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.472951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.472952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.472957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.472972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.472976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.472980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.472984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.472988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.472992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.472995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.472999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.473004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.473007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.473011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.473014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.473022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.473031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.473039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.473045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.473049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.473055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.473059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.473065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.473069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.473074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.473078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.473082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.473087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.473098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.473103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.473113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.473119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.473130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.473134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.473138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.473147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.473153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.473162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.473167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.473172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.473177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.473216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:16.475820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:16.476158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:16.476172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:16.476175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:16.476179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:16.476186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1618 [2:7559601643219204667:9338]
2025-10-10T14:35:16.476198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:16.476218Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:16.476228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.476232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.476235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.476253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:16.476265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:16.476273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:16.476334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.476342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.476344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.476347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:16.476415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:16.476425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.476436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.476446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.476460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:16.476482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601643219204661:9338]
2025-10-10T14:35:16.476485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601643219204661:9338]
2025-10-10T14:35:16.476487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601643219204661:9338]
2025-10-10T14:35:16.476496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:16.476512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:16.476516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:16.476518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:16.476522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:16.476534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:16.476551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:16.476563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429459:9969], now have 1 active actors on pipe
2025-10-10T14:35:16.476566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429264:2438], now have 1 active actors on pipe
2025-10-10T14:35:16.476591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601643219204661:9338]
2025-10-10T14:35:16.476588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1618
2025-10-10T14:35:16.476605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:16.476601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1618
2025-10-10T14:35:16.476683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:16.476753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.476770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.476806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:16.476821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.476846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.476853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:16.476866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.476879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:16.476905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.477132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.477145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.477168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.477284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1619 partition: 0 MaxSeqNo: 40 sessionId: src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0
2025-10-10T14:35:16.477693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d77f01f-b2cebc77-df6ee3b6-b894ca80_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:16.480457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0] Write session: try to update token
2025-10-10T14:35:16.480475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:16.495333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId: src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:16.497495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:16.497519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:16.497522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:16.497524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:16.497534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601643219204661:9338]
2025-10-10T14:35:16.497539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601643219204661:9338]
2025-10-10T14:35:16.497543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601643219204661:9338]
2025-10-10T14:35:16.497596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:16.497606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:16.497611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.497613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:16.497614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:16.497617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:16.497757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:16.498123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:16.552414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601644001429471:9869]
2025-10-10T14:35:16.552678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1618, pipe: [1:7559601644001429471:9869]
2025-10-10T14:35:16.613242Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:16.613702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.613720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.613769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429471:9869], now have 1 active actors on pipe
2025-10-10T14:35:16.614048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601644001429471:9869]
2025-10-10T14:35:16.614110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:16.614120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:16.614197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1619 reason: error at write: Disconnected sessionId: src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0
2025-10-10T14:35:16.614342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:16.614438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1619 sessionId: src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0 is DEAD
2025-10-10T14:35:16.614236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:16.614592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:16.614601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0] Write session will restart in 0.008429s
2025-10-10T14:35:16.614627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0] Write session: Do CDS request
2025-10-10T14:35:16.614638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:16.623867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.623990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:16.624004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1620
2025-10-10T14:35:16.624177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.624213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:16.624227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:16.624231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:16.624680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1620 sessionId:  describe result for acl check
2025-10-10T14:35:16.624721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:16.624728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:16.624730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:16.624737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601644001429517:9973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:16.625362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601644001429517:9973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:16.629852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601644001429517:9973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:16.632319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601644001429517:9973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:16.632339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601644001429517:9973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:16.632342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601644001429517:9973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:16.632351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:16.632354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:16.634546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:16.634793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:16.634804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:16.634817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:16.634882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:16.634932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601643219204871:9340]
2025-10-10T14:35:16.635542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:16.635854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:16.635898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:16.636257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:16.636337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.636347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.636348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.636349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.636350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.636351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.636352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.636353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.636353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.636355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.636356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.636356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.636358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.636363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.636377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.636381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.636385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.636389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.636393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.636396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.636399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.636402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.636406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.636408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.636412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.636415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.636423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.636432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.636439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.636445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.636450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.636455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.636460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.636477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.636482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.636487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.636491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.636498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.636508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.636513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.636517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.636521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.636525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.636530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.636536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.636540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.636545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.636551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.636555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.636560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.636565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.636570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.636609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:16.639052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:16.639386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:16.639397Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:16.639399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:16.639403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:16.639410Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1619 [2:7559601643219204871:9340]
2025-10-10T14:35:16.639422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:16.639440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:16.639447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.639451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.639454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.639471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:16.639482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:16.639495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:16.639556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.639563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.639565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.639567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:16.639631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:16.639638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.639649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.639663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.639679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:16.639716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429472:2438], now have 1 active actors on pipe
2025-10-10T14:35:16.639723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429668:9973], now have 1 active actors on pipe
2025-10-10T14:35:16.639731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601643219204865:9340]
2025-10-10T14:35:16.639734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601643219204865:9340]
2025-10-10T14:35:16.639736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601643219204865:9340]
2025-10-10T14:35:16.639750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:16.639768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:16.639772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:16.639775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:16.639777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:16.639790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:16.639799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:16.639785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1619
2025-10-10T14:35:16.639796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1619
2025-10-10T14:35:16.639835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601643219204865:9340]
2025-10-10T14:35:16.639846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:16.639852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:16.639863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.639869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.639913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63926b09-3aaec880-291df47b-35547733_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:16.639926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.639932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.639935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:16.639947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.639961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:16.639978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.640115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.640122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.640138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.640214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1620 partition: 0 MaxSeqNo: 40 sessionId: src_id|63926b09-3aaec880-291df47b-35547733_0
2025-10-10T14:35:16.640608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33ab666-49ccaacb-183f67aa-49de76dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63926b09-3aaec880-291df47b-35547733_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:16.643362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63926b09-3aaec880-291df47b-35547733_0] Write session: try to update token
2025-10-10T14:35:16.643382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63926b09-3aaec880-291df47b-35547733_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:16.658081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId: src_id|63926b09-3aaec880-291df47b-35547733_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:16.660796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:16.661047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.661067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.661110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:16.661224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:16.665982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:16.665999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:16.666002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:16.666004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:16.666016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601643219204865:9340]
2025-10-10T14:35:16.666020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601643219204865:9340]
2025-10-10T14:35:16.666026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601643219204865:9340]
2025-10-10T14:35:16.666077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:16.666084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.666085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:16.666087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:16.666093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:16.666097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:16.666220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:16.714196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601644001429702:9869]
2025-10-10T14:35:16.717590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1619, pipe: [1:7559601644001429702:9869]
2025-10-10T14:35:16.783005Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:16.791376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.791398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.791559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.791622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.791685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.791751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.791796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.791805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.791871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.791931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.791994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.792063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.792106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.792114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.792209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.792269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.792335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.792403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.792444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.792453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.792521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.792586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.792658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.792724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.792770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.792780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.792847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.792911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.792977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.793042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.793085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.793096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.793164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.793223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.793287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.793365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.793409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.793417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.793478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.793540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.793603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.793669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.793712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.793721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.793784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.793844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.793905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.793969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.794012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.794019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.794085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.794148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.794209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.794275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.794314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.794321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.794385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:16.794452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:16.794514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:16.794590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:16.794633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:16.794642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:16.794705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429702:9869], now have 1 active actors on pipe
2025-10-10T14:35:16.794917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601644001429702:9869]
2025-10-10T14:35:16.794949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:16.795013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:16.795025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:16.795053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1620 reason: error at write: Disconnected sessionId: src_id|63926b09-3aaec880-291df47b-35547733_0
2025-10-10T14:35:16.795272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1620 sessionId: src_id|63926b09-3aaec880-291df47b-35547733_0 is DEAD
2025-10-10T14:35:16.795425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63926b09-3aaec880-291df47b-35547733_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:16.795436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63926b09-3aaec880-291df47b-35547733_0] Write session will restart in 0.008466s
2025-10-10T14:35:16.795463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63926b09-3aaec880-291df47b-35547733_0] Write session: Do CDS request
2025-10-10T14:35:16.795469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63926b09-3aaec880-291df47b-35547733_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:16.795828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:16.804899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63926b09-3aaec880-291df47b-35547733_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.805024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:16.805051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1621
2025-10-10T14:35:16.805183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.805214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:16.805219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:16.805227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:16.806003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1621 sessionId:  describe result for acl check
2025-10-10T14:35:16.806041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:16.806048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:16.806050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:16.806056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601644001429770:9985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:16.806631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601644001429770:9985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:16.808924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601644001429770:9985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:16.812123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601644001429770:9985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:16.812138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601644001429770:9985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:16.812141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601644001429770:9985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:16.812149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:16.812428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:16.814957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:16.815201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:16.815211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:16.815224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:16.815277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:16.815320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601643219205121:9355]
2025-10-10T14:35:16.815957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:16.816224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:16.816262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:16.816576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:16.816629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.816635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.816636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.816637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.816638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.816640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.816641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.816642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.816643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.816644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.816645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.816647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.816648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.816654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.816667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.816671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.816675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.816679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.816683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.816687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.816691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.816695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.816699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.816703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.816706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.816710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.816718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.816726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.816733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.816739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.816742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.816747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.816751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.816757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.816761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.816766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.816770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.816775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.816790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.816800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.816804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.816809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.816814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.816818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.816823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.816829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.816833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.816838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.816843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.816848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.816853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.816858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.816897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:16.819276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:16.819749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:16.819759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:16.819769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:16.819773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:16.819783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1620 [2:7559601643219205121:9355]
2025-10-10T14:35:16.819796Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:16.819823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:16.819831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.819835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.819838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.819856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:16.819868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:16.819880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:16.819937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.819944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.819946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.819949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:16.820014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:16.820033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.820049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.820065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.820082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:16.820107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429716:2438], now have 1 active actors on pipe
2025-10-10T14:35:16.820118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429913:9985], now have 1 active actors on pipe
2025-10-10T14:35:16.820125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601643219205115:9355]
2025-10-10T14:35:16.820127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601643219205115:9355]
2025-10-10T14:35:16.820129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601643219205115:9355]
2025-10-10T14:35:16.820142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:16.820121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1620
2025-10-10T14:35:16.820171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1620
2025-10-10T14:35:16.820157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:16.820160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:16.820163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:16.820167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:16.820176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:16.820180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:16.820212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601643219205115:9355]
2025-10-10T14:35:16.820225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:16.820240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.820250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.820251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:16.820295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:16.820308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.820311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.820314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:16.820326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.820340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:16.820360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.820474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.820483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.820496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.820584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1621 partition: 0 MaxSeqNo: 40 sessionId: src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0
2025-10-10T14:35:16.821026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63926b09-3aaec880-291df47b-35547733_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:16.823875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0] Write session: try to update token
2025-10-10T14:35:16.823895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:16.842423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId: src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:16.845052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:16.841638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:16.841657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:16.841660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:16.841662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:16.841672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601643219205115:9355]
2025-10-10T14:35:16.841676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601643219205115:9355]
2025-10-10T14:35:16.841680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601643219205115:9355]
2025-10-10T14:35:16.841730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:16.841737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:16.841737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:16.841741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:16.841745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.841747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:16.841891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:16.895035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601644001429937:9869]
2025-10-10T14:35:16.895419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1620, pipe: [1:7559601644001429937:9869]
2025-10-10T14:35:16.960217Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:16.960509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.960521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.960568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429937:9869], now have 1 active actors on pipe
2025-10-10T14:35:16.960955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:16.960971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:16.961057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1621 reason: error at write: Disconnected sessionId: src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0
2025-10-10T14:35:16.961290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1621 sessionId: src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0 is DEAD
2025-10-10T14:35:16.961508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601644001429937:9869]
2025-10-10T14:35:16.961546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:16.961559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0] Write session will restart in 0.005525s
2025-10-10T14:35:16.961584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0] Write session: Do CDS request
2025-10-10T14:35:16.961590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:16.961983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:16.962342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:16.967965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.967971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:16.967999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1622
2025-10-10T14:35:16.968152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:16.968192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:16.968198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:16.968202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:16.968635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1622 sessionId:  describe result for acl check
2025-10-10T14:35:16.968667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:16.968675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:16.968677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:16.968683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601644001429950:9992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:16.969241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601644001429950:9992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:16.971390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601644001429950:9992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:16.974663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601644001429950:9992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:16.974678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601644001429950:9992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:16.974683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601644001429950:9992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:16.974699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:16.982240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:16.984815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:16.985052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:16.985064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:16.985077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:16.985135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:16.985182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601643219205334:9359]
2025-10-10T14:35:16.985848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:16.986182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:16.986233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:16.986591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:16.986670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.986677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.986678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.986679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.986681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.986682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.986683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.986684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.986685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.986686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.986688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.986689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.986690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.986696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.986709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.986714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.986717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.986721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.986725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.986729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.986732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.986736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.986741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.986745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.986749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.986753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.986762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.986772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:16.986779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.986786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:16.986790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.986797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:16.986806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.986812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:16.986816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.986822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:16.986826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.986832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:16.986837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.986842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:16.986846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.986851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:16.986857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.986867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:16.986871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.986877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:16.986886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.986891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.986901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.986906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.986910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.986919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.986960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:16.993731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:16.994048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:16.994061Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:16.994064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:16.994068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:16.994075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1621 [2:7559601643219205334:9359]
2025-10-10T14:35:16.994089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:16.994114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:16.994122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.994125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.994128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.994147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:16.994155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:16.994167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:16.994228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.994235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.994237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.994240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:16.994311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:16.994318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:16.994329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:16.994340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:16.994356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:16.994379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429994:9992], now have 1 active actors on pipe
2025-10-10T14:35:16.994388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601644001429942:2438], now have 1 active actors on pipe
2025-10-10T14:35:16.994396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601643219205329:9359]
2025-10-10T14:35:16.994398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601643219205329:9359]
2025-10-10T14:35:16.994401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601643219205329:9359]
2025-10-10T14:35:16.994414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:16.994429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:16.994435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:16.994439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:16.994442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:16.994445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:16.994448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:16.994484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601643219205329:9359]
2025-10-10T14:35:16.994491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:16.994497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:16.994704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.994718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.994760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:16.994773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:16.994782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:16.994785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:16.994797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:16.994814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:16.994836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.994452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1621
2025-10-10T14:35:16.994870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1621
2025-10-10T14:35:16.995109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:16.995121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:16.995146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:16.995242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1622 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0
2025-10-10T14:35:16.996338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e805b858-5f7d40d0-bc0e2295-b0d4615a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:16.999096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0] Write session: try to update token
2025-10-10T14:35:16.999115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:17.012808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:17.012826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:17.012841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601643219205329:9359]
2025-10-10T14:35:17.012884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:17.012895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:17.013061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:17.013196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:17.013346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:17.013479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:17.013675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:17.013717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:17.025675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId: src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:17.028528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.028548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.028269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:17.030411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:17.030455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:17.030462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:17.030466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:17.030468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:17.030478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601643219205329:9359]
2025-10-10T14:35:17.030483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601643219205329:9359]
2025-10-10T14:35:17.030486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601643219205329:9359]
2025-10-10T14:35:17.030513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:17.030525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:17.030527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:17.030532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:17.030534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.030536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:17.030540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:17.030685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:17.061861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601648296397444:9869]
2025-10-10T14:35:17.062130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1621, pipe: [1:7559601648296397444:9869]
2025-10-10T14:35:17.141358Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:17.149243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.149277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.149476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.149537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.149606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.149682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.149730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.149740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.149810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.149873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.149937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.150002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.150045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.150052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.150123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.150190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.150258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.150334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.150380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.150383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.150467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.150577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.150704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.150800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.150855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.150868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.150958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.151084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.151167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.151254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.151311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.151322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.151443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.151560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.151626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.151686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.151728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.151736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.151808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.151938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.152070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.152214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.152319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.152334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.152465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.152588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.152721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.152853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.152937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.152955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.153083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.153203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.153350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.153481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.153552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.153564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.153676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:17.153801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:17.153929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:17.154056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:17.154132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:17.154148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:17.154237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296397444:9869], now have 1 active actors on pipe
2025-10-10T14:35:17.154492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601648296397444:9869]
2025-10-10T14:35:17.154502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:17.154506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:17.154528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:17.154538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1622 reason: error at write: Disconnected sessionId: src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0
2025-10-10T14:35:17.154763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1622 sessionId: src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0 is DEAD
2025-10-10T14:35:17.154974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:17.154986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0] Write session will restart in 0.009476s
2025-10-10T14:35:17.155021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0] Write session: Do CDS request
2025-10-10T14:35:17.155027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:17.155538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:17.165865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.165997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:17.166013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1623
2025-10-10T14:35:17.166152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.166199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:17.166209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:17.166213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:17.166714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1623 sessionId:  describe result for acl check
2025-10-10T14:35:17.166753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:17.166755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:17.166757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:17.166763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601648296397482:9996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:17.167337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601648296397482:9996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:17.170048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601648296397482:9996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:17.173284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601648296397482:9996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:17.173298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601648296397482:9996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:17.173302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601648296397482:9996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:17.173311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:17.174504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:17.177028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:17.177400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:17.177411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:17.177427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:17.177500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:17.177550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601647514172839:9361]
2025-10-10T14:35:17.178179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:17.178573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:17.178629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:17.179001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:17.179062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.179069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.179070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.179071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.179073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.179074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.179075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.179076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.179077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.179079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.179080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.179081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.179082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.179089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.179103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.179107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.179111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.179115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.179119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.179123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.179127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.179130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.179134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.179138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.179142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.179145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.179154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.179162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.179171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.179177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.179182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.179187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.179191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.179196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.179201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.179206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.179210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.179215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.179220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.179226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.179230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.179235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.179245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.179250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.179254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.179259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.179264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.179269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.179273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.179278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.179287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.179293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.179331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:17.181754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:17.182078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:17.182093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:17.182096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:17.182100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:17.182108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1622 [2:7559601647514172839:9361]
2025-10-10T14:35:17.182121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:17.182140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:17.182144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.182147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.182150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.182168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:17.182182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:17.182189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:17.182246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.182253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.182255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.182257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:17.182331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:17.182338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.182350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.182366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.182388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:17.182415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296397447:2438], now have 1 active actors on pipe
2025-10-10T14:35:17.182419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296397643:9996], now have 1 active actors on pipe
2025-10-10T14:35:17.182426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601647514172832:9361]
2025-10-10T14:35:17.182428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601647514172832:9361]
2025-10-10T14:35:17.182430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601647514172832:9361]
2025-10-10T14:35:17.182445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:17.182440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1622
2025-10-10T14:35:17.182464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:17.182456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1622
2025-10-10T14:35:17.182486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:17.182497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:17.182503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:17.182505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:17.182505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:17.182556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.182566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.182580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601647514172832:9361]
2025-10-10T14:35:17.182593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:17.182614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:17.182631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:17.182643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.182647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.182649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:17.182661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.182676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:17.182704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.182973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.182982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.182999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.183132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1623 partition: 0 MaxSeqNo: 40 sessionId: src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0
2025-10-10T14:35:17.183604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b3da61-ad84a50e-ea68b0ff-14ac1a5b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:17.186364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0] Write session: try to update token
2025-10-10T14:35:17.186385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:17.203002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:17.203021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:17.203025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:17.203027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:17.203039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601647514172832:9361]
2025-10-10T14:35:17.203043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601647514172832:9361]
2025-10-10T14:35:17.203047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601647514172832:9361]
2025-10-10T14:35:17.203099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:17.203101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:17.203107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.203109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:17.203109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:17.203113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:17.203256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:17.208045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId: src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:17.210752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:17.254841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601648296397657:9869]
2025-10-10T14:35:17.255206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1622, pipe: [1:7559601648296397657:9869]
2025-10-10T14:35:17.319924Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:17.320509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.320525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.320549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296397657:9869], now have 1 active actors on pipe
2025-10-10T14:35:17.320761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:17.321277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:17.321288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0] Write session will restart in 0.005410s
2025-10-10T14:35:17.321343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0] Write session: Do CDS request
2025-10-10T14:35:17.321350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:17.320827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601648296397657:9869]
2025-10-10T14:35:17.320828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:17.320868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:17.320882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:17.320940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1623 reason: error at write: Disconnected sessionId: src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0
2025-10-10T14:35:17.321126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1623 sessionId: src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0 is DEAD
2025-10-10T14:35:17.327939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.328056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:17.328072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1624
2025-10-10T14:35:17.328207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.328243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:17.328254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:17.328258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:17.328822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1624 sessionId:  describe result for acl check
2025-10-10T14:35:17.328866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:17.328873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:17.328875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:17.328882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601648296397674:10000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:17.329492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601648296397674:10000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:17.333157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601648296397674:10000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:17.336860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601648296397674:10000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:17.336877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601648296397674:10000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:17.336882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601648296397674:10000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:17.336891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:17.339566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:17.340105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:17.340339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:17.340351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:17.340364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:17.340422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:17.340471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601647514173045:9363]
2025-10-10T14:35:17.341098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:17.342574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:17.342635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:17.343023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:17.343094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.343100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.343102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.343103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.343104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.343105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.343106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.343107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.343109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.343110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.343111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.343113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.343114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.343120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.343133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.343137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.343141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.343145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.343150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.343154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.343157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.343161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.343165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.343169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.343172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.343176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.343184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.343194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.343201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.343206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.343211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.343217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.343221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.343226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.343236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.343241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.343245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.343250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.343255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.343265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.343269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.343276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.343281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.343286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.343295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.343300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.343305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.343310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.343318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.343323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.343330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.343340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.343389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:17.346157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:17.346498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:17.346512Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:17.346515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:17.346520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:17.346528Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1623 [2:7559601647514173045:9363]
2025-10-10T14:35:17.346554Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:17.346574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:17.346582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.346586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.346589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.346609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:17.346617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:17.346626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:17.346695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.346703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.346705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.346709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:17.346789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:17.346797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.346812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.346845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.346868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:17.346897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296397659:2438], now have 1 active actors on pipe
2025-10-10T14:35:17.346906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296397847:10000], now have 1 active actors on pipe
2025-10-10T14:35:17.346914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601647514173039:9363]
2025-10-10T14:35:17.346922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601647514173039:9363]
2025-10-10T14:35:17.346925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601647514173039:9363]
2025-10-10T14:35:17.346939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:17.346952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:17.346958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:17.346961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:17.346964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:17.346976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:17.346980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:17.346965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1623
2025-10-10T14:35:17.346971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1623
2025-10-10T14:35:17.347016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601647514173039:9363]
2025-10-10T14:35:17.347025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:17.347026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:17.347043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.347054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.347113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:17.347126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.347130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.347134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:17.347146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.347161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:17.347186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.347331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.347344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.347371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.347505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1624 partition: 0 MaxSeqNo: 40 sessionId: src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0
2025-10-10T14:35:17.347952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f10071f-dd5643a2-cd5ed188-382cb1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:17.350819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0] Write session: try to update token
2025-10-10T14:35:17.350839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:17.367647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:17.367666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:17.367670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:17.367672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:17.367683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601647514173039:9363]
2025-10-10T14:35:17.367687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601647514173039:9363]
2025-10-10T14:35:17.367692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601647514173039:9363]
2025-10-10T14:35:17.367745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:17.367744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:17.367750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:17.367755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:17.367760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.367763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:17.367905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:17.371297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId: src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:17.374048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:17.420763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601648296397870:9869]
2025-10-10T14:35:17.421119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1623, pipe: [1:7559601648296397870:9869]
2025-10-10T14:35:17.491605Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:17.491921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.491940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.491990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296397870:9869], now have 1 active actors on pipe
2025-10-10T14:35:17.492212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:17.492400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601648296397870:9869]
2025-10-10T14:35:17.492432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:17.492467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:17.492544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1624 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0
2025-10-10T14:35:17.492745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1624 sessionId: src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0 is DEAD
2025-10-10T14:35:17.492922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:17.492934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0] Write session will restart in 0.008279s
2025-10-10T14:35:17.492959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0] Write session: Do CDS request
2025-10-10T14:35:17.492965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:17.503038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.503139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:17.503157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1625
2025-10-10T14:35:17.503294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.503331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:17.503342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:17.503347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:17.503997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1625 sessionId:  describe result for acl check
2025-10-10T14:35:17.504053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:17.504060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:17.504062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:17.504069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601648296397934:10004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:17.504685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601648296397934:10004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:17.507193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601648296397934:10004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:17.509590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:17.510125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601648296397934:10004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:17.510139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601648296397934:10004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:17.510143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601648296397934:10004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:17.510152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:17.512020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:17.512435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:17.512448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:17.512463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:17.512544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:17.512588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601647514173256:9365]
2025-10-10T14:35:17.513200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:17.513556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:17.513637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:17.514004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:17.514082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.514090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.514092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.514093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.514095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.514096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.514098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.514100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.514101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.514103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.514104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.514106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.514107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.514116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.514130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.514135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.514139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.514144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.514149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.514153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.514158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.514162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.514167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.514172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.514177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.514181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.514190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.514200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.514208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.514221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.514227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.514238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.514243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.514254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.514260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.514265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.514270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.514276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.514280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.514294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.514299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.514305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.514311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.514316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.514323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.514330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.514335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.514342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.514365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.514372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.514377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.514383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.514439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:17.516927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:17.517299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:17.517315Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:17.517318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:17.517322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:17.517348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1624 [2:7559601647514173256:9365]
2025-10-10T14:35:17.517363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:17.517391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:17.517401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.517405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.517409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.517429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:17.517437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:17.517448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:17.517517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.517524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.517527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.517530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:17.517602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:17.517613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.517625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.517638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.517656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:17.517684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398073:10004], now have 1 active actors on pipe
2025-10-10T14:35:17.517691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296397872:2438], now have 1 active actors on pipe
2025-10-10T14:35:17.517700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601647514173248:9365]
2025-10-10T14:35:17.517712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601647514173248:9365]
2025-10-10T14:35:17.517717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601647514173248:9365]
2025-10-10T14:35:17.517733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:17.517722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1624
2025-10-10T14:35:17.517750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:17.517769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:17.517770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:17.517773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:17.517774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:17.517749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1624
2025-10-10T14:35:17.517775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:17.517803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601647514173248:9365]
2025-10-10T14:35:17.517816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:17.517829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:17.517838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.517844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.517898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|713f5147-a395236e-156dbe0-b555e288_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:17.517911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.517916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.517918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:17.517934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.517951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:17.517971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.518133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.518142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.518159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.518246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1625 partition: 0 MaxSeqNo: 40 sessionId: src_id|713f5147-a395236e-156dbe0-b555e288_0
2025-10-10T14:35:17.518656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be4bd4-59b1595a-8e7053e-a8841b1e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|713f5147-a395236e-156dbe0-b555e288_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:17.521443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713f5147-a395236e-156dbe0-b555e288_0] Write session: try to update token
2025-10-10T14:35:17.521463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713f5147-a395236e-156dbe0-b555e288_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:17.536919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId: src_id|713f5147-a395236e-156dbe0-b555e288_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:17.538402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:17.538422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:17.538426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:17.538428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:17.538437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601647514173248:9365]
2025-10-10T14:35:17.538442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601647514173248:9365]
2025-10-10T14:35:17.538446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601647514173248:9365]
2025-10-10T14:35:17.538497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:17.538498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:17.538504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.538506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:17.538507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:17.538512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:17.538664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:17.539567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:17.594312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601648296398085:9869]
2025-10-10T14:35:17.595077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1624, pipe: [1:7559601648296398085:9869]
2025-10-10T14:35:17.653564Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:17.653846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.653863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.653910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398085:9869], now have 1 active actors on pipe
2025-10-10T14:35:17.654287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601648296398085:9869]
2025-10-10T14:35:17.654322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:17.654325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:17.654388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1625 reason: error at write: Disconnected sessionId: src_id|713f5147-a395236e-156dbe0-b555e288_0
2025-10-10T14:35:17.654593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:17.654634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1625 sessionId: src_id|713f5147-a395236e-156dbe0-b555e288_0 is DEAD
2025-10-10T14:35:17.654812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:17.656863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f5147-a395236e-156dbe0-b555e288_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:17.656875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f5147-a395236e-156dbe0-b555e288_0] Write session will restart in 0.007183s
2025-10-10T14:35:17.656913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f5147-a395236e-156dbe0-b555e288_0] Write session: Do CDS request
2025-10-10T14:35:17.656923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f5147-a395236e-156dbe0-b555e288_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:17.665024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|713f5147-a395236e-156dbe0-b555e288_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.665132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:17.665160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1626
2025-10-10T14:35:17.665268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.665302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:17.665308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:17.665313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:17.665866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1626 sessionId:  describe result for acl check
2025-10-10T14:35:17.665906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:17.665908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:17.665910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:17.665917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601648296398118:10009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:17.666526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601648296398118:10009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:17.670480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601648296398118:10009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:17.674644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601648296398118:10009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:17.674661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601648296398118:10009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:17.674666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601648296398118:10009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:17.674675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:17.683291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:17.685589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:17.685821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:17.685835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:17.685848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:17.685904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:17.685948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601647514173478:9367]
2025-10-10T14:35:17.686605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:17.688656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:17.688718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:17.689091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:17.689150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.689156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.689158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.689159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.689161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.689163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.689164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.689166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.689168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.689169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.689171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.689172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.689174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.689182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.689197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.689202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.689206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.689211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.689215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.689220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.689225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.689229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.689234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.689238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.689243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.689247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.689255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.689265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.689276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.689283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.689292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.689298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.689307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.689314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.689324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.689365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.689375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.689381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.689391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.689397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.689406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.689411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.689417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.689423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.689429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.689440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.689447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.689453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.689458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.689464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.689470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.689475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.689521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:17.692892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:17.693477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:17.693484Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:17.693486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:17.693491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:17.693498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1625 [2:7559601647514173478:9367]
2025-10-10T14:35:17.693512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:17.693533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:17.693537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.693541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.693543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.693562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:17.693570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:17.693579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:17.693649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.693652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.693654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.693657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:17.693730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:17.693734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.693746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.693756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.693776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:17.693799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601647514173466:9367]
2025-10-10T14:35:17.693802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601647514173466:9367]
2025-10-10T14:35:17.693804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601647514173466:9367]
2025-10-10T14:35:17.693819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:17.693835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:17.693853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:17.693857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:17.693891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601647514173466:9367]
2025-10-10T14:35:17.693894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:17.694175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:17.694181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:17.694183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:17.694189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:17.694472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398096:2438], now have 1 active actors on pipe
2025-10-10T14:35:17.694478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398246:10009], now have 1 active actors on pipe
2025-10-10T14:35:17.694717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1625
2025-10-10T14:35:17.694762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1625
2025-10-10T14:35:17.694908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.694917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.694951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:17.694960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.694965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.694968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:17.694982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.694997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:17.695025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.695451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.695458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.695479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.695627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1626 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0
2025-10-10T14:35:17.696433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|713f5147-a395236e-156dbe0-b555e288_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:17.699280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0] Write session: try to update token
2025-10-10T14:35:17.699304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:17.715676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:17.715693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:17.715696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:17.715698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:17.715709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601647514173466:9367]
2025-10-10T14:35:17.715714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601647514173466:9367]
2025-10-10T14:35:17.715718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601647514173466:9367]
2025-10-10T14:35:17.715771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:17.715779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.715780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:17.715782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:17.715787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:17.715790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:17.715920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:17.715072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId: src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:17.717837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:17.754060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601648296398322:9869]
2025-10-10T14:35:17.754338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1625, pipe: [1:7559601648296398322:9869]
2025-10-10T14:35:17.831009Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:17.831421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.831437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.831484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398322:9869], now have 1 active actors on pipe
2025-10-10T14:35:17.831855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601648296398322:9869]
2025-10-10T14:35:17.831856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:17.831891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:17.831975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1626 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0
2025-10-10T14:35:17.831734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:17.832182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1626 sessionId: src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0 is DEAD
2025-10-10T14:35:17.832525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:17.832536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0] Write session will restart in 0.006601s
2025-10-10T14:35:17.832562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0] Write session: Do CDS request
2025-10-10T14:35:17.832568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:17.840932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.841031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:17.841047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1627
2025-10-10T14:35:17.841183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:17.841222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:17.841232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:17.841236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:17.842022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1627 sessionId:  describe result for acl check
2025-10-10T14:35:17.842058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:17.842060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:17.842062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:17.842070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601648296398353:10016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:17.842520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601648296398353:10016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:17.845248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601648296398353:10016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:17.848525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601648296398353:10016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:17.848539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601648296398353:10016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:17.848543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601648296398353:10016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:17.848552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:17.850255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:17.852840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:17.853156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:17.853167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:17.853183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:17.853258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:17.853305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601647514173723:9382]
2025-10-10T14:35:17.853922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:17.854353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:17.854407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:17.854760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:17.854833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.854841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.854842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.854844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.854845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.854847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.854848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.854849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.854850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.854852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.854853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.854854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.854855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.854862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.854875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.854879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.854884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.854889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.854893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.854897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.854901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.854904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.854909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.854913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.854916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.854920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.854928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.854936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:17.854942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.854947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:17.854952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.854956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:17.854960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.854965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:17.854970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.854976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:17.854980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.854986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:17.854992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.854997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:17.855001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.855005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:17.855011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.855015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:17.855020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.855026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:17.855035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.855047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.855051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.855057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.855061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.855067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.855110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:17.858229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:17.858895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:17.858910Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:17.858913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:17.858916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:17.858924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1626 [2:7559601647514173723:9382]
2025-10-10T14:35:17.858937Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:17.858956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:17.858965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.858968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.858971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.858991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:17.859005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:17.859013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:17.859082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.859090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.859092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.859096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:17.859183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:17.859193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.859209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:17.859225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:17.859247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:17.859274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601647514173718:9382]
2025-10-10T14:35:17.859281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601647514173718:9382]
2025-10-10T14:35:17.859284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601647514173718:9382]
2025-10-10T14:35:17.859302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:17.859325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:17.859347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:17.859356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:17.859371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:17.859375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:17.859377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:17.859392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601647514173718:9382]
2025-10-10T14:35:17.859396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:17.859437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:17.859604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398324:2438], now have 1 active actors on pipe
2025-10-10T14:35:17.859616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398537:10016], now have 1 active actors on pipe
2025-10-10T14:35:17.859677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1626
2025-10-10T14:35:17.859737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1626
2025-10-10T14:35:17.859856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.859868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.859900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:17.859913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:17.859919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:17.859925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:17.859937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:17.859952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:17.859984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.860222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.860230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.860248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:17.860357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1627 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0
2025-10-10T14:35:17.860779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe0f7ef8-3f20d918-bf3f2c88-13be27df_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:17.863681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0] Write session: try to update token
2025-10-10T14:35:17.863702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:17.879475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:17.879496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:17.879499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:17.879515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:17.879525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601647514173718:9382]
2025-10-10T14:35:17.879529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601647514173718:9382]
2025-10-10T14:35:17.879533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601647514173718:9382]
2025-10-10T14:35:17.879583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:17.879594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:17.879596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:17.879599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:17.879605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:17.879609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:17.879740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:17.880899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId: src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:17.883593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:17.932257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601648296398563:9869]
2025-10-10T14:35:17.932571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1626, pipe: [1:7559601648296398563:9869]
2025-10-10T14:35:17.996973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:17.997393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:17.997408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:17.997455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398563:9869], now have 1 active actors on pipe
2025-10-10T14:35:17.997670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:17.997700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:17.997739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601648296398563:9869]
2025-10-10T14:35:17.997753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:17.997850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1627 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0
2025-10-10T14:35:17.998209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:17.998222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0] Write session will restart in 0.008294s
2025-10-10T14:35:17.998265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0] Write session: Do CDS request
2025-10-10T14:35:17.998272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:17.998067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1627 sessionId: src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0 is DEAD
2025-10-10T14:35:18.007938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.008027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:18.008045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1628
2025-10-10T14:35:18.008164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.008209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:18.008220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:18.008225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:18.009039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1628 sessionId:  describe result for acl check
2025-10-10T14:35:18.009082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:18.009084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:18.009086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:18.009092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601652591365871:10027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:18.009704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601652591365871:10027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:18.012293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601652591365871:10027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:18.015492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601652591365871:10027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:18.015507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601652591365871:10027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:18.015511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601652591365871:10027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:18.015521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:18.022011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:18.024981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:18.025196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:18.025208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:18.025221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:18.025277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:18.025324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601651809141238:9386]
2025-10-10T14:35:18.026005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:18.026329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:18.026376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:18.026719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:18.026787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.026798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.026799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.026800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.026801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.026803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.026804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.026805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.026806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.026808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.026809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.026810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.026811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.026817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.026831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.026836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.026841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.026845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.026864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.026869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.026873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.026877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.026882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.026886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.026890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.026895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.026903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.026912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.026919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.026925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.026930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.026936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.026941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.026947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.026957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.026962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.026967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.026973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.026978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.026988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.026993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.026998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.027007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.027013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.027018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.027029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.027033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.027039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.027049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.027055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.027063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.027069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.027119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:18.029657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:18.030192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:18.030203Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:18.030205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:18.030208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:18.030215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1627 [2:7559601651809141238:9386]
2025-10-10T14:35:18.030228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:18.030246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:18.030249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.030252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.030254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.030270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:18.030277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:18.030288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:18.030349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.030356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.030358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.030361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:18.030430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:18.030438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.030449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.030463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.030483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:18.030509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591365945:10027], now have 1 active actors on pipe
2025-10-10T14:35:18.030517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601648296398565:2438], now have 1 active actors on pipe
2025-10-10T14:35:18.030539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601651809141232:9386]
2025-10-10T14:35:18.030541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601651809141232:9386]
2025-10-10T14:35:18.030543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601651809141232:9386]
2025-10-10T14:35:18.030562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:18.030577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:18.030597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:18.030604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:18.030628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601651809141232:9386]
2025-10-10T14:35:18.030634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:18.030615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1627
2025-10-10T14:35:18.030649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1627
2025-10-10T14:35:18.030652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:18.030660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:18.030662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:18.030670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:18.030823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.030834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.030868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:18.030892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.030896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.030898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:18.030909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.030920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:18.030939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.031163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.031170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.031186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.031287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1628 partition: 0 MaxSeqNo: 40 sessionId: src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0
2025-10-10T14:35:18.031740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3a6798f-f0a79fc2-e54f524c-4a98a5eb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:18.034621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0] Write session: try to update token
2025-10-10T14:35:18.034641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:18.051308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId: src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:18.051437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:18.051452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.051463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601651809141232:9386]
2025-10-10T14:35:18.051513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:18.051519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:18.051699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:18.051855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.052013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.052166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.052376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:18.052423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:18.054105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:18.054290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.054317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.054358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:18.054466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:18.064042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:18.064064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.064068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:18.064070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:18.064097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601651809141232:9386]
2025-10-10T14:35:18.064101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601651809141232:9386]
2025-10-10T14:35:18.064109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601651809141232:9386]
2025-10-10T14:35:18.064151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:18.064158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:18.064164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:18.064166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.064168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:18.064170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:18.064315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:18.098146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601652591366077:9869]
2025-10-10T14:35:18.098512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1627, pipe: [1:7559601652591366077:9869]
2025-10-10T14:35:18.180742Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:18.188924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.188952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.189133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.189197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.189264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.189354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.189886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.189903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.189987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.190049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.190122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.190195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.190251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.190261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.190336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.190401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.190474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.190558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.190605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.190612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.190687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.190755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.190815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.190882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.190930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.190937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.191000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.191061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.191121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.191190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.191236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.191246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.191310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.191371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.191432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.191494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.191538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.191546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.191612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.191676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.191740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.191804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.191849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.191857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.191926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.191990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.192058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.192123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.192171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.192178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.192241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.192303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.192361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.192426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.192489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.192495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.192559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.192616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.192677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.192736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.192779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.192787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.192850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366077:9869], now have 1 active actors on pipe
2025-10-10T14:35:18.193089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601652591366077:9869]
2025-10-10T14:35:18.193119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:18.193663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:18.193729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1628 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0
2025-10-10T14:35:18.194018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1628 sessionId: src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0 is DEAD
2025-10-10T14:35:18.194154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:18.194165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0] Write session will restart in 0.008090s
2025-10-10T14:35:18.194187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0] Write session: Do CDS request
2025-10-10T14:35:18.194200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:18.193493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:18.203999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.204356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:18.204382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1629
2025-10-10T14:35:18.204551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.204599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:18.204610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:18.204614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:18.205159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1629 sessionId:  describe result for acl check
2025-10-10T14:35:18.205201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:18.205205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:18.205207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:18.205214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601652591366128:10031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:18.205836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601652591366128:10031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:18.213048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601652591366128:10031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:18.215561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:18.218044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601652591366128:10031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:18.218073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601652591366128:10031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:18.218077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601652591366128:10031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:18.218087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:18.219784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:18.220037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:18.220042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:18.220054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:18.220118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:18.220168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601651809141451:9388]
2025-10-10T14:35:18.220784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:18.221516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:18.221568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:18.221908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:18.221978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.221979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.221981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.221982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.221983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.221984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.221986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.221987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.221988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.221990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.221991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.221992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.221993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.222000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.222014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.222027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.222031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.222034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.222039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.222043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.222046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.222051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.222058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.222061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.222065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.222069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.222079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.222087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.222094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.222101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.222106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.222111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.222115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.222120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.222125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.222130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.222134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.222140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.222145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.222161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.222166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.222172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.222177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.222182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.222187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.222192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.222197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.222202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.222207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.222212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.222218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.222224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.222263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:18.224777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:18.225506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:18.225510Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:18.225513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:18.225517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:18.225524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1628 [2:7559601651809141451:9388]
2025-10-10T14:35:18.225538Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:18.225556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:18.225560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.225563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.225566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.225584Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:18.225592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:18.225600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:18.225664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.225679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.225681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.225684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:18.225753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:18.225764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.225776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.225789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.225808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:18.225838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366080:2438], now have 1 active actors on pipe
2025-10-10T14:35:18.225846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366285:10031], now have 1 active actors on pipe
2025-10-10T14:35:18.225855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601651809141445:9388]
2025-10-10T14:35:18.225857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601651809141445:9388]
2025-10-10T14:35:18.225860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601651809141445:9388]
2025-10-10T14:35:18.225874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:18.225893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:18.225898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:18.225901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:18.225903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:18.225912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:18.225915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:18.225945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601651809141445:9388]
2025-10-10T14:35:18.225957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:18.225965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:18.226099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1628
2025-10-10T14:35:18.226171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1628
2025-10-10T14:35:18.226322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.226336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.226374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0945372-34d26470-e7118bd8-63382bcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:18.226392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.226411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.226414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:18.226427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.226446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:18.226468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.226677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.226689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.226715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.226853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1629 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0945372-34d26470-e7118bd8-63382bcb_0
2025-10-10T14:35:18.227281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07a05-868474c7-6c36f8bc-1004d5fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0945372-34d26470-e7118bd8-63382bcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:18.230411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0945372-34d26470-e7118bd8-63382bcb_0] Write session: try to update token
2025-10-10T14:35:18.230432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0945372-34d26470-e7118bd8-63382bcb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:18.247502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:18.247519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.247523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:18.247525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:18.247536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601651809141445:9388]
2025-10-10T14:35:18.247541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601651809141445:9388]
2025-10-10T14:35:18.247546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601651809141445:9388]
2025-10-10T14:35:18.247598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:18.247605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:18.247605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:18.247609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:18.247613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.247616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:18.247779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:18.248659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId: src_id|b0945372-34d26470-e7118bd8-63382bcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:18.251437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:18.296243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601652591366296:9869]
2025-10-10T14:35:18.296756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1628, pipe: [1:7559601652591366296:9869]
2025-10-10T14:35:18.360702Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:18.360989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.361004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.361053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366296:9869], now have 1 active actors on pipe
2025-10-10T14:35:18.361322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:18.361355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601652591366296:9869]
2025-10-10T14:35:18.361384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:18.361388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:18.361454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1629 reason: error at write: Disconnected sessionId: src_id|b0945372-34d26470-e7118bd8-63382bcb_0
2025-10-10T14:35:18.361500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:18.361669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1629 sessionId: src_id|b0945372-34d26470-e7118bd8-63382bcb_0 is DEAD
2025-10-10T14:35:18.361841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0945372-34d26470-e7118bd8-63382bcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:18.361852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0945372-34d26470-e7118bd8-63382bcb_0] Write session will restart in 0.005118s
2025-10-10T14:35:18.361881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0945372-34d26470-e7118bd8-63382bcb_0] Write session: Do CDS request
2025-10-10T14:35:18.361890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0945372-34d26470-e7118bd8-63382bcb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:18.367849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0945372-34d26470-e7118bd8-63382bcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.367968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:18.367986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1630
2025-10-10T14:35:18.368119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.368170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:18.368181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:18.368185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:18.368636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1630 sessionId:  describe result for acl check
2025-10-10T14:35:18.368688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:18.368694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:18.368696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:18.368702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601652591366313:10035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:18.369276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601652591366313:10035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:18.371807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601652591366313:10035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:18.378441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601652591366313:10035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:18.378476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601652591366313:10035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:18.378480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601652591366313:10035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:18.378489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:18.384028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:18.386737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:18.387021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:18.387032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:18.387044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:18.387100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:18.387142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601651809141665:9390]
2025-10-10T14:35:18.387594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:18.387883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:18.387928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:18.388240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:18.388296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.388301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.388303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.388304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.388305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.388307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.388308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.388309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.388310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.388312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.388313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.388314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.388316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.388322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.388334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.388338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.388342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.388346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.388350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.388354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.388358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.388362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.388366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.388370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.388374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.388378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.388385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.388394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.388400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.388406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.388412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.388418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.388422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.388428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.388432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.388438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.388442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.388447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.388452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.388462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.388466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.388471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.388476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.388481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.388485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.388492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.388497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.388507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.388512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.388518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.388528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.388533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.388578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:18.390856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:18.391143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:18.391151Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:18.391153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:18.391156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:18.391161Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1629 [2:7559601651809141665:9390]
2025-10-10T14:35:18.391170Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:18.391183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:18.391185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.391187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.391189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.391202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:18.391209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:18.391229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:18.391284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.391292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.391294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.391296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:18.391362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:18.391372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.391383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.391393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.391409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:18.391434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366298:2438], now have 1 active actors on pipe
2025-10-10T14:35:18.391437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366395:10035], now have 1 active actors on pipe
2025-10-10T14:35:18.391443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601651809141660:9390]
2025-10-10T14:35:18.391449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601651809141660:9390]
2025-10-10T14:35:18.391450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601651809141660:9390]
2025-10-10T14:35:18.391459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:18.391472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:18.391474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:18.391477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:18.391479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:18.391485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:18.391488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:18.391510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601651809141660:9390]
2025-10-10T14:35:18.391517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:18.391519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:18.391501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1629
2025-10-10T14:35:18.391538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.391509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1629
2025-10-10T14:35:18.391546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.391594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:18.391608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.391612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.391614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:18.391624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.391635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:18.391655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.391807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.391815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.391830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.391937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1630 partition: 0 MaxSeqNo: 40 sessionId: src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0
2025-10-10T14:35:18.392344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0945372-34d26470-e7118bd8-63382bcb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:18.395043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0] Write session: try to update token
2025-10-10T14:35:18.395061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:18.410584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId: src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:18.410996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:18.411009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.411013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:18.411015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:18.411025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601651809141660:9390]
2025-10-10T14:35:18.411029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601651809141660:9390]
2025-10-10T14:35:18.411033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601651809141660:9390]
2025-10-10T14:35:18.411090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:18.411089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:18.411095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:18.411100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.411100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:18.411102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:18.411249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:18.413384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:18.461663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601652591366515:9869]
2025-10-10T14:35:18.462212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1629, pipe: [1:7559601652591366515:9869]
2025-10-10T14:35:18.525927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:18.526665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.526682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.526737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366515:9869], now have 1 active actors on pipe
2025-10-10T14:35:18.526987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:18.527021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:18.527047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601652591366515:9869]
2025-10-10T14:35:18.527072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:18.527155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1630 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0
2025-10-10T14:35:18.527351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1630 sessionId: src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0 is DEAD
2025-10-10T14:35:18.527513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:18.527526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0] Write session will restart in 0.008420s
2025-10-10T14:35:18.527554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0] Write session: Do CDS request
2025-10-10T14:35:18.527569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:18.536926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.536993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:18.537010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1631
2025-10-10T14:35:18.537124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.537161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:18.537167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:18.537170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:18.537653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1631 sessionId:  describe result for acl check
2025-10-10T14:35:18.537694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:18.537700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:18.537702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:18.537709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601652591366543:10039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:18.538311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601652591366543:10039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:18.541402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601652591366543:10039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:18.545731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601652591366543:10039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:18.545749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601652591366543:10039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:18.545753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601652591366543:10039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:18.545762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:18.548693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:18.552648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:18.552930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:18.552940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:18.552954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:18.553013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:18.553070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601651809141880:9392]
2025-10-10T14:35:18.553745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:18.554060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:18.554106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:18.554426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:18.554487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.554494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.554496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.554497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.554498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.554499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.554500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.554502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.554503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.554514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.554515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.554517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.554518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.554524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.554537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.554541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.554545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.554549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.554554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.554558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.554561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.554565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.554569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.554573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.554577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.554581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.554590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.554599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.554605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.554610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.554615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.554620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.554624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.554630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.554645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.554651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.554656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.554662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.554666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.554672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.554676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.554682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.554687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.554693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.554697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.554702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.554706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.554711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.554716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.554720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.554728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.554733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.554775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:18.557371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:18.558093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:18.558104Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:18.558106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:18.558111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:18.558119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1630 [2:7559601651809141880:9392]
2025-10-10T14:35:18.558134Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:18.558154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:18.558157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.558161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.558163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.558181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:18.558194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:18.558213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:18.558292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.558299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.558301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.558304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:18.558367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:18.558374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.558387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.558400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.558420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:18.558447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366517:2438], now have 1 active actors on pipe
2025-10-10T14:35:18.558455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366702:10039], now have 1 active actors on pipe
2025-10-10T14:35:18.558463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601651809141875:9392]
2025-10-10T14:35:18.558470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601651809141875:9392]
2025-10-10T14:35:18.558472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601651809141875:9392]
2025-10-10T14:35:18.558486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:18.558501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:18.558517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:18.558521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:18.558524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:18.558529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:18.558533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:18.558564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601651809141875:9392]
2025-10-10T14:35:18.558572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:18.558579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:18.558575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1630
2025-10-10T14:35:18.558626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1630
2025-10-10T14:35:18.558756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.558767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.558802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:18.558811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.558818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.558820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:18.558841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.558853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:18.558871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.559144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.559151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.559170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.559267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1631 partition: 0 MaxSeqNo: 40 sessionId: src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0
2025-10-10T14:35:18.559751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c012fb-8ca23435-ab87168e-9a6a3e93_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:18.562594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0] Write session: try to update token
2025-10-10T14:35:18.562615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:18.580898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:18.580920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.580931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601651809141875:9392]
2025-10-10T14:35:18.580972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:18.581217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:18.581360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId: src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:18.581422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:18.581582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.581737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.581882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.582111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:18.582155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:18.584223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:18.584470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.584491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.584530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:18.584668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:18.590845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:18.590866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.590870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:18.590872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:18.590885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601651809141875:9392]
2025-10-10T14:35:18.590889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601651809141875:9392]
2025-10-10T14:35:18.590893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601651809141875:9392]
2025-10-10T14:35:18.590946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:18.590950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:18.590958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.590958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:18.590960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:18.590963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:18.591101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:18.629399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601652591366736:9869]
2025-10-10T14:35:18.629725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1630, pipe: [1:7559601652591366736:9869]
2025-10-10T14:35:18.704714Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:18.713266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.713294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.713506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.713579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.713652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.713720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.713771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.713781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.713853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.713920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.713988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.714066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.714115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.714125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.714196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.714260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.714326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.714395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.714443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.714452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.714534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.714600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.714666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.714734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.714788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.714801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.714870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.714932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.714994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.715062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.716902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601652591366736:9869]
2025-10-10T14:35:18.716949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:18.716955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:18.716990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1631 reason: error at write: Disconnected sessionId: src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0
2025-10-10T14:35:18.717262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:18.717300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1631 sessionId: src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0 is DEAD
2025-10-10T14:35:18.715109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.715122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.715190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.715247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.715307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.715368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.715413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.715416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.715484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.715540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.715602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.715664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.715707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.715711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.715779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.715839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.715899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.715957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.716001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.716005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.716072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.716129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.716188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.716250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.716294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.716297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.716369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.716431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.716494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.716555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.716601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.716604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.716680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366736:9869], now have 1 active actors on pipe
2025-10-10T14:35:18.717557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:18.717569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0] Write session will restart in 0.007992s
2025-10-10T14:35:18.717595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0] Write session: Do CDS request
2025-10-10T14:35:18.717602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:18.717988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:18.726987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.727094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:18.727111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1632
2025-10-10T14:35:18.727361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.727401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:18.727413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:18.727424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:18.727904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1632 sessionId:  describe result for acl check
2025-10-10T14:35:18.727961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:18.727970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:18.727972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:18.727979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601652591366771:10045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:18.728545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601652591366771:10045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:18.730933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601652591366771:10045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:18.734922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601652591366771:10045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:18.734943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601652591366771:10045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:18.734947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601652591366771:10045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:18.734956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:18.742353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:18.745124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:18.745401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:18.745413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:18.745426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:18.745486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:18.745531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601651809142108:9395]
2025-10-10T14:35:18.746179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:18.746480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:18.746536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:18.746871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:18.746931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.746937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.746938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.746939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.746941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.746942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.746943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.746945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.746946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.746947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.746949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.746950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.746951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.746957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.746970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.746979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.746983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.746991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.746995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.747003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.747008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.747012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.747016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.747020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.747024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.747028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.747035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.747044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.747051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.747060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.747065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.747070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.747079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.747084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.747089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.747100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.747106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.747111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.747116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.747121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.747125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.747131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.747136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.747142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.747150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.747156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.747161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.747166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.747171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.747176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.747182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.747188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.747232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:18.749826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:18.750158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:18.750175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:18.750178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:18.750182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:18.750189Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1631 [2:7559601651809142108:9395]
2025-10-10T14:35:18.750203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:18.750222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:18.750229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.750233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.750236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.750253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:18.750264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:18.750272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:18.750335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.750342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.750344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.750347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:18.750552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1631
2025-10-10T14:35:18.750554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1631
2025-10-10T14:35:18.750638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:18.750649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.750662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.750675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.750698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:18.750724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366759:2438], now have 1 active actors on pipe
2025-10-10T14:35:18.750732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366861:10045], now have 1 active actors on pipe
2025-10-10T14:35:18.750751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.750756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.750782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601651809142103:9395]
2025-10-10T14:35:18.750789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601651809142103:9395]
2025-10-10T14:35:18.750791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601651809142103:9395]
2025-10-10T14:35:18.750803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:18.750814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:18.750816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:18.750818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:18.750824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:18.750839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:18.750843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:18.750864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:18.750879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.750889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.750892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:18.750904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.750914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:18.750944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601651809142103:9395]
2025-10-10T14:35:18.750956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:18.750972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.750997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:18.751156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.751164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.751181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.751302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1632 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0
2025-10-10T14:35:18.751741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff1ab03-cd82f3b-37e16ef4-bc76bfb8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:18.754596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0] Write session: try to update token
2025-10-10T14:35:18.754616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:18.762833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:18.762850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.762861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601651809142103:9395]
2025-10-10T14:35:18.762909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:18.762910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:18.763088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:18.763234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.763374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.763507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.763702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:18.763740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:18.770933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId: src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:18.773517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:18.773769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.773790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.773832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:18.773926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:18.782186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:18.782204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.782207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:18.782209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:18.782220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601651809142103:9395]
2025-10-10T14:35:18.782223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601651809142103:9395]
2025-10-10T14:35:18.782228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601651809142103:9395]
2025-10-10T14:35:18.782278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:18.782288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.782290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:18.782289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:18.782295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:18.782299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:18.782438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:18.817001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601652591366979:9869]
2025-10-10T14:35:18.817906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1631, pipe: [1:7559601652591366979:9869]
2025-10-10T14:35:18.894973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:18.902618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.902642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.902855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.902924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.902997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.903072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.903123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.903133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.903205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.903453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.903517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.903588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.903631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.903642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.903711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.903778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.903849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.903911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.903951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.903956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.904030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.904102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.904160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.904218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.904255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.904258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.904328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.904388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.904454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.904511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.904551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.904553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.904623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.904679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.904738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.904798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.904839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.904841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.904911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.904968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.905031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.905092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.905135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.905138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.905206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.905269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.905502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.905576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.905623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.905635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.905707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.905774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.905841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.905911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.905961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.905968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.906038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:18.906100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:18.906166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:18.906239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:18.906286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:18.906289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:18.906367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366979:9869], now have 1 active actors on pipe
2025-10-10T14:35:18.907636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:18.907698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:18.907701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:18.907742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1632 reason: error at write: Disconnected sessionId: src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0
2025-10-10T14:35:18.908065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1632 sessionId: src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0 is DEAD
2025-10-10T14:35:18.908337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601652591366979:9869]
2025-10-10T14:35:18.907756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:18.908481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:18.908492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0] Write session will restart in 0.007462s
2025-10-10T14:35:18.908523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0] Write session: Do CDS request
2025-10-10T14:35:18.908529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:18.916991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.917041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:18.917058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1633
2025-10-10T14:35:18.917266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:18.917322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:18.917343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:18.917348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:18.918008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1633 sessionId:  describe result for acl check
2025-10-10T14:35:18.918049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:18.918055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:18.918057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:18.918064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601652591367019:10055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:18.918616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601652591367019:10055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:18.922258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601652591367019:10055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:18.926385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601652591367019:10055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:18.926401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601652591367019:10055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:18.926405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601652591367019:10055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:18.926413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:18.930599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:18.933755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:18.934105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:18.934121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:18.934138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:18.934226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:18.934284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601651809142358:9409]
2025-10-10T14:35:18.935060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:18.935467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:18.935533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:18.935960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:18.936051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.936061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.936063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.936064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.936065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.936066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.936067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.936069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.936070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.936071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.936072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.936073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.936075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.936083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.936095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.936099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.936103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.936107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.936110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.936113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.936117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.936120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.936124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.936127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.936130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.936133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.936143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.936152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:18.936158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.936163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:18.936167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.936172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:18.936176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.936182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:18.936187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.936192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:18.936196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.936200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:18.936204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.936208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:18.936213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.936218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:18.936237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.936242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:18.936246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.936252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:18.936256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.936261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.936265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.936270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.936274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.936280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.936321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:18.939601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:18.939932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:18.939948Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:18.939950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:18.939953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:18.939960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1632 [2:7559601651809142358:9409]
2025-10-10T14:35:18.939973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:18.939991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:18.940002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.940007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.940009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.940026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:18.940042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:18.940051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:18.940112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.940121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.940123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.940126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:18.940195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:18.940202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.940214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:18.940230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:18.940252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:18.940284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601651809142353:9409]
2025-10-10T14:35:18.940290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601651809142353:9409]
2025-10-10T14:35:18.940292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601651809142353:9409]
2025-10-10T14:35:18.940307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:18.940325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:18.940335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:18.940339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:18.940341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:18.940346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:18.940350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:18.940378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601651809142353:9409]
2025-10-10T14:35:18.940385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:18.940395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:18.940405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591367147:10055], now have 1 active actors on pipe
2025-10-10T14:35:18.940409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601652591366996:2438], now have 1 active actors on pipe
2025-10-10T14:35:18.940490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1632
2025-10-10T14:35:18.940493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1632
2025-10-10T14:35:18.940564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.940574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.940605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:18.940617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:18.940621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:18.940623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:18.940635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:18.940650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:18.940665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.941048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.941059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.941078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:18.941182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1633 partition: 0 MaxSeqNo: 40 sessionId: src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0
2025-10-10T14:35:18.941578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac7dff3-d4ce3ab9-ef27cee0-2be1ae9b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:18.944329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0] Write session: try to update token
2025-10-10T14:35:18.944349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:18.954793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:18.954808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.954819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601651809142353:9409]
2025-10-10T14:35:18.954858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:18.954866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:18.955074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:18.955230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.955372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.955516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:18.955714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:18.955760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:18.959572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId: src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:18.962143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:18.962528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:18.962547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:18.962585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:18.962673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:18.976591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:18.976611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:18.976615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:18.976618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:18.976628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601651809142353:9409]
2025-10-10T14:35:18.976634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601651809142353:9409]
2025-10-10T14:35:18.976638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601651809142353:9409]
2025-10-10T14:35:18.976683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:18.976690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:18.976689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:18.976693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:18.976695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:18.976706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:18.976823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:19.008483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601656886334521:9869]
2025-10-10T14:35:19.008800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1632, pipe: [1:7559601656886334521:9869]
2025-10-10T14:35:19.089660Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:19.097876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.097910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.098090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.098157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.098220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.098289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.098335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.098345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.098415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.098483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.098558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.098624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.098670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.098679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.098750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.098812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.098880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.098947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.098992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.098999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.099067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.099126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.099191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.099261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.099305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.099312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.099379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.099442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.099508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.099575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.099621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.099629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.099697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.099768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.099831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.099893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.099936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.099948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.100012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.100071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.100140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.100205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.100269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.100276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.100342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.100430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.100537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.100605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.100657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.100666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.100731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.100793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.100864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.100932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.100979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.100989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.101053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.101114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.101173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.101238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.101280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.101286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.101368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886334521:9869], now have 1 active actors on pipe
2025-10-10T14:35:19.101642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:19.101644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601656886334521:9869]
2025-10-10T14:35:19.101657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:19.101668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:19.101690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1633 reason: error at write: Disconnected sessionId: src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0
2025-10-10T14:35:19.101926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1633 sessionId: src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0 is DEAD
2025-10-10T14:35:19.102044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:19.102055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0] Write session will restart in 0.008180s
2025-10-10T14:35:19.102081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0] Write session: Do CDS request
2025-10-10T14:35:19.102088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:19.102508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:19.111982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.112058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:19.112076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1634
2025-10-10T14:35:19.112249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.112295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:19.112308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:19.112313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:19.112814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1634 sessionId:  describe result for acl check
2025-10-10T14:35:19.112867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:19.112874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:19.112876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:19.112883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601656886334558:10062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:19.113557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601656886334558:10062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:19.117318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601656886334558:10062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:19.120500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601656886334558:10062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:19.120515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601656886334558:10062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:19.120519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601656886334558:10062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:19.120528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:19.121018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:19.123545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:19.123756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:19.123768Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:19.123781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:19.123836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:19.123873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601656104109879:9413]
2025-10-10T14:35:19.124401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:19.124699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:19.124740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:19.125031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:19.125080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.125081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.125083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.125084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.125085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.125086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.125087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.125089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.125090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.125091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.125092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.125094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.125095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.125100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.125114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.125119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.125123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.125127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.125131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.125135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.125139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.125143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.125147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.125151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.125155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.125159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.125166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.125174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.125180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.125186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.125190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.125196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.125200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.125205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.125210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.125216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.125220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.125225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.125229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.125235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.125239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.125244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.125248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.125253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.125256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.125262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.125266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.125272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.125277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.125282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.125286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.125291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.125353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:19.128270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:19.128801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:19.128812Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:19.128815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:19.128819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:19.128825Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1633 [2:7559601656104109879:9413]
2025-10-10T14:35:19.128838Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:19.128854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:19.128862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.128866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.128869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.128887Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:19.128899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:19.128910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:19.128981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.128988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.128990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.128992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:19.129057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:19.129065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.129078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.129094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.129115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:19.129151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601656104109874:9413]
2025-10-10T14:35:19.129158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601656104109874:9413]
2025-10-10T14:35:19.129160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601656104109874:9413]
2025-10-10T14:35:19.129170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:19.129179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:19.129181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:19.129183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:19.129188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:19.129208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:19.129215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:19.129249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886334732:10062], now have 1 active actors on pipe
2025-10-10T14:35:19.129257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886334523:2438], now have 1 active actors on pipe
2025-10-10T14:35:19.129259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601656104109874:9413]
2025-10-10T14:35:19.129266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:19.129280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:19.129309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1633
2025-10-10T14:35:19.129361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1633
2025-10-10T14:35:19.129514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.129526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.129559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:19.129573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.129580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.129589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:19.129602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.129616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:19.129631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.131057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.131068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.131093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.131248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1634 partition: 0 MaxSeqNo: 40 sessionId: src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0
2025-10-10T14:35:19.131984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442ac7ea-3fc2a1f7-556c118f-64e9acd8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:19.134618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0] Write session: try to update token
2025-10-10T14:35:19.134639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:19.146034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:19.146049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:19.146060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601656104109874:9413]
2025-10-10T14:35:19.146109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:19.146112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:19.146282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:19.146430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:19.146576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:19.146726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:19.146912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:19.146955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:19.162436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId: src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:19.165132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:19.165396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.165420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.165465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:19.169455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:19.171739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:19.171753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:19.171756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:19.171757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:19.171766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601656104109874:9413]
2025-10-10T14:35:19.171770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601656104109874:9413]
2025-10-10T14:35:19.171772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601656104109874:9413]
2025-10-10T14:35:19.171817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:19.171825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.171828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:19.171826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:19.171833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:19.171837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:19.171952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:19.201971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601656886334745:9869]
2025-10-10T14:35:19.202408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1633, pipe: [1:7559601656886334745:9869]
2025-10-10T14:35:19.288987Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:19.297427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.297458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.297645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.297721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.297795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.297864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.297916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.297926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.297998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.298064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.298128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.298194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.298239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.298246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.298320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.298386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.298452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.298568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.298616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.298624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.298694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.298765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.298834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.298899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.298942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.298948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.299020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.299082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.299151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.299222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.299273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.299281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.299353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.299420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.299490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.299563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.299609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.299612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.299679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.299739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.299805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.299869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.299913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.299916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.299990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.300049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.300110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.300170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.300214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.300218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.300293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.300355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.300413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.300474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.300515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.300519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.300594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:19.300653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:19.300714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:19.300777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:19.300823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:19.300826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:19.300904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886334745:9869], now have 1 active actors on pipe
2025-10-10T14:35:19.301323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:19.301354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:19.301381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601656886334745:9869]
2025-10-10T14:35:19.301386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1634 reason: error at write: Disconnected sessionId: src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0
2025-10-10T14:35:19.301408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:19.301602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1634 sessionId: src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0 is DEAD
2025-10-10T14:35:19.302275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:19.305428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:19.305442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0] Write session will restart in 0.007191s
2025-10-10T14:35:19.305473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0] Write session: Do CDS request
2025-10-10T14:35:19.305479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:19.313914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.314008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:19.314025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1635
2025-10-10T14:35:19.314207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.314258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:19.314268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:19.314272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:19.314788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1635 sessionId:  describe result for acl check
2025-10-10T14:35:19.314827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:19.314833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:19.314835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:19.314841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601656886334799:10066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:19.315423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601656886334799:10066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:19.318614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601656886334799:10066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:19.322316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601656886334799:10066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:19.322333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601656886334799:10066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:19.322337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601656886334799:10066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:19.322347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:19.323463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:19.326097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:19.326350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:19.326362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:19.326375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:19.326431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:19.326478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601656104110098:9415]
2025-10-10T14:35:19.327160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:19.327514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:19.327574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:19.327926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:19.327983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.327984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.327985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.327986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.327987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.327989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.327990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.327991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.327992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.327994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.327995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.327996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.327997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.328004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.328019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.328023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.328028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.328032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.328037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.328041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.328045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.328050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.328055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.328059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.328063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.328068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.328076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.328086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.328093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.328099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.328104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.328110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.328115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.328121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.328127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.328133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.328138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.328143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.328148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.328154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.328159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.328165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.328170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.328176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.328181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.328187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.328194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.328199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.328204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.328210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.328214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.328219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.328260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:19.331439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:19.331765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:19.331770Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:19.331773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:19.331778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:19.331786Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1634 [2:7559601656104110098:9415]
2025-10-10T14:35:19.331800Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:19.331820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:19.331824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.331829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.331831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.331865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:19.331873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:19.331880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:19.331946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.331948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.331950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.331953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:19.332027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:19.332030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.332043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.332055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.332074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:19.332097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601656104110093:9415]
2025-10-10T14:35:19.332100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601656104110093:9415]
2025-10-10T14:35:19.332103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601656104110093:9415]
2025-10-10T14:35:19.332112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:19.332126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:19.332128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:19.332129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:19.332131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:19.332146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:19.332149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:19.332161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886334957:10066], now have 1 active actors on pipe
2025-10-10T14:35:19.332166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886334747:2438], now have 1 active actors on pipe
2025-10-10T14:35:19.332198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601656104110093:9415]
2025-10-10T14:35:19.332208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:19.332217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:19.332858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1634
2025-10-10T14:35:19.332888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1634
2025-10-10T14:35:19.333485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.333501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.333540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6adccd4-24718f66-63b98d3d-91a755fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:19.333565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.333572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.333575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:19.333590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.333614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:19.333647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.334139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.334160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.334186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.334340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1635 partition: 0 MaxSeqNo: 40 sessionId: src_id|6adccd4-24718f66-63b98d3d-91a755fc_0
2025-10-10T14:35:19.337683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfd3514b-f4ea471c-b5d6825e-f39e5be2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6adccd4-24718f66-63b98d3d-91a755fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:19.340468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6adccd4-24718f66-63b98d3d-91a755fc_0] Write session: try to update token
2025-10-10T14:35:19.340488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6adccd4-24718f66-63b98d3d-91a755fc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:19.357652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:19.357670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:19.357674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:19.357676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:19.357688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601656104110093:9415]
2025-10-10T14:35:19.357693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601656104110093:9415]
2025-10-10T14:35:19.357696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601656104110093:9415]
2025-10-10T14:35:19.357747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:19.357755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.357758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:19.357759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:19.357768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:19.357773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:19.357898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:19.360337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId: src_id|6adccd4-24718f66-63b98d3d-91a755fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:19.363254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:19.401680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601656886334970:9869]
2025-10-10T14:35:19.405701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1634, pipe: [1:7559601656886334970:9869]
2025-10-10T14:35:19.470221Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:19.470818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.470833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.470884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886334970:9869], now have 1 active actors on pipe
2025-10-10T14:35:19.471180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:19.471195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601656886334970:9869]
2025-10-10T14:35:19.471196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:19.471217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:19.471258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1635 reason: error at write: Disconnected sessionId: src_id|6adccd4-24718f66-63b98d3d-91a755fc_0
2025-10-10T14:35:19.471260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:19.471489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1635 sessionId: src_id|6adccd4-24718f66-63b98d3d-91a755fc_0 is DEAD
2025-10-10T14:35:19.471657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6adccd4-24718f66-63b98d3d-91a755fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:19.471669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6adccd4-24718f66-63b98d3d-91a755fc_0] Write session will restart in 0.007200s
2025-10-10T14:35:19.471704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6adccd4-24718f66-63b98d3d-91a755fc_0] Write session: Do CDS request
2025-10-10T14:35:19.471710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6adccd4-24718f66-63b98d3d-91a755fc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:19.479916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6adccd4-24718f66-63b98d3d-91a755fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.480008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:19.480033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1636
2025-10-10T14:35:19.480161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.480205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:19.480214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:19.480218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:19.480685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1636 sessionId:  describe result for acl check
2025-10-10T14:35:19.480717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:19.480724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:19.480727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:19.480733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601656886334990:10070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:19.481254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601656886334990:10070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:19.484332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601656886334990:10070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:19.487727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601656886334990:10070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:19.487741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601656886334990:10070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:19.487745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601656886334990:10070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:19.487754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:19.489096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:19.491408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:19.491653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:19.491664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:19.491676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:19.491742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:19.491790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601656104110318:9417]
2025-10-10T14:35:19.492452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:19.492843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:19.492907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:19.493249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:19.493373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.493381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.493382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.493384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.493385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.493386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.493387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.493388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.493389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.493390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.493391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.493392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.493393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.493400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.493412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.493417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.493420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.493423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.493427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.493430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.493433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.493437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.493441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.493445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.493448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.493452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.493460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.493471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.493477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.493483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.493487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.493492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.493496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.493501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.493507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.493512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.493517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.493521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.493526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.493531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.493535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.493539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.493544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.493549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.493553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.493558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.493562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.493567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.493571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.493592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.493603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.493607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.493645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:19.496665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:19.496963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:19.496974Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:19.496977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:19.496982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:19.496989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1635 [2:7559601656104110318:9417]
2025-10-10T14:35:19.497003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:19.497026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:19.497033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.497037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.497040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.497057Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:19.497073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:19.497081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:19.497151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.497158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.497160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.497162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:19.497229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:19.497237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.497249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.497267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.497291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:19.497317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886334972:2438], now have 1 active actors on pipe
2025-10-10T14:35:19.497326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335181:10070], now have 1 active actors on pipe
2025-10-10T14:35:19.497349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601656104110313:9417]
2025-10-10T14:35:19.497354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601656104110313:9417]
2025-10-10T14:35:19.497356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601656104110313:9417]
2025-10-10T14:35:19.497371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:19.497388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:19.497390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:19.497399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:19.497401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:19.497418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:19.497425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:19.497427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1635
2025-10-10T14:35:19.497453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601656104110313:9417]
2025-10-10T14:35:19.497420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1635
2025-10-10T14:35:19.497460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:19.497471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:19.497477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.497483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.497542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:19.497558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.497562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.497565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:19.497576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.497592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:19.497618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.497822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.497833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.497856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.497958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1636 partition: 0 MaxSeqNo: 40 sessionId: src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0
2025-10-10T14:35:19.498346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6adccd4-24718f66-63b98d3d-91a755fc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:19.500960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0] Write session: try to update token
2025-10-10T14:35:19.500980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:19.516986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId: src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:19.519881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:19.520735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.520763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.520789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:19.520793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:19.520798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:19.520800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:19.520810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601656104110313:9417]
2025-10-10T14:35:19.520814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601656104110313:9417]
2025-10-10T14:35:19.520819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601656104110313:9417]
2025-10-10T14:35:19.520859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:19.520871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:19.520876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:19.520881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:19.520889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.520892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:19.521034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:19.571111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601656886335196:9869]
2025-10-10T14:35:19.571463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1635, pipe: [1:7559601656886335196:9869]
2025-10-10T14:35:19.633799Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:19.634073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:19.634151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335196:9869], now have 1 active actors on pipe
2025-10-10T14:35:19.634242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:19.634358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601656886335196:9869]
2025-10-10T14:35:19.634387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:19.645374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:19.645388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:19.645417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1636 reason: error at write: Disconnected sessionId: src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0
2025-10-10T14:35:19.645592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1636 sessionId: src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0 is DEAD
2025-10-10T14:35:19.645722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:19.645739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0] Write session will restart in 0.005247s
2025-10-10T14:35:19.645766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0] Write session: Do CDS request
2025-10-10T14:35:19.645772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:19.651894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.651940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:19.651956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1637
2025-10-10T14:35:19.652104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.652148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:19.652158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:19.652162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:19.652618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1637 sessionId:  describe result for acl check
2025-10-10T14:35:19.652661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:19.652668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:19.652670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:19.652676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601656886335255:10074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:19.653282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601656886335255:10074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:19.656586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601656886335255:10074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:19.659281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:19.659366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601656886335255:10074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:19.659381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601656886335255:10074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:19.659384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601656886335255:10074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:19.659393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:19.661968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:19.662203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:19.662215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:19.662226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:19.662285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:19.662329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601656104110539:9419]
2025-10-10T14:35:19.662967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:19.663299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:19.663343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:19.663675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:19.663732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.663738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.663739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.663740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.663742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.663743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.663744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.663746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.663747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.663748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.663750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.663751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.663752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.663758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.663772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.663776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.663780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.663784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.663789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.663793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.663796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.663800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.663804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.663809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.663812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.663817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.663825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.663839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.663849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.663855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.663864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.663869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.663878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.663884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.663892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.663897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.663902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.663911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.663916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.663926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.663930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.663936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.663945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.663950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.663959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.663964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.663973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.663978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.663982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.663992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.663997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.664006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.664044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:19.667053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:19.667741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:19.667752Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:19.667755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:19.667759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:19.667766Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1636 [2:7559601656104110539:9419]
2025-10-10T14:35:19.667779Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:19.667797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:19.667804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.667808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.667810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.667829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:19.667842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:19.667850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:19.667910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.667919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.667921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.667923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:19.667993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:19.668000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.668012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.668021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.668037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:19.668062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335416:10074], now have 1 active actors on pipe
2025-10-10T14:35:19.668070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335197:2438], now have 1 active actors on pipe
2025-10-10T14:35:19.668078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601656104110533:9419]
2025-10-10T14:35:19.668080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601656104110533:9419]
2025-10-10T14:35:19.668084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601656104110533:9419]
2025-10-10T14:35:19.668098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:19.668114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:19.668116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:19.668124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:19.668126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:19.668130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:19.668133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:19.668100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1636
2025-10-10T14:35:19.668119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1636
2025-10-10T14:35:19.668179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601656104110533:9419]
2025-10-10T14:35:19.668193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:19.668199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:19.668214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.668220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.668276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efc9ecfd-d539d547-9cc20222-eb474428_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:19.668289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.668293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.668296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:19.668308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.668319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:19.668343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.668527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.668536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.668550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.668650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1637 partition: 0 MaxSeqNo: 40 sessionId: src_id|efc9ecfd-d539d547-9cc20222-eb474428_0
2025-10-10T14:35:19.669043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e032c95b-ddef610e-8d85b74c-b6c3b792_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|efc9ecfd-d539d547-9cc20222-eb474428_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:19.671715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc9ecfd-d539d547-9cc20222-eb474428_0] Write session: try to update token
2025-10-10T14:35:19.671739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc9ecfd-d539d547-9cc20222-eb474428_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:19.686706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId: src_id|efc9ecfd-d539d547-9cc20222-eb474428_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:19.689506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:19.689612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:19.689627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:19.689631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:19.689633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:19.689642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601656104110533:9419]
2025-10-10T14:35:19.689647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601656104110533:9419]
2025-10-10T14:35:19.689651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601656104110533:9419]
2025-10-10T14:35:19.689680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:19.689685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:19.689690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:19.689704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.689719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.689742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:19.689758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.689761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:19.689891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:19.734492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601656886335443:9869]
2025-10-10T14:35:19.734762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1636, pipe: [1:7559601656886335443:9869]
2025-10-10T14:35:19.800886Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:19.801321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335443:9869], now have 1 active actors on pipe
2025-10-10T14:35:19.801548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:19.801623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:19.801624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601656886335443:9869]
2025-10-10T14:35:19.801655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:19.801658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:19.801724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1637 reason: error at write: Disconnected sessionId: src_id|efc9ecfd-d539d547-9cc20222-eb474428_0
2025-10-10T14:35:19.801926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1637 sessionId: src_id|efc9ecfd-d539d547-9cc20222-eb474428_0 is DEAD
2025-10-10T14:35:19.802083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc9ecfd-d539d547-9cc20222-eb474428_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:19.802093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc9ecfd-d539d547-9cc20222-eb474428_0] Write session will restart in 0.008680s
2025-10-10T14:35:19.802117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc9ecfd-d539d547-9cc20222-eb474428_0] Write session: Do CDS request
2025-10-10T14:35:19.802123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc9ecfd-d539d547-9cc20222-eb474428_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:19.811896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efc9ecfd-d539d547-9cc20222-eb474428_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.812014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:19.812030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1638
2025-10-10T14:35:19.812178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.812213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:19.812223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:19.812227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:19.812641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1638 sessionId:  describe result for acl check
2025-10-10T14:35:19.812678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:19.812684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:19.812686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:19.812693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601656886335504:10080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:19.813253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601656886335504:10080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:19.816531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601656886335504:10080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:19.818645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:19.821151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:19.821382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601656886335504:10080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:19.821402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:19.821400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601656886335504:10080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:19.821405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601656886335504:10080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:19.821414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:19.821414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:19.821429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:19.821492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:19.821537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601656104110776:9423]
2025-10-10T14:35:19.822169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:19.822491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:19.822535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:19.822850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:19.822916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.822923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.822924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.822926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.822927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.822928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.822929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.822930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.822931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.822931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.822933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.822934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.822935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.822940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.822954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.822958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.822962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.822966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.822971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.822974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.822978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.822982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.822986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.822990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.822994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.822998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.823007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.823016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.823022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.823028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.823033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.823039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.823044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.823049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.823054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.823059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.823063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.823068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.823073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.823079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.823083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.823096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.823101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.823111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.823116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.823126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.823138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.823143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.823152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.823157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.823166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.823172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.823218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:19.825876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:19.826181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:19.826194Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:19.826197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:19.826201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:19.826207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1637 [2:7559601656104110776:9423]
2025-10-10T14:35:19.826220Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:19.826238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:19.826241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.826244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.826247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.826278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:19.826293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:19.826306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:19.826359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.826370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.826372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.826375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:19.826647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1637
2025-10-10T14:35:19.826645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:19.826652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1637
2025-10-10T14:35:19.826656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.826668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.826679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.826694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:19.826720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335444:2438], now have 1 active actors on pipe
2025-10-10T14:35:19.826725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335658:10080], now have 1 active actors on pipe
2025-10-10T14:35:19.826747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.826753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.826772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601656104110770:9423]
2025-10-10T14:35:19.826774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601656104110770:9423]
2025-10-10T14:35:19.826776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601656104110770:9423]
2025-10-10T14:35:19.826787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:19.826800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:19.826801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:19.826804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:19.826805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:19.826812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:19.826816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:19.826833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:19.826840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.826843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.826845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:19.826855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.826868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:19.826903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601656104110770:9423]
2025-10-10T14:35:19.826915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:19.826922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:19.826927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.827096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.827107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.827124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.827207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1638 partition: 0 MaxSeqNo: 40 sessionId: src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0
2025-10-10T14:35:19.827598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efc9ecfd-d539d547-9cc20222-eb474428_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:19.830385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0] Write session: try to update token
2025-10-10T14:35:19.830406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:19.844544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId: src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:19.847130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:19.847148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:19.847152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:19.847154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:19.847164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601656104110770:9423]
2025-10-10T14:35:19.847169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601656104110770:9423]
2025-10-10T14:35:19.847172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601656104110770:9423]
2025-10-10T14:35:19.847226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:19.847228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:19.847237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.847239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:19.847239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:19.847243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:19.847305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:19.847386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:19.901901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601656886335669:9869]
2025-10-10T14:35:19.902163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1637, pipe: [1:7559601656886335669:9869]
2025-10-10T14:35:19.959180Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:19.959410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.959424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.959467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335669:9869], now have 1 active actors on pipe
2025-10-10T14:35:19.959673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:19.960299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:19.960310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0] Write session will restart in 0.005373s
2025-10-10T14:35:19.959708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601656886335669:9869]
2025-10-10T14:35:19.959747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:19.959784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:19.960346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0] Write session: Do CDS request
2025-10-10T14:35:19.959921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1638 reason: status is not ok: tablet will be restarted right now sessionId: src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0
2025-10-10T14:35:19.960126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1638 sessionId: src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0 is DEAD
2025-10-10T14:35:19.960352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:19.966963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.967010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:19.967026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1639
2025-10-10T14:35:19.967226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:19.967261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:19.967275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:19.967279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:19.967689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1639 sessionId:  describe result for acl check
2025-10-10T14:35:19.967744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:19.967750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:19.967752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:19.967758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601656886335701:10090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:19.968308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601656886335701:10090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:19.970992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601656886335701:10090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:19.975762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601656886335701:10090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:19.975778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601656886335701:10090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:19.975782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601656886335701:10090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:19.975792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:19.980608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:19.983663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:19.983916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:19.983921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:19.983934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:19.983988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:19.984030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601656104111031:9436]
2025-10-10T14:35:19.984651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:19.985006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:19.985055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:19.985677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:19.985760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.985761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.985762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.985763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.985765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.985766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.985767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.985769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.985770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.985771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.985773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.985774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.985775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.985782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.985793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.985797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.985801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.985805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.985808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.985812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.985815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.985819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.985822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.985826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.985829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.985833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.985841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.985849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:19.985856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.985862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:19.985869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.985874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:19.985878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.985884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:19.985889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.985894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:19.985899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.985905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:19.985910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.985916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:19.985920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.985926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:19.985931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.985936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:19.985940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.985946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:19.985952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.985957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.985961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.985967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.985971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.985977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.986017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:19.991872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:19.992205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:19.992218Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:19.992221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:19.992226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:19.992232Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1638 [2:7559601656104111031:9436]
2025-10-10T14:35:19.992246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:19.992270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:19.992280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.992285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.992287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.992306Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:19.992319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:19.992328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:19.992385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.992392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.992394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.992398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:19.992492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:19.992500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:19.992512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:19.992528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:19.992547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:19.992637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1638
2025-10-10T14:35:19.992643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1638
2025-10-10T14:35:19.992575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601656104111026:9436]
2025-10-10T14:35:19.992583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601656104111026:9436]
2025-10-10T14:35:19.992585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601656104111026:9436]
2025-10-10T14:35:19.992597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:19.992608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:19.992611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:19.992612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335827:10090], now have 1 active actors on pipe
2025-10-10T14:35:19.992613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:19.992628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601656886335686:2438], now have 1 active actors on pipe
2025-10-10T14:35:19.992634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:19.992650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:19.992653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:19.992685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601656104111026:9436]
2025-10-10T14:35:19.992693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:19.992707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:19.993009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.993021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.993052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:19.993066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:19.993070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:19.993072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:19.993085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:19.993096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:19.993110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.993237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:19.993246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:19.993260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:19.993377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1639 partition: 0 MaxSeqNo: 40 sessionId: src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0
2025-10-10T14:35:19.994919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|691d9491-ef2bb9a2-e32eea37-f25a1a7a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:19.996694Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:35:19.997615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0] Write session: try to update token
2025-10-10T14:35:19.997631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:20.011893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId: src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:20.014545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:20.014750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.014774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.014818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:20.014894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:20.039954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.039986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.040170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.040234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.040299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.040363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.040703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.040716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.040786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.040854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.040917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.040986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.041037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.041044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.041114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.041179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.041248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.041316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.041643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.041655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.041742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.041824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.041895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.041963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.042011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.042019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.042090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.042154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.042224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.042294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.042343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.042352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.042423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.042502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.042568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.042647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.042698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.042706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.042775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.042838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.042903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.042971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.043014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.043017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.043082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.043146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.043210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.043273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.043318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.043325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.043390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.043454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.043521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.043586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.043632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.043640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.043706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.043766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.043829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.043891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.043934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.043945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.044051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:35:20.044126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.044151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.044155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:35:20.044195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:35:20.044210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:35:20.044213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:35:20.044216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:35:20.044219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:35:20.044649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:35:20.044668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:35:20.044674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:35:20.044678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:35:20.044681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:35:20.044684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:35:20.045649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:35:20.045673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:35:20.045680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:35:20.045683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:35:20.045687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:35:20.045690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:35:20.046151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:35:20.046174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:35:20.046185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:35:20.046189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:35:20.046192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:35:20.055834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:35:20.055875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:35:20.055894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760106920055
2025-10-10T14:35:20.056018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:35:20.056036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:35:20.056044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:35:20.056050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:35:20.056055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:35:20.056062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:35:20.056631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:35:20.056659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:35:20.056666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:35:20.056670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:35:20.056674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:35:20.056677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:35:20.057125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:35:20.057145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:35:20.057152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:35:20.057156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:35:20.057159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:35:20.057164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:35:20.057637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:35:20.057660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:35:20.057665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:35:20.058798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:35:20.058818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:35:20.058824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:35:20.058827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:35:20.058838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760106920058
2025-10-10T14:35:20.059230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:35:20.059251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:35:20.059259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:35:20.059265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:35:20.059268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:35:20.059272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:35:20.059758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:35:20.059779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:35:20.059784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:35:20.059790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:35:20.059799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:35:20.059802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:35:20.060239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:35:20.060257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.060367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760106920060
2025-10-10T14:35:20.060734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601661181303217:9869]
2025-10-10T14:35:20.061028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1638, pipe: [1:7559601661181303217:9869]
2025-10-10T14:35:20.062982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303217:9869], now have 1 active actors on pipe
2025-10-10T14:35:20.063002Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:35:20.063021Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:35:20.063028Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:35:20.063036Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:35:20.063050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:20.063053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:20.063056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:20.063058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:20.063065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601656104111026:9436]
2025-10-10T14:35:20.063069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601656104111026:9436]
2025-10-10T14:35:20.063074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601656104111026:9436]
2025-10-10T14:35:20.063122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:20.063146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:20.063154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:20.069033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:20.069056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.069059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:20.069204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:20.186820Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:20.187166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:20.187180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:20.187192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601656104111026:9436]
2025-10-10T14:35:20.187230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:20.187474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:20.187528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:20.187530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601661181303217:9869]
2025-10-10T14:35:20.187550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:20.187550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:20.187585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1639 reason: error at write: Disconnected sessionId: src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0
2025-10-10T14:35:20.187834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1639 sessionId: src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0 is DEAD
2025-10-10T14:35:20.188005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:20.188020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0] Write session will restart in 0.008584s
2025-10-10T14:35:20.188062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0] Write session: Do CDS request
2025-10-10T14:35:20.188068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:20.191788Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [a7c6961174862fb3] Result# TEvPutResult {Id# [72075186224037892:1638:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-10T14:35:20.191818Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1638:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:35:20.191959Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1638:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:35:20.197909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.198069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:20.198086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1640
2025-10-10T14:35:20.201625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.201682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:20.201696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:20.201701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:20.202287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1640 sessionId:  describe result for acl check
2025-10-10T14:35:20.202328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:20.202337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:20.202339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:20.202345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601661181303327:10097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:20.202951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601661181303327:10097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:20.206124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601661181303327:10097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:20.207720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:20.210384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:20.210662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:20.210677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:20.210691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:20.210753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:20.210806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601660399078563:9440]
2025-10-10T14:35:20.211012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601661181303327:10097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:20.211031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601661181303327:10097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:20.211036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601661181303327:10097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:20.211047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:20.211443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:20.211733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:20.211781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:20.212116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:20.212173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.212178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.212179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.212181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.212182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.212184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.212185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.212186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.212188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.212189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.212190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.212192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.212193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.212199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.212212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.212216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.212220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.212224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.212228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.212232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.212236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.212240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.212244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.212248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.212252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.212256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.212264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.212273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.212281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.212287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.212294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.212299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.212303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.212308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.212313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.212319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.212324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.212330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.212337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.212342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.212346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.212360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.212366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.212371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.212375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.212380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.212385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.212389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.212394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.212398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.212403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.212408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.212448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:20.215160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:20.215811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:20.215828Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:20.215830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:20.215834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:20.215841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1639 [2:7559601660399078563:9440]
2025-10-10T14:35:20.215858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:20.215879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:20.215888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.215893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.215895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.215913Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:20.215925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:20.215933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:20.216000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.216007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.216009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.216012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:20.216083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:20.216091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.216104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.216122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.216144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:20.216170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601660399078558:9440]
2025-10-10T14:35:20.216177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601660399078558:9440]
2025-10-10T14:35:20.216179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601660399078558:9440]
2025-10-10T14:35:20.216197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:20.216217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303436:10097], now have 1 active actors on pipe
2025-10-10T14:35:20.216226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303220:2438], now have 1 active actors on pipe
2025-10-10T14:35:20.216236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:20.216253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:20.216262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:20.216295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601660399078558:9440]
2025-10-10T14:35:20.216304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:20.216338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.216338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:20.216341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:20.216343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:20.216347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.216351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:20.216380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|467dba96-86baa890-72284048-20d59eca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:20.216388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.216392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.216395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:20.216407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.216418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:20.216434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.216923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.216937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.216975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.216283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1639
2025-10-10T14:35:20.216329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1639
2025-10-10T14:35:20.217118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1640 partition: 0 MaxSeqNo: 40 sessionId: src_id|467dba96-86baa890-72284048-20d59eca_0
2025-10-10T14:35:20.217597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c242ae-25063477-2c21fe83-cbdc07c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|467dba96-86baa890-72284048-20d59eca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:20.220428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467dba96-86baa890-72284048-20d59eca_0] Write session: try to update token
2025-10-10T14:35:20.220449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467dba96-86baa890-72284048-20d59eca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:20.239950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:20.239968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:20.239972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:20.239974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:20.239986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601660399078558:9440]
2025-10-10T14:35:20.239990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601660399078558:9440]
2025-10-10T14:35:20.239995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601660399078558:9440]
2025-10-10T14:35:20.240047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:20.240055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.240058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:20.240070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:20.240079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:20.240084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:20.240204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:20.242530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId: src_id|467dba96-86baa890-72284048-20d59eca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:20.245314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:20.287439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601661181303448:9869]
2025-10-10T14:35:20.287743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1639, pipe: [1:7559601661181303448:9869]
2025-10-10T14:35:20.354560Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:20.355082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.355107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.355157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303448:9869], now have 1 active actors on pipe
2025-10-10T14:35:20.355409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:20.355999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467dba96-86baa890-72284048-20d59eca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:20.356011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467dba96-86baa890-72284048-20d59eca_0] Write session will restart in 0.009743s
2025-10-10T14:35:20.356037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467dba96-86baa890-72284048-20d59eca_0] Write session: Do CDS request
2025-10-10T14:35:20.356043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467dba96-86baa890-72284048-20d59eca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:20.355440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601661181303448:9869]
2025-10-10T14:35:20.355478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:20.355567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1640 reason: status is not ok: tablet will be restarted right now sessionId: src_id|467dba96-86baa890-72284048-20d59eca_0
2025-10-10T14:35:20.355686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:20.355829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1640 sessionId: src_id|467dba96-86baa890-72284048-20d59eca_0 is DEAD
2025-10-10T14:35:20.367006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467dba96-86baa890-72284048-20d59eca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.367068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:20.367085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1641
2025-10-10T14:35:20.367288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.367322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:20.367328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:20.367332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:20.367996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1641 sessionId:  describe result for acl check
2025-10-10T14:35:20.368035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:20.368038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:20.368040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:20.368046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601661181303499:10101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:20.368654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601661181303499:10101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:20.371413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601661181303499:10101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:20.376098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:20.378974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:20.379245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:20.379258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:20.379272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:20.379339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:20.379389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601660399078788:9442]
2025-10-10T14:35:20.379396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601661181303499:10101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:20.379413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601661181303499:10101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:20.379417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601661181303499:10101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:20.379426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:20.380009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:20.380305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:20.380365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:20.380696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:20.380755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.380761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.380762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.380763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.380764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.380766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.380767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.380768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.380769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.380771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.380772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.380773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.380774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.380780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.380794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.380798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.380802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.380806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.380810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.380814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.380818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.380822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.380827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.380831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.380834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.380838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.380847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.380855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.380862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.380867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.380870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.380875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.380879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.380884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.380890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.380895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.380899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.380904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.380909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.380914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.380918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.380924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.380929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.380935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.380939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.380944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.380948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.380955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.380959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.380964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.380969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.380974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.381020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:20.383934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:20.384518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:20.384537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:20.384539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:20.384544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:20.384549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1640 [2:7559601660399078788:9442]
2025-10-10T14:35:20.384558Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:20.384574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:20.384576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.384578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.384580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.384594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:20.384605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:20.384613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:20.384663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.384668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.384670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.384672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:20.384725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:20.384731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.384740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.384746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.384756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:20.384777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601660399078783:9442]
2025-10-10T14:35:20.384785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601660399078783:9442]
2025-10-10T14:35:20.384787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601660399078783:9442]
2025-10-10T14:35:20.384795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:20.384808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303667:10101], now have 1 active actors on pipe
2025-10-10T14:35:20.384810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303450:2438], now have 1 active actors on pipe
2025-10-10T14:35:20.384810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:20.384814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:20.384816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:20.384817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:20.384826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:20.384829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:20.384857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601660399078783:9442]
2025-10-10T14:35:20.384863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:20.384870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:20.384903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1640
2025-10-10T14:35:20.384903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1640
2025-10-10T14:35:20.385014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.385026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.385063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:20.385075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.385080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.385083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:20.385098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.385111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:20.385139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.385390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.385404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.385427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.385765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1641 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0
2025-10-10T14:35:20.386194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467dba96-86baa890-72284048-20d59eca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:20.388868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0] Write session: try to update token
2025-10-10T14:35:20.388890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:20.403981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId: src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:20.405562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:20.405582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:20.405586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:20.405588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:20.405597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601660399078783:9442]
2025-10-10T14:35:20.405602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601660399078783:9442]
2025-10-10T14:35:20.405606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601660399078783:9442]
2025-10-10T14:35:20.405662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:20.405664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:20.405676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.405679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:20.405683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:20.405687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:20.405821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:20.406786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:20.455354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601661181303678:9869]
2025-10-10T14:35:20.456019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1640, pipe: [1:7559601661181303678:9869]
2025-10-10T14:35:20.516675Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:20.517088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.517100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.517145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303678:9869], now have 1 active actors on pipe
2025-10-10T14:35:20.517426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:20.517441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:20.517443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:20.517503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601661181303678:9869]
2025-10-10T14:35:20.517568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1641 reason: error at write: Disconnected sessionId: src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0
2025-10-10T14:35:20.517624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:20.517824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1641 sessionId: src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0 is DEAD
2025-10-10T14:35:20.517968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:20.517978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0] Write session will restart in 0.009409s
2025-10-10T14:35:20.518005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0] Write session: Do CDS request
2025-10-10T14:35:20.518014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:20.528987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.529057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:20.529089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1642
2025-10-10T14:35:20.529263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.529310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:20.529321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:20.529325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:20.529829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1642 sessionId:  describe result for acl check
2025-10-10T14:35:20.529868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:20.529875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:20.529878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:20.529885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601661181303743:10105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:20.530484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601661181303743:10105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:20.533736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601661181303743:10105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:20.536336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:20.536374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601661181303743:10105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:20.536386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601661181303743:10105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:20.536390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601661181303743:10105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:20.536402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:20.538998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:20.539537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:20.539556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:20.539581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:20.539687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:20.539760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601660399079015:9444]
2025-10-10T14:35:20.540508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:20.540965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:20.541035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:20.541525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:20.541618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.541620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.541621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.541623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.541624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.541625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.541626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.541628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.541629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.541631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.541632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.541634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.541635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.541645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.541662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.541667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.541671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.541676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.541680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.541684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.541688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.541693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.541697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.541702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.541706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.541710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.541721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.541734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.541766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.541775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.541781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.541788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.541798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.541805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.541811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.541816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.541821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.541827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.541833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.541841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.541846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.541852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.541857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.541863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.541868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.541874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.541879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.541885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.541892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.541899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.541904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.541909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.541949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:20.544630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:20.545218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:20.545223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:20.545226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:20.545230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:20.545236Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1641 [2:7559601660399079015:9444]
2025-10-10T14:35:20.545251Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:20.545273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:20.545277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.545280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.545282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.545325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:20.545350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:20.545358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:20.545438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.545441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.545443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.545446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:20.545529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:20.545532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.545544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.545556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.545573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:20.545595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601660399079009:9444]
2025-10-10T14:35:20.545598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601660399079009:9444]
2025-10-10T14:35:20.545601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601660399079009:9444]
2025-10-10T14:35:20.545616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:20.545631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:20.545647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:20.545650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:20.545660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:20.545668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:20.545670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:20.545678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601660399079009:9444]
2025-10-10T14:35:20.545681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:20.545764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:20.545924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1641
2025-10-10T14:35:20.545954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1641
2025-10-10T14:35:20.545993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303897:10105], now have 1 active actors on pipe
2025-10-10T14:35:20.546003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303680:2438], now have 1 active actors on pipe
2025-10-10T14:35:20.546150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.546159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.546196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48352e24-9e0d32b0-40556df-5078aefb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:20.546218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.546224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.546226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:20.546239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.546254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:20.546278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.546573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.546581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.546599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.546735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1642 partition: 0 MaxSeqNo: 40 sessionId: src_id|48352e24-9e0d32b0-40556df-5078aefb_0
2025-10-10T14:35:20.547130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a045f-2cbfca99-5f8d7c66-3a7da966_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48352e24-9e0d32b0-40556df-5078aefb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:20.549931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48352e24-9e0d32b0-40556df-5078aefb_0] Write session: try to update token
2025-10-10T14:35:20.549948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48352e24-9e0d32b0-40556df-5078aefb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:20.566957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:20.566979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:20.566983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:20.566986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:20.566996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601660399079009:9444]
2025-10-10T14:35:20.567000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601660399079009:9444]
2025-10-10T14:35:20.567004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601660399079009:9444]
2025-10-10T14:35:20.567053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:20.567059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:20.567060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.567063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:20.567088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:20.567093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:20.567205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:20.567925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId: src_id|48352e24-9e0d32b0-40556df-5078aefb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:20.570643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:20.617684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601661181303909:9869]
2025-10-10T14:35:20.618080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1641, pipe: [1:7559601661181303909:9869]
2025-10-10T14:35:20.680892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:20.681258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.681269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.681317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303909:9869], now have 1 active actors on pipe
2025-10-10T14:35:20.682320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48352e24-9e0d32b0-40556df-5078aefb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:20.682332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48352e24-9e0d32b0-40556df-5078aefb_0] Write session will restart in 0.006667s
2025-10-10T14:35:20.682357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48352e24-9e0d32b0-40556df-5078aefb_0] Write session: Do CDS request
2025-10-10T14:35:20.682364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48352e24-9e0d32b0-40556df-5078aefb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:20.682504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:20.681660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601661181303909:9869]
2025-10-10T14:35:20.681660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:20.681666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:20.681697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:20.681742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1642 reason: error at write: Disconnected sessionId: src_id|48352e24-9e0d32b0-40556df-5078aefb_0
2025-10-10T14:35:20.681947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1642 sessionId: src_id|48352e24-9e0d32b0-40556df-5078aefb_0 is DEAD
2025-10-10T14:35:20.689853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48352e24-9e0d32b0-40556df-5078aefb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.693529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:20.693546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1643
2025-10-10T14:35:20.693729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.693759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:20.693766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:20.693770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:20.696901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1643 sessionId:  describe result for acl check
2025-10-10T14:35:20.696935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:20.696937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:20.696942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:20.696949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601661181303938:10111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:20.697541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601661181303938:10111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:20.700730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601661181303938:10111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:20.705686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601661181303938:10111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:20.705703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601661181303938:10111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:20.705707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601661181303938:10111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:20.705716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:20.721744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:20.724453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:20.724698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:20.724708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:20.724720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:20.724780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:20.724821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601660399079254:9447]
2025-10-10T14:35:20.725449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:20.725839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:20.725884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:20.726218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:20.726285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.726287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.726288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.726289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.726291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.726292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.726293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.726295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.726296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.726297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.726298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.726299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.726300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.726307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.726319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.726324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.726328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.726333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.726338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.726342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.726347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.726350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.726355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.726358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.726362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.726365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.726373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.726383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.726390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.726396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.726401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.726407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.726411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.726417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.726424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.726429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.726434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.726450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.726455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.726460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.726465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.726471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.726475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.726481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.726492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.726497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.726503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.726507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.726510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.726515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.726519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.726524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.726560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:20.729239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:20.729725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:20.729738Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:20.729748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:20.729752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:20.729757Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1642 [2:7559601660399079254:9447]
2025-10-10T14:35:20.729768Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:20.729783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:20.729784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.729787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.729789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.729804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:20.729810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:20.729817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:20.729881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.729889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.729890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.729893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:20.729954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:20.729962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.729974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.729984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.730007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:20.730033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601660399079249:9447]
2025-10-10T14:35:20.730040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601660399079249:9447]
2025-10-10T14:35:20.730042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601660399079249:9447]
2025-10-10T14:35:20.730056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:20.730067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:20.730070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:20.730072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:20.730080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303990:10111], now have 1 active actors on pipe
2025-10-10T14:35:20.730083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181303918:2438], now have 1 active actors on pipe
2025-10-10T14:35:20.730089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:20.730104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:20.730111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:20.730139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601660399079249:9447]
2025-10-10T14:35:20.730146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:20.730169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:20.730309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.730322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.730393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:20.730407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.730411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.730413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:20.730426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.730438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:20.730468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.730679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.730688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.730702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.731440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48352e24-9e0d32b0-40556df-5078aefb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:20.730141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1642
2025-10-10T14:35:20.730168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1642
2025-10-10T14:35:20.731014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1643 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0
2025-10-10T14:35:20.734023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0] Write session: try to update token
2025-10-10T14:35:20.734037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:20.751497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId: src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:20.754161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:20.754411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.754435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.754492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:20.754596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:20.756407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:20.756427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:20.756430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:20.756432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:20.756445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601660399079249:9447]
2025-10-10T14:35:20.756449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601660399079249:9447]
2025-10-10T14:35:20.756453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601660399079249:9447]
2025-10-10T14:35:20.756503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:20.756502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:20.756517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.756518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:20.756520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:20.756523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:20.756661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:20.782038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601661181304164:9869]
2025-10-10T14:35:20.782334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1642, pipe: [1:7559601661181304164:9869]
2025-10-10T14:35:20.870069Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:20.878517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.878543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.878732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.878802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.878871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.878946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.878997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.879008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.879084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.879156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.879218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.879292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.879353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.879363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.879449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.879505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.879574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.879644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.880033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.880043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.880114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.880185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.880247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.880316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.880363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.880371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.880447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.880518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.880592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.880656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.880710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.880718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.880789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.880854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.880925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.880991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.881038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.881048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.881116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.881180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.881246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.881314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.881411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.881420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.881489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.881549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.881612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.881677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.881732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.881739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.881811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.881871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.881932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.881998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.882040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.882047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.882114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:20.882179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:20.882241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:20.882306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:20.882351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:20.882359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:20.882429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181304164:9869], now have 1 active actors on pipe
2025-10-10T14:35:20.882743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:20.882757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:20.882794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1643 reason: error at write: Disconnected sessionId: src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0
2025-10-10T14:35:20.882914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:20.882979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601661181304164:9869]
2025-10-10T14:35:20.883024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1643 sessionId: src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0 is DEAD
2025-10-10T14:35:20.883349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:20.883389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:20.883417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0] Write session will restart in 0.007990s
2025-10-10T14:35:20.883446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0] Write session: Do CDS request
2025-10-10T14:35:20.883453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:20.892962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.893023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:20.893052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1644
2025-10-10T14:35:20.893232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:20.893267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:20.893277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:20.893281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:20.893799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1644 sessionId:  describe result for acl check
2025-10-10T14:35:20.893839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:20.893846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:20.893847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:20.893854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601661181304187:10115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:20.894459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601661181304187:10115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:20.900432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601661181304187:10115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:20.904034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601661181304187:10115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:20.904053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601661181304187:10115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:20.904057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601661181304187:10115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:20.904067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:20.904649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:20.907493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:20.907749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:20.907764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:20.907779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:20.907855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:20.907903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601660399079498:9450]
2025-10-10T14:35:20.908530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:20.908953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:20.909021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:20.909370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:20.909458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.909466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.909468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.909469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.909470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.909471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.909473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.909474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.909475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.909477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.909478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.909479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.909480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.909488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.909501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.909505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.909509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.909513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.909517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.909521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.909525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.909529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.909533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.909536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.909540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.909544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.909553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.909561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:20.909568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.909574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:20.909579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.909585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:20.909592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.909597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:20.909602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.909608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:20.909612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.909618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:20.909623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.909629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:20.909632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.909639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:20.909644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.909658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:20.909661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.909667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:20.909671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.909676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.909681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.909686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.909691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.909696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.909742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:20.912592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:20.913143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:20.913157Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:20.913160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:20.913164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:20.913171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1643 [2:7559601660399079498:9450]
2025-10-10T14:35:20.913185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:20.913204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:20.913208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.913212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.913214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.913234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:20.913247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:20.913256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:20.913345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.913354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.913356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.913359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:20.913432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:20.913441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.913454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:20.913469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:20.913488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:20.913518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181304385:10115], now have 1 active actors on pipe
2025-10-10T14:35:20.913524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181304167:2438], now have 1 active actors on pipe
2025-10-10T14:35:20.913539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601660399079493:9450]
2025-10-10T14:35:20.913546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601660399079493:9450]
2025-10-10T14:35:20.913548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601660399079493:9450]
2025-10-10T14:35:20.913563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:20.913583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:20.913590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:20.913594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:20.913596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:20.913606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:20.913588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1643
2025-10-10T14:35:20.913609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:20.913592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1643
2025-10-10T14:35:20.913641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601660399079493:9450]
2025-10-10T14:35:20.913656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:20.913657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:20.913715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.913725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.913758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9988a31e-af01c117-810e4dc8-db6701fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:20.913771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:20.913776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:20.913783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:20.913796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:20.913813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:20.913833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.913984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.913995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.914014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:20.914120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1644 partition: 0 MaxSeqNo: 40 sessionId: src_id|9988a31e-af01c117-810e4dc8-db6701fb_0
2025-10-10T14:35:20.914582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce54728-50f4872-84f73cfa-9ac16bb7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9988a31e-af01c117-810e4dc8-db6701fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:20.917321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9988a31e-af01c117-810e4dc8-db6701fb_0] Write session: try to update token
2025-10-10T14:35:20.917368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9988a31e-af01c117-810e4dc8-db6701fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:20.926455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:20.926485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:20.926500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601660399079493:9450]
2025-10-10T14:35:20.926547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:20.926565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:20.926887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:20.927128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:20.927352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:20.927568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:20.927896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:20.927959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:20.933139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId: src_id|9988a31e-af01c117-810e4dc8-db6701fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:20.935846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:20.936078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:20.936113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:20.936155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:20.936240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:20.944411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:20.944426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:20.944430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:20.944432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:20.944443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601660399079493:9450]
2025-10-10T14:35:20.944446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601660399079493:9450]
2025-10-10T14:35:20.944450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601660399079493:9450]
2025-10-10T14:35:20.944500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:20.944507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:20.944511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:20.944514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:20.944514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:20.944518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:20.944656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:20.983264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601661181304398:9869]
2025-10-10T14:35:20.983557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1643, pipe: [1:7559601661181304398:9869]
2025-10-10T14:35:21.056771Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:21.064495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.064524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.064728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.064804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.064874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.064935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.065599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.065614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.065691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.065758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.065828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.065897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.065945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.065951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.066021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.066087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.066151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.066216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.066266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.066274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.066342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.066412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.066495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.066564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.066609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.066615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.066686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.066753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.066816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.066881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.066929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.066936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.067011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.067073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.067139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.067203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.067252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.067258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.067333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.067397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.067464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.067526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.067573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.067583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.067650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.067711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.067783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.067854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.067900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.067907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.067978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.068042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.068104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.068165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.068211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.068218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.068287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:21.068351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:21.068415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:21.068480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:21.068531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:21.068544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:21.068612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601661181304398:9869], now have 1 active actors on pipe
2025-10-10T14:35:21.068859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:21.068861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601661181304398:9869]
2025-10-10T14:35:21.068891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:21.068893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:21.068926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1644 reason: error at write: Disconnected sessionId: src_id|9988a31e-af01c117-810e4dc8-db6701fb_0
2025-10-10T14:35:21.069141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1644 sessionId: src_id|9988a31e-af01c117-810e4dc8-db6701fb_0 is DEAD
2025-10-10T14:35:21.069189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:21.069278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9988a31e-af01c117-810e4dc8-db6701fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:21.069289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9988a31e-af01c117-810e4dc8-db6701fb_0] Write session will restart in 0.006582s
2025-10-10T14:35:21.069326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9988a31e-af01c117-810e4dc8-db6701fb_0] Write session: Do CDS request
2025-10-10T14:35:21.069343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9988a31e-af01c117-810e4dc8-db6701fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:21.076951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9988a31e-af01c117-810e4dc8-db6701fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.077166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:21.077184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1645
2025-10-10T14:35:21.077348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.077391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:21.077401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:21.077405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:21.077812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1645 sessionId:  describe result for acl check
2025-10-10T14:35:21.077858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:21.077864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:21.077866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:21.077872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601665476271737:10128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:21.078408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601665476271737:10128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:21.081774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601665476271737:10128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:21.085203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601665476271737:10128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:21.085220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601665476271737:10128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:21.085224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601665476271737:10128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:21.085233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:21.091640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:21.095201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:21.095472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:21.095487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:21.095502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:21.095574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:21.095624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601664694047048:9465]
2025-10-10T14:35:21.096248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:21.096600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:21.096654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:21.097001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:21.097054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.097062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.097062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.097063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.097064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.097065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.097066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.097067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.097068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.097069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.097069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.097070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.097071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.097076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.097086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.097088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.097091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.097094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.097096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.097098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.097100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.097102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.097105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.097109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.097113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.097116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.097124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.097134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.097140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.097145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.097150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.097156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.097161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.097167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.097170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.097173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.097177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.097183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.097187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.097192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.097196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.097201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.097205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.097209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.097214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.097220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.097224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.097231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.097233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.097237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.097241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.097246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.097283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:21.102397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:21.102737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:21.102750Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:21.102753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:21.102757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:21.102765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1644 [2:7559601664694047048:9465]
2025-10-10T14:35:21.102780Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:21.102805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:21.102813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.102817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.102819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.102838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:21.102848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:21.102856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:21.102919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.102928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.102931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.102933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:21.103004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:21.103012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.103153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1644
2025-10-10T14:35:21.103159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1644
2025-10-10T14:35:21.103036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.103058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.103075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:21.103098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476271881:10128], now have 1 active actors on pipe
2025-10-10T14:35:21.103101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476271722:2438], now have 1 active actors on pipe
2025-10-10T14:35:21.103109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601664694047043:9465]
2025-10-10T14:35:21.103112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601664694047043:9465]
2025-10-10T14:35:21.103114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601664694047043:9465]
2025-10-10T14:35:21.103128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:21.103151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:21.103168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:21.103168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:21.103171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:21.103172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:21.103173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:21.103207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601664694047043:9465]
2025-10-10T14:35:21.103210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:21.103213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:21.103228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.103233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.103289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a654855-d8b5cb56-2c63969b-30ec771_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:21.103297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.103302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.103305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:21.103316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.103326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:21.103349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.103541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.103566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.103593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.103690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1645 partition: 0 MaxSeqNo: 40 sessionId: src_id|7a654855-d8b5cb56-2c63969b-30ec771_0
2025-10-10T14:35:21.104118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9988a31e-af01c117-810e4dc8-db6701fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7a654855-d8b5cb56-2c63969b-30ec771_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:21.107167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a654855-d8b5cb56-2c63969b-30ec771_0] Write session: try to update token
2025-10-10T14:35:21.107189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a654855-d8b5cb56-2c63969b-30ec771_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:21.122795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:21.122815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:21.122819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:21.122821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:21.122830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601664694047043:9465]
2025-10-10T14:35:21.122835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601664694047043:9465]
2025-10-10T14:35:21.122839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601664694047043:9465]
2025-10-10T14:35:21.122885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:21.122888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:21.122895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:21.122896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.122899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:21.122899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:21.123732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:21.123921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId: src_id|7a654855-d8b5cb56-2c63969b-30ec771_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:21.126762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:21.169128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601665476271952:9869]
2025-10-10T14:35:21.169454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1644, pipe: [1:7559601665476271952:9869]
2025-10-10T14:35:21.235177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:21.235700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.235720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.235767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476271952:9869], now have 1 active actors on pipe
2025-10-10T14:35:21.235988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:21.236326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:21.236423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1645 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a654855-d8b5cb56-2c63969b-30ec771_0
2025-10-10T14:35:21.236615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1645 sessionId: src_id|7a654855-d8b5cb56-2c63969b-30ec771_0 is DEAD
2025-10-10T14:35:21.236773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a654855-d8b5cb56-2c63969b-30ec771_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:21.236784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a654855-d8b5cb56-2c63969b-30ec771_0] Write session will restart in 0.009787s
2025-10-10T14:35:21.236794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:21.236813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a654855-d8b5cb56-2c63969b-30ec771_0] Write session: Do CDS request
2025-10-10T14:35:21.236803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601665476271952:9869]
2025-10-10T14:35:21.236821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a654855-d8b5cb56-2c63969b-30ec771_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:21.247970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a654855-d8b5cb56-2c63969b-30ec771_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.248452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:21.248470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1646
2025-10-10T14:35:21.248611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.248668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:21.248678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:21.248683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:21.249287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1646 sessionId:  describe result for acl check
2025-10-10T14:35:21.249323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:21.249325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:21.249327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:21.249347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601665476272018:10132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:21.249917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601665476272018:10132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:21.254190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601665476272018:10132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:21.255963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:21.258582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:21.258770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601665476272018:10132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:21.258785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601665476272018:10132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:21.258825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:21.258789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601665476272018:10132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:21.258835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:21.258798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:21.258847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:21.258911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:21.258967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601664694047277:9467]
2025-10-10T14:35:21.259567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:21.259901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:21.259948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:21.260274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:21.260331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.260338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.260339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.260340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.260341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.260342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.260344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.260345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.260347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.260348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.260349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.260351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.260352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.260358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.260372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.260376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.260380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.260384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.260388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.260392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.260396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.260400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.260406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.260410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.260415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.260419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.260428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.260437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.260443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.260449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.260454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.260460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.260464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.260469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.260475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.260481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.260485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.260491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.260496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.260501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.260505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.260510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.260516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.260520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.260524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.260529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.260533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.260540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.260544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.260549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.260553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.260558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.260594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:21.263472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:21.263815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:21.263827Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:21.263830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:21.263833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:21.263840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1645 [2:7559601664694047277:9467]
2025-10-10T14:35:21.263854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:21.263875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:21.263885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.263889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.263892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.263909Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:21.263921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:21.263934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:21.264004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.264012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.264014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.264017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:21.264086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:21.264095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.264105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.264115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.264130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:21.264152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601664694047272:9467]
2025-10-10T14:35:21.264155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601664694047272:9467]
2025-10-10T14:35:21.264157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601664694047272:9467]
2025-10-10T14:35:21.264166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:21.264174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:21.264182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476271954:2438], now have 1 active actors on pipe
2025-10-10T14:35:21.264186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:21.264188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:21.264190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272176:10132], now have 1 active actors on pipe
2025-10-10T14:35:21.264196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:21.264211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:21.264220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:21.264250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601664694047272:9467]
2025-10-10T14:35:21.264263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:21.264288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:21.264274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1645
2025-10-10T14:35:21.264278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1645
2025-10-10T14:35:21.264400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.264411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.264441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|436bc271-4941060a-46a7d5b4-19314396_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:21.264449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.264452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.264455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:21.264469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.264480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:21.264495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.264697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.264705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.264721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.264827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1646 partition: 0 MaxSeqNo: 40 sessionId: src_id|436bc271-4941060a-46a7d5b4-19314396_0
2025-10-10T14:35:21.265238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a654855-d8b5cb56-2c63969b-30ec771_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|436bc271-4941060a-46a7d5b4-19314396_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:21.268002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436bc271-4941060a-46a7d5b4-19314396_0] Write session: try to update token
2025-10-10T14:35:21.268022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436bc271-4941060a-46a7d5b4-19314396_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:21.284158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:21.284177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:21.284180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:21.284182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:21.284192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601664694047272:9467]
2025-10-10T14:35:21.284197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601664694047272:9467]
2025-10-10T14:35:21.284201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601664694047272:9467]
2025-10-10T14:35:21.284198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId: src_id|436bc271-4941060a-46a7d5b4-19314396_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:21.284253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:21.284258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:21.284262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.284265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:21.284265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:21.284270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:21.284430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:21.286832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:21.337058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601665476272191:9869]
2025-10-10T14:35:21.337396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1645, pipe: [1:7559601665476272191:9869]
2025-10-10T14:35:21.400653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:21.400923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.400943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.401001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272191:9869], now have 1 active actors on pipe
2025-10-10T14:35:21.401272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:21.401401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:21.401402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601665476272191:9869]
2025-10-10T14:35:21.401495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1646 reason: status is not ok: tablet will be restarted right now sessionId: src_id|436bc271-4941060a-46a7d5b4-19314396_0
2025-10-10T14:35:21.401260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:21.401702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1646 sessionId: src_id|436bc271-4941060a-46a7d5b4-19314396_0 is DEAD
2025-10-10T14:35:21.401859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436bc271-4941060a-46a7d5b4-19314396_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:21.401873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436bc271-4941060a-46a7d5b4-19314396_0] Write session will restart in 0.006285s
2025-10-10T14:35:21.401901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436bc271-4941060a-46a7d5b4-19314396_0] Write session: Do CDS request
2025-10-10T14:35:21.401908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436bc271-4941060a-46a7d5b4-19314396_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:21.409895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436bc271-4941060a-46a7d5b4-19314396_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.409993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:21.410009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1647
2025-10-10T14:35:21.410120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.410173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:21.410184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:21.410187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:21.410618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1647 sessionId:  describe result for acl check
2025-10-10T14:35:21.410651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:21.410657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:21.410659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:21.410666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601665476272216:10138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:21.411231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601665476272216:10138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:21.415154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601665476272216:10138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:21.419568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601665476272216:10138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:21.419584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601665476272216:10138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:21.419587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601665476272216:10138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:21.419596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:21.422780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:21.425483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:21.425755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:21.425765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:21.425777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:21.425834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:21.425875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601664694047509:9469]
2025-10-10T14:35:21.426533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:21.426875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:21.426926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:21.427283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:21.427354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.427360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.427362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.427363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.427364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.427365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.427366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.427367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.427368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.427369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.427370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.427372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.427373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.427379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.427391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.427406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.427411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.427415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.427419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.427423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.427427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.427431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.427435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.427439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.427443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.427447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.427456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.427467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.427479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.427485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.427489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.427493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.427498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.427502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.427507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.427513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.427523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.427529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.427533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.427539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.427543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.427548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.427554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.427559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.427563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.427568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.427573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.427578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.427583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.427588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.427592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.427608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.427647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:21.430066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:21.430517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:21.430529Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:21.430531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:21.430535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:21.430541Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1646 [2:7559601664694047509:9469]
2025-10-10T14:35:21.430555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:21.430573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:21.430577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.430581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.430583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.430601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:21.430608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:21.430623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:21.430683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.430690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.430692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.430694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:21.430761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:21.430768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.430790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.430807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.430828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:21.430855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272383:10138], now have 1 active actors on pipe
2025-10-10T14:35:21.430863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272192:2438], now have 1 active actors on pipe
2025-10-10T14:35:21.430871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601664694047504:9469]
2025-10-10T14:35:21.430874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601664694047504:9469]
2025-10-10T14:35:21.430876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601664694047504:9469]
2025-10-10T14:35:21.430886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:21.430877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1646
2025-10-10T14:35:21.430900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:21.430903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:21.430906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:21.430879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1646
2025-10-10T14:35:21.430907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:21.430921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:21.430925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:21.430966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.430976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.430991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601664694047504:9469]
2025-10-10T14:35:21.430999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:21.431004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:21.431032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3e5720-1402da9-1969b701-5a0e3a75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:21.431044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.431048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.431055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:21.431066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.431076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:21.431371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.431558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.431567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.431584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.431677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1647 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3e5720-1402da9-1969b701-5a0e3a75_0
2025-10-10T14:35:21.432114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436bc271-4941060a-46a7d5b4-19314396_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3e5720-1402da9-1969b701-5a0e3a75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:21.434903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e5720-1402da9-1969b701-5a0e3a75_0] Write session: try to update token
2025-10-10T14:35:21.434923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e5720-1402da9-1969b701-5a0e3a75_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:21.451295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:21.451316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:21.451319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:21.451322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:21.451332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601664694047504:9469]
2025-10-10T14:35:21.451337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601664694047504:9469]
2025-10-10T14:35:21.451341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601664694047504:9469]
2025-10-10T14:35:21.451391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:21.451391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:21.451398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:21.451402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:21.451404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.451407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:21.451542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:21.452667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId: src_id|d3e5720-1402da9-1969b701-5a0e3a75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:21.455437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:21.501447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601665476272427:9869]
2025-10-10T14:35:21.501771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1646, pipe: [1:7559601665476272427:9869]
2025-10-10T14:35:21.563934Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:21.564385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.564395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.564441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272427:9869], now have 1 active actors on pipe
2025-10-10T14:35:21.564767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:21.564721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:21.564736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:21.564798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1647 reason: error at write: Disconnected sessionId: src_id|d3e5720-1402da9-1969b701-5a0e3a75_0
2025-10-10T14:35:21.565025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1647 sessionId: src_id|d3e5720-1402da9-1969b701-5a0e3a75_0 is DEAD
2025-10-10T14:35:21.565086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601665476272427:9869]
2025-10-10T14:35:21.565103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:21.565527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e5720-1402da9-1969b701-5a0e3a75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:21.565537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e5720-1402da9-1969b701-5a0e3a75_0] Write session will restart in 0.007146s
2025-10-10T14:35:21.565556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e5720-1402da9-1969b701-5a0e3a75_0] Write session: Do CDS request
2025-10-10T14:35:21.565564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e5720-1402da9-1969b701-5a0e3a75_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:21.573900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e5720-1402da9-1969b701-5a0e3a75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.574035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:21.574052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1648
2025-10-10T14:35:21.574192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.574239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:21.574249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:21.574253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:21.574720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1648 sessionId:  describe result for acl check
2025-10-10T14:35:21.574756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:21.574763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:21.574766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:21.574772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601665476272455:10142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:21.575308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601665476272455:10142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:21.578390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601665476272455:10142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:21.581893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601665476272455:10142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:21.581909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601665476272455:10142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:21.581913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601665476272455:10142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:21.581922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:21.584169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:21.586683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:21.586933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:21.586943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:21.586956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:21.587021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:21.587074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601664694047741:9471]
2025-10-10T14:35:21.587684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:21.588039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:21.588103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:21.588446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:21.588530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.588537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.588539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.588540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.588542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.588543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.588545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.588546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.588547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.588549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.588550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.588551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.588552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.588558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.588572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.588576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.588580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.588583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.588587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.588591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.588596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.588600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.588605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.588609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.588613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.588617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.588626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.588635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.588642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.588651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.588662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.588668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.588677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.588683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.588690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.588695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.588699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.588706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.588710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.588716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.588720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.588731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.588736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.588742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.588746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.588753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.588757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.588769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.588774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.588780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.588789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.588794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.588836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:21.591485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:21.591803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:21.591820Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:21.591823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:21.591827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:21.591834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1647 [2:7559601664694047741:9471]
2025-10-10T14:35:21.591847Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:21.591871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:21.591879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.591882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.591885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.591902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:21.591915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:21.591927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:21.591988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.592014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.592017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.592020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:21.592089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:21.592093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.592105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.592117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.592134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:21.592155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601664694047736:9471]
2025-10-10T14:35:21.592157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601664694047736:9471]
2025-10-10T14:35:21.592159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601664694047736:9471]
2025-10-10T14:35:21.592177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:21.592195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:21.592212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:21.592216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:21.592242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601664694047736:9471]
2025-10-10T14:35:21.592343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1647
2025-10-10T14:35:21.592244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:21.592345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1647
2025-10-10T14:35:21.592251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:21.592254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:21.592255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272638:10142], now have 1 active actors on pipe
2025-10-10T14:35:21.592257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:21.592259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272428:2438], now have 1 active actors on pipe
2025-10-10T14:35:21.592264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:21.592479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.592493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.592529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:21.592542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.592551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.592554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:21.592568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.592586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:21.592606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.592954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.592966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.592987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.593192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1648 partition: 0 MaxSeqNo: 40 sessionId: src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0
2025-10-10T14:35:21.593612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e5720-1402da9-1969b701-5a0e3a75_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:21.596277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0] Write session: try to update token
2025-10-10T14:35:21.596293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:21.611990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:21.612007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:21.612011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:21.612013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:21.612024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601664694047736:9471]
2025-10-10T14:35:21.612029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601664694047736:9471]
2025-10-10T14:35:21.612034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601664694047736:9471]
2025-10-10T14:35:21.612084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:21.612084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:21.612091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:21.612095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:21.612096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.612099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:21.612239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:21.612277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId: src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:21.615081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:21.665232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601665476272669:9869]
2025-10-10T14:35:21.665650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1647, pipe: [1:7559601665476272669:9869]
2025-10-10T14:35:21.725250Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:21.725999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.726017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.726067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272669:9869], now have 1 active actors on pipe
2025-10-10T14:35:21.726284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:21.726298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:21.726311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:21.726326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601665476272669:9869]
2025-10-10T14:35:21.726346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:21.726390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1648 reason: error at write: Disconnected sessionId: src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0
2025-10-10T14:35:21.726610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1648 sessionId: src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0 is DEAD
2025-10-10T14:35:21.726824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:21.726836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0] Write session will restart in 0.009833s
2025-10-10T14:35:21.726861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0] Write session: Do CDS request
2025-10-10T14:35:21.726867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:21.737918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.738000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:21.738031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1649
2025-10-10T14:35:21.738162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.738212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:21.738223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:21.738226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:21.738747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1649 sessionId:  describe result for acl check
2025-10-10T14:35:21.738788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:21.738795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:21.738797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:21.738804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601665476272766:10148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:21.739361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601665476272766:10148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:21.741771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601665476272766:10148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:21.744473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:21.744756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601665476272766:10148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:21.744771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601665476272766:10148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:21.744775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601665476272766:10148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:21.744785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:21.747433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:21.747696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:21.747708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:21.747721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:21.747781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:21.747836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601664694047986:9474]
2025-10-10T14:35:21.748486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:21.748839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:21.748911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:21.749260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:21.749344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.749352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.749354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.749355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.749356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.749358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.749359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.749360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.749361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.749363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.749364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.749365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.749366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.749374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.749388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.749393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.749397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.749401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.749405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.749409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.749413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.749417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.749422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.749426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.749430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.749434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.749443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.749452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.749459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.749465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.749468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.749474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.749492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.749498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.749504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.749509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.749516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.749522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.749527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.749531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.749537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.749542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.749547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.749552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.749558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.749564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.749569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.749574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.749579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.749584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.749589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.749594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.749646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:21.752239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:21.752932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:21.752945Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:21.752947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:21.752951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:21.752958Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1648 [2:7559601664694047986:9474]
2025-10-10T14:35:21.752971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:21.752989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:21.752992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.752996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.752998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.753016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:21.753025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:21.753033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:21.753099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.753107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.753108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.753112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:21.753178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:21.753186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.753199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.753212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.753231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:21.753257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272910:10148], now have 1 active actors on pipe
2025-10-10T14:35:21.753266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272685:2438], now have 1 active actors on pipe
2025-10-10T14:35:21.753275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601664694047980:9474]
2025-10-10T14:35:21.753277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601664694047980:9474]
2025-10-10T14:35:21.753279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601664694047980:9474]
2025-10-10T14:35:21.753294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:21.753311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:21.753318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1648
2025-10-10T14:35:21.753350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:21.753323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1648
2025-10-10T14:35:21.753354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:21.753358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:21.753359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:21.753360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:21.753402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.753411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.753426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601664694047980:9474]
2025-10-10T14:35:21.753434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:21.753448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:21.753477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:21.753489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.753496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.753498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:21.753509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.753520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:21.753547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.753717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.753726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.753741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.753816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1649 partition: 0 MaxSeqNo: 40 sessionId: src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0
2025-10-10T14:35:21.754223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e26ae9f3-623a25ef-acc4cd0-61f660fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:21.756997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0] Write session: try to update token
2025-10-10T14:35:21.757013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:21.771397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId: src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:21.772819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:21.772839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:21.772842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:21.772844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:21.772855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601664694047980:9474]
2025-10-10T14:35:21.772860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601664694047980:9474]
2025-10-10T14:35:21.772864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601664694047980:9474]
2025-10-10T14:35:21.772916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:21.772919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:21.772924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.772926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:21.772927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:21.772930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:21.773066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:21.774284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:21.826535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601665476272922:9869]
2025-10-10T14:35:21.826865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1648, pipe: [1:7559601665476272922:9869]
2025-10-10T14:35:21.889611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:21.890085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.890101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.890153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272922:9869], now have 1 active actors on pipe
2025-10-10T14:35:21.890401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:21.890436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:21.890476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601665476272922:9869]
2025-10-10T14:35:21.890511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:21.890519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:21.890594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1649 reason: error at write: Disconnected sessionId: src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0
2025-10-10T14:35:21.890829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1649 sessionId: src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0 is DEAD
2025-10-10T14:35:21.891039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:21.891053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0] Write session will restart in 0.008540s
2025-10-10T14:35:21.891098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0] Write session: Do CDS request
2025-10-10T14:35:21.891109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:21.900918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.900977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:21.900994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1650
2025-10-10T14:35:21.901181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:21.901246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:21.901257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:21.901262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:21.901881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1650 sessionId:  describe result for acl check
2025-10-10T14:35:21.901929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:21.901935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:21.901937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:21.901943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601665476272969:10152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:21.902530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601665476272969:10152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:21.905227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601665476272969:10152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:21.908341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601665476272969:10152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:21.908355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601665476272969:10152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:21.908359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601665476272969:10152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:21.908368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:21.909592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:21.912395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:21.912646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:21.912659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:21.912673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:21.912749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:21.912799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601664694048222:9477]
2025-10-10T14:35:21.913394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:21.913704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:21.913747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:21.914157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:21.914217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.914222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.914223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.914224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.914226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.914227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.914228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.914229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.914231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.914232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.914233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.914234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.914235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.914241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.914253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.914257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.914261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.914264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.914267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.914270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.914273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.914276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.914280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.914284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.914287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.914290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.914298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.914305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:21.914311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.914316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:21.914320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.914325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:21.914328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.914332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:21.914336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.914340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:21.914344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.914348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:21.914352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.914356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:21.914362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.914366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:21.914370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.914374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:21.914378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.914383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:21.914388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.914391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.914395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.914399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.914404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.914423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.914460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:21.916872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:21.917465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:21.917479Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:21.917481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:21.917485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:21.917492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1649 [2:7559601664694048222:9477]
2025-10-10T14:35:21.917505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:21.917524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:21.917528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.917531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.917534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.917554Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:21.917567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:21.917578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:21.917661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.917670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.917672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.917675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:21.917744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:21.917755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.917766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:21.917778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:21.917795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:21.917818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476272923:2438], now have 1 active actors on pipe
2025-10-10T14:35:21.917830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476273146:10152], now have 1 active actors on pipe
2025-10-10T14:35:21.917838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601664694048217:9477]
2025-10-10T14:35:21.917841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601664694048217:9477]
2025-10-10T14:35:21.917843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601664694048217:9477]
2025-10-10T14:35:21.917859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:21.917878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:21.917880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:21.917886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:21.917888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:21.917897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:21.917901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:21.917881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1649
2025-10-10T14:35:21.917927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601664694048217:9477]
2025-10-10T14:35:21.917888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1649
2025-10-10T14:35:21.917943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:21.917969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.917979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.918020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:21.918031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:21.918040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:21.918050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:21.918053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:21.918066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:21.918083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:21.918106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.918287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:21.918296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:21.918313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:21.918425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1650 partition: 0 MaxSeqNo: 40 sessionId: src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0
2025-10-10T14:35:21.918895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57af28ab-f5e1b2c5-9789a3aa-ca2210bd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:21.921699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0] Write session: try to update token
2025-10-10T14:35:21.921718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:21.937276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId: src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:21.937356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:21.937379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:21.937382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:21.937385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:21.937395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601664694048217:9477]
2025-10-10T14:35:21.937399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601664694048217:9477]
2025-10-10T14:35:21.937403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601664694048217:9477]
2025-10-10T14:35:21.937457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:21.937474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:21.937481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:21.937620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:21.937761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:21.937779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:21.937783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:21.939994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:21.990872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601665476273161:9869]
2025-10-10T14:35:21.991311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1649, pipe: [1:7559601665476273161:9869]
2025-10-10T14:35:22.055100Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:22.055603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.055620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.055668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601665476273161:9869], now have 1 active actors on pipe
2025-10-10T14:35:22.055939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:22.061088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:22.061690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:22.061143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601665476273161:9869]
2025-10-10T14:35:22.061167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:22.061249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1650 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0
2025-10-10T14:35:22.061492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1650 sessionId: src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0 is DEAD
2025-10-10T14:35:22.061702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0] Write session will restart in 0.009757s
2025-10-10T14:35:22.061774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0] Write session: Do CDS request
2025-10-10T14:35:22.061781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:22.073032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.073252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:22.073267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1651
2025-10-10T14:35:22.077409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.077467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:22.077477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:22.077482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:22.078034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1651 sessionId:  describe result for acl check
2025-10-10T14:35:22.078070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:22.078072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:22.078074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:22.078079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601669771240492:10162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:22.078652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601669771240492:10162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:22.083444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601669771240492:10162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:22.087071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601669771240492:10162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:22.087091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601669771240492:10162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:22.087095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601669771240492:10162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:22.087105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:22.088528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:22.090986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:22.091375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:22.091388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:22.091402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:22.091479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:22.091524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601668989015784:9490]
2025-10-10T14:35:22.092113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:22.092484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:22.092560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:22.092912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:22.092973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.092980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.092981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.092982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.092983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.092985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.092986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.092987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.092989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.092990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.092991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.092992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.092994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.093000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.093013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.093017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.093022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.093026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.093030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.093035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.093039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.093044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.093050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.093054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.093058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.093063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.093071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.093080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.093087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.093093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.093098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.093104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.093110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.093116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.093122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.093128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.093132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.093138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.093143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.093148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.093153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.093159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.093164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.093171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.093174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.093179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.093184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.093190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.093195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.093199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.093203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.093209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.093247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:22.095806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:22.096416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:22.096428Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:22.096431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:22.096435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:22.096442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1650 [2:7559601668989015784:9490]
2025-10-10T14:35:22.096456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:22.096475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:22.096480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.096484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.096486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.096504Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:22.096512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:22.096519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:22.096590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.096600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.096602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.096605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:22.096673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:22.096676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.096688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.096706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.096728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:22.096753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601668989015779:9490]
2025-10-10T14:35:22.096761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601668989015779:9490]
2025-10-10T14:35:22.096763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601668989015779:9490]
2025-10-10T14:35:22.096773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:22.096787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:22.096812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:22.096815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:22.096841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:22.096844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:22.096846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:22.096847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601668989015779:9490]
2025-10-10T14:35:22.096851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:22.096853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:22.096875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771240474:2438], now have 1 active actors on pipe
2025-10-10T14:35:22.096879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771240694:10162], now have 1 active actors on pipe
2025-10-10T14:35:22.096943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1650
2025-10-10T14:35:22.096989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1650
2025-10-10T14:35:22.097166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.097177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.097212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:22.097226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.097230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.097232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:22.097243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.097254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:22.097270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.097523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.097540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.097563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.097664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1651 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0
2025-10-10T14:35:22.098093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e3fea7-6d95f642-be18806e-fd7c0d53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:22.100841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0] Write session: try to update token
2025-10-10T14:35:22.100857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:22.115771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId: src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:22.117572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:22.117592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:22.117596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:22.117598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:22.117607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601668989015779:9490]
2025-10-10T14:35:22.117611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601668989015779:9490]
2025-10-10T14:35:22.117615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601668989015779:9490]
2025-10-10T14:35:22.117672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:22.117679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.117689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:22.117827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:22.118571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:22.118717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:22.118731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:22.118736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:22.161392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601669771240720:9869]
2025-10-10T14:35:22.161775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1650, pipe: [1:7559601669771240720:9869]
2025-10-10T14:35:22.236115Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:22.236416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.236431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.236478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771240720:9869], now have 1 active actors on pipe
2025-10-10T14:35:22.236708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:22.236752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601669771240720:9869]
2025-10-10T14:35:22.236757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:22.236784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:22.236787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:22.236858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1651 reason: error at write: Disconnected sessionId: src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0
2025-10-10T14:35:22.237207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:22.237219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0] Write session will restart in 0.005914s
2025-10-10T14:35:22.237051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1651 sessionId: src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0 is DEAD
2025-10-10T14:35:22.237244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0] Write session: Do CDS request
2025-10-10T14:35:22.237253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:22.244928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.244998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:22.245013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1652
2025-10-10T14:35:22.245140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.245174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:22.245183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:22.245187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:22.245689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1652 sessionId:  describe result for acl check
2025-10-10T14:35:22.245727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:22.245730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:22.245731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:22.245738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601669771240736:10169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:22.246330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601669771240736:10169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:22.249432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601669771240736:10169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:22.253610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601669771240736:10169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:22.253629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601669771240736:10169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:22.253633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601669771240736:10169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:22.253643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:22.256099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:22.259000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:22.259228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:22.259240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:22.259253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:22.259313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:22.259358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601668989016027:9494]
2025-10-10T14:35:22.259998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:22.260294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:22.260338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:22.260683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:22.260743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.260749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.260751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.260752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.260753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.260755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.260756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.260757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.260759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.260760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.260761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.260762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.260764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.260770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.260783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.260787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.260792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.260796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.260800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.260805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.260809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.260813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.260818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.260822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.260827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.260831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.260840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.260853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.260864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.260870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.260879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.260885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.260894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.260898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.260902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.260906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.260910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.260915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.260920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.260926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.260930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.260938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.260943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.260949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.260953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.260965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.260970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.260979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.260984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.260990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.260997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.261003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.261048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:22.263495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:22.263806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:22.263820Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:22.263822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:22.263826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:22.263832Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1651 [2:7559601668989016027:9494]
2025-10-10T14:35:22.263845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:22.263865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:22.263868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.263872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.263875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.263891Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:22.263900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:22.263908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:22.263961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.263970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.263972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.263975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:22.264042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:22.264050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.264062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.264079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.264102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:22.264128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771240926:10169], now have 1 active actors on pipe
2025-10-10T14:35:22.264136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771240721:2438], now have 1 active actors on pipe
2025-10-10T14:35:22.264145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601668989016022:9494]
2025-10-10T14:35:22.264156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601668989016022:9494]
2025-10-10T14:35:22.264158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601668989016022:9494]
2025-10-10T14:35:22.264169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:22.264152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1651
2025-10-10T14:35:22.264157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1651
2025-10-10T14:35:22.264184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:22.264188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:22.264192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:22.264194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:22.264206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:22.264209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:22.264466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.264479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.264518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601668989016022:9494]
2025-10-10T14:35:22.264532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:22.264542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:22.264558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:22.264571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.264575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.264578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:22.264590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.264606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:22.264647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.264860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.264868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.264883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.264971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1652 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0
2025-10-10T14:35:22.265376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a038d-a55b0842-6b58a870-f2f1ba6a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:22.268249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0] Write session: try to update token
2025-10-10T14:35:22.268267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:22.284363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId: src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:22.285054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:22.285076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:22.285080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:22.285082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:22.285092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601668989016022:9494]
2025-10-10T14:35:22.285097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601668989016022:9494]
2025-10-10T14:35:22.285100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601668989016022:9494]
2025-10-10T14:35:22.285155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:22.285168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.285170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:22.285283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:22.285298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:22.285303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:22.285318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:22.287126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:22.336946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601669771240962:9869]
2025-10-10T14:35:22.337553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1651, pipe: [1:7559601669771240962:9869]
2025-10-10T14:35:22.401760Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:22.402255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.402272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.402319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771240962:9869], now have 1 active actors on pipe
2025-10-10T14:35:22.402656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:22.402739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:22.402844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1652 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0
2025-10-10T14:35:22.402975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601669771240962:9869]
2025-10-10T14:35:22.403012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:22.403055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1652 sessionId: src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0 is DEAD
2025-10-10T14:35:22.403415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:22.403425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0] Write session will restart in 0.006132s
2025-10-10T14:35:22.403450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0] Write session: Do CDS request
2025-10-10T14:35:22.403456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:22.410898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.411219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:22.411235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1653
2025-10-10T14:35:22.411376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.411417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:22.411433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:22.411437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:22.411867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1653 sessionId:  describe result for acl check
2025-10-10T14:35:22.411902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:22.411911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:22.411912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:22.411918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601669771240978:10173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:22.412497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601669771240978:10173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:22.415292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601669771240978:10173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:22.419869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601669771240978:10173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:22.419889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601669771240978:10173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:22.419893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601669771240978:10173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:22.419903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:22.427094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:22.430462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:22.430769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:22.430783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:22.430797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:22.430870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:22.430909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601668989016264:9496]
2025-10-10T14:35:22.431540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:22.431892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:22.431940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:22.432325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:22.432398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.432400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.432401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.432402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.432404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.432405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.432406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.432407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.432408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.432409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.432410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.432412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.432413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.432419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.432433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.432437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.432441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.432446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.432450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.432454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.432459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.432463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.432468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.432472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.432476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.432480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.432490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.432499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.432506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.432512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.432516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.432523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.432528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.432533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.432538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.432544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.432549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.432554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.432560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.432565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.432570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.432575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.432580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.432585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.432590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.432595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.432601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.432606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.432611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.432617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.432622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.432628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.432670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:22.435362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:22.436090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1652
2025-10-10T14:35:22.436146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1652
2025-10-10T14:35:22.435708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:22.435724Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:22.435726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:22.435730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:22.435737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1652 [2:7559601668989016264:9496]
2025-10-10T14:35:22.435753Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:22.435774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:22.435777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.435781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.435783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.435805Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:22.435813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:22.435821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:22.435881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.435883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.435886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.435888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:22.435964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:22.435968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.435981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.435992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.436008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:22.436031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771240963:2438], now have 1 active actors on pipe
2025-10-10T14:35:22.436035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241099:10173], now have 1 active actors on pipe
2025-10-10T14:35:22.436043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601668989016259:9496]
2025-10-10T14:35:22.436045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601668989016259:9496]
2025-10-10T14:35:22.436047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601668989016259:9496]
2025-10-10T14:35:22.436062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:22.436076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:22.436076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:22.436079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:22.436081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:22.436094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:22.436098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:22.436130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601668989016259:9496]
2025-10-10T14:35:22.436138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:22.436140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:22.436180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.436185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.436213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:22.436221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.436226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.436228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:22.436241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.436254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:22.436272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.436425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.436429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.436447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.436556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1653 partition: 0 MaxSeqNo: 40 sessionId: src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0
2025-10-10T14:35:22.436952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9f0c73c-6e381944-337e611b-19f6bccb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:22.439590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0] Write session: try to update token
2025-10-10T14:35:22.439608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:22.451169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:22.451188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:22.451200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601668989016259:9496]
2025-10-10T14:35:22.451249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:22.451254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:22.451447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:22.451594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:22.451732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:22.451884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:22.452080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:22.452119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:22.467306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId: src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:22.470108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:22.470517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.470550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.470593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:22.470859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:22.477492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:22.477515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:22.477518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:22.477520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:22.477532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601668989016259:9496]
2025-10-10T14:35:22.477536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601668989016259:9496]
2025-10-10T14:35:22.477541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601668989016259:9496]
2025-10-10T14:35:22.477595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:22.477602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.477605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:22.477745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:22.480020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:22.480038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:22.480043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:22.503385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601669771241203:9869]
2025-10-10T14:35:22.503723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1652, pipe: [1:7559601669771241203:9869]
2025-10-10T14:35:22.592659Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:22.600653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.600684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.600862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.600925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.600986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.601051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.601096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.601106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.601174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.601239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.601297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.601377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.601421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.601432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.601498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.601559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.601619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.601682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.601724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.601733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.601802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.602228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.602296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.602355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.602406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.602418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.602490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.602551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.602610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.602669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.602713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.602723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.602789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.602848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.602909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.602972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.603013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.603019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.603083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.603140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.603208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.603270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.603319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.603325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.603389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.603450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.603510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.603576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.603618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.603626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.603692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.603755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.603815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.603877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.603919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.603926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.603993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:22.604052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:22.604116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:22.604179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:22.604223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:22.604227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:22.604297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241203:9869], now have 1 active actors on pipe
2025-10-10T14:35:22.604577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601669771241203:9869]
2025-10-10T14:35:22.604582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:22.604622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:22.604625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:22.604675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1653 reason: error at write: Disconnected sessionId: src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0
2025-10-10T14:35:22.604884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1653 sessionId: src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0 is DEAD
2025-10-10T14:35:22.605033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:22.605044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0] Write session will restart in 0.005198s
2025-10-10T14:35:22.605070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0] Write session: Do CDS request
2025-10-10T14:35:22.605040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:22.605077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:22.611892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.611970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:22.611987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1654
2025-10-10T14:35:22.612124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.612174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:22.612183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:22.612187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:22.612663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1654 sessionId:  describe result for acl check
2025-10-10T14:35:22.612706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:22.612714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:22.612716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:22.612722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601669771241220:10177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:22.613299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601669771241220:10177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:22.616425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601669771241220:10177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:22.619956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601669771241220:10177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:22.619972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601669771241220:10177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:22.619975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601669771241220:10177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:22.619984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:22.624901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:22.627955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:22.628204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:22.628218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:22.628232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:22.628292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:22.628349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601668989016502:9498]
2025-10-10T14:35:22.628941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:22.629359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:22.629407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:22.629738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:22.629799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.629805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.629807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.629808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.629809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.629811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.629812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.629813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.629814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.629816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.629817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.629818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.629820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.629826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.629840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.629844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.629848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.629852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.629856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.629860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.629864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.629868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.629873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.629876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.629880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.629884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.629892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.629901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.629907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.629912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.629917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.629922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.629926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.629932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.629937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.629948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.629952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.629961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.629966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.629975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.629979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.629985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.629990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.629996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.630000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.630005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.630014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.630021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.630030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.630035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.630041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.630050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.630094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:22.632682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:22.633193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:22.633212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:22.633214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:22.633218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:22.633226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1653 [2:7559601668989016502:9498]
2025-10-10T14:35:22.633240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:22.633260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:22.633263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.633266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.633269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.633288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:22.633300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:22.633307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:22.633387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.633395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.633398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.633401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:22.633483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:22.633490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.633503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.633520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.633543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:22.633569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241205:2438], now have 1 active actors on pipe
2025-10-10T14:35:22.633577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241360:10177], now have 1 active actors on pipe
2025-10-10T14:35:22.633585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601668989016497:9498]
2025-10-10T14:35:22.633591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601668989016497:9498]
2025-10-10T14:35:22.633593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601668989016497:9498]
2025-10-10T14:35:22.633609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:22.633629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:22.633634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:22.633649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:22.633649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:22.633653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:22.633638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1653
2025-10-10T14:35:22.633658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:22.633680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601668989016497:9498]
2025-10-10T14:35:22.633684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:22.633690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:22.633699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.633690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1653
2025-10-10T14:35:22.633704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.633765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:22.633778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.633785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.633788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:22.633800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.633821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:22.633841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.633985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.633994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.634010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.634094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1654 partition: 0 MaxSeqNo: 40 sessionId: src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0
2025-10-10T14:35:22.634495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cf514b-9f341a3d-df49d6de-4ff578e6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:22.637231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0] Write session: try to update token
2025-10-10T14:35:22.637248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:22.651810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId: src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:22.653860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:22.653886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:22.653890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:22.653892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:22.653903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601668989016497:9498]
2025-10-10T14:35:22.653908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601668989016497:9498]
2025-10-10T14:35:22.653913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601668989016497:9498]
2025-10-10T14:35:22.653963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:22.653968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:22.653977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:22.653978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.653981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:22.653981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:22.654127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:22.654633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:22.704599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601669771241466:9869]
2025-10-10T14:35:22.704893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1653, pipe: [1:7559601669771241466:9869]
2025-10-10T14:35:22.770608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:22.771054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.771075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.771124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241466:9869], now have 1 active actors on pipe
2025-10-10T14:35:22.771369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:22.771352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:22.771362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601669771241466:9869]
2025-10-10T14:35:22.771398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:22.771402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:22.771801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:22.771813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0] Write session will restart in 0.007183s
2025-10-10T14:35:22.771832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0] Write session: Do CDS request
2025-10-10T14:35:22.771836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:22.771481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1654 reason: error at write: Disconnected sessionId: src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0
2025-10-10T14:35:22.771685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1654 sessionId: src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0 is DEAD
2025-10-10T14:35:22.779973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.780007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:22.780023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1655
2025-10-10T14:35:22.780254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.780304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:22.780315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:22.780319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:22.780838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1655 sessionId:  describe result for acl check
2025-10-10T14:35:22.780877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:22.780885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:22.780887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:22.780894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601669771241494:10183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:22.781514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601669771241494:10183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:22.784601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601669771241494:10183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:22.788214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601669771241494:10183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:22.788230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601669771241494:10183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:22.788233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601669771241494:10183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:22.788243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:22.791648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:22.794256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:22.794494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:22.794506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:22.794520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:22.794577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:22.794620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601668989016756:9501]
2025-10-10T14:35:22.795211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:22.795519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:22.795562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:22.795869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:22.795933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.795939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.795940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.795941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.795942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.795944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.795945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.795946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.795947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.795949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.795950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.795951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.795952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.795958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.795970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.795974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.795978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.795982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.795986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.795989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.795993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.795997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.796001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.796005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.796008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.796012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.796020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.796029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.796036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.796048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.796057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.796063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.796072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.796077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.796082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.796087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.796091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.796096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.796101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.796107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.796111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.796115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.796125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.796129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.796137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.796141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.796146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.796154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.796158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.796162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.796172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.796177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.796212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:22.798788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:22.799131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:22.799143Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:22.799146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:22.799150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:22.799156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1654 [2:7559601668989016756:9501]
2025-10-10T14:35:22.799171Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:22.799191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:22.799194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.799197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.799200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.799216Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:22.799230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:22.799244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:22.799311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.799318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.799319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.799322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:22.799392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:22.799401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.799411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.799421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.799446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:22.799468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241470:2438], now have 1 active actors on pipe
2025-10-10T14:35:22.799476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241642:10183], now have 1 active actors on pipe
2025-10-10T14:35:22.799483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601668989016750:9501]
2025-10-10T14:35:22.799486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601668989016750:9501]
2025-10-10T14:35:22.799488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601668989016750:9501]
2025-10-10T14:35:22.799504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:22.799519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:22.799520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:22.799496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1654
2025-10-10T14:35:22.799523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:22.799496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1654
2025-10-10T14:35:22.799525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:22.799534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:22.799537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:22.799576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.799585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.799604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601668989016750:9501]
2025-10-10T14:35:22.799616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:22.799621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:22.799644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:22.799652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.799657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.799659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:22.799670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.799686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:22.799712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.799919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.799933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.799957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.800095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1655 partition: 0 MaxSeqNo: 40 sessionId: src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0
2025-10-10T14:35:22.800484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e89bee7f-b2747a8b-306d574c-35b1b849_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:22.803168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0] Write session: try to update token
2025-10-10T14:35:22.803187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:22.817669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId: src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:22.819062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:22.819078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:22.819080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:22.819081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:22.819088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601668989016750:9501]
2025-10-10T14:35:22.819092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601668989016750:9501]
2025-10-10T14:35:22.819094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601668989016750:9501]
2025-10-10T14:35:22.819142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:22.819144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:22.819149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.819150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:22.819150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:22.819155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:22.819282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:22.820404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:22.871504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601669771241722:9869]
2025-10-10T14:35:22.871815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1654, pipe: [1:7559601669771241722:9869]
2025-10-10T14:35:22.929832Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:22.930436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.930453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.930502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241722:9869], now have 1 active actors on pipe
2025-10-10T14:35:22.930711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:22.930740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:22.930741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601669771241722:9869]
2025-10-10T14:35:22.930769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:22.930772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:22.930841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1655 reason: error at write: Disconnected sessionId: src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0
2025-10-10T14:35:22.931079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1655 sessionId: src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0 is DEAD
2025-10-10T14:35:22.933532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:22.933544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0] Write session will restart in 0.005786s
2025-10-10T14:35:22.933570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0] Write session: Do CDS request
2025-10-10T14:35:22.933578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:22.940977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.941094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:22.941112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1656
2025-10-10T14:35:22.941238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:22.941270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:22.941276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:22.941281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:22.941901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1656 sessionId:  describe result for acl check
2025-10-10T14:35:22.941942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:22.941948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:22.941950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:22.941969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601669771241774:10187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:22.942622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601669771241774:10187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:22.946590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601669771241774:10187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:22.950182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601669771241774:10187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:22.950200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601669771241774:10187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:22.950204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601669771241774:10187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:22.950214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:22.951098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:22.954051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:22.954421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:22.954427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:22.954443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:22.954517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:22.954574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601668989016996:9504]
2025-10-10T14:35:22.955145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:22.955539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:22.955589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:22.955916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:22.955980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.955982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.955983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.955984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.955986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.955987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.955988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.955990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.955991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.955992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.955994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.955995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.955996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.956002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.956015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.956019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.956023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.956026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.956030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.956034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.956037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.956041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.956045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.956049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.956052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.956055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.956064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.956073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:22.956081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.956086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:22.956091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.956096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:22.956102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.956107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:22.956112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.956117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:22.956121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.956126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:22.956130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.956134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:22.956139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.956144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:22.956148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.956153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:22.956157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.956161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:22.956165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.956170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.956174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.956178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.956183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.956188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.956223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:22.959287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:22.959610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:22.959615Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:22.959617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:22.959621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:22.959627Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1655 [2:7559601668989016996:9504]
2025-10-10T14:35:22.959640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:22.959658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:22.959662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.959665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.959667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.959685Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:22.959693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:22.959701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:22.959779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.959781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.959783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.959786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:22.959858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:22.959860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.960047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1655
2025-10-10T14:35:22.960103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1655
2025-10-10T14:35:22.959871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:22.959885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:22.959901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:22.959923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241723:2438], now have 1 active actors on pipe
2025-10-10T14:35:22.959933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601668989016990:9504]
2025-10-10T14:35:22.959936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601668989016990:9504]
2025-10-10T14:35:22.959938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601668989016990:9504]
2025-10-10T14:35:22.959947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:22.959961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:22.959961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:22.959965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:22.959966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:22.959975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:22.959978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:22.960002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601669771241953:10187], now have 1 active actors on pipe
2025-10-10T14:35:22.960005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601668989016990:9504]
2025-10-10T14:35:22.960013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:22.960014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:22.960265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.960279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.960310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:22.960324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:22.960329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:22.960331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:22.960355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:22.960371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:22.960393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.960661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:22.960672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:22.960691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:22.960801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1656 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0
2025-10-10T14:35:22.961201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d66ce65-bd48a08b-b3d5dc4c-f7a156df_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:22.964087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0] Write session: try to update token
2025-10-10T14:35:22.964109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:22.980024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:22.980045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:22.980049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:22.980051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:22.980062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601668989016990:9504]
2025-10-10T14:35:22.980066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601668989016990:9504]
2025-10-10T14:35:22.980070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601668989016990:9504]
2025-10-10T14:35:22.980122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:22.980123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:22.980134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:22.980136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:22.980141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:22.980145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:22.980267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:22.980490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId: src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:22.983184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:23.030732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601674066209263:9869]
2025-10-10T14:35:23.031127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1655, pipe: [1:7559601674066209263:9869]
2025-10-10T14:35:23.101201Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:23.101708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.101725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.101771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066209263:9869], now have 1 active actors on pipe
2025-10-10T14:35:23.102015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:23.102038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601674066209263:9869]
2025-10-10T14:35:23.102048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:23.102053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:23.102072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:23.102123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1656 reason: error at write: Disconnected sessionId: src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0
2025-10-10T14:35:23.102359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1656 sessionId: src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0 is DEAD
2025-10-10T14:35:23.102536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:23.102545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0] Write session will restart in 0.005011s
2025-10-10T14:35:23.102569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0] Write session: Do CDS request
2025-10-10T14:35:23.102579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:23.108948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.109015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:23.109035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1657
2025-10-10T14:35:23.109227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.109276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:23.109292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:23.109296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:23.109806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1657 sessionId:  describe result for acl check
2025-10-10T14:35:23.109847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:23.109849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:23.109851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:23.109861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601674066209279:10191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:23.110435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601674066209279:10191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:23.114343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601674066209279:10191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:23.118410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601674066209279:10191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:23.118444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601674066209279:10191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:23.118449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601674066209279:10191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:23.118459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:23.124825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:23.128069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:23.128342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:23.128354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:23.128366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:23.128421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:23.128460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601673283984564:9517]
2025-10-10T14:35:23.129135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:23.129665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:23.129718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:23.130061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:23.130119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.130125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.130127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.130128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.130130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.130131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.130133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.130134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.130136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.130137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.130138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.130140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.130141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.130148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.130161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.130166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.130171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.130175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.130180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.130184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.130188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.130193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.130198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.130203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.130208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.130213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.130221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.130230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.130246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.130253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.130257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.130264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.130269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.130274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.130280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.130285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.130290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.130296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.130301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.130307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.130311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.130317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.130322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.130328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.130333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.130339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.130344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.130349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.130354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.130360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.130367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.130383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.130425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:23.133407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:23.133785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:23.133798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:23.133800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:23.133805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:23.133811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1656 [2:7559601673283984564:9517]
2025-10-10T14:35:23.133825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:23.134268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1656
2025-10-10T14:35:23.134305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1656
2025-10-10T14:35:23.133844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:23.133858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.133863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.133865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.133883Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:23.133892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:23.133901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:23.133963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.133965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.133969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.133972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:23.134314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:23.134317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.134330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.134346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.134367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:23.134403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066209417:10191], now have 1 active actors on pipe
2025-10-10T14:35:23.134407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066209264:2438], now have 1 active actors on pipe
2025-10-10T14:35:23.134416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601673283984559:9517]
2025-10-10T14:35:23.134419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601673283984559:9517]
2025-10-10T14:35:23.134421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601673283984559:9517]
2025-10-10T14:35:23.134441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:23.134457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:23.134470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:23.134473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:23.134476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:23.134476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:23.134480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:23.134512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601673283984559:9517]
2025-10-10T14:35:23.134519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:23.134539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.134541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:23.134544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.134604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:23.134613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.134617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.134620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:23.134631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.134643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:23.134665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.138236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.138253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.138297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.138567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1657 partition: 0 MaxSeqNo: 40 sessionId: src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0
2025-10-10T14:35:23.140221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a759c86-ed0c2360-8b84e27d-beb85bda_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:23.143040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0] Write session: try to update token
2025-10-10T14:35:23.143060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:23.158964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:23.158986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:23.158990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:23.158992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:23.159003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601673283984559:9517]
2025-10-10T14:35:23.159007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601673283984559:9517]
2025-10-10T14:35:23.159012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601673283984559:9517]
2025-10-10T14:35:23.159067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:23.159070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:23.159078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.159081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:23.159091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:23.159095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:23.159223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:23.165745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId: src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:23.168537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:23.202260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601674066209534:9869]
2025-10-10T14:35:23.202628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1656, pipe: [1:7559601674066209534:9869]
2025-10-10T14:35:23.273571Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:23.274060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.274078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.274102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066209534:9869], now have 1 active actors on pipe
2025-10-10T14:35:23.274332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:23.274326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:23.274332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:23.274340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:23.274392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601674066209534:9869]
2025-10-10T14:35:23.274438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1657 reason: error at write: Disconnected sessionId: src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0
2025-10-10T14:35:23.274661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1657 sessionId: src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0 is DEAD
2025-10-10T14:35:23.274850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:23.274860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0] Write session will restart in 0.009484s
2025-10-10T14:35:23.274884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0] Write session: Do CDS request
2025-10-10T14:35:23.274891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:23.285938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.285999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:23.286016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1658
2025-10-10T14:35:23.286188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.286245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:23.286257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:23.286261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:23.286893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1658 sessionId:  describe result for acl check
2025-10-10T14:35:23.286933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:23.286935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:23.286937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:23.286943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601674066209603:10204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:23.287508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601674066209603:10204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:23.290498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601674066209603:10204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:23.293578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601674066209603:10204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:23.293592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601674066209603:10204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:23.293596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601674066209603:10204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:23.293605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:23.293682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:23.296675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:23.296928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:23.296939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:23.296952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:23.297023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:23.297069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601673283984813:9521]
2025-10-10T14:35:23.297731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:23.298090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:23.298142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:23.298494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:23.298568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.298575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.298576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.298577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.298578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.298580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.298581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.298582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.298583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.298584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.298585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.298587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.298588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.298594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.298607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.298611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.298615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.298619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.298623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.298626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.298630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.298634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.298638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.298642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.298646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.298650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.298658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.298669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.298676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.298682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.298686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.298692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.298696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.298701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.298705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.298710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.298715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.298720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.298725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.298732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.298742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.298749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.298753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.298763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.298767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.298776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.298781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.298786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.298795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.298800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.298805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.298810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.298850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:23.301479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:23.301820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:23.301832Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:23.301836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:23.301840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:23.301847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1657 [2:7559601673283984813:9521]
2025-10-10T14:35:23.301860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:23.301882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:23.301890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.301894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.301896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.301914Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:23.301928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:23.301936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:23.302021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.302035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.302038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.302040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:23.302134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:23.302142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.302154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.302169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.302187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:23.302217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066209769:10204], now have 1 active actors on pipe
2025-10-10T14:35:23.302220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066209535:2438], now have 1 active actors on pipe
2025-10-10T14:35:23.302228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601673283984807:9521]
2025-10-10T14:35:23.302230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601673283984807:9521]
2025-10-10T14:35:23.302232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601673283984807:9521]
2025-10-10T14:35:23.302246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:23.302235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1657
2025-10-10T14:35:23.302249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1657
2025-10-10T14:35:23.302262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:23.302262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:23.302266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:23.302281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:23.302283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:23.302286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:23.302334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.302344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.302360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601673283984807:9521]
2025-10-10T14:35:23.302384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:23.302396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:23.302422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:23.302435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.302438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.302441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:23.302453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.302469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:23.302498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.302663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.302676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.302700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.302784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1658 partition: 0 MaxSeqNo: 40 sessionId: src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0
2025-10-10T14:35:23.303212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|268f5dc3-2dd85e3a-bbabaafb-91aeb871_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:23.306042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0] Write session: try to update token
2025-10-10T14:35:23.306061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:23.320428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId: src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:23.322314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:23.322335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:23.322339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:23.322341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:23.322351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601673283984807:9521]
2025-10-10T14:35:23.322355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601673283984807:9521]
2025-10-10T14:35:23.322359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601673283984807:9521]
2025-10-10T14:35:23.322439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:23.322450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:23.322453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.322455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:23.322457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:23.322461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:23.322603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:23.323547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:23.374298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601674066209782:9869]
2025-10-10T14:35:23.374592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1657, pipe: [1:7559601674066209782:9869]
2025-10-10T14:35:23.437261Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:23.437588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.437612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.437667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066209782:9869], now have 1 active actors on pipe
2025-10-10T14:35:23.438037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:23.438108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:23.438126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:23.438160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:23.438203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1658 reason: error at write: Disconnected sessionId: src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0
2025-10-10T14:35:23.438209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601674066209782:9869]
2025-10-10T14:35:23.438463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1658 sessionId: src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0 is DEAD
2025-10-10T14:35:23.438625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:23.438635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0] Write session will restart in 0.009613s
2025-10-10T14:35:23.438662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0] Write session: Do CDS request
2025-10-10T14:35:23.438672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:23.453717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.454066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:23.454085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1659
2025-10-10T14:35:23.454200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.454233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:23.454253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:23.454261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:23.454767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1659 sessionId:  describe result for acl check
2025-10-10T14:35:23.454808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:23.454815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:23.454818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:23.454825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601674066209955:10208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:23.455432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601674066209955:10208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:23.457808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:23.457889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601674066209955:10208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:23.461003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:23.461436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:23.461451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:23.461467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:23.461546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:23.461593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601673283985055:9523]
2025-10-10T14:35:23.461587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601674066209955:10208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:23.461616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601674066209955:10208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:23.461621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601674066209955:10208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:23.461631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:23.462217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:23.462620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:23.462695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:23.463021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:23.463114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.463122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.463123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.463125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.463126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.463128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.463129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.463130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.463132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.463133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.463135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.463136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.463138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.463146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.463159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.463163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.463167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.463171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.463176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.463179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.463184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.463188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.463193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.463196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.463200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.463204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.463213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.463222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.463228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.463240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.463245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.463250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.463255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.463259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.463264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.463270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.463274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.463279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.463284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.463290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.463295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.463306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.463310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.463321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.463326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.463332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.463349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.463358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.463363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.463368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.463377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.463382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.463425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:23.466080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:23.466775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:23.466801Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:23.466804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:23.466808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:23.466817Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1658 [2:7559601673283985055:9523]
2025-10-10T14:35:23.466831Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:23.466856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:23.466860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.466864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.466867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.466886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:23.466901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:23.466914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:23.466983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.466992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.466993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.466996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:23.467079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:23.467090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.467104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.467116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.467134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:23.467165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066209783:2438], now have 1 active actors on pipe
2025-10-10T14:35:23.467174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066210018:10208], now have 1 active actors on pipe
2025-10-10T14:35:23.467182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601673283985050:9523]
2025-10-10T14:35:23.467184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601673283985050:9523]
2025-10-10T14:35:23.467186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601673283985050:9523]
2025-10-10T14:35:23.467202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:23.467223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:23.467232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:23.467236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:23.467238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:23.467246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:23.467250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:23.467252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1658
2025-10-10T14:35:23.467287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1658
2025-10-10T14:35:23.467288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601673283985050:9523]
2025-10-10T14:35:23.467303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:23.467308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:23.467455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.467468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.467506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:23.467519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.467524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.467527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:23.467540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.467554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:23.467573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.467832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.467846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.467872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.467985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1659 partition: 0 MaxSeqNo: 40 sessionId: src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0
2025-10-10T14:35:23.468386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|546a9c8a-20d31f4d-54451dad-fd5f663e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:23.471186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0] Write session: try to update token
2025-10-10T14:35:23.471209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:23.486775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:23.486797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:23.486808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601673283985050:9523]
2025-10-10T14:35:23.486856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:23.486864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:23.487049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:23.487206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.487354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.487499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.487698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:23.487746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:23.488751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId: src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:23.491627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:23.492050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.492078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.492135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:23.492219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:23.524592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.524629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.524833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.524898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.524964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.525038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.525089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.525095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.525174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.525237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.525303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.525422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.525467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.525473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.525550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.525628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.525697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.525771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.525820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.525829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.525903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.525982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.526051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.526121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.526169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.526178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.526256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.526331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.526534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.526614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.526667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.526676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.526753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.526821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.526894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.526969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.527022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.527031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.527105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.527172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.527247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.527319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.527367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.527376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.527452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.527523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.527590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.527663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.527718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.527725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.527793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.527865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.527939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.528085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.528135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.528143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.528282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.528358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.528429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.528503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.528555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.528563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.528642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:23.528650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:23.528653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:23.528656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:23.528665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601673283985050:9523]
2025-10-10T14:35:23.528673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601673283985050:9523]
2025-10-10T14:35:23.528677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601673283985050:9523]
2025-10-10T14:35:23.528739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:35:23.528741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:23.528749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:23.528753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:23.528818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.528848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.528854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:35:23.528893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:35:23.528912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:35:23.528920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:35:23.528923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:35:23.528926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:35:23.529403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:35:23.529436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:35:23.529449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:35:23.529457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:35:23.529460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:35:23.529463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:35:23.530668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:35:23.530706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:35:23.530719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:35:23.530727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:35:23.530731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:35:23.530734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:35:23.531238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:35:23.531275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:35:23.531281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:35:23.531285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:35:23.531289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:35:23.533767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:35:23.533791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:35:23.533808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760106923533
2025-10-10T14:35:23.533927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:35:23.533945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:35:23.533951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:35:23.533955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:35:23.533962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:35:23.533965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:35:23.534958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:35:23.534984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:35:23.534991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:35:23.534995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:35:23.534999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:35:23.535004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:35:23.535464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:35:23.535491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:35:23.535498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:35:23.535502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:35:23.535507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:35:23.535512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:35:23.536063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:35:23.536075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:35:23.536081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:35:23.537199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:35:23.537219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:35:23.537225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:35:23.537229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:35:23.537240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760106923537
2025-10-10T14:35:23.538133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601674066210031:9869]
2025-10-10T14:35:23.538454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1658, pipe: [1:7559601674066210031:9869]
2025-10-10T14:35:23.537609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:35:23.537632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:35:23.537639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:35:23.537642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:35:23.537646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:35:23.537651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:35:23.538113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:35:23.538128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:35:23.538133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:35:23.538137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:35:23.538144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:35:23.538147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:35:23.538650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:35:23.538663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.538776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760106923538
2025-10-10T14:35:23.539510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:23.539515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.539517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:23.539660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:23.652873Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:23.653257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066210031:9869], now have 1 active actors on pipe
2025-10-10T14:35:23.653281Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:35:23.653309Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:35:23.653321Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:35:23.653351Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:35:23.653632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:23.653643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:23.653651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601674066210031:9869]
2025-10-10T14:35:23.653679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:23.653682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:23.653724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1659 reason: error at write: Disconnected sessionId: src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0
2025-10-10T14:35:23.653986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1659 sessionId: src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0 is DEAD
2025-10-10T14:35:23.654179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:23.654190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0] Write session will restart in 0.009553s
2025-10-10T14:35:23.654217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0] Write session: Do CDS request
2025-10-10T14:35:23.654224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:23.664976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.665106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:23.665123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1660
2025-10-10T14:35:23.665263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.665302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:23.665313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:23.665317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:23.665790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1660 sessionId:  describe result for acl check
2025-10-10T14:35:23.665829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:23.665833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:23.665835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:23.665842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601674066210057:10213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:23.666454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601674066210057:10213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:23.670775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601674066210057:10213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:23.675694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601674066210057:10213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:23.675733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601674066210057:10213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:23.675737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601674066210057:10213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:23.675748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:23.680469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:23.683530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:23.683810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:23.683821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:23.683834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:23.683908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:23.683954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601673283985300:9525]
2025-10-10T14:35:23.684591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:23.684926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:23.684977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:23.685309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:23.685424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.685426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.685427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.685428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.685429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.685431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.685432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.685433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.685435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.685436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.685437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.685439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.685440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.685446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.685460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.685465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.685469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.685473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.685477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.685481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.685485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.685489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.685494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.685498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.685502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.685505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.685514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.685523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.685531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.685537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.685543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.685548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.685552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.685557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.685562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.685567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.685571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.685577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.685581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.685587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.685591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.685597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.685603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.685608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.685613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.685618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.685623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.685628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.685632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.685638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.685649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.685656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.685694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:23.690260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:23.690868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:23.690883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:23.690886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:23.690890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:23.690897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1659 [2:7559601673283985300:9525]
2025-10-10T14:35:23.690911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:23.690943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:23.690955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.690959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.690962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.690980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:23.690989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:23.690998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:23.691064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.691073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.691076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.691079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:23.691155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:23.691162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.691175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.691192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.691210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:23.691341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1659
2025-10-10T14:35:23.691379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1659
2025-10-10T14:35:23.691237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066210211:10213], now have 1 active actors on pipe
2025-10-10T14:35:23.691247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066210036:2438], now have 1 active actors on pipe
2025-10-10T14:35:23.691256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601673283985295:9525]
2025-10-10T14:35:23.691258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601673283985295:9525]
2025-10-10T14:35:23.691260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601673283985295:9525]
2025-10-10T14:35:23.691274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:23.691288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:23.691305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:23.691306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:23.691309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:23.691310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:23.691312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:23.691344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601673283985295:9525]
2025-10-10T14:35:23.691349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:23.691354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:23.691579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.691589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.691626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0678e21-c54a3635-63ff9844-82e81763_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:23.691641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.691645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.691648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:23.691661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.691673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:23.691694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.691880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.691890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.691907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.692043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1660 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0678e21-c54a3635-63ff9844-82e81763_0
2025-10-10T14:35:23.692496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|468238e6-4b861647-eb8bdc1c-182ffc59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0678e21-c54a3635-63ff9844-82e81763_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:23.695423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678e21-c54a3635-63ff9844-82e81763_0] Write session: try to update token
2025-10-10T14:35:23.695443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678e21-c54a3635-63ff9844-82e81763_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:23.709837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:23.709860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:23.709873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601673283985295:9525]
2025-10-10T14:35:23.709929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:23.709932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:23.710116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:23.710279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.710457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.710601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.710813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:23.710862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:23.711595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId: src_id|f0678e21-c54a3635-63ff9844-82e81763_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:23.714322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:23.714565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.714599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.714643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:23.714738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:23.728585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:23.728618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:23.728621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:23.728624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:23.728636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601673283985295:9525]
2025-10-10T14:35:23.728639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601673283985295:9525]
2025-10-10T14:35:23.728643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601673283985295:9525]
2025-10-10T14:35:23.728690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:23.728698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.728700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:23.728700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:23.728708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:23.728712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:23.728834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:23.753706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601674066210303:9869]
2025-10-10T14:35:23.754029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1659, pipe: [1:7559601674066210303:9869]
2025-10-10T14:35:23.846214Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:23.855075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.855104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.855289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.855362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.855430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.855498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.855550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.855563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.855637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.855700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.855763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.855840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.855892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.855894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.855970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.856030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.856094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.856166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.856206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.856209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.856286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.856353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.856414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.856476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.856520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.856523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.856597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.856657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.856721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.856781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.856822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.856825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.856895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.856955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.857016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.857077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.857119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.857122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.857190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.857246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.857311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.857401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.857445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.857448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.857524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.857587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.857648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.857713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.857756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.857764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.857833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.857889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.857950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.858011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.858054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.858057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.858127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:23.858190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:23.858258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:23.858320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:23.858406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:23.858410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:23.858485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066210303:9869], now have 1 active actors on pipe
2025-10-10T14:35:23.858884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:23.858891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601674066210303:9869]
2025-10-10T14:35:23.858923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:23.858925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:23.858960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1660 reason: error at write: Disconnected sessionId: src_id|f0678e21-c54a3635-63ff9844-82e81763_0
2025-10-10T14:35:23.859209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1660 sessionId: src_id|f0678e21-c54a3635-63ff9844-82e81763_0 is DEAD
2025-10-10T14:35:23.859404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678e21-c54a3635-63ff9844-82e81763_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:23.859415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678e21-c54a3635-63ff9844-82e81763_0] Write session will restart in 0.007520s
2025-10-10T14:35:23.859443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678e21-c54a3635-63ff9844-82e81763_0] Write session: Do CDS request
2025-10-10T14:35:23.859449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678e21-c54a3635-63ff9844-82e81763_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:23.859696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:23.867891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678e21-c54a3635-63ff9844-82e81763_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.868020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:23.868042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1661
2025-10-10T14:35:23.868234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:23.868290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:23.868302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:23.868306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:23.868926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1661 sessionId:  describe result for acl check
2025-10-10T14:35:23.868969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:23.868976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:23.868978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:23.868985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601674066210321:10218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:23.869598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601674066210321:10218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:23.873551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601674066210321:10218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:23.877999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601674066210321:10218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:23.878018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601674066210321:10218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:23.878022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601674066210321:10218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:23.878032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:23.893798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:23.897454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:23.897730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:23.897745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:23.897759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:23.897824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:23.897875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601673283985559:9529]
2025-10-10T14:35:23.898570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:23.899028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:23.899102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:23.899464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:23.899562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.899569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.899570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.899572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.899573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.899575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.899576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.899578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.899579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.899581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.899583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.899584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.899586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.899592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.899607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.899611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.899616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.899620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.899624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.899628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.899633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.899636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.899642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.899646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.899650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.899654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.899663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.899675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:23.899682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.899688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:23.899693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.899697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:23.899702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.899707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:23.899712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.899717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:23.899723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.899729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:23.899734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.899739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:23.899744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.899750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:23.899760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.899765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:23.899770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.899780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:23.899784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.899790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.899796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.899806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.899811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.899816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.899860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:23.903938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1660
2025-10-10T14:35:23.902838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:23.903978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1660
2025-10-10T14:35:23.903497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:23.903503Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:23.903506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:23.903510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:23.903518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1660 [2:7559601673283985559:9529]
2025-10-10T14:35:23.903532Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:23.903555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:23.903558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.903562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.903565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.903584Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:23.903592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:23.903600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:23.903671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.903673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.903676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.903679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:23.903750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:23.903753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.903765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:23.903777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:23.903795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:23.903819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601673283985553:9529]
2025-10-10T14:35:23.903822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601673283985553:9529]
2025-10-10T14:35:23.903824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601673283985553:9529]
2025-10-10T14:35:23.903833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:23.903843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:23.903852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066210456:10218], now have 1 active actors on pipe
2025-10-10T14:35:23.903855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066210306:2438], now have 1 active actors on pipe
2025-10-10T14:35:23.903857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:23.903859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:23.903861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:23.903876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:23.903879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:23.903917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601673283985553:9529]
2025-10-10T14:35:23.903926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:23.903948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:23.904086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.904093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.904142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b16851e7-313be722-58263e65-e13a65b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:23.904158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:23.904163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:23.904165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:23.904178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:23.904191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:23.904215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.904368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.904375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.904390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:23.904494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1661 partition: 0 MaxSeqNo: 40 sessionId: src_id|b16851e7-313be722-58263e65-e13a65b8_0
2025-10-10T14:35:23.904907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0678e21-c54a3635-63ff9844-82e81763_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b16851e7-313be722-58263e65-e13a65b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:23.907755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16851e7-313be722-58263e65-e13a65b8_0] Write session: try to update token
2025-10-10T14:35:23.907781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16851e7-313be722-58263e65-e13a65b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:23.918854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:23.918878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:23.918891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601673283985553:9529]
2025-10-10T14:35:23.918944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:23.918951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:23.919139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:23.919284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.919417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.919558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:23.919750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:23.919804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:23.922662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId: src_id|b16851e7-313be722-58263e65-e13a65b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:23.925324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:23.925557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:23.925586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:23.925628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:23.925741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:23.936855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:23.936873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:23.936876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:23.936878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:23.936889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601673283985553:9529]
2025-10-10T14:35:23.936893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601673283985553:9529]
2025-10-10T14:35:23.936898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601673283985553:9529]
2025-10-10T14:35:23.936952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:23.936967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:23.936970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:23.936977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:23.936982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:23.936986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:23.937121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:23.959022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601674066210554:9869]
2025-10-10T14:35:23.959399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1660, pipe: [1:7559601674066210554:9869]
2025-10-10T14:35:24.052740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:24.061403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.061439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.061636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.061705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.061772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.061836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.061879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.061883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.061959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.062018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.062080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.062143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.062186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.062189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.062260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.062324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.062404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.062464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.062504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.062507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.062579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.062649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.062717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.062784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.062831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.062834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.062905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.062964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.063024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.063086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.063127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.063129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.063199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.063258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.063323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.063387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.063433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.063436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.063507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.063569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.063632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.063694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.063735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.063737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.063804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.063863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.063926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.063987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.064029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.064032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.064101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.064158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.064218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.064275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.064315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.064318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.064385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.064999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601674066210554:9869]
2025-10-10T14:35:24.065002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:24.065014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:24.065048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1661 reason: error at write: Disconnected sessionId: src_id|b16851e7-313be722-58263e65-e13a65b8_0
2025-10-10T14:35:24.065319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1661 sessionId: src_id|b16851e7-313be722-58263e65-e13a65b8_0 is DEAD
2025-10-10T14:35:24.065348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:24.065474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16851e7-313be722-58263e65-e13a65b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:24.065495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16851e7-313be722-58263e65-e13a65b8_0] Write session will restart in 0.008851s
2025-10-10T14:35:24.065550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16851e7-313be722-58263e65-e13a65b8_0] Write session: Do CDS request
2025-10-10T14:35:24.065559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16851e7-313be722-58263e65-e13a65b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:24.064444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.064503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.064563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.064604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.064607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.064679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601674066210554:9869], now have 1 active actors on pipe
2025-10-10T14:35:24.065985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:24.075975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16851e7-313be722-58263e65-e13a65b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.076072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:24.076091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1662
2025-10-10T14:35:24.076241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.076273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:24.076279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:24.076285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:24.076759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1662 sessionId:  describe result for acl check
2025-10-10T14:35:24.076791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:24.076793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:24.076804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:24.076811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601678361177868:10222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:24.077397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601678361177868:10222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:24.081406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601678361177868:10222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:24.087176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601678361177868:10222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:24.087197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601678361177868:10222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:24.087200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601678361177868:10222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:24.087211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:24.095728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:24.097991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:24.098269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:24.098275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:24.098290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:24.098364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:24.098423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601677578953116:9531]
2025-10-10T14:35:24.099021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:24.100331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:24.100405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:24.100796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:24.100881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.100883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.100884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.100885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.100886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.100887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.100889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.100890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.100891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.100892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.100894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.100895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.100896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.100904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.100917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.100920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.100924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.100927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.100931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.100935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.100938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.100941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.100945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.100949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.100953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.100957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.100965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.100974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.100981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.100987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.100992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.100997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.101002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.101007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.101011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.101016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.101020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.101024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.101029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.101034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.101038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.101042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.101047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.101052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.101056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.101064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.101069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.101074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.101078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.101082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.101086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.101091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.101132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:24.104326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:24.104967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:24.104973Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:24.104975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:24.104980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:24.104988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1661 [2:7559601677578953116:9531]
2025-10-10T14:35:24.105002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:24.105023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:24.105027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.105031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.105033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.105053Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:24.105061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:24.105070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:24.105138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.105141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.105143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.105145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:24.105224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:24.105228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.105239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.105250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.105264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:24.105286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601677578953111:9531]
2025-10-10T14:35:24.105289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601677578953111:9531]
2025-10-10T14:35:24.105291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601677578953111:9531]
2025-10-10T14:35:24.105301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:24.105309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:24.105313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:24.105315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:24.105319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:24.105355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:24.105365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:24.105379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361177991:10222], now have 1 active actors on pipe
2025-10-10T14:35:24.105383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361177853:2438], now have 1 active actors on pipe
2025-10-10T14:35:24.105440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601677578953111:9531]
2025-10-10T14:35:24.105456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:24.105516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:24.105627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.105637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.105668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:24.105681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.105689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.105691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:24.105705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.105721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:24.105746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.105922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.105931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.105948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.106517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16851e7-313be722-58263e65-e13a65b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:24.105465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1661
2025-10-10T14:35:24.105474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1661
2025-10-10T14:35:24.106083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1662 partition: 0 MaxSeqNo: 40 sessionId: src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0
2025-10-10T14:35:24.109501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0] Write session: try to update token
2025-10-10T14:35:24.109520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:24.117753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:24.117786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:24.117798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601677578953111:9531]
2025-10-10T14:35:24.117837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:24.117850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:24.118029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:24.118188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.118338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.118500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.118711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:24.118760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:24.135068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId: src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:24.138103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:24.139488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.139518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.139544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:24.139547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:24.139550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:24.139552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:24.139562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601677578953111:9531]
2025-10-10T14:35:24.139565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601677578953111:9531]
2025-10-10T14:35:24.139570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601677578953111:9531]
2025-10-10T14:35:24.139628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:24.139638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:24.139643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:24.139646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.139648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:24.139649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:24.139802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:24.165361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601678361178103:9869]
2025-10-10T14:35:24.165688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1661, pipe: [1:7559601678361178103:9869]
2025-10-10T14:35:24.260431Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:24.260894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:24.260930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178103:9869], now have 1 active actors on pipe
2025-10-10T14:35:24.262002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:24.262013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0] Write session will restart in 0.006144s
2025-10-10T14:35:24.261507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:24.261609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:24.261612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:24.262038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0] Write session: Do CDS request
2025-10-10T14:35:24.261696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1662 reason: error at write: Disconnected sessionId: src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0
2025-10-10T14:35:24.261873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1662 sessionId: src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0 is DEAD
2025-10-10T14:35:24.262045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:24.261938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601678361178103:9869]
2025-10-10T14:35:24.261964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:24.270690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.270761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:24.270777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1663
2025-10-10T14:35:24.270903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.270950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:24.270961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:24.270965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:24.271342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1663 sessionId:  describe result for acl check
2025-10-10T14:35:24.271374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:24.271379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:24.271381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:24.271385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601678361178139:10235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:24.271834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601678361178139:10235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:24.273577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601678361178139:10235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:24.276237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601678361178139:10235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:24.276250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601678361178139:10235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:24.276253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601678361178139:10235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:24.276261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:24.300768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:24.303666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:24.303878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:24.303887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:24.303896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:24.303939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:24.303971Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601677578953388:9546]
2025-10-10T14:35:24.304423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:24.304718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:24.304744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:24.304938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:24.304977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.304978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.304978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.304979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.304980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.304981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.304981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.304982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.304982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.304983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.304984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.304985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.304986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.304989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.304998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.305000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.305002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.305005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.305007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.305009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.305012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.305014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.305016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.305019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.305021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.305023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.305028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.305033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.305038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.305042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.305044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.305048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.305052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.305055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.305058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.305061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.305064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.305067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.305070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.305073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.305076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.305079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.305081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.305084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.305087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.305091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.305093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.305098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.305101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.305104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.305106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.305110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.305131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:24.307527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:24.307883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:24.307895Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:24.307898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:24.307901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:24.307908Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1662 [2:7559601677578953388:9546]
2025-10-10T14:35:24.307922Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:24.307939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:24.307947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.307951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.307953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.307971Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:24.307986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:24.307994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:24.308051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.308058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.308060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.308063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:24.308131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:24.308140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.308152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.308163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.308182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:24.308207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601677578953383:9546]
2025-10-10T14:35:24.308214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601677578953383:9546]
2025-10-10T14:35:24.308216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601677578953383:9546]
2025-10-10T14:35:24.308231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:24.308250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178131:2438], now have 1 active actors on pipe
2025-10-10T14:35:24.308254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:24.308257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:24.308258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178173:10235], now have 1 active actors on pipe
2025-10-10T14:35:24.308260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:24.308267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:24.308284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:24.308291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:24.308317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601677578953383:9546]
2025-10-10T14:35:24.308327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:24.308334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:24.308366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1662
2025-10-10T14:35:24.308413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1662
2025-10-10T14:35:24.308479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.308489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.308525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f939c513-5aed4615-11a56790-d42be413_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:24.308538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.308543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.308546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:24.308558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.308574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:24.308589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.308795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.308807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.308825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.308927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1663 partition: 0 MaxSeqNo: 40 sessionId: src_id|f939c513-5aed4615-11a56790-d42be413_0
2025-10-10T14:35:24.309351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6693cf4a-f21f1639-b03a2e7b-a413464_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f939c513-5aed4615-11a56790-d42be413_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:24.312146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f939c513-5aed4615-11a56790-d42be413_0] Write session: try to update token
2025-10-10T14:35:24.312166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f939c513-5aed4615-11a56790-d42be413_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:24.320394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:24.320418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:24.320429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601677578953383:9546]
2025-10-10T14:35:24.320475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:24.320481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:24.320671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:24.320827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.320982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.321158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.321394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:24.321447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:24.328306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId: src_id|f939c513-5aed4615-11a56790-d42be413_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:24.331164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:24.331607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.331644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.331718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:24.331824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:24.340392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:24.340418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:24.340421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:24.340423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:24.340435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601677578953383:9546]
2025-10-10T14:35:24.340440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601677578953383:9546]
2025-10-10T14:35:24.340445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601677578953383:9546]
2025-10-10T14:35:24.340502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:24.340517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.340520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:24.340664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:24.340844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:24.340857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:24.340862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:24.361905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601678361178379:9869]
2025-10-10T14:35:24.362206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1662, pipe: [1:7559601678361178379:9869]
2025-10-10T14:35:24.459580Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:24.468588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.468620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.468793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.468861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.468936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.469000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.469573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.469589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.469665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.469730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.469798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.469865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.472713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:24.472728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:24.472770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1663 reason: error at write: Disconnected sessionId: src_id|f939c513-5aed4615-11a56790-d42be413_0
2025-10-10T14:35:24.472971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1663 sessionId: src_id|f939c513-5aed4615-11a56790-d42be413_0 is DEAD
2025-10-10T14:35:24.473019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:24.473064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601678361178379:9869]
2025-10-10T14:35:24.469908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.469919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.469992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.470048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.470107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.470174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.470212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.470215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.470283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.470362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.470435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.470499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.470541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.470544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.470607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.470660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.470718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.470775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.470813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.470816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.470880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.470932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.470989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.471052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.471095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.471098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.471163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.471218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.471286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.471347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.471387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.471391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.471458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.471519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.471580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.471639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.471678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.471681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.471746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.471806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.471868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.471929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.471968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.471971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.472052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.472109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.472167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.472222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.472266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.472269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.472344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178379:9869], now have 1 active actors on pipe
2025-10-10T14:35:24.472835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:24.473586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f939c513-5aed4615-11a56790-d42be413_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:24.473596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f939c513-5aed4615-11a56790-d42be413_0] Write session will restart in 0.006271s
2025-10-10T14:35:24.473621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f939c513-5aed4615-11a56790-d42be413_0] Write session: Do CDS request
2025-10-10T14:35:24.473627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f939c513-5aed4615-11a56790-d42be413_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:24.480887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f939c513-5aed4615-11a56790-d42be413_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.481667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:24.481686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1664
2025-10-10T14:35:24.481824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.481864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:24.481874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:24.481878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:24.482526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1664 sessionId:  describe result for acl check
2025-10-10T14:35:24.482566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:24.482572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:24.482574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:24.482580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601678361178390:10239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:24.483137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601678361178390:10239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:24.486298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601678361178390:10239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:24.490242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601678361178390:10239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:24.490256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601678361178390:10239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:24.490260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601678361178390:10239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:24.490269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:24.503208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:24.509923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:24.510236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:24.510250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:24.510265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:24.510348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:24.510398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601677578953636:9548]
2025-10-10T14:35:24.511009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:24.511341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:24.511405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:24.511744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:24.511840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.511847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.511849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.511850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.511852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.511853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.511854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.511856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.511857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.511858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.511860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.511861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.511863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.511870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.511883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.511887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.511890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.511894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.511898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.511902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.511906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.511910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.511914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.511917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.511920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.511924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.511934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.511942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.511949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.511954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.511958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.511963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.511967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.511973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.511978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.511984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.511989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.511993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.511998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.512005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.512009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.512015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.512019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.512025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.512029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.512035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.512040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.512046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.512054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.512060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.512065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.512071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.512114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:24.518408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:24.518758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:24.518771Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:24.518774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:24.518790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:24.518798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1663 [2:7559601677578953636:9548]
2025-10-10T14:35:24.518813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:24.518833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:24.518842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.518846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.518849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.518867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:24.518880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:24.518889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:24.518955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.518963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.518966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.518968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:24.519200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1663
2025-10-10T14:35:24.519249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1663
2025-10-10T14:35:24.519042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:24.519055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.519068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.519082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.519102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:24.519124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178464:10239], now have 1 active actors on pipe
2025-10-10T14:35:24.519128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178381:2438], now have 1 active actors on pipe
2025-10-10T14:35:24.519137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601677578953631:9548]
2025-10-10T14:35:24.519140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601677578953631:9548]
2025-10-10T14:35:24.519143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601677578953631:9548]
2025-10-10T14:35:24.519156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:24.519169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:24.519171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:24.519173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:24.519184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:24.519189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:24.519192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:24.519228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601677578953631:9548]
2025-10-10T14:35:24.519237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:24.519256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:24.519453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.519478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.519524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:24.519539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.519548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.519551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:24.519564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.519582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:24.519603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.519796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.519807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.519829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.519927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1664 partition: 0 MaxSeqNo: 40 sessionId: src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0
2025-10-10T14:35:24.520345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f939c513-5aed4615-11a56790-d42be413_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:24.523063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0] Write session: try to update token
2025-10-10T14:35:24.523083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:24.530995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:24.531013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:24.531024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601677578953631:9548]
2025-10-10T14:35:24.531073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:24.531081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:24.531268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:24.531413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.531546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.531682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:24.531869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:24.531911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:24.544515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId: src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:24.547250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:24.547620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.547644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.547703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:24.549997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:24.550015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:24.550019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:24.550020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:24.550031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601677578953631:9548]
2025-10-10T14:35:24.550035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601677578953631:9548]
2025-10-10T14:35:24.550039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601677578953631:9548]
2025-10-10T14:35:24.550082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:24.550086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:24.550087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:24.550090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:24.550093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.550096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:24.550231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:24.547804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:24.573395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601678361178637:9869]
2025-10-10T14:35:24.573612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1663, pipe: [1:7559601678361178637:9869]
2025-10-10T14:35:24.664305Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:24.672805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.672837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.673031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.673106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.673182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.673257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.673526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.673539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.673615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.673684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.673756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.674109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.674151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.674154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.674228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.674286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.674400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.674462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.674502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.674509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.674577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.674660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.674720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.674780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.674828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.674832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.674902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.674963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.675026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.675089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.675130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.675134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.675203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.675263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.675321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.675383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.675424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.675427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.675495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.675802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.675879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.675947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.675996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.675999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.676070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.676129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.676193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.676257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.676297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.676300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.676369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.676427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.676487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.676544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.676583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.676586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.676654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:24.676708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:24.676766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:24.676827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:24.676869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:24.676872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:24.677003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178637:9869], now have 1 active actors on pipe
2025-10-10T14:35:24.677823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:24.677403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601678361178637:9869]
2025-10-10T14:35:24.677440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:24.677863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:24.677881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0] Write session will restart in 0.007405s
2025-10-10T14:35:24.677443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:24.677475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1664 reason: error at write: Disconnected sessionId: src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0
2025-10-10T14:35:24.677554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:24.677908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0] Write session: Do CDS request
2025-10-10T14:35:24.677693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1664 sessionId: src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0 is DEAD
2025-10-10T14:35:24.677915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:24.686950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.687074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:24.687092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1665
2025-10-10T14:35:24.687253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.687302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:24.687314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:24.687318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:24.687833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1665 sessionId:  describe result for acl check
2025-10-10T14:35:24.687877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:24.687883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:24.687884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:24.687890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601678361178660:8032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:24.688452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601678361178660:8032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:24.691448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601678361178660:8032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:24.696158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601678361178660:8032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:24.696175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601678361178660:8032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:24.696179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601678361178660:8032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:24.696188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:24.707212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:24.710020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:24.710275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:24.710282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:24.710294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:24.710367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:24.710425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601677578953898:9550]
2025-10-10T14:35:24.711069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:24.711341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:24.711398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:24.711696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:24.711761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.711767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.711768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.711769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.711770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.711771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.711772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.711773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.711775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.711776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.711777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.711778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.711779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.711785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.711797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.711801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.711804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.711807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.711811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.711814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.711817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.711821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.711825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.711828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.711831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.711834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.711842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.711850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.711857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.711861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.711867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.711872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.711876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.711881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.711885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.711890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.711893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.711900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.711909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.711913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.711922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.711927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.711931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.711940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.711944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.711948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.711954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.711963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.711968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.711977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.711982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.711986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.712024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:24.714544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:24.715259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1664
2025-10-10T14:35:24.715279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1664
2025-10-10T14:35:24.714883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:24.714897Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:24.714899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:24.714904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:24.714910Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1664 [2:7559601677578953898:9550]
2025-10-10T14:35:24.714924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:24.714943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:24.714946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.714950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.714953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.714970Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:24.714978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:24.714986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:24.715044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.715046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.715049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.715052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:24.715137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:24.715140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.715153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.715166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.715184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:24.715216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178648:2438], now have 1 active actors on pipe
2025-10-10T14:35:24.715224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601677578953893:9550]
2025-10-10T14:35:24.715227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601677578953893:9550]
2025-10-10T14:35:24.715229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601677578953893:9550]
2025-10-10T14:35:24.715244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:24.715253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178723:8032], now have 1 active actors on pipe
2025-10-10T14:35:24.715256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:24.715259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:24.715261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:24.715262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:24.715280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:24.715283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:24.715306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601677578953893:9550]
2025-10-10T14:35:24.715309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:24.715311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:24.715330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.715336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.715388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:24.715396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.715400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.715402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:24.715424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.715436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:24.715454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.715646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.715654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.715693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.716509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1665 partition: 0 MaxSeqNo: 40 sessionId: src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0
2025-10-10T14:35:24.716877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdf6d8d5-4172e977-8aa4f9d0-2e26e04f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:24.719483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0] Write session: try to update token
2025-10-10T14:35:24.719504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:24.735197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:24.735216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:24.735220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:24.735223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:24.735233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601677578953893:9550]
2025-10-10T14:35:24.735238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601677578953893:9550]
2025-10-10T14:35:24.735242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601677578953893:9550]
2025-10-10T14:35:24.735295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:24.735303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.735306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:24.735448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:24.737549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:24.737555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:24.737561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:24.740097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId: src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:24.742877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:24.777653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601678361178915:9869]
2025-10-10T14:35:24.777950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1664, pipe: [1:7559601678361178915:9869]
2025-10-10T14:35:24.856892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:24.857449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.857466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.857514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178915:9869], now have 1 active actors on pipe
2025-10-10T14:35:24.857727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:24.858260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:24.858270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0] Write session will restart in 0.005992s
2025-10-10T14:35:24.858304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0] Write session: Do CDS request
2025-10-10T14:35:24.857784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:24.858310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:24.857800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:24.857804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601678361178915:9869]
2025-10-10T14:35:24.857865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1665 reason: error at write: Disconnected sessionId: src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0
2025-10-10T14:35:24.857892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:24.858094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1665 sessionId: src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0 is DEAD
2025-10-10T14:35:24.865856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.865987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:24.866004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1666
2025-10-10T14:35:24.866149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:24.866210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:24.866221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:24.866226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:24.866676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1666 sessionId:  describe result for acl check
2025-10-10T14:35:24.866722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:24.866724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:24.866726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:24.866732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601678361178933:8027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:24.867333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601678361178933:8027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:24.870773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601678361178933:8027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:24.874140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601678361178933:8027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:24.874159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601678361178933:8027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:24.874162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601678361178933:8027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:24.874171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:24.878929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:24.882033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:24.882365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:24.882389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:24.882408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:24.882507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:24.882570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601677578954150:9554]
2025-10-10T14:35:24.883147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:24.883462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:24.883530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:24.883851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:24.883924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.883932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.883933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.883935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.883936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.883937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.883938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.883939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.883941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.883942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.883944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.883945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.883947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.883954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.883968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.883972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.883977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.883981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.883986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.883990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.883993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.883997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.884003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.884007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.884011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.884015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.884024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.884033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:24.884049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.884055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:24.884061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.884066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:24.884071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.884081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:24.884086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.884092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:24.884096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.884102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:24.884106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.884116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:24.884119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.884124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:24.884128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.884133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:24.884137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.884141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:24.884145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.884149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.884153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.884158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.884162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.884168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.884214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:24.886750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:24.887597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:24.887611Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:24.887614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:24.887618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:24.887624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1665 [2:7559601677578954150:9554]
2025-10-10T14:35:24.887641Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:24.887665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:24.887675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.887679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.887681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.887699Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:24.887707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:24.887716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:24.887778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.887786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.887788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.887791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:24.887861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:24.887866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.887879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:24.887896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:24.887920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:24.887949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361178918:2438], now have 1 active actors on pipe
2025-10-10T14:35:24.887957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361179079:8027], now have 1 active actors on pipe
2025-10-10T14:35:24.887966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601677578954145:9554]
2025-10-10T14:35:24.887973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601677578954145:9554]
2025-10-10T14:35:24.887975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601677578954145:9554]
2025-10-10T14:35:24.887989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:24.888006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:24.888009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:24.888013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:24.888015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:24.888023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:24.888027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:24.888005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1665
2025-10-10T14:35:24.888020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1665
2025-10-10T14:35:24.888056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601677578954145:9554]
2025-10-10T14:35:24.888069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:24.888088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:24.888092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.888097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.888145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:24.888160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:24.888170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:24.888173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:24.888185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:24.888196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:24.888219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.888350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:24.888357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:24.888373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:24.888463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1666 partition: 0 MaxSeqNo: 40 sessionId: src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0
2025-10-10T14:35:24.888882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2568be1-e24c17f0-58d0085c-74d50a2a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:24.891634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0] Write session: try to update token
2025-10-10T14:35:24.891652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:24.908178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:24.908201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:24.908205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:24.908208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:24.908218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601677578954145:9554]
2025-10-10T14:35:24.908224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601677578954145:9554]
2025-10-10T14:35:24.908229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601677578954145:9554]
2025-10-10T14:35:24.908282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:24.908296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:24.908300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:24.908436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:24.908641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId: src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:24.909448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:24.909462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:24.909468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:24.911288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:24.957900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601678361179172:9869]
2025-10-10T14:35:24.958189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1665, pipe: [1:7559601678361179172:9869]
2025-10-10T14:35:25.027933Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:25.028236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.028252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.028299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601678361179172:9869], now have 1 active actors on pipe
2025-10-10T14:35:25.028534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:25.028527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:25.028550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601678361179172:9869]
2025-10-10T14:35:25.028592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:25.028596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:25.028668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1666 reason: error at write: Disconnected sessionId: src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0
2025-10-10T14:35:25.028849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1666 sessionId: src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0 is DEAD
2025-10-10T14:35:25.029009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:25.029021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0] Write session will restart in 0.007563s
2025-10-10T14:35:25.029045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0] Write session: Do CDS request
2025-10-10T14:35:25.029054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:25.037904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.037987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:25.038006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1667
2025-10-10T14:35:25.038158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.038200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:25.038222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:25.038231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:25.038693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1667 sessionId:  describe result for acl check
2025-10-10T14:35:25.038738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:25.038745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:25.038747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:25.038754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601682656146491:8023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:25.039366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601682656146491:8023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:25.042771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601682656146491:8023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:25.046310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601682656146491:8023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:25.046337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601682656146491:8023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:25.046342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601682656146491:8023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:25.046351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:25.048919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:25.052088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:25.052325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:25.052336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:25.052348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:25.052415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:25.052459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601681873921701:9556]
2025-10-10T14:35:25.053110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:25.053492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:25.053543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:25.053846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:25.053900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.053905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.053906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.053906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.053907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.053907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.053908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.053909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.053910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.053910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.053911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.053912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.053912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.053917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.053928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.053932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.053936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.053939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.053942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.053946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.053949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.053953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.053958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.053962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.053966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.053970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.053977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.053982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.053987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.053991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.053993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.053996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.053999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.054002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.054005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.054008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.054011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.054014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.054017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.054020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.054023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.054026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.054031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.054035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.054039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.054044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.054048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.054054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.054058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.054063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.054068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.054073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.054097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:25.056535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:25.056858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:25.056876Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:25.056878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:25.056883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:25.056890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1666 [2:7559601681873921701:9556]
2025-10-10T14:35:25.056904Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:25.056923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:25.056931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.056935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.056937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.056957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:25.056974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:25.056981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:25.057043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.057050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.057052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.057055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:25.057124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:25.057131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.057142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.057154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.057175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:25.057203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656146681:8023], now have 1 active actors on pipe
2025-10-10T14:35:25.057207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656146474:2438], now have 1 active actors on pipe
2025-10-10T14:35:25.057215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601681873921696:9556]
2025-10-10T14:35:25.057217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601681873921696:9556]
2025-10-10T14:35:25.057219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601681873921696:9556]
2025-10-10T14:35:25.057233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:25.057235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1666
2025-10-10T14:35:25.057247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:25.057246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1666
2025-10-10T14:35:25.057251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:25.057258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:25.057261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:25.057267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:25.057270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:25.057306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601681873921696:9556]
2025-10-10T14:35:25.057314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:25.057343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:25.057351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.057356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.057429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:25.057445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.057449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.057452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:25.057463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.057476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:25.057493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.057637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.057645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.057659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.057738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1667 partition: 0 MaxSeqNo: 40 sessionId: src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0
2025-10-10T14:35:25.058143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4263166f-3539a2a0-28f720d9-4ce4756e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:25.060902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0] Write session: try to update token
2025-10-10T14:35:25.060919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:25.075351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId: src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:25.077044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:25.077063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:25.077066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:25.077069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:25.077080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601681873921696:9556]
2025-10-10T14:35:25.077085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601681873921696:9556]
2025-10-10T14:35:25.077089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601681873921696:9556]
2025-10-10T14:35:25.077142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:25.077146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:25.077154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:25.077156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.077158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:25.077158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:25.077303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:25.078103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:25.132550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601682656146729:9869]
2025-10-10T14:35:25.132887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1666, pipe: [1:7559601682656146729:9869]
2025-10-10T14:35:25.188510Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:25.188808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.188818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.188862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656146729:9869], now have 1 active actors on pipe
2025-10-10T14:35:25.189061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:25.189952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:25.190058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1667 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0
2025-10-10T14:35:25.190246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1667 sessionId: src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0 is DEAD
2025-10-10T14:35:25.190427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601682656146729:9869]
2025-10-10T14:35:25.190450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:25.190463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0] Write session will restart in 0.007153s
2025-10-10T14:35:25.190453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:25.190488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0] Write session: Do CDS request
2025-10-10T14:35:25.190494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:25.203372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.203753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:25.203772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1668
2025-10-10T14:35:25.203888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.203920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:25.203926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:25.203931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:25.204670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1668 sessionId:  describe result for acl check
2025-10-10T14:35:25.204713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:25.204716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:25.204718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:25.204725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601682656146776:8020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:25.205428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601682656146776:8020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:25.210089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601682656146776:8020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:25.213129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601682656146776:8020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:25.213147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601682656146776:8020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:25.213151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601682656146776:8020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:25.213160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:25.215482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:25.218117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:25.218359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:25.218371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:25.218384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:25.218444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:25.218525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601681873921984:9569]
2025-10-10T14:35:25.219142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:25.219593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:25.219663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:25.220019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:25.220097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.220104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.220105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.220106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.220108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.220109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.220109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.220110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.220111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.220112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.220113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.220114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.220115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.220121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.220140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.220144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.220147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.220150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.220153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.220156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.220159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.220162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.220166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.220169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.220172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.220175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.220189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.220198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.220205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.220209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.220214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.220219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.220230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.220236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.220241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.220247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.220252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.220257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.220262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.220267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.220271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.220275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.220282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.220288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.220307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.220318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.220323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.220328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.220332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.220337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.220342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.220348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.220391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:25.222804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:25.223567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1667
2025-10-10T14:35:25.223597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1667
2025-10-10T14:35:25.223203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:25.223214Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:25.223215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:25.223218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:25.223224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1667 [2:7559601681873921984:9569]
2025-10-10T14:35:25.223234Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:25.223250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:25.223253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.223257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.223259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.223276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:25.223282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:25.223289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:25.223349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.223351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.223353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.223356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:25.223419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:25.223421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.223432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.223444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.223462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:25.223483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656146963:8020], now have 1 active actors on pipe
2025-10-10T14:35:25.223491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601681873921979:9569]
2025-10-10T14:35:25.223494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601681873921979:9569]
2025-10-10T14:35:25.223496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601681873921979:9569]
2025-10-10T14:35:25.223522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:25.223532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656146734:2438], now have 1 active actors on pipe
2025-10-10T14:35:25.223534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:25.223537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:25.223539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:25.223540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:25.223556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:25.223559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:25.223588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601681873921979:9569]
2025-10-10T14:35:25.223596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:25.223619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:25.223713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.223722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.223762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:25.223772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.223776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.223779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:25.223807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.223829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:25.223848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.224049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.224066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.224082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.224183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1668 partition: 0 MaxSeqNo: 40 sessionId: src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0
2025-10-10T14:35:25.224587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11e2d6d-7e614822-7c0a6284-ac8368ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:25.227525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0] Write session: try to update token
2025-10-10T14:35:25.227544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:25.235253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:25.235273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:25.235285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601681873921979:9569]
2025-10-10T14:35:25.235328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:25.235337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:25.235519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:25.235665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:25.235798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:25.235944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:25.236136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:25.236182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:25.253745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId: src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:25.256667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:25.256711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:25.256730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:25.256733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:25.256735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:25.256746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601681873921979:9569]
2025-10-10T14:35:25.256750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601681873921979:9569]
2025-10-10T14:35:25.256754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601681873921979:9569]
2025-10-10T14:35:25.256805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:25.256810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:25.256816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.256817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:25.256818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:25.256821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:25.256957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:25.290754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601682656147010:9869]
2025-10-10T14:35:25.291047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1667, pipe: [1:7559601682656147010:9869]
2025-10-10T14:35:25.378526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:25.379356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.379378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.379403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147010:9869], now have 1 active actors on pipe
2025-10-10T14:35:25.379657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:25.379640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:25.379654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:25.379737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1668 reason: error at write: Disconnected sessionId: src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0
2025-10-10T14:35:25.379938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1668 sessionId: src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0 is DEAD
2025-10-10T14:35:25.379962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:25.380022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601682656147010:9869]
2025-10-10T14:35:25.380100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:25.380127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0] Write session will restart in 0.009663s
2025-10-10T14:35:25.380152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0] Write session: Do CDS request
2025-10-10T14:35:25.380159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:25.390907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.390946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:25.390965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1669
2025-10-10T14:35:25.391487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.391537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:25.391543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:25.391548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:25.392095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1669 sessionId:  describe result for acl check
2025-10-10T14:35:25.392132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:25.392137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:25.392139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:25.392145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601682656147078:7999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:25.392708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601682656147078:7999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:25.395791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601682656147078:7999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:25.399087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601682656147078:7999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:25.399103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601682656147078:7999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:25.399107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601682656147078:7999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:25.399117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:25.400064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:25.403068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:25.403336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:25.403348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:25.403361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:25.403430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:25.403477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601681873922244:9573]
2025-10-10T14:35:25.404120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:25.404449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:25.404505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:25.404861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:25.404918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.404925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.404926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.404928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.404929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.404931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.404932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.404933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.404934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.404935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.404937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.404938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.404939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.404945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.404959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.404963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.404967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.404971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.404976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.404980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.404983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.404987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.404992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.404996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.405000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.405003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.405012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.405021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.405028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.405033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.405038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.405043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.405047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.405053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.405058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.405063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.405067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.405072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.405077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.405083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.405087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.405092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.405096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.405101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.405106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.405111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.405116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.405121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.405125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.405130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.405135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.405140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.405193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:25.407872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:25.408533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:25.408549Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:25.408551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:25.408555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:25.408562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1668 [2:7559601681873922244:9573]
2025-10-10T14:35:25.408577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:25.408608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:25.408616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.408619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.408622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.408641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:25.408653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:25.408661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:25.408731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.408740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.408741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.408744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:25.408815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:25.408821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.408834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.408846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.408861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:25.408882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601681873922239:9573]
2025-10-10T14:35:25.408892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601681873922239:9573]
2025-10-10T14:35:25.408893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601681873922239:9573]
2025-10-10T14:35:25.408910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:25.408927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:25.408929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147013:2438], now have 1 active actors on pipe
2025-10-10T14:35:25.408933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147256:7999], now have 1 active actors on pipe
2025-10-10T14:35:25.408937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:25.408940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:25.408942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:25.408958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:25.408962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:25.408986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1668
2025-10-10T14:35:25.409042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1668
2025-10-10T14:35:25.408993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601681873922239:9573]
2025-10-10T14:35:25.409003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:25.409011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:25.409096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.409101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.409134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:25.409144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.409148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.409151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:25.409163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.409175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:25.409192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.409348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.409360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.409376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.409468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1669 partition: 0 MaxSeqNo: 40 sessionId: src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0
2025-10-10T14:35:25.409900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3edcc0cf-427e69d7-d1278d8-51d71c64_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:25.412595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0] Write session: try to update token
2025-10-10T14:35:25.412613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:25.428250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId: src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:25.429850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:25.429878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:25.429882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:25.429884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:25.429894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601681873922239:9573]
2025-10-10T14:35:25.429900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601681873922239:9573]
2025-10-10T14:35:25.429904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601681873922239:9573]
2025-10-10T14:35:25.429957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:25.429965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:25.429972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:25.429975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.429976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:25.429977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:25.430132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:25.430950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:25.480668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601682656147269:9869]
2025-10-10T14:35:25.481000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1668, pipe: [1:7559601682656147269:9869]
2025-10-10T14:35:25.538320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:25.538858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.538874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.538917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147269:9869], now have 1 active actors on pipe
2025-10-10T14:35:25.539159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:25.539163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:25.539168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:25.539222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601682656147269:9869]
2025-10-10T14:35:25.539222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:25.539238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1669 reason: error at write: Disconnected sessionId: src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0
2025-10-10T14:35:25.539468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1669 sessionId: src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0 is DEAD
2025-10-10T14:35:25.539640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:25.539651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0] Write session will restart in 0.005061s
2025-10-10T14:35:25.539683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0] Write session: Do CDS request
2025-10-10T14:35:25.539689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:25.545911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.545979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:25.546012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1670
2025-10-10T14:35:25.546174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.546212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:25.546224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:25.546229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:25.546718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1670 sessionId:  describe result for acl check
2025-10-10T14:35:25.546756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:25.546758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:25.546760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:25.546766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601682656147286:7994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:25.547378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601682656147286:7994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:25.549834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601682656147286:7994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:25.553493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601682656147286:7994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:25.553518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601682656147286:7994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:25.553522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601682656147286:7994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:25.553530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:25.558860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:25.561467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:25.561709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:25.561722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:25.561736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:25.561806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:25.561852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601681873922498:9575]
2025-10-10T14:35:25.562525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:25.562893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:25.562959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:25.563358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:25.563446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.563456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.563457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.563458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.563459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.563460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.563461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.563462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.563463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.563464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.563465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.563466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.563467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.563473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.563486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.563489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.563493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.563496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.563499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.563502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.563506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.563509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.563513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.563516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.563519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.563523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.563531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.563539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.563544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.563549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.563554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.563558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.563561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.563566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.563570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.563575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.563579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.563583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.563590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.563609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.563614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.563618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.563623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.563628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.563632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.563637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.563641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.563645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.563650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.563654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.563659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.563664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.563710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:25.566244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:25.566985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:25.566999Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:25.567001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:25.567005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:25.567012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1669 [2:7559601681873922498:9575]
2025-10-10T14:35:25.567025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:25.567042Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:25.567046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.567049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.567051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.567070Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:25.567084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:25.567093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:25.567158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.567169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.567171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.567173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:25.567247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:25.567257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.567270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.567282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.567303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:25.567331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147407:7994], now have 1 active actors on pipe
2025-10-10T14:35:25.567341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147271:2438], now have 1 active actors on pipe
2025-10-10T14:35:25.567349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601681873922493:9575]
2025-10-10T14:35:25.567351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601681873922493:9575]
2025-10-10T14:35:25.567353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601681873922493:9575]
2025-10-10T14:35:25.567374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:25.567390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:25.567391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:25.567393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:25.567395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:25.567408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:25.567411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:25.567406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1669
2025-10-10T14:35:25.567415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1669
2025-10-10T14:35:25.567441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601681873922493:9575]
2025-10-10T14:35:25.567455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:25.567463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:25.567485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.567496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.567550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:25.567569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.567574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.567577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:25.567588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.567599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:25.567618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.567789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.567800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.567820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.567916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1670 partition: 0 MaxSeqNo: 40 sessionId: src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0
2025-10-10T14:35:25.568330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adce8826-535a4e7a-fe86e3d0-81ef7602_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:25.571034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0] Write session: try to update token
2025-10-10T14:35:25.571054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:25.585669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId: src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:25.587161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:25.587182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:25.587185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:25.587188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:25.587198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601681873922493:9575]
2025-10-10T14:35:25.587202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601681873922493:9575]
2025-10-10T14:35:25.587207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601681873922493:9575]
2025-10-10T14:35:25.587260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:25.587269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.587272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:25.587433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:25.588492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:25.588645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:25.588671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:25.588676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:25.639383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601682656147528:9869]
2025-10-10T14:35:25.639751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1669, pipe: [1:7559601682656147528:9869]
2025-10-10T14:35:25.709231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:25.709929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.709948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.709993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147528:9869], now have 1 active actors on pipe
2025-10-10T14:35:25.710182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:25.710232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601682656147528:9869]
2025-10-10T14:35:25.710260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:25.710269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:25.710274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:25.710373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1670 reason: error at write: Disconnected sessionId: src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0
2025-10-10T14:35:25.710595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1670 sessionId: src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0 is DEAD
2025-10-10T14:35:25.710750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:25.710762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0] Write session will restart in 0.008582s
2025-10-10T14:35:25.710790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0] Write session: Do CDS request
2025-10-10T14:35:25.710800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:25.720964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.721065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:25.721081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1671
2025-10-10T14:35:25.721260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.721298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:25.721305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:25.721309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:25.721813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1671 sessionId:  describe result for acl check
2025-10-10T14:35:25.721853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:25.721855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:25.721856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:25.721862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601682656147585:7984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:25.722479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601682656147585:7984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:25.727422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601682656147585:7984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:25.732069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601682656147585:7984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:25.732083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601682656147585:7984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:25.732086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601682656147585:7984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:25.732094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:25.734992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:25.738286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:25.738541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:25.738554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:25.738568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:25.738631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:25.738807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601681873922766:9578]
2025-10-10T14:35:25.739315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:25.739637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:25.739699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:25.740008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:25.740069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.740075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.740076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.740077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.740078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.740079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.740081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.740082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.740083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.740085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.740086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.740088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.740089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.740095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.740109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.740113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.740116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.740120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.740124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.740128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.740132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.740136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.740142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.740146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.740150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.740154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.740162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.740172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.740184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.740194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.740199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.740209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.740213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.740218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.740228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.740233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.740237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.740242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.740248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.740253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.740258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.740263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.740268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.740273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.740277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.740282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.740291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.740297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.740305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.740310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.740314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.740319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.740361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:25.743008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:25.743684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:25.743696Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:25.743698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:25.743702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:25.743709Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1670 [2:7559601681873922766:9578]
2025-10-10T14:35:25.743740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:25.743765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:25.743768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.743771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.743774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.743791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:25.743799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:25.743807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:25.743874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.743887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.743889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.743892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:25.743963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:25.743972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.743985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.743996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.744012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:25.744042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147547:2438], now have 1 active actors on pipe
2025-10-10T14:35:25.744051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147774:7984], now have 1 active actors on pipe
2025-10-10T14:35:25.744059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601681873922761:9578]
2025-10-10T14:35:25.744066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601681873922761:9578]
2025-10-10T14:35:25.744068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601681873922761:9578]
2025-10-10T14:35:25.744083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:25.744096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:25.744099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:25.744107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:25.744109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:25.744116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:25.744120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:25.744149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601681873922761:9578]
2025-10-10T14:35:25.744159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:25.744164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:25.744132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1670
2025-10-10T14:35:25.744196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1670
2025-10-10T14:35:25.744509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.744526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.744559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:25.744588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.744594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.744597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:25.744610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.744643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:25.744666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.745098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.745109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.745128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.745243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1671 partition: 0 MaxSeqNo: 40 sessionId: src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0
2025-10-10T14:35:25.745697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611d8d5-500b20f5-cb1cfa38-ecb13e9f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:25.748563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0] Write session: try to update token
2025-10-10T14:35:25.748586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:25.756055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:25.756075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:25.756086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601681873922761:9578]
2025-10-10T14:35:25.756135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:25.756317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:25.756458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:25.756597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:25.756758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:25.756958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:25.757006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:25.757170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:25.766082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId: src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:25.768814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:25.769117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.769138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.769183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:25.769287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:25.777050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:25.777071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:25.777074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:25.777076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:25.777087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601681873922761:9578]
2025-10-10T14:35:25.777092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601681873922761:9578]
2025-10-10T14:35:25.777096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601681873922761:9578]
2025-10-10T14:35:25.777149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:25.777153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:25.777157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.777159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:25.777160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:25.777165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:25.777303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:25.810414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601682656147809:9869]
2025-10-10T14:35:25.810810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1670, pipe: [1:7559601682656147809:9869]
2025-10-10T14:35:25.893510Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:25.902025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.902071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.902333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.902452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.902552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.902659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.902723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.902728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.902846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.902950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.903049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.903150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.903682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.903708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.903819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.903927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.904036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.904149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.904219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.904222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.904329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.904434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.904555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.904654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.904818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.904832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.904938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.905051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.905164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.905265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.905349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.905360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.905446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.905513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.905581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.905652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.905710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.905714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.905793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.905887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.905996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.906107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.906175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.906179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.906260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.906338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.906409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.906478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.906527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.906535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.906606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.906672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.906743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.906818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.906866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.906873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.906946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:25.907019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:25.907086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:25.907160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:25.907209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:25.907217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:25.907293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147809:9869], now have 1 active actors on pipe
2025-10-10T14:35:25.907634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:25.907650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:25.907689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1671 reason: error at write: Disconnected sessionId: src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0
2025-10-10T14:35:25.907974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1671 sessionId: src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0 is DEAD
2025-10-10T14:35:25.908016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601682656147809:9869]
2025-10-10T14:35:25.908049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:25.908104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:25.908090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:25.908116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0] Write session will restart in 0.005963s
2025-10-10T14:35:25.908153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0] Write session: Do CDS request
2025-10-10T14:35:25.908160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:25.914942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.915021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:25.915039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1672
2025-10-10T14:35:25.915208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:25.915247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:25.915258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:25.915275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:25.915814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1672 sessionId:  describe result for acl check
2025-10-10T14:35:25.915856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:25.915863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:25.915865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:25.915871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601682656147820:7980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:25.916508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601682656147820:7980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:25.919860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601682656147820:7980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:25.923148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601682656147820:7980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:25.923165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601682656147820:7980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:25.923169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601682656147820:7980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:25.923180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:25.934040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:25.936929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:25.937209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:25.937220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:25.937233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:25.937296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:25.937359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601681873923024:9581]
2025-10-10T14:35:25.938029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:25.938417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:25.938482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:25.938821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:25.938902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.938909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.938910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.938911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.938913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.938914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.938915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.938917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.938918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.938920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.938921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.938922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.938924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.938931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.938944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.938949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.938953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.938958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.938962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.938966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.938969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.938973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.938977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.938981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.938985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.938989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.938998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.939007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:25.939014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.939020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:25.939025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.939030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:25.939035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.939040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:25.939045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.939050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:25.939055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.939061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:25.939071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.939076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:25.939080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.939085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:25.939091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.939097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:25.939108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.939116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:25.939121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.939127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.939131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.939147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.939164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.939170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.939220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:25.943175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1671
2025-10-10T14:35:25.941855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:25.942736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:25.942742Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:25.942744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:25.942749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:25.942757Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1671 [2:7559601681873923024:9581]
2025-10-10T14:35:25.942771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:25.942793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:25.942797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.942802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.942805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.942824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:25.942833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:25.942842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:25.942926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.942928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.942931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.942933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:25.943010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:25.943013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.943025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:25.943036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:25.943050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:25.943075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147888:7980], now have 1 active actors on pipe
2025-10-10T14:35:25.943079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601682656147812:2438], now have 1 active actors on pipe
2025-10-10T14:35:25.943088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601681873923019:9581]
2025-10-10T14:35:25.943090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601681873923019:9581]
2025-10-10T14:35:25.943092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601681873923019:9581]
2025-10-10T14:35:25.943109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:25.943125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:25.943129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:25.943133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:25.943340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1671
2025-10-10T14:35:25.943135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:25.943142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:25.943145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:25.943177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601681873923019:9581]
2025-10-10T14:35:25.943184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:25.943189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:25.943392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.943409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.943444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:25.943469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:25.943478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:25.943481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:25.943496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:25.943510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:25.943526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.943710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:25.943718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:25.943734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:25.943834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1672 partition: 0 MaxSeqNo: 40 sessionId: src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0
2025-10-10T14:35:25.944260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc32d91-83cdd41b-d6ed9beb-f2d0249b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:25.947227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0] Write session: try to update token
2025-10-10T14:35:25.947253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:25.964557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId: src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:25.966805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:25.966826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:25.966829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:25.966832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:25.966843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601681873923019:9581]
2025-10-10T14:35:25.966847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601681873923019:9581]
2025-10-10T14:35:25.966854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601681873923019:9581]
2025-10-10T14:35:25.966909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:25.966909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:25.966917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:25.966922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:25.966924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:25.966928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:25.967077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:25.967295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:26.008032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601686951115369:9869]
2025-10-10T14:35:26.008499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1671, pipe: [1:7559601686951115369:9869]
2025-10-10T14:35:26.080922Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:26.081462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.081479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.081530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115369:9869], now have 1 active actors on pipe
2025-10-10T14:35:26.081749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:26.081794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601686951115369:9869]
2025-10-10T14:35:26.081800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:26.081804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:26.081840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:26.081865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1672 reason: error at write: Disconnected sessionId: src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0
2025-10-10T14:35:26.082064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1672 sessionId: src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0 is DEAD
2025-10-10T14:35:26.082277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:26.082297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0] Write session will restart in 0.009940s
2025-10-10T14:35:26.082331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0] Write session: Do CDS request
2025-10-10T14:35:26.082337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:26.093914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.094006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:26.094025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1673
2025-10-10T14:35:26.094158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.094197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:26.094210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:26.094214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:26.094776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1673 sessionId:  describe result for acl check
2025-10-10T14:35:26.094838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:26.094846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:26.094848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:26.094854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601686951115415:7965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:26.095513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601686951115415:7965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:26.098627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601686951115415:7965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:26.102232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601686951115415:7965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:26.102251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601686951115415:7965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:26.102255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601686951115415:7965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:26.102265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:26.104771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:26.108180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:26.108489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:26.108501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:26.108514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:26.108570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:26.108619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601686168890577:9583]
2025-10-10T14:35:26.109357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:26.109767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:26.109813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:26.110167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:26.110224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.110231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.110232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.110234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.110236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.110237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.110239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.110241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.110242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.110244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.110246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.110248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.110249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.110256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.110271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.110276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.110281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.110299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.110303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.110308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.110312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.110317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.110322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.110327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.110331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.110336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.110345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.110355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.110363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.110377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.110383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.110389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.110394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.110400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.110406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.110412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.110423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.110429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.110436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.110443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.110448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.110454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.110466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.110472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.110477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.110484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.110489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.110495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.110505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.110511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.110533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.110544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.110589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:26.115395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:26.115783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:26.115795Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:26.115799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:26.115803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:26.115811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1672 [2:7559601686168890577:9583]
2025-10-10T14:35:26.115831Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:26.115857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:26.115865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.115870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.115872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.115894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:26.115909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:26.115918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:26.115983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.115990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.115993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.115996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:26.116237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1672
2025-10-10T14:35:26.116239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1672
2025-10-10T14:35:26.116464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:26.116474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.116488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.116508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.116534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:26.116563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115370:2438], now have 1 active actors on pipe
2025-10-10T14:35:26.116573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115611:7965], now have 1 active actors on pipe
2025-10-10T14:35:26.116589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.116599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.116623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601686168890572:9583]
2025-10-10T14:35:26.116631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601686168890572:9583]
2025-10-10T14:35:26.116634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601686168890572:9583]
2025-10-10T14:35:26.116658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:26.116679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:26.116681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:26.116683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:26.116686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:26.116700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:26.116704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:26.116727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:26.116741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.116750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.116753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:26.116765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.116780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:26.116827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601686168890572:9583]
2025-10-10T14:35:26.116843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:26.116856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:26.116861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.118064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.118081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.118108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.118536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1673 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0
2025-10-10T14:35:26.119011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cfa92c-42a47d9b-79fb0e10-2af4bcf6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:26.121937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0] Write session: try to update token
2025-10-10T14:35:26.121958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:26.129648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:26.129666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:26.129676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601686168890572:9583]
2025-10-10T14:35:26.129731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:26.129772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:26.129904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:26.130053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:26.130194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:26.130356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:26.130563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:26.130609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:26.138225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId: src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:26.141137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:26.142627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.142652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.142709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:26.142810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:26.149181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:26.149211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:26.149215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:26.149217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:26.149229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601686168890572:9583]
2025-10-10T14:35:26.149233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601686168890572:9583]
2025-10-10T14:35:26.149238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601686168890572:9583]
2025-10-10T14:35:26.149293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:26.149293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:26.149300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:26.149301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.149305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:26.149305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:26.149480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:26.182102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601686951115632:9869]
2025-10-10T14:35:26.182391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1672, pipe: [1:7559601686951115632:9869]
2025-10-10T14:35:26.264683Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:26.273558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.273596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.273789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.273847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.273909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.273970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.274015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.274020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.274092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.274151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.274210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.274272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.274331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.274335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.274408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.274467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.274529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.274589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.274630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.274632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.274701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.274761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.274824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.274885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.274926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.274929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.274999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.275059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.275120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.275183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.275226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.275229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.275301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.275358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.275419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.275478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.275520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.275523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.275593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.275649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.275710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.275770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.275813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.275816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.275889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.275951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.276015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.276074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.276115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.276118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.277408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:26.277433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:26.277438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:26.277471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1673 reason: error at write: Disconnected sessionId: src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0
2025-10-10T14:35:26.277472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601686951115632:9869]
2025-10-10T14:35:26.276185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.276241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.276299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.276360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.276400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.276403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.276470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.276525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.276583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.276640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.276681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.276684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.276760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115632:9869], now have 1 active actors on pipe
2025-10-10T14:35:26.277698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1673 sessionId: src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0 is DEAD
2025-10-10T14:35:26.277820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:26.277831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0] Write session will restart in 0.006088s
2025-10-10T14:35:26.277855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0] Write session: Do CDS request
2025-10-10T14:35:26.277862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:26.278171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:26.284951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.287060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:26.287083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1674
2025-10-10T14:35:26.287272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.287321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:26.287332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:26.287337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:26.287790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1674 sessionId:  describe result for acl check
2025-10-10T14:35:26.287826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:26.287834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:26.287836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:26.287843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601686951115664:7968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:26.288478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601686951115664:7968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:26.290840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601686951115664:7968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:26.297701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601686951115664:7968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:26.297721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601686951115664:7968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:26.297725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601686951115664:7968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:26.297735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:26.309887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:26.313853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:26.314138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:26.314144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:26.314157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:26.314225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:26.314268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601686168890867:9596]
2025-10-10T14:35:26.314940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:26.315324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:26.315385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:26.315743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:26.315805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.315812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.315813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.315814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.315816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.315817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.315819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.315820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.315822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.315823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.315824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.315826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.315827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.315834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.315847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.315853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.315856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.315861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.315864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.315867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.315871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.315874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.315879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.315883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.315888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.315892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.315904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.315913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.315928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.315934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.315939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.315945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.315951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.315957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.315963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.315969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.315974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.315980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.315986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.315992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.315996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.316003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.316009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.316015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.316021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.316027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.316032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.316039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.316044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.316050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.316056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.316061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.316121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:26.319041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:26.319560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:26.319566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:26.320024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1673
2025-10-10T14:35:26.320071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1673
2025-10-10T14:35:26.319569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:26.319574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:26.319581Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1673 [2:7559601686168890867:9596]
2025-10-10T14:35:26.319594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:26.319637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:26.319641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.319644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.319647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.319667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:26.319675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:26.319684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:26.319745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.319747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.319749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.319753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:26.319825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:26.319828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.319841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.319853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.319871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:26.319892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601686168890862:9596]
2025-10-10T14:35:26.319894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601686168890862:9596]
2025-10-10T14:35:26.319896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601686168890862:9596]
2025-10-10T14:35:26.319905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:26.319923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:26.319927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:26.319930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:26.319932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:26.319939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:26.319942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:26.319954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115772:7968], now have 1 active actors on pipe
2025-10-10T14:35:26.319958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115636:2438], now have 1 active actors on pipe
2025-10-10T14:35:26.319985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601686168890862:9596]
2025-10-10T14:35:26.319995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:26.320005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:26.320226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.320234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.320273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25f5a4db-38a23967-b3114445-a8f1007a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:26.320285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.320290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.320292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:26.320307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.320320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:26.320337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.323994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1674 partition: 0 MaxSeqNo: 40 sessionId: src_id|25f5a4db-38a23967-b3114445-a8f1007a_0
2025-10-10T14:35:26.323694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.323716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.323762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.327047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9caeb26-8b319ee5-265ec6f-c8b0b210_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25f5a4db-38a23967-b3114445-a8f1007a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:26.330379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f5a4db-38a23967-b3114445-a8f1007a_0] Write session: try to update token
2025-10-10T14:35:26.330409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f5a4db-38a23967-b3114445-a8f1007a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:26.340945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:26.340975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:26.340979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:26.340981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:26.340992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601686168890862:9596]
2025-10-10T14:35:26.340996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601686168890862:9596]
2025-10-10T14:35:26.341001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601686168890862:9596]
2025-10-10T14:35:26.341051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:26.341055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:26.341064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.341067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:26.341067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:26.341072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:26.341212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:26.353108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId: src_id|25f5a4db-38a23967-b3114445-a8f1007a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:26.356078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:26.377690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601686951115922:9869]
2025-10-10T14:35:26.378008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1673, pipe: [1:7559601686951115922:9869]
2025-10-10T14:35:26.461514Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:26.461984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.462004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.462028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115922:9869], now have 1 active actors on pipe
2025-10-10T14:35:26.462260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:26.462763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f5a4db-38a23967-b3114445-a8f1007a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:26.462776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f5a4db-38a23967-b3114445-a8f1007a_0] Write session will restart in 0.005559s
2025-10-10T14:35:26.462804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f5a4db-38a23967-b3114445-a8f1007a_0] Write session: Do CDS request
2025-10-10T14:35:26.462811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f5a4db-38a23967-b3114445-a8f1007a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:26.462257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:26.462263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:26.462273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:26.462333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601686951115922:9869]
2025-10-10T14:35:26.462347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1674 reason: error at write: Disconnected sessionId: src_id|25f5a4db-38a23967-b3114445-a8f1007a_0
2025-10-10T14:35:26.462543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1674 sessionId: src_id|25f5a4db-38a23967-b3114445-a8f1007a_0 is DEAD
2025-10-10T14:35:26.469810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25f5a4db-38a23967-b3114445-a8f1007a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.469879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:26.469893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1675
2025-10-10T14:35:26.470021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.470058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:26.470063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:26.470075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:26.470736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1675 sessionId:  describe result for acl check
2025-10-10T14:35:26.470765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:26.470767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:26.470769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:26.470776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601686951115931:7955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:26.471365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601686951115931:7955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:26.476206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601686951115931:7955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:26.479330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601686951115931:7955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:26.479345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601686951115931:7955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:26.479349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601686951115931:7955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:26.479356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:26.497685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:26.500856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:26.501112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:26.501124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:26.501137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:26.501193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:26.501237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601686168891133:9600]
2025-10-10T14:35:26.501928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:26.502250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:26.502314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:26.502677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:26.502736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.502746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.502747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.502748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.502750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.502751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.502753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.502754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.502756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.502757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.502758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.502759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.502760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.502766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.502780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.502784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.502789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.502793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.502798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.502802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.502806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.502810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.502815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.502820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.502824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.502829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.502838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.502847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.502854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.502860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.502865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.502871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.502876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.502882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.502886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.502892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.502897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.502904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.502910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.502916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.502920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.502926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.502932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.502937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.502942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.502948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.502961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.502967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.502977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.502982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.502986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.502991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.503035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:26.505519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:26.505831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:26.505843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:26.505846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:26.505850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:26.505855Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1674 [2:7559601686168891133:9600]
2025-10-10T14:35:26.505867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:26.505885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:26.505889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.505892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.505895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.505912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:26.505919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:26.505933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:26.505986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.505989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.505991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.505994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:26.506079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:26.506081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.506094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.506107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.506125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:26.506151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115963:7955], now have 1 active actors on pipe
2025-10-10T14:35:26.506159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951115924:2438], now have 1 active actors on pipe
2025-10-10T14:35:26.506159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1674
2025-10-10T14:35:26.506196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1674
2025-10-10T14:35:26.506167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601686168891127:9600]
2025-10-10T14:35:26.506173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601686168891127:9600]
2025-10-10T14:35:26.506175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601686168891127:9600]
2025-10-10T14:35:26.506189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:26.506204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:26.506211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:26.506215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:26.506218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:26.506221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:26.506225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:26.506258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.506290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.506311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601686168891127:9600]
2025-10-10T14:35:26.506319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:26.506340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:26.506359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c1006a4-f20d38d-b96db665-97d47517_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:26.506367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.506372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.506380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:26.506391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.506405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:26.506427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.506812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.506821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.506839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.506931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1675 partition: 0 MaxSeqNo: 40 sessionId: src_id|5c1006a4-f20d38d-b96db665-97d47517_0
2025-10-10T14:35:26.507327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25f5a4db-38a23967-b3114445-a8f1007a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5c1006a4-f20d38d-b96db665-97d47517_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:26.509935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1006a4-f20d38d-b96db665-97d47517_0] Write session: try to update token
2025-10-10T14:35:26.509954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1006a4-f20d38d-b96db665-97d47517_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:26.525127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId: src_id|5c1006a4-f20d38d-b96db665-97d47517_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:26.525586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:26.525603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:26.525607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:26.525609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:26.525618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601686168891127:9600]
2025-10-10T14:35:26.525623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601686168891127:9600]
2025-10-10T14:35:26.525627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601686168891127:9600]
2025-10-10T14:35:26.525677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:26.525677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:26.525683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:26.525688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:26.525690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.525693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:26.527917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:26.525831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:26.562527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601686951116187:9869]
2025-10-10T14:35:26.562820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1674, pipe: [1:7559601686951116187:9869]
2025-10-10T14:35:26.644315Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:26.644866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.644878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.644924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951116187:9869], now have 1 active actors on pipe
2025-10-10T14:35:26.645124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:26.645237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601686951116187:9869]
2025-10-10T14:35:26.645491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:26.645580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1675 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c1006a4-f20d38d-b96db665-97d47517_0
2025-10-10T14:35:26.645682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:26.645825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1675 sessionId: src_id|5c1006a4-f20d38d-b96db665-97d47517_0 is DEAD
2025-10-10T14:35:26.645992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1006a4-f20d38d-b96db665-97d47517_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:26.646003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1006a4-f20d38d-b96db665-97d47517_0] Write session will restart in 0.008545s
2025-10-10T14:35:26.646039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1006a4-f20d38d-b96db665-97d47517_0] Write session: Do CDS request
2025-10-10T14:35:26.646045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1006a4-f20d38d-b96db665-97d47517_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:26.655938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1006a4-f20d38d-b96db665-97d47517_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.656056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:26.656073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1676
2025-10-10T14:35:26.656213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.656250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:26.656260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:26.656264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:26.656726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1676 sessionId:  describe result for acl check
2025-10-10T14:35:26.656764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:26.656766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:26.656768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:26.656776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601686951116218:7951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:26.657399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601686951116218:7951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:26.660664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601686951116218:7951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:26.666026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601686951116218:7951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:26.666044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601686951116218:7951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:26.666048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601686951116218:7951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:26.666058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:26.668639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:26.671969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:26.672258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:26.672269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:26.672282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:26.672346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:26.672407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601686168891393:9602]
2025-10-10T14:35:26.673089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:26.673450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:26.673499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:26.673827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:26.673890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.673898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.673899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.673900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.673901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.673903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.673904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.673906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.673907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.673909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.673910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.673912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.673913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.673919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.673933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.673938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.673943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.673948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.673953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.673957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.673962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.673966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.673973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.673977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.673982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.673986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.673995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.674004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.674011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.674019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.674028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.674034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.674039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.674045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.674055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.674061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.674070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.674076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.674082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.674088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.674093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.674098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.674110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.674115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.674121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.674131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.674137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.674147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.674151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.674161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.674166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.674176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.674221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:26.677077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:26.678048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:26.678061Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:26.678063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:26.678067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:26.678074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1675 [2:7559601686168891393:9602]
2025-10-10T14:35:26.678091Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:26.678112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:26.678121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.678125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.678128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.678148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:26.678157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:26.678166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:26.678233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.678241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.678243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.678245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:26.678326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:26.678334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.678347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.678357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.678375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:26.678402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601686168891388:9602]
2025-10-10T14:35:26.678404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601686168891388:9602]
2025-10-10T14:35:26.678408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601686168891388:9602]
2025-10-10T14:35:26.678424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:26.678443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951116189:2438], now have 1 active actors on pipe
2025-10-10T14:35:26.678447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951116445:7951], now have 1 active actors on pipe
2025-10-10T14:35:26.678455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:26.678470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:26.678472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:26.678475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:26.678477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:26.678483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:26.678521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1675
2025-10-10T14:35:26.678526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1675
2025-10-10T14:35:26.678525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601686168891388:9602]
2025-10-10T14:35:26.678536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:26.678543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:26.678705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.678714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.678744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:26.678758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.678762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.678764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:26.678777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.678788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:26.678804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.679015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.679027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.679062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.679159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1676 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0
2025-10-10T14:35:26.679678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c1006a4-f20d38d-b96db665-97d47517_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:26.682450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0] Write session: try to update token
2025-10-10T14:35:26.682474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:26.705707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:26.705721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:26.705734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601686168891388:9602]
2025-10-10T14:35:26.705795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:26.705796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:26.705995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:26.706154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:26.706320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:26.706466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:26.706666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:26.706708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:26.709087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId: src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:26.711711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:26.712515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.712541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.712583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:26.712720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:26.716540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:26.716560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:26.716563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:26.716567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:26.716577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601686168891388:9602]
2025-10-10T14:35:26.716580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601686168891388:9602]
2025-10-10T14:35:26.716584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601686168891388:9602]
2025-10-10T14:35:26.716633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:26.716646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.716649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:26.716810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:26.721432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:26.721447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:26.721452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:26.745257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601686951116475:9869]
2025-10-10T14:35:26.745654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1675, pipe: [1:7559601686951116475:9869]
2025-10-10T14:35:26.830078Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:26.838288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.838319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.838506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.838566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.838629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.838690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.839124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.839136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.839206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.839271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.839334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.839403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.839593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.839603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.839670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.839729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.839792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.839854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.839898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.839906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.839976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.840041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.840115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.840184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.840231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.840238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.840306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.840367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.840438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.840514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.840563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.840572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.840643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.840705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.840768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.840830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.840998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.841003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.841073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.841136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.841300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.841385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.841432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.841444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.841514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.841580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.841647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.841713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.841760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.841767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.841852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.841916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.842741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:26.842810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:26.842821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:26.842831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601686951116475:9869]
2025-10-10T14:35:26.842865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1676 reason: error at write: Disconnected sessionId: src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0
2025-10-10T14:35:26.841983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.842051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.843117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1676 sessionId: src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0 is DEAD
2025-10-10T14:35:26.842095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.842098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.842166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:26.842222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:26.842296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:26.842358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:26.843295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:26.842403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:26.843310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0] Write session will restart in 0.005795s
2025-10-10T14:35:26.842405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:26.842480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951116475:9869], now have 1 active actors on pipe
2025-10-10T14:35:26.842867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:26.843338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0] Write session: Do CDS request
2025-10-10T14:35:26.843354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:26.851002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.851095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:26.851113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1677
2025-10-10T14:35:26.851275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:26.851305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:26.851310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:26.851314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:26.851735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1677 sessionId:  describe result for acl check
2025-10-10T14:35:26.851765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:26.851767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:26.851768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:26.851774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601686951116493:7931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:26.852308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601686951116493:7931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:26.857325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601686951116493:7931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:26.864060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601686951116493:7931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:26.864079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601686951116493:7931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:26.864083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601686951116493:7931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:26.864093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:26.868236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:26.871282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:26.871553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:26.871567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:26.871581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:26.871653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:26.871700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601686168891669:9606]
2025-10-10T14:35:26.872315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:26.872640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:26.872693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:26.873033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:26.873096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.873098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.873100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.873101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.873103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.873105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.873106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.873108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.873109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.873111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.873112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.873114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.873115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.873123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.873139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.873142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.873146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.873149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.873153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.873157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.873162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.873167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.873171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.873175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.873179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.873183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.873192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.873202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:26.873209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.873215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:26.873222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.873228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:26.873233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.873239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:26.873245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.873251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:26.873256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.873262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:26.873267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.873274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:26.873278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.873284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:26.873290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.873296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:26.873302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.873308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:26.873313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.873318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.873323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.873351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.873357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.873363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.873408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:26.877569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:26.878022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:26.878042Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:26.878045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:26.878050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:26.878057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1676 [2:7559601686168891669:9606]
2025-10-10T14:35:26.878073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:26.878094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:26.878098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.878102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.878104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.878123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:26.878140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:26.878148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:26.878215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.878223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.878227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.878230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:26.878324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:26.878332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.878347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:26.878360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:26.878383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:26.878409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951116672:7931], now have 1 active actors on pipe
2025-10-10T14:35:26.878417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951116478:2438], now have 1 active actors on pipe
2025-10-10T14:35:26.878426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601686168891664:9606]
2025-10-10T14:35:26.878428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601686168891664:9606]
2025-10-10T14:35:26.878431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601686168891664:9606]
2025-10-10T14:35:26.878446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:26.878462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:26.878480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:26.878480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:26.878484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:26.878486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:26.878488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:26.878470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1676
2025-10-10T14:35:26.878529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601686168891664:9606]
2025-10-10T14:35:26.878471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1676
2025-10-10T14:35:26.878536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:26.878540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:26.878570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.878580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.878617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:26.878630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:26.878635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:26.878637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:26.878650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:26.878662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:26.878686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.878854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:26.878865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:26.878887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:26.879007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1677 partition: 0 MaxSeqNo: 40 sessionId: src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0
2025-10-10T14:35:26.879498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a90e4be-227dfb06-807c6c39-94e4ec19_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:26.882417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0] Write session: try to update token
2025-10-10T14:35:26.882445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:26.898161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:26.898735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId: src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:26.898183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:26.898186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:26.898189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:26.898200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601686168891664:9606]
2025-10-10T14:35:26.898205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601686168891664:9606]
2025-10-10T14:35:26.898215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601686168891664:9606]
2025-10-10T14:35:26.898287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:26.898289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:26.898296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:26.898297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:26.898299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:26.898302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:26.898449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:26.901638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:26.940468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601686951116742:9869]
2025-10-10T14:35:26.940795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1676, pipe: [1:7559601686951116742:9869]
2025-10-10T14:35:27.034968Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:27.035498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.035518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.035570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601686951116742:9869], now have 1 active actors on pipe
2025-10-10T14:35:27.035851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:27.035854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601686951116742:9869]
2025-10-10T14:35:27.035859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:27.035863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:27.035907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:27.035926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1677 reason: error at write: Disconnected sessionId: src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0
2025-10-10T14:35:27.036155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1677 sessionId: src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0 is DEAD
2025-10-10T14:35:27.036302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:27.036313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0] Write session will restart in 0.005970s
2025-10-10T14:35:27.036359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0] Write session: Do CDS request
2025-10-10T14:35:27.036368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:27.043971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.044088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:27.044106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1678
2025-10-10T14:35:27.044215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.044258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:27.044270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:27.044277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:27.044824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1678 sessionId:  describe result for acl check
2025-10-10T14:35:27.044857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:27.044859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:27.044862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:27.044869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601691246084066:7936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:27.045460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601691246084066:7936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:27.048757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601691246084066:7936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:27.052209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601691246084066:7936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:27.052227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601691246084066:7936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:27.052231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601691246084066:7936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:27.052239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:27.057197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:27.060373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:27.060661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:27.060673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:27.060688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:27.060767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:27.060818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601690463859227:9608]
2025-10-10T14:35:27.061440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:27.061829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:27.061888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:27.062231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:27.062332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.062338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.062340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.062341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.062342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.062344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.062345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.062347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.062348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.062349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.062351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.062352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.062353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.062361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.062375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.062379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.062384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.062388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.062392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.062396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.062400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.062403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.062410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.062414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.062417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.062421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.062432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.062442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.062450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.062461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.062467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.062474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.062479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.062485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.062496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.062501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.062510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.062515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.062519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.062529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.062534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.062540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.062550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.062556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.062566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.062571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.062580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.062588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.062597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.062601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.062606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.062616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.062674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:27.065453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:27.065876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:27.065888Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:27.065891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:27.065896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:27.065904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1677 [2:7559601690463859227:9608]
2025-10-10T14:35:27.065919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:27.065945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:27.065953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.065957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.065959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.065978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:27.065991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:27.065998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:27.066079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.066088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.066090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.066094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:27.066169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:27.066179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.066192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.066205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.066223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:27.066253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084212:7936], now have 1 active actors on pipe
2025-10-10T14:35:27.066276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084041:2438], now have 1 active actors on pipe
2025-10-10T14:35:27.066289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601690463859222:9608]
2025-10-10T14:35:27.066295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601690463859222:9608]
2025-10-10T14:35:27.066298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601690463859222:9608]
2025-10-10T14:35:27.066333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1677
2025-10-10T14:35:27.066385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1677
2025-10-10T14:35:27.066312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:27.066325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:27.066328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:27.066330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:27.066333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:27.066351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:27.066355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:27.066389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601690463859222:9608]
2025-10-10T14:35:27.066398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:27.066403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:27.066416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.066422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.066483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|196866c7-a8c7844c-8efc0bd-aa900362_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:27.066497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.066501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.066503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:27.066514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.066526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:27.066548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.066790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.066804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.066830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.066966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1678 partition: 0 MaxSeqNo: 40 sessionId: src_id|196866c7-a8c7844c-8efc0bd-aa900362_0
2025-10-10T14:35:27.067430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e68cc196-c7917673-4c352b1a-7c794d0c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|196866c7-a8c7844c-8efc0bd-aa900362_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:27.070237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196866c7-a8c7844c-8efc0bd-aa900362_0] Write session: try to update token
2025-10-10T14:35:27.070270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196866c7-a8c7844c-8efc0bd-aa900362_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:27.086892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:27.086911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:27.086914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:27.086917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:27.086928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601690463859222:9608]
2025-10-10T14:35:27.086933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601690463859222:9608]
2025-10-10T14:35:27.086937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601690463859222:9608]
2025-10-10T14:35:27.086984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:27.086988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:27.086991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:27.086995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:27.086996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.086998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:27.087133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:27.087478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId: src_id|196866c7-a8c7844c-8efc0bd-aa900362_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:27.090385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:27.137454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601691246084306:9869]
2025-10-10T14:35:27.137798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1677, pipe: [1:7559601691246084306:9869]
2025-10-10T14:35:27.203394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:27.203401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601691246084306:9869]
2025-10-10T14:35:27.203429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:27.203431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:27.203538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1678 reason: error at write: Disconnected sessionId: src_id|196866c7-a8c7844c-8efc0bd-aa900362_0
2025-10-10T14:35:27.203769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1678 sessionId: src_id|196866c7-a8c7844c-8efc0bd-aa900362_0 is DEAD
2025-10-10T14:35:27.203888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196866c7-a8c7844c-8efc0bd-aa900362_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:27.203900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196866c7-a8c7844c-8efc0bd-aa900362_0] Write session will restart in 0.006345s
2025-10-10T14:35:27.203924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196866c7-a8c7844c-8efc0bd-aa900362_0] Write session: Do CDS request
2025-10-10T14:35:27.203930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196866c7-a8c7844c-8efc0bd-aa900362_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:27.202458Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:27.203102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.203113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.203162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084306:9869], now have 1 active actors on pipe
2025-10-10T14:35:27.204836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:27.211987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196866c7-a8c7844c-8efc0bd-aa900362_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.212082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:27.212100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1679
2025-10-10T14:35:27.212261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.212308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:27.212319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:27.212324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:27.212829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1679 sessionId:  describe result for acl check
2025-10-10T14:35:27.212870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:27.212878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:27.212880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:27.212888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601691246084323:7934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:27.213458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601691246084323:7934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:27.216949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601691246084323:7934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:27.221088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601691246084323:7934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:27.221107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601691246084323:7934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:27.221111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601691246084323:7934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:27.221121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:27.225915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:27.228853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:27.229188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:27.229199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:27.229215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:27.229287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:27.229353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601690463859490:9610]
2025-10-10T14:35:27.229981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:27.230363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:27.230411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:27.230724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:27.230793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.230798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.230799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.230800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.230802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.230803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.230804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.230805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.230807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.230808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.230809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.230810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.230811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.230819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.230832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.230835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.230839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.230842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.230846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.230849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.230853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.230857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.230861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.230864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.230868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.230871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.230880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.230888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.230894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.230901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.230909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.230913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.230917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.230922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.230931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.230936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.230939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.230943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.230948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.230953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.230957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.230961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.230965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.230969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.230973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.230978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.230982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.230987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.230990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.230995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.231002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.231006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.231041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:27.234162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:27.234678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:27.234691Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:27.234693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:27.234698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:27.234705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1678 [2:7559601690463859490:9610]
2025-10-10T14:35:27.234722Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:27.234744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:27.234747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.234751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.234754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.234785Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:27.234804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:27.234812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:27.234889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.234898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.234900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.234903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:27.234980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:27.234988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.235001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.235012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.235027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:27.235057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084308:2438], now have 1 active actors on pipe
2025-10-10T14:35:27.235064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084499:7934], now have 1 active actors on pipe
2025-10-10T14:35:27.235072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601690463859485:9610]
2025-10-10T14:35:27.235074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601690463859485:9610]
2025-10-10T14:35:27.235076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601690463859485:9610]
2025-10-10T14:35:27.235093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:27.235104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:27.235107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:27.235108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:27.235117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:27.235141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:27.235146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:27.235122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1678
2025-10-10T14:35:27.235128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1678
2025-10-10T14:35:27.235191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601690463859485:9610]
2025-10-10T14:35:27.235204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:27.235209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:27.235219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.235229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.235285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:27.235298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.235302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.235305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:27.235318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.235333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:27.235359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.235502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.235513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.235539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.235712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1679 partition: 0 MaxSeqNo: 40 sessionId: src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0
2025-10-10T14:35:27.236158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196866c7-a8c7844c-8efc0bd-aa900362_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:27.239078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0] Write session: try to update token
2025-10-10T14:35:27.239102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:27.255944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId: src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:27.258811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:27.258952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:27.258970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:27.258974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:27.258976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:27.258985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601690463859485:9610]
2025-10-10T14:35:27.258990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601690463859485:9610]
2025-10-10T14:35:27.258994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601690463859485:9610]
2025-10-10T14:35:27.259025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:27.259035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:27.259039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:27.259046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.259055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.259078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:27.259091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.259098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:27.259232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:27.303376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601691246084575:9869]
2025-10-10T14:35:27.303674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1678, pipe: [1:7559601691246084575:9869]
2025-10-10T14:35:27.371077Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:27.371511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084575:9869], now have 1 active actors on pipe
2025-10-10T14:35:27.371724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:27.371755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:27.371809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601691246084575:9869]
2025-10-10T14:35:27.371830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:27.371909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1679 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0
2025-10-10T14:35:27.372130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1679 sessionId: src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0 is DEAD
2025-10-10T14:35:27.372550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:27.372560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0] Write session will restart in 0.009617s
2025-10-10T14:35:27.372584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0] Write session: Do CDS request
2025-10-10T14:35:27.372591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:27.385861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.385969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:27.385987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1680
2025-10-10T14:35:27.386146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.386193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:27.386206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:27.386211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:27.386917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1680 sessionId:  describe result for acl check
2025-10-10T14:35:27.386957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:27.386964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:27.386966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:27.386972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601691246084692:7918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:27.387673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601691246084692:7918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:27.390828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601691246084692:7918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:27.394499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601691246084692:7918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:27.394516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601691246084692:7918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:27.394521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601691246084692:7918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:27.394530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:27.395180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:27.398022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:27.398273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:27.398285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:27.398299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:27.398359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:27.398407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601690463859792:9623]
2025-10-10T14:35:27.399043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:27.399319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:27.399361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:27.399677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:27.399737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.399743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.399744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.399745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.399747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.399748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.399749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.399751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.399752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.399753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.399755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.399756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.399757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.399763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.399777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.399781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.399786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.399791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.399795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.399800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.399805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.399809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.399813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.399818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.399822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.399826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.399835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.399846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.399853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.399862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.399867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.399873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.399878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.399883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.399888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.399894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.399898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.399911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.399916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.399921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.399931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.399936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.399941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.399947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.399957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.399963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.399972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.399978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.399987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.399992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.399997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.400007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.400052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:27.402722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:27.403309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:27.403325Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:27.403328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:27.403333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:27.403340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1679 [2:7559601690463859792:9623]
2025-10-10T14:35:27.403356Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:27.403380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:27.403389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.403392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.403395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.403415Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:27.403428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:27.403441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:27.403514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.403524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.403526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.403529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:27.403603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:27.403614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.403629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.403640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.403656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:27.403690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084590:2438], now have 1 active actors on pipe
2025-10-10T14:35:27.403698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084857:7918], now have 1 active actors on pipe
2025-10-10T14:35:27.403706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601690463859787:9623]
2025-10-10T14:35:27.403712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601690463859787:9623]
2025-10-10T14:35:27.403713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601690463859787:9623]
2025-10-10T14:35:27.403729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:27.403752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:27.403756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:27.403759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:27.403761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:27.403770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:27.403774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:27.403766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1679
2025-10-10T14:35:27.403807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601690463859787:9623]
2025-10-10T14:35:27.403817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:27.403773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1679
2025-10-10T14:35:27.403825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:27.403994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.404006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.404041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:27.404054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.404063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.404066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:27.404079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.404105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:27.404127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.404360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.404370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.404386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.404489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1680 partition: 0 MaxSeqNo: 40 sessionId: src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0
2025-10-10T14:35:27.404941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d5ccb0-b3c5c350-4562ad09-f198ecc1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:27.407865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0] Write session: try to update token
2025-10-10T14:35:27.407888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:27.415802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:27.415817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:27.415830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601690463859787:9623]
2025-10-10T14:35:27.415878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:27.415885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:27.416060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:27.416211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:27.416389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:27.416598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:27.416850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:27.416906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:27.424801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId: src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:27.427683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:27.428113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.428135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.428187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:27.428269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:27.434165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:27.434184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:27.434188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:27.434190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:27.434203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601690463859787:9623]
2025-10-10T14:35:27.434207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601690463859787:9623]
2025-10-10T14:35:27.434211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601690463859787:9623]
2025-10-10T14:35:27.434277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:27.434286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.434286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:27.434289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:27.434293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:27.434298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:27.434442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:27.471827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601691246084869:9869]
2025-10-10T14:35:27.472034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1679, pipe: [1:7559601691246084869:9869]
2025-10-10T14:35:27.552120Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:27.561410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.561441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.561629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.561696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.561763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.561830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.562299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.562314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.562389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.562451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.562518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.562589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.562634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.562641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.562709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.562773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.562847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.562913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.562958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.562970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.563037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.563103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.563164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.563227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.563272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.563280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.563344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.563406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.563468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.563534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.563584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.563589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.563657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.563713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.563773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.563835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.563875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.563878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.563949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.564007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.564068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.564129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.564170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.564172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.564240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.564296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.564355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.564417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.564457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.564459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.564526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.564579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.564635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.564694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.564733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.564736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.564803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.564860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.564924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.564982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.565023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.565039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.565129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084869:9869], now have 1 active actors on pipe
2025-10-10T14:35:27.565400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:27.565393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:27.565404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601691246084869:9869]
2025-10-10T14:35:27.565407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:27.565426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:27.565453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1680 reason: error at write: Disconnected sessionId: src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0
2025-10-10T14:35:27.565712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1680 sessionId: src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0 is DEAD
2025-10-10T14:35:27.569555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:27.569568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0] Write session will restart in 0.009378s
2025-10-10T14:35:27.569595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0] Write session: Do CDS request
2025-10-10T14:35:27.569601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:27.579956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.580087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:27.580112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1681
2025-10-10T14:35:27.580236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.580274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:27.580279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:27.580283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:27.580805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1681 sessionId:  describe result for acl check
2025-10-10T14:35:27.580841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:27.580849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:27.580851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:27.580858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601691246084989:7914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:27.581409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601691246084989:7914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:27.584229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601691246084989:7914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:27.587901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:27.588008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601691246084989:7914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:27.588025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601691246084989:7914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:27.588028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601691246084989:7914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:27.588038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:27.590574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:27.590811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:27.590825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:27.590840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:27.590907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:27.590946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601690463860057:9627]
2025-10-10T14:35:27.591448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:27.591736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:27.591771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:27.591983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:27.592022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.592027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.592028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.592028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.592029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.592030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.592031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.592032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.592033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.592033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.592034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.592035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.592035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.592040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.592049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.592051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.592053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.592055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.592058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.592059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.592062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.592064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.592066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.592069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.592070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.592072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.592078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.592084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.592088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.592092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.592094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.592097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.592100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.592103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.592106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.592110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.592112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.592116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.592118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.592122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.592124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.592127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.592130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.592134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.592136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.592139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.592143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.592146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.592148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.592152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.592154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.592158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.592179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:27.595002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:27.595622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:27.595634Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:27.595636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:27.595641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:27.595648Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1680 [2:7559601690463860057:9627]
2025-10-10T14:35:27.595663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:27.595682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:27.595692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.595697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.595700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.595719Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:27.595732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:27.595740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:27.595810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.595817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.595819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.595822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:27.595893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:27.595900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.595912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.595925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.595945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:27.595976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246085128:7914], now have 1 active actors on pipe
2025-10-10T14:35:27.595980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246084872:2438], now have 1 active actors on pipe
2025-10-10T14:35:27.595989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601690463860051:9627]
2025-10-10T14:35:27.595991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601690463860051:9627]
2025-10-10T14:35:27.595993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601690463860051:9627]
2025-10-10T14:35:27.596009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:27.596024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:27.596027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:27.596033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:27.596035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:27.596040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:27.596044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:27.596077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601690463860051:9627]
2025-10-10T14:35:27.596088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:27.596094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:27.596225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.596234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.596268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:27.596284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.596289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.596296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:27.596310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.596327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:27.596349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.596521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.596531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.596555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.597132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32e7c0f-8f5bc7b8-23121948-cc6d6b79_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:27.596072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1680
2025-10-10T14:35:27.596135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1680
2025-10-10T14:35:27.596668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1681 partition: 0 MaxSeqNo: 40 sessionId: src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0
2025-10-10T14:35:27.600017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0] Write session: try to update token
2025-10-10T14:35:27.600039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:27.608186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:27.608205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:27.608217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601690463860051:9627]
2025-10-10T14:35:27.608269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:27.608272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:27.608443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:27.608588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:27.608728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:27.608870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:27.609059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:27.609095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:27.617297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId: src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:27.619876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:27.620093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.620114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.620172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:27.620250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:27.626042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:27.626062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:27.626065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:27.626068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:27.626080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601690463860051:9627]
2025-10-10T14:35:27.626084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601690463860051:9627]
2025-10-10T14:35:27.626089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601690463860051:9627]
2025-10-10T14:35:27.626133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:27.626138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:27.626147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.626149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:27.626158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:27.626165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:27.626308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:27.665368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601691246085146:9869]
2025-10-10T14:35:27.665718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1680, pipe: [1:7559601691246085146:9869]
2025-10-10T14:35:27.740227Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:27.748880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.748914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.749106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.749180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.749257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.749351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.749406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.749411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.749484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.749548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.749613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.749687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.749736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.749739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.749812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.749874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.749943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.750008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.750060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.750064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.750136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.750199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.750280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.750344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.750389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.750393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.750468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.750533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.750600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.750664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.750704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.750707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.750778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.750841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.750902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.750964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.751006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.751009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.751078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.751134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.751201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.751265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.751311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.751314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.751387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.751450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.751512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.751579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.751622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.751625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.751701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.751764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.751829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.751896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.751938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.751943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.752010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:27.752080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:27.752144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:27.752211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:27.752261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:27.752268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:27.752336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246085146:9869], now have 1 active actors on pipe
2025-10-10T14:35:27.753061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:27.753121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601691246085146:9869]
2025-10-10T14:35:27.753203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:27.753216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:27.753248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1681 reason: error at write: Disconnected sessionId: src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0
2025-10-10T14:35:27.753494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1681 sessionId: src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0 is DEAD
2025-10-10T14:35:27.753567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:27.753885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:27.753896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0] Write session will restart in 0.006946s
2025-10-10T14:35:27.753923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0] Write session: Do CDS request
2025-10-10T14:35:27.753929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:27.763711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.763743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:27.763758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1682
2025-10-10T14:35:27.763922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.763963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:27.763973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:27.763984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:27.764435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1682 sessionId:  describe result for acl check
2025-10-10T14:35:27.764482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:27.764489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:27.764491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:27.764498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601691246085178:7909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:27.765102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601691246085178:7909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:27.768297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601691246085178:7909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:27.771757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601691246085178:7909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:27.771774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601691246085178:7909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:27.771778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601691246085178:7909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:27.771787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:27.777727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:27.780572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:27.780780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:27.780792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:27.780804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:27.780855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:27.780898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601690463860335:9630]
2025-10-10T14:35:27.781483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:27.781776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:27.781818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:27.782098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:27.782152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.782158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.782159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.782160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.782161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.782162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.782163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.782164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.782166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.782166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.782168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.782169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.782170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.782174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.782188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.782192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.782195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.782198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.782202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.782205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.782208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.782212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.782216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.782219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.782223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.782226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.782235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.782255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.782261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.782266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.782271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.782275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.782279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.782284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.782288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.782292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.782296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.782301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.782306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.782310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.782314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.782319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.782323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.782328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.782331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.782335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.782341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.782345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.782349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.782354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.782358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.782362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.782397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:27.784767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:27.785186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:27.785200Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:27.785202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:27.785206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:27.785212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1681 [2:7559601690463860335:9630]
2025-10-10T14:35:27.785224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:27.785242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:27.785250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.785254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.785256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.785275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:27.785282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:27.785290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:27.785370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.785378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.785380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.785383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:27.785450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:27.785457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.785469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.785487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.785508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:27.785535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246085163:2438], now have 1 active actors on pipe
2025-10-10T14:35:27.785543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246085318:7909], now have 1 active actors on pipe
2025-10-10T14:35:27.785551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601690463860330:9630]
2025-10-10T14:35:27.785557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601690463860330:9630]
2025-10-10T14:35:27.785560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601690463860330:9630]
2025-10-10T14:35:27.785577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:27.785573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1681
2025-10-10T14:35:27.785615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1681
2025-10-10T14:35:27.785596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:27.785598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:27.785602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:27.785604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:27.785621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:27.785625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:27.785651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601690463860330:9630]
2025-10-10T14:35:27.785654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:27.785665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:27.785668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.785674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.785715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:27.785729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.785733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.785736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:27.785747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.785757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:27.785774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.785940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.785953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.785977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.786057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1682 partition: 0 MaxSeqNo: 40 sessionId: src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0
2025-10-10T14:35:27.786529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e903e6f8-d94377c9-35d82418-4a3f8c63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:27.789118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0] Write session: try to update token
2025-10-10T14:35:27.789138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:27.805522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:27.805536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:27.805539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:27.805541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:27.805549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601690463860330:9630]
2025-10-10T14:35:27.805553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601690463860330:9630]
2025-10-10T14:35:27.805555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601690463860330:9630]
2025-10-10T14:35:27.805594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:27.805604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.805607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:27.805607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:27.805615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:27.805619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:27.805740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:27.803920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId: src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:27.806570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:27.853253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601691246085433:9869]
2025-10-10T14:35:27.853788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1681, pipe: [1:7559601691246085433:9869]
2025-10-10T14:35:27.918722Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:27.919104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.919117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.919159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246085433:9869], now have 1 active actors on pipe
2025-10-10T14:35:27.919329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:27.919936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:27.919948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0] Write session will restart in 0.007612s
2025-10-10T14:35:27.919976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0] Write session: Do CDS request
2025-10-10T14:35:27.919982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:27.919406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601691246085433:9869]
2025-10-10T14:35:27.919441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:27.919476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:27.919569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1682 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0
2025-10-10T14:35:27.919772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1682 sessionId: src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0 is DEAD
2025-10-10T14:35:27.928902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.928964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:27.928981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1683
2025-10-10T14:35:27.929129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:27.929175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:27.929181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:27.929185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:27.929672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1683 sessionId:  describe result for acl check
2025-10-10T14:35:27.929713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:27.929715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:27.929717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:27.929723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601691246085463:7889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:27.930337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601691246085463:7889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:27.933582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601691246085463:7889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:27.938057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601691246085463:7889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:27.938076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601691246085463:7889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:27.938080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601691246085463:7889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:27.938089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:27.941803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:27.944743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:27.945004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:27.945016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:27.945030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:27.945110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:27.945165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601690463860604:9633]
2025-10-10T14:35:27.945892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:27.946221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:27.946278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:27.946603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:27.946663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.946670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.946671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.946672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.946673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.946675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.946676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.946677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.946679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.946680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.946681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.946682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.946683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.946690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.946703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.946707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.946711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.946714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.946718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.946723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.946726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.946731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.946735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.946739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.946743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.946747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.946755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.946763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:27.946769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.946775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:27.946779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.946784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:27.946789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.946794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:27.946798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.946804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:27.946808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.946813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:27.946818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.946824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:27.946828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.946833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:27.946838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.946843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:27.946847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.946852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:27.946858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.946867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.946871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.946876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.946881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.946890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.946932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:27.949365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:27.949693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:27.949708Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:27.949711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:27.949714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:27.949722Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1682 [2:7559601690463860604:9633]
2025-10-10T14:35:27.949735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:27.949753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:27.949762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.949766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.949769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.949787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:27.949795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:27.949804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:27.949861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.949869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.949872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.949875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:27.949947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:27.949952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.949965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:27.949983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:27.950003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:27.950030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601690463860599:9633]
2025-10-10T14:35:27.950056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601690463860599:9633]
2025-10-10T14:35:27.950058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601690463860599:9633]
2025-10-10T14:35:27.950068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:27.950078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:27.950081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:27.950083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:27.950085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:27.950102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:27.950107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:27.950118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246085434:2438], now have 1 active actors on pipe
2025-10-10T14:35:27.950129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601691246085648:7889], now have 1 active actors on pipe
2025-10-10T14:35:27.950185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1682
2025-10-10T14:35:27.950224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1682
2025-10-10T14:35:27.950149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601690463860599:9633]
2025-10-10T14:35:27.950162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:27.950319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:27.950514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.950521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.950556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:27.950565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:27.950570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:27.950572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:27.950585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:27.950597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:27.950613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.951666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:27.951677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:27.951699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:27.951862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1683 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0
2025-10-10T14:35:27.952295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a1bd72-3d3b065e-8ea65709-a5630edc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:27.955110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0] Write session: try to update token
2025-10-10T14:35:27.955129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:27.970617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:27.970637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:27.970640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:27.970643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:27.970654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601690463860599:9633]
2025-10-10T14:35:27.970659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601690463860599:9633]
2025-10-10T14:35:27.970663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601690463860599:9633]
2025-10-10T14:35:27.970713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:27.970720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:27.970725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:27.970727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:27.970728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:27.970731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:27.970865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:27.971255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId: src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:27.973977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:28.020971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601695541053001:9869]
2025-10-10T14:35:28.021292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1682, pipe: [1:7559601695541053001:9869]
2025-10-10T14:35:28.086705Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:28.087377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.087395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.087444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053001:9869], now have 1 active actors on pipe
2025-10-10T14:35:28.087705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601695541053001:9869]
2025-10-10T14:35:28.087713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:28.087742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:28.087745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:28.087809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1683 reason: error at write: Disconnected sessionId: src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0
2025-10-10T14:35:28.088010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1683 sessionId: src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0 is DEAD
2025-10-10T14:35:28.087685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:28.088135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:28.088145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0] Write session will restart in 0.008049s
2025-10-10T14:35:28.088169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0] Write session: Do CDS request
2025-10-10T14:35:28.088178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:28.097878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.099532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:28.099549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1684
2025-10-10T14:35:28.099729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.099780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:28.099790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:28.099794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:28.100215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1684 sessionId:  describe result for acl check
2025-10-10T14:35:28.100252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:28.100253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:28.100255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:28.100263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601695541053046:7898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:28.100844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601695541053046:7898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:28.104039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601695541053046:7898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:28.107709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601695541053046:7898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:28.107725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601695541053046:7898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:28.107729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601695541053046:7898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:28.107767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:28.110294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:28.113069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:28.113318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:28.113348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:28.113364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:28.113436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:28.113484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601694758828168:9635]
2025-10-10T14:35:28.114119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:28.114433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:28.114484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:28.114808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:28.114880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.114882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.114883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.114884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.114886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.114887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.114888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.114890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.114891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.114892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.114894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.114895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.114897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.114903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.114916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.114920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.114923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.114928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.114932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.114936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.114940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.114944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.114950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.114954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.114958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.114961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.114970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.114979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.114986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.114991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.114996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.115002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.115007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.115012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.115017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.115023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.115028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.115034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.115039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.115045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.115052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.115058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.115063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.115068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.115072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.115078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.115083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.115088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.115093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.115099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.115104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.115110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.115151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:28.119746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:28.120430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:28.120444Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:28.120447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:28.120450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:28.120457Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1683 [2:7559601694758828168:9635]
2025-10-10T14:35:28.120473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:28.120492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:28.120500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.120503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.120506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.120524Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:28.120537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:28.120549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:28.120607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.120614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.120616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.120618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:28.120686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:28.120694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.120706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.120720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.120740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:28.120770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053002:2438], now have 1 active actors on pipe
2025-10-10T14:35:28.120779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053236:7898], now have 1 active actors on pipe
2025-10-10T14:35:28.120788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601694758828163:9635]
2025-10-10T14:35:28.120794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601694758828163:9635]
2025-10-10T14:35:28.120797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601694758828163:9635]
2025-10-10T14:35:28.120854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1683
2025-10-10T14:35:28.120883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1683
2025-10-10T14:35:28.120812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:28.120831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:28.120847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:28.120851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:28.120855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:28.120858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:28.120860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:28.120886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601694758828163:9635]
2025-10-10T14:35:28.120893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:28.120922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:28.121076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.121089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.121124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:28.121139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.121144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.121146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:28.121158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.121171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:28.121192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.121756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.121767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.121788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.121908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1684 partition: 0 MaxSeqNo: 40 sessionId: src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0
2025-10-10T14:35:28.122282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b212a03-e1c08658-cd52ec28-c0fc7e2e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:28.124892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0] Write session: try to update token
2025-10-10T14:35:28.124910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:28.140115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId: src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:28.142833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:28.144203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.144234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.144260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:28.144264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:28.144268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:28.144270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:28.144280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601694758828163:9635]
2025-10-10T14:35:28.144290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601694758828163:9635]
2025-10-10T14:35:28.144298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601694758828163:9635]
2025-10-10T14:35:28.144350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:28.144361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:28.144361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:28.144366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:28.144368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.144371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:28.144507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:28.188141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601695541053275:9869]
2025-10-10T14:35:28.188409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1683, pipe: [1:7559601695541053275:9869]
2025-10-10T14:35:28.261949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:28.262391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:28.262462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053275:9869], now have 1 active actors on pipe
2025-10-10T14:35:28.262592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:28.262686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:28.262735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601695541053275:9869]
2025-10-10T14:35:28.273355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:28.273371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:28.273399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1684 reason: error at write: Disconnected sessionId: src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0
2025-10-10T14:35:28.273557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1684 sessionId: src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0 is DEAD
2025-10-10T14:35:28.273704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:28.273716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0] Write session will restart in 0.009353s
2025-10-10T14:35:28.273742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0] Write session: Do CDS request
2025-10-10T14:35:28.273749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:28.283962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.284007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:28.284025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1685
2025-10-10T14:35:28.284242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.284278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:28.284289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:28.284293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:28.284758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1685 sessionId:  describe result for acl check
2025-10-10T14:35:28.284793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:28.284800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:28.284802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:28.284809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601695541053418:7885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:28.285366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601695541053418:7885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:28.288779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601695541053418:7885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:28.290456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:28.293400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:28.293767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:28.293779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:28.293774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601695541053418:7885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:28.293790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601695541053418:7885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:28.293794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601695541053418:7885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:28.293803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:28.293804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:28.293875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:28.293929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601694758828436:9637]
2025-10-10T14:35:28.294592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:28.294896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:28.294942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:28.295292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:28.295353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.295359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.295360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.295361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.295362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.295364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.295365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.295366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.295368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.295369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.295371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.295372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.295373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.295379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.295393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.295397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.295401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.295405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.295409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.295413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.295417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.295421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.295425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.295431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.295435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.295439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.295446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.295454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.295461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.295466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.295470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.295475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.295479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.295483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.295487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.295492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.295495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.295500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.295504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.295508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.295511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.295518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.295527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.295532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.295543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.295548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.295553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.295558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.295566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.295572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.295576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.295581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.295627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:28.298245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:28.298820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:28.298834Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:28.298836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:28.298840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:28.298847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1684 [2:7559601694758828436:9637]
2025-10-10T14:35:28.298861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:28.298881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:28.298884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.298888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.298890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.298922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:28.298935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:28.298943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:28.299004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.299011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.299013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.299015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:28.299087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:28.299099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.299112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.299123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.299139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:28.299165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601694758828431:9637]
2025-10-10T14:35:28.299173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601694758828431:9637]
2025-10-10T14:35:28.299175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601694758828431:9637]
2025-10-10T14:35:28.299191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:28.299203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:28.299205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053538:7885], now have 1 active actors on pipe
2025-10-10T14:35:28.299206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:28.299208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:28.299209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053276:2438], now have 1 active actors on pipe
2025-10-10T14:35:28.299217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:28.299232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:28.299236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:28.299267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601694758828431:9637]
2025-10-10T14:35:28.299275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:28.299277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:28.299235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1684
2025-10-10T14:35:28.299305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.299251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1684
2025-10-10T14:35:28.299310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.299350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:28.299367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.299375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.299377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:28.299387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.299398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:28.299422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.299602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.299610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.299627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.299715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1685 partition: 0 MaxSeqNo: 40 sessionId: src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0
2025-10-10T14:35:28.300100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6039c40-3e7f0fe3-57053ad4-ae236403_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:28.302813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0] Write session: try to update token
2025-10-10T14:35:28.302834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:28.316847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId: src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:28.318816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:28.318836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:28.318839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:28.318841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:28.318851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601694758828431:9637]
2025-10-10T14:35:28.318855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601694758828431:9637]
2025-10-10T14:35:28.318859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601694758828431:9637]
2025-10-10T14:35:28.318912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:28.318918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:28.318923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.318926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:28.318926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:28.318930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:28.319070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:28.319455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:28.362675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601695541053550:9869]
2025-10-10T14:35:28.362961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1684, pipe: [1:7559601695541053550:9869]
2025-10-10T14:35:28.432160Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:28.432523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.432537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.432578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053550:9869], now have 1 active actors on pipe
2025-10-10T14:35:28.432791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:28.432842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:28.432894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:28.432963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601695541053550:9869]
2025-10-10T14:35:28.432983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1685 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0
2025-10-10T14:35:28.433180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1685 sessionId: src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0 is DEAD
2025-10-10T14:35:28.433624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:28.433634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0] Write session will restart in 0.009984s
2025-10-10T14:35:28.433656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0] Write session: Do CDS request
2025-10-10T14:35:28.433663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:28.444940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.444965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:28.444983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1686
2025-10-10T14:35:28.445252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.445302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:28.445312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:28.445316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:28.445804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1686 sessionId:  describe result for acl check
2025-10-10T14:35:28.445840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:28.445846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:28.445848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:28.445855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601695541053640:7871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:28.446440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601695541053640:7871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:28.452283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601695541053640:7871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:28.454908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:28.457978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:28.458117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601695541053640:7871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:28.458134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601695541053640:7871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:28.458137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601695541053640:7871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:28.458146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:28.458359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:28.458374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:28.458390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:28.458474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:28.458526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601694758828745:9652]
2025-10-10T14:35:28.459096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:28.459404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:28.459453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:28.459764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:28.459826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.459832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.459833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.459834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.459835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.459836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.459837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.459838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.459839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.459841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.459842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.459843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.459844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.459850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.459862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.459866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.459869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.459872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.459876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.459879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.459882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.459885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.459891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.459894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.459897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.459900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.459908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.459916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.459922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.459927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.459931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.459935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.459939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.459943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.459947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.459952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.459956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.459960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.459964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.459968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.459972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.459976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.459980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.459984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.459988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.459992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.459996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.460000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.460017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.460022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.460026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.460035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.460069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:28.462413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:28.462967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:28.462976Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:28.462978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:28.462981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:28.462987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1685 [2:7559601694758828745:9652]
2025-10-10T14:35:28.463003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:28.463019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:28.463027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.463029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.463031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.463045Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:28.463054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:28.463060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:28.463101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.463105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.463106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.463108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:28.463157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:28.463164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.463174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.463187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.463209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:28.463234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053564:2438], now have 1 active actors on pipe
2025-10-10T14:35:28.463246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601694758828739:9652]
2025-10-10T14:35:28.463248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601694758828739:9652]
2025-10-10T14:35:28.463250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601694758828739:9652]
2025-10-10T14:35:28.463259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:28.463272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053837:7871], now have 1 active actors on pipe
2025-10-10T14:35:28.463279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:28.463282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:28.463284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:28.463285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:28.463299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:28.463307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:28.463297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1685
2025-10-10T14:35:28.463306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1685
2025-10-10T14:35:28.463328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601694758828739:9652]
2025-10-10T14:35:28.463341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:28.463349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:28.463361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.463367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.463418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57c1d4ee-c84486a1-529de786-c41b171d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:28.463429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.463433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.463436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:28.463446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.463461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:28.463480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.463688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.463695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.463710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.463845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1686 partition: 0 MaxSeqNo: 40 sessionId: src_id|57c1d4ee-c84486a1-529de786-c41b171d_0
2025-10-10T14:35:28.464284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cd5fe3-e116b988-9ded882d-932d336c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57c1d4ee-c84486a1-529de786-c41b171d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:28.467171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1d4ee-c84486a1-529de786-c41b171d_0] Write session: try to update token
2025-10-10T14:35:28.467192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1d4ee-c84486a1-529de786-c41b171d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:28.482342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId: src_id|57c1d4ee-c84486a1-529de786-c41b171d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:28.482614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:28.482633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:28.482636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:28.482638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:28.482648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601694758828739:9652]
2025-10-10T14:35:28.482653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601694758828739:9652]
2025-10-10T14:35:28.482656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601694758828739:9652]
2025-10-10T14:35:28.482705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:28.482708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:28.482716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.482718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:28.482727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:28.482732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:28.482857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:28.484862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:28.533198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601695541053849:9869]
2025-10-10T14:35:28.533453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1685, pipe: [1:7559601695541053849:9869]
2025-10-10T14:35:28.597885Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:28.598483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.598499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.598546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053849:9869], now have 1 active actors on pipe
2025-10-10T14:35:28.598824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:28.599644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1d4ee-c84486a1-529de786-c41b171d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:28.599655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1d4ee-c84486a1-529de786-c41b171d_0] Write session will restart in 0.006032s
2025-10-10T14:35:28.599679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1d4ee-c84486a1-529de786-c41b171d_0] Write session: Do CDS request
2025-10-10T14:35:28.599685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1d4ee-c84486a1-529de786-c41b171d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:28.599235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:28.599319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1686 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57c1d4ee-c84486a1-529de786-c41b171d_0
2025-10-10T14:35:28.599508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1686 sessionId: src_id|57c1d4ee-c84486a1-529de786-c41b171d_0 is DEAD
2025-10-10T14:35:28.599690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601695541053849:9869]
2025-10-10T14:35:28.599717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:28.606915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1d4ee-c84486a1-529de786-c41b171d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.607077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:28.607092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1687
2025-10-10T14:35:28.607233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.607269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:28.607282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:28.607286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:28.607784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1687 sessionId:  describe result for acl check
2025-10-10T14:35:28.607819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:28.607832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:28.607834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:28.607840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601695541053868:7866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:28.608385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601695541053868:7866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:28.611128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601695541053868:7866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:28.616732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601695541053868:7866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:28.616750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601695541053868:7866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:28.616754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601695541053868:7866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:28.616763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:28.622106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:28.624934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:28.625215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:28.625229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:28.625245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:28.625326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:28.625418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601694758829016:9654]
2025-10-10T14:35:28.626072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:28.626593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:28.626649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:28.626996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:28.627076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.627085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.627087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.627088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.627089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.627090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.627092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.627093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.627094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.627095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.627097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.627098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.627099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.627106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.627121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.627125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.627130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.627133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.627138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.627142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.627146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.627150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.627154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.627158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.627162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.627166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.627176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.627185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.627197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.627208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.627213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.627222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.627228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.627234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.627239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.627244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.627247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.627256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.627265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.627269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.627273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.627282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.627286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.627290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.627298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.627303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.627310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.627319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.627323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.627332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.627336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.627344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.627383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:28.629802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:28.630765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:28.630782Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:28.630784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:28.630788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:28.630795Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1686 [2:7559601694758829016:9654]
2025-10-10T14:35:28.630809Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:28.630829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:28.630832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.630835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.630838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.630854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:28.630867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:28.630875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:28.630938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.630944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.630946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.630949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:28.631141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1686
2025-10-10T14:35:28.631156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1686
2025-10-10T14:35:28.631242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:28.631250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.631263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.631274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.631291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:28.631315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541054036:7866], now have 1 active actors on pipe
2025-10-10T14:35:28.631318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541053850:2438], now have 1 active actors on pipe
2025-10-10T14:35:28.631339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.631343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.631364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601694758829011:9654]
2025-10-10T14:35:28.631366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601694758829011:9654]
2025-10-10T14:35:28.631367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601694758829011:9654]
2025-10-10T14:35:28.631381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:28.631392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:28.631394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:28.631395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:28.631396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:28.631410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:28.631413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:28.631435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:28.631449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.631452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.631454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:28.631466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.631478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:28.631516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601694758829011:9654]
2025-10-10T14:35:28.631527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:28.631533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:28.631539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.631708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.631720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.631739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.631862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1687 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0
2025-10-10T14:35:28.632268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c1d4ee-c84486a1-529de786-c41b171d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:28.634858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0] Write session: try to update token
2025-10-10T14:35:28.634877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:28.642838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:28.642853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:28.642863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601694758829011:9654]
2025-10-10T14:35:28.642901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:28.642912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:28.643154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:28.643299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:28.643434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:28.643572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:28.643811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:28.643853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:28.648859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId: src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:28.651658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:28.651881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.651903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.651948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:28.652033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:28.660376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:28.660396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:28.660399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:28.660401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:28.660411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601694758829011:9654]
2025-10-10T14:35:28.660414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601694758829011:9654]
2025-10-10T14:35:28.660418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601694758829011:9654]
2025-10-10T14:35:28.660464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:28.660472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.660475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:28.660475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:28.660482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:28.660487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:28.660611Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:28.700103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601695541054132:9869]
2025-10-10T14:35:28.700319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1686, pipe: [1:7559601695541054132:9869]
2025-10-10T14:35:28.770843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:28.777505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.777531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.777706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.777768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.777830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.777896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.777946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.777951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.778020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.778083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.778147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.778231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.778279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.778281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.778350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.778412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.778476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.778540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.778583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.778590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.778659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.778721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.778785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.778852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.778900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.778907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.778974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.779034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.779098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.779160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.779203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.779211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.779280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.779340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.779410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.779472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.779517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.779524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.779589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.779647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.779707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.779764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.779811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.779816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.779872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.779926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.779983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.780041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.780190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.780199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.780257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.780323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.780384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.780446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.780488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.780494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.780562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:28.780618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:28.780683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:28.780743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:28.780784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:28.780791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:28.780839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541054132:9869], now have 1 active actors on pipe
2025-10-10T14:35:28.781093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:28.781104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601695541054132:9869]
2025-10-10T14:35:28.781110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:28.781125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:28.781149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1687 reason: error at write: Disconnected sessionId: src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0
2025-10-10T14:35:28.781528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1687 sessionId: src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0 is DEAD
2025-10-10T14:35:28.781580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:28.781591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0] Write session will restart in 0.009747s
2025-10-10T14:35:28.781617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0] Write session: Do CDS request
2025-10-10T14:35:28.781622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:28.781906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:28.793808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.793859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:28.793884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1688
2025-10-10T14:35:28.794105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.794162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:28.794174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:28.794179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:28.794725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1688 sessionId:  describe result for acl check
2025-10-10T14:35:28.794767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:28.794778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:28.794781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:28.794788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601695541054223:7846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:28.795418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601695541054223:7846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:28.798760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601695541054223:7846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:28.806737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:28.806742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601695541054223:7846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:28.806761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601695541054223:7846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:28.806765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601695541054223:7846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:28.806775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:28.810939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:28.811194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:28.811205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:28.811217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:28.811278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:28.811322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601694758829303:9657]
2025-10-10T14:35:28.811959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:28.812255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:28.812297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:28.812614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:28.812671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.812679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.812680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.812681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.812683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.812684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.812686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.812687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.812688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.812689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.812691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.812692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.812693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.812699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.812712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.812716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.812721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.812726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.812730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.812735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.812739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.812743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.812748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.812752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.812757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.812761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.812769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.812778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.812784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.812791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.812796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.812801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.812806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.812812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.812818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.812823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.812827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.812831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.812839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.812844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.812847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.812852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.812857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.812862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.812866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.812878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.812882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.812887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.812892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.812900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.812905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.812910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.812954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:28.815445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:28.815916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:28.815927Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:28.815930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:28.815934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:28.815941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1687 [2:7559601694758829303:9657]
2025-10-10T14:35:28.815955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:28.815988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:28.815995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.815999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.816005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.816028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:28.816040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:28.816049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:28.816110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.816117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.816119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.816122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:28.816191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:28.816198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.816211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.816224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.816247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:28.816273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541054412:7846], now have 1 active actors on pipe
2025-10-10T14:35:28.816281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541054149:2438], now have 1 active actors on pipe
2025-10-10T14:35:28.816289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601694758829296:9657]
2025-10-10T14:35:28.816296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601694758829296:9657]
2025-10-10T14:35:28.816298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601694758829296:9657]
2025-10-10T14:35:28.816313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:28.816334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:28.816336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:28.816340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:28.816342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:28.816333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1687
2025-10-10T14:35:28.816352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:28.816356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:28.816348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1687
2025-10-10T14:35:28.816385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601694758829296:9657]
2025-10-10T14:35:28.816392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:28.816394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:28.816410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.816423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.816476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fe83610-e4355403-3afe96b-536c3aec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:28.816488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.816492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.816495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:28.816507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.816520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:28.816557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.816710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.816717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.816731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.816812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1688 partition: 0 MaxSeqNo: 40 sessionId: src_id|6fe83610-e4355403-3afe96b-536c3aec_0
2025-10-10T14:35:28.817282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e75b19-384bc035-fcc3f561-989bdbcc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6fe83610-e4355403-3afe96b-536c3aec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:28.820187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe83610-e4355403-3afe96b-536c3aec_0] Write session: try to update token
2025-10-10T14:35:28.820213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe83610-e4355403-3afe96b-536c3aec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:28.836178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:28.836197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:28.836201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:28.836203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:28.836213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601694758829296:9657]
2025-10-10T14:35:28.836217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601694758829296:9657]
2025-10-10T14:35:28.836221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601694758829296:9657]
2025-10-10T14:35:28.836268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:28.836274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:28.836275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:28.836277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:28.836285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.836288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:28.836427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:28.836678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId: src_id|6fe83610-e4355403-3afe96b-536c3aec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:28.839563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:28.881402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601695541054425:9869]
2025-10-10T14:35:28.881735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1687, pipe: [1:7559601695541054425:9869]
2025-10-10T14:35:28.947790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:28.948280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.948313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.948370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541054425:9869], now have 1 active actors on pipe
2025-10-10T14:35:28.948654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:28.948658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:28.948663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:28.948710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601695541054425:9869]
2025-10-10T14:35:28.948724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1688 reason: error at write: Disconnected sessionId: src_id|6fe83610-e4355403-3afe96b-536c3aec_0
2025-10-10T14:35:28.948615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:28.948976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1688 sessionId: src_id|6fe83610-e4355403-3afe96b-536c3aec_0 is DEAD
2025-10-10T14:35:28.949156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe83610-e4355403-3afe96b-536c3aec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:28.949167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe83610-e4355403-3afe96b-536c3aec_0] Write session will restart in 0.007699s
2025-10-10T14:35:28.949194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe83610-e4355403-3afe96b-536c3aec_0] Write session: Do CDS request
2025-10-10T14:35:28.949200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe83610-e4355403-3afe96b-536c3aec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:28.957942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe83610-e4355403-3afe96b-536c3aec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.958074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:28.958091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1689
2025-10-10T14:35:28.958237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:28.958271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:28.958284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:28.958289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:28.958731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1689 sessionId:  describe result for acl check
2025-10-10T14:35:28.958769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:28.958771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:28.958772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:28.958778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601695541054444:7843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:28.959315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601695541054444:7843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:28.961811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601695541054444:7843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:28.965962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601695541054444:7843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:28.965978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601695541054444:7843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:28.965982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601695541054444:7843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:28.965991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:28.971871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:28.975098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:28.975337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:28.975347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:28.975360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:28.975420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:28.975459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601694758829576:9660]
2025-10-10T14:35:28.976088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:28.976420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:28.976462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:28.976780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:28.976838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.976844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.976845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.976846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.976847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.976848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.976850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.976851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.976852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.976853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.976854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.976855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.976856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.976862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.976875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.976878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.976882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.976885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.976889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.976892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.976896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.976900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.976904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.976907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.976911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.976915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.976923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.976931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:28.976939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.976944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:28.976950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.976955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:28.976959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.976964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:28.976970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.976975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:28.976979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.976984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:28.976989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.976995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:28.976999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.977004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:28.977009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.977014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:28.977026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.977032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:28.977036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.977046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.977051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.977056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.977061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.977068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.977112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:28.980047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:28.980395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:28.980408Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:28.980410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:28.980414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:28.980422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1688 [2:7559601694758829576:9660]
2025-10-10T14:35:28.980436Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:28.980456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:28.980465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.980469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.980472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.980491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:28.980502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:28.980509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:28.980582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.980591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.980593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.980605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:28.980683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:28.980689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:28.980700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:28.980719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:28.980741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:28.980765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541054572:7843], now have 1 active actors on pipe
2025-10-10T14:35:28.980773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601695541054426:2438], now have 1 active actors on pipe
2025-10-10T14:35:28.980781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601694758829570:9660]
2025-10-10T14:35:28.980788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601694758829570:9660]
2025-10-10T14:35:28.980790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601694758829570:9660]
2025-10-10T14:35:28.980805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:28.980823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:28.980827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:28.980831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:28.980833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:28.980842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:28.980846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:28.980855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1688
2025-10-10T14:35:28.980877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601694758829570:9660]
2025-10-10T14:35:28.980884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:28.980896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:28.980912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.980922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.980936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1688
2025-10-10T14:35:28.980960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:28.980972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:28.980976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:28.980979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:28.980991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:28.981002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:28.981036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.981221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:28.981232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:28.981255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:28.981364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1689 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0
2025-10-10T14:35:28.981753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe83610-e4355403-3afe96b-536c3aec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:28.984664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0] Write session: try to update token
2025-10-10T14:35:28.984686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:28.999953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId: src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:29.001199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:29.001222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:29.001226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:29.001227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:29.001237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601694758829570:9660]
2025-10-10T14:35:29.001242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601694758829570:9660]
2025-10-10T14:35:29.001246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601694758829570:9660]
2025-10-10T14:35:29.001301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:29.001308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.001318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:29.001485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:29.002546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:29.002675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:29.002688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:29.002692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:29.048833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601699836021999:9869]
2025-10-10T14:35:29.049120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1688, pipe: [1:7559601699836021999:9869]
2025-10-10T14:35:29.115465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:29.116196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.116215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.116266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836021999:9869], now have 1 active actors on pipe
2025-10-10T14:35:29.116524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:29.116538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:29.116610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1689 reason: error at write: Disconnected sessionId: src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0
2025-10-10T14:35:29.116671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:29.116825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1689 sessionId: src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0 is DEAD
2025-10-10T14:35:29.116963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:29.116974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0] Write session will restart in 0.005934s
2025-10-10T14:35:29.116982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:29.116992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601699836021999:9869]
2025-10-10T14:35:29.117007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0] Write session: Do CDS request
2025-10-10T14:35:29.117016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:29.123880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.124880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:29.124896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1690
2025-10-10T14:35:29.125286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.125350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:29.125362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:29.125367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:29.125810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1690 sessionId:  describe result for acl check
2025-10-10T14:35:29.125844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:29.125855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:29.125857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:29.125863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601699836022016:7835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:29.126403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601699836022016:7835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:29.135220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601699836022016:7835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:29.140531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601699836022016:7835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:29.140550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601699836022016:7835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:29.140553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601699836022016:7835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:29.140564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:29.145826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:29.149184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:29.149476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:29.149482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:29.149497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:29.149567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:29.149609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601699053797146:9662]
2025-10-10T14:35:29.150269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:29.150665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:29.150725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:29.151097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:29.151176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.151184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.151185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.151187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.151189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.151190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.151191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.151193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.151194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.151195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.151197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.151198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.151199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.151206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.151220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.151224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.151227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.151231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.151234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.151238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.151242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.151246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.151253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.151257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.151260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.151264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.151273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.151282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.151289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.151295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.151300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.151304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.151308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.151316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.151327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.151333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.151343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.151349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.151359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.151365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.151375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.151381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.151386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.151397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.151407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.151417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.151421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.151431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.151439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.151444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.151449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.151457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.151499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:29.154165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:29.154657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:29.154669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:29.154672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:29.154675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:29.154682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1689 [2:7559601699053797146:9662]
2025-10-10T14:35:29.154696Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:29.154714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:29.154721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.154725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.154728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.154746Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:29.154754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:29.154768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:29.155131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.155147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.155149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.155152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:29.155228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:29.155238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.155251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.155264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.155284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:29.155313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022000:2438], now have 1 active actors on pipe
2025-10-10T14:35:29.155317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022209:7835], now have 1 active actors on pipe
2025-10-10T14:35:29.155331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601699053797141:9662]
2025-10-10T14:35:29.155337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601699053797141:9662]
2025-10-10T14:35:29.155339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601699053797141:9662]
2025-10-10T14:35:29.155353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:29.155373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:29.155395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:29.155399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:29.155402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:29.155404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:29.155404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:29.155368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1689
2025-10-10T14:35:29.155410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1689
2025-10-10T14:35:29.155436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601699053797141:9662]
2025-10-10T14:35:29.155449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:29.155463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:29.155465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.155470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.155516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:29.155529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.155533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.155536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:29.155548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.155559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:29.155576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.155731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.155739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.155755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.155863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1690 partition: 0 MaxSeqNo: 40 sessionId: src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0
2025-10-10T14:35:29.156290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a13062-d0c873cb-2c3dc63e-5ba3865_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:29.159036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0] Write session: try to update token
2025-10-10T14:35:29.159056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:29.173607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId: src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:29.174840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:29.174854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:29.174857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:29.174859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:29.174867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601699053797141:9662]
2025-10-10T14:35:29.174871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601699053797141:9662]
2025-10-10T14:35:29.174874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601699053797141:9662]
2025-10-10T14:35:29.174924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:29.174936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.174939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:29.175082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:29.175177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:29.175205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:29.175209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:29.176465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:29.217234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601699836022279:9869]
2025-10-10T14:35:29.217566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1689, pipe: [1:7559601699836022279:9869]
2025-10-10T14:35:29.287924Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:29.288429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.288445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.288495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022279:9869], now have 1 active actors on pipe
2025-10-10T14:35:29.288722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:29.288744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:29.288745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601699836022279:9869]
2025-10-10T14:35:29.288771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:29.288773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:29.289207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:29.289217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0] Write session will restart in 0.008130s
2025-10-10T14:35:29.289261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0] Write session: Do CDS request
2025-10-10T14:35:29.288837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1690 reason: error at write: Disconnected sessionId: src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0
2025-10-10T14:35:29.289068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1690 sessionId: src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0 is DEAD
2025-10-10T14:35:29.289267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:29.298937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.299112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:29.299128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1691
2025-10-10T14:35:29.299269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.299315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:29.299321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:29.299325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:29.299867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1691 sessionId:  describe result for acl check
2025-10-10T14:35:29.299909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:29.299911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:29.299913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:29.299920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601699836022294:7830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:29.300500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601699836022294:7830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:29.303003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601699836022294:7830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:29.306987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601699836022294:7830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:29.307007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601699836022294:7830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:29.307011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601699836022294:7830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:29.307020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:29.315248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:29.318025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:29.318251Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:29.318261Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:29.318272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:29.318323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:29.318364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601699053797421:9664]
2025-10-10T14:35:29.319016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:29.319324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:29.319379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:29.319687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:29.319738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.319744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.319745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.319746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.319747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.319749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.319750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.319751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.319753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.319754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.319755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.319757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.319757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.319767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.319780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.319784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.319788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.319793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.319797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.319800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.319804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.319807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.319811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.319815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.319819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.319822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.319829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.319838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.319843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.319849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.319854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.319858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.319861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.319867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.319871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.319875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.319880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.319885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.319889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.319893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.319897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.319903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.319907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.319912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.319915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.319920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.319923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.319929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.319934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.319938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.319942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.319947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.319982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:29.322651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:29.322988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:29.323001Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:29.323004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:29.323008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:29.323015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1690 [2:7559601699053797421:9664]
2025-10-10T14:35:29.323028Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:29.323047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:29.323050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.323054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.323057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.323075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:29.323091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:29.323100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:29.323163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.323173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.323176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.323178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:29.323261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:29.323269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.323281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.323296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.323310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:29.323340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022280:2438], now have 1 active actors on pipe
2025-10-10T14:35:29.323346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022414:7830], now have 1 active actors on pipe
2025-10-10T14:35:29.323354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601699053797416:9664]
2025-10-10T14:35:29.323356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601699053797416:9664]
2025-10-10T14:35:29.323359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601699053797416:9664]
2025-10-10T14:35:29.323373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:29.323391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:29.323392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:29.323396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:29.323399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:29.323407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:29.323411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:29.323443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601699053797416:9664]
2025-10-10T14:35:29.323463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:29.323469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:29.323592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1690
2025-10-10T14:35:29.323594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1690
2025-10-10T14:35:29.323678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.323690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.323728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:29.323751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.323760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.323762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:29.323775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.323787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:29.323804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.323998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.324009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.324030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.324165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1691 partition: 0 MaxSeqNo: 40 sessionId: src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0
2025-10-10T14:35:29.324654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b73ec9ab-a27ee071-b0d4e6ee-3bf6c82d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:29.327503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0] Write session: try to update token
2025-10-10T14:35:29.327529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:29.335524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:29.335549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:29.335560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601699053797416:9664]
2025-10-10T14:35:29.335607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:29.335607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:29.335779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:29.335929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:29.336063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:29.336201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:29.336391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:29.336433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:29.345133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId: src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:29.347932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:29.348331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.348353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.348398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:29.348504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:29.354826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:29.354847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:29.354852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:29.354854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:29.354866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601699053797416:9664]
2025-10-10T14:35:29.354871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601699053797416:9664]
2025-10-10T14:35:29.354875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601699053797416:9664]
2025-10-10T14:35:29.354932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:29.354942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.354943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:29.354945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:29.354951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:29.354958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:29.355083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:29.388726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601699836022560:9869]
2025-10-10T14:35:29.389106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1690, pipe: [1:7559601699836022560:9869]
2025-10-10T14:35:29.472509Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:29.481447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.481478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.481659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.481720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.481781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.481842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.481886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.481893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.481967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.482023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.482080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.482147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.482187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.482206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.482275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.482333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.482397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.482461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.482503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.482506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.482578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.482640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.482701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.482762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.482805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.482809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.482877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.482936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.482997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.483057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.483099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.483102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.483170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.483230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.483290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.483348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.483395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.483398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.483468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.483527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.483946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.485500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601699836022560:9869]
2025-10-10T14:35:29.485541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:29.485544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:29.484009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.484047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.484050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.484119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.484175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.484237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.484299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.484342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.484345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.484414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.484471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.484536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.484597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.484640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.484643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.484713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:29.484772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:29.484830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:29.484890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:29.484933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:29.484938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:29.485012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022560:9869], now have 1 active actors on pipe
2025-10-10T14:35:29.485563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:29.485586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1691 reason: error at write: Disconnected sessionId: src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0
2025-10-10T14:35:29.485817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1691 sessionId: src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0 is DEAD
2025-10-10T14:35:29.485893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:29.486141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:29.486155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0] Write session will restart in 0.005023s
2025-10-10T14:35:29.486179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0] Write session: Do CDS request
2025-10-10T14:35:29.486186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:29.493814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.497300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:29.497328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1692
2025-10-10T14:35:29.497532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.497582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:29.497593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:29.497598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:29.498359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1692 sessionId:  describe result for acl check
2025-10-10T14:35:29.498398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:29.498405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:29.498407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:29.498414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601699836022619:7808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:29.499007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601699836022619:7808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:29.501594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601699836022619:7808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:29.505062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601699836022619:7808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:29.505079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601699836022619:7808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:29.505083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601699836022619:7808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:29.505092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:29.514294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:29.517413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:29.517757Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:29.517781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:29.517806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:29.517919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:29.517982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601699053797735:9679]
2025-10-10T14:35:29.518766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:29.521692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:29.521760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:29.522149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:29.522243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.522244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.522245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.522247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.522248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.522249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.522251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.522252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.522254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.522255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.522256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.522257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.522258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.522266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.522280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.522284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.522288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.522291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.522295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.522299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.522302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.522306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.522310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.522314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.522318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.522321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.522331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.522340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.522348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.522354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.522365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.522373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.522379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.522384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.522390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.522395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.522400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.522405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.522410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.522415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.522422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.522427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.522432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.522437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.522442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.522448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.522452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.522458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.522462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.522468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.522473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.522479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.522516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:29.528530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1691
2025-10-10T14:35:29.528544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1691
2025-10-10T14:35:29.527591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:29.528101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:29.528107Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:29.528110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:29.528114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:29.528121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1691 [2:7559601699053797735:9679]
2025-10-10T14:35:29.528136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:29.528157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:29.528161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.528165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.528167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.528185Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:29.528193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:29.528202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:29.528263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.528265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.528267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.528270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:29.528349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:29.528352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.528367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.528380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.528398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:29.528421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022780:7808], now have 1 active actors on pipe
2025-10-10T14:35:29.528425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022579:2438], now have 1 active actors on pipe
2025-10-10T14:35:29.528434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601699053797730:9679]
2025-10-10T14:35:29.528436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601699053797730:9679]
2025-10-10T14:35:29.528438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601699053797730:9679]
2025-10-10T14:35:29.528452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:29.528467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:29.528468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:29.528470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:29.528472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:29.528486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:29.528489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:29.528525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601699053797730:9679]
2025-10-10T14:35:29.528533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:29.528552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:29.528586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.528592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.528629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2892abf6-7875eacc-318e09c9-202b4416_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:29.528637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.528641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.528644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:29.528655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.528666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:29.528682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.528803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.528809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.528829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.528913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1692 partition: 0 MaxSeqNo: 40 sessionId: src_id|2892abf6-7875eacc-318e09c9-202b4416_0
2025-10-10T14:35:29.529430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd4b94c-84046adc-b21bc0ba-d0cc016_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2892abf6-7875eacc-318e09c9-202b4416_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:29.532116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2892abf6-7875eacc-318e09c9-202b4416_0] Write session: try to update token
2025-10-10T14:35:29.532139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2892abf6-7875eacc-318e09c9-202b4416_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:29.548460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId: src_id|2892abf6-7875eacc-318e09c9-202b4416_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:29.548931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:29.548951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:29.548954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:29.548957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:29.548967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601699053797730:9679]
2025-10-10T14:35:29.548973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601699053797730:9679]
2025-10-10T14:35:29.548977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601699053797730:9679]
2025-10-10T14:35:29.549029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:29.549036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.549039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:29.549189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:29.551332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:29.551346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:29.551351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:29.551169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:29.585866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601699836022866:9869]
2025-10-10T14:35:29.586147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1691, pipe: [1:7559601699836022866:9869]
2025-10-10T14:35:29.665859Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:29.666518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.666535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.666582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022866:9869], now have 1 active actors on pipe
2025-10-10T14:35:29.666844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:29.666862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:29.666875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601699836022866:9869]
2025-10-10T14:35:29.666893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:29.666925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1692 reason: error at write: Disconnected sessionId: src_id|2892abf6-7875eacc-318e09c9-202b4416_0
2025-10-10T14:35:29.667157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1692 sessionId: src_id|2892abf6-7875eacc-318e09c9-202b4416_0 is DEAD
2025-10-10T14:35:29.666806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:29.667349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2892abf6-7875eacc-318e09c9-202b4416_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:29.667361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2892abf6-7875eacc-318e09c9-202b4416_0] Write session will restart in 0.006928s
2025-10-10T14:35:29.667386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2892abf6-7875eacc-318e09c9-202b4416_0] Write session: Do CDS request
2025-10-10T14:35:29.667392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2892abf6-7875eacc-318e09c9-202b4416_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:29.675901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2892abf6-7875eacc-318e09c9-202b4416_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.676021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:29.676041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1693
2025-10-10T14:35:29.676203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.676238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:29.676250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:29.676254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:29.676746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1693 sessionId:  describe result for acl check
2025-10-10T14:35:29.676800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:29.676807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:29.676809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:29.676815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601699836022892:7805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:29.677521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601699836022892:7805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:29.680521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601699836022892:7805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:29.683639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601699836022892:7805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:29.683653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601699836022892:7805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:29.683657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601699836022892:7805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:29.683667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:29.690720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:29.694143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:29.694395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:29.694408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:29.694420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:29.694472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:29.694514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601699053798012:9681]
2025-10-10T14:35:29.695162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:29.695668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:29.695726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:29.696080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:29.696140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.696141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.696142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.696144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.696145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.696146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.696147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.696148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.696149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.696150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.696151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.696153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.696154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.696162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.696176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.696180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.696184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.696188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.696193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.696196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.696200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.696203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.696207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.696210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.696213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.696217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.696226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.696235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.696242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.696248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.696253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.696259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.696263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.696269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.696274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.696278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.696282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.696287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.696291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.696296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.696302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.696307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.696311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.696317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.696321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.696326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.696331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.696336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.696342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.696347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.696352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.696357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.696394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:29.699119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:29.699481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:29.699492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:29.699496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:29.699500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:29.699507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1692 [2:7559601699053798012:9681]
2025-10-10T14:35:29.699521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:29.699540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:29.699547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.699551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.699553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.699573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:29.699584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:29.699593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:29.699660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.699669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.699671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.699674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:29.699803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:29.699812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.699823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.699838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.699858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:29.699888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836022875:2438], now have 1 active actors on pipe
2025-10-10T14:35:29.699896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836023022:7805], now have 1 active actors on pipe
2025-10-10T14:35:29.699905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601699053798007:9681]
2025-10-10T14:35:29.699907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601699053798007:9681]
2025-10-10T14:35:29.699909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601699053798007:9681]
2025-10-10T14:35:29.699893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1692
2025-10-10T14:35:29.699893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1692
2025-10-10T14:35:29.699926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:29.699941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:29.699945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:29.699947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:29.699947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:29.699965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:29.699968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:29.700015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.700024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.700042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601699053798007:9681]
2025-10-10T14:35:29.700054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:29.700066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:29.700094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83ccbb72-162d2963-6518f487-7871696d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:29.700107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.700110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.700113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:29.700126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.700141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:29.700167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.700321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.700329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.700344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.700448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1693 partition: 0 MaxSeqNo: 40 sessionId: src_id|83ccbb72-162d2963-6518f487-7871696d_0
2025-10-10T14:35:29.700904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2892abf6-7875eacc-318e09c9-202b4416_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|83ccbb72-162d2963-6518f487-7871696d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:29.703646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ccbb72-162d2963-6518f487-7871696d_0] Write session: try to update token
2025-10-10T14:35:29.703670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ccbb72-162d2963-6518f487-7871696d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:29.719650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:29.719669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:29.719673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:29.719674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:29.719685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601699053798007:9681]
2025-10-10T14:35:29.719691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601699053798007:9681]
2025-10-10T14:35:29.719695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601699053798007:9681]
2025-10-10T14:35:29.719747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:29.719755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.719758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:29.719779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:29.719814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:29.719821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:29.719913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:29.720734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId: src_id|83ccbb72-162d2963-6518f487-7871696d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:29.723289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:29.769399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601699836023171:9869]
2025-10-10T14:35:29.772579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1692, pipe: [1:7559601699836023171:9869]
2025-10-10T14:35:29.845007Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:29.845295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.845312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.845375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836023171:9869], now have 1 active actors on pipe
2025-10-10T14:35:29.845611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:29.845669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:29.845676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:29.846120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ccbb72-162d2963-6518f487-7871696d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:29.846132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ccbb72-162d2963-6518f487-7871696d_0] Write session will restart in 0.006703s
2025-10-10T14:35:29.846157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ccbb72-162d2963-6518f487-7871696d_0] Write session: Do CDS request
2025-10-10T14:35:29.846163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ccbb72-162d2963-6518f487-7871696d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:29.845742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1693 reason: error at write: Disconnected sessionId: src_id|83ccbb72-162d2963-6518f487-7871696d_0
2025-10-10T14:35:29.845921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601699836023171:9869]
2025-10-10T14:35:29.845959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1693 sessionId: src_id|83ccbb72-162d2963-6518f487-7871696d_0 is DEAD
2025-10-10T14:35:29.846100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:29.853983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ccbb72-162d2963-6518f487-7871696d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.854081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:29.854114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1694
2025-10-10T14:35:29.854274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:29.854314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:29.854325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:29.854329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:29.854729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1694 sessionId:  describe result for acl check
2025-10-10T14:35:29.854768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:29.854776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:29.854778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:29.854786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601699836023189:7799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:29.855346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601699836023189:7799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:29.859520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601699836023189:7799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:29.865931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601699836023189:7799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:29.865950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601699836023189:7799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:29.865954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601699836023189:7799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:29.865965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:29.878267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:29.882550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:29.882829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:29.882839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:29.882852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:29.882909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:29.882952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601699053798305:9685]
2025-10-10T14:35:29.883571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:29.883878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:29.883938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:29.884278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:29.884346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.884351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.884352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.884354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.884355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.884356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.884357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.884359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.884360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.884361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.884363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.884364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.884365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.884372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.884385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.884389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.884393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.884397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.884401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.884405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.884408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.884411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.884415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.884419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.884423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.884426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.884435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.884444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:29.884452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.884458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:29.884463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.884469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:29.884473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.884478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:29.884483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.884488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:29.884492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.884497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:29.884501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.884506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:29.884517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.884523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:29.884527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.884531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:29.884535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.884551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:29.884560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.884565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.884571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.884580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.884586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.884592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.884635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:29.887401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:29.887752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:29.887763Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:29.887766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:29.887770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:29.887777Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1693 [2:7559601699053798305:9685]
2025-10-10T14:35:29.887790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:29.887811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:29.887819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.887823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.887825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.887856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:29.887868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:29.887876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:29.887949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.887967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.887970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.887972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:29.888044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:29.888051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.888063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:29.888083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:29.888109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:29.888143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836023174:2438], now have 1 active actors on pipe
2025-10-10T14:35:29.888149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836023325:7799], now have 1 active actors on pipe
2025-10-10T14:35:29.888157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601699053798300:9685]
2025-10-10T14:35:29.888160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601699053798300:9685]
2025-10-10T14:35:29.888162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601699053798300:9685]
2025-10-10T14:35:29.888175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:29.888166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1693
2025-10-10T14:35:29.888202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1693
2025-10-10T14:35:29.888190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:29.888205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:29.888207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:29.888208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:29.888210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:29.888212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:29.888234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601699053798300:9685]
2025-10-10T14:35:29.888237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:29.888239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:29.888256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.888261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.888615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:29.888629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:29.888634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:29.888636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:29.888649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:29.888661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:29.888684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.888900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:29.888908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:29.888925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:29.889032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1694 partition: 0 MaxSeqNo: 40 sessionId: src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0
2025-10-10T14:35:29.889501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ccbb72-162d2963-6518f487-7871696d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:29.892204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0] Write session: try to update token
2025-10-10T14:35:29.892223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:29.907907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId: src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:29.909038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:29.909060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:29.909064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:29.909067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:29.909077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601699053798300:9685]
2025-10-10T14:35:29.909082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601699053798300:9685]
2025-10-10T14:35:29.909086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601699053798300:9685]
2025-10-10T14:35:29.909141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:29.909157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:29.909160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:29.909161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:29.909168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:29.909171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:29.909298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:29.910640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:29.945775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601699836023455:9869]
2025-10-10T14:35:29.946139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1693, pipe: [1:7559601699836023455:9869]
2025-10-10T14:35:30.023197Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:30.023689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.023709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.023758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601699836023455:9869], now have 1 active actors on pipe
2025-10-10T14:35:30.024081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:30.024076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:30.024107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:30.024111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:30.024150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601699836023455:9869]
2025-10-10T14:35:30.024197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1694 reason: error at write: Disconnected sessionId: src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0
2025-10-10T14:35:30.024414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1694 sessionId: src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0 is DEAD
2025-10-10T14:35:30.024572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:30.024584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0] Write session will restart in 0.008806s
2025-10-10T14:35:30.024610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0] Write session: Do CDS request
2025-10-10T14:35:30.024619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:30.034988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.035084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:30.035116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1695
2025-10-10T14:35:30.035278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.035313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:30.035320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:30.035325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:30.035937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1695 sessionId:  describe result for acl check
2025-10-10T14:35:30.035973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:30.035975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:30.035977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:30.035984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601704130990779:7795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:30.036565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601704130990779:7795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:30.040977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601704130990779:7795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:30.047458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601704130990779:7795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:30.047475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601704130990779:7795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:30.047479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601704130990779:7795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:30.047489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:30.056389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:30.059911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:30.060158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:30.060169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:30.060181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:30.060251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:30.060305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601703348765880:9687]
2025-10-10T14:35:30.061033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:30.061432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:30.061483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:30.061839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:30.061928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.061930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.061931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.061933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.061934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.061936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.061938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.061939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.061941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.061943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.061944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.061946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.061947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.061954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.061965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.061969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.061974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.061977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.061981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.061985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.061989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.061993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.061997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.062001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.062005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.062008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.062016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.062024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.062031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.062037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.062042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.062048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.062054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.062059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.062065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.062070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.062075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.062080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.062085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.062091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.062099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.062105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.062111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.062117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.062122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.062129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.062134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.062139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.062144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.062150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.062159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.062164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.062222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:30.065355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:30.065764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:30.065781Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:30.065784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:30.065789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:30.065799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1694 [2:7559601703348765880:9687]
2025-10-10T14:35:30.065815Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:30.065834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:30.065838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.065842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.065845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.065861Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:30.065868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:30.065878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:30.065965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.065975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.065978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.065981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:30.066069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:30.066079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.066091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.066104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.066130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:30.066155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130990753:2438], now have 1 active actors on pipe
2025-10-10T14:35:30.066160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130990891:7795], now have 1 active actors on pipe
2025-10-10T14:35:30.066167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601703348765875:9687]
2025-10-10T14:35:30.066185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601703348765875:9687]
2025-10-10T14:35:30.066188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601703348765875:9687]
2025-10-10T14:35:30.066204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:30.066219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:30.066227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:30.066231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:30.066234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:30.066237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:30.066238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:30.066221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1694
2025-10-10T14:35:30.066256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1694
2025-10-10T14:35:30.066276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601703348765875:9687]
2025-10-10T14:35:30.066287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:30.066288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:30.066320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.066330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.066365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:30.066378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.066382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.066385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:30.066396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.066414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:30.066437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.066660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.066680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.066706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.066852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1695 partition: 0 MaxSeqNo: 40 sessionId: src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0
2025-10-10T14:35:30.067433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f69d4e6-1f21ad57-a332557a-8c482e50_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:30.070226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0] Write session: try to update token
2025-10-10T14:35:30.070248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:30.084853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId: src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:30.087536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:30.087557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:30.087560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:30.087563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:30.087574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601703348765875:9687]
2025-10-10T14:35:30.087579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601703348765875:9687]
2025-10-10T14:35:30.087583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601703348765875:9687]
2025-10-10T14:35:30.087637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:30.087646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.087649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:30.087658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:30.087665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:30.087671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:30.087792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:30.087790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:30.124486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601704130991038:9869]
2025-10-10T14:35:30.124805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1694, pipe: [1:7559601704130991038:9869]
2025-10-10T14:35:30.132163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:35:30.132187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-10T14:35:30.199507Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:30.200353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.200385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.200431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991038:9869], now have 1 active actors on pipe
2025-10-10T14:35:30.200637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:30.200639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601704130991038:9869]
2025-10-10T14:35:30.200651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:30.200665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:30.200677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-10T14:35:30.200648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:30.200718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1695 reason: error at write: Disconnected sessionId: src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0
2025-10-10T14:35:30.201092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:30.201104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0] Write session will restart in 0.008899s
2025-10-10T14:35:30.200922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1695 sessionId: src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0 is DEAD
2025-10-10T14:35:30.201128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0] Write session: Do CDS request
2025-10-10T14:35:30.201135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:30.210929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.211006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:30.211022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1696
2025-10-10T14:35:30.211220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.211281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:30.211306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:30.211310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:30.211845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1696 sessionId:  describe result for acl check
2025-10-10T14:35:30.211891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:30.211893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:30.211895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:30.211901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601704130991082:7790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:30.212462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601704130991082:7790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:30.215705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601704130991082:7790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:30.219988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601704130991082:7790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:30.220018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601704130991082:7790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:30.220022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601704130991082:7790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:30.220033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:30.223084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:30.226685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:30.226941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:30.226954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:30.226967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:30.227030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:30.227078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601703348766161:9690]
2025-10-10T14:35:30.227710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:30.228038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:30.228091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:30.228420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:30.228491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.228498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.228500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.228501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.228502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.228504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.228505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.228507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.228509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.228510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.228512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.228514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.228515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.228521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.228536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.228541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.228545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.228550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.228554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.228559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.228563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.228568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.228573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.228578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.228583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.228587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.228595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.228603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.228616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.228622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.228632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.228637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.228642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.228647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.228656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.228661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.228666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.228670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.228675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.228680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.228685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.228695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.228700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.228707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.228716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.228723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.228734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.228740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.228749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.228754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.228761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.228771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.228814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:30.231581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:30.232439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:30.232456Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:30.232458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:30.232462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:30.232469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1695 [2:7559601703348766161:9690]
2025-10-10T14:35:30.232483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:30.232502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:30.232505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.232508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.232510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.232529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:30.232544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:30.232551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:30.232901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1695
2025-10-10T14:35:30.232904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1695
2025-10-10T14:35:30.232619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.232631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.232633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.232637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:30.232710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:30.232713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.232726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.232735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.232752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:30.232776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991275:7790], now have 1 active actors on pipe
2025-10-10T14:35:30.232785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601703348766156:9690]
2025-10-10T14:35:30.232788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601703348766156:9690]
2025-10-10T14:35:30.232791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601703348766156:9690]
2025-10-10T14:35:30.232805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:30.232814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991040:2438], now have 1 active actors on pipe
2025-10-10T14:35:30.232822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:30.232834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:30.232837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:30.232838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:30.232840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:30.232840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:30.232877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601703348766156:9690]
2025-10-10T14:35:30.232886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:30.232913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:30.233082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.233098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.233155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:30.233171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.233180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.233182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:30.233198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.233217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:30.233287Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:35:30.233321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.233513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.233522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.233540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.233569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 11 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:35:30.233613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:35:30.233647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1696 partition: 0 MaxSeqNo: 40 sessionId: src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0
2025-10-10T14:35:30.234058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a89e778-3662cd8a-4f910dbc-1472e3f1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:30.236781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0] Write session: try to update token
2025-10-10T14:35:30.236805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:30.251955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId: src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:30.254749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:30.255940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:30.255961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:30.255965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:30.255967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:30.255978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601703348766156:9690]
2025-10-10T14:35:30.255984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601703348766156:9690]
2025-10-10T14:35:30.255989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601703348766156:9690]
2025-10-10T14:35:30.256049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:30.256063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.256066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:30.256210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:30.257632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:30.257653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:30.257657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:30.300634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601704130991328:9869]
2025-10-10T14:35:30.300973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1695, pipe: [1:7559601704130991328:9869]
2025-10-10T14:35:30.368027Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:30.368297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.368314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.368360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991328:9869], now have 1 active actors on pipe
2025-10-10T14:35:30.368535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:30.369345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:30.369824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:30.369834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0] Write session will restart in 0.005614s
2025-10-10T14:35:30.369872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0] Write session: Do CDS request
2025-10-10T14:35:30.369443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1696 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0
2025-10-10T14:35:30.369666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1696 sessionId: src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0 is DEAD
2025-10-10T14:35:30.369878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:30.369731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601704130991328:9869]
2025-10-10T14:35:30.369756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:30.376908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.376996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:30.377012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1697
2025-10-10T14:35:30.377158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.377203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:30.377215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:30.377220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:30.377810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1697 sessionId:  describe result for acl check
2025-10-10T14:35:30.377852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:30.377858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:30.377860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:30.377866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601704130991339:7786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:30.378464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601704130991339:7786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:30.383228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601704130991339:7786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:30.387652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601704130991339:7786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:30.387668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601704130991339:7786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:30.387673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601704130991339:7786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:30.387683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:30.414744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:30.418356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:30.418597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:30.418620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:30.418632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:30.418677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:30.418711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601703348766443:9693]
2025-10-10T14:35:30.419206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:30.419550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:30.419605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:30.419872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:30.419931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.419937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.419938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.419939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.419940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.419941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.419943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.419944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.419945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.419946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.419947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.419948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.419949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.419953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.419961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.419964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.419966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.419969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.419973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.419975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.419978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.419981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.419984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.419986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.419989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.419992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.419998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.420004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.420010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.420016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.420022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.420027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.420032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.420037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.420043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.420048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.420053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.420060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.420070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.420075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.420079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.420082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.420085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.420089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.420092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.420096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.420100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.420104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.420110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.420114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.420117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.420121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.420144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:30.423687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:30.425005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:30.425019Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:30.425022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:30.425026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:30.425033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1696 [2:7559601703348766443:9693]
2025-10-10T14:35:30.425053Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:30.425070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:30.425074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.425077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.425079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.425097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:30.425104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:30.425111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:30.425190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.425199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.425201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.425204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:30.425281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:30.425290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.425303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.425314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.425344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:30.425365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601703348766438:9693]
2025-10-10T14:35:30.425367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601703348766438:9693]
2025-10-10T14:35:30.425369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601703348766438:9693]
2025-10-10T14:35:30.425383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:30.425396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:30.425399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:30.425401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:30.425402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991332:2438], now have 1 active actors on pipe
2025-10-10T14:35:30.425408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991377:7786], now have 1 active actors on pipe
2025-10-10T14:35:30.425416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:30.425431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:30.425434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:30.425468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601703348766438:9693]
2025-10-10T14:35:30.425483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:30.425490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:30.425682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1696
2025-10-10T14:35:30.425725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1696
2025-10-10T14:35:30.425904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.425917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.425945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:30.425957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.425963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.425965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:30.425976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.426003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:30.426018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.426590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.426605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.426626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.429684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1697 partition: 0 MaxSeqNo: 40 sessionId: src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0
2025-10-10T14:35:30.430194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b6bc89-3137a0c5-c5753ead-e349985b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:30.432995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0] Write session: try to update token
2025-10-10T14:35:30.433013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:30.448246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:30.448270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:30.448274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:30.448277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:30.448290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601703348766438:9693]
2025-10-10T14:35:30.448295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601703348766438:9693]
2025-10-10T14:35:30.448301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601703348766438:9693]
2025-10-10T14:35:30.448373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:30.448381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:30.448391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.448393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:30.448394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:30.448399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:30.448575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:30.453767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId: src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:30.456466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:30.470065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601704130991618:9869]
2025-10-10T14:35:30.472944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1696, pipe: [1:7559601704130991618:9869]
2025-10-10T14:35:30.593743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:30.594396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.594422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.594473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991618:9869], now have 1 active actors on pipe
2025-10-10T14:35:30.594732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:30.594769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:30.594773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:30.594796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601704130991618:9869]
2025-10-10T14:35:30.594781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:30.594856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1697 reason: error at write: Disconnected sessionId: src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0
2025-10-10T14:35:30.595077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1697 sessionId: src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0 is DEAD
2025-10-10T14:35:30.595257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:30.595269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0] Write session will restart in 0.006995s
2025-10-10T14:35:30.595301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0] Write session: Do CDS request
2025-10-10T14:35:30.595310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:30.603973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.604052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:30.604069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1698
2025-10-10T14:35:30.604245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.604300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:30.604310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:30.604315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:30.604828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1698 sessionId:  describe result for acl check
2025-10-10T14:35:30.604868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:30.604874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:30.604876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:30.604883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601704130991661:7769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:30.605859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601704130991661:7769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:30.608590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601704130991661:7769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:30.612205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601704130991661:7769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:30.612226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601704130991661:7769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:30.612229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601704130991661:7769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:30.612239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:30.618058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:30.621221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:30.621499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:30.621515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:30.621529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:30.621589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:30.621634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601703348766763:9708]
2025-10-10T14:35:30.622308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:30.622654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:30.622724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:30.623118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:30.623180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.623187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.623188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.623189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.623191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.623193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.623194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.623195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.623196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.623198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.623199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.623200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.623201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.623209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.623223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.623227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.623232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.623236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.623240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.623244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.623248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.623252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.623257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.623260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.623265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.623269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.623277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.623287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.623294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.623300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.623304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.623309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.623314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.623319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.623324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.623342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.623348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.623353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.623358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.623362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.623366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.623375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.623381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.623390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.623398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.623408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.623412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.623419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.623428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.623433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.623439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.623444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.623484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:30.626243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:30.626588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:30.626604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:30.626606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:30.626612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:30.626619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1697 [2:7559601703348766763:9708]
2025-10-10T14:35:30.626632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:30.626653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:30.626657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.626660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.626663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.626681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:30.626695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:30.626708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:30.626774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.626780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.627001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.627011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:30.627083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:30.627089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.627101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.627118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.627142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:30.627169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991794:7769], now have 1 active actors on pipe
2025-10-10T14:35:30.627177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991646:2438], now have 1 active actors on pipe
2025-10-10T14:35:30.627184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601703348766758:9708]
2025-10-10T14:35:30.627186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601703348766758:9708]
2025-10-10T14:35:30.627189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601703348766758:9708]
2025-10-10T14:35:30.627202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:30.627217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:30.627219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:30.627222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:30.627224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:30.627238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:30.627242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:30.627272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601703348766758:9708]
2025-10-10T14:35:30.627285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:30.627247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1697
2025-10-10T14:35:30.627289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:30.627258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1697
2025-10-10T14:35:30.627527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.627538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.627573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6337ad3-198b0a31-d756038a-655dfe91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:30.627585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.627590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.627592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:30.627604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.627615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:30.627631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.627847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.627862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.627886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.628054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1698 partition: 0 MaxSeqNo: 40 sessionId: src_id|a6337ad3-198b0a31-d756038a-655dfe91_0
2025-10-10T14:35:30.628494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9c462cb-4d4b8abe-678a9cd-fd02732a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a6337ad3-198b0a31-d756038a-655dfe91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:30.631240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6337ad3-198b0a31-d756038a-655dfe91_0] Write session: try to update token
2025-10-10T14:35:30.631260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6337ad3-198b0a31-d756038a-655dfe91_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:30.646649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:30.646664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:30.646678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601703348766758:9708]
2025-10-10T14:35:30.646719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:30.646729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:30.646919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:30.647076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:30.647251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:30.647416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:30.647613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId: src_id|a6337ad3-198b0a31-d756038a-655dfe91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:30.647623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:30.647675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:30.650340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:30.650552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.650570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.650621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:30.650693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:30.659765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:30.659785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:30.659789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:30.659791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:30.659803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601703348766758:9708]
2025-10-10T14:35:30.659807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601703348766758:9708]
2025-10-10T14:35:30.659811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601703348766758:9708]
2025-10-10T14:35:30.659861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:30.659869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.659872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:30.659877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:30.659884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:30.659888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:30.660011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:30.694864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601704130991934:9869]
2025-10-10T14:35:30.695241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1697, pipe: [1:7559601704130991934:9869]
2025-10-10T14:35:30.772468Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:30.781398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.781427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.781625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.781699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.781773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.781855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.781904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.781918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.781998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.782064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.782137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.782224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.782272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.782280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.782354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.782429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.782495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.782564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.782609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.782616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.782689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.782761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.782832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.782910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.782959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.782968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.783044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.783149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.783264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.783382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.783454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.783464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.783565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.783663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.783758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.783854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.783929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.783939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.784039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.784136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.784240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.784339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.784403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.784412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.784514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.784617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.784720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.784818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.784883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.784893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.784994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.785093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.785194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.785303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.785383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.785399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.785506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:30.785608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:30.785718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:30.785824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:30.786026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:30.786037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:30.786115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991934:9869], now have 1 active actors on pipe
2025-10-10T14:35:30.786377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:30.786401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601704130991934:9869]
2025-10-10T14:35:30.786558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:30.786567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:30.786601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1698 reason: error at write: Disconnected sessionId: src_id|a6337ad3-198b0a31-d756038a-655dfe91_0
2025-10-10T14:35:30.786820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1698 sessionId: src_id|a6337ad3-198b0a31-d756038a-655dfe91_0 is DEAD
2025-10-10T14:35:30.787003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6337ad3-198b0a31-d756038a-655dfe91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:30.787015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6337ad3-198b0a31-d756038a-655dfe91_0] Write session will restart in 0.006272s
2025-10-10T14:35:30.787040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6337ad3-198b0a31-d756038a-655dfe91_0] Write session: Do CDS request
2025-10-10T14:35:30.787047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6337ad3-198b0a31-d756038a-655dfe91_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:30.787398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:30.794915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6337ad3-198b0a31-d756038a-655dfe91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.794984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:30.795001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1699
2025-10-10T14:35:30.795112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.795157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:30.795167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:30.795170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:30.795569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1699 sessionId:  describe result for acl check
2025-10-10T14:35:30.795609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:30.795620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:30.795622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:30.795629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601704130991968:7759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:30.796190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601704130991968:7759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:30.798339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601704130991968:7759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:30.801572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601704130991968:7759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:30.801586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601704130991968:7759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:30.801590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601704130991968:7759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:30.801600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:30.808795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:30.811846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:30.812065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:30.812075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:30.812086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:30.812134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:30.812177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601703348767061:9711]
2025-10-10T14:35:30.812780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:30.813081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:30.813116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:30.813511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:30.813579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.813586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.813587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.813588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.813589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.813590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.813591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.813592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.813593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.813594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.813595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.813596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.813598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.813604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.813618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.813621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.813625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.813628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.813632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.813636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.813639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.813643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.813647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.813650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.813653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.813656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.813664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.813672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.813679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.813684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.813688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.813692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.813696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.813701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.813705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.813709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.813713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.813718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.813722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.813726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.813730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.813735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.813739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.813743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.813746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.813751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.813756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.813761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.813764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.813769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.813773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.813777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.813812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:30.816295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:30.816625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:30.816635Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:30.816637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:30.816641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:30.816647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1698 [2:7559601703348767061:9711]
2025-10-10T14:35:30.816660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:30.816681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:30.816688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.816692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.816694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.816710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:30.816718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:30.816725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:30.816777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.816783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.816785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.816787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:30.816855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:30.816861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.816871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.816886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.816905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:30.816930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130992084:7759], now have 1 active actors on pipe
2025-10-10T14:35:30.816939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130991951:2438], now have 1 active actors on pipe
2025-10-10T14:35:30.816947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601703348767055:9711]
2025-10-10T14:35:30.816949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601703348767055:9711]
2025-10-10T14:35:30.816951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601703348767055:9711]
2025-10-10T14:35:30.816964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:30.816976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:30.816977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:30.816980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:30.816982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:30.816992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:30.816995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:30.817017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601703348767055:9711]
2025-10-10T14:35:30.817023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:30.817029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:30.817016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1698
2025-10-10T14:35:30.817048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1698
2025-10-10T14:35:30.817145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.817154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.817186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:30.817198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.817203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.817210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:30.817222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.817236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:30.817250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.817456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.817464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.817479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.817613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1699 partition: 0 MaxSeqNo: 40 sessionId: src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0
2025-10-10T14:35:30.818037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6337ad3-198b0a31-d756038a-655dfe91_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:30.820648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0] Write session: try to update token
2025-10-10T14:35:30.820670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:30.836585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId: src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:30.836999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:30.837026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:30.837030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:30.837033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:30.837043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601703348767055:9711]
2025-10-10T14:35:30.837049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601703348767055:9711]
2025-10-10T14:35:30.837054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601703348767055:9711]
2025-10-10T14:35:30.837109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:30.837124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.837132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:30.837248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:30.837262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:30.837267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:30.837291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:30.839317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:30.886367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601704130992238:9869]
2025-10-10T14:35:30.886673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1698, pipe: [1:7559601704130992238:9869]
2025-10-10T14:35:30.957598Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:30.958294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.958313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.958372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130992238:9869], now have 1 active actors on pipe
2025-10-10T14:35:30.959651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:30.960090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:30.960101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0] Write session will restart in 0.009504s
2025-10-10T14:35:30.960127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0] Write session: Do CDS request
2025-10-10T14:35:30.960134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:30.959582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601704130992238:9869]
2025-10-10T14:35:30.959611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:30.959651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:30.959653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:30.959724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1699 reason: error at write: Disconnected sessionId: src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0
2025-10-10T14:35:30.959926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1699 sessionId: src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0 is DEAD
2025-10-10T14:35:30.970869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.970988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:30.971005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1700
2025-10-10T14:35:30.971146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:30.971186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:30.971196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:30.971200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:30.971778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1700 sessionId:  describe result for acl check
2025-10-10T14:35:30.971820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:30.971822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:30.971824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:30.971830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601704130992294:7747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:30.972416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601704130992294:7747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:30.975490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601704130992294:7747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:30.978607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601704130992294:7747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:30.978624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601704130992294:7747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:30.978628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601704130992294:7747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:30.978637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:30.981444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:30.984162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:30.984405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:30.984416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:30.984430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:30.984494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:30.984537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601703348767345:9714]
2025-10-10T14:35:30.985117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:30.985561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:30.985634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:30.986027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:30.986108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.986117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.986119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.986120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.986122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.986123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.986124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.986126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.986127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.986129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.986130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.986131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.986132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.986139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.986166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.986170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.986175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.986179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.986184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.986189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.986193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.986198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.986203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.986207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.986212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.986217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.986227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.986237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:30.986244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.986250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:30.986255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.986262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:30.986267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.986273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:30.986278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.986286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:30.986291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.986297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:30.986303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.986309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:30.986315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.986327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:30.986332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.986337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:30.986347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.986353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:30.986358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.986364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.986374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.986380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.986390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.986395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.986445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:30.988835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:30.989187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:30.989202Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:30.989204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:30.989208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:30.989215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1699 [2:7559601703348767345:9714]
2025-10-10T14:35:30.989232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:30.989250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:30.989254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.989258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.989261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.989278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:30.989287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:30.989300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:30.989385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.989393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.989396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.989398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:30.989465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:30.989474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:30.989487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:30.989503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:30.989527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:30.989554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130992479:7747], now have 1 active actors on pipe
2025-10-10T14:35:30.989562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601704130992243:2438], now have 1 active actors on pipe
2025-10-10T14:35:30.989570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601703348767340:9714]
2025-10-10T14:35:30.989572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601703348767340:9714]
2025-10-10T14:35:30.989575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601703348767340:9714]
2025-10-10T14:35:30.989589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:30.989606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:30.989609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:30.989614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:30.989616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:30.989625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:30.989630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:30.989605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1699
2025-10-10T14:35:30.989611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1699
2025-10-10T14:35:30.989655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601703348767340:9714]
2025-10-10T14:35:30.989664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:30.989666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:30.989685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.989693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.989743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:30.989755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:30.989759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:30.989762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:30.989773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:30.989788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:30.989811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.989983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:30.989991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:30.990006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:30.990082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1700 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0
2025-10-10T14:35:30.990496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcd3034-d10e9bb6-5284c05-d6646716_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:30.993109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0] Write session: try to update token
2025-10-10T14:35:30.993130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:31.008307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId: src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:31.009462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:31.009480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:31.009483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:31.009485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:31.009495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601703348767340:9714]
2025-10-10T14:35:31.009500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601703348767340:9714]
2025-10-10T14:35:31.009503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601703348767340:9714]
2025-10-10T14:35:31.011039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:31.009557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:31.009573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.009576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:31.009633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:31.009640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:31.009644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:31.009730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:31.059935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601708425959823:9869]
2025-10-10T14:35:31.060265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1699, pipe: [1:7559601708425959823:9869]
2025-10-10T14:35:31.129686Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:31.129970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.129987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.130034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425959823:9869], now have 1 active actors on pipe
2025-10-10T14:35:31.130323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601708425959823:9869]
2025-10-10T14:35:31.130383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:31.130478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1700 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0
2025-10-10T14:35:31.130675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1700 sessionId: src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0 is DEAD
2025-10-10T14:35:31.130277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:31.130856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:31.130868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0] Write session will restart in 0.006370s
2025-10-10T14:35:31.130867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:31.130892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0] Write session: Do CDS request
2025-10-10T14:35:31.130899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:31.138982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.139056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:31.139075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1701
2025-10-10T14:35:31.139264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.139321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:31.139333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:31.139355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:31.139854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1701 sessionId:  describe result for acl check
2025-10-10T14:35:31.139893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:31.139899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:31.139901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:31.139908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601708425959843:7748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:31.140470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601708425959843:7748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:31.143716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601708425959843:7748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:31.147266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601708425959843:7748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:31.147282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601708425959843:7748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:31.147286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601708425959843:7748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:31.147294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:31.152073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:31.155255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:31.155489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:31.155500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:31.155512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:31.155566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:31.155623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601707643734926:9716]
2025-10-10T14:35:31.156235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:31.156553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:31.156599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:31.156950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:31.157008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.157014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.157016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.157017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.157018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.157019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.157021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.157022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.157024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.157025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.157026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.157027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.157028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.157034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.157047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.157051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.157054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.157058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.157061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.157065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.157068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.157072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.157076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.157080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.157084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.157087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.157096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.157105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.157112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.157123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.157127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.157136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.157142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.157151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.157156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.157166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.157170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.157175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.157180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.157185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.157190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.157195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.157200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.157205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.157210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.157220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.157225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.157234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.157238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.157248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.157253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.157262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.157305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:31.159728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:31.160401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:31.160413Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:31.160415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:31.160419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:31.160426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1700 [2:7559601707643734926:9716]
2025-10-10T14:35:31.160439Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:31.160456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:31.160459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.160462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.160464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.160481Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:31.160492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:31.160502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:31.160545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.160550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.160551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.160553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:31.160607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:31.160614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.160621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.160627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.160636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:31.160652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601707643734921:9716]
2025-10-10T14:35:31.160655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601707643734921:9716]
2025-10-10T14:35:31.160657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601707643734921:9716]
2025-10-10T14:35:31.160664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:31.160674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:31.160677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:31.160680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:31.160679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:31.160696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:31.160700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:31.160710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425959827:2438], now have 1 active actors on pipe
2025-10-10T14:35:31.160713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960000:7748], now have 1 active actors on pipe
2025-10-10T14:35:31.160733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601707643734921:9716]
2025-10-10T14:35:31.160743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:31.160753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:31.160793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1700
2025-10-10T14:35:31.160794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1700
2025-10-10T14:35:31.160880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.160888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.160914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fe92b0-88839ccf-6befc00-515145b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:31.160925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.160928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.160930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:31.160939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.160951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:31.160962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.161133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.161139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.161152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.161254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1701 partition: 0 MaxSeqNo: 40 sessionId: src_id|1fe92b0-88839ccf-6befc00-515145b6_0
2025-10-10T14:35:31.161680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c32464-2a3b3e61-f2cda77d-c32d7a5c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1fe92b0-88839ccf-6befc00-515145b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:31.164309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe92b0-88839ccf-6befc00-515145b6_0] Write session: try to update token
2025-10-10T14:35:31.164326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe92b0-88839ccf-6befc00-515145b6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:31.172140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:31.172158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:31.172170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601707643734921:9716]
2025-10-10T14:35:31.172223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:31.172248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:31.172402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:31.172569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:31.172699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:31.172839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:31.173029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:31.173074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:31.178856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId: src_id|1fe92b0-88839ccf-6befc00-515145b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:31.181587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:31.181819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.181842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.181888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:31.182005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:31.190429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:31.190452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:31.190456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:31.190458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:31.190468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601707643734921:9716]
2025-10-10T14:35:31.190473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601707643734921:9716]
2025-10-10T14:35:31.190477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601707643734921:9716]
2025-10-10T14:35:31.190528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:31.190534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:31.190534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:31.190537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:31.190544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.190546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:31.190696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:31.230397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601708425960115:9869]
2025-10-10T14:35:31.230808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1700, pipe: [1:7559601708425960115:9869]
2025-10-10T14:35:31.304616Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:31.312937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.312967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.313147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.313217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.313290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.313378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.313426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.313435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.313509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.313575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.313651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.313725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.313773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.313781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.313857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.313930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.314003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.316568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:31.316569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601708425960115:9869]
2025-10-10T14:35:31.316585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:31.316590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:31.316618Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:35:31.316618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1701 reason: error at write: Disconnected sessionId: src_id|1fe92b0-88839ccf-6befc00-515145b6_0
2025-10-10T14:35:31.316711Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 17 consumer shared/user session shared/user_1_17_5822207453619915188_v1 is DEAD
2025-10-10T14:35:31.316722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1701 sessionId: src_id|1fe92b0-88839ccf-6befc00-515145b6_0 is DEAD
2025-10-10T14:35:31.316884Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601631116523865:9866] disconnected; active server actors: 1
2025-10-10T14:35:31.316894Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601631116523865:9866] client user disconnected session shared/user_1_17_5822207453619915188_v1
2025-10-10T14:35:31.316999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe92b0-88839ccf-6befc00-515145b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:31.317010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe92b0-88839ccf-6befc00-515145b6_0] Write session will restart in 0.007696s
2025-10-10T14:35:31.317033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe92b0-88839ccf-6befc00-515145b6_0] Write session: Do CDS request
2025-10-10T14:35:31.317040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe92b0-88839ccf-6befc00-515145b6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:31.317284Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:35:31.314072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.317373Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:35:31.317378Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:35:31.314124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.314127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.314213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.317384Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.008164s
2025-10-10T14:35:31.314276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.314344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.314407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.314450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.314452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.314524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.314592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.314654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.314715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.314761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.314763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.314836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.314898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.314959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.315021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.315063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.315067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.315137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.315196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.315261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.315322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.315368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.315370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.315438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.315499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.315562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.315626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.315669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.315671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.315740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.315804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.315866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.315930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.315971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.315974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.316048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:31.316109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:31.316170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:31.316230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:31.316269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:31.316272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:31.316350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960115:9869], now have 1 active actors on pipe
2025-10-10T14:35:31.317460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:31.325986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe92b0-88839ccf-6befc00-515145b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.326024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:31.326041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1702
2025-10-10T14:35:31.326292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.326338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:31.326348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:31.326353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:31.326649Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:35:31.326767Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:35:31.326777Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 18
2025-10-10T14:35:31.326917Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 18 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:35:31.326982Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:35:31.327083Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 auth for : user
2025-10-10T14:35:31.327095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1702 sessionId:  describe result for acl check
2025-10-10T14:35:31.327162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:31.327170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:31.327172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:31.327179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601708425960147:7736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:31.327179Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 Handle describe topics response
2025-10-10T14:35:31.327199Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 auth is DEAD
2025-10-10T14:35:31.327211Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:35:31.327507Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:35:31.327605Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_18_1003019182380050341_v1
2025-10-10T14:35:31.327599Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601708425960150:7737] connected; active server actors: 1
2025-10-10T14:35:31.327617Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601708425960150:7737] session shared/user_1_18_1003019182380050341_v1
2025-10-10T14:35:31.327638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:35:31.327655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:35:31.327667Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_18_1003019182380050341_v1" (Sender=[1:7559601708425960145:7737], Pipe=[1:7559601708425960150:7737], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:35:31.327672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:35:31.327684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:35:31.327708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_18_1003019182380050341_v1" (Sender=[1:7559601708425960145:7737], Pipe=[1:7559601708425960150:7737], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:35:31.327724Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_18_1003019182380050341_v1" sender [1:7559601708425960145:7737] lock partition 0 for ReadingSession "shared/user_1_18_1003019182380050341_v1" (Sender=[1:7559601708425960145:7737], Pipe=[1:7559601708425960150:7737], Partitions=[], ActiveFamilyCount=1) generation 1 step 18
2025-10-10T14:35:31.327738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:35:31.327746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000056s
2025-10-10T14:35:31.327796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601708425960147:7736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:31.327957Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 18 Session: "shared/user_1_18_1003019182380050341_v1" ClientId: "user" PipeClient { RawX1: 7559601708425960150 RawX2: 4503603922345529 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:35:31.327979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:35:31.331553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601708425960147:7736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:31.335420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601708425960147:7736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:31.335438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601708425960147:7736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:31.335442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601708425960147:7736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:31.335454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:31.339894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:31.343443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:31.343736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:31.343753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:31.343767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:31.343834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:31.343888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601707643735214:9718]
2025-10-10T14:35:31.344472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:31.344867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:31.344928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:31.345276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:31.345380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.345388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.345390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.345391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.345392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.345393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.345394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.345396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.345397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.345398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.345399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.345400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.345401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.345409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.345423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.345427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.345431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.345435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.345439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.345442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.345446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.345450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.345454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.345472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.345475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.345478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.345489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.345498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.345506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.345514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.345518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.345523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.345528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.345533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.345538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.345543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.345548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.345553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.345557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.345563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.345567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.345572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.345577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.345582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.345586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.345594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.345599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.345604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.345609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.345613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.345618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.345624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.345664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:31.348334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:31.348864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:31.348879Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:31.348882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:31.348887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:31.348895Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1701 [2:7559601707643735214:9718]
2025-10-10T14:35:31.348911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:31.348930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:31.348936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.348940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.348943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.348962Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:31.348975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:31.348988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:31.349072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.349080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.349082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.349085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:31.349157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:31.349166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.349179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.349189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.349204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:31.349229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960121:2438], now have 1 active actors on pipe
2025-10-10T14:35:31.349232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960161:7726], now have 1 active actors on pipe
2025-10-10T14:35:31.349240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601707643735209:9718]
2025-10-10T14:35:31.349247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601707643735209:9718]
2025-10-10T14:35:31.349250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601707643735209:9718]
2025-10-10T14:35:31.349264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:31.349277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960324:7736], now have 1 active actors on pipe
2025-10-10T14:35:31.349291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:31.349294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:31.349298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:31.349301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:31.349312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:31.349322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:31.349369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601707643735209:9718]
2025-10-10T14:35:31.349298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1701
2025-10-10T14:35:31.349377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:31.349382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:31.349397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.349403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.349317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1701, pipe: [1:7559601708425960161:7726]
2025-10-10T14:35:31.349364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1701
2025-10-10T14:35:31.349419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_18_1003019182380050341_v1 on pipe: [1:7559601708425960161:7726]
2025-10-10T14:35:31.349457Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_18_1003019182380050341_v1:1 with generation 1701
2025-10-10T14:35:31.349470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.349473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.349485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.349497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.349499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:31.349520Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_18_1003019182380050341_v1
2025-10-10T14:35:31.349527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.349577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:31.349589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:35:31.349594Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:35:31.354518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:35:31.354557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:35:31.354569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.354588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.354591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:31.354607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.354628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:31.354651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:35:31.354666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:35:31.354683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.354853Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106931348 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:35:31.354875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:35:31.354925Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 sending to client partition status
2025-10-10T14:35:31.355021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.355038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.355067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.355239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1702 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0
2025-10-10T14:35:31.355505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe92b0-88839ccf-6befc00-515145b6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:31.358116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0] Write session: try to update token
2025-10-10T14:35:31.358152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:31.369730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:31.369746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:31.369750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:31.369752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:31.369762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601707643735209:9718]
2025-10-10T14:35:31.369766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601707643735209:9718]
2025-10-10T14:35:31.369770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601707643735209:9718]
2025-10-10T14:35:31.369812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:31.369818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:31.369819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:31.369822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:31.369827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.369840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:31.369989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:31.372775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId: src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:31.375503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:31.483275Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:31.483471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.483488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.483692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_18_1003019182380050341_v1
2025-10-10T14:35:31.483710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:31.484156Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_18_1003019182380050341_v1
2025-10-10T14:35:31.485427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:31.485519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1702 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0
2025-10-10T14:35:31.486193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:31.486205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0] Write session will restart in 0.008340s
2025-10-10T14:35:31.486239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0] Write session: Do CDS request
2025-10-10T14:35:31.486246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:31.485732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1702 sessionId: src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0 is DEAD
2025-10-10T14:35:31.485919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:31.485956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601708425960161:7726]
2025-10-10T14:35:31.497852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.497921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:31.497938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1703
2025-10-10T14:35:31.498417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.498451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:31.498457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:31.498460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:31.498969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1703 sessionId:  describe result for acl check
2025-10-10T14:35:31.498999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:31.499001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:31.499004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:31.499010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601708425960435:7729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:31.499557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601708425960435:7729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:31.503986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601708425960435:7729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:31.507391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601708425960435:7729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:31.507410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601708425960435:7729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:31.507413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601708425960435:7729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:31.507422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:31.532159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:31.535683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:31.535934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:31.535946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:31.535960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:31.536033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:31.536076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601707643735526:9726]
2025-10-10T14:35:31.536674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:31.536996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:31.537035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:31.537327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:31.537410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.537412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.537413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.537414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.537415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.537416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.537417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.537418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.537419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.537420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.537421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.537422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.537423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.537429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.537442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.537445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.537449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.537453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.537457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.537460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.537464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.537467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.537472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.537475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.537478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.537481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.537489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.537498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.537505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.537510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.537516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.537521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.537526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.537532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.537537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.537542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.537546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.537552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.537557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.537563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.537568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.537573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.537577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.537583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.537587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.537593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.537597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.537603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.537607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.537611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.537616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.537621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.537661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:31.543553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:31.543906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:31.543917Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:31.543920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:31.543924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:31.543931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1702 [2:7559601707643735526:9726]
2025-10-10T14:35:31.543947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:31.543969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:31.543976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.543981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.543983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.544003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:31.544019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:31.544042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:31.544110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.544118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.544120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.544124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:31.544200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:31.544206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.544218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.544236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.544257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:31.544285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960473:7729], now have 1 active actors on pipe
2025-10-10T14:35:31.544293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960419:2438], now have 1 active actors on pipe
2025-10-10T14:35:31.544301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601707643735511:9726]
2025-10-10T14:35:31.544309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601707643735511:9726]
2025-10-10T14:35:31.544311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601707643735511:9726]
2025-10-10T14:35:31.544325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:31.544338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:31.544342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:31.544344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:31.544346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:31.544363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:31.544366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:31.544371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1702
2025-10-10T14:35:31.544374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1702
2025-10-10T14:35:31.544405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601707643735511:9726]
2025-10-10T14:35:31.544414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:31.544416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:31.544436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.544441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.544496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:31.544510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.544514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.544517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:31.544528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.544555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:31.544577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.544806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.544820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.544864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.544981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1703 partition: 0 MaxSeqNo: 40 sessionId: src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0
2025-10-10T14:35:31.545419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb1dfca4-b8c9878f-a5863dad-7e3f4c27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:31.548245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0] Write session: try to update token
2025-10-10T14:35:31.548265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:31.566909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:31.566929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:31.566933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:31.566935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:31.566945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601707643735511:9726]
2025-10-10T14:35:31.566950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601707643735511:9726]
2025-10-10T14:35:31.566954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601707643735511:9726]
2025-10-10T14:35:31.567007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:31.567015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.567019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:31.567026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:31.567033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:31.567053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:31.567165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:31.569145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId: src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:31.571854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:31.583701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601708425960723:7726]
2025-10-10T14:35:31.584031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1702, pipe: [1:7559601708425960723:7726]
2025-10-10T14:35:31.685871Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:31.686648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.686661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.686710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960723:7726], now have 1 active actors on pipe
2025-10-10T14:35:31.686981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:31.686991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:31.686995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601708425960723:7726]
2025-10-10T14:35:31.687008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:31.687016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:31.687074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1703 reason: error at write: Disconnected sessionId: src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0
2025-10-10T14:35:31.687286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1703 sessionId: src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0 is DEAD
2025-10-10T14:35:31.687519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:31.687532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0] Write session will restart in 0.007296s
2025-10-10T14:35:31.687559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0] Write session: Do CDS request
2025-10-10T14:35:31.687569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:31.695924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.696022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:31.696039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1704
2025-10-10T14:35:31.696152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.696189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:31.696199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:31.696203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:31.696688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1704 sessionId:  describe result for acl check
2025-10-10T14:35:31.696725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:31.696732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:31.696734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:31.696741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601708425960762:7712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:31.697288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601708425960762:7712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:31.700858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601708425960762:7712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:31.704958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601708425960762:7712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:31.704975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601708425960762:7712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:31.704979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601708425960762:7712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:31.704988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:31.713408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:31.717031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:31.717285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:31.717297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:31.717309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:31.717384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:31.717428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601707643735830:9735]
2025-10-10T14:35:31.718124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:31.718427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:31.718474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:31.718793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:31.718853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.718859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.718860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.718861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.718862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.718863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.718865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.718867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.718868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.718869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.718871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.718872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.718874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.718879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.718892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.718896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.718900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.718904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.718908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.718913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.718916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.718920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.718925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.718929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.718933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.718937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.718944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.718954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.718960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.718966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.718970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.718976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.718980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.718985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.718993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.719003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.719008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.719018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.719022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.719028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.719032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.719037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.719042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.719048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.719053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.719057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.719061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.719066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.719070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.719075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.719084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.719089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.719130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:31.722191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:31.723126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:31.723143Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:31.723145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:31.723150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:31.723157Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1703 [2:7559601707643735830:9735]
2025-10-10T14:35:31.723170Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:31.723189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:31.723198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.723201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.723204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.723221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:31.723233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:31.723246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:31.723316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.723324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.723326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.723328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:31.723395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:31.723403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.723431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.723447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.723464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:31.723489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960742:2438], now have 1 active actors on pipe
2025-10-10T14:35:31.723492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425960898:7712], now have 1 active actors on pipe
2025-10-10T14:35:31.723500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601707643735825:9735]
2025-10-10T14:35:31.723502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601707643735825:9735]
2025-10-10T14:35:31.723505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601707643735825:9735]
2025-10-10T14:35:31.723521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:31.723537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:31.723537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:31.723540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:31.723543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:31.723554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:31.723558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:31.723589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601707643735825:9735]
2025-10-10T14:35:31.723601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:31.723608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:31.723552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1703
2025-10-10T14:35:31.723594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1703
2025-10-10T14:35:31.723807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.723820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.723854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:31.723867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.723872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.723879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:31.723891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.723908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:31.723927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.724217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.724225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.724242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.724366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1704 partition: 0 MaxSeqNo: 40 sessionId: src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0
2025-10-10T14:35:31.724766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5153c372-eb3f7d25-801ab6dc-eff6b1c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:31.727379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0] Write session: try to update token
2025-10-10T14:35:31.727396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:31.746764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:31.746785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:31.746789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:31.746791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:31.746801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601707643735825:9735]
2025-10-10T14:35:31.746806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601707643735825:9735]
2025-10-10T14:35:31.746811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601707643735825:9735]
2025-10-10T14:35:31.746853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:31.746859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:31.746863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:31.746871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.746871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:31.746873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:31.747020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:31.747849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId: src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:31.750678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:31.786938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601708425961052:7726]
2025-10-10T14:35:31.787348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1703, pipe: [1:7559601708425961052:7726]
2025-10-10T14:35:31.861043Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:31.865397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.865438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.865501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425961052:7726], now have 1 active actors on pipe
2025-10-10T14:35:31.865824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:31.865830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601708425961052:7726]
2025-10-10T14:35:31.865869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:31.865872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:31.865946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1704 reason: error at write: Disconnected sessionId: src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0
2025-10-10T14:35:31.866188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1704 sessionId: src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0 is DEAD
2025-10-10T14:35:31.866222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:31.869436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:31.869452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0] Write session will restart in 0.006784s
2025-10-10T14:35:31.869481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0] Write session: Do CDS request
2025-10-10T14:35:31.869491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:31.877913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.878175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:31.878193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1705
2025-10-10T14:35:31.878384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:31.878445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:31.878456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:31.878460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:31.878951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1705 sessionId:  describe result for acl check
2025-10-10T14:35:31.878990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:31.878997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:31.878999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:31.879006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601708425961085:7695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:31.879587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601708425961085:7695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:31.886691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601708425961085:7695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:31.890893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601708425961085:7695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:31.890913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601708425961085:7695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:31.890917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601708425961085:7695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:31.890927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:31.896773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:31.897388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:31.897590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:31.897600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:31.897612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:31.897669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:31.897705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601707643736133:9739]
2025-10-10T14:35:31.898274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:31.900215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:31.900271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:31.900600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:31.900665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.900673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.900674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.900675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.900676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.900678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.900679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.900681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.900682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.900683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.900685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.900686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.900687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.900694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.900708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.900712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.900725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.900729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.900733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.900737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.900742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.900746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.900750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.900754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.900758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.900762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.900770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.900779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:31.900785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.900791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:31.900795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.900800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:31.900805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.900810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:31.900815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.900820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:31.900824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.900829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:31.900834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.900839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:31.900844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.900849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:31.900853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.900857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:31.900861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.900867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:31.900871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.900875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.900879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.900884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.900888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.900893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.900930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:31.903530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:31.903859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:31.903871Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:31.903874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:31.903878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:31.903885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1704 [2:7559601707643736133:9739]
2025-10-10T14:35:31.903900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:31.903919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:31.903923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.903927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.903930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.903948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:31.903960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:31.903968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:31.904035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.904043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.904046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.904049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:31.904123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:31.904132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.904144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:31.904157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:31.904277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1704
2025-10-10T14:35:31.904174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:31.904301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1704
2025-10-10T14:35:31.904196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425961055:2438], now have 1 active actors on pipe
2025-10-10T14:35:31.904200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425961257:7695], now have 1 active actors on pipe
2025-10-10T14:35:31.904208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601707643736128:9739]
2025-10-10T14:35:31.904210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601707643736128:9739]
2025-10-10T14:35:31.904213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601707643736128:9739]
2025-10-10T14:35:31.904226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:31.904241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:31.904255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:31.904257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:31.904258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:31.904260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:31.904261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:31.904286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601707643736128:9739]
2025-10-10T14:35:31.904290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:31.904299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:31.904319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.904324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.904365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|414b6e89-675887dd-2b796933-4333a05d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:31.904373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:31.904377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:31.904379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:31.904391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:31.904402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:31.904424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.904581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.904594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.904617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:31.904728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1705 partition: 0 MaxSeqNo: 40 sessionId: src_id|414b6e89-675887dd-2b796933-4333a05d_0
2025-10-10T14:35:31.905133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30c37b2-26c8cb2d-c5ce7576-9f9d6951_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|414b6e89-675887dd-2b796933-4333a05d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:31.908107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414b6e89-675887dd-2b796933-4333a05d_0] Write session: try to update token
2025-10-10T14:35:31.908133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414b6e89-675887dd-2b796933-4333a05d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:31.929613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId: src_id|414b6e89-675887dd-2b796933-4333a05d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:31.932554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:31.932828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:31.932860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:31.932919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:31.933028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:31.935478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:31.935495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:31.935500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:31.935502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:31.935514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601707643736128:9739]
2025-10-10T14:35:31.935519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601707643736128:9739]
2025-10-10T14:35:31.935524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601707643736128:9739]
2025-10-10T14:35:31.935580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:31.935579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:31.935585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:31.935587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:31.935589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:31.935591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:31.935743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:31.966356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601708425961349:7726]
2025-10-10T14:35:31.966819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1704, pipe: [1:7559601708425961349:7726]
2025-10-10T14:35:32.055676Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:32.065485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.065513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.065805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.065872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.065942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.066003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.066045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.066050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.066142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.066203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.066270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.066337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.066377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.066380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.066452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.066512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.066574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.066637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.067212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.067216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.067286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.067351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.067412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.067474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.067514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.067518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.067588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.067647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.067710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.067773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.067813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.067816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.067887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.067945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.068007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.068069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.068125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.068128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.068197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.068255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.068319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.068379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.068420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.068424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.068494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.068552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.068619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.068687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.068732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.068735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.068803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.068860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.068922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.068984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.069032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.069035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.069103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.069161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.069223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.069288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.069637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.069648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.069715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601708425961349:7726], now have 1 active actors on pipe
2025-10-10T14:35:32.070654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:32.071314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414b6e89-675887dd-2b796933-4333a05d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:32.071327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414b6e89-675887dd-2b796933-4333a05d_0] Write session will restart in 0.005088s
2025-10-10T14:35:32.071358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414b6e89-675887dd-2b796933-4333a05d_0] Write session: Do CDS request
2025-10-10T14:35:32.071365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414b6e89-675887dd-2b796933-4333a05d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:32.069954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:32.070014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:32.070024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:32.070059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1705 reason: error at write: Disconnected sessionId: src_id|414b6e89-675887dd-2b796933-4333a05d_0
2025-10-10T14:35:32.070282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1705 sessionId: src_id|414b6e89-675887dd-2b796933-4333a05d_0 is DEAD
2025-10-10T14:35:32.070441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601708425961349:7726]
2025-10-10T14:35:32.078076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|414b6e89-675887dd-2b796933-4333a05d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.078544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:32.078561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1706
2025-10-10T14:35:32.078762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.078811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:32.078822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:32.078826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:32.079398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1706 sessionId:  describe result for acl check
2025-10-10T14:35:32.079436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:32.079438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:32.079446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:32.079452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601712720928662:7697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:32.080169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601712720928662:7697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:32.086374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601712720928662:7697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:32.090031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601712720928662:7697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:32.090057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601712720928662:7697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:32.090061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601712720928662:7697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:32.090070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:32.097359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:32.100297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:32.100564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:32.100578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:32.100592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:32.100649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:32.100700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601711938703719:9741]
2025-10-10T14:35:32.101382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:32.101717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:32.101763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:32.102131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:32.102191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.102197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.102199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.102200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.102201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.102203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.102204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.102206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.102207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.102209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.102210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.102212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.102213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.102219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.102234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.102239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.102244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.102248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.102253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.102257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.102262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.102265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.102270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.102275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.102280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.102284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.102293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.102301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.102314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.102320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.102330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.102337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.102345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.102351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.102361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.102367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.102376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.102382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.102392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.102398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.102407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.102412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.102422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.102429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.102433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.102443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.102450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.102460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.102464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.102471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.102476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.102481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.102529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:32.105245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:32.105791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:32.105802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:32.105805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:32.105809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:32.105816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1705 [2:7559601711938703719:9741]
2025-10-10T14:35:32.105828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:32.105852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:32.105859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.105863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.105866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.105884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:32.105896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:32.105904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:32.105973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.105980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.105982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.105993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:32.106063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:32.106072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.106082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.106092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.106107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:32.106153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601711938703714:9741]
2025-10-10T14:35:32.106160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601711938703714:9741]
2025-10-10T14:35:32.106162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601711938703714:9741]
2025-10-10T14:35:32.106171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:32.106178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:32.106180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:32.106182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:32.106187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720928647:2438], now have 1 active actors on pipe
2025-10-10T14:35:32.106191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720928805:7697], now have 1 active actors on pipe
2025-10-10T14:35:32.106199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:32.106220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:32.106223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:32.106251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601711938703714:9741]
2025-10-10T14:35:32.106258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:32.106267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:32.109549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1705
2025-10-10T14:35:32.109549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1705
2025-10-10T14:35:32.109808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.109824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.109881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:32.109899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.109905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.109912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:32.109928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.109952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:32.109976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.110193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.110211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.110238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.110347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1706 partition: 0 MaxSeqNo: 40 sessionId: src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0
2025-10-10T14:35:32.110852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|414b6e89-675887dd-2b796933-4333a05d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:32.113761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0] Write session: try to update token
2025-10-10T14:35:32.113786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:32.121465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:32.121482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:32.121494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601711938703714:9741]
2025-10-10T14:35:32.121545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:32.121720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:32.121858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:32.122017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:32.122055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:32.122304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:32.122606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:32.122671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:32.128746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId: src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:32.131544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:32.131790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.131812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.131863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:32.131934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:32.141200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:32.141219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:32.141223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:32.141225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:32.141237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601711938703714:9741]
2025-10-10T14:35:32.141241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601711938703714:9741]
2025-10-10T14:35:32.141245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601711938703714:9741]
2025-10-10T14:35:32.141295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:32.141306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.141311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:32.141387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:32.141401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:32.141406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:32.141468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:32.169952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601712720928941:7726]
2025-10-10T14:35:32.170286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1705, pipe: [1:7559601712720928941:7726]
2025-10-10T14:35:32.253617Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:32.262712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.262746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.262933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.262999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.263068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.263130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.263176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.263181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.263249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.263310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.263367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.263432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.263473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.263476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.263543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.263596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.263656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.263716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.263753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.263756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.263823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.263885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.263946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.264011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.264059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.264062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.264127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.264182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.264250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.264312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.264349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.264352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.264417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.264473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.264530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.264587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.264634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.264637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.264703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.264761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.264820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.264881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.264930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.264934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.265005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.265063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.265120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.265180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.265219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.265222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.265286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.265614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.265687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.265750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.265800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.265809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.265879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.265941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.266004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.266066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.266122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.266129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.266196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720928941:7726], now have 1 active actors on pipe
2025-10-10T14:35:32.266933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:32.266947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0] Write session will restart in 0.005812s
2025-10-10T14:35:32.266972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0] Write session: Do CDS request
2025-10-10T14:35:32.266978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:32.266444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:32.266510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:32.266513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:32.266549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1706 reason: error at write: Disconnected sessionId: src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0
2025-10-10T14:35:32.266769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1706 sessionId: src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0 is DEAD
2025-10-10T14:35:32.266781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601712720928941:7726]
2025-10-10T14:35:32.267381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:32.277856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.277948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:32.277966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1707
2025-10-10T14:35:32.278141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.278189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:32.278195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:32.278215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:32.278712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1707 sessionId:  describe result for acl check
2025-10-10T14:35:32.278752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:32.278754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:32.278756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:32.278763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601712720928973:7688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:32.279338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601712720928973:7688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:32.283618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601712720928973:7688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:32.289167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601712720928973:7688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:32.289185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601712720928973:7688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:32.289189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601712720928973:7688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:32.289198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:32.295322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:32.298446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:32.298690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:32.298704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:32.298716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:32.298786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:32.298830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601711938704010:9743]
2025-10-10T14:35:32.299449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:32.299788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:32.299829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:32.300138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:32.300208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.300210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.300211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.300212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.300213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.300214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.300215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.300216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.300217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.300218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.300219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.300220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.300221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.300227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.300240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.300243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.300247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.300250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.300254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.300257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.300260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.300263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.300267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.300271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.300274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.300279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.300286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.300294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.300300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.300305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.300310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.300315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.300318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.300323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.300327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.300331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.300335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.300340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.300344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.300349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.300352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.300357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.300360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.300365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.300368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.300372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.300377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.300382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.300385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.300390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.300394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.300398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.300435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:32.306315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:32.306639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:32.306653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:32.306657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:32.306661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:32.306668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1706 [2:7559601711938704010:9743]
2025-10-10T14:35:32.306683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:32.306703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:32.306708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.306712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.306714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.306733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:32.306746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:32.306755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:32.306824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.306830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.306832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.306836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:32.306905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:32.306913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.306925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.306942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.306962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:32.306991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720929149:7688], now have 1 active actors on pipe
2025-10-10T14:35:32.306995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720928943:2438], now have 1 active actors on pipe
2025-10-10T14:35:32.307002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601711938704005:9743]
2025-10-10T14:35:32.307005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601711938704005:9743]
2025-10-10T14:35:32.307007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601711938704005:9743]
2025-10-10T14:35:32.307024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:32.307047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:32.307056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:32.307061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:32.307063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:32.307067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:32.307070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:32.307063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1706
2025-10-10T14:35:32.307065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1706
2025-10-10T14:35:32.307105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601711938704005:9743]
2025-10-10T14:35:32.307117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:32.307118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:32.307134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.307140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.307196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:32.307209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.307213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.307215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:32.307229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.307245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:32.307268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.307442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.307456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.307497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.307585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1707 partition: 0 MaxSeqNo: 40 sessionId: src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0
2025-10-10T14:35:32.308035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c79e4b-e24c076a-67efbdeb-1c849789_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:32.310643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0] Write session: try to update token
2025-10-10T14:35:32.310661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:32.326961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId: src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:32.328294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:32.328316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:32.328320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:32.328322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:32.328333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601711938704005:9743]
2025-10-10T14:35:32.328337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601711938704005:9743]
2025-10-10T14:35:32.328342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601711938704005:9743]
2025-10-10T14:35:32.328391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:32.328403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.328406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:32.328546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:32.328563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:32.328570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:32.328574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:32.329786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:32.367058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601712720929238:7726]
2025-10-10T14:35:32.367416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1706, pipe: [1:7559601712720929238:7726]
2025-10-10T14:35:32.447515Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:32.448291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.448305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.448345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720929238:7726], now have 1 active actors on pipe
2025-10-10T14:35:32.448515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:32.448712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:32.448806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1707 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0
2025-10-10T14:35:32.448986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1707 sessionId: src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0 is DEAD
2025-10-10T14:35:32.449160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:32.449171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0] Write session will restart in 0.005185s
2025-10-10T14:35:32.449202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0] Write session: Do CDS request
2025-10-10T14:35:32.449208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:32.449175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:32.449229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601712720929238:7726]
2025-10-10T14:35:32.456007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.456150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:32.456169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1708
2025-10-10T14:35:32.456354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.456392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:32.456398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:32.456403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:32.456901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1708 sessionId:  describe result for acl check
2025-10-10T14:35:32.456951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:32.456953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:32.456955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:32.456962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601712720929247:7684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:32.457602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601712720929247:7684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:32.460178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601712720929247:7684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:32.463807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601712720929247:7684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:32.463825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601712720929247:7684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:32.463829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601712720929247:7684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:32.463839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:32.482020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:32.483088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:32.483307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:32.483313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:32.483326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:32.483392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:32.483426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601711938704302:9745]
2025-10-10T14:35:32.483999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:32.484410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:32.484460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:32.484811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:32.484865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.484866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.484867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.484869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.484870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.484871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.484872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.484874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.484875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.484876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.484877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.484879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.484880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.484886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.484900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.484904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.484908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.484912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.484916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.484920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.484923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.484926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.484930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.484934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.484937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.484940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.484948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.484957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.484963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.484969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.484973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.484978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.484982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.484986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.484991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.484996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.485001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.485006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.485010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.485015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.485019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.485024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.485028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.485033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.485036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.485041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.485046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.485051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.485055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.485060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.485065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.485070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.485106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:32.487537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:32.487853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:32.487870Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:32.487874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:32.487877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:32.487884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1707 [2:7559601711938704302:9745]
2025-10-10T14:35:32.487897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:32.487918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:32.487921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.487925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.487928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.487948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:32.487963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:32.487971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:32.488034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.488042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.488044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.488047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:32.488130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:32.488140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.488152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.488164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.488186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:32.488213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720929240:2438], now have 1 active actors on pipe
2025-10-10T14:35:32.488216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720929285:7684], now have 1 active actors on pipe
2025-10-10T14:35:32.488224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601711938704297:9745]
2025-10-10T14:35:32.488227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601711938704297:9745]
2025-10-10T14:35:32.488229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601711938704297:9745]
2025-10-10T14:35:32.488255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:32.488272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:32.488297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:32.488302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:32.488336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601711938704297:9745]
2025-10-10T14:35:32.488344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:32.488383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:32.488389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:32.488391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:32.488399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:32.488451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1707
2025-10-10T14:35:32.488495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1707
2025-10-10T14:35:32.488693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.488706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.488740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:32.488754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.488759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.488761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:32.488774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.488787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:32.488803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.489627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.489636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.489656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.489774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1708 partition: 0 MaxSeqNo: 40 sessionId: src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0
2025-10-10T14:35:32.490221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a940ef4-9ba6f154-1207579d-20e45dda_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:32.493020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0] Write session: try to update token
2025-10-10T14:35:32.493042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:32.510100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:32.510141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:32.510144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:32.510146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:32.510157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601711938704297:9745]
2025-10-10T14:35:32.510161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601711938704297:9745]
2025-10-10T14:35:32.510166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601711938704297:9745]
2025-10-10T14:35:32.510220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:32.510233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.510232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:32.510235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:32.510238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:32.510243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:32.510376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:32.512210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId: src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:32.518746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:32.549351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601712720929537:7726]
2025-10-10T14:35:32.549664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1707, pipe: [1:7559601712720929537:7726]
2025-10-10T14:35:32.623525Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:32.624215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.624231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.624277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720929537:7726], now have 1 active actors on pipe
2025-10-10T14:35:32.624501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601712720929537:7726]
2025-10-10T14:35:32.624529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:32.624576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:32.624583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:32.624643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1708 reason: error at write: Disconnected sessionId: src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0
2025-10-10T14:35:32.624876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1708 sessionId: src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0 is DEAD
2025-10-10T14:35:32.625052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:32.625062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0] Write session will restart in 0.008188s
2025-10-10T14:35:32.625088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0] Write session: Do CDS request
2025-10-10T14:35:32.625095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:32.626346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:32.634964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.635036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:32.635072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1709
2025-10-10T14:35:32.635219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.635261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:32.635278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:32.635282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:32.635717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1709 sessionId:  describe result for acl check
2025-10-10T14:35:32.635760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:32.635767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:32.635769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:32.635777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601712720929663:7670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:32.636392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601712720929663:7670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:32.638983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601712720929663:7670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:32.641868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601712720929663:7670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:32.641885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601712720929663:7670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:32.641888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601712720929663:7670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:32.641897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:32.646067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:32.647044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:32.647252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:32.647270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:32.647287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:32.647341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:32.647383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601711938704626:9758]
2025-10-10T14:35:32.647996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:32.648308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:32.648355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:32.648664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:32.648726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.648732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.648733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.648733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.648734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.648735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.648737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.648737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.648738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.648739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.648741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.648742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.648743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.648749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.648762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.648766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.648770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.648774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.648778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.648782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.648786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.648790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.648794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.648798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.648802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.648806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.648814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.648823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.648829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.648834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.648839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.648844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.648847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.648853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.648857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.648863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.648867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.648872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.648878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.648889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.648893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.648897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.648901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.648906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.648912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.648917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.648921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.648925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.648928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.648932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.648935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.648939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.648976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:32.651401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:32.651869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:32.651882Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:32.651884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:32.651888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:32.651894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1708 [2:7559601711938704626:9758]
2025-10-10T14:35:32.651906Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:32.651923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:32.651927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.651931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.651933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.651952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:32.651964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:32.651974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:32.652034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.652041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.652044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.652046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:32.652119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:32.652126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.652138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.652151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.652173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:32.652203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720929556:2438], now have 1 active actors on pipe
2025-10-10T14:35:32.652207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720929992:7670], now have 1 active actors on pipe
2025-10-10T14:35:32.652215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601711938704621:9758]
2025-10-10T14:35:32.652218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601711938704621:9758]
2025-10-10T14:35:32.652220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601711938704621:9758]
2025-10-10T14:35:32.652234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:32.652247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:32.652250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:32.652250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:32.652253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:32.652266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:32.652269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:32.652294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601711938704621:9758]
2025-10-10T14:35:32.652305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:32.652229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1708
2025-10-10T14:35:32.652280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1708
2025-10-10T14:35:32.652321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:32.652731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.652742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.652775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:32.652789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.652798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.652800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:32.652812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.652828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:32.652847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.653053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.653062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.653076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.653179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1709 partition: 0 MaxSeqNo: 40 sessionId: src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0
2025-10-10T14:35:32.653657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396c567d-cc3406bd-1f3e7245-9730cfe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:32.656655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0] Write session: try to update token
2025-10-10T14:35:32.656678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:32.677081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:32.677107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:32.677111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:32.677112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:32.677123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601711938704621:9758]
2025-10-10T14:35:32.677128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601711938704621:9758]
2025-10-10T14:35:32.677132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601711938704621:9758]
2025-10-10T14:35:32.677186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:32.677192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:32.677194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.677196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:32.677212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:32.677217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:32.677476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId: src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:32.677591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:32.680357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:32.729397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601712720930107:7726]
2025-10-10T14:35:32.729790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1708, pipe: [1:7559601712720930107:7726]
2025-10-10T14:35:32.798772Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:32.799207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.799218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.799264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720930107:7726], now have 1 active actors on pipe
2025-10-10T14:35:32.799772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601712720930107:7726]
2025-10-10T14:35:32.799805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:32.799851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:32.799854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:32.799932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1709 reason: error at write: Disconnected sessionId: src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0
2025-10-10T14:35:32.800139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1709 sessionId: src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0 is DEAD
2025-10-10T14:35:32.799799Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:32.800480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:32.800488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0] Write session will restart in 0.007327s
2025-10-10T14:35:32.800513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0] Write session: Do CDS request
2025-10-10T14:35:32.800522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:32.808925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.809010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:32.809029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1710
2025-10-10T14:35:32.809474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:32.809517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:32.809529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:32.809533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:32.809997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1710 sessionId:  describe result for acl check
2025-10-10T14:35:32.810043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:32.810050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:32.810052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:32.810058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601712720930137:7656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:32.810633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601712720930137:7656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:32.812960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601712720930137:7656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:32.815769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601712720930137:7656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:32.815787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601712720930137:7656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:32.815792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601712720930137:7656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:32.815812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:32.832313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:32.833731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:32.833964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:32.833979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:32.833992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:32.834055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:32.834118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601711938704942:9764]
2025-10-10T14:35:32.834779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:32.835136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:32.835194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:32.835562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:32.835642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.835649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.835650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.835651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.835653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.835654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.835656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.835657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.835658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.835659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.835661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.835662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.835663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.835669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.835681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.835686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.835690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.835695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.835699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.835704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.835707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.835711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.835715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.835719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.835722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.835725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.835735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.835744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:32.835752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.835757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:32.835761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.835765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:32.835769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.835774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:32.835779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.835790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:32.835794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.835804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:32.835808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.835813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:32.835817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.835822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:32.835826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.835847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:32.835856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.835862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:32.835866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.835871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.835875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.835885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.835889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.835893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.835938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:32.838693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:32.839188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:32.839201Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:32.839204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:32.839208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:32.839216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1709 [2:7559601711938704942:9764]
2025-10-10T14:35:32.839231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:32.839252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:32.839256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.839260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.839262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.839281Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:32.839294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:32.839304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:32.839377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.839384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.839386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.839389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:32.839460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:32.839467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.839480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:32.839493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:32.839511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:32.839534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720930122:2438], now have 1 active actors on pipe
2025-10-10T14:35:32.839538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720930248:7656], now have 1 active actors on pipe
2025-10-10T14:35:32.839546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601711938704937:9764]
2025-10-10T14:35:32.839549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601711938704937:9764]
2025-10-10T14:35:32.839551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601711938704937:9764]
2025-10-10T14:35:32.839564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:32.839584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:32.839600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:32.839609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:32.839645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601711938704937:9764]
2025-10-10T14:35:32.839653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:32.839992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1709
2025-10-10T14:35:32.840055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1709
2025-10-10T14:35:32.839687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:32.839700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:32.839702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:32.839709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:32.840250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.840256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.840291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:32.840300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:32.840304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:32.840307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:32.840320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:32.840333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:32.840349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.840925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.840935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.840954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:32.841201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1710 partition: 0 MaxSeqNo: 40 sessionId: src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0
2025-10-10T14:35:32.841699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf130d-9e9e2934-3c18b40e-241dc3e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:32.844532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0] Write session: try to update token
2025-10-10T14:35:32.844556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:32.854899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:32.854916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:32.854927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601711938704937:9764]
2025-10-10T14:35:32.854988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:32.854993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:32.855179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:32.855329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:32.855479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:32.855622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:32.855822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:32.855868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:32.867519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId: src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:32.870468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:32.871208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.871234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.871280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:32.871398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:32.877049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:32.877066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:32.877070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:32.877072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:32.877083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601711938704937:9764]
2025-10-10T14:35:32.877087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601711938704937:9764]
2025-10-10T14:35:32.877092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601711938704937:9764]
2025-10-10T14:35:32.877142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:32.877146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:32.877148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:32.877156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:32.877156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:32.877159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:32.877310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:32.900028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601712720930655:7726]
2025-10-10T14:35:32.900292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1709, pipe: [1:7559601712720930655:7726]
2025-10-10T14:35:32.990225Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:32.998374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:32.998409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:32.998596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.998656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.998717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.998783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.998931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.998937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.999008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.999062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.999115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.999176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.999219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.999222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.999290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.999346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.999406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.999472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.999515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.999521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.999591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.999648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:32.999711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:32.999777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:32.999826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:32.999830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:32.999895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:32.999959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.000019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.000081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.000119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.000122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.000188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.000248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.000314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.000382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.000423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.000426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.000492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.000574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.000636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.000696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.000737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.000740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.000811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.000867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.000921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.000977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.001022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.001025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.001095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.001155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.001221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.001280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.001322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.001325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.001423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.001481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.001545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.001608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.001657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.001660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.001736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720930655:7726], now have 1 active actors on pipe
2025-10-10T14:35:33.002522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:33.002539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0] Write session will restart in 0.009583s
2025-10-10T14:35:33.002565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0] Write session: Do CDS request
2025-10-10T14:35:33.002571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:33.002925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:33.002057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601712720930655:7726]
2025-10-10T14:35:33.002069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:33.002120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:33.002123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:33.002155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1710 reason: error at write: Disconnected sessionId: src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0
2025-10-10T14:35:33.002384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1710 sessionId: src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0 is DEAD
2025-10-10T14:35:33.013965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.014021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:33.014045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1711
2025-10-10T14:35:33.014219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.014278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:33.014284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:33.014290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:33.014755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1711 sessionId:  describe result for acl check
2025-10-10T14:35:33.014795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:33.014803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:33.014804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:33.014811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601717015898038:7652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:33.015422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601717015898038:7652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:33.018781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601717015898038:7652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:33.021661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601717015898038:7652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:33.021678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601717015898038:7652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:33.021681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601717015898038:7652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:33.021690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:33.028447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:33.029408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:33.029612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:33.029623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:33.029636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:33.029686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:33.029735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601716233672533:9766]
2025-10-10T14:35:33.030381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:33.030699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:33.030744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:33.031100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:33.031159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.031164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.031165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.031166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.031168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.031169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.031170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.031171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.031173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.031174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.031175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.031177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.031178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.031184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.031197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.031202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.031206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.031210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.031213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.031217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.031221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.031226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.031230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.031234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.031238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.031242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.031249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.031257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.031264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.031274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.031279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.031284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.031293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.031298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.031303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.031313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.031317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.031322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.031328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.031337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.031344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.031353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.031357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.031362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.031367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.031372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.031377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.031382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.031390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.031395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.031399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.031405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.031446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:33.033915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:33.034534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:33.034547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:33.034550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:33.034554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:33.034561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1710 [2:7559601716233672533:9766]
2025-10-10T14:35:33.034575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:33.034593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:33.034596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.034600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.034602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.034619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:33.034632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:33.034640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:33.034702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.034710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.034713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.034715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:33.034786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:33.034794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.034805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.034821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.034842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:33.034870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015898368:7652], now have 1 active actors on pipe
2025-10-10T14:35:33.034874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601712720930660:2438], now have 1 active actors on pipe
2025-10-10T14:35:33.034881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601716233672528:9766]
2025-10-10T14:35:33.034883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601716233672528:9766]
2025-10-10T14:35:33.034885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601716233672528:9766]
2025-10-10T14:35:33.034898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:33.034913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:33.034889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1710
2025-10-10T14:35:33.034914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:33.034918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:33.034917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1710
2025-10-10T14:35:33.034920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:33.034929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:33.034932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:33.034970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.034975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.034994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601716233672528:9766]
2025-10-10T14:35:33.035007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:33.035021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:33.035044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:33.035058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.035063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.035066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:33.035078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.035093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:33.035123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.035302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.035313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.035333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.035423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1711 partition: 0 MaxSeqNo: 40 sessionId: src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0
2025-10-10T14:35:33.035853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72faa2d1-3e08e53e-ada8d1c5-dad38420_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:33.038798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0] Write session: try to update token
2025-10-10T14:35:33.038824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:33.054036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId: src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:33.054611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:33.054632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:33.054635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:33.054637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:33.054647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601716233672528:9766]
2025-10-10T14:35:33.054652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601716233672528:9766]
2025-10-10T14:35:33.054657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601716233672528:9766]
2025-10-10T14:35:33.054720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:33.054720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:33.054727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:33.054732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:33.054733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.054736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:33.054886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:33.056882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:33.100239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601717015898487:7726]
2025-10-10T14:35:33.100536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1710, pipe: [1:7559601717015898487:7726]
2025-10-10T14:35:33.172673Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:33.173306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.173327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.173400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015898487:7726], now have 1 active actors on pipe
2025-10-10T14:35:33.173665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:33.173691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601717015898487:7726]
2025-10-10T14:35:33.173721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:33.173722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:33.173725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:33.173822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1711 reason: error at write: Disconnected sessionId: src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0
2025-10-10T14:35:33.174081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1711 sessionId: src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0 is DEAD
2025-10-10T14:35:33.174269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:33.174281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0] Write session will restart in 0.007459s
2025-10-10T14:35:33.174305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0] Write session: Do CDS request
2025-10-10T14:35:33.174312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:33.182958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.183082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:33.183112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1712
2025-10-10T14:35:33.183270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.183309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:33.183320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:33.183324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:33.183860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1712 sessionId:  describe result for acl check
2025-10-10T14:35:33.183897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:33.183904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:33.183907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:33.183913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601717015898627:7648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:33.184522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601717015898627:7648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:33.187017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601717015898627:7648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:33.190029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601717015898627:7648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:33.190044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601717015898627:7648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:33.190048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601717015898627:7648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:33.190058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:33.193361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:33.194247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:33.194477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:33.194488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:33.194502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:33.194569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:33.194613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601716233672829:9768]
2025-10-10T14:35:33.195228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:33.195535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:33.195576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:33.195886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:33.195946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.195952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.195953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.195954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.195955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.195957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.195958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.195959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.195960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.195961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.195963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.195964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.195965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.195971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.195985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.195989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.195993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.195997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.196001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.196005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.196009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.196013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.196017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.196021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.196025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.196029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.196037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.196045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.196052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.196057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.196063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.196072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.196076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.196082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.196087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.196097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.196101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.196106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.196111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.196117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.196125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.196130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.196134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.196139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.196148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.196153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.196158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.196165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.196169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.196178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.196184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.196189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.196236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:33.198693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:33.199471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:33.199488Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:33.199491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:33.199495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:33.199502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1711 [2:7559601716233672829:9768]
2025-10-10T14:35:33.199516Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:33.199535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:33.199540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.199546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.199549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.199568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:33.199581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:33.199592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:33.199663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.199670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.199672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.199675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:33.199745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:33.199754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.199765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.199777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.199795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:33.199819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015898490:2438], now have 1 active actors on pipe
2025-10-10T14:35:33.199828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015898969:7648], now have 1 active actors on pipe
2025-10-10T14:35:33.199837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601716233672824:9768]
2025-10-10T14:35:33.199842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601716233672824:9768]
2025-10-10T14:35:33.199845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601716233672824:9768]
2025-10-10T14:35:33.199860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:33.199876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:33.199879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:33.199880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:33.199882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:33.199896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:33.199899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:33.199896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1711
2025-10-10T14:35:33.199896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1711
2025-10-10T14:35:33.199928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601716233672824:9768]
2025-10-10T14:35:33.199938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:33.199940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:33.199967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.199972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.200011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:33.200025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.200029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.200032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:33.200045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.200055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:33.200072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.200233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.200242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.200257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.200344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1712 partition: 0 MaxSeqNo: 40 sessionId: src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0
2025-10-10T14:35:33.200793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a683c2-ec466dc4-b91173f0-2db44ee0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:33.203633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0] Write session: try to update token
2025-10-10T14:35:33.203656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:33.219157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId: src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:33.221204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:33.221226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:33.221230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:33.221232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:33.221243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601716233672824:9768]
2025-10-10T14:35:33.221247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601716233672824:9768]
2025-10-10T14:35:33.221253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601716233672824:9768]
2025-10-10T14:35:33.221296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:33.221307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:33.221313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:33.221314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.221317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:33.221321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:33.221478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:33.222069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:33.273851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601717015899025:7726]
2025-10-10T14:35:33.274189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1711, pipe: [1:7559601717015899025:7726]
2025-10-10T14:35:33.332204Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:33.332622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.332631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.332673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015899025:7726], now have 1 active actors on pipe
2025-10-10T14:35:33.332872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:33.333622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601717015899025:7726]
2025-10-10T14:35:33.333670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:33.333750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1712 reason: status is not ok: tablet will be restarted right now sessionId: src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0
2025-10-10T14:35:33.333831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:33.334429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:33.334443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0] Write session will restart in 0.008622s
2025-10-10T14:35:33.334470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0] Write session: Do CDS request
2025-10-10T14:35:33.334477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:33.333973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1712 sessionId: src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0 is DEAD
2025-10-10T14:35:33.343991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.344106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:33.344124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1713
2025-10-10T14:35:33.344248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.344282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:33.344287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:33.344292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:33.344707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1713 sessionId:  describe result for acl check
2025-10-10T14:35:33.344736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:33.344738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:33.344740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:33.344746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601717015899036:7645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:33.345365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601717015899036:7645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:33.348179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601717015899036:7645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:33.354642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601717015899036:7645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:33.354663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601717015899036:7645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:33.354667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601717015899036:7645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:33.354677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:33.386904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:33.389662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:33.389878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:33.389883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:33.389895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:33.389941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:33.389979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601716233673127:9770]
2025-10-10T14:35:33.390654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:33.390960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:33.391002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:33.391351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:33.391395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.391396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.391397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.391399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.391400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.391401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.391403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.391404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.391405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.391406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.391408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.391409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.391410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.391416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.391429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.391434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.391438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.391442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.391447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.391451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.391455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.391458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.391463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.391466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.391470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.391474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.391482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.391490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.391497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.391503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.391508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.391513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.391518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.391523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.391528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.391533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.391537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.391543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.391548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.391553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.391557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.391563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.391568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.391573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.391579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.391585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.391589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.391595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.391599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.391605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.391609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.391614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.391657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:33.398499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:33.399252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:33.399259Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:33.399261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:33.399266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:33.399274Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1712 [2:7559601716233673127:9770]
2025-10-10T14:35:33.399288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:33.399309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:33.399314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.399317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.399319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.399337Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:33.399346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:33.399354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:33.399420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.399422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.399424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.399427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:33.399508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:33.399511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.399524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.399536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.399554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:33.399577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015899170:7645], now have 1 active actors on pipe
2025-10-10T14:35:33.399581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015899027:2438], now have 1 active actors on pipe
2025-10-10T14:35:33.399589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601716233673122:9770]
2025-10-10T14:35:33.399591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601716233673122:9770]
2025-10-10T14:35:33.399593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601716233673122:9770]
2025-10-10T14:35:33.399602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:33.399612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:33.399615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:33.399616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:33.399617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:33.399633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:33.399637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:33.399671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601716233673122:9770]
2025-10-10T14:35:33.399682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:33.399745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:33.400468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1712
2025-10-10T14:35:33.400506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1712
2025-10-10T14:35:33.400837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.400859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.400897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:33.400915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.400920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.400923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:33.400935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.400949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:33.400973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.401408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.401424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.401447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.401558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1713 partition: 0 MaxSeqNo: 40 sessionId: src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0
2025-10-10T14:35:33.405545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|712df427-31ef1916-1cd05b8c-cfb0e882_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:33.408376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0] Write session: try to update token
2025-10-10T14:35:33.408401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:33.420498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:33.420524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:33.420528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:33.420530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:33.420541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601716233673122:9770]
2025-10-10T14:35:33.420545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601716233673122:9770]
2025-10-10T14:35:33.420552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601716233673122:9770]
2025-10-10T14:35:33.420605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:33.420608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:33.420617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.420619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:33.420620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:33.420624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:33.420764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:33.424136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId: src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:33.426942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:33.433569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601717015899563:7726]
2025-10-10T14:35:33.433884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1712, pipe: [1:7559601717015899563:7726]
2025-10-10T14:35:33.540185Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:33.541015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.541034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.541087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015899563:7726], now have 1 active actors on pipe
2025-10-10T14:35:33.541311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:33.541325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601717015899563:7726]
2025-10-10T14:35:33.541378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:33.541413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:33.541506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1713 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0
2025-10-10T14:35:33.541704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1713 sessionId: src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0 is DEAD
2025-10-10T14:35:33.541837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:33.541847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0] Write session will restart in 0.007953s
2025-10-10T14:35:33.541881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0] Write session: Do CDS request
2025-10-10T14:35:33.541886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:33.550965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.551041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:33.551058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1714
2025-10-10T14:35:33.551264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.551322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:33.551334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:33.551338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:33.551819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1714 sessionId:  describe result for acl check
2025-10-10T14:35:33.551859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:33.551866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:33.551871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:33.551877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601717015899651:7639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:33.552478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601717015899651:7639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:33.555141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601717015899651:7639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:33.558185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601717015899651:7639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:33.558199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601717015899651:7639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:33.558202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601717015899651:7639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:33.558211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:33.563174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:33.564132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:33.564310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:33.564321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:33.564333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:33.564384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:33.564429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601716233673425:9772]
2025-10-10T14:35:33.565076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:33.565452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:33.565531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:33.565939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:33.566021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.566031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.566032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.566033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.566035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.566036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.566037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.566038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.566039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.566041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.566042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.566044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.566045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.566053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.566067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.566072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.566088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.566092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.566096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.566101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.566105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.566109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.566114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.566119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.566123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.566127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.566137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.566147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.566155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.566161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.566167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.566173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.566184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.566190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.566201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.566207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.566215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.566221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.566230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.566236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.566242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.566248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.566253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.566270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.566280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.566287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.566297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.566303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.566312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.566319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.566329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.566335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.566384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:33.568963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:33.569485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:33.569497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:33.569500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:33.569503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:33.569510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1713 [2:7559601716233673425:9772]
2025-10-10T14:35:33.569525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:33.569544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:33.569548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.569552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.569555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.569573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:33.569580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:33.569589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:33.569663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.569672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.569674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.569677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:33.569743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:33.569750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.569762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.569775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.569792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:33.569816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015899947:7639], now have 1 active actors on pipe
2025-10-10T14:35:33.569820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015899566:2438], now have 1 active actors on pipe
2025-10-10T14:35:33.569827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601716233673420:9772]
2025-10-10T14:35:33.569830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601716233673420:9772]
2025-10-10T14:35:33.569832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601716233673420:9772]
2025-10-10T14:35:33.569846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:33.569858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:33.569862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:33.569863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:33.569864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:33.569879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:33.569883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:33.569916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601716233673420:9772]
2025-10-10T14:35:33.569925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:33.569912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1713
2025-10-10T14:35:33.569912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1713
2025-10-10T14:35:33.569943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:33.569969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.569980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.570013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9eedd881-68b06682-36ea3b4b-df65de05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:33.570026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.570031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.570033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:33.570045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.570065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:33.570097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.570299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.570314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.570342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.570484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1714 partition: 0 MaxSeqNo: 40 sessionId: src_id|9eedd881-68b06682-36ea3b4b-df65de05_0
2025-10-10T14:35:33.570966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d57c3e1-2c49425-4a048e04-8908a38a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9eedd881-68b06682-36ea3b4b-df65de05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:33.573850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eedd881-68b06682-36ea3b4b-df65de05_0] Write session: try to update token
2025-10-10T14:35:33.573873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eedd881-68b06682-36ea3b4b-df65de05_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:33.581682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:33.581706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:33.581718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601716233673420:9772]
2025-10-10T14:35:33.581775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:33.581775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:33.582050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:33.582322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:33.582471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:33.582608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:33.582800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:33.582850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:33.589740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId: src_id|9eedd881-68b06682-36ea3b4b-df65de05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:33.592238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:33.592453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.592476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.592528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:33.592621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:33.599786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:33.599804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:33.599810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:33.599812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:33.599823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601716233673420:9772]
2025-10-10T14:35:33.599827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601716233673420:9772]
2025-10-10T14:35:33.599830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601716233673420:9772]
2025-10-10T14:35:33.599881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:33.599888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.599891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:33.599967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:33.599973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:33.599977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:33.600040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:33.641408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601717015900104:7726]
2025-10-10T14:35:33.641706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1713, pipe: [1:7559601717015900104:7726]
2025-10-10T14:35:33.714040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:33.721910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.721933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.722112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.722180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.722247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.722318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.722681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.722692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.722759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.722825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.722889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.722954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.723000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.723007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.723068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.723121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.723181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.723242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.723290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.723295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.723355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.723419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.723481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.723543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.723588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.723594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.723665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.723786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.723844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.723900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.723945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.723953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.724023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.724082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.724138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.724197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.724244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.724252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.724316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.724371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.724427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.724490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.724556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.724561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.724620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.724673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.724736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.724796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.724857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.724863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.724929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.724987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.725044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.725106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.725149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.725156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.725224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:33.725283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:33.725361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:33.725428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:33.725472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:33.725480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:33.725540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015900104:7726], now have 1 active actors on pipe
2025-10-10T14:35:33.725951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:33.726014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601717015900104:7726]
2025-10-10T14:35:33.726105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:33.726273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:33.726343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1714 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9eedd881-68b06682-36ea3b4b-df65de05_0
2025-10-10T14:35:33.726592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1714 sessionId: src_id|9eedd881-68b06682-36ea3b4b-df65de05_0 is DEAD
2025-10-10T14:35:33.726684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eedd881-68b06682-36ea3b4b-df65de05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:33.726694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eedd881-68b06682-36ea3b4b-df65de05_0] Write session will restart in 0.005712s
2025-10-10T14:35:33.726720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eedd881-68b06682-36ea3b4b-df65de05_0] Write session: Do CDS request
2025-10-10T14:35:33.726726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eedd881-68b06682-36ea3b4b-df65de05_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:33.733963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eedd881-68b06682-36ea3b4b-df65de05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.733980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:33.733998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1715
2025-10-10T14:35:33.734192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.734229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:33.734240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:33.734243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:33.734734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1715 sessionId:  describe result for acl check
2025-10-10T14:35:33.734776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:33.734784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:33.734786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:33.734792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601717015900175:7621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:33.735325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601717015900175:7621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:33.737553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601717015900175:7621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:33.740715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601717015900175:7621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:33.740736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601717015900175:7621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:33.740741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601717015900175:7621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:33.740751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:33.749844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:33.751592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:33.751833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:33.751848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:33.751861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:33.751922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:33.751981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601716233673774:9787]
2025-10-10T14:35:33.752606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:33.752992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:33.753060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:33.753424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:33.753495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.753501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.753503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.753504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.753505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.753506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.753508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.753509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.753510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.753511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.753512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.753514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.753515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.753521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.753535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.753540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.753544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.753548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.753553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.753557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.753561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.753565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.753569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.753573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.753577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.753580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.753588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.753596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.753603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.753608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.753613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.753618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.753623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.753628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.753634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.753640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.753644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.753650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.753655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.753659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.753664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.753670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.753675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.753680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.753684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.753690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.753702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.753708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.753712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.753718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.753723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.753728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.753771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:33.756261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:33.756743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:33.756759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:33.756761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:33.756765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:33.756773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1714 [2:7559601716233673774:9787]
2025-10-10T14:35:33.756788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:33.756812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:33.756820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.756825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.756827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.756846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:33.756859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:33.756868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:33.756936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.756944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.756946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.756949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:33.757021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:33.757031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.757044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.757056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.757074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:33.757097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015900385:7621], now have 1 active actors on pipe
2025-10-10T14:35:33.757107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015900137:2438], now have 1 active actors on pipe
2025-10-10T14:35:33.757114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601716233673769:9787]
2025-10-10T14:35:33.757121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601716233673769:9787]
2025-10-10T14:35:33.757123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601716233673769:9787]
2025-10-10T14:35:33.757138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:33.757156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:33.757159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:33.757163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:33.757165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:33.757178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:33.757183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:33.757209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601716233673769:9787]
2025-10-10T14:35:33.757213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:33.757215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:33.757179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1714
2025-10-10T14:35:33.757187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1714
2025-10-10T14:35:33.757239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.757248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.757289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:33.757302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.757311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.757313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:33.757326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.757358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:33.757390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.757557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.757570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.757596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.757716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1715 partition: 0 MaxSeqNo: 40 sessionId: src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0
2025-10-10T14:35:33.758152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eedd881-68b06682-36ea3b4b-df65de05_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:33.760790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0] Write session: try to update token
2025-10-10T14:35:33.760807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:33.777984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId: src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:33.780669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:33.778331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:33.778351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:33.778354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:33.778356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:33.778367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601716233673769:9787]
2025-10-10T14:35:33.778372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601716233673769:9787]
2025-10-10T14:35:33.778375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601716233673769:9787]
2025-10-10T14:35:33.778437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:33.778445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.778447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:33.778559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:33.778569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:33.778575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:33.778604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:33.827859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601717015900688:7726]
2025-10-10T14:35:33.828813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1714, pipe: [1:7559601717015900688:7726]
2025-10-10T14:35:33.892939Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:33.893933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601717015900688:7726]
2025-10-10T14:35:33.893955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:33.893960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:33.893975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:33.894022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1715 reason: error at write: Disconnected sessionId: src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0
2025-10-10T14:35:33.894260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1715 sessionId: src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0 is DEAD
2025-10-10T14:35:33.893544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.893561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.893609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015900688:7726], now have 1 active actors on pipe
2025-10-10T14:35:33.894104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:33.897437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:33.897449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0] Write session will restart in 0.009604s
2025-10-10T14:35:33.897476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0] Write session: Do CDS request
2025-10-10T14:35:33.897484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:33.907986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.909573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:33.909595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1716
2025-10-10T14:35:33.913460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:33.913521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:33.913527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:33.913532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:33.914002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1716 sessionId:  describe result for acl check
2025-10-10T14:35:33.914040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:33.914041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:33.914043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:33.914050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601717015900874:7611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:33.914630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601717015900874:7611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:33.917722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601717015900874:7611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:33.923750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601717015900874:7611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:33.923770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601717015900874:7611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:33.923774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601717015900874:7611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:33.923785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:33.932597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:33.934029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:33.934250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:33.934255Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:33.934265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:33.934311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:33.934349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601716233674076:9791]
2025-10-10T14:35:33.935000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:33.935351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:33.935414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:33.935786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:33.935844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.935853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.935854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.935856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.935857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.935859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.935860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.935862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.935863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.935865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.935866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.935868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.935870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.935877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.935892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.935897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.935907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.935912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.935921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.935930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.935939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.935948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.935958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.935967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.935976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.935982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.935991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.936007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:33.936018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.936029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:33.936039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.936048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:33.936058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.936068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:33.936079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.936089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:33.936094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.936104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:33.936115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.936125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:33.936133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.936144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:33.936153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.936163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:33.936171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.936181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:33.936190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.936200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.936210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.936220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.936229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.936239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.936288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:33.938704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:33.939578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:33.939592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:33.939595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:33.939599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:33.939607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1715 [2:7559601716233674076:9791]
2025-10-10T14:35:33.939623Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:33.939643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:33.939647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.939651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.939653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.939672Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:33.939681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:33.939690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:33.939758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.939764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.939767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.939770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:33.939842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:33.939849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.939862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:33.939874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:33.939892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:33.939913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601716233674071:9791]
2025-10-10T14:35:33.939919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601716233674071:9791]
2025-10-10T14:35:33.939921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601716233674071:9791]
2025-10-10T14:35:33.939934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:33.939949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:33.939966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:33.939973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:33.940227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601716233674071:9791]
2025-10-10T14:35:33.940237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:33.940348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:33.940354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:33.940357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:33.940362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:33.940820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1715
2025-10-10T14:35:33.940868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1715
2025-10-10T14:35:33.941077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015900690:2438], now have 1 active actors on pipe
2025-10-10T14:35:33.941088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015901030:7611], now have 1 active actors on pipe
2025-10-10T14:35:33.941107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.941116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.941149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:33.941163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:33.941167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:33.941170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:33.941183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:33.941195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:33.941212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.942282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47af6aa-dc14ff4c-efc61184-7b3e0f5c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:33.945215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0] Write session: try to update token
2025-10-10T14:35:33.945239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:33.941748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1716 partition: 0 MaxSeqNo: 40 sessionId: src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0
2025-10-10T14:35:33.941591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:33.941599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:33.941615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:33.972655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:33.972677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:33.972681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:33.972683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:33.972694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601716233674071:9791]
2025-10-10T14:35:33.972698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601716233674071:9791]
2025-10-10T14:35:33.972703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601716233674071:9791]
2025-10-10T14:35:33.972754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:33.972762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:33.972765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:33.972901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:33.975557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:33.975565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:33.975570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:33.982713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId: src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:33.985560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:33.991627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601717015901230:7726]
2025-10-10T14:35:33.993723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1715, pipe: [1:7559601717015901230:7726]
2025-10-10T14:35:34.095080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:34.095388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.095408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.095455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601717015901230:7726], now have 1 active actors on pipe
2025-10-10T14:35:34.097631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601717015901230:7726]
2025-10-10T14:35:34.097634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:34.097605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:34.097674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:34.098181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:34.097677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:34.098224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0] Write session will restart in 0.005874s
2025-10-10T14:35:34.097754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1716 reason: error at write: Disconnected sessionId: src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0
2025-10-10T14:35:34.097949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1716 sessionId: src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0 is DEAD
2025-10-10T14:35:34.098282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0] Write session: Do CDS request
2025-10-10T14:35:34.098291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:34.105930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.106005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:34.106023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1717
2025-10-10T14:35:34.106166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.106201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:34.106212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:34.106216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:34.106715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1717 sessionId:  describe result for acl check
2025-10-10T14:35:34.106767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:34.106776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:34.106779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:34.106786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601721310868543:7607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:34.107417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601721310868543:7607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:34.109676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601721310868543:7607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:34.112704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601721310868543:7607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:34.112722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601721310868543:7607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:34.112726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601721310868543:7607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:34.112735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:34.124446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:34.125690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:34.125907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:34.125919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:34.125932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:34.125988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:34.126030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601720528641673:9793]
2025-10-10T14:35:34.126685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:34.126984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:34.127026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:34.127345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:34.127405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.127410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.127411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.127412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.127413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.127414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.127416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.127420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.127421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.127422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.127424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.127425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.127426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.127432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.127446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.127450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.127454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.127458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.127462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.127466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.127471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.127475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.127480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.127484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.127488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.127493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.127500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.127509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.127517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.127523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.127528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.127534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.127539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.127543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.127548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.127553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.127558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.127570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.127575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.127581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.127590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.127595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.127605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.127611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.127621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.127627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.127633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.127638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.127642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.127648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.127658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.127664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.127710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:34.130095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:34.130960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:34.130976Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:34.130979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:34.130983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:34.130990Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1716 [2:7559601720528641673:9793]
2025-10-10T14:35:34.131003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:34.131023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:34.131026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.131030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.131032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.131052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:34.131061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:34.131075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:34.131139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.131147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.131149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.131151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:34.131219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:34.131227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.131238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.131254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.131275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:34.131303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310868752:7607], now have 1 active actors on pipe
2025-10-10T14:35:34.131311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310868528:2438], now have 1 active actors on pipe
2025-10-10T14:35:34.131321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601720528641668:9793]
2025-10-10T14:35:34.131327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601720528641668:9793]
2025-10-10T14:35:34.131329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601720528641668:9793]
2025-10-10T14:35:34.131344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:34.131364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:34.131380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:34.131388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:34.131418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601720528641668:9793]
2025-10-10T14:35:34.131398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1716
2025-10-10T14:35:34.131425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:34.131409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1716
2025-10-10T14:35:34.131452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:34.131475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:34.131478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:34.131485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:34.131555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.131566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.131602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:34.131615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.131620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.131622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:34.131634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.131646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:34.131661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.131837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.131845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.131859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.131979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1717 partition: 0 MaxSeqNo: 40 sessionId: src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0
2025-10-10T14:35:34.132412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ec9902-cdd87a9b-4433bd56-98d0db6d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:34.135399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0] Write session: try to update token
2025-10-10T14:35:34.135422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:34.151590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:34.151609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:34.151613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:34.151615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:34.151625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601720528641668:9793]
2025-10-10T14:35:34.151631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601720528641668:9793]
2025-10-10T14:35:34.151635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601720528641668:9793]
2025-10-10T14:35:34.151684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:34.151686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:34.151697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.151700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:34.151702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:34.151708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:34.151864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:34.151974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId: src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:34.154976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:34.201406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601721310869069:7726]
2025-10-10T14:35:34.201744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1716, pipe: [1:7559601721310869069:7726]
2025-10-10T14:35:34.267796Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:34.268081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.268091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.268132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310869069:7726], now have 1 active actors on pipe
2025-10-10T14:35:34.268857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:34.268896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:34.268912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:34.268985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1717 reason: error at write: Disconnected sessionId: src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0
2025-10-10T14:35:34.269224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1717 sessionId: src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0 is DEAD
2025-10-10T14:35:34.269404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:34.269413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0] Write session will restart in 0.008371s
2025-10-10T14:35:34.269438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0] Write session: Do CDS request
2025-10-10T14:35:34.269444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:34.269422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601721310869069:7726]
2025-10-10T14:35:34.269465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:34.278953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.279016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:34.279036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1718
2025-10-10T14:35:34.279259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.279318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:34.279329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:34.279333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:34.279811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1718 sessionId:  describe result for acl check
2025-10-10T14:35:34.279853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:34.279855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:34.279857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:34.279864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601721310869104:7601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:34.280440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601721310869104:7601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:34.282515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601721310869104:7601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:34.285360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601721310869104:7601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:34.285378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601721310869104:7601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:34.285382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601721310869104:7601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:34.285392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:34.295118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:34.296561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:34.296784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:34.296795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:34.296807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:34.296870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:34.296919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601720528641975:9795]
2025-10-10T14:35:34.297576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:34.297897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:34.297952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:34.298278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:34.298338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.298344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.298346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.298347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.298348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.298349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.298350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.298351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.298353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.298353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.298354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.298355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.298357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.298363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.298376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.298380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.298383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.298387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.298390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.298394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.298398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.298401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.298410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.298414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.298421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.298425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.298437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.298449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.298460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.298465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.298470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.298476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.298485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.298493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.298501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.298506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.298514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.298519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.298525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.298530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.298534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.298539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.298543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.298549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.298553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.298563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.298567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.298576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.298584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.298588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.298609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.298617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.298659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:34.300985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:34.301820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:34.301831Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:34.301833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:34.301837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:34.301843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1717 [2:7559601720528641975:9795]
2025-10-10T14:35:34.301857Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:34.301875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:34.301878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.301881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.301884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.301901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:34.301913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:34.301921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:34.301979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.301986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.301988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.301991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:34.302068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:34.302077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.302088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.302099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.302120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:34.302144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310869291:7601], now have 1 active actors on pipe
2025-10-10T14:35:34.302153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310869070:2438], now have 1 active actors on pipe
2025-10-10T14:35:34.302162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601720528641970:9795]
2025-10-10T14:35:34.302164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601720528641970:9795]
2025-10-10T14:35:34.302166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601720528641970:9795]
2025-10-10T14:35:34.302179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:34.302192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:34.302192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:34.302195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:34.302198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:34.302208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:34.302212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:34.302236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601720528641970:9795]
2025-10-10T14:35:34.302243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:34.302244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1717
2025-10-10T14:35:34.302262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1717
2025-10-10T14:35:34.302277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:34.302387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.302397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.302428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fac8f920-57aa4727-55ad0231-27f782cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:34.302439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.302443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.302446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:34.302458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.302469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:34.302486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.302632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.302642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.302657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.302743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1718 partition: 0 MaxSeqNo: 40 sessionId: src_id|fac8f920-57aa4727-55ad0231-27f782cc_0
2025-10-10T14:35:34.303144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7b31953-b9b42476-7ab714b7-234ada8e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fac8f920-57aa4727-55ad0231-27f782cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:34.305856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fac8f920-57aa4727-55ad0231-27f782cc_0] Write session: try to update token
2025-10-10T14:35:34.305875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fac8f920-57aa4727-55ad0231-27f782cc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:34.314200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:34.314226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:34.314239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601720528641970:9795]
2025-10-10T14:35:34.314294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:34.314303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:34.314512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:34.314688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.314857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.315029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.315267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:34.315317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:34.322822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId: src_id|fac8f920-57aa4727-55ad0231-27f782cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:34.325678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:34.325974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.326002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.326068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:34.326155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:34.332528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:34.332550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:34.332557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:34.332559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:34.332570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601720528641970:9795]
2025-10-10T14:35:34.332574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601720528641970:9795]
2025-10-10T14:35:34.332579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601720528641970:9795]
2025-10-10T14:35:34.332628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:34.332627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:34.332635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:34.332638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.332640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:34.332641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:34.332793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:34.369471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601721310869612:7726]
2025-10-10T14:35:34.369791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1717, pipe: [1:7559601721310869612:7726]
2025-10-10T14:35:34.445205Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:34.453512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.453543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.453723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.453791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.453860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.453927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.453973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.453982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.454064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.454127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.454186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.454254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.454301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.454314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.454386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.454452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.454535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.454603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.454647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.454655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.454720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.454972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.455044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.455107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.455156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.455165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.455234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.455296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.455363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.455430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.455474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.455481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.455546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.455605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.455673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.455737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.455777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.455781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.455848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.455991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.456053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.456115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.456180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.456183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.456258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.456326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.456387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.456456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.456500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.456502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.456573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.456638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.456699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.456760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.456807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.456810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.456876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.457308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.457867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.458318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.458366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.458374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.458836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601721310869612:7726]
2025-10-10T14:35:34.458895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:34.458898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:34.458930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1718 reason: error at write: Disconnected sessionId: src_id|fac8f920-57aa4727-55ad0231-27f782cc_0
2025-10-10T14:35:34.459164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1718 sessionId: src_id|fac8f920-57aa4727-55ad0231-27f782cc_0 is DEAD
2025-10-10T14:35:34.459410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:34.458447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310869612:7726], now have 1 active actors on pipe
2025-10-10T14:35:34.459453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:34.461429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac8f920-57aa4727-55ad0231-27f782cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:34.461442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac8f920-57aa4727-55ad0231-27f782cc_0] Write session will restart in 0.005281s
2025-10-10T14:35:34.461467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac8f920-57aa4727-55ad0231-27f782cc_0] Write session: Do CDS request
2025-10-10T14:35:34.461474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac8f920-57aa4727-55ad0231-27f782cc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:34.467974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fac8f920-57aa4727-55ad0231-27f782cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.468055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:34.468089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1719
2025-10-10T14:35:34.468719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.468770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:34.468777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:34.468781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:34.469417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1719 sessionId:  describe result for acl check
2025-10-10T14:35:34.469456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:34.469457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:34.469460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:34.469467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601721310869688:7596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:34.470063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601721310869688:7596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:34.473841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601721310869688:7596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:34.477304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601721310869688:7596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:34.477320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601721310869688:7596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:34.477324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601721310869688:7596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:34.477348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:34.485257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:34.486836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:34.487062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:34.487075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:34.487087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:34.487149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:34.487194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601720528642278:9797]
2025-10-10T14:35:34.487803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:34.488105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:34.488154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:34.488480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:34.488540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.488547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.488548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.488549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.488550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.488551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.488552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.488553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.488554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.488555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.488556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.488557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.488559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.488563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.488576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.488579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.488583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.488586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.488590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.488593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.488597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.488600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.488605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.488609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.488612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.488615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.488623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.488632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.488639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.488645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.488651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.488662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.488671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.488677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.488682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.488691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.488696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.488704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.488709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.488719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.488724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.488734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.488739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.488748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.488754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.488763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.488770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.488775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.488784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.488790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.488794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.488799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.488836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:34.491228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:34.491830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:34.491843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:34.491846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:34.491851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:34.491858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1718 [2:7559601720528642278:9797]
2025-10-10T14:35:34.491872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:34.491891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:34.491902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.491906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.491909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.491927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:34.491935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:34.491944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:34.492002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.492009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.492011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.492014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:34.492083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:34.492092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.492105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.492117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.492140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:34.492164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601720528642273:9797]
2025-10-10T14:35:34.492171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601720528642273:9797]
2025-10-10T14:35:34.492174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601720528642273:9797]
2025-10-10T14:35:34.492188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:34.492207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:34.492224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:34.492228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:34.492232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:34.492235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:34.492244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:34.492258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601720528642273:9797]
2025-10-10T14:35:34.492261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:34.492317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:34.492455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1718
2025-10-10T14:35:34.492499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310869940:7596], now have 1 active actors on pipe
2025-10-10T14:35:34.492487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1718
2025-10-10T14:35:34.492509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310869614:2438], now have 1 active actors on pipe
2025-10-10T14:35:34.492549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.492560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.492596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:34.492619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.492623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.492626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:34.492640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.492658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:34.492676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.492871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.492884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.492916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.493029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1719 partition: 0 MaxSeqNo: 40 sessionId: src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0
2025-10-10T14:35:34.493459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac8f920-57aa4727-55ad0231-27f782cc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:34.496180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0] Write session: try to update token
2025-10-10T14:35:34.496199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:34.504091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:34.504109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:34.504121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601720528642273:9797]
2025-10-10T14:35:34.504173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:34.504176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:34.504355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:34.504497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.504634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.504767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.504960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:34.505003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:34.511052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId: src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:34.513799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:34.514005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.514027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.514089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:34.514260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:34.522955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:34.522978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:34.522982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:34.522984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:34.522995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601720528642273:9797]
2025-10-10T14:35:34.523000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601720528642273:9797]
2025-10-10T14:35:34.523007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601720528642273:9797]
2025-10-10T14:35:34.523062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:34.523069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.523072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:34.523074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:34.523081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:34.523086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:34.523208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:34.558930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601721310870159:7726]
2025-10-10T14:35:34.559165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1718, pipe: [1:7559601721310870159:7726]
2025-10-10T14:35:34.641158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:34.649888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.649914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.650095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.650162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.650229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.650294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.650339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.650350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.650419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.650481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.650544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.650610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.650654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.650661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.650730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.650790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.650851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.650913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.650957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.650964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.651027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.651090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.651155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.651216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.651258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.651265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.651330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.651392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.651453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.651517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.651557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.651561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.651627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.651699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.651765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.651823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.651882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.651885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.651951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.652005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.652065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.652123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.652165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.652171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.652239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.652296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.652356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.652415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.652457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.652459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.652527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.652583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.652651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.652711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.653215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.653218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.653284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:34.654417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:34.654438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:34.654467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1719 reason: error at write: Disconnected sessionId: src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0
2025-10-10T14:35:34.654687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1719 sessionId: src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0 is DEAD
2025-10-10T14:35:34.654807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:34.654814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0] Write session will restart in 0.007996s
2025-10-10T14:35:34.654832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0] Write session: Do CDS request
2025-10-10T14:35:34.654837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:34.653491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:34.654850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601721310870159:7726]
2025-10-10T14:35:34.653555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:34.653613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:34.653652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:34.653655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:34.654874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:34.653717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310870159:7726], now have 1 active actors on pipe
2025-10-10T14:35:34.654471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:34.663866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.663960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:34.663982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1720
2025-10-10T14:35:34.664121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.664160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:34.664171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:34.664177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:34.664659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1720 sessionId:  describe result for acl check
2025-10-10T14:35:34.664702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:34.664709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:34.664711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:34.664717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601721310870206:7593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:34.665314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601721310870206:7593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:34.668045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601721310870206:7593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:34.671806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601721310870206:7593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:34.671822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601721310870206:7593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:34.671826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601721310870206:7593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:34.671835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:34.683407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:34.684967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:34.685186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:34.685191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:34.685205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:34.685269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:34.685410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601720528642597:9803]
2025-10-10T14:35:34.686060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:34.686439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:34.686506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:34.686870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:34.686929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.686936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.686937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.686938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.686940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.686941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.686943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.686944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.686945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.686947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.686948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.686949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.686950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.686956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.686968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.686973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.686977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.686981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.686984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.686990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.686993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.686997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.687002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.687005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.687009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.687013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.687020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.687029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.687036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.687041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.687045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.687050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.687054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.687061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.687065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.687070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.687075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.687080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.687084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.687098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.687102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.687108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.687112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.687118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.687122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.687127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.687131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.687137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.687141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.687145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.687150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.687155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.687202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:34.689764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:34.690286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:34.690304Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:34.690306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:34.690310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:34.690316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1719 [2:7559601720528642597:9803]
2025-10-10T14:35:34.690329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:34.690351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:34.690355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.690359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.690361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.690378Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:34.690386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:34.690394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:34.690474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.690476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.690479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.690482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:34.690554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:34.690557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.690568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.690580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.690599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:34.690620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601720528642592:9803]
2025-10-10T14:35:34.690623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601720528642592:9803]
2025-10-10T14:35:34.690626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601720528642592:9803]
2025-10-10T14:35:34.690643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:34.690660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:34.690675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:34.690678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:34.690692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:34.690696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:34.690698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:34.690708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601720528642592:9803]
2025-10-10T14:35:34.690711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:34.690778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:34.690848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310870165:2438], now have 1 active actors on pipe
2025-10-10T14:35:34.690855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310870436:7593], now have 1 active actors on pipe
2025-10-10T14:35:34.691005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1719
2025-10-10T14:35:34.691051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1719
2025-10-10T14:35:34.691103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.691117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.691160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ad13f75-f2be1015-123fffeb-925ca595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:34.691174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.691178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.691180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:34.691193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.691206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:34.691221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.691427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.691435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.691449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.691546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1720 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ad13f75-f2be1015-123fffeb-925ca595_0
2025-10-10T14:35:34.691935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4580cc91-9ed9651d-7531ed87-e45a6e84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ad13f75-f2be1015-123fffeb-925ca595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:34.694540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad13f75-f2be1015-123fffeb-925ca595_0] Write session: try to update token
2025-10-10T14:35:34.694555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad13f75-f2be1015-123fffeb-925ca595_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:34.711089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId: src_id|5ad13f75-f2be1015-123fffeb-925ca595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:34.714124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:34.714710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.714738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.714763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:34.714766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:34.714770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:34.714772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:34.714781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601720528642592:9803]
2025-10-10T14:35:34.714786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601720528642592:9803]
2025-10-10T14:35:34.714790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601720528642592:9803]
2025-10-10T14:35:34.714853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:34.714866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.714869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:34.714999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:34.715481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:34.715495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:34.715500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:34.754996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601721310870743:7726]
2025-10-10T14:35:34.755211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1719, pipe: [1:7559601721310870743:7726]
2025-10-10T14:35:34.831952Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:34.833114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:34.833193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310870743:7726], now have 1 active actors on pipe
2025-10-10T14:35:34.833259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:34.833487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:34.833536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601721310870743:7726]
2025-10-10T14:35:34.846534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:34.846547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:34.846572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1720 reason: error at write: Disconnected sessionId: src_id|5ad13f75-f2be1015-123fffeb-925ca595_0
2025-10-10T14:35:34.846721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1720 sessionId: src_id|5ad13f75-f2be1015-123fffeb-925ca595_0 is DEAD
2025-10-10T14:35:34.849591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad13f75-f2be1015-123fffeb-925ca595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:34.849606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad13f75-f2be1015-123fffeb-925ca595_0] Write session will restart in 0.008586s
2025-10-10T14:35:34.849633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad13f75-f2be1015-123fffeb-925ca595_0] Write session: Do CDS request
2025-10-10T14:35:34.849641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad13f75-f2be1015-123fffeb-925ca595_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:34.859938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad13f75-f2be1015-123fffeb-925ca595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.862130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:34.862151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1721
2025-10-10T14:35:34.862362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:34.862404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:34.862410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:34.862419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:34.863667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1721 sessionId:  describe result for acl check
2025-10-10T14:35:34.863712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:34.863721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:34.863723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:34.863730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601721310870782:7569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:34.864295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601721310870782:7569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:34.868014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601721310870782:7569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:34.871610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601721310870782:7569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:34.871629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601721310870782:7569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:34.871633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601721310870782:7569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:34.871642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:34.883536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:34.884668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:34.885476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:34.885493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:34.885510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:34.885607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:34.885656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601720528642951:9816]
2025-10-10T14:35:34.886303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:34.886611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:34.886657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:34.886958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:34.887019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.887020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.887021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.887022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.887023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.887024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.887025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.887026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.887027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.887028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.887030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.887031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.887032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.887038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.887049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.887053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.887057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.887060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.887064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.887067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.887070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.887073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.887077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.887080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.887084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.887087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.887094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.887102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:34.887108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.887113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:34.887117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.887122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:34.887125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.887130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:34.887134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.887139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:34.887143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.887148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:34.887152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.887157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:34.887161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.887165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:34.887169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.887175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:34.887178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.887183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:34.887188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.887193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.887196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.887200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.887206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.887210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.887246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:34.889728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:34.890094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:34.890106Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:34.890108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:34.890112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:34.890119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1720 [2:7559601720528642951:9816]
2025-10-10T14:35:34.890132Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:34.890150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:34.890153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.890156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.890158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.890176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:34.890188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:34.890197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:34.890274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.890282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.890284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.890287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:34.890365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:34.890372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.890384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:34.890397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:34.890419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:34.890446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601720528642941:9816]
2025-10-10T14:35:34.890453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601720528642941:9816]
2025-10-10T14:35:34.890455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601720528642941:9816]
2025-10-10T14:35:34.890465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:34.890475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:34.890481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:34.890486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:34.890488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:34.890495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:34.890498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:34.890527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310870757:2438], now have 1 active actors on pipe
2025-10-10T14:35:34.890531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310870888:7569], now have 1 active actors on pipe
2025-10-10T14:35:34.890533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601720528642941:9816]
2025-10-10T14:35:34.890540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:34.890563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:34.890632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1720
2025-10-10T14:35:34.890702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.890717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.890749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abbc559-1b17df62-21887cf0-a2426d8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:34.890763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:34.890770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:34.890777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:34.890789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:34.890809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:34.890828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.890836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1720
2025-10-10T14:35:34.890953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.890961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.890976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:34.891093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1721 partition: 0 MaxSeqNo: 40 sessionId: src_id|abbc559-1b17df62-21887cf0-a2426d8b_0
2025-10-10T14:35:34.891568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad13f75-f2be1015-123fffeb-925ca595_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|abbc559-1b17df62-21887cf0-a2426d8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:34.894259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbc559-1b17df62-21887cf0-a2426d8b_0] Write session: try to update token
2025-10-10T14:35:34.894279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbc559-1b17df62-21887cf0-a2426d8b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:34.906116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:34.906137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:34.906149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601720528642941:9816]
2025-10-10T14:35:34.906206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:34.906383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:34.906530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.906679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.906818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:34.907021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:34.907070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:34.907301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:34.921418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId: src_id|abbc559-1b17df62-21887cf0-a2426d8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:34.924253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:34.924689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:34.924713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:34.924767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:34.925052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:34.933684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601721310871304:7726]
2025-10-10T14:35:34.934289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1720, pipe: [1:7559601721310871304:7726]
2025-10-10T14:35:34.937442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601721310871304:7726], now have 1 active actors on pipe
2025-10-10T14:35:34.939278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:34.939301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:34.939304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:34.939306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:34.939315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601720528642941:9816]
2025-10-10T14:35:34.939318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601720528642941:9816]
2025-10-10T14:35:34.939321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601720528642941:9816]
2025-10-10T14:35:34.939369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:34.939373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:34.939381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:34.939382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:34.939383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:34.939386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:34.939530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:35.051756Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:35.060133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.060167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.060345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.060415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.060478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.060542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.060584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.060594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.060667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.060731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.060799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.060862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.060911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.060919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.060986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.061043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.061102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.061162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.061210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.061215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.061280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.061364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.061431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.061495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.061539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.061545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.061609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.061668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.061741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.061801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.061846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.061851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.061916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.061980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.062051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.062123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.062168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.062177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.062245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.062303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.062372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.062447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.062492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.062500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.062564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.062628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.062699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.062774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.062821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.062832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.062901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.062963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.063035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.063101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.063153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.063159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.063227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:35.063288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:35.063355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:35.063415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:35.063463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:35.063470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:35.063788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:35.063793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601721310871304:7726]
2025-10-10T14:35:35.063806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:35.063818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:35.063839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1721 reason: error at write: Disconnected sessionId: src_id|abbc559-1b17df62-21887cf0-a2426d8b_0
2025-10-10T14:35:35.064067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1721 sessionId: src_id|abbc559-1b17df62-21887cf0-a2426d8b_0 is DEAD
2025-10-10T14:35:35.064209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbc559-1b17df62-21887cf0-a2426d8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:35.064222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbc559-1b17df62-21887cf0-a2426d8b_0] Write session will restart in 0.007627s
2025-10-10T14:35:35.064249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbc559-1b17df62-21887cf0-a2426d8b_0] Write session: Do CDS request
2025-10-10T14:35:35.064264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbc559-1b17df62-21887cf0-a2426d8b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:35.064648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:35.073092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:35.073974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abbc559-1b17df62-21887cf0-a2426d8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.074092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:35.074111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1722
2025-10-10T14:35:35.074352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:35.074595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:35.074610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:35.074624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:35.074703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:35.074748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601724823610304:9818]
2025-10-10T14:35:35.075338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:35.074285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.074351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:35.074357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:35.074361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:35.074840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1722 sessionId:  describe result for acl check
2025-10-10T14:35:35.074869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:35.074871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:35.074876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:35.074882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601725605838623:7560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:35.075549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601725605838623:7560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:35.075684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:35.075751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:35.076146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:35.076208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.076209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.076210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.076211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.076212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.076213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.076214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.076216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.076217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.076218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.076219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.076220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.076221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.076227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.076240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.076243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.076247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.076251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.076254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.076259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.076263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.076266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.076270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.076273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.076277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.076280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.076288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.076296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.076301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.076308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.076312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.076316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.076319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.076327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.076331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.076335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.076339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.076344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.076348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.076353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.076357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.076362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.076365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.076370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.076375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.076394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.076398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.076403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.076407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.076411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.076419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.076423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.076458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:35.080119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601725605838623:7560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:35.082231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:35.082752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:35.082767Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:35.082770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:35.082774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:35.082783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1721 [2:7559601724823610304:9818]
2025-10-10T14:35:35.082797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:35.082816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:35.082825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.082829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.082831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.082850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:35.082865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:35.082874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:35.082936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.082946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.082950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.082953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:35.083031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:35.083039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.083051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.083061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.083080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:35.083109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838603:2438], now have 1 active actors on pipe
2025-10-10T14:35:35.083122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601724823610299:9818]
2025-10-10T14:35:35.083130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601724823610299:9818]
2025-10-10T14:35:35.083132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601724823610299:9818]
2025-10-10T14:35:35.083146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:35.083137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1721
2025-10-10T14:35:35.083161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:35.083170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:35.083170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:35.083173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:35.083188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:35.083192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:35.083244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601724823610299:9818]
2025-10-10T14:35:35.083260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:35.083283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:35.088577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601725605838623:7560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:35.088599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601725605838623:7560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:35.088603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601725605838623:7560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:35.088613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:35.088888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838660:7560], now have 1 active actors on pipe
2025-10-10T14:35:35.089002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1721
2025-10-10T14:35:35.089067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.089085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.089121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:35.089140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.089150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.089157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:35.089187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.089213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:35.089239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.089430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.089438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.089454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.089567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1722 partition: 0 MaxSeqNo: 40 sessionId: src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0
2025-10-10T14:35:35.090067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abbc559-1b17df62-21887cf0-a2426d8b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:35.092903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0] Write session: try to update token
2025-10-10T14:35:35.092926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:35.103123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:35.103144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:35.103147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:35.103149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:35.103160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601724823610299:9818]
2025-10-10T14:35:35.103164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601724823610299:9818]
2025-10-10T14:35:35.103167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601724823610299:9818]
2025-10-10T14:35:35.103223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:35.103231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.103235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:35.103239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:35.103242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:35.103246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:35.103382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:35.110609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId: src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:35.113315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:35.164124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601725605838665:7726]
2025-10-10T14:35:35.164423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1721, pipe: [1:7559601725605838665:7726]
2025-10-10T14:35:35.216788Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:35.217170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.217184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.217237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838665:7726], now have 1 active actors on pipe
2025-10-10T14:35:35.217538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:35.217568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:35.217575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601725605838665:7726]
2025-10-10T14:35:35.217603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:35.217605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:35.217659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1722 reason: error at write: Disconnected sessionId: src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0
2025-10-10T14:35:35.217832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1722 sessionId: src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0 is DEAD
2025-10-10T14:35:35.221579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:35.221594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0] Write session will restart in 0.005686s
2025-10-10T14:35:35.221638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0] Write session: Do CDS request
2025-10-10T14:35:35.221645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:35.228918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.229008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:35.229025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1723
2025-10-10T14:35:35.229651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:35.230967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:35.231209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:35.231221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:35.231236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:35.231298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:35.231346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601724823610363:9820]
2025-10-10T14:35:35.231980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:35.232332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:35.232391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:35.232771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:35.232829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.232835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.232836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.232838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.232839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.232843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.232844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.232846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.232848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.232850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.232851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.232852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.232854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.232861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.232874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.232878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.232882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.232886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.232891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.232895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.232899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.232903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.232907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.232911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.232915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.232919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.232928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.232937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.232944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.232950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.232955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.232961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.232965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.232971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.232976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.232986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.232991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.232996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.233002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.233007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.233012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.233017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.233023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.233033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.233040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.233045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.233050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.233059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.233063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.233068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.233072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.233077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.233119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:35.233618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.233686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:35.233691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:35.233697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:35.238072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:35.238442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:35.238456Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:35.238460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:35.238463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:35.238471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1722 [2:7559601724823610363:9820]
2025-10-10T14:35:35.238489Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:35.238513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:35.238521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.238525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.238528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.238547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:35.238559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:35.238574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:35.238652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.238659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.238661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.238663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:35.238043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1723 sessionId:  describe result for acl check
2025-10-10T14:35:35.238101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:35.238103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:35.238110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:35.238116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601725605838691:7554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:35.238738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601725605838691:7554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:35.238956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1722
2025-10-10T14:35:35.238732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:35.238740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.238752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.238764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.238781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:35.238806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838666:2438], now have 1 active actors on pipe
2025-10-10T14:35:35.238814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601724823610357:9820]
2025-10-10T14:35:35.238816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601724823610357:9820]
2025-10-10T14:35:35.238818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601724823610357:9820]
2025-10-10T14:35:35.238836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:35.238851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:35.238868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:35.238871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:35.238878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:35.238882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:35.238885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:35.238911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601724823610357:9820]
2025-10-10T14:35:35.238914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:35.238917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:35.247247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601725605838691:7554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:35.253517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601725605838691:7554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:35.253548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601725605838691:7554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:35.253552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601725605838691:7554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:35.253563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:35.253850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838725:7554], now have 1 active actors on pipe
2025-10-10T14:35:35.253936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1722
2025-10-10T14:35:35.254004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.254019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.254078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:35.254098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.254105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.254112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:35.254127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.254166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:35.254195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.254396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.254406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.254423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.254550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1723 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0
2025-10-10T14:35:35.254991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fad3c64-38f16a3e-e53cd128-fc2b4b65_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:35.257885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0] Write session: try to update token
2025-10-10T14:35:35.257911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:35.258235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:35.258256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:35.258259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:35.258263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:35.258275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601724823610357:9820]
2025-10-10T14:35:35.258279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601724823610357:9820]
2025-10-10T14:35:35.258283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601724823610357:9820]
2025-10-10T14:35:35.258334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:35.258334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:35.258341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:35.258346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.258346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:35.258348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:35.258488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:35.276053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId: src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:35.278866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:35.317723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601725605838729:7726]
2025-10-10T14:35:35.318033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1722, pipe: [1:7559601725605838729:7726]
2025-10-10T14:35:35.372491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:35.372937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.372954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.372978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838729:7726], now have 1 active actors on pipe
2025-10-10T14:35:35.373193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:35.373228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:35.373248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:35.373260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:35.373287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601725605838729:7726]
2025-10-10T14:35:35.373325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1723 reason: error at write: Disconnected sessionId: src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0
2025-10-10T14:35:35.373520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1723 sessionId: src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0 is DEAD
2025-10-10T14:35:35.373683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:35.373694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0] Write session will restart in 0.005864s
2025-10-10T14:35:35.373720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0] Write session: Do CDS request
2025-10-10T14:35:35.373729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:35.380952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.381012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:35.381028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1724
2025-10-10T14:35:35.381218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.381252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:35.381257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:35.381261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:35.381032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:35.382011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:35.382229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:35.382242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:35.382270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:35.382337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:35.382386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601724823610420:9822]
2025-10-10T14:35:35.381719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1724 sessionId:  describe result for acl check
2025-10-10T14:35:35.381751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:35.381754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:35.381756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:35.381762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601725605838751:7557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:35.382377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601725605838751:7557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:35.382980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:35.383295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:35.383350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:35.383696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:35.383766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.383775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.383776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.383779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.383781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.383782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.383784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.383785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.383786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.383788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.383789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.383790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.383792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.383798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.383810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.383814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.383818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.383821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.383824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.383828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.383832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.383836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.383840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.383844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.383848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.383851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.383860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.383869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.383876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.383882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.383885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.383890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.383895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.383901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.383906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.383910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.383916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.383921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.383925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.383929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.383933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.383938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.383943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.383947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.383952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.383957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.383962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.383967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.383972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.383977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.383981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.383986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.384030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:35.384891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601725605838751:7557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:35.387133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:35.387469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:35.387483Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:35.387486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:35.387489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:35.387496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1723 [2:7559601724823610420:9822]
2025-10-10T14:35:35.387511Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:35.387529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:35.387532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.387535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.387538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.387557Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:35.387574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:35.387585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:35.387645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.387656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.387658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.387661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:35.387726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:35.387734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.387746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.387760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.387780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:35.387811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838730:2438], now have 1 active actors on pipe
2025-10-10T14:35:35.387825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601724823610415:9822]
2025-10-10T14:35:35.387827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601724823610415:9822]
2025-10-10T14:35:35.387829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601724823610415:9822]
2025-10-10T14:35:35.387621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601725605838751:7557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:35.387838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:35.387850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:35.387637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601725605838751:7557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:35.387853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:35.387855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:35.387640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601725605838751:7557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:35.387855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:35.387653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:35.387872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:35.387802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1723
2025-10-10T14:35:35.387875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:35.387906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1723
2025-10-10T14:35:35.387906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838785:7557], now have 1 active actors on pipe
2025-10-10T14:35:35.387908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601724823610415:9822]
2025-10-10T14:35:35.387928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:35.387968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:35.388070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.388079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.388125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:35.388136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.388141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.388143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:35.388156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.388178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:35.388210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.388379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.388390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.388419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.388548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1724 partition: 0 MaxSeqNo: 40 sessionId: src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0
2025-10-10T14:35:35.388977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c88d049-e553a3a4-6550a177-1dd3f8c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:35.391822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0] Write session: try to update token
2025-10-10T14:35:35.391843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:35.408058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId: src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:35.409465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:35.409486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:35.409489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:35.409491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:35.409501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601724823610415:9822]
2025-10-10T14:35:35.409505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601724823610415:9822]
2025-10-10T14:35:35.409510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601724823610415:9822]
2025-10-10T14:35:35.409564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:35.409578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.409581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:35.409679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:35.409696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:35.409701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:35.409724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:35.410823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:35.473365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601725605838792:7726]
2025-10-10T14:35:35.473687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1723, pipe: [1:7559601725605838792:7726]
2025-10-10T14:35:35.523427Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:35.523794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.523812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.523860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838792:7726], now have 1 active actors on pipe
2025-10-10T14:35:35.524081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:35.524105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601725605838792:7726]
2025-10-10T14:35:35.524114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:35.524140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:35.524148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:35.524217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1724 reason: error at write: Disconnected sessionId: src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0
2025-10-10T14:35:35.524428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1724 sessionId: src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0 is DEAD
2025-10-10T14:35:35.524579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:35.524589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0] Write session will restart in 0.008661s
2025-10-10T14:35:35.524614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0] Write session: Do CDS request
2025-10-10T14:35:35.524621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:35.531270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:35.532340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:35.532607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:35.532617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:35.532630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:35.532683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:35.532734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601724823610480:9824]
2025-10-10T14:35:35.533437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:35.533826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:35.533873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:35.534239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:35.534319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.534326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.534327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.534329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.534330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.534331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.534332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.534334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.534335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.534336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.534338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.534339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.534340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.534346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.534360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.534365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.534370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.534373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.534377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.534381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.534385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.534389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.534393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.534397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.534400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.534404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.534412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.534420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.534426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.534432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.534440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.534446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.534450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.534455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.534459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.534466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.534470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.534475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.534479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.534485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.534488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.534493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.534497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.534502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.534506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.534511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.534515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.534520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.534524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.534529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.534533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.534546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.534586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:35.534983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.535049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:35.535067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1725
2025-10-10T14:35:35.536723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.536773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:35.536782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:35.536787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:35.537220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:35.537251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1725 sessionId:  describe result for acl check
2025-10-10T14:35:35.537298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:35.537306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:35.537308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:35.537315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601725605838821:7553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:35.537655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:35.537669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:35.537672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:35.537676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:35.537681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1724 [2:7559601724823610480:9824]
2025-10-10T14:35:35.537695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:35.537725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:35.537733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.537739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.537742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.537761Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:35.537773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:35.537782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:35.537841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.537847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.537850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.537852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:35.537931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:35.537939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.537952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.537963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.537958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601725605838821:7553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:35.537990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:35.538029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838794:2438], now have 1 active actors on pipe
2025-10-10T14:35:35.538042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601724823610475:9824]
2025-10-10T14:35:35.538044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601724823610475:9824]
2025-10-10T14:35:35.538046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601724823610475:9824]
2025-10-10T14:35:35.538059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:35.538064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1724
2025-10-10T14:35:35.538078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:35.538090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:35.538093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:35.538096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:35.538099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:35.538102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:35.538142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601724823610475:9824]
2025-10-10T14:35:35.538151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:35.538158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:35.540782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601725605838821:7553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:35.547331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601725605838821:7553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:35.547351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601725605838821:7553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:35.547355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601725605838821:7553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:35.547364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:35.547672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838854:7553], now have 1 active actors on pipe
2025-10-10T14:35:35.547743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1724
2025-10-10T14:35:35.547814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.547829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.547878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:35.547896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.547905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.547907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:35.547932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.547957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:35.547985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.548189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.548206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.548232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.548347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1725 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0
2025-10-10T14:35:35.548725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f993c7c2-9902ce03-594c7bf2-4a344f94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:35.549228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:35.549243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:35.549253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601724823610475:9824]
2025-10-10T14:35:35.549297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:35.549299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:35.549489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:35.549634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:35.549787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:35.549926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:35.550155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:35.550196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:35.551503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0] Write session: try to update token
2025-10-10T14:35:35.551523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:35.566345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId: src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:35.567664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:35.567688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:35.567692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:35.567694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:35.567709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601724823610475:9824]
2025-10-10T14:35:35.567715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601724823610475:9824]
2025-10-10T14:35:35.567719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601724823610475:9824]
2025-10-10T14:35:35.567776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:35.567778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:35.567786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:35.567789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.567790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:35.567792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:35.569142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:35.567953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:35.624403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601725605838857:7726]
2025-10-10T14:35:35.624819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1724, pipe: [1:7559601725605838857:7726]
2025-10-10T14:35:35.682400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:35.682751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.682766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.682794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838857:7726], now have 1 active actors on pipe
2025-10-10T14:35:35.683017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:35.683063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:35.683116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:35.683205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1725 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0
2025-10-10T14:35:35.683296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601725605838857:7726]
2025-10-10T14:35:35.683427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1725 sessionId: src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0 is DEAD
2025-10-10T14:35:35.683562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:35.683573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0] Write session will restart in 0.009793s
2025-10-10T14:35:35.683599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0] Write session: Do CDS request
2025-10-10T14:35:35.683605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:35.693591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:35.694917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.695011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:35.695029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1726
2025-10-10T14:35:35.695172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.695214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:35.695231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:35.695235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:35.695640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1726 sessionId:  describe result for acl check
2025-10-10T14:35:35.695675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:35.695681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:35.695683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:35.695689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601725605838890:7542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:35.696262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601725605838890:7542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:35.695288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:35.695497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:35.695505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:35.695516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:35.695565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:35.695601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601724823610542:9826]
2025-10-10T14:35:35.696262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:35.696629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:35.696685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:35.697045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:35.697112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.697121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.697122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.697123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.697124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.697125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.697126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.697128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.697129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.697130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.697131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.697132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.697133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.697139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.697152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.697156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.697160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.697165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.697169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.697173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.697178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.697181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.697185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.697190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.697194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.697198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.697205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.697213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.697220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.697225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.697231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.697235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.697239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.697247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.697252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.697257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.697261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.697266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.697271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.697276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.697281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.697286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.697291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.697296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.697301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.697305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.697310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.697315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.697319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.697324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.697343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.697349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.697395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:35.699207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601725605838890:7542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:35.700704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:35.701052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:35.701064Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:35.701067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:35.701071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:35.701078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1725 [2:7559601724823610542:9826]
2025-10-10T14:35:35.701093Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:35.701113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:35.701122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.701126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.701129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.701148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:35.701155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:35.701168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:35.701229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.701236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.701238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.701240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:35.701314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:35.701324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.701350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.701361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.701378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:35.701402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838866:2438], now have 1 active actors on pipe
2025-10-10T14:35:35.701416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601724823610536:9826]
2025-10-10T14:35:35.701418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601724823610536:9826]
2025-10-10T14:35:35.701420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601724823610536:9826]
2025-10-10T14:35:35.701435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:35.701451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:35.701468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:35.701471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:35.701506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601724823610536:9826]
2025-10-10T14:35:35.701509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:35.701508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:35.701512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:35.701514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:35.701523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:35.701509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1725
2025-10-10T14:35:35.709215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601725605838890:7542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:35.709235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601725605838890:7542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:35.709247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601725605838890:7542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:35.709257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:35.713809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1725
2025-10-10T14:35:35.714284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838926:7542], now have 1 active actors on pipe
2025-10-10T14:35:35.714320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.714329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.714351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:35.714354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:35.714362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601724823610536:9826]
2025-10-10T14:35:35.714419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:35.714441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.714448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.714451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:35.714466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.714487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:35.714513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:35.714688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:35.714835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:35.714978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:35.715124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:35.715320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:35.715367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.715390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:35.715417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:35.715657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.715674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.715697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.715818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1726 partition: 0 MaxSeqNo: 40 sessionId: src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0
2025-10-10T14:35:35.716275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4e0660-6d3f6648-c42c0093-7799eaf8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:35.719048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0] Write session: try to update token
2025-10-10T14:35:35.719067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:35.734964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:35.734992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:35.734996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:35.734998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:35.735010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601724823610536:9826]
2025-10-10T14:35:35.735014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601724823610536:9826]
2025-10-10T14:35:35.735018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601724823610536:9826]
2025-10-10T14:35:35.735073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:35.735080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.735083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:35.735087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:35.735094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:35.735098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:35.735224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:35.743642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId: src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:35.746506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:35.789484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601725605838958:7726]
2025-10-10T14:35:35.790122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1725, pipe: [1:7559601725605838958:7726]
2025-10-10T14:35:35.849541Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:35.849843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.849860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.849885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838958:7726], now have 1 active actors on pipe
2025-10-10T14:35:35.850185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601725605838958:7726]
2025-10-10T14:35:35.850217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:35.850216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:35.850254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:35.850263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:35.850326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1726 reason: error at write: Disconnected sessionId: src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0
2025-10-10T14:35:35.850531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1726 sessionId: src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0 is DEAD
2025-10-10T14:35:35.850753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:35.850763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0] Write session will restart in 0.009389s
2025-10-10T14:35:35.850789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0] Write session: Do CDS request
2025-10-10T14:35:35.850795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:35.858368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:35.859578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:35.859851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:35.859865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:35.859880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:35.859944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:35.859993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601724823610655:9843]
2025-10-10T14:35:35.860621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:35.861028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:35.861114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:35.861501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:35.861580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.861586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.861588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.861589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.861590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.861592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.861593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.861594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.861596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.861597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.861598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.861600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.861601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.861608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.861621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.861626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.861631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.861635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.861639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.861643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.861646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.861648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.861653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.861655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.861657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.861658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.861675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.861687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:35.861696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.861702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:35.861707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.861712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:35.861716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.861721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:35.861726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.861731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:35.861736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.861741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:35.861753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.861758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:35.861762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.861768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:35.861775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.861781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:35.861790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.861796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:35.861806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.861811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.861815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.861821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.861830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.861835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.861876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:35.861929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.862042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:35.862061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1727
2025-10-10T14:35:35.862274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:35.862312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:35.862323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:35.862327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:35.862816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1727 sessionId:  describe result for acl check
2025-10-10T14:35:35.862858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:35.862870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:35.862874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:35.862881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601725605839003:7525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:35.863504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601725605839003:7525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:35.864490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:35.864942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:35.864959Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:35.864962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:35.864966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:35.864975Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1726 [2:7559601724823610655:9843]
2025-10-10T14:35:35.864992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:35.865022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:35.865025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.865029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.865034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.865056Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:35.865070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:35.865079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:35.865148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.865157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.865159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.865162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:35.865237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:35.865246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.865259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:35.865269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:35.865285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:35.865307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601724823610650:9843]
2025-10-10T14:35:35.865310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601724823610650:9843]
2025-10-10T14:35:35.865312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601724823610650:9843]
2025-10-10T14:35:35.865325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:35.865361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:35.865378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:35.865381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:35.865396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:35.865402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:35.865404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:35.865423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601724823610650:9843]
2025-10-10T14:35:35.865426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:35.865470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:35.865619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605838974:2438], now have 1 active actors on pipe
2025-10-10T14:35:35.866173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601725605839003:7525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:35.866265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1726
2025-10-10T14:35:35.873363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601725605839003:7525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:35.873386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601725605839003:7525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:35.873391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601725605839003:7525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:35.873402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:35.873987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1726
2025-10-10T14:35:35.873934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605839033:7525], now have 1 active actors on pipe
2025-10-10T14:35:35.874131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.874151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.874196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:35.874216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:35.874225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:35.874228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:35.874244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:35.874276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:35.874303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.874701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1727 partition: 0 MaxSeqNo: 40 sessionId: src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0
2025-10-10T14:35:35.875118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515adeba-c7fc5842-44f59bf7-ca36bca6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:35.878111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0] Write session: try to update token
2025-10-10T14:35:35.878138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:35.874540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:35.874556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:35.874583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:35.887939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:35.887966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:35.887969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:35.887971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:35.887982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601724823610650:9843]
2025-10-10T14:35:35.887989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601724823610650:9843]
2025-10-10T14:35:35.887994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601724823610650:9843]
2025-10-10T14:35:35.888064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:35.888078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:35.888080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:35.888084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:35.888086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:35.888089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:35.888237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:35.898971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId: src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:35.902061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:35.950553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601725605839036:7726]
2025-10-10T14:35:35.952086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1726, pipe: [1:7559601725605839036:7726]
2025-10-10T14:35:36.002775Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:36.003058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.003067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.003089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601725605839036:7726], now have 1 active actors on pipe
2025-10-10T14:35:36.003413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:36.004151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:36.004161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0] Write session will restart in 0.006079s
2025-10-10T14:35:36.004180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0] Write session: Do CDS request
2025-10-10T14:35:36.004186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:36.003533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601725605839036:7726]
2025-10-10T14:35:36.003579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:36.003624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:36.003628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:36.003728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1727 reason: error at write: Disconnected sessionId: src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0
2025-10-10T14:35:36.003997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1727 sessionId: src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0 is DEAD
2025-10-10T14:35:36.017839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.021473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:36.021492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1728
2025-10-10T14:35:36.021652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.021684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:36.021690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:36.021694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:36.022346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:36.023028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1728 sessionId:  describe result for acl check
2025-10-10T14:35:36.023070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:36.023079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:36.023081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:36.023088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601729900806363:7520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:36.023677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601729900806363:7520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:36.024373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:36.024599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:36.024610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:36.024622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:36.024686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:36.024733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601729118578015:9845]
2025-10-10T14:35:36.025345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:36.028264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601729900806363:7520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:36.028150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:36.028220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:36.028563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:36.028626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.028628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.028629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.028630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.028631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.028634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.028635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.028637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.028638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.028639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.028640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.028641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.028642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.028648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.028661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.028665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.028669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.028673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.028677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.028680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.028685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.028688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.028693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.028697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.028700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.028704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.028713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.028721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.028728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.028733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.028738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.028743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.028747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.028752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.028756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.028761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.028765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.028771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.028775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.028782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.028786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.028790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.028795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.028800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.028804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.028808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.028812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.028817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.028820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.028827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.028834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.028838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.028875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:36.032462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601729900806363:7520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:36.032478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601729900806363:7520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:36.032482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601729900806363:7520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:36.032492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:36.034946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:36.035293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:36.035299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:36.035302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:36.035306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:36.035314Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1727 [2:7559601729118578015:9845]
2025-10-10T14:35:36.035336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:36.035355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:36.035359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.035366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.035368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.035388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:36.035396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:36.035405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:36.035465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.035467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.035469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.035472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:36.035552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:36.035555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.035567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.035580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.035599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:36.035621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601729118578010:9845]
2025-10-10T14:35:36.035624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601729118578010:9845]
2025-10-10T14:35:36.035626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601729118578010:9845]
2025-10-10T14:35:36.035635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:36.035652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:36.035653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:36.035657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:36.035660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:36.035670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:36.035675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:36.035688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806337:2438], now have 1 active actors on pipe
2025-10-10T14:35:36.035692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806392:7520], now have 1 active actors on pipe
2025-10-10T14:35:36.035731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601729118578010:9845]
2025-10-10T14:35:36.035740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:36.035783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:36.036181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1727
2025-10-10T14:35:36.036223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1727
2025-10-10T14:35:36.036360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.036373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.036407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:36.036416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.036420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.036422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:36.036434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.036446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:36.036462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.037103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.037114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.037135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.037248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1728 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0
2025-10-10T14:35:36.041660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3dd6e1b-af65ca4d-4e463ccf-6137e96e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:36.044376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0] Write session: try to update token
2025-10-10T14:35:36.044400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:36.050126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:36.050148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.050160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601729118578010:9845]
2025-10-10T14:35:36.050210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:36.050389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:36.050522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.050650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.050780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.050987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:36.051023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:36.051418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:36.060731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId: src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:36.063676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:36.064903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.064928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.064969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:36.065497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:36.082724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:36.082743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.082747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:36.082749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:36.082762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601729118578010:9845]
2025-10-10T14:35:36.082765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601729118578010:9845]
2025-10-10T14:35:36.082769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601729118578010:9845]
2025-10-10T14:35:36.082817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:36.082825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.082827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:36.082956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:36.082990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:36.082996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:36.083002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:36.103931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601729900806400:7726]
2025-10-10T14:35:36.105592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1727, pipe: [1:7559601729900806400:7726]
2025-10-10T14:35:36.200398Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:36.207979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.208019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.208209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.208281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.208351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.208416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.208469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.208479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.208550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.208616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.208684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.208754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.208799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.208807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.208875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.208937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.209004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.209070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.209115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.209122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.209191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.209253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.209319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.209401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.209457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.209465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.209535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.209597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.209659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.209723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.209766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.209773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.209838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.209899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.209963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.210037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.210082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.210092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.210155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.210215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.210278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.210340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.210389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.210396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.210462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.210529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.210592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.210655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.210701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.210711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.210776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.210839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.210901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.210967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.211012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.211019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.211084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.211146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.211208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.211274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.211321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.211329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.211397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806400:7726], now have 1 active actors on pipe
2025-10-10T14:35:36.211635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:36.211650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601729900806400:7726]
2025-10-10T14:35:36.211652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:36.211677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:36.211683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1728 reason: error at write: Disconnected sessionId: src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0
2025-10-10T14:35:36.211918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1728 sessionId: src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0 is DEAD
2025-10-10T14:35:36.212097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:36.212108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0] Write session will restart in 0.008298s
2025-10-10T14:35:36.212147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0] Write session: Do CDS request
2025-10-10T14:35:36.212154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:36.212494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:36.221973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.222055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:36.222074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1729
2025-10-10T14:35:36.222191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.222226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:36.222236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:36.222241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:36.222704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:36.222749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1729 sessionId:  describe result for acl check
2025-10-10T14:35:36.222789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:36.222791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:36.222794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:36.222800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601729900806428:7516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:36.223311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:36.223412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601729900806428:7516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:36.223537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:36.223550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:36.223577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:36.223649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:36.223703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601729118578078:9847]
2025-10-10T14:35:36.224308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:36.224682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:36.224727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:36.225073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:36.225144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.225155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.225156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.225157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.225159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.225160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.225162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.225166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.225168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.225169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.225170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.225171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.225172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.225178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.225190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.225194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.225198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.225202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.225206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.225209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.225213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.225217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.225221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.225225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.225228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.225232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.225241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.225249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.225256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.225261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.225266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.225271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.225275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.225280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.225285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.225290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.225295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.225300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.225306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.225311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.225316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.225321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.225325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.225352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.225356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.225360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.225365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.225369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.225373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.225380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.225384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.225393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.225434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:36.226060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601729900806428:7516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:36.227901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:36.228209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:36.228225Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:36.228227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:36.228231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:36.228238Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1728 [2:7559601729118578078:9847]
2025-10-10T14:35:36.228250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:36.228268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:36.228271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.228275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.228279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.228297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:36.228310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:36.228319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:36.228379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.228387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.228389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.228391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:36.228458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:36.228465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.228477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.228494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.228511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:36.228539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806403:2438], now have 1 active actors on pipe
2025-10-10T14:35:36.228552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601729118578073:9847]
2025-10-10T14:35:36.228554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601729118578073:9847]
2025-10-10T14:35:36.228556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601729118578073:9847]
2025-10-10T14:35:36.228568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:36.228581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:36.228585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:36.228587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:36.228596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:36.228613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:36.228621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:36.228606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1728
2025-10-10T14:35:36.228650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601729118578073:9847]
2025-10-10T14:35:36.228662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:36.228669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:36.228832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601729900806428:7516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:36.228844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601729900806428:7516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:36.228848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601729900806428:7516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:36.228856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:36.229027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806465:7516], now have 1 active actors on pipe
2025-10-10T14:35:36.229114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1728
2025-10-10T14:35:36.229165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.229175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.229204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|703f274b-517a7139-83b0fea5-f8919991_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:36.229216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.229221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.229228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:36.229240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.229254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:36.229271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.229431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.229439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.229452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.229522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1729 partition: 0 MaxSeqNo: 40 sessionId: src_id|703f274b-517a7139-83b0fea5-f8919991_0
2025-10-10T14:35:36.230034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7854ad-e5ee3b24-899dbffb-e74c099_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|703f274b-517a7139-83b0fea5-f8919991_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:36.232940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703f274b-517a7139-83b0fea5-f8919991_0] Write session: try to update token
2025-10-10T14:35:36.232960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703f274b-517a7139-83b0fea5-f8919991_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:36.241909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:36.241931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.241944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601729118578073:9847]
2025-10-10T14:35:36.242011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:36.242016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:36.242197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:36.242339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.242477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.242618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.242874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:36.242917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:36.250955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId: src_id|703f274b-517a7139-83b0fea5-f8919991_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:36.253783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:36.254048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.254076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.254130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:36.254208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:36.262425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:36.262448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.262451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:36.262453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:36.262465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601729118578073:9847]
2025-10-10T14:35:36.262469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601729118578073:9847]
2025-10-10T14:35:36.262472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601729118578073:9847]
2025-10-10T14:35:36.262521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:36.262523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:36.262529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.262530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:36.262532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:36.262534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:36.262665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:36.312038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601729900806473:7726]
2025-10-10T14:35:36.312321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1728, pipe: [1:7559601729900806473:7726]
2025-10-10T14:35:36.375315Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:36.383357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.383391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.383570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.383631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.383699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.383768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.384220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.384237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.384305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.384365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.384428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.384499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.384543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.384550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.384615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.384674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.384739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.384798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.384839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.384845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.384909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.384974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.385042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.385104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.385151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.385154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.385223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.385287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.385371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.385440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.385483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.385491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.385556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.385617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.385685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.385747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.385791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.385798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.385865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.385926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.385987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.386059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.386100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.386106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.386170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.386231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.386290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.386403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.386449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.386456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.386518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.386575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.386636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.386698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.386845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.386852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.386916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.386978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.387045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.387111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.387157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.387164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.387228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806473:7726], now have 1 active actors on pipe
2025-10-10T14:35:36.387479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601729900806473:7726]
2025-10-10T14:35:36.387526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:36.387530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:36.387535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:36.387561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1729 reason: error at write: Disconnected sessionId: src_id|703f274b-517a7139-83b0fea5-f8919991_0
2025-10-10T14:35:36.387772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:36.387826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1729 sessionId: src_id|703f274b-517a7139-83b0fea5-f8919991_0 is DEAD
2025-10-10T14:35:36.387981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f274b-517a7139-83b0fea5-f8919991_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:36.387991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f274b-517a7139-83b0fea5-f8919991_0] Write session will restart in 0.007547s
2025-10-10T14:35:36.388017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f274b-517a7139-83b0fea5-f8919991_0] Write session: Do CDS request
2025-10-10T14:35:36.388024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f274b-517a7139-83b0fea5-f8919991_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:36.396981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703f274b-517a7139-83b0fea5-f8919991_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.397016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:36.397035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1730
2025-10-10T14:35:36.397261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.397312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:36.397318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:36.397322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:36.397953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:36.397901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1730 sessionId:  describe result for acl check
2025-10-10T14:35:36.397947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:36.397948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:36.397950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:36.397958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601729900806502:7500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:36.398608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601729900806502:7500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:36.401018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:36.401271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:36.401285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:36.401298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:36.401381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:36.401427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601729118578145:9849]
2025-10-10T14:35:36.402071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:36.402012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601729900806502:7500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:36.402463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:36.402528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:36.402880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:36.402945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.402954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.402955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.402956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.402958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.402959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.402960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.402962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.402963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.402965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.402966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.402967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.402968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.402974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.402986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.402990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.402997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.403000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.403004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.403008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.403011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.403014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.403018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.403022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.403025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.403029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.403037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.403045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.403051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.403056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.403060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.403065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.403070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.403074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.403079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.403083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.403088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.403092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.403099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.403104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.403109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.403114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.403119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.403124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.403127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.403133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.403138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.403145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.403149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.403154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.403158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.403164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.403205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:36.405741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601729900806502:7500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:36.405760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601729900806502:7500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:36.405764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601729900806502:7500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:36.405774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:36.406678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1729
2025-10-10T14:35:36.406685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1729
2025-10-10T14:35:36.405872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:36.406243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:36.406248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:36.406251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:36.406255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:36.406261Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1729 [2:7559601729118578145:9849]
2025-10-10T14:35:36.406275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:36.406292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:36.406295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.406299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.406302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.406320Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:36.406328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:36.406336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:36.406398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.406400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.406403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.406407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:36.406484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:36.406489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.406503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.406516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.406535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:36.406557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601729118578139:9849]
2025-10-10T14:35:36.406559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601729118578139:9849]
2025-10-10T14:35:36.406561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601729118578139:9849]
2025-10-10T14:35:36.406570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:36.406585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:36.406589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:36.406592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:36.406595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:36.406603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:36.406606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:36.406617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806537:7500], now have 1 active actors on pipe
2025-10-10T14:35:36.406621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806475:2438], now have 1 active actors on pipe
2025-10-10T14:35:36.406648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601729118578139:9849]
2025-10-10T14:35:36.406659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:36.406787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:36.406895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.406902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.406936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9862a05b-e9c072a6-191b915f-70452825_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:36.406947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.406954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.406956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:36.406968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.406990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:36.407007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.407371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1730 partition: 0 MaxSeqNo: 40 sessionId: src_id|9862a05b-e9c072a6-191b915f-70452825_0
2025-10-10T14:35:36.407239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.407254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.407276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.407901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703f274b-517a7139-83b0fea5-f8919991_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9862a05b-e9c072a6-191b915f-70452825_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:36.410874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9862a05b-e9c072a6-191b915f-70452825_0] Write session: try to update token
2025-10-10T14:35:36.410896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9862a05b-e9c072a6-191b915f-70452825_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:36.426975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:36.426996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.426999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:36.427001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:36.427015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601729118578139:9849]
2025-10-10T14:35:36.427020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601729118578139:9849]
2025-10-10T14:35:36.427024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601729118578139:9849]
2025-10-10T14:35:36.427073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:36.427082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.427084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:36.427107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:36.427115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:36.427120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:36.427226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:36.432915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId: src_id|9862a05b-e9c072a6-191b915f-70452825_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:36.435511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:36.488513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601729900806545:7726]
2025-10-10T14:35:36.488808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1729, pipe: [1:7559601729900806545:7726]
2025-10-10T14:35:36.543565Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:36.543968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.543983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.544038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806545:7726], now have 1 active actors on pipe
2025-10-10T14:35:36.544588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:36.549490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601729900806545:7726]
2025-10-10T14:35:36.549501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:36.549507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:36.549534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:36.549592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1730 reason: error at write: Disconnected sessionId: src_id|9862a05b-e9c072a6-191b915f-70452825_0
2025-10-10T14:35:36.549968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9862a05b-e9c072a6-191b915f-70452825_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:36.549981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9862a05b-e9c072a6-191b915f-70452825_0] Write session will restart in 0.005982s
2025-10-10T14:35:36.550018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9862a05b-e9c072a6-191b915f-70452825_0] Write session: Do CDS request
2025-10-10T14:35:36.550025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9862a05b-e9c072a6-191b915f-70452825_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:36.549803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1730 sessionId: src_id|9862a05b-e9c072a6-191b915f-70452825_0 is DEAD
2025-10-10T14:35:36.556929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9862a05b-e9c072a6-191b915f-70452825_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.556996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:36.557028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1731
2025-10-10T14:35:36.557203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.557267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:36.557279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:36.557283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:36.557781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1731 sessionId:  describe result for acl check
2025-10-10T14:35:36.557820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:36.557827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:36.557829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:36.557846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601729900806573:7504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:36.558408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:36.558643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601729900806573:7504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:36.559203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:36.559423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:36.559435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:36.559447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:36.559501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:36.559557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601729118578210:9851]
2025-10-10T14:35:36.560246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:36.560617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:36.560673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:36.561000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601729900806573:7504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:36.561021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:36.561073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.561075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.561076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.561077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.561079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.561080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.561082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.561083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.561085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.561086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.561087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.561088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.561090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.561096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.561109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.561114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.561118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.561122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.561126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.561132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.561136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.561140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.561145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.561148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.561152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.561156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.561163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.561171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.561178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.561184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.561189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.561195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.561199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.561204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.561209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.561215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.561219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.561224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.561229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.561244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.561249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.561254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.561259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.561264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.561268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.561273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.561278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.561283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.561287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.561292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.561298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.561303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.561361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:36.564751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:36.564876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601729900806573:7504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:36.564897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601729900806573:7504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:36.564901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601729900806573:7504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:36.564910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:36.565069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:36.565084Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:36.565090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:36.565094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:36.565100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1730 [2:7559601729118578210:9851]
2025-10-10T14:35:36.565116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:36.565135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:36.565138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.565142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.565144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.565162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:36.565174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:36.565186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:36.565244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.565253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.565255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.565258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:36.565327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:36.565352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.565363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.565375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.565395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:36.565421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806546:2438], now have 1 active actors on pipe
2025-10-10T14:35:36.565429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806608:7504], now have 1 active actors on pipe
2025-10-10T14:35:36.565436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601729118578204:9851]
2025-10-10T14:35:36.565439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601729118578204:9851]
2025-10-10T14:35:36.565440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601729118578204:9851]
2025-10-10T14:35:36.565456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:36.565432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1730
2025-10-10T14:35:36.565444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1730
2025-10-10T14:35:36.565476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:36.565498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:36.565503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:36.565537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601729118578204:9851]
2025-10-10T14:35:36.565544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:36.565548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:36.565552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:36.565553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:36.565561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:36.565593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.565602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.565634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85c7a104-dc716058-35daf594-b3013e86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:36.565646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.565658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.565660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:36.565671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.565683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:36.565700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.565855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.565863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.565876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.566052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1731 partition: 0 MaxSeqNo: 40 sessionId: src_id|85c7a104-dc716058-35daf594-b3013e86_0
2025-10-10T14:35:36.566445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9862a05b-e9c072a6-191b915f-70452825_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|85c7a104-dc716058-35daf594-b3013e86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:36.569367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c7a104-dc716058-35daf594-b3013e86_0] Write session: try to update token
2025-10-10T14:35:36.569386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c7a104-dc716058-35daf594-b3013e86_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:36.579734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:36.579758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.579772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601729118578204:9851]
2025-10-10T14:35:36.579827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:36.579835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:36.580073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:36.580275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.580469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.580650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.580906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:36.580968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:36.587150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId: src_id|85c7a104-dc716058-35daf594-b3013e86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:36.589927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:36.591267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.591292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.591339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:36.591454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:36.598680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:36.598701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.598705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:36.598707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:36.598718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601729118578204:9851]
2025-10-10T14:35:36.598723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601729118578204:9851]
2025-10-10T14:35:36.598727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601729118578204:9851]
2025-10-10T14:35:36.598778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:36.598777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:36.598784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:36.598788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:36.598790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.598792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:36.598922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:36.649877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601729900806616:7726]
2025-10-10T14:35:36.651413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1730, pipe: [1:7559601729900806616:7726]
2025-10-10T14:35:36.714052Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:36.721916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.721945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.722132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.722192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.722254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.722317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.722570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.722581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.722657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.722733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.722818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.723142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.723192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.723201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.723267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.723328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.723390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.723452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.723495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.723502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.723567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.723633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.723696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.723757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.723799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.723806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.723871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.723932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.723994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.724055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.724098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.724105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.724168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.724230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.724294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.724371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.724416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.724427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.724492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.724547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.724607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.724666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.724706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.724709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.724775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.724833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.724894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.724950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.724989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.724991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.725054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.725108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.725164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.725224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.725262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.725264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.725433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:36.725496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:36.725555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:36.725624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:36.725668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:36.725671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:36.725744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806616:7726], now have 1 active actors on pipe
2025-10-10T14:35:36.725946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:36.726020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:36.726078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:36.726101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601729900806616:7726]
2025-10-10T14:35:36.726125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1731 reason: status is not ok: tablet will be restarted right now sessionId: src_id|85c7a104-dc716058-35daf594-b3013e86_0
2025-10-10T14:35:36.726377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1731 sessionId: src_id|85c7a104-dc716058-35daf594-b3013e86_0 is DEAD
2025-10-10T14:35:36.726798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c7a104-dc716058-35daf594-b3013e86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:36.726809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c7a104-dc716058-35daf594-b3013e86_0] Write session will restart in 0.006566s
2025-10-10T14:35:36.726835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c7a104-dc716058-35daf594-b3013e86_0] Write session: Do CDS request
2025-10-10T14:35:36.726842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c7a104-dc716058-35daf594-b3013e86_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:36.735803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:36.736136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85c7a104-dc716058-35daf594-b3013e86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.736271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:36.736290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1732
2025-10-10T14:35:36.736426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.736463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:36.736478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:36.736483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:36.736648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:36.736852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:36.736866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:36.736879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:36.736944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:36.736990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601729118578277:9853]
2025-10-10T14:35:36.737607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:36.738293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:36.738350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:36.738709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:36.738792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.738793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.738795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.738796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.738797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.738799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.738800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.738802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.738803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.738804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.738805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.738807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.738808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.738815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.738828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.738832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.738836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.738840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.738844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.738848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.738852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.738858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.738862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.738866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.738870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.738874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.738882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.738894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.738900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.738907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.738911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.738917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.738936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.738940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.738944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.738951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.738955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.738960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.738964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.738969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.738973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.738977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.738982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.738988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.738993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.738998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.739003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.739008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.739013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.739019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.739023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.739028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.739071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:36.737021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1732 sessionId:  describe result for acl check
2025-10-10T14:35:36.737059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:36.737061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:36.737063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:36.737069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601729900806655:7499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:36.737705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601729900806655:7499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:36.741325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601729900806655:7499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:36.742249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:36.742684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:36.742699Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:36.742702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:36.742706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:36.742714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1731 [2:7559601729118578277:9853]
2025-10-10T14:35:36.742728Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:36.742751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:36.742760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.742763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.742766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.742785Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:36.742798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:36.742809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:36.742868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.742878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.742880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.742883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:36.742958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:36.742968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.742981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.742994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.743013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:36.743040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806622:2438], now have 1 active actors on pipe
2025-10-10T14:35:36.743052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601729118578272:9853]
2025-10-10T14:35:36.743059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601729118578272:9853]
2025-10-10T14:35:36.743061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601729118578272:9853]
2025-10-10T14:35:36.743077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:36.743100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:36.743122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:36.743130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:36.743141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:36.743143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:36.743146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:36.743162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601729118578272:9853]
2025-10-10T14:35:36.743165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:36.743167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:36.743093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1731
2025-10-10T14:35:36.748187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601729900806655:7499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:36.748207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601729900806655:7499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:36.748211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601729900806655:7499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:36.748222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:36.752183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1731
2025-10-10T14:35:36.752869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1732 partition: 0 MaxSeqNo: 40 sessionId: src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0
2025-10-10T14:35:36.753309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85c7a104-dc716058-35daf594-b3013e86_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:36.752030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806692:7499], now have 1 active actors on pipe
2025-10-10T14:35:36.752295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.752310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.752366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:36.752380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.752389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.752392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:36.752407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.752430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:36.752453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.752719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.752725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.752762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.756163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0] Write session: try to update token
2025-10-10T14:35:36.756189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:36.764170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:36.764192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.764196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:36.764198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:36.764208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601729118578272:9853]
2025-10-10T14:35:36.764212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601729118578272:9853]
2025-10-10T14:35:36.764216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601729118578272:9853]
2025-10-10T14:35:36.764261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:36.764265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:36.764269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:36.764273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:36.764273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.764277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:36.764410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:36.775608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId: src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:36.778218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:36.829403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601729900806722:7726]
2025-10-10T14:35:36.829616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1731, pipe: [1:7559601729900806722:7726]
2025-10-10T14:35:36.880936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:36.881220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.881237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.881260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806722:7726], now have 1 active actors on pipe
2025-10-10T14:35:36.881471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:36.881877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:36.881886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0] Write session will restart in 0.005486s
2025-10-10T14:35:36.881911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0] Write session: Do CDS request
2025-10-10T14:35:36.881917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:36.881434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601729900806722:7726]
2025-10-10T14:35:36.881464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:36.881476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:36.881528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1732 reason: error at write: Disconnected sessionId: src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0
2025-10-10T14:35:36.881724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1732 sessionId: src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0 is DEAD
2025-10-10T14:35:36.881871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:36.890974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:36.891964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:36.892167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:36.892179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:36.892191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:36.892241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:36.892281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601729118578396:9870]
2025-10-10T14:35:36.892883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:36.893130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:36.893170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:36.893487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:36.893550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.893557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.893558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.893560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.893561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.893562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.893563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.893565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.893566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.893568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.893569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.893570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.893572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.893577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.893590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.893594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.893597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.893601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.893607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.893611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.893614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.893618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.893622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.893626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.893630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.893634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.893642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.893651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:36.893658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.893664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:36.893669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.893674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:36.893678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.893684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:36.893690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.893695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:36.893699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.893705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:36.893709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.893714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:36.893717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.893723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:36.893729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.893735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:36.893739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.893752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:36.893756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.893762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.893766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.893772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.893776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.893780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.893816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:36.893943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.894015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:36.894038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1733
2025-10-10T14:35:36.894194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:36.894235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:36.894245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:36.894250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:36.894962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1733 sessionId:  describe result for acl check
2025-10-10T14:35:36.895007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:36.895014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:36.895016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:36.895022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601729900806772:7480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:36.895597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601729900806772:7480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:36.896353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:36.896731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:36.896745Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:36.896748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:36.896751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:36.896757Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1732 [2:7559601729118578396:9870]
2025-10-10T14:35:36.896775Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:36.896807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:36.896815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.896820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.896822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.896840Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:36.896854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:36.896861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:36.896919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.896926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.896928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.896931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:36.897003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:36.897012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.897024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:36.897036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:36.897058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:36.897086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806736:2438], now have 1 active actors on pipe
2025-10-10T14:35:36.897093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601729118578391:9870]
2025-10-10T14:35:36.897096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601729118578391:9870]
2025-10-10T14:35:36.897098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601729118578391:9870]
2025-10-10T14:35:36.897111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:36.897123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:36.897127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:36.897127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:36.897129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:36.897142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:36.897117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1732
2025-10-10T14:35:36.897154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:36.897191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601729118578391:9870]
2025-10-10T14:35:36.897199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:36.897205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:36.897736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601729900806772:7480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:36.904177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601729900806772:7480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:36.904197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601729900806772:7480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:36.904201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601729900806772:7480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:36.904221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:36.904545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806802:7480], now have 1 active actors on pipe
2025-10-10T14:35:36.904631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1732
2025-10-10T14:35:36.904713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.904745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.904783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:36.904797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:36.904803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:36.904806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:36.904821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:36.904841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:36.904873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.905076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.905089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.905115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:36.905211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1733 partition: 0 MaxSeqNo: 40 sessionId: src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0
2025-10-10T14:35:36.905748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc04c8e-be5a6b0b-9ec44f5-43d059ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:36.908657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0] Write session: try to update token
2025-10-10T14:35:36.908679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:36.908689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:36.908708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.908718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601729118578391:9870]
2025-10-10T14:35:36.908770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:36.908772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:36.908956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:36.909113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.909260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.909425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:36.909638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:36.909674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:36.923876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId: src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:36.926815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:36.927238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:36.927264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:36.927292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:36.927304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:36.927307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:36.927309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:36.927319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601729118578391:9870]
2025-10-10T14:35:36.927322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601729118578391:9870]
2025-10-10T14:35:36.927327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601729118578391:9870]
2025-10-10T14:35:36.927376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:36.927388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:36.927390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:36.927392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:36.927398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:36.927401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:36.927538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:36.981699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601729900806806:7726]
2025-10-10T14:35:36.982074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1732, pipe: [1:7559601729900806806:7726]
2025-10-10T14:35:37.045627Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:37.045952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:37.046005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601729900806806:7726], now have 1 active actors on pipe
2025-10-10T14:35:37.046225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:37.046302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601729900806806:7726]
2025-10-10T14:35:37.046328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:37.046329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:37.046331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:37.046409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1733 reason: error at write: Disconnected sessionId: src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0
2025-10-10T14:35:37.046548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1733 sessionId: src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0 is DEAD
2025-10-10T14:35:37.046841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:37.046851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0] Write session will restart in 0.005691s
2025-10-10T14:35:37.046876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0] Write session: Do CDS request
2025-10-10T14:35:37.046883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:37.054052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.054229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:37.054246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1734
2025-10-10T14:35:37.054423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.054458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:37.054464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:37.054468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:37.055207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:37.056693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1734 sessionId:  describe result for acl check
2025-10-10T14:35:37.056741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:37.056743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:37.056745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:37.056752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601734195774136:7476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:37.057354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601734195774136:7476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:37.058389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:37.058601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:37.058614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:37.058626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:37.058680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:37.058721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601733413545762:9872]
2025-10-10T14:35:37.059314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:37.059996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:37.060069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:37.060289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601734195774136:7476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:37.060443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:37.060519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.060524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.060525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.060526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.060528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.060529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.060531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.060532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.060533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.060535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.060536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.060551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.060552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.060559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.060571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.060580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.060583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.060586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.060590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.060593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.060596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.060600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.060604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.060607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.060621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.060624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.060636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.060644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.060650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.060655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.060660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.060664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.060668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.060673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.060679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.060683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.060687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.060693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.060698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.060702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.060707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.060712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.060716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.060722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.060727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.060732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.060737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.060742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.060747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.060753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.060758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.060764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.060816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:37.063375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601734195774136:7476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:37.063393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601734195774136:7476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:37.063396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601734195774136:7476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:37.063405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:37.063826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:37.064208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:37.064231Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:37.064236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:37.064240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:37.064249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1733 [2:7559601733413545762:9872]
2025-10-10T14:35:37.064263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:37.064282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:37.064291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.064294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.064297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.064315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:37.064328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:37.064338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:37.064414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.064422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.064424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.064427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:37.064500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:37.064509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.064523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.064537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.064555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:37.064578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774104:2438], now have 1 active actors on pipe
2025-10-10T14:35:37.064583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774170:7476], now have 1 active actors on pipe
2025-10-10T14:35:37.064590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601733413545755:9872]
2025-10-10T14:35:37.064592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601733413545755:9872]
2025-10-10T14:35:37.064595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601733413545755:9872]
2025-10-10T14:35:37.064611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:37.064628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:37.064648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:37.064651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:37.064686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601733413545755:9872]
2025-10-10T14:35:37.064689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:37.064627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1733
2025-10-10T14:35:37.064665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1733
2025-10-10T14:35:37.064744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:37.064752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:37.064755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:37.064761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:37.064826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.064833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.064866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:37.064875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.064879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.064882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:37.064896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.064909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:37.064926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.065187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1734 partition: 0 MaxSeqNo: 40 sessionId: src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0
2025-10-10T14:35:37.065073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.065083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.065098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.065701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252f532d-326a7ff4-f33fd088-94c4d7a5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:37.068540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0] Write session: try to update token
2025-10-10T14:35:37.068564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:37.077963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:37.078005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:37.078017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601733413545755:9872]
2025-10-10T14:35:37.078073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:37.078076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:37.078255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:37.078408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:37.078544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:37.078682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:37.079192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:37.079245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:37.084810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId: src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:37.087506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:37.087732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.087759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.087822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:37.087908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:37.098266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:37.098289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:37.098293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:37.098295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:37.098307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601733413545755:9872]
2025-10-10T14:35:37.098312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601733413545755:9872]
2025-10-10T14:35:37.098316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601733413545755:9872]
2025-10-10T14:35:37.098364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:37.098375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.098378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:37.098384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:37.098392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:37.098397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:37.098514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:37.146093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601734195774177:7726]
2025-10-10T14:35:37.146533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1733, pipe: [1:7559601734195774177:7726]
2025-10-10T14:35:37.221435Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:37.230345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.230376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.230565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.230631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.230696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.230767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.230943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.230958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.231027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.231095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.231166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.231227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.231266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.231269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.231342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.231400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.231462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.231523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.231564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.231567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.231636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.231700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.231763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.231833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.231874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.231876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.231947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.232007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.232071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.232133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.232175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.232178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.232246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.232303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.232363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.232424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.232465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.232468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.232539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.232598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.232661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.232726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.232769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.232772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.232842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.232901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.232961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.233021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.233062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.233065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.233132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.233192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.233248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.233308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.235126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:37.235139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0] Write session will restart in 0.009694s
2025-10-10T14:35:37.235164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0] Write session: Do CDS request
2025-10-10T14:35:37.235170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:37.234631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601734195774177:7726]
2025-10-10T14:35:37.234670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:37.234711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:37.234724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:37.234757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1734 reason: error at write: Disconnected sessionId: src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0
2025-10-10T14:35:37.235034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1734 sessionId: src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0 is DEAD
2025-10-10T14:35:37.233568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.233581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.233651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:37.233704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:37.233767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:37.233827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:37.233867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:37.233870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:37.233944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774177:7726], now have 1 active actors on pipe
2025-10-10T14:35:37.235107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:37.245968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.246925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:37.246946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1735
2025-10-10T14:35:37.247118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.247177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:37.247188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:37.247192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:37.247544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:37.247692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1735 sessionId:  describe result for acl check
2025-10-10T14:35:37.247734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:37.247740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:37.247742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:37.247748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601734195774212:7470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:37.248312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601734195774212:7470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:37.249093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:37.249327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:37.249354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:37.249366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:37.249445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:37.249493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601733413545833:9874]
2025-10-10T14:35:37.250065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:37.251088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601734195774212:7470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:37.251515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:37.251586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:37.251921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:37.251994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.252007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.252008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.252009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.252010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.252011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.252012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.252014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.252015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.252016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.252017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.252018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.252019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.252025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.252042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.252046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.252049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.252052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.252056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.252059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.252063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.252066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.252070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.252073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.252076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.252080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.252087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.252096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.252102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.252107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.252111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.252116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.252121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.252125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.252129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.252133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.252137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.252141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.252145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.252150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.252154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.252159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.252163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.252168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.252181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.252185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.252190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.252194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.252197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.252202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.252207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.252212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.252246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:37.254900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601734195774212:7470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:37.254916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601734195774212:7470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:37.254920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601734195774212:7470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:37.254930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:37.255136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:37.255724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:37.255740Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:37.255743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:37.255749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:37.255755Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1734 [2:7559601733413545833:9874]
2025-10-10T14:35:37.255770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:37.255788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:37.255800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.255803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.255806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.255824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:37.255839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:37.255849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:37.255967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.255978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.255979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.255983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:37.256059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:37.256067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.256082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.256092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.256113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:37.256144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774246:7470], now have 1 active actors on pipe
2025-10-10T14:35:37.256153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774180:2438], now have 1 active actors on pipe
2025-10-10T14:35:37.256162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601733413545827:9874]
2025-10-10T14:35:37.256169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601733413545827:9874]
2025-10-10T14:35:37.256171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601733413545827:9874]
2025-10-10T14:35:37.256186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:37.256208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1734
2025-10-10T14:35:37.256238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1734
2025-10-10T14:35:37.256200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:37.256208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:37.256214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:37.256216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:37.256224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:37.256227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:37.256265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601733413545827:9874]
2025-10-10T14:35:37.256268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:37.256272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:37.256304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.256312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.256372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e46e255-24b8b464-d8300246-defcc764_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:37.256383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.256389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.256400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:37.256411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.256427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:37.256454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.256749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.256763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.256802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.256917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1735 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e46e255-24b8b464-d8300246-defcc764_0
2025-10-10T14:35:37.257301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afb03ed2-3036d252-aed7076e-430d8a4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e46e255-24b8b464-d8300246-defcc764_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:37.260035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e46e255-24b8b464-d8300246-defcc764_0] Write session: try to update token
2025-10-10T14:35:37.260058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e46e255-24b8b464-d8300246-defcc764_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:37.275871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId: src_id|4e46e255-24b8b464-d8300246-defcc764_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:37.277528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:37.277550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:37.277554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:37.277556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:37.277565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601733413545827:9874]
2025-10-10T14:35:37.277570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601733413545827:9874]
2025-10-10T14:35:37.277577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601733413545827:9874]
2025-10-10T14:35:37.277629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:37.277629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:37.277636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:37.277641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:37.277643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.277645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:37.277785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:37.278505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:37.334994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601734195774254:7726]
2025-10-10T14:35:37.335322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1734, pipe: [1:7559601734195774254:7726]
2025-10-10T14:35:37.392606Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:37.392912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.392934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.392997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774254:7726], now have 1 active actors on pipe
2025-10-10T14:35:37.393221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:37.393881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e46e255-24b8b464-d8300246-defcc764_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:37.393903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e46e255-24b8b464-d8300246-defcc764_0] Write session will restart in 0.006874s
2025-10-10T14:35:37.393928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e46e255-24b8b464-d8300246-defcc764_0] Write session: Do CDS request
2025-10-10T14:35:37.393934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e46e255-24b8b464-d8300246-defcc764_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:37.393399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601734195774254:7726]
2025-10-10T14:35:37.393434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:37.393506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:37.393509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1735 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e46e255-24b8b464-d8300246-defcc764_0
2025-10-10T14:35:37.393706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1735 sessionId: src_id|4e46e255-24b8b464-d8300246-defcc764_0 is DEAD
2025-10-10T14:35:37.401888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e46e255-24b8b464-d8300246-defcc764_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.402182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:37.404206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:37.404403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:37.404428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:37.404444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:37.404502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:37.404543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601733413545904:9876]
2025-10-10T14:35:37.405105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:37.401958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:37.401987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1736
2025-10-10T14:35:37.402142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.402174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:37.402180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:37.402184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:37.402614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1736 sessionId:  describe result for acl check
2025-10-10T14:35:37.402640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:37.402642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:37.402643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:37.402648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601734195774287:7466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:37.403105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601734195774287:7466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:37.405378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601734195774287:7466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:37.405454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:37.405510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:37.405856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:37.405910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.405912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.405913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.405915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.405916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.405917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.405918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.405922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.405923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.405925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.405926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.405927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.405929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.405935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.405949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.405954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.405958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.405962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.405977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.405981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.405986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.405989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.405995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.405998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.406002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.406006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.406014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.406023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.406032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.406039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.406043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.406049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.406055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.406061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.406067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.406073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.406080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.406086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.406092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.406098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.406103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.406108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.406113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.406119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.406123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.406129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.406133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.406138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.406143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.406148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.406152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.406157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.406198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:37.408392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601734195774287:7466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:37.408412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601734195774287:7466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:37.408415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601734195774287:7466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:37.408424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:37.409833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1735
2025-10-10T14:35:37.409848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1735
2025-10-10T14:35:37.409166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:37.409498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:37.409504Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:37.409506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:37.409512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:37.409518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1735 [2:7559601733413545904:9876]
2025-10-10T14:35:37.409533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:37.409552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:37.409555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.409558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.409561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.409578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:37.409586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:37.409594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:37.409654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.409656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.409657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.409660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:37.409735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:37.409738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.409751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.409764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.409783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:37.409806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774321:7466], now have 1 active actors on pipe
2025-10-10T14:35:37.409809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774255:2438], now have 1 active actors on pipe
2025-10-10T14:35:37.409817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601733413545898:9876]
2025-10-10T14:35:37.409819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601733413545898:9876]
2025-10-10T14:35:37.409821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601733413545898:9876]
2025-10-10T14:35:37.409836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:37.409850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:37.409861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:37.409865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:37.409868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:37.409868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:37.409871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:37.409911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.409915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.409933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601733413545898:9876]
2025-10-10T14:35:37.409942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:37.409947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:37.409981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:37.409988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.409992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.409994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:37.410008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.410018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:37.410041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.410281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.410296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.410319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.410439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1736 partition: 0 MaxSeqNo: 40 sessionId: src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0
2025-10-10T14:35:37.410886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e46e255-24b8b464-d8300246-defcc764_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:37.413626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0] Write session: try to update token
2025-10-10T14:35:37.413647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:37.429807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:37.429829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:37.429836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:37.429838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:37.429849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601733413545898:9876]
2025-10-10T14:35:37.429854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601733413545898:9876]
2025-10-10T14:35:37.429858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601733413545898:9876]
2025-10-10T14:35:37.429911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:37.429918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.429921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:37.429926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:37.429933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:37.429938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:37.430078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:37.432069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId: src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:37.435265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:37.493740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601734195774330:7726]
2025-10-10T14:35:37.494597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1735, pipe: [1:7559601734195774330:7726]
2025-10-10T14:35:37.544080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:37.544439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.544456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.544500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774330:7726], now have 1 active actors on pipe
2025-10-10T14:35:37.544722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:37.544820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:37.544827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601734195774330:7726]
2025-10-10T14:35:37.544834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:37.544848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:37.544901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1736 reason: error at write: Disconnected sessionId: src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0
2025-10-10T14:35:37.545253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:37.545265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0] Write session will restart in 0.005848s
2025-10-10T14:35:37.545091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1736 sessionId: src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0 is DEAD
2025-10-10T14:35:37.545290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0] Write session: Do CDS request
2025-10-10T14:35:37.545300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:37.552888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.553047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:37.553100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:37.553120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1737
2025-10-10T14:35:37.553270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.553317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:37.553349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:37.553354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:37.553764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1737 sessionId:  describe result for acl check
2025-10-10T14:35:37.553817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:37.553823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:37.553825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:37.553832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601734195774365:7458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:37.554124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:37.554371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601734195774365:7458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:37.554346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:37.554365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:37.554379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:37.554446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:37.554493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601733413545975:9878]
2025-10-10T14:35:37.555112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:37.555515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:37.555568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:37.555885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:37.555957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.555964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.555965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.555966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.555968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.555977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.555979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.555980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.555982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.555983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.555984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.555985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.555986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.555993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.556005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.556009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.556014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.556018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.556022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.556027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.556031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.556035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.556040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.556044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.556049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.556053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.556061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.556070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.556082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.556088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.556093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.556098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.556108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.556113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.556117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.556122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.556125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.556130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.556136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.556141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.556145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.556150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.556155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.556159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.556164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.556169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.556173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.556178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.556183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.556189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.556193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.556198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.556239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:37.556641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601734195774365:7458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:37.559043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:37.559366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:37.559387Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:37.559392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:37.559396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:37.559401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1736 [2:7559601733413545975:9878]
2025-10-10T14:35:37.559414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:37.559433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:37.559442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.559447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.559449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.559467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:37.559476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:37.559490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:37.559550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.559558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.559560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.559563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:37.559747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601734195774365:7458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:37.559764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601734195774365:7458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:37.559648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:37.559657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.559670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.559682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.559768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601734195774365:7458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:37.559700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:37.559776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:37.559721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601733413545970:9878]
2025-10-10T14:35:37.559724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601733413545970:9878]
2025-10-10T14:35:37.559726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601733413545970:9878]
2025-10-10T14:35:37.559741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:37.559756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:37.559772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:37.559773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:37.559774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:37.559776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:37.559776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:37.559803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601733413545970:9878]
2025-10-10T14:35:37.559806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:37.559845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:37.559920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1736
2025-10-10T14:35:37.560025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774331:2438], now have 1 active actors on pipe
2025-10-10T14:35:37.560043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774398:7458], now have 1 active actors on pipe
2025-10-10T14:35:37.560047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1736
2025-10-10T14:35:37.560103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.560114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.560143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:37.560157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.560168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.560171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:37.560182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.560195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:37.560210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.560435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.560445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.560463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.560578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1737 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0
2025-10-10T14:35:37.560921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b732e25e-1f4eca92-cdb259d2-c52dcf1d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:37.563672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0] Write session: try to update token
2025-10-10T14:35:37.563692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:37.579145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId: src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:37.579216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:37.579238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:37.579241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:37.579244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:37.579254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601733413545970:9878]
2025-10-10T14:35:37.579260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601733413545970:9878]
2025-10-10T14:35:37.579266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601733413545970:9878]
2025-10-10T14:35:37.579320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:37.579334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.579336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:37.579470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:37.579481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:37.579488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:37.579493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:37.581880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:37.644767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601734195774406:7726]
2025-10-10T14:35:37.645069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1736, pipe: [1:7559601734195774406:7726]
2025-10-10T14:35:37.691847Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:37.692130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.692149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.692198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774406:7726], now have 1 active actors on pipe
2025-10-10T14:35:37.692447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:37.692553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:37.692612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:37.692625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:37.692680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601734195774406:7726]
2025-10-10T14:35:37.692702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1737 reason: error at write: Disconnected sessionId: src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0
2025-10-10T14:35:37.692930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1737 sessionId: src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0 is DEAD
2025-10-10T14:35:37.693094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:37.693106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0] Write session will restart in 0.008384s
2025-10-10T14:35:37.693142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0] Write session: Do CDS request
2025-10-10T14:35:37.693148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:37.701535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:37.702754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:37.702999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:37.703009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:37.703019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:37.703024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.703067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:37.703113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601733413546048:9880]
2025-10-10T14:35:37.703404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:37.703437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1738
2025-10-10T14:35:37.703569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.703600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:37.703611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:37.703615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:37.703739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:37.704079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:37.704081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1738 sessionId:  describe result for acl check
2025-10-10T14:35:37.704118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:37.704125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:37.704127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:37.704134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601734195774450:7453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:37.704137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:37.704496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:37.704569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.704575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.704577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.704578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.704579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.704581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.704583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.704584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.704586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.704587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.704591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.704592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.704593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.704601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.704613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.704617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.704621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.704624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.704628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.704632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.704635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.704639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.704644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.704648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.704651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.704655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.704664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.704672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.704678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.704684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.704688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.704693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.704698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.704703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.704710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601734195774450:7453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:37.704709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.704714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.704718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.704724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.704729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.704734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.704738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.704744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.704749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.704753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.704756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.704760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.704764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.704769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.704773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.704777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.704781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.704785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.704826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:37.706832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601734195774450:7453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:37.707616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:37.708072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:37.708084Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:37.708088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:37.708091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:37.708100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1737 [2:7559601733413546048:9880]
2025-10-10T14:35:37.708113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:37.708133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:37.708141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.708145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.708149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.708167Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:37.708178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:37.708185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:37.708253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.708261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.708263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.708266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:37.708339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:37.708347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.708359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.708370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.708385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:37.708414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774413:2438], now have 1 active actors on pipe
2025-10-10T14:35:37.708427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601733413546043:9880]
2025-10-10T14:35:37.708430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601733413546043:9880]
2025-10-10T14:35:37.708432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601733413546043:9880]
2025-10-10T14:35:37.708446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:37.708460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:37.708475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:37.708476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:37.708480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:37.708481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:37.708483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:37.708496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1737
2025-10-10T14:35:37.708517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601733413546043:9880]
2025-10-10T14:35:37.708525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:37.708535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:37.713474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601734195774450:7453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:37.713494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601734195774450:7453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:37.713498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601734195774450:7453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:37.713508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:37.713992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774485:7453], now have 1 active actors on pipe
2025-10-10T14:35:37.714143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1737
2025-10-10T14:35:37.714217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.714233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.714281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:37.714301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.714312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.714315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:37.714330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.714354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:37.714376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.714554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.714562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.714580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.714658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1738 partition: 0 MaxSeqNo: 40 sessionId: src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0
2025-10-10T14:35:37.715122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f060fd8-3049bb04-d39ce4ef-81759ccb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:37.717813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0] Write session: try to update token
2025-10-10T14:35:37.717831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:37.728470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:37.728488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:37.728492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:37.728494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:37.728505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601733413546043:9880]
2025-10-10T14:35:37.728512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601733413546043:9880]
2025-10-10T14:35:37.728516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601733413546043:9880]
2025-10-10T14:35:37.728561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:37.728565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:37.728567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:37.728571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:37.728576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.728579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:37.728720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:37.733032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId: src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:37.735809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:37.792722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601734195774504:7726]
2025-10-10T14:35:37.793040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1737, pipe: [1:7559601734195774504:7726]
2025-10-10T14:35:37.842935Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:37.843233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.843249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.843294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774504:7726], now have 1 active actors on pipe
2025-10-10T14:35:37.843511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:37.844150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:37.844162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0] Write session will restart in 0.007229s
2025-10-10T14:35:37.844200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0] Write session: Do CDS request
2025-10-10T14:35:37.844206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:37.843665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601734195774504:7726]
2025-10-10T14:35:37.843677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:37.843704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:37.843786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1738 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0
2025-10-10T14:35:37.843982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1738 sessionId: src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0 is DEAD
2025-10-10T14:35:37.851634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:37.852615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:37.852820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:37.852836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:37.852849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:37.852908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.853500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:37.853519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1739
2025-10-10T14:35:37.852909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:37.852951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601733413546149:9890]
2025-10-10T14:35:37.853567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:37.853664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:37.853697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:37.853702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:37.853705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:37.853873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:37.853926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:37.854142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1739 sessionId:  describe result for acl check
2025-10-10T14:35:37.854183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:37.854185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:37.854187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:37.854193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601734195774544:7442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:37.854262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:37.854342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.854349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.854350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.854351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.854352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.854353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.854354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.854355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.854356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.854358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.854359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.854360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.854362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.854368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.854381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.854384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.854389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.854392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.854396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.854401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.854406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.854411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.854415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.854419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.854423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.854426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.854433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.854442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:37.854449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.854459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:37.854463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.854472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:37.854477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.854482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:37.854491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.854498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:37.854502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.854507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:37.854511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.854517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:37.854523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.854533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:37.854539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.854549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:37.854553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.854558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:37.854566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.854571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.854575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.854584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.854590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.854599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.854637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:37.854781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601734195774544:7442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:37.856583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601734195774544:7442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:37.857264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:37.857590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:37.857605Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:37.857607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:37.857611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:37.857616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1738 [2:7559601733413546149:9890]
2025-10-10T14:35:37.857628Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:37.857645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:37.857652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.857656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.857658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.857677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:37.857689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:37.857703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:37.857765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.857773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.857775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.857777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:37.857847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:37.857855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.857868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:37.857882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:37.857900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:37.857921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601733413546144:9890]
2025-10-10T14:35:37.857923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601733413546144:9890]
2025-10-10T14:35:37.857925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601733413546144:9890]
2025-10-10T14:35:37.857933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:37.857944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:37.857947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:37.857948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:37.857950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:37.857977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:37.857980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:37.857991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774506:2438], now have 1 active actors on pipe
2025-10-10T14:35:37.858017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601733413546144:9890]
2025-10-10T14:35:37.858029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:37.858040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:37.858373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1738
2025-10-10T14:35:37.863113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601734195774544:7442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:37.863131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601734195774544:7442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:37.863135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601734195774544:7442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:37.863144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:37.863384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774580:7442], now have 1 active actors on pipe
2025-10-10T14:35:37.863446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1738
2025-10-10T14:35:37.863514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.863528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.863581Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7765805-e5da7fc1-55e35046-96394f84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:37.863600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:37.863607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:37.863611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:37.863637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:37.863657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:37.863684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.863928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:37.863938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:37.863957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:37.864066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1739 partition: 0 MaxSeqNo: 40 sessionId: src_id|7765805-e5da7fc1-55e35046-96394f84_0
2025-10-10T14:35:37.864536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6384bf6e-4f3e178-7a2c7644-f18a3688_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7765805-e5da7fc1-55e35046-96394f84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:37.867566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7765805-e5da7fc1-55e35046-96394f84_0] Write session: try to update token
2025-10-10T14:35:37.867586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7765805-e5da7fc1-55e35046-96394f84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:37.870044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:37.870060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:37.870070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601733413546144:9890]
2025-10-10T14:35:37.870122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:37.870124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:37.870299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:37.870442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:37.870582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:37.870726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:37.870923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:37.870966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:37.890162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId: src_id|7765805-e5da7fc1-55e35046-96394f84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:37.892936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:37.889849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:37.889868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:37.889871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:37.889872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:37.889881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601733413546144:9890]
2025-10-10T14:35:37.889885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601733413546144:9890]
2025-10-10T14:35:37.889888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601733413546144:9890]
2025-10-10T14:35:37.889937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:37.889945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:37.889944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:37.889947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:37.889964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:37.889969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:37.890107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:37.943739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601734195774607:7726]
2025-10-10T14:35:37.944143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1738, pipe: [1:7559601734195774607:7726]
2025-10-10T14:35:38.007309Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:38.007646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.007657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.007682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601734195774607:7726], now have 1 active actors on pipe
2025-10-10T14:35:38.007925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:38.008471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:38.008473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601734195774607:7726]
2025-10-10T14:35:38.008502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:38.008581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1739 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7765805-e5da7fc1-55e35046-96394f84_0
2025-10-10T14:35:38.008787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1739 sessionId: src_id|7765805-e5da7fc1-55e35046-96394f84_0 is DEAD
2025-10-10T14:35:38.009204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7765805-e5da7fc1-55e35046-96394f84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:38.009212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7765805-e5da7fc1-55e35046-96394f84_0] Write session will restart in 0.007404s
2025-10-10T14:35:38.009236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7765805-e5da7fc1-55e35046-96394f84_0] Write session: Do CDS request
2025-10-10T14:35:38.009242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7765805-e5da7fc1-55e35046-96394f84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:38.017919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7765805-e5da7fc1-55e35046-96394f84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.018341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:38.018362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1740
2025-10-10T14:35:38.018533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.018573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:38.018589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:38.018593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:38.019018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1740 sessionId:  describe result for acl check
2025-10-10T14:35:38.019047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:38.019049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:38.019051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:38.019057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601738490741920:7429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:38.019612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601738490741920:7429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:38.022453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601738490741920:7429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:38.026410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601738490741920:7429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:38.026428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601738490741920:7429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:38.026432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601738490741920:7429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:38.026441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:38.030138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:38.032129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:38.032369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:38.032376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:38.032390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:38.032454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:38.032497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601737708513547:9899]
2025-10-10T14:35:38.033162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:38.035043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:38.035107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:38.035451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:38.035515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.035521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.035522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.035523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.035524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.035525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.035526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.035528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.035529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.035530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.035532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.035533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.035534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.035541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.035554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.035559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.035563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.035566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.035570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.035574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.035577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.035580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.035584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.035588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.035591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.035595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.035603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.035612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.035618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.035623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.035627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.035632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.035636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.035641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.035646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.035650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.035655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.035659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.035663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.035668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.035672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.035676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.035681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.035686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.035690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.035695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.035700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.035704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.035709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.035713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.035717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.035722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.035757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:38.038905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:38.039499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:38.039511Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:38.039514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:38.039517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:38.039525Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1739 [2:7559601737708513547:9899]
2025-10-10T14:35:38.039540Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:38.039562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:38.039565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.039569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.039571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.039589Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:38.039599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:38.039607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:38.039683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.039687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.039690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.039693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:38.039767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:38.039770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.039780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.039790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.039804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:38.039827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601737708513541:9899]
2025-10-10T14:35:38.039831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601737708513541:9899]
2025-10-10T14:35:38.039834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601737708513541:9899]
2025-10-10T14:35:38.039845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:38.039864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:38.039878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:38.039881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:38.039914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601737708513541:9899]
2025-10-10T14:35:38.039917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:38.040237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:38.040242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:38.040244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:38.040249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:38.040600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1739
2025-10-10T14:35:38.040635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1739
2025-10-10T14:35:38.041548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490741968:7429], now have 1 active actors on pipe
2025-10-10T14:35:38.041564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490741905:2438], now have 1 active actors on pipe
2025-10-10T14:35:38.041583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.041590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.041630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:38.041642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.041647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.041650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:38.041666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.041682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:38.041701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.045267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.045286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.045324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.048397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1740 partition: 0 MaxSeqNo: 40 sessionId: src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0
2025-10-10T14:35:38.049691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7765805-e5da7fc1-55e35046-96394f84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:38.052480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0] Write session: try to update token
2025-10-10T14:35:38.052641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:38.067794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:38.067811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.067815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:38.067816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:38.067825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601737708513541:9899]
2025-10-10T14:35:38.067834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601737708513541:9899]
2025-10-10T14:35:38.067838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601737708513541:9899]
2025-10-10T14:35:38.067885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:38.067893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.067895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:38.068040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:38.068910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:38.068918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:38.068922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:38.086695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId: src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:38.089697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:38.108630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601738490741983:7726]
2025-10-10T14:35:38.108919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1739, pipe: [1:7559601738490741983:7726]
2025-10-10T14:35:38.187232Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:38.187720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.187755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.187782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490741983:7726], now have 1 active actors on pipe
2025-10-10T14:35:38.188013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:38.188018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:38.188030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:38.188080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601738490741983:7726]
2025-10-10T14:35:38.188005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:38.188105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1740 reason: error at write: Disconnected sessionId: src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0
2025-10-10T14:35:38.188349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1740 sessionId: src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0 is DEAD
2025-10-10T14:35:38.188549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:38.188577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0] Write session will restart in 0.008998s
2025-10-10T14:35:38.188604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0] Write session: Do CDS request
2025-10-10T14:35:38.188614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:38.197760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:38.198890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.199462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:38.199758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:38.199778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1741
2025-10-10T14:35:38.199703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:38.199714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:38.199727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:38.199781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:38.199822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601737708513621:9901]
2025-10-10T14:35:38.200400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:38.200532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.200568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:38.200574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:38.200578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:38.200745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:38.200793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:38.200960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1741 sessionId:  describe result for acl check
2025-10-10T14:35:38.200995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:38.201001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:38.201004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:38.201010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601738490742027:7422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:38.201095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:38.201149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.201157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.201158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.201159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.201160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.201161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.201162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.201163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.201164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.201165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.201166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.201168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.201169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.201174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.201188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.201192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.201195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.201198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.201201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.201205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.201208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.201211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.201215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.201219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.201222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.201225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.201244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.201252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.201263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.201268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.201276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.201280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.201284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.201289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.201293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.201297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.201301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.201306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.201310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.201315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.201318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.201323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.201349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.201353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.201357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.201362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.201367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.201371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.201377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.201381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.201385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.201389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.201422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:38.201597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601738490742027:7422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:38.203945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601738490742027:7422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:38.204229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:38.204619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:38.204643Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:38.204645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:38.204648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:38.204654Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1740 [2:7559601737708513621:9901]
2025-10-10T14:35:38.204668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:38.204688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:38.204690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.204694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.204696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.204713Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:38.204721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:38.204729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:38.204790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.204794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.204796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.204798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:38.204863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:38.204866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.204877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.204887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.204903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:38.204924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490741986:2438], now have 1 active actors on pipe
2025-10-10T14:35:38.204938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601737708513616:9901]
2025-10-10T14:35:38.204942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601737708513616:9901]
2025-10-10T14:35:38.204943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601737708513616:9901]
2025-10-10T14:35:38.204957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:38.204973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:38.204978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1740
2025-10-10T14:35:38.204989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:38.204996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:38.205023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601737708513616:9901]
2025-10-10T14:35:38.205025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:38.205067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:38.205079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:38.205081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:38.205089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:38.211272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601738490742027:7422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:38.211291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601738490742027:7422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:38.211295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601738490742027:7422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:38.211304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:38.211587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742062:7422], now have 1 active actors on pipe
2025-10-10T14:35:38.211718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.211744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.211644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1740
2025-10-10T14:35:38.211789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:38.211807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.211822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.211829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:38.211845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.211871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:38.211897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.212203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.212216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.212239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.212351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1741 partition: 0 MaxSeqNo: 40 sessionId: src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0
2025-10-10T14:35:38.212703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47bf30b3-eb475907-6ca2b9ad-42458d4d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:38.215497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0] Write session: try to update token
2025-10-10T14:35:38.215516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:38.219512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:38.219532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.219547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601737708513616:9901]
2025-10-10T14:35:38.219603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:38.219793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:38.219944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.220082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.220225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.220411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:38.220457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:38.220583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:38.232665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId: src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:38.235341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:38.235540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.235564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.235622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:38.235727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:38.242454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:38.242472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.242476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:38.242478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:38.242492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601737708513616:9901]
2025-10-10T14:35:38.242496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601737708513616:9901]
2025-10-10T14:35:38.242500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601737708513616:9901]
2025-10-10T14:35:38.242548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:38.242550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:38.242556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:38.242560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:38.242561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.242563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:38.242692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:38.288300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601738490742065:7726]
2025-10-10T14:35:38.288588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1740, pipe: [1:7559601738490742065:7726]
2025-10-10T14:35:38.357646Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:38.365553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.365583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.368938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601738490742065:7726]
2025-10-10T14:35:38.368953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:38.368958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:38.368971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:38.369002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1741 reason: error at write: Disconnected sessionId: src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0
2025-10-10T14:35:38.369205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1741 sessionId: src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0 is DEAD
2025-10-10T14:35:38.365763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.369381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:38.365828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.369394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0] Write session will restart in 0.006441s
2025-10-10T14:35:38.365887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.365965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.366011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.366017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.366095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.366155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.366220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.366291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.366339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.366342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.366416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.369421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0] Write session: Do CDS request
2025-10-10T14:35:38.369434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:38.366474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.366533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.366597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.366634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.366638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.366700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.366754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.366806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.366859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.366896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.366897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.366960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.367013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.367072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.367129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.367167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.367169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.367248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.367306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.367361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.367415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.367459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.367462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.367536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.367587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.367644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.367701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.367759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.367761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.367821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.367870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.367925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.367989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.368025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.368029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.368091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.368143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.368199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.368261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.368306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.368309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.368378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.368434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.368492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.368549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.368589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.368592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.368665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742065:7726], now have 1 active actors on pipe
2025-10-10T14:35:38.369745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:38.376909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.378014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:38.379041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:38.379219Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:38.379230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:38.379241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:38.379292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:38.379344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601737708513698:9903]
2025-10-10T14:35:38.379940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:38.380288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:38.380323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:38.380611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:38.380665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.380678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.380679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.380679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.380680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.380681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.380682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.380683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.380684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.380685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.380686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.380687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.380688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.380693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.380704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.380708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.380711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.380715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.380719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.380723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.380727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.380731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.380735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.380739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.380742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.380746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.380753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.380761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.380766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.380772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.380775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.380778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.380780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.380783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.380786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.380790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.380792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.380795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.380798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.380801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.380804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.380807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.380812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.380817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.380821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.380826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.380830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.380835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.380839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.380844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.380848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.380853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.380891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:38.376980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:38.377000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1742
2025-10-10T14:35:38.377123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.377155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:38.377162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:38.377181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:38.377687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1742 sessionId:  describe result for acl check
2025-10-10T14:35:38.377716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:38.377718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:38.377720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:38.377726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601738490742106:7415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:38.378285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601738490742106:7415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:38.380937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601738490742106:7415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:38.383096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:38.383421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:38.383432Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:38.383434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:38.383437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:38.383445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1741 [2:7559601737708513698:9903]
2025-10-10T14:35:38.383457Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:38.383473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:38.383477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.383480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.383482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.383498Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:38.383509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:38.383517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:38.383560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.383565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.383565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.383567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:38.383619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:38.383625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.383595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601738490742106:7415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:38.383636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.383625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601738490742106:7415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:38.383648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.383629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601738490742106:7415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:38.383664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:38.383635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:38.383686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742067:2438], now have 1 active actors on pipe
2025-10-10T14:35:38.383698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601737708513693:9903]
2025-10-10T14:35:38.383703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601737708513693:9903]
2025-10-10T14:35:38.383704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601737708513693:9903]
2025-10-10T14:35:38.383714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:38.383724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:38.383728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:38.383731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:38.383732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:38.383737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:38.383739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:38.383754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601737708513693:9903]
2025-10-10T14:35:38.383764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:38.383764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1741
2025-10-10T14:35:38.383784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:38.383795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742141:7415], now have 1 active actors on pipe
2025-10-10T14:35:38.383869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1741
2025-10-10T14:35:38.383920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.383933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.383965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df055677-29ba1e82-f7b07118-61c90a31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:38.383978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.383986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.383988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:38.384000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.384026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:38.384047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.384200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.384208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.384231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.384318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1742 partition: 0 MaxSeqNo: 40 sessionId: src_id|df055677-29ba1e82-f7b07118-61c90a31_0
2025-10-10T14:35:38.384666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de6e3c4-183ff535-f3247c26-bd9b81cc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df055677-29ba1e82-f7b07118-61c90a31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:38.387443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df055677-29ba1e82-f7b07118-61c90a31_0] Write session: try to update token
2025-10-10T14:35:38.387465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df055677-29ba1e82-f7b07118-61c90a31_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:38.395037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:38.395057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.395069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601737708513693:9903]
2025-10-10T14:35:38.395121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:38.395131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:38.395307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:38.395482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.395641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.395793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.396009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:38.396056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:38.402128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId: src_id|df055677-29ba1e82-f7b07118-61c90a31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:38.404708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:38.404933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.404955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.405006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:38.405117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:38.412705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:38.412724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.412730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:38.412732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:38.412746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601737708513693:9903]
2025-10-10T14:35:38.412753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601737708513693:9903]
2025-10-10T14:35:38.412756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601737708513693:9903]
2025-10-10T14:35:38.412807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:38.412821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.412823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:38.412861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:38.412874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:38.412878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:38.412959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:38.469082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601738490742148:7726]
2025-10-10T14:35:38.469793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1741, pipe: [1:7559601738490742148:7726]
2025-10-10T14:35:38.530885Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:38.539637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.539670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.539865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.539943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.540016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.540088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.540373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.540392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.540466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.540537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.540605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.540893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.540946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.540955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.541028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.541093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.541160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.541234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.541283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.541292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.541471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.541543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.541626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.541695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.541740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.541747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.544413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601738490742148:7726]
2025-10-10T14:35:38.544420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:38.544425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:38.544459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1742 reason: error at write: Disconnected sessionId: src_id|df055677-29ba1e82-f7b07118-61c90a31_0
2025-10-10T14:35:38.544472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:38.541820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.541892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.541970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.542030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.542073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.542076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.542146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.542205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.542270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.542335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.542379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.542383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.542456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.542516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.542578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.542643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.542689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.542694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.542773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.542831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.542898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.542963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.543006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.543009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.543085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.543145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.543205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.543272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.543317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.543320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.543394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:38.543479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:38.543544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:38.543608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:38.543658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:38.543661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:38.543738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742148:7726], now have 1 active actors on pipe
2025-10-10T14:35:38.544911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:38.544747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1742 sessionId: src_id|df055677-29ba1e82-f7b07118-61c90a31_0 is DEAD
2025-10-10T14:35:38.545432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df055677-29ba1e82-f7b07118-61c90a31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:38.545444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df055677-29ba1e82-f7b07118-61c90a31_0] Write session will restart in 0.008888s
2025-10-10T14:35:38.545470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df055677-29ba1e82-f7b07118-61c90a31_0] Write session: Do CDS request
2025-10-10T14:35:38.545477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df055677-29ba1e82-f7b07118-61c90a31_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:38.555894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df055677-29ba1e82-f7b07118-61c90a31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.556169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:38.556327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:38.556354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1743
2025-10-10T14:35:38.556564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.556614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:38.556622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:38.556626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:38.556804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:38.557001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:38.557012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:38.557025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:38.557088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:38.557142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601737708513776:9905]
2025-10-10T14:35:38.557230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1743 sessionId:  describe result for acl check
2025-10-10T14:35:38.557270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:38.557272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:38.557274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:38.557280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601738490742191:7411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:38.557797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:38.558173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:38.557919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601738490742191:7411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:38.558222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:38.558537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:38.558610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.558619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.558620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.558621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.558623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.558624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.558625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.558627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.558629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.558630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.558631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.558632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.558633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.558640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.558653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.558657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.558662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.558666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.558671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.558675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.558679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.558683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.558688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.558692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.558696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.558700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.558707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.558717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.558724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.558731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.558736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.558741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.558745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.558751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.558756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.558761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.558765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.558771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.558775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.558780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.558784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.558789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.558794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.558799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.558803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.558808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.558813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.558817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.558821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.558835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.558841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.558846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.558888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:38.560858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601738490742191:7411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:38.561533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:38.561846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:38.561858Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:38.561860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:38.561864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:38.561871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1742 [2:7559601737708513776:9905]
2025-10-10T14:35:38.561886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:38.561908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:38.561919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.561922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.561924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.561958Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:38.561970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:38.561983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:38.562038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.562045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.562047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.562050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:38.562119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:38.562126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.562137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.562152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.562168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:38.562194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742150:2438], now have 1 active actors on pipe
2025-10-10T14:35:38.562206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601737708513771:9905]
2025-10-10T14:35:38.562208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601737708513771:9905]
2025-10-10T14:35:38.562210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601737708513771:9905]
2025-10-10T14:35:38.562223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:38.562238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:38.562242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:38.562248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:38.562250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:38.562260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:38.562263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:38.562292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601737708513771:9905]
2025-10-10T14:35:38.562305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:38.562310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:38.562386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1742
2025-10-10T14:35:38.566812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601738490742191:7411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:38.566831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601738490742191:7411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:38.566835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601738490742191:7411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:38.566846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:38.567104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742229:7411], now have 1 active actors on pipe
2025-10-10T14:35:38.567173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1742
2025-10-10T14:35:38.567249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.567265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.567307Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|316a7ab8-d38eee0a-830c3c52-14802760_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:38.567325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.567331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.567338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:38.567361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.567385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:38.567410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.567947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.567959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.567980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.568081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1743 partition: 0 MaxSeqNo: 40 sessionId: src_id|316a7ab8-d38eee0a-830c3c52-14802760_0
2025-10-10T14:35:38.568497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df055677-29ba1e82-f7b07118-61c90a31_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|316a7ab8-d38eee0a-830c3c52-14802760_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:38.571269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316a7ab8-d38eee0a-830c3c52-14802760_0] Write session: try to update token
2025-10-10T14:35:38.571290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316a7ab8-d38eee0a-830c3c52-14802760_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:38.582190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:38.582205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.582208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:38.582211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:38.582221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601737708513771:9905]
2025-10-10T14:35:38.582229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601737708513771:9905]
2025-10-10T14:35:38.582232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601737708513771:9905]
2025-10-10T14:35:38.582286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:38.582285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:38.582292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:38.582294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.582296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:38.582296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:38.582423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:38.592440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId: src_id|316a7ab8-d38eee0a-830c3c52-14802760_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:38.595069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:38.644696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601738490742232:7726]
2025-10-10T14:35:38.645004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1742, pipe: [1:7559601738490742232:7726]
2025-10-10T14:35:38.693104Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:38.693507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.693527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.693551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742232:7726], now have 1 active actors on pipe
2025-10-10T14:35:38.693803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:38.693774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:38.693839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601738490742232:7726]
2025-10-10T14:35:38.693859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:38.693861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:38.693939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1743 reason: error at write: Disconnected sessionId: src_id|316a7ab8-d38eee0a-830c3c52-14802760_0
2025-10-10T14:35:38.694125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1743 sessionId: src_id|316a7ab8-d38eee0a-830c3c52-14802760_0 is DEAD
2025-10-10T14:35:38.694281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316a7ab8-d38eee0a-830c3c52-14802760_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:38.694292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316a7ab8-d38eee0a-830c3c52-14802760_0] Write session will restart in 0.008230s
2025-10-10T14:35:38.694324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316a7ab8-d38eee0a-830c3c52-14802760_0] Write session: Do CDS request
2025-10-10T14:35:38.694331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316a7ab8-d38eee0a-830c3c52-14802760_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:38.702726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:38.703867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:38.703969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316a7ab8-d38eee0a-830c3c52-14802760_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.704057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:38.704076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1744
2025-10-10T14:35:38.704150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:38.704163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:38.704178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:38.704219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.704247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:38.704267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:38.704278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:38.704281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:38.704293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601737708513855:9907]
2025-10-10T14:35:38.704767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1744 sessionId:  describe result for acl check
2025-10-10T14:35:38.704820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:38.704826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:38.704828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:38.704834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601738490742282:7405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:38.704970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:38.705349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:38.705394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601738490742282:7405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:38.705409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:38.705748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:38.705815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.705823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.705824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.705825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.705826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.705827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.705829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.705830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.705831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.705832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.705833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.705834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.705835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.705842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.705854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.705859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.705863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.705867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.705871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.705875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.705879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.705883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.705887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.705891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.705895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.705899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.705908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.705916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.705947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.705953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.705957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.705962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.705966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.705971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.705976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.705981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.705985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.705990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.705995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.706000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.706005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.706010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.706015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.706020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.706035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.706040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.706044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.706049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.706054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.706060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.706069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.706075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.706111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:38.707699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601738490742282:7405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:38.708601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:38.708919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:38.708929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:38.708932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:38.708935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:38.708942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1743 [2:7559601737708513855:9907]
2025-10-10T14:35:38.708956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:38.708974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:38.708977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.708980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.708983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.708999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:38.709010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:38.709018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:38.709077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.709083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.709085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.709087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:38.709156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:38.709164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.709175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.709187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.709205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:38.709228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742241:2438], now have 1 active actors on pipe
2025-10-10T14:35:38.709242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601737708513850:9907]
2025-10-10T14:35:38.709244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601737708513850:9907]
2025-10-10T14:35:38.709248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601737708513850:9907]
2025-10-10T14:35:38.709248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1743
2025-10-10T14:35:38.709259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:38.709280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:38.709283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:38.709286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:38.709288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:38.709297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:38.709302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:38.709434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601737708513850:9907]
2025-10-10T14:35:38.709449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:38.709470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:38.714621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601738490742282:7405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:38.714638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601738490742282:7405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:38.714642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601738490742282:7405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:38.714652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:38.715235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742319:7405], now have 1 active actors on pipe
2025-10-10T14:35:38.715311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1743
2025-10-10T14:35:38.715457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.715473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.715519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a2bb001-29daead8-92070aa5-5f467394_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:38.715542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.715549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.715552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:38.715569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.715595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:38.715618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.715857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.715879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.715910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.716012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1744 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a2bb001-29daead8-92070aa5-5f467394_0
2025-10-10T14:35:38.717301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316a7ab8-d38eee0a-830c3c52-14802760_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a2bb001-29daead8-92070aa5-5f467394_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:38.720284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a2bb001-29daead8-92070aa5-5f467394_0] Write session: try to update token
2025-10-10T14:35:38.720306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a2bb001-29daead8-92070aa5-5f467394_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:38.727850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:38.727868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.727879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601737708513850:9907]
2025-10-10T14:35:38.727932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:38.727936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:38.728125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:38.728269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.728424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.728574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:38.728771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:38.728816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:38.735324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId: src_id|9a2bb001-29daead8-92070aa5-5f467394_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:38.738152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:38.739845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.739866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.739888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:38.739890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.739893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:38.739894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:38.739901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601737708513850:9907]
2025-10-10T14:35:38.739906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601737708513850:9907]
2025-10-10T14:35:38.739909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601737708513850:9907]
2025-10-10T14:35:38.739955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:38.739962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:38.739965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.739967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:38.739968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:38.739973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:38.740098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:38.793691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601738490742338:7726]
2025-10-10T14:35:38.794067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1743, pipe: [1:7559601738490742338:7726]
2025-10-10T14:35:38.856880Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:38.857186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:38.857234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742338:7726], now have 1 active actors on pipe
2025-10-10T14:35:38.857391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:38.857428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601738490742338:7726]
2025-10-10T14:35:38.857450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:38.857515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:38.857524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:38.857599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1744 reason: error at write: Disconnected sessionId: src_id|9a2bb001-29daead8-92070aa5-5f467394_0
2025-10-10T14:35:38.857775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1744 sessionId: src_id|9a2bb001-29daead8-92070aa5-5f467394_0 is DEAD
2025-10-10T14:35:38.858111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a2bb001-29daead8-92070aa5-5f467394_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:38.858123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a2bb001-29daead8-92070aa5-5f467394_0] Write session will restart in 0.006386s
2025-10-10T14:35:38.858146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a2bb001-29daead8-92070aa5-5f467394_0] Write session: Do CDS request
2025-10-10T14:35:38.858152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a2bb001-29daead8-92070aa5-5f467394_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:38.866021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a2bb001-29daead8-92070aa5-5f467394_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.866097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:38.866113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1745
2025-10-10T14:35:38.866045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:38.866300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:38.866343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:38.866349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:38.866354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:38.866822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1745 sessionId:  describe result for acl check
2025-10-10T14:35:38.866859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:38.866866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:38.866868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:38.866875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601738490742381:7398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:38.867448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601738490742381:7398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:38.867476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:38.867717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:38.867728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:38.867741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:38.867800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:38.867856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601737708513949:9911]
2025-10-10T14:35:38.868437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:38.869051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:38.869102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:38.869443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:38.869521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.869527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.869527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.869531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.869532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.869533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.869534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.869535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.869536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.869537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.869538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.869539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.869540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.869546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.869557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.869560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.869564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.869566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.869570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.869573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.869577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.869580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.869584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.869587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.869591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.869594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.869601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.869609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:38.869615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.869621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:38.869624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.869629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:38.869634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.869638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:38.869646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.869651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:38.869661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.869666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:38.869670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.869675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:38.869679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.869684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:38.869688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.869695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:38.869703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.869708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:38.869712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.869717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.869726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.869731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.869736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.869745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.869783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:38.870095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601738490742381:7398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:38.872459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:38.872777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:38.872791Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:38.872794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:38.872797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:38.872803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1744 [2:7559601737708513949:9911]
2025-10-10T14:35:38.872817Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:38.872836Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:38.872839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.872844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.872847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.872836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601738490742381:7398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:38.872867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:38.872853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601738490742381:7398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:38.872881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:38.872857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601738490742381:7398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:38.872889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:38.872866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:38.872948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.872955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.872957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.872959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:38.873036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:38.873046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.873057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:38.873069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:38.873088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:38.873110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742340:2438], now have 1 active actors on pipe
2025-10-10T14:35:38.873117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742416:7398], now have 1 active actors on pipe
2025-10-10T14:35:38.873126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601737708513944:9911]
2025-10-10T14:35:38.873131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601737708513944:9911]
2025-10-10T14:35:38.873134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601737708513944:9911]
2025-10-10T14:35:38.873146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:38.873161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:38.873163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:38.873170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:38.873159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1744
2025-10-10T14:35:38.873172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:38.873178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:38.873181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:38.873164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1744
2025-10-10T14:35:38.873210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601737708513944:9911]
2025-10-10T14:35:38.873222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:38.873228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:38.873242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.873251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.873300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a450de4b-f767dc91-2e482950-683e0aff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:38.873312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:38.873317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:38.873324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:38.873350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:38.873367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:38.873388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.873568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:38.873588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:38.873604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:38.873690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1745 partition: 0 MaxSeqNo: 40 sessionId: src_id|a450de4b-f767dc91-2e482950-683e0aff_0
2025-10-10T14:35:38.874118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a2bb001-29daead8-92070aa5-5f467394_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a450de4b-f767dc91-2e482950-683e0aff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:38.877050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a450de4b-f767dc91-2e482950-683e0aff_0] Write session: try to update token
2025-10-10T14:35:38.877076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a450de4b-f767dc91-2e482950-683e0aff_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:38.896264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:38.896287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:38.896290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:38.896292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:38.896302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601737708513944:9911]
2025-10-10T14:35:38.896307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601737708513944:9911]
2025-10-10T14:35:38.896311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601737708513944:9911]
2025-10-10T14:35:38.896365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:38.896365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:38.896371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:38.896374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:38.896375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:38.896376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:38.896531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:38.898685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId: src_id|a450de4b-f767dc91-2e482950-683e0aff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:38.901447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:38.957455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601738490742436:7726]
2025-10-10T14:35:38.957821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1744, pipe: [1:7559601738490742436:7726]
2025-10-10T14:35:39.014024Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:39.014440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.014456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.014501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601738490742436:7726], now have 1 active actors on pipe
2025-10-10T14:35:39.014725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:39.014766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601738490742436:7726]
2025-10-10T14:35:39.014793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:39.014802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:39.014894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1745 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a450de4b-f767dc91-2e482950-683e0aff_0
2025-10-10T14:35:39.015086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1745 sessionId: src_id|a450de4b-f767dc91-2e482950-683e0aff_0 is DEAD
2025-10-10T14:35:39.015249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450de4b-f767dc91-2e482950-683e0aff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:39.015261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450de4b-f767dc91-2e482950-683e0aff_0] Write session will restart in 0.007908s
2025-10-10T14:35:39.015287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450de4b-f767dc91-2e482950-683e0aff_0] Write session: Do CDS request
2025-10-10T14:35:39.015294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450de4b-f767dc91-2e482950-683e0aff_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:39.023355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:39.024797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:39.024950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a450de4b-f767dc91-2e482950-683e0aff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.024944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:39.024962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1746
2025-10-10T14:35:39.025019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:39.025028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:39.025038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:39.025086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:39.025131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601742003481364:9926]
2025-10-10T14:35:39.025185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.025225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:39.025237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:39.025242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:39.025710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1746 sessionId:  describe result for acl check
2025-10-10T14:35:39.025747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:39.025754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:39.025756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:39.025762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601742785709791:7377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:39.025782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:39.026122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:39.026170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:39.026350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601742785709791:7377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:39.026500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:39.026561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.026567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.026568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.026569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.026571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.026572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.026573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.026574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.026575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.026576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.026577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.026580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.026582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.026587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.026599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.026603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.026607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.026610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.026614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.026617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.026620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.026623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.026626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.026629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.026632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.026636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.026642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.026651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.026657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.026663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.026667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.026673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.026677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.026683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.026688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.026693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.026702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.026707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.026712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.026717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.026721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.026726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.026733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.026746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.026750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.026755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.026758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.026762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.026765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.026770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.026774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.026778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.026814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:39.028631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601742785709791:7377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:39.029122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:39.029500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:39.029510Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:39.029513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:39.029516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:39.029522Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1745 [2:7559601742003481364:9926]
2025-10-10T14:35:39.029536Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:39.029555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:39.029562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.029566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.029569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.029586Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:39.029599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:39.029610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:39.029686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.029693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.029695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.029698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:39.029831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:39.029841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.029853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.029867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.029885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:39.029908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785709748:2438], now have 1 active actors on pipe
2025-10-10T14:35:39.029917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601742003481359:9926]
2025-10-10T14:35:39.029931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601742003481359:9926]
2025-10-10T14:35:39.029933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601742003481359:9926]
2025-10-10T14:35:39.029948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:39.029904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1745
2025-10-10T14:35:39.029965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:39.029985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:39.029993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:39.030019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601742003481359:9926]
2025-10-10T14:35:39.030025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:39.030111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:39.030122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:39.030125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:39.030152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:39.034819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601742785709791:7377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:39.034835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601742785709791:7377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:39.034838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601742785709791:7377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:39.034845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:39.035064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785709826:7377], now have 1 active actors on pipe
2025-10-10T14:35:39.035224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1745
2025-10-10T14:35:39.035293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.035305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.035341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:39.035363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.035369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.035377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:39.035391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.035412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:39.035435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.035833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.035840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.035857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.035945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1746 partition: 0 MaxSeqNo: 40 sessionId: src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0
2025-10-10T14:35:39.036392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a450de4b-f767dc91-2e482950-683e0aff_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:39.039044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0] Write session: try to update token
2025-10-10T14:35:39.039063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:39.049401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:39.049418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:39.049423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:39.049425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:39.049436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601742003481359:9926]
2025-10-10T14:35:39.049442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601742003481359:9926]
2025-10-10T14:35:39.049446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601742003481359:9926]
2025-10-10T14:35:39.049501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:39.049503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:39.049510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:39.049513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.049514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:39.049516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:39.049658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:39.056787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId: src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:39.059545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:39.115221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601742785709829:7726]
2025-10-10T14:35:39.115526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1745, pipe: [1:7559601742785709829:7726]
2025-10-10T14:35:39.162467Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:39.162780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.162792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.162812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785709829:7726], now have 1 active actors on pipe
2025-10-10T14:35:39.163077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:39.163071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601742785709829:7726]
2025-10-10T14:35:39.163103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:39.163267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:39.163346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1746 reason: status is not ok: tablet will be restarted right now sessionId: src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0
2025-10-10T14:35:39.163573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1746 sessionId: src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0 is DEAD
2025-10-10T14:35:39.163711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:39.163722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0] Write session will restart in 0.009358s
2025-10-10T14:35:39.163747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0] Write session: Do CDS request
2025-10-10T14:35:39.163753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:39.170614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:39.171847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:39.172054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:39.172066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:39.172078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:39.172126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:39.172168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601742003481445:9928]
2025-10-10T14:35:39.172770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:39.173049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:39.173090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:39.173413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:39.173468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.173474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.173475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.173476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.173477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.173478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.173479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.173480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.173481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.173483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.173484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.173485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.173486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.173491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.173505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.173509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.173513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.173517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.173521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.173525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.173531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.173535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.173539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.173543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.173547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.173551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.173558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.173566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.173572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.173577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.173581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.173586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.173591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.173596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.173601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.173606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.173610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.173614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.173619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.173626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.173630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.173635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.173645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.173651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.173655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.173661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.173670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.173675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.173678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.173683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.173693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.173699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.173743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:39.173870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.173992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:39.174010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1747
2025-10-10T14:35:39.174124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.174165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:39.174175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:39.174179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:39.174566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1747 sessionId:  describe result for acl check
2025-10-10T14:35:39.174617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:39.174623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:39.174625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:39.174632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601742785709880:7373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:39.175202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601742785709880:7373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:39.176064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:39.176378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:39.176391Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:39.176393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:39.176397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:39.176403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1746 [2:7559601742003481445:9928]
2025-10-10T14:35:39.176416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:39.176433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:39.176436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.176442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.176444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.176462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:39.176475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:39.176484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:39.176542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.176549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.176551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.176553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:39.176621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:39.176630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.176640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.176653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.176674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:39.176700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785709832:2438], now have 1 active actors on pipe
2025-10-10T14:35:39.176715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601742003481440:9928]
2025-10-10T14:35:39.176717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601742003481440:9928]
2025-10-10T14:35:39.176719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601742003481440:9928]
2025-10-10T14:35:39.176731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:39.176716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1746
2025-10-10T14:35:39.176745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:39.176749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:39.176754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:39.176757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:39.176765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:39.176768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:39.176790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601742003481440:9928]
2025-10-10T14:35:39.176797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:39.176800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:39.177683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601742785709880:7373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:39.183555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601742785709880:7373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:39.183573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601742785709880:7373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:39.183577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601742785709880:7373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:39.183587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:39.183894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785709914:7373], now have 1 active actors on pipe
2025-10-10T14:35:39.183945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1746
2025-10-10T14:35:39.183998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.184013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.184062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43acaf22-b6482446-53cde07f-63fe553e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:39.184081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.184092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.184095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:39.184109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.184142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:39.184171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.184389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.184404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.184430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.184549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1747 partition: 0 MaxSeqNo: 40 sessionId: src_id|43acaf22-b6482446-53cde07f-63fe553e_0
2025-10-10T14:35:39.184962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110f875a-d7524b4b-3bc73e56-be9c2af9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43acaf22-b6482446-53cde07f-63fe553e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:39.187694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43acaf22-b6482446-53cde07f-63fe553e_0] Write session: try to update token
2025-10-10T14:35:39.187713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43acaf22-b6482446-53cde07f-63fe553e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:39.195370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:39.195399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:39.195414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601742003481440:9928]
2025-10-10T14:35:39.195473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:39.195482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:39.195662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:39.195814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:39.195965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:39.196111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:39.196303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:39.196347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:39.202193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId: src_id|43acaf22-b6482446-53cde07f-63fe553e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:39.204852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:39.205930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.205951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.205973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:39.205977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:39.205980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:39.205983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:39.205993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601742003481440:9928]
2025-10-10T14:35:39.205997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601742003481440:9928]
2025-10-10T14:35:39.206000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601742003481440:9928]
2025-10-10T14:35:39.206054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:39.206063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:39.206067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:39.206071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.206072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:39.206073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:39.206277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:39.263183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601742785709917:7726]
2025-10-10T14:35:39.263517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1746, pipe: [1:7559601742785709917:7726]
2025-10-10T14:35:39.319701Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:39.320129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:39.320182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785709917:7726], now have 1 active actors on pipe
2025-10-10T14:35:39.320308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:39.320357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:39.320404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601742785709917:7726]
2025-10-10T14:35:39.320410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:39.320413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:39.320495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1747 reason: error at write: Disconnected sessionId: src_id|43acaf22-b6482446-53cde07f-63fe553e_0
2025-10-10T14:35:39.320690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1747 sessionId: src_id|43acaf22-b6482446-53cde07f-63fe553e_0 is DEAD
2025-10-10T14:35:39.320846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43acaf22-b6482446-53cde07f-63fe553e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:39.320857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43acaf22-b6482446-53cde07f-63fe553e_0] Write session will restart in 0.005454s
2025-10-10T14:35:39.320884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43acaf22-b6482446-53cde07f-63fe553e_0] Write session: Do CDS request
2025-10-10T14:35:39.320891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43acaf22-b6482446-53cde07f-63fe553e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:39.328153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43acaf22-b6482446-53cde07f-63fe553e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.328301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:39.328321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1748
2025-10-10T14:35:39.328504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.328564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:39.328579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:39.328583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:39.329008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1748 sessionId:  describe result for acl check
2025-10-10T14:35:39.329049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:39.329059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:39.329061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:39.329071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601742785709961:7367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:39.329709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601742785709961:7367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:39.332171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601742785709961:7367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:39.332828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:39.334366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:39.334629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:39.334639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:39.334652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:39.334709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:39.334762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601742003481529:9930]
2025-10-10T14:35:39.335141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601742785709961:7367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:39.335155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601742785709961:7367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:39.335159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601742785709961:7367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:39.335169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:39.335425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:39.335735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:39.335785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:39.336162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:39.336226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.336232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.336234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.336235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.336236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.336237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.336238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.336240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.336241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.336243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.336244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.336246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.336248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.336255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.336269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.336273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.336278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.336282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.336286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.336290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.336294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.336298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.336303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.336307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.336311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.336315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.336324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.336333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.336340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.336345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.336350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.336355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.336359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.336364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.336369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.336375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.336380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.336385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.336390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.336395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.336400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.336405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.336410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.336416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.336428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.336434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.336438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.336444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.336448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.336454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.336459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.336465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.336509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:39.339139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:39.339601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:39.339611Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:39.339614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:39.339618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:39.339625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1747 [2:7559601742003481529:9930]
2025-10-10T14:35:39.339639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:39.339657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:39.339661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.339664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.339666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.339683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:39.339691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:39.339699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:39.339760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.339769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.339771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.339775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:39.339935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:39.339942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.339954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.339970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.339991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:39.339999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1747
2025-10-10T14:35:39.340064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1747
2025-10-10T14:35:39.340018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785709994:7367], now have 1 active actors on pipe
2025-10-10T14:35:39.340030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785709919:2438], now have 1 active actors on pipe
2025-10-10T14:35:39.340037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601742003481524:9930]
2025-10-10T14:35:39.340040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601742003481524:9930]
2025-10-10T14:35:39.340042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601742003481524:9930]
2025-10-10T14:35:39.340052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:39.340066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:39.340068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:39.340069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:39.340071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:39.340084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:39.340088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:39.340105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.340110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.340147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601742003481524:9930]
2025-10-10T14:35:39.340155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:39.340161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:39.340179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:39.340187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.340191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.340193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:39.340206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.340216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:39.340256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.340431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.340438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.340452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.340587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1748 partition: 0 MaxSeqNo: 40 sessionId: src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0
2025-10-10T14:35:39.341027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43acaf22-b6482446-53cde07f-63fe553e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:39.343701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0] Write session: try to update token
2025-10-10T14:35:39.343722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:39.362510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId: src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:39.364990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:39.365009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:39.365013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:39.365015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:39.365026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601742003481524:9930]
2025-10-10T14:35:39.365030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601742003481524:9930]
2025-10-10T14:35:39.365035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601742003481524:9930]
2025-10-10T14:35:39.365082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:39.365093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.365095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:39.365147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:39.365214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:39.365374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:39.365387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:39.365391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:39.420422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601742785710005:7726]
2025-10-10T14:35:39.420759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1747, pipe: [1:7559601742785710005:7726]
2025-10-10T14:35:39.477643Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:39.477953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.477969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.478016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710005:7726], now have 1 active actors on pipe
2025-10-10T14:35:39.478243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:39.478375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:39.478445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601742785710005:7726]
2025-10-10T14:35:39.478483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:39.478491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1748 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0
2025-10-10T14:35:39.478684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1748 sessionId: src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0 is DEAD
2025-10-10T14:35:39.478833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:39.478843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0] Write session will restart in 0.005535s
2025-10-10T14:35:39.478869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0] Write session: Do CDS request
2025-10-10T14:35:39.478875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:39.485851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.485896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:39.485923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1749
2025-10-10T14:35:39.486135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.486171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:39.486181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:39.486186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:39.486624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1749 sessionId:  describe result for acl check
2025-10-10T14:35:39.486659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:39.486661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:39.486663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:39.486669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601742785710051:7363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:39.487236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601742785710051:7363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:39.489619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601742785710051:7363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:39.493173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:39.493344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601742785710051:7363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:39.493360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601742785710051:7363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:39.493365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601742785710051:7363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:39.493375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:39.494620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:39.494857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:39.494866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:39.494878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:39.494927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:39.494972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601742003481614:9932]
2025-10-10T14:35:39.495641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:39.496003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:39.496079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:39.496439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:39.496511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.496517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.496518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.496519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.496520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.496521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.496523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.496524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.496525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.496526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.496527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.496529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.496530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.496536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.496549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.496553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.496556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.496560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.496564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.496568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.496571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.496575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.496578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.496585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.496588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.496592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.496600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.496608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.496614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.496619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.496624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.496629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.496633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.496637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.496642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.496648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.496652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.496656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.496660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.496665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.496670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.496674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.496678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.496684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.496696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.496702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.496707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.496711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.496718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.496727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.496732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.496736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.496772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:39.499369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:39.499681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:39.499695Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:39.499698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:39.499702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:39.499708Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1748 [2:7559601742003481614:9932]
2025-10-10T14:35:39.499726Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:39.499745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:39.499748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.499752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.499754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.499774Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:39.499787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:39.499798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:39.499856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.499863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.499865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.499868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:39.499937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:39.499944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.499954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.499964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.499985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:39.500012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710006:2438], now have 1 active actors on pipe
2025-10-10T14:35:39.500019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710081:7363], now have 1 active actors on pipe
2025-10-10T14:35:39.500027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601742003481608:9932]
2025-10-10T14:35:39.500030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601742003481608:9932]
2025-10-10T14:35:39.500032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601742003481608:9932]
2025-10-10T14:35:39.500050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:39.500075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1748
2025-10-10T14:35:39.500062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:39.500093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1748
2025-10-10T14:35:39.500065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:39.500067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:39.500069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:39.500086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:39.500089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:39.500140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601742003481608:9932]
2025-10-10T14:35:39.500146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:39.500151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:39.500162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.500169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.500217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:39.500230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.500234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.500236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:39.500247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.500258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:39.500275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.500401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.500408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.500422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.500529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1749 partition: 0 MaxSeqNo: 40 sessionId: src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0
2025-10-10T14:35:39.500987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64dba69e-3a42826a-cdf7d290-ce9ee735_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:39.503732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0] Write session: try to update token
2025-10-10T14:35:39.503749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:39.519377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId: src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:39.520838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:39.520855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:39.520858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:39.520860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:39.520871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601742003481608:9932]
2025-10-10T14:35:39.520875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601742003481608:9932]
2025-10-10T14:35:39.520878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601742003481608:9932]
2025-10-10T14:35:39.520920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:39.520925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:39.520929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:39.520930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:39.520940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.520944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:39.521100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:39.522175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:39.578571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601742785710094:7726]
2025-10-10T14:35:39.579169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1748, pipe: [1:7559601742785710094:7726]
2025-10-10T14:35:39.633075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:39.633198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1749 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0
2025-10-10T14:35:39.633219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601742785710094:7726]
2025-10-10T14:35:39.633246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:39.633446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1749 sessionId: src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0 is DEAD
2025-10-10T14:35:39.632095Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:39.632430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.632443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.632488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710094:7726], now have 1 active actors on pipe
2025-10-10T14:35:39.632742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:39.634654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:39.634668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0] Write session will restart in 0.007836s
2025-10-10T14:35:39.634693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0] Write session: Do CDS request
2025-10-10T14:35:39.634699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:39.644365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:39.646686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.646734Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:39.646753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1750
2025-10-10T14:35:39.646994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.647042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:39.647065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:39.647075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:39.647632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1750 sessionId:  describe result for acl check
2025-10-10T14:35:39.647672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:39.647678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:39.647680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:39.647686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601742785710144:7359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:39.648256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601742785710144:7359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:39.650043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:39.650300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:39.650313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:39.650327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:39.650320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601742785710144:7359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:39.650399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:39.650449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601742003481698:9934]
2025-10-10T14:35:39.651127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:39.651468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:39.651551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:39.651971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:39.652067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.652078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.652080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.652081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.652082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.652083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.652084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.652086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.652087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.652089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.652090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.652091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.652093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.652100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.652113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.652118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.652122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.652127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.652131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.652135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.652139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.652143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.652147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.652150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.652154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.652158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.652165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.652174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.652181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.652187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.652192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.652197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.652203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.652216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.652221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.652227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.652231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.652236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.652241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.652246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.652251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.652256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.652259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.652264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.652268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.652272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.652277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.652282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.652286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.652292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.652296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.652300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.652341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:39.653040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601742785710144:7359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:39.653054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601742785710144:7359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:39.653058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601742785710144:7359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:39.653078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:39.655215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:39.655520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:39.655536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:39.655539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:39.655544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:39.655551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1749 [2:7559601742003481698:9934]
2025-10-10T14:35:39.655572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:39.655593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:39.655602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.655606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.655609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.655626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:39.655635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:39.655643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:39.655751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.655759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.655761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.655765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:39.655847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:39.655856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.655869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.655887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.655913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:39.655941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710178:7359], now have 1 active actors on pipe
2025-10-10T14:35:39.655950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710097:2438], now have 1 active actors on pipe
2025-10-10T14:35:39.655957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601742003481693:9934]
2025-10-10T14:35:39.655960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601742003481693:9934]
2025-10-10T14:35:39.655962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601742003481693:9934]
2025-10-10T14:35:39.655976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:39.655962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1749
2025-10-10T14:35:39.655992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:39.655974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1749
2025-10-10T14:35:39.655998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:39.656002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:39.656005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:39.656015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:39.656019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:39.656049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601742003481693:9934]
2025-10-10T14:35:39.656060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:39.656082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:39.656309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.656321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.656356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:39.656371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.656378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.656381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:39.656393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.656415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:39.656439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.656643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.656654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.656689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.656771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1750 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0
2025-10-10T14:35:39.657210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f352039d-d7f4b96c-c59a1d8b-1d9753d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:39.659976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0] Write session: try to update token
2025-10-10T14:35:39.659997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:39.677445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId: src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:39.680230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:39.676664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:39.676685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:39.676688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:39.676690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:39.676701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601742003481693:9934]
2025-10-10T14:35:39.676706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601742003481693:9934]
2025-10-10T14:35:39.676710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601742003481693:9934]
2025-10-10T14:35:39.676762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:39.676762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:39.676770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:39.676771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.676773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:39.676774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:39.676920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:39.733187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601742785710193:7726]
2025-10-10T14:35:39.733549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1749, pipe: [1:7559601742785710193:7726]
2025-10-10T14:35:39.793768Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:39.794124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.794140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.794187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710193:7726], now have 1 active actors on pipe
2025-10-10T14:35:39.794474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:39.794468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601742785710193:7726]
2025-10-10T14:35:39.794512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:39.795033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:39.795044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0] Write session will restart in 0.005985s
2025-10-10T14:35:39.795071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0] Write session: Do CDS request
2025-10-10T14:35:39.795077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:39.794554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:39.794650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1750 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0
2025-10-10T14:35:39.794856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1750 sessionId: src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0 is DEAD
2025-10-10T14:35:39.802130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.802194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:39.802213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1751
2025-10-10T14:35:39.802373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.802431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:39.802444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:39.802449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:39.802944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1751 sessionId:  describe result for acl check
2025-10-10T14:35:39.802980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:39.802984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:39.802986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:39.802992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601742785710251:7349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:39.803583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601742785710251:7349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:39.804377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:39.805955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601742785710251:7349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:39.806014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:39.806258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:39.806271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:39.806284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:39.806346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:39.806387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601742003481795:9937]
2025-10-10T14:35:39.807004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:39.807322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:39.807388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:39.807735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:39.807807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.807815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.807817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.807818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.807819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.807820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.807822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.807823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.807824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.807825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.807826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.807827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.807828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.807834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.807846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.807850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.807854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.807858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.807862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.807866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.807870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.807874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.807879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.807882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.807885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.807889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.807897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.807905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.807914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.807919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.807923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.807928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.807933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.807940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.807944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.807949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.807953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.807958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.807963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.807968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.807980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.807985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.807988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.807993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.807996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.808001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.808006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.808011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.808015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.808020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.808025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.808029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.808069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:39.810419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601742785710251:7349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:39.810434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601742785710251:7349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:39.810438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601742785710251:7349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:39.810448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:39.811282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1750
2025-10-10T14:35:39.811306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1750
2025-10-10T14:35:39.810501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:39.810924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:39.810929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:39.810931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:39.810935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:39.810941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1750 [2:7559601742003481795:9937]
2025-10-10T14:35:39.810952Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:39.810971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:39.810975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.810979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.810981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.811000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:39.811007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:39.811015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:39.811078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.811081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.811082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.811084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:39.811157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:39.811160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.811171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.811194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.811212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:39.811235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710288:7349], now have 1 active actors on pipe
2025-10-10T14:35:39.811238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710206:2438], now have 1 active actors on pipe
2025-10-10T14:35:39.811247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601742003481790:9937]
2025-10-10T14:35:39.811249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601742003481790:9937]
2025-10-10T14:35:39.811251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601742003481790:9937]
2025-10-10T14:35:39.811264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:39.811281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:39.811281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:39.811284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:39.811286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:39.811298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:39.811301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:39.811323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601742003481790:9937]
2025-10-10T14:35:39.811326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:39.811340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:39.811360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.811364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.811395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7732d8bd-3b5a1865-419b8838-688e7076_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:39.811402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.811405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.811407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:39.811418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.811428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:39.811441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.811614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.811621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.811645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:39.811767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1751 partition: 0 MaxSeqNo: 40 sessionId: src_id|7732d8bd-3b5a1865-419b8838-688e7076_0
2025-10-10T14:35:39.812135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b87a5af-a4c39adb-3fb5404f-5cc94637_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7732d8bd-3b5a1865-419b8838-688e7076_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:39.814741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7732d8bd-3b5a1865-419b8838-688e7076_0] Write session: try to update token
2025-10-10T14:35:39.814758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7732d8bd-3b5a1865-419b8838-688e7076_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:39.823506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:39.823525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:39.823537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601742003481790:9937]
2025-10-10T14:35:39.823587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:39.823585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:39.823772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:39.823919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:39.824064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:39.824210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:39.824409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:39.824459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:39.830923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId: src_id|7732d8bd-3b5a1865-419b8838-688e7076_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:39.833631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:39.833983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.834001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.834056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:39.834162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:39.842312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:39.842332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:39.842335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:39.842337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:39.842349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601742003481790:9937]
2025-10-10T14:35:39.842357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601742003481790:9937]
2025-10-10T14:35:39.842360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601742003481790:9937]
2025-10-10T14:35:39.842413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:39.842414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:39.842420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.842421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:39.842422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:39.842426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:39.842557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:39.894494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601742785710296:7726]
2025-10-10T14:35:39.897873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1750, pipe: [1:7559601742785710296:7726]
2025-10-10T14:35:39.954117Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:39.961789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.961821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.962020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.962090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.962156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.962231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.962276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.962280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.962352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.962408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.962470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.962752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.962796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.962799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.962865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.962923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.962984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.963041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.963079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.963081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.963158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.963222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.963280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.963344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.963383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.963389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.963455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.963516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.963574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.963632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.963668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.963671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.963739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.963795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.963854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.963913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.963952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.963959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.964029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.964083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.964156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.964216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.964448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.964452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.964519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.964572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.964636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.964693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.964731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.964734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.964804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.964860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.964924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.964984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.965026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.965028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.965098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:39.965162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:39.965222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:39.965280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:39.965611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:39.965627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:39.965741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710296:7726], now have 1 active actors on pipe
2025-10-10T14:35:39.966056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:39.966057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601742785710296:7726]
2025-10-10T14:35:39.966071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:39.966079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:39.966118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1751 reason: error at write: Disconnected sessionId: src_id|7732d8bd-3b5a1865-419b8838-688e7076_0
2025-10-10T14:35:39.966379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1751 sessionId: src_id|7732d8bd-3b5a1865-419b8838-688e7076_0 is DEAD
2025-10-10T14:35:39.966226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:39.969587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7732d8bd-3b5a1865-419b8838-688e7076_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:39.969600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7732d8bd-3b5a1865-419b8838-688e7076_0] Write session will restart in 0.009664s
2025-10-10T14:35:39.969625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7732d8bd-3b5a1865-419b8838-688e7076_0] Write session: Do CDS request
2025-10-10T14:35:39.969631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7732d8bd-3b5a1865-419b8838-688e7076_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:39.977637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:39.978930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:39.979137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:39.979149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:39.979161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:39.979218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:39.979256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601742003481901:9946]
2025-10-10T14:35:39.979809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:39.980115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:39.980158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:39.980463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:39.980531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.980538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.980539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.980540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.980542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.980543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.980544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.980545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.980547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.980549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.980551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.980552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.980553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.980559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.980572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.980576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.980580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.980584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.980588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.980591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.980594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.980597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.980600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.980604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.980607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.980610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.980618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.980626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:39.980633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.980639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:39.980643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.980648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:39.980653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.980657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:39.980661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.980666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:39.980670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.980675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:39.980679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.980684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:39.980689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.980694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:39.980698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.980703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:39.980706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.980711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:39.980723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.980727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.980739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.980744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.980749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.980754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.980793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:39.980916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7732d8bd-3b5a1865-419b8838-688e7076_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.981059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:39.981083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1752
2025-10-10T14:35:39.981586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:39.981630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:39.981635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:39.981641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:39.982065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1752 sessionId:  describe result for acl check
2025-10-10T14:35:39.982097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:39.982101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:39.982102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:39.982108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601742785710358:7345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:39.982683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601742785710358:7345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:39.983659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:39.984168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:39.984184Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:39.984186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:39.984191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:39.984197Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1751 [2:7559601742003481901:9946]
2025-10-10T14:35:39.984210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:39.984242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:39.984246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.984250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.984253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.984271Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:39.984279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:39.984287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:39.984363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.984372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.984374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.984377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:39.984452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:39.984460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:39.984472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:39.984485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:39.984505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:39.984616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1751
2025-10-10T14:35:39.984529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710301:2438], now have 1 active actors on pipe
2025-10-10T14:35:39.984538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601742003481895:9946]
2025-10-10T14:35:39.984541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601742003481895:9946]
2025-10-10T14:35:39.984542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601742003481895:9946]
2025-10-10T14:35:39.984552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:39.984561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:39.984564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:39.984568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:39.984568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:39.984585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:39.984588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:39.984621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601742003481895:9946]
2025-10-10T14:35:39.984631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:39.984642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:39.985612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601742785710358:7345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:39.995454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601742785710358:7345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:39.995482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601742785710358:7345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:39.995486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601742785710358:7345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:39.995494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:39.996316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1751
2025-10-10T14:35:39.997521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601742785710390:7345], now have 1 active actors on pipe
2025-10-10T14:35:39.997552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:39.997561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:39.997595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:39.997611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:39.997620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:39.997622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:39.997636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:39.997655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:39.997679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.000610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.000632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.000667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.000785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1752 partition: 0 MaxSeqNo: 40 sessionId: src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0
2025-10-10T14:35:40.001216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7732d8bd-3b5a1865-419b8838-688e7076_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:40.003974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0] Write session: try to update token
2025-10-10T14:35:40.003995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:40.009036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:40.009056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.009059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:40.009061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:40.009071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601742003481895:9946]
2025-10-10T14:35:40.009076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601742003481895:9946]
2025-10-10T14:35:40.009081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601742003481895:9946]
2025-10-10T14:35:40.009128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:40.009131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:40.009139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.009141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:40.009142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:40.009146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:40.009269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:40.025413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId: src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:40.027988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:40.065994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601747080677712:7726]
2025-10-10T14:35:40.066938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1751, pipe: [1:7559601747080677712:7726]
2025-10-10T14:35:40.131433Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:40.131812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.131827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.131852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677712:7726], now have 1 active actors on pipe
2025-10-10T14:35:40.132074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:40.132065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:40.132141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601747080677712:7726]
2025-10-10T14:35:40.132160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:40.132163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:40.132243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1752 reason: error at write: Disconnected sessionId: src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0
2025-10-10T14:35:40.132444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1752 sessionId: src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0 is DEAD
2025-10-10T14:35:40.133531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:40.133542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0] Write session will restart in 0.009772s
2025-10-10T14:35:40.133568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0] Write session: Do CDS request
2025-10-10T14:35:40.133577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:40.141057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:40.142479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:40.142699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:40.142709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:40.142721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:40.142768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:40.142814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601746298449310:9955]
2025-10-10T14:35:40.143506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:40.143838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:40.143876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:40.144209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:40.144254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.144255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.144257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.144258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.144259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.144260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.144262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.144263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.144264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.144265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.144266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.144267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.144270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.144276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.144289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.144293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.144297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.144301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.144305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.144309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.144312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.144316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.144320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.144324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.144328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.144331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.144338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.144346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.144352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.144358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.144362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.144367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.144372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.144377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.144382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.144387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.144392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.144397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.144401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.144408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.144412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.144417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.144421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.144426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.144431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.144443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.144447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.144452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.144456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.144461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.144466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.144470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.144509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:40.144866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.144972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:40.144992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1753
2025-10-10T14:35:40.145115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.145167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:40.145178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:40.145182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:40.145651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1753 sessionId:  describe result for acl check
2025-10-10T14:35:40.145692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:40.145703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:40.145705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:40.145712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601747080677770:7327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:40.146281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601747080677770:7327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:40.148874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601747080677770:7327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:40.148937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1752
2025-10-10T14:35:40.148097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:40.148587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:40.148593Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:40.148595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:40.148599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:40.148605Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1752 [2:7559601746298449310:9955]
2025-10-10T14:35:40.148620Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:40.148639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:40.148642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.148645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.148648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.148667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:40.148675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:40.148683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:40.148745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.148747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.148749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.148751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:40.148871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:40.148874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.148887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.148899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.148914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:40.148940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677715:2438], now have 1 active actors on pipe
2025-10-10T14:35:40.148948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601746298449305:9955]
2025-10-10T14:35:40.148950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601746298449305:9955]
2025-10-10T14:35:40.148951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601746298449305:9955]
2025-10-10T14:35:40.148970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:40.148985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:40.148986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:40.148990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:40.148992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:40.149001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:40.149004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:40.149042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601746298449305:9955]
2025-10-10T14:35:40.149051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:40.149076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:40.154040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601747080677770:7327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:40.154059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601747080677770:7327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:40.154063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601747080677770:7327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:40.154073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:40.154318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677804:7327], now have 1 active actors on pipe
2025-10-10T14:35:40.154423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1752
2025-10-10T14:35:40.154493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.154507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.154546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:40.154566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.154573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.154575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:40.154592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.154618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:40.154647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.154966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.154975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.154993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.155113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1753 partition: 0 MaxSeqNo: 40 sessionId: src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0
2025-10-10T14:35:40.156929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086c206-239cd7dc-c390a0e7-6daceccc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:40.159831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0] Write session: try to update token
2025-10-10T14:35:40.159854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:40.169161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:40.169179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.169184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:40.169186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:40.169196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601746298449305:9955]
2025-10-10T14:35:40.169201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601746298449305:9955]
2025-10-10T14:35:40.169205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601746298449305:9955]
2025-10-10T14:35:40.169255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:40.169256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:40.169264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:40.169267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.169268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:40.169270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:40.169440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:40.181931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId: src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:40.184403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:40.232389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601747080677807:7726]
2025-10-10T14:35:40.232992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1752, pipe: [1:7559601747080677807:7726]
2025-10-10T14:35:40.281427Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:40.281783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.281802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.281828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677807:7726], now have 1 active actors on pipe
2025-10-10T14:35:40.282062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:40.282068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:40.282074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601747080677807:7726]
2025-10-10T14:35:40.282101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:40.282104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:40.282189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1753 reason: error at write: Disconnected sessionId: src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0
2025-10-10T14:35:40.282435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1753 sessionId: src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0 is DEAD
2025-10-10T14:35:40.282570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:40.282583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0] Write session will restart in 0.009329s
2025-10-10T14:35:40.282608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0] Write session: Do CDS request
2025-10-10T14:35:40.282614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:40.290873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:40.291961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:40.292141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:40.292156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:40.292167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:40.292213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:40.292256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601746298449399:9957]
2025-10-10T14:35:40.292840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:40.292910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.293046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:40.293063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1754
2025-10-10T14:35:40.293119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:40.293159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:40.293208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.293246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:40.293255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:40.293258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:40.293470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:40.293526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.293538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.293539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.293541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.293543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.293544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.293545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.293546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.293548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.293548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.293549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.293551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.293552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.293557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.293569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.293573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.293577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.293580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.293584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.293588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.293591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.293595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.293599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.293602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.293605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.293609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.293616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.293624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.293630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.293635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.293639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.293644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.293648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.293653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.293658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.293663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.293667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.293672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.293676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.293681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.293685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.293690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.293694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.293699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.293704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.293698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1754 sessionId:  describe result for acl check
2025-10-10T14:35:40.293709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.293713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.293719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.293723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.293734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:40.293741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:40.293728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.293743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:40.293738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.293749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601747080677861:7316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:40.293743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.293781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:40.294331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601747080677861:7316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:40.295994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:40.296169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601747080677861:7316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:40.296382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:40.296394Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:40.296396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:40.296400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:40.296404Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1753 [2:7559601746298449399:9957]
2025-10-10T14:35:40.296418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:40.296433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:40.296437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.296440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.296442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.296457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:40.296469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:40.296480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:40.296531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.296537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.296539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.296542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:40.296602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:40.296608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.296619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.296637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.296656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:40.296680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677808:2438], now have 1 active actors on pipe
2025-10-10T14:35:40.296693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601746298449394:9957]
2025-10-10T14:35:40.296697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601746298449394:9957]
2025-10-10T14:35:40.296700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601746298449394:9957]
2025-10-10T14:35:40.296693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1753
2025-10-10T14:35:40.296709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:40.296726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:40.296726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:40.296729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:40.296731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:40.296741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:40.296744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:40.296768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601746298449394:9957]
2025-10-10T14:35:40.296780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:40.296804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:40.301675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601747080677861:7316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:40.301688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601747080677861:7316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:40.301692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601747080677861:7316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:40.301700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:40.301959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677897:7316], now have 1 active actors on pipe
2025-10-10T14:35:40.302006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1753
2025-10-10T14:35:40.302074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.302089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.302123Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:40.302140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.302158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.302165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:40.302179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.302199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:40.302219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.302380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.302396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.302413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.302489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1754 partition: 0 MaxSeqNo: 40 sessionId: src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0
2025-10-10T14:35:40.302826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d93299d0-b5e4a6b3-83c6458c-9bcf4360_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:40.305583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0] Write session: try to update token
2025-10-10T14:35:40.305599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:40.307970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:40.307987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.307998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601746298449394:9957]
2025-10-10T14:35:40.308039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:40.308044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:40.308214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:40.308356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.308498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.308638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.308829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:40.308867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:40.320667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId: src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:40.323422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:40.323640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.323663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.323716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:40.323857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:40.325839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:40.325854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.325860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:40.325864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:40.325874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601746298449394:9957]
2025-10-10T14:35:40.325878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601746298449394:9957]
2025-10-10T14:35:40.325881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601746298449394:9957]
2025-10-10T14:35:40.325936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:40.325945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.325948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:40.326080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:40.329391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:40.329408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:40.329413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:40.382426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601747080677901:7726]
2025-10-10T14:35:40.382719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1753, pipe: [1:7559601747080677901:7726]
2025-10-10T14:35:40.439535Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:40.446683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.446707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.446859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.446926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.446991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.447049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.447091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.447099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.447164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.447225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.447283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.447345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.447385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.447390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.447462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.447518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.447582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.447646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.447689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.447697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.447762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.448107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.448169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.448233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.448271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.448273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.448337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.448388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.448444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.448511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.448553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.448555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.448617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.448675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.448738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.448793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.448830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.448831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.448899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.448956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.449017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.449070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.449113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.449114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.449175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.449230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.449286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.449371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.449414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.449417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.449490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.449550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.449617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.449672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.449713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.449718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.449784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.449835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.449906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.449970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.450019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.450021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.450088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677901:7726], now have 1 active actors on pipe
2025-10-10T14:35:40.450939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:40.450953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0] Write session will restart in 0.008376s
2025-10-10T14:35:40.450978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0] Write session: Do CDS request
2025-10-10T14:35:40.450984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:40.450663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:40.450432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601747080677901:7726]
2025-10-10T14:35:40.450490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:40.450493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:40.450523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1754 reason: error at write: Disconnected sessionId: src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0
2025-10-10T14:35:40.450598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:40.450715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1754 sessionId: src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0 is DEAD
2025-10-10T14:35:40.461949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.462104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:40.462124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1755
2025-10-10T14:35:40.462297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.462329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:40.462334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:40.462339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:40.462848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1755 sessionId:  describe result for acl check
2025-10-10T14:35:40.462883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:40.462885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:40.462886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:40.462895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601747080677918:7313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:40.463498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601747080677918:7313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:40.466469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601747080677918:7313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:40.466848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:40.468453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:40.468680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:40.468692Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:40.468704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:40.468754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:40.468792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601746298449490:9959]
2025-10-10T14:35:40.469420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:40.469782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:40.469844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:40.470185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:40.470245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.470250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.470251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.470252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.470254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.470255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.470257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.470258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.470259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.470260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.470261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.470263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.470264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.470271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.470285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.470289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.470293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.470296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.470302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.470306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.470309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.470313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.470318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.470321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.470325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.470328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.470335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.470345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.470351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.470356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.470360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.470366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.470369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.470375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.470379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.470384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.470389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.470394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.470398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.470404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.470408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.470413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.470418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.470423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.470427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.470432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.470445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.470451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.470455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.470461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.470465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.470470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.470508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:40.471510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601747080677918:7313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:40.471527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601747080677918:7313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:40.471531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601747080677918:7313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:40.471541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:40.474408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:40.474731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:40.474737Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:40.474739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:40.474743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:40.474749Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1754 [2:7559601746298449490:9959]
2025-10-10T14:35:40.474763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:40.474781Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:40.474784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.474788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.474791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.474810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:40.474820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:40.474827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:40.474885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.474887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.474889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.474892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:40.474963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:40.474966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.474977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.474990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.475007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:40.475028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677988:7313], now have 1 active actors on pipe
2025-10-10T14:35:40.475032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677902:2438], now have 1 active actors on pipe
2025-10-10T14:35:40.475039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601746298449485:9959]
2025-10-10T14:35:40.475041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601746298449485:9959]
2025-10-10T14:35:40.475044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601746298449485:9959]
2025-10-10T14:35:40.475052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:40.475066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:40.475083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:40.475085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:40.475087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:40.475089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:40.475092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:40.475113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601746298449485:9959]
2025-10-10T14:35:40.475122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:40.475153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:40.475402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.475415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.475449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d2f8849-709550b7-def202fd-94b03c86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:40.475462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.475466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.475469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:40.475481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.475497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:40.475516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.475134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1754
2025-10-10T14:35:40.475167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1754
2025-10-10T14:35:40.475752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.475764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.475781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.475900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1755 partition: 0 MaxSeqNo: 40 sessionId: src_id|5d2f8849-709550b7-def202fd-94b03c86_0
2025-10-10T14:35:40.476299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a17aa7-252c075a-f11e020e-4a3e206c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5d2f8849-709550b7-def202fd-94b03c86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:40.479024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2f8849-709550b7-def202fd-94b03c86_0] Write session: try to update token
2025-10-10T14:35:40.479043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2f8849-709550b7-def202fd-94b03c86_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:40.491515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:40.491533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.491545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601746298449485:9959]
2025-10-10T14:35:40.491602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:40.491604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:40.491797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:40.491946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.492097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.492250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.492587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:40.492624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:40.497229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.497251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.497291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:40.494332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId: src_id|5d2f8849-709550b7-def202fd-94b03c86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:40.496984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:40.497395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:40.509642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:40.509665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.509669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:40.509672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:40.509686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601746298449485:9959]
2025-10-10T14:35:40.509689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601746298449485:9959]
2025-10-10T14:35:40.509694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601746298449485:9959]
2025-10-10T14:35:40.509742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:40.509746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:40.509751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.509754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:40.509754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:40.509758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:40.509903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:40.551446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601747080677997:7726]
2025-10-10T14:35:40.551873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1754, pipe: [1:7559601747080677997:7726]
2025-10-10T14:35:40.621582Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:40.629090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.629111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.629274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.629352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.629419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.629484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.629901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.629913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.629992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.630060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.630127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.630199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.630242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.630249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.630316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.630380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.630440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.630506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.630559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.630568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.630631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.630690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.630756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.630821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.630873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.630881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.630949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.631015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.631079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.631142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.631188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.631193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.631260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.631319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.631388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.631448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.631498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.631505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.631568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.631632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.631698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.631765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.631809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.631819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.631889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.631948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.632012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.632076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.632121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.632128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.632192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.632252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.632313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.632375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.632422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.632431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.632495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.632556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.632619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.632680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.632727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.632734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.632810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677997:7726], now have 1 active actors on pipe
2025-10-10T14:35:40.633030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601747080677997:7726]
2025-10-10T14:35:40.633067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:40.633083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:40.633085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:40.633118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1755 reason: error at write: Disconnected sessionId: src_id|5d2f8849-709550b7-def202fd-94b03c86_0
2025-10-10T14:35:40.633320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:40.633348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1755 sessionId: src_id|5d2f8849-709550b7-def202fd-94b03c86_0 is DEAD
2025-10-10T14:35:40.633470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2f8849-709550b7-def202fd-94b03c86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:40.633481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2f8849-709550b7-def202fd-94b03c86_0] Write session will restart in 0.008095s
2025-10-10T14:35:40.633519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2f8849-709550b7-def202fd-94b03c86_0] Write session: Do CDS request
2025-10-10T14:35:40.633525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2f8849-709550b7-def202fd-94b03c86_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:40.642265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:40.642914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2f8849-709550b7-def202fd-94b03c86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.643413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:40.643433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1756
2025-10-10T14:35:40.643581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.643592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:40.643618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:40.643632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:40.643636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:40.643798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:40.643811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:40.643826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:40.643892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:40.643937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601746298449580:9961]
2025-10-10T14:35:40.644092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1756 sessionId:  describe result for acl check
2025-10-10T14:35:40.644133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:40.644140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:40.644142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:40.644148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601747080678052:7309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:40.644484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:40.644724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601747080678052:7309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:40.644899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:40.644953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:40.645295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:40.645411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.645421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.645423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.645424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.645425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.645426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.645428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.645429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.645432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.645433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.645434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.645436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.645437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.645444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.645455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.645458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.645461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.645465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.645468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.645472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.645476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.645479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.645484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.645488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.645491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.645494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.645501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.645509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.645514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.645519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.645524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.645528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.645532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.645537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.645541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.645546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.645549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.645556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.645560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.645566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.645571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.645576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.645580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.645585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.645589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.645594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.645598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.645603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.645607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.645612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.645618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.645622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.645655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:40.648001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601747080678052:7309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:40.648015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:40.648326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:40.648340Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:40.648342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:40.648346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:40.648352Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1755 [2:7559601746298449580:9961]
2025-10-10T14:35:40.648363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:40.648379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:40.648382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.648386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.648388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.648404Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:40.648415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:40.648423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:40.648480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.648486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.648488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.648490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:40.648553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:40.648561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.648573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.648585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.648607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:40.648631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080677999:2438], now have 1 active actors on pipe
2025-10-10T14:35:40.648643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601746298449575:9961]
2025-10-10T14:35:40.648645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601746298449575:9961]
2025-10-10T14:35:40.648648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601746298449575:9961]
2025-10-10T14:35:40.648634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1755
2025-10-10T14:35:40.648662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:40.648671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:40.648674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:40.648675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:40.648680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:40.648697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:40.648701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:40.648727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601746298449575:9961]
2025-10-10T14:35:40.648739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:40.648751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:40.653751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601747080678052:7309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:40.653783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601747080678052:7309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:40.653787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601747080678052:7309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:40.653797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:40.654060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080678093:7309], now have 1 active actors on pipe
2025-10-10T14:35:40.654190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1755
2025-10-10T14:35:40.654260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.654273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.654309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:40.654327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.654334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.654336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:40.654350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.654374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:40.654399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.654643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.654656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.654680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.654787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1756 partition: 0 MaxSeqNo: 40 sessionId: src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0
2025-10-10T14:35:40.655174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d2f8849-709550b7-def202fd-94b03c86_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:40.657844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0] Write session: try to update token
2025-10-10T14:35:40.657863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:40.660123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:40.660139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.660151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601746298449575:9961]
2025-10-10T14:35:40.660204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:40.660246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:40.660386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:40.660543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.660696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.660846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:40.661056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:40.661106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:40.673971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId: src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:40.676717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:40.676970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.676992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.677045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:40.677222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:40.679125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:40.679146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.679149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:40.679151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:40.679162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601746298449575:9961]
2025-10-10T14:35:40.679166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601746298449575:9961]
2025-10-10T14:35:40.679174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601746298449575:9961]
2025-10-10T14:35:40.679226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:40.679238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:40.679241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.679245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:40.679245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:40.679249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:40.679395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:40.733142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601747080678104:7726]
2025-10-10T14:35:40.733465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1755, pipe: [1:7559601747080678104:7726]
2025-10-10T14:35:40.792234Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:40.800441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.800474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.800662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.800729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.800796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.800870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.801291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.801310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.801399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.801463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.801528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.801598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.801642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.801649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.801719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.801784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.801848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.801924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.801968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.801975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.802045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.804577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601747080678104:7726]
2025-10-10T14:35:40.804583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:40.804587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:40.804611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:40.804629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1756 reason: error at write: Disconnected sessionId: src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0
2025-10-10T14:35:40.804845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1756 sessionId: src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0 is DEAD
2025-10-10T14:35:40.802113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.802181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.802243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.802283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.802285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.802357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.802419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.802479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.802540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.802581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.802583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.805083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:40.805096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0] Write session will restart in 0.009998s
2025-10-10T14:35:40.802653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.802715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.802775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.802839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.802880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.802883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.802955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.803016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.803080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.803143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.803183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.803186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.803253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.805133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0] Write session: Do CDS request
2025-10-10T14:35:40.805143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:40.803313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.803372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.803433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.803638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.803641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.803709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.803769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.803828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.803890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.803928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.803931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.803998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:40.804054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:40.804111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:40.804171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:40.804214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:40.804217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:40.804286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080678104:7726], now have 1 active actors on pipe
2025-10-10T14:35:40.804721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:40.814192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:40.815991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.816014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:40.816032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1757
2025-10-10T14:35:40.816198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:40.816256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.816321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:40.816333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:40.816337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:40.816446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:40.816458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:40.816470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:40.816554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:40.816601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601746298449685:9964]
2025-10-10T14:35:40.816806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1757 sessionId:  describe result for acl check
2025-10-10T14:35:40.816843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:40.816848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:40.816850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:40.816856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601747080678173:7300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:40.817193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:40.817374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601747080678173:7300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:40.817573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:40.817636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:40.817984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:40.818052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.818060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.818061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.818062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.818064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.818065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.818066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.818067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.818068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.818069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.818070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.818071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.818072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.818078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.818090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.818094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.818098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.818101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.818104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.818107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.818110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.818114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.818118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.818122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.818125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.818129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.818137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.818145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.818151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.818156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.818159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.818164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.818168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.818172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.818176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.818180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.818185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.818190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.818193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.818197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.818201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.818205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.818209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.818213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.818217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.818222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.818226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.818231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.818235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.818240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.818244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.818249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.818297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:40.819952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601747080678173:7300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:40.820881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:40.821267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:40.821280Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:40.821283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:40.821287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:40.821296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1756 [2:7559601746298449685:9964]
2025-10-10T14:35:40.821310Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:40.821327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:40.821350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.821353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.821355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.821373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:40.821388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:40.821395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:40.821456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.821467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.821469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.821472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:40.821532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:40.821540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.821552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.821570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.821584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:40.821629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080678117:2438], now have 1 active actors on pipe
2025-10-10T14:35:40.821643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601746298449679:9964]
2025-10-10T14:35:40.821645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601746298449679:9964]
2025-10-10T14:35:40.821647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601746298449679:9964]
2025-10-10T14:35:40.821656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:40.821669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:40.821672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:40.821673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:40.821674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:40.821689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:40.821697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:40.821672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1756
2025-10-10T14:35:40.821725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601746298449679:9964]
2025-10-10T14:35:40.821739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:40.821755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:40.826422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601747080678173:7300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:40.826439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601747080678173:7300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:40.826443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601747080678173:7300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:40.826451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:40.826682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080678211:7300], now have 1 active actors on pipe
2025-10-10T14:35:40.826721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1756
2025-10-10T14:35:40.826790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.826807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.826852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:40.826871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.826881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.826882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:40.826893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.826909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:40.826927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.827095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.827109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.827137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.827229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1757 partition: 0 MaxSeqNo: 40 sessionId: src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0
2025-10-10T14:35:40.827622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3445448f-f78de5e-b7ae61ce-e979ea39_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:40.830342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0] Write session: try to update token
2025-10-10T14:35:40.830361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:40.841467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:40.841489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.841496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:40.841500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:40.841520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601746298449679:9964]
2025-10-10T14:35:40.841529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601746298449679:9964]
2025-10-10T14:35:40.841535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601746298449679:9964]
2025-10-10T14:35:40.841592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:40.841607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:40.841609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:40.841614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:40.841623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.841627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:40.841899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:40.845137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId: src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:40.847823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:40.904672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601747080678214:7726]
2025-10-10T14:35:40.905069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1756, pipe: [1:7559601747080678214:7726]
2025-10-10T14:35:40.954829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:40.955179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.955193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.955239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080678214:7726], now have 1 active actors on pipe
2025-10-10T14:35:40.955457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:40.955446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601747080678214:7726]
2025-10-10T14:35:40.955490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:40.955529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:40.955628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1757 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0
2025-10-10T14:35:40.955832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1757 sessionId: src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0 is DEAD
2025-10-10T14:35:40.955990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:40.956001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0] Write session will restart in 0.005082s
2025-10-10T14:35:40.956026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0] Write session: Do CDS request
2025-10-10T14:35:40.956032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:40.961877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.962220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:40.962238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1758
2025-10-10T14:35:40.962433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:40.962480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:40.962491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:40.962495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:40.962934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1758 sessionId:  describe result for acl check
2025-10-10T14:35:40.962972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:40.962974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:40.962976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:40.962982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601747080678264:7292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:40.963542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601747080678264:7292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:40.964517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:40.965559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601747080678264:7292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:40.965992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:40.966195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:40.966205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:40.966218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:40.966276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:40.966316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601746298449779:9967]
2025-10-10T14:35:40.966912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:40.967257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:40.967312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:40.967685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:40.967741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.967747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.967748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.967750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.967751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.967752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.967754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.967755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.967756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.967758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.967759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.967760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.967762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.967768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.967782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.967786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.967791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.967795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.967799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.967803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.967807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.967811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.967816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.967822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.967826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.967830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.967837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.967846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:40.967852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.967858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:40.967862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.967868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:40.967879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.967885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:40.967890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.967895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:40.967900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.967905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:40.967910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.967916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:40.967920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.967925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:40.967930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.967937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:40.967941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.967947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:40.967952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.967957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.967963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.967968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.967973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.967979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.968032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:40.968427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601747080678264:7292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:40.968441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601747080678264:7292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:40.968445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601747080678264:7292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:40.968455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:40.970553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:40.970878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:40.970892Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:40.970894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:40.970898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:40.970905Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1757 [2:7559601746298449779:9967]
2025-10-10T14:35:40.970917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:40.970937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:40.970944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.970948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.970950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.970968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:40.970979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:40.970987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:40.971041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.971048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.971050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.971053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:40.971139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:40.971142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.971153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:40.971166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:40.971183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:40.971206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080678218:2438], now have 1 active actors on pipe
2025-10-10T14:35:40.971216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601747080678304:7292], now have 1 active actors on pipe
2025-10-10T14:35:40.971224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601746298449774:9967]
2025-10-10T14:35:40.971226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601746298449774:9967]
2025-10-10T14:35:40.971229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601746298449774:9967]
2025-10-10T14:35:40.971250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:40.971266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:40.971269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:40.971271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:40.971274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:40.971290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:40.971298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:40.971322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601746298449774:9967]
2025-10-10T14:35:40.971329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:40.971331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:40.971277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1757
2025-10-10T14:35:40.971357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.971366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.971283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1757
2025-10-10T14:35:40.971401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:40.971413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:40.971417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:40.971419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:40.971430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:40.971441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:40.971457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.971937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:40.971945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:40.971961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:40.972058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1758 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0
2025-10-10T14:35:40.972530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a11c6c-5969c136-5fe09aed-8dd35a9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:40.975186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0] Write session: try to update token
2025-10-10T14:35:40.975203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:40.990465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:40.990480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:40.990483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:40.990485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:40.990496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601746298449774:9967]
2025-10-10T14:35:40.990501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601746298449774:9967]
2025-10-10T14:35:40.990505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601746298449774:9967]
2025-10-10T14:35:40.990556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:40.990568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:40.990571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:40.990704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:40.991675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId: src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:40.992687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:40.992705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:40.992713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:40.994417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:41.055678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601751375645608:7726]
2025-10-10T14:35:41.055964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1757, pipe: [1:7559601751375645608:7726]
2025-10-10T14:35:41.104839Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:41.105161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.105174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.105220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645608:7726], now have 1 active actors on pipe
2025-10-10T14:35:41.109118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:41.109149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:41.110139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:41.110153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0] Write session will restart in 0.007855s
2025-10-10T14:35:41.110179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0] Write session: Do CDS request
2025-10-10T14:35:41.110185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:41.109225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:41.109233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:41.109305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1758 reason: error at write: Disconnected sessionId: src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0
2025-10-10T14:35:41.109528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1758 sessionId: src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0 is DEAD
2025-10-10T14:35:41.109680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601751375645608:7726]
2025-10-10T14:35:41.119264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.119654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:41.119671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1759
2025-10-10T14:35:41.119875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.119927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:41.119946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:41.119950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:41.120868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1759 sessionId:  describe result for acl check
2025-10-10T14:35:41.120903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:41.120913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:41.120914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:41.120920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601751375645680:7279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:41.121457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601751375645680:7279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:41.123868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601751375645680:7279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:41.125908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:41.126422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601751375645680:7279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:41.126437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601751375645680:7279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:41.126441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601751375645680:7279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:41.126448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:41.130934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:41.131196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:41.131208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:41.131220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:41.131282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:41.131338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601750593417209:9980]
2025-10-10T14:35:41.131956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:41.133298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:41.133380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:41.133722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:41.133810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.133816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.133817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.133818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.133819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.133833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.133834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.133835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.133836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.133837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.133837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.133838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.133839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.133844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.133853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.133855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.133858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.133860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.133874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.133877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.133879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.133881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.133884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.133886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.133888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.133890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.133897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.133907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.133914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.133920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.133925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.133930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.133936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.133941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.133945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.133950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.133955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.133960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.133969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.133974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.133978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.133982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.133987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.133992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.133996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.134001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.134010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.134025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.134033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.134039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.134047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.134056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.134097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:41.136540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:41.136896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:41.136909Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:41.136911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:41.136915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:41.136921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1758 [2:7559601750593417209:9980]
2025-10-10T14:35:41.136936Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:41.136956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:41.136964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.136967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.136969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.136984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:41.136996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:41.137008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:41.137066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.137074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.137076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.137078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:41.137144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:41.137151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.137161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.137178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.137200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:41.137227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645720:7279], now have 1 active actors on pipe
2025-10-10T14:35:41.137237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645622:2438], now have 1 active actors on pipe
2025-10-10T14:35:41.137244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601750593417202:9980]
2025-10-10T14:35:41.137250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601750593417202:9980]
2025-10-10T14:35:41.137252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601750593417202:9980]
2025-10-10T14:35:41.137268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:41.137291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:41.137295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:41.137299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:41.137301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:41.137311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:41.137319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:41.137363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601750593417202:9980]
2025-10-10T14:35:41.137374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:41.137385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:41.137814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.137828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.137883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:41.137898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.137906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.137910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:41.137924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.137942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:41.137963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.138188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.138196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.138212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.138797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2c2edf-466569-45ac5a6b-dd2ac6f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:41.141646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0] Write session: try to update token
2025-10-10T14:35:41.141667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:41.137473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1758
2025-10-10T14:35:41.137508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1758
2025-10-10T14:35:41.138359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1759 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0
2025-10-10T14:35:41.150138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:41.150155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:41.150169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601750593417202:9980]
2025-10-10T14:35:41.150213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:41.150219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:41.150389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:41.150533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:41.150669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:41.150810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:41.150995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:41.151030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:41.165501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId: src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:41.168223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:41.169962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.169986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.170012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:41.170016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:41.170020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:41.170023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:41.170032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601750593417202:9980]
2025-10-10T14:35:41.170041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601750593417202:9980]
2025-10-10T14:35:41.170045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601750593417202:9980]
2025-10-10T14:35:41.170110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:41.170108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:41.170115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:41.170121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.170121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:41.170124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:41.170258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:41.209812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601751375645733:7726]
2025-10-10T14:35:41.210351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1758, pipe: [1:7559601751375645733:7726]
2025-10-10T14:35:41.280640Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:41.281052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:41.281090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645733:7726], now have 1 active actors on pipe
2025-10-10T14:35:41.282510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:41.282524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0] Write session will restart in 0.006879s
2025-10-10T14:35:41.282551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0] Write session: Do CDS request
2025-10-10T14:35:41.282558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:41.281953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:41.282050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:41.282053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:41.282135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1759 reason: error at write: Disconnected sessionId: src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0
2025-10-10T14:35:41.282314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1759 sessionId: src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0 is DEAD
2025-10-10T14:35:41.282485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:41.282520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601751375645733:7726]
2025-10-10T14:35:41.293427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:41.293930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.295064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:41.295267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:41.295279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:41.295291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:41.295347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:41.295389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601750593417303:9984]
2025-10-10T14:35:41.295870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:41.296162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:41.296206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:41.296439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:41.296479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.296480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.296480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.296481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.296482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.296483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.296483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.296484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.296485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.296485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.296486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.296487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.296487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.296491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.296500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.296502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.296505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.296507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.296509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.296511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.296513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.296515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.296517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.296520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.296522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.296524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.296529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.296535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.296540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.296545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.296548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.296551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.296554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.296557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.296559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.296563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.296565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.296568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.296571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.296574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.296578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.296581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.296584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.296586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.296589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.296592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.296595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.296598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.296601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.296604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.296606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.296609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.296632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:41.297388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:41.297406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1760
2025-10-10T14:35:41.297579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.297621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:41.297626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:41.297632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:41.298100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1760 sessionId:  describe result for acl check
2025-10-10T14:35:41.298137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:41.298139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:41.298140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:41.298146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601751375645798:7269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:41.298636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601751375645798:7269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:41.299363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:41.299673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:41.299686Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:41.299688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:41.299692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:41.299698Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1759 [2:7559601750593417303:9984]
2025-10-10T14:35:41.299711Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:41.299728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:41.299733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.299737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.299739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.299756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:41.299763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:41.299771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:41.299824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.299826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.299828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.299830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:41.299896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:41.299899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.299910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.299922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.299937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:41.299952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601750593417297:9984]
2025-10-10T14:35:41.299954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601750593417297:9984]
2025-10-10T14:35:41.299955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601750593417297:9984]
2025-10-10T14:35:41.299960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:41.299970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:41.299973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:41.299977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:41.299979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:41.299979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:41.299982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:41.299993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645734:2438], now have 1 active actors on pipe
2025-10-10T14:35:41.300015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601750593417297:9984]
2025-10-10T14:35:41.300024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:41.300038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:41.300266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1759
2025-10-10T14:35:41.301954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601751375645798:7269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:41.310395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601751375645798:7269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:41.310423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601751375645798:7269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:41.310427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601751375645798:7269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:41.310437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:41.310878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1759
2025-10-10T14:35:41.312147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1760 partition: 0 MaxSeqNo: 40 sessionId: src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0
2025-10-10T14:35:41.311433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645834:7269], now have 1 active actors on pipe
2025-10-10T14:35:41.311494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.311503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.311573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:41.311588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.311597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.311600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:41.311618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.311643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:41.311667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.311986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.311994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.312017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.313647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8ac084-bd1de71b-f9dd888f-474850a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:41.316274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0] Write session: try to update token
2025-10-10T14:35:41.316294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:41.333982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:41.334000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:41.334004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:41.334006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:41.334018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601750593417297:9984]
2025-10-10T14:35:41.334023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601750593417297:9984]
2025-10-10T14:35:41.334027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601750593417297:9984]
2025-10-10T14:35:41.334084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:41.334093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.334098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:41.334250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:41.337406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:41.337432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:41.337438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:41.338480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId: src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:41.341221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:41.381839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601751375645838:7726]
2025-10-10T14:35:41.382132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1759, pipe: [1:7559601751375645838:7726]
2025-10-10T14:35:41.453595Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:41.454037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.454068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.454130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645838:7726], now have 1 active actors on pipe
2025-10-10T14:35:41.454374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:41.454836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:41.454847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0] Write session will restart in 0.005507s
2025-10-10T14:35:41.454872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0] Write session: Do CDS request
2025-10-10T14:35:41.454888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:41.454350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601751375645838:7726]
2025-10-10T14:35:41.454395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:41.454398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:41.454453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:41.454457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1760 reason: error at write: Disconnected sessionId: src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0
2025-10-10T14:35:41.454676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1760 sessionId: src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0 is DEAD
2025-10-10T14:35:41.461934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.462018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:41.462043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1761
2025-10-10T14:35:41.462173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.462207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:41.462213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:41.462216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:41.463191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1761 sessionId:  describe result for acl check
2025-10-10T14:35:41.463232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:41.463234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:41.463235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:41.463241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601751375645874:7256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:41.463814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601751375645874:7256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:41.466439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601751375645874:7256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:41.468974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601751375645874:7256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:41.468987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601751375645874:7256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:41.468990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601751375645874:7256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:41.468998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:41.469721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:41.471379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:41.471593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:41.471604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:41.471616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:41.471668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:41.471719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601750593417400:9986]
2025-10-10T14:35:41.472331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:41.472642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:41.472711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:41.473142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:41.473231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.473243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.473244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.473246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.473248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.473249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.473251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.473252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.473254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.473255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.473256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.473258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.473259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.473268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.473284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.473289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.473293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.473298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.473303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.473308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.473312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.473316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.473322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.473326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.473349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.473353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.473362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.473371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.473377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.473385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.473394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.473400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.473406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.473413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.473420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.473437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.473446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.473453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.473468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.473480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.473486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.473492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.473499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.473505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.473510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.473516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.473520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.473533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.473541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.473547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.473559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.473565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.473609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:41.476315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:41.476845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:41.476868Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:41.476872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:41.476877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:41.476885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1760 [2:7559601750593417400:9986]
2025-10-10T14:35:41.476903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:41.476922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:41.476933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.476938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.476940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.476957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:41.476965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:41.476973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:41.477064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.477079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.477083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.477085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:41.477187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:41.477199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.477212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.477230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.477253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:41.477287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645839:2438], now have 1 active actors on pipe
2025-10-10T14:35:41.477299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645927:7256], now have 1 active actors on pipe
2025-10-10T14:35:41.477309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601750593417395:9986]
2025-10-10T14:35:41.477312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601750593417395:9986]
2025-10-10T14:35:41.477315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601750593417395:9986]
2025-10-10T14:35:41.477355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:41.477371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:41.477380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:41.477387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:41.477392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:41.477372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1760
2025-10-10T14:35:41.477389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1760
2025-10-10T14:35:41.477408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:41.477420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:41.477458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601750593417395:9986]
2025-10-10T14:35:41.477481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:41.477484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:41.477531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.477543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.477596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7798cd73-abd0b334-a52ba20-8802f84a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:41.477615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.477627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.477630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:41.477646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.477670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:41.477692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.478029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.478047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.478075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.478169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1761 partition: 0 MaxSeqNo: 40 sessionId: src_id|7798cd73-abd0b334-a52ba20-8802f84a_0
2025-10-10T14:35:41.478592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186f009f-e03d11e1-7c53e3d4-ff01f9b1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7798cd73-abd0b334-a52ba20-8802f84a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:41.481401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7798cd73-abd0b334-a52ba20-8802f84a_0] Write session: try to update token
2025-10-10T14:35:41.481418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7798cd73-abd0b334-a52ba20-8802f84a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:41.497653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:41.497672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:41.497676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:41.497679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:41.497691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601750593417395:9986]
2025-10-10T14:35:41.497696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601750593417395:9986]
2025-10-10T14:35:41.497701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601750593417395:9986]
2025-10-10T14:35:41.497753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:41.497760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.497759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:41.497766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:41.497766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:41.497770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:41.497918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:41.498373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId: src_id|7798cd73-abd0b334-a52ba20-8802f84a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:41.501054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:41.554385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601751375645939:7726]
2025-10-10T14:35:41.557689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1760, pipe: [1:7559601751375645939:7726]
2025-10-10T14:35:41.616371Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:41.616709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.616727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.616776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645939:7726], now have 1 active actors on pipe
2025-10-10T14:35:41.616999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:41.617046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601751375645939:7726]
2025-10-10T14:35:41.617054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:41.617058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:41.617082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:41.617137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1761 reason: error at write: Disconnected sessionId: src_id|7798cd73-abd0b334-a52ba20-8802f84a_0
2025-10-10T14:35:41.617372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1761 sessionId: src_id|7798cd73-abd0b334-a52ba20-8802f84a_0 is DEAD
2025-10-10T14:35:41.617517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7798cd73-abd0b334-a52ba20-8802f84a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:41.617536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7798cd73-abd0b334-a52ba20-8802f84a_0] Write session will restart in 0.007546s
2025-10-10T14:35:41.617562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7798cd73-abd0b334-a52ba20-8802f84a_0] Write session: Do CDS request
2025-10-10T14:35:41.617568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7798cd73-abd0b334-a52ba20-8802f84a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:41.627207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:41.628917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:41.629128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:41.629141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:41.629154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:41.629210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:41.629254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601750593417495:9988]
2025-10-10T14:35:41.629845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7798cd73-abd0b334-a52ba20-8802f84a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.629944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:41.630430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:41.630480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:41.630809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:41.630868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.630874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.630876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.630877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.630878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.630879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.630881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.630882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.630884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.630886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.630887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.630889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.630890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.630896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.630910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.630915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.630919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.630925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.630929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.630934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.630938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.630943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.630948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.630952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.630957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.630963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.630973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.630983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.630993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.630999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.631004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.631010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.631014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.631020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.631026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.631031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.631036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.631042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.631047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.631052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.631056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.631061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.631066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.631071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.631076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.631082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.631088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.631093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.631098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.631103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.631115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.631121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.631163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:41.629939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:41.629959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1762
2025-10-10T14:35:41.630145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.630175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:41.630181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:41.630186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:41.630815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1762 sessionId:  describe result for acl check
2025-10-10T14:35:41.630856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:41.630859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:41.630860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:41.630866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601751375646003:7255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:41.631460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601751375646003:7255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:41.633637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:41.633975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:41.633993Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:41.633996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:41.634002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:41.634009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1761 [2:7559601750593417495:9988]
2025-10-10T14:35:41.634022Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:41.634039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:41.634043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.634046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.634048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.634065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:41.634073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:41.634082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:41.634138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.634148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.634150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.634152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:41.634226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:41.634233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.634243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.634261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.634287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:41.634310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375645940:2438], now have 1 active actors on pipe
2025-10-10T14:35:41.634319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601750593417489:9988]
2025-10-10T14:35:41.634322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601750593417489:9988]
2025-10-10T14:35:41.634324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601750593417489:9988]
2025-10-10T14:35:41.634322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601751375646003:7255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:41.634341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:41.634356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:41.634359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:41.634360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:41.634361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:41.634376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:41.634379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:41.634377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1761
2025-10-10T14:35:41.634404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601750593417489:9988]
2025-10-10T14:35:41.634412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:41.634419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:41.644171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601751375646003:7255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:41.644192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601751375646003:7255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:41.644197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601751375646003:7255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:41.644209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:41.644826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375646038:7255], now have 1 active actors on pipe
2025-10-10T14:35:41.644927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1761
2025-10-10T14:35:41.644998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.645012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.645047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:41.645065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.645075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.645079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:41.645107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.645137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:41.645158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.645379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.645391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.645413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.645518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1762 partition: 0 MaxSeqNo: 40 sessionId: src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0
2025-10-10T14:35:41.645973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7798cd73-abd0b334-a52ba20-8802f84a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:41.648666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0] Write session: try to update token
2025-10-10T14:35:41.648682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:41.654661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:41.654682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:41.654686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:41.654689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:41.654700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601750593417489:9988]
2025-10-10T14:35:41.654708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601750593417489:9988]
2025-10-10T14:35:41.654712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601750593417489:9988]
2025-10-10T14:35:41.654763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:41.654773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.654773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:41.654776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:41.654780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:41.654785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:41.654919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:41.670697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId: src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:41.673586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:41.717195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601751375646049:7726]
2025-10-10T14:35:41.717493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1761, pipe: [1:7559601751375646049:7726]
2025-10-10T14:35:41.774031Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:41.774380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.774404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.774436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375646049:7726], now have 1 active actors on pipe
2025-10-10T14:35:41.777622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:41.778080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:41.778173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1762 reason: status is not ok: tablet will be restarted right now sessionId: src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0
2025-10-10T14:35:41.778519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:41.778528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0] Write session will restart in 0.008875s
2025-10-10T14:35:41.778549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0] Write session: Do CDS request
2025-10-10T14:35:41.778554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:41.778372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1762 sessionId: src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0 is DEAD
2025-10-10T14:35:41.778526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601751375646049:7726]
2025-10-10T14:35:41.778542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:41.788951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.789044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:41.789065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1763
2025-10-10T14:35:41.789253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.789315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:41.789328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:41.789353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:41.789881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1763 sessionId:  describe result for acl check
2025-10-10T14:35:41.789920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:41.789935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:41.789937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:41.789944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601751375646124:7248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:41.790543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601751375646124:7248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:41.789870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:41.793260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601751375646124:7248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:41.794324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:41.794602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:41.794622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:41.794635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:41.794694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:41.794738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601750593417605:9990]
2025-10-10T14:35:41.795366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:41.795710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:41.795753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:41.796069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:41.796132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.796138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.796139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.796140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.796141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.796143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.796144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.796145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.796147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.796148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.796150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.796151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.796152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.796158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.796171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.796175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.796179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.796184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.796188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.796192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.796196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.796200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.796204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.796208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.796211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.796215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.796223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.796231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.796239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.796245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.796236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601751375646124:7248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:41.796252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601751375646124:7248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:41.796255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601751375646124:7248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:41.796264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:41.796249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.796254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.796259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.796264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.796269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.796274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.796279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.796284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.796289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.796294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.796298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.796302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.796306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.796311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.796314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.796320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.796327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.796332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.796336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.796341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.796345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.796351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.796389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:41.798700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:41.799063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:41.799077Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:41.799079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:41.799083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:41.799090Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1762 [2:7559601750593417605:9990]
2025-10-10T14:35:41.799102Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:41.799128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:41.799135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.799140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.799142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.799161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:41.799170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:41.799183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:41.799244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.799251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.799255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.799257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:41.799321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:41.799337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.799354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.799374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.799392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:41.799415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375646053:2438], now have 1 active actors on pipe
2025-10-10T14:35:41.799423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375646157:7248], now have 1 active actors on pipe
2025-10-10T14:35:41.799431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601750593417600:9990]
2025-10-10T14:35:41.799433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601750593417600:9990]
2025-10-10T14:35:41.799435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601750593417600:9990]
2025-10-10T14:35:41.799448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:41.799460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:41.799467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:41.799471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:41.799473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:41.799480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:41.799483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:41.799446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1762
2025-10-10T14:35:41.799462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1762
2025-10-10T14:35:41.799525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.799534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.799549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601750593417600:9990]
2025-10-10T14:35:41.799556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:41.799570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:41.799599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64d1a2a2-34d8e166-382928d1-a4909532_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:41.799611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.799614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.799617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:41.799628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.799643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:41.799667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.799836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.799849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.799876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.799977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1763 partition: 0 MaxSeqNo: 40 sessionId: src_id|64d1a2a2-34d8e166-382928d1-a4909532_0
2025-10-10T14:35:41.800395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11fd34d2-fb2c035b-d99b18a7-473f2652_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|64d1a2a2-34d8e166-382928d1-a4909532_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:41.803045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d1a2a2-34d8e166-382928d1-a4909532_0] Write session: try to update token
2025-10-10T14:35:41.803064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d1a2a2-34d8e166-382928d1-a4909532_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:41.818656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:41.818677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:41.818680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:41.818685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:41.818696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601750593417600:9990]
2025-10-10T14:35:41.818700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601750593417600:9990]
2025-10-10T14:35:41.818704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601750593417600:9990]
2025-10-10T14:35:41.818748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:41.818753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:41.818756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:41.818756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:41.818764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.818767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:41.818912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:41.833471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId: src_id|64d1a2a2-34d8e166-382928d1-a4909532_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:41.836104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:41.878499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601751375646166:7726]
2025-10-10T14:35:41.879015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1762, pipe: [1:7559601751375646166:7726]
2025-10-10T14:35:41.932030Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:41.932459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.932477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.932502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375646166:7726], now have 1 active actors on pipe
2025-10-10T14:35:41.932813Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:41.932967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:41.932983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601751375646166:7726]
2025-10-10T14:35:41.933019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:41.933021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:41.933092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1763 reason: error at write: Disconnected sessionId: src_id|64d1a2a2-34d8e166-382928d1-a4909532_0
2025-10-10T14:35:41.933303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1763 sessionId: src_id|64d1a2a2-34d8e166-382928d1-a4909532_0 is DEAD
2025-10-10T14:35:41.933500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d1a2a2-34d8e166-382928d1-a4909532_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:41.933512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d1a2a2-34d8e166-382928d1-a4909532_0] Write session will restart in 0.007524s
2025-10-10T14:35:41.933552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d1a2a2-34d8e166-382928d1-a4909532_0] Write session: Do CDS request
2025-10-10T14:35:41.933558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d1a2a2-34d8e166-382928d1-a4909532_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:41.944687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:41.945872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64d1a2a2-34d8e166-382928d1-a4909532_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.945928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:41.945948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1764
2025-10-10T14:35:41.946117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:41.946152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:41.946158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:41.946161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:41.946797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1764 sessionId:  describe result for acl check
2025-10-10T14:35:41.946836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:41.946841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:41.946843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:41.946849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601751375646229:7240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:41.946858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:41.947456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601751375646229:7240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:41.947247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:41.947257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:41.947270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:41.947337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:41.947379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601750593417706:9994]
2025-10-10T14:35:41.948106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:41.949132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:41.949224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:41.949647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:41.949755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.949766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.949768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.949769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.949770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.949772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.949774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.949775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.949777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.949778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.949779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.949794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601751375646229:7240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:41.949781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.949783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.949791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.949804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.949809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.949813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.949817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.949822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.949826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.949831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.949835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.949853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.949857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.949861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.949869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.949878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.949888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:41.949895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.949902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:41.949907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.949913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:41.949918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.949925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:41.949930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.949935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:41.949940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.949945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:41.949950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.949956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:41.949961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.949967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:41.949974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.949989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:41.949995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.950001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:41.950013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.950020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.950025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.950031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.950042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.950048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.950094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:41.953291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:41.953647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:41.953663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:41.953666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:41.953674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:41.953680Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1763 [2:7559601750593417706:9994]
2025-10-10T14:35:41.953694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:41.953713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:41.953718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.953722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.953725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.953742Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:41.953750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:41.953758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:41.953819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.953822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.953823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.953826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:41.953928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:41.953936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.953948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:41.953960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:41.953992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:41.954015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375646167:2438], now have 1 active actors on pipe
2025-10-10T14:35:41.954023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601750593417700:9994]
2025-10-10T14:35:41.954026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601750593417700:9994]
2025-10-10T14:35:41.954028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601750593417700:9994]
2025-10-10T14:35:41.954044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:41.954060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:41.954069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:41.954072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:41.954074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:41.954083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:41.954086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:41.954118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601750593417700:9994]
2025-10-10T14:35:41.954127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:41.954077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1763
2025-10-10T14:35:41.954199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:41.954747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601751375646229:7240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:41.954762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601751375646229:7240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:41.954766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601751375646229:7240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:41.954775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:41.955008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601751375646264:7240], now have 1 active actors on pipe
2025-10-10T14:35:41.955068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1763
2025-10-10T14:35:41.955153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.955165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.955198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:41.955207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:41.955213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:41.955216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:41.955232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:41.955258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:41.955275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.955482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.955492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.955508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:41.955643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1764 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0
2025-10-10T14:35:41.956047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64d1a2a2-34d8e166-382928d1-a4909532_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:41.958847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0] Write session: try to update token
2025-10-10T14:35:41.958868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:41.971235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:41.971254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:41.971265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601750593417700:9994]
2025-10-10T14:35:41.971318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:41.971344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:41.971499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:41.971647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:41.971778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:41.971909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:41.972093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:41.972136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:41.976630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId: src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:41.979383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:41.979639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:41.979662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:41.979712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:41.979836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:41.993516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:41.993531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:41.993534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:41.993536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:41.993547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601750593417700:9994]
2025-10-10T14:35:41.993551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601750593417700:9994]
2025-10-10T14:35:41.993559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601750593417700:9994]
2025-10-10T14:35:41.993610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:41.993619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:41.993621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:41.993758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:41.995501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:41.995523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:41.995528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:42.033135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601755670613566:7726]
2025-10-10T14:35:42.033516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1763, pipe: [1:7559601755670613566:7726]
2025-10-10T14:35:42.110545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:42.119384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.119420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.119618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.119681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.119745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.119808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.119855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.119859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.119935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.120001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.120062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.120477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.120517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.120519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.120590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.120645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.120704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.120762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.121083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.121086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.121153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.121214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.121275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.121544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.121592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.121599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.121665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.121729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.121791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.121865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.121907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.121910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.121979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.122040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.122099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.122158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.122201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.122204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.122280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.122345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.122414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.122480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.122544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.122547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.122626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.122689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.122769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.122842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.122886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.122889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.122962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.123021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.123089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.123155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.123200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.123202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.123285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.123346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.123409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.123478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.123527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.123530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.123605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613566:7726], now have 1 active actors on pipe
2025-10-10T14:35:42.125673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:42.126192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:42.126270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1764 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0
2025-10-10T14:35:42.126471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1764 sessionId: src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0 is DEAD
2025-10-10T14:35:42.126608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:42.126647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601755670613566:7726]
2025-10-10T14:35:42.130935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:42.130948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0] Write session will restart in 0.008625s
2025-10-10T14:35:42.130974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0] Write session: Do CDS request
2025-10-10T14:35:42.130980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:42.139942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:42.140936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.141312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:42.141350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1765
2025-10-10T14:35:42.141472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.141503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:42.141508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:42.141513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:42.142090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1765 sessionId:  describe result for acl check
2025-10-10T14:35:42.142132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:42.142139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:42.142141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:42.142147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601755670613646:7228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:42.142724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601755670613646:7228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:42.144536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601755670613646:7228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:42.144477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:42.144721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:42.144728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:42.144745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:42.144825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:42.144868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601754888385134:10007]
2025-10-10T14:35:42.145494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:42.146200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:42.146258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:42.146581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:42.146644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.146646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.146647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.146648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.146649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.146651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.146652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.146653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.146655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.146656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.146657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.146658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.146659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.146665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.146677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.146681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.146686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.146689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.146693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.146697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.146701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.146704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.146708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.146712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.146716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.146720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.146728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.146737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.146744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.146749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.146753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.146759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.146763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.146768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.146773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.146778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.146783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.146788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.146793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.146801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.146806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.146811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.146815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.146820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.146825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.146830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.146836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.146841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.146846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.146851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.146856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.146861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.146900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:42.149824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601755670613646:7228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:42.149856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601755670613646:7228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:42.149860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601755670613646:7228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:42.149870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:42.150657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:42.151531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:42.151546Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:42.151549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:42.151553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:42.151561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1764 [2:7559601754888385134:10007]
2025-10-10T14:35:42.151577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:42.151596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:42.151599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.151603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.151606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.151625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:42.151633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:42.151640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:42.151715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.151718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.151720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.151724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:42.151809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:42.151814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.151828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.151842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.151861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:42.151885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613581:2438], now have 1 active actors on pipe
2025-10-10T14:35:42.151890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613675:7228], now have 1 active actors on pipe
2025-10-10T14:35:42.151897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601754888385129:10007]
2025-10-10T14:35:42.151899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601754888385129:10007]
2025-10-10T14:35:42.151902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601754888385129:10007]
2025-10-10T14:35:42.151922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:42.151949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:42.151970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:42.151974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:42.151995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:42.151999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:42.152001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:42.152013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601754888385129:10007]
2025-10-10T14:35:42.152019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:42.152020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:42.152218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1764
2025-10-10T14:35:42.152253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1764
2025-10-10T14:35:42.152392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.152403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.152445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:42.152453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.152457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.152460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:42.152470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.152480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:42.152496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.152725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.152732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.152748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.153043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1765 partition: 0 MaxSeqNo: 40 sessionId: src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0
2025-10-10T14:35:42.153494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f65af-8ba30fa0-61ca5617-886f3389_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:42.156256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0] Write session: try to update token
2025-10-10T14:35:42.156274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:42.164487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:42.164507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:42.164518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601754888385129:10007]
2025-10-10T14:35:42.164573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:42.164772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:42.164939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:42.165106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:42.165264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:42.165508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:42.165548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:42.165827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:42.184877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId: src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:42.186316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:42.186335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:42.186339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:42.186341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:42.186352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601754888385129:10007]
2025-10-10T14:35:42.186357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601754888385129:10007]
2025-10-10T14:35:42.186362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601754888385129:10007]
2025-10-10T14:35:42.186413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:42.186421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.186424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:42.186425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:42.186432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:42.186437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:42.186575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:42.187780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:42.226580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601755670613694:7726]
2025-10-10T14:35:42.227120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1764, pipe: [1:7559601755670613694:7726]
2025-10-10T14:35:42.300128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:42.300513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.300534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.300562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613694:7726], now have 1 active actors on pipe
2025-10-10T14:35:42.300842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:42.300908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601755670613694:7726]
2025-10-10T14:35:42.300927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:42.300930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:42.300991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1765 reason: error at write: Disconnected sessionId: src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0
2025-10-10T14:35:42.301206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1765 sessionId: src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0 is DEAD
2025-10-10T14:35:42.300803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:42.301600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:42.301611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0] Write session will restart in 0.005166s
2025-10-10T14:35:42.301637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0] Write session: Do CDS request
2025-10-10T14:35:42.301645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:42.307937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.309627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:42.309646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1766
2025-10-10T14:35:42.309905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.309966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:42.309980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:42.309985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:42.310521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1766 sessionId:  describe result for acl check
2025-10-10T14:35:42.310562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:42.310564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:42.310566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:42.310573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601755670613739:7220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:42.311166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601755670613739:7220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:42.314066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:42.314327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601755670613739:7220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:42.316038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:42.316275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:42.316288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:42.316301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:42.316358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:42.316402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601754888385242:10011]
2025-10-10T14:35:42.317036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:42.317366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:42.317414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:42.317748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:42.317803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.317805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.317806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.317807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.317808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.317810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.317811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.317813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.317814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.317815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.317817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.317818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.317819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.317825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.317851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.317855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.317860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.317864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.317869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.317873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.317876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.317881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.317886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.317890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.317894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.317899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.317906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.317916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.317923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.317930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.317935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.317941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.317945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.317950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.317955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.317961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.317965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.317971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.317976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.317981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.317985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.317991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.317995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.318001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.318005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.318011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.318015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.318022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.318026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.318032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.318038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.318043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.318084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:42.322152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601755670613739:7220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:42.322172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601755670613739:7220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:42.322176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601755670613739:7220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:42.322187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:42.323911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:42.324411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:42.324417Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:42.324421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:42.324425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:42.324433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1765 [2:7559601754888385242:10011]
2025-10-10T14:35:42.324450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:42.324474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:42.324483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.324487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.324489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.324511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:42.324520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:42.324531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:42.324612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.324614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.324617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.324619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:42.324720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:42.324723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.324737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.324748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.324764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:42.324789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601754888385237:10011]
2025-10-10T14:35:42.324792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601754888385237:10011]
2025-10-10T14:35:42.324795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601754888385237:10011]
2025-10-10T14:35:42.324821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:42.324840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:42.324857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:42.324861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:42.324880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:42.324885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:42.324887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:42.324909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601754888385237:10011]
2025-10-10T14:35:42.324917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:42.324984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:42.325460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1765
2025-10-10T14:35:42.325495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1765
2025-10-10T14:35:42.325862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613793:7220], now have 1 active actors on pipe
2025-10-10T14:35:42.325875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613697:2438], now have 1 active actors on pipe
2025-10-10T14:35:42.325891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.325898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.325935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f9b3c17-571825f8-5536a633-97897e0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:42.325946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.325952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.325954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:42.325972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.325988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:42.326009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.326696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.326710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.326737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.326904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1766 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f9b3c17-571825f8-5536a633-97897e0b_0
2025-10-10T14:35:42.327330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e66e3a3a-487b7fe2-7b24b43-7198da53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f9b3c17-571825f8-5536a633-97897e0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:42.330265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9b3c17-571825f8-5536a633-97897e0b_0] Write session: try to update token
2025-10-10T14:35:42.330288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9b3c17-571825f8-5536a633-97897e0b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:42.352142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:42.352161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:42.352166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:42.352168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:42.352181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601754888385237:10011]
2025-10-10T14:35:42.352186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601754888385237:10011]
2025-10-10T14:35:42.352189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601754888385237:10011]
2025-10-10T14:35:42.352248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:42.352263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.352266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:42.352421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:42.353446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:42.353466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:42.353473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:42.355131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId: src_id|8f9b3c17-571825f8-5536a633-97897e0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:42.358076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:42.402710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601755670613801:7726]
2025-10-10T14:35:42.403024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1765, pipe: [1:7559601755670613801:7726]
2025-10-10T14:35:42.467081Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:42.467475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.467512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.467566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613801:7726], now have 1 active actors on pipe
2025-10-10T14:35:42.467824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:42.468405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9b3c17-571825f8-5536a633-97897e0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:42.468417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9b3c17-571825f8-5536a633-97897e0b_0] Write session will restart in 0.007198s
2025-10-10T14:35:42.468442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9b3c17-571825f8-5536a633-97897e0b_0] Write session: Do CDS request
2025-10-10T14:35:42.468449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9b3c17-571825f8-5536a633-97897e0b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:42.467872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:42.467901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:42.467935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:42.467972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1766 reason: error at write: Disconnected sessionId: src_id|8f9b3c17-571825f8-5536a633-97897e0b_0
2025-10-10T14:35:42.467981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601755670613801:7726]
2025-10-10T14:35:42.468217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1766 sessionId: src_id|8f9b3c17-571825f8-5536a633-97897e0b_0 is DEAD
2025-10-10T14:35:42.476885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9b3c17-571825f8-5536a633-97897e0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.477070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:42.477087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1767
2025-10-10T14:35:42.477217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.477252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:42.477263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:42.477267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:42.477680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1767 sessionId:  describe result for acl check
2025-10-10T14:35:42.477722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:42.477730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:42.477732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:42.477739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601755670613867:7205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:42.478344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601755670613867:7205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:42.480510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601755670613867:7205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:42.477435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:42.479006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:42.479200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:42.479205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:42.479217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:42.479274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:42.479309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601754888385343:10013]
2025-10-10T14:35:42.479856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:42.480136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:42.480178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:42.480484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:42.480526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.480527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.480528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.480529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.480530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.480532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.480533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.480534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.480535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.480536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.480537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.480538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.480539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.480544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.480557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.480560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.480563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.480567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.480570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.480574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.480577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.480581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.480584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.480588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.480591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.480594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.480600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.480608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.480614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.480619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.480623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.480628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.480631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.480636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.480640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.480645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.480648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.480653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.480657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.480661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.480665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.480670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.480674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.480691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.480696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.480701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.480706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.480710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.480714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.480718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.480722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.480727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.480760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:42.483275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:42.483352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601755670613867:7205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:42.483368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601755670613867:7205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:42.483372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601755670613867:7205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:42.483380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:42.483862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:42.483876Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:42.483878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:42.483883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:42.483889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1766 [2:7559601754888385343:10013]
2025-10-10T14:35:42.483903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:42.483922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:42.483931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.483934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.483937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.483956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:42.483969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:42.483976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:42.484049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.484056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.484058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.484062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:42.484124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:42.484132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.484143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.484159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.484180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:42.484202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613803:2438], now have 1 active actors on pipe
2025-10-10T14:35:42.484214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1766
2025-10-10T14:35:42.484214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601754888385338:10013]
2025-10-10T14:35:42.484216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601754888385338:10013]
2025-10-10T14:35:42.484218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601754888385338:10013]
2025-10-10T14:35:42.484234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:42.484246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:42.484248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:42.484249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:42.484250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:42.484263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:42.484268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:42.484302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601754888385338:10013]
2025-10-10T14:35:42.484311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:42.484323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613901:7205], now have 1 active actors on pipe
2025-10-10T14:35:42.484334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:42.484364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1766
2025-10-10T14:35:42.484435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.484447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.484487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:42.484501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.484505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.484508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:42.484520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.484547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:42.484566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.484791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.484801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.484817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.484905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1767 partition: 0 MaxSeqNo: 40 sessionId: src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0
2025-10-10T14:35:42.485250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f9b3c17-571825f8-5536a633-97897e0b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:42.487877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0] Write session: try to update token
2025-10-10T14:35:42.487895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:42.506935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:42.506956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:42.506960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:42.506962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:42.506973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601754888385338:10013]
2025-10-10T14:35:42.506977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601754888385338:10013]
2025-10-10T14:35:42.506981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601754888385338:10013]
2025-10-10T14:35:42.507024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:42.507029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:42.507030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:42.507033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:42.507038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.507040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:42.507193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:42.514760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId: src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:42.517509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:42.569918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601755670613908:7726]
2025-10-10T14:35:42.571362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1766, pipe: [1:7559601755670613908:7726]
2025-10-10T14:35:42.621169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:42.621542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.621561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.621586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613908:7726], now have 1 active actors on pipe
2025-10-10T14:35:42.621846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:42.621865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601755670613908:7726]
2025-10-10T14:35:42.621900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:42.621940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:42.621943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:42.622024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1767 reason: error at write: Disconnected sessionId: src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0
2025-10-10T14:35:42.622228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1767 sessionId: src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0 is DEAD
2025-10-10T14:35:42.622453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:42.622465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0] Write session will restart in 0.005551s
2025-10-10T14:35:42.622489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0] Write session: Do CDS request
2025-10-10T14:35:42.622495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:42.628908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.629009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:42.629030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1768
2025-10-10T14:35:42.629180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.629217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:42.629224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:42.629228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:42.629895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1768 sessionId:  describe result for acl check
2025-10-10T14:35:42.629956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:42.629963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:42.629965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:42.629973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601755670613943:7213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:42.630571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601755670613943:7213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:42.632367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:42.632672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601755670613943:7213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:42.634306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:42.634531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:42.634544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:42.634557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:42.634612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:42.634661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601754888385447:10015]
2025-10-10T14:35:42.635248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:42.635436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601755670613943:7213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:42.635457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601755670613943:7213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:42.635461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601755670613943:7213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:42.635470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:42.635633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:42.635683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:42.635991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:42.636092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.636098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.636099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.636100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.636101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.636103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.636104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.636105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.636106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.636107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.636108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.636110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.636111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.636118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.636131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.636135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.636139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.636143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.636147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.636151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.636155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.636159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.636164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.636168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.636171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.636175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.636184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.636192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.636198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.636203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.636207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.636212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.636217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.636222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.636227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.636232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.636236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.636241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.636246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.636251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.636255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.636266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.636274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.636283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.636290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.636295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.636299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.636304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.636309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.636314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.636319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.636331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.636370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:42.642582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:42.642956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:42.642974Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:42.642976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:42.642981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:42.642988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1767 [2:7559601754888385447:10015]
2025-10-10T14:35:42.643004Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:42.643030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:42.643039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.643042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.643046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.643065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:42.643078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:42.643091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:42.643160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.643167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.643169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.643172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:42.643247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:42.643255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.643267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.643278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.643298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:42.643322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670614007:7213], now have 1 active actors on pipe
2025-10-10T14:35:42.643326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670613909:2438], now have 1 active actors on pipe
2025-10-10T14:35:42.643334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601754888385441:10015]
2025-10-10T14:35:42.643342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601754888385441:10015]
2025-10-10T14:35:42.643345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601754888385441:10015]
2025-10-10T14:35:42.643358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:42.643377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:42.643381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:42.643384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:42.643387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:42.643400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:42.643404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:42.643440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601754888385441:10015]
2025-10-10T14:35:42.643406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1767
2025-10-10T14:35:42.643454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:42.643446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1767
2025-10-10T14:35:42.643479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:42.643624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.643633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.643669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:42.643682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.643691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.643694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:42.643708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.643719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:42.643740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.643913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.643922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.643936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.644018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1768 partition: 0 MaxSeqNo: 40 sessionId: src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0
2025-10-10T14:35:42.644430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d13a0ec-ab1292e2-86bfdaff-cef6b37d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:42.647206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0] Write session: try to update token
2025-10-10T14:35:42.647229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:42.655041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:42.655064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:42.655077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601754888385441:10015]
2025-10-10T14:35:42.655120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:42.655125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:42.655303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:42.655453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:42.655596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:42.655745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:42.655950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:42.655995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:42.666970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId: src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:42.669721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:42.669978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.670007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.670051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:42.670971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:42.681164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:42.681188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:42.681191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:42.681194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:42.681206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601754888385441:10015]
2025-10-10T14:35:42.681211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601754888385441:10015]
2025-10-10T14:35:42.681215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601754888385441:10015]
2025-10-10T14:35:42.681266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:42.681278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.681280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:42.681300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:42.681307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:42.681311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:42.681457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:42.722259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601755670614021:7726]
2025-10-10T14:35:42.722686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1767, pipe: [1:7559601755670614021:7726]
2025-10-10T14:35:42.812134Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:42.819998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.820035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.820217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.820282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.820348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.820416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.820466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.820475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.820545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.820607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.820678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.820755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.820800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.820807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.820874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.820935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.820999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.821062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.821105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.821111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.821177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.821241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.821307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.821392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.821436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.821444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.821509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.821570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.821635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.821694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.821737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.821744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.821813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.821880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.821941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.822004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.823692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601755670614021:7726]
2025-10-10T14:35:42.823701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:42.823746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:42.823749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:42.823782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1768 reason: error at write: Disconnected sessionId: src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0
2025-10-10T14:35:42.824030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1768 sessionId: src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0 is DEAD
2025-10-10T14:35:42.824212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:42.824223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0] Write session will restart in 0.007542s
2025-10-10T14:35:42.824259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0] Write session: Do CDS request
2025-10-10T14:35:42.824265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:42.822048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.822062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.822126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.822179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.822242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.822300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.822344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.822348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.822419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.822472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.822532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.822589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.822627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.822632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.822702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.822758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.822814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.822870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.822914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.822917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.822983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:42.823036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:42.823094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:42.823156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:42.823195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:42.823197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:42.823265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670614021:7726], now have 1 active actors on pipe
2025-10-10T14:35:42.824262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:42.832937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.832973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:42.832990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1769
2025-10-10T14:35:42.833192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.833234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:42.833245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:42.833249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:42.833622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:42.833717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1769 sessionId:  describe result for acl check
2025-10-10T14:35:42.833767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:42.833775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:42.833777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:42.833785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601755670614104:7203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:42.834395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601755670614104:7203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:42.834981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:42.835190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:42.835200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:42.835211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:42.835263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:42.835307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601754888385565:10018]
2025-10-10T14:35:42.835903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:42.836448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601755670614104:7203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:42.837010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:42.837065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:42.837430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:42.837496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.837503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.837504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.837505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.837506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.837508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.837509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.837510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.837512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.837513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.837514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.837516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.837517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.837523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.837536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.837540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.837544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.837548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.837552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.837556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.837560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.837564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.837568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.837572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.837581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.837585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.837593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.837601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.837612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.837618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.837622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.837627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.837636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.837641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.837646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.837655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.837659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.837668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.837674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.837683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.837687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.837693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.837697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.837702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.837706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.837716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.837721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.837730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.837735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.837740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.837749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.837754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.837795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:42.840196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:42.840229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601755670614104:7203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:42.840248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601755670614104:7203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:42.840252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601755670614104:7203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:42.840260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:42.840563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:42.840575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:42.840578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:42.840581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:42.840588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1768 [2:7559601754888385565:10018]
2025-10-10T14:35:42.840600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:42.840616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:42.840624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.840627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.840629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.840647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:42.840654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:42.840662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:42.840725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.840732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.840734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.840737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:42.840805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:42.840815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.840828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.840840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.840857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:42.840885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670614039:2438], now have 1 active actors on pipe
2025-10-10T14:35:42.840893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670614138:7203], now have 1 active actors on pipe
2025-10-10T14:35:42.840879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1768
2025-10-10T14:35:42.840900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601754888385560:10018]
2025-10-10T14:35:42.840910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601754888385560:10018]
2025-10-10T14:35:42.840912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601754888385560:10018]
2025-10-10T14:35:42.840925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:42.840938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:42.840940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1768
2025-10-10T14:35:42.840947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:42.840951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:42.840953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:42.840959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:42.840962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:42.840994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601754888385560:10018]
2025-10-10T14:35:42.841002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:42.841015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:42.841016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.841021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.841064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2166176-e2195c6c-805029a7-50a67da8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:42.841077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.841081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.841088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:42.841099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.841114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:42.841135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.841258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.841268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.841283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.841361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1769 partition: 0 MaxSeqNo: 40 sessionId: src_id|c2166176-e2195c6c-805029a7-50a67da8_0
2025-10-10T14:35:42.841780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea1c75a-c82c08c9-433ff4a2-32d58c67_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c2166176-e2195c6c-805029a7-50a67da8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:42.844585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166176-e2195c6c-805029a7-50a67da8_0] Write session: try to update token
2025-10-10T14:35:42.844602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166176-e2195c6c-805029a7-50a67da8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:42.858582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId: src_id|c2166176-e2195c6c-805029a7-50a67da8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:42.861242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:42.861387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:42.861403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:42.861407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:42.861409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:42.861419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601754888385560:10018]
2025-10-10T14:35:42.861424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601754888385560:10018]
2025-10-10T14:35:42.861428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601754888385560:10018]
2025-10-10T14:35:42.861474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:42.861479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:42.861484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:42.861489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.861499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.861522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:42.861536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.861539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:42.861671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:42.923963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601755670614146:7726]
2025-10-10T14:35:42.924302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1768, pipe: [1:7559601755670614146:7726]
2025-10-10T14:35:42.974915Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:42.975329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670614146:7726], now have 1 active actors on pipe
2025-10-10T14:35:42.975576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:42.976039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166176-e2195c6c-805029a7-50a67da8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:42.976048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166176-e2195c6c-805029a7-50a67da8_0] Write session will restart in 0.006631s
2025-10-10T14:35:42.976073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166176-e2195c6c-805029a7-50a67da8_0] Write session: Do CDS request
2025-10-10T14:35:42.976079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166176-e2195c6c-805029a7-50a67da8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:42.975564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:42.975626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:42.975629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:42.975706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1769 reason: error at write: Disconnected sessionId: src_id|c2166176-e2195c6c-805029a7-50a67da8_0
2025-10-10T14:35:42.975908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1769 sessionId: src_id|c2166176-e2195c6c-805029a7-50a67da8_0 is DEAD
2025-10-10T14:35:42.976081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601755670614146:7726]
2025-10-10T14:35:42.984197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166176-e2195c6c-805029a7-50a67da8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.984278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:42.984297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1770
2025-10-10T14:35:42.984411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:42.984463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:42.984473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:42.984477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:42.984912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1770 sessionId:  describe result for acl check
2025-10-10T14:35:42.984956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:42.984964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:42.984966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:42.984972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601755670614213:7197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:42.985568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601755670614213:7197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:42.985730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:42.987944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:42.988171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:42.988183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:42.988196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:42.988249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:42.988289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601754888385670:10021]
2025-10-10T14:35:42.988877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:42.988735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601755670614213:7197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:42.989252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:42.989295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:42.989635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:42.989689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.989696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.989697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.989698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.989699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.989701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.989702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.989703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.989704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.989705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.989706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.989707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.989708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.989714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.989725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.989729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.989733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.989737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.989740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.989743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.989747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.989750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.989754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.989758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.989761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.989765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.989771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.989778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:42.989784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.989789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:42.989793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.989798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:42.989802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.989806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:42.989822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.989826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:42.989830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.989835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:42.989839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.989843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:42.989848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.989853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:42.989857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.989861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:42.989865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.989869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:42.989873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.989877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.989881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.989885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.989889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.989893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.989928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:42.992293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:42.992632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:42.992643Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:42.992645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:42.992649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:42.992656Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1769 [2:7559601754888385670:10021]
2025-10-10T14:35:42.992667Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:42.992679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601755670614213:7197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:42.992696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601755670614213:7197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:42.992700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601755670614213:7197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:42.992709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:42.992685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:42.992692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.992695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.992697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.992715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:42.992725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:42.992732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:42.992787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.992794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.992796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.992798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:42.992863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:42.992870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:42.992883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:42.992893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:42.992909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:42.992929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601754888385664:10021]
2025-10-10T14:35:42.992931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601754888385664:10021]
2025-10-10T14:35:42.992933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601754888385664:10021]
2025-10-10T14:35:42.992941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:42.992945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:42.992948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:42.992950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:42.992958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670614148:2438], now have 1 active actors on pipe
2025-10-10T14:35:42.992963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:42.992978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:42.992981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:42.992986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601755670614249:7197], now have 1 active actors on pipe
2025-10-10T14:35:42.993007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601754888385664:10021]
2025-10-10T14:35:42.993013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:42.993031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1769
2025-10-10T14:35:42.993035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1769
2025-10-10T14:35:42.993112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:42.993133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.993138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.993165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:42.993173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:42.993176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:42.993179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:42.993190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:42.993201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:42.993222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.993384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:42.993392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:42.993409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:42.993493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1770 partition: 0 MaxSeqNo: 40 sessionId: src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0
2025-10-10T14:35:42.993877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166176-e2195c6c-805029a7-50a67da8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:42.996531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0] Write session: try to update token
2025-10-10T14:35:42.996548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:43.011002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId: src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:43.012256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:43.012275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.012278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:43.012280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:43.012290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601754888385664:10021]
2025-10-10T14:35:43.012294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601754888385664:10021]
2025-10-10T14:35:43.012298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601754888385664:10021]
2025-10-10T14:35:43.012347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:43.012351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:43.012360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.012362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:43.012368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:43.012383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:43.012518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:43.013708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:43.076824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601759965581552:7726]
2025-10-10T14:35:43.077254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1769, pipe: [1:7559601759965581552:7726]
2025-10-10T14:35:43.125325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:43.125751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.125769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.126115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601759965581552:7726]
2025-10-10T14:35:43.126153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:43.126191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:43.126194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:43.126252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1770 reason: error at write: Disconnected sessionId: src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0
2025-10-10T14:35:43.125829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581552:7726], now have 1 active actors on pipe
2025-10-10T14:35:43.126336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:43.126652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:43.126452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1770 sessionId: src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0 is DEAD
2025-10-10T14:35:43.126702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0] Write session will restart in 0.007434s
2025-10-10T14:35:43.126730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0] Write session: Do CDS request
2025-10-10T14:35:43.126735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:43.136181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.136256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:43.136284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1771
2025-10-10T14:35:43.136457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.136494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:43.136505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:43.136509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:43.136949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1771 sessionId:  describe result for acl check
2025-10-10T14:35:43.136989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:43.136995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:43.136997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:43.137004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601759965581621:7193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:43.137318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:43.137603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601759965581621:7193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:43.139176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:43.139415Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:43.139428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:43.139440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:43.139499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:43.139542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601759183353085:10029]
2025-10-10T14:35:43.140071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601759965581621:7193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:43.140140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:43.140435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:43.140487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:43.140843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:43.140941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.140949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.140950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.140951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.140952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.140954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.140955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.140956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.140958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.140959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.140961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.140962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.140964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.140971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.140983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.140987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.140991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.140996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.141000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.141004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.141008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.141012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.141016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.141020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.141024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.141028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.141037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.141045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.141052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.141058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.141062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.141067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.141071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.141076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.141081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.141086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.141090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.141094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.141099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.141104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.141108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.141115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.141120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.141125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.141129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.141134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.141138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.141142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.141146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.141150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.141154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.141159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.141194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:43.143586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601759965581621:7193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:43.143604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601759965581621:7193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:43.143608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601759965581621:7193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:43.143616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:43.143721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:43.144085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:43.144098Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:43.144100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:43.144105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:43.144112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1770 [2:7559601759183353085:10029]
2025-10-10T14:35:43.144126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:43.144146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:43.144154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.144158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.144161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.144179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:43.144190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:43.144202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:43.144264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.144271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.144273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.144275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:43.144343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:43.144351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.144363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.144374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.144401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:43.144424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581656:7193], now have 1 active actors on pipe
2025-10-10T14:35:43.144432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581553:2438], now have 1 active actors on pipe
2025-10-10T14:35:43.144440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601759183353079:10029]
2025-10-10T14:35:43.144442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601759183353079:10029]
2025-10-10T14:35:43.144446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601759183353079:10029]
2025-10-10T14:35:43.144459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:43.144468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:43.144470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:43.144472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:43.144479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:43.144493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1770
2025-10-10T14:35:43.144504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1770
2025-10-10T14:35:43.144494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:43.144504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:43.144520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.144526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.144563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601759183353079:10029]
2025-10-10T14:35:43.144570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:43.144578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:43.144593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:43.144607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.144615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.144618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:43.144630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.144644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:43.144685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.144856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.144865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.144881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.144994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1771 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0
2025-10-10T14:35:43.145413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd80d18-3ef78f11-34f3e2a3-2bb0945_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:43.148197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0] Write session: try to update token
2025-10-10T14:35:43.148219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:43.166060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:43.166083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.166087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:43.166089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:43.166098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601759183353079:10029]
2025-10-10T14:35:43.166103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601759183353079:10029]
2025-10-10T14:35:43.166108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601759183353079:10029]
2025-10-10T14:35:43.166159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:43.166167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.166169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:43.166171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:43.166179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:43.166184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:43.166334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:43.170786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId: src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:43.173479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:43.225982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601759965581681:7726]
2025-10-10T14:35:43.226319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1770, pipe: [1:7559601759965581681:7726]
2025-10-10T14:35:43.280187Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:43.280574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.280592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.280643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581681:7726], now have 1 active actors on pipe
2025-10-10T14:35:43.280904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:43.281006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:43.281023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:43.281083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1771 reason: error at write: Disconnected sessionId: src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0
2025-10-10T14:35:43.281292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1771 sessionId: src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0 is DEAD
2025-10-10T14:35:43.281393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601759965581681:7726]
2025-10-10T14:35:43.281416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:43.281745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:43.281757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0] Write session will restart in 0.005756s
2025-10-10T14:35:43.281780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0] Write session: Do CDS request
2025-10-10T14:35:43.281790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:43.289021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.289082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:43.289100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1772
2025-10-10T14:35:43.289694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.289759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:43.289771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:43.289776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:43.290268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1772 sessionId:  describe result for acl check
2025-10-10T14:35:43.290306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:43.290308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:43.290313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:43.290318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601759965581698:7181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:43.290904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601759965581698:7181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:43.293552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601759965581698:7181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:43.296589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601759965581698:7181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:43.296606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601759965581698:7181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:43.296609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601759965581698:7181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:43.296618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:43.296990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:43.298458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:43.298687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:43.298701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:43.298713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:43.298769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:43.298814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601759183353217:10038]
2025-10-10T14:35:43.299447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:43.299834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:43.299892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:43.300237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:43.300298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.300300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.300301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.300303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.300304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.300306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.300307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.300308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.300310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.300311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.300312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.300313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.300315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.300321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.300336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.300341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.300345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.300349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.300353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.300358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.300362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.300366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.300371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.300375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.300379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.300383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.300394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.300403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.300410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.300416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.300421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.300427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.300432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.300437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.300443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.300449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.300453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.300459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.300464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.300469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.300474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.300479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.300485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.300490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.300495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.300499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.300503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.300508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.300514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.300519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.300524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.300529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.300572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:43.303024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:43.303421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:43.303434Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:43.303436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:43.303440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:43.303446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1771 [2:7559601759183353217:10038]
2025-10-10T14:35:43.303460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:43.303487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:43.303498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.303501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.303503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.303521Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:43.303528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:43.303536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:43.303593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.303600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.303604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.303606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:43.303673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:43.303687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.303699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.303716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.303742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:43.303768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581786:7181], now have 1 active actors on pipe
2025-10-10T14:35:43.303777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581689:2438], now have 1 active actors on pipe
2025-10-10T14:35:43.303785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601759183353212:10038]
2025-10-10T14:35:43.303787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601759183353212:10038]
2025-10-10T14:35:43.303788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601759183353212:10038]
2025-10-10T14:35:43.303802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:43.303816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:43.303837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:43.303844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:43.303844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:43.303848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:43.303850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:43.303871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601759183353212:10038]
2025-10-10T14:35:43.303878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:43.303880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:43.303864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1771
2025-10-10T14:35:43.303897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1771
2025-10-10T14:35:43.304023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.304034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.304069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:43.304081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.304089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.304092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:43.304103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.304115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:43.304136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.304345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.304356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.304372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.304452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1772 partition: 0 MaxSeqNo: 40 sessionId: src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0
2025-10-10T14:35:43.304841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac0dc57c-3dc7a842-97938085-4f6ca6d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:43.307754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0] Write session: try to update token
2025-10-10T14:35:43.307776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:43.324611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId: src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:43.327728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:43.327950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.327976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.329879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:43.329904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.329907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:43.329914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:43.329923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601759183353212:10038]
2025-10-10T14:35:43.329928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601759183353212:10038]
2025-10-10T14:35:43.329932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601759183353212:10038]
2025-10-10T14:35:43.329982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:43.329985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:43.329996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:43.330003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:43.330004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:43.330011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.330014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:43.330113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:43.330154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:43.380676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601759965581800:7726]
2025-10-10T14:35:43.381062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1771, pipe: [1:7559601759965581800:7726]
2025-10-10T14:35:43.444316Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:43.452146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.452178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.452357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.452425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.452489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.452556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.452605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.452620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.452696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.452756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.452824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.452890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.452934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.452937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.453007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.453061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.453120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.453184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.453224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.453227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.453300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.453463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.453530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.453596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.453644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.453651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.453721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.453782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.453858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.453925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.453969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.453976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.454046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.454108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.454178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.454243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.454294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.454301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.454370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.454434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.454509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.454573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.454617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.454624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.454694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.454760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.454821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.454882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.454932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.454943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.455008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.455068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.455130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.455204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.455247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.455261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.455327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.455391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.455454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.455517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.455565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.455573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.455636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581800:7726], now have 1 active actors on pipe
2025-10-10T14:35:43.456343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:43.456358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0] Write session will restart in 0.006922s
2025-10-10T14:35:43.456384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0] Write session: Do CDS request
2025-10-10T14:35:43.456390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:43.456769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:43.455870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:43.455889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:43.455887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601759965581800:7726]
2025-10-10T14:35:43.455921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1772 reason: error at write: Disconnected sessionId: src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0
2025-10-10T14:35:43.456071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:43.456153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1772 sessionId: src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0 is DEAD
2025-10-10T14:35:43.464982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.465044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:43.465063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1773
2025-10-10T14:35:43.465239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.465285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:43.465291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:43.465295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:43.465735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1773 sessionId:  describe result for acl check
2025-10-10T14:35:43.465772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:43.465781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:43.465783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:43.465790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601759965581869:7176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:43.466340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601759965581869:7176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:43.467504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:43.468894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:43.469096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:43.469108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:43.469119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:43.469174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:43.469225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601759183353325:10040]
2025-10-10T14:35:43.469667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601759965581869:7176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:43.469835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:43.470189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:43.470252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:43.470569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:43.470621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.470626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.470628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.470628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.470630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.470631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.470632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.470633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.470634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.470636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.470637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.470638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.470639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.470645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.470657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.470661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.470665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.470668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.470672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.470676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.470679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.470683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.470687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.470690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.470694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.470698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.470704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.470713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.470719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.470724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.470728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.470733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.470737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.470742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.470746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.470751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.470755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.470760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.470765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.470769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.470773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.470779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.470783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.470788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.470792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.470798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.470803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.470808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.470812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.470817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.470821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.470826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.470862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:43.473152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601759965581869:7176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:43.473169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601759965581869:7176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:43.473172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601759965581869:7176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:43.473180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:43.473246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:43.473617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:43.473633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:43.473635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:43.473639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:43.473645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1772 [2:7559601759183353325:10040]
2025-10-10T14:35:43.473658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:43.473680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:43.473687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.473692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.473694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.473712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:43.473724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:43.473736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:43.473809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.473816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.473818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.473821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:43.473892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:43.473905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.473918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.473930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.473950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:43.473972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581907:7176], now have 1 active actors on pipe
2025-10-10T14:35:43.473984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581801:2438], now have 1 active actors on pipe
2025-10-10T14:35:43.473991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601759183353319:10040]
2025-10-10T14:35:43.473993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601759183353319:10040]
2025-10-10T14:35:43.473996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601759183353319:10040]
2025-10-10T14:35:43.474009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:43.474022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:43.474029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:43.474033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:43.474035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:43.474016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1772
2025-10-10T14:35:43.474046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:43.474049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:43.474017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1772
2025-10-10T14:35:43.474078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601759183353319:10040]
2025-10-10T14:35:43.474087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:43.474089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:43.474103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.474107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.474159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:43.474171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.474175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.474179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:43.474192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.474206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:43.474229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.474380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.474388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.474404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.474490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1773 partition: 0 MaxSeqNo: 40 sessionId: src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0
2025-10-10T14:35:43.474909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae1e21d9-15d3b16c-b5279919-64e906a7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:43.477549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0] Write session: try to update token
2025-10-10T14:35:43.477572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:43.493028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId: src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:43.493935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:43.493956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.493960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:43.493962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:43.493974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601759183353319:10040]
2025-10-10T14:35:43.493978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601759183353319:10040]
2025-10-10T14:35:43.493982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601759183353319:10040]
2025-10-10T14:35:43.494032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:43.494036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:43.494044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.494045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:43.494047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:43.494052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:43.494192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:43.495794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:43.556312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601759965581914:7726]
2025-10-10T14:35:43.556757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1772, pipe: [1:7559601759965581914:7726]
2025-10-10T14:35:43.607839Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:43.608152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.608172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.608220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581914:7726], now have 1 active actors on pipe
2025-10-10T14:35:43.608471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:43.608935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:43.608947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0] Write session will restart in 0.005552s
2025-10-10T14:35:43.608981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0] Write session: Do CDS request
2025-10-10T14:35:43.608987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:43.608463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:43.608466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:43.608481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:43.608522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601759965581914:7726]
2025-10-10T14:35:43.608556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1773 reason: error at write: Disconnected sessionId: src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0
2025-10-10T14:35:43.608768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1773 sessionId: src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0 is DEAD
2025-10-10T14:35:43.615939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.616048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:43.616067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1774
2025-10-10T14:35:43.616276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.616316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:43.616327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:43.616331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:43.616780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1774 sessionId:  describe result for acl check
2025-10-10T14:35:43.616822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:43.616829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:43.616831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:43.616838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601759965581969:7167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:43.617468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601759965581969:7167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:43.619723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601759965581969:7167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:43.620232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:43.622155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:43.622634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601759965581969:7167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:43.622649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601759965581969:7167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:43.622653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601759965581969:7167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:43.622664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:43.622413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:43.622427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:43.622439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:43.622494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:43.622535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601759183353433:10042]
2025-10-10T14:35:43.623169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:43.623484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:43.623535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:43.623918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:43.623976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.623983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.623984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.623986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.623987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.623988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.623989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.623990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.623992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.623992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.623993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.623994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.623996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.624001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.624014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.624019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.624023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.624026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.624030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.624034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.624038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.624042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.624047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.624052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.624057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.624061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.624069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.624078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.624086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.624092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.624098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.624104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.624110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.624116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.624122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.624127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.624137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.624143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.624148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.624154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.624158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.624164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.624173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.624179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.624184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.624189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.624194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.624200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.624205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.624211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.624215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.624222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.624272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:43.626876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:43.627366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:43.627380Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:43.627383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:43.627387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:43.627394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1773 [2:7559601759183353433:10042]
2025-10-10T14:35:43.627407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:43.627428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:43.627436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.627440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.627442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.627458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:43.627470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:43.627478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:43.627537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.627544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.627547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.627550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:43.627617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:43.627625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.627638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.627656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.627679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:43.627705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965581915:2438], now have 1 active actors on pipe
2025-10-10T14:35:43.627714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965582015:7167], now have 1 active actors on pipe
2025-10-10T14:35:43.627722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601759183353427:10042]
2025-10-10T14:35:43.627724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601759183353427:10042]
2025-10-10T14:35:43.627726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601759183353427:10042]
2025-10-10T14:35:43.627742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:43.627757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:43.627761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:43.627769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:43.627772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:43.627779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:43.627783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:43.627761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1773
2025-10-10T14:35:43.627778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1773
2025-10-10T14:35:43.627807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601759183353427:10042]
2025-10-10T14:35:43.627815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:43.627817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:43.627844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.627854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.627889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:43.627901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.627910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.627913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:43.627924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.627939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:43.627963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.628190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.628201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.628219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.628358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1774 partition: 0 MaxSeqNo: 40 sessionId: src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0
2025-10-10T14:35:43.629808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4adb54a6-7cae1023-12a9f02d-85c988f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:43.632434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0] Write session: try to update token
2025-10-10T14:35:43.632451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:43.650744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:43.650770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.650774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:43.650779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:43.650791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601759183353427:10042]
2025-10-10T14:35:43.650795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601759183353427:10042]
2025-10-10T14:35:43.650799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601759183353427:10042]
2025-10-10T14:35:43.650851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:43.650853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:43.650860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:43.650864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:43.650864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.650867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:43.651018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:43.653623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId: src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:43.656449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:43.709430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601759965582033:7726]
2025-10-10T14:35:43.709823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1773, pipe: [1:7559601759965582033:7726]
2025-10-10T14:35:43.768096Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:43.768438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.768462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.768529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965582033:7726], now have 1 active actors on pipe
2025-10-10T14:35:43.768770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:43.768850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:43.768921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601759965582033:7726]
2025-10-10T14:35:43.768947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:43.769022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1774 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0
2025-10-10T14:35:43.769206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1774 sessionId: src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0 is DEAD
2025-10-10T14:35:43.769396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:43.769410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0] Write session will restart in 0.009353s
2025-10-10T14:35:43.769435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0] Write session: Do CDS request
2025-10-10T14:35:43.769441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:43.779114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:43.779956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.780095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:43.780122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1775
2025-10-10T14:35:43.780245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.780562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:43.780786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:43.780800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:43.780814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:43.780880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:43.780942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601759183353543:10044]
2025-10-10T14:35:43.780292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:43.780303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:43.780307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:43.780701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1775 sessionId:  describe result for acl check
2025-10-10T14:35:43.780738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:43.781574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:43.780739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:43.780741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:43.780747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601759965582109:7155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:43.781349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601759965582109:7155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:43.781917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:43.781972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:43.782279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:43.782347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.782355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.782356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.782357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.782359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.782360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.782361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.782363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.782364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.782366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.782367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.782368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.782369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.782376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.782388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.782393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.782398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.782402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.782406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.782410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.782414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.782418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.782424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.782428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.782432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.782436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.782443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.782452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.782459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.782465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.782470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.782476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.782480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.782486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.782491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.782497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.782501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.782507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.782512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.782517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.782522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.782527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.782534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.782541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.782546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.782551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.782555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.782561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.782565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.782570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.782575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.782580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.782621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:43.783476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601759965582109:7155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:43.784922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:43.785351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:43.785366Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:43.785369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:43.785374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:43.785380Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1774 [2:7559601759183353543:10044]
2025-10-10T14:35:43.785393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:43.785410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:43.785418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.785423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.785426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.785442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:43.785455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:43.785463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:43.785521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.785540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.785542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.785544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:43.785769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1774
2025-10-10T14:35:43.785781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601759965582109:7155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:43.785804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601759965582109:7155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:43.785808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601759965582109:7155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:43.785815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:43.786156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1774
2025-10-10T14:35:43.785661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:43.785673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.785687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.785698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.785715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:43.785737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965582037:2438], now have 1 active actors on pipe
2025-10-10T14:35:43.785745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601759183353538:10044]
2025-10-10T14:35:43.785747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601759183353538:10044]
2025-10-10T14:35:43.785749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601759183353538:10044]
2025-10-10T14:35:43.785764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:43.785780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:43.785784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:43.785795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:43.785798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:43.785809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:43.785813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:43.785837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601759183353538:10044]
2025-10-10T14:35:43.785840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:43.785842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:43.786105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965582153:7155], now have 1 active actors on pipe
2025-10-10T14:35:43.786183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.786190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.786220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:43.786229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.786233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.786235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:43.786246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.786258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:43.786274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.786412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.786416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.786437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.786606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1775 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0
2025-10-10T14:35:43.786982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6521d3bd-877fee52-af9215c8-bfa1ae70_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:43.789547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0] Write session: try to update token
2025-10-10T14:35:43.789565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:43.803439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:43.803457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.803469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601759183353538:10044]
2025-10-10T14:35:43.803514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:43.803525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:43.803713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:43.803866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId: src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:43.803888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:43.804058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:43.804222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:43.804419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:43.804461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:43.806596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:43.806786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.806805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.806841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:43.806920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:43.815605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:43.815623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.815627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:43.815632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:43.815644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601759183353538:10044]
2025-10-10T14:35:43.815647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601759183353538:10044]
2025-10-10T14:35:43.815652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601759183353538:10044]
2025-10-10T14:35:43.815695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:43.815701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:43.815701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:43.815705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:43.815708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.815710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:43.815846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:43.869152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601759965582163:7726]
2025-10-10T14:35:43.869487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1774, pipe: [1:7559601759965582163:7726]
2025-10-10T14:35:43.927545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:43.934698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.934732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.934912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.934976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.935047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.935116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.935162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.935172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.935245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.935308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.935371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.935437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.935486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.935494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.935561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.935625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.935689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.935754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.935802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.935809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.935884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.935956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.936023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.936092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.936135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.936144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.936215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.936284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.936346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.936415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.936466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.936474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.936543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.936612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.936677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.936747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.936796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.936804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.936878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.936947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.937015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.937078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.937121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.937128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.937199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.937254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.937316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.937400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.937442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.937451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.937521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.937578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.937636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.937705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.937753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.937760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.937838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:43.937903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:43.937968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:43.938036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:43.938082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:43.938089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:43.938157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965582163:7726], now have 1 active actors on pipe
2025-10-10T14:35:43.938446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:43.938465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:43.938511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1775 reason: error at write: Disconnected sessionId: src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0
2025-10-10T14:35:43.938639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601759965582163:7726]
2025-10-10T14:35:43.938670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:43.938741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1775 sessionId: src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0 is DEAD
2025-10-10T14:35:43.938928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:43.938939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0] Write session will restart in 0.009494s
2025-10-10T14:35:43.938965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0] Write session: Do CDS request
2025-10-10T14:35:43.938971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:43.939184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:43.949554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:43.949973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.950020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:43.950040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1776
2025-10-10T14:35:43.951451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:43.951497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:43.951503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:43.951508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:43.952672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:43.952919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:43.952925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:43.952938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:43.952996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:43.953037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601759183353669:10048]
2025-10-10T14:35:43.953701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:43.954095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:43.954157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:43.954503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:43.954573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.954580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.954581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.954582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.954583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.954585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.954586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.954587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.954589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.954590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.954591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.954593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.954597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.954604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.954617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.954621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.954624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.954628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.954632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.954635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.954639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.954644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.954649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.954652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.954656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.954659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.954668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.954677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:43.954684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.954689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:43.954694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.954700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:43.954704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.954709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:43.954715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.954720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:43.954726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.954732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:43.954737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.954743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:43.954747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.954753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:43.954758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.954772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:43.954779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.954783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:43.954788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.954793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.954798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.954803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.954808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.954813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.954855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:43.957832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:43.957983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1776 sessionId:  describe result for acl check
2025-10-10T14:35:43.958035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:43.958037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:43.958039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:43.958046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601759965582248:7156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:43.958529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:43.958544Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:43.958547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:43.958551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:43.958558Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1775 [2:7559601759183353669:10048]
2025-10-10T14:35:43.958573Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:43.958603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:43.958611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.958615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.958618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.958635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:43.958648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:43.958657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:43.958630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601759965582248:7156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:43.958720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.958732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.958734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.958737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:43.958808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:43.958817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.958830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:43.958842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:43.958860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:43.958885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965582164:2438], now have 1 active actors on pipe
2025-10-10T14:35:43.958895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601759183353663:10048]
2025-10-10T14:35:43.958897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601759183353663:10048]
2025-10-10T14:35:43.958899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601759183353663:10048]
2025-10-10T14:35:43.958924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1775
2025-10-10T14:35:43.958914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:43.958928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:43.958931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:43.958933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:43.958935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:43.958953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:43.958956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:43.959000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601759183353663:10048]
2025-10-10T14:35:43.959008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:43.959024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:43.961355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601759965582248:7156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:43.967587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601759965582248:7156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:43.967618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601759965582248:7156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:43.967622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601759965582248:7156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:43.967633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:43.967933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601759965582278:7156], now have 1 active actors on pipe
2025-10-10T14:35:43.967976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1775
2025-10-10T14:35:43.968130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.968146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.968181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:43.968210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:43.968221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:43.968224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:43.968243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:43.968280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:43.968307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.968542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:43.968557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:43.968583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:43.968681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1776 partition: 0 MaxSeqNo: 40 sessionId: src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0
2025-10-10T14:35:43.969105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d73c4aa-424cf48-32b2227d-6557d6be_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:43.971903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0] Write session: try to update token
2025-10-10T14:35:43.971922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:43.970837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:43.970856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.970870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601759183353663:10048]
2025-10-10T14:35:43.970910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:43.970913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:43.971078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:43.971214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:43.971354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:43.971489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:43.971677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:43.971713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:43.987772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId: src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:43.989420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:43.989442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:43.989445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:43.989447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:43.989458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601759183353663:10048]
2025-10-10T14:35:43.989462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601759183353663:10048]
2025-10-10T14:35:43.989467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601759183353663:10048]
2025-10-10T14:35:43.989521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:43.989520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:43.989526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:43.989530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:43.989534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:43.989536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:43.989682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:43.990530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:44.038633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601764260549578:7726]
2025-10-10T14:35:44.039142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1775, pipe: [1:7559601764260549578:7726]
2025-10-10T14:35:44.106626Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:44.106992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.107019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.107058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549578:7726], now have 1 active actors on pipe
2025-10-10T14:35:44.107302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601764260549578:7726]
2025-10-10T14:35:44.107358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:44.107361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:44.107426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1776 reason: error at write: Disconnected sessionId: src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0
2025-10-10T14:35:44.107622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1776 sessionId: src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0 is DEAD
2025-10-10T14:35:44.107693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:44.108136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:44.108147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0] Write session will restart in 0.005759s
2025-10-10T14:35:44.108171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0] Write session: Do CDS request
2025-10-10T14:35:44.108177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:44.107369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:44.114930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.115040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:44.115059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1777
2025-10-10T14:35:44.115230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.115275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:44.115297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:44.115306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:44.115713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1777 sessionId:  describe result for acl check
2025-10-10T14:35:44.115754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:44.115764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:44.115766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:44.115773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601764260549633:7149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:44.116342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601764260549633:7149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:44.117998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:44.118487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601764260549633:7149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:44.120148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:44.120373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:44.120385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:44.120396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:44.120449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:44.120521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601763478321077:10050]
2025-10-10T14:35:44.121122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:44.121503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:44.121557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:44.121294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601764260549633:7149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:44.121310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601764260549633:7149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:44.121314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601764260549633:7149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:44.121323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:44.121898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:44.121958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.121968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.121970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.121971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.121972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.121973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.121975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.121976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.121977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.121978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.121979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.121980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.121981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.121987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.121999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.122003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.122006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.122010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.122014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.122018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.122021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.122024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.122028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.122031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.122035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.122038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.122046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.122054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.122060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.122066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.122070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.122075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.122079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.122084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.122089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.122093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.122098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.122102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.122107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.122111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.122115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.122119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.122124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.122129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.122132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.122137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.122141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.122145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.122149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.122154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.122158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.122162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.122198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:44.124805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:44.125173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:44.125189Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:44.125193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:44.125197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:44.125204Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1776 [2:7559601763478321077:10050]
2025-10-10T14:35:44.125219Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:44.125239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:44.125252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.125256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.125258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.125278Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:44.125291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:44.125321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:44.125405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.125407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.125410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.125413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:44.125490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:44.125493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.125508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.125519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.125539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:44.125562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601763478321071:10050]
2025-10-10T14:35:44.125565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601763478321071:10050]
2025-10-10T14:35:44.125567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601763478321071:10050]
2025-10-10T14:35:44.125580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:44.125597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:44.125614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:44.125618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:44.125650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601763478321071:10050]
2025-10-10T14:35:44.125653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:44.125654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:44.125658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:44.125660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:44.125667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:44.125798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549579:2438], now have 1 active actors on pipe
2025-10-10T14:35:44.125805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549685:7149], now have 1 active actors on pipe
2025-10-10T14:35:44.126018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.126031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.125901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1776
2025-10-10T14:35:44.125956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1776
2025-10-10T14:35:44.126065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:44.126079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.126088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.126090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:44.126113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.126130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:44.126150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.130362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.130387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.130428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.130612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1777 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0
2025-10-10T14:35:44.137667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3846b3c4-f99d2e4f-a1a09e4d-8c9d9c7d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:44.140551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0] Write session: try to update token
2025-10-10T14:35:44.140574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:44.149581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:44.149604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:44.149607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:44.149610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:44.149621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601763478321071:10050]
2025-10-10T14:35:44.149626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601763478321071:10050]
2025-10-10T14:35:44.149630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601763478321071:10050]
2025-10-10T14:35:44.149685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:44.149695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.149698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:44.149864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:44.150450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:44.150457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:44.150463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:44.160428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId: src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:44.163165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:44.207518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601764260549696:7726]
2025-10-10T14:35:44.207806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1776, pipe: [1:7559601764260549696:7726]
2025-10-10T14:35:44.278827Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:44.279304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.279322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.279348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549696:7726], now have 1 active actors on pipe
2025-10-10T14:35:44.279597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:44.279633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601764260549696:7726]
2025-10-10T14:35:44.279670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:44.279672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:44.279755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1777 reason: error at write: Disconnected sessionId: src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0
2025-10-10T14:35:44.279977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1777 sessionId: src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0 is DEAD
2025-10-10T14:35:44.280210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:44.283017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:44.283033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0] Write session will restart in 0.007198s
2025-10-10T14:35:44.283058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0] Write session: Do CDS request
2025-10-10T14:35:44.283067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:44.291920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.291998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:44.292016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1778
2025-10-10T14:35:44.292207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.292249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:44.292268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:44.292272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:44.292696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1778 sessionId:  describe result for acl check
2025-10-10T14:35:44.292727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:44.292739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:44.292741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:44.292748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601764260549782:7122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:44.293644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601764260549782:7122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:44.295959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:44.297481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:44.297709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:44.297720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:44.297733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:44.297805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:44.297846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601763478321228:10065]
2025-10-10T14:35:44.296851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601764260549782:7122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:44.298419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:44.298735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:44.298780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:44.299085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:44.299150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.299152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.299153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.299154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.299155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.299156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.299158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.299159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.299160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.299162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.299163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.299164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.299165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.299171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.299183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.299188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.299192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.299206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.299211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.299215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.299218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.299222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.299227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.299231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.299235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.299239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.299247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.299256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.299263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.299269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.299274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.299278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.299282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.299287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.299291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.299296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.299300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.299305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.299308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.299314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.299318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.299322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.299327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.299332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.299343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.299347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.299352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.299357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.299361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.299367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.299375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.299380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.299421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:44.299331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601764260549782:7122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:44.299350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601764260549782:7122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:44.299354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601764260549782:7122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:44.299364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:44.302375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:44.302872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:44.302884Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:44.302886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:44.302890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:44.302896Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1777 [2:7559601763478321228:10065]
2025-10-10T14:35:44.302913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:44.302931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:44.302934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.302939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.302942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.302959Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:44.302967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:44.302975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:44.303032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.303033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.303035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.303038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:44.303106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:44.303116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.303129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.303143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.303174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:44.303202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549829:7122], now have 1 active actors on pipe
2025-10-10T14:35:44.303211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549714:2438], now have 1 active actors on pipe
2025-10-10T14:35:44.303220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601763478321223:10065]
2025-10-10T14:35:44.303222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601763478321223:10065]
2025-10-10T14:35:44.303225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601763478321223:10065]
2025-10-10T14:35:44.303238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:44.303256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:44.303277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:44.303286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:44.303311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601763478321223:10065]
2025-10-10T14:35:44.303318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:44.303604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:44.303615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:44.303617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:44.303624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:44.303701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.303713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.303747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:44.303761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.303766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.303768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:44.303781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.303796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:44.303816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.304588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.304602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.304627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.303298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1777
2025-10-10T14:35:44.303342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1777
2025-10-10T14:35:44.304841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1778 partition: 0 MaxSeqNo: 40 sessionId: src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0
2025-10-10T14:35:44.305230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b901f79-b3d19a17-6d9a21ab-a887cc7d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:44.307872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0] Write session: try to update token
2025-10-10T14:35:44.307892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:44.328209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId: src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:44.331038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:44.331276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.331302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.331346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:44.331441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:44.336141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:44.336159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:44.336161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:44.336163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:44.336171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601763478321223:10065]
2025-10-10T14:35:44.336175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601763478321223:10065]
2025-10-10T14:35:44.336178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601763478321223:10065]
2025-10-10T14:35:44.336224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:44.336230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.336232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:44.336245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:44.336253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:44.336258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:44.336363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:44.379621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601764260549839:7726]
2025-10-10T14:35:44.379986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1777, pipe: [1:7559601764260549839:7726]
2025-10-10T14:35:44.448983Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:44.457323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.457374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.457540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.457603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.457658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.457717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.457767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.457795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.457865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.457921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.457982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.458048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.458088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.458089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.458148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.458204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.458261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.458320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.458358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.458361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.458432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.458496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.458557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.458616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.458650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.458652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.458708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.458755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.458814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.458866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.458906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.458908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.458972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.459025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.459081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.459137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.459174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.459179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.459250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.459304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.459364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.459423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.459823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.459830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.459902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.459959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.460022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.460086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.460129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.460132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.460204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.460260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.460322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.460387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.460545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.460550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.460621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.460675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.460737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.460801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.460841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.460844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.460919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549839:7726], now have 1 active actors on pipe
2025-10-10T14:35:44.461477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:44.461495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:44.461527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1778 reason: error at write: Disconnected sessionId: src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0
2025-10-10T14:35:44.461732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1778 sessionId: src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0 is DEAD
2025-10-10T14:35:44.462217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:44.462259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601764260549839:7726]
2025-10-10T14:35:44.462046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:44.462576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:44.462587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0] Write session will restart in 0.005066s
2025-10-10T14:35:44.462611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0] Write session: Do CDS request
2025-10-10T14:35:44.462618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:44.470291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.473719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:44.473738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1779
2025-10-10T14:35:44.474819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:44.476825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:44.477083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:44.477094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:44.477108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:44.477183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:44.477227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601763478321343:10067]
2025-10-10T14:35:44.477466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.477535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:44.477547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:44.477552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:44.477891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:44.478199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:44.478260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:44.478595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:44.478062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1779 sessionId:  describe result for acl check
2025-10-10T14:35:44.478112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:44.478116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:44.478118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:44.478124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601764260549921:7119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:44.478708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601764260549921:7119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:44.478823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.478832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.478834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.478835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.478836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.478837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.478839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.478840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.478841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.478842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.478844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.478845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.478846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.478854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.478867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.478871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.478875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.478878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.478882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.478886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.478890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.478907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.478912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.478917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.478921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.478925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.478934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.478943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.478949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.478963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.478967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.478973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.478978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.478983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.478988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.478993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.478997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.479003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.479007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.479013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.479017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.479023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.479028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.479033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.479037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.479042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.479048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.479052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.479058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.479062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.479066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.479071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.479113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:44.481488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601764260549921:7119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:44.482965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1778
2025-10-10T14:35:44.482235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:44.482554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:44.482559Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:44.482561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:44.482565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:44.482572Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1778 [2:7559601763478321343:10067]
2025-10-10T14:35:44.482586Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:44.482605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:44.482609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.482614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.482617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.482637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:44.482646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:44.482653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:44.482718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.482720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.482722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.482725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:44.482798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:44.482801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.482813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.482826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.482844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:44.482867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549841:2438], now have 1 active actors on pipe
2025-10-10T14:35:44.482876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601763478321338:10067]
2025-10-10T14:35:44.482879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601763478321338:10067]
2025-10-10T14:35:44.482882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601763478321338:10067]
2025-10-10T14:35:44.482896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:44.482912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:44.482914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:44.482917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:44.482919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:44.482929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:44.482944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:44.482976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601763478321338:10067]
2025-10-10T14:35:44.482984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:44.482996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:44.489119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549955:7119], now have 1 active actors on pipe
2025-10-10T14:35:44.488528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601764260549921:7119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:44.488550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601764260549921:7119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:44.488554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601764260549921:7119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:44.488564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:44.489242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1778
2025-10-10T14:35:44.493304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.493345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.493397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:44.493413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.493422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.493426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:44.493447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.493478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:44.493503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.493886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.493900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.493935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.494619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae7f294b-6a0d5481-12b73b84-19c6e3da_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:44.494143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1779 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0
2025-10-10T14:35:44.497837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0] Write session: try to update token
2025-10-10T14:35:44.497857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:44.508849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:44.508870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:44.508874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:44.508876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:44.508886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601763478321338:10067]
2025-10-10T14:35:44.508891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601763478321338:10067]
2025-10-10T14:35:44.508896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601763478321338:10067]
2025-10-10T14:35:44.508950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:44.508957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.508960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:44.508990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:44.509002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:44.509008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:44.509097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:44.526356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId: src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:44.529687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:44.562392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601764260549961:7726]
2025-10-10T14:35:44.567297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1778, pipe: [1:7559601764260549961:7726]
2025-10-10T14:35:44.627321Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:44.627854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.627876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.627902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549961:7726], now have 1 active actors on pipe
2025-10-10T14:35:44.628179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:44.628197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:44.628201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:44.628275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1779 reason: error at write: Disconnected sessionId: src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0
2025-10-10T14:35:44.628491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1779 sessionId: src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0 is DEAD
2025-10-10T14:35:44.628510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601764260549961:7726]
2025-10-10T14:35:44.628531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:44.628643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:44.628651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0] Write session will restart in 0.007281s
2025-10-10T14:35:44.628691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0] Write session: Do CDS request
2025-10-10T14:35:44.628698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:44.636920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.637045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:44.637063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1780
2025-10-10T14:35:44.637243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.637293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:44.637304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:44.637309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:44.637852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1780 sessionId:  describe result for acl check
2025-10-10T14:35:44.637897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:44.637903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:44.637905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:44.637912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601764260550040:7111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:44.638528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601764260550040:7111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:44.640820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601764260550040:7111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:44.642022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:44.644166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:44.644407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:44.644423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:44.644436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:44.644503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:44.644550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601763478321459:10069]
2025-10-10T14:35:44.645206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:44.645712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:44.645802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:44.645938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601764260550040:7111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:44.645958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601764260550040:7111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:44.645961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601764260550040:7111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:44.645971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:44.646148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:44.646226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.646233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.646234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.646235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.646237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.646238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.646239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.646241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.646243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.646244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.646245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.646246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.646248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.646254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.646267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.646287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.646291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.646295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.646299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.646303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.646307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.646311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.646315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.646319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.646322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.646326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.646336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.646353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.646364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.646370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.646379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.646385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.646389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.646394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.646403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.646409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.646417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.646422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.646427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.646443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.646451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.646455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.646460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.646464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.646473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.646478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.646482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.646486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.646494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.646500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.646504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.646509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.646551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:44.650653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1779
2025-10-10T14:35:44.649840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:44.650661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1779
2025-10-10T14:35:44.650182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:44.650187Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:44.650190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:44.650194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:44.650202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1779 [2:7559601763478321459:10069]
2025-10-10T14:35:44.650229Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:44.650252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:44.650256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.650261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.650263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.650283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:44.650291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:44.650299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:44.650366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.650369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.650371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.650374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:44.650449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:44.650452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.650465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.650476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.650493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:44.650515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601763478321454:10069]
2025-10-10T14:35:44.650518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601763478321454:10069]
2025-10-10T14:35:44.650520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601763478321454:10069]
2025-10-10T14:35:44.650529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:44.650544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:44.650544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:44.650547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:44.650550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:44.650564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:44.650568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:44.650579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260550075:7111], now have 1 active actors on pipe
2025-10-10T14:35:44.650583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260549965:2438], now have 1 active actors on pipe
2025-10-10T14:35:44.650617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601763478321454:10069]
2025-10-10T14:35:44.650628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:44.650659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:44.650729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.650738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.650777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2842d794-6e1e84b1-685641a-a970c9c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:44.650786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.650791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.650794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:44.650816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.650829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:44.650850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.651017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.651030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.651049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.651177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1780 partition: 0 MaxSeqNo: 40 sessionId: src_id|2842d794-6e1e84b1-685641a-a970c9c3_0
2025-10-10T14:35:44.651599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7c968f-75cf2b2f-2f36497e-6b061a6a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2842d794-6e1e84b1-685641a-a970c9c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:44.654276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2842d794-6e1e84b1-685641a-a970c9c3_0] Write session: try to update token
2025-10-10T14:35:44.654298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2842d794-6e1e84b1-685641a-a970c9c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:44.671225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:44.671249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:44.671252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:44.671254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:44.671264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601763478321454:10069]
2025-10-10T14:35:44.671268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601763478321454:10069]
2025-10-10T14:35:44.671272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601763478321454:10069]
2025-10-10T14:35:44.671323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:44.671326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:44.671334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.671337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:44.671339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:44.671343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:44.671487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:44.670920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId: src_id|2842d794-6e1e84b1-685641a-a970c9c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:44.673700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:44.729428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601764260550091:7726]
2025-10-10T14:35:44.729735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1779, pipe: [1:7559601764260550091:7726]
2025-10-10T14:35:44.784013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:44.784308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.784325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.784371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260550091:7726], now have 1 active actors on pipe
2025-10-10T14:35:44.784600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:44.784618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:44.784623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:44.784644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:44.784678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601764260550091:7726]
2025-10-10T14:35:44.784701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1780 reason: error at write: Disconnected sessionId: src_id|2842d794-6e1e84b1-685641a-a970c9c3_0
2025-10-10T14:35:44.784903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1780 sessionId: src_id|2842d794-6e1e84b1-685641a-a970c9c3_0 is DEAD
2025-10-10T14:35:44.785071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2842d794-6e1e84b1-685641a-a970c9c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:44.785083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2842d794-6e1e84b1-685641a-a970c9c3_0] Write session will restart in 0.007408s
2025-10-10T14:35:44.785108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2842d794-6e1e84b1-685641a-a970c9c3_0] Write session: Do CDS request
2025-10-10T14:35:44.785117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2842d794-6e1e84b1-685641a-a970c9c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:44.793871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2842d794-6e1e84b1-685641a-a970c9c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.793960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:44.793980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1781
2025-10-10T14:35:44.794118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.794155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:44.794166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:44.794170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:44.794672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1781 sessionId:  describe result for acl check
2025-10-10T14:35:44.794715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:44.794721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:44.794723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:44.794729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601764260550182:7102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:44.795282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601764260550182:7102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:44.795373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:44.797075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:44.797326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:44.797369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:44.797383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:44.797441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601764260550182:7102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:44.797454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:44.797504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601763478321586:10071]
2025-10-10T14:35:44.798172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:44.798515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:44.798579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:44.798914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:44.798997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.799003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.799004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.799006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.799007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.799008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.799009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.799010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.799011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.799012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.799013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.799014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.799015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.799022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.799036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.799040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.799044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.799048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.799053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.799056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.799060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.799064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.799068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.799072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.799076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.799080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.799087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.799095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.799102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.799107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.799111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.799117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.799130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.799142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.799147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.799151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.799154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.799159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.799164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.799168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.799172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.799177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.799182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.799188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.799192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.799198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.799203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.799208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.799212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.799217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.799221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.799227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.799268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:44.801651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601764260550182:7102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:44.801670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601764260550182:7102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:44.801674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601764260550182:7102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:44.801683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:44.801939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:44.802434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:44.802449Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:44.802452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:44.802456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:44.802463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1780 [2:7559601763478321586:10071]
2025-10-10T14:35:44.802475Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:44.802492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:44.802500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.802504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.802507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.802539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:44.802551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:44.802559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:44.802623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.802631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.802633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.802635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:44.802703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:44.802711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.802724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.802740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.802762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:44.802786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260550219:7102], now have 1 active actors on pipe
2025-10-10T14:35:44.802795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260550095:2438], now have 1 active actors on pipe
2025-10-10T14:35:44.802802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601763478321580:10071]
2025-10-10T14:35:44.802805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601763478321580:10071]
2025-10-10T14:35:44.802806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601763478321580:10071]
2025-10-10T14:35:44.802821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:44.802833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:44.802837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:44.802839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:44.802841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:44.802856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:44.802867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:44.802894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601763478321580:10071]
2025-10-10T14:35:44.802905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:44.802811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1780
2025-10-10T14:35:44.802911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:44.802819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1780
2025-10-10T14:35:44.802926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.802931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.802985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c992dfe-49f71755-1e12e194-1f37538_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:44.802999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.803007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.803009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:44.803021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.803036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:44.803060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.803254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.803264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.803281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.803347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1781 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c992dfe-49f71755-1e12e194-1f37538_0
2025-10-10T14:35:44.803758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2842d794-6e1e84b1-685641a-a970c9c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c992dfe-49f71755-1e12e194-1f37538_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:44.806468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c992dfe-49f71755-1e12e194-1f37538_0] Write session: try to update token
2025-10-10T14:35:44.806486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c992dfe-49f71755-1e12e194-1f37538_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:44.822104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:44.822128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:44.822147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601763478321580:10071]
2025-10-10T14:35:44.822204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:44.822213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:44.822403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:44.822603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:44.822766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:44.822942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:44.823159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:44.823211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:44.824034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId: src_id|2c992dfe-49f71755-1e12e194-1f37538_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:44.826799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:44.827054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.827091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.827133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:44.827218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:44.835226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:44.835251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:44.835255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:44.835258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:44.835269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601763478321580:10071]
2025-10-10T14:35:44.835274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601763478321580:10071]
2025-10-10T14:35:44.835278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601763478321580:10071]
2025-10-10T14:35:44.835329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:44.835342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.835345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:44.835386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:44.835405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:44.835409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:44.835480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:44.882903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601764260550227:7726]
2025-10-10T14:35:44.883228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1780, pipe: [1:7559601764260550227:7726]
2025-10-10T14:35:44.963517Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:44.971871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.971909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.972092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.972160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.972226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.972297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.972353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.972364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.972436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.972502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.972561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.972632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.972675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.972683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.972748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.972813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.972896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.972954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.972993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.972995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.973065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.973128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.973192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.973254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.973294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.973297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.973455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.973524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.973607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.973692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.973738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.973745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.973827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.973891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.973960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.974025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.974072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.974079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.974151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.974213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.974280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.974345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.974389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.974398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.974464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.974526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.974594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.974657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.974703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.974711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.974779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.974843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.974909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.974977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.975030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.975037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.975107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:44.975177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:44.975238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:44.975308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:44.975352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:44.975360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:44.975424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260550227:7726], now have 1 active actors on pipe
2025-10-10T14:35:44.976712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:44.976729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:44.976763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1781 reason: error at write: Disconnected sessionId: src_id|2c992dfe-49f71755-1e12e194-1f37538_0
2025-10-10T14:35:44.976735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:44.976960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:44.977006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1781 sessionId: src_id|2c992dfe-49f71755-1e12e194-1f37538_0 is DEAD
2025-10-10T14:35:44.977014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601764260550227:7726]
2025-10-10T14:35:44.977092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c992dfe-49f71755-1e12e194-1f37538_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:44.977117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c992dfe-49f71755-1e12e194-1f37538_0] Write session will restart in 0.009035s
2025-10-10T14:35:44.977144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c992dfe-49f71755-1e12e194-1f37538_0] Write session: Do CDS request
2025-10-10T14:35:44.977150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c992dfe-49f71755-1e12e194-1f37538_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:44.987744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:44.988184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c992dfe-49f71755-1e12e194-1f37538_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.988258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:44.988272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1782
2025-10-10T14:35:44.988413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:44.988441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:44.988449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:44.988453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:44.988778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1782 sessionId:  describe result for acl check
2025-10-10T14:35:44.988805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:44.988807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:44.988808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:44.988812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601764260550311:7100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:44.989227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601764260550311:7100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:44.989569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:44.989768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:44.989780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:44.989792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:44.989850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:44.989893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601763478321706:10075]
2025-10-10T14:35:44.990517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:44.990790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:44.990833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:44.991153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:44.991209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.991215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.991217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.991218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.991219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.991221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.991222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.991223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.991225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.991226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.991227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.991228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.991230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.991236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.991249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.991253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.991258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.991262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.991266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.991276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.991280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.991285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.991294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.991298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.991302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.991310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.991317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.991331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:44.991342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.991348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:44.991352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.991358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:44.991363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.991368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:44.991374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.991379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:44.991384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.991396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:44.991400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.991413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:44.991418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.991424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:44.991428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.991434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:44.991439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.991444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:44.991454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.991460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.991469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.991475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.991482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.991487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.991538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:44.992225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601764260550311:7100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:44.994240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:44.994583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:44.994588Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:44.994591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:44.994595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:44.994601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1781 [2:7559601763478321706:10075]
2025-10-10T14:35:44.994615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:44.994633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:44.994636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.994640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.994642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.994659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:44.994668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:44.994676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:44.994731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.994735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.994737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.994740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:44.994813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:44.994816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:44.994828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:44.994842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:44.994861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:44.994881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260550232:2438], now have 1 active actors on pipe
2025-10-10T14:35:44.994890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601763478321700:10075]
2025-10-10T14:35:44.994892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601763478321700:10075]
2025-10-10T14:35:44.994894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601763478321700:10075]
2025-10-10T14:35:44.994909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:44.994921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:44.994922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:44.994923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:44.994925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:44.994940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:44.994944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:44.994967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601763478321700:10075]
2025-10-10T14:35:44.994975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:44.994985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:44.995895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601764260550343:7100], now have 1 active actors on pipe
2025-10-10T14:35:44.995973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.995981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.996010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:44.996020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:44.996025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:44.996027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:44.996040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:44.995070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1781
2025-10-10T14:35:44.996052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:44.996066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.995274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601764260550311:7100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:44.995280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601764260550311:7100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:44.995284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601764260550311:7100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:44.995292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:44.995924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1781
2025-10-10T14:35:44.996204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:44.996210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:44.996226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:44.996294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1782 partition: 0 MaxSeqNo: 40 sessionId: src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0
2025-10-10T14:35:44.996683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c992dfe-49f71755-1e12e194-1f37538_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:44.999468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0] Write session: try to update token
2025-10-10T14:35:44.999491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:45.015145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:45.015173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:45.015181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:45.015183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:45.015194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601763478321700:10075]
2025-10-10T14:35:45.015198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601763478321700:10075]
2025-10-10T14:35:45.015201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601763478321700:10075]
2025-10-10T14:35:45.015254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:45.015261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.015264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:45.015270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:45.015272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:45.015277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:45.015414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:45.019432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId: src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:45.022098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:45.076945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601768555517645:7726]
2025-10-10T14:35:45.077245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1781, pipe: [1:7559601768555517645:7726]
2025-10-10T14:35:45.138129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:45.138150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:45.138227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1782 reason: error at write: Disconnected sessionId: src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0
2025-10-10T14:35:45.137445Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:45.137852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.137863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.137909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555517645:7726], now have 1 active actors on pipe
2025-10-10T14:35:45.138103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:45.138616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:45.138634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0] Write session will restart in 0.007587s
2025-10-10T14:35:45.138661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0] Write session: Do CDS request
2025-10-10T14:35:45.138669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:45.138449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1782 sessionId: src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0 is DEAD
2025-10-10T14:35:45.138676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:45.138711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601768555517645:7726]
2025-10-10T14:35:45.147973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.148597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:45.148616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1783
2025-10-10T14:35:45.148742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.148778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:45.148784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:45.148789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:45.149460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1783 sessionId:  describe result for acl check
2025-10-10T14:35:45.149500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:45.149502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:45.149504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:45.149510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601768555517725:7096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:45.150106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601768555517725:7096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:45.152865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601768555517725:7096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:45.153967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:45.155759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:45.156019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:45.156034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:45.156047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:45.156038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601768555517725:7096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:45.156055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601768555517725:7096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:45.156059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601768555517725:7096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:45.156068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:45.156110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:45.156156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601767773289120:10077]
2025-10-10T14:35:45.156747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:45.157108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:45.157166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:45.157523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:45.157613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.157623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.157625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.157626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.157628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.157630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.157631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.157632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.157634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.157635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.157637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.157638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.157639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.157647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.157661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.157665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.157669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.157673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.157678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.157682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.157686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.157690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.157694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.157698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.157702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.157706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.157715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.157723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.157730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.157736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.157741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.157746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.157765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.157771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.157777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.157782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.157787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.157792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.157797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.157804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.157810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.157815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.157819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.157825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.157829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.157835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.157840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.157845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.157849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.157854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.157860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.157866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.157926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:45.160502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:45.160850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:45.160865Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:45.160868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:45.160872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:45.160881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1782 [2:7559601767773289120:10077]
2025-10-10T14:35:45.160895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:45.160915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:45.160928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.160932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.160934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.160952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:45.160960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:45.160967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:45.161026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.161034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.161036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.161039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:45.161114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:45.161122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.161135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.161146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.161169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:45.161192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555517651:2438], now have 1 active actors on pipe
2025-10-10T14:35:45.161202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555517761:7096], now have 1 active actors on pipe
2025-10-10T14:35:45.161210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601767773289115:10077]
2025-10-10T14:35:45.161212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601767773289115:10077]
2025-10-10T14:35:45.161214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601767773289115:10077]
2025-10-10T14:35:45.161227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:45.161243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:45.161241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:45.161252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:45.161257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:45.161261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:45.161264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:45.161254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1782
2025-10-10T14:35:45.161259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1782
2025-10-10T14:35:45.161292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601767773289115:10077]
2025-10-10T14:35:45.161303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:45.161303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:45.161323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.161352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.161409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:45.161423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.161429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.161431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:45.161443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.161459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:45.161481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.161652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.161663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.161685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.161793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1783 partition: 0 MaxSeqNo: 40 sessionId: src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0
2025-10-10T14:35:45.162213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03196e7-287e3c91-28a606ee-3c6e9e40_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:45.165047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0] Write session: try to update token
2025-10-10T14:35:45.165066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:45.182588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:45.182613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:45.182617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:45.182619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:45.182631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601767773289115:10077]
2025-10-10T14:35:45.182636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601767773289115:10077]
2025-10-10T14:35:45.182640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601767773289115:10077]
2025-10-10T14:35:45.182696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:45.182709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.182711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:45.182716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:45.182719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:45.182723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:45.182852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId: src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:45.182881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:45.185720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:45.238757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601768555517772:7726]
2025-10-10T14:35:45.239184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1782, pipe: [1:7559601768555517772:7726]
2025-10-10T14:35:45.293720Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:45.294501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.294521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.294561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555517772:7726], now have 1 active actors on pipe
2025-10-10T14:35:45.294721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:45.294799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:45.294847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:45.294940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1783 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0
2025-10-10T14:35:45.295204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1783 sessionId: src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0 is DEAD
2025-10-10T14:35:45.295295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:45.295307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0] Write session will restart in 0.008431s
2025-10-10T14:35:45.295332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0] Write session: Do CDS request
2025-10-10T14:35:45.295346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:45.295485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601768555517772:7726]
2025-10-10T14:35:45.304960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.305066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:45.305084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1784
2025-10-10T14:35:45.305206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.305245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:45.305254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:45.305259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:45.305290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:45.305630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1784 sessionId:  describe result for acl check
2025-10-10T14:35:45.305664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:45.305672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:45.305673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:45.305680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601768555517871:7084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:45.306206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601768555517871:7084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:45.307048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:45.307267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:45.307279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:45.307292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:45.307351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:45.307409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601767773289270:10085]
2025-10-10T14:35:45.308026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:45.308299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:45.308350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:45.308384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601768555517871:7084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:45.308699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:45.308758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.308764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.308765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.308767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.308768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.308769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.308770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.308771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.308773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.308774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.308775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.308777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.308779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.308786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.308798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.308803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.308808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.308812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.308817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.308821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.308826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.308830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.308835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.308840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.308844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.308849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.308857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.308866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.308879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.308885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.308895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.308900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.308907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.308914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.308924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.308930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.308939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.308945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.308950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.308956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.308961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.308965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.308974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.308979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.308984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.308990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.308999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.309005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.309010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.309020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.309025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.309035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.309079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:45.311508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601768555517871:7084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:45.311525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601768555517871:7084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:45.311529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601768555517871:7084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:45.311537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:45.311546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:45.311903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:45.311920Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:45.311922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:45.311925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:45.311932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1783 [2:7559601767773289270:10085]
2025-10-10T14:35:45.311946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:45.311963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:45.311966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.311970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.311972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.311989Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:45.312001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:45.312014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:45.312072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.312080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.312082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.312085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:45.312149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:45.312156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.312168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.312183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.312206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:45.312233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555517787:2438], now have 1 active actors on pipe
2025-10-10T14:35:45.312242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555517901:7084], now have 1 active actors on pipe
2025-10-10T14:35:45.312250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601767773289264:10085]
2025-10-10T14:35:45.312252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601767773289264:10085]
2025-10-10T14:35:45.312255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601767773289264:10085]
2025-10-10T14:35:45.312258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1783
2025-10-10T14:35:45.312272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:45.312287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:45.312301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1783
2025-10-10T14:35:45.312290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:45.312292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:45.312293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:45.312323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:45.312326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:45.312365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.312375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.312390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601767773289264:10085]
2025-10-10T14:35:45.312402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:45.312408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:45.312429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9f0d967-380a1487-d361a1b0-faefd302_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:45.312443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.312447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.312450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:45.312462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.312474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:45.312498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.312699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.312708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.312723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.312862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1784 partition: 0 MaxSeqNo: 40 sessionId: src_id|f9f0d967-380a1487-d361a1b0-faefd302_0
2025-10-10T14:35:45.313416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24681e5-6a88ccc0-8a8c885-fc84f7e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f9f0d967-380a1487-d361a1b0-faefd302_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:45.316034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f0d967-380a1487-d361a1b0-faefd302_0] Write session: try to update token
2025-10-10T14:35:45.316050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f0d967-380a1487-d361a1b0-faefd302_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:45.330408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId: src_id|f9f0d967-380a1487-d361a1b0-faefd302_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:45.332328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:45.332358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:45.332362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:45.332364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:45.332375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601767773289264:10085]
2025-10-10T14:35:45.332379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601767773289264:10085]
2025-10-10T14:35:45.332384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601767773289264:10085]
2025-10-10T14:35:45.332434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:45.332439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:45.332448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.332450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:45.332461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:45.332466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:45.332604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:45.333311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:45.395397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601768555517920:7726]
2025-10-10T14:35:45.395739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1783, pipe: [1:7559601768555517920:7726]
2025-10-10T14:35:45.448539Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:45.449001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.449021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.449069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555517920:7726], now have 1 active actors on pipe
2025-10-10T14:35:45.449318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:45.449310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:45.449344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:45.449346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:45.449395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601768555517920:7726]
2025-10-10T14:35:45.449440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1784 reason: error at write: Disconnected sessionId: src_id|f9f0d967-380a1487-d361a1b0-faefd302_0
2025-10-10T14:35:45.449640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1784 sessionId: src_id|f9f0d967-380a1487-d361a1b0-faefd302_0 is DEAD
2025-10-10T14:35:45.449808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f0d967-380a1487-d361a1b0-faefd302_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:45.449818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f0d967-380a1487-d361a1b0-faefd302_0] Write session will restart in 0.009712s
2025-10-10T14:35:45.449842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f0d967-380a1487-d361a1b0-faefd302_0] Write session: Do CDS request
2025-10-10T14:35:45.449848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f0d967-380a1487-d361a1b0-faefd302_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:45.459098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:45.460840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:45.460938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f0d967-380a1487-d361a1b0-faefd302_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.461006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:45.461034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1785
2025-10-10T14:35:45.461069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:45.461082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:45.461095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:45.461155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:45.461176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.461200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601767773289395:10094]
2025-10-10T14:35:45.461219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:45.461231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:45.461236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:45.461690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1785 sessionId:  describe result for acl check
2025-10-10T14:35:45.461727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:45.461733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:45.461735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:45.461748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601768555518005:7072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:45.461851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:45.462188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:45.462243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:45.462299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601768555518005:7072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:45.462589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:45.462648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.462653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.462654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.462656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.462657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.462658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.462659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.462660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.462661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.462663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.462664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.462665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.462666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.462672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.462684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.462688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.462692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.462697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.462701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.462705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.462710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.462714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.462718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.462723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.462726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.462730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.462738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.462747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.462753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.462764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.462769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.462778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.462784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.462794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.462798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.462803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.462807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.462813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.462817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.462828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.462834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.462840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.462849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.462854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.462863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.462868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.462873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.462882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.462886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.462895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.462901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.462910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.462948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:45.464903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601768555518005:7072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:45.465396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:45.465767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:45.465778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:45.465780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:45.465784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:45.465790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1784 [2:7559601767773289395:10094]
2025-10-10T14:35:45.465804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:45.465821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:45.465829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.465833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.465835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.465862Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:45.465877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:45.465885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:45.465958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.465966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.465969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.465971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:45.466154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1784
2025-10-10T14:35:45.466176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:45.466187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.466199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.466213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.466237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:45.466264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555517921:2438], now have 1 active actors on pipe
2025-10-10T14:35:45.466284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601767773289390:10094]
2025-10-10T14:35:45.466292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601767773289390:10094]
2025-10-10T14:35:45.466295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601767773289390:10094]
2025-10-10T14:35:45.466310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:45.466329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:45.466351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:45.466352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:45.466357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:45.466358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:45.466360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:45.466390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601767773289390:10094]
2025-10-10T14:35:45.466397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:45.466418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:45.471365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601768555518005:7072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:45.471383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601768555518005:7072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:45.471387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601768555518005:7072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:45.471396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:45.471654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518042:7072], now have 1 active actors on pipe
2025-10-10T14:35:45.471699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1784
2025-10-10T14:35:45.471778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.471790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.471826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4006817-b5048e89-873848fd-da34dc6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:45.471843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.471853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.471856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:45.471872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.471898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:45.471920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.472068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.472081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.472117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.472203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1785 partition: 0 MaxSeqNo: 40 sessionId: src_id|4006817-b5048e89-873848fd-da34dc6b_0
2025-10-10T14:35:45.472617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f0d967-380a1487-d361a1b0-faefd302_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4006817-b5048e89-873848fd-da34dc6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:45.475279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4006817-b5048e89-873848fd-da34dc6b_0] Write session: try to update token
2025-10-10T14:35:45.475295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4006817-b5048e89-873848fd-da34dc6b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:45.477585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:45.477602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:45.477611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601767773289390:10094]
2025-10-10T14:35:45.477652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:45.477658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:45.477840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:45.477982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:45.478133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:45.478272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:45.478469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:45.478515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:45.491859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId: src_id|4006817-b5048e89-873848fd-da34dc6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:45.500678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:45.500706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:45.500709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:45.500711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:45.500722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601767773289390:10094]
2025-10-10T14:35:45.500727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601767773289390:10094]
2025-10-10T14:35:45.500735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601767773289390:10094]
2025-10-10T14:35:45.500789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:45.500793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:45.500797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.500799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:45.500803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:45.500804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:45.500807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:45.500952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:45.549539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601768555518045:7726]
2025-10-10T14:35:45.549980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1784, pipe: [1:7559601768555518045:7726]
2025-10-10T14:35:45.612827Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:45.613135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.613146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.613172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518045:7726], now have 1 active actors on pipe
2025-10-10T14:35:45.613396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:45.613410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:45.613415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:45.613476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601768555518045:7726]
2025-10-10T14:35:45.613492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1785 reason: error at write: Disconnected sessionId: src_id|4006817-b5048e89-873848fd-da34dc6b_0
2025-10-10T14:35:45.613495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:45.613698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1785 sessionId: src_id|4006817-b5048e89-873848fd-da34dc6b_0 is DEAD
2025-10-10T14:35:45.613902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4006817-b5048e89-873848fd-da34dc6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:45.613917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4006817-b5048e89-873848fd-da34dc6b_0] Write session will restart in 0.007340s
2025-10-10T14:35:45.613950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4006817-b5048e89-873848fd-da34dc6b_0] Write session: Do CDS request
2025-10-10T14:35:45.613962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4006817-b5048e89-873848fd-da34dc6b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:45.622935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4006817-b5048e89-873848fd-da34dc6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.623038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:45.623068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1786
2025-10-10T14:35:45.623214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.623263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:45.623275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:45.623280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:45.623798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1786 sessionId:  describe result for acl check
2025-10-10T14:35:45.623844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:45.623853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:45.623855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:45.623861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601768555518126:7062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:45.624418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601768555518126:7062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:45.625035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:45.626433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:45.626655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:45.626666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:45.626679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:45.626762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:45.626804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601767773289517:10096]
2025-10-10T14:35:45.627121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601768555518126:7062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:45.627424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:45.627771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:45.627844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:45.628189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:45.628276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.628284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.628286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.628287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.628289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.628290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.628291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.628293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.628294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.628295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.628297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.628298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.628299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.628306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.628321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.628324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.628328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.628332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.628335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.628339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.628342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.628346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.628350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.628354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.628358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.628361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.628369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.628378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.628385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.628390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.628394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.628398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.628403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.628408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.628413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.628417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.628422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.628427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.628432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.628436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.628441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.628446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.628451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.628456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.628461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.628466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.628470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.628476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.628482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.628487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.628491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.628495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.628535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:45.629528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601768555518126:7062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:45.629544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601768555518126:7062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:45.629548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601768555518126:7062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:45.629557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:45.631779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:45.632348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:45.632364Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:45.632367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:45.632371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:45.632379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1785 [2:7559601767773289517:10096]
2025-10-10T14:35:45.632393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:45.632412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:45.632424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.632428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.632430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.632450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:45.632457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:45.632465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:45.632528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.632537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.632539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.632542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:45.632614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:45.632625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.632638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.632648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.632667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:45.632698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518046:2438], now have 1 active actors on pipe
2025-10-10T14:35:45.632707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518164:7062], now have 1 active actors on pipe
2025-10-10T14:35:45.632716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601767773289511:10096]
2025-10-10T14:35:45.632724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601767773289511:10096]
2025-10-10T14:35:45.632727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601767773289511:10096]
2025-10-10T14:35:45.632746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:45.632761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1785
2025-10-10T14:35:45.632765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:45.632768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:45.632765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1785
2025-10-10T14:35:45.632769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:45.632770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:45.632787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:45.632791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:45.632823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601767773289511:10096]
2025-10-10T14:35:45.632836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:45.632839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:45.632856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.632861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.632919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15d447e7-b376281f-402aeb67-8d027c7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:45.632928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.632932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.632934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:45.632945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.632956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:45.632984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.633184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.633197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.633231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.633315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1786 partition: 0 MaxSeqNo: 40 sessionId: src_id|15d447e7-b376281f-402aeb67-8d027c7f_0
2025-10-10T14:35:45.633725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4006817-b5048e89-873848fd-da34dc6b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|15d447e7-b376281f-402aeb67-8d027c7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:45.636508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15d447e7-b376281f-402aeb67-8d027c7f_0] Write session: try to update token
2025-10-10T14:35:45.636524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15d447e7-b376281f-402aeb67-8d027c7f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:45.657426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId: src_id|15d447e7-b376281f-402aeb67-8d027c7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:45.661379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:45.661640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.661660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.661705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:45.661954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:45.680112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:45.680133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:45.680137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:45.680139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:45.680149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601767773289511:10096]
2025-10-10T14:35:45.680157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601767773289511:10096]
2025-10-10T14:35:45.680161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601767773289511:10096]
2025-10-10T14:35:45.680216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:45.680217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:45.680223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:45.680223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.680225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:45.680227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:45.680369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:45.713900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601768555518176:7726]
2025-10-10T14:35:45.714313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1785, pipe: [1:7559601768555518176:7726]
2025-10-10T14:35:45.794882Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:45.803889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.803921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.804126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.804196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.804270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.804345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.804396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.804409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.804490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.804560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.804634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.804701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.804755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.804764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.804837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.804904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.804970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.805045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.805095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.805103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.805178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.805546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.805614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.805677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.805723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.805730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.805815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.805883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.805952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.806022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.806073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.806081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.806152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.806215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.806282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.806349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.806396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.806406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.806482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.806553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.806631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.806700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.806752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.806766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.806839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.806902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.806969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.807035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.807083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.807090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.807164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.807228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.807296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.807371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.807420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.807427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.807505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.807567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.807633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.807702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.807752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.807759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.807870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518176:7726], now have 1 active actors on pipe
2025-10-10T14:35:45.808183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:45.808268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601768555518176:7726]
2025-10-10T14:35:45.808512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:45.808526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:45.808560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1786 reason: error at write: Disconnected sessionId: src_id|15d447e7-b376281f-402aeb67-8d027c7f_0
2025-10-10T14:35:45.808853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1786 sessionId: src_id|15d447e7-b376281f-402aeb67-8d027c7f_0 is DEAD
2025-10-10T14:35:45.808982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d447e7-b376281f-402aeb67-8d027c7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:45.808995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d447e7-b376281f-402aeb67-8d027c7f_0] Write session will restart in 0.007914s
2025-10-10T14:35:45.809021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d447e7-b376281f-402aeb67-8d027c7f_0] Write session: Do CDS request
2025-10-10T14:35:45.809027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d447e7-b376281f-402aeb67-8d027c7f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:45.809058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:45.817908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15d447e7-b376281f-402aeb67-8d027c7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.818048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:45.818068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1787
2025-10-10T14:35:45.818281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.818327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:45.818337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:45.818341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:45.818812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1787 sessionId:  describe result for acl check
2025-10-10T14:35:45.818851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:45.818860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:45.818862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:45.818869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601768555518251:7059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:45.819447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601768555518251:7059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:45.821680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:45.822080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601768555518251:7059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:45.823049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:45.823254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:45.823265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:45.823293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:45.823350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:45.823391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601767773289652:10099]
2025-10-10T14:35:45.824013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:45.824343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:45.824390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:45.824714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:45.824772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.824779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.824780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.824781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.824783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.824784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.824785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.824786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.824787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.824788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.824790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.824792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.824793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.824800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.824813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.824817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.824822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.824826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.824831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.824835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.824839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.824843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.824848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.824852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.824856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.824860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.824868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.824882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:45.824894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.824900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:45.824909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.824915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:45.824925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.824930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:45.824936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.824942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:45.824946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.824952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:45.824957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.824962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:45.824967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.824973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:45.824978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.824983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:45.824988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.824994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:45.825003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.825009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.825019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.825024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.825035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.825040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.825091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:45.827957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:45.828471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:45.828486Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:45.828488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:45.828493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:45.828500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1786 [2:7559601767773289652:10099]
2025-10-10T14:35:45.828513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:45.828531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:45.828539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.828544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.828546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.828564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:45.828572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:45.828579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:45.828650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.828656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.828659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.828661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:45.828729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:45.828737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.828748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:45.828760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:45.828777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:45.828800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518194:2438], now have 1 active actors on pipe
2025-10-10T14:35:45.828813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601767773289647:10099]
2025-10-10T14:35:45.828815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601767773289647:10099]
2025-10-10T14:35:45.828817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601767773289647:10099]
2025-10-10T14:35:45.828832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:45.828845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:45.828846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:45.828847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:45.828849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:45.828861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:45.828866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:45.828896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601767773289647:10099]
2025-10-10T14:35:45.828908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:45.828910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:45.829137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1786
2025-10-10T14:35:45.829442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601768555518251:7059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:45.829455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601768555518251:7059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:45.829459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601768555518251:7059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:45.829467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:45.829681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518314:7059], now have 1 active actors on pipe
2025-10-10T14:35:45.829816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1786
2025-10-10T14:35:45.829899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.829910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.829952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:45.829962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:45.829967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:45.829969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:45.829982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:45.829996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:45.830013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.830135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.830141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.830155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:45.830628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15d447e7-b376281f-402aeb67-8d027c7f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:45.833285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0] Write session: try to update token
2025-10-10T14:35:45.833303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:45.830220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1787 partition: 0 MaxSeqNo: 40 sessionId: src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0
2025-10-10T14:35:45.843346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:45.843362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:45.843372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601767773289647:10099]
2025-10-10T14:35:45.843418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:45.843425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:45.843590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:45.843710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:45.843835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:45.843960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:45.844136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:45.844168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:45.855565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId: src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:45.858570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:45.858793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.858825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.858870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:45.858944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:45.864025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:45.864042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:45.864046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:45.864048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:45.864060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601767773289647:10099]
2025-10-10T14:35:45.864065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601767773289647:10099]
2025-10-10T14:35:45.864071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601767773289647:10099]
2025-10-10T14:35:45.864132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:45.864143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:45.864146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:45.864246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:45.864253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:45.864258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:45.864305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:45.908448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601768555518319:7726]
2025-10-10T14:35:45.909116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1786, pipe: [1:7559601768555518319:7726]
2025-10-10T14:35:45.976432Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:45.985494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:45.985524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:45.985713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.985798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.985872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.985952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.986003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.986015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.986089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.986152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.986229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.986303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.989314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601768555518319:7726]
2025-10-10T14:35:45.989327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:45.989344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:45.986359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.986367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.989369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:45.986445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.989380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1787 reason: error at write: Disconnected sessionId: src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0
2025-10-10T14:35:45.986526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.986596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.986662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.986706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.986709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.986790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.986859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.986927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.986988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.987030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.987033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.987107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.987162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.987222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.987278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.987319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.987321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.987396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.987462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.987521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.987587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.987630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.987633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.987704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.987769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.987838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.987904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.987950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.987953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.988029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.988098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.988166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.988234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.988281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.988286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.988360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.988420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.988491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.988555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.988601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.988604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.988683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:45.988748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:45.988815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:45.988885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:45.988931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:45.988933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:45.989023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518319:7726], now have 1 active actors on pipe
2025-10-10T14:35:45.989746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:45.989756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0] Write session will restart in 0.006252s
2025-10-10T14:35:45.989781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0] Write session: Do CDS request
2025-10-10T14:35:45.989788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:45.989594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1787 sessionId: src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0 is DEAD
2025-10-10T14:35:45.990714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:45.996851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.997358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:45.997378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1788
2025-10-10T14:35:45.997556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:45.997606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:45.997612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:45.997617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:45.998108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1788 sessionId:  describe result for acl check
2025-10-10T14:35:45.998136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:45.998138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:45.998139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:45.998146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601768555518339:7055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:45.998739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601768555518339:7055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:46.004172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601768555518339:7055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:46.004594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:46.006451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:46.006689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:46.006701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:46.006714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:46.006775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:46.006819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601772068257073:10102]
2025-10-10T14:35:46.006824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601768555518339:7055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:46.006855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601768555518339:7055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:46.006858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601768555518339:7055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:46.006868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:46.007471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:46.007746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:46.007788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:46.008106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:46.008155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.008160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.008162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.008163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.008164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.008165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.008167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.008168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.008170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.008171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.008172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.008173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.008175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.008181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.008195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.008200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.008204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.008208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.008212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.008216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.008220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.008224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.008229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.008233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.008237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.008242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.008249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.008257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.008263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.008273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.008278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.008284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.008293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.008298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.008303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.008313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.008317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.008324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.008332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.008338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.008347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.008352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.008357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.008366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.008371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.008378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.008383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.008392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.008397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.008403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.008408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.008417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.008457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:46.011096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:46.011395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:46.011407Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:46.011409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:46.011413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:46.011420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1787 [2:7559601772068257073:10102]
2025-10-10T14:35:46.011433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:46.011454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:46.011462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.011467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.011470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.011487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:46.011499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:46.011507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:46.011566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.011573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.011575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.011578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:46.011644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:46.011651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.011662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.011678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.011700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:46.011730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601768555518324:2438], now have 1 active actors on pipe
2025-10-10T14:35:46.011739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850485732:7055], now have 1 active actors on pipe
2025-10-10T14:35:46.011747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601772068257068:10102]
2025-10-10T14:35:46.011750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601772068257068:10102]
2025-10-10T14:35:46.011752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601772068257068:10102]
2025-10-10T14:35:46.011767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:46.011781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:46.011798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:46.011809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:46.011803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1787
2025-10-10T14:35:46.011820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:46.011823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:46.011825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:46.011844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601772068257068:10102]
2025-10-10T14:35:46.011847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:46.011872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.011871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:46.011877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.011899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1787
2025-10-10T14:35:46.011914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:46.011929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.011933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.011936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:46.011946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.011956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:46.011983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.012137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.012145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.012158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.012278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1788 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0
2025-10-10T14:35:46.012655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42a43983-8357a4cb-1c1baa3d-61873b9b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:46.015574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0] Write session: try to update token
2025-10-10T14:35:46.015604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:46.030794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId: src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:46.031821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:46.031843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:46.031846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:46.031849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:46.031859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601772068257068:10102]
2025-10-10T14:35:46.031866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601772068257068:10102]
2025-10-10T14:35:46.031870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601772068257068:10102]
2025-10-10T14:35:46.031922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:46.031927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:46.031933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.031934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:46.031936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:46.031942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:46.032079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:46.033444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:46.089666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601772850485743:7726]
2025-10-10T14:35:46.090146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1787, pipe: [1:7559601772850485743:7726]
2025-10-10T14:35:46.148341Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:46.148784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.148795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.148841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850485743:7726], now have 1 active actors on pipe
2025-10-10T14:35:46.149131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:46.149174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:46.149249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601772850485743:7726]
2025-10-10T14:35:46.149269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:46.149272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:46.149372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1788 reason: error at write: Disconnected sessionId: src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0
2025-10-10T14:35:46.149540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1788 sessionId: src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0 is DEAD
2025-10-10T14:35:46.149985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:46.149992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0] Write session will restart in 0.006942s
2025-10-10T14:35:46.150016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0] Write session: Do CDS request
2025-10-10T14:35:46.150022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:46.157967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.158066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:46.158087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1789
2025-10-10T14:35:46.158216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.158254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:46.158263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:46.158267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:46.158777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1789 sessionId:  describe result for acl check
2025-10-10T14:35:46.158815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:46.158830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:46.158836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:46.158842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601772850485761:7051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:46.159426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601772850485761:7051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:46.162524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601772850485761:7051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:46.164150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:46.166702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:46.166943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:46.166954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:46.166976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:46.167043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:46.167093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601772068257197:10104]
2025-10-10T14:35:46.167168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601772850485761:7051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:46.167184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601772850485761:7051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:46.167188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601772850485761:7051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:46.167198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:46.167711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:46.168033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:46.168084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:46.168413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:46.168494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.168501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.168502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.168503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.168504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.168506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.168507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.168508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.168510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.168511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.168512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.168514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.168515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.168522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.168537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.168541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.168545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.168550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.168554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.168559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.168563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.168566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.168571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.168575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.168579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.168583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.168591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.168599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.168606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.168612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.168617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.168623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.168628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.168633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.168638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.168644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.168649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.168654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.168661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.168675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.168680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.168689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.168695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.168700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.168709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.168714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.168720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.168729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.168734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.168739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.168749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.168754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.168804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:46.171264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:46.171565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:46.171576Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:46.171578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:46.171583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:46.171589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1788 [2:7559601772068257197:10104]
2025-10-10T14:35:46.171602Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:46.171620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:46.171627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.171630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.171633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.171649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:46.171661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:46.171669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:46.171750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.171757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.171759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.171762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:46.171833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:46.171842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.171853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.171864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.171881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:46.171904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850485862:7051], now have 1 active actors on pipe
2025-10-10T14:35:46.171912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850485746:2438], now have 1 active actors on pipe
2025-10-10T14:35:46.171921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601772068257192:10104]
2025-10-10T14:35:46.171927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601772068257192:10104]
2025-10-10T14:35:46.171929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601772068257192:10104]
2025-10-10T14:35:46.171944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:46.171953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1788
2025-10-10T14:35:46.171958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:46.171957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1788
2025-10-10T14:35:46.171963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:46.171966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:46.171968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:46.171974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:46.171977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:46.172001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601772068257192:10104]
2025-10-10T14:35:46.172004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:46.172013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:46.172022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.172028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.172076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:46.172088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.172098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.172104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:46.172115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.172130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:46.172154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.172278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.172284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.172297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.172409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1789 partition: 0 MaxSeqNo: 40 sessionId: src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0
2025-10-10T14:35:46.172792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9ed945-9939b180-e01e538d-2a8def3d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:46.175508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0] Write session: try to update token
2025-10-10T14:35:46.175525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:46.191525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:46.191542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:46.191545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:46.191546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:46.191553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601772068257192:10104]
2025-10-10T14:35:46.191557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601772068257192:10104]
2025-10-10T14:35:46.191560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601772068257192:10104]
2025-10-10T14:35:46.191603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:46.191608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.191610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:46.191614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:46.191622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:46.191627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:46.191881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:46.196559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId: src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:46.199361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:46.248936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601772850485873:7726]
2025-10-10T14:35:46.249527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1788, pipe: [1:7559601772850485873:7726]
2025-10-10T14:35:46.304998Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:46.305267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.305284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.305454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850485873:7726], now have 1 active actors on pipe
2025-10-10T14:35:46.305663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:46.305786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601772850485873:7726]
2025-10-10T14:35:46.305835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:46.305924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1789 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0
2025-10-10T14:35:46.306120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1789 sessionId: src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0 is DEAD
2025-10-10T14:35:46.306196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:46.306566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:46.306580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0] Write session will restart in 0.005617s
2025-10-10T14:35:46.306605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0] Write session: Do CDS request
2025-10-10T14:35:46.306620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:46.313787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.313806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:46.313826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1790
2025-10-10T14:35:46.313992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.314030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:46.314042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:46.314046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:46.314492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1790 sessionId:  describe result for acl check
2025-10-10T14:35:46.314534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:46.314540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:46.314543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:46.314550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601772850485885:7041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:46.315129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601772850485885:7041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:46.317702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601772850485885:7041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:46.320666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601772850485885:7041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:46.320683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601772850485885:7041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:46.320686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601772850485885:7041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:46.320695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:46.322982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:46.325385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:46.325633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:46.325648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:46.325664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:46.325764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:46.325811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601772068257336:10112]
2025-10-10T14:35:46.326412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:46.326771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:46.326829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:46.327165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:46.327252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.327260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.327261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.327262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.327263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.327264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.327265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.327267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.327268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.327269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.327270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.327272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.327273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.327280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.327293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.327297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.327302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.327306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.327310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.327314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.327318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.327322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.327328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.327332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.327336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.327340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.327349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.327358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.327364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.327370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.327374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.327380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.327384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.327390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.327395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.327401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.327406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.327412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.327417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.327423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.327430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.327442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.327447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.327457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.327461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.327466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.327471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.327477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.327481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.327487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.327496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.327503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.327551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:46.330396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:46.330821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:46.330831Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:46.330834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:46.330837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:46.330844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1789 [2:7559601772068257336:10112]
2025-10-10T14:35:46.330858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:46.330880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:46.330888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.330892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.330895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.330911Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:46.330919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:46.330927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:46.330993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.331000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.331002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.331005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:46.331075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:46.331086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.331099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.331112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.331130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:46.331151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601772068257331:10112]
2025-10-10T14:35:46.331158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601772068257331:10112]
2025-10-10T14:35:46.331160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601772068257331:10112]
2025-10-10T14:35:46.331176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:46.331193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850485875:2438], now have 1 active actors on pipe
2025-10-10T14:35:46.331201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850485968:7041], now have 1 active actors on pipe
2025-10-10T14:35:46.331208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:46.331209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:46.331213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:46.331215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:46.331225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:46.331233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:46.331261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601772068257331:10112]
2025-10-10T14:35:46.331276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:46.331301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:46.331273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1789
2025-10-10T14:35:46.331328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1789
2025-10-10T14:35:46.331413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.331423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.331452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:46.331465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.331474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.331479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:46.331489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.331504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:46.331525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.331731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.331746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.331770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.331880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1790 partition: 0 MaxSeqNo: 40 sessionId: src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0
2025-10-10T14:35:46.332286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f52c0e95-25fdea28-d5869b11-a89faa2d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:46.335108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0] Write session: try to update token
2025-10-10T14:35:46.335130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:46.346268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:46.346287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:46.346298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601772068257331:10112]
2025-10-10T14:35:46.346352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:46.346354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:46.346543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:46.346734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:46.346903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:46.347084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:46.347300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:46.347349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:46.353973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId: src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:46.356742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:46.356945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.356965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.357005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:46.357078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:46.361681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:46.361695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:46.361698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:46.361699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:46.361711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601772068257331:10112]
2025-10-10T14:35:46.361715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601772068257331:10112]
2025-10-10T14:35:46.361731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601772068257331:10112]
2025-10-10T14:35:46.361784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:46.361787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:46.361792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.361793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:46.361794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:46.361796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:46.361930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:46.405595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601772850486030:7726]
2025-10-10T14:35:46.406008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1789, pipe: [1:7559601772850486030:7726]
2025-10-10T14:35:46.480138Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:46.489181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.489208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.489409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.489473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.489541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.489606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.489653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.489663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.489745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.489806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.489866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.489933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.489977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.489985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.490089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.490185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.490284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.490348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.490395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.490402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.490471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.490536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.490601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.490710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.490828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.490838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.490907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.490972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.491078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.491181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.491246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.491254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.491360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.491464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.491577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.491681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.491744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.491751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.491858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.491959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.492087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.492192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.492258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.492266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.492333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.492396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.492468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.492534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.492589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.492593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.492659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.492715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.492783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.492849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.492953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.492964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.493033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.493094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.493158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.493218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.493284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.493293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.493383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486030:7726], now have 1 active actors on pipe
2025-10-10T14:35:46.493644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:46.493692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:46.493696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:46.493725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601772850486030:7726]
2025-10-10T14:35:46.493742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1790 reason: error at write: Disconnected sessionId: src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0
2025-10-10T14:35:46.493952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1790 sessionId: src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0 is DEAD
2025-10-10T14:35:46.494109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:46.494121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0] Write session will restart in 0.008303s
2025-10-10T14:35:46.494147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0] Write session: Do CDS request
2025-10-10T14:35:46.494153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:46.494810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:46.504051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.504094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:46.504114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1791
2025-10-10T14:35:46.504357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.504400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:46.504405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:46.504409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:46.504977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1791 sessionId:  describe result for acl check
2025-10-10T14:35:46.505027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:46.505050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:46.505053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:46.505060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601772850486115:7021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:46.505694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601772850486115:7021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:46.507923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:46.508364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601772850486115:7021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:46.509074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:46.509282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:46.509293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:46.509306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:46.509384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:46.509440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601772068257486:10121]
2025-10-10T14:35:46.510077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:46.510409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:46.510460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:46.510794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:46.510856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.510864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.510866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.510867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.510868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.510869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.510870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.510872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.510873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.510874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.510875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.510876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.510878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.510884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.510897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.510901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.510906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.510910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.510914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.510918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.510922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.510925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.510930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.510934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.510938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.510942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.510950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.510959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.510965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.510972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.510976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.510982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.510987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.510992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.511002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.511008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.511022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.511028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.511033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.511039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.511044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.511049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.511054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.511060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.511180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601772850486115:7021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:46.511065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.511070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.511212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601772850486115:7021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:46.511074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.511080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.511084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.511216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601772850486115:7021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:46.511089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.511224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:46.511094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.511099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.511141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:46.513695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:46.514760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1790
2025-10-10T14:35:46.514763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1790
2025-10-10T14:35:46.514342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:46.514357Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:46.514359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:46.514364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:46.514383Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1790 [2:7559601772068257486:10121]
2025-10-10T14:35:46.514396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:46.514413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:46.514416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.514421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.514423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.514439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:46.514447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:46.514454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:46.514514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.514516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.514518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.515325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1791 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0
2025-10-10T14:35:46.514521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:46.514593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:46.514596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.514608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.514617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.514632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:46.514653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486153:7021], now have 1 active actors on pipe
2025-10-10T14:35:46.514657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486033:2438], now have 1 active actors on pipe
2025-10-10T14:35:46.514664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601772068257481:10121]
2025-10-10T14:35:46.514666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601772068257481:10121]
2025-10-10T14:35:46.514668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601772068257481:10121]
2025-10-10T14:35:46.514682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:46.514696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:46.514699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:46.514702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:46.514704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:46.514712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:46.514716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:46.514740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601772068257481:10121]
2025-10-10T14:35:46.514747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:46.514753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:46.514956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.514962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.514992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:46.515000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.515004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.515006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:46.515019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.515030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:46.515044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.515216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.515219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.515232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.515736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb4ad34-4e4e6fb9-4ca19910-be09ad57_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:46.518533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0] Write session: try to update token
2025-10-10T14:35:46.518554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:46.533611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId: src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:46.536061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:46.536513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.536535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.536558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:46.536562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:46.536566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:46.536568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:46.536576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601772068257481:10121]
2025-10-10T14:35:46.536581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601772068257481:10121]
2025-10-10T14:35:46.536586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601772068257481:10121]
2025-10-10T14:35:46.536629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:46.536636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:46.536640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:46.536646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:46.536654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.536657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:46.536881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:46.594010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601772850486162:7726]
2025-10-10T14:35:46.594282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1790, pipe: [1:7559601772850486162:7726]
2025-10-10T14:35:46.650723Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:46.651027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:46.651102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486162:7726], now have 1 active actors on pipe
2025-10-10T14:35:46.651170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:46.653543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601772850486162:7726]
2025-10-10T14:35:46.653588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:46.664251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:46.664271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:46.664301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1791 reason: error at write: Disconnected sessionId: src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0
2025-10-10T14:35:46.664454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1791 sessionId: src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0 is DEAD
2025-10-10T14:35:46.664778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:46.664789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0] Write session will restart in 0.008419s
2025-10-10T14:35:46.664823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0] Write session: Do CDS request
2025-10-10T14:35:46.664830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:46.670804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:46.672737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:46.672976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:46.672990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:46.673004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:46.673066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:46.673115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601772068257613:10123]
2025-10-10T14:35:46.673820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:46.674164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:46.674216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:46.674540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:46.674613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.674619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.674621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.674622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.674624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.674625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.674626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.674628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.674629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.674631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.674632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.674634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.674635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.674642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.674657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.674660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.674664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.674668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.674672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.674675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.674680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.674684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.674689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.674693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.674698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.674701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.674711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.674720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.674728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.674734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.674740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.674746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.674751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.674757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.674763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.674769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.674774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.674789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.674794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.674799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.674803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.674808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.674813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.674818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.674822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.674828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.674833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.674839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.674844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.674850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.674855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.674861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.674904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:46.674929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.675010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:46.675033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1792
2025-10-10T14:35:46.675174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.675216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:46.675227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:46.675230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:46.675651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1792 sessionId:  describe result for acl check
2025-10-10T14:35:46.675698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:46.675711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:46.675713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:46.675720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601772850486265:7014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:46.676372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601772850486265:7014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:46.677784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:46.678154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:46.678167Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:46.678170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:46.678174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:46.678180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1791 [2:7559601772068257613:10123]
2025-10-10T14:35:46.678196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:46.678219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:46.678222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.678226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.678228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.678249Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:46.678257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:46.678265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:46.678334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.678344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.678346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.678349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:46.678424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:46.678431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.678444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.678456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.678479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:46.678502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601772068257608:10123]
2025-10-10T14:35:46.678509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601772068257608:10123]
2025-10-10T14:35:46.678511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601772068257608:10123]
2025-10-10T14:35:46.678529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:46.678542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:46.678548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486166:2438], now have 1 active actors on pipe
2025-10-10T14:35:46.678553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:46.678554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:46.678556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:46.678571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:46.678574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:46.678609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601772068257608:10123]
2025-10-10T14:35:46.678622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:46.678632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:46.679259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601772850486265:7014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:46.679392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1791
2025-10-10T14:35:46.685523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601772850486265:7014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:46.685544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601772850486265:7014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:46.685548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601772850486265:7014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:46.685558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:46.685964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1791
2025-10-10T14:35:46.686658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1792 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0
2025-10-10T14:35:46.687107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4062d1-ee5ec5bc-3eab0025-19829e85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:46.685903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486298:7014], now have 1 active actors on pipe
2025-10-10T14:35:46.686071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.686083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.686120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:46.686135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.686141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.686144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:46.686170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.686190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:46.686211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.686417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.686425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.686467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.689896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0] Write session: try to update token
2025-10-10T14:35:46.689915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:46.699744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:46.699767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:46.699771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:46.699773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:46.699784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601772068257608:10123]
2025-10-10T14:35:46.699789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601772068257608:10123]
2025-10-10T14:35:46.699793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601772068257608:10123]
2025-10-10T14:35:46.699847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:46.699849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:46.699856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:46.699858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.699860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:46.699862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:46.700014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:46.709501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId: src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:46.712188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:46.753768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601772850486304:7726]
2025-10-10T14:35:46.754020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1791, pipe: [1:7559601772850486304:7726]
2025-10-10T14:35:46.819069Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:46.819437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.819457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.819483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486304:7726], now have 1 active actors on pipe
2025-10-10T14:35:46.820278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:46.820290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0] Write session will restart in 0.005628s
2025-10-10T14:35:46.819782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:46.819778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601772850486304:7726]
2025-10-10T14:35:46.819799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:46.820316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0] Write session: Do CDS request
2025-10-10T14:35:46.820354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:46.819816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:46.819820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:46.819890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1792 reason: error at write: Disconnected sessionId: src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0
2025-10-10T14:35:46.820093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1792 sessionId: src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0 is DEAD
2025-10-10T14:35:46.826945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.827071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:46.827089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1793
2025-10-10T14:35:46.827218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:46.827257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:46.827269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:46.827273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:46.827783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1793 sessionId:  describe result for acl check
2025-10-10T14:35:46.827827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:46.827835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:46.827837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:46.827847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601772850486340:7011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:46.828633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601772850486340:7011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:46.831688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:46.833512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:46.833751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:46.833762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:46.833775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:46.833832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:46.833878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601772068257753:10126]
2025-10-10T14:35:46.834540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:46.834799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:46.834842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:46.835039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601772850486340:7011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:46.835203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:46.835264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.835270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.835271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.835272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.835274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.835275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.835276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.835278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.835279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.835280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.835281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.835282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.835284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.835290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.835304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.835308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.835313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.835317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.835322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.835326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.835331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.835335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.835340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.835344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.835349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.835353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.835361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.835378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:46.835385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.835390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:46.835395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.835400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:46.835404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.835409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:46.835414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.835420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:46.835429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.835435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:46.835444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.835450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:46.835457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.835462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:46.835471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.835476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:46.835480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.835490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:46.835496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.835506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.835511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.835521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.835526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.835531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.835580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:46.838031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:46.838035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601772850486340:7011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:46.838053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601772850486340:7011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:46.838057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601772850486340:7011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:46.838067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:46.838645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:46.838657Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:46.838659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:46.838664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:46.838670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1792 [2:7559601772068257753:10126]
2025-10-10T14:35:46.838683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:46.838701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:46.838710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.838714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.838716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.838734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:46.838748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:46.838756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:46.838817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.838824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.838826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.838829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:46.838897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:46.838908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.838918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:46.838929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:46.838944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:46.838966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486442:7011], now have 1 active actors on pipe
2025-10-10T14:35:46.838973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486318:2438], now have 1 active actors on pipe
2025-10-10T14:35:46.838981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601772068257747:10126]
2025-10-10T14:35:46.838983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601772068257747:10126]
2025-10-10T14:35:46.838985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601772068257747:10126]
2025-10-10T14:35:46.839000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:46.839153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1792
2025-10-10T14:35:46.839017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:46.839206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1792
2025-10-10T14:35:46.839032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:46.839036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:46.839065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601772068257747:10126]
2025-10-10T14:35:46.839067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:46.839109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:46.839113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:46.839115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:46.839122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:46.839204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.839209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.839240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:46.839248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:46.839252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:46.839254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:46.839267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:46.839282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:46.839305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.839495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.839504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.839520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:46.839622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1793 partition: 0 MaxSeqNo: 40 sessionId: src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0
2025-10-10T14:35:46.840061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b8fd3a-f17de500-4e0a0f57-aea88cd5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:46.843008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0] Write session: try to update token
2025-10-10T14:35:46.843030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:46.853972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:46.853989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:46.854003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601772068257747:10126]
2025-10-10T14:35:46.854061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:46.854078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:46.854252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:46.854443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:46.854595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:46.854773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:46.854969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:46.855015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:46.861076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId: src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:46.863978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:46.864225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.864250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.864292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:46.864400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:46.870314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:46.870331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:46.870335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:46.870337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:46.870349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601772068257747:10126]
2025-10-10T14:35:46.870354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601772068257747:10126]
2025-10-10T14:35:46.870357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601772068257747:10126]
2025-10-10T14:35:46.870407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:46.870410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:46.870415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:46.870423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:46.870420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:46.870432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:46.870593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:46.920125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601772850486449:7726]
2025-10-10T14:35:46.920396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1792, pipe: [1:7559601772850486449:7726]
2025-10-10T14:35:46.989976Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:46.998388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:46.998420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:46.998609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.998674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.998748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.998815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.999334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.999347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.999457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.999561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:46.999671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:46.999743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:46.999791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:46.999800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:46.999868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:46.999965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.000121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.000186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.000235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.000245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.000314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.000526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.000632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.000735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.000781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.000791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.000921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.000984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.001085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.001182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.001247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.001255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.001376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.001441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.001505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.001566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.001608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.001614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.001680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.001757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.001827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.001894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.001940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.001947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.002014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.002083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.002148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.002212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.002371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.002379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.002448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.002511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.002575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.002644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.002696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.002703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.002769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.002831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.002895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.002959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.003007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.003014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.003082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601772850486449:7726], now have 1 active actors on pipe
2025-10-10T14:35:47.003304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:47.003320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:47.003369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1793 reason: error at write: Disconnected sessionId: src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0
2025-10-10T14:35:47.003425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:47.003662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1793 sessionId: src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0 is DEAD
2025-10-10T14:35:47.003781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:47.003792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0] Write session will restart in 0.007659s
2025-10-10T14:35:47.003819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0] Write session: Do CDS request
2025-10-10T14:35:47.003825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:47.003911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601772850486449:7726]
2025-10-10T14:35:47.003936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:47.012890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.012978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:47.012996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1794
2025-10-10T14:35:47.013139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.013173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:47.013183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:47.013187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:47.013177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:47.013738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1794 sessionId:  describe result for acl check
2025-10-10T14:35:47.013774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:47.013780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:47.013782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:47.013788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601777145453839:7006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:47.014330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601777145453839:7006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:47.014631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:47.014834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:47.014845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:47.014858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:47.014920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:47.014970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601776363225179:10129]
2025-10-10T14:35:47.015604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:47.015905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:47.015970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:47.016328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:47.016416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.016425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.016426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.016427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.016428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.016429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.016431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.016432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.016433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.016434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.016436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.016437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.016438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.016444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.016456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.016460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.016465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.016469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.016473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.016477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.016481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.016485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.016489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.016493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.016497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.016501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.016508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.016517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.016523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.016529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.016533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.016538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.016543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.016548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.016553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.016562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.016567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.016576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.016585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.016590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.016599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.016608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.016616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.016621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.016629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.016634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.016643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.016649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.016655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.016660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.016668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.016672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.016722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:47.016928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601777145453839:7006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:47.019077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:47.019402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:47.019416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:47.019419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:47.019422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:47.019428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1793 [2:7559601776363225179:10129]
2025-10-10T14:35:47.019441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:47.019458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:47.019468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.019472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.019474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.019492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:47.019504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:47.019512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:47.019557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601777145453839:7006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:47.019572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601777145453839:7006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:47.019576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601777145453839:7006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:47.019581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.019585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:47.019589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.019591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.019594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:47.019669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:47.019676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.019688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.019704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.019722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:47.019744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1793
2025-10-10T14:35:47.019749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145453748:2438], now have 1 active actors on pipe
2025-10-10T14:35:47.019762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601776363225174:10129]
2025-10-10T14:35:47.019768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601776363225174:10129]
2025-10-10T14:35:47.019771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601776363225174:10129]
2025-10-10T14:35:47.019783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:47.019797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:47.019801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:47.019807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:47.019814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:47.019840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:47.019848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:47.019876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145453872:7006], now have 1 active actors on pipe
2025-10-10T14:35:47.019889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601776363225174:10129]
2025-10-10T14:35:47.019900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:47.019891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1793
2025-10-10T14:35:47.019915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:47.019931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.019940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.019975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:47.019987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.019992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.019994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:47.020006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.020020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:47.020039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.020194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.020203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.020220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.020339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1794 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0
2025-10-10T14:35:47.020714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6f3c90-5b006ca7-d54494e-c8e36599_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:47.023549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0] Write session: try to update token
2025-10-10T14:35:47.023568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:47.039130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId: src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:47.039757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:47.039775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:47.039779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:47.039781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:47.039791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601776363225174:10129]
2025-10-10T14:35:47.039795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601776363225174:10129]
2025-10-10T14:35:47.039799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601776363225174:10129]
2025-10-10T14:35:47.039843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:47.039856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:47.039862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:47.039862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:47.039869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.039873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:47.040026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:47.041842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:47.103953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601777145453880:7726]
2025-10-10T14:35:47.104253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1793, pipe: [1:7559601777145453880:7726]
2025-10-10T14:35:47.156612Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:47.156993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.157008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.157058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145453880:7726], now have 1 active actors on pipe
2025-10-10T14:35:47.157365Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:47.158151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:47.158165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0] Write session will restart in 0.007070s
2025-10-10T14:35:47.158191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0] Write session: Do CDS request
2025-10-10T14:35:47.158198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:47.157486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601777145453880:7726]
2025-10-10T14:35:47.157535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:47.157767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1794 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0
2025-10-10T14:35:47.157973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1794 sessionId: src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0 is DEAD
2025-10-10T14:35:47.158156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:47.169871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.171490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:47.170439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:47.170458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1795
2025-10-10T14:35:47.170585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.170617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:47.170624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:47.170629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:47.171082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1795 sessionId:  describe result for acl check
2025-10-10T14:35:47.171116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:47.171118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:47.171120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:47.171127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601777145453974:6999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:47.171704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601777145453974:6999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:47.173236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:47.173492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:47.173510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:47.173523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:47.173609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:47.173654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601776363225310:10131]
2025-10-10T14:35:47.174279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:47.174311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601777145453974:6999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:47.174629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:47.174686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:47.175025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:47.175097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.175104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.175105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.175106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.175107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.175108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.175109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.175111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.175112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.175114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.175115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.175116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.175118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.175125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.175138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.175142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.175146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.175149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.175154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.175158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.175163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.175166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.175171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.175175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.175179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.175183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.175190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.175199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.175207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.175213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.175218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.175222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.175226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.175232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.175243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.175249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.175259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.175264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.175269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.175275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.175279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.175285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.175289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.175294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.175299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.175304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.175311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.175321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.175325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.175331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.175340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.175346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.175402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:47.177942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:47.177925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601777145453974:6999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:47.178426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:47.177943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601777145453974:6999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:47.178442Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:47.178445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:47.177947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601777145453974:6999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:47.177957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:47.178449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:47.178455Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1794 [2:7559601776363225310:10131]
2025-10-10T14:35:47.178469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:47.178487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:47.178491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.178495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.178498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.178515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:47.178523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:47.178531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:47.178589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.178599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.178601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.178604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:47.178674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:47.178683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.178697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.178710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.178733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:47.178761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454007:6999], now have 1 active actors on pipe
2025-10-10T14:35:47.178770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145453882:2438], now have 1 active actors on pipe
2025-10-10T14:35:47.178778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601776363225305:10131]
2025-10-10T14:35:47.178785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601776363225305:10131]
2025-10-10T14:35:47.178787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601776363225305:10131]
2025-10-10T14:35:47.178803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:47.178823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:47.178845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:47.178850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:47.178877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601776363225305:10131]
2025-10-10T14:35:47.178885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:47.178879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1794
2025-10-10T14:35:47.178913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1794
2025-10-10T14:35:47.179001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:47.179011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:47.179014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:47.179030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:47.179162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.179176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.179210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:47.179223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.179228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.179230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:47.179250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.179266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:47.179285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.179536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.179549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.179573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.179673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1795 partition: 0 MaxSeqNo: 40 sessionId: src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0
2025-10-10T14:35:47.180109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fdecc-d059d6e9-e9a0324f-a622dbb5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:47.182891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0] Write session: try to update token
2025-10-10T14:35:47.182911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:47.203491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:47.203509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:47.203512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:47.203514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:47.203525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601776363225305:10131]
2025-10-10T14:35:47.203531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601776363225305:10131]
2025-10-10T14:35:47.203535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601776363225305:10131]
2025-10-10T14:35:47.203582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:47.203587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:47.203589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:47.203594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:47.203595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.203599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:47.203728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:47.204167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId: src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:47.207022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:47.261145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601777145454015:7726]
2025-10-10T14:35:47.261947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1794, pipe: [1:7559601777145454015:7726]
2025-10-10T14:35:47.312994Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:47.313283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.313296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.313356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454015:7726], now have 1 active actors on pipe
2025-10-10T14:35:47.313589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:47.314092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:47.314182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1795 reason: status is not ok: tablet will be restarted right now sessionId: src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0
2025-10-10T14:35:47.314379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1795 sessionId: src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0 is DEAD
2025-10-10T14:35:47.314514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601777145454015:7726]
2025-10-10T14:35:47.314530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:47.317593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:47.317614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0] Write session will restart in 0.009987s
2025-10-10T14:35:47.317642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0] Write session: Do CDS request
2025-10-10T14:35:47.317649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:47.328830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.328976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:47.328997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1796
2025-10-10T14:35:47.333481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.333546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:47.333553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:47.333559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:47.334361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1796 sessionId:  describe result for acl check
2025-10-10T14:35:47.334402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:47.334404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:47.334406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:47.334413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601777145454078:6992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:47.335007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601777145454078:6992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:47.337979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601777145454078:6992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:47.342247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:47.343570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601777145454078:6992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:47.343591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601777145454078:6992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:47.343595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601777145454078:6992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:47.343605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:47.345929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:47.346183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:47.346195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:47.346210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:47.346276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:47.346320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601776363225442:10133]
2025-10-10T14:35:47.347038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:47.347392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:47.347434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:47.347767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:47.347831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.347837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.347839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.347840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.347842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.347843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.347844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.347846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.347847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.347848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.347850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.347851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.347852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.347859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.347873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.347878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.347882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.347886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.347890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.347894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.347898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.347902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.347907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.347911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.347915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.347919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.347927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.347935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.347942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.347948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.347952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.347957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.347962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.347969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.347979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.347984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.347989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.348000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.348005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.348010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.348014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.348019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.348024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.348030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.348034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.348039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.348049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.348060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.348066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.348074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.348079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.348089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.348132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:47.353955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:47.354300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:47.354313Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:47.354316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:47.354321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:47.354328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1795 [2:7559601776363225442:10133]
2025-10-10T14:35:47.354344Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:47.354364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:47.354368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.354372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.354375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.354397Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:47.354422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:47.354435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:47.354507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.354515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.354517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.354520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:47.354612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:47.354621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.354634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.354649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.354670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:47.354696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601776363225436:10133]
2025-10-10T14:35:47.354704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601776363225436:10133]
2025-10-10T14:35:47.354706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601776363225436:10133]
2025-10-10T14:35:47.354719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:47.354742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454140:6992], now have 1 active actors on pipe
2025-10-10T14:35:47.354742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:47.354745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:47.354747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:47.354750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454019:2438], now have 1 active actors on pipe
2025-10-10T14:35:47.354759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:47.354776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:47.354780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:47.354824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601776363225436:10133]
2025-10-10T14:35:47.354839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:47.354844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:47.354847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1795
2025-10-10T14:35:47.354855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1795
2025-10-10T14:35:47.354940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.354950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.354987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:47.355000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.355005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.355008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:47.355020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.355037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:47.355065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.355239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.355250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.355268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.355390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1796 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0
2025-10-10T14:35:47.355812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86f42788-6ca9fbc0-230336f2-dd590a1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:47.358562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0] Write session: try to update token
2025-10-10T14:35:47.358585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:47.378801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:47.378823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:47.378829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:47.378831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:47.378841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601776363225436:10133]
2025-10-10T14:35:47.378846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601776363225436:10133]
2025-10-10T14:35:47.378850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601776363225436:10133]
2025-10-10T14:35:47.378905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:47.378912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.378915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:47.379053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:47.381511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:47.381528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:47.381533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:47.383083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId: src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:47.385717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:47.414725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601777145454164:7726]
2025-10-10T14:35:47.414992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1795, pipe: [1:7559601777145454164:7726]
2025-10-10T14:35:47.492397Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:47.492921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.492937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.492984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454164:7726], now have 1 active actors on pipe
2025-10-10T14:35:47.493240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:47.493235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601777145454164:7726]
2025-10-10T14:35:47.493243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:47.493248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:47.493271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:47.493343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1796 reason: error at write: Disconnected sessionId: src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0
2025-10-10T14:35:47.493582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1796 sessionId: src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0 is DEAD
2025-10-10T14:35:47.493742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:47.493753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0] Write session will restart in 0.008874s
2025-10-10T14:35:47.493779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0] Write session: Do CDS request
2025-10-10T14:35:47.493786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:47.503955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.504078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:47.504098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1797
2025-10-10T14:35:47.504222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.504258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:47.504264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:47.504268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:47.504767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1797 sessionId:  describe result for acl check
2025-10-10T14:35:47.504806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:47.504812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:47.504816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:47.504823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601777145454272:6975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:47.505393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601777145454272:6975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:47.505799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:47.507448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601777145454272:6975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:47.507676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:47.507899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:47.507910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:47.507922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:47.507986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:47.508028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601776363225611:10148]
2025-10-10T14:35:47.508640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:47.508942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:47.508985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:47.509290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:47.509369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.509371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.509372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.509373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.509374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.509375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.509376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.509378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.509379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.509380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.509381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.509382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.509383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.509390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.509402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.509405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.509409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.509412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.509415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.509419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.509422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.509425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.509429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.509432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.509435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.509439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.509445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.509453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.509459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.509464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.509468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.509472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.509476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.509480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.509484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.509488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.509493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.509497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.509502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.509506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.509510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.509515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.509519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.509523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.509527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.509531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.509535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.509540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.509546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.509550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.509554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.509558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.509592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:47.510152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601777145454272:6975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:47.510167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601777145454272:6975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:47.510171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601777145454272:6975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:47.510180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:47.511937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:47.512309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:47.512322Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:47.512324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:47.512328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:47.512333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1796 [2:7559601776363225611:10148]
2025-10-10T14:35:47.512346Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:47.512363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:47.512371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.512375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.512378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.512394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:47.512406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:47.512417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:47.512479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.512491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.512493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.512495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:47.512575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:47.512578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.512589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.512601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.512676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1796
2025-10-10T14:35:47.512695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1796
2025-10-10T14:35:47.512686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:47.512715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454177:2438], now have 1 active actors on pipe
2025-10-10T14:35:47.512719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454306:6975], now have 1 active actors on pipe
2025-10-10T14:35:47.512727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601776363225606:10148]
2025-10-10T14:35:47.512729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601776363225606:10148]
2025-10-10T14:35:47.512731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601776363225606:10148]
2025-10-10T14:35:47.512741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:47.512751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:47.512754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:47.512756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:47.512758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:47.512776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:47.512788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:47.512806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.512811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.512851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601776363225606:10148]
2025-10-10T14:35:47.512865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:47.512871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:47.512885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:47.512898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.512906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.512908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:47.512920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.512936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:47.512970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.513107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.513116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.513131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.513210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1797 partition: 0 MaxSeqNo: 40 sessionId: src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0
2025-10-10T14:35:47.513604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5d6243e-96be6751-a14f0b3f-bf4f7115_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:47.516573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0] Write session: try to update token
2025-10-10T14:35:47.516594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:47.531566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId: src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:47.532555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:47.532573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:47.532577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:47.532579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:47.532589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601776363225606:10148]
2025-10-10T14:35:47.532594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601776363225606:10148]
2025-10-10T14:35:47.532598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601776363225606:10148]
2025-10-10T14:35:47.532650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:47.532663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.532665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:47.532814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:47.532828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:47.532832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:47.532839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:47.534361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:47.593418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601777145454313:7726]
2025-10-10T14:35:47.593711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1796, pipe: [1:7559601777145454313:7726]
2025-10-10T14:35:47.645116Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:47.645670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.645698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.645748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454313:7726], now have 1 active actors on pipe
2025-10-10T14:35:47.646044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:47.646051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:47.646119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601777145454313:7726]
2025-10-10T14:35:47.646145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:47.646153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:47.646615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:47.646627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0] Write session will restart in 0.006191s
2025-10-10T14:35:47.646653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0] Write session: Do CDS request
2025-10-10T14:35:47.646660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:47.646213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1797 reason: error at write: Disconnected sessionId: src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0
2025-10-10T14:35:47.646430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1797 sessionId: src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0 is DEAD
2025-10-10T14:35:47.653970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.654125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:47.654147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1798
2025-10-10T14:35:47.654289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.654329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:47.654350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:47.654360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:47.654879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1798 sessionId:  describe result for acl check
2025-10-10T14:35:47.654920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:47.654926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:47.654929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:47.654935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601777145454379:6971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:47.655524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601777145454379:6971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:47.658053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601777145454379:6971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:47.659518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:47.661672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:47.661887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601777145454379:6971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:47.661905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601777145454379:6971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:47.661909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601777145454379:6971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:47.661918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:47.661934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:47.661947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:47.661960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:47.662037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:47.662085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601776363225744:10150]
2025-10-10T14:35:47.662709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:47.663030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:47.663084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:47.663403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:47.663477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.663484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.663485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.663486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.663487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.663488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.663490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.663491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.663493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.663494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.663496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.663497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.663499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.663506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.663520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.663524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.663528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.663532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.663536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.663540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.663544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.663548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.663553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.663556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.663560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.663564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.663572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.663581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.663589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.663595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.663600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.663605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.663610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.663616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.663621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.663626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.663631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.663637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.663642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.663656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.663661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.663666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.663677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.663682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.663692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.663697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.663702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.663707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.663712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.663717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.663722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.663727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.663771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:47.666675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:47.667292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:47.667307Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:47.667309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:47.667314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:47.667323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1797 [2:7559601776363225744:10150]
2025-10-10T14:35:47.667337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:47.667358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:47.667366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.667370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.667373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.667391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:47.667405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:47.667413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:47.667476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.667484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.667486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.667489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:47.667564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:47.667572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.667586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.667600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.667619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:47.667647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601776363225739:10150]
2025-10-10T14:35:47.667654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601776363225739:10150]
2025-10-10T14:35:47.667656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601776363225739:10150]
2025-10-10T14:35:47.667666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:47.667676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:47.667679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:47.667682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:47.667686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:47.667704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:47.667712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:47.667724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454315:2438], now have 1 active actors on pipe
2025-10-10T14:35:47.667733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454440:6971], now have 1 active actors on pipe
2025-10-10T14:35:47.667768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601776363225739:10150]
2025-10-10T14:35:47.667782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:47.667843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1797
2025-10-10T14:35:47.667904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1797
2025-10-10T14:35:47.667981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:47.668079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.668091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.668124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:47.668133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.668140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.668147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:47.668160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.668188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:47.668215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.668502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.668511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.668532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.668659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1798 partition: 0 MaxSeqNo: 40 sessionId: src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0
2025-10-10T14:35:47.671826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|680e2a66-9ae3ac53-ddad58bd-8864cd9c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:47.674661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0] Write session: try to update token
2025-10-10T14:35:47.674683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:47.699166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId: src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:47.701842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:47.704947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.704973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.706920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:47.706962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:47.706966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:47.706969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:47.706971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:47.706980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601776363225739:10150]
2025-10-10T14:35:47.706984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601776363225739:10150]
2025-10-10T14:35:47.706988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601776363225739:10150]
2025-10-10T14:35:47.707034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:47.707043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.707045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:47.707184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:47.709441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:47.709449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:47.709453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:47.709952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:47.746005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601777145454461:7726]
2025-10-10T14:35:47.746386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1797, pipe: [1:7559601777145454461:7726]
2025-10-10T14:35:47.822209Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:47.830126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.830154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.830316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.830381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.830467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.830535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.830588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.830600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.830671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.830734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.830802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.830868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.830911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.830918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.830985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.831090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.831153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.831226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.831272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.831279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.831352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.831419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.831490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.831559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.831605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.831613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.831681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.831783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.831849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.831913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.831958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.831967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.832058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.832121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.832189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.832254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.832301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.832310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.832380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.832443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.832508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.832580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.832647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.832654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.832724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.832790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.832861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.832934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.832981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.832988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.833057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.833120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.833179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.833242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.833303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.833312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.833397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:47.833466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:47.833526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:47.833627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:47.833915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:47.833924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:47.833979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454461:7726], now have 1 active actors on pipe
2025-10-10T14:35:47.834168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:47.834186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601777145454461:7726]
2025-10-10T14:35:47.834218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:47.834227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:47.834260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1798 reason: error at write: Disconnected sessionId: src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0
2025-10-10T14:35:47.834516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1798 sessionId: src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0 is DEAD
2025-10-10T14:35:47.834699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:47.834712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0] Write session will restart in 0.005528s
2025-10-10T14:35:47.834740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0] Write session: Do CDS request
2025-10-10T14:35:47.834746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:47.834796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:47.841879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.842144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:47.842163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1799
2025-10-10T14:35:47.842304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:47.842364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:47.842376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:47.842381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:47.842952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1799 sessionId:  describe result for acl check
2025-10-10T14:35:47.842990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:47.842998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:47.843000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:47.843007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601777145454513:6963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:47.843578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601777145454513:6963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:47.846173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601777145454513:6963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:47.847666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:47.849371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:47.849567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:47.849578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:47.849589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:47.849642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:47.849694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601776363225892:10153]
2025-10-10T14:35:47.849746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601777145454513:6963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:47.849763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601777145454513:6963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:47.849768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601777145454513:6963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:47.849777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:47.850371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:47.850643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:47.850680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:47.850990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:47.851040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.851046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.851047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.851048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.851050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.851051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.851052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.851053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.851055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.851056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.851057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.851059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.851060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.851065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.851079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.851083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.851087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.851092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.851096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.851100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.851104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.851108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.851112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.851117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.851121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.851125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.851132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.851142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:47.851153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.851159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:47.851168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.851173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:47.851178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.851185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:47.851190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.851199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:47.851203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.851208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:47.851217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.851222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:47.851227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.851232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:47.851242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.851247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:47.851252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.851257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:47.851261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.851267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.851272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.851277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.851287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.851292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.851332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:47.853732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:47.854046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:47.854056Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:47.854059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:47.854064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:47.854070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1798 [2:7559601776363225892:10153]
2025-10-10T14:35:47.854083Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:47.854104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:47.854111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.854115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.854118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.854135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:47.854147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:47.854157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:47.854219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.854226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.854228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.854230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:47.854298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:47.854305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.854316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:47.854332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:47.854354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:47.854379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454476:2438], now have 1 active actors on pipe
2025-10-10T14:35:47.854389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454602:6963], now have 1 active actors on pipe
2025-10-10T14:35:47.854397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601776363225887:10153]
2025-10-10T14:35:47.854399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601776363225887:10153]
2025-10-10T14:35:47.854401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601776363225887:10153]
2025-10-10T14:35:47.854427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:47.854437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:47.854441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:47.854441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:47.854444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:47.854458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:47.854462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:47.854450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1798
2025-10-10T14:35:47.854484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601776363225887:10153]
2025-10-10T14:35:47.854492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:47.854494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:47.854466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1798
2025-10-10T14:35:47.854510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.854518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.854569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:47.854581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:47.854585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:47.854587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:47.854597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:47.854608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:47.854629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.854787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.854794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.854808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:47.854895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1799 partition: 0 MaxSeqNo: 40 sessionId: src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0
2025-10-10T14:35:47.855315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db0eb434-29c1333e-f93c16fb-9635b8e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:47.858187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0] Write session: try to update token
2025-10-10T14:35:47.858205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:47.873055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId: src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:47.875773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:47.876007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:47.876030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:47.876074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:47.876180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:47.878801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:47.878821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:47.878825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:47.878827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:47.878837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601776363225887:10153]
2025-10-10T14:35:47.878842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601776363225887:10153]
2025-10-10T14:35:47.878846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601776363225887:10153]
2025-10-10T14:35:47.878895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:47.878898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:47.878906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:47.878908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:47.878911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:47.878911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:47.879047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:47.934429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601777145454613:7726]
2025-10-10T14:35:47.934748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1798, pipe: [1:7559601777145454613:7726]
2025-10-10T14:35:47.992335Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:48.000774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.000806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.000995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.001073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.001142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.001214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.001519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.001532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.001605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.001685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.001758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.001835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.001882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.001889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.001992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.002063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.002132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.002202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.002254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.002262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.002337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.002413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.002480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.002577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.002641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.002649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.002721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.002783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.002852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.002920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.002967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.002976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.003084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.003151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.003393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.003465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.003513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.003523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.003595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.003701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.003805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.003916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.003966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.003973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.004043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.004107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.004177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.004244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.004296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.004303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.004374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.004434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.004499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.004566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.004629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.004637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.004707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.004772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.004847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.004920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.004967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.004974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.005037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601777145454613:7726], now have 1 active actors on pipe
2025-10-10T14:35:48.005526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:48.005543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601777145454613:7726]
2025-10-10T14:35:48.005573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:48.005576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:48.005605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1799 reason: error at write: Disconnected sessionId: src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0
2025-10-10T14:35:48.005837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1799 sessionId: src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0 is DEAD
2025-10-10T14:35:48.006373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:48.009581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:48.009595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0] Write session will restart in 0.007877s
2025-10-10T14:35:48.009623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0] Write session: Do CDS request
2025-10-10T14:35:48.009630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:48.018823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.019169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:48.019188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1800
2025-10-10T14:35:48.019315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.019347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:48.019353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:48.019357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:48.019895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1800 sessionId:  describe result for acl check
2025-10-10T14:35:48.019938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:48.019940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:48.019942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:48.019950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601781440421928:6961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:48.020558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601781440421928:6961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:48.024213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601781440421928:6961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:48.028190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601781440421928:6961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:48.028206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601781440421928:6961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:48.028210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601781440421928:6961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:48.028221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:48.029711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:48.031666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:48.031886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:48.031899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:48.031910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:48.031961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:48.032005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601780658193324:10156]
2025-10-10T14:35:48.032626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:48.033010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:48.033057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:48.033418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:48.033479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.033486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.033487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.033489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.033490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.033492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.033494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.033496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.033497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.033498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.033500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.033501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.033502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.033508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.033522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.033527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.033531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.033535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.033540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.033545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.033549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.033554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.033558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.033562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.033566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.033569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.033575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.033584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.033591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.033598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.033603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.033609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.033613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.033619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.033624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.033630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.033635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.033642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.033647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.033662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.033667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.033684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.033689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.033695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.033700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.033707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.033717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.033723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.033729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.033739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.033744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.033755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.033800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:48.036315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:48.036923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:48.036936Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:48.036938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:48.036942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:48.036948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1799 [2:7559601780658193324:10156]
2025-10-10T14:35:48.036966Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:48.036989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:48.036997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.037001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.037004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.037020Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:48.037032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:48.037044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:48.037107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.037114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.037116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.037119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:48.037186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:48.037193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.037205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.037223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.037246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:48.037272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440421911:2438], now have 1 active actors on pipe
2025-10-10T14:35:48.037280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422035:6961], now have 1 active actors on pipe
2025-10-10T14:35:48.037288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601780658193319:10156]
2025-10-10T14:35:48.037295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601780658193319:10156]
2025-10-10T14:35:48.037297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601780658193319:10156]
2025-10-10T14:35:48.037314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:48.037349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:48.037373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:48.037381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:48.037406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601780658193319:10156]
2025-10-10T14:35:48.037413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:48.037492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:48.037369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1799
2025-10-10T14:35:48.037499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:48.037424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1799
2025-10-10T14:35:48.037502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:48.037508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:48.037741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.037752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.037786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:48.037798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.037809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.037816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:48.037828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.037854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:48.037876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.040214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.040231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.040261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.040928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e75b8-2c897911-99f17e1f-e003e0dd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:48.040448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1800 partition: 0 MaxSeqNo: 40 sessionId: src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0
2025-10-10T14:35:48.043641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0] Write session: try to update token
2025-10-10T14:35:48.043660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:48.059584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:48.059612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.059627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601780658193319:10156]
2025-10-10T14:35:48.059688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:48.059696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:48.059895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:48.060056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.060209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.060352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.060553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:48.060616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:48.066784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId: src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:48.069658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:48.070138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.070168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.070193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:48.070197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.070201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:48.070203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:48.070213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601780658193319:10156]
2025-10-10T14:35:48.070222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601780658193319:10156]
2025-10-10T14:35:48.070227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601780658193319:10156]
2025-10-10T14:35:48.070273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:48.070286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:48.070291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:48.070292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:48.070299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.070301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:48.070444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:48.105940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601781440422050:7726]
2025-10-10T14:35:48.106298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1799, pipe: [1:7559601781440422050:7726]
2025-10-10T14:35:48.184528Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:48.184806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:48.184846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422050:7726], now have 1 active actors on pipe
2025-10-10T14:35:48.184966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:48.184984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:48.185040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601781440422050:7726]
2025-10-10T14:35:48.196517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:48.196942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:48.196955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0] Write session will restart in 0.009671s
2025-10-10T14:35:48.196989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0] Write session: Do CDS request
2025-10-10T14:35:48.196995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:48.196601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:48.196619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:48.196646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1800 reason: error at write: Disconnected sessionId: src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0
2025-10-10T14:35:48.196794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1800 sessionId: src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0 is DEAD
2025-10-10T14:35:48.203325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:48.203596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:48.203610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:48.203624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:48.203692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:48.203736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601780658193459:10158]
2025-10-10T14:35:48.204358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:48.204709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:48.204758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:48.205086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:48.205149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.205156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.205157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.205158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.205159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.205161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.205162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.205163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.205164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.205166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.205167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.205168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.205170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.205177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.205190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.205195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.205200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.205204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.205208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.205212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.205216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.205220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.205225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.205229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.205233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.205236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.205247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.205260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.205266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.205277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.205284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.205290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.205300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.205305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.205317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.205324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.205350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.205360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.205365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.205375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.205380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.205385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.205390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.205399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.205405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.205414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.205419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.205429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.205433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.205443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.205448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.205454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.205499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:48.208030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.208062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:48.208082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1801
2025-10-10T14:35:48.208230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:48.208286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.208331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:48.208342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:48.208346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:48.208731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:48.208743Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:48.208746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:48.208749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:48.208758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1800 [2:7559601780658193459:10158]
2025-10-10T14:35:48.208771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:48.208789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:48.208798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.208801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.208803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.208822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:48.208833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:48.208841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:48.208830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1801 sessionId:  describe result for acl check
2025-10-10T14:35:48.208872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:48.208879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:48.208881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:48.208887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601781440422156:6956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:48.208917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.208924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.208926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.208928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:48.208998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:48.209007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.209018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.209030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.209050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:48.209080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422052:2438], now have 1 active actors on pipe
2025-10-10T14:35:48.209092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601780658193453:10158]
2025-10-10T14:35:48.209095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601780658193453:10158]
2025-10-10T14:35:48.209097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601780658193453:10158]
2025-10-10T14:35:48.209110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:48.209126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:48.209132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:48.209125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1800
2025-10-10T14:35:48.209141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:48.209144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:48.209148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:48.209151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:48.209182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601780658193453:10158]
2025-10-10T14:35:48.209191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:48.209195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:48.209509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601781440422156:6956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:48.212658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601781440422156:6956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:48.219691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601781440422156:6956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:48.219710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601781440422156:6956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:48.219723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601781440422156:6956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:48.219734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:48.220092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1800
2025-10-10T14:35:48.220443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422191:6956], now have 1 active actors on pipe
2025-10-10T14:35:48.220477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.220485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.220508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:48.220516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.220527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601780658193453:10158]
2025-10-10T14:35:48.220567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:48.220585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:48.220603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.220617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.220624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:48.220641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.220664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:48.220683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:48.220851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:48.220991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.221129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.221265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.221472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:48.221516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.221543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:48.221766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.221776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.221796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.221947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1801 partition: 0 MaxSeqNo: 40 sessionId: src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0
2025-10-10T14:35:48.222351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fb8e614-e112f674-c43f9479-840cf8ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:48.225090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0] Write session: try to update token
2025-10-10T14:35:48.225108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:48.238696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:48.238720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.238724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:48.238731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:48.238743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601780658193453:10158]
2025-10-10T14:35:48.238750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601780658193453:10158]
2025-10-10T14:35:48.238753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601780658193453:10158]
2025-10-10T14:35:48.238805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:48.238807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:48.238816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.238819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:48.238820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:48.238824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:48.238963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:48.240751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId: src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:48.243566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:48.285135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601781440422192:7726]
2025-10-10T14:35:48.285655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1800, pipe: [1:7559601781440422192:7726]
2025-10-10T14:35:48.350477Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:48.350882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.350908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.350948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422192:7726], now have 1 active actors on pipe
2025-10-10T14:35:48.351176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:48.351186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601781440422192:7726]
2025-10-10T14:35:48.351179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:48.351193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:48.351221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:48.351253Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:35:48.351271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1801 reason: error at write: Disconnected sessionId: src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0
2025-10-10T14:35:48.351359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1801 sessionId: src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0 is DEAD
2025-10-10T14:35:48.351508Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 18 consumer shared/user session shared/user_1_18_1003019182380050341_v1 is DEAD
2025-10-10T14:35:48.351632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:48.351647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0] Write session will restart in 0.006530s
2025-10-10T14:35:48.351631Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:35:48.351673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0] Write session: Do CDS request
2025-10-10T14:35:48.351678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:48.351718Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601708425960150:7737] disconnected; active server actors: 1
2025-10-10T14:35:48.351729Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601708425960150:7737] client user disconnected session shared/user_1_18_1003019182380050341_v1
2025-10-10T14:35:48.351765Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:35:48.351770Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:35:48.351777Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.008425s
2025-10-10T14:35:48.359004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.359126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:48.359149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1802
2025-10-10T14:35:48.359314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.359352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:48.359363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:48.359368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:48.359921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1802 sessionId:  describe result for acl check
2025-10-10T14:35:48.359966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:48.359973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:48.359975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:48.359983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601781440422209:6947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:48.360730Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:35:48.360610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601781440422209:6947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:48.360935Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:35:48.360946Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 19
2025-10-10T14:35:48.361102Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 19 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:35:48.361190Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:35:48.361298Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 auth for : user
2025-10-10T14:35:48.361514Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 Handle describe topics response
2025-10-10T14:35:48.361545Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 auth is DEAD
2025-10-10T14:35:48.361556Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:35:48.361838Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:35:48.361943Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_19_15451886264104792848_v1
2025-10-10T14:35:48.362262Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601781440422255:6942] connected; active server actors: 1
2025-10-10T14:35:48.362561Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601781440422255:6942] session shared/user_1_19_15451886264104792848_v1
2025-10-10T14:35:48.362582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:35:48.362594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:35:48.362601Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_19_15451886264104792848_v1" (Sender=[1:7559601781440422225:6942], Pipe=[1:7559601781440422255:6942], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:35:48.362605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:35:48.362619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:35:48.362628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_19_15451886264104792848_v1" (Sender=[1:7559601781440422225:6942], Pipe=[1:7559601781440422255:6942], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:35:48.362639Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_19_15451886264104792848_v1" sender [1:7559601781440422225:6942] lock partition 0 for ReadingSession "shared/user_1_19_15451886264104792848_v1" (Sender=[1:7559601781440422225:6942], Pipe=[1:7559601781440422255:6942], Partitions=[], ActiveFamilyCount=1) generation 1 step 19
2025-10-10T14:35:48.362647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:35:48.362651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-10-10T14:35:48.362896Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 19 Session: "shared/user_1_19_15451886264104792848_v1" ClientId: "user" PipeClient { RawX1: 7559601781440422255 RawX2: 4503603922344734 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:35:48.362912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:35:48.363751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601781440422209:6947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:48.366090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:48.366277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601781440422209:6947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:48.366295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601781440422209:6947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:48.366298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601781440422209:6947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:48.366307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:48.366786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:48.366975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:48.366985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:48.366996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:48.367049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:48.367089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601780658193598:10160]
2025-10-10T14:35:48.367764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:48.368102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:48.368140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:48.368461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:48.368511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.368517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.368519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.368520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.368521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.368523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.368524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.368526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.368527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.368528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.368529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.368531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.368532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.368537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.368550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.368554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.368558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.368561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.368566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.368569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.368573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.368577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.368584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.368587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.368591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.368595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.368603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.368611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.368617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.368622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.368627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.368632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.368636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.368642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.368648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.368652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.368656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.368661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.368668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.368675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.368688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.368694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.368699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.368704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.368708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.368713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.368717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.368727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.368731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.368737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.368746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.368750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.368783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:48.371293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:48.371812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:48.371826Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:48.371830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:48.371834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:48.371840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1801 [2:7559601780658193598:10160]
2025-10-10T14:35:48.371853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:48.371871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:48.371874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.371878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.371881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.371899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:48.371915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:48.371923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:48.371983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.371990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.371992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.371995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:48.372059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:48.372067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.372079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.372095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.372116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:48.372143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422194:2438], now have 1 active actors on pipe
2025-10-10T14:35:48.372151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422330:6947], now have 1 active actors on pipe
2025-10-10T14:35:48.372154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422288:6939], now have 1 active actors on pipe
2025-10-10T14:35:48.372162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601780658193592:10160]
2025-10-10T14:35:48.372164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601780658193592:10160]
2025-10-10T14:35:48.372166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601780658193592:10160]
2025-10-10T14:35:48.372183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:48.372218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:48.372217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:48.372220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:48.372223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:48.372237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:48.372241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:48.372226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1801
2025-10-10T14:35:48.372254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1801
2025-10-10T14:35:48.372274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601780658193592:10160]
2025-10-10T14:35:48.372276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1801, pipe: [1:7559601781440422288:6939]
2025-10-10T14:35:48.372284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:48.372290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:48.372298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.372306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.372346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.372352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.372358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_19_15451886264104792848_v1 on pipe: [1:7559601781440422288:6939]
2025-10-10T14:35:48.372392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|873db91b-4215368d-bc1f2af9-c7a12536_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:48.372405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.372417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.372416Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_19_15451886264104792848_v1:1 with generation 1801
2025-10-10T14:35:48.372420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:48.372431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.372441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:48.372458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.372462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.372464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:48.372480Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_19_15451886264104792848_v1
2025-10-10T14:35:48.372487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.372514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.372532Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:35:48.372656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.372664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.372678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.372828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1802 partition: 0 MaxSeqNo: 40 sessionId: src_id|873db91b-4215368d-bc1f2af9-c7a12536_0
2025-10-10T14:35:48.373221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bfac390-a2d59812-6c3cb2d1-b6bf6fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|873db91b-4215368d-bc1f2af9-c7a12536_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:48.376125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873db91b-4215368d-bc1f2af9-c7a12536_0] Write session: try to update token
2025-10-10T14:35:48.376146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873db91b-4215368d-bc1f2af9-c7a12536_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:48.376971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:35:48.377005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:35:48.377015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.377018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.377020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.377030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:35:48.377048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:35:48.377291Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106948372 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:35:48.377321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:35:48.377377Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 sending to client partition status
2025-10-10T14:35:48.390741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId: src_id|873db91b-4215368d-bc1f2af9-c7a12536_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:48.391851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:48.391872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.391876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:48.391877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:48.391887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601780658193592:10160]
2025-10-10T14:35:48.391892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601780658193592:10160]
2025-10-10T14:35:48.391896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601780658193592:10160]
2025-10-10T14:35:48.391941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:48.391946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:48.391948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:48.391953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:48.391954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.391956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:48.392112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:48.393512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:48.520317Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:48.520604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.520620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.520884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:48.520907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:48.520912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:48.520952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601781440422288:6939]
2025-10-10T14:35:48.521008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1802 reason: error at write: Disconnected sessionId: src_id|873db91b-4215368d-bc1f2af9-c7a12536_0
2025-10-10T14:35:48.521172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_19_15451886264104792848_v1
2025-10-10T14:35:48.521197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:48.521217Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_19_15451886264104792848_v1
2025-10-10T14:35:48.521419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873db91b-4215368d-bc1f2af9-c7a12536_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:48.521432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873db91b-4215368d-bc1f2af9-c7a12536_0] Write session will restart in 0.007499s
2025-10-10T14:35:48.521223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1802 sessionId: src_id|873db91b-4215368d-bc1f2af9-c7a12536_0 is DEAD
2025-10-10T14:35:48.521477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873db91b-4215368d-bc1f2af9-c7a12536_0] Write session: Do CDS request
2025-10-10T14:35:48.521484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873db91b-4215368d-bc1f2af9-c7a12536_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:48.529920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|873db91b-4215368d-bc1f2af9-c7a12536_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.530020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:48.530039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1803
2025-10-10T14:35:48.531574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.531625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:48.531638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:48.531643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:48.532121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1803 sessionId:  describe result for acl check
2025-10-10T14:35:48.532162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:48.532170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:48.532172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:48.532179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601781440422467:6924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:48.532762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601781440422467:6924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:48.533878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:48.535981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601781440422467:6924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:48.539457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:48.539773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601781440422467:6924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:48.539793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:48.539791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601781440422467:6924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:48.539808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:48.539795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601781440422467:6924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:48.539824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:48.539803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:48.539901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:48.539947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601780658193775:10175]
2025-10-10T14:35:48.540614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:48.540921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:48.540970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:48.541295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:48.541455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.541463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.541464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.541466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.541467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.541469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.541470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.541471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.541473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.541474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.541475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.541476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.541478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.541486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.541499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.541504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.541508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.541512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.541517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.541521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.541525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.541530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.541534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.541538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.541542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.541546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.541558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.541567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.541574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.541581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.541586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.541592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.541596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.541610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.541615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.541626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.541631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.541637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.541642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.541647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.541651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.541675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.541686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.541691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.541696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.541701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.541711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.541717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.541726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.541732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.541742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.541747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.541797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:48.544433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:48.544988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:48.545002Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:48.545005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:48.545008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:48.545015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1802 [2:7559601780658193775:10175]
2025-10-10T14:35:48.545029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:48.545051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:48.545060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.545064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.545066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.545087Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:48.545101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:48.545113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:48.545176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.545183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.545185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.545188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:48.545256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:48.545263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.545277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.545294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.545319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:48.545363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422497:6924], now have 1 active actors on pipe
2025-10-10T14:35:48.545372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422370:2438], now have 1 active actors on pipe
2025-10-10T14:35:48.545380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601780658193770:10175]
2025-10-10T14:35:48.545387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601780658193770:10175]
2025-10-10T14:35:48.545389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601780658193770:10175]
2025-10-10T14:35:48.545403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:48.545417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:48.545421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:48.545428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:48.545431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:48.545440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:48.545444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:48.545470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601780658193770:10175]
2025-10-10T14:35:48.545484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:48.545490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:48.545622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1802
2025-10-10T14:35:48.545668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1802
2025-10-10T14:35:48.545716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.545729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.545859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4881477-daf473b4-788d7abb-61b5812b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:48.545875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.545887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.545890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:48.545902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.545915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:48.545938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.546733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.546748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.546771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.546915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1803 partition: 0 MaxSeqNo: 40 sessionId: src_id|4881477-daf473b4-788d7abb-61b5812b_0
2025-10-10T14:35:48.547340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|873db91b-4215368d-bc1f2af9-c7a12536_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4881477-daf473b4-788d7abb-61b5812b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:48.550310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4881477-daf473b4-788d7abb-61b5812b_0] Write session: try to update token
2025-10-10T14:35:48.550330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4881477-daf473b4-788d7abb-61b5812b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:48.557084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:48.557103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.557115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601780658193770:10175]
2025-10-10T14:35:48.557165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:48.557165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:48.557362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:48.557509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.557694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.557826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.558014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:48.558051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:48.573222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId: src_id|4881477-daf473b4-788d7abb-61b5812b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:48.575746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:48.575997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.576019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.576062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:48.576148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:48.578258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:48.578277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.578280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:48.578282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:48.578292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601780658193770:10175]
2025-10-10T14:35:48.578296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601780658193770:10175]
2025-10-10T14:35:48.578300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601780658193770:10175]
2025-10-10T14:35:48.578352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:48.578356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:48.578358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:48.578363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:48.578367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.578369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:48.578508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:48.621024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601781440422508:6939]
2025-10-10T14:35:48.621370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1802, pipe: [1:7559601781440422508:6939]
2025-10-10T14:35:48.690283Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:48.698712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.698742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.698919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.698980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.699044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.699109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.699490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.699503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.699570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.699637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.699695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.699757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.699794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.699798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.699868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.699924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.699981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.700042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.700081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.700084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.700146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.700440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.700500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.700559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.700602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.700605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.700668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.700734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.700793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.700851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.700888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.700890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.700956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.701019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.701078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.701135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.701192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.701195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.701263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.701318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.701554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.701623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.701711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.701714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.701815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.701870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.701929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.701991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.702029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.702032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.702100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.702156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.702219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.702277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.702387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.702390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.702455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:48.702535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:48.702600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:48.702659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:48.702782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:48.702785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:48.702854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422508:6939], now have 1 active actors on pipe
2025-10-10T14:35:48.703692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:48.704893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4881477-daf473b4-788d7abb-61b5812b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:48.704905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4881477-daf473b4-788d7abb-61b5812b_0] Write session will restart in 0.006662s
2025-10-10T14:35:48.704930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4881477-daf473b4-788d7abb-61b5812b_0] Write session: Do CDS request
2025-10-10T14:35:48.704936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4881477-daf473b4-788d7abb-61b5812b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:48.704148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:48.704216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601781440422508:6939]
2025-10-10T14:35:48.704240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:48.704275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1803 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4881477-daf473b4-788d7abb-61b5812b_0
2025-10-10T14:35:48.704551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1803 sessionId: src_id|4881477-daf473b4-788d7abb-61b5812b_0 is DEAD
2025-10-10T14:35:48.712873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4881477-daf473b4-788d7abb-61b5812b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.713142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:48.713158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1804
2025-10-10T14:35:48.713294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.713325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:48.713350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:48.713354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:48.717827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1804 sessionId:  describe result for acl check
2025-10-10T14:35:48.717871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:48.717873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:48.717875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:48.717883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601781440422601:6920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:48.718493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601781440422601:6920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:48.721791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:48.724013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:48.724228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:48.724233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:48.724245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:48.724304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:48.724340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601780658193914:10177]
2025-10-10T14:35:48.724972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:48.725411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:48.725457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:48.725837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:48.725897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.725898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.725900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.725901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.725903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.725904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.725905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.725907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.725908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.725909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.725911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.725912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.725914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.725920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.725933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.725938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.725943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.725947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.725951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.725955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.725959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.725963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.725968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.725972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.725976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.725980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.725987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.725997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.726004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.726009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.726013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.726018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.726023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.726029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.726034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.726040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.726044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.726049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.726054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.726058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.726062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.726068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.726072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.726077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.726082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.726087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.726091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.726095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.726099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.726104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.726110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.726116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.726156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:48.727174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601781440422601:6920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:48.728726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:48.729264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:48.729269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:48.729272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:48.729277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:48.729283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1803 [2:7559601780658193914:10177]
2025-10-10T14:35:48.729298Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:48.729315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:48.729319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.729324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.729326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.729364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:48.729372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:48.729380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:48.729440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.729443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.729445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.729447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:48.729516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:48.729519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.729530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.729542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.729559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:48.729579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601780658193908:10177]
2025-10-10T14:35:48.729582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601780658193908:10177]
2025-10-10T14:35:48.729585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601780658193908:10177]
2025-10-10T14:35:48.729598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:48.729614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:48.729632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:48.729636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:48.729675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601780658193908:10177]
2025-10-10T14:35:48.729678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:48.729877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:48.729884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:48.729886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:48.729892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:48.730355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422516:2438], now have 1 active actors on pipe
2025-10-10T14:35:48.733207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1803
2025-10-10T14:35:48.741084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601781440422601:6920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:48.741102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601781440422601:6920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:48.741106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601781440422601:6920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:48.741118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:48.741806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1803
2025-10-10T14:35:48.742449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422655:6920], now have 1 active actors on pipe
2025-10-10T14:35:48.742481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.742489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.742510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:48.742514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.742523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601780658193908:10177]
2025-10-10T14:35:48.742566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:48.742580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:48.742593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.742600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.742603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:48.742618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.742636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:48.742653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:48.742827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:48.742960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.743097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.743230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:48.743415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:48.743452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.743476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:48.745087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.745102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.745130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.745274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1804 partition: 0 MaxSeqNo: 40 sessionId: src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0
2025-10-10T14:35:48.745776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4881477-daf473b4-788d7abb-61b5812b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:48.748190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0] Write session: try to update token
2025-10-10T14:35:48.748209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:48.762141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:48.762161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.762164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:48.762166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:48.762177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601780658193908:10177]
2025-10-10T14:35:48.762181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601780658193908:10177]
2025-10-10T14:35:48.762185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601780658193908:10177]
2025-10-10T14:35:48.762231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:48.762239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.762241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:48.762373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:48.764411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:48.764437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:48.764442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:48.771236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId: src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:48.774448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:48.804300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601781440422674:6939]
2025-10-10T14:35:48.804793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1803, pipe: [1:7559601781440422674:6939]
2025-10-10T14:35:48.880907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:48.881379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.881398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.881424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422674:6939], now have 1 active actors on pipe
2025-10-10T14:35:48.881807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:48.882747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601781440422674:6939]
2025-10-10T14:35:48.882787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:48.882873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1804 reason: status is not ok: tablet will be restarted right now sessionId: src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0
2025-10-10T14:35:48.883099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1804 sessionId: src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0 is DEAD
2025-10-10T14:35:48.883132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:48.883261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:48.883273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0] Write session will restart in 0.005831s
2025-10-10T14:35:48.883299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0] Write session: Do CDS request
2025-10-10T14:35:48.883305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:48.889922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.890418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:48.890436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1805
2025-10-10T14:35:48.890573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:48.890603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:48.890609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:48.890613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:48.891165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1805 sessionId:  describe result for acl check
2025-10-10T14:35:48.891215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:48.891222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:48.891224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:48.891231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601781440422719:6912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:48.891833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601781440422719:6912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:48.894091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601781440422719:6912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:48.895811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:48.897833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:48.898077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:48.898089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:48.898102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:48.898154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:48.898193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601780658194068:10181]
2025-10-10T14:35:48.898213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601781440422719:6912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:48.898231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601781440422719:6912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:48.898235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601781440422719:6912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:48.898243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:48.898837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:48.899204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:48.899284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:48.899615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:48.899675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.899682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.899684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.899685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.899686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.899688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.899689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.899691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.899692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.899693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.899694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.899696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.899697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.899703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.899716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.899720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.899724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.899728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.899732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.899736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.899740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.899744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.899748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.899752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.899756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.899760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.899781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.899790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:48.899797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.899802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:48.899807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.899811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:48.899814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.899819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:48.899824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.899829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:48.899833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.899837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:48.899842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.899847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:48.899852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.899857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:48.899865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.899870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:48.899874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.899880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:48.899884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.899889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.899893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.899899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.899904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.899909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.899951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:48.902426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:48.903040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:48.903052Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:48.903055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:48.903060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:48.903066Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1804 [2:7559601780658194068:10181]
2025-10-10T14:35:48.903080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:48.903097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:48.903106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.903110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.903112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.903131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:48.903144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:48.903154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:48.903219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.903227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.903229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.903232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:48.903304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:48.903311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.903324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:48.903341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:48.903364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:48.903392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422808:6912], now have 1 active actors on pipe
2025-10-10T14:35:48.903397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422675:2438], now have 1 active actors on pipe
2025-10-10T14:35:48.903405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601780658194063:10181]
2025-10-10T14:35:48.903409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601780658194063:10181]
2025-10-10T14:35:48.903411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601780658194063:10181]
2025-10-10T14:35:48.903427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:48.903446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:48.903450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:48.903454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:48.903456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:48.903465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:48.903468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:48.903431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1804
2025-10-10T14:35:48.903448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1804
2025-10-10T14:35:48.903507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601780658194063:10181]
2025-10-10T14:35:48.903519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:48.903534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.903541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:48.903543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.903594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:48.903607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:48.903612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:48.903614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:48.903626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:48.903637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:48.903658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.903823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:48.903831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:48.903846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:48.903935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1805 partition: 0 MaxSeqNo: 40 sessionId: src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0
2025-10-10T14:35:48.904360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efaa1528-5d05d1bc-2c9f92c6-b5905a20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:48.907112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0] Write session: try to update token
2025-10-10T14:35:48.907132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:48.923313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:48.923337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:48.923341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:48.923343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:48.923355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601780658194063:10181]
2025-10-10T14:35:48.923360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601780658194063:10181]
2025-10-10T14:35:48.923367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601780658194063:10181]
2025-10-10T14:35:48.923421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:48.923422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:48.923429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:48.923428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:48.923431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:48.923433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:48.923615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:48.924639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId: src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:48.927311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:48.982973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601781440422820:6939]
2025-10-10T14:35:48.983262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1804, pipe: [1:7559601781440422820:6939]
2025-10-10T14:35:49.037136Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:49.037591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.037609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.037670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601781440422820:6939], now have 1 active actors on pipe
2025-10-10T14:35:49.037914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:49.037916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:49.037935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:49.038011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1805 reason: error at write: Disconnected sessionId: src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0
2025-10-10T14:35:49.038095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:49.038149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601781440422820:6939]
2025-10-10T14:35:49.038246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1805 sessionId: src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0 is DEAD
2025-10-10T14:35:49.038411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:49.038419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0] Write session will restart in 0.005174s
2025-10-10T14:35:49.038456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0] Write session: Do CDS request
2025-10-10T14:35:49.038463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:49.044882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.045015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:49.045032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1806
2025-10-10T14:35:49.045176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.045210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:49.045216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:49.045219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:49.045765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1806 sessionId:  describe result for acl check
2025-10-10T14:35:49.045821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:49.045828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:49.045833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:49.045839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601785735390152:6906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:49.046408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601785735390152:6906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:49.050926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601785735390152:6906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:49.053366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:49.055377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:49.055571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601785735390152:6906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:49.055590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601785735390152:6906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:49.055594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601785735390152:6906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:49.055603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:49.055623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:49.055635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:49.055646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:49.055698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:49.055741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601784953161505:10183]
2025-10-10T14:35:49.056424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:49.056807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:49.056847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:49.057182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:49.057229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.057235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.057236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.057237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.057238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.057240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.057241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.057242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.057243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.057244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.057246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.057247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.057248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.057253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.057267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.057272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.057276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.057280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.057284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.057288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.057292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.057296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.057301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.057305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.057309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.057312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.057321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.057343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.057349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.057355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.057360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.057365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.057370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.057375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.057380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.057392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.057396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.057402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.057406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.057412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.057416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.057421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.057426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.057432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.057436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.057442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.057446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.057451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.057460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.057466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.057471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.057476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.057516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:49.060082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:49.060645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:49.060657Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:49.060660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:49.060664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:49.060670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1805 [2:7559601784953161505:10183]
2025-10-10T14:35:49.060684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:49.060703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:49.060706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.060709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.060712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.060730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:49.060739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:49.060747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:49.060813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.060815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.060818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.060820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:49.060889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:49.060896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.060908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.060925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.060946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:49.060972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601784953161499:10183]
2025-10-10T14:35:49.060979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601784953161499:10183]
2025-10-10T14:35:49.060981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601784953161499:10183]
2025-10-10T14:35:49.060991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:49.061000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:49.061006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:49.061010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:49.061013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:49.061022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:49.061025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:49.061036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390117:2438], now have 1 active actors on pipe
2025-10-10T14:35:49.061044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390250:6906], now have 1 active actors on pipe
2025-10-10T14:35:49.061069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601784953161499:10183]
2025-10-10T14:35:49.061079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:49.061087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:49.061084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1805
2025-10-10T14:35:49.061092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1805
2025-10-10T14:35:49.061304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.061314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.061356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b32e155e-ce714459-756f2c63-74494552_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:49.061371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.061376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.061379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:49.061391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.061402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:49.061419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.061596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.061616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.061641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.061774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1806 partition: 0 MaxSeqNo: 40 sessionId: src_id|b32e155e-ce714459-756f2c63-74494552_0
2025-10-10T14:35:49.062237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3216e62-c33a11b7-34e31996-4a0a643c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b32e155e-ce714459-756f2c63-74494552_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:49.065126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e155e-ce714459-756f2c63-74494552_0] Write session: try to update token
2025-10-10T14:35:49.065144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e155e-ce714459-756f2c63-74494552_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:49.089060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId: src_id|b32e155e-ce714459-756f2c63-74494552_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:49.091218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:49.091243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:49.091253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:49.091255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:49.091265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601784953161499:10183]
2025-10-10T14:35:49.091269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601784953161499:10183]
2025-10-10T14:35:49.091273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601784953161499:10183]
2025-10-10T14:35:49.091322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:49.091327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:49.091336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.091337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:49.091338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:49.091341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:49.091484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:49.092017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:49.138127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601785735390262:6939]
2025-10-10T14:35:49.138527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1805, pipe: [1:7559601785735390262:6939]
2025-10-10T14:35:49.203648Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:49.204053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.204071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.204131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390262:6939], now have 1 active actors on pipe
2025-10-10T14:35:49.204395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:49.204365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601785735390262:6939]
2025-10-10T14:35:49.204416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:49.204419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:49.204427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:49.204484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1806 reason: error at write: Disconnected sessionId: src_id|b32e155e-ce714459-756f2c63-74494552_0
2025-10-10T14:35:49.204685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1806 sessionId: src_id|b32e155e-ce714459-756f2c63-74494552_0 is DEAD
2025-10-10T14:35:49.205083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e155e-ce714459-756f2c63-74494552_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:49.205091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e155e-ce714459-756f2c63-74494552_0] Write session will restart in 0.007049s
2025-10-10T14:35:49.205115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e155e-ce714459-756f2c63-74494552_0] Write session: Do CDS request
2025-10-10T14:35:49.205124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e155e-ce714459-756f2c63-74494552_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:49.213908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e155e-ce714459-756f2c63-74494552_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.214002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:49.214028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1807
2025-10-10T14:35:49.214169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.214207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:49.214218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:49.214223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:49.214833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1807 sessionId:  describe result for acl check
2025-10-10T14:35:49.214879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:49.214887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:49.214889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:49.214896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601785735390340:6899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:49.215466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601785735390340:6899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:49.217386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601785735390340:6899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:49.217476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:49.219827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:49.220058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:49.220070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:49.220083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:49.220149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:49.220226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601784953161648:10185]
2025-10-10T14:35:49.220300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601785735390340:6899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:49.220318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601785735390340:6899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:49.220321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601785735390340:6899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:49.220329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:49.220850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:49.221214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:49.221264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:49.221626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:49.221699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.221709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.221710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.221711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.221713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.221714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.221715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.221716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.221717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.221719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.221720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.221721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.221722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.221728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.221742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.221746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.221750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.221754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.221758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.221763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.221767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.221770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.221774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.221777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.221781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.221784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.221791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.221800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.221806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.221811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.221815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.221820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.221825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.221830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.221834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.221840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.221844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.221849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.221853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.221858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.221861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.221866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.221871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.221877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.221881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.221885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.221889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.221894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.221897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.221902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.221908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.221913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.221949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:49.224473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:49.225101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:49.225114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:49.225116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:49.225120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:49.225127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1806 [2:7559601784953161648:10185]
2025-10-10T14:35:49.225139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:49.225158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:49.225163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.225167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.225170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.225188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:49.225201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:49.225210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:49.225271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.225277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.225279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.225282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:49.225414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:49.225421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.225434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.225447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.225470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:49.225497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390263:2438], now have 1 active actors on pipe
2025-10-10T14:35:49.225505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390398:6899], now have 1 active actors on pipe
2025-10-10T14:35:49.225512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601784953161643:10185]
2025-10-10T14:35:49.225514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601784953161643:10185]
2025-10-10T14:35:49.225516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601784953161643:10185]
2025-10-10T14:35:49.225493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1806
2025-10-10T14:35:49.225494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1806
2025-10-10T14:35:49.225528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:49.225538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:49.225541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:49.225548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:49.225552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:49.225564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:49.225567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:49.225586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.225596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.225651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601784953161643:10185]
2025-10-10T14:35:49.225662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:49.225679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:49.225683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:49.225691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.225695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.225698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:49.225709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.225722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:49.225762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.225893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.225900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.225914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.226015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1807 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0
2025-10-10T14:35:49.226444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b32e155e-ce714459-756f2c63-74494552_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:49.229105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0] Write session: try to update token
2025-10-10T14:35:49.229127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:49.244336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId: src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:49.244973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:49.244996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:49.245000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:49.245002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:49.245013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601784953161643:10185]
2025-10-10T14:35:49.245017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601784953161643:10185]
2025-10-10T14:35:49.245021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601784953161643:10185]
2025-10-10T14:35:49.245070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:49.245077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:49.245081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:49.245082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:49.245090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.245092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:49.245243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:49.247079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:49.304512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601785735390410:6939]
2025-10-10T14:35:49.304820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1806, pipe: [1:7559601785735390410:6939]
2025-10-10T14:35:49.359692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:49.359995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.360011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.360062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390410:6939], now have 1 active actors on pipe
2025-10-10T14:35:49.360347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:49.360394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601785735390410:6939]
2025-10-10T14:35:49.360409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:49.360413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:49.360491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1807 reason: error at write: Disconnected sessionId: src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0
2025-10-10T14:35:49.360573Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:49.360707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1807 sessionId: src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0 is DEAD
2025-10-10T14:35:49.360851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:49.360863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0] Write session will restart in 0.008663s
2025-10-10T14:35:49.360888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0] Write session: Do CDS request
2025-10-10T14:35:49.360897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:49.370963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.371082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:49.371102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1808
2025-10-10T14:35:49.371231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.371282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:49.371293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:49.371297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:49.371774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1808 sessionId:  describe result for acl check
2025-10-10T14:35:49.371820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:49.371828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:49.371830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:49.371837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601785735390513:6893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:49.372428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601785735390513:6893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:49.373320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:49.374641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601785735390513:6893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:49.375252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:49.375555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:49.375566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:49.375578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:49.375636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:49.375678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601784953161791:10187]
2025-10-10T14:35:49.376113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:49.376438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:49.376532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:49.376860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:49.376926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.376932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.376934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.376935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.376936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.376937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.376938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.376940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.376941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.376942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.376943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.376945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.376946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.376951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.376964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.376969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.376973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.376977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.376981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.376984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.376988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.376991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.376995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.376999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.377015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.377018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.377027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.377040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.377049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.377055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.377063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.377068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.377073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.377081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.377086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.377091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.377096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.377101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.377105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.377111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.377116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.377126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.377131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.377136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.377141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.377146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.377150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.377155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.377159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.377165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.377179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.377188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.377214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:49.377462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601785735390513:6893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:49.377481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601785735390513:6893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:49.377485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601785735390513:6893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:49.377493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:49.379624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:49.380103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:49.380116Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:49.380118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:49.380122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:49.380128Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1807 [2:7559601784953161791:10187]
2025-10-10T14:35:49.380142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:49.380159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:49.380162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.380166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.380168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.380187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:49.380200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:49.380218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:49.380275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.380283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.380285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.380288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:49.380356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:49.380363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.380375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.380391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.380411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:49.380437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390550:6893], now have 1 active actors on pipe
2025-10-10T14:35:49.380445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390411:2438], now have 1 active actors on pipe
2025-10-10T14:35:49.380454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601784953161786:10187]
2025-10-10T14:35:49.380456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601784953161786:10187]
2025-10-10T14:35:49.380458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601784953161786:10187]
2025-10-10T14:35:49.380471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:49.380485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:49.380489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:49.380494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:49.380497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:49.380505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:49.380509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:49.380492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1807
2025-10-10T14:35:49.380494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1807
2025-10-10T14:35:49.380534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601784953161786:10187]
2025-10-10T14:35:49.380542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:49.380558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:49.380657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.380669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.380713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a68d40a5-6d77794-2d6167f7-c833a993_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:49.380727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.380731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.380733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:49.380745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.380761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:49.380783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.380917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.380925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.380939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.381035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1808 partition: 0 MaxSeqNo: 40 sessionId: src_id|a68d40a5-6d77794-2d6167f7-c833a993_0
2025-10-10T14:35:49.381489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e7644b8-20e9e510-2cb71187-6301ded2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a68d40a5-6d77794-2d6167f7-c833a993_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:49.384259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a68d40a5-6d77794-2d6167f7-c833a993_0] Write session: try to update token
2025-10-10T14:35:49.384280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a68d40a5-6d77794-2d6167f7-c833a993_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:49.399028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId: src_id|a68d40a5-6d77794-2d6167f7-c833a993_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:49.399911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:49.399928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:49.399930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:49.399932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:49.399940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601784953161786:10187]
2025-10-10T14:35:49.399943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601784953161786:10187]
2025-10-10T14:35:49.399946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601784953161786:10187]
2025-10-10T14:35:49.399989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:49.399995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.399996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:49.400014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:49.400021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:49.400026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:49.400122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:49.401779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:49.460717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601785735390557:6939]
2025-10-10T14:35:49.461003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1807, pipe: [1:7559601785735390557:6939]
2025-10-10T14:35:49.514850Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:49.515294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.515314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.515360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390557:6939], now have 1 active actors on pipe
2025-10-10T14:35:49.515682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:49.515697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601785735390557:6939]
2025-10-10T14:35:49.515729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:49.515763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:49.515765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:49.515834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1808 reason: error at write: Disconnected sessionId: src_id|a68d40a5-6d77794-2d6167f7-c833a993_0
2025-10-10T14:35:49.516036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1808 sessionId: src_id|a68d40a5-6d77794-2d6167f7-c833a993_0 is DEAD
2025-10-10T14:35:49.516443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68d40a5-6d77794-2d6167f7-c833a993_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:49.516455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68d40a5-6d77794-2d6167f7-c833a993_0] Write session will restart in 0.006417s
2025-10-10T14:35:49.516479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68d40a5-6d77794-2d6167f7-c833a993_0] Write session: Do CDS request
2025-10-10T14:35:49.516485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68d40a5-6d77794-2d6167f7-c833a993_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:49.523884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a68d40a5-6d77794-2d6167f7-c833a993_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.523980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:49.523996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1809
2025-10-10T14:35:49.524134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.524177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:49.524186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:49.524189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:49.524549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1809 sessionId:  describe result for acl check
2025-10-10T14:35:49.524585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:49.524591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:49.524595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:49.524601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601785735390612:6880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:49.525131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601785735390612:6880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:49.527466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601785735390612:6880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:49.528295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:49.530119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:49.530421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:49.530433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:49.530445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:49.530513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:49.530552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601784953161966:10195]
2025-10-10T14:35:49.530612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601785735390612:6880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:49.530629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601785735390612:6880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:49.530633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601785735390612:6880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:49.530641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:49.531159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:49.531428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:49.531474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:49.531789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:49.531853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.531861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.531862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.531863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.531865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.531866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.531867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.531868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.531870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.531871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.531872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.531873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.531874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.531880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.531892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.531896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.531900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.531904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.531907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.531911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.531915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.531920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.531924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.531928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.531932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.531935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.531942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.531950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.531959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.531964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.531970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.531974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.531978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.531983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.531988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.531993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.531997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.532002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.532007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.532012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.532016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.532021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.532025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.532031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.532035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.532040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.532045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.532055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.532059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.532064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.532072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.532078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.532117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:49.534533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:49.535142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:49.535156Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:49.535159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:49.535163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:49.535169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1808 [2:7559601784953161966:10195]
2025-10-10T14:35:49.535182Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:49.535202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:49.535210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.535214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.535216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.535233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:49.535245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:49.535257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:49.535313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.535319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.535321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.535324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:49.535393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:49.535401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.535413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.535430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.535452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:49.535480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390572:2438], now have 1 active actors on pipe
2025-10-10T14:35:49.535487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390707:6880], now have 1 active actors on pipe
2025-10-10T14:35:49.535495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601784953161961:10195]
2025-10-10T14:35:49.535501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601784953161961:10195]
2025-10-10T14:35:49.535503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601784953161961:10195]
2025-10-10T14:35:49.535516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:49.535528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:49.535531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:49.535533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:49.535536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:49.535554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:49.535561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:49.535545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1808
2025-10-10T14:35:49.535588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1808
2025-10-10T14:35:49.535597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601784953161961:10195]
2025-10-10T14:35:49.535605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:49.535609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:49.535636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.535645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.535681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:49.535697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.535703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.535705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:49.535716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.535726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:49.535744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.535899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.535907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.535922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.535999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1809 partition: 0 MaxSeqNo: 40 sessionId: src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0
2025-10-10T14:35:49.536399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a68d40a5-6d77794-2d6167f7-c833a993_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:49.539174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0] Write session: try to update token
2025-10-10T14:35:49.539192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:49.553777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId: src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:49.555093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:49.555112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:49.555115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:49.555118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:49.555127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601784953161961:10195]
2025-10-10T14:35:49.555132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601784953161961:10195]
2025-10-10T14:35:49.555135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601784953161961:10195]
2025-10-10T14:35:49.555183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:49.555188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:49.555196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.555198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:49.555199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:49.555203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:49.555340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:49.556508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:49.615853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601785735390731:6939]
2025-10-10T14:35:49.616237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1808, pipe: [1:7559601785735390731:6939]
2025-10-10T14:35:49.673146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:49.673547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.673563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.673611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390731:6939], now have 1 active actors on pipe
2025-10-10T14:35:49.673864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:49.674495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:49.674507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0] Write session will restart in 0.005283s
2025-10-10T14:35:49.674541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0] Write session: Do CDS request
2025-10-10T14:35:49.674547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:49.673957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:49.674017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601785735390731:6939]
2025-10-10T14:35:49.674039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:49.674133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1809 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0
2025-10-10T14:35:49.674339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1809 sessionId: src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0 is DEAD
2025-10-10T14:35:49.680873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.681099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:49.681121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1810
2025-10-10T14:35:49.681250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.681285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:49.681296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:49.681301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:49.681981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1810 sessionId:  describe result for acl check
2025-10-10T14:35:49.682023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:49.682026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:49.682028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:49.682035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601785735390762:6867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:49.682600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601785735390762:6867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:49.685736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601785735390762:6867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:49.686858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:49.688765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:49.688993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:49.689005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:49.689018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:49.689086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:49.689140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601784953162118:10204]
2025-10-10T14:35:49.689358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601785735390762:6867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:49.689376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601785735390762:6867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:49.689380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601785735390762:6867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:49.689391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:49.689799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:49.690093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:49.690140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:49.690463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:49.690518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.690525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.690526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.690527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.690528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.690529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.690531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.690532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.690533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.690535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.690536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.690537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.690538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.690545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.690558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.690562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.690566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.690570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.690574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.690578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.690582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.690586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.690590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.690594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.690598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.690602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.690610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.690619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.690625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.690631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.690636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.690643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.690647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.690652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.690657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.690662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.690667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.690671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.690676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.690681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.690685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.690690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.690695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.690700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.690704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.690709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.690713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.690718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.690722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.690727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.690732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.690737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.690783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:49.693125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:49.693848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:49.693861Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:49.693863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:49.693867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:49.693873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1809 [2:7559601784953162118:10204]
2025-10-10T14:35:49.693885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:49.693903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:49.693910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.693913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.693916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.693934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:49.693945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:49.693954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:49.694008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.694014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.694015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.694018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:49.694085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:49.694094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.694105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.694117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.694134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:49.694160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390738:2438], now have 1 active actors on pipe
2025-10-10T14:35:49.694168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390874:6867], now have 1 active actors on pipe
2025-10-10T14:35:49.694175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601784953162113:10204]
2025-10-10T14:35:49.694177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601784953162113:10204]
2025-10-10T14:35:49.694180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601784953162113:10204]
2025-10-10T14:35:49.694193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:49.694207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:49.694210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:49.694211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:49.694212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:49.694227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:49.694235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:49.694235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1809
2025-10-10T14:35:49.694261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601784953162113:10204]
2025-10-10T14:35:49.694248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1809
2025-10-10T14:35:49.694263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:49.694266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:49.694279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.694283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.694332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:49.694345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.694349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.694352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:49.694364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.694377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:49.694404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.694550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.694557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.694571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.694649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1810 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0
2025-10-10T14:35:49.695033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99081b35-bba9bfea-8a5117c5-ebc6bb79_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:49.697552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0] Write session: try to update token
2025-10-10T14:35:49.697572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:49.711306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId: src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:49.713523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:49.713544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:49.713547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:49.713549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:49.713559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601784953162113:10204]
2025-10-10T14:35:49.713564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601784953162113:10204]
2025-10-10T14:35:49.713568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601784953162113:10204]
2025-10-10T14:35:49.713618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:49.713623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:49.713637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.713640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:49.713658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:49.713663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:49.713781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:49.714109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:49.774041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601785735390888:6939]
2025-10-10T14:35:49.774338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1809, pipe: [1:7559601785735390888:6939]
2025-10-10T14:35:49.824805Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:49.825081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.825094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.825134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390888:6939], now have 1 active actors on pipe
2025-10-10T14:35:49.825343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:49.825516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601785735390888:6939]
2025-10-10T14:35:49.825525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:49.825564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:49.825602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1810 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0
2025-10-10T14:35:49.825830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1810 sessionId: src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0 is DEAD
2025-10-10T14:35:49.826195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:49.826204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0] Write session will restart in 0.007203s
2025-10-10T14:35:49.826232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0] Write session: Do CDS request
2025-10-10T14:35:49.826239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:49.835243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.835343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:49.835361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1811
2025-10-10T14:35:49.835610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:49.835657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:49.835668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:49.835672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:49.836192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1811 sessionId:  describe result for acl check
2025-10-10T14:35:49.836225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:49.836238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:49.836240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:49.836247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601785735391007:6856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:49.836819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601785735391007:6856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:49.838066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:49.840030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:49.840234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:49.840244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:49.840253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:49.840296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:49.840334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601784953162276:10207]
2025-10-10T14:35:49.840816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:49.841071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:49.841226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:49.841558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:49.841637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.841639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.841640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.841641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.841643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.841644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.841645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.841646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.841648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.841649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.841650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.841651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.841652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.841658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.841670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.841674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.841678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.841682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.841686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.841689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.841692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.841695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.841699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.841703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.841706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.841710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.841719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.841727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:49.841733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.841739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:49.841744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.841750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:49.841755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.841760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:49.841765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.841770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:49.841777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.841781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:49.841786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.841790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:49.841795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.841801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:49.841806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.841811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:49.841815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.841819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:49.841823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.841828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.841832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.841849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.841854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.841859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.841898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:49.843331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601785735391007:6856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:49.844870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1810
2025-10-10T14:35:49.844198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:49.844521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:49.844526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:49.844528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:49.844532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:49.844539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1810 [2:7559601784953162276:10207]
2025-10-10T14:35:49.844551Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:49.844568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:49.844571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.844574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.844577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.844595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:49.844604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:49.844611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:49.844667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.844669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.844671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.844674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:49.844840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:49.844843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.844856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:49.844869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:49.844886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:49.844908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735390902:2438], now have 1 active actors on pipe
2025-10-10T14:35:49.844916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601784953162269:10207]
2025-10-10T14:35:49.844918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601784953162269:10207]
2025-10-10T14:35:49.844921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601784953162269:10207]
2025-10-10T14:35:49.844930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:49.844941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:49.844944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:49.844954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:49.844956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:49.844974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:49.844977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:49.845008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601784953162269:10207]
2025-10-10T14:35:49.845016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:49.845025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:49.846598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601785735391007:6856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:49.846613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601785735391007:6856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:49.846616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601785735391007:6856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:49.846624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:49.846838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735391048:6856], now have 1 active actors on pipe
2025-10-10T14:35:49.846898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1810
2025-10-10T14:35:49.846956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.846967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.847019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1495aa35-a373e655-d94cb621-dbc20cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:49.847034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:49.847040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:49.847047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:49.847062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:49.847081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:49.847112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.847426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.847435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.847450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:49.847581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1811 partition: 0 MaxSeqNo: 40 sessionId: src_id|1495aa35-a373e655-d94cb621-dbc20cf_0
2025-10-10T14:35:49.848045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc57338f-39bce2e2-a6d3173c-34c6f612_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1495aa35-a373e655-d94cb621-dbc20cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:49.850817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1495aa35-a373e655-d94cb621-dbc20cf_0] Write session: try to update token
2025-10-10T14:35:49.850839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1495aa35-a373e655-d94cb621-dbc20cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:49.862353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:49.862371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:49.862380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601784953162269:10207]
2025-10-10T14:35:49.862437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:49.862445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:49.862639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:49.862777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:49.862913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:49.863053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:49.863238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:49.863275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:49.866856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId: src_id|1495aa35-a373e655-d94cb621-dbc20cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:49.869542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:49.869789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.869815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.869859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:49.869966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:49.877066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:49.877082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:49.877085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:49.877087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:49.877095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601784953162269:10207]
2025-10-10T14:35:49.877098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601784953162269:10207]
2025-10-10T14:35:49.877102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601784953162269:10207]
2025-10-10T14:35:49.877155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:49.877159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:49.877159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:49.877163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:49.877168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:49.877170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:49.877307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:49.925592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601785735391051:6939]
2025-10-10T14:35:49.927672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1810, pipe: [1:7559601785735391051:6939]
2025-10-10T14:35:49.989485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:49.996723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:49.996756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:49.996921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.996986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:49.997048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:49.997108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:49.997155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:49.997163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:49.997234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.997291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:49.997379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:49.997785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:49.997834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:49.997841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:49.997908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.997985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:49.998055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:49.998116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:49.998163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:49.998169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:49.998238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.998304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:49.998367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:49.998471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:49.998529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:49.998532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:49.998610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.998672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:49.998740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:49.998809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:49.998855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:49.998858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:49.998940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.999007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:49.999076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:49.999154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:49.999198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:49.999201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:49.999273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.999345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:49.999412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:49.999474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:49.999527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:49.999533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:49.999604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.999667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:49.999733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:49.999794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:49.999838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:49.999844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:49.999913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:49.999972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.000033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.000100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.000146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.000152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.000219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.000280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.000353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.000420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.000484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.000491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.000556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601785735391051:6939], now have 1 active actors on pipe
2025-10-10T14:35:50.000799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:50.000819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:50.000824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:50.000871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1811 reason: error at write: Disconnected sessionId: src_id|1495aa35-a373e655-d94cb621-dbc20cf_0
2025-10-10T14:35:50.000888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601785735391051:6939]
2025-10-10T14:35:50.001124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1811 sessionId: src_id|1495aa35-a373e655-d94cb621-dbc20cf_0 is DEAD
2025-10-10T14:35:50.001313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1495aa35-a373e655-d94cb621-dbc20cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:50.001327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1495aa35-a373e655-d94cb621-dbc20cf_0] Write session will restart in 0.009712s
2025-10-10T14:35:50.001377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1495aa35-a373e655-d94cb621-dbc20cf_0] Write session: Do CDS request
2025-10-10T14:35:50.001385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1495aa35-a373e655-d94cb621-dbc20cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:50.001346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:50.012001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1495aa35-a373e655-d94cb621-dbc20cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.012119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:50.012151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1812
2025-10-10T14:35:50.012371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.012415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:50.012425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:50.012437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:50.012855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1812 sessionId:  describe result for acl check
2025-10-10T14:35:50.012888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:50.012894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:50.012898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:50.012905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601790030358443:6854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:50.013505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601790030358443:6854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:50.015427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:50.016701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601790030358443:6854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:50.018995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:50.019368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601790030358443:6854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:50.019385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601790030358443:6854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:50.019388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601790030358443:6854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:50.019397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:50.019259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:50.019273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:50.019288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:50.019358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:50.019399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601789248129721:10210]
2025-10-10T14:35:50.020077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:50.020422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:50.020479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:50.020802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:50.020877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.020878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.020879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.020880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.020882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.020883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.020885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.020886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.020887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.020889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.020890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.020891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.020892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.020899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.020912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.020915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.020919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.020922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.020926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.020930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.020933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.020937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.020941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.020944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.020947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.020950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.020961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.020969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.020975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.020980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.020984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.020989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.020993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.020998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.021002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.021007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.021011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.021016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.021020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.021025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.021030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.021035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.021039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.021044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.021048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.021054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.021058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.021065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.021069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.021074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.021078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.021083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.021125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:50.025792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:50.026467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:50.026480Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:50.026483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:50.026487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:50.026494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1811 [2:7559601789248129721:10210]
2025-10-10T14:35:50.026507Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:50.026527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:50.026537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.026541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.026544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.026565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:50.026573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:50.026581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:50.026645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.026652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.026654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.026658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:50.026738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:50.026745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.026758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.026774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.026795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:50.026820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358349:2438], now have 1 active actors on pipe
2025-10-10T14:35:50.026829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358488:6854], now have 1 active actors on pipe
2025-10-10T14:35:50.026837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601789248129715:10210]
2025-10-10T14:35:50.026844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601789248129715:10210]
2025-10-10T14:35:50.026846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601789248129715:10210]
2025-10-10T14:35:50.026860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:50.026872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:50.026875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:50.026884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:50.026886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:50.026891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:50.026895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:50.026934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601789248129715:10210]
2025-10-10T14:35:50.026900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1811
2025-10-10T14:35:50.026942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:50.026952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:50.026900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1811
2025-10-10T14:35:50.026963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.026973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.027035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d98b73d-86a098d8-8878b187-27e97228_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:50.027049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.027054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.027056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:50.027069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.027084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:50.027112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.027311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.027319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.027338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.027412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1812 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d98b73d-86a098d8-8878b187-27e97228_0
2025-10-10T14:35:50.027850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1495aa35-a373e655-d94cb621-dbc20cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d98b73d-86a098d8-8878b187-27e97228_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:50.030705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d98b73d-86a098d8-8878b187-27e97228_0] Write session: try to update token
2025-10-10T14:35:50.030727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d98b73d-86a098d8-8878b187-27e97228_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:50.050532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId: src_id|1d98b73d-86a098d8-8878b187-27e97228_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:50.051638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:50.051662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:50.051665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:50.051667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:50.051677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601789248129715:10210]
2025-10-10T14:35:50.051682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601789248129715:10210]
2025-10-10T14:35:50.051686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601789248129715:10210]
2025-10-10T14:35:50.053173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:50.051746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:50.051762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.051765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:50.051845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:50.051852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:50.051857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:50.051916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:50.101199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601790030358500:6939]
2025-10-10T14:35:50.101641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1811, pipe: [1:7559601790030358500:6939]
2025-10-10T14:35:50.166410Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:50.166654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.166677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.166741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358500:6939], now have 1 active actors on pipe
2025-10-10T14:35:50.166989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601790030358500:6939]
2025-10-10T14:35:50.166991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:50.166996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:50.167034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:50.167069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1812 reason: error at write: Disconnected sessionId: src_id|1d98b73d-86a098d8-8878b187-27e97228_0
2025-10-10T14:35:50.167267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1812 sessionId: src_id|1d98b73d-86a098d8-8878b187-27e97228_0 is DEAD
2025-10-10T14:35:50.167425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d98b73d-86a098d8-8878b187-27e97228_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:50.167435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d98b73d-86a098d8-8878b187-27e97228_0] Write session will restart in 0.008761s
2025-10-10T14:35:50.167470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d98b73d-86a098d8-8878b187-27e97228_0] Write session: Do CDS request
2025-10-10T14:35:50.167476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d98b73d-86a098d8-8878b187-27e97228_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:50.168114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:50.180086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d98b73d-86a098d8-8878b187-27e97228_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.181085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:50.181106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1813
2025-10-10T14:35:50.181385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.181434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:50.181440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:50.181454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:50.182038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1813 sessionId:  describe result for acl check
2025-10-10T14:35:50.182084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:50.182086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:50.182087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:50.182094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601790030358577:6850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:50.182643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601790030358577:6850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:50.186569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601790030358577:6850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:50.189805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:50.190337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:50.190549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:50.190555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:50.190568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:50.190633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:50.190672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601789248129869:10212]
2025-10-10T14:35:50.191321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:50.191640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:50.191701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:50.192049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:50.192139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.192141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.192142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.192144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.192145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.192146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.192147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.192148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.192150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.192151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.192152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.192153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.192154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.192161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.192175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.192180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.192184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.192188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.192192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.192196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.192200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.192205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.192210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.192214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.192218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.192222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.192231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.192241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.192247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.192253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.192259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.192264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.192269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.192274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.192279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.192285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.192289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.192296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.192301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.192306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.192310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.192316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.192320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.192326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.192331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.192336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.192340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.192345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.192350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.192356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.192362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.192368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.192410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:50.190106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601790030358577:6850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:50.190122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601790030358577:6850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:50.190126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601790030358577:6850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:50.190136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:50.198390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:50.199044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:50.199062Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:50.199064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:50.199068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:50.199075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1812 [2:7559601789248129869:10212]
2025-10-10T14:35:50.199089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:50.199108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:50.199112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.199117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.199119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.199139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:50.199157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:50.199164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:50.199232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.199241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.199243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.199245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:50.199336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:50.199345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.199360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.199373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.199392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:50.199417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358502:2438], now have 1 active actors on pipe
2025-10-10T14:35:50.199421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358642:6850], now have 1 active actors on pipe
2025-10-10T14:35:50.199428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601789248129864:10212]
2025-10-10T14:35:50.199432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601789248129864:10212]
2025-10-10T14:35:50.199435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601789248129864:10212]
2025-10-10T14:35:50.199446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:50.199464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:50.199474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:50.199476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:50.199479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:50.199487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:50.199491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:50.199525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601789248129864:10212]
2025-10-10T14:35:50.199540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:50.199561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:50.199653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1812
2025-10-10T14:35:50.199706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1812
2025-10-10T14:35:50.199820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.199834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.199868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:50.199876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.199882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.199884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:50.199897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.199910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:50.199928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.200154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.200176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.200199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.200306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1813 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0
2025-10-10T14:35:50.205449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d98b73d-86a098d8-8878b187-27e97228_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:50.208079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0] Write session: try to update token
2025-10-10T14:35:50.208102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:50.221131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:50.221157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:50.221160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:50.221162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:50.221172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601789248129864:10212]
2025-10-10T14:35:50.221177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601789248129864:10212]
2025-10-10T14:35:50.221185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601789248129864:10212]
2025-10-10T14:35:50.221239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:50.221248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.221251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:50.221437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:50.222141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:50.222164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:50.222176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:50.223477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId: src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:50.226239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:50.267056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601790030358654:6939]
2025-10-10T14:35:50.267377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1812, pipe: [1:7559601790030358654:6939]
2025-10-10T14:35:50.340194Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:50.340506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.340537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.340608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358654:6939], now have 1 active actors on pipe
2025-10-10T14:35:50.340818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:50.340824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601790030358654:6939]
2025-10-10T14:35:50.340839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:50.340865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:50.340868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:50.340947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1813 reason: error at write: Disconnected sessionId: src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0
2025-10-10T14:35:50.341137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1813 sessionId: src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0 is DEAD
2025-10-10T14:35:50.341343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:50.341356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0] Write session will restart in 0.009676s
2025-10-10T14:35:50.341382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0] Write session: Do CDS request
2025-10-10T14:35:50.341409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:50.351943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.351998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:50.352017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1814
2025-10-10T14:35:50.352211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.352257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:50.352263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:50.352267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:50.352773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1814 sessionId:  describe result for acl check
2025-10-10T14:35:50.352814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:50.352823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:50.352825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:50.352832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601790030358749:6846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:50.353453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601790030358749:6846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:50.355053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:50.355678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601790030358749:6846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:50.357440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:50.357714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:50.357731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:50.357746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:50.357820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:50.357871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601789248130018:10214]
2025-10-10T14:35:50.358378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601790030358749:6846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:50.358404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601790030358749:6846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:50.358408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601790030358749:6846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:50.358416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:50.358493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:50.358877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:50.358990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:50.359395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:50.359488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.359498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.359500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.359501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.359502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.359503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.359506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.359507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.359508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.359510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.359511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.359513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.359515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.359524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.359555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.359560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.359565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.359569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.359575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.359579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.359583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.359587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.359592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.359600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.359604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.359608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.359630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.359644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.359656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.359661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.359669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.359674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.359680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.359686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.359695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.359700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.359705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.359710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.359720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.359725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.359730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.359737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.359745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.359754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.359761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.359766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.359770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.359775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.359780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.359784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.359789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.359795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.359855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:50.362409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:50.362810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:50.362824Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:50.362827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:50.362832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:50.362838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1813 [2:7559601789248130018:10214]
2025-10-10T14:35:50.362861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:50.362880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:50.362885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.362892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.362895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.362927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:50.362941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:50.362948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:50.363008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.363017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.363019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.363021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:50.363087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:50.363096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.363108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.363120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.363136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:50.363165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358656:2438], now have 1 active actors on pipe
2025-10-10T14:35:50.363174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358798:6846], now have 1 active actors on pipe
2025-10-10T14:35:50.363183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601789248130013:10214]
2025-10-10T14:35:50.363185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601789248130013:10214]
2025-10-10T14:35:50.363188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601789248130013:10214]
2025-10-10T14:35:50.363201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:50.363216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:50.363225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:50.363229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:50.363231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:50.363236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:50.363239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:50.363270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601789248130013:10214]
2025-10-10T14:35:50.363284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:50.363313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:50.363262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1813
2025-10-10T14:35:50.363307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1813
2025-10-10T14:35:50.363479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.363496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.363535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:50.363570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.363579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.363582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:50.363594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.363619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:50.363638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.363858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.363871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.363891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.363998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1814 partition: 0 MaxSeqNo: 40 sessionId: src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0
2025-10-10T14:35:50.364412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b74f88-19ae0e0a-3153c3ca-27bdf970_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:50.367212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0] Write session: try to update token
2025-10-10T14:35:50.367233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:50.380931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:50.380952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:50.380964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601789248130013:10214]
2025-10-10T14:35:50.381021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:50.381022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:50.381211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:50.381380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:50.381534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:50.381697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:50.381919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:50.381970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:50.384845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId: src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:50.387979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:50.388216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.388239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.388280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:50.388350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:50.393007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:50.393030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:50.393034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:50.393036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:50.393047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601789248130013:10214]
2025-10-10T14:35:50.393051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601789248130013:10214]
2025-10-10T14:35:50.393059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601789248130013:10214]
2025-10-10T14:35:50.393106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:50.393110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:50.393117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.393120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:50.393128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:50.393137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:50.393255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:50.441203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601790030358809:6939]
2025-10-10T14:35:50.441577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1813, pipe: [1:7559601790030358809:6939]
2025-10-10T14:35:50.508414Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:50.516951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.516986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.517173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.517241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.517308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.517395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.517451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.517461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.517540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.517602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.517681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.517753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.517801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.517807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.517878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.517942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.518014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.518082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.518130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.518138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.518214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.518285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.518348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.518418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.518465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.518472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.518541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.518605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.518671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.520575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:50.520585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:50.520588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:50.520625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1814 reason: error at write: Disconnected sessionId: src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0
2025-10-10T14:35:50.520643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601790030358809:6939]
2025-10-10T14:35:50.520851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1814 sessionId: src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0 is DEAD
2025-10-10T14:35:50.521007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:50.521019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0] Write session will restart in 0.008545s
2025-10-10T14:35:50.521045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0] Write session: Do CDS request
2025-10-10T14:35:50.521051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:50.518741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.518789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.518791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.518854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.518906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.518963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.519023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.519074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.519077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.519147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.519213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.519292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.519361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.519407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.519413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.519490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.519552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.519606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.519663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.519702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.519704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.519768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.519819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.519872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.519933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.519980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.519983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.520046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:50.520098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:50.520186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:50.520251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:50.520296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:50.520301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:50.520365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358809:6939], now have 1 active actors on pipe
2025-10-10T14:35:50.521687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:50.530899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.531030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:50.531049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1815
2025-10-10T14:35:50.531192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.531228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:50.531234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:50.531238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:50.531751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1815 sessionId:  describe result for acl check
2025-10-10T14:35:50.531794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:50.531800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:50.531803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:50.531810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601790030358922:6829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:50.532386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601790030358922:6829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:50.532598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:50.534394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:50.534638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:50.534651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:50.534663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:50.534718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:50.534761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601789248130182:10218]
2025-10-10T14:35:50.535438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:50.535603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601790030358922:6829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:50.535792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:50.535852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:50.536198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:50.536275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.536283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.536284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.536285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.536286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.536288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.536289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.536290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.536291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.536292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.536294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.536295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.536296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.536302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.536314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.536319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.536322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.536325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.536330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.536333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.536337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.536341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.536346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.536349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.536353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.536357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.536364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.536374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.536381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.536386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.536391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.536396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.536400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.536404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.536408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.536412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.536417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.536421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.536426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.536430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.536434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.536438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.536443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.536447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.536452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.536458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.536462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.536467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.536470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.536474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.536478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.536483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.536521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:50.538962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:50.539029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601790030358922:6829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:50.539048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601790030358922:6829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:50.539052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601790030358922:6829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:50.539078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:50.539286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:50.539298Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:50.539301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:50.539305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:50.539311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1814 [2:7559601789248130182:10218]
2025-10-10T14:35:50.539334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:50.539355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:50.539362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.539366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.539369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.539386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:50.539402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:50.539415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:50.539474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.539481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.539483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.539485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:50.539550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:50.539558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.539569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.539586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.539608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:50.539634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358958:6829], now have 1 active actors on pipe
2025-10-10T14:35:50.539643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358811:2438], now have 1 active actors on pipe
2025-10-10T14:35:50.539650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601789248130177:10218]
2025-10-10T14:35:50.539656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601789248130177:10218]
2025-10-10T14:35:50.539658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601789248130177:10218]
2025-10-10T14:35:50.539672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:50.539686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:50.539682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1814
2025-10-10T14:35:50.539690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:50.539693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:50.539683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1814
2025-10-10T14:35:50.539696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:50.539706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:50.539709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:50.539746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601789248130177:10218]
2025-10-10T14:35:50.539758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:50.539767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:50.539776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.539786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.539838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:50.539850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.539854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.539861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:50.539872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.539888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:50.539910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.540069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.540084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.540108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.540207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1815 partition: 0 MaxSeqNo: 40 sessionId: src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0
2025-10-10T14:35:50.540606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9306ae94-ba98240f-7df2bd01-85ebbe5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:50.543435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0] Write session: try to update token
2025-10-10T14:35:50.543454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:50.559543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:50.559566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:50.559570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:50.559572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:50.559582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601789248130177:10218]
2025-10-10T14:35:50.559587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601789248130177:10218]
2025-10-10T14:35:50.559592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601789248130177:10218]
2025-10-10T14:35:50.559596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId: src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:50.559642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:50.559655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.559658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:50.559660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:50.559666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:50.559673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:50.559819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:50.562568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:50.620905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601790030358989:6939]
2025-10-10T14:35:50.621239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1814, pipe: [1:7559601790030358989:6939]
2025-10-10T14:35:50.677185Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:50.677594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.677624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.677672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358989:6939], now have 1 active actors on pipe
2025-10-10T14:35:50.678059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:50.678070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601790030358989:6939]
2025-10-10T14:35:50.678407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:50.677948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:50.678501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1815 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0
2025-10-10T14:35:50.678689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1815 sessionId: src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0 is DEAD
2025-10-10T14:35:50.678843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:50.678854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0] Write session will restart in 0.007394s
2025-10-10T14:35:50.678879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0] Write session: Do CDS request
2025-10-10T14:35:50.678885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:50.687909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.688315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:50.688334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1816
2025-10-10T14:35:50.688451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.688489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:50.688500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:50.688504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:50.689018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1816 sessionId:  describe result for acl check
2025-10-10T14:35:50.689059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:50.689068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:50.689079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:50.689086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601790030359059:6816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:50.689714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601790030359059:6816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:50.692055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601790030359059:6816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:50.692912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:50.694869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:50.695110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:50.695125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:50.695139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:50.695209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:50.695252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601789248130358:10231]
2025-10-10T14:35:50.695863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:50.696465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:50.696527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:50.696737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601790030359059:6816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:50.696756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601790030359059:6816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:50.696760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601790030359059:6816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:50.696770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:50.696857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:50.696941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.696948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.696949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.696950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.696951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.696953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.696954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.696956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.696957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.696958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.696960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.696961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.696962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.696969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.696983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.696987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.696992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.696997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.697001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.697005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.697023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.697032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.697037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.697041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.697050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.697054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.697062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.697076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.697087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.697093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.697098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.697104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.697114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.697119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.697125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.697131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.697135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.697141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.697146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.697157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.697162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.697167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.697172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.697178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.697182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.697188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.697193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.697198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.697202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.697209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.697214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.697219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.697263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:50.700131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:50.700734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:50.700751Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:50.700753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:50.700757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:50.700763Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1815 [2:7559601789248130358:10231]
2025-10-10T14:35:50.700777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:50.700797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:50.700807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.700811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.700813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.700831Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:50.700839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:50.700847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:50.700931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.700940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.700942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.700945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:50.701014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:50.701022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.701034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.701045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.701065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:50.701093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030358998:2438], now have 1 active actors on pipe
2025-10-10T14:35:50.701101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030359143:6816], now have 1 active actors on pipe
2025-10-10T14:35:50.701109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601789248130353:10231]
2025-10-10T14:35:50.701112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601789248130353:10231]
2025-10-10T14:35:50.701115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601789248130353:10231]
2025-10-10T14:35:50.701131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:50.701145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:50.701148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:50.701150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:50.701151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:50.701165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:50.701170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:50.701200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601789248130353:10231]
2025-10-10T14:35:50.701215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:50.701223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:50.701201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1815
2025-10-10T14:35:50.701259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1815
2025-10-10T14:35:50.701317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.701386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.701423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|160daf41-e91c1640-ceda6768-ed87e352_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:50.701436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.701445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.701448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:50.701462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.701478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:50.701501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.701706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.701719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.701754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.702307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc209cc-749df42a-7bc7e6bd-11f80ff3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|160daf41-e91c1640-ceda6768-ed87e352_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:50.701865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1816 partition: 0 MaxSeqNo: 40 sessionId: src_id|160daf41-e91c1640-ceda6768-ed87e352_0
2025-10-10T14:35:50.705176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|160daf41-e91c1640-ceda6768-ed87e352_0] Write session: try to update token
2025-10-10T14:35:50.705193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|160daf41-e91c1640-ceda6768-ed87e352_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:50.720935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:50.720960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:50.720963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:50.720965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:50.720976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601789248130353:10231]
2025-10-10T14:35:50.720980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601789248130353:10231]
2025-10-10T14:35:50.720988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601789248130353:10231]
2025-10-10T14:35:50.721039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:50.721037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:50.721045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:50.721047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.721049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:50.721050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:50.721188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:50.724421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId: src_id|160daf41-e91c1640-ceda6768-ed87e352_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:50.727206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:50.778534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601790030359155:6939]
2025-10-10T14:35:50.778824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1815, pipe: [1:7559601790030359155:6939]
2025-10-10T14:35:50.836966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:50.837358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.837379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.837426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030359155:6939], now have 1 active actors on pipe
2025-10-10T14:35:50.837666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:50.837685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:50.837724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601790030359155:6939]
2025-10-10T14:35:50.838209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|160daf41-e91c1640-ceda6768-ed87e352_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:50.838225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|160daf41-e91c1640-ceda6768-ed87e352_0] Write session will restart in 0.008731s
2025-10-10T14:35:50.837755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:50.838251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|160daf41-e91c1640-ceda6768-ed87e352_0] Write session: Do CDS request
2025-10-10T14:35:50.837759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:50.838258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|160daf41-e91c1640-ceda6768-ed87e352_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:50.837824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1816 reason: error at write: Disconnected sessionId: src_id|160daf41-e91c1640-ceda6768-ed87e352_0
2025-10-10T14:35:50.838034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1816 sessionId: src_id|160daf41-e91c1640-ceda6768-ed87e352_0 is DEAD
2025-10-10T14:35:50.847918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|160daf41-e91c1640-ceda6768-ed87e352_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.847991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:50.848011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1817
2025-10-10T14:35:50.848157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:50.848204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:50.848215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:50.848233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:50.848711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1817 sessionId:  describe result for acl check
2025-10-10T14:35:50.848760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:50.849075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:50.849086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:50.849092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601790030359273:6811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:50.849712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601790030359273:6811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:50.850791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:50.851804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601790030359273:6811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:50.852944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:50.853286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:50.853301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:50.853316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:50.853397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:50.853445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601789248130524:10235]
2025-10-10T14:35:50.854014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:50.854378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:50.854445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:50.854574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601790030359273:6811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:50.854590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601790030359273:6811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:50.854594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601790030359273:6811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:50.854602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:50.854810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:50.854873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.854880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.854881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.854882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.854883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.854885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.854886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.854888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.854889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.854891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.854892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.854893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.854894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.854901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.854915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.854920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.854924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.854929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.854933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.854937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.854942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.854946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.854951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.854955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.854960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.854964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.854971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.854980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:50.854987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.854994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:50.854999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.855004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:50.855009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.855015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:50.855020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.855026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:50.855038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.855044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:50.855050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.855055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:50.855065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.855071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:50.855077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.855083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:50.855088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.855093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:50.855099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.855105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.855115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.855120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.855127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.855137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.855193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:50.857737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:50.858096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:50.858111Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:50.858114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:50.858118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:50.858124Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1816 [2:7559601789248130524:10235]
2025-10-10T14:35:50.858136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:50.858156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:50.858160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.858164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.858167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.858184Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:50.858192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:50.858212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:50.858271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.858278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.858281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.858283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:50.858353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:50.858362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.858374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:50.858387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:50.858410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:50.858449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030359315:6811], now have 1 active actors on pipe
2025-10-10T14:35:50.858454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030359169:2438], now have 1 active actors on pipe
2025-10-10T14:35:50.858461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601789248130518:10235]
2025-10-10T14:35:50.858469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601789248130518:10235]
2025-10-10T14:35:50.858471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601789248130518:10235]
2025-10-10T14:35:50.858489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:50.858503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:50.858509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:50.858483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1816
2025-10-10T14:35:50.858487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1816
2025-10-10T14:35:50.858512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:50.858515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:50.858521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:50.858525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:50.858563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.858573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.858593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601789248130518:10235]
2025-10-10T14:35:50.858604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:50.858626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:50.858635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:50.858643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:50.858648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:50.858650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:50.858662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:50.858678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:50.858704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.858896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.858904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.858919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:50.859007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1817 partition: 0 MaxSeqNo: 40 sessionId: src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0
2025-10-10T14:35:50.859408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|160daf41-e91c1640-ceda6768-ed87e352_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:50.862221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0] Write session: try to update token
2025-10-10T14:35:50.862238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:50.877619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId: src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:50.878798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:50.878820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:50.878823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:50.878825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:50.878836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601789248130518:10235]
2025-10-10T14:35:50.878841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601789248130518:10235]
2025-10-10T14:35:50.878846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601789248130518:10235]
2025-10-10T14:35:50.878903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:50.878915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:50.878921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:50.878924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:50.878929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:50.878934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:50.879095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:50.880629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:50.937816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601790030359324:6939]
2025-10-10T14:35:50.938095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1816, pipe: [1:7559601790030359324:6939]
2025-10-10T14:35:50.995213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:50.995579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:50.995597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:50.995643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030359324:6939], now have 1 active actors on pipe
2025-10-10T14:35:50.995861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:50.996021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:50.996076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:50.996119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1817 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0
2025-10-10T14:35:50.996120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601790030359324:6939]
2025-10-10T14:35:50.996326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1817 sessionId: src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0 is DEAD
2025-10-10T14:35:50.997540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:50.997553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0] Write session will restart in 0.008165s
2025-10-10T14:35:50.997578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0] Write session: Do CDS request
2025-10-10T14:35:50.997607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:51.006931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.007069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:51.007090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1818
2025-10-10T14:35:51.007235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.007290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:51.007301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:51.007305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:51.007913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1818 sessionId:  describe result for acl check
2025-10-10T14:35:51.007954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:51.007956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:51.007958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:51.007964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601794325326711:6800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:51.008560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601794325326711:6800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:51.013241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601794325326711:6800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:51.013626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:51.015673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:51.015908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:51.015921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:51.015932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:51.015987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:51.016032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601793543097972:10237]
2025-10-10T14:35:51.016683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:51.017176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:51.017246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:51.017654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:51.017737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.017745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.017746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.017747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.017749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.017750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.017755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.017756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.017757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.017758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.017759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.017761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.017762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.017768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.017782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.017786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.017790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.017794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.017798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.017801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.017805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.017809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.017815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.017819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.017823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.017827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.017836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.017860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.017873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.017878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.017882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.017887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.017897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.017902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.017907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.017916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.017921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.017927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.017936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.017941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.017945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.017954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.017958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.017964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.017969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.017974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.017979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.017984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.017988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.017998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.018002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.018007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.018053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:51.020451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601794325326711:6800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:51.020470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601794325326711:6800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:51.020474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601794325326711:6800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:51.020485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:51.021946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1817
2025-10-10T14:35:51.021980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1817
2025-10-10T14:35:51.021145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:51.021493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:51.021499Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:51.021502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:51.021506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:51.021512Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1817 [2:7559601793543097972:10237]
2025-10-10T14:35:51.021528Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:51.021547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:51.021551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.021554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.021557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.021575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:51.021582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:51.021606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:51.021664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.021666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.021668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.021671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:51.021746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:51.021749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.021761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.021773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.021790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:51.021812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601790030359326:2438], now have 1 active actors on pipe
2025-10-10T14:35:51.021816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325326770:6800], now have 1 active actors on pipe
2025-10-10T14:35:51.021824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601793543097967:10237]
2025-10-10T14:35:51.021827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601793543097967:10237]
2025-10-10T14:35:51.021830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601793543097967:10237]
2025-10-10T14:35:51.021844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:51.021855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:51.021859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:51.021859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:51.021861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:51.021876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:51.021881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:51.021909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601793543097967:10237]
2025-10-10T14:35:51.021917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:51.021929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:51.022240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.022250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.022282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:51.022290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.022294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.022297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:51.022309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.022323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:51.022337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.022554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.022562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.022580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.022704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1818 partition: 0 MaxSeqNo: 40 sessionId: src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0
2025-10-10T14:35:51.023078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1666ff23-1059bb4f-3ca181d0-5787c99f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:51.025539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0] Write session: try to update token
2025-10-10T14:35:51.025557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:51.042743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:51.042766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.042770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:51.042772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:51.042782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601793543097967:10237]
2025-10-10T14:35:51.042787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601793543097967:10237]
2025-10-10T14:35:51.042794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601793543097967:10237]
2025-10-10T14:35:51.042843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:51.042845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:51.042853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.042855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:51.042867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:51.042873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:51.043029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:51.041177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId: src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:51.043913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:51.096546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601794325326778:6939]
2025-10-10T14:35:51.096827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1817, pipe: [1:7559601794325326778:6939]
2025-10-10T14:35:51.161442Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:51.161940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.161958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.162006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325326778:6939], now have 1 active actors on pipe
2025-10-10T14:35:51.162232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:51.162237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:51.162277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:51.162282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:51.162300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601794325326778:6939]
2025-10-10T14:35:51.162373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1818 reason: error at write: Disconnected sessionId: src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0
2025-10-10T14:35:51.162589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1818 sessionId: src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0 is DEAD
2025-10-10T14:35:51.162703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:51.162714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0] Write session will restart in 0.005863s
2025-10-10T14:35:51.162752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0] Write session: Do CDS request
2025-10-10T14:35:51.162761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:51.169935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.170037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:51.170055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1819
2025-10-10T14:35:51.170200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.170248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:51.170258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:51.170262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:51.170758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1819 sessionId:  describe result for acl check
2025-10-10T14:35:51.170796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:51.170805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:51.170807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:51.170814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601794325326824:6803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:51.171397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601794325326824:6803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:51.174280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601794325326824:6803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:51.175072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:51.177448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601794325326824:6803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:51.177464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601794325326824:6803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:51.177467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601794325326824:6803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:51.177476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:51.177088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:51.177321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:51.177326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:51.177358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:51.177424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:51.177460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601793543098126:10239]
2025-10-10T14:35:51.178122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:51.178474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:51.178546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:51.178927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:51.179042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.179051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.179052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.179053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.179055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.179056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.179057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.179058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.179060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.179061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.179062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.179063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.179064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.179070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.179084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.179088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.179092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.179096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.179100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.179105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.179108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.179112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.179116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.179120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.179124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.179127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.179136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.179145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.179153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.179159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.179170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.179175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.179183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.179189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.179199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.179205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.179210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.179215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.179220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.179226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.179231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.179236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.179241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.179247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.179255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.179277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.179283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.179289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.179297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.179302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.179307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.179326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.179374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:51.181942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:51.182460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:51.182475Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:51.182478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:51.182482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:51.182489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1818 [2:7559601793543098126:10239]
2025-10-10T14:35:51.182501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:51.182519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:51.182523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.182527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.182529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.182546Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:51.182558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:51.182566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:51.182645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.182654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.182656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.182659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:51.182722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:51.182730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.182742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.182759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.182778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:51.182804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325326780:2438], now have 1 active actors on pipe
2025-10-10T14:35:51.182811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325326925:6803], now have 1 active actors on pipe
2025-10-10T14:35:51.182820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601793543098121:10239]
2025-10-10T14:35:51.182822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601793543098121:10239]
2025-10-10T14:35:51.182824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601793543098121:10239]
2025-10-10T14:35:51.182838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:51.182856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:51.182862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:51.182868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:51.182870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:51.182875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:51.182878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:51.182904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601793543098121:10239]
2025-10-10T14:35:51.182916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:51.182922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:51.182920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1818
2025-10-10T14:35:51.182971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1818
2025-10-10T14:35:51.183051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.183062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.183093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82646565-78d2e266-f57a0d80-b4163897_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:51.183107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.183116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.183119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:51.183132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.183148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:51.183167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.183529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.183541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.183559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.183709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1819 partition: 0 MaxSeqNo: 40 sessionId: src_id|82646565-78d2e266-f57a0d80-b4163897_0
2025-10-10T14:35:51.184155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fcedd9d-4626828b-3d6faa8b-1f8b3154_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|82646565-78d2e266-f57a0d80-b4163897_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:51.187059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82646565-78d2e266-f57a0d80-b4163897_0] Write session: try to update token
2025-10-10T14:35:51.187078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82646565-78d2e266-f57a0d80-b4163897_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:51.202843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId: src_id|82646565-78d2e266-f57a0d80-b4163897_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:51.202856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:51.202877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.202881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:51.202887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:51.202898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601793543098121:10239]
2025-10-10T14:35:51.202902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601793543098121:10239]
2025-10-10T14:35:51.202905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601793543098121:10239]
2025-10-10T14:35:51.202951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:51.202956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:51.202958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:51.202963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:51.202966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.202968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:51.203115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:51.205568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:51.262434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601794325326937:6939]
2025-10-10T14:35:51.262756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1818, pipe: [1:7559601794325326937:6939]
2025-10-10T14:35:51.317514Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:51.317973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.317990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.318038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325326937:6939], now have 1 active actors on pipe
2025-10-10T14:35:51.318243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:51.318264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:51.318305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601794325326937:6939]
2025-10-10T14:35:51.318322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:51.318406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1819 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82646565-78d2e266-f57a0d80-b4163897_0
2025-10-10T14:35:51.318619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1819 sessionId: src_id|82646565-78d2e266-f57a0d80-b4163897_0 is DEAD
2025-10-10T14:35:51.318758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82646565-78d2e266-f57a0d80-b4163897_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:51.318772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82646565-78d2e266-f57a0d80-b4163897_0] Write session will restart in 0.006139s
2025-10-10T14:35:51.318798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82646565-78d2e266-f57a0d80-b4163897_0] Write session: Do CDS request
2025-10-10T14:35:51.318805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82646565-78d2e266-f57a0d80-b4163897_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:51.325967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82646565-78d2e266-f57a0d80-b4163897_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.326016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:51.326036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1820
2025-10-10T14:35:51.326276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.326326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:51.326338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:51.326341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:51.326859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1820 sessionId:  describe result for acl check
2025-10-10T14:35:51.326898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:51.326905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:51.326907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:51.326913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601794325326993:6787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:51.327480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601794325326993:6787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:51.329818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601794325326993:6787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:51.330438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:51.332236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:51.332506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:51.332520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:51.332534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:51.332600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:51.332647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601793543098281:5725]
2025-10-10T14:35:51.332675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601794325326993:6787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:51.332691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601794325326993:6787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:51.332694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601794325326993:6787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:51.332703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:51.333250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:51.333542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:51.333594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:51.333846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:51.333886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.333891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.333892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.333893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.333894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.333895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.333896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.333896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.333897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.333898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.333898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.333899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.333900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.333905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.333915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.333920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.333924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.333928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.333931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.333935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.333939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.333942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.333947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.333951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.333954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.333957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.333965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.333973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.333980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.333986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.333991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.333995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.333998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.334002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.334004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.334007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.334011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.334016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.334021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.334027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.334032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.334037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.334042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.334045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.334048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.334051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.334056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.334059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.334061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.334064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.334067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.334070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.334094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:51.336691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:51.337413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:51.337430Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:51.337432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:51.337437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:51.337444Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1819 [2:7559601793543098281:5725]
2025-10-10T14:35:51.337458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:51.337478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:51.337481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.337485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.337488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.337508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:51.337521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:51.337531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:51.337618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.337626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.337628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.337631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:51.337708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:51.337716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.337728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.337746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.337767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:51.337796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327089:6787], now have 1 active actors on pipe
2025-10-10T14:35:51.337805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325326942:2438], now have 1 active actors on pipe
2025-10-10T14:35:51.337812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601793543098276:5725]
2025-10-10T14:35:51.337820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601793543098276:5725]
2025-10-10T14:35:51.337823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601793543098276:5725]
2025-10-10T14:35:51.337837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:51.337851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:51.337863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:51.337865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:51.337881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1819
2025-10-10T14:35:51.337894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:51.337917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:51.337920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:51.337955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601793543098276:5725]
2025-10-10T14:35:51.337963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:51.337967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1819
2025-10-10T14:35:51.337975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:51.338008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.338019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.338052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76cbc564-e8218841-98258793-ac38fd7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:51.338065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.338070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.338073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:51.338085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.338100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:51.338121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.338285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.338294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.338311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.338407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1820 partition: 0 MaxSeqNo: 40 sessionId: src_id|76cbc564-e8218841-98258793-ac38fd7d_0
2025-10-10T14:35:51.338831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82646565-78d2e266-f57a0d80-b4163897_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|76cbc564-e8218841-98258793-ac38fd7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:51.341735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76cbc564-e8218841-98258793-ac38fd7d_0] Write session: try to update token
2025-10-10T14:35:51.341757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76cbc564-e8218841-98258793-ac38fd7d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:51.357790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId: src_id|76cbc564-e8218841-98258793-ac38fd7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:51.358023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:51.358043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.358046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:51.358048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:51.358059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601793543098276:5725]
2025-10-10T14:35:51.358063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601793543098276:5725]
2025-10-10T14:35:51.358067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601793543098276:5725]
2025-10-10T14:35:51.358121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:51.358127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:51.358129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.358132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:51.358134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:51.358139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:51.358269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:51.360376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:51.418566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601794325327100:6939]
2025-10-10T14:35:51.419049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1819, pipe: [1:7559601794325327100:6939]
2025-10-10T14:35:51.476110Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:51.476401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.476420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.476468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327100:6939], now have 1 active actors on pipe
2025-10-10T14:35:51.477233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:51.478227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76cbc564-e8218841-98258793-ac38fd7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:51.478250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76cbc564-e8218841-98258793-ac38fd7d_0] Write session will restart in 0.005547s
2025-10-10T14:35:51.478276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76cbc564-e8218841-98258793-ac38fd7d_0] Write session: Do CDS request
2025-10-10T14:35:51.478282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76cbc564-e8218841-98258793-ac38fd7d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:51.477508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601794325327100:6939]
2025-10-10T14:35:51.477550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:51.477641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1820 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76cbc564-e8218841-98258793-ac38fd7d_0
2025-10-10T14:35:51.477754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:51.477843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1820 sessionId: src_id|76cbc564-e8218841-98258793-ac38fd7d_0 is DEAD
2025-10-10T14:35:51.484886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76cbc564-e8218841-98258793-ac38fd7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.485013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:51.485032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1821
2025-10-10T14:35:51.485201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.485262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:51.485272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:51.485277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:51.485944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1821 sessionId:  describe result for acl check
2025-10-10T14:35:51.485994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:51.486001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:51.486005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:51.486010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601794325327133:6792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:51.486600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601794325327133:6792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:51.490240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601794325327133:6792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:51.492088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:51.497857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:51.498032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601794325327133:6792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:51.498057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601794325327133:6792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:51.498061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601794325327133:6792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:51.498071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:51.498157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:51.498171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:51.498184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:51.498258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:51.498304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601793543098437:5723]
2025-10-10T14:35:51.498738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:51.499098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:51.499160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:51.499548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:51.499627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.499634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.499635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.499636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.499638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.499640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.499641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.499642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.499644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.499645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.499647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.499649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.499650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.499657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.499670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.499675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.499680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.499684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.499688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.499693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.499697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.499702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.499707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.499711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.499715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.499719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.499738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.499748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.499757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.499763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.499773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.499779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.499784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.499789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.499795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.499801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.499805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.499811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.499817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.499823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.499832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.499838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.499843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.499853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.499859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.499864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.499875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.499881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.499890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.499898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.499908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.499913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.499957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:51.502987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:51.503341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:51.503355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:51.503357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:51.503362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:51.503369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1820 [2:7559601793543098437:5723]
2025-10-10T14:35:51.503385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:51.503404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:51.503408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.503412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.503415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.503433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:51.503450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:51.503459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:51.503523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.503530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.503533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.503536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:51.503613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:51.503619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.503633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.503647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.503667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:51.503694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601793543098432:5723]
2025-10-10T14:35:51.503701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601793543098432:5723]
2025-10-10T14:35:51.503703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601793543098432:5723]
2025-10-10T14:35:51.503718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:51.503733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:51.503751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:51.503755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:51.503779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:51.503782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:51.503784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:51.503788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601793543098432:5723]
2025-10-10T14:35:51.503791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:51.503876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:51.503945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327250:6792], now have 1 active actors on pipe
2025-10-10T14:35:51.503952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327102:2438], now have 1 active actors on pipe
2025-10-10T14:35:51.504062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1820
2025-10-10T14:35:51.504065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1820
2025-10-10T14:35:51.504147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.504161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.504195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efe57865-f71e52a9-37931801-1232ba67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:51.504205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.504210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.504214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:51.504226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.504252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:51.504269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.504481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.504496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.504514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.504614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1821 partition: 0 MaxSeqNo: 40 sessionId: src_id|efe57865-f71e52a9-37931801-1232ba67_0
2025-10-10T14:35:51.505095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76cbc564-e8218841-98258793-ac38fd7d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|efe57865-f71e52a9-37931801-1232ba67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:51.507887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe57865-f71e52a9-37931801-1232ba67_0] Write session: try to update token
2025-10-10T14:35:51.507908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe57865-f71e52a9-37931801-1232ba67_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:51.524961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId: src_id|efe57865-f71e52a9-37931801-1232ba67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:51.527646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:51.527861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:51.527892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.527906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601793543098432:5723]
2025-10-10T14:35:51.527971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:51.528136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:51.528249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:51.528509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.528710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.528883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.529102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:51.529167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.529183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.529212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:51.529255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:51.529361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:51.551956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:51.551984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.551988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:51.551990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:51.552002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601793543098432:5723]
2025-10-10T14:35:51.552007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601793543098432:5723]
2025-10-10T14:35:51.552012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601793543098432:5723]
2025-10-10T14:35:51.552054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:51.552061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:51.552066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:51.552069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.552069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:51.552072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:51.552209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:51.581420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601794325327261:6939]
2025-10-10T14:35:51.587920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1820, pipe: [1:7559601794325327261:6939]
2025-10-10T14:35:51.676424Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:51.684783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.684820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.685023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.685118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.685188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.685258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.685895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.685912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.685986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.686050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.686122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.686195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.686241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.686249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.686315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.686377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.686442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.686513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.686737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.686750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.686816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.686881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.686949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.687017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.687058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.687065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.687136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.687201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.687266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.687328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.687375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.687383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.687452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.687511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.687572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.687637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.687690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.687699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.687775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.687844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.687915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.687984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.688051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.688065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.688138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.688193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.688254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.688314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.688353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.688356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.688421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.688477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.688539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.688608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.688650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.688653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.688721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.688780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.688842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.688907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.688952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.688956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.689029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327261:6939], now have 1 active actors on pipe
2025-10-10T14:35:51.689221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:51.689247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601794325327261:6939]
2025-10-10T14:35:51.689281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:51.689284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:51.689325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1821 reason: error at write: Disconnected sessionId: src_id|efe57865-f71e52a9-37931801-1232ba67_0
2025-10-10T14:35:51.689564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1821 sessionId: src_id|efe57865-f71e52a9-37931801-1232ba67_0 is DEAD
2025-10-10T14:35:51.689668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:51.693551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe57865-f71e52a9-37931801-1232ba67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:51.693564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe57865-f71e52a9-37931801-1232ba67_0] Write session will restart in 0.006070s
2025-10-10T14:35:51.693602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe57865-f71e52a9-37931801-1232ba67_0] Write session: Do CDS request
2025-10-10T14:35:51.693608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe57865-f71e52a9-37931801-1232ba67_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:51.700923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe57865-f71e52a9-37931801-1232ba67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.701051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:51.701076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1822
2025-10-10T14:35:51.701666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.701715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:51.701726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:51.701730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:51.702224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1822 sessionId:  describe result for acl check
2025-10-10T14:35:51.702260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:51.702271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:51.702278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:51.702286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601794325327411:6773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:51.702859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601794325327411:6773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:51.704092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:51.704679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601794325327411:6773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:51.706261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:51.706488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:51.706501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:51.706515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:51.706578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:51.706625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601793543098633:5678]
2025-10-10T14:35:51.707264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:51.707543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601794325327411:6773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:51.707558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601794325327411:6773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:51.707562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601794325327411:6773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:51.707571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:51.708451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:51.708515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:51.708853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:51.708926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.708933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.708934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.708936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.708937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.708938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.708940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.708941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.708942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.708944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.708945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.708946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.708947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.708954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.708969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.708973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.708979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.708983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.708987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.708991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.708995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.708999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.709004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.709009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.709013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.709017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.709026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.709035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.709042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.709048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.709053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.709059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.709064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.709070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.709075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.709080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.709085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.709091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.709096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.709101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.709106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.709120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.709125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.709130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.709135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.709145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.709150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.709155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.709160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.709169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.709178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.709188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.709232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:51.712332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:51.712835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:51.712849Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:51.712852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:51.712856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:51.712862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1821 [2:7559601793543098633:5678]
2025-10-10T14:35:51.712877Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:51.712897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:51.712905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.712909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.712912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.712932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:51.712946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:51.712955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:51.713030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.713039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.713041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.713044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:51.713116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:51.713125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.713138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.713156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.713180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:51.713212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327295:2438], now have 1 active actors on pipe
2025-10-10T14:35:51.713216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327451:6773], now have 1 active actors on pipe
2025-10-10T14:35:51.713224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601793543098628:5678]
2025-10-10T14:35:51.713226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601793543098628:5678]
2025-10-10T14:35:51.713228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601793543098628:5678]
2025-10-10T14:35:51.713243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:51.713257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:51.713262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:51.713265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:51.713268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:51.713280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:51.713283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:51.713265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1821
2025-10-10T14:35:51.713303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1821
2025-10-10T14:35:51.713310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601793543098628:5678]
2025-10-10T14:35:51.713323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:51.713345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:51.713474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.713486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.713518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:51.713532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.713542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.713545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:51.713556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.713568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:51.713603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.713794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.713811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.713837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.713959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1822 partition: 0 MaxSeqNo: 40 sessionId: src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0
2025-10-10T14:35:51.714377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe57865-f71e52a9-37931801-1232ba67_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:51.717187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0] Write session: try to update token
2025-10-10T14:35:51.717208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:51.725261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:51.725283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.725296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601793543098628:5678]
2025-10-10T14:35:51.725373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:51.725384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:51.725558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:51.725712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.725859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.726002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.726196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:51.726242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:51.732774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId: src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:51.735387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:51.735611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.735636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.735679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:51.735760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:51.744047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:51.744067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.744071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:51.744073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:51.744086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601793543098628:5678]
2025-10-10T14:35:51.744090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601793543098628:5678]
2025-10-10T14:35:51.744093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601793543098628:5678]
2025-10-10T14:35:51.744141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:51.744156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.744155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:51.744159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:51.744162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:51.744168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:51.744295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:51.789298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601794325327463:6939]
2025-10-10T14:35:51.789694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1821, pipe: [1:7559601794325327463:6939]
2025-10-10T14:35:51.859418Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:51.868164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.868196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.868389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.868456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.868522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.868592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.868639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.868644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.868723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.868789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.868853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.868924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.868970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.868973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.869044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.869109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.869179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.869243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.869291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.869299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.869389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.869739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.869805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.869868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.869920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.869928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.869995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.870062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.870126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.870190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.870233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.870242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.870309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.870372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.870436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.870502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.870550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.870559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.870641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.870704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.870777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.870844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.870890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.870898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.870964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.871026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.871089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.871156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.871202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.871209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.871275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.871339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.871405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.871471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.871517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.871525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.871596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:51.872591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601794325327463:6939]
2025-10-10T14:35:51.872638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:51.872641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:51.872672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1822 reason: error at write: Disconnected sessionId: src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0
2025-10-10T14:35:51.872928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1822 sessionId: src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0 is DEAD
2025-10-10T14:35:51.871660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:51.871732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:51.871796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:51.871840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:51.871843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:51.871916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327463:6939], now have 1 active actors on pipe
2025-10-10T14:35:51.872701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:51.873140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:51.874107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:51.874119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0] Write session will restart in 0.007073s
2025-10-10T14:35:51.874145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0] Write session: Do CDS request
2025-10-10T14:35:51.874151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:51.882889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.883065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:51.883096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1823
2025-10-10T14:35:51.883236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:51.883275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:51.883287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:51.883292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:51.883804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1823 sessionId:  describe result for acl check
2025-10-10T14:35:51.883853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:51.883862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:51.883864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:51.883871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601794325327526:6765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:51.884505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601794325327526:6765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:51.888061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601794325327526:6765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:51.892148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601794325327526:6765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:51.892167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601794325327526:6765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:51.892171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601794325327526:6765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:51.892181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:51.896055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:51.897976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:51.898190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:51.898199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:51.898211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:51.898265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:51.898311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601793543098806:5691]
2025-10-10T14:35:51.899025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:51.899328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:51.899366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:51.899740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:51.899806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.899815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.899817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.899818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.899819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.899821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.899822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.899823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.899825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.899826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.899827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.899828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.899830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.899836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.899849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.899853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.899856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.899859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.899863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.899866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.899870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.899873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.899876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.899880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.899884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.899887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.899896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.899905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:51.899911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.899916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:51.899920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.899925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:51.899929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.899933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:51.899938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.899944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:51.899949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.899954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:51.899959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.899965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:51.899969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.899975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:51.899981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.899988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:51.899992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.899999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:51.900005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.900009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.900013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.900018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.900022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.900027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.900068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:51.902626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:51.903067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:51.903082Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:51.903084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:51.903088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:51.903095Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1822 [2:7559601793543098806:5691]
2025-10-10T14:35:51.903108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:51.903127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:51.903130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.903133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.903136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.903153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:51.903161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:51.903168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:51.903220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.903223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.903225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.903227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:51.903297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:51.903305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.903316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:51.903328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:51.903350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:51.903377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327602:6765], now have 1 active actors on pipe
2025-10-10T14:35:51.903381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327478:2438], now have 1 active actors on pipe
2025-10-10T14:35:51.903389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601793543098801:5691]
2025-10-10T14:35:51.903391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601793543098801:5691]
2025-10-10T14:35:51.903394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601793543098801:5691]
2025-10-10T14:35:51.903408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:51.903434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:51.903451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:51.903459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:51.903486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601793543098801:5691]
2025-10-10T14:35:51.903493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:51.903495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:51.903499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:51.903501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:51.903508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:51.903458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1822
2025-10-10T14:35:51.903459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1822
2025-10-10T14:35:51.903607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.903624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.903662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:51.903688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:51.903693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:51.903696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:51.903713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:51.903727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:51.903743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.903952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.903960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.903976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:51.904077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1823 partition: 0 MaxSeqNo: 40 sessionId: src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0
2025-10-10T14:35:51.905476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39636ab5-d6d1fe07-ae23069b-13ef116b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:51.908801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0] Write session: try to update token
2025-10-10T14:35:51.908827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:51.915726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:51.915749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.915761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601793543098801:5691]
2025-10-10T14:35:51.915811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:51.915814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:51.915992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:51.916136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.916267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.916408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:51.916607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:51.916653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:51.924726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId: src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:51.927463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:51.927900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:51.927928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:51.927970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:51.928097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:51.935615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:51.935639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:51.935643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:51.935646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:51.935659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601793543098801:5691]
2025-10-10T14:35:51.935666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601793543098801:5691]
2025-10-10T14:35:51.935672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601793543098801:5691]
2025-10-10T14:35:51.935724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:51.935732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:51.935734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:51.935783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:51.935804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:51.935809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:51.935872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:51.972574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601794325327639:6939]
2025-10-10T14:35:51.972919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1822, pipe: [1:7559601794325327639:6939]
2025-10-10T14:35:52.055557Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:52.063222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.063255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.063417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.063480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.063551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.063615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.063655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.063665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.063729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.063790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.063851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.063917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.063962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.063973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.064041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.064104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.064163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.064220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.064259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.064261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.064323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.064380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.064437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.064494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.064532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.064534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.064600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.064654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.064711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.064781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.064823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.064826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.064889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.064942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.065010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.065078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.065121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.065123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.065185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.065246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.065311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.065396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.065439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.065442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.065511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.065593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.065661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.065733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.065779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.065786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.065856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.065920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.065983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.066050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.066096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.066109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.066186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.066250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.066319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.066381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.066430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.066437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.066504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601794325327639:6939], now have 1 active actors on pipe
2025-10-10T14:35:52.066772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:52.066789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:52.066808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601794325327639:6939]
2025-10-10T14:35:52.066830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:52.066836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1823 reason: error at write: Disconnected sessionId: src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0
2025-10-10T14:35:52.067172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:52.067181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0] Write session will restart in 0.007279s
2025-10-10T14:35:52.067207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0] Write session: Do CDS request
2025-10-10T14:35:52.067214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:52.067079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1823 sessionId: src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0 is DEAD
2025-10-10T14:35:52.067527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:52.076013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.076051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:52.076071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1824
2025-10-10T14:35:52.076267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.076334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:52.076348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:52.076353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:52.076882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1824 sessionId:  describe result for acl check
2025-10-10T14:35:52.076925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:52.076934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:52.076937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:52.076954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601798620294999:6761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:52.077615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601798620294999:6761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:52.080873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:52.080844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601798620294999:6761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:52.082701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:52.082970Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:52.082982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:52.083005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:52.083092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:52.083139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601797838066260:5688]
2025-10-10T14:35:52.083202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601798620294999:6761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:52.083223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601798620294999:6761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:52.083227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601798620294999:6761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:52.083236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:52.083778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:52.084113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:52.084187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:52.084553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:52.084618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.084627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.084628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.084630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.084631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.084633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.084634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.084635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.084636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.084637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.084639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.084640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.084641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.084649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.084663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.084667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.084670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.084675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.084679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.084682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.084686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.084690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.084694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.084698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.084702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.084705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.084716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.084725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.084732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.084738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.084742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.084747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.084751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.084756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.084760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.084765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.084769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.084774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.084780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.084786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.084797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.084803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.084808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.084818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.084823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.084830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.084839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.084845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.084849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.084855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.084859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.084865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.084909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:52.088140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:52.088917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:52.088932Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:52.088935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:52.088940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:52.088948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1823 [2:7559601797838066260:5688]
2025-10-10T14:35:52.088963Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:52.088982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:52.088985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.088989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.088992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.089014Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:52.089030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:52.089039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:52.089106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.089113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.089115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.089118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:52.089197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:52.089205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.089220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.089238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.089255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:52.089285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620294938:2438], now have 1 active actors on pipe
2025-10-10T14:35:52.089293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295088:6761], now have 1 active actors on pipe
2025-10-10T14:35:52.089303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601797838066255:5688]
2025-10-10T14:35:52.089309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601797838066255:5688]
2025-10-10T14:35:52.089311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601797838066255:5688]
2025-10-10T14:35:52.089326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:52.089355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:52.089359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:52.089364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:52.089376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1823
2025-10-10T14:35:52.089364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:52.089380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:52.089383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:52.089428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1823
2025-10-10T14:35:52.089424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601797838066255:5688]
2025-10-10T14:35:52.089434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:52.089454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:52.089496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.089506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.089540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:52.089556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.089578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.089581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:52.089595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.089606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:52.089622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.089886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.089897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.089915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.090238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1824 partition: 0 MaxSeqNo: 40 sessionId: src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0
2025-10-10T14:35:52.090683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a224e005-e1905b6a-5a65d5fe-f44a99db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:52.093920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0] Write session: try to update token
2025-10-10T14:35:52.093941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:52.106177Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:52.106198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:52.106210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601797838066255:5688]
2025-10-10T14:35:52.106261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:52.106260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:52.106441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:52.106586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.106726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.106871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.107074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:52.107121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:52.109590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId: src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:52.112253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:52.112486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.112506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.112564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:52.112664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:52.124670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:52.124690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:52.124694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:52.124697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:52.124707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601797838066255:5688]
2025-10-10T14:35:52.124711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601797838066255:5688]
2025-10-10T14:35:52.124716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601797838066255:5688]
2025-10-10T14:35:52.124770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:52.124779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.124777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:52.124782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:52.124785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:52.124789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:52.124915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:52.167116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601798620295101:6939]
2025-10-10T14:35:52.167466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1823, pipe: [1:7559601798620295101:6939]
2025-10-10T14:35:52.242601Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:52.250329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.250355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.250536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.250604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.250673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.250745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.250793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.250802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.250873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.250938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.251004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.251072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.251120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.251127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.251195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.251254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.251318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.251383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.251426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.251433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.251500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.251567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.251635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.251700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.251758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.251765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.251833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.251894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.251955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.252020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.252064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.252071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.252138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.252201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.252266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.252330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.252375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.252384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.252455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.252515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.252580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.252647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.252692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.252699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.252766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.252825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.252892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.252957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.253002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.253008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.253074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.253133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.253198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.253261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.253306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.253315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.253471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.253538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.253627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.253694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.253740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.253747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.253812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295101:6939], now have 1 active actors on pipe
2025-10-10T14:35:52.254845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:52.254905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601798620295101:6939]
2025-10-10T14:35:52.254933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:52.254940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:52.254967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1824 reason: error at write: Disconnected sessionId: src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0
2025-10-10T14:35:52.255145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1824 sessionId: src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0 is DEAD
2025-10-10T14:35:52.255321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:52.255336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0] Write session will restart in 0.007062s
2025-10-10T14:35:52.255372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0] Write session: Do CDS request
2025-10-10T14:35:52.255378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:52.255130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:52.263927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.265409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:52.265431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1825
2025-10-10T14:35:52.265601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.265662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:52.265674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:52.265680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:52.266140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1825 sessionId:  describe result for acl check
2025-10-10T14:35:52.266170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:52.266176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:52.266178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:52.266183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601798620295116:6756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:52.266747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601798620295116:6756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:52.270320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601798620295116:6756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:52.273476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601798620295116:6756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:52.273496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601798620295116:6756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:52.273500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601798620295116:6756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:52.273509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:52.274782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:52.276735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:52.276974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:52.276986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:52.276998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:52.277073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:52.277130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601797838066421:5686]
2025-10-10T14:35:52.277734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:52.278087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:52.278133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:52.278383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:52.278429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.278437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.278438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.278439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.278439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.278440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.278441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.278442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.278443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.278443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.278444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.278445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.278446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.278450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.278459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.278462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.278466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.278470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.278474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.278478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.278481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.278485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.278489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.278493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.278497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.278501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.278510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.278516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.278521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.278525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.278528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.278531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.278536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.278541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.278545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.278549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.278553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.278558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.278563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.278568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.278572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.278577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.278581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.278587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.278592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.278598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.278603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.278608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.278613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.278617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.278620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.278623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.278645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:52.281171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:52.281750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:52.281762Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:52.281765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:52.281770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:52.281778Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1824 [2:7559601797838066421:5686]
2025-10-10T14:35:52.281793Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:52.281811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:52.281819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.281823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.281825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.281844Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:52.281852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:52.281860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:52.281922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.281929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.281931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.281934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:52.282003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:52.282010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.282022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.282038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.282058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:52.282083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295103:2438], now have 1 active actors on pipe
2025-10-10T14:35:52.282092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295252:6756], now have 1 active actors on pipe
2025-10-10T14:35:52.282099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601797838066416:5686]
2025-10-10T14:35:52.282102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601797838066416:5686]
2025-10-10T14:35:52.282104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601797838066416:5686]
2025-10-10T14:35:52.282122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:52.282142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:52.282159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:52.282167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:52.282172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:52.282176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:52.282178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:52.282153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1824
2025-10-10T14:35:52.282176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1824
2025-10-10T14:35:52.282194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601797838066416:5686]
2025-10-10T14:35:52.282203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:52.282224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:52.282243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.282252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.282282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:52.282296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.282300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.282303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:52.282315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.282325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:52.282339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.282508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.282516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.282530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.282651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1825 partition: 0 MaxSeqNo: 40 sessionId: src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0
2025-10-10T14:35:52.283044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d01046f1-eaa1e8c6-b62bfcf3-76caf270_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:52.285828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0] Write session: try to update token
2025-10-10T14:35:52.285853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:52.300091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId: src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:52.302005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:52.302021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:52.302025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:52.302028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:52.302038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601797838066416:5686]
2025-10-10T14:35:52.302042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601797838066416:5686]
2025-10-10T14:35:52.302047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601797838066416:5686]
2025-10-10T14:35:52.302098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:52.302106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.302108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:52.302107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:52.302114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:52.302119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:52.302255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:52.302937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:52.355019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601798620295267:6939]
2025-10-10T14:35:52.355237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1824, pipe: [1:7559601798620295267:6939]
2025-10-10T14:35:52.420814Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:52.421146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.421162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.421209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295267:6939], now have 1 active actors on pipe
2025-10-10T14:35:52.421483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:52.422456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:52.422471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0] Write session will restart in 0.009844s
2025-10-10T14:35:52.422497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0] Write session: Do CDS request
2025-10-10T14:35:52.422504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:52.421958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:52.422014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:52.422022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601798620295267:6939]
2025-10-10T14:35:52.422086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1825 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0
2025-10-10T14:35:52.422292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1825 sessionId: src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0 is DEAD
2025-10-10T14:35:52.434045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.434563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:52.434584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1826
2025-10-10T14:35:52.434762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.434800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:52.434811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:52.434815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:52.435211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1826 sessionId:  describe result for acl check
2025-10-10T14:35:52.435249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:52.435251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:52.435253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:52.435260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601798620295389:6748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:52.435851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601798620295389:6748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:52.436450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:52.438134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601798620295389:6748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:52.438984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:52.439220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:52.439231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:52.439243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:52.439296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:52.439340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601797838066581:5684]
2025-10-10T14:35:52.440007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:52.440285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:52.440341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:52.440654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:52.440717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.440723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.440725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.440726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.440727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.440729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.440730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.440731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.440732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.440734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.440736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601798620295389:6748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:52.440735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.440751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601798620295389:6748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:52.440736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.440737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.440742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.440754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601798620295389:6748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:52.440756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.440760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.440765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.440763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:52.440769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.440773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.440778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.440782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.440786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.440790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.440795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.440799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.440802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.440810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.440820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.440827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.440833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.440837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.440842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.440847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.440852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.440857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.440862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.440867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.440872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.440877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.440882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.440886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.440893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.440897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.440903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.440907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.440912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.440916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.440921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.440926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.440930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.440935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.440939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.440976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:52.443516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:52.443835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:52.443847Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:52.443849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:52.443852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:52.443858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1825 [2:7559601797838066581:5684]
2025-10-10T14:35:52.443866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:52.443881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:52.443886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.443889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.443891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.443906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:52.443917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:52.443931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:52.443995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.444001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.444002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.444004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:52.444056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:52.444061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.444068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.444076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.444085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:52.444102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601797838066576:5684]
2025-10-10T14:35:52.444104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601797838066576:5684]
2025-10-10T14:35:52.444105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601797838066576:5684]
2025-10-10T14:35:52.444114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:52.444126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:52.444135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:52.444138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:52.444159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601797838066576:5684]
2025-10-10T14:35:52.444165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:52.444303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:52.444310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:52.444311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:52.444316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:52.444659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295422:6748], now have 1 active actors on pipe
2025-10-10T14:35:52.444667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295268:2438], now have 1 active actors on pipe
2025-10-10T14:35:52.444809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1825
2025-10-10T14:35:52.444839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1825
2025-10-10T14:35:52.444911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.444920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.444954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:52.444967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.444971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.444973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:52.444983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.444994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:52.445010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.445767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc8a12bc-5ff7d463-ab20b20-bc6f0ede_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:52.445341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1826 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0
2025-10-10T14:35:52.445201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.445212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.445231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.448254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0] Write session: try to update token
2025-10-10T14:35:52.448276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:52.463086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId: src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:52.465471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:52.465493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:52.465497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:52.465499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:52.465511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601797838066576:5684]
2025-10-10T14:35:52.465518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601797838066576:5684]
2025-10-10T14:35:52.465524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601797838066576:5684]
2025-10-10T14:35:52.465597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:52.465601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:52.465607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.465608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:52.465612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:52.465611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:52.465847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:52.465865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:52.521935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601798620295433:6939]
2025-10-10T14:35:52.522508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1825, pipe: [1:7559601798620295433:6939]
2025-10-10T14:35:52.580351Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:52.580822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.580836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.580882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295433:6939], now have 1 active actors on pipe
2025-10-10T14:35:52.581119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:52.581169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601798620295433:6939]
2025-10-10T14:35:52.581186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:52.581191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:52.581205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:52.581259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1826 reason: error at write: Disconnected sessionId: src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0
2025-10-10T14:35:52.581502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1826 sessionId: src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0 is DEAD
2025-10-10T14:35:52.581679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:52.581691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0] Write session will restart in 0.006115s
2025-10-10T14:35:52.581715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0] Write session: Do CDS request
2025-10-10T14:35:52.581724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:52.588987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.589065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:52.589086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1827
2025-10-10T14:35:52.589229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.589277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:52.589287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:52.589292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:52.589867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1827 sessionId:  describe result for acl check
2025-10-10T14:35:52.589907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:52.589909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:52.589911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:52.589918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601798620295459:6743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:52.590540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601798620295459:6743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:52.594054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601798620295459:6743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:52.597115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601798620295459:6743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:52.597144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601798620295459:6743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:52.597148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601798620295459:6743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:52.597158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:52.597491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:52.599766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:52.600017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:52.600029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:52.600041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:52.600099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:52.600157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601797838066744:5683]
2025-10-10T14:35:52.600915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:52.601320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:52.601387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:52.601754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:52.601833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.601842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.601844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.601845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.601847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.601848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.601849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.601851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.601853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.601855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.601857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.601858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.601860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.601868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.601882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.601887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.601891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.601895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.601900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.601905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.601909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.601914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.601920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.601924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.601928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.601932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.601944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.601952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.601959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.601966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.601971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.601978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.601983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.601997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.602004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.602015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.602020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.602032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.602038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.602045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.602055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.602062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.602072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.602079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.602090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.602096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.602106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.602115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.602124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.602131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.602141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.602148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.602193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:52.604999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:52.605579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:52.605594Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:52.605597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:52.605601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:52.605609Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1826 [2:7559601797838066744:5683]
2025-10-10T14:35:52.605626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:52.605645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:52.605650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.605654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.605657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.605674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:52.605682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:52.605690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:52.605758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.605766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.605769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.605772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:52.605849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:52.605858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.605868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.605879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.605896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:52.605919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295434:2438], now have 1 active actors on pipe
2025-10-10T14:35:52.605927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295587:6743], now have 1 active actors on pipe
2025-10-10T14:35:52.605934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601797838066738:5683]
2025-10-10T14:35:52.605938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601797838066738:5683]
2025-10-10T14:35:52.605941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601797838066738:5683]
2025-10-10T14:35:52.605958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:52.605974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:52.605986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:52.605992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:52.605995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:52.605996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:52.605998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:52.606019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601797838066738:5683]
2025-10-10T14:35:52.606027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:52.605991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1826
2025-10-10T14:35:52.606022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1826
2025-10-10T14:35:52.606041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:52.606073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.606083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.606111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b167e0d8-681ee545-168d1621-914fc8e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:52.606122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.606126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.606129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:52.606140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.606154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:52.606172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.606437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.606448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.606467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.606577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1827 partition: 0 MaxSeqNo: 40 sessionId: src_id|b167e0d8-681ee545-168d1621-914fc8e3_0
2025-10-10T14:35:52.606999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0b0faa9-320234f3-6e46f6b8-1cee2ea6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b167e0d8-681ee545-168d1621-914fc8e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:52.609812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b167e0d8-681ee545-168d1621-914fc8e3_0] Write session: try to update token
2025-10-10T14:35:52.609835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b167e0d8-681ee545-168d1621-914fc8e3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:52.624882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId: src_id|b167e0d8-681ee545-168d1621-914fc8e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:52.627900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:52.627953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:52.627979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:52.627983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:52.627986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:52.627997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601797838066738:5683]
2025-10-10T14:35:52.628003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601797838066738:5683]
2025-10-10T14:35:52.628008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601797838066738:5683]
2025-10-10T14:35:52.628072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:52.628071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:52.628089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:52.628091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.628094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:52.628094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:52.628275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:52.681178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601798620295611:6939]
2025-10-10T14:35:52.681476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1826, pipe: [1:7559601798620295611:6939]
2025-10-10T14:35:52.759876Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:52.760159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.760175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.760222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295611:6939], now have 1 active actors on pipe
2025-10-10T14:35:52.760434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:52.760463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:52.760455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:52.760517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:52.760543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1827 reason: error at write: Disconnected sessionId: src_id|b167e0d8-681ee545-168d1621-914fc8e3_0
2025-10-10T14:35:52.760577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601798620295611:6939]
2025-10-10T14:35:52.760754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1827 sessionId: src_id|b167e0d8-681ee545-168d1621-914fc8e3_0 is DEAD
2025-10-10T14:35:52.760905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b167e0d8-681ee545-168d1621-914fc8e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:52.760913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b167e0d8-681ee545-168d1621-914fc8e3_0] Write session will restart in 0.005810s
2025-10-10T14:35:52.760938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b167e0d8-681ee545-168d1621-914fc8e3_0] Write session: Do CDS request
2025-10-10T14:35:52.760947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b167e0d8-681ee545-168d1621-914fc8e3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:52.767938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b167e0d8-681ee545-168d1621-914fc8e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.768006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:52.768027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1828
2025-10-10T14:35:52.768173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.768230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:52.768241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:52.768245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:52.768740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1828 sessionId:  describe result for acl check
2025-10-10T14:35:52.768780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:52.768787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:52.768789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:52.768795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601798620295671:6725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:52.769430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601798620295671:6725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:52.772930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601798620295671:6725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:52.773677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:52.776243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601798620295671:6725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:52.776259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601798620295671:6725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:52.776263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601798620295671:6725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:52.776272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:52.775949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:52.776207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:52.776213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:52.776227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:52.776297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:52.776337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601797838066943:5657]
2025-10-10T14:35:52.776953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:52.777255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:52.777303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:52.777662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:52.777724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.777732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.777733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.777735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.777736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.777737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.777738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.777739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.777741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.777742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.777743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.777744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.777746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.777752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.777765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.777769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.777774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.777777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.777781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.777785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.777789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.777793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.777798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.777802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.777806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.777810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.777818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.777827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.777834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.777839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.777844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.777849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.777853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.777859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.777864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.777875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.777880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.777886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.777894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.777900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.777904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.777911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.777920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.777925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.777930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.777940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.777944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.777954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.777959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.777964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.777973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.777978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.778021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:52.780555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:52.780934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:52.780949Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:52.780952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:52.780956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:52.780962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1827 [2:7559601797838066943:5657]
2025-10-10T14:35:52.780976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:52.780994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:52.780997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.781001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.781003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.781021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:52.781035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:52.781048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:52.781113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.781122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.781124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.781127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:52.781189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:52.781197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.781210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.781228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.781266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:52.781297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295638:2438], now have 1 active actors on pipe
2025-10-10T14:35:52.781301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295790:6725], now have 1 active actors on pipe
2025-10-10T14:35:52.781310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601797838066938:5657]
2025-10-10T14:35:52.781313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601797838066938:5657]
2025-10-10T14:35:52.781315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601797838066938:5657]
2025-10-10T14:35:52.781347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:52.781363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:52.781362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:52.781366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:52.781368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:52.781364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1827
2025-10-10T14:35:52.781369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1827
2025-10-10T14:35:52.781381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:52.781396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:52.781421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601797838066938:5657]
2025-10-10T14:35:52.781430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:52.781470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:52.781492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.781500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.781534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3685a062-12ec0158-cdfd296b-5413457e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:52.781553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.781557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.781560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:52.781571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.781589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:52.781609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.781819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.781828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.781846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.781935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1828 partition: 0 MaxSeqNo: 40 sessionId: src_id|3685a062-12ec0158-cdfd296b-5413457e_0
2025-10-10T14:35:52.782344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b167e0d8-681ee545-168d1621-914fc8e3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3685a062-12ec0158-cdfd296b-5413457e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:52.785065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3685a062-12ec0158-cdfd296b-5413457e_0] Write session: try to update token
2025-10-10T14:35:52.785086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3685a062-12ec0158-cdfd296b-5413457e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:52.793743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:52.793761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:52.793773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601797838066938:5657]
2025-10-10T14:35:52.793821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:52.793828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:52.794034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:52.794214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.794386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.794563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.794878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:52.794927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:52.800079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId: src_id|3685a062-12ec0158-cdfd296b-5413457e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:52.802767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:52.803007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.803026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.803082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:52.803167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:52.811669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:52.811686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:52.811689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:52.811691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:52.811701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601797838066938:5657]
2025-10-10T14:35:52.811705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601797838066938:5657]
2025-10-10T14:35:52.811708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601797838066938:5657]
2025-10-10T14:35:52.811764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:52.811768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:52.811771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:52.811775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.811776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:52.811778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:52.811912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:52.860892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601798620295814:6939]
2025-10-10T14:35:52.861812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1827, pipe: [1:7559601798620295814:6939]
2025-10-10T14:35:52.928639Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:52.937305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.937356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.937555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.937623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.937692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.937760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.937806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.937817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.937886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.937950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.938023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.938090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.938135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.938143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.938218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.938282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.938349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.938421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.938469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.938477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.938552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.938629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.938700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.938768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.938814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.938821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.938892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.938956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.939023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.939091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.939140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.939149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.939220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.939285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.939350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.939418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.939465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.939473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.939541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.939607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.939675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.939742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.939788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.939796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.939865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.939930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.939994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.940060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.940105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.940112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.940182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.940245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.940312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.940393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.940438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.940446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.940514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:52.940580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:52.940646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:52.940713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:52.940759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:52.940768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:52.940840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295814:6939], now have 1 active actors on pipe
2025-10-10T14:35:52.941084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:52.941104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:52.941133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:52.941138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1828 reason: error at write: Disconnected sessionId: src_id|3685a062-12ec0158-cdfd296b-5413457e_0
2025-10-10T14:35:52.941193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601798620295814:6939]
2025-10-10T14:35:52.941367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1828 sessionId: src_id|3685a062-12ec0158-cdfd296b-5413457e_0 is DEAD
2025-10-10T14:35:52.941521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3685a062-12ec0158-cdfd296b-5413457e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:52.941529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3685a062-12ec0158-cdfd296b-5413457e_0] Write session will restart in 0.007338s
2025-10-10T14:35:52.941566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3685a062-12ec0158-cdfd296b-5413457e_0] Write session: Do CDS request
2025-10-10T14:35:52.941572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3685a062-12ec0158-cdfd296b-5413457e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:52.942013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:52.952535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3685a062-12ec0158-cdfd296b-5413457e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.952607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:52.952628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1829
2025-10-10T14:35:52.952772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:52.952823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:52.952836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:52.952840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:52.953363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1829 sessionId:  describe result for acl check
2025-10-10T14:35:52.953409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:52.953411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:52.953413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:52.953420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601798620295868:6719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:52.954018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601798620295868:6719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:52.957466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:52.959353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601798620295868:6719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:52.959717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:52.959935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:52.959948Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:52.959959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:52.960011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:52.960055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601797838067120:5654]
2025-10-10T14:35:52.960694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:52.961005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:52.961046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:52.961382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:52.961440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.961446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.961447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.961448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.961450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.961451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.961453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.961454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.961455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.961456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.961458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.961459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.961461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.961467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.961480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.961485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.961489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.961493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.961497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.961501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.961505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.961509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.961513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.961516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.961521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.961525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.961532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.961556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:52.961563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.961569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:52.961573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.961578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:52.961583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.961588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:52.961593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.961598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:52.961603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.961609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:52.961614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.961619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:52.961623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.961630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:52.961640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.961645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:52.961650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.961654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:52.961659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.961664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.961673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.961678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.961683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.961688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.961734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:52.962490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601798620295868:6719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:52.962510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601798620295868:6719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:52.962514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601798620295868:6719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:52.962522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:52.964267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:52.964607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:52.964619Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:52.964622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:52.964627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:52.964642Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1828 [2:7559601797838067120:5654]
2025-10-10T14:35:52.964656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:52.964674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:52.964681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.964685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.964687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.964713Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:52.964725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:52.964732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:52.964791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.964798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.964800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.964803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:52.964870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:52.964877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:52.964888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:52.964905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:52.964923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:52.964950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601797838067115:5654]
2025-10-10T14:35:52.964953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601797838067115:5654]
2025-10-10T14:35:52.964955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601797838067115:5654]
2025-10-10T14:35:52.964968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:52.964983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:52.964987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:52.964989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:52.964994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295976:6719], now have 1 active actors on pipe
2025-10-10T14:35:52.964998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601798620295816:2438], now have 1 active actors on pipe
2025-10-10T14:35:52.965006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:52.965022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:52.965029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:52.965061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601797838067115:5654]
2025-10-10T14:35:52.965072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:52.965034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1828
2025-10-10T14:35:52.965035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1828
2025-10-10T14:35:52.965081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:52.965263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.965278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.965311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:52.965326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:52.965351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:52.965353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:52.965365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:52.965379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:52.965400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.965603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.965613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.965629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:52.965738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1829 partition: 0 MaxSeqNo: 40 sessionId: src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0
2025-10-10T14:35:52.966163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3685a062-12ec0158-cdfd296b-5413457e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:52.968892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0] Write session: try to update token
2025-10-10T14:35:52.968911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:52.984039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId: src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:52.985133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:52.985154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:52.985165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601797838067115:5654]
2025-10-10T14:35:52.985220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:52.985225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:52.985420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:52.985598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.985741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.985880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:52.986080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:52.986118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:52.986953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:52.987317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:52.987341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:52.987377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:52.987470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:53.007487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:53.007505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:53.007508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:53.007510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:53.007521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601797838067115:5654]
2025-10-10T14:35:53.007526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601797838067115:5654]
2025-10-10T14:35:53.007529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601797838067115:5654]
2025-10-10T14:35:53.007580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:53.007585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:53.007587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.007590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:53.007591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:53.007598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:53.007728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:53.041611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601802915263280:6939]
2025-10-10T14:35:53.041936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1828, pipe: [1:7559601802915263280:6939]
2025-10-10T14:35:53.127260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:53.135819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.135846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.136036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.136105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.136166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.136224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.136273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.136278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.136349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.136405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.136463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.136524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.136563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.136567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.136636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.136693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.136752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.136815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.136855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.136858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.136928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.136986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.137045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.137102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.137141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.137144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.137211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.137267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.137488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.137574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.137622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.137630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.137701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.137763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.137827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.137894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.137939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.137946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.138022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.138088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.138160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.138224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.138273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.138280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.138351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.138414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.138480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.138548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.138595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.138604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.138669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.138731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.138795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.138859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.138904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.138912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.138978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:53.139040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:53.139102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:53.139167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:53.139213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:53.139223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:53.139285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263280:6939], now have 1 active actors on pipe
2025-10-10T14:35:53.139987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:53.140013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0] Write session will restart in 0.005183s
2025-10-10T14:35:53.140040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0] Write session: Do CDS request
2025-10-10T14:35:53.140047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:53.139530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:53.139553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:53.139588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1829 reason: error at write: Disconnected sessionId: src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0
2025-10-10T14:35:53.139820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1829 sessionId: src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0 is DEAD
2025-10-10T14:35:53.140029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601802915263280:6939]
2025-10-10T14:35:53.140044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:53.140381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:53.149908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.149947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:53.149968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1830
2025-10-10T14:35:53.150165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.150211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:53.150221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:53.150225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:53.150706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1830 sessionId:  describe result for acl check
2025-10-10T14:35:53.150743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:53.150749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:53.150761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:53.150767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601802915263368:6709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:53.151331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601802915263368:6709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:53.153901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:53.154253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601802915263368:6709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:53.155770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:53.155995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:53.156006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:53.156035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:53.156098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:53.156140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601802133034581:5653]
2025-10-10T14:35:53.156800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:53.156903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601802915263368:6709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:53.156917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601802915263368:6709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:53.156920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601802915263368:6709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:53.156929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:53.157087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:53.157135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:53.157504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:53.157581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.157587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.157588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.157590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.157591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.157592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.157594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.157595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.157597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.157598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.157599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.157600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.157601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.157607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.157620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.157625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.157629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.157632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.157636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.157640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.157644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.157648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.157664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.157667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.157671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.157675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.157683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.157693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.157699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.157705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.157709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.157715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.157720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.157726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.157737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.157742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.157746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.157751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.157761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.157767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.157771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.157776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.157781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.157786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.157790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.157795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.157800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.157809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.157814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.157819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.157824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.157829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.157869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:53.160299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:53.160622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:53.160634Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:53.160637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:53.160641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:53.160647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1829 [2:7559601802133034581:5653]
2025-10-10T14:35:53.160659Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:53.160677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:53.160686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.160690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.160693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.160709Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:53.160719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:53.160735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:53.160791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.160798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.160801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.160803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:53.160869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:53.160881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.160893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.160909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.160932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:53.160956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263442:6709], now have 1 active actors on pipe
2025-10-10T14:35:53.160966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263282:2438], now have 1 active actors on pipe
2025-10-10T14:35:53.160974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601802133034576:5653]
2025-10-10T14:35:53.160976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601802133034576:5653]
2025-10-10T14:35:53.160978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601802133034576:5653]
2025-10-10T14:35:53.160993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:53.161008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:53.161007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:53.161011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:53.161013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:53.161028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:53.161031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:53.161013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1829
2025-10-10T14:35:53.161024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1829
2025-10-10T14:35:53.161056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601802133034576:5653]
2025-10-10T14:35:53.161064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:53.161065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:53.161087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.161096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.161150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:53.161165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.161170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.161172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:53.161183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.161196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:53.161219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.161381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.161389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.161404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.161502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1830 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0
2025-10-10T14:35:53.161948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be6d05ea-70cfb45f-d52e0463-91b2f15_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:53.164553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0] Write session: try to update token
2025-10-10T14:35:53.164569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:53.178510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId: src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:53.180993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:53.181014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:53.181018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:53.181019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:53.181030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601802133034576:5653]
2025-10-10T14:35:53.181035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601802133034576:5653]
2025-10-10T14:35:53.181039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601802133034576:5653]
2025-10-10T14:35:53.181092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:53.181093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:53.181100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:53.181105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:53.181106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.181108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:53.181247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:53.181270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:53.240285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601802915263451:6939]
2025-10-10T14:35:53.240583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1829, pipe: [1:7559601802915263451:6939]
2025-10-10T14:35:53.302429Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:53.302883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.302904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.302970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263451:6939], now have 1 active actors on pipe
2025-10-10T14:35:53.303194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:53.303226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:53.303245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:53.303250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601802915263451:6939]
2025-10-10T14:35:53.303272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:53.303321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1830 reason: error at write: Disconnected sessionId: src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0
2025-10-10T14:35:53.303543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1830 sessionId: src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0 is DEAD
2025-10-10T14:35:53.303720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:53.303728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0] Write session will restart in 0.007066s
2025-10-10T14:35:53.303754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0] Write session: Do CDS request
2025-10-10T14:35:53.303763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:53.311855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.313543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:53.313564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1831
2025-10-10T14:35:53.315329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.315387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:53.315397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:53.315402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:53.315821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1831 sessionId:  describe result for acl check
2025-10-10T14:35:53.315856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:53.315863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:53.315866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:53.315883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601802915263579:6700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:53.316472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601802915263579:6700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:53.317282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:53.318730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601802915263579:6700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:53.319453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:53.319693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:53.319714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:53.319728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:53.319791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:53.319835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601802133034746:5645]
2025-10-10T14:35:53.320478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:53.320816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:53.320861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:53.321357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601802915263579:6700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:53.321372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601802915263579:6700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:53.321376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601802915263579:6700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:53.321384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:53.321181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:53.321243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.321244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.321245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.321246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.321247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.321248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.321249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.321250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.321251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.321252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.321253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.321254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.321255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.321261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.321275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.321279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.321283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.321287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.321290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.321294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.321297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.321301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.321305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.321308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.321312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.321316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.321324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.321350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.321357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.321362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.321366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.321371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.321375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.321379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.321383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.321388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.321392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.321396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.321400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.321405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.321408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.321413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.321417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.321421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.321427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.321431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.321436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.321440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.321444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.321448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.321452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.321457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.321493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:53.324285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:53.324641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:53.324652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:53.324655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:53.324659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:53.324664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1830 [2:7559601802133034746:5645]
2025-10-10T14:35:53.324677Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:53.324695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:53.324698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.324701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.324703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.324987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1830
2025-10-10T14:35:53.325031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1830
2025-10-10T14:35:53.324720Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:53.324744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:53.324752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:53.324807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.324810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.324812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.324814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:53.324893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:53.324895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.324906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.324916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.324931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:53.324951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263452:2438], now have 1 active actors on pipe
2025-10-10T14:35:53.324955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263613:6700], now have 1 active actors on pipe
2025-10-10T14:35:53.324972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601802133034741:5645]
2025-10-10T14:35:53.324975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601802133034741:5645]
2025-10-10T14:35:53.324977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601802133034741:5645]
2025-10-10T14:35:53.324990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:53.325005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:53.325007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:53.325010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:53.325012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:53.325020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:53.325023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:53.325047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601802133034741:5645]
2025-10-10T14:35:53.325055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:53.325102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:53.325195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.325205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.325241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:53.325268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.325278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.325281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:53.325293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.325311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:53.325363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.325685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.325696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.325717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.325879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1831 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0
2025-10-10T14:35:53.326271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1b6da29-11fd9bdf-59eef02b-2cc21835_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:53.328889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0] Write session: try to update token
2025-10-10T14:35:53.328906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:53.346352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId: src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:53.347793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:53.347810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:53.347814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:53.347817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:53.347827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601802133034741:5645]
2025-10-10T14:35:53.347832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601802133034741:5645]
2025-10-10T14:35:53.347838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601802133034741:5645]
2025-10-10T14:35:53.347889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:53.347888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:53.347895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:53.347900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:53.347902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.347904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:53.348051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:53.349297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:53.403611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601802915263622:6939]
2025-10-10T14:35:53.404201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1830, pipe: [1:7559601802915263622:6939]
2025-10-10T14:35:53.471136Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:53.471789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.471808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.471857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263622:6939], now have 1 active actors on pipe
2025-10-10T14:35:53.472101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:53.472628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:53.472645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601802915263622:6939]
2025-10-10T14:35:53.472674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:53.472754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1831 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0
2025-10-10T14:35:53.473122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:53.473131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0] Write session will restart in 0.006932s
2025-10-10T14:35:53.473157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0] Write session: Do CDS request
2025-10-10T14:35:53.473164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:53.472964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1831 sessionId: src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0 is DEAD
2025-10-10T14:35:53.481960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.482071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:53.482090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1832
2025-10-10T14:35:53.482358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.482406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:53.482411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:53.482415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:53.482964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1832 sessionId:  describe result for acl check
2025-10-10T14:35:53.483003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:53.483005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:53.483007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:53.483013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601802915263657:6695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:53.483563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601802915263657:6695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:53.486626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601802915263657:6695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:53.490001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:53.492090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:53.492291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:53.492296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:53.492308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:53.492354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:53.492404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601802133034912:5643]
2025-10-10T14:35:53.493051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:53.492593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601802915263657:6695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:53.492611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601802915263657:6695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:53.492615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601802915263657:6695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:53.492625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:53.493452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:53.493497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:53.493848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:53.493902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.493903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.493904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.493906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.493907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.493908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.493909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.493911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.493912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.493913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.493915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.493916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.493917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.493923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.493935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.493940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.493944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.493948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.493951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.493955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.493959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.493964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.493968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.493972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.493975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.493979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.493986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.493995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.494001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.494006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.494011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.494016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.494021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.494027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.494031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.494036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.494041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.494046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.494050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.494056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.494060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.494065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.494070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.494075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.494080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.494085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.494090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.494097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.494101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.494106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.494110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.494115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.494157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:53.498577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:53.498943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:53.498948Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:53.498951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:53.498972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:53.498980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1831 [2:7559601802133034912:5643]
2025-10-10T14:35:53.498995Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:53.499015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:53.499019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.499023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.499025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.499046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:53.499054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:53.499063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:53.499127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.499130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.499133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.499136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:53.499210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:53.499214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.499227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.499238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.499254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:53.499276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601802133034907:5643]
2025-10-10T14:35:53.499279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601802133034907:5643]
2025-10-10T14:35:53.499281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601802133034907:5643]
2025-10-10T14:35:53.499303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:53.499319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:53.499336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:53.499339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:53.499351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:53.499355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:53.499357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:53.499375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601802133034907:5643]
2025-10-10T14:35:53.499378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:53.499451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:53.500065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1831
2025-10-10T14:35:53.500111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1831
2025-10-10T14:35:53.503032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263623:2438], now have 1 active actors on pipe
2025-10-10T14:35:53.503046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263783:6695], now have 1 active actors on pipe
2025-10-10T14:35:53.503078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.503085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.503129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:53.503142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.503148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.503151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:53.503168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.503190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:53.503212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.507664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.507683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.507726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.509105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1832 partition: 0 MaxSeqNo: 40 sessionId: src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0
2025-10-10T14:35:53.511835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f7753ea-668f7433-9a40c6a1-b9e406f0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:53.514601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0] Write session: try to update token
2025-10-10T14:35:53.514623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:53.525215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:53.525231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:53.525236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:53.525238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:53.525249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601802133034907:5643]
2025-10-10T14:35:53.525253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601802133034907:5643]
2025-10-10T14:35:53.525257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601802133034907:5643]
2025-10-10T14:35:53.525311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:53.525319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.525322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:53.525468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:53.529605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:53.529616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:53.529621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:53.547187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId: src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:53.549815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:53.572549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601802915263795:6939]
2025-10-10T14:35:53.573560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1831, pipe: [1:7559601802915263795:6939]
2025-10-10T14:35:53.660186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:53.660492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.660502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.660525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263795:6939], now have 1 active actors on pipe
2025-10-10T14:35:53.660781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:53.660846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601802915263795:6939]
2025-10-10T14:35:53.660888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:53.660896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:53.660960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1832 reason: error at write: Disconnected sessionId: src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0
2025-10-10T14:35:53.661171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1832 sessionId: src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0 is DEAD
2025-10-10T14:35:53.660819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:53.661426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:53.661438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0] Write session will restart in 0.007774s
2025-10-10T14:35:53.661464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0] Write session: Do CDS request
2025-10-10T14:35:53.661470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:53.670965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.672666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:53.672688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1833
2025-10-10T14:35:53.672850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.672890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:53.672902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:53.672906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:53.673396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1833 sessionId:  describe result for acl check
2025-10-10T14:35:53.673440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:53.673443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:53.673445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:53.673451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601802915263815:6684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:53.674119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601802915263815:6684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:53.682074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601802915263815:6684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:53.685163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601802915263815:6684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:53.685181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601802915263815:6684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:53.685184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601802915263815:6684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:53.685193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:53.686804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:53.687345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:53.687536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:53.687548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:53.687560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:53.687628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:53.687674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601802133035080:5638]
2025-10-10T14:35:53.688244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:53.688791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:53.688840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:53.689188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:53.689243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.689245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.689246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.689247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.689249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.689250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.689251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.689252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.689254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.689255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.689256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.689257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.689259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.689265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.689280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.689284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.689289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.689293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.689297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.689302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.689306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.689311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.689316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.689320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.689325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.689346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.689355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.689363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.689370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.689374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.689378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.689383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.689386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.689391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.689396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.689401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.689405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.689409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.689414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.689418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.689422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.689427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.689431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.689436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.689440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.689444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.689448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.689453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.689456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.689462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.689467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.689471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.689536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:53.692309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:53.692857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:53.692870Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:53.692872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:53.692876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:53.692884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1832 [2:7559601802133035080:5638]
2025-10-10T14:35:53.692897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:53.692915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:53.692923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.692927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.692930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.692947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:53.692960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:53.692969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:53.693033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.693039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.693041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.693044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:53.693108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:53.693117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.693131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.693149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.693172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:53.693198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601802133035075:5638]
2025-10-10T14:35:53.693206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601802133035075:5638]
2025-10-10T14:35:53.693208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601802133035075:5638]
2025-10-10T14:35:53.693222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:53.693238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:53.693256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:53.693263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:53.693289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601802133035075:5638]
2025-10-10T14:35:53.693296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:53.693471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:53.693489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:53.693491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:53.693498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:53.693768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263798:2438], now have 1 active actors on pipe
2025-10-10T14:35:53.693777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263963:6684], now have 1 active actors on pipe
2025-10-10T14:35:53.693870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1832
2025-10-10T14:35:53.693909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1832
2025-10-10T14:35:53.694118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.694126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.694159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:53.694169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.694174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.694177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:53.694189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.694201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:53.694217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.694455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.694461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.694491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.694660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1833 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0
2025-10-10T14:35:53.695104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b15491c3-ae370b6a-6bce1d92-fed7e8a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:53.697915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0] Write session: try to update token
2025-10-10T14:35:53.697935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:53.724298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId: src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:53.727117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:53.727693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.727717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.727742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:53.727746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:53.727749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:53.727751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:53.727760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601802133035075:5638]
2025-10-10T14:35:53.727765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601802133035075:5638]
2025-10-10T14:35:53.727768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601802133035075:5638]
2025-10-10T14:35:53.727810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:53.727824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:53.727828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:53.727835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:53.727842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.727845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:53.727974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:53.760931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601802915263992:6939]
2025-10-10T14:35:53.761224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1832, pipe: [1:7559601802915263992:6939]
2025-10-10T14:35:53.846763Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:53.847242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:53.847300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915263992:6939], now have 1 active actors on pipe
2025-10-10T14:35:53.847404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:53.848137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601802915263992:6939]
2025-10-10T14:35:53.848155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:53.859446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:53.859464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:53.859492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1833 reason: error at write: Disconnected sessionId: src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0
2025-10-10T14:35:53.859772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:53.859782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0] Write session will restart in 0.005793s
2025-10-10T14:35:53.859805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0] Write session: Do CDS request
2025-10-10T14:35:53.859811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:53.859665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1833 sessionId: src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0 is DEAD
2025-10-10T14:35:53.866965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.867019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:53.867048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1834
2025-10-10T14:35:53.867244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:53.867284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:53.867291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:53.867296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:53.867793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1834 sessionId:  describe result for acl check
2025-10-10T14:35:53.867825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:53.867830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:53.867831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:53.867840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601802915264147:6669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:53.868426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601802915264147:6669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:53.868770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:53.871104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:53.871349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:53.871362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:53.871375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:53.871454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:53.871497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601802133035300:5604]
2025-10-10T14:35:53.871602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601802915264147:6669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:53.872100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:53.872509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:53.872600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:53.873008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:53.873104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.873112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.873114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.873116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.873117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.873118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.873119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.873120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.873122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.873123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.873124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.873125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.873126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.873133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.873169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.873174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.873178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.873182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.873186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.873189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.873193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.873197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.873202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.873205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.873209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.873213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.873222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.873232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:53.873243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.873249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:53.873254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.873262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:53.873267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.873272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:53.873279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.873284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:53.873289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.873294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:53.873305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.873310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:53.873315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.873319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:53.873326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.873350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:53.873359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.873364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:53.873369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.873373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.873382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.873387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.873392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.873402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.873439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:53.876106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:53.876110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601802915264147:6669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:53.876129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601802915264147:6669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:53.876133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601802915264147:6669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:53.876143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:53.876518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:53.876531Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:53.876543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:53.876548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:53.876555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1833 [2:7559601802133035300:5604]
2025-10-10T14:35:53.876571Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:53.876593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:53.876602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.876607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.876610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.876629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:53.876642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:53.876655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:53.876715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.876723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.876725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.876729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:53.876815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:53.876824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.876838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:53.876857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:53.876880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:53.876906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601802133035295:5604]
2025-10-10T14:35:53.876914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601802133035295:5604]
2025-10-10T14:35:53.876916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601802133035295:5604]
2025-10-10T14:35:53.876926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:53.876933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:53.876935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:53.876938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:53.876949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915264183:6669], now have 1 active actors on pipe
2025-10-10T14:35:53.876961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:53.876984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:53.876992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:53.876999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915264018:2438], now have 1 active actors on pipe
2025-10-10T14:35:53.877053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1833
2025-10-10T14:35:53.877088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1833
2025-10-10T14:35:53.877030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601802133035295:5604]
2025-10-10T14:35:53.877043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:53.877127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:53.877354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.877368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.877404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27139c8d-8a51bfd-24718765-32d7cee2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:53.877413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:53.877418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:53.877421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:53.877435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:53.877449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:53.877466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.877622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:53.877627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:53.877644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:53.877842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1834 partition: 0 MaxSeqNo: 40 sessionId: src_id|27139c8d-8a51bfd-24718765-32d7cee2_0
2025-10-10T14:35:53.878250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8a3b45-2ff10c1b-403940ee-10e18c1f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|27139c8d-8a51bfd-24718765-32d7cee2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:53.880974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27139c8d-8a51bfd-24718765-32d7cee2_0] Write session: try to update token
2025-10-10T14:35:53.880994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27139c8d-8a51bfd-24718765-32d7cee2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:53.901130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:53.901145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:53.901149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:53.901151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:53.901164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601802133035295:5604]
2025-10-10T14:35:53.901167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601802133035295:5604]
2025-10-10T14:35:53.901172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601802133035295:5604]
2025-10-10T14:35:53.901223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:53.901231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:53.901233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:53.901262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:53.901270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:53.901274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:53.901411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:53.901649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId: src_id|27139c8d-8a51bfd-24718765-32d7cee2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:53.904425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:53.948360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601802915264190:6939]
2025-10-10T14:35:53.948689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1833, pipe: [1:7559601802915264190:6939]
2025-10-10T14:35:54.019309Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:54.019955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.019965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.020013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601802915264190:6939], now have 1 active actors on pipe
2025-10-10T14:35:54.020253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:54.020908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601802915264190:6939]
2025-10-10T14:35:54.020942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:54.021007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1834 reason: status is not ok: tablet will be restarted right now sessionId: src_id|27139c8d-8a51bfd-24718765-32d7cee2_0
2025-10-10T14:35:54.021053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:54.021174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1834 sessionId: src_id|27139c8d-8a51bfd-24718765-32d7cee2_0 is DEAD
2025-10-10T14:35:54.021473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27139c8d-8a51bfd-24718765-32d7cee2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:54.021481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27139c8d-8a51bfd-24718765-32d7cee2_0] Write session will restart in 0.005063s
2025-10-10T14:35:54.021507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27139c8d-8a51bfd-24718765-32d7cee2_0] Write session: Do CDS request
2025-10-10T14:35:54.021526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27139c8d-8a51bfd-24718765-32d7cee2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:54.027913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27139c8d-8a51bfd-24718765-32d7cee2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.029541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:54.029560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1835
2025-10-10T14:35:54.029749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.029781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:54.029786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:54.029791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:54.030374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1835 sessionId:  describe result for acl check
2025-10-10T14:35:54.030412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:54.030413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:54.030415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:54.030422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601807210231512:6663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:54.031017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601807210231512:6663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:54.038824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601807210231512:6663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:54.046376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601807210231512:6663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:54.046403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601807210231512:6663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:54.046408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601807210231512:6663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:54.046420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:54.048479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:54.052061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:54.052289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:54.052299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:54.052308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:54.052352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:54.052387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601806428002767:5602]
2025-10-10T14:35:54.052864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:54.053366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:54.053421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:54.053821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:54.053910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.053917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.053918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.053919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.053921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.053922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.053923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.053924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.053926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.053927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.053928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.053929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.053931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.053937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.053951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.053956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.053960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.053964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.053968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.053972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.053975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.053979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.053983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.053987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.053991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.053995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.054005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.054014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.054023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.054028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.054033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.054038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.054043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.054047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.054052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.054057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.054063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.054068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.054075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.054081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.054087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.054093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.054098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.054104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.054110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.054116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.054122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.054128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.054133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.054139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.054143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.054148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.054187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:54.057366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:54.058048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:54.058054Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:54.058057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:54.058061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:54.058069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1834 [2:7559601806428002767:5602]
2025-10-10T14:35:54.058083Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:54.058100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:54.058103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.058105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.058107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.058121Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:54.058126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:54.058133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:54.058184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.058185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.058186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.058188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:54.058246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:54.058248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.058255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.058262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.058272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:54.058288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601806428002762:5602]
2025-10-10T14:35:54.058290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601806428002762:5602]
2025-10-10T14:35:54.058291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601806428002762:5602]
2025-10-10T14:35:54.058297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:54.058309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:54.058319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:54.058321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:54.058346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601806428002762:5602]
2025-10-10T14:35:54.058349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:54.058383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:54.058387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:54.058390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:54.058398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:54.058502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210231488:2438], now have 1 active actors on pipe
2025-10-10T14:35:54.058507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210231646:6663], now have 1 active actors on pipe
2025-10-10T14:35:54.059315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.059328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.059363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:54.059374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.059379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.059383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:54.059406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.059424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:54.059441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.058679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1834
2025-10-10T14:35:54.058717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1834
2025-10-10T14:35:54.061624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.061639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.061676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.062732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1835 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0
2025-10-10T14:35:54.063125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27139c8d-8a51bfd-24718765-32d7cee2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:54.065922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0] Write session: try to update token
2025-10-10T14:35:54.065943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:54.084014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:54.084032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:54.084035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:54.084036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:54.084051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601806428002762:5602]
2025-10-10T14:35:54.084054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601806428002762:5602]
2025-10-10T14:35:54.084058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601806428002762:5602]
2025-10-10T14:35:54.084101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:54.084108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.084110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:54.084239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:54.087180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:54.087203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:54.087210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:54.098969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId: src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:54.101843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:54.120434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601807210231661:6939]
2025-10-10T14:35:54.120881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1834, pipe: [1:7559601807210231661:6939]
2025-10-10T14:35:54.221988Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:54.222374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.222385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.222451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210231661:6939], now have 1 active actors on pipe
2025-10-10T14:35:54.222955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601807210231661:6939]
2025-10-10T14:35:54.222994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:54.222993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:54.223007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:54.223070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1835 reason: error at write: Disconnected sessionId: src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0
2025-10-10T14:35:54.223275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1835 sessionId: src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0 is DEAD
2025-10-10T14:35:54.223034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:54.228173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:54.228189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0] Write session will restart in 0.009754s
2025-10-10T14:35:54.228216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0] Write session: Do CDS request
2025-10-10T14:35:54.228225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:54.238912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.239018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:54.239038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1836
2025-10-10T14:35:54.239267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.239310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:54.239315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:54.239320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:54.239896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1836 sessionId:  describe result for acl check
2025-10-10T14:35:54.239940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:54.239942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:54.239944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:54.239950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601807210231680:6656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:54.240546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601807210231680:6656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:54.255448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601807210231680:6656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:54.256430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:54.259491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:54.259785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:54.259801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:54.259817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:54.259896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:54.259946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601806428002937:5601]
2025-10-10T14:35:54.260589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:54.260954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:54.261010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:54.261362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:54.261442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.261452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.261453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.261454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.261455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.261456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.261459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.261460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.261462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.261463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.261464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.261465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.261467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.261473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.261487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.261491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.261495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.261499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.261518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.261522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.261526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.261654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.261665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.261668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.261672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.261675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.261685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.261694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.261701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.261707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.261711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.261717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.261722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.261729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.261732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.261737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.261742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.261748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.261756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.261762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.261779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.261785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.261790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.261795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.261800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.261806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.261811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.261816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.261822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.261828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.261833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.261838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.261892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:54.262988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601807210231680:6656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:54.263008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601807210231680:6656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:54.263012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601807210231680:6656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:54.263021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:54.265093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:54.265465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:54.265479Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:54.265482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:54.265487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:54.265494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1835 [2:7559601806428002937:5601]
2025-10-10T14:35:54.265521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:54.265541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:54.265555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.265558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.265560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.265591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:54.265609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:54.265617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:54.265699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.265708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.265710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.265713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:54.265788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:54.265798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.265812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.265824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.265841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:54.265870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210231831:6656], now have 1 active actors on pipe
2025-10-10T14:35:54.265881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210231664:2438], now have 1 active actors on pipe
2025-10-10T14:35:54.265889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601806428002932:5601]
2025-10-10T14:35:54.265891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601806428002932:5601]
2025-10-10T14:35:54.265894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601806428002932:5601]
2025-10-10T14:35:54.265911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:54.265923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:54.265926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:54.265927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:54.265929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:54.265944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:54.265952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:54.265987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601806428002932:5601]
2025-10-10T14:35:54.266021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1835
2025-10-10T14:35:54.266055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1835
2025-10-10T14:35:54.266002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:54.266099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:54.266307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.266329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.266366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:54.266379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.266388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.266391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:54.266405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.266423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:54.266445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.266759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.266768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.266786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.266946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1836 partition: 0 MaxSeqNo: 40 sessionId: src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0
2025-10-10T14:35:54.267380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e95a2f7-1659e0de-386b674e-f4d5595_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:54.270105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0] Write session: try to update token
2025-10-10T14:35:54.270125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:54.291283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId: src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:54.291892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:54.291910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:54.291914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:54.291917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:54.291927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601806428002932:5601]
2025-10-10T14:35:54.291932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601806428002932:5601]
2025-10-10T14:35:54.291936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601806428002932:5601]
2025-10-10T14:35:54.291985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:54.291986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:54.291995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.291998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:54.291998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:54.292004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:54.292139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:54.294031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:54.325432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601807210231839:6939]
2025-10-10T14:35:54.325738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1835, pipe: [1:7559601807210231839:6939]
2025-10-10T14:35:54.413222Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:54.413951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.413971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.414039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210231839:6939], now have 1 active actors on pipe
2025-10-10T14:35:54.414310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:54.414328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:54.414342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601807210231839:6939]
2025-10-10T14:35:54.414365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:54.414390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1836 reason: error at write: Disconnected sessionId: src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0
2025-10-10T14:35:54.414615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1836 sessionId: src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0 is DEAD
2025-10-10T14:35:54.414291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:54.414764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:54.414784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0] Write session will restart in 0.006525s
2025-10-10T14:35:54.414811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0] Write session: Do CDS request
2025-10-10T14:35:54.414821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:54.423289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.423395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:54.423416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1837
2025-10-10T14:35:54.423541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.423582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:54.423592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:54.423596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:54.424085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1837 sessionId:  describe result for acl check
2025-10-10T14:35:54.424136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:54.424145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:54.424148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:54.424155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601807210231895:6652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:54.424726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601807210231895:6652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:54.428573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601807210231895:6652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:54.431436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601807210231895:6652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:54.431455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601807210231895:6652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:54.431459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601807210231895:6652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:54.431470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:54.431634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:54.434086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:54.434334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:54.434344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:54.434358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:54.434414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:54.434458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601806428003110:5598]
2025-10-10T14:35:54.435096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:54.437933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:54.438021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:54.438433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:54.438507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.438513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.438514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.438515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.438516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.438517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.438519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.438520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.438521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.438523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.438524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.438525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.438526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.438534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.438547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.438552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.438556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.438560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.438563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.438567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.438571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.438574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.438579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.438582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.438586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.438589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.438598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.438608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.438616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.438621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.438626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.438631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.438636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.438642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.438648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.438654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.438665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.438672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.438682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.438687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.438692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.438701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.438707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.438716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.438721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.438730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.438743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.438752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.438756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.438763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.438769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.438778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.438819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:54.446577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:54.446941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:54.446956Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:54.446960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:54.446965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:54.446973Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1836 [2:7559601806428003110:5598]
2025-10-10T14:35:54.446991Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:54.447013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:54.447021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.447026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.447028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.447050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:54.447070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:54.447079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:54.447151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.447160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.447162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.447165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:54.447244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:54.447253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.447267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.447285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.447308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:54.447340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232003:6652], now have 1 active actors on pipe
2025-10-10T14:35:54.447349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210231841:2438], now have 1 active actors on pipe
2025-10-10T14:35:54.447358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601806428003104:5598]
2025-10-10T14:35:54.447365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601806428003104:5598]
2025-10-10T14:35:54.447368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601806428003104:5598]
2025-10-10T14:35:54.447385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:54.447406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:54.447406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:54.447410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:54.447412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:54.447430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:54.447438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:54.447404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1836
2025-10-10T14:35:54.447419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1836
2025-10-10T14:35:54.447484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601806428003104:5598]
2025-10-10T14:35:54.447497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:54.447525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.447523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:54.447535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.447593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:54.447610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.447615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.447618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:54.447630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.447642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:54.447663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.447872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.447882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.447899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.448013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1837 partition: 0 MaxSeqNo: 40 sessionId: src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0
2025-10-10T14:35:54.448455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49eb52ff-92abcf0a-abc80bde-dfc8792c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:54.451250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0] Write session: try to update token
2025-10-10T14:35:54.451274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:54.467991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId: src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:54.468276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:54.468295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:54.468298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:54.468300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:54.468310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601806428003104:5598]
2025-10-10T14:35:54.468315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601806428003104:5598]
2025-10-10T14:35:54.468320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601806428003104:5598]
2025-10-10T14:35:54.468363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:54.468380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:54.468389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.468391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:54.468391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:54.468395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:54.468536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:54.470653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:54.514652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601807210232018:6939]
2025-10-10T14:35:54.514971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1836, pipe: [1:7559601807210232018:6939]
2025-10-10T14:35:54.585363Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:54.585941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.585957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.586004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232018:6939], now have 1 active actors on pipe
2025-10-10T14:35:54.586387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:54.586401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:54.586408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601807210232018:6939]
2025-10-10T14:35:54.586430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:54.586507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1837 reason: error at write: Disconnected sessionId: src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0
2025-10-10T14:35:54.586225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:54.586889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:54.586898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0] Write session will restart in 0.008224s
2025-10-10T14:35:54.586924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0] Write session: Do CDS request
2025-10-10T14:35:54.586930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:54.586755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1837 sessionId: src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0 is DEAD
2025-10-10T14:35:54.595887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.595956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:54.595971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1838
2025-10-10T14:35:54.596152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.596208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:54.596219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:54.596224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:54.596822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1838 sessionId:  describe result for acl check
2025-10-10T14:35:54.596859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:54.596867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:54.596869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:54.596875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601807210232114:6644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:54.597511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601807210232114:6644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:54.599972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601807210232114:6644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:54.601598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:54.603100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:54.603327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:54.603340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:54.603352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:54.603409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:54.603401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601807210232114:6644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:54.603417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601807210232114:6644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:54.603421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601807210232114:6644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:54.603430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:54.603455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601806428003284:5596]
2025-10-10T14:35:54.604069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:54.604394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:54.604442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:54.604795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:54.604860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.604866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.604868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.604869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.604870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.604871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.604872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.604874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.604875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.604876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.604878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.604879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.604880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.604887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.604901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.604905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.604909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.604913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.604918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.604922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.604929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.604933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.604938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.604942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.604946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.604950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.604957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.604965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.604972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.604979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.604990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.604996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.605005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.605011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.605016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.605021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.605026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.605032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.605037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.605042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.605047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.605052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.605058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.605063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.605072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.605077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.605082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.605091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.605095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.605100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.605105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.605114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.605153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:54.607729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:54.608297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:54.608312Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:54.608315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:54.608319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:54.608326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1837 [2:7559601806428003284:5596]
2025-10-10T14:35:54.608340Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:54.608359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:54.608364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.608375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.608378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.608395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:54.608408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:54.608416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:54.608479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.608486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.608488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.608491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:54.608563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:54.608571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.608583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.608594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.608613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:54.608642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232023:2438], now have 1 active actors on pipe
2025-10-10T14:35:54.608652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232189:6644], now have 1 active actors on pipe
2025-10-10T14:35:54.608661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601806428003278:5596]
2025-10-10T14:35:54.608663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601806428003278:5596]
2025-10-10T14:35:54.608665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601806428003278:5596]
2025-10-10T14:35:54.608682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:54.608700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:54.608699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:54.608703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:54.608705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:54.608723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:54.608727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:54.608689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1837
2025-10-10T14:35:54.608742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1837
2025-10-10T14:35:54.608764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601806428003278:5596]
2025-10-10T14:35:54.608776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:54.608791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.608796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.608798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:54.608841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:54.608852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.608857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.608859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:54.608871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.608888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:54.608906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.609129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.609138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.609156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.609439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1838 partition: 0 MaxSeqNo: 40 sessionId: src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0
2025-10-10T14:35:54.609845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45752f58-11be78ce-a0760e03-e9c95c2b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:54.612615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0] Write session: try to update token
2025-10-10T14:35:54.612636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:54.628604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:54.628628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:54.628631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:54.628634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:54.628644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601806428003278:5596]
2025-10-10T14:35:54.628650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601806428003278:5596]
2025-10-10T14:35:54.628655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601806428003278:5596]
2025-10-10T14:35:54.628706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:54.628707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:54.628714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:54.628719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:54.628720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.628723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:54.628861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:54.633361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId: src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:54.636156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:54.686674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601807210232209:6939]
2025-10-10T14:35:54.686986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1837, pipe: [1:7559601807210232209:6939]
2025-10-10T14:35:54.746602Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:54.747009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.747027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.747075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232209:6939], now have 1 active actors on pipe
2025-10-10T14:35:54.747326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:54.747380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:54.747392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:54.747398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601807210232209:6939]
2025-10-10T14:35:54.747419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:54.747472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1838 reason: error at write: Disconnected sessionId: src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0
2025-10-10T14:35:54.747671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1838 sessionId: src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0 is DEAD
2025-10-10T14:35:54.748089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:54.748112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0] Write session will restart in 0.008696s
2025-10-10T14:35:54.748139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0] Write session: Do CDS request
2025-10-10T14:35:54.748148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:54.757921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.758113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:54.758130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1839
2025-10-10T14:35:54.758265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.758302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:54.758314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:54.758322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:54.758918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1839 sessionId:  describe result for acl check
2025-10-10T14:35:54.758958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:54.758965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:54.758967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:54.758974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601807210232326:6640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:54.759555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601807210232326:6640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:54.761401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:54.762032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601807210232326:6640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:54.763194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:54.763424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:54.763436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:54.763447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:54.763502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:54.763547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601806428003457:5594]
2025-10-10T14:35:54.764207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:54.764523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:54.764567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:54.764656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601807210232326:6640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:54.764670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601807210232326:6640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:54.764674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601807210232326:6640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:54.764683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:54.764895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:54.764967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.764974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.764975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.764976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.764978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.764979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.764980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.764982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.764983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.764984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.764985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.764987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.764988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.764994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.765007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.765011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.765015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.765019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.765023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.765026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.765029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.765033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.765036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.765040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.765043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.765046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.765054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.765062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.765069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.765074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.765078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.765082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.765086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.765092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.765096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.765101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.765106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.765112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.765116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.765121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.765133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.765138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.765148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.765153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.765158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.765163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.765170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.765175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.765180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.765185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.765190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.765200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.765238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:54.767709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:54.768258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:54.768271Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:54.768273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:54.768277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:54.768283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1838 [2:7559601806428003457:5594]
2025-10-10T14:35:54.768297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:54.768317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:54.768334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.768339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.768341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.768359Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:54.768371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:54.768379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:54.768445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.768454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.768456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.768459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:54.768528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:54.768536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.768548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.768564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.768584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:54.768613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232381:6640], now have 1 active actors on pipe
2025-10-10T14:35:54.768621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232213:2438], now have 1 active actors on pipe
2025-10-10T14:35:54.768629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601806428003452:5594]
2025-10-10T14:35:54.768633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601806428003452:5594]
2025-10-10T14:35:54.768637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601806428003452:5594]
2025-10-10T14:35:54.768653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:54.768672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:54.768675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:54.768680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:54.768682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:54.768693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:54.768697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:54.768720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601806428003452:5594]
2025-10-10T14:35:54.768723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:54.768748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.768747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:54.768758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.768679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1838
2025-10-10T14:35:54.768686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1838
2025-10-10T14:35:54.768796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef100805-10157d0-a36c5418-1f603422_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:54.768808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.768812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.768814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:54.768827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.768839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:54.768865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.769013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.769021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.769037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.769128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1839 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef100805-10157d0-a36c5418-1f603422_0
2025-10-10T14:35:54.769549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f590cfaf-2f05ad32-7e22b6b9-345d2c0e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef100805-10157d0-a36c5418-1f603422_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:54.772264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef100805-10157d0-a36c5418-1f603422_0] Write session: try to update token
2025-10-10T14:35:54.772282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef100805-10157d0-a36c5418-1f603422_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:54.786251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId: src_id|ef100805-10157d0-a36c5418-1f603422_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:54.788312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:54.788331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:54.788334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:54.788336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:54.788344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601806428003452:5594]
2025-10-10T14:35:54.788348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601806428003452:5594]
2025-10-10T14:35:54.788352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601806428003452:5594]
2025-10-10T14:35:54.788410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:54.788421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:54.788424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.788426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:54.788428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:54.788432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:54.788563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:54.788878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:54.847415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601807210232427:6939]
2025-10-10T14:35:54.847621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1838, pipe: [1:7559601807210232427:6939]
2025-10-10T14:35:54.906650Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:54.906927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.906943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.906990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232427:6939], now have 1 active actors on pipe
2025-10-10T14:35:54.907236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:54.907314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601807210232427:6939]
2025-10-10T14:35:54.907359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:54.907894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef100805-10157d0-a36c5418-1f603422_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:54.907903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef100805-10157d0-a36c5418-1f603422_0] Write session will restart in 0.009637s
2025-10-10T14:35:54.907940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef100805-10157d0-a36c5418-1f603422_0] Write session: Do CDS request
2025-10-10T14:35:54.907947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef100805-10157d0-a36c5418-1f603422_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:54.907399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:54.907488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1839 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef100805-10157d0-a36c5418-1f603422_0
2025-10-10T14:35:54.907712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1839 sessionId: src_id|ef100805-10157d0-a36c5418-1f603422_0 is DEAD
2025-10-10T14:35:54.918925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef100805-10157d0-a36c5418-1f603422_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.919004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:54.919020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1840
2025-10-10T14:35:54.919189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:54.919245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:54.919257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:54.919262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:54.919732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1840 sessionId:  describe result for acl check
2025-10-10T14:35:54.919777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:54.919783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:54.919785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:54.919792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601807210232458:6618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:54.920397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601807210232458:6618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:54.923107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601807210232458:6618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:54.926058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:54.925946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601807210232458:6618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:54.925957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601807210232458:6618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:54.925961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601807210232458:6618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:54.925969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:54.928342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:54.928694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:54.928707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:54.928724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:54.928784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:54.928823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601806428003685:5570]
2025-10-10T14:35:54.929255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:54.929567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:54.929607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:54.929916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:54.929956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.929957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.929958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.929959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.929959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.929960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.929961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.929962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.929962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.929963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.929964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.929965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.929965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.929969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.929979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.929981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.929984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.929986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.929989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.929991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.929993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.929996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.929998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.930001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.930003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.930005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.930011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.930017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:54.930022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.930027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:54.930031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.930034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:54.930037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.930040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:54.930044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.930047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:54.930050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.930053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:54.930056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.930059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:54.930062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.930065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:54.930068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.930071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:54.930073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.930077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:54.930079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.930083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.930085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.930089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.930091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.930095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.930116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:54.932596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:54.933012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:54.933027Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:54.933031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:54.933035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:54.933041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1839 [2:7559601806428003685:5570]
2025-10-10T14:35:54.933053Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:54.933070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:54.933081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.933084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.933087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.933103Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:54.933124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:54.933136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:54.933194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.933205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.933207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.933210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:54.933277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:54.933285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.933296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:54.933308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:54.933327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:54.933374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232428:2438], now have 1 active actors on pipe
2025-10-10T14:35:54.933378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601807210232594:6618], now have 1 active actors on pipe
2025-10-10T14:35:54.933385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601806428003678:5570]
2025-10-10T14:35:54.933394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601806428003678:5570]
2025-10-10T14:35:54.933396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601806428003678:5570]
2025-10-10T14:35:54.933411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:54.933435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:54.933451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:54.933454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:54.933481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601806428003678:5570]
2025-10-10T14:35:54.933501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:54.933539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:54.933549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:54.933552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:54.933560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:54.933645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1839
2025-10-10T14:35:54.933655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1839
2025-10-10T14:35:54.933709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.933723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.933765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:54.933779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:54.933788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:54.933790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:54.933803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:54.933819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:54.933842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.934009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.934021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.934045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:54.934132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1840 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0
2025-10-10T14:35:54.934521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef100805-10157d0-a36c5418-1f603422_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:54.937301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0] Write session: try to update token
2025-10-10T14:35:54.937319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:54.954981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId: src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:54.958067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:54.958892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:54.958923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:54.958948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:54.958956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:54.958962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:54.958966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:54.958974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601806428003678:5570]
2025-10-10T14:35:54.958979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601806428003678:5570]
2025-10-10T14:35:54.958982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601806428003678:5570]
2025-10-10T14:35:54.959029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:54.959051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:54.959053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:54.959055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:54.959061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:54.959064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:54.959205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:55.007709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601811505199908:6939]
2025-10-10T14:35:55.008089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1839, pipe: [1:7559601811505199908:6939]
2025-10-10T14:35:55.077837Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:55.078135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:55.078200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505199908:6939], now have 1 active actors on pipe
2025-10-10T14:35:55.078277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:55.078381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601811505199908:6939]
2025-10-10T14:35:55.078408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:55.078483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:55.078492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:55.078512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1840 reason: error at write: Disconnected sessionId: src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0
2025-10-10T14:35:55.078885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:55.078900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0] Write session will restart in 0.006826s
2025-10-10T14:35:55.078927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0] Write session: Do CDS request
2025-10-10T14:35:55.078934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:55.078768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1840 sessionId: src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0 is DEAD
2025-10-10T14:35:55.086920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.087205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:55.087219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1841
2025-10-10T14:35:55.087386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.087418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:55.087424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:55.087428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:55.087960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1841 sessionId:  describe result for acl check
2025-10-10T14:35:55.088001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:55.088002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:55.088004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:55.088011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601811505199970:6614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:55.088657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601811505199970:6614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:55.091355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601811505199970:6614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:55.092768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:55.094955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:55.095213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:55.095225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:55.095241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:55.095304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:55.095388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601811505199970:6614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:55.095404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601811505199970:6614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:55.095408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601811505199970:6614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:55.095417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:55.095532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601810722971160:5568]
2025-10-10T14:35:55.096180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:55.096614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:55.096667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:55.096992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:55.097047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.097049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.097050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.097051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.097052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.097053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.097055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.097056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.097057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.097058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.097059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.097061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.097062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.097068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.097081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.097085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.097089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.097092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.097096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.097099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.097103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.097106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.097111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.097115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.097119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.097124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.097131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.097140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.097148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.097155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.097160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.097166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.097170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.097175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.097180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.097185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.097189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.097195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.097200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.097206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.097211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.097217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.097222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.097227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.097232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.097238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.097243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.097248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.097252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.097257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.097275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.097281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.097366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:55.100074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:55.100423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:55.100434Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:55.100437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:55.100441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:55.100448Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1840 [2:7559601810722971160:5568]
2025-10-10T14:35:55.100462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:55.100483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:55.100491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.100495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.100498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.100514Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:55.100527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:55.100536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:55.100590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.100599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.100601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.100603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:55.100659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:55.100662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.100669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.100676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.100687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:55.100709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601810722971155:5568]
2025-10-10T14:35:55.100716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601810722971155:5568]
2025-10-10T14:35:55.100718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601810722971155:5568]
2025-10-10T14:35:55.100729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:55.100738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:55.100741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:55.100743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:55.100749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200077:6614], now have 1 active actors on pipe
2025-10-10T14:35:55.100755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:55.100768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:55.100771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:55.100778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505199909:2438], now have 1 active actors on pipe
2025-10-10T14:35:55.100805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601810722971155:5568]
2025-10-10T14:35:55.100820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:55.100841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:55.100854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1840
2025-10-10T14:35:55.100888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1840
2025-10-10T14:35:55.100958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.100969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.100998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63f60783-62feb997-667aa2b7-c6cc369e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:55.101009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.101012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.101014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:55.101024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.101034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:55.101047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.101186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.101194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.101207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.101300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1841 partition: 0 MaxSeqNo: 40 sessionId: src_id|63f60783-62feb997-667aa2b7-c6cc369e_0
2025-10-10T14:35:55.101723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7c418-79b1465c-414e72a0-8778c8d5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63f60783-62feb997-667aa2b7-c6cc369e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:55.104459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f60783-62feb997-667aa2b7-c6cc369e_0] Write session: try to update token
2025-10-10T14:35:55.104474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f60783-62feb997-667aa2b7-c6cc369e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:55.119738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:55.119758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:55.119772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601810722971155:5568]
2025-10-10T14:35:55.119777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId: src_id|63f60783-62feb997-667aa2b7-c6cc369e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:55.119831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:55.119834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:55.120036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:55.120195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:55.120346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:55.120491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:55.120694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:55.120739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:55.122643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.122662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.122709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:55.122425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:55.122850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:55.132764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:55.132786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:55.132790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:55.132792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:55.132804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601810722971155:5568]
2025-10-10T14:35:55.132809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601810722971155:5568]
2025-10-10T14:35:55.132813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601810722971155:5568]
2025-10-10T14:35:55.132869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:55.132871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:55.132876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:55.132879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.132881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:55.132882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:55.133030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:55.178703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601811505200090:6939]
2025-10-10T14:35:55.179175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1840, pipe: [1:7559601811505200090:6939]
2025-10-10T14:35:55.255024Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:55.263447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.263480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.263666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.263741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.263810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.263885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.264381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.264398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.264470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.264534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.264603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.264676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.264727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.264736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.264808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.264872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.264937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.265002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.265052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.265059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.265128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.265196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.265264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.265351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.265396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.265403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.265474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.265549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.265621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.265690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.265736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.265746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.265813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.265882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.265948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.266018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.266065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.266073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.266150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.266218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.266290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.266359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.266406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.266413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.266490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.266555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.266625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.266694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.266744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.266747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.266818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.266885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.266947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.267016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.267082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.267089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.267161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:55.267227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:55.267295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:55.267363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:55.267789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:55.267811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:55.267846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1841 reason: error at write: Disconnected sessionId: src_id|63f60783-62feb997-667aa2b7-c6cc369e_0
2025-10-10T14:35:55.268117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1841 sessionId: src_id|63f60783-62feb997-667aa2b7-c6cc369e_0 is DEAD
2025-10-10T14:35:55.268317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:55.268367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601811505200090:6939]
2025-10-10T14:35:55.268446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f60783-62feb997-667aa2b7-c6cc369e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:55.268460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f60783-62feb997-667aa2b7-c6cc369e_0] Write session will restart in 0.008155s
2025-10-10T14:35:55.268486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f60783-62feb997-667aa2b7-c6cc369e_0] Write session: Do CDS request
2025-10-10T14:35:55.268493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f60783-62feb997-667aa2b7-c6cc369e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:55.267412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:55.267424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:55.267494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200090:6939], now have 1 active actors on pipe
2025-10-10T14:35:55.268112Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:55.277940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f60783-62feb997-667aa2b7-c6cc369e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.278011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:55.278189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1842
2025-10-10T14:35:55.278334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.278380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:55.278743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:55.278753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:55.279307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1842 sessionId:  describe result for acl check
2025-10-10T14:35:55.279343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:55.279348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:55.279350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:55.279357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601811505200163:6609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:55.279903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601811505200163:6609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:55.282840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601811505200163:6609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:55.283867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:55.285895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:55.286099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:55.286111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:55.286123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:55.286186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:55.286206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601811505200163:6609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:55.286217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601811505200163:6609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:55.286221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601811505200163:6609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:55.286229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:55.286230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601810722971338:5562]
2025-10-10T14:35:55.286842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:55.287145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:55.287189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:55.287505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:55.287565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.287571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.287573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.287574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.287575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.287576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.287577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.287578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.287580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.287581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.287582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.287583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.287584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.287589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.287602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.287606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.287610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.287614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.287618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.287622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.287626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.287630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.287635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.287639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.287643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.287647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.287655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.287664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.287672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.287677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.287681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.287687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.287691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.287696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.287701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.287706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.287710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.287715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.287720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.287725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.287737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.287742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.287747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.287752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.287756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.287761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.287766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.287771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.287775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.287780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.287784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.287790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.287834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:55.290276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:55.290642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:55.290652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:55.290655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:55.290658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:55.290664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1841 [2:7559601810722971338:5562]
2025-10-10T14:35:55.290677Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:55.290694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:55.290697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.290700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.290708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.290726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:55.290737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:55.290744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:55.290802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.290808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.290810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.290812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:55.290889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:55.290896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.290907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.290917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.290933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:55.290954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200261:6609], now have 1 active actors on pipe
2025-10-10T14:35:55.290964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200092:2438], now have 1 active actors on pipe
2025-10-10T14:35:55.290971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601810722971333:5562]
2025-10-10T14:35:55.290974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601810722971333:5562]
2025-10-10T14:35:55.290976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601810722971333:5562]
2025-10-10T14:35:55.290989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:55.291007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:55.291013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:55.291016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:55.291019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:55.291027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:55.291030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:55.291022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1841
2025-10-10T14:35:55.291055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601810722971333:5562]
2025-10-10T14:35:55.291052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1841
2025-10-10T14:35:55.291058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:55.291061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:55.291075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.291080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.291131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:55.291143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.291147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.291149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:55.291160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.291176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:55.291198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.291536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.291547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.291572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.291697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1842 partition: 0 MaxSeqNo: 40 sessionId: src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0
2025-10-10T14:35:55.292096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f60783-62feb997-667aa2b7-c6cc369e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:55.294957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0] Write session: try to update token
2025-10-10T14:35:55.294976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:55.311159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId: src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:55.311263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:55.311281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:55.311285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:55.311287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:55.311297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601810722971333:5562]
2025-10-10T14:35:55.311301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601810722971333:5562]
2025-10-10T14:35:55.311305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601810722971333:5562]
2025-10-10T14:35:55.311354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:55.311366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.311367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:55.311368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:55.311373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:55.311377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:55.311504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:55.313858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:55.369369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601811505200274:6939]
2025-10-10T14:35:55.369819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1841, pipe: [1:7559601811505200274:6939]
2025-10-10T14:35:55.433769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:55.434202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.434213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.434261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200274:6939], now have 1 active actors on pipe
2025-10-10T14:35:55.434510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:55.435282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:55.435293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0] Write session will restart in 0.007692s
2025-10-10T14:35:55.435318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0] Write session: Do CDS request
2025-10-10T14:35:55.434866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601811505200274:6939]
2025-10-10T14:35:55.434895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:55.434966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1842 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0
2025-10-10T14:35:55.435161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1842 sessionId: src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0 is DEAD
2025-10-10T14:35:55.435236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:55.435324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:55.443953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.444039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:55.444056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1843
2025-10-10T14:35:55.444174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.444211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:55.444221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:55.444224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:55.444800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1843 sessionId:  describe result for acl check
2025-10-10T14:35:55.444835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:55.444843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:55.444845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:55.444852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601811505200290:6605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:55.445533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601811505200290:6605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:55.452757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601811505200290:6605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:55.457616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601811505200290:6605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:55.457633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601811505200290:6605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:55.457637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601811505200290:6605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:55.457647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:55.459979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:55.463210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:55.463504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:55.463515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:55.463527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:55.463592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:55.463636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601810722971518:5566]
2025-10-10T14:35:55.464390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:55.464687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:55.464727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:55.465054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:55.465114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.465120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.465121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.465123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.465124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.465125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.465126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.465128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.465129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.465130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.465131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.465133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.465134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.465140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.465155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.465159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.465162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.465165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.465169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.465173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.465177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.465181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.465187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.465191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.465195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.465200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.465208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.465217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.465223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.465228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.465233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.465238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.465243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.465249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.465255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.465261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.465265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.465270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.465284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.465290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.465294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.465300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.465306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.465311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.465315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.465321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.465325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.465343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.465348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.465352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.465357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.465363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.465404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:55.468293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:55.468843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:55.468854Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:55.468856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:55.468861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:55.468867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1842 [2:7559601810722971518:5566]
2025-10-10T14:35:55.468880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:55.468897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:55.468901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.468905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.468907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.468924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:55.468938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:55.468952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:55.469011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.469019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.469021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.469024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:55.469088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:55.469097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.469110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.469124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.469140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:55.469164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601810722971513:5566]
2025-10-10T14:35:55.469171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601810722971513:5566]
2025-10-10T14:35:55.469173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601810722971513:5566]
2025-10-10T14:35:55.469182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:55.469190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:55.469198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:55.469199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:55.469201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:55.469214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:55.469218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:55.469230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200437:6605], now have 1 active actors on pipe
2025-10-10T14:35:55.469233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200275:2438], now have 1 active actors on pipe
2025-10-10T14:35:55.469252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601810722971513:5566]
2025-10-10T14:35:55.469271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:55.469282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:55.469281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1842
2025-10-10T14:35:55.469282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1842
2025-10-10T14:35:55.469556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.469568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.469602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:55.469617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.469621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.469624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:55.469636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.469649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:55.469663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.469993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.470004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.470025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.470160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1843 partition: 0 MaxSeqNo: 40 sessionId: src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0
2025-10-10T14:35:55.470583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aaa7439-20eb6b76-7d7c308a-2b6f9a23_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:55.473243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0] Write session: try to update token
2025-10-10T14:35:55.473259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:55.489417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:55.489440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:55.489443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:55.489446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:55.489459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601810722971513:5566]
2025-10-10T14:35:55.489464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601810722971513:5566]
2025-10-10T14:35:55.489468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601810722971513:5566]
2025-10-10T14:35:55.489530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:55.489534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:55.489543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.489545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:55.489547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:55.489552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:55.489693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:55.492469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId: src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:55.495164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:55.537430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601811505200457:6939]
2025-10-10T14:35:55.537816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1842, pipe: [1:7559601811505200457:6939]
2025-10-10T14:35:55.611260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:55.611830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.611850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.611899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200457:6939], now have 1 active actors on pipe
2025-10-10T14:35:55.612154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:55.612160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:55.612175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:55.612190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601811505200457:6939]
2025-10-10T14:35:55.612217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:55.612238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1843 reason: error at write: Disconnected sessionId: src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0
2025-10-10T14:35:55.612574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:55.612603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0] Write session will restart in 0.005489s
2025-10-10T14:35:55.612629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0] Write session: Do CDS request
2025-10-10T14:35:55.612635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:55.612445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1843 sessionId: src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0 is DEAD
2025-10-10T14:35:55.618855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.618968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:55.618990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1844
2025-10-10T14:35:55.619119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.619154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:55.619160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:55.619166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:55.619627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1844 sessionId:  describe result for acl check
2025-10-10T14:35:55.619664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:55.619666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:55.619667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:55.619673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601811505200478:6601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:55.620262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601811505200478:6601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:55.624763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601811505200478:6601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:55.627904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601811505200478:6601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:55.627919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601811505200478:6601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:55.627923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601811505200478:6601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:55.627933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:55.628024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:55.630321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:55.630546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:55.630559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:55.630572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:55.630626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:55.630669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601810722971697:5563]
2025-10-10T14:35:55.631231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:55.631607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:55.631672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:55.632023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:55.632091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.632097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.632099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.632100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.632101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.632103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.632104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.632105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.632107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.632108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.632109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.632110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.632111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.632118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.632130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.632135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.632138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.632142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.632146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.632150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.632154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.632158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.632162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.632166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.632170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.632173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.632184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.632192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.632199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.632204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.632208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.632214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.632219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.632224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.632229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.632245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.632250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.632255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.632259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.632264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.632268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.632273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.632278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.632283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.632287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.632292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.632302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.632308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.632315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.632320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.632324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.632333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.632372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:55.635119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:55.635492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:55.635506Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:55.635509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:55.635513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:55.635520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1843 [2:7559601810722971697:5563]
2025-10-10T14:35:55.635534Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:55.635553Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:55.635556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.635560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.635563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.635581Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:55.635589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:55.635603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:55.635681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.635689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.635691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.635694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:55.635776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:55.635784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.635797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.635811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.635830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:55.635854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200458:2438], now have 1 active actors on pipe
2025-10-10T14:35:55.635859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200629:6601], now have 1 active actors on pipe
2025-10-10T14:35:55.635867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601810722971691:5563]
2025-10-10T14:35:55.635869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601810722971691:5563]
2025-10-10T14:35:55.635872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601810722971691:5563]
2025-10-10T14:35:55.635887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:55.635944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1843
2025-10-10T14:35:55.635962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1843
2025-10-10T14:35:55.635902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:55.635925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:55.635926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:55.635929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:55.635929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:55.635931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:55.635960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601810722971691:5563]
2025-10-10T14:35:55.635963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:55.635977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:55.636002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.636007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.636049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d12f09ae-613a3d14-a7706563-3c12d710_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:55.636057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.636062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.636065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:55.636079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.636090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:55.636105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.636357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.636368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.636386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.636500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1844 partition: 0 MaxSeqNo: 40 sessionId: src_id|d12f09ae-613a3d14-a7706563-3c12d710_0
2025-10-10T14:35:55.636915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8c6114c-8e72eb06-ddd065ce-2182d714_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d12f09ae-613a3d14-a7706563-3c12d710_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:55.639683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12f09ae-613a3d14-a7706563-3c12d710_0] Write session: try to update token
2025-10-10T14:35:55.639704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12f09ae-613a3d14-a7706563-3c12d710_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:55.654628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId: src_id|d12f09ae-613a3d14-a7706563-3c12d710_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:55.655920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:55.655941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:55.655945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:55.655947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:55.655957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601810722971691:5563]
2025-10-10T14:35:55.655963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601810722971691:5563]
2025-10-10T14:35:55.655968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601810722971691:5563]
2025-10-10T14:35:55.656022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:55.656032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.656035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:55.656188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:55.657402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:55.657418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:55.657422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:55.657396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:55.712225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601811505200647:6939]
2025-10-10T14:35:55.713645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1843, pipe: [1:7559601811505200647:6939]
2025-10-10T14:35:55.778596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:55.779030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.779052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.779099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200647:6939], now have 1 active actors on pipe
2025-10-10T14:35:55.779355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:55.779367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601811505200647:6939]
2025-10-10T14:35:55.779393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:55.779395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:55.779460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1844 reason: error at write: Disconnected sessionId: src_id|d12f09ae-613a3d14-a7706563-3c12d710_0
2025-10-10T14:35:55.779677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1844 sessionId: src_id|d12f09ae-613a3d14-a7706563-3c12d710_0 is DEAD
2025-10-10T14:35:55.779981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12f09ae-613a3d14-a7706563-3c12d710_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:55.779990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12f09ae-613a3d14-a7706563-3c12d710_0] Write session will restart in 0.009298s
2025-10-10T14:35:55.779315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:55.780016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12f09ae-613a3d14-a7706563-3c12d710_0] Write session: Do CDS request
2025-10-10T14:35:55.780027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12f09ae-613a3d14-a7706563-3c12d710_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:55.791010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12f09ae-613a3d14-a7706563-3c12d710_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.791063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:55.791079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1845
2025-10-10T14:35:55.791228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.791295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:55.791308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:55.791312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:55.792000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1845 sessionId:  describe result for acl check
2025-10-10T14:35:55.792040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:55.792047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:55.792049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:55.792055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601811505200738:6591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:55.792627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601811505200738:6591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:55.795736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601811505200738:6591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:55.797945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:55.798386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601811505200738:6591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:55.798399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601811505200738:6591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:55.798403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601811505200738:6591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:55.798411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:55.800244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:55.800450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:55.800461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:55.800473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:55.800524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:55.800565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601810722971877:5555]
2025-10-10T14:35:55.801200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:55.801648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:55.801706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:55.802082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:55.802140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.802147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.802148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.802149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.802150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.802151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.802152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.802154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.802155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.802156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.802157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.802158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.802160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.802166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.802179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.802183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.802187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.802191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.802195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.802199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.802203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.802207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.802212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.802216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.802220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.802223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.802231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.802245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.802256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.802263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.802271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.802276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.802283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.802288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.802297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.802302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.802311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.802316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.802325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.802330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.802334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.802339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.802345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.802350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.802354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.802359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.802368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.802373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.802381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.802387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.802395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.802400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.802455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:55.804965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:55.805393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:55.805405Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:55.805408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:55.805411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:55.805418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1844 [2:7559601810722971877:5555]
2025-10-10T14:35:55.805431Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:55.805454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:55.805469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.805473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.805475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.805492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:55.805504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:55.805516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:55.805572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.805579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.805581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.805583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:55.805649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:55.805656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.805667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.805681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.805702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:55.805728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200651:2438], now have 1 active actors on pipe
2025-10-10T14:35:55.805735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200824:6591], now have 1 active actors on pipe
2025-10-10T14:35:55.805742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601810722971871:5555]
2025-10-10T14:35:55.805744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601810722971871:5555]
2025-10-10T14:35:55.805747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601810722971871:5555]
2025-10-10T14:35:55.805760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:55.805773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:55.805778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:55.805781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:55.805783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:55.805794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:55.805798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:55.805790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1844
2025-10-10T14:35:55.805822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601810722971871:5555]
2025-10-10T14:35:55.805799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1844
2025-10-10T14:35:55.805832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:55.805834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:55.805851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.805861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.805919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b52a7b30-ab87bbf-edded90d-23caa859_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:55.805934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.805938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.805940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:55.805962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.805973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:55.806000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.806179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.806193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.806215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.806299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1845 partition: 0 MaxSeqNo: 40 sessionId: src_id|b52a7b30-ab87bbf-edded90d-23caa859_0
2025-10-10T14:35:55.806710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12f09ae-613a3d14-a7706563-3c12d710_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b52a7b30-ab87bbf-edded90d-23caa859_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:55.809528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52a7b30-ab87bbf-edded90d-23caa859_0] Write session: try to update token
2025-10-10T14:35:55.809544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52a7b30-ab87bbf-edded90d-23caa859_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:55.827312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:55.827333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:55.827336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:55.827338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:55.827347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601810722971871:5555]
2025-10-10T14:35:55.827352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601810722971871:5555]
2025-10-10T14:35:55.827356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601810722971871:5555]
2025-10-10T14:35:55.827401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:55.827404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:55.827408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:55.827412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.827412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:55.827416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:55.827553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:55.837500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId: src_id|b52a7b30-ab87bbf-edded90d-23caa859_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:55.840275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:55.879626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601811505200861:6939]
2025-10-10T14:35:55.879915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1844, pipe: [1:7559601811505200861:6939]
2025-10-10T14:35:55.943515Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:55.944105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.944126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.944151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200861:6939], now have 1 active actors on pipe
2025-10-10T14:35:55.944305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:55.945418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601811505200861:6939]
2025-10-10T14:35:55.945443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:55.945501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:55.945572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1845 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b52a7b30-ab87bbf-edded90d-23caa859_0
2025-10-10T14:35:55.945761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1845 sessionId: src_id|b52a7b30-ab87bbf-edded90d-23caa859_0 is DEAD
2025-10-10T14:35:55.949594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52a7b30-ab87bbf-edded90d-23caa859_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:55.949607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52a7b30-ab87bbf-edded90d-23caa859_0] Write session will restart in 0.007276s
2025-10-10T14:35:55.949633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52a7b30-ab87bbf-edded90d-23caa859_0] Write session: Do CDS request
2025-10-10T14:35:55.949648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52a7b30-ab87bbf-edded90d-23caa859_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:55.957894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52a7b30-ab87bbf-edded90d-23caa859_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.959957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:55.959972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1846
2025-10-10T14:35:55.960145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:55.960182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:55.960187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:55.960192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:55.961687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1846 sessionId:  describe result for acl check
2025-10-10T14:35:55.961729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:55.961737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:55.961740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:55.961746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601811505200936:6576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:55.962310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601811505200936:6576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:55.969412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601811505200936:6576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:55.974360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:55.976145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:55.976306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:55.976310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:55.976319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:55.976354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:55.976384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601810722972109:5537]
2025-10-10T14:35:55.976830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:55.977259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:55.977292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:55.977627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:55.977714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.977721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.977723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.977724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.977725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.977726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.977727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.977729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.977730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.977731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.977732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.977734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.977735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.977741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.977754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.977758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.977762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.977765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.977769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.977773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.977777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.977780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.977784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.977787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.977791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.977794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.977803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.977812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:55.977819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.977825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:55.977830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.977835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:55.977840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.977845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:55.977850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.977856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:55.977860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.977866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:55.977871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.977876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:55.977881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.977886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:55.977891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.977897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:55.977902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.977908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:55.977913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.977919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.977923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.977929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.977934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.977940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.977979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:55.978654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601811505200936:6576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:55.978672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601811505200936:6576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:55.978676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601811505200936:6576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:55.978685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:55.980597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:55.981098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:55.981121Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:55.981122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:55.981126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:55.981131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1845 [2:7559601810722972109:5537]
2025-10-10T14:35:55.981140Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:55.981158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:55.981164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.981167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.981169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.981184Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:55.981189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:55.981199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:55.981250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.981256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.981258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.981260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:55.981320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:55.981327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:55.981354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:55.981365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:55.981384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:55.981405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601810722972104:5537]
2025-10-10T14:35:55.981411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601810722972104:5537]
2025-10-10T14:35:55.981412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601810722972104:5537]
2025-10-10T14:35:55.981421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:55.981432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:55.981445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:55.981451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:55.981990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1845
2025-10-10T14:35:55.982022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1845
2025-10-10T14:35:55.981489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601810722972104:5537]
2025-10-10T14:35:55.981495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:55.981560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:55.981561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:55.981562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:55.981567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:55.982215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505200875:2438], now have 1 active actors on pipe
2025-10-10T14:35:55.982224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601811505201048:6576], now have 1 active actors on pipe
2025-10-10T14:35:55.982237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.982242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.982279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:55.982288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:55.982293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:55.982295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:55.982308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:55.982320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:55.982336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.982634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:55.982640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:55.982654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:55.982789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1846 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0
2025-10-10T14:35:55.984769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52a7b30-ab87bbf-edded90d-23caa859_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:55.987626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0] Write session: try to update token
2025-10-10T14:35:55.987644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:56.009546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId: src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:56.012478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:56.012979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:56.012997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:56.013001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:56.013003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:56.013013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601810722972104:5537]
2025-10-10T14:35:56.013018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601810722972104:5537]
2025-10-10T14:35:56.013022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601810722972104:5537]
2025-10-10T14:35:56.013065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:56.013069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:56.013073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:56.013074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:56.013083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.013085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:56.013229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:56.042938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601815800168353:6939]
2025-10-10T14:35:56.043311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1845, pipe: [1:7559601815800168353:6939]
2025-10-10T14:35:56.131003Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:56.131470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.131490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.131554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168353:6939], now have 1 active actors on pipe
2025-10-10T14:35:56.132188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:56.132200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:56.132252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1846 reason: error at write: Disconnected sessionId: src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0
2025-10-10T14:35:56.132292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:56.132475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1846 sessionId: src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0 is DEAD
2025-10-10T14:35:56.132724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:56.132736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0] Write session will restart in 0.006368s
2025-10-10T14:35:56.132771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0] Write session: Do CDS request
2025-10-10T14:35:56.132778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:56.132721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601815800168353:6939]
2025-10-10T14:35:56.132743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:56.141842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.142201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:56.142215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1847
2025-10-10T14:35:56.145486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.145542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:56.145552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:56.145557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:56.146305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1847 sessionId:  describe result for acl check
2025-10-10T14:35:56.146348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:56.146355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:56.146356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:56.146364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601815800168470:5979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:56.146968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601815800168470:5979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:56.149582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:56.150647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601815800168470:5979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:56.152233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:56.152496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:56.152508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:56.152521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:56.152588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:56.152634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601815017939587:5536]
2025-10-10T14:35:56.153244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:56.153417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601815800168470:5979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:56.153433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601815800168470:5979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:56.153437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601815800168470:5979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:56.153446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:56.153602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:56.153677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:56.154063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:56.154150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.154158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.154159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.154161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.154163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.154164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.154165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.154167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.154168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.154170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.154171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.154172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.154174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.154181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.154196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.154201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.154205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.154210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.154214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.154218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.154223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.154227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.154232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.154236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.154240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.154245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.154253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.154263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.154270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.154275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.154280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.154286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.154292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.154298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.154304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.154310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.154321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.154326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.154331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.154336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.154341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.154346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.154352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.154357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.154361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.154366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.154371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.154382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.154387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.154393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.154398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.154405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.154471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:56.157148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:56.157861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:56.157874Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:56.157877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:56.157882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:56.157889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1846 [2:7559601815017939587:5536]
2025-10-10T14:35:56.157904Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:56.157927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:56.157931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.157935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.157938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.157956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:56.157965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:56.157978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:56.158051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.158058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.158060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.158063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:56.158135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:56.158143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.158155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.158167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.158185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:56.158214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168532:5979], now have 1 active actors on pipe
2025-10-10T14:35:56.158222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168355:2438], now have 1 active actors on pipe
2025-10-10T14:35:56.158230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601815017939582:5536]
2025-10-10T14:35:56.158237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601815017939582:5536]
2025-10-10T14:35:56.158242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601815017939582:5536]
2025-10-10T14:35:56.158256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:56.158267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:56.158270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:56.158272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:56.158277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:56.158296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:56.158304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:56.158298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1846
2025-10-10T14:35:56.158301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1846
2025-10-10T14:35:56.158340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601815017939582:5536]
2025-10-10T14:35:56.158351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:56.158357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:56.158371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.158381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.158440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58744f80-9b990892-d5d179c0-2d87c018_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:56.158453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.158460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.158467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:56.158480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.158496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:56.158516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.158715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.158726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.158745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.158864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1847 partition: 0 MaxSeqNo: 40 sessionId: src_id|58744f80-9b990892-d5d179c0-2d87c018_0
2025-10-10T14:35:56.159247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e9792fe-f2dcab5-c09e6844-4be45cec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|58744f80-9b990892-d5d179c0-2d87c018_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:56.162142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58744f80-9b990892-d5d179c0-2d87c018_0] Write session: try to update token
2025-10-10T14:35:56.162160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58744f80-9b990892-d5d179c0-2d87c018_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:56.176958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId: src_id|58744f80-9b990892-d5d179c0-2d87c018_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:56.179095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:56.179116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:56.179119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:56.179122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:56.179132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601815017939582:5536]
2025-10-10T14:35:56.179137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601815017939582:5536]
2025-10-10T14:35:56.179142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601815017939582:5536]
2025-10-10T14:35:56.179207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:56.179215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.179218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:56.179330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:56.179343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:56.179353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:56.179371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:56.179981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:56.229360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601815800168541:6939]
2025-10-10T14:35:56.229698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1846, pipe: [1:7559601815800168541:6939]
2025-10-10T14:35:56.297279Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:56.297716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.297735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.297786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168541:6939], now have 1 active actors on pipe
2025-10-10T14:35:56.297991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:56.298054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601815800168541:6939]
2025-10-10T14:35:56.298056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:56.298092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:56.298172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1847 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58744f80-9b990892-d5d179c0-2d87c018_0
2025-10-10T14:35:56.298376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1847 sessionId: src_id|58744f80-9b990892-d5d179c0-2d87c018_0 is DEAD
2025-10-10T14:35:56.298545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58744f80-9b990892-d5d179c0-2d87c018_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:56.298557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58744f80-9b990892-d5d179c0-2d87c018_0] Write session will restart in 0.008156s
2025-10-10T14:35:56.298583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58744f80-9b990892-d5d179c0-2d87c018_0] Write session: Do CDS request
2025-10-10T14:35:56.298590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58744f80-9b990892-d5d179c0-2d87c018_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:56.307917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58744f80-9b990892-d5d179c0-2d87c018_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.308009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:56.308027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1848
2025-10-10T14:35:56.308177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.308216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:56.308227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:56.308232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:56.308688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1848 sessionId:  describe result for acl check
2025-10-10T14:35:56.308726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:56.308728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:56.308730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:56.308738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601815800168609:6558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:56.309316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601815800168609:6558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:56.312333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601815800168609:6558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:56.314085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:56.316074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:56.316314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:56.316327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:56.316340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:56.316399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:56.316441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601815017939770:5528]
2025-10-10T14:35:56.317084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:56.317408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:56.317476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:56.317805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:56.317882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.317890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.317892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.317893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.317894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.317896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.317897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.317898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.317900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.317902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.317903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.317904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.317906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.317912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.317927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.317931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.317935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.317939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.317943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.317947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.317951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.317956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.317960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.317964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.317969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.317973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.317982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.317991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.317998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.318009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.318018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.318023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.318028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.318034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.318039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.318044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.318053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.318059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.318069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.318075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.318085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.318091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.318100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.318106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.318115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.318121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.318125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.318135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.318140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.318150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.318156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.318166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.318207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:56.319123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601815800168609:6558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:56.319135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601815800168609:6558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:56.319139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601815800168609:6558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:56.319148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:56.320632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:56.320977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:56.320988Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:56.320990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:56.320994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:56.321000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1847 [2:7559601815017939770:5528]
2025-10-10T14:35:56.321013Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:56.321029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:56.321034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.321037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.321040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.321058Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:56.321071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:56.321079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:56.321135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.321142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.321144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.321145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:56.321209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:56.321217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.321228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.321302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1847
2025-10-10T14:35:56.321311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1847
2025-10-10T14:35:56.321241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.321267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:56.321288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168732:6558], now have 1 active actors on pipe
2025-10-10T14:35:56.321292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168542:2438], now have 1 active actors on pipe
2025-10-10T14:35:56.321300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601815017939765:5528]
2025-10-10T14:35:56.321302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601815017939765:5528]
2025-10-10T14:35:56.321304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601815017939765:5528]
2025-10-10T14:35:56.321317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:56.321343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:56.321352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:56.321355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:56.321357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:56.321360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:56.321363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:56.321405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.321410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.321425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601815017939765:5528]
2025-10-10T14:35:56.321434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:56.321440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:56.321471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:56.321485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.321489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.321492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:56.321502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.321513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:56.321535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.321732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.321742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.321759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.321854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1848 partition: 0 MaxSeqNo: 40 sessionId: src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0
2025-10-10T14:35:56.322212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58744f80-9b990892-d5d179c0-2d87c018_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:56.325161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0] Write session: try to update token
2025-10-10T14:35:56.325177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:56.340700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId: src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:56.343715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:56.343985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.344009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.344060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:56.346252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:56.346271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:56.346275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:56.346277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:56.346289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601815017939765:5528]
2025-10-10T14:35:56.346294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601815017939765:5528]
2025-10-10T14:35:56.346298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601815017939765:5528]
2025-10-10T14:35:56.346353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:56.346361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.346364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:56.346353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:56.346381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:56.346396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:56.346526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:56.344141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:56.398314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601815800168739:6939]
2025-10-10T14:35:56.399140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1847, pipe: [1:7559601815800168739:6939]
2025-10-10T14:35:56.464853Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:56.473621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.473651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.473834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.473896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.473958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.474016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.474610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.474616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.474690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.474748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.474809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.474880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.474924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.474927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.474996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.475053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.475116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.475176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.475218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.475221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.475288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.475346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.475427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.475487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.475526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.475529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.475598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.475655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.475714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.475774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.475813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.475816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.475884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.475939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.476001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.476069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.476114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.476117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.476193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.476256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.476317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.476383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.476423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.476426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.476492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.476548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.476606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.476664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.476705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.476708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.476783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.476846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.476913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.476978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.477171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.477175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.477250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.477313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.477772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.477852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.477892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.477894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.477967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168739:6939], now have 1 active actors on pipe
2025-10-10T14:35:56.478478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:56.479180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601815800168739:6939]
2025-10-10T14:35:56.479190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:56.479194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:56.479227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:56.479230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1848 reason: error at write: Disconnected sessionId: src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0
2025-10-10T14:35:56.479454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1848 sessionId: src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0 is DEAD
2025-10-10T14:35:56.479609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:56.479620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0] Write session will restart in 0.006203s
2025-10-10T14:35:56.479655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0] Write session: Do CDS request
2025-10-10T14:35:56.479662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:56.486902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.486977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:56.486990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1849
2025-10-10T14:35:56.487130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.487170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:56.487190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:56.487194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:56.487604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1849 sessionId:  describe result for acl check
2025-10-10T14:35:56.487639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:56.487645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:56.487647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:56.487654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601815800168759:6556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:56.488218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601815800168759:6556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:56.493831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601815800168759:6556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:56.496020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:56.498991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:56.499237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:56.499250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:56.499262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:56.499320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:56.499476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601815800168759:6556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:56.499491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601815800168759:6556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:56.499495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601815800168759:6556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:56.499504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:56.499366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601815017939955:5526]
2025-10-10T14:35:56.500044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:56.500397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:56.500464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:56.500809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:56.500873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.500881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.500882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.500884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.500885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.500887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.500888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.500890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.500891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.500892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.500894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.500895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.500896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.500903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.500918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.500923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.500928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.500933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.500937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.500942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.500946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.500950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.500955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.500960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.500964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.500968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.500976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.500986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.500993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.500999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.501004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.501010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.501015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.501023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.501029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.501034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.501039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.501045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.501061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.501067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.501072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.501078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.501084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.501090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.501108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.501114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.501121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.501127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.501132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.501138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.501141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.501146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.501203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:56.503843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:56.504168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:56.504181Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:56.504184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:56.504189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:56.504196Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1848 [2:7559601815017939955:5526]
2025-10-10T14:35:56.504210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:56.504230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:56.504233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.504236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.504239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.504257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:56.504265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:56.504277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:56.504332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.504334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.504336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.504338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:56.504412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:56.504415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.504425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.504436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.504451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:56.504472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601815017939949:5526]
2025-10-10T14:35:56.504474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601815017939949:5526]
2025-10-10T14:35:56.504479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601815017939949:5526]
2025-10-10T14:35:56.504488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:56.504503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:56.504510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:56.504516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:56.504517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:56.504518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:56.504604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1848
2025-10-10T14:35:56.504637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1848
2025-10-10T14:35:56.504520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:56.504532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168920:6556], now have 1 active actors on pipe
2025-10-10T14:35:56.504536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168741:2438], now have 1 active actors on pipe
2025-10-10T14:35:56.504566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601815017939949:5526]
2025-10-10T14:35:56.504575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:56.504587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:56.504696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.504704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.504750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9074a33a-3e2cd426-6b80db35-9120f305_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:56.504759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.504767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.504770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:56.504782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.504806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:56.504823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.505024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.505035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.505054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.505160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1849 partition: 0 MaxSeqNo: 40 sessionId: src_id|9074a33a-3e2cd426-6b80db35-9120f305_0
2025-10-10T14:35:56.505635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc407e8-de39dd23-2110c963-a8ad44bf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9074a33a-3e2cd426-6b80db35-9120f305_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:56.508349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9074a33a-3e2cd426-6b80db35-9120f305_0] Write session: try to update token
2025-10-10T14:35:56.508371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9074a33a-3e2cd426-6b80db35-9120f305_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:56.516415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:56.516440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:56.516451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601815017939949:5526]
2025-10-10T14:35:56.516508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:56.516520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:56.516683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:56.516818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:56.516957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:56.517092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:56.517281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:56.517319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:56.523584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId: src_id|9074a33a-3e2cd426-6b80db35-9120f305_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:56.526333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:56.526550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.526573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.526614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:56.526689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:56.534985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:56.535009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:56.535013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:56.535015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:56.535026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601815017939949:5526]
2025-10-10T14:35:56.535031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601815017939949:5526]
2025-10-10T14:35:56.535034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601815017939949:5526]
2025-10-10T14:35:56.535089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:56.535096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.535095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:56.535098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:56.535103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:56.535107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:56.535229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:56.578000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601815800168931:6939]
2025-10-10T14:35:56.578310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1848, pipe: [1:7559601815800168931:6939]
2025-10-10T14:35:56.651175Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:56.659325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.659355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.659536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.659593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.659653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.659713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.659753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.659758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.659828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.659883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.659939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.660004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.660045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.660051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.660122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.660178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.660235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.660294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.660332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.660335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.660399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.660453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.660513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.660573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.660611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.660614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.660683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.660741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.660800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.660857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.660901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.660904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.660971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.661027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.661089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.661150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.661190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.661193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.661260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.661313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.661606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.661675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.661716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.661719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.661792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.661849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.661909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.661967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.662010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.662013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.662082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.662138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.662197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.662257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.662322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.662324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.662390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:56.662444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:56.662508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:56.662568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:56.662609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:56.662611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:56.662677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168931:6939], now have 1 active actors on pipe
2025-10-10T14:35:56.663574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9074a33a-3e2cd426-6b80db35-9120f305_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:56.663590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9074a33a-3e2cd426-6b80db35-9120f305_0] Write session will restart in 0.008364s
2025-10-10T14:35:56.663070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:56.663083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:56.663116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1849 reason: error at write: Disconnected sessionId: src_id|9074a33a-3e2cd426-6b80db35-9120f305_0
2025-10-10T14:35:56.663150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601815800168931:6939]
2025-10-10T14:35:56.663622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9074a33a-3e2cd426-6b80db35-9120f305_0] Write session: Do CDS request
2025-10-10T14:35:56.663182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:56.663360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1849 sessionId: src_id|9074a33a-3e2cd426-6b80db35-9120f305_0 is DEAD
2025-10-10T14:35:56.663630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9074a33a-3e2cd426-6b80db35-9120f305_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:56.663967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:56.673777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9074a33a-3e2cd426-6b80db35-9120f305_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.673939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:56.673956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1850
2025-10-10T14:35:56.674513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.674549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:56.674554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:56.674559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:56.675137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1850 sessionId:  describe result for acl check
2025-10-10T14:35:56.675173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:56.675176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:56.675178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:56.675185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601815800169007:6547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:56.675816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601815800169007:6547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:56.680487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601815800169007:6547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:56.686264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601815800169007:6547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:56.686279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601815800169007:6547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:56.686283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601815800169007:6547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:56.686293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:56.688051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:56.690412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:56.690827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:56.690834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:56.690849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:56.690921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:56.690964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601815017940141:5522]
2025-10-10T14:35:56.691677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:56.692522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:56.692586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:56.692997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:56.693072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.693073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.693074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.693076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.693077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.693078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.693080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.693081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.693083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.693084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.693086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.693087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.693088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.693096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.693110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.693116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.693120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.693124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.693129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.693134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.693138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.693143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.693148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.693152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.693157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.693161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.693171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.693179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.693187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.693193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.693200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.693207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.693212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.693218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.693224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.693230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.693237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.693243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.693249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.693255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.693261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.693267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.693273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.693280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.693285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.693292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.693298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.693307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.693312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.693319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.693324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.693352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.693400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:56.696378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:56.696698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:56.696703Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:56.696705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:56.696725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:56.696733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1849 [2:7559601815017940141:5522]
2025-10-10T14:35:56.696749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:56.696771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:56.696775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.696780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.696783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.696801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:56.696809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:56.696818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:56.696882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.696885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.696888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.696890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:56.696963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:56.696966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.696979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.696992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.697012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:56.697035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601815017940136:5522]
2025-10-10T14:35:56.697037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601815017940136:5522]
2025-10-10T14:35:56.697041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601815017940136:5522]
2025-10-10T14:35:56.697050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:56.697060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:56.697063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:56.697066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:56.697069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:56.697088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:56.697093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:56.697105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800169114:6547], now have 1 active actors on pipe
2025-10-10T14:35:56.697109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800168934:2438], now have 1 active actors on pipe
2025-10-10T14:35:56.697135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601815017940136:5522]
2025-10-10T14:35:56.697147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:56.697205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:56.697712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1849
2025-10-10T14:35:56.697744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1849
2025-10-10T14:35:56.701493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.701515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.701561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:56.701575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.701582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.701585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:56.701601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.701620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:56.701642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.705462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.705482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.705522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.709675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1850 partition: 0 MaxSeqNo: 40 sessionId: src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0
2025-10-10T14:35:56.713034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9074a33a-3e2cd426-6b80db35-9120f305_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:56.716001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0] Write session: try to update token
2025-10-10T14:35:56.716027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:56.718602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:56.718630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:56.718634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:56.718636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:56.718647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601815017940136:5522]
2025-10-10T14:35:56.718652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601815017940136:5522]
2025-10-10T14:35:56.718656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601815017940136:5522]
2025-10-10T14:35:56.718710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:56.718720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:56.718724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.718727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:56.718728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:56.718732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:56.718867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:56.731373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId: src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:56.733991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:56.763349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601815800169132:6939]
2025-10-10T14:35:56.763676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1849, pipe: [1:7559601815800169132:6939]
2025-10-10T14:35:56.844485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:56.845051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.845070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.845095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800169132:6939], now have 1 active actors on pipe
2025-10-10T14:35:56.845314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601815800169132:6939]
2025-10-10T14:35:56.845321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:56.845390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:56.845398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:56.845493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1850 reason: error at write: Disconnected sessionId: src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0
2025-10-10T14:35:56.845562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:56.845692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1850 sessionId: src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0 is DEAD
2025-10-10T14:35:56.849425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:56.849448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0] Write session will restart in 0.006852s
2025-10-10T14:35:56.849476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0] Write session: Do CDS request
2025-10-10T14:35:56.849481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:56.857945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.858048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:56.858064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1851
2025-10-10T14:35:56.858190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:56.858228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:56.858234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:56.858238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:56.858779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1851 sessionId:  describe result for acl check
2025-10-10T14:35:56.858813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:56.858816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:56.858817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:56.858844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601815800169179:6539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:56.859447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601815800169179:6539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:56.867304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601815800169179:6539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:56.869289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:56.871312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:56.871528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:56.871539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:56.871551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:56.871555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601815800169179:6539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:56.871572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601815800169179:6539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:56.871576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601815800169179:6539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:56.871585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:56.871601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:56.871645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601815017940338:5518]
2025-10-10T14:35:56.872272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:56.872530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:56.872572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:56.872890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:56.872944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.872950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.872952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.872953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.872954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.872956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.872957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.872958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.872960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.872961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.872962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.872964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.872965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.872971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.872984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.872989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.872993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.872997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.873001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.873005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.873009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.873013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.873018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.873022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.873026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.873030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.873038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.873051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:56.873062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.873072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:56.873081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.873086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:56.873090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.873095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:56.873106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.873115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:56.873124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.873135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:56.873143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.873152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:56.873156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.873162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:56.873166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.873175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:56.873180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.873185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:56.873191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.873196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.873200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.873206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.873220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.873224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.873260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:56.875888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:56.876229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:56.876241Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:56.876255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:56.876260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:56.876267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1850 [2:7559601815017940338:5518]
2025-10-10T14:35:56.876286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:56.876311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:56.876314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.876319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.876322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.876340Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:56.876353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:56.876367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:56.876423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.876430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.876433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.876435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:56.876503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:56.876511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.876523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:56.876545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:56.876562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:56.876586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800169147:2438], now have 1 active actors on pipe
2025-10-10T14:35:56.876590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800169325:6539], now have 1 active actors on pipe
2025-10-10T14:35:56.876597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601815017940333:5518]
2025-10-10T14:35:56.876600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601815017940333:5518]
2025-10-10T14:35:56.876602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601815017940333:5518]
2025-10-10T14:35:56.876617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:56.876634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:56.876643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:56.876647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:56.876650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:56.876655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:56.876659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:56.876689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601815017940333:5518]
2025-10-10T14:35:56.876697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:56.876717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:56.876717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1850
2025-10-10T14:35:56.876793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1850
2025-10-10T14:35:56.876856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.876866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.876902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac62355c-689bd44e-f9584dce-2f22689_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:56.876910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:56.876917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:56.876920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:56.876932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:56.876945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:56.876960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.877141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.877149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.877164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:56.877272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1851 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac62355c-689bd44e-f9584dce-2f22689_0
2025-10-10T14:35:56.877750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a116ac5-3075df59-4eb81a35-f51238dd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac62355c-689bd44e-f9584dce-2f22689_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:56.880506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac62355c-689bd44e-f9584dce-2f22689_0] Write session: try to update token
2025-10-10T14:35:56.880526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac62355c-689bd44e-f9584dce-2f22689_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:56.889588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:56.889607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:56.889618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601815017940333:5518]
2025-10-10T14:35:56.889672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:56.889670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:56.889856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:56.889994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:56.890129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:56.890266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:56.890452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:56.890489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:56.898624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId: src_id|ac62355c-689bd44e-f9584dce-2f22689_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:56.901316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:56.901559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:56.901584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:56.901642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:56.901757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:56.909255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:56.909281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:56.909285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:56.909288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:56.909300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601815017940333:5518]
2025-10-10T14:35:56.909306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601815017940333:5518]
2025-10-10T14:35:56.909312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601815017940333:5518]
2025-10-10T14:35:56.909384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:56.909391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:56.909392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:56.909397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:56.909398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:56.909401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:56.909562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:56.945623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601815800169336:6939]
2025-10-10T14:35:56.945994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1850, pipe: [1:7559601815800169336:6939]
2025-10-10T14:35:57.026647Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:57.035611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.035646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.035853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.035935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.036007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.036087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.036142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.036155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.036238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.036309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.036393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.036477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.036530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.036541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.036621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.036708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.036791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.036869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.036919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.036929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.037009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.037088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.037164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.037241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.037292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.037300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.037451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.037529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.037610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.037687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.037744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.037753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.037836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.037912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.037998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.038079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.038127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.038136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.038216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.038295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.038379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.038460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.038526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.038533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.038622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.038700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.038784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.038872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.038929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.038936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.039020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.039095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.039179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.039258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.039316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.039323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.039406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.039483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.039562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.039644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.039701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.039709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.039798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601815800169336:6939], now have 1 active actors on pipe
2025-10-10T14:35:57.041147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac62355c-689bd44e-f9584dce-2f22689_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:57.041165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac62355c-689bd44e-f9584dce-2f22689_0] Write session will restart in 0.008814s
2025-10-10T14:35:57.041193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac62355c-689bd44e-f9584dce-2f22689_0] Write session: Do CDS request
2025-10-10T14:35:57.041200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac62355c-689bd44e-f9584dce-2f22689_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:57.041385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:57.040511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:57.040576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601815800169336:6939]
2025-10-10T14:35:57.040605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:57.040608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:57.040643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1851 reason: error at write: Disconnected sessionId: src_id|ac62355c-689bd44e-f9584dce-2f22689_0
2025-10-10T14:35:57.041386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1851 sessionId: src_id|ac62355c-689bd44e-f9584dce-2f22689_0 is DEAD
2025-10-10T14:35:57.051162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac62355c-689bd44e-f9584dce-2f22689_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.051656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:57.051682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1852
2025-10-10T14:35:57.051873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.051925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:57.051932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:57.051936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:57.053382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1852 sessionId:  describe result for acl check
2025-10-10T14:35:57.053486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:57.053494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:57.053496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:57.053503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601820095136741:6520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:57.054078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601820095136741:6520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:57.057775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601820095136741:6520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:57.061224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601820095136741:6520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:57.061243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601820095136741:6520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:57.061247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601820095136741:6520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:57.061257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:57.062498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:57.063456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:57.063701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:57.063712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:57.063726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:57.063792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:57.063841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601819312907862:5474]
2025-10-10T14:35:57.064494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:57.065269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:57.065366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:57.065768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:57.065870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.065877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.065878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.065879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.065881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.065882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.065884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.065885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.065887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.065888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.065889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.065890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.065891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.065899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.065913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.065917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.065921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.065926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.065930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.065944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.065948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.065952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.065957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.065961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.065964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.065968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.065980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.065989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.065997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.066003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.066009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.066015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.066021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.066027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.066032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.066038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.066042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.066048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.066054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.066060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.066065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.066070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.066075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.066080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.066084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.066090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.066096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.066102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.066107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.066122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.066128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.066134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.066177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:57.069049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:57.069721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:57.069737Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:57.069739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:57.069744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:57.069752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1851 [2:7559601819312907862:5474]
2025-10-10T14:35:57.069766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:57.069789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:57.069801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.069805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.069808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.069827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:57.069836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:57.069845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:57.069918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.069927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.069930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.069933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:57.070009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:57.070018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.070043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.070065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.070084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:57.070113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095136661:2438], now have 1 active actors on pipe
2025-10-10T14:35:57.070120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095136836:6520], now have 1 active actors on pipe
2025-10-10T14:35:57.070127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601819312907857:5474]
2025-10-10T14:35:57.070135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601819312907857:5474]
2025-10-10T14:35:57.070137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601819312907857:5474]
2025-10-10T14:35:57.070152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:57.070167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:57.070170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:57.070172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:57.070173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:57.070190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:57.070199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:57.070177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1851
2025-10-10T14:35:57.070240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601819312907857:5474]
2025-10-10T14:35:57.070252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:57.070254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1851
2025-10-10T14:35:57.070267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:57.070455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.070471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.070504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:57.070517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.070521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.070525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:57.070539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.070562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:57.070590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.070870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.070879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.070898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.071042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1852 partition: 0 MaxSeqNo: 40 sessionId: src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0
2025-10-10T14:35:57.071566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac62355c-689bd44e-f9584dce-2f22689_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:57.074395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0] Write session: try to update token
2025-10-10T14:35:57.074418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:57.092297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId: src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:57.092526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:57.092553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:57.092557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:57.092559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:57.092571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601819312907857:5474]
2025-10-10T14:35:57.092576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601819312907857:5474]
2025-10-10T14:35:57.092582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601819312907857:5474]
2025-10-10T14:35:57.092642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:57.092662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.092665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:57.092693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:57.092708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:57.092713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:57.092823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:57.095150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:57.140691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601820095136848:6939]
2025-10-10T14:35:57.140927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1851, pipe: [1:7559601820095136848:6939]
2025-10-10T14:35:57.211216Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:57.211681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.211699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.211747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095136848:6939], now have 1 active actors on pipe
2025-10-10T14:35:57.211927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:57.212063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601820095136848:6939]
2025-10-10T14:35:57.212095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:57.212246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:57.212319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1852 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0
2025-10-10T14:35:57.212513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1852 sessionId: src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0 is DEAD
2025-10-10T14:35:57.212903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:57.212912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0] Write session will restart in 0.009742s
2025-10-10T14:35:57.212939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0] Write session: Do CDS request
2025-10-10T14:35:57.212945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:57.223923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.224010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:57.224026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1853
2025-10-10T14:35:57.224293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.224342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:57.224351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:57.224355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:57.224921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1853 sessionId:  describe result for acl check
2025-10-10T14:35:57.224960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:57.224966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:57.224968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:57.224976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601820095136935:6517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:57.225614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601820095136935:6517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:57.229804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601820095136935:6517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:57.229974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:57.232141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:57.232364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:57.232377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:57.232390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:57.232457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:57.232462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601820095136935:6517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:57.232476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601820095136935:6517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:57.232480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601820095136935:6517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:57.232488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:57.232503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601819312908049:5471]
2025-10-10T14:35:57.233063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:57.233385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:57.233453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:57.233775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:57.233847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.233854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.233855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.233856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.233857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.233859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.233860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.233862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.233863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.233864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.233866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.233867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.233868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.233875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.233890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.233894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.233897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.233901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.233905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.233909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.233913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.233917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.233921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.233925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.233929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.233933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.233943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.233952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.233958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.233963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.233968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.233973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.233977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.233982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.233994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.233999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.234004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.234015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.234020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.234031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.234035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.234040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.234050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.234055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.234059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.234064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.234068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.234073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.234079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.234084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.234089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.234094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.234133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:57.237158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:57.237837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:57.237857Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:57.237859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:57.237864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:57.237872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1852 [2:7559601819312908049:5471]
2025-10-10T14:35:57.237886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:57.237904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:57.237908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.237912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.237914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.237945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:57.237960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:57.237968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:57.238039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.238047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.238050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.238052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:57.238126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:57.238137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.238149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.238159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.238175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:57.238204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137031:6517], now have 1 active actors on pipe
2025-10-10T14:35:57.238212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095136851:2438], now have 1 active actors on pipe
2025-10-10T14:35:57.238219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601819312908044:5471]
2025-10-10T14:35:57.238222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601819312908044:5471]
2025-10-10T14:35:57.238225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601819312908044:5471]
2025-10-10T14:35:57.238235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:57.238246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:57.238266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1852
2025-10-10T14:35:57.238249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:57.238268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1852
2025-10-10T14:35:57.238256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:57.238259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:57.238265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:57.238268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:57.238305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601819312908044:5471]
2025-10-10T14:35:57.238308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:57.238316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:57.238330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.238334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.238392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:57.238407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.238411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.238413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:57.238426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.238449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:57.238478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.238660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.238670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.238686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.238792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1853 partition: 0 MaxSeqNo: 40 sessionId: src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0
2025-10-10T14:35:57.239196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c4d2fd-ec2a1016-f9e258bf-efcd3a3b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:57.242035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0] Write session: try to update token
2025-10-10T14:35:57.242056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:57.258064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId: src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:57.259790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:57.259816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:57.259821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:57.259823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:57.259834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601819312908044:5471]
2025-10-10T14:35:57.259839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601819312908044:5471]
2025-10-10T14:35:57.259844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601819312908044:5471]
2025-10-10T14:35:57.259891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:57.259901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:57.259905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:57.259909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:57.259910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.259912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:57.260073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:57.260899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:57.312217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601820095137042:6939]
2025-10-10T14:35:57.312533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1852, pipe: [1:7559601820095137042:6939]
2025-10-10T14:35:57.382604Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:57.382891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.382906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.382953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137042:6939], now have 1 active actors on pipe
2025-10-10T14:35:57.383254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:57.384179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:57.384193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0] Write session will restart in 0.006765s
2025-10-10T14:35:57.383644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601820095137042:6939]
2025-10-10T14:35:57.383676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:57.384221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0] Write session: Do CDS request
2025-10-10T14:35:57.383745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1853 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0
2025-10-10T14:35:57.383960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1853 sessionId: src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0 is DEAD
2025-10-10T14:35:57.384228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:57.384118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:57.394762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.396351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:57.396365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1854
2025-10-10T14:35:57.397555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.397623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:57.397635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:57.397640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:57.398136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1854 sessionId:  describe result for acl check
2025-10-10T14:35:57.398184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:57.398190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:57.398192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:57.398198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601820095137195:6511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:57.398772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601820095137195:6511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:57.399750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:57.400857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601820095137195:6511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:57.402313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:57.402565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:57.402577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:57.402590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:57.402650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:57.402693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601819312908238:5466]
2025-10-10T14:35:57.403332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:57.403891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601820095137195:6511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:57.403905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601820095137195:6511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:57.403909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601820095137195:6511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:57.403919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:57.403923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:57.403984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:57.404342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:57.404408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.404415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.404416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.404417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.404418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.404419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.404421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.404422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.404423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.404425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.404426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.404427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.404428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.404435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.404449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.404472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.404477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.404482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.404486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.404490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.404495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.404499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.404503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.404508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.404512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.404516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.404524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.404533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.404539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.404545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.404563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.404568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.404572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.404577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.404582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.404588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.404592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.404596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.404602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.404606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.404611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.404616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.404621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.404627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.404632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.404638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.404645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.404650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.404656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.404661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.404665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.404670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.404718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:57.407417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:57.407968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:57.407986Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:57.407989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:57.407994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:57.408002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1853 [2:7559601819312908238:5466]
2025-10-10T14:35:57.408018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:57.408041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:57.408052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.408056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.408059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.408079Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:57.408094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:57.408108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:57.408189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.408199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.408201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.408204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:57.408292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:57.408303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.408315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.408327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.408343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:57.408370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137044:2438], now have 1 active actors on pipe
2025-10-10T14:35:57.408380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137227:6511], now have 1 active actors on pipe
2025-10-10T14:35:57.408390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601819312908233:5466]
2025-10-10T14:35:57.408393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601819312908233:5466]
2025-10-10T14:35:57.408395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601819312908233:5466]
2025-10-10T14:35:57.408413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:57.408429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:57.408432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:57.408435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:57.408438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:57.408456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:57.408416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1853
2025-10-10T14:35:57.408460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:57.408420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1853
2025-10-10T14:35:57.408505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601819312908233:5466]
2025-10-10T14:35:57.408540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:57.408564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.408563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:57.408574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.408747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:57.408767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.408777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.408780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:57.408796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.408810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:57.408846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.409008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.409021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.409042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.409182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1854 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0
2025-10-10T14:35:57.409635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc184ab-d22f98f-19f1e8d1-d8d9ef43_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:57.412386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0] Write session: try to update token
2025-10-10T14:35:57.412406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:57.428777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId: src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:57.429911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:57.429934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:57.429938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:57.429941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:57.429954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601819312908233:5466]
2025-10-10T14:35:57.429959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601819312908233:5466]
2025-10-10T14:35:57.429964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601819312908233:5466]
2025-10-10T14:35:57.430017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:57.430029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.430032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:57.430152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:57.430167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:57.430179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:57.430187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:57.431885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:57.483740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601820095137237:6939]
2025-10-10T14:35:57.484049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1853, pipe: [1:7559601820095137237:6939]
2025-10-10T14:35:57.550940Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:57.551445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.551464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.551514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137237:6939], now have 1 active actors on pipe
2025-10-10T14:35:57.551904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601820095137237:6939]
2025-10-10T14:35:57.551943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:57.551946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:57.552008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1854 reason: error at write: Disconnected sessionId: src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0
2025-10-10T14:35:57.552155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:57.552225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1854 sessionId: src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0 is DEAD
2025-10-10T14:35:57.551931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:57.552494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:57.552502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0] Write session will restart in 0.006989s
2025-10-10T14:35:57.552525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0] Write session: Do CDS request
2025-10-10T14:35:57.552534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:57.561857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.565526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:57.565541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1855
2025-10-10T14:35:57.569456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.569510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:57.569514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:57.569518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:57.570538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1855 sessionId:  describe result for acl check
2025-10-10T14:35:57.570571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:57.570578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:57.570579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:57.570585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601820095137310:6503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:57.571053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601820095137310:6503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:57.575447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601820095137310:6503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:57.581670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601820095137310:6503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:57.581688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601820095137310:6503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:57.581692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601820095137310:6503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:57.581703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:57.586065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:57.587445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:57.587654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:57.587660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:57.587673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:57.587736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:57.587775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601819312908429:5461]
2025-10-10T14:35:57.588398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:57.588751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:57.588814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:57.589176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:57.589273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.589274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.589275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.589276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.589277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.589279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.589280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.589281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.589282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.589283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.589285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.589286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.589287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.589295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.589308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.589312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.589316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.589319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.589323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.589343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.589347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.589351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.589354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.589358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.589361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.589364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.589373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.589383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.589389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.589395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.589399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.589405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.589409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.589429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.589435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.589440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.589445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.589450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.589455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.589460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.589464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.589470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.589475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.589481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.589486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.589492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.589496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.589502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.589507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.589515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.589520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.589526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.589571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:57.598306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:57.599026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:57.599042Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:57.599045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:57.599049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:57.599060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1854 [2:7559601819312908429:5461]
2025-10-10T14:35:57.599074Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:57.599573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1854
2025-10-10T14:35:57.599621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1854
2025-10-10T14:35:57.599102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:57.599114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.599118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.599121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.599141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:57.599148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:57.599158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:57.599222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.599226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.599228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.599231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:57.599305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:57.599308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.599322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.599335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.599353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:57.599375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601819312908424:5461]
2025-10-10T14:35:57.599377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601819312908424:5461]
2025-10-10T14:35:57.599379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601819312908424:5461]
2025-10-10T14:35:57.599388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:57.599399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:57.599403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:57.599403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:57.599406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:57.599419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:57.599422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:57.599434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137409:6503], now have 1 active actors on pipe
2025-10-10T14:35:57.599437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137239:2438], now have 1 active actors on pipe
2025-10-10T14:35:57.599480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601819312908424:5461]
2025-10-10T14:35:57.599490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:57.599536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:57.599754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.599763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.599815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:57.599840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.599849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.599857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:57.599870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.599888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:57.599929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.600146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.600161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.600186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.600292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1855 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0
2025-10-10T14:35:57.600730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4f196b-9477b8eb-22509d8f-395dcec2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:57.603555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0] Write session: try to update token
2025-10-10T14:35:57.603580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:57.613235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:57.613261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:57.613273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601819312908424:5461]
2025-10-10T14:35:57.613346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:57.613374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:57.613548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:57.613724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:57.613866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:57.614001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:57.614201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:57.614242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:57.620548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId: src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:57.623189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:57.623766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.623795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.623840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:57.623944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:57.632453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:57.632477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:57.632481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:57.632483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:57.632496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601819312908424:5461]
2025-10-10T14:35:57.632501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601819312908424:5461]
2025-10-10T14:35:57.632504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601819312908424:5461]
2025-10-10T14:35:57.632558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:57.632566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.632569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:57.632594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:57.632610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:57.632614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:57.632699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:57.652178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601820095137433:6939]
2025-10-10T14:35:57.652501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1854, pipe: [1:7559601820095137433:6939]
2025-10-10T14:35:57.750481Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:57.758400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.758431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.758618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.758687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.758752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.758815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.759199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.759212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.759282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.759343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.759409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.759479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.759525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.759537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.759604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.759676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.759750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.759817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.759864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.759871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.759948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.760016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.760080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.760154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.760207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.760217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.760290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.760352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.760419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.760486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.760531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.760539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.760613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.760675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.760742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.760809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.760860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.760867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.760934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.760995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.761061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.761126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.761180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.761187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.761263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.761326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.761418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.761489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.761536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.761543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.761615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.761681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.761747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.761814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.761858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.761866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.761937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.761999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.762066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.762130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.762176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.762183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.762249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137433:6939], now have 1 active actors on pipe
2025-10-10T14:35:57.762550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:57.762567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:57.762568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:57.762602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1855 reason: error at write: Disconnected sessionId: src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0
2025-10-10T14:35:57.762620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601820095137433:6939]
2025-10-10T14:35:57.762812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1855 sessionId: src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0 is DEAD
2025-10-10T14:35:57.762922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:57.762983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:57.762997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0] Write session will restart in 0.008168s
2025-10-10T14:35:57.763025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0] Write session: Do CDS request
2025-10-10T14:35:57.763031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:57.772861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.773222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:57.773237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1856
2025-10-10T14:35:57.773391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.773480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:57.773491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:57.773495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:57.773973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1856 sessionId:  describe result for acl check
2025-10-10T14:35:57.774028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:57.774035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:57.774039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:57.774046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601820095137516:6500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:57.774652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601820095137516:6500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:57.778742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601820095137516:6500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:57.778849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:57.781292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:57.781534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:57.781545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:57.781557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:57.781605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:57.781596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601820095137516:6500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:57.781618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601820095137516:6500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:57.781622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601820095137516:6500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:57.781630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:57.781652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601819312908619:5457]
2025-10-10T14:35:57.782313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:57.782565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:57.782618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:57.783030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:57.783088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.783094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.783096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.783097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.783098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.783099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.783101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.783102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.783104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.783105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.783106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.783107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.783109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.783114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.783128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.783132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.783137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.783141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.783145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.783149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.783153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.783158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.783162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.783166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.783170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.783174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.783182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.783191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.783198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.783204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.783209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.783214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.783219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.783225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.783230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.783235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.783240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.783245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.783255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.783260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.783265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.783270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.783275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.783281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.783285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.783290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.783296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.783301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.783307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.783312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.783324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.783329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.783374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:57.785819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:57.786353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:57.786369Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:57.786371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:57.786375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:57.786383Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1855 [2:7559601819312908619:5457]
2025-10-10T14:35:57.786396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:57.786418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:57.786426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.786430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.786433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.786450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:57.786458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:57.786471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:57.786527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.786534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.786537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.786540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:57.786611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:57.786619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.786631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.786643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.786663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:57.786690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137444:2438], now have 1 active actors on pipe
2025-10-10T14:35:57.786702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601819312908613:5457]
2025-10-10T14:35:57.786705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601819312908613:5457]
2025-10-10T14:35:57.786707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601819312908613:5457]
2025-10-10T14:35:57.786720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:57.786733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137627:6500], now have 1 active actors on pipe
2025-10-10T14:35:57.786735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:57.786739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:57.786741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:57.786745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:57.786761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:57.786765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:57.786792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601819312908613:5457]
2025-10-10T14:35:57.786808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:57.786828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:57.786798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1855
2025-10-10T14:35:57.786799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1855
2025-10-10T14:35:57.787000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.787013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.787046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:57.787060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.787064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.787066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:57.787076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.787088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:57.787109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.787296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.787310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.787336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.787428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1856 partition: 0 MaxSeqNo: 40 sessionId: src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0
2025-10-10T14:35:57.787807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea8ea0dc-1f01c861-326764c7-4d1b2199_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:57.790706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0] Write session: try to update token
2025-10-10T14:35:57.790731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:57.798586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:57.798604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:57.798614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601819312908613:5457]
2025-10-10T14:35:57.798660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:57.798661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:57.798828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:57.798971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:57.799120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:57.799265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:57.799463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:57.799511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:57.805827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId: src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:57.808592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:57.808850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.808873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.808914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:57.809027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:57.819419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:57.819439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:57.819441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:57.819443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:57.819452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601819312908613:5457]
2025-10-10T14:35:57.819456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601819312908613:5457]
2025-10-10T14:35:57.819458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601819312908613:5457]
2025-10-10T14:35:57.819498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:57.819504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.819504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:57.819506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:57.819510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:57.819514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:57.819638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:57.862634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601820095137651:6939]
2025-10-10T14:35:57.863183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1855, pipe: [1:7559601820095137651:6939]
2025-10-10T14:35:57.943159Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:57.951266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.951297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.951489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.951561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.951635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.951703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.952197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.952216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.952292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.952361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.952434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.952504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.952560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.952568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.952639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.952706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.952782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.952850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.952895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.952902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.952977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.953048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.953112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.953185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.953239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.953242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.953319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.955674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:57.955686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:57.955719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1856 reason: error at write: Disconnected sessionId: src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0
2025-10-10T14:35:57.955955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1856 sessionId: src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0 is DEAD
2025-10-10T14:35:57.956139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:57.956146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0] Write session will restart in 0.006959s
2025-10-10T14:35:57.956171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0] Write session: Do CDS request
2025-10-10T14:35:57.956177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:57.953521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.953596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.953664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.953711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.953714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.953788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.953853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.953917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.956156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601820095137651:6939]
2025-10-10T14:35:57.956184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:57.953982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.954025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.954029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.954104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.954167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.954235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.954309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.954362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.954370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.954444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.954507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.954574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.954638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.954746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.954749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.954824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.954883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.954941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.955006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.955046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.955049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.955121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:57.955178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:57.955242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:57.955302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:57.955349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:57.955351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:57.955410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137651:6939], now have 1 active actors on pipe
2025-10-10T14:35:57.956011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:57.963971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.964055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:57.964069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1857
2025-10-10T14:35:57.964247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:57.964293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:57.964314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:57.964318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:57.964751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1857 sessionId:  describe result for acl check
2025-10-10T14:35:57.964788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:57.964805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:57.964807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:57.964813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601820095137671:6494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:57.965431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601820095137671:6494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:57.971905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601820095137671:6494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:57.975554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601820095137671:6494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:57.975569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601820095137671:6494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:57.975572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601820095137671:6494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:57.975581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:57.976194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:57.978766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:57.979078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:57.979091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:57.979106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:57.979178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:57.979225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601819312908840:5452]
2025-10-10T14:35:57.979880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:57.980252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:57.980312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:57.980677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:57.980745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.980752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.980754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.980755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.980756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.980758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.980759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.980761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.980762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.980764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.980765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.980766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.980767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.980775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.980789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.980793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.980798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.980803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.980807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.980811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.980815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.980819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.980824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.980829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.980833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.980837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.980845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.980854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:57.980862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.980867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:57.980875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.980881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:57.980886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.980892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:57.980898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.980903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:57.980908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.980914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:57.980918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.980924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:57.980929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.980935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:57.980940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.980946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:57.980951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.980956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:57.980961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.980967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.980972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.980985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.980990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.980995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.981037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:57.983571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:57.984073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:57.984087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:57.984089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:57.984093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:57.984099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1856 [2:7559601819312908840:5452]
2025-10-10T14:35:57.984111Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:57.984135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:57.984143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.984148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.984150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.984169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:57.984185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:57.984193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:57.984254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.984262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.984264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.984267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:57.984335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:57.984343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:57.984356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:57.984375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:57.984398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:57.984423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601819312908835:5452]
2025-10-10T14:35:57.984426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601819312908835:5452]
2025-10-10T14:35:57.984428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601819312908835:5452]
2025-10-10T14:35:57.984445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:57.984460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:57.984482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:57.984490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:57.984501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:57.984511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:57.984515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:57.984520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601819312908835:5452]
2025-10-10T14:35:57.984523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:57.984601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:57.984744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1856
2025-10-10T14:35:57.984775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1856
2025-10-10T14:35:57.984879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137836:6494], now have 1 active actors on pipe
2025-10-10T14:35:57.984890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601820095137656:2438], now have 1 active actors on pipe
2025-10-10T14:35:57.985361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.985374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.985417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|805e3aa5-28b02677-2617825c-689fd730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:57.985426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:57.985431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:57.985436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:57.985448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:57.985460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:57.985475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.989110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:57.989127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:57.989170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:57.990670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1857 partition: 0 MaxSeqNo: 40 sessionId: src_id|805e3aa5-28b02677-2617825c-689fd730_0
2025-10-10T14:35:57.993606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8191091-9caaf567-2ae11cc6-59a68d00_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|805e3aa5-28b02677-2617825c-689fd730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:57.996407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805e3aa5-28b02677-2617825c-689fd730_0] Write session: try to update token
2025-10-10T14:35:57.996431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805e3aa5-28b02677-2617825c-689fd730_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:58.005702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:58.005719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:58.005721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:58.005723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:58.005730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601819312908835:5452]
2025-10-10T14:35:58.005734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601819312908835:5452]
2025-10-10T14:35:58.005736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601819312908835:5452]
2025-10-10T14:35:58.005787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:58.005791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:58.005794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.005796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:58.005799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:58.005802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:58.005943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:58.015842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId: src_id|805e3aa5-28b02677-2617825c-689fd730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:58.018498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:58.056151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601824390105169:6939]
2025-10-10T14:35:58.056415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1856, pipe: [1:7559601824390105169:6939]
2025-10-10T14:35:58.126478Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:58.126894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.126905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.126932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105169:6939], now have 1 active actors on pipe
2025-10-10T14:35:58.129733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:58.129745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:58.129831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1857 reason: error at write: Disconnected sessionId: src_id|805e3aa5-28b02677-2617825c-689fd730_0
2025-10-10T14:35:58.130035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1857 sessionId: src_id|805e3aa5-28b02677-2617825c-689fd730_0 is DEAD
2025-10-10T14:35:58.130050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601824390105169:6939]
2025-10-10T14:35:58.130069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:58.130424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e3aa5-28b02677-2617825c-689fd730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:58.130433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e3aa5-28b02677-2617825c-689fd730_0] Write session will restart in 0.008608s
2025-10-10T14:35:58.130457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e3aa5-28b02677-2617825c-689fd730_0] Write session: Do CDS request
2025-10-10T14:35:58.130463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e3aa5-28b02677-2617825c-689fd730_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:58.129805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:58.143273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805e3aa5-28b02677-2617825c-689fd730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.143395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:58.143409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1858
2025-10-10T14:35:58.143543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.143576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:58.143582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:58.143586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:58.144132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1858 sessionId:  describe result for acl check
2025-10-10T14:35:58.144177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:58.144179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:58.144181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:58.144188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601824390105283:6473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:58.145116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601824390105283:6473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:58.147432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601824390105283:6473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:58.148881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:58.152340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:58.152708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:58.152714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:58.152727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:58.152810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:58.152849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601823607876353:5421]
2025-10-10T14:35:58.153460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:58.152608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601824390105283:6473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:58.152627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601824390105283:6473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:58.152631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601824390105283:6473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:58.152640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:58.153898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:58.153955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:58.154250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:58.154297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.154298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.154299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.154300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.154302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.154303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.154304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.154305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.154307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.154308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.154309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.154311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.154312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.154318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.154331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.154336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.154341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.154345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.154349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.154354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.154357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.154359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.154362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.154364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.154366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.154369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.154376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.154382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.154387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.154391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.154394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.154399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.154404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.154408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.154412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.154417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.154422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.154427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.154431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.154437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.154441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.154445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.154450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.154455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.154459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.154463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.154467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.154471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.154476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.154481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.154485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.154490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.154527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:58.158581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:58.158929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:58.158935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:58.158938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:58.158942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:58.158950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1857 [2:7559601823607876353:5421]
2025-10-10T14:35:58.158965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:58.158986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:58.158990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.158994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.158997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.159017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:58.159024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:58.159033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:58.159092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.159095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.159097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.159100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:58.159173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:58.159176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.159189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.159200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.159216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:58.159239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601823607876348:5421]
2025-10-10T14:35:58.159241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601823607876348:5421]
2025-10-10T14:35:58.159243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601823607876348:5421]
2025-10-10T14:35:58.159262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:58.159269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:58.159272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:58.159274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:58.159277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:58.159292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:58.159304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:58.159316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105356:6473], now have 1 active actors on pipe
2025-10-10T14:35:58.159319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105171:2438], now have 1 active actors on pipe
2025-10-10T14:35:58.159352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601823607876348:5421]
2025-10-10T14:35:58.159359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:58.159447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:58.159451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1857
2025-10-10T14:35:58.159453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1857
2025-10-10T14:35:58.159680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.159692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.159726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:58.159739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.159743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.159746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:58.159758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.159771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:58.159787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.159973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.159983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.160001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.160168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1858 partition: 0 MaxSeqNo: 40 sessionId: src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0
2025-10-10T14:35:58.160607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e3aa5-28b02677-2617825c-689fd730_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:58.163457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0] Write session: try to update token
2025-10-10T14:35:58.163479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:58.180087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:58.180108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:58.180112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:58.180114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:58.180125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601823607876348:5421]
2025-10-10T14:35:58.180131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601823607876348:5421]
2025-10-10T14:35:58.180135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601823607876348:5421]
2025-10-10T14:35:58.180189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:58.180202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.180205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:58.180342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:58.181384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:58.181415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:58.181420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:58.187637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId: src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:58.190299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:58.230248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601824390105368:6939]
2025-10-10T14:35:58.230640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1857, pipe: [1:7559601824390105368:6939]
2025-10-10T14:35:58.244763Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:35:58.297387Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:58.298072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.298094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.298142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105368:6939], now have 1 active actors on pipe
2025-10-10T14:35:58.298379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:58.298378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:58.298395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:58.298418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:58.298469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1858 reason: error at write: Disconnected sessionId: src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0
2025-10-10T14:35:58.298477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601824390105368:6939]
2025-10-10T14:35:58.298874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:58.298887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0] Write session will restart in 0.008592s
2025-10-10T14:35:58.298912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0] Write session: Do CDS request
2025-10-10T14:35:58.298918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:58.298691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1858 sessionId: src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0 is DEAD
2025-10-10T14:35:58.308996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.309107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:58.309121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1859
2025-10-10T14:35:58.309255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.309312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:58.309318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:58.309322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:58.309867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1859 sessionId:  describe result for acl check
2025-10-10T14:35:58.309907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:58.309915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:58.309918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:58.309925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601824390105455:6468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:58.310541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601824390105455:6468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:58.313410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601824390105455:6468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:58.314711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:58.316755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:58.316978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:58.316994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:58.317007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:58.317074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:58.317126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601823607876547:5426]
2025-10-10T14:35:58.317194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601824390105455:6468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:58.317209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601824390105455:6468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:58.317213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601824390105455:6468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:58.317223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:58.317769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:58.318087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:58.318139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:58.318506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:58.318580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.318587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.318588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.318589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.318591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.318592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.318593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.318594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.318595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.318597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.318598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.318599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.318601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.318608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.318621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.318626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.318630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.318635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.318640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.318645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.318649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.318654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.318659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.318663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.318666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.318670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.318678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.318688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.318694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.318699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.318703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.318709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.318713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.318719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.318723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.318728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.318739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.318744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.318748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.318753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.318757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.318762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.318766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.318786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.318791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.318795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.318800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.318804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.318810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.318814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.318819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.318825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.318860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:58.321508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:58.322162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:58.322178Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:58.322181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:58.322185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:58.322192Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1858 [2:7559601823607876547:5426]
2025-10-10T14:35:58.322207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:58.322227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:58.322231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.322235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.322239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.322259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:58.322275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:58.322288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:58.322358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.322367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.322369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.322372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:58.322447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:58.322456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.322470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.322483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.322510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:58.322532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601823607876542:5426]
2025-10-10T14:35:58.322536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601823607876542:5426]
2025-10-10T14:35:58.322538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601823607876542:5426]
2025-10-10T14:35:58.322548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:58.322564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:58.322569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:58.322573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:58.322575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:58.322584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:58.322588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:58.322627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105369:2438], now have 1 active actors on pipe
2025-10-10T14:35:58.322640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105555:6468], now have 1 active actors on pipe
2025-10-10T14:35:58.322643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601823607876542:5426]
2025-10-10T14:35:58.322652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:58.322662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:58.322678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1858
2025-10-10T14:35:58.322718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1858
2025-10-10T14:35:58.322935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.322950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.322998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:58.323013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.323022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.323024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:58.323040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.323059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:58.323080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.323353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.323365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.323386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.323744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1859 partition: 0 MaxSeqNo: 40 sessionId: src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0
2025-10-10T14:35:58.324174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d33dd2b1-23a35778-6c26c2c4-ad6a42c2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:58.327043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0] Write session: try to update token
2025-10-10T14:35:58.327066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:58.334480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:58.334502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:58.334514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601823607876542:5426]
2025-10-10T14:35:58.334562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:58.334567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:58.334748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:58.334920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:58.335071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:58.335220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:58.335430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:58.335479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:58.343002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId: src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:58.345781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:58.346964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.346994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.347042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:58.347179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:58.355724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:58.355747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:58.355751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:58.355753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:58.355765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601823607876542:5426]
2025-10-10T14:35:58.355769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601823607876542:5426]
2025-10-10T14:35:58.355774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601823607876542:5426]
2025-10-10T14:35:58.355826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:58.355826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:58.355835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.355838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:58.355838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:58.355841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:58.355999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:58.398662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601824390105567:6939]
2025-10-10T14:35:58.398957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1858, pipe: [1:7559601824390105567:6939]
2025-10-10T14:35:58.477675Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:58.486287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.486326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.486517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.486585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.486659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.486731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.486785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.486797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.486871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.486943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.487011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.487090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.487147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.487161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.487231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.487294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.487364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.487433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.487479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.487487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.487562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.487631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.487696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.487766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.487814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.487821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.487891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.487955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.488022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.488093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.488139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.488147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.488217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.488283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.488352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.488422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.488472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.488480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.488550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.488614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.488686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.488755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.488803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.488811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.488882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.488948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.489019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.489091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.489137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.489144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.489216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.489280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.489370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.489452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.489496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.489505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.489575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.489639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.489708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.489778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.489828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.489836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.489901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105567:6939], now have 1 active actors on pipe
2025-10-10T14:35:58.490155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:58.490163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601824390105567:6939]
2025-10-10T14:35:58.490196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:58.490199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:58.490243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1859 reason: error at write: Disconnected sessionId: src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0
2025-10-10T14:35:58.490485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1859 sessionId: src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0 is DEAD
2025-10-10T14:35:58.490640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:58.490652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0] Write session will restart in 0.007351s
2025-10-10T14:35:58.490694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0] Write session: Do CDS request
2025-10-10T14:35:58.490700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:58.491158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:58.501871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.501943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:58.501961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1860
2025-10-10T14:35:58.502095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.502141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:58.502152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:58.502157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:58.502630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1860 sessionId:  describe result for acl check
2025-10-10T14:35:58.502668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:58.502672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:58.502674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:58.502681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601824390105624:6462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:58.503252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601824390105624:6462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:58.506970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601824390105624:6462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:58.508564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:58.510626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:58.510884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:58.510900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:58.510915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:58.510983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:58.511030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601823607876743:5425]
2025-10-10T14:35:58.511056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601824390105624:6462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:58.511072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601824390105624:6462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:58.511078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601824390105624:6462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:58.511089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:58.511690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:58.512037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:58.512101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:58.512487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:58.512548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.512554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.512555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.512556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.512557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.512558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.512559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.512560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.512561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.512563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.512564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.512565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.512566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.512572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.512586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.512590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.512593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.512597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.512601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.512605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.512608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.512612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.512617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.512620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.512624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.512628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.512637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.512645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.512651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.512658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.512663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.512669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.512673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.512678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.512684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.512694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.512708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.512719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.512723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.512728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.512737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.512742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.512746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.512756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.512760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.512766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.512787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.512792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.512797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.512802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.512808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.512813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.512862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:58.515415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:58.515735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:58.515748Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:58.515752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:58.515756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:58.515764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1859 [2:7559601823607876743:5425]
2025-10-10T14:35:58.515778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:58.515797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:58.515805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.515809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.515813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.515830Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:58.515842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:58.515851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:58.515910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.515921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.515923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.515926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:58.515994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:58.516004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.516015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.516025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.516042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:58.516072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105570:2438], now have 1 active actors on pipe
2025-10-10T14:35:58.516075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105756:6462], now have 1 active actors on pipe
2025-10-10T14:35:58.516083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601823607876738:5425]
2025-10-10T14:35:58.516085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601823607876738:5425]
2025-10-10T14:35:58.516087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601823607876738:5425]
2025-10-10T14:35:58.516100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:58.516113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:58.516117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:58.516117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:58.516119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:58.516133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:58.516136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:58.516163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601823607876738:5425]
2025-10-10T14:35:58.516150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1859
2025-10-10T14:35:58.516153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1859
2025-10-10T14:35:58.516189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:58.516200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:58.516227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.516239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.516277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e04ed253-15858fef-119d342b-c81e4e95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:58.516291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.516295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.516297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:58.516309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.516320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:58.516343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.516520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.516533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.516558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.516696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1860 partition: 0 MaxSeqNo: 40 sessionId: src_id|e04ed253-15858fef-119d342b-c81e4e95_0
2025-10-10T14:35:58.517104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|110b812b-273534bd-f8c25fe6-de25b6c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e04ed253-15858fef-119d342b-c81e4e95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:58.520035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04ed253-15858fef-119d342b-c81e4e95_0] Write session: try to update token
2025-10-10T14:35:58.520056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04ed253-15858fef-119d342b-c81e4e95_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:58.536793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId: src_id|e04ed253-15858fef-119d342b-c81e4e95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:58.539459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:58.540662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.540688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.540714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:58.540717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:58.540720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:58.540723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:58.540732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601823607876738:5425]
2025-10-10T14:35:58.540737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601823607876738:5425]
2025-10-10T14:35:58.540741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601823607876738:5425]
2025-10-10T14:35:58.540784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:58.540804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:58.540812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.540814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:58.540815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:58.540818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:58.540957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:58.590178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601824390105768:6939]
2025-10-10T14:35:58.590694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1859, pipe: [1:7559601824390105768:6939]
2025-10-10T14:35:58.658379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:58.658816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:58.658910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105768:6939], now have 1 active actors on pipe
2025-10-10T14:35:58.658994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:58.659106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:58.659114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:58.659114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601824390105768:6939]
2025-10-10T14:35:58.659136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:58.659211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1860 reason: error at write: Disconnected sessionId: src_id|e04ed253-15858fef-119d342b-c81e4e95_0
2025-10-10T14:35:58.659445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1860 sessionId: src_id|e04ed253-15858fef-119d342b-c81e4e95_0 is DEAD
2025-10-10T14:35:58.659535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04ed253-15858fef-119d342b-c81e4e95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:58.659546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04ed253-15858fef-119d342b-c81e4e95_0] Write session will restart in 0.007640s
2025-10-10T14:35:58.659573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04ed253-15858fef-119d342b-c81e4e95_0] Write session: Do CDS request
2025-10-10T14:35:58.659580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04ed253-15858fef-119d342b-c81e4e95_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:58.669003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e04ed253-15858fef-119d342b-c81e4e95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.670299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:58.670323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1861
2025-10-10T14:35:58.670489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.670533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:58.670549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:58.670553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:58.671199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1861 sessionId:  describe result for acl check
2025-10-10T14:35:58.671244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:58.671250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:58.671252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:58.671260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601824390105851:6457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:58.671827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601824390105851:6457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:58.674600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601824390105851:6457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:58.677546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601824390105851:6457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:58.677564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601824390105851:6457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:58.677568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601824390105851:6457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:58.677578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:58.678774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:58.683309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:58.683586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:58.683601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:58.683614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:58.683673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:58.683720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601823607876940:5419]
2025-10-10T14:35:58.684380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:58.685180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:58.685237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:58.685617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:58.685690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.685697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.685699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.685700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.685701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.685703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.685705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.685706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.685707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.685709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.685710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.685712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.685713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.685721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.685735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.685740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.685745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.685750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.685755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.685760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.685765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.685769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.685774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.685778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.685783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.685787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.685795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.685805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.685814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.685821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.685826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.685836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.685841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.685849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.685856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.685867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.685872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.685879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.685889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.685895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.685900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.685911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.685916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.685923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.685933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.685939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.685950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.685955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.685965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.685971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.685994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.686005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.686053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:58.689035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:58.689380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:58.689409Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:58.689412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:58.689416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:58.689423Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1860 [2:7559601823607876940:5419]
2025-10-10T14:35:58.689440Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:58.689459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:58.689467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.689472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.689474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.689492Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:58.689508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:58.689517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:58.689593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.689600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.689602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.689606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:58.689677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:58.689686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.689698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.689710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.689733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:58.689753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601823607876935:5419]
2025-10-10T14:35:58.689757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601823607876935:5419]
2025-10-10T14:35:58.689759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601823607876935:5419]
2025-10-10T14:35:58.689769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:58.689785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:58.689790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:58.689797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:58.689799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:58.689808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:58.689811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:58.689849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105770:2438], now have 1 active actors on pipe
2025-10-10T14:35:58.689852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105958:6457], now have 1 active actors on pipe
2025-10-10T14:35:58.689855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601823607876935:5419]
2025-10-10T14:35:58.689864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:58.689882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:58.689939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1860
2025-10-10T14:35:58.689947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1860
2025-10-10T14:35:58.690093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.690104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.690140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:58.690148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.690154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.690157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:58.690170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.690183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:58.690198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.690377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.690385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.690399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.690534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1861 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0
2025-10-10T14:35:58.690932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e04ed253-15858fef-119d342b-c81e4e95_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:58.693662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0] Write session: try to update token
2025-10-10T14:35:58.693683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:58.708224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:58.708247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:58.708260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601823607876935:5419]
2025-10-10T14:35:58.708318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:58.708332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:58.708495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:58.708638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:58.708776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:58.708913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:58.709121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:58.709165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:58.712230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId: src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:58.715199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:58.715447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.715475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.715530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:58.715626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:58.722631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:58.722659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:58.722663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:58.722665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:58.722677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601823607876935:5419]
2025-10-10T14:35:58.722682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601823607876935:5419]
2025-10-10T14:35:58.722685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601823607876935:5419]
2025-10-10T14:35:58.722734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:58.722733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:58.722747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.722751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:58.722764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:58.722779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:58.722884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:58.759110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601824390105980:6939]
2025-10-10T14:35:58.759402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1860, pipe: [1:7559601824390105980:6939]
2025-10-10T14:35:58.845094Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:58.853675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.853708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.853886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.853948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.854012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.854082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.854132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.854137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.854207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.854265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.854322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.854384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.854536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.854540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.854604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.854663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.854720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.854780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.854819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.854822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.854891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.854950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.855010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.855071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.855202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.855206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.855272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.855326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.855383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.855444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.855483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.855486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.855557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.855614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.855676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.855737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.855776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.855778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.855845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.855904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.855963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.856025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.856066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.856069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.856135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.856191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.856251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.856309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.856418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.856422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.856488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.856551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.856614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.856676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.856715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.856718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.856789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:58.856846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:58.856909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:58.856968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:58.857008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:58.857012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:58.857087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105980:6939], now have 1 active actors on pipe
2025-10-10T14:35:58.857430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:58.857484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601824390105980:6939]
2025-10-10T14:35:58.857489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:58.857492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:58.857525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1861 reason: error at write: Disconnected sessionId: src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0
2025-10-10T14:35:58.857727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1861 sessionId: src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0 is DEAD
2025-10-10T14:35:58.858098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:58.858106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0] Write session will restart in 0.006970s
2025-10-10T14:35:58.858132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0] Write session: Do CDS request
2025-10-10T14:35:58.858139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:58.858477Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:58.866021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.866125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:58.866143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1862
2025-10-10T14:35:58.866473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:58.866516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:58.866527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:58.866531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:58.867062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1862 sessionId:  describe result for acl check
2025-10-10T14:35:58.867100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:58.867102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:58.867104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:58.867111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601824390106002:6452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:58.867724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601824390106002:6452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:58.870470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601824390106002:6452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:58.873017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601824390106002:6452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:58.873030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601824390106002:6452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:58.873035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601824390106002:6452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:58.873044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:58.891480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:58.893577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:58.893851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:58.893865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:58.893879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:58.893944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:58.893990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601823607877151:5416]
2025-10-10T14:35:58.894626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:58.894956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:58.895008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:58.895347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:58.895429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.895435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.895436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.895438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.895439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.895441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.895442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.895444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.895445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.895447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.895448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.895450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.895451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.895458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.895471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.895475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.895479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.895483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.895486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.895490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.895494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.895498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.895502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.895506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.895509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.895513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.895522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.895530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:58.895537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.895543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:58.895548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.895554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:58.895566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.895572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:58.895577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.895582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:58.895593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.895599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:58.895608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.895613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:58.895618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.895624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:58.895634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.895640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:58.895648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.895655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:58.895665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.895670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.895674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.895679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.895684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.895689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.895734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:58.898349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:58.898799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:58.898813Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:58.898816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:58.898820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:58.898827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1861 [2:7559601823607877151:5416]
2025-10-10T14:35:58.898841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:58.898859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:58.898865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.898867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.898869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.898884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:58.898893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:58.898900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:58.898961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.898968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.898971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.898974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:58.899043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:58.899051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.899064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:58.899076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:58.899099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:58.899126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390105995:2438], now have 1 active actors on pipe
2025-10-10T14:35:58.899134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390106038:6452], now have 1 active actors on pipe
2025-10-10T14:35:58.899142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601823607877146:5416]
2025-10-10T14:35:58.899145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601823607877146:5416]
2025-10-10T14:35:58.899147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601823607877146:5416]
2025-10-10T14:35:58.899160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:58.899174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:58.899179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:58.899184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:58.899187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:58.899195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:58.899199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:58.899225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601823607877146:5416]
2025-10-10T14:35:58.899235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:58.899248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:58.899377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1861
2025-10-10T14:35:58.899426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1861
2025-10-10T14:35:58.899688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.899700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.899747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:58.899756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:58.899760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:58.899764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:58.899779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:58.899792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:58.899809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.899987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:58.900000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:58.900024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:58.900146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1862 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0
2025-10-10T14:35:58.900540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11ddc3-16eaeee6-80cf0632-5f6be269_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:58.903358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0] Write session: try to update token
2025-10-10T14:35:58.903380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:58.920732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:58.920759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:58.920763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:58.920765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:58.920775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601823607877146:5416]
2025-10-10T14:35:58.920781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601823607877146:5416]
2025-10-10T14:35:58.920784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601823607877146:5416]
2025-10-10T14:35:58.920836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:58.920847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:58.920849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:58.921005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:58.921034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:58.921041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:58.921046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:58.921582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId: src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:58.924269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:58.957799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601824390106195:6939]
2025-10-10T14:35:58.958110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1861, pipe: [1:7559601824390106195:6939]
2025-10-10T14:35:59.038325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:59.038393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601824390106195:6939]
2025-10-10T14:35:59.038412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:59.038415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:59.038474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1862 reason: error at write: Disconnected sessionId: src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0
2025-10-10T14:35:59.038676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1862 sessionId: src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0 is DEAD
2025-10-10T14:35:59.037663Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:59.038037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.038046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.038083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601824390106195:6939], now have 1 active actors on pipe
2025-10-10T14:35:59.038838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:59.039504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:59.039515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0] Write session will restart in 0.008338s
2025-10-10T14:35:59.039541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0] Write session: Do CDS request
2025-10-10T14:35:59.039548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:59.048796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.049021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:59.049035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1863
2025-10-10T14:35:59.049210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.049243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:59.049248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:59.049252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:59.050037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1863 sessionId:  describe result for acl check
2025-10-10T14:35:59.050076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:59.050082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:59.050084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:59.050091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601828685073555:6447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:59.050651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601828685073555:6447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:59.054571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601828685073555:6447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:59.057980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:59.058026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601828685073555:6447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:59.058042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601828685073555:6447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:59.058046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601828685073555:6447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:59.058054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:59.060382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:59.060645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:59.060656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:59.060668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:59.060729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:59.060771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601827902844658:5399]
2025-10-10T14:35:59.061369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:59.061837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:59.061886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:59.062216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:59.062276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.062282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.062283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.062285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.062286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.062287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.062288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.062289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.062291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.062292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.062293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.062294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.062295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.062301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.062323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.062327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.062331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.062335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.062340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.062344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.062348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.062352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.062356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.062360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.062364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.062368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.062375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.062383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.062390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.062402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.062406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.062412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.062417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.062422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.062427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.062437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.062441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.062447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.062457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.062462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.062467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.062472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.062476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.062482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.062486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.062492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.062496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.062502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.062506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.062512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.062516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.062521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.062561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:59.065079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:59.065714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:59.065731Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:59.065733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:59.065737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:59.065743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1862 [2:7559601827902844658:5399]
2025-10-10T14:35:59.065757Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:59.065775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:59.065783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.065787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.065789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.065808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:59.065816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:59.065830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:59.065892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.065900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.065901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.065904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:59.065975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:59.065985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.065999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.066011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.066029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:59.066056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685073691:6447], now have 1 active actors on pipe
2025-10-10T14:35:59.066064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685073494:2438], now have 1 active actors on pipe
2025-10-10T14:35:59.066072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601827902844652:5399]
2025-10-10T14:35:59.066075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601827902844652:5399]
2025-10-10T14:35:59.066077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601827902844652:5399]
2025-10-10T14:35:59.066091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:59.066099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1862
2025-10-10T14:35:59.066109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:59.066131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1862
2025-10-10T14:35:59.066111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:59.066115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:59.066117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:59.066130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:59.066133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:59.066175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.066180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.066196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601827902844652:5399]
2025-10-10T14:35:59.066209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:59.066222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:59.066251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|394924e4-c7f9ae73-159a56b8-5befee43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:59.066265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.066274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.066276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:59.066287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.066303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:59.066339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.066510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.066521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.066539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.066639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1863 partition: 0 MaxSeqNo: 40 sessionId: src_id|394924e4-c7f9ae73-159a56b8-5befee43_0
2025-10-10T14:35:59.067053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb889ba9-4232e4b3-3211b6c0-b936fdbc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|394924e4-c7f9ae73-159a56b8-5befee43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:59.069987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394924e4-c7f9ae73-159a56b8-5befee43_0] Write session: try to update token
2025-10-10T14:35:59.070004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394924e4-c7f9ae73-159a56b8-5befee43_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:59.089154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:59.089179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:59.089182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:59.089184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:59.089193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601827902844652:5399]
2025-10-10T14:35:59.089196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601827902844652:5399]
2025-10-10T14:35:59.089200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601827902844652:5399]
2025-10-10T14:35:59.089248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:59.089247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:59.089253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:59.089255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.089257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:59.089257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:59.089443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:59.089307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId: src_id|394924e4-c7f9ae73-159a56b8-5befee43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:59.092180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:59.138509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601828685073719:6939]
2025-10-10T14:35:59.138803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1862, pipe: [1:7559601828685073719:6939]
2025-10-10T14:35:59.207585Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:59.207849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.207865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.207907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685073719:6939], now have 1 active actors on pipe
2025-10-10T14:35:59.208174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:59.208637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601828685073719:6939]
2025-10-10T14:35:59.208677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:59.208750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1863 reason: status is not ok: tablet will be restarted right now sessionId: src_id|394924e4-c7f9ae73-159a56b8-5befee43_0
2025-10-10T14:35:59.208949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1863 sessionId: src_id|394924e4-c7f9ae73-159a56b8-5befee43_0 is DEAD
2025-10-10T14:35:59.209116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:59.209163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394924e4-c7f9ae73-159a56b8-5befee43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:35:59.209176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394924e4-c7f9ae73-159a56b8-5befee43_0] Write session will restart in 0.005816s
2025-10-10T14:35:59.209202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394924e4-c7f9ae73-159a56b8-5befee43_0] Write session: Do CDS request
2025-10-10T14:35:59.209207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394924e4-c7f9ae73-159a56b8-5befee43_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:59.215881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394924e4-c7f9ae73-159a56b8-5befee43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.216012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:59.216026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1864
2025-10-10T14:35:59.216189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.216236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:59.216247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:59.216251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:59.216719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1864 sessionId:  describe result for acl check
2025-10-10T14:35:59.216756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:59.216764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:59.216766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:59.216773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601828685073744:6425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:59.217366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601828685073744:6425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:59.220380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601828685073744:6425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:59.223067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601828685073744:6425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:59.223081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601828685073744:6425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:59.223084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601828685073744:6425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:59.223092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:59.223292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:59.225452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:59.225799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:59.225810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:59.225824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:59.225904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:59.225950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601827902844882:5387]
2025-10-10T14:35:59.226585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:59.226991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:59.227048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:59.227422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:59.227472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.227478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.227479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.227480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.227482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.227483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.227485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.227486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.227487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.227489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.227490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.227491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.227493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.227499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.227512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.227516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.227520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.227524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.227528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.227532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.227536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.227540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.227544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.227548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.227561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.227565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.227573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.227581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.227588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.227594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.227600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.227610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.227614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.227620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.227629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.227634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.227643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.227649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.227653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.227659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.227663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.227669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.227673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.227678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.227687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.227692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.227697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.227702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.227706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.227717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.227722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.227727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.227772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:59.230204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:59.230526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:59.230537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:59.230539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:59.230542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:59.230547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1863 [2:7559601827902844882:5387]
2025-10-10T14:35:59.230557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:59.230572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:59.230574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.230576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.230578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.230592Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:59.230597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:59.230610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:59.230673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.230677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.230679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.230682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:59.230748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:59.230755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.230766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.230777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.230797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:59.230824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685073910:6425], now have 1 active actors on pipe
2025-10-10T14:35:59.230832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685073721:2438], now have 1 active actors on pipe
2025-10-10T14:35:59.230839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601827902844876:5387]
2025-10-10T14:35:59.230842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601827902844876:5387]
2025-10-10T14:35:59.230844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601827902844876:5387]
2025-10-10T14:35:59.230860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:59.230874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:59.230880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:59.230883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:59.230886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:59.230896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:59.230916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1863
2025-10-10T14:35:59.230899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:59.230938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601827902844876:5387]
2025-10-10T14:35:59.230916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1863
2025-10-10T14:35:59.230947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:59.230989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:59.231279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.231295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.231348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5b59639-da783586-28009a3a-d0fb140e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:59.231363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.231372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.231375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:59.231387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.231405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:59.231428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.231607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.231619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.231642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.231751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1864 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5b59639-da783586-28009a3a-d0fb140e_0
2025-10-10T14:35:59.232150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394924e4-c7f9ae73-159a56b8-5befee43_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5b59639-da783586-28009a3a-d0fb140e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:59.234914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b59639-da783586-28009a3a-d0fb140e_0] Write session: try to update token
2025-10-10T14:35:59.234936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b59639-da783586-28009a3a-d0fb140e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:59.243573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:59.243598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:59.243611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601827902844876:5387]
2025-10-10T14:35:59.243662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:59.243668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:59.243856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:59.244014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.244155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.244308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.244519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:59.244570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:59.249734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId: src_id|c5b59639-da783586-28009a3a-d0fb140e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:59.252426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:59.252772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.252797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.252850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:59.252965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:59.262894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:59.262916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:59.262920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:59.262922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:59.262938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601827902844876:5387]
2025-10-10T14:35:59.262942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601827902844876:5387]
2025-10-10T14:35:59.262946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601827902844876:5387]
2025-10-10T14:35:59.262997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:59.263002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:59.263009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.263011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:59.263012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:59.263015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:59.263146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:59.309033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601828685073922:6939]
2025-10-10T14:35:59.309378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1863, pipe: [1:7559601828685073922:6939]
2025-10-10T14:35:59.382785Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:59.391280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.391311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.391494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.391555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.391630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.391688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.391733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.391738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.391806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.391865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.391924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.391982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.392022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.392025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.392092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.392150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.392210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.392266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.392303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.392306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.392369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.392427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.392486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.392544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.392582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.392585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.392649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.392704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.392761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.392816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.392855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.392860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.392924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.392975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.393029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.393084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.393123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.393125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.393191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.393244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.393303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.393561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.393612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.393620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.393684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.393746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.393809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.393873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.393923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.393930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.393992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.394056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.394119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.394186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.394231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.394238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.394306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.394364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.394425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.394489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.394531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.394539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.394597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685073922:6939], now have 1 active actors on pipe
2025-10-10T14:35:59.394826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601828685073922:6939]
2025-10-10T14:35:59.394856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:59.394861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:59.394865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:59.394898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1864 reason: error at write: Disconnected sessionId: src_id|c5b59639-da783586-28009a3a-d0fb140e_0
2025-10-10T14:35:59.395128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1864 sessionId: src_id|c5b59639-da783586-28009a3a-d0fb140e_0 is DEAD
2025-10-10T14:35:59.395263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b59639-da783586-28009a3a-d0fb140e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:59.395271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b59639-da783586-28009a3a-d0fb140e_0] Write session will restart in 0.009660s
2025-10-10T14:35:59.395304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b59639-da783586-28009a3a-d0fb140e_0] Write session: Do CDS request
2025-10-10T14:35:59.395309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b59639-da783586-28009a3a-d0fb140e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:59.395621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:59.405949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b59639-da783586-28009a3a-d0fb140e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.409726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:59.409741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1865
2025-10-10T14:35:59.409965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.410010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:59.410020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:59.410024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:59.410487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1865 sessionId:  describe result for acl check
2025-10-10T14:35:59.410528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:59.410534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:59.410535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:59.410542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601828685074095:6420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:59.411087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601828685074095:6420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:59.412996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:59.413578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:59.413814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:59.413831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:59.413845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:59.413908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:59.413960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601827902845081:5391]
2025-10-10T14:35:59.414330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601828685074095:6420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:59.414515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:59.414842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:59.414889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:59.415188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:59.415254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.415261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.415262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.415263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.415264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.415265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.415266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.415267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.415269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.415270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.415271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.415272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.415273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.415280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.415294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.415297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.415301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.415304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.415308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.415311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.415314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.415317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.415321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.415325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.415328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.415332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.415339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.415349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.415357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.415362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.415366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.415371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.415375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.415380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.415385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.415389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.415393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.415398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.415402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.415407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.415410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.415415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.415419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.415423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.415428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.415432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.415438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.415442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.415446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.415450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.415455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.415459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.415492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:59.417930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601828685074095:6420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:59.417944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601828685074095:6420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:59.417948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601828685074095:6420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:59.417957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:59.418850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1864
2025-10-10T14:35:59.418855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1864
2025-10-10T14:35:59.418011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:59.418495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:59.418499Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:59.418501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:59.418504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:59.418510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1864 [2:7559601827902845081:5391]
2025-10-10T14:35:59.418522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:59.418539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:59.418542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.418545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.418547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.418564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:59.418587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:59.418595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:59.418658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.418660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.418662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.418664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:59.418733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:59.418735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.418745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.418755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.418769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:59.418791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074130:6420], now have 1 active actors on pipe
2025-10-10T14:35:59.418795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685073925:2438], now have 1 active actors on pipe
2025-10-10T14:35:59.418802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601827902845076:5391]
2025-10-10T14:35:59.418804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601827902845076:5391]
2025-10-10T14:35:59.418806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601827902845076:5391]
2025-10-10T14:35:59.418821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:59.418836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:59.418837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:59.418840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:59.418842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:59.418851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:59.418854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:59.418878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601827902845076:5391]
2025-10-10T14:35:59.418881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:59.418892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:59.418910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.418915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.418951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94e8f729-84e35782-49395992-1a749aed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:59.418958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.418962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.418964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:59.418975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.418985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:59.419000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.419138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.419144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.419167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.419264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1865 partition: 0 MaxSeqNo: 40 sessionId: src_id|94e8f729-84e35782-49395992-1a749aed_0
2025-10-10T14:35:59.419651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b59639-da783586-28009a3a-d0fb140e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94e8f729-84e35782-49395992-1a749aed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:59.422610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e8f729-84e35782-49395992-1a749aed_0] Write session: try to update token
2025-10-10T14:35:59.422628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e8f729-84e35782-49395992-1a749aed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:59.439946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:59.439967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:59.439970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:59.439972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:59.439984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601827902845076:5391]
2025-10-10T14:35:59.439989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601827902845076:5391]
2025-10-10T14:35:59.439998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601827902845076:5391]
2025-10-10T14:35:59.440054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:59.440062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.440064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:59.440073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:59.440081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:59.440086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:59.440214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:59.443362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId: src_id|94e8f729-84e35782-49395992-1a749aed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:59.446432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:59.494869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601828685074138:6939]
2025-10-10T14:35:59.495659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1864, pipe: [1:7559601828685074138:6939]
2025-10-10T14:35:59.561921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:59.562392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.562402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.562450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074138:6939], now have 1 active actors on pipe
2025-10-10T14:35:59.563407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e8f729-84e35782-49395992-1a749aed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:59.562935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:59.563422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e8f729-84e35782-49395992-1a749aed_0] Write session will restart in 0.007249s
2025-10-10T14:35:59.562946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:59.563028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1865 reason: error at write: Disconnected sessionId: src_id|94e8f729-84e35782-49395992-1a749aed_0
2025-10-10T14:35:59.563220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:59.563234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1865 sessionId: src_id|94e8f729-84e35782-49395992-1a749aed_0 is DEAD
2025-10-10T14:35:59.563262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601828685074138:6939]
2025-10-10T14:35:59.563449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e8f729-84e35782-49395992-1a749aed_0] Write session: Do CDS request
2025-10-10T14:35:59.563456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e8f729-84e35782-49395992-1a749aed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:59.563547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:59.571914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e8f729-84e35782-49395992-1a749aed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.574106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:59.574120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1866
2025-10-10T14:35:59.574433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.574483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:59.574489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:59.574503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:59.574995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1866 sessionId:  describe result for acl check
2025-10-10T14:35:59.575026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:59.575028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:59.575030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:59.575036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601828685074153:6414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:59.575652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601828685074153:6414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:59.579313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601828685074153:6414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:59.582770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601828685074153:6414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:59.582789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601828685074153:6414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:59.582793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601828685074153:6414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:59.582802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:59.597725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:59.600189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:59.600436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:59.600446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:59.600459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:59.600535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:59.600576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601827902845283:5389]
2025-10-10T14:35:59.601250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:59.601690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:59.601739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:59.602072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:59.602133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.602143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.602144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.602145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.602146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.602148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.602149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.602150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.602152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.602153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.602154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.602155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.602156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.602163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.602176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.602181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.602185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.602189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.602194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.602198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.602202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.602206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.602211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.602215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.602218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.602222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.602231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.602240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.602246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.602252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.602256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.602262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.602266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.602272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.602277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.602282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.602287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.602292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.602297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.602303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.602307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.602313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.602317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.602322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.602327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.602333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.602341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.602352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.602356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.602362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.602366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.602376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.602414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:59.604934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:59.605252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:59.605266Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:59.605268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:59.605272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:59.605279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1865 [2:7559601827902845283:5389]
2025-10-10T14:35:59.605292Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:59.605310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:59.605318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.605321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.605324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.605375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:59.605388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:59.605400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:59.605465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.605472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.605473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.605476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:59.605555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:59.605562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.605572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.605587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.605604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:59.605715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1865
2025-10-10T14:35:59.605726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1865
2025-10-10T14:35:59.605639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074139:2438], now have 1 active actors on pipe
2025-10-10T14:35:59.605646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074184:6414], now have 1 active actors on pipe
2025-10-10T14:35:59.605655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601827902845278:5389]
2025-10-10T14:35:59.605657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601827902845278:5389]
2025-10-10T14:35:59.605659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601827902845278:5389]
2025-10-10T14:35:59.605680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:59.605694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:59.605709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:59.605712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:59.605738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601827902845278:5389]
2025-10-10T14:35:59.605741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:59.605758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:59.605762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:59.605764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:59.605777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:59.605835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.605842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.605875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:59.605885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.605890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.605892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:59.605906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.605927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:59.605939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.606490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.606500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.606520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.606694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1866 partition: 0 MaxSeqNo: 40 sessionId: src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0
2025-10-10T14:35:59.608086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e8f729-84e35782-49395992-1a749aed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:59.610775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0] Write session: try to update token
2025-10-10T14:35:59.610794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:59.624498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:59.624515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:59.624528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601827902845278:5389]
2025-10-10T14:35:59.624587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:59.624592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:59.624779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:59.624937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.625087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.625222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.625784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:59.625847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:59.633511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId: src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:59.636164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:59.637972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.638008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.638036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:59.638040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:59.638044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:59.638047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:59.638058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601827902845278:5389]
2025-10-10T14:35:59.638063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601827902845278:5389]
2025-10-10T14:35:59.638067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601827902845278:5389]
2025-10-10T14:35:59.638110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:59.638121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:59.638124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:59.638136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:59.638146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.638148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:59.638308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:59.665670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601828685074344:6939]
2025-10-10T14:35:59.666577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1865, pipe: [1:7559601828685074344:6939]
2025-10-10T14:35:59.768622Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:59.769235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:59.769277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074344:6939], now have 1 active actors on pipe
2025-10-10T14:35:59.769516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:59.769631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:59.769635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:59.769730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1866 reason: error at write: Disconnected sessionId: src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0
2025-10-10T14:35:59.769870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601828685074344:6939]
2025-10-10T14:35:59.770064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:59.770080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0] Write session will restart in 0.005050s
2025-10-10T14:35:59.770115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0] Write session: Do CDS request
2025-10-10T14:35:59.770122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:59.769887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:59.769888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1866 sessionId: src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0 is DEAD
2025-10-10T14:35:59.776912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.777454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:59.777467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1867
2025-10-10T14:35:59.777980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.778018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:59.778024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:59.778028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:59.778532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1867 sessionId:  describe result for acl check
2025-10-10T14:35:59.778569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:59.778575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:59.778578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:59.778584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601828685074378:6405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:59.779152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601828685074378:6405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:59.782190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601828685074378:6405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:59.788618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:59.788909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601828685074378:6405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:59.788926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601828685074378:6405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:59.788930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601828685074378:6405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:59.788939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:59.790744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:59.790998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:59.791011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:59.791025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:59.791094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:59.791148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601827902845485:5381]
2025-10-10T14:35:59.791792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:59.792179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:59.792228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:59.792570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:59.792632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.792633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.792634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.792636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.792637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.792638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.792640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.792642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.792643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.792644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.792646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.792647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.792648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.792655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.792673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.792678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.792682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.792687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.792692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.792696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.792700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.792705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.792709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.792714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.792718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.792722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.792731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.792741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.792748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.792755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.792760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.792766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.792771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.792777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.792782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.792789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.792794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.792800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.792805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.792811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.792816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.792822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.792827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.792832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.792838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.792845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.792856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.792862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.792878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.792889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.792894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.792900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.792943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:59.795544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:59.796133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:59.796147Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:59.796149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:59.796153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:59.796159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1866 [2:7559601827902845485:5381]
2025-10-10T14:35:59.796172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:59.796195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:59.796198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.796202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.796205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.796221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:59.796234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:59.796247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:59.796310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.796318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.796320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.796323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:59.796404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:59.796414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.796427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.796440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.796460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:59.796487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074550:6405], now have 1 active actors on pipe
2025-10-10T14:35:59.796495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074356:2438], now have 1 active actors on pipe
2025-10-10T14:35:59.796503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601827902845479:5381]
2025-10-10T14:35:59.796506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601827902845479:5381]
2025-10-10T14:35:59.796509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601827902845479:5381]
2025-10-10T14:35:59.796522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:59.796543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:59.796547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:59.796550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:59.796552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:59.796569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:59.796572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:59.796596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601827902845479:5381]
2025-10-10T14:35:59.796608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:59.796620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:59.796644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.796654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.796683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:59.796694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.796699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.796702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:59.796714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.796598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1866
2025-10-10T14:35:59.796634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1866
2025-10-10T14:35:59.796729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:59.796750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.796865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.796869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.796885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.796980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1867 partition: 0 MaxSeqNo: 40 sessionId: src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0
2025-10-10T14:35:59.797458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe4837c-9f5229eb-448db44c-7fb341c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:59.800320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0] Write session: try to update token
2025-10-10T14:35:59.800341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:35:59.808536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:35:59.808559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:59.808570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601827902845479:5381]
2025-10-10T14:35:59.808628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:35:59.808627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:35:59.808811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:35:59.808961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.809108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.809254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:35:59.809495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:35:59.809537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:35:59.815408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId: src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:35:59.818049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:35:59.818294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.818315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.818363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:35:59.818471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:35:59.826690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:35:59.826709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:35:59.826713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:35:59.826715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:35:59.826725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601827902845479:5381]
2025-10-10T14:35:59.826730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601827902845479:5381]
2025-10-10T14:35:59.826738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601827902845479:5381]
2025-10-10T14:35:59.826786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:35:59.826788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:35:59.826795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:35:59.826798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.826800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:35:59.826801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:35:59.826932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:35:59.870180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601828685074574:6939]
2025-10-10T14:35:59.870553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1866, pipe: [1:7559601828685074574:6939]
2025-10-10T14:35:59.948999Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:35:59.958562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.958584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.958768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.958826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.958886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.958944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.958985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.958991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.959060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.959117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.959179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.959246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.959286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.959290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.959356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.959414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.959472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.959531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.959574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.959578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.959645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.959703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.959762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.959820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.959862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.959868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.959937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.959993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.960054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.960113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.960154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.960157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.960223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.960277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.960337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.960395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.960437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.960440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.960507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.960564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.960652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.960718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.960758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.960761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.960828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.960889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.960950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.961012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.961056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.961059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.961129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.961186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.961243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.961300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.961645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.961658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.963175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:35:59.963198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0] Write session will restart in 0.006562s
2025-10-10T14:35:59.963224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0] Write session: Do CDS request
2025-10-10T14:35:59.963231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:35:59.962760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:35:59.962776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:35:59.962814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1867 reason: error at write: Disconnected sessionId: src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0
2025-10-10T14:35:59.963086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1867 sessionId: src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0 is DEAD
2025-10-10T14:35:59.963317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:35:59.963364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601828685074574:6939]
2025-10-10T14:35:59.961731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:35:59.961797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:35:59.961864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:35:59.961929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:35:59.961968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:35:59.961972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:35:59.962037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074574:6939], now have 1 active actors on pipe
2025-10-10T14:35:59.963201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:35:59.970909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.971013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:35:59.971026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1868
2025-10-10T14:35:59.971159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:35:59.971203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:35:59.971214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:35:59.971220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:35:59.971695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1868 sessionId:  describe result for acl check
2025-10-10T14:35:59.971731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:35:59.971737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:35:59.971739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:35:59.971745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601828685074594:6399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:35:59.972273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601828685074594:6399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:35:59.977151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601828685074594:6399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:35:59.982093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601828685074594:6399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:35:59.982109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601828685074594:6399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:35:59.982112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601828685074594:6399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:35:59.982123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:35:59.986627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:35:59.988868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:35:59.989123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:35:59.989135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:35:59.989149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:35:59.989221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:35:59.989268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601827902845703:5374]
2025-10-10T14:35:59.989915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:35:59.990240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:35:59.990290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:35:59.990595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:35:59.990649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.990650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.990651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.990652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.990652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.990653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.990654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.990654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.990655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.990656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.990656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.990657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.990658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.990662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.990671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.990674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.990676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.990679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.990681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.990684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.990686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.990688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.990691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.990693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.990696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.990698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.990704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.990710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:35:59.990715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.990719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:35:59.990721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.990725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:35:59.990727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.990731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:35:59.990736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.990742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:35:59.990746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.990750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:35:59.990755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.990761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:35:59.990765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.990771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:35:59.990775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.990781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:35:59.990785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.990788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:35:59.990791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.990794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.990799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.990802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.990805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.990808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.990830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:35:59.993324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:35:59.993663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:35:59.993673Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:35:59.993676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:35:59.993680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:35:59.993686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1867 [2:7559601827902845703:5374]
2025-10-10T14:35:59.993698Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:35:59.993717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:35:59.993725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.993729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.993732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.993749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:35:59.993762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:35:59.993770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:35:59.993831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.993842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.993844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.993847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:35:59.993917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:35:59.993926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:35:59.993937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:35:59.993949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:35:59.993965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:35:59.993992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074721:6399], now have 1 active actors on pipe
2025-10-10T14:35:59.994000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601828685074579:2438], now have 1 active actors on pipe
2025-10-10T14:35:59.994007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601827902845698:5374]
2025-10-10T14:35:59.994009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601827902845698:5374]
2025-10-10T14:35:59.994011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601827902845698:5374]
2025-10-10T14:35:59.994025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:35:59.994044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:35:59.994043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:35:59.994055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:35:59.994057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:35:59.994064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:35:59.994067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:35:59.994062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1867
2025-10-10T14:35:59.994080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1867
2025-10-10T14:35:59.994101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601827902845698:5374]
2025-10-10T14:35:59.994109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:35:59.994111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:35:59.994128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.994133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.994179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:35:59.994195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:35:59.994198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:35:59.994201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:35:59.994211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:35:59.994223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:35:59.994240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.994374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:35:59.994383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:35:59.994398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:35:59.994468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1868 partition: 0 MaxSeqNo: 40 sessionId: src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0
2025-10-10T14:35:59.994828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac2fb-440a8a39-ab8d867e-ef2ed3b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:35:59.997663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0] Write session: try to update token
2025-10-10T14:35:59.997685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:00.012257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId: src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:00.015389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:00.016502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.016524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.016578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:00.016671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:00.018561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:00.018575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:00.018579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:00.018581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:00.018590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601827902845698:5374]
2025-10-10T14:36:00.018595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601827902845698:5374]
2025-10-10T14:36:00.018599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601827902845698:5374]
2025-10-10T14:36:00.018648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:00.018648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:00.018655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.018655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:00.018658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:00.018660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:00.018814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:00.063681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601832980042079:6939]
2025-10-10T14:36:00.065764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1867, pipe: [1:7559601832980042079:6939]
2025-10-10T14:36:00.132489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:36:00.132512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-10T14:36:00.138723Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:00.148366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.148400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.148592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.148662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.148732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.148805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.148860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.148873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.148947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.149020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.149089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.149159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.149206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.149215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.149290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.149492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.149567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.149645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.149697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.149705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.149789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.149855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.149928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.149999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.150054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.150062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.150136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.150205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.150279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.150355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.150403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.150411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.150488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.150561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.150633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.150701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.150823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.150831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.150899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.150957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.151020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.151098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.151150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.151159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.151236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.151305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.151381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.151455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.151512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.151520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.151591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.152932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:00.152945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0] Write session will restart in 0.006519s
2025-10-10T14:36:00.152972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0] Write session: Do CDS request
2025-10-10T14:36:00.152978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:00.152525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:00.152538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:00.152571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1868 reason: error at write: Disconnected sessionId: src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0
2025-10-10T14:36:00.152779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1868 sessionId: src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0 is DEAD
2025-10-10T14:36:00.152967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:00.152977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-10T14:36:00.153014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601832980042079:6939]
2025-10-10T14:36:00.151661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.151743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.151809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.151854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.151857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.151932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.151999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.152064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.152128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.152172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.152175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.152256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042079:6939], now have 1 active actors on pipe
2025-10-10T14:36:00.153822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:00.160944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.160997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:00.161012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1869
2025-10-10T14:36:00.161183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.161219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:00.161231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:00.161235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:00.161760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1869 sessionId:  describe result for acl check
2025-10-10T14:36:00.161807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:00.161812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:00.161813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:00.161819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601832980042134:6379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:00.162421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601832980042134:6379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:00.164856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601832980042134:6379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:00.168386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601832980042134:6379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:00.168401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601832980042134:6379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:00.168406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601832980042134:6379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:00.168414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:00.170011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:00.171991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:00.172207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:00.172221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:00.172234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:00.172294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:00.172341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601832197813242:5347]
2025-10-10T14:36:00.173010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:00.173305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:00.173379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:00.173728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:00.173790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.173797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.173798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.173800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.173801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.173803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.173804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.173806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.173808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.173809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.173811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.173812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.173813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.173818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.173833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.173838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.173843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.173847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.173852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.173856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.173860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.173865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.173869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.173874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.173878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.173883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.173891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.173900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.173911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.173917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.173924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.173930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.173936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.173942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.173949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.173953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.173957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.173962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.173966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.173970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.173974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.173979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.173982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.173987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.173993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.174002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.174007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.174011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.174015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.174019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.174023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.174027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.174062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:00.176642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:00.177013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:00.177025Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:00.177028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:00.177033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:00.177039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1868 [2:7559601832197813242:5347]
2025-10-10T14:36:00.177054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:00.177074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:00.177084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.177088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.177091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.177108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:00.177116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:00.177124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:00.177187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.177194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.177196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.177199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:00.177267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:00.177274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.177287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.177304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.177326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:00.177386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042301:6379], now have 1 active actors on pipe
2025-10-10T14:36:00.177389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042100:2438], now have 1 active actors on pipe
2025-10-10T14:36:00.177397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601832197813236:5347]
2025-10-10T14:36:00.177400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601832197813236:5347]
2025-10-10T14:36:00.177403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601832197813236:5347]
2025-10-10T14:36:00.177421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:00.177442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:00.177441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:00.177445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:00.177447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:00.177465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:00.177468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:00.177441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1868
2025-10-10T14:36:00.177516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601832197813236:5347]
2025-10-10T14:36:00.177531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:00.177547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:00.177597Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:36:00.177649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1868
2025-10-10T14:36:00.177719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.177728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.177760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:00.177773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.177781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.177788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:00.177802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.177818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:00.177838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.177842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 12 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:36:00.177885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:36:00.177985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.177997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.178014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.178102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1869 partition: 0 MaxSeqNo: 40 sessionId: src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0
2025-10-10T14:36:00.178512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfebae24-f05209ef-ca6ce4fa-b80416ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:00.181543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0] Write session: try to update token
2025-10-10T14:36:00.181561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:00.196402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId: src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:00.198566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:00.198583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:00.198587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:00.198589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:00.198599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601832197813236:5347]
2025-10-10T14:36:00.198603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601832197813236:5347]
2025-10-10T14:36:00.198607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601832197813236:5347]
2025-10-10T14:36:00.198656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:00.198659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:00.198667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.198669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:00.198670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:00.198674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:00.198815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:00.199178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:00.253160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601832980042318:6939]
2025-10-10T14:36:00.253511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1868, pipe: [1:7559601832980042318:6939]
2025-10-10T14:36:00.315945Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:00.316479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.316499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.316553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042318:6939], now have 1 active actors on pipe
2025-10-10T14:36:00.316782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601832980042318:6939]
2025-10-10T14:36:00.316814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:00.316817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:00.316815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:00.316879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1869 reason: error at write: Disconnected sessionId: src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0
2025-10-10T14:36:00.317110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1869 sessionId: src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0 is DEAD
2025-10-10T14:36:00.317276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:00.317292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-10T14:36:00.317511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:00.317524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0] Write session will restart in 0.006084s
2025-10-10T14:36:00.317565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0] Write session: Do CDS request
2025-10-10T14:36:00.317571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:00.324952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.325476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:00.325491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1870
2025-10-10T14:36:00.326120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.326159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:00.326166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:00.326170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:00.326745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1870 sessionId:  describe result for acl check
2025-10-10T14:36:00.326781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:00.326783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:00.326785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:00.326791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601832980042357:6376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:00.327313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601832980042357:6376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:00.330071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601832980042357:6376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:00.333545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601832980042357:6376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:00.333560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601832980042357:6376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:00.333564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601832980042357:6376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:00.333574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:00.335414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:00.338032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:00.338282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:00.338293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:00.338305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:00.338366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:00.338415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601832197813447:5327]
2025-10-10T14:36:00.339006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:00.339319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:00.339379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:00.339701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:00.339765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.339770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.339772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.339773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.339774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.339776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.339778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.339779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.339780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.339781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.339783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.339784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.339785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.339791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.339806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.339811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.339816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.339820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.339823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.339827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.339832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.339836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.339841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.339845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.339850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.339854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.339869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.339882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.339890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.339900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.339905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.339915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.339919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.339924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.339929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.339935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.339940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.339945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.339950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.339956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.339961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.339967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.339978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.339984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.339992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.339998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.340014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.340025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.340029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.340035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.340040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.340044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.340088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:00.342962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:00.343362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:00.343375Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:00.343378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:00.343382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:00.343391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1869 [2:7559601832197813447:5327]
2025-10-10T14:36:00.343406Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:00.343428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:00.343436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.343440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.343442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.343461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:00.343470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:00.343483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:00.343553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.343561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.343563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.343566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:00.343643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:00.343654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.343666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.343678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.343696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:00.343721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042518:6376], now have 1 active actors on pipe
2025-10-10T14:36:00.343725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042324:2438], now have 1 active actors on pipe
2025-10-10T14:36:00.343734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601832197813441:5327]
2025-10-10T14:36:00.343737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601832197813441:5327]
2025-10-10T14:36:00.343739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601832197813441:5327]
2025-10-10T14:36:00.343753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:00.343768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:00.343775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:00.343779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:00.343781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:00.343784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:00.343788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:00.343807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1869
2025-10-10T14:36:00.343828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601832197813441:5327]
2025-10-10T14:36:00.343854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1869
2025-10-10T14:36:00.343846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:00.343880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:00.344010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.344021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.344075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7025761-148abcf8-aa42b602-885568ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:00.344089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.344093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.344096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:00.344109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.344122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:00.344184Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:36:00.344219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.344428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 13 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:36:00.344466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:36:00.344520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.344534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.344570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.344663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1870 partition: 0 MaxSeqNo: 40 sessionId: src_id|a7025761-148abcf8-aa42b602-885568ae_0
2025-10-10T14:36:00.345085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452edde3-60ab30af-e11cbf03-db46dbc8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a7025761-148abcf8-aa42b602-885568ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:00.347916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7025761-148abcf8-aa42b602-885568ae_0] Write session: try to update token
2025-10-10T14:36:00.347939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7025761-148abcf8-aa42b602-885568ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:00.362863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:00.362883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:00.362897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601832197813441:5327]
2025-10-10T14:36:00.362956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:00.363004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:00.363152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:00.363320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:00.363476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:00.363630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:00.363837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:00.363892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:00.366809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId: src_id|a7025761-148abcf8-aa42b602-885568ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:00.369701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:00.369962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.369984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.370030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:00.370133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:00.375201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:00.375216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:00.375220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:00.375222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:00.375234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601832197813441:5327]
2025-10-10T14:36:00.375238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601832197813441:5327]
2025-10-10T14:36:00.375243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601832197813441:5327]
2025-10-10T14:36:00.375293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:00.375304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:00.375306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:00.375311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:00.375314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.375317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:00.375455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:00.416966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601832980042535:6939]
2025-10-10T14:36:00.417307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1869, pipe: [1:7559601832980042535:6939]
2025-10-10T14:36:00.490093Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:00.498453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.498480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.498668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.498734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.498804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.498869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.498916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.498926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.498997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.499059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.499132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.499203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.499250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.499258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.499328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.499393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.499458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.499530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.499572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.499578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.499646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.499705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.499765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.499828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.499870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.499873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.499943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.500003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.500066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.500127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.500169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.500172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.500241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.500299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.500361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.500421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.500463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.500465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.500532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.500590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.500653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.500714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.500762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.500765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.500830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.500888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.500946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.501003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.501116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.501120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.501187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.501247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.501305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.501562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.501609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.501617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.501687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:00.501752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:00.501815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:00.501880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:00.501926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:00.501933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:00.501997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042535:6939], now have 1 active actors on pipe
2025-10-10T14:36:00.502229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:00.502233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601832980042535:6939]
2025-10-10T14:36:00.502254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:00.502270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:00.502291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1870 reason: error at write: Disconnected sessionId: src_id|a7025761-148abcf8-aa42b602-885568ae_0
2025-10-10T14:36:00.502559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1870 sessionId: src_id|a7025761-148abcf8-aa42b602-885568ae_0 is DEAD
2025-10-10T14:36:00.502669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7025761-148abcf8-aa42b602-885568ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:00.502682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7025761-148abcf8-aa42b602-885568ae_0] Write session will restart in 0.009830s
2025-10-10T14:36:00.502719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7025761-148abcf8-aa42b602-885568ae_0] Write session: Do CDS request
2025-10-10T14:36:00.502726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7025761-148abcf8-aa42b602-885568ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:00.503111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:00.516477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7025761-148abcf8-aa42b602-885568ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.516565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:00.516581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1871
2025-10-10T14:36:00.516736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.516775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:00.516787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:00.516791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:00.517435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1871 sessionId:  describe result for acl check
2025-10-10T14:36:00.517478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:00.517485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:00.517487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:00.517493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601832980042705:6364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:00.518070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601832980042705:6364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:00.519597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:00.520713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601832980042705:6364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:00.521843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:00.522091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:00.522107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:00.522122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:00.522199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:00.522247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601832197813652:5320]
2025-10-10T14:36:00.523050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:00.523102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601832980042705:6364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:00.523126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601832980042705:6364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:00.523130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601832980042705:6364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:00.523137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:00.523438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:00.523492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:00.523896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:00.523980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.523987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.523989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.523990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.523992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.523993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.523994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.523996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.523997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.523999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.524000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.524001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.524003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.524010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.524025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.524030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.524036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.524040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.524045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.524049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.524054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.524058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.524063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.524067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.524071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.524076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.524084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.524094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.524101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.524108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.524115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.524141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.524149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.524155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.524167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.524172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.524181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.524186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.524196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.524201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.524211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.524217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.524227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.524232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.524241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.524247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.524255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.524261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.524270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.524275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.524283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.524289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.524335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:00.526921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:00.527265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:00.527279Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:00.527282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:00.527286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:00.527291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1870 [2:7559601832197813652:5320]
2025-10-10T14:36:00.527306Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:00.527325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:00.527328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.527331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.527333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.527350Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:00.527363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:00.527371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:00.527429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.527436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.527437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.527440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:00.527518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:00.527527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.527538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.527549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.527564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:00.527604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042740:6364], now have 1 active actors on pipe
2025-10-10T14:36:00.527613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042541:2438], now have 1 active actors on pipe
2025-10-10T14:36:00.527620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601832197813647:5320]
2025-10-10T14:36:00.527622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601832197813647:5320]
2025-10-10T14:36:00.527623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601832197813647:5320]
2025-10-10T14:36:00.527638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:00.527656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:00.527658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:00.527661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:00.527664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:00.527676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:00.527679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:00.527706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601832197813647:5320]
2025-10-10T14:36:00.527714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:00.527717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:00.527685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1870
2025-10-10T14:36:00.527738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.527748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.527782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f542414-f8401c90-ba4bbe12-66dade06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:00.527790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.527728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1870
2025-10-10T14:36:00.527793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.527796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:00.527806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.527818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:00.527845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.528040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.528054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.528078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.528192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1871 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f542414-f8401c90-ba4bbe12-66dade06_0
2025-10-10T14:36:00.528616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7025761-148abcf8-aa42b602-885568ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f542414-f8401c90-ba4bbe12-66dade06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:00.531465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f542414-f8401c90-ba4bbe12-66dade06_0] Write session: try to update token
2025-10-10T14:36:00.531487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f542414-f8401c90-ba4bbe12-66dade06_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:00.547508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId: src_id|8f542414-f8401c90-ba4bbe12-66dade06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:00.547916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:00.547952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:00.547955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:00.547958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:00.547968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601832197813647:5320]
2025-10-10T14:36:00.547973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601832197813647:5320]
2025-10-10T14:36:00.547978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601832197813647:5320]
2025-10-10T14:36:00.548035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:00.548050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.548052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:00.548052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:00.548060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:00.548064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:00.548199Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:00.550253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:00.602611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601832980042750:6939]
2025-10-10T14:36:00.606969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1870, pipe: [1:7559601832980042750:6939]
2025-10-10T14:36:00.663387Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:00.664040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.664060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.664118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042750:6939], now have 1 active actors on pipe
2025-10-10T14:36:00.664348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:00.665050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:00.665170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1871 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f542414-f8401c90-ba4bbe12-66dade06_0
2025-10-10T14:36:00.665418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1871 sessionId: src_id|8f542414-f8401c90-ba4bbe12-66dade06_0 is DEAD
2025-10-10T14:36:00.665423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601832980042750:6939]
2025-10-10T14:36:00.665449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:00.665547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f542414-f8401c90-ba4bbe12-66dade06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:00.665557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f542414-f8401c90-ba4bbe12-66dade06_0] Write session will restart in 0.009563s
2025-10-10T14:36:00.665592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f542414-f8401c90-ba4bbe12-66dade06_0] Write session: Do CDS request
2025-10-10T14:36:00.665598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f542414-f8401c90-ba4bbe12-66dade06_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:00.676927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f542414-f8401c90-ba4bbe12-66dade06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.677022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:00.677041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1872
2025-10-10T14:36:00.677195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.677243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:00.677254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:00.677259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:00.677724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1872 sessionId:  describe result for acl check
2025-10-10T14:36:00.677767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:00.677773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:00.677775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:00.677781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601832980042850:6360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:00.678419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601832980042850:6360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:00.681276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601832980042850:6360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:00.683248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:00.685966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:00.686110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601832980042850:6360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:00.686127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601832980042850:6360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:00.686132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601832980042850:6360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:00.686142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:00.686238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:00.686252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:00.686266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:00.686328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:00.686375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601832197813858:5318]
2025-10-10T14:36:00.687131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:00.687505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:00.687574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:00.687962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:00.688040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.688053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.688054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.688055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.688057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.688059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.688060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.688061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.688063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.688064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.688065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.688066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.688068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.688075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.688090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.688094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.688098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.688101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.688105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.688109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.688113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.688116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.688121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.688125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.688128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.688132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.688142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.688151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.688159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.688165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.688170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.688177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.688182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.688188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.688193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.688200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.688205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.688211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.688217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.688223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.688229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.688241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.688248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.688254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.688263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.688268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.688275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.688280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.688283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.688288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.688299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.688304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.688344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:00.690986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:00.691356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:00.691368Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:00.691371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:00.691375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:00.691381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1871 [2:7559601832197813858:5318]
2025-10-10T14:36:00.691395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:00.691416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:00.691426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.691430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.691433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.691452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:00.691460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:00.691468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:00.691533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.691541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.691543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.691545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:00.691625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:00.691632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.691643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.691655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.691680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:00.691705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601832197813853:5318]
2025-10-10T14:36:00.691712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601832197813853:5318]
2025-10-10T14:36:00.691714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601832197813853:5318]
2025-10-10T14:36:00.691724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:00.691742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:00.691743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:00.691750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:00.691753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:00.691757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:00.691760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:00.691771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042956:6360], now have 1 active actors on pipe
2025-10-10T14:36:00.691775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042752:2438], now have 1 active actors on pipe
2025-10-10T14:36:00.691803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601832197813853:5318]
2025-10-10T14:36:00.691819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:00.691867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:00.691861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1871
2025-10-10T14:36:00.691904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1871
2025-10-10T14:36:00.692045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.692057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.692094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:00.692102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.692106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.692110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:00.692121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.692136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:00.692155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.692399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.692411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.692442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.692591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1872 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0
2025-10-10T14:36:00.693016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f542414-f8401c90-ba4bbe12-66dade06_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:00.695771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0] Write session: try to update token
2025-10-10T14:36:00.695792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:00.714197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:00.714216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:00.714220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:00.714223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:00.714233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601832197813853:5318]
2025-10-10T14:36:00.714237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601832197813853:5318]
2025-10-10T14:36:00.714242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601832197813853:5318]
2025-10-10T14:36:00.714293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:00.714306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.714309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:00.714462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:00.715966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:00.715981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:00.715985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:00.717078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId: src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:00.719720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:00.765661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601832980042970:6939]
2025-10-10T14:36:00.766244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1871, pipe: [1:7559601832980042970:6939]
2025-10-10T14:36:00.832238Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:00.832535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.832545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.832597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042970:6939], now have 1 active actors on pipe
2025-10-10T14:36:00.833571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601832980042970:6939]
2025-10-10T14:36:00.833641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:00.833647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:00.833692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:00.833705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1872 reason: error at write: Disconnected sessionId: src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0
2025-10-10T14:36:00.833887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1872 sessionId: src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0 is DEAD
2025-10-10T14:36:00.833768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:00.834288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:00.834301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0] Write session will restart in 0.006240s
2025-10-10T14:36:00.834324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0] Write session: Do CDS request
2025-10-10T14:36:00.834333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:00.845882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.845909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:00.845926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1873
2025-10-10T14:36:00.846109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:00.846148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:00.846154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:00.846167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:00.846689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1873 sessionId:  describe result for acl check
2025-10-10T14:36:00.846728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:00.846735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:00.846737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:00.846746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601832980043022:6357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:00.847345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601832980043022:6357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:00.851969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601832980043022:6357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:00.854976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601832980043022:6357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:00.854991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601832980043022:6357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:00.854995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601832980043022:6357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:00.855005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:00.856232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:00.858541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:00.858772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:00.858783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:00.858795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:00.858851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:00.858894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601832197814078:5316]
2025-10-10T14:36:00.859544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:00.859898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:00.859956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:00.860281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:00.860340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.860346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.860348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.860349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.860350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.860352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.860353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.860354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.860356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.860357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.860358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.860360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.860361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.860368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.860382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.860387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.860392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.860396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.860401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.860405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.860410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.860414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.860419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.860423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.860428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.860432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.860440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.860449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:00.860456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.860463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:00.860474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.860480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:00.860484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.860489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:00.860494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.860499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:00.860503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.860509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:00.860514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.860520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:00.860524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.860531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:00.860537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.860544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:00.860549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.860556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:00.860566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.860572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.860577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.860583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.860590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.860596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.860636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:00.863125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:00.863635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:00.863650Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:00.863652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:00.863657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:00.863663Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1872 [2:7559601832197814078:5316]
2025-10-10T14:36:00.863678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:00.863696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:00.863699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.863702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.863705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.863721Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:00.863729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:00.863744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:00.863798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.863806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.863808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.863811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:00.863880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:00.863888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.863901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:00.863918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:00.863941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:00.863967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980043181:6357], now have 1 active actors on pipe
2025-10-10T14:36:00.863978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980042972:2438], now have 1 active actors on pipe
2025-10-10T14:36:00.863985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601832197814073:5316]
2025-10-10T14:36:00.863988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601832197814073:5316]
2025-10-10T14:36:00.863991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601832197814073:5316]
2025-10-10T14:36:00.864004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:00.864020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:00.864023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:00.864027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:00.864029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:00.864041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:00.864045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:00.864067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601832197814073:5316]
2025-10-10T14:36:00.864079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:00.864099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:00.864100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1872
2025-10-10T14:36:00.864139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1872
2025-10-10T14:36:00.864151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.864163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.864193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:00.864206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:00.864211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:00.864213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:00.864227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:00.864239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:00.864259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.864464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:00.864478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:00.864503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:00.864592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1873 partition: 0 MaxSeqNo: 40 sessionId: src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0
2025-10-10T14:36:00.864985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e45400-7ef8a93f-cca4c375-e940a225_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:00.867690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0] Write session: try to update token
2025-10-10T14:36:00.867711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:00.885439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:00.885471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:00.885475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:00.885478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:00.885489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601832197814073:5316]
2025-10-10T14:36:00.885495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601832197814073:5316]
2025-10-10T14:36:00.885500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601832197814073:5316]
2025-10-10T14:36:00.885563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:00.885567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:00.885574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:00.885581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:00.885583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:00.885591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:00.885769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:00.885512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId: src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:00.888248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:00.933624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601832980043196:6939]
2025-10-10T14:36:00.934134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1872, pipe: [1:7559601832980043196:6939]
2025-10-10T14:36:01.003409Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:01.003881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.003894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.003945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601832980043196:6939], now have 1 active actors on pipe
2025-10-10T14:36:01.004169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:01.004314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:01.004314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:01.004404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0
2025-10-10T14:36:01.004631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1873 sessionId: src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0 is DEAD
2025-10-10T14:36:01.004786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601832980043196:6939]
2025-10-10T14:36:01.005638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:01.005649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0] Write session will restart in 0.008670s
2025-10-10T14:36:01.005672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0] Write session: Do CDS request
2025-10-10T14:36:01.005679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:01.016304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.016365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:01.016381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1874
2025-10-10T14:36:01.016733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.016788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:01.016802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:01.016806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:01.017355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1874 sessionId:  describe result for acl check
2025-10-10T14:36:01.017394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:01.017398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:01.017400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:01.017407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601837275010569:6350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:01.017973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601837275010569:6350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:01.021207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601837275010569:6350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:01.025501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:01.025536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601837275010569:6350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:01.025559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601837275010569:6350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:01.025563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601837275010569:6350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:01.025572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:01.028242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:01.028460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:01.028476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:01.028489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:01.028554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:01.028605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601836492781584:5311]
2025-10-10T14:36:01.029231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:01.029605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:01.029656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:01.029964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:01.030025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.030030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.030032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.030033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.030034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.030035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.030036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.030037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.030039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.030040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.030041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.030042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.030043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.030049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.030060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.030064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.030067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.030071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.030074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.030077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.030081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.030084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.030088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.030092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.030096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.030099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.030106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.030115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.030121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.030125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.030129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.030134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.030138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.030142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.030146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.030153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.030156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.030161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.030165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.030169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.030173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.030178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.030183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.030187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.030190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.030194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.030198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.030202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.030205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.030209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.030214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.030218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.030253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:01.032802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:01.033139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:01.033153Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:01.033155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:01.033160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:01.033168Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1873 [2:7559601836492781584:5311]
2025-10-10T14:36:01.033181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:01.033202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:01.033205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.033209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.033212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.033228Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:01.033236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:01.033244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:01.033310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.033318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.033320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.033361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:01.033429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:01.033438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.033449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.033459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.033474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:01.033498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275010494:2438], now have 1 active actors on pipe
2025-10-10T14:36:01.033501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275010695:6350], now have 1 active actors on pipe
2025-10-10T14:36:01.033509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601836492781577:5311]
2025-10-10T14:36:01.033511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601836492781577:5311]
2025-10-10T14:36:01.033515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601836492781577:5311]
2025-10-10T14:36:01.033534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:01.033554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:01.033570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:01.033578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:01.033575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1873
2025-10-10T14:36:01.033602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601836492781577:5311]
2025-10-10T14:36:01.033609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:01.033620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1873
2025-10-10T14:36:01.033643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:01.033651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:01.033653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:01.033660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:01.033783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.033794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.033845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|522b6dc7-17179f55-61d05354-432271a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:01.033874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.033884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.033887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:01.033901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.033914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:01.033929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.034097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.034107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.034122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.034197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1874 partition: 0 MaxSeqNo: 40 sessionId: src_id|522b6dc7-17179f55-61d05354-432271a5_0
2025-10-10T14:36:01.034623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46704eb2-4d4d37bd-9dcbfa13-b36ac84_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|522b6dc7-17179f55-61d05354-432271a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:01.037383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|522b6dc7-17179f55-61d05354-432271a5_0] Write session: try to update token
2025-10-10T14:36:01.037402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|522b6dc7-17179f55-61d05354-432271a5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:01.051750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:01.051774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:01.051787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601836492781577:5311]
2025-10-10T14:36:01.051848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:01.051838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId: src_id|522b6dc7-17179f55-61d05354-432271a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:01.052042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:01.052189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:01.052334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:01.052466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:01.052656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:01.052694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:01.052919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:01.054627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:01.055206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.055223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.055265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:01.055384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:01.066976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:01.066994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:01.066998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:01.067000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:01.067012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601836492781577:5311]
2025-10-10T14:36:01.067016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601836492781577:5311]
2025-10-10T14:36:01.067019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601836492781577:5311]
2025-10-10T14:36:01.067068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:01.067081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:01.067085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:01.067089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.067089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:01.067091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:01.067232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:01.105093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601837275010707:6939]
2025-10-10T14:36:01.105511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1873, pipe: [1:7559601837275010707:6939]
2025-10-10T14:36:01.186991Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:01.195825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.195859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.196048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.196131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.196215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.196491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.196539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.196549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.196620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.196689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.196964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.197038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.197085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.197093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.197161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.197228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.197295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.197427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.197473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.197481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.197553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.197624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.197691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.197758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.197805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.197813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.197887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.197952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.198021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.198094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.198149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.198158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.198226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.198291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.198362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.198434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.198478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.198485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.198555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.198623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.198698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.198773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.198827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.198832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.199100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.199368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.199632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.199896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.200039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.200050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.200123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.200185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.200249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.200320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.200377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.200386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.200456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.200524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.200585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.200649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.200780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.200789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.200863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275010707:6939], now have 1 active actors on pipe
2025-10-10T14:36:01.201179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:01.201210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:01.201245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1874 reason: error at write: Disconnected sessionId: src_id|522b6dc7-17179f55-61d05354-432271a5_0
2025-10-10T14:36:01.201513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1874 sessionId: src_id|522b6dc7-17179f55-61d05354-432271a5_0 is DEAD
2025-10-10T14:36:01.201671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601837275010707:6939]
2025-10-10T14:36:01.201693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522b6dc7-17179f55-61d05354-432271a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:01.201710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522b6dc7-17179f55-61d05354-432271a5_0] Write session will restart in 0.005659s
2025-10-10T14:36:01.201705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:01.201736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522b6dc7-17179f55-61d05354-432271a5_0] Write session: Do CDS request
2025-10-10T14:36:01.201744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522b6dc7-17179f55-61d05354-432271a5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:01.202060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:01.208915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|522b6dc7-17179f55-61d05354-432271a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.209079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:01.209093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1875
2025-10-10T14:36:01.209205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.209250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:01.209259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:01.209263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:01.209711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1875 sessionId:  describe result for acl check
2025-10-10T14:36:01.209751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:01.209758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:01.209759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:01.209766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601837275010742:6333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:01.210471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601837275010742:6333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:01.214458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601837275010742:6333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:01.217932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601837275010742:6333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:01.217951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601837275010742:6333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:01.217955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601837275010742:6333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:01.217964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:01.220492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:01.222758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:01.223127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:01.223148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:01.223164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:01.223231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:01.223283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601836492781832:5303]
2025-10-10T14:36:01.223912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:01.224321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:01.224376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:01.224706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:01.224766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.224772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.224773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.224775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.224776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.224777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.224778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.224780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.224781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.224783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.224784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.224785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.224786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.224794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.224808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.224812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.224817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.224820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.224825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.224829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.224833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.224838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.224842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.224846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.224851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.224854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.224863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.224872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.224878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.224889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.224894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.224900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.224905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.224910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.224915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.224921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.224926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.224932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.224937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.224942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.224947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.224953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.224962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.224968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.224972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.224983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.224988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.224997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.225002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.225008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.225019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.225024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.225084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:01.227981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:01.228317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:01.228329Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:01.228331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:01.228335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:01.228341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1874 [2:7559601836492781832:5303]
2025-10-10T14:36:01.228355Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:01.228385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:01.228393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.228397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.228399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.228419Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:01.228431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:01.228441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:01.228503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.228511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.228513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.228516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:01.228584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:01.228592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.228604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.228616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.228633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:01.228660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275010724:2438], now have 1 active actors on pipe
2025-10-10T14:36:01.228673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601836492781827:5303]
2025-10-10T14:36:01.228680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601836492781827:5303]
2025-10-10T14:36:01.228683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601836492781827:5303]
2025-10-10T14:36:01.228698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:01.228711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:01.228713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275010916:6333], now have 1 active actors on pipe
2025-10-10T14:36:01.228715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:01.228717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:01.228721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:01.228738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:01.228743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:01.228770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601836492781827:5303]
2025-10-10T14:36:01.228779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:01.228802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:01.228892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1874
2025-10-10T14:36:01.229040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1874
2025-10-10T14:36:01.229031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.229048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.229082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:01.229092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.229097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.229105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:01.229118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.229146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:01.229167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.229489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.229500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.229519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.229621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1875 partition: 0 MaxSeqNo: 40 sessionId: src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0
2025-10-10T14:36:01.230064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|522b6dc7-17179f55-61d05354-432271a5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:01.241191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:01.241211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:01.241222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601836492781827:5303]
2025-10-10T14:36:01.241278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:01.241507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:01.241685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:01.241773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0] Write session: try to update token
2025-10-10T14:36:01.241794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:01.241852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:01.242015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:01.242248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:01.242300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:01.244985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:01.258870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId: src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:01.261761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:01.261997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.262020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.262063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:01.262487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:01.264520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:01.264538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:01.264542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:01.264544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:01.264555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601836492781827:5303]
2025-10-10T14:36:01.264559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601836492781827:5303]
2025-10-10T14:36:01.264564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601836492781827:5303]
2025-10-10T14:36:01.264618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:01.264631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.264635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:01.264636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:01.264642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:01.264659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:01.264791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:01.301692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601837275010949:6939]
2025-10-10T14:36:01.302029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1874, pipe: [1:7559601837275010949:6939]
2025-10-10T14:36:01.381155Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:01.389878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.389908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.390093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.390154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.390221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.390285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.390330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.390339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.390411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.390472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.390537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.390603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.390651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.390658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.390788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.390856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.390920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.390984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.391026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.391033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.391101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.391165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.391231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.391296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.391341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.391348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.391475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.391595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.391717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.391817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.391880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.391888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.391994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.392053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.392115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.392179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.392223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.392230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.392296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.392356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.392423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.392486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.392545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.392555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.392619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.392679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.392742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.392807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.392851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.392858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.392922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.392980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.393040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.393104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.393148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.393154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.393221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:01.393280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:01.393374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:01.393437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:01.393498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:01.393506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:01.393573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275010949:6939], now have 1 active actors on pipe
2025-10-10T14:36:01.393895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601837275010949:6939]
2025-10-10T14:36:01.393932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:01.393948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:01.393951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:01.393986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1875 reason: error at write: Disconnected sessionId: src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0
2025-10-10T14:36:01.394190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1875 sessionId: src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0 is DEAD
2025-10-10T14:36:01.394327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:01.394337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0] Write session will restart in 0.008889s
2025-10-10T14:36:01.394365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0] Write session: Do CDS request
2025-10-10T14:36:01.394371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:01.394739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:01.404925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.405029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:01.405044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1876
2025-10-10T14:36:01.405233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.405271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:01.405283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:01.405288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:01.405906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1876 sessionId:  describe result for acl check
2025-10-10T14:36:01.405944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:01.405953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:01.405955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:01.405962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601837275011056:6313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:01.406517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601837275011056:6313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:01.409812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601837275011056:6313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:01.411184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:01.413495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:01.413761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:01.413772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:01.413785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:01.413842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:01.413884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601836492782042:5286]
2025-10-10T14:36:01.414160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601837275011056:6313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:01.414175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601837275011056:6313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:01.414179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601837275011056:6313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:01.414188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:01.414577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:01.414904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:01.414965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:01.415307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:01.415384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.415390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.415391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.415393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.415394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.415395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.415397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.415398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.415400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.415401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.415402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.415403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.415405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.415411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.415425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.415431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.415435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.415439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.415444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.415448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.415452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.415456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.415461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.415464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.415468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.415472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.415494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.415502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.415509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.415516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.415521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.415527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.415539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.415544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.415549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.415556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.415560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.415564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.415573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.415579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.415582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.415591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.415596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.415600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.415604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.415609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.415613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.415620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.415629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.415633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.415637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.415641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.415683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:01.424172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:01.424540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:01.424553Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:01.424557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:01.424561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:01.424570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1875 [2:7559601836492782042:5286]
2025-10-10T14:36:01.424588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:01.424612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:01.424622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.424626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.424629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.424650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:01.424663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:01.424672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:01.424748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.424756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.424759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.424761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:01.424835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:01.424846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.424858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.424870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.424888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:01.424911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275010964:2438], now have 1 active actors on pipe
2025-10-10T14:36:01.424916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011167:6313], now have 1 active actors on pipe
2025-10-10T14:36:01.424924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601836492782037:5286]
2025-10-10T14:36:01.424928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601836492782037:5286]
2025-10-10T14:36:01.424930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601836492782037:5286]
2025-10-10T14:36:01.424945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:01.424966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:01.424987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:01.424995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:01.425037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601836492782037:5286]
2025-10-10T14:36:01.425045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:01.425006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1875
2025-10-10T14:36:01.425030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1875
2025-10-10T14:36:01.425087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:01.425094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:01.425096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:01.425103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:01.425237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.425244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.425277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7dafc20-33da760a-2896c718-a8158ea6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:01.425287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.425291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.425294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:01.425307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.425350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:01.425368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.426278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.426289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.426310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.426443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1876 partition: 0 MaxSeqNo: 40 sessionId: src_id|e7dafc20-33da760a-2896c718-a8158ea6_0
2025-10-10T14:36:01.429603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87dcd031-9e5634f1-dea75cb6-a47a6127_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e7dafc20-33da760a-2896c718-a8158ea6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:01.432201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Write session: try to update token
2025-10-10T14:36:01.432221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:01.447310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId: src_id|e7dafc20-33da760a-2896c718-a8158ea6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:01.449193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:01.449209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:01.449212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:01.449215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:01.449226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601836492782037:5286]
2025-10-10T14:36:01.449231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601836492782037:5286]
2025-10-10T14:36:01.449235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601836492782037:5286]
2025-10-10T14:36:01.449285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:01.449285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:01.449293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.449296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:01.449297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:01.449301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:01.449460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:01.450124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:01.496136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601837275011179:6939]
2025-10-10T14:36:01.500733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1875, pipe: [1:7559601837275011179:6939]
2025-10-10T14:36:01.567907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:01.568564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.568581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.568628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011179:6939], now have 1 active actors on pipe
2025-10-10T14:36:01.568876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:01.568871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:01.568919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601837275011179:6939]
2025-10-10T14:36:01.568927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:01.569017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1876 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7dafc20-33da760a-2896c718-a8158ea6_0
2025-10-10T14:36:01.569229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1876 sessionId: src_id|e7dafc20-33da760a-2896c718-a8158ea6_0 is DEAD
2025-10-10T14:36:01.569421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 139 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:36:01.569457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:01.569462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Write session will restart in 0.005933s
2025-10-10T14:36:01.569489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Write session: Do CDS request
2025-10-10T14:36:01.569494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:01.576883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.576960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:01.576973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1877
2025-10-10T14:36:01.577083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.577130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:01.577140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:01.577144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:01.577887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1877 sessionId:  describe result for acl check
2025-10-10T14:36:01.577927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:01.577933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:01.577937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:01.577944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601837275011208:6303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:01.578501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601837275011208:6303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:01.582256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601837275011208:6303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:01.585748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601837275011208:6303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:01.585762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601837275011208:6303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:01.585766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601837275011208:6303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:01.585775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:01.586869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:01.589112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:01.589387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:01.589397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:01.589410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:01.589468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:01.589513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601836492782256:5271]
2025-10-10T14:36:01.589993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:01.590329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:01.590414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:01.590819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:01.590910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.590920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.590921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.590922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.590924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.590925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.590927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.590929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.590930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.590931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.590933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.590934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.590935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.590942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.590957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.590961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.590966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.590970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.590974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.590978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.590983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.590987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.590992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.590997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.591001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.591005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.591013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.591022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.591029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.591035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.591040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.591046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.591051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.591056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.591063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.591075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.591078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.591083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.591093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.591099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.591103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.591108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.591115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.591121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.591126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.591130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.591140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.591145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.591150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.591156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.591165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.591171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.591220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:01.594294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:01.594649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:01.594673Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:01.594676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:01.594679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:01.594686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1876 [2:7559601836492782256:5271]
2025-10-10T14:36:01.594700Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:01.594720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:01.594728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.594732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.594735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.594755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:01.594766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:01.594776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:01.594852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.594858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.594861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.594863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:01.594936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:01.594946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.594958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.594979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.594996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:01.595027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011383:6303], now have 1 active actors on pipe
2025-10-10T14:36:01.595035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011180:2438], now have 1 active actors on pipe
2025-10-10T14:36:01.595042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601836492782251:5271]
2025-10-10T14:36:01.595046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601836492782251:5271]
2025-10-10T14:36:01.595048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601836492782251:5271]
2025-10-10T14:36:01.595030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1876
2025-10-10T14:36:01.595062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:01.595057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1876
2025-10-10T14:36:01.595077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:01.595095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:01.595096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:01.595099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:01.595104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:01.595112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:01.595149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.595158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.595172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601836492782251:5271]
2025-10-10T14:36:01.595186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:01.595198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:01.595221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4da20c4d-3487115b-f3496da5-82f4d701_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:01.595234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.595243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.595246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:01.595257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.595272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:01.595300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.595453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.595478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.595504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.595621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1877 partition: 0 MaxSeqNo: 40 sessionId: src_id|4da20c4d-3487115b-f3496da5-82f4d701_0
2025-10-10T14:36:01.596072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dafc20-33da760a-2896c718-a8158ea6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4da20c4d-3487115b-f3496da5-82f4d701_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:01.598782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4da20c4d-3487115b-f3496da5-82f4d701_0] Write session: try to update token
2025-10-10T14:36:01.598800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4da20c4d-3487115b-f3496da5-82f4d701_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:01.614066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId: src_id|4da20c4d-3487115b-f3496da5-82f4d701_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:01.616105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:01.616127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:01.616131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:01.616133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:01.616144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601836492782251:5271]
2025-10-10T14:36:01.616149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601836492782251:5271]
2025-10-10T14:36:01.616153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601836492782251:5271]
2025-10-10T14:36:01.616206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:01.616212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:01.616219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:01.616219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.616222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:01.616224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:01.616401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:01.616775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:01.669327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601837275011397:6939]
2025-10-10T14:36:01.669673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1876, pipe: [1:7559601837275011397:6939]
2025-10-10T14:36:01.734273Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:01.734912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.734928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.734977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011397:6939], now have 1 active actors on pipe
2025-10-10T14:36:01.735186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:01.735203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:01.735731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da20c4d-3487115b-f3496da5-82f4d701_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:01.735743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da20c4d-3487115b-f3496da5-82f4d701_0] Write session will restart in 0.007000s
2025-10-10T14:36:01.735216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:01.735281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1877 reason: error at write: Disconnected sessionId: src_id|4da20c4d-3487115b-f3496da5-82f4d701_0
2025-10-10T14:36:01.735520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1877 sessionId: src_id|4da20c4d-3487115b-f3496da5-82f4d701_0 is DEAD
2025-10-10T14:36:01.735531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601837275011397:6939]
2025-10-10T14:36:01.735547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:01.735784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da20c4d-3487115b-f3496da5-82f4d701_0] Write session: Do CDS request
2025-10-10T14:36:01.735794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da20c4d-3487115b-f3496da5-82f4d701_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:01.744410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4da20c4d-3487115b-f3496da5-82f4d701_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.744678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:01.744701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1878
2025-10-10T14:36:01.744895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.744960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:01.744975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:01.744980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:01.745536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1878 sessionId:  describe result for acl check
2025-10-10T14:36:01.745592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:01.745600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:01.745602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:01.745611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601837275011457:6299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:01.746189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601837275011457:6299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:01.751592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601837275011457:6299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:01.753080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:01.755192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:01.755397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601837275011457:6299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:01.755413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601837275011457:6299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:01.755417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601837275011457:6299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:01.755441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:01.755455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:01.755471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:01.755426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:01.755541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:01.755602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601836492782468:5283]
2025-10-10T14:36:01.756029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:01.756365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:01.756442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:01.756785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:01.756854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.756861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.756862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.756863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.756864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.756865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.756867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.756868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.756869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.756871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.756872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.756873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.756874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.756880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.756894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.756898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.756902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.756906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.756911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.756915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.756918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.756923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.756927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.756931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.756935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.756940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.756948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.756957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.756963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.756974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.756978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.756984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.756988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.756998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.757002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.757007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.757018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.757028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.757033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.757039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.757044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.757060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.757069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.757075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.757084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.757089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.757098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.757103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.757112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.757117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.757122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.757131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.757172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:01.759713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:01.760056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:01.760071Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:01.760073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:01.760077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:01.760083Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1877 [2:7559601836492782468:5283]
2025-10-10T14:36:01.760096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:01.760115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:01.760123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.760126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.760128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.760145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:01.760157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:01.760165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:01.760241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.760251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.760253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.760255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:01.760324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:01.760331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.760342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.760351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.760365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:01.760392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011403:2438], now have 1 active actors on pipe
2025-10-10T14:36:01.760401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011612:6299], now have 1 active actors on pipe
2025-10-10T14:36:01.760408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601836492782463:5283]
2025-10-10T14:36:01.760410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601836492782463:5283]
2025-10-10T14:36:01.760412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601836492782463:5283]
2025-10-10T14:36:01.760434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:01.760448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:01.760458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:01.760469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:01.760473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:01.760477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:01.760479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:01.760496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601836492782463:5283]
2025-10-10T14:36:01.760503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:01.760494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1877
2025-10-10T14:36:01.760519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:01.760532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1877
2025-10-10T14:36:01.760544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.760556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.760593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:01.760606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.760614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.760616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:01.760628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.760642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:01.760665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.760938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.760948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.760968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.761085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1878 partition: 0 MaxSeqNo: 40 sessionId: src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0
2025-10-10T14:36:01.761532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4da20c4d-3487115b-f3496da5-82f4d701_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:01.764403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0] Write session: try to update token
2025-10-10T14:36:01.764422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:01.782533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:01.782553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:01.782557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:01.782558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:01.782568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601836492782463:5283]
2025-10-10T14:36:01.782578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601836492782463:5283]
2025-10-10T14:36:01.782581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601836492782463:5283]
2025-10-10T14:36:01.782629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:01.782628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:01.782635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:01.782640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:01.782642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.782645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:01.784513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId: src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:01.782804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:01.789236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:01.837420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601837275011624:6939]
2025-10-10T14:36:01.837922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1877, pipe: [1:7559601837275011624:6939]
2025-10-10T14:36:01.904117Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:01.904424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.904436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.904487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011624:6939], now have 1 active actors on pipe
2025-10-10T14:36:01.904771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:01.905121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601837275011624:6939]
2025-10-10T14:36:01.905163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:01.905163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:01.905166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:01.905231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1878 reason: error at write: Disconnected sessionId: src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0
2025-10-10T14:36:01.905482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1878 sessionId: src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0 is DEAD
2025-10-10T14:36:01.905724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:01.905736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0] Write session will restart in 0.007133s
2025-10-10T14:36:01.905774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0] Write session: Do CDS request
2025-10-10T14:36:01.905782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:01.913921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.917683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:01.917700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1879
2025-10-10T14:36:01.917856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:01.917903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:01.917910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:01.917914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:01.918871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1879 sessionId:  describe result for acl check
2025-10-10T14:36:01.918908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:01.918915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:01.918917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:01.918924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601837275011665:6296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:01.919471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601837275011665:6296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:01.922980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601837275011665:6296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:01.926954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:01.926872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601837275011665:6296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:01.926890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601837275011665:6296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:01.926894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601837275011665:6296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:01.926903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:01.929477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:01.929730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:01.929741Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:01.929766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:01.929838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:01.929886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601836492782697:5281]
2025-10-10T14:36:01.930548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:01.930944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:01.930996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:01.931366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:01.931431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.931435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.931437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.931438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.931439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.931441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.931442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.931444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.931445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.931446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.931448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.931449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.931450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.931457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.931471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.931475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.931479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.931484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.931488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.931492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.931496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.931500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.931504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.931508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.931512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.931516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.931524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.931533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:01.931540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.931546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:01.931551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.931556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:01.931561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.931566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:01.931571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.931577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:01.931581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.931586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:01.931592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.931598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:01.931609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.931614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:01.931619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.931624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:01.931629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.931634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:01.931638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.931643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.931649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.931654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.931659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.931664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.931714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:01.935809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:01.936547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:01.936559Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:01.936561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:01.936565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:01.936572Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1878 [2:7559601836492782697:5281]
2025-10-10T14:36:01.936588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:01.936617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:01.936621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.936625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.936628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.936647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:01.936659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:01.936667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:01.936738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.936745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.936747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.936750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:01.936827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:01.936834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.936849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:01.936867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:01.936888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:01.936919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011637:2438], now have 1 active actors on pipe
2025-10-10T14:36:01.936927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601837275011842:6296], now have 1 active actors on pipe
2025-10-10T14:36:01.936936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601836492782691:5281]
2025-10-10T14:36:01.936938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601836492782691:5281]
2025-10-10T14:36:01.936940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601836492782691:5281]
2025-10-10T14:36:01.936956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:01.936971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:01.936992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:01.936992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:01.936996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:01.936999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:01.937000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:01.937042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601836492782691:5281]
2025-10-10T14:36:01.936971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1878
2025-10-10T14:36:01.937049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:01.937064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:01.937018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1878
2025-10-10T14:36:01.937264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.937276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.937323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:01.937349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:01.937353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:01.937357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:01.937371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:01.937389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:01.937412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.937618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:01.937640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:01.937667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:01.937768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1879 partition: 0 MaxSeqNo: 40 sessionId: src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0
2025-10-10T14:36:01.939438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbc2d409-c8a80a14-e8e7f888-4a7894c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:01.942266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0] Write session: try to update token
2025-10-10T14:36:01.942289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:01.957165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:01.957184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:01.957188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:01.957190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:01.957201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601836492782691:5281]
2025-10-10T14:36:01.957207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601836492782691:5281]
2025-10-10T14:36:01.957211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601836492782691:5281]
2025-10-10T14:36:01.957264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:01.957274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:01.957277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:01.957280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:01.957282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:01.957286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:01.957458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:01.961144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId: src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:01.963895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:02.007143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601841569979152:6939]
2025-10-10T14:36:02.009660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1878, pipe: [1:7559601841569979152:6939]
2025-10-10T14:36:02.071218Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:02.071497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.071508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.071558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979152:6939], now have 1 active actors on pipe
2025-10-10T14:36:02.072055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:02.072009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601841569979152:6939]
2025-10-10T14:36:02.072044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:02.072047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:02.072125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1879 reason: error at write: Disconnected sessionId: src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0
2025-10-10T14:36:02.072350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:02.072357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1879 sessionId: src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0 is DEAD
2025-10-10T14:36:02.073436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:02.073528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0] Write session will restart in 0.005954s
2025-10-10T14:36:02.073557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0] Write session: Do CDS request
2025-10-10T14:36:02.073563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:02.080970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.081066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:02.081086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1880
2025-10-10T14:36:02.081715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.081764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:02.081771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:02.081776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:02.082204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1880 sessionId:  describe result for acl check
2025-10-10T14:36:02.082234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:02.082236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:02.082238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:02.082245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601841569979188:6290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:02.082828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601841569979188:6290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:02.088740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601841569979188:6290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:02.094904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601841569979188:6290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:02.094918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601841569979188:6290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:02.094922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601841569979188:6290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:02.094932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:02.099881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:02.102951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:02.103216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:02.103232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:02.103246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:02.103315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:02.103363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601840787750208:5278]
2025-10-10T14:36:02.104017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:02.104466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:02.104514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:02.104836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:02.104895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.104896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.104897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.104899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.104900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.104901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.104903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.104905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.104906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.104908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.104909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.104910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.104911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.104918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.104932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.104936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.104941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.104945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.104949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.104953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.104957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.104961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.104966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.104970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.104975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.104979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.104987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.104996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.105004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.105010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.105014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.105019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.105024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.105030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.105035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.105041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.105046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.105051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.105056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.105062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.105067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.105072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.105078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.105084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.105088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.105094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.105100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.105105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.105110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.105118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.105131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.105155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.105195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:02.107918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:02.108242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:02.108254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:02.108257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:02.108262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:02.108268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1879 [2:7559601840787750208:5278]
2025-10-10T14:36:02.108282Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:02.108304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:02.108311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.108314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.108316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.108334Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:02.108349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:02.108358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:02.108416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.108419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.108420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.108423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:02.108491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:02.108495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.108505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.108514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.108531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:02.108552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601840787750202:5278]
2025-10-10T14:36:02.108554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601840787750202:5278]
2025-10-10T14:36:02.108556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601840787750202:5278]
2025-10-10T14:36:02.108572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:02.108587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:02.108601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:02.108605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:02.108624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:02.108628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:02.108632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601840787750202:5278]
2025-10-10T14:36:02.108632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:02.108635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:02.108640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:02.108928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979153:2438], now have 1 active actors on pipe
2025-10-10T14:36:02.108937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979330:6290], now have 1 active actors on pipe
2025-10-10T14:36:02.109378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1879
2025-10-10T14:36:02.109418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1879
2025-10-10T14:36:02.110528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1880 partition: 0 MaxSeqNo: 40 sessionId: src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0
2025-10-10T14:36:02.109703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.109716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.109750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:02.109760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.109765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.109767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:02.109781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.109795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:02.109809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.110131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.110135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.110151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.113472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80e2d166-1d7f3540-a9c3764-2f7662b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:02.116328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0] Write session: try to update token
2025-10-10T14:36:02.116350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:02.135066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId: src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:02.137719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:02.137738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:02.137743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:02.137745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:02.137756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601840787750202:5278]
2025-10-10T14:36:02.137761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601840787750202:5278]
2025-10-10T14:36:02.137766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601840787750202:5278]
2025-10-10T14:36:02.137820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:02.137821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:02.137829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:02.137834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:02.137834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.137838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:02.137980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:02.137997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:02.171589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601841569979372:6939]
2025-10-10T14:36:02.171907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1879, pipe: [1:7559601841569979372:6939]
2025-10-10T14:36:02.256924Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:02.257622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.257641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.257689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979372:6939], now have 1 active actors on pipe
2025-10-10T14:36:02.257900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:02.258406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601841569979372:6939]
2025-10-10T14:36:02.258447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:02.258492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:02.258575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1880 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0
2025-10-10T14:36:02.258799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1880 sessionId: src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0 is DEAD
2025-10-10T14:36:02.260314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:02.260325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0] Write session will restart in 0.007173s
2025-10-10T14:36:02.260349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0] Write session: Do CDS request
2025-10-10T14:36:02.260355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:02.270246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.270229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:02.270251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1881
2025-10-10T14:36:02.270507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.270542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:02.270548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:02.270553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:02.271050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1881 sessionId:  describe result for acl check
2025-10-10T14:36:02.271081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:02.271083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:02.271085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:02.271091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601841569979437:6273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:02.271638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601841569979437:6273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:02.275115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601841569979437:6273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:02.278477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601841569979437:6273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:02.278492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601841569979437:6273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:02.278496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601841569979437:6273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:02.278505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:02.280211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:02.282543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:02.282760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:02.282766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:02.282779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:02.282836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:02.282877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601840787750462:5264]
2025-10-10T14:36:02.283472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:02.283799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:02.283833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:02.284046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:02.284080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.284081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.284081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.284082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.284083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.284083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.284084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.284085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.284086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.284086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.284088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.284088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.284089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.284093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.284102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.284104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.284107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.284109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.284112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.284114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.284117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.284119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.284122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.284124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.284126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.284129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.284135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.284142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.284147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.284151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.284153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.284156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.284159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.284162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.284165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.284168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.284171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.284174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.284177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.284180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.284183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.284186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.284189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.284192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.284195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.284198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.284201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.284204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.284207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.284212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.284214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.284217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.284241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:02.287102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1880
2025-10-10T14:36:02.287103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1880
2025-10-10T14:36:02.286488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:02.286766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:02.286769Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:02.286771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:02.286774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:02.286779Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1880 [2:7559601840787750462:5264]
2025-10-10T14:36:02.286788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:02.286801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:02.286803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.286805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.286806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.286819Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:02.286825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:02.286832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:02.286877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.286878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.286880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.286882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:02.287157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:02.287160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.287168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.287176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.287186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:02.287203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979387:2438], now have 1 active actors on pipe
2025-10-10T14:36:02.287205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979603:6273], now have 1 active actors on pipe
2025-10-10T14:36:02.287211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601840787750457:5264]
2025-10-10T14:36:02.287212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601840787750457:5264]
2025-10-10T14:36:02.287214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601840787750457:5264]
2025-10-10T14:36:02.287224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:02.287236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:02.287247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:02.287249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:02.287254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:02.287256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:02.287259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:02.287278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.287282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.287293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601840787750457:5264]
2025-10-10T14:36:02.287298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:02.287304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:02.287321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|687d3142-c7c8162c-5fc24565-203a57ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:02.287328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.287331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.287333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:02.287341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.287350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:02.287369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.287949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1881 partition: 0 MaxSeqNo: 40 sessionId: src_id|687d3142-c7c8162c-5fc24565-203a57ae_0
2025-10-10T14:36:02.288389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c276a8b8-71111dda-eb53c6e7-6b5e1e6c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|687d3142-c7c8162c-5fc24565-203a57ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:02.287816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.287825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.287845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.291119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687d3142-c7c8162c-5fc24565-203a57ae_0] Write session: try to update token
2025-10-10T14:36:02.291137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687d3142-c7c8162c-5fc24565-203a57ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:02.307163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId: src_id|687d3142-c7c8162c-5fc24565-203a57ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:02.307532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:02.307554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:02.307558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:02.307560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:02.307572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601840787750457:5264]
2025-10-10T14:36:02.307576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601840787750457:5264]
2025-10-10T14:36:02.307581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601840787750457:5264]
2025-10-10T14:36:02.307634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:02.307635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:02.307642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:02.307647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.307650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:02.307650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:02.307790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:02.309876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:02.358511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601841569979618:6939]
2025-10-10T14:36:02.358838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1880, pipe: [1:7559601841569979618:6939]
2025-10-10T14:36:02.422795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:02.423227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.423244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.423292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979618:6939], now have 1 active actors on pipe
2025-10-10T14:36:02.423503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:02.423981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601841569979618:6939]
2025-10-10T14:36:02.424007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:02.424037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:02.424104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1881 reason: status is not ok: tablet will be restarted right now sessionId: src_id|687d3142-c7c8162c-5fc24565-203a57ae_0
2025-10-10T14:36:02.424269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1881 sessionId: src_id|687d3142-c7c8162c-5fc24565-203a57ae_0 is DEAD
2025-10-10T14:36:02.424436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687d3142-c7c8162c-5fc24565-203a57ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:02.424448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687d3142-c7c8162c-5fc24565-203a57ae_0] Write session will restart in 0.008812s
2025-10-10T14:36:02.424472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687d3142-c7c8162c-5fc24565-203a57ae_0] Write session: Do CDS request
2025-10-10T14:36:02.424479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687d3142-c7c8162c-5fc24565-203a57ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:02.434918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687d3142-c7c8162c-5fc24565-203a57ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.434961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:02.434983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1882
2025-10-10T14:36:02.435184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.435235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:02.435241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:02.435245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:02.435716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1882 sessionId:  describe result for acl check
2025-10-10T14:36:02.435756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:02.435840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:02.435848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:02.435856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601841569979725:6264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:02.436459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601841569979725:6264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:02.439489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601841569979725:6264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:02.440642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:02.442979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:02.443221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:02.443231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:02.443243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:02.443301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:02.443359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601840787750679:5253]
2025-10-10T14:36:02.443434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601841569979725:6264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:02.443449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601841569979725:6264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:02.443453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601841569979725:6264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:02.443463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:02.444018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:02.444354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:02.444401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:02.444751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:02.444811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.444817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.444819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.444820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.444822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.444824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.444825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.444826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.444827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.444828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.444830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.444831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.444833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.444839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.444854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.444858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.444862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.444867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.444871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.444875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.444879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.444884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.444888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.444892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.444897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.444901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.444908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.444918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.444925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.444931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.444942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.444947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.444952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.444962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.444967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.444977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.444982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.444993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.445000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.445011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.445016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.445026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.445030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.445035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.445045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.445051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.445061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.445066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.445071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.445081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.445086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.445093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.445136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:02.448174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:02.448903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:02.448918Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:02.448921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:02.448925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:02.448932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1881 [2:7559601840787750679:5253]
2025-10-10T14:36:02.448946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:02.448965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:02.448973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.448977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.448979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.448998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:02.449009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:02.449018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:02.449086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.449094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.449095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.449098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:02.449171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:02.449180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.449194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.449206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.449224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:02.449252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979828:6264], now have 1 active actors on pipe
2025-10-10T14:36:02.449260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979619:2438], now have 1 active actors on pipe
2025-10-10T14:36:02.449267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601840787750673:5253]
2025-10-10T14:36:02.449270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601840787750673:5253]
2025-10-10T14:36:02.449271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601840787750673:5253]
2025-10-10T14:36:02.449294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:02.449312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:02.449317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:02.449323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:02.449324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:02.449372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:02.449382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:02.449419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601840787750673:5253]
2025-10-10T14:36:02.449431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:02.449397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1881
2025-10-10T14:36:02.449401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1881
2025-10-10T14:36:02.449463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:02.449545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.449559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.449595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30d2b0cb-d886b025-89546944-8ada4990_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:02.449616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.449621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.449624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:02.449641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.449668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:02.449686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.449895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.449914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.449937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.450069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1882 partition: 0 MaxSeqNo: 40 sessionId: src_id|30d2b0cb-d886b025-89546944-8ada4990_0
2025-10-10T14:36:02.450513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687d3142-c7c8162c-5fc24565-203a57ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|30d2b0cb-d886b025-89546944-8ada4990_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:02.453256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d2b0cb-d886b025-89546944-8ada4990_0] Write session: try to update token
2025-10-10T14:36:02.453275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d2b0cb-d886b025-89546944-8ada4990_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:02.467635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:02.467651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:02.467664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601840787750673:5253]
2025-10-10T14:36:02.467724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:02.467726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:02.467918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:02.468121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.468276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.468418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.468627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:02.468669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:02.473209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId: src_id|30d2b0cb-d886b025-89546944-8ada4990_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:02.475810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:02.476019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.476041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.476083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:02.476192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:02.480440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:02.480462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:02.480465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:02.480468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:02.480478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601840787750673:5253]
2025-10-10T14:36:02.480482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601840787750673:5253]
2025-10-10T14:36:02.480487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601840787750673:5253]
2025-10-10T14:36:02.480537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:02.480545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.480547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:02.480549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:02.480557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:02.480562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:02.480699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:02.521804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601841569979840:6939]
2025-10-10T14:36:02.522128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1881, pipe: [1:7559601841569979840:6939]
2025-10-10T14:36:02.605889Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:02.614760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.614793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.614984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.615053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.615124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.615193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.615239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.615251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.615323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.615391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.615463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.615534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.615578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.615590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.615662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.615732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.615794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.615856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.615897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.615901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.615973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.616035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.616097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.616159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.616200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.616204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.616274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.616334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.616396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.616460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.616505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.616508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.616577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.616635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.616699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.616766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.617475Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 18 CurrentSessionLifetimeMs: 301370 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:36:02.618594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601841569979840:6939]
2025-10-10T14:36:02.618613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:02.618617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:02.618625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:02.618652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1882 reason: error at write: Disconnected sessionId: src_id|30d2b0cb-d886b025-89546944-8ada4990_0
2025-10-10T14:36:02.618866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1882 sessionId: src_id|30d2b0cb-d886b025-89546944-8ada4990_0 is DEAD
2025-10-10T14:36:02.619202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d2b0cb-d886b025-89546944-8ada4990_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:02.619226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d2b0cb-d886b025-89546944-8ada4990_0] Write session will restart in 0.007987s
2025-10-10T14:36:02.619254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d2b0cb-d886b025-89546944-8ada4990_0] Write session: Do CDS request
2025-10-10T14:36:02.619260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d2b0cb-d886b025-89546944-8ada4990_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:02.616809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.616812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.616883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.616944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.617008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.617069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.617190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.617194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.617262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.617507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.617571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.617632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.617671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.617674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.617746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.617805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.617868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.617927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.617968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.617970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.618041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.618099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.618162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.618225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.618265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.618268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.618343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979840:6939], now have 1 active actors on pipe
2025-10-10T14:36:02.619596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:02.628892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d2b0cb-d886b025-89546944-8ada4990_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.629002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:02.629018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1883
2025-10-10T14:36:02.629156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.629194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:02.629204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:02.629208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:02.629761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1883 sessionId:  describe result for acl check
2025-10-10T14:36:02.629800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:02.629808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:02.629810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:02.629817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601841569979897:6260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:02.630383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601841569979897:6260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:02.634793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601841569979897:6260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:02.637837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601841569979897:6260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:02.637853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601841569979897:6260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:02.637857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601841569979897:6260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:02.637867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:02.639086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:02.641680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:02.641910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:02.641921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:02.641933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:02.641984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:02.642029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601840787750898:5256]
2025-10-10T14:36:02.642634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:02.642987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:02.643030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:02.643355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:02.643416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.643420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.643421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.643422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.643424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.643425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.643427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.643428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.643430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.643430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.643432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.643433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.643434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.643439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.643452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.643455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.643459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.643463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.643466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.643470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.643473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.643477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.643481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.643484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.643487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.643491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.643498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.643506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.643513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.643518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.643522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.643526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.643530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.643536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.643540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.643545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.643549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.643554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.643558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.643563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.643566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.643572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.643576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.643581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.643585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.643590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.643594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.643598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.643603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.643608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.643612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.643616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.643653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:02.646410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:02.646738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:02.646751Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:02.646754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:02.646759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:02.646765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1882 [2:7559601840787750898:5256]
2025-10-10T14:36:02.646778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:02.646799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:02.646802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.646806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.646808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.646828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:02.646836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:02.646845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:02.646907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.646910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.646912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.646915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:02.646986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:02.646989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.647000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.647013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.647032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:02.647058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569979842:2438], now have 1 active actors on pipe
2025-10-10T14:36:02.647068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569980050:6260], now have 1 active actors on pipe
2025-10-10T14:36:02.647075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601840787750893:5256]
2025-10-10T14:36:02.647078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601840787750893:5256]
2025-10-10T14:36:02.647081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601840787750893:5256]
2025-10-10T14:36:02.647095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:02.647109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:02.647113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:02.647117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:02.647119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:02.647131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:02.647135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:02.647126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1882
2025-10-10T14:36:02.647148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1882
2025-10-10T14:36:02.647162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601840787750893:5256]
2025-10-10T14:36:02.647175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:02.647184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:02.647239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.647250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.647281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b98a251-49fc0e4a-d77203f5-20488094_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:02.647294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.647304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.647306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:02.647318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.647334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:02.647354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.647487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.647495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.647510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.647620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1883 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b98a251-49fc0e4a-d77203f5-20488094_0
2025-10-10T14:36:02.648039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d2b0cb-d886b025-89546944-8ada4990_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b98a251-49fc0e4a-d77203f5-20488094_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:02.651096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98a251-49fc0e4a-d77203f5-20488094_0] Write session: try to update token
2025-10-10T14:36:02.651114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98a251-49fc0e4a-d77203f5-20488094_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:02.662724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:02.662746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:02.662757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601840787750893:5256]
2025-10-10T14:36:02.662812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:02.662992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:02.663136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.663267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.663403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.663664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:02.663710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:02.663823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:02.669804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId: src_id|7b98a251-49fc0e4a-d77203f5-20488094_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:02.673013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:02.673400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.673422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.673465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:02.673586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:02.681836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:02.681855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:02.681858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:02.681861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:02.681872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601840787750893:5256]
2025-10-10T14:36:02.681877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601840787750893:5256]
2025-10-10T14:36:02.681881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601840787750893:5256]
2025-10-10T14:36:02.681931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:02.681941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.681944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:02.682080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:02.683731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:02.683748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:02.683752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:02.718927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601841569980071:6939]
2025-10-10T14:36:02.719228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1882, pipe: [1:7559601841569980071:6939]
2025-10-10T14:36:02.803929Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:02.812541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.812573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.812759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.812822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.812887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.812957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.813522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.813539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.813615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.813682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.813754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.813823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.813869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.813878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.813956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.814035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.814101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.814165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.814210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.814217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.814287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.814352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.814414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.814479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.814531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.814538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.814610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.814675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.814739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.814806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.814857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.814864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.814936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.815002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.815073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.815139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.815187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.815194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.815262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.815324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.815387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.815456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.815508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.815516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.815588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.815651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.815718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.815786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.815832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.815839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.815905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.815967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.816034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.816100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.816146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.816153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.816225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.816290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.816423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.816497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.816549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.816558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.816629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569980071:6939], now have 1 active actors on pipe
2025-10-10T14:36:02.817127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:02.817462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98a251-49fc0e4a-d77203f5-20488094_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:02.817475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98a251-49fc0e4a-d77203f5-20488094_0] Write session will restart in 0.007531s
2025-10-10T14:36:02.817501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98a251-49fc0e4a-d77203f5-20488094_0] Write session: Do CDS request
2025-10-10T14:36:02.817507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98a251-49fc0e4a-d77203f5-20488094_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:02.816972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:02.816994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601841569980071:6939]
2025-10-10T14:36:02.817028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:02.817031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:02.817072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1883 reason: error at write: Disconnected sessionId: src_id|7b98a251-49fc0e4a-d77203f5-20488094_0
2025-10-10T14:36:02.817306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1883 sessionId: src_id|7b98a251-49fc0e4a-d77203f5-20488094_0 is DEAD
2025-10-10T14:36:02.825906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98a251-49fc0e4a-d77203f5-20488094_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.826249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:02.826264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1884
2025-10-10T14:36:02.826406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:02.826454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:02.826467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:02.826472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:02.826969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1884 sessionId:  describe result for acl check
2025-10-10T14:36:02.827019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:02.827026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:02.827028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:02.827034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601841569980128:6252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:02.827632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601841569980128:6252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:02.830998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601841569980128:6252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:02.835639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601841569980128:6252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:02.835654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601841569980128:6252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:02.835659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601841569980128:6252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:02.835669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:02.836837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:02.839089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:02.839304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:02.839313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:02.839323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:02.839367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:02.839402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601840787751117:5249]
2025-10-10T14:36:02.839829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:02.840085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:02.840124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:02.840358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:02.840402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.840408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.840408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.840409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.840410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.840411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.840412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.840412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.840413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.840414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.840414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.840415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.840416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.840419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.840429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.840431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.840434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.840438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.840442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.840446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.840450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.840454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.840458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.840463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.840466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.840469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.840475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.840481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:02.840486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.840490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:02.840497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.840500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:02.840503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.840512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:02.840517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.840526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:02.840535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.840545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:02.840551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.840555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:02.840558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.840565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:02.840569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.840572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:02.840575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.840579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:02.840582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.840585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.840588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.840592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.840594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.840597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.840619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:02.843227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:02.843562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:02.843572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:02.843574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:02.843578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:02.843585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1883 [2:7559601840787751117:5249]
2025-10-10T14:36:02.843597Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:02.843614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:02.843616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.843620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.843623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.843640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:02.843648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:02.843660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:02.843716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.843726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.843728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.843731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:02.843803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:02.843810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.843822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:02.843839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:02.843857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:02.843876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569980077:2438], now have 1 active actors on pipe
2025-10-10T14:36:02.843885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569980284:6252], now have 1 active actors on pipe
2025-10-10T14:36:02.843902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601840787751112:5249]
2025-10-10T14:36:02.843908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601840787751112:5249]
2025-10-10T14:36:02.843911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601840787751112:5249]
2025-10-10T14:36:02.843927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:02.843945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:02.843956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:02.843960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:02.843962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:02.843966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:02.843970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:02.843989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601840787751112:5249]
2025-10-10T14:36:02.843995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:02.843998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:02.843977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1883
2025-10-10T14:36:02.844020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1883
2025-10-10T14:36:02.844173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.844191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.844222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f590872-9b17621-f85835cd-f00dbc93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:02.844232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:02.844236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:02.844239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:02.844252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:02.844266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:02.844288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.844555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.844563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.844590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:02.844712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1884 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f590872-9b17621-f85835cd-f00dbc93_0
2025-10-10T14:36:02.845138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b98a251-49fc0e4a-d77203f5-20488094_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f590872-9b17621-f85835cd-f00dbc93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:02.847983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f590872-9b17621-f85835cd-f00dbc93_0] Write session: try to update token
2025-10-10T14:36:02.848004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f590872-9b17621-f85835cd-f00dbc93_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:02.855884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:02.855902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:02.855914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601840787751112:5249]
2025-10-10T14:36:02.855964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:02.855969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:02.856148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:02.856286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.856427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.856585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:02.856789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:02.856829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:02.862100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId: src_id|6f590872-9b17621-f85835cd-f00dbc93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:02.864904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:02.865131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.865150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.865189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:02.865257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:02.874559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:02.874583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:02.874586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:02.874589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:02.874600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601840787751112:5249]
2025-10-10T14:36:02.874604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601840787751112:5249]
2025-10-10T14:36:02.874608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601840787751112:5249]
2025-10-10T14:36:02.874664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:02.874665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:02.874672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:02.874677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:02.874678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:02.874681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:02.874849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:02.917087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601841569980311:6939]
2025-10-10T14:36:02.917392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1883, pipe: [1:7559601841569980311:6939]
2025-10-10T14:36:02.988203Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:02.996759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:02.996793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:02.996982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.997051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.997112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.997177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.997216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.997221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.997311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.000571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:03.000636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:03.000640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:03.000677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1884 reason: error at write: Disconnected sessionId: src_id|6f590872-9b17621-f85835cd-f00dbc93_0
2025-10-10T14:36:03.000880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1884 sessionId: src_id|6f590872-9b17621-f85835cd-f00dbc93_0 is DEAD
2025-10-10T14:36:03.001326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f590872-9b17621-f85835cd-f00dbc93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:03.001352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f590872-9b17621-f85835cd-f00dbc93_0] Write session will restart in 0.008950s
2025-10-10T14:36:03.001382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f590872-9b17621-f85835cd-f00dbc93_0] Write session: Do CDS request
2025-10-10T14:36:03.001389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f590872-9b17621-f85835cd-f00dbc93_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:03.001094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601841569980311:6939]
2025-10-10T14:36:02.997461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.997531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.997599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.997646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.997650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.997720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.997773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.997832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.997895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.997937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.997941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.998009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.998069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.998129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.998190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.998238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.998242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.998311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.998369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.998427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.998487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.998530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.998533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.998601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.998658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.998714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.998799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.998841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.998847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.998912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.998970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.999035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.999096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.999136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.999139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.999209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.999267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.999327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.999387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.999428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.999432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.999505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.999563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.999623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.999686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:02.999727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:02.999731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:02.999798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:02.999855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:02.999916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:02.999977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.000122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.000126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.000204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601841569980311:6939], now have 1 active actors on pipe
2025-10-10T14:36:03.001922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:03.011894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f590872-9b17621-f85835cd-f00dbc93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.012030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:03.012046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1885
2025-10-10T14:36:03.013570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.013613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:03.013629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:03.013635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:03.014143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1885 sessionId:  describe result for acl check
2025-10-10T14:36:03.014172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:03.014174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:03.014175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:03.014182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601845864947637:6242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:03.014754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601845864947637:6242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:03.019913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601845864947637:6242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:03.026762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:03.029525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:03.029755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:03.029766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:03.029779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:03.029836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:03.029883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601845082718647:5237]
2025-10-10T14:36:03.030423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:03.030777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:03.030837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:03.031013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601845864947637:6242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:03.031032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601845864947637:6242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:03.031036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601845864947637:6242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:03.031045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:03.031238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:03.031302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.031309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.031310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.031311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.031312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.031314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.031315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.031316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.031317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.031319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.031320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.031321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.031323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.031329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.031343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.031347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.031352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.031355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.031360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.031363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.031367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.031371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.031377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.031381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.031385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.031389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.031397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.031406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.031413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.031419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.031424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.031429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.031435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.031440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.031444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.031448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.031459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.031464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.031473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.031479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.031483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.031493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.031498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.031503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.031512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.031517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.031522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.031533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.031537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.031547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.031551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.031557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.031601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:03.033959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:03.034454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:03.034467Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:03.034470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:03.034474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:03.034480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1884 [2:7559601845082718647:5237]
2025-10-10T14:36:03.034494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:03.034517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:03.034524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.034527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.034530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.034546Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:03.034558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:03.034570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:03.034629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.034636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.034639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.034641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:03.034718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:03.034728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.034739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.034752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.034769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:03.034792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864947823:6242], now have 1 active actors on pipe
2025-10-10T14:36:03.034798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864947612:2438], now have 1 active actors on pipe
2025-10-10T14:36:03.034806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601845082718640:5237]
2025-10-10T14:36:03.034812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601845082718640:5237]
2025-10-10T14:36:03.034815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601845082718640:5237]
2025-10-10T14:36:03.034831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:03.034850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:03.034832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1884
2025-10-10T14:36:03.034844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1884
2025-10-10T14:36:03.034861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:03.034870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:03.034870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:03.034873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:03.034874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:03.034897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601845082718640:5237]
2025-10-10T14:36:03.034905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:03.034917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:03.034923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.034927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.034979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21339f93-52b7b47d-f338194e-d4128553_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:03.034993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.034997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.034999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:03.035013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.035027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:03.035050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.035222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.035234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.035269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.035388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1885 partition: 0 MaxSeqNo: 40 sessionId: src_id|21339f93-52b7b47d-f338194e-d4128553_0
2025-10-10T14:36:03.035797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f590872-9b17621-f85835cd-f00dbc93_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21339f93-52b7b47d-f338194e-d4128553_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:03.038563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21339f93-52b7b47d-f338194e-d4128553_0] Write session: try to update token
2025-10-10T14:36:03.038583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21339f93-52b7b47d-f338194e-d4128553_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:03.055621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:03.055642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:03.055645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:03.055648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:03.055658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601845082718640:5237]
2025-10-10T14:36:03.055664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601845082718640:5237]
2025-10-10T14:36:03.055668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601845082718640:5237]
2025-10-10T14:36:03.055724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:03.055737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.055740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:03.055879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:03.057703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:03.057724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:03.057729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:03.058063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId: src_id|21339f93-52b7b47d-f338194e-d4128553_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:03.060833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:03.101419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601845864947832:6939]
2025-10-10T14:36:03.101723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1884, pipe: [1:7559601845864947832:6939]
2025-10-10T14:36:03.170915Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:03.171238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.171259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.171320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864947832:6939], now have 1 active actors on pipe
2025-10-10T14:36:03.171573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:03.171649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:03.171657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:03.171721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1885 reason: error at write: Disconnected sessionId: src_id|21339f93-52b7b47d-f338194e-d4128553_0
2025-10-10T14:36:03.171752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601845864947832:6939]
2025-10-10T14:36:03.171596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:03.171920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1885 sessionId: src_id|21339f93-52b7b47d-f338194e-d4128553_0 is DEAD
2025-10-10T14:36:03.172073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21339f93-52b7b47d-f338194e-d4128553_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:03.172083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21339f93-52b7b47d-f338194e-d4128553_0] Write session will restart in 0.005151s
2025-10-10T14:36:03.172110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21339f93-52b7b47d-f338194e-d4128553_0] Write session: Do CDS request
2025-10-10T14:36:03.172119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21339f93-52b7b47d-f338194e-d4128553_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:03.178815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21339f93-52b7b47d-f338194e-d4128553_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.178896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:03.178910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1886
2025-10-10T14:36:03.179074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.179130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:03.179140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:03.179145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:03.179656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1886 sessionId:  describe result for acl check
2025-10-10T14:36:03.179693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:03.179696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:03.179698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:03.179704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601845864947862:6238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:03.180250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601845864947862:6238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:03.183071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601845864947862:6238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:03.186200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601845864947862:6238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:03.186213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601845864947862:6238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:03.186216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601845864947862:6238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:03.186224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:03.188048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:03.190101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:03.190279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:03.190288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:03.190297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:03.190335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:03.190373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601845082718868:5235]
2025-10-10T14:36:03.190907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:03.191217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:03.191266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:03.191599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:03.191656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.191662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.191663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.191665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.191666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.191667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.191668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.191670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.191671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.191672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.191674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.191675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.191676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.191682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.191696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.191700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.191705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.191708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.191713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.191716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.191720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.191724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.191729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.191733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.191737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.191741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.191749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.191758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.191764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.191769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.191776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.191781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.191785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.191796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.191800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.191806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.191815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.191820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.191824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.191828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.191837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.191841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.191846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.191850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.191854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.191858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.191862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.191867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.191871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.191877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.191882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.191891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.191929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:03.194272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:03.194625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:03.194637Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:03.194640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:03.194644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:03.194651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1885 [2:7559601845082718868:5235]
2025-10-10T14:36:03.194665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:03.194682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:03.194690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.194694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.194696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.194713Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:03.194720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:03.194733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:03.194792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.194799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.194801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.194803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:03.194880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:03.194887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.194898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.194911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.194927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:03.194952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948045:6238], now have 1 active actors on pipe
2025-10-10T14:36:03.194960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864947835:2438], now have 1 active actors on pipe
2025-10-10T14:36:03.194967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601845082718863:5235]
2025-10-10T14:36:03.194974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601845082718863:5235]
2025-10-10T14:36:03.194978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601845082718863:5235]
2025-10-10T14:36:03.194995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:03.195012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:03.195027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:03.195030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:03.195030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:03.195032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:03.195034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:03.195057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601845082718863:5235]
2025-10-10T14:36:03.195065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:03.195074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:03.195082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.195009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1885
2025-10-10T14:36:03.195026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1885
2025-10-10T14:36:03.195086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.195133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:03.195145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.195149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.195153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:03.195164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.195179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:03.195200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.195347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.195350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.195364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.195455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1886 partition: 0 MaxSeqNo: 40 sessionId: src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0
2025-10-10T14:36:03.195837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21339f93-52b7b47d-f338194e-d4128553_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:03.198623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0] Write session: try to update token
2025-10-10T14:36:03.198642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:03.212666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId: src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:03.215379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:03.215399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:03.215403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:03.215404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:03.215415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601845082718863:5235]
2025-10-10T14:36:03.215419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601845082718863:5235]
2025-10-10T14:36:03.215424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601845082718863:5235]
2025-10-10T14:36:03.215476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:03.215479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:03.215487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:03.215488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.215491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:03.215467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:03.215491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:03.215634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:03.271900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601845864948059:6939]
2025-10-10T14:36:03.272081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1885, pipe: [1:7559601845864948059:6939]
2025-10-10T14:36:03.330883Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:03.331150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.331165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.331209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948059:6939], now have 1 active actors on pipe
2025-10-10T14:36:03.331375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:03.331391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:03.331395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:03.331428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601845864948059:6939]
2025-10-10T14:36:03.331419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:03.331460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1886 reason: error at write: Disconnected sessionId: src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0
2025-10-10T14:36:03.331692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1886 sessionId: src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0 is DEAD
2025-10-10T14:36:03.331861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:03.331884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0] Write session will restart in 0.006797s
2025-10-10T14:36:03.331910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0] Write session: Do CDS request
2025-10-10T14:36:03.331916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:03.341145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.341247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:03.341315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1887
2025-10-10T14:36:03.341559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.341602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:03.341612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:03.341617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:03.342213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1887 sessionId:  describe result for acl check
2025-10-10T14:36:03.342255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:03.342258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:03.342260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:03.342267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601845864948154:6210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:03.342858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601845864948154:6210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:03.345363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601845864948154:6210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:03.348117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:03.348308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601845864948154:6210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:03.348321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601845864948154:6210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:03.348325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601845864948154:6210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:03.348334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:03.350714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:03.350908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:03.350920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:03.350932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:03.351006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:03.351049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601845082719128:5221]
2025-10-10T14:36:03.351593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:03.351894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:03.351939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:03.352260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:03.352326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.352332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.352334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.352335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.352336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.352337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.352338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.352339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.352341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.352342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.352343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.352344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.352345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.352351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.352365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.352369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.352373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.352377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.352382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.352386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.352390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.352394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.352399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.352403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.352407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.352409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.352415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.352421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.352426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.352429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.352432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.352435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.352438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.352441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.352445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.352450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.352455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.352460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.352466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.352471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.352476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.352481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.352486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.352491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.352496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.352501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.352508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.352511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.352514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.352517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.352519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.352522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.352559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:03.354987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:03.355695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:03.355715Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:03.355717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:03.355722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:03.355728Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1886 [2:7559601845082719128:5221]
2025-10-10T14:36:03.355740Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:03.355758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:03.355767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.355771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.355773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.355790Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:03.355797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:03.355805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:03.355869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.355877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.355879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.355881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:03.355947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:03.355955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.355966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.355978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.356000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:03.356026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948088:2438], now have 1 active actors on pipe
2025-10-10T14:36:03.356035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948298:6210], now have 1 active actors on pipe
2025-10-10T14:36:03.356043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601845082719122:5221]
2025-10-10T14:36:03.356046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601845082719122:5221]
2025-10-10T14:36:03.356049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601845082719122:5221]
2025-10-10T14:36:03.356062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:03.356075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:03.356081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:03.356090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:03.356092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:03.356092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:03.356095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:03.356097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1886
2025-10-10T14:36:03.356124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601845082719122:5221]
2025-10-10T14:36:03.356132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:03.356097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1886
2025-10-10T14:36:03.356135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:03.356161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.356170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.356206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:03.356219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.356223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.356225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:03.356236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.356246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:03.356273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.356471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.356482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.356498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.356582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1887 partition: 0 MaxSeqNo: 40 sessionId: src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0
2025-10-10T14:36:03.356996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1fbdfe-e19f028d-984b611c-72f8753c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:03.359826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0] Write session: try to update token
2025-10-10T14:36:03.359845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:03.375135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId: src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:03.377837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:03.378091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.378114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.378159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:03.378270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:03.381289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:03.381307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:03.381311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:03.381314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:03.381324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601845082719122:5221]
2025-10-10T14:36:03.381347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601845082719122:5221]
2025-10-10T14:36:03.381352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601845082719122:5221]
2025-10-10T14:36:03.381405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:03.381413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:03.381418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.381420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:03.381421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:03.381425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:03.381564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:03.431641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601845864948310:6939]
2025-10-10T14:36:03.432001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1886, pipe: [1:7559601845864948310:6939]
2025-10-10T14:36:03.495743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:03.504789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.504825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.505023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.505090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.505153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.505225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.505296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.505302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.505442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.505503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.505563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.505634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.505679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.505685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.505758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.505816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.505898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.505977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.506028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.506037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.506108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.506177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.506252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.506326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.506379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.506389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.506458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.506523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.506593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.506662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.506714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.506725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.506797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.506868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.506937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.507004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.507052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.507060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.507133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.507202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.507276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.507339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.507388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.507401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.507471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.507535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.507606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.507673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.507717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.507728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.507798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.507861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.507928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.507994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.508042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.508056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.508126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:03.508188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:03.508249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:03.508309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:03.508361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:03.508364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:03.508429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948310:6939], now have 1 active actors on pipe
2025-10-10T14:36:03.508692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:03.508698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:03.508703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:03.508733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1887 reason: error at write: Disconnected sessionId: src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0
2025-10-10T14:36:03.508753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601845864948310:6939]
2025-10-10T14:36:03.508839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:03.508970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1887 sessionId: src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0 is DEAD
2025-10-10T14:36:03.509089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:03.509098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0] Write session will restart in 0.009106s
2025-10-10T14:36:03.509123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0] Write session: Do CDS request
2025-10-10T14:36:03.509130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:03.520946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.521074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:03.521089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1888
2025-10-10T14:36:03.521515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.521574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:03.521581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:03.521585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:03.522327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1888 sessionId:  describe result for acl check
2025-10-10T14:36:03.522367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:03.522369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:03.522371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:03.522378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601845864948347:6208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:03.522980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601845864948347:6208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:03.527853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601845864948347:6208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:03.532363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601845864948347:6208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:03.532381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601845864948347:6208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:03.532386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601845864948347:6208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:03.532396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:03.535439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:03.538043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:03.538282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:03.538294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:03.538306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:03.538362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:03.538411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601845082719352:5219]
2025-10-10T14:36:03.539067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:03.539383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:03.539457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:03.539821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:03.539876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.539878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.539879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.539880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.539882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.539883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.539884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.539886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.539887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.539888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.539890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.539891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.539893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.539900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.539915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.539919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.539924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.539928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.539933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.539937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.539942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.539946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.539951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.539955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.539960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.539964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.539972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.539982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.539990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.539996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.540001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.540007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.540012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.540018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.540023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.540029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.540034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.540039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.540046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.540051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.540056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.540061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.540067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.540073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.540077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.540083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.540088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.540093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.540098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.540104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.540109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.540115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.540160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:03.542689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:03.543118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:03.543133Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:03.543135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:03.543139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:03.543146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1887 [2:7559601845082719352:5219]
2025-10-10T14:36:03.543159Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:03.543176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:03.543184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.543189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.543191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.543210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:03.543905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1887
2025-10-10T14:36:03.543223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:03.543252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:03.543315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.543317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.543319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.543322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:03.543664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:03.543668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.543682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.543958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1887
2025-10-10T14:36:03.543696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.543717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:03.543741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948313:2438], now have 1 active actors on pipe
2025-10-10T14:36:03.543745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948510:6208], now have 1 active actors on pipe
2025-10-10T14:36:03.543754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601845082719347:5219]
2025-10-10T14:36:03.543756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601845082719347:5219]
2025-10-10T14:36:03.543758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601845082719347:5219]
2025-10-10T14:36:03.543773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:03.543788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:03.543794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:03.543799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:03.543801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:03.543805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:03.543809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:03.543835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601845082719347:5219]
2025-10-10T14:36:03.543843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:03.543849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:03.544071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.544086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.544119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|738f9b2b-d256485b-1fd89059-26170f70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:03.544134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.544138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.544141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:03.544153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.544171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:03.544189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.546731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1888 partition: 0 MaxSeqNo: 40 sessionId: src_id|738f9b2b-d256485b-1fd89059-26170f70_0
2025-10-10T14:36:03.547171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bba08b9-5efd9db6-c0dfc542-8f5857b7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|738f9b2b-d256485b-1fd89059-26170f70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:03.546525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.546540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.546576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.549939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|738f9b2b-d256485b-1fd89059-26170f70_0] Write session: try to update token
2025-10-10T14:36:03.549959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|738f9b2b-d256485b-1fd89059-26170f70_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:03.563759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:03.563778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:03.563781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:03.563784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:03.563796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601845082719347:5219]
2025-10-10T14:36:03.563800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601845082719347:5219]
2025-10-10T14:36:03.563804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601845082719347:5219]
2025-10-10T14:36:03.563855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:03.563858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:03.563862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:03.563865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.563868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:03.563878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:03.564024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:03.565561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId: src_id|738f9b2b-d256485b-1fd89059-26170f70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:03.568318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:03.608797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601845864948539:6939]
2025-10-10T14:36:03.609076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1887, pipe: [1:7559601845864948539:6939]
2025-10-10T14:36:03.680295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:03.680746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.680761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.680810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948539:6939], now have 1 active actors on pipe
2025-10-10T14:36:03.681044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:03.681095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:03.681149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:03.681152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:03.681221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1888 reason: error at write: Disconnected sessionId: src_id|738f9b2b-d256485b-1fd89059-26170f70_0
2025-10-10T14:36:03.681460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1888 sessionId: src_id|738f9b2b-d256485b-1fd89059-26170f70_0 is DEAD
2025-10-10T14:36:03.681600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601845864948539:6939]
2025-10-10T14:36:03.685296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738f9b2b-d256485b-1fd89059-26170f70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:03.685310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738f9b2b-d256485b-1fd89059-26170f70_0] Write session will restart in 0.005939s
2025-10-10T14:36:03.685356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738f9b2b-d256485b-1fd89059-26170f70_0] Write session: Do CDS request
2025-10-10T14:36:03.685366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738f9b2b-d256485b-1fd89059-26170f70_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:03.692890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|738f9b2b-d256485b-1fd89059-26170f70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.693286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:03.693301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1889
2025-10-10T14:36:03.693445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.693495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:03.693506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:03.693511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:03.693984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1889 sessionId:  describe result for acl check
2025-10-10T14:36:03.694020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:03.694022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:03.694024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:03.694033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601845864948563:6189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:03.694671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601845864948563:6189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:03.705887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601845864948563:6189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:03.716038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601845864948563:6189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:03.716055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601845864948563:6189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:03.716059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601845864948563:6189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:03.716068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:03.724187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:03.726925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:03.727397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:03.727403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:03.727418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:03.727502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:03.727543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601845082719577:5210]
2025-10-10T14:36:03.728205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:03.728628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:03.728683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:03.729049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:03.729109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.729111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.729112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.729113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.729115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.729116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.729117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.729119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.729120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.729121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.729122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.729124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.729125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.729132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.729147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.729151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.729156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.729160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.729165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.729168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.729172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.729176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.729181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.729185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.729188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.729191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.729200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.729211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.729217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.729223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.729228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.729234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.729238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.729244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.729249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.729267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.729273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.729279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.729285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.729291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.729296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.729301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.729306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.729311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.729315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.729321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.729326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.729347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.729353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.729357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.729362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.729367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.729411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:03.732972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:03.734024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1888
2025-10-10T14:36:03.734061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1888
2025-10-10T14:36:03.733347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:03.733360Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:03.733364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:03.733368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:03.733376Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1888 [2:7559601845082719577:5210]
2025-10-10T14:36:03.733619Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:03.733641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:03.733645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.733649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.733652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.733671Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:03.733679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:03.733688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:03.733774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.733778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.733780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.733783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:03.733858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:03.733861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.733873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.733884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.733903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:03.733926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948543:2438], now have 1 active actors on pipe
2025-10-10T14:36:03.733930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948696:6189], now have 1 active actors on pipe
2025-10-10T14:36:03.733937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601845082719572:5210]
2025-10-10T14:36:03.733939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601845082719572:5210]
2025-10-10T14:36:03.733941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601845082719572:5210]
2025-10-10T14:36:03.733956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:03.733973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:03.733975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:03.733979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:03.733981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:03.733989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:03.733993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:03.734025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601845082719572:5210]
2025-10-10T14:36:03.734033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:03.734039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:03.734248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.734257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.734297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:03.734313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.734319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.734322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:03.734336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.734350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:03.734367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.734604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.734613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.734638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.734742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1889 partition: 0 MaxSeqNo: 40 sessionId: src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0
2025-10-10T14:36:03.735234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|738f9b2b-d256485b-1fd89059-26170f70_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:03.738150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0] Write session: try to update token
2025-10-10T14:36:03.738172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:03.754593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId: src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:03.757239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:03.756860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:03.756878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:03.756882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:03.756884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:03.756894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601845082719572:5210]
2025-10-10T14:36:03.756900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601845082719572:5210]
2025-10-10T14:36:03.756905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601845082719572:5210]
2025-10-10T14:36:03.756951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:03.756958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:03.756961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:03.756962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:03.756970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.756973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:03.757133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:03.781846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601845864948777:6939]
2025-10-10T14:36:03.782298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1888, pipe: [1:7559601845864948777:6939]
2025-10-10T14:36:03.881267Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:03.881752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.881767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.881815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948777:6939], now have 1 active actors on pipe
2025-10-10T14:36:03.882005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:03.883130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:03.883195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601845864948777:6939]
2025-10-10T14:36:03.883265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:03.883342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1889 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0
2025-10-10T14:36:03.883542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1889 sessionId: src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0 is DEAD
2025-10-10T14:36:03.884848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:03.884860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0] Write session will restart in 0.005206s
2025-10-10T14:36:03.884880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0] Write session: Do CDS request
2025-10-10T14:36:03.884886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:03.890949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.895999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:03.896017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1890
2025-10-10T14:36:03.896328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:03.896381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:03.896394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:03.896399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:03.896846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1890 sessionId:  describe result for acl check
2025-10-10T14:36:03.896881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:03.896888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:03.896890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:03.896897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601845864948806:6191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:03.897559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601845864948806:6191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:03.905283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601845864948806:6191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:03.911854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601845864948806:6191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:03.911871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601845864948806:6191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:03.911874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601845864948806:6191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:03.911885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:03.921760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:03.925465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:03.925757Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:03.925764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:03.925777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:03.925844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:03.925899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601845082719816:5203]
2025-10-10T14:36:03.926601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:03.926977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:03.927039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:03.927387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:03.927457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.927458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.927460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.927461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.927462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.927464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.927465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.927466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.927467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.927468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.927470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.927471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.927472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.927479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.927492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.927496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.927500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.927503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.927508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.927512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.927516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.927520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.927527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.927530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.927534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.927538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.927547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.927555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:03.927563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.927568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:03.927573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.927578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:03.927583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.927589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:03.927593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.927599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:03.927603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.927609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:03.927614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.927619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:03.927624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.927630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:03.927635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.927640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:03.927645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.927650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:03.927655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.927663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.927668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.927683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.927688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.927692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.927738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:03.930670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:03.931230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:03.931254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:03.931257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:03.931261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:03.931269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1889 [2:7559601845082719816:5203]
2025-10-10T14:36:03.931287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:03.931311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:03.931325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.931328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.931331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.931354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:03.931371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:03.931388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:03.931469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.931477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.931479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.931482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:03.931554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:03.931564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.931578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:03.931589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:03.931606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:03.931638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948792:2438], now have 1 active actors on pipe
2025-10-10T14:36:03.931647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864948957:6191], now have 1 active actors on pipe
2025-10-10T14:36:03.931656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601845082719810:5203]
2025-10-10T14:36:03.931665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601845082719810:5203]
2025-10-10T14:36:03.931668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601845082719810:5203]
2025-10-10T14:36:03.931683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:03.931702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:03.931706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:03.931705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:03.931707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:03.931724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:03.931728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:03.931715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1889
2025-10-10T14:36:03.931763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601845082719810:5203]
2025-10-10T14:36:03.931772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:03.931737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1889
2025-10-10T14:36:03.931775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:03.931812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.931821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.931862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:03.931876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:03.931880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:03.931882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:03.931894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:03.931905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:03.931927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.932074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:03.932081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:03.932097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:03.932198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1890 partition: 0 MaxSeqNo: 40 sessionId: src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0
2025-10-10T14:36:03.932606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a171ef8d-7177cb5a-76c28473-a686e34d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:03.935502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0] Write session: try to update token
2025-10-10T14:36:03.935524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:03.955546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:03.955565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:03.955569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:03.955576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:03.955586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601845082719810:5203]
2025-10-10T14:36:03.955590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601845082719810:5203]
2025-10-10T14:36:03.955594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601845082719810:5203]
2025-10-10T14:36:03.955647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:03.955655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:03.955659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:03.955799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:03.955843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:03.955852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:03.955858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:03.957894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId: src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:03.960468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:03.983533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601845864949040:6939]
2025-10-10T14:36:03.983997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1889, pipe: [1:7559601845864949040:6939]
2025-10-10T14:36:04.073534Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:04.074186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.074197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.074247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601845864949040:6939], now have 1 active actors on pipe
2025-10-10T14:36:04.074636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:04.074698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:04.074785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1890 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0
2025-10-10T14:36:04.074600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:04.075087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1890 sessionId: src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0 is DEAD
2025-10-10T14:36:04.075146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601845864949040:6939]
2025-10-10T14:36:04.077288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:04.077305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0] Write session will restart in 0.008210s
2025-10-10T14:36:04.077344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0] Write session: Do CDS request
2025-10-10T14:36:04.077352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:04.086980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.093844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:04.093859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1891
2025-10-10T14:36:04.094232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.094272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:04.094278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:04.094281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:04.094760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1891 sessionId:  describe result for acl check
2025-10-10T14:36:04.094797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:04.094804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:04.094806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:04.094812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601850159916511:6185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:04.095395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601850159916511:6185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:04.100456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:04.101436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601850159916511:6185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:04.103762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601850159916511:6185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:04.103776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601850159916511:6185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:04.103780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601850159916511:6185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:04.103790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:04.103497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:04.103765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:04.103771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:04.103785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:04.103849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:04.103893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601849377687337:5186]
2025-10-10T14:36:04.104523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:04.104890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:04.104942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:04.105325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:04.105410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.105411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.105413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.105414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.105415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.105417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.105419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.105420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.105421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.105422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.105424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.105425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.105426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.105433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.105447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.105451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.105456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.105460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.105464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.105468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.105473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.105477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.105481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.105485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.105489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.105493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.105501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.105511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.105518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.105525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.105530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.105536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.105541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.105546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.105554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.105559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.105564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.105570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.105574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.105580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.105584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.105591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.105596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.105602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.105607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.105612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.105616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.105621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.105626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.105631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.105636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.105641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.105683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:04.108828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:04.109349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:04.109370Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:04.109373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:04.109378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:04.109385Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1890 [2:7559601849377687337:5186]
2025-10-10T14:36:04.109401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:04.109424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:04.109428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.109432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.109436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.109458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:04.109479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:04.109490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:04.109840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1890
2025-10-10T14:36:04.109850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1890
2025-10-10T14:36:04.109589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.109605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.109608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.109611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:04.110097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:04.110103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.110120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.110132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.110151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:04.110183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159916555:6185], now have 1 active actors on pipe
2025-10-10T14:36:04.110187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159916338:2438], now have 1 active actors on pipe
2025-10-10T14:36:04.110209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.110214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.110236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601849377687332:5186]
2025-10-10T14:36:04.110239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601849377687332:5186]
2025-10-10T14:36:04.110241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601849377687332:5186]
2025-10-10T14:36:04.110265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:04.110292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:04.110307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:04.110311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:04.110313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:04.110316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:04.110321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:04.110346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:04.110355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.110361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.110364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:04.110382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.110397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:04.110449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601849377687332:5186]
2025-10-10T14:36:04.110464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:04.110467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:04.110480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.110726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.110740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.110761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.111089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1891 partition: 0 MaxSeqNo: 40 sessionId: src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0
2025-10-10T14:36:04.111526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10fc64a-cdb7017a-7590cc14-d4466a75_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:04.114493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0] Write session: try to update token
2025-10-10T14:36:04.114513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:04.130089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:04.130114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:04.130127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601849377687332:5186]
2025-10-10T14:36:04.130191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:04.130203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:04.130454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:04.130618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:04.130763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:04.130901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:04.131110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:04.131159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:04.134290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId: src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:04.137776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:04.138761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.138787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.138834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:04.138929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:04.142735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:04.142755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:04.142759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:04.142760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:04.142771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601849377687332:5186]
2025-10-10T14:36:04.142775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601849377687332:5186]
2025-10-10T14:36:04.142779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601849377687332:5186]
2025-10-10T14:36:04.142826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:04.142831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:04.142833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:04.142838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:04.142839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.142842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:04.142978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:04.174577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601850159916568:6939]
2025-10-10T14:36:04.174882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1890, pipe: [1:7559601850159916568:6939]
2025-10-10T14:36:04.258087Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:04.266869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.266898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.267090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.267161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.267230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.267310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.267360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.267373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.267465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.267553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.267624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.267697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.267748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.267756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.267822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.267896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.267965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.268039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.268083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.268087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.268162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.268232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.268303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.268369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.268408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.268412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.268483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.268543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.268604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.268665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.268707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.268710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.268781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.268841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.268901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.268963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.269144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.269147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.269222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.269301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.271165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:04.271178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:04.271209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1891 reason: error at write: Disconnected sessionId: src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0
2025-10-10T14:36:04.271429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1891 sessionId: src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0 is DEAD
2025-10-10T14:36:04.271549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:04.271561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0] Write session will restart in 0.006527s
2025-10-10T14:36:04.271596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0] Write session: Do CDS request
2025-10-10T14:36:04.271604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:04.271620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:04.271669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601850159916568:6939]
2025-10-10T14:36:04.269518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.269588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.269630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.269633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.269704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.269763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.269820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.269880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.269921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.269924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.269990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.270044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.270108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.270171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.270212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.270215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.270286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.270350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.270411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.270474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.270515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.270518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.270593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159916568:6939], now have 1 active actors on pipe
2025-10-10T14:36:04.271811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:04.278945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.279036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:04.279051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1892
2025-10-10T14:36:04.279210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.279245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:04.279256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:04.279260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:04.279707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1892 sessionId:  describe result for acl check
2025-10-10T14:36:04.279743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:04.279745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:04.279747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:04.279754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601850159916585:6184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:04.280693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601850159916585:6184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:04.283776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601850159916585:6184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:04.286760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601850159916585:6184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:04.286773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601850159916585:6184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:04.286777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601850159916585:6184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:04.286787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:04.291690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:04.294680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:04.294946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:04.294962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:04.294975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:04.295042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:04.295095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601849377687565:5199]
2025-10-10T14:36:04.295750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:04.296141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:04.296209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:04.296584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:04.296652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.296658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.296659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.296660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.296661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.296662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.296663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.296665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.296667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.296668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.296670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.296671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.296672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.296681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.296696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.296700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.296705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.296709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.296714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.296718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.296722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.296727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.296731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.296735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.296739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.296743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.296752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.296762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.296774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.296780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.296790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.296796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.296801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.296807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.296812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.296817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.296822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.296827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.296832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.296837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.296841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.296847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.296852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.296858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.296863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.296870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.296878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.296882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.296887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.296898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.296903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.296908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.296950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:04.299581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:04.300077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:04.300094Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:04.300096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:04.300100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:04.300107Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1891 [2:7559601849377687565:5199]
2025-10-10T14:36:04.300121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:04.300140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:04.300145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.300148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.300150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.300168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:04.300181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:04.300190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:04.300250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.300258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.300261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.300264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:04.300341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:04.300349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.300362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.300376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.300401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:04.300430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159916570:2438], now have 1 active actors on pipe
2025-10-10T14:36:04.300440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159916722:6184], now have 1 active actors on pipe
2025-10-10T14:36:04.300449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601849377687560:5199]
2025-10-10T14:36:04.300452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601849377687560:5199]
2025-10-10T14:36:04.300455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601849377687560:5199]
2025-10-10T14:36:04.300470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:04.300493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:04.300532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1891
2025-10-10T14:36:04.300616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1891
2025-10-10T14:36:04.300517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:04.300528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:04.300548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:04.300559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:04.300561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601849377687560:5199]
2025-10-10T14:36:04.300562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:04.300564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:04.300569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:04.300693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.300699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.300735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6457977f-9d9a7d47-13874d7-3c99c128_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:04.300743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.300749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.300752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:04.300764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.300775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:04.300791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.300960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.300971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.300988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.301088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1892 partition: 0 MaxSeqNo: 40 sessionId: src_id|6457977f-9d9a7d47-13874d7-3c99c128_0
2025-10-10T14:36:04.301541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ee0976-5dd2c912-f3356d71-527d6de7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6457977f-9d9a7d47-13874d7-3c99c128_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:04.304231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6457977f-9d9a7d47-13874d7-3c99c128_0] Write session: try to update token
2025-10-10T14:36:04.304250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6457977f-9d9a7d47-13874d7-3c99c128_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:04.320779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:04.320801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:04.320805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:04.320808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:04.320818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601849377687560:5199]
2025-10-10T14:36:04.320823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601849377687560:5199]
2025-10-10T14:36:04.320827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601849377687560:5199]
2025-10-10T14:36:04.320876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:04.320878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:04.320883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:04.320886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.320889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:04.320890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:04.321043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:04.319714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId: src_id|6457977f-9d9a7d47-13874d7-3c99c128_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:04.322435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:04.371714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601850159916814:6939]
2025-10-10T14:36:04.373661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1891, pipe: [1:7559601850159916814:6939]
2025-10-10T14:36:04.443357Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:04.443898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.443918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.443981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159916814:6939], now have 1 active actors on pipe
2025-10-10T14:36:04.444247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:04.444297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:04.444303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601850159916814:6939]
2025-10-10T14:36:04.444310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:04.444327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:04.444375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1892 reason: error at write: Disconnected sessionId: src_id|6457977f-9d9a7d47-13874d7-3c99c128_0
2025-10-10T14:36:04.444625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1892 sessionId: src_id|6457977f-9d9a7d47-13874d7-3c99c128_0 is DEAD
2025-10-10T14:36:04.444824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6457977f-9d9a7d47-13874d7-3c99c128_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:04.444837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6457977f-9d9a7d47-13874d7-3c99c128_0] Write session will restart in 0.008176s
2025-10-10T14:36:04.444863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6457977f-9d9a7d47-13874d7-3c99c128_0] Write session: Do CDS request
2025-10-10T14:36:04.444869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6457977f-9d9a7d47-13874d7-3c99c128_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:04.453932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6457977f-9d9a7d47-13874d7-3c99c128_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.454021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:04.454034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1893
2025-10-10T14:36:04.454193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.454242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:04.454253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:04.454257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:04.454731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1893 sessionId:  describe result for acl check
2025-10-10T14:36:04.454781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:04.454789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:04.454791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:04.454797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601850159916844:6166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:04.455391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601850159916844:6166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:04.459113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601850159916844:6166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:04.463832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601850159916844:6166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:04.463848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601850159916844:6166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:04.463852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601850159916844:6166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:04.463869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:04.465747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:04.468554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:04.468804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:04.468816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:04.468828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:04.468886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:04.468934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601849377687830:5179]
2025-10-10T14:36:04.469639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:04.470027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:04.470090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:04.470452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:04.470520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.470526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.470528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.470529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.470530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.470531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.470532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.470533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.470534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.470536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.470537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.470538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.470539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.470545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.470557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.470561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.470564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.470568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.470571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.470575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.470578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.470581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.470585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.470588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.470592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.470596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.470604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.470612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.470619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.470623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.470627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.470632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.470635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.470640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.470645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.470649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.470653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.470658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.470662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.470667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.470672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.470678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.470682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.470688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.470692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.470697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.470701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.470706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.470718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.470723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.470728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.470733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.470775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:04.473399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:04.474392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:04.474408Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:04.474411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:04.474415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:04.474422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1892 [2:7559601849377687830:5179]
2025-10-10T14:36:04.474438Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:04.474459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:04.474466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.474470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.474473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.474494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:04.474508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:04.474522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:04.474594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.474602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.474606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.474608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:04.474688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:04.474696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.474710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.474723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.474743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:04.474766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159916826:2438], now have 1 active actors on pipe
2025-10-10T14:36:04.474769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917044:6166], now have 1 active actors on pipe
2025-10-10T14:36:04.474790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601849377687825:5179]
2025-10-10T14:36:04.474793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601849377687825:5179]
2025-10-10T14:36:04.474796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601849377687825:5179]
2025-10-10T14:36:04.474809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:04.474824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:04.474843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:04.474850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:04.474855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:04.474857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:04.474859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:04.474887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601849377687825:5179]
2025-10-10T14:36:04.474893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:04.474886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1892
2025-10-10T14:36:04.474898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1892
2025-10-10T14:36:04.474917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:04.475117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.475123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.475159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8edca011-95c591b-b7623886-8fb231f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:04.475171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.475176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.475179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:04.475195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.475215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:04.475238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.475494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.475503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.475521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.475882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1893 partition: 0 MaxSeqNo: 40 sessionId: src_id|8edca011-95c591b-b7623886-8fb231f6_0
2025-10-10T14:36:04.476264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6457977f-9d9a7d47-13874d7-3c99c128_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8edca011-95c591b-b7623886-8fb231f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:04.479111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8edca011-95c591b-b7623886-8fb231f6_0] Write session: try to update token
2025-10-10T14:36:04.479130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8edca011-95c591b-b7623886-8fb231f6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:04.495620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:04.495640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:04.495644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:04.495646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:04.495657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601849377687825:5179]
2025-10-10T14:36:04.495661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601849377687825:5179]
2025-10-10T14:36:04.495665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601849377687825:5179]
2025-10-10T14:36:04.495717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:04.495725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.495729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:04.495783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:04.495792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:04.495797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:04.495876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:04.496923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId: src_id|8edca011-95c591b-b7623886-8fb231f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:04.499570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:04.545395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601850159917061:6939]
2025-10-10T14:36:04.545624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1892, pipe: [1:7559601850159917061:6939]
2025-10-10T14:36:04.611656Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:04.611928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.611936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.611978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917061:6939], now have 1 active actors on pipe
2025-10-10T14:36:04.612271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:04.612298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601850159917061:6939]
2025-10-10T14:36:04.612324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:04.612327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:04.612400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1893 reason: error at write: Disconnected sessionId: src_id|8edca011-95c591b-b7623886-8fb231f6_0
2025-10-10T14:36:04.612599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1893 sessionId: src_id|8edca011-95c591b-b7623886-8fb231f6_0 is DEAD
2025-10-10T14:36:04.612249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:04.613572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edca011-95c591b-b7623886-8fb231f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:04.613585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edca011-95c591b-b7623886-8fb231f6_0] Write session will restart in 0.008140s
2025-10-10T14:36:04.613626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edca011-95c591b-b7623886-8fb231f6_0] Write session: Do CDS request
2025-10-10T14:36:04.613635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edca011-95c591b-b7623886-8fb231f6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:04.622912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8edca011-95c591b-b7623886-8fb231f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.623038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:04.623055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1894
2025-10-10T14:36:04.623220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.623283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:04.623293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:04.623298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:04.623854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1894 sessionId:  describe result for acl check
2025-10-10T14:36:04.623902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:04.623909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:04.623911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:04.623918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601850159917090:6164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:04.624522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601850159917090:6164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:04.627523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601850159917090:6164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:04.631184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601850159917090:6164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:04.631201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601850159917090:6164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:04.631205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601850159917090:6164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:04.631214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:04.633136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:04.635690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:04.635941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:04.635957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:04.635970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:04.636045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:04.636089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601849377688059:5175]
2025-10-10T14:36:04.636715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:04.637041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:04.637097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:04.637473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:04.637560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.637567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.637568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.637570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.637571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.637572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.637574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.637575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.637576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.637578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.637579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.637580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.637582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.637589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.637604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.637608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.637613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.637617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.637622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.637627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.637631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.637636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.637641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.637645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.637664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.637669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.637680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.637690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.637702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.637709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.637719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.637725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.637734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.637739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.637745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.637755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.637761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.637771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.637776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.637782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.637792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.637798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.637808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.637813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.637818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.637828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.637833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.637839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.637844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.637849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.637854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.637865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.637909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:04.640455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:04.641149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:04.641162Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:04.641164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:04.641169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:04.641175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1893 [2:7559601849377688059:5175]
2025-10-10T14:36:04.641190Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:04.641210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:04.641219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.641223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.641239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.641258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:04.641266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:04.641276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:04.641366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.641374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.641376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.641379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:04.641452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:04.641460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.641473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.641492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.641508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:04.641534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917283:6164], now have 1 active actors on pipe
2025-10-10T14:36:04.641548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601849377688054:5175]
2025-10-10T14:36:04.641550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601849377688054:5175]
2025-10-10T14:36:04.641552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601849377688054:5175]
2025-10-10T14:36:04.641566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:04.641581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917064:2438], now have 1 active actors on pipe
2025-10-10T14:36:04.641585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:04.641588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:04.641590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:04.641595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:04.641611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:04.641617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:04.641608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1893
2025-10-10T14:36:04.641648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601849377688054:5175]
2025-10-10T14:36:04.641631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1893
2025-10-10T14:36:04.641660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:04.641666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:04.641679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.641684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.641742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:04.641756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.641760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.641763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:04.641777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.641788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:04.641813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.641989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.641998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.642013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.642245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1894 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0
2025-10-10T14:36:04.642691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8edca011-95c591b-b7623886-8fb231f6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:04.645548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0] Write session: try to update token
2025-10-10T14:36:04.645568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:04.661680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId: src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:04.663190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:04.663215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:04.663218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:04.663221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:04.663231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601849377688054:5175]
2025-10-10T14:36:04.663235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601849377688054:5175]
2025-10-10T14:36:04.663239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601849377688054:5175]
2025-10-10T14:36:04.663288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:04.663293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:04.663295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:04.663299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:04.663301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.663304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:04.663450Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:04.664179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:04.712655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601850159917306:6939]
2025-10-10T14:36:04.712866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1893, pipe: [1:7559601850159917306:6939]
2025-10-10T14:36:04.786978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:04.787486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.787505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.787552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917306:6939], now have 1 active actors on pipe
2025-10-10T14:36:04.787787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:04.788775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:04.788787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0] Write session will restart in 0.005655s
2025-10-10T14:36:04.788823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0] Write session: Do CDS request
2025-10-10T14:36:04.788829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:04.788308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:04.788392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1894 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0
2025-10-10T14:36:04.788582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1894 sessionId: src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0 is DEAD
2025-10-10T14:36:04.788762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:04.788797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601850159917306:6939]
2025-10-10T14:36:04.795963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.796006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:04.796020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1895
2025-10-10T14:36:04.796250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.796300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:04.796321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:04.796330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:04.796772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1895 sessionId:  describe result for acl check
2025-10-10T14:36:04.796807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:04.796813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:04.796816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:04.796822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601850159917335:6161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:04.797454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601850159917335:6161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:04.802169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601850159917335:6161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:04.806538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601850159917335:6161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:04.806554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601850159917335:6161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:04.806558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601850159917335:6161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:04.806567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:04.807728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:04.810061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:04.810272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:04.810285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:04.810297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:04.810350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:04.810395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601849377688288:5172]
2025-10-10T14:36:04.811033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:04.811373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:04.811418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:04.811755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:04.811813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.811821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.811822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.811823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.811824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.811825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.811827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.811828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.811830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.811831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.811832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.811834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.811835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.811841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.811855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.811859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.811863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.811880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.811885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.811889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.811893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.811898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.811902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.811906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.811911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.811915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.811923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.811932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:04.811944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.811951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:04.811956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.811961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:04.811971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.811977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:04.811982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.811988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:04.811993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.811999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:04.812004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.812014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:04.812018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.812023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:04.812029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.812035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:04.812039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.812056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:04.812066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.812072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.812077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.812087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.812092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.812102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.812144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:04.814879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:04.815539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:04.815557Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:04.815559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:04.815564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:04.815570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1894 [2:7559601849377688288:5172]
2025-10-10T14:36:04.815587Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:04.815605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:04.815614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.815618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.815621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.815637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:04.815644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:04.815653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:04.815718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.815726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.815728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.815731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:04.815801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:04.815812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.815824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:04.815842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:04.815865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:04.815892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917531:6161], now have 1 active actors on pipe
2025-10-10T14:36:04.815902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917310:2438], now have 1 active actors on pipe
2025-10-10T14:36:04.815910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601849377688283:5172]
2025-10-10T14:36:04.815914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601849377688283:5172]
2025-10-10T14:36:04.815916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601849377688283:5172]
2025-10-10T14:36:04.815947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:04.815960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:04.815963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:04.815965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:04.815968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:04.815986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:04.815993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:04.816017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601849377688283:5172]
2025-10-10T14:36:04.816030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:04.816035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:04.816184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.816194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.816230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5388a1ca-ca594830-937e684f-6eb00255_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:04.816243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:04.816249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:04.816251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:04.816263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:04.816274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:04.816291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.816614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.816622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.816638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:04.817241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c217e7c-ac598fc4-398756b4-3139f55f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5388a1ca-ca594830-937e684f-6eb00255_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:04.820155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5388a1ca-ca594830-937e684f-6eb00255_0] Write session: try to update token
2025-10-10T14:36:04.820174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5388a1ca-ca594830-937e684f-6eb00255_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:04.816019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1894
2025-10-10T14:36:04.816055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1894
2025-10-10T14:36:04.816782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1895 partition: 0 MaxSeqNo: 40 sessionId: src_id|5388a1ca-ca594830-937e684f-6eb00255_0
2025-10-10T14:36:04.836517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId: src_id|5388a1ca-ca594830-937e684f-6eb00255_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:04.839305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:04.839557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.839584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.839643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:04.839715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:04.841624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:04.841640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:04.841644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:04.841646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:04.841657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601849377688283:5172]
2025-10-10T14:36:04.841663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601849377688283:5172]
2025-10-10T14:36:04.841667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601849377688283:5172]
2025-10-10T14:36:04.841719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:04.841723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:04.841731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:04.841734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:04.841735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:04.841738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:04.841882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:04.893429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601850159917557:6939]
2025-10-10T14:36:04.897529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1894, pipe: [1:7559601850159917557:6939]
2025-10-10T14:36:04.962247Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:04.970842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:04.970867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:04.971048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.971117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.971187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.971253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.971306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.971317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.971396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.971462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.971541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.971628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.971680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.971688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.971761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.971871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.971938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.972019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.972067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.972075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.972145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.972214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.972286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.972353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.972402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.972409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.972480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.972546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.972619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.972690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.972743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.972751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.972828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.972896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.972965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.973035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.973090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.973099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.973176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.973258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.973354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.973430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.973475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.973483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.973557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.973626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.973717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.973790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.973835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.973842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.973914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.973975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.974044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.974111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.974235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.974244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.974314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:04.974377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:04.974444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:04.974510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:04.974561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:04.974569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:04.974641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917557:6939], now have 1 active actors on pipe
2025-10-10T14:36:04.974914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:04.974932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:04.974966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1895 reason: error at write: Disconnected sessionId: src_id|5388a1ca-ca594830-937e684f-6eb00255_0
2025-10-10T14:36:04.975224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1895 sessionId: src_id|5388a1ca-ca594830-937e684f-6eb00255_0 is DEAD
2025-10-10T14:36:04.975253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601850159917557:6939]
2025-10-10T14:36:04.975272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:04.976030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:04.977697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5388a1ca-ca594830-937e684f-6eb00255_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:04.977709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5388a1ca-ca594830-937e684f-6eb00255_0] Write session will restart in 0.008516s
2025-10-10T14:36:04.977736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5388a1ca-ca594830-937e684f-6eb00255_0] Write session: Do CDS request
2025-10-10T14:36:04.977742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5388a1ca-ca594830-937e684f-6eb00255_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:04.987955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5388a1ca-ca594830-937e684f-6eb00255_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.988090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:04.988110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1896
2025-10-10T14:36:04.988294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:04.988344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:04.988354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:04.988360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:04.988886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1896 sessionId:  describe result for acl check
2025-10-10T14:36:04.988931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:04.988939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:04.988943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:04.988949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601850159917626:6158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:04.989618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601850159917626:6158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:04.993065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601850159917626:6158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:04.996731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601850159917626:6158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:04.996754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601850159917626:6158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:04.996758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601850159917626:6158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:04.996767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:04.997275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:05.004584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:05.004878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:05.004891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:05.004904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:05.004976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:05.005027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601853672655828:5158]
2025-10-10T14:36:05.005686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:05.006126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:05.006192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:05.006577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:05.006657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.006664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.006665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.006667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.006668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.006669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.006671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.006672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.006674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.006675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.006676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.006678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.006679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.006685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.006699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.006704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.006707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.006711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.006715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.006719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.006722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.006726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.006730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.006733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.006737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.006741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.006751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.006760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.006766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.006771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.006775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.006781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.006785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.006791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.006796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.006801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.006807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.006813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.006818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.006823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.006828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.006833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.006839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.006855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.006861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.006867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.006874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.006880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.006884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.006891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.006896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.006902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.006962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:05.009868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:05.010183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:05.010198Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:05.010201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:05.010206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:05.010213Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1895 [2:7559601853672655828:5158]
2025-10-10T14:36:05.010240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:05.010260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:05.010269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.010273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.010276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.010295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:05.010308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:05.010321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:05.010384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.010392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.010394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.010397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:05.010466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:05.010474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.010486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.010503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.010527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:05.010553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601849377688527:5158]
2025-10-10T14:36:05.010560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601849377688527:5158]
2025-10-10T14:36:05.010563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601849377688527:5158]
2025-10-10T14:36:05.010581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:05.010600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:05.010621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:05.010629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:05.010656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601849377688527:5158]
2025-10-10T14:36:05.010664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:05.010667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:05.010671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:05.010673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:05.010678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917781:6158], now have 1 active actors on pipe
2025-10-10T14:36:05.010682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:05.010683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601850159917562:2438], now have 1 active actors on pipe
2025-10-10T14:36:05.010890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1895
2025-10-10T14:36:05.010901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1895
2025-10-10T14:36:05.011303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.011319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.011351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:05.011367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.011372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.011374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:05.011387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.011399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:05.011413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.011628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.011637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.011654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.011760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1896 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0
2025-10-10T14:36:05.012192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5388a1ca-ca594830-937e684f-6eb00255_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:05.014891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0] Write session: try to update token
2025-10-10T14:36:05.014910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:05.023484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:05.023505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:05.023516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601849377688527:5158]
2025-10-10T14:36:05.023567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:05.023571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:05.023755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:05.023907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:05.024052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:05.024190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:05.024399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:05.024436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:05.038805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId: src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:05.041511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:05.043526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.043562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.043585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:05.043588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:05.043592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:05.043595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:05.043606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601849377688527:5158]
2025-10-10T14:36:05.043610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601849377688527:5158]
2025-10-10T14:36:05.043619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601849377688527:5158]
2025-10-10T14:36:05.043671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:05.043688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:05.043688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:05.043697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:05.043697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.043700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:05.043861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:05.075669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601854454885089:6939]
2025-10-10T14:36:05.076006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1895, pipe: [1:7559601854454885089:6939]
2025-10-10T14:36:05.166981Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:05.167610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:05.167651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885089:6939], now have 1 active actors on pipe
2025-10-10T14:36:05.168316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:05.168328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0] Write session will restart in 0.007547s
2025-10-10T14:36:05.167769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:05.168365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0] Write session: Do CDS request
2025-10-10T14:36:05.167882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:05.168378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:05.167885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:05.167906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601854454885089:6939]
2025-10-10T14:36:05.167924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:05.167975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1896 reason: error at write: Disconnected sessionId: src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0
2025-10-10T14:36:05.168157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1896 sessionId: src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0 is DEAD
2025-10-10T14:36:05.177926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.178086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:05.178108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1897
2025-10-10T14:36:05.178279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.178331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:05.178343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:05.178347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:05.179134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1897 sessionId:  describe result for acl check
2025-10-10T14:36:05.179173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:05.179175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:05.179177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:05.179184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601854454885129:6148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:05.179775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601854454885129:6148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:05.183221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601854454885129:6148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:05.187369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601854454885129:6148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:05.187384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601854454885129:6148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:05.187388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601854454885129:6148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:05.187397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:05.189071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:05.192222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:05.192578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:05.192591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:05.192605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:05.192679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:05.192733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601853672656059:5166]
2025-10-10T14:36:05.193532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:05.194011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:05.194103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:05.194525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:05.194611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.194620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.194622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.194624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.194626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.194628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.194630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.194632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.194633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.194635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.194637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.194639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.194641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.194648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.194661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.194666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.194671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.194676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.194681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.194685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.194690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.194695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.194700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.194703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.194708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.194712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.194722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.194731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.194739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.194746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.194752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.194758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.194764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.194770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.194776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.194782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.194788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.194795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.194809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.194815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.194827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.194833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.194839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.194852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.194858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.194870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.194876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.194883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.194895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.194902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.194908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.194924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.194976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:05.197737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:05.198337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:05.198355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:05.198358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:05.198363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:05.198370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1896 [2:7559601853672656059:5166]
2025-10-10T14:36:05.198400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:05.198422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:05.198431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.198435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.198438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.198458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:05.198472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:05.198485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:05.198559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.198566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.198568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.198571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:05.198645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:05.198654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.198668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.198680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.198698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:05.198723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885313:6148], now have 1 active actors on pipe
2025-10-10T14:36:05.198736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885092:2438], now have 1 active actors on pipe
2025-10-10T14:36:05.198744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601853672656054:5166]
2025-10-10T14:36:05.198747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601853672656054:5166]
2025-10-10T14:36:05.198749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601853672656054:5166]
2025-10-10T14:36:05.198767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:05.198783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:05.198801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:05.198813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:05.198854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601853672656054:5166]
2025-10-10T14:36:05.198860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:05.198863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:05.198864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:05.198866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:05.198873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:05.198809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1896
2025-10-10T14:36:05.198817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1896
2025-10-10T14:36:05.199080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.199095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.199132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:05.199147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.199152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.199155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:05.199169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.199193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:05.199211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.199453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.199463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.199478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.199735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1897 partition: 0 MaxSeqNo: 40 sessionId: src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0
2025-10-10T14:36:05.200198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb0f1e04-41eea3bc-75740cd7-501e9a86_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:05.203104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0] Write session: try to update token
2025-10-10T14:36:05.203124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:05.218736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId: src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:05.219572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:05.219596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:05.219600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:05.219602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:05.219612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601853672656054:5166]
2025-10-10T14:36:05.219618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601853672656054:5166]
2025-10-10T14:36:05.219621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601853672656054:5166]
2025-10-10T14:36:05.219668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:05.219668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:05.219677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.219679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:05.219679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:05.219685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:05.219824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:05.221482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:05.268136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601854454885327:6939]
2025-10-10T14:36:05.268485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1896, pipe: [1:7559601854454885327:6939]
2025-10-10T14:36:05.336566Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:05.336916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.336938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.336989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885327:6939], now have 1 active actors on pipe
2025-10-10T14:36:05.337379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601854454885327:6939]
2025-10-10T14:36:05.337382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:05.337432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:05.337434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:05.337956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:05.337968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0] Write session will restart in 0.009927s
2025-10-10T14:36:05.337506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:05.337517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1897 reason: error at write: Disconnected sessionId: src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0
2025-10-10T14:36:05.337746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1897 sessionId: src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0 is DEAD
2025-10-10T14:36:05.337994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0] Write session: Do CDS request
2025-10-10T14:36:05.338104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:05.349161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.349237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:05.349253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1898
2025-10-10T14:36:05.349469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.349531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:05.349544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:05.349549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:05.349997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1898 sessionId:  describe result for acl check
2025-10-10T14:36:05.350041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:05.350048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:05.350050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:05.350057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601854454885389:6144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:05.350704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601854454885389:6144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:05.354604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601854454885389:6144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:05.361730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601854454885389:6144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:05.361753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601854454885389:6144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:05.361759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601854454885389:6144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:05.361772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:05.366318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:05.366988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:05.367189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:05.367194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:05.367208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:05.367259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:05.367302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601853672656291:5165]
2025-10-10T14:36:05.367915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:05.368361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:05.368408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:05.368739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:05.368800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.368801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.368802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.368803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.368804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.368806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.368807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.368809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.368810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.368811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.368812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.368813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.368814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.368821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.368833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.368837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.368841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.368844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.368847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.368851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.368854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.368857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.368861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.368864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.368867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.368871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.368879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.368887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.368894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.368899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.368904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.368908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.368913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.368920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.368925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.368929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.368933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.368938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.368942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.368947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.368951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.368956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.368961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.368965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.368969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.368974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.368978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.368983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.368987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.368992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.368997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.369001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.369054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:05.371799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:05.372146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:05.372151Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:05.372154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:05.372157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:05.372164Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1897 [2:7559601853672656291:5165]
2025-10-10T14:36:05.372178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:05.372197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:05.372201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.372205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.372208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.372226Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:05.372234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:05.372243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:05.372967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1897
2025-10-10T14:36:05.373028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1897
2025-10-10T14:36:05.372302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.372316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.372318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.372320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:05.372391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:05.372395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.372406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.372416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.372430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:05.372451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601853672656286:5165]
2025-10-10T14:36:05.372453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601853672656286:5165]
2025-10-10T14:36:05.372456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601853672656286:5165]
2025-10-10T14:36:05.372469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:05.372483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:05.372498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:05.372501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:05.372526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601853672656286:5165]
2025-10-10T14:36:05.372529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:05.372856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:05.372859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:05.372872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:05.372872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885554:6144], now have 1 active actors on pipe
2025-10-10T14:36:05.372877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885329:2438], now have 1 active actors on pipe
2025-10-10T14:36:05.372879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:05.373093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.373099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.373130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:05.373139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.373143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.373146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:05.373159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.373172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:05.373186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.373419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.373428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.373444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.373559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1898 partition: 0 MaxSeqNo: 40 sessionId: src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0
2025-10-10T14:36:05.377457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9012179d-9cadfcfc-48236142-d8b58c4f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:05.380172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0] Write session: try to update token
2025-10-10T14:36:05.380192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:05.393572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:05.393593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:05.393597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:05.393599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:05.393609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601853672656286:5165]
2025-10-10T14:36:05.393614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601853672656286:5165]
2025-10-10T14:36:05.393618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601853672656286:5165]
2025-10-10T14:36:05.393673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:05.393688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.393690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:05.393696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:05.393726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:05.393740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:05.393844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:05.396448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId: src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:05.399162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:05.437626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601854454885589:6939]
2025-10-10T14:36:05.437860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1897, pipe: [1:7559601854454885589:6939]
2025-10-10T14:36:05.512670Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:05.513177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.513200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.513275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885589:6939], now have 1 active actors on pipe
2025-10-10T14:36:05.513909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601854454885589:6939]
2025-10-10T14:36:05.513530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:05.513955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:05.513957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:05.514015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1898 reason: error at write: Disconnected sessionId: src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0
2025-10-10T14:36:05.514224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1898 sessionId: src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0 is DEAD
2025-10-10T14:36:05.514402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:05.514414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0] Write session will restart in 0.007419s
2025-10-10T14:36:05.514401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:05.514455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0] Write session: Do CDS request
2025-10-10T14:36:05.514465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:05.522960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.523118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:05.523136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1899
2025-10-10T14:36:05.523283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.523328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:05.523339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:05.523344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:05.523807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1899 sessionId:  describe result for acl check
2025-10-10T14:36:05.523837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:05.523840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:05.523842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:05.523849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601854454885617:6129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:05.524432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601854454885617:6129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:05.527598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601854454885617:6129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:05.531606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601854454885617:6129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:05.531620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601854454885617:6129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:05.531624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601854454885617:6129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:05.531633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:05.535082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:05.537461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:05.537749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:05.537762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:05.537776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:05.537841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:05.537891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601853672656563:5129]
2025-10-10T14:36:05.538555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:05.538944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:05.539012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:05.539321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:05.539395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.539397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.539398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.539399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.539400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.539401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.539402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.539404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.539405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.539406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.539407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.539407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.539408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.539415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.539428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.539432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.539436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.539439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.539443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.539446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.539449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.539453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.539456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.539459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.539463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.539465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.539475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.539483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.539489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.539494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.539500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.539504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.539510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.539515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.539519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.539524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.539528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.539533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.539538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.539543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.539547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.539553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.539558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.539563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.539567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.539572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.539577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.539582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.539586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.539592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.539597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.539602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.539644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:05.542536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:05.543195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:05.543202Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:05.543205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:05.543209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:05.543216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1898 [2:7559601853672656563:5129]
2025-10-10T14:36:05.543232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:05.543670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1898
2025-10-10T14:36:05.543724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1898
2025-10-10T14:36:05.543255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:05.543258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.543262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.543265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.543285Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:05.543293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:05.543302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:05.543370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.543373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.543375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.543378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:05.543460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:05.543464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.543477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.543490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.543507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:05.543531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885592:2438], now have 1 active actors on pipe
2025-10-10T14:36:05.543535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885797:6129], now have 1 active actors on pipe
2025-10-10T14:36:05.543544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601853672656558:5129]
2025-10-10T14:36:05.543546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601853672656558:5129]
2025-10-10T14:36:05.543549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601853672656558:5129]
2025-10-10T14:36:05.543564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:05.543577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:05.543579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:05.543581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:05.543595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:05.543597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:05.543600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:05.543638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601853672656558:5129]
2025-10-10T14:36:05.543646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:05.543652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:05.543862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.543872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.543908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:05.543926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.543932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.543938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:05.543952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.543982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:05.544003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.544290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.544301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.544323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.544435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1899 partition: 0 MaxSeqNo: 40 sessionId: src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0
2025-10-10T14:36:05.544888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fea3754-16d07843-9bc938b8-f85d2e5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:05.547739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0] Write session: try to update token
2025-10-10T14:36:05.547764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:05.563285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId: src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:05.566059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:05.566586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.566610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.566634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:05.566637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:05.566641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:05.566644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:05.566653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601853672656558:5129]
2025-10-10T14:36:05.566658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601853672656558:5129]
2025-10-10T14:36:05.566662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601853672656558:5129]
2025-10-10T14:36:05.566723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:05.566732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.566734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:05.566791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:05.566798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:05.566802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:05.566868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:05.614312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601854454885830:6939]
2025-10-10T14:36:05.614613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1898, pipe: [1:7559601854454885830:6939]
2025-10-10T14:36:05.683681Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:05.684236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:05.684327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885830:6939], now have 1 active actors on pipe
2025-10-10T14:36:05.684399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:05.684998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601854454885830:6939]
2025-10-10T14:36:05.685029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:05.697557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:05.697573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:05.697603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1899 reason: error at write: Disconnected sessionId: src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0
2025-10-10T14:36:05.697781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1899 sessionId: src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0 is DEAD
2025-10-10T14:36:05.697936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:05.697947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0] Write session will restart in 0.009585s
2025-10-10T14:36:05.697975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0] Write session: Do CDS request
2025-10-10T14:36:05.697981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:05.708921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.709239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:05.709263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1900
2025-10-10T14:36:05.709439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.709474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:05.709487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:05.709492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:05.709916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1900 sessionId:  describe result for acl check
2025-10-10T14:36:05.709972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:05.709978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:05.709981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:05.709988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601854454886037:6109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:05.710303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:05.710574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601854454886037:6109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:05.714343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601854454886037:6109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:05.713672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:05.714029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:05.714035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:05.714049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:05.714114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:05.714158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601853672656797:5139]
2025-10-10T14:36:05.714777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:05.715140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:05.715212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:05.715554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:05.715891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.715899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.715901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.715902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.715904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.715905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.715907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.715908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.715910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.715912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.715913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.715914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.715916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.715925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.715939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.715944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.715948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.715952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.715956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.715961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.715965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.715969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.715974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.715978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.715982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.715987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.715996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.716006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.716014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.716020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.716026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.716032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.716036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.716041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.716046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.716050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.716055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.716060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.716064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.716069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.716074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.716079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.716085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.716091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.716095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.716102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.716107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.716111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.716115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.716121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.716125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.716130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.716170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:05.718750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601854454886037:6109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:05.718766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601854454886037:6109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:05.718770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601854454886037:6109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:05.718779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:05.718849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:05.719201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:05.719212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:05.719215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:05.719219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:05.719225Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1899 [2:7559601853672656797:5139]
2025-10-10T14:36:05.719238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:05.719265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:05.719268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.719272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.719276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.719293Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:05.719316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:05.719330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:05.719400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.719407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.719408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.719415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:05.719489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:05.719497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.719509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.719522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.719542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:05.719566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454885836:2438], now have 1 active actors on pipe
2025-10-10T14:36:05.719575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454886071:6109], now have 1 active actors on pipe
2025-10-10T14:36:05.719582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601853672656792:5139]
2025-10-10T14:36:05.719589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601853672656792:5139]
2025-10-10T14:36:05.719591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601853672656792:5139]
2025-10-10T14:36:05.719574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1899
2025-10-10T14:36:05.719605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:05.719582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1899
2025-10-10T14:36:05.719627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:05.719641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:05.719647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:05.719650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:05.719652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:05.719655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:05.719679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601853672656792:5139]
2025-10-10T14:36:05.719682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:05.719685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:05.719832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.719845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.719879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:05.719887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.719892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.719895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:05.719907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.719919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:05.719940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.720104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.720114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.720129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.720292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1900 partition: 0 MaxSeqNo: 40 sessionId: src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0
2025-10-10T14:36:05.720718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0196c9-2ec0daad-71c0cd37-4f9d46d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:05.723519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0] Write session: try to update token
2025-10-10T14:36:05.723539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:05.735972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:05.735992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:05.736005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601853672656792:5139]
2025-10-10T14:36:05.736069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:05.736075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:05.736278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:05.736422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:05.736558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:05.736699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:05.736933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:05.736973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:05.739649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId: src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:05.742595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:05.742846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.742869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.742912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:05.743001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:05.754691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:05.754713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:05.754717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:05.754719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:05.754731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601853672656792:5139]
2025-10-10T14:36:05.754736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601853672656792:5139]
2025-10-10T14:36:05.754740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601853672656792:5139]
2025-10-10T14:36:05.754784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:05.754791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:05.754796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:05.754799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.754800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:05.754802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:05.754961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:05.784856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601854454886081:6939]
2025-10-10T14:36:05.785273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1899, pipe: [1:7559601854454886081:6939]
2025-10-10T14:36:05.871775Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:05.880623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.880653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.880843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.880911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.880982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.881047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.881781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.881802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.881882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.881969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.882033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.882100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.882147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.882152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.882221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.882289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.882353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.882421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.882465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.882473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.882541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.882607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.882677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.882744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.882811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.882819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.882891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.882963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.883028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.883091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.883136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.883144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.883211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.883275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.883344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.883417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.883464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.883467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.883535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.883600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.883677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.883747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.883796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.883803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.883867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.883929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.883996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.884061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.884110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.884117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.884186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.884249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.884313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.884386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.884425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.884428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.884497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:05.884554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:05.884617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:05.884678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:05.884721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:05.884723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:05.884808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454886081:6939], now have 1 active actors on pipe
2025-10-10T14:36:05.885069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:05.885103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:05.885182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:05.885251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1900 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0
2025-10-10T14:36:05.885497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1900 sessionId: src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0 is DEAD
2025-10-10T14:36:05.885662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601854454886081:6939]
2025-10-10T14:36:05.885690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:05.885701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0] Write session will restart in 0.007697s
2025-10-10T14:36:05.885727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0] Write session: Do CDS request
2025-10-10T14:36:05.885733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:05.897861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.897944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:05.897963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1901
2025-10-10T14:36:05.898130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:05.898185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:05.898197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:05.898201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:05.898665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1901 sessionId:  describe result for acl check
2025-10-10T14:36:05.898701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:05.898708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:05.898710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:05.898717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601854454886194:6108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:05.899295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601854454886194:6108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:05.902360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601854454886194:6108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:05.904699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:05.907365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:05.907406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601854454886194:6108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:05.907422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601854454886194:6108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:05.907426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601854454886194:6108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:05.907435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:05.907626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:05.907642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:05.907656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:05.907728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:05.907782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601853672657049:5136]
2025-10-10T14:36:05.908383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:05.908713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:05.908787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:05.909167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:05.909268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.909276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.909278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.909279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.909282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.909283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.909284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.909286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.909287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.909289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.909290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.909291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.909293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.909300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.909315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.909321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.909325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.909341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.909346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.909349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.909354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.909357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.909362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.909366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.909371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.909375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.909383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.909394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:05.909406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.909411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:05.909415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.909421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:05.909427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.909437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:05.909444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.909454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:05.909460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.909466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:05.909470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.909476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:05.909481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.909491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:05.909497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.909505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:05.909509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.909530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:05.909534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.909543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.909548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.909553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.909557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.909567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.909608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:05.912055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:05.912764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:05.912783Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:05.912786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:05.912790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:05.912798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1900 [2:7559601853672657049:5136]
2025-10-10T14:36:05.912812Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:05.912831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:05.912840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.912844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.912847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.912866Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:05.912874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:05.912887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:05.912954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.912963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.912966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.912969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:05.913043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:05.913051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.913067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:05.913085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:05.913105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:05.913131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601853672657043:5136]
2025-10-10T14:36:05.913138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601853672657043:5136]
2025-10-10T14:36:05.913140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601853672657043:5136]
2025-10-10T14:36:05.913157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:05.913172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:05.913209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:05.913216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:05.913248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601853672657043:5136]
2025-10-10T14:36:05.913248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:05.913251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:05.913254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:05.913256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:05.913262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:05.913266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454886096:2438], now have 1 active actors on pipe
2025-10-10T14:36:05.913326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1900
2025-10-10T14:36:05.913431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454886324:6108], now have 1 active actors on pipe
2025-10-10T14:36:05.913623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1900
2025-10-10T14:36:05.913690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.913701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.913740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:05.913754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:05.913763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:05.913767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:05.913779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:05.913795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:05.913817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.914000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:05.914051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:05.914077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:05.914201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1901 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0
2025-10-10T14:36:05.914664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a97ac8e4-658980fa-1bbb8884-8587a7a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:05.917491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0] Write session: try to update token
2025-10-10T14:36:05.917511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:05.932585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId: src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:05.933880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:05.933900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:05.933903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:05.933905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:05.933921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601853672657043:5136]
2025-10-10T14:36:05.933927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601853672657043:5136]
2025-10-10T14:36:05.933931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601853672657043:5136]
2025-10-10T14:36:05.933984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:05.933996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:05.933997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:05.934000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:05.934004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:05.934009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:05.934140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:05.935338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:05.986015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601854454886336:6939]
2025-10-10T14:36:05.986362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1900, pipe: [1:7559601854454886336:6939]
2025-10-10T14:36:06.051063Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:06.051575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.051591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.051638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601854454886336:6939], now have 1 active actors on pipe
2025-10-10T14:36:06.051912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:06.051918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:06.051926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:06.051980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601854454886336:6939]
2025-10-10T14:36:06.051991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1901 reason: error at write: Disconnected sessionId: src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0
2025-10-10T14:36:06.051995Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:36:06.052096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1901 sessionId: src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0 is DEAD
2025-10-10T14:36:06.052114Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 19 consumer shared/user session shared/user_1_19_15451886264104792848_v1 is DEAD
2025-10-10T14:36:06.052275Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601781440422255:6942] disconnected; active server actors: 1
2025-10-10T14:36:06.052285Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601781440422255:6942] client user disconnected session shared/user_1_19_15451886264104792848_v1
2025-10-10T14:36:06.052337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:06.052483Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:36:06.052488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:06.052515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0] Write session will restart in 0.005828s
2025-10-10T14:36:06.052542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0] Write session: Do CDS request
2025-10-10T14:36:06.052548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:06.052626Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:36:06.052633Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:36:06.052639Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.007959s
2025-10-10T14:36:06.059933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.060002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:06.060016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1902
2025-10-10T14:36:06.060188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.060225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:06.060230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:06.060234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:06.060730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1902 sessionId:  describe result for acl check
2025-10-10T14:36:06.060768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:06.060778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:06.060781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:06.060787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601858749853657:6101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:06.061449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601858749853657:6101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:06.061613Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:36:06.061761Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:36:06.061769Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 20
2025-10-10T14:36:06.062025Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 20 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:36:06.062074Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:36:06.062157Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 auth for : user
2025-10-10T14:36:06.062367Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 Handle describe topics response
2025-10-10T14:36:06.062397Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 auth is DEAD
2025-10-10T14:36:06.062417Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:36:06.062674Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:36:06.062770Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_20_9308480143958711937_v1
2025-10-10T14:36:06.062961Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601858749853693:6095] connected; active server actors: 1
2025-10-10T14:36:06.062975Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601858749853693:6095] session shared/user_1_20_9308480143958711937_v1
2025-10-10T14:36:06.062985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:36:06.062995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:36:06.063002Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_20_9308480143958711937_v1" (Sender=[1:7559601858749853671:6095], Pipe=[1:7559601858749853693:6095], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:36:06.063006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:36:06.063017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:36:06.063025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_20_9308480143958711937_v1" (Sender=[1:7559601858749853671:6095], Pipe=[1:7559601858749853693:6095], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:36:06.063037Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_20_9308480143958711937_v1" sender [1:7559601858749853671:6095] lock partition 0 for ReadingSession "shared/user_1_20_9308480143958711937_v1" (Sender=[1:7559601858749853671:6095], Pipe=[1:7559601858749853693:6095], Partitions=[], ActiveFamilyCount=1) generation 1 step 20
2025-10-10T14:36:06.063044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:36:06.063049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-10-10T14:36:06.063287Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 20 Session: "shared/user_1_20_9308480143958711937_v1" ClientId: "user" PipeClient { RawX1: 7559601858749853693 RawX2: 4503603922343887 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:36:06.063662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:36:06.064532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601858749853657:6101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:06.067891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601858749853657:6101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:06.067905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601858749853657:6101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:06.067910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601858749853657:6101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:06.067918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:06.071384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:06.074140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:06.074404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:06.074418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:06.074433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:06.074498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:06.074541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601857967624583:5131]
2025-10-10T14:36:06.075040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:06.075342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:06.075393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:06.075705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:06.075773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.075784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.075785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.075786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.075788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.075789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.075790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.075791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.075793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.075794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.075795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.075796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.075797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.075803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.075816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.075820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.075823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.075827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.075831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.075835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.075839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.075843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.075847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.075851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.075854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.075857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.075867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.075875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.075882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.075887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.075891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.075896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.075900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.075905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.075910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.075915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.075919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.075923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.075928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.075933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.075937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.075942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.075946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.075951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.075956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.075961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.075965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.075973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.075978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.075984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.075989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.075994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.076036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:06.078651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:06.079452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:06.079468Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:06.079471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:06.079475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:06.079481Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1901 [2:7559601857967624583:5131]
2025-10-10T14:36:06.079496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:06.079515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:06.079518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.079521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.079524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.079542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:06.079550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:06.079558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:06.079625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.079636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.079638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.079640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:06.079717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:06.079724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.079737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.079753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.079770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:06.079797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749853633:2438], now have 1 active actors on pipe
2025-10-10T14:36:06.079805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749853829:6101], now have 1 active actors on pipe
2025-10-10T14:36:06.079808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749853720:6092], now have 1 active actors on pipe
2025-10-10T14:36:06.079817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601857967624578:5131]
2025-10-10T14:36:06.079820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601857967624578:5131]
2025-10-10T14:36:06.079822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601857967624578:5131]
2025-10-10T14:36:06.079836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:06.079848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:06.079853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:06.079858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:06.079861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:06.079869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:06.079872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:06.079851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1901
2025-10-10T14:36:06.079871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1901, pipe: [1:7559601858749853720:6092]
2025-10-10T14:36:06.079893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1901
2025-10-10T14:36:06.079906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601857967624578:5131]
2025-10-10T14:36:06.079916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:06.079918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:06.079934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.079939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.079959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.079961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.079968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_20_9308480143958711937_v1 on pipe: [1:7559601858749853720:6092]
2025-10-10T14:36:06.080010Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_20_9308480143958711937_v1:1 with generation 1901
2025-10-10T14:36:06.080020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72c3b249-bf8ceadf-31314923-bf14a952_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:06.080029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.080033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.080036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:06.080047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.080066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:06.080080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.080085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.080087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:06.080103Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_20_9308480143958711937_v1
2025-10-10T14:36:06.080110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.080143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.080159Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:36:06.080313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.080322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.080339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.080453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1902 partition: 0 MaxSeqNo: 40 sessionId: src_id|72c3b249-bf8ceadf-31314923-bf14a952_0
2025-10-10T14:36:06.080833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5723d7-d03726f2-51cd4c86-3955c69_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72c3b249-bf8ceadf-31314923-bf14a952_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:06.083665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c3b249-bf8ceadf-31314923-bf14a952_0] Write session: try to update token
2025-10-10T14:36:06.083684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c3b249-bf8ceadf-31314923-bf14a952_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:06.084979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:36:06.085446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-10T14:36:06.085486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:36:06.085498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.085503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.085506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.085519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:36:06.085534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:36:06.085694Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106966079 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:36:06.085725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:36:06.085762Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 sending to client partition status
2025-10-10T14:36:06.098922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId: src_id|72c3b249-bf8ceadf-31314923-bf14a952_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:06.100579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:06.100603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:06.100606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:06.100609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:06.100620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601857967624578:5131]
2025-10-10T14:36:06.100624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601857967624578:5131]
2025-10-10T14:36:06.100628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601857967624578:5131]
2025-10-10T14:36:06.100686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:06.100701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.100704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:06.100710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:06.100712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:06.100718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:06.100884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:06.101687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:06.216520Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:06.217162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.217183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.217470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_20_9308480143958711937_v1
2025-10-10T14:36:06.217491Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:06.217523Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_20_9308480143958711937_v1
2025-10-10T14:36:06.217521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:06.217537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:06.217541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:06.217583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601858749853720:6092]
2025-10-10T14:36:06.217603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1902 reason: error at write: Disconnected sessionId: src_id|72c3b249-bf8ceadf-31314923-bf14a952_0
2025-10-10T14:36:06.217799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1902 sessionId: src_id|72c3b249-bf8ceadf-31314923-bf14a952_0 is DEAD
2025-10-10T14:36:06.217962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c3b249-bf8ceadf-31314923-bf14a952_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:06.217974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c3b249-bf8ceadf-31314923-bf14a952_0] Write session will restart in 0.008038s
2025-10-10T14:36:06.218016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c3b249-bf8ceadf-31314923-bf14a952_0] Write session: Do CDS request
2025-10-10T14:36:06.218022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c3b249-bf8ceadf-31314923-bf14a952_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:06.226922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c3b249-bf8ceadf-31314923-bf14a952_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.227322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:06.227337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1903
2025-10-10T14:36:06.227523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.227574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:06.227579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:06.227585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:06.228176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1903 sessionId:  describe result for acl check
2025-10-10T14:36:06.228207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:06.228209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:06.228212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:06.228219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601858749853931:6093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:06.228807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601858749853931:6093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:06.232293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601858749853931:6093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:06.235714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601858749853931:6093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:06.235728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601858749853931:6093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:06.235732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601858749853931:6093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:06.235742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:06.237963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:06.241321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:06.241769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:06.241782Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:06.241797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:06.241865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:06.241913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601857967624823:5125]
2025-10-10T14:36:06.242570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:06.243037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:06.243103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:06.243468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:06.243551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.243559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.243560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.243562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.243563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.243564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.243566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.243568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.243569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.243570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.243571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.243573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.243574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.243580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.243595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.243600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.243604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.243608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.243626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.243630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.243635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.243639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.243644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.243648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.243652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.243656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.243667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.243676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.243683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.243689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.243694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.243699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.243703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.243708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.243723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.243735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.243739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.243745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.243756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.243760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.243771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.243776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.243785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.243791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.243797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.243807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.243813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.243822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.243827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.243832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.243841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.243847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.243897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:06.246591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:06.247280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:06.247294Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:06.247297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:06.247301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:06.247307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1902 [2:7559601857967624823:5125]
2025-10-10T14:36:06.247323Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:06.247343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:06.247346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.247350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.247352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.247370Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:06.247380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:06.247388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:06.247470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.247477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.247479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.247481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:06.247556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:06.247565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.247576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.247587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.247607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:06.247634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854109:6093], now have 1 active actors on pipe
2025-10-10T14:36:06.247637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749853882:2438], now have 1 active actors on pipe
2025-10-10T14:36:06.247645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601857967624817:5125]
2025-10-10T14:36:06.247647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601857967624817:5125]
2025-10-10T14:36:06.247649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601857967624817:5125]
2025-10-10T14:36:06.247662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:06.247677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:06.247678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:06.247682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:06.247686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:06.247697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:06.247701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:06.247735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601857967624817:5125]
2025-10-10T14:36:06.247746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:06.247736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1902
2025-10-10T14:36:06.247763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:06.247739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1902
2025-10-10T14:36:06.247787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.247792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.247826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e175e370-616aa222-fbdaa479-3b57bf20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:06.247842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.247846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.247848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:06.247861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.247872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:06.247889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.248106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.248120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.248146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.248253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1903 partition: 0 MaxSeqNo: 40 sessionId: src_id|e175e370-616aa222-fbdaa479-3b57bf20_0
2025-10-10T14:36:06.248678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c3b249-bf8ceadf-31314923-bf14a952_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e175e370-616aa222-fbdaa479-3b57bf20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:06.251489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e175e370-616aa222-fbdaa479-3b57bf20_0] Write session: try to update token
2025-10-10T14:36:06.251512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e175e370-616aa222-fbdaa479-3b57bf20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:06.259883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:06.259911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:06.259923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601857967624817:5125]
2025-10-10T14:36:06.259976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:06.259982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:06.260177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:06.260349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.260492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.260638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.260833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:06.260880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:06.267955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId: src_id|e175e370-616aa222-fbdaa479-3b57bf20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:06.270712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:06.271060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.271085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.271136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:06.271216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:06.282879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:06.282901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:06.282904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:06.282907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:06.282919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601857967624817:5125]
2025-10-10T14:36:06.282923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601857967624817:5125]
2025-10-10T14:36:06.282928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601857967624817:5125]
2025-10-10T14:36:06.282984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:06.282992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.282994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:06.283137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:06.284341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:06.284356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:06.284360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:06.317774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601858749854128:6092]
2025-10-10T14:36:06.318101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1902, pipe: [1:7559601858749854128:6092]
2025-10-10T14:36:06.397807Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:06.407098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.407136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.407332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.407395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.407462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.407527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.408060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.408066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.408143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.408205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.408274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.408351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.408395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.408401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.408473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.408534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.408600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.408665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.408707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.408709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.408783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.408850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.408916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.408983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.409029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.409032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.409103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.409168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.409251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.409318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.409564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.409581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.409655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.409722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.409791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.409863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.409911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.409918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.409992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.410058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.410125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.410195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.410242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.410250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.410323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.410385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.410455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.411595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:06.411665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:06.411673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:06.411705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1903 reason: error at write: Disconnected sessionId: src_id|e175e370-616aa222-fbdaa479-3b57bf20_0
2025-10-10T14:36:06.411930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1903 sessionId: src_id|e175e370-616aa222-fbdaa479-3b57bf20_0 is DEAD
2025-10-10T14:36:06.412024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601858749854128:6092]
2025-10-10T14:36:06.412301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e175e370-616aa222-fbdaa479-3b57bf20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:06.412313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e175e370-616aa222-fbdaa479-3b57bf20_0] Write session will restart in 0.009134s
2025-10-10T14:36:06.410522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.410573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.410577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.410645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.410703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.410763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.410825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.412350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e175e370-616aa222-fbdaa479-3b57bf20_0] Write session: Do CDS request
2025-10-10T14:36:06.410866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.412357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e175e370-616aa222-fbdaa479-3b57bf20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:06.410870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.410942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.411000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.411064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.411127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.411171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.411173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.411242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854128:6092], now have 1 active actors on pipe
2025-10-10T14:36:06.411939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:06.422923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e175e370-616aa222-fbdaa479-3b57bf20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.423011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:06.423027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1904
2025-10-10T14:36:06.423203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.423256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:06.423267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:06.423271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:06.423722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1904 sessionId:  describe result for acl check
2025-10-10T14:36:06.423758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:06.423765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:06.423766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:06.423772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601858749854144:6085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:06.424401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601858749854144:6085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:06.427647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601858749854144:6085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:06.432173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601858749854144:6085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:06.432188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601858749854144:6085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:06.432192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601858749854144:6085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:06.432203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:06.446028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:06.448681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:06.449041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:06.449046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:06.449056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:06.449101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:06.449134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601857967625062:5123]
2025-10-10T14:36:06.449627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:06.449907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:06.449952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:06.450186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:06.450237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.450244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.450245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.450246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.450247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.450249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.450250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.450251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.450252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.450254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.450255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.450256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.450258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.450264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.450277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.450282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.450286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.450291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.450296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.450316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.450324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.450331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.450338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.450346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.450351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.450354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.450364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.450379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.450391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.450402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.450410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.450420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.450425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.450435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.450440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.450445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.450449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.450455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.450465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.450471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.450474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.450480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.450486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.450495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.450500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.450510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.450517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.450527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.450531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.450539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.450547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.450553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.450590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:06.453379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:06.453899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:06.453913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:06.453915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:06.453918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:06.453926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1903 [2:7559601857967625062:5123]
2025-10-10T14:36:06.453939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:06.453957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:06.453960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.453964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.453967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.453983Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:06.453992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:06.454001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:06.454056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.454063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.454066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.454068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:06.454131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:06.454138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.454149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.454163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.454185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:06.454212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854235:6085], now have 1 active actors on pipe
2025-10-10T14:36:06.454224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601857967625057:5123]
2025-10-10T14:36:06.454231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601857967625057:5123]
2025-10-10T14:36:06.454234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601857967625057:5123]
2025-10-10T14:36:06.454249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:06.454263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854130:2438], now have 1 active actors on pipe
2025-10-10T14:36:06.454268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:06.454271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:06.454273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:06.454276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:06.454293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:06.454301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:06.454324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601857967625057:5123]
2025-10-10T14:36:06.454335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:06.454376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:06.454455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1903
2025-10-10T14:36:06.454489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1903
2025-10-10T14:36:06.454625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.454635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.454666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:06.454678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.454682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.454687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:06.454700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.454717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:06.454735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.454942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.454948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.454975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.455253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1904 partition: 0 MaxSeqNo: 40 sessionId: src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0
2025-10-10T14:36:06.455748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e175e370-616aa222-fbdaa479-3b57bf20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:06.458839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0] Write session: try to update token
2025-10-10T14:36:06.458863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:06.472522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:06.472546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:06.472558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601857967625057:5123]
2025-10-10T14:36:06.472611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:06.472792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:06.472937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.473099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.473265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.473372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:06.473546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:06.473590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:06.479564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId: src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:06.482487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:06.482921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.482944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.482988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:06.483096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:06.485789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:06.485812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:06.485816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:06.485818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:06.485828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601857967625057:5123]
2025-10-10T14:36:06.485835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601857967625057:5123]
2025-10-10T14:36:06.485839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601857967625057:5123]
2025-10-10T14:36:06.485887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:06.485894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.485897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:06.486039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:06.489475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:06.489504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:06.489507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:06.512360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601858749854386:6092]
2025-10-10T14:36:06.512670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1903, pipe: [1:7559601858749854386:6092]
2025-10-10T14:36:06.600764Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:06.609927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.609969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.610216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.610317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.610418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.610495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.610673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.610678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.610756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.610821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.610888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.610959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.611011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.611014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.611091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.611155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.611224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.611293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.611337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.611340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.611420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.611495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.611562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.611628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.612125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.612132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.612210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.612273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.612341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.612411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.612454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.612457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.612534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.612598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.612664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.612732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.612776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.612780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.612855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.612921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.612988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.613053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.613102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.613104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.613195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.613259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.613597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.613675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.613717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.613721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.613792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.613853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.613911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.613975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.614017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.614020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.614088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.614148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.614211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.614273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.614318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.614322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.614398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854386:6092], now have 1 active actors on pipe
2025-10-10T14:36:06.615356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:06.615895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:06.615907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0] Write session will restart in 0.005523s
2025-10-10T14:36:06.615933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0] Write session: Do CDS request
2025-10-10T14:36:06.615940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:06.615438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:06.615460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:06.615493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1904 reason: error at write: Disconnected sessionId: src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0
2025-10-10T14:36:06.615744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1904 sessionId: src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0 is DEAD
2025-10-10T14:36:06.615938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601858749854386:6092]
2025-10-10T14:36:06.615955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:06.622856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.622998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:06.623014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1905
2025-10-10T14:36:06.623726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.623769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:06.623782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:06.623786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:06.624386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1905 sessionId:  describe result for acl check
2025-10-10T14:36:06.624428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:06.624434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:06.624436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:06.624443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601858749854414:6066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:06.625052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601858749854414:6066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:06.629320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601858749854414:6066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:06.632922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601858749854414:6066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:06.632936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601858749854414:6066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:06.632940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601858749854414:6066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:06.632948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:06.635412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:06.638355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:06.638612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:06.638629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:06.638645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:06.638718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:06.638771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601857967625341:5096]
2025-10-10T14:36:06.639396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:06.639800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:06.639864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:06.640238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:06.640316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.640324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.640325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.640326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.640328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.640329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.640331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.640332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.640333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.640335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.640336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.640338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.640339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.640346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.640360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.640365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.640369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.640374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.640378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.640382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.640387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.640391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.640396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.640401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.640405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.640409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.640419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.640428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.640436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.640443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.640448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.640459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.640464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.640474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.640479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.640489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.640494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.640500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.640511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.640516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.640526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.640532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.640543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.640549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.640554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.640560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.640568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.640573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.640579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.640584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.640593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.640598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.640646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:06.643330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:06.644214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1904
2025-10-10T14:36:06.644262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1904
2025-10-10T14:36:06.643818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:06.643835Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:06.643837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:06.643841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:06.643848Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1904 [2:7559601857967625341:5096]
2025-10-10T14:36:06.643861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:06.643880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:06.643883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.643888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.643890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.643908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:06.643916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:06.643925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:06.644005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.644008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.644011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.644014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:06.644084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:06.644088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.644101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.644115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.644133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:06.644156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854399:2438], now have 1 active actors on pipe
2025-10-10T14:36:06.644160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854614:6066], now have 1 active actors on pipe
2025-10-10T14:36:06.644168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601857967625336:5096]
2025-10-10T14:36:06.644170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601857967625336:5096]
2025-10-10T14:36:06.644173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601857967625336:5096]
2025-10-10T14:36:06.644188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:06.644205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:06.644220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:06.644224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:06.644250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601857967625336:5096]
2025-10-10T14:36:06.644253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:06.644370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:06.644373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:06.644376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:06.644384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:06.644477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.644493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.644540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:06.644550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.644555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.644563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:06.644576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.644590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:06.644611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.644826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.644835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.644849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.644961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1905 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0
2025-10-10T14:36:06.645417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e149faf2-5ca9ead7-4f7e699-d7efc59f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:06.648083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0] Write session: try to update token
2025-10-10T14:36:06.648099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:06.657192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:06.657216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:06.657227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601857967625336:5096]
2025-10-10T14:36:06.657276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:06.657282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:06.657493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:06.658023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.658167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.658301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:06.658500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:06.658539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:06.663217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId: src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:06.666094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:06.666326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.666353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.666408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:06.666505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:06.675662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:06.675686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:06.675690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:06.675693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:06.675706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601857967625336:5096]
2025-10-10T14:36:06.675710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601857967625336:5096]
2025-10-10T14:36:06.675718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601857967625336:5096]
2025-10-10T14:36:06.675772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:06.675772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:06.675779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:06.675779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.675782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:06.675783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:06.675921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:06.716129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601858749854648:6092]
2025-10-10T14:36:06.716433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1904, pipe: [1:7559601858749854648:6092]
2025-10-10T14:36:06.823855Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:06.833282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.833315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.833570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.833647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.833718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.833793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.833844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.833855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.833934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.834005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.834072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.834148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.834201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.834210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.834295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.834366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.834436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.834507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.834557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.834565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.834637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.834698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.834763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.834839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.834888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.834896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.834968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.835035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.835106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.835176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.835228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.835238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.835309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.835374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.835447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.835515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.835562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.835571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.835643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.835709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.835778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.835849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.835897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.835904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.835974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.836039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.836105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.836182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.836228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.836235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.836312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.836375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.836451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.836516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.836583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.836594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.836664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:06.836727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:06.836795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:06.836861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:06.836909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:06.836917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:06.836995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854648:6092], now have 1 active actors on pipe
2025-10-10T14:36:06.837604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601858749854648:6092]
2025-10-10T14:36:06.837631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:06.837647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:06.837649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:06.837690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1905 reason: error at write: Disconnected sessionId: src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0
2025-10-10T14:36:06.837926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1905 sessionId: src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0 is DEAD
2025-10-10T14:36:06.838699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:06.838710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0] Write session will restart in 0.008960s
2025-10-10T14:36:06.838736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0] Write session: Do CDS request
2025-10-10T14:36:06.838708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:06.838742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:06.848928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.849063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:06.849079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1906
2025-10-10T14:36:06.849255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:06.849302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:06.849324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:06.849347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:06.850107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1906 sessionId:  describe result for acl check
2025-10-10T14:36:06.850145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:06.850154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:06.850156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:06.850163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601858749854682:6060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:06.850745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601858749854682:6060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:06.857377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601858749854682:6060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:06.861916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601858749854682:6060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:06.861941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601858749854682:6060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:06.861946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601858749854682:6060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:06.861955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:06.861978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:06.864960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:06.865251Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:06.865264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:06.865279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:06.865368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:06.865416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601857967625594:5094]
2025-10-10T14:36:06.866066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:06.866478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:06.866543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:06.866921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:06.866980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.866986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.866987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.866988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.866989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.866991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.866993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.866994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.866996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.866997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.866998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.866999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.867000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.867007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.867021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.867025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.867030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.867034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.867038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.867042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.867046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.867050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.867055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.867072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.867077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.867081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.867088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.867098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:06.867109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.867115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:06.867125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.867130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:06.867139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.867144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:06.867149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.867154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:06.867163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.867168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:06.867175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.867185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:06.867189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.867195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:06.867206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.867211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:06.867216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.867221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:06.867226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.867231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.867243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.867249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.867257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.867262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.867310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:06.869984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:06.870478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:06.870493Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:06.870496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:06.870501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:06.870518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1905 [2:7559601857967625594:5094]
2025-10-10T14:36:06.870534Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:06.870561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:06.870565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.870568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.870571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.870591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:06.870604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:06.870614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:06.870682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.870689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.870692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.870695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:06.870767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:06.870777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.870787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:06.870798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:06.870814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:06.870835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601857967625588:5094]
2025-10-10T14:36:06.870843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601857967625588:5094]
2025-10-10T14:36:06.870846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601857967625588:5094]
2025-10-10T14:36:06.870855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:06.870869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:06.870874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:06.870875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:06.870877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:06.870890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:06.870893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:06.870905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854654:2438], now have 1 active actors on pipe
2025-10-10T14:36:06.870908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854898:6060], now have 1 active actors on pipe
2025-10-10T14:36:06.870942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601857967625588:5094]
2025-10-10T14:36:06.870951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:06.870962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:06.870960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1905
2025-10-10T14:36:06.870979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1905
2025-10-10T14:36:06.871123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.871134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.871170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1545a5c6-716cac85-3d8060d4-831752eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:06.871178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:06.871183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:06.871185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:06.871200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:06.871217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:06.871237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.871417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.871432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.871466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:06.871613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1906 partition: 0 MaxSeqNo: 40 sessionId: src_id|1545a5c6-716cac85-3d8060d4-831752eb_0
2025-10-10T14:36:06.872087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2a85ef-6a475ca5-188cf58b-d7331340_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1545a5c6-716cac85-3d8060d4-831752eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:06.875049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1545a5c6-716cac85-3d8060d4-831752eb_0] Write session: try to update token
2025-10-10T14:36:06.875069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1545a5c6-716cac85-3d8060d4-831752eb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:06.891937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId: src_id|1545a5c6-716cac85-3d8060d4-831752eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:06.895070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:06.895348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:06.895384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:06.895432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:06.895545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:06.903096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:06.903118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:06.903121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:06.903124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:06.903134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601857967625588:5094]
2025-10-10T14:36:06.903140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601857967625588:5094]
2025-10-10T14:36:06.903144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601857967625588:5094]
2025-10-10T14:36:06.903198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:06.903202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:06.903209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:06.903214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:06.903217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:06.903220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:06.903367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:06.937804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601858749854910:6092]
2025-10-10T14:36:06.941646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1905, pipe: [1:7559601858749854910:6092]
2025-10-10T14:36:07.026824Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:07.036333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.036366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.036556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.036627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.036692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.036762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.036811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.036826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.036900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.036975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.037044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.037114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.037174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.037183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.037252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.037317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.037399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.037468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.037516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.037524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.037596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.037668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.037825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.037975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.038024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.038032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.038104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.038169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.038244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.038309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.038356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.038364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.038446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.038512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.038582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.038650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.038698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.038706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.038777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.038841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.038911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.038982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.039029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.039036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.039107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.039172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.039240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.039305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.039352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.039360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.039427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.040343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:07.040416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:07.040424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:07.040472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1906 reason: error at write: Disconnected sessionId: src_id|1545a5c6-716cac85-3d8060d4-831752eb_0
2025-10-10T14:36:07.040643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601858749854910:6092]
2025-10-10T14:36:07.040705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1906 sessionId: src_id|1545a5c6-716cac85-3d8060d4-831752eb_0 is DEAD
2025-10-10T14:36:07.039488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.039556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.039617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.039657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.039660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.039728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.039786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.039848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.039910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.039953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.039955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.040030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601858749854910:6092], now have 1 active actors on pipe
2025-10-10T14:36:07.041298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:07.041468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1545a5c6-716cac85-3d8060d4-831752eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:07.041481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1545a5c6-716cac85-3d8060d4-831752eb_0] Write session will restart in 0.005128s
2025-10-10T14:36:07.041507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1545a5c6-716cac85-3d8060d4-831752eb_0] Write session: Do CDS request
2025-10-10T14:36:07.041515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1545a5c6-716cac85-3d8060d4-831752eb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:07.047939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1545a5c6-716cac85-3d8060d4-831752eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.048320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:07.048334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1907
2025-10-10T14:36:07.048483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.048531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:07.048543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:07.048548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:07.049069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1907 sessionId:  describe result for acl check
2025-10-10T14:36:07.049114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:07.049122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:07.049125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:07.049131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601863044822224:6050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:07.049776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601863044822224:6050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:07.053078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601863044822224:6050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:07.058257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601863044822224:6050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:07.058275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601863044822224:6050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:07.058279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601863044822224:6050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:07.058290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:07.064256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:07.067210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:07.067471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:07.067476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:07.067487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:07.067543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:07.067587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601862262593135:5077]
2025-10-10T14:36:07.068265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:07.068665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:07.068741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:07.069112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:07.069196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.069198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.069199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.069200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.069202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.069203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.069204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.069206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.069207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.069208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.069210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.069211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.069212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.069218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.069231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.069236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.069240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.069244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.069248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.069252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.069255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.069259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.069263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.069267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.069271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.069275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.069283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.069293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.069299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.069305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.069310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.069316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.069321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.069326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.069349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.069354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.069358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.069364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.069369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.069374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.069379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.069384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.069390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.069395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.069399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.069405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.069411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.069416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.069421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.069427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.069433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.069438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.069477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:07.072212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:07.072552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:07.072572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:07.072575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:07.072579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:07.072586Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1906 [2:7559601862262593135:5077]
2025-10-10T14:36:07.072601Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:07.072620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:07.072624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.072628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.072632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.072651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:07.072665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:07.072679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:07.072752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.072759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.072762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.072764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:07.072835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:07.072843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.072869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.072888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.072905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:07.072935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822362:6050], now have 1 active actors on pipe
2025-10-10T14:36:07.072939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822209:2438], now have 1 active actors on pipe
2025-10-10T14:36:07.072947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601862262593130:5077]
2025-10-10T14:36:07.072950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601862262593130:5077]
2025-10-10T14:36:07.072952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601862262593130:5077]
2025-10-10T14:36:07.072967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:07.072983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:07.072993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:07.072996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:07.072999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:07.073006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:07.073010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:07.073040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601862262593130:5077]
2025-10-10T14:36:07.073048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:07.073013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1906
2025-10-10T14:36:07.073015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1906
2025-10-10T14:36:07.073064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:07.073103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.073113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.073146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:07.073160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.073176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.073179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:07.073191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.073205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:07.073225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.073447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.073456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.073472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.073613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1907 partition: 0 MaxSeqNo: 40 sessionId: src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0
2025-10-10T14:36:07.074116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1545a5c6-716cac85-3d8060d4-831752eb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:07.076939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0] Write session: try to update token
2025-10-10T14:36:07.076958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:07.094767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:07.094793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:07.094797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:07.094799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:07.094811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601862262593130:5077]
2025-10-10T14:36:07.094816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601862262593130:5077]
2025-10-10T14:36:07.094821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601862262593130:5077]
2025-10-10T14:36:07.094881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:07.094890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.094893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:07.094927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:07.094944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:07.094949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:07.095055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:07.095895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId: src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:07.098905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:07.141117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601863044822454:6092]
2025-10-10T14:36:07.141566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1906, pipe: [1:7559601863044822454:6092]
2025-10-10T14:36:07.220582Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:07.221110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.221127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.221208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822454:6092], now have 1 active actors on pipe
2025-10-10T14:36:07.221437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:07.221446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:07.221502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:07.221942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:07.221954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0] Write session will restart in 0.007376s
2025-10-10T14:36:07.221981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0] Write session: Do CDS request
2025-10-10T14:36:07.221998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:07.221588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1907 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0
2025-10-10T14:36:07.221784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1907 sessionId: src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0 is DEAD
2025-10-10T14:36:07.222076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601863044822454:6092]
2025-10-10T14:36:07.232119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.232277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:07.232292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1908
2025-10-10T14:36:07.232522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.232576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:07.232583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:07.232587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:07.233506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1908 sessionId:  describe result for acl check
2025-10-10T14:36:07.233546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:07.233552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:07.233555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:07.233561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601863044822500:6047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:07.234192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601863044822500:6047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:07.238059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601863044822500:6047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:07.241835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601863044822500:6047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:07.241850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601863044822500:6047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:07.241855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601863044822500:6047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:07.241865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:07.245557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:07.248391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:07.248639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:07.248644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:07.248657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:07.248721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:07.248766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601862262593378:5069]
2025-10-10T14:36:07.249440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:07.249808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:07.249877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:07.250257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:07.250332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.250339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.250340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.250341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.250343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.250344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.250345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.250347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.250348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.250349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.250350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.250352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.250353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.250359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.250373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.250377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.250381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.250386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.250390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.250394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.250398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.250402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.250410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.250414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.250417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.250421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.250430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.250438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.250445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.250451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.250456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.250461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.250467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.250472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.250477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.250483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.250489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.250494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.250499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.250505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.250509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.250514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.250519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.250524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.250529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.250534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.250539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.250545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.250549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.250561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.250567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.250577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.250618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:07.254921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:07.255879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:07.255895Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:07.255898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:07.255904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:07.255911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1907 [2:7559601862262593378:5069]
2025-10-10T14:36:07.255927Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:07.255947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:07.255956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.255960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.255963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.255982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:07.255995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:07.256003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:07.256074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.256082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.256084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.256087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:07.256164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:07.256173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.256187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.256197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.256212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:07.256237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822457:2438], now have 1 active actors on pipe
2025-10-10T14:36:07.256247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822641:6047], now have 1 active actors on pipe
2025-10-10T14:36:07.256255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601862262593373:5069]
2025-10-10T14:36:07.256257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601862262593373:5069]
2025-10-10T14:36:07.256259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601862262593373:5069]
2025-10-10T14:36:07.256272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:07.256340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1907
2025-10-10T14:36:07.256340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1907
2025-10-10T14:36:07.256288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:07.256293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:07.256297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:07.256299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:07.256310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:07.256314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:07.256352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601862262593373:5069]
2025-10-10T14:36:07.256360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:07.256377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:07.256408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.256413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.256443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:07.256454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.256465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.256467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:07.256479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.256496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:07.256520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.256662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.256673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.256691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.256800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1908 partition: 0 MaxSeqNo: 40 sessionId: src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0
2025-10-10T14:36:07.257233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16ebcb2e-244afdc5-a8aef9ed-1a27f7e9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:07.260101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0] Write session: try to update token
2025-10-10T14:36:07.260120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:07.268886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:07.268914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:07.268925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601862262593373:5069]
2025-10-10T14:36:07.268980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:07.268982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:07.269180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:07.269353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:07.269503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:07.269642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:07.269851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:07.269907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:07.278825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId: src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:07.281767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:07.282079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.282105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.282150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:07.282275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:07.287949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:07.287975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:07.287978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:07.287980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:07.287992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601862262593373:5069]
2025-10-10T14:36:07.287998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601862262593373:5069]
2025-10-10T14:36:07.288003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601862262593373:5069]
2025-10-10T14:36:07.288061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:07.288064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:07.288074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.288077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:07.288081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:07.288086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:07.288214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:07.322325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601863044822704:6092]
2025-10-10T14:36:07.322791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1907, pipe: [1:7559601863044822704:6092]
2025-10-10T14:36:07.412059Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:07.421130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.421189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.424773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601863044822704:6092]
2025-10-10T14:36:07.424818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:07.424820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:07.424851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1908 reason: error at write: Disconnected sessionId: src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0
2025-10-10T14:36:07.425065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1908 sessionId: src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0 is DEAD
2025-10-10T14:36:07.425250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:07.425262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0] Write session will restart in 0.007227s
2025-10-10T14:36:07.425250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:07.425289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0] Write session: Do CDS request
2025-10-10T14:36:07.425295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:07.421403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.421472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.421538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.421605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.421647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.421653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.421729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.421791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.421855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.421925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.421973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.421976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.422050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.422114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.422176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.422239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.422281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.422284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.422355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.422420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.422484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.422544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.422584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.422588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.422657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.422717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.422778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.422840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.422883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.422886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.422957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.423014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.423073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.423135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.423182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.423186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.423253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.423311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.423377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.423437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.423478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.423484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.423556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.423614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.423677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.423742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.423784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.423786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.423857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.423951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.424017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.424078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.424117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.424123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.424192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.424250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.424313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.424374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.424415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.424417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.424513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822704:6092], now have 1 active actors on pipe
2025-10-10T14:36:07.425094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:07.433887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.434308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:07.434327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1909
2025-10-10T14:36:07.434450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.434492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:07.434502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:07.434506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:07.435084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1909 sessionId:  describe result for acl check
2025-10-10T14:36:07.435135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:07.435141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:07.435143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:07.435149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601863044822715:6041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:07.435749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601863044822715:6041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:07.440188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601863044822715:6041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:07.450220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601863044822715:6041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:07.450239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601863044822715:6041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:07.450243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601863044822715:6041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:07.450253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:07.462397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:07.465375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:07.465601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:07.465606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:07.465618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:07.465670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:07.465714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601862262593623:5067]
2025-10-10T14:36:07.466358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:07.466681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:07.466730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:07.467050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:07.467105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.467106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.467108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.467109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.467110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.467112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.467113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.467115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.467116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.467117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.467118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.467120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.467121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.467127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.467140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.467144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.467148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.467152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.467156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.467160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.467164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.467168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.467173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.467177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.467182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.467185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.467193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.467202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.467210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.467216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.467221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.467227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.467232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.467238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.467243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.467249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.467254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.467260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.467265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.467271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.467276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.467282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.467287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.467293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.467298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.467303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.467308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.467314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.467320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.467326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.467331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.467336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.467376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:07.469804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:07.470547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:07.470552Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:07.470554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:07.470558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:07.470564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1908 [2:7559601862262593623:5067]
2025-10-10T14:36:07.470576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:07.470594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:07.470598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.470602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.470605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.470622Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:07.470630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:07.470638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:07.470695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.470697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.470699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.470702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:07.470774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:07.470777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.470790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.470803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.470820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:07.470841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601862262593617:5067]
2025-10-10T14:36:07.470844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601862262593617:5067]
2025-10-10T14:36:07.470846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601862262593617:5067]
2025-10-10T14:36:07.470861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:07.470876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:07.470894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:07.470898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:07.470921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601862262593617:5067]
2025-10-10T14:36:07.470924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:07.471269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1908
2025-10-10T14:36:07.471279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1908
2025-10-10T14:36:07.471171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:07.471179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:07.471182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:07.471188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:07.471189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822706:2438], now have 1 active actors on pipe
2025-10-10T14:36:07.471197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822792:6041], now have 1 active actors on pipe
2025-10-10T14:36:07.471630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.471648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.471683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:07.471701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.471706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.471709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:07.471723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.471748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:07.471764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.472042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.472057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.472084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.472198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1909 partition: 0 MaxSeqNo: 40 sessionId: src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0
2025-10-10T14:36:07.472605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b9e357-bbda7d41-c48d03fe-1cf3c16d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:07.475363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0] Write session: try to update token
2025-10-10T14:36:07.475385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:07.490344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId: src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:07.492942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:07.494567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.494594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.494619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:07.494623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:07.494626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:07.494628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:07.494637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601862262593617:5067]
2025-10-10T14:36:07.494648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601862262593617:5067]
2025-10-10T14:36:07.494651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601862262593617:5067]
2025-10-10T14:36:07.494701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:07.494712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:07.494713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:07.494718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:07.494721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.494724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:07.494856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:07.525020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601863044822958:6092]
2025-10-10T14:36:07.525431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1908, pipe: [1:7559601863044822958:6092]
2025-10-10T14:36:07.618438Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:07.618729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:07.618796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822958:6092], now have 1 active actors on pipe
2025-10-10T14:36:07.618899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:07.619033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601863044822958:6092]
2025-10-10T14:36:07.619062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:07.631724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:07.631740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0] Write session will restart in 0.009600s
2025-10-10T14:36:07.631768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0] Write session: Do CDS request
2025-10-10T14:36:07.631775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:07.631303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:07.631317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:07.631346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1909 reason: error at write: Disconnected sessionId: src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0
2025-10-10T14:36:07.631508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1909 sessionId: src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0 is DEAD
2025-10-10T14:36:07.643036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.643132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:07.643148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1910
2025-10-10T14:36:07.643346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.643382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:07.643393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:07.643398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:07.644361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1910 sessionId:  describe result for acl check
2025-10-10T14:36:07.644402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:07.644404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:07.644405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:07.644413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601863044823189:6024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:07.645005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601863044823189:6024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:07.645074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:07.648103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:07.648236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601863044823189:6024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:07.648365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:07.648377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:07.648391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:07.648453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:07.648502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601862262593905:5031]
2025-10-10T14:36:07.649185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:07.649633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:07.649691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:07.650117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:07.650186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.650193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.650194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.650195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.650197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.650198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.650199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.650201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.650202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.650203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.650205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.650206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.650207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.650214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.650228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.650233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.650238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.650241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.650246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.650250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.650255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.650259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.650264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.650268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.650273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.650277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.650285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.650295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.650302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.650308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.650313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.650319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.650324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.650330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.650336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.650342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.650347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.650352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.650370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.650380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.650386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.650397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.650402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.650408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.650413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.650419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.650424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.650430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.650435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.650446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.650451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.650459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.650508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:07.651311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601863044823189:6024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:07.651326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601863044823189:6024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:07.651329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601863044823189:6024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:07.651338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:07.653018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:07.653749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:07.653766Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:07.653768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:07.653772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:07.653778Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1909 [2:7559601862262593905:5031]
2025-10-10T14:36:07.653791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:07.653810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:07.653814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.653818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.653820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.653839Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:07.653852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:07.653860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:07.653926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.653935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.653937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.653940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:07.654026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:07.654036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.654049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.654063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.654087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:07.654116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044822983:2438], now have 1 active actors on pipe
2025-10-10T14:36:07.654125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044823222:6024], now have 1 active actors on pipe
2025-10-10T14:36:07.654133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601862262593900:5031]
2025-10-10T14:36:07.654136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601862262593900:5031]
2025-10-10T14:36:07.654138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601862262593900:5031]
2025-10-10T14:36:07.654152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:07.654165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:07.654167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:07.654179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:07.654181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:07.654185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:07.654189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:07.654215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601862262593900:5031]
2025-10-10T14:36:07.654227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:07.654233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:07.654374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1909
2025-10-10T14:36:07.654390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1909
2025-10-10T14:36:07.654612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.654627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.654680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|870a331d-f0d57efc-2456960b-219e78db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:07.654694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.654699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.654706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:07.654722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.654742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:07.654767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.655024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.655038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.655073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.655153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1910 partition: 0 MaxSeqNo: 40 sessionId: src_id|870a331d-f0d57efc-2456960b-219e78db_0
2025-10-10T14:36:07.655571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|232eb535-2a35d8e7-219433b1-6984a5e3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|870a331d-f0d57efc-2456960b-219e78db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:07.658346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870a331d-f0d57efc-2456960b-219e78db_0] Write session: try to update token
2025-10-10T14:36:07.658371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870a331d-f0d57efc-2456960b-219e78db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:07.667136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:07.667153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:07.667167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601862262593900:5031]
2025-10-10T14:36:07.667225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:07.667257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:07.667423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:07.667581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:07.667731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:07.667893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:07.668129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:07.668180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:07.677487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId: src_id|870a331d-f0d57efc-2456960b-219e78db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:07.680331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:07.680562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.680588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.680630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:07.680713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:07.685579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:07.685603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:07.685607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:07.685609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:07.685622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601862262593900:5031]
2025-10-10T14:36:07.685627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601862262593900:5031]
2025-10-10T14:36:07.685631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601862262593900:5031]
2025-10-10T14:36:07.685684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:07.685688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:07.685692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:07.685696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.685697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:07.685699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:07.685842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:07.719136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601863044823234:6092]
2025-10-10T14:36:07.719498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1909, pipe: [1:7559601863044823234:6092]
2025-10-10T14:36:07.807636Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:07.816510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.816543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.816726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.816789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.816854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.816916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.816957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.816976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.817048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.817116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.817198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.817270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.817315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.817343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.817410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.817473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.817537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.817602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.817648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.817656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.817723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.817790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.817856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.817923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.817969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.817977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.818047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.818110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.818182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.818246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.818295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.818303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.818371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.818437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.818503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.818567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.818614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.818621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.818690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.818750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.818819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.818884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.818932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.818939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.819008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.819069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.819137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.819202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.819259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.819268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.819337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.819399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.819463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.819526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.819571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.819580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.819646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:07.819708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:07.819772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:07.819836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:07.819885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:07.819898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:07.819962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044823234:6092], now have 1 active actors on pipe
2025-10-10T14:36:07.820351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:07.820364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:07.820397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1910 reason: error at write: Disconnected sessionId: src_id|870a331d-f0d57efc-2456960b-219e78db_0
2025-10-10T14:36:07.820622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1910 sessionId: src_id|870a331d-f0d57efc-2456960b-219e78db_0 is DEAD
2025-10-10T14:36:07.820838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601863044823234:6092]
2025-10-10T14:36:07.820859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:07.820979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:07.820999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870a331d-f0d57efc-2456960b-219e78db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:07.821008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870a331d-f0d57efc-2456960b-219e78db_0] Write session will restart in 0.009662s
2025-10-10T14:36:07.821033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870a331d-f0d57efc-2456960b-219e78db_0] Write session: Do CDS request
2025-10-10T14:36:07.821040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870a331d-f0d57efc-2456960b-219e78db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:07.832651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|870a331d-f0d57efc-2456960b-219e78db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.832769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:07.832785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1911
2025-10-10T14:36:07.832972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.833010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:07.833016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:07.833021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:07.833562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1911 sessionId:  describe result for acl check
2025-10-10T14:36:07.833599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:07.833601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:07.833603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:07.833610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601863044823308:6015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:07.834638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601863044823308:6015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:07.838061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601863044823308:6015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:07.841553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601863044823308:6015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:07.841568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601863044823308:6015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:07.841572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601863044823308:6015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:07.841582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:07.841962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:07.844452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:07.844662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:07.844674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:07.844686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:07.844739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:07.844783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601862262594153:5014]
2025-10-10T14:36:07.845436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:07.845727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:07.845769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:07.846091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:07.846149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.846156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.846157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.846159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.846161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.846162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.846163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.846164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.846165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.846166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.846168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.846169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.846170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.846176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.846190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.846194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.846198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.846202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.846207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.846211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.846215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.846218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.846223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.846227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.846230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.846234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.846243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.846252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:07.846258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.846263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:07.846267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.846272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:07.846277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.846282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:07.846287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.846293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:07.846297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.846303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:07.846307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.846313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:07.846317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.846322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:07.846327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.846332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:07.846338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.846345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:07.846355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.846360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.846364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.846369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.846375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.846380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.846424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:07.848870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:07.849573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:07.849587Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:07.849590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:07.849594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:07.849599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1910 [2:7559601862262594153:5014]
2025-10-10T14:36:07.849612Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:07.849631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:07.849639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.849643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.849645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.849663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:07.849675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:07.849683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:07.849750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.849759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.849761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.849764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:07.849837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:07.849845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.849857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:07.849874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:07.849897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:07.849923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601862262594147:5014]
2025-10-10T14:36:07.849932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601862262594147:5014]
2025-10-10T14:36:07.849934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601862262594147:5014]
2025-10-10T14:36:07.849944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:07.849960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:07.849963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044823476:6015], now have 1 active actors on pipe
2025-10-10T14:36:07.849963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:07.849965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:07.849969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:07.849987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:07.849996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:07.850004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044823240:2438], now have 1 active actors on pipe
2025-10-10T14:36:07.850032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601862262594147:5014]
2025-10-10T14:36:07.850044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:07.850050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:07.850072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1910
2025-10-10T14:36:07.850075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1910
2025-10-10T14:36:07.850144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.850155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.850188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:07.850201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:07.850207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:07.850210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:07.850223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:07.850235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:07.850250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.850422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.850430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.850447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:07.850551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1911 partition: 0 MaxSeqNo: 40 sessionId: src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0
2025-10-10T14:36:07.850972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|870a331d-f0d57efc-2456960b-219e78db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:07.853790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0] Write session: try to update token
2025-10-10T14:36:07.853809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:07.870572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:07.870593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:07.870597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:07.870599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:07.870609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601862262594147:5014]
2025-10-10T14:36:07.870614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601862262594147:5014]
2025-10-10T14:36:07.870619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601862262594147:5014]
2025-10-10T14:36:07.869109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId: src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:07.871896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:07.870673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:07.870683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:07.870689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:07.870691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:07.870691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:07.870695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:07.870855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:07.920861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601863044823501:6092]
2025-10-10T14:36:07.921251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1910, pipe: [1:7559601863044823501:6092]
2025-10-10T14:36:07.986814Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:07.987250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:07.987273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:07.987320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044823501:6092], now have 1 active actors on pipe
2025-10-10T14:36:07.987531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:07.987597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:07.987610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:07.987755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1911 reason: error at write: Disconnected sessionId: src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0
2025-10-10T14:36:07.987951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1911 sessionId: src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0 is DEAD
2025-10-10T14:36:07.988123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:07.988163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601863044823501:6092]
2025-10-10T14:36:07.988352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:07.988362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0] Write session will restart in 0.009638s
2025-10-10T14:36:07.988387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0] Write session: Do CDS request
2025-10-10T14:36:07.988396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:07.998967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.999036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:07.999053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1912
2025-10-10T14:36:07.999211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:07.999247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:07.999268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:07.999275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:07.999753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1912 sessionId:  describe result for acl check
2025-10-10T14:36:07.999792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:07.999795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:07.999797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:07.999803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601863044823561:6004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:08.000482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601863044823561:6004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:08.003660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601863044823561:6004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:08.009815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601863044823561:6004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:08.009829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601863044823561:6004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:08.009833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601863044823561:6004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:08.009844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:08.010465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:08.012986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:08.013207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:08.013217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:08.013231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:08.013290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:08.013356Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601866557561710:5012]
2025-10-10T14:36:08.013971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:08.014280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:08.014340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:08.014690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:08.014762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.014770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.014771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.014772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.014774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.014775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.014776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.014778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.014779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.014780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.014782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.014783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.014784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.014790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.014804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.014809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.014813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.014817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.014822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.014825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.014830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.014847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.014852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.014856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.014860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.014863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.014871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.014880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.014887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.014894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.014899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.014904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.014909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.014915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.014920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.014925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.014929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.014935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.014949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.014959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.014963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.014968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.014973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.014978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.014987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.014992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.014999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.015004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.015009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.015014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.015023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.015029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.015071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:08.017517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:08.017849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:08.017865Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:08.017868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:08.017872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:08.017878Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1911 [2:7559601866557561710:5012]
2025-10-10T14:36:08.017891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:08.017910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:08.017913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.017917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.017919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.017936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:08.017944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:08.017953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:08.018007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.018016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.018018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.018021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:08.018090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:08.018099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.018111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.018123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.018141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:08.018167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791038:6004], now have 1 active actors on pipe
2025-10-10T14:36:08.018176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601863044823504:2438], now have 1 active actors on pipe
2025-10-10T14:36:08.018184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601866557561705:5012]
2025-10-10T14:36:08.018194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601866557561705:5012]
2025-10-10T14:36:08.018197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601866557561705:5012]
2025-10-10T14:36:08.018210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:08.018218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1911
2025-10-10T14:36:08.018222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1911
2025-10-10T14:36:08.018222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:08.018225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:08.018234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:08.018236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:08.018244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:08.018247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:08.018271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601866557561705:5012]
2025-10-10T14:36:08.018280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:08.018315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:08.018369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.018381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.018413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|834093e7-b3230223-632c3bf0-fee871bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:08.018420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.018425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.018435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:08.018446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.018457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:08.018480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.019045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.019059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.019081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.019209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1912 partition: 0 MaxSeqNo: 40 sessionId: src_id|834093e7-b3230223-632c3bf0-fee871bb_0
2025-10-10T14:36:08.019666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcf7c4a8-f7a29703-e81e018b-19aa1aeb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|834093e7-b3230223-632c3bf0-fee871bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:08.022485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|834093e7-b3230223-632c3bf0-fee871bb_0] Write session: try to update token
2025-10-10T14:36:08.022506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|834093e7-b3230223-632c3bf0-fee871bb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:08.036999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId: src_id|834093e7-b3230223-632c3bf0-fee871bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:08.039489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:08.039513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.039517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:08.039519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:08.039529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601866557561705:5012]
2025-10-10T14:36:08.039533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601866557561705:5012]
2025-10-10T14:36:08.039537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601866557561705:5012]
2025-10-10T14:36:08.039592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:08.039600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.039602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:08.039745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:08.039754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:08.039871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:08.039886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:08.039893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:08.088856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601867339791050:6092]
2025-10-10T14:36:08.089317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1911, pipe: [1:7559601867339791050:6092]
2025-10-10T14:36:08.154956Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:08.155497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.155508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.155555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791050:6092], now have 1 active actors on pipe
2025-10-10T14:36:08.155810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:08.155837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:08.155857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:08.155864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601867339791050:6092]
2025-10-10T14:36:08.155868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:08.155933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1912 reason: error at write: Disconnected sessionId: src_id|834093e7-b3230223-632c3bf0-fee871bb_0
2025-10-10T14:36:08.156142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1912 sessionId: src_id|834093e7-b3230223-632c3bf0-fee871bb_0 is DEAD
2025-10-10T14:36:08.156346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|834093e7-b3230223-632c3bf0-fee871bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:08.156356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|834093e7-b3230223-632c3bf0-fee871bb_0] Write session will restart in 0.005342s
2025-10-10T14:36:08.156392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|834093e7-b3230223-632c3bf0-fee871bb_0] Write session: Do CDS request
2025-10-10T14:36:08.156399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|834093e7-b3230223-632c3bf0-fee871bb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:08.163072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|834093e7-b3230223-632c3bf0-fee871bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.163165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:08.163191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1913
2025-10-10T14:36:08.163398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.163470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:08.163477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:08.163480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:08.164003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1913 sessionId:  describe result for acl check
2025-10-10T14:36:08.164045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:08.164052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:08.164054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:08.164061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601867339791067:6000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:08.164675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601867339791067:6000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:08.167620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601867339791067:6000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:08.171331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601867339791067:6000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:08.171343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601867339791067:6000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:08.171348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601867339791067:6000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:08.171356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:08.176556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:08.179194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:08.179436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:08.179451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:08.179465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:08.179531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:08.179579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601866557561959:5007]
2025-10-10T14:36:08.180208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:08.180566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:08.180634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:08.180986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:08.181229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.181239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.181241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.181242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.181243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.181245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.181246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.181248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.181249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.181250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.181252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.181253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.181254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.181261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.181276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.181280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.181285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.181289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.181294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.181298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.181302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.181306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.181312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.181316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.181321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.181325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.181356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.181366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.181380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.181387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.181397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.181402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.181407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.181413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.181418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.181424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.181434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.181440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.181450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.181455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.181465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.181470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.181475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.181481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.181486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.181491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.181496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.181502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.181512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.181518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.181528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.181534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.181581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:08.184061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:08.184641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:08.184657Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:08.184659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:08.184664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:08.184672Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1912 [2:7559601866557561959:5007]
2025-10-10T14:36:08.184690Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:08.184708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:08.184712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.184716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.184719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.184737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:08.184752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:08.184761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:08.184833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.184842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.184844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.184847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:08.184919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:08.184928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.184941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.184959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.184981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:08.185009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601866557561953:5007]
2025-10-10T14:36:08.185016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601866557561953:5007]
2025-10-10T14:36:08.185019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601866557561953:5007]
2025-10-10T14:36:08.185034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:08.185046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:08.185120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1912
2025-10-10T14:36:08.185050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:08.185123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1912
2025-10-10T14:36:08.185053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:08.185059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791194:6000], now have 1 active actors on pipe
2025-10-10T14:36:08.185066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:08.185084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:08.185087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:08.185094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791052:2438], now have 1 active actors on pipe
2025-10-10T14:36:08.185116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601866557561953:5007]
2025-10-10T14:36:08.185129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:08.185155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:08.185183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.185189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.185221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55b30673-42692b39-6295d1ab-9386e506_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:08.185229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.185241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.185244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:08.185256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.185273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:08.185291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.185489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.185503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.185526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.185676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1913 partition: 0 MaxSeqNo: 40 sessionId: src_id|55b30673-42692b39-6295d1ab-9386e506_0
2025-10-10T14:36:08.186131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|834093e7-b3230223-632c3bf0-fee871bb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55b30673-42692b39-6295d1ab-9386e506_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:08.189009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b30673-42692b39-6295d1ab-9386e506_0] Write session: try to update token
2025-10-10T14:36:08.189035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b30673-42692b39-6295d1ab-9386e506_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:08.197037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:08.197061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.197075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601866557561953:5007]
2025-10-10T14:36:08.197125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:08.197144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:08.197372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:08.197532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.197675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.197803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.197999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:08.198053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:08.205403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId: src_id|55b30673-42692b39-6295d1ab-9386e506_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:08.208161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:08.208386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.208411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.208452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:08.208557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:08.216639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:08.216664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.216668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:08.216670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:08.216682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601866557561953:5007]
2025-10-10T14:36:08.216687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601866557561953:5007]
2025-10-10T14:36:08.216692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601866557561953:5007]
2025-10-10T14:36:08.216745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:08.216752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.216755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:08.216760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:08.216767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:08.216771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:08.216903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:08.256227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601867339791302:6092]
2025-10-10T14:36:08.256520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1912, pipe: [1:7559601867339791302:6092]
2025-10-10T14:36:08.333569Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:08.342891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.342931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.343137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.343204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.343275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.343346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.343391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.343396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.343482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.343553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.343622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.343693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.343739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.343742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.343822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.343885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.343955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.344027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.344569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.344575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.344657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.344731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.344804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.344876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.344922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.344925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.345004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.345071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.345166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.345237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.345282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.345285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.347600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:08.347611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:08.347649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1913 reason: error at write: Disconnected sessionId: src_id|55b30673-42692b39-6295d1ab-9386e506_0
2025-10-10T14:36:08.347935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1913 sessionId: src_id|55b30673-42692b39-6295d1ab-9386e506_0 is DEAD
2025-10-10T14:36:08.347981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:08.348036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601867339791302:6092]
2025-10-10T14:36:08.345580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.345660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.345727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.345796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.345841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.345844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.345926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.345994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.346074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.346152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.346202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.346205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.346275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.346338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.346404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.346472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.346518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.346521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.346599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.346673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.346737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.346804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.346849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.346852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.346934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.347002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.347068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.347138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.347183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.347186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.347281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791302:6092], now have 1 active actors on pipe
2025-10-10T14:36:08.348088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:08.348693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b30673-42692b39-6295d1ab-9386e506_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:08.348704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b30673-42692b39-6295d1ab-9386e506_0] Write session will restart in 0.006255s
2025-10-10T14:36:08.348731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b30673-42692b39-6295d1ab-9386e506_0] Write session: Do CDS request
2025-10-10T14:36:08.348737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b30673-42692b39-6295d1ab-9386e506_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:08.361880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b30673-42692b39-6295d1ab-9386e506_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.361935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:08.361966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1914
2025-10-10T14:36:08.362116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.362157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:08.362169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:08.362172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:08.362776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1914 sessionId:  describe result for acl check
2025-10-10T14:36:08.362829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:08.362831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:08.362833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:08.362839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601867339791401:5996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:08.363423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601867339791401:5996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:08.367536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601867339791401:5996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:08.371179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:08.374257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:08.374534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:08.374549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:08.374564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:08.374645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:08.374696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601866557562207:5002]
2025-10-10T14:36:08.374704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601867339791401:5996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:08.374727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601867339791401:5996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:08.374732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601867339791401:5996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:08.374741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:08.375222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:08.375550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:08.375601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:08.375943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:08.376170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.376177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.376178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.376179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.376181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.376182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.376183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.376184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.376186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.376187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.376188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.376189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.376191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.376197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.376211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.376215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.376219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.376222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.376225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.376228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.376231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.376235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.376240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.376244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.376247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.376251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.376260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.376268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.376275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.376280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.376284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.376288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.376292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.376297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.376301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.376305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.376309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.376333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.376357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.376366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.376370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.376378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.376394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.376399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.376403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.376408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.376420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.376425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.376428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.376438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.376442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.376466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.376505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:08.379135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:08.379446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:08.379460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:08.379463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:08.379467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:08.379475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1913 [2:7559601866557562207:5002]
2025-10-10T14:36:08.379489Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:08.379513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:08.379520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.379524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.379527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.379546Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:08.379558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:08.379566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:08.379632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.379642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.379645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.379648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:08.379736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:08.379746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.379758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.379771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.379786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:08.379816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791305:2438], now have 1 active actors on pipe
2025-10-10T14:36:08.379820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791545:5996], now have 1 active actors on pipe
2025-10-10T14:36:08.379828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601866557562202:5002]
2025-10-10T14:36:08.379831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601866557562202:5002]
2025-10-10T14:36:08.379833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601866557562202:5002]
2025-10-10T14:36:08.379847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:08.379860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:08.379862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:08.379871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:08.379873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:08.379879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:08.379882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:08.379897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1913
2025-10-10T14:36:08.379907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1913
2025-10-10T14:36:08.379910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601866557562202:5002]
2025-10-10T14:36:08.379920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:08.379922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:08.379949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.379954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.379994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:08.380002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.380006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.380008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:08.380019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.380030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:08.380048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.380302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.380313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.380329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.380435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1914 partition: 0 MaxSeqNo: 40 sessionId: src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0
2025-10-10T14:36:08.380838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b30673-42692b39-6295d1ab-9386e506_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:08.383517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0] Write session: try to update token
2025-10-10T14:36:08.383535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:08.398187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId: src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:08.400831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:08.400860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.400863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:08.400865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:08.400875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601866557562202:5002]
2025-10-10T14:36:08.400884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601866557562202:5002]
2025-10-10T14:36:08.400889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601866557562202:5002]
2025-10-10T14:36:08.400942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:08.400945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:08.400949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.400952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:08.400953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:08.400957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:08.400916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:08.401118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:08.448234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601867339791556:6092]
2025-10-10T14:36:08.448631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1913, pipe: [1:7559601867339791556:6092]
2025-10-10T14:36:08.518682Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:08.518993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.519014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.519065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791556:6092], now have 1 active actors on pipe
2025-10-10T14:36:08.519433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:08.519825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:08.519837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0] Write session will restart in 0.005091s
2025-10-10T14:36:08.519865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0] Write session: Do CDS request
2025-10-10T14:36:08.519872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:08.519337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:08.519351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:08.519359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:08.519418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601867339791556:6092]
2025-10-10T14:36:08.519441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1914 reason: error at write: Disconnected sessionId: src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0
2025-10-10T14:36:08.519649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1914 sessionId: src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0 is DEAD
2025-10-10T14:36:08.525896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.525968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:08.525985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1915
2025-10-10T14:36:08.526231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.526295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:08.526301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:08.526306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:08.526825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1915 sessionId:  describe result for acl check
2025-10-10T14:36:08.526860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:08.526866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:08.526868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:08.526873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601867339791573:5995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:08.527459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601867339791573:5995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:08.529667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601867339791573:5995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:08.533997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601867339791573:5995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:08.534011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601867339791573:5995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:08.534015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601867339791573:5995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:08.534024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:08.545112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:08.547981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:08.548213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:08.548224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:08.548236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:08.548308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:08.548352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601866557562458:4991]
2025-10-10T14:36:08.548996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:08.549341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:08.549416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:08.549788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:08.549852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.549859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.549860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.549862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.549863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.549864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.549866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.549867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.549868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.549869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.549871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.549872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.549873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.549881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.549896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.549900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.549904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.549909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.549913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.549917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.549921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.549925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.549930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.549934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.549938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.549942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.549951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.549970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.549984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.549995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.549999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.550005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.550009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.550015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.550025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.550031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.550040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.550047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.550056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.550062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.550066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.550076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.550082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.550088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.550093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.550098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.550104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.550109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.550114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.550120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.550124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.550134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.550176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:08.552615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:08.553140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:08.553155Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:08.553158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:08.553162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:08.553169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1914 [2:7559601866557562458:4991]
2025-10-10T14:36:08.553185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:08.553204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:08.553208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.553212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.553214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.553232Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:08.553245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:08.553254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:08.553878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1914
2025-10-10T14:36:08.553926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1914
2025-10-10T14:36:08.554490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1915 partition: 0 MaxSeqNo: 40 sessionId: src_id|310d9675-36797790-b722dd63-28cb845b_0
2025-10-10T14:36:08.554896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|131c00df-f0c60cfa-2efe1d94-2b8d0981_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|310d9675-36797790-b722dd63-28cb845b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:08.553320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.553326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.553348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.553351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:08.553422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:08.553424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.553436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.553447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.553465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:08.553487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601866557562453:4991]
2025-10-10T14:36:08.553489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601866557562453:4991]
2025-10-10T14:36:08.553491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601866557562453:4991]
2025-10-10T14:36:08.553505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:08.553515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:08.553517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:08.553519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:08.553523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791666:5995], now have 1 active actors on pipe
2025-10-10T14:36:08.553527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791558:2438], now have 1 active actors on pipe
2025-10-10T14:36:08.553535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:08.553551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:08.553554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:08.553586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601866557562453:4991]
2025-10-10T14:36:08.553594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:08.553649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:08.554017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.554025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.554059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|310d9675-36797790-b722dd63-28cb845b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:08.554070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.554075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.554078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:08.554091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.554105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:08.554122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.554358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.554363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.554395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.557675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310d9675-36797790-b722dd63-28cb845b_0] Write session: try to update token
2025-10-10T14:36:08.557692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310d9675-36797790-b722dd63-28cb845b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:08.566860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:08.566882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.566893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601866557562453:4991]
2025-10-10T14:36:08.566950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:08.566963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:08.567158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:08.567295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.567421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.567550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.567726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:08.567763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:08.573351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId: src_id|310d9675-36797790-b722dd63-28cb845b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:08.575972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:08.576533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.576558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.576603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:08.576726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:08.585795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:08.585817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.585820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:08.585822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:08.585831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601866557562453:4991]
2025-10-10T14:36:08.585835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601866557562453:4991]
2025-10-10T14:36:08.585839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601866557562453:4991]
2025-10-10T14:36:08.585890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:08.585893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:08.585900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:08.585900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.585902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:08.585904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:08.586035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:08.619751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601867339791824:6092]
2025-10-10T14:36:08.620060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1914, pipe: [1:7559601867339791824:6092]
2025-10-10T14:36:08.701606Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:08.710918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.710952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.711138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.711210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.711280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.711349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.711654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.711668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.711739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.711803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.711865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.711933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.711975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.711982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.712048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.712108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.712171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.712245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.712291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.712299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.712363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.712427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.712489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.712554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.712596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.712605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.712669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.712728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.712788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.712849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.712893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.712901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.712967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.713025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.713087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.713167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.713209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.713216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.713280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.713377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.713443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.713504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.713547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.713555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.713619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.713681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.713745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.714963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601867339791824:6092]
2025-10-10T14:36:08.715012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:08.715015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:08.715050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1915 reason: error at write: Disconnected sessionId: src_id|310d9675-36797790-b722dd63-28cb845b_0
2025-10-10T14:36:08.715264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1915 sessionId: src_id|310d9675-36797790-b722dd63-28cb845b_0 is DEAD
2025-10-10T14:36:08.715302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:08.715406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310d9675-36797790-b722dd63-28cb845b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:08.715418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310d9675-36797790-b722dd63-28cb845b_0] Write session will restart in 0.009612s
2025-10-10T14:36:08.715445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310d9675-36797790-b722dd63-28cb845b_0] Write session: Do CDS request
2025-10-10T14:36:08.715451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310d9675-36797790-b722dd63-28cb845b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:08.713809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.713859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.713862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.713930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.713991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.714052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.714116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.714157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.714160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.714228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.714290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.714352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.714413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.714454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.714457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.714527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791824:6092], now have 1 active actors on pipe
2025-10-10T14:36:08.715428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:08.725892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|310d9675-36797790-b722dd63-28cb845b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.726257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:08.726276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1916
2025-10-10T14:36:08.726380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.726417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:08.726435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:08.726439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:08.727473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1916 sessionId:  describe result for acl check
2025-10-10T14:36:08.727522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:08.727529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:08.727532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:08.727539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601867339791872:5976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:08.728155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601867339791872:5976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:08.731278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601867339791872:5976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:08.735763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601867339791872:5976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:08.735778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601867339791872:5976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:08.735782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601867339791872:5976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:08.735790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:08.744847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:08.747717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:08.747963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:08.747968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:08.747979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:08.748033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:08.748074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601866557562748:4976]
2025-10-10T14:36:08.748751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:08.749091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:08.749176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:08.749575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:08.749646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.749652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.749653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.749654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.749655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.749657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.749658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.749659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.749660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.749661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.749663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.749664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.749665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.749671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.749685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.749689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.749693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.749702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.749706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.749715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.749719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.749727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.749733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.749737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.749746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.749750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.749761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.749774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.749781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.749786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.749791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.749796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.749802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.749807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.749812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.749817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.749823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.749833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.749837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.749842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.749846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.749852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.749856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.749861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.749865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.749871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.749882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.749887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.749891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.749900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.749905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.749914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.749955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:08.752495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:08.753305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:08.753322Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:08.753324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:08.753363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:08.753370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1915 [2:7559601866557562748:4976]
2025-10-10T14:36:08.753387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:08.753415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:08.753418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.753422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.753424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.753441Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:08.753449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:08.753457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:08.753525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.753532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.753534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.753537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:08.753606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:08.753613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.753626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.753643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.753667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:08.753801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1915
2025-10-10T14:36:08.753848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1915
2025-10-10T14:36:08.753696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791845:2438], now have 1 active actors on pipe
2025-10-10T14:36:08.753704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339791987:5976], now have 1 active actors on pipe
2025-10-10T14:36:08.753712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601866557562743:4976]
2025-10-10T14:36:08.753715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601866557562743:4976]
2025-10-10T14:36:08.753717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601866557562743:4976]
2025-10-10T14:36:08.753729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:08.753743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:08.753759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:08.753762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:08.753797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601866557562743:4976]
2025-10-10T14:36:08.753799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:08.753841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:08.753844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:08.753846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:08.753854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:08.754478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1916 partition: 0 MaxSeqNo: 40 sessionId: src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0
2025-10-10T14:36:08.754853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|310d9675-36797790-b722dd63-28cb845b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:08.754008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.754020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.754052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:08.754061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.754065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.754068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:08.754082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.754093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:08.754107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.754326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.754329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.754344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.757631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0] Write session: try to update token
2025-10-10T14:36:08.757649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:08.768370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:08.768393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.768406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601866557562743:4976]
2025-10-10T14:36:08.768458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:08.768461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:08.768652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:08.768844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.768993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.769152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.772332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId: src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:08.769381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:08.769430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:08.775322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:08.775575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.775608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.775661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:08.775791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:08.787507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:08.787539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.787543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:08.787545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:08.787556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601866557562743:4976]
2025-10-10T14:36:08.787561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601866557562743:4976]
2025-10-10T14:36:08.787565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601866557562743:4976]
2025-10-10T14:36:08.787610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:08.787615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:08.787617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:08.787621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:08.787624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.787626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:08.787770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:08.814775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601867339792103:6092]
2025-10-10T14:36:08.815107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1915, pipe: [1:7559601867339792103:6092]
2025-10-10T14:36:08.904643Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:08.913305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.913353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.913548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.913620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.913687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.913751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.913797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.913810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.913885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.913948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.914019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.914086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.914134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.914142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.914211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.914273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.914337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.914409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.914451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.914454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.917079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:08.917164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:08.914522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.914585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.914649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.914709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.914749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.914752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.914818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.914876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.914941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.915008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.915048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.915050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.915117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.915181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.915241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.915305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.915351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.915356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.915427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.915490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.915555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.915615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.915661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.915664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.915733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.915797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.915860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.915923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.915964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.915967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.916039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.916101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.916164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.916227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.916268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.916271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.916339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:08.916398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:08.916466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:08.916534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:08.916573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:08.916576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:08.916652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339792103:6092], now have 1 active actors on pipe
2025-10-10T14:36:08.917167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:08.917201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1916 reason: error at write: Disconnected sessionId: src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0
2025-10-10T14:36:08.917434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1916 sessionId: src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0 is DEAD
2025-10-10T14:36:08.917572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601867339792103:6092]
2025-10-10T14:36:08.917806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:08.921564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:08.921578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0] Write session will restart in 0.007063s
2025-10-10T14:36:08.921604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0] Write session: Do CDS request
2025-10-10T14:36:08.921609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:08.933889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.934025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:08.934041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1917
2025-10-10T14:36:08.934186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:08.934229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:08.934239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:08.934246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:08.934761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1917 sessionId:  describe result for acl check
2025-10-10T14:36:08.934802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:08.934808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:08.934810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:08.934816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601867339792218:5966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:08.935408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601867339792218:5966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:08.938490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601867339792218:5966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:08.941604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601867339792218:5966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:08.941619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601867339792218:5966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:08.941622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601867339792218:5966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:08.941631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:08.941928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:08.944783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:08.945035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:08.945054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:08.945067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:08.945136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:08.945181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601866557563014:4969]
2025-10-10T14:36:08.945836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:08.946146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:08.946191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:08.946460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:08.946505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.946510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.946512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.946513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.946515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.946516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.946517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.946519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.946520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.946521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.946522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.946524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.946525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.946532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.946545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.946548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.946553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.946557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.946561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.946565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.946569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.946573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.946577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.946581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.946585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.946589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.946596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.946606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:08.946612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.946626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:08.946631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.946649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:08.946653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.946659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:08.946663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.946668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:08.946673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.946678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:08.946682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.946688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:08.946692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.946698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:08.946703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.946708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:08.946714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.946724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:08.946730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.946736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.946741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.946746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.946750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.946755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.946792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:08.949276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:08.949740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:08.949752Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:08.949755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:08.949759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:08.949766Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1916 [2:7559601866557563014:4969]
2025-10-10T14:36:08.949777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:08.949794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:08.949802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.949805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.949807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.949826Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:08.949840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:08.949848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:08.949909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.949917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.949919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.949921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:08.949987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:08.949995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.950006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:08.950022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:08.950039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:08.950079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339792360:5966], now have 1 active actors on pipe
2025-10-10T14:36:08.950088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601867339792117:2438], now have 1 active actors on pipe
2025-10-10T14:36:08.950095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601866557563009:4969]
2025-10-10T14:36:08.950102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601866557563009:4969]
2025-10-10T14:36:08.950104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601866557563009:4969]
2025-10-10T14:36:08.950119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:08.950137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:08.950152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:08.950156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:08.950156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:08.950159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:08.950159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:08.950187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601866557563009:4969]
2025-10-10T14:36:08.950196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:08.950209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:08.950237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1916
2025-10-10T14:36:08.950268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1916
2025-10-10T14:36:08.950389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.950412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.950451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:08.950461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:08.950466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:08.950469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:08.950483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:08.950497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:08.950516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.951015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.951021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.951039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:08.951985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a635767-5deaa921-cbc56b7e-f5d7537e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:08.955419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0] Write session: try to update token
2025-10-10T14:36:08.955446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:08.951500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1917 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0
2025-10-10T14:36:08.962650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:08.962670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.962682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601866557563009:4969]
2025-10-10T14:36:08.962737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:08.962737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:08.962916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:08.963060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.963201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.963353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:08.963560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:08.963657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:08.977092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId: src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:08.979918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:08.981554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:08.981584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:08.981610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:08.981614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:08.981618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:08.981621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:08.981631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601866557563009:4969]
2025-10-10T14:36:08.981635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601866557563009:4969]
2025-10-10T14:36:08.981639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601866557563009:4969]
2025-10-10T14:36:08.981690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:08.981705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:08.981709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:08.981710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:08.981717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:08.981720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:08.981853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:09.013422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601871634759669:6092]
2025-10-10T14:36:09.013729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1916, pipe: [1:7559601871634759669:6092]
2025-10-10T14:36:09.103208Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:09.103818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:09.103863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634759669:6092], now have 1 active actors on pipe
2025-10-10T14:36:09.103954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:09.104062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:09.104071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:09.104157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1917 reason: error at write: Disconnected sessionId: src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0
2025-10-10T14:36:09.104216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:09.104281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601871634759669:6092]
2025-10-10T14:36:09.104324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1917 sessionId: src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0 is DEAD
2025-10-10T14:36:09.104514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:09.104527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0] Write session will restart in 0.007146s
2025-10-10T14:36:09.104565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0] Write session: Do CDS request
2025-10-10T14:36:09.104573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:09.112968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.113025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:09.113041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1918
2025-10-10T14:36:09.113270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.113318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:09.113345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:09.113349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:09.113898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1918 sessionId:  describe result for acl check
2025-10-10T14:36:09.113936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:09.113940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:09.113942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:09.113950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601871634759704:5963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:09.114570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601871634759704:5963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:09.119622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601871634759704:5963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:09.123472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601871634759704:5963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:09.123490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601871634759704:5963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:09.123493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601871634759704:5963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:09.123504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:09.126404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:09.129045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:09.129313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:09.129323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:09.129354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:09.129410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:09.129462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601870852530563:4955]
2025-10-10T14:36:09.130157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:09.130469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:09.130507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:09.130844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:09.130898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.130904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.130906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.130907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.130909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.130910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.130911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.130912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.130914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.130915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.130916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.130918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.130919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.130925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.130939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.130943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.130947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.130951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.130956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.130960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.130964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.130968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.130973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.130977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.130981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.130985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.130993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.131003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.131010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.131016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.131021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.131026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.131031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.131038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.131048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.131054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.131063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.131069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.131074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.131079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.131089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.131095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.131104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.131110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.131114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.131125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.131130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.131141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.131145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.131150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.131155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.131161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.131203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:09.133778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:09.134108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:09.134125Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:09.134127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:09.134131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:09.134137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1917 [2:7559601870852530563:4955]
2025-10-10T14:36:09.134148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:09.134166Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:09.134169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.134173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.134176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.134193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:09.134206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:09.134214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:09.134273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.134280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.134283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.134286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:09.134354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:09.134361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.134372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.134389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.134410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:09.134439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634759895:5963], now have 1 active actors on pipe
2025-10-10T14:36:09.134442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634759671:2438], now have 1 active actors on pipe
2025-10-10T14:36:09.134452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601870852530558:4955]
2025-10-10T14:36:09.134454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601870852530558:4955]
2025-10-10T14:36:09.134457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601870852530558:4955]
2025-10-10T14:36:09.134472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:09.134489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:09.134491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:09.134500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:09.134503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:09.134506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:09.134510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:09.134492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1917
2025-10-10T14:36:09.134516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1917
2025-10-10T14:36:09.134535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601870852530558:4955]
2025-10-10T14:36:09.134544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:09.134546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:09.134560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.134564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.134614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f93141e9-a58c4055-cc749ec5-2abc213_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:09.134627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.134630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.134637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:09.134649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.134663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:09.134684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.134889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.134895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.134910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.135003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1918 partition: 0 MaxSeqNo: 40 sessionId: src_id|f93141e9-a58c4055-cc749ec5-2abc213_0
2025-10-10T14:36:09.135375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac90d255-e7a4aa82-12a7f0fb-144551c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f93141e9-a58c4055-cc749ec5-2abc213_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:09.138048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93141e9-a58c4055-cc749ec5-2abc213_0] Write session: try to update token
2025-10-10T14:36:09.138068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93141e9-a58c4055-cc749ec5-2abc213_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:09.154696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:09.154720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:09.154723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:09.154725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:09.154736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601870852530558:4955]
2025-10-10T14:36:09.154740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601870852530558:4955]
2025-10-10T14:36:09.154744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601870852530558:4955]
2025-10-10T14:36:09.154793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:09.154796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:09.154801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:09.154804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.154806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:09.154806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:09.154952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:09.163724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId: src_id|f93141e9-a58c4055-cc749ec5-2abc213_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:09.166499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:09.204468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601871634759928:6092]
2025-10-10T14:36:09.204835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1917, pipe: [1:7559601871634759928:6092]
2025-10-10T14:36:09.273064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:09.274000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.274022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.274048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634759928:6092], now have 1 active actors on pipe
2025-10-10T14:36:09.274984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93141e9-a58c4055-cc749ec5-2abc213_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:09.274997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93141e9-a58c4055-cc749ec5-2abc213_0] Write session will restart in 0.009866s
2025-10-10T14:36:09.274441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:09.275033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93141e9-a58c4055-cc749ec5-2abc213_0] Write session: Do CDS request
2025-10-10T14:36:09.275040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93141e9-a58c4055-cc749ec5-2abc213_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:09.274417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601871634759928:6092]
2025-10-10T14:36:09.274449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:09.274504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:09.274510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:09.274595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1918 reason: error at write: Disconnected sessionId: src_id|f93141e9-a58c4055-cc749ec5-2abc213_0
2025-10-10T14:36:09.274801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1918 sessionId: src_id|f93141e9-a58c4055-cc749ec5-2abc213_0 is DEAD
2025-10-10T14:36:09.285887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f93141e9-a58c4055-cc749ec5-2abc213_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.286034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:09.286049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1919
2025-10-10T14:36:09.286229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.286275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:09.286287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:09.286291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:09.286707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1919 sessionId:  describe result for acl check
2025-10-10T14:36:09.286737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:09.286739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:09.286741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:09.286747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601871634759988:5959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:09.287347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601871634759988:5959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:09.290342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601871634759988:5959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:09.302324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601871634759988:5959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:09.302345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601871634759988:5959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:09.302349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601871634759988:5959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:09.302359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:09.306319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:09.312255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:09.312584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:09.312599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:09.312614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:09.312686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:09.312722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601870852530818:4965]
2025-10-10T14:36:09.313165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:09.313496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:09.313531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:09.313775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:09.313822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.313827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.313829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.313830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.313831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.313832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.313833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.313834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.313835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.313836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.313838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.313838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.313839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.313843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.313853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.313855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.313858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.313861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.313863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.313866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.313868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.313870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.313873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.313875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.313878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.313881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.313887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.313893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.313898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.313901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.313905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.313908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.313911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.313914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.313918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.313921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.313924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.313927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.313930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.313934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.313937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.313941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.313944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.313947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.313951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.313955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.313958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.313961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.313964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.313967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.313970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.313973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.313999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:09.319630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:09.320089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:09.320100Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:09.320102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:09.320106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:09.320112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1918 [2:7559601870852530818:4965]
2025-10-10T14:36:09.320123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:09.320141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:09.320143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.320146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.320148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.320162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:09.320169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:09.320176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:09.320235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.320244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.320245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.320247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:09.320306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:09.320313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.320321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.320328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.320339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:09.320361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601870852530813:4965]
2025-10-10T14:36:09.320367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601870852530813:4965]
2025-10-10T14:36:09.320368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601870852530813:4965]
2025-10-10T14:36:09.320378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:09.320390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:09.320400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:09.320406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:09.320438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601870852530813:4965]
2025-10-10T14:36:09.320446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:09.320924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:09.320932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:09.320934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:09.320939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:09.321468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1918
2025-10-10T14:36:09.321509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1918
2025-10-10T14:36:09.321207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760172:5959], now have 1 active actors on pipe
2025-10-10T14:36:09.321217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634759929:2438], now have 1 active actors on pipe
2025-10-10T14:36:09.321556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.321563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.321599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:09.321608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.321613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.321624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:09.321648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.321664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:09.321689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.321870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.321892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.321912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.322015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1919 partition: 0 MaxSeqNo: 40 sessionId: src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0
2025-10-10T14:36:09.322460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f93141e9-a58c4055-cc749ec5-2abc213_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:09.325231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0] Write session: try to update token
2025-10-10T14:36:09.325250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:09.341936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId: src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:09.344550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:09.346069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.346100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.346125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:09.346130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:09.346134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:09.346136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:09.346147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601870852530813:4965]
2025-10-10T14:36:09.346159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601870852530813:4965]
2025-10-10T14:36:09.346163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601870852530813:4965]
2025-10-10T14:36:09.346224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:09.346228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:09.346237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.346240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:09.346240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:09.346245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:09.346378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:09.374413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601871634760188:6092]
2025-10-10T14:36:09.374955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1918, pipe: [1:7559601871634760188:6092]
2025-10-10T14:36:09.468529Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:09.469026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:09.469132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760188:6092], now have 1 active actors on pipe
2025-10-10T14:36:09.469210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:09.469407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601871634760188:6092]
2025-10-10T14:36:09.469433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:09.480956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:09.480970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:09.480999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1919 reason: error at write: Disconnected sessionId: src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0
2025-10-10T14:36:09.481164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1919 sessionId: src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0 is DEAD
2025-10-10T14:36:09.481327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:09.481357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0] Write session will restart in 0.007304s
2025-10-10T14:36:09.481381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0] Write session: Do CDS request
2025-10-10T14:36:09.481397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:09.489974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.490039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:09.490057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1920
2025-10-10T14:36:09.490264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.490324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:09.490331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:09.490335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:09.490880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1920 sessionId:  describe result for acl check
2025-10-10T14:36:09.490916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:09.490917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:09.490919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:09.490926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601871634760301:5954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:09.491536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601871634760301:5954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:09.494918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601871634760301:5954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:09.497066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:09.499833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:09.500055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:09.500069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:09.500081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:09.500102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601871634760301:5954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:09.500135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:09.500117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601871634760301:5954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:09.500121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601871634760301:5954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:09.500132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:09.500180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601870852531072:4964]
2025-10-10T14:36:09.500816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:09.501180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:09.501238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:09.501586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:09.501648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.501656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.501657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.501659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.501660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.501661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.501662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.501664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.501665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.501666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.501668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.501669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.501670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.501677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.501691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.501696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.501701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.501706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.501710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.501715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.501719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.501723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.501728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.501732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.501736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.501740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.501748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.501758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.501766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.501773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.501777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.501783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.501787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.501794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.501799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.501805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.501810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.501816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.501821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.501827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.501832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.501838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.501848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.501853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.501858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.501864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.501869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.501876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.501880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.501886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.501896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.501902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.501951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:09.504518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:09.504844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:09.504859Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:09.504863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:09.504867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:09.504873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1919 [2:7559601870852531072:4964]
2025-10-10T14:36:09.504889Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:09.504907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:09.504915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.504919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.504922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.504939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:09.504953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:09.504966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:09.505023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.505030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.505032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.505035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:09.505113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:09.505122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.505152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.505233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1919
2025-10-10T14:36:09.505168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.505190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:09.505213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760190:2438], now have 1 active actors on pipe
2025-10-10T14:36:09.505266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1919
2025-10-10T14:36:09.505217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760438:5954], now have 1 active actors on pipe
2025-10-10T14:36:09.505225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601870852531067:4964]
2025-10-10T14:36:09.505227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601870852531067:4964]
2025-10-10T14:36:09.505229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601870852531067:4964]
2025-10-10T14:36:09.505245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:09.505261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:09.505262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:09.505266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:09.505267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:09.505286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:09.505289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:09.505356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.505362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.505378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601870852531067:4964]
2025-10-10T14:36:09.505394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:09.505418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:09.505432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:09.505440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.505449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.505452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:09.505464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.505480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:09.505510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.505708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.505724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.505749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.505848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1920 partition: 0 MaxSeqNo: 40 sessionId: src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0
2025-10-10T14:36:09.506269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d9a8a-844c96cf-b52b0628-4f4c38d3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:09.508855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0] Write session: try to update token
2025-10-10T14:36:09.508875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:09.522852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId: src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:09.525231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:09.525255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:09.525259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:09.525261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:09.525272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601870852531067:4964]
2025-10-10T14:36:09.525277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601870852531067:4964]
2025-10-10T14:36:09.525281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601870852531067:4964]
2025-10-10T14:36:09.525349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:09.525352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:09.525361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.525364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:09.525366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:09.525371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:09.525502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:09.525635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:09.569508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601871634760449:6092]
2025-10-10T14:36:09.569812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1919, pipe: [1:7559601871634760449:6092]
2025-10-10T14:36:09.643919Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:09.644464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.644481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.644525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760449:6092], now have 1 active actors on pipe
2025-10-10T14:36:09.644781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:09.644792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:09.644822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:09.645226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:09.645235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0] Write session will restart in 0.008707s
2025-10-10T14:36:09.645262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0] Write session: Do CDS request
2025-10-10T14:36:09.645268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:09.644845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1920 reason: error at write: Disconnected sessionId: src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0
2025-10-10T14:36:09.645039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1920 sessionId: src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0 is DEAD
2025-10-10T14:36:09.645188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601871634760449:6092]
2025-10-10T14:36:09.645202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:09.656474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.656615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:09.656630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1921
2025-10-10T14:36:09.656764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.656796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:09.656807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:09.656820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:09.657426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1921 sessionId:  describe result for acl check
2025-10-10T14:36:09.657464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:09.657470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:09.657472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:09.657478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601871634760491:5936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:09.658049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601871634760491:5936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:09.663147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601871634760491:5936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:09.668029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601871634760491:5936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:09.668045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601871634760491:5936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:09.668049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601871634760491:5936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:09.668069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:09.673855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:09.676652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:09.677000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:09.677012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:09.677027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:09.677112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:09.677161Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601870852531341:4951]
2025-10-10T14:36:09.677836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:09.678130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:09.678176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:09.678513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:09.678577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.678583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.678585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.678586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.678587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.678589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.678590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.678591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.678592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.678594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.678595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.678597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.678598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.678604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.678616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.678621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.678624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.678628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.678632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.678636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.678640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.678644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.678648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.678652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.678656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.678660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.678668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.678676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.678683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.678690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.678694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.678699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.678703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.678709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.678714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.678720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.678726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.678731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.678737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.678742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.678747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.678754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.678759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.678765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.678770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.678776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.678781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.678787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.678791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.678796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.678806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.678821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.678869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:09.682982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:09.683671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:09.683687Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:09.683690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:09.683693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:09.683699Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1920 [2:7559601870852531341:4951]
2025-10-10T14:36:09.683711Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:09.683729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:09.683733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.683736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.683738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.683755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:09.683770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:09.683778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:09.683832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.683839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.683840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.683843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:09.683906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:09.683913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.683924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.683939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.683954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:09.683979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601870852531336:4951]
2025-10-10T14:36:09.683989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601870852531336:4951]
2025-10-10T14:36:09.683991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601870852531336:4951]
2025-10-10T14:36:09.684001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:09.684010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:09.684013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:09.684014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:09.684015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:09.684028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:09.684031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:09.684042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760465:2438], now have 1 active actors on pipe
2025-10-10T14:36:09.684045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760647:5936], now have 1 active actors on pipe
2025-10-10T14:36:09.684074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601870852531336:4951]
2025-10-10T14:36:09.684082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:09.684101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:09.684102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1920
2025-10-10T14:36:09.684142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1920
2025-10-10T14:36:09.686094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.686111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.686153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72de895c-b13b3d97-b6699624-8385a1af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:09.686165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.686171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.686173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:09.686187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.686204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:09.686218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.686667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.686671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.686688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.686826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1921 partition: 0 MaxSeqNo: 40 sessionId: src_id|72de895c-b13b3d97-b6699624-8385a1af_0
2025-10-10T14:36:09.687694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|633ee67e-9c50135e-c5c7b12d-e9a010ce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72de895c-b13b3d97-b6699624-8385a1af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:09.690617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72de895c-b13b3d97-b6699624-8385a1af_0] Write session: try to update token
2025-10-10T14:36:09.690640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72de895c-b13b3d97-b6699624-8385a1af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:09.707681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:09.707708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:09.707712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:09.707714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:09.707724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601870852531336:4951]
2025-10-10T14:36:09.707729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601870852531336:4951]
2025-10-10T14:36:09.707733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601870852531336:4951]
2025-10-10T14:36:09.707784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:09.707793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.707795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:09.707796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:09.707806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:09.707810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:09.707936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:09.709717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId: src_id|72de895c-b13b3d97-b6699624-8385a1af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:09.712177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:09.745082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601871634760742:6092]
2025-10-10T14:36:09.745322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1920, pipe: [1:7559601871634760742:6092]
2025-10-10T14:36:09.827183Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:09.827574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.827587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.827647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760742:6092], now have 1 active actors on pipe
2025-10-10T14:36:09.827864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:09.828312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601871634760742:6092]
2025-10-10T14:36:09.828354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:09.828433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1921 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72de895c-b13b3d97-b6699624-8385a1af_0
2025-10-10T14:36:09.828631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1921 sessionId: src_id|72de895c-b13b3d97-b6699624-8385a1af_0 is DEAD
2025-10-10T14:36:09.828801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:09.829107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de895c-b13b3d97-b6699624-8385a1af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:09.829120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de895c-b13b3d97-b6699624-8385a1af_0] Write session will restart in 0.005092s
2025-10-10T14:36:09.829146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de895c-b13b3d97-b6699624-8385a1af_0] Write session: Do CDS request
2025-10-10T14:36:09.829153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de895c-b13b3d97-b6699624-8385a1af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:09.835977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72de895c-b13b3d97-b6699624-8385a1af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.836067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:09.836086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1922
2025-10-10T14:36:09.836273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:09.836312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:09.836323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:09.836328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:09.836833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1922 sessionId:  describe result for acl check
2025-10-10T14:36:09.836882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:09.836889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:09.836891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:09.836897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601871634760761:5927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:09.837522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601871634760761:5927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:09.840037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601871634760761:5927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:09.844201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601871634760761:5927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:09.844215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601871634760761:5927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:09.844219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601871634760761:5927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:09.844228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:09.851300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:09.854076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:09.854332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:09.854346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:09.854360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:09.854433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:09.854493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601870852531622:4926]
2025-10-10T14:36:09.855131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:09.855447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:09.855492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:09.855816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:09.855884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.855891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.855892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.855893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.855895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.855896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.855897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.855899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.855901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.855902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.855903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.855904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.855906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.855912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.855925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.855930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.855934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.855939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.855943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.855947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.855951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.855954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.855958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.855961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.855965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.855968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.855977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.855986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:09.855992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.855998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:09.856002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.856008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:09.856012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.856018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:09.856023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.856028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:09.856032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.856037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:09.856042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.856048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:09.856051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.856056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:09.856061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.856066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:09.856070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.856074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:09.856078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.856083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.856087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.856092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.856097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.856102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.856147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:09.858640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:09.859069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:09.859083Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:09.859085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:09.859088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:09.859093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1921 [2:7559601870852531622:4926]
2025-10-10T14:36:09.859103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:09.859120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:09.859123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.859127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.859130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.859147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:09.859152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:09.859159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:09.859224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.859230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.859231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.859233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:09.859289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:09.859295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.859303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:09.859310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:09.859320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:09.859338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601870852531617:4926]
2025-10-10T14:36:09.859343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601870852531617:4926]
2025-10-10T14:36:09.859344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601870852531617:4926]
2025-10-10T14:36:09.859354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:09.859364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:09.859365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:09.859368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:09.859370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:09.859377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:09.859380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:09.859410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760747:2438], now have 1 active actors on pipe
2025-10-10T14:36:09.859419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634760871:5927], now have 1 active actors on pipe
2025-10-10T14:36:09.859422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601870852531617:4926]
2025-10-10T14:36:09.859429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:09.859475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1921
2025-10-10T14:36:09.859483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1921
2025-10-10T14:36:09.859456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:09.859884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.859895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.859922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:09.859934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:09.859943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:09.859947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:09.859959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:09.859975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:09.859996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.860193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.860203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.860222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:09.860350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1922 partition: 0 MaxSeqNo: 40 sessionId: src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0
2025-10-10T14:36:09.860782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72de895c-b13b3d97-b6699624-8385a1af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:09.863588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0] Write session: try to update token
2025-10-10T14:36:09.863611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:09.882552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:09.882576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:09.882580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:09.882582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:09.882592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601870852531617:4926]
2025-10-10T14:36:09.882598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601870852531617:4926]
2025-10-10T14:36:09.882602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601870852531617:4926]
2025-10-10T14:36:09.882655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:09.882663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:09.882666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:09.882814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:09.883070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:09.883077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:09.883082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:09.884295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId: src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:09.887101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:09.929079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601871634761020:6092]
2025-10-10T14:36:09.929451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1921, pipe: [1:7559601871634761020:6092]
2025-10-10T14:36:09.996178Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:09.996546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:09.996558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:09.996595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634761020:6092], now have 1 active actors on pipe
2025-10-10T14:36:09.996763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:09.996849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:09.996871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:09.996910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601871634761020:6092]
2025-10-10T14:36:09.996970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1922 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0
2025-10-10T14:36:09.997201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1922 sessionId: src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0 is DEAD
2025-10-10T14:36:09.997323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:09.997353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0] Write session will restart in 0.007895s
2025-10-10T14:36:09.997379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0] Write session: Do CDS request
2025-10-10T14:36:09.997385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:10.006987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.009541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:10.009559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1923
2025-10-10T14:36:10.012201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.012260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:10.012266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:10.012272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:10.012848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1923 sessionId:  describe result for acl check
2025-10-10T14:36:10.012887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:10.012890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:10.012892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:10.012899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601875929728447:5918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:10.013554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601875929728447:5918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:10.016875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601875929728447:5918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:10.020193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:10.019852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601875929728447:5918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:10.019868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601875929728447:5918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:10.019872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601875929728447:5918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:10.019881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:10.022974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:10.023221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:10.023234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:10.023255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:10.023311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:10.023354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601875147499193:4928]
2025-10-10T14:36:10.023925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:10.024232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:10.024279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:10.024606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:10.024678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.024687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.024688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.024689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.024690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.024692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.024693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.024694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.024696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.024697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.024698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.024699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.024701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.024706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.024719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.024723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.024725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.024727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.024731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.024735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.024739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.024742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.024745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.024750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.024753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.024757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.024766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.024774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.024780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.024786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.024790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.024795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.024799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.024804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.024809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.024813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.024817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.024822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.024827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.024832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.024836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.024841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.024846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.024851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.024855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.024860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.024865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.024870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.024874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.024879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.024884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.024889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.024929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:10.027443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:10.027789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:10.027802Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:10.027805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:10.027809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:10.027816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1922 [2:7559601875147499193:4928]
2025-10-10T14:36:10.027829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:10.027846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:10.027849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.027853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.027856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.027873Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:10.027882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:10.027891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:10.027958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.027966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.027968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.027970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:10.028035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:10.028043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.028055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.028071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.028093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:10.028119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929728572:5918], now have 1 active actors on pipe
2025-10-10T14:36:10.028127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601871634761027:2438], now have 1 active actors on pipe
2025-10-10T14:36:10.028136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601875147499187:4928]
2025-10-10T14:36:10.028144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601875147499187:4928]
2025-10-10T14:36:10.028146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601875147499187:4928]
2025-10-10T14:36:10.028158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:10.028173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:10.028177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:10.028181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:10.028183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:10.028194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:10.028197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:10.028182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1922
2025-10-10T14:36:10.028183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1922
2025-10-10T14:36:10.028220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601875147499187:4928]
2025-10-10T14:36:10.028229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:10.028233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:10.028262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.028272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.028313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1302081d-697acb27-2a5cb485-b7d387db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:10.028325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.028329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.028331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:10.028343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.028358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:10.028371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.028515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.028523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.028539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.028632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1923 partition: 0 MaxSeqNo: 40 sessionId: src_id|1302081d-697acb27-2a5cb485-b7d387db_0
2025-10-10T14:36:10.029069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeb3618-656c1c22-2bf86a5f-1a22e267_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1302081d-697acb27-2a5cb485-b7d387db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:10.031853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1302081d-697acb27-2a5cb485-b7d387db_0] Write session: try to update token
2025-10-10T14:36:10.031875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1302081d-697acb27-2a5cb485-b7d387db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:10.046785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId: src_id|1302081d-697acb27-2a5cb485-b7d387db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:10.048374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:10.048396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:10.048399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:10.048401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:10.048412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601875147499187:4928]
2025-10-10T14:36:10.048416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601875147499187:4928]
2025-10-10T14:36:10.048420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601875147499187:4928]
2025-10-10T14:36:10.048477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:10.048485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.048488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:10.048631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:10.048761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:10.048776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:10.048781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:10.049673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:10.097391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601875929728585:6092]
2025-10-10T14:36:10.097711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1922, pipe: [1:7559601875929728585:6092]
2025-10-10T14:36:10.165382Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:10.166123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.166143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.166192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929728585:6092], now have 1 active actors on pipe
2025-10-10T14:36:10.166589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:10.166603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:10.166677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1923 reason: error at write: Disconnected sessionId: src_id|1302081d-697acb27-2a5cb485-b7d387db_0
2025-10-10T14:36:10.166683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:10.166913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1923 sessionId: src_id|1302081d-697acb27-2a5cb485-b7d387db_0 is DEAD
2025-10-10T14:36:10.166924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:10.166964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601875929728585:6092]
2025-10-10T14:36:10.169852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1302081d-697acb27-2a5cb485-b7d387db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:10.169866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1302081d-697acb27-2a5cb485-b7d387db_0] Write session will restart in 0.008454s
2025-10-10T14:36:10.169895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1302081d-697acb27-2a5cb485-b7d387db_0] Write session: Do CDS request
2025-10-10T14:36:10.169903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1302081d-697acb27-2a5cb485-b7d387db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:10.179929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1302081d-697acb27-2a5cb485-b7d387db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.180023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:10.180039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1924
2025-10-10T14:36:10.180175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.180206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:10.180212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:10.180217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:10.180757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1924 sessionId:  describe result for acl check
2025-10-10T14:36:10.180788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:10.180790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:10.180792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:10.180799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601875929728603:5915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:10.181461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601875929728603:5915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:10.184263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601875929728603:5915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:10.188700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601875929728603:5915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:10.188717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601875929728603:5915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:10.188721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601875929728603:5915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:10.188731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:10.194670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:10.200686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:10.200977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:10.200994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:10.201008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:10.201108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:10.201162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601875147499452:4918]
2025-10-10T14:36:10.201735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:10.202133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:10.202195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:10.202517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:10.202571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.202572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.202573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.202574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.202575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.202577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.202578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.202579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.202580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.202582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.202583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.202584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.202586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.202592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.202607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.202612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.202616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.202620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.202624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.202629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.202633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.202637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.202641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.202645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.202649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.202653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.202663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.202671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.202678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.202684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.202688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.202694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.202699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.202705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.202710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.202715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.202719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.202725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.202730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.202735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.202741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.202747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.202752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.202757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.202762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.202767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.202772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.202777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.202781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.202787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.202791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.202796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.202839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:10.205413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:10.206118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:10.206132Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:10.206134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:10.206138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:10.206144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1923 [2:7559601875147499452:4918]
2025-10-10T14:36:10.206157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:10.206177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:10.206180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.206184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.206186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.206206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:10.206220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:10.206233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:10.206302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.206312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.206314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.206317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:10.206383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:10.206392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.206404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.206417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.206540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1923
2025-10-10T14:36:10.206437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:10.206583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1923
2025-10-10T14:36:10.206461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929728734:5915], now have 1 active actors on pipe
2025-10-10T14:36:10.206464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929728587:2438], now have 1 active actors on pipe
2025-10-10T14:36:10.206473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601875147499447:4918]
2025-10-10T14:36:10.206475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601875147499447:4918]
2025-10-10T14:36:10.206477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601875147499447:4918]
2025-10-10T14:36:10.206491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:10.206505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:10.206506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:10.206509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:10.206511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:10.206522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:10.206526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:10.206556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601875147499447:4918]
2025-10-10T14:36:10.206564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:10.206568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:10.206905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.206916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.206953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:10.206966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.206975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.206977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:10.206991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.207007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:10.207028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.207209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.207217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.207233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.207325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1924 partition: 0 MaxSeqNo: 40 sessionId: src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0
2025-10-10T14:36:10.207741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1302081d-697acb27-2a5cb485-b7d387db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:10.210603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0] Write session: try to update token
2025-10-10T14:36:10.210621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:10.227338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:10.227372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:10.227387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601875147499447:4918]
2025-10-10T14:36:10.227454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:10.228763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId: src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:10.231434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:10.232656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:10.232914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:10.233099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:10.233253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:10.233439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:10.233643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:10.233729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.233739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.233761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:10.233803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:10.233948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:10.242769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:10.242794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:10.242797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:10.242799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:10.242810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601875147499447:4918]
2025-10-10T14:36:10.242815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601875147499447:4918]
2025-10-10T14:36:10.242818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601875147499447:4918]
2025-10-10T14:36:10.242863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:10.242871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.242873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:10.242875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:10.242882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:10.242888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:10.243009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:10.267357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601875929728850:6092]
2025-10-10T14:36:10.267645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1923, pipe: [1:7559601875929728850:6092]
2025-10-10T14:36:10.362723Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:10.372150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.372191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.372412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.372476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.372541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.372607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.372940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.372953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.373019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.373102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.373167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.373504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.373553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.373561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.373635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.373700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.373757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.373820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.373869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.373876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.373946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.374011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.374073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.374139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.374183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.374195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.374262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.374327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.374389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.374464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.374527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.374536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.374616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.374684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.374754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.374819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.374869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.374872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.374944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.375005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.375071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.375134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.375191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.375193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.375253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.375308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.375366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.375421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.375463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.375466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.375533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.375582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.375635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.375691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.375825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.375827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.375884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:10.375933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:10.375982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:10.376033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:10.376069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:10.376083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:10.376148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929728850:6092], now have 1 active actors on pipe
2025-10-10T14:36:10.376421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601875929728850:6092]
2025-10-10T14:36:10.376468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:10.376471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:10.376517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1924 reason: error at write: Disconnected sessionId: src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0
2025-10-10T14:36:10.376532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:10.376850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:10.376862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0] Write session will restart in 0.009404s
2025-10-10T14:36:10.376898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0] Write session: Do CDS request
2025-10-10T14:36:10.376905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:10.376721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1924 sessionId: src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0 is DEAD
2025-10-10T14:36:10.376810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:10.387943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.387989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:10.388012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1925
2025-10-10T14:36:10.388213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.388262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:10.388274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:10.388278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:10.388846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1925 sessionId:  describe result for acl check
2025-10-10T14:36:10.388887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:10.388894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:10.388896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:10.388902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601875929728939:5912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:10.389554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601875929728939:5912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:10.393234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601875929728939:5912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:10.397217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:10.400925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601875929728939:5912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:10.400940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601875929728939:5912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:10.400944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601875929728939:5912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:10.400954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:10.400768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:10.400947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:10.400951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:10.400959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:10.400997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:10.401023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601875147499711:4919]
2025-10-10T14:36:10.401440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:10.401719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:10.401749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:10.401966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:10.402000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.402001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.402002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.402002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.402003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.402004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.402005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.402006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.402007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.402008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.402008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.402009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.402010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.402014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.402023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.402025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.402028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.402031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.402033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.402035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.402038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.402040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.402043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.402045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.402047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.402050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.402057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.402062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.402066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.402070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.402075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.402078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.402081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.402084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.402086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.402089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.402092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.402096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.402099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.402102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.402104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.402107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.402110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.402113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.402116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.402119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.402122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.402125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.402128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.402131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.402134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.402138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.402160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:10.404642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:10.405590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:10.405603Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:10.405606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:10.405609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:10.405616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1924 [2:7559601875147499711:4919]
2025-10-10T14:36:10.405629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:10.405648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:10.405652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.405655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.405657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.405675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:10.405683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:10.405692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:10.405755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.405757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.405759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.405762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:10.405828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:10.405832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.405845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.405859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.405878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:10.405902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601875147499706:4919]
2025-10-10T14:36:10.405905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601875147499706:4919]
2025-10-10T14:36:10.405907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601875147499706:4919]
2025-10-10T14:36:10.405923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:10.405939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:10.405958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:10.405961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:10.405990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601875147499706:4919]
2025-10-10T14:36:10.405992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:10.406201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:10.406208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:10.406212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:10.406219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:10.406692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729104:5912], now have 1 active actors on pipe
2025-10-10T14:36:10.406703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929728853:2438], now have 1 active actors on pipe
2025-10-10T14:36:10.409523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1924
2025-10-10T14:36:10.409528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1924
2025-10-10T14:36:10.409770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.409788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.409832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a59309c-39993643-42417b12-78c50b17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:10.409844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.409851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.409854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:10.409871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.409891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:10.409919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.411852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.411871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.411903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.412036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1925 partition: 0 MaxSeqNo: 40 sessionId: src_id|4a59309c-39993643-42417b12-78c50b17_0
2025-10-10T14:36:10.413484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6356d0b0-86b7eec8-2e7ee050-85b8fe8c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4a59309c-39993643-42417b12-78c50b17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:10.416086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a59309c-39993643-42417b12-78c50b17_0] Write session: try to update token
2025-10-10T14:36:10.416105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a59309c-39993643-42417b12-78c50b17_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:10.430036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:10.430052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId: src_id|4a59309c-39993643-42417b12-78c50b17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:10.430062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:10.430065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:10.430068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:10.430078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601875147499706:4919]
2025-10-10T14:36:10.430083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601875147499706:4919]
2025-10-10T14:36:10.430086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601875147499706:4919]
2025-10-10T14:36:10.430136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:10.430145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.430147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:10.430149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:10.430156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:10.430161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:10.430291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:10.432710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:10.476279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601875929729116:6092]
2025-10-10T14:36:10.476659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1924, pipe: [1:7559601875929729116:6092]
2025-10-10T14:36:10.546774Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:10.547087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.547104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.547146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729116:6092], now have 1 active actors on pipe
2025-10-10T14:36:10.547335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:10.547724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:10.547738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:10.547791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1925 reason: error at write: Disconnected sessionId: src_id|4a59309c-39993643-42417b12-78c50b17_0
2025-10-10T14:36:10.547961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1925 sessionId: src_id|4a59309c-39993643-42417b12-78c50b17_0 is DEAD
2025-10-10T14:36:10.548117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:10.548175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601875929729116:6092]
2025-10-10T14:36:10.548300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a59309c-39993643-42417b12-78c50b17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:10.548309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a59309c-39993643-42417b12-78c50b17_0] Write session will restart in 0.005375s
2025-10-10T14:36:10.548330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a59309c-39993643-42417b12-78c50b17_0] Write session: Do CDS request
2025-10-10T14:36:10.548337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a59309c-39993643-42417b12-78c50b17_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:10.554892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a59309c-39993643-42417b12-78c50b17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.557728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:10.557740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1926
2025-10-10T14:36:10.557913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.557952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:10.557957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:10.557961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:10.558453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1926 sessionId:  describe result for acl check
2025-10-10T14:36:10.558506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:10.558514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:10.558516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:10.558523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601875929729134:5908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:10.559119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601875929729134:5908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:10.561193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601875929729134:5908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:10.564893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601875929729134:5908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:10.564906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601875929729134:5908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:10.564910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601875929729134:5908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:10.564918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:10.572733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:10.575297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:10.575554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:10.575564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:10.575577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:10.575635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:10.575799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601875147499973:4913]
2025-10-10T14:36:10.576439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:10.576769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:10.576813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:10.577173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:10.577235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.577241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.577242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.577243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.577245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.577246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.577247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.577248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.577250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.577251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.577252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.577254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.577255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.577261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.577276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.577280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.577284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.577288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.577292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.577296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.577300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.577304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.577309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.577313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.577316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.577320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.577343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.577352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.577358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.577364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.577368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.577373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.577378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.577383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.577389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.577394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.577398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.577404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.577408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.577414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.577426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.577431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.577435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.577440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.577444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.577450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.577457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.577463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.577467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.577472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.577476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.577481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.577524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:10.580309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:10.581112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:10.581125Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:10.581127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:10.581131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:10.581138Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1925 [2:7559601875147499973:4913]
2025-10-10T14:36:10.581150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:10.581168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:10.581175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.581179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.581182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.581198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:10.581211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:10.581219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:10.581276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.581283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.581285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.581288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:10.581390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:10.581397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.581407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.581419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.581436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:10.581458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729118:2438], now have 1 active actors on pipe
2025-10-10T14:36:10.581463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729227:5908], now have 1 active actors on pipe
2025-10-10T14:36:10.581475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601875147499968:4913]
2025-10-10T14:36:10.581478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601875147499968:4913]
2025-10-10T14:36:10.581481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601875147499968:4913]
2025-10-10T14:36:10.581495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:10.581512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:10.581512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:10.581516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:10.581518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:10.581533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:10.581541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:10.581565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601875147499968:4913]
2025-10-10T14:36:10.581576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:10.581582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:10.581713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1925
2025-10-10T14:36:10.581756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1925
2025-10-10T14:36:10.582294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.582314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.582348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f477e786-bb394596-ae6939ec-2780805b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:10.582363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.582369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.582372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:10.582385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.582412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:10.582435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.584320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.584336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.584364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.584549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1926 partition: 0 MaxSeqNo: 40 sessionId: src_id|f477e786-bb394596-ae6939ec-2780805b_0
2025-10-10T14:36:10.584963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a59309c-39993643-42417b12-78c50b17_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f477e786-bb394596-ae6939ec-2780805b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:10.587759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f477e786-bb394596-ae6939ec-2780805b_0] Write session: try to update token
2025-10-10T14:36:10.587780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f477e786-bb394596-ae6939ec-2780805b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:10.605161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId: src_id|f477e786-bb394596-ae6939ec-2780805b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:10.607964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:10.608468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.608496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.608516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:10.608519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:10.608521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:10.608523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:10.608529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601875147499968:4913]
2025-10-10T14:36:10.608534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601875147499968:4913]
2025-10-10T14:36:10.608537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601875147499968:4913]
2025-10-10T14:36:10.608585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:10.608586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:10.608594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:10.608599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:10.608599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.608602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:10.608752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:10.648293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601875929729383:6092]
2025-10-10T14:36:10.648768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1925, pipe: [1:7559601875929729383:6092]
2025-10-10T14:36:10.732684Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:10.733322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:10.733409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729383:6092], now have 1 active actors on pipe
2025-10-10T14:36:10.733865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:10.733957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:10.733960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:10.734036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1926 reason: error at write: Disconnected sessionId: src_id|f477e786-bb394596-ae6939ec-2780805b_0
2025-10-10T14:36:10.734337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f477e786-bb394596-ae6939ec-2780805b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:10.734347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f477e786-bb394596-ae6939ec-2780805b_0] Write session will restart in 0.006323s
2025-10-10T14:36:10.734374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f477e786-bb394596-ae6939ec-2780805b_0] Write session: Do CDS request
2025-10-10T14:36:10.734357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1926 sessionId: src_id|f477e786-bb394596-ae6939ec-2780805b_0 is DEAD
2025-10-10T14:36:10.734389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f477e786-bb394596-ae6939ec-2780805b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:10.734551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:10.734588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601875929729383:6092]
2025-10-10T14:36:10.742114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f477e786-bb394596-ae6939ec-2780805b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.742188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:10.742203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1927
2025-10-10T14:36:10.742541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.742583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:10.742596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:10.742599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:10.743102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1927 sessionId:  describe result for acl check
2025-10-10T14:36:10.743144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:10.743146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:10.743147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:10.743153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601875929729434:5884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:10.744384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601875929729434:5884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:10.751644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601875929729434:5884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:10.757738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601875929729434:5884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:10.757758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601875929729434:5884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:10.757762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601875929729434:5884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:10.757773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:10.774927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:10.778361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:10.778606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:10.778622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:10.778634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:10.778696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:10.778745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601875147500273:4905]
2025-10-10T14:36:10.779400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:10.779756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:10.779807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:10.780133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:10.780199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.780205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.780206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.780208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.780209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.780210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.780212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.780213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.780215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.780216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.780217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.780219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.780220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.780226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.780239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.780244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.780248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.780252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.780257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.780262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.780266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.780270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.780275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.780279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.780283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.780287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.780297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.780305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.780312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.780319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.780325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.780331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.780336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.780342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.780356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.780367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.780371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.780377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.780382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.780388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.780392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.780398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.780403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.780408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.780418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.780424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.780429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.780439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.780444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.780452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.780456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.780462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.780506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:10.783356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:10.783922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:10.783937Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:10.783939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:10.783944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:10.783951Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1926 [2:7559601875147500273:4905]
2025-10-10T14:36:10.783964Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:10.783984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:10.783987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.783991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.783994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.784011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:10.784027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:10.784036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:10.784098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.784105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.784107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.784110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:10.784182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:10.784191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.784202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.784215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.784232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:10.784259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729406:2438], now have 1 active actors on pipe
2025-10-10T14:36:10.784263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729518:5884], now have 1 active actors on pipe
2025-10-10T14:36:10.784271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601875147500267:4905]
2025-10-10T14:36:10.784274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601875147500267:4905]
2025-10-10T14:36:10.784276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601875147500267:4905]
2025-10-10T14:36:10.784291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:10.784310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:10.784313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:10.784313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:10.784315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:10.784329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:10.784333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:10.784367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601875147500267:4905]
2025-10-10T14:36:10.784375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:10.784383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:10.784417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1926
2025-10-10T14:36:10.784476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1926
2025-10-10T14:36:10.784642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.784657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.784711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:10.784727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.784732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.784735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:10.784750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.784764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:10.784788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.784996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.785007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.785025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.785206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1927 partition: 0 MaxSeqNo: 40 sessionId: src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0
2025-10-10T14:36:10.785632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f477e786-bb394596-ae6939ec-2780805b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:10.788381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0] Write session: try to update token
2025-10-10T14:36:10.788399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:10.803717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId: src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:10.804066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:10.804090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:10.804094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:10.804096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:10.804108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601875147500267:4905]
2025-10-10T14:36:10.804114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601875147500267:4905]
2025-10-10T14:36:10.804118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601875147500267:4905]
2025-10-10T14:36:10.804167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:10.804169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:10.804177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.804179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:10.804188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:10.804192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:10.804361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:10.806370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:10.834642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601875929729686:6092]
2025-10-10T14:36:10.834965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1926, pipe: [1:7559601875929729686:6092]
2025-10-10T14:36:10.939229Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:10.940299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.940344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.940395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729686:6092], now have 1 active actors on pipe
2025-10-10T14:36:10.940930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:10.941207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:10.941234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601875929729686:6092]
2025-10-10T14:36:10.941285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1927 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0
2025-10-10T14:36:10.941288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:10.941470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1927 sessionId: src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0 is DEAD
2025-10-10T14:36:10.941642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:10.941654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0] Write session will restart in 0.007305s
2025-10-10T14:36:10.941680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0] Write session: Do CDS request
2025-10-10T14:36:10.941687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:10.949925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.950010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:10.950023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1928
2025-10-10T14:36:10.950306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:10.950342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:10.950361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:10.950365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:10.952588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1928 sessionId:  describe result for acl check
2025-10-10T14:36:10.952627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:10.952630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:10.952631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:10.952638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601875929729736:5882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:10.953295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601875929729736:5882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:10.958098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601875929729736:5882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:10.963633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601875929729736:5882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:10.963648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601875929729736:5882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:10.963653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601875929729736:5882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:10.963663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:10.974127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:10.977409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:10.977773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:10.977780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:10.977796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:10.977877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:10.977918Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601875147500551:4882]
2025-10-10T14:36:10.978451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:10.978803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:10.978855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:10.979094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:10.979161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.979169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.979170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.979171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.979172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.979173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.979174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.979176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.979177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.979178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.979180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.979181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.979182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.979189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.979200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.979203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.979205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.979208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.979210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.979212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.979214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.979217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.979221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.979223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.979225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.979227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.979236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.979241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:10.979246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.979250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:10.979252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.979255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:10.979258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.979262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:10.979265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.979268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:10.979271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.979275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:10.979278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.979281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:10.979284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.979287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:10.979290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.979293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:10.979296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.979299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:10.979302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.979307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.979310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.979313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.979315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.979318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.979343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:10.982651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:10.983507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:10.983524Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:10.983527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:10.983531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:10.983538Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1927 [2:7559601875147500551:4882]
2025-10-10T14:36:10.983552Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:10.983573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:10.983577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.983580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.983583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.983601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:10.983609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:10.983623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:10.983691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.983701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.983703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.983706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:10.983781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:10.983791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:10.983811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:10.983824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:10.983843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:10.983865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601875147500546:4882]
2025-10-10T14:36:10.983867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601875147500546:4882]
2025-10-10T14:36:10.983869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601875147500546:4882]
2025-10-10T14:36:10.983883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:10.983899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729700:2438], now have 1 active actors on pipe
2025-10-10T14:36:10.983908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601875929729833:5882], now have 1 active actors on pipe
2025-10-10T14:36:10.983910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:10.983913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:10.983916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:10.983916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:10.983932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:10.983935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:10.983970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601875147500546:4882]
2025-10-10T14:36:10.983977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:10.984082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1927
2025-10-10T14:36:10.984154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1927
2025-10-10T14:36:10.984467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:10.984661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.984668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.984700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:10.984709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:10.984713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:10.984716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:10.984730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:10.984743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:10.984757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.985013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:10.985024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:10.985057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:10.985153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1928 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0
2025-10-10T14:36:10.985636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dee9ab9-a74bf5e1-b9e6ae32-845ab2a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:10.988270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0] Write session: try to update token
2025-10-10T14:36:10.988287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:11.006148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:11.006162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.006171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601875147500546:4882]
2025-10-10T14:36:11.006217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:11.006280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:11.006431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:11.006581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.006711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.006841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.007056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:11.007114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:11.010456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId: src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:11.013372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.013393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.013449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:11.013132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:11.013554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:11.044477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601880224697263:6092]
2025-10-10T14:36:11.044793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1927, pipe: [1:7559601880224697263:6092]
2025-10-10T14:36:11.046692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.046718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.046919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.046997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.047079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.047165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.047818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.047833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.047918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.047992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.048063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.048145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.048189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.048192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.048276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.048343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.048413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.048483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.048528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.048532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.048611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.048682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.048757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.048829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.048874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.048889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.048967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.049040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.049129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.049214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.049272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.049281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.049555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.049625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.049684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.049752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.049802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.049806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.049906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.049981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.050052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.050120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.050169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.050175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.050260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.050325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.050387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.050456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.050515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.050518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.050587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.050645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.050707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.050774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.050816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.050819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.050891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.050948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.051012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.051077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.051119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.051122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.051234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224697263:6092], now have 1 active actors on pipe
2025-10-10T14:36:11.051243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:36:11.051314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.051338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.051341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:36:11.051387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:36:11.051405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:36:11.051409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:36:11.051412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:36:11.051416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:36:11.051852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:36:11.051870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:36:11.051876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:36:11.051883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:36:11.051887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:36:11.051890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:36:11.052489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:36:11.052503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:36:11.052510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:36:11.052513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:36:11.052516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:36:11.052522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:36:11.053734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:36:11.053764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:36:11.053771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:36:11.053775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:36:11.053779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:36:11.062284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:36:11.062315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:36:11.062342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760106971061
2025-10-10T14:36:11.062519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:36:11.062532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:36:11.062540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:36:11.062544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:36:11.062550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:36:11.062553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:36:11.063039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:36:11.063057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:36:11.063066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:36:11.063070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:36:11.063073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:36:11.063076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:36:11.063623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:36:11.063637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:36:11.063647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:36:11.063651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:36:11.063656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:36:11.063660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:36:11.064124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:36:11.064135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:36:11.064141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:36:11.065309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:36:11.065318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:36:11.065323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:36:11.065327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:36:11.065526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760106971065
2025-10-10T14:36:11.065829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:36:11.065857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:36:11.065862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:36:11.065866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:36:11.065870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:36:11.065874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:36:11.066360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:36:11.066373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:36:11.066378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:36:11.066383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:36:11.066388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:36:11.066391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:36:11.066879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:36:11.066893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.067009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760106971066
2025-10-10T14:36:11.073687Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:36:11.073723Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:36:11.073732Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:36:11.073741Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:36:11.073758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:11.073762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.073765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:11.073770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:11.073782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601875147500546:4882]
2025-10-10T14:36:11.073787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601875147500546:4882]
2025-10-10T14:36:11.073791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601875147500546:4882]
2025-10-10T14:36:11.073890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:11.073903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.073905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:11.074043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:11.075818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:11.075832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:11.075837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:11.190544Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:11.191216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:11.191871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:11.191889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601880224697263:6092]
2025-10-10T14:36:11.191915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:11.191972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1928 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0
2025-10-10T14:36:11.192443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:11.192453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0] Write session will restart in 0.007128s
2025-10-10T14:36:11.192478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0] Write session: Do CDS request
2025-10-10T14:36:11.192484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:11.192561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1928 sessionId: src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0 is DEAD
2025-10-10T14:36:11.197148Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [5e1d1ac6f658dcc9] Result# TEvPutResult {Id# [72075186224037892:1927:1:2:2:7988760:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-10T14:36:11.197250Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1927:1:2:1:8295638:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:36:11.197444Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1927:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:36:11.200958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:11.201015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:11.201027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1929
2025-10-10T14:36:11.201715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:11.201761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:11.201768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:11.201774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:11.202233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1929 sessionId:  describe result for acl check
2025-10-10T14:36:11.202285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:11.202292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:11.202294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:11.202300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601880224697282:5876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:11.202904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601880224697282:5876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:11.206920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601880224697282:5876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:11.211123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601880224697282:5876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:11.211138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601880224697282:5876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:11.211142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601880224697282:5876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:11.211152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:11.217315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:11.219968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:11.220179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:11.220185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:11.220196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:11.220244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:11.220297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601879442468116:4880]
2025-10-10T14:36:11.220914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:11.221313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:11.221385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:11.221740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:11.221814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.221816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.221817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.221818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.221820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.221821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.221822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.221823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.221824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.221825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.221826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.221828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.221829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.221844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.221855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.221859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.221862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.221866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.221869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.221873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.221876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.221879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.221883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.221886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.221889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.221892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.221900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.221908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.221915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.221920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.221924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.221928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.221932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.221947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.221952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.221957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.221962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.221967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.221972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.221976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.221982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.221987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.221990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.221995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.221998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.222003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.222007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.222012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.222016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.222021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.222024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.222029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.222064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:11.226047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1928
2025-10-10T14:36:11.226083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1928
2025-10-10T14:36:11.224996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:11.225632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:11.225638Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:11.225640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:11.225644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:11.225652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1928 [2:7559601879442468116:4880]
2025-10-10T14:36:11.225666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:11.225685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:11.225689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.225693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.225695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.225712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:11.225720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:11.225728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:11.225792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.225795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.225797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.225799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:11.225872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:11.225875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.225886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.225898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.225914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:11.225938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224697413:5876], now have 1 active actors on pipe
2025-10-10T14:36:11.225941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224697266:2438], now have 1 active actors on pipe
2025-10-10T14:36:11.225949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601879442468111:4880]
2025-10-10T14:36:11.225952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601879442468111:4880]
2025-10-10T14:36:11.225954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601879442468111:4880]
2025-10-10T14:36:11.225971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:11.225985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:11.226001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:11.226005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:11.226039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601879442468111:4880]
2025-10-10T14:36:11.226041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:11.226084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:11.226087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:11.226089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:11.226098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:11.226357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.226379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.226421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb74bf03-dffb7852-b3981636-e3848623_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:11.226437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.226446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.226449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:11.226466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.226484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:11.226506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:11.226734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.226743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.226762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:11.226864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1929 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb74bf03-dffb7852-b3981636-e3848623_0
2025-10-10T14:36:11.227287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ddea818-8bf56a16-28537b7a-93ca860e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb74bf03-dffb7852-b3981636-e3848623_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:11.230076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74bf03-dffb7852-b3981636-e3848623_0] Write session: try to update token
2025-10-10T14:36:11.230097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74bf03-dffb7852-b3981636-e3848623_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:11.238094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:11.238110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.238122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601879442468111:4880]
2025-10-10T14:36:11.238184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:11.238191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:11.238363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:11.238536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.238679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.238819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.239014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:11.239053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:11.244622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId: src_id|fb74bf03-dffb7852-b3981636-e3848623_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:11.247364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:11.247607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.247627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.247680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:11.247779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:11.256607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:11.256629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.256633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:11.256635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:11.256648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601879442468111:4880]
2025-10-10T14:36:11.256652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601879442468111:4880]
2025-10-10T14:36:11.256656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601879442468111:4880]
2025-10-10T14:36:11.256712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:11.256711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:11.256719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:11.256725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.256726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:11.256730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:11.256876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:11.293436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601880224697534:6092]
2025-10-10T14:36:11.297408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1928, pipe: [1:7559601880224697534:6092]
2025-10-10T14:36:11.385409Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:11.395033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.395066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.395274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.395348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.395416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.395486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.395532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.395538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.395616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.395680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.395750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.395821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.395867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.395871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.395952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.396020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.396085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.396152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.396200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.396208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.396286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.396356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.396423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.396490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.396535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.396538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.396622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.396686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.396752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.396827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.396876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.396879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.396953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.397016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.397104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.397176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.397224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.397227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.397306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.397692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.397770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.397842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.397885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.397888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.397965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.398027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.398096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.398171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.398217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.398220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.398296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.398361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.398428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.398492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.398542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.398545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.398616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.398674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.398738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.398800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.398841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.398844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.398947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224697534:6092], now have 1 active actors on pipe
2025-10-10T14:36:11.399313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:11.401235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74bf03-dffb7852-b3981636-e3848623_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:11.401249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74bf03-dffb7852-b3981636-e3848623_0] Write session will restart in 0.006277s
2025-10-10T14:36:11.401276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74bf03-dffb7852-b3981636-e3848623_0] Write session: Do CDS request
2025-10-10T14:36:11.401282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74bf03-dffb7852-b3981636-e3848623_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:11.399406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:11.399471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601880224697534:6092]
2025-10-10T14:36:11.399475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:11.399480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:11.399512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1929 reason: error at write: Disconnected sessionId: src_id|fb74bf03-dffb7852-b3981636-e3848623_0
2025-10-10T14:36:11.399716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1929 sessionId: src_id|fb74bf03-dffb7852-b3981636-e3848623_0 is DEAD
2025-10-10T14:36:11.408975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74bf03-dffb7852-b3981636-e3848623_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:11.409000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:11.409016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1930
2025-10-10T14:36:11.409294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:11.409353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:11.409364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:11.409368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:11.409829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1930 sessionId:  describe result for acl check
2025-10-10T14:36:11.409864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:11.409870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:11.409872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:11.409879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601880224697553:5871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:11.410479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601880224697553:5871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:11.413304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601880224697553:5871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:11.418821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601880224697553:5871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:11.418838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601880224697553:5871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:11.418842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601880224697553:5871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:11.418852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:11.438193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:11.441161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:11.441406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:11.441412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:11.441425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:11.441482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:11.441526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601879442468381:4877]
2025-10-10T14:36:11.442181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:11.442665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:11.442712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:11.443025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:11.443079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.443080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.443082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.443083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.443084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.443085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.443086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.443087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.443089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.443090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.443091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.443092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.443093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.443099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.443110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.443114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.443118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.443121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.443125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.443129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.443133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.443136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.443142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.443146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.443150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.443154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.443162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.443171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.443178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.443183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.443190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.443195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.443200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.443205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.443210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.443215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.443219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.443224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.443229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.443234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.443240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.443245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.443249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.443254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.443258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.443263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.443267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.443271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.443275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.443279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.443283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.443288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.443324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:11.446128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:11.446555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:11.446569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:11.446572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:11.446576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:11.446583Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1929 [2:7559601879442468381:4877]
2025-10-10T14:36:11.446596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:11.446629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:11.446636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.446640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.446642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.446659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:11.446671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:11.446679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:11.446740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.446747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.446749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.446752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:11.446816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:11.446825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.446835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.446846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.446862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:11.446885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224697584:5871], now have 1 active actors on pipe
2025-10-10T14:36:11.446893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224697540:2438], now have 1 active actors on pipe
2025-10-10T14:36:11.446901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601879442468376:4877]
2025-10-10T14:36:11.446903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601879442468376:4877]
2025-10-10T14:36:11.446906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601879442468376:4877]
2025-10-10T14:36:11.446919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:11.446931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:11.446934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:11.446934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:11.446937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:11.446950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:11.446954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:11.446984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601879442468376:4877]
2025-10-10T14:36:11.446991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:11.446997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:11.447002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1929
2025-10-10T14:36:11.447036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1929
2025-10-10T14:36:11.447123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.447135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.447170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:11.447178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.447183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.447186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:11.447210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.447223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:11.447238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:11.447789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.447799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.447820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:11.447924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1930 partition: 0 MaxSeqNo: 40 sessionId: src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0
2025-10-10T14:36:11.448366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb74bf03-dffb7852-b3981636-e3848623_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:11.451079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0] Write session: try to update token
2025-10-10T14:36:11.451098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:11.459388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:11.459402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.459411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601879442468376:4877]
2025-10-10T14:36:11.459454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:11.459508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:11.459627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:11.459789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.459936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.460075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.460275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:11.460319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:11.468088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId: src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:11.470708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:11.470943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.470971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.471024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:11.471134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:11.478221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:11.478236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.478240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:11.478242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:11.478258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601879442468376:4877]
2025-10-10T14:36:11.478262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601879442468376:4877]
2025-10-10T14:36:11.478265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601879442468376:4877]
2025-10-10T14:36:11.478317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:11.478328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:11.478334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.478335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:11.478337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:11.478339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:11.478475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:11.499742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601880224697809:6092]
2025-10-10T14:36:11.500077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1929, pipe: [1:7559601880224697809:6092]
2025-10-10T14:36:11.596389Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:11.604908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.604942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.605142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.605205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.605273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.608982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:11.608997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0] Write session will restart in 0.006529s
2025-10-10T14:36:11.609028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0] Write session: Do CDS request
2025-10-10T14:36:11.609034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:11.605357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.605406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.605411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.605484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.605541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.605605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.605670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.605718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.605721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.608549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:11.605802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.605861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.608565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:11.605928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.605991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.606027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.606029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.608600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1930 reason: error at write: Disconnected sessionId: src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0
2025-10-10T14:36:11.606104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.608799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1930 sessionId: src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0 is DEAD
2025-10-10T14:36:11.606167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.606234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.606299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.608986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:11.609457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601880224697809:6092]
2025-10-10T14:36:11.606353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.606356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.606432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.606489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.606556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.606618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.606657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.606661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.606729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.606787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.606855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.606915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.606962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.606965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.607033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.607091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.607153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.607216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.607260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.607263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.607332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.607388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.607450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.607509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.607556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.607562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.607636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.607693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.607756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.607818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.607864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.607867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.607938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.607997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.608061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.608125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.608166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.608169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.608255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224697809:6092], now have 1 active actors on pipe
2025-10-10T14:36:11.609707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:11.616911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:11.617038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:11.617072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1931
2025-10-10T14:36:11.617901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:11.617941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:11.617947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:11.617951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:11.618457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1931 sessionId:  describe result for acl check
2025-10-10T14:36:11.618491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:11.618493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:11.618494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:11.618501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601880224697835:5857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:11.619118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601880224697835:5857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:11.626002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601880224697835:5857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:11.630137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601880224697835:5857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:11.630155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601880224697835:5857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:11.630159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601880224697835:5857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:11.630169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:11.631760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:11.634472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:11.634708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:11.634719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:11.634732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:11.634797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:11.634846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601879442468648:4875]
2025-10-10T14:36:11.635448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:11.635770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:11.635815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:11.636144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:11.636197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.636203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.636204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.636205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.636206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.636207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.636209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.636210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.636211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.636212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.636213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.636214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.636215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.636220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.636233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.636237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.636241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.636244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.636248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.636252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.636255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.636259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.636262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.636266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.636269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.636272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.636281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.636289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.636294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.636300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.636303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.636309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.636313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.636318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.636322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.636327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.636331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.636341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.636346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.636351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.636355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.636360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.636364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.636375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.636379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.636389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.636396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.636400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.636405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.636409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.636413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.636417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.636460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:11.639485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:11.640368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:11.640381Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:11.640383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:11.640387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:11.640393Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1930 [2:7559601879442468648:4875]
2025-10-10T14:36:11.640407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:11.640430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:11.640438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.640441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.640443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.640462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:11.640474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:11.640481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:11.640544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.640551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.640553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.640556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:11.640625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:11.640632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.640642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.640657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.640676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:11.640703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224698065:5857], now have 1 active actors on pipe
2025-10-10T14:36:11.640712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224697811:2438], now have 1 active actors on pipe
2025-10-10T14:36:11.640720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601879442468642:4875]
2025-10-10T14:36:11.640722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601879442468642:4875]
2025-10-10T14:36:11.640724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601879442468642:4875]
2025-10-10T14:36:11.640740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:11.640759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:11.640769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:11.640778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:11.640778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:11.640780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:11.640781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:11.640811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601879442468642:4875]
2025-10-10T14:36:11.640822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:11.640828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:11.640959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1930
2025-10-10T14:36:11.640989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1930
2025-10-10T14:36:11.641305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.641326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.641380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff723d03-b1a03ca4-70664e99-104b428_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:11.641394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.641403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.641406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:11.641419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.641435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:11.641456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:11.641729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.641738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.641758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:11.641894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1931 partition: 0 MaxSeqNo: 40 sessionId: src_id|ff723d03-b1a03ca4-70664e99-104b428_0
2025-10-10T14:36:11.642403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0dbd376-77b3dbe5-b0fc2066-79a05299_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ff723d03-b1a03ca4-70664e99-104b428_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:11.645133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff723d03-b1a03ca4-70664e99-104b428_0] Write session: try to update token
2025-10-10T14:36:11.645153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff723d03-b1a03ca4-70664e99-104b428_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:11.669469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId: src_id|ff723d03-b1a03ca4-70664e99-104b428_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:11.672214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:11.672438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:11.672458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.672462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:11.672465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:11.672476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601879442468642:4875]
2025-10-10T14:36:11.672482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601879442468642:4875]
2025-10-10T14:36:11.672488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601879442468642:4875]
2025-10-10T14:36:11.672554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.672552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:11.672560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:11.672566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:11.672570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.672590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:11.672600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.672603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:11.672767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:11.709663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601880224698088:6092]
2025-10-10T14:36:11.710727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1930, pipe: [1:7559601880224698088:6092]
2025-10-10T14:36:11.805800Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:11.806558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224698088:6092], now have 1 active actors on pipe
2025-10-10T14:36:11.806839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601880224698088:6092]
2025-10-10T14:36:11.806880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:11.806883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:11.806967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1931 reason: error at write: Disconnected sessionId: src_id|ff723d03-b1a03ca4-70664e99-104b428_0
2025-10-10T14:36:11.807155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:11.807192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1931 sessionId: src_id|ff723d03-b1a03ca4-70664e99-104b428_0 is DEAD
2025-10-10T14:36:11.807216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:11.809250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff723d03-b1a03ca4-70664e99-104b428_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:11.809265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff723d03-b1a03ca4-70664e99-104b428_0] Write session will restart in 0.005962s
2025-10-10T14:36:11.809289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff723d03-b1a03ca4-70664e99-104b428_0] Write session: Do CDS request
2025-10-10T14:36:11.809296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff723d03-b1a03ca4-70664e99-104b428_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:11.817817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff723d03-b1a03ca4-70664e99-104b428_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:11.818212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:11.818232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1932
2025-10-10T14:36:11.818396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:11.818444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:11.818455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:11.818461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:11.819184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1932 sessionId:  describe result for acl check
2025-10-10T14:36:11.819221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:11.819223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:11.819225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:11.819231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601880224698129:5844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:11.819835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601880224698129:5844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:11.823232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601880224698129:5844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:11.826475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601880224698129:5844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:11.826491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601880224698129:5844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:11.826496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601880224698129:5844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:11.826506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:11.837933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:11.840809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:11.841069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:11.841080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:11.841091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:11.841153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:11.841211Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601879442468953:4841]
2025-10-10T14:36:11.841882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:11.842240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:11.842290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:11.842633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:11.842694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.842701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.842702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.842703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.842704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.842706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.842707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.842708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.842710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.842711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.842712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.842714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.842715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.842722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.842737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.842741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.842745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.842749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.842753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.842757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.842761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.842765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.842772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.842777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.842781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.842785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.842794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.842804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:11.842811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.842817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:11.842821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.842827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:11.842831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.842837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:11.842842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.842848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:11.842853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.842859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:11.842864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.842870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:11.842875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.842881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:11.842887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.842893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:11.842897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.842902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:11.842908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.842914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.842919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.842930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.842936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.842941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.842989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:11.845605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:11.846047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:11.846061Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:11.846064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:11.846069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:11.846076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1931 [2:7559601879442468953:4841]
2025-10-10T14:36:11.846090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:11.846109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:11.846117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.846121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.846124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.846142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:11.846155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:11.846164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:11.846233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.846240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.846243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.846245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:11.846319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:11.846326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.846339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:11.846358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:11.846381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:11.846409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224698119:2438], now have 1 active actors on pipe
2025-10-10T14:36:11.846417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224698172:5844], now have 1 active actors on pipe
2025-10-10T14:36:11.846425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601879442468948:4841]
2025-10-10T14:36:11.846428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601879442468948:4841]
2025-10-10T14:36:11.846430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601879442468948:4841]
2025-10-10T14:36:11.846444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:11.846458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:11.846459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:11.846463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:11.846465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:11.846476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:11.846484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:11.846513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601879442468948:4841]
2025-10-10T14:36:11.846524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:11.846530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:11.846507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1931
2025-10-10T14:36:11.846573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.846583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.846613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f173e785-182b2de7-d05fbc6-b737494e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:11.846571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1931
2025-10-10T14:36:11.846625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:11.846630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:11.846632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:11.846644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:11.846662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:11.846680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:11.846831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.846843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.846872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:11.846971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1932 partition: 0 MaxSeqNo: 40 sessionId: src_id|f173e785-182b2de7-d05fbc6-b737494e_0
2025-10-10T14:36:11.847371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff723d03-b1a03ca4-70664e99-104b428_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f173e785-182b2de7-d05fbc6-b737494e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:11.850254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f173e785-182b2de7-d05fbc6-b737494e_0] Write session: try to update token
2025-10-10T14:36:11.850271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f173e785-182b2de7-d05fbc6-b737494e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:11.858525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:11.858544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.858559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601879442468948:4841]
2025-10-10T14:36:11.858612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:11.858630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:11.858797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:11.858943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.859101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.859241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:11.859428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:11.859468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:11.869012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId: src_id|f173e785-182b2de7-d05fbc6-b737494e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:11.871836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:11.872011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.872031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.872083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:11.872144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:11.877401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:11.877415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:11.877419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:11.877421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:11.877434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601879442468948:4841]
2025-10-10T14:36:11.877439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601879442468948:4841]
2025-10-10T14:36:11.877443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601879442468948:4841]
2025-10-10T14:36:11.877483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:11.877494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:11.877497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:11.877504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:11.877511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:11.877521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:11.877648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:11.903706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601880224698400:6092]
2025-10-10T14:36:11.904088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1931, pipe: [1:7559601880224698400:6092]
2025-10-10T14:36:11.989731Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:11.998154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:11.998176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:11.998365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.998452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.998518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.998592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.999290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.999302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.999381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.999454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.999529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.999611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.999659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.999666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:11.999732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:11.999790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:11.999849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:11.999926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:11.999975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:11.999981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.000049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.000124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.000203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.000281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.000329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.000338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.000406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.000479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.000557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.000632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.000681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.000692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.000768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.000835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.000910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.000988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.001049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.001058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.001130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.001192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.001262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.001350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.001502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.001511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.001583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.001645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.001711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.001783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.001824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.001830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.001897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.001955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.002016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.002084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.002127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.002133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.002196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.002256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.002327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.002391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.002434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.002439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.002501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601880224698400:6092], now have 1 active actors on pipe
2025-10-10T14:36:12.002736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:12.002737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601880224698400:6092]
2025-10-10T14:36:12.002767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:12.002770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:12.002810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1932 reason: error at write: Disconnected sessionId: src_id|f173e785-182b2de7-d05fbc6-b737494e_0
2025-10-10T14:36:12.003048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1932 sessionId: src_id|f173e785-182b2de7-d05fbc6-b737494e_0 is DEAD
2025-10-10T14:36:12.003060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:12.003202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f173e785-182b2de7-d05fbc6-b737494e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:12.003216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f173e785-182b2de7-d05fbc6-b737494e_0] Write session will restart in 0.007424s
2025-10-10T14:36:12.003253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f173e785-182b2de7-d05fbc6-b737494e_0] Write session: Do CDS request
2025-10-10T14:36:12.003259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f173e785-182b2de7-d05fbc6-b737494e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:12.011911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f173e785-182b2de7-d05fbc6-b737494e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.011973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:12.011986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1933
2025-10-10T14:36:12.012149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.012189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:12.012195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:12.012200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:12.012840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1933 sessionId:  describe result for acl check
2025-10-10T14:36:12.012877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:12.012883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:12.012887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:12.012893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601884519665738:5837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:12.013484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601884519665738:5837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:12.017143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601884519665738:5837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:12.020419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601884519665738:5837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:12.020443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601884519665738:5837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:12.020447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601884519665738:5837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:12.020455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:12.024401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:12.026993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:12.027211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:12.027222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:12.027234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:12.027290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:12.027337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601883737436530:4833]
2025-10-10T14:36:12.028003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:12.028348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:12.028395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:12.028745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:12.028806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.028813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.028814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.028816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.028817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.028819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.028820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.028822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.028823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.028825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.028826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.028827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.028829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.028835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.028849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.028854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.028858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.028862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.028867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.028871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.028875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.028880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.028885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.028889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.028893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.028898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.028907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.028916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.028924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.028935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.028942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.028951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.028956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.028961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.028967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.028978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.028983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.028988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.029000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.029006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.029011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.029016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.029026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.029032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.029050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.029058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.029062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.029068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.029072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.029078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.029087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.029093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.029137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:12.031591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:12.032349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:12.032359Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:12.032362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:12.032366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:12.032373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1932 [2:7559601883737436530:4833]
2025-10-10T14:36:12.032387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:12.032406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:12.032415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.032419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.032421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.032438Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:12.032446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:12.032454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:12.032517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.032524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.032526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.032529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:12.032598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:12.032609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.032622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.032634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.032652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:12.032674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519665901:5837], now have 1 active actors on pipe
2025-10-10T14:36:12.032685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519665701:2438], now have 1 active actors on pipe
2025-10-10T14:36:12.032694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601883737436525:4833]
2025-10-10T14:36:12.032696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601883737436525:4833]
2025-10-10T14:36:12.032699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601883737436525:4833]
2025-10-10T14:36:12.032712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:12.032726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:12.032736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:12.032741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:12.032746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:12.032749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:12.032752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:12.032776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601883737436525:4833]
2025-10-10T14:36:12.032789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:12.032793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:12.032771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1932
2025-10-10T14:36:12.032774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1932
2025-10-10T14:36:12.032829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.032839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.032870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b53f21f-913cd60d-164499-6f71b791_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:12.032883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.032888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.032891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:12.032902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.032912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:12.032928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.033161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.033171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.033189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.033279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1933 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b53f21f-913cd60d-164499-6f71b791_0
2025-10-10T14:36:12.033698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f173e785-182b2de7-d05fbc6-b737494e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b53f21f-913cd60d-164499-6f71b791_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:12.036413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b53f21f-913cd60d-164499-6f71b791_0] Write session: try to update token
2025-10-10T14:36:12.036433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b53f21f-913cd60d-164499-6f71b791_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:12.044559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:12.044579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:12.044590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601883737436525:4833]
2025-10-10T14:36:12.044638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:12.044645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:12.044848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:12.044993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:12.045135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:12.045277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:12.045503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:12.045540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:12.052050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId: src_id|4b53f21f-913cd60d-164499-6f71b791_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:12.055030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:12.055255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.055277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.055321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:12.055474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:12.063898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:12.063922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:12.063925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:12.063927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:12.063938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601883737436525:4833]
2025-10-10T14:36:12.063942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601883737436525:4833]
2025-10-10T14:36:12.063946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601883737436525:4833]
2025-10-10T14:36:12.063994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:12.063997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:12.064005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.064008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:12.064010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:12.064016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:12.064145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:12.102897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601884519665969:6092]
2025-10-10T14:36:12.103244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1932, pipe: [1:7559601884519665969:6092]
2025-10-10T14:36:12.185469Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:12.194250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.194288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.194478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.194555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.194623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.194695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.194747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.194757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.194832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.194905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.194976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.195055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.195112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.195124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.195197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.195264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.195335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.195402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.195450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.195459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.195530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.195600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.195670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.195738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.195786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.195794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.195867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.195939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.196007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.196068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.196115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.196123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.196193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.196259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.196326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.196389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.196436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.196443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.196516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.196581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.196651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.196720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.196769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.196777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.196847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.196914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.196984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.197069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.197118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.197126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.197195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.197262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.197350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.197421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.197470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.197477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.197550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.197618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.197691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.197759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.197807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.197814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.197884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519665969:6092], now have 1 active actors on pipe
2025-10-10T14:36:12.198264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601884519665969:6092]
2025-10-10T14:36:12.198292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:12.198296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:12.198301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:12.198331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1933 reason: error at write: Disconnected sessionId: src_id|4b53f21f-913cd60d-164499-6f71b791_0
2025-10-10T14:36:12.198593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1933 sessionId: src_id|4b53f21f-913cd60d-164499-6f71b791_0 is DEAD
2025-10-10T14:36:12.198709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b53f21f-913cd60d-164499-6f71b791_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:12.198719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b53f21f-913cd60d-164499-6f71b791_0] Write session will restart in 0.009229s
2025-10-10T14:36:12.198745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b53f21f-913cd60d-164499-6f71b791_0] Write session: Do CDS request
2025-10-10T14:36:12.198751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b53f21f-913cd60d-164499-6f71b791_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:12.199077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:12.208880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b53f21f-913cd60d-164499-6f71b791_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.208985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:12.209000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1934
2025-10-10T14:36:12.209446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.209485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:12.209498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:12.209502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:12.209984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1934 sessionId:  describe result for acl check
2025-10-10T14:36:12.210021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:12.210027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:12.210029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:12.210036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601884519666032:5830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:12.210631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601884519666032:5830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:12.214263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601884519666032:5830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:12.217611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601884519666032:5830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:12.217625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601884519666032:5830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:12.217628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601884519666032:5830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:12.217637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:12.219729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:12.222571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:12.222793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:12.222804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:12.222816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:12.222872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:12.222917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601883737436798:4828]
2025-10-10T14:36:12.223566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:12.223849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:12.223891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:12.224120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:12.224170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.224178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.224179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.224180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.224182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.224183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.224184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.224185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.224186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.224187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.224187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.224188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.224189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.224192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.224201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.224204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.224206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.224208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.224210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.224213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.224215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.224218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.224220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.224222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.224224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.224226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.224232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.224240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.224247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.224252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.224257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.224263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.224267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.224273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.224276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.224279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.224282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.224285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.224288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.224292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.224295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.224299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.224303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.224306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.224309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.224312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.224315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.224320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.224322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.224326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.224329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.224332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.224357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:12.226842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:12.227298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:12.227309Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:12.227312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:12.227316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:12.227322Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1933 [2:7559601883737436798:4828]
2025-10-10T14:36:12.227335Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:12.227354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:12.227357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.227361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.227363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.227381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:12.227394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:12.227402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:12.227462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.227469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.227471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.227474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:12.227541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:12.227548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.227560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.227576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.227598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:12.227624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519665972:2438], now have 1 active actors on pipe
2025-10-10T14:36:12.227632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666230:5830], now have 1 active actors on pipe
2025-10-10T14:36:12.227639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601883737436793:4828]
2025-10-10T14:36:12.227683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1933
2025-10-10T14:36:12.227642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601883737436793:4828]
2025-10-10T14:36:12.227644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601883737436793:4828]
2025-10-10T14:36:12.227705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1933
2025-10-10T14:36:12.227660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:12.227675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:12.227690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:12.227693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:12.227695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:12.227698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:12.227701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:12.227716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601883737436793:4828]
2025-10-10T14:36:12.227719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:12.227721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:12.227748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.227753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.227788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:12.227795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.227799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.227801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:12.227812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.227823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:12.227839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.227973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.227982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.227997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.228088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1934 partition: 0 MaxSeqNo: 40 sessionId: src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0
2025-10-10T14:36:12.228472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b53f21f-913cd60d-164499-6f71b791_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:12.231298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0] Write session: try to update token
2025-10-10T14:36:12.231318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:12.248837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId: src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:12.251649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:12.253153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.253180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.253207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:12.253210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:12.253215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:12.253217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:12.253226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601883737436793:4828]
2025-10-10T14:36:12.253231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601883737436793:4828]
2025-10-10T14:36:12.253235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601883737436793:4828]
2025-10-10T14:36:12.253285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:12.253301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:12.253308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.253309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:12.253311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:12.253314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:12.253476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:12.298475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601884519666244:6092]
2025-10-10T14:36:12.298805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1933, pipe: [1:7559601884519666244:6092]
2025-10-10T14:36:12.374195Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:12.374669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:12.374738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666244:6092], now have 1 active actors on pipe
2025-10-10T14:36:12.374842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:12.374948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:12.374961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:12.374965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:12.375070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601884519666244:6092]
2025-10-10T14:36:12.375074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1934 reason: error at write: Disconnected sessionId: src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0
2025-10-10T14:36:12.375310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1934 sessionId: src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0 is DEAD
2025-10-10T14:36:12.375402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:12.375412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0] Write session will restart in 0.009462s
2025-10-10T14:36:12.375437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0] Write session: Do CDS request
2025-10-10T14:36:12.375443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:12.385935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.386081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:12.386097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1935
2025-10-10T14:36:12.386257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.386313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:12.386324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:12.386329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:12.386942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1935 sessionId:  describe result for acl check
2025-10-10T14:36:12.386985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:12.386991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:12.386993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:12.387000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601884519666323:5827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:12.387596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601884519666323:5827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:12.390520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601884519666323:5827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:12.393582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601884519666323:5827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:12.393595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601884519666323:5827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:12.393599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601884519666323:5827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:12.393606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:12.395296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:12.397958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:12.398169Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:12.398181Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:12.398193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:12.398256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:12.398301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601883737437067:4823]
2025-10-10T14:36:12.398926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:12.399217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:12.399256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:12.399573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:12.399628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.399637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.399639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.399640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.399641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.399643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.399644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.399645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.399646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.399648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.399649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.399650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.399651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.399657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.399671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.399675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.399679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.399684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.399688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.399692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.399696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.399701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.399705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.399709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.399713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.399717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.399724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.399733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.399739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.399745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.399748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.399753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.399757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.399762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.399768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.399774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.399780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.399786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.399791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.399796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.399801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.399806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.399811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.399821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.399826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.399831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.399836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.399841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.399846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.399851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.399861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.399866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.399907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:12.402257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:12.402566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:12.402577Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:12.402580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:12.402583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:12.402589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1934 [2:7559601883737437067:4823]
2025-10-10T14:36:12.402600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:12.402616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:12.402619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.402623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.402625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.402641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:12.402650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:12.402658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:12.402714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.402722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.402724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.402726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:12.402794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:12.402803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.402815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.402826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.402844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:12.402864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666506:5827], now have 1 active actors on pipe
2025-10-10T14:36:12.402872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666246:2438], now have 1 active actors on pipe
2025-10-10T14:36:12.402879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601883737437062:4823]
2025-10-10T14:36:12.402882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601883737437062:4823]
2025-10-10T14:36:12.402884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601883737437062:4823]
2025-10-10T14:36:12.402896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:12.402909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:12.402912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:12.402914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:12.402914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:12.402930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:12.402938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:12.402934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1934
2025-10-10T14:36:12.402960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601883737437062:4823]
2025-10-10T14:36:12.402934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1934
2025-10-10T14:36:12.402967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:12.402973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:12.402990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.402999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.403039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|913a860c-28639166-43b022c0-82a57724_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:12.403051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.403055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.403057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:12.403067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.403077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:12.403097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.403260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.403268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.403282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.403388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1935 partition: 0 MaxSeqNo: 40 sessionId: src_id|913a860c-28639166-43b022c0-82a57724_0
2025-10-10T14:36:12.403823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cfe21a-f6796cd7-db810715-7eadff44_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|913a860c-28639166-43b022c0-82a57724_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:12.406630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|913a860c-28639166-43b022c0-82a57724_0] Write session: try to update token
2025-10-10T14:36:12.406650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|913a860c-28639166-43b022c0-82a57724_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:12.421376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId: src_id|913a860c-28639166-43b022c0-82a57724_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:12.423366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:12.423386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:12.423390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:12.423392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:12.423403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601883737437062:4823]
2025-10-10T14:36:12.423408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601883737437062:4823]
2025-10-10T14:36:12.423414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601883737437062:4823]
2025-10-10T14:36:12.423470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:12.423477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:12.423484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:12.423486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.423489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:12.423492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:12.423679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:12.424782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:12.475102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601884519666520:6092]
2025-10-10T14:36:12.475422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1934, pipe: [1:7559601884519666520:6092]
2025-10-10T14:36:12.540089Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:12.540800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.540814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.540875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666520:6092], now have 1 active actors on pipe
2025-10-10T14:36:12.541142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:12.541729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:12.541743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601884519666520:6092]
2025-10-10T14:36:12.541766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:12.541826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1935 reason: status is not ok: tablet will be restarted right now sessionId: src_id|913a860c-28639166-43b022c0-82a57724_0
2025-10-10T14:36:12.542050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1935 sessionId: src_id|913a860c-28639166-43b022c0-82a57724_0 is DEAD
2025-10-10T14:36:12.542242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913a860c-28639166-43b022c0-82a57724_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:12.542253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913a860c-28639166-43b022c0-82a57724_0] Write session will restart in 0.008078s
2025-10-10T14:36:12.542280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913a860c-28639166-43b022c0-82a57724_0] Write session: Do CDS request
2025-10-10T14:36:12.542287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913a860c-28639166-43b022c0-82a57724_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:12.557877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|913a860c-28639166-43b022c0-82a57724_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.561500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:12.561525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1936
2025-10-10T14:36:12.566466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.566530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:12.566536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:12.566541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:12.567061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1936 sessionId:  describe result for acl check
2025-10-10T14:36:12.567097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:12.567098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:12.567100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:12.567108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601884519666747:5822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:12.567661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601884519666747:5822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:12.570174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601884519666747:5822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:12.570732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:12.573318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:12.573584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:12.573590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:12.573604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:12.573664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:12.573704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601883737437336:4814]
2025-10-10T14:36:12.574354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:12.575202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601884519666747:5822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:12.575220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601884519666747:5822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:12.575224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601884519666747:5822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:12.575234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:12.574771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:12.574816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:12.575145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:12.575199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.575200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.575202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.575203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.575205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.575207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.575208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.575209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.575211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.575212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.575214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.575215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.575216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.575222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.575236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.575241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.575246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.575250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.575255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.575259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.575264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.575268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.575273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.575278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.575282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.575286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.575295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.575304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.575311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.575317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.575322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.575328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.575333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.575339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.575344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.575349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.575354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.575360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.575365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.575371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.575376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.575381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.575387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.575393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.575398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.575405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.575410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.575415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.575419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.575425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.575430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.575436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.575494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:12.578052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:12.578404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:12.578410Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:12.578413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:12.578817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1935
2025-10-10T14:36:12.578416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:12.578848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1935
2025-10-10T14:36:12.578422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1935 [2:7559601883737437336:4814]
2025-10-10T14:36:12.578435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:12.578452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:12.578455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.578459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.578461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.578480Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:12.578487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:12.578494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:12.578554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.578557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.578558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.578561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:12.578634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:12.578637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.578647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.578658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.578674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:12.578694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601883737437331:4814]
2025-10-10T14:36:12.578696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601883737437331:4814]
2025-10-10T14:36:12.578699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601883737437331:4814]
2025-10-10T14:36:12.578707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:12.578717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:12.578721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:12.578721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:12.578723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:12.578736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:12.578740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:12.578751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666522:2438], now have 1 active actors on pipe
2025-10-10T14:36:12.578754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666788:5822], now have 1 active actors on pipe
2025-10-10T14:36:12.578775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601883737437331:4814]
2025-10-10T14:36:12.578784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:12.578917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:12.579396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.579407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.579444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:12.579455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.579459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.579461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:12.579474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.579486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:12.579503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.582292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.582304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.582338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.582917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|913a860c-28639166-43b022c0-82a57724_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:12.582520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1936 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0
2025-10-10T14:36:12.585604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0] Write session: try to update token
2025-10-10T14:36:12.585622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:12.602178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:12.602198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:12.602201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:12.602204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:12.602215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601883737437331:4814]
2025-10-10T14:36:12.602224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601883737437331:4814]
2025-10-10T14:36:12.602228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601883737437331:4814]
2025-10-10T14:36:12.602283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:12.602291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.602294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:12.602436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:12.603231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:12.603252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:12.603264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:12.606309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId: src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:12.609264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:12.642020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601884519666797:6092]
2025-10-10T14:36:12.642406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1935, pipe: [1:7559601884519666797:6092]
2025-10-10T14:36:12.721323Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:12.721821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.721836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.721877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666797:6092], now have 1 active actors on pipe
2025-10-10T14:36:12.725578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:12.726497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:12.726509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0] Write session will restart in 0.009404s
2025-10-10T14:36:12.725986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:12.726040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:12.726536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0] Write session: Do CDS request
2025-10-10T14:36:12.726120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1936 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0
2025-10-10T14:36:12.726544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:12.726203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601884519666797:6092]
2025-10-10T14:36:12.726336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1936 sessionId: src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0 is DEAD
2025-10-10T14:36:12.736935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.737306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:12.737322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1937
2025-10-10T14:36:12.737600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.737639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:12.737645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:12.737649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:12.738420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1937 sessionId:  describe result for acl check
2025-10-10T14:36:12.738455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:12.738457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:12.738459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:12.738466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601884519666842:5813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:12.739103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601884519666842:5813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:12.743822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601884519666842:5813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:12.746758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601884519666842:5813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:12.746773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601884519666842:5813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:12.746777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601884519666842:5813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:12.746785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:12.751711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:12.754086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:12.754318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:12.754332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:12.754344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:12.754400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:12.754444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601883737437608:4808]
2025-10-10T14:36:12.755084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:12.755422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:12.755485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:12.755866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:12.755925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.755931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.755933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.755934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.755935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.755937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.755938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.755939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.755941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.755942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.755943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.755944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.755946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.755952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.755966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.755970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.755975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.755979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.755983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.755987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.755991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.755995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.756000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.756004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.756008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.756013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.756021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.756030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.756037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.756049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.756053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.756059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.756064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.756069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.756076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.756082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.756086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.756092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.756099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.756105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.756109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.756115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.756121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.756129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.756134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.756139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.756146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.756157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.756163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.756173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.756178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.756184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.756240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:12.759505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:12.759860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:12.759877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:12.759880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:12.759884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:12.759891Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1936 [2:7559601883737437608:4808]
2025-10-10T14:36:12.759905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:12.759929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:12.759937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.759941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.759943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.759961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:12.759975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:12.759983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:12.760061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.760069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.760071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.760074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:12.760154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:12.760163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.760177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.760193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.760216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:12.760306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1936
2025-10-10T14:36:12.760313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1936
2025-10-10T14:36:12.760239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519667022:5813], now have 1 active actors on pipe
2025-10-10T14:36:12.760248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519666804:2438], now have 1 active actors on pipe
2025-10-10T14:36:12.760256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601883737437603:4808]
2025-10-10T14:36:12.760259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601883737437603:4808]
2025-10-10T14:36:12.760262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601883737437603:4808]
2025-10-10T14:36:12.760276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:12.760293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:12.760311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:12.760313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:12.760315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:12.760318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:12.760320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:12.760344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601883737437603:4808]
2025-10-10T14:36:12.760348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:12.760349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:12.760392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.760397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.760428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2698284c-755c7d49-e792b7b8-4319babc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:12.760437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.760441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.760443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:12.760455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.760467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:12.760481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.760728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.760741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.760760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.760883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1937 partition: 0 MaxSeqNo: 40 sessionId: src_id|2698284c-755c7d49-e792b7b8-4319babc_0
2025-10-10T14:36:12.761590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3e40146-4c62438f-42c5749d-4d108fe4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2698284c-755c7d49-e792b7b8-4319babc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:12.764234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2698284c-755c7d49-e792b7b8-4319babc_0] Write session: try to update token
2025-10-10T14:36:12.764253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2698284c-755c7d49-e792b7b8-4319babc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:12.777693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:12.777713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:12.777725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601883737437603:4808]
2025-10-10T14:36:12.777781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:12.777785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:12.777971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:12.778122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:12.778290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:12.778425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:12.778639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:12.778690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:12.783286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId: src_id|2698284c-755c7d49-e792b7b8-4319babc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:12.785770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:12.786157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.786176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.786225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:12.786321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:12.791210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:12.791223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:12.791227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:12.791229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:12.791240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601883737437603:4808]
2025-10-10T14:36:12.791244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601883737437603:4808]
2025-10-10T14:36:12.791247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601883737437603:4808]
2025-10-10T14:36:12.791294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:12.791300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:12.791306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.791307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:12.791309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:12.791312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:12.791442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:12.826310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601884519667097:6092]
2025-10-10T14:36:12.832770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1936, pipe: [1:7559601884519667097:6092]
2025-10-10T14:36:12.913062Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:12.924958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.924985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.925217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.925285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.925488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.925569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.926240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.926256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.926349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.926426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.926510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.926594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.926655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.926663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.926750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.926833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.926917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.927000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.927059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.927062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.927150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.927230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.927307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.927384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.927440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.927443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.927534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.927605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.927683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.927764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.927819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.927822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.927915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.927986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.928068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.928154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.928214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.928217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.928306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.928382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.928464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.928540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.928596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.928599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.928687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.928761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.928838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.928925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.928987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.928990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.929100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.929174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.929493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.929580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.929646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.929659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.929753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:12.929831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:12.929913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:12.930469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:12.930480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601884519667097:6092]
2025-10-10T14:36:12.930521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:12.930535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:12.930575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1937 reason: error at write: Disconnected sessionId: src_id|2698284c-755c7d49-e792b7b8-4319babc_0
2025-10-10T14:36:12.930821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1937 sessionId: src_id|2698284c-755c7d49-e792b7b8-4319babc_0 is DEAD
2025-10-10T14:36:12.930961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2698284c-755c7d49-e792b7b8-4319babc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:12.930983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2698284c-755c7d49-e792b7b8-4319babc_0] Write session will restart in 0.008909s
2025-10-10T14:36:12.931008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2698284c-755c7d49-e792b7b8-4319babc_0] Write session: Do CDS request
2025-10-10T14:36:12.931014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2698284c-755c7d49-e792b7b8-4319babc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:12.929994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:12.930057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:12.930060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:12.930151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519667097:6092], now have 1 active actors on pipe
2025-10-10T14:36:12.931906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:12.940902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2698284c-755c7d49-e792b7b8-4319babc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.941053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:12.941068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1938
2025-10-10T14:36:12.941197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:12.941233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:12.941243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:12.941247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:12.941875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1938 sessionId:  describe result for acl check
2025-10-10T14:36:12.941915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:12.941924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:12.941926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:12.941933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601884519667163:5788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:12.942495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601884519667163:5788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:12.945513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601884519667163:5788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:12.949633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601884519667163:5788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:12.949649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601884519667163:5788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:12.949653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601884519667163:5788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:12.949663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:12.955205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:12.956128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:12.956419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:12.956433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:12.956444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:12.956494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:12.956529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601883737437933:4783]
2025-10-10T14:36:12.957048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:12.958486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:12.958551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:12.958955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:12.959026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.959034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.959035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.959037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.959038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.959040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.959041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.959043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.959044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.959046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.959048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.959049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.959051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.959058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.959072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.959077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.959082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.959087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.959092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.959096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.959101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.959105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.959110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.959114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.959118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.959122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.959132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.959141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:12.959149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.959155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:12.959160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.959167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:12.959172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.959179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:12.959185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.959191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:12.959196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.959202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:12.959207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.959214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:12.959222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.959228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:12.959233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.959239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:12.959243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.959249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:12.959255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.959261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.959266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.959272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.959277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.959283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.959328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:12.962617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:12.963483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:12.963501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:12.963506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:12.963511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:12.963520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1937 [2:7559601883737437933:4783]
2025-10-10T14:36:12.963538Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:12.963560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:12.963565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.963568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.963571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.963592Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:12.963608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:12.963617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:12.963697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.963708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.963712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.963715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:12.963807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:12.963818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.963832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:12.963843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:12.963862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:12.963889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519667358:5788], now have 1 active actors on pipe
2025-10-10T14:36:12.963900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601884519667124:2438], now have 1 active actors on pipe
2025-10-10T14:36:12.963908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601883737437928:4783]
2025-10-10T14:36:12.963911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601883737437928:4783]
2025-10-10T14:36:12.963914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601883737437928:4783]
2025-10-10T14:36:12.963936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:12.963922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1937
2025-10-10T14:36:12.963958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:12.963926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1937
2025-10-10T14:36:12.963982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:12.963983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:12.963987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:12.963989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:12.963992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:12.964049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.964060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.964080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601883737437928:4783]
2025-10-10T14:36:12.964097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:12.964112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:12.964134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|815fe829-3f54c343-481de732-491166c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:12.964146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:12.964151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:12.964154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:12.964164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:12.964176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:12.964208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.964542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.964553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.964572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:12.964676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1938 partition: 0 MaxSeqNo: 40 sessionId: src_id|815fe829-3f54c343-481de732-491166c0_0
2025-10-10T14:36:12.965084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2698284c-755c7d49-e792b7b8-4319babc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|815fe829-3f54c343-481de732-491166c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:12.967773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815fe829-3f54c343-481de732-491166c0_0] Write session: try to update token
2025-10-10T14:36:12.967792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815fe829-3f54c343-481de732-491166c0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:12.982311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId: src_id|815fe829-3f54c343-481de732-491166c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:12.984830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:12.985080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:12.985113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:12.985164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:12.985284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:12.993928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:12.993948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:12.993952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:12.993955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:12.993968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601883737437928:4783]
2025-10-10T14:36:12.993974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601883737437928:4783]
2025-10-10T14:36:12.993980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601883737437928:4783]
2025-10-10T14:36:12.994049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:12.994047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:12.994061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:12.994067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:12.994068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:12.994071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:12.994253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:13.030623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601888814634696:6092]
2025-10-10T14:36:13.033706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1937, pipe: [1:7559601888814634696:6092]
2025-10-10T14:36:13.115817Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:13.124795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.124829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.125034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.125111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.125180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.125252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.125615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.125629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.125712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.125788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.125858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.125930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.125976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.125979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.126055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.126122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.126186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.126253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.126295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.126299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.126374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.126434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.126495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.126555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.126597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.126600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.126682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.126741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.126805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.126869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.126916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.126919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.126993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.127056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.127118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.127182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.127227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.127232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.127310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.127376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.127452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.127521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.127586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.127589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.127661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.127717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.127780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.127842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.127884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.127886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.127956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.128012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.128068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.128126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.128171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.128174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.128241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.128299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.128360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.128430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.128470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.128473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.128581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814634696:6092], now have 1 active actors on pipe
2025-10-10T14:36:13.128921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601888814634696:6092]
2025-10-10T14:36:13.128969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:13.128972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:13.129002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1938 reason: error at write: Disconnected sessionId: src_id|815fe829-3f54c343-481de732-491166c0_0
2025-10-10T14:36:13.129235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1938 sessionId: src_id|815fe829-3f54c343-481de732-491166c0_0 is DEAD
2025-10-10T14:36:13.129240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:13.129579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815fe829-3f54c343-481de732-491166c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:13.129598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815fe829-3f54c343-481de732-491166c0_0] Write session will restart in 0.005581s
2025-10-10T14:36:13.129624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815fe829-3f54c343-481de732-491166c0_0] Write session: Do CDS request
2025-10-10T14:36:13.129631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815fe829-3f54c343-481de732-491166c0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:13.129216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:13.137076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|815fe829-3f54c343-481de732-491166c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.137106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:13.137120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1939
2025-10-10T14:36:13.137372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.137413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:13.137420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:13.137429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:13.137893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1939 sessionId:  describe result for acl check
2025-10-10T14:36:13.137926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:13.137927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:13.137929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:13.137935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601888814634709:5779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:13.138587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601888814634709:5779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:13.141590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601888814634709:5779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:13.145953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601888814634709:5779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:13.145969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601888814634709:5779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:13.145973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601888814634709:5779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:13.145982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:13.159296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:13.162056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:13.162370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:13.162383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:13.162399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:13.162478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:13.162531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601888032405503:4781]
2025-10-10T14:36:13.163207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:13.163641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:13.163714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:13.164157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:13.164241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.164242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.164244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.164245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.164246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.164248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.164249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.164250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.164252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.164253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.164254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.164256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.164257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.164265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.164279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.164284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.164289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.164293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.164299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.164302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.164306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.164311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.164316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.164321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.164325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.164329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.164338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.164369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.164378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.164384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.164388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.164394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.164400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.164405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.164411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.164416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.164422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.164427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.164433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.164448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.164452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.164458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.164464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.164472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.164476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.164482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.164487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.164493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.164498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.164503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.164508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.164514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.164558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:13.167185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:13.167930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:13.167945Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:13.167949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:13.167953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:13.167960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1938 [2:7559601888032405503:4781]
2025-10-10T14:36:13.167975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:13.167996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:13.168000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.168004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.168007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.168025Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:13.168034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:13.168042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:13.168109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.168119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.168121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.168124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:13.168203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:13.168206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.168220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.168232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.168375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1938
2025-10-10T14:36:13.168250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:13.168377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1938
2025-10-10T14:36:13.168274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814634794:5779], now have 1 active actors on pipe
2025-10-10T14:36:13.168278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814634697:2438], now have 1 active actors on pipe
2025-10-10T14:36:13.168286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601888032405498:4781]
2025-10-10T14:36:13.168289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601888032405498:4781]
2025-10-10T14:36:13.168291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601888032405498:4781]
2025-10-10T14:36:13.168308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:13.168327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:13.168331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:13.168335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:13.168338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:13.168345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:13.168349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:13.168385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601888032405498:4781]
2025-10-10T14:36:13.168393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:13.168399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:13.168604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.168611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.168646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b79c91c-b4331109-4f21223a-31fe2138_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:13.168656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.168662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.168664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:13.168678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.168701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:13.168718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.168927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.168934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.168959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.169068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1939 partition: 0 MaxSeqNo: 40 sessionId: src_id|9b79c91c-b4331109-4f21223a-31fe2138_0
2025-10-10T14:36:13.169488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|815fe829-3f54c343-481de732-491166c0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9b79c91c-b4331109-4f21223a-31fe2138_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:13.172205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b79c91c-b4331109-4f21223a-31fe2138_0] Write session: try to update token
2025-10-10T14:36:13.172225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b79c91c-b4331109-4f21223a-31fe2138_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:13.181048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:13.181067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.181079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601888032405498:4781]
2025-10-10T14:36:13.181134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:13.181314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:13.181471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.181611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.181747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.181969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:13.182007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:13.182123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:13.188234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId: src_id|9b79c91c-b4331109-4f21223a-31fe2138_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:13.190978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:13.191406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.191428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.191471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:13.191552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:13.200716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:13.200739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.200744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:13.200746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:13.200757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601888032405498:4781]
2025-10-10T14:36:13.200762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601888032405498:4781]
2025-10-10T14:36:13.200767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601888032405498:4781]
2025-10-10T14:36:13.200824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:13.200824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:13.200831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:13.200835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:13.200839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.200842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:13.201000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:13.229299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601888814634975:6092]
2025-10-10T14:36:13.234142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1938, pipe: [1:7559601888814634975:6092]
2025-10-10T14:36:13.318200Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:13.327376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.327405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.327589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.327651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.327721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.327790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.327835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.327841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.327935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.327996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.328064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.328133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.328182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.328189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.328263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.328324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.328389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.328457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.328505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.328513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.328625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.328693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.328757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.328822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.328863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.328866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.328938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.328997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.329075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.329138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.329177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.329181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.329252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.329306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.329396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.329461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.329510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.329514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.329583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.329649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.329722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.329786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.329836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.329845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.329918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.329976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.330040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.330106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.330152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.330159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.330226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.330287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.330349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.330411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.330458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.330464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.330530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.330590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.330655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.330718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.330762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.330769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.330841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814634975:6092], now have 1 active actors on pipe
2025-10-10T14:36:13.331311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:13.331326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:13.331361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1939 reason: error at write: Disconnected sessionId: src_id|9b79c91c-b4331109-4f21223a-31fe2138_0
2025-10-10T14:36:13.331616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1939 sessionId: src_id|9b79c91c-b4331109-4f21223a-31fe2138_0 is DEAD
2025-10-10T14:36:13.331635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:13.331698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b79c91c-b4331109-4f21223a-31fe2138_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:13.331712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b79c91c-b4331109-4f21223a-31fe2138_0] Write session will restart in 0.008572s
2025-10-10T14:36:13.331691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601888814634975:6092]
2025-10-10T14:36:13.331742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b79c91c-b4331109-4f21223a-31fe2138_0] Write session: Do CDS request
2025-10-10T14:36:13.331748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b79c91c-b4331109-4f21223a-31fe2138_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:13.331984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:13.341900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b79c91c-b4331109-4f21223a-31fe2138_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.342067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:13.342082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1940
2025-10-10T14:36:13.342271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.342304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:13.342310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:13.342314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:13.342782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1940 sessionId:  describe result for acl check
2025-10-10T14:36:13.342828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:13.342830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:13.342832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:13.342839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601888814635005:5783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:13.343391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601888814635005:5783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:13.347359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601888814635005:5783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:13.352279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601888814635005:5783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:13.352295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601888814635005:5783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:13.352299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601888814635005:5783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:13.352308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:13.358116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:13.364630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:13.364924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:13.364952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:13.364971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:13.365064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:13.365112Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601888032405778:4775]
2025-10-10T14:36:13.365821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:13.366301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:13.366395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:13.366890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:13.366962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.366970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.366971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.366972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.366973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.366975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.366976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.366977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.366979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.366980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.366981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.366983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.366984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.366991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.367007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.367011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.367015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.367019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.367023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.367026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.367030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.367035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.367040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.367044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.367048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.367053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.367062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.367071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.367078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.367084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.367089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.367094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.367100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.367106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.367111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.367116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.367121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.367128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.367133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.367139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.367143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.367149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.367154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.367161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.367166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.367172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.367184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.367191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.367200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.367205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.367210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.367217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.367258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:13.371196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1939
2025-10-10T14:36:13.371203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1939
2025-10-10T14:36:13.370358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:13.370692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:13.370697Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:13.370701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:13.370705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:13.370714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1939 [2:7559601888032405778:4775]
2025-10-10T14:36:13.370729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:13.370750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:13.370754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.370758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.370761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.370780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:13.370788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:13.370797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:13.370874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.370876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.370878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.370880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:13.371312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:13.371316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.371329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.371339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.371357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:13.371382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635178:5783], now have 1 active actors on pipe
2025-10-10T14:36:13.371386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814634978:2438], now have 1 active actors on pipe
2025-10-10T14:36:13.371404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.371409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.371433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601888032405773:4775]
2025-10-10T14:36:13.371436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601888032405773:4775]
2025-10-10T14:36:13.371437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601888032405773:4775]
2025-10-10T14:36:13.371455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:13.371468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:13.371470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:13.371472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:13.371474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:13.371487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:13.371491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:13.371512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:13.371520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.371524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.371526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:13.371537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.371549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:13.371596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601888032405773:4775]
2025-10-10T14:36:13.371606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:13.371619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.371653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:13.372279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.372288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.372306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.372390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1940 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0
2025-10-10T14:36:13.372791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b79c91c-b4331109-4f21223a-31fe2138_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:13.375641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0] Write session: try to update token
2025-10-10T14:36:13.375663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:13.384709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:13.384735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.384752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601888032405773:4775]
2025-10-10T14:36:13.384807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:13.384822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:13.385167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:13.385423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.385607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.385772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.386015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:13.386059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:13.391765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId: src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:13.394527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:13.394774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.394793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.394834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:13.394949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:13.403511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:13.403529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.403532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:13.403534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:13.403546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601888032405773:4775]
2025-10-10T14:36:13.403549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601888032405773:4775]
2025-10-10T14:36:13.403553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601888032405773:4775]
2025-10-10T14:36:13.403603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:13.403615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.403618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:13.403653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:13.403669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:13.403673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:13.403752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:13.432069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601888814635256:6092]
2025-10-10T14:36:13.432441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1939, pipe: [1:7559601888814635256:6092]
2025-10-10T14:36:13.520724Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:13.528123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.528145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.528320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.528380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.528437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.528492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.528534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.528543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.528605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.528661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.528720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.528779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.528826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.528832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.528892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.528951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.529027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.529356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.529778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.529792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.529868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.529928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.529986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.530058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.530102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.530108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.530204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.530268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.530328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.530387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.530431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.530441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.530510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.530569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.530627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.530684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.530727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.530735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.530814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.530870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.530933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.530993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.531109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.531116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.531182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.531238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.531306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.531380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.531429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.531437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.531511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.531588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.531660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.531731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.531778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.531789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.531856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.531923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.531988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.532054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.532098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.532105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.532172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635256:6092], now have 1 active actors on pipe
2025-10-10T14:36:13.532885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:13.532953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:13.532971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:13.533020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1940 reason: error at write: Disconnected sessionId: src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0
2025-10-10T14:36:13.533229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1940 sessionId: src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0 is DEAD
2025-10-10T14:36:13.533407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601888814635256:6092]
2025-10-10T14:36:13.533431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:13.537247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:13.537262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0] Write session will restart in 0.008679s
2025-10-10T14:36:13.537288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0] Write session: Do CDS request
2025-10-10T14:36:13.537294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:13.546914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.549653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:13.549670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1941
2025-10-10T14:36:13.549861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.549899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:13.549905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:13.549910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:13.550669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1941 sessionId:  describe result for acl check
2025-10-10T14:36:13.550710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:13.550713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:13.550715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:13.550732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601888814635323:5770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:13.551369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601888814635323:5770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:13.554489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601888814635323:5770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:13.557967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601888814635323:5770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:13.557982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601888814635323:5770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:13.557986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601888814635323:5770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:13.557997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:13.561441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:13.564307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:13.564593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:13.564605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:13.564620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:13.564688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:13.564740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601888032406056:4770]
2025-10-10T14:36:13.565440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:13.566033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:13.566093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:13.566447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:13.566514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.566515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.566517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.566518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.566520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.566521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.566522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.566523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.566525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.566526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.566527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.566529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.566530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.566537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.566551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.566556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.566559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.566564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.566569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.566573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.566577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.566582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.566586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.566591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.566595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.566598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.566608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.566619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.566626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.566632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.566636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.566642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.566647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.566653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.566657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.566662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.566667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.566673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.566678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.566700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.566705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.566711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.566717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.566723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.566727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.566733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.566737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.566742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.566747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.566752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.566757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.566763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.566806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:13.570547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:13.571054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:13.571068Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:13.571070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:13.571075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:13.571082Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1940 [2:7559601888032406056:4770]
2025-10-10T14:36:13.571096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:13.571114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:13.571118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.571122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.571125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.571143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:13.571156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:13.571164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:13.571245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.571254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.571256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.571259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:13.571332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:13.571340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.571354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.571372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.571483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1940
2025-10-10T14:36:13.571500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1940
2025-10-10T14:36:13.571390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:13.571419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635497:5770], now have 1 active actors on pipe
2025-10-10T14:36:13.571423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635259:2438], now have 1 active actors on pipe
2025-10-10T14:36:13.571431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601888032406051:4770]
2025-10-10T14:36:13.571434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601888032406051:4770]
2025-10-10T14:36:13.571436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601888032406051:4770]
2025-10-10T14:36:13.571451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:13.571466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:13.571484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:13.571488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:13.571517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601888032406051:4770]
2025-10-10T14:36:13.571520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:13.571560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:13.571563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:13.571565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:13.571572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:13.571735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.571752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.571785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffbc6a47-68040873-e741f222-de81c7a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:13.571800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.571804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.571807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:13.571821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.571832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:13.571853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.572262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.572271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.572303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.572486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1941 partition: 0 MaxSeqNo: 40 sessionId: src_id|ffbc6a47-68040873-e741f222-de81c7a1_0
2025-10-10T14:36:13.573072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ba1dc8-f0121a4-704786e2-2b1c2ea7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ffbc6a47-68040873-e741f222-de81c7a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:13.575855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbc6a47-68040873-e741f222-de81c7a1_0] Write session: try to update token
2025-10-10T14:36:13.575872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbc6a47-68040873-e741f222-de81c7a1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:13.584268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:13.584286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.584306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601888032406051:4770]
2025-10-10T14:36:13.584358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:13.584370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:13.584536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:13.584676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.584812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.584944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.585149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:13.585189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:13.594905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId: src_id|ffbc6a47-68040873-e741f222-de81c7a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:13.597570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:13.597826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.597848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.597892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:13.597990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:13.604236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:13.604252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.604256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:13.604258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:13.604270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601888032406051:4770]
2025-10-10T14:36:13.604275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601888032406051:4770]
2025-10-10T14:36:13.604278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601888032406051:4770]
2025-10-10T14:36:13.604331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:13.604331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:13.604338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:13.604342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:13.604344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.604349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:13.604492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:13.633746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601888814635538:6092]
2025-10-10T14:36:13.634071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1940, pipe: [1:7559601888814635538:6092]
2025-10-10T14:36:13.721263Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:13.729991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.730025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.730219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.730288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.730356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.730430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.730476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.730487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.730567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.730631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.730702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.730774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.730821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.730829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.730899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.730968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.731041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.731111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.731158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.731171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.731246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.731310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.731379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.731450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.731495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.731502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.731573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.731645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.731716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.731789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.731836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.731844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.731918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.731984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.732054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.732124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.732171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.732179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.732249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.732320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.732390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.732459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.732511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.732519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.732591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.732657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.732729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.732798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.732843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.732851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.732923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.733006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.733075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.733145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.733189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.733197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.733266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.733351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.733427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.733494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.733534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.733537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.733624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635538:6092], now have 1 active actors on pipe
2025-10-10T14:36:13.734476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbc6a47-68040873-e741f222-de81c7a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:13.734491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbc6a47-68040873-e741f222-de81c7a1_0] Write session will restart in 0.009712s
2025-10-10T14:36:13.733967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601888814635538:6092]
2025-10-10T14:36:13.734003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:13.734048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:13.734051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:13.734081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1941 reason: error at write: Disconnected sessionId: src_id|ffbc6a47-68040873-e741f222-de81c7a1_0
2025-10-10T14:36:13.734304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1941 sessionId: src_id|ffbc6a47-68040873-e741f222-de81c7a1_0 is DEAD
2025-10-10T14:36:13.734530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbc6a47-68040873-e741f222-de81c7a1_0] Write session: Do CDS request
2025-10-10T14:36:13.734538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbc6a47-68040873-e741f222-de81c7a1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:13.734837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:13.748409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbc6a47-68040873-e741f222-de81c7a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.748781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:13.748796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1942
2025-10-10T14:36:13.748936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.748971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:13.748983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:13.748987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:13.749534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1942 sessionId:  describe result for acl check
2025-10-10T14:36:13.749572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:13.749579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:13.749581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:13.749588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601888814635623:5768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:13.750214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601888814635623:5768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:13.758371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601888814635623:5768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:13.760907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:13.763853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:13.764113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:13.764136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:13.764151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:13.764219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:13.764215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601888814635623:5768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:13.764230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601888814635623:5768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:13.764234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601888814635623:5768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:13.764244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:13.764269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601888032406332:4765]
2025-10-10T14:36:13.764918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:13.765214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:13.765265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:13.765627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:13.765699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.765706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.765707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.765707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.765709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.765710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.765711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.765712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.765714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.765715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.765716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.765717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.765718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.765724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.765739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.765743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.765747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.765750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.765755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.765758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.765762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.765767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.765771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.765774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.765778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.765781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.765790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.765799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.765805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.765810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.765815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.765821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.765826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.765831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.765836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.765841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.765846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.765851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.765856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.765862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.765866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.765871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.765877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.765882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.765886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.765892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.765898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.765914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.765918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.765924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.765928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.765943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.765980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:13.769864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1941
2025-10-10T14:36:13.769890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1941
2025-10-10T14:36:13.770545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1942 partition: 0 MaxSeqNo: 40 sessionId: src_id|825b8b92-9ddf5397-73567f07-23d297bb_0
2025-10-10T14:36:13.770965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffbc6a47-68040873-e741f222-de81c7a1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|825b8b92-9ddf5397-73567f07-23d297bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:13.768930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:13.769466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:13.769471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:13.769474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:13.769478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:13.769485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1941 [2:7559601888032406332:4765]
2025-10-10T14:36:13.769498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:13.769519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:13.769522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.769526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.769529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.769547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:13.769554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:13.769562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:13.769620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.769622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.769624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.769627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:13.769695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:13.769698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.769710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.769720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.769736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:13.769760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635817:5768], now have 1 active actors on pipe
2025-10-10T14:36:13.769763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635546:2438], now have 1 active actors on pipe
2025-10-10T14:36:13.769771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601888032406327:4765]
2025-10-10T14:36:13.769774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601888032406327:4765]
2025-10-10T14:36:13.769777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601888032406327:4765]
2025-10-10T14:36:13.769793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:13.769806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:13.769810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:13.769813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:13.769816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:13.769821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:13.769824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:13.769849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601888032406327:4765]
2025-10-10T14:36:13.769856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:13.769861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:13.770038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.770046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.770081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|825b8b92-9ddf5397-73567f07-23d297bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:13.770090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.770094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.770097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:13.770109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.770121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:13.770149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.770397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.770403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.770421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.773903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825b8b92-9ddf5397-73567f07-23d297bb_0] Write session: try to update token
2025-10-10T14:36:13.773924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825b8b92-9ddf5397-73567f07-23d297bb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:13.781997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:13.782012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.782023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601888032406327:4765]
2025-10-10T14:36:13.782066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:13.782129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:13.782248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:13.782399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.782555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.782707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:13.782939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:13.783001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:13.790507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId: src_id|825b8b92-9ddf5397-73567f07-23d297bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:13.793432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:13.793707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.793742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.793800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:13.793900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:13.803530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:13.803545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.803548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:13.803550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:13.803561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601888032406327:4765]
2025-10-10T14:36:13.803565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601888032406327:4765]
2025-10-10T14:36:13.803568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601888032406327:4765]
2025-10-10T14:36:13.803616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:13.803623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.803625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:13.803679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:13.803687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:13.803692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:13.803757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:13.833948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601888814635830:6092]
2025-10-10T14:36:13.834497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1941, pipe: [1:7559601888814635830:6092]
2025-10-10T14:36:13.921812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:13.931182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.931206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.931358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.931417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.931475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.931538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.931590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.931604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.931677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.931731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.931787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.931853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.931896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.931899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.931973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.932028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.932094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.932159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.932202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.932205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.932274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.932330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.932390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.932451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.932490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.932493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.932562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.932623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.932686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.932743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.932783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.932785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.932851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.932910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.932966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.933038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.933076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.933078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.933146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.933206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.933265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.933321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.933523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.933535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.933607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.933677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.933744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.935978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825b8b92-9ddf5397-73567f07-23d297bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:13.935993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825b8b92-9ddf5397-73567f07-23d297bb_0] Write session will restart in 0.008480s
2025-10-10T14:36:13.936018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825b8b92-9ddf5397-73567f07-23d297bb_0] Write session: Do CDS request
2025-10-10T14:36:13.936024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825b8b92-9ddf5397-73567f07-23d297bb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:13.933809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.933852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.933854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.933929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.933986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.934048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.934107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.934153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.934156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.934224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:13.934282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:13.934342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:13.934409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:13.934452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:13.934455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:13.935170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635830:6092], now have 1 active actors on pipe
2025-10-10T14:36:13.936280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:13.935560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:13.935572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:13.935602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1942 reason: error at write: Disconnected sessionId: src_id|825b8b92-9ddf5397-73567f07-23d297bb_0
2025-10-10T14:36:13.935872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1942 sessionId: src_id|825b8b92-9ddf5397-73567f07-23d297bb_0 is DEAD
2025-10-10T14:36:13.936001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601888814635830:6092]
2025-10-10T14:36:13.936018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:13.945943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|825b8b92-9ddf5397-73567f07-23d297bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.946025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:13.946041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1943
2025-10-10T14:36:13.946169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:13.946204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:13.946214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:13.946218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:13.946711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1943 sessionId:  describe result for acl check
2025-10-10T14:36:13.946746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:13.946752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:13.946754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:13.946761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601888814635886:5755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:13.947339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601888814635886:5755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:13.950019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601888814635886:5755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:13.954413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601888814635886:5755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:13.954429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601888814635886:5755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:13.954433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601888814635886:5755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:13.954442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:13.966335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:13.969765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:13.969991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:13.970004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:13.970016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:13.970081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:13.970137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601888032406664:4743]
2025-10-10T14:36:13.970902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:13.971290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:13.971322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:13.971549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:13.971606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.971608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.971609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.971609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.971610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.971611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.971612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.971613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.971613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.971614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.971615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.971616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.971616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.971620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.971630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.971633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.971635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.971637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.971639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.971642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.971644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.971646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.971648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.971650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.971653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.971655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.971663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.971668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:13.971672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.971676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:13.971679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.971682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:13.971684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.971688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:13.971691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.971694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:13.971697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.971700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:13.971703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.971707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:13.971709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.971712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:13.971715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.971718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:13.971722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.971725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:13.971728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.971731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.971733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.971736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.971739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.971742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.971767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:13.975527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1942
2025-10-10T14:36:13.975546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1942
2025-10-10T14:36:13.974525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:13.975050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:13.975055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:13.975058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:13.975063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:13.975070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1942 [2:7559601888032406664:4743]
2025-10-10T14:36:13.975086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:13.975105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:13.975108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.975112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.975114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.975132Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:13.975140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:13.975149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:13.975211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.975213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.975215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.975217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:13.975311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:13.975315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.975327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:13.975339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:13.975354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:13.975377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601888032406658:4743]
2025-10-10T14:36:13.975380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601888032406658:4743]
2025-10-10T14:36:13.975382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601888032406658:4743]
2025-10-10T14:36:13.975396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:13.975412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635996:5755], now have 1 active actors on pipe
2025-10-10T14:36:13.975415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601888814635870:2438], now have 1 active actors on pipe
2025-10-10T14:36:13.975424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:13.975441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:13.975445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:13.975472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601888032406658:4743]
2025-10-10T14:36:13.975475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:13.975786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:13.975803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:13.975805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:13.975805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.975812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.975812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:13.975847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:13.975856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:13.975861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:13.975863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:13.975878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:13.975890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:13.975907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.976253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:13.976260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:13.976280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:13.976382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1943 partition: 0 MaxSeqNo: 40 sessionId: src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0
2025-10-10T14:36:13.976790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|825b8b92-9ddf5397-73567f07-23d297bb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:13.979562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0] Write session: try to update token
2025-10-10T14:36:13.979581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:13.996507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:13.996529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:13.996533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:13.996535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:13.996546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601888032406658:4743]
2025-10-10T14:36:13.996551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601888032406658:4743]
2025-10-10T14:36:13.996558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601888032406658:4743]
2025-10-10T14:36:13.996613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:13.996628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:13.996630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:13.996776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:13.998537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId: src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:13.999483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:13.999500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:13.999505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:14.001206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:14.036185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601893109603446:6092]
2025-10-10T14:36:14.036598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1942, pipe: [1:7559601893109603446:6092]
2025-10-10T14:36:14.113599Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:14.114310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.114332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.114382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109603446:6092], now have 1 active actors on pipe
2025-10-10T14:36:14.115264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:14.115287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601893109603446:6092]
2025-10-10T14:36:14.115326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:14.115329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:14.115403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1943 reason: error at write: Disconnected sessionId: src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0
2025-10-10T14:36:14.115600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1943 sessionId: src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0 is DEAD
2025-10-10T14:36:14.115337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:14.115972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:14.115981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0] Write session will restart in 0.008972s
2025-10-10T14:36:14.116006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0] Write session: Do CDS request
2025-10-10T14:36:14.116015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:14.125896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.125982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:14.125999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1944
2025-10-10T14:36:14.126147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.126186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:14.126197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:14.126201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:14.126685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1944 sessionId:  describe result for acl check
2025-10-10T14:36:14.126733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:14.126744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:14.126748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:14.126754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601893109603461:5751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:14.127316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601893109603461:5751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:14.129478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601893109603461:5751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:14.135348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601893109603461:5751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:14.135368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601893109603461:5751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:14.135372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601893109603461:5751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:14.135383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:14.142685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:14.146249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:14.146509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:14.146526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:14.146541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:14.146630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:14.146679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601892327374239:4739]
2025-10-10T14:36:14.147322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:14.147693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:14.147766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:14.148126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:14.148192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.148193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.148195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.148196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.148197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.148198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.148200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.148201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.148202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.148203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.148204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.148205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.148206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.148213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.148226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.148231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.148235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.148239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.148243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.148247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.148251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.148254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.148259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.148263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.148267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.148270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.148280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.148289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.148297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.148303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.148308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.148314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.148322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.148328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.148334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.148339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.148344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.148350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.148354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.148360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.148365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.148371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.148376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.148382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.148388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.148394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.148397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.148402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.148420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.148427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.148433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.148449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.148492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:14.151087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:14.151412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:14.151424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:14.151427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:14.151432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:14.151439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1943 [2:7559601892327374239:4739]
2025-10-10T14:36:14.151453Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:14.151473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:14.151476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.151480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.151482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.151502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:14.151516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:14.151532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:14.151599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.151606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.151608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.151611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:14.151686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:14.151693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.151705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.151721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.151738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:14.151762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601892327374234:4739]
2025-10-10T14:36:14.151768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601892327374234:4739]
2025-10-10T14:36:14.151771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601892327374234:4739]
2025-10-10T14:36:14.151781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:14.151791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:14.151800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:14.151802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109603569:5751], now have 1 active actors on pipe
2025-10-10T14:36:14.151802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:14.151809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109603448:2438], now have 1 active actors on pipe
2025-10-10T14:36:14.151815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:14.151832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:14.151840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:14.151867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601892327374234:4739]
2025-10-10T14:36:14.151875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:14.151899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:14.152059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1943
2025-10-10T14:36:14.152092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1943
2025-10-10T14:36:14.152418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.152428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.152463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:14.152475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.152483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.152487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:14.152499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.152513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:14.152533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.155901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1944 partition: 0 MaxSeqNo: 40 sessionId: src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0
2025-10-10T14:36:14.156350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36a2dc16-a508e2be-fe654c5b-ed923c5d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:14.155697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.155711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.155748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.159294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0] Write session: try to update token
2025-10-10T14:36:14.159316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:14.172592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:14.172610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:14.172614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:14.172616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:14.172626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601892327374234:4739]
2025-10-10T14:36:14.172631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601892327374234:4739]
2025-10-10T14:36:14.172634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601892327374234:4739]
2025-10-10T14:36:14.172684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:14.172693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.172696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:14.172848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:14.173427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:14.173437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:14.173440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:14.175441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId: src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:14.178322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:14.215374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601893109603731:6092]
2025-10-10T14:36:14.215701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1943, pipe: [1:7559601893109603731:6092]
2025-10-10T14:36:14.288588Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:14.289517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.289530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.289577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109603731:6092], now have 1 active actors on pipe
2025-10-10T14:36:14.289822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:14.289913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601893109603731:6092]
2025-10-10T14:36:14.289920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:14.289960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:14.290038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1944 reason: status is not ok: tablet will be restarted right now sessionId: src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0
2025-10-10T14:36:14.290244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1944 sessionId: src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0 is DEAD
2025-10-10T14:36:14.290433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:14.290445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0] Write session will restart in 0.008389s
2025-10-10T14:36:14.290472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0] Write session: Do CDS request
2025-10-10T14:36:14.290478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:14.299853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.299962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:14.299975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1945
2025-10-10T14:36:14.300115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.300152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:14.300162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:14.300166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:14.300594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1945 sessionId:  describe result for acl check
2025-10-10T14:36:14.300624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:14.300631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:14.300633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:14.300641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601893109603773:5746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:14.301213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601893109603773:5746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:14.304264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601893109603773:5746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:14.309201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601893109603773:5746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:14.309216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601893109603773:5746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:14.309220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601893109603773:5746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:14.309229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:14.317738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:14.320819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:14.321053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:14.321059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:14.321070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:14.321125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:14.321163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601892327374519:4737]
2025-10-10T14:36:14.321839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:14.322164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:14.322205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:14.322544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:14.322605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.322611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.322612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.322614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.322615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.322616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.322618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.322619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.322620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.322622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.322624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.322625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.322626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.322632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.322646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.322651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.322655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.322659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.322664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.322668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.322672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.322676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.322681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.322685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.322689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.322693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.322701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.322710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.322717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.322722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.322727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.322732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.322736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.322742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.322747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.322753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.322759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.322764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.322769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.322774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.322778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.322783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.322788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.322799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.322803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.322810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.322821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.322827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.322836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.322842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.322846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.322851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.322893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:14.325305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:14.325625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:14.325637Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:14.325640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:14.325644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:14.325652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1944 [2:7559601892327374519:4737]
2025-10-10T14:36:14.325665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:14.325682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:14.325689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.325693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.325696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.325713Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:14.325725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:14.325738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:14.325791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.325802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.325804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.325807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:14.325873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:14.325881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.325893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.325906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.325928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:14.325955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109603732:2438], now have 1 active actors on pipe
2025-10-10T14:36:14.325963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109603924:5746], now have 1 active actors on pipe
2025-10-10T14:36:14.325971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601892327374514:4737]
2025-10-10T14:36:14.325979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601892327374514:4737]
2025-10-10T14:36:14.325981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601892327374514:4737]
2025-10-10T14:36:14.325993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:14.326021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1944
2025-10-10T14:36:14.326012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:14.326046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1944
2025-10-10T14:36:14.326018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:14.326021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:14.326024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:14.326036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:14.326039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:14.326063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601892327374514:4737]
2025-10-10T14:36:14.326066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:14.326069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:14.326087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.326092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.326147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a89f11c-9e504117-922c5497-e6a2610d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:14.326159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.326163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.326170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:14.326182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.326197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:14.326218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.326389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.326399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.326414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.326494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1945 partition: 0 MaxSeqNo: 40 sessionId: src_id|a89f11c-9e504117-922c5497-e6a2610d_0
2025-10-10T14:36:14.326883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649f3723-41eeb7f3-2c3b4fb2-999d5257_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a89f11c-9e504117-922c5497-e6a2610d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:14.329625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89f11c-9e504117-922c5497-e6a2610d_0] Write session: try to update token
2025-10-10T14:36:14.329643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89f11c-9e504117-922c5497-e6a2610d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:14.347762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:14.347780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:14.347784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:14.347787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:14.347797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601892327374514:4737]
2025-10-10T14:36:14.347801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601892327374514:4737]
2025-10-10T14:36:14.347804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601892327374514:4737]
2025-10-10T14:36:14.347859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:14.347862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:14.347872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.347873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:14.347875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:14.347877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:14.348018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:14.348028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId: src_id|a89f11c-9e504117-922c5497-e6a2610d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:14.350782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:14.389993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601893109604017:6092]
2025-10-10T14:36:14.390374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1944, pipe: [1:7559601893109604017:6092]
2025-10-10T14:36:14.463828Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:14.464776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.464791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.464841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604017:6092], now have 1 active actors on pipe
2025-10-10T14:36:14.465582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:14.465860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:14.465916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601893109604017:6092]
2025-10-10T14:36:14.465943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:14.465951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:14.466026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1945 reason: error at write: Disconnected sessionId: src_id|a89f11c-9e504117-922c5497-e6a2610d_0
2025-10-10T14:36:14.466229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1945 sessionId: src_id|a89f11c-9e504117-922c5497-e6a2610d_0 is DEAD
2025-10-10T14:36:14.466451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89f11c-9e504117-922c5497-e6a2610d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:14.466463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89f11c-9e504117-922c5497-e6a2610d_0] Write session will restart in 0.007701s
2025-10-10T14:36:14.466489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89f11c-9e504117-922c5497-e6a2610d_0] Write session: Do CDS request
2025-10-10T14:36:14.466495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89f11c-9e504117-922c5497-e6a2610d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:14.475954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89f11c-9e504117-922c5497-e6a2610d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.476192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:14.476209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1946
2025-10-10T14:36:14.476353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.476403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:14.476414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:14.476419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:14.477077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1946 sessionId:  describe result for acl check
2025-10-10T14:36:14.477118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:14.477128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:14.477130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:14.477136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601893109604057:5737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:14.477775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601893109604057:5737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:14.480844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601893109604057:5737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:14.484468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601893109604057:5737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:14.484483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601893109604057:5737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:14.484487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601893109604057:5737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:14.484496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:14.488961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:14.491771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:14.492017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:14.492029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:14.492042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:14.492101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:14.492148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601892327374800:4719]
2025-10-10T14:36:14.492801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:14.493163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:14.493210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:14.493579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:14.493649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.493654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.493656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.493657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.493659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.493660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.493661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.493663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.493664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.493666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.493667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.493668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.493670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.493676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.493689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.493693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.493698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.493702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.493706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.493710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.493714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.493718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.493722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.493726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.493730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.493734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.493743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.493752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.493759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.493765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.493769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.493775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.493780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.493785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.493789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.493795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.493800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.493805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.493810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.493816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.493820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.493826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.493831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.493837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.493842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.493848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.493854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.493859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.493872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.493877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.493882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.493887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.493932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:14.496502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:14.496804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:14.496815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:14.496819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:14.496823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:14.496830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1945 [2:7559601892327374800:4719]
2025-10-10T14:36:14.496845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:14.496865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:14.496873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.496876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.496879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.496897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:14.496911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:14.496923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:14.497014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.497024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.497027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.497030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:14.497100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:14.497108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.497120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.497135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.497158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:14.497195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604212:5737], now have 1 active actors on pipe
2025-10-10T14:36:14.497205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604018:2438], now have 1 active actors on pipe
2025-10-10T14:36:14.497212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601892327374795:4719]
2025-10-10T14:36:14.497215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601892327374795:4719]
2025-10-10T14:36:14.497217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601892327374795:4719]
2025-10-10T14:36:14.497233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:14.497247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:14.497275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:14.497260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1945
2025-10-10T14:36:14.497285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:14.497270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1945
2025-10-10T14:36:14.497286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:14.497289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:14.497292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:14.497309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601892327374795:4719]
2025-10-10T14:36:14.497312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:14.497320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:14.497360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.497365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.497565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89fc335a-907e761-4355a8b4-32ce05c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:14.497578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.497582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.497585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:14.497597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.497608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:14.497629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.497870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.497882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.497907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.498022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1946 partition: 0 MaxSeqNo: 40 sessionId: src_id|89fc335a-907e761-4355a8b4-32ce05c2_0
2025-10-10T14:36:14.498440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89f11c-9e504117-922c5497-e6a2610d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89fc335a-907e761-4355a8b4-32ce05c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:14.501292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89fc335a-907e761-4355a8b4-32ce05c2_0] Write session: try to update token
2025-10-10T14:36:14.501311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89fc335a-907e761-4355a8b4-32ce05c2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:14.516347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId: src_id|89fc335a-907e761-4355a8b4-32ce05c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:14.517203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:14.517224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:14.517227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:14.517229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:14.517240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601892327374795:4719]
2025-10-10T14:36:14.517244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601892327374795:4719]
2025-10-10T14:36:14.517251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601892327374795:4719]
2025-10-10T14:36:14.517302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:14.517306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:14.517310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.517313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:14.517313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:14.517318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:14.517528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:14.519185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:14.565595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601893109604306:6092]
2025-10-10T14:36:14.565983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1945, pipe: [1:7559601893109604306:6092]
2025-10-10T14:36:14.632172Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:14.632919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.632938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.633005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604306:6092], now have 1 active actors on pipe
2025-10-10T14:36:14.633300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:14.633905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:14.634003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1946 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89fc335a-907e761-4355a8b4-32ce05c2_0
2025-10-10T14:36:14.634183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601893109604306:6092]
2025-10-10T14:36:14.634213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:14.634217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1946 sessionId: src_id|89fc335a-907e761-4355a8b4-32ce05c2_0 is DEAD
2025-10-10T14:36:14.634558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fc335a-907e761-4355a8b4-32ce05c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:14.634569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fc335a-907e761-4355a8b4-32ce05c2_0] Write session will restart in 0.005096s
2025-10-10T14:36:14.634593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fc335a-907e761-4355a8b4-32ce05c2_0] Write session: Do CDS request
2025-10-10T14:36:14.634599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fc335a-907e761-4355a8b4-32ce05c2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:14.640923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89fc335a-907e761-4355a8b4-32ce05c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.640983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:14.640998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1947
2025-10-10T14:36:14.641171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.641210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:14.641216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:14.641220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:14.641726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1947 sessionId:  describe result for acl check
2025-10-10T14:36:14.641768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:14.641775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:14.641777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:14.641783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601893109604325:5733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:14.642392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601893109604325:5733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:14.645368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601893109604325:5733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:14.651003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601893109604325:5733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:14.651019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601893109604325:5733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:14.651022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601893109604325:5733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:14.651031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:14.655708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:14.658420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:14.658669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:14.658679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:14.658700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:14.658762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:14.658805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601892327375083:4732]
2025-10-10T14:36:14.659410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:14.659768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:14.659831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:14.660176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:14.660236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.660242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.660243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.660244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.660246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.660247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.660248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.660250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.660251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.660252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.660253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.660254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.660256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.660262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.660276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.660280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.660284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.660288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.660293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.660297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.660301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.660314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.660318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.660322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.660326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.660329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.660338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.660346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.660353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.660358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.660364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.660369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.660374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.660379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.660384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.660390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.660394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.660399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.660404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.660410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.660414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.660429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.660434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.660439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.660443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.660448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.660453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.660459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.660463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.660468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.660481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.660490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.660531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:14.663054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:14.663533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:14.663548Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:14.663551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:14.663554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:14.663560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1946 [2:7559601892327375083:4732]
2025-10-10T14:36:14.663574Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:14.663594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:14.663602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.663606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.663609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.663626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:14.663634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:14.663648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:14.663716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.663725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.663727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.663730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:14.663803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:14.663811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.663823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.663836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.663860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:14.663880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604310:2438], now have 1 active actors on pipe
2025-10-10T14:36:14.663887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604501:5733], now have 1 active actors on pipe
2025-10-10T14:36:14.663894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601892327375078:4732]
2025-10-10T14:36:14.663897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601892327375078:4732]
2025-10-10T14:36:14.663899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601892327375078:4732]
2025-10-10T14:36:14.663913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:14.663927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1946
2025-10-10T14:36:14.663925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:14.663927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:14.663942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:14.663945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:14.663945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:14.663947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:14.663974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601892327375078:4732]
2025-10-10T14:36:14.663977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:14.663979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:14.664005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.663974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1946
2025-10-10T14:36:14.664009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.664056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:14.664071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.664075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.664079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:14.664092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.664104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:14.664129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.664270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.664278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.664294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.664426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1947 partition: 0 MaxSeqNo: 40 sessionId: src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0
2025-10-10T14:36:14.664760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89fc335a-907e761-4355a8b4-32ce05c2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:14.667412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0] Write session: try to update token
2025-10-10T14:36:14.667430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:14.684141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:14.684162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:14.684165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:14.684167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:14.684178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601892327375078:4732]
2025-10-10T14:36:14.684182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601892327375078:4732]
2025-10-10T14:36:14.684187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601892327375078:4732]
2025-10-10T14:36:14.684239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:14.684247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.684250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:14.684281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:14.684290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:14.684295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:14.684400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:14.683544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId: src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:14.686764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:14.734622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601893109604603:6092]
2025-10-10T14:36:14.734942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1946, pipe: [1:7559601893109604603:6092]
2025-10-10T14:36:14.802139Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:14.802452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.802470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.802519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604603:6092], now have 1 active actors on pipe
2025-10-10T14:36:14.802821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:14.802833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:14.802915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:14.802962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1947 reason: error at write: Disconnected sessionId: src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0
2025-10-10T14:36:14.802973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601893109604603:6092]
2025-10-10T14:36:14.803019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:14.803196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1947 sessionId: src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0 is DEAD
2025-10-10T14:36:14.805406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:14.805419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0] Write session will restart in 0.008806s
2025-10-10T14:36:14.805445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0] Write session: Do CDS request
2025-10-10T14:36:14.805453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:14.815915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.817483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:14.817512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1948
2025-10-10T14:36:14.817677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:14.817717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:14.817728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:14.817732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:14.818326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1948 sessionId:  describe result for acl check
2025-10-10T14:36:14.818362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:14.818365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:14.818368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:14.818374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601893109604699:5722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:14.819001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601893109604699:5722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:14.821983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601893109604699:5722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:14.825406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601893109604699:5722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:14.825421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601893109604699:5722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:14.825426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601893109604699:5722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:14.825435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:14.827034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:14.829664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:14.829916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:14.829929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:14.829942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:14.830020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:14.830079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601892327375366:4731]
2025-10-10T14:36:14.830704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:14.831082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:14.831155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:14.831502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:14.831569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.831575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.831576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.831578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.831579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.831580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.831581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.831583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.831584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.831585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.831586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.831588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.831589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.831595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.831609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.831613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.831618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.831623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.831628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.831631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.831635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.831640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.831645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.831649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.831653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.831657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.831665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.831674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:14.831681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.831686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:14.831693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.831697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:14.831702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.831707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:14.831712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.831718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:14.831722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.831729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:14.831734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.831747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:14.831752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.831756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:14.831761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.831768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:14.831771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.831776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:14.831781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.831785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.831789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.831794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.831798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.831803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.831846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:14.834446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:14.834964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:14.834975Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:14.834978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:14.834981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:14.834988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1947 [2:7559601892327375366:4731]
2025-10-10T14:36:14.835003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:14.835023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:14.835026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.835030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.835033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.835051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:14.835064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:14.835077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:14.835146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.835153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.835156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.835159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:14.835232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:14.835240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.835251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:14.835263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:14.835279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:14.835309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604881:5722], now have 1 active actors on pipe
2025-10-10T14:36:14.835313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604607:2438], now have 1 active actors on pipe
2025-10-10T14:36:14.835321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601892327375361:4731]
2025-10-10T14:36:14.835323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601892327375361:4731]
2025-10-10T14:36:14.835325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601892327375361:4731]
2025-10-10T14:36:14.835340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:14.835356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:14.835360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:14.835376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:14.835378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:14.835380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:14.835381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:14.835410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601892327375361:4731]
2025-10-10T14:36:14.835420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:14.835401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1947
2025-10-10T14:36:14.835402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1947
2025-10-10T14:36:14.835435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:14.835456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.835460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.835499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1da0e915-5875107f-e14b6c84-a40a6308_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:14.835515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:14.835519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:14.835522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:14.835533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:14.835545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:14.835575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.835763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.835784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.835810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:14.835993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1948 partition: 0 MaxSeqNo: 40 sessionId: src_id|1da0e915-5875107f-e14b6c84-a40a6308_0
2025-10-10T14:36:14.836416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29b29ad0-716c6e0-cdc119a7-d099cdec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1da0e915-5875107f-e14b6c84-a40a6308_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:14.839355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0e915-5875107f-e14b6c84-a40a6308_0] Write session: try to update token
2025-10-10T14:36:14.839384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0e915-5875107f-e14b6c84-a40a6308_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:14.847604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:14.847618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:14.847630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601892327375361:4731]
2025-10-10T14:36:14.847672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:14.847685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:14.847916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:14.848065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:14.848674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:14.848811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:14.849015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:14.849059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:14.853948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId: src_id|1da0e915-5875107f-e14b6c84-a40a6308_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:14.856544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:14.856766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.856784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.856824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:14.856908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:14.868043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:14.868069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:14.868073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:14.868075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:14.868087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601892327375361:4731]
2025-10-10T14:36:14.868092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601892327375361:4731]
2025-10-10T14:36:14.868097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601892327375361:4731]
2025-10-10T14:36:14.868152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:14.868159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:14.868165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:14.868166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:14.868168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:14.868171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:14.868321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:14.903030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601893109604907:6092]
2025-10-10T14:36:14.903355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1947, pipe: [1:7559601893109604907:6092]
2025-10-10T14:36:14.990735Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:14.998561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:14.998583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:14.998746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:14.998817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:14.998888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:14.998951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:14.998992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:14.998999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:14.999069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:14.999130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:14.999191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:14.999260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:14.999308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:14.999311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:14.999380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:14.999437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:14.999496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:14.999563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:14.999609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:14.999612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:14.999678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:14.999736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:14.999796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:14.999863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:14.999906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:14.999909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:14.999974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.000027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.000082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.000144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.000194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.000197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.000263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.000319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.000380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.000449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.000490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.000493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.000562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.000622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.000685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.000745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.000785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.000790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.000861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.000916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.000995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.001056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.001096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.001099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.001171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.001228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.001286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.001557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.001603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.001612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.002215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:15.002230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:15.002229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:15.002262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1948 reason: error at write: Disconnected sessionId: src_id|1da0e915-5875107f-e14b6c84-a40a6308_0
2025-10-10T14:36:15.002279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601893109604907:6092]
2025-10-10T14:36:15.002513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1948 sessionId: src_id|1da0e915-5875107f-e14b6c84-a40a6308_0 is DEAD
2025-10-10T14:36:15.001683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.001746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.001807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.001869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.001914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.001917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.001983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601893109604907:6092], now have 1 active actors on pipe
2025-10-10T14:36:15.003088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:15.005245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0e915-5875107f-e14b6c84-a40a6308_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:15.005255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0e915-5875107f-e14b6c84-a40a6308_0] Write session will restart in 0.007100s
2025-10-10T14:36:15.005281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0e915-5875107f-e14b6c84-a40a6308_0] Write session: Do CDS request
2025-10-10T14:36:15.005288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0e915-5875107f-e14b6c84-a40a6308_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:15.013953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0e915-5875107f-e14b6c84-a40a6308_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.014080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:15.014098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1949
2025-10-10T14:36:15.017457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.017512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:15.017519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:15.017525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:15.018069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1949 sessionId:  describe result for acl check
2025-10-10T14:36:15.018108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:15.018126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:15.018128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:15.018136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601897404572330:5699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:15.018759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601897404572330:5699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:15.022520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601897404572330:5699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:15.025890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601897404572330:5699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:15.025915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601897404572330:5699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:15.025919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601897404572330:5699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:15.025928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:15.026966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:15.029870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:15.030103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:15.030115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:15.030128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:15.030184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:15.030235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601896622342998:4705]
2025-10-10T14:36:15.030859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:15.031340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:15.031408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:15.031760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:15.031829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.031834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.031836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.031837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.031838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.031839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.031841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.031842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.031844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.031845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.031846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.031848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.031849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.031856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.031871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.031875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.031880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.031888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.031893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.031897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.031901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.031905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.031910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.031915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.031919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.031923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.031933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.031945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.031955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.031973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.031982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.031988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.031996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.032001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.032008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.032017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.032023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.032032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.032037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.032047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.032052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.032058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.032063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.032069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.032082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.032087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.032091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.032097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.032101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.032106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.032111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.032116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.032158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:15.034769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:15.035379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:15.035390Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:15.035393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:15.035397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:15.035403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1948 [2:7559601896622342998:4705]
2025-10-10T14:36:15.035426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:15.035446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:15.035455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.035459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.035461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.035478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:15.035486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:15.035499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:15.035562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.035569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.035572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.035574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:15.035646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:15.035655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.035667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.035683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.035704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:15.035732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404572503:5699], now have 1 active actors on pipe
2025-10-10T14:36:15.035740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404572232:2438], now have 1 active actors on pipe
2025-10-10T14:36:15.035747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601896622342993:4705]
2025-10-10T14:36:15.035751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601896622342993:4705]
2025-10-10T14:36:15.035753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601896622342993:4705]
2025-10-10T14:36:15.035771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:15.035789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:15.035791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:15.035795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:15.035798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:15.035809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:15.035813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:15.035842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601896622342993:4705]
2025-10-10T14:36:15.035858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:15.035871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:15.035824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1948
2025-10-10T14:36:15.035892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1948
2025-10-10T14:36:15.036045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.036055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.036088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:15.036102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.036106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.036108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:15.036120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.036131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:15.036146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.036395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.036407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.036431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.036564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1949 partition: 0 MaxSeqNo: 40 sessionId: src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0
2025-10-10T14:36:15.036991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0e915-5875107f-e14b6c84-a40a6308_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:15.039930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0] Write session: try to update token
2025-10-10T14:36:15.039952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:15.054065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId: src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:15.056930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:15.057178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.057203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.057250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:15.057384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:15.059720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:15.059738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:15.059742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:15.059744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:15.059754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601896622342993:4705]
2025-10-10T14:36:15.059759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601896622342993:4705]
2025-10-10T14:36:15.059767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601896622342993:4705]
2025-10-10T14:36:15.059816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:15.059820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:15.059822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:15.059827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:15.059827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.059830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:15.059990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:15.102193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601897404572516:6092]
2025-10-10T14:36:15.102551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1948, pipe: [1:7559601897404572516:6092]
2025-10-10T14:36:15.176324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:15.185273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.185309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.185516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.185586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.185654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.185725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.185771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.185781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.185852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.185918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.188889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:15.188906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:15.188912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:15.188946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1949 reason: error at write: Disconnected sessionId: src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0
2025-10-10T14:36:15.188964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601897404572516:6092]
2025-10-10T14:36:15.185983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.186057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.186098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.186101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.186169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.186229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.186292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.186354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.186395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.186398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.186470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.186534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.186596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.186654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.186694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.186697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.186766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.186825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.186890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.186952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.187014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.187017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.187086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.187147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.187208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.187273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.187333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.187335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.187403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.187463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.187524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.187588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.187629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.187631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.187699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.187758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.187819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.187881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.187928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.187931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.187999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.188058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.188124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.188189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.188233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.188236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.188309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.188369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.188431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.188493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.188532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.188535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.188608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404572516:6092], now have 1 active actors on pipe
2025-10-10T14:36:15.189180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1949 sessionId: src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0 is DEAD
2025-10-10T14:36:15.189371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:15.189381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0] Write session will restart in 0.009635s
2025-10-10T14:36:15.189417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0] Write session: Do CDS request
2025-10-10T14:36:15.189424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:15.190142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:15.199927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.200026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:15.200041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1950
2025-10-10T14:36:15.200223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.200287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:15.200298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:15.200302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:15.200838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1950 sessionId:  describe result for acl check
2025-10-10T14:36:15.200874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:15.200879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:15.200881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:15.200888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601897404572585:5704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:15.201511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601897404572585:5704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:15.205720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601897404572585:5704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:15.209085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601897404572585:5704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:15.209099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601897404572585:5704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:15.209103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601897404572585:5704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:15.209112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:15.211369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:15.214246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:15.214470Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:15.214483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:15.214496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:15.214559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:15.214604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601896622343284:4695]
2025-10-10T14:36:15.215240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:15.215876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:15.215925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:15.216286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:15.216344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.216352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.216354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.216355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.216357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.216358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.216360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.216361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.216362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.216363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.216365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.216366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.216368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.216373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.216386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.216389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.216394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.216398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.216402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.216406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.216410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.216415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.216419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.216423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.216427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.216432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.216440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.216449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.216456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.216462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.216467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.216472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.216477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.216482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.216488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.216501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.216505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.216511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.216516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.216522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.216527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.216533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.216539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.216548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.216553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.216558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.216562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.216569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.216573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.216578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.216583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.216588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.216625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:15.219076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:15.219561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:15.219574Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:15.219577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:15.219581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:15.219586Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1949 [2:7559601896622343284:4695]
2025-10-10T14:36:15.219594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:15.219608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:15.219610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.219612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.219613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.219630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:15.219637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:15.219649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:15.219705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.219713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.219715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.219718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:15.219786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:15.219793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.219801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.219807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.219837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:15.219861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601896622343279:4695]
2025-10-10T14:36:15.219868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601896622343279:4695]
2025-10-10T14:36:15.219870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601896622343279:4695]
2025-10-10T14:36:15.219885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:15.219891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:15.219895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:15.219900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:15.219905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404572794:5704], now have 1 active actors on pipe
2025-10-10T14:36:15.219909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404572521:2438], now have 1 active actors on pipe
2025-10-10T14:36:15.219919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:15.219938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:15.219946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:15.219971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601896622343279:4695]
2025-10-10T14:36:15.219982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:15.219975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1949
2025-10-10T14:36:15.219989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:15.219976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1949
2025-10-10T14:36:15.220099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.220111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.220154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b63dff0c-f4aa7358-54505f79-43e86027_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:15.220166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.220176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.220179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:15.220190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.220203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:15.220224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.220382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.220391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.220406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.220497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1950 partition: 0 MaxSeqNo: 40 sessionId: src_id|b63dff0c-f4aa7358-54505f79-43e86027_0
2025-10-10T14:36:15.220880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|301f7ea1-d2e4f74c-4ab8fae6-1d5ec53f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b63dff0c-f4aa7358-54505f79-43e86027_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:15.223646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63dff0c-f4aa7358-54505f79-43e86027_0] Write session: try to update token
2025-10-10T14:36:15.223663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63dff0c-f4aa7358-54505f79-43e86027_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:15.232587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:15.232601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:15.232612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601896622343279:4695]
2025-10-10T14:36:15.232664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:15.232666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:15.232862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:15.233032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:15.233174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:15.233352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:15.233561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:15.233610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:15.238657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId: src_id|b63dff0c-f4aa7358-54505f79-43e86027_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:15.241577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:15.241804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.241822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.241859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:15.241930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:15.255249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:15.255274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:15.255278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:15.255280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:15.255292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601896622343279:4695]
2025-10-10T14:36:15.255296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601896622343279:4695]
2025-10-10T14:36:15.255301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601896622343279:4695]
2025-10-10T14:36:15.255357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:15.255365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.255367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:15.255370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:15.255377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:15.255382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:15.255504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:15.289034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601897404572809:6092]
2025-10-10T14:36:15.289307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1949, pipe: [1:7559601897404572809:6092]
2025-10-10T14:36:15.376500Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:15.385362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.385388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.385563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.385633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.385700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.385761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.385805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.385815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.385880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.385946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.386012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.386077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.386122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.386130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.386196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.386259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.386323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.386388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.386432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.386440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.386507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.386572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.386632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.386697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.386737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.386741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.386809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.386871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.386932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.386995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.387039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.387042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.387112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.387178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.387241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.387308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.387353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.387361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.387427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.387488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.387552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.387614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.387661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.387669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.387735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.387797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.387862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.387924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.387972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.387980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.388045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.388107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.388928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:15.388934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601897404572809:6092]
2025-10-10T14:36:15.388941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:15.388972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:15.389000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1950 reason: error at write: Disconnected sessionId: src_id|b63dff0c-f4aa7358-54505f79-43e86027_0
2025-10-10T14:36:15.389230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1950 sessionId: src_id|b63dff0c-f4aa7358-54505f79-43e86027_0 is DEAD
2025-10-10T14:36:15.388174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.388246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.388286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.388289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.388358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.388418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.388479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.388539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.388580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.388583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.388651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404572809:6092], now have 1 active actors on pipe
2025-10-10T14:36:15.389414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63dff0c-f4aa7358-54505f79-43e86027_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:15.389440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63dff0c-f4aa7358-54505f79-43e86027_0] Write session will restart in 0.006606s
2025-10-10T14:36:15.389466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63dff0c-f4aa7358-54505f79-43e86027_0] Write session: Do CDS request
2025-10-10T14:36:15.389472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63dff0c-f4aa7358-54505f79-43e86027_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:15.389965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:15.396905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b63dff0c-f4aa7358-54505f79-43e86027_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.396998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:15.397012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1951
2025-10-10T14:36:15.397198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.397238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:15.397248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:15.397252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:15.397778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1951 sessionId:  describe result for acl check
2025-10-10T14:36:15.397812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:15.397814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:15.397816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:15.397822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601897404572832:5690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:15.398389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601897404572832:5690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:15.401781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601897404572832:5690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:15.406435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601897404572832:5690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:15.406457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601897404572832:5690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:15.406462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601897404572832:5690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:15.406472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:15.411791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:15.414572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:15.414855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:15.414866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:15.414882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:15.414955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:15.415001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601896622343571:4687]
2025-10-10T14:36:15.415649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:15.416019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:15.416090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:15.416465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:15.416533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.416540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.416541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.416542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.416544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.416545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.416546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.416548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.416549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.416550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.416551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.416552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.416554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.416560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.416574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.416578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.416583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.416587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.416591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.416595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.416599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.416603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.416608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.416612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.416616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.416619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.416628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.416637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.416643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.416649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.416653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.416658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.416662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.416667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.416672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.416676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.416680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.416685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.416689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.416694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.416698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.416717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.416727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.416732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.416737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.416742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.416746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.416752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.416761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.416765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.416770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.416776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.416820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:15.419626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:15.419957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:15.419969Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:15.419972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:15.419975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:15.419982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1950 [2:7559601896622343571:4687]
2025-10-10T14:36:15.420006Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:15.420029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:15.420037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.420040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.420042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.420061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:15.420073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:15.420088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:15.420388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1950
2025-10-10T14:36:15.420156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.420163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.420165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.420176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:15.420248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:15.420251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.420261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.420536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1950
2025-10-10T14:36:15.420271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.420285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:15.420309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404572812:2438], now have 1 active actors on pipe
2025-10-10T14:36:15.420313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404572997:5690], now have 1 active actors on pipe
2025-10-10T14:36:15.420321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601896622343566:4687]
2025-10-10T14:36:15.420323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601896622343566:4687]
2025-10-10T14:36:15.420324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601896622343566:4687]
2025-10-10T14:36:15.420339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:15.420353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:15.420357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:15.420361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:15.420363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:15.420368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:15.420371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:15.420402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601896622343566:4687]
2025-10-10T14:36:15.420405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:15.420423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:15.420604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.420613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.420657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|126e6b6a-2925844c-1b37d87e-baf22430_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:15.420667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.420674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.420696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:15.420710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.420729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:15.420762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.421011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.421024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.421049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.421184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1951 partition: 0 MaxSeqNo: 40 sessionId: src_id|126e6b6a-2925844c-1b37d87e-baf22430_0
2025-10-10T14:36:15.421596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b63dff0c-f4aa7358-54505f79-43e86027_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|126e6b6a-2925844c-1b37d87e-baf22430_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:15.424316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|126e6b6a-2925844c-1b37d87e-baf22430_0] Write session: try to update token
2025-10-10T14:36:15.424336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|126e6b6a-2925844c-1b37d87e-baf22430_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:15.432317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:15.432334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:15.432346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601896622343566:4687]
2025-10-10T14:36:15.432395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:15.432399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:15.432575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:15.432714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:15.432846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:15.432997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:15.433191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:15.433231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:15.440107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId: src_id|126e6b6a-2925844c-1b37d87e-baf22430_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:15.442838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:15.445494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.445524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.445570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:15.445707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:15.457075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:15.457094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:15.457098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:15.457100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:15.457111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601896622343566:4687]
2025-10-10T14:36:15.457116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601896622343566:4687]
2025-10-10T14:36:15.457121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601896622343566:4687]
2025-10-10T14:36:15.457172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:15.457172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:15.457180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.457183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:15.457189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:15.457195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:15.457322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:15.489184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601897404573102:6092]
2025-10-10T14:36:15.489683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1950, pipe: [1:7559601897404573102:6092]
2025-10-10T14:36:15.574074Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:15.583120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.583154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.583347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.583427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.583503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.583574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.583621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.583626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.583703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.583772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.583839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.583906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.583953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.583962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.584038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.584106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.584174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.584248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.584304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.584311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.584381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.584446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.584511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.584577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.584621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.584629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.584700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.584763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.584832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.584901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.584957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.584965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.585034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.585101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.585165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.585236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.585287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.585298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.585383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.585446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.585518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.585585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.585629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.585636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.585707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.585774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.585840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.585906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.585952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.585959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.586027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.586088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.586151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.586215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.586270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.586277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.586353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:15.586417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:15.586481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:15.586550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:15.586600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:15.586607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:15.586677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573102:6092], now have 1 active actors on pipe
2025-10-10T14:36:15.587072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:15.587075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:15.587080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:15.587128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1951 reason: error at write: Disconnected sessionId: src_id|126e6b6a-2925844c-1b37d87e-baf22430_0
2025-10-10T14:36:15.587152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601897404573102:6092]
2025-10-10T14:36:15.587336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1951 sessionId: src_id|126e6b6a-2925844c-1b37d87e-baf22430_0 is DEAD
2025-10-10T14:36:15.587480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|126e6b6a-2925844c-1b37d87e-baf22430_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:15.587491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|126e6b6a-2925844c-1b37d87e-baf22430_0] Write session will restart in 0.007535s
2025-10-10T14:36:15.587518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|126e6b6a-2925844c-1b37d87e-baf22430_0] Write session: Do CDS request
2025-10-10T14:36:15.587525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|126e6b6a-2925844c-1b37d87e-baf22430_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:15.587870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:15.595979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|126e6b6a-2925844c-1b37d87e-baf22430_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.596061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:15.596078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1952
2025-10-10T14:36:15.596250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.596298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:15.596320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:15.596325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:15.596836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1952 sessionId:  describe result for acl check
2025-10-10T14:36:15.596874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:15.596876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:15.596878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:15.596884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601897404573128:5688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:15.597520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601897404573128:5688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:15.601405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601897404573128:5688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:15.605646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601897404573128:5688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:15.605663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601897404573128:5688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:15.605668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601897404573128:5688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:15.605678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:15.613173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:15.615949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:15.616167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:15.616178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:15.616190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:15.616236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:15.616280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601896622343858:4685]
2025-10-10T14:36:15.616989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:15.617413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:15.617500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:15.617884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:15.617965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.617973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.617974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.617975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.617977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.617978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.617980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.617981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.617982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.617984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.617986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.617987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.617988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.617996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.618011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.618015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.618020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.618024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.618027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.618032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.618036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.618040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.618046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.618050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.618054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.618058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.618067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.618077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.618084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.618089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.618094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.618099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.618104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.618110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.618115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.618121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.618126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.618138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.618143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.618154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.618159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.618170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.618176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.618185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.618190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.618199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.618207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.618212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.618216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.618222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.618231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.618236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.618278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:15.620981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:15.621492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:15.621505Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:15.621508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:15.621513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:15.621520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1951 [2:7559601896622343858:4685]
2025-10-10T14:36:15.621535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:15.621556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:15.621560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.621564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.621567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.621588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:15.621606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:15.621615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:15.621693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.621702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.621704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.621707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:15.621784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:15.621793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.621807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.621821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.621843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:15.621876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573275:5688], now have 1 active actors on pipe
2025-10-10T14:36:15.621880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573104:2438], now have 1 active actors on pipe
2025-10-10T14:36:15.621889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601896622343853:4685]
2025-10-10T14:36:15.621891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601896622343853:4685]
2025-10-10T14:36:15.621894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601896622343853:4685]
2025-10-10T14:36:15.621911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:15.621932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:15.621939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:15.621942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:15.621944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:15.621956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:15.621963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:15.621926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1951
2025-10-10T14:36:15.622008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601896622343853:4685]
2025-10-10T14:36:15.622003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1951
2025-10-10T14:36:15.622020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:15.622021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:15.622057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.622067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.622107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e475c258-d72141e2-749d957c-3a50d83b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:15.622121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.622127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.622134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:15.622151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.622167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:15.622188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.622391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.622400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.622417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.622522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1952 partition: 0 MaxSeqNo: 40 sessionId: src_id|e475c258-d72141e2-749d957c-3a50d83b_0
2025-10-10T14:36:15.622941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|126e6b6a-2925844c-1b37d87e-baf22430_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e475c258-d72141e2-749d957c-3a50d83b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:15.625683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e475c258-d72141e2-749d957c-3a50d83b_0] Write session: try to update token
2025-10-10T14:36:15.625702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e475c258-d72141e2-749d957c-3a50d83b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:15.641113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId: src_id|e475c258-d72141e2-749d957c-3a50d83b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:15.643842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:15.643847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:15.643870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:15.643874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:15.643876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:15.643886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601896622343853:4685]
2025-10-10T14:36:15.643891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601896622343853:4685]
2025-10-10T14:36:15.643895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601896622343853:4685]
2025-10-10T14:36:15.643951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:15.643963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.643965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:15.643969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:15.643987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:15.643992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:15.644112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:15.687438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601897404573396:6092]
2025-10-10T14:36:15.687812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1951, pipe: [1:7559601897404573396:6092]
2025-10-10T14:36:15.771385Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:15.772161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.772174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.772225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573396:6092], now have 1 active actors on pipe
2025-10-10T14:36:15.772546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:15.772522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:15.772540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:15.772610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1952 reason: error at write: Disconnected sessionId: src_id|e475c258-d72141e2-749d957c-3a50d83b_0
2025-10-10T14:36:15.772807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1952 sessionId: src_id|e475c258-d72141e2-749d957c-3a50d83b_0 is DEAD
2025-10-10T14:36:15.772954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:15.772967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601897404573396:6092]
2025-10-10T14:36:15.775861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e475c258-d72141e2-749d957c-3a50d83b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:15.775875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e475c258-d72141e2-749d957c-3a50d83b_0] Write session will restart in 0.006169s
2025-10-10T14:36:15.775901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e475c258-d72141e2-749d957c-3a50d83b_0] Write session: Do CDS request
2025-10-10T14:36:15.775921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e475c258-d72141e2-749d957c-3a50d83b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:15.785810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e475c258-d72141e2-749d957c-3a50d83b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.789704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:15.789722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1953
2025-10-10T14:36:15.793461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.793522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:15.793529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:15.793535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:15.794397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1953 sessionId:  describe result for acl check
2025-10-10T14:36:15.794438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:15.794439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:15.794441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:15.794448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601897404573430:5681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:15.794955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601897404573430:5681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:15.804921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601897404573430:5681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:15.808897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601897404573430:5681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:15.808914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601897404573430:5681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:15.808917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601897404573430:5681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:15.808924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:15.811222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:15.813973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:15.814204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:15.814217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:15.814230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:15.814285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:15.814331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601896622344146:4678]
2025-10-10T14:36:15.814966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:15.815367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:15.815411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:15.815742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:15.815804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.815810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.815811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.815813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.815814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.815815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.815816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.815818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.815819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.815820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.815822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.815823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.815824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.815830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.815844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.815848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.815851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.815855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.815859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.815863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.815866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.815869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.815874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.815878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.815882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.815886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.815894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.815903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:15.815910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.815916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:15.815920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.815926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:15.815931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.815936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:15.815941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.815947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:15.815950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.815957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:15.815968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.815974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:15.815978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.815988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:15.815993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.815998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:15.816007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.816012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:15.816019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.816029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.816034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.816043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.816048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.816053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.816101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:15.818740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:15.819085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:15.819095Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:15.819097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:15.819101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:15.819108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1952 [2:7559601896622344146:4678]
2025-10-10T14:36:15.819120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:15.819139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:15.819147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.819151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.819153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.819180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:15.819193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:15.819201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:15.819258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.819265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.819268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.819271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:15.819339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:15.819347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.819360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:15.819376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:15.819399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:15.819425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573683:5681], now have 1 active actors on pipe
2025-10-10T14:36:15.819433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573405:2438], now have 1 active actors on pipe
2025-10-10T14:36:15.819441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601896622344141:4678]
2025-10-10T14:36:15.819444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601896622344141:4678]
2025-10-10T14:36:15.819446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601896622344141:4678]
2025-10-10T14:36:15.819460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:15.819475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:15.819475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:15.819478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:15.819480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:15.819497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:15.819501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:15.819523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601896622344141:4678]
2025-10-10T14:36:15.819534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:15.819515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1952
2025-10-10T14:36:15.819541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:15.819515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1952
2025-10-10T14:36:15.819648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.819659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.819691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5821af0-93d588af-532c6852-f2adf050_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:15.819704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:15.819708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:15.819711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:15.819723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:15.819734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:15.819748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.819925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.819932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.819948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:15.820060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1953 partition: 0 MaxSeqNo: 40 sessionId: src_id|d5821af0-93d588af-532c6852-f2adf050_0
2025-10-10T14:36:15.821631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e475c258-d72141e2-749d957c-3a50d83b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d5821af0-93d588af-532c6852-f2adf050_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:15.824305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5821af0-93d588af-532c6852-f2adf050_0] Write session: try to update token
2025-10-10T14:36:15.824325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5821af0-93d588af-532c6852-f2adf050_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:15.839645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:15.839662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:15.839665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:15.839667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:15.839678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601896622344141:4678]
2025-10-10T14:36:15.839683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601896622344141:4678]
2025-10-10T14:36:15.839687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601896622344141:4678]
2025-10-10T14:36:15.839740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:15.839747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:15.839750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:15.839886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:15.841410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:15.841418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:15.841423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:15.846288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId: src_id|d5821af0-93d588af-532c6852-f2adf050_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:15.849242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:15.872701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601897404573697:6092]
2025-10-10T14:36:15.873034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1952, pipe: [1:7559601897404573697:6092]
2025-10-10T14:36:15.955576Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:15.956599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:15.956613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:15.956664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573697:6092], now have 1 active actors on pipe
2025-10-10T14:36:15.957004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601897404573697:6092]
2025-10-10T14:36:15.957049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:15.957052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:15.957114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1953 reason: error at write: Disconnected sessionId: src_id|d5821af0-93d588af-532c6852-f2adf050_0
2025-10-10T14:36:15.957522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5821af0-93d588af-532c6852-f2adf050_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:15.957536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5821af0-93d588af-532c6852-f2adf050_0] Write session will restart in 0.005087s
2025-10-10T14:36:15.957562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5821af0-93d588af-532c6852-f2adf050_0] Write session: Do CDS request
2025-10-10T14:36:15.957569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5821af0-93d588af-532c6852-f2adf050_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:15.957149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:15.957315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1953 sessionId: src_id|d5821af0-93d588af-532c6852-f2adf050_0 is DEAD
2025-10-10T14:36:15.957521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:15.963914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5821af0-93d588af-532c6852-f2adf050_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.964002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:15.964016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1954
2025-10-10T14:36:15.964198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:15.964230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:15.964236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:15.964240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:15.964706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1954 sessionId:  describe result for acl check
2025-10-10T14:36:15.964752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:15.964755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:15.964757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:15.964762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601897404573725:5674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:15.965410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601897404573725:5674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:15.967533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601897404573725:5674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:15.974236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601897404573725:5674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:15.974251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601897404573725:5674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:15.974255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601897404573725:5674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:15.974265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:15.994829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:15.998210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:15.998461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:15.998475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:15.998490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:15.998562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:15.998609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601896622344453:4662]
2025-10-10T14:36:15.999239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:15.999992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:16.000050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:16.000359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:16.000426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.000427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.000429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.000430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.000431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.000434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.000435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.000436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.000438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.000438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.000440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.000441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.000442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.000447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.000459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.000463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.000466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.000470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.000474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.000477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.000481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.000484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.000488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.000493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.000498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.000502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.000510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.000519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.000526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.000531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.000536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.000540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.000545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.000550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.000555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.000561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.000565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.000572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.000577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.000582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.000586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.000591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.000596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.000602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.000608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.000614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.000619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.000624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.000629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.000635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.000639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.000644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.000686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:16.009150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:16.009535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:16.009551Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:16.009554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:16.009558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:16.009566Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1953 [2:7559601896622344453:4662]
2025-10-10T14:36:16.009579Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:16.009603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:16.009611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.009615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.009618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.009638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:16.009650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:16.009663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:16.009725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.009736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.009738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.009741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:16.009815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:16.009818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.009833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.009846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.009866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:16.009887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601896622344443:4662]
2025-10-10T14:36:16.009890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601896622344443:4662]
2025-10-10T14:36:16.009893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601896622344443:4662]
2025-10-10T14:36:16.009909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:16.009923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:16.009938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:16.009942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:16.009973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:16.009977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:16.009979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:16.009984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601896622344443:4662]
2025-10-10T14:36:16.009988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:16.010076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:16.010320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1953
2025-10-10T14:36:16.010347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1953
2025-10-10T14:36:16.010358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573793:5674], now have 1 active actors on pipe
2025-10-10T14:36:16.010368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601897404573713:2438], now have 1 active actors on pipe
2025-10-10T14:36:16.010386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.010392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.010437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:16.010445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.010450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.010453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:16.010467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.010481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:16.010497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.010683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.010690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.010707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.010818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1954 partition: 0 MaxSeqNo: 40 sessionId: src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0
2025-10-10T14:36:16.011266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5821af0-93d588af-532c6852-f2adf050_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:16.014191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0] Write session: try to update token
2025-10-10T14:36:16.014211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:16.035016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId: src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:16.037721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:16.039478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.039506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.039530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:16.039533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:16.039537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:16.039539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:16.039548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601896622344443:4662]
2025-10-10T14:36:16.039552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601896622344443:4662]
2025-10-10T14:36:16.039556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601896622344443:4662]
2025-10-10T14:36:16.039616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:16.039624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.039626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:16.039769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:16.041401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:16.041410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:16.041414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:16.057045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601901699541323:6092]
2025-10-10T14:36:16.057426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1953, pipe: [1:7559601901699541323:6092]
2025-10-10T14:36:16.159122Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:16.159690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:16.159853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:16.159763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699541323:6092], now have 1 active actors on pipe
2025-10-10T14:36:16.161466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:16.161541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601901699541323:6092]
2025-10-10T14:36:16.173149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:16.173163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:16.173191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1954 reason: error at write: Disconnected sessionId: src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0
2025-10-10T14:36:16.173375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1954 sessionId: src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0 is DEAD
2025-10-10T14:36:16.173554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:16.173564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0] Write session will restart in 0.007013s
2025-10-10T14:36:16.173589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0] Write session: Do CDS request
2025-10-10T14:36:16.173597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:16.181884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.182019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:16.182034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1955
2025-10-10T14:36:16.182519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.182559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:16.182565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:16.182569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:16.183082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1955 sessionId:  describe result for acl check
2025-10-10T14:36:16.183118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:16.183122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:16.183124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:16.183130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601901699541409:5658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:16.183673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601901699541409:5658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:16.187539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601901699541409:5658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:16.190770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601901699541409:5658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:16.190784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601901699541409:5658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:16.190786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601901699541409:5658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:16.190793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:16.192275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:16.194913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:16.195147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:16.195160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:16.195172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:16.195229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:16.195273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601900917312073:4649]
2025-10-10T14:36:16.195896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:16.196250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:16.196326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:16.196667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:16.196729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.196738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.196739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.196740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.196742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.196743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.196745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.196747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.196748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.196750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.196751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.196752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.196754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.196760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.196775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.196779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.196783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.196786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.196790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.196795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.196799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.196804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.196809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.196813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.196817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.196821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.196830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.196839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.196846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.196853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.196857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.196863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.196868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.196873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.196878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.196884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.196888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.196893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.196904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.196911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.196916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.196939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.196944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.196949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.196954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.196958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.196963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.196971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.196975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.196981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.196987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.196992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.197035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:16.199567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:16.200387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:16.200407Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:16.200410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:16.200414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:16.200421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1954 [2:7559601900917312073:4649]
2025-10-10T14:36:16.200434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:16.200453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:16.200462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.200466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.200468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.200487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:16.200496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:16.200504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:16.200571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.200578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.200580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.200583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:16.200651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:16.200659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.200671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.200684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.200706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:16.200733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699541604:5658], now have 1 active actors on pipe
2025-10-10T14:36:16.200741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699541328:2438], now have 1 active actors on pipe
2025-10-10T14:36:16.200749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601900917312068:4649]
2025-10-10T14:36:16.200753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601900917312068:4649]
2025-10-10T14:36:16.200755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601900917312068:4649]
2025-10-10T14:36:16.200771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:16.200786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:16.200792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:16.200795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:16.200797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:16.200809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:16.200817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:16.200782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1954
2025-10-10T14:36:16.200794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1954
2025-10-10T14:36:16.200846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601900917312068:4649]
2025-10-10T14:36:16.200855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:16.200857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:16.200876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.200887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.200950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35741248-622112fb-3a5152-ea6de642_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:16.200966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.200970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.200973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:16.200984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.200995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:16.201012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.201188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.201197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.201213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.201311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1955 partition: 0 MaxSeqNo: 40 sessionId: src_id|35741248-622112fb-3a5152-ea6de642_0
2025-10-10T14:36:16.201722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|332e6b7a-4e511b5d-e28baf6-c1ca9647_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35741248-622112fb-3a5152-ea6de642_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:16.204497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35741248-622112fb-3a5152-ea6de642_0] Write session: try to update token
2025-10-10T14:36:16.204517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35741248-622112fb-3a5152-ea6de642_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:16.219530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId: src_id|35741248-622112fb-3a5152-ea6de642_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:16.220947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:16.220964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:16.220968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:16.220970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:16.220982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601900917312068:4649]
2025-10-10T14:36:16.220987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601900917312068:4649]
2025-10-10T14:36:16.220990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601900917312068:4649]
2025-10-10T14:36:16.221041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:16.221049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.221047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:16.221051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:16.221055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:16.221059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:16.221191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:16.223632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:16.261867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601901699541618:6092]
2025-10-10T14:36:16.262140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1954, pipe: [1:7559601901699541618:6092]
2025-10-10T14:36:16.338595Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:16.339198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.339223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.339290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699541618:6092], now have 1 active actors on pipe
2025-10-10T14:36:16.339627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:16.339641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:16.339632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601901699541618:6092]
2025-10-10T14:36:16.339663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:16.339701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1955 reason: error at write: Disconnected sessionId: src_id|35741248-622112fb-3a5152-ea6de642_0
2025-10-10T14:36:16.339909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1955 sessionId: src_id|35741248-622112fb-3a5152-ea6de642_0 is DEAD
2025-10-10T14:36:16.339600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:16.340093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35741248-622112fb-3a5152-ea6de642_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:16.340105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35741248-622112fb-3a5152-ea6de642_0] Write session will restart in 0.005759s
2025-10-10T14:36:16.340132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35741248-622112fb-3a5152-ea6de642_0] Write session: Do CDS request
2025-10-10T14:36:16.340142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35741248-622112fb-3a5152-ea6de642_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:16.346976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35741248-622112fb-3a5152-ea6de642_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.347090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:16.347107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1956
2025-10-10T14:36:16.347270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.347303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:16.347309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:16.347314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:16.347756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1956 sessionId:  describe result for acl check
2025-10-10T14:36:16.347785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:16.347787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:16.347789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:16.347796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601901699541638:5646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:16.348400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601901699541638:5646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:16.352613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601901699541638:5646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:16.356546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601901699541638:5646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:16.356564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601901699541638:5646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:16.356568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601901699541638:5646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:16.356577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:16.363394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:16.366583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:16.366956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:16.366970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:16.366984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:16.367075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:16.367125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601900917312364:4647]
2025-10-10T14:36:16.367772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:16.368124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:16.368190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:16.368583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:16.368656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.368662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.368663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.368665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.368666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.368668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.368669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.368671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.368672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.368673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.368675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.368676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.368678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.368685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.368700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.368704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.368708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.368713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.368718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.368722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.368726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.368730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.368735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.368739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.368743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.368747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.368757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.368766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.368772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.368779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.368784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.368790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.368794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.368800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.368805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.368816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.368821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.368826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.368831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.368837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.368841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.368847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.368856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.368863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.368873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.368878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.368883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.368893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.368897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.368903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.368908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.368914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.368966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:16.371879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:16.372692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:16.372705Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:16.372708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:16.372713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:16.372721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1955 [2:7559601900917312364:4647]
2025-10-10T14:36:16.372738Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:16.372760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:16.372771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.372775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.372777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.372798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:16.372811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:16.372824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:16.372898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.372904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.372906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.372909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:16.373001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:16.373004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.373018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.373034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.373051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:16.373079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699541782:5646], now have 1 active actors on pipe
2025-10-10T14:36:16.373088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699541623:2438], now have 1 active actors on pipe
2025-10-10T14:36:16.373096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601900917312359:4647]
2025-10-10T14:36:16.373103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601900917312359:4647]
2025-10-10T14:36:16.373106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601900917312359:4647]
2025-10-10T14:36:16.373121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:16.373141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:16.373146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:16.373149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:16.373152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:16.373163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:16.373167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:16.373210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601900917312359:4647]
2025-10-10T14:36:16.373222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:16.373232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:16.373198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1955
2025-10-10T14:36:16.373324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1955
2025-10-10T14:36:16.373390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.373401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.373432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:16.373445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.373450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.373453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:16.373465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.373479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:16.373502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.373737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.373747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.373765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.373869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1956 partition: 0 MaxSeqNo: 40 sessionId: src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0
2025-10-10T14:36:16.374318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35741248-622112fb-3a5152-ea6de642_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:16.377442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0] Write session: try to update token
2025-10-10T14:36:16.377460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:16.385144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:16.385158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:16.385181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601900917312359:4647]
2025-10-10T14:36:16.385225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:16.385235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:16.385429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:16.385570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:16.385708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:16.385857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:16.386052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:16.386092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:16.395021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId: src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:16.397762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:16.397989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.398018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.398071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:16.398172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:16.403619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:16.403636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:16.403640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:16.403642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:16.403654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601900917312359:4647]
2025-10-10T14:36:16.403658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601900917312359:4647]
2025-10-10T14:36:16.403662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601900917312359:4647]
2025-10-10T14:36:16.403708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:16.403710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:16.403718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.403720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:16.403722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:16.403727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:16.403856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:16.440017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601901699541917:6092]
2025-10-10T14:36:16.440335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1955, pipe: [1:7559601901699541917:6092]
2025-10-10T14:36:16.518558Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:16.527625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.527657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.527849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.527922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.527999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.528077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.528128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.528137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.528224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.528296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.528370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.528447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.528495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.528503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.528576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.528648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.528720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.528789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.528838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.528848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.528934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.529008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.529072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.529140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.529183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.529186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.529261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.531775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:16.531789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:16.531828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1956 reason: error at write: Disconnected sessionId: src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0
2025-10-10T14:36:16.532158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:16.532170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0] Write session will restart in 0.005300s
2025-10-10T14:36:16.532207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0] Write session: Do CDS request
2025-10-10T14:36:16.532213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:16.532033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1956 sessionId: src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0 is DEAD
2025-10-10T14:36:16.532127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601901699541917:6092]
2025-10-10T14:36:16.532145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:16.529511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.529587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.529656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.529701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.529703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.529781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.529849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.529917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.529985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.530034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.530037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.530117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.530181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.530254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.530323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.530367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.530371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.530466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.530530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.530600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.530668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.530711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.530714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.530788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.530848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.530917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.530984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.531027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.531030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.531106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.531170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.531236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.531303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.531346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.531349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.531442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699541917:6092], now have 1 active actors on pipe
2025-10-10T14:36:16.533072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:16.538899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.539023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:16.539048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1957
2025-10-10T14:36:16.539177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.539216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:16.539227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:16.539232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:16.539649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1957 sessionId:  describe result for acl check
2025-10-10T14:36:16.539695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:16.539705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:16.539708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:16.539715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601901699541935:5643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:16.540338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601901699541935:5643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:16.543309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601901699541935:5643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:16.547651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601901699541935:5643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:16.547667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601901699541935:5643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:16.547671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601901699541935:5643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:16.547680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:16.556376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:16.559480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:16.559839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:16.559853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:16.559866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:16.559932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:16.559976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601900917312658:4645]
2025-10-10T14:36:16.560608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:16.560988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:16.561066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:16.561464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:16.561528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.561534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.561535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.561537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.561538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.561539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.561541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.561542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.561543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.561545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.561546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.561547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.561548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.561569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.561583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.561587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.561591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.561594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.561599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.561603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.561608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.561611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.561618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.561623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.561626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.561630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.561639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.561648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.561659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.561665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.561679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.561690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.561695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.561700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.561706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.561717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.561721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.561726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.561735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.561740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.561745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.561754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.561759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.561764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.561774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.561779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.561787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.561793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.561797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.561806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.561811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.561820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.561859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:16.564364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:16.565120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:16.565132Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:16.565134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:16.565139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:16.565146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1956 [2:7559601900917312658:4645]
2025-10-10T14:36:16.565160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:16.565181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:16.565185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.565189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.565191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.565210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:16.565223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:16.565232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:16.565300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.565307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.565309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.565312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:16.565439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:16.565449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.565462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.565473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.565491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:16.565582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1956
2025-10-10T14:36:16.565583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1956
2025-10-10T14:36:16.565517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699542033:5643], now have 1 active actors on pipe
2025-10-10T14:36:16.565526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699541920:2438], now have 1 active actors on pipe
2025-10-10T14:36:16.565533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601900917312653:4645]
2025-10-10T14:36:16.565535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601900917312653:4645]
2025-10-10T14:36:16.565538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601900917312653:4645]
2025-10-10T14:36:16.565551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:16.565567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:16.565572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:16.565575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:16.565577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:16.565583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:16.565586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:16.565622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601900917312653:4645]
2025-10-10T14:36:16.565630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:16.565645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:16.565803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.565815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.565857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cba41334-1e46a53e-888cea74-2c3b880d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:16.565874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.565879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.565882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:16.565895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.565907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:16.565934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.566136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.566145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.566163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.566251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1957 partition: 0 MaxSeqNo: 40 sessionId: src_id|cba41334-1e46a53e-888cea74-2c3b880d_0
2025-10-10T14:36:16.566706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c43344f-4eeb4416-283d74e9-90b62fe8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cba41334-1e46a53e-888cea74-2c3b880d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:16.569415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba41334-1e46a53e-888cea74-2c3b880d_0] Write session: try to update token
2025-10-10T14:36:16.569435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba41334-1e46a53e-888cea74-2c3b880d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:16.584113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId: src_id|cba41334-1e46a53e-888cea74-2c3b880d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:16.584426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:16.584446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:16.584459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601900917312653:4645]
2025-10-10T14:36:16.584514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:16.584700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:16.584854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:16.585019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:16.585066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:16.585167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:16.585431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:16.585476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:16.587031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:16.587253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.587269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.587307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:16.587397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:16.597187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:16.597210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:16.597213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:16.597216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:16.597227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601900917312653:4645]
2025-10-10T14:36:16.597232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601900917312653:4645]
2025-10-10T14:36:16.597240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601900917312653:4645]
2025-10-10T14:36:16.597293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:16.597299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:16.597301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.597304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:16.597306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:16.597311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:16.597461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:16.632538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601901699542216:6092]
2025-10-10T14:36:16.632879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1956, pipe: [1:7559601901699542216:6092]
2025-10-10T14:36:16.718014Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:16.727340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.727379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.727578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.727640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.727707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.727779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.728184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.728190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.728266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.728330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.728404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.728686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.728732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.728738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.728813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.728874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.728960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.729026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.729073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.729076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.729156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.729226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.729294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.732164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601901699542216:6092]
2025-10-10T14:36:16.732202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:16.732217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:16.732220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:16.732257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1957 reason: error at write: Disconnected sessionId: src_id|cba41334-1e46a53e-888cea74-2c3b880d_0
2025-10-10T14:36:16.729589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.729646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.729653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.729724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.729796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.729861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.729922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.729966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.729969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.730043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.730102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.730167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.730237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.730285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.730288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.730363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.730423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.730488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.730556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.730609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.730612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.730684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.730751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.732511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1957 sessionId: src_id|cba41334-1e46a53e-888cea74-2c3b880d_0 is DEAD
2025-10-10T14:36:16.730814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.730879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.730926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.730929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.731006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.731066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.731126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.731191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.731237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.731241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.731316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:16.731381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:16.731448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:16.731515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:16.731563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:16.731566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:16.731657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699542216:6092], now have 1 active actors on pipe
2025-10-10T14:36:16.732243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:16.732670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba41334-1e46a53e-888cea74-2c3b880d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:16.732679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba41334-1e46a53e-888cea74-2c3b880d_0] Write session will restart in 0.006378s
2025-10-10T14:36:16.732718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba41334-1e46a53e-888cea74-2c3b880d_0] Write session: Do CDS request
2025-10-10T14:36:16.732728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba41334-1e46a53e-888cea74-2c3b880d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:16.739921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cba41334-1e46a53e-888cea74-2c3b880d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.739998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:16.740015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1958
2025-10-10T14:36:16.740687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.740747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:16.740759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:16.740765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:16.741250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1958 sessionId:  describe result for acl check
2025-10-10T14:36:16.741289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:16.741297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:16.741298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:16.741304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601901699542233:5637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:16.741924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601901699542233:5637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:16.747773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601901699542233:5637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:16.751629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601901699542233:5637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:16.751645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601901699542233:5637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:16.751650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601901699542233:5637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:16.751659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:16.763865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:16.767017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:16.767261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:16.767267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:16.767280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:16.767337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:16.767380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601900917312951:4636]
2025-10-10T14:36:16.768017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:16.768378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:16.768427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:16.768765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:16.768821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.768823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.768824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.768825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.768826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.768828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.768829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.768831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.768832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.768833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.768834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.768836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.768837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.768843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.768857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.768862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.768867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.768871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.768876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.768881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.768885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.768890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.768895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.768899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.768904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.768908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.768931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.768940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.768947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.768953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.768958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.768966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.768971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.768977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.768983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.768988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.768993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.768998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.769003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.769008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.769013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.769019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.769028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.769033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.769039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.769045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.769050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.769055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.769059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.769065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.769069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.769074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.769119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:16.772074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:16.772998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:16.773011Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:16.773014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:16.773018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:16.773025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1957 [2:7559601900917312951:4636]
2025-10-10T14:36:16.773040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:16.773466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1957
2025-10-10T14:36:16.773472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1957
2025-10-10T14:36:16.773065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:16.773076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.773080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.773083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.773103Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:16.773112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:16.773121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:16.773183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.773187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.773189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.773192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:16.773265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:16.773268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.773282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.773295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.773313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:16.773352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601900917312946:4636]
2025-10-10T14:36:16.773355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601900917312946:4636]
2025-10-10T14:36:16.773357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601900917312946:4636]
2025-10-10T14:36:16.773371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:16.773387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699542305:5637], now have 1 active actors on pipe
2025-10-10T14:36:16.773392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699542225:2438], now have 1 active actors on pipe
2025-10-10T14:36:16.773401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:16.773418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:16.773422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:16.773456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601900917312946:4636]
2025-10-10T14:36:16.773459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:16.773605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:16.773609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:16.773611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:16.773618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:16.773853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.773860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.773893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:16.773902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.773907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.773910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:16.773923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.773936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:16.773953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.774142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.774145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.774160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.774291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1958 partition: 0 MaxSeqNo: 40 sessionId: src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0
2025-10-10T14:36:16.774652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cba41334-1e46a53e-888cea74-2c3b880d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:16.777204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0] Write session: try to update token
2025-10-10T14:36:16.777220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:16.795257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:16.795280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:16.795284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:16.795286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:16.795297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601900917312946:4636]
2025-10-10T14:36:16.795301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601900917312946:4636]
2025-10-10T14:36:16.795305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601900917312946:4636]
2025-10-10T14:36:16.795360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:16.795368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.795370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:16.795372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:16.795380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:16.795386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:16.795515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:16.795652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId: src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:16.798452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:16.832214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601901699542525:6092]
2025-10-10T14:36:16.832502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1957, pipe: [1:7559601901699542525:6092]
2025-10-10T14:36:16.912190Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:16.912641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.912654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.912695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699542525:6092], now have 1 active actors on pipe
2025-10-10T14:36:16.913025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:16.913038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:16.913072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601901699542525:6092]
2025-10-10T14:36:16.913090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:16.913119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1958 reason: error at write: Disconnected sessionId: src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0
2025-10-10T14:36:16.913128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:16.913320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1958 sessionId: src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0 is DEAD
2025-10-10T14:36:16.913492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:16.913512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0] Write session will restart in 0.007416s
2025-10-10T14:36:16.913538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0] Write session: Do CDS request
2025-10-10T14:36:16.913545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:16.925887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.925929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:16.925946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1959
2025-10-10T14:36:16.926240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:16.926294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:16.926305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:16.926309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:16.926963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1959 sessionId:  describe result for acl check
2025-10-10T14:36:16.927005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:16.927008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:16.927010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:16.927016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601901699542591:5633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:16.927653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601901699542591:5633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:16.933812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601901699542591:5633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:16.937371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601901699542591:5633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:16.937387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601901699542591:5633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:16.937391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601901699542591:5633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:16.937401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:16.940289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:16.943173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:16.943415Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:16.943421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:16.943432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:16.943486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:16.943523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601900917313259:4633]
2025-10-10T14:36:16.944166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:16.944517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:16.944582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:16.944953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:16.945012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.945017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.945019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.945020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.945021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.945022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.945024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.945025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.945026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.945027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.945029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.945030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.945031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.945037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.945049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.945052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.945056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.945060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.945064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.945068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.945072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.945075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.945079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.945083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.945086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.945090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.945098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.945106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:16.945114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.945119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:16.945123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.945128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:16.945131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.945136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:16.945141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.945145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:16.945149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.945154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:16.945158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.945163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:16.945181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.945193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:16.945206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.945211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:16.945216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.945220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:16.945224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.945229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.945233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.945238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.945242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.945247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.945284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:16.947814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:16.948305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:16.948320Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:16.948322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:16.948326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:16.948333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1958 [2:7559601900917313259:4633]
2025-10-10T14:36:16.948345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:16.948364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:16.948373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.948376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.948379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.948395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:16.948403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:16.948410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:16.948470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.948477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.948479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.948482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:16.948546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:16.948555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.948565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:16.948579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:16.948599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:16.948623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699542806:5633], now have 1 active actors on pipe
2025-10-10T14:36:16.948631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601901699542538:2438], now have 1 active actors on pipe
2025-10-10T14:36:16.948638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601900917313254:4633]
2025-10-10T14:36:16.948640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601900917313254:4633]
2025-10-10T14:36:16.948642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601900917313254:4633]
2025-10-10T14:36:16.948655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:16.948671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:16.948676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:16.948681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:16.948683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:16.948690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:16.948693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:16.948690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1958
2025-10-10T14:36:16.948695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1958
2025-10-10T14:36:16.948721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601900917313254:4633]
2025-10-10T14:36:16.948728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:16.948734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:16.948754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.948765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.948811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:16.948823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:16.948827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:16.948830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:16.948841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:16.948851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:16.948876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.949049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:16.949061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:16.949083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:16.949190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1959 partition: 0 MaxSeqNo: 40 sessionId: src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0
2025-10-10T14:36:16.949671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|875c6b84-4947b72c-f1f7f1a5-6d2ce679_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:16.952549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0] Write session: try to update token
2025-10-10T14:36:16.952573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:16.972298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:16.972320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:16.972324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:16.972327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:16.972337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601900917313254:4633]
2025-10-10T14:36:16.972341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601900917313254:4633]
2025-10-10T14:36:16.972347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601900917313254:4633]
2025-10-10T14:36:16.972391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:16.972399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:16.972404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:16.972406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:16.972415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:16.972417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:16.972559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:16.970958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId: src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:16.973825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:17.013437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601905994510133:6092]
2025-10-10T14:36:17.014129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1958, pipe: [1:7559601905994510133:6092]
2025-10-10T14:36:17.098970Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:17.099439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.099460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.099500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994510133:6092], now have 1 active actors on pipe
2025-10-10T14:36:17.099679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:17.100143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:17.100154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0] Write session will restart in 0.009810s
2025-10-10T14:36:17.100179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0] Write session: Do CDS request
2025-10-10T14:36:17.100186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:17.099674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601905994510133:6092]
2025-10-10T14:36:17.099723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:17.099729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:17.099789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1959 reason: error at write: Disconnected sessionId: src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0
2025-10-10T14:36:17.099997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1959 sessionId: src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0 is DEAD
2025-10-10T14:36:17.100184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:17.110999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.112179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:17.112214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1960
2025-10-10T14:36:17.112382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.112430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:17.112444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:17.112451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:17.112975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1960 sessionId:  describe result for acl check
2025-10-10T14:36:17.113039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:17.113042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:17.113044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:17.113052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601905994510207:5616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:17.113798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601905994510207:5616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:17.120636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601905994510207:5616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:17.124210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601905994510207:5616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:17.124228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601905994510207:5616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:17.124231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601905994510207:5616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:17.124241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:17.124570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:17.127957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:17.128398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:17.128417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:17.128434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:17.128515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:17.128577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601905212280888:4611]
2025-10-10T14:36:17.129254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:17.129698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:17.129768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:17.130104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:17.130177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.130179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.130180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.130181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.130183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.130184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.130186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.130187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.130189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.130190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.130191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.130193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.130194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.130202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.130216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.130220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.130223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.130227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.130231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.130234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.130238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.130241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.130246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.130249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.130253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.130256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.130263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.130272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.130279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.130284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.130289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.130293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.130297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.130302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.130310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.130317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.130321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.130327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.130332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.130337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.130342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.130347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.130352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.130357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.130362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.130368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.130372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.130378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.130383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.130388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.130392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.130397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.130436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:17.133362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:17.133991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:17.134005Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:17.134008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:17.134012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:17.134019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1959 [2:7559601905212280888:4611]
2025-10-10T14:36:17.134034Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:17.134055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:17.134059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.134063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.134066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.134086Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:17.134095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:17.134103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:17.134170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.134179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.134181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.134184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:17.134259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:17.134267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.134280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.134291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.134305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:17.134336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994510151:2438], now have 1 active actors on pipe
2025-10-10T14:36:17.134345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994510433:5616], now have 1 active actors on pipe
2025-10-10T14:36:17.134353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601905212280875:4611]
2025-10-10T14:36:17.134361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601905212280875:4611]
2025-10-10T14:36:17.134365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601905212280875:4611]
2025-10-10T14:36:17.134379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:17.134396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:17.134408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:17.134414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:17.134418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:17.134420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:17.134423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:17.134453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601905212280875:4611]
2025-10-10T14:36:17.134466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:17.134477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:17.134643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.134656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.134688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:17.134703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.134708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.134713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:17.134725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.134739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:17.134756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.134933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.134941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.134957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.135529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ef53d8-94a8e3c6-30f9d571-fcf99f62_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:17.134412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1959
2025-10-10T14:36:17.134427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1959
2025-10-10T14:36:17.135095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1960 partition: 0 MaxSeqNo: 40 sessionId: src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0
2025-10-10T14:36:17.138381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0] Write session: try to update token
2025-10-10T14:36:17.138403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:17.155649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId: src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:17.155801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:17.155819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:17.155822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:17.155824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:17.155833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601905212280875:4611]
2025-10-10T14:36:17.155837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601905212280875:4611]
2025-10-10T14:36:17.155842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601905212280875:4611]
2025-10-10T14:36:17.155895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:17.155895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:17.155903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:17.155908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:17.155908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.155910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:17.156052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:17.158426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:17.201462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601905994510458:6092]
2025-10-10T14:36:17.201777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1959, pipe: [1:7559601905994510458:6092]
2025-10-10T14:36:17.271024Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:17.271503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.271522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.271571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994510458:6092], now have 1 active actors on pipe
2025-10-10T14:36:17.271813Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:17.272347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:17.272360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0] Write session will restart in 0.009904s
2025-10-10T14:36:17.271855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601905994510458:6092]
2025-10-10T14:36:17.272385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0] Write session: Do CDS request
2025-10-10T14:36:17.271890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:17.272393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:17.271901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:17.271978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1960 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0
2025-10-10T14:36:17.272187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1960 sessionId: src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0 is DEAD
2025-10-10T14:36:17.283937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.284149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:17.284169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1961
2025-10-10T14:36:17.284330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.284373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:17.284384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:17.284389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:17.284804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1961 sessionId:  describe result for acl check
2025-10-10T14:36:17.284840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:17.284846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:17.284847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:17.284853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601905994510474:5600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:17.285482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601905994510474:5600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:17.288032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601905994510474:5600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:17.293362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601905994510474:5600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:17.293377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601905994510474:5600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:17.293381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601905994510474:5600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:17.293391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:17.306297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:17.310234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:17.310493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:17.310545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:17.310561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:17.310630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:17.310677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601905212281183:4607]
2025-10-10T14:36:17.311398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:17.311702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:17.311747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:17.312065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:17.312131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.312138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.312140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.312141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.312142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.312144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.312145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.312146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.312147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.312149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.312150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.312151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.312153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.312159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.312173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.312177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.312182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.312186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.312190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.312194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.312198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.312203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.312207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.312211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.312215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.312219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.312228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.312236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.312243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.312249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.312255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.312260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.312264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.312277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.312281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.312286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.312290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.312294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.312300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.312305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.312310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.312315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.312320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.312326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.312331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.312336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.312341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.312346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.312350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.312355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.312359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.312365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.312411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:17.314944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:17.315426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:17.315439Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:17.315441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:17.315445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:17.315451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1960 [2:7559601905212281183:4607]
2025-10-10T14:36:17.315464Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:17.315482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:17.315491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.315494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.315497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.315513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:17.315521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:17.315529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:17.315592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.315599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.315601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.315603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:17.315674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:17.315682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.315694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.315712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.315737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:17.315765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994510460:2438], now have 1 active actors on pipe
2025-10-10T14:36:17.315774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994510578:5600], now have 1 active actors on pipe
2025-10-10T14:36:17.315782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601905212281177:4607]
2025-10-10T14:36:17.315784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601905212281177:4607]
2025-10-10T14:36:17.315787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601905212281177:4607]
2025-10-10T14:36:17.315800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:17.315780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1960
2025-10-10T14:36:17.315819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:17.315795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1960
2025-10-10T14:36:17.315823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:17.315827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:17.315829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:17.315841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:17.315849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:17.315886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.315894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.315912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601905212281177:4607]
2025-10-10T14:36:17.315924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:17.315941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:17.315961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:17.315973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.315977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.315980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:17.315990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.316004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:17.316032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.316182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.316203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.316262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.316382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1961 partition: 0 MaxSeqNo: 40 sessionId: src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0
2025-10-10T14:36:17.316868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198ab83-db6f30bd-416f3974-1c0a850f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:17.319639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0] Write session: try to update token
2025-10-10T14:36:17.319658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:17.337411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId: src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:17.339648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:17.339667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:17.339670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:17.339672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:17.339680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601905212281177:4607]
2025-10-10T14:36:17.339684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601905212281177:4607]
2025-10-10T14:36:17.339689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601905212281177:4607]
2025-10-10T14:36:17.339735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:17.339740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:17.339740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:17.339743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:17.339747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.339750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:17.339890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:17.340195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:17.372762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601905994510760:6092]
2025-10-10T14:36:17.373176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1960, pipe: [1:7559601905994510760:6092]
2025-10-10T14:36:17.457428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:17.457882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.457896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.457937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994510760:6092], now have 1 active actors on pipe
2025-10-10T14:36:17.458168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:17.458692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:17.458738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:17.458814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1961 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0
2025-10-10T14:36:17.458997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1961 sessionId: src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0 is DEAD
2025-10-10T14:36:17.459149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601905994510760:6092]
2025-10-10T14:36:17.465428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:17.465447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0] Write session will restart in 0.008463s
2025-10-10T14:36:17.465488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0] Write session: Do CDS request
2025-10-10T14:36:17.465494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:17.474949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.477654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:17.477671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1962
2025-10-10T14:36:17.477839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.477893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:17.477899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:17.477904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:17.478514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1962 sessionId:  describe result for acl check
2025-10-10T14:36:17.478543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:17.478546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:17.478548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:17.478555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601905994510953:5598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:17.479163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601905994510953:5598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:17.482006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601905994510953:5598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:17.484800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:17.484893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601905994510953:5598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:17.484916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601905994510953:5598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:17.484921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601905994510953:5598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:17.484930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:17.487298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:17.487534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:17.487545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:17.487558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:17.487614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:17.487659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601905212281479:4605]
2025-10-10T14:36:17.488265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:17.488588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:17.488633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:17.488965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:17.489060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.489066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.489067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.489069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.489070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.489071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.489072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.489074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.489075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.489077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.489078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.489079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.489081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.489087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.489101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.489105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.489110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.489114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.489118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.489122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.489125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.489129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.489134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.489138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.489142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.489163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.489177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.489186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.489197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.489208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.489217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.489226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.489231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.489240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.489245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.489251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.489255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.489264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.489269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.489275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.489293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.489302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.489308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.489317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.489322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.489346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.489351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.489358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.489369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.489374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.489379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.489384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.489425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:17.491837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:17.492323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:17.492335Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:17.492337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:17.492341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:17.492347Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1961 [2:7559601905212281479:4605]
2025-10-10T14:36:17.492358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:17.492377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:17.492380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.492384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.492387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.492404Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:17.492416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:17.492423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:17.492484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.492490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.492492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.492495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:17.492560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:17.492571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.492581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.492594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.492616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:17.492642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994510762:2438], now have 1 active actors on pipe
2025-10-10T14:36:17.492651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994511050:5598], now have 1 active actors on pipe
2025-10-10T14:36:17.492660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601905212281473:4605]
2025-10-10T14:36:17.492662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601905212281473:4605]
2025-10-10T14:36:17.492664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601905212281473:4605]
2025-10-10T14:36:17.492679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:17.492699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:17.492703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:17.492707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:17.492709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:17.492718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:17.492722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:17.492727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1961
2025-10-10T14:36:17.492750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601905212281473:4605]
2025-10-10T14:36:17.492757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:17.492760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:17.492731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1961
2025-10-10T14:36:17.492789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.492801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.493178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:17.493193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.493197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.493200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:17.493211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.493223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:17.493252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.493440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.493448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.493464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.493559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1962 partition: 0 MaxSeqNo: 40 sessionId: src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0
2025-10-10T14:36:17.493968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8910be9c-35bc2cba-ff79125-b14fe9a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:17.496589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0] Write session: try to update token
2025-10-10T14:36:17.496608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:17.511049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId: src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:17.513119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:17.513138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:17.513141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:17.513143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:17.513153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601905212281473:4605]
2025-10-10T14:36:17.513158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601905212281473:4605]
2025-10-10T14:36:17.513165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601905212281473:4605]
2025-10-10T14:36:17.513220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:17.513231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.513234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:17.513233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:17.513242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:17.513247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:17.513401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:17.513770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:17.559256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601905994511062:6092]
2025-10-10T14:36:17.559680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1961, pipe: [1:7559601905994511062:6092]
2025-10-10T14:36:17.629714Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:17.630237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.630254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.630304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994511062:6092], now have 1 active actors on pipe
2025-10-10T14:36:17.630598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:17.631029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:17.631041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0] Write session will restart in 0.009606s
2025-10-10T14:36:17.631064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0] Write session: Do CDS request
2025-10-10T14:36:17.631070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:17.630592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601905994511062:6092]
2025-10-10T14:36:17.630624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:17.630623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:17.630626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:17.630692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1962 reason: error at write: Disconnected sessionId: src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0
2025-10-10T14:36:17.630876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1962 sessionId: src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0 is DEAD
2025-10-10T14:36:17.645833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.646067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:17.646084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1963
2025-10-10T14:36:17.649455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.649522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:17.649534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:17.649541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:17.652183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1963 sessionId:  describe result for acl check
2025-10-10T14:36:17.652228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:17.652235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:17.652237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:17.652244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601905994511279:5594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:17.652860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601905994511279:5594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:17.655167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601905994511279:5594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:17.655924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:17.658917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:17.659163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:17.659175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:17.659188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:17.659249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:17.659257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601905994511279:5594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:17.659271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601905994511279:5594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:17.659275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601905994511279:5594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:17.659293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601905212281775:4603]
2025-10-10T14:36:17.659283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:17.659966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:17.660265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:17.660313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:17.660648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:17.660705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.660711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.660712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.660714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.660715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.660717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.660718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.660719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.660721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.660722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.660723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.660724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.660726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.660732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.660747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.660751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.660756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.660761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.660766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.660770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.660775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.660779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.660783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.660787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.660792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.660796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.660803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.660817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.660829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.660835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.660840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.660846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.660850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.660856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.660862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.660872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.660877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.660887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.660904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.660914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.660919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.660925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.660931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.660936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.660942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.660947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.660952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.660963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.660968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.660979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.660988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.660994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.661044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:17.663517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:17.663989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:17.664005Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:17.664017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:17.664021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:17.664026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1962 [2:7559601905212281775:4603]
2025-10-10T14:36:17.664040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:17.664060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:17.664067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.664070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.664073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.664090Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:17.664101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:17.664110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:17.664173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.664179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.664181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.664183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:17.664255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:17.664262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.664272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.664287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.664306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:17.664335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601905212281770:4603]
2025-10-10T14:36:17.664337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601905212281770:4603]
2025-10-10T14:36:17.664339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601905212281770:4603]
2025-10-10T14:36:17.664347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:17.664361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:17.664370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:17.664374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:17.664375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:17.664376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:17.664378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:17.664407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601905212281770:4603]
2025-10-10T14:36:17.664411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:17.664422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994511355:5594], now have 1 active actors on pipe
2025-10-10T14:36:17.664423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:17.664425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994511063:2438], now have 1 active actors on pipe
2025-10-10T14:36:17.664744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1962
2025-10-10T14:36:17.664766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1962
2025-10-10T14:36:17.665311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.665327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.665383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:17.665399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.665403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.665406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:17.665418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.665436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:17.665453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.665710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.665725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.665746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.665873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1963 partition: 0 MaxSeqNo: 40 sessionId: src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0
2025-10-10T14:36:17.666322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|737ce2d6-b373a03e-dcbb3a24-4a658b19_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:17.668955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0] Write session: try to update token
2025-10-10T14:36:17.668972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:17.683839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId: src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:17.684927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:17.684952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:17.684954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:17.684956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:17.684965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601905212281770:4603]
2025-10-10T14:36:17.684970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601905212281770:4603]
2025-10-10T14:36:17.684975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601905212281770:4603]
2025-10-10T14:36:17.685035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:17.685035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:17.685041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:17.685044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.685046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:17.685048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:17.685207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:17.686547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:17.730797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601905994511373:6092]
2025-10-10T14:36:17.731251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1962, pipe: [1:7559601905994511373:6092]
2025-10-10T14:36:17.808304Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:17.808906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.808929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.808980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994511373:6092], now have 1 active actors on pipe
2025-10-10T14:36:17.809209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:17.809249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:17.809267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601905994511373:6092]
2025-10-10T14:36:17.809275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:17.809305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:17.809366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1963 reason: error at write: Disconnected sessionId: src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0
2025-10-10T14:36:17.809579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1963 sessionId: src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0 is DEAD
2025-10-10T14:36:17.809751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:17.809764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0] Write session will restart in 0.005865s
2025-10-10T14:36:17.809790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0] Write session: Do CDS request
2025-10-10T14:36:17.809800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:17.816943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.817012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:17.817027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1964
2025-10-10T14:36:17.817211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:17.817251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:17.817263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:17.817267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:17.817708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1964 sessionId:  describe result for acl check
2025-10-10T14:36:17.817743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:17.817751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:17.817754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:17.817760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601905994511393:5589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:17.818329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601905994511393:5589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:17.821389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601905994511393:5589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:17.825592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601905994511393:5589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:17.825615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601905994511393:5589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:17.825619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601905994511393:5589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:17.825628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:17.833202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:17.836524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:17.836784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:17.836798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:17.836813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:17.836878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:17.836939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601905212282074:4598]
2025-10-10T14:36:17.837616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:17.837917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:17.837960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:17.838256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:17.838304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.838310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.838311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.838311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.838312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.838313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.838314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.838316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.838317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.838318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.838319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.838321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.838322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.838328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.838341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.838346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.838350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.838354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.838359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.838362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.838364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.838366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.838371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.838373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.838375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.838377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.838384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.838393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:17.838400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.838405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:17.838409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.838414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:17.838418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.838423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:17.838428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.838433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:17.838438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.838443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:17.838448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.838452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:17.838454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.838458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:17.838461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.838465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:17.838467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.838471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:17.838474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.838477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.838481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.838485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.838487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.838491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.838523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:17.841097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:17.841622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:17.841637Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:17.841640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:17.841644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:17.841651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1963 [2:7559601905212282074:4598]
2025-10-10T14:36:17.841665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:17.841684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:17.841688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.841691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.841694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.841711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:17.841720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:17.841730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:17.841794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.841804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.841806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.841809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:17.842004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1963
2025-10-10T14:36:17.842008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1963
2025-10-10T14:36:17.842255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:17.842267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.842282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:17.842301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:17.842320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:17.842345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994511532:5589], now have 1 active actors on pipe
2025-10-10T14:36:17.842354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994511378:2438], now have 1 active actors on pipe
2025-10-10T14:36:17.842371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.842381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.842405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601905212282069:4598]
2025-10-10T14:36:17.842411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601905212282069:4598]
2025-10-10T14:36:17.842414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601905212282069:4598]
2025-10-10T14:36:17.842427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:17.842442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:17.842443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:17.842447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:17.842449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:17.842465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:17.842469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:17.842488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb007964-a9badd59-1a02265-be384469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:17.842501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:17.842510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:17.842512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:17.842524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:17.842541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:17.842577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601905212282069:4598]
2025-10-10T14:36:17.842589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:17.842600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.842615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:17.842774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.842782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.842797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:17.842888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1964 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb007964-a9badd59-1a02265-be384469_0
2025-10-10T14:36:17.843318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ce4a42-e2868c6c-1163fb18-853810b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb007964-a9badd59-1a02265-be384469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:17.846007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb007964-a9badd59-1a02265-be384469_0] Write session: try to update token
2025-10-10T14:36:17.846027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb007964-a9badd59-1a02265-be384469_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:17.854687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:17.854705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:17.854717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601905212282069:4598]
2025-10-10T14:36:17.854769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:17.854772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:17.854948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:17.855094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:17.855241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:17.855386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:17.855596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:17.855641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:17.862678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId: src_id|cb007964-a9badd59-1a02265-be384469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:17.865427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:17.865673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:17.865704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:17.865747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:17.865827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:17.877591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:17.877612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:17.877616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:17.877619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:17.877631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601905212282069:4598]
2025-10-10T14:36:17.877638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601905212282069:4598]
2025-10-10T14:36:17.877644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601905212282069:4598]
2025-10-10T14:36:17.877702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:17.877707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:17.877718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:17.877722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:17.877724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:17.877725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:17.877899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:17.909395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601905994511692:6092]
2025-10-10T14:36:17.909628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1963, pipe: [1:7559601905994511692:6092]
2025-10-10T14:36:18.011613Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:18.022927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.022962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.023191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.023276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.023364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.023442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.023514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.023525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.023612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.023689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.023769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.023851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.023916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.023925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.024011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.024085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.024165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.024246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.024305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.024314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.024400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.024476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.024555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.024629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.024692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.024701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.024781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.024861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.024952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.025033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.025095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.025105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.025189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.025257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.025353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.025431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.025488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.025497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.025579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.025648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.025721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.025793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.025850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.025858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.025936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.026009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.026105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.026179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.026237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.026245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.026323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.026398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.026477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.026549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.026608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.026616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.026700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.026775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.026848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.026923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.026979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.026987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.027062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601905994511692:6092], now have 1 active actors on pipe
2025-10-10T14:36:18.027438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601905994511692:6092]
2025-10-10T14:36:18.027437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:18.027453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:18.027483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:18.027488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1964 reason: error at write: Disconnected sessionId: src_id|cb007964-a9badd59-1a02265-be384469_0
2025-10-10T14:36:18.027703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1964 sessionId: src_id|cb007964-a9badd59-1a02265-be384469_0 is DEAD
2025-10-10T14:36:18.027876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb007964-a9badd59-1a02265-be384469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:18.027887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb007964-a9badd59-1a02265-be384469_0] Write session will restart in 0.005726s
2025-10-10T14:36:18.027907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb007964-a9badd59-1a02265-be384469_0] Write session: Do CDS request
2025-10-10T14:36:18.027913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb007964-a9badd59-1a02265-be384469_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:18.028604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:18.034917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb007964-a9badd59-1a02265-be384469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.035047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:18.035067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1965
2025-10-10T14:36:18.035199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.035238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:18.035251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:18.035256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:18.035746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1965 sessionId:  describe result for acl check
2025-10-10T14:36:18.035786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:18.035793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:18.035795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:18.035802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601910289479008:5581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:18.036397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601910289479008:5581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:18.038896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601910289479008:5581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:18.043106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601910289479008:5581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:18.043121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601910289479008:5581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:18.043125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601910289479008:5581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:18.043134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:18.052537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:18.056158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:18.056424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:18.056437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:18.056451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:18.056510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:18.056562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601909507249684:4592]
2025-10-10T14:36:18.057291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:18.057701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:18.057758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:18.058133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:18.058202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.058210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.058212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.058213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.058218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.058220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.058221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.058223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.058234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.058236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.058237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.058238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.058239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.058245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.058257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.058261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.058266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.058270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.058275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.058278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.058282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.058286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.058290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.058294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.058298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.058302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.058314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.058323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.058336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.058342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.058347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.058352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.058357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.058362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.058367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.058373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.058387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.058393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.058399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.058405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.058410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.058416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.058422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.058427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.058432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.058438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.058450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.058455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.058460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.058465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.058470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.058474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.058516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:18.061079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:18.061981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:18.061992Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:18.061995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:18.061998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:18.062005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1964 [2:7559601909507249684:4592]
2025-10-10T14:36:18.062019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:18.062037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:18.062039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.062043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.062046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.062061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:18.062073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:18.062079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:18.062146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.062152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.062154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.062157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:18.062224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:18.062231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.062242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.062253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.062267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:18.062289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479131:5581], now have 1 active actors on pipe
2025-10-10T14:36:18.062297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289478993:2438], now have 1 active actors on pipe
2025-10-10T14:36:18.062304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601909507249679:4592]
2025-10-10T14:36:18.062307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601909507249679:4592]
2025-10-10T14:36:18.062310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601909507249679:4592]
2025-10-10T14:36:18.062323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:18.062336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:18.062339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:18.062345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:18.062348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:18.062353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:18.062356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:18.062381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601909507249679:4592]
2025-10-10T14:36:18.062394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:18.062411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:18.062392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1964
2025-10-10T14:36:18.062393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1964
2025-10-10T14:36:18.063031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.063043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.063075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:18.063087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.063092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.063099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:18.063113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.063128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:18.063147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.063312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.063320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.063332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.063455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1965 partition: 0 MaxSeqNo: 40 sessionId: src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0
2025-10-10T14:36:18.063874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb007964-a9badd59-1a02265-be384469_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:18.066671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0] Write session: try to update token
2025-10-10T14:36:18.066694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:18.083505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId: src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:18.084136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:18.084158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:18.084162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:18.084164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:18.084176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601909507249679:4592]
2025-10-10T14:36:18.084183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601909507249679:4592]
2025-10-10T14:36:18.084188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601909507249679:4592]
2025-10-10T14:36:18.084246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:18.084252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:18.084261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.084261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:18.084264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:18.084266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:18.084436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:18.086282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:18.127589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601910289479294:6092]
2025-10-10T14:36:18.127931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1964, pipe: [1:7559601910289479294:6092]
2025-10-10T14:36:18.207631Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:18.208027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.208042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.208088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479294:6092], now have 1 active actors on pipe
2025-10-10T14:36:18.208426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:18.208918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:18.208942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0] Write session will restart in 0.006367s
2025-10-10T14:36:18.208969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0] Write session: Do CDS request
2025-10-10T14:36:18.208975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:18.208415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:18.208425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:18.208439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:18.208481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601910289479294:6092]
2025-10-10T14:36:18.208518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1965 reason: error at write: Disconnected sessionId: src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0
2025-10-10T14:36:18.208737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1965 sessionId: src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0 is DEAD
2025-10-10T14:36:18.216948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.217039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:18.217059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1966
2025-10-10T14:36:18.217243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.217293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:18.217304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:18.217309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:18.217845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1966 sessionId:  describe result for acl check
2025-10-10T14:36:18.217884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:18.217890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:18.217892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:18.217899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601910289479342:5559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:18.218467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601910289479342:5559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:18.221650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601910289479342:5559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:18.226434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601910289479342:5559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:18.226450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601910289479342:5559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:18.226454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601910289479342:5559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:18.226464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:18.233981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:18.238168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:18.238433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:18.238444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:18.238456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:18.238529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:18.238590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601909507250023:4552]
2025-10-10T14:36:18.239249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:18.239716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:18.239775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:18.240134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:18.240223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.240231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.240232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.240233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.240234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.240236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.240237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.240239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.240240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.240242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.240243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.240244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.240246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.240253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.240265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.240269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.240273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.240277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.240281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.240285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.240288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.240292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.240296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.240299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.240304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.240307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.240316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.240324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.240331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.240338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.240344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.240349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.240354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.240359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.240367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.240373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.240377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.240382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.240387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.240392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.240397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.240410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.240415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.240425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.240430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.240435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.240446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.240450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.240456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.240462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.240467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.240473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.240528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:18.245637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:18.246356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:18.246376Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:18.246394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:18.246398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:18.246406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1965 [2:7559601909507250023:4552]
2025-10-10T14:36:18.246434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:18.246456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:18.246460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.246464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.246467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.246483Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:18.246490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:18.246504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:18.246586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.246595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.246598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.246601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:18.246676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:18.246687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.246701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.246856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1965
2025-10-10T14:36:18.246899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1965
2025-10-10T14:36:18.246721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.246745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:18.246766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479484:5559], now have 1 active actors on pipe
2025-10-10T14:36:18.246771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479323:2438], now have 1 active actors on pipe
2025-10-10T14:36:18.246778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601909507250018:4552]
2025-10-10T14:36:18.246783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601909507250018:4552]
2025-10-10T14:36:18.246786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601909507250018:4552]
2025-10-10T14:36:18.246801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:18.246820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:18.246824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:18.246828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:18.246831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:18.246836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:18.246841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:18.246876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601909507250018:4552]
2025-10-10T14:36:18.246886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:18.246901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:18.247053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.247059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.247091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:18.247099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.247104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.247107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:18.247120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.247132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:18.247147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.247335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.247347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.247368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.247502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1966 partition: 0 MaxSeqNo: 40 sessionId: src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0
2025-10-10T14:36:18.248226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1096b21b-a4cd168-f441e266-1b5dbfb4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:18.251296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0] Write session: try to update token
2025-10-10T14:36:18.251320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:18.265486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:18.265510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:18.265523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601909507250018:4552]
2025-10-10T14:36:18.265586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:18.265595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:18.265804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:18.265970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:18.266123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:18.266269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:18.266481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:18.266520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:18.276336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId: src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:18.279025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:18.283845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:18.281423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.281451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.283550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:18.283555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:18.283558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:18.283561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:18.283572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601909507250018:4552]
2025-10-10T14:36:18.283577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601909507250018:4552]
2025-10-10T14:36:18.283583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601909507250018:4552]
2025-10-10T14:36:18.283643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:18.283658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:18.283664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:18.283668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:18.283674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.283674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:18.283677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:18.283831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:18.309239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601910289479625:6092]
2025-10-10T14:36:18.309604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1965, pipe: [1:7559601910289479625:6092]
2025-10-10T14:36:18.418255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:18.430418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.430459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.430686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.430770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.430852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.430940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.431004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.431020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.431108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.431184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.431267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.431356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.431421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.431428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.431515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.431586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.431660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.431734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.431786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.431790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.431877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.431950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.432026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.432100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.432155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.432159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.432249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.432321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.432396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.432473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.432530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.432534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.432630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.432703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.432778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.432884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.432943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.432947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.433035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.433111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.433189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.433264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.433322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.433326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.435228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601910289479625:6092]
2025-10-10T14:36:18.435288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:18.435292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:18.435330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1966 reason: error at write: Disconnected sessionId: src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0
2025-10-10T14:36:18.435549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1966 sessionId: src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0 is DEAD
2025-10-10T14:36:18.435725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:18.435739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0] Write session will restart in 0.006572s
2025-10-10T14:36:18.435765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0] Write session: Do CDS request
2025-10-10T14:36:18.435770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:18.435776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:18.433650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.433732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.433806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.433881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.433937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.433940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.434025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.434095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.434165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.434244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.434301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.434305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.434394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:18.434464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:18.434537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:18.434696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:18.434761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:18.434764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:18.434852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479625:6092], now have 1 active actors on pipe
2025-10-10T14:36:18.436952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:18.444294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.444412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:18.444429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1967
2025-10-10T14:36:18.444631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.444667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:18.444676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:18.444680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:18.445135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1967 sessionId:  describe result for acl check
2025-10-10T14:36:18.445167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:18.445169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:18.445171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:18.445181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601910289479640:5552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:18.445826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601910289479640:5552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:18.448902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601910289479640:5552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:18.455933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601910289479640:5552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:18.455954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601910289479640:5552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:18.455957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601910289479640:5552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:18.455967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:18.470983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:18.474904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:18.475141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:18.475146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:18.475157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:18.475210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:18.475253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601909507250325:4542]
2025-10-10T14:36:18.475952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:18.476281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:18.476324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:18.476680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:18.476740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.476741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.476743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.476744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.476746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.476747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.476749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.476750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.476752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.476753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.476755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.476756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.476758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.476763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.476775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.476780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.476784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.476789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.476794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.476798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.476803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.476807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.476812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.476816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.476820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.476825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.476833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.476842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.476849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.476854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.476860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.476865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.476884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.476890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.476896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.476902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.476906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.476913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.476919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.476924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.476929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.476935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.476942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.476947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.476953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.476959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.476964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.476971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.476978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.476983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.476989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.476994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.477039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:18.482351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:18.482784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:18.482798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:18.482801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:18.482805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:18.482812Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1966 [2:7559601909507250325:4542]
2025-10-10T14:36:18.482829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:18.482849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:18.482852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.482856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.482858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.482874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:18.482881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:18.482888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:18.482962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.482965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.482968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.482971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:18.483060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:18.483063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.483073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.483083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.483098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:18.483117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601909507250320:4542]
2025-10-10T14:36:18.483122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601909507250320:4542]
2025-10-10T14:36:18.483124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601909507250320:4542]
2025-10-10T14:36:18.483147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:18.483162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479627:2438], now have 1 active actors on pipe
2025-10-10T14:36:18.483166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479727:5552], now have 1 active actors on pipe
2025-10-10T14:36:18.483173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:18.483187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:18.483191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:18.483223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601909507250320:4542]
2025-10-10T14:36:18.483226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:18.483478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:18.483482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:18.483484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:18.483490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:18.485479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1966
2025-10-10T14:36:18.485529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1966
2025-10-10T14:36:18.487901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f353d06-44fbef25-b24ff7a0-5019565a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:18.485712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.485728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.485762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:18.485773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.485778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.485781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:18.485794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.485808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:18.485825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.486078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.486082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.486098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.491326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0] Write session: try to update token
2025-10-10T14:36:18.491344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:18.487387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1967 partition: 0 MaxSeqNo: 40 sessionId: src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0
2025-10-10T14:36:18.512397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:18.512425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:18.512429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:18.512431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:18.512442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601909507250320:4542]
2025-10-10T14:36:18.512448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601909507250320:4542]
2025-10-10T14:36:18.512454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601909507250320:4542]
2025-10-10T14:36:18.512518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:18.512525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:18.512529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.512532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:18.512532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:18.512537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:18.512703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:18.522513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId: src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:18.526032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:18.535656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601910289479933:6092]
2025-10-10T14:36:18.536103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1966, pipe: [1:7559601910289479933:6092]
2025-10-10T14:36:18.635276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:18.636147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.636169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.636207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479933:6092], now have 1 active actors on pipe
2025-10-10T14:36:18.636480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:18.637053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:18.637068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0] Write session will restart in 0.005148s
2025-10-10T14:36:18.637094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0] Write session: Do CDS request
2025-10-10T14:36:18.637100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:18.636509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:18.636517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601910289479933:6092]
2025-10-10T14:36:18.636548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:18.636639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1967 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0
2025-10-10T14:36:18.636894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1967 sessionId: src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0 is DEAD
2025-10-10T14:36:18.643934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.644054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:18.644072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1968
2025-10-10T14:36:18.644191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.644222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:18.644228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:18.644232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:18.644691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1968 sessionId:  describe result for acl check
2025-10-10T14:36:18.644723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:18.644725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:18.644727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:18.644733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601910289479951:5547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:18.645318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601910289479951:5547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:18.647949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601910289479951:5547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:18.651623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601910289479951:5547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:18.651642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601910289479951:5547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:18.651645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601910289479951:5547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:18.651653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:18.660303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:18.660919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:18.661118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:18.661131Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:18.661142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:18.661192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:18.661247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601909507250629:4545]
2025-10-10T14:36:18.661854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:18.663829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:18.663906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:18.664283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:18.664342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.664348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.664348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.664349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.664350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.664351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.664352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.664353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.664354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.664355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.664356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.664357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.664359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.664365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.664379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.664383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.664388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.664392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.664396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.664400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.664403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.664407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.664413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.664416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.664420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.664424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.664432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.664441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.664447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.664452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.664456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.664461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.664465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.664470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.664474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.664490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.664494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.664500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.664504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.664516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.664521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.664526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.664536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.664541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.664546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.664551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.664561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.664566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.664570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.664580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.664584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.664590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.664635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:18.667171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:18.667744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:18.667758Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:18.667760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:18.667764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:18.667771Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1967 [2:7559601909507250629:4545]
2025-10-10T14:36:18.667783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:18.667815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:18.667823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.667826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.667829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.667849Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:18.667856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:18.667864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:18.667927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.667934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.667936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.667939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:18.668007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:18.668018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.668029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.668040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.668056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:18.668080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289479935:2438], now have 1 active actors on pipe
2025-10-10T14:36:18.668088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289480073:5547], now have 1 active actors on pipe
2025-10-10T14:36:18.668096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601909507250623:4545]
2025-10-10T14:36:18.668099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601909507250623:4545]
2025-10-10T14:36:18.668101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601909507250623:4545]
2025-10-10T14:36:18.668114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:18.668132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:18.668152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:18.668152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:18.668156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:18.668158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:18.668160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:18.668186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601909507250623:4545]
2025-10-10T14:36:18.668193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:18.668195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:18.668218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1967
2025-10-10T14:36:18.668278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1967
2025-10-10T14:36:18.668324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.668338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.668378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:18.668393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.668401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.668404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:18.668416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.668433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:18.668466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.668677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.668688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.668711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.669020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1968 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0
2025-10-10T14:36:18.669451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95091784-2b59e8f7-b69a890d-b161a3a0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:18.672331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0] Write session: try to update token
2025-10-10T14:36:18.672350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:18.688618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:18.688635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:18.688638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:18.688640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:18.688651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601909507250623:4545]
2025-10-10T14:36:18.688657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601909507250623:4545]
2025-10-10T14:36:18.688675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601909507250623:4545]
2025-10-10T14:36:18.688718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:18.688723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:18.688726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:18.688730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:18.688734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.688737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:18.688891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:18.695116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId: src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:18.698060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:18.736842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601910289480247:6092]
2025-10-10T14:36:18.737186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1967, pipe: [1:7559601910289480247:6092]
2025-10-10T14:36:18.807417Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:18.808143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.808163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.808210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289480247:6092], now have 1 active actors on pipe
2025-10-10T14:36:18.808475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:18.808523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601910289480247:6092]
2025-10-10T14:36:18.808539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:18.808468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:18.808637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1968 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0
2025-10-10T14:36:18.808872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1968 sessionId: src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0 is DEAD
2025-10-10T14:36:18.808984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:18.808995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0] Write session will restart in 0.007116s
2025-10-10T14:36:18.809020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0] Write session: Do CDS request
2025-10-10T14:36:18.809027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:18.816915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.817082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:18.817107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1969
2025-10-10T14:36:18.817313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:18.817366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:18.817378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:18.817383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:18.817941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1969 sessionId:  describe result for acl check
2025-10-10T14:36:18.817992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:18.818000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:18.818002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:18.818008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601910289480260:5539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:18.818575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601910289480260:5539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:18.821478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601910289480260:5539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:18.824102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601910289480260:5539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:18.824135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601910289480260:5539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:18.824139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601910289480260:5539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:18.824147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:18.839976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:18.843317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:18.843746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:18.843765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:18.843783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:18.843872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:18.843925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601909507250933:4544]
2025-10-10T14:36:18.844570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:18.844926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:18.844984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:18.845322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:18.845423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.845431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.845433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.845434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.845435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.845437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.845438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.845439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.845441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.845442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.845444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.845445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.845447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.845453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.845467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.845471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.845476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.845494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.845499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.845503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.845507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.845512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.845516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.845528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.845531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.845536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.845546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.845556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:18.845568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.845574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:18.845585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.845591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:18.845602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.845608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:18.845619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.845624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:18.845634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.845639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:18.845648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.845655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:18.845659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.845669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:18.845675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.845683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:18.845693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.845699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:18.845706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.845712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.845722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.845728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.845736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.845742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.845787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:18.848423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:18.849135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:18.849155Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:18.849157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:18.849161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:18.849167Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1968 [2:7559601909507250933:4544]
2025-10-10T14:36:18.849183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:18.849219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:18.849223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.849226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.849229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.849247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:18.849254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:18.849262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:18.849355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.849366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.849368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.849370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:18.849605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1968
2025-10-10T14:36:18.849754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1968
2025-10-10T14:36:18.849447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:18.849459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.849472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:18.849485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:18.849504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:18.849528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289480298:5539], now have 1 active actors on pipe
2025-10-10T14:36:18.849534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289480252:2438], now have 1 active actors on pipe
2025-10-10T14:36:18.849542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601909507250928:4544]
2025-10-10T14:36:18.849544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601909507250928:4544]
2025-10-10T14:36:18.849547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601909507250928:4544]
2025-10-10T14:36:18.849563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:18.849577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:18.849580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:18.849581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:18.849584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:18.849598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:18.849602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:18.849630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601909507250928:4544]
2025-10-10T14:36:18.849633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:18.849636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:18.849904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.849911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.849943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:18.849952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:18.849957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:18.849960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:18.849972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:18.849984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:18.850002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.850184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.850197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.850215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:18.850302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1969 partition: 0 MaxSeqNo: 40 sessionId: src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0
2025-10-10T14:36:18.853618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b43d824-ea7dee13-9822cfd3-d592fbc4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:18.856359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0] Write session: try to update token
2025-10-10T14:36:18.856378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:18.870404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:18.870428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:18.870431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:18.870433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:18.870444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601909507250928:4544]
2025-10-10T14:36:18.870448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601909507250928:4544]
2025-10-10T14:36:18.870453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601909507250928:4544]
2025-10-10T14:36:18.870509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:18.870508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:18.870515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:18.870519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:18.870521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:18.870521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:18.870672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:18.872678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId: src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:18.875416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:18.908871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601910289480571:6092]
2025-10-10T14:36:18.909132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1968, pipe: [1:7559601910289480571:6092]
2025-10-10T14:36:18.992332Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:18.992645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:18.992665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:18.992730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289480571:6092], now have 1 active actors on pipe
2025-10-10T14:36:18.993011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:18.993032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601910289480571:6092]
2025-10-10T14:36:18.993035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:18.993054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:18.993096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1969 reason: error at write: Disconnected sessionId: src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0
2025-10-10T14:36:18.993312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1969 sessionId: src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0 is DEAD
2025-10-10T14:36:18.992999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:18.993698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:18.993710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0] Write session will restart in 0.005922s
2025-10-10T14:36:18.993735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0] Write session: Do CDS request
2025-10-10T14:36:18.993744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:19.000927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.001040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:19.001058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1970
2025-10-10T14:36:19.001211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.001250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:19.001261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:19.001265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:19.001742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1970 sessionId:  describe result for acl check
2025-10-10T14:36:19.001784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:19.001792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:19.001794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:19.001800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601914584447888:5531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:19.002388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601914584447888:5531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:19.007971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601914584447888:5531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:19.015949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601914584447888:5531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:19.015971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601914584447888:5531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:19.015975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601914584447888:5531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:19.015985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:19.051272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:19.053998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:19.054188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:19.054199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:19.054209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:19.054248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:19.054284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601913802218554:4531]
2025-10-10T14:36:19.054712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:19.055386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:19.055452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:19.055819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:19.055929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.055937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.055937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.055938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.055939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.055940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.055941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.055942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.055943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.055945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.055946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.055947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.055948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.055955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.055967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.055970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.055974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.055977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.055981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.055984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.055987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.055991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.055995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.055999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.056003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.056006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.056013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.056022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.056027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.056032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.056036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.056041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.056044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.056048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.056053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.056057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.056061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.056066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.056070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.056075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.056079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.056083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.056088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.056093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.056097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.056101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.056106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.056110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.056115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.056120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.056125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.056130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.056166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:19.059034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:19.059956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:19.059961Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:19.059964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:19.059969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:19.059977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1969 [2:7559601913802218554:4531]
2025-10-10T14:36:19.059994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:19.060016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:19.060019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.060025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.060027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.060046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:19.060055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:19.060065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:19.060135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.060139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.060141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.060143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:19.060225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:19.060228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.060241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.060253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.060271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:19.060291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601913802218549:4531]
2025-10-10T14:36:19.060294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601913802218549:4531]
2025-10-10T14:36:19.060296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601913802218549:4531]
2025-10-10T14:36:19.060305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:19.060319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:19.060321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601910289480577:2438], now have 1 active actors on pipe
2025-10-10T14:36:19.060323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:19.060325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:19.060325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584447968:5531], now have 1 active actors on pipe
2025-10-10T14:36:19.060335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:19.060351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:19.060354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:19.060387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601913802218549:4531]
2025-10-10T14:36:19.060394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:19.060403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:19.060470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.060475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.060506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:19.060514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.060518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.060521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:19.060535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.060547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:19.060562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.060921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.060936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.060954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.060399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1969
2025-10-10T14:36:19.060412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1969
2025-10-10T14:36:19.061078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1970 partition: 0 MaxSeqNo: 40 sessionId: src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0
2025-10-10T14:36:19.061483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d4a7b7-2227d9e7-5823b15e-49878557_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:19.064201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0] Write session: try to update token
2025-10-10T14:36:19.064223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:19.082462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:19.082487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:19.082491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:19.082493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:19.082504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601913802218549:4531]
2025-10-10T14:36:19.082509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601913802218549:4531]
2025-10-10T14:36:19.082513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601913802218549:4531]
2025-10-10T14:36:19.082561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:19.082575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.082578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:19.082734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:19.083171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId: src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:19.085491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:19.085510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:19.085515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:19.085903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:19.093420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601914584448181:6092]
2025-10-10T14:36:19.093688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1969, pipe: [1:7559601914584448181:6092]
2025-10-10T14:36:19.204048Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:19.204628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.204651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.204699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448181:6092], now have 1 active actors on pipe
2025-10-10T14:36:19.204941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:19.204963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:19.205016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:19.205025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:19.205084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1970 reason: error at write: Disconnected sessionId: src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0
2025-10-10T14:36:19.205284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1970 sessionId: src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0 is DEAD
2025-10-10T14:36:19.205538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601914584448181:6092]
2025-10-10T14:36:19.205728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:19.205740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0] Write session will restart in 0.006607s
2025-10-10T14:36:19.205767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0] Write session: Do CDS request
2025-10-10T14:36:19.205776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:19.212959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:19.213898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.213975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:19.213989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1971
2025-10-10T14:36:19.214766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:19.214955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:19.214970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:19.214982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:19.215034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:19.215079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601913802218645:4515]
2025-10-10T14:36:19.214419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.214461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:19.214467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:19.214471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:19.214859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1971 sessionId:  describe result for acl check
2025-10-10T14:36:19.214887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:19.214889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:19.214891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:19.214897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601914584448220:5517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:19.215371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601914584448220:5517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:19.215639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:19.215916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:19.215959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:19.216239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:19.216289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.216300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.216302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.216303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.216304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.216305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.216306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.216306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.216307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.216309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.216310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.216311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.216312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.216317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.216328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.216331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.216335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.216339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.216343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.216346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.216350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.216353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.216357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.216361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.216364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.216367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.216374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.216382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.216390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.216395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.216399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.216403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.216409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.216413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.216417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.216422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.216426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.216431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.216435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.216440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.216443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.216448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.216452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.216457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.216460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.216465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.216469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.216474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.216478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.216483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.216486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.216491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.216528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:19.217268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601914584448220:5517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:19.218869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:19.219259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:19.219275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:19.219277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:19.219281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:19.219287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1970 [2:7559601913802218645:4515]
2025-10-10T14:36:19.219300Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:19.219326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:19.219334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.219337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.219339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.219358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:19.219365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:19.219374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:19.219459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.219467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.219469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.219471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:19.219541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:19.219551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.219564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.219581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.219599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:19.219627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448197:2438], now have 1 active actors on pipe
2025-10-10T14:36:19.219641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601913802218640:4515]
2025-10-10T14:36:19.219647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601913802218640:4515]
2025-10-10T14:36:19.219650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601913802218640:4515]
2025-10-10T14:36:19.219663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:19.219677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:19.219683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:19.219686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:19.219688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:19.219698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:19.219702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:19.219734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601913802218640:4515]
2025-10-10T14:36:19.219749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:19.219754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:19.219998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601914584448220:5517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:19.220027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601914584448220:5517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:19.220031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601914584448220:5517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:19.220044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:19.220232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1970
2025-10-10T14:36:19.220619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448252:5517], now have 1 active actors on pipe
2025-10-10T14:36:19.220662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1970
2025-10-10T14:36:19.220720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.220731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.220764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:19.220780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.220784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.220787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:19.220800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.220824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:19.220840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.221043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.221051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.221066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.221225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1971 partition: 0 MaxSeqNo: 40 sessionId: src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0
2025-10-10T14:36:19.221639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43bb610c-494af2f9-6913fd0d-5ef36ef4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:19.224422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0] Write session: try to update token
2025-10-10T14:36:19.224440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:19.231952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:19.231966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:19.231978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601913802218640:4515]
2025-10-10T14:36:19.232032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:19.232043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:19.232210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:19.232374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:19.232542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:19.232685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:19.232896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:19.232932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:19.240709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId: src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:19.243519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:19.243742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.243779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.243823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:19.243904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:19.251125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:19.251153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:19.251157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:19.251160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:19.251173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601913802218640:4515]
2025-10-10T14:36:19.251179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601913802218640:4515]
2025-10-10T14:36:19.251186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601913802218640:4515]
2025-10-10T14:36:19.251253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:19.251269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.251273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:19.251271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:19.251280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:19.251285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:19.251445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:19.305979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601914584448270:6092]
2025-10-10T14:36:19.306283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1970, pipe: [1:7559601914584448270:6092]
2025-10-10T14:36:19.388085Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:19.399461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.399499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.399726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.399822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.399897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.399973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.400037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.400051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.400140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.400230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.400305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.400378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.400431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.400435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.400522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.400591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.400668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.400742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.400798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.400802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.400920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.400991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.401066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.401144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.401201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.401205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.401314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.401590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.401679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.401755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.401812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.401816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.401903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.401972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.402044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.402114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.402171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.402174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.402264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.402343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.402421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.402496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.402549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.402553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.402638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.402707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.402781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.402857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.402916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.402920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.403006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.403075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.403146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.403220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.403276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.403279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.403367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:19.403442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:19.403516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:19.403590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:19.403645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:19.403648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:19.403739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448270:6092], now have 1 active actors on pipe
2025-10-10T14:36:19.405856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:19.405923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601914584448270:6092]
2025-10-10T14:36:19.405954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:19.405962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:19.405997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1971 reason: error at write: Disconnected sessionId: src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0
2025-10-10T14:36:19.406154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:19.406194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1971 sessionId: src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0 is DEAD
2025-10-10T14:36:19.409461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:19.409480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0] Write session will restart in 0.007234s
2025-10-10T14:36:19.409507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0] Write session: Do CDS request
2025-10-10T14:36:19.409513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:19.417775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.420506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:19.420528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1972
2025-10-10T14:36:19.420798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.420842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:19.420866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:19.420872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:19.421599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1972 sessionId:  describe result for acl check
2025-10-10T14:36:19.421652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:19.421659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:19.421665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:19.421673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601914584448293:5509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:19.422284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601914584448293:5509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:19.423005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:19.424194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:19.424425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:19.424438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:19.424452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:19.424518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:19.424571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601913802218712:4498]
2025-10-10T14:36:19.425287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:19.425753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601914584448293:5509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:19.425805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:19.425868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:19.426286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:19.426379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.426384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.426387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.426388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.426390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.426391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.426393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.426395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.426397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.426398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.426400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.426401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.426403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.426410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.426424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.426429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.426433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.426438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.426442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.426447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.426452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.426456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.426461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.426465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.426470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.426474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.426483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.426493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.426500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.426506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.426511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.426517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.426522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.426528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.426536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.426546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.426551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.426555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.426561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.426640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.426649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.426663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.426670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.426681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.426686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.426693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.426698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.426709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.426714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.426724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.426731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.426740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.426786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:19.429380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601914584448293:5509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:19.429405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601914584448293:5509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:19.429409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601914584448293:5509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:19.429418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:19.429789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:19.430331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:19.430353Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:19.430355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:19.430360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:19.430370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1971 [2:7559601913802218712:4498]
2025-10-10T14:36:19.430385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:19.430408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:19.430411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.430414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.430416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.430432Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:19.430439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:19.430446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:19.430521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.430530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.430532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.430535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:19.430613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:19.430620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.430632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.430645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.430667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:19.430692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448273:2438], now have 1 active actors on pipe
2025-10-10T14:36:19.430701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448327:5509], now have 1 active actors on pipe
2025-10-10T14:36:19.430707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601913802218707:4498]
2025-10-10T14:36:19.430710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601913802218707:4498]
2025-10-10T14:36:19.430712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601913802218707:4498]
2025-10-10T14:36:19.430728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:19.430745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:19.430746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:19.430750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:19.430752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:19.430765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:19.430769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:19.430801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601913802218707:4498]
2025-10-10T14:36:19.430813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:19.430823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:19.430828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1971
2025-10-10T14:36:19.430850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1971
2025-10-10T14:36:19.430887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.430899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.430926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:19.430934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.430938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.430940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:19.430950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.430962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:19.430975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.431173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.431182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.431201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.431311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1972 partition: 0 MaxSeqNo: 40 sessionId: src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0
2025-10-10T14:36:19.433431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45892c1f-42e567e4-8dbe2da4-d31a5fde_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:19.436114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0] Write session: try to update token
2025-10-10T14:36:19.436130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:19.455470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:19.455495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:19.455499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:19.455507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:19.455518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601913802218707:4498]
2025-10-10T14:36:19.455523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601913802218707:4498]
2025-10-10T14:36:19.455529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601913802218707:4498]
2025-10-10T14:36:19.455595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:19.455610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.455613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:19.455653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:19.455662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:19.455666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:19.455777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:19.467146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId: src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:19.469750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:19.505864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601914584448335:6092]
2025-10-10T14:36:19.508377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1971, pipe: [1:7559601914584448335:6092]
2025-10-10T14:36:19.585287Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:19.585731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.585749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.585772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448335:6092], now have 1 active actors on pipe
2025-10-10T14:36:19.586055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:19.586691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:19.586706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0] Write session will restart in 0.006918s
2025-10-10T14:36:19.586742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0] Write session: Do CDS request
2025-10-10T14:36:19.586749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:19.586127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601914584448335:6092]
2025-10-10T14:36:19.586174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:19.586217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:19.586309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1972 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0
2025-10-10T14:36:19.586525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1972 sessionId: src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0 is DEAD
2025-10-10T14:36:19.594962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.596730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:19.596748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1973
2025-10-10T14:36:19.597137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.597183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:19.597196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:19.597220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:19.597812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1973 sessionId:  describe result for acl check
2025-10-10T14:36:19.597853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:19.597860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:19.597862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:19.597872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601914584448357:5496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:19.598495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601914584448357:5496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:19.600920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:19.602348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601914584448357:5496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:19.601632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:19.601839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:19.601845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:19.601857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:19.601915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:19.601951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601913802218772:4495]
2025-10-10T14:36:19.602652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:19.602978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:19.603026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:19.603413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:19.603485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.603487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.603488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.603489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.603491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.603492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.603493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.603494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.603496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.603497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.603499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.603500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.603501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.603508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.603522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.603526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.603541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.603545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.603549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.603553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.603557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.603561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.603566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.604797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601914584448357:5496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:19.604813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601914584448357:5496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:19.604817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601914584448357:5496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:19.604826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:19.603569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.603573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.603577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.603585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.603598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.603606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.603612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.603618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.603622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.603629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.603633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.603638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.603643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.603656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.603663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.603668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.603673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.603679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.603684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.603688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.603694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.603698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.603703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.603708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.603713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.603717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.603722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.603727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.603732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.603774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:19.607575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1972
2025-10-10T14:36:19.607613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1972
2025-10-10T14:36:19.606866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:19.607207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:19.607211Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:19.607214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:19.607217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:19.607225Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1972 [2:7559601913802218772:4495]
2025-10-10T14:36:19.607239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:19.607258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:19.607262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.607266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.607268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.607285Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:19.607293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:19.607301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:19.607362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.607364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.607366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.607369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:19.607443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:19.607446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.607458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.607469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.607487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:19.607510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448395:5496], now have 1 active actors on pipe
2025-10-10T14:36:19.607514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448336:2438], now have 1 active actors on pipe
2025-10-10T14:36:19.607521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601913802218766:4495]
2025-10-10T14:36:19.607524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601913802218766:4495]
2025-10-10T14:36:19.607526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601913802218766:4495]
2025-10-10T14:36:19.607543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:19.607559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:19.607569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:19.607573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:19.607575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:19.607576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:19.607581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:19.607631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601913802218766:4495]
2025-10-10T14:36:19.607638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:19.607665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:19.607877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.607883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.607928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ae045fe-823f564f-8e888d14-a764c113_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:19.607937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.607943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.607945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:19.607957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.607977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:19.607993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.609129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1973 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ae045fe-823f564f-8e888d14-a764c113_0
2025-10-10T14:36:19.610625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ad8d09-9f66109f-6bc50466-298aaf02_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ae045fe-823f564f-8e888d14-a764c113_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:19.608898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.608915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.608951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.613372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Write session: try to update token
2025-10-10T14:36:19.613390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:19.631460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:19.631487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:19.631491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:19.631494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:19.631513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601913802218766:4495]
2025-10-10T14:36:19.631519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601913802218766:4495]
2025-10-10T14:36:19.631524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601913802218766:4495]
2025-10-10T14:36:19.631593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:19.631604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.631602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:19.631611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:19.631613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:19.631618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:19.631788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:19.633277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId: src_id|5ae045fe-823f564f-8e888d14-a764c113_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:19.635900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:19.686064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601914584448408:6092]
2025-10-10T14:36:19.686421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1972, pipe: [1:7559601914584448408:6092]
2025-10-10T14:36:19.756980Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:19.757676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.757698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.757748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448408:6092], now have 1 active actors on pipe
2025-10-10T14:36:19.758110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:19.758105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601914584448408:6092]
2025-10-10T14:36:19.758139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:19.758178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:19.758181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:19.758264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1973 reason: error at write: Disconnected sessionId: src_id|5ae045fe-823f564f-8e888d14-a764c113_0
2025-10-10T14:36:19.758462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1973 sessionId: src_id|5ae045fe-823f564f-8e888d14-a764c113_0 is DEAD
2025-10-10T14:36:19.761704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:19.761718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Write session will restart in 0.009412s
2025-10-10T14:36:19.761744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Write session: Do CDS request
2025-10-10T14:36:19.761753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:19.769757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:19.771980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:19.772277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:19.772283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:19.772297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:19.772379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:19.772425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601913802218832:4483]
2025-10-10T14:36:19.773065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:19.773835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.773440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:19.773501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:19.773816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:19.773870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.773871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.773872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.773873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.773873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.773874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.773875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.773876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.773877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.773877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.773880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.773881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.773882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.773887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.773895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.773897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.773900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.773902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.773904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.773906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.773908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.773910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.773913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.773915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.773917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.773919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.773925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.773931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.773936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.773939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.773942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.773945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.773948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.773951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.773954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.773958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.773960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.773964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.773969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.773972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.773974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.773980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.773983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.773987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.773991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.773996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.774000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.774005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.774008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.774012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.774016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.774021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.774058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:19.776506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:19.776920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:19.776930Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:19.776932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:19.776936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:19.776943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1973 [2:7559601913802218832:4483]
2025-10-10T14:36:19.776954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:19.776972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:19.776974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.776977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.776979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.776993Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:19.776999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:19.777006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:19.777057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.777058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.777061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.777063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:19.777121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:19.777123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.777131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.777137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.777148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:19.777165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601913802218826:4483]
2025-10-10T14:36:19.777167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601913802218826:4483]
2025-10-10T14:36:19.777168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601913802218826:4483]
2025-10-10T14:36:19.777174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:19.777186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:19.777185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:19.777188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:19.777190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:19.777196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:19.777198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:19.777207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448414:2438], now have 1 active actors on pipe
2025-10-10T14:36:19.777230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601913802218826:4483]
2025-10-10T14:36:19.777237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:19.777247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:19.777920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1973
2025-10-10T14:36:19.782354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:19.782373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1974
2025-10-10T14:36:19.782741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.782784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:19.782794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:19.782798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:19.783197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1974 sessionId:  describe result for acl check
2025-10-10T14:36:19.783235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:19.783241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:19.783243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:19.783249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601914584448450:5487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:19.783828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601914584448450:5487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:19.785976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601914584448450:5487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:19.794570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601914584448450:5487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:19.794590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601914584448450:5487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:19.794594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601914584448450:5487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:19.794615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:19.795252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1973
2025-10-10T14:36:19.797365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448478:5487], now have 1 active actors on pipe
2025-10-10T14:36:19.797400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.797412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.797473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58b98c50-602d8526-7506827-26f6542d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:19.797486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.797492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.797495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:19.797512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.797533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:19.799244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.799278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:19.799284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:19.799288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:19.799290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:19.799298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601913802218826:4483]
2025-10-10T14:36:19.799302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601913802218826:4483]
2025-10-10T14:36:19.799306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601913802218826:4483]
2025-10-10T14:36:19.799335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:19.799341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:19.799347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:19.799363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:19.799370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.799372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:19.799511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:19.858136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601914584448482:6092]
2025-10-10T14:36:19.858464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1973, pipe: [1:7559601914584448482:6092]
2025-10-10T14:36:19.923759Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:19.924187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.924204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.924271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448482:6092], now have 1 active actors on pipe
2025-10-10T14:36:19.924704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:19.925254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:36:19.925267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Write session will restart in 0.017679s
2025-10-10T14:36:19.925302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Write session: Do CDS request
2025-10-10T14:36:19.924757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:19.925308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:19.924782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1974 reason: pipe to partition's 0 tablet is dead #2 sessionId: 
2025-10-10T14:36:19.925054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1974 sessionId:  is DEAD
2025-10-10T14:36:19.924587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:19.925224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601914584448482:6092]
2025-10-10T14:36:19.944004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.944074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:19.944092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1975
2025-10-10T14:36:19.944262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:19.944300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:19.944306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:19.944310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:19.944754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1975 sessionId:  describe result for acl check
2025-10-10T14:36:19.944785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:19.944787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:19.944790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:19.944797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601914584448517:5479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:19.945479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601914584448517:5479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:19.949044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601914584448517:5479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:19.951272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:19.961915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601914584448517:5479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:19.961935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601914584448517:5479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:19.961940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601914584448517:5479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:19.961951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:19.960101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:19.960404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:19.960410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:19.960423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:19.960484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:19.960527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601913802218907:4492]
2025-10-10T14:36:19.961198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:19.961756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:19.961815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:19.962136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:19.962192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.962194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.962195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.962196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.962197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.962198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.962199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.962201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.962202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.962203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.962205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.962206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.962207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.962213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.962240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.962244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.962248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.962253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.962257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.962262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.962267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.962271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.962276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.962280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.962284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.962288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.962297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.962306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:19.962312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.962319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:19.962323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.962332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:19.962337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.962342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:19.962348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.962369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:19.962374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.962379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:19.962383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.962392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:19.962398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.962403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:19.962408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.962414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:19.962418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.962424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:19.962428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.962434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.962438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.962443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.962447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.962454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.962498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:19.965385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:19.966174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1974
2025-10-10T14:36:19.966251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1974
2025-10-10T14:36:19.967022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1975 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0
2025-10-10T14:36:19.967454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ae045fe-823f564f-8e888d14-a764c113_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:19.965688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:19.965706Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:19.965709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:19.965713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:19.965720Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1974 [2:7559601913802218907:4492]
2025-10-10T14:36:19.965735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:19.965755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:19.965758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.965765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.965769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.965787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:19.965795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:19.965803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:19.965866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.965868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.965870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.965873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:19.965958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:19.965961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:19.965973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:19.965986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:19.966005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:19.966025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601913802218901:4492]
2025-10-10T14:36:19.966027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601913802218901:4492]
2025-10-10T14:36:19.966029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601913802218901:4492]
2025-10-10T14:36:19.966038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:19.966051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:19.966052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:19.966054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:19.966057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:19.966067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:19.966070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:19.966080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448495:2438], now have 1 active actors on pipe
2025-10-10T14:36:19.966084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601914584448550:5479], now have 1 active actors on pipe
2025-10-10T14:36:19.966109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601913802218901:4492]
2025-10-10T14:36:19.966117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:19.966179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:19.966451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.966460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.966508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:19.966519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:19.966525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:19.966528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:19.966542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:19.966557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:19.966574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.966861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.966880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.966901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:19.970373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0] Write session: try to update token
2025-10-10T14:36:19.970393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:19.994549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId: src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:19.997399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:19.997419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:19.997437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:19.997449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601913802218901:4492]
2025-10-10T14:36:19.997504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:19.997503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:19.997683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:19.997830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:19.997969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:19.998105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:19.998298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:19.998365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:19.998384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:19.998406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:19.998464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:19.998586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:20.008585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:20.008609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:20.008616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:20.008618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:20.008633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601913802218901:4492]
2025-10-10T14:36:20.008638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601913802218901:4492]
2025-10-10T14:36:20.008642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601913802218901:4492]
2025-10-10T14:36:20.008708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:20.008710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:20.008721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:20.008723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.008725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:20.008727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:20.008886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:20.025571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601918879415856:6092]
2025-10-10T14:36:20.025935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1974, pipe: [1:7559601918879415856:6092]
2025-10-10T14:36:20.131332Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:20.131638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879415856:6092], now have 1 active actors on pipe
2025-10-10T14:36:20.140127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.140161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.140352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.140428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.140499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.140566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.140616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.140628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.140705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.140767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.140845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.140913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.140961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.140973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.141042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.141105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.141173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.141233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.141279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.141287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.141541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.141611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.141680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.141744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.141796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.141804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.145430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:20.145506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601918879415856:6092]
2025-10-10T14:36:20.145538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:20.145597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1975 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0
2025-10-10T14:36:20.145810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1975 sessionId: src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0 is DEAD
2025-10-10T14:36:20.141871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.141937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.141994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.142054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.142092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.142095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.142165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.142226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.142290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.142356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.142405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.142409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.142479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.142536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.142599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.142660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.142707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.142711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.142786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.142854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.142923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.142987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.143037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.143040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.143113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.143172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.143234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.143305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.143423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.143427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.143502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.143565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.143629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.143696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.143735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.143737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.145092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:20.146171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:20.146184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0] Write session will restart in 0.009745s
2025-10-10T14:36:20.146220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0] Write session: Do CDS request
2025-10-10T14:36:20.146226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:20.156938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.157024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:20.157042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1976
2025-10-10T14:36:20.157272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:20.157537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.157598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:20.157610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:20.157614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:20.158082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1976 sessionId:  describe result for acl check
2025-10-10T14:36:20.158124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:20.158126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:20.158128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:20.158135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601918879415884:5472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:20.158751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601918879415884:5472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:20.159729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:20.160047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:20.160061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:20.160075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:20.160163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:20.160221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601918097186265:4484]
2025-10-10T14:36:20.160980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:20.161386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:20.161448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:20.161843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:20.161924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.161933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.161935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.161936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.161938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.161941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.161943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.161945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.161947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.161949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.161951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.161953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.161955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.161962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.161976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.161984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.161989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.161994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.161999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.162004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.162009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.162013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.162020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.162024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.162029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.162034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.162042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.162051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.162058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.162064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.162070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.162076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.162081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.162087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.162093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.162099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.162104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.162116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.162123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.162151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.162157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.162163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.162169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.162175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.162180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.162187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.162196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.162202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.162207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.162214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.162226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.162232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.162289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:20.165204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:20.165559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:20.165575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:20.165578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:20.165582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:20.165589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1975 [2:7559601918097186265:4484]
2025-10-10T14:36:20.165605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:20.165624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:20.165628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.165632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.165634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.165655Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:20.165664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:20.165672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:20.165735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.165737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.165742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.165745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:20.165830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:20.165841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.165852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.165865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.165888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:20.165915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879415859:2438], now have 1 active actors on pipe
2025-10-10T14:36:20.165929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601918097186258:4484]
2025-10-10T14:36:20.165931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601918097186258:4484]
2025-10-10T14:36:20.165933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601918097186258:4484]
2025-10-10T14:36:20.165946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:20.165960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:20.165977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:20.165981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:20.166009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:20.166017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601918097186258:4484]
2025-10-10T14:36:20.166019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:20.166021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:20.166023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:20.166031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:20.166047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1975
2025-10-10T14:36:20.166989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601918879415884:5472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:20.173447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601918879415884:5472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:20.173463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601918879415884:5472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:20.173467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601918879415884:5472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:20.173484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:20.173773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879415920:5472], now have 1 active actors on pipe
2025-10-10T14:36:20.173812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1975
2025-10-10T14:36:20.173887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.173901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.173937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:20.173955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.173965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.173968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:20.173983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.174010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:20.174030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.174306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.174323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.174349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.174868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1976 partition: 0 MaxSeqNo: 40 sessionId: src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0
2025-10-10T14:36:20.175284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa1b8f9-e6c0056b-7f5bf142-87c8ff8c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:20.178085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0] Write session: try to update token
2025-10-10T14:36:20.178107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:20.186361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:20.186398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:20.186402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:20.186409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:20.186421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601918097186258:4484]
2025-10-10T14:36:20.186425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601918097186258:4484]
2025-10-10T14:36:20.186429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601918097186258:4484]
2025-10-10T14:36:20.186483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:20.186482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:20.186489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:20.186494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:20.186498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.186500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:20.186633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:20.192367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId: src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:20.195224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:20.245831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601918879415937:6092]
2025-10-10T14:36:20.249797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1975, pipe: [1:7559601918879415937:6092]
2025-10-10T14:36:20.303577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:20.303989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.304005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.304028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879415937:6092], now have 1 active actors on pipe
2025-10-10T14:36:20.304270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:20.304873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:20.304883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0] Write session will restart in 0.007470s
2025-10-10T14:36:20.304907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0] Write session: Do CDS request
2025-10-10T14:36:20.304913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:20.304241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:20.304246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:20.304250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:20.304300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601918879415937:6092]
2025-10-10T14:36:20.304307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1976 reason: error at write: Disconnected sessionId: src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0
2025-10-10T14:36:20.304504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1976 sessionId: src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0 is DEAD
2025-10-10T14:36:20.311582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:20.313387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:20.313621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:20.313631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:20.313643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:20.313699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:20.313743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601918097186365:4465]
2025-10-10T14:36:20.313909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.314006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:20.314022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1977
2025-10-10T14:36:20.314163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.314193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:20.314203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:20.314208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:20.314395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:20.314646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1977 sessionId:  describe result for acl check
2025-10-10T14:36:20.314674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:20.314688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:20.314695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:20.314697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:20.314703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601918879415993:5447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:20.314716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:20.315046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:20.315107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.315114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.315118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.315119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.315120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.315122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.315123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.315124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.315126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.315127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.315128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.315129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.315130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.315137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.315149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.315153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.315157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.315162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.315166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.315170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.315174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.315178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.315182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.315187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.315191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.315195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.315203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.315211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.315217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.315222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.315227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.315233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.315237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.315244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.315249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.315254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.315258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.315263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.315269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.315274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.315282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.315287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.315293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.315304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.315308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.315300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601918879415993:5447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:20.315319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.315324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.315329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.315333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.315338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.315342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.315347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.315387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:20.317242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601918879415993:5447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:20.317773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:20.318103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:20.318117Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:20.318121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:20.318124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:20.318131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1976 [2:7559601918097186365:4465]
2025-10-10T14:36:20.318143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:20.318162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:20.318169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.318178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.318185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.318203Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:20.318215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:20.318227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:20.318279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.318286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.318289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.318291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:20.318359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:20.318365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.318376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.318387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.318406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:20.318432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879415966:2438], now have 1 active actors on pipe
2025-10-10T14:36:20.318445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601918097186360:4465]
2025-10-10T14:36:20.318451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601918097186360:4465]
2025-10-10T14:36:20.318453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601918097186360:4465]
2025-10-10T14:36:20.318467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:20.318486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:20.318486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:20.318490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:20.318492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:20.318508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:20.318515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:20.318537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601918097186360:4465]
2025-10-10T14:36:20.318548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:20.318559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:20.318601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1976
2025-10-10T14:36:20.323439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601918879415993:5447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:20.323454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601918879415993:5447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:20.323458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601918879415993:5447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:20.323467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:20.323700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416026:5447], now have 1 active actors on pipe
2025-10-10T14:36:20.323733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1976
2025-10-10T14:36:20.323813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.323830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.323872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:20.323890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.323896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.323903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:20.323922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.323945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:20.323974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.324099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.324107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.324122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.324193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1977 partition: 0 MaxSeqNo: 40 sessionId: src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0
2025-10-10T14:36:20.324595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76f75cd-50e228c0-58476f91-9968f4d5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:20.327278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0] Write session: try to update token
2025-10-10T14:36:20.327297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:20.338746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:20.338770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:20.338774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:20.338776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:20.338786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601918097186360:4465]
2025-10-10T14:36:20.338791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601918097186360:4465]
2025-10-10T14:36:20.338797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601918097186360:4465]
2025-10-10T14:36:20.338855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:20.338854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:20.338861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:20.338867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:20.338868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.338871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:20.339022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:20.344438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId: src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:20.347140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:20.404456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601918879416029:6092]
2025-10-10T14:36:20.404843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1976, pipe: [1:7559601918879416029:6092]
2025-10-10T14:36:20.464434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:20.465034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.465045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.465066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416029:6092], now have 1 active actors on pipe
2025-10-10T14:36:20.465383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:20.465361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:20.465389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601918879416029:6092]
2025-10-10T14:36:20.465436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:20.465445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:20.465692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1977 reason: error at write: Disconnected sessionId: src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0
2025-10-10T14:36:20.465910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1977 sessionId: src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0 is DEAD
2025-10-10T14:36:20.466059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:20.466070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0] Write session will restart in 0.007764s
2025-10-10T14:36:20.466098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0] Write session: Do CDS request
2025-10-10T14:36:20.466108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:20.474923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.475063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:20.475082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1978
2025-10-10T14:36:20.475228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.475274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:20.475284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:20.475288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:20.475801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1978 sessionId:  describe result for acl check
2025-10-10T14:36:20.475844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:20.475852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:20.475855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:20.475862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601918879416043:5445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:20.476487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601918879416043:5445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:20.479331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601918879416043:5445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:20.480239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:20.481991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:20.482210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:20.482236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:20.482246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:20.482299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:20.482352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601918097186430:4464]
2025-10-10T14:36:20.482407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601918879416043:5445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:20.482421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601918879416043:5445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:20.482425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601918879416043:5445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:20.482434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:20.483061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:20.483369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:20.483413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:20.483742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:20.483803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.483809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.483811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.483812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.483814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.483815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.483817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.483819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.483820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.483822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.483823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.483825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.483826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.483832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.483844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.483848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.483852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.483855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.483860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.483864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.483868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.483872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.483876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.483881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.483885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.483888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.483897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.483905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.483912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.483923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.483927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.483932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.483941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.483946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.483951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.483960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.483965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.483969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.483974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.483979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.483984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.483989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.483994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.483999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.484004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.484014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.484021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.484030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.484034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.484039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.484048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.484053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.484099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:20.486733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:20.487116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:20.487130Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:20.487133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:20.487137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:20.487144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1977 [2:7559601918097186430:4464]
2025-10-10T14:36:20.487160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:20.487176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:20.487179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.487183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.487186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.487199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:20.487206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:20.487219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:20.487279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.487288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.487293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.487295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:20.487369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:20.487378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.487391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.487409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.487433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:20.487457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416089:5445], now have 1 active actors on pipe
2025-10-10T14:36:20.487481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416032:2438], now have 1 active actors on pipe
2025-10-10T14:36:20.487493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601918097186425:4464]
2025-10-10T14:36:20.487497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601918097186425:4464]
2025-10-10T14:36:20.487499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601918097186425:4464]
2025-10-10T14:36:20.487515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:20.487529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:20.487509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1977
2025-10-10T14:36:20.487548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1977
2025-10-10T14:36:20.487537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:20.487544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:20.487548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:20.487556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:20.487558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:20.487574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601918097186425:4464]
2025-10-10T14:36:20.487578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:20.487586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:20.487618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.487622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.487652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:20.487659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.487663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.487666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:20.487677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.487688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:20.487709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.487904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.487914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.487930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.488056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1978 partition: 0 MaxSeqNo: 40 sessionId: src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0
2025-10-10T14:36:20.488432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c5651-4a9ded80-14a7984-2f5b1fcc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:20.491211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0] Write session: try to update token
2025-10-10T14:36:20.491229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:20.505838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId: src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:20.508433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:20.508699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.508730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.508771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:20.508907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:20.517479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:20.517503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:20.517507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:20.517509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:20.517520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601918097186425:4464]
2025-10-10T14:36:20.517526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601918097186425:4464]
2025-10-10T14:36:20.517531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601918097186425:4464]
2025-10-10T14:36:20.517598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:20.517607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.517610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:20.517787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:20.521121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:20.521145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:20.521151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:20.569463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601918879416100:6092]
2025-10-10T14:36:20.569827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1977, pipe: [1:7559601918879416100:6092]
2025-10-10T14:36:20.643649Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:20.655478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.655513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.655731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.655822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.655900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.655991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.656047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.656052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.656142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.656215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.656290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.656367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.656417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.656421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.656515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.656586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.656665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.656743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.656798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.656801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.656902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.656972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.657042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.657112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.657164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.657168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.657251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.657319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.657459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.657536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.657598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.657602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.657687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.657762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.657838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.657911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.657964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.657967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.658057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.658126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.658209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.658283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.659054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.659058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.659510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.659594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.659673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.659745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.659797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.659799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.659888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.659954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.660025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.660097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.660149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.660152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.660410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:20.660495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:20.660570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:20.660648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:20.660708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:20.660717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:20.660849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416100:6092], now have 1 active actors on pipe
2025-10-10T14:36:20.662351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:20.664548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:20.664565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0] Write session will restart in 0.008650s
2025-10-10T14:36:20.664592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0] Write session: Do CDS request
2025-10-10T14:36:20.664599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:20.662445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:20.662521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601918879416100:6092]
2025-10-10T14:36:20.662555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:20.662559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:20.662595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1978 reason: error at write: Disconnected sessionId: src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0
2025-10-10T14:36:20.662887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1978 sessionId: src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0 is DEAD
2025-10-10T14:36:20.675002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.677523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:20.677543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1979
2025-10-10T14:36:20.677836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.677886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:20.677892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:20.677897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:20.678390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1979 sessionId:  describe result for acl check
2025-10-10T14:36:20.678433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:20.678436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:20.678438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:20.678450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601918879416128:5441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:20.679098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601918879416128:5441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:20.682332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:20.685015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:20.685258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:20.685272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:20.685284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:20.685362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:20.685411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601918097186496:4463]
2025-10-10T14:36:20.685813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601918879416128:5441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:20.686115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:20.686687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:20.686740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:20.687086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:20.687151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.687158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.687159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.687160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.687161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.687163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.687164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.687165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.687168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.687169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.687171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.687171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.687172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.687179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.687190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.687194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.687198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.687204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.687208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.687212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.687215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.687219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.687223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.687226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.687230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.687233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.687241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.687252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.687258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.687263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.687268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.687273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.687277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.687283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.687288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.687293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.687297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.687305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.687309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.687314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.687318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.687324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.687329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.687334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.687338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.687343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.687350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.687355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.687360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.687370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.687375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.687379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.687419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:20.690203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601918879416128:5441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:20.690225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601918879416128:5441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:20.690228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601918879416128:5441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:20.690239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:20.691081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1978
2025-10-10T14:36:20.691082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1978
2025-10-10T14:36:20.690135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:20.690718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:20.690723Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:20.690730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:20.690734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:20.690742Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1978 [2:7559601918097186496:4463]
2025-10-10T14:36:20.690760Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:20.690777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:20.690781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.690785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.690787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.690804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:20.690814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:20.690821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:20.690881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.690885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.690887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.690890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:20.690970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:20.690973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.690987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.691001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.691021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:20.691041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416103:2438], now have 1 active actors on pipe
2025-10-10T14:36:20.691044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416165:5441], now have 1 active actors on pipe
2025-10-10T14:36:20.691051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601918097186491:4463]
2025-10-10T14:36:20.691054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601918097186491:4463]
2025-10-10T14:36:20.691057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601918097186491:4463]
2025-10-10T14:36:20.691072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:20.691085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:20.691087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:20.691089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:20.691092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:20.691104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:20.691108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:20.691140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601918097186491:4463]
2025-10-10T14:36:20.691148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:20.691154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:20.691167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.691171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.691222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1885942-9eadde48-fdf9ea97-1148028e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:20.691229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.691235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.691241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:20.691253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.691265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:20.691281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.691415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.691421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.691443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.691538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1979 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1885942-9eadde48-fdf9ea97-1148028e_0
2025-10-10T14:36:20.691983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ae52ec-71963853-269c37f0-b7ba15c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1885942-9eadde48-fdf9ea97-1148028e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:20.694878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1885942-9eadde48-fdf9ea97-1148028e_0] Write session: try to update token
2025-10-10T14:36:20.694910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1885942-9eadde48-fdf9ea97-1148028e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:20.713317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:20.713359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:20.713364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:20.713365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:20.713376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601918097186491:4463]
2025-10-10T14:36:20.713382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601918097186491:4463]
2025-10-10T14:36:20.713387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601918097186491:4463]
2025-10-10T14:36:20.713442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:20.713450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.713453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:20.713455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:20.713464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:20.713469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:20.713595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:20.721150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId: src_id|d1885942-9eadde48-fdf9ea97-1148028e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:20.723929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:20.760202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601918879416178:6092]
2025-10-10T14:36:20.764523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1978, pipe: [1:7559601918879416178:6092]
2025-10-10T14:36:20.842341Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:20.842741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.842761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.842785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416178:6092], now have 1 active actors on pipe
2025-10-10T14:36:20.843100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601918879416178:6092]
2025-10-10T14:36:20.843147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:20.843151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:20.843157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:20.843221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1979 reason: error at write: Disconnected sessionId: src_id|d1885942-9eadde48-fdf9ea97-1148028e_0
2025-10-10T14:36:20.843418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:20.843456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1979 sessionId: src_id|d1885942-9eadde48-fdf9ea97-1148028e_0 is DEAD
2025-10-10T14:36:20.845435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1885942-9eadde48-fdf9ea97-1148028e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:20.845449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1885942-9eadde48-fdf9ea97-1148028e_0] Write session will restart in 0.009610s
2025-10-10T14:36:20.845478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1885942-9eadde48-fdf9ea97-1148028e_0] Write session: Do CDS request
2025-10-10T14:36:20.845488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1885942-9eadde48-fdf9ea97-1148028e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:20.852645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:20.855089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:20.855363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:20.855375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:20.855389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:20.855462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:20.855509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601918097186562:4460]
2025-10-10T14:36:20.855938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1885942-9eadde48-fdf9ea97-1148028e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.856040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:20.856056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1980
2025-10-10T14:36:20.856194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:20.856254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:20.856308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:20.856320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:20.856324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:20.856551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:20.856611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:20.856750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1980 sessionId:  describe result for acl check
2025-10-10T14:36:20.856782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:20.856788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:20.856790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:20.856796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601918879416215:5432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:20.856990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:20.857056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.857064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.857066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.857068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.857069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.857071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.857073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.857074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.857076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.857077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.857078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.857080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.857081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.857088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.857101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.857105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.857110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.857114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.857119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.857123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.857127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.857131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.857134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.857139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.857143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.857147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.857155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.857167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:20.857179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.857186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:20.857196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.857201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:20.857205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.857211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:20.857220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.857226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:20.857234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.857240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:20.857249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.857255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:20.857260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.857269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:20.857274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.857280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:20.857285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.857290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:20.857296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.857301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.857310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.857316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.857325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.857350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.857396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:20.857457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601918879416215:5432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:20.859619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601918879416215:5432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:20.860098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:20.860582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:20.860596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:20.860599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:20.860605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:20.860612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1979 [2:7559601918097186562:4460]
2025-10-10T14:36:20.860627Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:20.860647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:20.860650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.860653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.860657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.860676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:20.860691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:20.860699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:20.860762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.860770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.860771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.860786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:20.860875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:20.860883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.860907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:20.860918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:20.860943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:20.860973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416183:2438], now have 1 active actors on pipe
2025-10-10T14:36:20.860987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601918097186556:4460]
2025-10-10T14:36:20.860990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601918097186556:4460]
2025-10-10T14:36:20.860992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601918097186556:4460]
2025-10-10T14:36:20.861008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:20.861025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:20.861029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:20.861029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:20.861019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1979
2025-10-10T14:36:20.861031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:20.861045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:20.861051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:20.861083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601918097186556:4460]
2025-10-10T14:36:20.861092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:20.861098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:20.866616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416250:5432], now have 1 active actors on pipe
2025-10-10T14:36:20.866762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.866781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.866819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:20.866833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:20.866840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:20.866843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:20.866869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:20.866895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:20.866929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.867134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:20.867145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:20.867162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:20.867664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1885942-9eadde48-fdf9ea97-1148028e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:20.866293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601918879416215:5432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:20.866312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601918879416215:5432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:20.866316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601918879416215:5432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:20.866326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:20.866667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1979
2025-10-10T14:36:20.867247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1980 partition: 0 MaxSeqNo: 40 sessionId: src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0
2025-10-10T14:36:20.870533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0] Write session: try to update token
2025-10-10T14:36:20.870554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:20.881177Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:20.881209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:20.881216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:20.881219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:20.881231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601918097186556:4460]
2025-10-10T14:36:20.881236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601918097186556:4460]
2025-10-10T14:36:20.881240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601918097186556:4460]
2025-10-10T14:36:20.881287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:20.881303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:20.881306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:20.881313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:20.881316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:20.881316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:20.881531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:20.886854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId: src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:20.889651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:20.943085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601918879416265:6092]
2025-10-10T14:36:20.943387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1979, pipe: [1:7559601918879416265:6092]
2025-10-10T14:36:21.001983Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:21.002313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.002331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.002384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601918879416265:6092], now have 1 active actors on pipe
2025-10-10T14:36:21.002608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:21.002762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:21.002874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1980 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0
2025-10-10T14:36:21.003077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1980 sessionId: src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0 is DEAD
2025-10-10T14:36:21.003253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601918879416265:6092]
2025-10-10T14:36:21.003269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:21.005575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:21.005592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0] Write session will restart in 0.005506s
2025-10-10T14:36:21.005620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0] Write session: Do CDS request
2025-10-10T14:36:21.005626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:21.013766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:21.014171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.014317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:21.014333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1981
2025-10-10T14:36:21.015043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:21.015279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:21.015291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:21.015303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:21.015360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:21.015403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601922392153939:4457]
2025-10-10T14:36:21.016060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:21.016376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:21.016436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:21.016765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:21.016836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.016843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.016845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.016847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.016848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.016850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.016853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.016854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.016855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.016857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.016858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.016859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.016860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.016866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.016880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.016884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.016889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.016894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.016898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.016903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.016907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.016911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.016916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.016920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.016923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.016928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.016937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.016946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.016959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.016971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.016975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.016981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.016990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.016995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.017002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.017013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.017018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.017028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.017033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.017042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.017052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.017057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.017062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.017067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.017071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.017076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.017081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.017091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.017094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.017104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.017108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.017114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.017158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:21.017554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.017617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:21.017629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:21.017634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:21.018103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1981 sessionId:  describe result for acl check
2025-10-10T14:36:21.018144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:21.018150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:21.018152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:21.018159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601923174383597:5422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:21.018744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601923174383597:5422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:21.019514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:21.019923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:21.019938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:21.019940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:21.019944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:21.019952Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1980 [2:7559601922392153939:4457]
2025-10-10T14:36:21.019965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:21.019982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:21.019992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.019998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.020005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.020021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:21.020042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:21.020054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:21.020117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.020128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.020129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.020131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:21.020201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:21.020210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.020223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.020239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.020260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:21.020300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383563:2438], now have 1 active actors on pipe
2025-10-10T14:36:21.020312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601922392153933:4457]
2025-10-10T14:36:21.020301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1980
2025-10-10T14:36:21.020319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601922392153933:4457]
2025-10-10T14:36:21.020321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601922392153933:4457]
2025-10-10T14:36:21.020329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:21.020338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:21.020341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:21.020343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:21.020344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:21.020361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:21.020374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:21.020407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601922392153933:4457]
2025-10-10T14:36:21.020420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:21.020425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:21.020782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601923174383597:5422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:21.026141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601923174383597:5422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:21.026157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601923174383597:5422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:21.026161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601923174383597:5422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:21.026170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:21.026433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383630:5422], now have 1 active actors on pipe
2025-10-10T14:36:21.026486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1980
2025-10-10T14:36:21.026553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.026566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.026607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:21.026626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.026637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.026640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:21.026654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.026680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:21.026710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.026881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.026890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.026907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.026990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1981 partition: 0 MaxSeqNo: 40 sessionId: src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0
2025-10-10T14:36:21.027393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dd7f253-fb0458b5-3813ff36-327e0a04_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:21.030357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0] Write session: try to update token
2025-10-10T14:36:21.030380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:21.032606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:21.032625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.032637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601922392153933:4457]
2025-10-10T14:36:21.032688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:21.032707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:21.032891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:21.033050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.033209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.033388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.033625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:21.033673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:21.045819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId: src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:21.048574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:21.048777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.048802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.048853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:21.048928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:21.051656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:21.051676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.051681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:21.051683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:21.051702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601922392153933:4457]
2025-10-10T14:36:21.051705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601922392153933:4457]
2025-10-10T14:36:21.051709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601922392153933:4457]
2025-10-10T14:36:21.051763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:21.051762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:21.051771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.051771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:21.051774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:21.051777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:21.051926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:21.103374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601923174383633:6092]
2025-10-10T14:36:21.103720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1980, pipe: [1:7559601923174383633:6092]
2025-10-10T14:36:21.175917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:21.184907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.184947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.185145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.185209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.185279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.189400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:21.189414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601923174383633:6092]
2025-10-10T14:36:21.189446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:21.189449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:21.189493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1981 reason: error at write: Disconnected sessionId: src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0
2025-10-10T14:36:21.189756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1981 sessionId: src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0 is DEAD
2025-10-10T14:36:21.189888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:21.189904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0] Write session will restart in 0.008346s
2025-10-10T14:36:21.189930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0] Write session: Do CDS request
2025-10-10T14:36:21.189936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:21.185454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.185851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.185856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.185932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.185990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.186059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.186123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.186161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.186164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.186236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.186295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.186355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.186417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.186463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.186466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.186537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.186606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.186667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.186729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.186770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.186773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.186846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.186905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.186966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.187027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.187069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.187071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.187141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.187203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.187267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.187327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.187442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.187445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.187520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.187585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.187656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.187719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.187838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.187841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.187914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.187975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.188041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.188107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.188149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.188153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.188228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.188287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.188347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.188413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.188457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.188460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.188540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.188605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.188673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.188740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.188790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.188793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.188908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383633:6092], now have 1 active actors on pipe
2025-10-10T14:36:21.189565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:21.199960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.200023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:21.200059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1982
2025-10-10T14:36:21.200216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.200259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:21.200270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:21.200275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:21.200814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1982 sessionId:  describe result for acl check
2025-10-10T14:36:21.200862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:21.200868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:21.200870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:21.200877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601923174383645:5417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:21.201503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601923174383645:5417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:21.204312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601923174383645:5417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:21.210253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601923174383645:5417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:21.210270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601923174383645:5417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:21.210273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601923174383645:5417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:21.210284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:21.218316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:21.222506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:21.222789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:21.222807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:21.222821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:21.222897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:21.222949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601922392154008:4451]
2025-10-10T14:36:21.223616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:21.223934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:21.224004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:21.224368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:21.224456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.224464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.224466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.224467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.224469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.224470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.224472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.224473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.224474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.224476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.224477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.224479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.224480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.224500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.224515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.224519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.224523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.224527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.224531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.224535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.224539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.224543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.224547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.224551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.224554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.224558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.224567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.224576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.224583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.224588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.224594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.224616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.224622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.224627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.224632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.224642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.224646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.224651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.224660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.224666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.224670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.224675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.224685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.224690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.224700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.224705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.224711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.224721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.224725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.224730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.224739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.224744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.224784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:21.227469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:21.228052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:21.228064Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:21.228067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:21.228072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:21.228079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1981 [2:7559601922392154008:4451]
2025-10-10T14:36:21.228094Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:21.228114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:21.228133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.228136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.228139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.228158Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:21.228171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:21.228179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:21.228249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.228257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.228259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.228262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:21.228332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:21.228340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.228352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.228364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.228383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:21.228407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601922392154002:4451]
2025-10-10T14:36:21.228414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601922392154002:4451]
2025-10-10T14:36:21.228416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601922392154002:4451]
2025-10-10T14:36:21.228429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:21.228450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:21.228465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:21.228472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:21.228497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601922392154002:4451]
2025-10-10T14:36:21.228505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:21.228532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383636:2438], now have 1 active actors on pipe
2025-10-10T14:36:21.228539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383680:5417], now have 1 active actors on pipe
2025-10-10T14:36:21.228621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:21.228631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:21.228634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:21.228641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:21.228649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1981
2025-10-10T14:36:21.228669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1981
2025-10-10T14:36:21.228879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.228891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.228926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:21.228940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.228950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.228953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:21.228967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.228980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:21.229001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.229266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.229275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.229293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.229425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1982 partition: 0 MaxSeqNo: 40 sessionId: src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0
2025-10-10T14:36:21.229945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b032fac-79b6fa63-172c8ea5-99189d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:21.232889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0] Write session: try to update token
2025-10-10T14:36:21.232912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:21.251940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:21.251963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.251967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:21.251975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:21.251986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601922392154002:4451]
2025-10-10T14:36:21.251990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601922392154002:4451]
2025-10-10T14:36:21.251997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601922392154002:4451]
2025-10-10T14:36:21.252050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:21.252058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.252061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:21.252065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:21.252076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:21.252090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:21.252214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:21.253606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId: src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:21.256497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:21.289239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601923174383708:6092]
2025-10-10T14:36:21.289555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1981, pipe: [1:7559601923174383708:6092]
2025-10-10T14:36:21.384575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:21.384983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.385001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.385050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383708:6092], now have 1 active actors on pipe
2025-10-10T14:36:21.385295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:21.385366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:21.385399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601923174383708:6092]
2025-10-10T14:36:21.385429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:21.385536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1982 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0
2025-10-10T14:36:21.385766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1982 sessionId: src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0 is DEAD
2025-10-10T14:36:21.385948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:21.385957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0] Write session will restart in 0.006542s
2025-10-10T14:36:21.385993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0] Write session: Do CDS request
2025-10-10T14:36:21.385999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:21.393859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.393982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:21.393997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1983
2025-10-10T14:36:21.394352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.394408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:21.394415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:21.394419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:21.394929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1983 sessionId:  describe result for acl check
2025-10-10T14:36:21.394980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:21.394989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:21.394991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:21.394997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601923174383769:5392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:21.395226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:21.395572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601923174383769:5392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:21.396981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:21.397223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:21.397235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:21.397248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:21.397303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:21.397397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601922392154113:4424]
2025-10-10T14:36:21.397734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601923174383769:5392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:21.398031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:21.398389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:21.398462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:21.398857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:21.398939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.398946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.398948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.398950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.398951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.398952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.398953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.398955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.398970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.398971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.398973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.398974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.398975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.398982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.398996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.399005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.399010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.399014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.399019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.399023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.399027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.399032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.399038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.399042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.399045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.399049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.399056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.399064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.399080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.399091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.399098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.399106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.399115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.399120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.399128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.399133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.399139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.399144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.399154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.399159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.399168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.399173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.399177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.399183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.399187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.399193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.399199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.399209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.399213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.399223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.399230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.399236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.399288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:21.401822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601923174383769:5392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:21.401840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601923174383769:5392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:21.401843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601923174383769:5392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:21.401853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:21.401834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:21.402184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:21.402189Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:21.402191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:21.402196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:21.402202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1982 [2:7559601922392154113:4424]
2025-10-10T14:36:21.402217Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:21.402237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:21.402240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.402243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.402245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.402263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:21.402270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:21.402277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:21.402343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.402672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1982
2025-10-10T14:36:21.402345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.402346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.402739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1982
2025-10-10T14:36:21.402349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:21.402426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:21.402430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.402441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.402451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.402480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:21.402502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601922392154108:4424]
2025-10-10T14:36:21.402504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601922392154108:4424]
2025-10-10T14:36:21.402506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601922392154108:4424]
2025-10-10T14:36:21.402515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:21.402528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:21.402527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:21.402530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:21.402532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:21.402542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:21.402545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:21.402576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601922392154108:4424]
2025-10-10T14:36:21.402583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:21.402585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:21.402594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383801:5392], now have 1 active actors on pipe
2025-10-10T14:36:21.402598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383739:2438], now have 1 active actors on pipe
2025-10-10T14:36:21.402769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.402774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.402804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|430b9b99-ec389b82-567016c-1fbe80a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:21.402816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.402820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.402822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:21.402834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.402848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:21.402862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.403008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.403020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.403038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.403150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1983 partition: 0 MaxSeqNo: 40 sessionId: src_id|430b9b99-ec389b82-567016c-1fbe80a8_0
2025-10-10T14:36:21.403617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b1e857-35b3d8e9-d3afba5e-494137f0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|430b9b99-ec389b82-567016c-1fbe80a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:21.406629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430b9b99-ec389b82-567016c-1fbe80a8_0] Write session: try to update token
2025-10-10T14:36:21.406654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430b9b99-ec389b82-567016c-1fbe80a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:21.415178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:21.415201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.415213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601922392154108:4424]
2025-10-10T14:36:21.415265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:21.415285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:21.415461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:21.415607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.415759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.416299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.417153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:21.417210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:21.421859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId: src_id|430b9b99-ec389b82-567016c-1fbe80a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:21.424589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:21.424950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.424973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.425031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:21.425117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:21.433805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:21.433823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.433826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:21.433828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:21.433844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601922392154108:4424]
2025-10-10T14:36:21.433849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601922392154108:4424]
2025-10-10T14:36:21.433851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601922392154108:4424]
2025-10-10T14:36:21.433898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:21.433908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.433910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:21.433910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:21.433917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:21.433921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:21.434042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:21.485785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601923174383809:6092]
2025-10-10T14:36:21.486053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1982, pipe: [1:7559601923174383809:6092]
2025-10-10T14:36:21.553552Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:21.562343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.562376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.562572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.562643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.562712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.562785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.563042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.563058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.563129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.563189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.563254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.563559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.563612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.563620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.563687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.563755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.563824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.563890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.563936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.563946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.564013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.564077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.564141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.564201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.564248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.564257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.564324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.564389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.564457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.564521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.564574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.564581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.564665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.564732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.564817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.564882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.564926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.564933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.565003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.565074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.565146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.565219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.565271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.565279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.565370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.565438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.565505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.565575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.565625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.565635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.565706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.565775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.565843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.565913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.565964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.565973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.566047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.566116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.566188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.566260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.566309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.566317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.566381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383809:6092], now have 1 active actors on pipe
2025-10-10T14:36:21.566614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:21.566627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:21.566631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:21.566661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1983 reason: error at write: Disconnected sessionId: src_id|430b9b99-ec389b82-567016c-1fbe80a8_0
2025-10-10T14:36:21.566690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601923174383809:6092]
2025-10-10T14:36:21.566913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1983 sessionId: src_id|430b9b99-ec389b82-567016c-1fbe80a8_0 is DEAD
2025-10-10T14:36:21.566979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:21.567090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430b9b99-ec389b82-567016c-1fbe80a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:21.567102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430b9b99-ec389b82-567016c-1fbe80a8_0] Write session will restart in 0.007998s
2025-10-10T14:36:21.567130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430b9b99-ec389b82-567016c-1fbe80a8_0] Write session: Do CDS request
2025-10-10T14:36:21.567136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430b9b99-ec389b82-567016c-1fbe80a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:21.575927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430b9b99-ec389b82-567016c-1fbe80a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.576019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:21.576037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1984
2025-10-10T14:36:21.576168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.576218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:21.576229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:21.576234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:21.576707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1984 sessionId:  describe result for acl check
2025-10-10T14:36:21.576754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:21.576765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:21.576767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:21.576773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601923174383842:5389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:21.577011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:21.577396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601923174383842:5389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:21.579208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:21.579443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:21.579457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:21.579479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:21.579542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:21.579582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601922392154184:4428]
2025-10-10T14:36:21.580257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:21.580260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601923174383842:5389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:21.580622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:21.580672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:21.581026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:21.581084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.581090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.581092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.581094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.581095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.581096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.581098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.581099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.581100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.581101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.581103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.581104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.581105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.581111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.581124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.581127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.581132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.581136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.581143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.581147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.581151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.581156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.581161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.581165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.581169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.581173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.581181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.581190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.581197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.581204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.581209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.581215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.581220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.581226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.581231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.581237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.581242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.581247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.581253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.581259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.581265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.581271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.581276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.581282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.581287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.581292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.581303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.581309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.581315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.581322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.581375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.581386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.581425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:21.583928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601923174383842:5389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:21.583943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601923174383842:5389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:21.583947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601923174383842:5389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:21.583957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:21.583993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:21.584443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:21.584456Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:21.584458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:21.584462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:21.584469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1983 [2:7559601922392154184:4428]
2025-10-10T14:36:21.584481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:21.584500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:21.584504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.584507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.584511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.584529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:21.584536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:21.584545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:21.584606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.584615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.584617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.584620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:21.584692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:21.584701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.584714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.584728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.584749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:21.584778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383811:2438], now have 1 active actors on pipe
2025-10-10T14:36:21.584787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383877:5389], now have 1 active actors on pipe
2025-10-10T14:36:21.584781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1983
2025-10-10T14:36:21.584808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601922392154177:4428]
2025-10-10T14:36:21.584803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1983
2025-10-10T14:36:21.584810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601922392154177:4428]
2025-10-10T14:36:21.584812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601922392154177:4428]
2025-10-10T14:36:21.584821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:21.584837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:21.584848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:21.584851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:21.584853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:21.584855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:21.584858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:21.584899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.584909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.584928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601922392154177:4428]
2025-10-10T14:36:21.584939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:21.584944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:21.584974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:21.584988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.584996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.584998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:21.585009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.585024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:21.585049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.585260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.585273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.585309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.585438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1984 partition: 0 MaxSeqNo: 40 sessionId: src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0
2025-10-10T14:36:21.585850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430b9b99-ec389b82-567016c-1fbe80a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:21.588512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0] Write session: try to update token
2025-10-10T14:36:21.588530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:21.606762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:21.606787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.606791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:21.606793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:21.606803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601922392154177:4428]
2025-10-10T14:36:21.606812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601922392154177:4428]
2025-10-10T14:36:21.606816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601922392154177:4428]
2025-10-10T14:36:21.606866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:21.606869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:21.606877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.606879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:21.606883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:21.606888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:21.607029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:21.604300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId: src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:21.607045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:21.667026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601923174383885:6092]
2025-10-10T14:36:21.668064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1983, pipe: [1:7559601923174383885:6092]
2025-10-10T14:36:21.725500Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:21.725942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.725964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.726031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383885:6092], now have 1 active actors on pipe
2025-10-10T14:36:21.726274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:21.726869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601923174383885:6092]
2025-10-10T14:36:21.726905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:21.726907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:21.726999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1984 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0
2025-10-10T14:36:21.727227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1984 sessionId: src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0 is DEAD
2025-10-10T14:36:21.727768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:21.727782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0] Write session will restart in 0.008176s
2025-10-10T14:36:21.727810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0] Write session: Do CDS request
2025-10-10T14:36:21.727816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:21.736385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:21.736952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.737105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:21.737121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1985
2025-10-10T14:36:21.737264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.737303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:21.737310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:21.737315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:21.737877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1985 sessionId:  describe result for acl check
2025-10-10T14:36:21.737914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:21.737921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:21.737923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:21.737929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601923174383924:5382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:21.738131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:21.738359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:21.738370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:21.738382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:21.738438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:21.738484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601922392154255:4426]
2025-10-10T14:36:21.738497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601923174383924:5382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:21.739113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:21.739723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:21.739802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:21.740167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:21.740236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.740243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.740245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.740246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.740247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.740248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.740249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.740251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.740252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.740253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.740254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.740255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.740257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.740263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.740274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.740277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.740281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.740284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.740288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.740292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.740295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.740299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.740303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.740306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.740310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.740323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.740331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.740347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.740358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.740363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.740371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.740376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.740381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.740386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.740389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.740394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.740399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.740404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.740409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.740417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.740422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.740426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.740430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.740434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.740442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.740446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.740450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.740455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.740458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.740462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.740467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.740471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.740507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:21.740641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601923174383924:5382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:21.742947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:21.743424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601923174383924:5382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:21.743440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601923174383924:5382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:21.743444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601923174383924:5382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:21.743452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:21.743369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:21.743383Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:21.743385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:21.743391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:21.743397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1984 [2:7559601922392154255:4426]
2025-10-10T14:36:21.743411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:21.743429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:21.743432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.743435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.743437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.743453Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:21.743460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:21.743467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:21.743520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.743522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.743524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.743526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:21.743593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:21.743596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.743606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.743616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.743630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:21.743649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601922392154249:4426]
2025-10-10T14:36:21.743651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601922392154249:4426]
2025-10-10T14:36:21.743652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601922392154249:4426]
2025-10-10T14:36:21.743663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:21.743674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:21.743676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:21.743678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:21.743680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:21.743689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:21.743691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:21.743702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383891:2438], now have 1 active actors on pipe
2025-10-10T14:36:21.743725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383958:5382], now have 1 active actors on pipe
2025-10-10T14:36:21.743727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601922392154249:4426]
2025-10-10T14:36:21.743737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:21.743777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:21.743959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1984
2025-10-10T14:36:21.744004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1984
2025-10-10T14:36:21.744075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.744089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.744125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:21.744149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.744158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.744160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:21.744173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.744191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:21.744215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.744426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.744437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.744456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.744529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1985 partition: 0 MaxSeqNo: 40 sessionId: src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0
2025-10-10T14:36:21.744913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ffd789-4f251d13-2c033dca-4b9a27ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:21.747603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0] Write session: try to update token
2025-10-10T14:36:21.747622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:21.764095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId: src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:21.766810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:21.770099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.770129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.770157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:21.770160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.770171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601922392154249:4426]
2025-10-10T14:36:21.770218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:21.770236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:21.770418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:21.770569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.770711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.770865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:21.771074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:21.771119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:21.771144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:21.771240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:21.781969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:21.781989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.781992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:21.781994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:21.782006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601922392154249:4426]
2025-10-10T14:36:21.782010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601922392154249:4426]
2025-10-10T14:36:21.782014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601922392154249:4426]
2025-10-10T14:36:21.782054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:21.782059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:21.782063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:21.782064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:21.782076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.782078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:21.782213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:21.826772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601923174383969:6092]
2025-10-10T14:36:21.827177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1984, pipe: [1:7559601923174383969:6092]
2025-10-10T14:36:21.897918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:21.905429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.905458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.905641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.905700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.905767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.905833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.905885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.905890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.905965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.906023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.906085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.906157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.906198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.906201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.906275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.906335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.906399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.906467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.906505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.906508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.906580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.906639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.906698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.906757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.906800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.906803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.906873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.906930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.906993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.907054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.907096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.907098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.907164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.907220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.907279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.907339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.907380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.907383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.907456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.907516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.907581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.907649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.907695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.907700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.907773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.907829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.907893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.907953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.907997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.908000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.908071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.908129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.908187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.908250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.908292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.908295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.908364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:21.908424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:21.908481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:21.908544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:21.908590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:21.908593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:21.908649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383969:6092], now have 1 active actors on pipe
2025-10-10T14:36:21.910292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601923174383969:6092]
2025-10-10T14:36:21.910328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:21.910368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:21.910413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1985 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0
2025-10-10T14:36:21.910611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1985 sessionId: src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0 is DEAD
2025-10-10T14:36:21.909828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:21.913589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:21.913605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0] Write session will restart in 0.006530s
2025-10-10T14:36:21.913631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0] Write session: Do CDS request
2025-10-10T14:36:21.913637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:21.920899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.921032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:21.921047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1986
2025-10-10T14:36:21.921222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:21.921278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:21.921300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:21.921309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:21.921702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1986 sessionId:  describe result for acl check
2025-10-10T14:36:21.921741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:21.921743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:21.921746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:21.921751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601923174383998:5377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:21.922144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601923174383998:5377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:21.924338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:21.924599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601923174383998:5377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:21.926388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:21.926670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:21.926682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:21.926695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:21.926760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:21.926807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601922392154339:4415]
2025-10-10T14:36:21.927232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601923174383998:5377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:21.927247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601923174383998:5377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:21.927251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601923174383998:5377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:21.927260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:21.927433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:21.927748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:21.927809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:21.928168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:21.928236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.928245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.928246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.928247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.928249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.928250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.928251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.928252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.928254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.928255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.928256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.928258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.928259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.928264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.928277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.928282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.928286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.928290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.928294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.928298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.928302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.928306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.928310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.928314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.928318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.928324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.928331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.928355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:21.928362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.928368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:21.928373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.928378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:21.928384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.928391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:21.928396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.928401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:21.928407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.928412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:21.928416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.928421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:21.928425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.928435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:21.928440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.928450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:21.928454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.928463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:21.928468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.928472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.928475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.928481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.928485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.928489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.928541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:21.931411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:21.931764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:21.931777Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:21.931779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:21.931785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:21.931791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1985 [2:7559601922392154339:4415]
2025-10-10T14:36:21.931806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:21.931825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:21.931828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.931831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.931834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.931850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:21.931858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:21.931866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:21.931930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.931934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.931936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.931938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:21.932026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:21.932038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.932050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:21.932061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:21.932078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:21.932104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601922392154334:4415]
2025-10-10T14:36:21.932114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601922392154334:4415]
2025-10-10T14:36:21.932116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601922392154334:4415]
2025-10-10T14:36:21.932134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:21.932149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:21.932171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:21.932174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:21.932178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:21.932181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:21.932183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:21.932199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601922392154334:4415]
2025-10-10T14:36:21.932219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:21.932258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:21.932365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174383971:2438], now have 1 active actors on pipe
2025-10-10T14:36:21.932375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601923174384047:5377], now have 1 active actors on pipe
2025-10-10T14:36:21.932546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1985
2025-10-10T14:36:21.932605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1985
2025-10-10T14:36:21.932825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.932836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.932869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:21.932882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:21.932887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:21.932890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:21.932902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:21.932915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:21.932929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.933160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.933169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.933184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:21.933284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1986 partition: 0 MaxSeqNo: 40 sessionId: src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0
2025-10-10T14:36:21.933709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9afa0376-d56c734e-ed8f8c1c-4b8fdaad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:21.936552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0] Write session: try to update token
2025-10-10T14:36:21.936573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:21.951004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId: src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:21.953871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:21.954675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:21.954705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:21.954730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:21.954734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:21.954737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:21.954739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:21.954748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601922392154334:4415]
2025-10-10T14:36:21.954764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601922392154334:4415]
2025-10-10T14:36:21.954773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601922392154334:4415]
2025-10-10T14:36:21.954825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:21.954837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:21.954841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:21.954843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:21.954845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:21.954848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:21.954979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:22.010582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601927469351355:6092]
2025-10-10T14:36:22.010895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1985, pipe: [1:7559601927469351355:6092]
2025-10-10T14:36:22.070481Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:22.070895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:22.070960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351355:6092], now have 1 active actors on pipe
2025-10-10T14:36:22.071727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:22.071739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0] Write session will restart in 0.007595s
2025-10-10T14:36:22.071078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:22.071126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:22.071175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601927469351355:6092]
2025-10-10T14:36:22.071304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:22.071764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0] Write session: Do CDS request
2025-10-10T14:36:22.071308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:22.071387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1986 reason: error at write: Disconnected sessionId: src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0
2025-10-10T14:36:22.071770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:22.071553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1986 sessionId: src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0 is DEAD
2025-10-10T14:36:22.081005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.082764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:22.085358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:22.085481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:22.085496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1987
2025-10-10T14:36:22.085618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:22.085630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:22.085643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:22.085689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.085709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:22.085725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:22.085732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:22.085736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:22.085757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601926687121710:4411]
2025-10-10T14:36:22.086156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1987 sessionId:  describe result for acl check
2025-10-10T14:36:22.086190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:22.086191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:22.086193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:22.086199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601927469351392:5374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:22.086424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:22.086812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:22.086794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601927469351392:5374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:22.086882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:22.087271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:22.087345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.087352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.087353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.087354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.087355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.087356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.087357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.087359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.087360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.087361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.087363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.087364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.087365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.087373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.087386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.087390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.087394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.087398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.087402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.087407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.087411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.087415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.087421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.087425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.087429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.087433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.087441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.087450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.087457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.087463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.087468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.087475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.087480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.087484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.087490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.087496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.087501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.087506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.087518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.087524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.087534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.087540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.087545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.087551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.087556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.087567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.087572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.087581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.087585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.087590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.087599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.087604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.087655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:22.089163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601927469351392:5374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:22.090217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:22.090566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:22.090581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:22.090584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:22.090588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:22.090595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1986 [2:7559601926687121710:4411]
2025-10-10T14:36:22.090609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:22.090627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:22.090633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.090637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.090641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.090660Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:22.090675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:22.090683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:22.090749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.090757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.090758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.090761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:22.090835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:22.090843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.090855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.090870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.090892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:22.090920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601926687121704:4411]
2025-10-10T14:36:22.090925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601926687121704:4411]
2025-10-10T14:36:22.090928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601926687121704:4411]
2025-10-10T14:36:22.090943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:22.090976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:22.090991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:22.090994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:22.090997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:22.091000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:22.091004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:22.091040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601926687121704:4411]
2025-10-10T14:36:22.091049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:22.091057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:22.091070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351356:2438], now have 1 active actors on pipe
2025-10-10T14:36:22.091207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1986
2025-10-10T14:36:22.094928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601927469351392:5374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:22.094945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601927469351392:5374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:22.094950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601927469351392:5374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:22.094961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:22.095255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351429:5374], now have 1 active actors on pipe
2025-10-10T14:36:22.095336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1986
2025-10-10T14:36:22.095446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.095459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.095492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:22.095512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.095524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.095532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:22.095547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.095572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:22.095598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.095783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.095793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.095809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.095920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1987 partition: 0 MaxSeqNo: 40 sessionId: src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0
2025-10-10T14:36:22.096389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2955e26-4a7fdaf9-29b17b48-3630eed5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:22.099256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0] Write session: try to update token
2025-10-10T14:36:22.099277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:22.112620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:22.112657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:22.112662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:22.112664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:22.112677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601926687121704:4411]
2025-10-10T14:36:22.112684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601926687121704:4411]
2025-10-10T14:36:22.112690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601926687121704:4411]
2025-10-10T14:36:22.112753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:22.112756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:22.112763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:22.112768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:22.112768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.112772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:22.112951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:22.116733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId: src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:22.119526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:22.171360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601927469351433:6092]
2025-10-10T14:36:22.171696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1986, pipe: [1:7559601927469351433:6092]
2025-10-10T14:36:22.231274Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:22.231650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.231666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.231707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351433:6092], now have 1 active actors on pipe
2025-10-10T14:36:22.232022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:22.232044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601927469351433:6092]
2025-10-10T14:36:22.232071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:22.232074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:22.232157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1987 reason: error at write: Disconnected sessionId: src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0
2025-10-10T14:36:22.232421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1987 sessionId: src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0 is DEAD
2025-10-10T14:36:22.232764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:22.232789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0] Write session will restart in 0.007387s
2025-10-10T14:36:22.232825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0] Write session: Do CDS request
2025-10-10T14:36:22.232831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:22.232742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:22.242047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.242145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:22.242163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1988
2025-10-10T14:36:22.242327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.242379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:22.242390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:22.242394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:22.242509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:22.242882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1988 sessionId:  describe result for acl check
2025-10-10T14:36:22.242920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:22.242927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:22.242929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:22.242935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601927469351485:5366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:22.243517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601927469351485:5366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:22.244649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:22.244913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:22.244920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:22.244933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:22.245012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:22.245054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601926687121784:4393]
2025-10-10T14:36:22.245653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:22.246016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:22.246084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:22.246232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601927469351485:5366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:22.246435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:22.246512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.246519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.246523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.246525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.246526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.246527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.246529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.246530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.246531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.246532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.246534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.246535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.246536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.246543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.246556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.246560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.246564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.246568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.246572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.246576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.246579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.246584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.246589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.246592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.246596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.246602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.246609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.246618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.246624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.246630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.246634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.246639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.246644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.246651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.246655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.246660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.246664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.246669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.246674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.246679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.246683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.246688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.246701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.246707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.246712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.246722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.246727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.246738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.246744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.246754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.246759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.246770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.246810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:22.249862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601927469351485:5366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:22.249880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601927469351485:5366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:22.249885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601927469351485:5366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:22.249895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:22.249891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:22.250428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:22.250445Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:22.250448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:22.250453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:22.250463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1987 [2:7559601926687121784:4393]
2025-10-10T14:36:22.250478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:22.250506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:22.250515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.250519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.250523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.250543Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:22.250556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:22.250568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:22.250645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.250653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.250655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.250658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:22.250728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:22.250736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.250748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.250766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.250785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:22.250814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351434:2438], now have 1 active actors on pipe
2025-10-10T14:36:22.250822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351519:5366], now have 1 active actors on pipe
2025-10-10T14:36:22.250830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601926687121778:4393]
2025-10-10T14:36:22.250836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601926687121778:4393]
2025-10-10T14:36:22.250840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601926687121778:4393]
2025-10-10T14:36:22.250859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:22.250880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:22.250900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:22.250907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:22.250910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:22.250914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:22.250916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:22.250952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601926687121778:4393]
2025-10-10T14:36:22.250963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:22.251019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:22.250878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1987
2025-10-10T14:36:22.250905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1987
2025-10-10T14:36:22.251167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.251178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.251215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:22.251229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.251239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.251241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:22.251254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.251273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:22.251296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.251553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.251566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.251588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.251794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1988 partition: 0 MaxSeqNo: 40 sessionId: src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0
2025-10-10T14:36:22.252219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc2a15b0-4f42907d-fd9578a7-fdf949ee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:22.255365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0] Write session: try to update token
2025-10-10T14:36:22.255391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:22.271653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId: src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:22.274608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:22.274616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:22.274638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:22.274642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:22.274644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:22.274654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601926687121778:4393]
2025-10-10T14:36:22.274659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601926687121778:4393]
2025-10-10T14:36:22.274663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601926687121778:4393]
2025-10-10T14:36:22.274717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:22.274731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.274734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:22.274781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:22.274789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:22.274804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:22.274871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:22.332123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601927469351528:6092]
2025-10-10T14:36:22.332428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1987, pipe: [1:7559601927469351528:6092]
2025-10-10T14:36:22.402656Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:22.402890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.402905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.402944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351528:6092], now have 1 active actors on pipe
2025-10-10T14:36:22.403578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:22.403250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:22.403407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:22.403410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:22.403472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1988 reason: error at write: Disconnected sessionId: src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0
2025-10-10T14:36:22.403685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1988 sessionId: src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0 is DEAD
2025-10-10T14:36:22.403870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601927469351528:6092]
2025-10-10T14:36:22.404194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:22.404218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0] Write session will restart in 0.007010s
2025-10-10T14:36:22.404243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0] Write session: Do CDS request
2025-10-10T14:36:22.404252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:22.415857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.413396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:22.415468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:22.415698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:22.415705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:22.415720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:22.415786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:22.415827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601926687121889:4397]
2025-10-10T14:36:22.416476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:22.416882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:22.416947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:22.417446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:22.417463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1989
2025-10-10T14:36:22.417282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:22.417384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.417385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.417387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.417388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.417389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.417390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.417391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.417392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.417393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.417395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.417396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.417397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.417398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.417405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.417417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.417421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.417425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.417429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.417432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.417436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.417441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.417445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.417449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.417453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.417456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.417460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.417468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.417476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.417486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.417491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.417495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.417499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.417503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.417508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.417512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.417517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.417521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.417526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.417531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.417535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.417540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.417546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.417550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.417554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.417557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.417564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.417569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.417576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.417579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.417584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.417588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.417594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.417647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:22.417812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.417845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:22.417850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:22.417854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:22.418296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1989 sessionId:  describe result for acl check
2025-10-10T14:36:22.418332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:22.418334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:22.418336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:22.418342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601927469351587:5351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:22.418914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601927469351587:5351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:22.421801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:22.422735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:22.422748Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:22.422750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:22.422754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:22.422761Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1988 [2:7559601926687121889:4397]
2025-10-10T14:36:22.422774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:22.422793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:22.422798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.422802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.422804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.422824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:22.422837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:22.422844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:22.422911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.422918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.422920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.422922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:22.422991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:22.422999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.423011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.423023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.423047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:22.422012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601927469351587:5351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:22.423173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1988
2025-10-10T14:36:22.423076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601926687121884:4397]
2025-10-10T14:36:22.423087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601926687121884:4397]
2025-10-10T14:36:22.423089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601926687121884:4397]
2025-10-10T14:36:22.423104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:22.423119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351545:2438], now have 1 active actors on pipe
2025-10-10T14:36:22.423122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:22.423126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:22.423128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:22.423128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:22.423144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:22.423147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:22.423183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601926687121884:4397]
2025-10-10T14:36:22.423186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:22.423223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:22.430921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601927469351587:5351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:22.430938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601927469351587:5351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:22.430942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601927469351587:5351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:22.430951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:22.431786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1988
2025-10-10T14:36:22.432477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351619:5351], now have 1 active actors on pipe
2025-10-10T14:36:22.432511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.432529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.432566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:22.432579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.432594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.432597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:22.432612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.432633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:22.432655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.433038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.433050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.433076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.433409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1989 partition: 0 MaxSeqNo: 40 sessionId: src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0
2025-10-10T14:36:22.433875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c109a0e2-1049e792-daef6de1-4e0ebd8c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:22.436534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0] Write session: try to update token
2025-10-10T14:36:22.436557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:22.455961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId: src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:22.458675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:22.454004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:22.454024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:22.454028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:22.454030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:22.454040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601926687121884:4397]
2025-10-10T14:36:22.454044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601926687121884:4397]
2025-10-10T14:36:22.454052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601926687121884:4397]
2025-10-10T14:36:22.454100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:22.454102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:22.454108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.454110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:22.454111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:22.454115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:22.454249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:22.504445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601927469351632:6092]
2025-10-10T14:36:22.504899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1988, pipe: [1:7559601927469351632:6092]
2025-10-10T14:36:22.578937Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:22.580058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.580074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.580134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351632:6092], now have 1 active actors on pipe
2025-10-10T14:36:22.581775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:22.584710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601927469351632:6092]
2025-10-10T14:36:22.584758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:22.584861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1989 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0
2025-10-10T14:36:22.585077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1989 sessionId: src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0 is DEAD
2025-10-10T14:36:22.585349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:22.585597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:22.585608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0] Write session will restart in 0.007405s
2025-10-10T14:36:22.585639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0] Write session: Do CDS request
2025-10-10T14:36:22.585645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:22.594036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.596913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:22.596931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1990
2025-10-10T14:36:22.600532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.600585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:22.600590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:22.600594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:22.600835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:22.605206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1990 sessionId:  describe result for acl check
2025-10-10T14:36:22.605251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:22.605254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:22.605259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:22.605264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601927469351671:5341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:22.606783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601927469351671:5341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:22.606524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:22.606810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:22.606815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:22.606828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:22.606892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:22.606933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601926687121973:4384]
2025-10-10T14:36:22.607674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:22.608087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:22.608149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:22.608521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:22.608605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.608612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.608613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.608614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.608616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.608617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.608618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.608620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.608621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.608622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.608624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.608625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.608626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.608633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.608648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.608652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.608655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.608658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.608662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.608665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.608668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.608673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.608677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.608681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.608685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.608688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.608695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.608704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.608709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.608714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.608718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.608723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.608727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.608732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.608736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.608741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.608746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.608752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.608757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.608775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.608787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.608793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.608803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.608809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.608819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.608825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.608834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.608851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.608856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.608861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.608866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.608876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.608917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:22.610236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601927469351671:5341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:22.612023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:22.612485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:22.612497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:22.612502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:22.612507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:22.612513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1989 [2:7559601926687121973:4384]
2025-10-10T14:36:22.612525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:22.612552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:22.612563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.612567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.612570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.612588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:22.612601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:22.612608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:22.612669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.612675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.612678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.612680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:22.612746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:22.612754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.612778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.612792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.612809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:22.612833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351637:2438], now have 1 active actors on pipe
2025-10-10T14:36:22.612842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601926687121967:4384]
2025-10-10T14:36:22.612844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601926687121967:4384]
2025-10-10T14:36:22.612846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601926687121967:4384]
2025-10-10T14:36:22.612861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:22.612875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:22.612892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:22.612901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:22.612930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601926687121967:4384]
2025-10-10T14:36:22.612937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:22.612980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:22.612983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:22.612986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:22.612994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:22.614446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351707:5341], now have 1 active actors on pipe
2025-10-10T14:36:22.614590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.614604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.614648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7218eed2-4335b6a5-87dae199-124b3d23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:22.614659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.614664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.614666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:22.614678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.614694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:22.614708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.613406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1989
2025-10-10T14:36:22.613850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601927469351671:5341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:22.613857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601927469351671:5341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:22.613861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601927469351671:5341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:22.613869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:22.614493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1989
2025-10-10T14:36:22.614925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.614932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.614950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.615067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1990 partition: 0 MaxSeqNo: 40 sessionId: src_id|7218eed2-4335b6a5-87dae199-124b3d23_0
2025-10-10T14:36:22.615492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa9f92a-8407e687-65cf2780-5a58abd0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7218eed2-4335b6a5-87dae199-124b3d23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:22.618339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7218eed2-4335b6a5-87dae199-124b3d23_0] Write session: try to update token
2025-10-10T14:36:22.618363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7218eed2-4335b6a5-87dae199-124b3d23_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:22.634513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId: src_id|7218eed2-4335b6a5-87dae199-124b3d23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:22.637112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:22.637369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.637394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.637449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:22.637549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:22.647753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:22.647772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:22.647779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:22.647781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:22.647797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601926687121967:4384]
2025-10-10T14:36:22.647801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601926687121967:4384]
2025-10-10T14:36:22.647805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601926687121967:4384]
2025-10-10T14:36:22.647854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:22.647866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.647877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:22.647904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:22.647919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:22.647924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:22.648017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:22.684338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601927469351714:6092]
2025-10-10T14:36:22.684739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1989, pipe: [1:7559601927469351714:6092]
2025-10-10T14:36:22.776135Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:22.785407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.785438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.785636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.785706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.785774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.785840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.785888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.785900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.785974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.786061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.786129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.786382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.786428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.786431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.786509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.786569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.786634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.786698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.786743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.786746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.786827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.786889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.786952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.787024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.787067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.787070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.787144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.787208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.787275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.787337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.787384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.787387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.787461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.787523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.787586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.787656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.787709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.787712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.787785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.787846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.787992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.788126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.788178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.788181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.788256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.788319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.788389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.788454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.789074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.789083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.789159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.789224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.789288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.790146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.790197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.790203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.790281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.790942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601927469351714:6092]
2025-10-10T14:36:22.790953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:22.790958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:22.790977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:22.790993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1990 reason: error at write: Disconnected sessionId: src_id|7218eed2-4335b6a5-87dae199-124b3d23_0
2025-10-10T14:36:22.791270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1990 sessionId: src_id|7218eed2-4335b6a5-87dae199-124b3d23_0 is DEAD
2025-10-10T14:36:22.791361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7218eed2-4335b6a5-87dae199-124b3d23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:22.791370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7218eed2-4335b6a5-87dae199-124b3d23_0] Write session will restart in 0.005782s
2025-10-10T14:36:22.791395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7218eed2-4335b6a5-87dae199-124b3d23_0] Write session: Do CDS request
2025-10-10T14:36:22.791402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7218eed2-4335b6a5-87dae199-124b3d23_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:22.790354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.790444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.790514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.790562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.790565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.790687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351714:6092], now have 1 active actors on pipe
2025-10-10T14:36:22.791572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:22.799000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7218eed2-4335b6a5-87dae199-124b3d23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.799016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:22.799033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1991
2025-10-10T14:36:22.799254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.799302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:22.799323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:22.799328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:22.799794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1991 sessionId:  describe result for acl check
2025-10-10T14:36:22.799830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:22.799838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:22.799840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:22.799853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601927469351761:5334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:22.800454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601927469351761:5334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:22.802347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:22.804031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:22.804127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601927469351761:5334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:22.804302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:22.804315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:22.804328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:22.804403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:22.804450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601926687122051:4382]
2025-10-10T14:36:22.805187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:22.805567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:22.805626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:22.805945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:22.806021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.806028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.806029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.806030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.806032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.806033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.806034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.806036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.806037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.806038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.806039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.806040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.806041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.806047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.806062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.806066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.806070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.806073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.806078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.806081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.806085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.806089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.806095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.806099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.806102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.806108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.806116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.806125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.806131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.806137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.806141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.806148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.806152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.806157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.806162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.806166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.806170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.806175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.806180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.806184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.806188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.806193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.806197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.806202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.806206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.806212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.806219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.806223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.806227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.806231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.806236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.806250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.806289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:22.806956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601927469351761:5334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:22.806970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601927469351761:5334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:22.806974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601927469351761:5334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:22.806984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:22.809689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:22.810128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:22.810141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:22.810144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:22.810149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:22.810156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1990 [2:7559601926687122051:4382]
2025-10-10T14:36:22.810171Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:22.810193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:22.810196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.810201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.810206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.810231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:22.810245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:22.810258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:22.810323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.810330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.810332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.810336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:22.810410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:22.810430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.810446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.810462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.810483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:22.810508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351799:5334], now have 1 active actors on pipe
2025-10-10T14:36:22.810516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351725:2438], now have 1 active actors on pipe
2025-10-10T14:36:22.810524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601926687122045:4382]
2025-10-10T14:36:22.810526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601926687122045:4382]
2025-10-10T14:36:22.810528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601926687122045:4382]
2025-10-10T14:36:22.810544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:22.810557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:22.810561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:22.810563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:22.810564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:22.810580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:22.810584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:22.810554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1990
2025-10-10T14:36:22.810576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1990
2025-10-10T14:36:22.810630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.810641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.810661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601926687122045:4382]
2025-10-10T14:36:22.810669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:22.810675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:22.810702Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:22.810716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.810720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.810723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:22.810735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.810750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:22.810779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.810949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.810958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.810977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.811094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1991 partition: 0 MaxSeqNo: 40 sessionId: src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0
2025-10-10T14:36:22.811505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7218eed2-4335b6a5-87dae199-124b3d23_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:22.814351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0] Write session: try to update token
2025-10-10T14:36:22.814371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:22.830175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId: src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:22.832959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:22.833269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.833293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.833353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:22.833464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:22.835833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:22.835849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:22.835852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:22.835853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:22.835862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601926687122045:4382]
2025-10-10T14:36:22.835867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601926687122045:4382]
2025-10-10T14:36:22.835871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601926687122045:4382]
2025-10-10T14:36:22.835924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:22.835931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:22.835931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:22.835935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:22.835940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.835943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:22.836099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:22.893446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601927469351807:6092]
2025-10-10T14:36:22.893912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1990, pipe: [1:7559601927469351807:6092]
2025-10-10T14:36:22.950332Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:22.958596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.958627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.958809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.958884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.958955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.959028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.959077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.959087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.959161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.959229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.959294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.959362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.959414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.959417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.959490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.959551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.959614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.959674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.959718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.959721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.959793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.959855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.959919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.959981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.960028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.960031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.960101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.960164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.960230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.960289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.960335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.960340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.960412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.960474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.960542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.960608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.960652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.960654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.960724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.960800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.960868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.960938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.960982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.960985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.961059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.961122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.961187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.961252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.961296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.961302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.961567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.961631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.961690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.961754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.961797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.961800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.961878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:22.961939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:22.962001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:22.962060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:22.962101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:22.962104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:22.962184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351807:6092], now have 1 active actors on pipe
2025-10-10T14:36:22.963728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:22.963611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:22.963669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601927469351807:6092]
2025-10-10T14:36:22.963696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:22.963698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:22.963729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1991 reason: error at write: Disconnected sessionId: src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0
2025-10-10T14:36:22.963948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1991 sessionId: src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0 is DEAD
2025-10-10T14:36:22.966471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:22.966494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0] Write session will restart in 0.009321s
2025-10-10T14:36:22.966521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0] Write session: Do CDS request
2025-10-10T14:36:22.966528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:22.975228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:22.977443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.977635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:22.977653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1992
2025-10-10T14:36:22.977859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:22.977894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:22.977905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:22.977909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:22.977528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:22.977759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:22.977765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:22.977778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:22.977843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:22.977888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601926687122143:4376]
2025-10-10T14:36:22.978417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:22.978859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:22.978906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:22.979275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:22.979340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.979341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.979342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.979343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.979347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.979348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.979349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.979350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.979351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.979352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.979353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.979354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.979355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.979361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.979371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.978824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1992 sessionId:  describe result for acl check
2025-10-10T14:36:22.979375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.979379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.979383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.978860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:22.979386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.978861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:22.978863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:22.978871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601927469351867:5325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:22.979389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.979419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601927469351867:5325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:22.979392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.979395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.979399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.979402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.979406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.979409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.979416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.979429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:22.979435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.979440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:22.979444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.979448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:22.979451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.979456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:22.979460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.979466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:22.979470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.979475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:22.979479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.979483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:22.979486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.979491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:22.979494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.979499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:22.979502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.979506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:22.979510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.979515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.979519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.979524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.979527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.979531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.979565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:22.981785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601927469351867:5325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:22.982739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:22.983111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:22.983128Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:22.983131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:22.983134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:22.983141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1991 [2:7559601926687122143:4376]
2025-10-10T14:36:22.983155Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:22.983172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:22.983176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.983180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.983183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.983200Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:22.983213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:22.983225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:22.983285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.983292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.983294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.983297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:22.983361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:22.983369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:22.983380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:22.983391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:22.983407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:22.983430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351824:2438], now have 1 active actors on pipe
2025-10-10T14:36:22.983439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601926687122136:4376]
2025-10-10T14:36:22.983441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601926687122136:4376]
2025-10-10T14:36:22.983443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601926687122136:4376]
2025-10-10T14:36:22.983455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:22.983468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:22.983470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:22.983471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:22.983472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:22.983487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:22.983490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:22.983516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601926687122136:4376]
2025-10-10T14:36:22.983522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:22.983528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:22.984111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1991
2025-10-10T14:36:22.985931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601927469351867:5325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:22.985943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601927469351867:5325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:22.985955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601927469351867:5325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:22.985963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:22.986448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601927469351898:5325], now have 1 active actors on pipe
2025-10-10T14:36:22.986556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1991
2025-10-10T14:36:22.986629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.986639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.986669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:22.986679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:22.986685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:22.986687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:22.986698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:22.986725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:22.986740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.987040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:22.987049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:22.987064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:22.987182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1992 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0
2025-10-10T14:36:22.987607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b69c4be3-1aba2139-2d126d48-2a087ccc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:22.990331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0] Write session: try to update token
2025-10-10T14:36:22.990350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:23.010405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:23.010430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.010434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:23.010439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:23.010450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601926687122136:4376]
2025-10-10T14:36:23.010455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601926687122136:4376]
2025-10-10T14:36:23.010460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601926687122136:4376]
2025-10-10T14:36:23.010512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:23.010520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.010528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:23.010595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:23.010612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:23.010617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:23.010685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:23.011446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId: src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:23.014200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:23.061199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601931764319198:6092]
2025-10-10T14:36:23.061511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1991, pipe: [1:7559601931764319198:6092]
2025-10-10T14:36:23.137255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:23.137677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.137697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.137745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319198:6092], now have 1 active actors on pipe
2025-10-10T14:36:23.137998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:23.138493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601931764319198:6092]
2025-10-10T14:36:23.138532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:23.138612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1992 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0
2025-10-10T14:36:23.138860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1992 sessionId: src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0 is DEAD
2025-10-10T14:36:23.138891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:23.141481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:23.141495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0] Write session will restart in 0.007827s
2025-10-10T14:36:23.141520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0] Write session: Do CDS request
2025-10-10T14:36:23.141527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:23.150917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.151468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:23.151041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:23.151067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1993
2025-10-10T14:36:23.151202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.151235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:23.151241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:23.151246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:23.152220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1993 sessionId:  describe result for acl check
2025-10-10T14:36:23.152259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:23.152261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:23.152263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:23.152270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601931764319243:5316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:23.152859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601931764319243:5316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:23.153531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:23.153764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:23.153776Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:23.153789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:23.153849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:23.153898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601930982089518:4375]
2025-10-10T14:36:23.154477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:23.154788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:23.154850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:23.155191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:23.155261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.155266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.155267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.155268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.155268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.155269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.155270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.155271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.155273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.155274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.155275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.155276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.155276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.155281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.155288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.155291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.155293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.155295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.155298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.155300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.155302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.155304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.155307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.155309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.155311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.155313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.155319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.155325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.155331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.155337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.155341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.155346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.155351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.155356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.155361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.155367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.155371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.155377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.155382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.155386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.155390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.155395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.155397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.155400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.155403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.155406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.155409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.155412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.155414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.155418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.155420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.155423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.155462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:23.155770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601931764319243:5316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:23.158736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601931764319243:5316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:23.158734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:23.158754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601931764319243:5316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:23.158758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601931764319243:5316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:23.158767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:23.159200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:23.159213Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:23.159216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:23.159220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:23.159225Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1992 [2:7559601930982089518:4375]
2025-10-10T14:36:23.159243Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:23.159258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:23.159260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.159264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.159266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.159279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:23.159299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:23.159310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:23.159367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.159374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.159376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.159380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:23.159444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:23.159453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.159465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.159481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.159499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:23.159525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319276:5316], now have 1 active actors on pipe
2025-10-10T14:36:23.159533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319201:2438], now have 1 active actors on pipe
2025-10-10T14:36:23.159524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1992
2025-10-10T14:36:23.159540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601930982089512:4375]
2025-10-10T14:36:23.159537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1992
2025-10-10T14:36:23.159547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601930982089512:4375]
2025-10-10T14:36:23.159549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601930982089512:4375]
2025-10-10T14:36:23.159565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:23.159585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:23.159605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:23.159612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:23.159632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:23.159639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601930982089512:4375]
2025-10-10T14:36:23.159641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:23.159642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:23.159644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:23.159650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:23.159686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.159691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.159723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:23.159736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.159743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.159745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:23.159757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.159772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:23.159791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.160119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.160144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.160169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.160295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1993 partition: 0 MaxSeqNo: 40 sessionId: src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0
2025-10-10T14:36:23.160697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f86d20b-ea34cf4c-e2b94c3a-942e9881_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:23.163400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0] Write session: try to update token
2025-10-10T14:36:23.163419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:23.176800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:23.176824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.176835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601930982089512:4375]
2025-10-10T14:36:23.176882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:23.176888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:23.177066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:23.177210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.177370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.177514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.177715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:23.177760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:23.180606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.180626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.180665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:23.177818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId: src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:23.180412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:23.180773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:23.199415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:23.199435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.199438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:23.199441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:23.199454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601930982089512:4375]
2025-10-10T14:36:23.199458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601930982089512:4375]
2025-10-10T14:36:23.199461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601930982089512:4375]
2025-10-10T14:36:23.199503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:23.199508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:23.199516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.199519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:23.199519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:23.199523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:23.199648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:23.238858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601931764319283:6092]
2025-10-10T14:36:23.239184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1992, pipe: [1:7559601931764319283:6092]
2025-10-10T14:36:23.322138Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:23.330188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.330214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.330388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.330453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.330514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.330577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.330867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.330884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.330952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.331013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.331072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.331143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.331190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.331198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.331260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.331322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.331381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.331442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.331485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.331492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.331555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.331867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.331933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.331993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.332036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.332043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.332106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.332162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.332221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.332285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.332327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.332338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.332401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.332456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.332533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.332619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.332671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.332680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.332779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.332862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.332951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.333035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.333089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.333097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.333178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.333255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.333353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.333436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.333488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.333502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.333584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.333662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.333744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.333829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.333883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.333895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.333974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.334062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.334147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.334230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.334281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.334291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.334445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319283:6092], now have 1 active actors on pipe
2025-10-10T14:36:23.335123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:23.335236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:23.335245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0] Write session will restart in 0.005377s
2025-10-10T14:36:23.335272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0] Write session: Do CDS request
2025-10-10T14:36:23.335278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:23.334727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601931764319283:6092]
2025-10-10T14:36:23.334765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:23.334768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:23.334804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1993 reason: error at write: Disconnected sessionId: src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0
2025-10-10T14:36:23.335063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1993 sessionId: src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0 is DEAD
2025-10-10T14:36:23.335090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:23.342038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:23.342065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1994
2025-10-10T14:36:23.342108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.342367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.342417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:23.342430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:23.342435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:23.342862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1994 sessionId:  describe result for acl check
2025-10-10T14:36:23.343299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:23.343310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:23.343312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:23.343319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601931764319301:5312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:23.343954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601931764319301:5312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:23.346345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:23.348231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:23.348489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:23.348504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:23.348516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:23.348584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:23.348635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601930982089599:4374]
2025-10-10T14:36:23.349114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601931764319301:5312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:23.349223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:23.349589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:23.349649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:23.350016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:23.350089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.350096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.350097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.350099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.350100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.350102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.350103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.350104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.350105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.350107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.350108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.350109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.350110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.350120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.350133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.350137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.350141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.350145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.350149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.350153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.350158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.350162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.350167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.350171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.350175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.350178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.350186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.350195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.350202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.350209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.350214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.350219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.350224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.350229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.350234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.350239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.350246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.350251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.350256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.350262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.350266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.350272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.350277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.350282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.350290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.350294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.350298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.350303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.350309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.350314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.350318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.350323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.350365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:23.353400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:23.353474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601931764319301:5312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:23.353492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601931764319301:5312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:23.353496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601931764319301:5312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:23.353507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:23.353799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:23.353815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:23.353818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:23.353822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:23.353829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1993 [2:7559601930982089599:4374]
2025-10-10T14:36:23.353845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:23.353866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:23.353870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.353874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.353876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.353896Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:23.353904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:23.353911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:23.353983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.353994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.353996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.353999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:23.354074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:23.354083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.354097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.354111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.354138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:23.354163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601930982089593:4374]
2025-10-10T14:36:23.354171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601930982089593:4374]
2025-10-10T14:36:23.354173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601930982089593:4374]
2025-10-10T14:36:23.354188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:23.354203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319286:2438], now have 1 active actors on pipe
2025-10-10T14:36:23.354214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319362:5312], now have 1 active actors on pipe
2025-10-10T14:36:23.354221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:23.354235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:23.354241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:23.354244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:23.354246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:23.354248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:23.354277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601930982089593:4374]
2025-10-10T14:36:23.354286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:23.354271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1993
2025-10-10T14:36:23.354297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:23.354316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1993
2025-10-10T14:36:23.354376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.354388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.354419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:23.354433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.354437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.354439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:23.354453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.354469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:23.354490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.354652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.354660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.354675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.354754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1994 partition: 0 MaxSeqNo: 40 sessionId: src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0
2025-10-10T14:36:23.355168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bde0284-952c7cf2-baa3b6fe-6066dd12_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:23.357951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0] Write session: try to update token
2025-10-10T14:36:23.357974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:23.378014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId: src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:23.380641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:23.378527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:23.378550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.378554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:23.378560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:23.378570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601930982089593:4374]
2025-10-10T14:36:23.378577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601930982089593:4374]
2025-10-10T14:36:23.378580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601930982089593:4374]
2025-10-10T14:36:23.378637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:23.378645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.378647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:23.378798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:23.381944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:23.381960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:23.381964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:23.437503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601931764319369:6092]
2025-10-10T14:36:23.437838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1993, pipe: [1:7559601931764319369:6092]
2025-10-10T14:36:23.508264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:23.508638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.508654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.508703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319369:6092], now have 1 active actors on pipe
2025-10-10T14:36:23.509011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:23.509461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:23.509477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0] Write session will restart in 0.009485s
2025-10-10T14:36:23.508980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:23.508994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:23.509042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601931764319369:6092]
2025-10-10T14:36:23.509059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:23.509062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1994 reason: error at write: Disconnected sessionId: src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0
2025-10-10T14:36:23.509272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1994 sessionId: src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0 is DEAD
2025-10-10T14:36:23.509524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0] Write session: Do CDS request
2025-10-10T14:36:23.509539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:23.517849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:23.519543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:23.519779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:23.519794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:23.519807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:23.519870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:23.519932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.519914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601930982089717:4350]
2025-10-10T14:36:23.520042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:23.520056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1995
2025-10-10T14:36:23.520213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.520267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:23.520279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:23.520284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:23.520589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:23.520730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1995 sessionId:  describe result for acl check
2025-10-10T14:36:23.520778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:23.520785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:23.520787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:23.520794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601931764319444:5299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:23.520936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:23.520996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:23.521379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:23.521399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601931764319444:5299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:23.521442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.521449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.521450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.521452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.521453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.521454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.521456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.521457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.521459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.521460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.521461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.521463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.521464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.521471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.521485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.521489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.521494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.521498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.521502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.521506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.521511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.521515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.521520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.521525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.521529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.521535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.521542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.521552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.521558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.521564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.521569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.521574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.521582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.521587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.521599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.521604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.521613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.521619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.521624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.521629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.521634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.521643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.521647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.521652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.521658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.521667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.521673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.521678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.521688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.521693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.521704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.521709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.521758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:23.523469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601931764319444:5299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:23.524683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:23.525124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:23.525141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:23.525147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:23.525151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:23.525159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1994 [2:7559601930982089717:4350]
2025-10-10T14:36:23.525173Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:23.525191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:23.525195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.525200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.525202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.525219Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:23.525233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:23.525240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:23.525308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.525317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.525319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.525322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:23.525414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:23.525425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.525438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.525452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.525472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:23.525508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319398:2438], now have 1 active actors on pipe
2025-10-10T14:36:23.525521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601930982089712:4350]
2025-10-10T14:36:23.525524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601930982089712:4350]
2025-10-10T14:36:23.525526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601930982089712:4350]
2025-10-10T14:36:23.525543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:23.525563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:23.525565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:23.525567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:23.525569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:23.525584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:23.525558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1994
2025-10-10T14:36:23.525587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:23.525619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601930982089712:4350]
2025-10-10T14:36:23.525631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:23.525638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:23.525805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601931764319444:5299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:23.525821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601931764319444:5299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:23.525825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601931764319444:5299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:23.525833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:23.526154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1994
2025-10-10T14:36:23.526625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1995 partition: 0 MaxSeqNo: 40 sessionId: src_id|2b144826-4762b7e6-ee6c979a-97052862_0
2025-10-10T14:36:23.527059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b41a63b6-9f7198d0-41da03e4-567ef33_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2b144826-4762b7e6-ee6c979a-97052862_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:23.526084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319473:5299], now have 1 active actors on pipe
2025-10-10T14:36:23.526221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.526226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.526271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b144826-4762b7e6-ee6c979a-97052862_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:23.526281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.526285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.526287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:23.526300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.526313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:23.526332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.526509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.526512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.526527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.529797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b144826-4762b7e6-ee6c979a-97052862_0] Write session: try to update token
2025-10-10T14:36:23.529817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b144826-4762b7e6-ee6c979a-97052862_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:23.544424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId: src_id|2b144826-4762b7e6-ee6c979a-97052862_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:23.546796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:23.546822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.546825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:23.546830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:23.546842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601930982089712:4350]
2025-10-10T14:36:23.546848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601930982089712:4350]
2025-10-10T14:36:23.546852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601930982089712:4350]
2025-10-10T14:36:23.546904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:23.546909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:23.546916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:23.546917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.546920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:23.546923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:23.547067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:23.547138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:23.609048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601931764319479:6092]
2025-10-10T14:36:23.609382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1994, pipe: [1:7559601931764319479:6092]
2025-10-10T14:36:23.669695Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:23.670014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.670031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.670079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319479:6092], now have 1 active actors on pipe
2025-10-10T14:36:23.670348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601931764319479:6092]
2025-10-10T14:36:23.670383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:23.670431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:23.670516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1995 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b144826-4762b7e6-ee6c979a-97052862_0
2025-10-10T14:36:23.670295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:23.670714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1995 sessionId: src_id|2b144826-4762b7e6-ee6c979a-97052862_0 is DEAD
2025-10-10T14:36:23.670923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b144826-4762b7e6-ee6c979a-97052862_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:23.670934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b144826-4762b7e6-ee6c979a-97052862_0] Write session will restart in 0.008623s
2025-10-10T14:36:23.670959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b144826-4762b7e6-ee6c979a-97052862_0] Write session: Do CDS request
2025-10-10T14:36:23.670965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b144826-4762b7e6-ee6c979a-97052862_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:23.680147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:23.680913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b144826-4762b7e6-ee6c979a-97052862_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.681046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:23.681060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1996
2025-10-10T14:36:23.681175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.681211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:23.681221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:23.681225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:23.681990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:23.682157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1996 sessionId:  describe result for acl check
2025-10-10T14:36:23.682193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:23.682199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:23.682201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:23.682217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601931764319526:5289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:23.682221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:23.682233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:23.682247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:23.682303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:23.682365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601930982089799:4348]
2025-10-10T14:36:23.682823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601931764319526:5289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:23.682988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:23.683280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:23.683324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:23.683671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:23.683730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.683736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.683737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.683738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.683742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.683743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.683744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.683745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.683747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.683748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.683749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.683750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.683751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.683757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.683767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.683771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.683775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.683778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.683783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.683786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.683790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.683794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.683798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.683803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.683807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.683811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.683817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.683826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.683833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.683839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.683844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.683849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.683853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.683859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.683864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.683871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.683876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.683881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.683886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.683896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.683901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.683912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.683917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.683922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.683926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.683931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.683935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.683940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.683944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.683949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.683960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.683964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.684009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:23.684859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601931764319526:5289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:23.686470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:23.686846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:23.686860Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:23.686863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:23.686867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:23.686873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1995 [2:7559601930982089799:4348]
2025-10-10T14:36:23.686887Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:23.686906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:23.686914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.686918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.686921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.686939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:23.686953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:23.686970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:23.687026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.687033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.687035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.687038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:23.687182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:23.687193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.687206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.687219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.687243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:23.687270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319482:2438], now have 1 active actors on pipe
2025-10-10T14:36:23.687282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601930982089794:4348]
2025-10-10T14:36:23.687286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601930982089794:4348]
2025-10-10T14:36:23.687288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601930982089794:4348]
2025-10-10T14:36:23.687301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:23.687321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:23.687338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:23.687341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:23.687372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601930982089794:4348]
2025-10-10T14:36:23.687379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:23.687394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:23.687398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:23.687401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:23.687408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:23.687386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1995
2025-10-10T14:36:23.687630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601931764319526:5289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:23.687654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601931764319526:5289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:23.687662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601931764319526:5289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:23.687671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:23.687864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319562:5289], now have 1 active actors on pipe
2025-10-10T14:36:23.687914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1995
2025-10-10T14:36:23.687978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.687992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.688026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1309cd-e1d1312b-db060094-3d900efd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:23.688040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.688047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.688062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:23.688079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.688096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:23.688113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.688267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.688275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.688289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.688364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1996 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1309cd-e1d1312b-db060094-3d900efd_0
2025-10-10T14:36:23.688796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b144826-4762b7e6-ee6c979a-97052862_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1309cd-e1d1312b-db060094-3d900efd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:23.691808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1309cd-e1d1312b-db060094-3d900efd_0] Write session: try to update token
2025-10-10T14:36:23.691829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1309cd-e1d1312b-db060094-3d900efd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:23.700337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:23.700358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.700369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601930982089794:4348]
2025-10-10T14:36:23.700423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:23.700424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:23.700617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:23.700800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.700959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.701106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.701305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:23.701368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:23.707852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId: src_id|a1309cd-e1d1312b-db060094-3d900efd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:23.710999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:23.711221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.711242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.711294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:23.711406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:23.720078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:23.720106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.720110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:23.720112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:23.720124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601930982089794:4348]
2025-10-10T14:36:23.720146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601930982089794:4348]
2025-10-10T14:36:23.720154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601930982089794:4348]
2025-10-10T14:36:23.720202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:23.720209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:23.720216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:23.720218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.720220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:23.720229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:23.720360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:23.770331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601931764319577:6092]
2025-10-10T14:36:23.770727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1995, pipe: [1:7559601931764319577:6092]
2025-10-10T14:36:23.844259Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:23.853025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.853060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.853246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.853311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.853395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.853459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.853510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.853523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.853592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.853653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.853717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.853787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.853831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.853838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.853905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.853963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.854026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.854090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.854135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.854145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.854214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.854279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.854341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.856960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1309cd-e1d1312b-db060094-3d900efd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:23.856973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1309cd-e1d1312b-db060094-3d900efd_0] Write session will restart in 0.008759s
2025-10-10T14:36:23.857000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1309cd-e1d1312b-db060094-3d900efd_0] Write session: Do CDS request
2025-10-10T14:36:23.857007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1309cd-e1d1312b-db060094-3d900efd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:23.856542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:23.856545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:23.856555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:23.856590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1996 reason: error at write: Disconnected sessionId: src_id|a1309cd-e1d1312b-db060094-3d900efd_0
2025-10-10T14:36:23.856601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601931764319577:6092]
2025-10-10T14:36:23.856826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1996 sessionId: src_id|a1309cd-e1d1312b-db060094-3d900efd_0 is DEAD
2025-10-10T14:36:23.854411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.854459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.854462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.854529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.854583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.854640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.854702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.854743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.854746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.854811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.854867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.854926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.854986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.855026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.855030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.855100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.855157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.855218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.855285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.855328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.855334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.855398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.855455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.855513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.855571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.855620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.855623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.855688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.855743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.855801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.855859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.855899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.855902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.855966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:23.856021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:23.856082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:23.856143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:23.856183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:23.856186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:23.856258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319577:6092], now have 1 active actors on pipe
2025-10-10T14:36:23.857611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:23.866983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1309cd-e1d1312b-db060094-3d900efd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.867071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:23.867087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1997
2025-10-10T14:36:23.867224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:23.867261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:23.867270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:23.867274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:23.867733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1997 sessionId:  describe result for acl check
2025-10-10T14:36:23.867769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:23.867771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:23.867775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:23.867780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601931764319595:5279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:23.868380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601931764319595:5279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:23.870548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:23.871274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601931764319595:5279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:23.872503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:23.872756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:23.872767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:23.872781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:23.872846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:23.872898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601930982089883:4336]
2025-10-10T14:36:23.873552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:23.873858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:23.873907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:23.873874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601931764319595:5279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:23.873889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601931764319595:5279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:23.873892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601931764319595:5279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:23.873901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:23.874233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:23.874300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.874301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.874302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.874304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.874305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.874306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.874307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.874309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.874310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.874311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.874312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.874313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.874315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.874320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.874336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.874340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.874343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.874347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.874351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.874355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.874358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.874362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.874367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.874371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.874375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.874379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.874386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.874395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:23.874402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.874408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:23.874412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.874417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:23.874422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.874428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:23.874434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.874439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:23.874445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.874450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:23.874455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.874460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:23.874464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.874470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:23.874474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.874480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:23.874483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.874492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:23.874498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.874504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.874509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.874514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.874520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.874525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.874571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:23.877394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:23.878303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1996
2025-10-10T14:36:23.878307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1996
2025-10-10T14:36:23.877912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:23.877926Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:23.877929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:23.877936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:23.877942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1996 [2:7559601930982089883:4336]
2025-10-10T14:36:23.877954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:23.877972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:23.877976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.877988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.877991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.878009Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:23.878016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:23.878022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:23.878078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.878080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.878082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.878084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:23.878150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:23.878153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.878164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:23.878177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:23.878193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:23.878216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319580:2438], now have 1 active actors on pipe
2025-10-10T14:36:23.878219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319657:5279], now have 1 active actors on pipe
2025-10-10T14:36:23.878227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601930982089878:4336]
2025-10-10T14:36:23.878232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601930982089878:4336]
2025-10-10T14:36:23.878234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601930982089878:4336]
2025-10-10T14:36:23.878248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:23.878267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:23.878269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:23.878273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:23.878275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:23.878282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:23.878285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:23.878307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601930982089878:4336]
2025-10-10T14:36:23.878309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:23.878326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:23.878342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.878348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.878380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:23.878389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:23.878393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:23.878395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:23.878407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:23.878418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:23.878432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.878582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.878585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.878603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:23.878673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1997 partition: 0 MaxSeqNo: 40 sessionId: src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0
2025-10-10T14:36:23.879077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1309cd-e1d1312b-db060094-3d900efd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:23.881950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0] Write session: try to update token
2025-10-10T14:36:23.881969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:23.891769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:23.891790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.891807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601930982089878:4336]
2025-10-10T14:36:23.891858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:23.891865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:23.892050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:23.892211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.892361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.892518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:23.892700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:23.892759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:23.904071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId: src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:23.906946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:23.907205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:23.907230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:23.907274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:23.907418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:23.910216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:23.910237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:23.910240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:23.910243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:23.910255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601930982089878:4336]
2025-10-10T14:36:23.910260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601930982089878:4336]
2025-10-10T14:36:23.910269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601930982089878:4336]
2025-10-10T14:36:23.910325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:23.910331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:23.910337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:23.910342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:23.910344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:23.910350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:23.910521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:23.956679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601931764319679:6092]
2025-10-10T14:36:23.959503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1996, pipe: [1:7559601931764319679:6092]
2025-10-10T14:36:24.029974Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:24.038526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.038559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.038750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.038818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.038889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.038962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.039017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.039029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.039106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.039171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.039247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.039317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.039366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.039377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.039446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.039515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.039588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.039661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.039707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.039715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.039781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.039846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.039913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.039981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.040027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.040036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.040106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.040169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.040236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.040312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.040360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.040369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.040443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.040506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.040569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.040641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.040694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.040703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.040821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.040888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.040957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.041028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.041077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.041085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.041154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.041218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.041286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.041370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.041419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.041432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.041499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.041563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.041629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.041697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.041746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.041754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.041821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.041885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.041961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.042034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.042082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.042090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.042160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601931764319679:6092], now have 1 active actors on pipe
2025-10-10T14:36:24.042403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:24.042415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601931764319679:6092]
2025-10-10T14:36:24.042448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:24.042451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:24.042492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1997 reason: error at write: Disconnected sessionId: src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0
2025-10-10T14:36:24.042715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1997 sessionId: src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0 is DEAD
2025-10-10T14:36:24.042879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:24.042889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0] Write session will restart in 0.009091s
2025-10-10T14:36:24.042914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0] Write session: Do CDS request
2025-10-10T14:36:24.042920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:24.043318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:24.052934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.053000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:24.053019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1998
2025-10-10T14:36:24.053166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.053213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:24.053221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:24.053226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:24.053698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1998 sessionId:  describe result for acl check
2025-10-10T14:36:24.053733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:24.053736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:24.053738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:24.053744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601936059287022:5275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:24.054338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601936059287022:5275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:24.052640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:24.054637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:24.054849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:24.054855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:24.054868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:24.054928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:24.054968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601935277057277:4343]
2025-10-10T14:36:24.055566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:24.055864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:24.055904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:24.056223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:24.056292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.056301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.056302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.056303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.056305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.056306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.056307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.056309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.056310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.056311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.056312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.056313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.056314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.056321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.056334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.056338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.056343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.056347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.056351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.056355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.056359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.056363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.056368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.056372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.056375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.056379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.056386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.056394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.056401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.056407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.056412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.056417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.056424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.056429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.056434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.056440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.056445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.056454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.056458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.056464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.056477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.056482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.056488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.056493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.056498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.056503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.056508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.056513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.056517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.056529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.056534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.056539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.056586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:24.056790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601936059287022:5275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:24.059914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:24.059984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601936059287022:5275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:24.060002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601936059287022:5275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:24.060006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601936059287022:5275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:24.060015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:24.060332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:24.060355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:24.060358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:24.060362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:24.060369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1997 [2:7559601935277057277:4343]
2025-10-10T14:36:24.060384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:24.060417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:24.060420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.060424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.060432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.060470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:24.060483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:24.060491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:24.060569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.060577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.060580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.060582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:24.060657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:24.060665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.060678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.060696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.060715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:24.060754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059286977:2438], now have 1 active actors on pipe
2025-10-10T14:36:24.060762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287057:5275], now have 1 active actors on pipe
2025-10-10T14:36:24.060769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601935277057271:4343]
2025-10-10T14:36:24.060772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601935277057271:4343]
2025-10-10T14:36:24.060774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601935277057271:4343]
2025-10-10T14:36:24.060773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1997
2025-10-10T14:36:24.060789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:24.060805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:24.060809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:24.060810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:24.060811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:24.060821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1997
2025-10-10T14:36:24.060829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:24.060837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:24.060880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601935277057271:4343]
2025-10-10T14:36:24.060893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:24.060914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:24.061023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.061038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.061068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:24.061083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.061088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.061090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:24.061102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.061115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:24.061143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.061350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.061362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.061384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.061628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1998 partition: 0 MaxSeqNo: 40 sessionId: src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0
2025-10-10T14:36:24.065457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7ebd2b8-a53c7c92-27af6ace-dfa29639_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:24.068177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0] Write session: try to update token
2025-10-10T14:36:24.068202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:24.082441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:24.082459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:24.082463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:24.082465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:24.082477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601935277057271:4343]
2025-10-10T14:36:24.082485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601935277057271:4343]
2025-10-10T14:36:24.082489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601935277057271:4343]
2025-10-10T14:36:24.082546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:24.082547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:24.082554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:24.082558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:24.082565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.082567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:24.082746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:24.091607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId: src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:24.094360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:24.142555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601936059287065:6092]
2025-10-10T14:36:24.142904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1997, pipe: [1:7559601936059287065:6092]
2025-10-10T14:36:24.200512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:24.200956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.200976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.201001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287065:6092], now have 1 active actors on pipe
2025-10-10T14:36:24.201298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:24.201739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:24.201793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:24.201797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601936059287065:6092]
2025-10-10T14:36:24.201890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1998 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0
2025-10-10T14:36:24.202096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1998 sessionId: src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0 is DEAD
2025-10-10T14:36:24.202275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:24.202303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0] Write session will restart in 0.005583s
2025-10-10T14:36:24.202331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0] Write session: Do CDS request
2025-10-10T14:36:24.202337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:24.208973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.209061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:24.209078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1999
2025-10-10T14:36:24.209317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.209369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:24.209383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:24.209387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:24.209837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1999 sessionId:  describe result for acl check
2025-10-10T14:36:24.209876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:24.209884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:24.209886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:24.209892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601936059287105:5271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:24.210468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601936059287105:5271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:24.211593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:24.213056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601936059287105:5271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:24.213301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:24.213551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:24.213564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:24.213576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:24.213632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:24.213683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601935277057362:4337]
2025-10-10T14:36:24.214267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:24.214588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:24.214641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:24.214960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:24.215044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.215051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.215052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.215053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.215054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.215055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.215056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.215060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.215061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.215063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.215064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.215065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.215065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.215072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.215085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.215088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.215092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.215096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.215100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.215103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.215107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.215111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.215116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.215120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.215124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.215127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.215135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.215143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.215150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.215155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.215160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.215165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.215169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.215174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.215182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.215188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.215198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.215205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.215210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.215220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.215225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.215231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.215238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.215244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.215248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.215263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.215269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.215274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.215278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.215283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.215288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.215292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.215334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:24.215919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601936059287105:5271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:24.215932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601936059287105:5271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:24.215949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601936059287105:5271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:24.215957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:24.217822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:24.218174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:24.218185Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:24.218187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:24.218192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:24.218197Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1998 [2:7559601935277057362:4337]
2025-10-10T14:36:24.218209Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:24.218228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:24.218236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.218240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.218242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.218259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:24.218267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:24.218274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:24.218329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.218336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.218338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.218340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:24.218422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:24.218429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.218441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.218456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.218479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:24.218515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287147:5271], now have 1 active actors on pipe
2025-10-10T14:36:24.218523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287066:2438], now have 1 active actors on pipe
2025-10-10T14:36:24.218530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601935277057356:4337]
2025-10-10T14:36:24.218532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601935277057356:4337]
2025-10-10T14:36:24.218534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601935277057356:4337]
2025-10-10T14:36:24.218538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1998
2025-10-10T14:36:24.218565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1998
2025-10-10T14:36:24.218549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:24.218570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:24.218585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:24.218587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:24.218588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:24.218590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:24.218590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:24.218612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601935277057356:4337]
2025-10-10T14:36:24.218614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:24.218621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:24.218634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.218638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.218688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:24.218700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.218704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.218706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:24.218717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.218731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:24.218754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.218973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.218994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.219022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.219132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1999 partition: 0 MaxSeqNo: 40 sessionId: src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0
2025-10-10T14:36:24.219540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3b1285-795f2cc-d7cc38-aaeebac8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:24.222328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0] Write session: try to update token
2025-10-10T14:36:24.222347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:24.238975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId: src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:24.239189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:24.239215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:24.239224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:24.239226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:24.239237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601935277057356:4337]
2025-10-10T14:36:24.239241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601935277057356:4337]
2025-10-10T14:36:24.239245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601935277057356:4337]
2025-10-10T14:36:24.239303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:24.239319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.239322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:24.239475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:24.241473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:24.241494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:24.241499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:24.241845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:24.301784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601936059287155:6092]
2025-10-10T14:36:24.302091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1998, pipe: [1:7559601936059287155:6092]
2025-10-10T14:36:24.362070Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:24.362571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.362583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.362633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287155:6092], now have 1 active actors on pipe
2025-10-10T14:36:24.362913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:24.362937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:24.362952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:24.363042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1999 reason: error at write: Disconnected sessionId: src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0
2025-10-10T14:36:24.363285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1999 sessionId: src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0 is DEAD
2025-10-10T14:36:24.363454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:24.363523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601936059287155:6092]
2025-10-10T14:36:24.363852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:24.363865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0] Write session will restart in 0.007212s
2025-10-10T14:36:24.363907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0] Write session: Do CDS request
2025-10-10T14:36:24.363917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:24.371932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.372375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:24.372401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2000
2025-10-10T14:36:24.372597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.372636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:24.372642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:24.372655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:24.373200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2000 sessionId:  describe result for acl check
2025-10-10T14:36:24.373240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:24.373247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:24.373249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:24.373256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601936059287201:5260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:24.373912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601936059287201:5260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:24.377021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601936059287201:5260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:24.377480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:24.381110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:24.381373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:24.381395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:24.381408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:24.381472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:24.381515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601935277057448:4341]
2025-10-10T14:36:24.382195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601936059287201:5260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:24.382134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:24.382214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601936059287201:5260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:24.382219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601936059287201:5260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:24.382229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:24.382995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:24.383047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:24.383399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:24.383457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.383458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.383459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.383460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.383462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.383463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.383464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.383465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.383466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.383467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.383468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.383470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.383471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.383476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.383488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.383492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.383496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.383500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.383503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.383507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.383510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.383513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.383517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.383520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.383524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.383527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.383536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.383545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.383552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.383557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.383561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.383565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.383569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.383574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.383578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.383584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.383587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.383592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.383597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.383602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.383606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.383610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.383615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.383619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.383623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.383628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.383632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.383637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.383640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.383645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.383652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.383657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.383692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:24.391155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1999
2025-10-10T14:36:24.391188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1999
2025-10-10T14:36:24.390327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:24.390679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:24.390705Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:24.390708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:24.390713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:24.390720Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1999 [2:7559601935277057448:4341]
2025-10-10T14:36:24.390741Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:24.390772Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:24.390776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.390781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.390783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.390804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:24.390812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:24.390823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:24.390888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.390890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.390892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.390895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:24.390972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:24.390975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.390988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.391001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.391022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:24.391043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601935277057442:4341]
2025-10-10T14:36:24.391045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601935277057442:4341]
2025-10-10T14:36:24.391047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601935277057442:4341]
2025-10-10T14:36:24.391057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:24.391071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:24.391080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:24.391083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:24.391085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:24.391089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:24.391095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:24.391110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287233:5260], now have 1 active actors on pipe
2025-10-10T14:36:24.391114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287156:2438], now have 1 active actors on pipe
2025-10-10T14:36:24.391153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601935277057442:4341]
2025-10-10T14:36:24.391161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:24.391174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:24.391429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.391444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.391477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:24.391490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.391495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.391497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:24.391509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.391521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:24.391539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.391683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.391692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.391706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.391804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2000 partition: 0 MaxSeqNo: 40 sessionId: src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0
2025-10-10T14:36:24.392253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48b1c5e8-9f8b266c-6da1d3e8-4834dac1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:24.395029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0] Write session: try to update token
2025-10-10T14:36:24.395049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:24.410838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId: src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:24.414000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.413736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:24.414026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.414077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:24.414155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:24.420283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:24.420306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:24.420310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:24.420312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:24.420321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601935277057442:4341]
2025-10-10T14:36:24.420326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601935277057442:4341]
2025-10-10T14:36:24.420333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601935277057442:4341]
2025-10-10T14:36:24.420383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:24.420394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.420397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:24.420400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:24.420409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:24.420414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:24.420536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:24.463577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601936059287246:6092]
2025-10-10T14:36:24.463883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1999, pipe: [1:7559601936059287246:6092]
2025-10-10T14:36:24.537592Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:24.545750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.545779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.545969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.546044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.546127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.546198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.546250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.546260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.546338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.546420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.546487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.546564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.546616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.546623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.546699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.546769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.546846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.546921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.546969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.546976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.547054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.547123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.547193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.547262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.547322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.547330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.547408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.547480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.547543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.547617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.547663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.547670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.547741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.547806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.547883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.547954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.548007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.548015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.548091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.548162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.548233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.548302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.548349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.548360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.548434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.548507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.548575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.548647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.548811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.548820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.548893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.548957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.549028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.549094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.549140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.549149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.549224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:24.549285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:24.549369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:24.549438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:24.549487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:24.549494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:24.549574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287246:6092], now have 1 active actors on pipe
2025-10-10T14:36:24.550125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:24.550144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0] Write session will restart in 0.008284s
2025-10-10T14:36:24.550173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0] Write session: Do CDS request
2025-10-10T14:36:24.550179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:24.549717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:24.549729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:24.549755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2000 reason: error at write: Disconnected sessionId: src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0
2025-10-10T14:36:24.549968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2000 sessionId: src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0 is DEAD
2025-10-10T14:36:24.550149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:24.550187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601936059287246:6092]
2025-10-10T14:36:24.550672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:24.559919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.560288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:24.560304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2001
2025-10-10T14:36:24.560441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.560506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:24.560517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:24.560521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:24.560979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2001 sessionId:  describe result for acl check
2025-10-10T14:36:24.561016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:24.561022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:24.561024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:24.561029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601936059287288:5246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:24.561611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601936059287288:5246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:24.564759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601936059287288:5246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:24.566774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:24.568915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:24.568949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601936059287288:5246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:24.568962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601936059287288:5246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:24.568966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601936059287288:5246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:24.568979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:24.569197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:24.569216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:24.569231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:24.569322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:24.569456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601935277057574:4312]
2025-10-10T14:36:24.570023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:24.571006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:24.571061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:24.571297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:24.571358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.571366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.571366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.571367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.571368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.571368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.571369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.571370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.571370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.571371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.571372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.571373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.571373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.571378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.571387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.571389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.571391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.571393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.571396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.571398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.571402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.571404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.571406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.571408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.571410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.571412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.571418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.571425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.571430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.571435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.571440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.571445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.571448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.571453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.571457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.571462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.571466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.571472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.571476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.571481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.571486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.571492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.571497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.571503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.571507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.571511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.571516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.571520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.571524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.571530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.571534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.571540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.571579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:24.574100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:24.574420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:24.574815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2000
2025-10-10T14:36:24.574437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:24.574817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2000
2025-10-10T14:36:24.574439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:24.574443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:24.574449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2000 [2:7559601935277057574:4312]
2025-10-10T14:36:24.574461Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:24.574477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:24.574480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.574484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.574487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.574505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:24.574515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:24.574523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:24.574577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.574579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.574581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.574583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:24.574654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:24.574657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.574668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.574681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.574699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:24.574721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287275:2438], now have 1 active actors on pipe
2025-10-10T14:36:24.574724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287354:5246], now have 1 active actors on pipe
2025-10-10T14:36:24.574732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601935277057568:4312]
2025-10-10T14:36:24.574734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601935277057568:4312]
2025-10-10T14:36:24.574736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601935277057568:4312]
2025-10-10T14:36:24.574750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:24.574765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:24.574775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:24.574779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:24.574779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:24.574781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:24.574782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:24.574804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601935277057568:4312]
2025-10-10T14:36:24.574806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:24.574809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:24.574872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.574878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.574907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:24.574914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.574918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.574920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:24.574932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.574943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:24.574955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.575149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.575160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.575189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.575753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2001 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0
2025-10-10T14:36:24.576194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed5a782-6465ec6e-9aeb0d62-aec3b00d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:24.579035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0] Write session: try to update token
2025-10-10T14:36:24.579058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:24.595335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:24.595361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:24.595373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601935277057568:4312]
2025-10-10T14:36:24.595428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:24.595428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:24.595615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:24.595783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:24.595952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:24.596101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:24.596305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:24.596358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:24.607042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId: src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:24.609625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:24.609648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:24.609653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:24.609656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:24.609669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601935277057568:4312]
2025-10-10T14:36:24.609673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601935277057568:4312]
2025-10-10T14:36:24.609677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601935277057568:4312]
2025-10-10T14:36:24.609734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:24.609741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.609744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:24.609760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:24.609888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:24.609897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:24.609902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:24.609906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:24.650750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601936059287369:6092]
2025-10-10T14:36:24.651098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2000, pipe: [1:7559601936059287369:6092]
2025-10-10T14:36:24.726971Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:24.727292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.727311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.727335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287369:6092], now have 1 active actors on pipe
2025-10-10T14:36:24.727636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:24.727655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601936059287369:6092]
2025-10-10T14:36:24.727703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:24.728159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:24.728171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0] Write session will restart in 0.008388s
2025-10-10T14:36:24.728197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0] Write session: Do CDS request
2025-10-10T14:36:24.728203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:24.728437Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:36:24.728562Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:36:24.728567Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:36:24.728577Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.007696s
2025-10-10T14:36:24.727750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:24.727824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2001 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0
2025-10-10T14:36:24.728015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2001 sessionId: src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0 is DEAD
2025-10-10T14:36:24.728172Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:36:24.728273Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 20 consumer shared/user session shared/user_1_20_9308480143958711937_v1 is DEAD
2025-10-10T14:36:24.728544Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601858749853693:6095] disconnected; active server actors: 1
2025-10-10T14:36:24.728548Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601858749853693:6095] client user disconnected session shared/user_1_20_9308480143958711937_v1
2025-10-10T14:36:24.736789Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:36:24.737003Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:36:24.737017Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 21
2025-10-10T14:36:24.737203Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 21 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:36:24.737284Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:36:24.737596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:24.737730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.737404Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 auth for : user
2025-10-10T14:36:24.737640Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 Handle describe topics response
2025-10-10T14:36:24.737666Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 auth is DEAD
2025-10-10T14:36:24.737693Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:36:24.737981Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:36:24.738029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:24.738037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2002
2025-10-10T14:36:24.738075Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601936059287426:5238] connected; active server actors: 1
2025-10-10T14:36:24.738093Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559601936059287426:5238] session shared/user_1_21_5332133425265739141_v1
2025-10-10T14:36:24.738104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:36:24.738116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:36:24.738122Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_21_5332133425265739141_v1" (Sender=[1:7559601936059287422:5238], Pipe=[1:7559601936059287426:5238], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:36:24.738131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:36:24.738146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:36:24.738155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_21_5332133425265739141_v1" (Sender=[1:7559601936059287422:5238], Pipe=[1:7559601936059287426:5238], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:36:24.738166Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_21_5332133425265739141_v1" sender [1:7559601936059287422:5238] lock partition 0 for ReadingSession "shared/user_1_21_5332133425265739141_v1" (Sender=[1:7559601936059287422:5238], Pipe=[1:7559601936059287426:5238], Partitions=[], ActiveFamilyCount=1) generation 1 step 21
2025-10-10T14:36:24.738174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:36:24.738179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000030s
2025-10-10T14:36:24.738430Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 21 Session: "shared/user_1_21_5332133425265739141_v1" ClientId: "user" PipeClient { RawX1: 7559601936059287426 RawX2: 4503603922343030 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:36:24.738460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:36:24.739726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:24.739951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:24.739966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:24.739979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:24.740041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:24.740097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601935277057661:4310]
2025-10-10T14:36:24.740768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:24.741086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:24.741155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:24.741567Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_21_5332133425265739141_v1
2025-10-10T14:36:24.741534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.741575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:24.741583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:24.741588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:24.741533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:24.741626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.741627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.741628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.741629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.741631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.741632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.741633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.741635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.741636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.741637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.741638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.741640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.741641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.741647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.741662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.741667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.741671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.741675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.741679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.741683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.741688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.741692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.741696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.741701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.741704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.741709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.741718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.741731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.741738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.741744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.741749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.741755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.741759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.741765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.741770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.741776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.741781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.741786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.741792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.741797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.741801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.741806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.741810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.741818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.741823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.741829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.741834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.741839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.741844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.741849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.741854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.741859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.742075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2002 sessionId:  describe result for acl check
2025-10-10T14:36:24.742116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:24.741902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:24.742120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:24.742121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:24.742127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601936059287436:5228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:24.742730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601936059287436:5228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:24.744404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:24.744839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:24.744855Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:24.744857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:24.744861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:24.744867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2001 [2:7559601935277057661:4310]
2025-10-10T14:36:24.744881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:24.744900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:24.744910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.744914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.744916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.744933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:24.744941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:24.744950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:24.745008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.745016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.745018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.745020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:24.745093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:24.745104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.745117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.745128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.745144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:24.745165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287376:2438], now have 1 active actors on pipe
2025-10-10T14:36:24.745174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287431:5230], now have 1 active actors on pipe
2025-10-10T14:36:24.745183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601935277057654:4310]
2025-10-10T14:36:24.745189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601935277057654:4310]
2025-10-10T14:36:24.745191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601935277057654:4310]
2025-10-10T14:36:24.745204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:24.745222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:24.745238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:24.745242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:24.745243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:24.745274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2001
2025-10-10T14:36:24.745244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:24.745247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:24.745274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601935277057654:4310]
2025-10-10T14:36:24.745284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:24.745285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:24.745326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601936059287436:5228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:24.745366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2001, pipe: [1:7559601936059287431:5230]
2025-10-10T14:36:24.745383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.745397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.745411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_21_5332133425265739141_v1 on pipe: [1:7559601936059287431:5230]
2025-10-10T14:36:24.745434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.745437Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_21_5332133425265739141_v1:1 with generation 2001
2025-10-10T14:36:24.745445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.745449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:24.745471Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_21_5332133425265739141_v1
2025-10-10T14:36:24.745474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.745514Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:36:24.750420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601936059287436:5228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:24.750317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:36:24.750436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601936059287436:5228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:24.750441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601936059287436:5228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:24.750357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:36:24.750450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:24.750370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.750373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.750376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.750390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:36:24.750406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:36:24.750572Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760106984744 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:36:24.750594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:36:24.750652Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 sending to client partition status
2025-10-10T14:36:24.750794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287471:5228], now have 1 active actors on pipe
2025-10-10T14:36:24.750856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2001
2025-10-10T14:36:24.750903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.750915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.750954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:24.750969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.750974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.750976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:24.750989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.751004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:24.751028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.751265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.751281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.751305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.751392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2002 partition: 0 MaxSeqNo: 40 sessionId: src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0
2025-10-10T14:36:24.753621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5ee1f3d-83be3a54-e265e927-5b42ce2d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:24.756372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0] Write session: try to update token
2025-10-10T14:36:24.756395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:24.765363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:24.765384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:24.765388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:24.765390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:24.765400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601935277057654:4310]
2025-10-10T14:36:24.765409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601935277057654:4310]
2025-10-10T14:36:24.765412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601935277057654:4310]
2025-10-10T14:36:24.765464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:24.765479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.765481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:24.765620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:24.766244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:24.766260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:24.766267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:24.774938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId: src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:24.777710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:24.883798Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:24.884167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.884187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.885655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:24.885714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:24.885722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:24.885788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2002 reason: error at write: Disconnected sessionId: src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0
2025-10-10T14:36:24.885977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2002 sessionId: src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0 is DEAD
2025-10-10T14:36:24.885602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_21_5332133425265739141_v1
2025-10-10T14:36:24.885627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:24.885994Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_21_5332133425265739141_v1
2025-10-10T14:36:24.886125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601936059287431:5230]
2025-10-10T14:36:24.886344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:24.886353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0] Write session will restart in 0.007417s
2025-10-10T14:36:24.886395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0] Write session: Do CDS request
2025-10-10T14:36:24.886402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:24.895230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.895367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:24.895384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2003
2025-10-10T14:36:24.895517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:24.895554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:24.895567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:24.895571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:24.896066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2003 sessionId:  describe result for acl check
2025-10-10T14:36:24.896106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:24.896114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:24.896116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:24.896123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601936059287528:5226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:24.896748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601936059287528:5226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:24.897783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:24.899276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:24.899507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:24.899520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:24.899532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:24.899586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:24.899645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601935277057750:4304]
2025-10-10T14:36:24.900332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:24.900802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:24.900851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:24.901196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:24.901253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.901261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.901263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.901264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.901265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.901267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.901268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.901270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.901271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.901273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.901275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.901276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.901277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.901284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.901298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.901303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.901308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.901312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.901317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.901322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.901343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.901348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.901352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.901357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.901361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.901365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.901373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.901382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:24.901394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.901400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:24.901409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.901415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:24.901420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.901425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:24.901431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.901437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:24.901442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.901448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:24.901462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.901469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:24.901473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.901479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:24.901484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.901490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:24.901495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.901503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:24.901508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.901519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.901526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.901537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.901544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.901554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.901599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:24.901807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601936059287528:5226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:24.904804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601936059287528:5226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:24.904822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601936059287528:5226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:24.904827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601936059287528:5226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:24.904838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:24.904921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:24.905272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:24.905285Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:24.905289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:24.905293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:24.905300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2002 [2:7559601935277057750:4304]
2025-10-10T14:36:24.905315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:24.905349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:24.905358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.905362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.905365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.905394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:24.905402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:24.905410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:24.905472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.905481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.905483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.905486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:24.905571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:24.905581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.905594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:24.905607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:24.905626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:24.905655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287563:5226], now have 1 active actors on pipe
2025-10-10T14:36:24.905666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287479:2438], now have 1 active actors on pipe
2025-10-10T14:36:24.905675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601935277057745:4304]
2025-10-10T14:36:24.905677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601935277057745:4304]
2025-10-10T14:36:24.905680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601935277057745:4304]
2025-10-10T14:36:24.905694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:24.905710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:24.905740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:24.905748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:24.905734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2002
2025-10-10T14:36:24.905771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:24.905780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601935277057745:4304]
2025-10-10T14:36:24.905783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:24.905785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:24.905805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2002
2025-10-10T14:36:24.905788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:24.905797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:24.905888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.905897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.905932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:24.905940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:24.905945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:24.905948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:24.905960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:24.905971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:24.905988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.906172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.906180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.906195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:24.906512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2003 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0
2025-10-10T14:36:24.906929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64e1d2cb-38e3fe56-2d24dcd8-53ef01f3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:24.909730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0] Write session: try to update token
2025-10-10T14:36:24.909752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:24.925143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId: src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:24.928279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:24.930052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:24.930082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:24.930119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:24.930123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:24.930126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:24.930130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:24.930140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601935277057745:4304]
2025-10-10T14:36:24.930144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601935277057745:4304]
2025-10-10T14:36:24.930148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601935277057745:4304]
2025-10-10T14:36:24.930201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:24.930208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:24.930212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:24.930223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:24.930231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:24.930234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:24.930383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:24.986308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601936059287584:5230]
2025-10-10T14:36:24.987573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2002, pipe: [1:7559601936059287584:5230]
2025-10-10T14:36:25.051941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:25.052258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:25.052326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601936059287584:5230], now have 1 active actors on pipe
2025-10-10T14:36:25.052467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:25.052577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:25.052586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:25.052675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2003 reason: error at write: Disconnected sessionId: src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0
2025-10-10T14:36:25.052863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2003 sessionId: src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0 is DEAD
2025-10-10T14:36:25.053059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:25.053068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0] Write session will restart in 0.009781s
2025-10-10T14:36:25.053051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601936059287584:5230]
2025-10-10T14:36:25.053095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0] Write session: Do CDS request
2025-10-10T14:36:25.053077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:25.053101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:25.064029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.064102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:25.064118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2004
2025-10-10T14:36:25.064306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.064347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:25.064359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:25.064364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:25.064904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2004 sessionId:  describe result for acl check
2025-10-10T14:36:25.064944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:25.064951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:25.064953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:25.064960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601940354254933:5219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:25.065625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601940354254933:5219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:25.065989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:25.068112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601940354254933:5219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:25.068538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:25.068784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:25.068795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:25.068808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:25.068861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:25.068902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601939572025150:4297]
2025-10-10T14:36:25.069609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:25.070556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601940354254933:5219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:25.070570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601940354254933:5219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:25.070574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601940354254933:5219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:25.070584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:25.070134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:25.070176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:25.070512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:25.070561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.070562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.070563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.070565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.070568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.070569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.070570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.070571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.070572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.070573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.070575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.070576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.070577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.070583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.070596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.070600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.070605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.070609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.070613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.070616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.070621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.070625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.070629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.070633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.070637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.070640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.070647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.070655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.070661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.070667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.070671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.070676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.070681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.070686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.070691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.070699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.070703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.070709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.070714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.070719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.070733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.070739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.070744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.070750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.070754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.070759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.070763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.070769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.070773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.070779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.070783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.070789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.070829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:25.074088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2003
2025-10-10T14:36:25.073223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:25.074133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2003
2025-10-10T14:36:25.073537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:25.073541Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:25.073544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:25.073549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:25.073556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2003 [2:7559601939572025150:4297]
2025-10-10T14:36:25.073569Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:25.073587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:25.073591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.073594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.073598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.073614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:25.073623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:25.073631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:25.073686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.073688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.073690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.073692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:25.073808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:25.073812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.073824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.073837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.073868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:25.073891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354254881:2438], now have 1 active actors on pipe
2025-10-10T14:36:25.073894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354254964:5219], now have 1 active actors on pipe
2025-10-10T14:36:25.073902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601939572025145:4297]
2025-10-10T14:36:25.073904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601939572025145:4297]
2025-10-10T14:36:25.073907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601939572025145:4297]
2025-10-10T14:36:25.073922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:25.073936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:25.073936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:25.073939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:25.073941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:25.073953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:25.073956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:25.073979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601939572025145:4297]
2025-10-10T14:36:25.073987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:25.073991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:25.074467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.074479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.074517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51a42796-26a85c55-26509c0e-204ca3ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:25.074525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.074529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.074532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:25.074542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.074553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:25.074570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.074748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.074755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.074770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.074981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2004 partition: 0 MaxSeqNo: 40 sessionId: src_id|51a42796-26a85c55-26509c0e-204ca3ab_0
2025-10-10T14:36:25.075338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9a0618-9aa64f99-51c2f852-8e4f72a1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51a42796-26a85c55-26509c0e-204ca3ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:25.078101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51a42796-26a85c55-26509c0e-204ca3ab_0] Write session: try to update token
2025-10-10T14:36:25.078123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51a42796-26a85c55-26509c0e-204ca3ab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:25.095895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:25.095914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:25.095926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601939572025145:4297]
2025-10-10T14:36:25.095977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:25.095975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:25.096151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:25.096288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:25.096415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:25.096548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:25.096747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:25.096796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:25.100479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId: src_id|51a42796-26a85c55-26509c0e-204ca3ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:25.103325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:25.103687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.103723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.103765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:25.103941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:25.109869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:25.109893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:25.109897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:25.109903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:25.109915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601939572025145:4297]
2025-10-10T14:36:25.109919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601939572025145:4297]
2025-10-10T14:36:25.109928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601939572025145:4297]
2025-10-10T14:36:25.109981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:25.109990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.109993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:25.110154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:25.113534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:25.113550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:25.113555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:25.153258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601940354254975:5230]
2025-10-10T14:36:25.153723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2003, pipe: [1:7559601940354254975:5230]
2025-10-10T14:36:25.228420Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:25.236450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.236484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.236681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.236750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.236816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.236883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.236928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.236933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.237014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.237078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.237135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.237195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.237241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.237244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.237316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.237397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.237461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.237521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.237574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.237577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.237648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.237721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.237790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.237858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.237904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.237911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.237982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.238047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.238113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.238180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.238231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.238238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.238303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.238365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.238431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.238498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.238551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.238559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.238629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.238695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.238761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.238825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.238872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.238880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.238951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.239018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.239085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.239152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.239197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.239206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.239274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.239333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.239404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.239470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.239519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.239527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.239594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:25.239659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:25.239728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:25.239795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:25.239842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:25.239849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:25.239921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354254975:5230], now have 1 active actors on pipe
2025-10-10T14:36:25.240188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601940354254975:5230]
2025-10-10T14:36:25.240196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:25.240201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:25.240243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:25.240245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2004 reason: error at write: Disconnected sessionId: src_id|51a42796-26a85c55-26509c0e-204ca3ab_0
2025-10-10T14:36:25.240454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2004 sessionId: src_id|51a42796-26a85c55-26509c0e-204ca3ab_0 is DEAD
2025-10-10T14:36:25.240657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a42796-26a85c55-26509c0e-204ca3ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:25.240667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a42796-26a85c55-26509c0e-204ca3ab_0] Write session will restart in 0.006485s
2025-10-10T14:36:25.240694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a42796-26a85c55-26509c0e-204ca3ab_0] Write session: Do CDS request
2025-10-10T14:36:25.240721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a42796-26a85c55-26509c0e-204ca3ab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:25.241162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:25.248978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51a42796-26a85c55-26509c0e-204ca3ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.249113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:25.249129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2005
2025-10-10T14:36:25.249650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.249697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:25.249715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:25.249724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:25.250231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2005 sessionId:  describe result for acl check
2025-10-10T14:36:25.250271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:25.250274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:25.250276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:25.250284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601940354255025:5215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:25.251283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601940354255025:5215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:25.254067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601940354255025:5215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:25.254560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:25.256395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:25.256734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:25.256747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:25.256761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:25.256825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:25.256880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601939572025240:4284]
2025-10-10T14:36:25.256956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601940354255025:5215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:25.256971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601940354255025:5215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:25.256975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601940354255025:5215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:25.256995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:25.257559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:25.257933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:25.257985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:25.258330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:25.258393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.258395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.258396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.258398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.258399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.258401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.258402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.258405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.258407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.258408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.258409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.258411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.258412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.258419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.258434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.258439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.258443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.258448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.258452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.258456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.258461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.258465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.258471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.258476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.258480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.258484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.258491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.258500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.258508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.258512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.258517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.258522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.258526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.258532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.258537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.258543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.258548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.258553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.258559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.258565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.258570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.258576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.258581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.258590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.258598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.258604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.258614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.258620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.258625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.258631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.258641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.258647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.258691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:25.261381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:25.261720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:25.261736Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:25.261740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:25.261744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:25.261752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2004 [2:7559601939572025240:4284]
2025-10-10T14:36:25.261769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:25.261793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:25.261801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.261805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.261807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.261826Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:25.261839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:25.261848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:25.261919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.261926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.261928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.261932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:25.262005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:25.262014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.262027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.262046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.262068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:25.262095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354254978:2438], now have 1 active actors on pipe
2025-10-10T14:36:25.262103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255061:5215], now have 1 active actors on pipe
2025-10-10T14:36:25.262112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601939572025235:4284]
2025-10-10T14:36:25.262119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601939572025235:4284]
2025-10-10T14:36:25.262121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601939572025235:4284]
2025-10-10T14:36:25.262134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:25.262150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:25.262153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:25.262162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:25.262165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:25.262172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:25.262177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:25.262206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601939572025235:4284]
2025-10-10T14:36:25.262214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:25.262178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2004
2025-10-10T14:36:25.262215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2004
2025-10-10T14:36:25.262224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:25.262252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.262257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.262291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:25.262304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.262314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.262316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:25.262329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.262339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:25.262359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.262539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.262547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.262563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.262657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2005 partition: 0 MaxSeqNo: 40 sessionId: src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0
2025-10-10T14:36:25.263085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a42796-26a85c55-26509c0e-204ca3ab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:25.266140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0] Write session: try to update token
2025-10-10T14:36:25.266161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:25.283215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:25.283245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:25.283249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:25.283251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:25.283265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601939572025235:4284]
2025-10-10T14:36:25.283270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601939572025235:4284]
2025-10-10T14:36:25.283276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601939572025235:4284]
2025-10-10T14:36:25.283330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:25.283338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.283341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:25.283497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:25.284827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:25.284834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:25.284837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:25.295325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId: src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:25.298121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:25.341416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601940354255073:5230]
2025-10-10T14:36:25.345710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2004, pipe: [1:7559601940354255073:5230]
2025-10-10T14:36:25.408963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601940354255073:5230]
2025-10-10T14:36:25.409006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:25.409039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:25.409047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:25.409105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2005 reason: error at write: Disconnected sessionId: src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0
2025-10-10T14:36:25.409313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2005 sessionId: src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0 is DEAD
2025-10-10T14:36:25.407838Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:25.408215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.408227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.408253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255073:5230], now have 1 active actors on pipe
2025-10-10T14:36:25.409097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:25.413440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:25.413453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0] Write session will restart in 0.007590s
2025-10-10T14:36:25.413482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0] Write session: Do CDS request
2025-10-10T14:36:25.413492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:25.422258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.425769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:25.425790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2006
2025-10-10T14:36:25.429495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.429583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:25.429597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:25.429603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:25.430243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2006 sessionId:  describe result for acl check
2025-10-10T14:36:25.430282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:25.430284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:25.430287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:25.430294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601940354255083:8835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:25.430967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601940354255083:8835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:25.433483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601940354255083:8835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:25.437855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601940354255083:8835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:25.437869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601940354255083:8835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:25.437873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601940354255083:8835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:25.437883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:25.445476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:25.447261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:25.447463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:25.447482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:25.447494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:25.447541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:25.447597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601939572025332:4276]
2025-10-10T14:36:25.448284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:25.448625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:25.448711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:25.449043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:25.449137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.449143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.449145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.449146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.449147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.449148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.449150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.449151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.449152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.449154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.449155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.449156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.449158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.449165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.449179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.449184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.449189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.449193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.449197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.449200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.449204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.449208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.449213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.449216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.449219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.449223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.449231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.449239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.449246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.449251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.449255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.449260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.449265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.449272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.449276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.449280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.449284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.449289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.449296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.449300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.449303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.449307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.449312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.449323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.449328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.449348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.449357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.449362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.449366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.449371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.449380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.449385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.449423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:25.453032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:25.453373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:25.453387Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:25.453391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:25.453395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:25.453402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2005 [2:7559601939572025332:4276]
2025-10-10T14:36:25.453416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:25.453437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:25.453440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.453444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.453447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.453468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:25.453481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:25.453490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:25.453555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.453566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.453568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.453572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:25.453645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:25.453654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.453667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.453681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.453706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:25.453732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601939572025327:4276]
2025-10-10T14:36:25.453740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601939572025327:4276]
2025-10-10T14:36:25.453742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601939572025327:4276]
2025-10-10T14:36:25.453752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:25.453773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:25.453787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:25.453796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:25.453798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:25.453800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:25.453800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:25.453813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255074:2438], now have 1 active actors on pipe
2025-10-10T14:36:25.453818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255120:8835], now have 1 active actors on pipe
2025-10-10T14:36:25.453850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601939572025327:4276]
2025-10-10T14:36:25.453863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:25.453869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:25.453889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2005
2025-10-10T14:36:25.453899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2005
2025-10-10T14:36:25.454050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.454062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.454095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1546de84-bb610120-10e01a04-6784c16e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:25.454108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.454113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.454115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:25.454127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.454138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:25.454158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.454361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.454370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.454387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.454512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2006 partition: 0 MaxSeqNo: 40 sessionId: src_id|1546de84-bb610120-10e01a04-6784c16e_0
2025-10-10T14:36:25.454933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96cdb42d-cac80fcc-cdd7c812-3cdc8f6e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1546de84-bb610120-10e01a04-6784c16e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:25.457787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1546de84-bb610120-10e01a04-6784c16e_0] Write session: try to update token
2025-10-10T14:36:25.457810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1546de84-bb610120-10e01a04-6784c16e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:25.473664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:25.473688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:25.473692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:25.473695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:25.473706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601939572025327:4276]
2025-10-10T14:36:25.473712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601939572025327:4276]
2025-10-10T14:36:25.473717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601939572025327:4276]
2025-10-10T14:36:25.473769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:25.473778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.473781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:25.473833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:25.473853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:25.473861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:25.473927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:25.475749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId: src_id|1546de84-bb610120-10e01a04-6784c16e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:25.478559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:25.509086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601940354255172:5230]
2025-10-10T14:36:25.509625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2005, pipe: [1:7559601940354255172:5230]
2025-10-10T14:36:25.589894Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:25.590321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.590338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.590384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255172:5230], now have 1 active actors on pipe
2025-10-10T14:36:25.591566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:25.591540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:25.591606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601940354255172:5230]
2025-10-10T14:36:25.591627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:25.591629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:25.591696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2006 reason: error at write: Disconnected sessionId: src_id|1546de84-bb610120-10e01a04-6784c16e_0
2025-10-10T14:36:25.591913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2006 sessionId: src_id|1546de84-bb610120-10e01a04-6784c16e_0 is DEAD
2025-10-10T14:36:25.593416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546de84-bb610120-10e01a04-6784c16e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:25.593427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546de84-bb610120-10e01a04-6784c16e_0] Write session will restart in 0.008201s
2025-10-10T14:36:25.593452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546de84-bb610120-10e01a04-6784c16e_0] Write session: Do CDS request
2025-10-10T14:36:25.593461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546de84-bb610120-10e01a04-6784c16e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:25.602960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1546de84-bb610120-10e01a04-6784c16e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.603103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:25.603119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2007
2025-10-10T14:36:25.603230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.603265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:25.603274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:25.603280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:25.603441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:25.603703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2007 sessionId:  describe result for acl check
2025-10-10T14:36:25.603734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:25.603741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:25.603743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:25.603749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601940354255243:8822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:25.604335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601940354255243:8822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:25.605570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:25.605796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:25.605803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:25.605816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:25.605878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:25.605917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601939572025455:4243]
2025-10-10T14:36:25.606526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:25.606901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:25.606959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:25.607231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:25.607280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.607285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.607286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.607287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.607287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.607288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.607289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.607289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.607290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.607292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.607293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.607293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.607294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.607299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.607306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.607309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.607311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.607313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.607315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.607317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.607319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.607321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.607324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.607326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.607328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.607330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.607335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.607340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.607346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.607350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.607352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.607355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.607358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.607361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.607363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.607366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.607369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.607372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.607376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.607379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.607382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.607387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.607389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.607392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.607395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.607398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.607402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.607405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.607409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.607414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.607419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.607424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.607461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:25.607096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601940354255243:8822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:25.612786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601940354255243:8822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:25.612801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601940354255243:8822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:25.612805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601940354255243:8822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:25.612814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:25.613179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:25.613521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:25.613537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:25.613540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:25.613545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:25.613551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2006 [2:7559601939572025455:4243]
2025-10-10T14:36:25.613563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:25.613584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:25.613593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.613597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.613600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.613621Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:25.613636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:25.613643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:25.613705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.613713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.613715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.613718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:25.613779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:25.613788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.613801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.613815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.613833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:25.613857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255189:2438], now have 1 active actors on pipe
2025-10-10T14:36:25.613866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255284:8822], now have 1 active actors on pipe
2025-10-10T14:36:25.613876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601939572025449:4243]
2025-10-10T14:36:25.613879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601939572025449:4243]
2025-10-10T14:36:25.613882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601939572025449:4243]
2025-10-10T14:36:25.613895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:25.613909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:25.613860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2006
2025-10-10T14:36:25.613885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2006
2025-10-10T14:36:25.613930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:25.613938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:25.613950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:25.613961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:25.613963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:25.613975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601939572025449:4243]
2025-10-10T14:36:25.613983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:25.613998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:25.614023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.614032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.614068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:25.614082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.614089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.614092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:25.614103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.614119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:25.614135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.614751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2007 partition: 0 MaxSeqNo: 40 sessionId: src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0
2025-10-10T14:36:25.615153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1546de84-bb610120-10e01a04-6784c16e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:25.614624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.614635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.614657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.617975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0] Write session: try to update token
2025-10-10T14:36:25.617994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:25.636203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId: src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:25.638601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:25.638627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:25.638631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:25.638633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:25.638643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601939572025449:4243]
2025-10-10T14:36:25.638648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601939572025449:4243]
2025-10-10T14:36:25.638652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601939572025449:4243]
2025-10-10T14:36:25.638704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:25.638704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:25.638711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:25.638716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:25.638717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.638720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:25.638857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:25.643943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:25.691857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601940354255294:5230]
2025-10-10T14:36:25.692290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2006, pipe: [1:7559601940354255294:5230]
2025-10-10T14:36:25.756194Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:25.756592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.756608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.756658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255294:5230], now have 1 active actors on pipe
2025-10-10T14:36:25.756931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:25.756930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:25.756943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:25.756946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:25.757004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601940354255294:5230]
2025-10-10T14:36:25.757013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2007 reason: error at write: Disconnected sessionId: src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0
2025-10-10T14:36:25.757247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2007 sessionId: src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0 is DEAD
2025-10-10T14:36:25.757422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:25.757434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0] Write session will restart in 0.007719s
2025-10-10T14:36:25.757468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0] Write session: Do CDS request
2025-10-10T14:36:25.757473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:25.766919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.767037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:25.767058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2008
2025-10-10T14:36:25.767239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.767270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:25.767274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:25.767277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:25.767608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2008 sessionId:  describe result for acl check
2025-10-10T14:36:25.767639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:25.767640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:25.767641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:25.767646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601940354255358:8814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:25.768100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601940354255358:8814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:25.770389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601940354255358:8814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:25.770925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:25.771547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:25.771748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:25.771761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:25.771775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:25.771832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:25.771876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601939572025556:4236]
2025-10-10T14:36:25.772512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:25.773022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:25.773070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:25.773388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601940354255358:8814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:25.773405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601940354255358:8814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:25.773409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601940354255358:8814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:25.773418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:25.773412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:25.773482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.773483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.773484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.773485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.773487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.773488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.773489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.773491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.773492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.773493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.773494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.773496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.773497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.773503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.773518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.773522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.773526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.773530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.773535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.773538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.773542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.773546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.773551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.773555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.773560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.773564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.773571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.773580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.773587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.773592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.773599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.773604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.773609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.773614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.773619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.773625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.773629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.773644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.773650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.773655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.773660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.773665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.773670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.773675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.773680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.773685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.773690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.773697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.773701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.773706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.773711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.773716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.773759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:25.776832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:25.777304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:25.777319Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:25.777322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:25.777325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:25.777349Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2007 [2:7559601939572025556:4236]
2025-10-10T14:36:25.777367Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:25.777391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:25.777399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.777403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.777406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.777429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:25.777444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:25.777452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:25.777514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.777523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.777526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.777528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:25.777603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:25.777613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.777626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.777642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.777667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:25.777695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255391:8814], now have 1 active actors on pipe
2025-10-10T14:36:25.777704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255301:2438], now have 1 active actors on pipe
2025-10-10T14:36:25.777712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601939572025551:4236]
2025-10-10T14:36:25.777720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601939572025551:4236]
2025-10-10T14:36:25.777721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601939572025551:4236]
2025-10-10T14:36:25.777737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:25.777755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:25.777759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:25.777764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:25.777766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:25.777774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:25.777779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:25.777775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2007
2025-10-10T14:36:25.777810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601939572025551:4236]
2025-10-10T14:36:25.777824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:25.777809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2007
2025-10-10T14:36:25.777826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:25.777838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.777847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.777901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|276d0ed5-5cbda924-fe092166-bf9159de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:25.777913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.777918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.777921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:25.777933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.777948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:25.777977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.778144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.778160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.778185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.778339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2008 partition: 0 MaxSeqNo: 40 sessionId: src_id|276d0ed5-5cbda924-fe092166-bf9159de_0
2025-10-10T14:36:25.778733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd4f7b-e63a15a5-cacf5c1c-3e0ac815_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|276d0ed5-5cbda924-fe092166-bf9159de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:25.781572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|276d0ed5-5cbda924-fe092166-bf9159de_0] Write session: try to update token
2025-10-10T14:36:25.781590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|276d0ed5-5cbda924-fe092166-bf9159de_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:25.797884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId: src_id|276d0ed5-5cbda924-fe092166-bf9159de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:25.799056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:25.799082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:25.799085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:25.799087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:25.799098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601939572025551:4236]
2025-10-10T14:36:25.799104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601939572025551:4236]
2025-10-10T14:36:25.799111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601939572025551:4236]
2025-10-10T14:36:25.799168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:25.799184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.799187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:25.799339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:25.800526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:25.800669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:25.800696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:25.800701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:25.857207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601940354255402:5230]
2025-10-10T14:36:25.857544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2007, pipe: [1:7559601940354255402:5230]
2025-10-10T14:36:25.918795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:25.919148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.919171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.919230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255402:5230], now have 1 active actors on pipe
2025-10-10T14:36:25.919699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:25.919774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:25.919788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:25.919864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2008 reason: error at write: Disconnected sessionId: src_id|276d0ed5-5cbda924-fe092166-bf9159de_0
2025-10-10T14:36:25.920111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2008 sessionId: src_id|276d0ed5-5cbda924-fe092166-bf9159de_0 is DEAD
2025-10-10T14:36:25.920151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:25.920191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601940354255402:5230]
2025-10-10T14:36:25.921569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276d0ed5-5cbda924-fe092166-bf9159de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:25.921582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276d0ed5-5cbda924-fe092166-bf9159de_0] Write session will restart in 0.008887s
2025-10-10T14:36:25.921607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276d0ed5-5cbda924-fe092166-bf9159de_0] Write session: Do CDS request
2025-10-10T14:36:25.921618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276d0ed5-5cbda924-fe092166-bf9159de_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:25.932489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|276d0ed5-5cbda924-fe092166-bf9159de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.932584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:25.932600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2009
2025-10-10T14:36:25.932767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:25.932807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:25.932813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:25.932826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:25.933355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2009 sessionId:  describe result for acl check
2025-10-10T14:36:25.933393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:25.933395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:25.933398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:25.933404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601940354255459:8810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:25.933983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601940354255459:8810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:25.934470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:25.936220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601940354255459:8810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:25.936615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:25.936938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:25.936955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:25.936972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:25.937051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:25.937094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601939572025664:4218]
2025-10-10T14:36:25.937655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:25.937965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:25.938016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:25.938337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:25.938407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.938416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.938417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.938418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.938419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.938421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.938422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.938423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.938424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.938425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.938427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.938427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.938429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.938435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.938446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.938450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.938454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.938457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.938462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.938466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.938469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.938473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.938477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.938481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.938487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.938490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.938497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.938505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:25.938512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.938518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:25.938522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.938528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:25.938532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.938537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:25.938541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.938546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:25.938550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.938553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:25.938557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.938561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:25.938565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.938569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:25.938574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.938579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:25.938582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.938587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:25.938591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.938596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.938599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.938604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.938608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.938614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.938654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:25.939311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601940354255459:8810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:25.939324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601940354255459:8810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:25.939327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601940354255459:8810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:25.939336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:25.942248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:25.942765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:25.942780Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:25.942782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:25.942786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:25.942792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2008 [2:7559601939572025664:4218]
2025-10-10T14:36:25.942804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:25.942822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:25.942825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.942828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.942831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.942846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:25.942875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:25.942884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:25.943018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.943030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.943032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.943034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:25.943107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:25.943116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.943128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:25.943145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:25.943210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2008
2025-10-10T14:36:25.943258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2008
2025-10-10T14:36:25.943167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:25.943198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255403:2438], now have 1 active actors on pipe
2025-10-10T14:36:25.943201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601940354255505:8810], now have 1 active actors on pipe
2025-10-10T14:36:25.943209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601939572025659:4218]
2025-10-10T14:36:25.943211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601939572025659:4218]
2025-10-10T14:36:25.943213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601939572025659:4218]
2025-10-10T14:36:25.943225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:25.943241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:25.943260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:25.943263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:25.943288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601939572025659:4218]
2025-10-10T14:36:25.943291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:25.943336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:25.943339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:25.943341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:25.943349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:25.943491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.943503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.943534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:25.943552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:25.943571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:25.943573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:25.943587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:25.943604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:25.943618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.943850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:25.943864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:25.943889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:25.944007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2009 partition: 0 MaxSeqNo: 40 sessionId: src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0
2025-10-10T14:36:25.944398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|276d0ed5-5cbda924-fe092166-bf9159de_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:25.947165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0] Write session: try to update token
2025-10-10T14:36:25.947184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:25.963817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId: src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:25.963810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:25.963835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:25.963839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:25.963841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:25.963852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601939572025659:4218]
2025-10-10T14:36:25.963860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601939572025659:4218]
2025-10-10T14:36:25.963863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601939572025659:4218]
2025-10-10T14:36:25.963919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:25.963928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:25.963930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:25.964078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:25.964110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:25.964128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:25.964133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:25.966656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:26.021440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601944649222810:5230]
2025-10-10T14:36:26.022013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2008, pipe: [1:7559601944649222810:5230]
2025-10-10T14:36:26.086234Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:26.086542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.086562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.086611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649222810:5230], now have 1 active actors on pipe
2025-10-10T14:36:26.086954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:26.086978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:26.086982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:26.087014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601944649222810:5230]
2025-10-10T14:36:26.087061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2009 reason: error at write: Disconnected sessionId: src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0
2025-10-10T14:36:26.086877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:26.087280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2009 sessionId: src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0 is DEAD
2025-10-10T14:36:26.087458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:26.087478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0] Write session will restart in 0.009780s
2025-10-10T14:36:26.087502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0] Write session: Do CDS request
2025-10-10T14:36:26.087509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:26.096723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:26.098615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:26.098829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:26.098843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:26.098855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:26.098913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:26.098958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601943866993058:4214]
2025-10-10T14:36:26.099593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:26.099954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:26.100023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:26.100385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:26.100451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.100457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.100459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.100460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.100461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.100463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.100464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.100465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.100466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.100468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.100469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.100471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.100472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.100479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.100492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.100499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.100516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.100521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.100525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.100528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.100532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.100536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.100540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.100544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.100548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.100551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.100560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.100570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.100578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.100583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.100587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.100593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.100597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.100602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.100607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.100612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.100617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.100622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.100627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.100632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.100636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.100641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.100645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.100651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.100663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.100668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.100674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.100693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.100697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.100702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.100706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.100711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.100751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:26.101935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.102047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:26.102075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2010
2025-10-10T14:36:26.102237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.102304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:26.102311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:26.102316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:26.102843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2010 sessionId:  describe result for acl check
2025-10-10T14:36:26.102884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:26.102886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:26.102888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:26.102895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601944649222874:8800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:26.103540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:26.103529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601944649222874:8800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:26.103877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:26.103894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:26.103896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:26.103900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:26.103907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2009 [2:7559601943866993058:4214]
2025-10-10T14:36:26.103920Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:26.103939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:26.103942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.103946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.103948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.103967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:26.103975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:26.103983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:26.104071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.104078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.104080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.104084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:26.104165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:26.104174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.104185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.104201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.104221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:26.104244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649222811:2438], now have 1 active actors on pipe
2025-10-10T14:36:26.104257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601943866993053:4214]
2025-10-10T14:36:26.104264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601943866993053:4214]
2025-10-10T14:36:26.104266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601943866993053:4214]
2025-10-10T14:36:26.104281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:26.104274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2009
2025-10-10T14:36:26.104296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:26.104298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:26.104308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:26.104310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:26.104314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:26.104318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:26.104353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601943866993053:4214]
2025-10-10T14:36:26.104367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:26.104377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:26.106070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601944649222874:8800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:26.112396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601944649222874:8800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:26.112416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601944649222874:8800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:26.112420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601944649222874:8800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:26.112431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:26.112766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649222907:8800], now have 1 active actors on pipe
2025-10-10T14:36:26.112816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2009
2025-10-10T14:36:26.112919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.112939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.112988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:26.113009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.113021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.113024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:26.113041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.113065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:26.113090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.113272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.113285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.113301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.113413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2010 partition: 0 MaxSeqNo: 40 sessionId: src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0
2025-10-10T14:36:26.113886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89c3d60a-e7a0ebb8-6aaef3a0-3270469c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:26.116809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0] Write session: try to update token
2025-10-10T14:36:26.116827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:26.124436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:26.124460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:26.124472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601943866993053:4214]
2025-10-10T14:36:26.124534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:26.124539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:26.124741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:26.124903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:26.125049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:26.125196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:26.125427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:26.125477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:26.138903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:26.138925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:26.138929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:26.138931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:26.138943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601943866993053:4214]
2025-10-10T14:36:26.138947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601943866993053:4214]
2025-10-10T14:36:26.138951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601943866993053:4214]
2025-10-10T14:36:26.139005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:26.139011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:26.139013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.139019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:26.139019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:26.139023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:26.139149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:26.139953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId: src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:26.142846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:26.189475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601944649222911:5230]
2025-10-10T14:36:26.189832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2009, pipe: [1:7559601944649222911:5230]
2025-10-10T14:36:26.253612Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:26.254035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.254047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.254073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649222911:5230], now have 1 active actors on pipe
2025-10-10T14:36:26.254339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:26.257681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:26.257695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601944649222911:5230]
2025-10-10T14:36:26.257730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:26.257824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2010 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0
2025-10-10T14:36:26.258048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2010 sessionId: src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0 is DEAD
2025-10-10T14:36:26.258544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:26.258555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0] Write session will restart in 0.008119s
2025-10-10T14:36:26.258582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0] Write session: Do CDS request
2025-10-10T14:36:26.258589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:26.267920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.268974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:26.268042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:26.268061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2011
2025-10-10T14:36:26.269523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.269570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:26.269581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:26.269586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:26.270072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2011 sessionId:  describe result for acl check
2025-10-10T14:36:26.270111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:26.270114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:26.270116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:26.270122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601944649222972:8798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:26.270727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601944649222972:8798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:26.270791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:26.271026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:26.271039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:26.271051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:26.271110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:26.271154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601943866993155:4212]
2025-10-10T14:36:26.271738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:26.272002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:26.272059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:26.272402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:26.272482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.272488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.272489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.272490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.272492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.272493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.272494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.272495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.272497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.272499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.272500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.272501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.272502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.272509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.272522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.272527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.272531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.272535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.272540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.272544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.272573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.272588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.272597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.272601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.272605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.272610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.272618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.272632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.272642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.272647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.272654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.272659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.272666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.272682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.272687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.272692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.272697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.272702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.272712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.272718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.272722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.272727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.272732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.272736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.272741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.272746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.272750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.272756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.272764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.272769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.272779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.272784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.272826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:26.273065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601944649222972:8798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:26.277927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601944649222972:8798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:26.277943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601944649222972:8798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:26.277947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601944649222972:8798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:26.277956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:26.278216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:26.278683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:26.278701Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:26.278704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:26.278711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:26.278718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2010 [2:7559601943866993155:4212]
2025-10-10T14:36:26.278731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:26.278749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:26.278753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.278757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.278760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.278779Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:26.278797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:26.278804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:26.278869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.278879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.278881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.278884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:26.278963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:26.278971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.278984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.278996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.279016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:26.279043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649222912:2438], now have 1 active actors on pipe
2025-10-10T14:36:26.279051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223005:8798], now have 1 active actors on pipe
2025-10-10T14:36:26.279059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601943866993149:4212]
2025-10-10T14:36:26.279062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601943866993149:4212]
2025-10-10T14:36:26.279064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601943866993149:4212]
2025-10-10T14:36:26.279078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:26.279095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2010
2025-10-10T14:36:26.279091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:26.279098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:26.279102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:26.279104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:26.279115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:26.279141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2010
2025-10-10T14:36:26.279119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:26.279154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601943866993149:4212]
2025-10-10T14:36:26.279157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:26.279161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:26.279206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.279216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.279254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:26.279268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.279272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.279279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:26.279291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.279305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:26.279322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.279471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.279478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.279492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.279584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2011 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0
2025-10-10T14:36:26.279995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8999314e-f1dc4c7c-ebe51cfa-d9468537_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:26.282770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0] Write session: try to update token
2025-10-10T14:36:26.282788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:26.303064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:26.303088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:26.303091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:26.303093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:26.303104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601943866993149:4212]
2025-10-10T14:36:26.303109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601943866993149:4212]
2025-10-10T14:36:26.303113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601943866993149:4212]
2025-10-10T14:36:26.303161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:26.303162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:26.303169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:26.303170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.303172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:26.303173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:26.303301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:26.303573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId: src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:26.306163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:26.358005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601944649223016:5230]
2025-10-10T14:36:26.358318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2010, pipe: [1:7559601944649223016:5230]
2025-10-10T14:36:26.422047Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:26.422414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.422433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.422482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223016:5230], now have 1 active actors on pipe
2025-10-10T14:36:26.422701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:26.422731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:26.422735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:26.422781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601944649223016:5230]
2025-10-10T14:36:26.422802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2011 reason: error at write: Disconnected sessionId: src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0
2025-10-10T14:36:26.422977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:26.423022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2011 sessionId: src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0 is DEAD
2025-10-10T14:36:26.423180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:26.423190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0] Write session will restart in 0.005402s
2025-10-10T14:36:26.423214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0] Write session: Do CDS request
2025-10-10T14:36:26.423235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:26.429909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.429994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:26.430010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2012
2025-10-10T14:36:26.430163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.430209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:26.430219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:26.430223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:26.430710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2012 sessionId:  describe result for acl check
2025-10-10T14:36:26.430748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:26.430755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:26.430757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:26.430763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601944649223050:8788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:26.431373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601944649223050:8788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:26.433645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:26.434100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601944649223050:8788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:26.435495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:26.435710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:26.435722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:26.435734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:26.435788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:26.435830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601943866993253:4207]
2025-10-10T14:36:26.436469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:26.436777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:26.436823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:26.437159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:26.437220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.437238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.437244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.437245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.437247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.437248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.437249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.437251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.437252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.437253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.437254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.437255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.437257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.437262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.437276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.437280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.437285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.437288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.437293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.437297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.437301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.437305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.437310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.437314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.437318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.437322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.437342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.437351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.437358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.437363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.437368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.437372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.437376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.437381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.437385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.437390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.437394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.437398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.437403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.437409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.437413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.437419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.437425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.437437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.437441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.437447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.437458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.437463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.437472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.437478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.437490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.437495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.437538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:26.438075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601944649223050:8788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:26.438091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601944649223050:8788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:26.438094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601944649223050:8788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:26.438104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:26.439987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:26.440318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:26.440332Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:26.440335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:26.440339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:26.440346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2011 [2:7559601943866993253:4207]
2025-10-10T14:36:26.440361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:26.440381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:26.440389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.440393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.440395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.440413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:26.440421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:26.440443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:26.440504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.440511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.440514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.440517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:26.440605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:26.440613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.440623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.440638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.440656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:26.440697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223111:8788], now have 1 active actors on pipe
2025-10-10T14:36:26.440701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223017:2438], now have 1 active actors on pipe
2025-10-10T14:36:26.440710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601943866993247:4207]
2025-10-10T14:36:26.440712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601943866993247:4207]
2025-10-10T14:36:26.440714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601943866993247:4207]
2025-10-10T14:36:26.440729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:26.440706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2011
2025-10-10T14:36:26.440718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2011
2025-10-10T14:36:26.440744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:26.440748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:26.440751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:26.440752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:26.440768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:26.440771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:26.440817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.440827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.440846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601943866993247:4207]
2025-10-10T14:36:26.440852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:26.440859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:26.440881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:26.440897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.440900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.440903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:26.440914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.440926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:26.440953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.441109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.441124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.441149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.441244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2012 partition: 0 MaxSeqNo: 40 sessionId: src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0
2025-10-10T14:36:26.441681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd6b7686-f1d9c26-bc8c0e42-29ad7a51_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:26.444461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0] Write session: try to update token
2025-10-10T14:36:26.444479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:26.460784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId: src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:26.463606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:26.464177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.464205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.464231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:26.464234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:26.464239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:26.464242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:26.464254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601943866993247:4207]
2025-10-10T14:36:26.464259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601943866993247:4207]
2025-10-10T14:36:26.464264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601943866993247:4207]
2025-10-10T14:36:26.464322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:26.464334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:26.464341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:26.464343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.464344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:26.464346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:26.464497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:26.522859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601944649223119:5230]
2025-10-10T14:36:26.525621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2011, pipe: [1:7559601944649223119:5230]
2025-10-10T14:36:26.590636Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:26.591056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:26.591226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:26.592005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:26.592054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601944649223119:5230]
2025-10-10T14:36:26.591121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223119:5230], now have 1 active actors on pipe
2025-10-10T14:36:26.604086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:26.604131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:26.604145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:26.604172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2012 reason: error at write: Disconnected sessionId: src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0
2025-10-10T14:36:26.604497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:26.604509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0] Write session will restart in 0.009236s
2025-10-10T14:36:26.604533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0] Write session: Do CDS request
2025-10-10T14:36:26.604540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:26.604321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2012 sessionId: src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0 is DEAD
2025-10-10T14:36:26.611426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:26.611692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:26.611697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:26.611710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:26.611768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:26.611805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601943866993365:4200]
2025-10-10T14:36:26.612442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:26.612934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:26.612989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:26.613493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:26.613583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.613589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.613590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.613591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.613593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.613595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.613596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.613598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.613599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.613600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.613602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.613603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.613605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.613612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.613626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.613631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.613636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.613641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.613647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.613651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.613656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.613660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.613667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.613671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.613675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.613680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.613689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.613699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.613706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.613713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.613719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.613725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.613730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.613736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.613742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.613747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.613752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.613757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.613762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.613767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.613772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.613777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.613782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.613787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.613792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.613798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.613804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.613810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.613815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.613822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.613827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.613844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.613886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:26.614924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.615010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:26.615023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2013
2025-10-10T14:36:26.615168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.615201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:26.615208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:26.615211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:26.615649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2013 sessionId:  describe result for acl check
2025-10-10T14:36:26.615687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:26.615694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:26.615696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:26.615703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601944649223191:8768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:26.616200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601944649223191:8768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:26.618173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:26.618580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:26.618597Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:26.618600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:26.618603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:26.618610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2012 [2:7559601943866993365:4200]
2025-10-10T14:36:26.618623Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:26.618647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:26.618655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.618658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.618661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.618681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:26.618693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:26.618705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:26.618781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.618789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.618791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.618793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:26.618861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:26.618873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.618885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.618897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.618912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:26.618934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223120:2438], now have 1 active actors on pipe
2025-10-10T14:36:26.618949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601943866993359:4200]
2025-10-10T14:36:26.618950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601943866993359:4200]
2025-10-10T14:36:26.618952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601943866993359:4200]
2025-10-10T14:36:26.618965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:26.618979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:26.618980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:26.618984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:26.618985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:26.618993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:26.618997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:26.619031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601943866993359:4200]
2025-10-10T14:36:26.619043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:26.619049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:26.619267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2012
2025-10-10T14:36:26.619506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601944649223191:8768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:26.625454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601944649223191:8768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:26.625470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601944649223191:8768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:26.625474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601944649223191:8768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:26.625484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:26.626576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223232:8768], now have 1 active actors on pipe
2025-10-10T14:36:26.626626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2012
2025-10-10T14:36:26.626701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.626721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.626771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:26.626791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.626806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.626813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:26.626839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.626864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:26.626894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.627126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.627137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.627156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.627263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2013 partition: 0 MaxSeqNo: 40 sessionId: src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0
2025-10-10T14:36:26.627677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe5a34-21d12a3b-7857dec5-dd26fd17_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:26.630491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0] Write session: try to update token
2025-10-10T14:36:26.630511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:26.639296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:26.639325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:26.639329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:26.639331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:26.639342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601943866993359:4200]
2025-10-10T14:36:26.639347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601943866993359:4200]
2025-10-10T14:36:26.639351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601943866993359:4200]
2025-10-10T14:36:26.639407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:26.639416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.639419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:26.639584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:26.642192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:26.642211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:26.642216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:26.650327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId: src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:26.653678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:26.692296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601944649223250:5230]
2025-10-10T14:36:26.692587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2012, pipe: [1:7559601944649223250:5230]
2025-10-10T14:36:26.760642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:26.761252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.761269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.761294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223250:5230], now have 1 active actors on pipe
2025-10-10T14:36:26.761570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:26.761678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:26.761716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:26.761720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:26.761750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601944649223250:5230]
2025-10-10T14:36:26.761798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2013 reason: error at write: Disconnected sessionId: src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0
2025-10-10T14:36:26.762018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2013 sessionId: src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0 is DEAD
2025-10-10T14:36:26.762198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:26.762218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0] Write session will restart in 0.006544s
2025-10-10T14:36:26.762244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0] Write session: Do CDS request
2025-10-10T14:36:26.762252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:26.769958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.770069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:26.770086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2014
2025-10-10T14:36:26.770254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.770301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:26.770314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:26.770318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:26.770903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2014 sessionId:  describe result for acl check
2025-10-10T14:36:26.770938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:26.770946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:26.770948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:26.770954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601944649223318:8754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:26.771488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601944649223318:8754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:26.772509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:26.773944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601944649223318:8754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:26.774620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:26.774888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:26.774894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:26.774908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:26.774974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:26.775111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601943866993490:4185]
2025-10-10T14:36:26.775739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:26.776135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:26.776204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:26.776534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601944649223318:8754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:26.776558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601944649223318:8754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:26.776562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601944649223318:8754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:26.776570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:26.776549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:26.776620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.776627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.776628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.776630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.776633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.776634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.776636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.776637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.776639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.776640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.776641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.776643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.776644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.776651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.776702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.776706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.776717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.776721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.776725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.776729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.776734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.776739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.776747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.776750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.776755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.776758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.776766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.776775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.776781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.776787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.776794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.776798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.776802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.776807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.776812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.776825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.776832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.776837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.776841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.776845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.776849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.776854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.776858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.776863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.776866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.776871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.776874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.776879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.776883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.776887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.776891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.776896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.776935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:26.779405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:26.779774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:26.779779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:26.779781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:26.779785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:26.779790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2013 [2:7559601943866993490:4185]
2025-10-10T14:36:26.779802Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:26.779819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:26.779822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.779827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.779830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.779849Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:26.779856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:26.779864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:26.779923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.779925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.779926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.779929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:26.780002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:26.780004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.780017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.780029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.780046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:26.780067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601943866993484:4185]
2025-10-10T14:36:26.780070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601943866993484:4185]
2025-10-10T14:36:26.780075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601943866993484:4185]
2025-10-10T14:36:26.780094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:26.780109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:26.780125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:26.780129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:26.780155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601943866993484:4185]
2025-10-10T14:36:26.780160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:26.780215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:26.780218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:26.780220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:26.780227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:26.780481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2013
2025-10-10T14:36:26.780510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2013
2025-10-10T14:36:26.780416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223352:8754], now have 1 active actors on pipe
2025-10-10T14:36:26.780430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223256:2438], now have 1 active actors on pipe
2025-10-10T14:36:26.780756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.780766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.780804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:26.780819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.780836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.780844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:26.780857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.780870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:26.780888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.781200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.781217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.781242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.781360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2014 partition: 0 MaxSeqNo: 40 sessionId: src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0
2025-10-10T14:36:26.781798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b304b0bd-4206aa8e-9c37122-6fd8bad1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:26.784893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0] Write session: try to update token
2025-10-10T14:36:26.784915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:26.802533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:26.802555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:26.802559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:26.802564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:26.802574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601943866993484:4185]
2025-10-10T14:36:26.802580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601943866993484:4185]
2025-10-10T14:36:26.802587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601943866993484:4185]
2025-10-10T14:36:26.802638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:26.802642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:26.802645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.802648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:26.802648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:26.802653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:26.807328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId: src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:26.802785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:26.810107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:26.865431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601944649223363:5230]
2025-10-10T14:36:26.865820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2013, pipe: [1:7559601944649223363:5230]
2025-10-10T14:36:26.932260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:26.932513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.932529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.932574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223363:5230], now have 1 active actors on pipe
2025-10-10T14:36:26.932815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:26.935392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:26.935408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0] Write session will restart in 0.006465s
2025-10-10T14:36:26.935435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0] Write session: Do CDS request
2025-10-10T14:36:26.935442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:26.933344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:26.933434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:26.933452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2014 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0
2025-10-10T14:36:26.933480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601944649223363:5230]
2025-10-10T14:36:26.933645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2014 sessionId: src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0 is DEAD
2025-10-10T14:36:26.949708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:26.949872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.950156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:26.950173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2015
2025-10-10T14:36:26.950545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:26.950583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:26.950589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:26.950594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:26.951444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2015 sessionId:  describe result for acl check
2025-10-10T14:36:26.951472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:26.951474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:26.951476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:26.951485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601944649223440:8751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:26.952070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601944649223440:8751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:26.953721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:26.956481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601944649223440:8751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:26.954082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:26.954088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:26.954100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:26.954158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:26.954197Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601943866993605:4178]
2025-10-10T14:36:26.954860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:26.957913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:26.957965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:26.958371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:26.958424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.958426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.958427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.958428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.958430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.958431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.958432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.958434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.958436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.958437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.958438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.958440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.958441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.958448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.958461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.958465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.958470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.958474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.958478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.958483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.958487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.958592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.958599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.958603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.958607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.958611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.958620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.958629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:26.958637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.958644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:26.958649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.958655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:26.958660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.958666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:26.958670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.958676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:26.958681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.958687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:26.958692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.958697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:26.958701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.958707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:26.958714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.958719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:26.958724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.958729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:26.958734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.958740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.958744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.958750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.958755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.958761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.958804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:26.961771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601944649223440:8751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:26.961787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601944649223440:8751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:26.961791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601944649223440:8751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:26.961801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:26.965937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2014
2025-10-10T14:36:26.965987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2014
2025-10-10T14:36:26.965068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:26.965496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:26.965501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:26.965503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:26.965508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:26.965515Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2014 [2:7559601943866993605:4178]
2025-10-10T14:36:26.965529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:26.965547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:26.965551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.965555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.965557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.965587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:26.965595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:26.965603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:26.965664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.965666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.965672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.965674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:26.965752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:26.965758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.965769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:26.965782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:26.965799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:26.965820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223364:2438], now have 1 active actors on pipe
2025-10-10T14:36:26.965824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601944649223473:8751], now have 1 active actors on pipe
2025-10-10T14:36:26.965830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601943866993598:4178]
2025-10-10T14:36:26.965833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601943866993598:4178]
2025-10-10T14:36:26.965835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601943866993598:4178]
2025-10-10T14:36:26.965850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:26.965864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:26.965867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:26.965871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:26.965873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:26.965880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:26.965883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:26.965912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601943866993598:4178]
2025-10-10T14:36:26.965918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:26.965959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:26.966195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.966206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.966238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:26.966245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:26.966248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:26.966250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:26.966262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:26.966274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:26.966289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.966534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:26.966545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:26.966573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:26.966736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2015 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0
2025-10-10T14:36:26.967130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd5a5755-e24743d2-cb8d2eb9-122b1112_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:26.969887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0] Write session: try to update token
2025-10-10T14:36:26.969909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:26.986332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:26.986353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:26.986357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:26.986359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:26.986369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601943866993598:4178]
2025-10-10T14:36:26.986374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601943866993598:4178]
2025-10-10T14:36:26.986379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601943866993598:4178]
2025-10-10T14:36:26.986432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:26.986440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:26.986442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:26.986442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:26.986450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:26.986455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:26.986580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:26.999095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId: src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:27.001861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:27.034794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601948944190777:5230]
2025-10-10T14:36:27.035119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2014, pipe: [1:7559601948944190777:5230]
2025-10-10T14:36:27.105994Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:27.106425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.106436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.106461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944190777:5230], now have 1 active actors on pipe
2025-10-10T14:36:27.106841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:27.107303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:27.107313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0] Write session will restart in 0.009341s
2025-10-10T14:36:27.107349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0] Write session: Do CDS request
2025-10-10T14:36:27.107355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:27.106786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:27.106818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:27.106824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:27.106861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601948944190777:5230]
2025-10-10T14:36:27.106898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2015 reason: error at write: Disconnected sessionId: src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0
2025-10-10T14:36:27.107155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2015 sessionId: src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0 is DEAD
2025-10-10T14:36:27.117997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.118848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:27.118871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2016
2025-10-10T14:36:27.119077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.119131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:27.119151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:27.119157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:27.119733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2016 sessionId:  describe result for acl check
2025-10-10T14:36:27.119775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:27.119782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:27.119785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:27.119793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601948944190840:8747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:27.120446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601948944190840:8747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:27.123792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601948944190840:8747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:27.123908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:27.126028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:27.126312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:27.126326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:27.126338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:27.126399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:27.126465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601948161961003:4175]
2025-10-10T14:36:27.127086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:27.127441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:27.127491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:27.127828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:27.127890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.127896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.127897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.127899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.127900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.127902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.127903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.127905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.127906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.127908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.127909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.127910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.127912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.127918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.127932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.127936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.127940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.127944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.127948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.127951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.127954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.127958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.127963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.127966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.127970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.127973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.127983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.127991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.127997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.128002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.128007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.128012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.128016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.128021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.128025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.128031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.128036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.128040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.128045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.128049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.128054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.128059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.128063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.128068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.128074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.128080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.128085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.128090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.128094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.128098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.128103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.128107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.128146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:27.129772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601948944190840:8747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:27.129789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601948944190840:8747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:27.129793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601948944190840:8747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:27.129802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:27.130744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:27.131107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:27.131121Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:27.131124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:27.131128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:27.131135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2015 [2:7559601948161961003:4175]
2025-10-10T14:36:27.131149Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:27.131169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:27.131180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.131184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.131186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.131206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:27.131213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:27.131221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:27.131286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.131293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.131295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.131297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:27.131396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:27.131403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.131414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.131424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.131459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:27.131488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944190878:8747], now have 1 active actors on pipe
2025-10-10T14:36:27.131497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944190778:2438], now have 1 active actors on pipe
2025-10-10T14:36:27.131504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601948161960998:4175]
2025-10-10T14:36:27.131509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601948161960998:4175]
2025-10-10T14:36:27.131512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601948161960998:4175]
2025-10-10T14:36:27.131527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:27.131542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:27.131543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:27.131547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:27.131550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:27.131561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:27.131564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:27.131597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601948161960998:4175]
2025-10-10T14:36:27.131555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2015
2025-10-10T14:36:27.131608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:27.131630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:27.131635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.131641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.131590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2015
2025-10-10T14:36:27.131688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:27.131703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.131708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.131710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:27.131722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.131737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:27.131762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.131918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.131925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.131941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.132041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2016 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0
2025-10-10T14:36:27.132431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba88a1c1-38a17242-b7ada079-f2929ac7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:27.135447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0] Write session: try to update token
2025-10-10T14:36:27.135480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:27.156293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:27.156314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:27.156319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:27.156321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:27.156332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601948161960998:4175]
2025-10-10T14:36:27.156337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601948161960998:4175]
2025-10-10T14:36:27.156346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601948161960998:4175]
2025-10-10T14:36:27.156398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:27.156400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:27.156405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.156407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:27.156408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:27.156414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:27.156565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:27.156667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId: src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:27.159758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:27.207703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601948944190885:5230]
2025-10-10T14:36:27.208186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2015, pipe: [1:7559601948944190885:5230]
2025-10-10T14:36:27.275611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:27.276023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.276041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.276089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944190885:5230], now have 1 active actors on pipe
2025-10-10T14:36:27.276350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:27.276332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:27.276345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:27.276345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:27.276399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601948944190885:5230]
2025-10-10T14:36:27.276424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2016 reason: error at write: Disconnected sessionId: src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0
2025-10-10T14:36:27.276635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2016 sessionId: src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0 is DEAD
2025-10-10T14:36:27.276820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:27.276833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0] Write session will restart in 0.005359s
2025-10-10T14:36:27.276859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0] Write session: Do CDS request
2025-10-10T14:36:27.276880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:27.283898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.283999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:27.284018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2017
2025-10-10T14:36:27.284184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.284233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:27.284244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:27.284249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:27.284745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2017 sessionId:  describe result for acl check
2025-10-10T14:36:27.284785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:27.284787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:27.284789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:27.284796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601948944190901:8743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:27.285444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601948944190901:8743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:27.287990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601948944190901:8743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:27.289552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:27.291590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:27.291812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:27.291834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:27.291847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:27.291899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:27.291945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601948161961106:4163]
2025-10-10T14:36:27.292598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:27.292907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:27.292951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:27.293279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:27.293361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.293368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.293370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.293371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.293372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.293373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.293373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.293375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.293376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.293377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.293378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.293379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.293380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.293387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.293401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.293406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.293410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.293414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.293418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.293422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.293425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.293428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.293433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.293436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.293440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.293443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.293452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.293459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.293467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.293472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.293476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.293481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.293484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.293489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.293493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.293497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.293502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.293507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.293511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.293516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.293520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.293524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.293529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.293535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.293539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.293543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.293548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.293553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.293564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.293569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.293574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.293584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.293621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:27.295991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:27.296290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:27.296299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:27.296301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:27.296307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:27.296311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2016 [2:7559601948161961106:4163]
2025-10-10T14:36:27.296320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:27.296333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:27.296335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.296337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.296338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.296352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:27.296360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:27.296383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:27.296429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.296436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.296437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.296438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:27.296505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:27.296514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.296535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.296550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.296572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:27.296600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944190984:8743], now have 1 active actors on pipe
2025-10-10T14:36:27.296603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944190886:2438], now have 1 active actors on pipe
2025-10-10T14:36:27.296611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601948161961101:4163]
2025-10-10T14:36:27.296613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601948161961101:4163]
2025-10-10T14:36:27.296615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601948161961101:4163]
2025-10-10T14:36:27.296629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:27.296643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:27.296672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:27.296680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:27.296702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601948161961101:4163]
2025-10-10T14:36:27.296708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:27.296732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:27.296740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:27.296742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:27.296749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:27.296872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.296887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.296930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:27.296944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.296949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.296952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:27.296965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.296980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:27.297008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.294416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601948944190901:8743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:27.294432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601948944190901:8743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:27.294436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601948944190901:8743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:27.294445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:27.296635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2016
2025-10-10T14:36:27.296668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2016
2025-10-10T14:36:27.297363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2017 partition: 0 MaxSeqNo: 40 sessionId: src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0
2025-10-10T14:36:27.297766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5b054d-ffa5eba-dec4baa1-d32ce4fa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:27.300445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0] Write session: try to update token
2025-10-10T14:36:27.300463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:27.297219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.297230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.297251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.320388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId: src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:27.317918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:27.317945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:27.317950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:27.317952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:27.317966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601948161961101:4163]
2025-10-10T14:36:27.317974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601948161961101:4163]
2025-10-10T14:36:27.317978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601948161961101:4163]
2025-10-10T14:36:27.318030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:27.318036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:27.318037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:27.318044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.318047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:27.318051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:27.318192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:27.323511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:27.376413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601948944190993:5230]
2025-10-10T14:36:27.376794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2016, pipe: [1:7559601948944190993:5230]
2025-10-10T14:36:27.451457Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:27.451827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.451847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.451897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944190993:5230], now have 1 active actors on pipe
2025-10-10T14:36:27.452201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:27.453115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:27.453129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0] Write session will restart in 0.006970s
2025-10-10T14:36:27.453157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0] Write session: Do CDS request
2025-10-10T14:36:27.453163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:27.452594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:27.452673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601948944190993:5230]
2025-10-10T14:36:27.452693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:27.452696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:27.452750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2017 reason: error at write: Disconnected sessionId: src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0
2025-10-10T14:36:27.452942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2017 sessionId: src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0 is DEAD
2025-10-10T14:36:27.465668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:27.466044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.466038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:27.466052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2018
2025-10-10T14:36:27.466276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.466325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:27.466336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:27.466341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:27.466771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2018 sessionId:  describe result for acl check
2025-10-10T14:36:27.466807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:27.466808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:27.466810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:27.466817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601948944191062:8737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:27.467396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601948944191062:8737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:27.469662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:27.469909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:27.469923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:27.469936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:27.469995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:27.470039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601948161961210:4171]
2025-10-10T14:36:27.470682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:27.472423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:27.472483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:27.472844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:27.472904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.472906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.472907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.472908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.472910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.472911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.472912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.472913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.472914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.472916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.472917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.472919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.472920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.472928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.472941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.472946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.472950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.472955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.472959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.472964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.472968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.472972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.472979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.472983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.472987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.472991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.472999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.473008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.473016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.473022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.473028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.473034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.473038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.473044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.473050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.473055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.473060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.473068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.473074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.473079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.473084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.473090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.473097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.473103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.473107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.473113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.473118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.473124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.473130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.473135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.473140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.473146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.473191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:27.472864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601948944191062:8737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:27.475899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:27.476363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:27.476380Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:27.476383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:27.476387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:27.476396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2017 [2:7559601948161961210:4171]
2025-10-10T14:36:27.476410Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:27.476429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:27.476440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.476444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.476446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.476464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:27.476477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:27.476485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:27.476556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.476567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.476569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.476571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:27.476657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:27.476660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.476673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.476687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.476722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:27.476745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944190994:2438], now have 1 active actors on pipe
2025-10-10T14:36:27.476753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601948161961205:4171]
2025-10-10T14:36:27.476756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601948161961205:4171]
2025-10-10T14:36:27.476758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601948161961205:4171]
2025-10-10T14:36:27.476775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:27.476789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:27.476807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:27.476811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:27.476837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601948161961205:4171]
2025-10-10T14:36:27.476842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:27.476992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2017
2025-10-10T14:36:27.477044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:27.477055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:27.477057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:27.477065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:27.480685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601948944191062:8737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:27.480701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601948944191062:8737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:27.480705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601948944191062:8737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:27.480716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:27.481244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191098:8737], now have 1 active actors on pipe
2025-10-10T14:36:27.481312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2017
2025-10-10T14:36:27.481411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.481425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.481462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a08edb5c-4e048416-5e90d447-4079aedf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:27.481476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.481483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.481486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:27.481500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.481519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:27.481539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.485075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.485094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.485123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.485326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2018 partition: 0 MaxSeqNo: 40 sessionId: src_id|a08edb5c-4e048416-5e90d447-4079aedf_0
2025-10-10T14:36:27.485795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d66fd889-162ec3d-f2ff9f05-2307da21_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a08edb5c-4e048416-5e90d447-4079aedf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:27.488431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a08edb5c-4e048416-5e90d447-4079aedf_0] Write session: try to update token
2025-10-10T14:36:27.488450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a08edb5c-4e048416-5e90d447-4079aedf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:27.501763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:27.501787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:27.501791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:27.501794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:27.501805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601948161961205:4171]
2025-10-10T14:36:27.501814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601948161961205:4171]
2025-10-10T14:36:27.501818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601948161961205:4171]
2025-10-10T14:36:27.501869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:27.501878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.501883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:27.502018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:27.505612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:27.505619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:27.505624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:27.504775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId: src_id|a08edb5c-4e048416-5e90d447-4079aedf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:27.507226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:27.552973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601948944191102:5230]
2025-10-10T14:36:27.553413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2017, pipe: [1:7559601948944191102:5230]
2025-10-10T14:36:27.634189Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:27.634519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.634538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.634580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191102:5230], now have 1 active actors on pipe
2025-10-10T14:36:27.634806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601948944191102:5230]
2025-10-10T14:36:27.634836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:27.634841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:27.634844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:27.634910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2018 reason: error at write: Disconnected sessionId: src_id|a08edb5c-4e048416-5e90d447-4079aedf_0
2025-10-10T14:36:27.635127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2018 sessionId: src_id|a08edb5c-4e048416-5e90d447-4079aedf_0 is DEAD
2025-10-10T14:36:27.635224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:27.635506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08edb5c-4e048416-5e90d447-4079aedf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:27.635517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08edb5c-4e048416-5e90d447-4079aedf_0] Write session will restart in 0.006551s
2025-10-10T14:36:27.635544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08edb5c-4e048416-5e90d447-4079aedf_0] Write session: Do CDS request
2025-10-10T14:36:27.635551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08edb5c-4e048416-5e90d447-4079aedf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:27.645838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a08edb5c-4e048416-5e90d447-4079aedf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.646521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:27.646542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2019
2025-10-10T14:36:27.646696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.646753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:27.646764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:27.646768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:27.647214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2019 sessionId:  describe result for acl check
2025-10-10T14:36:27.647256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:27.647263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:27.647265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:27.647272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601948944191120:8733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:27.647869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601948944191120:8733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:27.653260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:27.655123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:27.655364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:27.655376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:27.655389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:27.655449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:27.655492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601948161961329:4164]
2025-10-10T14:36:27.656128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:27.656742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:27.656802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:27.656801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601948944191120:8733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:27.657196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:27.657264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.657271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.657273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.657274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.657275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.657277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.657278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.657279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.657280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.657281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.657282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.657283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.657285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.657291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.657303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.657307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.657312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.657316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.657320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.657324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.657328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.657347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.657352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.657356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.657359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.657363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.657371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.657379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.657386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.657391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.657397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.657402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.657406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.657412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.657416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.657421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.657426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.657432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.657437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.657442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.657446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.657451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.657456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.657461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.657466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.657471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.657476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.657482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.657486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.657491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.657495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.657501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.657540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:27.659932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601948944191120:8733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:27.659955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601948944191120:8733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:27.659959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601948944191120:8733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:27.659969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:27.660059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:27.660519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:27.660538Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:27.660540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:27.660545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:27.660551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2018 [2:7559601948161961329:4164]
2025-10-10T14:36:27.660563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:27.660584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:27.660587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.660590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.660593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.660610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:27.660622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:27.660629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:27.660710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.660720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.660722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.660724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:27.660861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:27.660870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.660883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.660894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.660911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:27.660897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2018
2025-10-10T14:36:27.660900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2018
2025-10-10T14:36:27.660938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191206:8733], now have 1 active actors on pipe
2025-10-10T14:36:27.660949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191104:2438], now have 1 active actors on pipe
2025-10-10T14:36:27.660957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601948161961324:4164]
2025-10-10T14:36:27.660960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601948161961324:4164]
2025-10-10T14:36:27.660962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601948161961324:4164]
2025-10-10T14:36:27.660976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:27.660990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:27.660989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:27.660993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:27.660995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:27.661011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:27.661014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:27.661029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.661034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.661072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601948161961324:4164]
2025-10-10T14:36:27.661084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:27.661094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:27.661103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:27.661112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.661115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.661116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:27.661125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.661134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:27.661164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.661327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.661352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.661370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.661473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2019 partition: 0 MaxSeqNo: 40 sessionId: src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0
2025-10-10T14:36:27.661874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a08edb5c-4e048416-5e90d447-4079aedf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:27.664873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0] Write session: try to update token
2025-10-10T14:36:27.664893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:27.680358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId: src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:27.681148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:27.681173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:27.681175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:27.681177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:27.681188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601948161961324:4164]
2025-10-10T14:36:27.681192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601948161961324:4164]
2025-10-10T14:36:27.681195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601948161961324:4164]
2025-10-10T14:36:27.681251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:27.681262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.681272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:27.681440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:27.681527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:27.681534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:27.681538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:27.683268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:27.734723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601948944191242:5230]
2025-10-10T14:36:27.734950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2018, pipe: [1:7559601948944191242:5230]
2025-10-10T14:36:27.801057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:27.801375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.801393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.801441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191242:5230], now have 1 active actors on pipe
2025-10-10T14:36:27.801726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601948944191242:5230]
2025-10-10T14:36:27.801753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:27.801760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:27.801765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:27.801843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2019 reason: error at write: Disconnected sessionId: src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0
2025-10-10T14:36:27.802044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2019 sessionId: src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0 is DEAD
2025-10-10T14:36:27.801795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:27.802208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:27.802217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0] Write session will restart in 0.009338s
2025-10-10T14:36:27.802242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0] Write session: Do CDS request
2025-10-10T14:36:27.802250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:27.812975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.813426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:27.813442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2020
2025-10-10T14:36:27.813638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.813675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:27.813685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:27.813689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:27.814219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2020 sessionId:  describe result for acl check
2025-10-10T14:36:27.814261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:27.814271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:27.814273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:27.814280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601948944191315:8714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:27.814891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601948944191315:8714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:27.817688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601948944191315:8714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:27.818386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:27.820844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:27.821104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:27.821122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:27.821136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:27.821198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:27.821245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601948161961460:4134]
2025-10-10T14:36:27.821905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:27.822271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:27.822333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:27.822699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:27.822765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.822766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.822768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.822769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.822770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.822772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.822773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.822774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.822776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.822777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.822779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.822780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.822781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.822788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.822801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.822805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.822809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.822813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.822818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.822822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.822826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.822830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.822834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.822838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.822842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.822846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.822854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.822863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:27.822869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.822875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:27.822880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.822885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:27.822890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.822896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:27.822912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.822917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:27.822922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.822927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:27.822933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.822938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:27.822945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.822950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:27.822956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.822961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:27.822965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.822970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:27.822975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.822980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.822985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.822991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.822998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.823003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.823041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:27.825988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601948944191315:8714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:27.826007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601948944191315:8714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:27.826011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601948944191315:8714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:27.826022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:27.826316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:27.826952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:27.826970Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:27.826972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:27.826978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:27.826984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2019 [2:7559601948161961460:4134]
2025-10-10T14:36:27.826999Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:27.827018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:27.827024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.827028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.827031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.827050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:27.827059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:27.827381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2019
2025-10-10T14:36:27.827422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2019
2025-10-10T14:36:27.827070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:27.827138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.827141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.827143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.827146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:27.827216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:27.827219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.827232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:27.827244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:27.827260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:27.827284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191247:2438], now have 1 active actors on pipe
2025-10-10T14:36:27.827287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191349:8714], now have 1 active actors on pipe
2025-10-10T14:36:27.827295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601948161961455:4134]
2025-10-10T14:36:27.827298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601948161961455:4134]
2025-10-10T14:36:27.827300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601948161961455:4134]
2025-10-10T14:36:27.827316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:27.827332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:27.827352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:27.827356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:27.827388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601948161961455:4134]
2025-10-10T14:36:27.827391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:27.827439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:27.827443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:27.827445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:27.827452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:27.827601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.827613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.827646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:27.827660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:27.827665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:27.827667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:27.827679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:27.827697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:27.827716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.827871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.827878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.827892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:27.827963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2020 partition: 0 MaxSeqNo: 40 sessionId: src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0
2025-10-10T14:36:27.828351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd843d7-23a1ea63-2709403a-93a57dc8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:27.831189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0] Write session: try to update token
2025-10-10T14:36:27.831211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:27.848614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId: src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:27.851675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:27.850649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:27.850675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:27.850679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:27.850682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:27.850693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601948161961455:4134]
2025-10-10T14:36:27.850698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601948161961455:4134]
2025-10-10T14:36:27.850702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601948161961455:4134]
2025-10-10T14:36:27.850761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:27.850771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:27.850773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:27.850783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:27.850794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:27.850800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:27.850949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:27.901669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601948944191356:5230]
2025-10-10T14:36:27.901922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2019, pipe: [1:7559601948944191356:5230]
2025-10-10T14:36:27.984502Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:27.984957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:27.984976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:27.985022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191356:5230], now have 1 active actors on pipe
2025-10-10T14:36:27.985251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:27.985303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:27.985311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:27.985432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:27.986074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:27.986085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0] Write session will restart in 0.005307s
2025-10-10T14:36:27.986111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0] Write session: Do CDS request
2025-10-10T14:36:27.986118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:27.985395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2020 reason: error at write: Disconnected sessionId: src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0
2025-10-10T14:36:27.985421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601948944191356:5230]
2025-10-10T14:36:27.985607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2020 sessionId: src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0 is DEAD
2025-10-10T14:36:27.992849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.993622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:27.993637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2021
2025-10-10T14:36:27.993778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:27.993824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:27.993830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:27.993834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:27.994241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2021 sessionId:  describe result for acl check
2025-10-10T14:36:27.994270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:27.994272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:27.994274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:27.994280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601948944191409:8705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:27.994849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601948944191409:8705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:27.997849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601948944191409:8705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:27.998623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:28.001115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:28.001351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:28.001358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:28.001373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:28.001453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:28.001494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601952456928876:4141]
2025-10-10T14:36:28.002150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:28.002438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:28.002509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:28.002837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:28.002915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.002922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.002924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.002925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.002926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.002927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.002928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.002929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.002930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.002931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.002933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.002934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.002935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.002941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.002954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.002957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.002961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.002964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.002968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.002972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.002975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.002978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.002982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.002986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.002989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.002992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.003000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.003008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.003016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.003021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.003025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.003029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.003033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.003037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.003042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.003046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.003050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.003055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.003059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.003064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.003074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.003079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.003083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.003093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.003096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.003101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.003110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.003115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.003119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.003129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.003133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.003138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.002752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601948944191409:8705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:28.002768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601948944191409:8705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:28.002771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601948944191409:8705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:28.002781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:28.003182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:28.006429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2020
2025-10-10T14:36:28.006467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2020
2025-10-10T14:36:28.005683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:28.006073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:28.006079Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:28.006081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:28.006084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:28.006091Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2020 [2:7559601952456928876:4141]
2025-10-10T14:36:28.006104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:28.006122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:28.006126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.006130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.006132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.006151Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:28.006158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:28.006166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:28.006224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.006226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.006228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.006230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:28.006300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:28.006304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.006317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.006330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.006348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:28.006371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601948944191373:2438], now have 1 active actors on pipe
2025-10-10T14:36:28.006375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239158766:8705], now have 1 active actors on pipe
2025-10-10T14:36:28.006383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601948161961575:4141]
2025-10-10T14:36:28.006385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601948161961575:4141]
2025-10-10T14:36:28.006388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601948161961575:4141]
2025-10-10T14:36:28.006403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:28.006417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:28.006433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:28.006436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:28.006450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:28.006453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:28.006455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:28.006462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601948161961575:4141]
2025-10-10T14:36:28.006465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:28.006474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:28.006601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.006610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.006650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:28.006659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.006664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.006666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:28.006680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.006701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:28.006716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.006888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.006900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.006925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.007071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2021 partition: 0 MaxSeqNo: 40 sessionId: src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0
2025-10-10T14:36:28.007422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b78da14-2c00fa13-cc7d4101-8ab84b55_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:28.010147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0] Write session: try to update token
2025-10-10T14:36:28.010167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:28.027319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:28.027343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:28.027347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:28.027350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:28.027361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601948161961575:4141]
2025-10-10T14:36:28.027365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601948161961575:4141]
2025-10-10T14:36:28.027370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601948161961575:4141]
2025-10-10T14:36:28.027425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:28.027426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:28.027438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.027442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:28.027442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:28.027447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:28.027594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:28.029468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId: src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:28.032311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:28.085476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601953239158776:5230]
2025-10-10T14:36:28.086006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2020, pipe: [1:7559601953239158776:5230]
2025-10-10T14:36:28.186723Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:28.187156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.187170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.187210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239158776:5230], now have 1 active actors on pipe
2025-10-10T14:36:28.187426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:28.187488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:28.187495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601953239158776:5230]
2025-10-10T14:36:28.187517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:28.187602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2021 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0
2025-10-10T14:36:28.187798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2021 sessionId: src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0 is DEAD
2025-10-10T14:36:28.187972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:28.187985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0] Write session will restart in 0.007827s
2025-10-10T14:36:28.188012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0] Write session: Do CDS request
2025-10-10T14:36:28.188020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:28.196918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.197063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:28.197086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2022
2025-10-10T14:36:28.197208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.197245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:28.197264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:28.197273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:28.197739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2022 sessionId:  describe result for acl check
2025-10-10T14:36:28.197784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:28.197790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:28.197795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:28.197803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601953239158848:8703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:28.197971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:28.198414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601953239158848:8703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:28.200074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:28.200296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:28.200309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:28.200322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:28.200382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:28.200424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601952456928985:4135]
2025-10-10T14:36:28.200765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601953239158848:8703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:28.201002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:28.201323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:28.201384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:28.201714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:28.201773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.201779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.201780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.201781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.201783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.201784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.201785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.201786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.201788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.201789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.201791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.201792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.201793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.201799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.201811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.201815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.201820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.201824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.201829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.201833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.201837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.201841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.201846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.201850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.201854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.201858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.201865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.201876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.201883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.201888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.201892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.201901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.201905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.201910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.201921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.201926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.201930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.201941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.201946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.201952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.201956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.201961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.201968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.201974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.201978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.201986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.201991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.201997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.202006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.202012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.202017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.202022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.202070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:28.204534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601953239158848:8703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:28.204550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601953239158848:8703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:28.204554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601953239158848:8703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:28.204564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:28.204582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:28.204954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:28.204967Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:28.204969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:28.204972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:28.204976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2021 [2:7559601952456928985:4135]
2025-10-10T14:36:28.204986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:28.204998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:28.205000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.205002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.205004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.205017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:28.205022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:28.205028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:28.205076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.205083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.205085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.205086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:28.205140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:28.205146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.205152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.205159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.205169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:28.205187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239158883:8703], now have 1 active actors on pipe
2025-10-10T14:36:28.205193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239158779:2438], now have 1 active actors on pipe
2025-10-10T14:36:28.205199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601952456928979:4135]
2025-10-10T14:36:28.205200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601952456928979:4135]
2025-10-10T14:36:28.205202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601952456928979:4135]
2025-10-10T14:36:28.205212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:28.205224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:28.205227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:28.205230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:28.205232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:28.205244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:28.205247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:28.205268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601952456928979:4135]
2025-10-10T14:36:28.205279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:28.205285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:28.205299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2021
2025-10-10T14:36:28.205327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2021
2025-10-10T14:36:28.205423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.205437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.205471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:28.205480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.205483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.205484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:28.205494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.205507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:28.205522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.205703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.205711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.205723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.205811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2022 partition: 0 MaxSeqNo: 40 sessionId: src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0
2025-10-10T14:36:28.206184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca60ad5-d5a60dd4-30d9e46e-aca8d3cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:28.208907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0] Write session: try to update token
2025-10-10T14:36:28.208925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:28.230773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId: src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:28.228667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:28.228693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:28.228697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:28.228699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:28.228709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601952456928979:4135]
2025-10-10T14:36:28.228715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601952456928979:4135]
2025-10-10T14:36:28.228719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601952456928979:4135]
2025-10-10T14:36:28.228769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:28.228773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:28.228775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:28.228781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:28.228786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.228789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:28.228937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:28.233694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:28.287655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601953239158890:5230]
2025-10-10T14:36:28.288132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2021, pipe: [1:7559601953239158890:5230]
2025-10-10T14:36:28.349177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:28.349614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.349632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.349679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239158890:5230], now have 1 active actors on pipe
2025-10-10T14:36:28.350023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601953239158890:5230]
2025-10-10T14:36:28.350023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:28.350028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:28.350055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:28.350095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2022 reason: error at write: Disconnected sessionId: src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0
2025-10-10T14:36:28.350308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2022 sessionId: src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0 is DEAD
2025-10-10T14:36:28.350562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:28.350573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0] Write session will restart in 0.007700s
2025-10-10T14:36:28.350592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0] Write session: Do CDS request
2025-10-10T14:36:28.350596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:28.349972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:28.359912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.360031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:28.360049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2023
2025-10-10T14:36:28.360207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.360248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:28.360259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:28.360263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:28.360688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2023 sessionId:  describe result for acl check
2025-10-10T14:36:28.360720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:28.360722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:28.360723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:28.360728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601953239158960:8695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:28.361310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601953239158960:8695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:28.361858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:28.364073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:28.364272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:28.364277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:28.364287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:28.364328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:28.364374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601952456929094:4139]
2025-10-10T14:36:28.364892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:28.365762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601953239158960:8695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:28.365177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:28.365217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:28.365460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:28.365498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.365499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.365500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.365501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.365502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.365503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.365503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.365504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.365505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.365506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.365506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.365507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.365508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.365512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.365521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.365523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.365526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.365528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.365531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.365533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.365535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.365537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.365540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.365542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.365544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.365546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.365552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.365558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.365562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.365566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.365569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.365572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.365575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.365578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.365582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.365585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.365588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.365591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.365596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.365599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.365602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.365605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.365609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.365612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.365615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.365618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.365621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.365624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.365627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.365630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.365635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.365638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.365661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:28.368206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601953239158960:8695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:28.368223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601953239158960:8695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:28.368226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601953239158960:8695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:28.368235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:28.368264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:28.368756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:28.368769Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:28.368771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:28.368775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:28.368781Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2022 [2:7559601952456929094:4139]
2025-10-10T14:36:28.368798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:28.368817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:28.368821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.368825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.368828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.368848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:28.368856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:28.368865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:28.368930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.368937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.368939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.368942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:28.369012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:28.369018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.369031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.369043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.369058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:28.369080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601952456929088:4139]
2025-10-10T14:36:28.369082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601952456929088:4139]
2025-10-10T14:36:28.369083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601952456929088:4139]
2025-10-10T14:36:28.369099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:28.369114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:28.369130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:28.369133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:28.369159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601952456929088:4139]
2025-10-10T14:36:28.369162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:28.369511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:28.369541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:28.369544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:28.369551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:28.369720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239158997:8695], now have 1 active actors on pipe
2025-10-10T14:36:28.369732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239158892:2438], now have 1 active actors on pipe
2025-10-10T14:36:28.370022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2022
2025-10-10T14:36:28.370064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2022
2025-10-10T14:36:28.370228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.370249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.370290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:28.370303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.370311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.370315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:28.370329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.370352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:28.370376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.370560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.370570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.370586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.370702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2023 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0
2025-10-10T14:36:28.371224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49ffd9d9-2378b2ca-e56419d1-7cc3906e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:28.374156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0] Write session: try to update token
2025-10-10T14:36:28.374179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:28.390432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:28.390459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:28.390466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:28.390469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:28.390479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601952456929088:4139]
2025-10-10T14:36:28.390484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601952456929088:4139]
2025-10-10T14:36:28.390488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601952456929088:4139]
2025-10-10T14:36:28.390542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:28.390552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.390551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:28.390556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:28.390559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:28.390564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:28.390711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:28.392239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId: src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:28.395042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:28.450026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601953239159004:5230]
2025-10-10T14:36:28.450408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2022, pipe: [1:7559601953239159004:5230]
2025-10-10T14:36:28.512715Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:28.513098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.513116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.513165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159004:5230], now have 1 active actors on pipe
2025-10-10T14:36:28.513475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:28.513907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601953239159004:5230]
2025-10-10T14:36:28.513952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:28.513955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:28.514024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2023 reason: error at write: Disconnected sessionId: src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0
2025-10-10T14:36:28.514239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2023 sessionId: src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0 is DEAD
2025-10-10T14:36:28.514386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:28.514413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:28.514452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0] Write session will restart in 0.005675s
2025-10-10T14:36:28.514481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0] Write session: Do CDS request
2025-10-10T14:36:28.514492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:28.521938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.522032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:28.522051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2024
2025-10-10T14:36:28.522193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.522229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:28.522242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:28.522246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:28.522804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2024 sessionId:  describe result for acl check
2025-10-10T14:36:28.522845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:28.522847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:28.522849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:28.522856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601953239159041:8690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:28.523507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601953239159041:8690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:28.526152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601953239159041:8690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:28.530070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:28.530048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601953239159041:8690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:28.530064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601953239159041:8690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:28.530069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601953239159041:8690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:28.530078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:28.533096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:28.533350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:28.533363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:28.533376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:28.533458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:28.533503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601952456929205:4137]
2025-10-10T14:36:28.534142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:28.534606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:28.534654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:28.534983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:28.535046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.535052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.535053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.535055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.535057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.535058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.535059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.535060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.535061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.535062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.535063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.535064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.535065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.535070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.535083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.535087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.535091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.535096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.535100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.535104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.535108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.535112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.535118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.535122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.535125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.535129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.535137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.535146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.535153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.535158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.535163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.535168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.535175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.535181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.535185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.535191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.535195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.535201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.535206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.535212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.535216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.535222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.535227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.535240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.535244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.535252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.535269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.535279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.535283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.535289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.535294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.535299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.535342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:28.538074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:28.538438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:28.538450Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:28.538453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:28.538457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:28.538464Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2023 [2:7559601952456929205:4137]
2025-10-10T14:36:28.538475Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:28.538492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:28.538501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.538504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.538507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.538525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:28.538539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:28.538562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:28.538634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.538640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.538642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.538645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:28.538710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:28.538718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.538732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.538750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.538774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:28.538801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159006:2438], now have 1 active actors on pipe
2025-10-10T14:36:28.538805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159105:8690], now have 1 active actors on pipe
2025-10-10T14:36:28.538813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601952456929198:4137]
2025-10-10T14:36:28.538816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601952456929198:4137]
2025-10-10T14:36:28.538818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601952456929198:4137]
2025-10-10T14:36:28.538829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:28.538846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:28.538856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:28.538859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:28.538861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:28.538862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:28.538865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:28.538889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601952456929198:4137]
2025-10-10T14:36:28.538902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:28.538939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:28.539015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2023
2025-10-10T14:36:28.539047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2023
2025-10-10T14:36:28.539232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.539245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.539284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:28.539297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.539302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.539306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:28.539319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.539336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:28.539355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.539558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.539567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.539582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.539828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2024 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0
2025-10-10T14:36:28.540251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb72edde-2691a6fb-2459b39c-af1549a7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:28.543169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0] Write session: try to update token
2025-10-10T14:36:28.543190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:28.559755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:28.559778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:28.559781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:28.559784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:28.559794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601952456929198:4137]
2025-10-10T14:36:28.559799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601952456929198:4137]
2025-10-10T14:36:28.559802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601952456929198:4137]
2025-10-10T14:36:28.559853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:28.559868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.559870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:28.559870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:28.559880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:28.559886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:28.560024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:28.560584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId: src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:28.563577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:28.615239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601953239159118:5230]
2025-10-10T14:36:28.615576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2023, pipe: [1:7559601953239159118:5230]
2025-10-10T14:36:28.677089Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:28.677514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.677536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.677602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159118:5230], now have 1 active actors on pipe
2025-10-10T14:36:28.677997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:28.678015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601953239159118:5230]
2025-10-10T14:36:28.678047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:28.678050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:28.677844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:28.678129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2024 reason: error at write: Disconnected sessionId: src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0
2025-10-10T14:36:28.678361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2024 sessionId: src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0 is DEAD
2025-10-10T14:36:28.681434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:28.681448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0] Write session will restart in 0.005726s
2025-10-10T14:36:28.681490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0] Write session: Do CDS request
2025-10-10T14:36:28.681496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:28.689186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.689326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:28.689359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2025
2025-10-10T14:36:28.689522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.689583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:28.689589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:28.689593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:28.690082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2025 sessionId:  describe result for acl check
2025-10-10T14:36:28.690136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:28.690143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:28.690145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:28.690155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601953239159166:8684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:28.690789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601953239159166:8684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:28.693726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601953239159166:8684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:28.694321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:28.696318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:28.696579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:28.696594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:28.696607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:28.696724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601953239159166:8684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:28.696705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:28.696738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601953239159166:8684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:28.696758Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601952456929315:4129]
2025-10-10T14:36:28.696742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601953239159166:8684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:28.696751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:28.697393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:28.697786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:28.697851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:28.698213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:28.698278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.698287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.698289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.698290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.698291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.698293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.698294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.698295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.698297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.698298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.698300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.698302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.698303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.698310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.698323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.698327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.698331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.698335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.698338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.698343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.698347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.698351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.698358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.698361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.698364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.698368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.698387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.698396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.698403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.698408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.698413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.698418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.698423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.698429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.698435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.698440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.698445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.698450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.698456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.698461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.698468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.698473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.698486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.698491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.698496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.698501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.698506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.698511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.698516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.698521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.698525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.698529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.698566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:28.701258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:28.701978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:28.701996Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:28.701999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:28.702003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:28.702010Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2024 [2:7559601952456929315:4129]
2025-10-10T14:36:28.702029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:28.702051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:28.702055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.702059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.702062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.702083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:28.702097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:28.702106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:28.702174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.702181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.702183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.702186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:28.702267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:28.702275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.702289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.702301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.702317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:28.702347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159120:2438], now have 1 active actors on pipe
2025-10-10T14:36:28.702364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601952456929310:4129]
2025-10-10T14:36:28.702382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601952456929310:4129]
2025-10-10T14:36:28.702388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601952456929310:4129]
2025-10-10T14:36:28.702402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:28.702413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159226:8684], now have 1 active actors on pipe
2025-10-10T14:36:28.702418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:28.702422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:28.702422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:28.702425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:28.702438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:28.702447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:28.702455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2024
2025-10-10T14:36:28.702487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601952456929310:4129]
2025-10-10T14:36:28.702451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2024
2025-10-10T14:36:28.702501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:28.702519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:28.702683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.702697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.702734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41160d06-f441113-c593a01a-13b919f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:28.702750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.702764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.702767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:28.702781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.702794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:28.702810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.703113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.703122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.703141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.703322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2025 partition: 0 MaxSeqNo: 40 sessionId: src_id|41160d06-f441113-c593a01a-13b919f1_0
2025-10-10T14:36:28.703806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7ecda7-cafbf6c1-be581021-3ceba748_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|41160d06-f441113-c593a01a-13b919f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:28.706890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41160d06-f441113-c593a01a-13b919f1_0] Write session: try to update token
2025-10-10T14:36:28.706914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41160d06-f441113-c593a01a-13b919f1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:28.721484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:28.721510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:28.721523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601952456929310:4129]
2025-10-10T14:36:28.721587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:28.721779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:28.721944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:28.722095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:28.722242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:28.722262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId: src_id|41160d06-f441113-c593a01a-13b919f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:28.722614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:28.722670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:28.722863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:28.725050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:28.725282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.725309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.725362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:28.725451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:28.733984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:28.734011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:28.734015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:28.734018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:28.734030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601952456929310:4129]
2025-10-10T14:36:28.734034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601952456929310:4129]
2025-10-10T14:36:28.734037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601952456929310:4129]
2025-10-10T14:36:28.734081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:28.734086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:28.734092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.734094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:28.734095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:28.734099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:28.734238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:28.778196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601953239159258:5230]
2025-10-10T14:36:28.778533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2024, pipe: [1:7559601953239159258:5230]
2025-10-10T14:36:28.857534Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:28.866610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.866647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.866847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.866912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.866980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.867042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.867630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.867636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.867712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.867772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.867841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.867910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.867952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.867955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.868026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.868086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.868146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.868210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.868252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.868255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.868327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.868393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.868454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.868540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.868582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.868586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.868673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.868735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.868797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.868859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.868900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.868903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.868972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.869030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.869092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.869155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.869198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.869201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.869271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.871106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:28.871128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:28.871162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601953239159258:5230]
2025-10-10T14:36:28.871788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:28.871940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2025 reason: error at write: Disconnected sessionId: src_id|41160d06-f441113-c593a01a-13b919f1_0
2025-10-10T14:36:28.872151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2025 sessionId: src_id|41160d06-f441113-c593a01a-13b919f1_0 is DEAD
2025-10-10T14:36:28.872318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41160d06-f441113-c593a01a-13b919f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:28.872328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41160d06-f441113-c593a01a-13b919f1_0] Write session will restart in 0.009251s
2025-10-10T14:36:28.872357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41160d06-f441113-c593a01a-13b919f1_0] Write session: Do CDS request
2025-10-10T14:36:28.872365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41160d06-f441113-c593a01a-13b919f1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:28.869586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.869663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.869728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.869770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.869773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.869847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.869910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.869972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.870037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.870080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.870083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.870155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.870215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.870279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.870345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.870389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.870391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.870464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:28.870526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:28.870591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:28.870655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:28.870698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:28.870701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:28.870776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159258:5230], now have 1 active actors on pipe
2025-10-10T14:36:28.871377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:28.882937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41160d06-f441113-c593a01a-13b919f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.885494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:28.885513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2026
2025-10-10T14:36:28.889496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:28.889556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:28.889562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:28.889566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:28.886547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:28.889179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:28.889440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:28.889445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:28.889460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:28.889517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:28.889558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601952456929464:4106]
2025-10-10T14:36:28.890195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:28.890528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:28.890057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2026 sessionId:  describe result for acl check
2025-10-10T14:36:28.890093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:28.890095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:28.890097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:28.890104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601953239159347:8651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:28.890697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601953239159347:8651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:28.890584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:28.890905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:28.890963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.890964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.890965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.890967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.890968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.890969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.890971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.890972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.890974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.890975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.890976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.890978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.890979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.890984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.890996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.891000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.891005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.891009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.891012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.891015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.891020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.891023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.891028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.891032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.891036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.891040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.891047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.891056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:28.891063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.891069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:28.891214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.891228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:28.891234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.891239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:28.891246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.891252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:28.891266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.891276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:28.891282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.891292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:28.891297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.891301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:28.891305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.891309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:28.891313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.891318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:28.891322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.891326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.891331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.891336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.891340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.891346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.891400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:28.895433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:28.896077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:28.896094Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:28.896096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:28.896103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:28.896109Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2025 [2:7559601952456929464:4106]
2025-10-10T14:36:28.896122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:28.896141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:28.896165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.896169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.896172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.896190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:28.896198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:28.896206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:28.896270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.896276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.896277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.896280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:28.896352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:28.896356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.896367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:28.896378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:28.896393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:28.896414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601952456929459:4106]
2025-10-10T14:36:28.896417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601952456929459:4106]
2025-10-10T14:36:28.896419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601952456929459:4106]
2025-10-10T14:36:28.896430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:28.896440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:28.896444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:28.896446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:28.896449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:28.896465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:28.896468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:28.896479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159272:2438], now have 1 active actors on pipe
2025-10-10T14:36:28.896520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601952456929459:4106]
2025-10-10T14:36:28.896528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:28.896534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:28.895612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601953239159347:8651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:28.901667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2025
2025-10-10T14:36:28.908381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601953239159347:8651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:28.908406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601953239159347:8651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:28.908411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601953239159347:8651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:28.908421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:28.909823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2025
2025-10-10T14:36:28.913442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159383:8651], now have 1 active actors on pipe
2025-10-10T14:36:28.913492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.913504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.913546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:28.913561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:28.913568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:28.913571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:28.913588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:28.913612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:28.913636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.914007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:28.914015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:28.914042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:28.914196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2026 partition: 0 MaxSeqNo: 40 sessionId: src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0
2025-10-10T14:36:28.914706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41160d06-f441113-c593a01a-13b919f1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:28.917632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0] Write session: try to update token
2025-10-10T14:36:28.917659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:28.925989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:28.926017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:28.926021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:28.926024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:28.926037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601952456929459:4106]
2025-10-10T14:36:28.926041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601952456929459:4106]
2025-10-10T14:36:28.926045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601952456929459:4106]
2025-10-10T14:36:28.926100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:28.926113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:28.926116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:28.926291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:28.926478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:28.926485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:28.926489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:28.936031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId: src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:28.938806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:28.971176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601953239159400:5230]
2025-10-10T14:36:28.971474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2025, pipe: [1:7559601953239159400:5230]
2025-10-10T14:36:29.048651Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:29.049006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.049024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.049072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601953239159400:5230], now have 1 active actors on pipe
2025-10-10T14:36:29.049400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:29.049557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:29.049572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:29.049650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2026 reason: error at write: Disconnected sessionId: src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0
2025-10-10T14:36:29.049864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2026 sessionId: src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0 is DEAD
2025-10-10T14:36:29.050023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601953239159400:5230]
2025-10-10T14:36:29.050037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:29.053441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:29.053460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0] Write session will restart in 0.005530s
2025-10-10T14:36:29.053490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0] Write session: Do CDS request
2025-10-10T14:36:29.053501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:29.061925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.062006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:29.062024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2027
2025-10-10T14:36:29.062163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.062211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:29.062222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:29.062227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:29.062687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2027 sessionId:  describe result for acl check
2025-10-10T14:36:29.062731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:29.062733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:29.062735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:29.062741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601957534126722:8653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:29.063345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601957534126722:8653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:29.067299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601957534126722:8653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:29.067804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:29.070366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:29.070611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:29.070616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:29.070629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:29.070689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:29.070728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601956751896886:4108]
2025-10-10T14:36:29.071343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:29.071695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:29.071744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:29.072120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:29.072177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.072178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.072179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.072180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.072182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.072183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.072185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.072186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.072188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.072189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.072190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.072191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.072192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.072198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.072211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.072216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.072221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.072225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.072229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.072234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.072238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.072243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.072248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.072252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.072257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.072261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.072271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.072280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.072287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.072292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.072297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.072303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.072307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.072313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.072319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.072325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.072329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.072335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.072341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.072347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.072351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.072357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.072363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.072369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.072373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.072379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.072385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.072391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.072397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.072403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.072408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.072414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.072460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:29.075825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601957534126722:8653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:29.075846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601957534126722:8653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:29.075851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601957534126722:8653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:29.075862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:29.077193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:29.077740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:29.077760Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:29.077762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:29.077766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:29.077773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2026 [2:7559601956751896886:4108]
2025-10-10T14:36:29.077788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:29.077808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:29.077814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.077818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.077821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.077841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:29.077850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:29.077857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:29.077930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.077933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.077935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.077937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:29.078017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:29.078020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.078032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.078044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.078061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:29.078084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601956751896881:4108]
2025-10-10T14:36:29.078087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601956751896881:4108]
2025-10-10T14:36:29.078089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601956751896881:4108]
2025-10-10T14:36:29.078099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:29.078107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:29.078110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:29.078113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:29.078116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:29.078136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:29.078140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:29.078152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534126697:2438], now have 1 active actors on pipe
2025-10-10T14:36:29.078156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534126806:8653], now have 1 active actors on pipe
2025-10-10T14:36:29.078194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601956751896881:4108]
2025-10-10T14:36:29.078208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:29.078210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:29.078564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2026
2025-10-10T14:36:29.078603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2026
2025-10-10T14:36:29.082297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.082322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.082364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:29.082386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.082397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.082400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:29.082416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.082442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:29.082469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.089421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.089452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.089507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.089753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2027 partition: 0 MaxSeqNo: 40 sessionId: src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0
2025-10-10T14:36:29.090180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3a8046-a231de8-15d58b0d-8300c8ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:29.092918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0] Write session: try to update token
2025-10-10T14:36:29.092938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:29.108274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:29.108299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:29.108304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:29.108307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:29.108319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601956751896881:4108]
2025-10-10T14:36:29.108325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601956751896881:4108]
2025-10-10T14:36:29.108330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601956751896881:4108]
2025-10-10T14:36:29.108398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:29.108406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.108409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:29.108408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:29.108417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:29.108422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:29.108564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:29.121182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId: src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:29.123928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:29.150432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601957534126815:5230]
2025-10-10T14:36:29.150814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2026, pipe: [1:7559601957534126815:5230]
2025-10-10T14:36:29.224434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:29.224779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.224799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.224823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534126815:5230], now have 1 active actors on pipe
2025-10-10T14:36:29.225080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:29.225104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601957534126815:5230]
2025-10-10T14:36:29.225133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:29.225136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:29.225215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2027 reason: error at write: Disconnected sessionId: src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0
2025-10-10T14:36:29.225054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:29.225448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2027 sessionId: src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0 is DEAD
2025-10-10T14:36:29.229589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:29.229603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0] Write session will restart in 0.007479s
2025-10-10T14:36:29.229631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0] Write session: Do CDS request
2025-10-10T14:36:29.229641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:29.238431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.239884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:29.241517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:29.241544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2028
2025-10-10T14:36:29.241738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.241779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:29.241790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:29.241795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:29.242280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2028 sessionId:  describe result for acl check
2025-10-10T14:36:29.242378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:29.242471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:29.242480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:29.242482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:29.242490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601957534126894:8649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:29.242693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:29.242723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:29.243129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601957534126894:8649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:29.242758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:29.242870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:29.242935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601956751896999:4100]
2025-10-10T14:36:29.243643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:29.244349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:29.244436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:29.244834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:29.244911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.244918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.244919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.244921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.244922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.244924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.244925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.244927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.244929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.244930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.244932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.244934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.244935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.244944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.244957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.244962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.244967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.244971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.244975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.244989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.244993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.244997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.245002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.245006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.245011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.245015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.245023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.245031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.245039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.245046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.245051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.245057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.245062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.245068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.245073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.245078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.245083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.245089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.245094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.245105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.245109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.245115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.245120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.245127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.245132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.245137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.245143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.245150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.245155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.245161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.245170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.245180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.245223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:29.245616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601957534126894:8649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:29.248676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:29.249284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:29.249298Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:29.249301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:29.249305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:29.249313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2027 [2:7559601956751896999:4100]
2025-10-10T14:36:29.249343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:29.249365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:29.249374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.249381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.249383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.249404Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:29.249415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:29.249424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:29.249256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601957534126894:8649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:29.249274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601957534126894:8649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:29.249278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601957534126894:8649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:29.249288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:29.249493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.249502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.249504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.249507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:29.249673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2027
2025-10-10T14:36:29.249708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2027
2025-10-10T14:36:29.249588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:29.249597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.249611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.249622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.249637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:29.249663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534126927:8649], now have 1 active actors on pipe
2025-10-10T14:36:29.249667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534126816:2438], now have 1 active actors on pipe
2025-10-10T14:36:29.249675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601956751896994:4100]
2025-10-10T14:36:29.249677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601956751896994:4100]
2025-10-10T14:36:29.249679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601956751896994:4100]
2025-10-10T14:36:29.249695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:29.249710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:29.249712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:29.249714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:29.249716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:29.249730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:29.249734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:29.249775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601956751896994:4100]
2025-10-10T14:36:29.249784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:29.249799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:29.249803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.249808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.249870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:29.249878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.249884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.249886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:29.249899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.249912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:29.249936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.250146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.250164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.250198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.250334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2028 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0
2025-10-10T14:36:29.250713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55dd1a5a-5f0367b9-24953554-aa51fc20_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:29.253492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0] Write session: try to update token
2025-10-10T14:36:29.253513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:29.271444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:29.271475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:29.271479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:29.271481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:29.271493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601956751896994:4100]
2025-10-10T14:36:29.271499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601956751896994:4100]
2025-10-10T14:36:29.271505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601956751896994:4100]
2025-10-10T14:36:29.271569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:29.271589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.271591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:29.271781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:29.269201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId: src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:29.272260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:29.272457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:29.272476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:29.272481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:29.325490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601957534126935:5230]
2025-10-10T14:36:29.325886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2027, pipe: [1:7559601957534126935:5230]
2025-10-10T14:36:29.390977Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:29.391334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.391350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.391406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534126935:5230], now have 1 active actors on pipe
2025-10-10T14:36:29.391676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:29.393432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:29.391729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601957534126935:5230]
2025-10-10T14:36:29.393445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0] Write session will restart in 0.009609s
2025-10-10T14:36:29.391762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:29.391797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:29.393470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0] Write session: Do CDS request
2025-10-10T14:36:29.393477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:29.391883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2028 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0
2025-10-10T14:36:29.392075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2028 sessionId: src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0 is DEAD
2025-10-10T14:36:29.404022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.404202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:29.404219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2029
2025-10-10T14:36:29.404387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.404435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:29.404445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:29.404449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:29.404915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2029 sessionId:  describe result for acl check
2025-10-10T14:36:29.404955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:29.404963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:29.404965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:29.404971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601957534127013:8644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:29.404733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:29.405604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601957534127013:8644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:29.409251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601957534127013:8644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:29.407242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:29.407474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:29.407480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:29.407493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:29.407558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:29.407601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601956751897113:4098]
2025-10-10T14:36:29.408205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:29.408676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:29.408730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:29.409217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:29.409299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.409301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.409302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.409304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.409305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.409307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.409308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.409309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.409311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.409312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.409313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.409315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.409316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.409322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.409347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.409350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.409354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.409357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.409360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.409364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.409367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.409370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.409377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.409381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.409384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.409388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.409395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.409403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.409410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.409415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.409419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.409424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.409428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.409433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.409446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.409451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.409455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.409460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.409465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.409471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.409475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.409480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.409486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.409491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.409495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.409499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.409505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.409510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.409514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.409520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.409525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.409530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.409572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:29.412307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601957534127013:8644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:29.412322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601957534127013:8644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:29.412326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601957534127013:8644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:29.412335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:29.413244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2028
2025-10-10T14:36:29.413281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2028
2025-10-10T14:36:29.412337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:29.412828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:29.412834Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:29.412837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:29.412840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:29.412847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2028 [2:7559601956751897113:4098]
2025-10-10T14:36:29.412860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:29.412877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:29.412881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.412885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.412888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.412919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:29.412927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:29.412935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:29.412998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.413000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.413002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.413005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:29.413078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:29.413081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.413093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.413107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.413125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:29.413149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534126936:2438], now have 1 active actors on pipe
2025-10-10T14:36:29.413153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127047:8644], now have 1 active actors on pipe
2025-10-10T14:36:29.413161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601956751897108:4098]
2025-10-10T14:36:29.413163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601956751897108:4098]
2025-10-10T14:36:29.413165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601956751897108:4098]
2025-10-10T14:36:29.413180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:29.413197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:29.413215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:29.413219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:29.413245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601956751897108:4098]
2025-10-10T14:36:29.413247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:29.413302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:29.413306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:29.413309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:29.413317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:29.413750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.413766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.413809Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:29.413818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.413825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.413828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:29.413841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.413853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:29.413872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.414215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.414226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.414244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.414366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2029 partition: 0 MaxSeqNo: 40 sessionId: src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0
2025-10-10T14:36:29.417495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad25ade-87c5918e-8db39a71-bb666d2c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:29.420219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0] Write session: try to update token
2025-10-10T14:36:29.420245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:29.436568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:29.436587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:29.436608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601956751897108:4098]
2025-10-10T14:36:29.436664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:29.436669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:29.436847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:29.436998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:29.437142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:29.437281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:29.437526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:29.437581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:29.442748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId: src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:29.445676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:29.445975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.446018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.446063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:29.446228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:29.454515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:29.454542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:29.454546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:29.454549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:29.454562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601956751897108:4098]
2025-10-10T14:36:29.454568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601956751897108:4098]
2025-10-10T14:36:29.454572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601956751897108:4098]
2025-10-10T14:36:29.454633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:29.454635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:29.454640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:29.454644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:29.454647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.454650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:29.454796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:29.491922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601957534127055:5230]
2025-10-10T14:36:29.492297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2028, pipe: [1:7559601957534127055:5230]
2025-10-10T14:36:29.578425Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:29.587417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.587458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.587653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.587728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.587794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.587855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.587898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.587909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.587975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.588035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.588099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.588187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.588238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.588245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.588319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.588389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.588464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.588538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.588587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.588612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.588747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.588817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.588888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.589038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.589087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.589095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.589171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.589237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.589306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.589394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.589443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.589450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.589526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.589585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.589648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.589716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.589760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.589766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.589827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.589884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.589949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.590011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.590057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.590062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.590127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.590187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.590247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.590305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.590351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.590360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.590437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.590504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.590559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.590616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.590661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.590663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.590729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:29.590781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:29.590836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:29.590909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:29.590949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:29.590951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:29.591030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127055:5230], now have 1 active actors on pipe
2025-10-10T14:36:29.592412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:29.592426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0] Write session will restart in 0.007854s
2025-10-10T14:36:29.592452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0] Write session: Do CDS request
2025-10-10T14:36:29.592458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:29.591998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:29.592012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:29.592045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2029 reason: error at write: Disconnected sessionId: src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0
2025-10-10T14:36:29.592258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2029 sessionId: src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0 is DEAD
2025-10-10T14:36:29.592398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:29.592431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601957534127055:5230]
2025-10-10T14:36:29.592151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:29.601938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.602030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:29.602047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2030
2025-10-10T14:36:29.602209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.602251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:29.602258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:29.602263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:29.602781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2030 sessionId:  describe result for acl check
2025-10-10T14:36:29.602827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:29.602834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:29.602836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:29.602843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601957534127096:8635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:29.603524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601957534127096:8635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:29.606683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601957534127096:8635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:29.609323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:29.612864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:29.612998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601957534127096:8635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:29.613017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601957534127096:8635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:29.613021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601957534127096:8635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:29.613039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:29.613145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:29.613167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:29.613186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:29.613259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:29.613311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601956751897228:4093]
2025-10-10T14:36:29.613936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:29.614379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:29.614455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:29.614833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:29.614907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.614913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.614915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.614916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.614918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.614919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.614921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.614923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.614925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.614926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.614928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.614930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.614931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.614939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.614954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.614959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.614965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.614970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.614974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.614979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.614984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.614994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.614999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.615003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.615007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.615025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.615041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.615050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.615058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.615064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.615070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.615076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.615082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.615088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.615095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.615102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.615107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.615118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.615124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.615130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.615141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.615147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.615159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.615165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.615176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.615183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.615189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.615197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.615202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.615208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.615219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.615225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.615278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:29.618494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:29.618900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:29.618916Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:29.618919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:29.618924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:29.618932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2029 [2:7559601956751897228:4093]
2025-10-10T14:36:29.618955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:29.618981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:29.618989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.618993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.618996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.619028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:29.619037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:29.619045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:29.619120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.619128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.619131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.619134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:29.619210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:29.619222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.619236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.619248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.619267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:29.619293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601956751897222:4093]
2025-10-10T14:36:29.619302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601956751897222:4093]
2025-10-10T14:36:29.619305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601956751897222:4093]
2025-10-10T14:36:29.619315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:29.619327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:29.619331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:29.619333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:29.619334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:29.619350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:29.619353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:29.619365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127057:2438], now have 1 active actors on pipe
2025-10-10T14:36:29.619370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127164:8635], now have 1 active actors on pipe
2025-10-10T14:36:29.619410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601956751897222:4093]
2025-10-10T14:36:29.619421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:29.619428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:29.619874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2029
2025-10-10T14:36:29.619918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2029
2025-10-10T14:36:29.620114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.620126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.620165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:29.620175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.620179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.620183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:29.620199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.620216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:29.620240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.620503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.620511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.620525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.620651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2030 partition: 0 MaxSeqNo: 40 sessionId: src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0
2025-10-10T14:36:29.621103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2c55a8b-309d11cf-e3444f54-9882bf72_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:29.623989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0] Write session: try to update token
2025-10-10T14:36:29.624010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:29.641387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:29.641411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:29.641415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:29.641418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:29.641429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601956751897222:4093]
2025-10-10T14:36:29.641434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601956751897222:4093]
2025-10-10T14:36:29.641438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601956751897222:4093]
2025-10-10T14:36:29.641494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:29.641508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.641511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:29.641656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:29.643732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:29.643761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:29.643766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:29.645415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId: src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:29.648091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:29.691639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601957534127177:5230]
2025-10-10T14:36:29.691980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2029, pipe: [1:7559601957534127177:5230]
2025-10-10T14:36:29.765255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:29.765744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.765760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.765806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127177:5230], now have 1 active actors on pipe
2025-10-10T14:36:29.766290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:29.766305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:29.766375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2030 reason: error at write: Disconnected sessionId: src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0
2025-10-10T14:36:29.766578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2030 sessionId: src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0 is DEAD
2025-10-10T14:36:29.766775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601957534127177:5230]
2025-10-10T14:36:29.766817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:29.767088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:29.767100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0] Write session will restart in 0.007920s
2025-10-10T14:36:29.767125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0] Write session: Do CDS request
2025-10-10T14:36:29.767131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:29.766856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:29.777800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.781646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:29.782024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:29.782046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2031
2025-10-10T14:36:29.782345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.782387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:29.782398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:29.782402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:29.782824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2031 sessionId:  describe result for acl check
2025-10-10T14:36:29.782866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:29.782868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:29.782870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:29.782877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601957534127268:8632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:29.783498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601957534127268:8632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:29.784340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:29.784666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:29.784679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:29.784692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:29.784755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:29.784805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601956751897357:4085]
2025-10-10T14:36:29.785435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:29.785794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:29.785852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:29.786183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:29.786250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.786251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.786253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.786256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.786257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.786262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.786263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.786264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.786265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.786266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.786267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.786268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.786269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.786275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.786290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.786293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.786297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.786301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.786320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.786323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.786327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.786330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.786335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.786339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.786343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.786347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.786354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.786375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.786382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.786387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.786390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.786396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.786400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.786406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.786412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.786418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.786422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.786427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.786432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.786438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.786442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.786447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.786453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.786458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.786462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.786468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.786472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.786478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.786482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.786487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.786492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.786497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.786551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:29.787616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601957534127268:8632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:29.789062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:29.789531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:29.789544Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:29.789546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:29.789560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:29.789567Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2030 [2:7559601956751897357:4085]
2025-10-10T14:36:29.789582Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:29.789599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:29.789607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.789611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.789614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.789635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:29.789932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2030
2025-10-10T14:36:29.789642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:29.789657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:29.789718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.789720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.789722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.789725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:29.789792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:29.789795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.789807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.789818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.789836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:29.789860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127188:2438], now have 1 active actors on pipe
2025-10-10T14:36:29.789869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601956751897352:4085]
2025-10-10T14:36:29.789871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601956751897352:4085]
2025-10-10T14:36:29.789874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601956751897352:4085]
2025-10-10T14:36:29.789889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:29.789904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:29.789906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:29.789910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:29.789912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:29.789929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:29.789933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:29.789962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601956751897352:4085]
2025-10-10T14:36:29.789965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:29.789968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:29.793258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127317:8632], now have 1 active actors on pipe
2025-10-10T14:36:29.793424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.793438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.793472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:29.793503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.793568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.793576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:29.793591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.793611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:29.793630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.792764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601957534127268:8632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:29.792778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601957534127268:8632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:29.792782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601957534127268:8632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:29.792792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:29.793814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.793354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2030
2025-10-10T14:36:29.793822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.793840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.793957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2031 partition: 0 MaxSeqNo: 40 sessionId: src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0
2025-10-10T14:36:29.794346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a2f0d5-6cb90876-b41fd1b3-6d1fea03_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:29.797238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0] Write session: try to update token
2025-10-10T14:36:29.797257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:29.814431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:29.814456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:29.814459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:29.814461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:29.814472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601956751897352:4085]
2025-10-10T14:36:29.814476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601956751897352:4085]
2025-10-10T14:36:29.814479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601956751897352:4085]
2025-10-10T14:36:29.814531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:29.814537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:29.814540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.814542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:29.814544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:29.814549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:29.814681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:29.814845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId: src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:29.817712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:29.866687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601957534127333:5230]
2025-10-10T14:36:29.867099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2030, pipe: [1:7559601957534127333:5230]
2025-10-10T14:36:29.942136Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:29.942480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.942499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.942545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127333:5230], now have 1 active actors on pipe
2025-10-10T14:36:29.942913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:29.943223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:29.943246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0] Write session will restart in 0.005167s
2025-10-10T14:36:29.943274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0] Write session: Do CDS request
2025-10-10T14:36:29.943280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:29.942762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:29.942777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:29.942857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2031 reason: error at write: Disconnected sessionId: src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0
2025-10-10T14:36:29.943062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2031 sessionId: src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0 is DEAD
2025-10-10T14:36:29.943123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:29.943165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601957534127333:5230]
2025-10-10T14:36:29.949921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.950006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:29.950023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2032
2025-10-10T14:36:29.950782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:29.950832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:29.950838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:29.950843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:29.951274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2032 sessionId:  describe result for acl check
2025-10-10T14:36:29.951317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:29.951323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:29.951325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:29.951331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601957534127350:8615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:29.951820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601957534127350:8615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:29.953936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601957534127350:8615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:29.959151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601957534127350:8615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:29.959170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601957534127350:8615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:29.959174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601957534127350:8615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:29.959183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:29.960891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:29.963193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:29.963461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:29.963474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:29.963489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:29.963574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:29.963625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601956751897514:4071]
2025-10-10T14:36:29.964270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:29.964620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:29.964671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:29.965025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:29.965087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.965095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.965096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.965098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.965099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.965101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.965102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.965104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.965105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.965107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.965108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.965110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.965112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.965118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.965131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.965135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.965139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.965143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.965147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.965151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.965156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.965160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.965165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.965169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.965173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.965176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.965184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.965193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:29.965199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.965204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:29.965208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.965213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:29.965217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.965222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:29.965226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.965231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:29.965236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.965240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:29.965245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.965250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:29.965255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.965260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:29.965265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.965269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:29.965273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.965278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:29.965282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.965287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.965291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.965295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.965309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.965313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.965368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:29.967989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:29.968461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:29.968480Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:29.968482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:29.968487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:29.968494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2031 [2:7559601956751897514:4071]
2025-10-10T14:36:29.968527Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:29.968550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:29.968558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.968562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.968565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.968597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:29.968610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:29.968623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:29.968696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.968704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.968706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.968709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:29.968790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:29.968798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.968811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:29.968828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:29.968851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:29.968879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127453:8615], now have 1 active actors on pipe
2025-10-10T14:36:29.968889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601957534127334:2438], now have 1 active actors on pipe
2025-10-10T14:36:29.968897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601956751897509:4071]
2025-10-10T14:36:29.968901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601956751897509:4071]
2025-10-10T14:36:29.968903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601956751897509:4071]
2025-10-10T14:36:29.968919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:29.968933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:29.968935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:29.968936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:29.968939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:29.968953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:29.968957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:29.968989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601956751897509:4071]
2025-10-10T14:36:29.969001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:29.968952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2031
2025-10-10T14:36:29.969006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:29.969099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2031
2025-10-10T14:36:29.969198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.969214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.969248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:29.969261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:29.969271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:29.969273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:29.969286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:29.969303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:29.969378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.969651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.969664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.969684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:29.969799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2032 partition: 0 MaxSeqNo: 40 sessionId: src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0
2025-10-10T14:36:29.970254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c23a6e0-47644d11-f542220e-5c2b97c1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:29.973161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0] Write session: try to update token
2025-10-10T14:36:29.973185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:29.980665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:29.980688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:29.980698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601956751897509:4071]
2025-10-10T14:36:29.980739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:29.980746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:29.980923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:29.981079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:29.981217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:29.981376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:29.981565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:29.981626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:29.991691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId: src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:29.994511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:29.994793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:29.994820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:29.994861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:29.994949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:29.999211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:29.999237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:29.999240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:29.999242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:29.999254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601956751897509:4071]
2025-10-10T14:36:29.999258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601956751897509:4071]
2025-10-10T14:36:29.999263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601956751897509:4071]
2025-10-10T14:36:29.999313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:29.999314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:29.999323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:29.999326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:29.999327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:29.999328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:29.999466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:30.043370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601961829094763:5230]
2025-10-10T14:36:30.043721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2031, pipe: [1:7559601961829094763:5230]
2025-10-10T14:36:30.130346Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:30.132401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:36:30.132430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-10T14:36:30.139257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.139292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.139481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.139544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.139609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.139674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.140296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.140309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.140380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.140442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.140507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.140594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.140639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.140646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.140718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.140781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.140850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.140914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.140963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.140966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.141032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.141096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.141160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.141226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.141270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.141277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.141364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.141425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.141486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.141549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.141594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.141601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.141665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.141727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.141790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.141851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.141898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.141905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.141972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.142033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.142105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.142164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.142211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.142217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.142282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.142342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.142406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.142471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.142516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.142523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.142587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.142646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.142711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.142773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.142817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.142824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.142890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:30.142949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:30.143011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:30.143079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:30.143124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:30.143131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:30.143200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829094763:5230], now have 1 active actors on pipe
2025-10-10T14:36:30.143432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601961829094763:5230]
2025-10-10T14:36:30.143483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:30.143486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:30.143537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2032 reason: error at write: Disconnected sessionId: src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0
2025-10-10T14:36:30.143798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2032 sessionId: src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0 is DEAD
2025-10-10T14:36:30.143843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:30.143860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-10T14:36:30.143817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:30.145565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:30.145577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0] Write session will restart in 0.008796s
2025-10-10T14:36:30.145606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0] Write session: Do CDS request
2025-10-10T14:36:30.145626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:30.155977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.156015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:30.156033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2033
2025-10-10T14:36:30.156216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.156257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:30.156268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:30.156272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:30.156774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2033 sessionId:  describe result for acl check
2025-10-10T14:36:30.156823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:30.156830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:30.156832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:30.156839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601961829094847:8604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:30.157496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601961829094847:8604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:30.158127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:30.159963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601961829094847:8604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:30.160646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:30.160886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:30.160904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:30.160918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:30.160992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:30.161046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601961046864930:4063]
2025-10-10T14:36:30.161714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:30.162070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:30.162136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:30.162488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:30.162555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.162563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.162564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.162566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.162567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.162568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.162569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.162571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.162572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.162573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.162575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.162576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.162578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.162585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.162597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.162602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.162606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.162609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.162613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.162617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.162621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.162625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.162628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.162632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.162636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.162640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.162649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.162669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.162675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.162681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.162685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.162691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.162695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.162700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.162705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.162710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.162715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.162721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.162724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.162729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.162733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.162738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.162743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.162748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.162762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.162767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.162771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.162778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.162783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.162793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.162798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.162804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.162848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:30.162876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601961829094847:8604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:30.162892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601961829094847:8604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:30.162896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601961829094847:8604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:30.162905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:30.165709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:30.166234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:30.166246Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:30.166250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:30.166254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:30.166264Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2032 [2:7559601961046864930:4063]
2025-10-10T14:36:30.166281Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:30.166314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:30.166318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.166322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.166326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.166345Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:30.166357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:30.166365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:30.166729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2032
2025-10-10T14:36:30.166800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2032
2025-10-10T14:36:30.166443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.166451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.166453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.166456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:30.166538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:30.166541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.166555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.166568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.166587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:30.166609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601961046864925:4063]
2025-10-10T14:36:30.166611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601961046864925:4063]
2025-10-10T14:36:30.166613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601961046864925:4063]
2025-10-10T14:36:30.166627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:30.166642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:30.166644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829094881:8604], now have 1 active actors on pipe
2025-10-10T14:36:30.166645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:30.166648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:30.166650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829094768:2438], now have 1 active actors on pipe
2025-10-10T14:36:30.166658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:30.166676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:30.166681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:30.166716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601961046864925:4063]
2025-10-10T14:36:30.166725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:30.166742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:30.166761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.166767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.166800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:30.166810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.166814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.166817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:30.166831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.166842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:30.166876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.166938Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:36:30.167079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.167087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.167114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.167241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2033 partition: 0 MaxSeqNo: 40 sessionId: src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0
2025-10-10T14:36:30.167420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 14 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:36:30.167462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:36:30.167628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c556c07a-19245e4c-cdd962d9-71fe26e9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:30.170557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0] Write session: try to update token
2025-10-10T14:36:30.170578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:30.186045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId: src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:30.188940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:30.190049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.190081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.190107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:30.190110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:30.190114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:30.190116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:30.190126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601961046864925:4063]
2025-10-10T14:36:30.190131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601961046864925:4063]
2025-10-10T14:36:30.190135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601961046864925:4063]
2025-10-10T14:36:30.190187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:30.190198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:30.190203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:30.190206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.190208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:30.190209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:30.190348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:30.243571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601961829094893:5230]
2025-10-10T14:36:30.245271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2032, pipe: [1:7559601961829094893:5230]
2025-10-10T14:36:30.314838Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:30.315202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:30.315294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829094893:5230], now have 1 active actors on pipe
2025-10-10T14:36:30.316088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:30.317414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601961829094893:5230]
2025-10-10T14:36:30.317443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:30.328921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:30.328937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:30.328965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2033 reason: error at write: Disconnected sessionId: src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0
2025-10-10T14:36:30.329263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:30.329277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0] Write session will restart in 0.006162s
2025-10-10T14:36:30.329304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0] Write session: Do CDS request
2025-10-10T14:36:30.329310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:30.329302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2033 sessionId: src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0 is DEAD
2025-10-10T14:36:30.336908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.337621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:30.337638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2034
2025-10-10T14:36:30.337782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.337817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:30.337828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:30.337832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:30.338500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2034 sessionId:  describe result for acl check
2025-10-10T14:36:30.338540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:30.338546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:30.338548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:30.338555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601961829094925:8599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:30.339127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601961829094925:8599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:30.343671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601961829094925:8599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:30.348442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:30.349569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601961829094925:8599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:30.349588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601961829094925:8599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:30.349593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601961829094925:8599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:30.349605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:30.351737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:30.352023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:30.352037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:30.352051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:30.352121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:30.352185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601961046865052:4051]
2025-10-10T14:36:30.352870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:30.353415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:30.353482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:30.353874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:30.353952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.353960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.353961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.353963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.353975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.353976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.353978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.353980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.353982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.353983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.353985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.353986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.353988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.353996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.354010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.354015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.354020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.354024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.354029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.354034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.354038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.354043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.354051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.354055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.354059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.354064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.354074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.354086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.354100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.354108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.354118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.354125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.354136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.354143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.354149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.354156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.354166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.354174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.354185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.354191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.354201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.354207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.354213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.354219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.354225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.354232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.354244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.354251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.354256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.354262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.354268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.354274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.354320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:30.358045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:30.358432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:30.358455Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:30.358458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:30.358463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:30.358471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2033 [2:7559601961046865052:4051]
2025-10-10T14:36:30.358488Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:30.358508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:30.358512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.358516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.358520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.358538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:30.358554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:30.358579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:30.358659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.358668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.358671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.358675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:30.358755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:30.358770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.358784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.358797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.358815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:30.358848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829094900:2438], now have 1 active actors on pipe
2025-10-10T14:36:30.358858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095010:8599], now have 1 active actors on pipe
2025-10-10T14:36:30.358867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601961046865046:4051]
2025-10-10T14:36:30.358870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601961046865046:4051]
2025-10-10T14:36:30.358872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601961046865046:4051]
2025-10-10T14:36:30.358890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:30.358910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:30.358921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2033
2025-10-10T14:36:30.358929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:30.358937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:30.358965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:30.358968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:30.358970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:30.358973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601961046865046:4051]
2025-10-10T14:36:30.358976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:30.358978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:30.358967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2033
2025-10-10T14:36:30.359226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.359240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.359275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:30.359285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.359289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.359292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:30.359305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.359319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:30.359335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.359711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.359722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.359743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.359870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2034 partition: 0 MaxSeqNo: 40 sessionId: src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0
2025-10-10T14:36:30.360304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491d36b-aaef3ccc-a752eb5d-c2f964ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:30.363308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0] Write session: try to update token
2025-10-10T14:36:30.363332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:30.381733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId: src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:30.381905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:30.381923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:30.381927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:30.381929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:30.381939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601961046865046:4051]
2025-10-10T14:36:30.381943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601961046865046:4051]
2025-10-10T14:36:30.381949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601961046865046:4051]
2025-10-10T14:36:30.382008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:30.382017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:30.382019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.382022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:30.382025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:30.382030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:30.382170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:30.384305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:30.417633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601961829095022:5230]
2025-10-10T14:36:30.417940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2033, pipe: [1:7559601961829095022:5230]
2025-10-10T14:36:30.514277Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:30.514651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.514667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.514715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095022:5230], now have 1 active actors on pipe
2025-10-10T14:36:30.515005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601961829095022:5230]
2025-10-10T14:36:30.515044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:30.515121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2034 reason: status is not ok: tablet will be restarted right now sessionId: src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0
2025-10-10T14:36:30.514982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:30.515322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2034 sessionId: src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0 is DEAD
2025-10-10T14:36:30.515506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:30.515520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:30.515532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0] Write session will restart in 0.009513s
2025-10-10T14:36:30.515560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0] Write session: Do CDS request
2025-10-10T14:36:30.515566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:30.525850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.526002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:30.526019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2035
2025-10-10T14:36:30.526161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.526200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:30.526213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:30.526217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:30.526708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2035 sessionId:  describe result for acl check
2025-10-10T14:36:30.526764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:30.526766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:30.526768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:30.526774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601961829095040:8587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:30.527344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601961829095040:8587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:30.530389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601961829095040:8587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:30.530878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:30.532933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:30.533134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:30.533129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601961829095040:8587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:30.533149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:30.533146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601961829095040:8587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:30.533150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601961829095040:8587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:30.533160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:30.533161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:30.533212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:30.533255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601961046865172:4048]
2025-10-10T14:36:30.533890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:30.534214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:30.534265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:30.534647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:30.534699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.534706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.534707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.534708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.534710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.534711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.534712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.534714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.534715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.534716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.534718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.534719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.534720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.534727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.534741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.534745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.534750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.534754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.534758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.534763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.534767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.534771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.534776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.534780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.534784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.534788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.534796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.534805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.534811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.534817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.534822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.534832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.534837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.534847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.534852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.534858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.534863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.534868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.534877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.534883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.534887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.534893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.534898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.534908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.534912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.534922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.534927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.534933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.534937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.534943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.534948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.534953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.534999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:30.537431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:30.537860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:30.537874Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:30.537877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:30.537880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:30.537888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2034 [2:7559601961046865172:4048]
2025-10-10T14:36:30.537900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:30.537919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:30.537927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.537931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.537933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.537950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:30.537962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:30.537976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:30.538048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.538054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.538056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.538059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:30.538141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:30.538151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.538163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.538174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.538192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:30.538217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095138:8587], now have 1 active actors on pipe
2025-10-10T14:36:30.538226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095025:2438], now have 1 active actors on pipe
2025-10-10T14:36:30.538233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601961046865167:4048]
2025-10-10T14:36:30.538235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601961046865167:4048]
2025-10-10T14:36:30.538237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601961046865167:4048]
2025-10-10T14:36:30.538250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:30.538264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:30.538280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:30.538273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2034
2025-10-10T14:36:30.538286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:30.538290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2034
2025-10-10T14:36:30.538289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:30.538290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:30.538292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:30.538315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601961046865167:4048]
2025-10-10T14:36:30.538318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:30.538320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:30.538346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.538352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.538396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3706019d-6b9ac466-e27137e8-acab24eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:30.538408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.538412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.538414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:30.538425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.538435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:30.538453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.538589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.538596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.538611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.538698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2035 partition: 0 MaxSeqNo: 40 sessionId: src_id|3706019d-6b9ac466-e27137e8-acab24eb_0
2025-10-10T14:36:30.539103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|175fdfbd-cd70652b-bd4daab6-d4b83074_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3706019d-6b9ac466-e27137e8-acab24eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:30.541927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3706019d-6b9ac466-e27137e8-acab24eb_0] Write session: try to update token
2025-10-10T14:36:30.541963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3706019d-6b9ac466-e27137e8-acab24eb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:30.556243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId: src_id|3706019d-6b9ac466-e27137e8-acab24eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:30.558063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:30.558081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:30.558084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:30.558087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:30.558096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601961046865167:4048]
2025-10-10T14:36:30.558101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601961046865167:4048]
2025-10-10T14:36:30.558119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601961046865167:4048]
2025-10-10T14:36:30.558171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:30.558185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.558184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:30.558187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:30.558192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:30.558196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:30.558335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:30.558948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:30.615251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601961829095149:5230]
2025-10-10T14:36:30.615576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2034, pipe: [1:7559601961829095149:5230]
2025-10-10T14:36:30.673312Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:30.673677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.673696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.673757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095149:5230], now have 1 active actors on pipe
2025-10-10T14:36:30.674004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:30.674031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:30.674095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601961829095149:5230]
2025-10-10T14:36:30.674549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3706019d-6b9ac466-e27137e8-acab24eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:30.674558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3706019d-6b9ac466-e27137e8-acab24eb_0] Write session will restart in 0.005783s
2025-10-10T14:36:30.674583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3706019d-6b9ac466-e27137e8-acab24eb_0] Write session: Do CDS request
2025-10-10T14:36:30.674589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3706019d-6b9ac466-e27137e8-acab24eb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:30.674115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:30.674201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2035 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3706019d-6b9ac466-e27137e8-acab24eb_0
2025-10-10T14:36:30.674401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2035 sessionId: src_id|3706019d-6b9ac466-e27137e8-acab24eb_0 is DEAD
2025-10-10T14:36:30.682792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3706019d-6b9ac466-e27137e8-acab24eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.683647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:30.683663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2036
2025-10-10T14:36:30.683794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.683832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:30.683838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:30.683842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:30.684361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2036 sessionId:  describe result for acl check
2025-10-10T14:36:30.684400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:30.684402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:30.684404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:30.684411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601961829095232:8592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:30.685024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601961829095232:8592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:30.685377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:30.687504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:30.687702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:30.687712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:30.687700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601961829095232:8592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:30.687723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:30.687783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:30.687823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601961046865294:4040]
2025-10-10T14:36:30.688534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:30.688836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:30.688873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:30.689207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:30.689257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.689263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.689264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.689265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.689266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.689267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.689268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.689270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.689271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.689272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.689273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.689274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.689276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.689281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.689302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.689306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.689310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.689314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.689319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.689323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.689327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.689346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.689352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.689356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.689359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.689363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.689371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.689379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.689386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.689391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.689396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.689402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.689407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.689413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.689417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.689428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.689432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.689437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.689443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.689456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.689460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.689466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.689470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.689476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.689484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.689490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.689498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.689504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.689508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.689518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.689522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.689528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.689573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:30.694110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601961829095232:8592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:30.694143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601961829095232:8592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:30.694148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601961829095232:8592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:30.694159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:30.697661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:30.698198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:30.698212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:30.698214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:30.698219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:30.698229Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2035 [2:7559601961046865294:4040]
2025-10-10T14:36:30.698245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:30.698263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:30.698271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.698275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.698277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.698297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:30.698305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:30.698317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:30.698377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.698383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.698386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.698388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:30.698463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:30.698469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.698481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.698499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.698520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:30.698547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095151:2438], now have 1 active actors on pipe
2025-10-10T14:36:30.698554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095269:8592], now have 1 active actors on pipe
2025-10-10T14:36:30.698562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601961046865288:4040]
2025-10-10T14:36:30.698564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601961046865288:4040]
2025-10-10T14:36:30.698567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601961046865288:4040]
2025-10-10T14:36:30.698580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:30.698594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:30.698598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:30.698603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:30.698605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:30.698614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:30.698617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:30.698657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601961046865288:4040]
2025-10-10T14:36:30.698670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:30.698693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:30.698736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2035
2025-10-10T14:36:30.698749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2035
2025-10-10T14:36:30.698901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.698926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.698963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e8e4156-99de19a6-f8f81086-9956da94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:30.698991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.699003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.699009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:30.699023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.699041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:30.699064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.699257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.699267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.699285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.699426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2036 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e8e4156-99de19a6-f8f81086-9956da94_0
2025-10-10T14:36:30.699858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3706019d-6b9ac466-e27137e8-acab24eb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e8e4156-99de19a6-f8f81086-9956da94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:30.702760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8e4156-99de19a6-f8f81086-9956da94_0] Write session: try to update token
2025-10-10T14:36:30.702783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8e4156-99de19a6-f8f81086-9956da94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:30.721441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId: src_id|9e8e4156-99de19a6-f8f81086-9956da94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:30.722382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:30.722401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:30.722405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:30.722408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:30.722421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601961046865288:4040]
2025-10-10T14:36:30.722426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601961046865288:4040]
2025-10-10T14:36:30.722429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601961046865288:4040]
2025-10-10T14:36:30.722479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:30.722487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.722490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:30.722481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:30.722499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:30.722504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:30.722637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:30.724285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:30.774501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601961829095284:5230]
2025-10-10T14:36:30.774849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2035, pipe: [1:7559601961829095284:5230]
2025-10-10T14:36:30.856372Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:30.856644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.856659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.856705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095284:5230], now have 1 active actors on pipe
2025-10-10T14:36:30.856923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:30.856954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601961829095284:5230]
2025-10-10T14:36:30.856989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:30.857028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:30.857115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2036 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e8e4156-99de19a6-f8f81086-9956da94_0
2025-10-10T14:36:30.857518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8e4156-99de19a6-f8f81086-9956da94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:30.857533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8e4156-99de19a6-f8f81086-9956da94_0] Write session will restart in 0.009260s
2025-10-10T14:36:30.857560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8e4156-99de19a6-f8f81086-9956da94_0] Write session: Do CDS request
2025-10-10T14:36:30.857565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8e4156-99de19a6-f8f81086-9956da94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:30.857365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2036 sessionId: src_id|9e8e4156-99de19a6-f8f81086-9956da94_0 is DEAD
2025-10-10T14:36:30.867895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8e4156-99de19a6-f8f81086-9956da94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.868131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:30.868149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2037
2025-10-10T14:36:30.868270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:30.868300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:30.868305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:30.868309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:30.868933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2037 sessionId:  describe result for acl check
2025-10-10T14:36:30.868975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:30.868977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:30.868980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:30.868987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601961829095328:8576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:30.869631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601961829095328:8576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:30.872848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601961829095328:8576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:30.874556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:30.876309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:30.876638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:30.876650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:30.876662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:30.876715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:30.876748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601961046865430:4026]
2025-10-10T14:36:30.877205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:30.877526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:30.877568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:30.877800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:30.877842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.877848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.877849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.877850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.877851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.877852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.877854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.877855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.877856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.877857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.877858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.877860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.877861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.877868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.877878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.877880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.877882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.877885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.877887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.877889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.877891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.877893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.877896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.877898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.877900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.877902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.877907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.877913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:30.877918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.877921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:30.877924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.877927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:30.877930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.877934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:30.877937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.877940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:30.877942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.877945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:30.877948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.877951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:30.877954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.877957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:30.877965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.877969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:30.877971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.877975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:30.877977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.877980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.877984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.877987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.877990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.877993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.878017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:30.880887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:30.881229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:30.881240Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:30.881242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:30.881245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:30.881250Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2036 [2:7559601961046865430:4026]
2025-10-10T14:36:30.881260Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:30.881275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:30.881277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.881279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.881281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.881296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:30.881302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:30.881314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:30.881394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.881402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.881406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.881410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:30.881486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:30.881494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.881505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:30.881514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:30.881532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:30.881559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095300:2438], now have 1 active actors on pipe
2025-10-10T14:36:30.881568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601961046865425:4026]
2025-10-10T14:36:30.881570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601961046865425:4026]
2025-10-10T14:36:30.881572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601961046865425:4026]
2025-10-10T14:36:30.881584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:30.881537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2036
2025-10-10T14:36:30.881598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:30.881598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:30.881601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:30.881603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:30.881620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:30.881623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:30.881660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601961046865425:4026]
2025-10-10T14:36:30.881673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:30.881684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:30.882629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601961829095328:8576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:30.882644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601961829095328:8576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:30.882648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601961829095328:8576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:30.882657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:30.884577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095422:8576], now have 1 active actors on pipe
2025-10-10T14:36:30.884709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2036
2025-10-10T14:36:30.884785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.884814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.884850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:30.884862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:30.884869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:30.884872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:30.884885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:30.884904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:30.884925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.885132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:30.885143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:30.885159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:30.885663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2037 partition: 0 MaxSeqNo: 40 sessionId: src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0
2025-10-10T14:36:30.886216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8e4156-99de19a6-f8f81086-9956da94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:30.888936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0] Write session: try to update token
2025-10-10T14:36:30.888954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:30.904803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:30.904821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:30.904825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:30.904827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:30.904838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601961046865425:4026]
2025-10-10T14:36:30.904843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601961046865425:4026]
2025-10-10T14:36:30.904848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601961046865425:4026]
2025-10-10T14:36:30.904900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:30.904906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:30.904912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:30.904914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:30.904915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:30.904918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:30.905059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:30.908021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId: src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:30.910901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:30.957247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601961829095449:5230]
2025-10-10T14:36:30.957723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2036, pipe: [1:7559601961829095449:5230]
2025-10-10T14:36:31.020722Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:31.021033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.021046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.021088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601961829095449:5230], now have 1 active actors on pipe
2025-10-10T14:36:31.021888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:31.021403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:31.021419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:31.021495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2037 reason: error at write: Disconnected sessionId: src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0
2025-10-10T14:36:31.021707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2037 sessionId: src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0 is DEAD
2025-10-10T14:36:31.021872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601961829095449:5230]
2025-10-10T14:36:31.021891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:31.022076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:31.022083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0] Write session will restart in 0.005275s
2025-10-10T14:36:31.022109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0] Write session: Do CDS request
2025-10-10T14:36:31.022117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:31.029825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.030892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:31.030910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2038
2025-10-10T14:36:31.031212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.031254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:31.031262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:31.031266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:31.031607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2038 sessionId:  describe result for acl check
2025-10-10T14:36:31.031628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:31.031630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:31.031631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:31.031635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601966124062760:8565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:31.032109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601966124062760:8565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:31.034645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601966124062760:8565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:31.037375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601966124062760:8565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:31.037394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601966124062760:8565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:31.037398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601966124062760:8565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:31.037407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:31.038650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:31.040391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:31.040675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:31.040689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:31.040705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:31.040774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:31.040819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601965341832890:3998]
2025-10-10T14:36:31.041496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:31.041819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:31.041870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:31.042201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:31.042281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.042287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.042289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.042290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.042291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.042292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.042293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.042294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.042295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.042297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.042298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.042299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.042300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.042306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.042318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.042322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.042327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.042331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.042335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.042339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.042343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.042347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.042353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.042356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.042360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.042363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.042371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.042379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.042385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.042391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.042396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.042402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.042408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.042414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.042419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.042423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.042428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.042434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.042439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.042445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.042452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.042458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.042463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.042469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.042474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.042480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.042485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.042496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.042501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.042511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.042516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.042521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.042564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:31.046259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:31.046655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:31.046668Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:31.046671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:31.046675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:31.046683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2037 [2:7559601965341832890:3998]
2025-10-10T14:36:31.046698Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:31.046719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:31.046728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.046733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.046735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.046753Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:31.046766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:31.046781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:31.046851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.046859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.046860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.046866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:31.046938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:31.046945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.046966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.046983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.047004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:31.047030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601965341832885:3998]
2025-10-10T14:36:31.047037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601965341832885:3998]
2025-10-10T14:36:31.047039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601965341832885:3998]
2025-10-10T14:36:31.047054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:31.047072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:31.047093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:31.047105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:31.047115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:31.047124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:31.047126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:31.047138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601965341832885:3998]
2025-10-10T14:36:31.047145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:31.047221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:31.047474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124062860:8565], now have 1 active actors on pipe
2025-10-10T14:36:31.047487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124062747:2438], now have 1 active actors on pipe
2025-10-10T14:36:31.047474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2037
2025-10-10T14:36:31.047514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2037
2025-10-10T14:36:31.047586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.047596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.047628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:31.047642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.047651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.047653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:31.047665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.047678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:31.047699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.048026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.048037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.048062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.048160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2038 partition: 0 MaxSeqNo: 40 sessionId: src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0
2025-10-10T14:36:31.049495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3eaadf3-5a55984b-9258f090-1fdab1ed_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:31.052403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0] Write session: try to update token
2025-10-10T14:36:31.052425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:31.071919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:31.071936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.071948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601965341832885:3998]
2025-10-10T14:36:31.072004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:31.072010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:31.072184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:31.072325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.072462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.072611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.072797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:31.072854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:31.084850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:31.084866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.084870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:31.084872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:31.084884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601965341832885:3998]
2025-10-10T14:36:31.084889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601965341832885:3998]
2025-10-10T14:36:31.084893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601965341832885:3998]
2025-10-10T14:36:31.084943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:31.084943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:31.084951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.084952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:31.084953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:31.084956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:31.085103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:31.086790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId: src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:31.089548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:31.122123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601966124062874:5230]
2025-10-10T14:36:31.122412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2037, pipe: [1:7559601966124062874:5230]
2025-10-10T14:36:31.206027Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:31.206482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.206492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.206518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124062874:5230], now have 1 active actors on pipe
2025-10-10T14:36:31.206905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601966124062874:5230]
2025-10-10T14:36:31.206939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:31.207294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:31.207385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2038 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0
2025-10-10T14:36:31.207596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2038 sessionId: src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0 is DEAD
2025-10-10T14:36:31.207762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:31.207774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0] Write session will restart in 0.008903s
2025-10-10T14:36:31.207800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0] Write session: Do CDS request
2025-10-10T14:36:31.207806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:31.206758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:31.217928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.218063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:31.218080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2039
2025-10-10T14:36:31.218244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.218288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:31.218299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:31.218302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:31.218849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2039 sessionId:  describe result for acl check
2025-10-10T14:36:31.218886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:31.218892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:31.218893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:31.218902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601966124062914:8558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:31.219438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601966124062914:8558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:31.222305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601966124062914:8558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:31.222424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:31.224375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:31.224606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:31.224613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:31.224626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:31.224682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:31.224720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601965341833014:3999]
2025-10-10T14:36:31.225267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:31.225708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:31.225769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:31.226160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:31.226236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.226237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.226239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.226240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.226241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.226243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.226244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.226246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.226247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.226248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.226250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.226251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.226253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.226259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.226274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.226279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.226283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.226288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.226293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.226297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.226302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.226306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.226310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.226314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.226318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.226323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.226331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.226341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.226348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.226355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.226361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.226367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.226371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.226378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.226384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.226390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.226395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.226401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.226406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.226412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.226417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.226423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.226429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.226435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.226439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.226445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.226450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.226456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.226472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.226478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.226484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.226490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.226533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:31.226420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601966124062914:8558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:31.226439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601966124062914:8558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:31.226443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601966124062914:8558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:31.226454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:31.230103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:31.230475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:31.230490Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:31.230493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:31.230497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:31.230505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2038 [2:7559601965341833014:3999]
2025-10-10T14:36:31.230522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:31.230542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:31.230551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.230556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.230558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.230578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:31.230591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:31.230599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:31.230666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.230674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.230677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.230680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:31.230908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:31.230918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.230933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.230949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.230976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:31.231004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601965341833009:3999]
2025-10-10T14:36:31.231013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601965341833009:3999]
2025-10-10T14:36:31.231015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601965341833009:3999]
2025-10-10T14:36:31.231032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:31.231051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:31.231072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:31.231080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:31.231088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:31.231099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:31.231101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:31.231120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601965341833009:3999]
2025-10-10T14:36:31.231123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:31.231196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:31.231641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124062877:2438], now have 1 active actors on pipe
2025-10-10T14:36:31.231653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124062995:8558], now have 1 active actors on pipe
2025-10-10T14:36:31.231953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.231968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.232010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6cbbce4-449468b-d100f003-cdb3347c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:31.232028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.232037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.232040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:31.232063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.232084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:31.232109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.232320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.232328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.232347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.232907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f1b734-b19635c3-5c025ad7-6b1b85e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c6cbbce4-449468b-d100f003-cdb3347c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:31.231798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2038
2025-10-10T14:36:31.231843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2038
2025-10-10T14:36:31.232446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2039 partition: 0 MaxSeqNo: 40 sessionId: src_id|c6cbbce4-449468b-d100f003-cdb3347c_0
2025-10-10T14:36:31.235804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cbbce4-449468b-d100f003-cdb3347c_0] Write session: try to update token
2025-10-10T14:36:31.235826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cbbce4-449468b-d100f003-cdb3347c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:31.257470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId: src_id|c6cbbce4-449468b-d100f003-cdb3347c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:31.260401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:31.262068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.262095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.262123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:31.262127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.262131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:31.262133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:31.262143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601965341833009:3999]
2025-10-10T14:36:31.262149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601965341833009:3999]
2025-10-10T14:36:31.262154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601965341833009:3999]
2025-10-10T14:36:31.262241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:31.262255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.262258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:31.262414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:31.264162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:31.264176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:31.264181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:31.306974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601966124063006:5230]
2025-10-10T14:36:31.307305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2038, pipe: [1:7559601966124063006:5230]
2025-10-10T14:36:31.382589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:31.382888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601966124063006:5230]
2025-10-10T14:36:31.382917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:31.381942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:31.382258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:31.382314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063006:5230], now have 1 active actors on pipe
2025-10-10T14:36:31.403085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cbbce4-449468b-d100f003-cdb3347c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:31.403101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cbbce4-449468b-d100f003-cdb3347c_0] Write session will restart in 0.005994s
2025-10-10T14:36:31.403127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cbbce4-449468b-d100f003-cdb3347c_0] Write session: Do CDS request
2025-10-10T14:36:31.403133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cbbce4-449468b-d100f003-cdb3347c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:31.401723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:31.401739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:31.401768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2039 reason: error at write: Disconnected sessionId: src_id|c6cbbce4-449468b-d100f003-cdb3347c_0
2025-10-10T14:36:31.401924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2039 sessionId: src_id|c6cbbce4-449468b-d100f003-cdb3347c_0 is DEAD
2025-10-10T14:36:31.412074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cbbce4-449468b-d100f003-cdb3347c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.412074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:31.412872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:31.412888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2040
2025-10-10T14:36:31.413062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.413100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:31.413114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:31.413123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:31.413634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2040 sessionId:  describe result for acl check
2025-10-10T14:36:31.413674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:31.413676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:31.413678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:31.413684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601966124063100:8547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:31.414282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601966124063100:8547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:31.416248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:31.416498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:31.416502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:31.416512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:31.416596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:31.416640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601965341833141:3995]
2025-10-10T14:36:31.417224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:31.420826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601966124063100:8547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:31.422602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:31.422726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:31.423243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:31.423309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.423316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.423318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.423319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.423321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.423322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.423324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.423327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.423327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.423328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.423329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.423330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.423331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.423336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.423349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.423353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.423356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.423359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.423363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.423366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.423370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.423373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.423378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.423381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.423385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.423388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.423398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.423408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.423414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.423421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.423425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.423431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.423435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.423440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.423444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.423449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.423454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.423459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.423463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.423469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.423475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.423481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.423486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.423491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.423495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.423499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.423505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.423511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.423515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.423521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.423526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.423530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.423564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:31.424445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601966124063100:8547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:31.424464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601966124063100:8547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:31.424468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601966124063100:8547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:31.424477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:31.426675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:31.427428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:31.427445Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:31.427448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:31.427453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:31.427460Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2039 [2:7559601965341833141:3995]
2025-10-10T14:36:31.427477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:31.427501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:31.427513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.427517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.427520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.427541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:31.427555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:31.427582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:31.427668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.427676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.427679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.427681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:31.427775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:31.427778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.427798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.427820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.427850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:31.427883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601965341833136:3995]
2025-10-10T14:36:31.427891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601965341833136:3995]
2025-10-10T14:36:31.427893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601965341833136:3995]
2025-10-10T14:36:31.427912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:31.427929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:31.427933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:31.427935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063010:2438], now have 1 active actors on pipe
2025-10-10T14:36:31.427935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:31.427942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:31.427963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:31.427969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:31.427983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063132:8547], now have 1 active actors on pipe
2025-10-10T14:36:31.428028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601965341833136:3995]
2025-10-10T14:36:31.428043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:31.428226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:31.428681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2039
2025-10-10T14:36:31.428744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2039
2025-10-10T14:36:31.428815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.428833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.428873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:31.428897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.428902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.428906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:31.428922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.428939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:31.428962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.429150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.429160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.429177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.429262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2040 partition: 0 MaxSeqNo: 40 sessionId: src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0
2025-10-10T14:36:31.429739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cbbce4-449468b-d100f003-cdb3347c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:31.432597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0] Write session: try to update token
2025-10-10T14:36:31.432620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:31.444099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:31.444119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.444131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601965341833136:3995]
2025-10-10T14:36:31.444181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:31.444187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:31.444385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:31.444539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.444709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.444871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.445075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:31.445117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:31.457817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId: src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:31.460726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:31.460989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.461027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.461085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:31.461383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:31.467861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:31.467880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.467884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:31.467886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:31.467898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601965341833136:3995]
2025-10-10T14:36:31.467903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601965341833136:3995]
2025-10-10T14:36:31.467907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601965341833136:3995]
2025-10-10T14:36:31.467965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:31.467974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.467978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:31.467979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:31.467987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:31.468001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:31.468125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:31.485482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601966124063141:5230]
2025-10-10T14:36:31.485964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2039, pipe: [1:7559601966124063141:5230]
2025-10-10T14:36:31.590282Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:31.590686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063141:5230], now have 1 active actors on pipe
2025-10-10T14:36:31.599098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.599134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.599340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.599414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.599490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.599564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.599622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.599636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.599719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.599793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.599930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.600007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.600064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.600073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.600156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.600227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.600297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.600370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.600417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.600420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.600503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.600591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.600658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.600720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.600764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.600767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.600849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.600914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.600988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.601059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.601178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.601182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.601258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.601324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.601565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.601639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.601680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.601683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.601760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.601820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.601885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.601944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.601985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.601988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.602059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.602123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.602188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.602256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.602312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.602316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.602411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.602478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.602557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.602628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.602754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.602759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.602847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.602915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.602985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.603053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.603094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.603098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.604663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:31.605155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:31.605168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0] Write session will restart in 0.005708s
2025-10-10T14:36:31.605194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0] Write session: Do CDS request
2025-10-10T14:36:31.605200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:31.604663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601966124063141:5230]
2025-10-10T14:36:31.604697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:31.604741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:31.604744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:31.604783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2040 reason: error at write: Disconnected sessionId: src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0
2025-10-10T14:36:31.605003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2040 sessionId: src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0 is DEAD
2025-10-10T14:36:31.611925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.612048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:31.612065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2041
2025-10-10T14:36:31.612614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.612660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:31.612670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:31.612675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:31.613131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2041 sessionId:  describe result for acl check
2025-10-10T14:36:31.613164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:31.613170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:31.613172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:31.613179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601966124063158:8541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:31.613781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601966124063158:8541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:31.616967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601966124063158:8541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:31.618213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:31.620409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601966124063158:8541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:31.620424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601966124063158:8541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:31.620429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601966124063158:8541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:31.620437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:31.620735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:31.620949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:31.620961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:31.620971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:31.621023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:31.621067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601965341833270:3987]
2025-10-10T14:36:31.621675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:31.622125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:31.622167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:31.622477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:31.622527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.622529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.622530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.622531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.622532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.622533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.622534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.622535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.622536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.622537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.622538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.622539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.622540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.622547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.622559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.622563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.622566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.622570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.622573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.622577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.622580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.622584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.622587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.622591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.622594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.622598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.622605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.622613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.622619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.622625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.622629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.622634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.622638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.622643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.622648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.622652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.622655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.622660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.622665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.622669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.622674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.622679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.622684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.622689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.622693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.622697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.622702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.622707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.622711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.622717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.622721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.622726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.622764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:31.625362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:31.625906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:31.625920Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:31.625922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:31.625925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:31.625931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2040 [2:7559601965341833270:3987]
2025-10-10T14:36:31.625940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:31.625955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:31.625969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.625975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.625978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.625992Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:31.626005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:31.626014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:31.626077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.626085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.626086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.626089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:31.626165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:31.626171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.626182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.626192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.626212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:31.626238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601965341833264:3987]
2025-10-10T14:36:31.626245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601965341833264:3987]
2025-10-10T14:36:31.626247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601965341833264:3987]
2025-10-10T14:36:31.626265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:31.626276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:31.626282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063143:2438], now have 1 active actors on pipe
2025-10-10T14:36:31.626284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:31.626286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:31.626286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063260:8541], now have 1 active actors on pipe
2025-10-10T14:36:31.626295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:31.626310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:31.626313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:31.626342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601965341833264:3987]
2025-10-10T14:36:31.626355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:31.626334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2040
2025-10-10T14:36:31.626336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2040
2025-10-10T14:36:31.626373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:31.626397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.626407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.626438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:31.626453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.626463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.626466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:31.626477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.626492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:31.626509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.626691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.626702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.626724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.626847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2041 partition: 0 MaxSeqNo: 40 sessionId: src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0
2025-10-10T14:36:31.627227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf2285b-857850da-cccf3fd2-9fefe0a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:31.630399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0] Write session: try to update token
2025-10-10T14:36:31.630427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:31.638539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:31.638557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.638571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601965341833264:3987]
2025-10-10T14:36:31.638616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:31.638633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:31.638813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:31.638973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.639123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.639270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.639478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:31.639525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:31.647268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId: src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:31.650479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.650503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.650551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:31.650179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:31.650653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:31.657444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:31.657461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.657464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:31.657466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:31.657479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601965341833264:3987]
2025-10-10T14:36:31.657484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601965341833264:3987]
2025-10-10T14:36:31.657492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601965341833264:3987]
2025-10-10T14:36:31.657543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:31.657558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:31.657561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.657564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:31.657566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:31.657568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:31.657715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:31.705450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601966124063276:5230]
2025-10-10T14:36:31.705757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2040, pipe: [1:7559601966124063276:5230]
2025-10-10T14:36:31.775540Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:31.784595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.784625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.784828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.784901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.784972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.785048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.785101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.785111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.785189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.785257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.788558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:31.788574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:31.788609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2041 reason: error at write: Disconnected sessionId: src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0
2025-10-10T14:36:31.788826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2041 sessionId: src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0 is DEAD
2025-10-10T14:36:31.789036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601966124063276:5230]
2025-10-10T14:36:31.789063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:31.789424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:31.789437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0] Write session will restart in 0.007187s
2025-10-10T14:36:31.789467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0] Write session: Do CDS request
2025-10-10T14:36:31.789474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:31.785349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.785440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.785487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.785490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.785564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.785628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.785691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.785755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.785799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.785801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.785873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.785939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.786079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.786141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.786189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.786192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.786266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.786327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.786392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.786456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.786499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.786502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.786577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.786637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.786705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.786771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.786816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.786818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.786917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.786980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.787051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.787120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.787164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.787171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.787249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.787315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.787382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.787449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.787494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.787497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.787569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.787630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.787690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.787754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.787795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.787798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.787870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.787930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.787997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.788060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.788101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.788103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.788179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063276:5230], now have 1 active actors on pipe
2025-10-10T14:36:31.789899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:31.797936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.798021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:31.798046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2042
2025-10-10T14:36:31.798201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:31.798238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:31.798249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:31.798253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:31.798780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2042 sessionId:  describe result for acl check
2025-10-10T14:36:31.798823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:31.798829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:31.798834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:31.798840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601966124063299:8534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:31.799418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601966124063299:8534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:31.802664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601966124063299:8534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:31.805925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:31.806328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601966124063299:8534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:31.806348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601966124063299:8534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:31.806352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601966124063299:8534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:31.806363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:31.808747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:31.809009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:31.809023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:31.809036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:31.809092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:31.809136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601965341833398:3991]
2025-10-10T14:36:31.809766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:31.810113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:31.810177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:31.810501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:31.810566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.810567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.810568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.810569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.810571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.810572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.810573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.810574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.810575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.810576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.810578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.810579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.810580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.810585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.810599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.810603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.810607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.810610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.810614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.810618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.810622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.810625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.810629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.810633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.810638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.810642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.810649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.810658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:31.810664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.810669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:31.810677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.810682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:31.810693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.810697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:31.810702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.810707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:31.810716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.810723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:31.810732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.810737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:31.810742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.810747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:31.810757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.810762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:31.810772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.810777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:31.810787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.810793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.810802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.810808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.810817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.810823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.810865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:31.814372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:31.814943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:31.814958Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:31.814961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:31.814965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:31.814973Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2041 [2:7559601965341833398:3991]
2025-10-10T14:36:31.814988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:31.815005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:31.815009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.815013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.815015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.815034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:31.815047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:31.815060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:31.815125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.815133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.815136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.815139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:31.815783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2041
2025-10-10T14:36:31.815832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2041
2025-10-10T14:36:31.816453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2042 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0
2025-10-10T14:36:31.816870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5aad979-69a9cbba-10ca8178-b441bbf3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:31.815216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:31.815227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.815240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:31.815255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:31.815274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:31.815298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601965341833392:3991]
2025-10-10T14:36:31.815301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601965341833392:3991]
2025-10-10T14:36:31.815305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601965341833392:3991]
2025-10-10T14:36:31.815320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:31.815338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063405:8534], now have 1 active actors on pipe
2025-10-10T14:36:31.815355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063284:2438], now have 1 active actors on pipe
2025-10-10T14:36:31.815363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:31.815382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:31.815387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:31.815413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601965341833392:3991]
2025-10-10T14:36:31.815416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:31.815562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:31.815565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:31.815567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:31.815574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:31.816055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.816064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.816100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:31.816112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:31.816117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:31.816120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:31.816136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:31.816151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:31.816171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.816331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.816335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.816352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:31.819797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0] Write session: try to update token
2025-10-10T14:36:31.819818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:31.834824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:31.834843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.834855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601965341833392:3991]
2025-10-10T14:36:31.834909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:31.834946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:31.835092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:31.835242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.835389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.835541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:31.835747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:31.835784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:31.845286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId: src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:31.848236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:31.848487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.848519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.848572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:31.848670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:31.867910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:31.867927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:31.867932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:31.867934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:31.867946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601965341833392:3991]
2025-10-10T14:36:31.867950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601965341833392:3991]
2025-10-10T14:36:31.867970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601965341833392:3991]
2025-10-10T14:36:31.868018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:31.868027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:31.868038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:31.868041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:31.868060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:31.868065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:31.868208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:31.889102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601966124063416:5230]
2025-10-10T14:36:31.892356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2041, pipe: [1:7559601966124063416:5230]
2025-10-10T14:36:31.987074Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:31.995958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:31.995987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:31.996175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.996244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.996307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.996375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.996935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.996947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.997019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.997083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.997149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.997223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.997269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.997277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.997367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.997436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.997511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.997578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.997632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.997638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.997711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.997774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.997835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.997897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.997936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.997939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.998006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.998064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.998128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.998191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.998232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.998236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.998306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.998367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.998428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.998493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.998537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.998540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.998614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.998674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.998815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.998878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.998920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.998922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.998991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.999049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.999106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.999175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.999216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.999218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.999291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.999353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.999413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.999477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.999520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.999523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.999598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:31.999655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:31.999716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:31.999787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:31.999834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:31.999837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:31.999912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601966124063416:5230], now have 1 active actors on pipe
2025-10-10T14:36:32.000738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:32.000496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601966124063416:5230]
2025-10-10T14:36:32.000550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:32.000554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:32.000588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2042 reason: error at write: Disconnected sessionId: src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0
2025-10-10T14:36:32.000784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2042 sessionId: src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0 is DEAD
2025-10-10T14:36:32.001115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:32.001313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:32.001321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0] Write session will restart in 0.007228s
2025-10-10T14:36:32.001365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0] Write session: Do CDS request
2025-10-10T14:36:32.001375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:32.010014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.010324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:32.010348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2043
2025-10-10T14:36:32.011489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.011532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:32.011537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:32.011542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:32.012128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2043 sessionId:  describe result for acl check
2025-10-10T14:36:32.012167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:32.012175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:32.012177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:32.012183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601970419030799:8511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:32.012774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601970419030799:8511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:32.016405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:32.016298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601970419030799:8511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:32.019296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601970419030799:8511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:32.019312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601970419030799:8511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:32.019315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601970419030799:8511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:32.019323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:32.021755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:32.022013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:32.022024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:32.022037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:32.022100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:32.022145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601969636800877:3963]
2025-10-10T14:36:32.022777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:32.024312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:32.024393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:32.024769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:32.024831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.024832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.024834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.024836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.024837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.024839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.024841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.024842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.024843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.024845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.024846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.024848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.024849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.024856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.024870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.024875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.024880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.024884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.024890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.024895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.024899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.024903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.024908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.024913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.024918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.024922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.024931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.024941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.024947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.024954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.024959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.024965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.024970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.024977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.024982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.024989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.024994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.025000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.025005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.025010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.025016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.025022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.025031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.025037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.025042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.025048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.025053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.025058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.025064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.025070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.025077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.025083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.025128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:32.038722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:32.039046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:32.039063Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:32.039066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:32.039071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:32.039078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2042 [2:7559601969636800877:3963]
2025-10-10T14:36:32.039095Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:32.039118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:32.039121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.039126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.039129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.039148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:32.039160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:32.039169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:32.039242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.039251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.039254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.039257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:32.039469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:32.039479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.039490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.039503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.039521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:32.039522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2042
2025-10-10T14:36:32.039549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419030871:8511], now have 1 active actors on pipe
2025-10-10T14:36:32.039562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419030753:2438], now have 1 active actors on pipe
2025-10-10T14:36:32.039536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2042
2025-10-10T14:36:32.039570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601969636800871:3963]
2025-10-10T14:36:32.039573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601969636800871:3963]
2025-10-10T14:36:32.039575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601969636800871:3963]
2025-10-10T14:36:32.039585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:32.039595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:32.039598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:32.039600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:32.039601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:32.039617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:32.039621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:32.039646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.039656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.039705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601969636800871:3963]
2025-10-10T14:36:32.039717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:32.039735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:32.039738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:32.039745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.039749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.039751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:32.039764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.039774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:32.039816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.040096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.040105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.040120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.040244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2043 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0
2025-10-10T14:36:32.040706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f8e3531-8a267dcf-12ee4b0f-3c422780_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:32.043563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0] Write session: try to update token
2025-10-10T14:36:32.043584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:32.059328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId: src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:32.061468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:32.061485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:32.061488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:32.061490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:32.061500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601969636800871:3963]
2025-10-10T14:36:32.061504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601969636800871:3963]
2025-10-10T14:36:32.061509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601969636800871:3963]
2025-10-10T14:36:32.061557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:32.061561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:32.061565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:32.061569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:32.061570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.061572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:32.061708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:32.062278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:32.100581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601970419030882:5230]
2025-10-10T14:36:32.100944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2042, pipe: [1:7559601970419030882:5230]
2025-10-10T14:36:32.179067Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:32.179424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.179441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.179490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419030882:5230], now have 1 active actors on pipe
2025-10-10T14:36:32.179728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:32.181218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:32.181229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0] Write session will restart in 0.007944s
2025-10-10T14:36:32.181263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0] Write session: Do CDS request
2025-10-10T14:36:32.181270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:32.180737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601970419030882:5230]
2025-10-10T14:36:32.180744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:32.180779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:32.180858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2043 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0
2025-10-10T14:36:32.181072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2043 sessionId: src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0 is DEAD
2025-10-10T14:36:32.191344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.191444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:32.191461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2044
2025-10-10T14:36:32.193589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.193645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:32.193663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:32.193668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:32.194188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2044 sessionId:  describe result for acl check
2025-10-10T14:36:32.194227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:32.194230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:32.194232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:32.194238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601970419030954:8506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:32.194812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601970419030954:8506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:32.197374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601970419030954:8506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:32.201022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601970419030954:8506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:32.201389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:32.201035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601970419030954:8506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:32.201040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601970419030954:8506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:32.201049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:32.204059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:32.204311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:32.204321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:32.204336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:32.204404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:32.204457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601969636801007:3961]
2025-10-10T14:36:32.205059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:32.205486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:32.205543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:32.205864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:32.205933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.205939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.205940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.205941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.205942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.205943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.205945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.205946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.205947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.205949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.205950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.205951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.205953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.205960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.205973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.205977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.205981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.205985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.205989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.205993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.205997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.206001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.206006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.206009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.206012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.206016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.206024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.206033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.206039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.206045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.206049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.206054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.206059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.206064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.206069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.206074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.206079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.206084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.206089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.206096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.206100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.206113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.206119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.206127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.206131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.206136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.206141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.206146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.206151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.206156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.206161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.206165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.206222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:32.208753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:32.209078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:32.209092Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:32.209095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:32.209099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:32.209108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2043 [2:7559601969636801007:3961]
2025-10-10T14:36:32.209122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:32.209140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:32.209146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.209148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.209150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.209163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:32.209169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:32.209176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:32.209226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.209232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.209234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.209235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:32.209296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:32.209302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.209310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.209317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.209345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:32.209371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601969636801001:3961]
2025-10-10T14:36:32.209376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601969636801001:3961]
2025-10-10T14:36:32.209378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601969636801001:3961]
2025-10-10T14:36:32.209385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:32.209396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:32.209401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:32.209404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:32.209406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:32.209410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:32.209412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:32.209423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031005:8506], now have 1 active actors on pipe
2025-10-10T14:36:32.209447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601969636801001:3961]
2025-10-10T14:36:32.209461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:32.209469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419030885:2438], now have 1 active actors on pipe
2025-10-10T14:36:32.209479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:32.209500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2043
2025-10-10T14:36:32.209530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2043
2025-10-10T14:36:32.210080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.210095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.210135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:32.210149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.210156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.210160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:32.210174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.210191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:32.210212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.210497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.210509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.210873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2044 partition: 0 MaxSeqNo: 40 sessionId: src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0
2025-10-10T14:36:32.211376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e9bdc4f-fe8826e2-aff4cdbe-87d05b04_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:32.210533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.214223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0] Write session: try to update token
2025-10-10T14:36:32.214244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:32.230303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:32.230326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:32.230329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:32.230339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:32.230352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601969636801001:3961]
2025-10-10T14:36:32.230356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601969636801001:3961]
2025-10-10T14:36:32.230360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601969636801001:3961]
2025-10-10T14:36:32.230417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:32.230424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.230427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:32.230426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:32.230434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:32.230439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:32.230572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:32.231022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId: src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:32.233976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:32.280955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601970419031018:5230]
2025-10-10T14:36:32.281495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2043, pipe: [1:7559601970419031018:5230]
2025-10-10T14:36:32.348009Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:32.348396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.348414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.348465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031018:5230], now have 1 active actors on pipe
2025-10-10T14:36:32.348762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:32.349258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:32.349271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0] Write session will restart in 0.009532s
2025-10-10T14:36:32.349296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0] Write session: Do CDS request
2025-10-10T14:36:32.349302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:32.348811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:32.348827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:32.348839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601970419031018:5230]
2025-10-10T14:36:32.348860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:32.348901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2044 reason: error at write: Disconnected sessionId: src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0
2025-10-10T14:36:32.349103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2044 sessionId: src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0 is DEAD
2025-10-10T14:36:32.359936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.360312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:32.360332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2045
2025-10-10T14:36:32.360485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.360546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:32.360558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:32.360562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:32.361046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2045 sessionId:  describe result for acl check
2025-10-10T14:36:32.361088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:32.361097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:32.361099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:32.361106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601970419031111:8495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:32.361767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601970419031111:8495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:32.362663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:32.364757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:32.364801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601970419031111:8495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:32.365024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:32.365036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:32.365048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:32.365099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:32.365158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601969636801137:3960]
2025-10-10T14:36:32.365893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:32.366550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:32.366647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:32.367082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:32.367193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.367204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.367205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.367207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.367208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.367210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.367211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.367213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.367214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.367216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.367217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.367219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.367220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.367229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.367244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.367251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.367255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.367259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.367263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.367267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.367271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.367276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.367280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.367285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.367289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.367293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.367303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.367314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.367322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.367333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.367340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.367347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.367352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.367358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.367372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.367384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.367390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.367396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.367403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.367415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.367421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.367426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.367431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.367437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.367443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.367449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.367455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.367461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.367466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.367472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.367479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.367484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.367529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:32.370357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:32.370768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601970419031111:8495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:32.370787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601970419031111:8495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:32.370791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601970419031111:8495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:32.370801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:32.370704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:32.370716Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:32.370719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:32.370723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:32.370731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2044 [2:7559601969636801137:3960]
2025-10-10T14:36:32.370764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:32.370783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:32.370787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.370791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.370793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.370811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:32.370820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:32.370828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:32.370895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.370898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.370900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.370903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:32.370979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:32.370981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.370995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.371007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.371025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:32.371047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601969636801132:3960]
2025-10-10T14:36:32.371050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601969636801132:3960]
2025-10-10T14:36:32.371052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601969636801132:3960]
2025-10-10T14:36:32.371061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:32.371075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:32.371075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:32.371079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:32.371081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:32.371090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:32.371092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:32.371103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031020:2438], now have 1 active actors on pipe
2025-10-10T14:36:32.371107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031148:8495], now have 1 active actors on pipe
2025-10-10T14:36:32.371138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601969636801132:3960]
2025-10-10T14:36:32.371146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:32.371195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:32.371352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2044
2025-10-10T14:36:32.371400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2044
2025-10-10T14:36:32.371503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.371514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.371542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:32.371555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.371560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.371562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:32.371573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.371590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:32.371611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.371989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2045 partition: 0 MaxSeqNo: 40 sessionId: src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0
2025-10-10T14:36:32.371870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.371877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.371891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.372471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246347b8-84ce1797-c9f5e5bc-e06a306_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:32.375450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0] Write session: try to update token
2025-10-10T14:36:32.375476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:32.392502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId: src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:32.393299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:32.393322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:32.393326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:32.393346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:32.393356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601969636801132:3960]
2025-10-10T14:36:32.393360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601969636801132:3960]
2025-10-10T14:36:32.393364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601969636801132:3960]
2025-10-10T14:36:32.393415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:32.393431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.393433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:32.393587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:32.395355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:32.395701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:32.395714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:32.395719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:32.448868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601970419031155:5230]
2025-10-10T14:36:32.449305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2044, pipe: [1:7559601970419031155:5230]
2025-10-10T14:36:32.510781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:32.511329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.511339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.511381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031155:5230], now have 1 active actors on pipe
2025-10-10T14:36:32.511705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:32.513415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601970419031155:5230]
2025-10-10T14:36:32.513426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:32.513463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:32.513512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2045 reason: status is not ok: tablet will be restarted right now sessionId: src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0
2025-10-10T14:36:32.513889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:32.513903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0] Write session will restart in 0.008632s
2025-10-10T14:36:32.513929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0] Write session: Do CDS request
2025-10-10T14:36:32.513935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:32.513730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2045 sessionId: src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0 is DEAD
2025-10-10T14:36:32.525159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.525349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:32.525368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2046
2025-10-10T14:36:32.525529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.525577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:32.525584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:32.525588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:32.526112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2046 sessionId:  describe result for acl check
2025-10-10T14:36:32.526151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:32.526158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:32.526160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:32.526167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601970419031208:8496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:32.526754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601970419031208:8496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:32.531116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601970419031208:8496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:32.532983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:32.535569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:32.535854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:32.535870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601970419031208:8496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:32.535898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601970419031208:8496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:32.535902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601970419031208:8496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:32.535867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:32.535912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:32.535881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:32.535951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:32.536001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601969636801269:3953]
2025-10-10T14:36:32.536641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:32.536947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:32.536994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:32.537325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:32.537432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.537439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.537441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.537442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.537443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.537445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.537446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.537448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.537449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.537451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.537452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.537453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.537454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.537460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.537474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.537479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.537483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.537487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.537491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.537496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.537500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.537504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.537508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.537513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.537517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.537521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.537529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.537538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.537545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.537551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.537555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.537561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.537566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.537572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.537577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.537582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.537586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.537592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.537602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.537607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.537612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.537617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.537621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.537626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.537632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.537636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.537644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.537655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.537659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.537669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.537674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.537680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.537726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:32.542318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:32.542872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:32.542885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:32.542887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:32.542891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:32.542899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2045 [2:7559601969636801269:3953]
2025-10-10T14:36:32.542913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:32.542931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:32.542934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.542938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.542941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.542960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:32.542968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:32.542976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:32.543040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.543048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.543050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.543053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:32.543125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:32.543133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.543141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.543148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.543162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:32.543189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031159:2438], now have 1 active actors on pipe
2025-10-10T14:36:32.543199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031280:8496], now have 1 active actors on pipe
2025-10-10T14:36:32.543206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601969636801264:3953]
2025-10-10T14:36:32.543208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601969636801264:3953]
2025-10-10T14:36:32.543210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601969636801264:3953]
2025-10-10T14:36:32.543221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:32.543235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:32.543241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:32.543245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:32.543248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:32.543254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:32.543258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:32.543296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601969636801264:3953]
2025-10-10T14:36:32.543304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:32.543285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2045
2025-10-10T14:36:32.543289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2045
2025-10-10T14:36:32.543328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:32.543345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.543353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.543384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:32.543397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.543406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.543408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:32.543421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.543438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:32.543453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.543614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.543621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.543635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.543739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2046 partition: 0 MaxSeqNo: 40 sessionId: src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0
2025-10-10T14:36:32.544170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edda3f2a-4c1e5194-a499abcd-4b125176_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:32.547067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0] Write session: try to update token
2025-10-10T14:36:32.547084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:32.556067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:32.556083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:32.556095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601969636801264:3953]
2025-10-10T14:36:32.556145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:32.556148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:32.556340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:32.556495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:32.556660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:32.556815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:32.557030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:32.557086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:32.568975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId: src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:32.571653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:32.571909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.571929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.571973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:32.572070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:32.578076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:32.578094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:32.578099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:32.578101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:32.578112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601969636801264:3953]
2025-10-10T14:36:32.578116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601969636801264:3953]
2025-10-10T14:36:32.578120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601969636801264:3953]
2025-10-10T14:36:32.578170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:32.578180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.578190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:32.578217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:32.578233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:32.578238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:32.578329Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:32.613572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601970419031291:5230]
2025-10-10T14:36:32.613889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2045, pipe: [1:7559601970419031291:5230]
2025-10-10T14:36:32.696337Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:32.705064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.705097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.705296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.705411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.705487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.705560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.705612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.705622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.705706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.705768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.705836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.709432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:32.709451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:32.709487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2046 reason: error at write: Disconnected sessionId: src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0
2025-10-10T14:36:32.709688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2046 sessionId: src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0 is DEAD
2025-10-10T14:36:32.709739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:32.709797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601970419031291:5230]
2025-10-10T14:36:32.705903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.705960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.705964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.706038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.706103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.706171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.706232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.706278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.706281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.706357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.706807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.706879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.706952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.706999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.707002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.707081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.707140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.707203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.707266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.707311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.707314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.707384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.707451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.707519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.707584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.707627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.707630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.707704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.707764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.707832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.707902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.707948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.707951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.708025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.708088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.708156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.708223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.708267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.708271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.708343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.708401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.710022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:32.710040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0] Write session will restart in 0.005639s
2025-10-10T14:36:32.708466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.708552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.710081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0] Write session: Do CDS request
2025-10-10T14:36:32.708598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.710092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:32.708601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.708678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.708740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.708803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.708871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.708915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.708918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.709010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031291:5230], now have 1 active actors on pipe
2025-10-10T14:36:32.709510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:32.718016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.721560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:32.721579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2047
2025-10-10T14:36:32.721780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.721839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:32.721850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:32.721856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:32.722386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2047 sessionId:  describe result for acl check
2025-10-10T14:36:32.722428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:32.722437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:32.722439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:32.722446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601970419031379:8484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:32.723081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601970419031379:8484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:32.728389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601970419031379:8484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:32.725471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:32.727464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:32.727898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:32.727904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:32.727919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:32.727996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:32.728037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601969636801402:3951]
2025-10-10T14:36:32.728688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:32.729022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:32.729099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:32.729485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:32.729566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.729573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.729575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.729576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.729577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.729579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.729580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.729581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.729583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.729584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.729586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.729587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.729589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.729596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.729610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.729615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.729620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.729624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.729629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.729634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.729638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.729643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.729648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.729652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.729656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.729661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.729669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.729680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.729695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.729701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.729706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.729712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.729717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.729723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.729729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.729735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.729740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.729746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.729752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.729758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.729770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.729777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.729783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.729789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.729793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.729800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.729806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.729814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.729823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.729830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.729839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.729845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.729894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:32.732470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:32.732944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601970419031379:8484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:32.732963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601970419031379:8484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:32.732967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601970419031379:8484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:32.732977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:32.733126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:32.733140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:32.733143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:32.733147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:32.733154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2046 [2:7559601969636801402:3951]
2025-10-10T14:36:32.733171Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:32.733190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:32.733199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.733204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.733206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.733224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:32.733235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:32.733247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:32.733314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.733321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.733323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.733326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:32.733421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:32.733424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.733437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.733453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.733471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:32.733498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031298:2438], now have 1 active actors on pipe
2025-10-10T14:36:32.733507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031430:8484], now have 1 active actors on pipe
2025-10-10T14:36:32.733515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601969636801397:3951]
2025-10-10T14:36:32.733517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601969636801397:3951]
2025-10-10T14:36:32.733520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601969636801397:3951]
2025-10-10T14:36:32.733534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:32.733537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2046
2025-10-10T14:36:32.733549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:32.733552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:32.733558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:32.733561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:32.733569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:32.733582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:32.733621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601969636801397:3951]
2025-10-10T14:36:32.733632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:32.733597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2046
2025-10-10T14:36:32.733635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:32.733648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.733653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.733702Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|defed725-6b20eda9-226ae81d-5debdd48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:32.733714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.733718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.733720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:32.733731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.733741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:32.733762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.733941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.733956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.733982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.734059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2047 partition: 0 MaxSeqNo: 40 sessionId: src_id|defed725-6b20eda9-226ae81d-5debdd48_0
2025-10-10T14:36:32.734453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69e2b9e-87e77f44-907f2dda-b9913b10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|defed725-6b20eda9-226ae81d-5debdd48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:32.737208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|defed725-6b20eda9-226ae81d-5debdd48_0] Write session: try to update token
2025-10-10T14:36:32.737227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|defed725-6b20eda9-226ae81d-5debdd48_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:32.753260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId: src_id|defed725-6b20eda9-226ae81d-5debdd48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:32.755970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:32.756296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.756319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.756361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:32.756690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:32.764315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:32.764336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:32.764340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:32.764342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:32.764352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601969636801397:3951]
2025-10-10T14:36:32.764357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601969636801397:3951]
2025-10-10T14:36:32.764360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601969636801397:3951]
2025-10-10T14:36:32.764391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:32.764396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:32.764399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:32.764409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:32.764416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.764418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:32.764573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:32.809705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601970419031441:5230]
2025-10-10T14:36:32.810042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2046, pipe: [1:7559601970419031441:5230]
2025-10-10T14:36:32.885000Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:32.894173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.894203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.894400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.894470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.894539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.894609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.894660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.894673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.894748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.894814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.894889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.894964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.895011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.895022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.895096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.895169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.895239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.895306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.895360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.895368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.895441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.895761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.895837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.895902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.895950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.895957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.896031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.896095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.896162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.896231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.896280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.896288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.896364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.896431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.896499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.896580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.896628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.896636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.896708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.896775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.896849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.896917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.896964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.896975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.897048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.898313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:32.898354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601970419031441:5230]
2025-10-10T14:36:32.898375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:32.898378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:32.898414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2047 reason: error at write: Disconnected sessionId: src_id|defed725-6b20eda9-226ae81d-5debdd48_0
2025-10-10T14:36:32.897114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.897191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.897255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.897297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.899205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2047 sessionId: src_id|defed725-6b20eda9-226ae81d-5debdd48_0 is DEAD
2025-10-10T14:36:32.897300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.897391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.897454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.897521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.897592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.897635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.897638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.897708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:32.897772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:32.897837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:32.897901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:32.897945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:32.897949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:32.898031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031441:5230], now have 1 active actors on pipe
2025-10-10T14:36:32.899085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:32.899601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defed725-6b20eda9-226ae81d-5debdd48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:32.899611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defed725-6b20eda9-226ae81d-5debdd48_0] Write session will restart in 0.009413s
2025-10-10T14:36:32.899635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defed725-6b20eda9-226ae81d-5debdd48_0] Write session: Do CDS request
2025-10-10T14:36:32.899641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defed725-6b20eda9-226ae81d-5debdd48_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:32.909946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|defed725-6b20eda9-226ae81d-5debdd48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.910037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:32.910067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2048
2025-10-10T14:36:32.910191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:32.910227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:32.910237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:32.910242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:32.910814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2048 sessionId:  describe result for acl check
2025-10-10T14:36:32.910853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:32.910862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:32.910864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:32.910870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601970419031517:8481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:32.911470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601970419031517:8481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:32.913525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:32.914320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601970419031517:8481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:32.916214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:32.916526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:32.916541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:32.916554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:32.916630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:32.916678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601969636801536:3947]
2025-10-10T14:36:32.917244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:32.917585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:32.917631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:32.917970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:32.918048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.918058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.918060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.918061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.918063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.918064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.918066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.918067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.918068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.918069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.918071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.918072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.918073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.918080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.918093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.918097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.918100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.918103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.918107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.918111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.918115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.918118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.918123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.918127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.918131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.918135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.918142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.918151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:32.918158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.918163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:32.918167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.918173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:32.918177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.918182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:32.918186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.918192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:32.918196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.918201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:32.918206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.918211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:32.918215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.918221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:32.918226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.918231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:32.918236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.918243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:32.918248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.918254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.918258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.918264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.918270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.918275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.918320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:32.919015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601970419031517:8481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:32.919030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601970419031517:8481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:32.919034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601970419031517:8481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:32.919043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:32.920773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:32.921321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:32.921348Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:32.921351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:32.921355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:32.921361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2047 [2:7559601969636801536:3947]
2025-10-10T14:36:32.921375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:32.921394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:32.921398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.921401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.921404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.921422Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:32.921431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:32.921440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:32.921503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.921506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.921511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.921514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:32.921589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:32.921592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.921605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:32.921618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:32.921636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:32.921659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031573:8481], now have 1 active actors on pipe
2025-10-10T14:36:32.921670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031443:2438], now have 1 active actors on pipe
2025-10-10T14:36:32.921678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601969636801531:3947]
2025-10-10T14:36:32.921681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601969636801531:3947]
2025-10-10T14:36:32.921683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601969636801531:3947]
2025-10-10T14:36:32.921697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:32.921712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:32.921714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:32.921717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:32.921719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:32.921729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:32.921732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:32.921761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601969636801531:3947]
2025-10-10T14:36:32.921770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:32.921773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:32.921731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2047
2025-10-10T14:36:32.921792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.921768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2047
2025-10-10T14:36:32.921805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.921863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:32.921876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:32.921880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:32.921883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:32.921894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:32.921906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:32.921928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.922206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.922222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.922247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:32.922378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2048 partition: 0 MaxSeqNo: 40 sessionId: src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0
2025-10-10T14:36:32.922816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|defed725-6b20eda9-226ae81d-5debdd48_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:32.925649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0] Write session: try to update token
2025-10-10T14:36:32.925673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:32.942935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId: src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:32.945968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:32.946355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:32.946381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:32.946404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:32.946407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:32.946410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:32.946412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:32.946421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601969636801531:3947]
2025-10-10T14:36:32.946426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601969636801531:3947]
2025-10-10T14:36:32.946429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601969636801531:3947]
2025-10-10T14:36:32.946486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:32.946488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:32.946496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:32.946498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:32.946498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:32.946502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:32.946629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:32.998988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601970419031606:5230]
2025-10-10T14:36:32.999598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2047, pipe: [1:7559601970419031606:5230]
2025-10-10T14:36:33.078442Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:33.078756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:33.078816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601970419031606:5230], now have 1 active actors on pipe
2025-10-10T14:36:33.081375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:33.081389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0] Write session will restart in 0.009177s
2025-10-10T14:36:33.081415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0] Write session: Do CDS request
2025-10-10T14:36:33.081421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:33.080868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:33.080966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:33.080969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:33.081060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2048 reason: error at write: Disconnected sessionId: src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0
2025-10-10T14:36:33.081222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2048 sessionId: src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0 is DEAD
2025-10-10T14:36:33.081457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601970419031606:5230]
2025-10-10T14:36:33.081473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:33.091864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.092031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:33.092047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2049
2025-10-10T14:36:33.092207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.092267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:33.092279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:33.092284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:33.092822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2049 sessionId:  describe result for acl check
2025-10-10T14:36:33.092862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:33.092865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:33.092867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:33.092875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601974713999000:8460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:33.093494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601974713999000:8460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:33.095624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:33.096546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601974713999000:8460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:33.098100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:33.098349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:33.098360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:33.098374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:33.098434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:33.098479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601973931769018:3931]
2025-10-10T14:36:33.099088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:33.099373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:33.099421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:33.099725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:33.099568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601974713999000:8460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:33.099583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601974713999000:8460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:33.099587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601974713999000:8460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:33.099597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:33.099796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.099805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.099807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.099808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.099809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.099810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.099811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.099812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.099813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.099814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.099815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.099816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.099817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.099823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.099838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.099842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.099845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.099850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.099854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.099858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.099863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.099867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.099871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.099875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.099880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.099884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.099892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.099900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.099907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.099913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.099917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.099923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.099927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.099933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.099937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.099943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.099947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.099953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.099958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.099963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.099966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.099971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.099976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.099980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.099986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.099993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.100006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.100016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.100024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.100030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.100039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.100045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.100095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:33.102771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:33.103519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:33.103532Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:33.103534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:33.103538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:33.103544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2048 [2:7559601973931769018:3931]
2025-10-10T14:36:33.103557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:33.103576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:33.103583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.103587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.103589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.103607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:33.103619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:33.103627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:33.103694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.103703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.103705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.103708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:33.103773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:33.103780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.103792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.103809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.103832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:33.103858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999044:8460], now have 1 active actors on pipe
2025-10-10T14:36:33.103866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713998915:2438], now have 1 active actors on pipe
2025-10-10T14:36:33.103874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601973931769013:3931]
2025-10-10T14:36:33.103881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601973931769013:3931]
2025-10-10T14:36:33.103883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601973931769013:3931]
2025-10-10T14:36:33.103895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:33.103912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:33.103914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:33.103915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:33.103917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:33.103931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:33.103938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:33.103966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601973931769013:3931]
2025-10-10T14:36:33.103979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:33.103960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2048
2025-10-10T14:36:33.104006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2048
2025-10-10T14:36:33.104001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:33.104241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.104251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.104284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:33.104292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.104297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.104299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:33.104313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.104326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:33.104341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.104669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.104679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.104701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.104800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2049 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0
2025-10-10T14:36:33.105214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5668b45a-81e98c3-fba995d9-12a4a5d3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:33.107990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0] Write session: try to update token
2025-10-10T14:36:33.108012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:33.123908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:33.123925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:33.123929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:33.123931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:33.123941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601973931769013:3931]
2025-10-10T14:36:33.123946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601973931769013:3931]
2025-10-10T14:36:33.123950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601973931769013:3931]
2025-10-10T14:36:33.124006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:33.124011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:33.124016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.124018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:33.124019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:33.124024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:33.124159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:33.134827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId: src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:33.137750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:33.185421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601974713999054:5230]
2025-10-10T14:36:33.189720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2048, pipe: [1:7559601974713999054:5230]
2025-10-10T14:36:33.245423Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:33.245876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.245892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.245918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999054:5230], now have 1 active actors on pipe
2025-10-10T14:36:33.249678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:33.249696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:33.249739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:33.250165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:33.250173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0] Write session will restart in 0.007145s
2025-10-10T14:36:33.250200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0] Write session: Do CDS request
2025-10-10T14:36:33.250206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:33.249789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2049 reason: error at write: Disconnected sessionId: src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0
2025-10-10T14:36:33.249957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:33.249996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2049 sessionId: src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0 is DEAD
2025-10-10T14:36:33.250004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601974713999054:5230]
2025-10-10T14:36:33.258982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.260248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:33.260270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2050
2025-10-10T14:36:33.260409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.260446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:33.260452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:33.260456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:33.261998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2050 sessionId:  describe result for acl check
2025-10-10T14:36:33.262041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:33.262042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:33.262046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:33.262053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601974713999070:8445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:33.262660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601974713999070:8445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:33.266158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601974713999070:8445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:33.270603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601974713999070:8445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:33.270620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601974713999070:8445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:33.270624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601974713999070:8445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:33.270634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:33.278290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:33.280632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:33.280889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:33.280905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:33.280924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:33.280999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:33.281046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601973931769154:3925]
2025-10-10T14:36:33.281518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:33.281859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:33.281911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:33.282163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:33.282202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.282203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.282204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.282204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.282205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.282206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.282206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.282207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.282208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.282209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.282210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.282211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.282212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.282218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.282230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.282234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.282238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.282242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.282245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.282249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.282253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.282257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.282261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.282263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.282265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.282267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.282274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.282280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.282285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.282288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.282291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.282295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.282297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.282301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.282304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.282307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.282310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.282313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.282316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.282319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.282321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.282325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.282327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.282330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.282333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.282336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.282339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.282343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.282346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.282349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.282352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.282355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.282378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:33.285665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:33.286073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:33.286089Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:33.286091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:33.286096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:33.286103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2049 [2:7559601973931769154:3925]
2025-10-10T14:36:33.286116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:33.286136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:33.286148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.286152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.286155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.286175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:33.286183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:33.286212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:33.286283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.286290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.286293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.286295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:33.286367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:33.286375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.286386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.286398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.286419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:33.286446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999055:2438], now have 1 active actors on pipe
2025-10-10T14:36:33.286455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999127:8445], now have 1 active actors on pipe
2025-10-10T14:36:33.286463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601973931769148:3925]
2025-10-10T14:36:33.286466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601973931769148:3925]
2025-10-10T14:36:33.286468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601973931769148:3925]
2025-10-10T14:36:33.286484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:33.286505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:33.286527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:33.286531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:33.286534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:33.286534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:33.286536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:33.286566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601973931769148:3925]
2025-10-10T14:36:33.286575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:33.286578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:33.286515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2049
2025-10-10T14:36:33.286567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2049
2025-10-10T14:36:33.286735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.286748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.286782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4093258-101ee1d3-fa17822-67f7c616_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:33.286834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.286839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.286847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:33.286873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.286891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:33.286910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.287164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.287173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.287201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.287280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2050 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4093258-101ee1d3-fa17822-67f7c616_0
2025-10-10T14:36:33.287795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe1a438c-5e61763a-46f79193-ef4237a1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4093258-101ee1d3-fa17822-67f7c616_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:33.290666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4093258-101ee1d3-fa17822-67f7c616_0] Write session: try to update token
2025-10-10T14:36:33.290687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4093258-101ee1d3-fa17822-67f7c616_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:33.307535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId: src_id|c4093258-101ee1d3-fa17822-67f7c616_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:33.310332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:33.310601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.310626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.310682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:33.310799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:33.317552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:33.317573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:33.317576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:33.317579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:33.317590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601973931769148:3925]
2025-10-10T14:36:33.317594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601973931769148:3925]
2025-10-10T14:36:33.317599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601973931769148:3925]
2025-10-10T14:36:33.317650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:33.317655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:33.317657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:33.317661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:33.317663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.317666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:33.317805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:33.349854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601974713999196:5230]
2025-10-10T14:36:33.351321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2049, pipe: [1:7559601974713999196:5230]
2025-10-10T14:36:33.433892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:33.442348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.442380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.442544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.442608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.442670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.442729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.442780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.442790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.442865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.442923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.442979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.443054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.443102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.443110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.443181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.443239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.443304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.443370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.443411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.443415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.443482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.443540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.443608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.443675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.443714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.443719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.443787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.443851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.443913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.443970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.444010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.444016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.444086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.444148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.444208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.444269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.444315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.444318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.444388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.444447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.444526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.444587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.444628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.444631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.444700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.444756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.444815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.444879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.444932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.444935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.445003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.445060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.445122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.445185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.445225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.445228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.445297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:33.445433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:33.445496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:33.445562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:33.445632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:33.445650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:33.445719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999196:5230], now have 1 active actors on pipe
2025-10-10T14:36:33.445987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:33.446012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:33.446036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:33.446047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2050 reason: error at write: Disconnected sessionId: src_id|c4093258-101ee1d3-fa17822-67f7c616_0
2025-10-10T14:36:33.446088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601974713999196:5230]
2025-10-10T14:36:33.446367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2050 sessionId: src_id|c4093258-101ee1d3-fa17822-67f7c616_0 is DEAD
2025-10-10T14:36:33.446428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4093258-101ee1d3-fa17822-67f7c616_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:33.446438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4093258-101ee1d3-fa17822-67f7c616_0] Write session will restart in 0.007628s
2025-10-10T14:36:33.446472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4093258-101ee1d3-fa17822-67f7c616_0] Write session: Do CDS request
2025-10-10T14:36:33.446479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4093258-101ee1d3-fa17822-67f7c616_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:33.446934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:33.454889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4093258-101ee1d3-fa17822-67f7c616_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.454998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:33.455015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2051
2025-10-10T14:36:33.455154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.455195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:33.455201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:33.455206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:33.455696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2051 sessionId:  describe result for acl check
2025-10-10T14:36:33.455737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:33.455739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:33.455741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:33.455748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601974713999245:8452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:33.456337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601974713999245:8452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:33.459286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601974713999245:8452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:33.459459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:33.461794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:33.462078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:33.462090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:33.462103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:33.462166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:33.462213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601973931769289:3920]
2025-10-10T14:36:33.462211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601974713999245:8452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:33.462224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601974713999245:8452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:33.462229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601974713999245:8452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:33.462238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:33.462854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:33.463114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:33.463157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:33.463491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:33.463549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.463555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.463557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.463558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.463559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.463560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.463562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.463563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.463564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.463566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.463567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.463568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.463569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.463575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.463588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.463592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.463595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.463598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.463602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.463606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.463610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.463614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.463619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.463622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.463626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.463630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.463638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.463646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.463653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.463659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.463664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.463670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.463675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.463689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.463693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.463699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.463703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.463708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.463714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.463719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.463723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.463728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.463732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.463737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.463742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.463748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.463754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.463764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.463769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.463775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.463780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.463785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.463827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:33.466266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:33.466594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:33.466608Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:33.466611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:33.466614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:33.466620Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2050 [2:7559601973931769289:3920]
2025-10-10T14:36:33.466635Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:33.466652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:33.466659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.466663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.466665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.466684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:33.466697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:33.466710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:33.466776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.466785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.466787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.466790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:33.466857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:33.466865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.466876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.466888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.466910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:33.466937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999327:8452], now have 1 active actors on pipe
2025-10-10T14:36:33.466948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999198:2438], now have 1 active actors on pipe
2025-10-10T14:36:33.466956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601973931769284:3920]
2025-10-10T14:36:33.466963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601973931769284:3920]
2025-10-10T14:36:33.466965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601973931769284:3920]
2025-10-10T14:36:33.466979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:33.466997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:33.467019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:33.467027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:33.467006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2050
2025-10-10T14:36:33.467053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601973931769284:3920]
2025-10-10T14:36:33.467060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:33.467010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2050
2025-10-10T14:36:33.467095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:33.467111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:33.467118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:33.467126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:33.467221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.467233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.467271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:33.467283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.467289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.467292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:33.467303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.467318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:33.467348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.467651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.467666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.467686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.467792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2051 partition: 0 MaxSeqNo: 40 sessionId: src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0
2025-10-10T14:36:33.468286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4093258-101ee1d3-fa17822-67f7c616_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:33.470996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0] Write session: try to update token
2025-10-10T14:36:33.471010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:33.489466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:33.489483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:33.489487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:33.489489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:33.489500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601973931769284:3920]
2025-10-10T14:36:33.489504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601973931769284:3920]
2025-10-10T14:36:33.489508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601973931769284:3920]
2025-10-10T14:36:33.489558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:33.489560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:33.489566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.489567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:33.489568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:33.489571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:33.489702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:33.491896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId: src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:33.494549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:33.546450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601974713999339:5230]
2025-10-10T14:36:33.546739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2050, pipe: [1:7559601974713999339:5230]
2025-10-10T14:36:33.605845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:33.606417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.606436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.606479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999339:5230], now have 1 active actors on pipe
2025-10-10T14:36:33.606700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:33.606715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:33.606695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:33.607147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:33.607158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0] Write session will restart in 0.005356s
2025-10-10T14:36:33.607182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0] Write session: Do CDS request
2025-10-10T14:36:33.606779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2051 reason: error at write: Disconnected sessionId: src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0
2025-10-10T14:36:33.606926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601974713999339:5230]
2025-10-10T14:36:33.607188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:33.606949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:33.607007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2051 sessionId: src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0 is DEAD
2025-10-10T14:36:33.613885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.613984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:33.614000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2052
2025-10-10T14:36:33.614175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.614230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:33.614243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:33.614247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:33.614718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2052 sessionId:  describe result for acl check
2025-10-10T14:36:33.614750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:33.614756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:33.614758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:33.614765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601974713999355:8447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:33.615310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601974713999355:8447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:33.618288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601974713999355:8447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:33.621948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601974713999355:8447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:33.621966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601974713999355:8447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:33.621969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601974713999355:8447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:33.621978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:33.623153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:33.624963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:33.625164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:33.625174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:33.625185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:33.625241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:33.625286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601973931769427:3915]
2025-10-10T14:36:33.625922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:33.626200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:33.626238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:33.626567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:33.626620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.626625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.626627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.626628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.626629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.626630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.626631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.626632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.626634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.626635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.626636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.626637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.626638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.626643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.626656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.626660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.626664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.626667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.626670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.626674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.626678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.626681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.626687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.626690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.626694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.626697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.626704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.626712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.626718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.626723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.626727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.626732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.626736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.626747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.626751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.626756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.626760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.626769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.626775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.626783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.626787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.626792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.626797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.626807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.626811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.626817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.626821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.626825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.626829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.626834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.626838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.626843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.626879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:33.629415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:33.629740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:33.629756Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:33.629758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:33.629763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:33.629770Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2051 [2:7559601973931769427:3915]
2025-10-10T14:36:33.629783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:33.629803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:33.629806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.629810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.629812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.629829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:33.629838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:33.629845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:33.629919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.629928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.629931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.629934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:33.630005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:33.630013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.630026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.630091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2051
2025-10-10T14:36:33.630042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.630065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:33.630087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999468:8447], now have 1 active actors on pipe
2025-10-10T14:36:33.630091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999340:2438], now have 1 active actors on pipe
2025-10-10T14:36:33.630098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601973931769422:3915]
2025-10-10T14:36:33.630101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601973931769422:3915]
2025-10-10T14:36:33.630103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601973931769422:3915]
2025-10-10T14:36:33.630116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:33.630159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2051
2025-10-10T14:36:33.630128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:33.630131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:33.630131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:33.630133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:33.630149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:33.630152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:33.630183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601973931769422:3915]
2025-10-10T14:36:33.630187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:33.630196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:33.630205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.630209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.630258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:33.630273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.630277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.630280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:33.630293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.630312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:33.630330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.630512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.630522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.630551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.630670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2052 partition: 0 MaxSeqNo: 40 sessionId: src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0
2025-10-10T14:36:33.631102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e1d8bb-43893d76-a4c6ca69-8f84f86c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:33.633968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0] Write session: try to update token
2025-10-10T14:36:33.633986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:33.652147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId: src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:33.655522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:33.655548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:33.655552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:33.655554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:33.655568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601973931769422:3915]
2025-10-10T14:36:33.655574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601973931769422:3915]
2025-10-10T14:36:33.655580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601973931769422:3915]
2025-10-10T14:36:33.655643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:33.655660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.655663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:33.655744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:33.655759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:33.655764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:33.655864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:33.655928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:33.707202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601974713999484:5230]
2025-10-10T14:36:33.707471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2051, pipe: [1:7559601974713999484:5230]
2025-10-10T14:36:33.778676Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:33.779062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.779079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.779126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999484:5230], now have 1 active actors on pipe
2025-10-10T14:36:33.779387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:33.779376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:33.779844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:33.779854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0] Write session will restart in 0.009481s
2025-10-10T14:36:33.779878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0] Write session: Do CDS request
2025-10-10T14:36:33.779884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:33.779446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:33.779454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:33.779532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2052 reason: error at write: Disconnected sessionId: src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0
2025-10-10T14:36:33.779700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2052 sessionId: src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0 is DEAD
2025-10-10T14:36:33.779859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601974713999484:5230]
2025-10-10T14:36:33.790913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.791162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:33.791180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2053
2025-10-10T14:36:33.791311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.791346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:33.791355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:33.791359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:33.791861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2053 sessionId:  describe result for acl check
2025-10-10T14:36:33.791911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:33.791918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:33.791920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:33.791927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601974713999592:8442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:33.792440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:33.792521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601974713999592:8442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:33.794670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:33.794904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:33.794918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:33.794932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:33.794998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:33.794995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601974713999592:8442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:33.795042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601973931769564:3913]
2025-10-10T14:36:33.795666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:33.796214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:33.796282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:33.796637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:33.796701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.796707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.796708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.796709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.796710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.796711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.796713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.796714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.796715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.796716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.796717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.796718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.796719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.796738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.796750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.796754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.796759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.796762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.796766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.796770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.796774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.796777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.796781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.796785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.796789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.796792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.796800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.796808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.796816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.796828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.796833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.796843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.796848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.796868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.796877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.796883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.796888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.796894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.796899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.796905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.796909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.796915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.796920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.796926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.796930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.796936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.796940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.796947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.796958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.796964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.796969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.796976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.797015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:33.797859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601974713999592:8442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:33.797884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601974713999592:8442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:33.797891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601974713999592:8442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:33.797900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:33.799577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:33.799920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:33.799931Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:33.799934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:33.799938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:33.799944Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2052 [2:7559601973931769564:3913]
2025-10-10T14:36:33.799957Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:33.799974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:33.799977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.799980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.799984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.800000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:33.800013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:33.800026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:33.800091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.800098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.800100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.800103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:33.800175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:33.800183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.800195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.800207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.800226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:33.800253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999491:2438], now have 1 active actors on pipe
2025-10-10T14:36:33.800262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999631:8442], now have 1 active actors on pipe
2025-10-10T14:36:33.800269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601973931769559:3913]
2025-10-10T14:36:33.800272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601973931769559:3913]
2025-10-10T14:36:33.800275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601973931769559:3913]
2025-10-10T14:36:33.800292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:33.800309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:33.800315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:33.800319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:33.800321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:33.800325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:33.800328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:33.800355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601973931769559:3913]
2025-10-10T14:36:33.800368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:33.800375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:33.800393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2052
2025-10-10T14:36:33.800412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2052
2025-10-10T14:36:33.800573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.800582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.800613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:33.800626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.800630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.800632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:33.800655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.800671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:33.800684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.801378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.801391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.801413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.801852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2053 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0
2025-10-10T14:36:33.802301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564c1352-f3f51b57-1247444e-fa8ecb5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:33.805247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0] Write session: try to update token
2025-10-10T14:36:33.805265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:33.824643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:33.824667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:33.824671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:33.824673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:33.824683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601973931769559:3913]
2025-10-10T14:36:33.824688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601973931769559:3913]
2025-10-10T14:36:33.824695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601973931769559:3913]
2025-10-10T14:36:33.824741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:33.824748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:33.824749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:33.824754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:33.824756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.824761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:33.824904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:33.832785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId: src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:33.835468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:33.880283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601974713999638:5230]
2025-10-10T14:36:33.880764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2052, pipe: [1:7559601974713999638:5230]
2025-10-10T14:36:33.944768Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:33.945168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.945183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.945203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999638:5230], now have 1 active actors on pipe
2025-10-10T14:36:33.945432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:33.945561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601974713999638:5230]
2025-10-10T14:36:33.945612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:33.945696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2053 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0
2025-10-10T14:36:33.945790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:33.945893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2053 sessionId: src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0 is DEAD
2025-10-10T14:36:33.946017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:33.946027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0] Write session will restart in 0.005551s
2025-10-10T14:36:33.946050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0] Write session: Do CDS request
2025-10-10T14:36:33.946055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:33.952867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.953187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:33.953202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2054
2025-10-10T14:36:33.953489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:33.953534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:33.953539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:33.953544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:33.954506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2054 sessionId:  describe result for acl check
2025-10-10T14:36:33.954541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:33.954546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:33.954548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:33.954554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601974713999651:8435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:33.955119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601974713999651:8435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:33.957800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601974713999651:8435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:33.961304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601974713999651:8435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:33.961319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601974713999651:8435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:33.961323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601974713999651:8435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:33.961345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:33.963585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:33.966256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:33.966528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:33.966544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:33.966559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:33.966641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:33.966690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601973931769716:3893]
2025-10-10T14:36:33.967283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:33.967826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:33.967880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:33.968276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:33.968342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.968343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.968345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.968347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.968349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.968350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.968352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.968353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.968355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.968356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.968357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.968358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.968360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.968367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.968382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.968386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.968391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.968394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.968398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.968402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.968407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.968411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.968416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.968419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.968424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.968428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.968436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.968447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:33.968464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.968470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:33.968475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.968480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:33.968498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.968504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:33.968509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.968514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:33.968518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.968525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:33.968529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.968534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:33.968541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.968546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:33.968551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.968556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:33.968560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.968565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:33.968569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.968574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.968578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.968584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.968588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.968593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.968638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:33.971759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:33.972456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:33.972469Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:33.972472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:33.972477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:33.972501Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2053 [2:7559601973931769716:3893]
2025-10-10T14:36:33.972517Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:33.972539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:33.972549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.972554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.972557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.972579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:33.972587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:33.972596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:33.972671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.972680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.972683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.972687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:33.972764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:33.972772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:33.972786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:33.972804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:33.972828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:33.972858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999639:2438], now have 1 active actors on pipe
2025-10-10T14:36:33.972866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601974713999749:8435], now have 1 active actors on pipe
2025-10-10T14:36:33.972875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601973931769711:3893]
2025-10-10T14:36:33.972883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601973931769711:3893]
2025-10-10T14:36:33.972886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601973931769711:3893]
2025-10-10T14:36:33.972899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:33.972913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:33.972920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:33.972936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:33.972936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:33.972938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:33.972944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:33.972981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601973931769711:3893]
2025-10-10T14:36:33.972997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:33.973007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:33.977306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2053
2025-10-10T14:36:33.977369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2053
2025-10-10T14:36:33.979696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.979722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.979785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:33.979804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:33.979816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:33.979820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:33.979838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:33.979875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:33.979914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.983295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:33.983326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:33.983367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:33.983588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2054 partition: 0 MaxSeqNo: 40 sessionId: src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0
2025-10-10T14:36:33.984022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab0b251a-f047ab49-c7308312-a312ab5b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:33.986800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0] Write session: try to update token
2025-10-10T14:36:33.986822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:33.996248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:33.996268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:33.996281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601973931769711:3893]
2025-10-10T14:36:33.996351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:33.996353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:33.996566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:33.996717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:33.996864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:33.997015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:33.997220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:33.997269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:34.005524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId: src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:34.008527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:34.008716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.008740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.010684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:34.010727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:34.010731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:34.010736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:34.010738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:34.010748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601973931769711:3893]
2025-10-10T14:36:34.010757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601973931769711:3893]
2025-10-10T14:36:34.010763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601973931769711:3893]
2025-10-10T14:36:34.010811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:34.010817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:34.010823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.010825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:34.010825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:34.010829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:34.010823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:34.010962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:34.049447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601979008967105:5230]
2025-10-10T14:36:34.049892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2053, pipe: [1:7559601979008967105:5230]
2025-10-10T14:36:34.140980Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:34.150572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.150611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.150811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.150885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.150952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.151019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.151693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.151700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.151779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.151848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.151915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.151987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.152033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.152036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.152113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.152172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.152236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.152303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.152347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.152350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.152428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.152514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.152585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.152655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.152706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.152709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.152781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.152844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.152913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.152980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.153020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.153023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.153103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.153172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.153239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.153310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.153661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.153688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.153764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.153839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.153912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.153983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.154036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.154039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.154122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.154191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.154263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.154362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.154442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.154446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.154609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.154684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.154755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.154826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.154872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.154875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.154952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:34.155021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:34.155095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:34.155174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:34.155226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:34.155229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:34.155330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967105:5230], now have 1 active actors on pipe
2025-10-10T14:36:34.155680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601979008967105:5230]
2025-10-10T14:36:34.155715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:34.155791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:34.155803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:34.155837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2054 reason: error at write: Disconnected sessionId: src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0
2025-10-10T14:36:34.155899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:34.156205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:34.156216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0] Write session will restart in 0.009996s
2025-10-10T14:36:34.156245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0] Write session: Do CDS request
2025-10-10T14:36:34.156252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:34.156044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2054 sessionId: src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0 is DEAD
2025-10-10T14:36:34.167920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.168013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:34.168031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2055
2025-10-10T14:36:34.168165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.168201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:34.168213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:34.168218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:34.169085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2055 sessionId:  describe result for acl check
2025-10-10T14:36:34.169130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:34.169138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:34.169140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:34.169147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601979008967222:8411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:34.169733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601979008967222:8411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:34.169596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:34.171840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:34.172066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:34.172079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:34.172092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:34.172149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:34.172194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601978226737193:3853]
2025-10-10T14:36:34.172265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601979008967222:8411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:34.172867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:34.173269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:34.173320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:34.173720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:34.173794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.173801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.173802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.173804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.173805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.173806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.173807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.173808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.173810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.173811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.173812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.173814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.173815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.173822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.173836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.173840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.173844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.173848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.173852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.173856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.173861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.173865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.173869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.173874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.173878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.173883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.173891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.173900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.173907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.173913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.173918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.173924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.173928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.173940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.173945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.173950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.173955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.173961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.173966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.173971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.173976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.173982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.173987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.173998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.174003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.174008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.174018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.174024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.174033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.174039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.174044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.174050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.174097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:34.174817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601979008967222:8411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:34.174833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601979008967222:8411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:34.174836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601979008967222:8411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:34.174845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:34.176587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:34.177061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:34.177079Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:34.177081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:34.177085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:34.177091Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2054 [2:7559601978226737193:3853]
2025-10-10T14:36:34.177105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:34.177123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:34.177129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.177133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.177136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.177154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:34.177164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:34.177173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:34.177234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.177243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.177245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.177247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:34.177316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:34.177323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.177353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.177370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.177387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:34.177414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967119:2438], now have 1 active actors on pipe
2025-10-10T14:36:34.177423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967256:8411], now have 1 active actors on pipe
2025-10-10T14:36:34.177430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601978226737188:3853]
2025-10-10T14:36:34.177432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601978226737188:3853]
2025-10-10T14:36:34.177435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601978226737188:3853]
2025-10-10T14:36:34.177450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:34.177466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:34.177486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:34.177495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:34.177508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:34.177512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:34.177514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:34.177480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2054
2025-10-10T14:36:34.177520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601978226737188:3853]
2025-10-10T14:36:34.177523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:34.177481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2054
2025-10-10T14:36:34.177558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:34.177623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.177637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.177683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:34.177697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.177703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.177706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:34.177718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.177738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:34.177760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.177960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.177974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.177995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.178105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2055 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0
2025-10-10T14:36:34.178527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|121f6ac9-130b7070-99d2681f-52fbb21a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:34.181474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0] Write session: try to update token
2025-10-10T14:36:34.181494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:34.196904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId: src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:34.198639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:34.198668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:34.198672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:34.198674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:34.198686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601978226737188:3853]
2025-10-10T14:36:34.198692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601978226737188:3853]
2025-10-10T14:36:34.198698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601978226737188:3853]
2025-10-10T14:36:34.198761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:34.198762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:34.198769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:34.198773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:34.198780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.198783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:34.198968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:34.200474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:34.253479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601979008967263:5230]
2025-10-10T14:36:34.253924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2054, pipe: [1:7559601979008967263:5230]
2025-10-10T14:36:34.316698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:34.317124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.317144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.317193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967263:5230], now have 1 active actors on pipe
2025-10-10T14:36:34.317516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:34.318262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:34.318273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0] Write session will restart in 0.006822s
2025-10-10T14:36:34.317701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601979008967263:5230]
2025-10-10T14:36:34.318299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0] Write session: Do CDS request
2025-10-10T14:36:34.318328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:34.317740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:34.317782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:34.317862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2055 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0
2025-10-10T14:36:34.318065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2055 sessionId: src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0 is DEAD
2025-10-10T14:36:34.325956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.326063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:34.326083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2056
2025-10-10T14:36:34.327219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.327269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:34.327281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:34.327286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:34.327698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2056 sessionId:  describe result for acl check
2025-10-10T14:36:34.327738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:34.327747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:34.327750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:34.327755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601979008967274:8407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:34.328361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601979008967274:8407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:34.331671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601979008967274:8407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:34.335679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601979008967274:8407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:34.335698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601979008967274:8407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:34.335701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601979008967274:8407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:34.335711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:34.343005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:34.349879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:34.350168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:34.350180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:34.350195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:34.350260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:34.350311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601978226737336:3850]
2025-10-10T14:36:34.350973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:34.354491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:34.354558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:34.354867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:34.354935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.354936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.354938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.354939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.354941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.354942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.354944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.354945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.354946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.354948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.354949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.354951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.354952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.354959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.354970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.354973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.354976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.354978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.354981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.354983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.354985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.354987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.354990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.354993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.354995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.354998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.355005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.355012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.355017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.355020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.355027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.355031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.355036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.355042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.355047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.355054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.355059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.355066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.355071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.355077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.355081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.355085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.355089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.355092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.355095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.355099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.355104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.355108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.355111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.355114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.355117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.355121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.355147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:34.359645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:34.360266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:34.360271Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:34.360274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:34.360278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:34.360286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2055 [2:7559601978226737336:3850]
2025-10-10T14:36:34.360301Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:34.360324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:34.360328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.360332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.360334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.360355Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:34.360364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:34.360389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:34.360459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.360462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.360465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.360468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:34.360559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:34.360562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.360576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.360587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.360603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:34.360627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601978226737331:3850]
2025-10-10T14:36:34.360629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601978226737331:3850]
2025-10-10T14:36:34.360631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601978226737331:3850]
2025-10-10T14:36:34.360649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:34.360669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:34.360687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:34.360690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:34.360693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:34.360696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:34.360699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:34.360730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601978226737331:3850]
2025-10-10T14:36:34.360734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:34.360780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:34.361112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2055
2025-10-10T14:36:34.361159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2055
2025-10-10T14:36:34.361249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967310:8407], now have 1 active actors on pipe
2025-10-10T14:36:34.361261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967265:2438], now have 1 active actors on pipe
2025-10-10T14:36:34.361277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.361288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.361350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89871196-df78fff8-7603c25-70401120_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:34.361364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.361370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.361372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:34.361389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.361403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:34.361424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.364986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.365007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.365045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.365250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2056 partition: 0 MaxSeqNo: 40 sessionId: src_id|89871196-df78fff8-7603c25-70401120_0
2025-10-10T14:36:34.365740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe042ecb-913b012-86ef6c5e-35f589c6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|89871196-df78fff8-7603c25-70401120_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:34.368637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89871196-df78fff8-7603c25-70401120_0] Write session: try to update token
2025-10-10T14:36:34.368661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89871196-df78fff8-7603c25-70401120_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:34.382854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:34.382878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:34.382882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:34.382884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:34.382900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601978226737331:3850]
2025-10-10T14:36:34.382905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601978226737331:3850]
2025-10-10T14:36:34.382909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601978226737331:3850]
2025-10-10T14:36:34.382961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:34.382969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.382972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:34.382975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:34.382982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:34.382988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:34.383117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:34.385915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId: src_id|89871196-df78fff8-7603c25-70401120_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:34.388865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:34.417896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601979008967410:5230]
2025-10-10T14:36:34.421645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2055, pipe: [1:7559601979008967410:5230]
2025-10-10T14:36:34.515152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:34.515462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.515473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.515521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967410:5230], now have 1 active actors on pipe
2025-10-10T14:36:34.515810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:34.515812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601979008967410:5230]
2025-10-10T14:36:34.515828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:34.515835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:34.515910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2056 reason: error at write: Disconnected sessionId: src_id|89871196-df78fff8-7603c25-70401120_0
2025-10-10T14:36:34.515787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:34.516113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2056 sessionId: src_id|89871196-df78fff8-7603c25-70401120_0 is DEAD
2025-10-10T14:36:34.516295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89871196-df78fff8-7603c25-70401120_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:34.516307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89871196-df78fff8-7603c25-70401120_0] Write session will restart in 0.006475s
2025-10-10T14:36:34.516331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89871196-df78fff8-7603c25-70401120_0] Write session: Do CDS request
2025-10-10T14:36:34.516340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89871196-df78fff8-7603c25-70401120_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:34.523911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89871196-df78fff8-7603c25-70401120_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.523987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:34.524005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2057
2025-10-10T14:36:34.524170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.524214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:34.524220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:34.524224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:34.524722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2057 sessionId:  describe result for acl check
2025-10-10T14:36:34.524766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:34.524772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:34.524774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:34.524781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601979008967429:8403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:34.525402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601979008967429:8403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:34.528020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601979008967429:8403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:34.531325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:34.531705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601979008967429:8403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:34.531724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601979008967429:8403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:34.531728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601979008967429:8403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:34.531737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:34.534360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:34.534619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:34.534632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:34.534645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:34.534702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:34.534761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601978226737480:3843]
2025-10-10T14:36:34.535359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:34.535757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:34.535820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:34.536213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:34.536273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.536279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.536281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.536282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.536283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.536285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.536286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.536287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.536289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.536290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.536292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.536293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.536294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.536301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.536315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.536319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.536324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.536328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.536332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.536337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.536341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.536345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.536350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.536354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.536359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.536363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.536371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.536380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.536387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.536392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.536397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.536407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.536412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.536418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.536423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.536433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.536438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.536444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.536454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.536459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.536465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.536485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.536490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.536497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.536506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.536512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.536521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.536527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.536532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.536541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.536546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.536552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.536594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:34.539271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:34.539890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:34.539906Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:34.539910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:34.539914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:34.539923Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2056 [2:7559601978226737480:3843]
2025-10-10T14:36:34.539938Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:34.539958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:34.539966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.539970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.539972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.539992Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:34.540004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:34.540017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:34.540085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.540092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.540094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.540097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:34.540339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2056
2025-10-10T14:36:34.540172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:34.540182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.540194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.540206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.540222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:34.540245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967548:8403], now have 1 active actors on pipe
2025-10-10T14:36:34.540516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2056
2025-10-10T14:36:34.540249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967414:2438], now have 1 active actors on pipe
2025-10-10T14:36:34.540257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601978226737474:3843]
2025-10-10T14:36:34.540259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601978226737474:3843]
2025-10-10T14:36:34.540261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601978226737474:3843]
2025-10-10T14:36:34.540276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:34.540288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:34.540289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:34.540291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:34.540293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:34.540305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:34.540309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:34.540343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601978226737474:3843]
2025-10-10T14:36:34.540346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:34.540374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:34.540379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.540384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.540415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3930840a-49d696ad-2e372b52-64823858_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:34.540423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.540426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.540429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:34.540442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.540453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:34.540484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.540591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.540594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.540608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.540822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2057 partition: 0 MaxSeqNo: 40 sessionId: src_id|3930840a-49d696ad-2e372b52-64823858_0
2025-10-10T14:36:34.541319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89871196-df78fff8-7603c25-70401120_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3930840a-49d696ad-2e372b52-64823858_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:34.544200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3930840a-49d696ad-2e372b52-64823858_0] Write session: try to update token
2025-10-10T14:36:34.544222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3930840a-49d696ad-2e372b52-64823858_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:34.560697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:34.560721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:34.560725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:34.560726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:34.560737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601978226737474:3843]
2025-10-10T14:36:34.560742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601978226737474:3843]
2025-10-10T14:36:34.560746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601978226737474:3843]
2025-10-10T14:36:34.560794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:34.560798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:34.560806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.560809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:34.560811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:34.560816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:34.560975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:34.561374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId: src_id|3930840a-49d696ad-2e372b52-64823858_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:34.563970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:34.615970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601979008967563:5230]
2025-10-10T14:36:34.616272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2056, pipe: [1:7559601979008967563:5230]
2025-10-10T14:36:34.682011Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:34.682381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.682397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.682444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967563:5230], now have 1 active actors on pipe
2025-10-10T14:36:34.682715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:34.683042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:34.683099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601979008967563:5230]
2025-10-10T14:36:34.683119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:34.683197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2057 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3930840a-49d696ad-2e372b52-64823858_0
2025-10-10T14:36:34.683395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2057 sessionId: src_id|3930840a-49d696ad-2e372b52-64823858_0 is DEAD
2025-10-10T14:36:34.683621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3930840a-49d696ad-2e372b52-64823858_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:34.683635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3930840a-49d696ad-2e372b52-64823858_0] Write session will restart in 0.006213s
2025-10-10T14:36:34.683663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3930840a-49d696ad-2e372b52-64823858_0] Write session: Do CDS request
2025-10-10T14:36:34.683670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3930840a-49d696ad-2e372b52-64823858_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:34.690924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3930840a-49d696ad-2e372b52-64823858_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.690994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:34.691012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2058
2025-10-10T14:36:34.691280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.691334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:34.691344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:34.691348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:34.691801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2058 sessionId:  describe result for acl check
2025-10-10T14:36:34.691835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:34.691841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:34.691843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:34.691849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601979008967583:8400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:34.692444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601979008967583:8400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:34.694458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601979008967583:8400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:34.698453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601979008967583:8400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:34.698467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601979008967583:8400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:34.698472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601979008967583:8400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:34.698482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:34.700945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:34.703032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:34.703271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:34.703283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:34.703295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:34.703347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:34.703396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601978226737624:3841]
2025-10-10T14:36:34.704049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:34.704455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:34.704529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:34.704892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:34.704956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.704963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.704964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.704966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.704967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.704969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.704970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.704971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.704973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.704975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.704977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.704978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.704979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.704986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.705000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.705005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.705009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.705013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.705018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.705022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.705026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.705030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.705035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.705039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.705044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.705048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.705056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.705066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.705073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.705082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.705087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.705093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.705099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.705105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.705110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.705122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.705128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.705134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.705139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.705144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.705149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.705156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.705161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.705166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.705171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.705177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.705182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.705187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.705194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.705201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.705213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.705219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.705267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:34.707867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:34.708209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:34.708221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:34.708224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:34.708228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:34.708235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2057 [2:7559601978226737624:3841]
2025-10-10T14:36:34.708249Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:34.708268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:34.708276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.708279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.708282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.708298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:34.708307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:34.708320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:34.708387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.708394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.708396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.708399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:34.708491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:34.708499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.708510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.708523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.708541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:34.708570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967566:2438], now have 1 active actors on pipe
2025-10-10T14:36:34.708580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967700:8400], now have 1 active actors on pipe
2025-10-10T14:36:34.708588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601978226737619:3841]
2025-10-10T14:36:34.708591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601978226737619:3841]
2025-10-10T14:36:34.708594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601978226737619:3841]
2025-10-10T14:36:34.708608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:34.708623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:34.708598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2057
2025-10-10T14:36:34.708641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:34.708651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:34.708654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:34.708658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:34.708659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:34.708661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2057
2025-10-10T14:36:34.708678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601978226737619:3841]
2025-10-10T14:36:34.708686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:34.708688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:34.708725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.708735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.708776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed24ae62-90082fb2-403b4e74-1da59692_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:34.708789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.708794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.708797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:34.708810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.708826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:34.708845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.709006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.709015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.709030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.709156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2058 partition: 0 MaxSeqNo: 40 sessionId: src_id|ed24ae62-90082fb2-403b4e74-1da59692_0
2025-10-10T14:36:34.709569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3930840a-49d696ad-2e372b52-64823858_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ed24ae62-90082fb2-403b4e74-1da59692_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:34.712327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed24ae62-90082fb2-403b4e74-1da59692_0] Write session: try to update token
2025-10-10T14:36:34.712346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed24ae62-90082fb2-403b4e74-1da59692_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:34.735424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:34.735452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:34.735456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:34.735458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:34.735469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601978226737619:3841]
2025-10-10T14:36:34.735474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601978226737619:3841]
2025-10-10T14:36:34.735477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601978226737619:3841]
2025-10-10T14:36:34.735536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:34.735553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.735556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:34.735707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:34.737724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:34.737743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:34.737747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:34.739583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId: src_id|ed24ae62-90082fb2-403b4e74-1da59692_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:34.742411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:34.783431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601979008967723:5230]
2025-10-10T14:36:34.783763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2057, pipe: [1:7559601979008967723:5230]
2025-10-10T14:36:34.854417Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:34.854843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.854860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.854906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967723:5230], now have 1 active actors on pipe
2025-10-10T14:36:34.855299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:34.855358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601979008967723:5230]
2025-10-10T14:36:34.855378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:34.855383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:34.855444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2058 reason: error at write: Disconnected sessionId: src_id|ed24ae62-90082fb2-403b4e74-1da59692_0
2025-10-10T14:36:34.855648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2058 sessionId: src_id|ed24ae62-90082fb2-403b4e74-1da59692_0 is DEAD
2025-10-10T14:36:34.855397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:34.856161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed24ae62-90082fb2-403b4e74-1da59692_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:34.856183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed24ae62-90082fb2-403b4e74-1da59692_0] Write session will restart in 0.005036s
2025-10-10T14:36:34.856206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed24ae62-90082fb2-403b4e74-1da59692_0] Write session: Do CDS request
2025-10-10T14:36:34.856212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed24ae62-90082fb2-403b4e74-1da59692_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:34.862871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed24ae62-90082fb2-403b4e74-1da59692_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.863214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:34.863230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2059
2025-10-10T14:36:34.863348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:34.863379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:34.863385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:34.863389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:34.863822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2059 sessionId:  describe result for acl check
2025-10-10T14:36:34.863850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:34.863852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:34.863854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:34.863861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601979008967741:8385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:34.864456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601979008967741:8385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:34.868023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601979008967741:8385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:34.874482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601979008967741:8385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:34.874505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601979008967741:8385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:34.874509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601979008967741:8385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:34.874521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:34.876790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:34.879228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:34.879433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:34.879444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:34.879457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:34.879507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:34.879557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601978226737769:3838]
2025-10-10T14:36:34.879979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:34.880240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:34.880285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:34.880570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:34.880634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.880639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.880640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.880642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.880643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.880644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.880645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.880647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.880648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.880649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.880651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.880652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.880653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.880659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.880673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.880678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.880682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.880687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.880691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.880695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.880699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.880703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.880708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.880712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.880716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.880721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.880729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.880743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:34.880751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.880757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:34.880763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.880775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:34.880780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.880785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:34.880790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.880794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:34.880799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.880805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:34.880809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.880814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:34.880819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.880825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:34.880830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.880837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:34.880841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.880850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:34.880856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.880861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.880866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.880876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.880881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.880887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.880932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:34.887560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:34.887998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:34.888015Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:34.888018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:34.888022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:34.888030Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2058 [2:7559601978226737769:3838]
2025-10-10T14:36:34.888046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:34.888069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:34.888072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.888076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.888079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.888098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:34.888107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:34.888116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:34.888186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.888189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.888191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.888194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:34.888271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:34.888274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.888287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:34.888300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:34.888319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:34.888341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601978226737764:3838]
2025-10-10T14:36:34.888344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601978226737764:3838]
2025-10-10T14:36:34.888346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601978226737764:3838]
2025-10-10T14:36:34.888361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:34.888379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:34.888397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:34.888401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:34.888451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601978226737764:3838]
2025-10-10T14:36:34.888453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:34.890506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2058
2025-10-10T14:36:34.890567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2058
2025-10-10T14:36:34.889995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:34.890007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:34.890010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:34.890011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967725:2438], now have 1 active actors on pipe
2025-10-10T14:36:34.890018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:34.890019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967859:8385], now have 1 active actors on pipe
2025-10-10T14:36:34.892733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2059 partition: 0 MaxSeqNo: 40 sessionId: src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0
2025-10-10T14:36:34.893313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed24ae62-90082fb2-403b4e74-1da59692_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:34.896193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0] Write session: try to update token
2025-10-10T14:36:34.896215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:34.891023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.891038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.891078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:34.891092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:34.891099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:34.891102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:34.891130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:34.891149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:34.891177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.892503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.892513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.892546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:34.914305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId: src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:34.917032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:34.919052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:34.919084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:34.919111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:34.919115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:34.919118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:34.919120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:34.919133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601978226737764:3838]
2025-10-10T14:36:34.919138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601978226737764:3838]
2025-10-10T14:36:34.919142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601978226737764:3838]
2025-10-10T14:36:34.919205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:34.919208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:34.919216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:34.919219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:34.919221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:34.919227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:34.919364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:34.957487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601979008967874:5230]
2025-10-10T14:36:34.958691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2058, pipe: [1:7559601979008967874:5230]
2025-10-10T14:36:35.037238Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:35.037817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:35.037908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601979008967874:5230], now have 1 active actors on pipe
2025-10-10T14:36:35.038466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:35.038488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:35.038543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601979008967874:5230]
2025-10-10T14:36:35.038588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:35.038591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:35.038682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2059 reason: error at write: Disconnected sessionId: src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0
2025-10-10T14:36:35.038868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2059 sessionId: src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0 is DEAD
2025-10-10T14:36:35.039277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:35.039287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0] Write session will restart in 0.009764s
2025-10-10T14:36:35.039311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0] Write session: Do CDS request
2025-10-10T14:36:35.039317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:35.049969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.050052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:35.050068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2060
2025-10-10T14:36:35.050232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.050282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:35.050303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:35.050308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:35.050793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2060 sessionId:  describe result for acl check
2025-10-10T14:36:35.050832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:35.050838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:35.050840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:35.050847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601983303935291:8382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:35.051456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601983303935291:8382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:35.051672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:35.053804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:35.053896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601983303935291:8382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:35.054054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:35.054075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:35.054089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:35.054155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:35.054200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601982521705228:3828]
2025-10-10T14:36:35.054826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:35.055211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:35.055263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:35.055606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:35.055675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.055683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.055684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.055686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.055687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.055688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.055689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.055690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.055692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.055693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.055694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.055695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.055696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.055702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.055726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.055730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.055734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.055737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.055741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.055744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.055747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.055751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.055755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.055758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.055761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.055765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.055773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.055780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.055784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.055788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.055791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.055794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.055799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.055804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.055809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.055813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.055816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.055820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.055826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.055831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.055835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.055841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.055846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.055851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.055855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.055860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.055864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.055868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.055872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.055876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.055881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.055887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.055925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:35.058432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:35.058489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601983303935291:8382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:35.058508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601983303935291:8382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:35.058512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601983303935291:8382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:35.058521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:35.058815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:35.058833Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:35.058836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:35.058840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:35.058846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2059 [2:7559601982521705228:3828]
2025-10-10T14:36:35.058862Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:35.058882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:35.058890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.058894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.058896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.058926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:35.058937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:35.058945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:35.059008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.059017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.059019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.059021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:35.059106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:35.059115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.059129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.059143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.059160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:35.059189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935185:2438], now have 1 active actors on pipe
2025-10-10T14:36:35.059199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935327:8382], now have 1 active actors on pipe
2025-10-10T14:36:35.059204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2059
2025-10-10T14:36:35.059207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601982521705219:3828]
2025-10-10T14:36:35.059211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601982521705219:3828]
2025-10-10T14:36:35.059250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2059
2025-10-10T14:36:35.059213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601982521705219:3828]
2025-10-10T14:36:35.059226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:35.059239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:35.059241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:35.059244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:35.059246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:35.059255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:35.059258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:35.059288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601982521705219:3828]
2025-10-10T14:36:35.059295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:35.059302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:35.059432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.059444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.059475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e5ca8e4-139aba95-94143b62-347e071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:35.059489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.059493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.059496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:35.059508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.059524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:35.059544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.059690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.059702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.059717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.059857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2060 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e5ca8e4-139aba95-94143b62-347e071_0
2025-10-10T14:36:35.060277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8705cc97-60b09a52-7bb6e173-72164a8c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e5ca8e4-139aba95-94143b62-347e071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:35.063047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ca8e4-139aba95-94143b62-347e071_0] Write session: try to update token
2025-10-10T14:36:35.063066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ca8e4-139aba95-94143b62-347e071_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:35.083606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId: src_id|9e5ca8e4-139aba95-94143b62-347e071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:35.085430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:35.085473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:35.085477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:35.085480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:35.085491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601982521705219:3828]
2025-10-10T14:36:35.085495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601982521705219:3828]
2025-10-10T14:36:35.085501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601982521705219:3828]
2025-10-10T14:36:35.085569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:35.085572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:35.085580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:35.085580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.085584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:35.085585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:35.085747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:35.086329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:35.138707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601983303935359:5230]
2025-10-10T14:36:35.139073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2059, pipe: [1:7559601983303935359:5230]
2025-10-10T14:36:35.203369Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:35.203855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.203873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.203937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935359:5230], now have 1 active actors on pipe
2025-10-10T14:36:35.204220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:35.204284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601983303935359:5230]
2025-10-10T14:36:35.204316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:35.204712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:35.204796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2060 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e5ca8e4-139aba95-94143b62-347e071_0
2025-10-10T14:36:35.205012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2060 sessionId: src_id|9e5ca8e4-139aba95-94143b62-347e071_0 is DEAD
2025-10-10T14:36:35.205201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ca8e4-139aba95-94143b62-347e071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:35.205214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ca8e4-139aba95-94143b62-347e071_0] Write session will restart in 0.009001s
2025-10-10T14:36:35.205242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ca8e4-139aba95-94143b62-347e071_0] Write session: Do CDS request
2025-10-10T14:36:35.205249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ca8e4-139aba95-94143b62-347e071_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:35.215967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ca8e4-139aba95-94143b62-347e071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.216075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:35.216095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2061
2025-10-10T14:36:35.216241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.216283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:35.216295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:35.216299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:35.216805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2061 sessionId:  describe result for acl check
2025-10-10T14:36:35.216841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:35.216847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:35.216849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:35.216856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601983303935376:8365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:35.217450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601983303935376:8365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:35.220213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601983303935376:8365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:35.222643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601983303935376:8365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:35.222661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601983303935376:8365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:35.222664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601983303935376:8365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:35.222673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:35.223630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:35.226264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:35.226500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:35.226512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:35.226524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:35.226578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:35.226625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601982521705411:3812]
2025-10-10T14:36:35.227254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:35.227586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:35.227625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:35.227931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:35.227985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.227991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.227992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.227993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.227994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.227995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.227996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.227997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.227999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.228000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.228002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.228003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.228004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.228010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.228022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.228026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.228030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.228033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.228037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.228041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.228044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.228048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.228052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.228055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.228059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.228063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.228070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.228079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.228085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.228091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.228095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.228100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.228109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.228117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.228127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.228132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.228136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.228140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.228145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.228149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.228153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.228157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.228161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.228167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.228171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.228175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.228182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.228186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.228194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.228199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.228203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.228208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.228245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:35.231023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:35.231377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:35.231388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:35.231391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:35.231395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:35.231402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2060 [2:7559601982521705411:3812]
2025-10-10T14:36:35.231417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:35.231436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:35.231440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.231443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.231445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.231464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:35.231472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:35.231486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:35.231553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.231560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.231562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.231564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:35.231637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:35.231645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.231655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.231665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.231685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:35.231711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935500:8365], now have 1 active actors on pipe
2025-10-10T14:36:35.231723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935360:2438], now have 1 active actors on pipe
2025-10-10T14:36:35.231731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601982521705406:3812]
2025-10-10T14:36:35.231734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601982521705406:3812]
2025-10-10T14:36:35.231736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601982521705406:3812]
2025-10-10T14:36:35.231753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:35.231767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:35.231777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:35.231782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:35.231782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:35.231784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:35.231785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:35.231786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2060
2025-10-10T14:36:35.231788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2060
2025-10-10T14:36:35.231814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601982521705406:3812]
2025-10-10T14:36:35.231825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:35.231828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:35.231856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.231860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.231898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:35.231905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.231909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.231912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:35.231925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.231936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:35.231959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.232229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.232245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.232283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.232414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2061 partition: 0 MaxSeqNo: 40 sessionId: src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0
2025-10-10T14:36:35.232895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5ca8e4-139aba95-94143b62-347e071_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:35.235973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0] Write session: try to update token
2025-10-10T14:36:35.235998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:35.251552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId: src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:35.254504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:35.254763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.254790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.254836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:35.254995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:35.257802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:35.257823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:35.257827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:35.257829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:35.257841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601982521705406:3812]
2025-10-10T14:36:35.257849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601982521705406:3812]
2025-10-10T14:36:35.257854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601982521705406:3812]
2025-10-10T14:36:35.257908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:35.257922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.257925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:35.257925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:35.257942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:35.257956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:35.258069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:35.304755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601983303935519:5230]
2025-10-10T14:36:35.305070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2060, pipe: [1:7559601983303935519:5230]
2025-10-10T14:36:35.381368Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:35.395411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.395445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.395641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.395712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.395773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.395843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.395896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.395907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.395982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.396052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.396120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.396200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.396248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.396257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.396327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.396396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.396473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.396541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.396588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.396596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.396660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.396722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.396788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.396851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.396898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.396901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.396967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.397029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.397096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.397163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.397214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.397222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.397293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.397379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.397448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.397513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.397559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.397566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.397639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.397711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.397780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.397846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.397896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.397905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.397970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.398034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.398100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.398165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.398214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.398221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.398292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.398356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.398424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.398490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.398535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.398542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.398613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.398676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.398746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.398811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.398862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.398870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.398941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935519:5230], now have 1 active actors on pipe
2025-10-10T14:36:35.399294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:35.399312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:35.399327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601983303935519:5230]
2025-10-10T14:36:35.399345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2061 reason: error at write: Disconnected sessionId: src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0
2025-10-10T14:36:35.399355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:35.399563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2061 sessionId: src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0 is DEAD
2025-10-10T14:36:35.399734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:35.399746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0] Write session will restart in 0.009223s
2025-10-10T14:36:35.399774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0] Write session: Do CDS request
2025-10-10T14:36:35.399780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:35.399977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:35.409874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.410685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:35.410704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2062
2025-10-10T14:36:35.410838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.410874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:35.410884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:35.410889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:35.411339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2062 sessionId:  describe result for acl check
2025-10-10T14:36:35.411372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:35.411375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:35.411376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:35.411382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601983303935600:8359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:35.411943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601983303935600:8359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:35.414738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601983303935600:8359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:35.414860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:35.417593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:35.417833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:35.417846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:35.417858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:35.417914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:35.417962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601982521705558:3804]
2025-10-10T14:36:35.418635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:35.419032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:35.419091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:35.419427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:35.419493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.419499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.419500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.419502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.419504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.419505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.419506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.419508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.419509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.419510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.419511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.419513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.419514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.419520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.419534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.419539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.419543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.419548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.419552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.419556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.419560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.419565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.419570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.419574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.419578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.419582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.419592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.419601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.419608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.419614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.419619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.419624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.419629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.419635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.419640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.419646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.419651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.419656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.419661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.419667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.419672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.419677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.419688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.419693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.419703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.419709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.419719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.419724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.419729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.419734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.419739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.419745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.419786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:35.419758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601983303935600:8359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:35.419777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601983303935600:8359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:35.419781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601983303935600:8359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:35.419790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:35.422511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:35.422874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:35.422890Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:35.422893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:35.422897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:35.422906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2061 [2:7559601982521705558:3804]
2025-10-10T14:36:35.422919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:35.422939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:35.422947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.422952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.422955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.422974Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:35.422986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:35.422994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:35.423059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.423065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.423067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.423070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:35.423140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:35.423147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.423159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.423176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.423199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:35.423227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935522:2438], now have 1 active actors on pipe
2025-10-10T14:36:35.423231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935664:8359], now have 1 active actors on pipe
2025-10-10T14:36:35.423238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601982521705553:3804]
2025-10-10T14:36:35.423240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601982521705553:3804]
2025-10-10T14:36:35.423242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601982521705553:3804]
2025-10-10T14:36:35.423257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:35.423282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:35.423305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:35.423313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:35.423303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2061
2025-10-10T14:36:35.423314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2061
2025-10-10T14:36:35.423348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601982521705553:3804]
2025-10-10T14:36:35.423356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:35.423346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:35.423367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:35.423371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:35.423378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:35.423396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.423408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.423446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be546c2d-2e7449e-4ad2855-af545e6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:35.423458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.423462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.423465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:35.423476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.423487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:35.423506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.423674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.423684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.423701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.423783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2062 partition: 0 MaxSeqNo: 40 sessionId: src_id|be546c2d-2e7449e-4ad2855-af545e6f_0
2025-10-10T14:36:35.424196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bca6dbfe-96d62a88-5275102f-ed9c4fdf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|be546c2d-2e7449e-4ad2855-af545e6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:35.431869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be546c2d-2e7449e-4ad2855-af545e6f_0] Write session: try to update token
2025-10-10T14:36:35.431895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be546c2d-2e7449e-4ad2855-af545e6f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:35.445471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:35.445490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:35.445493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:35.445495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:35.445506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601982521705553:3804]
2025-10-10T14:36:35.445511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601982521705553:3804]
2025-10-10T14:36:35.445516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601982521705553:3804]
2025-10-10T14:36:35.445567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:35.445569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:35.445577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:35.445579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.445581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:35.445582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:35.445730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:35.448144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId: src_id|be546c2d-2e7449e-4ad2855-af545e6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:35.455725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:35.499741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601983303935673:5230]
2025-10-10T14:36:35.500088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2061, pipe: [1:7559601983303935673:5230]
2025-10-10T14:36:35.563387Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:35.563968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.563985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.564010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935673:5230], now have 1 active actors on pipe
2025-10-10T14:36:35.564240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:35.564303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601983303935673:5230]
2025-10-10T14:36:35.564431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:35.564451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:35.564517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2062 reason: error at write: Disconnected sessionId: src_id|be546c2d-2e7449e-4ad2855-af545e6f_0
2025-10-10T14:36:35.564244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:35.564721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2062 sessionId: src_id|be546c2d-2e7449e-4ad2855-af545e6f_0 is DEAD
2025-10-10T14:36:35.564897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be546c2d-2e7449e-4ad2855-af545e6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:35.564909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be546c2d-2e7449e-4ad2855-af545e6f_0] Write session will restart in 0.005519s
2025-10-10T14:36:35.564936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be546c2d-2e7449e-4ad2855-af545e6f_0] Write session: Do CDS request
2025-10-10T14:36:35.564942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be546c2d-2e7449e-4ad2855-af545e6f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:35.571942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be546c2d-2e7449e-4ad2855-af545e6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.572014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:35.572030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2063
2025-10-10T14:36:35.572218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.572274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:35.572286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:35.572291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:35.573008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2063 sessionId:  describe result for acl check
2025-10-10T14:36:35.573049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:35.573051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:35.573053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:35.573060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601983303935702:8356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:35.573714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601983303935702:8356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:35.576531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601983303935702:8356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:35.577715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:35.580122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:35.580374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:35.580387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:35.580399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:35.580476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:35.580530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601982521705707:3802]
2025-10-10T14:36:35.580541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601983303935702:8356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:35.580572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601983303935702:8356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:35.580576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601983303935702:8356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:35.580586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:35.581174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:35.581477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:35.581528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:35.581875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:35.581941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.581949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.581950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.581951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.581953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.581955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.581956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.581957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.581958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.581959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.581961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.581962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.581963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.581970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.581983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.581987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.581992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.581997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.582001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.582006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.582010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.582015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.582021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.582025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.582029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.582034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.582042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.582050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.582058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.582064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.582069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.582075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.582080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.582086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.582096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.582102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.582106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.582112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.582122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.582127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.582137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.582144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.582157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.582163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.582169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.582175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.582180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.582186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.582195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.582201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.582206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.582217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.582260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:35.584835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:35.585200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:35.585216Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:35.585220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:35.585223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:35.585230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2062 [2:7559601982521705707:3802]
2025-10-10T14:36:35.585256Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:35.585276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:35.585284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.585288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.585290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.585307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:35.585316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:35.585325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:35.585405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.585415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.585418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.585421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:35.585618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2062
2025-10-10T14:36:35.585668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2062
2025-10-10T14:36:35.585498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:35.585508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.585520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.585533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.585551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:35.585576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935816:8356], now have 1 active actors on pipe
2025-10-10T14:36:35.585580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935675:2438], now have 1 active actors on pipe
2025-10-10T14:36:35.585588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601982521705702:3802]
2025-10-10T14:36:35.585591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601982521705702:3802]
2025-10-10T14:36:35.585594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601982521705702:3802]
2025-10-10T14:36:35.585608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:35.585621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:35.585623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:35.585625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:35.585627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:35.585641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:35.585644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:35.585688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.585692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.585708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601982521705702:3802]
2025-10-10T14:36:35.585718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:35.585749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:35.585750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:35.585757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.585762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.585765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:35.585776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.585786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:35.585813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.585973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.585987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.586011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.586117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2063 partition: 0 MaxSeqNo: 40 sessionId: src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0
2025-10-10T14:36:35.586534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be546c2d-2e7449e-4ad2855-af545e6f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:35.589403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0] Write session: try to update token
2025-10-10T14:36:35.589421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:35.604180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId: src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:35.609134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:35.611615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.611645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.611672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:35.611675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:35.611679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:35.611681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:35.611691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601982521705702:3802]
2025-10-10T14:36:35.611695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601982521705702:3802]
2025-10-10T14:36:35.611699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601982521705702:3802]
2025-10-10T14:36:35.611758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:35.611766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:35.611770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:35.611771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:35.611779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.611782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:35.611927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:35.664584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601983303935827:5230]
2025-10-10T14:36:35.665701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2062, pipe: [1:7559601983303935827:5230]
2025-10-10T14:36:35.735877Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:35.736419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:35.736495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935827:5230], now have 1 active actors on pipe
2025-10-10T14:36:35.736622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:35.736706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:35.736745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:35.736753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:35.736770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601983303935827:5230]
2025-10-10T14:36:35.736830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2063 reason: error at write: Disconnected sessionId: src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0
2025-10-10T14:36:35.737010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2063 sessionId: src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0 is DEAD
2025-10-10T14:36:35.737174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:35.737181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0] Write session will restart in 0.008345s
2025-10-10T14:36:35.737207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0] Write session: Do CDS request
2025-10-10T14:36:35.737213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:35.746894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.746974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:35.746991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2064
2025-10-10T14:36:35.747153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.747199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:35.747211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:35.747215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:35.747764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2064 sessionId:  describe result for acl check
2025-10-10T14:36:35.747806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:35.747808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:35.747809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:35.747817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601983303935923:8345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:35.748405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601983303935923:8345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:35.750488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:35.750749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601983303935923:8345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:35.752721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:35.752958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:35.752969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:35.752981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:35.753037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:35.753083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601982521705857:3797]
2025-10-10T14:36:35.753240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601983303935923:8345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:35.753254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601983303935923:8345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:35.753257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601983303935923:8345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:35.753265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:35.753728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:35.754055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:35.754099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:35.754429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:35.754486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.754493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.754494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.754496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.754497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.754498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.754500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.754501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.754502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.754504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.754505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.754507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.754508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.754514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.754528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.754532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.754536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.754540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.754545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.754549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.754554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.754558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.754563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.754567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.754571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.754575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.754582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.754591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.754598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.754604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.754608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.754614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.754619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.754624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.754629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.754640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.754644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.754650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.754660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.754666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.754671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.754675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.754681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.754686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.754690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.754695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.754700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.754706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.754711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.754716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.754725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.754730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.754772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:35.757659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:35.758031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:35.758045Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:35.758047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:35.758051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:35.758058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2063 [2:7559601982521705857:3797]
2025-10-10T14:36:35.758072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:35.758092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:35.758095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.758098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.758101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.758119Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:35.758132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:35.758145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:35.758230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.758239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.758241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.758244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:35.758313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:35.758320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.758333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.758350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.758369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:35.758398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601982521705852:3797]
2025-10-10T14:36:35.758405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601982521705852:3797]
2025-10-10T14:36:35.758407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601982521705852:3797]
2025-10-10T14:36:35.758417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:35.758432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:35.758435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:35.758443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:35.758445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:35.758451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:35.758456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:35.758468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935979:8345], now have 1 active actors on pipe
2025-10-10T14:36:35.758471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935836:2438], now have 1 active actors on pipe
2025-10-10T14:36:35.758497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601982521705852:3797]
2025-10-10T14:36:35.758510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:35.758519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:35.758701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2063
2025-10-10T14:36:35.758703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2063
2025-10-10T14:36:35.758894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.758910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.758944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:35.758959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.758963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.758966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:35.758980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.758997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:35.759018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.759215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.759225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.759250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.759360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2064 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0
2025-10-10T14:36:35.759753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|218c55d6-ebbca1fd-3bd25204-a8b68892_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:35.762522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0] Write session: try to update token
2025-10-10T14:36:35.762539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:35.776926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:35.776951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:35.776964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601982521705852:3797]
2025-10-10T14:36:35.777351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId: src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:35.780038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:35.780362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:35.777018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:35.777033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:35.777204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:35.777395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:35.777527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:35.777656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:35.777843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:35.777878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:35.780243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.780254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.780293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:35.791474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:35.791497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:35.791501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:35.791503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:35.791514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601982521705852:3797]
2025-10-10T14:36:35.791519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601982521705852:3797]
2025-10-10T14:36:35.791522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601982521705852:3797]
2025-10-10T14:36:35.791572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:35.791576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:35.791581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:35.791583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.791586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:35.791586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:35.791736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:35.837152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601983303935993:5230]
2025-10-10T14:36:35.837439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2063, pipe: [1:7559601983303935993:5230]
2025-10-10T14:36:35.907110Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:35.915946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.915984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.916183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.916253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.916324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.916397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.916990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.917007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.917084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.917148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.917214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.917279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.917323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.917414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.917498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.917561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.917630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.917696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.917742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.917751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.917817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.917882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.917946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.918013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.918058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.918065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.918132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.918202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.918269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.918336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.918381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.918388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.918458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.918519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.918581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.918646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.918696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.918704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.918768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.918829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.918897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.918964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.919010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.919017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.919084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.919148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.919217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.919285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.919330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.919341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.919411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.919478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.919541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.919612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.920722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:35.920734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0] Write session will restart in 0.009221s
2025-10-10T14:36:35.920759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0] Write session: Do CDS request
2025-10-10T14:36:35.920765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:35.920289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601983303935993:5230]
2025-10-10T14:36:35.920306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:35.920310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:35.920344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2064 reason: error at write: Disconnected sessionId: src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0
2025-10-10T14:36:35.920345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:35.920634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2064 sessionId: src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0 is DEAD
2025-10-10T14:36:35.919657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.919669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.919733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:35.919787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:35.919845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:35.919904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:35.919943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:35.919945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:35.920019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935993:5230], now have 1 active actors on pipe
2025-10-10T14:36:35.920934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:35.930928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.931336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:35.931355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2065
2025-10-10T14:36:35.931529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:35.931583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:35.931594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:35.931598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:35.932095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2065 sessionId:  describe result for acl check
2025-10-10T14:36:35.932136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:35.932144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:35.932146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:35.932152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601983303936068:8343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:35.932773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601983303936068:8343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:35.936035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601983303936068:8343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:35.940108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601983303936068:8343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:35.940129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601983303936068:8343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:35.940133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601983303936068:8343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:35.940143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:35.937464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:35.939689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:35.939961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:35.939967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:35.939980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:35.940037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:35.940088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601982521706008:3795]
2025-10-10T14:36:35.940730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:35.941044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:35.941085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:35.941441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:35.941496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.941508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.941509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.941511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.941512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.941514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.941515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.941516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.941518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.941519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.941521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.941522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.941523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.941529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.941543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.941548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.941552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.941556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.941560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.941564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.941569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.941573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.941578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.941582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.941586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.941589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.941597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.941607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:35.941614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.941620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:35.941625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.941630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:35.941635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.941641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:35.941646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.941655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:35.941659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.941668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:35.941673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.941683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:35.941689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.941695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:35.941705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.941711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:35.941715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.941721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:35.941726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.941731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.941736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.941742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.941748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.941754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.941800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:35.944624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:35.945282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:35.945303Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:35.945305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:35.945309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:35.945316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2064 [2:7559601982521706008:3795]
2025-10-10T14:36:35.945350Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:35.945375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:35.945384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.945387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.945390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.945409Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:35.945423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:35.945432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:35.945499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.945507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.945509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.945512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:35.945591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:35.945600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.945614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:35.945631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:35.945651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:35.945677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601982521706003:3795]
2025-10-10T14:36:35.945684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601982521706003:3795]
2025-10-10T14:36:35.945686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601982521706003:3795]
2025-10-10T14:36:35.945703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:35.945720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303935996:2438], now have 1 active actors on pipe
2025-10-10T14:36:35.945725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:35.945728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:35.945728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601983303936138:8343], now have 1 active actors on pipe
2025-10-10T14:36:35.945733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:35.945738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:35.945754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:35.945763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:35.945761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2064
2025-10-10T14:36:35.945792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601982521706003:3795]
2025-10-10T14:36:35.945800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:35.945803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:35.945820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2064
2025-10-10T14:36:35.945938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.945956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.945987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:35.946001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:35.946008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:35.946011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:35.946024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:35.946042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:35.946061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.946317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.946335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.946360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:35.946456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2065 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0
2025-10-10T14:36:35.946875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba66a1d9-d394b1e3-ac049b4-b6667139_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:35.949994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0] Write session: try to update token
2025-10-10T14:36:35.950018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:35.958626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:35.958649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:35.958659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601982521706003:3795]
2025-10-10T14:36:35.958704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:35.958712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:35.958908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:35.959089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:35.959250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:35.959432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:35.959769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:35.959818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:35.968856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId: src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:35.971753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:35.972029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:35.972061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:35.972118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:35.972220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:35.978986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:35.979011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:35.979015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:35.979017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:35.979029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601982521706003:3795]
2025-10-10T14:36:35.979033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601982521706003:3795]
2025-10-10T14:36:35.979038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601982521706003:3795]
2025-10-10T14:36:35.979095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:35.979109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:35.979112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:35.979262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:35.981397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:35.981421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:35.981426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:36.020396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601987598903458:5230]
2025-10-10T14:36:36.021150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2064, pipe: [1:7559601987598903458:5230]
2025-10-10T14:36:36.096967Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:36.105756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.105788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.105983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.106055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.106130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.106206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.106255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.106266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.106353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.106428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.106500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.106580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.106628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.106637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.106712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.106779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.106844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.106913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.106960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.106968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.107046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.107117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.107188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.107258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.107309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.107317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.107393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.107464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.107535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.107603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.107748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.107758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.107831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.107898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.107975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.108045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.108097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.108100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.108171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.108238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.108308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.108375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.108421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.108426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.108515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.108575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.108648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.108730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.108787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.108791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.108865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.108924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.108990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.109061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.109108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.109113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.109186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:36.109264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:36.112187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:36.112199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0] Write session will restart in 0.007324s
2025-10-10T14:36:36.109354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:36.109425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:36.112218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0] Write session: Do CDS request
2025-10-10T14:36:36.109470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:36.109473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:36.112223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:36.109551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903458:5230], now have 1 active actors on pipe
2025-10-10T14:36:36.110938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:36.111727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:36.111787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601987598903458:5230]
2025-10-10T14:36:36.111813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:36.111862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2065 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0
2025-10-10T14:36:36.112068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2065 sessionId: src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0 is DEAD
2025-10-10T14:36:36.120940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.121032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:36.121050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2066
2025-10-10T14:36:36.121213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.121264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:36.121276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:36.121280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:36.121815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2066 sessionId:  describe result for acl check
2025-10-10T14:36:36.121859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:36.121863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:36.121865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:36.121871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601987598903476:8334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:36.122492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601987598903476:8334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:36.125457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601987598903476:8334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:36.134225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601987598903476:8334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:36.134247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601987598903476:8334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:36.134252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601987598903476:8334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:36.134262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:36.138176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:36.141185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:36.141482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:36.141496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:36.141509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:36.141575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:36.141623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601986816673484:3785]
2025-10-10T14:36:36.142224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:36.142547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:36.142590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:36.142901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:36.142968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.142970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.142971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.142972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.142974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.142975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.142976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.142978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.142979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.142980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.142982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.142983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.142984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.142990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.143002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.143006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.143010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.143014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.143019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.143022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.143026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.143030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.143036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.143040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.143044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.143048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.143058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.143067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.143073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.143079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.143084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.143090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.143094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.143099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.143103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.143109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.143114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.143118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.143122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.143127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.143132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.143137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.143142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.143149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.143153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.143158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.143163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.143168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.143174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.143179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.143183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.143188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.143226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:36.150587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:36.151043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:36.151058Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:36.151061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:36.151065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:36.151072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2065 [2:7559601986816673484:3785]
2025-10-10T14:36:36.151087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:36.151107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:36.151115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.151119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.151121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.151141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:36.151149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:36.151165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:36.151227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.151234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.151236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.151239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:36.151316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:36.151324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.151336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.151348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.151370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:36.151397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903461:2438], now have 1 active actors on pipe
2025-10-10T14:36:36.151405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903613:8334], now have 1 active actors on pipe
2025-10-10T14:36:36.151414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601986816673479:3785]
2025-10-10T14:36:36.151421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601986816673479:3785]
2025-10-10T14:36:36.151423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601986816673479:3785]
2025-10-10T14:36:36.151440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:36.151458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:36.151478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:36.151486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:36.151528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601986816673479:3785]
2025-10-10T14:36:36.151538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:36.151588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:36.151600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:36.151602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:36.151611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:36.151741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2065
2025-10-10T14:36:36.151786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2065
2025-10-10T14:36:36.151962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.151973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.152090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:36.152104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.152107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.152110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:36.152122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.152137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:36.152159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.152825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.152836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.152853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.152958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2066 partition: 0 MaxSeqNo: 40 sessionId: src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0
2025-10-10T14:36:36.153357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1c1d28-afcc6b1e-a6b105d5-99a0e8e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:36.156070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0] Write session: try to update token
2025-10-10T14:36:36.156093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:36.164869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:36.164901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:36.164915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601986816673479:3785]
2025-10-10T14:36:36.164956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:36.164971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:36.165196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:36.165362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:36.165501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:36.165647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:36.165856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:36.165899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:36.184783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId: src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:36.187519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:36.188150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.188179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.188203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:36.188206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:36.188209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:36.188211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:36.188220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601986816673479:3785]
2025-10-10T14:36:36.188224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601986816673479:3785]
2025-10-10T14:36:36.188228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601986816673479:3785]
2025-10-10T14:36:36.188279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:36.188285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.188289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:36.188362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:36.188368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:36.188372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:36.188419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:36.211898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601987598903639:5230]
2025-10-10T14:36:36.212477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2065, pipe: [1:7559601987598903639:5230]
2025-10-10T14:36:36.338944Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:36.339711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:36.339749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903639:5230], now have 1 active actors on pipe
2025-10-10T14:36:36.340351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:36.340361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0] Write session will restart in 0.006186s
2025-10-10T14:36:36.340385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0] Write session: Do CDS request
2025-10-10T14:36:36.340392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:36.339852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:36.339902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:36.339956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601987598903639:5230]
2025-10-10T14:36:36.339973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:36.339976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:36.340056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2066 reason: error at write: Disconnected sessionId: src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0
2025-10-10T14:36:36.340226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2066 sessionId: src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0 is DEAD
2025-10-10T14:36:36.348044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.349678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:36.349695Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2067
2025-10-10T14:36:36.349874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.349924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:36.349935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:36.349939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:36.350527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2067 sessionId:  describe result for acl check
2025-10-10T14:36:36.350570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:36.350577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:36.350579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:36.350586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601987598903705:8317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:36.351147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601987598903705:8317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:36.354568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601987598903705:8317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:36.355260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:36.357362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:36.357638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:36.357650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:36.357663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:36.357740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:36.357835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601986816673662:3761]
2025-10-10T14:36:36.357890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601987598903705:8317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:36.357908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601987598903705:8317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:36.357912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601987598903705:8317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:36.357921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:36.358496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:36.358851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:36.358918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:36.359282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:36.359365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.359375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.359377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.359378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.359379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.359381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.359383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.359384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.359385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.359386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.359388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.359389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.359390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.359398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.359412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.359416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.359421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.359425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.359430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.359434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.359438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.359442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.359447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.359451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.359455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.359458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.359466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.359475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.359481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.359486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.359490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.359495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.359499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.359504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.359509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.359524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.359534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.359539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.359545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.359555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.359560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.359565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.359575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.359585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.359591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.359600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.359605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.359611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.359616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.359627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.359633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.359638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.359679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:36.362225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:36.363201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2066
2025-10-10T14:36:36.363209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2066
2025-10-10T14:36:36.362765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:36.362781Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:36.362783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:36.362787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:36.362794Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2066 [2:7559601986816673662:3761]
2025-10-10T14:36:36.362807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:36.362826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:36.362829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.362834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.362837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.362853Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:36.362862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:36.362870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:36.362933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.362937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.362939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.362942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:36.363014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:36.363017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.363029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.363042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.363060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:36.363081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601986816673657:3761]
2025-10-10T14:36:36.363084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601986816673657:3761]
2025-10-10T14:36:36.363086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601986816673657:3761]
2025-10-10T14:36:36.363094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:36.363105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:36.363109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:36.363109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:36.363111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:36.363126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:36.363129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:36.363140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903645:2438], now have 1 active actors on pipe
2025-10-10T14:36:36.363143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903790:8317], now have 1 active actors on pipe
2025-10-10T14:36:36.363170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601986816673657:3761]
2025-10-10T14:36:36.363177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:36.363193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:36.363320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.363329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.363368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2583e134-e9b7d902-1842a784-f07bd78b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:36.363379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.363385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.363387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:36.363400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.363414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:36.363432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.363625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.363637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.363654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.363743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2067 partition: 0 MaxSeqNo: 40 sessionId: src_id|2583e134-e9b7d902-1842a784-f07bd78b_0
2025-10-10T14:36:36.364156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaddb18d-8fbb81d8-6ea00dd1-b4ec6b03_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2583e134-e9b7d902-1842a784-f07bd78b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:36.367019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2583e134-e9b7d902-1842a784-f07bd78b_0] Write session: try to update token
2025-10-10T14:36:36.367040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2583e134-e9b7d902-1842a784-f07bd78b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:36.389439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId: src_id|2583e134-e9b7d902-1842a784-f07bd78b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:36.390362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:36.390387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:36.390391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:36.390393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:36.390403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601986816673657:3761]
2025-10-10T14:36:36.390409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601986816673657:3761]
2025-10-10T14:36:36.390414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601986816673657:3761]
2025-10-10T14:36:36.392097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:36.390469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:36.390481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:36.390486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.390488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:36.390489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:36.390493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:36.390633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:36.441242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601987598903802:5230]
2025-10-10T14:36:36.441802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2066, pipe: [1:7559601987598903802:5230]
2025-10-10T14:36:36.512435Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:36.512866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.512881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.512931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903802:5230], now have 1 active actors on pipe
2025-10-10T14:36:36.513230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:36.513648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:36.513699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:36.513776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2583e134-e9b7d902-1842a784-f07bd78b_0
2025-10-10T14:36:36.514014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2067 sessionId: src_id|2583e134-e9b7d902-1842a784-f07bd78b_0 is DEAD
2025-10-10T14:36:36.514215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601987598903802:5230]
2025-10-10T14:36:36.517121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2583e134-e9b7d902-1842a784-f07bd78b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:36.517136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2583e134-e9b7d902-1842a784-f07bd78b_0] Write session will restart in 0.005200s
2025-10-10T14:36:36.517165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2583e134-e9b7d902-1842a784-f07bd78b_0] Write session: Do CDS request
2025-10-10T14:36:36.517172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2583e134-e9b7d902-1842a784-f07bd78b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:36.524930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2583e134-e9b7d902-1842a784-f07bd78b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.525540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:36.525563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2068
2025-10-10T14:36:36.525731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.525768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:36.525784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:36.525789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:36.526365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2068 sessionId:  describe result for acl check
2025-10-10T14:36:36.526403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:36.526410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:36.526412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:36.526419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601987598903829:8313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:36.527016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601987598903829:8313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:36.529702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601987598903829:8313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:36.531908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:36.534767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:36.534707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601987598903829:8313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:36.534737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601987598903829:8313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:36.534741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601987598903829:8313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:36.534752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:36.535013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:36.535027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:36.535039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:36.535101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:36.535146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601986816673817:3760]
2025-10-10T14:36:36.535832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:36.536244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:36.536321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:36.536686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:36.536767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.536774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.536775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.536777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.536779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.536780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.536782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.536783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.536784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.536786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.536787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.536789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.536790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.536797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.536811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.536815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.536820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.536824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.536828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.536833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.536837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.536841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.536846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.536850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.536854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.536858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.536866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.536875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.536881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.536887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.536892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.536898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.536903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.536909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.536915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.536920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.536925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.536936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.536941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.536947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.536958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.536963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.536968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.536974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.536978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.536984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.536993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.537000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.537009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.537014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.537019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.537028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.537070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:36.543589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:36.544068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:36.544086Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:36.544088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:36.544093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:36.544101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2067 [2:7559601986816673817:3760]
2025-10-10T14:36:36.544116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:36.544138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:36.544146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.544149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.544152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.544173Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:36.544188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:36.544201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:36.544278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.544285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.544287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.544290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:36.544373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:36.544381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.544394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.544409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.544437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:36.544465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903950:8313], now have 1 active actors on pipe
2025-10-10T14:36:36.544474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903803:2438], now have 1 active actors on pipe
2025-10-10T14:36:36.544483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601986816673811:3760]
2025-10-10T14:36:36.544485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601986816673811:3760]
2025-10-10T14:36:36.544487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601986816673811:3760]
2025-10-10T14:36:36.544501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:36.544521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:36.544539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:36.544542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:36.544566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:36.544578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:36.544580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:36.544585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601986816673811:3760]
2025-10-10T14:36:36.544588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:36.544605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:36.544577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2067
2025-10-10T14:36:36.544581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2067
2025-10-10T14:36:36.544701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.544712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.544745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34593040-c3410526-8031367e-9b16425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:36.544760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.544764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.544767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:36.544780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.544797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:36.544814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.545031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.545045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.545079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.545175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2068 partition: 0 MaxSeqNo: 40 sessionId: src_id|34593040-c3410526-8031367e-9b16425_0
2025-10-10T14:36:36.545645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2583e134-e9b7d902-1842a784-f07bd78b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34593040-c3410526-8031367e-9b16425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:36.548651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34593040-c3410526-8031367e-9b16425_0] Write session: try to update token
2025-10-10T14:36:36.548672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34593040-c3410526-8031367e-9b16425_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:36.563903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId: src_id|34593040-c3410526-8031367e-9b16425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:36.566834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:36.566858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:36.566862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:36.566864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:36.566875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601986816673811:3760]
2025-10-10T14:36:36.566879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601986816673811:3760]
2025-10-10T14:36:36.566883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601986816673811:3760]
2025-10-10T14:36:36.566934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:36.566936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:36.566945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.566947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:36.566960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:36.566965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:36.566968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:36.567089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:36.617480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601987598903962:5230]
2025-10-10T14:36:36.621492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2067, pipe: [1:7559601987598903962:5230]
2025-10-10T14:36:36.686139Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:36.686540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.686560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.686609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903962:5230], now have 1 active actors on pipe
2025-10-10T14:36:36.686831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:36.687402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34593040-c3410526-8031367e-9b16425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:36.687414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34593040-c3410526-8031367e-9b16425_0] Write session will restart in 0.009137s
2025-10-10T14:36:36.687440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34593040-c3410526-8031367e-9b16425_0] Write session: Do CDS request
2025-10-10T14:36:36.687447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34593040-c3410526-8031367e-9b16425_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:36.686907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:36.686924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:36.686997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2068 reason: error at write: Disconnected sessionId: src_id|34593040-c3410526-8031367e-9b16425_0
2025-10-10T14:36:36.687206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2068 sessionId: src_id|34593040-c3410526-8031367e-9b16425_0 is DEAD
2025-10-10T14:36:36.687445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:36.687482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601987598903962:5230]
2025-10-10T14:36:36.698003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34593040-c3410526-8031367e-9b16425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.698173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:36.698197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2069
2025-10-10T14:36:36.698399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.698441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:36.698452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:36.698456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:36.698943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2069 sessionId:  describe result for acl check
2025-10-10T14:36:36.698987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:36.698989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:36.698992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:36.698998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601987598904039:8306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:36.699610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601987598904039:8306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:36.702172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601987598904039:8306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:36.706334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:36.706763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601987598904039:8306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:36.706779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601987598904039:8306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:36.706784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601987598904039:8306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:36.706795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:36.706967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:36.707180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:36.707186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:36.707200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:36.707266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:36.707308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601986816673972:3757]
2025-10-10T14:36:36.707972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:36.708338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:36.708394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:36.708739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:36.708815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.708816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.708818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.708819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.708820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.708822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.708824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.708825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.708826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.708828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.708829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.708831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.708832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.708840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.708854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.708859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.708863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.708868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.708873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.708877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.708882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.708885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.708890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.708895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.708899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.708903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.708912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.708921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.708928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.708933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.708941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.708947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.708952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.708957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.708963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.708968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.708973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.708979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.708985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.708991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.708996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.709003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.709008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.709014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.709019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.709025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.709029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.709035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.709040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.709046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.709051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.709057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.709102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:36.712601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2068
2025-10-10T14:36:36.712636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2068
2025-10-10T14:36:36.711790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:36.712199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:36.712204Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:36.712206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:36.712211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:36.712217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2068 [2:7559601986816673972:3757]
2025-10-10T14:36:36.712231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:36.712248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:36.712252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.712256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.712260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.712277Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:36.712285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:36.712293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:36.712357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.712359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.712361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.712364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:36.712456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:36.712458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.712469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.712481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.712499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:36.712521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598904110:8306], now have 1 active actors on pipe
2025-10-10T14:36:36.712525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598903963:2438], now have 1 active actors on pipe
2025-10-10T14:36:36.712532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601986816673966:3757]
2025-10-10T14:36:36.712535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601986816673966:3757]
2025-10-10T14:36:36.712537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601986816673966:3757]
2025-10-10T14:36:36.712550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:36.712566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:36.712567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:36.712570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:36.712572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:36.712582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:36.712586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:36.712615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601986816673966:3757]
2025-10-10T14:36:36.712623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:36.712629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:36.712840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.712852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.712885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:36.712893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.712897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.712900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:36.712912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.712922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:36.712939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.713102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.713108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.713122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.713274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2069 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0
2025-10-10T14:36:36.713694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34593040-c3410526-8031367e-9b16425_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:36.716604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0] Write session: try to update token
2025-10-10T14:36:36.716622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:36.732009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:36.732032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:36.732045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601986816673966:3757]
2025-10-10T14:36:36.732103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:36.732299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:36.732469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:36.732609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:36.732747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:36.732935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:36.732975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:36.733366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:36.746685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:36.746712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:36.746716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:36.746718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:36.746729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601986816673966:3757]
2025-10-10T14:36:36.746734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601986816673966:3757]
2025-10-10T14:36:36.746739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601986816673966:3757]
2025-10-10T14:36:36.746792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:36.746801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.746803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:36.746804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:36.746812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:36.746817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:36.746966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:36.746361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId: src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:36.749276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:36.787422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601987598904131:5230]
2025-10-10T14:36:36.787766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2068, pipe: [1:7559601987598904131:5230]
2025-10-10T14:36:36.867283Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:36.867826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.867843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.867868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598904131:5230], now have 1 active actors on pipe
2025-10-10T14:36:36.868077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:36.868083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:36.868149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:36.868214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601987598904131:5230]
2025-10-10T14:36:36.868231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2069 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0
2025-10-10T14:36:36.868446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2069 sessionId: src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0 is DEAD
2025-10-10T14:36:36.868740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:36.868747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0] Write session will restart in 0.006243s
2025-10-10T14:36:36.868773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0] Write session: Do CDS request
2025-10-10T14:36:36.868780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:36.875944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.876349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:36.876365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2070
2025-10-10T14:36:36.876656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:36.876703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:36.876709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:36.876714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:36.877170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2070 sessionId:  describe result for acl check
2025-10-10T14:36:36.877212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:36.877222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:36.877224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:36.877233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601987598904144:8298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:36.877901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601987598904144:8298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:36.880799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601987598904144:8298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:36.885025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601987598904144:8298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:36.885042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601987598904144:8298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:36.885047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601987598904144:8298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:36.885056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:36.894880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:36.897535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:36.897779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:36.897789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:36.897801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:36.897864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:36.897910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601986816674129:3755]
2025-10-10T14:36:36.898633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:36.898962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:36.899016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:36.899349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:36.899409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.899416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.899418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.899419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.899421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.899422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.899424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.899425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.899427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.899428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.899429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.899431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.899432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.899438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.899452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.899457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.899461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.899466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.899471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.899475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.899480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.899484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.899488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.899492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.899497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.899501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.899508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.899517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:36.899525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.899531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:36.899535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.899542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:36.899546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.899552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:36.899559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.899565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:36.899575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.899580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:36.899585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.899591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:36.899597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.899606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:36.899610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.899616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:36.899620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.899626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:36.899635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.899641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.899647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.899657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.899661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.899672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.899714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:36.902635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:36.903276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:36.903290Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:36.903293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:36.903297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:36.903304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2069 [2:7559601986816674129:3755]
2025-10-10T14:36:36.903318Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:36.903336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:36.903340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.903344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.903347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.903365Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:36.903378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:36.903387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:36.903457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.903464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.903466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.903469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:36.903542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:36.903549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.903561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:36.903591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:36.903615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:36.903644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598904214:8298], now have 1 active actors on pipe
2025-10-10T14:36:36.903653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598904132:2438], now have 1 active actors on pipe
2025-10-10T14:36:36.903660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601986816674123:3755]
2025-10-10T14:36:36.903663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601986816674123:3755]
2025-10-10T14:36:36.903665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601986816674123:3755]
2025-10-10T14:36:36.903684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:36.903702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:36.903702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:36.903706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:36.903709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:36.903725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:36.903735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:36.903703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2069
2025-10-10T14:36:36.903723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2069
2025-10-10T14:36:36.903764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601986816674123:3755]
2025-10-10T14:36:36.903777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:36.903793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:36.903795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.903800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.903854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:36.903861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:36.903865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:36.903867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:36.903878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:36.903888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:36.903906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.904134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.904151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.904174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:36.904274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2070 partition: 0 MaxSeqNo: 40 sessionId: src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0
2025-10-10T14:36:36.904737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc3b5c37-8faebcbb-3f4693b8-ebcf7bbe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:36.907516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0] Write session: try to update token
2025-10-10T14:36:36.907535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:36.924159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId: src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:36.926882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:36.928037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:36.928064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:36.928089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:36.928097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:36.928101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:36.928103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:36.928112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601986816674123:3755]
2025-10-10T14:36:36.928117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601986816674123:3755]
2025-10-10T14:36:36.928121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601986816674123:3755]
2025-10-10T14:36:36.928178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:36.928187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:36.928193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:36.928195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:36.928197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:36.928198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:36.928327Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:36.965441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601987598904293:5230]
2025-10-10T14:36:36.965816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2069, pipe: [1:7559601987598904293:5230]
2025-10-10T14:36:37.045292Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:37.045683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:37.045784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601987598904293:5230], now have 1 active actors on pipe
2025-10-10T14:36:37.045841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:37.046013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:37.046065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601987598904293:5230]
2025-10-10T14:36:37.057788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:37.057803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:37.057831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2070 reason: error at write: Disconnected sessionId: src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0
2025-10-10T14:36:37.058058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2070 sessionId: src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0 is DEAD
2025-10-10T14:36:37.058186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:37.058193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0] Write session will restart in 0.007536s
2025-10-10T14:36:37.058228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0] Write session: Do CDS request
2025-10-10T14:36:37.058235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:37.067053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.067059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:37.067075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2071
2025-10-10T14:36:37.067317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.067354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:37.067365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:37.067369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:37.067824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2071 sessionId:  describe result for acl check
2025-10-10T14:36:37.067863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:37.067870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:37.067872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:37.067880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601991893871722:8292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:37.068309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:37.068516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601991893871722:8292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:37.070668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:37.071057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:37.071073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:37.071088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:37.071183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:37.071209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601991893871722:8292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:37.071228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601991111641595:3748]
2025-10-10T14:36:37.071847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:37.072137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:37.072184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:37.072540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:37.072600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.072607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.072608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.072609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.072610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.072611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.072613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.072614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.072615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.072616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.072617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.072618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.072619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.072626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.072639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.072644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.072648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.072653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.072658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.072662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.072667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.072670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.072676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.072680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.072685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.072689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.072697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.072710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.072731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.072741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.072745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.072751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.072756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.072763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.072770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.072776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.072781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.072787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.072796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.072802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.072810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.072816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.072825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.072832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.072840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.072845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.072850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.072855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.072860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.072871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.072876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.072885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.072927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:37.075258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601991893871722:8292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:37.075273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601991893871722:8292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:37.075276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601991893871722:8292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:37.075285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:37.075714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:37.076144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:37.076159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:37.076162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:37.076166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:37.076173Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2070 [2:7559601991111641595:3748]
2025-10-10T14:36:37.076185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:37.076203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:37.076211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.076214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.076217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.076236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:37.076250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:37.076259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:37.076314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.076324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.076326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.076328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:37.076396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:37.076417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.076429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.076440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.076457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:37.076480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893871602:2438], now have 1 active actors on pipe
2025-10-10T14:36:37.076489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893871757:8292], now have 1 active actors on pipe
2025-10-10T14:36:37.076498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601991111641590:3748]
2025-10-10T14:36:37.076500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601991111641590:3748]
2025-10-10T14:36:37.076503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601991111641590:3748]
2025-10-10T14:36:37.076517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:37.076531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:37.076535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:37.076539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:37.076542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:37.076550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:37.076553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:37.076575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601991111641590:3748]
2025-10-10T14:36:37.076586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:37.076591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:37.076690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2070
2025-10-10T14:36:37.076723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2070
2025-10-10T14:36:37.076754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.076766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.076799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b1989e7-2886156f-43a4b162-9a878eba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:37.076813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.076821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.076823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:37.076835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.076847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:37.076867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.077054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.077061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.077076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.077152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2071 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b1989e7-2886156f-43a4b162-9a878eba_0
2025-10-10T14:36:37.077562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c406efdc-ed870ad0-c0e3c734-38cb98f0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b1989e7-2886156f-43a4b162-9a878eba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:37.080186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b1989e7-2886156f-43a4b162-9a878eba_0] Write session: try to update token
2025-10-10T14:36:37.080203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b1989e7-2886156f-43a4b162-9a878eba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:37.094380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId: src_id|4b1989e7-2886156f-43a4b162-9a878eba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:37.094478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:37.094501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:37.094514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601991111641590:3748]
2025-10-10T14:36:37.094569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:37.094705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:37.094782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:37.094948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:37.095104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:37.095273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:37.095494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:37.095539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:37.097240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:37.097519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.097539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.097585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:37.097679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:37.107076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:37.107096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:37.107099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:37.107101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:37.107111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601991111641590:3748]
2025-10-10T14:36:37.107115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601991111641590:3748]
2025-10-10T14:36:37.107121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601991111641590:3748]
2025-10-10T14:36:37.107162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:37.107167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:37.107168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:37.107171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:37.107175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.107177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:37.107312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:37.145828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601991893871764:5230]
2025-10-10T14:36:37.146113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2070, pipe: [1:7559601991893871764:5230]
2025-10-10T14:36:37.223461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:37.231770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.231802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.231976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.232046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.232108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.232168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.232349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.232354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.232436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.232489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.232548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.232613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.232651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.232654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.232724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.232789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.232849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.232905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.232948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.232951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.233022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.233086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.233150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.233215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.233256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.233258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.233474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.235866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:37.235918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601991893871764:5230]
2025-10-10T14:36:37.235942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:37.235945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:37.235977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2071 reason: error at write: Disconnected sessionId: src_id|4b1989e7-2886156f-43a4b162-9a878eba_0
2025-10-10T14:36:37.236181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2071 sessionId: src_id|4b1989e7-2886156f-43a4b162-9a878eba_0 is DEAD
2025-10-10T14:36:37.233546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.233617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.233680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.233727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.233731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.233804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.233864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.233924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.233984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.234021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.234024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.234087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.234146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.234208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.234266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.234308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.234311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.234373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.234430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.234486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.234540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.234581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.234584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.234653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.234708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.234758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.234812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.234851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.234855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.234922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.234979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.235037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.235099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.235141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.235144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.235209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893871764:5230], now have 1 active actors on pipe
2025-10-10T14:36:37.236249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:37.237484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b1989e7-2886156f-43a4b162-9a878eba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:37.237497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b1989e7-2886156f-43a4b162-9a878eba_0] Write session will restart in 0.005059s
2025-10-10T14:36:37.237532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b1989e7-2886156f-43a4b162-9a878eba_0] Write session: Do CDS request
2025-10-10T14:36:37.237538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b1989e7-2886156f-43a4b162-9a878eba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:37.244296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b1989e7-2886156f-43a4b162-9a878eba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.244561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:37.244578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2072
2025-10-10T14:36:37.245101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.245138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:37.245148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:37.245151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:37.245743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2072 sessionId:  describe result for acl check
2025-10-10T14:36:37.245782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:37.245784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:37.245786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:37.245792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601991893871824:8274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:37.246316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601991893871824:8274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:37.248083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601991893871824:8274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:37.251869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:37.251865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601991893871824:8274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:37.251882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601991893871824:8274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:37.251886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601991893871824:8274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:37.251895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:37.254541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:37.254813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:37.254825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:37.254838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:37.254901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:37.254948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601991111641792:3730]
2025-10-10T14:36:37.255588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:37.255955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:37.256013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:37.256365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:37.256456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.256462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.256463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.256465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.256466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.256467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.256468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.256469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.256471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.256472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.256473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.256474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.256476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.256483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.256496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.256501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.256505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.256509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.256514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.256518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.256522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.256526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.256531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.256535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.256539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.256544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.256551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.256560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.256567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.256573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.256577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.256582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.256587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.256592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.256597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.256602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.256606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.256612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.256618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.256623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.256627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.256634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.256639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.256644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.256650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.256655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.256660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.256665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.256674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.256680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.256684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.256689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.256729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:37.259247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:37.259651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:37.259672Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:37.259675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:37.259679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:37.259687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2071 [2:7559601991111641792:3730]
2025-10-10T14:36:37.259702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:37.259720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:37.259728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.259732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.259735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.259756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:37.259771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:37.259779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:37.259841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.259849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.259852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.259854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:37.259929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:37.259940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.259951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.259964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.259983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:37.260008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893871939:8274], now have 1 active actors on pipe
2025-10-10T14:36:37.260017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893871783:2438], now have 1 active actors on pipe
2025-10-10T14:36:37.260027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601991111641786:3730]
2025-10-10T14:36:37.260030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601991111641786:3730]
2025-10-10T14:36:37.260032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601991111641786:3730]
2025-10-10T14:36:37.260045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:37.260062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:37.260078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:37.260082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:37.260083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:37.260086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:37.260085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:37.260118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601991111641786:3730]
2025-10-10T14:36:37.260127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:37.260080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2071
2025-10-10T14:36:37.260088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2071
2025-10-10T14:36:37.260142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:37.260157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.260161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.260211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:37.260223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.260228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.260230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:37.260242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.260254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:37.260273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.260568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.260586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.260602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.260764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2072 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0
2025-10-10T14:36:37.261216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b1989e7-2886156f-43a4b162-9a878eba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:37.263958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0] Write session: try to update token
2025-10-10T14:36:37.263979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:37.278897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId: src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:37.281537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:37.283632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.283657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.285456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:37.285495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:37.285498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:37.285502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:37.285504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:37.285512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601991111641786:3730]
2025-10-10T14:36:37.285517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601991111641786:3730]
2025-10-10T14:36:37.285521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601991111641786:3730]
2025-10-10T14:36:37.285565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:37.285577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:37.285579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.285582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:37.285582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:37.285587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:37.285717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:37.285762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:37.336319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601991893871951:5230]
2025-10-10T14:36:37.336696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2071, pipe: [1:7559601991893871951:5230]
2025-10-10T14:36:37.401849Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:37.410715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.410752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.410946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.411018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.411095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.411168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.411215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.411225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.411296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.411365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.411431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.411498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.411541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.411550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.411662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.411731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.411796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.411866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.411915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.411925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.411997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.412066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.412136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.412202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.412248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.412256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.412324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.412391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.412477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.412544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.412592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.412599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.412668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.412736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.412805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.412873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.412924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.412933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.413002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.413069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.413139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.413208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.413254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.413261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.413350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.415035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:37.415048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0] Write session will restart in 0.006358s
2025-10-10T14:36:37.415073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0] Write session: Do CDS request
2025-10-10T14:36:37.414572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601991893871951:5230]
2025-10-10T14:36:37.415079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:37.414619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:37.414631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:37.414660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2072 reason: error at write: Disconnected sessionId: src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0
2025-10-10T14:36:37.414868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2072 sessionId: src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0 is DEAD
2025-10-10T14:36:37.414920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:37.413417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.413485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.413551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.413592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.413595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.413667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.413726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.413787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.413845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.413888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.413891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.413959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:37.414018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:37.414084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:37.414149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:37.414190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:37.414193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:37.414259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893871951:5230], now have 1 active actors on pipe
2025-10-10T14:36:37.415368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:37.422928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.422985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:37.423002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2073
2025-10-10T14:36:37.423208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.423247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:37.423257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:37.423262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:37.423774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2073 sessionId:  describe result for acl check
2025-10-10T14:36:37.423824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:37.423833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:37.423835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:37.423841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601991893871969:8258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:37.424441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601991893871969:8258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:37.427905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601991893871969:8258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:37.432898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601991893871969:8258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:37.432917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601991893871969:8258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:37.432921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601991893871969:8258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:37.432930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:37.437501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:37.440446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:37.440796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:37.440810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:37.440824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:37.440901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:37.440946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601991111641951:3723]
2025-10-10T14:36:37.441635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:37.442019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:37.442098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:37.442488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:37.442551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.442560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.442561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.442562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.442563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.442564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.442566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.442567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.442568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.442570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.442571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.442572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.442573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.442580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.442594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.442598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.442602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.442606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.442611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.442615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.442619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.442623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.442627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.442631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.442636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.442640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.442648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.442656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.442663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.442668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.442673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.442679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.442684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.442690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.442700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.442707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.442711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.442717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.442727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.442732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.442741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.442746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.442752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.442757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.442761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.442766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.442771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.442776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.442780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.442784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.442788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.442794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.442840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:37.446532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:37.447139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:37.447155Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:37.447157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:37.447161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:37.447169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2072 [2:7559601991111641951:3723]
2025-10-10T14:36:37.447182Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:37.447201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:37.447209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.447213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.447216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.447233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:37.447246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:37.447254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:37.447317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.447323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.447325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.447328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:37.447401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:37.447408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.447421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.447438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.447459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:37.447486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893871954:2438], now have 1 active actors on pipe
2025-10-10T14:36:37.447496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872059:8258], now have 1 active actors on pipe
2025-10-10T14:36:37.447504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601991111641946:3723]
2025-10-10T14:36:37.447505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601991111641946:3723]
2025-10-10T14:36:37.447507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601991111641946:3723]
2025-10-10T14:36:37.447520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:37.447534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:37.447545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:37.447551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:37.447554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:37.447557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:37.447560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:37.447548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2072
2025-10-10T14:36:37.447567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2072
2025-10-10T14:36:37.447631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601991111641946:3723]
2025-10-10T14:36:37.447645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:37.447652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:37.447676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.447688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.447734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19f764b7-5700609a-a83de612-85656c59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:37.447749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.447758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.447760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:37.447771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.447787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:37.447811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.447957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.447965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.447983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.448078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2073 partition: 0 MaxSeqNo: 40 sessionId: src_id|19f764b7-5700609a-a83de612-85656c59_0
2025-10-10T14:36:37.448509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1bffd6-97fbab00-12c6d0ae-73fd99c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|19f764b7-5700609a-a83de612-85656c59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:37.451226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f764b7-5700609a-a83de612-85656c59_0] Write session: try to update token
2025-10-10T14:36:37.451244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f764b7-5700609a-a83de612-85656c59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:37.467185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId: src_id|19f764b7-5700609a-a83de612-85656c59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:37.470812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:37.470842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:37.470847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:37.470849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:37.470860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601991111641946:3723]
2025-10-10T14:36:37.470869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601991111641946:3723]
2025-10-10T14:36:37.470857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:37.470872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601991111641946:3723]
2025-10-10T14:36:37.470928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:37.470930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:37.470935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.470937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:37.470938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:37.470943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:37.471078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:37.514979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601991893872116:5230]
2025-10-10T14:36:37.515311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2072, pipe: [1:7559601991893872116:5230]
2025-10-10T14:36:37.585025Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:37.585300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.585310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.585391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872116:5230], now have 1 active actors on pipe
2025-10-10T14:36:37.585638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:37.585641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:37.585643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601991893872116:5230]
2025-10-10T14:36:37.585656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:37.585661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:37.585734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2073 reason: error at write: Disconnected sessionId: src_id|19f764b7-5700609a-a83de612-85656c59_0
2025-10-10T14:36:37.585942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2073 sessionId: src_id|19f764b7-5700609a-a83de612-85656c59_0 is DEAD
2025-10-10T14:36:37.589582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f764b7-5700609a-a83de612-85656c59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:37.589597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f764b7-5700609a-a83de612-85656c59_0] Write session will restart in 0.009969s
2025-10-10T14:36:37.589623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f764b7-5700609a-a83de612-85656c59_0] Write session: Do CDS request
2025-10-10T14:36:37.589633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f764b7-5700609a-a83de612-85656c59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:37.599367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:37.600929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19f764b7-5700609a-a83de612-85656c59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.601310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:37.601466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:37.601497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2074
2025-10-10T14:36:37.601585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:37.601599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:37.601613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:37.601688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:37.601743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601991111642110:3727]
2025-10-10T14:36:37.602349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:37.605440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.605499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:37.605516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:37.605527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:37.602678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:37.605905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2074 sessionId:  describe result for acl check
2025-10-10T14:36:37.602725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:37.603034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:37.603095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.603096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.603097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.603099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.603100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.603101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.603102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.603104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.605938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:37.605945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:37.605948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:37.605955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601991893872246:8254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:37.603105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.603106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.603107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.603108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.603109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.603115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.603128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.603132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.603136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.603140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.603144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.603147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.603151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.603154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.603159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.603163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.603167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.603171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.603179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.603188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.603194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.603200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.603204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.603209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.603214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.603219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.603224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.603229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.603233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.603238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.603244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.603249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.603252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.603257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.603263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.603268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.603273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.603277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.603281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.603286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.603290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.603295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.603299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.603304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.603345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:37.605980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:37.606539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601991893872246:8254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:37.606745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:37.606764Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:37.606766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:37.606771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:37.606777Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2073 [2:7559601991111642110:3727]
2025-10-10T14:36:37.606791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:37.606813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:37.606822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.606826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.606829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.606847Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:37.606865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:37.606876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:37.606932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.606934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.606936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.606939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:37.607018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:37.607028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.607042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.607056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.607090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:37.607116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601991111642105:3727]
2025-10-10T14:36:37.607124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601991111642105:3727]
2025-10-10T14:36:37.607127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601991111642105:3727]
2025-10-10T14:36:37.607139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:37.607159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:37.607182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:37.607190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:37.607214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601991111642105:3727]
2025-10-10T14:36:37.607221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:37.607344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:37.607357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:37.607359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:37.607365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:37.607558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872118:2438], now have 1 active actors on pipe
2025-10-10T14:36:37.607614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2073
2025-10-10T14:36:37.611212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601991893872246:8254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:37.618888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601991893872246:8254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:37.618909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601991893872246:8254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:37.618913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601991893872246:8254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:37.618923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:37.619357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2073
2025-10-10T14:36:37.619861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2074 partition: 0 MaxSeqNo: 40 sessionId: src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0
2025-10-10T14:36:37.619394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872278:8254], now have 1 active actors on pipe
2025-10-10T14:36:37.619436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.619444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.619480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:37.619494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.619506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.619509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:37.619526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.619545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:37.619577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.619744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.619753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.619777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.621482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19f764b7-5700609a-a83de612-85656c59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:37.624168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0] Write session: try to update token
2025-10-10T14:36:37.624186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:37.629164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:37.629185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:37.629188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:37.629191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:37.629201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601991111642105:3727]
2025-10-10T14:36:37.629205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601991111642105:3727]
2025-10-10T14:36:37.629209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601991111642105:3727]
2025-10-10T14:36:37.629262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:37.629267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:37.629274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:37.629275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.629278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:37.629279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:37.629459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:37.649901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId: src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:37.652638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:37.686155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601991893872282:5230]
2025-10-10T14:36:37.686485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2073, pipe: [1:7559601991893872282:5230]
2025-10-10T14:36:37.747944Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:37.748377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.748388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.748424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872282:5230], now have 1 active actors on pipe
2025-10-10T14:36:37.750092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:37.750104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0] Write session will restart in 0.007370s
2025-10-10T14:36:37.750129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0] Write session: Do CDS request
2025-10-10T14:36:37.750135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:37.749659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:37.749655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:37.749669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:37.749718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:37.749755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2074 reason: error at write: Disconnected sessionId: src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0
2025-10-10T14:36:37.749767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601991893872282:5230]
2025-10-10T14:36:37.749945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2074 sessionId: src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0 is DEAD
2025-10-10T14:36:37.758948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.759023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:37.759040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2075
2025-10-10T14:36:37.759325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.759386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:37.759398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:37.759403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:37.759900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2075 sessionId:  describe result for acl check
2025-10-10T14:36:37.759934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:37.759937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:37.759938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:37.759945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601991893872312:8253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:37.760569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601991893872312:8253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:37.765874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601991893872312:8253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:37.767743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:37.769897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:37.770026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601991893872312:8253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:37.770040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601991893872312:8253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:37.770044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601991893872312:8253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:37.770052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:37.770171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:37.770193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:37.770208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:37.770277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:37.770336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601991111642271:3725]
2025-10-10T14:36:37.770976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:37.771304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:37.771354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:37.771706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:37.771778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.771784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.771786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.771787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.771788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.771789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.771791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.771792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.771793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.771795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.771796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.771797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.771799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.771805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.771819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.771824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.771829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.771833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.771838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.771842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.771847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.771851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.771855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.771859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.771876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.771885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.771893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.771903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.771915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.771922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.771931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.771936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.771940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.771946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.771951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.771957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.771962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.771967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.771972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.771977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.771982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.771995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.771999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.772010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.772015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.772024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.772029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.772039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.772043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.772049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.772059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.772064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.772109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:37.774597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:37.775070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:37.775086Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:37.775088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:37.775092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:37.775098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2074 [2:7559601991111642271:3725]
2025-10-10T14:36:37.775112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:37.775128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:37.775131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.775135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.775139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.775155Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:37.775168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:37.775181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:37.775243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.775250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.775252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.775255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:37.775327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:37.775336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.775348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.775365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.775387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:37.775413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872442:8253], now have 1 active actors on pipe
2025-10-10T14:36:37.775421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872289:2438], now have 1 active actors on pipe
2025-10-10T14:36:37.775429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601991111642266:3725]
2025-10-10T14:36:37.775435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601991111642266:3725]
2025-10-10T14:36:37.775437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601991111642266:3725]
2025-10-10T14:36:37.775450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:37.775465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:37.775469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:37.775472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:37.775474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:37.775489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:37.775493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:37.775516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601991111642266:3725]
2025-10-10T14:36:37.775520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:37.775522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:37.775541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.775548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.775473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2074
2025-10-10T14:36:37.775477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2074
2025-10-10T14:36:37.775603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:37.775617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.775621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.775624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:37.775635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.775651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:37.775673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.775837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.775845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.775861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.775940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2075 partition: 0 MaxSeqNo: 40 sessionId: src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0
2025-10-10T14:36:37.776362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94ab6da0-c292acf3-1aefe5cf-b84b7eb3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:37.779289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0] Write session: try to update token
2025-10-10T14:36:37.779312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:37.795085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId: src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:37.796533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:37.796548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:37.796552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:37.796554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:37.796564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601991111642266:3725]
2025-10-10T14:36:37.796570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601991111642266:3725]
2025-10-10T14:36:37.796574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601991111642266:3725]
2025-10-10T14:36:37.796622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:37.796625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:37.796629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:37.796634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:37.796634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.796637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:37.796778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:37.797826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:37.849815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601991893872456:5230]
2025-10-10T14:36:37.850186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2074, pipe: [1:7559601991893872456:5230]
2025-10-10T14:36:37.872971Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:36:37.914123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:37.914656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.914686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.914737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872456:5230], now have 1 active actors on pipe
2025-10-10T14:36:37.915016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601991893872456:5230]
2025-10-10T14:36:37.915039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:37.915042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:37.915060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:37.915118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2075 reason: error at write: Disconnected sessionId: src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0
2025-10-10T14:36:37.915465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:37.915475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0] Write session will restart in 0.007811s
2025-10-10T14:36:37.915069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:37.915509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0] Write session: Do CDS request
2025-10-10T14:36:37.915516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:37.915307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2075 sessionId: src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0 is DEAD
2025-10-10T14:36:37.924923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.925037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:37.925053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2076
2025-10-10T14:36:37.925194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:37.925232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:37.925238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:37.925242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:37.925793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2076 sessionId:  describe result for acl check
2025-10-10T14:36:37.925830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:37.925832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:37.925834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:37.925843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601991893872473:8247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:37.926426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601991893872473:8247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:37.931690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601991893872473:8247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:37.934606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:37.935617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601991893872473:8247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:37.935637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601991893872473:8247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:37.935640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601991893872473:8247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:37.935650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:37.937233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:37.937490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:37.937500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:37.937513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:37.937571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:37.937616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601991111642434:3717]
2025-10-10T14:36:37.938213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:37.938567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:37.938621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:37.938951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:37.939011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.939019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.939020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.939021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.939022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.939023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.939024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.939025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.939026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.939027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.939028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.939029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.939030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.939036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.939049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.939053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.939057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.939060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.939064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.939068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.939072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.939076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.939080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.939084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.939088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.939092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.939100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.939109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:37.939116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.939121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:37.939126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.939131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:37.939135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.939140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:37.939145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.939150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:37.939154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.939159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:37.939163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.939168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:37.939172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.939177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:37.939183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.939190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:37.939194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.939199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:37.939203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.939208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.939212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.939217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.939221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.939226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.939266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:37.941782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:37.942164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:37.942177Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:37.942179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:37.942183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:37.942190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2075 [2:7559601991111642434:3717]
2025-10-10T14:36:37.942203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:37.942220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:37.942224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.942227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.942230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.942247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:37.942255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:37.942263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:37.942322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.942332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.942333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.942336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:37.942404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:37.942414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.942426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:37.942438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:37.942457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:37.942479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872458:2438], now have 1 active actors on pipe
2025-10-10T14:36:37.942489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601991893872611:8247], now have 1 active actors on pipe
2025-10-10T14:36:37.942496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601991111642428:3717]
2025-10-10T14:36:37.942499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601991111642428:3717]
2025-10-10T14:36:37.942501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601991111642428:3717]
2025-10-10T14:36:37.942516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:37.942532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:37.942531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:37.942534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:37.942536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:37.942550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:37.942555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:37.942577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601991111642428:3717]
2025-10-10T14:36:37.942580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:37.942589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:37.942560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2075
2025-10-10T14:36:37.942610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2075
2025-10-10T14:36:37.942768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.942780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.942812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:37.942824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:37.942828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:37.942830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:37.942843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:37.942859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:37.942878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.945523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:37.945538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:37.945567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:37.945760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2076 partition: 0 MaxSeqNo: 40 sessionId: src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0
2025-10-10T14:36:37.946229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|874b177c-3e2d4dc5-75861a0c-3f17685d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:37.948966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0] Write session: try to update token
2025-10-10T14:36:37.948984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:37.962948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:37.962963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:37.962966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:37.962968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:37.962979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601991111642428:3717]
2025-10-10T14:36:37.962984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601991111642428:3717]
2025-10-10T14:36:37.962989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601991111642428:3717]
2025-10-10T14:36:37.963038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:37.963042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:37.963049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:37.963050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:37.963053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:37.963053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:37.963188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:37.971406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId: src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:37.974086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:38.014151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601996188839930:5230]
2025-10-10T14:36:38.014365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2075, pipe: [1:7559601996188839930:5230]
2025-10-10T14:36:38.075934Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:38.076348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.076358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.076379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188839930:5230], now have 1 active actors on pipe
2025-10-10T14:36:38.076777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:38.076785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:38.076790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:38.076847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601996188839930:5230]
2025-10-10T14:36:38.076859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2076 reason: error at write: Disconnected sessionId: src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0
2025-10-10T14:36:38.077067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2076 sessionId: src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0 is DEAD
2025-10-10T14:36:38.077075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:38.081436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:38.081454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0] Write session will restart in 0.007156s
2025-10-10T14:36:38.081482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0] Write session: Do CDS request
2025-10-10T14:36:38.081491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:38.089870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.090399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:38.090417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2077
2025-10-10T14:36:38.091202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.091254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:38.091260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:38.091268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:38.091737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2077 sessionId:  describe result for acl check
2025-10-10T14:36:38.091780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:38.091787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:38.091790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:38.091797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601996188839949:8227] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:38.092397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601996188839949:8227] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:38.096809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601996188839949:8227] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:38.106502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601996188839949:8227] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:38.106527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601996188839949:8227] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:38.106531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601996188839949:8227] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:38.106542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:38.111054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:38.113495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:38.113752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:38.113762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:38.113776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:38.113835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:38.113874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601995406609908:3707]
2025-10-10T14:36:38.114504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:38.115059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:38.115114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:38.115450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:38.115522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.115527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.115528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.115530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.115531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.115532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.115533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.115535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.115536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.115538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.115539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.115540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.115542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.115549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.115563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.115568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.115573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.115577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.115582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.115586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.115590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.115594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.115599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.115603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.115607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.115611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.115621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.115630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.115641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.115647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.115651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.115656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.115660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.115665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.115671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.115675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.115680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.115684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.115702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.115707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.115712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.115717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.115723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.115728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.115733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.115738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.115743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.115749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.115754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.115760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.115766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.115772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.115816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:38.119365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:38.119684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:38.119697Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:38.119699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:38.119704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:38.119711Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2076 [2:7559601995406609908:3707]
2025-10-10T14:36:38.119726Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:38.119747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:38.119751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.119755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.119757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.119777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:38.119785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:38.119811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:38.119876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.119882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.119885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.119888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:38.120056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:38.120065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.120077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.120087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.120116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:38.120140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840048:8227], now have 1 active actors on pipe
2025-10-10T14:36:38.120143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188839933:2438], now have 1 active actors on pipe
2025-10-10T14:36:38.120151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601995406609903:3707]
2025-10-10T14:36:38.120153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601995406609903:3707]
2025-10-10T14:36:38.120156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601995406609903:3707]
2025-10-10T14:36:38.120171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:38.120191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:38.120208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:38.120213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:38.120249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601995406609903:3707]
2025-10-10T14:36:38.120256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:38.120284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2076
2025-10-10T14:36:38.120316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2076
2025-10-10T14:36:38.120469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:38.120476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:38.120478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:38.120485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:38.122322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.122339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.122383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdf1e636-27533118-67fd2585-90ee3746_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:38.122396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.122401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.122405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:38.122421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.122439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:38.122469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.124545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.124558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.124591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.127138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2077 partition: 0 MaxSeqNo: 40 sessionId: src_id|fdf1e636-27533118-67fd2585-90ee3746_0
2025-10-10T14:36:38.129606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|485c6f61-e5cb18e2-e05562f8-7cb5684c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fdf1e636-27533118-67fd2585-90ee3746_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:38.132722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf1e636-27533118-67fd2585-90ee3746_0] Write session: try to update token
2025-10-10T14:36:38.132747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf1e636-27533118-67fd2585-90ee3746_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:38.153150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:38.153169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:38.153172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:38.153175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:38.153186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601995406609903:3707]
2025-10-10T14:36:38.153191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601995406609903:3707]
2025-10-10T14:36:38.153194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601995406609903:3707]
2025-10-10T14:36:38.153245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:38.153255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.153257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:38.153423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:38.153445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:38.153453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:38.153458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:38.155405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId: src_id|fdf1e636-27533118-67fd2585-90ee3746_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:38.157989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:38.176997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601996188840099:5230]
2025-10-10T14:36:38.177493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2076, pipe: [1:7559601996188840099:5230]
2025-10-10T14:36:38.282688Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:38.282980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.282994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.283032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840099:5230], now have 1 active actors on pipe
2025-10-10T14:36:38.283186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:38.285463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:38.285935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf1e636-27533118-67fd2585-90ee3746_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:38.285948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf1e636-27533118-67fd2585-90ee3746_0] Write session will restart in 0.005790s
2025-10-10T14:36:38.285982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf1e636-27533118-67fd2585-90ee3746_0] Write session: Do CDS request
2025-10-10T14:36:38.285989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf1e636-27533118-67fd2585-90ee3746_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:38.285554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2077 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fdf1e636-27533118-67fd2585-90ee3746_0
2025-10-10T14:36:38.285768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2077 sessionId: src_id|fdf1e636-27533118-67fd2585-90ee3746_0 is DEAD
2025-10-10T14:36:38.285943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601996188840099:5230]
2025-10-10T14:36:38.285963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:38.297833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf1e636-27533118-67fd2585-90ee3746_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.299898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:38.301756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:38.301769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2078
2025-10-10T14:36:38.302012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.302065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:38.302075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:38.302079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:38.302504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:38.302521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2078 sessionId:  describe result for acl check
2025-10-10T14:36:38.302553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:38.302560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:38.302562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:38.302568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601996188840254:8202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:38.302725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:38.302735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:38.302747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:38.302807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:38.302907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601995406610109:3698]
2025-10-10T14:36:38.303093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601996188840254:8202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:38.303550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:38.303895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:38.303966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:38.304300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:38.304394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.304400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.304401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.304402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.304404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.304405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.304406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.304407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.304408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.304412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.304413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.304414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.304414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.304420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.304431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.304434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.304438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.304442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.304446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.304449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.304453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.304456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.304460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.304463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.304466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.304470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.304477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.304485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.304491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.304496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.304500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.304505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.304509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.304513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.304517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.304522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.304528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.304532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.304538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.304542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.304546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.304550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.304554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.304558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.304562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.304566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.304570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.304574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.304577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.304582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.304587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.304592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.304624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:38.305187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601996188840254:8202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:38.307168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:38.307531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:38.307545Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:38.307547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:38.307551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:38.307556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2077 [2:7559601995406610109:3698]
2025-10-10T14:36:38.307569Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:38.307587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:38.307594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.307598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.307600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.307617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:38.307631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:38.307639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:38.307697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.307704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.307705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.307707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:38.307780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:38.307788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.307798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.307813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.307832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:38.307858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840120:2438], now have 1 active actors on pipe
2025-10-10T14:36:38.307870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601995406610097:3698]
2025-10-10T14:36:38.307876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601995406610097:3698]
2025-10-10T14:36:38.307878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601995406610097:3698]
2025-10-10T14:36:38.307891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:38.307906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:38.307907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:38.307911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:38.307923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:38.307926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:38.307929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:38.307774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601996188840254:8202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:38.307789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601996188840254:8202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:38.307950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601995406610097:3698]
2025-10-10T14:36:38.307960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:38.307961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:38.307990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840284:8202], now have 1 active actors on pipe
2025-10-10T14:36:38.307792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601996188840254:8202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:38.307800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:38.307930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2077
2025-10-10T14:36:38.308084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2077
2025-10-10T14:36:38.308151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.308165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.308200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12ec2702-88085224-7b206a6f-40d6de95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:38.308213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.308225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.308232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:38.308244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.308270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:38.308291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.308485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.308494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.308509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.308599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2078 partition: 0 MaxSeqNo: 40 sessionId: src_id|12ec2702-88085224-7b206a6f-40d6de95_0
2025-10-10T14:36:38.308960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf1e636-27533118-67fd2585-90ee3746_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12ec2702-88085224-7b206a6f-40d6de95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:38.311824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12ec2702-88085224-7b206a6f-40d6de95_0] Write session: try to update token
2025-10-10T14:36:38.311839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12ec2702-88085224-7b206a6f-40d6de95_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:38.328649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId: src_id|12ec2702-88085224-7b206a6f-40d6de95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:38.331143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:38.332805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.332832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.332856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:38.332860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:38.332863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:38.332865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:38.332874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601995406610097:3698]
2025-10-10T14:36:38.332878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601995406610097:3698]
2025-10-10T14:36:38.332882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601995406610097:3698]
2025-10-10T14:36:38.332938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:38.332943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:38.332951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.332953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:38.332954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:38.332958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:38.333098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:38.385893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601996188840291:5230]
2025-10-10T14:36:38.386233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2077, pipe: [1:7559601996188840291:5230]
2025-10-10T14:36:38.451908Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:38.452245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:38.452304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840291:5230], now have 1 active actors on pipe
2025-10-10T14:36:38.452418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:38.457652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601996188840291:5230]
2025-10-10T14:36:38.457681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:38.466278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:38.466293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:38.466324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2078 reason: error at write: Disconnected sessionId: src_id|12ec2702-88085224-7b206a6f-40d6de95_0
2025-10-10T14:36:38.466498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2078 sessionId: src_id|12ec2702-88085224-7b206a6f-40d6de95_0 is DEAD
2025-10-10T14:36:38.468291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ec2702-88085224-7b206a6f-40d6de95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:38.468307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ec2702-88085224-7b206a6f-40d6de95_0] Write session will restart in 0.007714s
2025-10-10T14:36:38.468335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ec2702-88085224-7b206a6f-40d6de95_0] Write session: Do CDS request
2025-10-10T14:36:38.468342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ec2702-88085224-7b206a6f-40d6de95_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:38.476879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12ec2702-88085224-7b206a6f-40d6de95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.476971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:38.476989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2079
2025-10-10T14:36:38.477115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.477146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:38.477152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:38.477157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:38.477585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2079 sessionId:  describe result for acl check
2025-10-10T14:36:38.477616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:38.477618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:38.477620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:38.477627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601996188840419:8207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:38.478225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601996188840419:8207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:38.479277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:38.481502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601996188840419:8207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:38.481997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:38.482221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:38.482232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:38.482244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:38.482296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:38.482330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601995406610274:3688]
2025-10-10T14:36:38.482847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:38.483161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:38.483208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:38.483523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:38.483578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.483579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.483581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.483591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.483592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.483593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.483594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.483595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.483597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.483598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.483599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.483600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.483601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.483606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.483619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.483622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.483626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.483629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.483633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.483637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.483641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.483644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.483648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.483651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.483655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.483658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.483666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.483675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.483681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.483687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.483693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.483698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.483703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.483708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.483715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.483721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.483725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.483731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.483736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.483742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.483746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.483752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.483758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.483763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.483767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.483772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.483777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.483781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.483786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.483790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.483794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.483798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.483833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:38.484689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601996188840419:8207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:38.484706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601996188840419:8207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:38.484709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601996188840419:8207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:38.484718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:38.486233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:38.486690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:38.486699Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:38.486701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:38.486703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:38.486708Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2078 [2:7559601995406610274:3688]
2025-10-10T14:36:38.486717Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:38.486729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:38.486732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.486735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.486739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.486757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:38.486765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:38.486772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:38.486828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.486837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.486839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.486841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:38.486905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:38.486913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.486924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.486936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.486952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:38.486979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840294:2438], now have 1 active actors on pipe
2025-10-10T14:36:38.486983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840455:8207], now have 1 active actors on pipe
2025-10-10T14:36:38.486990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601995406610269:3688]
2025-10-10T14:36:38.486992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601995406610269:3688]
2025-10-10T14:36:38.486994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601995406610269:3688]
2025-10-10T14:36:38.487008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:38.487022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:38.487037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:38.487040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:38.487062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601995406610269:3688]
2025-10-10T14:36:38.487064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:38.487098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:38.487108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:38.487110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:38.487117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:38.487191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2078
2025-10-10T14:36:38.487225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2078
2025-10-10T14:36:38.487391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.487440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.487482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:38.487508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.487513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.487516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:38.487528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.487547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:38.487574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.487735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.487743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.487758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.487849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2079 partition: 0 MaxSeqNo: 40 sessionId: src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0
2025-10-10T14:36:38.488228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12ec2702-88085224-7b206a6f-40d6de95_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:38.491104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0] Write session: try to update token
2025-10-10T14:36:38.491122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:38.499450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:38.499464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:38.499478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601995406610269:3688]
2025-10-10T14:36:38.499520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:38.499528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:38.499706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:38.499860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:38.500102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:38.500312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:38.500677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:38.500726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:38.508268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId: src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:38.510949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:38.511332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.511354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.511402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:38.511484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:38.532447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:38.532467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:38.532472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:38.532475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:38.532488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601995406610269:3688]
2025-10-10T14:36:38.532497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601995406610269:3688]
2025-10-10T14:36:38.532501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601995406610269:3688]
2025-10-10T14:36:38.532553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:38.532561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.532565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:38.532734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:38.537613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:38.537629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:38.537634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:38.557926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601996188840462:5230]
2025-10-10T14:36:38.558522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2078, pipe: [1:7559601996188840462:5230]
2025-10-10T14:36:38.662917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:38.670606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.670634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.670801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.670861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.670921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.670983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.671030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.671037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.671102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.671157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.671213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.671509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.671560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.671568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.671642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.671712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.671783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.671844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.672079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.672085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.672160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.672227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.672292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.672357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.672419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.672427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.672501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.672565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.672635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.672704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.672753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.672762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.672833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.672897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.672963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.673046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.673096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.673102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.673184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.673247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.673321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.673483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.673532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.673537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.673688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.673755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.673858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.675318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:38.675336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:38.675342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:38.675379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2079 reason: error at write: Disconnected sessionId: src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0
2025-10-10T14:36:38.675401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601996188840462:5230]
2025-10-10T14:36:38.675585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2079 sessionId: src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0 is DEAD
2025-10-10T14:36:38.675735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:38.675747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0] Write session will restart in 0.006795s
2025-10-10T14:36:38.675773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0] Write session: Do CDS request
2025-10-10T14:36:38.675779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:38.673922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.673975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.673978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.674049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.674108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.674168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.674231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.674279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.674282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.674356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.674418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.674484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.674549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.674597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.674603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.674669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840462:5230], now have 1 active actors on pipe
2025-10-10T14:36:38.675637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:38.684002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.684088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:38.684105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2080
2025-10-10T14:36:38.684322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.684356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:38.684362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:38.684375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:38.684793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2080 sessionId:  describe result for acl check
2025-10-10T14:36:38.684820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:38.684823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:38.684825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:38.684830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601996188840478:8204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:38.685408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601996188840478:8204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:38.688323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601996188840478:8204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:38.693318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601996188840478:8204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:38.693349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601996188840478:8204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:38.693352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601996188840478:8204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:38.693361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:38.694841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:38.697099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:38.697366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:38.697379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:38.697392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:38.697461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:38.697501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601995406610441:3686]
2025-10-10T14:36:38.697980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:38.698265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:38.698300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:38.698540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:38.698583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.698583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.698584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.698585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.698586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.698587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.698588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.698588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.698589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.698590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.698591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.698591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.698592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.698596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.698605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.698607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.698610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.698612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.698614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.698617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.698619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.698622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.698624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.698627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.698629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.698631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.698637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.698643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.698648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.698651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.698654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.698658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.698660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.698664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.698667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.698670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.698673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.698677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.698680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.698683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.698686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.698690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.698693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.698696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.698699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.698704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.698707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.698710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.698712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.698715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.698718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.698721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.698746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:38.701527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:38.702037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:38.702051Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:38.702054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:38.702057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:38.702062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2079 [2:7559601995406610441:3686]
2025-10-10T14:36:38.702071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:38.702085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:38.702088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.702091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.702092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.702108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:38.702122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:38.702131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:38.702198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.702207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.702209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.702212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:38.702299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:38.702307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.702318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.702329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.702345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:38.702367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601995406610436:3686]
2025-10-10T14:36:38.702369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601995406610436:3686]
2025-10-10T14:36:38.702372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601995406610436:3686]
2025-10-10T14:36:38.702386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:38.702395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:38.702398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:38.702400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:38.702402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840465:2438], now have 1 active actors on pipe
2025-10-10T14:36:38.702406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840619:8204], now have 1 active actors on pipe
2025-10-10T14:36:38.702414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:38.702429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:38.702433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:38.702462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601995406610436:3686]
2025-10-10T14:36:38.702465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:38.702469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:38.702824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2079
2025-10-10T14:36:38.702867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2079
2025-10-10T14:36:38.703120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.703134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.703172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:38.703187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.703193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.703195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:38.703209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.703227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:38.703249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.703635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.703644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.703664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.703895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2080 partition: 0 MaxSeqNo: 40 sessionId: src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0
2025-10-10T14:36:38.704322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b268db2e-2ef0c2cb-8f726c55-f57da853_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:38.707212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0] Write session: try to update token
2025-10-10T14:36:38.707236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:38.714396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:38.714411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:38.714432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559601995406610436:3686]
2025-10-10T14:36:38.714479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:38.714484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:38.714666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:38.714809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:38.714965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:38.715102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:38.715287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:38.715322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:38.722194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId: src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:38.724701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:38.725244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.725263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.725311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:38.725414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:38.734548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:38.734565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:38.734569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:38.734571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:38.734583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601995406610436:3686]
2025-10-10T14:36:38.734586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601995406610436:3686]
2025-10-10T14:36:38.734591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601995406610436:3686]
2025-10-10T14:36:38.734637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:38.734642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:38.734645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:38.734649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:38.734652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.734655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:38.734788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:38.778437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601996188840645:5230]
2025-10-10T14:36:38.778660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2079, pipe: [1:7559601996188840645:5230]
2025-10-10T14:36:38.851402Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:38.859221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.859253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.859457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.859521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.859597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.859662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.859713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.859725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.859798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.859867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.859933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.860009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.860052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.860055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.860134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.860197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.860264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.860328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.860396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.860402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.860478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.860548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.860612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.860678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.860720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.860727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.860803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.860872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.860930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.861000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.861046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.861053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.861120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.861182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.861244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.861313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.861377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.861384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.861452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.861520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.861592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.861657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.861702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.861709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.861776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.861835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.861899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.861960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.862011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.862014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.862089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.862153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.862217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.862282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.862329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.862336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.862403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:38.862466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:38.862536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:38.862598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:38.862647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:38.862658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:38.862720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840645:5230], now have 1 active actors on pipe
2025-10-10T14:36:38.863078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:38.863092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601996188840645:5230]
2025-10-10T14:36:38.863145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:38.863155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:38.863196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2080 reason: error at write: Disconnected sessionId: src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0
2025-10-10T14:36:38.863420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2080 sessionId: src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0 is DEAD
2025-10-10T14:36:38.863769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:38.863779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0] Write session will restart in 0.006140s
2025-10-10T14:36:38.863799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0] Write session: Do CDS request
2025-10-10T14:36:38.863804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:38.863834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:38.870961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.871344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:38.871360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2081
2025-10-10T14:36:38.871728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:38.871766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:38.871772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:38.871775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:38.872282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2081 sessionId:  describe result for acl check
2025-10-10T14:36:38.872325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:38.872332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:38.872334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:38.872341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559601996188840684:8199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:38.872982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559601996188840684:8199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:38.875841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559601996188840684:8199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:38.877496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:38.879857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:38.880043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559601996188840684:8199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:38.880068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:38.880059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559601996188840684:8199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:38.880081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:38.880062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559601996188840684:8199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:38.880072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:38.880094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:38.880158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:38.880227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601995406610607:3681]
2025-10-10T14:36:38.880849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:38.881125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:38.881171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:38.881522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:38.881597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.881604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.881606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.881607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.881608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.881609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.881610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.881611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.881613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.881614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.881615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.881616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.881617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.881624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.881637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.881642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.881646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.881650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.881654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.881658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.881662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.881666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.881670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.881675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.881678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.881682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.881690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.881699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:38.881706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.881731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:38.881742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.881748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:38.881752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.881758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:38.881762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.881768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:38.881772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.881778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:38.881782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.881787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:38.881792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.881797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:38.881803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.881808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:38.881816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.881821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:38.881826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.881831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.881836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.881842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.881846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.881851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.881887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:38.885116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:38.885726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:38.885738Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:38.885740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:38.885744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:38.885750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2080 [2:7559601995406610607:3681]
2025-10-10T14:36:38.885764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:38.885784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:38.885793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.885797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.885800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.885817Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:38.885829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:38.885839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:38.885901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.885910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.885911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.885914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:38.885982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:38.885990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.886001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:38.886011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:38.886031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:38.886055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601995406610602:3681]
2025-10-10T14:36:38.886062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601995406610602:3681]
2025-10-10T14:36:38.886064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601995406610602:3681]
2025-10-10T14:36:38.886081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:38.886100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:38.886115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:38.886118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:38.886150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601995406610602:3681]
2025-10-10T14:36:38.886158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:38.886241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:38.886247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:38.886249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:38.886256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:38.886339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840647:2438], now have 1 active actors on pipe
2025-10-10T14:36:38.886348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840805:8199], now have 1 active actors on pipe
2025-10-10T14:36:38.886621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2080
2025-10-10T14:36:38.886665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2080
2025-10-10T14:36:38.887680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2081 partition: 0 MaxSeqNo: 40 sessionId: src_id|d288b573-16638ec6-b0460548-8ae19620_0
2025-10-10T14:36:38.888119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5ef4dc-f82f6820-2d9fb9f5-60f94bd5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d288b573-16638ec6-b0460548-8ae19620_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:38.887050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.887063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.887105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d288b573-16638ec6-b0460548-8ae19620_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:38.887115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:38.887120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:38.887124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:38.887137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:38.887153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:38.887170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.887539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:38.887543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:38.887576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:38.891054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d288b573-16638ec6-b0460548-8ae19620_0] Write session: try to update token
2025-10-10T14:36:38.891073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d288b573-16638ec6-b0460548-8ae19620_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:38.906420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:38.906439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:38.906443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:38.906445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:38.906456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601995406610602:3681]
2025-10-10T14:36:38.906461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601995406610602:3681]
2025-10-10T14:36:38.906465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601995406610602:3681]
2025-10-10T14:36:38.906518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:38.906519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:38.906525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:38.906528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:38.906530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:38.906534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:38.906672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:38.912259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId: src_id|d288b573-16638ec6-b0460548-8ae19620_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:38.915178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:38.963444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559601996188840818:5230]
2025-10-10T14:36:38.963783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2080, pipe: [1:7559601996188840818:5230]
2025-10-10T14:36:39.033040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:39.033504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.033524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.033571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559601996188840818:5230], now have 1 active actors on pipe
2025-10-10T14:36:39.033800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:39.033824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559601996188840818:5230]
2025-10-10T14:36:39.033854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:39.033932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:39.033880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:39.033949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2081 reason: error at write: Disconnected sessionId: src_id|d288b573-16638ec6-b0460548-8ae19620_0
2025-10-10T14:36:39.034147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2081 sessionId: src_id|d288b573-16638ec6-b0460548-8ae19620_0 is DEAD
2025-10-10T14:36:39.034311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d288b573-16638ec6-b0460548-8ae19620_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:39.034323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d288b573-16638ec6-b0460548-8ae19620_0] Write session will restart in 0.008468s
2025-10-10T14:36:39.034351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d288b573-16638ec6-b0460548-8ae19620_0] Write session: Do CDS request
2025-10-10T14:36:39.034360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d288b573-16638ec6-b0460548-8ae19620_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:39.046210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d288b573-16638ec6-b0460548-8ae19620_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.046293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:39.046311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2082
2025-10-10T14:36:39.046422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.046460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:39.046471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:39.046475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:39.046965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2082 sessionId:  describe result for acl check
2025-10-10T14:36:39.047015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:39.047024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:39.047025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:39.047032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602000483808257:2320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:39.047600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602000483808257:2320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:39.047935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:39.050045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602000483808257:2320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:39.050730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:39.050979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:39.050985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:39.050997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:39.051071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:39.051114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601999701578085:3662]
2025-10-10T14:36:39.051693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:39.052013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:39.052061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:39.052418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:39.052478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.052484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.052486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.052487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.052489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.052490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.052492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.052493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.052494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.052496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.052497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.052499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.052500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.052507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.052520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.052525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.052529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.052533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.052538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.052542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.052546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.052550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.052555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.052559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.052563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.052567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.052574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.052583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.052589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.052595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.052599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.052605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.052609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.052615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.052620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.052632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.052638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.052644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.052654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.052659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.052670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.052676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.052681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.052686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.052694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.052700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.052704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.052709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.052714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.052719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.052723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.052729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.052727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602000483808257:2320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:39.052771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:39.052746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602000483808257:2320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:39.052749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602000483808257:2320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:39.052760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:39.055380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:39.055752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:39.055762Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:39.055765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:39.055769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:39.055775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2081 [2:7559601999701578085:3662]
2025-10-10T14:36:39.055790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:39.055811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:39.055818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.055822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.055824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.055841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:39.055854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:39.055862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:39.055923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.055931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.055933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.055936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:39.056004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:39.056012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.056025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.056040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.056062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:39.056088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808127:2438], now have 1 active actors on pipe
2025-10-10T14:36:39.056100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808290:2320], now have 1 active actors on pipe
2025-10-10T14:36:39.056108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601999701578080:3662]
2025-10-10T14:36:39.056110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601999701578080:3662]
2025-10-10T14:36:39.056113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601999701578080:3662]
2025-10-10T14:36:39.056126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:39.056141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:39.056147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:39.056150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:39.056152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:39.056163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:39.056167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:39.056165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2081
2025-10-10T14:36:39.056194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601999701578080:3662]
2025-10-10T14:36:39.056178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2081
2025-10-10T14:36:39.056207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:39.056213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:39.056227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.056236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.056288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bb17334-1eb28530-68d79179-5f53461e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:39.056300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.056304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.056307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:39.056322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.056338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:39.056373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.056525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.056534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.056550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.056660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2082 partition: 0 MaxSeqNo: 40 sessionId: src_id|7bb17334-1eb28530-68d79179-5f53461e_0
2025-10-10T14:36:39.057059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d288b573-16638ec6-b0460548-8ae19620_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7bb17334-1eb28530-68d79179-5f53461e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:39.059794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb17334-1eb28530-68d79179-5f53461e_0] Write session: try to update token
2025-10-10T14:36:39.059814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb17334-1eb28530-68d79179-5f53461e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:39.076926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:39.076946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:39.076950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:39.076956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:39.076967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601999701578080:3662]
2025-10-10T14:36:39.076973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601999701578080:3662]
2025-10-10T14:36:39.076977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601999701578080:3662]
2025-10-10T14:36:39.077024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:39.077029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:39.077030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:39.077035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:39.077037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.077039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:39.077177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:39.077426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId: src_id|7bb17334-1eb28530-68d79179-5f53461e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:39.080063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:39.133919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602000483808300:5230]
2025-10-10T14:36:39.134262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2081, pipe: [1:7559602000483808300:5230]
2025-10-10T14:36:39.193205Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:39.193849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.193879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.193937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808300:5230], now have 1 active actors on pipe
2025-10-10T14:36:39.194327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:39.194398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:39.194409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:39.194482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2082 reason: error at write: Disconnected sessionId: src_id|7bb17334-1eb28530-68d79179-5f53461e_0
2025-10-10T14:36:39.194499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602000483808300:5230]
2025-10-10T14:36:39.194527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:39.194699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2082 sessionId: src_id|7bb17334-1eb28530-68d79179-5f53461e_0 is DEAD
2025-10-10T14:36:39.197574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb17334-1eb28530-68d79179-5f53461e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:39.197588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb17334-1eb28530-68d79179-5f53461e_0] Write session will restart in 0.009269s
2025-10-10T14:36:39.197615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb17334-1eb28530-68d79179-5f53461e_0] Write session: Do CDS request
2025-10-10T14:36:39.197624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb17334-1eb28530-68d79179-5f53461e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:39.207938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb17334-1eb28530-68d79179-5f53461e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.208029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:39.208048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2083
2025-10-10T14:36:39.208188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.208243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:39.208254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:39.208259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:39.208420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:39.208790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2083 sessionId:  describe result for acl check
2025-10-10T14:36:39.208831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:39.208838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:39.208840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:39.208847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602000483808432:2326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:39.209433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602000483808432:2326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:39.210990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:39.211228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:39.211240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:39.211253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:39.211316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:39.211365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601999701578255:3670]
2025-10-10T14:36:39.211784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602000483808432:2326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:39.211978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:39.212270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:39.212326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:39.212662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:39.212719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.212726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.212728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.212729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.212730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.212731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.212733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.212734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.212735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.212736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.212738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.212739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.212740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.212746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.212759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.212764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.212768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.212771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.212775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.212780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.212784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.212788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.212793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.212797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.212801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.212805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.212812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.212821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.212827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.212833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.212840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.212845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.212849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.212855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.212860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.212865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.212870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.212875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.212880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.212887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.212891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.212896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.212901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.212907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.212911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.212915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.212919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.212924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.212928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.212934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.212939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.212944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.212988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:39.215456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602000483808432:2326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:39.215474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602000483808432:2326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:39.215478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602000483808432:2326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:39.215488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:39.215527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:39.215862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:39.215874Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:39.215877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:39.215893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:39.215901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2082 [2:7559601999701578255:3670]
2025-10-10T14:36:39.215915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:39.215933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:39.215940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.215944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.215954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.215972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:39.215985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:39.215993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:39.216061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.216069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.216071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.216074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:39.216144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:39.216152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.216163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.216175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.216193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:39.216223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808301:2438], now have 1 active actors on pipe
2025-10-10T14:36:39.216231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808465:2326], now have 1 active actors on pipe
2025-10-10T14:36:39.216239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601999701578249:3670]
2025-10-10T14:36:39.216241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601999701578249:3670]
2025-10-10T14:36:39.216243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601999701578249:3670]
2025-10-10T14:36:39.216268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:39.216280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:39.216284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:39.216286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:39.216290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:39.216308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:39.216312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:39.216340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601999701578249:3670]
2025-10-10T14:36:39.216350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:39.216366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:39.216390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.216400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.216283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2082
2025-10-10T14:36:39.216284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2082
2025-10-10T14:36:39.216455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:39.216471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.216475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.216478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:39.216490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.216500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:39.216522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.216737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.216768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.216799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.216897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2083 partition: 0 MaxSeqNo: 40 sessionId: src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0
2025-10-10T14:36:39.217496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb17334-1eb28530-68d79179-5f53461e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:39.220277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0] Write session: try to update token
2025-10-10T14:36:39.220297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:39.234924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId: src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:39.237267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:39.237284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:39.237287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:39.237290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:39.237302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601999701578249:3670]
2025-10-10T14:36:39.237308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601999701578249:3670]
2025-10-10T14:36:39.237312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601999701578249:3670]
2025-10-10T14:36:39.237381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:39.237389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.237391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:39.237389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:39.237397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:39.237401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:39.237556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:39.237703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:39.294680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602000483808473:5230]
2025-10-10T14:36:39.295040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2082, pipe: [1:7559602000483808473:5230]
2025-10-10T14:36:39.357428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:39.357998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.358014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.358059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808473:5230], now have 1 active actors on pipe
2025-10-10T14:36:39.358285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:39.358315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602000483808473:5230]
2025-10-10T14:36:39.358333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:39.358338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:39.358345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:39.358415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2083 reason: error at write: Disconnected sessionId: src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0
2025-10-10T14:36:39.358628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2083 sessionId: src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0 is DEAD
2025-10-10T14:36:39.358973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:39.358986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0] Write session will restart in 0.006707s
2025-10-10T14:36:39.359012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0] Write session: Do CDS request
2025-10-10T14:36:39.359019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:39.366940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.369495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:39.369511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2084
2025-10-10T14:36:39.369682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.369733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:39.369746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:39.369750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:39.370241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2084 sessionId:  describe result for acl check
2025-10-10T14:36:39.370284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:39.370291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:39.370293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:39.370299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602000483808516:2357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:39.370892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602000483808516:2357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:39.373419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602000483808516:2357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:39.378596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602000483808516:2357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:39.378615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602000483808516:2357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:39.378619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602000483808516:2357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:39.378629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:39.380771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:39.383615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:39.383903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:39.383913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:39.383926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:39.383987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:39.384034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601999701578464:3647]
2025-10-10T14:36:39.384734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:39.385075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:39.385122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:39.385475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:39.385542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.385549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.385550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.385551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.385553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.385555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.385556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.385557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.385559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.385560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.385561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.385562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.385564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.385571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.385586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.385591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.385595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.385600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.385605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.385610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.385614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.385619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.385623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.385628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.385632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.385635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.385644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.385653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.385659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.385665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.385670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.385675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.385689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.385695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.385701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.385711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.385716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.385722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.385728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.385734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.385744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.385749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.385755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.385765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.385770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.385780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.385786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.385796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.385801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.385811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.385816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.385826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.385871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:39.388496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:39.388830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:39.388843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:39.388846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:39.388850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:39.388857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2083 [2:7559601999701578464:3647]
2025-10-10T14:36:39.388871Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:39.388897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:39.388905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.388909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.388912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.388929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:39.388942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:39.388955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:39.389020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.389027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.389030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.389033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:39.389105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:39.389113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.389127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.389147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.389170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:39.389199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808501:2438], now have 1 active actors on pipe
2025-10-10T14:36:39.389209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808657:2357], now have 1 active actors on pipe
2025-10-10T14:36:39.389218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601999701578459:3647]
2025-10-10T14:36:39.389221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601999701578459:3647]
2025-10-10T14:36:39.389224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601999701578459:3647]
2025-10-10T14:36:39.389239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:39.389254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:39.389254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:39.389257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:39.389268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:39.389272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:39.389276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:39.389307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601999701578459:3647]
2025-10-10T14:36:39.389252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2083
2025-10-10T14:36:39.389320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:39.389275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2083
2025-10-10T14:36:39.389343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:39.389400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.389411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.389567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:39.389581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.389585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.389588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:39.389600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.389617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:39.389641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.389810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.389819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.389835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.389923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2084 partition: 0 MaxSeqNo: 40 sessionId: src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0
2025-10-10T14:36:39.390313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fd82e16-4e7d93c2-aa803030-4e174fa5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:39.393002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0] Write session: try to update token
2025-10-10T14:36:39.393023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:39.407678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId: src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:39.409945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:39.409969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:39.409973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:39.409975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:39.409985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601999701578459:3647]
2025-10-10T14:36:39.409989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601999701578459:3647]
2025-10-10T14:36:39.409993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601999701578459:3647]
2025-10-10T14:36:39.410049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:39.410048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:39.410056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:39.410061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:39.410062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.410064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:39.410217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:39.410418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:39.458531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602000483808672:5230]
2025-10-10T14:36:39.458903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2083, pipe: [1:7559602000483808672:5230]
2025-10-10T14:36:39.530918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:39.531627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.531656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.531718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808672:5230], now have 1 active actors on pipe
2025-10-10T14:36:39.532055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:39.532032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:39.532108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602000483808672:5230]
2025-10-10T14:36:39.532145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:39.532152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:39.532215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2084 reason: error at write: Disconnected sessionId: src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0
2025-10-10T14:36:39.532471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2084 sessionId: src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0 is DEAD
2025-10-10T14:36:39.533600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:39.533613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0] Write session will restart in 0.005822s
2025-10-10T14:36:39.533639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0] Write session: Do CDS request
2025-10-10T14:36:39.533658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:39.541776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.544004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:39.544019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2085
2025-10-10T14:36:39.545196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.545257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:39.545280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:39.545284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:39.545771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2085 sessionId:  describe result for acl check
2025-10-10T14:36:39.545807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:39.545809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:39.545811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:39.545817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602000483808795:2359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:39.546389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602000483808795:2359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:39.547856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:39.548800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602000483808795:2359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:39.550113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:39.550334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:39.550348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:39.550360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:39.550421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:39.550462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601999701578634:3633]
2025-10-10T14:36:39.551056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:39.551451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:39.551525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:39.551852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602000483808795:2359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:39.551868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602000483808795:2359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:39.551872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602000483808795:2359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:39.551881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:39.551921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:39.551989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.551999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.552000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.552001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.552003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.552004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.552005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.552006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.552008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.552009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.552010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.552012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.552013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.552020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.552034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.552039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.552044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.552048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.552053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.552057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.552062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.552066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.552071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.552076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.552080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.552085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.552093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.552103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.552110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.552115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.552119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.552125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.552129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.552135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.552140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.552145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.552151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.552156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.552162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.552168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.552173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.552178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.552183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.552189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.552196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.552207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.552212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.552217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.552225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.552231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.552235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.552244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.552284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:39.554851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:39.555515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:39.555529Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:39.555531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:39.555536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:39.555542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2084 [2:7559601999701578634:3633]
2025-10-10T14:36:39.555557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:39.555576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:39.555582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.555586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.555588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.555607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:39.555616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:39.555629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:39.555694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.555701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.555704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.555707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:39.555783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:39.555791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.555805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.555817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.555835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:39.555858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601999701578629:3633]
2025-10-10T14:36:39.555866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601999701578629:3633]
2025-10-10T14:36:39.555868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601999701578629:3633]
2025-10-10T14:36:39.555885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:39.555905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:39.555907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808839:2359], now have 1 active actors on pipe
2025-10-10T14:36:39.555911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808674:2438], now have 1 active actors on pipe
2025-10-10T14:36:39.555914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:39.555916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:39.555920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:39.555937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:39.555946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:39.555981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601999701578629:3633]
2025-10-10T14:36:39.555995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:39.555995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:39.555959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2084
2025-10-10T14:36:39.556077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2084
2025-10-10T14:36:39.556122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.556132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.556167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:39.556179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.556183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.556186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:39.556196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.556222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:39.556240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.556539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.556550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.556574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.556695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2085 partition: 0 MaxSeqNo: 40 sessionId: src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0
2025-10-10T14:36:39.557099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18216a77-ec6271c4-13ec9d8e-4030f585_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:39.559766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0] Write session: try to update token
2025-10-10T14:36:39.559785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:39.574755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId: src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:39.576571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:39.576590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:39.576594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:39.576596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:39.576609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601999701578629:3633]
2025-10-10T14:36:39.576614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601999701578629:3633]
2025-10-10T14:36:39.576618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601999701578629:3633]
2025-10-10T14:36:39.576669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:39.576675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:39.576681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.576682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:39.576684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:39.576688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:39.576842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:39.577808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:39.632077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602000483808849:5230]
2025-10-10T14:36:39.632416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2084, pipe: [1:7559602000483808849:5230]
2025-10-10T14:36:39.694347Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:39.694662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.694679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.694726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808849:5230], now have 1 active actors on pipe
2025-10-10T14:36:39.694955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:39.694974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:39.694982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:39.695047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602000483808849:5230]
2025-10-10T14:36:39.695053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2085 reason: error at write: Disconnected sessionId: src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0
2025-10-10T14:36:39.695258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2085 sessionId: src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0 is DEAD
2025-10-10T14:36:39.695004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:39.695481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:39.695493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0] Write session will restart in 0.008547s
2025-10-10T14:36:39.695531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0] Write session: Do CDS request
2025-10-10T14:36:39.695537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:39.704922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.705034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:39.705050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2086
2025-10-10T14:36:39.705188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.705236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:39.705248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:39.705261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:39.705750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2086 sessionId:  describe result for acl check
2025-10-10T14:36:39.705787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:39.705789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:39.705791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:39.705797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602000483808918:2380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:39.706396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602000483808918:2380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:39.708830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602000483808918:2380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:39.710420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:39.712858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:39.713068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602000483808918:2380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:39.713084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602000483808918:2380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:39.713088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602000483808918:2380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:39.713101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:39.713111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:39.713097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:39.713121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:39.713164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:39.713215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601999701578806:3641]
2025-10-10T14:36:39.713818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:39.714121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:39.714159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:39.714419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:39.714479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.714487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.714488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.714489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.714490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.714492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.714493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.714494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.714496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.714497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.714498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.714500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.714501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.714507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.714518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.714520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.714522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.714525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.714527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.714529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.714531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.714533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.714535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.714538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.714540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.714542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.714549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.714554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.714559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.714562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.714565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.714568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.714571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.714574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.714577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.714580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.714583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.714586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.714589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.714592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.714595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.714607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.714610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.714613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.714615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.714620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.714623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.714626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.714629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.714632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.714635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.714638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.714676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:39.717110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:39.717475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:39.717487Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:39.717489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:39.717493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:39.717500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2085 [2:7559601999701578806:3641]
2025-10-10T14:36:39.717512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:39.717530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:39.717533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.717537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.717539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.717557Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:39.717565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:39.717573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:39.717640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.717651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.717653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.717656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:39.717738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:39.717745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.717757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.717772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.717794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:39.717821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483808852:2438], now have 1 active actors on pipe
2025-10-10T14:36:39.717829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483809018:2380], now have 1 active actors on pipe
2025-10-10T14:36:39.717837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601999701578801:3641]
2025-10-10T14:36:39.717839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601999701578801:3641]
2025-10-10T14:36:39.717842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601999701578801:3641]
2025-10-10T14:36:39.717857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:39.717874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:39.717853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2085
2025-10-10T14:36:39.717867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2085
2025-10-10T14:36:39.717891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:39.717898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:39.717902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:39.717903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:39.717905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:39.717925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601999701578801:3641]
2025-10-10T14:36:39.717928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:39.717932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:39.718072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.718083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.718115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|265d975e-6264198b-bd7012d3-29bdbc42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:39.718130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.718134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.718137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:39.718148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.718160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:39.718181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.718338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.718347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.718362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.718472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2086 partition: 0 MaxSeqNo: 40 sessionId: src_id|265d975e-6264198b-bd7012d3-29bdbc42_0
2025-10-10T14:36:39.718875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab015d60-a873ec44-1015eb2e-24852e3b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|265d975e-6264198b-bd7012d3-29bdbc42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:39.721779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|265d975e-6264198b-bd7012d3-29bdbc42_0] Write session: try to update token
2025-10-10T14:36:39.721804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|265d975e-6264198b-bd7012d3-29bdbc42_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:39.737325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId: src_id|265d975e-6264198b-bd7012d3-29bdbc42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:39.738490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:39.738506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:39.738511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:39.738514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:39.738525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601999701578801:3641]
2025-10-10T14:36:39.738530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601999701578801:3641]
2025-10-10T14:36:39.738534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601999701578801:3641]
2025-10-10T14:36:39.738592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:39.738594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:39.738601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:39.738606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:39.738610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.738613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:39.738769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:39.740525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:39.795413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602000483809036:5230]
2025-10-10T14:36:39.795675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2085, pipe: [1:7559602000483809036:5230]
2025-10-10T14:36:39.854633Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:39.855285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.855306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.855358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483809036:5230], now have 1 active actors on pipe
2025-10-10T14:36:39.855647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602000483809036:5230]
2025-10-10T14:36:39.855648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:39.855683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:39.855761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2086 reason: status is not ok: tablet will be restarted right now sessionId: src_id|265d975e-6264198b-bd7012d3-29bdbc42_0
2025-10-10T14:36:39.855580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:39.855964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2086 sessionId: src_id|265d975e-6264198b-bd7012d3-29bdbc42_0 is DEAD
2025-10-10T14:36:39.856110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|265d975e-6264198b-bd7012d3-29bdbc42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:39.856122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|265d975e-6264198b-bd7012d3-29bdbc42_0] Write session will restart in 0.009774s
2025-10-10T14:36:39.856157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|265d975e-6264198b-bd7012d3-29bdbc42_0] Write session: Do CDS request
2025-10-10T14:36:39.856164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|265d975e-6264198b-bd7012d3-29bdbc42_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:39.866992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|265d975e-6264198b-bd7012d3-29bdbc42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.867014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:39.867032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2087
2025-10-10T14:36:39.867275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:39.867322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:39.867332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:39.867337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:39.867807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2087 sessionId:  describe result for acl check
2025-10-10T14:36:39.867845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:39.867847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:39.867849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:39.867856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602000483809158:2389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:39.868531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602000483809158:2389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:39.870293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:39.871379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602000483809158:2389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:39.872839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:39.873078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:39.873092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:39.873105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:39.873162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:39.873209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559601999701578979:3640]
2025-10-10T14:36:39.873854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:39.873841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602000483809158:2389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:39.873857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602000483809158:2389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:39.873861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602000483809158:2389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:39.873870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:39.874117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:39.874162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:39.874476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:39.874536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.874542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.874544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.874545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.874546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.874547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.874549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.874550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.874551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.874553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.874554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.874555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.874556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.874562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.874576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.874581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.874585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.874589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.874593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.874597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.874601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.874606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.874610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.874614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.874618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.874623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.874630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.874639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:39.874646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.874652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:39.874656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.874662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:39.874672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.874678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:39.874689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.874694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:39.874700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.874705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:39.874710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.874715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:39.874720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.874726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:39.874731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.874742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:39.874747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.874753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:39.874758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.874765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.874774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.874781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.874790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.874795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.874839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:39.877319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:39.877697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:39.877720Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:39.877723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:39.877726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:39.877733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2086 [2:7559601999701578979:3640]
2025-10-10T14:36:39.877747Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:39.877769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:39.877773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.877776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.877779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.877796Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:39.877810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:39.877818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:39.877890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.877897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.877899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.877902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:39.877985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:39.877993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.878005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:39.878020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:39.878041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:39.878072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483809202:2389], now have 1 active actors on pipe
2025-10-10T14:36:39.878082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483809037:2438], now have 1 active actors on pipe
2025-10-10T14:36:39.878091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559601999701578974:3640]
2025-10-10T14:36:39.878093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559601999701578974:3640]
2025-10-10T14:36:39.878095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559601999701578974:3640]
2025-10-10T14:36:39.878114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:39.878131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:39.878137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:39.878142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:39.878144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:39.878153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:39.878133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2086
2025-10-10T14:36:39.878157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:39.878138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2086
2025-10-10T14:36:39.878192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559601999701578974:3640]
2025-10-10T14:36:39.878208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:39.878216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:39.878233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.878244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.878303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:39.878318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:39.878327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:39.878330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:39.878342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:39.878358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:39.878379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.878561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:39.878573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:39.878596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:39.878731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2087 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0
2025-10-10T14:36:39.879160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|265d975e-6264198b-bd7012d3-29bdbc42_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:39.881824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0] Write session: try to update token
2025-10-10T14:36:39.881839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:39.904767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:39.904792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:39.904796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:39.904798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:39.904809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559601999701578974:3640]
2025-10-10T14:36:39.904814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559601999701578974:3640]
2025-10-10T14:36:39.904817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559601999701578974:3640]
2025-10-10T14:36:39.904875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:39.904884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:39.904886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:39.904898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:39.904906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:39.904911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:39.905040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:39.909883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId: src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:39.912623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:39.955675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602000483809214:5230]
2025-10-10T14:36:39.956030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2086, pipe: [1:7559602000483809214:5230]
2025-10-10T14:36:40.023442Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:40.023843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.023859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.023905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602000483809214:5230], now have 1 active actors on pipe
2025-10-10T14:36:40.024142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:40.024121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602000483809214:5230]
2025-10-10T14:36:40.024192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:40.024194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:40.024268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2087 reason: error at write: Disconnected sessionId: src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0
2025-10-10T14:36:40.024410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:40.024511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2087 sessionId: src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0 is DEAD
2025-10-10T14:36:40.024682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:40.024696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0] Write session will restart in 0.009835s
2025-10-10T14:36:40.024738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0] Write session: Do CDS request
2025-10-10T14:36:40.024748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:40.035908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.036036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:40.036056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2088
2025-10-10T14:36:40.036212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.036251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:40.036262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:40.036266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:40.036817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2088 sessionId:  describe result for acl check
2025-10-10T14:36:40.036855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:40.036861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:40.036864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:40.036870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602004778776622:2401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:40.037473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602004778776622:2401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:40.039577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602004778776622:2401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:40.039712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:40.041960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:40.042189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:40.042205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:40.042217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:40.042277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:40.042324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602003996546463:3638]
2025-10-10T14:36:40.042330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602004778776622:2401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:40.042342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602004778776622:2401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:40.042346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602004778776622:2401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:40.042353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:40.042899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:40.043878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:40.043951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:40.044353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:40.044424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.044431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.044432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.044434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.044436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.044437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.044438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.044440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.044441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.044443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.044444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.044445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.044446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.044453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.044468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.044472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.044477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.044480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.044485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.044489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.044493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.044498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.044503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.044508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.044513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.044517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.044525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.044534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.044547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.044553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.044563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.044568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.044573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.044578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.044582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.044587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.044594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.044599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.044604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.044616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.044621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.044630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.044634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.044645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.044650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.044660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.044665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.044671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.044675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.044680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.044685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.044691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.044736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:40.047247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:40.047596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:40.047607Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:40.047609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:40.047614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:40.047621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2087 [2:7559602003996546463:3638]
2025-10-10T14:36:40.047636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:40.047661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:40.047664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.047668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.047671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.047689Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:40.047702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:40.047715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:40.047774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.047782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.047784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.047786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:40.047857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:40.047865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.047879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.047893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.047912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:40.047951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778776690:2401], now have 1 active actors on pipe
2025-10-10T14:36:40.047960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778776523:2438], now have 1 active actors on pipe
2025-10-10T14:36:40.047968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602003996546458:3638]
2025-10-10T14:36:40.047971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602003996546458:3638]
2025-10-10T14:36:40.047973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602003996546458:3638]
2025-10-10T14:36:40.047987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:40.047964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2087
2025-10-10T14:36:40.047992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2087
2025-10-10T14:36:40.048003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:40.048003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:40.048006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:40.048009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:40.048025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:40.048029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:40.048070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.048079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.048098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602003996546458:3638]
2025-10-10T14:36:40.048110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:40.048123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:40.048145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:40.048161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.048165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.048168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:40.048179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.048190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:40.048216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.048424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.048437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.048479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.048610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2088 partition: 0 MaxSeqNo: 40 sessionId: src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0
2025-10-10T14:36:40.049044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8c1d91-57bf053d-b4c8cd16-ee6e64c2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:40.051779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0] Write session: try to update token
2025-10-10T14:36:40.051798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:40.068431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:40.068451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:40.068455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:40.068457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:40.068468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602003996546458:3638]
2025-10-10T14:36:40.068475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602003996546458:3638]
2025-10-10T14:36:40.068480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602003996546458:3638]
2025-10-10T14:36:40.068530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:40.068536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:40.068537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:40.068541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:40.068545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.068548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:40.068696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:40.066230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId: src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:40.069136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:40.124149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602004778776702:5230]
2025-10-10T14:36:40.124660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2087, pipe: [1:7559602004778776702:5230]
2025-10-10T14:36:40.189969Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:40.190276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.190293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.190343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778776702:5230], now have 1 active actors on pipe
2025-10-10T14:36:40.190584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:40.190579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:40.190623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602004778776702:5230]
2025-10-10T14:36:40.190643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:40.190739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2088 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0
2025-10-10T14:36:40.190942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2088 sessionId: src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0 is DEAD
2025-10-10T14:36:40.191116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:40.191129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0] Write session will restart in 0.008895s
2025-10-10T14:36:40.191154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0] Write session: Do CDS request
2025-10-10T14:36:40.191161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:40.201312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.201453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:40.201469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2089
2025-10-10T14:36:40.201596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.201655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:40.201666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:40.201670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:40.202220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2089 sessionId:  describe result for acl check
2025-10-10T14:36:40.202263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:40.202270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:40.202272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:40.202278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602004778776788:2409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:40.202927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602004778776788:2409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:40.205209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602004778776788:2409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:40.205914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:40.208320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602004778776788:2409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:40.208347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602004778776788:2409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:40.208351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602004778776788:2409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:40.208361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:40.208001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:40.208229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:40.208234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:40.208246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:40.208302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:40.208354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602003996546638:3636]
2025-10-10T14:36:40.209016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:40.209288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:40.209375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:40.209736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:40.209799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.209807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.209808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.209810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.209811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.209812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.209814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.209815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.209816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.209818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.209819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.209820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.209822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.209828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.209843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.209847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.209852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.209856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.209860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.209865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.209870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.209874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.209878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.209882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.209887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.209891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.209900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.209910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.209922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.209928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.209934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.209940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.209945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.209951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.209956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.209962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.209967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.209973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.209978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.209984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.209989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.209995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.210001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.210007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.210012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.210018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.210023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.210029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.210039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.210045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.210051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.210057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.210101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:40.212831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:40.213239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:40.213254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:40.213256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:40.213260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:40.213266Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2088 [2:7559602003996546638:3636]
2025-10-10T14:36:40.213280Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:40.213297Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:40.213305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.213309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.213311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.213344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:40.213356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:40.213363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:40.213842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2088
2025-10-10T14:36:40.213428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.213879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2088
2025-10-10T14:36:40.213438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.213440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.213442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:40.213514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:40.213517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.213527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.213539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.213556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:40.213578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778776703:2438], now have 1 active actors on pipe
2025-10-10T14:36:40.213581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778776869:2409], now have 1 active actors on pipe
2025-10-10T14:36:40.213589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602003996546633:3636]
2025-10-10T14:36:40.213591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602003996546633:3636]
2025-10-10T14:36:40.213593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602003996546633:3636]
2025-10-10T14:36:40.213607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:40.213622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:40.213638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:40.213642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:40.213668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602003996546633:3636]
2025-10-10T14:36:40.213670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:40.213776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:40.213779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:40.213781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:40.213788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:40.213996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.214008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.214041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:40.214054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.214058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.214060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:40.214072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.214084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:40.214104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.217983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.217998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.218030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.218185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2089 partition: 0 MaxSeqNo: 40 sessionId: src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0
2025-10-10T14:36:40.218597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a69752c1-3e1a1735-c33b185c-4453fc8f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:40.221405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0] Write session: try to update token
2025-10-10T14:36:40.221428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:40.235350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:40.235370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:40.235373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:40.235376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:40.235386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602003996546633:3636]
2025-10-10T14:36:40.235391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602003996546633:3636]
2025-10-10T14:36:40.235395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602003996546633:3636]
2025-10-10T14:36:40.235446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:40.235454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.235457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:40.235523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:40.235538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:40.235543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:40.235598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:40.247696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId: src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:40.250589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:40.291062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602004778776882:5230]
2025-10-10T14:36:40.291448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2088, pipe: [1:7559602004778776882:5230]
2025-10-10T14:36:40.355473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:40.356532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.356540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.356579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778776882:5230], now have 1 active actors on pipe
2025-10-10T14:36:40.357326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602004778776882:5230]
2025-10-10T14:36:40.357883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:40.357396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:40.357436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:40.357438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:40.357904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0] Write session will restart in 0.008895s
2025-10-10T14:36:40.357495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2089 reason: error at write: Disconnected sessionId: src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0
2025-10-10T14:36:40.357694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2089 sessionId: src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0 is DEAD
2025-10-10T14:36:40.357508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:40.357931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0] Write session: Do CDS request
2025-10-10T14:36:40.357941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:40.367893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.369271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:40.369291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2090
2025-10-10T14:36:40.369527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.369575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:40.369580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:40.369588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:40.370012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2090 sessionId:  describe result for acl check
2025-10-10T14:36:40.370049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:40.370051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:40.370053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:40.370060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602004778776909:2448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:40.370702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602004778776909:2448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:40.373371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602004778776909:2448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:40.377653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602004778776909:2448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:40.377681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602004778776909:2448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:40.377686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602004778776909:2448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:40.377700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:40.381447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:40.383804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:40.384031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:40.384048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:40.384061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:40.384117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:40.384175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602003996546828:3618]
2025-10-10T14:36:40.384829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:40.385189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:40.385249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:40.385603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:40.385688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.385696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.385697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.385698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.385699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.385700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.385701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.385702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.385704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.385705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.385706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.385708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.385709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.385717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.385728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.385732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.385735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.385739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.385743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.385756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.385760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.385764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.385768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.385772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.385775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.385780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.385788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.385796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.385802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.385807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.385811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.385817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.385830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.385841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.385846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.385852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.385856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.385862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.385868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.385873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.385881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.385887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.385891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.385900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.385905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.385910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.385915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.385920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.385924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.385929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.385933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.385937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.385976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:40.388835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:40.389441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:40.389455Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:40.389457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:40.389461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:40.389468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2089 [2:7559602003996546828:3618]
2025-10-10T14:36:40.389481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:40.389498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:40.389502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.389506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.389508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.389525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:40.389538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:40.389546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:40.389612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.389619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.389621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.389624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:40.389694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:40.389702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.389716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.389733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.389753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:40.389781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777028:2448], now have 1 active actors on pipe
2025-10-10T14:36:40.389789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778776885:2438], now have 1 active actors on pipe
2025-10-10T14:36:40.389797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602003996546823:3618]
2025-10-10T14:36:40.389804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602003996546823:3618]
2025-10-10T14:36:40.389806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602003996546823:3618]
2025-10-10T14:36:40.389819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:40.389834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:40.389839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:40.389854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:40.389857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:40.389857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:40.389860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:40.389885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602003996546823:3618]
2025-10-10T14:36:40.389898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:40.389893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2089
2025-10-10T14:36:40.389925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:40.389932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.389938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.389939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2089
2025-10-10T14:36:40.389971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87424426-910abe60-21331560-3ddecc7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:40.389985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.389990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.389997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:40.390010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.390025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:40.390049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.390197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.390213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.390237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.390345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2090 partition: 0 MaxSeqNo: 40 sessionId: src_id|87424426-910abe60-21331560-3ddecc7d_0
2025-10-10T14:36:40.390776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f03319-b9fe02c7-bb652be5-3d01c77b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|87424426-910abe60-21331560-3ddecc7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:40.393622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87424426-910abe60-21331560-3ddecc7d_0] Write session: try to update token
2025-10-10T14:36:40.393640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87424426-910abe60-21331560-3ddecc7d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:40.409321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId: src_id|87424426-910abe60-21331560-3ddecc7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:40.410541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:40.410557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:40.410560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:40.410562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:40.410570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602003996546823:3618]
2025-10-10T14:36:40.410575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602003996546823:3618]
2025-10-10T14:36:40.410579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602003996546823:3618]
2025-10-10T14:36:40.410627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:40.410629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:40.410635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.410635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:40.410638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:40.410639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:40.410773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:40.412205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:40.459132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602004778777088:5230]
2025-10-10T14:36:40.459559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2089, pipe: [1:7559602004778777088:5230]
2025-10-10T14:36:40.529367Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:40.529728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.529743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.529790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777088:5230], now have 1 active actors on pipe
2025-10-10T14:36:40.529994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:40.530735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602004778777088:5230]
2025-10-10T14:36:40.530765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:40.530824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2090 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87424426-910abe60-21331560-3ddecc7d_0
2025-10-10T14:36:40.530998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2090 sessionId: src_id|87424426-910abe60-21331560-3ddecc7d_0 is DEAD
2025-10-10T14:36:40.531097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:40.531177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87424426-910abe60-21331560-3ddecc7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:40.531189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87424426-910abe60-21331560-3ddecc7d_0] Write session will restart in 0.008857s
2025-10-10T14:36:40.531215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87424426-910abe60-21331560-3ddecc7d_0] Write session: Do CDS request
2025-10-10T14:36:40.531222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87424426-910abe60-21331560-3ddecc7d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:40.540904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87424426-910abe60-21331560-3ddecc7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.541268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:40.541284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2091
2025-10-10T14:36:40.541451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.541496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:40.541508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:40.541512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:40.542026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2091 sessionId:  describe result for acl check
2025-10-10T14:36:40.542071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:40.542078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:40.542080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:40.542086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602004778777167:2466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:40.542657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602004778777167:2466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:40.545689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:40.545886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602004778777167:2466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:40.547965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:40.548172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:40.548183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:40.548196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:40.548230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602004778777167:2466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:40.548249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:40.548243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602004778777167:2466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:40.548266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602004778777167:2466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:40.548273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:40.548300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602003996547029:3608]
2025-10-10T14:36:40.548913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:40.549172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:40.549216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:40.549546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:40.549606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.549616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.549617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.549618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.549619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.549620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.549622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.549623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.549624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.549625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.549626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.549627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.549628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.549634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.549647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.549651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.549655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.549660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.549664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.549668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.549672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.549677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.549681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.549685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.549690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.549694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.549701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.549710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.549717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.549723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.549727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.549733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.549737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.549742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.549747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.549752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.549757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.549762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.549767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.549772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.549776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.549782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.549789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.549795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.549799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.549805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.549809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.549815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.549821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.549835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.549840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.549846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.549886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:40.552195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:40.552538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:40.552548Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:40.552550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:40.552553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:40.552559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2090 [2:7559602003996547029:3608]
2025-10-10T14:36:40.552572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:40.552589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:40.552596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.552600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.552602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.552619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:40.552626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:40.552638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:40.552697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.552703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.552705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.552708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:40.552774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:40.552781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.552792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.552808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.552828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:40.552854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777258:2466], now have 1 active actors on pipe
2025-10-10T14:36:40.552858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777089:2438], now have 1 active actors on pipe
2025-10-10T14:36:40.552864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602003996547024:3608]
2025-10-10T14:36:40.552867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602003996547024:3608]
2025-10-10T14:36:40.552869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602003996547024:3608]
2025-10-10T14:36:40.552882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:40.552896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:40.552909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:40.552915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:40.552918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:40.552922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:40.552905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2090
2025-10-10T14:36:40.552931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2090
2025-10-10T14:36:40.552924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:40.552942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602003996547024:3608]
2025-10-10T14:36:40.552945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:40.552948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:40.553054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.553063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.553092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:40.553103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.553107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.553109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:40.553120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.553130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:40.553143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.553276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.553282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.553295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.553398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2091 partition: 0 MaxSeqNo: 40 sessionId: src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0
2025-10-10T14:36:40.553792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87424426-910abe60-21331560-3ddecc7d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:40.556494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0] Write session: try to update token
2025-10-10T14:36:40.556511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:40.572243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId: src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:40.573835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:40.573853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:40.573857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:40.573859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:40.573869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602003996547024:3608]
2025-10-10T14:36:40.573874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602003996547024:3608]
2025-10-10T14:36:40.573878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602003996547024:3608]
2025-10-10T14:36:40.573930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:40.573930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:40.573938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:40.573938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.573941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:40.573942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:40.574077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:40.575037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:40.631000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602004778777270:5230]
2025-10-10T14:36:40.631313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2090, pipe: [1:7559602004778777270:5230]
2025-10-10T14:36:40.701860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:40.702461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.702471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.702520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777270:5230], now have 1 active actors on pipe
2025-10-10T14:36:40.703003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:40.703005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:40.703019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:40.703064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602004778777270:5230]
2025-10-10T14:36:40.703098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2091 reason: error at write: Disconnected sessionId: src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0
2025-10-10T14:36:40.703334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2091 sessionId: src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0 is DEAD
2025-10-10T14:36:40.703512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:40.703526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0] Write session will restart in 0.006629s
2025-10-10T14:36:40.703552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0] Write session: Do CDS request
2025-10-10T14:36:40.703558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:40.703660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:40.711919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.711997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:40.712016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2092
2025-10-10T14:36:40.712146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.712187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:40.712193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:40.712198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:40.712785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2092 sessionId:  describe result for acl check
2025-10-10T14:36:40.712830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:40.712838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:40.712839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:40.712846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602004778777288:2477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:40.713501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602004778777288:2477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:40.716354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602004778777288:2477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:40.721736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602004778777288:2477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:40.721760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602004778777288:2477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:40.721764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602004778777288:2477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:40.721774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:40.733271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:40.736702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:40.736940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:40.736945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:40.736956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:40.737004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:40.737043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602003996547208:3607]
2025-10-10T14:36:40.737792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:40.738233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:40.738272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:40.738649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:40.738701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.738702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.738703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.738705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.738706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.738708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.738709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.738710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.738712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.738713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.738714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.738715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.738716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.738722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.738736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.738740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.738744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.738748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.738753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.738757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.738760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.738764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.738769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.738773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.738777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.738781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.738789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.738797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.738805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.738811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.738816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.738822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.738827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.738832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.738837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.738843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.738848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.738854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.738859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.738864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.738878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.738884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.738889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.738894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.738899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.738904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.738910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.738916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.738920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.738926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.738930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.738936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.738978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:40.741986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:40.742483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:40.742496Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:40.742500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:40.742504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:40.742511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2091 [2:7559602003996547208:3607]
2025-10-10T14:36:40.742526Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:40.742544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:40.742548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.742552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.742554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.742574Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:40.742588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:40.742601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:40.742667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.742676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.742678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.742680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:40.742758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:40.742768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.742781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.742793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.742813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:40.742949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2091
2025-10-10T14:36:40.742836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777273:2438], now have 1 active actors on pipe
2025-10-10T14:36:40.742848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777359:2477], now have 1 active actors on pipe
2025-10-10T14:36:40.742856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602003996547202:3607]
2025-10-10T14:36:40.742858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602003996547202:3607]
2025-10-10T14:36:40.742861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602003996547202:3607]
2025-10-10T14:36:40.742878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:40.742894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:40.742913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:40.742916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:40.742947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602003996547202:3607]
2025-10-10T14:36:40.742950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:40.743004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2091
2025-10-10T14:36:40.743094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:40.743101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:40.743103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:40.743109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:40.743211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.743226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.743260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:40.743294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.743303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.743306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:40.743318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.743339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:40.743355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.743675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.743685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.743703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.743823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2092 partition: 0 MaxSeqNo: 40 sessionId: src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0
2025-10-10T14:36:40.744260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3ca1d59-e7ef6a3e-210740e-ecafb003_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:40.747085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0] Write session: try to update token
2025-10-10T14:36:40.747105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:40.764060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId: src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:40.766781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:40.767685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:40.767466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.767488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.767542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:40.769512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:40.769525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:40.769529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:40.769531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:40.769541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602003996547202:3607]
2025-10-10T14:36:40.769547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602003996547202:3607]
2025-10-10T14:36:40.769551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602003996547202:3607]
2025-10-10T14:36:40.769612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:40.769620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.769622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:40.769769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:40.770015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:40.770026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:40.770030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:40.803550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602004778777464:5230]
2025-10-10T14:36:40.803921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2091, pipe: [1:7559602004778777464:5230]
2025-10-10T14:36:40.894123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:40.903087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.903115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.903305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.903366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.903430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.903491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.903544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.903550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.903623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.903686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.903749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.903810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.903852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.903855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.903924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.903982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.904046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.904105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.904145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.904149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.904218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.904282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.904362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.904425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.904465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.904468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.904539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.904602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.904667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.904734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.904776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.904779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.904853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.904916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.904979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.905039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.905081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.905085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.905155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.905213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.905277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.907011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602004778777464:5230]
2025-10-10T14:36:40.907065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:40.907068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:40.907100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2092 reason: error at write: Disconnected sessionId: src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0
2025-10-10T14:36:40.907234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:40.907284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2092 sessionId: src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0 is DEAD
2025-10-10T14:36:40.907513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:40.907522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0] Write session will restart in 0.006266s
2025-10-10T14:36:40.907548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0] Write session: Do CDS request
2025-10-10T14:36:40.907554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:40.905612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.905660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.905663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.905735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.905795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.905857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.905919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.905959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.905964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.906036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.906096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.906158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.906220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.906261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.906264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.906332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:40.906389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:40.906453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:40.906516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:40.906556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:40.906559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:40.906632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777464:5230], now have 1 active actors on pipe
2025-10-10T14:36:40.907863Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:40.914971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.915260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:40.915277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2093
2025-10-10T14:36:40.915445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:40.915480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:40.915489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:40.915492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:40.915858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2093 sessionId:  describe result for acl check
2025-10-10T14:36:40.915895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:40.915897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:40.915898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:40.915904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602004778777482:2471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:40.916441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602004778777482:2471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:40.922902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602004778777482:2471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:40.927612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602004778777482:2471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:40.927629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602004778777482:2471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:40.927633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602004778777482:2471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:40.927650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:40.937285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:40.940469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:40.940697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:40.940702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:40.940714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:40.940765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:40.940803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602003996547388:3601]
2025-10-10T14:36:40.941497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:40.942032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:40.942078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:40.942411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:40.942463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.942465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.942466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.942468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.942469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.942471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.942472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.942474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.942476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.942477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.942479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.942480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.942481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.942487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.942500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.942504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.942507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.942512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.942516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.942521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.942525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.942529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.942536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.942540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.942545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.942549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.942558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.942567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:40.942573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.942579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:40.942585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.942591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:40.942596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.942602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:40.942607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.942613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:40.942618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.942624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:40.942629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.942635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:40.942640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.942646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:40.942651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.942657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:40.942662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.942668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:40.942689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.942695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.942700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.942706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.942712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.942717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.942764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:40.945844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:40.946291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:40.946296Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:40.946299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:40.946303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:40.946310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2092 [2:7559602003996547388:3601]
2025-10-10T14:36:40.946325Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:40.946345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:40.946348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.946352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.946354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.946373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:40.946381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:40.946392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:40.946457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.946459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.946461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.946464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:40.946538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:40.946541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.946554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:40.946565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:40.946585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:40.946608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602003996547382:3601]
2025-10-10T14:36:40.946611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602003996547382:3601]
2025-10-10T14:36:40.946613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602003996547382:3601]
2025-10-10T14:36:40.946629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:40.946643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777466:2438], now have 1 active actors on pipe
2025-10-10T14:36:40.946647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602004778777573:2471], now have 1 active actors on pipe
2025-10-10T14:36:40.946648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:40.946652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:40.946654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:40.946655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:40.946672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:40.946677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:40.946702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602003996547382:3601]
2025-10-10T14:36:40.946711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:40.946721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:40.947436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2092
2025-10-10T14:36:40.947480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2092
2025-10-10T14:36:40.947896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.947912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.947946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|264c31ab-5d34a16e-f9070840-731e97b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:40.947956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:40.947960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:40.947963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:40.947976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:40.948002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:40.948024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.949115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:40.949131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:40.949155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:40.949289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2093 partition: 0 MaxSeqNo: 40 sessionId: src_id|264c31ab-5d34a16e-f9070840-731e97b8_0
2025-10-10T14:36:40.949735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5a501c-914ac15d-c0d3297-ca47f989_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|264c31ab-5d34a16e-f9070840-731e97b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:40.952547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|264c31ab-5d34a16e-f9070840-731e97b8_0] Write session: try to update token
2025-10-10T14:36:40.952574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|264c31ab-5d34a16e-f9070840-731e97b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:40.970828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:40.970850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:40.970853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:40.970855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:40.970865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602003996547382:3601]
2025-10-10T14:36:40.970870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602003996547382:3601]
2025-10-10T14:36:40.970875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602003996547382:3601]
2025-10-10T14:36:40.970926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:40.970935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:40.970938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:40.971084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:40.971381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:40.971391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:40.971396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:40.971765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId: src_id|264c31ab-5d34a16e-f9070840-731e97b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:40.974601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:41.007301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602009073744945:5230]
2025-10-10T14:36:41.007842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2092, pipe: [1:7559602009073744945:5230]
2025-10-10T14:36:41.089092Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:41.089471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.089497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.089562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073744945:5230], now have 1 active actors on pipe
2025-10-10T14:36:41.091015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|264c31ab-5d34a16e-f9070840-731e97b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:41.091028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|264c31ab-5d34a16e-f9070840-731e97b8_0] Write session will restart in 0.009850s
2025-10-10T14:36:41.091054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|264c31ab-5d34a16e-f9070840-731e97b8_0] Write session: Do CDS request
2025-10-10T14:36:41.091060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|264c31ab-5d34a16e-f9070840-731e97b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:41.090559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:41.090315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:41.090326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602009073744945:5230]
2025-10-10T14:36:41.090331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:41.090349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:41.090411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2093 reason: error at write: Disconnected sessionId: src_id|264c31ab-5d34a16e-f9070840-731e97b8_0
2025-10-10T14:36:41.090633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2093 sessionId: src_id|264c31ab-5d34a16e-f9070840-731e97b8_0 is DEAD
2025-10-10T14:36:41.101960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|264c31ab-5d34a16e-f9070840-731e97b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.102347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:41.102366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2094
2025-10-10T14:36:41.102564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.102600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:41.102607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:41.102611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:41.103173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2094 sessionId:  describe result for acl check
2025-10-10T14:36:41.103211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:41.103213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:41.103215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:41.103221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602009073744993:2501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:41.103901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602009073744993:2501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:41.108595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602009073744993:2501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:41.111651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602009073744993:2501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:41.111669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602009073744993:2501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:41.111673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602009073744993:2501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:41.111684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:41.113106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:41.115705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:41.115967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:41.115986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:41.115999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:41.116070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:41.116123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602008291514879:3589]
2025-10-10T14:36:41.116734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:41.117130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:41.117179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:41.117519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:41.117589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.117595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.117596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.117598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.117599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.117601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.117602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.117604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.117605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.117606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.117608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.117609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.117611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.117617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.117631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.117636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.117640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.117644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.117648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.117653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.117657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.117661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.117665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.117670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.117674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.117678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.117686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.117695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.117702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.117708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.117713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.117718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.117723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.117729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.117734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.117740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.117744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.117749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.117753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.117759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.117764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.117769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.117775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.117787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.117791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.117801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.117806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.117812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.117817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.117827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.117832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.117837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.117880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:41.120513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:41.120849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:41.120865Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:41.120868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:41.120872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:41.120879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2093 [2:7559602008291514879:3589]
2025-10-10T14:36:41.120893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:41.120913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:41.120922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.120926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.120929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.120947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:41.120960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:41.120973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:41.121043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.121051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.121053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.121056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:41.121133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:41.121142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.121154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.121166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.121200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:41.121226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602008291514873:3589]
2025-10-10T14:36:41.121233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602008291514873:3589]
2025-10-10T14:36:41.121236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602008291514873:3589]
2025-10-10T14:36:41.121250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:41.121269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:41.121289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:41.121296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:41.121326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602008291514873:3589]
2025-10-10T14:36:41.121349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:41.121431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:41.121439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:41.121441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:41.121447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:41.121590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073744960:2438], now have 1 active actors on pipe
2025-10-10T14:36:41.121605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745129:2501], now have 1 active actors on pipe
2025-10-10T14:36:41.121663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2093
2025-10-10T14:36:41.121672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2093
2025-10-10T14:36:41.121910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.121921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.121965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:41.121980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.121990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.121993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:41.122006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.122038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:41.122059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.122785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2094 partition: 0 MaxSeqNo: 40 sessionId: src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0
2025-10-10T14:36:41.123177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|264c31ab-5d34a16e-f9070840-731e97b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:41.122616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.122626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.122654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.125992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0] Write session: try to update token
2025-10-10T14:36:41.126012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:41.142226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:41.142245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:41.142249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:41.142251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:41.142262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602008291514873:3589]
2025-10-10T14:36:41.142267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602008291514873:3589]
2025-10-10T14:36:41.142271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602008291514873:3589]
2025-10-10T14:36:41.142328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:41.142332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:41.142337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.142339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:41.142340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:41.142343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:41.142524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:41.146616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId: src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:41.149427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:41.191662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602009073745143:5230]
2025-10-10T14:36:41.192554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2093, pipe: [1:7559602009073745143:5230]
2025-10-10T14:36:41.266862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:41.267183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.267204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.267255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745143:5230], now have 1 active actors on pipe
2025-10-10T14:36:41.267646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602009073745143:5230]
2025-10-10T14:36:41.267672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:41.267705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:41.267712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:41.267738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:41.267773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2094 reason: error at write: Disconnected sessionId: src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0
2025-10-10T14:36:41.267937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2094 sessionId: src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0 is DEAD
2025-10-10T14:36:41.268069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:41.268078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0] Write session will restart in 0.007292s
2025-10-10T14:36:41.268097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0] Write session: Do CDS request
2025-10-10T14:36:41.268105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:41.276839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.276896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:41.276913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2095
2025-10-10T14:36:41.277055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.277105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:41.277117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:41.277122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:41.277755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2095 sessionId:  describe result for acl check
2025-10-10T14:36:41.277792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:41.277798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:41.277801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:41.277807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602009073745177:2500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:41.278437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602009073745177:2500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:41.281148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602009073745177:2500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:41.284421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:41.284463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602009073745177:2500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:41.284481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602009073745177:2500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:41.284485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602009073745177:2500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:41.284494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:41.286939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:41.287164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:41.287175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:41.287187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:41.287242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:41.287284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602008291515060:3587]
2025-10-10T14:36:41.287958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:41.288319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:41.288361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:41.288699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:41.288745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.288746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.288748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.288749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.288750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.288751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.288753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.288754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.288755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.288757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.288758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.288759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.288760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.288766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.288780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.288784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.288789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.288793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.288798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.288802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.288806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.288810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.288815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.288819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.288823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.288827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.288835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.288864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.288871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.288878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.288883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.288888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.288893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.288899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.288904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.288910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.288915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.288921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.288928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.288933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.288938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.288944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.288949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.288954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.288959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.288964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.288969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.288974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.288978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.288984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.288988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.288994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.289036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:41.291589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:41.291926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:41.291942Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:41.291945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:41.291950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:41.291956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2094 [2:7559602008291515060:3587]
2025-10-10T14:36:41.291971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:41.291994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:41.292002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.292006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.292008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.292028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:41.292040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:41.292048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:41.292121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.292128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.292131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.292133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:41.292364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2094
2025-10-10T14:36:41.292384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2094
2025-10-10T14:36:41.292408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:41.292419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.292432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.292452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.292474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:41.292499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745318:2500], now have 1 active actors on pipe
2025-10-10T14:36:41.292507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745145:2438], now have 1 active actors on pipe
2025-10-10T14:36:41.292527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.292536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.292556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602008291515054:3587]
2025-10-10T14:36:41.292563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602008291515054:3587]
2025-10-10T14:36:41.292565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602008291515054:3587]
2025-10-10T14:36:41.292581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:41.292602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:41.292605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:41.292609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:41.292610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:41.292626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:41.292629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:41.292651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:41.292660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.292663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.292666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:41.292678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.292689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:41.292731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602008291515054:3587]
2025-10-10T14:36:41.292744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:41.292751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:41.292759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.292931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.292945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.292969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.293092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2095 partition: 0 MaxSeqNo: 40 sessionId: src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0
2025-10-10T14:36:41.293507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72ac0e5-cb63bb16-5a2eda9f-9011d9dd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:41.296330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0] Write session: try to update token
2025-10-10T14:36:41.296352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:41.310499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:41.310524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:41.310537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602008291515054:3587]
2025-10-10T14:36:41.310596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:41.310783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:41.310927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:41.311062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:41.311200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:41.311397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:41.311441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:41.311444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:41.324130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:41.324159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:41.324162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:41.324165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:41.324177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602008291515054:3587]
2025-10-10T14:36:41.324182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602008291515054:3587]
2025-10-10T14:36:41.324187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602008291515054:3587]
2025-10-10T14:36:41.324243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:41.324258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.324265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:41.324434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:41.326055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId: src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:41.327010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:41.327030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:41.327034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:41.328684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:41.367782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602009073745333:5230]
2025-10-10T14:36:41.368141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2094, pipe: [1:7559602009073745333:5230]
2025-10-10T14:36:41.443354Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:41.443988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.444000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.444026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745333:5230], now have 1 active actors on pipe
2025-10-10T14:36:41.444219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:41.444209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:41.444224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:41.444287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2095 reason: error at write: Disconnected sessionId: src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0
2025-10-10T14:36:41.444523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2095 sessionId: src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0 is DEAD
2025-10-10T14:36:41.444681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:41.444752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602009073745333:5230]
2025-10-10T14:36:41.445053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:41.445062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0] Write session will restart in 0.008669s
2025-10-10T14:36:41.445099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0] Write session: Do CDS request
2025-10-10T14:36:41.445107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:41.455102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.455191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:41.455209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2096
2025-10-10T14:36:41.455331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.455377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:41.455387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:41.455391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:41.456082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2096 sessionId:  describe result for acl check
2025-10-10T14:36:41.456125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:41.456127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:41.456128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:41.456135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602009073745387:2534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:41.456694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602009073745387:2534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:41.463258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602009073745387:2534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:41.463919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:41.466361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:41.466557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:41.466568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:41.466578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:41.466623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:41.466720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602009073745387:2534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:41.466736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602009073745387:2534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:41.466740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602009073745387:2534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:41.466749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:41.466885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602008291515278:3576]
2025-10-10T14:36:41.467573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:41.467857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:41.467920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:41.468371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:41.468452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.468459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.468460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.468461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.468463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.468464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.468465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.468466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.468468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.468470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.468471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.468472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.468473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.468480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.468491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.468494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.468498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.468502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.468505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.468509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.468512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.468515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.468519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.468522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.468526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.468530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.468537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.468546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.468552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.468557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.468561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.468566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.468570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.468575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.468579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.468584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.468588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.468598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.468602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.468610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.468614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.468622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.468626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.468635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.468639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.468648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.468657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.468666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.468671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.468676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.468685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.468689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.468725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:41.471059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:41.471383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:41.471396Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:41.471398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:41.471402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:41.471407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2095 [2:7559602008291515278:3576]
2025-10-10T14:36:41.471421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:41.471444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:41.471452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.471455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.471458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.471473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:41.471494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:41.471507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:41.471560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.471566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.471567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.471570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:41.471632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:41.471641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.471651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.471662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.471678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:41.471702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745532:2534], now have 1 active actors on pipe
2025-10-10T14:36:41.471710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745348:2438], now have 1 active actors on pipe
2025-10-10T14:36:41.471718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602008291515266:3576]
2025-10-10T14:36:41.471720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602008291515266:3576]
2025-10-10T14:36:41.471722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602008291515266:3576]
2025-10-10T14:36:41.471735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:41.471747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:41.471749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:41.471752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:41.471754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:41.471766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:41.471769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:41.471767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2095
2025-10-10T14:36:41.471790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602008291515266:3576]
2025-10-10T14:36:41.471796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:41.471799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:41.471780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2095
2025-10-10T14:36:41.471815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.471819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.471875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:41.471889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.471892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.471894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:41.471904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.471913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:41.471930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.472116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.472128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.472150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.472260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2096 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0
2025-10-10T14:36:41.472671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c30fb9d-eecbe653-15ab1a02-c0847aec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:41.475713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0] Write session: try to update token
2025-10-10T14:36:41.475735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:41.491089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId: src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:41.491737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:41.491754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:41.491758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:41.491762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:41.491772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602008291515266:3576]
2025-10-10T14:36:41.491776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602008291515266:3576]
2025-10-10T14:36:41.491781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602008291515266:3576]
2025-10-10T14:36:41.491830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:41.491832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:41.491840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.491843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:41.491844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:41.491849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:41.491991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:41.493826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:41.544923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602009073745545:5230]
2025-10-10T14:36:41.545239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2095, pipe: [1:7559602009073745545:5230]
2025-10-10T14:36:41.613252Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:41.613605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.613620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.613668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745545:5230], now have 1 active actors on pipe
2025-10-10T14:36:41.613859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:41.613881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:41.613864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602009073745545:5230]
2025-10-10T14:36:41.613876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:41.613883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:41.613942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2096 reason: error at write: Disconnected sessionId: src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0
2025-10-10T14:36:41.614139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2096 sessionId: src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0 is DEAD
2025-10-10T14:36:41.614319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:41.614329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0] Write session will restart in 0.009624s
2025-10-10T14:36:41.614363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0] Write session: Do CDS request
2025-10-10T14:36:41.614374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:41.624916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.625002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:41.625020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2097
2025-10-10T14:36:41.625157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.625194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:41.625205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:41.625210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:41.625866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2097 sessionId:  describe result for acl check
2025-10-10T14:36:41.625907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:41.625915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:41.625916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:41.625923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602009073745653:2538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:41.626529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602009073745653:2538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:41.628707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:41.629215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602009073745653:2538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:41.631422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:41.631807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:41.631823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:41.631840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:41.631922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:41.631970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602008291515460:3562]
2025-10-10T14:36:41.632601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:41.633006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:41.633069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:41.633413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:41.633501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.633505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.633507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.633508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.633509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.633510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.633511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.633512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.633514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.633515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.633516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.633517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.633518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.633525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.633539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.633544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.633548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.633553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.633556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.633560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.633564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.633568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.633575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.633578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.633582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.633585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.633595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.633604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.633610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.633615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.633619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.633625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.633629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.633635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.633639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.633643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.633648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.633652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.633656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.633661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.633665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.633670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.633676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.633692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.633696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.633701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.633705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.633711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.633715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.633720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.633724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.633730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.633770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:41.634017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602009073745653:2538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:41.634036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602009073745653:2538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:41.634039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602009073745653:2538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:41.634049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:41.636271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:41.636617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:41.636633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:41.636636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:41.636640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:41.636647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2096 [2:7559602008291515460:3562]
2025-10-10T14:36:41.636673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:41.636691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:41.636695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.636699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.636702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.636719Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:41.636733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:41.636741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:41.636805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.636814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.636816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.636818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:41.636888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:41.636896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.636907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.636924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.636946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:41.636968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602008291515455:3562]
2025-10-10T14:36:41.636971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602008291515455:3562]
2025-10-10T14:36:41.636973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602008291515455:3562]
2025-10-10T14:36:41.636983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:41.636993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:41.637001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745727:2538], now have 1 active actors on pipe
2025-10-10T14:36:41.637002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:41.637005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:41.637007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:41.637024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:41.637033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:41.637040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745547:2438], now have 1 active actors on pipe
2025-10-10T14:36:41.637066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602008291515455:3562]
2025-10-10T14:36:41.637074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:41.637093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:41.637083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2096
2025-10-10T14:36:41.637123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2096
2025-10-10T14:36:41.637357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.637368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.637401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30610e2a-39650c44-92b8c736-2620a277_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:41.637417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.637425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.637428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:41.637440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.637456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:41.637476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.637753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.637766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.637786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.637887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2097 partition: 0 MaxSeqNo: 40 sessionId: src_id|30610e2a-39650c44-92b8c736-2620a277_0
2025-10-10T14:36:41.638320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a5a5d66-7a5345dc-cc900df1-e2f3b4a8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|30610e2a-39650c44-92b8c736-2620a277_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:41.641007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30610e2a-39650c44-92b8c736-2620a277_0] Write session: try to update token
2025-10-10T14:36:41.641025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30610e2a-39650c44-92b8c736-2620a277_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:41.656056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId: src_id|30610e2a-39650c44-92b8c736-2620a277_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:41.657662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:41.657681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:41.657685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:41.657688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:41.657700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602008291515455:3562]
2025-10-10T14:36:41.657705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602008291515455:3562]
2025-10-10T14:36:41.657712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602008291515455:3562]
2025-10-10T14:36:41.657764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:41.657771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:41.657776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.657779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:41.657779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:41.657784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:41.657919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:41.659045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:41.713857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602009073745738:5230]
2025-10-10T14:36:41.714165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2096, pipe: [1:7559602009073745738:5230]
2025-10-10T14:36:41.774196Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:41.774561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.774582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.774631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745738:5230], now have 1 active actors on pipe
2025-10-10T14:36:41.774825Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:41.774928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:41.774944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:41.775023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2097 reason: error at write: Disconnected sessionId: src_id|30610e2a-39650c44-92b8c736-2620a277_0
2025-10-10T14:36:41.775245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2097 sessionId: src_id|30610e2a-39650c44-92b8c736-2620a277_0 is DEAD
2025-10-10T14:36:41.775367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:41.775405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30610e2a-39650c44-92b8c736-2620a277_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:41.775417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30610e2a-39650c44-92b8c736-2620a277_0] Write session will restart in 0.007762s
2025-10-10T14:36:41.775414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602009073745738:5230]
2025-10-10T14:36:41.775455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30610e2a-39650c44-92b8c736-2620a277_0] Write session: Do CDS request
2025-10-10T14:36:41.775464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30610e2a-39650c44-92b8c736-2620a277_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:41.784918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30610e2a-39650c44-92b8c736-2620a277_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.785029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:41.785048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2098
2025-10-10T14:36:41.785173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.785211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:41.785222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:41.785226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:41.785652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2098 sessionId:  describe result for acl check
2025-10-10T14:36:41.785687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:41.785694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:41.785696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:41.785702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602009073745761:2558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:41.786274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602009073745761:2558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:41.788501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602009073745761:2558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:41.793322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602009073745761:2558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:41.793352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602009073745761:2558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:41.793356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602009073745761:2558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:41.793366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:41.794391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:41.797023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:41.797358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:41.797371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:41.797387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:41.797463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:41.797514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602008291515644:3560]
2025-10-10T14:36:41.798130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:41.798677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:41.798730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:41.799062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:41.799140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.799147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.799148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.799150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.799151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.799153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.799154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.799155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.799157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.799158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.799160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.799161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.799162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.799168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.799182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.799186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.799189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.799193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.799196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.799200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.799204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.799209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.799213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.799216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.799220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.799223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.799231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.799241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.799250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.799260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.799265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.799270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.799280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.799286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.799290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.799300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.799305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.799310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.799315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.799325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.799329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.799334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.799340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.799345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.799352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.799357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.799366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.799371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.799376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.799383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.799387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.799392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.799437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:41.801991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:41.802603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:41.802613Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:41.802616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:41.802620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:41.802627Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2097 [2:7559602008291515644:3560]
2025-10-10T14:36:41.802642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:41.802661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:41.802668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.802672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.802675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.802692Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:41.802701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:41.802708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:41.802777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.802785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.802787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.802790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:41.802863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:41.802871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.802883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.802899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.802919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:41.802950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745919:2558], now have 1 active actors on pipe
2025-10-10T14:36:41.802959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745743:2438], now have 1 active actors on pipe
2025-10-10T14:36:41.802967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602008291515639:3560]
2025-10-10T14:36:41.802969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602008291515639:3560]
2025-10-10T14:36:41.802972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602008291515639:3560]
2025-10-10T14:36:41.802988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:41.802972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2097
2025-10-10T14:36:41.803004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:41.802995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2097
2025-10-10T14:36:41.803009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:41.803012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:41.803014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:41.803020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:41.803024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:41.803062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.803067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.803086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602008291515639:3560]
2025-10-10T14:36:41.803094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:41.803108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:41.803127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:41.803134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.803138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.803140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:41.803153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.803164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:41.803197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.803401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.803409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.803424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.803561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2098 partition: 0 MaxSeqNo: 40 sessionId: src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0
2025-10-10T14:36:41.804006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30610e2a-39650c44-92b8c736-2620a277_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:41.806878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0] Write session: try to update token
2025-10-10T14:36:41.806900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:41.822010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId: src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:41.824529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:41.824547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:41.824551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:41.824553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:41.824565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602008291515639:3560]
2025-10-10T14:36:41.824569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602008291515639:3560]
2025-10-10T14:36:41.824574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602008291515639:3560]
2025-10-10T14:36:41.824630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:41.824645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.824648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:41.824797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:41.825038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:41.825165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:41.825191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:41.825195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:41.875618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602009073745933:5230]
2025-10-10T14:36:41.875947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2097, pipe: [1:7559602009073745933:5230]
2025-10-10T14:36:41.944927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:41.945241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.945262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.945308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745933:5230], now have 1 active actors on pipe
2025-10-10T14:36:41.945533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:41.945519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:41.945582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602009073745933:5230]
2025-10-10T14:36:41.945601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:41.945604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:41.945686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2098 reason: error at write: Disconnected sessionId: src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0
2025-10-10T14:36:41.945898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2098 sessionId: src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0 is DEAD
2025-10-10T14:36:41.946053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:41.946064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0] Write session will restart in 0.005428s
2025-10-10T14:36:41.946089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0] Write session: Do CDS request
2025-10-10T14:36:41.946095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:41.952891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.952959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:41.952986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2099
2025-10-10T14:36:41.953126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:41.953169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:41.953180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:41.953184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:41.953655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2099 sessionId:  describe result for acl check
2025-10-10T14:36:41.953701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:41.953709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:41.953711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:41.953717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602009073745953:2553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:41.954386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602009073745953:2553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:41.956433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602009073745953:2553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:41.960432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602009073745953:2553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:41.960452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602009073745953:2553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:41.960457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602009073745953:2553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:41.960466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:41.962276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:41.964794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:41.965056Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:41.965068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:41.965081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:41.965144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:41.965188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602008291515828:3546]
2025-10-10T14:36:41.965860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:41.966713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:41.966763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:41.967279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:41.967347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.967353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.967354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.967356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.967357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.967359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.967360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.967361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.967362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.967364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.967366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.967367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.967369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.967376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.967390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.967394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.967399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.967402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.967406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.967409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.967412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.967416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.967423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.967427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.967431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.967435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.967444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.967462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:41.967470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.967475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:41.967480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.967486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:41.967490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.967494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:41.967499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.967503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:41.967508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.967513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:41.967523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.967534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:41.967538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.967543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:41.967548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.967552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:41.967556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.967561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:41.967566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.967571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.967575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.967580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.967585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.967591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.967632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:41.970666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:41.971154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:41.971165Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:41.971168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:41.971173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:41.971180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2098 [2:7559602008291515828:3546]
2025-10-10T14:36:41.971198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:41.971227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:41.971236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.971240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.971243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.971262Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:41.971275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:41.971295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:41.971359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.971366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.971370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.971374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:41.971444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:41.971454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.971467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:41.971479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:41.971502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:41.971530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602008291515823:3546]
2025-10-10T14:36:41.971538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602008291515823:3546]
2025-10-10T14:36:41.971541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602008291515823:3546]
2025-10-10T14:36:41.971555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:41.971575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:41.971599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:41.971607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:41.971642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602008291515823:3546]
2025-10-10T14:36:41.971650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:41.971855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:41.971863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:41.971865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:41.971872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:41.971969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2098
2025-10-10T14:36:41.971977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2098
2025-10-10T14:36:41.972420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073745935:2438], now have 1 active actors on pipe
2025-10-10T14:36:41.972434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602009073746109:2553], now have 1 active actors on pipe
2025-10-10T14:36:41.972458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.972466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.972510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:41.972526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:41.972535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:41.972538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:41.972551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:41.972566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:41.972585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.972915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:41.972922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:41.972938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:41.973086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2099 partition: 0 MaxSeqNo: 40 sessionId: src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0
2025-10-10T14:36:41.973540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97f13e8e-3a398b27-a38e78b8-585ffac7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:41.976436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0] Write session: try to update token
2025-10-10T14:36:41.976456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:41.993924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:41.993948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:41.993952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:41.993954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:41.993965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602008291515823:3546]
2025-10-10T14:36:41.993970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602008291515823:3546]
2025-10-10T14:36:41.993974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602008291515823:3546]
2025-10-10T14:36:41.994029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:41.994038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:41.994041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:41.994187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:42.001502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:42.001525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:42.001530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:42.000207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId: src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:42.003057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:42.045650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602013368713431:5230]
2025-10-10T14:36:42.048461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2098, pipe: [1:7559602013368713431:5230]
2025-10-10T14:36:42.119522Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:42.119869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.119880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.119928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713431:5230], now have 1 active actors on pipe
2025-10-10T14:36:42.120270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:42.120258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:42.120265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:42.120270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:42.120333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602013368713431:5230]
2025-10-10T14:36:42.120369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2099 reason: error at write: Disconnected sessionId: src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0
2025-10-10T14:36:42.120580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2099 sessionId: src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0 is DEAD
2025-10-10T14:36:42.121628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:42.121640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0] Write session will restart in 0.005354s
2025-10-10T14:36:42.121668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0] Write session: Do CDS request
2025-10-10T14:36:42.121678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:42.129871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.130310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:42.130337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2100
2025-10-10T14:36:42.133564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.133623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:42.133630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:42.133635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:42.134163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2100 sessionId:  describe result for acl check
2025-10-10T14:36:42.134207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:42.134209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:42.134211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:42.134218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602013368713495:2564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:42.134848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602013368713495:2564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:42.137949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602013368713495:2564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:42.141101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602013368713495:2564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:42.141117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602013368713495:2564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:42.141121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602013368713495:2564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:42.141130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:42.141895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:42.143941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:42.144215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:42.144229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:42.144242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:42.144329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:42.144384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602012586483323:3555]
2025-10-10T14:36:42.145010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:42.145306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:42.145372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:42.145708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:42.145782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.145789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.145790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.145791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.145793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.145794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.145795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.145797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.145798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.145799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.145800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.145801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.145803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.145809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.145823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.145827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.145831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.145834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.145838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.145842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.145846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.145850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.145854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.145858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.145863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.145866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.145875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.145883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.145890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.145895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.145902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.145907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.145911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.145917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.145921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.145932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.145937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.145942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.145947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.145956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.145961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.145967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.145976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.145980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.145984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.145989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.145993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.145998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.146002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.146008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.146012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.146017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.146054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:42.148523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:42.148842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:42.148851Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:42.148853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:42.148856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:42.148861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2099 [2:7559602012586483323:3555]
2025-10-10T14:36:42.148870Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:42.148884Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:42.148886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.148888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.148890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.148903Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:42.148908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:42.148914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:42.148959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.148964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.148965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.148967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:42.149037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:42.149045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.149056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.149070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.149091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:42.149114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713434:2438], now have 1 active actors on pipe
2025-10-10T14:36:42.149122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713611:2564], now have 1 active actors on pipe
2025-10-10T14:36:42.149129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602012586483318:3555]
2025-10-10T14:36:42.149131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602012586483318:3555]
2025-10-10T14:36:42.149132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602012586483318:3555]
2025-10-10T14:36:42.149145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:42.149161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:42.149164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:42.149164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:42.149166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:42.149179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:42.149183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:42.149182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2099
2025-10-10T14:36:42.149212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602012586483318:3555]
2025-10-10T14:36:42.149223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:42.149232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:42.149225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2099
2025-10-10T14:36:42.149479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.149489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.149524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7377e285-9887211b-175e5abf-785e06c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:42.149533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.149536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.149539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:42.149551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.149563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:42.149578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.152088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.152100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.152122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.152244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2100 partition: 0 MaxSeqNo: 40 sessionId: src_id|7377e285-9887211b-175e5abf-785e06c9_0
2025-10-10T14:36:42.153617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1efee5-59720f83-a8ce8bda-af6473ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7377e285-9887211b-175e5abf-785e06c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:42.156415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7377e285-9887211b-175e5abf-785e06c9_0] Write session: try to update token
2025-10-10T14:36:42.156438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7377e285-9887211b-175e5abf-785e06c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:42.175718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:42.175738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:42.175741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:42.175744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:42.175754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602012586483318:3555]
2025-10-10T14:36:42.175759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602012586483318:3555]
2025-10-10T14:36:42.175763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602012586483318:3555]
2025-10-10T14:36:42.175809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:42.175816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:42.175820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:42.175820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:42.175828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.175830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:42.175979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:42.186907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId: src_id|7377e285-9887211b-175e5abf-785e06c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:42.189523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:42.220240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602013368713623:5230]
2025-10-10T14:36:42.220591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2099, pipe: [1:7559602013368713623:5230]
2025-10-10T14:36:42.293096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:42.293103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:42.293112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:42.293166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602013368713623:5230]
2025-10-10T14:36:42.293198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2100 reason: error at write: Disconnected sessionId: src_id|7377e285-9887211b-175e5abf-785e06c9_0
2025-10-10T14:36:42.292123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:42.292632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.292643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.292668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713623:5230], now have 1 active actors on pipe
2025-10-10T14:36:42.293164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:42.293450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2100 sessionId: src_id|7377e285-9887211b-175e5abf-785e06c9_0 is DEAD
2025-10-10T14:36:42.297601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7377e285-9887211b-175e5abf-785e06c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:42.297624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7377e285-9887211b-175e5abf-785e06c9_0] Write session will restart in 0.006899s
2025-10-10T14:36:42.297652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7377e285-9887211b-175e5abf-785e06c9_0] Write session: Do CDS request
2025-10-10T14:36:42.297663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7377e285-9887211b-175e5abf-785e06c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:42.309799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7377e285-9887211b-175e5abf-785e06c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.309909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:42.309925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2101
2025-10-10T14:36:42.313659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.313722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:42.313733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:42.313738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:42.313915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:42.314191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2101 sessionId:  describe result for acl check
2025-10-10T14:36:42.314236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:42.314238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:42.314241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:42.314248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602013368713774:2575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:42.314883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602013368713774:2575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:42.316832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:42.317087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:42.317105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:42.317120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:42.317194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:42.317245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602012586483508:3554]
2025-10-10T14:36:42.317750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602013368713774:2575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:42.317929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:42.318259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:42.318313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:42.318579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:42.318645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.318650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.318651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.318652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.318653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.318653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.318655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.318655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.318656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.318657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.318657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.318658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.318659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.318664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.318674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.318677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.318679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.318681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.318684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.318686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.318688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.318690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.318693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.318695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.318697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.318699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.318705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.318711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.318715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.318720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.318723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.318727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.318730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.318733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.318736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.318740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.318743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.318746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.318750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.318756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.318761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.318766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.318772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.318778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.318782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.318788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.318794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.318798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.318802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.318807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.318812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.318817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.318853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:42.321916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602013368713774:2575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:42.321936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602013368713774:2575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:42.321939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602013368713774:2575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:42.321949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:42.324030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2100
2025-10-10T14:36:42.324069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2100
2025-10-10T14:36:42.322956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:42.323330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:42.323355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:42.323359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:42.323364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:42.323371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2100 [2:7559602012586483508:3554]
2025-10-10T14:36:42.323387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:42.323408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:42.323412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.323416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.323419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.323438Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:42.323446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:42.323454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:42.323523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.323526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.323528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.323531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:42.323612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:42.323615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.323627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.323640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.323656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:42.323678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602012586483503:3554]
2025-10-10T14:36:42.323680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602012586483503:3554]
2025-10-10T14:36:42.323682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602012586483503:3554]
2025-10-10T14:36:42.323692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:42.323705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:42.323708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:42.323709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:42.323711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:42.323725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:42.323728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:42.323740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713625:2438], now have 1 active actors on pipe
2025-10-10T14:36:42.323743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713807:2575], now have 1 active actors on pipe
2025-10-10T14:36:42.323777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602012586483503:3554]
2025-10-10T14:36:42.323789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:42.324134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:42.324586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.324594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.324649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ffb59-7d911c3e-33197acf-877c4805_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:42.324668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.324676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.324678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:42.324691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.324706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:42.324739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.325203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2101 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ffb59-7d911c3e-33197acf-877c4805_0
2025-10-10T14:36:42.325705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7377e285-9887211b-175e5abf-785e06c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ffb59-7d911c3e-33197acf-877c4805_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:42.325075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.325087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.325109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.328526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ffb59-7d911c3e-33197acf-877c4805_0] Write session: try to update token
2025-10-10T14:36:42.328545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ffb59-7d911c3e-33197acf-877c4805_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:42.346002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId: src_id|5ffb59-7d911c3e-33197acf-877c4805_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:42.349066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:42.349094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:42.349098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:42.349100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:42.349112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602012586483503:3554]
2025-10-10T14:36:42.349118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602012586483503:3554]
2025-10-10T14:36:42.349127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602012586483503:3554]
2025-10-10T14:36:42.349191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:42.349203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:42.349211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:42.349211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.349214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:42.349216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:42.349881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:42.349806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:42.393348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602013368713815:5230]
2025-10-10T14:36:42.395506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2100, pipe: [1:7559602013368713815:5230]
2025-10-10T14:36:42.470511Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:42.470788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.470810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.470860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713815:5230], now have 1 active actors on pipe
2025-10-10T14:36:42.471083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:42.471857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ffb59-7d911c3e-33197acf-877c4805_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:42.471867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ffb59-7d911c3e-33197acf-877c4805_0] Write session will restart in 0.009088s
2025-10-10T14:36:42.471896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ffb59-7d911c3e-33197acf-877c4805_0] Write session: Do CDS request
2025-10-10T14:36:42.471903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ffb59-7d911c3e-33197acf-877c4805_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:42.472140Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:36:42.472223Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:36:42.472227Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:36:42.472233Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.008379s
2025-10-10T14:36:42.471240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:42.471308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602013368713815:5230]
2025-10-10T14:36:42.471339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:42.471420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2101 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ffb59-7d911c3e-33197acf-877c4805_0
2025-10-10T14:36:42.471631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2101 sessionId: src_id|5ffb59-7d911c3e-33197acf-877c4805_0 is DEAD
2025-10-10T14:36:42.471754Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:36:42.471813Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 21 consumer shared/user session shared/user_1_21_5332133425265739141_v1 is DEAD
2025-10-10T14:36:42.472041Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601936059287426:5238] disconnected; active server actors: 1
2025-10-10T14:36:42.472045Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559601936059287426:5238] client user disconnected session shared/user_1_21_5332133425265739141_v1
2025-10-10T14:36:42.481807Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:36:42.482126Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:36:42.482142Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 22
2025-10-10T14:36:42.482322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ffb59-7d911c3e-33197acf-877c4805_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.482404Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 22 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:36:42.482475Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:36:42.482588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:42.482604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2102
2025-10-10T14:36:42.482622Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 auth for : user
2025-10-10T14:36:42.484081Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_22_7118026399824385190_v1
2025-10-10T14:36:42.482872Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 Handle describe topics response
2025-10-10T14:36:42.482903Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 auth is DEAD
2025-10-10T14:36:42.482932Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:36:42.483220Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:36:42.483276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.483314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:42.483318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:42.483322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:42.483399Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602013368713847:2599] connected; active server actors: 1
2025-10-10T14:36:42.483412Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602013368713847:2599] session shared/user_1_22_7118026399824385190_v1
2025-10-10T14:36:42.483423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:36:42.483435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:36:42.483443Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_22_7118026399824385190_v1" (Sender=[1:7559602013368713843:2599], Pipe=[1:7559602013368713847:2599], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:36:42.483447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:36:42.483460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:36:42.483471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_22_7118026399824385190_v1" (Sender=[1:7559602013368713843:2599], Pipe=[1:7559602013368713847:2599], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:36:42.483482Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_22_7118026399824385190_v1" sender [1:7559602013368713843:2599] lock partition 0 for ReadingSession "shared/user_1_22_7118026399824385190_v1" (Sender=[1:7559602013368713843:2599], Pipe=[1:7559602013368713847:2599], Partitions=[], ActiveFamilyCount=1) generation 1 step 22
2025-10-10T14:36:42.483490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:36:42.483496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000032s
2025-10-10T14:36:42.483732Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 22 Session: "shared/user_1_22_7118026399824385190_v1" ClientId: "user" PipeClient { RawX1: 7559602013368713847 RawX2: 4503603922340391 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:36:42.483770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:36:42.484028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2102 sessionId:  describe result for acl check
2025-10-10T14:36:42.484055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:42.484060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:42.484062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:42.484068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602013368713853:2595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:42.484734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602013368713853:2595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:42.491294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602013368713853:2595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:42.496415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602013368713853:2595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:42.496435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602013368713853:2595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:42.496439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602013368713853:2595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:42.496450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:42.500991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:42.504685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:42.504981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:42.504994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:42.505006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:42.505070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:42.505119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602012586483710:3543]
2025-10-10T14:36:42.505794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:42.509860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:42.509966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:42.510355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:42.510451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.510458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.510459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.510460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.510462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.510462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.510464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.510465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.510466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.510467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.510469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.510470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.510471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.510480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.510493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.510498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.510502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.510507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.510511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.510516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.510520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.510524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.510528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.510533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.510537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.510541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.510549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.510559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.510566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.510572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.510576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.510583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.510588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.510593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.510598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.510604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.510609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.510614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.510622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.510638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.510643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.510649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.510653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.510659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.510663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.510669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.510673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.510679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.510683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.510690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.510694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.510700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.510747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:42.513832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:42.514174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:42.514188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:42.514191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:42.514195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:42.514201Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2101 [2:7559602012586483710:3543]
2025-10-10T14:36:42.514215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:42.514238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:42.514245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.514249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.514252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.514270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:42.514283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:42.514291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:42.514363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.514370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.514373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.514375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:42.514448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:42.514458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.514472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.514485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.514501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:42.514527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713851:2605], now have 1 active actors on pipe
2025-10-10T14:36:42.514536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713821:2438], now have 1 active actors on pipe
2025-10-10T14:36:42.514539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368713985:2595], now have 1 active actors on pipe
2025-10-10T14:36:42.514547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602012586483705:3543]
2025-10-10T14:36:42.514549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602012586483705:3543]
2025-10-10T14:36:42.514551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602012586483705:3543]
2025-10-10T14:36:42.514565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:42.514579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:42.514582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:42.514585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:42.514586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:42.514604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:42.514608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:42.514644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602012586483705:3543]
2025-10-10T14:36:42.514652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:42.514657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:42.516851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2101
2025-10-10T14:36:42.516905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2101
2025-10-10T14:36:42.516935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2101, pipe: [1:7559602013368713851:2605]
2025-10-10T14:36:42.517101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.517120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.517137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_22_7118026399824385190_v1 on pipe: [1:7559602013368713851:2605]
2025-10-10T14:36:42.517177Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_22_7118026399824385190_v1:1 with generation 2101
2025-10-10T14:36:42.517190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.517193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.517209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.517216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.517219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:42.517245Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_22_7118026399824385190_v1
2025-10-10T14:36:42.517253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.517302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b19b021-5e88280f-c6f1605d-178981_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:42.517343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:36:42.517353Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:36:42.521659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:36:42.521705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:36:42.521718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.521730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.521733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:42.521749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.521771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:42.521782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:36:42.521800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:36:42.521826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.522229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.522258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.522289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.522105Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107002514 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:36:42.522145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:36:42.522177Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 sending to client partition status
2025-10-10T14:36:42.522460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2102 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b19b021-5e88280f-c6f1605d-178981_0
2025-10-10T14:36:42.525462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ffb59-7d911c3e-33197acf-877c4805_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b19b021-5e88280f-c6f1605d-178981_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:42.528367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b19b021-5e88280f-c6f1605d-178981_0] Write session: try to update token
2025-10-10T14:36:42.528392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b19b021-5e88280f-c6f1605d-178981_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:42.535523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:42.535543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:42.535546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:42.535547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:42.535557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602012586483705:3543]
2025-10-10T14:36:42.535561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602012586483705:3543]
2025-10-10T14:36:42.535564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602012586483705:3543]
2025-10-10T14:36:42.535612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:42.535622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:42.535625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.535629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:42.535631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:42.535633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:42.535773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:42.551894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId: src_id|4b19b021-5e88280f-c6f1605d-178981_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:42.554761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:42.652896Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:42.653391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.653408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.653631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_22_7118026399824385190_v1
2025-10-10T14:36:42.653653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:42.653728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602013368713851:2605]
2025-10-10T14:36:42.653760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:42.653805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:42.653894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2102 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b19b021-5e88280f-c6f1605d-178981_0
2025-10-10T14:36:42.653980Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_22_7118026399824385190_v1
2025-10-10T14:36:42.654098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2102 sessionId: src_id|4b19b021-5e88280f-c6f1605d-178981_0 is DEAD
2025-10-10T14:36:42.654289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b19b021-5e88280f-c6f1605d-178981_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:42.654300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b19b021-5e88280f-c6f1605d-178981_0] Write session will restart in 0.005253s
2025-10-10T14:36:42.654339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b19b021-5e88280f-c6f1605d-178981_0] Write session: Do CDS request
2025-10-10T14:36:42.654348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b19b021-5e88280f-c6f1605d-178981_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:42.661018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b19b021-5e88280f-c6f1605d-178981_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.661094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:42.661113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2103
2025-10-10T14:36:42.661242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.661280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:42.661292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:42.661297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:42.661846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2103 sessionId:  describe result for acl check
2025-10-10T14:36:42.661881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:42.661887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:42.661889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:42.661895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602013368714058:2614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:42.662448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602013368714058:2614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:42.667157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602013368714058:2614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:42.670693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602013368714058:2614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:42.670709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602013368714058:2614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:42.670712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602013368714058:2614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:42.670722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:42.671907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:42.674809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:42.675085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:42.675099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:42.675112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:42.675174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:42.675225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602012586483926:3509]
2025-10-10T14:36:42.675915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:42.676294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:42.676358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:42.676741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:42.676810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.676816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.676818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.676819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.676821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.676822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.676823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.676825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.676826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.676828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.676829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.676830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.676832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.676839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.676854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.676858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.676862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.676866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.676870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.676875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.676879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.676884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.676890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.676895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.676900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.676908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.676918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.676931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.676942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.676952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.676960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.676969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.676977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.676984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.676992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.676998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.677006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.677011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.677016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.677022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.677026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.677032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.677037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.677043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.677048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.677058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.677064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.677073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.677078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.677088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.677093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.677102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.677145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:42.679689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:42.680295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:42.680310Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:42.680313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:42.680318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:42.680325Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2102 [2:7559602012586483926:3509]
2025-10-10T14:36:42.680339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:42.680357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:42.680361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.680365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.680367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.680387Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:42.680402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:42.680417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:42.680494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.680501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.680504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.680507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:42.680576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:42.680584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.680596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.680608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.680630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:42.680660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368714043:2438], now have 1 active actors on pipe
2025-10-10T14:36:42.680670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368714221:2614], now have 1 active actors on pipe
2025-10-10T14:36:42.680679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602012586483921:3509]
2025-10-10T14:36:42.680682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602012586483921:3509]
2025-10-10T14:36:42.680685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602012586483921:3509]
2025-10-10T14:36:42.680701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:42.680720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:42.680712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2102
2025-10-10T14:36:42.680728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:42.680735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2102
2025-10-10T14:36:42.680731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:42.680733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:42.680745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:42.680748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:42.680779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602012586483921:3509]
2025-10-10T14:36:42.680787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:42.680800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:42.680819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.680825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.680870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:42.680885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.680890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.680893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:42.680906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.680922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:42.680949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.681154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.681168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.681194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.681327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2103 partition: 0 MaxSeqNo: 40 sessionId: src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0
2025-10-10T14:36:42.681802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b19b021-5e88280f-c6f1605d-178981_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:42.684553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0] Write session: try to update token
2025-10-10T14:36:42.684574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:42.700903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId: src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:42.701500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:42.701520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:42.701524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:42.701526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:42.701535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602012586483921:3509]
2025-10-10T14:36:42.701540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602012586483921:3509]
2025-10-10T14:36:42.701544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602012586483921:3509]
2025-10-10T14:36:42.701596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:42.701594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:42.701602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:42.701606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:42.701607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.701610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:42.701758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:42.703633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:42.753734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602013368714241:2605]
2025-10-10T14:36:42.754039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2102, pipe: [1:7559602013368714241:2605]
2025-10-10T14:36:42.819721Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:42.820116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.820135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.820185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368714241:2605], now have 1 active actors on pipe
2025-10-10T14:36:42.820445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:42.821575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:42.821590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0] Write session will restart in 0.005196s
2025-10-10T14:36:42.821615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0] Write session: Do CDS request
2025-10-10T14:36:42.821622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:42.820606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602013368714241:2605]
2025-10-10T14:36:42.820642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:42.820676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:42.820782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2103 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0
2025-10-10T14:36:42.821027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2103 sessionId: src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0 is DEAD
2025-10-10T14:36:42.828198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.828322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:42.828336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2104
2025-10-10T14:36:42.829525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:42.829579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:42.829590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:42.829595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:42.830029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2104 sessionId:  describe result for acl check
2025-10-10T14:36:42.830059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:42.830065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:42.830066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:42.830071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602013368714252:2619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:42.830565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602013368714252:2619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:42.835919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602013368714252:2619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:42.841117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602013368714252:2619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:42.841131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602013368714252:2619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:42.841134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602013368714252:2619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:42.841142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:42.860687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:42.863238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:42.863461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:42.863484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:42.863497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:42.863556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:42.863606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602012586484117:3504]
2025-10-10T14:36:42.864076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:42.864350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:42.864400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:42.864641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:42.864701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.864702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.864703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.864705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.864706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.864708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.864710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.864711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.864712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.864713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.864714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.864716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.864717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.864724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.864737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.864742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.864747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.864751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.864756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.864761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.864765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.864769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.864774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.864778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.864783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.864788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.864798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.864806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:42.864813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.864826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:42.864832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.864840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:42.864845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.864851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:42.864858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.864867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:42.864872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.864884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:42.864891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.864900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:42.864905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.864915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:42.864920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.864929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:42.864933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.864938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:42.864944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.864949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.864953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.864958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.864962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.864968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.865012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:42.867662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:42.867963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:42.867973Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:42.867976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:42.867980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:42.867985Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2103 [2:7559602012586484117:3504]
2025-10-10T14:36:42.867995Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:42.868010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:42.868014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.868018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.868020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.868036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:42.868044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:42.868053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:42.868104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.868105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.868107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.868109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:42.868165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:42.868174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.868182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:42.868188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:42.868199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:42.868218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602012586484111:3504]
2025-10-10T14:36:42.868223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602012586484111:3504]
2025-10-10T14:36:42.868225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602012586484111:3504]
2025-10-10T14:36:42.868235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:42.868247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:42.868263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:42.868281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:42.868304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602012586484111:3504]
2025-10-10T14:36:42.868306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:42.868430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:42.868437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:42.868439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:42.868455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:42.868534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2103
2025-10-10T14:36:42.868585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2103
2025-10-10T14:36:42.869854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2104 partition: 0 MaxSeqNo: 40 sessionId: src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0
2025-10-10T14:36:42.870288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f0dc4a-ef66637-3036fa59-b4ecf1c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:42.873078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0] Write session: try to update token
2025-10-10T14:36:42.873097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:42.868660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368714308:2619], now have 1 active actors on pipe
2025-10-10T14:36:42.868671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368714245:2438], now have 1 active actors on pipe
2025-10-10T14:36:42.868982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.868989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.869025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:42.869033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:42.869037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:42.869040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:42.869052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:42.869064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:42.869081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.869670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:42.869674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:42.869707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:42.890469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId: src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:42.892764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:42.892790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:42.892795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:42.892797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:42.892809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602012586484111:3504]
2025-10-10T14:36:42.892814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602012586484111:3504]
2025-10-10T14:36:42.892818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602012586484111:3504]
2025-10-10T14:36:42.892875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:42.892884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:42.892884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:42.892888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:42.892893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:42.892898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:42.893043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:42.893447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:42.920172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602013368714440:2605]
2025-10-10T14:36:42.920677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2103, pipe: [1:7559602013368714440:2605]
2025-10-10T14:36:43.015167Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:43.015359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.015374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.015415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602013368714440:2605], now have 1 active actors on pipe
2025-10-10T14:36:43.015707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602013368714440:2605]
2025-10-10T14:36:43.015752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:43.015755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:43.015829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2104 reason: error at write: Disconnected sessionId: src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0
2025-10-10T14:36:43.016030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2104 sessionId: src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0 is DEAD
2025-10-10T14:36:43.016067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:43.015664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:43.016366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:43.016376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0] Write session will restart in 0.009127s
2025-10-10T14:36:43.016409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0] Write session: Do CDS request
2025-10-10T14:36:43.016418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:43.026979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.027116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:43.027132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2105
2025-10-10T14:36:43.027290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.027336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:43.027347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:43.027351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:43.027840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2105 sessionId:  describe result for acl check
2025-10-10T14:36:43.027891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:43.027895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:43.027897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:43.027904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602017663681809:2629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:43.028506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602017663681809:2629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:43.031444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602017663681809:2629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:43.033081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:43.035495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:43.035858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:43.035870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:43.035884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:43.035899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602017663681809:2629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:43.035921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602017663681809:2629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:43.035924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602017663681809:2629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:43.035947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:43.035934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:43.035991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602016881451617:3486]
2025-10-10T14:36:43.036590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:43.036955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:43.037017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:43.037403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:43.037477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.037479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.037480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.037481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.037482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.037484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.037485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.037486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.037487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.037488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.037490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.037491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.037492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.037499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.037510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.037514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.037517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.037521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.037525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.037529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.037533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.037536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.037542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.037545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.037549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.037553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.037561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.037570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.037576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.037582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.037588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.037594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.037599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.037604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.037609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.037614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.037619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.037623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.037628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.037633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.037637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.037642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.037648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.037654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.037658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.037664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.037668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.037673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.037677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.037682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.037686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.037692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.037731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:43.040094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:43.040468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:43.040483Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:43.040485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:43.040489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:43.040495Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2104 [2:7559602016881451617:3486]
2025-10-10T14:36:43.040507Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:43.040524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:43.040527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.040530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.040533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.040550Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:43.040559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:43.040572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:43.040633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.040642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.040644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.040648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:43.040716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:43.040724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.040736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.040747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.040785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:43.040813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663681933:2629], now have 1 active actors on pipe
2025-10-10T14:36:43.040821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663681738:2438], now have 1 active actors on pipe
2025-10-10T14:36:43.040831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602016881451612:3486]
2025-10-10T14:36:43.040836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602016881451612:3486]
2025-10-10T14:36:43.040838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602016881451612:3486]
2025-10-10T14:36:43.040838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2104
2025-10-10T14:36:43.040882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2104
2025-10-10T14:36:43.040854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:43.040874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:43.040880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:43.040883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:43.040884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:43.040891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:43.040894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:43.040915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602016881451612:3486]
2025-10-10T14:36:43.040918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:43.040920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:43.040940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.040945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.041003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:43.041016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.041021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.041024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:43.041034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.041050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:43.041067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.041239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.041252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.041275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.041380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2105 partition: 0 MaxSeqNo: 40 sessionId: src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0
2025-10-10T14:36:43.041812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09bdf7d-799fa001-ea02e565-660d8ff6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:43.044477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0] Write session: try to update token
2025-10-10T14:36:43.044493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:43.060845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId: src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:43.063693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:43.064053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.064080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.064136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:43.064299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:43.072805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:43.072828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:43.072833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:43.072835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:43.072845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602016881451612:3486]
2025-10-10T14:36:43.072850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602016881451612:3486]
2025-10-10T14:36:43.072855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602016881451612:3486]
2025-10-10T14:36:43.072908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:43.072917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:43.072921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.072924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:43.072925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:43.072930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:43.073073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:43.115211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602017663681945:2605]
2025-10-10T14:36:43.115576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2104, pipe: [1:7559602017663681945:2605]
2025-10-10T14:36:43.200433Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:43.208823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.208853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.209037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.209103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.209174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.209241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.209441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.209454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.209523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.209587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.209653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.209720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.209764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.209775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.209852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.209915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.209978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.210043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.210089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.210096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.210162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.210235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.210299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.210364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.210408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.210417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.210485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.210550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.210614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.210675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.210720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.210729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.210794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.210863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.210928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.210993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.211043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.211053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.211120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.211184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.211249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.211318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.211364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.211371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.211438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.211502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.211569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.211633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.211681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.211689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.211761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.211827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.211894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.211959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.212003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.212012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.212078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.212142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.212206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.212287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.212335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.212338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.212401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663681945:2605], now have 1 active actors on pipe
2025-10-10T14:36:43.212714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:43.212741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:43.212745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:43.212789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602017663681945:2605]
2025-10-10T14:36:43.212790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2105 reason: error at write: Disconnected sessionId: src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0
2025-10-10T14:36:43.213021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2105 sessionId: src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0 is DEAD
2025-10-10T14:36:43.213169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:43.213181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0] Write session will restart in 0.006517s
2025-10-10T14:36:43.213220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0] Write session: Do CDS request
2025-10-10T14:36:43.213227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:43.213287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:43.220931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.220996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:43.221012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2106
2025-10-10T14:36:43.221130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.221177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:43.221192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:43.221200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:43.221662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2106 sessionId:  describe result for acl check
2025-10-10T14:36:43.221697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:43.221704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:43.221706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:43.221713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602017663681962:2642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:43.222289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602017663681962:2642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:43.225736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602017663681962:2642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:43.228835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602017663681962:2642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:43.228849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602017663681962:2642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:43.228852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602017663681962:2642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:43.228860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:43.231321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:43.234087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:43.234324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:43.234334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:43.234346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:43.234404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:43.234448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602016881451810:3496]
2025-10-10T14:36:43.235012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:43.235381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:43.235448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:43.235818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:43.235889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.235896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.235898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.235899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.235900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.235902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.235903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.235905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.235906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.235907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.235908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.235910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.235911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.235917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.235931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.235936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.235940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.235944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.235948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.235952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.235955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.235959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.235963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.235968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.235972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.235976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.235985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.235994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.236001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.236007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.236012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.236017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.236022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.236026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.236031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.236036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.236040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.236045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.236050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.236055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.236059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.236064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.236069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.236075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.236088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.236094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.236104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.236109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.236114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.236124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.236141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.236151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.236193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:43.238867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:43.239338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:43.239355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:43.239357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:43.239361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:43.239369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2105 [2:7559602016881451810:3496]
2025-10-10T14:36:43.239384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:43.239402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:43.239406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.239409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.239412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.239432Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:43.239442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:43.239452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:43.239516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.239525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.239527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.239530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:43.239602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:43.239610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.239622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.239638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.239661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:43.239689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682115:2642], now have 1 active actors on pipe
2025-10-10T14:36:43.239699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663681947:2438], now have 1 active actors on pipe
2025-10-10T14:36:43.239711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602016881451805:3496]
2025-10-10T14:36:43.239713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602016881451805:3496]
2025-10-10T14:36:43.239715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602016881451805:3496]
2025-10-10T14:36:43.239733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:43.239749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:43.239752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:43.239760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:43.239762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:43.239771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:43.239774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:43.239803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602016881451805:3496]
2025-10-10T14:36:43.239811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:43.239821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:43.239789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2105
2025-10-10T14:36:43.239788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2105
2025-10-10T14:36:43.239850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.239860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.239894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:43.239902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.239905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.239908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:43.239921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.239933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:43.239947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.240119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.240129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.240145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.240267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2106 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0
2025-10-10T14:36:43.240721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3643bc6f-fae2f25f-36fbd852-52a209b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:43.243755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0] Write session: try to update token
2025-10-10T14:36:43.243778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:43.251922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:43.251943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:43.251956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602016881451805:3496]
2025-10-10T14:36:43.252013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:43.252019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:43.252191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:43.252346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:43.252482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:43.252622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:43.252813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:43.252856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:43.258863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId: src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:43.261694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:43.261961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.261986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.262034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:43.262111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:43.271053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:43.271074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:43.271078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:43.271080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:43.271091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602016881451805:3496]
2025-10-10T14:36:43.271096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602016881451805:3496]
2025-10-10T14:36:43.271100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602016881451805:3496]
2025-10-10T14:36:43.271153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:43.271162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.271165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:43.271170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:43.271177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:43.271182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:43.271304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:43.312872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602017663682143:2605]
2025-10-10T14:36:43.313300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2105, pipe: [1:7559602017663682143:2605]
2025-10-10T14:36:43.390065Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:43.398374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.398415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.398608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.398681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.398746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.398819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.398866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.398876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.398946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.399015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.399086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.399164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.399213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.399221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.399290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.399358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.399434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.399502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.399553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.399566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.399645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.399714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.399782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.399855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.399904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.399912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.399986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.400055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.400123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.400192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.400248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.400319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.400404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.400472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.400545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.400620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.400686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.400694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.400771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.400840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.400915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.400990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.401043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.401047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.401126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.401196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.401267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.402851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:43.402872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0] Write session will restart in 0.005457s
2025-10-10T14:36:43.402899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0] Write session: Do CDS request
2025-10-10T14:36:43.402905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:43.402447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602017663682143:2605]
2025-10-10T14:36:43.402455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:43.402459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:43.402503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2106 reason: error at write: Disconnected sessionId: src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0
2025-10-10T14:36:43.402716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2106 sessionId: src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0 is DEAD
2025-10-10T14:36:43.402762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:43.401358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.401414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.401417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.401491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.401555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.401619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.401685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.401728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.401731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.401804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:43.401867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:43.401931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:43.401995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:43.402042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:43.402045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:43.402129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682143:2605], now have 1 active actors on pipe
2025-10-10T14:36:43.403434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:43.410073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.410209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:43.410225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2107
2025-10-10T14:36:43.410323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.410360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:43.410372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:43.410376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:43.410842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2107 sessionId:  describe result for acl check
2025-10-10T14:36:43.410876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:43.410878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:43.410880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:43.410886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602017663682160:2647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:43.411450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602017663682160:2647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:43.420229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602017663682160:2647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:43.423706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602017663682160:2647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:43.423723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602017663682160:2647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:43.423727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602017663682160:2647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:43.423736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:43.425285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:43.428198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:43.428461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:43.428472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:43.428485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:43.428544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:43.428585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602016881452003:3495]
2025-10-10T14:36:43.429055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:43.429370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:43.429429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:43.429809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:43.429871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.429878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.429879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.429880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.429881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.429882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.429884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.429885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.429886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.429887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.429888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.429890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.429890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.429896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.429910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.429913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.429917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.429920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.429924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.429928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.429932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.429935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.429939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.429943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.429946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.429950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.429958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.429967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.429973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.429978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.429982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.429987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.429991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.429996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.430000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.430005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.430009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.430014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.430029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.430034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.430038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.430043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.430047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.430052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.430055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.430062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.430066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.430070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.430075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.430079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.430086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.430090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.430124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:43.432654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:43.433317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:43.433348Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:43.433350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:43.433354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:43.433361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2106 [2:7559602016881452003:3495]
2025-10-10T14:36:43.433375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:43.433394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:43.433403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.433408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.433410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.433430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:43.433444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:43.433453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:43.433515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.433523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.433526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.433529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:43.433604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:43.433612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.433624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.433635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.433652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:43.433675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682328:2647], now have 1 active actors on pipe
2025-10-10T14:36:43.433685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682145:2438], now have 1 active actors on pipe
2025-10-10T14:36:43.433694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602016881451998:3495]
2025-10-10T14:36:43.433696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602016881451998:3495]
2025-10-10T14:36:43.433698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602016881451998:3495]
2025-10-10T14:36:43.433713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:43.433727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:43.433748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:43.433756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:43.433787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602016881451998:3495]
2025-10-10T14:36:43.433795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:43.433830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:43.433841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:43.433843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:43.433851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:43.433831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2106
2025-10-10T14:36:43.433908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2106
2025-10-10T14:36:43.433946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.433958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.433988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:43.434003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.434011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.434029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:43.434040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.434058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:43.434073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.434242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.434252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.434267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.434363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2107 partition: 0 MaxSeqNo: 40 sessionId: src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0
2025-10-10T14:36:43.434753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ed4d17b-72587f2a-b6b02b3f-b1b6ee89_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:43.437526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0] Write session: try to update token
2025-10-10T14:36:43.437544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:43.451967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId: src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:43.454834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:43.457072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.457101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.457128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:43.457131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:43.457135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:43.457138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:43.457146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602016881451998:3495]
2025-10-10T14:36:43.457150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602016881451998:3495]
2025-10-10T14:36:43.457158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602016881451998:3495]
2025-10-10T14:36:43.457226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:43.457239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.457242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:43.457411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:43.461452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:43.461470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:43.461478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:43.502803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602017663682342:2605]
2025-10-10T14:36:43.503210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2106, pipe: [1:7559602017663682342:2605]
2025-10-10T14:36:43.571978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:43.570837Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:43.571811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:43.571874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682342:2605], now have 1 active actors on pipe
2025-10-10T14:36:43.576015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602017663682342:2605]
2025-10-10T14:36:43.576039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:43.585707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:43.585721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:43.585747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2107 reason: error at write: Disconnected sessionId: src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0
2025-10-10T14:36:43.586066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:43.586078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0] Write session will restart in 0.009995s
2025-10-10T14:36:43.585902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2107 sessionId: src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0 is DEAD
2025-10-10T14:36:43.586103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0] Write session: Do CDS request
2025-10-10T14:36:43.586109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:43.596860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.596979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:43.596995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2108
2025-10-10T14:36:43.597127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.597158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:43.597164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:43.597180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:43.598172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2108 sessionId:  describe result for acl check
2025-10-10T14:36:43.598214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:43.598219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:43.598221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:43.598228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602017663682472:2671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:43.598796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602017663682472:2671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:43.602257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602017663682472:2671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:43.602255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:43.605002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:43.605415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602017663682472:2671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:43.605432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602017663682472:2671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:43.605436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602017663682472:2671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:43.605446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:43.605526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:43.605543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:43.605560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:43.605644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:43.605693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602016881452234:3488]
2025-10-10T14:36:43.606324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:43.606673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:43.606729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:43.607086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:43.607162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.607170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.607171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.607173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.607174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.607175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.607177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.607178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.607179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.607181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.607182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.607184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.607185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.607192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.607205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.607210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.607214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.607217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.607222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.607226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.607230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.607233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.607238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.607242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.607246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.607250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.607259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.607268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.607276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.607282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.607287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.607293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.607298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.607303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.607307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.607313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.607317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.607322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.607327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.607332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.607336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.607340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.607345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.607350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.607353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.607359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.607365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.607370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.607375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.607380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.607385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.607391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.607440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:43.609984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:43.610311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:43.610326Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:43.610330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:43.610334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:43.610340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2107 [2:7559602016881452234:3488]
2025-10-10T14:36:43.610353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:43.610373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:43.610376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.610380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.610383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.610401Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:43.610415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:43.610424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:43.610490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.610499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.610501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.610504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:43.610822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:43.610833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.610848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.610869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.610891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:43.610921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602016881452229:3488]
2025-10-10T14:36:43.610931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602016881452229:3488]
2025-10-10T14:36:43.610933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602016881452229:3488]
2025-10-10T14:36:43.610948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:43.610969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:43.610991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:43.610998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:43.611016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:43.611026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:43.611027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602016881452229:3488]
2025-10-10T14:36:43.611028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:43.611030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:43.611035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:43.611154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682358:2438], now have 1 active actors on pipe
2025-10-10T14:36:43.611165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682552:2671], now have 1 active actors on pipe
2025-10-10T14:36:43.611339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2107
2025-10-10T14:36:43.611364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2107
2025-10-10T14:36:43.611751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.611764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.611801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a63255e6-d6197525-281f7111-9e8c9a54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:43.611815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.611823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.611830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:43.611842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.611870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:43.611890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.612098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.612116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.612139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.612272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2108 partition: 0 MaxSeqNo: 40 sessionId: src_id|a63255e6-d6197525-281f7111-9e8c9a54_0
2025-10-10T14:36:43.613694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea5ffd6-df69909d-a7c83dc0-8bacd6f1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a63255e6-d6197525-281f7111-9e8c9a54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:43.616457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63255e6-d6197525-281f7111-9e8c9a54_0] Write session: try to update token
2025-10-10T14:36:43.616474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63255e6-d6197525-281f7111-9e8c9a54_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:43.631891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:43.631910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:43.631914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:43.631916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:43.631927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602016881452229:3488]
2025-10-10T14:36:43.631932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602016881452229:3488]
2025-10-10T14:36:43.631936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602016881452229:3488]
2025-10-10T14:36:43.631979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:43.631984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:43.631988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:43.631989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:43.631996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.631998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:43.632144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:43.633008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId: src_id|a63255e6-d6197525-281f7111-9e8c9a54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:43.635778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:43.676333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602017663682563:2605]
2025-10-10T14:36:43.676585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2107, pipe: [1:7559602017663682563:2605]
2025-10-10T14:36:43.747921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:43.748371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.748389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.748436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682563:2605], now have 1 active actors on pipe
2025-10-10T14:36:43.748651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:43.748722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:43.748797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:43.748805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:43.748881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2108 reason: error at write: Disconnected sessionId: src_id|a63255e6-d6197525-281f7111-9e8c9a54_0
2025-10-10T14:36:43.749013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602017663682563:2605]
2025-10-10T14:36:43.749086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2108 sessionId: src_id|a63255e6-d6197525-281f7111-9e8c9a54_0 is DEAD
2025-10-10T14:36:43.749258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63255e6-d6197525-281f7111-9e8c9a54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:43.749266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63255e6-d6197525-281f7111-9e8c9a54_0] Write session will restart in 0.009449s
2025-10-10T14:36:43.749290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63255e6-d6197525-281f7111-9e8c9a54_0] Write session: Do CDS request
2025-10-10T14:36:43.749300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63255e6-d6197525-281f7111-9e8c9a54_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:43.761135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63255e6-d6197525-281f7111-9e8c9a54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.761410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:43.761431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2109
2025-10-10T14:36:43.762102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.762155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:43.762161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:43.762165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:43.762669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2109 sessionId:  describe result for acl check
2025-10-10T14:36:43.762707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:43.762713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:43.762715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:43.762722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602017663682703:2700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:43.763293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602017663682703:2700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:43.765565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:43.765778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602017663682703:2700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:43.768398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:43.768741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:43.768747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:43.768761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:43.768846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:43.768882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602016881452430:3457]
2025-10-10T14:36:43.768988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602017663682703:2700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:43.769003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602017663682703:2700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:43.769007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602017663682703:2700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:43.769015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:43.769551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:43.769885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:43.769949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:43.770307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:43.770588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.770598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.770600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.770601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.770603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.770605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.770606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.770608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.770610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.770611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.770612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.770614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.770615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.770624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.770639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.770644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.770649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.770653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.770657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.770662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.770666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.770670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.770676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.770680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.770684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.770688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.770699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.770708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.770715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.770722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.770728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.770734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.770739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.770745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.770756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.770762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.770766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.770772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.770777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.770783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.770787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.770792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.770799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.770805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.770809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.770815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.770819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.770825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.770829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.770835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.770841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.770847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.770889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:43.775295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:43.775638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:43.775657Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:43.775660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:43.775664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:43.775671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2108 [2:7559602016881452430:3457]
2025-10-10T14:36:43.775685Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:43.775705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:43.775714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.775718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.775720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.775739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:43.775747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:43.775760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:43.775826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.775834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.775837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.775840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:43.776105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:43.776117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.776132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.776152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.776181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:43.776211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682758:2700], now have 1 active actors on pipe
2025-10-10T14:36:43.776221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682570:2438], now have 1 active actors on pipe
2025-10-10T14:36:43.776229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602016881452425:3457]
2025-10-10T14:36:43.776232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602016881452425:3457]
2025-10-10T14:36:43.776234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602016881452425:3457]
2025-10-10T14:36:43.776258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:43.776276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:43.776295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:43.776298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:43.776301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:43.776304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:43.776305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:43.776360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.776370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.776387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602016881452425:3457]
2025-10-10T14:36:43.776401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:43.776414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:43.776439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed326822-568c3358-a9966a56-8149f7d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:43.776452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.776461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.776464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:43.776476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.776493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:43.776526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.776142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2108
2025-10-10T14:36:43.776185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2108
2025-10-10T14:36:43.776804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.776815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.776836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.777013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2109 partition: 0 MaxSeqNo: 40 sessionId: src_id|ed326822-568c3358-a9966a56-8149f7d8_0
2025-10-10T14:36:43.777531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63255e6-d6197525-281f7111-9e8c9a54_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ed326822-568c3358-a9966a56-8149f7d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:43.780339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed326822-568c3358-a9966a56-8149f7d8_0] Write session: try to update token
2025-10-10T14:36:43.780357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed326822-568c3358-a9966a56-8149f7d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:43.797983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:43.798004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:43.798008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:43.798011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:43.798024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602016881452425:3457]
2025-10-10T14:36:43.798029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602016881452425:3457]
2025-10-10T14:36:43.798033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602016881452425:3457]
2025-10-10T14:36:43.798089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:43.798095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:43.798097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.798101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:43.798102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:43.798107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:43.798235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:43.802309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId: src_id|ed326822-568c3358-a9966a56-8149f7d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:43.805003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:43.849405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602017663682772:2605]
2025-10-10T14:36:43.849667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2108, pipe: [1:7559602017663682772:2605]
2025-10-10T14:36:43.918260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:43.918658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.918676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.918723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682772:2605], now have 1 active actors on pipe
2025-10-10T14:36:43.918940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:43.919245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:43.919341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602017663682772:2605]
2025-10-10T14:36:43.919371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ed326822-568c3358-a9966a56-8149f7d8_0
2025-10-10T14:36:43.919396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:43.919591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2109 sessionId: src_id|ed326822-568c3358-a9966a56-8149f7d8_0 is DEAD
2025-10-10T14:36:43.921594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed326822-568c3358-a9966a56-8149f7d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:43.921607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed326822-568c3358-a9966a56-8149f7d8_0] Write session will restart in 0.005105s
2025-10-10T14:36:43.921635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed326822-568c3358-a9966a56-8149f7d8_0] Write session: Do CDS request
2025-10-10T14:36:43.921641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed326822-568c3358-a9966a56-8149f7d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:43.929849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed326822-568c3358-a9966a56-8149f7d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.931493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:43.931510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2110
2025-10-10T14:36:43.933568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:43.933610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:43.933614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:43.933618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:43.934159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2110 sessionId:  describe result for acl check
2025-10-10T14:36:43.934199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:43.934207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:43.934209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:43.934216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602017663682801:2687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:43.934791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602017663682801:2687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:43.943350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602017663682801:2687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:43.950701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602017663682801:2687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:43.950720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602017663682801:2687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:43.950724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602017663682801:2687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:43.950735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:43.951011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:43.954405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:43.954666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:43.954691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:43.954704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:43.954772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:43.954821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602016881452628:3467]
2025-10-10T14:36:43.955482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:43.955861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:43.955913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:43.956270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:43.956334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.956341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.956343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.956345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.956346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.956348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.956350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.956351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.956353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.956354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.956355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.956357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.956359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.956365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.956381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.956386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.956391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.956395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.956400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.956405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.956410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.956414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.956419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.956423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.956428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.956432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.956441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.956451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:43.956458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.956465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:43.956470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.956477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:43.956487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.956493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:43.956499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.956504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:43.956508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.956513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:43.956518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.956524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:43.956532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.956539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:43.956548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.956553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:43.956558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.956568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:43.956573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.956583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.956589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.956600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.956623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.956633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.956678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:43.959161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:43.959869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:43.959883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:43.959886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:43.959890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:43.959900Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2109 [2:7559602016881452628:3467]
2025-10-10T14:36:43.959926Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:43.959950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:43.959954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.959958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.959960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.959980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:43.959989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:43.960006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:43.960076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.960082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.960085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.960087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:43.960158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:43.960167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.960178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:43.960191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:43.960207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:43.960231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682962:2687], now have 1 active actors on pipe
2025-10-10T14:36:43.960235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602017663682773:2438], now have 1 active actors on pipe
2025-10-10T14:36:43.960253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602016881452621:3467]
2025-10-10T14:36:43.960255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602016881452621:3467]
2025-10-10T14:36:43.960258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602016881452621:3467]
2025-10-10T14:36:43.960272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:43.960288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:43.960307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:43.960310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:43.960340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602016881452621:3467]
2025-10-10T14:36:43.960343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:43.960381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:43.960393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:43.960536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2109
2025-10-10T14:36:43.960579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2109
2025-10-10T14:36:43.960403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:43.960416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:43.960587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.960593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.960630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:43.960640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:43.960644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:43.960646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:43.960660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:43.960672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:43.960690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.961107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:43.961122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:43.961146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:43.961275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2110 partition: 0 MaxSeqNo: 40 sessionId: src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0
2025-10-10T14:36:43.965440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed326822-568c3358-a9966a56-8149f7d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:43.968195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0] Write session: try to update token
2025-10-10T14:36:43.968216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:43.976445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:43.976466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:43.976477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602016881452621:3467]
2025-10-10T14:36:43.976529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:43.976655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:43.976699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:43.976838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:43.976982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:43.977119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:43.977310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:43.977376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:43.996280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:43.996301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:43.996305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:43.996307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:43.996319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602016881452621:3467]
2025-10-10T14:36:43.996324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602016881452621:3467]
2025-10-10T14:36:43.996328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602016881452621:3467]
2025-10-10T14:36:43.996376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:43.996384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:43.996387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:43.996391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:43.996399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:43.996404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:43.996524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:43.997387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId: src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:43.999937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:44.021400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602021958650271:2605]
2025-10-10T14:36:44.025635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2109, pipe: [1:7559602021958650271:2605]
2025-10-10T14:36:44.117927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:44.118293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.118310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.118335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650271:2605], now have 1 active actors on pipe
2025-10-10T14:36:44.118550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:44.118605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:44.118613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:44.118695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2110 reason: error at write: Disconnected sessionId: src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0
2025-10-10T14:36:44.118886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602021958650271:2605]
2025-10-10T14:36:44.118555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:44.118908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2110 sessionId: src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0 is DEAD
2025-10-10T14:36:44.119070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:44.119081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0] Write session will restart in 0.005524s
2025-10-10T14:36:44.119109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0] Write session: Do CDS request
2025-10-10T14:36:44.119128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:44.125917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.126053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:44.126068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2111
2025-10-10T14:36:44.126188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.126238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:44.126248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:44.126252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:44.126810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2111 sessionId:  describe result for acl check
2025-10-10T14:36:44.126858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:44.126865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:44.126867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:44.126874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602021958650310:2702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:44.127445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602021958650310:2702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:44.130539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602021958650310:2702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:44.133362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602021958650310:2702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:44.133378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602021958650310:2702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:44.133381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602021958650310:2702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:44.133389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:44.134929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:44.137529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:44.137924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:44.137940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:44.137955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:44.138022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:44.138073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602021176420135:3464]
2025-10-10T14:36:44.138740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:44.139139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:44.139199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:44.139564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:44.139642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.139650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.139651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.139652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.139653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.139654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.139656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.139657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.139659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.139660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.139661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.139662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.139664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.139670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.139683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.139688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.139692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.139696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.139701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.139705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.139710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.139714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.139718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.139722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.139727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.139731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.139740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.139749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.139757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.139763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.139769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.139775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.139781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.139786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.139791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.139795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.139799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.139805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.139810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.139815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.139820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.139825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.139831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.139845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.139850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.139854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.139859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.139865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.139869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.139879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.139884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.139890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.139934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:44.142572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:44.142913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:44.142927Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:44.142930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:44.142934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:44.142941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2110 [2:7559602021176420135:3464]
2025-10-10T14:36:44.142955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:44.142975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:44.142982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.142987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.142990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.143019Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:44.143032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:44.143042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:44.143110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.143119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.143121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.143124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:44.143198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:44.143201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.143214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.143230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.143256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:44.143283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602021176420130:3464]
2025-10-10T14:36:44.143290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602021176420130:3464]
2025-10-10T14:36:44.143293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602021176420130:3464]
2025-10-10T14:36:44.143305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:44.143314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:44.143321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650472:2702], now have 1 active actors on pipe
2025-10-10T14:36:44.143325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650286:2438], now have 1 active actors on pipe
2025-10-10T14:36:44.143326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:44.143329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:44.143333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:44.143350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:44.143353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:44.143389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2110
2025-10-10T14:36:44.143427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2110
2025-10-10T14:36:44.143377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602021176420130:3464]
2025-10-10T14:36:44.143391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:44.143430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:44.143696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.143713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.143748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:44.143762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.143769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.143771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:44.143782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.143795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:44.143812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.144008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.144021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.144044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.144172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2111 partition: 0 MaxSeqNo: 40 sessionId: src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0
2025-10-10T14:36:44.144610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8daeefa4-4d48061c-70cae44c-46ae3be5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:44.147461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0] Write session: try to update token
2025-10-10T14:36:44.147484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:44.162938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:44.162961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:44.162965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:44.162967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:44.162978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602021176420130:3464]
2025-10-10T14:36:44.162983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602021176420130:3464]
2025-10-10T14:36:44.162987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602021176420130:3464]
2025-10-10T14:36:44.163039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:44.163044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:44.163047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.163050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:44.163051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:44.163055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:44.163207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:44.164992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId: src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:44.167670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:44.218588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602021958650486:2605]
2025-10-10T14:36:44.218959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2110, pipe: [1:7559602021958650486:2605]
2025-10-10T14:36:44.281091Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:44.281600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.281623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.281673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650486:2605], now have 1 active actors on pipe
2025-10-10T14:36:44.282055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602021958650486:2605]
2025-10-10T14:36:44.282108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:44.282112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:44.282194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2111 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0
2025-10-10T14:36:44.281926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:44.282413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2111 sessionId: src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0 is DEAD
2025-10-10T14:36:44.282582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:44.282594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0] Write session will restart in 0.009290s
2025-10-10T14:36:44.282620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0] Write session: Do CDS request
2025-10-10T14:36:44.282627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:44.292929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.293064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:44.293091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2112
2025-10-10T14:36:44.293225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.293266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:44.293280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:44.293285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:44.293782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2112 sessionId:  describe result for acl check
2025-10-10T14:36:44.293828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:44.293831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:44.293833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:44.293841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602021958650516:2715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:44.294458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602021958650516:2715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:44.301612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602021958650516:2715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:44.303579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:44.306510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602021958650516:2715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:44.306528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602021958650516:2715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:44.306532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602021958650516:2715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:44.306541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:44.306298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:44.306553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:44.306559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:44.306575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:44.306643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:44.306688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602021176420332:3458]
2025-10-10T14:36:44.307310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:44.307616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:44.307665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:44.308000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:44.308092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.308099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.308100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.308102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.308103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.308104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.308105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.308106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.308108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.308109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.308111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.308112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.308113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.308120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.308134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.308138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.308142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.308146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.308149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.308153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.308157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.308160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.308164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.308168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.308172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.308175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.308183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.308191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.308198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.308204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.308208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.308214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.308218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.308223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.308228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.308245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.308251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.308257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.308270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.308274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.308278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.308283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.308288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.308293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.308298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.308303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.308310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.308315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.308319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.308325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.308329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.308334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.308375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:44.310779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:44.311108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:44.311120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:44.311123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:44.311126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:44.311132Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2111 [2:7559602021176420332:3458]
2025-10-10T14:36:44.311141Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:44.311155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:44.311157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.311159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.311162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.311179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:44.311188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:44.311203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:44.311251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.311256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.311258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.311260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:44.311324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:44.311333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.311343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.311353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.311369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:44.311390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650488:2438], now have 1 active actors on pipe
2025-10-10T14:36:44.311399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650678:2715], now have 1 active actors on pipe
2025-10-10T14:36:44.311405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602021176420327:3458]
2025-10-10T14:36:44.311407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602021176420327:3458]
2025-10-10T14:36:44.311409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602021176420327:3458]
2025-10-10T14:36:44.311422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:44.311441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:44.311441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:44.311444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:44.311447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:44.311463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:44.311465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:44.311487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602021176420327:3458]
2025-10-10T14:36:44.311499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:44.311501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:44.311465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2111
2025-10-10T14:36:44.311478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2111
2025-10-10T14:36:44.311526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.311535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.311572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9aea0919-9c38182b-184bfca7-cced5a58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:44.311585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.311594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.311597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:44.311608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.311622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:44.311649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.311783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.311798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.311822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.311933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2112 partition: 0 MaxSeqNo: 40 sessionId: src_id|9aea0919-9c38182b-184bfca7-cced5a58_0
2025-10-10T14:36:44.312324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34279cf5-826a827a-8ee0766a-8d2cc738_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9aea0919-9c38182b-184bfca7-cced5a58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:44.315140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aea0919-9c38182b-184bfca7-cced5a58_0] Write session: try to update token
2025-10-10T14:36:44.315160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aea0919-9c38182b-184bfca7-cced5a58_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:44.331871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:44.331899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:44.331903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:44.331906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:44.331917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602021176420327:3458]
2025-10-10T14:36:44.331923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602021176420327:3458]
2025-10-10T14:36:44.331927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602021176420327:3458]
2025-10-10T14:36:44.331984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:44.331993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.331996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:44.331995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:44.332002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:44.332006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:44.332159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:44.332723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId: src_id|9aea0919-9c38182b-184bfca7-cced5a58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:44.335415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:44.382448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602021958650689:2605]
2025-10-10T14:36:44.382795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2111, pipe: [1:7559602021958650689:2605]
2025-10-10T14:36:44.448106Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:44.448843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.448859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.448910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650689:2605], now have 1 active actors on pipe
2025-10-10T14:36:44.449255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:44.449310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:44.449312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:44.449389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2112 reason: error at write: Disconnected sessionId: src_id|9aea0919-9c38182b-184bfca7-cced5a58_0
2025-10-10T14:36:44.449392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602021958650689:2605]
2025-10-10T14:36:44.449588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2112 sessionId: src_id|9aea0919-9c38182b-184bfca7-cced5a58_0 is DEAD
2025-10-10T14:36:44.449285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:44.449928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aea0919-9c38182b-184bfca7-cced5a58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:44.449936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aea0919-9c38182b-184bfca7-cced5a58_0] Write session will restart in 0.005598s
2025-10-10T14:36:44.449961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aea0919-9c38182b-184bfca7-cced5a58_0] Write session: Do CDS request
2025-10-10T14:36:44.449968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aea0919-9c38182b-184bfca7-cced5a58_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:44.458523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aea0919-9c38182b-184bfca7-cced5a58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.458800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:44.458817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2113
2025-10-10T14:36:44.459002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.459052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:44.459063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:44.459068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:44.459802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2113 sessionId:  describe result for acl check
2025-10-10T14:36:44.459843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:44.459850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:44.459852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:44.459859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602021958650744:2718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:44.460345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602021958650744:2718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:44.463206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602021958650744:2718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:44.466473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:44.468940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:44.469260Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:44.469274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:44.469289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:44.469386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:44.469436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602021176420531:3460]
2025-10-10T14:36:44.470031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:44.470378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:44.470372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602021958650744:2718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:44.470390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602021958650744:2718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:44.470394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602021958650744:2718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:44.470403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:44.470429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:44.470734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:44.470790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.470797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.470798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.470799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.470800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.470801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.470802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.470804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.470805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.470806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.470807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.470808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.470809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.470815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.470828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.470832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.470836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.470839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.470843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.470846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.470850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.470853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.470857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.470861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.470864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.470868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.470875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.470883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.470889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.470894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.470899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.470903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.470907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.470912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.470916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.470921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.470925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.470930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.470934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.470939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.470943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.470947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.470951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.470956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.470961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.470965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.470972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.470977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.470981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.470985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.470989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.470994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.471028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:44.473574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:44.474135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:44.474147Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:44.474148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:44.474152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:44.474160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2112 [2:7559602021176420531:3460]
2025-10-10T14:36:44.474172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:44.474189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:44.474192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.474196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.474198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.474216Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:44.474229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:44.474236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:44.474294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.474306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.474308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.474310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:44.474393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:44.474402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.474412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.474423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.474438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:44.474485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2112
2025-10-10T14:36:44.474546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2112
2025-10-10T14:36:44.474462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650691:2438], now have 1 active actors on pipe
2025-10-10T14:36:44.474475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602021176420526:3460]
2025-10-10T14:36:44.474477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602021176420526:3460]
2025-10-10T14:36:44.474480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602021176420526:3460]
2025-10-10T14:36:44.474488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:44.474501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:44.474502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:44.474505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:44.474507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:44.474516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:44.474519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:44.474526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650884:2718], now have 1 active actors on pipe
2025-10-10T14:36:44.474553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602021176420526:3460]
2025-10-10T14:36:44.474560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:44.474567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:44.474733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.474743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.474771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:44.474779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.474782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.474785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:44.474795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.474805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:44.474818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.475021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.475036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.475059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.475190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2113 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0
2025-10-10T14:36:44.475586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aea0919-9c38182b-184bfca7-cced5a58_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:44.478458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0] Write session: try to update token
2025-10-10T14:36:44.478476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:44.493062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId: src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:44.494640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:44.494659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:44.494662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:44.494664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:44.494673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602021176420526:3460]
2025-10-10T14:36:44.494680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602021176420526:3460]
2025-10-10T14:36:44.494684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602021176420526:3460]
2025-10-10T14:36:44.494739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:44.494742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:44.494748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:44.494752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.494753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:44.494754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:44.494896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:44.495732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:44.549343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602021958650895:2605]
2025-10-10T14:36:44.549692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2112, pipe: [1:7559602021958650895:2605]
2025-10-10T14:36:44.608815Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:44.609127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.609137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.609179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650895:2605], now have 1 active actors on pipe
2025-10-10T14:36:44.609629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:44.609662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:44.609728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2113 reason: error at write: Disconnected sessionId: src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0
2025-10-10T14:36:44.609939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2113 sessionId: src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0 is DEAD
2025-10-10T14:36:44.610112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:44.610122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0] Write session will restart in 0.005376s
2025-10-10T14:36:44.610149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0] Write session: Do CDS request
2025-10-10T14:36:44.610156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:44.610134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:44.610177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602021958650895:2605]
2025-10-10T14:36:44.610565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:44.616941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.617001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:44.617019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2114
2025-10-10T14:36:44.617208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.617258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:44.617268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:44.617273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:44.617710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2114 sessionId:  describe result for acl check
2025-10-10T14:36:44.617750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:44.617757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:44.617759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:44.617766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602021958650919:2735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:44.618357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602021958650919:2735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:44.620703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602021958650919:2735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:44.624197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602021958650919:2735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:44.624215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602021958650919:2735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:44.624218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602021958650919:2735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:44.624239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:44.638046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:44.640932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:44.641160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:44.641173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:44.641187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:44.641245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:44.641298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602021176420759:3442]
2025-10-10T14:36:44.641969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:44.642300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:44.642355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:44.642691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:44.642750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.642760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.642761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.642762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.642763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.642765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.642766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.642768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.642769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.642770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.642771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.642773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.642774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.642781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.642793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.642799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.642805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.642809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.642813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.642817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.642822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.642826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.642830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.642834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.642839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.642843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.642850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.642860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.642867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.642873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.642878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.642883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.642888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.642893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.642900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.642905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.642909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.642915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.642920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.642926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.642930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.642936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.642941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.642947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.642952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.642959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.642964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.642970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.642974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.642980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.642985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.642991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.643033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:44.645512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:44.646069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:44.646085Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:44.646088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:44.646091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:44.646098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2113 [2:7559602021176420759:3442]
2025-10-10T14:36:44.646112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:44.646130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:44.646138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.646144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.646146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.646162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:44.646175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:44.646184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:44.646249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.646257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.646260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.646262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:44.646329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:44.646337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.646350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.646368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.646390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:44.646418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650951:2735], now have 1 active actors on pipe
2025-10-10T14:36:44.646427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958650912:2438], now have 1 active actors on pipe
2025-10-10T14:36:44.646437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602021176420748:3442]
2025-10-10T14:36:44.646439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602021176420748:3442]
2025-10-10T14:36:44.646441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602021176420748:3442]
2025-10-10T14:36:44.646454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:44.646468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:44.646472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:44.646478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:44.646481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:44.646489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:44.646493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:44.646520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602021176420748:3442]
2025-10-10T14:36:44.646532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:44.646537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:44.646626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2113
2025-10-10T14:36:44.646656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2113
2025-10-10T14:36:44.646711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.646725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.646764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:44.646776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.646780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.646783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:44.646794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.646807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:44.646823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.647031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.647038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.647053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.647181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2114 partition: 0 MaxSeqNo: 40 sessionId: src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0
2025-10-10T14:36:44.647591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e9b89a-345ac939-b5f1e689-989f2be0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:44.650208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0] Write session: try to update token
2025-10-10T14:36:44.650227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:44.667931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId: src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:44.668931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:44.668958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:44.668962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:44.668965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:44.668974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602021176420748:3442]
2025-10-10T14:36:44.668979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602021176420748:3442]
2025-10-10T14:36:44.668983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602021176420748:3442]
2025-10-10T14:36:44.669038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:44.669052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.669055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:44.669193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:44.670676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:44.673770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:44.673789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:44.673794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:44.710123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602021958651129:2605]
2025-10-10T14:36:44.712561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2113, pipe: [1:7559602021958651129:2605]
2025-10-10T14:36:44.791626Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:44.791922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.791939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.791985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958651129:2605], now have 1 active actors on pipe
2025-10-10T14:36:44.792248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:44.792248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:44.792254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:44.792304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602021958651129:2605]
2025-10-10T14:36:44.792756Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:44.793178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2114 reason: error at write: Disconnected sessionId: src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0
2025-10-10T14:36:44.793392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2114 sessionId: src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0 is DEAD
2025-10-10T14:36:44.793530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:44.793551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0] Write session will restart in 0.009250s
2025-10-10T14:36:44.793576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0] Write session: Do CDS request
2025-10-10T14:36:44.793585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:44.803828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.803915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:44.803933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2115
2025-10-10T14:36:44.804041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.804088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:44.804103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:44.804106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:44.804577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2115 sessionId:  describe result for acl check
2025-10-10T14:36:44.804621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:44.804630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:44.804632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:44.804639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602021958651243:2743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:44.805213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602021958651243:2743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:44.807647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602021958651243:2743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:44.808735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:44.811046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:44.811286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:44.811298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:44.811312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:44.811380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:44.811359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602021958651243:2743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:44.811381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602021958651243:2743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:44.811385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602021958651243:2743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:44.811393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:44.811423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602021176420971:3434]
2025-10-10T14:36:44.811932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:44.812245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:44.812293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:44.812628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:44.812684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.812690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.812691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.812692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.812694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.812695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.812696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.812698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.812699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.812700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.812702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.812703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.812704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.812710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.812723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.812727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.812732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.812736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.812740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.812744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.812748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.812752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.812756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.812760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.812764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.812767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.812774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.812782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.812789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.812795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.812799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.812804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.812809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.812814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.812819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.812824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.812829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.812834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.812839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.812844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.812849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.812854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.812859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.812865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.812869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.812881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.812888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.812898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.812903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.812916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.812920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.812925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.812968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:44.815398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:44.815989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:44.816004Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:44.816006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:44.816010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:44.816018Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2114 [2:7559602021176420971:3434]
2025-10-10T14:36:44.816030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:44.816047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:44.816050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.816054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.816056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.816073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:44.816086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:44.816098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:44.816159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.816169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.816171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.816174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:44.816254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:44.816263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.816276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.816287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.816311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:44.816337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958651140:2438], now have 1 active actors on pipe
2025-10-10T14:36:44.816345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958651333:2743], now have 1 active actors on pipe
2025-10-10T14:36:44.816352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602021176420966:3434]
2025-10-10T14:36:44.816360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602021176420966:3434]
2025-10-10T14:36:44.816363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602021176420966:3434]
2025-10-10T14:36:44.816340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2114
2025-10-10T14:36:44.816356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2114
2025-10-10T14:36:44.816377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:44.816392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:44.816395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:44.816397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:44.816401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:44.816417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:44.816421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:44.816460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.816465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.816479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602021176420966:3434]
2025-10-10T14:36:44.816487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:44.816511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:44.816521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:44.816529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.816533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.816536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:44.816549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.816559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:44.816580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.816723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.816732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.816749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.816820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2115 partition: 0 MaxSeqNo: 40 sessionId: src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0
2025-10-10T14:36:44.817226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b645222a-7936e2ce-d657018f-e7ff7f00_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:44.819907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0] Write session: try to update token
2025-10-10T14:36:44.819926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:44.834501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId: src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:44.837200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:44.839160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.839186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.839213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:44.839216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:44.839220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:44.839222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:44.839231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602021176420966:3434]
2025-10-10T14:36:44.839235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602021176420966:3434]
2025-10-10T14:36:44.839238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602021176420966:3434]
2025-10-10T14:36:44.839283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:44.839299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:44.839299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:44.839303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:44.839306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.839308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:44.839438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:44.892363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602021958651344:2605]
2025-10-10T14:36:44.892659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2114, pipe: [1:7559602021958651344:2605]
2025-10-10T14:36:44.954835Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:44.955100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:44.955159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958651344:2605], now have 1 active actors on pipe
2025-10-10T14:36:44.955246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:44.955312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602021958651344:2605]
2025-10-10T14:36:44.955339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:44.968963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:44.968569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:44.968584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:44.968612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2115 reason: error at write: Disconnected sessionId: src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0
2025-10-10T14:36:44.968783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2115 sessionId: src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0 is DEAD
2025-10-10T14:36:44.968991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0] Write session will restart in 0.008909s
2025-10-10T14:36:44.969067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0] Write session: Do CDS request
2025-10-10T14:36:44.969074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:44.978950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.979002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:44.979021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2116
2025-10-10T14:36:44.979210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:44.979258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:44.979270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:44.979274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:44.979357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:44.979720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2116 sessionId:  describe result for acl check
2025-10-10T14:36:44.979766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:44.979775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:44.979777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:44.979784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602021958651514:2757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:44.980483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602021958651514:2757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:44.981853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:44.982080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:44.982085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:44.982099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:44.982157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:44.982197Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602021176421173:3428]
2025-10-10T14:36:44.982760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:44.983087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:44.983175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:44.983089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602021958651514:2757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:44.983546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:44.983753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.983762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.983763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.983764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.983766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.983768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.983769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.983770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.983772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.983773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.983774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.983775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.983776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.983784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.983797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.983801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.983806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.983810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.983815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.983819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.983823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.983827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.983832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.983836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.983840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.983845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.983854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.983864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:44.983871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.983878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:44.983883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.983888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:44.983893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.983899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:44.983903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.983909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:44.983914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.983920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:44.983926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.983931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:44.983948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.983960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:44.983964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.983971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:44.983975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.983987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:44.983992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.984001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.984005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.984010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.984014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.984019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.984072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:44.987290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:44.987298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602021958651514:2757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:44.987314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602021958651514:2757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:44.987317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602021958651514:2757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:44.987326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:44.987710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:44.987730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:44.987733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:44.987737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:44.987743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2115 [2:7559602021176421173:3428]
2025-10-10T14:36:44.987756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:44.987773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:44.987777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.987781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.987784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.987800Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:44.987812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:44.987820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:44.987887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.987895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.987897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.987900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:44.987974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:44.987982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:44.987994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:44.988013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:44.988031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:44.988060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958651349:2438], now have 1 active actors on pipe
2025-10-10T14:36:44.988068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602021958651543:2757], now have 1 active actors on pipe
2025-10-10T14:36:44.988075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602021176421168:3428]
2025-10-10T14:36:44.988077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602021176421168:3428]
2025-10-10T14:36:44.988079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602021176421168:3428]
2025-10-10T14:36:44.988070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2115
2025-10-10T14:36:44.988093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:44.988109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:44.988128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:44.988070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2115
2025-10-10T14:36:44.988128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:44.988131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:44.988132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:44.988134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:44.988174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.988184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.988199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602021176421168:3428]
2025-10-10T14:36:44.988212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:44.988235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:44.988263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:44.988277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:44.988281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:44.988284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:44.988295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:44.988311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:44.988340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.989916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2116 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0
2025-10-10T14:36:44.990435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd0c71-ac06d056-f1ac03c8-20b3c5dd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:44.989745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:44.989761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:44.989785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:44.993653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0] Write session: try to update token
2025-10-10T14:36:44.993670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:45.008604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:45.008624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:45.008628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:45.008630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:45.008641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602021176421168:3428]
2025-10-10T14:36:45.008645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602021176421168:3428]
2025-10-10T14:36:45.008649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602021176421168:3428]
2025-10-10T14:36:45.008703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:45.008720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.008723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:45.008866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:45.011636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId: src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:45.014457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:45.013462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:45.013484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:45.013489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:45.055684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602026253618859:2605]
2025-10-10T14:36:45.056073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2115, pipe: [1:7559602026253618859:2605]
2025-10-10T14:36:45.136144Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:45.136647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.136672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.136728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253618859:2605], now have 1 active actors on pipe
2025-10-10T14:36:45.136963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:45.137117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602026253618859:2605]
2025-10-10T14:36:45.137172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:45.137255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2116 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0
2025-10-10T14:36:45.137491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2116 sessionId: src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0 is DEAD
2025-10-10T14:36:45.137604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:45.137652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:45.137665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0] Write session will restart in 0.008715s
2025-10-10T14:36:45.137702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0] Write session: Do CDS request
2025-10-10T14:36:45.137709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:45.147988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.149944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:45.149964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2117
2025-10-10T14:36:45.150146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.150203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:45.150215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:45.150220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:45.150840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2117 sessionId:  describe result for acl check
2025-10-10T14:36:45.150883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:45.150890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:45.150893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:45.150902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602026253618952:2752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:45.151461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602026253618952:2752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:45.155385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602026253618952:2752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:45.157350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:45.160442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:45.160693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:45.160709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:45.160723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:45.160794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:45.160841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602025471388686:3430]
2025-10-10T14:36:45.160655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602026253618952:2752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:45.160674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602026253618952:2752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:45.160678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602026253618952:2752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:45.160688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:45.161524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:45.161898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:45.161965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:45.162350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:45.162411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.162412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.162413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.162414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.162416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.162417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.162418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.162419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.162421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.162422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.162423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.162425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.162426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.162432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.162445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.162450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.162454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.162458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.162463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.162467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.162471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.162474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.162478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.162481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.162485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.162489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.162498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.162506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.162514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.162519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.162524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.162529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.162534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.162540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.162545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.162550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.162554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.162560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.162565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.162570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.162574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.162580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.162585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.162592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.162596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.162601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.162606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.162611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.162615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.162621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.162627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.162632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.162673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:45.165368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:45.166086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:45.166102Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:45.166106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:45.166110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:45.166117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2116 [2:7559602025471388686:3430]
2025-10-10T14:36:45.166131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:45.166149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:45.166152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.166156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.166159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.166178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:45.166191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:45.166200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:45.166265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.166274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.166277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.166280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:45.166350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:45.166361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.166375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.166393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.166412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:45.166443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253618865:2438], now have 1 active actors on pipe
2025-10-10T14:36:45.166453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619061:2752], now have 1 active actors on pipe
2025-10-10T14:36:45.166461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602025471388681:3430]
2025-10-10T14:36:45.166464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602025471388681:3430]
2025-10-10T14:36:45.166466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602025471388681:3430]
2025-10-10T14:36:45.166483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:45.166499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:45.166530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:45.166540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:45.166571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602025471388681:3430]
2025-10-10T14:36:45.166580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:45.166564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2116
2025-10-10T14:36:45.166571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2116
2025-10-10T14:36:45.166617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:45.166633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:45.166636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:45.166643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:45.166759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.166765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.166797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|431093f6-38267ae3-80a64211-dedb0424_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:45.166805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.166809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.166812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:45.166824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.166835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:45.166853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.167015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.167031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.167056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.167177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2117 partition: 0 MaxSeqNo: 40 sessionId: src_id|431093f6-38267ae3-80a64211-dedb0424_0
2025-10-10T14:36:45.167616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa250511-5aa9dbd9-d64b5bb2-68f4de3f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|431093f6-38267ae3-80a64211-dedb0424_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:45.170624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431093f6-38267ae3-80a64211-dedb0424_0] Write session: try to update token
2025-10-10T14:36:45.170644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431093f6-38267ae3-80a64211-dedb0424_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:45.178585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:45.178610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:45.178621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602025471388681:3430]
2025-10-10T14:36:45.178675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:45.178680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:45.178855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:45.179002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:45.179146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:45.179291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:45.179513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:45.179561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:45.186130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId: src_id|431093f6-38267ae3-80a64211-dedb0424_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:45.188821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:45.189034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.189069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.189117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:45.189200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:45.197305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:45.197321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:45.197324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:45.197326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:45.197356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602025471388681:3430]
2025-10-10T14:36:45.197360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602025471388681:3430]
2025-10-10T14:36:45.197364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602025471388681:3430]
2025-10-10T14:36:45.197410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:45.197414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:45.197421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.197422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:45.197424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:45.197426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:45.197562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:45.237419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602026253619072:2605]
2025-10-10T14:36:45.237755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2116, pipe: [1:7559602026253619072:2605]
2025-10-10T14:36:45.315093Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:45.323887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.323916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.324104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.324170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.324259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.324331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.324511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.324521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.324593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.324663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.324726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.324798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.324852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.324859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.324928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.324998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.325077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.325143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.325189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.325196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.325281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.325388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.325451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.325522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.325569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.325577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.325653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.325721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.325795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.325864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.325913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.325920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.328345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:45.328409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602026253619072:2605]
2025-10-10T14:36:45.328437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:45.328439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:45.328481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2117 reason: error at write: Disconnected sessionId: src_id|431093f6-38267ae3-80a64211-dedb0424_0
2025-10-10T14:36:45.325994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.326058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.326124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.326188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.326230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.326233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.326305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.326368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.326438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.326505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.326546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.326549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.326619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.326677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.329137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431093f6-38267ae3-80a64211-dedb0424_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:45.326737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.329151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431093f6-38267ae3-80a64211-dedb0424_0] Write session will restart in 0.007597s
2025-10-10T14:36:45.326808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.326856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.328911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2117 sessionId: src_id|431093f6-38267ae3-80a64211-dedb0424_0 is DEAD
2025-10-10T14:36:45.326858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.326929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.326993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.327053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.327115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.327157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.327159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.327241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.327307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.327375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.327439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.327481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.327483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.327567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619072:2605], now have 1 active actors on pipe
2025-10-10T14:36:45.328722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:45.329176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431093f6-38267ae3-80a64211-dedb0424_0] Write session: Do CDS request
2025-10-10T14:36:45.329247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431093f6-38267ae3-80a64211-dedb0424_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:45.337947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|431093f6-38267ae3-80a64211-dedb0424_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.338868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:45.338886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2118
2025-10-10T14:36:45.339050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.339088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:45.339095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:45.339099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:45.339801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2118 sessionId:  describe result for acl check
2025-10-10T14:36:45.339841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:45.339843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:45.339845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:45.339853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602026253619113:2772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:45.340637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602026253619113:2772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:45.344283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602026253619113:2772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:45.347653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:45.347737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602026253619113:2772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:45.347753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602026253619113:2772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:45.347757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602026253619113:2772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:45.347766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:45.351282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:45.351671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:45.351677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:45.351692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:45.351759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:45.351799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602025471388891:3422]
2025-10-10T14:36:45.352391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:45.352922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:45.353003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:45.353398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:45.353478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.353480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.353481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.353482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.353484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.353485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.353487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.353489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.353491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.353492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.353493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.353494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.353496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.353502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.353516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.353520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.353524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.353529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.353533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.353538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.353542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.353546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.353557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.353565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.353578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.353583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.353593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.353606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.353613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.353623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.353629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.353634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.353641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.353645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.353650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.353655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.353659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.353665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.353670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.353678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.353687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.353692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.353697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.353707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.353712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.353717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.353726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.353732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.353736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.353742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.353752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.353757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.353798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:45.358030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:45.358401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:45.358416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:45.358420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:45.358424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:45.358433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2117 [2:7559602025471388891:3422]
2025-10-10T14:36:45.358472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:45.358499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:45.358509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.358513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.358516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.358537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:45.358546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:45.358555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:45.358628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.358638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.358640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.358644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:45.358725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:45.358733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.358749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.358764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.358789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:45.358817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602025471388885:3422]
2025-10-10T14:36:45.358824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602025471388885:3422]
2025-10-10T14:36:45.358826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602025471388885:3422]
2025-10-10T14:36:45.358842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:45.358863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:45.358886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:45.358890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:45.358906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:45.358915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:45.358917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:45.358933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602025471388885:3422]
2025-10-10T14:36:45.358942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:45.358984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:45.359179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619270:2772], now have 1 active actors on pipe
2025-10-10T14:36:45.359187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619075:2438], now have 1 active actors on pipe
2025-10-10T14:36:45.359409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2117
2025-10-10T14:36:45.359459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2117
2025-10-10T14:36:45.359500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.359511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.359546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de65a149-c276181c-8a359eed-efc5f243_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:45.359555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.359560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.359562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:45.359583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.359598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:45.359617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.359861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.359867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.359890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.359979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2118 partition: 0 MaxSeqNo: 40 sessionId: src_id|de65a149-c276181c-8a359eed-efc5f243_0
2025-10-10T14:36:45.360444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|431093f6-38267ae3-80a64211-dedb0424_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|de65a149-c276181c-8a359eed-efc5f243_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:45.363264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de65a149-c276181c-8a359eed-efc5f243_0] Write session: try to update token
2025-10-10T14:36:45.363286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de65a149-c276181c-8a359eed-efc5f243_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:45.379380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId: src_id|de65a149-c276181c-8a359eed-efc5f243_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:45.382865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:45.381563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:45.381587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:45.381591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:45.381593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:45.381627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602025471388885:3422]
2025-10-10T14:36:45.381634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602025471388885:3422]
2025-10-10T14:36:45.381639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602025471388885:3422]
2025-10-10T14:36:45.381703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:45.381713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.381715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:45.381927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:45.383039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:45.383047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:45.383052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:45.428842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602026253619282:2605]
2025-10-10T14:36:45.429121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2117, pipe: [1:7559602026253619282:2605]
2025-10-10T14:36:45.510292Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:45.510591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.510606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.510653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619282:2605], now have 1 active actors on pipe
2025-10-10T14:36:45.511895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602026253619282:2605]
2025-10-10T14:36:45.511931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:45.511934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:45.512008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2118 reason: error at write: Disconnected sessionId: src_id|de65a149-c276181c-8a359eed-efc5f243_0
2025-10-10T14:36:45.511859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:45.512213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2118 sessionId: src_id|de65a149-c276181c-8a359eed-efc5f243_0 is DEAD
2025-10-10T14:36:45.512347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:45.512362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65a149-c276181c-8a359eed-efc5f243_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:45.512376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65a149-c276181c-8a359eed-efc5f243_0] Write session will restart in 0.009566s
2025-10-10T14:36:45.512402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65a149-c276181c-8a359eed-efc5f243_0] Write session: Do CDS request
2025-10-10T14:36:45.512425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65a149-c276181c-8a359eed-efc5f243_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:45.522995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de65a149-c276181c-8a359eed-efc5f243_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.523041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:45.523060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2119
2025-10-10T14:36:45.523249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.523291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:45.523306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:45.523314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:45.523804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2119 sessionId:  describe result for acl check
2025-10-10T14:36:45.523842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:45.523848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:45.523852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:45.523859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602026253619340:2775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:45.524444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602026253619340:2775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:45.527356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602026253619340:2775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:45.530703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602026253619340:2775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:45.530723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602026253619340:2775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:45.530727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602026253619340:2775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:45.530737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:45.532198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:45.535392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:45.535649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:45.535663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:45.535677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:45.535747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:45.535805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602025471389097:3420]
2025-10-10T14:36:45.536475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:45.536847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:45.536900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:45.537247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:45.537351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.537352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.537353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.537354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.537355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.537357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.537358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.537360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.537361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.537362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.537363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.537364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.537365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.537372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.537387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.537392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.537397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.537402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.537407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.537411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.537415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.537419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.537423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.537428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.537432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.537436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.537447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.537456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.537463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.537469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.537475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.537481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.537486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.537492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.537497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.537503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.537508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.537513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.537518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.537524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.537529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.537535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.537539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.537545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.537553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.537558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.537582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.537588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.537594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.537600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.537605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.537612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.537661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:45.540310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:45.540892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:45.540913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:45.540915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:45.540919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:45.540926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2118 [2:7559602025471389097:3420]
2025-10-10T14:36:45.540942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:45.540961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:45.540970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.540974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.540977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.540996Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:45.541004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:45.541012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:45.541086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.541096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.541098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.541101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:45.541175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:45.541183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.541196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.541214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.541242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:45.541272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619479:2775], now have 1 active actors on pipe
2025-10-10T14:36:45.541282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619285:2438], now have 1 active actors on pipe
2025-10-10T14:36:45.541291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602025471389092:3420]
2025-10-10T14:36:45.541294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602025471389092:3420]
2025-10-10T14:36:45.541296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602025471389092:3420]
2025-10-10T14:36:45.541311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:45.541326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:45.541346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:45.541351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:45.541353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:45.541369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:45.541373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:45.541402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602025471389092:3420]
2025-10-10T14:36:45.541366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2118
2025-10-10T14:36:45.541412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:45.541418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:45.541459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.541464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.541422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2118
2025-10-10T14:36:45.541501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:45.541516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.541520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.541529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:45.541542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.541559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:45.541579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.541752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.541764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.541784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.541935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2119 partition: 0 MaxSeqNo: 40 sessionId: src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0
2025-10-10T14:36:45.542360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65a149-c276181c-8a359eed-efc5f243_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:45.545225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0] Write session: try to update token
2025-10-10T14:36:45.545245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:45.561645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:45.561665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:45.561669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:45.561671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:45.561682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602025471389092:3420]
2025-10-10T14:36:45.561687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602025471389092:3420]
2025-10-10T14:36:45.561698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602025471389092:3420]
2025-10-10T14:36:45.561757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:45.561764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.561772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:45.561771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:45.561778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:45.561782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:45.561978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:45.562667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId: src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:45.565615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:45.612272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602026253619493:2605]
2025-10-10T14:36:45.612642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2118, pipe: [1:7559602026253619493:2605]
2025-10-10T14:36:45.680055Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:45.680624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.680634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.680680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619493:2605], now have 1 active actors on pipe
2025-10-10T14:36:45.681020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:45.680951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602026253619493:2605]
2025-10-10T14:36:45.681000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:45.681003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:45.681061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2119 reason: error at write: Disconnected sessionId: src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0
2025-10-10T14:36:45.681261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2119 sessionId: src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0 is DEAD
2025-10-10T14:36:45.681452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:45.681734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:45.681744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0] Write session will restart in 0.006093s
2025-10-10T14:36:45.681769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0] Write session: Do CDS request
2025-10-10T14:36:45.681774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:45.688911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.688993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:45.689008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2120
2025-10-10T14:36:45.689130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.689165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:45.689175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:45.689179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:45.689707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2120 sessionId:  describe result for acl check
2025-10-10T14:36:45.689742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:45.689743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:45.689744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:45.689749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602026253619536:2807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:45.690263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602026253619536:2807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:45.693495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602026253619536:2807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:45.697133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602026253619536:2807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:45.697148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602026253619536:2807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:45.697152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602026253619536:2807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:45.697161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:45.701274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:45.701874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:45.702086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:45.702097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:45.702110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:45.702167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:45.702223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602025471389340:3403]
2025-10-10T14:36:45.702834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:45.703155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:45.703205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:45.703460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:45.703524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.703530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.703531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.703532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.703533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.703533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.703534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.703535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.703536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.703537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.703537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.703538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.703539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.703543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.703552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.703554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.703556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.703558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.703560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.703563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.703565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.703567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.703569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.703572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.703574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.703576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.703582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.703589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.703593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.703597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.703600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.703603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.703605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.703608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.703611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.703614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.703617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.703620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.703624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.703629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.703634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.703638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.703642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.703647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.703651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.703657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.703661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.703666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.703671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.703676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.703681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.703697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.703738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:45.706295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:45.706633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:45.706644Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:45.706647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:45.706651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:45.706658Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2119 [2:7559602025471389340:3403]
2025-10-10T14:36:45.706671Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:45.706697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:45.706700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.706705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.706707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.706725Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:45.706733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:45.706747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:45.706809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.706816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.706817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.706820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:45.707048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2119
2025-10-10T14:36:45.707064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2119
2025-10-10T14:36:45.707161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:45.707172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.707186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.707198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.707217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:45.707245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619508:2438], now have 1 active actors on pipe
2025-10-10T14:36:45.707254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619714:2807], now have 1 active actors on pipe
2025-10-10T14:36:45.707273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.707282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.707301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602025471389335:3403]
2025-10-10T14:36:45.707308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602025471389335:3403]
2025-10-10T14:36:45.707310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602025471389335:3403]
2025-10-10T14:36:45.707323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:45.707340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:45.707343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:45.707348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:45.707351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:45.707360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:45.707364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:45.707385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:45.707397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.707401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.707403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:45.707414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.707430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:45.707468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602025471389335:3403]
2025-10-10T14:36:45.707479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:45.707485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:45.707491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.707619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.707628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.707644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.707708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2120 partition: 0 MaxSeqNo: 40 sessionId: src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0
2025-10-10T14:36:45.708105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b2a09b-89358b88-1f94a82a-d75fcbd5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:45.710868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0] Write session: try to update token
2025-10-10T14:36:45.710890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:45.719115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:45.719132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:45.719144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602025471389335:3403]
2025-10-10T14:36:45.719193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:45.719195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:45.719386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:45.719537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:45.719679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:45.719825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:45.720019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:45.720065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:45.725278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId: src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:45.728070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:45.728744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.728776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.728845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:45.728968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:45.738122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:45.738139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:45.738143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:45.738145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:45.738157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602025471389335:3403]
2025-10-10T14:36:45.738162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602025471389335:3403]
2025-10-10T14:36:45.738167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602025471389335:3403]
2025-10-10T14:36:45.738219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:45.738219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:45.738226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:45.738227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.738229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:45.738230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:45.738389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:45.781212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602026253619736:2605]
2025-10-10T14:36:45.781547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2119, pipe: [1:7559602026253619736:2605]
2025-10-10T14:36:45.856051Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:45.864493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.864517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.864698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.864761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.864816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.864877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.864916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.864921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.864995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.865050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.865103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.865170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.865210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.865213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.865280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.865360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.865425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.865487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.865538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.865546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.865618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.865685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.865752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.865819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.865874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.865885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.865965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.866027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.866090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.866159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.866206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.866213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.866283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.866344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.866407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.866478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.866528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.866538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.866604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.866662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.866735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.866803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.866851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.866858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.866925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.866989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.867051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.867116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.867164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.867172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.867240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.867310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.867378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.867442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.867490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.867498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.867567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:45.867625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:45.867692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:45.867762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:45.867807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:45.867816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:45.867878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619736:2605], now have 1 active actors on pipe
2025-10-10T14:36:45.868134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:45.868143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:45.868151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:45.868187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2120 reason: error at write: Disconnected sessionId: src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0
2025-10-10T14:36:45.868192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602026253619736:2605]
2025-10-10T14:36:45.868429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2120 sessionId: src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0 is DEAD
2025-10-10T14:36:45.868599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:45.868611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0] Write session will restart in 0.008223s
2025-10-10T14:36:45.868637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0] Write session: Do CDS request
2025-10-10T14:36:45.868643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:45.869128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:45.878018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.878114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:45.878142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2121
2025-10-10T14:36:45.878307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:45.878353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:45.878360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:45.878364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:45.878855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2121 sessionId:  describe result for acl check
2025-10-10T14:36:45.878895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:45.878902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:45.878904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:45.878910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602026253619784:2816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:45.879490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602026253619784:2816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:45.883078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602026253619784:2816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:45.886364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:45.889150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:45.889461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:45.889476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:45.889491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:45.889561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:45.889613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602025471389545:3386]
2025-10-10T14:36:45.889437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602026253619784:2816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:45.889458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602026253619784:2816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:45.889462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602026253619784:2816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:45.889473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:45.890254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:45.890613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:45.890677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:45.891075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:45.891145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.891151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.891153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.891154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.891156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.891157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.891158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.891160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.891161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.891162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.891164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.891165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.891167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.891186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.891200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.891204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.891209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.891213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.891218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.891222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.891226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.891230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.891235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.891239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.891242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.891246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.891254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.891262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:45.891269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.891275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:45.891280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.891285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:45.891289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.891295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:45.891299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.891305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:45.891309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.891315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:45.891320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.891326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:45.891331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.891337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:45.891342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.891354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:45.891358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.891363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:45.891369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.891380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.891384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.891392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.891402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.891408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.891452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:45.894118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:45.894686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:45.894701Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:45.894704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:45.894708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:45.894715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2120 [2:7559602025471389545:3386]
2025-10-10T14:36:45.894730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:45.894749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:45.894759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.894762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.894765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.894782Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:45.894790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:45.894799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:45.894869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.894878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.894880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.894883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:45.894952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:45.894960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.894973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:45.894989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:45.895012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:45.895040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619739:2438], now have 1 active actors on pipe
2025-10-10T14:36:45.895049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619937:2816], now have 1 active actors on pipe
2025-10-10T14:36:45.895057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602025471389540:3386]
2025-10-10T14:36:45.895064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602025471389540:3386]
2025-10-10T14:36:45.895066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602025471389540:3386]
2025-10-10T14:36:45.895080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:45.895097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:45.895114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:45.895118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:45.895122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:45.895124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:45.895126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:45.895156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602025471389540:3386]
2025-10-10T14:36:45.895164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:45.895168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:45.895186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.895197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.895116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2120
2025-10-10T14:36:45.895133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2120
2025-10-10T14:36:45.895253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:45.895266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:45.895270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:45.895278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:45.895291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:45.895307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:45.895335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.895660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:45.895671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:45.895702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:45.895805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2121 partition: 0 MaxSeqNo: 40 sessionId: src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0
2025-10-10T14:36:45.896256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ba8167-42ad9c98-6cbdf08f-65225a6b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:45.899254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0] Write session: try to update token
2025-10-10T14:36:45.899282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:45.916321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId: src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:45.916669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:45.916696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:45.916705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:45.916707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:45.916725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602025471389540:3386]
2025-10-10T14:36:45.916734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602025471389540:3386]
2025-10-10T14:36:45.916739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602025471389540:3386]
2025-10-10T14:36:45.916811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:45.916829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:45.916832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:45.917022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:45.917271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:45.917284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:45.917291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:45.919853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:45.968601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602026253619950:2605]
2025-10-10T14:36:45.968964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2120, pipe: [1:7559602026253619950:2605]
2025-10-10T14:36:46.039058Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:46.039576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.039595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.039642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602026253619950:2605], now have 1 active actors on pipe
2025-10-10T14:36:46.039901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:46.039917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:46.039966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:46.039982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2121 reason: error at write: Disconnected sessionId: src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0
2025-10-10T14:36:46.040049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:46.040104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602026253619950:2605]
2025-10-10T14:36:46.040212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2121 sessionId: src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0 is DEAD
2025-10-10T14:36:46.040365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:46.040374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0] Write session will restart in 0.007422s
2025-10-10T14:36:46.040398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0] Write session: Do CDS request
2025-10-10T14:36:46.040417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:46.049010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.049108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:46.049126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2122
2025-10-10T14:36:46.049285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.049326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:46.049358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:46.049362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:46.050063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2122 sessionId:  describe result for acl check
2025-10-10T14:36:46.050109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:46.050117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:46.050119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:46.050127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602030548587295:2827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:46.050727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602030548587295:2827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:46.055806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602030548587295:2827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:46.059568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602030548587295:2827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:46.059585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602030548587295:2827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:46.059589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602030548587295:2827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:46.059598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:46.060984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:46.065246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:46.065546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:46.065559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:46.065574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:46.065651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:46.065709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602029766357063:3381]
2025-10-10T14:36:46.066368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:46.066877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:46.066940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:46.067280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:46.067345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.067351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.067353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.067354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.067355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.067357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.067358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.067360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.067362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.067364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.067365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.067366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.067367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.067374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.067389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.067394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.067398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.067402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.067407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.067411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.067415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.067419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.067425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.067439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.067443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.067446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.067457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.067466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.067473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.067480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.067492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.067497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.067513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.067517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.067525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.067531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.067536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.067541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.067547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.067553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.067558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.067563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.067568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.067573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.067578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.067583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.067588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.067593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.067598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.067603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.067609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.067615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.067659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:46.070763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:46.071120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:46.071134Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:46.071137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:46.071142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:46.071150Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2121 [2:7559602029766357063:3381]
2025-10-10T14:36:46.071165Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:46.071186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:46.071194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.071198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.071201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.071236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:46.071250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:46.071264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:46.071332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.071339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.071341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.071345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:46.071425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:46.071433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.071446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.071458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.071475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:46.071499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587458:2827], now have 1 active actors on pipe
2025-10-10T14:36:46.071509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587249:2438], now have 1 active actors on pipe
2025-10-10T14:36:46.071516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602029766357058:3381]
2025-10-10T14:36:46.071521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602029766357058:3381]
2025-10-10T14:36:46.071524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602029766357058:3381]
2025-10-10T14:36:46.071539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:46.071554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:46.071556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:46.071562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:46.071564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:46.071574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:46.071577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:46.071615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602029766357058:3381]
2025-10-10T14:36:46.071627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:46.071632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:46.071800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2121
2025-10-10T14:36:46.071841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2121
2025-10-10T14:36:46.071871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.071884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.071922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:46.071935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.071940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.071945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:46.071958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.071976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:46.071998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.072225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.072238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.072262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.072373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2122 partition: 0 MaxSeqNo: 40 sessionId: src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0
2025-10-10T14:36:46.072808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63fe6a97-b1ceecfe-f8dfca35-3025c524_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:46.075695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0] Write session: try to update token
2025-10-10T14:36:46.075719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:46.093063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:46.093085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:46.093089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:46.093091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:46.093101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602029766357058:3381]
2025-10-10T14:36:46.093112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602029766357058:3381]
2025-10-10T14:36:46.093118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602029766357058:3381]
2025-10-10T14:36:46.093172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:46.093181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.093188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:46.093188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:46.093196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:46.093201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:46.093363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:46.110716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId: src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:46.113423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:46.140108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602030548587472:2605]
2025-10-10T14:36:46.141351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2121, pipe: [1:7559602030548587472:2605]
2025-10-10T14:36:46.218126Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:46.218806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.218823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.218848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587472:2605], now have 1 active actors on pipe
2025-10-10T14:36:46.219077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:46.219070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:46.219087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:46.219105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602030548587472:2605]
2025-10-10T14:36:46.219130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:46.219150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2122 reason: error at write: Disconnected sessionId: src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0
2025-10-10T14:36:46.219355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2122 sessionId: src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0 is DEAD
2025-10-10T14:36:46.219737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:46.219749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0] Write session will restart in 0.008340s
2025-10-10T14:36:46.219786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0] Write session: Do CDS request
2025-10-10T14:36:46.219796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:46.228906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.229034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:46.229051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2123
2025-10-10T14:36:46.229754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.229798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:46.229804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:46.229808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:46.230290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2123 sessionId:  describe result for acl check
2025-10-10T14:36:46.230326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:46.230327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:46.230329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:46.230336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602030548587523:2832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:46.230892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602030548587523:2832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:46.233908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602030548587523:2832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:46.236644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:46.237025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602030548587523:2832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:46.237044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602030548587523:2832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:46.237049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602030548587523:2832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:46.237058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:46.240005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:46.240266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:46.240278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:46.240290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:46.240360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:46.240407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602029766357271:3378]
2025-10-10T14:36:46.241020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:46.241494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:46.241570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:46.241937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:46.242014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.242021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.242022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.242023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.242024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.242025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.242027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.242028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.242029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.242031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.242032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.242033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.242035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.242042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.242054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.242058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.242062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.242066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.242070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.242073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.242077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.242081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.242085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.242089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.242092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.242096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.242104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.242112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.242119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.242124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.242128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.242133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.242137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.242142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.242147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.242152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.242156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.242161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.242166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.242171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.242175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.242180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.242184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.242189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.242198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.242207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.242212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.242218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.242227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.242233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.242237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.242243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.242281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:46.246147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:46.246680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:46.246693Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:46.246696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:46.246701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:46.246708Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2122 [2:7559602029766357271:3378]
2025-10-10T14:36:46.246726Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:46.246765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:46.246773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.246777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.246780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.246800Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:46.246808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:46.246816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:46.246886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.246896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.246898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.246901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:46.246980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:46.246988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.247001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.247019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.247043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:46.247072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587674:2832], now have 1 active actors on pipe
2025-10-10T14:36:46.247080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587473:2438], now have 1 active actors on pipe
2025-10-10T14:36:46.247089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602029766357265:3378]
2025-10-10T14:36:46.247092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602029766357265:3378]
2025-10-10T14:36:46.247094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602029766357265:3378]
2025-10-10T14:36:46.247108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:46.247125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:46.247127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:46.247131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:46.247133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:46.247145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:46.247149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:46.247116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2122
2025-10-10T14:36:46.247125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2122
2025-10-10T14:36:46.247191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602029766357265:3378]
2025-10-10T14:36:46.247202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:46.247209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:46.247521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.247548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.247590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:46.247620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.247629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.247633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:46.247647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.247675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:46.247699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.247853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.247863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.247879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.247972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2123 partition: 0 MaxSeqNo: 40 sessionId: src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0
2025-10-10T14:36:46.248408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9b1672e-4ce3ec45-1af7f940-81eb6a0d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:46.251347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0] Write session: try to update token
2025-10-10T14:36:46.251369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:46.261708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:46.261726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:46.261739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602029766357265:3378]
2025-10-10T14:36:46.261794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:46.261989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:46.262134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:46.262277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:46.262414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:46.262600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:46.262638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:46.262930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:46.272261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId: src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:46.275183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:46.275536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.275570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.275616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:46.275807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:46.283872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:46.283895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:46.283898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:46.283901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:46.283912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602029766357265:3378]
2025-10-10T14:36:46.283917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602029766357265:3378]
2025-10-10T14:36:46.283926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602029766357265:3378]
2025-10-10T14:36:46.283977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:46.283985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:46.283987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:46.283990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:46.283994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.283997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:46.284133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:46.321309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602030548587687:2605]
2025-10-10T14:36:46.325645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2122, pipe: [1:7559602030548587687:2605]
2025-10-10T14:36:46.409786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:46.418726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.418751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.418931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.418991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.419072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.419155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.419458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.419470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.419545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.419607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.419673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.420068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.420115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.420123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.420207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.420284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.420362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.420432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.420480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.420490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.420563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.420629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.420695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.420762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.420811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.420821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.420903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.420968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.421030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.421090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.421134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.421139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.421205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.421268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.421347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.421413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.421463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.421470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.421535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.421590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.421656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.421721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.421763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.421768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.421834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.421903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.421968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.422039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.422084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.422092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.422156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.422223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.422286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.422349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.422392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.422398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.422467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.422528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.422594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.422660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.422708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.422715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.422779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587687:2605], now have 1 active actors on pipe
2025-10-10T14:36:46.423038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602030548587687:2605]
2025-10-10T14:36:46.423095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:46.423313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:46.423326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:46.423359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2123 reason: error at write: Disconnected sessionId: src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0
2025-10-10T14:36:46.423359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:46.423576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2123 sessionId: src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0 is DEAD
2025-10-10T14:36:46.423712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:46.423724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0] Write session will restart in 0.005729s
2025-10-10T14:36:46.423751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0] Write session: Do CDS request
2025-10-10T14:36:46.423758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:46.430998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.431038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:46.431058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2124
2025-10-10T14:36:46.431284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.431325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:46.431336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:46.431340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:46.431941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2124 sessionId:  describe result for acl check
2025-10-10T14:36:46.432003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:46.432010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:46.432014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:46.432021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602030548587708:2861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:46.432645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602030548587708:2861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:46.436404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602030548587708:2861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:46.439785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602030548587708:2861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:46.439798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602030548587708:2861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:46.439802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602030548587708:2861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:46.439811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:46.444117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:46.446448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:46.446680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:46.446692Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:46.446704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:46.446766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:46.446808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602029766357480:3375]
2025-10-10T14:36:46.447455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:46.447824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:46.447883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:46.448276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:46.448343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.448352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.448353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.448355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.448356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.448358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.448359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.448361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.448362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.448363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.448365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.448366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.448367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.448374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.448389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.448393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.448398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.448402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.448407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.448411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.448416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.448421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.448427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.448431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.448436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.448440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.448449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.448458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.448465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.448472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.448477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.448484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.448489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.448495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.448500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.448506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.448511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.448517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.448525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.448531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.448536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.448542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.448546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.448552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.448557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.448563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.448570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.448576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.448586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.448592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.448598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.448609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.448652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:46.451120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:46.451821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:46.451836Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:46.451839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:46.451843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:46.451850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2123 [2:7559602029766357480:3375]
2025-10-10T14:36:46.451864Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:46.451887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:46.451895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.451900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.451902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.451920Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:46.451933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:46.451941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:46.452251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2123
2025-10-10T14:36:46.452252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2123
2025-10-10T14:36:46.452007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.452022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.452024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.452027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:46.452100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:46.452102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.452115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.452130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.452149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:46.452172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587692:2438], now have 1 active actors on pipe
2025-10-10T14:36:46.452176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587876:2861], now have 1 active actors on pipe
2025-10-10T14:36:46.452199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602029766357475:3375]
2025-10-10T14:36:46.452744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2124 partition: 0 MaxSeqNo: 40 sessionId: src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0
2025-10-10T14:36:46.452203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602029766357475:3375]
2025-10-10T14:36:46.452206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602029766357475:3375]
2025-10-10T14:36:46.452222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:46.452236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:46.452254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:46.452258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:46.452270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:46.452277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:46.452279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:46.452287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602029766357475:3375]
2025-10-10T14:36:46.452291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:46.452305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:46.452337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.452343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.452374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:46.452382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.452387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.452390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:46.452405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.452416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:46.452429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.452608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.452611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.452626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.453149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af422992-2ff3a98e-61da7d00-55c99d8f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:46.456152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0] Write session: try to update token
2025-10-10T14:36:46.456174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:46.470445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:46.470464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:46.470476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602029766357475:3375]
2025-10-10T14:36:46.470528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:46.470536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:46.470701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:46.470845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:46.470988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:46.471123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:46.471310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:46.471353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:46.473221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId: src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:46.475950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:46.476197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.476219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.476260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:46.476410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:46.486012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:46.486033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:46.486036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:46.486038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:46.486051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602029766357475:3375]
2025-10-10T14:36:46.486055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602029766357475:3375]
2025-10-10T14:36:46.486059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602029766357475:3375]
2025-10-10T14:36:46.486109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:46.486117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.486120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:46.486121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:46.486128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:46.486135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:46.486260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:46.525574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602030548587906:2605]
2025-10-10T14:36:46.526024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2123, pipe: [1:7559602030548587906:2605]
2025-10-10T14:36:46.602672Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:46.611268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.611299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.611499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.611581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.611654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.611726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.611774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.611784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.611856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.611926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.612005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.612078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.612122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.612125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.612212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.612278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.612343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.612403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.612445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.612448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.612525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.612587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.612652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.612724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.612769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.612773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.612851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.612914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.612980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.613047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.613098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.613101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.613175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.613237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.613306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.613538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.613593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.613601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.616014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:46.616029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0] Write session will restart in 0.009406s
2025-10-10T14:36:46.616078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0] Write session: Do CDS request
2025-10-10T14:36:46.616084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:46.613684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.613760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.613837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.613915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.613962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.613966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.614039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.614103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.614172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.614240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.614290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.614293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.614374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.614437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.614502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.614566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.614612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.614616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.614691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:46.615280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:46.615299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602030548587906:2605]
2025-10-10T14:36:46.615337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:46.615341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:46.614754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:46.614825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:46.614890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:46.615372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2124 reason: error at write: Disconnected sessionId: src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0
2025-10-10T14:36:46.614933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:46.615581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2124 sessionId: src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0 is DEAD
2025-10-10T14:36:46.614936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:46.615022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587906:2605], now have 1 active actors on pipe
2025-10-10T14:36:46.616416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:46.626946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.627024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:46.627054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2125
2025-10-10T14:36:46.627250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.627290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:46.627307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:46.627315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:46.627857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2125 sessionId:  describe result for acl check
2025-10-10T14:36:46.627895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:46.627897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:46.627899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:46.627905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602030548587924:2853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:46.628514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602030548587924:2853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:46.630600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602030548587924:2853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:46.635147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602030548587924:2853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:46.635166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602030548587924:2853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:46.635169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602030548587924:2853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:46.635179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:46.642706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:46.646213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:46.646491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:46.646503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:46.646518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:46.646592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:46.646669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602029766357691:3374]
2025-10-10T14:36:46.647317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:46.647766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:46.647833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:46.648205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:46.648276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.648283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.648284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.648286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.648288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.648289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.648290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.648292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.648293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.648294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.648296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.648297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.648298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.648306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.648331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.648344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.648348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.648352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.648357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.648362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.648366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.648370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.648375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.648380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.648384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.648388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.648397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.648407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.648415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.648425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.648435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.648440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.648447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.648453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.648458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.648464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.648469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.648476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.648481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.648487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.648497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.648502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.648514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.648525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.648531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.648536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.648558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.648563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.648568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.648574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.648580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.648585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.648626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:46.651536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:46.652002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:46.652014Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:46.652017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:46.652021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:46.652028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2124 [2:7559602029766357691:3374]
2025-10-10T14:36:46.652042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:46.652060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:46.652068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.652072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.652075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.652093Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:46.652115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:46.652127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:46.652202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.652211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.652213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.652216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:46.652288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:46.652295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.652307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.652324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.652342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:46.652370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548587908:2438], now have 1 active actors on pipe
2025-10-10T14:36:46.652377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548588001:2853], now have 1 active actors on pipe
2025-10-10T14:36:46.652384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602029766357686:3374]
2025-10-10T14:36:46.652387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602029766357686:3374]
2025-10-10T14:36:46.652389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602029766357686:3374]
2025-10-10T14:36:46.652403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:46.652419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:46.652424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:46.652427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:46.652430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:46.652435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:46.652439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:46.652443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2124
2025-10-10T14:36:46.652494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2124
2025-10-10T14:36:46.652465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602029766357686:3374]
2025-10-10T14:36:46.652471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:46.652474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:46.652538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.652544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.652575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:46.652588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.652593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.652596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:46.652610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.652627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:46.652642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.652790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.652799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.652814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.652902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2125 partition: 0 MaxSeqNo: 40 sessionId: src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0
2025-10-10T14:36:46.653431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41d6c5c-4b3e3dfe-fd6bf0e0-c17582c3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:46.656173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0] Write session: try to update token
2025-10-10T14:36:46.656203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:46.674600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:46.674621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:46.674626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:46.674628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:46.674640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602029766357686:3374]
2025-10-10T14:36:46.674644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602029766357686:3374]
2025-10-10T14:36:46.674649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602029766357686:3374]
2025-10-10T14:36:46.674706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:46.674719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.674722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:46.674722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:46.674731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:46.674736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:46.674886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:46.675073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId: src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:46.677966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:46.715597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602030548588140:2605]
2025-10-10T14:36:46.715905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2124, pipe: [1:7559602030548588140:2605]
2025-10-10T14:36:46.793466Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:46.794244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.794266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.794320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548588140:2605], now have 1 active actors on pipe
2025-10-10T14:36:46.794596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:46.795123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:46.795124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:46.795189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602030548588140:2605]
2025-10-10T14:36:46.795219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2125 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0
2025-10-10T14:36:46.795423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2125 sessionId: src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0 is DEAD
2025-10-10T14:36:46.795572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:46.795584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0] Write session will restart in 0.005030s
2025-10-10T14:36:46.795609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0] Write session: Do CDS request
2025-10-10T14:36:46.795615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:46.801901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.802261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:46.802275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2126
2025-10-10T14:36:46.802428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.802455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:46.802459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:46.802462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:46.802934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2126 sessionId:  describe result for acl check
2025-10-10T14:36:46.802976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:46.802983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:46.802985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:46.802991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602030548588177:2876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:46.803573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602030548588177:2876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:46.807192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602030548588177:2876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:46.810662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602030548588177:2876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:46.810680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602030548588177:2876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:46.810684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602030548588177:2876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:46.810701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:46.814078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:46.816711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:46.816975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:46.816980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:46.816996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:46.817070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:46.817124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602029766357941:3344]
2025-10-10T14:36:46.817813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:46.818247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:46.818303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:46.818679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:46.818764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.818773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.818774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.818775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.818777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.818778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.818780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.818781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.818782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.818784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.818785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.818787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.818788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.818796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.818811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.818815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.818820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.818824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.818829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.818834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.818838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.818843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.818848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.818852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.818857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.818861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.818870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.818880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.818893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.818899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.818905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.818911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.818916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.818923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.818935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.818941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.818945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.818951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.818956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.818963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.818969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.818979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.818987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.818998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.819003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.819014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.819019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.819029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.819035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.819045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.819053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.819059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.819111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:46.821937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:46.822306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:46.822321Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:46.822324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:46.822328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:46.822336Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2125 [2:7559602029766357941:3344]
2025-10-10T14:36:46.822350Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:46.822371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:46.822383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.822387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.822389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.822409Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:46.822421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:46.822433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:46.822501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.822510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.822512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.822515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:46.822589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:46.822597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.822610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.822623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.822646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:46.822674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602029766357936:3344]
2025-10-10T14:36:46.822681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602029766357936:3344]
2025-10-10T14:36:46.822684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602029766357936:3344]
2025-10-10T14:36:46.822700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:46.822712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:46.822720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:46.822721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548588321:2876], now have 1 active actors on pipe
2025-10-10T14:36:46.822722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:46.822726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548588161:2438], now have 1 active actors on pipe
2025-10-10T14:36:46.822735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:46.822752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:46.822761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:46.822790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602029766357936:3344]
2025-10-10T14:36:46.822771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2125
2025-10-10T14:36:46.822803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:46.822810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:46.822774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2125
2025-10-10T14:36:46.822994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.823005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.823034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:46.823045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.823053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.823055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:46.823066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.823081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:46.823097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.823326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.823340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.823364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.823433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2126 partition: 0 MaxSeqNo: 40 sessionId: src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0
2025-10-10T14:36:46.824697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7612d38f-fe3eb2a9-c6f040ed-ca4e9e6d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:46.827714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0] Write session: try to update token
2025-10-10T14:36:46.827740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:46.843159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:46.843183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:46.843187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:46.843190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:46.843203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602029766357936:3344]
2025-10-10T14:36:46.843209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602029766357936:3344]
2025-10-10T14:36:46.843213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602029766357936:3344]
2025-10-10T14:36:46.843260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:46.843268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:46.843272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:46.843276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.843279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:46.843279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:46.843421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:46.844286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId: src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:46.846955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:46.895325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602030548588374:2605]
2025-10-10T14:36:46.895632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2125, pipe: [1:7559602030548588374:2605]
2025-10-10T14:36:46.961646Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:46.962366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.962390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.962439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548588374:2605], now have 1 active actors on pipe
2025-10-10T14:36:46.962746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:46.963015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602030548588374:2605]
2025-10-10T14:36:46.963054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:46.963125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2126 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0
2025-10-10T14:36:46.963312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2126 sessionId: src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0 is DEAD
2025-10-10T14:36:46.963464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:46.963481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:46.963493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0] Write session will restart in 0.005969s
2025-10-10T14:36:46.963518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0] Write session: Do CDS request
2025-10-10T14:36:46.963524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:46.970875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.970939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:46.970956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2127
2025-10-10T14:36:46.971096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:46.971132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:46.971143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:46.971147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:46.971596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2127 sessionId:  describe result for acl check
2025-10-10T14:36:46.971631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:46.971638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:46.971640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:46.971646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602030548588403:2895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:46.972225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602030548588403:2895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:46.975600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602030548588403:2895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:46.979100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602030548588403:2895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:46.979117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602030548588403:2895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:46.979121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602030548588403:2895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:46.979130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:46.980903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:46.983667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:46.983914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:46.983926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:46.983939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:46.983995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:46.984042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602029766358154:3342]
2025-10-10T14:36:46.984694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:46.985027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:46.985072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:46.985421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:46.985489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.985490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.985491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.985492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.985493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.985495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.985496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.985497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.985498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.985500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.985501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.985502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.985503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.985510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.985525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.985530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.985535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.985539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.985543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.985547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.985551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.985555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.985560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.985563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.985567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.985572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.985580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.985589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:46.985596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.985602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:46.985607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.985613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:46.985617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.985641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:46.985647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.985653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:46.985657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.985663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:46.985668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.985673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:46.985677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.985683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:46.985688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.985696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:46.985700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.985705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:46.985712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.985717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.985722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.985727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.985731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.985737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.985778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:46.988456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:46.988955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:46.988969Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:46.988972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:46.988976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:46.988983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2126 [2:7559602029766358154:3342]
2025-10-10T14:36:46.988996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:46.989020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:46.989028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.989032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.989034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.989067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:46.989076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:46.989083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:46.989141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.989149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.989151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.989154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:46.989229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:46.989237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:46.989249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:46.989262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:46.989280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:46.989304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548588379:2438], now have 1 active actors on pipe
2025-10-10T14:36:46.989307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602030548588578:2895], now have 1 active actors on pipe
2025-10-10T14:36:46.989315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602029766358149:3342]
2025-10-10T14:36:46.989318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602029766358149:3342]
2025-10-10T14:36:46.989320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602029766358149:3342]
2025-10-10T14:36:46.989348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:46.989622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2126
2025-10-10T14:36:46.989364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:46.989374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:46.989378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:46.989380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:46.989382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:46.989385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:46.989412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602029766358149:3342]
2025-10-10T14:36:46.989420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:46.989426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:46.989719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2126
2025-10-10T14:36:46.989975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.989986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.990022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:46.990036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:46.990041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:46.990044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:46.990056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:46.990069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:46.990087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.990367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:46.990380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:46.990402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:46.990591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2127 partition: 0 MaxSeqNo: 40 sessionId: src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0
2025-10-10T14:36:46.991195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1776130a-85b411ae-80bed2a3-66fdf6e7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:46.994113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0] Write session: try to update token
2025-10-10T14:36:46.994131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:47.004047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:47.004068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:47.004086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602029766358149:3342]
2025-10-10T14:36:47.004136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:47.004144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:47.004396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:47.004565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:47.004786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:47.005067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:47.005922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:47.005989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:47.014939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId: src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:47.017850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:47.018087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.018109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.018152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:47.018956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:47.023959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:47.023977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:47.023981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:47.023983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:47.023994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602029766358149:3342]
2025-10-10T14:36:47.024003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602029766358149:3342]
2025-10-10T14:36:47.024006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602029766358149:3342]
2025-10-10T14:36:47.024059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:47.024059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:47.024065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:47.024068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:47.024073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.024076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:47.024234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:47.063245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602034843555900:2605]
2025-10-10T14:36:47.063651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2126, pipe: [1:7559602034843555900:2605]
2025-10-10T14:36:47.146176Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:47.154954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.154984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.155169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.155238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.155308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.155376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.155428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.155439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.155509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.155571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.155635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.155709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.155763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.155770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.155839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.155902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.155974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.156043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.156091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.156098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.156180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.156248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.156314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.156387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.156435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.156442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.156510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.156570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.156633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.156704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.156755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.156763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.156835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.156899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.156966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.157037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.157084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.157098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.157167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.157238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.157309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.157392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.157440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.157448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.157523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.157589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.157658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.157731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.157789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.157798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.157865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.157933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.158002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.158113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.158888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:47.158917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:47.158921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:47.158960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602034843555900:2605]
2025-10-10T14:36:47.158961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2127 reason: error at write: Disconnected sessionId: src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0
2025-10-10T14:36:47.159247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2127 sessionId: src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0 is DEAD
2025-10-10T14:36:47.159341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:47.159351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0] Write session will restart in 0.007153s
2025-10-10T14:36:47.159386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0] Write session: Do CDS request
2025-10-10T14:36:47.159393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:47.158163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.158172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.158263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.158331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.158393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.158461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.158509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.158512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.158591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843555900:2605], now have 1 active actors on pipe
2025-10-10T14:36:47.159514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:47.169684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.170057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:47.170083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2128
2025-10-10T14:36:47.170245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.170292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:47.170303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:47.170312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:47.171035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2128 sessionId:  describe result for acl check
2025-10-10T14:36:47.171072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:47.171080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:47.171082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:47.171089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602034843555927:2909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:47.171766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602034843555927:2909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:47.175592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602034843555927:2909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:47.181479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602034843555927:2909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:47.181495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602034843555927:2909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:47.181499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602034843555927:2909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:47.181508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:47.182745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:47.184682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:47.185040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:47.185053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:47.185068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:47.185142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:47.185191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602034061325678:3335]
2025-10-10T14:36:47.185827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:47.186195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:47.186247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:47.186612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:47.186692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.186701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.186702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.186703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.186705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.186706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.186707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.186708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.186710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.186711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.186712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.186713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.186715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.186722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.186737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.186742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.186747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.186751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.186755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.186760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.186764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.186768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.186773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.186777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.186782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.186786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.186798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.186807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.186814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.186820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.186826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.186832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.186837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.186842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.186848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.186854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.186859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.186865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.186870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.186876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.186881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.186889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.186906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.186913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.186918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.186924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.186928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.186933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.186938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.186944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.186948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.186954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.186998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:47.192699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:47.193074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:47.193090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:47.193093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:47.193097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:47.193104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2127 [2:7559602034061325678:3335]
2025-10-10T14:36:47.193121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:47.193143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:47.193153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.193157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.193159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.193178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:47.193186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:47.193195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:47.193262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.193270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.193272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.193275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:47.193372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:47.193381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.193394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.193410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.193586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2127
2025-10-10T14:36:47.193591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2127
2025-10-10T14:36:47.193428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:47.193459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556108:2909], now have 1 active actors on pipe
2025-10-10T14:36:47.193467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602034061325673:3335]
2025-10-10T14:36:47.193469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602034061325673:3335]
2025-10-10T14:36:47.193471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602034061325673:3335]
2025-10-10T14:36:47.193486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:47.193498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843555903:2438], now have 1 active actors on pipe
2025-10-10T14:36:47.193507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:47.193512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:47.193516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:47.193518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:47.193524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:47.193529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:47.193564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602034061325673:3335]
2025-10-10T14:36:47.193572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:47.193579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:47.193841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.193855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.193893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6efa019-e16750d6-27a1551a-fac0f575_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:47.193907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.193910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.193912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:47.193922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.193933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:47.193949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.194216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.194228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.194265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.194410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2128 partition: 0 MaxSeqNo: 40 sessionId: src_id|e6efa019-e16750d6-27a1551a-fac0f575_0
2025-10-10T14:36:47.197703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f708b0d1-e2587317-ca3d5cb0-5ba0aebf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e6efa019-e16750d6-27a1551a-fac0f575_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:47.200376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6efa019-e16750d6-27a1551a-fac0f575_0] Write session: try to update token
2025-10-10T14:36:47.200396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6efa019-e16750d6-27a1551a-fac0f575_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:47.214314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:47.214335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:47.214339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:47.214341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:47.214352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602034061325673:3335]
2025-10-10T14:36:47.214357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602034061325673:3335]
2025-10-10T14:36:47.214361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602034061325673:3335]
2025-10-10T14:36:47.214413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:47.214425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.214433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:47.214581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:47.218280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:47.218308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:47.218313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:47.226474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId: src_id|e6efa019-e16750d6-27a1551a-fac0f575_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:47.229050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:47.261414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602034843556120:2605]
2025-10-10T14:36:47.273403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2127, pipe: [1:7559602034843556120:2605]
2025-10-10T14:36:47.333989Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:47.334546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.334563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.334589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556120:2605], now have 1 active actors on pipe
2025-10-10T14:36:47.334821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:47.334855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:47.334864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602034843556120:2605]
2025-10-10T14:36:47.334892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:47.334968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2128 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6efa019-e16750d6-27a1551a-fac0f575_0
2025-10-10T14:36:47.335188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2128 sessionId: src_id|e6efa019-e16750d6-27a1551a-fac0f575_0 is DEAD
2025-10-10T14:36:47.335326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6efa019-e16750d6-27a1551a-fac0f575_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:47.335339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6efa019-e16750d6-27a1551a-fac0f575_0] Write session will restart in 0.008969s
2025-10-10T14:36:47.335362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6efa019-e16750d6-27a1551a-fac0f575_0] Write session: Do CDS request
2025-10-10T14:36:47.335368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6efa019-e16750d6-27a1551a-fac0f575_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:47.345907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6efa019-e16750d6-27a1551a-fac0f575_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.345974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:47.345991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2129
2025-10-10T14:36:47.346168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.346210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:47.346216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:47.346220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:47.346739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2129 sessionId:  describe result for acl check
2025-10-10T14:36:47.346775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:47.346782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:47.346784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:47.346793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602034843556207:2905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:47.347359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602034843556207:2905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:47.351902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:47.352505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602034843556207:2905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:47.354666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602034843556207:2905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:47.354683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602034843556207:2905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:47.354686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602034843556207:2905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:47.354695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:47.356347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:47.356636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:47.356649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:47.356662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:47.356732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:47.356778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602034061325893:3330]
2025-10-10T14:36:47.357570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:47.358609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:47.358666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:47.358996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:47.359088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.359097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.359099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.359100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.359101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.359102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.359103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.359105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.359106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.359107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.359109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.359110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.359111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.359119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.359132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.359137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.359141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.359145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.359149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.359153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.359157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.359161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.359166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.359171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.359175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.359179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.359201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.359210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.359217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.359224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.359229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.359235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.359241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.359247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.359254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.359259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.359264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.359269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.359274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.359279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.359283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.359289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.359292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.359297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.359302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.359307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.359312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.359317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.359321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.359325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.359330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.359335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.359373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:47.362042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:47.362333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:47.362343Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:47.362347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:47.362351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:47.362358Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2128 [2:7559602034061325893:3330]
2025-10-10T14:36:47.362372Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:47.362389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:47.362398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.362401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.362404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.362421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:47.362427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:47.362432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:47.362476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.362477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.362479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.362481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:47.362534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:47.362537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.362545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.362551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.362561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:47.362579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602034061325887:3330]
2025-10-10T14:36:47.362581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602034061325887:3330]
2025-10-10T14:36:47.362582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602034061325887:3330]
2025-10-10T14:36:47.362590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:47.362602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:47.362623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:47.362626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:47.362647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602034061325887:3330]
2025-10-10T14:36:47.362650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:47.362750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:47.362752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:47.362754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:47.362758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:47.363027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2128
2025-10-10T14:36:47.363042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2128
2025-10-10T14:36:47.363184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556329:2905], now have 1 active actors on pipe
2025-10-10T14:36:47.363195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556122:2438], now have 1 active actors on pipe
2025-10-10T14:36:47.363214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.363224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.363256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:47.363269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.363273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.363276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:47.363290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.363306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:47.363326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.363539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.363546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.363560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.363667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2129 partition: 0 MaxSeqNo: 40 sessionId: src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0
2025-10-10T14:36:47.364098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6efa019-e16750d6-27a1551a-fac0f575_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:47.366809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0] Write session: try to update token
2025-10-10T14:36:47.366829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:47.386111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId: src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:47.388778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:47.387441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:47.387460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:47.387464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:47.387466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:47.387476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602034061325887:3330]
2025-10-10T14:36:47.387481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602034061325887:3330]
2025-10-10T14:36:47.387486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602034061325887:3330]
2025-10-10T14:36:47.387542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:47.387541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:47.387548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:47.387550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.387553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:47.387553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:47.387699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:47.434968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602034843556340:2605]
2025-10-10T14:36:47.435269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2128, pipe: [1:7559602034843556340:2605]
2025-10-10T14:36:47.502857Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:47.503447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.503462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.503509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556340:2605], now have 1 active actors on pipe
2025-10-10T14:36:47.503791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602034843556340:2605]
2025-10-10T14:36:47.503808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:47.503832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:47.503835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:47.503908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2129 reason: error at write: Disconnected sessionId: src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0
2025-10-10T14:36:47.503914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:47.504111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2129 sessionId: src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0 is DEAD
2025-10-10T14:36:47.504299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:47.504318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0] Write session will restart in 0.005887s
2025-10-10T14:36:47.504343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0] Write session: Do CDS request
2025-10-10T14:36:47.504353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:47.511921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.512096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:47.512115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2130
2025-10-10T14:36:47.512280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.512318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:47.512328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:47.512332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:47.512926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2130 sessionId:  describe result for acl check
2025-10-10T14:36:47.512968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:47.512974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:47.512977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:47.512983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602034843556366:2913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:47.513583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602034843556366:2913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:47.516376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602034843556366:2913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:47.521996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:47.524840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:47.525053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:47.525064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:47.525075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:47.525132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:47.525169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602034061326108:3311]
2025-10-10T14:36:47.525143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602034843556366:2913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:47.525165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602034843556366:2913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:47.525170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602034843556366:2913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:47.525179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:47.525690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:47.526051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:47.526113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:47.526488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:47.526562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.526569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.526570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.526572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.526573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.526574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.526576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.526578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.526579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.526580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.526582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.526583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.526585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.526592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.526606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.526615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.526624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.526628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.526637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.526644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.526652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.526661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.526666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.526674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.526679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.526687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.526695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.526709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.526720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.526731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.526740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.526750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.526759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.526769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.526778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.526788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.526797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.526807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.526816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.526826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.526835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.526844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.526854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.526864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.526872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.526882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.526891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.526900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.526909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.526920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.526929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.526935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.526983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:47.529533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:47.530197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:47.530214Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:47.530217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:47.530221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:47.530227Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2129 [2:7559602034061326108:3311]
2025-10-10T14:36:47.530241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:47.530260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:47.530264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.530268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.530271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.530288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:47.530297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:47.530305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:47.530367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.530379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.530382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.530384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:47.530450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:47.530460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.530471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.530482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.530500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:47.530559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556549:2913], now have 1 active actors on pipe
2025-10-10T14:36:47.530562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556342:2438], now have 1 active actors on pipe
2025-10-10T14:36:47.530570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602034061326103:3311]
2025-10-10T14:36:47.530572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602034061326103:3311]
2025-10-10T14:36:47.530576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602034061326103:3311]
2025-10-10T14:36:47.530589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:47.530602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:47.530605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:47.530607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:47.530608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:47.530624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:47.530627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:47.530659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602034061326103:3311]
2025-10-10T14:36:47.530667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:47.530674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:47.530683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.530688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.530743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:47.530758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.530763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.530770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:47.530783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.530798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:47.530820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.531047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.531058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.531079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.531580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51594d1-12e4db3d-d4cc3885-dd9fdefd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:47.530613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2129
2025-10-10T14:36:47.530623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2129
2025-10-10T14:36:47.531183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2130 partition: 0 MaxSeqNo: 40 sessionId: src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0
2025-10-10T14:36:47.534398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0] Write session: try to update token
2025-10-10T14:36:47.534416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:47.551946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:47.551970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:47.551974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:47.551977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:47.551988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602034061326103:3311]
2025-10-10T14:36:47.551993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602034061326103:3311]
2025-10-10T14:36:47.551998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602034061326103:3311]
2025-10-10T14:36:47.552055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:47.552056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:47.552063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:47.552068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:47.552070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.552073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:47.552249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:47.550988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId: src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:47.553815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:47.603998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602034843556561:2605]
2025-10-10T14:36:47.605581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2129, pipe: [1:7559602034843556561:2605]
2025-10-10T14:36:47.676365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:47.676384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:47.676473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2130 reason: error at write: Disconnected sessionId: src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0
2025-10-10T14:36:47.676696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2130 sessionId: src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0 is DEAD
2025-10-10T14:36:47.676848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:47.676893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602034843556561:2605]
2025-10-10T14:36:47.677100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:47.677111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0] Write session will restart in 0.008460s
2025-10-10T14:36:47.677137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0] Write session: Do CDS request
2025-10-10T14:36:47.677143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:47.675704Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:47.676009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.676021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.676071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556561:2605], now have 1 active actors on pipe
2025-10-10T14:36:47.676495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:47.686891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.687307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:47.687326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2131
2025-10-10T14:36:47.687430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.687465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:47.687475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:47.687479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:47.687896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2131 sessionId:  describe result for acl check
2025-10-10T14:36:47.687934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:47.687940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:47.687942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:47.687950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602034843556577:2922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:47.688540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602034843556577:2922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:47.691308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602034843556577:2922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:47.696717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602034843556577:2922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:47.696734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602034843556577:2922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:47.696739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602034843556577:2922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:47.696748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:47.717050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:47.720373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:47.720643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:47.720656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:47.720668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:47.720723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:47.720772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602034061326326:3325]
2025-10-10T14:36:47.721501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:47.721840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:47.721902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:47.722259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:47.722351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.722360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.722362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.722363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.722365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.722366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.722367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.722369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.722370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.722371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.722373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.722374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.722375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.722381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.722396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.722400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.722403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.722407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.722411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.722415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.722418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.722422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.722426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.722430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.722434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.722438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.722446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.722455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.722462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.722469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.722474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.722480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.722485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.722490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.722495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.722500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.722505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.722510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.722515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.722520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.722525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.722529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.722535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.722540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.722545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.722551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.722556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.722560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.722575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.722580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.722588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.722593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.722636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:47.732339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:47.733818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2130
2025-10-10T14:36:47.733857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2130
2025-10-10T14:36:47.732719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:47.732737Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:47.732740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:47.732745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:47.732754Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2130 [2:7559602034061326326:3325]
2025-10-10T14:36:47.732770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:47.732794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:47.732798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.732801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.732804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.732824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:47.732832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:47.732842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:47.732915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.732918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.732921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.732923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:47.733019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:47.733022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.733035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.733046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.733063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:47.733085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602034061326321:3325]
2025-10-10T14:36:47.733088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602034061326321:3325]
2025-10-10T14:36:47.733091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602034061326321:3325]
2025-10-10T14:36:47.733107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:47.733123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:47.733138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:47.733141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:47.733155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:47.733159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:47.733165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:47.733184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602034061326321:3325]
2025-10-10T14:36:47.733188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:47.733253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:47.734150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556610:2922], now have 1 active actors on pipe
2025-10-10T14:36:47.734156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556563:2438], now have 1 active actors on pipe
2025-10-10T14:36:47.734172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.734179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.734218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:47.734229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.734235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.734249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:47.734264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.734284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:47.734304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.736924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2131 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0
2025-10-10T14:36:47.736735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.736747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.736777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.737349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b28acb99-a3ef7de0-ce9affad-a9e48ece_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:47.739959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0] Write session: try to update token
2025-10-10T14:36:47.739976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:47.746692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:47.746711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:47.746722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602034061326321:3325]
2025-10-10T14:36:47.746776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:47.746777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:47.746958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:47.747105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:47.747246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:47.747391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:47.747593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:47.747630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:47.760565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId: src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:47.763489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:47.763946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.763969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.764013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:47.764101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:47.768608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:47.768626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:47.768630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:47.768631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:47.768643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602034061326321:3325]
2025-10-10T14:36:47.768647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602034061326321:3325]
2025-10-10T14:36:47.768652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602034061326321:3325]
2025-10-10T14:36:47.768697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:47.768705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:47.768713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.768718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:47.768720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:47.768725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:47.768859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:47.776941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602034843556810:2605]
2025-10-10T14:36:47.780434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2130, pipe: [1:7559602034843556810:2605]
2025-10-10T14:36:47.886925Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:47.887447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556810:2605], now have 1 active actors on pipe
2025-10-10T14:36:47.898941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.898973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.899171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.899240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.899306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.899369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.899415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.899421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.899494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.899558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.899621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.899684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.899727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.899730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.899803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.899865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.899935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.900002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.900044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.900047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.900117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.900511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.900574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.900637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.900676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.900679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.900751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.900810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.900866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.900927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.900972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.900976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.901047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.901105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.903450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602034843556810:2605]
2025-10-10T14:36:47.903493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:47.903496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:47.903527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2131 reason: error at write: Disconnected sessionId: src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0
2025-10-10T14:36:47.903740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2131 sessionId: src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0 is DEAD
2025-10-10T14:36:47.903870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:47.901171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.901250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.901293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.901296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.901422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.901480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.901539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.901603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.901650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.901653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.901721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.901789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.901851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.901911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.901955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.901958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.902027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.902087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.902147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.902206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.902244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.902247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.902315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:47.902396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:47.902457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:47.902519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:47.902561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:47.902564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:47.903687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:47.906008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:47.906020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0] Write session will restart in 0.009407s
2025-10-10T14:36:47.906048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0] Write session: Do CDS request
2025-10-10T14:36:47.906054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:47.917819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.921644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:47.921662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2132
2025-10-10T14:36:47.921877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:47.921908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:47.921914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:47.921918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:47.923042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2132 sessionId:  describe result for acl check
2025-10-10T14:36:47.923076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:47.923078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:47.923079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:47.923084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602034843556882:2954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:47.923547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602034843556882:2954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:47.928780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602034843556882:2954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:47.932752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602034843556882:2954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:47.932771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602034843556882:2954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:47.932775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602034843556882:2954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:47.932785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:47.944963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:47.947212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:47.947541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:47.947546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:47.947557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:47.947604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:47.947642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602034061326583:3289]
2025-10-10T14:36:47.948120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:47.948466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:47.948502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:47.948723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:47.948764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.948770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.948770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.948771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.948772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.948773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.948774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.948774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.948775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.948776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.948777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.948777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.948779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.948783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.948792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.948794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.948797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.948799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.948801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.948803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.948806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.948808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.948810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.948812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.948814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.948816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.948822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.948828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:47.948833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.948837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:47.948840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.948843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:47.948846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.948849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:47.948853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.948857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:47.948859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.948863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:47.948867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.948871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:47.948874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.948877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:47.948880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.948883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:47.948886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.948889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:47.948892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.948896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.948898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.948902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.948905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.948909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.948934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:47.953210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:47.953610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:47.953624Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:47.953627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:47.953631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:47.953638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2131 [2:7559602034061326583:3289]
2025-10-10T14:36:47.953653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:47.953673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:47.953681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.953685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.953687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.953708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:47.953720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:47.953728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:47.953793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.953799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.953802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.953804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:47.953875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:47.953884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.953896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:47.953909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:47.953925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:47.953948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556989:2954], now have 1 active actors on pipe
2025-10-10T14:36:47.953952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602034843556829:2438], now have 1 active actors on pipe
2025-10-10T14:36:47.953960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602034061326578:3289]
2025-10-10T14:36:47.953967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602034061326578:3289]
2025-10-10T14:36:47.953969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602034061326578:3289]
2025-10-10T14:36:47.953981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:47.953995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:47.953999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:47.954002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:47.954004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:47.954010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:47.954014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:47.954044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602034061326578:3289]
2025-10-10T14:36:47.954051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:47.954078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:47.954385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.954396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.954432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8446b15a-38678832-8f536f02-a30d1be9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:47.954442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:47.954447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:47.954449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:47.954464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:47.954478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:47.954498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.954178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2131
2025-10-10T14:36:47.954210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2131
2025-10-10T14:36:47.954813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:47.954819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:47.954835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:47.955351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c4032d-67e2e2d2-3636bfc5-66e88626_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8446b15a-38678832-8f536f02-a30d1be9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:47.954974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2132 partition: 0 MaxSeqNo: 40 sessionId: src_id|8446b15a-38678832-8f536f02-a30d1be9_0
2025-10-10T14:36:47.958214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8446b15a-38678832-8f536f02-a30d1be9_0] Write session: try to update token
2025-10-10T14:36:47.958234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8446b15a-38678832-8f536f02-a30d1be9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:47.974643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:47.974664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:47.974667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:47.974670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:47.974680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602034061326578:3289]
2025-10-10T14:36:47.974684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602034061326578:3289]
2025-10-10T14:36:47.974688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602034061326578:3289]
2025-10-10T14:36:47.974735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:47.974743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:47.974746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:47.974888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:47.975856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:47.975866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:47.975870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:47.976551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId: src_id|8446b15a-38678832-8f536f02-a30d1be9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:47.979407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:48.003794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602039138524347:2605]
2025-10-10T14:36:48.004357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2131, pipe: [1:7559602039138524347:2605]
2025-10-10T14:36:48.092122Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:48.092798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.092811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.092857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524347:2605], now have 1 active actors on pipe
2025-10-10T14:36:48.093154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:48.093108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602039138524347:2605]
2025-10-10T14:36:48.093158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:48.093161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:48.093222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2132 reason: error at write: Disconnected sessionId: src_id|8446b15a-38678832-8f536f02-a30d1be9_0
2025-10-10T14:36:48.093435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2132 sessionId: src_id|8446b15a-38678832-8f536f02-a30d1be9_0 is DEAD
2025-10-10T14:36:48.093497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:48.093889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8446b15a-38678832-8f536f02-a30d1be9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:48.093899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8446b15a-38678832-8f536f02-a30d1be9_0] Write session will restart in 0.006237s
2025-10-10T14:36:48.093928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8446b15a-38678832-8f536f02-a30d1be9_0] Write session: Do CDS request
2025-10-10T14:36:48.093937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8446b15a-38678832-8f536f02-a30d1be9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:48.102605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8446b15a-38678832-8f536f02-a30d1be9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.102983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:48.103000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2133
2025-10-10T14:36:48.103180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.103217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:48.103224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:48.103228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:48.103702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2133 sessionId:  describe result for acl check
2025-10-10T14:36:48.103733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:48.103735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:48.103741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:48.103747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602039138524373:2959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:48.104332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602039138524373:2959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:48.110684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602039138524373:2959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:48.122913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602039138524373:2959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:48.122932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602039138524373:2959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:48.122936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602039138524373:2959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:48.122946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:48.132590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:48.137394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:48.137691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:48.137712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:48.137724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:48.137805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:48.137849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602038356294112:3278]
2025-10-10T14:36:48.138533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:48.138955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:48.139044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:48.139410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:48.139497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.139508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.139510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.139511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.139513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.139514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.139516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.139517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.139518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.139520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.139521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.139523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.139524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.139533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.139548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.139553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.139558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.139581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.139585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.139589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.139593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.139597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.139601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.139605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.139609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.139613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.139622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.139631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.139638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.139644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.139648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.139655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.139662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.139669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.139679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.139685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.139691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.139697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.139702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.139707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.139712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.139718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.139722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.139728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.139733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.139739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.139747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.139753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.139758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.139764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.139769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.139774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.139816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:48.143105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:48.143877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:48.143892Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:48.143895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:48.143899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:48.143906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2132 [2:7559602038356294112:3278]
2025-10-10T14:36:48.143920Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:48.143942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:48.143945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.143949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.143951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.143970Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:48.143978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:48.143992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:48.144056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.144064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.144066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.144069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:48.144153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:48.144164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.144176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.144186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.144202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:48.144227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602038356294107:3278]
2025-10-10T14:36:48.144233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602038356294107:3278]
2025-10-10T14:36:48.144236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602038356294107:3278]
2025-10-10T14:36:48.144249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:48.144267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:48.144273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524360:2438], now have 1 active actors on pipe
2025-10-10T14:36:48.144276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524497:2959], now have 1 active actors on pipe
2025-10-10T14:36:48.144276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:48.144279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:48.144285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:48.144303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:48.144312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:48.144350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602038356294107:3278]
2025-10-10T14:36:48.144363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:48.144394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:48.144582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2132
2025-10-10T14:36:48.144638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2132
2025-10-10T14:36:48.144730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.144745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.144778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:48.144797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.144802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.144805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:48.144819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.144834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:48.144852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.145051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.145063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.145085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.145207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2133 partition: 0 MaxSeqNo: 40 sessionId: src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0
2025-10-10T14:36:48.145730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8446b15a-38678832-8f536f02-a30d1be9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:48.148630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0] Write session: try to update token
2025-10-10T14:36:48.148653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:48.164720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:48.164749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:48.164762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602038356294107:3278]
2025-10-10T14:36:48.164824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:48.165382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:48.165537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.165702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.166040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.166243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:48.166637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:48.166691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:48.175434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId: src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:48.178176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:48.178610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.178639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.178665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:48.178669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:48.178672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:48.178674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:48.178685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602038356294107:3278]
2025-10-10T14:36:48.178689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602038356294107:3278]
2025-10-10T14:36:48.178693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602038356294107:3278]
2025-10-10T14:36:48.178741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:48.178754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:48.178756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:48.178761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:48.178764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.178767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:48.178908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:48.193245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602039138524583:2605]
2025-10-10T14:36:48.193643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2132, pipe: [1:7559602039138524583:2605]
2025-10-10T14:36:48.301559Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:48.301976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:48.302031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524583:2605], now have 1 active actors on pipe
2025-10-10T14:36:48.302154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:48.302454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:48.302524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602039138524583:2605]
2025-10-10T14:36:48.321739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:48.324590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:48.324901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:48.324915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:48.324929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:48.324990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:48.325054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602038356294332:3276]
2025-10-10T14:36:48.325723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:48.326049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:48.326100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:48.326092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:48.326112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:48.326140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2133 reason: error at write: Disconnected sessionId: src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0
2025-10-10T14:36:48.326294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2133 sessionId: src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0 is DEAD
2025-10-10T14:36:48.326482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:48.326494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0] Write session will restart in 0.008894s
2025-10-10T14:36:48.326527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0] Write session: Do CDS request
2025-10-10T14:36:48.326534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:48.326649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:48.326734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.326741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.326743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.326744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.326745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.326746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.326747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.326749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.326750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.326751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.326753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.326756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.326758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.326764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.326778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.326782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.326786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.326791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.326795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.326799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.326803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.326807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.326811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.326816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.326820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.326824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.326834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.326843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.326849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.326853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.326863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.326867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.326872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.326879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.326883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.326887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.326891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.326896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.326901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.326906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.326910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.326915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.326923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.326928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.326934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.326942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.326950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.326955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.326960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.326967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.326972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.326977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.327022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:48.335830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:48.336966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:48.336980Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:48.336982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:48.336987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:48.336994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2133 [2:7559602038356294332:3276]
2025-10-10T14:36:48.337008Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:48.337027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:48.337029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.337032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.337034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.337053Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:48.337062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:48.337076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:48.337141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.337148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.337150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.337153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:48.337232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:48.337241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.337250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.337267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.337283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:48.337313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524585:2438], now have 1 active actors on pipe
2025-10-10T14:36:48.337346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602038356294327:3276]
2025-10-10T14:36:48.337352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602038356294327:3276]
2025-10-10T14:36:48.337354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602038356294327:3276]
2025-10-10T14:36:48.337374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:48.337378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:48.337384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:48.337388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:48.337396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:48.337412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:48.337415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:48.337420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2133
2025-10-10T14:36:48.337453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602038356294327:3276]
2025-10-10T14:36:48.337469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:48.337497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:48.337938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.338023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:48.338041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2134
2025-10-10T14:36:48.338161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.338208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:48.338219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:48.338223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:48.338683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2134 sessionId:  describe result for acl check
2025-10-10T14:36:48.338740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:48.338746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:48.338750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:48.338757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602039138524777:2964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:48.339368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602039138524777:2964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:48.342378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602039138524777:2964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:48.348902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602039138524777:2964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:48.348922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602039138524777:2964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:48.348927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602039138524777:2964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:48.348938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:48.349635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524805:2964], now have 1 active actors on pipe
2025-10-10T14:36:48.349975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2133
2025-10-10T14:36:48.350102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.350122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.350171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:48.350189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.350195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.350198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:48.350213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.350243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:48.350277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.350486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.350510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.350537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.350999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2134 partition: 0 MaxSeqNo: 40 sessionId: src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0
2025-10-10T14:36:48.351429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a706f6-47ebd8b5-253ddf2-89973302_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:48.354385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0] Write session: try to update token
2025-10-10T14:36:48.354409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:48.358110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:48.358130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:48.358134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:48.358136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:48.358149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602038356294327:3276]
2025-10-10T14:36:48.358154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602038356294327:3276]
2025-10-10T14:36:48.358157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602038356294327:3276]
2025-10-10T14:36:48.358209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:48.358216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.358219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:48.358774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:48.361522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:48.361539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:48.361544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:48.373638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId: src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:48.376400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:48.402686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602039138524809:2605]
2025-10-10T14:36:48.403062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2133, pipe: [1:7559602039138524809:2605]
2025-10-10T14:36:48.474456Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:48.474773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.474801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.474828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524809:2605], now have 1 active actors on pipe
2025-10-10T14:36:48.475088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:48.475111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:48.475130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:48.475196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2134 reason: error at write: Disconnected sessionId: src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0
2025-10-10T14:36:48.475227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:48.475282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602039138524809:2605]
2025-10-10T14:36:48.475408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2134 sessionId: src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0 is DEAD
2025-10-10T14:36:48.475603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:48.475626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0] Write session will restart in 0.008691s
2025-10-10T14:36:48.475652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0] Write session: Do CDS request
2025-10-10T14:36:48.475658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:48.485989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.486098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:48.486118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2135
2025-10-10T14:36:48.486253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.486289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:48.486300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:48.486304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:48.486800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2135 sessionId:  describe result for acl check
2025-10-10T14:36:48.486838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:48.486846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:48.486848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:48.486854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602039138524824:2974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:48.487446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602039138524824:2974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:48.489862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602039138524824:2974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:48.493275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602039138524824:2974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:48.493290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602039138524824:2974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:48.493294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602039138524824:2974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:48.493303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:48.498301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:48.500881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:48.501106Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:48.501117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:48.501130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:48.501198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:48.501249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602038356294554:3272]
2025-10-10T14:36:48.501901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:48.502546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:48.502592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:48.502934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:48.503000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.503007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.503008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.503010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.503011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.503012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.503014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.503015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.503016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.503018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.503019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.503020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.503021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.503028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.503041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.503046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.503050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.503054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.503058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.503062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.503067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.503071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.503075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.503079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.503084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.503087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.503096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.503105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.503113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.503119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.503123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.503129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.503133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.503143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.503145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.503149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.503152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.503155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.503158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.503162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.503164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.503168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.503170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.503174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.503176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.503180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.503182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.503185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.503188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.503192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.503195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.503200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.503236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:48.505790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:48.506567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:48.506581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:48.506584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:48.506588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:48.506594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2134 [2:7559602038356294554:3272]
2025-10-10T14:36:48.506607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:48.506627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:48.506630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.506634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.506636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.506654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:48.506665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:48.506674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:48.506747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.506754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.506756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.506758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:48.506829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:48.506837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.506850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.506867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.506884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:48.506909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524811:2438], now have 1 active actors on pipe
2025-10-10T14:36:48.506918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138524926:2974], now have 1 active actors on pipe
2025-10-10T14:36:48.506926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602038356294549:3272]
2025-10-10T14:36:48.506929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602038356294549:3272]
2025-10-10T14:36:48.506933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602038356294549:3272]
2025-10-10T14:36:48.506947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:48.507002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2134
2025-10-10T14:36:48.507007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2134
2025-10-10T14:36:48.506960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:48.506962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:48.506966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:48.506967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:48.506978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:48.506981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:48.507007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602038356294549:3272]
2025-10-10T14:36:48.507017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:48.507023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:48.507057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.507062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.507092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:48.507105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.507109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.507117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:48.507132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.507147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:48.507167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.507341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.507351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.507369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.508148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2135 partition: 0 MaxSeqNo: 40 sessionId: src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0
2025-10-10T14:36:48.508523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7d31e1a-18125e47-ec1b4588-783a6a7d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:48.511387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0] Write session: try to update token
2025-10-10T14:36:48.511410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:48.519059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:48.519083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:48.519095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602038356294549:3272]
2025-10-10T14:36:48.519149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:48.519140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:48.519461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:48.519654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.519855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.520059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.520385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:48.520430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:48.528485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId: src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:48.531104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:48.531509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:48.531343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.531368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.531423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:48.538768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:48.538787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:48.538791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:48.538793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:48.538813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602038356294549:3272]
2025-10-10T14:36:48.538817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602038356294549:3272]
2025-10-10T14:36:48.538820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602038356294549:3272]
2025-10-10T14:36:48.538864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:48.538869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:48.538877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.538879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:48.538880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:48.538883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:48.539018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:48.575210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602039138525035:2605]
2025-10-10T14:36:48.575504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2134, pipe: [1:7559602039138525035:2605]
2025-10-10T14:36:48.666658Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:48.674951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.674984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.675180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.675249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.675315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.675377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.675424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.675446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.675570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.675668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.675765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.675826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.675873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.675877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.675950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.676037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.676124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.676224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.676334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.676336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.676400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.676481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.676562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.676617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.676656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.676658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.676722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.676802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.676882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.676978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.677026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.677028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.677119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.677170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.677226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.677281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.677463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.677469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.677572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.677655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.677762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.677847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.677892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.677900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.677986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.678049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.678114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.678180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.678228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.678235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.678307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.678371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.678434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.678499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.678635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.678642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.678710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:48.678772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:48.678836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:48.678898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:48.678955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:48.678962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:48.679028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138525035:2605], now have 1 active actors on pipe
2025-10-10T14:36:48.679761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:48.679759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:48.679775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:48.679803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2135 reason: error at write: Disconnected sessionId: src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0
2025-10-10T14:36:48.679968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2135 sessionId: src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0 is DEAD
2025-10-10T14:36:48.680170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602039138525035:2605]
2025-10-10T14:36:48.680182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:48.685437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:48.685454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0] Write session will restart in 0.008707s
2025-10-10T14:36:48.685487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0] Write session: Do CDS request
2025-10-10T14:36:48.685494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:48.695950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.696046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:48.696062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2136
2025-10-10T14:36:48.696184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.696214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:48.696220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:48.696224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:48.696726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2136 sessionId:  describe result for acl check
2025-10-10T14:36:48.696766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:48.696769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:48.696770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:48.696777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602039138525063:2985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:48.697481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602039138525063:2985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:48.702420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602039138525063:2985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:48.706296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602039138525063:2985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:48.706314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602039138525063:2985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:48.706318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602039138525063:2985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:48.706326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:48.708515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:48.711444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:48.711715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:48.711727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:48.711740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:48.711804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:48.711868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602038356294776:3270]
2025-10-10T14:36:48.712519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:48.712861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:48.712912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:48.713254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:48.713320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.713326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.713327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.713344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.713345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.713347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.713348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.713349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.713351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.713352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.713353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.713354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.713355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.713362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.713377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.713382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.713386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.713391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.713395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.713399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.713403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.713407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.713411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.713414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.713419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.713423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.713433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.713442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.713449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.713455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.713460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.713465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.713470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.713476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.713480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.713485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.713489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.713495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.713500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.713505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.713509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.713515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.713521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.713531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.713536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.713542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.713552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.713557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.713561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.713571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.713575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.713580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.713630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:48.716253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:48.716783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:48.716830Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:48.716834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:48.716839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:48.716847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2135 [2:7559602038356294776:3270]
2025-10-10T14:36:48.716864Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:48.716893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:48.716905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.716908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.716911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.716931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:48.716940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:48.716948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:48.717028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.717043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.717045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.717048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:48.717135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:48.717144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.717156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.717178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.717199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:48.717228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138525247:2985], now have 1 active actors on pipe
2025-10-10T14:36:48.717239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138525039:2438], now have 1 active actors on pipe
2025-10-10T14:36:48.717248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602038356294771:3270]
2025-10-10T14:36:48.717256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602038356294771:3270]
2025-10-10T14:36:48.717259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602038356294771:3270]
2025-10-10T14:36:48.717276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:48.717300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:48.717302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:48.717310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:48.717314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:48.717320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:48.717325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:48.717377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602038356294771:3270]
2025-10-10T14:36:48.717388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:48.717401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:48.717429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.717440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.717318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2135
2025-10-10T14:36:48.717319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2135
2025-10-10T14:36:48.717487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:48.717502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.717507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.717510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:48.717524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.717539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:48.717560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.717763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.717776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.717801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.717982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2136 partition: 0 MaxSeqNo: 40 sessionId: src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0
2025-10-10T14:36:48.718421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1ffa93d-793ba35b-61d7e6d4-4f10dbc7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:48.721112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0] Write session: try to update token
2025-10-10T14:36:48.721130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:48.740904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:48.740931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:48.740935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:48.740938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:48.740948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602038356294771:3270]
2025-10-10T14:36:48.740954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602038356294771:3270]
2025-10-10T14:36:48.740958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602038356294771:3270]
2025-10-10T14:36:48.741006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:48.741009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:48.741020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:48.741021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.741024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:48.741033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:48.741166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:48.740531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId: src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:48.743115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:48.780483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602039138525267:2605]
2025-10-10T14:36:48.780808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2135, pipe: [1:7559602039138525267:2605]
2025-10-10T14:36:48.862663Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:48.863049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.863062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.863103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138525267:2605], now have 1 active actors on pipe
2025-10-10T14:36:48.863266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:48.863628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602039138525267:2605]
2025-10-10T14:36:48.863636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:48.863640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:48.863653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:48.863708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2136 reason: error at write: Disconnected sessionId: src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0
2025-10-10T14:36:48.863897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2136 sessionId: src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0 is DEAD
2025-10-10T14:36:48.865449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:48.865472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0] Write session will restart in 0.007843s
2025-10-10T14:36:48.865498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0] Write session: Do CDS request
2025-10-10T14:36:48.865506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:48.874887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.874974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:48.874990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2137
2025-10-10T14:36:48.875188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:48.875223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:48.875230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:48.875233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:48.875660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2137 sessionId:  describe result for acl check
2025-10-10T14:36:48.875696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:48.875701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:48.875702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:48.875708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602039138525342:3006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:48.876322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602039138525342:3006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:48.879594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602039138525342:3006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:48.883588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602039138525342:3006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:48.883604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602039138525342:3006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:48.883607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602039138525342:3006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:48.883616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:48.885406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:48.888738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:48.888998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:48.889010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:48.889023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:48.889079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:48.889124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602038356295037:3236]
2025-10-10T14:36:48.889808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:48.890196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:48.890270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:48.890676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:48.890773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.890780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.890782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.890783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.890784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.890786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.890787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.890789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.890790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.890791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.890792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.890794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.890795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.890802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.890815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.890820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.890824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.890827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.890831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.890834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.890837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.890841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.890845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.890848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.890852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.890855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.890865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.890874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:48.890880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.890887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:48.890892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.890898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:48.890902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.890907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:48.890912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.890918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:48.890921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.890927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:48.890931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.890936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:48.890940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.890958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:48.890964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.890969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:48.890975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.890981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:48.890985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.890989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.890993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.890998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.891002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.891007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.891048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:48.893819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:48.894569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:48.894585Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:48.894588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:48.894592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:48.894598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2136 [2:7559602038356295037:3236]
2025-10-10T14:36:48.894611Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:48.894630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:48.894633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.894637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.894640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.894658Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:48.894672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:48.894681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:48.894744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.894755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.894758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.894760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:48.894837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:48.894845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.894859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:48.894870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:48.894890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:48.894913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138525508:3006], now have 1 active actors on pipe
2025-10-10T14:36:48.894922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138525289:2438], now have 1 active actors on pipe
2025-10-10T14:36:48.894930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602038356295032:3236]
2025-10-10T14:36:48.894937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602038356295032:3236]
2025-10-10T14:36:48.894939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602038356295032:3236]
2025-10-10T14:36:48.894955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:48.894969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:48.894973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:48.894976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:48.894978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:48.894990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:48.894994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:48.895025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602038356295032:3236]
2025-10-10T14:36:48.895036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:48.895069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:48.895264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.895278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.895199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2136
2025-10-10T14:36:48.895232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2136
2025-10-10T14:36:48.895320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:48.895335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:48.895340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:48.895343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:48.895357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:48.895371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:48.895393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.895597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.895608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.895631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:48.895957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2137 partition: 0 MaxSeqNo: 40 sessionId: src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0
2025-10-10T14:36:48.896461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f06fa9f6-8f3a4163-5d53eb80-f2de5902_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:48.899320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0] Write session: try to update token
2025-10-10T14:36:48.899343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:48.918553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:48.918673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:48.918692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602038356295032:3236]
2025-10-10T14:36:48.918752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:48.918763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:48.918974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:48.919125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.919305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.919452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:48.919663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:48.919726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:48.921316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId: src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:48.923978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:48.924232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:48.924255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:48.924295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:48.924394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:48.930328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:48.930353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:48.930357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:48.930359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:48.930371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602038356295032:3236]
2025-10-10T14:36:48.930375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602038356295032:3236]
2025-10-10T14:36:48.930396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602038356295032:3236]
2025-10-10T14:36:48.930447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:48.930455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:48.930458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:48.930598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:48.933434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:48.933449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:48.933454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:48.965480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602039138525522:2605]
2025-10-10T14:36:48.966341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2136, pipe: [1:7559602039138525522:2605]
2025-10-10T14:36:49.053133Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:49.062230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.062263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.062454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.062522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.062591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.062657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.062700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.062705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.062780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.062843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.062907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.062976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.063020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.063024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.063097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.063163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.063315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.063380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.063422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.063428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.063503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.063572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.063636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.063743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.063788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.063791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.063869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.063931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.063997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.064062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.064147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.064150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.064220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.064283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.064345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.064408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.064471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.064474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.064545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.064607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.064673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.064738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.064783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.064786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.064857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.064919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.064987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.065054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.065174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.065177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.065250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.065317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.065756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.065836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.065905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.065909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.065981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.066043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.066112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.066179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.066222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.066225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.066309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602039138525522:2605], now have 1 active actors on pipe
2025-10-10T14:36:49.067597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602039138525522:2605]
2025-10-10T14:36:49.067652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:49.067656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:49.067686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2137 reason: error at write: Disconnected sessionId: src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0
2025-10-10T14:36:49.067911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2137 sessionId: src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0 is DEAD
2025-10-10T14:36:49.067633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:49.068064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:49.068388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:49.068398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0] Write session will restart in 0.009252s
2025-10-10T14:36:49.068423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0] Write session: Do CDS request
2025-10-10T14:36:49.068433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:49.078917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.079045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:49.079065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2138
2025-10-10T14:36:49.079224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.079275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:49.079291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:49.079296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:49.079807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2138 sessionId:  describe result for acl check
2025-10-10T14:36:49.079846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:49.079848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:49.079850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:49.079856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602043433492843:3021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:49.080477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602043433492843:3021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:49.083221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602043433492843:3021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:49.089613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602043433492843:3021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:49.089631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602043433492843:3021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:49.089636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602043433492843:3021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:49.089647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:49.097241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:49.100332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:49.100612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:49.100624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:49.100637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:49.100705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:49.100756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602042651262572:3225]
2025-10-10T14:36:49.101401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:49.101876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:49.101938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:49.102270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:49.102338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.102345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.102346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.102348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.102349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.102351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.102352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.102354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.102355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.102357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.102358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.102359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.102361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.102367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.102381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.102386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.102390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.102394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.102399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.102403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.102407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.102411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.102415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.102418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.102421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.102425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.102434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.102442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.102449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.102454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.102457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.102462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.102466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.102471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.102475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.102480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.102485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.102489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.102494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.102498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.102502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.102507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.102518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.102524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.102528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.102533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.102539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.102545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.102549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.102554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.102565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.102571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.102614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:49.105253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:49.105920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:49.105931Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:49.105934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:49.105939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:49.105946Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2137 [2:7559602042651262572:3225]
2025-10-10T14:36:49.105961Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:49.105980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:49.105983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.105987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.105989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.106007Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:49.106022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:49.106030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:49.106096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.106106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.106109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.106112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:49.106183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:49.106191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.106203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.106214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.106231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:49.106255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433492833:2438], now have 1 active actors on pipe
2025-10-10T14:36:49.106264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433492943:3021], now have 1 active actors on pipe
2025-10-10T14:36:49.106272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602042651262567:3225]
2025-10-10T14:36:49.106279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602042651262567:3225]
2025-10-10T14:36:49.106282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602042651262567:3225]
2025-10-10T14:36:49.106297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:49.106310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:49.106314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:49.106316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:49.106320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:49.106337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:49.106340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:49.106368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602042651262567:3225]
2025-10-10T14:36:49.106385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:49.106401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:49.106370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2137
2025-10-10T14:36:49.106372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2137
2025-10-10T14:36:49.106440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.106451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.106485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:49.106500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.106504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.106507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:49.106521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.106535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:49.106556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.106744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.106757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.106780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.106873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2138 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0
2025-10-10T14:36:49.107296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75b79f57-dc693b6d-6a18fd91-9a880579_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:49.110138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0] Write session: try to update token
2025-10-10T14:36:49.110161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:49.122630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:49.122654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:49.122665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602042651262567:3225]
2025-10-10T14:36:49.122712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:49.122719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:49.122906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:49.123057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:49.123208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:49.123370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:49.123590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:49.123642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:49.127995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId: src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:49.130869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:49.131390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.131412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.131453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:49.131572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:49.142890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:49.142909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:49.142912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:49.142915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:49.142927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602042651262567:3225]
2025-10-10T14:36:49.142932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602042651262567:3225]
2025-10-10T14:36:49.142937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602042651262567:3225]
2025-10-10T14:36:49.142982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:49.142990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.142989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:49.142993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:49.142997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:49.143001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:49.143178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:49.167591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602043433493061:2605]
2025-10-10T14:36:49.167986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2137, pipe: [1:7559602043433493061:2605]
2025-10-10T14:36:49.267263Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:49.275993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.276026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.276227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.276294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.276361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.276428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.277038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.277051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.277119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.277180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.277244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.277360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.277407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.277415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.277480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.277546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.277619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.277687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.277753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.277760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.277830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.277896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.277959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.278036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.278082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.278089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.278190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.278289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.278355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.278447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.278512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.278520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.278592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.278660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.278728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.278793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.278856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.278865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.278938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.279006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.279074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.280891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:49.280903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0] Write session will restart in 0.008655s
2025-10-10T14:36:49.280928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0] Write session: Do CDS request
2025-10-10T14:36:49.280934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:49.280487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:49.280507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:49.280529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602043433493061:2605]
2025-10-10T14:36:49.280541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2138 reason: error at write: Disconnected sessionId: src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0
2025-10-10T14:36:49.280569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:49.280729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2138 sessionId: src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0 is DEAD
2025-10-10T14:36:49.279142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.279206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.279209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.279277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.279333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.279393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.279453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.279497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.279501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.279571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.279631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.279692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.279755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.279797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.279799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.279868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.279931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.279994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.280056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.280101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.280104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.280191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493061:2605], now have 1 active actors on pipe
2025-10-10T14:36:49.280748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:49.290948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.291042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:49.291058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2139
2025-10-10T14:36:49.291276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.291330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:49.291344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:49.291349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:49.292012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2139 sessionId:  describe result for acl check
2025-10-10T14:36:49.292056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:49.292058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:49.292060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:49.292067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602043433493109:3030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:49.292697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602043433493109:3030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:49.296032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602043433493109:3030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:49.298881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602043433493109:3030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:49.298894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602043433493109:3030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:49.298898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602043433493109:3030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:49.298907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:49.299633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:49.303243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:49.303495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:49.303506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:49.303519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:49.303576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:49.303621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602042651262797:3229]
2025-10-10T14:36:49.304261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:49.304569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:49.304615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:49.304960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:49.305019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.305025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.305027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.305028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.305029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.305031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.305032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.305033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.305034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.305038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.305040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.305041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.305043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.305048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.305062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.305066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.305069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.305074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.305078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.305082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.305087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.305091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.305095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.305099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.305103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.305108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.305116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.305124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.305131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.305136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.305143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.305148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.305153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.305159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.305164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.305176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.305180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.305186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.305190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.305195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.305200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.305205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.305210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.305216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.305225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.305230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.305234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.305240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.305244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.305254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.305260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.305265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.305305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:49.307849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:49.308274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:49.308285Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:49.308287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:49.308291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:49.308297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2138 [2:7559602042651262797:3229]
2025-10-10T14:36:49.308310Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:49.308328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:49.308332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.308336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.308338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.308354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:49.308370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:49.308378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:49.308441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.308448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.308450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.308452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:49.308520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:49.308527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.308539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.308549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.308570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:49.308596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493063:2438], now have 1 active actors on pipe
2025-10-10T14:36:49.308605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493278:3030], now have 1 active actors on pipe
2025-10-10T14:36:49.308612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602042651262792:3229]
2025-10-10T14:36:49.308614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602042651262792:3229]
2025-10-10T14:36:49.308616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602042651262792:3229]
2025-10-10T14:36:49.308648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2138
2025-10-10T14:36:49.308710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2138
2025-10-10T14:36:49.308629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:49.308646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:49.308648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:49.308650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:49.308650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:49.308666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:49.308669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:49.308690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602042651262792:3229]
2025-10-10T14:36:49.308693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:49.308695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:49.308897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.308908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.308942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:49.308952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.308956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.308959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:49.308972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.308985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:49.308999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.309164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.309190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.309212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.309319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2139 partition: 0 MaxSeqNo: 40 sessionId: src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0
2025-10-10T14:36:49.309740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e384c26-4b11b4e6-647ed17d-6033e744_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:49.312588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0] Write session: try to update token
2025-10-10T14:36:49.312603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:49.328402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId: src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:49.330899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:49.330924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:49.330928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:49.330930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:49.330940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602042651262792:3229]
2025-10-10T14:36:49.330945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602042651262792:3229]
2025-10-10T14:36:49.330949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602042651262792:3229]
2025-10-10T14:36:49.330996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:49.331000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:49.331008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.331010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:49.331011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:49.331014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:49.331212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:49.331267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:49.380586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602043433493292:2605]
2025-10-10T14:36:49.380902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2138, pipe: [1:7559602043433493292:2605]
2025-10-10T14:36:49.452482Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:49.453134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.453154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.453205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493292:2605], now have 1 active actors on pipe
2025-10-10T14:36:49.453459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:49.453777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:49.453825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:49.453894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2139 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0
2025-10-10T14:36:49.454087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2139 sessionId: src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0 is DEAD
2025-10-10T14:36:49.454256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602043433493292:2605]
2025-10-10T14:36:49.457538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:49.457552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0] Write session will restart in 0.005276s
2025-10-10T14:36:49.457577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0] Write session: Do CDS request
2025-10-10T14:36:49.457583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:49.463897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.464027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:49.464046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2140
2025-10-10T14:36:49.464219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.464268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:49.464275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:49.464279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:49.464812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2140 sessionId:  describe result for acl check
2025-10-10T14:36:49.464849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:49.464856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:49.464857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:49.464862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602043433493302:3036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:49.465439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602043433493302:3036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:49.467950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602043433493302:3036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:49.478267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602043433493302:3036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:49.478287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602043433493302:3036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:49.478291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602043433493302:3036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:49.478301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:49.481937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:49.485352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:49.485608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:49.485619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:49.485632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:49.485702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:49.485746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602042651263025:3227]
2025-10-10T14:36:49.486377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:49.486785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:49.486841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:49.487236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:49.487340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.487342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.487343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.487344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.487346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.487347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.487348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.487350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.487351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.487352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.487353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.487354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.487355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.487362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.487376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.487380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.487383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.487387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.487391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.487394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.487398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.487402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.487406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.487410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.487414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.487418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.487428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.487437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.487445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.487451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.487455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.487460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.487465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.487470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.487475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.487480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.487484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.487489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.487494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.487499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.487503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.487508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.487512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.487517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.487521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.487526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.487531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.487536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.487540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.487545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.487550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.487556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.487597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:49.491263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2139
2025-10-10T14:36:49.491293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2139
2025-10-10T14:36:49.490241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:49.490888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:49.490894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:49.490896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:49.490900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:49.490905Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2139 [2:7559602042651263025:3227]
2025-10-10T14:36:49.490919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:49.490937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:49.490941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.490945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.490947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.490965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:49.490975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:49.490983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:49.491053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.491055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.491056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.491059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:49.491130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:49.491133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.491145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.491158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.491175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:49.491198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493293:2438], now have 1 active actors on pipe
2025-10-10T14:36:49.491201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493473:3036], now have 1 active actors on pipe
2025-10-10T14:36:49.491210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602042651263019:3227]
2025-10-10T14:36:49.491212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602042651263019:3227]
2025-10-10T14:36:49.491214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602042651263019:3227]
2025-10-10T14:36:49.491230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:49.491242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:49.491245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:49.491247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:49.491248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:49.491263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:49.491266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:49.491292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602042651263019:3227]
2025-10-10T14:36:49.491300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:49.491312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:49.491729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.491742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.491777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e265f-ca727328-9bc97176-4df73462_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:49.491786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.491800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.491803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:49.491816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.491828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:49.491845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.492220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.492230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.492250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.492524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2140 partition: 0 MaxSeqNo: 40 sessionId: src_id|2e265f-ca727328-9bc97176-4df73462_0
2025-10-10T14:36:49.492981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb97206-9ccc148-2a8d5ab3-5c8e1625_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2e265f-ca727328-9bc97176-4df73462_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:49.495733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e265f-ca727328-9bc97176-4df73462_0] Write session: try to update token
2025-10-10T14:36:49.495754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e265f-ca727328-9bc97176-4df73462_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:49.507986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:49.508005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:49.508015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602042651263019:3227]
2025-10-10T14:36:49.508062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:49.508069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:49.508254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:49.508402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:49.508556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:49.508755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:49.508990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:49.509036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:49.510571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId: src_id|2e265f-ca727328-9bc97176-4df73462_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:49.513741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:49.515544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.515573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.515617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:49.515741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:49.529021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:49.529045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:49.529049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:49.529052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:49.529064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602042651263019:3227]
2025-10-10T14:36:49.529068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602042651263019:3227]
2025-10-10T14:36:49.529073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602042651263019:3227]
2025-10-10T14:36:49.529123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:49.529131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.529134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:49.529162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:49.529169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:49.529173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:49.529272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:49.554657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602043433493524:2605]
2025-10-10T14:36:49.554949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2139, pipe: [1:7559602043433493524:2605]
2025-10-10T14:36:49.652255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:49.661160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.661196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.661603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.661679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.661747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.661816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.661864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.661880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.661950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.662013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.662083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.662147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.662191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.662198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.662269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.662327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.662396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.662463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.662504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.662507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.662592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.662652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.662711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.662775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.662888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.662892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.662956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.663014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.663078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.663145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.663187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.663190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.663264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.663321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.663389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.663452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.663497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.663500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.663571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.663633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.663699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.663763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.663805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.663808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.663919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.663983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.664045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.664122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.664163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.664166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.664232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.664292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.664352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.664414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.664474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.664480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.664550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:49.664676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:49.664737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:49.664799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:49.664839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:49.664845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:49.664924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493524:2605], now have 1 active actors on pipe
2025-10-10T14:36:49.665555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:49.665627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:49.665634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:49.665668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2140 reason: error at write: Disconnected sessionId: src_id|2e265f-ca727328-9bc97176-4df73462_0
2025-10-10T14:36:49.665866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2140 sessionId: src_id|2e265f-ca727328-9bc97176-4df73462_0 is DEAD
2025-10-10T14:36:49.666029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602043433493524:2605]
2025-10-10T14:36:49.666052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e265f-ca727328-9bc97176-4df73462_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:49.666064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e265f-ca727328-9bc97176-4df73462_0] Write session will restart in 0.009110s
2025-10-10T14:36:49.666099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e265f-ca727328-9bc97176-4df73462_0] Write session: Do CDS request
2025-10-10T14:36:49.666105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e265f-ca727328-9bc97176-4df73462_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:49.666479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:49.676962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e265f-ca727328-9bc97176-4df73462_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.677100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:49.677118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2141
2025-10-10T14:36:49.677267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.677307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:49.677318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:49.677325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:49.677881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2141 sessionId:  describe result for acl check
2025-10-10T14:36:49.677920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:49.677927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:49.677929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:49.677937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602043433493585:3052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:49.678559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602043433493585:3052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:49.682362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602043433493585:3052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:49.686005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:49.685695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602043433493585:3052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:49.685714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602043433493585:3052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:49.685718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602043433493585:3052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:49.685728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:49.689059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:49.689367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:49.689389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:49.689412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:49.689525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:49.689577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602042651263252:3219]
2025-10-10T14:36:49.690303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:49.690717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:49.690775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:49.691269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:49.691363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.691369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.691371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.691372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.691373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.691374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.691375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.691377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.691378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.691379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.691381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.691382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.691384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.691391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.691406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.691411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.691415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.691420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.691425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.691429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.691434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.691438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.691452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.691457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.691462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.691466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.691476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.691486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.691494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.691500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.691505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.691511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.691522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.691528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.691533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.691539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.691549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.691554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.691559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.691570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.691575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.691581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.691587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.691593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.691602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.691608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.691616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.691622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.691626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.691633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.691643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.691649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.691698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:49.694419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:49.695103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:49.695109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:49.695112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:49.695116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:49.695122Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2140 [2:7559602042651263252:3219]
2025-10-10T14:36:49.695136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:49.695156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:49.695160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.695164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.695167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.695186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:49.695194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:49.695749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2140
2025-10-10T14:36:49.695755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2140
2025-10-10T14:36:49.695204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:49.695275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.695277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.695279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.695282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:49.695358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:49.695361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.695373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.695387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.695406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:49.695427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602042651263246:3219]
2025-10-10T14:36:49.695430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602042651263246:3219]
2025-10-10T14:36:49.695432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602042651263246:3219]
2025-10-10T14:36:49.695447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:49.695461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:49.695478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:49.695481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:49.695489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:49.695493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:49.695495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:49.695556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602042651263246:3219]
2025-10-10T14:36:49.695559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:49.695577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:49.695593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493745:3052], now have 1 active actors on pipe
2025-10-10T14:36:49.695597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493528:2438], now have 1 active actors on pipe
2025-10-10T14:36:49.695919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.695925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.695962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c82686-3f251f87-230b7140-2657fdb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:49.695973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.695977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.695980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:49.695992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.696004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:49.696023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.696255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.696272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.696294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.696430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2141 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c82686-3f251f87-230b7140-2657fdb6_0
2025-10-10T14:36:49.696836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e265f-ca727328-9bc97176-4df73462_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c82686-3f251f87-230b7140-2657fdb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:49.699714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c82686-3f251f87-230b7140-2657fdb6_0] Write session: try to update token
2025-10-10T14:36:49.699740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c82686-3f251f87-230b7140-2657fdb6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:49.720069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId: src_id|9c82686-3f251f87-230b7140-2657fdb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:49.722948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:49.724766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.724791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.724818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:49.724821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:49.724826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:49.724827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:49.724836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602042651263246:3219]
2025-10-10T14:36:49.724842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602042651263246:3219]
2025-10-10T14:36:49.724848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602042651263246:3219]
2025-10-10T14:36:49.724898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:49.724915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:49.724916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:49.724920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:49.724924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.724926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:49.725085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:49.766100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602043433493763:2605]
2025-10-10T14:36:49.766412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2140, pipe: [1:7559602043433493763:2605]
2025-10-10T14:36:49.840172Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:49.840515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:49.840578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493763:2605], now have 1 active actors on pipe
2025-10-10T14:36:49.841177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:49.841237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:49.841269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:49.841273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:49.841285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602043433493763:2605]
2025-10-10T14:36:49.841362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2141 reason: error at write: Disconnected sessionId: src_id|9c82686-3f251f87-230b7140-2657fdb6_0
2025-10-10T14:36:49.841536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2141 sessionId: src_id|9c82686-3f251f87-230b7140-2657fdb6_0 is DEAD
2025-10-10T14:36:49.842030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c82686-3f251f87-230b7140-2657fdb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:49.842038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c82686-3f251f87-230b7140-2657fdb6_0] Write session will restart in 0.009693s
2025-10-10T14:36:49.842063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c82686-3f251f87-230b7140-2657fdb6_0] Write session: Do CDS request
2025-10-10T14:36:49.842069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c82686-3f251f87-230b7140-2657fdb6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:49.853098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c82686-3f251f87-230b7140-2657fdb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.853207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:49.853235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2142
2025-10-10T14:36:49.853414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:49.853472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:49.853485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:49.853490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:49.854028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2142 sessionId:  describe result for acl check
2025-10-10T14:36:49.854066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:49.854073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:49.854075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:49.854092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602043433493785:3045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:49.854712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602043433493785:3045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:49.859951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602043433493785:3045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:49.863500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602043433493785:3045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:49.863517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602043433493785:3045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:49.863522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602043433493785:3045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:49.863532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:49.867259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:49.869592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:49.869983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:49.869996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:49.870011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:49.870084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:49.870130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602042651263481:3217]
2025-10-10T14:36:49.870740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:49.871074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:49.871126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:49.871464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:49.871531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.871539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.871540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.871541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.871543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.871544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.871546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.871547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.871548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.871550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.871551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.871552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.871554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.871560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.871572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.871576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.871580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.871585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.871589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.871593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.871597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.871602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.871606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.871610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.871614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.871618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.871628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.871637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:49.871643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.871649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:49.871654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.871659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:49.871664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.871670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:49.871681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.871686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:49.871696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.871701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:49.871710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.871720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:49.871725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.871735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:49.871741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.871751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:49.871756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.871766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:49.871775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.871784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.871789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.871795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.871804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.871809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.871848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:49.874515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:49.874865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:49.874870Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:49.874872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:49.874876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:49.874882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2141 [2:7559602042651263481:3217]
2025-10-10T14:36:49.874895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:49.874912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:49.874916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.874919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.874923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.874940Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:49.874947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:49.874957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:49.875013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.875015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.875016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.875019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:49.875092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:49.875095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.875107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:49.875120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:49.875138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:49.875160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493768:2438], now have 1 active actors on pipe
2025-10-10T14:36:49.875163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433493982:3045], now have 1 active actors on pipe
2025-10-10T14:36:49.875171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602042651263475:3217]
2025-10-10T14:36:49.875173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602042651263475:3217]
2025-10-10T14:36:49.875175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602042651263475:3217]
2025-10-10T14:36:49.875188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:49.875202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:49.875211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:49.875472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2141
2025-10-10T14:36:49.875214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:49.875506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2141
2025-10-10T14:36:49.875217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:49.875219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:49.875221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:49.875245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602042651263475:3217]
2025-10-10T14:36:49.875253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:49.875297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:49.875830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.875843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.875878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:49.875887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:49.875968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:49.875974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:49.875989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:49.876003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:49.876022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.876464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.876476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.876498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:49.876620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2142 partition: 0 MaxSeqNo: 40 sessionId: src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0
2025-10-10T14:36:49.877058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c82686-3f251f87-230b7140-2657fdb6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:49.880643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0] Write session: try to update token
2025-10-10T14:36:49.880665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:49.898739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId: src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:49.901837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:49.902148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:49.902173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:49.902219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:49.905261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:49.905281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:49.905284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:49.905287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:49.905297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602042651263475:3217]
2025-10-10T14:36:49.905300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602042651263475:3217]
2025-10-10T14:36:49.905303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602042651263475:3217]
2025-10-10T14:36:49.905371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:49.905375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:49.905381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:49.905385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:49.905386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:49.905389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:49.905534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:49.902407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:49.941697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602043433494024:2605]
2025-10-10T14:36:49.942158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2141, pipe: [1:7559602043433494024:2605]
2025-10-10T14:36:50.037464Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:50.046181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.046214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.046393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.046461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.046524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.046596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.046643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.046656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.046728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.046794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.046861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.046930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.046973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.046982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.047047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.047110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.047176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.047242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.047785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.047798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.047914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.047981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.048046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.048136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.048183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.048191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.048261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.048328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.048398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.048521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.048571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.048586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.048661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.048723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.048797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.048865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.048977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.048985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.049053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.049117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.049185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.049250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.049311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.049318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.049424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.049490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.049557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.049635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.049681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.049688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.049754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.049825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.049890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.049960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.050098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.050108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.050177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.050241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.050309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.050376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.050426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.050438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.050511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602043433494024:2605], now have 1 active actors on pipe
2025-10-10T14:36:50.050811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602043433494024:2605]
2025-10-10T14:36:50.050843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:50.051068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:50.051460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:50.051519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2142 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0
2025-10-10T14:36:50.051727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2142 sessionId: src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0 is DEAD
2025-10-10T14:36:50.051850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:50.051859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0] Write session will restart in 0.009269s
2025-10-10T14:36:50.051888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0] Write session: Do CDS request
2025-10-10T14:36:50.051894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:50.061882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.062602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:50.062621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2143
2025-10-10T14:36:50.062782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.062831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:50.062838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:50.062842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:50.063418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2143 sessionId:  describe result for acl check
2025-10-10T14:36:50.063459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:50.063466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:50.063468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:50.063538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602047728461395:3081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:50.064158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602047728461395:3081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:50.071302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:50.071181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602047728461395:3081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:50.074051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:50.074194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602047728461395:3081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:50.074212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602047728461395:3081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:50.074216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602047728461395:3081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:50.074224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:50.074288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:50.074301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:50.074313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:50.074378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:50.074434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602046946231056:3186]
2025-10-10T14:36:50.074977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:50.075275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:50.075322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:50.075657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:50.075723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.075729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.075730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.075731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.075732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.075734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.075735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.075736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.075738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.075739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.075740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.075741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.075743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.075750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.075765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.075769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.075773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.075778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.075782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.075786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.075791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.075795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.075800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.075805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.075809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.075814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.075822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.075836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.075844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.075851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.075861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.075867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.075876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.075882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.075891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.075897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.075905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.075911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.075919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.075928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.075934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.075943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.075948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.075954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.075960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.075967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.075975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.075981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.075989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.075996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.076004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.076009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.076058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:50.078581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:50.078908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:50.078921Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:50.078924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:50.078927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:50.078933Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2142 [2:7559602046946231056:3186]
2025-10-10T14:36:50.078947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:50.078965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:50.078973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.078977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.078979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.078997Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:50.079008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:50.079015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:50.079070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.079079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.079081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.079084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:50.079158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:50.079165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.079176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.079192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.079229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:50.079255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728461323:2438], now have 1 active actors on pipe
2025-10-10T14:36:50.079263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728461556:3081], now have 1 active actors on pipe
2025-10-10T14:36:50.079271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602046946231051:3186]
2025-10-10T14:36:50.079274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602046946231051:3186]
2025-10-10T14:36:50.079276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602046946231051:3186]
2025-10-10T14:36:50.079291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:50.079283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2142
2025-10-10T14:36:50.079309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:50.079314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:50.079318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:50.079320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:50.079330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:50.079284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2142
2025-10-10T14:36:50.079334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:50.079364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602046946231051:3186]
2025-10-10T14:36:50.079377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:50.079384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:50.079393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.079398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.079446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:50.079458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.079461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.079463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:50.079475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.079490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:50.079507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.079649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.079656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.079670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.079738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2143 partition: 0 MaxSeqNo: 40 sessionId: src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0
2025-10-10T14:36:50.080138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e902ee-af7a7295-c067e6b2-946f20a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:50.082828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0] Write session: try to update token
2025-10-10T14:36:50.082847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:50.099203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId: src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:50.099921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:50.099953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:50.099956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:50.099959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:50.099971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602046946231051:3186]
2025-10-10T14:36:50.099974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602046946231051:3186]
2025-10-10T14:36:50.099980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602046946231051:3186]
2025-10-10T14:36:50.100025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:50.100038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:50.100042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:50.100043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:50.100051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.100054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:50.100262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:50.102157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:50.151088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602047728461568:2605]
2025-10-10T14:36:50.151392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2142, pipe: [1:7559602047728461568:2605]
2025-10-10T14:36:50.218023Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:50.218507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.218526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.218575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728461568:2605], now have 1 active actors on pipe
2025-10-10T14:36:50.218822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:50.218819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:50.218842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:50.218847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:50.218880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602047728461568:2605]
2025-10-10T14:36:50.218927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2143 reason: error at write: Disconnected sessionId: src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0
2025-10-10T14:36:50.219282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:50.219291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0] Write session will restart in 0.009345s
2025-10-10T14:36:50.219316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0] Write session: Do CDS request
2025-10-10T14:36:50.219323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:50.219145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2143 sessionId: src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0 is DEAD
2025-10-10T14:36:50.229899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.229949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:50.229966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2144
2025-10-10T14:36:50.230113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.230160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:50.230171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:50.230175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:50.230691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2144 sessionId:  describe result for acl check
2025-10-10T14:36:50.230733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:50.230735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:50.230737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:50.230743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602047728461654:3090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:50.231326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602047728461654:3090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:50.233959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602047728461654:3090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:50.236690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:50.236723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602047728461654:3090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:50.236737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602047728461654:3090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:50.236740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602047728461654:3090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:50.236749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:50.239303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:50.239532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:50.239544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:50.239556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:50.239608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:50.239648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602046946231287:3184]
2025-10-10T14:36:50.240269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:50.240582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:50.240625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:50.240942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:50.240997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.241004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.241005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.241006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.241007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.241008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.241009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.241011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.241012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.241013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.241014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.241015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.241016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.241022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.241035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.241038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.241042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.241046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.241049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.241053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.241057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.241061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.241064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.241067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.241071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.241075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.241082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.241091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.241097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.241102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.241107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.241112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.241117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.241122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.241126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.241131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.241135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.241140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.241145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.241150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.241155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.241160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.241164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.241169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.241173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.241178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.241182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.241187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.241190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.241195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.241207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.241212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.241250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:50.243974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:50.244403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:50.244419Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:50.244422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:50.244426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:50.244434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2143 [2:7559602046946231287:3184]
2025-10-10T14:36:50.244451Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:50.244477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:50.244486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.244490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.244492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.244513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:50.244527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:50.244542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:50.244636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.244647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.244649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.244653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:50.244736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:50.244745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.244757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.244772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.244795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:50.244824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602046946231281:3184]
2025-10-10T14:36:50.244834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602046946231281:3184]
2025-10-10T14:36:50.244837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602046946231281:3184]
2025-10-10T14:36:50.244848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:50.244857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:50.244861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:50.244863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:50.244869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:50.244887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:50.244890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:50.244903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728461569:2438], now have 1 active actors on pipe
2025-10-10T14:36:50.244912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728461790:3090], now have 1 active actors on pipe
2025-10-10T14:36:50.244928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2143
2025-10-10T14:36:50.244945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602046946231281:3184]
2025-10-10T14:36:50.244965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:50.244982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:50.244967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2143
2025-10-10T14:36:50.245419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.245434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.245470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10e3436b-57f215f3-b7f02279-48b317cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:50.245485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.245491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.245494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:50.245508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.245528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:50.245551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.245839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.245851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.245873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.245972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2144 partition: 0 MaxSeqNo: 40 sessionId: src_id|10e3436b-57f215f3-b7f02279-48b317cf_0
2025-10-10T14:36:50.246464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|292fa257-61efdd00-98da3dfe-8e7b1502_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|10e3436b-57f215f3-b7f02279-48b317cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:50.249497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e3436b-57f215f3-b7f02279-48b317cf_0] Write session: try to update token
2025-10-10T14:36:50.249521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e3436b-57f215f3-b7f02279-48b317cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:50.266643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:50.266669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:50.266673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:50.266676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:50.266688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602046946231281:3184]
2025-10-10T14:36:50.266694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602046946231281:3184]
2025-10-10T14:36:50.266699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602046946231281:3184]
2025-10-10T14:36:50.266759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:50.266769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.266772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:50.266800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:50.266816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:50.266821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:50.266924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:50.268440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId: src_id|10e3436b-57f215f3-b7f02279-48b317cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:50.271847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:50.321553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602047728461803:2605]
2025-10-10T14:36:50.322036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2143, pipe: [1:7559602047728461803:2605]
2025-10-10T14:36:50.387592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:50.387654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602047728461803:2605]
2025-10-10T14:36:50.387675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:50.387678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:50.387750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2144 reason: error at write: Disconnected sessionId: src_id|10e3436b-57f215f3-b7f02279-48b317cf_0
2025-10-10T14:36:50.388194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e3436b-57f215f3-b7f02279-48b317cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:50.388208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e3436b-57f215f3-b7f02279-48b317cf_0] Write session will restart in 0.008843s
2025-10-10T14:36:50.388233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e3436b-57f215f3-b7f02279-48b317cf_0] Write session: Do CDS request
2025-10-10T14:36:50.388248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e3436b-57f215f3-b7f02279-48b317cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:50.388065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2144 sessionId: src_id|10e3436b-57f215f3-b7f02279-48b317cf_0 is DEAD
2025-10-10T14:36:50.386829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:50.387134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.387146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.387197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728461803:2605], now have 1 active actors on pipe
2025-10-10T14:36:50.387668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:50.397862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e3436b-57f215f3-b7f02279-48b317cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.398279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:50.398300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2145
2025-10-10T14:36:50.400136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.400197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:50.400203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:50.400214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:50.400863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2145 sessionId:  describe result for acl check
2025-10-10T14:36:50.400905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:50.400908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:50.400910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:50.400917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602047728461884:3098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:50.401543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602047728461884:3098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:50.405595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602047728461884:3098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:50.413381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602047728461884:3098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:50.413402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602047728461884:3098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:50.413407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602047728461884:3098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:50.413420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:50.414559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:50.415630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:50.415824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:50.415828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:50.415840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:50.415889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:50.415926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602046946231518:3179]
2025-10-10T14:36:50.416558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:50.416846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:50.416882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:50.417201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:50.417255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.417256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.417258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.417259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.417261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.417262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.417263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.417265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.417266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.417267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.417268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.417270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.417271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.417276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.417290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.417295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.417300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.417304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.417309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.417314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.417318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.417322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.417529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.417546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.417550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.417554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.417564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.417573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.417580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.417586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.417590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.417596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.417600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.417606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.417611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.417616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.417621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.417626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.417631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.417637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.417642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.417648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.417653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.417659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.417663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.417669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.417675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.417680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.417687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.417692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.417697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.417702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.417749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:50.424994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2144
2025-10-10T14:36:50.425031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2144
2025-10-10T14:36:50.424081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:50.424480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:50.424486Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:50.424489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:50.424493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:50.424502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2144 [2:7559602046946231518:3179]
2025-10-10T14:36:50.424516Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:50.424539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:50.424543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.424547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.424550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.424571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:50.424580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:50.424589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:50.424663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.424666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.424668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.424671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:50.424757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:50.424760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.424772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.424783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.424800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:50.424826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462026:3098], now have 1 active actors on pipe
2025-10-10T14:36:50.424830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728461804:2438], now have 1 active actors on pipe
2025-10-10T14:36:50.424839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602046946231513:3179]
2025-10-10T14:36:50.424841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602046946231513:3179]
2025-10-10T14:36:50.424844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602046946231513:3179]
2025-10-10T14:36:50.424858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:50.424874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:50.424891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:50.424894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:50.424932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:50.424935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:50.424937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602046946231513:3179]
2025-10-10T14:36:50.424938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:50.424939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:50.424946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:50.425212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.425222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.425280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8292ae67-b6628807-85a2b6c7-6092a145_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:50.425299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.425304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.425307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:50.425323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.425356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:50.425379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.425885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2145 partition: 0 MaxSeqNo: 40 sessionId: src_id|8292ae67-b6628807-85a2b6c7-6092a145_0
2025-10-10T14:36:50.425680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.425694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.425717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.429469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e3436b-57f215f3-b7f02279-48b317cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8292ae67-b6628807-85a2b6c7-6092a145_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:50.432270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8292ae67-b6628807-85a2b6c7-6092a145_0] Write session: try to update token
2025-10-10T14:36:50.432296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8292ae67-b6628807-85a2b6c7-6092a145_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:50.451012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId: src_id|8292ae67-b6628807-85a2b6c7-6092a145_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:50.453884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:50.454316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:50.454163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.454186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.454222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:50.463188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:50.463210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:50.463213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:50.463214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:50.463223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602046946231513:3179]
2025-10-10T14:36:50.463227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602046946231513:3179]
2025-10-10T14:36:50.463230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602046946231513:3179]
2025-10-10T14:36:50.463273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:50.463280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.463281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:50.463291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:50.463311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:50.463326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:50.463416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:50.488014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602047728462040:2605]
2025-10-10T14:36:50.488435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2144, pipe: [1:7559602047728462040:2605]
2025-10-10T14:36:50.579095Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:50.587579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.587611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.587811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.587895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.587980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.588053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.588118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.588131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.588210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.588279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.588357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.588466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.588526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.588533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.588648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.588725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.588792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.588870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.588911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.588914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.588991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.589059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.589129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.589193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.589236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.589240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.589323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.589472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.589555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.589631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.589682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.589689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.589762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.591629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:50.591657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:50.591693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2145 reason: error at write: Disconnected sessionId: src_id|8292ae67-b6628807-85a2b6c7-6092a145_0
2025-10-10T14:36:50.591977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2145 sessionId: src_id|8292ae67-b6628807-85a2b6c7-6092a145_0 is DEAD
2025-10-10T14:36:50.591980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602047728462040:2605]
2025-10-10T14:36:50.592023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:50.592127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292ae67-b6628807-85a2b6c7-6092a145_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:50.592140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292ae67-b6628807-85a2b6c7-6092a145_0] Write session will restart in 0.009541s
2025-10-10T14:36:50.592166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292ae67-b6628807-85a2b6c7-6092a145_0] Write session: Do CDS request
2025-10-10T14:36:50.592173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292ae67-b6628807-85a2b6c7-6092a145_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:50.589838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.589909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.589974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.590019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.590022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.590091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.590156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.590225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.590291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.590337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.590340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.590418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.590480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.590548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.590611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.590654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.590658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.590733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.590793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.590858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.590920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.590962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.590965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.591036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.591096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.591156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.591223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.591266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.591269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.591341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462040:2605], now have 1 active actors on pipe
2025-10-10T14:36:50.592851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:50.602885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8292ae67-b6628807-85a2b6c7-6092a145_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.603260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:50.603278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2146
2025-10-10T14:36:50.603439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.603494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:50.603505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:50.603509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:50.604014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2146 sessionId:  describe result for acl check
2025-10-10T14:36:50.604052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:50.604059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:50.604060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:50.604068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602047728462058:3105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:50.604637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602047728462058:3105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:50.608459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602047728462058:3105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:50.612114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602047728462058:3105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:50.612131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602047728462058:3105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:50.612135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602047728462058:3105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:50.612145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:50.615508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:50.618585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:50.618856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:50.618867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:50.618879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:50.618944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:50.618994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602046946231751:3176]
2025-10-10T14:36:50.619634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:50.619958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:50.620016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:50.620380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:50.620442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.620448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.620449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.620451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.620452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.620453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.620455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.620456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.620458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.620460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.620461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.620462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.620464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.620477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.620487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.620490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.620492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.620494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.620497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.620499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.620503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.620507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.620511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.620515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.620519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.620523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.620530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.620539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.620545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.620551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.620555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.620560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.620571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.620577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.620581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.620584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.620587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.620591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.620594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.620597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.620600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.620605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.620611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.620621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.620625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.620630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.620641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.620646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.620651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.620656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.620661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.620664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.620691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:50.623448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:50.623787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:50.623807Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:50.623809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:50.623814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:50.623830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2145 [2:7559602046946231751:3176]
2025-10-10T14:36:50.623846Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:50.623865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:50.623869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.623873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.623875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.623893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:50.623918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:50.623931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:50.623997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.624007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.624009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.624012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:50.624111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:50.624121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.624146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.624163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.624186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:50.624214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462042:2438], now have 1 active actors on pipe
2025-10-10T14:36:50.624219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462224:3105], now have 1 active actors on pipe
2025-10-10T14:36:50.624227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602046946231746:3176]
2025-10-10T14:36:50.624231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602046946231746:3176]
2025-10-10T14:36:50.624233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602046946231746:3176]
2025-10-10T14:36:50.624248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:50.624267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:50.624270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2145
2025-10-10T14:36:50.624283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:50.624281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2145
2025-10-10T14:36:50.624286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:50.624289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:50.624289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:50.624293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:50.624327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602046946231746:3176]
2025-10-10T14:36:50.624331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:50.624333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:50.624349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.624355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.624408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:50.624421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.624425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.624427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:50.624440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.624452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:50.624475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.624628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.624639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.624655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.624757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2146 partition: 0 MaxSeqNo: 40 sessionId: src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0
2025-10-10T14:36:50.625227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8292ae67-b6628807-85a2b6c7-6092a145_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:50.627989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0] Write session: try to update token
2025-10-10T14:36:50.628009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:50.642683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId: src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:50.645223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:50.645245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:50.645249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:50.645251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:50.645261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602046946231746:3176]
2025-10-10T14:36:50.645266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602046946231746:3176]
2025-10-10T14:36:50.645272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602046946231746:3176]
2025-10-10T14:36:50.645327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:50.645349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:50.645354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.645356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:50.645357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:50.645364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:50.645496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:50.645549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:50.692260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602047728462278:2605]
2025-10-10T14:36:50.692598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2145, pipe: [1:7559602047728462278:2605]
2025-10-10T14:36:50.759780Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:50.760303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.760320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.760368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462278:2605], now have 1 active actors on pipe
2025-10-10T14:36:50.760575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:50.760589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:50.760601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:50.760605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:50.760657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602047728462278:2605]
2025-10-10T14:36:50.760683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2146 reason: error at write: Disconnected sessionId: src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0
2025-10-10T14:36:50.760925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2146 sessionId: src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0 is DEAD
2025-10-10T14:36:50.761263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:50.761276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0] Write session will restart in 0.007350s
2025-10-10T14:36:50.761301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0] Write session: Do CDS request
2025-10-10T14:36:50.761311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:50.769977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.770062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:50.770090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2147
2025-10-10T14:36:50.770254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.770302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:50.770330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:50.770339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:50.770947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2147 sessionId:  describe result for acl check
2025-10-10T14:36:50.770984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:50.770991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:50.770992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:50.770999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602047728462324:3136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:50.771580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602047728462324:3136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:50.774402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602047728462324:3136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:50.777106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602047728462324:3136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:50.777120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602047728462324:3136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:50.777123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602047728462324:3136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:50.777131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:50.779308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:50.782106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:50.782329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:50.782341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:50.782353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:50.782413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:50.782461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602046946231984:3173]
2025-10-10T14:36:50.783138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:50.783455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:50.783507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:50.783849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:50.783910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.783920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.783921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.783922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.783924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.783925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.783927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.783928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.783928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.783930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.783931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.783932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.783933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.783939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.783953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.783959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.783963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.783968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.783973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.783977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.783981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.783986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.783991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.783995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.783999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.784003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.784011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.784024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.784032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.784038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.784043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.784049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.784055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.784061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.784066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.784072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.784092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.784098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.784110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.784116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.784126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.784132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.784142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.784148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.784157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.784162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.784190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.784200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.784205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.784211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.784217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.784224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.784288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:50.786796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:50.787469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:50.787486Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:50.787488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:50.787493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:50.787500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2146 [2:7559602046946231984:3173]
2025-10-10T14:36:50.787512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:50.787547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:50.787555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.787559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.787562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.787579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:50.787591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:50.787605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:50.787670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.787678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.787681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.787684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:50.787754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:50.787762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.787775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.787795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.787819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:50.787846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462286:2438], now have 1 active actors on pipe
2025-10-10T14:36:50.787855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462503:3136], now have 1 active actors on pipe
2025-10-10T14:36:50.787862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602046946231979:3173]
2025-10-10T14:36:50.787869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602046946231979:3173]
2025-10-10T14:36:50.787872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602046946231979:3173]
2025-10-10T14:36:50.787885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:50.787899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:50.787902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:50.787904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:50.787904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:50.787922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:50.787930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:50.787953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602046946231979:3173]
2025-10-10T14:36:50.787970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:50.787969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2146
2025-10-10T14:36:50.788005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:50.787970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2146
2025-10-10T14:36:50.788052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.788066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.788112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e791b46f-7cf3665a-b430494b-bf63831b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:50.788127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.788137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.788140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:50.788152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.788167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:50.788189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.788345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.788353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.788368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.788501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2147 partition: 0 MaxSeqNo: 40 sessionId: src_id|e791b46f-7cf3665a-b430494b-bf63831b_0
2025-10-10T14:36:50.788945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bd192f-8b4b03c6-439ea77-a6f4177e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e791b46f-7cf3665a-b430494b-bf63831b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:50.791711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e791b46f-7cf3665a-b430494b-bf63831b_0] Write session: try to update token
2025-10-10T14:36:50.791731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e791b46f-7cf3665a-b430494b-bf63831b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:50.806195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:50.806220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:50.806234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602046946231979:3173]
2025-10-10T14:36:50.806289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:50.806289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:50.806483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:50.806634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:50.806781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:50.806926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:50.807119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:50.807167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:50.807361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId: src_id|e791b46f-7cf3665a-b430494b-bf63831b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:50.810120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:50.810365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.810386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.810426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:50.810524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:50.818806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:50.818827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:50.818830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:50.818832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:50.818844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602046946231979:3173]
2025-10-10T14:36:50.818848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602046946231979:3173]
2025-10-10T14:36:50.818851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602046946231979:3173]
2025-10-10T14:36:50.818894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:50.818899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:50.818908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.818910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:50.818913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:50.818917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:50.819059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:50.860772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602047728462526:2605]
2025-10-10T14:36:50.861198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2146, pipe: [1:7559602047728462526:2605]
2025-10-10T14:36:50.937169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:50.945544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.945568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.945737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.945796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.945862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.945928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.945975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.945986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.946065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.946129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.946203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.946276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.946328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.946330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.946402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.946471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.946539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.946606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.946649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.946656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.946723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.946791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.946859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.946929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.946976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.946984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.947052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.947109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.947175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.947239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.947304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.947315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.947392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.947459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.947529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.947591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.947632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.947641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.947713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.947774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.947844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.947901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.947949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.947960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.948032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.948115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.948185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.948252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.948300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.948307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.948380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.948447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.948512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.948580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.948627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.948637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.948706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:50.948774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:50.948841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:50.948906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:50.948957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:50.948965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:50.949019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462526:2605], now have 1 active actors on pipe
2025-10-10T14:36:50.949322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602047728462526:2605]
2025-10-10T14:36:50.949378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:50.949442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:50.949452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:50.949493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2147 reason: error at write: Disconnected sessionId: src_id|e791b46f-7cf3665a-b430494b-bf63831b_0
2025-10-10T14:36:50.949699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2147 sessionId: src_id|e791b46f-7cf3665a-b430494b-bf63831b_0 is DEAD
2025-10-10T14:36:50.949844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e791b46f-7cf3665a-b430494b-bf63831b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:50.949855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e791b46f-7cf3665a-b430494b-bf63831b_0] Write session will restart in 0.007954s
2025-10-10T14:36:50.949881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e791b46f-7cf3665a-b430494b-bf63831b_0] Write session: Do CDS request
2025-10-10T14:36:50.949886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e791b46f-7cf3665a-b430494b-bf63831b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:50.950208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:50.958889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e791b46f-7cf3665a-b430494b-bf63831b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.959003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:50.959021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2148
2025-10-10T14:36:50.959151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:50.959186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:50.959196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:50.959200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:50.959597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2148 sessionId:  describe result for acl check
2025-10-10T14:36:50.959631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:50.959643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:50.959645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:50.959650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602047728462559:3132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:50.960246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602047728462559:3132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:50.963312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602047728462559:3132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:50.966809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602047728462559:3132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:50.966823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602047728462559:3132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:50.966826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602047728462559:3132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:50.966835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:50.970075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:50.973064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:50.973308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:50.973321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:50.973352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:50.973411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:50.973451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602046946232230:3159]
2025-10-10T14:36:50.974122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:50.974453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:50.974508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:50.974845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:50.974906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.974911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.974913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.974914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.974915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.974917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.974918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.974919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.974921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.974921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.974922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.974923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.974924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.974931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.974944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.974949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.974953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.974957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.974961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.974965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.974969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.974973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.974978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.974982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.974987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.974991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.974999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.975008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:50.975014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.975020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:50.975025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.975030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:50.975035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.975041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:50.975045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.975052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:50.975057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.975063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:50.975067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.975073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:50.975077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.975083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:50.975094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.975100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:50.975109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.975114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:50.975123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.975129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.975137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.975142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.975147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.975152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.975195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:50.977777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:50.978247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:50.978260Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:50.978263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:50.978267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:50.978275Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2147 [2:7559602046946232230:3159]
2025-10-10T14:36:50.978290Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:50.978313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:50.978321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.978324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.978327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.978345Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:50.978357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:50.978369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:50.978433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.978440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.978442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.978445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:50.978521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:50.978530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:50.978541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:50.978569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:50.978592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:50.978701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2147
2025-10-10T14:36:50.978766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2147
2025-10-10T14:36:50.978900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462707:3132], now have 1 active actors on pipe
2025-10-10T14:36:50.978912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602047728462541:2438], now have 1 active actors on pipe
2025-10-10T14:36:50.978921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602046946232225:3159]
2025-10-10T14:36:50.978923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602046946232225:3159]
2025-10-10T14:36:50.978925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602046946232225:3159]
2025-10-10T14:36:50.978942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:50.978963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:50.978985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:50.978992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:50.979016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.979025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.979064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602046946232225:3159]
2025-10-10T14:36:50.979071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:50.979072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:50.979076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:50.979078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:50.979086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:50.979092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|728e13f-e557a258-521f90ed-3b700f08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:50.979100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:50.979104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:50.979106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:50.979119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:50.979132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:50.979170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.979384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:50.979392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:50.979408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:50.979507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2148 partition: 0 MaxSeqNo: 40 sessionId: src_id|728e13f-e557a258-521f90ed-3b700f08_0
2025-10-10T14:36:50.979940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e791b46f-7cf3665a-b430494b-bf63831b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|728e13f-e557a258-521f90ed-3b700f08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:50.982847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728e13f-e557a258-521f90ed-3b700f08_0] Write session: try to update token
2025-10-10T14:36:50.982868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728e13f-e557a258-521f90ed-3b700f08_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:50.991348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:50.991368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:50.991379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602046946232225:3159]
2025-10-10T14:36:50.991432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:50.991609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:50.991754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:50.991894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:50.992044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:50.992495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:50.992547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:50.995070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:51.003007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId: src_id|728e13f-e557a258-521f90ed-3b700f08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:51.006073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.006100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.006157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:51.005782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:51.006356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:51.014950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:51.014976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:51.014979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:51.014981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:51.014992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602046946232225:3159]
2025-10-10T14:36:51.014996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602046946232225:3159]
2025-10-10T14:36:51.015001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602046946232225:3159]
2025-10-10T14:36:51.015047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:51.015051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:51.015060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.015063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:51.015063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:51.015071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:51.015201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:51.049684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602052023430085:2605]
2025-10-10T14:36:51.050032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2147, pipe: [1:7559602052023430085:2605]
2025-10-10T14:36:51.133512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:51.142087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.142124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.142329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.142406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.142487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.142561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.142693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.142704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.142780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.142848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.142922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.143001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.143051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.143059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.143134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.143212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.143290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.143375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.143421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.143429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.143524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.143591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.143658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.143725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.143768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.143771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.143845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.143910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.143983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.144055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.144114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.144117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.144193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.144257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.144322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.144384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.144491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.144494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.144568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.144631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.144702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.144771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.144814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.144817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.144891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.144954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.145022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.145088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.145134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.145138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.145212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.145277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.145397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.145471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.145519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.145522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.145597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:51.145658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:51.145724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:51.145803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:51.145845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:51.145848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:51.145917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430085:2605], now have 1 active actors on pipe
2025-10-10T14:36:51.147177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:51.146951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602052023430085:2605]
2025-10-10T14:36:51.146993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:51.147005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:51.147035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2148 reason: error at write: Disconnected sessionId: src_id|728e13f-e557a258-521f90ed-3b700f08_0
2025-10-10T14:36:51.147259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:51.147630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2148 sessionId: src_id|728e13f-e557a258-521f90ed-3b700f08_0 is DEAD
2025-10-10T14:36:51.149838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728e13f-e557a258-521f90ed-3b700f08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:51.149851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728e13f-e557a258-521f90ed-3b700f08_0] Write session will restart in 0.006949s
2025-10-10T14:36:51.149880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728e13f-e557a258-521f90ed-3b700f08_0] Write session: Do CDS request
2025-10-10T14:36:51.149887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728e13f-e557a258-521f90ed-3b700f08_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:51.158105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|728e13f-e557a258-521f90ed-3b700f08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.158069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:51.158089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2149
2025-10-10T14:36:51.158307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.158340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:51.158353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:51.158357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:51.158919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2149 sessionId:  describe result for acl check
2025-10-10T14:36:51.158972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:51.158978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:51.158981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:51.158987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602052023430115:3151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:51.159598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602052023430115:3151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:51.162961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602052023430115:3151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:51.174463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602052023430115:3151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:51.174484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602052023430115:3151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:51.174488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602052023430115:3151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:51.174498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:51.186011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:51.191995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:51.192272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:51.192277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:51.192290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:51.192353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:51.192393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602051241199800:3145]
2025-10-10T14:36:51.193016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:51.193445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:51.193487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:51.193810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:51.193879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.193881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.193882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.193883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.193885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.193886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.193887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.193888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.193889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.193891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.193892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.193893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.193894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.193899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.193912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.193917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.193921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.193925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.193930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.193934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.193938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.193942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.193947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.193951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.193955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.193959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.193968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.193977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.193984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.193990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.193994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.194000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.194004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.194009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.194015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.194020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.194024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.194030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.194035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.194040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.194045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.194050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.194055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.194061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.194065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.194071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.194075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.194081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.194086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.194091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.194098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.194104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.194161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:51.198354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:51.198954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:51.198968Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:51.198970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:51.198974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:51.198980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2148 [2:7559602051241199800:3145]
2025-10-10T14:36:51.198995Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:51.199015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:51.199018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.199022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.199025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.199042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:51.199050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:51.199058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:51.199124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.199126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.199128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.199132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:51.199203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:51.199214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.199224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.199235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.199252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:51.199279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430226:3151], now have 1 active actors on pipe
2025-10-10T14:36:51.199288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430101:2438], now have 1 active actors on pipe
2025-10-10T14:36:51.199296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602051241199794:3145]
2025-10-10T14:36:51.199298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602051241199794:3145]
2025-10-10T14:36:51.199300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602051241199794:3145]
2025-10-10T14:36:51.199313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:51.199325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:51.199327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:51.199329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:51.199332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:51.199347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:51.199355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:51.199383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602051241199794:3145]
2025-10-10T14:36:51.199390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:51.199453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:51.199591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2148
2025-10-10T14:36:51.199644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2148
2025-10-10T14:36:51.199669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.199680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.199711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:51.199724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.199729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.199732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:51.199744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.199770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:51.199789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.200002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.200017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.200040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.200173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2149 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0
2025-10-10T14:36:51.202494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|728e13f-e557a258-521f90ed-3b700f08_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:51.205240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0] Write session: try to update token
2025-10-10T14:36:51.205258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:51.220057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId: src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:51.221928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:51.221950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:51.221953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:51.221955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:51.221965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602051241199794:3145]
2025-10-10T14:36:51.221970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602051241199794:3145]
2025-10-10T14:36:51.221974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602051241199794:3145]
2025-10-10T14:36:51.222027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:51.222032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:51.222035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:51.222040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:51.222040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.222042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:51.222222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:51.222854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:51.247439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602052023430338:2605]
2025-10-10T14:36:51.247809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2148, pipe: [1:7559602052023430338:2605]
2025-10-10T14:36:51.341538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:51.342234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.342258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.342304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430338:2605], now have 1 active actors on pipe
2025-10-10T14:36:51.342957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:51.342965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:51.342970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:51.343017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602052023430338:2605]
2025-10-10T14:36:51.343035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2149 reason: error at write: Disconnected sessionId: src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0
2025-10-10T14:36:51.342972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:51.343267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2149 sessionId: src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0 is DEAD
2025-10-10T14:36:51.343440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:51.343452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0] Write session will restart in 0.007184s
2025-10-10T14:36:51.343492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0] Write session: Do CDS request
2025-10-10T14:36:51.343500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:51.352042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.352130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:51.352156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2150
2025-10-10T14:36:51.352304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.352363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:51.352373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:51.352377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:51.352815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2150 sessionId:  describe result for acl check
2025-10-10T14:36:51.352855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:51.352861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:51.352863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:51.352869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602052023430359:3159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:51.353433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602052023430359:3159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:51.356259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602052023430359:3159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:51.364756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602052023430359:3159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:51.364777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602052023430359:3159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:51.364781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602052023430359:3159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:51.364791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:51.376203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:51.378513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:51.378822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:51.378837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:51.378851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:51.378917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:51.378961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602051241200035:3143]
2025-10-10T14:36:51.379605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:51.385654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:51.385784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:51.386209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:51.386309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.386318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.386320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.386321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.386322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.386324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.386325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.386327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.386328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.386330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.386331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.386332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.386334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.386343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.386356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.386361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.386365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.386369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.386373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.386378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.386381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.386386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.386391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.386394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.386398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.386402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.386413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.386424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.386438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.386448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.386453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.386463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.386472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.386482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.386487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.386498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.386508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.386513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.386524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.386530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.386539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.386544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.386550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.386560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.386566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.386575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.386581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.386593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.386601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.386607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.386617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.386622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.386672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:51.390505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:51.390856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:51.390872Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:51.390875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:51.390879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:51.390887Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2149 [2:7559602051241200035:3143]
2025-10-10T14:36:51.390904Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:51.390943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:51.390953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.390957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.390960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.390979Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:51.390988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:51.390997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:51.391070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.391079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.391081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.391085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:51.391160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:51.391173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.391187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.391199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.391219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:51.391242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602051241200030:3143]
2025-10-10T14:36:51.391251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602051241200030:3143]
2025-10-10T14:36:51.391254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602051241200030:3143]
2025-10-10T14:36:51.391268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:51.391286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:51.391304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:51.391307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:51.391346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602051241200030:3143]
2025-10-10T14:36:51.391349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:51.391719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2149
2025-10-10T14:36:51.391591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:51.391597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:51.391601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:51.391607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:51.391911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2149
2025-10-10T14:36:51.391930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430344:2438], now have 1 active actors on pipe
2025-10-10T14:36:51.391945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430441:3159], now have 1 active actors on pipe
2025-10-10T14:36:51.392110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.392124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.392157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:51.392169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.392174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.392178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:51.392191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.392206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:51.392229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.392560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.392575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.392598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.392758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2150 partition: 0 MaxSeqNo: 40 sessionId: src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0
2025-10-10T14:36:51.393153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa716430-9c72854c-4337cf4e-edde8ce3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:51.396031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0] Write session: try to update token
2025-10-10T14:36:51.396051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:51.412587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:51.412608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:51.412611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:51.412613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:51.412623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602051241200030:3143]
2025-10-10T14:36:51.412628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602051241200030:3143]
2025-10-10T14:36:51.412632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602051241200030:3143]
2025-10-10T14:36:51.412682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:51.412692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.412694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:51.412696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:51.412704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:51.412708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:51.412835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:51.415106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId: src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:51.417951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:51.442054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602052023430583:2605]
2025-10-10T14:36:51.442393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2149, pipe: [1:7559602052023430583:2605]
2025-10-10T14:36:51.530434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:51.531238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.531263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.531317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430583:2605], now have 1 active actors on pipe
2025-10-10T14:36:51.531660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:51.531736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602052023430583:2605]
2025-10-10T14:36:51.531762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:51.531769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:51.531838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2150 reason: error at write: Disconnected sessionId: src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0
2025-10-10T14:36:51.532081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2150 sessionId: src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0 is DEAD
2025-10-10T14:36:51.531880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:51.532477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:51.532488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0] Write session will restart in 0.008987s
2025-10-10T14:36:51.532514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0] Write session: Do CDS request
2025-10-10T14:36:51.532523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:51.542869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.543201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:51.543219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2151
2025-10-10T14:36:51.543418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.543483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:51.543493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:51.543498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:51.544049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2151 sessionId:  describe result for acl check
2025-10-10T14:36:51.544097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:51.544099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:51.544104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:51.544110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602052023430623:3169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:51.544668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602052023430623:3169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:51.548553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602052023430623:3169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:51.552367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602052023430623:3169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:51.552386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602052023430623:3169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:51.552390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602052023430623:3169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:51.552402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:51.555934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:51.558934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:51.559179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:51.559193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:51.559205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:51.559261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:51.559307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602051241200271:3137]
2025-10-10T14:36:51.559955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:51.560271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:51.560317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:51.560641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:51.560702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.560709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.560711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.560712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.560714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.560715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.560716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.560718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.560719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.560721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.560722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.560723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.560724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.560731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.560745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.560750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.560755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.560759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.560764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.560769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.560773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.560777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.560782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.560786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.560790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.560794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.560803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.560812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.560819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.560824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.560829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.560835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.560840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.560846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.560851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.560856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.560861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.560868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.560873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.560878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.560882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.560893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.560899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.560905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.560915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.560921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.560931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.560936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.560942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.560949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.560954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.560964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.561011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:51.563606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:51.564293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:51.564310Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:51.564312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:51.564317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:51.564324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2150 [2:7559602051241200271:3137]
2025-10-10T14:36:51.564339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:51.564359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:51.564362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.564366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.564369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.564386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:51.564399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:51.564412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:51.564478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.564486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.564488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.564491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:51.564565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:51.564572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.564586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.564601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.564623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:51.564651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430772:3169], now have 1 active actors on pipe
2025-10-10T14:36:51.564659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430586:2438], now have 1 active actors on pipe
2025-10-10T14:36:51.564668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602051241200266:3137]
2025-10-10T14:36:51.564670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602051241200266:3137]
2025-10-10T14:36:51.564673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602051241200266:3137]
2025-10-10T14:36:51.564687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:51.564705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:51.564708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:51.564712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:51.564714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:51.564729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:51.564738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:51.564737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2150
2025-10-10T14:36:51.564767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602051241200266:3137]
2025-10-10T14:36:51.564776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:51.564738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2150
2025-10-10T14:36:51.564778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:51.564806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.564816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.564859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:51.564871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.564875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.564878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:51.564890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.564900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:51.564918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.565057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.565065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.565080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.565150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2151 partition: 0 MaxSeqNo: 40 sessionId: src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0
2025-10-10T14:36:51.566074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa4bdbb-c2561bca-5b36e218-7e584830_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:51.569016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0] Write session: try to update token
2025-10-10T14:36:51.569034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:51.586208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:51.586229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:51.586233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:51.586235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:51.586246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602051241200266:3137]
2025-10-10T14:36:51.586251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602051241200266:3137]
2025-10-10T14:36:51.586255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602051241200266:3137]
2025-10-10T14:36:51.586309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:51.586319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:51.586323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.586326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:51.586326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:51.586330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:51.586503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:51.595723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId: src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:51.598601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:51.633405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602052023430826:2605]
2025-10-10T14:36:51.635427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2150, pipe: [1:7559602052023430826:2605]
2025-10-10T14:36:51.710300Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:51.710834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.710851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.710876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430826:2605], now have 1 active actors on pipe
2025-10-10T14:36:51.711110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:51.711171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:51.711209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602052023430826:2605]
2025-10-10T14:36:51.711233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:51.711313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2151 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0
2025-10-10T14:36:51.711522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2151 sessionId: src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0 is DEAD
2025-10-10T14:36:51.711702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:51.711713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0] Write session will restart in 0.009635s
2025-10-10T14:36:51.711741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0] Write session: Do CDS request
2025-10-10T14:36:51.711747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:51.722951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.723036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:51.723055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2152
2025-10-10T14:36:51.723306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.723361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:51.723373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:51.723377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:51.724646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2152 sessionId:  describe result for acl check
2025-10-10T14:36:51.724687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:51.724693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:51.724695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:51.724704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602052023430856:3171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:51.725285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602052023430856:3171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:51.730491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602052023430856:3171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:51.736360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602052023430856:3171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:51.736382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602052023430856:3171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:51.736386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602052023430856:3171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:51.736399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:51.737437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:51.744345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:51.744626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:51.744638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:51.744650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:51.744718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:51.744765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602051241200508:3141]
2025-10-10T14:36:51.745445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:51.745867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:51.745936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:51.746369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:51.746458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.746470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.746483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.746484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.746486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.746488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.746489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.746491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.746492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.746493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.746495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.746497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.746498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.746505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.746519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.746524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.746529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.746533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.746537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.746542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.746546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.746551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.746556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.746574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.746579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.746583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.746593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.746603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.746610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.746616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.746622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.746628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.746641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.746648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.746654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.746662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.746667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.746673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.746683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.746689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.746694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.746700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.746705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.746711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.746715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.746721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.746726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.746736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.746741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.746747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.746757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.746763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.746807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:51.749981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:51.750315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:51.750328Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:51.750331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:51.750335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:51.750342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2151 [2:7559602051241200508:3141]
2025-10-10T14:36:51.750356Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:51.750380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:51.750387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.750401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.750409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.750426Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:51.750439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:51.750447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:51.750521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.750529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.750532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.750534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:51.750605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:51.750612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.750623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.750636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.750653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:51.750676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023430828:2438], now have 1 active actors on pipe
2025-10-10T14:36:51.750685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023431061:3171], now have 1 active actors on pipe
2025-10-10T14:36:51.750693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602051241200503:3141]
2025-10-10T14:36:51.750696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602051241200503:3141]
2025-10-10T14:36:51.750702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602051241200503:3141]
2025-10-10T14:36:51.750717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:51.750734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:51.750754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:51.750755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:51.750759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:51.750761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:51.750762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:51.750792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602051241200503:3141]
2025-10-10T14:36:51.750803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:51.750778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2151
2025-10-10T14:36:51.750832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:51.750848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2151
2025-10-10T14:36:51.751028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.751041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.751074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:51.751087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.751092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.751094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:51.751107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.751122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:51.751136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.757527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.757551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.757600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.757891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2152 partition: 0 MaxSeqNo: 40 sessionId: src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0
2025-10-10T14:36:51.758334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850f3d1-57da2da6-65c1132c-8a45eebb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:51.761227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0] Write session: try to update token
2025-10-10T14:36:51.761247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:51.763385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:51.763416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:51.763428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602051241200503:3141]
2025-10-10T14:36:51.763477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:51.763479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:51.763641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:51.763779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:51.763910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:51.764041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:51.764274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:51.764317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:51.780224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId: src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:51.783029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:51.784767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.784794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.784822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:51.784825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:51.784827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:51.784830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:51.784839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602051241200503:3141]
2025-10-10T14:36:51.784842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602051241200503:3141]
2025-10-10T14:36:51.784846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602051241200503:3141]
2025-10-10T14:36:51.784886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:51.784902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:51.784909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.784911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:51.784912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:51.784916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:51.785037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:51.811549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602052023431078:2605]
2025-10-10T14:36:51.813544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2151, pipe: [1:7559602052023431078:2605]
2025-10-10T14:36:51.916488Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:51.917100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:51.917136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023431078:2605], now have 1 active actors on pipe
2025-10-10T14:36:51.917417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:51.917537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:51.917540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:51.917632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2152 reason: error at write: Disconnected sessionId: src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0
2025-10-10T14:36:51.917785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602052023431078:2605]
2025-10-10T14:36:51.917804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:51.918048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:51.918061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0] Write session will restart in 0.009557s
2025-10-10T14:36:51.918085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0] Write session: Do CDS request
2025-10-10T14:36:51.918101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:51.917996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2152 sessionId: src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0 is DEAD
2025-10-10T14:36:51.928919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.929296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:51.929326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2153
2025-10-10T14:36:51.929460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:51.929498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:51.929506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:51.929510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:51.929999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2153 sessionId:  describe result for acl check
2025-10-10T14:36:51.930040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:51.930044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:51.930046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:51.930053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602052023431122:3195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:51.930631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602052023431122:3195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:51.934719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602052023431122:3195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:51.940421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:51.943663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:51.943930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:51.943944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:51.943957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:51.944017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:51.944083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602051241200745:3138]
2025-10-10T14:36:51.944224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602052023431122:3195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:51.944244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602052023431122:3195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:51.944248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602052023431122:3195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:51.944258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:51.944749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:51.945044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:51.945088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:51.945435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:51.945504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.945509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.945511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.945512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.945514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.945515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.945517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.945518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.945519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.945521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.945523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.945524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.945526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.945532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.945545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.945549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.945552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.945557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.945561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.945566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.945570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.945575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.945579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.945584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.945588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.945593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.945601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.945611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:51.945618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.945624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:51.945629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.945635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:51.945640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.945646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:51.945652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.945658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:51.945663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.945669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:51.945675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.945681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:51.945686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.945692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:51.945697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.945705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:51.945709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.945715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:51.945720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.945725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.945730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.945736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.945741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.945747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.945791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:51.948610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:51.949104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:51.949118Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:51.949121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:51.949126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:51.949133Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2152 [2:7559602051241200745:3138]
2025-10-10T14:36:51.949148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:51.949167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:51.949171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.949175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.949178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.949198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:51.949212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:51.949221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:51.949286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.949294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.949297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.949300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:51.949395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:51.949404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.949416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:51.949432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:51.949455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:51.949484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023431081:2438], now have 1 active actors on pipe
2025-10-10T14:36:51.949493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602052023431310:3195], now have 1 active actors on pipe
2025-10-10T14:36:51.949502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602051241200740:3138]
2025-10-10T14:36:51.949504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602051241200740:3138]
2025-10-10T14:36:51.949507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602051241200740:3138]
2025-10-10T14:36:51.949522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:51.949534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:51.949538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:51.949545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:51.949547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:51.949556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:51.949560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:51.949590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602051241200740:3138]
2025-10-10T14:36:51.949596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:51.949645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:51.949724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2152
2025-10-10T14:36:51.949770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2152
2025-10-10T14:36:51.949842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.949865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.949903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:51.949918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:51.949923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:51.949926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:51.949940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:51.949952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:51.949968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.952347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.952367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.952400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:51.952810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2153 partition: 0 MaxSeqNo: 40 sessionId: src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0
2025-10-10T14:36:51.953247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2dd6dcc-b8e7cc75-bbda8c96-eb375c59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:51.956062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0] Write session: try to update token
2025-10-10T14:36:51.956085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:51.972370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId: src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:51.975271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:51.975625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:51.975653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:51.975677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:51.975680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:51.975684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:51.975686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:51.975694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602051241200740:3138]
2025-10-10T14:36:51.975701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602051241200740:3138]
2025-10-10T14:36:51.975709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602051241200740:3138]
2025-10-10T14:36:51.975761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:51.975770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:51.975777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:51.975777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:51.975780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:51.975782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:51.975927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:52.017821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602056318398632:2605]
2025-10-10T14:36:52.025543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2152, pipe: [1:7559602056318398632:2605]
2025-10-10T14:36:52.109114Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:52.109672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:52.109746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318398632:2605], now have 1 active actors on pipe
2025-10-10T14:36:52.111847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:52.111908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:52.112000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:52.112008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:52.112105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2153 reason: error at write: Disconnected sessionId: src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0
2025-10-10T14:36:52.112262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2153 sessionId: src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0 is DEAD
2025-10-10T14:36:52.112659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602056318398632:2605]
2025-10-10T14:36:52.113524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:52.113536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0] Write session will restart in 0.008433s
2025-10-10T14:36:52.113564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0] Write session: Do CDS request
2025-10-10T14:36:52.113570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:52.122965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.125945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:52.125964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2154
2025-10-10T14:36:52.126119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.126168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:52.126174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:52.126179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:52.126830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2154 sessionId:  describe result for acl check
2025-10-10T14:36:52.126882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:52.126892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:52.126897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:52.126904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602056318398673:3216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:52.127468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602056318398673:3216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:52.130971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602056318398673:3216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:52.134674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602056318398673:3216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:52.134691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602056318398673:3216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:52.134696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602056318398673:3216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:52.134707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:52.141282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:52.144682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:52.144989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:52.145003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:52.145017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:52.145078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:52.145144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602055536168334:3111]
2025-10-10T14:36:52.145833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:52.146245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:52.146320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:52.146739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:52.146826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.146837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.146839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.146841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.146842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.146844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.146845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.146847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.146848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.146850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.146851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.146852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.146854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.146864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.146878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.146883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.146887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.146890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.146895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.146898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.146902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.146906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.146912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.146917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.146921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.146926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.146937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.146947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.146955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.146961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.146967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.146974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.146980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.146986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.146991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.146996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.147009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.147014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.147025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.147039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.147045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.147050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.147055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.147066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.147072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.147083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.147088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.147099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.147103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.147110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.147116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.147126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.147178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:52.151857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:52.152823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:52.152841Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:52.152845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:52.152849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:52.152857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2153 [2:7559602055536168334:3111]
2025-10-10T14:36:52.152872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:52.152895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:52.152899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.152903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.152906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.152925Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:52.152941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:52.152956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:52.153028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.153036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.153039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.153043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:52.153126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:52.153137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.153151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.153164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.153182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:52.153206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318398806:3216], now have 1 active actors on pipe
2025-10-10T14:36:52.153221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602055536168329:3111]
2025-10-10T14:36:52.153224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602055536168329:3111]
2025-10-10T14:36:52.153226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602055536168329:3111]
2025-10-10T14:36:52.153239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:52.153250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318398659:2438], now have 1 active actors on pipe
2025-10-10T14:36:52.153260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:52.153278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:52.153281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:52.153292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2153
2025-10-10T14:36:52.153311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2153
2025-10-10T14:36:52.153302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:52.153312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:52.153315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:52.153323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602055536168329:3111]
2025-10-10T14:36:52.153326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:52.153353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:52.153432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.153442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.153492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:52.153503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.153508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.153511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:52.153524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.153538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:52.153559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.153818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.153830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.153853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.153943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2154 partition: 0 MaxSeqNo: 40 sessionId: src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0
2025-10-10T14:36:52.154705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ce028c7-7bb49d26-5761f3ba-b3ca1dc5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:52.157416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0] Write session: try to update token
2025-10-10T14:36:52.157433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:52.169535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:52.169554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:52.169564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602055536168329:3111]
2025-10-10T14:36:52.169617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:52.169621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:52.169822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:52.169967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:52.170120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:52.170271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:52.170883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:52.170937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:52.174910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId: src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:52.177666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:52.178092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.178112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.178172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:52.178273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:52.196740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:52.196763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:52.196766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:52.196769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:52.196781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602055536168329:3111]
2025-10-10T14:36:52.196786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602055536168329:3111]
2025-10-10T14:36:52.196790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602055536168329:3111]
2025-10-10T14:36:52.196842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:52.196850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.196852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:52.196856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:52.196863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:52.196867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:52.196996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:52.212950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602056318398910:2605]
2025-10-10T14:36:52.213245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2153, pipe: [1:7559602056318398910:2605]
2025-10-10T14:36:52.320862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:52.330068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.330097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.330284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.330355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.330424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.330492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.330545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.330555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.330630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.330698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.330770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.330842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.330890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.330898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.330972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.331036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.331102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.331172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.331300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.331309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.331388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.331456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.331531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.331594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.331636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.331639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.331716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.331775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.331838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.331907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.331954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.331957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.332026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.332098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.332158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.332220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.332262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.332266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.332339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.332396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.332456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.332520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.332562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.332565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.332636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.332693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.332755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.332822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.332864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.332868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.332937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.332996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.333060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.333120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.333162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.333165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.333232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.333290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.333595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.333668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.333715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.333723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.333793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318398910:2605], now have 1 active actors on pipe
2025-10-10T14:36:52.335120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602056318398910:2605]
2025-10-10T14:36:52.335130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:52.335135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:52.335164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:52.335169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2154 reason: error at write: Disconnected sessionId: src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0
2025-10-10T14:36:52.335494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:52.335383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2154 sessionId: src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0 is DEAD
2025-10-10T14:36:52.337551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:52.337562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0] Write session will restart in 0.006638s
2025-10-10T14:36:52.337588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0] Write session: Do CDS request
2025-10-10T14:36:52.337594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:52.345880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.349464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:52.349491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2155
2025-10-10T14:36:52.349697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.349753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:52.349762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:52.349766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:52.350346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2155 sessionId:  describe result for acl check
2025-10-10T14:36:52.350387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:52.350394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:52.350396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:52.350403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602056318398977:3225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:52.351004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602056318398977:3225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:52.354255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602056318398977:3225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:52.358488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602056318398977:3225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:52.358515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602056318398977:3225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:52.358519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602056318398977:3225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:52.358530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:52.360424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:52.364738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:52.365054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:52.365067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:52.365080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:52.365152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:52.365204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602055536168575:3110]
2025-10-10T14:36:52.365888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:52.369053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:52.369128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:52.369776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:52.369865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.369872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.369873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.369874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.369879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.369880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.369881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.369882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.369886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.369887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.369888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.369890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.369891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.369898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.369910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.369914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.369918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.369922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.369926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.369930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.369933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.369937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.369941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.369944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.369948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.369952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.369960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.369969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.369975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.369981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.369985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.369990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.369994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.370000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.370005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.370010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.370016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.370027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.370032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.370037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.370045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.370050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.370056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.370062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.370066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.370071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.370075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.370080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.370085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.370095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.370100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.370105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.370145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:52.375730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:52.376106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:52.376117Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:52.376121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:52.376125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:52.376133Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2154 [2:7559602055536168575:3110]
2025-10-10T14:36:52.376149Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:52.376170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:52.376178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.376190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.376198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.376217Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:52.376231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:52.376239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:52.376306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.376317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.376319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.376322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:52.376389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:52.376397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.376409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.376421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.376439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:52.376468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399142:3225], now have 1 active actors on pipe
2025-10-10T14:36:52.376476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318398913:2438], now have 1 active actors on pipe
2025-10-10T14:36:52.376486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602055536168570:3110]
2025-10-10T14:36:52.376492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602055536168570:3110]
2025-10-10T14:36:52.376495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602055536168570:3110]
2025-10-10T14:36:52.376508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:52.376528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:52.376532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:52.376535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:52.376537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:52.376544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2154
2025-10-10T14:36:52.376551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:52.376550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2154
2025-10-10T14:36:52.376555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:52.376593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602055536168570:3110]
2025-10-10T14:36:52.376601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:52.376608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:52.376624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.376630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.376682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|934417bb-8b77d33d-3d108df0-35b7b626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:52.376695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.376700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.376702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:52.376714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.376725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:52.376750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.376954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.376964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.376982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.377082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2155 partition: 0 MaxSeqNo: 40 sessionId: src_id|934417bb-8b77d33d-3d108df0-35b7b626_0
2025-10-10T14:36:52.377499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2dba95-9ee2dbf-cbf44335-d03c0cb6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|934417bb-8b77d33d-3d108df0-35b7b626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:52.380448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|934417bb-8b77d33d-3d108df0-35b7b626_0] Write session: try to update token
2025-10-10T14:36:52.380469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|934417bb-8b77d33d-3d108df0-35b7b626_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:52.402114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId: src_id|934417bb-8b77d33d-3d108df0-35b7b626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:52.405028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:52.405366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.405391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.405418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:52.405422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:52.405426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:52.405428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:52.405438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602055536168570:3110]
2025-10-10T14:36:52.405443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602055536168570:3110]
2025-10-10T14:36:52.405447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602055536168570:3110]
2025-10-10T14:36:52.405521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:52.405534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.405537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:52.405713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:52.409475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:52.409489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:52.409494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:52.435148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602056318399157:2605]
2025-10-10T14:36:52.435592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2154, pipe: [1:7559602056318399157:2605]
2025-10-10T14:36:52.522558Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:52.523000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:52.523072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399157:2605], now have 1 active actors on pipe
2025-10-10T14:36:52.523154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:52.523243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:52.523260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:52.523263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:52.523322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602056318399157:2605]
2025-10-10T14:36:52.523359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2155 reason: error at write: Disconnected sessionId: src_id|934417bb-8b77d33d-3d108df0-35b7b626_0
2025-10-10T14:36:52.523521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2155 sessionId: src_id|934417bb-8b77d33d-3d108df0-35b7b626_0 is DEAD
2025-10-10T14:36:52.523690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934417bb-8b77d33d-3d108df0-35b7b626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:52.523701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934417bb-8b77d33d-3d108df0-35b7b626_0] Write session will restart in 0.007561s
2025-10-10T14:36:52.523735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934417bb-8b77d33d-3d108df0-35b7b626_0] Write session: Do CDS request
2025-10-10T14:36:52.523742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934417bb-8b77d33d-3d108df0-35b7b626_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:52.532884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|934417bb-8b77d33d-3d108df0-35b7b626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.533010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:52.533028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2156
2025-10-10T14:36:52.533193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.533241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:52.533252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:52.533258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:52.533782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2156 sessionId:  describe result for acl check
2025-10-10T14:36:52.533825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:52.533834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:52.533837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:52.533844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602056318399192:3239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:52.534427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602056318399192:3239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:52.537885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602056318399192:3239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:52.540988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602056318399192:3239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:52.541004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602056318399192:3239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:52.541007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602056318399192:3239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:52.541017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:52.542508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:52.545395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:52.545640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:52.545657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:52.545670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:52.545730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:52.545776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602055536168819:3103]
2025-10-10T14:36:52.546348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:52.546684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:52.546731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:52.547046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:52.547116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.547122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.547123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.547124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.547126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.547127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.547128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.547130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.547131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.547132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.547133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.547134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.547135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.547141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.547155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.547159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.547163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.547166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.547171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.547175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.547179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.547183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.547186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.547190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.547194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.547198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.547206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.547217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.547224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.547229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.547233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.547239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.547242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.547247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.547251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.547258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.547262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.547267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.547271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.547276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.547280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.547284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.547289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.547293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.547303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.547308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.547312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.547317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.547321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.547331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.547335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.547340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.547384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:52.549863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:52.550221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:52.550234Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:52.550237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:52.550241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:52.550248Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2155 [2:7559602055536168819:3103]
2025-10-10T14:36:52.550262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:52.550280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:52.550284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.550288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.550290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.550307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:52.550315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:52.550330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:52.550390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.550398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.550401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.550403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:52.550478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:52.550485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.550498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.550516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.550539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:52.550565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399160:2438], now have 1 active actors on pipe
2025-10-10T14:36:52.550573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399391:3239], now have 1 active actors on pipe
2025-10-10T14:36:52.550583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602055536168813:3103]
2025-10-10T14:36:52.550585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602055536168813:3103]
2025-10-10T14:36:52.550588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602055536168813:3103]
2025-10-10T14:36:52.550563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2155
2025-10-10T14:36:52.550590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2155
2025-10-10T14:36:52.550606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:52.550625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:52.550635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:52.550639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:52.550648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:52.550652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:52.550656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:52.550697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.550706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.550721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602055536168813:3103]
2025-10-10T14:36:52.550729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:52.550744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:52.550764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:52.550776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.550785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.550789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:52.550801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.550816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:52.550840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.551022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.551031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.551046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.551122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2156 partition: 0 MaxSeqNo: 40 sessionId: src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0
2025-10-10T14:36:52.551537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934417bb-8b77d33d-3d108df0-35b7b626_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:52.554218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0] Write session: try to update token
2025-10-10T14:36:52.554237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:52.568697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId: src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:52.570586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:52.570605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:52.570609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:52.570612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:52.570623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602055536168813:3103]
2025-10-10T14:36:52.570628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602055536168813:3103]
2025-10-10T14:36:52.570633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602055536168813:3103]
2025-10-10T14:36:52.570688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:52.570693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:52.570697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.570699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:52.570716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:52.570727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:52.570858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:52.571563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:52.623572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602056318399405:2605]
2025-10-10T14:36:52.623891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2155, pipe: [1:7559602056318399405:2605]
2025-10-10T14:36:52.692833Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:52.693593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.693609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.693658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399405:2605], now have 1 active actors on pipe
2025-10-10T14:36:52.694003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:52.694020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:52.694020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602056318399405:2605]
2025-10-10T14:36:52.694052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:52.694087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2156 reason: error at write: Disconnected sessionId: src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0
2025-10-10T14:36:52.693903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:52.694300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2156 sessionId: src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0 is DEAD
2025-10-10T14:36:52.694465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:52.694476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0] Write session will restart in 0.009393s
2025-10-10T14:36:52.694502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0] Write session: Do CDS request
2025-10-10T14:36:52.694508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:52.706162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.706542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:52.706559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2157
2025-10-10T14:36:52.706670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.706699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:52.706705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:52.706708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:52.707182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2157 sessionId:  describe result for acl check
2025-10-10T14:36:52.707219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:52.707221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:52.707224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:52.707230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602056318399440:3241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:52.707820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602056318399440:3241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:52.712576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602056318399440:3241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:52.717652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602056318399440:3241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:52.717669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602056318399440:3241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:52.717673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602056318399440:3241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:52.717682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:52.719396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:52.723899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:52.724178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:52.724192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:52.724206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:52.724275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:52.724334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602055536169062:3099]
2025-10-10T14:36:52.724984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:52.726402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:52.726483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:52.726900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:52.726962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.726968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.726969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.726971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.726972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.726974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.726975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.726977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.726979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.726980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.726982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.726983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.726984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.726991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.727006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.727011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.727015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.727020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.727024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.727029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.727033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.727037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.727042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.727046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.727051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.727055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.727065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.727075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.727088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.727114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.727119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.727125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.727130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.727136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.727147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.727153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.727163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.727169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.727179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.727185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.727195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.727201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.727206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.727213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.727222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.727239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.727253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.727260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.727265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.727271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.727276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.727282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.727327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:52.730093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:52.730405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:52.730417Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:52.730420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:52.730425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:52.730433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2156 [2:7559602055536169062:3099]
2025-10-10T14:36:52.730448Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:52.730469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:52.730471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.730474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.730476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.730490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:52.730497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:52.730503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:52.730557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.730563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.730564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.730566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:52.730640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:52.730650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.730658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.730668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.730697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:52.730717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602055536169057:3099]
2025-10-10T14:36:52.730725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602055536169057:3099]
2025-10-10T14:36:52.730726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602055536169057:3099]
2025-10-10T14:36:52.730733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:52.730745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:52.730747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399644:3241], now have 1 active actors on pipe
2025-10-10T14:36:52.730748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:52.730751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399407:2438], now have 1 active actors on pipe
2025-10-10T14:36:52.730751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:52.730756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:52.730772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:52.730775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:52.730807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602055536169057:3099]
2025-10-10T14:36:52.730817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:52.730841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:52.730899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.730911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.730941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:52.730954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.730959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.730962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:52.730973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.730986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:52.731011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.731249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.731259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.731276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.730819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2156
2025-10-10T14:36:52.730859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2156
2025-10-10T14:36:52.731456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2157 partition: 0 MaxSeqNo: 40 sessionId: src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0
2025-10-10T14:36:52.733648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e6c9e2-c947c22b-9b7a7f4a-3b288abb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:52.736631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0] Write session: try to update token
2025-10-10T14:36:52.736652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:52.743575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:52.743595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:52.743608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602055536169057:3099]
2025-10-10T14:36:52.743658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:52.743662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:52.743846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:52.743992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:52.744145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:52.744324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:52.744533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:52.744570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:52.757389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId: src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:52.760053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:52.760299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.760320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.760376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:52.760486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:52.763662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:52.763677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:52.763680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:52.763682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:52.763693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602055536169057:3099]
2025-10-10T14:36:52.763697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602055536169057:3099]
2025-10-10T14:36:52.763702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602055536169057:3099]
2025-10-10T14:36:52.763749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:52.763751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:52.763759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.763761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:52.763761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:52.763766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:52.763889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:52.794067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602056318399664:2605]
2025-10-10T14:36:52.794339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2156, pipe: [1:7559602056318399664:2605]
2025-10-10T14:36:52.893482Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:52.902315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.902341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.902526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.902590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.902656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.902720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.902765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.902776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.902846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.902919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.902984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.903058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.903105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.903112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.903181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.903242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.903308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.903371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.903418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.903425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.903496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.903570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.903638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.903704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.903752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.903759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.903828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.903889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.903952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.904016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.904074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.904082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.904176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.904236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.904302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.904367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.904433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.904440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.904504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.904564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.904629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.904695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.904740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.904747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.904813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.904876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.904943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.905006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.905050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.905057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.905125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.905186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.905249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.905314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.905378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.905386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.905452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:52.905513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:52.905575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:52.905638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:52.905682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:52.905692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:52.905762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399664:2605], now have 1 active actors on pipe
2025-10-10T14:36:52.906016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602056318399664:2605]
2025-10-10T14:36:52.906052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:52.906064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:52.906080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:52.906121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2157 reason: error at write: Disconnected sessionId: src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0
2025-10-10T14:36:52.906415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2157 sessionId: src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0 is DEAD
2025-10-10T14:36:52.907183Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:52.909440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:52.909454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0] Write session will restart in 0.009774s
2025-10-10T14:36:52.909480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0] Write session: Do CDS request
2025-10-10T14:36:52.909486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:52.920970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.921092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:52.921109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2158
2025-10-10T14:36:52.921460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:52.921515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:52.921522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:52.921527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:52.922038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2158 sessionId:  describe result for acl check
2025-10-10T14:36:52.922077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:52.922082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:52.922084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:52.922090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602056318399773:3252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:52.922661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602056318399773:3252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:52.927754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:52.928040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602056318399773:3252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:52.930738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:52.930983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:52.930998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:52.931011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:52.931083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:52.931129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602055536169305:3097]
2025-10-10T14:36:52.931139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602056318399773:3252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:52.931159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602056318399773:3252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:52.931163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602056318399773:3252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:52.931178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:52.931742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:52.932094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:52.932144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:52.932480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:52.932559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.932566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.932568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.932569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.932570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.932572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.932573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.932575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.932576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.932578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.932579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.932580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.932581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.932588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.932602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.932606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.932609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.932613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.932616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.932619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.932623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.932627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.932631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.932634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.932638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.932641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.932649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.932657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:52.932664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.932670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:52.932674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.932679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:52.932683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.932689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:52.932694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.932700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:52.932704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.932710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:52.932721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.932727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:52.932732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.932743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:52.932748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.932758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:52.932763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.932768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:52.932782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.932788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.932793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.932804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.932811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.932816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.932857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:52.935555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:52.935872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:52.935884Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:52.935887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:52.935891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:52.935898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2157 [2:7559602055536169305:3097]
2025-10-10T14:36:52.935915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:52.935937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:52.935945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.935948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.935952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.935970Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:52.935983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:52.935991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:52.936069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.936076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.936078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.936080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:52.936152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:52.936166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.936180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:52.936196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:52.936216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:52.936243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602055536169300:3097]
2025-10-10T14:36:52.936252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602055536169300:3097]
2025-10-10T14:36:52.936254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602055536169300:3097]
2025-10-10T14:36:52.936264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:52.936273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:52.936276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:52.936279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:52.936283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399667:2438], now have 1 active actors on pipe
2025-10-10T14:36:52.936289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:52.936306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:52.936310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:52.936316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602056318399903:3252], now have 1 active actors on pipe
2025-10-10T14:36:52.936344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602055536169300:3097]
2025-10-10T14:36:52.936358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:52.936377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:52.937884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2157
2025-10-10T14:36:52.937892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2157
2025-10-10T14:36:52.938120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.938136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.938171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:52.938196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:52.938201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:52.938204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:52.938218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:52.938235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:52.938256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.938480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:52.938491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:52.938521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:52.938618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2158 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0
2025-10-10T14:36:52.939043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f75358-100c9183-f2cd0c5c-81c11ae7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:52.941834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0] Write session: try to update token
2025-10-10T14:36:52.941855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:52.958081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId: src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:52.959050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:52.959070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:52.959073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:52.959076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:52.959085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602055536169300:3097]
2025-10-10T14:36:52.959090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602055536169300:3097]
2025-10-10T14:36:52.959094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602055536169300:3097]
2025-10-10T14:36:52.959147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:52.959151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:52.959159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:52.959160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:52.959162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:52.959163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:52.959332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:52.961047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:53.006264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602060613367211:2605]
2025-10-10T14:36:53.006628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2157, pipe: [1:7559602060613367211:2605]
2025-10-10T14:36:53.073115Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:53.073675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.073694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.073743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367211:2605], now have 1 active actors on pipe
2025-10-10T14:36:53.073997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:53.074785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:53.074836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:53.074932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2158 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0
2025-10-10T14:36:53.075231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2158 sessionId: src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0 is DEAD
2025-10-10T14:36:53.075402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602060613367211:2605]
2025-10-10T14:36:53.077656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:53.077671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0] Write session will restart in 0.009192s
2025-10-10T14:36:53.077707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0] Write session: Do CDS request
2025-10-10T14:36:53.077713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:53.087913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.089413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:53.089443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2159
2025-10-10T14:36:53.089631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.089674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:53.089685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:53.089689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:53.090327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2159 sessionId:  describe result for acl check
2025-10-10T14:36:53.090369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:53.090376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:53.090378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:53.090385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602060613367251:3274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:53.090971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602060613367251:3274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:53.095574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602060613367251:3274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:53.099422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602060613367251:3274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:53.099441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602060613367251:3274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:53.099446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602060613367251:3274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:53.099454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:53.109391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:53.112525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:53.112760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:53.112765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:53.112777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:53.112834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:53.112878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602059831136899:3086]
2025-10-10T14:36:53.113549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:53.113967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:53.114032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:53.114402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:53.114469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.114475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.114477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.114478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.114480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.114481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.114483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.114484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.114486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.114487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.114489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.114490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.114491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.114498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.114512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.114516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.114521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.114526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.114531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.114535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.114540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.114544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.114550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.114555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.114559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.114563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.114572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.114589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.114601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.114607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.114613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.114619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.114625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.114632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.114637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.114649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.114654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.114660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.114665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.114671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.114676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.114682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.114687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.114693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.114698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.114709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.114715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.114720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.114727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.114733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.114738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.114750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.114797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:53.117469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:53.117913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:53.117926Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:53.117929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:53.117933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:53.117940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2158 [2:7559602059831136899:3086]
2025-10-10T14:36:53.117955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:53.117977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:53.117985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.117989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.117992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.118011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:53.118019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:53.118032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:53.118097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.118104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.118107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.118109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:53.118181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:53.118190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.118216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.118230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.118250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:53.118278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367338:3274], now have 1 active actors on pipe
2025-10-10T14:36:53.118287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367236:2438], now have 1 active actors on pipe
2025-10-10T14:36:53.118296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602059831136894:3086]
2025-10-10T14:36:53.118302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602059831136894:3086]
2025-10-10T14:36:53.118305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602059831136894:3086]
2025-10-10T14:36:53.118318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:53.118336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:53.118354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:53.118362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:53.118361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:53.118365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:53.118367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:53.118392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602059831136894:3086]
2025-10-10T14:36:53.118401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:53.118408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:53.118429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.118434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.118474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8f03661-e21e85e7-2919b414-8a59598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:53.118487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.118491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.118493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:53.118515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.118530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:53.118348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2158
2025-10-10T14:36:53.118388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2158
2025-10-10T14:36:53.118557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.118829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.118840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.118859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.118951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2159 partition: 0 MaxSeqNo: 40 sessionId: src_id|f8f03661-e21e85e7-2919b414-8a59598_0
2025-10-10T14:36:53.119384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e2adace-a925e7d0-3c218761-9eda2c52_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f8f03661-e21e85e7-2919b414-8a59598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:53.122278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8f03661-e21e85e7-2919b414-8a59598_0] Write session: try to update token
2025-10-10T14:36:53.122297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8f03661-e21e85e7-2919b414-8a59598_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:53.139390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:53.139413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:53.139418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:53.139420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:53.139431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602059831136894:3086]
2025-10-10T14:36:53.139436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602059831136894:3086]
2025-10-10T14:36:53.139445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602059831136894:3086]
2025-10-10T14:36:53.139496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:53.139498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:53.139506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.139508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:53.139509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:53.139513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:53.139651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:53.140436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId: src_id|f8f03661-e21e85e7-2919b414-8a59598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:53.143164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:53.175516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602060613367498:2605]
2025-10-10T14:36:53.175862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2158, pipe: [1:7559602060613367498:2605]
2025-10-10T14:36:53.263299Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:53.263987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.264003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.264067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367498:2605], now have 1 active actors on pipe
2025-10-10T14:36:53.264294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:53.264289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602060613367498:2605]
2025-10-10T14:36:53.264301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:53.264305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:53.264396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2159 reason: error at write: Disconnected sessionId: src_id|f8f03661-e21e85e7-2919b414-8a59598_0
2025-10-10T14:36:53.264424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:53.264620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2159 sessionId: src_id|f8f03661-e21e85e7-2919b414-8a59598_0 is DEAD
2025-10-10T14:36:53.264832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8f03661-e21e85e7-2919b414-8a59598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:53.264846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8f03661-e21e85e7-2919b414-8a59598_0] Write session will restart in 0.006443s
2025-10-10T14:36:53.264872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8f03661-e21e85e7-2919b414-8a59598_0] Write session: Do CDS request
2025-10-10T14:36:53.264882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8f03661-e21e85e7-2919b414-8a59598_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:53.272964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8f03661-e21e85e7-2919b414-8a59598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.273000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:53.273020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2160
2025-10-10T14:36:53.273204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.273249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:53.273261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:53.273266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:53.273738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2160 sessionId:  describe result for acl check
2025-10-10T14:36:53.273783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:53.273785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:53.273786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:53.273794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602060613367528:3275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:53.274386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602060613367528:3275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:53.278072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602060613367528:3275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:53.281394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602060613367528:3275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:53.281412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602060613367528:3275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:53.281416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602060613367528:3275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:53.281440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:53.283486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:53.286217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:53.286427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:53.286448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:53.286460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:53.286514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:53.286552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602059831137145:3068]
2025-10-10T14:36:53.287031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:53.287360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:53.287407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:53.287737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:53.287788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.287794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.287795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.287796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.287798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.287799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.287800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.287801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.287802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.287803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.287805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.287806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.287807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.287813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.287825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.287827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.287830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.287832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.287834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.287836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.287838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.287840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.287843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.287847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.287851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.287854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.287862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.287871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.287877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.287882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.287886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.287891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.287895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.287901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.287906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.287911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.287916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.287920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.287925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.287930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.287936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.287942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.287946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.287952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.287956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.287962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.287966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.287971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.287975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.287980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.287984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.287989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.288040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:53.290570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:53.291041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:53.291051Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:53.291052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:53.291055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:53.291061Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2159 [2:7559602059831137145:3068]
2025-10-10T14:36:53.291069Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:53.291100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:53.291103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.291106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.291107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.291120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:53.291129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:53.291136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:53.291181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.291186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.291188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.291190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:53.291249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:53.291256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.291268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.291283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.291300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:53.291326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602059831137140:3068]
2025-10-10T14:36:53.291333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602059831137140:3068]
2025-10-10T14:36:53.291337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602059831137140:3068]
2025-10-10T14:36:53.291350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:53.291365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:53.291369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367500:2438], now have 1 active actors on pipe
2025-10-10T14:36:53.291372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367730:3275], now have 1 active actors on pipe
2025-10-10T14:36:53.291374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:53.291376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:53.291381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:53.291396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:53.291405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:53.291430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602059831137140:3068]
2025-10-10T14:36:53.291443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:53.291428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2159
2025-10-10T14:36:53.291432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2159
2025-10-10T14:36:53.291463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:53.291505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.291514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.291543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26d49679-33f6fa88-41752822-a75cf9e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:53.291554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.291557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.291559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:53.291567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.291576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:53.291600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.291732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.291740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.291754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.291842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2160 partition: 0 MaxSeqNo: 40 sessionId: src_id|26d49679-33f6fa88-41752822-a75cf9e4_0
2025-10-10T14:36:53.292243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8f03661-e21e85e7-2919b414-8a59598_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26d49679-33f6fa88-41752822-a75cf9e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:53.295079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d49679-33f6fa88-41752822-a75cf9e4_0] Write session: try to update token
2025-10-10T14:36:53.295097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d49679-33f6fa88-41752822-a75cf9e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:53.311209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId: src_id|26d49679-33f6fa88-41752822-a75cf9e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:53.312081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:53.312103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:53.312106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:53.312109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:53.312118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602059831137140:3068]
2025-10-10T14:36:53.312122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602059831137140:3068]
2025-10-10T14:36:53.312126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602059831137140:3068]
2025-10-10T14:36:53.312187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:53.312198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.312206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:53.312256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:53.312273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:53.312278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:53.312364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:53.313994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:53.364447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602060613367750:2605]
2025-10-10T14:36:53.364836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2159, pipe: [1:7559602060613367750:2605]
2025-10-10T14:36:53.428320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:53.428797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.428812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.428861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367750:2605], now have 1 active actors on pipe
2025-10-10T14:36:53.429094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:53.429140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602060613367750:2605]
2025-10-10T14:36:53.429171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:53.429175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:53.429254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2160 reason: error at write: Disconnected sessionId: src_id|26d49679-33f6fa88-41752822-a75cf9e4_0
2025-10-10T14:36:53.429262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:53.429474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2160 sessionId: src_id|26d49679-33f6fa88-41752822-a75cf9e4_0 is DEAD
2025-10-10T14:36:53.429665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d49679-33f6fa88-41752822-a75cf9e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:53.429679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d49679-33f6fa88-41752822-a75cf9e4_0] Write session will restart in 0.007816s
2025-10-10T14:36:53.429705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d49679-33f6fa88-41752822-a75cf9e4_0] Write session: Do CDS request
2025-10-10T14:36:53.429715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d49679-33f6fa88-41752822-a75cf9e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:53.438941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d49679-33f6fa88-41752822-a75cf9e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.438980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:53.438996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2161
2025-10-10T14:36:53.439188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.439225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:53.439236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:53.439240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:53.439804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2161 sessionId:  describe result for acl check
2025-10-10T14:36:53.439845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:53.439852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:53.439856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:53.439862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602060613367794:3287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:53.440465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602060613367794:3287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:53.443438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602060613367794:3287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:53.448574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602060613367794:3287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:53.448593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602060613367794:3287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:53.448597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602060613367794:3287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:53.448606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:53.449449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:53.452343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:53.452573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:53.452608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:53.452627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:53.452694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:53.452739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602059831137392:3063]
2025-10-10T14:36:53.453381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:53.453738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:53.453790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:53.454115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:53.454194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.454200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.454202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.454203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.454205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.454206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.454207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.454208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.454210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.454211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.454212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.454213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.454214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.454220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.454234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.454238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.454242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.454246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.454250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.454254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.454258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.454261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.454267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.454270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.454274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.454278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.454286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.454295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.454301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.454307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.454312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.454317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.454330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.454336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.454341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.454347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.454351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.454356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.454361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.454366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.454370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.454375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.454380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.454384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.454390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.454399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.454404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.454409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.454413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.454418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.454422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.454427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.454467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:53.457100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:53.457809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:53.457826Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:53.457829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:53.457832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:53.457838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2160 [2:7559602059831137392:3063]
2025-10-10T14:36:53.457851Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:53.457868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:53.457871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.457874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.457877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.457894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:53.457902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:53.457909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:53.457982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.457992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.457993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.457996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:53.458067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:53.458075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.458085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.458095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.458114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:53.458140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602059831137387:3063]
2025-10-10T14:36:53.458149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602059831137387:3063]
2025-10-10T14:36:53.458152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602059831137387:3063]
2025-10-10T14:36:53.458162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:53.458172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:53.458176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:53.458176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:53.458178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:53.458190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:53.458193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:53.458204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367987:3287], now have 1 active actors on pipe
2025-10-10T14:36:53.458218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613367751:2438], now have 1 active actors on pipe
2025-10-10T14:36:53.458242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602059831137387:3063]
2025-10-10T14:36:53.458248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:53.458477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:53.458874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.458887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.458922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90089aa0-72718cdf-7806e06c-780a676f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:53.458939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.458943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.458945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:53.458958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.458970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:53.458990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.459175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.459182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.459195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.458741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2160
2025-10-10T14:36:53.458775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2160
2025-10-10T14:36:53.459314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2161 partition: 0 MaxSeqNo: 40 sessionId: src_id|90089aa0-72718cdf-7806e06c-780a676f_0
2025-10-10T14:36:53.459695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d49679-33f6fa88-41752822-a75cf9e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90089aa0-72718cdf-7806e06c-780a676f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:53.462497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90089aa0-72718cdf-7806e06c-780a676f_0] Write session: try to update token
2025-10-10T14:36:53.462518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90089aa0-72718cdf-7806e06c-780a676f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:53.479924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId: src_id|90089aa0-72718cdf-7806e06c-780a676f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:53.482888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:53.483148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.483171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.483225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:53.483338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:53.515674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.515706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.515895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.516069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.516154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.516227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.516277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.516290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.516385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.516444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.516505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.516567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.516615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.516619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.516695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.516754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.516820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.516886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.516932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.516935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.517012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.517077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.517137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.517198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.517264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.517271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.517359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.517423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.517489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.517551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.517621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.517628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.517699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.517761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.517826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.517898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.517962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.517971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.518045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.518119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.518188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.518268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.518323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.518332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.518423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.518492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.518559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.518633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.518675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.518678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.518751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.518813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.518881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.518947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.518991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.518994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.519069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.519135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.519198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.519262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.519325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.519328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.519413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:53.519416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:53.519419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:53.519421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:53.519428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602059831137387:3063]
2025-10-10T14:36:53.519431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602059831137387:3063]
2025-10-10T14:36:53.519434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602059831137387:3063]
2025-10-10T14:36:53.519502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:36:53.519513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:53.519519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:53.519526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:53.519562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.519582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.519584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:36:53.519612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:36:53.519624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:36:53.519627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:36:53.519629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:36:53.519631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:36:53.520028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:36:53.520045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:36:53.520050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:36:53.520052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:36:53.520055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:36:53.520057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:36:53.520627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:36:53.520636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:36:53.520640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:36:53.520642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:36:53.520645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:36:53.520647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:36:53.521806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:36:53.521831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:36:53.521838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:36:53.521842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:36:53.521845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:36:53.524158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:36:53.524183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:36:53.524201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760107013524
2025-10-10T14:36:53.524331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:36:53.524349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:36:53.524357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:36:53.524361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:36:53.524366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:36:53.524370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:36:53.525181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:36:53.525210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:36:53.525217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:36:53.525221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:36:53.525224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:36:53.525228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:36:53.525917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:36:53.525939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:36:53.525953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:36:53.525957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:36:53.525962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:36:53.525967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:36:53.526467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:36:53.526494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:36:53.526501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:36:53.529286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602060613368002:2605]
2025-10-10T14:36:53.527679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:36:53.527700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:36:53.527707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:36:53.527711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:36:53.527727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760107013527
2025-10-10T14:36:53.528049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:36:53.528064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:36:53.528074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:36:53.528077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:36:53.528081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:36:53.528084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:36:53.528597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:36:53.528611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:36:53.528617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:36:53.528622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:36:53.528626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:36:53.528630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:36:53.529207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:36:53.529220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.529317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760107013529
2025-10-10T14:36:53.533463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:53.533483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.533489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:53.533633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:53.533697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2160, pipe: [1:7559602060613368002:2605]
2025-10-10T14:36:53.649121Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:53.649490Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:36:53.649524Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:36:53.649538Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:36:53.649551Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:36:53.649576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613368002:2605], now have 1 active actors on pipe
2025-10-10T14:36:53.649815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:53.649816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:53.649844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:53.649848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:53.649881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602060613368002:2605]
2025-10-10T14:36:53.649882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2161 reason: error at write: Disconnected sessionId: src_id|90089aa0-72718cdf-7806e06c-780a676f_0
2025-10-10T14:36:53.650135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2161 sessionId: src_id|90089aa0-72718cdf-7806e06c-780a676f_0 is DEAD
2025-10-10T14:36:53.650266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90089aa0-72718cdf-7806e06c-780a676f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:53.650278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90089aa0-72718cdf-7806e06c-780a676f_0] Write session will restart in 0.009129s
2025-10-10T14:36:53.650309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90089aa0-72718cdf-7806e06c-780a676f_0] Write session: Do CDS request
2025-10-10T14:36:53.650315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90089aa0-72718cdf-7806e06c-780a676f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:53.660953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90089aa0-72718cdf-7806e06c-780a676f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.661092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:53.661108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2162
2025-10-10T14:36:53.661247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.661283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:53.661303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:53.661306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:53.661818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2162 sessionId:  describe result for acl check
2025-10-10T14:36:53.661866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:53.661873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:53.661875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:53.661882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602060613368067:3305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:53.662489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602060613368067:3305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:53.665588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602060613368067:3305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:53.669434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602060613368067:3305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:53.669451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602060613368067:3305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:53.669455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602060613368067:3305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:53.669465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:53.670028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:53.672733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:53.672967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:53.672978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:53.672991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:53.673062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:53.673107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602059831137640:3056]
2025-10-10T14:36:53.673769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:53.674141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:53.674187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:53.674540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:53.674597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.674604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.674605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.674606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.674608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.674609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.674610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.674611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.674613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.674614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.674616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.674617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.674618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.674624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.674637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.674641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.674646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.674650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.674654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.674658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.674662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.674666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.674671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.674675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.674679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.674683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.674691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.674699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.674706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.674712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.674717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.674722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.674726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.674732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.674736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.674742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.674746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.674752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.674757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.674763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.674767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.674772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.674777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.674782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.674787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.674792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.674797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.674803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.674808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.674813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.674832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.674837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.674880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:53.677507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:53.678385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:53.678401Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:53.678403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:53.678407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:53.678414Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2161 [2:7559602059831137640:3056]
2025-10-10T14:36:53.678429Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:53.678448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:53.678455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.678458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.678461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.678479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:53.678491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:53.678500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:53.678573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.678580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.678582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.678586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:53.678658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:53.678666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.678679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.678696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.678717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:53.678744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602059831137635:3056]
2025-10-10T14:36:53.678750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602059831137635:3056]
2025-10-10T14:36:53.678753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602059831137635:3056]
2025-10-10T14:36:53.678769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:53.678787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:53.678790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613368244:3305], now have 1 active actors on pipe
2025-10-10T14:36:53.678790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:53.678792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:53.678794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613368004:2438], now have 1 active actors on pipe
2025-10-10T14:36:53.678805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:53.678822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:53.678831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:53.678869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602059831137635:3056]
2025-10-10T14:36:53.678885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:53.678865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2161
2025-10-10T14:36:53.678870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2161
2025-10-10T14:36:53.678910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:53.679020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.679034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.679071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30a3432c-cd03977d-7b14a56-38e142fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:53.679084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.679099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.679109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:53.679123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.679139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:53.679163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.679350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.679365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.679382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.679465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2162 partition: 0 MaxSeqNo: 40 sessionId: src_id|30a3432c-cd03977d-7b14a56-38e142fb_0
2025-10-10T14:36:53.679883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90089aa0-72718cdf-7806e06c-780a676f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|30a3432c-cd03977d-7b14a56-38e142fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:53.682935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a3432c-cd03977d-7b14a56-38e142fb_0] Write session: try to update token
2025-10-10T14:36:53.682958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a3432c-cd03977d-7b14a56-38e142fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:53.692558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:53.692577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:53.692590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602059831137635:3056]
2025-10-10T14:36:53.692646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:53.692830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:53.692979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:53.693125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:53.693307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:53.693520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:53.693564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:53.693659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:53.698206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId: src_id|30a3432c-cd03977d-7b14a56-38e142fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:53.700912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:53.701114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.701135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.701177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:53.701252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:53.711171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:53.711190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:53.711193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:53.711195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:53.711208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602059831137635:3056]
2025-10-10T14:36:53.711213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602059831137635:3056]
2025-10-10T14:36:53.711217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602059831137635:3056]
2025-10-10T14:36:53.711265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:53.711275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.711275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:53.711277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:53.711281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:53.711284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:53.711417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:53.750002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602060613368263:2605]
2025-10-10T14:36:53.750319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2161, pipe: [1:7559602060613368263:2605]
2025-10-10T14:36:53.830233Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:53.838503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.838536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.838728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.838800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.838857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.838927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.838979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.838991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.839067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.839132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.839208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.839280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.839329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.839332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.839402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.839479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.839547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.839610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.839653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.839656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.839723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.839793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.839862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.839928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.840112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.840119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.840193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.840249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.840307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.840368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.840409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.840412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.840480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.840543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.840613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.840677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.840724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.840727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.840805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.840868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.840932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.840999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.841051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.841053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.841127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.841188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.841254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.841319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.841392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.841396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.841472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.841530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.841591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.841667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.841738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.841747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.841823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:53.841892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:53.841963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:53.842035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:53.842084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:53.842092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:53.842168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613368263:2605], now have 1 active actors on pipe
2025-10-10T14:36:53.842439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602060613368263:2605]
2025-10-10T14:36:53.842494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:53.842497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:53.842529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2162 reason: error at write: Disconnected sessionId: src_id|30a3432c-cd03977d-7b14a56-38e142fb_0
2025-10-10T14:36:53.842729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2162 sessionId: src_id|30a3432c-cd03977d-7b14a56-38e142fb_0 is DEAD
2025-10-10T14:36:53.842742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:53.842927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a3432c-cd03977d-7b14a56-38e142fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:53.842936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a3432c-cd03977d-7b14a56-38e142fb_0] Write session will restart in 0.009687s
2025-10-10T14:36:53.842961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a3432c-cd03977d-7b14a56-38e142fb_0] Write session: Do CDS request
2025-10-10T14:36:53.842968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a3432c-cd03977d-7b14a56-38e142fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:53.843262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:53.853918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30a3432c-cd03977d-7b14a56-38e142fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.854010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:53.854028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2163
2025-10-10T14:36:53.854156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:53.854198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:53.854208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:53.854214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:53.854677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2163 sessionId:  describe result for acl check
2025-10-10T14:36:53.854719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:53.854726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:53.854728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:53.854735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602060613368285:3309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:53.855325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602060613368285:3309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:53.860437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602060613368285:3309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:53.866191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602060613368285:3309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:53.866209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602060613368285:3309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:53.866213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602060613368285:3309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:53.866223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:53.869856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:53.872659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:53.872936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:53.872950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:53.872963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:53.873055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:53.873105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602059831137890:3051]
2025-10-10T14:36:53.873758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:53.874156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:53.874211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:53.874567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:53.874633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.874640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.874642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.874643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.874644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.874646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.874647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.874649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.874650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.874652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.874653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.874654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.874655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.874662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.874675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.874680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.874684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.874687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.874691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.874695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.874700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.874704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.874709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.874713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.874717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.874721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.874731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.874739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:53.874746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.874751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:53.874756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.874761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:53.874766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.874771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:53.874776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.874780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:53.874784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.874788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:53.874793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.874797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:53.874801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.874807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:53.874811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.874816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:53.874819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.874824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:53.874828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.874833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.874838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.874842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.874846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.874851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.874900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:53.879339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2162
2025-10-10T14:36:53.879352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2162
2025-10-10T14:36:53.879863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2163 partition: 0 MaxSeqNo: 40 sessionId: src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0
2025-10-10T14:36:53.878577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:53.878919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:53.878924Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:53.878927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:53.878931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:53.878939Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2162 [2:7559602059831137890:3051]
2025-10-10T14:36:53.878953Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:53.878972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:53.878975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.878980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.878983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.879011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:53.879020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:53.879028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:53.879093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.879098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.879100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.879103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:53.879179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:53.879181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.879193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:53.879206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:53.879222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:53.879246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613368463:3309], now have 1 active actors on pipe
2025-10-10T14:36:53.879250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613368269:2438], now have 1 active actors on pipe
2025-10-10T14:36:53.879258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602059831137884:3051]
2025-10-10T14:36:53.879260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602059831137884:3051]
2025-10-10T14:36:53.879263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602059831137884:3051]
2025-10-10T14:36:53.879276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:53.879290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:53.879292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:53.879296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:53.879298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:53.879307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:53.879310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:53.879338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602059831137884:3051]
2025-10-10T14:36:53.879346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:53.879362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:53.879378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.879382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.879415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:53.879421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:53.879424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:53.879426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:53.879434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:53.879443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:53.879455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.879708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.879712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.879729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:53.880280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30a3432c-cd03977d-7b14a56-38e142fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:53.883017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0] Write session: try to update token
2025-10-10T14:36:53.883037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:53.892490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:53.892510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:53.892521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602059831137884:3051]
2025-10-10T14:36:53.892574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:53.892575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:53.892752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:53.892891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:53.893026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:53.893159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:53.893388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:53.893437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:53.899892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId: src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:53.902749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:53.903104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:53.903125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:53.903170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:53.903253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:53.912000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:53.912033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:53.912037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:53.912039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:53.912051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602059831137884:3051]
2025-10-10T14:36:53.912056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602059831137884:3051]
2025-10-10T14:36:53.912061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602059831137884:3051]
2025-10-10T14:36:53.912106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:53.912111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:53.912111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:53.912114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:53.912119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:53.912121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:53.912263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:53.942493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602060613368521:2605]
2025-10-10T14:36:53.942877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2162, pipe: [1:7559602060613368521:2605]
2025-10-10T14:36:54.028569Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:54.036256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.036280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.036458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.036516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.036583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.036655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.036708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.036713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.036795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.036862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.036924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.036981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.037024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.037028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.037097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.037155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.037220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.037278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.037320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.037323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.037414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.037471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.037528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.037587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.037630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.037633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.037706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.037761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.037820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.037878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.037917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.037920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.037987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.038049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.038124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.038191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.038236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.038243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.038310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.038370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.038430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.038487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.038589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.038595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.038657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.038712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.038778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.038851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.038897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.038906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.038972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.039027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.039092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.039154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.039277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.039290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.039357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.039894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:54.039903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:54.039911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:54.039943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2163 reason: error at write: Disconnected sessionId: src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0
2025-10-10T14:36:54.039952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602060613368521:2605]
2025-10-10T14:36:54.040204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2163 sessionId: src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0 is DEAD
2025-10-10T14:36:54.040311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:54.040326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0] Write session will restart in 0.005361s
2025-10-10T14:36:54.040354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0] Write session: Do CDS request
2025-10-10T14:36:54.040360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:54.039423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.039493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.039556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.039595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.039598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.039659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602060613368521:2605], now have 1 active actors on pipe
2025-10-10T14:36:54.040643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:54.049952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.050305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:54.050324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2164
2025-10-10T14:36:54.050472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.050542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:54.050554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:54.050559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:54.051088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2164 sessionId:  describe result for acl check
2025-10-10T14:36:54.051135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:54.051137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:54.051139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:54.051147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602064908335849:3314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:54.051755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602064908335849:3314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:54.056168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602064908335849:3314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:54.062546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602064908335849:3314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:54.062566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602064908335849:3314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:54.062570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602064908335849:3314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:54.062581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:54.068697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:54.072205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:54.072472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:54.072484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:54.072498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:54.072563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:54.072611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602064126105451:3043]
2025-10-10T14:36:54.073145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:54.076573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:54.076661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:54.077090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:54.077211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.077218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.077219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.077221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.077223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.077224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.077226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.077227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.077228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.077230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.077232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.077233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.077235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.077243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.077267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.077271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.077275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.077280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.077284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.077287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.077291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.077295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.077300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.077305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.077309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.077313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.077323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.077348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.077356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.077362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.077378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.077383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.077388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.077393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.077398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.077414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.077418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.077423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.077427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.077433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.077436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.077442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.077446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.077451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.077455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.077459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.077463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.077468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.077472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.077478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.077482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.077487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.077534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:54.080500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:54.081169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:54.081184Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:54.081186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:54.081190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:54.081198Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2163 [2:7559602064126105451:3043]
2025-10-10T14:36:54.081212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:54.081230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:54.081234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.081238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.081240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.081259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:54.081267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:54.081281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:54.081363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.081371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.081373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.081376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:54.081445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:54.081448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.081461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.081473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.081491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:54.081514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602064126105446:3043]
2025-10-10T14:36:54.081517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602064126105446:3043]
2025-10-10T14:36:54.081519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602064126105446:3043]
2025-10-10T14:36:54.081533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:54.081550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:54.081553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:54.081555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:54.081560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:54.081576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:54.081580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:54.081612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602064126105446:3043]
2025-10-10T14:36:54.081615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:54.081640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:54.081688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908335820:2438], now have 1 active actors on pipe
2025-10-10T14:36:54.081697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336015:3314], now have 1 active actors on pipe
2025-10-10T14:36:54.081793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2163
2025-10-10T14:36:54.081848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2163
2025-10-10T14:36:54.082007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.082020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.082053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:54.082067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.082071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.082074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:54.082086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.082098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:54.082117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.082300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.082306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.082323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.082429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2164 partition: 0 MaxSeqNo: 40 sessionId: src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0
2025-10-10T14:36:54.085574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df983716-2c5d2a07-ec6986aa-ec21ba2d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:54.088260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0] Write session: try to update token
2025-10-10T14:36:54.088281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:54.093748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:54.093762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:54.093775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602064126105446:3043]
2025-10-10T14:36:54.093827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:54.093829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:54.094023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:54.094186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:54.094336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:54.094493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:54.094739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:54.094792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:54.104855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId: src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:54.107817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:54.108379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.108400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.108443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:54.108584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:54.112622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:54.112641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:54.112645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:54.112647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:54.112658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602064126105446:3043]
2025-10-10T14:36:54.112661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602064126105446:3043]
2025-10-10T14:36:54.112665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602064126105446:3043]
2025-10-10T14:36:54.112720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:54.112720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:54.112727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:54.112729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.112731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:54.112732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:54.112876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:54.140140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602064908336098:2605]
2025-10-10T14:36:54.140570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2163, pipe: [1:7559602064908336098:2605]
2025-10-10T14:36:54.242742Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:54.251806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.251840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.252041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.252114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.252184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.252258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.252794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.252810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.252881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.252952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.253029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.253110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.253154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.253156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.253229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.253289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.256088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:54.256097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:54.256102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:54.256138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2164 reason: error at write: Disconnected sessionId: src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0
2025-10-10T14:36:54.256170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602064908336098:2605]
2025-10-10T14:36:54.256391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2164 sessionId: src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0 is DEAD
2025-10-10T14:36:54.256609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:54.256622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0] Write session will restart in 0.007743s
2025-10-10T14:36:54.256655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0] Write session: Do CDS request
2025-10-10T14:36:54.256662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:54.253473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.253547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.253587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.253590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.253657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.253719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.253781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.253843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.253884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.253887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.253954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.254013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.254076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.254137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.254179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.254182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.254247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.254307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.254369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.254447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.254508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.254511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.254583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.254642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.254706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.254771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.254812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.254816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.254887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.254946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.255007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.255073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.255116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.255118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.255189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.255248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.255314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.255382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.255422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.255425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.255497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:54.255554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:54.255620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:54.255681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:54.255723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:54.255727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:54.255806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336098:2605], now have 1 active actors on pipe
2025-10-10T14:36:54.256395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:54.266553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.267156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:54.267176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2165
2025-10-10T14:36:54.267330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.267372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:54.267394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:54.267404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:54.267971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2165 sessionId:  describe result for acl check
2025-10-10T14:36:54.268029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:54.268045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:54.268048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:54.268055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602064908336120:3338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:54.268687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602064908336120:3338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:54.271683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602064908336120:3338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:54.274555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602064908336120:3338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:54.274579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602064908336120:3338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:54.274583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602064908336120:3338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:54.274592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:54.299966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:54.305988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:54.306697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:54.306715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:54.306735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:54.306860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:54.306923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602064126105740:3022]
2025-10-10T14:36:54.307583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:54.308238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:54.308308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:54.308649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:54.308711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.308713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.308714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.308715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.308717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.308718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.308730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.308731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.308733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.308734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.308735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.308736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.308738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.308747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.308761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.308765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.308769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.308773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.308777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.308781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.308784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.308789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.308793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.308797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.308801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.308805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.308813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.308823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.308830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.308836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.308841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.308848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.308853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.308859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.308864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.308870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.308875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.308881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.308887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.308894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.308900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.308905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.308910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.308916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.308920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.308926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.308932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.308937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.308942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.308947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.308952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.308958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.309002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:54.314446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:54.315282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2164
2025-10-10T14:36:54.314782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:54.314788Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:54.314791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:54.314796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:54.314804Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2164 [2:7559602064126105740:3022]
2025-10-10T14:36:54.314821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:54.314841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:54.314845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.314849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.314852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.314871Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:54.315395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2164
2025-10-10T14:36:54.314879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:54.314888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:54.314957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.314960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.314962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.314965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:54.315040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:54.315043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.315056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.315068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.315082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:54.315116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602064126105735:3022]
2025-10-10T14:36:54.315119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602064126105735:3022]
2025-10-10T14:36:54.315121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602064126105735:3022]
2025-10-10T14:36:54.315131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:54.315144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:54.315146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:54.315148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:54.315150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:54.315163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:54.315167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:54.315179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336156:3338], now have 1 active actors on pipe
2025-10-10T14:36:54.315182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336112:2438], now have 1 active actors on pipe
2025-10-10T14:36:54.315222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602064126105735:3022]
2025-10-10T14:36:54.315230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:54.315262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:54.315580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.315591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.315629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:54.315639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.315644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.315647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:54.315660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.315674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:54.315691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.316092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.316099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.316117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.319508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2165 partition: 0 MaxSeqNo: 40 sessionId: src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0
2025-10-10T14:36:54.320098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a31f086c-4b92a212-5bf2b209-6bb8e880_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:54.323082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0] Write session: try to update token
2025-10-10T14:36:54.323125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:54.339140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:54.339160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:54.339163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:54.339166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:54.339176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602064126105735:3022]
2025-10-10T14:36:54.339181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602064126105735:3022]
2025-10-10T14:36:54.339184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602064126105735:3022]
2025-10-10T14:36:54.339238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:54.339246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:54.339252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:54.339253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.339255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:54.339257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:54.339400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:54.341660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId: src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:54.344513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:54.356206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602064908336367:2605]
2025-10-10T14:36:54.356689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2164, pipe: [1:7559602064908336367:2605]
2025-10-10T14:36:54.476012Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:54.476768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.476788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.476836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336367:2605], now have 1 active actors on pipe
2025-10-10T14:36:54.477047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:54.477080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602064908336367:2605]
2025-10-10T14:36:54.477082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:54.477087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:54.477119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:54.477169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2165 reason: error at write: Disconnected sessionId: src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0
2025-10-10T14:36:54.477418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2165 sessionId: src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0 is DEAD
2025-10-10T14:36:54.477558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:54.477569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0] Write session will restart in 0.008761s
2025-10-10T14:36:54.477595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0] Write session: Do CDS request
2025-10-10T14:36:54.477601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:54.487954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.488120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:54.488141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2166
2025-10-10T14:36:54.488293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.488349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:54.488365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:54.488371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:54.489172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2166 sessionId:  describe result for acl check
2025-10-10T14:36:54.489239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:54.489256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:54.489258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:54.489267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602064908336413:3353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:54.489922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602064908336413:3353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:54.495328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602064908336413:3353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:54.498373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602064908336413:3353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:54.498390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602064908336413:3353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:54.498394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602064908336413:3353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:54.498404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:54.499917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:54.503027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:54.503334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:54.503345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:54.503358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:54.503426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:54.503470Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602064126105992:3020]
2025-10-10T14:36:54.504113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:54.504510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:54.504575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:54.504921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:54.505003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.505011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.505013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.505014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.505015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.505016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.505017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.505019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.505020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.505021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.505022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.505023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.505025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.505033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.505046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.505050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.505054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.505058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.505062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.505066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.505070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.505073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.505079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.505083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.505086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.505090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.505100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.505110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.505117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.505123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.505130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.505135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.505139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.505144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.505149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.505153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.505157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.505162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.505167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.505172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.505176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.505181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.505186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.505191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.505197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.505203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.505207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.505213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.505217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.505222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.505228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.505235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.505293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:54.507888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:54.508253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:54.508270Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:54.508272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:54.508277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:54.508284Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2165 [2:7559602064126105992:3020]
2025-10-10T14:36:54.508299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:54.508319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:54.508330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.508335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.508337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.508356Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:54.508368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:54.508401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:54.508484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.508491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.508493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.508496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:54.508568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:54.508577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.508601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.508618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.508634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:54.508664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336369:2438], now have 1 active actors on pipe
2025-10-10T14:36:54.508679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602064126105987:3020]
2025-10-10T14:36:54.508682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602064126105987:3020]
2025-10-10T14:36:54.508684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602064126105987:3020]
2025-10-10T14:36:54.508699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:54.508710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336611:3353], now have 1 active actors on pipe
2025-10-10T14:36:54.508720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:54.508724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:54.508728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:54.508731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:54.508737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:54.508740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:54.508767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602064126105987:3020]
2025-10-10T14:36:54.508779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:54.508786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:54.508801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2165
2025-10-10T14:36:54.508832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2165
2025-10-10T14:36:54.508976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.508991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.509023Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c60ce0f1-1d126514-5477f589-5a31880b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:54.509033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.509039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.509042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:54.509055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.509068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:54.509084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.509279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.509289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.509307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.509425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2166 partition: 0 MaxSeqNo: 40 sessionId: src_id|c60ce0f1-1d126514-5477f589-5a31880b_0
2025-10-10T14:36:54.509850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f24a9a-9f6c01c5-a5e3cef8-ca0ec999_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c60ce0f1-1d126514-5477f589-5a31880b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:54.512824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c60ce0f1-1d126514-5477f589-5a31880b_0] Write session: try to update token
2025-10-10T14:36:54.512846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c60ce0f1-1d126514-5477f589-5a31880b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:54.529662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:54.529677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:54.529681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:54.529684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:54.529694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602064126105987:3020]
2025-10-10T14:36:54.529699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602064126105987:3020]
2025-10-10T14:36:54.529708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602064126105987:3020]
2025-10-10T14:36:54.529751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:54.529761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:54.529763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:54.529773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.529777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:54.529787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:54.529940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:54.531174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId: src_id|c60ce0f1-1d126514-5477f589-5a31880b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:54.534262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:54.577402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602064908336629:2605]
2025-10-10T14:36:54.577703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2165, pipe: [1:7559602064908336629:2605]
2025-10-10T14:36:54.650161Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:54.650835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.650853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.650902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336629:2605], now have 1 active actors on pipe
2025-10-10T14:36:54.651134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:54.651612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c60ce0f1-1d126514-5477f589-5a31880b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:54.651619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c60ce0f1-1d126514-5477f589-5a31880b_0] Write session will restart in 0.005726s
2025-10-10T14:36:54.651638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c60ce0f1-1d126514-5477f589-5a31880b_0] Write session: Do CDS request
2025-10-10T14:36:54.651644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c60ce0f1-1d126514-5477f589-5a31880b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:54.651147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:54.651153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:54.651162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:54.651204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602064908336629:2605]
2025-10-10T14:36:54.651237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2166 reason: error at write: Disconnected sessionId: src_id|c60ce0f1-1d126514-5477f589-5a31880b_0
2025-10-10T14:36:54.651444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2166 sessionId: src_id|c60ce0f1-1d126514-5477f589-5a31880b_0 is DEAD
2025-10-10T14:36:54.658955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c60ce0f1-1d126514-5477f589-5a31880b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.658979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:54.658997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2167
2025-10-10T14:36:54.659207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.659251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:54.659272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:54.659280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:54.659764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2167 sessionId:  describe result for acl check
2025-10-10T14:36:54.659802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:54.659810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:54.659812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:54.659819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602064908336655:3360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:54.660398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602064908336655:3360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:54.662755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602064908336655:3360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:54.666034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602064908336655:3360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:54.666049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602064908336655:3360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:54.666052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602064908336655:3360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:54.666060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:54.670923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:54.674042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:54.674322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:54.674334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:54.674347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:54.674406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:54.674456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602064126106246:3012]
2025-10-10T14:36:54.675132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:54.675497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:54.675573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:54.676139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:54.676233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.676235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.676236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.676237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.676238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.676239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.676241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.676242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.676243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.676244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.676245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.676247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.676248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.676254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.676267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.676272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.676276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.676280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.676284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.676288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.676292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.676296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.676301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.676305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.676309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.676313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.676321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.676330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.676337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.676343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.676348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.676353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.676358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.676363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.676368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.676374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.676378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.676384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.676390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.676396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.676401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.676406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.676411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.676417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.676422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.676427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.676431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.676447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.676452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.676457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.676462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.676467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.676507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:54.679138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:54.679947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:54.679958Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:54.679960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:54.679965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:54.679972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2166 [2:7559602064126106246:3012]
2025-10-10T14:36:54.679997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:54.680016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:54.680025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.680028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.680031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.680049Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:54.680061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:54.680073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:54.680134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.680141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.680144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.680147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:54.680216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:54.680224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.680236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.680252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.680273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:54.680303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336633:2438], now have 1 active actors on pipe
2025-10-10T14:36:54.680314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336783:3360], now have 1 active actors on pipe
2025-10-10T14:36:54.680322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602064126106241:3012]
2025-10-10T14:36:54.680325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602064126106241:3012]
2025-10-10T14:36:54.680327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602064126106241:3012]
2025-10-10T14:36:54.680377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2166
2025-10-10T14:36:54.680342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:54.680418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2166
2025-10-10T14:36:54.680359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:54.680366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:54.680370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:54.680373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:54.680376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:54.680379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:54.680411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602064126106241:3012]
2025-10-10T14:36:54.680415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:54.680418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:54.680436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.680442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.680502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1eff336a-73413322-9f58a1df-fe4b022c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:54.680516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.680520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.680522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:54.680533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.680544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:54.680569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.680755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.680767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.680789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.680862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2167 partition: 0 MaxSeqNo: 40 sessionId: src_id|1eff336a-73413322-9f58a1df-fe4b022c_0
2025-10-10T14:36:54.681270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c60ce0f1-1d126514-5477f589-5a31880b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1eff336a-73413322-9f58a1df-fe4b022c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:54.684228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eff336a-73413322-9f58a1df-fe4b022c_0] Write session: try to update token
2025-10-10T14:36:54.684250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eff336a-73413322-9f58a1df-fe4b022c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:54.699069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId: src_id|1eff336a-73413322-9f58a1df-fe4b022c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:54.700259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:54.700278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:54.700281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:54.700282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:54.700290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602064126106241:3012]
2025-10-10T14:36:54.700294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602064126106241:3012]
2025-10-10T14:36:54.700297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602064126106241:3012]
2025-10-10T14:36:54.700343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:54.700342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:54.700346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:54.700354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:54.700355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.700357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:54.700525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:54.701905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:54.751449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602064908336896:2605]
2025-10-10T14:36:54.751759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2166, pipe: [1:7559602064908336896:2605]
2025-10-10T14:36:54.815542Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:54.815849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.815880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.815930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336896:2605], now have 1 active actors on pipe
2025-10-10T14:36:54.816220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:54.816201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:54.816218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:54.816238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602064908336896:2605]
2025-10-10T14:36:54.816260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:54.816297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2167 reason: error at write: Disconnected sessionId: src_id|1eff336a-73413322-9f58a1df-fe4b022c_0
2025-10-10T14:36:54.816523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2167 sessionId: src_id|1eff336a-73413322-9f58a1df-fe4b022c_0 is DEAD
2025-10-10T14:36:54.816703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eff336a-73413322-9f58a1df-fe4b022c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:54.816712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eff336a-73413322-9f58a1df-fe4b022c_0] Write session will restart in 0.009306s
2025-10-10T14:36:54.816747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eff336a-73413322-9f58a1df-fe4b022c_0] Write session: Do CDS request
2025-10-10T14:36:54.816757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eff336a-73413322-9f58a1df-fe4b022c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:54.826939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eff336a-73413322-9f58a1df-fe4b022c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.827082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:54.827102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2168
2025-10-10T14:36:54.827278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:54.827311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:54.827318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:54.827322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:54.827811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2168 sessionId:  describe result for acl check
2025-10-10T14:36:54.827842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:54.827844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:54.827846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:54.827852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602064908336961:3367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:54.828484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602064908336961:3367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:54.831716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602064908336961:3367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:54.835189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602064908336961:3367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:54.835208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602064908336961:3367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:54.835212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602064908336961:3367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:54.835220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:54.837432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:54.840550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:54.840823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:54.840836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:54.840852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:54.840949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:54.841006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602064126106500:3010]
2025-10-10T14:36:54.841700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:54.842163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:54.842224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:54.842572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:54.842635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.842641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.842642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.842643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.842645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.842646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.842647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.842648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.842650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.842651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.842652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.842653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.842655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.842660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.842672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.842676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.842679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.842684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.842688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.842691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.842694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.842698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.842702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.842706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.842709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.842713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.842721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.842729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:54.842735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.842739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:54.842743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.842748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:54.842752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.842757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:54.842761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.842766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:54.842772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.842777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:54.842781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.842785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:54.842790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.842794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:54.842798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.842803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:54.842806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.842811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:54.842816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.842820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.842824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.842828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.842833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.842837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.842871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:54.845366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:54.845867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:54.845888Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:54.845890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:54.845894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:54.845903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2167 [2:7559602064126106500:3010]
2025-10-10T14:36:54.845918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:54.845936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:54.845945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.845949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.845951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.845972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:54.845980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:54.845988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:54.846050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.846057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.846059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.846061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:54.846141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:54.846149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.846160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:54.846169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:54.846183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:54.846212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908336900:2438], now have 1 active actors on pipe
2025-10-10T14:36:54.846219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908337145:3367], now have 1 active actors on pipe
2025-10-10T14:36:54.846228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602064126106495:3010]
2025-10-10T14:36:54.846234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602064126106495:3010]
2025-10-10T14:36:54.846237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602064126106495:3010]
2025-10-10T14:36:54.846250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:54.846263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:54.846266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:54.846268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:54.846268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:54.846283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:54.846290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:54.846289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2167
2025-10-10T14:36:54.846318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602064126106495:3010]
2025-10-10T14:36:54.846289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2167
2025-10-10T14:36:54.846325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:54.846327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:54.846355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.846363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.846399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|755072a4-2d528354-93fc3f47-418dfd10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:54.846418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:54.846422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:54.846425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:54.846438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:54.846449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:54.846470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.846609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.846617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.846631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:54.846744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2168 partition: 0 MaxSeqNo: 40 sessionId: src_id|755072a4-2d528354-93fc3f47-418dfd10_0
2025-10-10T14:36:54.847164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eff336a-73413322-9f58a1df-fe4b022c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|755072a4-2d528354-93fc3f47-418dfd10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:54.850015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|755072a4-2d528354-93fc3f47-418dfd10_0] Write session: try to update token
2025-10-10T14:36:54.850034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|755072a4-2d528354-93fc3f47-418dfd10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:54.866567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:54.866588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:54.866591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:54.866593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:54.866606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602064126106495:3010]
2025-10-10T14:36:54.866610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602064126106495:3010]
2025-10-10T14:36:54.866614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602064126106495:3010]
2025-10-10T14:36:54.866668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:54.866669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:54.866676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:54.866676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:54.866679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:54.866680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:54.866861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:54.866889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId: src_id|755072a4-2d528354-93fc3f47-418dfd10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:54.869746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:54.916333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602064908337159:2605]
2025-10-10T14:36:54.916772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2167, pipe: [1:7559602064908337159:2605]
2025-10-10T14:36:54.987697Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:54.988431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:54.988459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:54.988524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908337159:2605], now have 1 active actors on pipe
2025-10-10T14:36:54.988843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:54.989001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602064908337159:2605]
2025-10-10T14:36:54.989044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:54.989136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:54.989145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:54.989209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2168 reason: error at write: Disconnected sessionId: src_id|755072a4-2d528354-93fc3f47-418dfd10_0
2025-10-10T14:36:54.989455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2168 sessionId: src_id|755072a4-2d528354-93fc3f47-418dfd10_0 is DEAD
2025-10-10T14:36:54.993607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755072a4-2d528354-93fc3f47-418dfd10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:54.993621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755072a4-2d528354-93fc3f47-418dfd10_0] Write session will restart in 0.009285s
2025-10-10T14:36:54.993648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755072a4-2d528354-93fc3f47-418dfd10_0] Write session: Do CDS request
2025-10-10T14:36:54.993655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755072a4-2d528354-93fc3f47-418dfd10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:55.005964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|755072a4-2d528354-93fc3f47-418dfd10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.006038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:55.006057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2169
2025-10-10T14:36:55.006233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.006271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:55.006278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:55.006287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:55.006749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2169 sessionId:  describe result for acl check
2025-10-10T14:36:55.006786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:55.006793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:55.006795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:55.006801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602069203304498:3373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:55.007396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602069203304498:3373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:55.011141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602069203304498:3373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:55.014158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602069203304498:3373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:55.014175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602069203304498:3373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:55.014178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602069203304498:3373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:55.014187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:55.018341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:55.021596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:55.021839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:55.021845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:55.021857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:55.021916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:55.021959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602068421074051:3005]
2025-10-10T14:36:55.022610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:55.022953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:55.022996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:55.023325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:55.023395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.023397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.023398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.023399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.023401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.023402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.023403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.023404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.023405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.023407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.023408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.023409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.023410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.023416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.023430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.023435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.023439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.023444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.023448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.023452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.023456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.023460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.023464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.023468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.023473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.023477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.023487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.023496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.023503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.023510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.023515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.023521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.023526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.023532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.023537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.023543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.023547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.023553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.023559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.023564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.023568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.023574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.023579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.023586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.023590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.023596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.023604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.023610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.023614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.023620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.023624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.023630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.023674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:55.026450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:55.027156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:55.027176Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:55.027179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:55.027183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:55.027189Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2168 [2:7559602068421074051:3005]
2025-10-10T14:36:55.027203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:55.027240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:55.027248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.027252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.027254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.027272Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:55.027286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:55.027295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:55.027358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.027367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.027369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.027372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:55.027446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:55.027455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.027468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.027481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.027500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:55.027528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203304647:3373], now have 1 active actors on pipe
2025-10-10T14:36:55.027537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602064908337160:2438], now have 1 active actors on pipe
2025-10-10T14:36:55.027545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602068421074046:3005]
2025-10-10T14:36:55.027553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602068421074046:3005]
2025-10-10T14:36:55.027556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602068421074046:3005]
2025-10-10T14:36:55.027574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:55.027595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:55.027651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2168
2025-10-10T14:36:55.027613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:55.027686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2168
2025-10-10T14:36:55.027616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:55.027644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602068421074046:3005]
2025-10-10T14:36:55.027647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:55.027681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:55.027685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:55.027687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:55.027694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:55.027828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.027841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.027888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71c871de-74abd606-166df3cb-5762d784_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:55.027903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.027907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.027910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:55.027923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.027946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:55.027968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.028183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.028202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.028222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.028338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2169 partition: 0 MaxSeqNo: 40 sessionId: src_id|71c871de-74abd606-166df3cb-5762d784_0
2025-10-10T14:36:55.028802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|755072a4-2d528354-93fc3f47-418dfd10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71c871de-74abd606-166df3cb-5762d784_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:55.031658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c871de-74abd606-166df3cb-5762d784_0] Write session: try to update token
2025-10-10T14:36:55.031677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c871de-74abd606-166df3cb-5762d784_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:55.039759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:55.039778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:55.039790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602068421074046:3005]
2025-10-10T14:36:55.039828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:55.039842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:55.040044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:55.040199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:55.040359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:55.040512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:55.040715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:55.040761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:55.048279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId: src_id|71c871de-74abd606-166df3cb-5762d784_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:55.051064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:55.051248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.051272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.051328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:55.051431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:55.058834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:55.058856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:55.058860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:55.058862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:55.058874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602068421074046:3005]
2025-10-10T14:36:55.058880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602068421074046:3005]
2025-10-10T14:36:55.058883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602068421074046:3005]
2025-10-10T14:36:55.058932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:55.058941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.058939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:55.058947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:55.058949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:55.058961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:55.059095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:55.089366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602069203304728:2605]
2025-10-10T14:36:55.089771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2168, pipe: [1:7559602069203304728:2605]
2025-10-10T14:36:55.174631Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:55.183906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.183941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.184140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.184208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.184279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.184347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.184399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.184409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.184484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.184550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.184622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.184703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.184750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.184757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.184829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.184903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.184975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.185056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.185107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.185110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.185186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.185253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.185318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.185462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.185593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.185602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.185681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.185754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.185820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.185888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.185936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.185938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.186010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.186072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.186137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.186201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.186244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.186247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.186316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.186377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.186440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.186506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.186548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.186551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.186624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.186683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.186745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.186804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.186846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.186849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.186921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.186977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.187040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.187105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.187150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.187154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.187227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.187292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.187356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.187418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.187460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.187463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.188000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203304728:2605], now have 1 active actors on pipe
2025-10-10T14:36:55.189614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:55.189880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:55.189931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:55.189939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:55.189967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2169 reason: error at write: Disconnected sessionId: src_id|71c871de-74abd606-166df3cb-5762d784_0
2025-10-10T14:36:55.190168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2169 sessionId: src_id|71c871de-74abd606-166df3cb-5762d784_0 is DEAD
2025-10-10T14:36:55.190352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602069203304728:2605]
2025-10-10T14:36:55.191094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c871de-74abd606-166df3cb-5762d784_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:55.191106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c871de-74abd606-166df3cb-5762d784_0] Write session will restart in 0.009964s
2025-10-10T14:36:55.191145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c871de-74abd606-166df3cb-5762d784_0] Write session: Do CDS request
2025-10-10T14:36:55.191152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c871de-74abd606-166df3cb-5762d784_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:55.201926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71c871de-74abd606-166df3cb-5762d784_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.205458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:55.205475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2170
2025-10-10T14:36:55.206136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.206187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:55.206192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:55.206196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:55.206619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2170 sessionId:  describe result for acl check
2025-10-10T14:36:55.206663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:55.206670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:55.206672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:55.206679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602069203304770:3408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:55.207268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602069203304770:3408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:55.212758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602069203304770:3408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:55.218038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602069203304770:3408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:55.218061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602069203304770:3408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:55.218064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602069203304770:3408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:55.218073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:55.222011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:55.224955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:55.225175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:55.225188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:55.225200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:55.225249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:55.225294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602068421074361:2995]
2025-10-10T14:36:55.226016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:55.226410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:55.226482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:55.226855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:55.226945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.226953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.226954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.226956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.226957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.226959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.226960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.226961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.226963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.226964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.226965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.226966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.226967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.226974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.226989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.226993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.226998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.227002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.227005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.227009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.227013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.227016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.227020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.227024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.227027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.227031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.227040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.227048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.227055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.227077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.227084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.227097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.227104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.227110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.227114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.227119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.227133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.227138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.227143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.227152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.227157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.227161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.227168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.227179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.227183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.227195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.227201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.227211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.227216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.227220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.227233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.227238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.227278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:55.230246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:55.230835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:55.230848Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:55.230850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:55.230854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:55.230861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2169 [2:7559602068421074361:2995]
2025-10-10T14:36:55.230875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:55.230894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:55.230897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.230901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.230905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.230921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:55.230928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:55.230936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:55.230999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.231010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.231012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.231014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:55.231085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:55.231093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.231105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.231120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.231140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:55.231167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203304745:2438], now have 1 active actors on pipe
2025-10-10T14:36:55.231174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203304960:3408], now have 1 active actors on pipe
2025-10-10T14:36:55.231181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602068421074356:2995]
2025-10-10T14:36:55.231184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602068421074356:2995]
2025-10-10T14:36:55.231186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602068421074356:2995]
2025-10-10T14:36:55.231200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:55.231216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:55.231235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:55.231242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:55.231268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602068421074356:2995]
2025-10-10T14:36:55.231270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:55.231252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2169
2025-10-10T14:36:55.231284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:55.231254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2169
2025-10-10T14:36:55.231290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:55.231292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:55.231300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:55.231377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.231387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.231424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:55.231436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.231446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.231449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:55.231462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.231477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:55.231497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.231710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.231721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.231744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.231843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2170 partition: 0 MaxSeqNo: 40 sessionId: src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0
2025-10-10T14:36:55.232302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71c871de-74abd606-166df3cb-5762d784_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:55.235082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0] Write session: try to update token
2025-10-10T14:36:55.235101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:55.254543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:55.254565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:55.254569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:55.254572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:55.254583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602068421074356:2995]
2025-10-10T14:36:55.254588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602068421074356:2995]
2025-10-10T14:36:55.254593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602068421074356:2995]
2025-10-10T14:36:55.254649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:55.254663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.254666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:55.254819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:55.257509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:55.257525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:55.257530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:55.258232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId: src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:55.261294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:55.290087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602069203305015:2605]
2025-10-10T14:36:55.290619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2169, pipe: [1:7559602069203305015:2605]
2025-10-10T14:36:55.383079Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:55.383631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.383646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.383699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305015:2605], now have 1 active actors on pipe
2025-10-10T14:36:55.384002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:55.384413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:55.384466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602069203305015:2605]
2025-10-10T14:36:55.384487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:55.384557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0
2025-10-10T14:36:55.384775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2170 sessionId: src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0 is DEAD
2025-10-10T14:36:55.385563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:55.385576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0] Write session will restart in 0.006408s
2025-10-10T14:36:55.385605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0] Write session: Do CDS request
2025-10-10T14:36:55.385612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:55.392874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.393127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:55.393146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2171
2025-10-10T14:36:55.393350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.393398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:55.393404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:55.393422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:55.393848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2171 sessionId:  describe result for acl check
2025-10-10T14:36:55.393882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:55.393883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:55.393886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:55.393896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602069203305034:3415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:55.394480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602069203305034:3415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:55.396747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602069203305034:3415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:55.402299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602069203305034:3415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:55.402320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602069203305034:3415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:55.402324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602069203305034:3415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:55.402335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:55.409980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:55.413283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:55.413540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:55.413554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:55.413568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:55.413634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:55.413676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602068421074618:2982]
2025-10-10T14:36:55.414304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:55.414655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:55.414714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:55.415082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:55.415162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.415169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.415170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.415172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.415173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.415175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.415176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.415178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.415190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.415192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.415193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.415195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.415196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.415203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.415218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.415222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.415226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.415231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.415235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.415240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.415244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.415248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.415253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.415257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.415261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.415265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.415275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.415285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.415297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.415308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.415314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.415324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.415329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.415338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.415345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.415354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.415360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.415365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.415372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.415381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.415387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.415396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.415403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.415413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.415419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.415429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.415434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.415444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.415449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.415458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.415462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.415471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.415512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:55.418307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:55.418655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:55.418668Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:55.418671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:55.418675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:55.418682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2170 [2:7559602068421074618:2982]
2025-10-10T14:36:55.418699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:55.418722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:55.418725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.418729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.418731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.418749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:55.418757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:55.418765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:55.418834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.418842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.418844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.418846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:55.418915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:55.418923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.418933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.418949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.418969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:55.418994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602068421074613:2982]
2025-10-10T14:36:55.419001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602068421074613:2982]
2025-10-10T14:36:55.419003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602068421074613:2982]
2025-10-10T14:36:55.419020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:55.419038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:55.419058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:55.419061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:55.419087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:55.419093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602068421074613:2982]
2025-10-10T14:36:55.419096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:55.419096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:55.419098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:55.419106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:55.419269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305019:2438], now have 1 active actors on pipe
2025-10-10T14:36:55.419285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305131:3415], now have 1 active actors on pipe
2025-10-10T14:36:55.419533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2170
2025-10-10T14:36:55.419547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2170
2025-10-10T14:36:55.419659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.419671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.419705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:55.419714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.419727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.419731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:55.419745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.419759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:55.419777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.421385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.421398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.421426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.421978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2171 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0
2025-10-10T14:36:55.422461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ad927fd-27330c8-39a6bce7-e2d9a476_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:55.425304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0] Write session: try to update token
2025-10-10T14:36:55.425324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:55.439708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:55.439734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:55.439738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:55.439740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:55.439751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602068421074613:2982]
2025-10-10T14:36:55.439756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602068421074613:2982]
2025-10-10T14:36:55.439760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602068421074613:2982]
2025-10-10T14:36:55.439815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:55.439822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.439826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:55.439990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:55.441406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:55.441427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:55.441430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:55.443579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId: src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:55.446290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:55.484637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602069203305279:2605]
2025-10-10T14:36:55.485020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2170, pipe: [1:7559602069203305279:2605]
2025-10-10T14:36:55.555263Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:55.556065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.556085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.556134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305279:2605], now have 1 active actors on pipe
2025-10-10T14:36:55.556307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:55.556362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:55.556389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602069203305279:2605]
2025-10-10T14:36:55.556473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:55.556484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:55.556554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2171 reason: error at write: Disconnected sessionId: src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0
2025-10-10T14:36:55.556766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2171 sessionId: src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0 is DEAD
2025-10-10T14:36:55.556999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:55.557010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0] Write session will restart in 0.007678s
2025-10-10T14:36:55.557037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0] Write session: Do CDS request
2025-10-10T14:36:55.557045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:55.565904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.572328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:55.572347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2172
2025-10-10T14:36:55.572575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.572628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:55.572640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:55.572654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:55.573240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2172 sessionId:  describe result for acl check
2025-10-10T14:36:55.573292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:55.573295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:55.573297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:55.573305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602069203305317:3418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:55.573952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602069203305317:3418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:55.578278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602069203305317:3418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:55.581983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602069203305317:3418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:55.582002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602069203305317:3418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:55.582006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602069203305317:3418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:55.582016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:55.586294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:55.589020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:55.589252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:55.589264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:55.589276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:55.589355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:55.589402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602068421074877:2976]
2025-10-10T14:36:55.590054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:55.590432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:55.590490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:55.590864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:55.590926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.590932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.590934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.590935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.590937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.590938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.590939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.590940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.590942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.590943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.590944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.590946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.590947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.590954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.590967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.590971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.590974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.590978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.590982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.590985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.590988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.590992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.591093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.591104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.591107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.591111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.591121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.591130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.591141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.591146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.591151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.591156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.591161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.591166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.591174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.591185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.591190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.591200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.591206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.591211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.591216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.591221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.591230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.591235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.591239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.591245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.591249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.591254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.591263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.591268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.591273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.591282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.591318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:55.593932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:55.594892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:55.594909Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:55.594912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:55.594916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:55.594924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2171 [2:7559602068421074877:2976]
2025-10-10T14:36:55.594940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:55.594961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:55.594965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.594969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.594971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.594990Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:55.595005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:55.595014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:55.595083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.595093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.595095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.595098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:55.595177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:55.595186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.595198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.595210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.595233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:55.595256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305478:3418], now have 1 active actors on pipe
2025-10-10T14:36:55.595260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305282:2438], now have 1 active actors on pipe
2025-10-10T14:36:55.595268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602068421074872:2976]
2025-10-10T14:36:55.595270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602068421074872:2976]
2025-10-10T14:36:55.595272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602068421074872:2976]
2025-10-10T14:36:55.595287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:55.595301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:55.595304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:55.595323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:55.595323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:55.595326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:55.595328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:55.595341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2171
2025-10-10T14:36:55.595374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2171
2025-10-10T14:36:55.595357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602068421074872:2976]
2025-10-10T14:36:55.595364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:55.595374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:55.595397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.595402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.595440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:55.595448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.595453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.595456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:55.595470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.595482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:55.595498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.595677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.595690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.595709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.595814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2172 partition: 0 MaxSeqNo: 40 sessionId: src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0
2025-10-10T14:36:55.596214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c9fcb4-e9e19305-2dae6783-155ca517_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:55.599218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0] Write session: try to update token
2025-10-10T14:36:55.599235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:55.614112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:55.614135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:55.614148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602068421074872:2976]
2025-10-10T14:36:55.614207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:55.614401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:55.614558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:55.614710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:55.614853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:55.615040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:55.615089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:55.616037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId: src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:55.617467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:55.618722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:55.618942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.618960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.619013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:55.619128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:55.628979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:55.629002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:55.629006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:55.629009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:55.629021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602068421074872:2976]
2025-10-10T14:36:55.629025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602068421074872:2976]
2025-10-10T14:36:55.629029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602068421074872:2976]
2025-10-10T14:36:55.629076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:55.629079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:55.629087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.629089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:55.629090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:55.629092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:55.629233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:55.656765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602069203305544:2605]
2025-10-10T14:36:55.657353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2171, pipe: [1:7559602069203305544:2605]
2025-10-10T14:36:55.744070Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:55.752798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.752826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.753014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.753083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.753154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.753224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.753275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.753288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.753381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.753446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.757304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:55.757319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0] Write session will restart in 0.007412s
2025-10-10T14:36:55.756850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602069203305544:2605]
2025-10-10T14:36:55.756900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:55.756903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:55.756937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2172 reason: error at write: Disconnected sessionId: src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0
2025-10-10T14:36:55.757149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2172 sessionId: src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0 is DEAD
2025-10-10T14:36:55.753515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.757267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:55.757391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0] Write session: Do CDS request
2025-10-10T14:36:55.753591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.757398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:55.753633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.753641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.753714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.753774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.753833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.753894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.753939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.753942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.754020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.754086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.754151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.754219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.754264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.754267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.754348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.754409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.754541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.754661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.754704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.754707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.754781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.754837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.754903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.754967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.755029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.755032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.755101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.755155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.755219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.755286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.755329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.755335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.755406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.755474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.755538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.755602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.755646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.755649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.755720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.755780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.755838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.755898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.755941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.755944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.756039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:55.756097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:55.756162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:55.756227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:55.756346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:55.756349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:55.756432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305544:2605], now have 1 active actors on pipe
2025-10-10T14:36:55.757834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:55.766435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.769502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:55.769519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2173
2025-10-10T14:36:55.773472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.773527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:55.773534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:55.773539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:55.774086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2173 sessionId:  describe result for acl check
2025-10-10T14:36:55.774123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:55.774131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:55.774132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:55.774137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602069203305586:3429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:55.774645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602069203305586:3429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:55.778546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602069203305586:3429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:55.787993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602069203305586:3429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:55.788011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602069203305586:3429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:55.788014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602069203305586:3429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:55.788022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:55.800173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:55.803940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:55.804361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:55.804374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:55.804388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:55.804475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:55.804535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602068421075136:2974]
2025-10-10T14:36:55.805201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:55.805661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:55.805713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:55.806071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:55.806135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.806143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.806144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.806145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.806147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.806148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.806150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.806151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.806152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.806154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.806155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.806156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.806157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.806164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.806177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.806180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.806186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.806189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.806193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.806196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.806200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.806203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.806207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.806211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.806214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.806217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.806226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.806235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.806242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.806247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.806252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.806258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.806269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.806275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.806286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.806291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.806296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.806301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.806306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.806311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.806317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.806347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.806357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.806362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.806367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.806373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.806378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.806386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.806395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.806401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.806410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.806416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.806460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:55.814398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:55.814745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:55.814751Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:55.814755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:55.814779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:55.814788Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2172 [2:7559602068421075136:2974]
2025-10-10T14:36:55.814804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:55.814828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:55.814832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.814837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.814839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.814861Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:55.814869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:55.814879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:55.814957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.814960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.814962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.814965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:55.815049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:55.815053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.815067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.815078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.815097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:55.815124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602068421075130:2974]
2025-10-10T14:36:55.815127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602068421075130:2974]
2025-10-10T14:36:55.815129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602068421075130:2974]
2025-10-10T14:36:55.815145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:55.815163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:55.815166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:55.815171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:55.815173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:55.815181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:55.815184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:55.815227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602068421075130:2974]
2025-10-10T14:36:55.815231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:55.815245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:55.815258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305552:2438], now have 1 active actors on pipe
2025-10-10T14:36:55.815262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305706:3429], now have 1 active actors on pipe
2025-10-10T14:36:55.815734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.815748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.815786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:55.815812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.815818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.815821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:55.815835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.815850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:55.815869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.816135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.816140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.816161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:55.816707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c5679d4-3b81dfe5-fbba4be6-d8e60ef2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:55.815599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2172
2025-10-10T14:36:55.815646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2172
2025-10-10T14:36:55.816291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2173 partition: 0 MaxSeqNo: 40 sessionId: src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0
2025-10-10T14:36:55.819651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0] Write session: try to update token
2025-10-10T14:36:55.819671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:55.837453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:55.837474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:55.837479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:55.837481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:55.837493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602068421075130:2974]
2025-10-10T14:36:55.837499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602068421075130:2974]
2025-10-10T14:36:55.837503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602068421075130:2974]
2025-10-10T14:36:55.837557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:55.837567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.837570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:55.837726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:55.839656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:55.839671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:55.839675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:55.840634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId: src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:55.843604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:55.856845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602069203305818:2605]
2025-10-10T14:36:55.857318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2172, pipe: [1:7559602069203305818:2605]
2025-10-10T14:36:55.961706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:55.962315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.962325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:55.962365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305818:2605], now have 1 active actors on pipe
2025-10-10T14:36:55.962898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:55.965400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:55.965415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602069203305818:2605]
2025-10-10T14:36:55.965455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:55.965539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2173 reason: status is not ok: tablet will be restarted right now sessionId: src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0
2025-10-10T14:36:55.965744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2173 sessionId: src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0 is DEAD
2025-10-10T14:36:55.965927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:55.965939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0] Write session will restart in 0.007785s
2025-10-10T14:36:55.965972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0] Write session: Do CDS request
2025-10-10T14:36:55.965978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:55.974970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.975007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:55.975028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2174
2025-10-10T14:36:55.975242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:55.975289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:55.975299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:55.975304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:55.976408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2174 sessionId:  describe result for acl check
2025-10-10T14:36:55.976451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:55.976453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:55.976458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:55.976464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602069203305865:3442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:55.977076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602069203305865:3442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:55.982434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602069203305865:3442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:55.987578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602069203305865:3442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:55.987599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602069203305865:3442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:55.987603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602069203305865:3442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:55.987614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:55.990252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:55.993749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:55.993999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:55.994008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:55.994020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:55.994074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:55.994123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602068421075396:2959]
2025-10-10T14:36:55.994723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:55.995086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:55.995147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:55.995512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:55.995572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.995578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.995579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.995580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.995581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.995582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.995583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.995585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.995586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.995587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.995588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.995590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.995591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.995597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.995611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.995615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.995618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.995623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.995626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.995630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.995634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.995637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.995641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.995644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.995649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.995653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.995661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.995669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:55.995675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.995708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:55.995717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.995723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:55.995730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.995739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:55.995744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.995750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:55.995758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.995762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:55.995767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.995772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:55.995781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.995785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:55.995790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.995795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:55.995804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.995819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:55.995823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.995834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.995838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.995844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.995857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.995866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.995904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:55.999721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2173
2025-10-10T14:36:55.999775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2173
2025-10-10T14:36:55.998901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:56.000343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2174 partition: 0 MaxSeqNo: 40 sessionId: src_id|953b85cd-2d2c5869-a01794a2-29894f76_0
2025-10-10T14:36:55.999260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:55.999266Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:55.999270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:55.999275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:55.999283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2173 [2:7559602068421075396:2959]
2025-10-10T14:36:55.999298Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:55.999321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:55.999325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:55.999330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:55.999332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:55.999353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:55.999363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:55.999373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:55.999442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.999445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.999447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.999450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:55.999527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:55.999530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:55.999542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:55.999553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:55.999570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:55.999594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203305825:2438], now have 1 active actors on pipe
2025-10-10T14:36:55.999597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602069203306066:3442], now have 1 active actors on pipe
2025-10-10T14:36:55.999606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602068421075391:2959]
2025-10-10T14:36:55.999608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602068421075391:2959]
2025-10-10T14:36:55.999613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602068421075391:2959]
2025-10-10T14:36:55.999628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:55.999644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:55.999657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:55.999659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:55.999661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:55.999663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:55.999663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:55.999696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602068421075391:2959]
2025-10-10T14:36:55.999705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:55.999758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:55.999965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:55.999973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.000004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|953b85cd-2d2c5869-a01794a2-29894f76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:56.000014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.000019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.000021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:56.000780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74535f69-4ed8f4c6-cc15150e-6f035f26_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|953b85cd-2d2c5869-a01794a2-29894f76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:56.000034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.000046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:56.000061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.000200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.000203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.000220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.003707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953b85cd-2d2c5869-a01794a2-29894f76_0] Write session: try to update token
2025-10-10T14:36:56.003726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953b85cd-2d2c5869-a01794a2-29894f76_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:56.026752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId: src_id|953b85cd-2d2c5869-a01794a2-29894f76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:56.029680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:56.030017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.030045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.030092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:56.030215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:56.035283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:56.035309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:56.035314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:56.035316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:56.035329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602068421075391:2959]
2025-10-10T14:36:56.035336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602068421075391:2959]
2025-10-10T14:36:56.035341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602068421075391:2959]
2025-10-10T14:36:56.035409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:56.035430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.035433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:56.035679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:56.038190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:56.038207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:56.038216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:56.065765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602073498273378:2605]
2025-10-10T14:36:56.066115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2173, pipe: [1:7559602073498273378:2605]
2025-10-10T14:36:56.156953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:56.166208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.166239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.166432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.166510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.166584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.166659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.166715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.166726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.166803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.166873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.166945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.167028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.167078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.167087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.167161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.167231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.167300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.167368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.167422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.167429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.167507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.167583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.167653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.167729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.167777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.167785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.167856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.167923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.168003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.168072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.168123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.168135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.168206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.168279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.168359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.168437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.168489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.168498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.168570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.168640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.168718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.168791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.168914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.168927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.169009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.169080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.169151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.169218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.169267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.169274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.169362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.169428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.169502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.169579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.169626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.169637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.169709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:56.169778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:56.169853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:56.169929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:56.169976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:56.169985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:56.170057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498273378:2605], now have 1 active actors on pipe
2025-10-10T14:36:56.170365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602073498273378:2605]
2025-10-10T14:36:56.170379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:56.170416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:56.170419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:56.170460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2174 reason: error at write: Disconnected sessionId: src_id|953b85cd-2d2c5869-a01794a2-29894f76_0
2025-10-10T14:36:56.170835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2174 sessionId: src_id|953b85cd-2d2c5869-a01794a2-29894f76_0 is DEAD
2025-10-10T14:36:56.170987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953b85cd-2d2c5869-a01794a2-29894f76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:56.170996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953b85cd-2d2c5869-a01794a2-29894f76_0] Write session will restart in 0.006000s
2025-10-10T14:36:56.171023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953b85cd-2d2c5869-a01794a2-29894f76_0] Write session: Do CDS request
2025-10-10T14:36:56.171029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953b85cd-2d2c5869-a01794a2-29894f76_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:56.171346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:56.177879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|953b85cd-2d2c5869-a01794a2-29894f76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.178002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:56.178019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2175
2025-10-10T14:36:56.178153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.178191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:56.178202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:56.178207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:56.178732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2175 sessionId:  describe result for acl check
2025-10-10T14:36:56.178772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:56.178781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:56.178783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:56.178789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602073498273408:3445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:56.179368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602073498273408:3445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:56.182556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602073498273408:3445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:56.185861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602073498273408:3445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:56.185879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602073498273408:3445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:56.185883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602073498273408:3445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:56.185893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:56.193814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:56.197213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:56.197481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:56.197494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:56.197508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:56.197581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:56.197645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602072716042967:2968]
2025-10-10T14:36:56.198322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:56.198666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:56.198728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:56.199107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:56.199176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.199184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.199186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.199187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.199189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.199191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.199192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.199194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.199196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.199198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.199199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.199200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.199202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.199208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.199222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.199227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.199233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.199237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.199243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.199247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.199251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.199255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.199260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.199265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.199269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.199273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.199282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.199291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.199299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.199305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.199310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.199316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.199322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.199328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.199334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.199340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.199345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.199351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.199356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.199362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.199367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.199373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.199380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.199386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.199391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.199397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.199403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.199409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.199424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.199430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.199435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.199440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.199484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:56.202223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:56.202580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:56.202592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:56.202595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:56.202600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:56.202610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2174 [2:7559602072716042967:2968]
2025-10-10T14:36:56.202623Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:56.202644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:56.202665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.202674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.202677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.202696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:56.202708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:56.202717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:56.202788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.202796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.202798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.202802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:56.202874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:56.202882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.202895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.202913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.202938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:56.202966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498273393:2438], now have 1 active actors on pipe
2025-10-10T14:36:56.202974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498273524:3445], now have 1 active actors on pipe
2025-10-10T14:36:56.202983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602072716042962:2968]
2025-10-10T14:36:56.202990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602072716042962:2968]
2025-10-10T14:36:56.202993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602072716042962:2968]
2025-10-10T14:36:56.203007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:56.203026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:56.203029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:56.203032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:56.203034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:56.203047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:56.203051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:56.203045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2174
2025-10-10T14:36:56.203082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602072716042962:2968]
2025-10-10T14:36:56.203093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:56.203099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:56.203103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2174
2025-10-10T14:36:56.203151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.203164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.203195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63dff98c-bbf978b-734f320-2a67475b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:56.203203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.203207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.203218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:56.203231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.203246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:56.203267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.203727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.203739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.203760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.203874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2175 partition: 0 MaxSeqNo: 40 sessionId: src_id|63dff98c-bbf978b-734f320-2a67475b_0
2025-10-10T14:36:56.204392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|953b85cd-2d2c5869-a01794a2-29894f76_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63dff98c-bbf978b-734f320-2a67475b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:56.207622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dff98c-bbf978b-734f320-2a67475b_0] Write session: try to update token
2025-10-10T14:36:56.207642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dff98c-bbf978b-734f320-2a67475b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:56.216347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:56.216379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:56.216391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602072716042962:2968]
2025-10-10T14:36:56.216440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:56.216445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:56.216632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:56.216792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:56.216942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:56.217092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:56.217395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:56.217445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:56.234160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId: src_id|63dff98c-bbf978b-734f320-2a67475b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:56.237503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:56.238834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.238863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.238889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:56.238894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:56.238897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:56.238899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:56.238912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602072716042962:2968]
2025-10-10T14:36:56.238916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602072716042962:2968]
2025-10-10T14:36:56.238920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602072716042962:2968]
2025-10-10T14:36:56.238960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:56.238973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:56.238976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:56.238981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:56.238989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.238997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:56.239140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:56.270498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602073498273670:2605]
2025-10-10T14:36:56.270727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2174, pipe: [1:7559602073498273670:2605]
2025-10-10T14:36:56.357829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:56.358377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:56.358427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498273670:2605], now have 1 active actors on pipe
2025-10-10T14:36:56.358602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:56.358780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602073498273670:2605]
2025-10-10T14:36:56.358806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:56.371919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:56.371936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:56.371981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2175 reason: error at write: Disconnected sessionId: src_id|63dff98c-bbf978b-734f320-2a67475b_0
2025-10-10T14:36:56.372141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2175 sessionId: src_id|63dff98c-bbf978b-734f320-2a67475b_0 is DEAD
2025-10-10T14:36:56.372345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dff98c-bbf978b-734f320-2a67475b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:56.372388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dff98c-bbf978b-734f320-2a67475b_0] Write session will restart in 0.008503s
2025-10-10T14:36:56.372418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dff98c-bbf978b-734f320-2a67475b_0] Write session: Do CDS request
2025-10-10T14:36:56.372424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dff98c-bbf978b-734f320-2a67475b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:56.382020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63dff98c-bbf978b-734f320-2a67475b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.385620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:56.385640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2176
2025-10-10T14:36:56.385838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.385892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:56.385904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:56.385921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:56.386414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2176 sessionId:  describe result for acl check
2025-10-10T14:36:56.386462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:56.386468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:56.386473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:56.386483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602073498273795:3496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:56.387122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602073498273795:3496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:56.391654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602073498273795:3496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:56.395027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:56.395143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602073498273795:3496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:56.395163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602073498273795:3496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:56.395167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602073498273795:3496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:56.395176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:56.398360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:56.398650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:56.398662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:56.398675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:56.398737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:56.398788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602072716043269:2945]
2025-10-10T14:36:56.399467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:56.399828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:56.399921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:56.400346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:56.400421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.400423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.400424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.400425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.400426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.400428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.400429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.400430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.400432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.400433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.400435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.400436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.400437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.400445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.400460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.400465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.400470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.400475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.400479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.400483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.400487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.400491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.400496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.400501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.400505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.400509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.400518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.400527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.400534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.400540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.400545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.400552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.400557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.400563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.400569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.400592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.400597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.400603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.400608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.400614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.400618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.400624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.400629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.400635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.400640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.400646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.400652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.400657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.400662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.400668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.400673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.400679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.400721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:56.403484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:56.403827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:56.403846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:56.403848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:56.403852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:56.403860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2175 [2:7559602072716043269:2945]
2025-10-10T14:36:56.403876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:56.403897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:56.403907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.403911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.403914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.403933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:56.403959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:56.403972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:56.404054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.404062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.404064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.404067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:56.404311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2175
2025-10-10T14:36:56.404319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2175
2025-10-10T14:36:56.404481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:56.404497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.404511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.404528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.404553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:56.404585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498273940:3496], now have 1 active actors on pipe
2025-10-10T14:36:56.404593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498273687:2438], now have 1 active actors on pipe
2025-10-10T14:36:56.404615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.404628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.404649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602072716043263:2945]
2025-10-10T14:36:56.404657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602072716043263:2945]
2025-10-10T14:36:56.404659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602072716043263:2945]
2025-10-10T14:36:56.404675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:56.404694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:56.404698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:56.404703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:56.404705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:56.404717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:56.404721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:56.404749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:56.404762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.404767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.404774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:56.404787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.404805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:56.404839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602072716043263:2945]
2025-10-10T14:36:56.404852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:56.404858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:56.404869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.405066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.405078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.405101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.405222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2176 partition: 0 MaxSeqNo: 40 sessionId: src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0
2025-10-10T14:36:56.406342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63dff98c-bbf978b-734f320-2a67475b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:56.409151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0] Write session: try to update token
2025-10-10T14:36:56.409169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:56.426947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:56.426973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:56.426977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:56.426979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:56.426990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602072716043263:2945]
2025-10-10T14:36:56.426996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602072716043263:2945]
2025-10-10T14:36:56.426999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602072716043263:2945]
2025-10-10T14:36:56.427049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:56.427064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.427066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:56.427068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:56.427076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:56.427081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:56.427215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:56.425323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId: src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:56.428291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:56.458945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602073498273952:2605]
2025-10-10T14:36:56.459272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2175, pipe: [1:7559602073498273952:2605]
2025-10-10T14:36:56.543690Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:56.544535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.544561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.544625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498273952:2605], now have 1 active actors on pipe
2025-10-10T14:36:56.544983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:56.544990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:56.545001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:56.545050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602073498273952:2605]
2025-10-10T14:36:56.545081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2176 reason: error at write: Disconnected sessionId: src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0
2025-10-10T14:36:56.545814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:56.545835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0] Write session will restart in 0.005350s
2025-10-10T14:36:56.545343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2176 sessionId: src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0 is DEAD
2025-10-10T14:36:56.545861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0] Write session: Do CDS request
2025-10-10T14:36:56.545869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:56.544937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:56.552922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.552991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:56.553011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2177
2025-10-10T14:36:56.553147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.553182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:56.553189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:56.553192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:56.553719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2177 sessionId:  describe result for acl check
2025-10-10T14:36:56.553758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:56.553765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:56.553769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:56.553775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602073498273969:3483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:56.554360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602073498273969:3483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:56.557132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602073498273969:3483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:56.561480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602073498273969:3483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:56.561498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602073498273969:3483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:56.561502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602073498273969:3483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:56.561513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:56.566534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:56.569914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:56.570180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:56.570193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:56.570207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:56.570272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:56.570319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602072716043532:2930]
2025-10-10T14:36:56.571029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:56.571388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:56.571437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:56.571781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:56.571849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.571860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.571861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.571862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.571864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.571865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.571866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.571867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.571868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.571870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.571871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.571872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.571873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.571879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.571894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.571898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.571901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.571906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.571910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.571914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.571918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.571922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.571927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.571931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.571935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.571938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.571963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.571972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.571979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.571985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.571992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.571998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.572002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.572008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.572013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.572018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.572023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.572028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.572033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.572039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.572044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.572050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.572054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.572059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.572064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.572069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.572074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.572079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.572084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.572089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.572093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.572099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.572142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:56.575021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:56.575816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:56.575830Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:56.575833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:56.575837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:56.575844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2176 [2:7559602072716043532:2930]
2025-10-10T14:36:56.575858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:56.575882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:56.575890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.575895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.575897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.575917Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:56.575958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:56.575973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:56.576041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.576050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.576052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.576055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:56.576125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:56.576133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.576146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.576159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.576183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:56.576212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498273954:2438], now have 1 active actors on pipe
2025-10-10T14:36:56.576220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498274126:3483], now have 1 active actors on pipe
2025-10-10T14:36:56.576227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602072716043527:2930]
2025-10-10T14:36:56.576230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602072716043527:2930]
2025-10-10T14:36:56.576232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602072716043527:2930]
2025-10-10T14:36:56.576249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:56.576264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:56.576268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:56.576271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:56.576273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:56.576285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:56.576289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:56.576281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2176
2025-10-10T14:36:56.576322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602072716043527:2930]
2025-10-10T14:36:56.576331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:56.576327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2176
2025-10-10T14:36:56.576337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:56.576362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.576371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.576409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:56.576422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.576427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.576429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:56.576441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.576452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:56.576470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.576689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.576700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.576718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.576795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2177 partition: 0 MaxSeqNo: 40 sessionId: src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0
2025-10-10T14:36:56.577204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4bd6277-9051d920-bc04e77a-5a0f82fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:56.580069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0] Write session: try to update token
2025-10-10T14:36:56.580094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:56.600215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId: src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:56.600261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:56.600280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:56.600283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:56.600285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:56.600297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602072716043527:2930]
2025-10-10T14:36:56.600302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602072716043527:2930]
2025-10-10T14:36:56.600306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602072716043527:2930]
2025-10-10T14:36:56.600358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:56.600370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.600370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:56.600377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:56.600377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:56.600381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:56.600527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:56.603035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:56.645354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602073498274220:2605]
2025-10-10T14:36:56.649821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2176, pipe: [1:7559602073498274220:2605]
2025-10-10T14:36:56.717241Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:56.717843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.717864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.717914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498274220:2605], now have 1 active actors on pipe
2025-10-10T14:36:56.718185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:56.718200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:56.718256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:56.718262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:56.718339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2177 reason: error at write: Disconnected sessionId: src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0
2025-10-10T14:36:56.718579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2177 sessionId: src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0 is DEAD
2025-10-10T14:36:56.718753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:56.718736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602073498274220:2605]
2025-10-10T14:36:56.718764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0] Write session will restart in 0.005851s
2025-10-10T14:36:56.718791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0] Write session: Do CDS request
2025-10-10T14:36:56.718813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:56.725954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.726061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:56.726077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2178
2025-10-10T14:36:56.726215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.726250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:56.726261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:56.726265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:56.726792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2178 sessionId:  describe result for acl check
2025-10-10T14:36:56.726834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:56.726840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:56.726842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:56.726848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602073498274242:3500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:56.727459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602073498274242:3500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:56.730672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602073498274242:3500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:56.734843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602073498274242:3500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:56.734861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602073498274242:3500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:56.734865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602073498274242:3500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:56.734874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:56.742506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:56.745550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:56.745814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:56.745820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:56.745833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:56.745895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:56.745934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602072716043796:2940]
2025-10-10T14:36:56.746601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:56.746982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:56.747054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:56.747423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:56.747491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.747500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.747501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.747502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.747503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.747505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.747506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.747507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.747509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.747510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.747511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.747512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.747514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.747521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.747535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.747539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.747543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.747546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.747551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.747555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.747558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.747562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.747567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.747571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.747575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.747579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.747598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.747607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.747614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.747619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.747624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.747629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.747634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.747640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.747645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.747651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.747655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.747660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.747666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.747671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.747675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.747681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.747686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.747693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.747697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.747702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.747707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.747712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.747717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.747722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.747728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.747733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.747789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:56.750423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:56.751271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:56.751288Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:56.751290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:56.751294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:56.751300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2177 [2:7559602072716043796:2940]
2025-10-10T14:36:56.751313Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:56.751332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:56.751335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.751340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.751342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.751360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:56.751369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:56.751377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:56.751449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.751456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.751457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.751460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:56.751532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:56.751541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.751552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.751564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.751580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:56.751608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498274226:2438], now have 1 active actors on pipe
2025-10-10T14:36:56.751618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498274360:3500], now have 1 active actors on pipe
2025-10-10T14:36:56.751626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602072716043791:2940]
2025-10-10T14:36:56.751633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602072716043791:2940]
2025-10-10T14:36:56.751636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602072716043791:2940]
2025-10-10T14:36:56.751649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:56.751709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2177
2025-10-10T14:36:56.751775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2177
2025-10-10T14:36:56.751676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:56.751700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:56.751703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:56.751736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602072716043791:2940]
2025-10-10T14:36:56.751739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:56.751854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:56.751865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:56.751867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:56.751874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:56.751987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.752000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.752030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|312c284c-bde6a196-62674bd9-6cb9f674_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:56.752043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.752048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.752050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:56.752063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.752075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:56.752090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.752447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.752458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.752476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.752606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2178 partition: 0 MaxSeqNo: 40 sessionId: src_id|312c284c-bde6a196-62674bd9-6cb9f674_0
2025-10-10T14:36:56.753039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bc47fdd-d0b4052-a07ce830-218b9578_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|312c284c-bde6a196-62674bd9-6cb9f674_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:56.755843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312c284c-bde6a196-62674bd9-6cb9f674_0] Write session: try to update token
2025-10-10T14:36:56.755865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312c284c-bde6a196-62674bd9-6cb9f674_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:56.773532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:56.773553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:56.773557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:56.773560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:56.773569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602072716043791:2940]
2025-10-10T14:36:56.773574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602072716043791:2940]
2025-10-10T14:36:56.773579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602072716043791:2940]
2025-10-10T14:36:56.773633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:56.773642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.773644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:56.773816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:56.777518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:56.777535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:56.777542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:56.783314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId: src_id|312c284c-bde6a196-62674bd9-6cb9f674_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:56.786213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:56.818927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602073498274500:2605]
2025-10-10T14:36:56.819333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2177, pipe: [1:7559602073498274500:2605]
2025-10-10T14:36:56.893904Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:56.894420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.894436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.894460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498274500:2605], now have 1 active actors on pipe
2025-10-10T14:36:56.894683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:56.894681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602073498274500:2605]
2025-10-10T14:36:56.894680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:56.894686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:56.894721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:56.894753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2178 reason: error at write: Disconnected sessionId: src_id|312c284c-bde6a196-62674bd9-6cb9f674_0
2025-10-10T14:36:56.894965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2178 sessionId: src_id|312c284c-bde6a196-62674bd9-6cb9f674_0 is DEAD
2025-10-10T14:36:56.895116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312c284c-bde6a196-62674bd9-6cb9f674_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:56.895127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312c284c-bde6a196-62674bd9-6cb9f674_0] Write session will restart in 0.005652s
2025-10-10T14:36:56.895161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312c284c-bde6a196-62674bd9-6cb9f674_0] Write session: Do CDS request
2025-10-10T14:36:56.895170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312c284c-bde6a196-62674bd9-6cb9f674_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:56.901894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312c284c-bde6a196-62674bd9-6cb9f674_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.902030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:56.902049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2179
2025-10-10T14:36:56.902170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:56.902206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:56.902217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:56.902221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:56.902698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2179 sessionId:  describe result for acl check
2025-10-10T14:36:56.902739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:56.902746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:56.902748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:56.902755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602073498274518:3507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:56.903361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602073498274518:3507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:56.905985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602073498274518:3507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:56.910593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602073498274518:3507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:56.910614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602073498274518:3507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:56.910618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602073498274518:3507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:56.910628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:56.915574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:56.919064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:56.919344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:56.919357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:56.919370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:56.919431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:56.919479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602072716044061:2939]
2025-10-10T14:36:56.920181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:56.920621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:56.920674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:56.921070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:56.921137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.921143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.921144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.921145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.921147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.921148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.921150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.921151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.921153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.921155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.921157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.921158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.921160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.921167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.921181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.921186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.921191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.921198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.921203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.921211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.921215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.921219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.921224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.921229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.921232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.921236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.921246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.921268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:56.921278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.921285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:56.921294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.921300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:56.921308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.921314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:56.921318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.921324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:56.921344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.921351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:56.921357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.921371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:56.921377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.921383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:56.921388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.921393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:56.921397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.921403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:56.921408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.921414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.921420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.921424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.921429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.921433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.921483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:56.925803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:56.926364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:56.926391Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:56.926394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:56.926398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:56.926405Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2178 [2:7559602072716044061:2939]
2025-10-10T14:36:56.926420Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:56.926439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:56.926443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.926447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.926449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.926470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:56.926485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:56.926495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:56.926569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.926580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.926582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.926585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:56.926660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:56.926668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.926682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:56.926699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:56.926716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:56.926745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498274671:3507], now have 1 active actors on pipe
2025-10-10T14:36:56.926753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498274502:2438], now have 1 active actors on pipe
2025-10-10T14:36:56.926762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602072716044056:2939]
2025-10-10T14:36:56.926765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602072716044056:2939]
2025-10-10T14:36:56.926768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602072716044056:2939]
2025-10-10T14:36:56.926781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:56.926797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:56.926796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:56.926800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:56.926802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:56.926819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:56.926823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:56.926857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602072716044056:2939]
2025-10-10T14:36:56.926867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:56.926874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:56.927428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2178
2025-10-10T14:36:56.927490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2178
2025-10-10T14:36:56.927611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.927629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.927689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5875460-efef0c60-447fa8f9-4cc488f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:56.927705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:56.927710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:56.927714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:56.927728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:56.927743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:56.927776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.927967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.927981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.928004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:56.928115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2179 partition: 0 MaxSeqNo: 40 sessionId: src_id|5875460-efef0c60-447fa8f9-4cc488f_0
2025-10-10T14:36:56.928554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312c284c-bde6a196-62674bd9-6cb9f674_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5875460-efef0c60-447fa8f9-4cc488f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:56.931489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5875460-efef0c60-447fa8f9-4cc488f_0] Write session: try to update token
2025-10-10T14:36:56.931510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5875460-efef0c60-447fa8f9-4cc488f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:56.948558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId: src_id|5875460-efef0c60-447fa8f9-4cc488f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:56.951596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:56.952233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:56.952260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:56.952287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:56.952291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:56.952302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602072716044056:2939]
2025-10-10T14:36:56.952351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:56.952368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:56.952564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:56.952725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:56.952878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:56.953026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:56.953246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:56.953315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:56.954226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:56.953542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:56.973824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:56.973848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:56.973852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:56.973855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:56.973867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602072716044056:2939]
2025-10-10T14:36:56.973872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602072716044056:2939]
2025-10-10T14:36:56.973876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602072716044056:2939]
2025-10-10T14:36:56.973937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:56.973947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:56.973950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:56.974124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:56.977663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:56.977683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:56.977688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:56.995045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602073498274771:2605]
2025-10-10T14:36:56.997907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2178, pipe: [1:7559602073498274771:2605]
2025-10-10T14:36:57.096978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:57.106795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.106834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.107036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.107116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.107187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.107263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.107311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.107322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.107400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.107465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.107542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.107612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.107657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.107660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.107749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.107810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.107873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.107990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.108033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.108036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.108118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.108180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.108247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.108314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.108360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.108363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.108437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.108496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.108563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.108633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.108678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.108681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.108758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.108828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.108900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.108975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.109024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.109027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.109104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.109168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.109236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.109301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.109556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.109570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.109652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.111114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602073498274771:2605]
2025-10-10T14:36:57.111167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:57.111170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:57.111205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2179 reason: error at write: Disconnected sessionId: src_id|5875460-efef0c60-447fa8f9-4cc488f_0
2025-10-10T14:36:57.111446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2179 sessionId: src_id|5875460-efef0c60-447fa8f9-4cc488f_0 is DEAD
2025-10-10T14:36:57.111676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:57.111970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5875460-efef0c60-447fa8f9-4cc488f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:57.111984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5875460-efef0c60-447fa8f9-4cc488f_0] Write session will restart in 0.006214s
2025-10-10T14:36:57.112010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5875460-efef0c60-447fa8f9-4cc488f_0] Write session: Do CDS request
2025-10-10T14:36:57.112016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5875460-efef0c60-447fa8f9-4cc488f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:57.109719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.109802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.109870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.109917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.109920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.109993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.110059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.110129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.110195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.110242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.110245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.110319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.110382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.110450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.110516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.110560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.110566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.110653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602073498274771:2605], now have 1 active actors on pipe
2025-10-10T14:36:57.112118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:57.120142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5875460-efef0c60-447fa8f9-4cc488f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.120252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:57.120269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2180
2025-10-10T14:36:57.120408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.120462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:57.120475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:57.120480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:57.120935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2180 sessionId:  describe result for acl check
2025-10-10T14:36:57.120970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:57.120975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:57.120976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:57.120982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602077793242097:3522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:57.121534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602077793242097:3522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:57.123701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602077793242097:3522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:57.129853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602077793242097:3522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:57.129875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602077793242097:3522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:57.129879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602077793242097:3522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:57.129889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:57.142278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:57.149456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:57.149760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:57.149773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:57.149786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:57.149851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:57.149903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602077011011637:2931]
2025-10-10T14:36:57.150587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:57.151796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:57.151860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:57.152310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:57.152382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.152390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.152391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.152392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.152394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.152395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.152397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.152399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.152400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.152402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.152403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.152405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.152406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.152414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.152429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.152434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.152439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.152443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.152448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.152452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.152457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.152461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.152466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.152471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.152475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.152480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.152489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.152499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.152506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.152513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.152518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.152524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.152530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.152537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.152543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.152549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.152554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.152561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.152571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.152577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.152582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.152588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.152594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.152601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.152605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.152611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.152618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.152623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.152628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.152633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.152639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.152645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.152691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:57.160886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:57.161472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:57.161484Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:57.161487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:57.161492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:57.161499Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2179 [2:7559602077011011637:2931]
2025-10-10T14:36:57.161515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:57.161537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:57.161541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.161544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.161548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.161567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:57.161582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:57.161591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:57.161669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.161676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.161679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.161682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:57.161758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:57.161766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.161779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.161797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.161821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:57.161849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602077011011631:2931]
2025-10-10T14:36:57.161857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602077011011631:2931]
2025-10-10T14:36:57.161860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602077011011631:2931]
2025-10-10T14:36:57.161874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:57.161892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242188:3522], now have 1 active actors on pipe
2025-10-10T14:36:57.161896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242082:2438], now have 1 active actors on pipe
2025-10-10T14:36:57.161906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:57.161927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:57.161930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:57.161972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602077011011631:2931]
2025-10-10T14:36:57.161980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:57.161987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2179
2025-10-10T14:36:57.162029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2179
2025-10-10T14:36:57.162092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:57.162102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:57.162106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:57.162113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:57.162245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.162268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.162303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:57.162317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.162322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.162324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:57.162341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.162354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:57.162386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.162600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.162608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.162623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.163188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5875460-efef0c60-447fa8f9-4cc488f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:57.166170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0] Write session: try to update token
2025-10-10T14:36:57.166193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:57.162728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2180 partition: 0 MaxSeqNo: 40 sessionId: src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0
2025-10-10T14:36:57.187474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:57.187496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:57.187499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:57.187501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:57.187512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602077011011631:2931]
2025-10-10T14:36:57.187517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602077011011631:2931]
2025-10-10T14:36:57.187522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602077011011631:2931]
2025-10-10T14:36:57.187579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:57.187587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.187589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:57.187590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:57.187598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:57.187602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:57.187746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:57.200473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId: src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:57.203371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:57.211093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602077793242351:2605]
2025-10-10T14:36:57.211436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2179, pipe: [1:7559602077793242351:2605]
2025-10-10T14:36:57.306117Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:57.306432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.306448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.306472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242351:2605], now have 1 active actors on pipe
2025-10-10T14:36:57.306726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:57.306742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:57.306816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2180 reason: error at write: Disconnected sessionId: src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0
2025-10-10T14:36:57.307036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2180 sessionId: src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0 is DEAD
2025-10-10T14:36:57.307084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:57.307190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:57.307202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0] Write session will restart in 0.008905s
2025-10-10T14:36:57.307227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0] Write session: Do CDS request
2025-10-10T14:36:57.307233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:57.307282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:57.307327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602077793242351:2605]
2025-10-10T14:36:57.316974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.317057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:57.317075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2181
2025-10-10T14:36:57.317236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.317287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:57.317297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:57.317303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:57.317788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2181 sessionId:  describe result for acl check
2025-10-10T14:36:57.317824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:57.317833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:57.317835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:57.317842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602077793242381:3547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:57.318434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602077793242381:3547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:57.322221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602077793242381:3547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:57.326890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602077793242381:3547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:57.326913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602077793242381:3547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:57.326918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602077793242381:3547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:57.326926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:57.333267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:57.336555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:57.336788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:57.336802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:57.336815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:57.336871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:57.336919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602077011011942:2920]
2025-10-10T14:36:57.337622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:57.337978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:57.338061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:57.338443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:57.338502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.338508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.338509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.338510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.338512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.338525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.338527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.338529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.338530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.338531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.338532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.338533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.338535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.338542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.338557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.338562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.338566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.338571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.338575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.338579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.338583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.338588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.338592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.338596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.338601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.338605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.338613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.338622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.338638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.338643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.338649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.338656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.338661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.338667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.338672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.338677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.338681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.338687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.338691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.338697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.338702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.338708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.338713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.338719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.338723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.338729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.338733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.338742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.338748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.338753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.338762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.338768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.338810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:57.341581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:57.341974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:57.341988Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:57.341991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:57.341995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:57.342002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2180 [2:7559602077011011942:2920]
2025-10-10T14:36:57.342016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:57.342035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:57.342048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.342052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.342055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.342073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:57.342081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:57.342089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:57.342149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.342156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.342159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.342162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:57.342230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:57.342239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.342251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.342264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.342288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:57.342314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242533:3547], now have 1 active actors on pipe
2025-10-10T14:36:57.342327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602077011011930:2920]
2025-10-10T14:36:57.342331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602077011011930:2920]
2025-10-10T14:36:57.342334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602077011011930:2920]
2025-10-10T14:36:57.342354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:57.342368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242366:2438], now have 1 active actors on pipe
2025-10-10T14:36:57.342372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:57.342374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:57.342376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:57.342382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:57.342399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:57.342408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:57.342443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2180
2025-10-10T14:36:57.342476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2180
2025-10-10T14:36:57.342438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602077011011930:2920]
2025-10-10T14:36:57.342452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:57.342459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:57.342485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.342490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.342523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:57.342530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.342534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.342537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:57.342549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.342560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:57.342577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.342874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.342882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.342900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.343120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2181 partition: 0 MaxSeqNo: 40 sessionId: src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0
2025-10-10T14:36:57.345513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ef38d6-1ad7a942-f88d8316-eb2c1fc9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:57.348307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0] Write session: try to update token
2025-10-10T14:36:57.348330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:57.367316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId: src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:57.370352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:57.370613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.370639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.370685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:57.370776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:57.374802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:57.374823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:57.374828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:57.374830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:57.374841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602077011011930:2920]
2025-10-10T14:36:57.374847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602077011011930:2920]
2025-10-10T14:36:57.374853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602077011011930:2920]
2025-10-10T14:36:57.374913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:57.374926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.374930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:57.374934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:57.374937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:57.374942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:57.375103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:57.406775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602077793242648:2605]
2025-10-10T14:36:57.407305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2180, pipe: [1:7559602077793242648:2605]
2025-10-10T14:36:57.498530Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:57.508218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.508254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.508452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.508526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.508591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.508662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.508706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.508712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.508788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.508848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.508911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.508984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.509028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.509031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.509106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.509169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.509231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.509295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.511977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602077793242648:2605]
2025-10-10T14:36:57.512022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:57.512025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:57.512056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2181 reason: error at write: Disconnected sessionId: src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0
2025-10-10T14:36:57.512313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2181 sessionId: src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0 is DEAD
2025-10-10T14:36:57.512468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:57.512480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0] Write session will restart in 0.009056s
2025-10-10T14:36:57.512504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0] Write session: Do CDS request
2025-10-10T14:36:57.512510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:57.512867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:57.509479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.509489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.509566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.509627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.509689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.509751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.509801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.509804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.509873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.509937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.510000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.510065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.510105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.510109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.510179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.510237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.510301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.510367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.510411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.510417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.510491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.510550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.510614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.510677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.510722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.510725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.510799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.510863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.510927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.510992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.511035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.511039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.511111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.511173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.511238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.511303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.511347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.511351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.511421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.511477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.511541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.511607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.511651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.511654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.511726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242648:2605], now have 1 active actors on pipe
2025-10-10T14:36:57.513058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:57.522963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.523013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:57.523031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2182
2025-10-10T14:36:57.525635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.525690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:57.525695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:57.525699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:57.526055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2182 sessionId:  describe result for acl check
2025-10-10T14:36:57.526084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:57.526090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:57.526091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:57.526096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602077793242663:3562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:57.526531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602077793242663:3562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:57.529497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602077793242663:3562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:57.533319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602077793242663:3562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:57.533356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602077793242663:3562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:57.533360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602077793242663:3562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:57.533370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:57.553546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:57.555978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:57.556215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:57.556220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:57.556232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:57.556287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:57.556338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602077011012211:2910]
2025-10-10T14:36:57.557009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:57.557377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:57.557436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:57.557781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:57.557846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.557852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.557854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.557855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.557857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.557858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.557859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.557860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.557862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.557863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.557865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.557866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.557867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.557874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.557886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.557890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.557895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.557898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.557902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.557905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.557910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.557913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.557918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.557921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.557925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.557928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.557938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.557946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.557953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.557958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.557962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.557966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.557971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.557976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.557982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.557986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.557991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.558004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.558008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.558013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.558017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.558022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.558027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.558032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.558036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.558041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.558046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.558051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.558055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.558060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.558065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.558070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.558110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:57.560769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:57.561504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:57.561528Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:57.561531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:57.561534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:57.561542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2181 [2:7559602077011012211:2910]
2025-10-10T14:36:57.561562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:57.561585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:57.561604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.561607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.561609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.561630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:57.561638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:57.561646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:57.561716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.561725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.561726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.561729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:57.561803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:57.561812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.561826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.561839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.561858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:57.561886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242695:3562], now have 1 active actors on pipe
2025-10-10T14:36:57.561895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242651:2438], now have 1 active actors on pipe
2025-10-10T14:36:57.561903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602077011012206:2910]
2025-10-10T14:36:57.561905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602077011012206:2910]
2025-10-10T14:36:57.561907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602077011012206:2910]
2025-10-10T14:36:57.561921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:57.561938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:57.561941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:57.561942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:57.561943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:57.561960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:57.561968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:57.562004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602077011012206:2910]
2025-10-10T14:36:57.562017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:57.562023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:57.562154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2181
2025-10-10T14:36:57.562244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.562190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2181
2025-10-10T14:36:57.562261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.562309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:57.562324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.562329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.562345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:57.562359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.562372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:57.562390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.562584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.562597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.562623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.562726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2182 partition: 0 MaxSeqNo: 40 sessionId: src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0
2025-10-10T14:36:57.563128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|341cf024-d1fe2395-f6553cf3-8124ec9e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:57.566014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0] Write session: try to update token
2025-10-10T14:36:57.566036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:57.581383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId: src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:57.583365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:57.583391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:57.583394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:57.583396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:57.583408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602077011012206:2910]
2025-10-10T14:36:57.583413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602077011012206:2910]
2025-10-10T14:36:57.583416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602077011012206:2910]
2025-10-10T14:36:57.583463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:57.583466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:57.583474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.583477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:57.583480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:57.583485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:57.583622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:57.584598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:57.612024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602077793242922:2605]
2025-10-10T14:36:57.612509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2181, pipe: [1:7559602077793242922:2605]
2025-10-10T14:36:57.708209Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:57.708914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.708932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.708979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242922:2605], now have 1 active actors on pipe
2025-10-10T14:36:57.709229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:57.709306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602077793242922:2605]
2025-10-10T14:36:57.709362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:57.709442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2182 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0
2025-10-10T14:36:57.709668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2182 sessionId: src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0 is DEAD
2025-10-10T14:36:57.709700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:57.713463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:57.713478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0] Write session will restart in 0.007383s
2025-10-10T14:36:57.713519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0] Write session: Do CDS request
2025-10-10T14:36:57.713529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:57.722080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.722543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:57.722562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2183
2025-10-10T14:36:57.722690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.722723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:57.722729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:57.722734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:57.723185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2183 sessionId:  describe result for acl check
2025-10-10T14:36:57.723216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:57.723217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:57.723219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:57.723227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602077793242956:3578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:57.723813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602077793242956:3578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:57.727884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602077793242956:3578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:57.732772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602077793242956:3578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:57.732796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602077793242956:3578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:57.732801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602077793242956:3578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:57.732812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:57.743042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:57.747002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:57.747316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:57.747322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:57.747335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:57.747399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:57.747444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602077011012481:2908]
2025-10-10T14:36:57.748100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:57.748454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:57.748512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:57.748881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:57.748947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.748954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.748955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.748956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.748958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.748959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.748960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.748962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.748963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.748965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.748966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.748967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.748969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.748975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.748989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.748993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.748998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.749002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.749006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.749010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.749014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.749018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.749025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.749028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.749032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.749036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.749045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.749053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.749065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.749071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.749075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.749081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.749085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.749091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.749096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.749101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.749106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.749111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.749116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.749132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.749141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.749147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.749152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.749162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.749166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.749172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.749177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.749182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.749186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.749197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.749201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.749206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.749252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:57.751964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:57.752518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:57.752531Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:57.752534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:57.752538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:57.752547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2182 [2:7559602077011012481:2908]
2025-10-10T14:36:57.752561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:57.752581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:57.752584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.752588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.752591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.752609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:57.752617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:57.752626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:57.752701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.752710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.752713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.752716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:57.752788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:57.752796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.752808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.752821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.752840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:57.752864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602077011012476:2908]
2025-10-10T14:36:57.752867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602077011012476:2908]
2025-10-10T14:36:57.752869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602077011012476:2908]
2025-10-10T14:36:57.752879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:57.752889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:57.752892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:57.752894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:57.752894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:57.752911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:57.752915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:57.752928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793243072:3578], now have 1 active actors on pipe
2025-10-10T14:36:57.752932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793242925:2438], now have 1 active actors on pipe
2025-10-10T14:36:57.752962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602077011012476:2908]
2025-10-10T14:36:57.752970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:57.753015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2182
2025-10-10T14:36:57.753026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2182
2025-10-10T14:36:57.753089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:57.753285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.753298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.753364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:57.753380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.753385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.753388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:57.753401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.753414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:57.753433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.753666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.753676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.753708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.753832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2183 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0
2025-10-10T14:36:57.754278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9f6447-3755d76a-1a74c622-12ebfe1a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:57.757302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0] Write session: try to update token
2025-10-10T14:36:57.757323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:57.774850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId: src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:57.777747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:57.777998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.778024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.778067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:57.778134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:57.780097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:57.780115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:57.780118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:57.780120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:57.780130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602077011012476:2908]
2025-10-10T14:36:57.780134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602077011012476:2908]
2025-10-10T14:36:57.780138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602077011012476:2908]
2025-10-10T14:36:57.780187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:57.780197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:57.780203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:57.780204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.780207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:57.780207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:57.780378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:57.809134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602077793243204:2605]
2025-10-10T14:36:57.809875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2182, pipe: [1:7559602077793243204:2605]
2025-10-10T14:36:57.898449Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:57.907890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.907938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.908139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.908214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.908290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.908361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.908421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.908437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.908518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.908590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.908657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.908734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.909100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.909105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.909189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.909256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.912362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:57.912389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:57.912425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2183 reason: error at write: Disconnected sessionId: src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0
2025-10-10T14:36:57.912677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2183 sessionId: src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0 is DEAD
2025-10-10T14:36:57.912720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:57.912797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602077793243204:2605]
2025-10-10T14:36:57.912990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:57.913004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0] Write session will restart in 0.006766s
2025-10-10T14:36:57.913032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0] Write session: Do CDS request
2025-10-10T14:36:57.913039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:57.909418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.909503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.909548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.909551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.909633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.909696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.909762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.909828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.909870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.909872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.909946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.910010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.910072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.910136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.910179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.910182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.910257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.910319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.910382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.910447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.910493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.910496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.910570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.910631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.910700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.910763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.910810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.910815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.910884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.910946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.911010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.911080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.911124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.911127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.911202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.911264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.911327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.911393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.911437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.911441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.911515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:57.911578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:57.911646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:57.911715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:57.911760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:57.911763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:57.911856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793243204:2605], now have 1 active actors on pipe
2025-10-10T14:36:57.913547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:57.920981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.921740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:57.921762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2184
2025-10-10T14:36:57.921931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:57.921974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:57.921987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:57.921991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:57.922531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2184 sessionId:  describe result for acl check
2025-10-10T14:36:57.922577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:57.922582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:57.922585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:57.922592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602077793243222:3577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:57.923656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602077793243222:3577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:57.937407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602077793243222:3577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:57.946655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602077793243222:3577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:57.946677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602077793243222:3577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:57.946681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602077793243222:3577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:57.946691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:57.961512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:57.961961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:57.962236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:57.962248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:57.962262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:57.962321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:57.962368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602077011012751:2902]
2025-10-10T14:36:57.963001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:57.967438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:57.967530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:57.967942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:57.968038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.968046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.968047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.968049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.968050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.968053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.968054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.968056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.968058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.968060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.968061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.968063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.968064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.968074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.968088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.968093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.968097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.968102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.968106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.968111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.968115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.968120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.968125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.968129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.968133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.968138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.968147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.968158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:57.968165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.968170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:57.968176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.968182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:57.968187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.968194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:57.968200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.968213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:57.968218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.968229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:57.968235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.968246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:57.968251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.968262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:57.968268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.968274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:57.968280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.968285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:57.968290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.968302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.968309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.968320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.968326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.968331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.968378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:57.971298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:57.971670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:57.971691Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:57.971694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:57.971699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:57.971708Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2183 [2:7559602077011012751:2902]
2025-10-10T14:36:57.971724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:57.971747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:57.971751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.971756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.971759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.971780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:57.971790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:57.971798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:57.971872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.971875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.971879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.971882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:57.971978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:57.971982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:57.972017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:57.972031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:57.972050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:57.972075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793243207:2438], now have 1 active actors on pipe
2025-10-10T14:36:57.972079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602077793243421:3577], now have 1 active actors on pipe
2025-10-10T14:36:57.972088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602077011012746:2902]
2025-10-10T14:36:57.972091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602077011012746:2902]
2025-10-10T14:36:57.972094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602077011012746:2902]
2025-10-10T14:36:57.972110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:57.972128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:57.972139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:57.972143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:57.972145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:57.972146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:57.972150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:57.972187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602077011012746:2902]
2025-10-10T14:36:57.972196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:57.972202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:57.972538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2183
2025-10-10T14:36:57.972551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2183
2025-10-10T14:36:57.972899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.972915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.972955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:57.972971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:57.972977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:57.972981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:57.972995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:57.973010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:57.973032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.973242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:57.973253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:57.973284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:57.973443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2184 partition: 0 MaxSeqNo: 40 sessionId: src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0
2025-10-10T14:36:57.977680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e44fd8d-1f159552-fa3a260c-8926ad66_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:57.981827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0] Write session: try to update token
2025-10-10T14:36:57.981852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:57.984611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:57.984636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:57.984648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602077011012746:2902]
2025-10-10T14:36:57.984706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:57.984914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:57.985083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:57.985241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:57.985255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:57.985421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:57.985639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:57.985682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:58.003951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:58.003970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:58.003974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:58.003977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:58.003989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602077011012746:2902]
2025-10-10T14:36:58.003993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602077011012746:2902]
2025-10-10T14:36:58.003997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602077011012746:2902]
2025-10-10T14:36:58.004054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:58.004064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.004067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:58.004139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:58.004152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:58.004159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:58.004221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:58.001957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId: src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:58.004904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:58.012908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602082088210777:2605]
2025-10-10T14:36:58.013976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2183, pipe: [1:7559602082088210777:2605]
2025-10-10T14:36:58.120786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:58.121529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.121549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.121578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088210777:2605], now have 1 active actors on pipe
2025-10-10T14:36:58.121788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:58.122509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:58.122613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0
2025-10-10T14:36:58.123008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:58.123021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0] Write session will restart in 0.006728s
2025-10-10T14:36:58.123048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0] Write session: Do CDS request
2025-10-10T14:36:58.123055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:58.122829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2184 sessionId: src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0 is DEAD
2025-10-10T14:36:58.123010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602082088210777:2605]
2025-10-10T14:36:58.123025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:58.130943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.131129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:58.131147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2185
2025-10-10T14:36:58.131385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.131454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:58.131468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:58.131473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:58.132029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2185 sessionId:  describe result for acl check
2025-10-10T14:36:58.132067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:58.132074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:58.132076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:58.132082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602082088210799:3593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:58.132674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602082088210799:3593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:58.141786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602082088210799:3593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:58.150852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602082088210799:3593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:58.150874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602082088210799:3593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:58.150879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602082088210799:3593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:58.150889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:58.171783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:58.174869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:58.175146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:58.175152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:58.175165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:58.175227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:58.175272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602081305980332:2903]
2025-10-10T14:36:58.175939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:58.176741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:58.176820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:58.177230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:58.177306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.177311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.177312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.177313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.177315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.177316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.177318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.177319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.177320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.177321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.177323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.177324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.177325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.177347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.177360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.177364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.177368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.177371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.177375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.177378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.177383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.177386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.177390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.177394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.177398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.177401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.177410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.177418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.177425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.177430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.177436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.177441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.177445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.177453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.177458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.177463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.177467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.177472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.177476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.177480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.177484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.177490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.177495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.177515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.177519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.177524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.177532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.177537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.177546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.177550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.177556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.177561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.177614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:58.181181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:58.181585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:58.181591Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:58.181594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:58.181600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:58.181608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2184 [2:7559602081305980332:2903]
2025-10-10T14:36:58.181626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:58.181649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:58.181652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.181656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.181659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.181682Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:58.181692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:58.181702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:58.181780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.181783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.181785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.181788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:58.181866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:58.181870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.181882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.181893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.181911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:58.181934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602081305980327:2903]
2025-10-10T14:36:58.181937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602081305980327:2903]
2025-10-10T14:36:58.181942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602081305980327:2903]
2025-10-10T14:36:58.181961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:58.181977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:58.181993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:58.181997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:58.182034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602081305980327:2903]
2025-10-10T14:36:58.182037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:58.182309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:58.182317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:58.182320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:58.182327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:58.182634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2184
2025-10-10T14:36:58.182638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2184
2025-10-10T14:36:58.182729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088210914:3593], now have 1 active actors on pipe
2025-10-10T14:36:58.182738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088210792:2438], now have 1 active actors on pipe
2025-10-10T14:36:58.183061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.183071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.183105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:58.183116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.183121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.183123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:58.183137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.183154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:58.183172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.183589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.183599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.183619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.183762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2185 partition: 0 MaxSeqNo: 40 sessionId: src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0
2025-10-10T14:36:58.184203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24f0d357-94235ee2-ff1a7257-21411d5b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:58.187328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0] Write session: try to update token
2025-10-10T14:36:58.187349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:58.207413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId: src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:58.210569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:58.212336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.212378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.212412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:58.212415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:58.212419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:58.212421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:58.212435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602081305980327:2903]
2025-10-10T14:36:58.212452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602081305980327:2903]
2025-10-10T14:36:58.212458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602081305980327:2903]
2025-10-10T14:36:58.212511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:58.212523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:58.212528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:58.212532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:58.212540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.212543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:58.212695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:58.223302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602082088211066:2605]
2025-10-10T14:36:58.223701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2184, pipe: [1:7559602082088211066:2605]
2025-10-10T14:36:58.334604Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:58.335281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:58.335351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211066:2605], now have 1 active actors on pipe
2025-10-10T14:36:58.335422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:58.335885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602082088211066:2605]
2025-10-10T14:36:58.335934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:58.349352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:58.349374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:58.349406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2185 reason: error at write: Disconnected sessionId: src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0
2025-10-10T14:36:58.349578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2185 sessionId: src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0 is DEAD
2025-10-10T14:36:58.349883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:58.349896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0] Write session will restart in 0.005429s
2025-10-10T14:36:58.349923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0] Write session: Do CDS request
2025-10-10T14:36:58.349930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:58.356951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.357106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:58.357143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2186
2025-10-10T14:36:58.357381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.357430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:58.357435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:58.357440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:58.357887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2186 sessionId:  describe result for acl check
2025-10-10T14:36:58.357927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:58.357930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:58.357932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:58.357938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602082088211150:3614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:58.358506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602082088211150:3614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:58.361687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602082088211150:3614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:58.370244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602082088211150:3614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:58.370265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602082088211150:3614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:58.370269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602082088211150:3614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:58.370278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:58.374368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:58.381741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:58.382058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:58.382072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:58.382085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:58.382152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:58.382196Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602081305980623:2886]
2025-10-10T14:36:58.382869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:58.383385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:58.383450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:58.383794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:58.383851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.383858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.383859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.383860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.383861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.383862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.383863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.383865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.383866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.383867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.383868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.383870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.383871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.383878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.383890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.383893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.383897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.383915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.383918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.383922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.383926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.383929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.383933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.383936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.383939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.383943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.383950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.383960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.383966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.383971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.383976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.383981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.383985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.383991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.383995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.384000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.384003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.384008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.384013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.384017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.384020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.384025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.384030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.384035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.384039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.384043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.384047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.384052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.384056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.384061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.384065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.384070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.384106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:58.387371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:58.388788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:58.388808Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:58.388810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:58.388815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:58.388822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2185 [2:7559602081305980623:2886]
2025-10-10T14:36:58.388850Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:58.388876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:58.388885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.388888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.388890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.388910Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:58.388923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:58.388935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:58.389000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.389007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.389009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.389011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:58.389558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2185
2025-10-10T14:36:58.389597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2185
2025-10-10T14:36:58.389090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:58.389098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.389111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.389122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.389137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:58.389160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211321:3614], now have 1 active actors on pipe
2025-10-10T14:36:58.389163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211069:2438], now have 1 active actors on pipe
2025-10-10T14:36:58.389171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602081305980612:2886]
2025-10-10T14:36:58.389173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602081305980612:2886]
2025-10-10T14:36:58.389175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602081305980612:2886]
2025-10-10T14:36:58.389186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:58.389200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:58.389214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:58.389217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:58.389259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602081305980612:2886]
2025-10-10T14:36:58.389261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:58.389443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:58.389448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:58.389450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:58.389457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:58.389677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.389684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.389719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97d17315-9683c726-4fd1150a-cfd02af3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:58.389729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.389734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.389736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:58.389748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.389763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:58.389781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.390049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.390064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.390089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.393791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2186 partition: 0 MaxSeqNo: 40 sessionId: src_id|97d17315-9683c726-4fd1150a-cfd02af3_0
2025-10-10T14:36:58.394210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6968bfb-26a7b00d-7a3da0e-230cd46_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|97d17315-9683c726-4fd1150a-cfd02af3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:58.396988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d17315-9683c726-4fd1150a-cfd02af3_0] Write session: try to update token
2025-10-10T14:36:58.397014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d17315-9683c726-4fd1150a-cfd02af3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:58.414929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:58.414949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:58.414953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:58.414955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:58.414966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602081305980612:2886]
2025-10-10T14:36:58.414971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602081305980612:2886]
2025-10-10T14:36:58.414975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602081305980612:2886]
2025-10-10T14:36:58.415030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:58.415038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.415041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:58.415195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:58.417559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:58.417575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:58.417580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:58.426866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId: src_id|97d17315-9683c726-4fd1150a-cfd02af3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:58.429928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:58.436329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602082088211368:2605]
2025-10-10T14:36:58.436849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2185, pipe: [1:7559602082088211368:2605]
2025-10-10T14:36:58.534671Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:58.534984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.535002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.535050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211368:2605], now have 1 active actors on pipe
2025-10-10T14:36:58.535310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:58.535314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:58.535327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:58.535381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602082088211368:2605]
2025-10-10T14:36:58.535396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2186 reason: error at write: Disconnected sessionId: src_id|97d17315-9683c726-4fd1150a-cfd02af3_0
2025-10-10T14:36:58.535632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2186 sessionId: src_id|97d17315-9683c726-4fd1150a-cfd02af3_0 is DEAD
2025-10-10T14:36:58.535292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:58.535800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d17315-9683c726-4fd1150a-cfd02af3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:58.535821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d17315-9683c726-4fd1150a-cfd02af3_0] Write session will restart in 0.007525s
2025-10-10T14:36:58.535857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d17315-9683c726-4fd1150a-cfd02af3_0] Write session: Do CDS request
2025-10-10T14:36:58.535866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d17315-9683c726-4fd1150a-cfd02af3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:58.544941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d17315-9683c726-4fd1150a-cfd02af3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.544989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:58.545014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2187
2025-10-10T14:36:58.545222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.545282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:58.545292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:58.545296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:58.545816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2187 sessionId:  describe result for acl check
2025-10-10T14:36:58.545855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:58.545857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:58.545859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:58.545865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602082088211407:3615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:58.546450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602082088211407:3615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:58.550453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602082088211407:3615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:58.554147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602082088211407:3615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:58.554164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602082088211407:3615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:58.554168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602082088211407:3615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:58.554176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:58.557017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:58.560030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:58.560259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:58.560271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:58.560282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:58.560333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:58.560378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602081305980916:2878]
2025-10-10T14:36:58.561034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:58.561378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:58.561424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:58.561752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:58.561828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.561836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.561838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.561839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.561840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.561841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.561842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.561843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.561844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.561845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.561847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.561848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.561849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.561855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.561869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.561873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.561877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.561881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.561886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.561890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.561894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.561898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.561903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.561907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.561911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.561915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.561923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.561931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.561938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.561948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.561954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.561959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.561963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.561973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.561979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.561984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.561989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.561994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.562004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.562009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.562014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.562023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.562028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.562033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.562044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.562049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.562070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.562076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.562085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.562091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.562095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.562098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.562122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:58.564660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:58.565072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:58.565084Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:58.565086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:58.565091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:58.565098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2186 [2:7559602081305980916:2878]
2025-10-10T14:36:58.565111Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:58.565130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:58.565133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.565137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.565139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.565156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:58.565165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:58.565173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:58.565231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.565239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.565242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.565244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:58.565306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:58.565309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.565319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.565350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.565373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:58.565400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211613:3615], now have 1 active actors on pipe
2025-10-10T14:36:58.565404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211371:2438], now have 1 active actors on pipe
2025-10-10T14:36:58.565412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602081305980910:2878]
2025-10-10T14:36:58.565415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602081305980910:2878]
2025-10-10T14:36:58.565417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602081305980910:2878]
2025-10-10T14:36:58.565430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:58.565468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2186
2025-10-10T14:36:58.565471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2186
2025-10-10T14:36:58.565443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:58.565444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:58.565448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:58.565450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:58.565460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:58.565464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:58.565487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602081305980910:2878]
2025-10-10T14:36:58.565490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:58.565494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:58.565523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.565527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.565567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfda5820-da43b599-591a183-db0d5ffe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:58.565575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.565579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.565581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:58.565591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.565602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:58.565619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.565805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.565820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.565846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.566015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2187 partition: 0 MaxSeqNo: 40 sessionId: src_id|cfda5820-da43b599-591a183-db0d5ffe_0
2025-10-10T14:36:58.566416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d17315-9683c726-4fd1150a-cfd02af3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cfda5820-da43b599-591a183-db0d5ffe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:58.569151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda5820-da43b599-591a183-db0d5ffe_0] Write session: try to update token
2025-10-10T14:36:58.569171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda5820-da43b599-591a183-db0d5ffe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:58.583363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId: src_id|cfda5820-da43b599-591a183-db0d5ffe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:58.584920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:58.584944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:58.584947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:58.584951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:58.584960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602081305980910:2878]
2025-10-10T14:36:58.584966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602081305980910:2878]
2025-10-10T14:36:58.584970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602081305980910:2878]
2025-10-10T14:36:58.585021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:58.585022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:58.585031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:58.585035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:58.585036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.585039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:58.585193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:58.586305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:58.635477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602082088211647:2605]
2025-10-10T14:36:58.635972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2186, pipe: [1:7559602082088211647:2605]
2025-10-10T14:36:58.704593Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:58.705302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.705318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.705403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211647:2605], now have 1 active actors on pipe
2025-10-10T14:36:58.705742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:58.705832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2187 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfda5820-da43b599-591a183-db0d5ffe_0
2025-10-10T14:36:58.705867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:58.706000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602082088211647:2605]
2025-10-10T14:36:58.706054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2187 sessionId: src_id|cfda5820-da43b599-591a183-db0d5ffe_0 is DEAD
2025-10-10T14:36:58.705628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:58.708328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda5820-da43b599-591a183-db0d5ffe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:58.708342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda5820-da43b599-591a183-db0d5ffe_0] Write session will restart in 0.007404s
2025-10-10T14:36:58.708370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda5820-da43b599-591a183-db0d5ffe_0] Write session: Do CDS request
2025-10-10T14:36:58.708377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda5820-da43b599-591a183-db0d5ffe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:58.716987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda5820-da43b599-591a183-db0d5ffe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.717061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:58.717095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2188
2025-10-10T14:36:58.717259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.717320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:58.717346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:58.717350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:58.717872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2188 sessionId:  describe result for acl check
2025-10-10T14:36:58.717913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:58.717915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:58.717917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:58.717923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602082088211666:3639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:58.718506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602082088211666:3639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:58.722842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602082088211666:3639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:58.726914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602082088211666:3639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:58.726937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602082088211666:3639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:58.726941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602082088211666:3639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:58.726951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:58.733051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:58.736660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:58.736922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:58.736934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:58.736947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:58.737013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:58.737059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602081305981191:2875]
2025-10-10T14:36:58.737746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:58.738100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:58.738147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:58.738478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:58.738543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.738550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.738551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.738553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.738555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.738556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.738558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.738560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.738561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.738562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.738564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.738565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.738567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.738573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.738586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.738596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.738601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.738605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.738610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.738615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.738619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.738623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.738628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.738632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.738637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.738640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.738649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.738658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.738665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.738672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.738677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.738683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.738695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.738700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.738708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.738713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.738718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.738724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.738729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.738735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.738739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.738745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.738750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.738756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.738760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.738765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.738771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.738776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.738783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.738793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.738798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.738808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.738851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:58.741683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:58.742042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:58.742055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:58.742057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:58.742061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:58.742068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2187 [2:7559602081305981191:2875]
2025-10-10T14:36:58.742081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:58.742098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:58.742102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.742105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.742108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.742126Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:58.742133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:58.742142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:58.742203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.742206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.742208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.742211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:58.742286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:58.742290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.742302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.742316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.742334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:58.742354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602081305981186:2875]
2025-10-10T14:36:58.742357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602081305981186:2875]
2025-10-10T14:36:58.742360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602081305981186:2875]
2025-10-10T14:36:58.742369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:58.742385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:58.742389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:58.742393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:58.742395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:58.742402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:58.742406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:58.742418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211799:3639], now have 1 active actors on pipe
2025-10-10T14:36:58.742422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211651:2438], now have 1 active actors on pipe
2025-10-10T14:36:58.742446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602081305981186:2875]
2025-10-10T14:36:58.742455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:58.742479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:58.742715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.742730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.742765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:58.742779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.742790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.742793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:58.742806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.742834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:58.742856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.742529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2187
2025-10-10T14:36:58.742530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2187
2025-10-10T14:36:58.743039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.743046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.743068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.743170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2188 partition: 0 MaxSeqNo: 40 sessionId: src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0
2025-10-10T14:36:58.743674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfda5820-da43b599-591a183-db0d5ffe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:58.746587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0] Write session: try to update token
2025-10-10T14:36:58.746606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:58.761965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId: src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:58.764674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:58.764731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:58.764751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:58.764754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:58.764756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:58.764766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602081305981186:2875]
2025-10-10T14:36:58.764770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602081305981186:2875]
2025-10-10T14:36:58.764775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602081305981186:2875]
2025-10-10T14:36:58.764826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:58.764839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.764848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:58.764850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.764853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:58.764871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:58.764884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.764887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:58.765019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:58.805961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602082088211937:2605]
2025-10-10T14:36:58.806334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2187, pipe: [1:7559602082088211937:2605]
2025-10-10T14:36:58.891869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:58.892710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211937:2605], now have 1 active actors on pipe
2025-10-10T14:36:58.893290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:58.892995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:58.893396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602082088211937:2605]
2025-10-10T14:36:58.893436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:58.893511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0
2025-10-10T14:36:58.893722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2188 sessionId: src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0 is DEAD
2025-10-10T14:36:58.893881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:58.893895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0] Write session will restart in 0.007380s
2025-10-10T14:36:58.893922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0] Write session: Do CDS request
2025-10-10T14:36:58.893929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:58.902939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.903052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:58.903071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2189
2025-10-10T14:36:58.903230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:58.903282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:58.903293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:58.903298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:58.903805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2189 sessionId:  describe result for acl check
2025-10-10T14:36:58.903850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:58.903857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:58.903859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:58.903866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602082088211968:3646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:58.904455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602082088211968:3646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:58.907448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602082088211968:3646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:58.911946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602082088211968:3646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:58.911963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602082088211968:3646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:58.911967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602082088211968:3646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:58.911976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:58.916466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:58.919478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:58.919742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:58.919754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:58.919768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:58.919835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:58.919885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602081305981466:2869]
2025-10-10T14:36:58.920569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:58.920870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:58.920917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:58.921274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:58.921351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.921359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.921360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.921361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.921363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.921365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.921366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.921368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.921369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.921371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.921373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.921374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.921375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.921382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.921397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.921402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.921408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.921412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.921417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.921422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.921437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.921441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.921452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.921456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.921461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.921465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.921474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.921487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:58.921495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.921501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:58.921507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.921513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:58.921518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.921524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:58.921530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.921536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:58.921540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.921546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:58.921551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.921557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:58.921562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.921568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:58.921574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.921581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:58.921587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.921593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:58.921598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.921604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.921609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.921616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.921621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.921627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.921675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:58.924264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:58.924935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:58.924952Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:58.924954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:58.924960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:58.924967Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2188 [2:7559602081305981466:2869]
2025-10-10T14:36:58.924983Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:58.925008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:58.925018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.925022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.925025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.925043Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:58.925061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:58.925071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:58.925139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.925147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.925149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.925152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:58.925227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:58.925235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.925248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:58.925266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:58.925291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:58.925320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088211940:2438], now have 1 active actors on pipe
2025-10-10T14:36:58.925344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088212143:3646], now have 1 active actors on pipe
2025-10-10T14:36:58.925353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602081305981461:2869]
2025-10-10T14:36:58.925361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602081305981461:2869]
2025-10-10T14:36:58.925363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602081305981461:2869]
2025-10-10T14:36:58.925379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:58.925393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:58.925400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:58.925403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:58.925405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:58.925417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:58.925421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:58.925420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2188
2025-10-10T14:36:58.925453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602081305981461:2869]
2025-10-10T14:36:58.925462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:58.925464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:58.925472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2188
2025-10-10T14:36:58.925589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.925600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.925631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:58.925643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:58.925648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:58.925656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:58.925668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:58.925683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:58.925704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.925881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.925896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.925921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:58.926022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2189 partition: 0 MaxSeqNo: 40 sessionId: src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0
2025-10-10T14:36:58.926438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70d3fa55-e53dafd2-90022de3-10083d1f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:58.929235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0] Write session: try to update token
2025-10-10T14:36:58.929255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:58.944623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:58.944647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:58.944659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602081305981461:2869]
2025-10-10T14:36:58.944720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:58.944725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:58.944916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:58.945074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:58.945224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:58.945401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:58.945610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:58.945661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:58.947452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId: src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:58.950397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:58.951420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:58.951447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:58.951492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:58.951665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:58.959286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:58.959309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:58.959313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:58.959315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:58.959326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602081305981461:2869]
2025-10-10T14:36:58.959330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602081305981461:2869]
2025-10-10T14:36:58.959339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602081305981461:2869]
2025-10-10T14:36:58.959392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:58.959403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:58.959405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:58.959408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:58.959411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:58.959416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:58.959550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:58.993385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602082088212218:2605]
2025-10-10T14:36:58.993790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2188, pipe: [1:7559602082088212218:2605]
2025-10-10T14:36:59.078301Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:59.087668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.087699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.087903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.087975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.088049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.088120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.088692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.088707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.088781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.088843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.088909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.088980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.089025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.089032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.089101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.089165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.089231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.089294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.089396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.089406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.089474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.089541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.089610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.089677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.089722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.089733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.089802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.089864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.089933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.090000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.090066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.090077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.090145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.090206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.090270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.090336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.090384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.090392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.090458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.090522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.090586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.090649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.090694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.090702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.090772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.090836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.090899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.090977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.091038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.091045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.091111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.091172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.091239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.091305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.091352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.091360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.091443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.091507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.091574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.091639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.091689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.091697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.091757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602082088212218:2605], now have 1 active actors on pipe
2025-10-10T14:36:59.091963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:59.091970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602082088212218:2605]
2025-10-10T14:36:59.092014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:59.092027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:59.092073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2189 reason: error at write: Disconnected sessionId: src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0
2025-10-10T14:36:59.092306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2189 sessionId: src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0 is DEAD
2025-10-10T14:36:59.092418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:59.092428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0] Write session will restart in 0.006492s
2025-10-10T14:36:59.092455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0] Write session: Do CDS request
2025-10-10T14:36:59.092462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:59.092397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:59.099973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.100059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:59.100080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2190
2025-10-10T14:36:59.100208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.100244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:59.100254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:59.100257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:59.100729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2190 sessionId:  describe result for acl check
2025-10-10T14:36:59.100771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:59.100778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:59.100781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:59.100786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602086383179544:3655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:59.101377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602086383179544:3655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:59.105539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602086383179544:3655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:59.109797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602086383179544:3655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:59.109814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602086383179544:3655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:59.109818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602086383179544:3655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:59.109829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:59.118068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:59.121362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:59.121602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:59.121613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:59.121626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:59.121688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:59.121737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602085600949052:2862]
2025-10-10T14:36:59.122395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:59.122743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:59.122807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:59.123217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:59.123294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.123302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.123304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.123305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.123306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.123307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.123308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.123310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.123311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.123312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.123313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.123314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.123315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.123322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.123335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.123339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.123343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.123347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.123351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.123354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.123358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.123361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.123368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.123371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.123374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.123377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.123387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.123396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.123403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.123409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.123416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.123421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.123425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.123430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.123434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.123439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.123444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.123449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.123454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.123458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.123463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.123469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.123474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.123479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.123498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.123504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.123508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.123513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.123517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.123522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.123540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.123545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.123586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:59.126314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:59.127080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:59.127094Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:59.127096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:59.127100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:59.127106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2189 [2:7559602085600949052:2862]
2025-10-10T14:36:59.127120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:59.127141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:59.127150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.127153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.127156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.127172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:59.127180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:59.127190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:59.127251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.127258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.127260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.127264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:59.127346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:59.127355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.127369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.127380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.127395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:59.127419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383179650:3655], now have 1 active actors on pipe
2025-10-10T14:36:59.127431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383179517:2438], now have 1 active actors on pipe
2025-10-10T14:36:59.127438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602085600949047:2862]
2025-10-10T14:36:59.127440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602085600949047:2862]
2025-10-10T14:36:59.127443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602085600949047:2862]
2025-10-10T14:36:59.127457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:59.127472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:59.127487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:59.127490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:59.127521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602085600949047:2862]
2025-10-10T14:36:59.127529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:59.127539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:59.127543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:59.127546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:59.127554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:59.127586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.127596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.127625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de234462-24c9f555-77327956-dc8bc97f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:59.127638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.127644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.127651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:59.127664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.127676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:59.127693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.127925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.127937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.127956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.128495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5537b274-fa790b76-37c1ad83-eae78ea2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|de234462-24c9f555-77327956-dc8bc97f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:59.127509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2189
2025-10-10T14:36:59.127512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2189
2025-10-10T14:36:59.128039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2190 partition: 0 MaxSeqNo: 40 sessionId: src_id|de234462-24c9f555-77327956-dc8bc97f_0
2025-10-10T14:36:59.131424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de234462-24c9f555-77327956-dc8bc97f_0] Write session: try to update token
2025-10-10T14:36:59.131449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de234462-24c9f555-77327956-dc8bc97f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:59.139953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:36:59.139974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:59.139987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602085600949047:2862]
2025-10-10T14:36:59.140042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:36:59.140047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:36:59.140237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:36:59.140407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:59.140556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:59.140708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:36:59.140907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:36:59.140957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:36:59.150595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId: src_id|de234462-24c9f555-77327956-dc8bc97f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:59.153608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:59.153892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.153916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.153971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:36:59.154101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:59.159862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:59.159899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:59.159902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:59.159905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:59.159918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602085600949047:2862]
2025-10-10T14:36:59.159922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602085600949047:2862]
2025-10-10T14:36:59.159926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602085600949047:2862]
2025-10-10T14:36:59.159981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:59.159982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:59.159988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:59.159995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.159996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:59.159998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:59.160155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:59.192025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602086383179809:2605]
2025-10-10T14:36:59.192369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2189, pipe: [1:7559602086383179809:2605]
2025-10-10T14:36:59.280423Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:59.289540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.289574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.289765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.289833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.289904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.289973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.290022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.290039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.290117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.290194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.290267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.290342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.290394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.290402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.290475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.290544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.290610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.290677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.290723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.290726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.290796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.290867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.290939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.291008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.291054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.291062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.291134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.291203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.291270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.291342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.291389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.291402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.291474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.291540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.291608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.291679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.291726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.291734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.291804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.291869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.291959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.292028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.292083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.292090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.292165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.292235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.292306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.292377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.292423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.292430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.292504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.292569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.292634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.292703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.292757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.292766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.292836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:36:59.292904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:36:59.292971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:36:59.293042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:36:59.293091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:36:59.293098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:36:59.293169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383179809:2605], now have 1 active actors on pipe
2025-10-10T14:36:59.293405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:59.293421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602086383179809:2605]
2025-10-10T14:36:59.293423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:59.293441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:59.293467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2190 reason: error at write: Disconnected sessionId: src_id|de234462-24c9f555-77327956-dc8bc97f_0
2025-10-10T14:36:59.293684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2190 sessionId: src_id|de234462-24c9f555-77327956-dc8bc97f_0 is DEAD
2025-10-10T14:36:59.293839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de234462-24c9f555-77327956-dc8bc97f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:59.293848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de234462-24c9f555-77327956-dc8bc97f_0] Write session will restart in 0.006450s
2025-10-10T14:36:59.293882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de234462-24c9f555-77327956-dc8bc97f_0] Write session: Do CDS request
2025-10-10T14:36:59.293888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de234462-24c9f555-77327956-dc8bc97f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:59.294482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:59.301887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de234462-24c9f555-77327956-dc8bc97f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.302075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:59.302093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2191
2025-10-10T14:36:59.302259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.302322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:59.302334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:59.302341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:59.302859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2191 sessionId:  describe result for acl check
2025-10-10T14:36:59.302900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:59.302911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:59.302913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:59.302920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602086383179832:3661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:59.303525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602086383179832:3661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:59.307645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602086383179832:3661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:59.311579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602086383179832:3661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:59.311597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602086383179832:3661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:59.311600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602086383179832:3661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:59.311610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:59.315728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:59.319184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:59.319421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:59.319433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:59.319445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:59.319498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:59.319543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602085600949329:2857]
2025-10-10T14:36:59.320249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:59.320603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:59.320649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:59.320999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:59.321069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.321076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.321077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.321079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.321080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.321081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.321083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.321084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.321085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.321086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.321088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.321089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.321091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.321096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.321111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.321120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.321125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.321134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.321139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.321143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.321152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.321161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.321166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.321170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.321179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.321183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.321191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.321204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.321215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.321225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.321234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.321244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.321249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.321255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.321260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.321266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.321276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.321286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.321291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.321297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.321306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.321311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.321325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.321342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.321347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.321355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.321362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.321368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.321373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.321378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.321383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.321389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.321431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:59.324201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:59.324725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:59.324742Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:59.324745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:59.324750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:59.324756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2190 [2:7559602085600949329:2857]
2025-10-10T14:36:59.324770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:59.324788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:59.324796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.324800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.324803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.324820Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:59.324833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:59.324840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:59.324900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.324910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.324912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.324916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:59.324986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:59.324994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.325007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.325020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.325040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:59.325067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180011:3661], now have 1 active actors on pipe
2025-10-10T14:36:59.325076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383179811:2438], now have 1 active actors on pipe
2025-10-10T14:36:59.325084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602085600949324:2857]
2025-10-10T14:36:59.325087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602085600949324:2857]
2025-10-10T14:36:59.325090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602085600949324:2857]
2025-10-10T14:36:59.325106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:59.325120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:59.325145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:59.325148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:59.325169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2190
2025-10-10T14:36:59.325216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2190
2025-10-10T14:36:59.325175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602085600949324:2857]
2025-10-10T14:36:59.325183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:59.325194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:59.325199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:59.325201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:59.325208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:59.325358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.325373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.325408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:59.325418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.325422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.325425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:59.325437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.325457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:59.325481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.325637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.325647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.325663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.325812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2191 partition: 0 MaxSeqNo: 40 sessionId: src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0
2025-10-10T14:36:59.326275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de234462-24c9f555-77327956-dc8bc97f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:59.329190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0] Write session: try to update token
2025-10-10T14:36:59.329218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:59.344346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId: src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:59.345271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:59.345292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:59.345296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:59.345298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:59.345307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602085600949324:2857]
2025-10-10T14:36:59.345313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602085600949324:2857]
2025-10-10T14:36:59.345316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602085600949324:2857]
2025-10-10T14:36:59.345391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:59.345394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:59.345403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.345405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:59.345407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:59.345412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:59.345531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:59.347054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:59.393733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602086383180092:2605]
2025-10-10T14:36:59.394005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2190, pipe: [1:7559602086383180092:2605]
2025-10-10T14:36:59.460288Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:59.460699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.460718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.460763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180092:2605], now have 1 active actors on pipe
2025-10-10T14:36:59.460897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:59.460958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602086383180092:2605]
2025-10-10T14:36:59.460959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:59.460983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:59.460992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:59.461051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2191 reason: error at write: Disconnected sessionId: src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0
2025-10-10T14:36:59.461267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2191 sessionId: src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0 is DEAD
2025-10-10T14:36:59.461416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:59.461428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0] Write session will restart in 0.009823s
2025-10-10T14:36:59.461461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0] Write session: Do CDS request
2025-10-10T14:36:59.461471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:59.472980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.473081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:59.473101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2192
2025-10-10T14:36:59.473645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.473689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:59.473701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:59.473704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:59.474244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2192 sessionId:  describe result for acl check
2025-10-10T14:36:59.474287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:59.474289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:59.474291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:59.474299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602086383180208:3691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:59.474871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602086383180208:3691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:59.477815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602086383180208:3691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:59.481110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602086383180208:3691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:59.481127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602086383180208:3691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:59.481131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602086383180208:3691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:59.481140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:59.482147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:59.485174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:59.485521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:59.485532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:59.485547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:59.485613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:59.485649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602085600949645:2833]
2025-10-10T14:36:59.486070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:59.486426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:59.486481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:59.486776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:59.486828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.486831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.486832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.486833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.486834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.486835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.486835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.486836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.486837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.486837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.486838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.486839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.486840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.486844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.486857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.486861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.486865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.486868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.486871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.486875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.486889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.486892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.486897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.486901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.486905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.486909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.486919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.486926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.486932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.486935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.486938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.486942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.486944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.486948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.486951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.486954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.486956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.486959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.486975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.486984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.486989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.486994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.486999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.487005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.487022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.487027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.487031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.487037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.487043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.487046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.487049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.487052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.487076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:59.489655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:59.490402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:59.490415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:59.490418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:59.490422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:59.490430Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2191 [2:7559602085600949645:2833]
2025-10-10T14:36:59.490443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:59.490462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:59.490477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.490481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.490484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.490503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:59.490511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:59.490519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:59.490580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.490587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.490589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.490592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:59.490666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:59.490673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.490686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.490703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.490725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:59.490752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180385:3691], now have 1 active actors on pipe
2025-10-10T14:36:59.490760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180119:2438], now have 1 active actors on pipe
2025-10-10T14:36:59.490769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602085600949640:2833]
2025-10-10T14:36:59.490775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602085600949640:2833]
2025-10-10T14:36:59.490777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602085600949640:2833]
2025-10-10T14:36:59.490791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:59.490803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:59.490806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:59.490808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:59.490810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:59.490827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:59.490830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:59.490859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602085600949640:2833]
2025-10-10T14:36:59.490870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:59.490877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:59.490844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2191
2025-10-10T14:36:59.490895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.490904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.490958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:59.490971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.490979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.490982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:59.490994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.490992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2191
2025-10-10T14:36:59.491009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:59.491030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.491217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.491225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.491243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.491363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2192 partition: 0 MaxSeqNo: 40 sessionId: src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0
2025-10-10T14:36:59.491829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ab7ad38-273a9104-926d0d61-1a290f22_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:59.494707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0] Write session: try to update token
2025-10-10T14:36:59.494728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:59.509203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId: src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:59.510974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:59.510996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:59.511000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:59.511002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:59.511011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602085600949640:2833]
2025-10-10T14:36:59.511016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602085600949640:2833]
2025-10-10T14:36:59.511020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602085600949640:2833]
2025-10-10T14:36:59.511070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:59.511079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.511081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:59.511083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:59.511089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:59.511093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:59.511226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:59.512609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:59.561183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602086383180399:2605]
2025-10-10T14:36:59.561540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2191, pipe: [1:7559602086383180399:2605]
2025-10-10T14:36:59.630993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:59.631584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.631606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.631677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180399:2605], now have 1 active actors on pipe
2025-10-10T14:36:59.631930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:59.631930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602086383180399:2605]
2025-10-10T14:36:59.631940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:59.631944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:59.631977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:59.632025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2192 reason: error at write: Disconnected sessionId: src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0
2025-10-10T14:36:59.632259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2192 sessionId: src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0 is DEAD
2025-10-10T14:36:59.632433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:59.632445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0] Write session will restart in 0.009792s
2025-10-10T14:36:59.632473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0] Write session: Do CDS request
2025-10-10T14:36:59.632479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:59.643954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.644029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:59.644049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2193
2025-10-10T14:36:59.644223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.644271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:59.644284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:59.644289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:59.644755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2193 sessionId:  describe result for acl check
2025-10-10T14:36:59.644796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:59.644802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:59.644804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:59.644811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602086383180430:3704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:59.645445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602086383180430:3704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:59.648601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602086383180430:3704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:59.656178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:59.660249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602086383180430:3704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:59.660271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602086383180430:3704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:59.660275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602086383180430:3704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:59.660285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:59.659715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:59.659983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:59.659989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:59.660001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:59.660053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:59.660095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602085600949923:2828]
2025-10-10T14:36:59.660781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:59.661073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:59.661124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:59.661501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:59.661556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.661562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.661563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.661565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.661566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.661567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.661569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.661570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.661571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.661573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.661574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.661575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.661576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.661582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.661596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.661601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.661605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.661610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.661615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.661619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.661624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.661628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.661633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.661638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.661643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.661647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.661655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.661669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.661681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.661689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.661700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.661711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.661716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.661727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.661733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.661739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.661744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.661750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.661755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.661761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.661765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.661776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.661781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.661791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.661795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.661802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.661807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.661813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.661818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.661830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.661839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.661846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.661899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:59.664562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:59.665044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:59.665057Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:59.665059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:59.665064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:59.665071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2192 [2:7559602085600949923:2828]
2025-10-10T14:36:59.665087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:59.665107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:59.665111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.665114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.665117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.665135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:59.665148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:59.665161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:59.665231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.665239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.665241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.665243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:59.665311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:59.665321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.665352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.665365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.665382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:59.665411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180672:3704], now have 1 active actors on pipe
2025-10-10T14:36:59.665421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180401:2438], now have 1 active actors on pipe
2025-10-10T14:36:59.665429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602085600949918:2828]
2025-10-10T14:36:59.665432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602085600949918:2828]
2025-10-10T14:36:59.665434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602085600949918:2828]
2025-10-10T14:36:59.665447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:59.665460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:59.665463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:59.665465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:59.665467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:59.665485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:59.665493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:59.665484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2192
2025-10-10T14:36:59.665489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2192
2025-10-10T14:36:59.665520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602085600949918:2828]
2025-10-10T14:36:59.665528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:59.665530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:59.665557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.665567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.665606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:59.665619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.665625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.665628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:59.665639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.665650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:59.665672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.666032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.666043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.666060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.666196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2193 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0
2025-10-10T14:36:59.666688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4b3621-f836145d-e8dbfe3d-5033151a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:59.669550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0] Write session: try to update token
2025-10-10T14:36:59.669573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:59.685846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:59.685867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:59.685871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:59.685873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:59.685884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602085600949918:2828]
2025-10-10T14:36:59.685890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602085600949918:2828]
2025-10-10T14:36:59.685895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602085600949918:2828]
2025-10-10T14:36:59.685950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:59.685949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:59.685956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:59.685959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.685961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:59.685963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:59.686105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:59.693111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId: src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:59.696404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:59.732213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602086383180688:2605]
2025-10-10T14:36:59.732500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2192, pipe: [1:7559602086383180688:2605]
2025-10-10T14:36:59.805892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:59.806818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.806837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.806880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180688:2605], now have 1 active actors on pipe
2025-10-10T14:36:59.807108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:59.807114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:36:59.807119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:36:59.807179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602086383180688:2605]
2025-10-10T14:36:59.807187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2193 reason: error at write: Disconnected sessionId: src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0
2025-10-10T14:36:59.807324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:59.807466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2193 sessionId: src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0 is DEAD
2025-10-10T14:36:59.807572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:36:59.807585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0] Write session will restart in 0.009466s
2025-10-10T14:36:59.807611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0] Write session: Do CDS request
2025-10-10T14:36:59.807620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:59.821989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.822123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:59.822148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2194
2025-10-10T14:36:59.822328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.822369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:59.822380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:59.822384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:59.823031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2194 sessionId:  describe result for acl check
2025-10-10T14:36:59.823075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:59.823082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:59.823084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:59.823090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602086383180821:3718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:59.823743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602086383180821:3718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:59.826347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602086383180821:3718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:36:59.829143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:36:59.829178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602086383180821:3718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:36:59.829192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602086383180821:3718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:36:59.829196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602086383180821:3718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:36:59.829205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:36:59.832777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:36:59.833058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:36:59.833071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:36:59.833085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:36:59.833147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:36:59.833195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602085600950204:2826]
2025-10-10T14:36:59.833873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:36:59.834195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:36:59.834240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:36:59.834566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:36:59.834626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.834632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.834633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.834634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.834635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.834636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.834638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.834639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.834640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.834642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.834643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.834644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.834645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.834652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.834665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.834669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.834673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.834676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.834680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.834683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.834687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.834690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.834695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.834699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.834704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.834708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.834715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.834724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:36:59.834730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.834736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:36:59.834742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.834753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:36:59.834757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.834767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:36:59.834773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.834778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:36:59.834787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.834793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:36:59.834798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.834803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:36:59.834809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.834814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:36:59.834818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.834822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:36:59.834826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.834831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:36:59.834835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.834841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.834846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.834851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.834856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.834866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.834899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:36:59.837553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:36:59.838364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:36:59.838380Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:36:59.838382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:36:59.838387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:36:59.838394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2193 [2:7559602085600950204:2826]
2025-10-10T14:36:59.838408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:36:59.838428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:36:59.838437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.838440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.838443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.838461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:36:59.838473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:36:59.838486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:36:59.838550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.838556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.838559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.838562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:36:59.838633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:36:59.838644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.838657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:36:59.838669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:36:59.838686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:36:59.838710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180695:2438], now have 1 active actors on pipe
2025-10-10T14:36:59.838719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180967:3718], now have 1 active actors on pipe
2025-10-10T14:36:59.838727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602085600950198:2826]
2025-10-10T14:36:59.838729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602085600950198:2826]
2025-10-10T14:36:59.838731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602085600950198:2826]
2025-10-10T14:36:59.838747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:36:59.838761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:36:59.838781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:36:59.838783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:36:59.838784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:36:59.838785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:36:59.838787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:36:59.838809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2193
2025-10-10T14:36:59.838820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602085600950198:2826]
2025-10-10T14:36:59.838832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:36:59.838856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2193
2025-10-10T14:36:59.838836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:36:59.839017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.839027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.839057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5481632-99257c51-10da1ea9-a57534e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:36:59.839071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:36:59.839080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:36:59.839083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:36:59.839095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:36:59.839111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:36:59.839131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.839379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.839394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.839420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:36:59.839544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2194 partition: 0 MaxSeqNo: 40 sessionId: src_id|e5481632-99257c51-10da1ea9-a57534e3_0
2025-10-10T14:36:59.840004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d490285-48d2d1-45ea16ff-7e804c0e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e5481632-99257c51-10da1ea9-a57534e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:36:59.843003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5481632-99257c51-10da1ea9-a57534e3_0] Write session: try to update token
2025-10-10T14:36:59.843025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5481632-99257c51-10da1ea9-a57534e3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:36:59.859806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:36:59.859832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:36:59.859835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:36:59.859837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:36:59.859847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602085600950198:2826]
2025-10-10T14:36:59.859852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602085600950198:2826]
2025-10-10T14:36:59.859858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602085600950198:2826]
2025-10-10T14:36:59.859929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:36:59.859937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:36:59.859943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:36:59.859945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:36:59.859945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:36:59.859950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:36:59.860106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:36:59.858958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId: src_id|e5481632-99257c51-10da1ea9-a57534e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:36:59.861767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:36:59.907296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602086383180980:2605]
2025-10-10T14:36:59.907669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2193, pipe: [1:7559602086383180980:2605]
2025-10-10T14:36:59.982166Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:36:59.982471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:36:59.982485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:36:59.982544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180980:2605], now have 1 active actors on pipe
2025-10-10T14:36:59.982921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:36:59.982971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:36:59.983065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2194 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e5481632-99257c51-10da1ea9-a57534e3_0
2025-10-10T14:36:59.982780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:36:59.983303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2194 sessionId: src_id|e5481632-99257c51-10da1ea9-a57534e3_0 is DEAD
2025-10-10T14:36:59.983447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602086383180980:2605]
2025-10-10T14:36:59.983607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5481632-99257c51-10da1ea9-a57534e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:36:59.983618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5481632-99257c51-10da1ea9-a57534e3_0] Write session will restart in 0.008772s
2025-10-10T14:36:59.983642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5481632-99257c51-10da1ea9-a57534e3_0] Write session: Do CDS request
2025-10-10T14:36:59.983648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5481632-99257c51-10da1ea9-a57534e3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:36:59.993970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5481632-99257c51-10da1ea9-a57534e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.994777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:36:59.994799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2195
2025-10-10T14:36:59.995038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:36:59.995080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:36:59.995088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:36:59.995092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:36:59.995626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2195 sessionId:  describe result for acl check
2025-10-10T14:36:59.995681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:36:59.995691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:36:59.995693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:36:59.995702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602086383180998:3726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:36:59.996386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602086383180998:3726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:36:59.998360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602086383180998:3726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:00.001523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602086383180998:3726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:00.001538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602086383180998:3726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:00.001542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602086383180998:3726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:00.001552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:00.022408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:00.023361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:00.023616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:00.023628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:00.023642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:00.023703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:00.023753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602089895917781:2812]
2025-10-10T14:37:00.024461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:00.026193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:00.026270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:00.026656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:00.026725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.026732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.026734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.026736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.026737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.026738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.026740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.026741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.026743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.026745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.026746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.026747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.026749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.026757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.026772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.026776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.026781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.026785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.026790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.026794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.026798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.026802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.026808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.026812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.026816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.026828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.026837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.026847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.026854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.026860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.026866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.026871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.026876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.026882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.026888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.026893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.026898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.026904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.026914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.026920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.026925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.026931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.026938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.026945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.026951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.026961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.026971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.026982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.026987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.026993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.027002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.027007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.027049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:00.030341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:00.030814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:00.030827Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:00.030830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:00.030834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:00.030841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2194 [2:7559602089895917781:2812]
2025-10-10T14:37:00.030856Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:00.030877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:00.030889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.030893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.030894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.030913Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:00.030922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:00.030931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:00.030999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.031008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.031010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.031013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:00.031089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:00.031098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.031112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.031124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.031142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:00.031171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678148322:3726], now have 1 active actors on pipe
2025-10-10T14:37:00.031178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602086383180984:2438], now have 1 active actors on pipe
2025-10-10T14:37:00.031187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602089895917775:2812]
2025-10-10T14:37:00.031190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602089895917775:2812]
2025-10-10T14:37:00.031224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602089895917775:2812]
2025-10-10T14:37:00.031244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:00.031241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2194
2025-10-10T14:37:00.031281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2194
2025-10-10T14:37:00.031261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:00.031285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:00.031289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:00.031293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:00.031297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:00.031299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:00.031326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602089895917775:2812]
2025-10-10T14:37:00.031330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:00.031332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:00.031348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.031354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.031416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:00.031425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.031430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.031433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:00.031446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.031457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:00.031477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.031709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.031720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.031737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.031848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2195 partition: 0 MaxSeqNo: 40 sessionId: src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0
2025-10-10T14:37:00.032309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5481632-99257c51-10da1ea9-a57534e3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:00.035217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0] Write session: try to update token
2025-10-10T14:37:00.035236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:00.050907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId: src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:00.053579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:00.055113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.055141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.055170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:00.055173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:00.055181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:00.055183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:00.055193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602089895917775:2812]
2025-10-10T14:37:00.055200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602089895917775:2812]
2025-10-10T14:37:00.055204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602089895917775:2812]
2025-10-10T14:37:00.055252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:00.055269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:00.055271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:00.055274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:00.055280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.055282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:00.055429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:00.085620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602090678148562:2605]
2025-10-10T14:37:00.086522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2194, pipe: [1:7559602090678148562:2605]
2025-10-10T14:37:00.132548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:37:00.132578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-10T14:37:00.171036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:00.171524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:00.171582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678148562:2605], now have 1 active actors on pipe
2025-10-10T14:37:00.171708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:00.172772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:00.172799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-10T14:37:00.172841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602090678148562:2605]
2025-10-10T14:37:00.187622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:00.187640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:00.187791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2195 reason: error at write: Disconnected sessionId: src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0
2025-10-10T14:37:00.187963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2195 sessionId: src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0 is DEAD
2025-10-10T14:37:00.188277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:00.188296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0] Write session will restart in 0.008181s
2025-10-10T14:37:00.188323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0] Write session: Do CDS request
2025-10-10T14:37:00.188333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:00.197954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:00.198124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:00.198142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2196
2025-10-10T14:37:00.198309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:00.198366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:00.198380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:00.198385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:00.199013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2196 sessionId:  describe result for acl check
2025-10-10T14:37:00.199056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:00.199066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:00.199256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:00.199273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602090678148624:3732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:00.199849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602090678148624:3732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:00.205517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602090678148624:3732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:00.209998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602090678148624:3732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:00.210031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602090678148624:3732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:00.210035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602090678148624:3732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:00.210050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:00.213326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:00.216386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:00.216662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:00.216680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:00.216693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:00.216755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:00.216820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602089895918078:2820]
2025-10-10T14:37:00.217472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:00.217863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:00.217927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:00.218330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:00.218401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.218410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.218411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.218413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.218414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.218415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.218417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.218418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.218419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.218420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.218422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.218423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.218424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.218431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.218445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.218449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.218452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.218456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.218459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.218463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.218467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.218472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.218476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.218482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.218485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.218489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.218498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.218508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.218514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.218520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.218525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.218531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.218536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.218541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.218547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.218552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.218557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.218564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.218569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.218575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.218579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.218585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.218590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.218596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.218601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.218606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.218620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.218627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.218632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.218638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.218643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.218649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.218695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:00.224146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:00.224766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:00.224793Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:00.224796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:00.224800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:00.224807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2195 [2:7559602089895918078:2820]
2025-10-10T14:37:00.224822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:00.224842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:00.224850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.224854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.224857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.224876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:00.224888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:00.224898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:00.224969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.224976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.224978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.224981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:00.225058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:00.225069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.225081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.225093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.225110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:00.225231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2195
2025-10-10T14:37:00.225139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678148815:3732], now have 1 active actors on pipe
2025-10-10T14:37:00.225236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2195
2025-10-10T14:37:00.225152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678148579:2438], now have 1 active actors on pipe
2025-10-10T14:37:00.225161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602089895918073:2820]
2025-10-10T14:37:00.225164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602089895918073:2820]
2025-10-10T14:37:00.225166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602089895918073:2820]
2025-10-10T14:37:00.225180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:00.225195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:00.225203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:00.225207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:00.225209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:00.225212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:00.225216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:00.225252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602089895918073:2820]
2025-10-10T14:37:00.225256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:00.225261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:00.225288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.225293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.225663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68513414-3b200436-6ae624d2-3e249a00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:00.225678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.225683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.225685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:00.225698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.225711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:00.225769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.225834Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:37:00.226069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.226085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.226110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.226083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 15 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:37:00.226138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:37:00.226332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2196 partition: 0 MaxSeqNo: 40 sessionId: src_id|68513414-3b200436-6ae624d2-3e249a00_0
2025-10-10T14:37:00.226758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdef81bf-f45cc87f-9746cc64-a2213d6d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|68513414-3b200436-6ae624d2-3e249a00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:00.229600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68513414-3b200436-6ae624d2-3e249a00_0] Write session: try to update token
2025-10-10T14:37:00.229620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68513414-3b200436-6ae624d2-3e249a00_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:00.247439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId: src_id|68513414-3b200436-6ae624d2-3e249a00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:00.250435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:00.250669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.250696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.250744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:00.250850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:00.258866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:00.258886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:00.258890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:00.258892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:00.258903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602089895918073:2820]
2025-10-10T14:37:00.258908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602089895918073:2820]
2025-10-10T14:37:00.258915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602089895918073:2820]
2025-10-10T14:37:00.258970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:00.258969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:00.258976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:00.258980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.258981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:00.258982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:00.259130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:00.273623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602090678148867:2605]
2025-10-10T14:37:00.273810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2195, pipe: [1:7559602090678148867:2605]
2025-10-10T14:37:00.376921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:00.377646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678148867:2605], now have 1 active actors on pipe
2025-10-10T14:37:00.386525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.386560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.386757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.386822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.386887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.386959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.387006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.387012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.387094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.387157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.387220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.387289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.387332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.387335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.387410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.387476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.387541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.387608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.388079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.388083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.388159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.388224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.388286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.388354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.388398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.388402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.388484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.388553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.388623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.388688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.388735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.388738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.388812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.388872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.388936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.389007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.389054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.389058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.389136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.389204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.389270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.389570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.389628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.389639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.389709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.389776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.389843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.389913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.389965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.389979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.390056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.390129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.390195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.390263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.390310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.390315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.390394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.390460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.390529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.390596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.390637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.390640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.391320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:00.393522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:00.393592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602090678148867:2605]
2025-10-10T14:37:00.393619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:00.393667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2196 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68513414-3b200436-6ae624d2-3e249a00_0
2025-10-10T14:37:00.393871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2196 sessionId: src_id|68513414-3b200436-6ae624d2-3e249a00_0 is DEAD
2025-10-10T14:37:00.394436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68513414-3b200436-6ae624d2-3e249a00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:00.394450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68513414-3b200436-6ae624d2-3e249a00_0] Write session will restart in 0.008443s
2025-10-10T14:37:00.394475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68513414-3b200436-6ae624d2-3e249a00_0] Write session: Do CDS request
2025-10-10T14:37:00.394489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68513414-3b200436-6ae624d2-3e249a00_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:00.403962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68513414-3b200436-6ae624d2-3e249a00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:00.404025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:00.404042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2197
2025-10-10T14:37:00.404288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:00.404349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:00.404361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:00.404365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:00.405068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2197 sessionId:  describe result for acl check
2025-10-10T14:37:00.405111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:00.405115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:00.405118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:00.405124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602090678148897:3733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:00.405731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602090678148897:3733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:00.409425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602090678148897:3733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:00.413656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602090678148897:3733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:00.413677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602090678148897:3733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:00.413681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602090678148897:3733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:00.413690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:00.434135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:00.437911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:00.438208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:00.438221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:00.438235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:00.438298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:00.438344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602089895918363:2813]
2025-10-10T14:37:00.438946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:00.439347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:00.439401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:00.439731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:00.439806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.439812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.439814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.439815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.439817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.439818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.439819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.439820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.439821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.439822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.439823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.439825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.439826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.439833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.439846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.439850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.439866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.439870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.439873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.439877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.439880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.439884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.439888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.439891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.439895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.439899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.439907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.439916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.439922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.439927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.439931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.439937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.439941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.439947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.439951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.439956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.439962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.439968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.439981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.439985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.439989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.439994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.439999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.440004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.440008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.440013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.440020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.440024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.440029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.440033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.440037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.440042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.440079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:00.445772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:00.446245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:00.446261Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:00.446264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:00.446267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:00.446274Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2196 [2:7559602089895918363:2813]
2025-10-10T14:37:00.446289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:00.446308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:00.446320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.446323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.446326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.446345Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:00.446356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:00.446364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:00.446427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.446434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.446437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.446439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:00.446525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:00.446532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.446544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.446556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.446578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:00.446603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602089895918357:2813]
2025-10-10T14:37:00.446610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602089895918357:2813]
2025-10-10T14:37:00.446612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602089895918357:2813]
2025-10-10T14:37:00.446626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:00.446641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678148873:2438], now have 1 active actors on pipe
2025-10-10T14:37:00.446641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:00.446644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:00.446646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:00.446653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678149030:3733], now have 1 active actors on pipe
2025-10-10T14:37:00.446659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:00.446675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:00.446683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:00.446721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602089895918357:2813]
2025-10-10T14:37:00.446732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:00.446745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:00.446920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2196
2025-10-10T14:37:00.446962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2196
2025-10-10T14:37:00.447050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.447074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.447106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:00.447120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.447129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.447132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:00.447144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.447159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:00.447192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.447363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.447379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.447414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.447562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2197 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0
2025-10-10T14:37:00.447976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68513414-3b200436-6ae624d2-3e249a00_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:00.451039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0] Write session: try to update token
2025-10-10T14:37:00.451070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:00.467326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:00.467349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:00.467353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:00.467355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:00.467368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602089895918357:2813]
2025-10-10T14:37:00.467373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602089895918357:2813]
2025-10-10T14:37:00.467377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602089895918357:2813]
2025-10-10T14:37:00.467433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:00.467435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:00.467441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.467443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:00.467445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:00.467449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:00.467588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:00.471453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId: src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:00.474230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:00.495112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602090678149173:2605]
2025-10-10T14:37:00.495562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2196, pipe: [1:7559602090678149173:2605]
2025-10-10T14:37:00.597130Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:00.597659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.597675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.597723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678149173:2605], now have 1 active actors on pipe
2025-10-10T14:37:00.598053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:00.601433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:00.598576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602090678149173:2605]
2025-10-10T14:37:00.598606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:00.598636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:00.598706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2197 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0
2025-10-10T14:37:00.598906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2197 sessionId: src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0 is DEAD
2025-10-10T14:37:00.601449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0] Write session will restart in 0.007799s
2025-10-10T14:37:00.601549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0] Write session: Do CDS request
2025-10-10T14:37:00.601557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:00.613947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:00.614058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:00.614077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2198
2025-10-10T14:37:00.614278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:00.614323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:00.614329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:00.614334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:00.615546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2198 sessionId:  describe result for acl check
2025-10-10T14:37:00.615579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:00.615580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:00.615582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:00.615588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602090678149202:3775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:00.616141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602090678149202:3775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:00.620734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602090678149202:3775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:00.632635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602090678149202:3775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:00.632661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602090678149202:3775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:00.632665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602090678149202:3775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:00.632676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:00.657377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:00.662346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:00.662638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:00.662655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:00.662670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:00.662748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:00.662799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602089895918686:2792]
2025-10-10T14:37:00.663439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:00.663878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:00.663935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:00.664274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:00.664361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.664369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.664370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.664371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.664373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.664374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.664376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.664377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.664379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.664380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.664382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.664383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.664384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.664393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.664407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.664412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.664416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.664420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.664424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.664428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.664432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.664437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.664442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.664446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.664450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.664455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.664464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.664473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.664480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.664486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.664495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.664501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.664505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.664511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.664515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.664521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.664526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.664531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.664536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.664542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.664546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.664552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.664557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.664562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.664567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.664573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.664578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.664584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.664588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.664600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.664606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.664611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.664663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:00.667545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:00.668309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:00.668325Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:00.668328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:00.668333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:00.668341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2197 [2:7559602089895918686:2792]
2025-10-10T14:37:00.668356Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:00.668375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:00.668379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.668383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.668386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.668405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:00.668419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:00.668428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:00.668498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.668507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.668510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.668514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:00.668591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:00.668602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.668618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.668636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.668661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:00.668689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678149186:2438], now have 1 active actors on pipe
2025-10-10T14:37:00.668693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678149289:3775], now have 1 active actors on pipe
2025-10-10T14:37:00.668701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602089895918680:2792]
2025-10-10T14:37:00.668704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602089895918680:2792]
2025-10-10T14:37:00.668706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602089895918680:2792]
2025-10-10T14:37:00.668721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:00.668736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:00.668740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:00.668747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:00.668750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:00.668759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:00.668763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:00.668794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602089895918680:2792]
2025-10-10T14:37:00.668806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:00.668814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:00.668910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2197
2025-10-10T14:37:00.668960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2197
2025-10-10T14:37:00.669030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.669045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.669079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:00.669095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.669099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.669102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:00.669116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.669130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:00.669147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.669384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.669396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.669418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.669772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2198 partition: 0 MaxSeqNo: 40 sessionId: src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0
2025-10-10T14:37:00.670240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b847967-c6a238b8-2f6ed8e1-1828a117_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:00.673054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0] Write session: try to update token
2025-10-10T14:37:00.673073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:00.689305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:00.689380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:00.689392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602089895918680:2792]
2025-10-10T14:37:00.690357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId: src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:00.689452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:00.689460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:00.689656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:00.689831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:00.689978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:00.690113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:00.690312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:00.690351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:00.693468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:00.693703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.693727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.693780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:00.693873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:00.698833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602090678149474:2605]
2025-10-10T14:37:00.699118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678149474:2605], now have 1 active actors on pipe
2025-10-10T14:37:00.699146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2197, pipe: [1:7559602090678149474:2605]
2025-10-10T14:37:00.701991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:00.702007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:00.702011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:00.702013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:00.702023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602089895918680:2792]
2025-10-10T14:37:00.702027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602089895918680:2792]
2025-10-10T14:37:00.702031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602089895918680:2792]
2025-10-10T14:37:00.702075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:00.702080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:00.702082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:00.702087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.702088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:00.702090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:00.702221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:00.819728Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:00.828304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.828333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.828519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.828584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.828655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.828730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.828773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.828779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.828852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.828908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.828970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.829037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.829087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.829090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.829165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.829230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.829296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.829456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.829505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.829513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.829580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.829646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.829715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.829777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.829824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.829833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.829901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.829958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.830016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.830075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.830115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.830118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.830185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.830244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.830301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.830363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.832130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:00.832196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:00.832204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:00.832236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2198 reason: error at write: Disconnected sessionId: src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0
2025-10-10T14:37:00.832439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2198 sessionId: src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0 is DEAD
2025-10-10T14:37:00.832732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:00.832743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0] Write session will restart in 0.008900s
2025-10-10T14:37:00.832770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0] Write session: Do CDS request
2025-10-10T14:37:00.832777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:00.830508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.830515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.830583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.830641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.830702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.830762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.830804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.830807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.830880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.830937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.830996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.831058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.831097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.831100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.831167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.831223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.831283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.831349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.831389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.831391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.831463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:00.831520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:00.831580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:00.831638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:00.831683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:00.831686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:00.833006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:00.832488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602090678149474:2605]
2025-10-10T14:37:00.842944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:00.843085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:00.843101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2199
2025-10-10T14:37:00.843262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:00.843314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:00.843320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:00.843324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:00.843866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2199 sessionId:  describe result for acl check
2025-10-10T14:37:00.843899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:00.843901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:00.843904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:00.843911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602090678149501:3773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:00.844520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602090678149501:3773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:00.848606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602090678149501:3773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:00.853810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602090678149501:3773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:00.853833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602090678149501:3773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:00.853837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602090678149501:3773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:00.853858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:00.857974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:00.861485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:00.861733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:00.861745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:00.861758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:00.861814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:00.861862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602089895918971:2787]
2025-10-10T14:37:00.862492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:00.862826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:00.862871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:00.863207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:00.863265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.863271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.863272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.863273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.863274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.863276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.863277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.863278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.863279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.863280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.863281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.863283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.863284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.863289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.863302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.863306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.863310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.863313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.863317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.863321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.863324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.863329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.863333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.863337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.863341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.863346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.863356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.863365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:00.863378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.863383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:00.863392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.863398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:00.863402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.863408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:00.863413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.863423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:00.863427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.863438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:00.863443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.863453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:00.863458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.863467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:00.863472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.863477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:00.863485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.863490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:00.863501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.863506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.863509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.863518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.863522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.863528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.863564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:00.866073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:00.866756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:00.866771Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:00.866774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:00.866777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:00.866784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2198 [2:7559602089895918971:2787]
2025-10-10T14:37:00.866797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:00.866814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:00.866817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.866821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.866823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.866840Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:00.866848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:00.866855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:00.866918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.866920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.866923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.866925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:00.866998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:00.867002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.867015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:00.867029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:00.867047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:00.867070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678149485:2438], now have 1 active actors on pipe
2025-10-10T14:37:00.867075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678149712:3773], now have 1 active actors on pipe
2025-10-10T14:37:00.867082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602089895918966:2787]
2025-10-10T14:37:00.867085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602089895918966:2787]
2025-10-10T14:37:00.867088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602089895918966:2787]
2025-10-10T14:37:00.867102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:00.867117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:00.867135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:00.867138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:00.867166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602089895918966:2787]
2025-10-10T14:37:00.867168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:00.867214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:00.867217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:00.867219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:00.867226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:00.867312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2198
2025-10-10T14:37:00.867362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2198
2025-10-10T14:37:00.867581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.867591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.867624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b31c76b9-15c44728-d425e336-b0896512_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:00.867632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:00.867637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:00.867640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:00.867652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:00.867665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:00.867680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.873429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:00.873448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:00.873490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:00.873701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2199 partition: 0 MaxSeqNo: 40 sessionId: src_id|b31c76b9-15c44728-d425e336-b0896512_0
2025-10-10T14:37:00.874150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cc40ac-982cbf39-6756411c-7c14db24_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b31c76b9-15c44728-d425e336-b0896512_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:00.877175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c76b9-15c44728-d425e336-b0896512_0] Write session: try to update token
2025-10-10T14:37:00.877199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c76b9-15c44728-d425e336-b0896512_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:00.888160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:00.888180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:00.888183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:00.888185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:00.888197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602089895918966:2787]
2025-10-10T14:37:00.888203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602089895918966:2787]
2025-10-10T14:37:00.888208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602089895918966:2787]
2025-10-10T14:37:00.888262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:00.888273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:00.888276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:00.888289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:00.888298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:00.888305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:00.888421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:00.898120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId: src_id|b31c76b9-15c44728-d425e336-b0896512_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:00.901069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:00.932861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602090678149773:2605]
2025-10-10T14:37:00.933208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2198, pipe: [1:7559602090678149773:2605]
2025-10-10T14:37:01.008549Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:01.009293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.009313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.009489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602090678149773:2605], now have 1 active actors on pipe
2025-10-10T14:37:01.011006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:01.011015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602090678149773:2605]
2025-10-10T14:37:01.011045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:01.011048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:01.011122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2199 reason: error at write: Disconnected sessionId: src_id|b31c76b9-15c44728-d425e336-b0896512_0
2025-10-10T14:37:01.011175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:01.011315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2199 sessionId: src_id|b31c76b9-15c44728-d425e336-b0896512_0 is DEAD
2025-10-10T14:37:01.011464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c76b9-15c44728-d425e336-b0896512_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:01.011473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c76b9-15c44728-d425e336-b0896512_0] Write session will restart in 0.009253s
2025-10-10T14:37:01.011502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c76b9-15c44728-d425e336-b0896512_0] Write session: Do CDS request
2025-10-10T14:37:01.011512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c76b9-15c44728-d425e336-b0896512_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:01.021944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c76b9-15c44728-d425e336-b0896512_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.025457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:01.025478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2200
2025-10-10T14:37:01.027785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.027855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:01.027863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:01.027868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:01.028327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2200 sessionId:  describe result for acl check
2025-10-10T14:37:01.028356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:01.028358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:01.028360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:01.028367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602094973117154:3785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:01.028956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602094973117154:3785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:01.036054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602094973117154:3785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:01.041633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:01.045183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:01.045214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602094973117154:3785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:01.045235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602094973117154:3785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:01.045239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602094973117154:3785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:01.045249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:01.045485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:01.045502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:01.045518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:01.045603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:01.045649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602094190886554:2785]
2025-10-10T14:37:01.046358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:01.046686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:01.046740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:01.047108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:01.047188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.047198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.047199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.047200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.047202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.047203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.047204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.047206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.047207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.047208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.047209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.047210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.047211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.047218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.047232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.047236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.047239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.047243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.047248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.047252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.047256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.047260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.047265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.047269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.047274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.047278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.047290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.047300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.047307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.047313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.047317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.047323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.047327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.047334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.047339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.047344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.047348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.047354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.047360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.047365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.047370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.047376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.047381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.047386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.047391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.047397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.047401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.047407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.047411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.047417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.047421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.047427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.047469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:01.050851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:01.051418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:01.051424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:01.051427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:01.051431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:01.051439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2199 [2:7559602094190886554:2785]
2025-10-10T14:37:01.051454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:01.051475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:01.051480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.051484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.051487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.051509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:01.051517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:01.051526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:01.051607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.051609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.051611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.051614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:01.051700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:01.051704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.051717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.051730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.051749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:01.051772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602094190886547:2785]
2025-10-10T14:37:01.051775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602094190886547:2785]
2025-10-10T14:37:01.051779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602094190886547:2785]
2025-10-10T14:37:01.051789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:01.051804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:01.051806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:01.051808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:01.051810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:01.051823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:01.051826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:01.051852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117071:2438], now have 1 active actors on pipe
2025-10-10T14:37:01.051859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117349:3785], now have 1 active actors on pipe
2025-10-10T14:37:01.051906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602094190886547:2785]
2025-10-10T14:37:01.051926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:01.052377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:01.052253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2199
2025-10-10T14:37:01.052308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2199
2025-10-10T14:37:01.054468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c76b9-15c44728-d425e336-b0896512_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f4bc5815-346e733c-1e47ee2-46770af8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:01.053200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.053217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.053255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4bc5815-346e733c-1e47ee2-46770af8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:01.053266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.057416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bc5815-346e733c-1e47ee2-46770af8_0] Write session: try to update token
2025-10-10T14:37:01.053272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.053982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2200 partition: 0 MaxSeqNo: 40 sessionId: src_id|f4bc5815-346e733c-1e47ee2-46770af8_0
2025-10-10T14:37:01.053275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:01.053289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.053306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:01.053343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.053823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.053831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.053855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.057442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bc5815-346e733c-1e47ee2-46770af8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:01.079645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId: src_id|f4bc5815-346e733c-1e47ee2-46770af8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:01.082367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:01.083596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:01.083624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:01.083628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:01.083630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:01.083639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602094190886547:2785]
2025-10-10T14:37:01.083644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602094190886547:2785]
2025-10-10T14:37:01.083649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602094190886547:2785]
2025-10-10T14:37:01.083701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:01.083709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.083711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:01.083871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:01.085399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:01.085417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:01.085421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:01.111016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602094973117373:2605]
2025-10-10T14:37:01.111305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2199, pipe: [1:7559602094973117373:2605]
2025-10-10T14:37:01.224883Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:01.225544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.225564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.225619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117373:2605], now have 1 active actors on pipe
2025-10-10T14:37:01.225905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602094973117373:2605]
2025-10-10T14:37:01.225921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:01.225961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:01.225965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:01.226047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2200 reason: error at write: Disconnected sessionId: src_id|f4bc5815-346e733c-1e47ee2-46770af8_0
2025-10-10T14:37:01.226266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2200 sessionId: src_id|f4bc5815-346e733c-1e47ee2-46770af8_0 is DEAD
2025-10-10T14:37:01.226449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bc5815-346e733c-1e47ee2-46770af8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:01.225936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:01.226462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bc5815-346e733c-1e47ee2-46770af8_0] Write session will restart in 0.007264s
2025-10-10T14:37:01.226505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bc5815-346e733c-1e47ee2-46770af8_0] Write session: Do CDS request
2025-10-10T14:37:01.226516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bc5815-346e733c-1e47ee2-46770af8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:01.234986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bc5815-346e733c-1e47ee2-46770af8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.235031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:01.235051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2201
2025-10-10T14:37:01.235263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.235316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:01.235328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:01.235333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:01.235923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2201 sessionId:  describe result for acl check
2025-10-10T14:37:01.235964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:01.235967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:01.235969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:01.235976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602094973117391:3812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:01.236561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602094973117391:3812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:01.241102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602094973117391:3812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:01.246397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602094973117391:3812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:01.246418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602094973117391:3812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:01.246422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602094973117391:3812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:01.246433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:01.262579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:01.266123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:01.266399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:01.266405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:01.266421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:01.266495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:01.266544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602094190886854:2777]
2025-10-10T14:37:01.267185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:01.267748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:01.267806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:01.268369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:01.268452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.268454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.268455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.268456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.268458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.268459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.268461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.268462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.268463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.268464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.268466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.268467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.268468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.268475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.268489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.268493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.268498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.268502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.268507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.268511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.268515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.268519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.268524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.268528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.268532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.268536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.268547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.268555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.268562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.268567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.268573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.268579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.268584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.268589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.268595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.268600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.268604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.268610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.268615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.268620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.268624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.268630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.268636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.268641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.268646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.268652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.268656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.268664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.268669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.268675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.268680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.268685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.268733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:01.272073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:01.272901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:01.272908Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:01.272910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:01.272915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:01.272922Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2200 [2:7559602094190886854:2777]
2025-10-10T14:37:01.272939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:01.272962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:01.272967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.272971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.272974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.272995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:01.273004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:01.273013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:01.273088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.273091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.273094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.273097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:01.273185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:01.273190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.273206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.273220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.273237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:01.273261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602094190886849:2777]
2025-10-10T14:37:01.273264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602094190886849:2777]
2025-10-10T14:37:01.273266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602094190886849:2777]
2025-10-10T14:37:01.273277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:01.273293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:01.273310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:01.273313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:01.273357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:01.273361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:01.273364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:01.273376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602094190886849:2777]
2025-10-10T14:37:01.273380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:01.273503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:01.274053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117547:3812], now have 1 active actors on pipe
2025-10-10T14:37:01.274065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117376:2438], now have 1 active actors on pipe
2025-10-10T14:37:01.274524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2200
2025-10-10T14:37:01.274628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.274569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2200
2025-10-10T14:37:01.274645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.274681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:01.274698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.274705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.274708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:01.274723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.274742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:01.274773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.274986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.274997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.275016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.277021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2201 partition: 0 MaxSeqNo: 40 sessionId: src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0
2025-10-10T14:37:01.281456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bc5815-346e733c-1e47ee2-46770af8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:01.284291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0] Write session: try to update token
2025-10-10T14:37:01.284314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:01.300430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId: src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:01.301697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:01.301728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:01.301732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:01.301734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:01.301744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602094190886849:2777]
2025-10-10T14:37:01.301749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602094190886849:2777]
2025-10-10T14:37:01.301753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602094190886849:2777]
2025-10-10T14:37:01.301801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:01.301809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.301813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:01.301898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:01.301917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:01.301922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:01.301963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:01.303277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:01.326034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602094973117667:2605]
2025-10-10T14:37:01.326593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2200, pipe: [1:7559602094973117667:2605]
2025-10-10T14:37:01.424352Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:01.424870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.424888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.424937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117667:2605], now have 1 active actors on pipe
2025-10-10T14:37:01.425167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:01.425203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:01.425222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:01.425306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2201 reason: error at write: Disconnected sessionId: src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0
2025-10-10T14:37:01.425530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2201 sessionId: src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0 is DEAD
2025-10-10T14:37:01.425709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:01.425701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602094973117667:2605]
2025-10-10T14:37:01.425722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0] Write session will restart in 0.006910s
2025-10-10T14:37:01.425722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:01.425761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0] Write session: Do CDS request
2025-10-10T14:37:01.425772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:01.425764Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:37:01.425897Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 22 consumer shared/user session shared/user_1_22_7118026399824385190_v1 is DEAD
2025-10-10T14:37:01.426050Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602013368713847:2599] disconnected; active server actors: 1
2025-10-10T14:37:01.426063Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602013368713847:2599] client user disconnected session shared/user_1_22_7118026399824385190_v1
2025-10-10T14:37:01.429562Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:37:01.429721Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:37:01.429726Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:37:01.429734Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.005665s
2025-10-10T14:37:01.433940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.434022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:01.434049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2202
2025-10-10T14:37:01.434223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.434270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:01.434282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:01.434285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:01.434778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2202 sessionId:  describe result for acl check
2025-10-10T14:37:01.434818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:01.434825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:01.434828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:01.434835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602094973117702:3835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:01.435441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602094973117702:3835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:01.436696Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:37:01.436892Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:37:01.436903Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 23
2025-10-10T14:37:01.437112Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 23 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:37:01.437173Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:37:01.437282Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 auth for : user
2025-10-10T14:37:01.437451Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 Handle describe topics response
2025-10-10T14:37:01.437477Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 auth is DEAD
2025-10-10T14:37:01.437492Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:37:01.437761Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:37:01.437932Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_23_10338363962526116583_v1
2025-10-10T14:37:01.438536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602094973117702:3835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:01.438598Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602094973117754:3840] connected; active server actors: 1
2025-10-10T14:37:01.438614Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602094973117754:3840] session shared/user_1_23_10338363962526116583_v1
2025-10-10T14:37:01.438624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:37:01.438636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:37:01.438642Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_23_10338363962526116583_v1" (Sender=[1:7559602094973117735:3840], Pipe=[1:7559602094973117754:3840], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:37:01.438646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:37:01.438658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:37:01.438666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_23_10338363962526116583_v1" (Sender=[1:7559602094973117735:3840], Pipe=[1:7559602094973117754:3840], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:37:01.438677Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_23_10338363962526116583_v1" sender [1:7559602094973117735:3840] lock partition 0 for ReadingSession "shared/user_1_23_10338363962526116583_v1" (Sender=[1:7559602094973117735:3840], Pipe=[1:7559602094973117754:3840], Partitions=[], ActiveFamilyCount=1) generation 1 step 23
2025-10-10T14:37:01.438692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:37:01.438697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-10T14:37:01.438974Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 23 Session: "shared/user_1_23_10338363962526116583_v1" ClientId: "user" PipeClient { RawX1: 7559602094973117754 RawX2: 4503603922341632 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:37:01.438998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:37:01.443187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602094973117702:3835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:01.443205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602094973117702:3835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:01.443209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602094973117702:3835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:01.443218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:01.449319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:01.452002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:01.452215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:01.452226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:01.452238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:01.452290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:01.452340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602094190887145:2772]
2025-10-10T14:37:01.452993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:01.453259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:01.453301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:01.453625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:01.453682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.453689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.453690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.453692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.453693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.453695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.453696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.453697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.453698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.453700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.453701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.453702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.453703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.453709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.453722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.453727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.453731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.453736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.453740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.453744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.453748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.453753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.453757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.453761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.453765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.453769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.453778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.453791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.453802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.453812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.453822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.453829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.453839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.453844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.453849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.453855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.453859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.453865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.453874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.453879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.453883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.453893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.453898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.453904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.453913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.453918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.453923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.453929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.453935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.453940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.453944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.453952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.453992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:01.456600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:01.456932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:01.456944Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:01.456947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:01.456951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:01.456958Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2201 [2:7559602094190887145:2772]
2025-10-10T14:37:01.456972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:01.456991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:01.456999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.457003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.457006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.457023Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:01.457033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:01.457046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:01.457103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.457110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.457112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.457115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:01.457185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:01.457194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.457206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.457221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.457244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:01.457270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117780:3836], now have 1 active actors on pipe
2025-10-10T14:37:01.457278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117682:2438], now have 1 active actors on pipe
2025-10-10T14:37:01.457282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973117859:3835], now have 1 active actors on pipe
2025-10-10T14:37:01.457289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602094190887140:2772]
2025-10-10T14:37:01.457296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602094190887140:2772]
2025-10-10T14:37:01.457298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602094190887140:2772]
2025-10-10T14:37:01.457312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:01.457349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:01.457358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:01.457363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:01.457367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:01.457370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:01.457373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:01.457392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602094190887140:2772]
2025-10-10T14:37:01.457400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:01.457373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2201
2025-10-10T14:37:01.457386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2201, pipe: [1:7559602094973117780:3836]
2025-10-10T14:37:01.457417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2201
2025-10-10T14:37:01.457408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:01.457583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.457596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.457610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_23_10338363962526116583_v1 on pipe: [1:7559602094973117780:3836]
2025-10-10T14:37:01.457644Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_23_10338363962526116583_v1:1 with generation 2201
2025-10-10T14:37:01.457823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.457832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.457847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.457853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.457855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:01.457880Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_23_10338363962526116583_v1
2025-10-10T14:37:01.457882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.457921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:01.457933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:37:01.457937Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:37:01.462290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:37:01.462338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:37:01.462348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.462354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.462362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:01.462376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.462390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:01.462403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:37:01.462418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:37:01.462439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.462593Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107021457 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:37:01.462618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:37:01.462644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.462663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.462691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.462673Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 sending to client partition status
2025-10-10T14:37:01.462915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2202 partition: 0 MaxSeqNo: 40 sessionId: src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0
2025-10-10T14:37:01.463193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5c3bc73-f0a95db0-eed3e95c-c5e62d15_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:01.466084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Write session: try to update token
2025-10-10T14:37:01.466106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:01.477599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:01.477622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:01.477626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:01.477628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:01.477639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602094190887140:2772]
2025-10-10T14:37:01.477645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602094190887140:2772]
2025-10-10T14:37:01.477650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602094190887140:2772]
2025-10-10T14:37:01.477700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:01.477708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:01.477709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:01.477713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:01.477718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.477722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:01.477892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:01.494655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId: src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:01.497309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:01.595028Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:01.595325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.595342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.595696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:01.595768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:01.595776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:01.595882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2202 reason: error at write: Disconnected sessionId: src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0
2025-10-10T14:37:01.595918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_23_10338363962526116583_v1
2025-10-10T14:37:01.595938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:01.595965Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_23_10338363962526116583_v1
2025-10-10T14:37:01.596114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2202 sessionId: src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0 is DEAD
2025-10-10T14:37:01.596320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602094973117780:3836]
2025-10-10T14:37:01.597407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 134 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:37:01.597448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:01.597454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Write session will restart in 0.006811s
2025-10-10T14:37:01.597481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Write session: Do CDS request
2025-10-10T14:37:01.597487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:01.607198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.607297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:01.607316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2203
2025-10-10T14:37:01.607468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.607499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:01.607504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:01.607509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:01.607987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2203 sessionId:  describe result for acl check
2025-10-10T14:37:01.608015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:01.608017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:01.608019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:01.608024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602094973118024:3852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:01.608642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602094973118024:3852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:01.611444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602094973118024:3852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:01.615285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602094973118024:3852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:01.615304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602094973118024:3852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:01.615308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602094973118024:3852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:01.615317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:01.627089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:01.631073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:01.631381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:01.631393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:01.631408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:01.631482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:01.631536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602094190887474:2759]
2025-10-10T14:37:01.632293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:01.632727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:01.632800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:01.633197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:01.633271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.633272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.633274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.633275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.633276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.633278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.633280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.633281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.633284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.633285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.633287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.633289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.633290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.633298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.633314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.633319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.633323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.633347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.633352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.633357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.633361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.633366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.633371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.633376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.633380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.633385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.633393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.633404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.633412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.633418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.633424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.633430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.633434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.633443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.633449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.633454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.633459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.633465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.633470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.633475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.633480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.633487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.633493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.633500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.633505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.633511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.633520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.633526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.633532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.633538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.633544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.633551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.633599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:01.636736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:01.637498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:01.637511Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:01.637513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:01.637518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:01.637526Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2202 [2:7559602094190887474:2759]
2025-10-10T14:37:01.637542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:01.637562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:01.637566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.637570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.637572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.637591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:01.637604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:01.637612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:01.637684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.637691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.637694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.637696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:01.637767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:01.637776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.637789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.637802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.637826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:01.637853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973118127:3852], now have 1 active actors on pipe
2025-10-10T14:37:01.637866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602094190887469:2759]
2025-10-10T14:37:01.637870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602094190887469:2759]
2025-10-10T14:37:01.637872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602094190887469:2759]
2025-10-10T14:37:01.637882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:01.637891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:01.637894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:01.637897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:01.637902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:01.637920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:01.637923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:01.637937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973118008:2438], now have 1 active actors on pipe
2025-10-10T14:37:01.637973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602094190887469:2759]
2025-10-10T14:37:01.637987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:01.637974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2202
2025-10-10T14:37:01.638012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:01.638018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2202
2025-10-10T14:37:01.638106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.638117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.638153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:01.638166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.638174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.638177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:01.638192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.638211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:01.638226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.638427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.638438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.638454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.638648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2203 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0
2025-10-10T14:37:01.639106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d37e5d54-3b83a4dc-e49a8052-4ddf6fd2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:01.642750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0] Write session: try to update token
2025-10-10T14:37:01.642774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:01.659661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:01.659686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:01.659689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:01.659691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:01.659702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602094190887469:2759]
2025-10-10T14:37:01.659707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602094190887469:2759]
2025-10-10T14:37:01.659711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602094190887469:2759]
2025-10-10T14:37:01.659766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:01.659770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:01.659779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.659782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:01.659793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:01.659809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:01.659954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:01.661048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId: src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:01.663952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:01.696731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602094973118298:3836]
2025-10-10T14:37:01.697212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2202, pipe: [1:7559602094973118298:3836]
2025-10-10T14:37:01.778531Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:01.779247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.779267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.779323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973118298:3836], now have 1 active actors on pipe
2025-10-10T14:37:01.779528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:01.780498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:01.780521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0] Write session will restart in 0.008334s
2025-10-10T14:37:01.779948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:01.780020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602094973118298:3836]
2025-10-10T14:37:01.780057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:01.780146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2203 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0
2025-10-10T14:37:01.780546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0] Write session: Do CDS request
2025-10-10T14:37:01.780554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:01.780336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2203 sessionId: src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0 is DEAD
2025-10-10T14:37:01.789901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.791607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:01.791628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2204
2025-10-10T14:37:01.791835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:01.791873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:01.791880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:01.791884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:01.792908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2204 sessionId:  describe result for acl check
2025-10-10T14:37:01.792951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:01.792958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:01.792960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:01.792967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602094973118333:3874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:01.793571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602094973118333:3874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:01.799118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602094973118333:3874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:01.804807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602094973118333:3874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:01.804828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602094973118333:3874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:01.804832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602094973118333:3874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:01.804844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:01.814155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:01.817389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:01.817646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:01.817661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:01.817674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:01.817731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:01.817778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602094190887764:2756]
2025-10-10T14:37:01.818459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:01.818791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:01.818839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:01.819180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:01.819244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.819252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.819253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.819254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.819256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.819257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.819259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.819260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.819261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.819263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.819264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.819265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.819267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.819273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.819288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.819293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.819298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.819302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.819307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.819311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.819314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.819317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.819321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.819325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.819329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.819334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.819342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.819353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:01.819359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.819366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:01.819371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.819377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:01.819381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.819386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:01.819392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.819398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:01.819403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.819409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:01.819414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.819420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:01.819424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.819431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:01.819435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.819441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:01.819448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.819453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:01.819458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.819464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.819469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.819475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.819480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.819486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.819528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:01.822155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:01.822637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:01.822652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:01.822654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:01.822659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:01.822667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2203 [2:7559602094190887764:2756]
2025-10-10T14:37:01.822681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:01.822700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:01.822710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.822714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.822717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.822736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:01.822749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:01.822763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:01.822823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.822831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.822833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.822837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:01.822913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:01.822926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.822939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:01.822952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:01.822977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:01.823003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973118459:3874], now have 1 active actors on pipe
2025-10-10T14:37:01.823013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973118305:2438], now have 1 active actors on pipe
2025-10-10T14:37:01.823022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602094190887759:2756]
2025-10-10T14:37:01.823029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602094190887759:2756]
2025-10-10T14:37:01.823031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602094190887759:2756]
2025-10-10T14:37:01.823048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:01.823065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:01.823079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:01.823083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:01.823087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:01.823091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:01.823094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:01.823116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602094190887759:2756]
2025-10-10T14:37:01.823119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:01.823133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:01.823117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2203
2025-10-10T14:37:01.823152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2203
2025-10-10T14:37:01.823276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.823292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.823329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:01.823343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:01.823353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:01.823356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:01.823369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:01.823386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:01.823404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.823807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.823817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.823848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:01.823948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2204 partition: 0 MaxSeqNo: 40 sessionId: src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0
2025-10-10T14:37:01.824395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac38f9f8-a4e09987-8bba9e84-f7dc279c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:01.827382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0] Write session: try to update token
2025-10-10T14:37:01.827403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:01.839140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:01.839165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:01.839178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602094190887759:2756]
2025-10-10T14:37:01.839232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:01.839235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:01.839440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:01.839591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:01.839751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:01.839917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:01.840132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:01.840184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:01.847883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId: src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:01.850678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:01.851254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.851281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.851338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:01.851466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:01.864340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:01.864365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:01.864368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:01.864370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:01.864382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602094190887759:2756]
2025-10-10T14:37:01.864386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602094190887759:2756]
2025-10-10T14:37:01.864393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602094190887759:2756]
2025-10-10T14:37:01.864450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:01.864449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:01.864464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:01.864464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:01.864467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:01.864470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:01.864622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:01.880027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602094973118603:3836]
2025-10-10T14:37:01.880340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2203, pipe: [1:7559602094973118603:3836]
2025-10-10T14:37:01.989349Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:01.997939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:01.997971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:01.998165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:01.998241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:01.998322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:01.998398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:01.998461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:01.998471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:01.998554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:01.998621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:01.998694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:01.998769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:01.998823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:01.998830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:01.998910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:01.998985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:01.999058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:01.999130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:01.999179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:01.999186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:01.999259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:01.999326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:01.999396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:01.999467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:01.999514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:01.999521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:01.999595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:01.999662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:01.999733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:01.999804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:01.999876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:01.999879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:01.999971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.000118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.000197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.000272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.000328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.000335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.000420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.000495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.000575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.000652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.000707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.000713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.000799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.000873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.000954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.001035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.001094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.001101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.001192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.001265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.001529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.001612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.001672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.001675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.001757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.002379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:02.002398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:02.002434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2204 reason: error at write: Disconnected sessionId: src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0
2025-10-10T14:37:02.002656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2204 sessionId: src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0 is DEAD
2025-10-10T14:37:02.002833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602094973118603:3836]
2025-10-10T14:37:02.002854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:02.001830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.001912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.001986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.002047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.002050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.002118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602094973118603:3836], now have 1 active actors on pipe
2025-10-10T14:37:02.003356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:02.005435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:02.005449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0] Write session will restart in 0.007882s
2025-10-10T14:37:02.005478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0] Write session: Do CDS request
2025-10-10T14:37:02.005485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:02.014999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.017713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:02.017733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2205
2025-10-10T14:37:02.017932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.017982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:02.017994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:02.018000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:02.018522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2205 sessionId:  describe result for acl check
2025-10-10T14:37:02.018571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:02.018580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:02.018582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:02.018590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602099268085935:3881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:02.019280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602099268085935:3881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:02.022928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602099268085935:3881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:02.029653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602099268085935:3881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:02.029686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602099268085935:3881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:02.029690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602099268085935:3881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:02.029701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:02.038228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:02.042303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:02.042739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:02.042745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:02.042758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:02.042824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:02.042867Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602098485855352:2750]
2025-10-10T14:37:02.043574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:02.043976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:02.044025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:02.044412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:02.044479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.044481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.044483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.044484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.044486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.044487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.044489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.044491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.044493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.044494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.044495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.044497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.044498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.044506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.044521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.044525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.044530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.044535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.044539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.044544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.044548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.044553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.044557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.044562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.044566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.044571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.044579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.044589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.044597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.044604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.044612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.044618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.044624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.044630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.044635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.044642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.044648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.044654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.044660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.044666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.044672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.044678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.044683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.044688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.044693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.044700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.044710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.044716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.044721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.044728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.044733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.044739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.044783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:02.047743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:02.048613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:02.048618Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:02.048621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:02.048625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:02.048633Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2204 [2:7559602098485855352:2750]
2025-10-10T14:37:02.048648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:02.048670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:02.048674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.048677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.048680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.048700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:02.048710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:02.048719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:02.048787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.048790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.048793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.048795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:02.048878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:02.048881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.048895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.048908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.048927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:02.048952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268085905:2438], now have 1 active actors on pipe
2025-10-10T14:37:02.048956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086092:3881], now have 1 active actors on pipe
2025-10-10T14:37:02.048964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602098485855346:2750]
2025-10-10T14:37:02.048967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602098485855346:2750]
2025-10-10T14:37:02.048969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602098485855346:2750]
2025-10-10T14:37:02.048980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:02.048995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:02.048998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:02.049001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:02.049004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:02.049010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:02.049014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:02.049049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602098485855346:2750]
2025-10-10T14:37:02.049058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:02.049076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:02.049472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.049479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.049523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:02.049533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.049538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.049541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:02.049554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.049566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:02.049585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.049027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2204
2025-10-10T14:37:02.049077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2204
2025-10-10T14:37:02.052887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2205 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0
2025-10-10T14:37:02.053321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2fd5cd-49ac5fc7-9b4129f2-1f4ac739_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:02.052742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.052760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.052794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.056245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0] Write session: try to update token
2025-10-10T14:37:02.056268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:02.065007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:02.065031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:02.065042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602098485855346:2750]
2025-10-10T14:37:02.065092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:02.065096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:02.065294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:02.065480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.065640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.065794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.066014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:02.066061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:02.084001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId: src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:02.087758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:02.087937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:02.087959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:02.087962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:02.087965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:02.087976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602098485855346:2750]
2025-10-10T14:37:02.087981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602098485855346:2750]
2025-10-10T14:37:02.087985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602098485855346:2750]
2025-10-10T14:37:02.088038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:02.088046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.088054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:02.088063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:02.088076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:02.088080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:02.088200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:02.103252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602099268086195:3836]
2025-10-10T14:37:02.105594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2204, pipe: [1:7559602099268086195:3836]
2025-10-10T14:37:02.214839Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:02.215388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.215409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.215436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086195:3836], now have 1 active actors on pipe
2025-10-10T14:37:02.215712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:02.216622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:02.216635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0] Write session will restart in 0.005537s
2025-10-10T14:37:02.216662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0] Write session: Do CDS request
2025-10-10T14:37:02.216669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:02.216072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602099268086195:3836]
2025-10-10T14:37:02.216118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:02.216159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:02.216257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2205 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0
2025-10-10T14:37:02.216475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2205 sessionId: src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0 is DEAD
2025-10-10T14:37:02.223957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.225535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:02.225557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2206
2025-10-10T14:37:02.229483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.229545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:02.229552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:02.229557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:02.230005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2206 sessionId:  describe result for acl check
2025-10-10T14:37:02.230038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:02.230040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:02.230042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:02.230049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602099268086260:3882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:02.230652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602099268086260:3882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:02.255686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602099268086260:3882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:02.262759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:02.262298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602099268086260:3882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:02.262319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602099268086260:3882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:02.262323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602099268086260:3882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:02.262334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:02.266626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:02.266907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:02.266921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:02.266934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:02.266993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:02.267048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602098485855658:2744]
2025-10-10T14:37:02.267690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:02.268133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:02.268211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:02.268587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:02.268675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.268684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.268685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.268686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.268687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.268688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.268690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.268691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.268692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.268694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.268695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.268696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.268697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.268705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.268720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.268725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.268730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.268734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.268737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.268741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.268744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.268748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.268752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.268755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.268759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.268763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.268772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.268780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.268786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.268791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.268796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.268801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.268806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.268811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.268816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.268821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.268825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.268834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.268840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.268845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.268849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.268854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.268859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.268865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.268870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.268876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.268881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.268887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.268892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.268905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.268911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.268917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.268962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:02.272057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:02.272555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:02.272575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:02.272578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:02.272583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:02.272591Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2205 [2:7559602098485855658:2744]
2025-10-10T14:37:02.272606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:02.272626Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:02.272630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.272633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.272635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.272657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:02.272666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:02.272674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:02.272745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.272747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.272749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.272752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:02.272834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:02.272837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.272850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.272861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.272876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:02.272900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086210:2438], now have 1 active actors on pipe
2025-10-10T14:37:02.272904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086492:3882], now have 1 active actors on pipe
2025-10-10T14:37:02.272913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602098485855651:2744]
2025-10-10T14:37:02.272916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602098485855651:2744]
2025-10-10T14:37:02.272919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602098485855651:2744]
2025-10-10T14:37:02.272935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:02.272949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:02.272952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:02.272952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:02.272955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:02.272972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:02.272975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:02.273012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602098485855651:2744]
2025-10-10T14:37:02.273019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:02.273026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:02.273241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2205
2025-10-10T14:37:02.273290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2205
2025-10-10T14:37:02.273540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.273557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.273590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:02.273606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.273615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.273618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:02.273631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.273644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:02.273665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.274222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.274234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.274261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.275330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1502334-be400bf2-b2fbea27-f5f61b79_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:02.278211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0] Write session: try to update token
2025-10-10T14:37:02.278234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:02.274879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2206 partition: 0 MaxSeqNo: 40 sessionId: src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0
2025-10-10T14:37:02.285555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:02.285587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:02.285597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602098485855651:2744]
2025-10-10T14:37:02.285654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:02.285835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:02.285992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.286146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.286292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.286488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:02.286538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:02.287105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:02.304756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:02.304777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:02.304781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:02.304783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:02.304795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602098485855651:2744]
2025-10-10T14:37:02.304801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602098485855651:2744]
2025-10-10T14:37:02.304805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602098485855651:2744]
2025-10-10T14:37:02.304860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:02.304869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.304872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:02.305020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:02.307535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:02.307544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:02.307549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:02.314908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId: src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:02.316217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602099268086506:3836]
2025-10-10T14:37:02.316543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2205, pipe: [1:7559602099268086506:3836]
2025-10-10T14:37:02.317676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:02.433862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:02.434755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086506:3836], now have 1 active actors on pipe
2025-10-10T14:37:02.434805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.434813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.437653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:02.439395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:02.439409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0] Write session will restart in 0.006468s
2025-10-10T14:37:02.439435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0] Write session: Do CDS request
2025-10-10T14:37:02.439442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:02.438091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:02.438193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0
2025-10-10T14:37:02.438392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2206 sessionId: src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0 is DEAD
2025-10-10T14:37:02.438554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602099268086506:3836]
2025-10-10T14:37:02.438569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:02.448078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.449656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:02.449675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2207
2025-10-10T14:37:02.449895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.449931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:02.449937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:02.449941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:02.450576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2207 sessionId:  describe result for acl check
2025-10-10T14:37:02.450621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:02.450623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:02.450625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:02.450632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602099268086522:3889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:02.451237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602099268086522:3889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:02.467211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602099268086522:3889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:02.472382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602099268086522:3889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:02.472403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602099268086522:3889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:02.472407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602099268086522:3889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:02.472416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:02.487230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:02.490740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:02.490999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:02.491005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:02.491018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:02.491078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:02.491119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602098485855953:2739]
2025-10-10T14:37:02.491777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:02.492224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:02.492286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:02.492635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:02.492709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.492710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.492712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.492713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.492715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.492716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.492718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.492719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.492721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.492722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.492723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.492725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.492726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.492732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.492746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.492750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.492755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.492759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.492764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.492768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.492772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.492775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.492780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.492784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.492788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.492792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.492800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.492810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.492818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.492824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.492832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.492837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.492843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.492850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.492856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.492862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.492867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.492873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.492878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.492885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.492890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.492897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.492903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.492909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.492916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.492922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.492927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.492933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.492938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.492944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.492950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.492956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.493004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:02.495633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:02.496197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:02.496210Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:02.496213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:02.496217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:02.496223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2206 [2:7559602098485855953:2739]
2025-10-10T14:37:02.496236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:02.496256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:02.496259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.496263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.496265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.496284Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:02.496297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:02.496305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:02.496366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.496376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.496378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.496381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:02.496458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:02.496476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.496487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.496503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.496518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:02.496545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086653:3889], now have 1 active actors on pipe
2025-10-10T14:37:02.496554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086509:2438], now have 1 active actors on pipe
2025-10-10T14:37:02.496562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602098485855948:2739]
2025-10-10T14:37:02.496565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602098485855948:2739]
2025-10-10T14:37:02.496567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602098485855948:2739]
2025-10-10T14:37:02.496579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:02.496593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:02.496593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:02.496597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:02.496598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:02.496623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:02.496634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:02.496665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602098485855948:2739]
2025-10-10T14:37:02.496677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:02.496688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:02.496687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2206
2025-10-10T14:37:02.496693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2206
2025-10-10T14:37:02.496740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.496750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.496786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:02.496799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.496803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.496806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:02.496830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.496846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:02.496865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.497196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.497208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.497231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.497379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2207 partition: 0 MaxSeqNo: 40 sessionId: src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0
2025-10-10T14:37:02.497827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25422748-ab6b0b10-f68fd0e8-acf8a867_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:02.500706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0] Write session: try to update token
2025-10-10T14:37:02.500724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:02.518461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:02.518483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:02.518486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:02.518488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:02.518499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602098485855948:2739]
2025-10-10T14:37:02.518503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602098485855948:2739]
2025-10-10T14:37:02.518511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602098485855948:2739]
2025-10-10T14:37:02.518566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:02.518572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:02.518579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.518580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:02.518582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:02.518585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:02.518727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:02.531603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId: src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:02.534519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:02.538967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602099268086805:3836]
2025-10-10T14:37:02.539360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2206, pipe: [1:7559602099268086805:3836]
2025-10-10T14:37:02.638243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:02.638853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.638873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.638899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086805:3836], now have 1 active actors on pipe
2025-10-10T14:37:02.639138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:02.639909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:02.639923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0] Write session will restart in 0.008666s
2025-10-10T14:37:02.639949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0] Write session: Do CDS request
2025-10-10T14:37:02.639956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:02.639166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602099268086805:3836]
2025-10-10T14:37:02.639206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:02.639205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:02.639210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:02.639278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2207 reason: error at write: Disconnected sessionId: src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0
2025-10-10T14:37:02.639520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2207 sessionId: src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0 is DEAD
2025-10-10T14:37:02.649977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.653736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:02.653755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2208
2025-10-10T14:37:02.653968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.654005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:02.654011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:02.654016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:02.654509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2208 sessionId:  describe result for acl check
2025-10-10T14:37:02.654553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:02.654560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:02.654563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:02.654570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602099268086860:3926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:02.655142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602099268086860:3926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:02.669357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602099268086860:3926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:02.678223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602099268086860:3926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:02.678245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602099268086860:3926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:02.678249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602099268086860:3926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:02.678260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:02.685611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:02.689278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:02.689556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:02.689563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:02.689578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:02.689652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:02.689692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602098485856285:2724]
2025-10-10T14:37:02.690269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:02.690616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:02.690678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:02.691017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:02.691078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.691085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.691086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.691086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.691087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.691088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.691089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.691090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.691091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.691092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.691092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.691093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.691094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.691098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.691107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.691110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.691112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.691115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.691118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.691120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.691122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.691125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.691127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.691129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.691132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.691134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.691141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.691147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.691151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.691156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.691159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.691162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.691165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.691168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.691171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.691174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.691178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.691181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.691184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.691188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.691190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.691194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.691197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.691200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.691203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.691206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.691209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.691214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.691216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.691220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.691222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.691225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.691249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:02.693871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:02.694277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:02.694291Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:02.694294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:02.694298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:02.694304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2207 [2:7559602098485856285:2724]
2025-10-10T14:37:02.694320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:02.694338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:02.694342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.694345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.694348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.694364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:02.694377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:02.694385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:02.694444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.694453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.694455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.694457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:02.694529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:02.694532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.694543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.694555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.694573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:02.694594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602098485856280:2724]
2025-10-10T14:37:02.694596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602098485856280:2724]
2025-10-10T14:37:02.694598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602098485856280:2724]
2025-10-10T14:37:02.694607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:02.694622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:02.694632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:02.694636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:02.694637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:02.694638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:02.694640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:02.694673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268087057:3926], now have 1 active actors on pipe
2025-10-10T14:37:02.694676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268086834:2438], now have 1 active actors on pipe
2025-10-10T14:37:02.694678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602098485856280:2724]
2025-10-10T14:37:02.694688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:02.694711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:02.694861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2207
2025-10-10T14:37:02.694911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2207
2025-10-10T14:37:02.695015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.695030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.695067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec95a059-1d933150-f0d137ab-18d8021f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:02.695081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.695085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.695088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:02.695111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.695129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:02.695150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.695343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.695353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.695370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.695487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2208 partition: 0 MaxSeqNo: 40 sessionId: src_id|ec95a059-1d933150-f0d137ab-18d8021f_0
2025-10-10T14:37:02.695999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674915e-90e60286-3fbcbe7d-df3fce26_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ec95a059-1d933150-f0d137ab-18d8021f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:02.698734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec95a059-1d933150-f0d137ab-18d8021f_0] Write session: try to update token
2025-10-10T14:37:02.698753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec95a059-1d933150-f0d137ab-18d8021f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:02.706954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:02.706982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:02.706994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602098485856280:2724]
2025-10-10T14:37:02.707055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:02.707249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:02.707409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.707561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.707729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:02.707964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:02.708015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:02.708136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:02.714028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId: src_id|ec95a059-1d933150-f0d137ab-18d8021f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:02.717040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:02.717187Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 22 CurrentSessionLifetimeMs: 361470 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:37:02.717844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.717870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.717918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:02.718247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:02.727171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:02.727196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:02.727200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:02.727202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:02.727213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602098485856280:2724]
2025-10-10T14:37:02.727218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602098485856280:2724]
2025-10-10T14:37:02.727223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602098485856280:2724]
2025-10-10T14:37:02.727280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:02.727284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:02.727288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.727291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:02.727291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:02.727295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:02.727435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:02.739187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602099268087135:3836]
2025-10-10T14:37:02.739477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2207, pipe: [1:7559602099268087135:3836]
2025-10-10T14:37:02.856268Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:02.856833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268087135:3836], now have 1 active actors on pipe
2025-10-10T14:37:02.865474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.865505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.869092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:02.869096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:02.869111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:02.869144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2208 reason: error at write: Disconnected sessionId: src_id|ec95a059-1d933150-f0d137ab-18d8021f_0
2025-10-10T14:37:02.869154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602099268087135:3836]
2025-10-10T14:37:02.865702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.865776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.865842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.865906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.865949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.865954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.866027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.866090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.866153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.866224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.866267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.866270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.866345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.866403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.866465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.866525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.866566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.866569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.866639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.866703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.866767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.866832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.866873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.866876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.866945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.867007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.867072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.869538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec95a059-1d933150-f0d137ab-18d8021f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:02.869558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec95a059-1d933150-f0d137ab-18d8021f_0] Write session will restart in 0.008744s
2025-10-10T14:37:02.867135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.867177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.867180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.869585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec95a059-1d933150-f0d137ab-18d8021f_0] Write session: Do CDS request
2025-10-10T14:37:02.867251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.867311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.869593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec95a059-1d933150-f0d137ab-18d8021f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:02.867380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.867444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.867488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.867492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.867563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.867624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.867690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.867753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.867809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.867814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.867887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.867948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.868011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.868077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.868118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.868121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.868193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.868254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.868318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.868379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.868421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.868424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.868494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:02.868551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:02.868614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:02.868677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:02.868727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:02.868730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:02.869385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2208 sessionId: src_id|ec95a059-1d933150-f0d137ab-18d8021f_0 is DEAD
2025-10-10T14:37:02.870344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:02.879931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec95a059-1d933150-f0d137ab-18d8021f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.880311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:02.880328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2209
2025-10-10T14:37:02.880463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:02.880502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:02.880513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:02.880518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:02.880947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2209 sessionId:  describe result for acl check
2025-10-10T14:37:02.880983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:02.880990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:02.880992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:02.880998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602099268087158:3927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:02.881589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602099268087158:3927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:02.892273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602099268087158:3927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:02.898836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602099268087158:3927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:02.898859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602099268087158:3927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:02.898865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602099268087158:3927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:02.898877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:02.902788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:02.906649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:02.906948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:02.906962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:02.906975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:02.907037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:02.907097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602098485856580:2719]
2025-10-10T14:37:02.907840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:02.908291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:02.908344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:02.908673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:02.908756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.908763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.908765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.908766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.908767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.908769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.908771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.908772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.908773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.908775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.908776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.908778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.908779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.908785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.908798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.908802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.908806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.908809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.908813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.908817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.908820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.908824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.908828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.908832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.908836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.908840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.908849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.908858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:02.908867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.908873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:02.908878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.908883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:02.908888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.908893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:02.908899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.908904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:02.908910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.908915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:02.908919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.908924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:02.908928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.908933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:02.908937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.908943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:02.908948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.908953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:02.908961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.908966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.908970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.908976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.908980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.908985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.909025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:02.911963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:02.912915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:02.912935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:02.912937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:02.912942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:02.912949Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2208 [2:7559602098485856580:2719]
2025-10-10T14:37:02.912962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:02.912983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:02.912992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.912996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.912998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.913016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:02.913030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:02.913038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:02.913102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.913110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.913112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.913115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:02.913192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:02.913201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.913215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:02.913230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:02.913322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2208
2025-10-10T14:37:02.913328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2208
2025-10-10T14:37:02.913253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:02.913280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268087141:2438], now have 1 active actors on pipe
2025-10-10T14:37:02.913285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268087414:3927], now have 1 active actors on pipe
2025-10-10T14:37:02.913294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602098485856575:2719]
2025-10-10T14:37:02.913296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602098485856575:2719]
2025-10-10T14:37:02.913298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602098485856575:2719]
2025-10-10T14:37:02.913315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:02.913394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:02.913413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:02.913417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:02.913448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:02.913451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:02.913453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:02.913465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602098485856575:2719]
2025-10-10T14:37:02.913469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:02.913491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:02.913528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.913542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.913593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:02.913607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:02.913617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:02.913619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:02.913632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:02.913649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:02.913670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.913864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:02.913879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:02.913905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:02.914030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2209 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0
2025-10-10T14:37:02.914513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec95a059-1d933150-f0d137ab-18d8021f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:02.918099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0] Write session: try to update token
2025-10-10T14:37:02.918121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:02.935000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:02.935025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:02.935029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:02.935032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:02.935043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602098485856575:2719]
2025-10-10T14:37:02.935048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602098485856575:2719]
2025-10-10T14:37:02.935052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602098485856575:2719]
2025-10-10T14:37:02.935109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:02.935120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:02.935123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:02.935277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:02.937759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:02.937779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:02.937783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:02.939280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId: src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:02.942225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:02.969545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602099268087440:3836]
2025-10-10T14:37:02.970122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2208, pipe: [1:7559602099268087440:3836]
2025-10-10T14:37:03.056704Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:03.057036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.057059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.057114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602099268087440:3836], now have 1 active actors on pipe
2025-10-10T14:37:03.057402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:03.057439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:03.057505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:03.057516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:03.057585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2209 reason: error at write: Disconnected sessionId: src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0
2025-10-10T14:37:03.057793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2209 sessionId: src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0 is DEAD
2025-10-10T14:37:03.058105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602099268087440:3836]
2025-10-10T14:37:03.058333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:03.058344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0] Write session will restart in 0.006491s
2025-10-10T14:37:03.058370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0] Write session: Do CDS request
2025-10-10T14:37:03.058377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:03.065943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.066357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:03.066376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2210
2025-10-10T14:37:03.066511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.066549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:03.066561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:03.066565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:03.067049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2210 sessionId:  describe result for acl check
2025-10-10T14:37:03.067093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:03.067100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:03.067101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:03.067108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602103563054751:3931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:03.067700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602103563054751:3931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:03.070621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602103563054751:3931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:03.074943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602103563054751:3931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:03.074961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602103563054751:3931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:03.074966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602103563054751:3931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:03.074974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:03.087098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:03.091198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:03.091488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:03.091502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:03.091516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:03.091580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:03.091628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602102780824186:2715]
2025-10-10T14:37:03.092326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:03.093503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:03.093573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:03.093953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:03.094031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.094039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.094040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.094042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.094043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.094045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.094047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.094048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.094049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.094050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.094051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.094053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.094054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.094062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.094077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.094081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.094085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.094090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.094093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.094097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.094101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.094104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.094109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.094112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.094116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.094120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.094129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.094140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.094147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.094153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.094158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.094163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.094168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.094174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.094179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.094184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.094189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.094205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.094210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.094216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.094232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.094237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.094243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.094248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.094253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.094258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.094264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.094269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.094274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.094280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.094285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.094291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.094338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:03.099357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:03.099873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:03.099890Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:03.099893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:03.099897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:03.099905Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2209 [2:7559602102780824186:2715]
2025-10-10T14:37:03.099940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:03.099969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:03.099977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.099981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.099984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.100018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:03.100032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:03.100044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:03.100122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.100131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.100133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.100136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:03.100218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:03.100227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.100240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.100251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.100273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:03.100303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602102780824180:2715]
2025-10-10T14:37:03.100310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602102780824180:2715]
2025-10-10T14:37:03.100312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602102780824180:2715]
2025-10-10T14:37:03.100329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:03.100346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:03.100367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:03.100375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:03.100390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:03.100401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:03.100406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:03.100420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602102780824180:2715]
2025-10-10T14:37:03.100429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:03.100507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:03.100690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2209
2025-10-10T14:37:03.100696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2209
2025-10-10T14:37:03.100798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563054852:3931], now have 1 active actors on pipe
2025-10-10T14:37:03.100812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563054738:2438], now have 1 active actors on pipe
2025-10-10T14:37:03.100888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.100900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.100940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:03.100956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.100961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.100963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:03.100978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.100997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:03.101023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.101257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.101267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.101286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.105461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2210 partition: 0 MaxSeqNo: 40 sessionId: src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0
2025-10-10T14:37:03.105922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd750146-bcc640b1-f24d4609-ecf28ea9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:03.109244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0] Write session: try to update token
2025-10-10T14:37:03.109269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:03.123419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:03.123445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:03.123449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:03.123451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:03.123463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602102780824180:2715]
2025-10-10T14:37:03.123468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602102780824180:2715]
2025-10-10T14:37:03.123473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602102780824180:2715]
2025-10-10T14:37:03.123527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:03.123528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:03.123532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:03.123536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:03.123537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.123540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:03.123693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:03.128477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId: src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:03.131753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:03.158469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602103563055050:3836]
2025-10-10T14:37:03.158829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2209, pipe: [1:7559602103563055050:3836]
2025-10-10T14:37:03.241807Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:03.242426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.242438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.242490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055050:3836], now have 1 active actors on pipe
2025-10-10T14:37:03.242776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:03.242759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602103563055050:3836]
2025-10-10T14:37:03.242800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:03.242804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:03.242869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2210 reason: error at write: Disconnected sessionId: src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0
2025-10-10T14:37:03.243086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2210 sessionId: src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0 is DEAD
2025-10-10T14:37:03.243246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:03.244771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:03.244783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0] Write session will restart in 0.007202s
2025-10-10T14:37:03.244803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0] Write session: Do CDS request
2025-10-10T14:37:03.244811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:03.253047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.253686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:03.253705Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2211
2025-10-10T14:37:03.254115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.254157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:03.254161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:03.254165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:03.254671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2211 sessionId:  describe result for acl check
2025-10-10T14:37:03.254713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:03.254720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:03.254722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:03.254731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602103563055067:3947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:03.255343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602103563055067:3947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:03.259625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602103563055067:3947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:03.266251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602103563055067:3947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:03.266271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602103563055067:3947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:03.266275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602103563055067:3947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:03.266285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:03.282512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:03.286187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:03.286456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:03.286467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:03.286480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:03.286540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:03.286702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602102780824484:2694]
2025-10-10T14:37:03.287378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:03.287683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:03.287739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:03.288098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:03.288168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.288174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.288176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.288178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.288179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.288181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.288182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.288183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.288185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.288186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.288188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.288189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.288191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.288197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.288210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.288214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.288219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.288223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.288227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.288232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.288236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.288240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.288245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.288249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.288253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.288258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.288266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.288275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.288281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.288288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.288295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.288308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.288312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.288318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.288324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.288329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.288333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.288339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.288344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.288350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.288355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.288361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.288366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.288372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.288377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.288382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.288387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.288393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.288397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.288403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.288411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.288422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.288464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:03.291118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:03.291964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:03.291983Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:03.291985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:03.291989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:03.291997Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2210 [2:7559602102780824484:2694]
2025-10-10T14:37:03.292012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:03.292032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:03.292041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.292045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.292047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.292065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:03.292078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:03.292086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:03.292156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.292167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.292169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.292172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:03.292252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:03.292255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.292267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.292277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.292292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:03.292313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602102780824479:2694]
2025-10-10T14:37:03.292316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602102780824479:2694]
2025-10-10T14:37:03.292318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602102780824479:2694]
2025-10-10T14:37:03.292328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:03.292344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055175:3947], now have 1 active actors on pipe
2025-10-10T14:37:03.292349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055052:2438], now have 1 active actors on pipe
2025-10-10T14:37:03.292352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:03.292355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:03.292357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:03.292357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:03.292375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:03.292379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:03.292413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602102780824479:2694]
2025-10-10T14:37:03.292421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:03.292531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:03.292915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.292932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.292970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70123869-58b5738a-85f9799e-583db63a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:03.292979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.292985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.292988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:03.293001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.293014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:03.293036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.292465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2210
2025-10-10T14:37:03.292505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2210
2025-10-10T14:37:03.293470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.293481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.293502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.294182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75570ca2-e70d5d6a-a90e6ab1-b5c76699_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|70123869-58b5738a-85f9799e-583db63a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:03.296964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70123869-58b5738a-85f9799e-583db63a_0] Write session: try to update token
2025-10-10T14:37:03.296986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70123869-58b5738a-85f9799e-583db63a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:03.293748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2211 partition: 0 MaxSeqNo: 40 sessionId: src_id|70123869-58b5738a-85f9799e-583db63a_0
2025-10-10T14:37:03.317428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:03.317451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:03.317455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:03.317457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:03.317468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602102780824479:2694]
2025-10-10T14:37:03.317473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602102780824479:2694]
2025-10-10T14:37:03.317477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602102780824479:2694]
2025-10-10T14:37:03.317525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:03.317532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.317535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:03.317673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:03.318912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId: src_id|70123869-58b5738a-85f9799e-583db63a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:03.321698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:03.321997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:03.322010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:03.322015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:03.342315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602103563055353:3836]
2025-10-10T14:37:03.343817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2210, pipe: [1:7559602103563055353:3836]
2025-10-10T14:37:03.440598Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:03.441134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.441158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.441213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055353:3836], now have 1 active actors on pipe
2025-10-10T14:37:03.442575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:03.445512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:03.445532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:03.445545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602103563055353:3836]
2025-10-10T14:37:03.445566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:03.445611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2211 reason: error at write: Disconnected sessionId: src_id|70123869-58b5738a-85f9799e-583db63a_0
2025-10-10T14:37:03.445831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2211 sessionId: src_id|70123869-58b5738a-85f9799e-583db63a_0 is DEAD
2025-10-10T14:37:03.446212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70123869-58b5738a-85f9799e-583db63a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:03.446225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70123869-58b5738a-85f9799e-583db63a_0] Write session will restart in 0.009315s
2025-10-10T14:37:03.446250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70123869-58b5738a-85f9799e-583db63a_0] Write session: Do CDS request
2025-10-10T14:37:03.446259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70123869-58b5738a-85f9799e-583db63a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:03.456943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70123869-58b5738a-85f9799e-583db63a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.457291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:03.457311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2212
2025-10-10T14:37:03.457614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.457670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:03.457681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:03.457686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:03.458369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2212 sessionId:  describe result for acl check
2025-10-10T14:37:03.458409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:03.458413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:03.458415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:03.458422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602103563055399:3949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:03.459027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602103563055399:3949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:03.461906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602103563055399:3949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:03.465843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602103563055399:3949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:03.465858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602103563055399:3949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:03.465862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602103563055399:3949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:03.465871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:03.477358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:03.481004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:03.481264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:03.481276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:03.481289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:03.481363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:03.481410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602102780824783:2708]
2025-10-10T14:37:03.482035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:03.482408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:03.482471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:03.482835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:03.482903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.482904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.482905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.482906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.482908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.482909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.482910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.482912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.482913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.482914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.482916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.482917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.482919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.482926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.482940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.482945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.482950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.482954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.482959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.482963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.482968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.482973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.482977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.482982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.482986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.482991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.483000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.483010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.483017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.483024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.483029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.483035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.483040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.483046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.483064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.483070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.483075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.483081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.483088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.483094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.483099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.483104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.483111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.483129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.483134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.483139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.483144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.483150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.483155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.483160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.483166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.483171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.483212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:03.485833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:03.486611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:03.486622Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:03.486624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:03.486628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:03.486634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2211 [2:7559602102780824783:2708]
2025-10-10T14:37:03.486648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:03.486666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:03.486671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.486675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.486678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.486695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:03.486708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:03.486720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:03.486784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.486791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.486794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.486796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:03.486859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:03.486867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.486879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.486892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.486910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:03.486937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055355:2438], now have 1 active actors on pipe
2025-10-10T14:37:03.486947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055531:3949], now have 1 active actors on pipe
2025-10-10T14:37:03.486955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602102780824778:2708]
2025-10-10T14:37:03.486957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602102780824778:2708]
2025-10-10T14:37:03.486959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602102780824778:2708]
2025-10-10T14:37:03.486973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:03.486989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:03.486994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:03.486998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:03.487000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:03.487010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:03.487014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:03.487001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2211
2025-10-10T14:37:03.487040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602102780824778:2708]
2025-10-10T14:37:03.487050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:03.487051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:03.487031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2211
2025-10-10T14:37:03.487068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.487077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.487130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:03.487145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.487149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.487151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:03.487162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.487172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:03.487190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.487432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.487446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.487468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.487590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2212 partition: 0 MaxSeqNo: 40 sessionId: src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0
2025-10-10T14:37:03.488027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70123869-58b5738a-85f9799e-583db63a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:03.490677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0] Write session: try to update token
2025-10-10T14:37:03.490693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:03.507836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId: src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:03.508448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:03.508466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:03.508470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:03.508472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:03.508483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602102780824778:2708]
2025-10-10T14:37:03.508488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602102780824778:2708]
2025-10-10T14:37:03.508492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602102780824778:2708]
2025-10-10T14:37:03.508537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:03.508545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:03.508553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.508555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:03.508555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:03.508569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:03.508715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:03.510650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:03.545538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602103563055657:3836]
2025-10-10T14:37:03.546013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2211, pipe: [1:7559602103563055657:3836]
2025-10-10T14:37:03.639624Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:03.640153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.640165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.640209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055657:3836], now have 1 active actors on pipe
2025-10-10T14:37:03.640402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:03.641734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602103563055657:3836]
2025-10-10T14:37:03.641764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:03.641799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:03.641884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2212 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0
2025-10-10T14:37:03.642064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2212 sessionId: src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0 is DEAD
2025-10-10T14:37:03.645618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:03.645635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0] Write session will restart in 0.008630s
2025-10-10T14:37:03.645663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0] Write session: Do CDS request
2025-10-10T14:37:03.645672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:03.660378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.660853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:03.660874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2213
2025-10-10T14:37:03.661270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.661308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:03.661322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:03.661327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:03.661792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2213 sessionId:  describe result for acl check
2025-10-10T14:37:03.661835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:03.661837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:03.661840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:03.661846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602103563055685:3965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:03.662417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602103563055685:3965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:03.665487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602103563055685:3965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:03.674765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602103563055685:3965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:03.674785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602103563055685:3965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:03.674789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602103563055685:3965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:03.674798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:03.704652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:03.708691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:03.708951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:03.708956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:03.708968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:03.709028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:03.709077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602102780825120:2696]
2025-10-10T14:37:03.709758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:03.710325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:03.710378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:03.710729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:03.710785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.710786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.710788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.710789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.710790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.710792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.710794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.710795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.710797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.710798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.710799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.710801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.710802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.710809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.710822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.710827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.710831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.710835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.710839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.710844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.710848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.710853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.710857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.710862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.710866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.710870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.710880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.710889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.710897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.710902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.710907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.710912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.710918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.710924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.710930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.710935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.710940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.710946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.710954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.710960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.710965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.710970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.710975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.710980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.710987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.710993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.710998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.711004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.711008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.711014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.711019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.711024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.711070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:03.714457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:03.714929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:03.714935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:03.714937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:03.714942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:03.714950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2212 [2:7559602102780825120:2696]
2025-10-10T14:37:03.714964Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:03.714984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:03.714988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.714992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.714994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.715012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:03.715020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:03.715028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:03.715150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.715152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.715155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.715158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:03.715238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:03.715242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.715253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.715265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.715283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:03.715305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602102780825114:2696]
2025-10-10T14:37:03.715307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602102780825114:2696]
2025-10-10T14:37:03.715310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602102780825114:2696]
2025-10-10T14:37:03.715325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:03.715343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:03.715359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:03.715370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:03.715620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2212
2025-10-10T14:37:03.715414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602102780825114:2696]
2025-10-10T14:37:03.715424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:03.715522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:03.715525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:03.715526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:03.715532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:03.715804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055673:2438], now have 1 active actors on pipe
2025-10-10T14:37:03.715816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055726:3965], now have 1 active actors on pipe
2025-10-10T14:37:03.716249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2212
2025-10-10T14:37:03.716449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.716461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.716506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:03.716517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.716522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.716525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:03.716539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.716554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:03.716570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.721507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.721529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.721572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.721802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2213 partition: 0 MaxSeqNo: 40 sessionId: src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0
2025-10-10T14:37:03.725616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7bac2b-fcd392bc-be5cc76c-f89d56f1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:03.728444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0] Write session: try to update token
2025-10-10T14:37:03.728466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:03.742126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602103563055990:3836]
2025-10-10T14:37:03.743550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:03.743574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:03.743577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:03.743579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:03.743590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602102780825114:2696]
2025-10-10T14:37:03.743595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602102780825114:2696]
2025-10-10T14:37:03.743603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602102780825114:2696]
2025-10-10T14:37:03.743655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:03.743665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.743667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:03.743847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:03.744118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:03.744130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:03.744135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:03.744272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2212, pipe: [1:7559602103563055990:3836]
2025-10-10T14:37:03.761201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId: src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:03.763911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:03.873897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:03.874743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055990:3836], now have 1 active actors on pipe
2025-10-10T14:37:03.874817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.874838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.875139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602103563055990:3836]
2025-10-10T14:37:03.875179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:03.875182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:03.875253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2213 reason: error at write: Disconnected sessionId: src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0
2025-10-10T14:37:03.875607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:03.875616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0] Write session will restart in 0.008427s
2025-10-10T14:37:03.875652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0] Write session: Do CDS request
2025-10-10T14:37:03.875658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:03.875448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2213 sessionId: src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0 is DEAD
2025-10-10T14:37:03.875643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:03.875236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:03.884952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.885037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:03.885058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2214
2025-10-10T14:37:03.885214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:03.885260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:03.885272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:03.885276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:03.885785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2214 sessionId:  describe result for acl check
2025-10-10T14:37:03.885822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:03.885825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:03.885827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:03.885834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602103563056011:3979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:03.886420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602103563056011:3979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:03.891023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602103563056011:3979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:03.897766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602103563056011:3979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:03.897786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602103563056011:3979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:03.897791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602103563056011:3979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:03.897801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:03.908595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:03.911327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:03.911575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:03.911589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:03.911602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:03.911663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:03.911714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602102780825420:2685]
2025-10-10T14:37:03.912399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:03.912761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:03.912813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:03.913152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:03.913221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.913229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.913231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.913232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.913234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.913236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.913237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.913238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.913240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.913241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.913242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.913244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.913245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.913252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.913267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.913271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.913276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.913280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.913284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.913289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.913294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.913298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.913303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.913307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.913311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.913316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.913324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.913348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:03.913356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.913362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:03.913368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.913377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:03.913384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.913389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:03.913394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.913400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:03.913405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.913411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:03.913418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.913431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:03.913436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.913442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:03.913447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.913452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:03.913457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.913462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:03.913467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.913473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.913477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.913483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.913488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.913493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.913536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:03.916237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:03.917190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:03.917205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:03.917208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:03.917212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:03.917219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2213 [2:7559602102780825420:2685]
2025-10-10T14:37:03.917233Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:03.917253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:03.917257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.917261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.917264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.917283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:03.917297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:03.917307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:03.917402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.917404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.917408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.917411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:03.917483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:03.917486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.917497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:03.917506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:03.917521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:03.917543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602102780825415:2685]
2025-10-10T14:37:03.917551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602102780825415:2685]
2025-10-10T14:37:03.917553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602102780825415:2685]
2025-10-10T14:37:03.917562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:03.917577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:03.917579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:03.917582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:03.917584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:03.917592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:03.917596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:03.917633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563055996:2438], now have 1 active actors on pipe
2025-10-10T14:37:03.917641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563056176:3979], now have 1 active actors on pipe
2025-10-10T14:37:03.917644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602102780825415:2685]
2025-10-10T14:37:03.917651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:03.917783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:03.918433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2213
2025-10-10T14:37:03.918488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2213
2025-10-10T14:37:03.918595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.918609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.918645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dcef958-15d9854-35c01b31-60850756_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:03.918656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:03.918661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:03.918664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:03.918677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:03.918691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:03.918708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.921747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:03.921766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:03.921799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:03.925415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2214 partition: 0 MaxSeqNo: 40 sessionId: src_id|5dcef958-15d9854-35c01b31-60850756_0
2025-10-10T14:37:03.925851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7ce0bc-bb78fb7e-5e1954e5-42b3977a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5dcef958-15d9854-35c01b31-60850756_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:03.928633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcef958-15d9854-35c01b31-60850756_0] Write session: try to update token
2025-10-10T14:37:03.928655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcef958-15d9854-35c01b31-60850756_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:03.949487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:03.949512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:03.949516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:03.949518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:03.949528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602102780825415:2685]
2025-10-10T14:37:03.949533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602102780825415:2685]
2025-10-10T14:37:03.949538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602102780825415:2685]
2025-10-10T14:37:03.949589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:03.949603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:03.949606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:03.949775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:03.952917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:03.952932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:03.952936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:03.961244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId: src_id|5dcef958-15d9854-35c01b31-60850756_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:03.964054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:03.977532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602103563056299:3836]
2025-10-10T14:37:03.977859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2213, pipe: [1:7559602103563056299:3836]
2025-10-10T14:37:04.075593Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:04.076125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.076146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.076171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602103563056299:3836], now have 1 active actors on pipe
2025-10-10T14:37:04.076658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:04.077072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcef958-15d9854-35c01b31-60850756_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:04.077085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcef958-15d9854-35c01b31-60850756_0] Write session will restart in 0.007392s
2025-10-10T14:37:04.077111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcef958-15d9854-35c01b31-60850756_0] Write session: Do CDS request
2025-10-10T14:37:04.077118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcef958-15d9854-35c01b31-60850756_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:04.076355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:04.076420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:04.076423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:04.076501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2214 reason: error at write: Disconnected sessionId: src_id|5dcef958-15d9854-35c01b31-60850756_0
2025-10-10T14:37:04.076701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2214 sessionId: src_id|5dcef958-15d9854-35c01b31-60850756_0 is DEAD
2025-10-10T14:37:04.076869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602103563056299:3836]
2025-10-10T14:37:04.085938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcef958-15d9854-35c01b31-60850756_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.086027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:04.086045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2215
2025-10-10T14:37:04.086224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.086275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:04.086285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:04.086290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:04.086792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2215 sessionId:  describe result for acl check
2025-10-10T14:37:04.086833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:04.086841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:04.086844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:04.086851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602107858023616:3981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:04.087507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602107858023616:3981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:04.090858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602107858023616:3981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:04.102140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602107858023616:3981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:04.102161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602107858023616:3981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:04.102165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602107858023616:3981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:04.102175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:04.114124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:04.117715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:04.118010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:04.118023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:04.118037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:04.118117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:04.118168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602107075793032:2669]
2025-10-10T14:37:04.118821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:04.119615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:04.119675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:04.120097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:04.120170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.120177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.120179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.120180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.120181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.120183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.120184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.120185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.120187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.120188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.120189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.120190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.120192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.120198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.120212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.120216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.120221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.120224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.120228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.120232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.120235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.120239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.120243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.120247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.120250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.120254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.120262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.120272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.120279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.120285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.120289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.120294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.120299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.120305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.120309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.120315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.120319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.120325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.120329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.120334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.120339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.120344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.120349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.120355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.120361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.120366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.120372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.120378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.120382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.120387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.120392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.120397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.120439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:04.128427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:04.129085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:04.129104Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:04.129107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:04.129112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:04.129121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2214 [2:7559602107075793032:2669]
2025-10-10T14:37:04.129139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:04.129162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:04.129171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.129175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.129178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.129198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:04.129208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:04.129224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:04.129307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.129316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.129319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.129322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:04.129423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:04.129433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.129447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.129459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.129476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:04.129512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602107075793026:2669]
2025-10-10T14:37:04.129522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602107075793026:2669]
2025-10-10T14:37:04.129525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602107075793026:2669]
2025-10-10T14:37:04.129547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:04.129579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:04.129608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:04.129614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:04.129618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:04.129620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:04.129622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:04.129678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602107075793026:2669]
2025-10-10T14:37:04.129691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:04.129728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:04.130555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858023837:3981], now have 1 active actors on pipe
2025-10-10T14:37:04.130572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858023598:2438], now have 1 active actors on pipe
2025-10-10T14:37:04.130595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.130604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.130649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1533db48-158348cf-8fa27af8-dec59bea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:04.130668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.130678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.130681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:04.130697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.130719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:04.130749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.130979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.130990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.131011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.130397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2214
2025-10-10T14:37:04.130438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2214
2025-10-10T14:37:04.131141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2215 partition: 0 MaxSeqNo: 40 sessionId: src_id|1533db48-158348cf-8fa27af8-dec59bea_0
2025-10-10T14:37:04.133468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcef958-15d9854-35c01b31-60850756_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1533db48-158348cf-8fa27af8-dec59bea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:04.136406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1533db48-158348cf-8fa27af8-dec59bea_0] Write session: try to update token
2025-10-10T14:37:04.136431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1533db48-158348cf-8fa27af8-dec59bea_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:04.146861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:04.146887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:04.146899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602107075793026:2669]
2025-10-10T14:37:04.146957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:04.147154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:04.147320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.147487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.147640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.147873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:04.147918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:04.148114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:04.165130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId: src_id|1533db48-158348cf-8fa27af8-dec59bea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:04.168507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:04.169221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.169248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.171686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:04.171723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:04.171727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:04.171731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:04.171733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:04.171744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602107075793026:2669]
2025-10-10T14:37:04.171749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602107075793026:2669]
2025-10-10T14:37:04.171756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602107075793026:2669]
2025-10-10T14:37:04.171823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:04.171830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:04.171832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:04.171835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:04.171840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.171843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:04.172012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:04.171893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:04.177029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602107858023915:3836]
2025-10-10T14:37:04.177576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2214, pipe: [1:7559602107858023915:3836]
2025-10-10T14:37:04.293706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:04.294129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858023915:3836], now have 1 active actors on pipe
2025-10-10T14:37:04.303046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.303079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.303269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.303332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.303393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.303455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.303498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.303506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.303583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.303680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.303797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.303891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.303948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.303961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.304050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.304129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.304203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.304281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.304331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.304336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.304422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.304494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.304568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.304641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.304689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.304692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.304775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.304861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.304930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.305003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.305049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.305053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.305129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.305199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.305269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.305508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.305565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.305568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.305642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.305705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.305770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.305835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.305880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.305883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.305959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.306020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.306085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.306152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.306196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.306199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.306279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.306343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.306403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.306466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.306510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.306513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.306592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.306654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.306721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.306785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.306829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.306832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.309090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602107858023915:3836]
2025-10-10T14:37:04.309122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:04.309124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:04.309154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2215 reason: error at write: Disconnected sessionId: src_id|1533db48-158348cf-8fa27af8-dec59bea_0
2025-10-10T14:37:04.309325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2215 sessionId: src_id|1533db48-158348cf-8fa27af8-dec59bea_0 is DEAD
2025-10-10T14:37:04.309440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:04.309622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:04.312806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1533db48-158348cf-8fa27af8-dec59bea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:04.312820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1533db48-158348cf-8fa27af8-dec59bea_0] Write session will restart in 0.008435s
2025-10-10T14:37:04.312850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1533db48-158348cf-8fa27af8-dec59bea_0] Write session: Do CDS request
2025-10-10T14:37:04.312857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1533db48-158348cf-8fa27af8-dec59bea_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:04.322897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1533db48-158348cf-8fa27af8-dec59bea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.323247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:04.323263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2216
2025-10-10T14:37:04.323405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.323429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:04.323434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:04.323437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:04.325213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2216 sessionId:  describe result for acl check
2025-10-10T14:37:04.325251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:04.325252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:04.325254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:04.325259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602107858023972:3986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:04.325845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602107858023972:3986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:04.330480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602107858023972:3986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:04.335591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602107858023972:3986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:04.335610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602107858023972:3986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:04.335614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602107858023972:3986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:04.335623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:04.350283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:04.353470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:04.353696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:04.353709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:04.353722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:04.353777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:04.353826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602107075793335:2662]
2025-10-10T14:37:04.354257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:04.354598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:04.354650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:04.354891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:04.354944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.354950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.354952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.354953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.354954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.354955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.354957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.354958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.354959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.354961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.354962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.354964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.354965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.354971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.354984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.354989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.354994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.354998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.355003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.355007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.355012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.355017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.355022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.355026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.355031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.355034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.355042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.355052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.355065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.355073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.355083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.355088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.355093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.355101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.355107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.355117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.355122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.355133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.355138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.355144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.355148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.355154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.355158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.355164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.355169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.355176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.355181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.355186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.355191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.355197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.355206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.355211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.355248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:04.357711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:04.358146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:04.358161Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:04.358163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:04.358167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:04.358174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2215 [2:7559602107075793335:2662]
2025-10-10T14:37:04.358189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:04.358207Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:04.358215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.358219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.358221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.358239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:04.358250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:04.358259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:04.358315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.358324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.358326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.358329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:04.358391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:04.358395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.358405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.358414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.358427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:04.358451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602107075793330:2662]
2025-10-10T14:37:04.358454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602107075793330:2662]
2025-10-10T14:37:04.358455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602107075793330:2662]
2025-10-10T14:37:04.358464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:04.358478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:04.358492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:04.358496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:04.358518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602107075793330:2662]
2025-10-10T14:37:04.358521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:04.358632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:04.358634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:04.358636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:04.358643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:04.358709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024062:3986], now have 1 active actors on pipe
2025-10-10T14:37:04.358717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858023917:2438], now have 1 active actors on pipe
2025-10-10T14:37:04.359185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2215
2025-10-10T14:37:04.359213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2215
2025-10-10T14:37:04.362765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.362782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.362824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eacf2726-2a11e533-d8e3774e-685c915b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:04.362836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.362842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.362845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:04.362863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.362883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:04.362903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.364899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.364913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.364940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.367426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2216 partition: 0 MaxSeqNo: 40 sessionId: src_id|eacf2726-2a11e533-d8e3774e-685c915b_0
2025-10-10T14:37:04.368410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1533db48-158348cf-8fa27af8-dec59bea_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eacf2726-2a11e533-d8e3774e-685c915b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:04.371399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf2726-2a11e533-d8e3774e-685c915b_0] Write session: try to update token
2025-10-10T14:37:04.371422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf2726-2a11e533-d8e3774e-685c915b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:04.386006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:04.386033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:04.386038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:04.386041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:04.386056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602107075793330:2662]
2025-10-10T14:37:04.386063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602107075793330:2662]
2025-10-10T14:37:04.386071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602107075793330:2662]
2025-10-10T14:37:04.386132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:04.386141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.386143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:04.386338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:04.389854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:04.389881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:04.389887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:04.395358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId: src_id|eacf2726-2a11e533-d8e3774e-685c915b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:04.398140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:04.416200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602107858024222:3836]
2025-10-10T14:37:04.416637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2215, pipe: [1:7559602107858024222:3836]
2025-10-10T14:37:04.511043Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:04.511684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.511702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.511749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024222:3836], now have 1 active actors on pipe
2025-10-10T14:37:04.512053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:04.512068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:04.512144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2216 reason: error at write: Disconnected sessionId: src_id|eacf2726-2a11e533-d8e3774e-685c915b_0
2025-10-10T14:37:04.512355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2216 sessionId: src_id|eacf2726-2a11e533-d8e3774e-685c915b_0 is DEAD
2025-10-10T14:37:04.512510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602107858024222:3836]
2025-10-10T14:37:04.512626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:04.512895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf2726-2a11e533-d8e3774e-685c915b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:04.512906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf2726-2a11e533-d8e3774e-685c915b_0] Write session will restart in 0.006061s
2025-10-10T14:37:04.512933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf2726-2a11e533-d8e3774e-685c915b_0] Write session: Do CDS request
2025-10-10T14:37:04.512941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf2726-2a11e533-d8e3774e-685c915b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:04.511997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:04.521944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf2726-2a11e533-d8e3774e-685c915b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.522407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:04.522427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2217
2025-10-10T14:37:04.522558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.522599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:04.522605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:04.522609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:04.523076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2217 sessionId:  describe result for acl check
2025-10-10T14:37:04.523122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:04.523130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:04.523132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:04.523138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602107858024236:3992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:04.523779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602107858024236:3992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:04.526156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602107858024236:3992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:04.528984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602107858024236:3992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:04.529002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602107858024236:3992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:04.529007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602107858024236:3992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:04.529016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:04.572975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:04.576819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:04.577054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:04.577068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:04.577080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:04.577139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:04.577188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602107075793639:2658]
2025-10-10T14:37:04.577876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:04.578162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:04.578208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:04.578533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:04.578592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.578600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.578601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.578603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.578604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.578605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.578607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.578608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.578609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.578611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.578612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.578613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.578615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.578621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.578634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.578639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.578644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.578648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.578653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.578657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.578662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.578667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.578672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.578676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.578680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.578685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.578694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.578703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.578711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.578717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.578722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.578728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.578739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.578745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.578756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.578762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.578771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.578777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.578782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.578792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.578797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.578803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.578808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.578814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.578819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.578825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.578834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.578840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.578844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.578854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.578860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.578871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.578914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:04.581368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:04.582099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:04.582119Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:04.582121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:04.582125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:04.582131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2216 [2:7559602107075793639:2658]
2025-10-10T14:37:04.582145Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:04.582162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:04.582165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.582170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.582172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.582190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:04.582199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:04.582213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:04.582276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.582284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.582286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.582289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:04.582361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:04.582371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.582383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.582397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.582418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:04.582444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602107075793634:2658]
2025-10-10T14:37:04.582451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602107075793634:2658]
2025-10-10T14:37:04.582453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602107075793634:2658]
2025-10-10T14:37:04.582467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:04.582482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:04.582504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:04.582512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:04.582536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602107075793634:2658]
2025-10-10T14:37:04.582544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:04.582570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024270:3992], now have 1 active actors on pipe
2025-10-10T14:37:04.582580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024226:2438], now have 1 active actors on pipe
2025-10-10T14:37:04.582605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:04.582616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:04.582618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:04.582626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:04.582799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.582815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.582854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:04.582868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.582890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.582897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:04.582912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.582925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:04.582948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.583121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.583129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.583156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.583666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacf2726-2a11e533-d8e3774e-685c915b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:04.582726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2216
2025-10-10T14:37:04.582780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2216
2025-10-10T14:37:04.583264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2217 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0
2025-10-10T14:37:04.586372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0] Write session: try to update token
2025-10-10T14:37:04.586390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:04.597186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:04.597216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:04.597230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602107075793634:2658]
2025-10-10T14:37:04.597287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:04.597305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:04.597529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:04.597699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.597866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.598028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.598242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:04.598282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:04.606250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId: src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:04.609027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:04.609288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.609315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.609373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:04.609472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:04.612590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602107858024535:3836]
2025-10-10T14:37:04.612870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2216, pipe: [1:7559602107858024535:3836]
2025-10-10T14:37:04.612826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024535:3836], now have 1 active actors on pipe
2025-10-10T14:37:04.617715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:04.617738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:04.617741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:04.617743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:04.617756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602107075793634:2658]
2025-10-10T14:37:04.617761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602107075793634:2658]
2025-10-10T14:37:04.617765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602107075793634:2658]
2025-10-10T14:37:04.617825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:04.617832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:04.617834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:04.617836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:04.617842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.617845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:04.618043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:04.740805Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:04.749505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.749534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.749728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.749806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.749880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.749946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.750002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.750008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.750092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.750159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.750235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.750312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.750362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.750365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.750443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.750520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.750593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.750670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.750716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.750719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.750797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.750858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.750931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.751001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.751046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.751049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.751126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.751194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.751265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.751332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.751389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.751392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.751471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.751548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.751617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.751698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.751749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.751767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.751847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.751911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.751977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.752044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.752101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.752104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.752184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.752249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.752318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.752384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.752427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.752442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.752509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.752570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.752640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.752705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.752757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.752760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.752834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.752906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.752975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.753055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.753126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.753129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.754513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:04.755916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:04.755970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2217 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0
2025-10-10T14:37:04.756174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2217 sessionId: src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0 is DEAD
2025-10-10T14:37:04.756297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:04.756340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:04.756352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0] Write session will restart in 0.006554s
2025-10-10T14:37:04.756339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602107858024535:3836]
2025-10-10T14:37:04.756377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0] Write session: Do CDS request
2025-10-10T14:37:04.756385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:04.763848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.765580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:04.765598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2218
2025-10-10T14:37:04.773275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.773355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:04.773362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:04.773367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:04.774627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2218 sessionId:  describe result for acl check
2025-10-10T14:37:04.774670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:04.774677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:04.774678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:04.774684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602107858024604:4020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:04.775948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602107858024604:4020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:04.782012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602107858024604:4020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:04.787779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602107858024604:4020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:04.787800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602107858024604:4020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:04.787804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602107858024604:4020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:04.787813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:04.792700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:04.796252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:04.796737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:04.796751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:04.796769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:04.796846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:04.796894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602107075793987:2637]
2025-10-10T14:37:04.797573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:04.798263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:04.798335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:04.798699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:04.798802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.798810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.798812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.798812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.798813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.798815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.798816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.798818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.798819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.798820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.798821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.798823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.798824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.798830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.798845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.798849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.798854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.798858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.798862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.798866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.798870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.798874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.798878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.798882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.798886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.798889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.798913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.798927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.798935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.798940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.798944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.798948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.798952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.798957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.798962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.798972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.798981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.798986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.798991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.798996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.799005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.799010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.799015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.799021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.799026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.799031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.799036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.799041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.799046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.799051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.799056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.799061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.799103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:04.801541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:04.802303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:04.802317Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:04.802319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:04.802323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:04.802333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2217 [2:7559602107075793987:2637]
2025-10-10T14:37:04.802347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:04.802368Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:04.802376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.802380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.802383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.802402Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:04.802414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:04.802428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:04.802501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.802510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.802511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.802514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:04.802587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:04.802594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.802605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.802623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.802642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:04.802674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602107075793977:2637]
2025-10-10T14:37:04.802681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602107075793977:2637]
2025-10-10T14:37:04.802683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602107075793977:2637]
2025-10-10T14:37:04.802698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:04.802717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:04.802733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:04.802736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:04.802741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:04.802745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:04.802747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:04.802766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602107075793977:2637]
2025-10-10T14:37:04.802775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:04.802824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:04.802874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024819:4020], now have 1 active actors on pipe
2025-10-10T14:37:04.802884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024565:2438], now have 1 active actors on pipe
2025-10-10T14:37:04.803059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2217
2025-10-10T14:37:04.803077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2217
2025-10-10T14:37:04.803471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.803484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.803520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ee59c75-105b5950-a6b27836-9095184b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:04.803534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.803543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.803546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:04.803560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.803575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:04.803597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.805667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.805681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.805706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.805821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2218 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ee59c75-105b5950-a6b27836-9095184b_0
2025-10-10T14:37:04.806258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1185fe2-5a652165-b6bd46f3-4518b851_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ee59c75-105b5950-a6b27836-9095184b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:04.809130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee59c75-105b5950-a6b27836-9095184b_0] Write session: try to update token
2025-10-10T14:37:04.809149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee59c75-105b5950-a6b27836-9095184b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:04.814650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:04.814670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:04.814683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602107075793977:2637]
2025-10-10T14:37:04.814729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:04.814736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:04.814908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:04.815056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.815202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.815346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:04.815543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:04.815588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:04.824720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId: src_id|8ee59c75-105b5950-a6b27836-9095184b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:04.827682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:04.827962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.827993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.828042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:04.828160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:04.833903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:04.833930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:04.833935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:04.833937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:04.833951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602107075793977:2637]
2025-10-10T14:37:04.833956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602107075793977:2637]
2025-10-10T14:37:04.833962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602107075793977:2637]
2025-10-10T14:37:04.834022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:04.834037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.834040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:04.834138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:04.834155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:04.834159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:04.834228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:04.856271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602107858024881:3836]
2025-10-10T14:37:04.856570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2217, pipe: [1:7559602107858024881:3836]
2025-10-10T14:37:04.957277Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:04.967463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.967504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.967731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.967823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.967896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.967972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.968025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.968039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.968120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.968188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.968277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.968364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.968416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.968425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.968508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.968592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.968688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.968784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.968843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.968853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.968946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.969073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.969146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.969225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.969273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.969276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.969416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.969485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.969560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.969650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.969707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.969716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.969796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.969879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.972016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602107858024881:3836]
2025-10-10T14:37:04.972097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:04.972107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:04.972145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2218 reason: error at write: Disconnected sessionId: src_id|8ee59c75-105b5950-a6b27836-9095184b_0
2025-10-10T14:37:04.972345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:04.972531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2218 sessionId: src_id|8ee59c75-105b5950-a6b27836-9095184b_0 is DEAD
2025-10-10T14:37:04.972542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee59c75-105b5950-a6b27836-9095184b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:04.972568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee59c75-105b5950-a6b27836-9095184b_0] Write session will restart in 0.007310s
2025-10-10T14:37:04.972597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee59c75-105b5950-a6b27836-9095184b_0] Write session: Do CDS request
2025-10-10T14:37:04.972605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee59c75-105b5950-a6b27836-9095184b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:04.969962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.970057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.970104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.970108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.970216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.970289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.970396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.970496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.970542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.970545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.970620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.970687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.970763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.970832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.970879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.970882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.970954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.971028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.971110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.971190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.971238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.971243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.971330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:04.971407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:04.971491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:04.971580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:04.971633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:04.971638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:04.971721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024881:3836], now have 1 active actors on pipe
2025-10-10T14:37:04.973153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:04.983251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee59c75-105b5950-a6b27836-9095184b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.983344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:04.983365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2219
2025-10-10T14:37:04.983519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:04.983570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:04.983581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:04.983586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:04.984096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2219 sessionId:  describe result for acl check
2025-10-10T14:37:04.984141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:04.984143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:04.984145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:04.984153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602107858024903:4029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:04.984876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602107858024903:4029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:04.988033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:04.988119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602107858024903:4029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:04.990317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:04.990608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:04.990628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:04.990643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:04.990718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:04.990774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602107075794049:2627]
2025-10-10T14:37:04.991423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:04.991825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:04.991892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:04.991907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602107858024903:4029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:04.991926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602107858024903:4029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:04.991930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602107858024903:4029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:04.991939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:04.992260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:04.992335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.992346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.992347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.992348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.992350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.992351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.992354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.992355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.992356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.992357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.992358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.992359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.992360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.992368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.992382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.992386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.992390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.992394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.992398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.992402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.992405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.992409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.992414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.992418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.992421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.992425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.992434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.992442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:04.992451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.992457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:04.992462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.992468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:04.992472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.992478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:04.992482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.992488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:04.992492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.992498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:04.992504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.992509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:04.992514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.992519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:04.992524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.992529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:04.992533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.992539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:04.992554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.992560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.992563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.992568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.992572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.992577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.992614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:04.995265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:04.995848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:04.995854Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:04.995856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:04.995860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:04.995868Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2218 [2:7559602107075794049:2627]
2025-10-10T14:37:04.995881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:04.995900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:04.995904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.995907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.995910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.995937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:04.995946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:04.995953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:04.996013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.996015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.996018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.996020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:04.996096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:04.996099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:04.996112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:04.996126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:04.996145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:04.996169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024936:4029], now have 1 active actors on pipe
2025-10-10T14:37:04.996173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602107858024886:2438], now have 1 active actors on pipe
2025-10-10T14:37:04.996181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602107075794043:2627]
2025-10-10T14:37:04.996184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602107075794043:2627]
2025-10-10T14:37:04.996186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602107075794043:2627]
2025-10-10T14:37:04.996195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:04.996205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:04.996208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:04.996209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:04.996210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:04.996226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:04.996229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:04.996256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602107075794043:2627]
2025-10-10T14:37:04.996266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:04.996289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:04.996673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2218
2025-10-10T14:37:04.996705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2218
2025-10-10T14:37:04.996774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.996790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.996836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:04.996850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:04.996857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:04.996861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:04.996874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:04.996887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:04.996904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.997083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:04.997099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:04.997122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:04.997218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2219 partition: 0 MaxSeqNo: 40 sessionId: src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0
2025-10-10T14:37:04.998138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ee59c75-105b5950-a6b27836-9095184b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:05.000843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0] Write session: try to update token
2025-10-10T14:37:05.000861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:05.009190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:05.009212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:05.009223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602107075794043:2627]
2025-10-10T14:37:05.009267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:05.009274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:05.009475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:05.009640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:05.009782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:05.009923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:05.010117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:05.010161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:05.028842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:05.028871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:05.028874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:05.028876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:05.028888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602107075794043:2627]
2025-10-10T14:37:05.028893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602107075794043:2627]
2025-10-10T14:37:05.028897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602107075794043:2627]
2025-10-10T14:37:05.028950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:05.028954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:05.028962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.028965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:05.028970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:05.028975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:05.029107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:05.034281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId: src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:05.037083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:05.072358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602112152992241:3836]
2025-10-10T14:37:05.072762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2218, pipe: [1:7559602112152992241:3836]
2025-10-10T14:37:05.151402Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:05.151721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.151752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.151780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992241:3836], now have 1 active actors on pipe
2025-10-10T14:37:05.152005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:05.157494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602112152992241:3836]
2025-10-10T14:37:05.157543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:05.157664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2219 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0
2025-10-10T14:37:05.157877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2219 sessionId: src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0 is DEAD
2025-10-10T14:37:05.158037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:05.158049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0] Write session will restart in 0.008031s
2025-10-10T14:37:05.158076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0] Write session: Do CDS request
2025-10-10T14:37:05.158083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:05.158087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:05.166557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:05.166912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.167024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:05.167043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2220
2025-10-10T14:37:05.167195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.167236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:05.167242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:05.167254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:05.167741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2220 sessionId:  describe result for acl check
2025-10-10T14:37:05.167791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:05.167800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:05.167802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:05.167808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602112152992276:4048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:05.168376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602112152992276:4048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:05.168348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:05.168590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:05.168603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:05.168616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:05.168676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:05.168724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602111370761416:2620]
2025-10-10T14:37:05.169245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:05.169624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:05.169682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:05.170009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:05.170086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.170096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.170098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.170099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.170101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.170103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.170104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.170105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.170107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.170108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.170113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.170114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.170115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.170121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.170132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.170136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.170140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.170144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.170149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.170153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.170157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.170161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.170166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.170170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.170174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.170177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.170185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.170194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.170200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.170206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.170210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.170215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.170220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.170225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.170230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.170235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.170240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.170245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.170251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.170258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.170262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.170269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.170274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.170285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.170290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.170295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.170299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.170309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.170313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.170318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.170327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.170333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.170373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:05.170977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602112152992276:4048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:05.172884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:05.173258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:05.173274Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:05.173277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:05.173282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:05.173288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2219 [2:7559602111370761416:2620]
2025-10-10T14:37:05.173302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:05.173321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:05.173342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.173349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.173351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.173369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:05.173376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:05.173384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:05.173451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.173461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.173463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.173466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:05.173542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:05.173552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.173564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.173576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.173594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:05.173617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992256:2438], now have 1 active actors on pipe
2025-10-10T14:37:05.173631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602111370761411:2620]
2025-10-10T14:37:05.173633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602111370761411:2620]
2025-10-10T14:37:05.173636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602111370761411:2620]
2025-10-10T14:37:05.173652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:05.173671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:05.173687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:05.173694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:05.173664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2219
2025-10-10T14:37:05.173726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602111370761411:2620]
2025-10-10T14:37:05.173736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:05.173791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:05.173802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:05.173804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:05.173811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:05.174079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602112152992276:4048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:05.174094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602112152992276:4048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:05.174098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602112152992276:4048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:05.174107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:05.174347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992312:4048], now have 1 active actors on pipe
2025-10-10T14:37:05.174428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2219
2025-10-10T14:37:05.174485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.174497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.174530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d214262-d60bc8c9-82104adb-79045126_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:05.174545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.174550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.174552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:05.174576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.174595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:05.174615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.174782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.174812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.174844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.174914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2220 partition: 0 MaxSeqNo: 40 sessionId: src_id|9d214262-d60bc8c9-82104adb-79045126_0
2025-10-10T14:37:05.175411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c97f569b-42f9a66e-eca757df-5e239b8e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9d214262-d60bc8c9-82104adb-79045126_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:05.178554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d214262-d60bc8c9-82104adb-79045126_0] Write session: try to update token
2025-10-10T14:37:05.178574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d214262-d60bc8c9-82104adb-79045126_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:05.194298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId: src_id|9d214262-d60bc8c9-82104adb-79045126_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:05.195457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:05.195488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:05.195492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:05.195494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:05.195507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602111370761411:2620]
2025-10-10T14:37:05.195513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602111370761411:2620]
2025-10-10T14:37:05.195519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602111370761411:2620]
2025-10-10T14:37:05.195581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:05.195600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.195606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:05.195609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:05.195613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:05.195618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:05.195830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:05.198024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:05.257697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602112152992317:3836]
2025-10-10T14:37:05.258104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2219, pipe: [1:7559602112152992317:3836]
2025-10-10T14:37:05.314247Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:05.314617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.314627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.314672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992317:3836], now have 1 active actors on pipe
2025-10-10T14:37:05.314954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:05.317606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:05.317678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602112152992317:3836]
2025-10-10T14:37:05.317706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:05.317787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2220 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d214262-d60bc8c9-82104adb-79045126_0
2025-10-10T14:37:05.317980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2220 sessionId: src_id|9d214262-d60bc8c9-82104adb-79045126_0 is DEAD
2025-10-10T14:37:05.318260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d214262-d60bc8c9-82104adb-79045126_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:05.318273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d214262-d60bc8c9-82104adb-79045126_0] Write session will restart in 0.005439s
2025-10-10T14:37:05.318299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d214262-d60bc8c9-82104adb-79045126_0] Write session: Do CDS request
2025-10-10T14:37:05.318305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d214262-d60bc8c9-82104adb-79045126_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:05.325805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d214262-d60bc8c9-82104adb-79045126_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.327652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:05.327858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:05.327877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2221
2025-10-10T14:37:05.328084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.328132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:05.328143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:05.328147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:05.328635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2221 sessionId:  describe result for acl check
2025-10-10T14:37:05.328671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:05.328679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:05.328681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:05.328687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602112152992339:4054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:05.329318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602112152992339:4054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:05.329315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:05.329560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:05.329565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:05.329580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:05.329645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:05.329702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602111370761475:2618]
2025-10-10T14:37:05.330383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:05.330752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:05.330811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:05.331169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:05.331244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.331251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.331252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.331254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.331256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.331257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.331259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.331260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.331262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.331263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.331265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.331266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.331267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.331277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.331290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.331295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.331299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.331303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.331307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.331311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.331315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.331319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.331324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.331329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.331333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.331337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.331346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.331361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.331372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.331378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.331382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.331392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.331397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.331402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.331410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.331415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.331419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.331425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.331434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.331440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.331448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.331454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.331459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.331464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.331469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.331474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.331483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.331488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.331493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.331513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.331521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.331527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.331568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:05.333006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602112152992339:4054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:05.334318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:05.334713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:05.334726Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:05.334729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:05.334733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:05.334739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2220 [2:7559602111370761475:2618]
2025-10-10T14:37:05.334754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:05.334774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:05.334782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.334786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.334788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.334807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:05.334819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:05.334828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:05.334894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.334901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.334903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.334906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:05.334978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:05.334985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.334997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.335011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.335032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:05.335054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992319:2438], now have 1 active actors on pipe
2025-10-10T14:37:05.335063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602111370761470:2618]
2025-10-10T14:37:05.335075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602111370761470:2618]
2025-10-10T14:37:05.335082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602111370761470:2618]
2025-10-10T14:37:05.335096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:05.335115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:05.335119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:05.335123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:05.335125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:05.335135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:05.335137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:05.335168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602111370761470:2618]
2025-10-10T14:37:05.335176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:05.335178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:05.335151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2220
2025-10-10T14:37:05.341455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602112152992339:4054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:05.341479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602112152992339:4054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:05.341483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602112152992339:4054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:05.341494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:05.341805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992377:4054], now have 1 active actors on pipe
2025-10-10T14:37:05.341845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2220
2025-10-10T14:37:05.341922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.341936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.341972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:05.341993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.341999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.342002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:05.342018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.342040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:05.342071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.342292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.342304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.342329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.342413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2221 partition: 0 MaxSeqNo: 40 sessionId: src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0
2025-10-10T14:37:05.342816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d214262-d60bc8c9-82104adb-79045126_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:05.345846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0] Write session: try to update token
2025-10-10T14:37:05.345865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:05.348113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:05.348133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:05.348147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602111370761470:2618]
2025-10-10T14:37:05.348199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:05.348226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:05.348409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:05.348570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:05.348720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:05.348878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:05.349087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:05.349127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:05.367778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:05.367801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:05.367804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:05.367806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:05.367817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602111370761470:2618]
2025-10-10T14:37:05.367822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602111370761470:2618]
2025-10-10T14:37:05.367827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602111370761470:2618]
2025-10-10T14:37:05.367877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:05.367880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:05.367887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:05.367892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:05.367892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.367895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:05.368057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:05.368170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId: src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:05.371027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:05.417943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602112152992381:3836]
2025-10-10T14:37:05.418285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2220, pipe: [1:7559602112152992381:3836]
2025-10-10T14:37:05.486398Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:05.486728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.486739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.486766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992381:3836], now have 1 active actors on pipe
2025-10-10T14:37:05.487035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:05.487463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:05.487569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2221 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0
2025-10-10T14:37:05.487982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:05.487995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0] Write session will restart in 0.008573s
2025-10-10T14:37:05.488036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0] Write session: Do CDS request
2025-10-10T14:37:05.488042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:05.487813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2221 sessionId: src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0 is DEAD
2025-10-10T14:37:05.488044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:05.488100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602112152992381:3836]
2025-10-10T14:37:05.497991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.501377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:05.501405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2222
2025-10-10T14:37:05.503720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:05.505469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.505530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:05.505537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:05.505542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:05.505939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:05.506178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:05.506191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:05.506204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:05.506266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:05.506311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602111370761536:2601]
2025-10-10T14:37:05.506902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:05.506398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2222 sessionId:  describe result for acl check
2025-10-10T14:37:05.506436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:05.506440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:05.506442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:05.506447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602112152992407:4065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:05.507024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602112152992407:4065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:05.507443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:05.507506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:05.507857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:05.507923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.507930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.507932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.507935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.507936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.507938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.507939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.507940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.507942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.507943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.507944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.507946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.507947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.507953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.507965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.507969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.507973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.507977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.507982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.507986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.507989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.507993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.507998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.508002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.508006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.508009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.508016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.508025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.508033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.508039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.508044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.508049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.508054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.508059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.508064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.508070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.508075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.508080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.508084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.508089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.508094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.508097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.508100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.508103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.508105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.508108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.508111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.508116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.508123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.508127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.508138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.508143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.508190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:05.510466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602112152992407:4065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:05.511311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:05.511707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:05.511723Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:05.511725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:05.511730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:05.511752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2221 [2:7559602111370761536:2601]
2025-10-10T14:37:05.511766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:05.511785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:05.511796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.511799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.511804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.511824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:05.511836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:05.511849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:05.511922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.511934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.511936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.511938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:05.512008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:05.512016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.512030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.512044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.512060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:05.512090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992383:2438], now have 1 active actors on pipe
2025-10-10T14:37:05.512101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602111370761531:2601]
2025-10-10T14:37:05.512108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602111370761531:2601]
2025-10-10T14:37:05.512110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602111370761531:2601]
2025-10-10T14:37:05.512124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:05.512138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:05.512160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:05.512167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:05.512196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602111370761531:2601]
2025-10-10T14:37:05.512177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2221
2025-10-10T14:37:05.512203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:05.512362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:05.512374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:05.512376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:05.512383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:05.517396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602112152992407:4065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:05.517416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602112152992407:4065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:05.517421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602112152992407:4065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:05.517430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:05.517927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2221
2025-10-10T14:37:05.521384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992444:4065], now have 1 active actors on pipe
2025-10-10T14:37:05.521433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.521443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.521485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:05.521508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.521515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.521521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:05.521539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.521565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:05.521592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.521988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.522003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.522037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.522251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2222 partition: 0 MaxSeqNo: 40 sessionId: src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0
2025-10-10T14:37:05.523452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd01adcd-20af85c-c1a7d2e3-fe1b0544_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:05.526395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0] Write session: try to update token
2025-10-10T14:37:05.526416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:05.534401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:05.534423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:05.534427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:05.534429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:05.534445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602111370761531:2601]
2025-10-10T14:37:05.534450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602111370761531:2601]
2025-10-10T14:37:05.534454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602111370761531:2601]
2025-10-10T14:37:05.534517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:05.534531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.534533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:05.534675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:05.537040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:05.537049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:05.537054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:05.546090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId: src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:05.548836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:05.583840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602112152992447:3836]
2025-10-10T14:37:05.584161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2221, pipe: [1:7559602112152992447:3836]
2025-10-10T14:37:05.653279Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:05.653663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.653679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.653705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992447:3836], now have 1 active actors on pipe
2025-10-10T14:37:05.654090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:05.654680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:05.654692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0] Write session will restart in 0.007338s
2025-10-10T14:37:05.654717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0] Write session: Do CDS request
2025-10-10T14:37:05.654722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:05.654021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602112152992447:3836]
2025-10-10T14:37:05.654064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:05.654106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:05.654109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:05.654179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2222 reason: error at write: Disconnected sessionId: src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0
2025-10-10T14:37:05.654379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2222 sessionId: src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0 is DEAD
2025-10-10T14:37:05.662928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.665486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:05.665506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2223
2025-10-10T14:37:05.669526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.669600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:05.669606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:05.669611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:05.670249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2223 sessionId:  describe result for acl check
2025-10-10T14:37:05.670295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:05.670297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:05.670299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:05.670307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602112152992465:4073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:05.670934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602112152992465:4073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:05.673797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602112152992465:4073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:05.677069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:05.679099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:05.679313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:05.679331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:05.679344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:05.679402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:05.679439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602111370761597:2613]
2025-10-10T14:37:05.680073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:05.680370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:05.680417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:05.680736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:05.680790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.680792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.680793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.680796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.680798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.680799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.680800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.680802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.680803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.680804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.680805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.680806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.680807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.680812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.680824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.680827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.680830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.680834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.680838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.680841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.680845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.680849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.680853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.680857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.680861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.680865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.680873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.680882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.680888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.680894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.680899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.680904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.680908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.680913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.680921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.680926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.680930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.680935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.680940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.680946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.680951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.680956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.680960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.680966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.680970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.680975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.680980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.680986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.680990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.680995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.680999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.681004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.681044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:05.679594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602112152992465:4073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:05.679612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602112152992465:4073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:05.679616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602112152992465:4073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:05.679627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:05.684066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:05.684430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:05.684435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:05.684438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:05.684442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:05.684449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2222 [2:7559602111370761597:2613]
2025-10-10T14:37:05.684462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:05.684479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:05.684483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.684488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.684491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.684510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:05.684517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:05.684525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:05.684584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.684586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.684589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.684591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:05.684667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:05.684670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.684683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.684695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.684712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:05.684752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602111370761592:2613]
2025-10-10T14:37:05.684753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602111370761592:2613]
2025-10-10T14:37:05.684755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602111370761592:2613]
2025-10-10T14:37:05.684770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:05.684785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:05.684800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:05.684804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:05.684839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602111370761592:2613]
2025-10-10T14:37:05.684842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:05.685256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:05.685264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:05.685266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:05.685273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:05.685752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992501:4073], now have 1 active actors on pipe
2025-10-10T14:37:05.685763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992449:2438], now have 1 active actors on pipe
2025-10-10T14:37:05.686167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.686193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.686236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:05.686245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.686249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.686253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:05.686265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.686278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:05.686296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.685932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2222
2025-10-10T14:37:05.685963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2222
2025-10-10T14:37:05.690534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.690552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.690591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.691218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ffed60a-c1ae71a0-cd1c29f6-27c60132_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:05.690787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2223 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0
2025-10-10T14:37:05.694222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0] Write session: try to update token
2025-10-10T14:37:05.694245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:05.724845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:05.724868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:05.724872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:05.724874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:05.724884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602111370761592:2613]
2025-10-10T14:37:05.724889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602111370761592:2613]
2025-10-10T14:37:05.724894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602111370761592:2613]
2025-10-10T14:37:05.724949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:05.724957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.724960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:05.724959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:05.724966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:05.724971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:05.725102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:05.723970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId: src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:05.727255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:05.755023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602112152992520:3836]
2025-10-10T14:37:05.755382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2222, pipe: [1:7559602112152992520:3836]
2025-10-10T14:37:05.842792Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:05.843102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.843119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.843166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992520:3836], now have 1 active actors on pipe
2025-10-10T14:37:05.843417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:05.843416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602112152992520:3836]
2025-10-10T14:37:05.843433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:05.843438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:05.843451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:05.843511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2223 reason: error at write: Disconnected sessionId: src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0
2025-10-10T14:37:05.843745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2223 sessionId: src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0 is DEAD
2025-10-10T14:37:05.843922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:05.843941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0] Write session will restart in 0.009028s
2025-10-10T14:37:05.843969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0] Write session: Do CDS request
2025-10-10T14:37:05.843975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:05.851963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:05.853727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:05.853966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.853944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:05.853960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:05.853973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:05.854037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:05.854077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:05.854092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2224
2025-10-10T14:37:05.854085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602111370761695:2590]
2025-10-10T14:37:05.854240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:05.854282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:05.854301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:05.854305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:05.854724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:05.854805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2224 sessionId:  describe result for acl check
2025-10-10T14:37:05.854845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:05.854847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:05.854849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:05.854855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602112152992576:4089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:05.855033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:05.855084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:05.855420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:05.855494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.855473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602112152992576:4089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:05.855501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.855502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.855503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.855504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.855506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.855507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.855508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.855509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.855510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.855512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.855513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.855514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.855519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.855530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.855534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.855537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.855542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.855546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.855550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.855554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.855557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.855561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.855566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.855570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.855574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.855580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.855589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:05.855595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.855601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:05.855605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.855611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:05.855616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.855621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:05.855625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.855631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:05.855635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.855640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:05.855645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.855650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:05.855654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.855664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:05.855668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.855674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:05.855683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.855688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:05.855691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.855697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.855708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.855713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.855721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.855726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.855777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:05.857729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602112152992576:4089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:05.858191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:05.858541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:05.858550Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:05.858552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:05.858556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:05.858562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2223 [2:7559602111370761695:2590]
2025-10-10T14:37:05.858573Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:05.858597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:05.858607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.858611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.858613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.858628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:05.858635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:05.858644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:05.858699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.858706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.858708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.858711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:05.858780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:05.858788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.858799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:05.858814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:05.858832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:05.858857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992552:2438], now have 1 active actors on pipe
2025-10-10T14:37:05.858869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602111370761690:2590]
2025-10-10T14:37:05.858875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602111370761690:2590]
2025-10-10T14:37:05.858877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602111370761690:2590]
2025-10-10T14:37:05.858891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:05.858905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:05.858908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:05.858909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:05.858910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:05.858927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:05.858930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:05.858911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2223
2025-10-10T14:37:05.858957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602111370761690:2590]
2025-10-10T14:37:05.858975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:05.858980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:05.863620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602112152992576:4089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:05.863633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602112152992576:4089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:05.863637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602112152992576:4089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:05.863649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:05.863903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992611:4089], now have 1 active actors on pipe
2025-10-10T14:37:05.863958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2223
2025-10-10T14:37:05.864021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.864036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.864069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:05.864087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:05.864098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:05.864101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:05.864116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:05.864139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:05.864165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.864503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.864518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.864542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:05.864652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2224 partition: 0 MaxSeqNo: 40 sessionId: src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0
2025-10-10T14:37:05.865058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4539da-df20d723-18b0fbe6-5ea0996d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:05.867763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0] Write session: try to update token
2025-10-10T14:37:05.867782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:05.879924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:05.879946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:05.879950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:05.879952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:05.879964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602111370761690:2590]
2025-10-10T14:37:05.879971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602111370761690:2590]
2025-10-10T14:37:05.879975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602111370761690:2590]
2025-10-10T14:37:05.880025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:05.880035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:05.880037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:05.880040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:05.880043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:05.880047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:05.880176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:05.883622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId: src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:05.886331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:05.943779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602112152992614:3836]
2025-10-10T14:37:05.944102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2223, pipe: [1:7559602112152992614:3836]
2025-10-10T14:37:05.999328Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:05.999644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:05.999660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:05.999709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602112152992614:3836], now have 1 active actors on pipe
2025-10-10T14:37:05.999998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:06.000069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602112152992614:3836]
2025-10-10T14:37:06.000106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:06.000246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2224 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0
2025-10-10T14:37:05.999989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:06.000642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:06.000666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0] Write session will restart in 0.005693s
2025-10-10T14:37:06.000690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0] Write session: Do CDS request
2025-10-10T14:37:06.000697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:06.000505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2224 sessionId: src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0 is DEAD
2025-10-10T14:37:06.007908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.008307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:06.008324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2225
2025-10-10T14:37:06.008469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.008510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:06.008516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:06.008520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:06.008974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2225 sessionId:  describe result for acl check
2025-10-10T14:37:06.009013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:06.009015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:06.009017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:06.009024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602116447959939:4100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:06.009119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:06.009634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602116447959939:4100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:06.011022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:06.011241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:06.011253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:06.011265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:06.011966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602116447959939:4100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:06.011335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:06.011382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602115665729053:2588]
2025-10-10T14:37:06.012038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:06.012317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:06.012379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:06.012738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:06.012824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.012831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.012833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.012834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.012835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.012836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.012838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.012839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.012840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.012844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.012846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.012847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.012848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.012855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.012869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.012873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.012877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.012881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.012885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.012889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.012893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.012897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.012901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.012904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.012908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.012912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.012920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.012929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.012941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.012946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.012955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.012960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.012963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.012968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.012974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.012983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.012987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.012992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.013002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.013007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.013012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.013022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.013027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.013052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.013062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.013067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.013073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.013079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.013084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.013094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.013099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.013109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.013168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:06.015688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602116447959939:4100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:06.015706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602116447959939:4100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:06.015710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602116447959939:4100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:06.015720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:06.015735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:06.016084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:06.016103Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:06.016106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:06.016112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:06.016118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2224 [2:7559602115665729053:2588]
2025-10-10T14:37:06.016133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:06.016151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:06.016155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.016159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.016162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.016179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:06.016188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:06.016197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:06.016260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.016275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.016277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.016280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:06.016353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:06.016362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.016373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.016391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.016413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:06.016442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447959970:4100], now have 1 active actors on pipe
2025-10-10T14:37:06.016451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447959915:2438], now have 1 active actors on pipe
2025-10-10T14:37:06.016460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602115665729048:2588]
2025-10-10T14:37:06.016463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602115665729048:2588]
2025-10-10T14:37:06.016465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602115665729048:2588]
2025-10-10T14:37:06.016479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:06.016463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2224
2025-10-10T14:37:06.016500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2224
2025-10-10T14:37:06.016499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:06.016511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:06.016514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:06.016516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:06.016522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:06.016525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:06.016550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602115665729048:2588]
2025-10-10T14:37:06.016563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:06.016577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:06.016580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.016585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.016637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e773ddc2-ecd4ba44-4048b274-30698299_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:06.016650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.016654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.016662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:06.016673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.016684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:06.016714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.016883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.016891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.016907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.016984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2225 partition: 0 MaxSeqNo: 40 sessionId: src_id|e773ddc2-ecd4ba44-4048b274-30698299_0
2025-10-10T14:37:06.017427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d094b00b-ade93a25-566fc5fd-7ba928a6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e773ddc2-ecd4ba44-4048b274-30698299_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:06.020273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e773ddc2-ecd4ba44-4048b274-30698299_0] Write session: try to update token
2025-10-10T14:37:06.020294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e773ddc2-ecd4ba44-4048b274-30698299_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:06.038352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId: src_id|e773ddc2-ecd4ba44-4048b274-30698299_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:06.039633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:06.039656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:06.039663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:06.039665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:06.039676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602115665729048:2588]
2025-10-10T14:37:06.039680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602115665729048:2588]
2025-10-10T14:37:06.039684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602115665729048:2588]
2025-10-10T14:37:06.039751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:06.039761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.039764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:06.039928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:06.041291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:06.041492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:06.041511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:06.041516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:06.100444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602116447959978:3836]
2025-10-10T14:37:06.101858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2224, pipe: [1:7559602116447959978:3836]
2025-10-10T14:37:06.162295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:06.162737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.162749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.162801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447959978:3836], now have 1 active actors on pipe
2025-10-10T14:37:06.163899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:06.163977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602116447959978:3836]
2025-10-10T14:37:06.163349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:06.164004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:06.164012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:06.164072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2225 reason: error at write: Disconnected sessionId: src_id|e773ddc2-ecd4ba44-4048b274-30698299_0
2025-10-10T14:37:06.164269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2225 sessionId: src_id|e773ddc2-ecd4ba44-4048b274-30698299_0 is DEAD
2025-10-10T14:37:06.165464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e773ddc2-ecd4ba44-4048b274-30698299_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:06.165476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e773ddc2-ecd4ba44-4048b274-30698299_0] Write session will restart in 0.005123s
2025-10-10T14:37:06.165501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e773ddc2-ecd4ba44-4048b274-30698299_0] Write session: Do CDS request
2025-10-10T14:37:06.165510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e773ddc2-ecd4ba44-4048b274-30698299_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:06.171988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e773ddc2-ecd4ba44-4048b274-30698299_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.172457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:06.172481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2226
2025-10-10T14:37:06.172641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.172690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:06.172696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:06.172710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:06.173378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2226 sessionId:  describe result for acl check
2025-10-10T14:37:06.173418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:06.173420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:06.173422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:06.173428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602116447960016:4117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:06.173996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602116447960016:4117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:06.177556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:06.178394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:06.178545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:06.178549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:06.178557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:06.178593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:06.178621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602115665729131:2584]
2025-10-10T14:37:06.179052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:06.179691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602116447960016:4117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:06.180428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:06.180472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:06.180710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:06.180754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.180759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.180760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.180760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.180761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.180762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.180762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.180763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.180764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.180765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.180766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.180766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.180767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.180772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.180781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.180783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.180786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.180788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.180790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.180793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.180795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.180797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.180800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.180803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.180806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.180808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.180815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.180820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.180824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.180828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.180831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.180836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.180838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.180842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.180845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.180848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.180850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.180854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.180857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.180861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.180864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.180867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.180870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.180873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.180875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.180878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.180881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.180885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.180888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.180891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.180893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.180897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.180935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:06.184117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:06.184062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602116447960016:4117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:06.184082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602116447960016:4117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:06.184087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602116447960016:4117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:06.184097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:06.184576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:06.184600Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:06.184603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:06.184607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:06.184614Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2225 [2:7559602115665729131:2584]
2025-10-10T14:37:06.184629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:06.184653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:06.184656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.184660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.184669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.184689Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:06.184701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:06.184712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:06.184774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.184783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.184786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.184788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:06.184871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:06.184878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.184890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.184903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.184926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:06.184955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447959993:2438], now have 1 active actors on pipe
2025-10-10T14:37:06.184966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960052:4117], now have 1 active actors on pipe
2025-10-10T14:37:06.184974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602115665729125:2584]
2025-10-10T14:37:06.184979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602115665729125:2584]
2025-10-10T14:37:06.184981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602115665729125:2584]
2025-10-10T14:37:06.184998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:06.185015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:06.185025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2225
2025-10-10T14:37:06.185029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2225
2025-10-10T14:37:06.185026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:06.185030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:06.185032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:06.185043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:06.185047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:06.185079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602115665729125:2584]
2025-10-10T14:37:06.185089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:06.185097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:06.185130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.185148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.185189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:06.185204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.185209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.185212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:06.185224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.185237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:06.185258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.185499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.185514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.185539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.185734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2226 partition: 0 MaxSeqNo: 40 sessionId: src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0
2025-10-10T14:37:06.190328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e773ddc2-ecd4ba44-4048b274-30698299_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:06.193239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0] Write session: try to update token
2025-10-10T14:37:06.193263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:06.224015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:06.224039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:06.224043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:06.224045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:06.224056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602115665729125:2584]
2025-10-10T14:37:06.224060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602115665729125:2584]
2025-10-10T14:37:06.224064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602115665729125:2584]
2025-10-10T14:37:06.224117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:06.224124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.224127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:06.224274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:06.225488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:06.225505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:06.225510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:06.229376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId: src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:06.232108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:06.265434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602116447960060:3836]
2025-10-10T14:37:06.265762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2225, pipe: [1:7559602116447960060:3836]
2025-10-10T14:37:06.350343Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:06.350799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.350816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.350866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960060:3836], now have 1 active actors on pipe
2025-10-10T14:37:06.351109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:06.351135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:06.351138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:06.351154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:06.351188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602116447960060:3836]
2025-10-10T14:37:06.351229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2226 reason: error at write: Disconnected sessionId: src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0
2025-10-10T14:37:06.351634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:06.351653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0] Write session will restart in 0.007189s
2025-10-10T14:37:06.351468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2226 sessionId: src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0 is DEAD
2025-10-10T14:37:06.351679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0] Write session: Do CDS request
2025-10-10T14:37:06.351686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:06.359924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.360003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:06.360023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2227
2025-10-10T14:37:06.360260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.360300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:06.360312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:06.360317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:06.360793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:06.360835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2227 sessionId:  describe result for acl check
2025-10-10T14:37:06.360872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:06.360879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:06.360881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:06.360887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602116447960092:4130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:06.361492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602116447960092:4130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:06.362807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:06.363016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:06.363043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:06.363055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:06.363107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:06.363150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602115665729194:2583]
2025-10-10T14:37:06.363516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602116447960092:4130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:06.363807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:06.364089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:06.364135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:06.364471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:06.364530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.364531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.364532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.364534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.364535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.364536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.364537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.364538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.364540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.364541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.364542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.364543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.364544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.364549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.364563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.364567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.364570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.364574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.364578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.364582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.364586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.364589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.364594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.364598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.364601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.364605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.364613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.364623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.364629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.364634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.364638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.364643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.364648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.364653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.364657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.364662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.364666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.364671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.364675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.364680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.364684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.364689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.364693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.364703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.364707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.364712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.364716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.364727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.364731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.364737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.364746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.364751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.364787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:06.367446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602116447960092:4130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:06.367465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602116447960092:4130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:06.367468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602116447960092:4130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:06.367478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:06.367496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:06.367971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:06.367984Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:06.367987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:06.367991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:06.368006Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2226 [2:7559602115665729194:2583]
2025-10-10T14:37:06.368021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:06.368040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:06.368047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.368051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.368053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.368070Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:06.368081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:06.368088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:06.368161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.368168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.368170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.368173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:06.368243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:06.368250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.368262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.368278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.368300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:06.368327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960066:2438], now have 1 active actors on pipe
2025-10-10T14:37:06.368335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960127:4130], now have 1 active actors on pipe
2025-10-10T14:37:06.368344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602115665729189:2583]
2025-10-10T14:37:06.368346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602115665729189:2583]
2025-10-10T14:37:06.368348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602115665729189:2583]
2025-10-10T14:37:06.368345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2226
2025-10-10T14:37:06.368365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:06.368351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2226
2025-10-10T14:37:06.368382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:06.368385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:06.368387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:06.368389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:06.368403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:06.368406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:06.368453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.368461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.368476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602115665729189:2583]
2025-10-10T14:37:06.368487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:06.368495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:06.368519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:06.368532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.368535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.368538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:06.368548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.368558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:06.368580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.368745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.368759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.368785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.368880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2227 partition: 0 MaxSeqNo: 40 sessionId: src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0
2025-10-10T14:37:06.369235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1da612c-480b9b85-b6f23a78-277c8cee_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:06.372040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0] Write session: try to update token
2025-10-10T14:37:06.372060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:06.390608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:06.390629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:06.390634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:06.390636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:06.390648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602115665729189:2583]
2025-10-10T14:37:06.390654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602115665729189:2583]
2025-10-10T14:37:06.390659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602115665729189:2583]
2025-10-10T14:37:06.390719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:06.390731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.390733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:06.390919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:06.388888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId: src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:06.392042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:06.392251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:06.392262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:06.392270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:06.451154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602116447960134:3836]
2025-10-10T14:37:06.453444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2226, pipe: [1:7559602116447960134:3836]
2025-10-10T14:37:06.507205Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:06.507480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.507497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.507554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960134:3836], now have 1 active actors on pipe
2025-10-10T14:37:06.507836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602116447960134:3836]
2025-10-10T14:37:06.507875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:06.507914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:06.507922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:06.507983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2227 reason: error at write: Disconnected sessionId: src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0
2025-10-10T14:37:06.508192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2227 sessionId: src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0 is DEAD
2025-10-10T14:37:06.507809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:06.508529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:06.508541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0] Write session will restart in 0.009058s
2025-10-10T14:37:06.508566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0] Write session: Do CDS request
2025-10-10T14:37:06.508587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:06.518991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.519861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:06.519886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2228
2025-10-10T14:37:06.520160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.520212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:06.520236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:06.520247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:06.519595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:06.521115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2228 sessionId:  describe result for acl check
2025-10-10T14:37:06.521155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:06.521157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:06.521158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:06.521165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602116447960165:4133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:06.521594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:06.521814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:06.521820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:06.521831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:06.521889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:06.521927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602115665729260:2580]
2025-10-10T14:37:06.521753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602116447960165:4133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:06.522558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:06.523183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:06.523256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:06.523613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:06.523685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.523692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.523693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.523694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.523696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.523697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.523698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.523700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.523701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.523702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.523703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.523704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.523705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.523711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.523736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.523739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.523743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.523747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.523750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.523754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.523757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.523760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.523766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.523785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.523788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.523792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.523800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.523807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.523813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.523818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.523822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.523827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.523831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.523836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.523839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.523843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.523847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.523851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.523856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.523861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.523864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.523869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.523873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.523877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.523880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.523884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.523888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.523892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.523897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.523902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.523906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.523914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.523956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:06.524341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602116447960165:4133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:06.528106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602116447960165:4133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:06.528128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602116447960165:4133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:06.528132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602116447960165:4133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:06.528141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:06.528211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:06.528553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:06.528566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:06.528569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:06.528573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:06.528580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2227 [2:7559602115665729260:2580]
2025-10-10T14:37:06.528596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:06.528616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:06.528620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.528625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.528628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.528646Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:06.528653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:06.528663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:06.528728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.528736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.528738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.528741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:06.528808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:06.528815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.528827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.528837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.528854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:06.528888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602115665729254:2580]
2025-10-10T14:37:06.528897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602115665729254:2580]
2025-10-10T14:37:06.528900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602115665729254:2580]
2025-10-10T14:37:06.528915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:06.528932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:06.528939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960136:2438], now have 1 active actors on pipe
2025-10-10T14:37:06.528942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:06.528945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:06.528947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:06.528965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:06.528968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:06.528973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2227
2025-10-10T14:37:06.529006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602115665729254:2580]
2025-10-10T14:37:06.529015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:06.529017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:06.529045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960198:4133], now have 1 active actors on pipe
2025-10-10T14:37:06.529181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2227
2025-10-10T14:37:06.529266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.529278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.529326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:06.529354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.529360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.529362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:06.529375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.529388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:06.529420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.530557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.530570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.530605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.530685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2228 partition: 0 MaxSeqNo: 40 sessionId: src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0
2025-10-10T14:37:06.531108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e6ec87-bfdc3a50-4a3b6360-3a0284bc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:06.534021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0] Write session: try to update token
2025-10-10T14:37:06.534045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:06.541661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:06.541681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:06.541693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602115665729254:2580]
2025-10-10T14:37:06.541744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:06.541756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:06.541979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:06.542169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:06.542337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:06.542505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:06.542752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:06.542811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:06.549570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId: src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:06.552295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:06.552505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.552525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.552569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:06.552647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:06.559942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:06.559961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:06.559965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:06.559966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:06.559979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602115665729254:2580]
2025-10-10T14:37:06.559983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602115665729254:2580]
2025-10-10T14:37:06.559987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602115665729254:2580]
2025-10-10T14:37:06.560043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:06.560049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:06.560056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.560056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:06.560058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:06.560062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:06.560212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:06.607951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602116447960205:3836]
2025-10-10T14:37:06.608411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2227, pipe: [1:7559602116447960205:3836]
2025-10-10T14:37:06.678578Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:06.686489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.686520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.686701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.686765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.686829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.686898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.686944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.686958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.687027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.687094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.687160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.687221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.687266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.687273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.687343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.687412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.687483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.687548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.687593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.687601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.687666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.687750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.687813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.687875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.687918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.687926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.688001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.688061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.688125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.688190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.688233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.688240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.688311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.688376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.688441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.688504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.688549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.688559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.688634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.688699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.688774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.688842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.688888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.688895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.688969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.689032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.689102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.689177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.689223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.689232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.689303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.689384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.689458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.689524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.689578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.689585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.689663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:06.689737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:06.689852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:06.689954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:06.690000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:06.690008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:06.690072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960205:3836], now have 1 active actors on pipe
2025-10-10T14:37:06.690387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:06.690452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602116447960205:3836]
2025-10-10T14:37:06.690503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:06.690508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:06.690540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2228 reason: error at write: Disconnected sessionId: src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0
2025-10-10T14:37:06.690773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2228 sessionId: src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0 is DEAD
2025-10-10T14:37:06.690963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:06.690973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0] Write session will restart in 0.006393s
2025-10-10T14:37:06.691007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0] Write session: Do CDS request
2025-10-10T14:37:06.691014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:06.691188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:06.698928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.698968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:06.698986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2229
2025-10-10T14:37:06.699173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.699220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:06.699232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:06.699247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:06.699706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2229 sessionId:  describe result for acl check
2025-10-10T14:37:06.699767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:06.699774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:06.699776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:06.699793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602116447960236:4145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:06.700083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:06.700404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602116447960236:4145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:06.701816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:06.702036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:06.702048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:06.702063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:06.702136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:06.702187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602115665729325:2578]
2025-10-10T14:37:06.702778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:06.703159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:06.703218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:06.703558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:06.703642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.703649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.703650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.703652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.703653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.703656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.703657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.703658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.703660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.703661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.703662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.703663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.703664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.703671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.703684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.703687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.703692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.703695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.703700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.703704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.703723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.703727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.703731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.703735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.703739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.703743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.703752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.703760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.703766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.703778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.703783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.703793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.703797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.703802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.703811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.703817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.703821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.703831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.703836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.703845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.703849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.703854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.703863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.703870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.703879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.703883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.703887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.703892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.703896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.703901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.703905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.703909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.703947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:06.703971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602116447960236:4145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:06.706798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:06.707072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602116447960236:4145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:06.707090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602116447960236:4145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:06.707094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602116447960236:4145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:06.707103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:06.707156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:06.707167Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:06.707169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:06.707173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:06.707180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2228 [2:7559602115665729325:2578]
2025-10-10T14:37:06.707197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:06.707233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:06.707240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.707244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.707246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.707265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:06.707277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:06.707288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:06.707347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.707354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.707356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.707359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:06.707422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:06.707429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.707442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.707456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.707476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:06.707503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960208:2438], now have 1 active actors on pipe
2025-10-10T14:37:06.707511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960271:4145], now have 1 active actors on pipe
2025-10-10T14:37:06.707519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602115665729320:2578]
2025-10-10T14:37:06.707525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602115665729320:2578]
2025-10-10T14:37:06.707527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602115665729320:2578]
2025-10-10T14:37:06.707542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:06.707563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:06.707545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2228
2025-10-10T14:37:06.707556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2228
2025-10-10T14:37:06.707577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:06.707582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:06.707586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:06.707586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:06.707589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:06.707621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602115665729320:2578]
2025-10-10T14:37:06.707633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:06.707654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:06.707807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.707820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.707851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:06.707865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.707874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.707876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:06.707890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.707903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:06.707923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.708106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.708115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.708132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.708224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2229 partition: 0 MaxSeqNo: 40 sessionId: src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0
2025-10-10T14:37:06.708650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cab5c9-a3ee8942-a139f6cd-47262eb5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:06.711438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0] Write session: try to update token
2025-10-10T14:37:06.711457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:06.727971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId: src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:06.730575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:06.732437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.732460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.732486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:06.732490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:06.732494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:06.732496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:06.732505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602115665729320:2578]
2025-10-10T14:37:06.732512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602115665729320:2578]
2025-10-10T14:37:06.732518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602115665729320:2578]
2025-10-10T14:37:06.732565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:06.732579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:06.732583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:06.732587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:06.732594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.732596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:06.732741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:06.795622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602116447960284:3836]
2025-10-10T14:37:06.796136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2228, pipe: [1:7559602116447960284:3836]
2025-10-10T14:37:06.853867Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:06.854133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:06.854191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960284:3836], now have 1 active actors on pipe
2025-10-10T14:37:06.854269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:06.867378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602116447960284:3836]
2025-10-10T14:37:06.867493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:06.867500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:06.867527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2229 reason: error at write: Disconnected sessionId: src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0
2025-10-10T14:37:06.867690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2229 sessionId: src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0 is DEAD
2025-10-10T14:37:06.867880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:06.873438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:06.873455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0] Write session will restart in 0.007635s
2025-10-10T14:37:06.873481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0] Write session: Do CDS request
2025-10-10T14:37:06.873488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:06.881973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.882102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:06.882124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2230
2025-10-10T14:37:06.882279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:06.882327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:06.882339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:06.882346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:06.882827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2230 sessionId:  describe result for acl check
2025-10-10T14:37:06.882864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:06.882871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:06.882873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:06.882880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602116447960317:4166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:06.883504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602116447960317:4166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:06.886608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:06.888309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602116447960317:4166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:06.888384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:06.888613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:06.888624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:06.888636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:06.888692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:06.888739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602115665729425:2557]
2025-10-10T14:37:06.889424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:06.889807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:06.889867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:06.890223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:06.890308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.890314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.890315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.890316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.890318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.890319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.890321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.890322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.890323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.890324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.890326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.890327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.890328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.890336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.890348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.890352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.890356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.890360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.890364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.890368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.890371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.890376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.890381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.890385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.890388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.890392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.890399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.890408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:06.890415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.890422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:06.890427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.890432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:06.890437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.890442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:06.890447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.890452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:06.890456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.890461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:06.890465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.890478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:06.890482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.890488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:06.890492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.890497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:06.890503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.890508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:06.890512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.890517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.890521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.890526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.890530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.890534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.890575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:06.893069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602116447960317:4166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:06.893087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602116447960317:4166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:06.893091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602116447960317:4166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:06.893100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:06.893023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:06.895087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:06.895108Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:06.895111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:06.895115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:06.895123Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2229 [2:7559602115665729425:2557]
2025-10-10T14:37:06.895138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:06.895155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:06.895160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.895164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.895167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.895185Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:06.895199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:06.895207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:06.895276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.895285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.895287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.895289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:06.895360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:06.895368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.895384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:06.895403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:06.895417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2229
2025-10-10T14:37:06.895456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2229
2025-10-10T14:37:06.896558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2230 partition: 0 MaxSeqNo: 40 sessionId: src_id|94d02ad1-3248b240-23dcace1-17034dbc_0
2025-10-10T14:37:06.895427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:06.895460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960313:2438], now have 1 active actors on pipe
2025-10-10T14:37:06.895465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960361:4166], now have 1 active actors on pipe
2025-10-10T14:37:06.895479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602115665729420:2557]
2025-10-10T14:37:06.895481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602115665729420:2557]
2025-10-10T14:37:06.895483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602115665729420:2557]
2025-10-10T14:37:06.895496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:06.895511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:06.895510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:06.895513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:06.895515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:06.895529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:06.895534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:06.895567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602115665729420:2557]
2025-10-10T14:37:06.895570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:06.895598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:06.895897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.895904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.895936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94d02ad1-3248b240-23dcace1-17034dbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:06.895945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:06.895950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:06.895952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:06.895964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:06.895981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:06.895997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.896423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:06.896430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:06.896453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:06.897087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de2d6f3-997b3d33-1c4903d9-538a8033_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94d02ad1-3248b240-23dcace1-17034dbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:06.900090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d02ad1-3248b240-23dcace1-17034dbc_0] Write session: try to update token
2025-10-10T14:37:06.900114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d02ad1-3248b240-23dcace1-17034dbc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:06.915762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:06.915780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:06.915784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:06.915786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:06.915777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId: src_id|94d02ad1-3248b240-23dcace1-17034dbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:06.915796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602115665729420:2557]
2025-10-10T14:37:06.915800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602115665729420:2557]
2025-10-10T14:37:06.915804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602115665729420:2557]
2025-10-10T14:37:06.915857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:06.915863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:06.915865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:06.915867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:06.915869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:06.915874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:06.916004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:06.918620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:06.967760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602116447960380:3836]
2025-10-10T14:37:06.968082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2229, pipe: [1:7559602116447960380:3836]
2025-10-10T14:37:07.034369Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:07.034681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.034696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.034736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602116447960380:3836], now have 1 active actors on pipe
2025-10-10T14:37:07.035028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:07.035044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:07.035125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602116447960380:3836]
2025-10-10T14:37:07.035154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:07.035252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2230 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94d02ad1-3248b240-23dcace1-17034dbc_0
2025-10-10T14:37:07.035522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2230 sessionId: src_id|94d02ad1-3248b240-23dcace1-17034dbc_0 is DEAD
2025-10-10T14:37:07.036637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d02ad1-3248b240-23dcace1-17034dbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:07.036647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d02ad1-3248b240-23dcace1-17034dbc_0] Write session will restart in 0.008894s
2025-10-10T14:37:07.036673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d02ad1-3248b240-23dcace1-17034dbc_0] Write session: Do CDS request
2025-10-10T14:37:07.036680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d02ad1-3248b240-23dcace1-17034dbc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:07.045518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:07.046938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d02ad1-3248b240-23dcace1-17034dbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.047007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:07.047026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2231
2025-10-10T14:37:07.047202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.047238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:07.047249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:07.047253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:07.047537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:07.047788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:07.047800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:07.047814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:07.047808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2231 sessionId:  describe result for acl check
2025-10-10T14:37:07.047842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:07.047844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:07.047846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:07.047852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602120742927711:4175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:07.047874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:07.047919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602119960696797:2552]
2025-10-10T14:37:07.048550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:07.048430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602120742927711:4175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:07.048983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:07.049048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:07.049462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:07.049517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.049523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.049524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.049526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.049527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.049531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.049532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.049533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.049535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.049537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.049538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.049539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.049541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.049548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.049561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.049565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.049570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.049574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.049578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.049583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.049587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.049591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.049596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.049600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.049604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.049609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.049617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.049626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.049633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.049639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.049645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.049650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.049656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.049661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.049666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.049671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.049685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.049691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.049697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.049702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.049706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.049711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.049715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.049720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.049724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.049729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.049734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.049739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.049743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.049748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.049753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.049758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.049800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:07.050882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602120742927711:4175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:07.052527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:07.052973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:07.052986Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:07.052989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:07.052994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:07.053000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2230 [2:7559602119960696797:2552]
2025-10-10T14:37:07.053014Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:07.053037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:07.053044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.053048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.053050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.053068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:07.053082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:07.053095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:07.053159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.053166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.053169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.053171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:07.053240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:07.053252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.053266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.053280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.053299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:07.053318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602119960696791:2552]
2025-10-10T14:37:07.053325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602119960696791:2552]
2025-10-10T14:37:07.053327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602119960696791:2552]
2025-10-10T14:37:07.053353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:07.053373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:07.053396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:07.053400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:07.053402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:07.053405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:07.053408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:07.053431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602119960696791:2552]
2025-10-10T14:37:07.053435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:07.053437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:07.053444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927679:2438], now have 1 active actors on pipe
2025-10-10T14:37:07.053509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2230
2025-10-10T14:37:07.055137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602120742927711:4175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:07.055154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602120742927711:4175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:07.055158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602120742927711:4175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:07.055166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:07.055563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927747:4175], now have 1 active actors on pipe
2025-10-10T14:37:07.055623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2230
2025-10-10T14:37:07.055742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.055759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.055796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:07.055821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.055830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.055833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:07.055857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.055880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:07.055904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.057101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.057114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.057138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.057299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2231 partition: 0 MaxSeqNo: 40 sessionId: src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0
2025-10-10T14:37:07.057733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d02ad1-3248b240-23dcace1-17034dbc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:07.060543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0] Write session: try to update token
2025-10-10T14:37:07.060562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:07.074921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:07.074945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:07.074953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:07.074956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:07.074968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602119960696791:2552]
2025-10-10T14:37:07.074973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602119960696791:2552]
2025-10-10T14:37:07.074978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602119960696791:2552]
2025-10-10T14:37:07.075034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:07.075038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:07.075042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:07.075047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:07.075047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.075050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:07.075216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:07.097462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId: src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:07.100183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:07.135194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602120742927763:3836]
2025-10-10T14:37:07.135693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2230, pipe: [1:7559602120742927763:3836]
2025-10-10T14:37:07.199769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:07.200110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.200128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.200177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927763:3836], now have 1 active actors on pipe
2025-10-10T14:37:07.200415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:07.200447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:07.200452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:07.200464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:07.200499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602120742927763:3836]
2025-10-10T14:37:07.200537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2231 reason: error at write: Disconnected sessionId: src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0
2025-10-10T14:37:07.200747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2231 sessionId: src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0 is DEAD
2025-10-10T14:37:07.201166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:07.201176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0] Write session will restart in 0.009345s
2025-10-10T14:37:07.201204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0] Write session: Do CDS request
2025-10-10T14:37:07.201224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:07.208944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:07.210606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:07.210817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:07.210830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:07.210843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:07.210903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:07.210946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602119960696880:2549]
2025-10-10T14:37:07.211597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:07.211910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.211976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:07.212027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:07.212392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:07.212456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.212463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.212464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.212465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.212466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.212467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.212468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.212469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.212471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.212472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.212473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.212474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.212475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.212481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.212494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.212499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.212503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.212507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.212512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.212516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.212522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.212525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.212530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.212534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.212538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.212542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.212550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.212558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.212565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.212571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.212575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.212581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.212585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.212591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.212601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.212607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.212612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.212621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.212627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.212632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.212636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.212642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.212646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.212656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.212660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.212670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.212674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.212684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.212688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.212697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.212702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.212712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.212742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:07.213463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:07.213489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2232
2025-10-10T14:37:07.215120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:07.215569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:07.215583Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:07.215586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:07.215590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:07.215597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2231 [2:7559602119960696880:2549]
2025-10-10T14:37:07.215612Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:07.215634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:07.215642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.215645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.215648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.215666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:07.215680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:07.215688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:07.215761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.215768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.215770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.215772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:07.215840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:07.215848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.215861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.216126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2231
2025-10-10T14:37:07.215885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.215907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:07.215930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927765:2438], now have 1 active actors on pipe
2025-10-10T14:37:07.215939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602119960696875:2549]
2025-10-10T14:37:07.215942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602119960696875:2549]
2025-10-10T14:37:07.215945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602119960696875:2549]
2025-10-10T14:37:07.215957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:07.215967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:07.215969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:07.215971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:07.215972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:07.215989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:07.215993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:07.216019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602119960696875:2549]
2025-10-10T14:37:07.216025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:07.216032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:07.217450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.217504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:07.217510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:07.217517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:07.218133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2232 sessionId:  describe result for acl check
2025-10-10T14:37:07.218172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:07.218179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:07.218182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:07.218188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602120742927807:4203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:07.218779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602120742927807:4203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:07.222126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602120742927807:4203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:07.227680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602120742927807:4203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:07.227710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602120742927807:4203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:07.227714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602120742927807:4203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:07.227724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:07.228092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927836:4203], now have 1 active actors on pipe
2025-10-10T14:37:07.228136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2231
2025-10-10T14:37:07.228231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.228249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.228308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:07.228329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.228339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.228345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:07.228361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.228382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:07.228403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.228598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.228607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.228624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.228745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2232 partition: 0 MaxSeqNo: 40 sessionId: src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0
2025-10-10T14:37:07.229143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9adb539-1b3f57a7-b8938ed1-b71191e0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:07.232126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0] Write session: try to update token
2025-10-10T14:37:07.232147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:07.239086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:07.239120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:07.239125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:07.239131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:07.239147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602119960696875:2549]
2025-10-10T14:37:07.239152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602119960696875:2549]
2025-10-10T14:37:07.239158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602119960696875:2549]
2025-10-10T14:37:07.239221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:07.239229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:07.239239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.239242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:07.239244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:07.239249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:07.239427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:07.246760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId: src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:07.249656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:07.300568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602120742927839:3836]
2025-10-10T14:37:07.300849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2231, pipe: [1:7559602120742927839:3836]
2025-10-10T14:37:07.357410Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:07.357736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.357754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.357780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927839:3836], now have 1 active actors on pipe
2025-10-10T14:37:07.358045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:07.358498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:07.358642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2232 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0
2025-10-10T14:37:07.359032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:07.359053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0] Write session will restart in 0.005378s
2025-10-10T14:37:07.359078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0] Write session: Do CDS request
2025-10-10T14:37:07.359088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:07.358850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2232 sessionId: src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0 is DEAD
2025-10-10T14:37:07.359067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602120742927839:3836]
2025-10-10T14:37:07.359083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:07.365889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.366024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:07.366054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2233
2025-10-10T14:37:07.366228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.366263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:07.366273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:07.366277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:07.366697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2233 sessionId:  describe result for acl check
2025-10-10T14:37:07.366732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:07.366739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:07.366741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:07.366747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602120742927857:4208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:07.367331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602120742927857:4208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:07.369542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:07.370345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602120742927857:4208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:07.371897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:07.372158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:07.372169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:07.372181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:07.372239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:07.372292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602119960696952:2543]
2025-10-10T14:37:07.372896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:07.373128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602120742927857:4208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:07.373146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602120742927857:4208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:07.373150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602120742927857:4208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:07.373160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:07.373386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:07.373435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:07.373774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:07.373854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.373856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.373857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.373859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.373860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.373862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.373864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.373865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.373866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.373868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.373869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.373873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.373874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.373882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.373894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.373898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.373901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.373905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.373908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.373911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.373915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.373918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.373923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.373926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.373929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.373932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.373942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.373951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.373957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.373962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.373966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.373971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.373975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.373980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.373984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.373989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.373993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.373998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.374002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.374007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.374011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.374016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.374025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.374031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.374035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.374041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.374046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.374051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.374055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.374061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.374066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.374071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.374117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:07.377624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:07.377992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:07.377998Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:07.378001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:07.378006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:07.378014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2232 [2:7559602119960696952:2543]
2025-10-10T14:37:07.378029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:07.378051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:07.378056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.378060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.378063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.378083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:07.378092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:07.378101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:07.378175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.378179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.378181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.378183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:07.378261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:07.378264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.378274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.378284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.378298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:07.378320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602119960696946:2543]
2025-10-10T14:37:07.378323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602119960696946:2543]
2025-10-10T14:37:07.378324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602119960696946:2543]
2025-10-10T14:37:07.378333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:07.378349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:07.378363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:07.378366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:07.378385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:07.378388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:07.378390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:07.378399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602119960696946:2543]
2025-10-10T14:37:07.378402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:07.378419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:07.378429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927906:4208], now have 1 active actors on pipe
2025-10-10T14:37:07.378433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927841:2438], now have 1 active actors on pipe
2025-10-10T14:37:07.378931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2232
2025-10-10T14:37:07.378962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2232
2025-10-10T14:37:07.379087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.379113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.379152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56db010f-3f2669e0-5dcf111-7a919359_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:07.379163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.379169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.379173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:07.379186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.379202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:07.379222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.379628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.379638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.379657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.379783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2233 partition: 0 MaxSeqNo: 40 sessionId: src_id|56db010f-3f2669e0-5dcf111-7a919359_0
2025-10-10T14:37:07.380233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a8967c0-93273f88-fc1cbfe5-4014c233_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56db010f-3f2669e0-5dcf111-7a919359_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:07.383076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db010f-3f2669e0-5dcf111-7a919359_0] Write session: try to update token
2025-10-10T14:37:07.383097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db010f-3f2669e0-5dcf111-7a919359_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:07.404248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:07.404270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:07.404274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:07.404277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:07.404289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602119960696946:2543]
2025-10-10T14:37:07.404294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602119960696946:2543]
2025-10-10T14:37:07.404300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602119960696946:2543]
2025-10-10T14:37:07.404352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:07.404353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:07.404360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.404362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:07.404366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:07.404370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:07.404416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId: src_id|56db010f-3f2669e0-5dcf111-7a919359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:07.404501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:07.407173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:07.459296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602120742927916:3836]
2025-10-10T14:37:07.459578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2232, pipe: [1:7559602120742927916:3836]
2025-10-10T14:37:07.530220Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:07.530593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.530608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.530655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927916:3836], now have 1 active actors on pipe
2025-10-10T14:37:07.530879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:07.530902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:07.530962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:07.530966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:07.531034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2233 reason: error at write: Disconnected sessionId: src_id|56db010f-3f2669e0-5dcf111-7a919359_0
2025-10-10T14:37:07.531259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2233 sessionId: src_id|56db010f-3f2669e0-5dcf111-7a919359_0 is DEAD
2025-10-10T14:37:07.531416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602120742927916:3836]
2025-10-10T14:37:07.531655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db010f-3f2669e0-5dcf111-7a919359_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:07.531663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db010f-3f2669e0-5dcf111-7a919359_0] Write session will restart in 0.008763s
2025-10-10T14:37:07.531688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db010f-3f2669e0-5dcf111-7a919359_0] Write session: Do CDS request
2025-10-10T14:37:07.531710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db010f-3f2669e0-5dcf111-7a919359_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:07.543643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:07.545857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56db010f-3f2669e0-5dcf111-7a919359_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.546210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:07.546230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2234
2025-10-10T14:37:07.546316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:07.546393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.546442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:07.546455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:07.546458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:07.546528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:07.546540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:07.546554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:07.546618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:07.546670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602119960697024:2547]
2025-10-10T14:37:07.546936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2234 sessionId:  describe result for acl check
2025-10-10T14:37:07.546976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:07.546982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:07.546984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:07.546990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602120742927954:4215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:07.547195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:07.547561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602120742927954:4215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:07.548281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:07.548349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:07.548706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:07.548766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.548772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.548773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.548774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.548776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.548777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.548778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.548779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.548781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.548782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.548784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.548785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.548786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.548793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.548805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.548809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.548813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.548818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.548822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.548826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.548830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.548834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.548839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.548843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.548847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.548851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.548859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.548868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.548875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.548881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.548892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.548897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.548906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.548912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.548922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.548927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.548934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.548943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.548948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.548953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.548962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.548967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.548972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.548981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.548986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.548991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.549000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.549005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.549010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.549016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.549020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.549026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.549067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:07.551592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:07.551592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602120742927954:4215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:07.552052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:07.552065Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:07.552066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:07.552070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:07.552076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2233 [2:7559602119960697024:2547]
2025-10-10T14:37:07.552087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:07.552101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:07.552103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.552106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.552107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.552122Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:07.552131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:07.552138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:07.552190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.552196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.552197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.552199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:07.552260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:07.552268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.552279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.552290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.552311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:07.552338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927918:2438], now have 1 active actors on pipe
2025-10-10T14:37:07.552351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602119960697018:2547]
2025-10-10T14:37:07.552357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602119960697018:2547]
2025-10-10T14:37:07.552359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602119960697018:2547]
2025-10-10T14:37:07.552372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:07.552393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:07.552401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:07.552401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:07.552404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:07.552412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:07.552417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:07.552444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602119960697018:2547]
2025-10-10T14:37:07.552453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:07.552478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:07.552557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2233
2025-10-10T14:37:07.560069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602120742927954:4215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:07.560089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602120742927954:4215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:07.560095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602120742927954:4215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:07.560105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:07.560486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927991:4215], now have 1 active actors on pipe
2025-10-10T14:37:07.560586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2233
2025-10-10T14:37:07.560662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.560684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.560728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:07.560748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.560755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.560759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:07.560781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.560802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:07.560834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.561012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.561021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.561037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.561162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2234 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0
2025-10-10T14:37:07.561578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56db010f-3f2669e0-5dcf111-7a919359_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:07.564536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0] Write session: try to update token
2025-10-10T14:37:07.564550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:07.572745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:07.572766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:07.572776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602119960697018:2547]
2025-10-10T14:37:07.572828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:07.572830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:07.573009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:07.573140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:07.573283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:07.573441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:07.573645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:07.573712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:07.581586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId: src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:07.584322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:07.585495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.585519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.585544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:07.585547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:07.585555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:07.585557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:07.585565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602119960697018:2547]
2025-10-10T14:37:07.585570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602119960697018:2547]
2025-10-10T14:37:07.585572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602119960697018:2547]
2025-10-10T14:37:07.585614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:07.585625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:07.585628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:07.585632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:07.585640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.585643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:07.585788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:07.631892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602120742927994:3836]
2025-10-10T14:37:07.632254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2233, pipe: [1:7559602120742927994:3836]
2025-10-10T14:37:07.702936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:07.703236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:07.703276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927994:3836], now have 1 active actors on pipe
2025-10-10T14:37:07.703379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:07.703592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:07.703660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602120742927994:3836]
2025-10-10T14:37:07.712870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:07.714527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:07.714774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:07.714784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:07.714796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:07.714850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:07.714906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602119960697096:2545]
2025-10-10T14:37:07.715492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:07.715655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:07.715673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:07.715718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2234 reason: error at write: Disconnected sessionId: src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0
2025-10-10T14:37:07.715898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2234 sessionId: src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0 is DEAD
2025-10-10T14:37:07.716073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:07.716098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0] Write session will restart in 0.007045s
2025-10-10T14:37:07.716125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0] Write session: Do CDS request
2025-10-10T14:37:07.716131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:07.722169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:07.722261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:07.722588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:07.722664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.722672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.722674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.722675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.722677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.722679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.722680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.722681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.722683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.722684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.722686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.722687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.722688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.722695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.722709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.722714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.722718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.722722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.722727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.722730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.722732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.722734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.722737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.722739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.722741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.722744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.722755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.722764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.722771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.722776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.722781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.722787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.722793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.722802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.722806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.722812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.722817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.722822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.722826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.722832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.722838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.722843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.722846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.722849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.722852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.722855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.722859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.722864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.722868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.722873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.722876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.722881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.722920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:07.724967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.725063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:07.725083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2235
2025-10-10T14:37:07.725596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:07.725645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.725685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:07.725696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:07.725704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:07.726060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:07.726077Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:07.726080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:07.726087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:07.726094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2234 [2:7559602119960697096:2545]
2025-10-10T14:37:07.726113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:07.726157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:07.726167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.726171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.726173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.726192Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:07.726200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:07.726208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:07.726212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2235 sessionId:  describe result for acl check
2025-10-10T14:37:07.726251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:07.726257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:07.726262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:07.726268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602120742928037:4221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:07.726272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.726281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.726283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.726286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:07.726361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:07.726369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.726382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.726398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.726420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:07.726447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742927996:2438], now have 1 active actors on pipe
2025-10-10T14:37:07.726462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602119960697091:2545]
2025-10-10T14:37:07.726472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602119960697091:2545]
2025-10-10T14:37:07.726474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602119960697091:2545]
2025-10-10T14:37:07.726490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:07.726501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:07.726504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:07.726504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:07.726506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:07.726520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:07.726524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:07.726520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2234
2025-10-10T14:37:07.726555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602119960697091:2545]
2025-10-10T14:37:07.726566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:07.726570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:07.726856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602120742928037:4221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:07.729840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602120742928037:4221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:07.736228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602120742928037:4221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:07.736251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602120742928037:4221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:07.736255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602120742928037:4221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:07.736262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:07.736532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742928072:4221], now have 1 active actors on pipe
2025-10-10T14:37:07.736600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2234
2025-10-10T14:37:07.736673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.736689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.736729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:07.736749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.736755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.736758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:07.736772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.736791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:07.736827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.737008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.737016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.737030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.737149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2235 partition: 0 MaxSeqNo: 40 sessionId: src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0
2025-10-10T14:37:07.737615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee9b79b8-3883f479-2cd4208d-ed4350f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:07.740535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0] Write session: try to update token
2025-10-10T14:37:07.740555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:07.748349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:07.748378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:07.748383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:07.748387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:07.748407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602119960697091:2545]
2025-10-10T14:37:07.748415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602119960697091:2545]
2025-10-10T14:37:07.748422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602119960697091:2545]
2025-10-10T14:37:07.748484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:07.748494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:07.748494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:07.748499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:07.748517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.748520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:07.748775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:07.756146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId: src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:07.758923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:07.803879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602120742928081:3836]
2025-10-10T14:37:07.804239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2234, pipe: [1:7559602120742928081:3836]
2025-10-10T14:37:07.866009Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:07.866274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.866289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.866315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742928081:3836], now have 1 active actors on pipe
2025-10-10T14:37:07.866524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:07.866574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:07.866591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:07.866590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:07.866652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602120742928081:3836]
2025-10-10T14:37:07.866656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2235 reason: error at write: Disconnected sessionId: src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0
2025-10-10T14:37:07.866883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2235 sessionId: src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0 is DEAD
2025-10-10T14:37:07.867029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:07.867042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0] Write session will restart in 0.009682s
2025-10-10T14:37:07.867067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0] Write session: Do CDS request
2025-10-10T14:37:07.867073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:07.875516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:07.877248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:07.877500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:07.877512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:07.877525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:07.877590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:07.877643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602119960697183:2511]
2025-10-10T14:37:07.877940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.878242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:07.878231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:07.878251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2236
2025-10-10T14:37:07.878379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:07.878435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:07.878446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:07.878450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:07.878590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:07.878641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:07.878863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2236 sessionId:  describe result for acl check
2025-10-10T14:37:07.878901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:07.878910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:07.878911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:07.878918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602120742928122:4234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:07.879004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:07.879081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.879087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.879088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.879090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.879091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.879093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.879093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.879094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.879096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.879097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.879098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.879100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.879101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.879107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.879118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.879122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.879126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.879130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.879134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.879138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.879141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.879144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.879148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.879152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.879155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.879159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.879166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.879175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:07.879182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.879187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:07.879191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.879197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:07.879204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.879209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:07.879214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.879219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:07.879223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.879228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:07.879234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.879240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:07.879244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.879249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:07.879255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.879260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:07.879264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.879268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:07.879273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.879283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.879287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.879293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.879298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.879306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.879344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:07.879513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602120742928122:4234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:07.881677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602120742928122:4234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:07.881821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:07.882215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:07.882227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:07.882229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:07.882232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:07.882239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2235 [2:7559602119960697183:2511]
2025-10-10T14:37:07.882252Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:07.882281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:07.882292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.882295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.882298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.882320Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:07.882332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:07.882339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:07.882428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.882437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.882438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.882441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:07.882508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:07.882518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.882528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:07.882636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2235
2025-10-10T14:37:07.882538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:07.882560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:07.882582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742928083:2438], now have 1 active actors on pipe
2025-10-10T14:37:07.882590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602119960697178:2511]
2025-10-10T14:37:07.882592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602119960697178:2511]
2025-10-10T14:37:07.882594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602119960697178:2511]
2025-10-10T14:37:07.882611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:07.882622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:07.882625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:07.882626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:07.882628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:07.882642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:07.882645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:07.882668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602119960697178:2511]
2025-10-10T14:37:07.882670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:07.882674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:07.887779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602120742928122:4234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:07.887808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602120742928122:4234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:07.887812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602120742928122:4234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:07.887822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:07.888078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742928157:4234], now have 1 active actors on pipe
2025-10-10T14:37:07.888188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2235
2025-10-10T14:37:07.888264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.888279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.888325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46fedeca-c69b0f07-ace372c2-618a308e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:07.888338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:07.888344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:07.888347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:07.888362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:07.888394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:07.888416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.888607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.888618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.888635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:07.888756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2236 partition: 0 MaxSeqNo: 40 sessionId: src_id|46fedeca-c69b0f07-ace372c2-618a308e_0
2025-10-10T14:37:07.889175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddc4bcb-cdecbe82-73009962-c35fda52_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|46fedeca-c69b0f07-ace372c2-618a308e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:07.892191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46fedeca-c69b0f07-ace372c2-618a308e_0] Write session: try to update token
2025-10-10T14:37:07.892215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46fedeca-c69b0f07-ace372c2-618a308e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:07.900927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:07.900947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:07.900960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602119960697178:2511]
2025-10-10T14:37:07.901019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:07.901037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:07.901236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:07.901443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:07.901597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:07.901751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:07.901971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:07.902026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:07.913715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId: src_id|46fedeca-c69b0f07-ace372c2-618a308e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:07.916624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:07.916956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:07.916980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:07.917004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:07.917007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:07.917010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:07.917012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:07.917022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602119960697178:2511]
2025-10-10T14:37:07.917026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602119960697178:2511]
2025-10-10T14:37:07.917031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602119960697178:2511]
2025-10-10T14:37:07.917068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:07.917079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:07.917084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:07.917092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:07.917105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:07.917112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:07.917249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:07.968335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602120742928184:3836]
2025-10-10T14:37:07.968762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2235, pipe: [1:7559602120742928184:3836]
2025-10-10T14:37:08.036452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:08.036940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:08.036983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602120742928184:3836], now have 1 active actors on pipe
2025-10-10T14:37:08.037083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:08.037193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602120742928184:3836]
2025-10-10T14:37:08.037224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:08.050483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:08.050499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:08.050521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2236 reason: error at write: Disconnected sessionId: src_id|46fedeca-c69b0f07-ace372c2-618a308e_0
2025-10-10T14:37:08.050816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46fedeca-c69b0f07-ace372c2-618a308e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:08.050828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46fedeca-c69b0f07-ace372c2-618a308e_0] Write session will restart in 0.008892s
2025-10-10T14:37:08.050849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46fedeca-c69b0f07-ace372c2-618a308e_0] Write session: Do CDS request
2025-10-10T14:37:08.050855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46fedeca-c69b0f07-ace372c2-618a308e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:08.050846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2236 sessionId: src_id|46fedeca-c69b0f07-ace372c2-618a308e_0 is DEAD
2025-10-10T14:37:08.060843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46fedeca-c69b0f07-ace372c2-618a308e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.061141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:08.061168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2237
2025-10-10T14:37:08.061418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:08.061267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.061292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:08.061296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:08.061300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:08.061649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:08.061985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2237 sessionId:  describe result for acl check
2025-10-10T14:37:08.062013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:08.062014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:08.062015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:08.062019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602125037895520:4244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:08.062444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602125037895520:4244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:08.063896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:08.063914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:08.063926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:08.064000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:08.064081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602124255664583:2495]
2025-10-10T14:37:08.064725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:08.065010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:08.065057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:08.065401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:08.065443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602125037895520:4244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:08.065466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.065474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.065475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.065477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.065478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.065479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.065481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.065482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.065483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.065485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.065486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.065487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.065489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.065495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.065508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.065512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.065517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.065522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.065526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.065531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.065535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.065540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.065545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.065549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.065554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.065558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.065565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.065574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.065584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.065590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.065596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.065601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.065605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.065611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.065616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.065622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.065626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.065632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.065637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.065643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.065647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.065654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.065660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.065674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.065678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.065683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.065688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.065692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.065696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.065702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.065706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.065713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.065764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:08.068256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:08.068324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602125037895520:4244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:08.068339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602125037895520:4244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:08.068344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602125037895520:4244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:08.068352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:08.068655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:08.068671Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:08.068673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:08.068677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:08.068683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2236 [2:7559602124255664583:2495]
2025-10-10T14:37:08.068697Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:08.068716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:08.068725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.068729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.068731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.068748Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:08.068760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:08.068767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:08.068831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.068841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.068844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.068846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:08.068927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:08.068930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.068943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.068957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.068977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:08.068999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895553:4244], now have 1 active actors on pipe
2025-10-10T14:37:08.069003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895482:2438], now have 1 active actors on pipe
2025-10-10T14:37:08.069010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602124255664578:2495]
2025-10-10T14:37:08.069012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602124255664578:2495]
2025-10-10T14:37:08.069015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602124255664578:2495]
2025-10-10T14:37:08.069029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:08.069041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:08.069057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:08.069060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:08.069081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602124255664578:2495]
2025-10-10T14:37:08.069085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:08.069123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:08.069126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:08.069129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:08.069136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:08.069257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2236
2025-10-10T14:37:08.069289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2236
2025-10-10T14:37:08.069482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.069494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.069526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:08.069539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.069543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.069546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:08.069558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.069570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:08.069590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.070247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.070255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.070272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.070383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2237 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0
2025-10-10T14:37:08.070811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46fedeca-c69b0f07-ace372c2-618a308e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:08.073918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0] Write session: try to update token
2025-10-10T14:37:08.073942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:08.090491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:08.090514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:08.090518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:08.090521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:08.090536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602124255664578:2495]
2025-10-10T14:37:08.090543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602124255664578:2495]
2025-10-10T14:37:08.090547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602124255664578:2495]
2025-10-10T14:37:08.090601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:08.090609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.090612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:08.090768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:08.091281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:08.091288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:08.091293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:08.092564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId: src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:08.095656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:08.137186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602125037895573:3836]
2025-10-10T14:37:08.137555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2236, pipe: [1:7559602125037895573:3836]
2025-10-10T14:37:08.220663Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:08.221053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.221069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.221118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895573:3836], now have 1 active actors on pipe
2025-10-10T14:37:08.221451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:08.221398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602125037895573:3836]
2025-10-10T14:37:08.221452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:08.221490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:08.221492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:08.221567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2237 reason: error at write: Disconnected sessionId: src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0
2025-10-10T14:37:08.222004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2237 sessionId: src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0 is DEAD
2025-10-10T14:37:08.222157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:08.222165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0] Write session will restart in 0.006187s
2025-10-10T14:37:08.222191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0] Write session: Do CDS request
2025-10-10T14:37:08.222201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:08.229800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.229930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:08.229948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2238
2025-10-10T14:37:08.230074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.230118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:08.230131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:08.230135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:08.230562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2238 sessionId:  describe result for acl check
2025-10-10T14:37:08.230596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:08.230602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:08.230604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:08.230610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602125037895612:4262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:08.231174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602125037895612:4262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:08.231216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:08.233569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602125037895612:4262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:08.236226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602125037895612:4262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:08.236240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602125037895612:4262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:08.236244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602125037895612:4262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:08.236253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:08.237458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:08.237703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:08.237715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:08.237727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:08.237790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:08.237853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602124255664672:2478]
2025-10-10T14:37:08.238469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:08.238846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:08.238917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:08.239277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:08.239339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.239354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.239360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.239361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.239363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.239368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.239369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.239370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.239374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.239377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.239378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.239380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.239381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.239388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.239409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.239415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.239419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.239423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.239428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.239432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.239436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.239439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.239443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.239448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.239452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.239456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.239465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.239474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.239480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.239486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.239492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.239498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.239503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.239508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.239513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.239517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.239522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.239528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.239533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.239538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.239548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.239553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.239558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.239563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.239569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.239574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.239580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.239585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.239589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.239599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.239606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.239611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.239653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:08.242460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:08.242923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:08.242935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:08.242938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:08.242943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:08.242951Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2237 [2:7559602124255664672:2478]
2025-10-10T14:37:08.242977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:08.242999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:08.243004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.243010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.243012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.243031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:08.243040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:08.243049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:08.243114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.243121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.243123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.243126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:08.243203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:08.243215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.243228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.243240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.243262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:08.243290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895644:4262], now have 1 active actors on pipe
2025-10-10T14:37:08.243299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895575:2438], now have 1 active actors on pipe
2025-10-10T14:37:08.243308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602124255664665:2478]
2025-10-10T14:37:08.243310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602124255664665:2478]
2025-10-10T14:37:08.243312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602124255664665:2478]
2025-10-10T14:37:08.243326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:08.243345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:08.243351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:08.243354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:08.243356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:08.243365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:08.243369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:08.243404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602124255664665:2478]
2025-10-10T14:37:08.243415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:08.243421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:08.243543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.243557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.243594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:08.243607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.243612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.243619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:08.243631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.243648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:08.243665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.243824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.243837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.243852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.243384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2237
2025-10-10T14:37:08.243393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2237
2025-10-10T14:37:08.243957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2238 partition: 0 MaxSeqNo: 40 sessionId: src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0
2025-10-10T14:37:08.244360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2ac16c-2221ada2-55aee4c7-4e7f6379_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:08.247183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0] Write session: try to update token
2025-10-10T14:37:08.247208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:08.263427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId: src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:08.264012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:08.264034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:08.264038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:08.264041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:08.264050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602124255664665:2478]
2025-10-10T14:37:08.264058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602124255664665:2478]
2025-10-10T14:37:08.264062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602124255664665:2478]
2025-10-10T14:37:08.264116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:08.264124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.264126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:08.264125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:08.264132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:08.264137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:08.264275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:08.266491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:08.321506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602125037895655:3836]
2025-10-10T14:37:08.321890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2237, pipe: [1:7559602125037895655:3836]
2025-10-10T14:37:08.387770Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:08.388133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.388149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.388198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895655:3836], now have 1 active actors on pipe
2025-10-10T14:37:08.388598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602125037895655:3836]
2025-10-10T14:37:08.388653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:08.388748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2238 reason: status is not ok: tablet will be restarted right now sessionId: src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0
2025-10-10T14:37:08.388441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:08.388950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2238 sessionId: src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0 is DEAD
2025-10-10T14:37:08.389010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:08.389095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:08.389107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0] Write session will restart in 0.007709s
2025-10-10T14:37:08.389144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0] Write session: Do CDS request
2025-10-10T14:37:08.389150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:08.397977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.398075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:08.398097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2239
2025-10-10T14:37:08.398247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.398286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:08.398301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:08.398306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:08.398918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2239 sessionId:  describe result for acl check
2025-10-10T14:37:08.398966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:08.398968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:08.398973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:08.398979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602125037895693:4283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:08.399561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602125037895693:4283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:08.401156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:08.402095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602125037895693:4283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:08.403700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:08.403961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:08.403973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:08.403986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:08.404049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:08.404096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602124255664748:2476]
2025-10-10T14:37:08.404702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:08.405038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:08.405093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:08.405350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602125037895693:4283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:08.405374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602125037895693:4283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:08.405378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602125037895693:4283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:08.405389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:08.405441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:08.405527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.405532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.405534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.405535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.405537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.405539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.405540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.405541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.405543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.405543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.405545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.405546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.405547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.405554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.405566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.405570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.405574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.405577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.405581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.405585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.405589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.405592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.405596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.405600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.405604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.405607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.405616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.405624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.405634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.405640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.405643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.405648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.405654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.405659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.405664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.405669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.405673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.405678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.405684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.405688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.405693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.405698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.405702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.405707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.405711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.405715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.405720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.405726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.405731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.405737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.405750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.405756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.405804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:08.408469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:08.408814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:08.408826Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:08.408828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:08.408834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:08.408841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2238 [2:7559602124255664748:2476]
2025-10-10T14:37:08.408854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:08.408874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:08.408877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.408880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.408882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.408901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:08.408913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:08.408921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:08.408997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.409003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.409005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.409007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:08.409073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:08.409083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.409094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.409103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.409118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:08.409139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895729:4283], now have 1 active actors on pipe
2025-10-10T14:37:08.409146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895657:2438], now have 1 active actors on pipe
2025-10-10T14:37:08.409154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602124255664741:2476]
2025-10-10T14:37:08.409156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602124255664741:2476]
2025-10-10T14:37:08.409158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602124255664741:2476]
2025-10-10T14:37:08.409177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:08.409196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:08.409176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2238
2025-10-10T14:37:08.409202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:08.409188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2238
2025-10-10T14:37:08.409206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:08.409209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:08.409215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:08.409218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:08.409247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602124255664741:2476]
2025-10-10T14:37:08.409259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:08.409266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:08.409281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.409286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.409377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:08.409392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.409395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.409397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:08.409409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.409424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:08.409446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.409660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.409669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.409686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.409776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2239 partition: 0 MaxSeqNo: 40 sessionId: src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0
2025-10-10T14:37:08.410183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26e135ea-d6af6d75-555d85c4-1d6a4f61_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:08.412931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0] Write session: try to update token
2025-10-10T14:37:08.412949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:08.430085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId: src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:08.430529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:08.430551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:08.430556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:08.430558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:08.430568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602124255664741:2476]
2025-10-10T14:37:08.430572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602124255664741:2476]
2025-10-10T14:37:08.430589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602124255664741:2476]
2025-10-10T14:37:08.430641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:08.430645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:08.430654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.430656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:08.430657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:08.430662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:08.430806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:08.432843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:08.488925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602125037895738:3836]
2025-10-10T14:37:08.489252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2238, pipe: [1:7559602125037895738:3836]
2025-10-10T14:37:08.549026Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:08.549438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.549455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.549505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895738:3836], now have 1 active actors on pipe
2025-10-10T14:37:08.549795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:08.549841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602125037895738:3836]
2025-10-10T14:37:08.549885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:08.550441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:08.550455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0] Write session will restart in 0.009484s
2025-10-10T14:37:08.550480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0] Write session: Do CDS request
2025-10-10T14:37:08.550486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:08.549941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:08.549950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:08.550031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2239 reason: error at write: Disconnected sessionId: src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0
2025-10-10T14:37:08.550236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2239 sessionId: src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0 is DEAD
2025-10-10T14:37:08.560946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.561052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:08.561070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2240
2025-10-10T14:37:08.561218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.561270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:08.561282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:08.561286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:08.561748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2240 sessionId:  describe result for acl check
2025-10-10T14:37:08.561787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:08.561789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:08.561791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:08.561798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602125037895780:4287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:08.562371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602125037895780:4287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:08.564744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602125037895780:4287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:08.566747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:08.568776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:08.569001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:08.569014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:08.569027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:08.569083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:08.569134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602124255664826:2471]
2025-10-10T14:37:08.569231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602125037895780:4287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:08.569249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602125037895780:4287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:08.569253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602125037895780:4287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:08.569263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:08.569850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:08.577655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:08.577795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:08.578257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:08.578354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.578361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.578362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.578364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.578365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.578367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.578369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.578370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.578372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.578373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.578375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.578376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.578377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.578386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.578400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.578404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.578408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.578412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.578416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.578419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.578423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.578427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.578432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.578436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.578440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.578444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.578453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.578464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.578470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.578490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.578494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.578500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.578504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.578509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.578514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.578521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.578525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.578531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.578537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.578548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.578553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.578559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.578568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.578573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.578577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.578583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.578588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.578593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.578597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.578602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.578606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.578617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.578661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:08.585037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:08.585417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:08.585434Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:08.585437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:08.585444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:08.585452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2239 [2:7559602124255664826:2471]
2025-10-10T14:37:08.585469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:08.585503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:08.585507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.585511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.585514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.585534Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:08.585542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:08.585551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:08.585624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.585637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.585640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.585642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:08.585726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:08.585738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.585753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.585766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.585785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:08.585810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895740:2438], now have 1 active actors on pipe
2025-10-10T14:37:08.585814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895810:4287], now have 1 active actors on pipe
2025-10-10T14:37:08.585823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602124255664820:2471]
2025-10-10T14:37:08.585826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602124255664820:2471]
2025-10-10T14:37:08.585829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602124255664820:2471]
2025-10-10T14:37:08.585848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:08.585872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:08.585892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:08.585897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:08.585940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602124255664820:2471]
2025-10-10T14:37:08.585941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:08.585943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:08.585945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:08.585958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:08.585966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:08.589420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2239
2025-10-10T14:37:08.589421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2239
2025-10-10T14:37:08.593565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.593599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.593657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:08.593670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.593676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.593679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:08.593699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.593724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:08.593748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.594055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.594072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.594097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.594216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2240 partition: 0 MaxSeqNo: 40 sessionId: src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0
2025-10-10T14:37:08.594688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29e1f2dd-4117b5d4-78dfc997-4c4b2b05_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:08.597900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0] Write session: try to update token
2025-10-10T14:37:08.597923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:08.607951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:08.607975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:08.607988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602124255664820:2471]
2025-10-10T14:37:08.608047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:08.608138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:08.608242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:08.608405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:08.608550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:08.608716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:08.608944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:08.609006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:08.618653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId: src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:08.620570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:08.620587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:08.620591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:08.620596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:08.620607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602124255664820:2471]
2025-10-10T14:37:08.620611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602124255664820:2471]
2025-10-10T14:37:08.620615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602124255664820:2471]
2025-10-10T14:37:08.620670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:08.620683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.620690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:08.620715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:08.620729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:08.620734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:08.620836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:08.621556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:08.651580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602125037895821:3836]
2025-10-10T14:37:08.652101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2239, pipe: [1:7559602125037895821:3836]
2025-10-10T14:37:08.738808Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:08.739162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.739178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.739206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895821:3836], now have 1 active actors on pipe
2025-10-10T14:37:08.739465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:08.739641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602125037895821:3836]
2025-10-10T14:37:08.739677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:08.739701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:08.739825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2240 reason: status is not ok: tablet will be restarted right now sessionId: src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0
2025-10-10T14:37:08.740100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2240 sessionId: src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0 is DEAD
2025-10-10T14:37:08.740218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:08.740229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0] Write session will restart in 0.007923s
2025-10-10T14:37:08.740258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0] Write session: Do CDS request
2025-10-10T14:37:08.740265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:08.750002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:08.751952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:08.752187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:08.752198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:08.752219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:08.752271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:08.752312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602124255664905:2469]
2025-10-10T14:37:08.752818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:08.753092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:08.753132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:08.753440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:08.753501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.753507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.753508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.753510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.753511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.753512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.753514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.753516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.753517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.753520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.753522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.753523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.753524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.753530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.753543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.753547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.753551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.753555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.753559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.753563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.753567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.753570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.753575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.753578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.753582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.753586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.753593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.753602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.753608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.753613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.753620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.753625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.753633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.753639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.753648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.753668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.753677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.753682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.753687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.753694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.753699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.753704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.753709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.753713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.753722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.753727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.753733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.753741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.753745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.753750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.753759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.753764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.753804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:08.753829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.753973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:08.753991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2241
2025-10-10T14:37:08.754107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.754140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:08.754151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:08.754155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:08.754559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2241 sessionId:  describe result for acl check
2025-10-10T14:37:08.754598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:08.754600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:08.754602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:08.754609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602125037895877:4290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:08.755215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602125037895877:4290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:08.756390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:08.756715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:08.756728Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:08.756730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:08.756734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:08.756740Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2240 [2:7559602124255664905:2469]
2025-10-10T14:37:08.756753Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:08.756774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:08.756783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.756789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.756791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.756806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:08.756815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:08.756828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:08.756890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.756896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.756898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.756901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:08.756966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:08.756973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.756985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.757010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.757032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:08.757061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895828:2438], now have 1 active actors on pipe
2025-10-10T14:37:08.757073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602124255664899:2469]
2025-10-10T14:37:08.757080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602124255664899:2469]
2025-10-10T14:37:08.757082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602124255664899:2469]
2025-10-10T14:37:08.757095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:08.757107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:08.757114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:08.757116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:08.757095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2240
2025-10-10T14:37:08.757117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:08.757132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:08.757136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:08.757168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602124255664899:2469]
2025-10-10T14:37:08.757180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:08.757185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:08.757274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602125037895877:4290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:08.762103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602125037895877:4290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:08.762119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602125037895877:4290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:08.762123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602125037895877:4290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:08.762131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:08.762405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895910:4290], now have 1 active actors on pipe
2025-10-10T14:37:08.762455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2240
2025-10-10T14:37:08.762560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.762571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.762601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:08.762620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.762626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.762628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:08.762650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.762667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:08.762689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.762868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.762882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.762907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.762991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2241 partition: 0 MaxSeqNo: 40 sessionId: src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0
2025-10-10T14:37:08.763422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|801ce45e-5fc9d20-e772252a-91c1e6ec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:08.766302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0] Write session: try to update token
2025-10-10T14:37:08.766323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:08.776689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:08.776712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:08.776716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:08.776718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:08.776728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602124255664899:2469]
2025-10-10T14:37:08.776733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602124255664899:2469]
2025-10-10T14:37:08.776736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602124255664899:2469]
2025-10-10T14:37:08.776788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:08.776793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:08.776800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:08.776802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.776804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:08.776804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:08.776940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:08.782045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId: src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:08.785010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:08.839672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602125037895917:3836]
2025-10-10T14:37:08.839948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2240, pipe: [1:7559602125037895917:3836]
2025-10-10T14:37:08.892978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:08.893348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.893362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.893414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895917:3836], now have 1 active actors on pipe
2025-10-10T14:37:08.893668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:08.893688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602125037895917:3836]
2025-10-10T14:37:08.893737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:08.893740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:08.893831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2241 reason: error at write: Disconnected sessionId: src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0
2025-10-10T14:37:08.894060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2241 sessionId: src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0 is DEAD
2025-10-10T14:37:08.894322Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:08.894429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:08.894443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0] Write session will restart in 0.007855s
2025-10-10T14:37:08.894469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0] Write session: Do CDS request
2025-10-10T14:37:08.894476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:08.903993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.904037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:08.904070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:08.904099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2242
2025-10-10T14:37:08.904270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:08.904316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:08.904327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:08.904332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:08.904806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2242 sessionId:  describe result for acl check
2025-10-10T14:37:08.904850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:08.904857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:08.904859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:08.904866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602125037895960:4301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:08.905475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602125037895960:4301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:08.905848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:08.906061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:08.906072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:08.906086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:08.906142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:08.906208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602124255664985:2465]
2025-10-10T14:37:08.906797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:08.907122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:08.907177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:08.907515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:08.907581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.907588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.907589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.907590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.907591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.907592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.907593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.907594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.907596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.907597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.907598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.907599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.907601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.907607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.907618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.907621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.907627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.907631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.907635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.907638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.907642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.907646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.907649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.907653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.907656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.907673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.907681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.907689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:08.907695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.907701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:08.907708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.907713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:08.907718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.907723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:08.907727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.907732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:08.907736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.907741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:08.907746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.907751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:08.907754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.907759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:08.907763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.907768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:08.907771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.907776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:08.907781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.907786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.907790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.907794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.907798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.907802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.907847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:08.907861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602125037895960:4301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:08.910216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:08.910484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602125037895960:4301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:08.910530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:08.910542Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:08.910544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:08.910500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602125037895960:4301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:08.910503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602125037895960:4301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:08.910548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:08.910511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:08.910555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2241 [2:7559602124255664985:2465]
2025-10-10T14:37:08.910567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:08.910585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:08.910596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.910600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.910602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.910619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:08.910626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:08.910634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:08.910687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.910694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.910696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.910699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:08.910888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2241
2025-10-10T14:37:08.910894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2241
2025-10-10T14:37:08.910781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:08.910792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.910802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:08.910812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:08.910827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:08.910848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895994:4301], now have 1 active actors on pipe
2025-10-10T14:37:08.910851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037895918:2438], now have 1 active actors on pipe
2025-10-10T14:37:08.910858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602124255664979:2465]
2025-10-10T14:37:08.910860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602124255664979:2465]
2025-10-10T14:37:08.910862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602124255664979:2465]
2025-10-10T14:37:08.910874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:08.910886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:08.910888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:08.910892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:08.910894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:08.910901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:08.910903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:08.910926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602124255664979:2465]
2025-10-10T14:37:08.910929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:08.910932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:08.910963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.910969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.911000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:08.911008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:08.911011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:08.911013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:08.911024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:08.911034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:08.911049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.911215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.911223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.911237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:08.911317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2242 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0
2025-10-10T14:37:08.911730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d09343b7-189feb7e-48a7a1b3-1fa4574b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:08.914557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0] Write session: try to update token
2025-10-10T14:37:08.914579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:08.930777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId: src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:08.933903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:08.934528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:08.934557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:08.934581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:08.934585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:08.934591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:08.934594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:08.934602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602124255664979:2465]
2025-10-10T14:37:08.934612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602124255664979:2465]
2025-10-10T14:37:08.934616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602124255664979:2465]
2025-10-10T14:37:08.934672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:08.934688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:08.934689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:08.934692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:08.934697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:08.934700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:08.934853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:08.993738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602125037896015:3836]
2025-10-10T14:37:08.994040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2241, pipe: [1:7559602125037896015:3836]
2025-10-10T14:37:09.062926Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:09.063427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:09.063495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602125037896015:3836], now have 1 active actors on pipe
2025-10-10T14:37:09.063593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:09.063745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602125037896015:3836]
2025-10-10T14:37:09.063790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:09.074823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:09.076868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:09.077117Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:09.077130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:09.077144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:09.077212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:09.077181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:09.077210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:09.077236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2242 reason: error at write: Disconnected sessionId: src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0
2025-10-10T14:37:09.077270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602128550632402:2445]
2025-10-10T14:37:09.077420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2242 sessionId: src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0 is DEAD
2025-10-10T14:37:09.077576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:09.077585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0] Write session will restart in 0.005519s
2025-10-10T14:37:09.077614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0] Write session: Do CDS request
2025-10-10T14:37:09.077620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:09.077912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:09.084012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.084153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:09.084174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2243
2025-10-10T14:37:09.084356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.084409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:09.084421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:09.084426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:09.084568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:09.084663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:09.085044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:09.085071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2243 sessionId:  describe result for acl check
2025-10-10T14:37:09.085105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.085112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.085112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:09.085113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.085114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.085116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.085117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.085118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.085120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.085122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.085119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:09.085121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:09.085128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602129332863370:4318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:09.085123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.085124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.085125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.085126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.085134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.085147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.085151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.085155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.085159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.085167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.085171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.085175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.085178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.085182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.085185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.085189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.085192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.085202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.085211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.085217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.085222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.085226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.085231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.085235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.085239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.085244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.085249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.085253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.085258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.085263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.085268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.085273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.085278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.085284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.085288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.085292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.085297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.085302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.085306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.085311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.085317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.085322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.085327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.085381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:09.085708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602129332863370:4318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:09.088170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:09.088794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:09.088816Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:09.088818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:09.088822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:09.088830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2242 [2:7559602128550632402:2445]
2025-10-10T14:37:09.088845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:09.088868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:09.088872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.088875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.088878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.088899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:09.088906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:09.088914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:09.088982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.088996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.088999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.089002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:09.089079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:09.089087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.089099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.089112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.089131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:09.089161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863323:2438], now have 1 active actors on pipe
2025-10-10T14:37:09.089175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602128550632396:2445]
2025-10-10T14:37:09.089178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602128550632396:2445]
2025-10-10T14:37:09.089180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602128550632396:2445]
2025-10-10T14:37:09.089196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:09.089182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2242
2025-10-10T14:37:09.089211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:09.089411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602129332863370:4318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:09.089229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:09.089232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:09.089234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:09.089236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:09.089240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:09.089283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602128550632396:2445]
2025-10-10T14:37:09.089292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:09.089298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:09.096702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602129332863370:4318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:09.096726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602129332863370:4318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:09.096730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602129332863370:4318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:09.096741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:09.097083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863405:4318], now have 1 active actors on pipe
2025-10-10T14:37:09.097202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2242
2025-10-10T14:37:09.097258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.097275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.097322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|734076b6-38e9c7ca-6c28d956-d99b580_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:09.097359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.097372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.097388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:09.097411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.097438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:09.097477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.097652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.097661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.097678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.097791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2243 partition: 0 MaxSeqNo: 40 sessionId: src_id|734076b6-38e9c7ca-6c28d956-d99b580_0
2025-10-10T14:37:09.098209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4bb89f-c880068d-283c322a-c2e22caf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|734076b6-38e9c7ca-6c28d956-d99b580_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:09.101246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734076b6-38e9c7ca-6c28d956-d99b580_0] Write session: try to update token
2025-10-10T14:37:09.101273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734076b6-38e9c7ca-6c28d956-d99b580_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:09.101597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:09.101618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.101628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602128550632396:2445]
2025-10-10T14:37:09.101666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:09.101681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:09.101899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:09.102066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.102241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.102395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.102621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:09.102670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:09.117478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId: src_id|734076b6-38e9c7ca-6c28d956-d99b580_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:09.120372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:09.120741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.120773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.120797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:09.120808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.120812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:09.120814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:09.120831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602128550632396:2445]
2025-10-10T14:37:09.120841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602128550632396:2445]
2025-10-10T14:37:09.120854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602128550632396:2445]
2025-10-10T14:37:09.120897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:09.120909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:09.120914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:09.120920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:09.120927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.120938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:09.121085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:09.163732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602129332863421:3836]
2025-10-10T14:37:09.164030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2242, pipe: [1:7559602129332863421:3836]
2025-10-10T14:37:09.235732Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:09.236002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:09.236034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863421:3836], now have 1 active actors on pipe
2025-10-10T14:37:09.236153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:09.236217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602129332863421:3836]
2025-10-10T14:37:09.236249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:09.236277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:09.236286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:09.236368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2243 reason: error at write: Disconnected sessionId: src_id|734076b6-38e9c7ca-6c28d956-d99b580_0
2025-10-10T14:37:09.236556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2243 sessionId: src_id|734076b6-38e9c7ca-6c28d956-d99b580_0 is DEAD
2025-10-10T14:37:09.236741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734076b6-38e9c7ca-6c28d956-d99b580_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:09.236753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734076b6-38e9c7ca-6c28d956-d99b580_0] Write session will restart in 0.006113s
2025-10-10T14:37:09.236781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734076b6-38e9c7ca-6c28d956-d99b580_0] Write session: Do CDS request
2025-10-10T14:37:09.236788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734076b6-38e9c7ca-6c28d956-d99b580_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:09.243893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734076b6-38e9c7ca-6c28d956-d99b580_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.243968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:09.243983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2244
2025-10-10T14:37:09.244137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.244176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:09.244186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:09.244191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:09.244678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2244 sessionId:  describe result for acl check
2025-10-10T14:37:09.244720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:09.244723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:09.244725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:09.244731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602129332863463:4335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:09.245324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602129332863463:4335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:09.245911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:09.247604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:09.247739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602129332863463:4335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:09.247831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:09.247845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:09.247858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:09.247920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:09.247974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602128550632495:2437]
2025-10-10T14:37:09.248610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:09.248925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:09.248974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:09.249321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:09.249414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.249421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.249423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.249425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.249426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.249427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.249429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.249430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.249432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.249432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.249434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.249435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.249436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.249443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.249457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.249462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.249467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.249471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.249476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.249481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.249485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.249490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.249496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.249501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.249505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.249510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.249521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.249530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.249537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.249543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.249548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.249554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.249565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.249571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.249576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.249582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.249587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.249592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.249598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.249608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.249613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.249623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.249628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.249639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.249643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.249649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.249654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.249660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.249664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.249674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.249680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.249685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.249733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:09.250423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602129332863463:4335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:09.250443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602129332863463:4335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:09.250447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602129332863463:4335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:09.250456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:09.252182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:09.252599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:09.252616Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:09.252619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:09.252623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:09.252629Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2243 [2:7559602128550632495:2437]
2025-10-10T14:37:09.252645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:09.252662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:09.252665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.252669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.252673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.252690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:09.252704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:09.252711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:09.252772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.252781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.252783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.252786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:09.252855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:09.252864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.252877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.252890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.252915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:09.252938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863422:2438], now have 1 active actors on pipe
2025-10-10T14:37:09.252946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863500:4335], now have 1 active actors on pipe
2025-10-10T14:37:09.252954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602128550632490:2437]
2025-10-10T14:37:09.252961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602128550632490:2437]
2025-10-10T14:37:09.252963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602128550632490:2437]
2025-10-10T14:37:09.252977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:09.252968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2243
2025-10-10T14:37:09.252990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2243
2025-10-10T14:37:09.252996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:09.253012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:09.253015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:09.253017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:09.253019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:09.253025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:09.253068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.253079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.253097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602128550632490:2437]
2025-10-10T14:37:09.253106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:09.253120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:09.253139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58c90774-58cd207b-cb188d39-9902e9ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:09.253152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.253160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.253162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:09.253173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.253189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:09.253216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.253419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.253429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.253448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.253565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2244 partition: 0 MaxSeqNo: 40 sessionId: src_id|58c90774-58cd207b-cb188d39-9902e9ca_0
2025-10-10T14:37:09.253941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734076b6-38e9c7ca-6c28d956-d99b580_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|58c90774-58cd207b-cb188d39-9902e9ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:09.256687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c90774-58cd207b-cb188d39-9902e9ca_0] Write session: try to update token
2025-10-10T14:37:09.256705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c90774-58cd207b-cb188d39-9902e9ca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:09.271084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId: src_id|58c90774-58cd207b-cb188d39-9902e9ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:09.272742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:09.272767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.272770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:09.272772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:09.272781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602128550632490:2437]
2025-10-10T14:37:09.272785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602128550632490:2437]
2025-10-10T14:37:09.272791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602128550632490:2437]
2025-10-10T14:37:09.272843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:09.272849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:09.272852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.272854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:09.272858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:09.272863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:09.272999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:09.273878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:09.336270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602129332863508:3836]
2025-10-10T14:37:09.336599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2243, pipe: [1:7559602129332863508:3836]
2025-10-10T14:37:09.392490Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:09.392853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.392868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.392912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863508:3836], now have 1 active actors on pipe
2025-10-10T14:37:09.393170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:09.393222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602129332863508:3836]
2025-10-10T14:37:09.393230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:09.393263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:09.393371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2244 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58c90774-58cd207b-cb188d39-9902e9ca_0
2025-10-10T14:37:09.393583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2244 sessionId: src_id|58c90774-58cd207b-cb188d39-9902e9ca_0 is DEAD
2025-10-10T14:37:09.393738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c90774-58cd207b-cb188d39-9902e9ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:09.393747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c90774-58cd207b-cb188d39-9902e9ca_0] Write session will restart in 0.007525s
2025-10-10T14:37:09.393773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c90774-58cd207b-cb188d39-9902e9ca_0] Write session: Do CDS request
2025-10-10T14:37:09.393779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c90774-58cd207b-cb188d39-9902e9ca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:09.402968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c90774-58cd207b-cb188d39-9902e9ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.403050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:09.403071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2245
2025-10-10T14:37:09.403208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.403247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:09.403258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:09.403262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:09.403436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:09.403751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2245 sessionId:  describe result for acl check
2025-10-10T14:37:09.403794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:09.403801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:09.403803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:09.403811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602129332863553:4342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:09.404386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602129332863553:4342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:09.405279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:09.405501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:09.405515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:09.405528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:09.405652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:09.405697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602128550632579:2438]
2025-10-10T14:37:09.406305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:09.406318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602129332863553:4342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:09.406632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:09.406683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:09.407012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:09.407078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.407084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.407085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.407086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.407087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.407087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.407089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.407090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.407091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.407092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.407093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.407094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.407096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.407102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.407115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.407119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.407124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.407133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.407137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.407141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.407145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.407149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.407153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.407157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.407161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.407166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.407179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.407192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.407203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.407209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.407213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.407218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.407222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.407228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.407237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.407247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.407255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.407265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.407274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.407283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.407289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.407294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.407298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.407304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.407308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.407313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.407317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.407322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.407326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.407332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.407337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.407342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.407387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:09.409865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:09.409887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602129332863553:4342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:09.409906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602129332863553:4342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:09.409911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602129332863553:4342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:09.409923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:09.410283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:09.410293Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:09.410296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:09.410303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:09.410310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2244 [2:7559602128550632579:2438]
2025-10-10T14:37:09.410324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:09.410341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:09.410350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.410353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.410356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.410373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:09.410385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:09.410397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:09.410459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.410467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.410469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.410472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:09.410539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:09.410547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.410559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.410572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.410591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:09.410620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863588:4342], now have 1 active actors on pipe
2025-10-10T14:37:09.410629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863509:2438], now have 1 active actors on pipe
2025-10-10T14:37:09.410637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602128550632573:2438]
2025-10-10T14:37:09.410639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602128550632573:2438]
2025-10-10T14:37:09.410641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602128550632573:2438]
2025-10-10T14:37:09.410651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2244
2025-10-10T14:37:09.410663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2244
2025-10-10T14:37:09.410658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:09.410669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:09.410673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:09.410675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:09.410676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:09.410704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:09.410707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:09.410745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.410755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.410775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602128550632573:2438]
2025-10-10T14:37:09.410787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:09.410793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:09.410817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:09.410830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.410841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.410843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:09.410854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.410865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:09.410890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.411041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.411049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.411063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.411142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2245 partition: 0 MaxSeqNo: 40 sessionId: src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0
2025-10-10T14:37:09.411510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c90774-58cd207b-cb188d39-9902e9ca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:09.414290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0] Write session: try to update token
2025-10-10T14:37:09.414311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:09.428413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId: src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:09.430179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:09.430202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.430205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:09.430207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:09.430219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602128550632573:2438]
2025-10-10T14:37:09.430223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602128550632573:2438]
2025-10-10T14:37:09.430227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602128550632573:2438]
2025-10-10T14:37:09.430268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:09.430276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:09.430286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:09.430286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.430289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:09.430293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:09.430428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:09.431594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:09.493397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602129332863596:3836]
2025-10-10T14:37:09.493666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2244, pipe: [1:7559602129332863596:3836]
2025-10-10T14:37:09.548937Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:09.549318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.549353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.549407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863596:3836], now have 1 active actors on pipe
2025-10-10T14:37:09.549625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:09.549630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602129332863596:3836]
2025-10-10T14:37:09.549649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:09.549651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:09.549680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:09.549707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2245 reason: error at write: Disconnected sessionId: src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0
2025-10-10T14:37:09.549917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2245 sessionId: src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0 is DEAD
2025-10-10T14:37:09.550119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:09.550131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0] Write session will restart in 0.006632s
2025-10-10T14:37:09.550158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0] Write session: Do CDS request
2025-10-10T14:37:09.550167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:09.557888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.557979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:09.558000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2246
2025-10-10T14:37:09.558148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.558185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:09.558196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:09.558200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:09.558697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2246 sessionId:  describe result for acl check
2025-10-10T14:37:09.558730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:09.558737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:09.558739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:09.558745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602129332863641:4346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:09.559327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602129332863641:4346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:09.559365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:09.561197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:09.561418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:09.561430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:09.561442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:09.561484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602129332863641:4346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:09.561505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:09.561594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602128550632662:2426]
2025-10-10T14:37:09.562075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:09.562390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:09.562438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:09.562706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:09.562755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.562761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.562761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.562762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.562765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.562766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.562767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.562767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.562768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.562769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.562769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.562770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.562771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.562775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.562784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.562786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.562788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.562790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.562792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.562794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.562796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.562798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.562801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.562803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.562805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.562807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.562812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.562817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.562823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.562828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.562833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.562838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.562841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.562846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.562852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.562857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.562866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.562870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.562875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.562886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.562895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.562903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.562906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.562909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.562911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.562914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.562916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.562920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.562922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.562925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.562927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.562930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.562953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:09.563682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602129332863641:4346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:09.563693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602129332863641:4346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:09.563696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602129332863641:4346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:09.563703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:09.565242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:09.565618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:09.565633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:09.565635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:09.565638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:09.565644Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2245 [2:7559602128550632662:2426]
2025-10-10T14:37:09.565654Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:09.565668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:09.565670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.565672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.565678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.565691Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:09.565700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:09.565706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:09.565759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.565771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.565772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.565774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:09.565831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:09.565840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.565852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.565871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.565886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:09.565906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602128550632657:2426]
2025-10-10T14:37:09.565911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602128550632657:2426]
2025-10-10T14:37:09.565912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602128550632657:2426]
2025-10-10T14:37:09.565919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:09.565931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863597:2438], now have 1 active actors on pipe
2025-10-10T14:37:09.565930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:09.565934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:09.565934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863677:4346], now have 1 active actors on pipe
2025-10-10T14:37:09.565935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:09.565942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:09.565956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:09.565964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:09.565988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602128550632657:2426]
2025-10-10T14:37:09.565999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:09.566029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:09.566034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2245
2025-10-10T14:37:09.566079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2245
2025-10-10T14:37:09.566137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.566145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.566168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:09.566181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.566185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.566186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:09.566195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.566208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:09.566222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.566415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.566423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.566437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.566528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2246 partition: 0 MaxSeqNo: 40 sessionId: src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0
2025-10-10T14:37:09.566913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b0a4f48-18c079ff-39dab3eb-b0724e3c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:09.569591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0] Write session: try to update token
2025-10-10T14:37:09.569612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:09.583617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:09.583634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.583661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602128550632657:2426]
2025-10-10T14:37:09.583717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:09.583719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:09.583733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId: src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:09.583910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:09.584073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.584230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.584382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.584578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:09.584625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:09.586536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:09.586774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.586795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.586831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:09.586937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:09.595244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:09.595263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.595267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:09.595269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:09.595280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602128550632657:2426]
2025-10-10T14:37:09.595284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602128550632657:2426]
2025-10-10T14:37:09.595288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602128550632657:2426]
2025-10-10T14:37:09.595340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:09.595346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:09.595352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.595353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:09.595355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:09.595357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:09.595496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:09.649611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602129332863686:3836]
2025-10-10T14:37:09.649910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2245, pipe: [1:7559602129332863686:3836]
2025-10-10T14:37:09.710197Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:09.718716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.718749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.718939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.719016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.719093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.719167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.719214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.719227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.719300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.719368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.719434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.719501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.719547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.719554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.719629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.719709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.719780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.719849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.719895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.719903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.719973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.720314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.720390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.720457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.720502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.720510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.720581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.720655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.720727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.720805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.720856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.720864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.720936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.721006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.721075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.721143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.721190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.721199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.721266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.721361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.721434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.721503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.721550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.721557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.721633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.721702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.721769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.721839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.721884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.721891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.721962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.722044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.722110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.722180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.722226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.722233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.722307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.722373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.722440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.722509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.722555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.722562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.722635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863686:3836], now have 1 active actors on pipe
2025-10-10T14:37:09.722908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:09.722932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602129332863686:3836]
2025-10-10T14:37:09.722980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:09.722991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:09.723025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2246 reason: error at write: Disconnected sessionId: src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0
2025-10-10T14:37:09.723257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2246 sessionId: src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0 is DEAD
2025-10-10T14:37:09.723362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:09.723402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:09.723414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0] Write session will restart in 0.008784s
2025-10-10T14:37:09.723450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0] Write session: Do CDS request
2025-10-10T14:37:09.723457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:09.732955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:09.733831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.733880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:09.733897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2247
2025-10-10T14:37:09.734058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.734110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:09.734121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:09.734126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:09.734552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2247 sessionId:  describe result for acl check
2025-10-10T14:37:09.734586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:09.734587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:09.734589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:09.734597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602129332863738:4361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:09.734698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:09.734914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:09.734925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:09.734937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:09.734999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:09.735046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602128550632748:2433]
2025-10-10T14:37:09.735096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602129332863738:4361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:09.735699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:09.736066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:09.736118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:09.736450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:09.736508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.736514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.736516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.736517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.736518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.736520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.736521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.736522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.736523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.736525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.736526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.736527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.736528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.736538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.736551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.736555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.736559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.736563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.736568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.736572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.736576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.736579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.736583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.736589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.736593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.736597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.736604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.736612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.736619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.736630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.736635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.736640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.736650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.736655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.736665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.736670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.736679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.736685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.736694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.736700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.736708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.736713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.736718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.736723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.736728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.736734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.736743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.736749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.736753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.736760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.736769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.736775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.736820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:09.737811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602129332863738:4361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:09.739184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:09.739502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:09.739515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:09.739516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:09.739519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:09.739525Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2246 [2:7559602128550632748:2433]
2025-10-10T14:37:09.739533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:09.739546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:09.739548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.739550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.739551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.739564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:09.739570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:09.739576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:09.739631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.739636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.739637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.739649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:09.739713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:09.739718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.739726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.739733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.739743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:09.739763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863688:2438], now have 1 active actors on pipe
2025-10-10T14:37:09.739773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602128550632742:2433]
2025-10-10T14:37:09.739774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602128550632742:2433]
2025-10-10T14:37:09.739776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602128550632742:2433]
2025-10-10T14:37:09.739786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:09.739796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:09.739804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:09.739807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:09.739809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:09.739810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:09.739812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:09.739784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2246
2025-10-10T14:37:09.739830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602128550632742:2433]
2025-10-10T14:37:09.739837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:09.739839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:09.740403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602129332863738:4361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:09.740417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602129332863738:4361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:09.740420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602129332863738:4361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:09.740428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:09.740612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863774:4361], now have 1 active actors on pipe
2025-10-10T14:37:09.740663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2246
2025-10-10T14:37:09.740736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.740752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.740792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:09.740806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.740815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.740817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:09.740829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.740847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:09.740866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.740993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.741000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.741015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.741093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2247 partition: 0 MaxSeqNo: 40 sessionId: src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0
2025-10-10T14:37:09.741485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fe8fa42-e0f79458-b5ac0624-943e8cb4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:09.744162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0] Write session: try to update token
2025-10-10T14:37:09.744183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:09.751430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:09.751451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.751461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602128550632742:2433]
2025-10-10T14:37:09.751513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:09.751513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:09.751712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:09.751873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.752017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.752172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.752372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:09.752413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:09.758947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId: src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:09.761691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:09.761925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.761955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.762013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:09.762094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:09.768908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:09.768931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.768934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:09.768936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:09.768948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602128550632742:2433]
2025-10-10T14:37:09.768951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602128550632742:2433]
2025-10-10T14:37:09.768958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602128550632742:2433]
2025-10-10T14:37:09.769000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:09.769004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:09.769010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:09.769010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:09.769019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.769021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:09.769171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:09.823408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602129332863785:3836]
2025-10-10T14:37:09.823690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2246, pipe: [1:7559602129332863785:3836]
2025-10-10T14:37:09.887478Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:09.895965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.896001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.896188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.896258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.896326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.896410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.896454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.896459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.896541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.896606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.896668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.896736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.896782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.896785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.896858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.896920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.896985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.897051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.897093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.897096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.897168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.897234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.897302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.897497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.897551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.897560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.897635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.897704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.897771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.897836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.897890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.897898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.897969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.898041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.898107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.898176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.898224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.898232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.898305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.898370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.898445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.898508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.898557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.898566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.898640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.898704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.898769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.898836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.898891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.898900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.898969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.899033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.899103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.899169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.899215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.899223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.899338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:09.899402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:09.899469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:09.899536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:09.899584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:09.899593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:09.899672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863785:3836], now have 1 active actors on pipe
2025-10-10T14:37:09.899883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:09.899895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602129332863785:3836]
2025-10-10T14:37:09.899920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:09.899922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:09.899950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2247 reason: error at write: Disconnected sessionId: src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0
2025-10-10T14:37:09.900221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2247 sessionId: src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0 is DEAD
2025-10-10T14:37:09.900373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:09.900386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0] Write session will restart in 0.006091s
2025-10-10T14:37:09.900427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0] Write session: Do CDS request
2025-10-10T14:37:09.900433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:09.900815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:09.907951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.907998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:09.908019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2248
2025-10-10T14:37:09.908204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:09.908243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:09.908254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:09.908259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:09.908702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2248 sessionId:  describe result for acl check
2025-10-10T14:37:09.908751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:09.908760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:09.908763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:09.908769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602129332863833:4363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:09.909370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602129332863833:4363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:09.910174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:09.911755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:09.911977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:09.911993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:09.912007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:09.912070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:09.912130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602128550632834:2431]
2025-10-10T14:37:09.912277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602129332863833:4363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:09.912742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:09.913090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:09.913147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:09.913506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:09.913590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.913599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.913600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.913601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.913603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.913604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.913605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.913606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.913608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.913609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.913610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.913612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.913613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.913619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.913632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.913636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.913641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.913645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.913649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.913653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.913658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.913662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.913667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.913671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.913675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.913679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.913688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.913696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:09.913703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.913710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:09.913715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.913721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:09.913731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.913737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:09.913742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.913748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:09.913752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.913757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:09.913762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.913768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:09.913779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.913784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:09.913789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.913800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:09.913804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.913816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:09.913820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.913831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.913835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.913842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.913851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.913856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.913897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:09.916274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602129332863833:4363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:09.916291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602129332863833:4363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:09.916295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602129332863833:4363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:09.916304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:09.916379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:09.916841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:09.916859Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:09.916867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:09.916872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:09.916883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2247 [2:7559602128550632834:2431]
2025-10-10T14:37:09.916900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:09.916931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:09.916941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.916953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.916957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.916980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:09.917021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:09.917031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:09.917117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.917127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.917129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.917132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:09.917207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:09.917217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.917229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:09.917241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:09.917258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:09.917285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863787:2438], now have 1 active actors on pipe
2025-10-10T14:37:09.917294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863870:4363], now have 1 active actors on pipe
2025-10-10T14:37:09.917301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602128550632828:2431]
2025-10-10T14:37:09.917308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602128550632828:2431]
2025-10-10T14:37:09.917310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602128550632828:2431]
2025-10-10T14:37:09.917325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:09.917374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:09.917376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:09.917380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:09.917383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:09.917396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:09.917401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:09.917375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2247
2025-10-10T14:37:09.917435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2247
2025-10-10T14:37:09.917430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602128550632828:2431]
2025-10-10T14:37:09.917449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:09.917474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:09.917498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.917509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.917540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:09.917554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:09.917563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:09.917565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:09.917576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:09.917594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:09.917614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.917788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.917798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.917822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:09.917918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2248 partition: 0 MaxSeqNo: 40 sessionId: src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0
2025-10-10T14:37:09.918312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebba0caf-a4f830cf-37d29fcc-7a5154d4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:09.921075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0] Write session: try to update token
2025-10-10T14:37:09.921103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:09.929313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:09.929350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.929362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602128550632828:2431]
2025-10-10T14:37:09.929415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:09.929416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:09.929609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:09.929746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.929890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.930041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:09.930254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:09.930299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:09.935409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId: src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:09.938263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:09.938495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:09.938520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:09.938581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:09.938676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:09.947441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:09.947466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:09.947470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:09.947472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:09.947487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602128550632828:2431]
2025-10-10T14:37:09.947491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602128550632828:2431]
2025-10-10T14:37:09.947495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602128550632828:2431]
2025-10-10T14:37:09.947545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:09.947551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:09.947557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:09.947558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:09.947560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:09.947561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:09.947719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:09.999819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602129332863878:3836]
2025-10-10T14:37:10.000128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2247, pipe: [1:7559602129332863878:3836]
2025-10-10T14:37:10.065773Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:10.073644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.073682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.073892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.073955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.074023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.074088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.074139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.074147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.074215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.074276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.074337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.074402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.074444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.074450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.074516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.074579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.074643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.074706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.074751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.074757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.074823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.074886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.074948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.075010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.075054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.075060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.075125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.075186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.075251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.075310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.075354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.075359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.075423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.075481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.075542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.075602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.075663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.075670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.075733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.075791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.075855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.075915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.075957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.075963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.076027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.076086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.076146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.076208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.076250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.076255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.076318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.076373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.076430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.076487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.076539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.076550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.076623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.076681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.076749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.076813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.076863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.076872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.076940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602129332863878:3836], now have 1 active actors on pipe
2025-10-10T14:37:10.077153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:10.077204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:10.077219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602129332863878:3836]
2025-10-10T14:37:10.077231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:10.077270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2248 reason: error at write: Disconnected sessionId: src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0
2025-10-10T14:37:10.077503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2248 sessionId: src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0 is DEAD
2025-10-10T14:37:10.077692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:10.077705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0] Write session will restart in 0.007140s
2025-10-10T14:37:10.077731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0] Write session: Do CDS request
2025-10-10T14:37:10.077738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:10.078133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:10.085861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.085941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:10.085958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2249
2025-10-10T14:37:10.086071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.086108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:10.086118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:10.086122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:10.086536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2249 sessionId:  describe result for acl check
2025-10-10T14:37:10.086570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:10.086572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:10.086573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:10.086579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602133627831250:4401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:10.086672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:10.087221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602133627831250:4401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:10.088412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:10.088617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:10.088632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:10.088645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:10.088707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:10.088752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602132845600256:2392]
2025-10-10T14:37:10.089309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602133627831250:4401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:10.089416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:10.089730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:10.089785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:10.090119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:10.090189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.090197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.090198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.090200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.090201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.090203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.090204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.090205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.090206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.090208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.090209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.090210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.090212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.090218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.090232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.090237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.090241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.090245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.090250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.090256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.090260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.090263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.090267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.090270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.090273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.090278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.090285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.090294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.090301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.090307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.090311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.090316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.090320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.090325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.090330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.090335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.090340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.090345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.090350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.090356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.090366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.090373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.090377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.090388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.090392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.090411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.090416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.090421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.090426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.090432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.090437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.090442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.090483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:10.092814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602133627831250:4401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:10.092830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602133627831250:4401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:10.092834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602133627831250:4401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:10.092843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:10.092881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:10.093212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:10.093227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:10.093229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:10.093233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:10.093239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2248 [2:7559602132845600256:2392]
2025-10-10T14:37:10.093251Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:10.093268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:10.093277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.093280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.093283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.093299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:10.093312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:10.093320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:10.093400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.093412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.093414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.093417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:10.093486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:10.093493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.093505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.093522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.093545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:10.093571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831282:4401], now have 1 active actors on pipe
2025-10-10T14:37:10.093580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831202:2438], now have 1 active actors on pipe
2025-10-10T14:37:10.093589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602132845600251:2392]
2025-10-10T14:37:10.093591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602132845600251:2392]
2025-10-10T14:37:10.093593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602132845600251:2392]
2025-10-10T14:37:10.093606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:10.093625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:10.093614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2248
2025-10-10T14:37:10.093624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2248
2025-10-10T14:37:10.093632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:10.093642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:10.093642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:10.093645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:10.093645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:10.093668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602132845600251:2392]
2025-10-10T14:37:10.093675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:10.093677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:10.093690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.093695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.093744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:10.093756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.093764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.093766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:10.093777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.093789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:10.093806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.094005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.094018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.094035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.094132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2249 partition: 0 MaxSeqNo: 40 sessionId: src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0
2025-10-10T14:37:10.094504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa4144e-d7756218-cd29a5fc-e35dd70b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:10.097289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0] Write session: try to update token
2025-10-10T14:37:10.097308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:10.112024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId: src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:10.113935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:10.113963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.113966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:10.113968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:10.113979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602132845600251:2392]
2025-10-10T14:37:10.113984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602132845600251:2392]
2025-10-10T14:37:10.113989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602132845600251:2392]
2025-10-10T14:37:10.114045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:10.114054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:10.114060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.114061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:10.114063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:10.114065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:10.114209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:10.114907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:10.177474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602133627831302:3836]
2025-10-10T14:37:10.177767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2248, pipe: [1:7559602133627831302:3836]
2025-10-10T14:37:10.231962Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:10.232376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.232393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.232438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831302:3836], now have 1 active actors on pipe
2025-10-10T14:37:10.232667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:10.232705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:10.232724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:10.232733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:10.232790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2249 reason: error at write: Disconnected sessionId: src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0
2025-10-10T14:37:10.232800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602133627831302:3836]
2025-10-10T14:37:10.233026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2249 sessionId: src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0 is DEAD
2025-10-10T14:37:10.233228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:10.233241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0] Write session will restart in 0.009910s
2025-10-10T14:37:10.233266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0] Write session: Do CDS request
2025-10-10T14:37:10.233284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:10.242604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:10.244468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:10.244689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:10.244701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:10.244713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:10.244769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:10.244817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602132845600356:2404]
2025-10-10T14:37:10.244915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.244957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:10.244973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2250
2025-10-10T14:37:10.245164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.245195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:10.245205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:10.245210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:10.245442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:10.245667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2250 sessionId:  describe result for acl check
2025-10-10T14:37:10.245710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:10.245716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:10.245718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:10.245724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602133627831357:4392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:10.245731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:10.245777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:10.246119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:10.246172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.246178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.246179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.246181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.246182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.246183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.246185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.246186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.246187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.246188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.246191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.246193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.246194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.246200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.246211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.246214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.246217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.246221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.246225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.246228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.246232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.246235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.246240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.246243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.246247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.246251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.246258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.246266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.246273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.246277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.246281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.246286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.246272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602133627831357:4392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:10.246289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.246293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.246306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.246311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.246315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.246320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.246324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.246329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.246332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.246338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.246342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.246347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.246351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.246355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.246360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.246364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.246368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.246374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.246378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.246383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.246425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:10.248633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602133627831357:4392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:10.248920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:10.249244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:10.249257Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:10.249259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:10.249263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:10.249271Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2249 [2:7559602132845600356:2404]
2025-10-10T14:37:10.249284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:10.249308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:10.249311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.249314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.249317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.249350Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:10.249363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:10.249376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:10.249438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.249445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.249446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.249449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:10.249516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:10.249527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.249539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.249549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.249566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:10.249595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831304:2438], now have 1 active actors on pipe
2025-10-10T14:37:10.249607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602132845600351:2404]
2025-10-10T14:37:10.249609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602132845600351:2404]
2025-10-10T14:37:10.249611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602132845600351:2404]
2025-10-10T14:37:10.249627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:10.249631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2249
2025-10-10T14:37:10.249648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:10.249649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:10.249653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:10.249655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:10.249672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:10.249676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:10.249705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602132845600351:2404]
2025-10-10T14:37:10.249716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:10.249725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:10.254841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602133627831357:4392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:10.254860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602133627831357:4392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:10.254864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602133627831357:4392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:10.254874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:10.255135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831392:4392], now have 1 active actors on pipe
2025-10-10T14:37:10.255201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2249
2025-10-10T14:37:10.255275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.255288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.255338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26d93794-f305affd-f7c8812a-3edea38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:10.255357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.255367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.255372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:10.255387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.255421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:10.255446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.255613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.255625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.255649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.255756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2250 partition: 0 MaxSeqNo: 40 sessionId: src_id|26d93794-f305affd-f7c8812a-3edea38_0
2025-10-10T14:37:10.256149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa929dba-bb46a0b9-b8cce95b-1c8711f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26d93794-f305affd-f7c8812a-3edea38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:10.258836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d93794-f305affd-f7c8812a-3edea38_0] Write session: try to update token
2025-10-10T14:37:10.258855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d93794-f305affd-f7c8812a-3edea38_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:10.261184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:10.261201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.261211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602132845600351:2404]
2025-10-10T14:37:10.261259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:10.261259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:10.261490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:10.261635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.261777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.261916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.262112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:10.262155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:10.273233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId: src_id|26d93794-f305affd-f7c8812a-3edea38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:10.276041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:10.276289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.276315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.276351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:10.276441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:10.280071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:10.280090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.280094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:10.280096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:10.280107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602132845600351:2404]
2025-10-10T14:37:10.280111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602132845600351:2404]
2025-10-10T14:37:10.280116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602132845600351:2404]
2025-10-10T14:37:10.280165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:10.280169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:10.280177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.280180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:10.280180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:10.280184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:10.280322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:10.333490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602133627831396:3836]
2025-10-10T14:37:10.333805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2249, pipe: [1:7559602133627831396:3836]
2025-10-10T14:37:10.392456Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:10.401081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.401122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.401317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.401411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.401477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.401560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.401615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.401627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.401703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.401770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.401840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.401915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.401966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.401974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.402048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.402119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.402186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.402251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.402300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.402310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.402383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.402452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.402514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.402581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.402628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.402635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.402707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.402773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.402847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.402920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.402975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.402983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.403057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.403125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.403195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.403261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.403309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.403319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.403392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.403458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.403527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.403595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.403656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.403666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.403739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.403800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.403869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.403936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.403982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.403989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.404058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.404118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.404180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.404246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.404292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.404302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.404370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.404429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.404492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.404556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.404604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.404612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.404681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831396:3836], now have 1 active actors on pipe
2025-10-10T14:37:10.404940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:10.404952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602133627831396:3836]
2025-10-10T14:37:10.405003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:10.405006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:10.405040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2250 reason: error at write: Disconnected sessionId: src_id|26d93794-f305affd-f7c8812a-3edea38_0
2025-10-10T14:37:10.405365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2250 sessionId: src_id|26d93794-f305affd-f7c8812a-3edea38_0 is DEAD
2025-10-10T14:37:10.405516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d93794-f305affd-f7c8812a-3edea38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:10.405525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d93794-f305affd-f7c8812a-3edea38_0] Write session will restart in 0.009909s
2025-10-10T14:37:10.405550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d93794-f305affd-f7c8812a-3edea38_0] Write session: Do CDS request
2025-10-10T14:37:10.405555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d93794-f305affd-f7c8812a-3edea38_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:10.405920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:10.415083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:10.416882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26d93794-f305affd-f7c8812a-3edea38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.416941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:10.416958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2251
2025-10-10T14:37:10.417080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:10.417173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.417226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:10.417237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:10.417241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:10.417319Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:10.417352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:10.417366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:10.417439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:10.417492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602132845600446:2398]
2025-10-10T14:37:10.417685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2251 sessionId:  describe result for acl check
2025-10-10T14:37:10.417715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:10.417722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:10.417723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:10.417729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602133627831450:4404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:10.418091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:10.418271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602133627831450:4404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:10.418424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:10.418496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:10.418804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:10.418857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.418864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.418866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.418867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.418868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.418869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.418871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.418872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.418873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.418874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.418875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.418877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.418878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.418894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.418907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.418911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.418915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.418919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.418923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.418927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.418931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.418935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.418939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.418943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.418947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.418951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.418959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.418969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.418975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.418980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.418986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.418991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.418996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.419001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.419005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.419010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.419014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.419019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.419024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.419034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.419038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.419043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.419047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.419052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.419056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.419061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.419075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.419086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.419090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.419095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.419099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.419109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.419148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:10.421034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602133627831450:4404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:10.421517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:10.421881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:10.421894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:10.421897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:10.421901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:10.421908Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2250 [2:7559602132845600446:2398]
2025-10-10T14:37:10.421919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:10.421941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:10.421949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.421953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.421956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.421972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:10.421984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:10.421991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:10.422059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.422066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.422067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.422070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:10.422133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:10.422140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.422152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.422167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.422188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:10.422215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831397:2438], now have 1 active actors on pipe
2025-10-10T14:37:10.422227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602132845600440:2398]
2025-10-10T14:37:10.422229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602132845600440:2398]
2025-10-10T14:37:10.422231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602132845600440:2398]
2025-10-10T14:37:10.422245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:10.422235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2250
2025-10-10T14:37:10.422258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:10.422261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:10.422265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:10.422278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:10.422279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:10.422282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:10.422316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602132845600440:2398]
2025-10-10T14:37:10.422328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:10.422334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:10.427419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602133627831450:4404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:10.427438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602133627831450:4404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:10.427442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602133627831450:4404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:10.427451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:10.427762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831487:4404], now have 1 active actors on pipe
2025-10-10T14:37:10.427814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2250
2025-10-10T14:37:10.427902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.427913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.427959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:10.427976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.427987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.427989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:10.428004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.428027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:10.428050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.428293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.428304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.428318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.428421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2251 partition: 0 MaxSeqNo: 40 sessionId: src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0
2025-10-10T14:37:10.428833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26d93794-f305affd-f7c8812a-3edea38_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:10.431441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0] Write session: try to update token
2025-10-10T14:37:10.431458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:10.433744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:10.433760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.433770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602132845600440:2398]
2025-10-10T14:37:10.433813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:10.433816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:10.433988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:10.434124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.434260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.434391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.434584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:10.434625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:10.445450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId: src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:10.448418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:10.448654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.448679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.448731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:10.448814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:10.452007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:10.452026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.452033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:10.452036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:10.452047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602132845600440:2398]
2025-10-10T14:37:10.452050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602132845600440:2398]
2025-10-10T14:37:10.452052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602132845600440:2398]
2025-10-10T14:37:10.452090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:10.452096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.452098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:10.452102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:10.452109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:10.452113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:10.452233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:10.505153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602133627831491:3836]
2025-10-10T14:37:10.505490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2250, pipe: [1:7559602133627831491:3836]
2025-10-10T14:37:10.566630Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:10.574226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.574254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.574408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.574474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.574542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.574616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.574663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.574676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.574744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.574808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.574875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.574948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.574988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.574994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.575056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.575111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.575168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.575223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.575262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.575269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.575327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.575387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.575445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.575501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.575542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.575547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.575607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.575678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.575736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.575805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.575851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.575857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.575918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.575971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.576027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.576087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.576129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.576135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.576193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.576247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.576307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.576363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.576405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.576413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.576483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.576543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.576607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.576665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.576704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.576709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.576767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.576821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.576880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.576937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.576983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.576989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.577048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.577101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.577158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.577214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.577258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.577264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.577315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831491:3836], now have 1 active actors on pipe
2025-10-10T14:37:10.577606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:10.577624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602133627831491:3836]
2025-10-10T14:37:10.577654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:10.577657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:10.577689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2251 reason: error at write: Disconnected sessionId: src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0
2025-10-10T14:37:10.577923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2251 sessionId: src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0 is DEAD
2025-10-10T14:37:10.578040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:10.578051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0] Write session will restart in 0.009894s
2025-10-10T14:37:10.578080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0] Write session: Do CDS request
2025-10-10T14:37:10.578087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:10.578199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:10.588407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:10.588894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.588987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:10.589010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2252
2025-10-10T14:37:10.589128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.589165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:10.589178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:10.589183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:10.589619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2252 sessionId:  describe result for acl check
2025-10-10T14:37:10.589654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:10.589656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:10.589657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:10.589663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602133627831546:4408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:10.590187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602133627831546:4408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:10.590182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:10.590431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:10.590445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:10.590460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:10.590533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:10.590580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602132845600536:2394]
2025-10-10T14:37:10.591168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:10.591475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:10.591521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:10.591844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:10.591911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.591917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.591919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.591920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.591921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.591922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.591923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.591925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.591926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.591927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.591928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.591929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.591930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.591936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.591948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.591952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.591957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.591961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.591965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.591969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.591973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.591977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.591981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.591985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.591989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.591993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.592000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.592009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.592017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.592024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.592028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.592033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.592037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.592042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.592047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.592052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.592055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.592060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.592063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.592066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.592069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.592072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.592075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.592080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.592089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.592094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.592098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.592103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.592108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.592114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.592118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.592123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.592159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:10.592734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602133627831546:4408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:10.594521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:10.594844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:10.594858Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:10.594861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:10.594865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:10.594871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2251 [2:7559602132845600536:2394]
2025-10-10T14:37:10.594884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:10.594905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:10.594909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.594912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.594914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.594933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:10.594945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:10.594952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:10.595013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.595021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.595023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.595025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:10.595092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:10.595100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.595114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.595129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.595150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:10.595179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831492:2438], now have 1 active actors on pipe
2025-10-10T14:37:10.595188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602132845600530:2394]
2025-10-10T14:37:10.595190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602132845600530:2394]
2025-10-10T14:37:10.595181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2251
2025-10-10T14:37:10.595192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602132845600530:2394]
2025-10-10T14:37:10.595210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:10.595225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:10.595230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:10.595235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:10.595237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:10.595247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:10.595251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:10.595280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602132845600530:2394]
2025-10-10T14:37:10.595295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:10.595302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:10.595421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602133627831546:4408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:10.595433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602133627831546:4408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:10.595436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602133627831546:4408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:10.595445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:10.595654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831581:4408], now have 1 active actors on pipe
2025-10-10T14:37:10.595701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2251
2025-10-10T14:37:10.595764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.595777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.595821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:10.595835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.595840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.595842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:10.595854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.595871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:10.595892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.596051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.596059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.596073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.596157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2252 partition: 0 MaxSeqNo: 40 sessionId: src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0
2025-10-10T14:37:10.596506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d00fe2d9-ee25b435-d9bbc0be-5bd2842_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:10.599101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0] Write session: try to update token
2025-10-10T14:37:10.599119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:10.606949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:10.606969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.606981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602132845600530:2394]
2025-10-10T14:37:10.607027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:10.607032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:10.607206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:10.607349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.607491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.607653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:10.607846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:10.607885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:10.612846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId: src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:10.615593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:10.615826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.615850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.615892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:10.615969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:10.625237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:10.625257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.625260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:10.625267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:10.625278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602132845600530:2394]
2025-10-10T14:37:10.625284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602132845600530:2394]
2025-10-10T14:37:10.625287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602132845600530:2394]
2025-10-10T14:37:10.625352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:10.625357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:10.625364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.625365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:10.625367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:10.625369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:10.625501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:10.677693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602133627831587:3836]
2025-10-10T14:37:10.678098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2251, pipe: [1:7559602133627831587:3836]
2025-10-10T14:37:10.738449Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:10.746842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.746874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.747061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.747134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.747202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.747279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.747328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.747338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.747412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.747478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.747548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.747631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.747684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.747692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.747759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.747822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.747892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.747955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.747999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.748006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.748073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.748142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.748217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.748285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.748333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.748345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.748416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.748482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.748551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.748620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.748666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.748674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.748744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.748810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.748878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.748947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.749059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.749067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.749138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.749203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.749270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.749357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.749402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.749411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.749483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.749547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.749611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.749684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.749789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.749797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.749863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.749925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.749986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.750049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.750092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.750100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.750170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:10.750236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:10.750299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:10.750365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:10.750407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:10.750415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:10.750486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831587:3836], now have 1 active actors on pipe
2025-10-10T14:37:10.750777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:10.750788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:10.750792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:10.750838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2252 reason: error at write: Disconnected sessionId: src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0
2025-10-10T14:37:10.750838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602133627831587:3836]
2025-10-10T14:37:10.751034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2252 sessionId: src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0 is DEAD
2025-10-10T14:37:10.751188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:10.751200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0] Write session will restart in 0.009222s
2025-10-10T14:37:10.751228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0] Write session: Do CDS request
2025-10-10T14:37:10.751234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:10.751550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:10.760595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:10.761919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.762030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:10.762048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2253
2025-10-10T14:37:10.762199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.762246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:10.762257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:10.762261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:10.762361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:10.762627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:10.762640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:10.762653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:10.762671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2253 sessionId:  describe result for acl check
2025-10-10T14:37:10.762710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:10.762709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:10.762717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:10.762719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:10.762725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602133627831649:4427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:10.762753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602132845600626:2390]
2025-10-10T14:37:10.763273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602133627831649:4427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:10.763356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:10.763705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:10.763748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:10.764058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:10.764107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.764113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.764114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.764115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.764116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.764119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.764120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.764121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.764122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.764123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.764124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.764124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.764125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.764131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.764142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.764145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.764149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.764153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.764156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.764160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.764163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.764166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.764169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.764173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.764176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.764180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.764187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.764194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.764200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.764205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.764209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.764214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.764217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.764222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.764226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.764230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.764235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.764239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.764244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.764248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.764251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.764256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.764260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.764264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.764267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.764272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.764276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.764280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.764284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.764289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.764292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.764298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.764331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:10.765799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602133627831649:4427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:10.766713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:10.767035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:10.767053Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:10.767056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:10.767059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:10.767065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2252 [2:7559602132845600626:2390]
2025-10-10T14:37:10.767077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:10.767093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:10.767101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.767104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.767107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.767122Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:10.767134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:10.767149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:10.767221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.767229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.767231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.767233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:10.767298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:10.767308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.767320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.767331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.767347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:10.767370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831595:2438], now have 1 active actors on pipe
2025-10-10T14:37:10.767383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602132845600621:2390]
2025-10-10T14:37:10.767390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602132845600621:2390]
2025-10-10T14:37:10.767392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602132845600621:2390]
2025-10-10T14:37:10.767408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:10.767420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:10.767428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:10.767433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:10.767436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:10.767440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:10.767443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:10.767465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602132845600621:2390]
2025-10-10T14:37:10.767473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:10.767474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:10.767449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2252
2025-10-10T14:37:10.772324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602133627831649:4427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:10.772340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602133627831649:4427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:10.772345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602133627831649:4427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:10.772354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:10.772583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831687:4427], now have 1 active actors on pipe
2025-10-10T14:37:10.772645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2252
2025-10-10T14:37:10.772734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.772747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.772797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56122f29-50887416-ac7db41d-1804ae00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:10.772816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.772823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.772826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:10.772842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.772865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:10.772889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.773063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.773072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.773088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.773192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2253 partition: 0 MaxSeqNo: 40 sessionId: src_id|56122f29-50887416-ac7db41d-1804ae00_0
2025-10-10T14:37:10.773588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e724e4c-16fd0dc3-5d838bf8-2fcf7cf5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56122f29-50887416-ac7db41d-1804ae00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:10.776383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56122f29-50887416-ac7db41d-1804ae00_0] Write session: try to update token
2025-10-10T14:37:10.776400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56122f29-50887416-ac7db41d-1804ae00_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:10.787230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:10.787258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.787263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:10.787265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:10.787280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602132845600621:2390]
2025-10-10T14:37:10.787285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602132845600621:2390]
2025-10-10T14:37:10.787289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602132845600621:2390]
2025-10-10T14:37:10.787332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:10.787343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:10.787344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:10.787348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:10.787351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.787354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:10.787499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:10.790797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId: src_id|56122f29-50887416-ac7db41d-1804ae00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:10.793641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:10.850790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602133627831694:3836]
2025-10-10T14:37:10.851178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2252, pipe: [1:7559602133627831694:3836]
2025-10-10T14:37:10.898753Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:10.899098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.899114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.899161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831694:3836], now have 1 active actors on pipe
2025-10-10T14:37:10.899404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:10.899445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:10.899481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602133627831694:3836]
2025-10-10T14:37:10.899505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:10.899579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2253 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56122f29-50887416-ac7db41d-1804ae00_0
2025-10-10T14:37:10.899791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2253 sessionId: src_id|56122f29-50887416-ac7db41d-1804ae00_0 is DEAD
2025-10-10T14:37:10.899991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56122f29-50887416-ac7db41d-1804ae00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:10.900004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56122f29-50887416-ac7db41d-1804ae00_0] Write session will restart in 0.005984s
2025-10-10T14:37:10.900030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56122f29-50887416-ac7db41d-1804ae00_0] Write session: Do CDS request
2025-10-10T14:37:10.900037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56122f29-50887416-ac7db41d-1804ae00_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:10.906911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56122f29-50887416-ac7db41d-1804ae00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.906999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:10.907019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2254
2025-10-10T14:37:10.907199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:10.907255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:10.907266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:10.907271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:10.907715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2254 sessionId:  describe result for acl check
2025-10-10T14:37:10.907753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:10.907757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:10.907758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:10.907764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602133627831738:4437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:10.908300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602133627831738:4437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:10.909283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:10.910753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602133627831738:4437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:10.910907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:10.911102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:10.911114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:10.911126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:10.911177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:10.911216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602132845600718:2378]
2025-10-10T14:37:10.911844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:10.912140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:10.912189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:10.912507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:10.912574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.912580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.912581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.912582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.912584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.912585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.912588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.912589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.912590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.912592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.912593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.912594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.912595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.912602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.912616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.912621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.912625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.912629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.912634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.912638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.912642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.912646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.912651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.912655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.912659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.912668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.912675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.912689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:10.912700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.912710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:10.912719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.912725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:10.912730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.912735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:10.912744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.912754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:10.912763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.912771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:10.912780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.912787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:10.912796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.912808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:10.912813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.912819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:10.912823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.912829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:10.912838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.912848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.912857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.912866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.912875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.912884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.912933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:10.913379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602133627831738:4437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:10.913394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602133627831738:4437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:10.913398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602133627831738:4437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:10.913406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:10.915151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:10.915495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:10.915507Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:10.915510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:10.915513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:10.915520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2253 [2:7559602132845600718:2378]
2025-10-10T14:37:10.915532Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:10.915554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:10.915562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.915566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.915574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.915591Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:10.915603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:10.915630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:10.915689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.915697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.915698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.915701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:10.915769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:10.915777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.915789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:10.915807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:10.915829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:10.915855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831695:2438], now have 1 active actors on pipe
2025-10-10T14:37:10.915863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831783:4437], now have 1 active actors on pipe
2025-10-10T14:37:10.915871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602132845600713:2378]
2025-10-10T14:37:10.915878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602132845600713:2378]
2025-10-10T14:37:10.915880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602132845600713:2378]
2025-10-10T14:37:10.915895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:10.915883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2253
2025-10-10T14:37:10.915914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:10.915922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:10.915926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:10.915928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:10.915926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2253
2025-10-10T14:37:10.915936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:10.915941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:10.915968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602132845600713:2378]
2025-10-10T14:37:10.915979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:10.915992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:10.915993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.915998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.916044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:10.916057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:10.916062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:10.916069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:10.916081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:10.916092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:10.916113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.916245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:10.916253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:10.916267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:10.916352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2254 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0
2025-10-10T14:37:10.916712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56122f29-50887416-ac7db41d-1804ae00_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:10.919462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0] Write session: try to update token
2025-10-10T14:37:10.919479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:10.934313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId: src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:10.935314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:10.935339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:10.935341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:10.935343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:10.935351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602132845600713:2378]
2025-10-10T14:37:10.935358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602132845600713:2378]
2025-10-10T14:37:10.935360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602132845600713:2378]
2025-10-10T14:37:10.935400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:10.935407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:10.935409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:10.935542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:10.935591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:10.935606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:10.935611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:10.936967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:10.999723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602133627831791:3836]
2025-10-10T14:37:11.000162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2253, pipe: [1:7559602133627831791:3836]
2025-10-10T14:37:11.045177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:11.045441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.045455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.045494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602133627831791:3836], now have 1 active actors on pipe
2025-10-10T14:37:11.045624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:11.045798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602133627831791:3836]
2025-10-10T14:37:11.045866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:11.045900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:11.045978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2254 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0
2025-10-10T14:37:11.046231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2254 sessionId: src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0 is DEAD
2025-10-10T14:37:11.046407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:11.046418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0] Write session will restart in 0.005169s
2025-10-10T14:37:11.046453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0] Write session: Do CDS request
2025-10-10T14:37:11.046459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:11.052840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.052924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:11.052948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2255
2025-10-10T14:37:11.053061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.053109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:11.053120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:11.053124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:11.053595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2255 sessionId:  describe result for acl check
2025-10-10T14:37:11.053632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:11.053638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:11.053640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:11.053646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602137922799106:4428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:11.054150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602137922799106:4428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:11.056040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602137922799106:4428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:11.056612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:11.058862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:11.059095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:11.059107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:11.059118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:11.059178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:11.059218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602137140568141:2361]
2025-10-10T14:37:11.059285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602137922799106:4428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:11.059305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602137922799106:4428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:11.059308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602137922799106:4428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:11.059315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:11.059664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:11.059982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:11.060031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:11.060434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:11.060498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.060503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.060504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.060504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.060505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.060506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.060507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.060507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.060508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.060509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.060509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.060510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.060511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.060515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.060543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.060547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.060556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.060565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.060571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.060578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.060581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.060583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.060585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.060587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.060589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.060591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.060597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.060606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.060614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.060618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.060624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.060627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.060630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.060633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.060636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.060642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.060645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.060648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.060651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.060654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.060660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.060663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.060666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.060672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.060675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.060678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.060684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.060688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.060692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.060699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.060701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.060704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.060731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:11.062974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:11.063304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:11.063318Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:11.063320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:11.063323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:11.063329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2254 [2:7559602137140568141:2361]
2025-10-10T14:37:11.063338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:11.063349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:11.063352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.063354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.063356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.063369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:11.063381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:11.063394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:11.063446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.063451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.063452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.063454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:11.063510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:11.063519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.063529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.063539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.063554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:11.063575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799173:4428], now have 1 active actors on pipe
2025-10-10T14:37:11.063584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799088:2438], now have 1 active actors on pipe
2025-10-10T14:37:11.063592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602137140568135:2361]
2025-10-10T14:37:11.063599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602137140568135:2361]
2025-10-10T14:37:11.063601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602137140568135:2361]
2025-10-10T14:37:11.063628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:11.063643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:11.063632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2254
2025-10-10T14:37:11.063665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:11.063673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:11.063675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:11.063676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2254
2025-10-10T14:37:11.063679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:11.063681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:11.063705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.063713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.063728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602137140568135:2361]
2025-10-10T14:37:11.063739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:11.063755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:11.063781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:11.063791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.063794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.063796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:11.063805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.063815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:11.063928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.064106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.064114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.064130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.064232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2255 partition: 0 MaxSeqNo: 40 sessionId: src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0
2025-10-10T14:37:11.064619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b097e34-3d64820e-b14c1be8-eaab939a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:11.067477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0] Write session: try to update token
2025-10-10T14:37:11.067498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:11.080976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId: src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:11.083149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:11.083172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:11.083175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:11.083176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:11.083187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602137140568135:2361]
2025-10-10T14:37:11.083191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602137140568135:2361]
2025-10-10T14:37:11.083193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602137140568135:2361]
2025-10-10T14:37:11.083233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:11.083242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.083243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:11.083255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:11.083277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:11.083281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:11.083366Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:11.083524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:11.146187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602137922799220:3836]
2025-10-10T14:37:11.146511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2254, pipe: [1:7559602137922799220:3836]
2025-10-10T14:37:11.192568Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:11.192852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.192867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.192915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799220:3836], now have 1 active actors on pipe
2025-10-10T14:37:11.193141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:11.193170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:11.193181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602137922799220:3836]
2025-10-10T14:37:11.193208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:11.193288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2255 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0
2025-10-10T14:37:11.193534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2255 sessionId: src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0 is DEAD
2025-10-10T14:37:11.193721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:11.193740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0] Write session will restart in 0.005065s
2025-10-10T14:37:11.193758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0] Write session: Do CDS request
2025-10-10T14:37:11.193763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:11.199934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.200024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:11.200047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2256
2025-10-10T14:37:11.200276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.200310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:11.200322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:11.200327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:11.200845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2256 sessionId:  describe result for acl check
2025-10-10T14:37:11.200895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:11.200905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:11.200907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:11.200913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602137922799237:4456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:11.201486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602137922799237:4456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:11.203763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602137922799237:4456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:11.204206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:11.206041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:11.206122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602137922799237:4456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:11.206135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602137922799237:4456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:11.206139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602137922799237:4456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:11.206144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:11.206321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:11.206345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:11.206363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:11.206452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:11.206514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602137140568252:2339]
2025-10-10T14:37:11.207186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:11.207484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:11.207518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:11.207775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:11.207823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.207828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.207829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.207830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.207830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.207831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.207832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.207833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.207834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.207835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.207835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.207836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.207837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.207841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.207851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.207853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.207857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.207859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.207862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.207864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.207866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.207868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.207870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.207872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.207874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.207876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.207882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.207888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.207892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.207896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.207900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.207903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.207906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.207911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.207914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.207918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.207922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.207927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.207932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.207943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.207950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.207953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.207956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.207959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.207961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.207964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.207967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.207971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.207973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.207977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.207979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.207983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.208018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:11.210410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:11.210757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:11.210779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:11.210783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:11.210788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:11.210797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2255 [2:7559602137140568252:2339]
2025-10-10T14:37:11.210812Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:11.210835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:11.210848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.210852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.210855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.210873Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:11.210886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:11.210894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:11.210961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.210970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.210973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.210977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:11.211061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:11.211070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.211081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.211094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.211111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:11.211140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799308:4456], now have 1 active actors on pipe
2025-10-10T14:37:11.211148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799222:2438], now have 1 active actors on pipe
2025-10-10T14:37:11.211158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602137140568246:2339]
2025-10-10T14:37:11.211161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602137140568246:2339]
2025-10-10T14:37:11.211163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602137140568246:2339]
2025-10-10T14:37:11.211176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:11.211190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:11.211192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:11.211209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:11.211211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:11.211194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2255
2025-10-10T14:37:11.211216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:11.211218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:11.211211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2255
2025-10-10T14:37:11.211238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602137140568246:2339]
2025-10-10T14:37:11.211247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:11.211249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:11.211271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.211281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.211330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:11.211343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.211347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.211349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:11.211360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.211372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:11.211391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.211564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.211572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.211588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.211683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2256 partition: 0 MaxSeqNo: 40 sessionId: src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0
2025-10-10T14:37:11.212095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5901f6-369341cf-fdb7ed1-52824a12_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:11.214860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0] Write session: try to update token
2025-10-10T14:37:11.214878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:11.229813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId: src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:11.230468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:11.230490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:11.230496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:11.230497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:11.230506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602137140568246:2339]
2025-10-10T14:37:11.230510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602137140568246:2339]
2025-10-10T14:37:11.230512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602137140568246:2339]
2025-10-10T14:37:11.230551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:11.230561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.230563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:11.230569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:11.230576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:11.230581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:11.230711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:11.233443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:11.293168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602137922799319:3836]
2025-10-10T14:37:11.293532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2255, pipe: [1:7559602137922799319:3836]
2025-10-10T14:37:11.340408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:11.340717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.340729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.340767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799319:3836], now have 1 active actors on pipe
2025-10-10T14:37:11.340934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:11.340998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:11.341021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:11.341021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602137922799319:3836]
2025-10-10T14:37:11.341046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:11.341103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2256 reason: error at write: Disconnected sessionId: src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0
2025-10-10T14:37:11.341393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2256 sessionId: src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0 is DEAD
2025-10-10T14:37:11.341520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:11.341532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0] Write session will restart in 0.006155s
2025-10-10T14:37:11.341557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0] Write session: Do CDS request
2025-10-10T14:37:11.341564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:11.348778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.348880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:11.348897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2257
2025-10-10T14:37:11.349071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.349107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:11.349117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:11.349121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:11.349572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2257 sessionId:  describe result for acl check
2025-10-10T14:37:11.349609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:11.349619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:11.349621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:11.349636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602137922799380:4466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:11.349786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:11.350202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602137922799380:4466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:11.351734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:11.351923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:11.351935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:11.351943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:11.351987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:11.352029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602137140568346:2333]
2025-10-10T14:37:11.352479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:11.352565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602137922799380:4466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:11.352727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:11.352770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:11.352990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:11.353042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.353049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.353050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.353051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.353052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.353054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.353055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.353056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.353057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.353058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.353059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.353060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.353061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.353066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.353081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.353084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.353087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.353089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.353091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.353093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.353095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.353097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.353099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.353101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.353104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.353108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.353115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.353124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.353131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.353138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.353142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.353148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.353151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.353155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.353158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.353161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.353164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.353167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.353170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.353173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.353175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.353179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.353183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.353186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.353189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.353193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.353196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.353199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.353204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.353209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.353218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.353228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.353268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:11.355650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602137922799380:4466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:11.355668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602137922799380:4466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:11.355672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602137922799380:4466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:11.355682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:11.355622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:11.355949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:11.355960Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:11.355961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:11.355964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:11.355972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2256 [2:7559602137140568346:2333]
2025-10-10T14:37:11.355980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:11.355998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:11.356003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.356006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.356008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.356021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:11.356030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:11.356037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:11.356085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.356092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.356093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.356095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:11.356158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:11.356165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.356172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.356181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.356196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:11.356219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799415:4466], now have 1 active actors on pipe
2025-10-10T14:37:11.356228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799324:2438], now have 1 active actors on pipe
2025-10-10T14:37:11.356236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602137140568341:2333]
2025-10-10T14:37:11.356239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602137140568341:2333]
2025-10-10T14:37:11.356241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602137140568341:2333]
2025-10-10T14:37:11.356253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:11.356264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:11.356267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:11.356273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:11.356274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:11.356281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:11.356284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:11.356290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2256
2025-10-10T14:37:11.356295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2256
2025-10-10T14:37:11.356309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602137140568341:2333]
2025-10-10T14:37:11.356318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:11.356320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:11.356340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.356345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.356397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:11.356410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.356415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.356421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:11.356433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.356448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:11.356475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.356627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.356649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.356678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.356805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2257 partition: 0 MaxSeqNo: 40 sessionId: src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0
2025-10-10T14:37:11.357170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d93b8e-40a2a05d-3c68c14d-feace3c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:11.359948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0] Write session: try to update token
2025-10-10T14:37:11.359970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:11.373709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId: src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:11.375951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:11.375972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:11.375975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:11.375977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:11.375990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602137140568341:2333]
2025-10-10T14:37:11.375996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602137140568341:2333]
2025-10-10T14:37:11.376002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602137140568341:2333]
2025-10-10T14:37:11.376047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:11.376049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:11.376054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.376055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:11.376056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:11.376069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:11.376196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:11.376490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:11.441112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602137922799422:3836]
2025-10-10T14:37:11.441408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2256, pipe: [1:7559602137922799422:3836]
2025-10-10T14:37:11.482336Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:11.482694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.482709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.482749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799422:3836], now have 1 active actors on pipe
2025-10-10T14:37:11.482915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:11.483016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602137922799422:3836]
2025-10-10T14:37:11.483037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:11.483069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:11.483132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2257 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0
2025-10-10T14:37:11.483340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2257 sessionId: src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0 is DEAD
2025-10-10T14:37:11.483536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:11.483545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0] Write session will restart in 0.007409s
2025-10-10T14:37:11.483572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0] Write session: Do CDS request
2025-10-10T14:37:11.483578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:11.491988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.492153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:11.492179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2258
2025-10-10T14:37:11.492305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.492341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:11.492352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:11.492359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:11.492825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2258 sessionId:  describe result for acl check
2025-10-10T14:37:11.492877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:11.492884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:11.492886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:11.492892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602137922799480:4474] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:11.492887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:11.493464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602137922799480:4474] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:11.494987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:11.495175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:11.495190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:11.495202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:11.495255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:11.495293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602137140568443:2329]
2025-10-10T14:37:11.495917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:11.496017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602137922799480:4474] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:11.496195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:11.496238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:11.496553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:11.496611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.496617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.496619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.496620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.496622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.496623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.496624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.496626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.496627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.496628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.496629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.496631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.496632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.496637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.496650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.496659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.496664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.496673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.496677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.496685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.496690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.496701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.496706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.496710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.496714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.496718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.496726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.496738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.496745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.496755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.496764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.496769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.496778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.496784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.496793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.496802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.496812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.496821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.496826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.496831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.496835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.496844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.496849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.496858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.496862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.496868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.496873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.496882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.496890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.496895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.496904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.496911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.496957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:11.499136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602137922799480:4474] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:11.499151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602137922799480:4474] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:11.499155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602137922799480:4474] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:11.499163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:11.499156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:11.499470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:11.499484Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:11.499486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:11.499490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:11.499496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2257 [2:7559602137140568443:2329]
2025-10-10T14:37:11.499508Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:11.499524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:11.499532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.499535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.499538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.499555Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:11.499566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:11.499578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:11.499646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.499654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.499656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.499658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:11.499735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:11.499743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.499754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.499772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.499794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:11.499809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2257
2025-10-10T14:37:11.499818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799423:2438], now have 1 active actors on pipe
2025-10-10T14:37:11.499826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799516:4474], now have 1 active actors on pipe
2025-10-10T14:37:11.499821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2257
2025-10-10T14:37:11.499833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602137140568437:2329]
2025-10-10T14:37:11.499835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602137140568437:2329]
2025-10-10T14:37:11.499837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602137140568437:2329]
2025-10-10T14:37:11.499846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:11.499854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:11.499856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:11.499857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:11.499861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:11.499878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:11.499885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:11.499905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.499914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.499952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602137140568437:2329]
2025-10-10T14:37:11.499965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:11.499988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:11.500000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.500009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.500011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:11.500021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.500020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:11.500031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:11.500141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.500279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.500287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.500302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.500382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2258 partition: 0 MaxSeqNo: 40 sessionId: src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0
2025-10-10T14:37:11.500759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e55b5b2-ca0ff1f9-a8888c8e-42d56314_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:11.503302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0] Write session: try to update token
2025-10-10T14:37:11.503319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:11.516316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId: src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:11.518702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:11.518723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:11.518727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:11.518729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:11.518738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602137140568437:2329]
2025-10-10T14:37:11.518745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602137140568437:2329]
2025-10-10T14:37:11.518749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602137140568437:2329]
2025-10-10T14:37:11.518800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:11.518810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:11.518814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.518816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:11.518817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:11.518821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:11.518914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:11.518950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:11.583431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602137922799523:3836]
2025-10-10T14:37:11.583693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2257, pipe: [1:7559602137922799523:3836]
2025-10-10T14:37:11.622137Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:11.622401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.622415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.622453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799523:3836], now have 1 active actors on pipe
2025-10-10T14:37:11.622630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:11.622730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:11.622732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602137922799523:3836]
2025-10-10T14:37:11.622758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:11.622853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2258 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0
2025-10-10T14:37:11.623074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2258 sessionId: src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0 is DEAD
2025-10-10T14:37:11.623255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:11.623266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0] Write session will restart in 0.006538s
2025-10-10T14:37:11.623291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0] Write session: Do CDS request
2025-10-10T14:37:11.623297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:11.630942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.630975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:11.630992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2259
2025-10-10T14:37:11.631172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.631209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:11.631219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:11.631228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:11.631676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2259 sessionId:  describe result for acl check
2025-10-10T14:37:11.631717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:11.631726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:11.631728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:11.631734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602137922799580:4481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:11.632279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602137922799580:4481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:11.632360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:11.633996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:11.634191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:11.634201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:11.634212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:11.634258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:11.634290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602137140568539:2325]
2025-10-10T14:37:11.634595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602137922799580:4481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:11.634708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:11.634992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:11.635027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:11.635324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:11.635368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.635373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.635374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.635375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.635376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.635376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.635377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.635378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.635378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.635379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.635380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.635380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.635381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.635385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.635392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.635395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.635397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.635399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.635402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.635404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.635406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.635409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.635411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.635413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.635415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.635418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.635425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.635436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.635443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.635449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.635453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.635456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.635459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.635462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.635465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.635468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.635470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.635473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.635476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.635479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.635482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.635485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.635488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.635490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.635493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.635497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.635500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.635503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.635505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.635508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.635511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.635514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.635536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:11.637695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602137922799580:4481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:11.637709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602137922799580:4481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:11.637713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602137922799580:4481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:11.637722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:11.637776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:11.638208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:11.638221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:11.638223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:11.638227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:11.638232Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2258 [2:7559602137140568539:2325]
2025-10-10T14:37:11.638241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:11.638256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:11.638257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.638260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.638262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.638275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:11.638284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:11.638294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:11.638342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.638347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.638348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.638350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:11.638404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:11.638410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.638416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.638426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.638439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:11.638461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799617:4481], now have 1 active actors on pipe
2025-10-10T14:37:11.638471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602137140568534:2325]
2025-10-10T14:37:11.638473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602137140568534:2325]
2025-10-10T14:37:11.638475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602137140568534:2325]
2025-10-10T14:37:11.638487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:11.638493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799524:2438], now have 1 active actors on pipe
2025-10-10T14:37:11.638499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:11.638496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2258
2025-10-10T14:37:11.638509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:11.638509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2258
2025-10-10T14:37:11.638515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:11.638520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:11.638524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:11.638526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:11.638531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602137140568534:2325]
2025-10-10T14:37:11.638533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:11.638544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:11.638545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.638548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.638583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:11.638592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.638595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.638596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:11.638604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.638611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:11.638627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.638726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.638733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.638744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.638825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2259 partition: 0 MaxSeqNo: 40 sessionId: src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0
2025-10-10T14:37:11.639163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc8232c-fefc1331-d0c323e7-e94553c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:11.641856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0] Write session: try to update token
2025-10-10T14:37:11.641871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:11.656734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId: src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:11.656794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:11.656818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:11.656821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:11.656823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:11.656832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602137140568534:2325]
2025-10-10T14:37:11.656836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602137140568534:2325]
2025-10-10T14:37:11.656840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602137140568534:2325]
2025-10-10T14:37:11.656884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:11.656895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:11.656900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:11.656905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:11.656906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.656908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:11.657053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:11.659611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:11.722708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602137922799625:3836]
2025-10-10T14:37:11.722973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2258, pipe: [1:7559602137922799625:3836]
2025-10-10T14:37:11.764107Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:11.764405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.764420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.764465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799625:3836], now have 1 active actors on pipe
2025-10-10T14:37:11.764662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:11.764660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:11.764667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602137922799625:3836]
2025-10-10T14:37:11.764692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:11.764695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:11.764761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2259 reason: error at write: Disconnected sessionId: src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0
2025-10-10T14:37:11.764968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2259 sessionId: src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0 is DEAD
2025-10-10T14:37:11.765157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:11.765171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0] Write session will restart in 0.009314s
2025-10-10T14:37:11.765198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0] Write session: Do CDS request
2025-10-10T14:37:11.765205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:11.774385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:11.775773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:11.775818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.775914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:11.775929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2260
2025-10-10T14:37:11.775962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:11.775976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:11.775988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:11.776037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:11.776048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.776081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:11.776081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602137140568637:2321]
2025-10-10T14:37:11.776102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:11.776110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:11.776427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2260 sessionId:  describe result for acl check
2025-10-10T14:37:11.776455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:11.776460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:11.776461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:11.776465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602137922799693:4484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:11.776686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:11.776927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:11.776967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:11.776968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602137922799693:4484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:11.777220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:11.777262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.777269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.777269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.777271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.777272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.777273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.777273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.777274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.777275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.777276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.777277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.777278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.777279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.777286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.777298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.777301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.777305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.777309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.777314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.777317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.777320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.777322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.777324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.777326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.777345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.777349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.777356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.777363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.777368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.777371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.777374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.777377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.777380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.777383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.777386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.777389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.777392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.777395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.777402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.777405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.777409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.777414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.777423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.777428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.777438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.777443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.777452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.777457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.777461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.777470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.777474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.777476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.777500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:11.778799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602137922799693:4484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:11.779694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:11.780007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:11.780020Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:11.780023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:11.780026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:11.780032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2259 [2:7559602137140568637:2321]
2025-10-10T14:37:11.780044Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:11.780059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:11.780062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.780065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.780067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.780084Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:11.780096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:11.780103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:11.780154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.780161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.780163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.780166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:11.780230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:11.780238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.780250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.780267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.780291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:11.780317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799633:2438], now have 1 active actors on pipe
2025-10-10T14:37:11.780329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602137140568632:2321]
2025-10-10T14:37:11.780331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602137140568632:2321]
2025-10-10T14:37:11.780333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602137140568632:2321]
2025-10-10T14:37:11.780346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:11.780341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2259
2025-10-10T14:37:11.780364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:11.780365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:11.780367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:11.780368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:11.780383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:11.780386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:11.780412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602137140568632:2321]
2025-10-10T14:37:11.780423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:11.780426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:11.782271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602137922799693:4484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:11.782284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602137922799693:4484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:11.782287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602137922799693:4484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:11.782293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:11.782483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799731:4484], now have 1 active actors on pipe
2025-10-10T14:37:11.782528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2259
2025-10-10T14:37:11.782577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.782588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.782620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8c08405-e9064761-25a3d016-5a98774_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:11.782634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.782643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.782646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:11.782659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.782676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:11.782695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.782821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.782830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.782844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.782921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2260 partition: 0 MaxSeqNo: 40 sessionId: src_id|a8c08405-e9064761-25a3d016-5a98774_0
2025-10-10T14:37:11.783222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69df3df3-7723f5af-87f21e2c-b7aa6da6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a8c08405-e9064761-25a3d016-5a98774_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:11.785668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c08405-e9064761-25a3d016-5a98774_0] Write session: try to update token
2025-10-10T14:37:11.785682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c08405-e9064761-25a3d016-5a98774_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:11.797066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:11.797086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:11.797097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602137140568632:2321]
2025-10-10T14:37:11.797143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:11.797143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:11.797325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:11.797532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:11.797681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:11.797828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:11.798071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:11.798123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:11.798781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId: src_id|a8c08405-e9064761-25a3d016-5a98774_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:11.801406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:11.801623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.801646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.801686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:11.801770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:11.809712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:11.809729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:11.809731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:11.809733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:11.809741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602137140568632:2321]
2025-10-10T14:37:11.809744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602137140568632:2321]
2025-10-10T14:37:11.809750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602137140568632:2321]
2025-10-10T14:37:11.809786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:11.809792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.809794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:11.809800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:11.809817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:11.809822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:11.809919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:11.865031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602137922799738:3836]
2025-10-10T14:37:11.865317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2259, pipe: [1:7559602137922799738:3836]
2025-10-10T14:37:11.918414Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:11.925785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.925814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.925971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.926027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.926089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.926147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.926455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.926470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.926544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.926611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.926673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.926741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.926782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.926787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.926849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.926903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.926961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.927017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.927057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.927062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.927122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.927185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.927245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.927304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.927347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.927355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.927415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.927471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.927534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.927615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.927712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.927718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.927777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.927836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.927894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.927952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.927997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.928003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.928066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.928123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.928182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.928243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.928288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.928295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.928356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.928414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.928472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.928531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.928571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.928577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.928636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.928692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.928746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.928806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.928847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.928852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.928912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:11.928968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:11.929026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:11.929089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:11.929129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:11.929135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:11.929192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799738:3836], now have 1 active actors on pipe
2025-10-10T14:37:11.929416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:11.929429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602137922799738:3836]
2025-10-10T14:37:11.929459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:11.929468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:11.929494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2260 reason: error at write: Disconnected sessionId: src_id|a8c08405-e9064761-25a3d016-5a98774_0
2025-10-10T14:37:11.929714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2260 sessionId: src_id|a8c08405-e9064761-25a3d016-5a98774_0 is DEAD
2025-10-10T14:37:11.929779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:11.929875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c08405-e9064761-25a3d016-5a98774_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:11.929892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c08405-e9064761-25a3d016-5a98774_0] Write session will restart in 0.008512s
2025-10-10T14:37:11.929917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c08405-e9064761-25a3d016-5a98774_0] Write session: Do CDS request
2025-10-10T14:37:11.929922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c08405-e9064761-25a3d016-5a98774_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:11.939327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:11.939881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c08405-e9064761-25a3d016-5a98774_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.940173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:11.940191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2261
2025-10-10T14:37:11.940334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:11.940373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:11.940382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:11.940386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:11.940799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2261 sessionId:  describe result for acl check
2025-10-10T14:37:11.940832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:11.940837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:11.940838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:11.940843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602137922799800:4502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:11.940969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:11.941155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:11.941163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:11.941174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:11.941239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:11.941265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602137922799800:4502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:11.941281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602137140568736:2318]
2025-10-10T14:37:11.941750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:11.942017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:11.942054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:11.942291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:11.942337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.942343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.942344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.942345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.942346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.942347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.942348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.942349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.942350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.942352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.942353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.942354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.942355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.942360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.942373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.942378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.942381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.942384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.942386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.942396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.942398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.942400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.942402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.942405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.942407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.942409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.942414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.942421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:11.942425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.942429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:11.942432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.942435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:11.942437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.942440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:11.942443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.942446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:11.942449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.942452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:11.942454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.942457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:11.942460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.942462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:11.942465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.942468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:11.942471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.942475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:11.942477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.942480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.942483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.942488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.942497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.942501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.942544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:11.943448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602137922799800:4502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:11.944657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:11.944950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:11.944961Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:11.944962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:11.944966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:11.944971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2260 [2:7559602137140568736:2318]
2025-10-10T14:37:11.944988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:11.945012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:11.945019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.945023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.945026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.945039Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:11.945048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:11.945069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:11.945119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.945124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.945125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.945127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:11.945172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:11.945177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.945185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:11.945195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:11.945205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:11.945225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799739:2438], now have 1 active actors on pipe
2025-10-10T14:37:11.945238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602137140568731:2318]
2025-10-10T14:37:11.945241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602137140568731:2318]
2025-10-10T14:37:11.945244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602137140568731:2318]
2025-10-10T14:37:11.945255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:11.945264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:11.945266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:11.945268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:11.945272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:11.945289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:11.945281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2260
2025-10-10T14:37:11.945295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:11.945322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602137140568731:2318]
2025-10-10T14:37:11.945350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:11.945353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:11.946583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602137922799800:4502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:11.946597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602137922799800:4502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:11.946601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602137922799800:4502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:11.946609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:11.946812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602137922799838:4502], now have 1 active actors on pipe
2025-10-10T14:37:11.946863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2260
2025-10-10T14:37:11.946930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.946939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.946963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:11.946975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:11.946978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:11.946980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:11.946989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:11.947003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:11.947018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.947139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:11.947145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:11.947156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:11.947224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2261 partition: 0 MaxSeqNo: 40 sessionId: src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0
2025-10-10T14:37:11.947544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c08405-e9064761-25a3d016-5a98774_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:11.950156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0] Write session: try to update token
2025-10-10T14:37:11.950177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:11.964014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId: src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:11.964428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:11.964451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:11.964454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:11.964455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:11.964463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602137140568731:2318]
2025-10-10T14:37:11.964466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602137140568731:2318]
2025-10-10T14:37:11.964469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602137140568731:2318]
2025-10-10T14:37:11.964511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:11.964512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:11.964518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:11.964522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:11.964523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:11.964524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:11.964655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:11.966496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:12.029395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602142217767138:3836]
2025-10-10T14:37:12.029717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2260, pipe: [1:7559602142217767138:3836]
2025-10-10T14:37:12.074575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:12.074922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.074941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.074990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767138:3836], now have 1 active actors on pipe
2025-10-10T14:37:12.075214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:12.075225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:12.075229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:12.075234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:12.075262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602142217767138:3836]
2025-10-10T14:37:12.075303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2261 reason: error at write: Disconnected sessionId: src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0
2025-10-10T14:37:12.075507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2261 sessionId: src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0 is DEAD
2025-10-10T14:37:12.075710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:12.075720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0] Write session will restart in 0.007867s
2025-10-10T14:37:12.075739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0] Write session: Do CDS request
2025-10-10T14:37:12.075754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:12.084913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.084967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:12.084988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2262
2025-10-10T14:37:12.085001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:12.085183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.085230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:12.085241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:12.085245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:12.085703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2262 sessionId:  describe result for acl check
2025-10-10T14:37:12.085741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:12.085746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:12.085748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:12.085755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602142217767200:4497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:12.086329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602142217767200:4497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:12.086801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:12.087002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:12.087018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:12.087032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:12.087096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:12.087142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602141435536147:2288]
2025-10-10T14:37:12.087799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:12.088112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:12.088103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602142217767200:4497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:12.088164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:12.088525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:12.088594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.088603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.088604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.088605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.088606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.088608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.088609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.088610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.088611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.088612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.088613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.088614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.088615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.088621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.088633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.088638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.088643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.088647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.088652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.088657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.088661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.088666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.088671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.088675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.088685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.088690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.088703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.088717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.088728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.088733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.088742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.088747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.088755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.088761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.088770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.088780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.088784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.088795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.088800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.088804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.088813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.088819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.088825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.088831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.088835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.088845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.088854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.088863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.088871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.088877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.088887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.088895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.088937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:12.091203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602142217767200:4497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:12.091220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602142217767200:4497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:12.091223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602142217767200:4497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:12.091229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:12.091324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:12.091657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:12.091669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:12.091671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:12.091675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:12.091681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2261 [2:7559602141435536147:2288]
2025-10-10T14:37:12.091693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:12.091711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:12.091719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.091722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.091724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.091742Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:12.091757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:12.091764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:12.091820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.091827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.091829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.091831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:12.091900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:12.091910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.091922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.091934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.091953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:12.091979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767139:2438], now have 1 active actors on pipe
2025-10-10T14:37:12.091987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767235:4497], now have 1 active actors on pipe
2025-10-10T14:37:12.091994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602141435536142:2288]
2025-10-10T14:37:12.091998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602141435536142:2288]
2025-10-10T14:37:12.092004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602141435536142:2288]
2025-10-10T14:37:12.092014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2261
2025-10-10T14:37:12.092020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:12.092025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2261
2025-10-10T14:37:12.092038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:12.092038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:12.092042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:12.092044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:12.092058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:12.092061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:12.092081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602141435536142:2288]
2025-10-10T14:37:12.092089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:12.092091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:12.092104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.092109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.092155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:12.092168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.092177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.092179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:12.092190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.092205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:12.092222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.092370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.092377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.092392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.092470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2262 partition: 0 MaxSeqNo: 40 sessionId: src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0
2025-10-10T14:37:12.092828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff20ff1c-d43b4b54-32dda682-e45ee08b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:12.095394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0] Write session: try to update token
2025-10-10T14:37:12.095409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:12.108635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId: src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:12.111396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:12.111553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:12.111575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.111578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:12.111579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:12.111600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602141435536142:2288]
2025-10-10T14:37:12.111605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602141435536142:2288]
2025-10-10T14:37:12.111608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602141435536142:2288]
2025-10-10T14:37:12.111649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:12.111654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:12.111657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:12.111657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.111665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.111684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:12.111690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.111691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:12.111828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:12.175320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602142217767279:3836]
2025-10-10T14:37:12.175623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2261, pipe: [1:7559602142217767279:3836]
2025-10-10T14:37:12.217526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:12.218088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767279:3836], now have 1 active actors on pipe
2025-10-10T14:37:12.218288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:12.218324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:12.218376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:12.218389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:12.218454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2262 reason: error at write: Disconnected sessionId: src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0
2025-10-10T14:37:12.218518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602142217767279:3836]
2025-10-10T14:37:12.218634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2262 sessionId: src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0 is DEAD
2025-10-10T14:37:12.218806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:12.218814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0] Write session will restart in 0.008325s
2025-10-10T14:37:12.218839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0] Write session: Do CDS request
2025-10-10T14:37:12.218845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:12.227373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:12.228865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.228917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:12.228936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2263
2025-10-10T14:37:12.229092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.229128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:12.229139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:12.229148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:12.229472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:12.229617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2263 sessionId:  describe result for acl check
2025-10-10T14:37:12.229655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:12.229662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:12.229663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:12.229669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602142217767343:4526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:12.229672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:12.229684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:12.229697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:12.229755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:12.229799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602141435536285:10248]
2025-10-10T14:37:12.230243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602142217767343:4526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:12.230274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:12.230525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:12.230569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:12.230837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:12.230894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.230901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.230902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.230903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.230905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.230906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.230908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.230910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.230911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.230912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.230914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.230915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.230916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.230922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.230935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.230940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.230945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.230952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.230957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.230962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.230968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.230972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.230976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.230981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.230985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.230989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.230997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.231010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.231021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.231031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.231036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.231045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.231050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.231060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.231065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.231072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.231078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.231087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.231095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.231104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.231109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.231118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.231124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.231129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.231137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.231142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.231146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.231151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.231155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.231162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.231166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.231172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.231212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:12.231930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602142217767343:4526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:12.233480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:12.233885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:12.233901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:12.233903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:12.233907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:12.233915Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2262 [2:7559602141435536285:10248]
2025-10-10T14:37:12.233927Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:12.233943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:12.233951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.233954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.233957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.233973Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:12.233985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:12.233994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:12.234051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.234057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.234058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.234061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:12.234127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:12.234135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.234146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.234158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.234180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:12.234202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2262
2025-10-10T14:37:12.234207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767280:2438], now have 1 active actors on pipe
2025-10-10T14:37:12.234215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602141435536280:10248]
2025-10-10T14:37:12.234217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602141435536280:10248]
2025-10-10T14:37:12.234220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602141435536280:10248]
2025-10-10T14:37:12.234233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:12.234251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:12.234254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:12.234259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:12.234263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:12.234271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:12.234274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:12.234302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602141435536280:10248]
2025-10-10T14:37:12.234314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:12.234328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:12.234553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602142217767343:4526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:12.234566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602142217767343:4526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:12.234569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602142217767343:4526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:12.234577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:12.234756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767379:4526], now have 1 active actors on pipe
2025-10-10T14:37:12.234817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2262
2025-10-10T14:37:12.234868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.234877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.234906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:12.234918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.234926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.234929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:12.234940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.234958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:12.234975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.235098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.235105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.235119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.235196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2263 partition: 0 MaxSeqNo: 40 sessionId: src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0
2025-10-10T14:37:12.235527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5950bc8c-7a9fe378-bf3f270f-8bcdf71e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:12.238240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0] Write session: try to update token
2025-10-10T14:37:12.238255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:12.245876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:12.245894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.245903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602141435536280:10248]
2025-10-10T14:37:12.245941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:12.245946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:12.246105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:12.246238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:12.246357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:12.246490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:12.246676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:12.246721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:12.252103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId: src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:12.254657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:12.254873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.254897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.254954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:12.255032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:12.264010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:12.264033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.264036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:12.264039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:12.264050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602141435536280:10248]
2025-10-10T14:37:12.264054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602141435536280:10248]
2025-10-10T14:37:12.264057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602141435536280:10248]
2025-10-10T14:37:12.264108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:12.264120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.264123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:12.264127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:12.264142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:12.264147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:12.264248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:12.318672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602142217767384:3836]
2025-10-10T14:37:12.318975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2262, pipe: [1:7559602142217767384:3836]
2025-10-10T14:37:12.367758Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:12.375452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.375480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.375650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.375707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.375766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.375827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.376058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.376067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.376130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.376190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.376249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.376513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.376555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.376561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.376623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.376680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.376743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.376800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.376840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.376845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.376907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.376970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.377029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.377089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.377132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.377138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.377199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.377256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.377314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.377399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.377443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.377449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.377515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.377576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.377638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.377698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.377738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.377744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.377807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.377865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.377925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.377983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.378024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.378029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.378091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.378145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.378205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.378264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.378308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.378313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.378374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.378431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.378488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.378546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.378587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.378593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.378656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:12.378711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:12.378769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:12.378828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:12.378867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:12.378873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:12.378929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767384:3836], now have 1 active actors on pipe
2025-10-10T14:37:12.379177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:12.379192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:12.379201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:12.379232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2263 reason: error at write: Disconnected sessionId: src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0
2025-10-10T14:37:12.379255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602142217767384:3836]
2025-10-10T14:37:12.379364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:12.379456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2263 sessionId: src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0 is DEAD
2025-10-10T14:37:12.379599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:12.379612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0] Write session will restart in 0.005300s
2025-10-10T14:37:12.379652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0] Write session: Do CDS request
2025-10-10T14:37:12.379659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:12.385857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.385900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:12.385918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2264
2025-10-10T14:37:12.386091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.386132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:12.386142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:12.386147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:12.386530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2264 sessionId:  describe result for acl check
2025-10-10T14:37:12.386564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:12.386571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:12.386573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:12.386577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602142217767401:4535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:12.387149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602142217767401:4535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:12.389889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602142217767401:4535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:12.390174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:12.391917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:12.392119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:12.392132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:12.392145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:12.392203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:12.392243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602141435536388:10250]
2025-10-10T14:37:12.392373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602142217767401:4535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:12.392387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602142217767401:4535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:12.392390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602142217767401:4535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:12.392398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:12.392883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:12.393130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:12.393178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:12.393512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:12.393584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.393594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.393595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.393596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.393598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.393599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.393600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.393601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.393603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.393603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.393604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.393605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.393607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.393613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.393626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.393631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.393635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.393640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.393645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.393649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.393654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.393658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.393663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.393667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.393684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.393693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.393700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.393714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.393724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.393735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.393740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.393746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.393753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.393762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.393772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.393792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.393801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.393806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.393811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.393821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.393829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.393837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.393848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.393858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.393866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.393876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.393885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.393892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.393900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.393907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.393916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.393925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.393965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:12.396124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:12.396558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:12.396576Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:12.396578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:12.396582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:12.396588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2263 [2:7559602141435536388:10250]
2025-10-10T14:37:12.396599Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:12.396616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:12.396624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.396628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.396631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.396649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:12.396661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:12.396669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:12.396725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.396737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.396739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.396742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:12.396804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:12.396812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.396824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.396840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.396863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:12.396892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767386:2438], now have 1 active actors on pipe
2025-10-10T14:37:12.396900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767480:4535], now have 1 active actors on pipe
2025-10-10T14:37:12.396908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602141435536382:10250]
2025-10-10T14:37:12.396915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602141435536382:10250]
2025-10-10T14:37:12.396918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602141435536382:10250]
2025-10-10T14:37:12.396932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:12.396931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2263
2025-10-10T14:37:12.396946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:12.396953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:12.396956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:12.396958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:12.396968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:12.396971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:12.397010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.397020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.397035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602141435536382:10250]
2025-10-10T14:37:12.397046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:12.397050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:12.397079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b43a924-5a77405b-4a445858-9940f5c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:12.397093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.397097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.397099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:12.397110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.397127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:12.397153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.397163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2263
2025-10-10T14:37:12.397313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.397324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.397359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.397467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2264 partition: 0 MaxSeqNo: 40 sessionId: src_id|b43a924-5a77405b-4a445858-9940f5c4_0
2025-10-10T14:37:12.397822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bff4a829-c87ded55-ff73f059-9a1f4e12_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b43a924-5a77405b-4a445858-9940f5c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:12.400813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43a924-5a77405b-4a445858-9940f5c4_0] Write session: try to update token
2025-10-10T14:37:12.400830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43a924-5a77405b-4a445858-9940f5c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:12.414769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:12.414788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.414790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:12.414791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:12.414800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602141435536382:10250]
2025-10-10T14:37:12.414804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602141435536382:10250]
2025-10-10T14:37:12.414807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602141435536382:10250]
2025-10-10T14:37:12.414843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:12.414845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:12.414847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:12.414850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:12.414851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.414852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:12.414983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:12.414976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId: src_id|b43a924-5a77405b-4a445858-9940f5c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:12.417608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:12.479463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602142217767491:3836]
2025-10-10T14:37:12.479736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2263, pipe: [1:7559602142217767491:3836]
2025-10-10T14:37:12.516396Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:12.516666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.516679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.516718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767491:3836], now have 1 active actors on pipe
2025-10-10T14:37:12.516891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:12.516942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:12.516995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:12.517091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602142217767491:3836]
2025-10-10T14:37:12.517094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2264 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b43a924-5a77405b-4a445858-9940f5c4_0
2025-10-10T14:37:12.517281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2264 sessionId: src_id|b43a924-5a77405b-4a445858-9940f5c4_0 is DEAD
2025-10-10T14:37:12.517452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43a924-5a77405b-4a445858-9940f5c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:12.517464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43a924-5a77405b-4a445858-9940f5c4_0] Write session will restart in 0.009800s
2025-10-10T14:37:12.517483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43a924-5a77405b-4a445858-9940f5c4_0] Write session: Do CDS request
2025-10-10T14:37:12.517488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43a924-5a77405b-4a445858-9940f5c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:12.525599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:12.527443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:12.527619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:12.527629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:12.527638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:12.527677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:12.527708Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602141435536488:10252]
2025-10-10T14:37:12.528097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:12.528387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:12.528421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:12.528631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:12.528666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.528670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.528671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.528672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.528672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.528673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.528673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.528674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.528675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.528675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.528676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.528676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.528677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.528681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.528690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.528693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.528695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.528697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.528700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.528702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.528704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.528706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.528709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.528711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.528713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.528716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.528721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.528726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.528731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.528734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.528737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.528740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.528742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.528746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.528748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.528752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.528754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.528757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.528761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.528764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.528766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.528769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.528772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.528776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.528778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.528782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.528786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.528790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.528793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.528796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.528800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.528803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.528824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:12.528891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b43a924-5a77405b-4a445858-9940f5c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.529035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:12.529054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2265
2025-10-10T14:37:12.529252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.529285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:12.529295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:12.529299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:12.529759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2265 sessionId:  describe result for acl check
2025-10-10T14:37:12.529794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:12.529796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:12.529798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:12.529804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602142217767563:4548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:12.530253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602142217767563:4548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:12.530959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:12.531356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:12.531369Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:12.531371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:12.531374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:12.531379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2264 [2:7559602141435536488:10252]
2025-10-10T14:37:12.531390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:12.531412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:12.531415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.531418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.531420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.531437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:12.531451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:12.531459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:12.531515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.531523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.531524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.531527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:12.531603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:12.531614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.531623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.531632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.531647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:12.531669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767493:2438], now have 1 active actors on pipe
2025-10-10T14:37:12.531682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602141435536483:10252]
2025-10-10T14:37:12.531683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602141435536483:10252]
2025-10-10T14:37:12.531687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602141435536483:10252]
2025-10-10T14:37:12.531677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2264
2025-10-10T14:37:12.531699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:12.531714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:12.531725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:12.531729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:12.531732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:12.531733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:12.531737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:12.531761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602141435536483:10252]
2025-10-10T14:37:12.531772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:12.531799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:12.532562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602142217767563:4548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:12.537906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602142217767563:4548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:12.537921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602142217767563:4548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:12.537924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602142217767563:4548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:12.537932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:12.538183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767596:4548], now have 1 active actors on pipe
2025-10-10T14:37:12.538253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2264
2025-10-10T14:37:12.538316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.538324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.538354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:12.538376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.538387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.538391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:12.538414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.538434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:12.538449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.538654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.538666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.538686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.538773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2265 partition: 0 MaxSeqNo: 40 sessionId: src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0
2025-10-10T14:37:12.539114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b43a924-5a77405b-4a445858-9940f5c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:12.541865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0] Write session: try to update token
2025-10-10T14:37:12.541882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:12.542150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:12.542161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.542168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602141435536483:10252]
2025-10-10T14:37:12.542201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:12.542207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:12.542357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:12.542482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:12.542601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:12.542735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:12.542905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:12.542933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:12.555668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId: src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:12.558262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:12.558843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.558869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.558893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:12.558897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.558899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:12.558901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:12.558908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602141435536483:10252]
2025-10-10T14:37:12.558912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602141435536483:10252]
2025-10-10T14:37:12.558915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602141435536483:10252]
2025-10-10T14:37:12.558955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:12.558959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:12.558965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.558967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:12.558969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:12.558973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:12.559089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:12.617174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602142217767599:3836]
2025-10-10T14:37:12.617466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2264, pipe: [1:7559602142217767599:3836]
2025-10-10T14:37:12.659898Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:12.660201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:12.660233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767599:3836], now have 1 active actors on pipe
2025-10-10T14:37:12.660354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:12.660456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:12.660461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602142217767599:3836]
2025-10-10T14:37:12.660464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:12.660487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:12.660539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2265 reason: error at write: Disconnected sessionId: src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0
2025-10-10T14:37:12.660694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2265 sessionId: src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0 is DEAD
2025-10-10T14:37:12.660836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:12.660858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0] Write session will restart in 0.006195s
2025-10-10T14:37:12.660883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0] Write session: Do CDS request
2025-10-10T14:37:12.660890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:12.667841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.667920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:12.667948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2266
2025-10-10T14:37:12.668085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.668128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:12.668139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:12.668143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:12.668680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2266 sessionId:  describe result for acl check
2025-10-10T14:37:12.668747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:12.668757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:12.668760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:12.668768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602142217767664:4552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:12.669562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602142217767664:4552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:12.669784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:12.671624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:12.671795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:12.671804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:12.671785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602142217767664:4552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:12.671813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:12.671853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:12.671895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602141435536592:10254]
2025-10-10T14:37:12.672307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:12.672538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:12.672569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:12.672795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:12.672834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.672838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.672839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.672840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.672841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.672841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.672842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.672843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.672843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.672844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.672845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.672846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.672846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.672850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.672858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.672861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.672863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.672865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.672868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.672870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.672872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.672874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.672876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.672878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.672881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.672883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.672888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.672894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.672898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.672902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.672904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.672908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.672910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.672913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.672916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.672919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.672922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.672925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.672928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.672931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.672934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.672938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.672941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.672946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.672950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.672955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.672960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.672965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.672969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.672974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.672979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.672985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.673009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:12.675154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602142217767664:4552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:12.675168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602142217767664:4552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:12.675172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602142217767664:4552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:12.675166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:12.675182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:12.675466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:12.675474Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:12.675476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:12.675481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:12.675486Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2265 [2:7559602141435536592:10254]
2025-10-10T14:37:12.675498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:12.675515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:12.675526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.675530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.675532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.675545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:12.675551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:12.675556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:12.675612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.675621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.675623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.675625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:12.675685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:12.675692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.675699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.675706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.675716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:12.675737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767600:2438], now have 1 active actors on pipe
2025-10-10T14:37:12.675744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767701:4552], now have 1 active actors on pipe
2025-10-10T14:37:12.675749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602141435536587:10254]
2025-10-10T14:37:12.675751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602141435536587:10254]
2025-10-10T14:37:12.675752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602141435536587:10254]
2025-10-10T14:37:12.675764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:12.675775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:12.675785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:12.675789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:12.675789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:12.675790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:12.675791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:12.675786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2265
2025-10-10T14:37:12.675807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602141435536587:10254]
2025-10-10T14:37:12.675800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2265
2025-10-10T14:37:12.675813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:12.675837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.675823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:12.675844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.675871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:12.675878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.675881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.675882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:12.675890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.675902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:12.675950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.676088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.676093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.676105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.676219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2266 partition: 0 MaxSeqNo: 40 sessionId: src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0
2025-10-10T14:37:12.676548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bfd0e5-b13b721b-2ee23f70-8840a970_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:12.679337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0] Write session: try to update token
2025-10-10T14:37:12.679357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:12.694136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId: src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:12.694317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:12.694337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.694340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:12.694341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:12.694349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602141435536587:10254]
2025-10-10T14:37:12.694354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602141435536587:10254]
2025-10-10T14:37:12.694357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602141435536587:10254]
2025-10-10T14:37:12.694395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:12.694406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.694412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:12.694412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:12.694419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:12.694423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:12.694543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:12.696887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:12.760539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602142217767713:3836]
2025-10-10T14:37:12.760805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2265, pipe: [1:7559602142217767713:3836]
2025-10-10T14:37:12.803801Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:12.804204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.804224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.804272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767713:3836], now have 1 active actors on pipe
2025-10-10T14:37:12.804495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:12.804557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:12.804563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602142217767713:3836]
2025-10-10T14:37:12.804585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:12.804659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2266 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0
2025-10-10T14:37:12.804869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2266 sessionId: src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0 is DEAD
2025-10-10T14:37:12.805001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:12.805012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0] Write session will restart in 0.008720s
2025-10-10T14:37:12.805032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0] Write session: Do CDS request
2025-10-10T14:37:12.805036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:12.812635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:12.814032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:12.814207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:12.814218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:12.814228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:12.814270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:12.814303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602141435536697:10256]
2025-10-10T14:37:12.814722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:12.814748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.814877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:12.814892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2267
2025-10-10T14:37:12.814987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:12.815017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.815047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:12.815049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:12.815058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:12.815062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:12.815424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:12.815463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2267 sessionId:  describe result for acl check
2025-10-10T14:37:12.815499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.815502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:12.815510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:12.815506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.815512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:12.815507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.815509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.815518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602142217767786:4563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:12.815510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.815511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.815512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.815513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.815515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.815516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.815517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.815518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.815519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.815525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.815536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.815540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.815544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.815547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.815551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.815554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.815557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.815560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.815564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.815567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.815581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.815598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.815606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.815614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.815620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.815626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.815630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.815635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.815640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.815645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.815649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.815654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.815658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.815663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.815667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.815671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.815676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.815682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.815686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.815691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.815700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.815705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.815714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.815723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.815726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.815731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.815735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.815744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.815785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:12.816038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602142217767786:4563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:12.817920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:12.818155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602142217767786:4563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:12.818286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:12.818299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:12.818310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:12.818313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:12.818317Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2266 [2:7559602141435536697:10256]
2025-10-10T14:37:12.818326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:12.818339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:12.818345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.818347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.818350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.818363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:12.818368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:12.818374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:12.818414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.818419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.818421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.818422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:12.818480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:12.818488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.818496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.818503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.818513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:12.818533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767717:2438], now have 1 active actors on pipe
2025-10-10T14:37:12.818543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602141435536692:10256]
2025-10-10T14:37:12.818544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602141435536692:10256]
2025-10-10T14:37:12.818546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602141435536692:10256]
2025-10-10T14:37:12.818557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:12.818571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:12.818572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:12.818581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:12.818582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:12.818587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:12.818580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2266
2025-10-10T14:37:12.818589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:12.818615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602141435536692:10256]
2025-10-10T14:37:12.818622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:12.818625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:12.822933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602142217767786:4563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:12.822945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602142217767786:4563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:12.822948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602142217767786:4563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:12.822955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:12.823157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767822:4563], now have 1 active actors on pipe
2025-10-10T14:37:12.823217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2266
2025-10-10T14:37:12.823260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.823271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.823300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:12.823309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.823314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.823316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:12.823327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.823351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:12.823369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.823488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.823494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.823505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.823583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2267 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0
2025-10-10T14:37:12.823900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f12e4452-b685d5e1-415e83ed-f21f55cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:12.826599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0] Write session: try to update token
2025-10-10T14:37:12.826616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:12.837455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:12.837472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.837474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:12.837476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:12.837484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602141435536692:10256]
2025-10-10T14:37:12.837487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602141435536692:10256]
2025-10-10T14:37:12.837493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602141435536692:10256]
2025-10-10T14:37:12.837529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:12.837535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:12.837538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:12.837539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:12.837548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.837550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:12.837673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:12.840201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId: src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:12.842737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:12.904922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602142217767826:3836]
2025-10-10T14:37:12.905230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2266, pipe: [1:7559602142217767826:3836]
2025-10-10T14:37:12.942503Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:12.942733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.942745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.942786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767826:3836], now have 1 active actors on pipe
2025-10-10T14:37:12.943132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:12.943151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:12.943169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602142217767826:3836]
2025-10-10T14:37:12.943198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:12.943257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2267 reason: error at write: Disconnected sessionId: src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0
2025-10-10T14:37:12.943309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:12.943471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2267 sessionId: src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0 is DEAD
2025-10-10T14:37:12.943664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:12.943677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0] Write session will restart in 0.006778s
2025-10-10T14:37:12.943703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0] Write session: Do CDS request
2025-10-10T14:37:12.943713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:12.951919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.951939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:12.951956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2268
2025-10-10T14:37:12.952145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:12.952186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:12.952197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:12.952202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:12.952421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:12.952674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2268 sessionId:  describe result for acl check
2025-10-10T14:37:12.952709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:12.952715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:12.952716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:12.952722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602142217767898:4566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:12.953260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602142217767898:4566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:12.953908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:12.954084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:12.954094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:12.954104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:12.954148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:12.954180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602141435536803:10258]
2025-10-10T14:37:12.954581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:12.954785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:12.954821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:12.955066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:12.955121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.955127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.955128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.955128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.955129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.955129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.955131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.955131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.955132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.955133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.955133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.955134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.955135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.955139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.955146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.955148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.955151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.955155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.955159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.955163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.955166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.955169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.955174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.955178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.955183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.955187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.955194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.955202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:12.955209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.955215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:12.955219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.955222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602142217767898:4566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:12.955225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:12.955229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.955234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:12.955239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.955244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:12.955248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.955253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:12.955258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.955262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:12.955265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.955268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:12.955271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.955274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:12.955276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.955280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:12.955283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.955286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.955288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.955292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.955295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.955298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.955329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:12.957542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:12.957667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602142217767898:4566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:12.957680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602142217767898:4566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:12.957684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602142217767898:4566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:12.957690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:12.957908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:12.957922Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:12.957925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:12.957928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:12.957934Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2267 [2:7559602141435536803:10258]
2025-10-10T14:37:12.957947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:12.957964Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:12.957972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.957976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.957978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.957994Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:12.958006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:12.958017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:12.958066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.958072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.958074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.958077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:12.958142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:12.958149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.958161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:12.958178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:12.958200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:12.958226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767929:4566], now have 1 active actors on pipe
2025-10-10T14:37:12.958224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2267
2025-10-10T14:37:12.958229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602142217767827:2438], now have 1 active actors on pipe
2025-10-10T14:37:12.958237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2267
2025-10-10T14:37:12.958236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602141435536798:10258]
2025-10-10T14:37:12.958238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602141435536798:10258]
2025-10-10T14:37:12.958240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602141435536798:10258]
2025-10-10T14:37:12.958249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:12.958262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:12.958275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:12.958282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:12.958283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:12.958284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:12.958285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:12.958320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.958329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.958343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602141435536798:10258]
2025-10-10T14:37:12.958359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:12.958366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:12.958389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:12.958404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:12.958409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:12.958411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:12.958422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:12.958432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:12.958452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.958602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:12.958613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:12.958628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:12.958716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2268 partition: 0 MaxSeqNo: 40 sessionId: src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0
2025-10-10T14:37:12.959049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9e343f-9ae84a9-95f9af7-fd12d7cb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:12.961992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0] Write session: try to update token
2025-10-10T14:37:12.962010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:12.975921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId: src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:12.978401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:12.978422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:12.978426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:12.978428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:12.978440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602141435536798:10258]
2025-10-10T14:37:12.978445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602141435536798:10258]
2025-10-10T14:37:12.978449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602141435536798:10258]
2025-10-10T14:37:12.978499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:12.978507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:12.978510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:12.978509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:12.978514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:12.978520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:12.978558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:12.978649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:13.043166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602146512735233:3836]
2025-10-10T14:37:13.043402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2267, pipe: [1:7559602146512735233:3836]
2025-10-10T14:37:13.084161Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:13.084535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.084553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.084597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735233:3836], now have 1 active actors on pipe
2025-10-10T14:37:13.084769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:13.084888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602146512735233:3836]
2025-10-10T14:37:13.084891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:13.084925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:13.084972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0
2025-10-10T14:37:13.085190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2268 sessionId: src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0 is DEAD
2025-10-10T14:37:13.085347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:13.085360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0] Write session will restart in 0.007360s
2025-10-10T14:37:13.085386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0] Write session: Do CDS request
2025-10-10T14:37:13.085392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:13.093146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:13.093766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.093844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:13.093860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2269
2025-10-10T14:37:13.093991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.094025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:13.094036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:13.094039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:13.094441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2269 sessionId:  describe result for acl check
2025-10-10T14:37:13.094479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:13.094485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:13.094487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:13.094493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602146512735303:4568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:13.094719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:13.094889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:13.094900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:13.094912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:13.094961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:13.094951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602146512735303:4568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:13.095003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602145730504208:10261]
2025-10-10T14:37:13.095614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:13.095902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:13.095942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:13.096255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:13.096305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.096311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.096312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.096313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.096314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.096315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.096316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.096317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.096319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.096320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.096322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.096323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.096324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.096329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.096341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.096346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.096350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.096354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.096358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.096362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.096366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.096370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.096380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.096383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.096387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.096391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.096397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.096406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.096417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.096422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.096427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.096434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.096439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.096444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.096449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.096458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.096462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.096467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.096474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.096483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.096488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.096493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.096498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.096504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.096510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.096516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.096522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.096527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.096536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.096541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.096550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.096555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.096598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:13.096660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602146512735303:4568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:13.098769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:13.098880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602146512735303:4568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:13.098893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602146512735303:4568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:13.098897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602146512735303:4568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:13.098904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:13.099188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:13.099201Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:13.099206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:13.099209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:13.099215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2268 [2:7559602145730504208:10261]
2025-10-10T14:37:13.099226Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:13.099246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:13.099249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.099252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.099254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.099270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:13.099281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:13.099288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:13.099339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.099347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.099349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.099352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:13.099411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:13.099419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.099430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.099443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.099465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:13.099486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735337:4568], now have 1 active actors on pipe
2025-10-10T14:37:13.099494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735234:2438], now have 1 active actors on pipe
2025-10-10T14:37:13.099501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602145730504203:10261]
2025-10-10T14:37:13.099503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602145730504203:10261]
2025-10-10T14:37:13.099505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602145730504203:10261]
2025-10-10T14:37:13.099520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:13.099507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2268
2025-10-10T14:37:13.099513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2268
2025-10-10T14:37:13.099534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:13.099536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:13.099545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:13.099547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:13.099552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:13.099555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:13.099597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.099606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.099625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602145730504203:10261]
2025-10-10T14:37:13.099636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:13.099646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:13.099662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:13.099674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.099677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.099680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:13.099690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.099704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:13.099731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.099890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.099900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.099916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.099989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2269 partition: 0 MaxSeqNo: 40 sessionId: src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0
2025-10-10T14:37:13.100251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9bf5137-a4003b09-abf9fadf-44fa4695_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:13.102986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0] Write session: try to update token
2025-10-10T14:37:13.103003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:13.117004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId: src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:13.119458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:13.119478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:13.119480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:13.119482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:13.119490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602145730504203:10261]
2025-10-10T14:37:13.119493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602145730504203:10261]
2025-10-10T14:37:13.119495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602145730504203:10261]
2025-10-10T14:37:13.119533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:13.119542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:13.119547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:13.119548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.119550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:13.119551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:13.119689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:13.119789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:13.184964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602146512735370:3836]
2025-10-10T14:37:13.185221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2268, pipe: [1:7559602146512735370:3836]
2025-10-10T14:37:13.223276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:13.223606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.223620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.223661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735370:3836], now have 1 active actors on pipe
2025-10-10T14:37:13.223919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:13.223911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:13.223928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:13.223940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602146512735370:3836]
2025-10-10T14:37:13.223963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:13.224000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2269 reason: error at write: Disconnected sessionId: src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0
2025-10-10T14:37:13.224199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2269 sessionId: src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0 is DEAD
2025-10-10T14:37:13.224360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:13.224372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0] Write session will restart in 0.009407s
2025-10-10T14:37:13.224399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0] Write session: Do CDS request
2025-10-10T14:37:13.224414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:13.232281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:13.233757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:13.233927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:13.233939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:13.233950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:13.233999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:13.234039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602145730504366:10277]
2025-10-10T14:37:13.234656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:13.234824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.234886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:13.234898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2270
2025-10-10T14:37:13.234909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:13.234957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:13.235068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.235103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:13.235114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:13.235118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:13.235273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:13.235324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.235330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.235332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.235333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.235334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.235335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.235336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.235337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.235338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.235340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.235341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.235342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.235343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.235349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.235362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.235366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.235370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.235374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.235378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.235387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.235391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.235399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.235404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.235412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.235416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.235425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.235433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.235446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.235457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.235462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.235466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.235472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.235476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.235481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.235486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.235491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.235499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.235504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.235516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.235526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.235506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2270 sessionId:  describe result for acl check
2025-10-10T14:37:13.235530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.235535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.235544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.235550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.235556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.235552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:13.235560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:13.235574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:13.235574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.235581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602146512735454:4595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:13.235584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.235589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.235593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.235607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.235612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.235617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.235656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:13.236164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602146512735454:4595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:13.237791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:13.237986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602146512735454:4595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:13.238174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:13.238186Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:13.238188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:13.238190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:13.238195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2269 [2:7559602145730504366:10277]
2025-10-10T14:37:13.238205Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:13.238222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:13.238229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.238233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.238235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.238254Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:13.238266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:13.238276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:13.238331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.238339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.238341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.238343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:13.238404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:13.238412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.238422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.238439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.238461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:13.238486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735382:2438], now have 1 active actors on pipe
2025-10-10T14:37:13.238498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602145730504361:10277]
2025-10-10T14:37:13.238504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602145730504361:10277]
2025-10-10T14:37:13.238506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602145730504361:10277]
2025-10-10T14:37:13.238518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:13.238531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:13.238535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:13.238540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:13.238541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:13.238526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2269
2025-10-10T14:37:13.238551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:13.238556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:13.238582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602145730504361:10277]
2025-10-10T14:37:13.238594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:13.238597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:13.243308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602146512735454:4595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:13.243323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602146512735454:4595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:13.243326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602146512735454:4595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:13.243334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:13.243525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735489:4595], now have 1 active actors on pipe
2025-10-10T14:37:13.243549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2269
2025-10-10T14:37:13.243599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.243612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.243643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:13.243654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.243659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.243662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:13.243676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.243692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:13.243712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.243877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.243886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.243902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.243980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2270 partition: 0 MaxSeqNo: 40 sessionId: src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0
2025-10-10T14:37:13.244304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbd76f39-b21e0002-3166cb7-48a9f40b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:13.247025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0] Write session: try to update token
2025-10-10T14:37:13.247043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:13.250052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:13.250077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:13.250088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602145730504361:10277]
2025-10-10T14:37:13.250131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:13.250135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:13.250311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:13.250471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:13.250628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:13.250781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:13.250984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:13.251029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:13.260873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId: src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:13.263463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:13.263685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.263709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.263752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:13.263836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:13.267752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:13.267767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:13.267772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:13.267773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:13.267782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602145730504361:10277]
2025-10-10T14:37:13.267785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602145730504361:10277]
2025-10-10T14:37:13.267787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602145730504361:10277]
2025-10-10T14:37:13.267825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:13.267827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:13.267833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:13.267837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:13.267838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.267840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:13.267969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:13.324264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602146512735493:3836]
2025-10-10T14:37:13.324564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2269, pipe: [1:7559602146512735493:3836]
2025-10-10T14:37:13.371850Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:13.379221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.379251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.379417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.379485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.379547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.379622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.379670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.379681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.379760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.379827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.379887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.379947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.379995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.380005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.380070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.380128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.380192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.380260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.380306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.380312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.380376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.380443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.380513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.380576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.380618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.380624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.380688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.380751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.380817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.380878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.380922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.380928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.380996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.381061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.381123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.381187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.381235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.381242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.381321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.381396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.381459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.381530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.381575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.381581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.381646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.381703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.381768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.381835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.381879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.381884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.381950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.382011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.382079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.382140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.382185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.382194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.382274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.382342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.382402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.382463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.382504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.382510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.382592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735493:3836], now have 1 active actors on pipe
2025-10-10T14:37:13.382761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:13.382763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602146512735493:3836]
2025-10-10T14:37:13.382778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:13.382791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:13.382811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2270 reason: error at write: Disconnected sessionId: src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0
2025-10-10T14:37:13.383006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2270 sessionId: src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0 is DEAD
2025-10-10T14:37:13.383126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:13.383139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0] Write session will restart in 0.007475s
2025-10-10T14:37:13.383162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0] Write session: Do CDS request
2025-10-10T14:37:13.383168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:13.383446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:13.391910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.392014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:13.392031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2271
2025-10-10T14:37:13.392099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:13.392185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.392222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:13.392228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:13.392232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:13.392674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2271 sessionId:  describe result for acl check
2025-10-10T14:37:13.392722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:13.392731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:13.392733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:13.392739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602146512735566:4596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:13.393285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602146512735566:4596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:13.393747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:13.393930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:13.393941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:13.393953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:13.394006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:13.394045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602145730504476:10279]
2025-10-10T14:37:13.394657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:13.394920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:13.394964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:13.395276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:13.395330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.395336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.395337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.395338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.395339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.395341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.395342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.395343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.395345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.395346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.395347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.395349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.395350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.395356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.395369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.395372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.395377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.395381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.395385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.395390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.395394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.395397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.395402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.395406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.395410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.395414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.395421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.395429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.395436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.395441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.395446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.395454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.395459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.395467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.395471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.395482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.395487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.395492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.395497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.395502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.395507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.395512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.395517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.395522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.395527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.395537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.395542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.395547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.395551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.395568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.395574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.395579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.395543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602146512735566:4596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:13.395622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:13.397883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:13.398150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602146512735566:4596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:13.398166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602146512735566:4596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:13.398170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602146512735566:4596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:13.398180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:13.398200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:13.398212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:13.398215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:13.398219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:13.398225Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2270 [2:7559602145730504476:10279]
2025-10-10T14:37:13.398238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:13.398255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:13.398260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.398264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.398266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.398287Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:13.398299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:13.398307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:13.398364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.398371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.398373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.398375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:13.398442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:13.398449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.398461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.398479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.398501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:13.398519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2270
2025-10-10T14:37:13.398528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735600:4596], now have 1 active actors on pipe
2025-10-10T14:37:13.398537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735495:2438], now have 1 active actors on pipe
2025-10-10T14:37:13.398526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2270
2025-10-10T14:37:13.398544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602145730504471:10279]
2025-10-10T14:37:13.398547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602145730504471:10279]
2025-10-10T14:37:13.398549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602145730504471:10279]
2025-10-10T14:37:13.398557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:13.398573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:13.398587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:13.398593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:13.398597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:13.398599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:13.398601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:13.398636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.398645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.398659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602145730504471:10279]
2025-10-10T14:37:13.398670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:13.398682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:13.398706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a00ff77-89606e20-a4272e98-96c22de7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:13.398718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.398722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.398724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:13.398735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.398750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:13.398777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.398938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.398949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.398966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.399049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2271 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a00ff77-89606e20-a4272e98-96c22de7_0
2025-10-10T14:37:13.399442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceba2ffd-f80f014f-91b4662-e4c1dfa7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a00ff77-89606e20-a4272e98-96c22de7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:13.402160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a00ff77-89606e20-a4272e98-96c22de7_0] Write session: try to update token
2025-10-10T14:37:13.402180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a00ff77-89606e20-a4272e98-96c22de7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:13.416403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId: src_id|8a00ff77-89606e20-a4272e98-96c22de7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:13.417223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:13.417244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:13.417247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:13.417250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:13.417259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602145730504471:10279]
2025-10-10T14:37:13.417263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602145730504471:10279]
2025-10-10T14:37:13.417266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602145730504471:10279]
2025-10-10T14:37:13.417315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:13.417323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.417324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:13.417347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:13.417350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:13.417355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:13.417489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:13.419006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:13.482983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602146512735607:3836]
2025-10-10T14:37:13.483279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2270, pipe: [1:7559602146512735607:3836]
2025-10-10T14:37:13.528756Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:13.529167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.529184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.529232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735607:3836], now have 1 active actors on pipe
2025-10-10T14:37:13.529486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:13.529492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:13.529507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:13.529510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:13.529556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602146512735607:3836]
2025-10-10T14:37:13.529576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2271 reason: error at write: Disconnected sessionId: src_id|8a00ff77-89606e20-a4272e98-96c22de7_0
2025-10-10T14:37:13.529814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2271 sessionId: src_id|8a00ff77-89606e20-a4272e98-96c22de7_0 is DEAD
2025-10-10T14:37:13.529948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a00ff77-89606e20-a4272e98-96c22de7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:13.529960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a00ff77-89606e20-a4272e98-96c22de7_0] Write session will restart in 0.008622s
2025-10-10T14:37:13.529985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a00ff77-89606e20-a4272e98-96c22de7_0] Write session: Do CDS request
2025-10-10T14:37:13.529992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a00ff77-89606e20-a4272e98-96c22de7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:13.539503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:13.539937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a00ff77-89606e20-a4272e98-96c22de7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.540104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:13.540122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2272
2025-10-10T14:37:13.540262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.540297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:13.540308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:13.540312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:13.540819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2272 sessionId:  describe result for acl check
2025-10-10T14:37:13.540863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:13.540866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:13.540868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:13.540874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602146512735681:4605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:13.541303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:13.541496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602146512735681:4605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:13.541594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:13.541617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:13.541636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:13.541722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:13.541784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602145730504585:10281]
2025-10-10T14:37:13.542451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:13.542808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:13.542851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:13.543077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:13.543116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.543120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.543121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.543122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.543122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.543123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.543124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.543125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.543126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.543126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.543127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.543128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.543128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.543134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.543142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.543144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.543147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.543149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.543152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.543154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.543157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.543159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.543162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.543164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.543166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.543168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.543173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.543179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.543184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.543190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.543195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.543200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.543205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.543210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.543215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.543221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.543225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.543230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.543233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.543236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.543239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.543242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.543244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.543248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.543250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.543253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.543256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.543259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.543262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.543265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.543268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.543271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.543295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:13.543884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602146512735681:4605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:13.545642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:13.545971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:13.545984Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:13.545987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:13.545991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:13.545998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2271 [2:7559602145730504585:10281]
2025-10-10T14:37:13.546011Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:13.546033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:13.546041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.546046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.546049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.546066Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:13.546078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:13.546088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:13.546146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.546154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.546156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.546159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:13.546229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:13.546238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.546249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.546262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.546285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:13.546314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735609:2438], now have 1 active actors on pipe
2025-10-10T14:37:13.546327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602145730504579:10281]
2025-10-10T14:37:13.546330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602145730504579:10281]
2025-10-10T14:37:13.546300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2271
2025-10-10T14:37:13.546332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602145730504579:10281]
2025-10-10T14:37:13.546341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:13.546350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:13.546352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:13.546353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:13.546360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:13.546378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:13.546388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:13.546416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602145730504579:10281]
2025-10-10T14:37:13.546427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:13.546431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:13.546576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602146512735681:4605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:13.546593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602146512735681:4605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:13.546596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602146512735681:4605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:13.546606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:13.546783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735717:4605], now have 1 active actors on pipe
2025-10-10T14:37:13.546834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2271
2025-10-10T14:37:13.546915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.546928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.546959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:13.546972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.546982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.546984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:13.546996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.547014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:13.547034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.547211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.547219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.547234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.547306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2272 partition: 0 MaxSeqNo: 40 sessionId: src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0
2025-10-10T14:37:13.547675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a00ff77-89606e20-a4272e98-96c22de7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:13.550613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0] Write session: try to update token
2025-10-10T14:37:13.550636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:13.565527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId: src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:13.566989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:13.567009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:13.567013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:13.567015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:13.567025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602145730504579:10281]
2025-10-10T14:37:13.567033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602145730504579:10281]
2025-10-10T14:37:13.567038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602145730504579:10281]
2025-10-10T14:37:13.567088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:13.567101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.567104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:13.567191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:13.567207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:13.567212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:13.567251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:13.567984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:13.629883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602146512735722:3836]
2025-10-10T14:37:13.630219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2271, pipe: [1:7559602146512735722:3836]
2025-10-10T14:37:13.674429Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:13.674786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.674800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.674842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735722:3836], now have 1 active actors on pipe
2025-10-10T14:37:13.675094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:13.675109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:13.675170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2272 reason: error at write: Disconnected sessionId: src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0
2025-10-10T14:37:13.675047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:13.675280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602146512735722:3836]
2025-10-10T14:37:13.675319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:13.675365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2272 sessionId: src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0 is DEAD
2025-10-10T14:37:13.675526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:13.675536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0] Write session will restart in 0.007066s
2025-10-10T14:37:13.675563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0] Write session: Do CDS request
2025-10-10T14:37:13.675571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:13.683833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.683949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:13.683964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2273
2025-10-10T14:37:13.684102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.684132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:13.684142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:13.684146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:13.684636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2273 sessionId:  describe result for acl check
2025-10-10T14:37:13.684675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:13.684682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:13.684686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:13.684692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602146512735801:4608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:13.685239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602146512735801:4608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:13.685653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:13.687172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602146512735801:4608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:13.687433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:13.687630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:13.687642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:13.687653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:13.687702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:13.687744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602145730504696:10283]
2025-10-10T14:37:13.688360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:13.688625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:13.688670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:13.688988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:13.689040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.689047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.689048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.689049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.689050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.689051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.689053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.689054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.689055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.689057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.689058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.689060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.689061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.689066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.689079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.689084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.689088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.689092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.689096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.689100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.689104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.689108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.689113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.689117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.689121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.689125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.689131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.689140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.689147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.689153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.689164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.689169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.689173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.689179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.689183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.689188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.689193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.689198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.689203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.689208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.689212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.689220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.689229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.689236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.689244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.689250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.689261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.689270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.689279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.689289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.689294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.689299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.689355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:13.689890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602146512735801:4608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:13.689906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602146512735801:4608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:13.689910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602146512735801:4608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:13.689919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:13.691458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:13.691824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:13.691837Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:13.691839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:13.691843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:13.691850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2272 [2:7559602145730504696:10283]
2025-10-10T14:37:13.691861Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:13.691884Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:13.691891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.691895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.691897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.691913Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:13.691925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:13.691936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:13.691992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.691999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.692001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.692003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:13.692067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:13.692074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.692086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.692103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.692125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:13.692152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735725:2438], now have 1 active actors on pipe
2025-10-10T14:37:13.692160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735838:4608], now have 1 active actors on pipe
2025-10-10T14:37:13.692168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602145730504690:10283]
2025-10-10T14:37:13.692170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602145730504690:10283]
2025-10-10T14:37:13.692172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602145730504690:10283]
2025-10-10T14:37:13.692185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:13.692195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:13.692173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2272
2025-10-10T14:37:13.692197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:13.692198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:13.692201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2272
2025-10-10T14:37:13.692202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:13.692217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:13.692225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:13.692257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602145730504690:10283]
2025-10-10T14:37:13.692268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:13.692273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:13.692399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.692409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.692451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:13.692464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.692473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.692475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:13.692491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.692506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:13.692524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.692699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.692708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.692726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.692830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2273 partition: 0 MaxSeqNo: 40 sessionId: src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0
2025-10-10T14:37:13.693203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdb061d9-f0db4e01-19ffc515-d6d51c80_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:13.695892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0] Write session: try to update token
2025-10-10T14:37:13.695913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:13.709384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId: src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:13.711101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:13.711121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:13.711125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:13.711127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:13.711139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602145730504690:10283]
2025-10-10T14:37:13.711143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602145730504690:10283]
2025-10-10T14:37:13.711147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602145730504690:10283]
2025-10-10T14:37:13.711197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:13.711205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:13.711208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.711210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:13.711214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:13.711218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:13.711359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:13.712058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:13.775343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602146512735850:3836]
2025-10-10T14:37:13.775685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2272, pipe: [1:7559602146512735850:3836]
2025-10-10T14:37:13.818098Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:13.818402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.818417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.818453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735850:3836], now have 1 active actors on pipe
2025-10-10T14:37:13.818689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:13.818713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:13.818759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602146512735850:3836]
2025-10-10T14:37:13.818760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:13.818834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0
2025-10-10T14:37:13.819021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2273 sessionId: src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0 is DEAD
2025-10-10T14:37:13.819191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:13.819203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0] Write session will restart in 0.005027s
2025-10-10T14:37:13.819229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0] Write session: Do CDS request
2025-10-10T14:37:13.819237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:13.825770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.825927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:13.825942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2274
2025-10-10T14:37:13.826076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:13.826114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:13.826133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:13.826143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:13.826690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2274 sessionId:  describe result for acl check
2025-10-10T14:37:13.826734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:13.826741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:13.826744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:13.826751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602146512735878:4629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:13.827365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602146512735878:4629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:13.829813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602146512735878:4629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:13.830110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:13.832149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:13.832334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:13.832345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:13.832358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:13.832411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:13.832410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602146512735878:4629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:13.832426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602146512735878:4629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:13.832430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602146512735878:4629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:13.832439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:13.832454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602145730504808:10285]
2025-10-10T14:37:13.833376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:13.833658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:13.833694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:13.833923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:13.833964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.833968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.833969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.833970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.833971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.833972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.833972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.833973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.833974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.833974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.833975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.833976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.833976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.833980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.833989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.833991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.833994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.833996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.833998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.834000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.834002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.834005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.834007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.834009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.834012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.834014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.834019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.834025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:13.834030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.834034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:13.834037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.834043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:13.834047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.834053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:13.834057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.834063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:13.834073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.834079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:13.834086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.834089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:13.834092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.834097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:13.834100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.834103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:13.834110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.834114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:13.834117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.834121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.834123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.834126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.834128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.834131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.834169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:13.836325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:13.836634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:13.836645Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:13.836646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:13.836649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:13.836654Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2273 [2:7559602145730504808:10285]
2025-10-10T14:37:13.836662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:13.836674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:13.836676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.836678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.836680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.836692Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:13.836697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:13.836703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:13.836750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.836756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.836757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.836759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:13.836810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:13.836818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.836825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:13.836831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:13.836841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:13.836860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735854:2438], now have 1 active actors on pipe
2025-10-10T14:37:13.836866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602145730504802:10285]
2025-10-10T14:37:13.836867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602145730504802:10285]
2025-10-10T14:37:13.836869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602145730504802:10285]
2025-10-10T14:37:13.836880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:13.836888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735959:4629], now have 1 active actors on pipe
2025-10-10T14:37:13.836898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:13.836908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:13.836914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:13.836932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602145730504802:10285]
2025-10-10T14:37:13.836938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:13.836943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:13.836947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:13.836950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:13.836951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2273
2025-10-10T14:37:13.836959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:13.837016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2273
2025-10-10T14:37:13.837053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.837062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.837086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:13.837096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:13.837099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:13.837101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:13.837109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:13.837125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:13.837135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.837345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.837356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.837372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:13.837485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2274 partition: 0 MaxSeqNo: 40 sessionId: src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0
2025-10-10T14:37:13.837865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee8f1769-369fdf52-fee283a6-9e1a7a22_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:13.840555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0] Write session: try to update token
2025-10-10T14:37:13.840572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:13.848157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:13.848180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:13.848192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602145730504802:10285]
2025-10-10T14:37:13.848243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:13.848248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:13.848432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:13.848585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:13.848734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:13.848886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:13.849177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:13.849220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:13.854035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId: src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:13.856634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:13.856852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.856873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.856914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:13.857000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:13.865581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:13.865602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:13.865605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:13.865607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:13.865620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602145730504802:10285]
2025-10-10T14:37:13.865624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602145730504802:10285]
2025-10-10T14:37:13.865627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602145730504802:10285]
2025-10-10T14:37:13.865669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:13.865676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:13.865685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:13.865686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:13.865694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:13.865698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:13.865814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:13.919187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602146512735971:3836]
2025-10-10T14:37:13.919527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2273, pipe: [1:7559602146512735971:3836]
2025-10-10T14:37:13.978825Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:13.986846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:13.986873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:13.987045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.987112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.987171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.987232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.987284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.987290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.987365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.987425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.987488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.987566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.987614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.987620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.987684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.987739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.987799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.987873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.987917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.987922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.987988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.988049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.988118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.988178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.988221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.988226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.988288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.988351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.988412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.988468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.988509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.988514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.988577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.988643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.988702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.988763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.988810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.988815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.988882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.988944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.989244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.989307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.989369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.989373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.989440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.989495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.989553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.989616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.989663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.989671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.989733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.989789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.989847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.989914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.989957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.989963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.990026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:13.990085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:13.990152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:13.990210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:13.990251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:13.990257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:13.990316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735971:3836], now have 1 active actors on pipe
2025-10-10T14:37:13.990705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602146512735971:3836]
2025-10-10T14:37:13.990768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:13.990771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:13.990784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:13.990807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2274 reason: error at write: Disconnected sessionId: src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0
2025-10-10T14:37:13.990925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:13.991637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2274 sessionId: src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0 is DEAD
2025-10-10T14:37:13.991769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:13.991781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0] Write session will restart in 0.008768s
2025-10-10T14:37:13.991800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0] Write session: Do CDS request
2025-10-10T14:37:13.991806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:14.001944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.002052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:14.002076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2275
2025-10-10T14:37:14.002259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.002300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:14.002307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:14.002312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:14.002844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2275 sessionId:  describe result for acl check
2025-10-10T14:37:14.002890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:14.002892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:14.002895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:14.002902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602150807703349:4633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:14.003574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602150807703349:4633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:14.004062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:14.006100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:14.006347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:14.006360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:14.006372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:14.006424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:14.006472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602150025472217:10287]
2025-10-10T14:37:14.006732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602150807703349:4633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:14.007116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:14.007397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:14.007447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:14.007833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:14.007911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.007918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.007920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.007921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.007922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.007924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.007925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.007926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.007928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.007929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.007931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.007932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.007933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.007939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.007952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.007956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.007960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.007964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.007967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.007971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.007974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.007978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.007982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.007985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.007989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.007992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.008000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.008009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.008015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.008019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.008023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.008028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.008035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.008040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.008045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.008049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.008054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.008058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.008062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.008071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.008075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.008081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.008091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.008097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.008101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.008107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.008113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.008118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.008123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.008129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.008135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.008145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.008184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:14.010615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602150807703349:4633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:14.010632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602150807703349:4633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:14.010636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602150807703349:4633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:14.010645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:14.010652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:14.010976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:14.010990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:14.010992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:14.010996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:14.011002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2274 [2:7559602150025472217:10287]
2025-10-10T14:37:14.011014Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:14.011032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:14.011036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.011039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.011042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.011059Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:14.011072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:14.011081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:14.011163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.011171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.011173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.011176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:14.011250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:14.011258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.011271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.011283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.011317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:14.011344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703382:4633], now have 1 active actors on pipe
2025-10-10T14:37:14.011352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602146512735979:2438], now have 1 active actors on pipe
2025-10-10T14:37:14.011360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602150025472212:10287]
2025-10-10T14:37:14.011362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602150025472212:10287]
2025-10-10T14:37:14.011365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602150025472212:10287]
2025-10-10T14:37:14.011382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:14.011373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2274
2025-10-10T14:37:14.011401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:14.011408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:14.011422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:14.011423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:14.011425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:14.011426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:14.011381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2274
2025-10-10T14:37:14.011449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602150025472212:10287]
2025-10-10T14:37:14.011458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:14.011461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:14.011477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.011488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.011557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:14.011570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.011574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.011577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:14.011588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.011601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:14.011626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.011826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.011849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.011865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.011979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2275 partition: 0 MaxSeqNo: 40 sessionId: src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0
2025-10-10T14:37:14.012388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4137e87f-9c130711-6c3c8ce3-d138d856_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:14.015809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0] Write session: try to update token
2025-10-10T14:37:14.015830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:14.032174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:14.032204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:14.032207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:14.032210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:14.032221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602150025472212:10287]
2025-10-10T14:37:14.032226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602150025472212:10287]
2025-10-10T14:37:14.032231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602150025472212:10287]
2025-10-10T14:37:14.032294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:14.032299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:14.032305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.032308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:14.032308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:14.032317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:14.032492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:14.036375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId: src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:14.039865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:14.090746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602150807703389:3836]
2025-10-10T14:37:14.091093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2274, pipe: [1:7559602150807703389:3836]
2025-10-10T14:37:14.160500Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:14.161558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.161585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.161633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703389:3836], now have 1 active actors on pipe
2025-10-10T14:37:14.161940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:14.161946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:14.161969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:14.162065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2275 reason: error at write: Disconnected sessionId: src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0
2025-10-10T14:37:14.162263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:14.162507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:14.162526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0] Write session will restart in 0.007327s
2025-10-10T14:37:14.162286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2275 sessionId: src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0 is DEAD
2025-10-10T14:37:14.162553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0] Write session: Do CDS request
2025-10-10T14:37:14.162332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602150807703389:3836]
2025-10-10T14:37:14.162560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:14.170921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.171210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:14.171233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2276
2025-10-10T14:37:14.171358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.171391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:14.171402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:14.171419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:14.171961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2276 sessionId:  describe result for acl check
2025-10-10T14:37:14.172004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:14.172011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:14.172014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:14.172020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602150807703439:4641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:14.172680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602150807703439:4641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:14.174913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602150807703439:4641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:14.175588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:14.178489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:14.178723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:14.178736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:14.178747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:14.178808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:14.178863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602150025472358:10297]
2025-10-10T14:37:14.178952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602150807703439:4641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:14.178966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602150807703439:4641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:14.178969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602150807703439:4641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:14.178977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:14.179557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:14.179896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:14.179941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:14.180273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:14.180350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.180359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.180360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.180361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.180362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.180363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.180365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.180366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.180368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.180369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.180370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.180372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.180374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.180380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.180392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.180397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.180401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.180406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.180411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.180415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.180419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.180423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.180427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.180431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.180436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.180440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.180447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.180455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.180461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.180468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.180472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.180477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.180483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.180489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.180494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.180500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.180505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.180511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.180518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.180524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.180528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.180534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.180539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.180545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.180549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.180555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.180561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.180566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.180571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.180577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.180582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.180588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.180630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:14.183461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:14.184051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:14.184070Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:14.184073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:14.184078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:14.184085Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2275 [2:7559602150025472358:10297]
2025-10-10T14:37:14.184103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:14.184123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:14.184132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.184136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.184139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.184159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:14.184169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:14.184183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:14.184258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.184266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.184268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.184270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:14.184351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:14.184360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.184380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.184394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.184414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:14.184438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703403:2438], now have 1 active actors on pipe
2025-10-10T14:37:14.184449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703511:4641], now have 1 active actors on pipe
2025-10-10T14:37:14.184457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602150025472353:10297]
2025-10-10T14:37:14.184460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602150025472353:10297]
2025-10-10T14:37:14.184463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602150025472353:10297]
2025-10-10T14:37:14.184488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:14.184510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:14.184534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:14.184542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:14.184545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:14.184549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:14.184554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:14.184580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602150025472353:10297]
2025-10-10T14:37:14.184590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:14.184606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:14.184637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.184642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.184530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2275
2025-10-10T14:37:14.184541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2275
2025-10-10T14:37:14.184687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:14.184700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.184704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.184706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:14.184721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.184733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:14.184755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.184969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.184991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.185021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.185164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2276 partition: 0 MaxSeqNo: 40 sessionId: src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0
2025-10-10T14:37:14.185757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e6c6ea-d5a89695-51f72105-1ae8ac5c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:14.188779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0] Write session: try to update token
2025-10-10T14:37:14.188802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:14.204291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId: src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:14.205531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:14.205555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:14.205558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:14.205559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:14.205569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602150025472353:10297]
2025-10-10T14:37:14.205573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602150025472353:10297]
2025-10-10T14:37:14.205577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602150025472353:10297]
2025-10-10T14:37:14.205631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:14.205644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.205646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:14.205658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:14.205685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:14.205689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:14.205811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:14.207614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:14.262699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602150807703546:3836]
2025-10-10T14:37:14.262987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2275, pipe: [1:7559602150807703546:3836]
2025-10-10T14:37:14.340108Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:14.340426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.340438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.340485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703546:3836], now have 1 active actors on pipe
2025-10-10T14:37:14.340887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:14.340910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:14.340996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2276 reason: error at write: Disconnected sessionId: src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0
2025-10-10T14:37:14.341221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2276 sessionId: src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0 is DEAD
2025-10-10T14:37:14.341311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:14.340776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:14.341397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602150807703546:3836]
2025-10-10T14:37:14.341648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:14.341660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0] Write session will restart in 0.008658s
2025-10-10T14:37:14.341690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0] Write session: Do CDS request
2025-10-10T14:37:14.341696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:14.351986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.352403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:14.352427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2277
2025-10-10T14:37:14.353466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.353522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:14.353528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:14.353533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:14.354077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2277 sessionId:  describe result for acl check
2025-10-10T14:37:14.354118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:14.354122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:14.354125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:14.354131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602150807703565:4670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:14.354788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602150807703565:4670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:14.359026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602150807703565:4670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:14.361350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:14.366413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602150807703565:4670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:14.366436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602150807703565:4670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:14.366440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602150807703565:4670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:14.366451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:14.366291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:14.366566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:14.366571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:14.366583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:14.366640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:14.366683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602150025472498:10306]
2025-10-10T14:37:14.367279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:14.367629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:14.367682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:14.368004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:14.368062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.368064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.368065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.368066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.368068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.368070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.368071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.368073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.368075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.368076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.368078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.368079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.368080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.368087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.368102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.368107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.368112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.368116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.368119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.368124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.368129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.368134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.368139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.368143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.368147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.368151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.368160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.368169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.368176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.368182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.368187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.368192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.368196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.368201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.368206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.368213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.368218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.368223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.368228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.368235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.368239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.368245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.368249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.368254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.368260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.368266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.368271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.368277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.368282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.368288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.368293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.368299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.368343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:14.371467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:14.372122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:14.372141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:14.372144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:14.372149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:14.372156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2276 [2:7559602150025472498:10306]
2025-10-10T14:37:14.372172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:14.372194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:14.372205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.372209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.372212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.372233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:14.372246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:14.372255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:14.372332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.372339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.372342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.372344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:14.372416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:14.372423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.372434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.372444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.372463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:14.372491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703655:4670], now have 1 active actors on pipe
2025-10-10T14:37:14.372504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602150025472493:10306]
2025-10-10T14:37:14.372506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602150025472493:10306]
2025-10-10T14:37:14.372507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602150025472493:10306]
2025-10-10T14:37:14.372521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:14.372532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703549:2438], now have 1 active actors on pipe
2025-10-10T14:37:14.372537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:14.372541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:14.372544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:14.372544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:14.372559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:14.372563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:14.372598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602150025472493:10306]
2025-10-10T14:37:14.372618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:14.372598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2276
2025-10-10T14:37:14.372623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2276
2025-10-10T14:37:14.372666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:14.372844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.372857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.372896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:14.372904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.372908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.372911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:14.372929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.372949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:14.372964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.373305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.373508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.373545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.373743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2277 partition: 0 MaxSeqNo: 40 sessionId: src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0
2025-10-10T14:37:14.374211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ffed9e-b6970c78-5c1d320-a1f4a0b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:14.376990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0] Write session: try to update token
2025-10-10T14:37:14.377014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:14.394407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId: src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:14.394804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:14.394835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:14.394838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:14.394841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:14.394853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602150025472493:10306]
2025-10-10T14:37:14.394859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602150025472493:10306]
2025-10-10T14:37:14.394864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602150025472493:10306]
2025-10-10T14:37:14.394932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:14.394949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.394953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:14.395154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:14.396557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:14.396585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:14.396590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:14.398182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:14.441463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602150807703667:3836]
2025-10-10T14:37:14.441833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2276, pipe: [1:7559602150807703667:3836]
2025-10-10T14:37:14.531519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602150807703667:3836]
2025-10-10T14:37:14.531530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:14.531577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:14.531652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2277 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0
2025-10-10T14:37:14.531867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2277 sessionId: src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0 is DEAD
2025-10-10T14:37:14.532066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:14.532081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0] Write session will restart in 0.007836s
2025-10-10T14:37:14.532110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0] Write session: Do CDS request
2025-10-10T14:37:14.532131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:14.530677Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:14.531011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.531022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.531071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703667:3836], now have 1 active actors on pipe
2025-10-10T14:37:14.531312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:14.540987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.541419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:14.541442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2278
2025-10-10T14:37:14.541647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.541707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:14.541722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:14.541727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:14.542277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2278 sessionId:  describe result for acl check
2025-10-10T14:37:14.542335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:14.542344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:14.542347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:14.542354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602150807703706:4676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:14.543016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602150807703706:4676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:14.546006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:14.545836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602150807703706:4676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:14.548536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:14.548806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:14.548818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:14.548831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:14.548893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:14.548941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602150025472615:10308]
2025-10-10T14:37:14.549622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:14.549936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:14.549985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:14.550338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:14.550396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.550403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.550404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.550405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.550406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.550408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.550409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.550410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.550412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.550413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.550414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.550415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.550417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.550423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.550437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.550442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.550446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.550451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.550455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.550458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.550462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.550467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.550471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.550475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.550479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.550483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.550492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.550501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.550507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.550513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.550518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.550524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.550528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.550534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.550539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.550544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.550549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.550555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.550560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.550565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.550570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.550582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.550586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.550591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.550601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.550607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.550612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.550618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.550622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.550627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.550632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.550638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.550678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:14.550831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602150807703706:4676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:14.550854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602150807703706:4676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:14.550860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602150807703706:4676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:14.550872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:14.553178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:14.553730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:14.553743Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:14.553746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:14.553750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:14.553757Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2277 [2:7559602150025472615:10308]
2025-10-10T14:37:14.553772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:14.553794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:14.553798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.553802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.553805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.553823Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:14.553836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:14.553858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:14.553925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.553932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.553936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.553939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:14.554011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:14.554019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.554033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.554045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.554063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:14.554085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703784:4676], now have 1 active actors on pipe
2025-10-10T14:37:14.554094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703671:2438], now have 1 active actors on pipe
2025-10-10T14:37:14.554102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602150025472610:10308]
2025-10-10T14:37:14.554105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602150025472610:10308]
2025-10-10T14:37:14.554107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602150025472610:10308]
2025-10-10T14:37:14.554121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:14.554135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:14.554135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:14.554138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:14.554140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:14.554155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:14.554158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:14.554184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602150025472610:10308]
2025-10-10T14:37:14.554191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:14.554194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:14.554138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2277
2025-10-10T14:37:14.554206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.554216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.554148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2277
2025-10-10T14:37:14.554268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:14.554281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.554291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.554293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:14.554306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.554318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:14.554342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.554532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.554543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.554560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.554649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2278 partition: 0 MaxSeqNo: 40 sessionId: src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0
2025-10-10T14:37:14.555086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13f929b1-50ef8c9a-e4c6f59e-5a8eb931_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:14.557930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0] Write session: try to update token
2025-10-10T14:37:14.557952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:14.572870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId: src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:14.574637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:14.574661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:14.574664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:14.574667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:14.574682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602150025472610:10308]
2025-10-10T14:37:14.574686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602150025472610:10308]
2025-10-10T14:37:14.574690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602150025472610:10308]
2025-10-10T14:37:14.574745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:14.574755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:14.574759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.574761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:14.574763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:14.574768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:14.574900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:14.575555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:14.631914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602150807703793:3836]
2025-10-10T14:37:14.632541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2277, pipe: [1:7559602150807703793:3836]
2025-10-10T14:37:14.692868Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:14.693181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.693204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.693263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703793:3836], now have 1 active actors on pipe
2025-10-10T14:37:14.693574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:14.693644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:14.693664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:14.693669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:14.693726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602150807703793:3836]
2025-10-10T14:37:14.693781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2278 reason: error at write: Disconnected sessionId: src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0
2025-10-10T14:37:14.693966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2278 sessionId: src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0 is DEAD
2025-10-10T14:37:14.694153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:14.694164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0] Write session will restart in 0.007800s
2025-10-10T14:37:14.694189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0] Write session: Do CDS request
2025-10-10T14:37:14.694199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:14.702928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.703108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:14.703136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2279
2025-10-10T14:37:14.703277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.703312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:14.703328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:14.703332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:14.703883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2279 sessionId:  describe result for acl check
2025-10-10T14:37:14.703928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:14.703937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:14.703939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:14.703945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602150807703820:4681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:14.704520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602150807703820:4681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:14.706935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602150807703820:4681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:14.709994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:14.710185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602150807703820:4681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:14.710205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602150807703820:4681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:14.710210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602150807703820:4681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:14.710220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:14.712188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:14.712443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:14.712454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:14.712466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:14.712519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:14.712566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602150025472733:10310]
2025-10-10T14:37:14.713002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:14.713385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:14.713460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:14.713812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:14.713885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.713892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.713893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.713896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.713897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.713898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.713899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.713901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.713902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.713903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.713904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.713906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.713907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.713914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.713927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.713931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.713936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.713940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.713944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.713948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.713952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.713956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.713961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.713964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.713968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.713972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.713980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.713989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.713995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.714001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.714007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.714012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.714017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.714022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.714026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.714031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.714035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.714042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.714047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.714052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.714057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.714061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.714066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.714071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.714077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.714082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.714088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.714093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.714096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.714100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.714112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.714117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.714153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:14.717024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:14.717617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:14.717636Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:14.717639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:14.717644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:14.717651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2278 [2:7559602150025472733:10310]
2025-10-10T14:37:14.717670Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:14.717694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:14.717704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.717708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.717710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.717731Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:14.717738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:14.717747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:14.717842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.717857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.717860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.717863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:14.717950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:14.717960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.717975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.717989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.718005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:14.718035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703903:4681], now have 1 active actors on pipe
2025-10-10T14:37:14.718046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703796:2438], now have 1 active actors on pipe
2025-10-10T14:37:14.718055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602150025472727:10310]
2025-10-10T14:37:14.718057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602150025472727:10310]
2025-10-10T14:37:14.718059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602150025472727:10310]
2025-10-10T14:37:14.718077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:14.718088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:14.718091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:14.718094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:14.718099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:14.718115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:14.718124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:14.718181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602150025472727:10310]
2025-10-10T14:37:14.718193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:14.718196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:14.718153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2278
2025-10-10T14:37:14.718155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2278
2025-10-10T14:37:14.718241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.718254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.718309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df196efe-1672e981-44f4ed3a-9b987b13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:14.718327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.718339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.718342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:14.718355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.718369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:14.718405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.718645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.718660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.718684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.718804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2279 partition: 0 MaxSeqNo: 40 sessionId: src_id|df196efe-1672e981-44f4ed3a-9b987b13_0
2025-10-10T14:37:14.719236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a578ca-1b227d05-446abf41-f61d8a6e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|df196efe-1672e981-44f4ed3a-9b987b13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:14.722185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df196efe-1672e981-44f4ed3a-9b987b13_0] Write session: try to update token
2025-10-10T14:37:14.722214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df196efe-1672e981-44f4ed3a-9b987b13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:14.739340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:14.739372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:14.739375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:14.739377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:14.739389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602150025472727:10310]
2025-10-10T14:37:14.739393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602150025472727:10310]
2025-10-10T14:37:14.739396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602150025472727:10310]
2025-10-10T14:37:14.739451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:14.739460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:14.739468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:14.739469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.739472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:14.739473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:14.739634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:14.741381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId: src_id|df196efe-1672e981-44f4ed3a-9b987b13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:14.744346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:14.793690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602150807703923:3836]
2025-10-10T14:37:14.793961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2278, pipe: [1:7559602150807703923:3836]
2025-10-10T14:37:14.856584Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:14.856820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.856837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.856882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703923:3836], now have 1 active actors on pipe
2025-10-10T14:37:14.857050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:14.857148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:14.857171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:14.857187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602150807703923:3836]
2025-10-10T14:37:14.857209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:14.857237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2279 reason: error at write: Disconnected sessionId: src_id|df196efe-1672e981-44f4ed3a-9b987b13_0
2025-10-10T14:37:14.857461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2279 sessionId: src_id|df196efe-1672e981-44f4ed3a-9b987b13_0 is DEAD
2025-10-10T14:37:14.857625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df196efe-1672e981-44f4ed3a-9b987b13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:14.857637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df196efe-1672e981-44f4ed3a-9b987b13_0] Write session will restart in 0.008539s
2025-10-10T14:37:14.857663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df196efe-1672e981-44f4ed3a-9b987b13_0] Write session: Do CDS request
2025-10-10T14:37:14.857669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df196efe-1672e981-44f4ed3a-9b987b13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:14.867914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df196efe-1672e981-44f4ed3a-9b987b13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.867983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:14.868002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2280
2025-10-10T14:37:14.868154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:14.868191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:14.868202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:14.868207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:14.868210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:14.868733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2280 sessionId:  describe result for acl check
2025-10-10T14:37:14.868767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:14.868773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:14.868775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:14.868779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602150807704008:4688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:14.869317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602150807704008:4688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:14.870008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:14.870233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:14.870250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:14.870264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:14.870326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:14.870371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602150025472850:10312]
2025-10-10T14:37:14.871065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:14.871394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:14.871431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602150807704008:4688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:14.871446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:14.871803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:14.871882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.871890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.871891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.871892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.871894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.871895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.871897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.871898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.871899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.871901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.871902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.871904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.871905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.871912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.871925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.871929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.871933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.871937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.871940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.871944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.871948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.871952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.871956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.871960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.871963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.871967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.871975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.871984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:14.871990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.871996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:14.872001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.872007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:14.872011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.872017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:14.872021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.872027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:14.872031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.872044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:14.872049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.872054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:14.872058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.872064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:14.872073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.872079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:14.872085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.872091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:14.872096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.872101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.872109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.872114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.872124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.872129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.872173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:14.874606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602150807704008:4688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:14.874626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602150807704008:4688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:14.874629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602150807704008:4688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:14.874638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:14.874676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:14.875029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:14.875045Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:14.875048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:14.875052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:14.875058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2279 [2:7559602150025472850:10312]
2025-10-10T14:37:14.875073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:14.875097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:14.875105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.875110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.875118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.875136Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:14.875149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:14.875164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:14.875234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.875242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.875245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.875248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:14.875323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:14.875331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.875343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:14.875360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:14.875383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:14.875417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807703928:2438], now have 1 active actors on pipe
2025-10-10T14:37:14.875421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807704042:4688], now have 1 active actors on pipe
2025-10-10T14:37:14.875429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602150025472844:10312]
2025-10-10T14:37:14.875433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602150025472844:10312]
2025-10-10T14:37:14.875435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602150025472844:10312]
2025-10-10T14:37:14.875450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:14.875450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2279
2025-10-10T14:37:14.875470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:14.875452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2279
2025-10-10T14:37:14.875474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:14.875479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:14.875482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:14.875491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:14.875495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:14.875548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602150025472844:10312]
2025-10-10T14:37:14.875563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:14.875570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:14.875582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.875587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.875641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:14.875655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:14.875666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:14.875668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:14.875680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:14.875692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:14.875714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.875937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:14.875946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:14.875963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:14.876041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2280 partition: 0 MaxSeqNo: 40 sessionId: src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0
2025-10-10T14:37:14.876454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df196efe-1672e981-44f4ed3a-9b987b13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:14.879338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0] Write session: try to update token
2025-10-10T14:37:14.879361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:14.894190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId: src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:14.895668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:14.895691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:14.895695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:14.895697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:14.895707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602150025472844:10312]
2025-10-10T14:37:14.895711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602150025472844:10312]
2025-10-10T14:37:14.895717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602150025472844:10312]
2025-10-10T14:37:14.895768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:14.895774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:14.895780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:14.895781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:14.895783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:14.895786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:14.895926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:14.896866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:14.957524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602150807704049:3836]
2025-10-10T14:37:14.957854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2279, pipe: [1:7559602150807704049:3836]
2025-10-10T14:37:15.008873Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:15.009314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.009345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.009396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602150807704049:3836], now have 1 active actors on pipe
2025-10-10T14:37:15.009656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:15.009726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602150807704049:3836]
2025-10-10T14:37:15.009727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:15.009734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:15.009763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:15.009827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2280 reason: error at write: Disconnected sessionId: src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0
2025-10-10T14:37:15.010031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2280 sessionId: src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0 is DEAD
2025-10-10T14:37:15.010247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:15.010256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0] Write session will restart in 0.005152s
2025-10-10T14:37:15.010276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0] Write session: Do CDS request
2025-10-10T14:37:15.010285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:15.016871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.016958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:15.016985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2281
2025-10-10T14:37:15.017177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.017216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:15.017231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:15.017235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:15.017733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2281 sessionId:  describe result for acl check
2025-10-10T14:37:15.017787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:15.017798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:15.017800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:15.017807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602155102671371:4692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:15.018444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602155102671371:4692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:15.020859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602155102671371:4692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:15.021508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:15.024253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:15.024478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:15.024490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:15.024501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:15.024551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:15.024587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602154320440265:10314]
2025-10-10T14:37:15.024721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602155102671371:4692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:15.024741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602155102671371:4692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:15.024745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602155102671371:4692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:15.024755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:15.025021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:15.025313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:15.025372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:15.025638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:15.025701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.025707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.025708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.025710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.025711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.025712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.025714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.025715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.025716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.025718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.025719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.025721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.025722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.025728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.025742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.025746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.025751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.025755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.025759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.025763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.025766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.025768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.025773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.025775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.025777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.025779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.025786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.025792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.025801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.025805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.025812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.025815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.025817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.025821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.025824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.025828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.025831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.025834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.025839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.025842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.025848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.025852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.025855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.025858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.025864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.025868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.025870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.025874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.025877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.025880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.025883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.025886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.025917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:15.028277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:15.028772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:15.028787Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:15.028790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:15.028795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:15.028803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2280 [2:7559602154320440265:10314]
2025-10-10T14:37:15.028816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:15.028834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:15.028842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.028845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.028848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.028865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:15.028878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:15.028891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:15.028971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.028982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.028985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.028987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:15.029063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:15.029073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.029085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.029098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.029116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:15.029143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671458:4692], now have 1 active actors on pipe
2025-10-10T14:37:15.029152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671347:2438], now have 1 active actors on pipe
2025-10-10T14:37:15.029159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602154320440259:10314]
2025-10-10T14:37:15.029162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602154320440259:10314]
2025-10-10T14:37:15.029164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602154320440259:10314]
2025-10-10T14:37:15.029177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:15.029191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:15.029192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:15.029195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:15.029197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:15.029213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:15.029221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:15.029204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2280
2025-10-10T14:37:15.029256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2280
2025-10-10T14:37:15.029245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602154320440259:10314]
2025-10-10T14:37:15.029253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:15.029255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:15.029279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.029288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.029351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:15.029364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.029369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.029371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:15.029383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.029398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:15.029427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.029605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.029614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.029628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.029711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2281 partition: 0 MaxSeqNo: 40 sessionId: src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0
2025-10-10T14:37:15.030112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98db16f6-39d8bef3-6c6f2bbc-ce616b2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:15.033043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0] Write session: try to update token
2025-10-10T14:37:15.033062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:15.047903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId: src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:15.050171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:15.050194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:15.050196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:15.050202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:15.050210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602154320440259:10314]
2025-10-10T14:37:15.050213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602154320440259:10314]
2025-10-10T14:37:15.050215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602154320440259:10314]
2025-10-10T14:37:15.050260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:15.050266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.050268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:15.050265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:15.050282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:15.050287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:15.050409Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:15.050550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:15.110120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602155102671469:3836]
2025-10-10T14:37:15.110489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2280, pipe: [1:7559602155102671469:3836]
2025-10-10T14:37:15.161707Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:15.162016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.162029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.162069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671469:3836], now have 1 active actors on pipe
2025-10-10T14:37:15.162264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:15.162433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:15.162449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602155102671469:3836]
2025-10-10T14:37:15.162454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:15.162470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:15.162534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2281 reason: error at write: Disconnected sessionId: src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0
2025-10-10T14:37:15.162730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2281 sessionId: src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0 is DEAD
2025-10-10T14:37:15.162927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:15.162941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0] Write session will restart in 0.005775s
2025-10-10T14:37:15.162969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0] Write session: Do CDS request
2025-10-10T14:37:15.162976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:15.169918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.169959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:15.170002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2282
2025-10-10T14:37:15.170179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.170209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:15.170214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:15.170217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:15.170855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2282 sessionId:  describe result for acl check
2025-10-10T14:37:15.170889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:15.170891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:15.170892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:15.170898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602155102671511:4714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:15.171557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602155102671511:4714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:15.173610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602155102671511:4714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:15.174216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:15.176995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:15.177066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602155102671511:4714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:15.177082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602155102671511:4714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:15.177085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602155102671511:4714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:15.177094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:15.177238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:15.177253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:15.177265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:15.177321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:15.177423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602154320440399:10318]
2025-10-10T14:37:15.178145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:15.178439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:15.178483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:15.178781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:15.178845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.178854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.178856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.178857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.178858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.178859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.178860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.178860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.178861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.178862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.178863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.178864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.178865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.178869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.178878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.178880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.178883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.178885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.178888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.178891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.178894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.178896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.178899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.178902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.178905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.178908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.178913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.178919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.178923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.178927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.178930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.178934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.178937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.178945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.178951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.178957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.178961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.178968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.178973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.178979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.178984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.178989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.178994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.179005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.179015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.179021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.179031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.179041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.179050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.179055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.179067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.179073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.179116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:15.181886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:15.182573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:15.182589Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:15.182592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:15.182597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:15.182605Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2281 [2:7559602154320440399:10318]
2025-10-10T14:37:15.182621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:15.182645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:15.182653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.182658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.182661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.182679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:15.182693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:15.182706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:15.182782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.182792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.182795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.182798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:15.182886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:15.182889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.182903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.182918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.182937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:15.182959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671597:4714], now have 1 active actors on pipe
2025-10-10T14:37:15.182963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671485:2438], now have 1 active actors on pipe
2025-10-10T14:37:15.182972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602154320440393:10318]
2025-10-10T14:37:15.182977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602154320440393:10318]
2025-10-10T14:37:15.182981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602154320440393:10318]
2025-10-10T14:37:15.182998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:15.183015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:15.183039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:15.183047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:15.183078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602154320440393:10318]
2025-10-10T14:37:15.183087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:15.183125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:15.183135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:15.183138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:15.183145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:15.183569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2281
2025-10-10T14:37:15.183572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2281
2025-10-10T14:37:15.183671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.183688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.183718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:15.183732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.183742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.183744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:15.183756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.183770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:15.183792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.183994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.184009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.184033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.184139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2282 partition: 0 MaxSeqNo: 40 sessionId: src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0
2025-10-10T14:37:15.184676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281d55ca-b2c12871-580bd0ca-71f5312a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:15.187630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0] Write session: try to update token
2025-10-10T14:37:15.187654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:15.204959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId: src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:15.208084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:15.205945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:15.205969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:15.205973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:15.205976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:15.205986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602154320440393:10318]
2025-10-10T14:37:15.205992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602154320440393:10318]
2025-10-10T14:37:15.205997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602154320440393:10318]
2025-10-10T14:37:15.206057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:15.206066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.206064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:15.206073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:15.206093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:15.206099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:15.206246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:15.262806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602155102671612:3836]
2025-10-10T14:37:15.263267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2281, pipe: [1:7559602155102671612:3836]
2025-10-10T14:37:15.321927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:15.322438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.322456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.322504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671612:3836], now have 1 active actors on pipe
2025-10-10T14:37:15.322862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:15.323155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602155102671612:3836]
2025-10-10T14:37:15.323399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:15.324016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:15.324115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2282 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0
2025-10-10T14:37:15.324338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2282 sessionId: src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0 is DEAD
2025-10-10T14:37:15.324677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:15.324703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0] Write session will restart in 0.006642s
2025-10-10T14:37:15.324731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0] Write session: Do CDS request
2025-10-10T14:37:15.324738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:15.333071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.333374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:15.333405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2283
2025-10-10T14:37:15.334426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.334474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:15.334481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:15.334487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:15.340883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:15.335370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2283 sessionId:  describe result for acl check
2025-10-10T14:37:15.335409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:15.335412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:15.335414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:15.335421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602155102671696:4735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:15.336003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602155102671696:4735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:15.339628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602155102671696:4735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:15.342057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:15.342262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:15.342276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:15.342287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:15.342338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:15.342391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602154320440558:10333]
2025-10-10T14:37:15.343107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:15.344056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:15.344104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:15.344447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:15.344497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.344499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.344500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.344501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.344503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.344504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.344505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.344507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.344508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.344510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.344511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.344513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.344514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.344520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.344533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.344538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.344543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.344547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.344552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.344557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.344561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.344566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.344571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.344576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.344580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.344585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.344593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.344603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.344610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.344616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.344622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.344629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.344634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.344640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.344646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.344652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.344657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.344663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.344669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.344675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.344680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.344686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.344692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.344699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.344704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.344711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.344716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.344723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.344728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.344734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.344740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.344746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.344792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:15.345738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602155102671696:4735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:15.345760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602155102671696:4735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:15.345763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602155102671696:4735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:15.345786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:15.347318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:15.347846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:15.347861Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:15.347863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:15.347867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:15.347874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2282 [2:7559602154320440558:10333]
2025-10-10T14:37:15.347889Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:15.347904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:15.347907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.347910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.347913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.347927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:15.347939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:15.347946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:15.348009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.348018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.348021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.348024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:15.348093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:15.348100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.348115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.348132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.348156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:15.348223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2282
2025-10-10T14:37:15.348235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2282
2025-10-10T14:37:15.348180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671637:2438], now have 1 active actors on pipe
2025-10-10T14:37:15.348193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671751:4735], now have 1 active actors on pipe
2025-10-10T14:37:15.348200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602154320440552:10333]
2025-10-10T14:37:15.348202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602154320440552:10333]
2025-10-10T14:37:15.348204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602154320440552:10333]
2025-10-10T14:37:15.348218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:15.348232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:15.348233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:15.348236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:15.348239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:15.348248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:15.348251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:15.348274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602154320440552:10333]
2025-10-10T14:37:15.348278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:15.348279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:15.348297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.348302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.348345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a589899-5408e515-9866534a-6798e889_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:15.348352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.348359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.348361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:15.348370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.348379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:15.348400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.348685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.348699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.348722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.348808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2283 partition: 0 MaxSeqNo: 40 sessionId: src_id|5a589899-5408e515-9866534a-6798e889_0
2025-10-10T14:37:15.349257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17eddc0d-625a8889-1ec2f465-ee1aaf59_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5a589899-5408e515-9866534a-6798e889_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:15.352071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a589899-5408e515-9866534a-6798e889_0] Write session: try to update token
2025-10-10T14:37:15.352092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a589899-5408e515-9866534a-6798e889_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:15.370236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId: src_id|5a589899-5408e515-9866534a-6798e889_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:15.374432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:15.376666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.376706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.376730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:15.376734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:15.376738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:15.376740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:15.376752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602154320440552:10333]
2025-10-10T14:37:15.376758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602154320440552:10333]
2025-10-10T14:37:15.376764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602154320440552:10333]
2025-10-10T14:37:15.376810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:15.376816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:15.376820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:15.376838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:15.376850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.376853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:15.377040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:15.423561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602155102671758:3836]
2025-10-10T14:37:15.425855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2282, pipe: [1:7559602155102671758:3836]
2025-10-10T14:37:15.517094Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:15.517684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:15.517759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671758:3836], now have 1 active actors on pipe
2025-10-10T14:37:15.521550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:15.523612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:15.523675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602155102671758:3836]
2025-10-10T14:37:15.540821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:15.540847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:15.540878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2283 reason: error at write: Disconnected sessionId: src_id|5a589899-5408e515-9866534a-6798e889_0
2025-10-10T14:37:15.541048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2283 sessionId: src_id|5a589899-5408e515-9866534a-6798e889_0 is DEAD
2025-10-10T14:37:15.545607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a589899-5408e515-9866534a-6798e889_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:15.545624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a589899-5408e515-9866534a-6798e889_0] Write session will restart in 0.007053s
2025-10-10T14:37:15.545652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a589899-5408e515-9866534a-6798e889_0] Write session: Do CDS request
2025-10-10T14:37:15.545660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a589899-5408e515-9866534a-6798e889_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:15.553948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a589899-5408e515-9866534a-6798e889_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.557525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:15.557547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2284
2025-10-10T14:37:15.557746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.557788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:15.557796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:15.557802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:15.558285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2284 sessionId:  describe result for acl check
2025-10-10T14:37:15.558330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:15.558339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:15.558341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:15.558349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602155102671777:4751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:15.558943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602155102671777:4751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:15.572888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602155102671777:4751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:15.578937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602155102671777:4751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:15.578963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602155102671777:4751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:15.578967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602155102671777:4751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:15.578978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:15.592622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:15.597709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:15.598029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:15.598044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:15.598059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:15.598138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:15.598194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602154320440683:10335]
2025-10-10T14:37:15.598919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:15.601823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:15.601905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:15.602309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:15.602377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.602383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.602385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.602386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.602389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.602390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.602392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.602394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.602395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.602397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.602398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.602399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.602400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.602408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.602423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.602428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.602433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.602437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.602442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.602447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.602451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.602456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.602461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.602465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.602470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.602477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.602486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.602497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.602504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.602510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.602523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.602529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.602535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.602541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.602546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.602552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.602557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.602565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.602570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.602576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.602582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.602588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.602593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.602599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.602607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.602613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.602618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.602623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.602628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.602634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.602639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.602645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.602694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:15.609982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:15.610568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:15.610575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:15.610581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:15.610586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:15.610594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2283 [2:7559602154320440683:10335]
2025-10-10T14:37:15.610610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:15.610631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:15.610635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.610640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.610643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.610663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:15.610671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:15.610679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:15.610752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.610754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.610756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.610759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:15.610839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:15.610843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.610857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.610869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.610901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:15.610924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602154320440678:10335]
2025-10-10T14:37:15.610926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602154320440678:10335]
2025-10-10T14:37:15.610930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602154320440678:10335]
2025-10-10T14:37:15.610949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:15.610964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:15.610980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:15.610984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:15.611027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602154320440678:10335]
2025-10-10T14:37:15.611029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:15.613546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2283
2025-10-10T14:37:15.613605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2283
2025-10-10T14:37:15.613110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:15.613122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:15.613125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:15.613133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:15.613465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671871:4751], now have 1 active actors on pipe
2025-10-10T14:37:15.613483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671761:2438], now have 1 active actors on pipe
2025-10-10T14:37:15.613870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.613890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.613943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97e24a03-16a7e06b-4d30001-ca26f804_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:15.613958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.613964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.613967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:15.613984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.614005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:15.614028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.621582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602155102671884:3836]
2025-10-10T14:37:15.622164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2283, pipe: [1:7559602155102671884:3836]
2025-10-10T14:37:15.622068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.622097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.622122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671884:3836], now have 1 active actors on pipe
2025-10-10T14:37:15.622150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.622825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a589899-5408e515-9866534a-6798e889_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|97e24a03-16a7e06b-4d30001-ca26f804_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:15.625657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97e24a03-16a7e06b-4d30001-ca26f804_0] Write session: try to update token
2025-10-10T14:37:15.625678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97e24a03-16a7e06b-4d30001-ca26f804_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:15.622335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2284 partition: 0 MaxSeqNo: 40 sessionId: src_id|97e24a03-16a7e06b-4d30001-ca26f804_0
2025-10-10T14:37:15.643386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId: src_id|97e24a03-16a7e06b-4d30001-ca26f804_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:15.646353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:15.647687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.647716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.647743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:15.647747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:15.647751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:15.647753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:15.647767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602154320440678:10335]
2025-10-10T14:37:15.647780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602154320440678:10335]
2025-10-10T14:37:15.647788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602154320440678:10335]
2025-10-10T14:37:15.647836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:15.647852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:15.647853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:15.647861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.647863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:15.647865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:15.648007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:15.765744Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:15.766044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:15.766271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:15.766850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602155102671884:3836]
2025-10-10T14:37:15.766895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:15.779249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:15.779269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:15.779291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2284 reason: error at write: Disconnected sessionId: src_id|97e24a03-16a7e06b-4d30001-ca26f804_0
2025-10-10T14:37:15.779431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2284 sessionId: src_id|97e24a03-16a7e06b-4d30001-ca26f804_0 is DEAD
2025-10-10T14:37:15.781566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e24a03-16a7e06b-4d30001-ca26f804_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:15.781580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e24a03-16a7e06b-4d30001-ca26f804_0] Write session will restart in 0.008476s
2025-10-10T14:37:15.781608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e24a03-16a7e06b-4d30001-ca26f804_0] Write session: Do CDS request
2025-10-10T14:37:15.781616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e24a03-16a7e06b-4d30001-ca26f804_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:15.790985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97e24a03-16a7e06b-4d30001-ca26f804_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.791091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:15.791123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2285
2025-10-10T14:37:15.791342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.791407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:15.791413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:15.791418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:15.791928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2285 sessionId:  describe result for acl check
2025-10-10T14:37:15.791961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:15.791963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:15.791965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:15.791976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602155102671956:4750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:15.792562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602155102671956:4750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:15.794687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602155102671956:4750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:15.794914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:15.796785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:15.797080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:15.797093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:15.797106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:15.797175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:15.797228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602154320440805:10337]
2025-10-10T14:37:15.797841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:15.798138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:15.798195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:15.798360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602155102671956:4750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:15.798376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602155102671956:4750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:15.798380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602155102671956:4750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:15.798389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:15.798509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:15.798610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.798618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.798619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.798620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.798622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.798623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.798624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.798625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.798627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.798628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.798630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.798631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.798634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.798640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.798654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.798659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.798663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.798666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.798670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.798673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.798677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.798682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.798686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.798689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.798694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.798697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.798705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.798714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.798720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.798725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.798730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.798735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.798739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.798745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.798750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.798754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.798758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.798763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.798767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.798772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.798775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.798780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.798785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.798790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.798794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.798799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.798803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.798807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.798811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.798815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.798819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.798823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.798862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:15.801363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:15.801796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:15.801810Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:15.801811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:15.801815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:15.801822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2284 [2:7559602154320440805:10337]
2025-10-10T14:37:15.801835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:15.801852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:15.801856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.801859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.801862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.801880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:15.801893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:15.801901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:15.801997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.802003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.802005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.802007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:15.802062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:15.802070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.802081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.802098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.802124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:15.802155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102671894:2438], now have 1 active actors on pipe
2025-10-10T14:37:15.802158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102672012:4750], now have 1 active actors on pipe
2025-10-10T14:37:15.802176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602154320440800:10337]
2025-10-10T14:37:15.802179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602154320440800:10337]
2025-10-10T14:37:15.802181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602154320440800:10337]
2025-10-10T14:37:15.802195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:15.802209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:15.802226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:15.802227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:15.802232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:15.802233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:15.802234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:15.802257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602154320440800:10337]
2025-10-10T14:37:15.802267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:15.802285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:15.805509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2284
2025-10-10T14:37:15.805672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2284
2025-10-10T14:37:15.805690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.805710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.805752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:15.805772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.805777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.805780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:15.805794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.805811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:15.805832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.806106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.806120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.806144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.806257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2285 partition: 0 MaxSeqNo: 40 sessionId: src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0
2025-10-10T14:37:15.809623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e24a03-16a7e06b-4d30001-ca26f804_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:15.812686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0] Write session: try to update token
2025-10-10T14:37:15.812707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:15.817415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:15.817447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:15.817460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602154320440800:10337]
2025-10-10T14:37:15.817520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:15.817526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:15.817807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:15.818024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:15.818239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:15.818436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:15.818737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:15.818793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:15.837839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId: src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:15.840817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:15.838034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:15.838065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:15.838069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:15.838071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:15.838085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602154320440800:10337]
2025-10-10T14:37:15.838094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602154320440800:10337]
2025-10-10T14:37:15.838099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602154320440800:10337]
2025-10-10T14:37:15.838153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:15.838162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:15.838162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:15.838166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:15.838170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.838172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:15.838361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:15.866875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602155102672024:3836]
2025-10-10T14:37:15.867229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2284, pipe: [1:7559602155102672024:3836]
2025-10-10T14:37:15.916956Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:37:15.957125Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:15.957466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.957484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.957509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102672024:3836], now have 1 active actors on pipe
2025-10-10T14:37:15.957745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:15.957789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:15.957794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:15.957818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602155102672024:3836]
2025-10-10T14:37:15.957824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:15.957868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2285 reason: error at write: Disconnected sessionId: src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0
2025-10-10T14:37:15.958094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2285 sessionId: src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0 is DEAD
2025-10-10T14:37:15.958269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:15.958285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0] Write session will restart in 0.006408s
2025-10-10T14:37:15.958312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0] Write session: Do CDS request
2025-10-10T14:37:15.958319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:15.965903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.965971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:15.965993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2286
2025-10-10T14:37:15.966318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:15.966364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:15.966376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:15.966381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:15.966940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2286 sessionId:  describe result for acl check
2025-10-10T14:37:15.966988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:15.966991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:15.966993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:15.967000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602155102672044:4739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:15.967629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602155102672044:4739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:15.971340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602155102672044:4739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:15.973902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:15.974226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602155102672044:4739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:15.974247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602155102672044:4739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:15.974251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602155102672044:4739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:15.974260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:15.976740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:15.977212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:15.977228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:15.977242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:15.977318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:15.977394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602154320440930:10339]
2025-10-10T14:37:15.978091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:15.978501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:15.978571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:15.978957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:15.979058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.979059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.979061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.979063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.979064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.979066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.979068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.979070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.979071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.979073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.979075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.979077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.979079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.979087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.979099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.979104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.979109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.979113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.979118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.979122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.979126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.979130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.979136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.979140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.979144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.979149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.979157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.979166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:15.979175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.979183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:15.979189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.979196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:15.979201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.979208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:15.979214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.979221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:15.979226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.979233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:15.979241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.979247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:15.979253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.979259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:15.979269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.979275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:15.979281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.979287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:15.979294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.979300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.979308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.979314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.979320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.979326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.979375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:15.982330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:15.983141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2285
2025-10-10T14:37:15.983153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2285
2025-10-10T14:37:15.982709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:15.982726Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:15.982729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:15.982733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:15.982741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2285 [2:7559602154320440930:10339]
2025-10-10T14:37:15.982757Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:15.982773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:15.982777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.982780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.982784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.982809Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:15.982817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:15.982824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:15.982892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.982895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.982897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.982899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:15.983117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:15.983120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:15.983133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:15.983144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:15.983162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:15.983184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102672028:2438], now have 1 active actors on pipe
2025-10-10T14:37:15.983188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602155102672141:4739], now have 1 active actors on pipe
2025-10-10T14:37:15.983196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602154320440924:10339]
2025-10-10T14:37:15.983198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602154320440924:10339]
2025-10-10T14:37:15.983202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602154320440924:10339]
2025-10-10T14:37:15.983219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:15.983234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:15.983237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:15.983239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:15.983240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:15.983254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:15.983257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:15.983273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.983278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.983315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602154320440924:10339]
2025-10-10T14:37:15.983322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:15.983330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:15.983338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:15.983345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:15.983349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:15.983352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:15.983362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:15.983372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:15.983403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.983662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:15.983672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:15.983688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:15.983894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2286 partition: 0 MaxSeqNo: 40 sessionId: src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0
2025-10-10T14:37:15.984392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bcbbafc-2f149064-920941cd-27fbd6fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:15.987477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0] Write session: try to update token
2025-10-10T14:37:15.987515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:16.006777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:16.006808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:16.006811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:16.006815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:16.006835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602154320440924:10339]
2025-10-10T14:37:16.006841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602154320440924:10339]
2025-10-10T14:37:16.006846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602154320440924:10339]
2025-10-10T14:37:16.006910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:16.006912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:16.006922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.006925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:16.006932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:16.006937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:16.007120Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:16.007810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId: src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:16.010574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:16.057806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602159397639449:3836]
2025-10-10T14:37:16.058175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2285, pipe: [1:7559602159397639449:3836]
2025-10-10T14:37:16.132544Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:16.132905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.132916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.132959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639449:3836], now have 1 active actors on pipe
2025-10-10T14:37:16.133283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602159397639449:3836]
2025-10-10T14:37:16.133348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:16.133351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:16.133426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:16.133434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2286 reason: error at write: Disconnected sessionId: src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0
2025-10-10T14:37:16.133632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2286 sessionId: src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0 is DEAD
2025-10-10T14:37:16.133708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:16.133826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:16.133839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0] Write session will restart in 0.005003s
2025-10-10T14:37:16.133866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0] Write session: Do CDS request
2025-10-10T14:37:16.133876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:16.140001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.140073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:16.140107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2287
2025-10-10T14:37:16.140289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.140327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:16.140338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:16.140342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:16.140800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2287 sessionId:  describe result for acl check
2025-10-10T14:37:16.140835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:16.140841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:16.140844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:16.140849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602159397639460:4765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:16.141507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602159397639460:4765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:16.144523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602159397639460:4765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:16.148382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602159397639460:4765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:16.148404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602159397639460:4765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:16.148408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602159397639460:4765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:16.148418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:16.152278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:16.155616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:16.156047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:16.156052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:16.156067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:16.156130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:16.156175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602158615408365:10343]
2025-10-10T14:37:16.156852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:16.157172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:16.157219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:16.157539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:16.157607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.157615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.157616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.157618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.157619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.157620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.157622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.157623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.157624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.157625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.157627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.157630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.157631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.157636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.157644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.157647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.157649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.157651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.157654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.157656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.157658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.157661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.157665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.157669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.157673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.157677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.157685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.157693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.157700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.157706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.157710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.157716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.157721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.157733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.157738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.157743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.157748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.157753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.157759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.157766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.157771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.157777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.157793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.157806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.157812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.157818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.157824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.157829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.157841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.157847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.157851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.157856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.157895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:16.163899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:16.164985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2286
2025-10-10T14:37:16.165002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2286
2025-10-10T14:37:16.164565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:16.164584Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:16.164587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:16.164590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:16.164595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2286 [2:7559602158615408365:10343]
2025-10-10T14:37:16.164608Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:16.164623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:16.164625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.164627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.164629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.164642Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:16.164650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:16.164657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:16.164726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.164728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.164730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.164732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:16.164797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:16.164800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.164809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.164816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.164826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:16.164842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602158615408359:10343]
2025-10-10T14:37:16.164843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602158615408359:10343]
2025-10-10T14:37:16.164846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602158615408359:10343]
2025-10-10T14:37:16.164852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:16.164863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:16.164864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:16.164868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:16.164871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:16.164872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:16.164873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:16.164881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639529:4765], now have 1 active actors on pipe
2025-10-10T14:37:16.164884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639452:2438], now have 1 active actors on pipe
2025-10-10T14:37:16.164915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602158615408359:10343]
2025-10-10T14:37:16.164923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:16.164931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:16.165060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.165065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.165096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:16.165106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.165109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.165112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:16.165121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.165132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:16.165144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.165295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.165298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.165314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.165462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2287 partition: 0 MaxSeqNo: 40 sessionId: src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0
2025-10-10T14:37:16.165885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|871a1388-f2e5629a-f35ab06b-d3c7210c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:16.169169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0] Write session: try to update token
2025-10-10T14:37:16.169188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:16.188825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:16.188861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:16.188865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:16.188867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:16.188879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602158615408359:10343]
2025-10-10T14:37:16.188885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602158615408359:10343]
2025-10-10T14:37:16.188894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602158615408359:10343]
2025-10-10T14:37:16.188955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:16.188966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.188969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:16.189134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:16.191531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId: src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:16.191976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:16.192005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:16.192011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:16.195060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:16.233438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602159397639592:3836]
2025-10-10T14:37:16.233977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2286, pipe: [1:7559602159397639592:3836]
2025-10-10T14:37:16.307902Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:16.308403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.308429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.308472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639592:3836], now have 1 active actors on pipe
2025-10-10T14:37:16.308699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:16.309130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:16.309146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0] Write session will restart in 0.009058s
2025-10-10T14:37:16.309173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0] Write session: Do CDS request
2025-10-10T14:37:16.309181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:16.308666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:16.308672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602159397639592:3836]
2025-10-10T14:37:16.308691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:16.308696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:16.308784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2287 reason: error at write: Disconnected sessionId: src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0
2025-10-10T14:37:16.308962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2287 sessionId: src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0 is DEAD
2025-10-10T14:37:16.320005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.320138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:16.320166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2288
2025-10-10T14:37:16.320395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.320443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:16.320464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:16.320468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:16.321070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2288 sessionId:  describe result for acl check
2025-10-10T14:37:16.321151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:16.321158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:16.321161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:16.321166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602159397639667:4776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:16.321831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602159397639667:4776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:16.325051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:16.333067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:16.333374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:16.333380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:16.333394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:16.333470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:16.333522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602158615408522:10356]
2025-10-10T14:37:16.334454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:16.334326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602159397639667:4776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:16.335004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:16.335117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:16.335479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:16.335579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.335580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.335582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.335583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.335585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.335587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.335588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.335590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.335592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.335594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.335596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.335597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.335599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.335606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.335618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.335622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.335627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.335631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.335635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.335640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.335644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.335649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.335654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.335659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.335663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.335667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.335677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.335687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.335696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.335703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.335709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.335716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.335721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.335728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.335734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.335741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.335746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.335754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.335760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.335767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.335773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.335780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.335787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.335794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.335799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.335806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.335812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.335817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.335823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.335830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.335835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.335842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.335891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:16.346287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:16.346788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:16.346813Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:16.346817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:16.346822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:16.346831Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2287 [2:7559602158615408522:10356]
2025-10-10T14:37:16.346849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:16.346873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:16.346878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.346883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.346886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.346907Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:16.346918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:16.346939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:16.346419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602159397639667:4776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:16.346445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602159397639667:4776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:16.346448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602159397639667:4776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:16.346459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:16.347216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.347228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.347231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.347234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:16.347417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:16.347432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.347447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.347461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.347478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:16.347521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602158615408516:10356]
2025-10-10T14:37:16.347533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602158615408516:10356]
2025-10-10T14:37:16.347535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602158615408516:10356]
2025-10-10T14:37:16.347559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:16.347578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:16.347594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:16.347598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:16.347651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602158615408516:10356]
2025-10-10T14:37:16.347655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:16.348044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:16.348060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:16.348063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:16.348071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:16.348358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639730:4776], now have 1 active actors on pipe
2025-10-10T14:37:16.348370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639597:2438], now have 1 active actors on pipe
2025-10-10T14:37:16.348390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.348401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.348437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2224002b-46a609b3-f54b6100-c2bf9729_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:16.348467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.348476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.348479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:16.348493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.348513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:16.348538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.350076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.350091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.350112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.350684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7983eaa4-22501b77-d25a876b-f4c03b72_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2224002b-46a609b3-f54b6100-c2bf9729_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:16.348082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2287
2025-10-10T14:37:16.348142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2287
2025-10-10T14:37:16.350264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2288 partition: 0 MaxSeqNo: 40 sessionId: src_id|2224002b-46a609b3-f54b6100-c2bf9729_0
2025-10-10T14:37:16.362848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2224002b-46a609b3-f54b6100-c2bf9729_0] Write session: try to update token
2025-10-10T14:37:16.362874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2224002b-46a609b3-f54b6100-c2bf9729_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:16.374228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:16.374261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:16.374265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:16.374268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:16.374279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602158615408516:10356]
2025-10-10T14:37:16.374283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602158615408516:10356]
2025-10-10T14:37:16.374288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602158615408516:10356]
2025-10-10T14:37:16.374343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:16.374353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.374355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:16.374513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:16.375270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:16.375276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:16.375290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:16.386452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId: src_id|2224002b-46a609b3-f54b6100-c2bf9729_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:16.389481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:16.409080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602159397639749:3836]
2025-10-10T14:37:16.410975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2287, pipe: [1:7559602159397639749:3836]
2025-10-10T14:37:16.504575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:16.505044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.505067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.505097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639749:3836], now have 1 active actors on pipe
2025-10-10T14:37:16.505366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:16.505869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602159397639749:3836]
2025-10-10T14:37:16.505898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:16.505939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:16.506018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2224002b-46a609b3-f54b6100-c2bf9729_0
2025-10-10T14:37:16.506201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2288 sessionId: src_id|2224002b-46a609b3-f54b6100-c2bf9729_0 is DEAD
2025-10-10T14:37:16.509655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2224002b-46a609b3-f54b6100-c2bf9729_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:16.509668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2224002b-46a609b3-f54b6100-c2bf9729_0] Write session will restart in 0.008723s
2025-10-10T14:37:16.509695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2224002b-46a609b3-f54b6100-c2bf9729_0] Write session: Do CDS request
2025-10-10T14:37:16.509703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2224002b-46a609b3-f54b6100-c2bf9729_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:16.519926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2224002b-46a609b3-f54b6100-c2bf9729_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.520682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:16.520706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2289
2025-10-10T14:37:16.520886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.520949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:16.520961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:16.520965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:16.521442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2289 sessionId:  describe result for acl check
2025-10-10T14:37:16.521486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:16.521493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:16.521495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:16.521502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602159397639785:4783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:16.522151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602159397639785:4783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:16.525113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602159397639785:4783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:16.526578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:16.528921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:16.529377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602159397639785:4783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:16.529397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602159397639785:4783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:16.529402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602159397639785:4783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:16.529414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:16.529263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:16.529278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:16.529291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:16.529386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:16.529431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602158615408656:10360]
2025-10-10T14:37:16.530092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:16.530425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:16.530490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:16.530890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:16.530956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.530963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.530964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.530966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.530967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.530968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.530969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.530971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.530972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.530973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.530974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.530976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.530977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.530984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.531000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.531004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.531009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.531014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.531018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.531022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.531027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.531031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.531037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.531041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.531045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.531050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.531059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.531068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.531077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.531084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.531089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.531096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.531101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.531108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.531113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.531118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.531123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.531129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.531136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.531142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.531147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.531153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.531158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.531163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.531168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.531174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.531180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.531186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.531191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.531197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.531202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.531214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.531266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:16.534281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:16.534827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:16.534833Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:16.534836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:16.534841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:16.534849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2288 [2:7559602158615408656:10360]
2025-10-10T14:37:16.534866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:16.534900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:16.534904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.534908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.534911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.534932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:16.534941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:16.534950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:16.535017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.535020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.535022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.535025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:16.535104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:16.535107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.535121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.535135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.535153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:16.535178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639871:4783], now have 1 active actors on pipe
2025-10-10T14:37:16.535182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639752:2438], now have 1 active actors on pipe
2025-10-10T14:37:16.535191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602158615408651:10360]
2025-10-10T14:37:16.535193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602158615408651:10360]
2025-10-10T14:37:16.535196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602158615408651:10360]
2025-10-10T14:37:16.535213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:16.535229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:16.535244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:16.535248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:16.535282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602158615408651:10360]
2025-10-10T14:37:16.535295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:16.535338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2288
2025-10-10T14:37:16.535374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2288
2025-10-10T14:37:16.535525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:16.535537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:16.535539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:16.535542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.535546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:16.535548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.535595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54b3acc0-800a588-ba72614a-30ec96b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:16.535610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.535615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.535618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:16.535630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.535643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:16.535660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.535944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.535952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.535969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.536086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2289 partition: 0 MaxSeqNo: 40 sessionId: src_id|54b3acc0-800a588-ba72614a-30ec96b2_0
2025-10-10T14:37:16.536587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2224002b-46a609b3-f54b6100-c2bf9729_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|54b3acc0-800a588-ba72614a-30ec96b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:16.539388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3acc0-800a588-ba72614a-30ec96b2_0] Write session: try to update token
2025-10-10T14:37:16.539409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3acc0-800a588-ba72614a-30ec96b2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:16.557796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:16.557822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:16.557825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:16.557827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:16.557838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602158615408651:10360]
2025-10-10T14:37:16.557842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602158615408651:10360]
2025-10-10T14:37:16.557847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602158615408651:10360]
2025-10-10T14:37:16.557901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:16.557909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.557912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:16.557915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:16.557922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:16.557927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:16.558061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:16.558883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId: src_id|54b3acc0-800a588-ba72614a-30ec96b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:16.561635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:16.606151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602159397639882:3836]
2025-10-10T14:37:16.606412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2288, pipe: [1:7559602159397639882:3836]
2025-10-10T14:37:16.677396Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:16.677808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.677835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.677886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639882:3836], now have 1 active actors on pipe
2025-10-10T14:37:16.678145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:16.678226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602159397639882:3836]
2025-10-10T14:37:16.678259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:16.678432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:16.678548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2289 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54b3acc0-800a588-ba72614a-30ec96b2_0
2025-10-10T14:37:16.678735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2289 sessionId: src_id|54b3acc0-800a588-ba72614a-30ec96b2_0 is DEAD
2025-10-10T14:37:16.679174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3acc0-800a588-ba72614a-30ec96b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:16.679190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3acc0-800a588-ba72614a-30ec96b2_0] Write session will restart in 0.007788s
2025-10-10T14:37:16.679218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3acc0-800a588-ba72614a-30ec96b2_0] Write session: Do CDS request
2025-10-10T14:37:16.679225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3acc0-800a588-ba72614a-30ec96b2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:16.688951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3acc0-800a588-ba72614a-30ec96b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.689064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:16.689103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2290
2025-10-10T14:37:16.689320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.689392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:16.689409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:16.689414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:16.690124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2290 sessionId:  describe result for acl check
2025-10-10T14:37:16.690186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:16.690189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:16.690191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:16.690198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602159397639938:4800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:16.690913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602159397639938:4800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:16.692917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:16.693479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602159397639938:4800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:16.695200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:16.695481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:16.695506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:16.695519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:16.695583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:16.695627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602158615408784:10362]
2025-10-10T14:37:16.696211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:16.696739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602159397639938:4800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:16.696755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602159397639938:4800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:16.696759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602159397639938:4800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:16.696814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:16.696609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:16.696669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:16.696929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:16.696970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.696970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.696971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.696972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.696973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.696973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.696974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.696975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.696976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.696976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.696977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.696977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.696978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.696982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.696995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.696999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.697003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.697007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.697010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.697014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.697019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.697023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.697027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.697031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.697035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.697039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.697048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.697057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.697064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.697067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.697070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.697073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.697076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.697079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.697082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.697085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.697088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.697090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.697093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.697096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.697099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.697103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.697105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.697108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.697111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.697114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.697117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.697121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.697124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.697127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.697132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.697135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.697158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:16.699522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:16.699929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:16.699941Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:16.699944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:16.699947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:16.699954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2289 [2:7559602158615408784:10362]
2025-10-10T14:37:16.699968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:16.699986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:16.699993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.699997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.700000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.700017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:16.700029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:16.700042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:16.700107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.700116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.700118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.700120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:16.700201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:16.700210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.700222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.700235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.700253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:16.700291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397639884:2438], now have 1 active actors on pipe
2025-10-10T14:37:16.700299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397640007:4800], now have 1 active actors on pipe
2025-10-10T14:37:16.700307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602158615408779:10362]
2025-10-10T14:37:16.700313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602158615408779:10362]
2025-10-10T14:37:16.700316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602158615408779:10362]
2025-10-10T14:37:16.700327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:16.700310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2289
2025-10-10T14:37:16.700324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2289
2025-10-10T14:37:16.700344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:16.700346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:16.700349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:16.700351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:16.700364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:16.700367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:16.700405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.700414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.700435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602158615408779:10362]
2025-10-10T14:37:16.700446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:16.700454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:16.700477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|165ccd67-12597d05-d85024bf-b738fa16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:16.700488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.700496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.700498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:16.700510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.700524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:16.700554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.700774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.700789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.700815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.700936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2290 partition: 0 MaxSeqNo: 40 sessionId: src_id|165ccd67-12597d05-d85024bf-b738fa16_0
2025-10-10T14:37:16.701372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3acc0-800a588-ba72614a-30ec96b2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|165ccd67-12597d05-d85024bf-b738fa16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:16.704202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165ccd67-12597d05-d85024bf-b738fa16_0] Write session: try to update token
2025-10-10T14:37:16.704224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165ccd67-12597d05-d85024bf-b738fa16_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:16.726189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId: src_id|165ccd67-12597d05-d85024bf-b738fa16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:16.729244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:16.729637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.729673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.729708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:16.729711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:16.729715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:16.729717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:16.729728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602158615408779:10362]
2025-10-10T14:37:16.729734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602158615408779:10362]
2025-10-10T14:37:16.729742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602158615408779:10362]
2025-10-10T14:37:16.729811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:16.729825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.729828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:16.730019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:16.730054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:16.730062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:16.730071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:16.778250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602159397640023:3836]
2025-10-10T14:37:16.778837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2289, pipe: [1:7559602159397640023:3836]
2025-10-10T14:37:16.847210Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:16.847853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:16.847935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397640023:3836], now have 1 active actors on pipe
2025-10-10T14:37:16.848062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:16.848204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:16.848288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602159397640023:3836]
2025-10-10T14:37:16.862452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:16.863470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:16.863506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:16.863541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2290 reason: error at write: Disconnected sessionId: src_id|165ccd67-12597d05-d85024bf-b738fa16_0
2025-10-10T14:37:16.863747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2290 sessionId: src_id|165ccd67-12597d05-d85024bf-b738fa16_0 is DEAD
2025-10-10T14:37:16.863910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165ccd67-12597d05-d85024bf-b738fa16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:16.863923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165ccd67-12597d05-d85024bf-b738fa16_0] Write session will restart in 0.008876s
2025-10-10T14:37:16.863954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165ccd67-12597d05-d85024bf-b738fa16_0] Write session: Do CDS request
2025-10-10T14:37:16.863963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165ccd67-12597d05-d85024bf-b738fa16_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:16.870220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:16.870541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:16.870556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:16.870570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:16.870640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:16.870691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602158615408913:10364]
2025-10-10T14:37:16.871547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:16.871935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:16.871990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:16.872392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:16.872475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.872482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.872484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.872485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.872487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.872488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.872490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.872491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.872493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.872494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.872496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.872497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.872499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.872505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.872520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.872524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.872528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.872533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.872538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.872543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.872547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.872551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.872556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.872561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.872565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.872569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.872579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.872588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:16.872595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.872602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:16.872607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.872613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:16.872619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.872625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:16.872630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.872636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:16.872641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.872647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:16.872658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.872664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:16.872673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.872679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:16.872690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.872696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:16.872706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.872712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:16.872725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.872737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.872743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.872749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.872754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.872759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.872803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:16.874003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|165ccd67-12597d05-d85024bf-b738fa16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.874127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:16.874148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2291
2025-10-10T14:37:16.874303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:16.874340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:16.874352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:16.874370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:16.874993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2291 sessionId:  describe result for acl check
2025-10-10T14:37:16.875042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:16.875044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:16.875048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:16.875057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602159397640125:4806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:16.875673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602159397640125:4806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:16.876260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:16.876829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:16.876843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:16.876846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:16.876850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:16.876857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2290 [2:7559602158615408913:10364]
2025-10-10T14:37:16.876885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:16.876905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:16.876909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.876913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.876916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.876946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:16.876954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:16.876963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:16.877142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.877155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.877157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.877160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:16.877237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:16.877246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.877258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:16.877269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:16.877286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:16.877318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397640028:2438], now have 1 active actors on pipe
2025-10-10T14:37:16.877345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602158615408908:10364]
2025-10-10T14:37:16.877353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602158615408908:10364]
2025-10-10T14:37:16.877357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602158615408908:10364]
2025-10-10T14:37:16.877376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:16.877398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:16.877390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2290
2025-10-10T14:37:16.877399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:16.877410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:16.877412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:16.877419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:16.877423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:16.877462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602158615408908:10364]
2025-10-10T14:37:16.877475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:16.877489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:16.879511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602159397640125:4806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:16.886164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602159397640125:4806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:16.886185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602159397640125:4806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:16.886189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602159397640125:4806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:16.886199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:16.886510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397640158:4806], now have 1 active actors on pipe
2025-10-10T14:37:16.886580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2290
2025-10-10T14:37:16.886642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.886665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.886706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:16.886738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:16.886749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:16.886752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:16.886767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:16.886793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:16.886821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.887061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.887075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.887092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:16.887233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2291 partition: 0 MaxSeqNo: 40 sessionId: src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0
2025-10-10T14:37:16.887692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|165ccd67-12597d05-d85024bf-b738fa16_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:16.890674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0] Write session: try to update token
2025-10-10T14:37:16.890696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:16.896985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:16.897010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:16.897023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602158615408908:10364]
2025-10-10T14:37:16.897078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:16.897080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:16.897244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:16.897450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:16.897607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:16.897756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:16.897960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:16.898001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:16.908863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId: src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:16.911985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:16.912498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:16.912521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:16.912558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:16.912659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:16.914357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:16.914382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:16.914385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:16.914387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:16.914402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602158615408908:10364]
2025-10-10T14:37:16.914405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602158615408908:10364]
2025-10-10T14:37:16.914409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602158615408908:10364]
2025-10-10T14:37:16.914457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:16.914464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:16.914470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:16.914471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:16.914473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:16.914475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:16.914622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:16.948716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602159397640161:3836]
2025-10-10T14:37:16.949065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2290, pipe: [1:7559602159397640161:3836]
2025-10-10T14:37:17.032371Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:17.041531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.041570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.041783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.041862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.041942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.042031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.042576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.042583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.042668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.042742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.042809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.042877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.042923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.042926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.042999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.043088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.043155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.043221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.043265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.043268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.043380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.043498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.043562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.043628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.043674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.043678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.043750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.043808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.043873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.043934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.044073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.044077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.044148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.044210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.044272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.044358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.044417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.044425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.044497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.044564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.044638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.044716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.044765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.044777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.044850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.044917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.044990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.045062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.045116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.045123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.045194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.045258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.045324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.045420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.045470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.045480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.045560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.045629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.045703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.045772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.045822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.045830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.045915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602159397640161:3836], now have 1 active actors on pipe
2025-10-10T14:37:17.046300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:17.046327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:17.046334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:17.046795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:17.046808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0] Write session will restart in 0.009771s
2025-10-10T14:37:17.046855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0] Write session: Do CDS request
2025-10-10T14:37:17.046862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:17.046381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2291 reason: error at write: Disconnected sessionId: src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0
2025-10-10T14:37:17.046409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602159397640161:3836]
2025-10-10T14:37:17.046629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2291 sessionId: src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0 is DEAD
2025-10-10T14:37:17.046740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:17.057929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.059706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:17.059730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2292
2025-10-10T14:37:17.059938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.060001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:17.060008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:17.060013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:17.060671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2292 sessionId:  describe result for acl check
2025-10-10T14:37:17.060719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:17.060727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:17.060729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:17.060737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602163692607526:4826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:17.061399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602163692607526:4826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:17.063675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:17.064505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602163692607526:4826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:17.066212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:17.066446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:17.066458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:17.066471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:17.066540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:17.066587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602162910376341:10366]
2025-10-10T14:37:17.067154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602163692607526:4826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:17.067171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602163692607526:4826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:17.067174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602163692607526:4826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:17.067183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:17.067203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:17.067611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:17.067673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:17.068078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:17.068167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.068176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.068177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.068179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.068180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.068181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.068183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.068184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.068185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.068187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.068188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.068189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.068191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.068197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.068211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.068216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.068220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.068224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.068228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.068232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.068237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.068241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.068246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.068249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.068254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.068258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.068266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.068275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.068282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.068288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.068292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.068298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.068303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.068309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.068314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.068320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.068324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.068329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.068334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.068340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.068344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.068350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.068355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.068360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.068365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.068370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.068378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.068389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.068395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.068401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.068406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.068411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.068455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:17.071171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:17.071880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:17.071893Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:17.071896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:17.071901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:17.071910Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2291 [2:7559602162910376341:10366]
2025-10-10T14:37:17.071925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:17.071943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:17.071947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.071952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.071954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.071974Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:17.071983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:17.071996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:17.072059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.072069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.072072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.072074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:17.072146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:17.072155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.072166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.072183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.072206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:17.072236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607581:4826], now have 1 active actors on pipe
2025-10-10T14:37:17.072245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607459:2438], now have 1 active actors on pipe
2025-10-10T14:37:17.072252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602162910376336:10366]
2025-10-10T14:37:17.072255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602162910376336:10366]
2025-10-10T14:37:17.072257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602162910376336:10366]
2025-10-10T14:37:17.072295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2291
2025-10-10T14:37:17.072302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2291
2025-10-10T14:37:17.072271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:17.072289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:17.072290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:17.072293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:17.072295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:17.072308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:17.072312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:17.072342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602162910376336:10366]
2025-10-10T14:37:17.072346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:17.072348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:17.072363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.072369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.072423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|faece847-7c8e4fea-85833fac-76616c27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:17.072449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.072458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.072462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:17.072475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.072490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:17.072515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.072702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.072712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.072728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.072816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2292 partition: 0 MaxSeqNo: 40 sessionId: src_id|faece847-7c8e4fea-85833fac-76616c27_0
2025-10-10T14:37:17.073233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdcb05a3-2bd5f5f0-cf4e7a0a-b996ec76_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|faece847-7c8e4fea-85833fac-76616c27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:17.076372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faece847-7c8e4fea-85833fac-76616c27_0] Write session: try to update token
2025-10-10T14:37:17.076396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faece847-7c8e4fea-85833fac-76616c27_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:17.093008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId: src_id|faece847-7c8e4fea-85833fac-76616c27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:17.096223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:17.097498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.097531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.097557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:17.097560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:17.097564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:17.097567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:17.097576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602162910376336:10366]
2025-10-10T14:37:17.097581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602162910376336:10366]
2025-10-10T14:37:17.097590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602162910376336:10366]
2025-10-10T14:37:17.097641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:17.097658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:17.097659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:17.097662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:17.097667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.097672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:17.097821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:17.145445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602163692607594:3836]
2025-10-10T14:37:17.145998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2291, pipe: [1:7559602163692607594:3836]
2025-10-10T14:37:17.223880Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:17.224214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:17.224285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607594:3836], now have 1 active actors on pipe
2025-10-10T14:37:17.224393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:17.225387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602163692607594:3836]
2025-10-10T14:37:17.225413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:17.237960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:17.237979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:17.238010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2292 reason: error at write: Disconnected sessionId: src_id|faece847-7c8e4fea-85833fac-76616c27_0
2025-10-10T14:37:17.238221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2292 sessionId: src_id|faece847-7c8e4fea-85833fac-76616c27_0 is DEAD
2025-10-10T14:37:17.238336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faece847-7c8e4fea-85833fac-76616c27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:17.238348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faece847-7c8e4fea-85833fac-76616c27_0] Write session will restart in 0.008826s
2025-10-10T14:37:17.238374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faece847-7c8e4fea-85833fac-76616c27_0] Write session: Do CDS request
2025-10-10T14:37:17.238381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faece847-7c8e4fea-85833fac-76616c27_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:17.249318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|faece847-7c8e4fea-85833fac-76616c27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.249417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:17.249440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2293
2025-10-10T14:37:17.249648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.249696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:17.249718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:17.249722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:17.250201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2293 sessionId:  describe result for acl check
2025-10-10T14:37:17.250245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:17.250254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:17.250256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:17.250264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602163692607643:4834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:17.250894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602163692607643:4834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:17.254759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602163692607643:4834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:17.257840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:17.264296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602163692607643:4834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:17.264320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602163692607643:4834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:17.264324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602163692607643:4834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:17.264335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:17.265018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:17.265527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:17.265546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:17.265564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:17.265916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:17.265982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602162910376487:10370]
2025-10-10T14:37:17.266630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:17.267024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:17.267088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:17.267496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:17.267558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.267560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.267562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.267564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.267565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.267567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.267568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.267570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.267571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.267573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.267575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.267576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.267578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.267585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.267603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.267607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.267613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.267617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.267621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.267626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.267630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.267634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.267641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.267645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.267649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.267653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.267661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.267671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.267677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.267683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.267688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.267694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.267699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.267704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.267709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.267716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.267723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.267728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.267733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.267738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.267742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.267748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.267752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.267758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.267762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.267770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.267774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.267780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.267785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.267790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.267797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.267803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.267848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:17.270904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:17.271342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:17.271356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:17.271359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:17.271363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:17.271370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2292 [2:7559602162910376487:10370]
2025-10-10T14:37:17.271385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:17.271404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:17.271414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.271418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.271421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.271442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:17.271451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:17.271460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:17.271539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.271550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.271552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.271554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:17.271628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:17.271647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.271659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.271671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.271687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:17.271719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607607:2438], now have 1 active actors on pipe
2025-10-10T14:37:17.271727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607731:4834], now have 1 active actors on pipe
2025-10-10T14:37:17.271736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602162910376480:10370]
2025-10-10T14:37:17.271743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602162910376480:10370]
2025-10-10T14:37:17.271747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602162910376480:10370]
2025-10-10T14:37:17.271761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:17.271779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:17.271800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:17.271808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:17.271845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602162910376480:10370]
2025-10-10T14:37:17.271852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:17.271930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:17.271944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:17.271947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:17.271955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:17.272031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2292
2025-10-10T14:37:17.272076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2292
2025-10-10T14:37:17.272541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.272555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.272601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:17.272615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.272620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.272628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:17.272640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.272654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:17.272684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.273055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.273067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.273084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.273199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2293 partition: 0 MaxSeqNo: 40 sessionId: src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0
2025-10-10T14:37:17.273642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|faece847-7c8e4fea-85833fac-76616c27_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:17.276523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0] Write session: try to update token
2025-10-10T14:37:17.276542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:17.299199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId: src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:17.302090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:17.303853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.303882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.305800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:17.305836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:17.305840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:17.305844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:17.305846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:17.305856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602162910376480:10370]
2025-10-10T14:37:17.305861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602162910376480:10370]
2025-10-10T14:37:17.305866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602162910376480:10370]
2025-10-10T14:37:17.305919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:17.305928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.305930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:17.305945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:17.305952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:17.305957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:17.306085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:17.309392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:17.325546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602163692607743:3836]
2025-10-10T14:37:17.325958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2292, pipe: [1:7559602163692607743:3836]
2025-10-10T14:37:17.446223Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:17.446636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607743:3836], now have 1 active actors on pipe
2025-10-10T14:37:17.455106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.455136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.455316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.455386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.455460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.455535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.456024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.456029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.456095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.456149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.456201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.456261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.456455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.456459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.456526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.456581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.456644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.456709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.456747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.456751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.456819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.456879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.456984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.457046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.457086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.457089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.457164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.457226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.457286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.457585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.457641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.457649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.457718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.457781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.457849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.457915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.457966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.457976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.458046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.458113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.458185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.458255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.458303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.458311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.458380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.458440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.458505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.458566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.458631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.458640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.458710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.458773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.458839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.458906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.458952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.458959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.459068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.459134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.459202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.459267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.459328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.459335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.459512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:17.459566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602163692607743:3836]
2025-10-10T14:37:17.459605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:17.459613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:17.459637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2293 reason: error at write: Disconnected sessionId: src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0
2025-10-10T14:37:17.459730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:17.459856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2293 sessionId: src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0 is DEAD
2025-10-10T14:37:17.460018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:17.460030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0] Write session will restart in 0.006910s
2025-10-10T14:37:17.460061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0] Write session: Do CDS request
2025-10-10T14:37:17.460067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:17.467898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.467949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:17.467968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2294
2025-10-10T14:37:17.468150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.468187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:17.468198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:17.468202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:17.468656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2294 sessionId:  describe result for acl check
2025-10-10T14:37:17.468690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:17.468694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:17.468696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:17.468702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602163692607814:4853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:17.469277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602163692607814:4853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:17.471480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602163692607814:4853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:17.472253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:17.474389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:17.474644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:17.474655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:17.474670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:17.474739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:17.474747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602163692607814:4853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:17.474768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602163692607814:4853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:17.474772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602163692607814:4853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:17.474784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:17.474787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602162910376656:10385]
2025-10-10T14:37:17.475430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:17.475762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:17.475814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:17.476168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:17.476225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.476231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.476232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.476233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.476235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.476236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.476237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.476239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.476240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.476241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.476242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.476244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.476245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.476251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.476265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.476269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.476274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.476278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.476282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.476286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.476290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.476294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.476299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.476303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.476307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.476311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.476319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.476327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.476334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.476341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.476346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.476353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.476357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.476368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.476372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.476379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.476388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.476392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.476397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.476407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.476412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.476417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.476427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.476432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.476442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.476447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.476451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.476456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.476461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.476466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.476471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.476481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.476522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:17.479208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:17.479704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:17.479717Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:17.479719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:17.479723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:17.479729Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2293 [2:7559602162910376656:10385]
2025-10-10T14:37:17.479739Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:17.479753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:17.479755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.479758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.479759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.479772Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:17.479781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:17.479789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:17.479838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.479846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.479848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.479851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:17.479919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:17.479928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.479935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.479942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.479952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:17.479971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607771:2438], now have 1 active actors on pipe
2025-10-10T14:37:17.479983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602162910376651:10385]
2025-10-10T14:37:17.479985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602162910376651:10385]
2025-10-10T14:37:17.479986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602162910376651:10385]
2025-10-10T14:37:17.479996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:17.480004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607894:4853], now have 1 active actors on pipe
2025-10-10T14:37:17.480011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:17.480012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:17.480022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:17.480024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:17.480030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:17.480033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:17.480048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602162910376651:10385]
2025-10-10T14:37:17.480050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:17.480052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:17.480078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2293
2025-10-10T14:37:17.480093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2293
2025-10-10T14:37:17.480192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.480211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.480248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50b75fa-4b17af90-3a759771-9005f6fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:17.480265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.480274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.480278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:17.480295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.480316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:17.480336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.480519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.480529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.480544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.480659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2294 partition: 0 MaxSeqNo: 40 sessionId: src_id|50b75fa-4b17af90-3a759771-9005f6fb_0
2025-10-10T14:37:17.481099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e162d6e-68c12a5e-5d683082-2ff72542_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|50b75fa-4b17af90-3a759771-9005f6fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:17.484074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b75fa-4b17af90-3a759771-9005f6fb_0] Write session: try to update token
2025-10-10T14:37:17.484097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b75fa-4b17af90-3a759771-9005f6fb_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:17.501606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId: src_id|50b75fa-4b17af90-3a759771-9005f6fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:17.504444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:17.504712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.504741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.504784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:17.504871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:17.506683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:17.506704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:17.506707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:17.506709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:17.506720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602162910376651:10385]
2025-10-10T14:37:17.506724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602162910376651:10385]
2025-10-10T14:37:17.506728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602162910376651:10385]
2025-10-10T14:37:17.506775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:17.506778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:17.506786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.506789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:17.506790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:17.506806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:17.506933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:17.560302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602163692607905:3836]
2025-10-10T14:37:17.560667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2293, pipe: [1:7559602163692607905:3836]
2025-10-10T14:37:17.622240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:17.631316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.631352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.631572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.631635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.631700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.631764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.631809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.631815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.631888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.631955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.632063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.632132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.632172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.632175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.632244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.632305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.632364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.632425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.632467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.632469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.632538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.632939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.633006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.633068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.633112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.633115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.633188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.633252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.633319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.633413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.633461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.633464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.633540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.633602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.635994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b75fa-4b17af90-3a759771-9005f6fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:17.636008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b75fa-4b17af90-3a759771-9005f6fb_0] Write session will restart in 0.007179s
2025-10-10T14:37:17.636034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b75fa-4b17af90-3a759771-9005f6fb_0] Write session: Do CDS request
2025-10-10T14:37:17.635572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:17.635625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:17.635627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:17.636043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b75fa-4b17af90-3a759771-9005f6fb_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:17.635655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2294 reason: error at write: Disconnected sessionId: src_id|50b75fa-4b17af90-3a759771-9005f6fb_0
2025-10-10T14:37:17.635840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2294 sessionId: src_id|50b75fa-4b17af90-3a759771-9005f6fb_0 is DEAD
2025-10-10T14:37:17.635985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602163692607905:3836]
2025-10-10T14:37:17.633683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.633794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.633836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.633840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.633945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.634006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.634073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.634143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.634186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.634189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.634261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.634325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.634391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.634457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.634500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.634503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.634573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.634632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.634696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.634760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.634804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.634807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.634881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.634945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.635007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.635071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.635119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.635122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.635200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607905:3836], now have 1 active actors on pipe
2025-10-10T14:37:17.636105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:17.644944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b75fa-4b17af90-3a759771-9005f6fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.645042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:17.645059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2295
2025-10-10T14:37:17.645192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.645240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:17.645251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:17.645256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:17.645719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2295 sessionId:  describe result for acl check
2025-10-10T14:37:17.645753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:17.645755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:17.645757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:17.645763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602163692607923:4871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:17.646457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602163692607923:4871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:17.652268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602163692607923:4871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:17.659879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:17.663082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602163692607923:4871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:17.663102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602163692607923:4871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:17.663107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602163692607923:4871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:17.663117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:17.662895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:17.663124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:17.663131Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:17.663144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:17.663209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:17.663246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602162910376789:10387]
2025-10-10T14:37:17.663899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:17.677648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:17.677793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:17.678225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:17.678335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.678344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.678346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.678348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.678349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.678351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.678352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.678354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.678355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.678357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.678359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.678360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.678362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.678371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.678387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.678392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.678397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.678402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.678407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.678412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.678416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.678420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.678425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.678429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.678434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.678439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.678451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.678462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.678470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.678477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.678483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.678488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.678493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.678498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.678504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.678510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.678523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.678528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.678533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.678544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.678550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.678557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.678563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.678569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.678580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.678587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.678597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.678603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.678608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.678619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.678624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.678630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.678674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:17.681868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:17.682209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:17.682229Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:17.682232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:17.682238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:17.682249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2294 [2:7559602162910376789:10387]
2025-10-10T14:37:17.682266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:17.682290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:17.682298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.682302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.682305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.682327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:17.682360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:17.682369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:17.682440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.682448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.682451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.682453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:17.682533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:17.682542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.682555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.682573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.682595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:17.682618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602162910376784:10387]
2025-10-10T14:37:17.682626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602162910376784:10387]
2025-10-10T14:37:17.682629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602162910376784:10387]
2025-10-10T14:37:17.682639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:17.682661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:17.682685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:17.682689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:17.682723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602162910376784:10387]
2025-10-10T14:37:17.682726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:17.682748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:17.682770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:17.682774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:17.682791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:17.682859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692607907:2438], now have 1 active actors on pipe
2025-10-10T14:37:17.682876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692608033:4871], now have 1 active actors on pipe
2025-10-10T14:37:17.684424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.684444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.684480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:17.684492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.684509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.684513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:17.684528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.684546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:17.684564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.684804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.684815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.684833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.683203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2294
2025-10-10T14:37:17.683240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2294
2025-10-10T14:37:17.684954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2295 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0
2025-10-10T14:37:17.685440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b75fa-4b17af90-3a759771-9005f6fb_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:17.688515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0] Write session: try to update token
2025-10-10T14:37:17.688536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:17.706648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId: src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:17.709604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:17.710881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.710909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.712911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:17.712959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:17.712963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:17.712967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:17.712969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:17.712979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602162910376784:10387]
2025-10-10T14:37:17.712984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602162910376784:10387]
2025-10-10T14:37:17.712989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602162910376784:10387]
2025-10-10T14:37:17.713039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:17.713054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.713057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:17.713226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:17.714479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:17.714497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:17.714505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:17.713100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:17.736249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602163692608047:3836]
2025-10-10T14:37:17.736653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2294, pipe: [1:7559602163692608047:3836]
2025-10-10T14:37:17.833975Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:17.834550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692608047:3836], now have 1 active actors on pipe
2025-10-10T14:37:17.842960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.842993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.843162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.843221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.843280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.843339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.843742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.843754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.843819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.843876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.843936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.844000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.844042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.844051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.844117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.844182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.844260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.844335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.844383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.844390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.844459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.844532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.844601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.844673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.844722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.844727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.844789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.844844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.844906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.844962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.845002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.845008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.845072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.845142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.845209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.845272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.845320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.845347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.845422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.845481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.845543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.845601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.845652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.845660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.845720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.845773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.845831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.845890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.845938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.845947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.846019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.846084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.846149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.846215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.846262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.846274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.846339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:17.846393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:17.846452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:17.846511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:17.846578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:17.846585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:17.846897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602163692608047:3836]
2025-10-10T14:37:17.846906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:17.846911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:17.846944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:17.846955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2295 reason: error at write: Disconnected sessionId: src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0
2025-10-10T14:37:17.847166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2295 sessionId: src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0 is DEAD
2025-10-10T14:37:17.847282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:17.847300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0] Write session will restart in 0.009721s
2025-10-10T14:37:17.847281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:17.847326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0] Write session: Do CDS request
2025-10-10T14:37:17.847333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:17.857924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.858386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:17.858406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2296
2025-10-10T14:37:17.858567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:17.858617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:17.858629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:17.858634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:17.859156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2296 sessionId:  describe result for acl check
2025-10-10T14:37:17.859195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:17.859205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:17.859208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:17.859214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602163692608140:4855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:17.859850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602163692608140:4855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:17.861217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:17.863949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:17.864256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:17.864274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:17.864287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:17.864352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:17.864401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602162910376923:10389]
2025-10-10T14:37:17.864810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602163692608140:4855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:17.865103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:17.866709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:17.866794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:17.867192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:17.867258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.867265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.867266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.867268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.867269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.867271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.867272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.867274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.867276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.867277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.867279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.867280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.867282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.867290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.867304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.867309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.867314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.867318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.867322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.867327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.867331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.867336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.867341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.867346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.867350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.867355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.867364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.867374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:17.867381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.867387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:17.867392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.867398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:17.867403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.867409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:17.867414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.867420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:17.867425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.867431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:17.867436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.867442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:17.867447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.867453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:17.867478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.867485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:17.867491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.867497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:17.867508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.867514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.867519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.867523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.867531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.867541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.867585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:17.870511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602163692608140:4855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:17.870532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602163692608140:4855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:17.870536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602163692608140:4855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:17.870554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:17.874403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:17.874884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:17.874900Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:17.874904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:17.874908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:17.874916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2295 [2:7559602162910376923:10389]
2025-10-10T14:37:17.874934Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:17.874956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:17.874967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.874971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.874974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.874995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:17.875003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:17.875015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:17.875101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.875108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.875110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.875113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:17.875195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:17.875205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.875218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:17.875232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:17.875251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:17.875283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692608187:4855], now have 1 active actors on pipe
2025-10-10T14:37:17.875292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692608057:2438], now have 1 active actors on pipe
2025-10-10T14:37:17.875301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602162910376918:10389]
2025-10-10T14:37:17.875304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602162910376918:10389]
2025-10-10T14:37:17.875306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602162910376918:10389]
2025-10-10T14:37:17.875320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:17.875337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:17.875337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:17.875341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:17.875344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:17.875360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:17.875365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:17.875391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2295
2025-10-10T14:37:17.875448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2295
2025-10-10T14:37:17.875407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602162910376918:10389]
2025-10-10T14:37:17.875416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:17.875419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:17.875445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.875451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.875506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3138d631-d075425d-26c20f3c-524baea8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:17.875514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:17.875519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:17.875522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:17.875534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:17.875546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:17.875570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.875790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:17.875798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:17.875814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:17.875935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2296 partition: 0 MaxSeqNo: 40 sessionId: src_id|3138d631-d075425d-26c20f3c-524baea8_0
2025-10-10T14:37:17.876432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a667f-61bf8aa5-54fa8e41-5539e9d0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3138d631-d075425d-26c20f3c-524baea8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:17.879216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3138d631-d075425d-26c20f3c-524baea8_0] Write session: try to update token
2025-10-10T14:37:17.879235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3138d631-d075425d-26c20f3c-524baea8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:17.903071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:17.903098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:17.903102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:17.903104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:17.903115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602162910376918:10389]
2025-10-10T14:37:17.903120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602162910376918:10389]
2025-10-10T14:37:17.903124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602162910376918:10389]
2025-10-10T14:37:17.903178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:17.903186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:17.903189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:17.903330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:17.905565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:17.905588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:17.905594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:17.906834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId: src_id|3138d631-d075425d-26c20f3c-524baea8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:17.910230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:17.947119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602163692608194:3836]
2025-10-10T14:37:17.947646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2295, pipe: [1:7559602163692608194:3836]
2025-10-10T14:37:18.026508Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:18.026936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.026952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.027000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602163692608194:3836], now have 1 active actors on pipe
2025-10-10T14:37:18.027430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:18.027669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602163692608194:3836]
2025-10-10T14:37:18.027721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:18.027725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:18.027816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2296 reason: error at write: Disconnected sessionId: src_id|3138d631-d075425d-26c20f3c-524baea8_0
2025-10-10T14:37:18.028016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2296 sessionId: src_id|3138d631-d075425d-26c20f3c-524baea8_0 is DEAD
2025-10-10T14:37:18.028438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:18.029620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3138d631-d075425d-26c20f3c-524baea8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:18.029631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3138d631-d075425d-26c20f3c-524baea8_0] Write session will restart in 0.007771s
2025-10-10T14:37:18.029661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3138d631-d075425d-26c20f3c-524baea8_0] Write session: Do CDS request
2025-10-10T14:37:18.029670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3138d631-d075425d-26c20f3c-524baea8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:18.042027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3138d631-d075425d-26c20f3c-524baea8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.042405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:18.042433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2297
2025-10-10T14:37:18.042611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.042651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:18.042657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:18.042663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:18.043231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2297 sessionId:  describe result for acl check
2025-10-10T14:37:18.043284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:18.043292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:18.043295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:18.043301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602167987575508:4883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:18.043987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602167987575508:4883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:18.047504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602167987575508:4883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:18.059176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602167987575508:4883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:18.059200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602167987575508:4883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:18.059205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602167987575508:4883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:18.059217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:18.059853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:18.068051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:18.068329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:18.068346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:18.068359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:18.068438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:18.068499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602167205344357:10391]
2025-10-10T14:37:18.069275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:18.069729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:18.069790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:18.070181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:18.070257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.070265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.070284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.070286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.070288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.070291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.070293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.070294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.070296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.070298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.070300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.070301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.070303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.070309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.070322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.070326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.070331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.070336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.070341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.070345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.070350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.070354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.070360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.070364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.070368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.070372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.070381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.070390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.070405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.070412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.070418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.070424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.070429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.070436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.070443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.070457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.070463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.070469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.070476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.070482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.070494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.070501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.070506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.070513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.070519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.070525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.070533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.070539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.070544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.070558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.070563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.070569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.070616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:18.075955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:18.076400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:18.076430Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:18.076435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:18.076439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:18.076447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2296 [2:7559602167205344357:10391]
2025-10-10T14:37:18.076466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:18.076486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:18.076490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.076494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.076497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.076514Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:18.076522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:18.076530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:18.076605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.076618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.076621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.076624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:18.076705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:18.076715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.076727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.076737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.076753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:18.076772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602167205344351:10391]
2025-10-10T14:37:18.076782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602167205344351:10391]
2025-10-10T14:37:18.076785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602167205344351:10391]
2025-10-10T14:37:18.076798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:18.076813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:18.076829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:18.076840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:18.076873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602167205344351:10391]
2025-10-10T14:37:18.076882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:18.080276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2296
2025-10-10T14:37:18.080337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2296
2025-10-10T14:37:18.079421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:18.079438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:18.079438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575493:2438], now have 1 active actors on pipe
2025-10-10T14:37:18.079441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:18.079449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:18.079682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575617:4883], now have 1 active actors on pipe
2025-10-10T14:37:18.081253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.081269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.081302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:18.081317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.081323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.081326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:18.081356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.081375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:18.081403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.084062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.084081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.084111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.084277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2297 partition: 0 MaxSeqNo: 40 sessionId: src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0
2025-10-10T14:37:18.084711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3138d631-d075425d-26c20f3c-524baea8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:18.087498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0] Write session: try to update token
2025-10-10T14:37:18.087524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:18.103967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId: src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:18.106989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:18.107312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.107350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.107393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:18.107650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:18.119933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:18.119963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:18.119967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:18.119970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:18.119980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602167205344351:10391]
2025-10-10T14:37:18.119992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602167205344351:10391]
2025-10-10T14:37:18.119996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602167205344351:10391]
2025-10-10T14:37:18.120050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:18.120057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.120060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:18.120261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:18.121479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:18.121488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:18.121493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:18.129411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602167987575630:3836]
2025-10-10T14:37:18.132620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2296, pipe: [1:7559602167987575630:3836]
2025-10-10T14:37:18.247745Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:18.248137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575630:3836], now have 1 active actors on pipe
2025-10-10T14:37:18.257549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.257579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.257777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.257839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.257904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.257973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.258021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.258027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.258107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.258180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.258297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.258370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.258415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.258418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.258493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.258557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.258623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.258697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.258743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.258745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.258816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.258883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.258947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.259015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.259059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.259061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.259139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.259207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.259277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.259345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.259391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.259394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.259487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.259554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.259629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.259700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.259746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.259748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.259823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.259885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.259952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.260019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.260064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.260067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.260143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.260205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.260273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.260342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.260396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.260406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.260484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.260546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.260611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.260677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.260720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.260723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.260794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.260853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.260915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.260977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.261042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.261044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.263078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:18.270088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:18.270112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0] Write session will restart in 0.005528s
2025-10-10T14:37:18.270140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0] Write session: Do CDS request
2025-10-10T14:37:18.270146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:18.269465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602167987575630:3836]
2025-10-10T14:37:18.269526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:18.269582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2297 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0
2025-10-10T14:37:18.269826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:18.269865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2297 sessionId: src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0 is DEAD
2025-10-10T14:37:18.277066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.277064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:18.277096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2298
2025-10-10T14:37:18.281488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.281562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:18.281569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:18.281575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:18.282146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2298 sessionId:  describe result for acl check
2025-10-10T14:37:18.282183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:18.282186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:18.282188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:18.282194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602167987575652:4884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:18.282808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602167987575652:4884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:18.289148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602167987575652:4884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:18.293356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602167987575652:4884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:18.293378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602167987575652:4884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:18.293382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602167987575652:4884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:18.293392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:18.302463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:18.304356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:18.304558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:18.304569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:18.304578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:18.304619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:18.304654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602167205344507:10395]
2025-10-10T14:37:18.305084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:18.305426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:18.305485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:18.305838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:18.305910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.305911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.305912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.305913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.305914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.305916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.305917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.305918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.305919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.305920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.305922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.305923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.305924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.305929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.305942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.305946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.305950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.305953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.305957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.305960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.305963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.305967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.305971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.305974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.305977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.305980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.305988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.305996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.306003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.306008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.306012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.306016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.306020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.306024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.306028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.306033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.306037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.306042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.306046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.306051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.306056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.306061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.306065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.306070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.306076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.306080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.306084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.306089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.306092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.306097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.306101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.306106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.306145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:18.309228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:18.309705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:18.309718Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:18.309720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:18.309723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:18.309728Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2297 [2:7559602167205344507:10395]
2025-10-10T14:37:18.309737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:18.309752Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:18.309754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.309756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.309758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.309771Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:18.309781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:18.309790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:18.309847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.309854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.309856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.309859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:18.309926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:18.309929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.309939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.309950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.309965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:18.309988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602167205344502:10395]
2025-10-10T14:37:18.309990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602167205344502:10395]
2025-10-10T14:37:18.309992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602167205344502:10395]
2025-10-10T14:37:18.310006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:18.310022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:18.310038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:18.310041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:18.310070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602167205344502:10395]
2025-10-10T14:37:18.310081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:18.310089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:18.310092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:18.310094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:18.310102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:18.310217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575690:4884], now have 1 active actors on pipe
2025-10-10T14:37:18.310228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575647:2438], now have 1 active actors on pipe
2025-10-10T14:37:18.310437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2297
2025-10-10T14:37:18.310484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2297
2025-10-10T14:37:18.310918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.310931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.310963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:18.310977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.310981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.310988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:18.311001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.311023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:18.311044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.311501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.311510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.311526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.311630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2298 partition: 0 MaxSeqNo: 40 sessionId: src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0
2025-10-10T14:37:18.314768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e89b3d-2d4d4d85-6abe01e9-cb7a7bf0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:18.317596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0] Write session: try to update token
2025-10-10T14:37:18.317616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:18.338462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:18.338491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:18.338495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:18.338497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:18.338507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602167205344502:10395]
2025-10-10T14:37:18.338513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602167205344502:10395]
2025-10-10T14:37:18.338518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602167205344502:10395]
2025-10-10T14:37:18.338573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:18.338581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.338584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:18.338732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:18.340749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId: src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:18.343187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:18.343214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:18.343219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:18.343625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:18.363892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602167987575785:3836]
2025-10-10T14:37:18.364335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2297, pipe: [1:7559602167987575785:3836]
2025-10-10T14:37:18.468298Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:18.468571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.468588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.468635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575785:3836], now have 1 active actors on pipe
2025-10-10T14:37:18.469054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:18.469854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:18.469867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0] Write session will restart in 0.006019s
2025-10-10T14:37:18.469893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0] Write session: Do CDS request
2025-10-10T14:37:18.469900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:18.469395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:18.469494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2298 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0
2025-10-10T14:37:18.469687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2298 sessionId: src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0 is DEAD
2025-10-10T14:37:18.469898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:18.469941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602167987575785:3836]
2025-10-10T14:37:18.476960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.477074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:18.477096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2299
2025-10-10T14:37:18.477235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.477270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:18.477282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:18.477286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:18.477704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2299 sessionId:  describe result for acl check
2025-10-10T14:37:18.477743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:18.477745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:18.477747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:18.477752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602167987575816:4896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:18.478331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602167987575816:4896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:18.481080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602167987575816:4896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:18.485542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602167987575816:4896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:18.485567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602167987575816:4896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:18.485570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602167987575816:4896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:18.485581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:18.486764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:18.488806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:18.489031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:18.489047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:18.489061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:18.489125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:18.489173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602167205344675:10408]
2025-10-10T14:37:18.489842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:18.490184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:18.490233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:18.490592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:18.490648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.490649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.490650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.490651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.490652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.490653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.490655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.490656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.490657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.490659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.490660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.490662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.490663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.490670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.490684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.490688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.490692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.490696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.490700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.490704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.490708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.490713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.490717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.490721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.490725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.490729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.490737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.490746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.490752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.490757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.490762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.490768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.490771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.490777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.490782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.490787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.490792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.490798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.490802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.490807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.490812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.490817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.490823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.490829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.490834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.490840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.490844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.490850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.490854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.490859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.490864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.490869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.490908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:18.495528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:18.495896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:18.495912Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:18.495915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:18.495920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:18.495927Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2298 [2:7559602167205344675:10408]
2025-10-10T14:37:18.495941Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:18.495968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:18.495971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.495975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.495978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.495995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:18.496003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:18.496018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:18.496082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.496091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.496093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.496097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:18.496170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:18.496179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.496193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.496211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.496234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:18.496257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575802:2438], now have 1 active actors on pipe
2025-10-10T14:37:18.496266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575925:4896], now have 1 active actors on pipe
2025-10-10T14:37:18.496275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602167205344670:10408]
2025-10-10T14:37:18.496281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602167205344670:10408]
2025-10-10T14:37:18.496284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602167205344670:10408]
2025-10-10T14:37:18.496299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:18.496322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:18.496333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:18.496336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:18.496338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:18.496350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:18.496353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:18.496388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602167205344670:10408]
2025-10-10T14:37:18.496401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:18.496408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:18.496479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2298
2025-10-10T14:37:18.496560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2298
2025-10-10T14:37:18.496604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.496625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.496659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:18.496674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.496679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.496682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:18.496697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.496711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:18.496733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.496923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.496937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.496972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.497098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2299 partition: 0 MaxSeqNo: 40 sessionId: src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0
2025-10-10T14:37:18.497544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88d20af-5d71ef09-aa040ee6-c030e710_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:18.500388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0] Write session: try to update token
2025-10-10T14:37:18.500410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:18.508660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:18.508682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:18.508694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602167205344670:10408]
2025-10-10T14:37:18.508742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:18.508751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:18.508968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:18.509114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:18.509289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:18.509523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:18.509833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:18.509909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:18.515680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId: src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:18.518380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:18.518591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.518616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.518658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:18.518738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:18.527492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:18.527518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:18.527523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:18.527525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:18.527537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602167205344670:10408]
2025-10-10T14:37:18.527541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602167205344670:10408]
2025-10-10T14:37:18.527546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602167205344670:10408]
2025-10-10T14:37:18.527599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:18.527613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.527616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:18.527674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:18.527697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:18.527702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:18.527765Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:18.573465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602167987575951:3836]
2025-10-10T14:37:18.573945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2298, pipe: [1:7559602167987575951:3836]
2025-10-10T14:37:18.648543Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:18.658215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.658252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.658450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.658516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.658587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.658672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.658720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.658726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.658804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.658870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.658939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.659014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.659064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.659070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.659153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.659229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.659301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.659375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.659422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.659425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.659524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.659593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.659657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.659727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.659772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.659775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.659855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.659927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.660001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.660067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.660114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.660117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.660199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.660269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.660337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.660413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.660461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.660471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.660553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.660621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.660692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.660768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.660832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.660835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.660917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.660991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.661058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.661131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.661178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.661181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.661264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.661686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.661767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.661839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.661891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.661894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.661965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:18.662021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:18.662083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:18.662149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:18.662198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:18.662201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:18.662267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575951:3836], now have 1 active actors on pipe
2025-10-10T14:37:18.662701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:18.662721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:18.662765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2299 reason: error at write: Disconnected sessionId: src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0
2025-10-10T14:37:18.662976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2299 sessionId: src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0 is DEAD
2025-10-10T14:37:18.663201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:18.663249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602167987575951:3836]
2025-10-10T14:37:18.663549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:18.665600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:18.665612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0] Write session will restart in 0.007998s
2025-10-10T14:37:18.665650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0] Write session: Do CDS request
2025-10-10T14:37:18.665657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:18.674930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.675030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:18.675065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2300
2025-10-10T14:37:18.675310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.675372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:18.675382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:18.675386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:18.676005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2300 sessionId:  describe result for acl check
2025-10-10T14:37:18.676049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:18.676055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:18.676058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:18.676065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602167987576051:4906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:18.676559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602167987576051:4906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:18.677681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:18.680335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:18.680596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:18.680603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:18.680618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:18.680692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:18.680730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602167205344819:10412]
2025-10-10T14:37:18.681364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:18.681742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:18.681794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:18.682138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:18.682201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.682208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.682209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.682210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.682212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.682213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.682214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.682216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.682218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.682219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.682220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.682222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.682223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.682230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.682244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.682249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.682254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.682258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.682262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.682271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.682276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.682280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.682285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.682293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.682297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.682301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.682312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.682326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.682333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.682339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.682349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.682355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.682360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.682366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.682371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.682376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.682381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.682387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.682392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.682402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.682407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.682413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.682418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.682428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.682433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.682442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.682448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.682453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.682457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.682463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.682467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.682477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.682519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:18.682564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602167987576051:4906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:18.685115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:18.685478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:18.685492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:18.685495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:18.685499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:18.685505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2299 [2:7559602167205344819:10412]
2025-10-10T14:37:18.685519Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:18.685540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:18.685543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.685547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.685550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.685568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:18.685578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:18.685586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:18.685653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.685655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.685656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.685659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:18.685738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:18.685741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.685752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.685763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.685780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:18.685804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987575954:2438], now have 1 active actors on pipe
2025-10-10T14:37:18.685813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602167205344813:10412]
2025-10-10T14:37:18.685816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602167205344813:10412]
2025-10-10T14:37:18.685818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602167205344813:10412]
2025-10-10T14:37:18.685833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:18.685847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:18.685847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:18.685850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:18.685853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:18.685863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:18.685866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:18.685891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602167205344813:10412]
2025-10-10T14:37:18.685900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:18.685963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:18.685902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602167987576051:4906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:18.685922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602167987576051:4906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:18.685926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602167987576051:4906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:18.685936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:18.686099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2299
2025-10-10T14:37:18.686734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987576087:4906], now have 1 active actors on pipe
2025-10-10T14:37:18.686800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2299
2025-10-10T14:37:18.686863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.686873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.686904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:18.686914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.686918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.686920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:18.686933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.686947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:18.686962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.688194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.688208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.688232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.688390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2300 partition: 0 MaxSeqNo: 40 sessionId: src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0
2025-10-10T14:37:18.688781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41cf22d-2b247fff-b3651a46-db0cbbda_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:18.691798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0] Write session: try to update token
2025-10-10T14:37:18.691824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:18.707218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:18.707247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:18.707251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:18.707253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:18.707265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602167205344813:10412]
2025-10-10T14:37:18.707270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602167205344813:10412]
2025-10-10T14:37:18.707275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602167205344813:10412]
2025-10-10T14:37:18.707329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:18.707338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.707338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:18.707340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:18.707346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:18.707351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:18.707506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:18.713278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId: src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:18.716099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:18.762755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602167987576100:3836]
2025-10-10T14:37:18.763256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2299, pipe: [1:7559602167987576100:3836]
2025-10-10T14:37:18.832196Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:18.832827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.832847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.832900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987576100:3836], now have 1 active actors on pipe
2025-10-10T14:37:18.833145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:18.833219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602167987576100:3836]
2025-10-10T14:37:18.833219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:18.833224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:18.833259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:18.833297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2300 reason: error at write: Disconnected sessionId: src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0
2025-10-10T14:37:18.833528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2300 sessionId: src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0 is DEAD
2025-10-10T14:37:18.833704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:18.833716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0] Write session will restart in 0.007715s
2025-10-10T14:37:18.833745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0] Write session: Do CDS request
2025-10-10T14:37:18.833754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:18.842969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.843078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:18.843100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2301
2025-10-10T14:37:18.843232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:18.843277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:18.843289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:18.843294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:18.843787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2301 sessionId:  describe result for acl check
2025-10-10T14:37:18.843831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:18.843833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:18.843834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:18.843843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602167987576149:4930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:18.844412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602167987576149:4930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:18.846898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602167987576149:4930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:18.846973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:18.848848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:18.849069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:18.849083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:18.849097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:18.849153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:18.849155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602167987576149:4930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:18.849173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602167987576149:4930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:18.849176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602167987576149:4930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:18.849186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:18.849198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602167205344958:10414]
2025-10-10T14:37:18.849824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:18.850105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:18.850149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:18.850477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:18.850552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.850558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.850559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.850560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.850562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.850563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.850564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.850565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.850567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.850568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.850569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.850571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.850572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.850578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.850593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.850598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.850602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.850607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.850610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.850614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.850619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.850622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.850628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.850632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.850637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.850641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.850649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.850661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:18.850672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.850681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:18.850687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.850697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:18.850701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.850711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:18.850716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.850725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:18.850729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.850736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:18.850741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.850746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:18.850750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.850756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:18.850765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.850771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:18.850780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.850786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:18.850795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.850800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.850806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.850816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.850821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.850829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.850873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:18.853473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:18.853804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:18.853816Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:18.853818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:18.853822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:18.853828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2300 [2:7559602167205344958:10414]
2025-10-10T14:37:18.853841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:18.853862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:18.853865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.853869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.853872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.853889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:18.853901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:18.853910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:18.853972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.853979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.853981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.853984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:18.854057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:18.854065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.854076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:18.854092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:18.854112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:18.854139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602167205344953:10414]
2025-10-10T14:37:18.854145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602167205344953:10414]
2025-10-10T14:37:18.854147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602167205344953:10414]
2025-10-10T14:37:18.854157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:18.854173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:18.854179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987576105:2438], now have 1 active actors on pipe
2025-10-10T14:37:18.854181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:18.854183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987576237:4930], now have 1 active actors on pipe
2025-10-10T14:37:18.854183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:18.854189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:18.854206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:18.854214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:18.854241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2300
2025-10-10T14:37:18.854245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2300
2025-10-10T14:37:18.854238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602167205344953:10414]
2025-10-10T14:37:18.854249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:18.854261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:18.854284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.854289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.854322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:18.854330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:18.854334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:18.854337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:18.854350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:18.854361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:18.854375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.854583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.854589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.854605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:18.854715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2301 partition: 0 MaxSeqNo: 40 sessionId: src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0
2025-10-10T14:37:18.855139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eeec346b-ce6805e7-f3026c04-afd2c4e6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:18.857990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0] Write session: try to update token
2025-10-10T14:37:18.858007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:18.867340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:18.867366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:18.867381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602167205344953:10414]
2025-10-10T14:37:18.867450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:18.867453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:18.867637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:18.867787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:18.867940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:18.868085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:18.868469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:18.868533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:18.873472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId: src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:18.876165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:18.876412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:18.876438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:18.876482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:18.876698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:18.887185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:18.887204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:18.887209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:18.887211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:18.887222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602167205344953:10414]
2025-10-10T14:37:18.887226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602167205344953:10414]
2025-10-10T14:37:18.887231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602167205344953:10414]
2025-10-10T14:37:18.887281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:18.887289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:18.887297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:18.887452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:18.889513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:18.889527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:18.889531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:18.933226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602167987576248:3836]
2025-10-10T14:37:18.933666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2300, pipe: [1:7559602167987576248:3836]
2025-10-10T14:37:19.005258Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:19.014325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.014351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.014544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.014616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.014682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.014746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.014792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.014807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.014890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.014960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.015027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.015106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.015157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.015167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.015252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.015322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.015394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.015479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.015527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.015534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.015608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.015679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.015753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.015823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.015874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.015883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.015955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.016031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.016105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.016183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.016233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.016236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.016314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.016375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.016443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.016516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.016563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.016566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.016640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.016702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.016768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.016833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.016879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.016882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.016956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.017024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.017097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.017166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.017210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.017213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.017287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.019728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:19.019739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0] Write session will restart in 0.009932s
2025-10-10T14:37:19.019770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0] Write session: Do CDS request
2025-10-10T14:37:19.019776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:19.017509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.017578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.017644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.017692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.017694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.017770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:19.017835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:19.017902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:19.017972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:19.018027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:19.018030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:19.018105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602167987576248:3836], now have 1 active actors on pipe
2025-10-10T14:37:19.019429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:19.018794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602167987576248:3836]
2025-10-10T14:37:19.018833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:19.018881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:19.018887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:19.019282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2301 reason: error at write: Disconnected sessionId: src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0
2025-10-10T14:37:19.019502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2301 sessionId: src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0 is DEAD
2025-10-10T14:37:19.019645Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:37:19.019734Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 23 consumer shared/user session shared/user_1_23_10338363962526116583_v1 is DEAD
2025-10-10T14:37:19.019849Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602094973117754:3840] disconnected; active server actors: 1
2025-10-10T14:37:19.019853Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602094973117754:3840] client user disconnected session shared/user_1_23_10338363962526116583_v1
2025-10-10T14:37:19.021721Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:37:19.021873Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:37:19.021879Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:37:19.021900Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.009451s
2025-10-10T14:37:19.030940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.032642Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:37:19.033392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:19.033393Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:37:19.033397Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 24
2025-10-10T14:37:19.033421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2302
2025-10-10T14:37:19.033567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.033614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:19.033625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:19.033629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:19.033643Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 24 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:37:19.033705Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:37:19.033793Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 auth for : user
2025-10-10T14:37:19.033932Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 Handle describe topics response
2025-10-10T14:37:19.033957Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 auth is DEAD
2025-10-10T14:37:19.033979Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:37:19.034116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2302 sessionId:  describe result for acl check
2025-10-10T14:37:19.034155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:19.034162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:19.034164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:19.034170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602172282543652:4933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:19.034188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:19.034262Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:37:19.034392Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602172282543653:4932] connected; active server actors: 1
2025-10-10T14:37:19.034435Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_24_7560477778585456082_v1
2025-10-10T14:37:19.034425Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602172282543653:4932] session shared/user_1_24_7560477778585456082_v1
2025-10-10T14:37:19.034442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:37:19.034455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:37:19.034462Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_24_7560477778585456082_v1" (Sender=[1:7559602172282543646:4932], Pipe=[1:7559602172282543653:4932], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:37:19.034467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:37:19.034480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:37:19.034495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_24_7560477778585456082_v1" (Sender=[1:7559602172282543646:4932], Pipe=[1:7559602172282543653:4932], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:37:19.034510Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_24_7560477778585456082_v1" sender [1:7559602172282543646:4932] lock partition 0 for ReadingSession "shared/user_1_24_7560477778585456082_v1" (Sender=[1:7559602172282543646:4932], Pipe=[1:7559602172282543653:4932], Partitions=[], ActiveFamilyCount=1) generation 1 step 24
2025-10-10T14:37:19.034522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:37:19.034531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000043s
2025-10-10T14:37:19.034786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602172282543652:4933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:19.034798Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 24 Session: "shared/user_1_24_7560477778585456082_v1" ClientId: "user" PipeClient { RawX1: 7559602172282543653 RawX2: 4503603922342724 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:37:19.034815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:37:19.036618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:19.036885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:19.036897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:19.036910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:19.036973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:19.037036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602171500312395:10416]
2025-10-10T14:37:19.037689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:19.038318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602172282543652:4933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:19.038126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:19.038173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:19.038584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:19.038675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.038676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.038677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.038678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.038680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.038681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.038682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.038683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.038685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.038686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.038687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.038688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.038690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.038697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.038709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.038712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.038716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.038719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.038724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.038728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.038731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.038735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.038739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.038743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.038747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.038750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.038759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.038768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.038774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.038780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.038784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.038789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.038793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.038797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.038801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.038807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.038811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.038816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.038820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.038826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.038829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.038834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.038839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.038843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.038847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.038852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.038858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.038863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.038867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.038872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.038876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.038881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.038918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:19.042181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:19.042291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602172282543652:4933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:19.042317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602172282543652:4933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:19.042321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602172282543652:4933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:19.042386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:19.042553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:19.042564Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:19.042567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:19.042572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:19.042579Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2301 [2:7559602171500312395:10416]
2025-10-10T14:37:19.042594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:19.042617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:19.042624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.042629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.042632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.042651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:19.042664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:19.042672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:19.042735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.042742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.042744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.042747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:19.042821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:19.042829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.042839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.042855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.042876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:19.042903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602171500312389:10416]
2025-10-10T14:37:19.042912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602171500312389:10416]
2025-10-10T14:37:19.042914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602171500312389:10416]
2025-10-10T14:37:19.042923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:19.042943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:19.042964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:19.042972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:19.042983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282543658:4939], now have 1 active actors on pipe
2025-10-10T14:37:19.042992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282543547:2438], now have 1 active actors on pipe
2025-10-10T14:37:19.043025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602171500312389:10416]
2025-10-10T14:37:19.043033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:19.043046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2301, pipe: [1:7559602172282543658:4939]
2025-10-10T14:37:19.043096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2301
2025-10-10T14:37:19.043921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282543689:4933], now have 1 active actors on pipe
2025-10-10T14:37:19.044038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.044049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.044007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2301
2025-10-10T14:37:19.044064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_24_7560477778585456082_v1 on pipe: [1:7559602172282543658:4939]
2025-10-10T14:37:19.044094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.044102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.044117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.044129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.044133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:19.044166Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_24_7560477778585456082_v1
2025-10-10T14:37:19.044169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.044213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cab9a045-bb4e204a-64440440-8d647535_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:19.044225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:37:19.044230Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:37:19.044256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:19.044260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:19.044262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:19.044270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:19.044373Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_24_7560477778585456082_v1:1 with generation 2301
2025-10-10T14:37:19.047835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:37:19.047882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:37:19.047896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.047904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.047907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:19.047934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.047954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:19.047967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:37:19.047983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:37:19.048004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.048213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.048226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.048255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.048162Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107039042 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:37:19.048189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:37:19.048239Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 sending to client partition status
2025-10-10T14:37:19.048356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2302 partition: 0 MaxSeqNo: 40 sessionId: src_id|cab9a045-bb4e204a-64440440-8d647535_0
2025-10-10T14:37:19.048708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf67801-26e8417f-9a245c64-2ab6d6e5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cab9a045-bb4e204a-64440440-8d647535_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:19.051594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab9a045-bb4e204a-64440440-8d647535_0] Write session: try to update token
2025-10-10T14:37:19.051615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab9a045-bb4e204a-64440440-8d647535_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:19.065274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:19.065291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:19.065295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:19.065297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:19.065308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602171500312389:10416]
2025-10-10T14:37:19.065313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602171500312389:10416]
2025-10-10T14:37:19.065318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602171500312389:10416]
2025-10-10T14:37:19.065384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:19.065391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:19.065394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:19.065395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:19.065404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.065406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:19.065554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:19.073158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId: src_id|cab9a045-bb4e204a-64440440-8d647535_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:19.076060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:19.192256Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:19.192851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.192861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.194641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:19.194769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2302 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cab9a045-bb4e204a-64440440-8d647535_0
2025-10-10T14:37:19.194970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2302 sessionId: src_id|cab9a045-bb4e204a-64440440-8d647535_0 is DEAD
2025-10-10T14:37:19.195176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602172282543658:4939]
2025-10-10T14:37:19.195201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:19.195489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab9a045-bb4e204a-64440440-8d647535_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:19.195500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab9a045-bb4e204a-64440440-8d647535_0] Write session will restart in 0.006976s
2025-10-10T14:37:19.195521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab9a045-bb4e204a-64440440-8d647535_0] Write session: Do CDS request
2025-10-10T14:37:19.195529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab9a045-bb4e204a-64440440-8d647535_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:19.193282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_24_7560477778585456082_v1
2025-10-10T14:37:19.193310Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:19.193355Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_24_7560477778585456082_v1
2025-10-10T14:37:19.205930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab9a045-bb4e204a-64440440-8d647535_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.206037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:19.206060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2303
2025-10-10T14:37:19.206232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.206271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:19.206277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:19.206285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:19.206814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2303 sessionId:  describe result for acl check
2025-10-10T14:37:19.206854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:19.206860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:19.206864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:19.206870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602172282543720:4950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:19.207470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602172282543720:4950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:19.209684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602172282543720:4950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:19.214173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602172282543720:4950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:19.214190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602172282543720:4950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:19.214194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602172282543720:4950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:19.214204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:19.226497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:19.232174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:19.232505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:19.232520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:19.232534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:19.232603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:19.232659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602171500312553:10420]
2025-10-10T14:37:19.233347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:19.233961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:19.234044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:19.234461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:19.234544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.234552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.234553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.234554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.234556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.234557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.234559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.234560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.234562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.234563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.234564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.234566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.234567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.234574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.234587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.234591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.234595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.234599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.234603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.234606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.234610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.234614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.234618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.234622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.234625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.234629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.234638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.234647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.234655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.234661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.234666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.234671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.234676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.234681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.234686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.234693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.234698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.234703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.234708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.234713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.234724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.234729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.234734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.234739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.234744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.234748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.234754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.234759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.234764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.234769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.234779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.234784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.234837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:19.240045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:19.240405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:19.240415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:19.240418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:19.240423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:19.240431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2302 [2:7559602171500312553:10420]
2025-10-10T14:37:19.240448Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:19.240471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:19.240478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.240483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.240486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.240506Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:19.240518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:19.240531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:19.240597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.240603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.240605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.240608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:19.240683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:19.240690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.240703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.240720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.240742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:19.240769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602171500312547:10420]
2025-10-10T14:37:19.240776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602171500312547:10420]
2025-10-10T14:37:19.240779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602171500312547:10420]
2025-10-10T14:37:19.240789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:19.240799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:19.240806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:19.240810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:19.240812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:19.240824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:19.240828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:19.240891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2302
2025-10-10T14:37:19.240916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2302
2025-10-10T14:37:19.240839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282543757:4950], now have 1 active actors on pipe
2025-10-10T14:37:19.240847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282543711:2438], now have 1 active actors on pipe
2025-10-10T14:37:19.240882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602171500312547:10420]
2025-10-10T14:37:19.240890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:19.240899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:19.241121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.241131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.241163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:19.241172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.241176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.241179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:19.241193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.241205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:19.241223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.241715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.241723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.241744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.241861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2303 partition: 0 MaxSeqNo: 40 sessionId: src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0
2025-10-10T14:37:19.245453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab9a045-bb4e204a-64440440-8d647535_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:19.248316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0] Write session: try to update token
2025-10-10T14:37:19.248341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:19.266091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:19.266123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:19.266127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:19.266129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:19.266142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602171500312547:10420]
2025-10-10T14:37:19.266148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602171500312547:10420]
2025-10-10T14:37:19.266153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602171500312547:10420]
2025-10-10T14:37:19.266212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:19.266221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.266224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:19.266399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:19.267064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:19.267081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:19.267091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:19.265584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId: src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:19.269661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:19.295381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602172282543855:4939]
2025-10-10T14:37:19.295866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2302, pipe: [1:7559602172282543855:4939]
2025-10-10T14:37:19.399299Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:19.399697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.399717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.399766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282543855:4939], now have 1 active actors on pipe
2025-10-10T14:37:19.400056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:19.400173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:19.400175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602172282543855:4939]
2025-10-10T14:37:19.400191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:19.400197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:19.400658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:19.400260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2303 reason: error at write: Disconnected sessionId: src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0
2025-10-10T14:37:19.400484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2303 sessionId: src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0 is DEAD
2025-10-10T14:37:19.400669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0] Write session will restart in 0.008511s
2025-10-10T14:37:19.400723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0] Write session: Do CDS request
2025-10-10T14:37:19.400735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:19.410902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.410993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:19.411016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2304
2025-10-10T14:37:19.413619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.413687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:19.413698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:19.413702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:19.414169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2304 sessionId:  describe result for acl check
2025-10-10T14:37:19.414210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:19.414214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:19.414216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:19.414222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602172282543876:4948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:19.414787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602172282543876:4948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:19.417471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602172282543876:4948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:19.421344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:19.423830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:19.423977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602172282543876:4948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:19.423996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602172282543876:4948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:19.424002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602172282543876:4948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:19.424012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:19.424082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:19.424093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:19.424106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:19.424161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:19.424206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602171500312694:10422]
2025-10-10T14:37:19.424849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:19.425180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:19.425228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:19.425597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:19.425657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.425663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.425664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.425666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.425667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.425669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.425670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.425672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.425674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.425675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.425677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.425678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.425679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.425686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.425700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.425704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.425709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.425714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.425719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.425723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.425728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.425732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.425737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.425742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.425746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.425751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.425759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.425768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.425775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.425781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.425786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.425791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.425796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.425801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.425806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.425811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.425816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.425821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.425827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.425832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.425836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.425842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.425847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.425852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.425857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.425862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.425866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.425873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.425878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.425883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.425888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.425893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.425934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:19.428339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:19.428663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:19.428675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:19.428678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:19.428682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:19.428689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2303 [2:7559602171500312694:10422]
2025-10-10T14:37:19.428703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:19.428723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:19.428732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.428736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.428739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.428755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:19.428767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:19.428775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:19.428850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.428857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.428859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.428862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:19.428932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:19.428939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.428950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.428963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.428980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:19.429003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282543992:4948], now have 1 active actors on pipe
2025-10-10T14:37:19.429011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282543858:2438], now have 1 active actors on pipe
2025-10-10T14:37:19.429019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602171500312689:10422]
2025-10-10T14:37:19.429021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602171500312689:10422]
2025-10-10T14:37:19.429023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602171500312689:10422]
2025-10-10T14:37:19.429037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:19.429053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:19.429057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:19.429063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:19.429066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:19.429073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:19.429076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:19.429057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2303
2025-10-10T14:37:19.429058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2303
2025-10-10T14:37:19.429103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602171500312689:10422]
2025-10-10T14:37:19.429114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:19.429120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:19.429130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.429135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.429184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:19.429197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.429201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.429203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:19.429214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.429229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:19.429252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.429417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.429425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.429442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.429528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2304 partition: 0 MaxSeqNo: 40 sessionId: src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0
2025-10-10T14:37:19.430001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efcaad4f-5b6824c0-76c9119f-b17a3e5d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:19.432901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0] Write session: try to update token
2025-10-10T14:37:19.432921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:19.450689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId: src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:19.453780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:19.453234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:19.453259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:19.453263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:19.453265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:19.453281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602171500312689:10422]
2025-10-10T14:37:19.453285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602171500312689:10422]
2025-10-10T14:37:19.453289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602171500312689:10422]
2025-10-10T14:37:19.453366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:19.453365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:19.453374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.453376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:19.453377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:19.453380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:19.453537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:19.500511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602172282544004:4939]
2025-10-10T14:37:19.500892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2303, pipe: [1:7559602172282544004:4939]
2025-10-10T14:37:19.581017Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:19.581491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.581505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.581550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544004:4939], now have 1 active actors on pipe
2025-10-10T14:37:19.581986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:19.582384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:19.582402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:19.582470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2304 reason: error at write: Disconnected sessionId: src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0
2025-10-10T14:37:19.582698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2304 sessionId: src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0 is DEAD
2025-10-10T14:37:19.582966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:19.583003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602172282544004:4939]
2025-10-10T14:37:19.589461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:19.589480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0] Write session will restart in 0.007966s
2025-10-10T14:37:19.589508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0] Write session: Do CDS request
2025-10-10T14:37:19.589519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:19.601927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.602585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:19.604711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:19.604968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:19.604974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:19.604987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:19.605044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:19.605088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602171500312877:10437]
2025-10-10T14:37:19.605786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:19.606254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:19.606301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:19.606641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:19.606696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.606698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.606699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.606701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.606702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.606704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.606705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.606707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.606708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.606709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.606711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.606712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.606713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.606721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.606736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.606741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.606746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.606750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.606755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.606760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.606764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.606768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.606774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.606778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.606783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.606787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.606797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.606806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.606814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.606820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.606826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.606832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.606838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.606845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.606850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.606856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.606861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.606868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.606873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.606879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.606884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.606889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.606894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.606899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.606905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.606910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.606916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.606922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.606927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.606933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.606938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.606944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.607006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:19.609546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:19.609569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2305
2025-10-10T14:37:19.610343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:19.610690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:19.610704Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:19.610707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:19.610712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:19.610719Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2304 [2:7559602171500312877:10437]
2025-10-10T14:37:19.610747Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:19.610772Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:19.610779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.610784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.610787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.610808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:19.610821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:19.610830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:19.610903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.610911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.610913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.610916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:19.610993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:19.611003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.611018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.611035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.611058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:19.611085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602171500312872:10437]
2025-10-10T14:37:19.611092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602171500312872:10437]
2025-10-10T14:37:19.611094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602171500312872:10437]
2025-10-10T14:37:19.611108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:19.611127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:19.611148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:19.611156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:19.611196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602171500312872:10437]
2025-10-10T14:37:19.611203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:19.611465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2304
2025-10-10T14:37:19.611358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:19.611366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:19.611370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:19.611370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544032:2438], now have 1 active actors on pipe
2025-10-10T14:37:19.611377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:19.613496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.613569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:19.613575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:19.613580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:19.615100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2305 sessionId:  describe result for acl check
2025-10-10T14:37:19.615153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:19.615161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:19.615163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:19.615170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602172282544143:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:19.615854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602172282544143:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:19.618633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602172282544143:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:19.629038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602172282544143:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:19.629061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602172282544143:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:19.629066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602172282544143:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:19.629077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:19.629934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544170:4967], now have 1 active actors on pipe
2025-10-10T14:37:19.630040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2304
2025-10-10T14:37:19.630214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.630228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.630266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:19.630285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.630296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.630300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:19.630316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.630347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:19.630369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.631184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.631195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.631219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.631600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2305 partition: 0 MaxSeqNo: 40 sessionId: src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0
2025-10-10T14:37:19.633493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9608239-8a84360b-7b2cc0ba-12ba4887_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:19.636447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0] Write session: try to update token
2025-10-10T14:37:19.636470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:19.635708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:19.635728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:19.635732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:19.635734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:19.635746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602171500312872:10437]
2025-10-10T14:37:19.635750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602171500312872:10437]
2025-10-10T14:37:19.635754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602171500312872:10437]
2025-10-10T14:37:19.635806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:19.635815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.635818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:19.635975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:19.637704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:19.637714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:19.637718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:19.673746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId: src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:19.676591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:19.683294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602172282544175:4939]
2025-10-10T14:37:19.683732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2304, pipe: [1:7559602172282544175:4939]
2025-10-10T14:37:19.764567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:19.764986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.765001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.765026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544175:4939], now have 1 active actors on pipe
2025-10-10T14:37:19.765319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602172282544175:4939]
2025-10-10T14:37:19.765374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:19.765976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:19.765998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0] Write session will restart in 0.007378s
2025-10-10T14:37:19.765410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:19.765420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:19.765478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2305 reason: error at write: Disconnected sessionId: src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0
2025-10-10T14:37:19.766025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0] Write session: Do CDS request
2025-10-10T14:37:19.765669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2305 sessionId: src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0 is DEAD
2025-10-10T14:37:19.766032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:19.765423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:19.775194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.775298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:19.775316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2306
2025-10-10T14:37:19.775840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.775904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:19.775914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:19.775919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:19.776439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2306 sessionId:  describe result for acl check
2025-10-10T14:37:19.776481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:19.776488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:19.776490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:19.776497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602172282544211:4992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:19.777102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602172282544211:4992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:19.783251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602172282544211:4992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:19.792159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602172282544211:4992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:19.792187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602172282544211:4992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:19.792191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602172282544211:4992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:19.792202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:19.792776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:19.795124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:19.795357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:19.795370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:19.795385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:19.795460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:19.795505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602171500313022:10439]
2025-10-10T14:37:19.796159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:19.796517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:19.796559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:19.796886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:19.796942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.796949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.796951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.796952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.796953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.796954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.796956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.796957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.796959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.796960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.796961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.796962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.796964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.796969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.796983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.796988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.796993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.796997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.797001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.797005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.797010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.797014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.797018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.797022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.797026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.797030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.797038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.797047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.797053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.797059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.797065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.797070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.797075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.797080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.797085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.797090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.797095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.797100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.797105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.797110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.797116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.797121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.797127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.797132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.797136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.797143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.797148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.797153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.797158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.797163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.797170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.797175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.797219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:19.800183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:19.800497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:19.800509Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:19.800511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:19.800514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:19.800519Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2305 [2:7559602171500313022:10439]
2025-10-10T14:37:19.800530Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:19.800545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:19.800549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.800552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.800553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.800567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:19.800575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:19.800582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:19.800625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.800631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.800632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.800635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:19.800685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:19.800693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.800701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.800708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.800718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:19.800734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602171500313017:10439]
2025-10-10T14:37:19.800736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602171500313017:10439]
2025-10-10T14:37:19.800738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602171500313017:10439]
2025-10-10T14:37:19.800745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:19.800759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:19.800758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:19.800761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:19.800764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:19.800773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:19.800776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:19.800786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544182:2438], now have 1 active actors on pipe
2025-10-10T14:37:19.800790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544316:4992], now have 1 active actors on pipe
2025-10-10T14:37:19.800819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602171500313017:10439]
2025-10-10T14:37:19.800832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:19.800889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2305
2025-10-10T14:37:19.800890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2305
2025-10-10T14:37:19.800954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:19.801106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.801117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.801150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:19.801164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.801168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.801172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:19.801183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.801200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:19.801218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.801716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2306 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0
2025-10-10T14:37:19.802157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a3870f-5c4ffdef-9fae1b7a-ded13c0f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:19.804771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0] Write session: try to update token
2025-10-10T14:37:19.804789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:19.801539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.801549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.801567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.821469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:19.821489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:19.821492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:19.821495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:19.821504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602171500313017:10439]
2025-10-10T14:37:19.821509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602171500313017:10439]
2025-10-10T14:37:19.821513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602171500313017:10439]
2025-10-10T14:37:19.821564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:19.821582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.821585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:19.821720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:19.824384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:19.824400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:19.824405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:19.825981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId: src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:19.829907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:19.865575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602172282544333:4939]
2025-10-10T14:37:19.866111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2305, pipe: [1:7559602172282544333:4939]
2025-10-10T14:37:19.939438Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:19.939965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.939975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.940024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544333:4939], now have 1 active actors on pipe
2025-10-10T14:37:19.940268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:19.941101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:19.941154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602172282544333:4939]
2025-10-10T14:37:19.941426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:19.941494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2306 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0
2025-10-10T14:37:19.941702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2306 sessionId: src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0 is DEAD
2025-10-10T14:37:19.945570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:19.945584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0] Write session will restart in 0.009970s
2025-10-10T14:37:19.945611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0] Write session: Do CDS request
2025-10-10T14:37:19.945617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:19.956934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.957400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:19.957420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2307
2025-10-10T14:37:19.957734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:19.957770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:19.957776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:19.957780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:19.958218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2307 sessionId:  describe result for acl check
2025-10-10T14:37:19.958244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:19.958247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:19.958249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:19.958256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602172282544431:5001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:19.958848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602172282544431:5001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:19.960737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:19.961119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602172282544431:5001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:19.963253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:19.963495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:19.963507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:19.963518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:19.963570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:19.963615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602171500313166:10441]
2025-10-10T14:37:19.964146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602172282544431:5001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:19.964164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602172282544431:5001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:19.964168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602172282544431:5001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:19.964177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:19.964288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:19.964607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:19.964657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:19.964992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:19.965054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.965060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.965062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.965063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.965065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.965066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.965068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.965069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.965071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.965072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.965073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.965075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.965076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.965082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.965095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.965099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.965104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.965108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.965113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.965117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.965121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.965125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.965129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.965133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.965137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.965140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.965149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.965159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:19.965172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.965178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:19.965182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.965187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:19.965192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.965197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:19.965202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.965212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:19.965216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.965224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:19.965233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.965238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:19.965243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.965254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:19.965259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.965272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:19.965277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.965283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:19.965293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.965298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.965304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.965313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.965319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.965328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.965391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:19.968130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:19.968475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:19.968493Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:19.968495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:19.968513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:19.968521Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2306 [2:7559602171500313166:10441]
2025-10-10T14:37:19.968536Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:19.968555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:19.968559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.968563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.968566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.968585Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:19.968593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:19.968602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:19.968667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.968677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.968679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.968682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:19.968771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:19.968780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.968793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:19.968810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:19.968835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:19.968860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602171500313161:10441]
2025-10-10T14:37:19.968869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602171500313161:10441]
2025-10-10T14:37:19.968871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602171500313161:10441]
2025-10-10T14:37:19.968884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:19.968917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:19.968939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:19.968946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:19.968981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602171500313161:10441]
2025-10-10T14:37:19.968989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:19.969363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2306
2025-10-10T14:37:19.969375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2306
2025-10-10T14:37:19.969233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:19.969241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:19.969244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:19.969253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:19.969682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544471:5001], now have 1 active actors on pipe
2025-10-10T14:37:19.969690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602172282544334:2438], now have 1 active actors on pipe
2025-10-10T14:37:19.969718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.969727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.969773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:19.969788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:19.969797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:19.969800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:19.969812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:19.969844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:19.969869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.970101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:19.970113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:19.970136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:19.970239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2307 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0
2025-10-10T14:37:19.970726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe7b423c-106ba2ce-2f35803c-5bcc197_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:19.973733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0] Write session: try to update token
2025-10-10T14:37:19.973757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:19.991959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:19.991978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:19.991982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:19.991985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:19.991995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602171500313161:10441]
2025-10-10T14:37:19.991999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602171500313161:10441]
2025-10-10T14:37:19.992002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602171500313161:10441]
2025-10-10T14:37:19.992054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:19.992063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:19.992071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:19.992126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:19.992142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:19.992147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:19.992062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId: src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:19.992245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:19.995333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:20.037584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602176577511780:4939]
2025-10-10T14:37:20.038447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2306, pipe: [1:7559602176577511780:4939]
2025-10-10T14:37:20.110491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:20.110812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.110822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.110873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577511780:4939], now have 1 active actors on pipe
2025-10-10T14:37:20.111156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:20.111485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:20.111501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:20.111555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2307 reason: error at write: Disconnected sessionId: src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0
2025-10-10T14:37:20.111650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602176577511780:4939]
2025-10-10T14:37:20.111666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:20.111762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2307 sessionId: src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0 is DEAD
2025-10-10T14:37:20.113572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:20.113586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0] Write session will restart in 0.005282s
2025-10-10T14:37:20.113612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0] Write session: Do CDS request
2025-10-10T14:37:20.113623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:20.120244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.120638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:20.120655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2308
2025-10-10T14:37:20.120807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.120858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:20.120870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:20.120874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:20.121367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2308 sessionId:  describe result for acl check
2025-10-10T14:37:20.121409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:20.121411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:20.121413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:20.121419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602176577511795:5003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:20.122030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602176577511795:5003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:20.124246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602176577511795:5003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:20.127637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602176577511795:5003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:20.127655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602176577511795:5003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:20.127659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602176577511795:5003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:20.127669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:20.132886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:20.135572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:20.135871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:20.135886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:20.135901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:20.135985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:20.136039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602175795280623:10444]
2025-10-10T14:37:20.136712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:20.137098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:20.137154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:20.137538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:20.137619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.137625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.137627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.137628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.137629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.137630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.137632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.137633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.137634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.137636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.137637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.137639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.137640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.137647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.137661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.137666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.137670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.137673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.137677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.137693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.137696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.137700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.137704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.137708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.137712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.137716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.137726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.137735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.137743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.137749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.137757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.137762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.137767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.137773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.137778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.137785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.137789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.137795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.137801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.137806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.137810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.137816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.137821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.137827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.137832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.137837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.137842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.137848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.137852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.137858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.137864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.137869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.137913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:20.141420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:20.141899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:20.141914Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:20.141917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:20.141921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:20.141929Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2307 [2:7559602175795280623:10444]
2025-10-10T14:37:20.141946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:20.141974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:20.141985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.141988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.141991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.142011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:20.142019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:20.142028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:20.142110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.142113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.142115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.142118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:20.142195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:20.142198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.142212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.142223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.142238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:20.142260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602175795280618:10444]
2025-10-10T14:37:20.142262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602175795280618:10444]
2025-10-10T14:37:20.142265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602175795280618:10444]
2025-10-10T14:37:20.142282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:20.142297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:20.142312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:20.142316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:20.142348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:20.142351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602175795280618:10444]
2025-10-10T14:37:20.142353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:20.142364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:20.142366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:20.142374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:20.143171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577511865:5003], now have 1 active actors on pipe
2025-10-10T14:37:20.143185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577511781:2438], now have 1 active actors on pipe
2025-10-10T14:37:20.143203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.143210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.142726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2307
2025-10-10T14:37:20.142732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2307
2025-10-10T14:37:20.143255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:20.143270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.143276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.143283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:20.143297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.143312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:20.143338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.143647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.143660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.143682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.143787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2308 partition: 0 MaxSeqNo: 40 sessionId: src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0
2025-10-10T14:37:20.144207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c5579cd-6a2bac87-4c1ac9cc-f1190ab7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:20.146981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0] Write session: try to update token
2025-10-10T14:37:20.146997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:20.157115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:20.157138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:20.157151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602175795280618:10444]
2025-10-10T14:37:20.157205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:20.157404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:20.157557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:20.157705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:20.157867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:20.158079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:20.158124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:20.158311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:20.166219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId: src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:20.168991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:20.169590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.169613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.169656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:20.169775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:20.181950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:20.181975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:20.181979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:20.181981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:20.181992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602175795280618:10444]
2025-10-10T14:37:20.181998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602175795280618:10444]
2025-10-10T14:37:20.182002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602175795280618:10444]
2025-10-10T14:37:20.182063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:20.182073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.182076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:20.182262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:20.184039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:20.184047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:20.184052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:20.211671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602176577511944:4939]
2025-10-10T14:37:20.212151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2307, pipe: [1:7559602176577511944:4939]
2025-10-10T14:37:20.306233Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:20.316854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.316883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.317081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.317173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.317250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.317347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.317922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.317937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.318017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.318082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.318158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.318239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.318284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.318292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.318362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.318428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.322092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:20.322109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:20.322140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2308 reason: error at write: Disconnected sessionId: src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0
2025-10-10T14:37:20.322340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2308 sessionId: src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0 is DEAD
2025-10-10T14:37:20.322687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602176577511944:4939]
2025-10-10T14:37:20.322710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:20.318505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.318579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.318622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.318626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.318696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.318758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.318824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.318890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.318935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.318939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.319012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.319085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.319147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.319209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.319254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.319257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.319336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.319397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.319473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.319541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.319585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.319588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.319661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.319723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.319794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.319856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.319899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.319902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.319980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.320046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.320107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.320167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.320216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.320219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.320288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.320345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.320412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.320484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.320528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.320531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.320608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.320674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.320738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.320798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.320839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.320841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.320923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577511944:4939], now have 1 active actors on pipe
2025-10-10T14:37:20.323952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:20.325610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:20.325623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0] Write session will restart in 0.009194s
2025-10-10T14:37:20.325661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0] Write session: Do CDS request
2025-10-10T14:37:20.325667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:20.335981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.336033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:20.336054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2309
2025-10-10T14:37:20.336229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.336270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:20.336281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:20.336286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:20.336830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2309 sessionId:  describe result for acl check
2025-10-10T14:37:20.336868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:20.336876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:20.336878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:20.336885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602176577511968:5018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:20.337514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602176577511968:5018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:20.341670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602176577511968:5018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:20.342756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:20.345667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:20.345916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:20.345928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:20.345941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:20.346000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:20.346063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602175795280769:10447]
2025-10-10T14:37:20.346727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:20.347093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:20.347145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:20.347511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:20.347595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.347601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.347602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.347604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.347605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.347606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.347608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.347609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.347610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.347612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.347614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.347615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.347616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.347624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.347638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.347643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.347647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.347652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.347656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.347660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.347665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.347669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.347674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.347678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.347682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.347686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.347694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.347703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.347711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.347717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.347727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.347734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.347743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.347749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.347755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.347765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.347770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.347779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.347784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.347790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.347795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.347801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.347807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.347813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.347818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.347829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.347837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.347843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.347847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.347853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.347858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.347873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.347918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:20.352591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:20.352814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602176577511968:5018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:20.352838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602176577511968:5018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:20.352843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602176577511968:5018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:20.352853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:20.353257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:20.353272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:20.353275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:20.353279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:20.353287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2308 [2:7559602175795280769:10447]
2025-10-10T14:37:20.353302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:20.353320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:20.353324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.353343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.353346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.353367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:20.353376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:20.353385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:20.353451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.353453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.353455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.353458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:20.353833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2308
2025-10-10T14:37:20.353864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2308
2025-10-10T14:37:20.355155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28216be2-e93709cc-7080b9cf-2cbcc014_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:20.354734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2309 partition: 0 MaxSeqNo: 40 sessionId: src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0
2025-10-10T14:37:20.353524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:20.353533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.353546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.353557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.353574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:20.353600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512089:5018], now have 1 active actors on pipe
2025-10-10T14:37:20.353604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577511947:2438], now have 1 active actors on pipe
2025-10-10T14:37:20.353611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602175795280764:10447]
2025-10-10T14:37:20.353614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602175795280764:10447]
2025-10-10T14:37:20.353616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602175795280764:10447]
2025-10-10T14:37:20.353632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:20.353648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:20.353664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:20.353668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:20.353706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602175795280764:10447]
2025-10-10T14:37:20.353709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:20.353734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:20.353737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:20.353740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:20.353755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:20.354351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.354358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.354395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:20.354404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.354409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.354412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:20.354437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.354450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:20.354468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.354642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.354645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.354660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.358140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0] Write session: try to update token
2025-10-10T14:37:20.358159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:20.379838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId: src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:20.382566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:20.386016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.386040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.388026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:20.388042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:20.388045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:20.388048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:20.388059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602175795280764:10447]
2025-10-10T14:37:20.388064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602175795280764:10447]
2025-10-10T14:37:20.388068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602175795280764:10447]
2025-10-10T14:37:20.388126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:20.388150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:20.388162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.388166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:20.388210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:20.388226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:20.388230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:20.388311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:20.388353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:20.422618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602176577512097:4939]
2025-10-10T14:37:20.422944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2308, pipe: [1:7559602176577512097:4939]
2025-10-10T14:37:20.510150Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:20.519633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.519668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.519860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.519923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.519985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.520053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.520096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.520101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.520175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.520238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.520304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.520383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.520429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.520432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.520502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.520561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.520624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.520694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.520735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.520739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.520809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.520870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.520932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.520996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.521037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.521041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.521111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.521168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.521232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.521296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.521691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.521705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.521778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.521845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.521913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.521983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.522034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.522042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.522118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.522232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.522303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.522372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.522419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.522426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.522498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.522560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.522633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.522693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.522733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.522735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.522806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.522863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.522926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.522990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.523049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.523052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.523124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:20.523181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:20.523241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:20.523304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:20.523347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:20.523349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:20.523435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512097:4939], now have 1 active actors on pipe
2025-10-10T14:37:20.525828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:20.525861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:20.525894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2309 reason: error at write: Disconnected sessionId: src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0
2025-10-10T14:37:20.526120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2309 sessionId: src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0 is DEAD
2025-10-10T14:37:20.526162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602176577512097:4939]
2025-10-10T14:37:20.526192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:20.526311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:20.526325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0] Write session will restart in 0.005310s
2025-10-10T14:37:20.526360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0] Write session: Do CDS request
2025-10-10T14:37:20.526366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:20.529606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:20.533111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:20.533137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2310
2025-10-10T14:37:20.533344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.533610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.533653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:20.533672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:20.533683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:20.534177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2310 sessionId:  describe result for acl check
2025-10-10T14:37:20.534216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:20.534219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:20.534222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:20.534228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602176577512108:5023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:20.534824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602176577512108:5023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:20.538957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602176577512108:5023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:20.542863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602176577512108:5023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:20.542888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602176577512108:5023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:20.542892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602176577512108:5023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:20.542903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:20.546819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:20.549554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:20.549795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:20.549801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:20.549813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:20.549867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:20.549907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602175795280949:10455]
2025-10-10T14:37:20.550601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:20.551175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:20.551230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:20.551601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:20.551662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.551664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.551665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.551667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.551668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.551670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.551672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.551673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.551675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.551676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.551677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.551678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.551680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.551687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.551702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.551708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.551713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.551717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.551722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.551726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.551731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.551735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.551740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.551745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.551749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.551753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.551762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.551771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.551778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.551784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.551790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.551797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.551804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.551810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.551815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.551822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.551827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.551833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.551839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.551845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.551849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.551854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.551859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.551864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.551868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.551874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.551879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.551885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.551890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.551896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.551901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.551907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.551948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:20.555293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:20.555704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:20.555717Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:20.555720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:20.555724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:20.555731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2309 [2:7559602175795280949:10455]
2025-10-10T14:37:20.555746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:20.555770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:20.555778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.555782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.555785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.555803Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:20.555816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:20.555825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:20.555898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.555906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.555908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.555911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:20.555988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:20.555996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.556010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.556029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.556054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:20.556084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512190:5023], now have 1 active actors on pipe
2025-10-10T14:37:20.556092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512100:2438], now have 1 active actors on pipe
2025-10-10T14:37:20.556101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602175795280944:10455]
2025-10-10T14:37:20.556108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602175795280944:10455]
2025-10-10T14:37:20.556110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602175795280944:10455]
2025-10-10T14:37:20.556126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:20.556146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:20.556148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:20.556160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:20.556162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:20.556167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:20.556172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:20.556205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602175795280944:10455]
2025-10-10T14:37:20.556214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:20.556216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:20.556241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.556251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.556289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:20.556302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.556311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.556314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:20.556326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.556342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:20.556366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.556173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2309
2025-10-10T14:37:20.556227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2309
2025-10-10T14:37:20.556965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.556980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.557002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.557697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17bba23a-24fd55c-a9d9f08a-b4b67f97_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:20.560642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0] Write session: try to update token
2025-10-10T14:37:20.560663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:20.557219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2310 partition: 0 MaxSeqNo: 40 sessionId: src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0
2025-10-10T14:37:20.581700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId: src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:20.584436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:20.583851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:20.583875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:20.583879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:20.583881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:20.583892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602175795280944:10455]
2025-10-10T14:37:20.583897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602175795280944:10455]
2025-10-10T14:37:20.583902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602175795280944:10455]
2025-10-10T14:37:20.583957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:20.583965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.583967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:20.584130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:20.584612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:20.584617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:20.584621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:20.626416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602176577512264:4939]
2025-10-10T14:37:20.626814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2309, pipe: [1:7559602176577512264:4939]
2025-10-10T14:37:20.706548Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:20.707008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.707021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.707072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512264:4939], now have 1 active actors on pipe
2025-10-10T14:37:20.707348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:20.707422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602176577512264:4939]
2025-10-10T14:37:20.707461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:20.707502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:20.707595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2310 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0
2025-10-10T14:37:20.707828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2310 sessionId: src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0 is DEAD
2025-10-10T14:37:20.708289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:20.708300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0] Write session will restart in 0.005855s
2025-10-10T14:37:20.708329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0] Write session: Do CDS request
2025-10-10T14:37:20.708336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:20.715983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.716601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:20.716625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2311
2025-10-10T14:37:20.716857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.716909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:20.716922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:20.716926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:20.717428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2311 sessionId:  describe result for acl check
2025-10-10T14:37:20.717471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:20.717481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:20.717483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:20.717490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602176577512293:5050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:20.718089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602176577512293:5050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:20.722025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602176577512293:5050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:20.724031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:20.726628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:20.726878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:20.726891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:20.726904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:20.726958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:20.727005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602175795281104:10464]
2025-10-10T14:37:20.727019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602176577512293:5050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:20.727042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602176577512293:5050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:20.727046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602176577512293:5050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:20.727056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:20.727685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:20.728042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:20.728121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:20.728503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:20.728593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.728599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.728600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.728601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.728603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.728604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.728606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.728607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.728608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.728610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.728611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.728612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.728614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.728621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.728634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.728639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.728643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.728647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.728652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.728656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.728660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.728664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.728669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.728674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.728678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.728682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.728690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.728701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.728713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.728719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.728728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.728734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.728738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.728744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.728749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.728755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.728760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.728766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.728770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.728776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.728780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.728790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.728796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.728800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.728810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.728815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.728822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.728828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.728833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.728843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.728848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.728858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.728901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:20.731739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:20.732111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:20.732117Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:20.732121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:20.732145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:20.732153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2310 [2:7559602175795281104:10464]
2025-10-10T14:37:20.732171Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:20.732194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:20.732198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.732202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.732205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.732226Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:20.732234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:20.732243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:20.732546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.732549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.732552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.732555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:20.732639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:20.732642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.732658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.732671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.732690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:20.732715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602175795281099:10464]
2025-10-10T14:37:20.732719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602175795281099:10464]
2025-10-10T14:37:20.732721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602175795281099:10464]
2025-10-10T14:37:20.732732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:20.732749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:20.732766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:20.732770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:20.732808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602175795281099:10464]
2025-10-10T14:37:20.732812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:20.732908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:20.732911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:20.732914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:20.732920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:20.733010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512278:2438], now have 1 active actors on pipe
2025-10-10T14:37:20.733019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512421:5050], now have 1 active actors on pipe
2025-10-10T14:37:20.733066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2310
2025-10-10T14:37:20.733076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2310
2025-10-10T14:37:20.733169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.733184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.733220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:20.733235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.733239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.733242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:20.733255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.733273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:20.733295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.733482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.733495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.733519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.733651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2311 partition: 0 MaxSeqNo: 40 sessionId: src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0
2025-10-10T14:37:20.734091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51fb3339-34a89e68-f898725d-d00bbfe6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:20.736896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0] Write session: try to update token
2025-10-10T14:37:20.736915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:20.752320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId: src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:20.753638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:20.753654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:20.753656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:20.753658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:20.753666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602175795281099:10464]
2025-10-10T14:37:20.753669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602175795281099:10464]
2025-10-10T14:37:20.753673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602175795281099:10464]
2025-10-10T14:37:20.753717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:20.753724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.753726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:20.753731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:20.753739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:20.753745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:20.753890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:20.755435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:20.807686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602176577512440:4939]
2025-10-10T14:37:20.807978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2310, pipe: [1:7559602176577512440:4939]
2025-10-10T14:37:20.870160Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:20.870504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.870525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.870602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512440:4939], now have 1 active actors on pipe
2025-10-10T14:37:20.870874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:20.870951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602176577512440:4939]
2025-10-10T14:37:20.870978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:20.870987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:20.871062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2311 reason: error at write: Disconnected sessionId: src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0
2025-10-10T14:37:20.870861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:20.871287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2311 sessionId: src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0 is DEAD
2025-10-10T14:37:20.871482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:20.871510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0] Write session will restart in 0.007115s
2025-10-10T14:37:20.871538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0] Write session: Do CDS request
2025-10-10T14:37:20.871548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:20.879980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.880127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:20.880155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2312
2025-10-10T14:37:20.880280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:20.880319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:20.880330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:20.880335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:20.880841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2312 sessionId:  describe result for acl check
2025-10-10T14:37:20.880879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:20.880885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:20.880887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:20.880894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602176577512459:5053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:20.881542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602176577512459:5053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:20.884610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602176577512459:5053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:20.886642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:20.889023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:20.889314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:20.889342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:20.889360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:20.889437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:20.889485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602175795281254:10466]
2025-10-10T14:37:20.889719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602176577512459:5053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:20.889739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602176577512459:5053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:20.889743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602176577512459:5053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:20.889752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:20.890119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:20.890432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:20.890480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:20.890820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:20.890883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.890888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.890890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.890891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.890892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.890893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.890894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.890896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.890897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.890898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.890900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.890901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.890902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.890908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.890921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.890925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.890929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.890933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.890938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.890942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.890946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.890950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.890956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.890960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.890963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.890967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.890974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.890983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:20.890990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.890997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:20.891006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.891012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:20.891016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.891022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:20.891028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.891037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:20.891042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.891048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:20.891054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.891060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:20.891070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.891075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:20.891080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.891084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:20.891088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.891094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:20.891098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.891104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.891108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.891113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.891118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.891124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.891164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:20.893865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:20.894604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:20.894617Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:20.894620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:20.894625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:20.894631Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2311 [2:7559602175795281254:10466]
2025-10-10T14:37:20.894646Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:20.894666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:20.894670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.894674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.894677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.894698Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:20.894711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:20.894724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:20.894792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.894799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.894801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.894804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:20.895070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2311
2025-10-10T14:37:20.894879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:20.894892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.895139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2311
2025-10-10T14:37:20.894906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:20.894918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:20.894935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:20.894960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512442:2438], now have 1 active actors on pipe
2025-10-10T14:37:20.894964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512584:5053], now have 1 active actors on pipe
2025-10-10T14:37:20.894973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602175795281249:10466]
2025-10-10T14:37:20.894977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602175795281249:10466]
2025-10-10T14:37:20.894979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602175795281249:10466]
2025-10-10T14:37:20.894997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:20.895012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:20.895020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:20.895023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:20.895026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:20.895029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:20.895033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:20.895071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602175795281249:10466]
2025-10-10T14:37:20.895081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:20.895183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:20.895335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.895349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.895387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:20.895415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:20.895425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:20.895427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:20.895445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:20.895463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:20.895488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.895786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.895797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.895816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:20.895962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2312 partition: 0 MaxSeqNo: 40 sessionId: src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0
2025-10-10T14:37:20.896537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800e6d4e-8c96582d-1fd4ab15-e1ffdf9d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:20.899541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0] Write session: try to update token
2025-10-10T14:37:20.899565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:20.915328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:20.915346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:20.915358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602175795281249:10466]
2025-10-10T14:37:20.915423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:20.915429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:20.915620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:20.915770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:20.915914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:20.916063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:20.916288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:20.916334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:20.916870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId: src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:20.920119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:20.920348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:20.920371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:20.920417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:20.920542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:20.929085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:20.929107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:20.929111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:20.929114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:20.929131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602175795281249:10466]
2025-10-10T14:37:20.929136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602175795281249:10466]
2025-10-10T14:37:20.929140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602175795281249:10466]
2025-10-10T14:37:20.929194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:20.929204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:20.929207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:20.929207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:20.929218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:20.929222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:20.929380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:20.970997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602176577512595:4939]
2025-10-10T14:37:20.971311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2311, pipe: [1:7559602176577512595:4939]
2025-10-10T14:37:21.055490Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:21.065306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.065363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.065560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.065624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.065691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.065756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.066133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.066139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.066220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.066284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.066348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.066419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.066461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.066464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.066537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.066600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.066664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.066735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.066778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.066781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.066854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.066918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.066982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.067046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.067090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.067093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.067165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.067227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.067289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.067366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.067428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.067431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.067500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.067566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.067632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.067695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.067738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.067741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.067815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.067873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.067936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.068004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.068048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.068052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.068125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.068187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.068255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.068757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.068813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.068817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.068895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.068956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.069020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.069085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.069231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.069238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.069314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.069411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.069489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.069552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.069595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.069597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.069684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602176577512595:4939], now have 1 active actors on pipe
2025-10-10T14:37:21.071701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602176577512595:4939]
2025-10-10T14:37:21.071737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:21.071776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:21.071785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:21.071816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2312 reason: error at write: Disconnected sessionId: src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0
2025-10-10T14:37:21.072035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2312 sessionId: src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0 is DEAD
2025-10-10T14:37:21.072380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:21.072392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0] Write session will restart in 0.006497s
2025-10-10T14:37:21.072419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0] Write session: Do CDS request
2025-10-10T14:37:21.072425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:21.073582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:21.079912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.085419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:21.085445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2313
2025-10-10T14:37:21.085898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.085952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:21.085960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:21.085965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:21.086421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2313 sessionId:  describe result for acl check
2025-10-10T14:37:21.086462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:21.086474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:21.086477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:21.086483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602180872479904:5061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:21.087107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602180872479904:5061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:21.089816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602180872479904:5061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:21.093418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602180872479904:5061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:21.093436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602180872479904:5061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:21.093440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602180872479904:5061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:21.093451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:21.098279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:21.101346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:21.101620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:21.101635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:21.101650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:21.101722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:21.101771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602180090248706:10469]
2025-10-10T14:37:21.102468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:21.105813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:21.105910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:21.106313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:21.106390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.106398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.106400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.106401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.106402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.106404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.106405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.106406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.106408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.106409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.106410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.106412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.106413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.106421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.106434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.106438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.106441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.106445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.106449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.106453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.106457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.106461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.106465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.106469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.106472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.106476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.106486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.106495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.106502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.106507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.106512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.106517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.106521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.106527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.106531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.106537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.106541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.106547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.106551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.106569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.106574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.106579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.106584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.106589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.106594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.106598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.106611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.106617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.106626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.106640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.106650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.106656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.106696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:21.112453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:21.113147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:21.113161Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:21.113163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:21.113168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:21.113176Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2312 [2:7559602180090248706:10469]
2025-10-10T14:37:21.113194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:21.113217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:21.113224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.113228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.113230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.113253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:21.113267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:21.113280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:21.113365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.113374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.113376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.113379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:21.113451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:21.113462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.113477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.113490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.113509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:21.113537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872479977:5061], now have 1 active actors on pipe
2025-10-10T14:37:21.113541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872479894:2438], now have 1 active actors on pipe
2025-10-10T14:37:21.113549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602180090248699:10469]
2025-10-10T14:37:21.113551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602180090248699:10469]
2025-10-10T14:37:21.113554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602180090248699:10469]
2025-10-10T14:37:21.113573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:21.113590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:21.113605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:21.113606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:21.113608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:21.113610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:21.113610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:21.113654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602180090248699:10469]
2025-10-10T14:37:21.113669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:21.113674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2312
2025-10-10T14:37:21.113675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2312
2025-10-10T14:37:21.113686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:21.113799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.113808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.113850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:21.113863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.113869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.113872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:21.113924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.113949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:21.113969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.114210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.114224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.114249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.114423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2313 partition: 0 MaxSeqNo: 40 sessionId: src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0
2025-10-10T14:37:21.114982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430917b-8ab77128-23aa9d9b-fec2f85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:21.117820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0] Write session: try to update token
2025-10-10T14:37:21.117844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:21.129571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:21.129595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:21.129607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602180090248699:10469]
2025-10-10T14:37:21.129663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:21.129669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:21.129887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:21.130058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:21.130227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:21.130398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:21.130643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:21.130695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:21.138361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId: src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:21.142021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:21.142317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.142356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.142408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:21.142509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:21.154567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:21.154600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:21.154604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:21.154607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:21.154619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602180090248699:10469]
2025-10-10T14:37:21.154625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602180090248699:10469]
2025-10-10T14:37:21.154631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602180090248699:10469]
2025-10-10T14:37:21.154694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:21.154705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.154716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:21.154904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:21.157446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:21.157456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:21.157463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:21.171657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602180872480049:4939]
2025-10-10T14:37:21.172226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2312, pipe: [1:7559602180872480049:4939]
2025-10-10T14:37:21.288013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:21.299354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.299416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.299577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.299635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.299697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.299760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.299921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.299935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.300031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.300118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.300175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.300237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.300280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.300282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.300347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.300419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.300478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.300535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.300578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.300585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.300647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.300709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.300768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.300829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.300872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.300874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.300933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.300984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.301037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.301092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.301131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.301133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.301194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.301256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.301317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.301408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.301460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.301469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.301543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.301602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.301670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.301737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.301781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.301790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.301853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.301914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.301968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.302026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.302064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.302066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.302131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.302191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.302246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.302306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.302351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.302354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.302427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:21.302490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:21.302552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:21.302614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:21.302656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:21.302660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:21.302738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480049:4939], now have 1 active actors on pipe
2025-10-10T14:37:21.303078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:21.303145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:21.303150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:21.303184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2313 reason: error at write: Disconnected sessionId: src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0
2025-10-10T14:37:21.303346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:21.303607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:21.303616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0] Write session will restart in 0.005116s
2025-10-10T14:37:21.303638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0] Write session: Do CDS request
2025-10-10T14:37:21.303642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:21.303411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2313 sessionId: src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0 is DEAD
2025-10-10T14:37:21.303614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602180872480049:4939]
2025-10-10T14:37:21.309934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.313557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:21.313583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2314
2025-10-10T14:37:21.313810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.313881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:21.313896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:21.313902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:21.314529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2314 sessionId:  describe result for acl check
2025-10-10T14:37:21.314574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:21.314583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:21.314606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:21.314619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602180872480079:5068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:21.315245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602180872480079:5068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:21.318827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602180872480079:5068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:21.329976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602180872480079:5068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:21.330004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602180872480079:5068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:21.330009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602180872480079:5068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:21.330020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:21.330321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:21.338242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:21.338545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:21.338560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:21.338575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:21.338652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:21.338709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602180090248870:10472]
2025-10-10T14:37:21.339468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:21.343782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:21.343878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:21.344422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:21.344632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.344641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.344643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.344644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.344646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.344647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.344649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.344651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.344652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.344654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.344656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.344657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.344659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.344667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.344681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.344685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.344690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.344695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.344699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.344704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.344708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.344712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.344717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.344722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.344727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.344731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.344742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.344753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.344762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.344768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.344774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.344780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.344785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.344801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.344807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.344812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.344817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.344823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.344829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.344834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.344839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.344855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.344867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.344873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.344878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.344883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.344889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.344894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.344897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.344904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.344909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.344914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.344960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:21.348001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:21.348820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:21.348837Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:21.348840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:21.348844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:21.348852Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2313 [2:7559602180090248870:10472]
2025-10-10T14:37:21.348868Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:21.348889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:21.348893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.348897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.348900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.348920Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:21.348929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:21.348945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:21.349018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.349026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.349032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.349034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:21.349122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:21.349135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.349149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.349160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.349176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:21.349201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602180090248864:10472]
2025-10-10T14:37:21.349203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602180090248864:10472]
2025-10-10T14:37:21.349206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602180090248864:10472]
2025-10-10T14:37:21.349222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:21.349242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:21.349264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:21.349272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:21.349314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602180090248864:10472]
2025-10-10T14:37:21.349324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:21.349449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:21.349457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:21.349459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:21.349467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:21.349889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2313
2025-10-10T14:37:21.349892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2313
2025-10-10T14:37:21.350091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480063:2438], now have 1 active actors on pipe
2025-10-10T14:37:21.350102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480206:5068], now have 1 active actors on pipe
2025-10-10T14:37:21.350143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.350155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.350193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:21.350210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.350220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.350223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:21.350238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.350257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:21.350644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.351162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.351177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.351204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.351510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2314 partition: 0 MaxSeqNo: 40 sessionId: src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0
2025-10-10T14:37:21.351986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8847d2f-484b3c18-f24ceba0-5ec8be2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:21.354928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0] Write session: try to update token
2025-10-10T14:37:21.354949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:21.377185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:21.377215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:21.377219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:21.377222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:21.377235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602180090248864:10472]
2025-10-10T14:37:21.377242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602180090248864:10472]
2025-10-10T14:37:21.377246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602180090248864:10472]
2025-10-10T14:37:21.377315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:21.377348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.377351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:21.377351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:21.377365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:21.377371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:21.377526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:21.380328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId: src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:21.383395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:21.403637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602180872480222:4939]
2025-10-10T14:37:21.403981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2313, pipe: [1:7559602180872480222:4939]
2025-10-10T14:37:21.500650Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:21.501202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.501215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.501269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480222:4939], now have 1 active actors on pipe
2025-10-10T14:37:21.501640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:21.501587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602180872480222:4939]
2025-10-10T14:37:21.501641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:21.501644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:21.501642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:21.501732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2314 reason: error at write: Disconnected sessionId: src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0
2025-10-10T14:37:21.501938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2314 sessionId: src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0 is DEAD
2025-10-10T14:37:21.504392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:21.504411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0] Write session will restart in 0.008342s
2025-10-10T14:37:21.504439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0] Write session: Do CDS request
2025-10-10T14:37:21.504450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:21.513979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.514063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:21.514084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2315
2025-10-10T14:37:21.514261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.514298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:21.514316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:21.514325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:21.515467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2315 sessionId:  describe result for acl check
2025-10-10T14:37:21.515531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:21.515538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:21.515540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:21.515546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602180872480253:5070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:21.516315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602180872480253:5070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:21.521557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602180872480253:5070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:21.523697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:21.529006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:21.529346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:21.529360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:21.529375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:21.529446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:21.529499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602180090249022:10474]
2025-10-10T14:37:21.529576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602180872480253:5070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:21.529598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602180872480253:5070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:21.529602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602180872480253:5070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:21.529613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:21.530163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:21.530540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:21.530609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:21.530965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:21.531034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.531042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.531043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.531045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.531046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.531048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.531049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.531051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.531052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.531054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.531055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.531057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.531058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.531065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.531079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.531083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.531088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.531092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.531096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.531101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.531105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.531109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.531114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.531118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.531121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.531126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.531136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.531145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.531152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.531157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.531162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.531168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.531174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.531179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.531184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.531190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.531195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.531200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.531205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.531210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.531215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.531224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.531228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.531234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.531238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.531244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.531249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.531254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.531259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.531264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.531270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.531275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.531317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:21.537171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:21.537583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:21.537602Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:21.537606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:21.537611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:21.537620Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2314 [2:7559602180090249022:10474]
2025-10-10T14:37:21.537640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:21.537667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:21.537679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.537684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.537687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.538351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2314
2025-10-10T14:37:21.538393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2314
2025-10-10T14:37:21.537708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:21.537738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:21.537747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:21.537837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.537840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.537843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.537846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:21.537945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:21.537949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.537964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.537977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.537996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:21.538022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480225:2438], now have 1 active actors on pipe
2025-10-10T14:37:21.538027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480369:5070], now have 1 active actors on pipe
2025-10-10T14:37:21.538036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602180090249017:10474]
2025-10-10T14:37:21.538039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602180090249017:10474]
2025-10-10T14:37:21.538041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602180090249017:10474]
2025-10-10T14:37:21.538058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:21.538075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:21.538078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:21.538078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:21.538080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:21.538098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:21.538102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:21.538153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602180090249017:10474]
2025-10-10T14:37:21.538164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:21.538185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:21.538446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.538453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.538497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:21.538507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.538512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.538516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:21.538532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.538549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:21.538572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.539010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.539024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.539048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.539167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2315 partition: 0 MaxSeqNo: 40 sessionId: src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0
2025-10-10T14:37:21.539612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f739d8-99d2fa59-cf0b7825-797f89ea_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:21.542406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0] Write session: try to update token
2025-10-10T14:37:21.542427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:21.565281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId: src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:21.567731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:21.567757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:21.567761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:21.567763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:21.567776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602180090249017:10474]
2025-10-10T14:37:21.567782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602180090249017:10474]
2025-10-10T14:37:21.567789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602180090249017:10474]
2025-10-10T14:37:21.567855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:21.567875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.567877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:21.568045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:21.568645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:21.569388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:21.569403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:21.569408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:21.601758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602180872480381:4939]
2025-10-10T14:37:21.602188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2314, pipe: [1:7559602180872480381:4939]
2025-10-10T14:37:21.694966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:21.695557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.695579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.695633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480381:4939], now have 1 active actors on pipe
2025-10-10T14:37:21.695890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:21.697533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602180872480381:4939]
2025-10-10T14:37:21.697580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:21.697620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:21.697702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2315 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0
2025-10-10T14:37:21.697925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2315 sessionId: src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0 is DEAD
2025-10-10T14:37:21.698093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:21.698105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0] Write session will restart in 0.005325s
2025-10-10T14:37:21.698137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0] Write session: Do CDS request
2025-10-10T14:37:21.698144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:21.704966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.705092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:21.705121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2316
2025-10-10T14:37:21.705353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.705392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:21.705414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:21.705424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:21.705942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2316 sessionId:  describe result for acl check
2025-10-10T14:37:21.706002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:21.706012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:21.706015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:21.706021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602180872480423:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:21.706681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602180872480423:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:21.708822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602180872480423:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:21.713271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602180872480423:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:21.713303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602180872480423:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:21.713307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602180872480423:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:21.713317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:21.721528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:21.723880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:21.724206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:21.724224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:21.724239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:21.724319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:21.724375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602180090249215:10488]
2025-10-10T14:37:21.725075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:21.725537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:21.725618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:21.726007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:21.726087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.726096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.726097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.726098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.726100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.726101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.726102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.726103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.726105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.726106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.726107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.726108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.726109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.726116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.726129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.726133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.726137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.726141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.726145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.726148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.726152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.726155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.726160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.726164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.726168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.726171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.726186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.726195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.726203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.726209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.726215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.726224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.726229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.726234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.726239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.726245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.726250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.726255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.726260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.726265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.726269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.726274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.726278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.726282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.726286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.726292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.726296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.726302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.726306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.726310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.726315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.726321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.726362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:21.731341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:21.732380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2315
2025-10-10T14:37:21.732430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2315
2025-10-10T14:37:21.731913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:21.731929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:21.731932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:21.731937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:21.731945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2315 [2:7559602180090249215:10488]
2025-10-10T14:37:21.731962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:21.731984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:21.731989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.731993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.731995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.732016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:21.732025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:21.732033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:21.732107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.732110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.732112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.732115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:21.732193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:21.732196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.732211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.732222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.732955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2316 partition: 0 MaxSeqNo: 40 sessionId: src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0
2025-10-10T14:37:21.732238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:21.732262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602180090249210:10488]
2025-10-10T14:37:21.732265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602180090249210:10488]
2025-10-10T14:37:21.732267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602180090249210:10488]
2025-10-10T14:37:21.732281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:21.732287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:21.732290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:21.732292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:21.732301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480487:5115], now have 1 active actors on pipe
2025-10-10T14:37:21.732305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480397:2438], now have 1 active actors on pipe
2025-10-10T14:37:21.732315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:21.732331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:21.732334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:21.732381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602180090249210:10488]
2025-10-10T14:37:21.732392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:21.732410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:21.732435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.732441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.732480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:21.732489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.732493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.732496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:21.732509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.732522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:21.732539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.732784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.732788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.732818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.733460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55e08f9e-e3984a6b-fbc4dc31-d3a395c6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:21.736183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0] Write session: try to update token
2025-10-10T14:37:21.736205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:21.754442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:21.754467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:21.754470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:21.754472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:21.754484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602180090249210:10488]
2025-10-10T14:37:21.754489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602180090249210:10488]
2025-10-10T14:37:21.754494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602180090249210:10488]
2025-10-10T14:37:21.754547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:21.754555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.754561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:21.754568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:21.754577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:21.754596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:21.754702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:21.756395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId: src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:21.759156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:21.797879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602180872480570:4939]
2025-10-10T14:37:21.798327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2315, pipe: [1:7559602180872480570:4939]
2025-10-10T14:37:21.870213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:21.870658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.870673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.870718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480570:4939], now have 1 active actors on pipe
2025-10-10T14:37:21.870966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:21.870995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:21.871012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:21.871085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2316 reason: error at write: Disconnected sessionId: src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0
2025-10-10T14:37:21.871293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2316 sessionId: src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0 is DEAD
2025-10-10T14:37:21.871492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:21.871297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602180872480570:4939]
2025-10-10T14:37:21.871520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0] Write session will restart in 0.008316s
2025-10-10T14:37:21.871323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:21.871554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0] Write session: Do CDS request
2025-10-10T14:37:21.871561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:21.880965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.881062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:21.881084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2317
2025-10-10T14:37:21.881230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:21.881278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:21.881290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:21.881294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:21.881744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2317 sessionId:  describe result for acl check
2025-10-10T14:37:21.881776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:21.881778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:21.881780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:21.881788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602180872480608:5114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:21.882371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602180872480608:5114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:21.886175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602180872480608:5114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:21.887068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:21.889676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:21.889964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:21.889980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:21.889993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:21.890056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:21.890106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602180090249369:10491]
2025-10-10T14:37:21.890092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602180872480608:5114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:21.890114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602180872480608:5114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:21.890117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602180872480608:5114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:21.890126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:21.890761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:21.891274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:21.891330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:21.891911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:21.891992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.891999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.892000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.892001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.892003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.892004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.892006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.892007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.892008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.892010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.892011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.892012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.892014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.892022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.892036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.892041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.892046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.892050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.892054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.892059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.892062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.892066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.892071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.892075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.892079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.892083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.892092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.892101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:21.892107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.892114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:21.892118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.892126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:21.892130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.892135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:21.892141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.892146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:21.892150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.892155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:21.892160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.892165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:21.892171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.892188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:21.892196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.892202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:21.892207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.892212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:21.892217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.892222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.892227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.892232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.892237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.892242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.892282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:21.895066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:21.895644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:21.895656Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:21.895659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:21.895664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:21.895670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2316 [2:7559602180090249369:10491]
2025-10-10T14:37:21.895685Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:21.895704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:21.895713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.895717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.895719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.895739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:21.895764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:21.895776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:21.895844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.895853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.895855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.895857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:21.895934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:21.895942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.895954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:21.895972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:21.895995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:21.896017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602180090249364:10491]
2025-10-10T14:37:21.896023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602180090249364:10491]
2025-10-10T14:37:21.896025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602180090249364:10491]
2025-10-10T14:37:21.896043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:21.896061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:21.896081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:21.896084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:21.896097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:21.896112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:21.896115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602180090249364:10491]
2025-10-10T14:37:21.896115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:21.896118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:21.896137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:21.896238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480723:5114], now have 1 active actors on pipe
2025-10-10T14:37:21.896277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480576:2438], now have 1 active actors on pipe
2025-10-10T14:37:21.896571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.896585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.896628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:21.896642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:21.896647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:21.896653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:21.896666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:21.896680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:21.896704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.896932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.896940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.896957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:21.896388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2316
2025-10-10T14:37:21.896431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2316
2025-10-10T14:37:21.897054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2317 partition: 0 MaxSeqNo: 40 sessionId: src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0
2025-10-10T14:37:21.897516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27fc7c73-76b004ce-ece083d3-f60ccaa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:21.900372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0] Write session: try to update token
2025-10-10T14:37:21.900393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:21.915384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId: src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:21.915598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:21.915619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:21.915634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602180090249364:10491]
2025-10-10T14:37:21.915695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:21.915712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:21.915922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:21.916140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:21.916358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:21.916552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:21.916780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:21.916838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:21.918066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:21.918269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:21.918291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:21.918329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:21.918442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:21.930467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:21.930483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:21.930487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:21.930490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:21.930504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602180090249364:10491]
2025-10-10T14:37:21.930509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602180090249364:10491]
2025-10-10T14:37:21.930520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602180090249364:10491]
2025-10-10T14:37:21.930576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:21.930578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:21.930584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:21.930588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:21.930589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:21.930592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:21.930743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:21.971459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602180872480734:4939]
2025-10-10T14:37:21.971891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2316, pipe: [1:7559602180872480734:4939]
2025-10-10T14:37:22.045461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:22.053901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.053929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.054121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.054189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.054253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.054326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.054614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.054627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.054701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.054764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.054826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.054891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.054937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.054943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.055015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.055075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.055137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.055198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.055246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.055253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.055325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.055406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.055473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.055533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.055580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.055588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.055656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.055718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.055781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.055861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.055911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.055920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.056000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.056066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.056130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.056204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.056250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.056258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.056331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.056391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.056460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.056529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.056577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.056584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.056649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.056711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.056777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.056848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.056901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.056909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.056981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.057040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.057102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.057165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.057211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.057218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.057285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.057362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.057426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.057496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.057538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.057544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.057606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602180872480734:4939], now have 1 active actors on pipe
2025-10-10T14:37:22.057864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:22.057888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:22.057893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:22.057928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2317 reason: error at write: Disconnected sessionId: src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0
2025-10-10T14:37:22.057951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602180872480734:4939]
2025-10-10T14:37:22.058210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2317 sessionId: src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0 is DEAD
2025-10-10T14:37:22.058319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:22.058331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0] Write session will restart in 0.005895s
2025-10-10T14:37:22.058368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0] Write session: Do CDS request
2025-10-10T14:37:22.058374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:22.058454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:22.065899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.066032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:22.066051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2318
2025-10-10T14:37:22.066165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.066199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:22.066209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:22.066215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:22.066662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2318 sessionId:  describe result for acl check
2025-10-10T14:37:22.066700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:22.066716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:22.066719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:22.066725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602185167448048:5119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:22.067275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602185167448048:5119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:22.070806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602185167448048:5119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:22.073541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602185167448048:5119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:22.073559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602185167448048:5119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:22.073562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602185167448048:5119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:22.073571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:22.073565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:22.076095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:22.076371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:22.076384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:22.076400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:22.076485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:22.076534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602184385216824:10493]
2025-10-10T14:37:22.077202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:22.077602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:22.077661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:22.078010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:22.078090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.078097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.078099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.078101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.078102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.078104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.078106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.078107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.078108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.078110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.078112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.078113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.078114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.078122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.078138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.078142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.078147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.078152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.078157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.078161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.078165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.078169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.078174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.078179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.078184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.078188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.078198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.078208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.078216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.078223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.078228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.078241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.078247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.078258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.078269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.078275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.078280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.078287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.078292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.078297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.078302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.078308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.078318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.078325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.078334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.078340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.078348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.078354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.078358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.078365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.078369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.078375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.078425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:22.081124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:22.081720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:22.081736Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:22.081739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:22.081743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:22.081750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2317 [2:7559602184385216824:10493]
2025-10-10T14:37:22.081764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:22.081784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:22.081788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.081792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.081795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.081814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:22.081829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:22.081837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:22.081905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.081914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.081916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.081919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:22.081994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:22.082002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.082015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.082033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.082057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:22.082083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448033:2438], now have 1 active actors on pipe
2025-10-10T14:37:22.082087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448180:5119], now have 1 active actors on pipe
2025-10-10T14:37:22.082109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602184385216818:10493]
2025-10-10T14:37:22.082118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602184385216818:10493]
2025-10-10T14:37:22.082120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602184385216818:10493]
2025-10-10T14:37:22.082135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:22.082148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:22.082157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:22.082158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:22.082161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:22.082174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:22.082179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:22.082213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602184385216818:10493]
2025-10-10T14:37:22.082231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:22.082226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2317
2025-10-10T14:37:22.082240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2317
2025-10-10T14:37:22.082276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:22.082348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.082363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.082415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2283360a-f14f777a-e323f34e-fd115c11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:22.082430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.082436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.082439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:22.082461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.082479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:22.082500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.082780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.082791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.082816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.082903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2318 partition: 0 MaxSeqNo: 40 sessionId: src_id|2283360a-f14f777a-e323f34e-fd115c11_0
2025-10-10T14:37:22.083301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6412e85e-6dcc6256-f15b3c0a-9bf44c7c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2283360a-f14f777a-e323f34e-fd115c11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:22.085972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2283360a-f14f777a-e323f34e-fd115c11_0] Write session: try to update token
2025-10-10T14:37:22.085993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2283360a-f14f777a-e323f34e-fd115c11_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:22.095765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:22.095782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:22.095794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602184385216818:10493]
2025-10-10T14:37:22.095836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:22.095849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:22.096076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:22.096240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:22.096386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:22.096577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:22.096802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:22.096845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:22.100337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId: src_id|2283360a-f14f777a-e323f34e-fd115c11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:22.103096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:22.103307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.103337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.103390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:22.103511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:22.115202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:22.115220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:22.115225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:22.115227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:22.115244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602184385216818:10493]
2025-10-10T14:37:22.115248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602184385216818:10493]
2025-10-10T14:37:22.115251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602184385216818:10493]
2025-10-10T14:37:22.115303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:22.115305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:22.115313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.115315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:22.115319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:22.115323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:22.115476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:22.158300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602185167448193:4939]
2025-10-10T14:37:22.158568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2317, pipe: [1:7559602185167448193:4939]
2025-10-10T14:37:22.232871Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:22.241810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.241838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.242050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.242123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.242202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.242276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.242572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.242583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.242661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.242726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.242796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.242869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.242917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.242925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.242995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.243058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.243142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.243206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.243260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.243269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.243342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.243426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.243498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.243615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.243665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.243673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.243747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.243826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.243901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.243965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.244017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.244025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.244097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.244167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.244234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.244304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.244360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.244375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.244446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.244509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.244581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.244648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.244699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.244708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.244789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.244859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.244932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.245002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.245053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.245060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.245137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.245211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.245281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.245364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.245412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.245424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.245496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.245570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.245635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.245711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.245756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.245764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.245836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448193:4939], now have 1 active actors on pipe
2025-10-10T14:37:22.246092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:22.246108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602185167448193:4939]
2025-10-10T14:37:22.246140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:22.246143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:22.246177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2318 reason: error at write: Disconnected sessionId: src_id|2283360a-f14f777a-e323f34e-fd115c11_0
2025-10-10T14:37:22.246444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2318 sessionId: src_id|2283360a-f14f777a-e323f34e-fd115c11_0 is DEAD
2025-10-10T14:37:22.246611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283360a-f14f777a-e323f34e-fd115c11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:22.246633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283360a-f14f777a-e323f34e-fd115c11_0] Write session will restart in 0.006816s
2025-10-10T14:37:22.246659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283360a-f14f777a-e323f34e-fd115c11_0] Write session: Do CDS request
2025-10-10T14:37:22.246666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283360a-f14f777a-e323f34e-fd115c11_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:22.246827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:22.254927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2283360a-f14f777a-e323f34e-fd115c11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.255016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:22.255034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2319
2025-10-10T14:37:22.255194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.255230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:22.255239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:22.255243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:22.255728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2319 sessionId:  describe result for acl check
2025-10-10T14:37:22.255769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:22.255776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:22.255778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:22.255786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602185167448222:5131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:22.256401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602185167448222:5131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:22.259514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602185167448222:5131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:22.262335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602185167448222:5131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:22.262354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602185167448222:5131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:22.262358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602185167448222:5131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:22.262366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:22.262554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:22.265382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:22.265625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:22.265635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:22.265647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:22.265697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:22.265746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602184385216993:10497]
2025-10-10T14:37:22.266378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:22.266727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:22.266775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:22.267112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:22.267177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.267183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.267185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.267186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.267187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.267188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.267189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.267190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.267192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.267193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.267195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.267196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.267197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.267203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.267216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.267220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.267225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.267228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.267232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.267236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.267240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.267244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.267248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.267251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.267255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.267259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.267268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.267276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.267284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.267290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.267294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.267299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.267303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.267308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.267313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.267318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.267322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.267327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.267331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.267336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.267372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.267382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.267386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.267391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.267397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.267401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.267411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.267416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.267420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.267433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.267444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.267449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.267489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:22.270107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:22.270678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:22.270692Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:22.270695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:22.270699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:22.270706Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2318 [2:7559602184385216993:10497]
2025-10-10T14:37:22.270720Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:22.270739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:22.270751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.270755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.270758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.270777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:22.270795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:22.270807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:22.270863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.270867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.270870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.270873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:22.270943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:22.270957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.270970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.270983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.271016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:22.271043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448355:5131], now have 1 active actors on pipe
2025-10-10T14:37:22.271055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602184385216987:10497]
2025-10-10T14:37:22.271063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602184385216987:10497]
2025-10-10T14:37:22.271065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602184385216987:10497]
2025-10-10T14:37:22.271077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:22.271085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:22.271088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:22.271090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:22.271092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448207:2438], now have 1 active actors on pipe
2025-10-10T14:37:22.271101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:22.271108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2318
2025-10-10T14:37:22.271110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2318
2025-10-10T14:37:22.271118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:22.271130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:22.271156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602184385216987:10497]
2025-10-10T14:37:22.271159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:22.271181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:22.271191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.271197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.271233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:22.271250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.271254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.271257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:22.271269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.271291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:22.271310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.271475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.271485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.271500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.271595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2319 partition: 0 MaxSeqNo: 40 sessionId: src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0
2025-10-10T14:37:22.272062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2283360a-f14f777a-e323f34e-fd115c11_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:22.274995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0] Write session: try to update token
2025-10-10T14:37:22.275020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:22.290061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId: src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:22.293093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:22.293384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.293421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.293465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:22.293580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:22.311491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:22.311508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:22.311512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:22.311514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:22.311525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602184385216987:10497]
2025-10-10T14:37:22.311529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602184385216987:10497]
2025-10-10T14:37:22.311533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602184385216987:10497]
2025-10-10T14:37:22.311585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:22.311590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:22.311594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:22.311598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:22.311599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.311601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:22.311744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:22.346231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602185167448368:4939]
2025-10-10T14:37:22.346641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2318, pipe: [1:7559602185167448368:4939]
2025-10-10T14:37:22.432607Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:22.441381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.441407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.441598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.441666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.441738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.441808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.441858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.441872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.441954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.442023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.442096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.442163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.442210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.442218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.442290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.442352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.442421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.442491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.442536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.442543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.442609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.442676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.442743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.442821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.442871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.442878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.442954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.443021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.443089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.443160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.443211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.443218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.443296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.443378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.443446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.443518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.443565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.443574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.443644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.443709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.443780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.443847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.443898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.443906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.443980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.444053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.444132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.444205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.444257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.444264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.444336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.444406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.444479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.444558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.444605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.444612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.444685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:22.444750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:22.444823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:22.444890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:22.444938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:22.444945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:22.445063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448368:4939], now have 1 active actors on pipe
2025-10-10T14:37:22.445346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:22.445409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602185167448368:4939]
2025-10-10T14:37:22.445679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:22.445684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:22.445716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2319 reason: error at write: Disconnected sessionId: src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0
2025-10-10T14:37:22.446027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2319 sessionId: src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0 is DEAD
2025-10-10T14:37:22.446411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:22.446914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:22.446926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0] Write session will restart in 0.007024s
2025-10-10T14:37:22.446951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0] Write session: Do CDS request
2025-10-10T14:37:22.446958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:22.454982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.455080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:22.455107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2320
2025-10-10T14:37:22.455310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.455388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:22.455402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:22.455407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:22.455985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2320 sessionId:  describe result for acl check
2025-10-10T14:37:22.456033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:22.456041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:22.456043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:22.456050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602185167448394:5144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:22.456635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602185167448394:5144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:22.460279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602185167448394:5144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:22.464603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602185167448394:5144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:22.464623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602185167448394:5144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:22.464628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602185167448394:5144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:22.464638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:22.466883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:22.471977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:22.472301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:22.472314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:22.472328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:22.472408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:22.472454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602184385217153:10499]
2025-10-10T14:37:22.473174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:22.473532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:22.473580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:22.473928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:22.473987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.473989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.473990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.473991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.473993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.473994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.473996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.473997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.473998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.474000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.474001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.474002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.474004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.474010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.474025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.474029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.474034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.474039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.474044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.474048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.474053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.474057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.474062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.474067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.474071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.474076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.474084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.474094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.474102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.474108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.474113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.474120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.474125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.474131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.474136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.474142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.474147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.474154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.474159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.474166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.474171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.474176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.474181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.474187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.474192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.474198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.474202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.474208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.474213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.474218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.474223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.474231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.474273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:22.477050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:22.477675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:22.477686Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:22.477689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:22.477693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:22.477700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2319 [2:7559602184385217153:10499]
2025-10-10T14:37:22.477725Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:22.477751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:22.477755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.477758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.477761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.477781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:22.477789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:22.477803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:22.477868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.477880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.477883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.477886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:22.477959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:22.477967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.477979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.477993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.478017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:22.478044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448370:2438], now have 1 active actors on pipe
2025-10-10T14:37:22.478052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448526:5144], now have 1 active actors on pipe
2025-10-10T14:37:22.478061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602184385217148:10499]
2025-10-10T14:37:22.478063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602184385217148:10499]
2025-10-10T14:37:22.478065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602184385217148:10499]
2025-10-10T14:37:22.478082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:22.478103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:22.478126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:22.478134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:22.478166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602184385217148:10499]
2025-10-10T14:37:22.478165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:22.478169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:22.478169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:22.478148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2319
2025-10-10T14:37:22.478171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:22.478165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2319
2025-10-10T14:37:22.478179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:22.478293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.478307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.478348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63977cce-862fdf9b-efc4603e-f256a10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:22.478359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.478364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.478367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:22.478381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.478411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:22.478434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.478657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.478667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.478692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.478821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2320 partition: 0 MaxSeqNo: 40 sessionId: src_id|63977cce-862fdf9b-efc4603e-f256a10_0
2025-10-10T14:37:22.479381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe4af-a6f55ed3-60d22a7e-56558efc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63977cce-862fdf9b-efc4603e-f256a10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:22.482218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63977cce-862fdf9b-efc4603e-f256a10_0] Write session: try to update token
2025-10-10T14:37:22.482246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63977cce-862fdf9b-efc4603e-f256a10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:22.499965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:22.499992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:22.499996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:22.499999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:22.500010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602184385217148:10499]
2025-10-10T14:37:22.500014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602184385217148:10499]
2025-10-10T14:37:22.500018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602184385217148:10499]
2025-10-10T14:37:22.500072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:22.500081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.500084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:22.500092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:22.500106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:22.500111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:22.500228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:22.497691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId: src_id|63977cce-862fdf9b-efc4603e-f256a10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:22.500571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:22.545419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602185167448541:4939]
2025-10-10T14:37:22.546071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2319, pipe: [1:7559602185167448541:4939]
2025-10-10T14:37:22.619261Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:22.619529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.619553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.619604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448541:4939], now have 1 active actors on pipe
2025-10-10T14:37:22.619753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:22.619816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:22.619820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:22.619897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2320 reason: error at write: Disconnected sessionId: src_id|63977cce-862fdf9b-efc4603e-f256a10_0
2025-10-10T14:37:22.620285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63977cce-862fdf9b-efc4603e-f256a10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:22.619820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:22.620301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63977cce-862fdf9b-efc4603e-f256a10_0] Write session will restart in 0.005496s
2025-10-10T14:37:22.620349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63977cce-862fdf9b-efc4603e-f256a10_0] Write session: Do CDS request
2025-10-10T14:37:22.620356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63977cce-862fdf9b-efc4603e-f256a10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:22.620100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602185167448541:4939]
2025-10-10T14:37:22.620113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2320 sessionId: src_id|63977cce-862fdf9b-efc4603e-f256a10_0 is DEAD
2025-10-10T14:37:22.626876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63977cce-862fdf9b-efc4603e-f256a10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.627011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:22.627038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2321
2025-10-10T14:37:22.628668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.628721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:22.628738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:22.628745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:22.629237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2321 sessionId:  describe result for acl check
2025-10-10T14:37:22.629289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:22.629291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:22.629293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:22.629300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602185167448560:5141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:22.629939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602185167448560:5141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:22.633927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602185167448560:5141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:22.637652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602185167448560:5141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:22.637671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602185167448560:5141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:22.637675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602185167448560:5141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:22.637685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:22.637829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:22.641152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:22.641410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:22.641420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:22.641434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:22.641501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:22.641559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602184385217325:10507]
2025-10-10T14:37:22.642190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:22.642578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:22.642643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:22.642989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:22.643047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.643053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.643055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.643056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.643057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.643058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.643060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.643061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.643063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.643064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.643065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.643067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.643068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.643073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.643086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.643090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.643095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.643099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.643103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.643106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.643109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.643114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.643117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.643122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.643127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.643131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.643139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.643151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.643158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.643164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.643169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.643174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.643179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.643184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.643189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.643195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.643199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.643205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.643210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.643215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.643220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.643227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.643232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.643238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.643242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.643247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.643253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.643258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.643263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.643270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.643281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.643287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.643327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:22.646847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:22.647187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:22.647198Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:22.647201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:22.647204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:22.647211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2320 [2:7559602184385217325:10507]
2025-10-10T14:37:22.647224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:22.647243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:22.647245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.647249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.647252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.647269Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:22.647277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:22.647286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:22.647365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.647372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.647374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.647377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:22.647445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:22.647453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.647464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.647479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.647494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:22.647523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448692:5141], now have 1 active actors on pipe
2025-10-10T14:37:22.647532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448542:2438], now have 1 active actors on pipe
2025-10-10T14:37:22.647539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602184385217319:10507]
2025-10-10T14:37:22.647541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602184385217319:10507]
2025-10-10T14:37:22.647543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602184385217319:10507]
2025-10-10T14:37:22.647558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:22.647569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:22.647572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:22.647573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:22.647574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:22.647589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:22.647596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:22.647622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602184385217319:10507]
2025-10-10T14:37:22.647633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:22.647637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:22.648236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.648247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.648280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:22.648294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.648299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.648301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:22.648314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.648326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:22.648341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.648130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2320
2025-10-10T14:37:22.648380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2320
2025-10-10T14:37:22.648602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.648609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.648623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.649271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2321 partition: 0 MaxSeqNo: 40 sessionId: src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0
2025-10-10T14:37:22.649843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63977cce-862fdf9b-efc4603e-f256a10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:22.653221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0] Write session: try to update token
2025-10-10T14:37:22.653244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:22.663347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:22.663377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:22.663389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602184385217319:10507]
2025-10-10T14:37:22.663443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:22.663445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:22.663627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:22.663777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:22.663914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:22.664048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:22.664236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:22.664272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:22.678981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId: src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:22.682558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:22.682577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:22.682581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:22.682584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:22.682595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602184385217319:10507]
2025-10-10T14:37:22.682599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602184385217319:10507]
2025-10-10T14:37:22.682603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602184385217319:10507]
2025-10-10T14:37:22.682659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:22.682664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:22.682666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:22.682670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:22.682673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.682676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:22.682638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:22.682810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:22.720474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602185167448719:4939]
2025-10-10T14:37:22.720819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2320, pipe: [1:7559602185167448719:4939]
2025-10-10T14:37:22.800799Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:22.801103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.801121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.801152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448719:4939], now have 1 active actors on pipe
2025-10-10T14:37:22.801434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:22.801424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602185167448719:4939]
2025-10-10T14:37:22.801468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:22.801471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:22.801898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:22.801910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0] Write session will restart in 0.008782s
2025-10-10T14:37:22.801938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0] Write session: Do CDS request
2025-10-10T14:37:22.801944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:22.801544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2321 reason: error at write: Disconnected sessionId: src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0
2025-10-10T14:37:22.801735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:22.801762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2321 sessionId: src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0 is DEAD
2025-10-10T14:37:22.811902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.813220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:22.813241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2322
2025-10-10T14:37:22.813448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:22.813478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:22.813484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:22.813489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:22.813903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2322 sessionId:  describe result for acl check
2025-10-10T14:37:22.813933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:22.813935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:22.813937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:22.813943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602185167448800:5170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:22.814537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602185167448800:5170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:22.818003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602185167448800:5170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:22.822194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:22.826213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:22.826499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:22.826520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:22.826532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:22.826596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:22.826641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602184385217509:10516]
2025-10-10T14:37:22.828892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602185167448800:5170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:22.828920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602185167448800:5170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:22.828924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602185167448800:5170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:22.828943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:22.827428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:22.827960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:22.828022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:22.828366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:22.828434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.828435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.828436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.828438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.828439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.828440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.828442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.828443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.828445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.828446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.828448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.828449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.828451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.828458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.828470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.828474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.828479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.828482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.828486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.828490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.828494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.828497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.828501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.828505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.828509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.828513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.828521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.828530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:22.828538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.828545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:22.828550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.828556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:22.828561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.828566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:22.828572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.828577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:22.828582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.828588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:22.828607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.828612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:22.828617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.828623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:22.828629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.828634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:22.828639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.828645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:22.828661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.828666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.828673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.828678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.828683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.828689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.828728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:22.833970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:22.834526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:22.834532Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:22.834535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:22.834539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:22.834547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2321 [2:7559602184385217509:10516]
2025-10-10T14:37:22.834563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:22.834584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:22.834589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.834594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.834597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.834617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:22.834626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:22.834636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:22.834709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.834712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.834715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.834718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:22.834798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:22.834964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2321
2025-10-10T14:37:22.834992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2321
2025-10-10T14:37:22.834801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.834816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:22.834830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:22.834850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:22.834875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448741:2438], now have 1 active actors on pipe
2025-10-10T14:37:22.834886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602184385217504:10516]
2025-10-10T14:37:22.834889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602184385217504:10516]
2025-10-10T14:37:22.834892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602184385217504:10516]
2025-10-10T14:37:22.834907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:22.834923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:22.834941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:22.834944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:22.834952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448896:5170], now have 1 active actors on pipe
2025-10-10T14:37:22.834990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602184385217504:10516]
2025-10-10T14:37:22.834993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:22.835059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:22.835063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:22.835067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:22.835075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:22.835377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.835391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.835427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:22.835441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:22.835445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:22.835448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:22.835462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:22.835475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:22.835496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.836102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.836121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.836154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:22.836312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2322 partition: 0 MaxSeqNo: 40 sessionId: src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0
2025-10-10T14:37:22.836778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151b37f2-2383fcd5-1d3ca4fa-f425d144_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:22.839863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0] Write session: try to update token
2025-10-10T14:37:22.839888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:22.858254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId: src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:22.860686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:22.860709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:22.860712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:22.860715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:22.860726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602184385217504:10516]
2025-10-10T14:37:22.860731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602184385217504:10516]
2025-10-10T14:37:22.860735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602184385217504:10516]
2025-10-10T14:37:22.860788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:22.860800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:22.860802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:22.860804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:22.860809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:22.860814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:22.860949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:22.861121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:22.901756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602185167448905:4939]
2025-10-10T14:37:22.902758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2321, pipe: [1:7559602185167448905:4939]
2025-10-10T14:37:22.986822Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:22.987159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:22.987171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:22.987221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448905:4939], now have 1 active actors on pipe
2025-10-10T14:37:22.988045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602185167448905:4939]
2025-10-10T14:37:22.988110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:22.988114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:22.988201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2322 reason: error at write: Disconnected sessionId: src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0
2025-10-10T14:37:22.988290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:22.988580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2322 sessionId: src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0 is DEAD
2025-10-10T14:37:22.988049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:22.989028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:22.989042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0] Write session will restart in 0.009875s
2025-10-10T14:37:22.989068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0] Write session: Do CDS request
2025-10-10T14:37:22.989078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:22.999966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.005594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:23.005613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2323
2025-10-10T14:37:23.005873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.005911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:23.005916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:23.005920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:23.009824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2323 sessionId:  describe result for acl check
2025-10-10T14:37:23.009889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:23.009891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:23.009894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:23.009904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602189462416269:5184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:23.010549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602189462416269:5184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:23.014028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602189462416269:5184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:23.016188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:23.023043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:23.023280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602189462416269:5184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:23.023305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602189462416269:5184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:23.023311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602189462416269:5184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:23.023321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:23.023330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:23.023360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:23.023375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:23.023448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:23.023497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602188680184966:10518]
2025-10-10T14:37:23.024156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:23.024588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:23.024664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:23.025115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:23.025219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.025231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.025232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.025234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.025235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.025237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.025239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.025240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.025241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.025243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.025245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.025246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.025248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.025255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.025268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.025273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.025277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.025282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.025287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.025291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.025295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.025299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.025304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.025308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.025313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.025317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.025326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.025353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.025360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.025366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.025371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.025377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.025388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.025393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.025399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.025407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.025416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.025422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.025427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.025432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.025437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.025443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.025448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.025453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.025458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.025464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.025469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.025477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.025481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.025487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.025497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.025503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.025539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:23.028526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:23.029155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:23.029167Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:23.029169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:23.029172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:23.029178Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2322 [2:7559602188680184966:10518]
2025-10-10T14:37:23.029190Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:23.029205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:23.029208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.029210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.029212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.029231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:23.029244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:23.029252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:23.029305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.029311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.029313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.029315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:23.029404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:23.029414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.029425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.029436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.029453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:23.029477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602185167448910:2438], now have 1 active actors on pipe
2025-10-10T14:37:23.029480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416357:5184], now have 1 active actors on pipe
2025-10-10T14:37:23.029488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602188680184961:10518]
2025-10-10T14:37:23.029491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602188680184961:10518]
2025-10-10T14:37:23.029493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602188680184961:10518]
2025-10-10T14:37:23.029511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:23.029525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:23.029530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:23.029530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:23.029532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:23.029545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:23.029549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:23.029581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602188680184961:10518]
2025-10-10T14:37:23.029592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:23.029598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:23.029607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2322
2025-10-10T14:37:23.029665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2322
2025-10-10T14:37:23.029792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.029805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.029839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:23.029852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.029857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.029860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:23.029873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.029887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:23.029904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.030405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2323 partition: 0 MaxSeqNo: 40 sessionId: src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0
2025-10-10T14:37:23.030242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.030255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.030292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.030854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23a85a70-ad3c20dd-48a0f64c-bd767685_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:23.033892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0] Write session: try to update token
2025-10-10T14:37:23.033914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:23.051337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId: src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:23.052800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:23.052823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:23.052828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:23.052830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:23.052840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602188680184961:10518]
2025-10-10T14:37:23.052845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602188680184961:10518]
2025-10-10T14:37:23.052850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602188680184961:10518]
2025-10-10T14:37:23.052896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:23.052901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:23.052905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:23.052906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:23.052913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.052917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:23.053073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:23.054104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:23.088105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602189462416368:4939]
2025-10-10T14:37:23.089417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2322, pipe: [1:7559602189462416368:4939]
2025-10-10T14:37:23.173190Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:23.173514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.173532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.173582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416368:4939], now have 1 active actors on pipe
2025-10-10T14:37:23.174308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:23.175644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:23.175706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602189462416368:4939]
2025-10-10T14:37:23.175729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:23.175801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2323 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0
2025-10-10T14:37:23.175998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2323 sessionId: src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0 is DEAD
2025-10-10T14:37:23.179074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:23.179088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0] Write session will restart in 0.006344s
2025-10-10T14:37:23.179115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0] Write session: Do CDS request
2025-10-10T14:37:23.179122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:23.190050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.191147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:23.191170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2324
2025-10-10T14:37:23.193349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.193412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:23.193423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:23.193429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:23.194108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2324 sessionId:  describe result for acl check
2025-10-10T14:37:23.194166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:23.194171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:23.194174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:23.194180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602189462416435:5186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:23.195170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602189462416435:5186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:23.200697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602189462416435:5186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:23.203239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:23.205833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:23.205993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602189462416435:5186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:23.206012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602189462416435:5186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:23.206016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602189462416435:5186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:23.206027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:23.206118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:23.206131Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:23.206144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:23.206219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:23.206264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602188680185142:10522]
2025-10-10T14:37:23.206890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:23.207322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:23.207386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:23.207747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:23.207834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.207841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.207842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.207844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.207845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.207847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.207848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.207849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.207851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.207852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.207854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.207855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.207857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.207864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.207879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.207883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.207887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.207892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.207896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.207916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.207919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.207923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.207929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.207933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.207937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.207941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.207950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.207959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.207966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.207971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.207976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.207982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.207987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.207992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.207997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.208002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.208008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.208013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.208020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.208033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.208038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.208043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.208048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.208054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.208059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.208064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.208069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.208088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.208097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.208103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.208108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.208113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.208156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:23.210892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:23.211463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:23.211477Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:23.211480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:23.211485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:23.211491Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2323 [2:7559602188680185142:10522]
2025-10-10T14:37:23.211506Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:23.211537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:23.211542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.211546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.211549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.211568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:23.211583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:23.211592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:23.211670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.211678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.211682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.211685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:23.211759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:23.211768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.211780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.211794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.211812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:23.211841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416371:2438], now have 1 active actors on pipe
2025-10-10T14:37:23.211844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416536:5186], now have 1 active actors on pipe
2025-10-10T14:37:23.211853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602188680185137:10522]
2025-10-10T14:37:23.211860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602188680185137:10522]
2025-10-10T14:37:23.211862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602188680185137:10522]
2025-10-10T14:37:23.211876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:23.211890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:23.211894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:23.211899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:23.211902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:23.211910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:23.211914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:23.211948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602188680185137:10522]
2025-10-10T14:37:23.211957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:23.211885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2323
2025-10-10T14:37:23.211935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2323
2025-10-10T14:37:23.212489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2324 partition: 0 MaxSeqNo: 40 sessionId: src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0
2025-10-10T14:37:23.211968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:23.211991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.211996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.212039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:23.212050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.212054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.212056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:23.212068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.212079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:23.212097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.212375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.212382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.212406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.212972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a098c228-bd8ec275-69c3d160-80a47cf1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:23.216255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0] Write session: try to update token
2025-10-10T14:37:23.216277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:23.236909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:23.236934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:23.236938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:23.236941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:23.236951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602188680185137:10522]
2025-10-10T14:37:23.236955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602188680185137:10522]
2025-10-10T14:37:23.236960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602188680185137:10522]
2025-10-10T14:37:23.237019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:23.237027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.237034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:23.237185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:23.241477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:23.241499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:23.241504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:23.246624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId: src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:23.249401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:23.276024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602189462416548:4939]
2025-10-10T14:37:23.276361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2323, pipe: [1:7559602189462416548:4939]
2025-10-10T14:37:23.356659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:23.356713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602189462416548:4939]
2025-10-10T14:37:23.356735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:23.356738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:23.356809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2324 reason: error at write: Disconnected sessionId: src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0
2025-10-10T14:37:23.355888Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:23.356236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.356251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.356315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416548:4939], now have 1 active actors on pipe
2025-10-10T14:37:23.357049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2324 sessionId: src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0 is DEAD
2025-10-10T14:37:23.357422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:23.357434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0] Write session will restart in 0.007911s
2025-10-10T14:37:23.357462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0] Write session: Do CDS request
2025-10-10T14:37:23.357469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:23.357323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:23.369705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.370083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:23.370101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2325
2025-10-10T14:37:23.370279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.370336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:23.370347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:23.370357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:23.370811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2325 sessionId:  describe result for acl check
2025-10-10T14:37:23.370854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:23.370865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:23.370867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:23.370876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602189462416565:5201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:23.371495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602189462416565:5201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:23.374031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602189462416565:5201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:23.380179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602189462416565:5201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:23.380202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602189462416565:5201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:23.380206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602189462416565:5201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:23.380216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:23.384496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:23.387369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:23.387647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:23.387660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:23.387674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:23.387734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:23.387784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602188680185306:10524]
2025-10-10T14:37:23.388456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:23.388836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:23.388909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:23.389264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:23.389347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.389353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.389355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.389356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.389357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.389359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.389361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.389362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.389364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.389365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.389367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.389368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.389369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.389377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.389391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.389395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.389400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.389404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.389408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.389411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.389415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.389418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.389422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.389426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.389429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.389433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.389442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.389453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.389460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.389466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.389470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.389475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.389480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.389485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.389491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.389496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.389501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.389507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.389512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.389518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.389523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.389529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.389534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.389541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.389546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.389551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.389556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.389561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.389567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.389572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.389578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.389595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.389634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:23.395360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2324
2025-10-10T14:37:23.395421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2324
2025-10-10T14:37:23.394056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:23.394466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:23.394471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:23.394476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:23.394480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:23.394489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2324 [2:7559602188680185306:10524]
2025-10-10T14:37:23.394505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:23.394528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:23.394532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.394537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.394540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.394559Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:23.394567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:23.394576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:23.394651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.394653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.394656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.394659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:23.394753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:23.394756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.394773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.394787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.394806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:23.394830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602188680185301:10524]
2025-10-10T14:37:23.394833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602188680185301:10524]
2025-10-10T14:37:23.394836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602188680185301:10524]
2025-10-10T14:37:23.394850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:23.394868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:23.394886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:23.394891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:23.394935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602188680185301:10524]
2025-10-10T14:37:23.394939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:23.395282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:23.395284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:23.395290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:23.395297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:23.395807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416550:2438], now have 1 active actors on pipe
2025-10-10T14:37:23.395818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416659:5201], now have 1 active actors on pipe
2025-10-10T14:37:23.395840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.395846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.395881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:23.395892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.395898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.395902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:23.395918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.395933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:23.395952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.397843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.397859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.397891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.401063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2325 partition: 0 MaxSeqNo: 40 sessionId: src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0
2025-10-10T14:37:23.401543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c17e14-96c48396-c483b6ec-1aeb8d8e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:23.404543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0] Write session: try to update token
2025-10-10T14:37:23.404570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:23.427181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId: src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:23.425767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:23.425788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:23.425802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:23.425804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:23.425817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602188680185301:10524]
2025-10-10T14:37:23.425822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602188680185301:10524]
2025-10-10T14:37:23.425826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602188680185301:10524]
2025-10-10T14:37:23.425888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:23.425897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.425900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:23.425901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:23.425910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:23.425915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:23.426053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:23.430149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:23.456736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602189462416717:4939]
2025-10-10T14:37:23.457132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2324, pipe: [1:7559602189462416717:4939]
2025-10-10T14:37:23.541271Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:23.541908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.541925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.541975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416717:4939], now have 1 active actors on pipe
2025-10-10T14:37:23.542264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:23.542385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:23.542418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:23.542423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:23.542465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602189462416717:4939]
2025-10-10T14:37:23.542489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2325 reason: error at write: Disconnected sessionId: src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0
2025-10-10T14:37:23.542704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2325 sessionId: src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0 is DEAD
2025-10-10T14:37:23.542884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:23.542892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0] Write session will restart in 0.008214s
2025-10-10T14:37:23.542918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0] Write session: Do CDS request
2025-10-10T14:37:23.542928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:23.553034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.553037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:23.553056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2326
2025-10-10T14:37:23.553246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.553286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:23.553306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:23.553315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:23.553813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2326 sessionId:  describe result for acl check
2025-10-10T14:37:23.553852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:23.553859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:23.553862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:23.553868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602189462416735:5203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:23.554471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602189462416735:5203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:23.557264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602189462416735:5203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:23.562168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602189462416735:5203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:23.562190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602189462416735:5203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:23.562194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602189462416735:5203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:23.562204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:23.566746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:23.572268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:23.572554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:23.572571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:23.572585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:23.572661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:23.572714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602188680185470:10526]
2025-10-10T14:37:23.573406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:23.573888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:23.573954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:23.574303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:23.574389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.574396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.574398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.574399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.574401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.574403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.574404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.574406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.574408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.574409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.574411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.574412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.574413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.574420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.574436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.574442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.574447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.574452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.574457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.574461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.574466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.574471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.574476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.574481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.574486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.574491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.574500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.574510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.574523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.574530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.574553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.574566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.574571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.574578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.574592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.574602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.574608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.574619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.574625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.574637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.574642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.574652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.574659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.574669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.574673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.574679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.574684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.574695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.574700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.574710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.574715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.574721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.574767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:23.577733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:23.578148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:23.578164Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:23.578167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:23.578172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:23.578179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2325 [2:7559602188680185470:10526]
2025-10-10T14:37:23.578195Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:23.578225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:23.578233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.578237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.578240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.578259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:23.578272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:23.578289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:23.578359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.578368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.578371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.578374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:23.578452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:23.578461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.578474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.578491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.578513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:23.578542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602188680185464:10526]
2025-10-10T14:37:23.578549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602188680185464:10526]
2025-10-10T14:37:23.578552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602188680185464:10526]
2025-10-10T14:37:23.578566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:23.578585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:23.578608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:23.578616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:23.578646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602188680185464:10526]
2025-10-10T14:37:23.578653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:23.578753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:23.578762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:23.578765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:23.578771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:23.579148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2325
2025-10-10T14:37:23.579184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2325
2025-10-10T14:37:23.579470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416852:5203], now have 1 active actors on pipe
2025-10-10T14:37:23.579483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416720:2438], now have 1 active actors on pipe
2025-10-10T14:37:23.579499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.579505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.579541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:23.579556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.579565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.579569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:23.579581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.579601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:23.579623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.579915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.579927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.579946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.580071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2326 partition: 0 MaxSeqNo: 40 sessionId: src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0
2025-10-10T14:37:23.580502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5bcd79-7d0db658-3a42d264-85c9240_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:23.583487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0] Write session: try to update token
2025-10-10T14:37:23.583509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:23.598665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId: src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:23.601429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:23.603218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.603248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.603275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:23.603278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:23.603282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:23.603284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:23.603294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602188680185464:10526]
2025-10-10T14:37:23.603299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602188680185464:10526]
2025-10-10T14:37:23.603303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602188680185464:10526]
2025-10-10T14:37:23.603366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:23.603373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:23.603378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:23.603386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:23.603394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.603397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:23.603535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:23.645419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602189462416887:4939]
2025-10-10T14:37:23.648564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2325, pipe: [1:7559602189462416887:4939]
2025-10-10T14:37:23.739714Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:23.740214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:23.740268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416887:4939], now have 1 active actors on pipe
2025-10-10T14:37:23.741345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:23.741442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:23.741446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:23.741523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2326 reason: error at write: Disconnected sessionId: src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0
2025-10-10T14:37:23.741679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2326 sessionId: src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0 is DEAD
2025-10-10T14:37:23.741879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602189462416887:4939]
2025-10-10T14:37:23.741894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:23.742239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:23.742260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0] Write session will restart in 0.007574s
2025-10-10T14:37:23.742287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0] Write session: Do CDS request
2025-10-10T14:37:23.742293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:23.750862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.751463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:23.751481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2327
2025-10-10T14:37:23.751779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.751823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:23.751830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:23.751833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:23.752524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2327 sessionId:  describe result for acl check
2025-10-10T14:37:23.752561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:23.752564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:23.752566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:23.752573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602189462416924:8190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:23.753152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602189462416924:8190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:23.758953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602189462416924:8190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:23.768864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602189462416924:8190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:23.768888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602189462416924:8190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:23.768892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602189462416924:8190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:23.768903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:23.769158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:23.772663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:23.772906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:23.772912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:23.772925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:23.772987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:23.773029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602188680185666:10539]
2025-10-10T14:37:23.773727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:23.774283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:23.774330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:23.774668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:23.774726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.774727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.774728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.774730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.774731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.774733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.774734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.774736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.774737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.774739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.774740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.774742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.774743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.774751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.774766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.774771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.774776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.774780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.774785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.774789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.774793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.774797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.774803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.774807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.774812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.774816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.774823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.774833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.774840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.774847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.774853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.774859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.774863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.774870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.774875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.774881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.774886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.774892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.774898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.774904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.774910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.774915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.774920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.774926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.774931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.774936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.774941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.774947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.774952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.774957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.774962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.774968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.775012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:23.779128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2326
2025-10-10T14:37:23.779172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2326
2025-10-10T14:37:23.778036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:23.778618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:23.778623Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:23.778626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:23.778630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:23.778636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2326 [2:7559602188680185666:10539]
2025-10-10T14:37:23.778650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:23.778669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:23.778673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.778676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.778679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.778698Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:23.778706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:23.778715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:23.778778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.778780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.778783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.778786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:23.778860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:23.778863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.778876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.778889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.778908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:23.778931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602188680185659:10539]
2025-10-10T14:37:23.778933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602188680185659:10539]
2025-10-10T14:37:23.778935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602188680185659:10539]
2025-10-10T14:37:23.778952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:23.778966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462417062:8190], now have 1 active actors on pipe
2025-10-10T14:37:23.778970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462416896:2438], now have 1 active actors on pipe
2025-10-10T14:37:23.778979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:23.778981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:23.778985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:23.778987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:23.778996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:23.778999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:23.779031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602188680185659:10539]
2025-10-10T14:37:23.779039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:23.779287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:23.779442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.779448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.779483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:23.779493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.779496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.779499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:23.779512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.779523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:23.779539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.780301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.780319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.780345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.783596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37528b3c-3cb948bb-be70283c-8b5ebb73_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:23.782206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2327 partition: 0 MaxSeqNo: 40 sessionId: src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0
2025-10-10T14:37:23.786338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0] Write session: try to update token
2025-10-10T14:37:23.786356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:23.795461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:23.795479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:23.795487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602188680185659:10539]
2025-10-10T14:37:23.795533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:23.795718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:23.795886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:23.796039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:23.796202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:23.796419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:23.796470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:23.796547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:23.806949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId: src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:23.810296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:23.810790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:23.810570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.810592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.810637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:23.815252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:23.815272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:23.815276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:23.815278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:23.815290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602188680185659:10539]
2025-10-10T14:37:23.815294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602188680185659:10539]
2025-10-10T14:37:23.815298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602188680185659:10539]
2025-10-10T14:37:23.815359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:23.815366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:23.815373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.815376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:23.815377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:23.815382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:23.815523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:23.842288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602189462417093:4939]
2025-10-10T14:37:23.842582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2326, pipe: [1:7559602189462417093:4939]
2025-10-10T14:37:23.938784Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:23.939068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462417093:4939], now have 1 active actors on pipe
2025-10-10T14:37:23.947512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.947539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.947721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.947786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.947858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.947940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.947985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.947990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.948073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.948144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.948220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.948294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.948343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.948346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.948429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.948495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.948570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.948641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.948687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.948690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.948768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.948856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.948926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.949000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.949046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.949049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.949131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.949201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.949272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.949509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.949568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.949582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.949662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.949738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.949817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.949897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.949950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.949959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.950037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.950111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.951683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:23.951683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602189462417093:4939]
2025-10-10T14:37:23.951706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:23.951741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2327 reason: error at write: Disconnected sessionId: src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0
2025-10-10T14:37:23.951964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2327 sessionId: src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0 is DEAD
2025-10-10T14:37:23.952226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:23.952706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:23.952720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0] Write session will restart in 0.006320s
2025-10-10T14:37:23.952748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0] Write session: Do CDS request
2025-10-10T14:37:23.952756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:23.950192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.950275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.950322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.950325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.950411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.950472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.950544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.950613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.950664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.950667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.950747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.950814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.950880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.950953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.951000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.951005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.951088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:23.951148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:23.951219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:23.951295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:23.951360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:23.951363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:23.952827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:23.959958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.960098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:23.960122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2328
2025-10-10T14:37:23.960313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:23.960348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:23.960359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:23.960368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:23.960862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2328 sessionId:  describe result for acl check
2025-10-10T14:37:23.960904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:23.960906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:23.960911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:23.960917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602189462417111:8175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:23.961551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602189462417111:8175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:23.964320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602189462417111:8175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:23.968397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602189462417111:8175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:23.968418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602189462417111:8175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:23.968422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602189462417111:8175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:23.968432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:23.971771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:23.974381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:23.974694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:23.974707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:23.974721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:23.974806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:23.974854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602188680185841:10543]
2025-10-10T14:37:23.975517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:23.975907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:23.975997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:23.976385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:23.976453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.976460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.976462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.976463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.976465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.976466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.976468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.976469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.976470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.976472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.976474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.976475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.976477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.976494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.976509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.976514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.976519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.976524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.976528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.976534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.976539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.976543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.976551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.976561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.976566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.976570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.976579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.976589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:23.976601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.976607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:23.976613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.976619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:23.976624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.976636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:23.976641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.976651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:23.976656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.976667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:23.976673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.976683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:23.976689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.976701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:23.976706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.976718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:23.976723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.976729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:23.976739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.976745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.976755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.976761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.976770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.976776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.976830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:23.979799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:23.980266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:23.980281Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:23.980284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:23.980289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:23.980297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2327 [2:7559602188680185841:10543]
2025-10-10T14:37:23.980314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:23.980334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:23.980354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.980358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.980361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.980380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:23.980388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:23.980396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:23.980468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.980476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.980478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.980481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:23.980562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:23.980572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:23.980584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:23.980602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:23.980625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:23.980655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462417239:8175], now have 1 active actors on pipe
2025-10-10T14:37:23.980664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602189462417098:2438], now have 1 active actors on pipe
2025-10-10T14:37:23.980672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602188680185836:10543]
2025-10-10T14:37:23.980680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602188680185836:10543]
2025-10-10T14:37:23.980683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602188680185836:10543]
2025-10-10T14:37:23.980699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:23.980721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:23.980742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:23.980730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2327
2025-10-10T14:37:23.980748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:23.980730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2327
2025-10-10T14:37:23.980786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:23.980789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602188680185836:10543]
2025-10-10T14:37:23.980793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:23.980805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:23.980808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:23.980816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:23.980873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.980879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.980915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|684edddf-322cb88a-537c65fc-23e5fe45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:23.980923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:23.980927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:23.980930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:23.980944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:23.980955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:23.980973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.981605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:23.981619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:23.981641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:23.981748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2328 partition: 0 MaxSeqNo: 40 sessionId: src_id|684edddf-322cb88a-537c65fc-23e5fe45_0
2025-10-10T14:37:23.982221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80a615f6-15bc200b-ec27c54a-985efdc2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|684edddf-322cb88a-537c65fc-23e5fe45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:23.985107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684edddf-322cb88a-537c65fc-23e5fe45_0] Write session: try to update token
2025-10-10T14:37:23.985128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684edddf-322cb88a-537c65fc-23e5fe45_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:23.997728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:23.997754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:23.997768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602188680185836:10543]
2025-10-10T14:37:23.997827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:23.998018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:23.998161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:23.998383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:23.998572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:23.998772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:23.998810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:23.998901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:24.007495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId: src_id|684edddf-322cb88a-537c65fc-23e5fe45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:24.010853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:24.011596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.011632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.013545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:24.013584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:24.013587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:24.013591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:24.013593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:24.013607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602188680185836:10543]
2025-10-10T14:37:24.013611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602188680185836:10543]
2025-10-10T14:37:24.013615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602188680185836:10543]
2025-10-10T14:37:24.013661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:24.013677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.013679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:24.013683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:24.013688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:24.013710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:24.013750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:24.013817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:24.051698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602193757384561:4939]
2025-10-10T14:37:24.052034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2327, pipe: [1:7559602193757384561:4939]
2025-10-10T14:37:24.131453Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:24.141227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.141264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.141484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.141568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.141646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.141717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.141770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.141775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.141859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.141931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.142000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.142071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.142114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.142117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.142193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.142265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.142336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.142414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.142467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.142471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.142555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.142631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.142702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.142781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.142828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.142832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.142911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.142982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.143059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.143140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.143415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.143419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.143507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.143576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.143642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.143707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.143754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.143757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.143838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.143902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.143977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.144040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.144085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.144088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.144166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.144226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.144294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.144370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.144415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.144418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.144493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.144550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.144618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.144687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.144759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.144763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.144838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:24.144906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:24.144973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:24.145030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:24.145071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:24.145093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:24.145162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757384561:4939], now have 1 active actors on pipe
2025-10-10T14:37:24.145522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:24.145549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:24.145547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:24.145580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2328 reason: error at write: Disconnected sessionId: src_id|684edddf-322cb88a-537c65fc-23e5fe45_0
2025-10-10T14:37:24.145829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:24.145885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602193757384561:4939]
2025-10-10T14:37:24.145889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2328 sessionId: src_id|684edddf-322cb88a-537c65fc-23e5fe45_0 is DEAD
2025-10-10T14:37:24.146091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684edddf-322cb88a-537c65fc-23e5fe45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:24.146105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684edddf-322cb88a-537c65fc-23e5fe45_0] Write session will restart in 0.005707s
2025-10-10T14:37:24.146132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684edddf-322cb88a-537c65fc-23e5fe45_0] Write session: Do CDS request
2025-10-10T14:37:24.146139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684edddf-322cb88a-537c65fc-23e5fe45_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:24.155954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|684edddf-322cb88a-537c65fc-23e5fe45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:24.157458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:24.157481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2329
2025-10-10T14:37:24.157827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:24.157873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:24.157885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:24.157890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:24.159250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2329 sessionId:  describe result for acl check
2025-10-10T14:37:24.159297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:24.159306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:24.159309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:24.159316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602193757384603:8171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:24.160001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602193757384603:8171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:24.173489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602193757384603:8171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:24.176321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:24.176779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:24.176976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:24.176982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:24.176992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:24.177040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:24.177091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602192975153317:10547]
2025-10-10T14:37:24.177841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:24.181240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:24.181316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:24.181746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:24.181835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.181837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.181839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.181841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.181842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.181844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.181846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.181849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.181850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.181852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.181855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.181856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.181858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.181865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.181895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.181901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.181905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.181910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.181915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.181920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.181925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.181931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.181939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.181944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.181949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.181954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.181965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.181975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.181982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.181989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.181994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.182001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.182007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.182015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.182021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.182028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.182034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.182040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.182046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.182053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.182058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.182064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.182070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.182077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.182083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.182089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.182095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.182102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.182108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.182114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.182120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.182127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.182171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:24.183739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602193757384603:8171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:24.183762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602193757384603:8171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:24.183766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602193757384603:8171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:24.183777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:24.185406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:24.186236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:24.186242Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:24.186246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:24.186251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:24.186258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2328 [2:7559602192975153317:10547]
2025-10-10T14:37:24.186277Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:24.186295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:24.186299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:24.186303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:24.186306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:24.186323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:24.186332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:24.186339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:24.186414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.186417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.186419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.186422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:24.186510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:24.186513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.186527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.186541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.186561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:24.186579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602192975153312:10547]
2025-10-10T14:37:24.186582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602192975153312:10547]
2025-10-10T14:37:24.186585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602192975153312:10547]
2025-10-10T14:37:24.186599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:24.186613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:24.186630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:24.186634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:24.186662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602192975153312:10547]
2025-10-10T14:37:24.186665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:24.187017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:24.187025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:24.187028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:24.187034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:24.187407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2328
2025-10-10T14:37:24.187407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2328
2025-10-10T14:37:24.187333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757384727:8171], now have 1 active actors on pipe
2025-10-10T14:37:24.187362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757384563:2438], now have 1 active actors on pipe
2025-10-10T14:37:24.188095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.188119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.188160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:24.188180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:24.188193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:24.188197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:24.188214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:24.188234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:24.188255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:24.188551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.188564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.188594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:24.188767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2329 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0
2025-10-10T14:37:24.189557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|684edddf-322cb88a-537c65fc-23e5fe45_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:24.192388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0] Write session: try to update token
2025-10-10T14:37:24.192408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:24.211824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:24.211846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:24.211849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:24.211851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:24.211862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602192975153312:10547]
2025-10-10T14:37:24.211866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602192975153312:10547]
2025-10-10T14:37:24.211870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602192975153312:10547]
2025-10-10T14:37:24.211926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:24.211935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.211938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:24.212089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:24.212852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:24.212859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:24.212863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:24.211431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId: src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:24.214151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:24.246259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602193757384746:4939]
2025-10-10T14:37:24.246746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2328, pipe: [1:7559602193757384746:4939]
2025-10-10T14:37:24.349160Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:24.349700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.349714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.349760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757384746:4939], now have 1 active actors on pipe
2025-10-10T14:37:24.350243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:24.350544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:24.350571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:24.350655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2329 reason: error at write: Disconnected sessionId: src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0
2025-10-10T14:37:24.350954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2329 sessionId: src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0 is DEAD
2025-10-10T14:37:24.351121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602193757384746:4939]
2025-10-10T14:37:24.351136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:24.353732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:24.353744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0] Write session will restart in 0.008182s
2025-10-10T14:37:24.353773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0] Write session: Do CDS request
2025-10-10T14:37:24.353781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:24.363828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:24.365685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:24.365715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2330
2025-10-10T14:37:24.370503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:24.370597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:24.370604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:24.370610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:24.371291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2330 sessionId:  describe result for acl check
2025-10-10T14:37:24.371336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:24.371341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:24.371344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:24.371350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602193757384846:8159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:24.372061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602193757384846:8159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:24.378155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602193757384846:8159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:24.384243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:24.387726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602193757384846:8159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:24.387747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602193757384846:8159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:24.387751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602193757384846:8159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:24.387762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:24.385156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:24.385383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:24.385388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:24.385403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:24.385458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:24.385498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602192975153485:10549]
2025-10-10T14:37:24.386230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:24.388386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:24.388449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:24.388831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:24.388882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.388883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.388884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.388886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.388887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.388889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.388890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.388892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.388893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.388895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.388896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.388898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.388899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.388908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.388922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.388927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.388932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.388936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.388941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.388946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.388950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.388954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.388960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.388964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.388968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.388973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.388982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.388992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.389000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.389006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.389011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.389017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.389022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.389027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.389033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.389039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.389044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.389050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.389056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.389062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.389066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.389072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.389077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.389084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.389089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.389095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.389100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.389106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.389111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.389117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.389122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.389128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.389179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:24.392379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:24.392725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:24.392730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:24.392734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:24.392739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:24.392746Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2329 [2:7559602192975153485:10549]
2025-10-10T14:37:24.392761Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:24.392782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:24.392786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:24.392791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:24.392794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:24.392814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:24.392823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:24.392832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:24.392895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.392897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.392900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.392903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:24.392977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:24.392980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.392993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.393006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.393026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:24.393048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602192975153480:10549]
2025-10-10T14:37:24.393051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602192975153480:10549]
2025-10-10T14:37:24.393053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602192975153480:10549]
2025-10-10T14:37:24.393068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:24.393084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:24.393101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:24.393105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:24.393143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602192975153480:10549]
2025-10-10T14:37:24.393146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:24.393235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:24.393237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:24.393240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:24.393245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:24.393968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2329
2025-10-10T14:37:24.394002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2329
2025-10-10T14:37:24.398445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757384910:8159], now have 1 active actors on pipe
2025-10-10T14:37:24.398466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757384751:2438], now have 1 active actors on pipe
2025-10-10T14:37:24.398492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.398501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.398547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:24.398561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:24.398569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:24.398572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:24.398591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:24.398612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:24.398635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:24.402360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2330 partition: 0 MaxSeqNo: 40 sessionId: src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0
2025-10-10T14:37:24.402142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.402163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.402206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:24.405648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e93c614-c5d85343-4f1c1630-5fc87bcc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:24.408405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0] Write session: try to update token
2025-10-10T14:37:24.408430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:24.418766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:24.418789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:24.418793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:24.418796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:24.418806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602192975153480:10549]
2025-10-10T14:37:24.418811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602192975153480:10549]
2025-10-10T14:37:24.418816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602192975153480:10549]
2025-10-10T14:37:24.418873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:24.418879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:24.418883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.418885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:24.418886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:24.418891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:24.419030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:24.443359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId: src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:24.446648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:24.454022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602193757384920:4939]
2025-10-10T14:37:24.454617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2329, pipe: [1:7559602193757384920:4939]
2025-10-10T14:37:24.575952Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:24.576406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.576415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.576439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757384920:4939], now have 1 active actors on pipe
2025-10-10T14:37:24.576963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:24.577488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:24.577514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:24.577599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2330 reason: error at write: Disconnected sessionId: src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0
2025-10-10T14:37:24.577797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2330 sessionId: src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0 is DEAD
2025-10-10T14:37:24.577802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602193757384920:4939]
2025-10-10T14:37:24.577832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:24.578240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:24.578250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0] Write session will restart in 0.008597s
2025-10-10T14:37:24.578277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0] Write session: Do CDS request
2025-10-10T14:37:24.578288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:24.589888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:24.590089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:24.590112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2331
2025-10-10T14:37:24.590436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:24.590477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:24.590493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:24.590498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:24.591208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2331 sessionId:  describe result for acl check
2025-10-10T14:37:24.591256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:24.591263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:24.591266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:24.591273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602193757384943:8156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:24.591951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602193757384943:8156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:24.598471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602193757384943:8156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:24.616157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602193757384943:8156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:24.616184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602193757384943:8156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:24.616188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602193757384943:8156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:24.616199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:24.617830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:24.618378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:24.618580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:24.618586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:24.618598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:24.618646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:24.618689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602192975153655:10551]
2025-10-10T14:37:24.619414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:24.620179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:24.620231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:24.620697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:24.620751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.620752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.620753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.620755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.620756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.620758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.620759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.620761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.620762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.620763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.620765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.620767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.620768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.620775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.620789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.620793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.620797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.620802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.620807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.620812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.620817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.620821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.620826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.620830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.620835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.620839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.620848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.620859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.620866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.620873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.620878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.620883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.620889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.620895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.620900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.620906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.620911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.620917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.620922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.620928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.620933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.620939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.620946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.620952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.620957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.620962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.620967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.620972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.620977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.620983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.620988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.620994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.621039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:24.624036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:24.624445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:24.624451Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:24.624453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:24.624458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:24.624465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2330 [2:7559602192975153655:10551]
2025-10-10T14:37:24.624483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:24.624504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:24.624509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:24.624513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:24.624515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:24.624553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:24.624561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:24.624571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:24.624638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.624641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.624643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.624645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:24.624719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:24.624722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.624736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.624749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.624769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:24.624791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602192975153650:10551]
2025-10-10T14:37:24.624794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602192975153650:10551]
2025-10-10T14:37:24.624796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602192975153650:10551]
2025-10-10T14:37:24.624811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:24.624827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:24.624843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:24.624847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:24.624892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602192975153650:10551]
2025-10-10T14:37:24.624895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:24.625171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:24.625178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:24.625181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:24.625187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:24.625493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2330
2025-10-10T14:37:24.625570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757384927:2438], now have 1 active actors on pipe
2025-10-10T14:37:24.629457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757385086:8156], now have 1 active actors on pipe
2025-10-10T14:37:24.629608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2330
2025-10-10T14:37:24.631746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.631766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.631807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|593a520f-88c07cba-8df7386f-3d2c4443_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:24.631823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:24.631829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:24.631833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:24.631850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:24.631873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:24.631896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:24.641692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.641715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.641761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:24.649656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2331 partition: 0 MaxSeqNo: 40 sessionId: src_id|593a520f-88c07cba-8df7386f-3d2c4443_0
2025-10-10T14:37:24.652845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b6ba5cf-7c80d2e3-7e51f79b-a344a714_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|593a520f-88c07cba-8df7386f-3d2c4443_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:24.653077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:24.653098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:24.653101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:24.653104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:24.653115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602192975153650:10551]
2025-10-10T14:37:24.653120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602192975153650:10551]
2025-10-10T14:37:24.653124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602192975153650:10551]
2025-10-10T14:37:24.653181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:24.653187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:24.653190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.653192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:24.653193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:24.653198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:24.656630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|593a520f-88c07cba-8df7386f-3d2c4443_0] Write session: try to update token
2025-10-10T14:37:24.656659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|593a520f-88c07cba-8df7386f-3d2c4443_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:24.653365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:24.677959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602193757385103:4939]
2025-10-10T14:37:24.678624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2330, pipe: [1:7559602193757385103:4939]
2025-10-10T14:37:24.682843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId: src_id|593a520f-88c07cba-8df7386f-3d2c4443_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:24.685593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:24.788926Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:24.789569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757385103:4939], now have 1 active actors on pipe
2025-10-10T14:37:24.789633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.789641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.789933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:24.790098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:24.790177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:24.790198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2331 reason: status is not ok: tablet will be restarted right now sessionId: src_id|593a520f-88c07cba-8df7386f-3d2c4443_0
2025-10-10T14:37:24.790595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|593a520f-88c07cba-8df7386f-3d2c4443_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:24.790614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|593a520f-88c07cba-8df7386f-3d2c4443_0] Write session will restart in 0.007299s
2025-10-10T14:37:24.790642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|593a520f-88c07cba-8df7386f-3d2c4443_0] Write session: Do CDS request
2025-10-10T14:37:24.790648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|593a520f-88c07cba-8df7386f-3d2c4443_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:24.790412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2331 sessionId: src_id|593a520f-88c07cba-8df7386f-3d2c4443_0 is DEAD
2025-10-10T14:37:24.790572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602193757385103:4939]
2025-10-10T14:37:24.799015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|593a520f-88c07cba-8df7386f-3d2c4443_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:24.801681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:24.801700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2332
2025-10-10T14:37:24.805468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:24.805529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:24.805535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:24.805540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:24.805995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2332 sessionId:  describe result for acl check
2025-10-10T14:37:24.806028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:24.806030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:24.806031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:24.806039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602193757385150:8150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:24.806642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602193757385150:8150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:24.810144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602193757385150:8150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:24.815611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602193757385150:8150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:24.815632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602193757385150:8150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:24.815636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602193757385150:8150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:24.815647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:24.823838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:24.827188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:24.827504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:24.827516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:24.827530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:24.827594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:24.827648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602192975153859:10564]
2025-10-10T14:37:24.828362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:24.828766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:24.828819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:24.829197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:24.829260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.829262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.829263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.829264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.829267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.829268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.829269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.829271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.829272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.829274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.829276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.829277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.829278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.829286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.829299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.829303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.829308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.829312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.829317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.829321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.829326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.829349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.829354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.829358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.829362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.829366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.829375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.829385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:24.829392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.829399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:24.829405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.829412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:24.829417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.829423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:24.829429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.829435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:24.829440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.829445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:24.829452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.829458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:24.829463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.829469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:24.829474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.829480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:24.829485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.829491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:24.829497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.829503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.829509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.829515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.829521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.829527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.829585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:24.832506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:24.832889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:24.832894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:24.832897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:24.832901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:24.832909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2331 [2:7559602192975153859:10564]
2025-10-10T14:37:24.832923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:24.832942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:24.832945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:24.832949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:24.832952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:24.832970Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:24.832979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:24.832987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:24.833050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.833053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.833055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.833058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:24.833133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:24.833136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.833148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:24.833162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:24.833182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:24.833204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757385110:2438], now have 1 active actors on pipe
2025-10-10T14:37:24.833208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757385229:8150], now have 1 active actors on pipe
2025-10-10T14:37:24.833217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602192975153853:10564]
2025-10-10T14:37:24.833219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602192975153853:10564]
2025-10-10T14:37:24.833221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602192975153853:10564]
2025-10-10T14:37:24.833237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:24.833250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:24.833267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:24.833271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:24.833299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602192975153853:10564]
2025-10-10T14:37:24.833302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:24.833351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:24.833354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:24.833357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:24.833365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:24.836257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2331
2025-10-10T14:37:24.836311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2331
2025-10-10T14:37:24.836383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.836401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.836436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d44866be-a7d66387-71cbfac7-a487a480_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:24.836448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:24.836453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:24.836456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:24.836470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:24.836487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:24.836504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:24.841601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.841622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.841675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:24.841896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2332 partition: 0 MaxSeqNo: 40 sessionId: src_id|d44866be-a7d66387-71cbfac7-a487a480_0
2025-10-10T14:37:24.842374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|593a520f-88c07cba-8df7386f-3d2c4443_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d44866be-a7d66387-71cbfac7-a487a480_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:24.846283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44866be-a7d66387-71cbfac7-a487a480_0] Write session: try to update token
2025-10-10T14:37:24.846304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44866be-a7d66387-71cbfac7-a487a480_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:24.846894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:24.846912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:24.846924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602192975153853:10564]
2025-10-10T14:37:24.846970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:24.846975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:24.847164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:24.847336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:24.847482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:24.847628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:24.847835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:24.847884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:24.871975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId: src_id|d44866be-a7d66387-71cbfac7-a487a480_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:24.874969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:24.875347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:24.875371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:24.875423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:24.875562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:24.893486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602193757385304:4939]
2025-10-10T14:37:24.893807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2331, pipe: [1:7559602193757385304:4939]
2025-10-10T14:37:24.895632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602193757385304:4939], now have 1 active actors on pipe
2025-10-10T14:37:24.895659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:24.895662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:24.895665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:24.895667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:24.895677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602192975153853:10564]
2025-10-10T14:37:24.895681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602192975153853:10564]
2025-10-10T14:37:24.895684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602192975153853:10564]
2025-10-10T14:37:24.895730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:24.895737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:24.895740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:24.895878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:24.895958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:24.895972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:24.895976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:25.016218Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:25.026256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.026283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.026487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.026551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.026620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.026696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.026737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.026742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.026816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.026875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.026940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.027410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.027453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.027456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.027534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.027596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.027661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.027726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.027770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.027773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.027843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.027911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.027978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.028041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.028084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.028087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.028160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.028243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.028304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.028365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.028409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.028412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.028482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.028542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.028605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.028668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.028712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.028718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.028795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.028855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.028916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.028975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.029016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.029019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.029092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.029149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.029213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.029276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.029316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.029319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.030691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602193757385304:4939]
2025-10-10T14:37:25.030737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:25.030741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:25.030780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2332 reason: error at write: Disconnected sessionId: src_id|d44866be-a7d66387-71cbfac7-a487a480_0
2025-10-10T14:37:25.030878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:25.030975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2332 sessionId: src_id|d44866be-a7d66387-71cbfac7-a487a480_0 is DEAD
2025-10-10T14:37:25.029687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.029753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.029814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.029877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.029927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.029930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.030003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.030062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.030127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.030190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.030229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.030233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.031221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:25.032437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44866be-a7d66387-71cbfac7-a487a480_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:25.032446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44866be-a7d66387-71cbfac7-a487a480_0] Write session will restart in 0.008634s
2025-10-10T14:37:25.032476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44866be-a7d66387-71cbfac7-a487a480_0] Write session: Do CDS request
2025-10-10T14:37:25.032484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44866be-a7d66387-71cbfac7-a487a480_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:25.041905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d44866be-a7d66387-71cbfac7-a487a480_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.042261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:25.042280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2333
2025-10-10T14:37:25.042807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.042845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:25.042851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:25.042863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:25.043460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2333 sessionId:  describe result for acl check
2025-10-10T14:37:25.043499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:25.043503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:25.043505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:25.043512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602198052352635:8132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:25.044075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602198052352635:8132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:25.048693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602198052352635:8132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:25.057230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602198052352635:8132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:25.057252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602198052352635:8132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:25.057256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602198052352635:8132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:25.057266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:25.061379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:25.064346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:25.064639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:25.064653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:25.064667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:25.064748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:25.064804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602197270121334:10568]
2025-10-10T14:37:25.065474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:25.065867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:25.065913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:25.066250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:25.066304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.066306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.066307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.066308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.066309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.066311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.066312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.066313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.066314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.066315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.066317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.066318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.066319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.066325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.066339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.066342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.066346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.066350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.066354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.066358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.066361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.066365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.066369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.066373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.066377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.066382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.066391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.066402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.066409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.066415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.066420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.066426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.066431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.066438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.066444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.066449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.066454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.066460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.066464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.066470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.066475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.066481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.066487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.066492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.066496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.066501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.066506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.066511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.066516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.066522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.066527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.066533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.066577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:25.070532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:25.070855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:25.070870Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:25.070889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:25.070894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:25.070900Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2332 [2:7559602197270121334:10568]
2025-10-10T14:37:25.070919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:25.070945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:25.070952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.070955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.070959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.070977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:25.070997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:25.071006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:25.071074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.071077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.071079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.071082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:25.071165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:25.071173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.071185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.071197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.071220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:25.071260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052352612:2438], now have 1 active actors on pipe
2025-10-10T14:37:25.071268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052352749:8132], now have 1 active actors on pipe
2025-10-10T14:37:25.071277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602197270121328:10568]
2025-10-10T14:37:25.071280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602197270121328:10568]
2025-10-10T14:37:25.071283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602197270121328:10568]
2025-10-10T14:37:25.071296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:25.071321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:25.071326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:25.071329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:25.071333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:25.071352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:25.071355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:25.071387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602197270121328:10568]
2025-10-10T14:37:25.071399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:25.071433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:25.074158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.074173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.074207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:25.074222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.074228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.074231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:25.074245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.074274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:25.074296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.073947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2332
2025-10-10T14:37:25.073996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2332
2025-10-10T14:37:25.077544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.077562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.077599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.077788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2333 partition: 0 MaxSeqNo: 40 sessionId: src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0
2025-10-10T14:37:25.080839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d44866be-a7d66387-71cbfac7-a487a480_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:25.084077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0] Write session: try to update token
2025-10-10T14:37:25.084106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:25.106213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:25.106245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:25.106249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:25.106252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:25.106264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602197270121328:10568]
2025-10-10T14:37:25.106270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602197270121328:10568]
2025-10-10T14:37:25.106277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602197270121328:10568]
2025-10-10T14:37:25.106340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:25.106351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.106349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:25.106354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:25.106357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:25.106362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:25.106540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:25.111292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId: src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:25.114791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:25.133410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602198052352793:4939]
2025-10-10T14:37:25.133877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2332, pipe: [1:7559602198052352793:4939]
2025-10-10T14:37:25.241270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:25.239583Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:25.241353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602198052352793:4939]
2025-10-10T14:37:25.241380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:25.240356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.240367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.240412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052352793:4939], now have 1 active actors on pipe
2025-10-10T14:37:25.240723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:25.241965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:25.241979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0] Write session will restart in 0.009353s
2025-10-10T14:37:25.242008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0] Write session: Do CDS request
2025-10-10T14:37:25.242014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:25.241467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2333 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0
2025-10-10T14:37:25.241659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2333 sessionId: src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0 is DEAD
2025-10-10T14:37:25.252935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.253674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:25.253695Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2334
2025-10-10T14:37:25.253831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.253862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:25.253868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:25.253872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:25.254447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2334 sessionId:  describe result for acl check
2025-10-10T14:37:25.254486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:25.254489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:25.254491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:25.254497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602198052352841:8120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:25.255157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602198052352841:8120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:25.259042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602198052352841:8120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:25.265651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602198052352841:8120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:25.265672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602198052352841:8120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:25.265676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602198052352841:8120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:25.265686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:25.266474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:25.269911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:25.270151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:25.270157Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:25.270168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:25.270224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:25.270271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602197270121520:10572]
2025-10-10T14:37:25.270964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:25.271450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:25.271496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:25.271835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:25.271890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.271891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.271893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.271894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.271896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.271897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.271898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.271900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.271901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.271903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.271905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.271906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.271907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.271914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.271929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.271933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.271938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.271943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.271947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.271952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.271956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.271961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.271966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.271970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.271974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.271978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.271986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.271997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.272004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.272010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.272015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.272021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.272026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.272031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.272037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.272043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.272048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.272054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.272058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.272064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.272068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.272074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.272098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.272105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.272110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.272116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.272122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.272128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.272133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.272139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.272144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.272150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.272194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:25.276216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2333
2025-10-10T14:37:25.276264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2333
2025-10-10T14:37:25.275026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:25.275471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:25.275476Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:25.275479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:25.275483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:25.275490Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2333 [2:7559602197270121520:10572]
2025-10-10T14:37:25.275504Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:25.275523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:25.275526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.275531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.275535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.275552Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:25.275560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:25.275569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:25.275629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.275632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.275635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.275637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:25.275715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:25.275718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.275729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.275744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.275763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:25.275786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602197270121515:10572]
2025-10-10T14:37:25.275789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602197270121515:10572]
2025-10-10T14:37:25.275790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602197270121515:10572]
2025-10-10T14:37:25.275805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:25.275821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052352807:2438], now have 1 active actors on pipe
2025-10-10T14:37:25.275825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052352969:8120], now have 1 active actors on pipe
2025-10-10T14:37:25.275834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:25.275851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:25.275854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:25.275879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602197270121515:10572]
2025-10-10T14:37:25.275882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:25.276090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:25.276093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:25.276096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:25.276102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:25.276442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.276449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.276482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d11ff782-182bd4ce-5c08179d-291b9092_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:25.276491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.276495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.276498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:25.276510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.276524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:25.276540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.280506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2334 partition: 0 MaxSeqNo: 40 sessionId: src_id|d11ff782-182bd4ce-5c08179d-291b9092_0
2025-10-10T14:37:25.280959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b454591-82fe8767-5153da4e-ea5a3a49_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d11ff782-182bd4ce-5c08179d-291b9092_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:25.280287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.280307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.280353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.283824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d11ff782-182bd4ce-5c08179d-291b9092_0] Write session: try to update token
2025-10-10T14:37:25.283847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d11ff782-182bd4ce-5c08179d-291b9092_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:25.303604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:25.303626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:25.303630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:25.303633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:25.303645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602197270121515:10572]
2025-10-10T14:37:25.303649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602197270121515:10572]
2025-10-10T14:37:25.303654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602197270121515:10572]
2025-10-10T14:37:25.303707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:25.303720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.303720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:25.303723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:25.303727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:25.303734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:25.303874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:25.309389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId: src_id|d11ff782-182bd4ce-5c08179d-291b9092_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:25.312250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:25.342433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602198052352982:4939]
2025-10-10T14:37:25.343054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2333, pipe: [1:7559602198052352982:4939]
2025-10-10T14:37:25.436558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:25.436594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:25.436693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2334 reason: error at write: Disconnected sessionId: src_id|d11ff782-182bd4ce-5c08179d-291b9092_0
2025-10-10T14:37:25.437076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11ff782-182bd4ce-5c08179d-291b9092_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:25.437098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11ff782-182bd4ce-5c08179d-291b9092_0] Write session will restart in 0.009976s
2025-10-10T14:37:25.437125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11ff782-182bd4ce-5c08179d-291b9092_0] Write session: Do CDS request
2025-10-10T14:37:25.437132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11ff782-182bd4ce-5c08179d-291b9092_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:25.436917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2334 sessionId: src_id|d11ff782-182bd4ce-5c08179d-291b9092_0 is DEAD
2025-10-10T14:37:25.437239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602198052352982:4939]
2025-10-10T14:37:25.435485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:25.437259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:25.435901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.435914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.435964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052352982:4939], now have 1 active actors on pipe
2025-10-10T14:37:25.437812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:25.447898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d11ff782-182bd4ce-5c08179d-291b9092_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.451328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:25.451350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2335
2025-10-10T14:37:25.451563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.451600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:25.451606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:25.451610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:25.453082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2335 sessionId:  describe result for acl check
2025-10-10T14:37:25.453121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:25.453131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:25.453133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:25.453140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602198052353028:8114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:25.453723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602198052353028:8114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:25.460226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602198052353028:8114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:25.465448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:25.468410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:25.468654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:25.468659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:25.468684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:25.468745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:25.468787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602197270121694:10574]
2025-10-10T14:37:25.468783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602198052353028:8114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:25.468799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602198052353028:8114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:25.468803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602198052353028:8114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:25.468814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:25.469377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:25.469894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:25.469949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:25.470309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:25.470363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.470364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.470365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.470367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.470368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.470369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.470371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.470372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.470374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.470375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.470377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.470378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.470379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.470385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.470399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.470404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.470408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.470412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.470416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.470421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.470425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.470429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.470434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.470438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.470442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.470446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.470455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.470481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.470490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.470496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.470502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.470507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.470512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.470517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.470522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.470528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.470533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.470539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.470544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.470549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.470553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.470558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.470563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.470569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.470573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.470578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.470583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.470588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.470592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.470597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.470602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.470608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.470649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:25.478519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:25.479257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:25.479270Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:25.479273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:25.479277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:25.479285Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2334 [2:7559602197270121694:10574]
2025-10-10T14:37:25.479312Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:25.479338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:25.479347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.479351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.479354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.479375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:25.479388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:25.479402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:25.479487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.479495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.479496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.479499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:25.479583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:25.479593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.479606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.479622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.479638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:25.479667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052353149:8114], now have 1 active actors on pipe
2025-10-10T14:37:25.479675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052352985:2438], now have 1 active actors on pipe
2025-10-10T14:37:25.479684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602197270121689:10574]
2025-10-10T14:37:25.479691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602197270121689:10574]
2025-10-10T14:37:25.479694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602197270121689:10574]
2025-10-10T14:37:25.479708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:25.479729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:25.479750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:25.479758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:25.479763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:25.479766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:25.479768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:25.479935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602197270121689:10574]
2025-10-10T14:37:25.479948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:25.479973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:25.480020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2334
2025-10-10T14:37:25.480057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2334
2025-10-10T14:37:25.480392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.480413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.480475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:25.480494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.480506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.480510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:25.480527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.480552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:25.480598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.480964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.480977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.481001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.481139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2335 partition: 0 MaxSeqNo: 40 sessionId: src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0
2025-10-10T14:37:25.481576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d11ff782-182bd4ce-5c08179d-291b9092_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:25.484354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0] Write session: try to update token
2025-10-10T14:37:25.484374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:25.503013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:25.503034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:25.503046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602197270121689:10574]
2025-10-10T14:37:25.503106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:25.503115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:25.503307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:25.503456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:25.503594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:25.503743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:25.503942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:25.503978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:25.517519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId: src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:25.520609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:25.520880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.520905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.520957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:25.521081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:25.533230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:25.533255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:25.533259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:25.533261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:25.533273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602197270121689:10574]
2025-10-10T14:37:25.533278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602197270121689:10574]
2025-10-10T14:37:25.533281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602197270121689:10574]
2025-10-10T14:37:25.533345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:25.533354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.533357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:25.533491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:25.534933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602198052353162:4939]
2025-10-10T14:37:25.535318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:25.535335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:25.535343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:25.535499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2334, pipe: [1:7559602198052353162:4939]
2025-10-10T14:37:25.649856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:25.650107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052353162:4939], now have 1 active actors on pipe
2025-10-10T14:37:25.657415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.657444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.657631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.657696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.657768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.657835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.657879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.657884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.657961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.658022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.658083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.658155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.658196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.658199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.658268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.658320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.658405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.658461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.658503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.658504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.658578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.658636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.658699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.658766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.658812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.658816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.658911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.659026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.659135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.659232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.659306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.659315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.659404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.659498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.659587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.659673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.659725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.659729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.659806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.659862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.659919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.659981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.660021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.660026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.660092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.660143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.660197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.660261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.660376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.660378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.660439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.660496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.661472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602198052353162:4939]
2025-10-10T14:37:25.661527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:25.661530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:25.660563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.660616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.660651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.661560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2335 reason: error at write: Disconnected sessionId: src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0
2025-10-10T14:37:25.660652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.660722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.660783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.660845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.660900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.660936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.660938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.661755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2335 sessionId: src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0 is DEAD
2025-10-10T14:37:25.661889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:25.662217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:25.666337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:25.666350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0] Write session will restart in 0.007632s
2025-10-10T14:37:25.666379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0] Write session: Do CDS request
2025-10-10T14:37:25.666385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:25.677908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.682550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:25.682574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2336
2025-10-10T14:37:25.682762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.682813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:25.682826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:25.682831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:25.683257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2336 sessionId:  describe result for acl check
2025-10-10T14:37:25.683314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:25.683322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:25.683324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:25.683331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602198052353261:8108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:25.683915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602198052353261:8108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:25.688518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602198052353261:8108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:25.692665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:25.692923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602198052353261:8108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:25.692940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602198052353261:8108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:25.692944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602198052353261:8108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:25.692952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:25.693182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:25.693434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:25.693447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:25.693459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:25.693530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:25.693573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602197270121869:10576]
2025-10-10T14:37:25.694261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:25.694628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:25.694708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:25.695044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:25.695131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.695138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.695139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.695141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.695142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.695143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.695144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.695146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.695147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.695148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.695149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.695150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.695152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.695158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.695171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.695176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.695180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.695184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.695188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.695192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.695195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.695199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.695204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.695220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.695224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.695227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.695236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.695245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.695251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.695257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.695267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.695273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.695278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.695299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.695304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.695309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.695318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.695324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.695329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.695339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.695346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.695355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.695360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.695365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.695374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.695380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.695399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.695405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.695411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.695422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.695427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.695436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.695477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:25.698193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:25.698758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:25.698771Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:25.698774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:25.698778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:25.698785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2335 [2:7559602197270121869:10576]
2025-10-10T14:37:25.698798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:25.698817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:25.698820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.698832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.698836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.698854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:25.698868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:25.698875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:25.698934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.698942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.698944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.698947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:25.699015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:25.699023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.699035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.699052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.699076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:25.699103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052353331:8108], now have 1 active actors on pipe
2025-10-10T14:37:25.699112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052353164:2438], now have 1 active actors on pipe
2025-10-10T14:37:25.699121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602197270121863:10576]
2025-10-10T14:37:25.699123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602197270121863:10576]
2025-10-10T14:37:25.699125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602197270121863:10576]
2025-10-10T14:37:25.699139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:25.699156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:25.699160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2335
2025-10-10T14:37:25.699205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2335
2025-10-10T14:37:25.699171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:25.699178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:25.699181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:25.699184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:25.699187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:25.699204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602197270121863:10576]
2025-10-10T14:37:25.699207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:25.699209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:25.699414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.699435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.699473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:25.699495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.699509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.699512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:25.699527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.699540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:25.699563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.699853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.699865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.699885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.699989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2336 partition: 0 MaxSeqNo: 40 sessionId: src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0
2025-10-10T14:37:25.700409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19c24d71-9e4557f2-1355d9a3-3b893956_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:25.703381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0] Write session: try to update token
2025-10-10T14:37:25.703404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:25.714621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:25.714643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:25.714654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602197270121863:10576]
2025-10-10T14:37:25.714704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:25.714880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:25.715028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:25.715189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:25.715344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:25.715541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:25.715590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:25.716228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:25.724606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId: src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:25.727686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:25.727940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.727966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.728012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:25.728110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:25.734043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:25.734065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:25.734068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:25.734071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:25.734082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602197270121863:10576]
2025-10-10T14:37:25.734086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602197270121863:10576]
2025-10-10T14:37:25.734091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602197270121863:10576]
2025-10-10T14:37:25.734138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:25.734146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:25.734150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:25.734154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:25.734155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.734158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:25.734298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:25.761766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602198052353347:4939]
2025-10-10T14:37:25.762171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2335, pipe: [1:7559602198052353347:4939]
2025-10-10T14:37:25.852239Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:25.860907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.860940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.861133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.861206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.861275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.861363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.861412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.861422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.861495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.861562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.861642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.861712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.861758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.861765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.861835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.861899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.861966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.862029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.862076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.862082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.862150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.862216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.862281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.862348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.862396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.862403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.862473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.862535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.862598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.862659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.862703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.862710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.862780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.862841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.862904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.862964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.863010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.863018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.863085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.863148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.863213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.863277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.863336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.863342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.863408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.863471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.863533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.863596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.863644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.863650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.863717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.863778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.863845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.863908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.863953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.863960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.864024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:25.864083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:25.864148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:25.864217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:25.864268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:25.864275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:25.864342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052353347:4939], now have 1 active actors on pipe
2025-10-10T14:37:25.864640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:25.864711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602198052353347:4939]
2025-10-10T14:37:25.865104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:25.865126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:25.865159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2336 reason: error at write: Disconnected sessionId: src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0
2025-10-10T14:37:25.865545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2336 sessionId: src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0 is DEAD
2025-10-10T14:37:25.865602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:25.865626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0] Write session will restart in 0.006065s
2025-10-10T14:37:25.865566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:25.865657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0] Write session: Do CDS request
2025-10-10T14:37:25.865664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:25.872903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.873028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:25.873051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2337
2025-10-10T14:37:25.873282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:25.873340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:25.873354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:25.873364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:25.873855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2337 sessionId:  describe result for acl check
2025-10-10T14:37:25.873895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:25.873901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:25.873903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:25.873909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602198052353370:8098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:25.874537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602198052353370:8098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:25.878386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602198052353370:8098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:25.881963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602198052353370:8098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:25.881979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602198052353370:8098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:25.881983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602198052353370:8098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:25.881991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:25.886538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:25.890059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:25.890445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:25.890459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:25.890476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:25.890547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:25.890590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602197270122075:10589]
2025-10-10T14:37:25.891250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:25.891886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:25.891957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:25.892343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:25.892419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.892427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.892429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.892430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.892431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.892433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.892434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.892436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.892437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.892439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.892440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.892442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.892443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.892450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.892465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.892470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.892475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.892479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.892484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.892488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.892493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.892497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.892502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.892507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.892512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.892516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.892526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.892535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:25.892544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.892550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:25.892556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.892562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:25.892567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.892574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:25.892580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.892586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:25.892590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.892596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:25.892603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.892609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:25.892614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.892620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:25.892626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.892632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:25.892639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.892653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:25.892658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.892665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.892670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.892676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.892681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.892686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.892732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:25.895358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:25.895683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:25.895693Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:25.895697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:25.895701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:25.895709Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2336 [2:7559602197270122075:10589]
2025-10-10T14:37:25.895724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:25.895749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:25.895753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.895757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.895760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.895777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:25.895790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:25.895800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:25.895881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.895889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.895892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.895894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:25.895967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:25.895978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.895990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:25.896003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:25.896021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:25.896050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052353516:8098], now have 1 active actors on pipe
2025-10-10T14:37:25.896059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052353355:2438], now have 1 active actors on pipe
2025-10-10T14:37:25.896068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602197270122069:10589]
2025-10-10T14:37:25.896075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602197270122069:10589]
2025-10-10T14:37:25.896077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602197270122069:10589]
2025-10-10T14:37:25.896090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:25.896109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:25.896112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:25.896112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:25.896114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:25.896131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:25.896141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:25.896169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602197270122069:10589]
2025-10-10T14:37:25.896184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:25.896193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:25.896236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2336
2025-10-10T14:37:25.896236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2336
2025-10-10T14:37:25.897021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.897036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.897072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:25.897083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:25.897088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:25.897090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:25.897104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:25.897118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:25.897135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.897418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:25.897430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:25.897457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:25.897618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2337 partition: 0 MaxSeqNo: 40 sessionId: src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0
2025-10-10T14:37:25.898022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8927d6fa-8b9ea5ff-90d69aee-a9de2cb9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:25.901436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0] Write session: try to update token
2025-10-10T14:37:25.901454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:25.922576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId: src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:25.926552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:25.926909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:25.926929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:25.926932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:25.926934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:25.926944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602197270122069:10589]
2025-10-10T14:37:25.926948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602197270122069:10589]
2025-10-10T14:37:25.926953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602197270122069:10589]
2025-10-10T14:37:25.926996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:25.927002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:25.927006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:25.927006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:25.927014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:25.927017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:25.927159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:25.964474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602198052353554:4939]
2025-10-10T14:37:25.964852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2336, pipe: [1:7559602198052353554:4939]
2025-10-10T14:37:26.046812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:26.047491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.047508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.047555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602198052353554:4939], now have 1 active actors on pipe
2025-10-10T14:37:26.047876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602198052353554:4939]
2025-10-10T14:37:26.047932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:26.047936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:26.048032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2337 reason: error at write: Disconnected sessionId: src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0
2025-10-10T14:37:26.047899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:26.048234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2337 sessionId: src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0 is DEAD
2025-10-10T14:37:26.048480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:26.048493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0] Write session will restart in 0.007144s
2025-10-10T14:37:26.048520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0] Write session: Do CDS request
2025-10-10T14:37:26.048526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:26.048630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:26.056990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.057946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:26.057973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2338
2025-10-10T14:37:26.058205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.058247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:26.058261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:26.058266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:26.058908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2338 sessionId:  describe result for acl check
2025-10-10T14:37:26.058960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:26.058962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:26.058965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:26.058971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602202347320869:8082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:26.059695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602202347320869:8082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:26.063636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602202347320869:8082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:26.067063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602202347320869:8082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:26.067084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602202347320869:8082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:26.067088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602202347320869:8082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:26.067099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:26.068155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:26.070747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:26.071006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:26.071019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:26.071031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:26.071096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:26.071139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602201565089556:10593]
2025-10-10T14:37:26.071854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:26.072196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:26.072273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:26.072621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:26.072687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.072693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.072695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.072696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.072697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.072699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.072700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.072702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.072703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.072705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.072706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.072707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.072708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.072715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.072729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.072733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.072738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.072741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.072745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.072749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.072753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.072757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.072761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.072765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.072769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.072773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.072780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.072789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.072796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.072801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.072806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.072811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.072815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.072820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.072827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.072832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.072836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.072841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.072845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.072851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.072855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.072860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.072865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.072871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.072875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.072880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.072890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.072896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.072905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.072911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.072915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.072925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.072965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:26.075647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:26.075965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:26.075978Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:26.075981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:26.075985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:26.076007Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2337 [2:7559602201565089556:10593]
2025-10-10T14:37:26.076027Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:26.076055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:26.076059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.076063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.076066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.076083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:26.076098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:26.076107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:26.076167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.076174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.076177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.076179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:26.076251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:26.076260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.076273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.076290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.076314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:26.076338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602201565089549:10593]
2025-10-10T14:37:26.076345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602201565089549:10593]
2025-10-10T14:37:26.076347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602201565089549:10593]
2025-10-10T14:37:26.076362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:26.076383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347320854:2438], now have 1 active actors on pipe
2025-10-10T14:37:26.076390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:26.076393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321020:8082], now have 1 active actors on pipe
2025-10-10T14:37:26.076395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:26.076399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:26.076403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:26.076420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:26.076423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:26.076456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602201565089549:10593]
2025-10-10T14:37:26.076479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2337
2025-10-10T14:37:26.076464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:26.076552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2337
2025-10-10T14:37:26.076474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:26.076685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.076700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.076729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:26.076745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.076755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.076758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:26.076770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.076786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:26.076808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.077005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.077019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.077035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.077160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2338 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0
2025-10-10T14:37:26.077601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7954dd6e-eabf8ee1-ea35ffb5-99b09b79_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:26.080633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0] Write session: try to update token
2025-10-10T14:37:26.080656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:26.088444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:26.088468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:26.088478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602201565089549:10593]
2025-10-10T14:37:26.088532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:26.088541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:26.088728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:26.088881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:26.089032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:26.089178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:26.089405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:26.089448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:26.100723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId: src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:26.103618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:26.104977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.104997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.105032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:26.105148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:26.108459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:26.108481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:26.108485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:26.108487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:26.108498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602201565089549:10593]
2025-10-10T14:37:26.108503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602201565089549:10593]
2025-10-10T14:37:26.108508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602201565089549:10593]
2025-10-10T14:37:26.108563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:26.108577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.108585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:26.108612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:26.108625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:26.108629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:26.108732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:26.148332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602202347321033:4939]
2025-10-10T14:37:26.148726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2337, pipe: [1:7559602202347321033:4939]
2025-10-10T14:37:26.227942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:26.236282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.236318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.236513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.236590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.236653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.236718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.236761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.236766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.236844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.236906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.236967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.237034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.237082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.237086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.237160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.237223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.237292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.237531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.237594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.237604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.237686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.237754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.237824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.237895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.237942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.237945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.238033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.238101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.238171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.238242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.238287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.238290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.238365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.238435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.238501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.238570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.238617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.238620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.238700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.238767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.238838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.238915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.238963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.238965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.239045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.239115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.241712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:26.241814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:26.241824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:26.241860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2338 reason: error at write: Disconnected sessionId: src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0
2025-10-10T14:37:26.242087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2338 sessionId: src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0 is DEAD
2025-10-10T14:37:26.242294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602202347321033:4939]
2025-10-10T14:37:26.239187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.239261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.239327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.239331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.239414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.239484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.239554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.239636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.239686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.239689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.239777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.239854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.239931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.240006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.240062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.240068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.240156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321033:4939], now have 1 active actors on pipe
2025-10-10T14:37:26.242044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:26.242512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:26.242533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0] Write session will restart in 0.006283s
2025-10-10T14:37:26.242566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0] Write session: Do CDS request
2025-10-10T14:37:26.242573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:26.250046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.253514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:26.253536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2339
2025-10-10T14:37:26.253783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.253857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:26.253875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:26.253880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:26.254488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2339 sessionId:  describe result for acl check
2025-10-10T14:37:26.254562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:26.254573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:26.254575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:26.254585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602202347321064:8076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:26.255258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602202347321064:8076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:26.260908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602202347321064:8076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:26.265252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602202347321064:8076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:26.265273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602202347321064:8076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:26.265277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602202347321064:8076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:26.265288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:26.268857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:26.271499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:26.271779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:26.271792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:26.271807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:26.271890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:26.271937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602201565089745:10597]
2025-10-10T14:37:26.272598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:26.272895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:26.272939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:26.273265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:26.273327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.273419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.273421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.273422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.273424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.273425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.273426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.273428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.273429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.273430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.273431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.273433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.273434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.273441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.273455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.273458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.273462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.273465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.273469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.273472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.273475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.273479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.273483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.273487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.273491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.273495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.273506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.273514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.273520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.273526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.273531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.273535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.273539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.273544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.273549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.273553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.273557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.273563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.273568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.273573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.273585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.273591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.273596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.273605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.273610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.273615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.273624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.273629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.273633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.273642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.273646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.273650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.273688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:26.276389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:26.277210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:26.277232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:26.277235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:26.277240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:26.277247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2338 [2:7559602201565089745:10597]
2025-10-10T14:37:26.277274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:26.277296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:26.277309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.277313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.277317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.277357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:26.277377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:26.277387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:26.277477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.277487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.277490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.277494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:26.277581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:26.277591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.277605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.277619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.277644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:26.277677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321048:2438], now have 1 active actors on pipe
2025-10-10T14:37:26.277688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321173:8076], now have 1 active actors on pipe
2025-10-10T14:37:26.277699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602201565089740:10597]
2025-10-10T14:37:26.277702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602201565089740:10597]
2025-10-10T14:37:26.277704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602201565089740:10597]
2025-10-10T14:37:26.277717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:26.277727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:26.277730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:26.277731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:26.277684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2338
2025-10-10T14:37:26.277745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:26.277730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2338
2025-10-10T14:37:26.277770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:26.277780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:26.277826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602201565089740:10597]
2025-10-10T14:37:26.277840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:26.277872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:26.278006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.278015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.278047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93a29de0-fbe5850f-59528a35-d098ce81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:26.278062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.278066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.278069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:26.278082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.278099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:26.278119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.278312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.278321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.278336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.278447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2339 partition: 0 MaxSeqNo: 40 sessionId: src_id|93a29de0-fbe5850f-59528a35-d098ce81_0
2025-10-10T14:37:26.278872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a38e088-42862cb8-9d3454cf-c7015da1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|93a29de0-fbe5850f-59528a35-d098ce81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:26.281843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a29de0-fbe5850f-59528a35-d098ce81_0] Write session: try to update token
2025-10-10T14:37:26.281864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a29de0-fbe5850f-59528a35-d098ce81_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:26.299822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId: src_id|93a29de0-fbe5850f-59528a35-d098ce81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:26.298547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:26.298572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:26.298575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:26.298578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:26.298588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602201565089740:10597]
2025-10-10T14:37:26.298593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602201565089740:10597]
2025-10-10T14:37:26.298597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602201565089740:10597]
2025-10-10T14:37:26.298649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:26.298659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.298648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:26.298661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:26.298664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:26.298669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:26.298811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:26.302847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:26.342369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602202347321231:4939]
2025-10-10T14:37:26.342904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2338, pipe: [1:7559602202347321231:4939]
2025-10-10T14:37:26.427264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:26.427586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.427596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.427643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321231:4939], now have 1 active actors on pipe
2025-10-10T14:37:26.427924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:26.428075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:26.428101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:26.428169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2339 reason: error at write: Disconnected sessionId: src_id|93a29de0-fbe5850f-59528a35-d098ce81_0
2025-10-10T14:37:26.428382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2339 sessionId: src_id|93a29de0-fbe5850f-59528a35-d098ce81_0 is DEAD
2025-10-10T14:37:26.428491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:26.428539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602202347321231:4939]
2025-10-10T14:37:26.428633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a29de0-fbe5850f-59528a35-d098ce81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:26.428645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a29de0-fbe5850f-59528a35-d098ce81_0] Write session will restart in 0.008651s
2025-10-10T14:37:26.428670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a29de0-fbe5850f-59528a35-d098ce81_0] Write session: Do CDS request
2025-10-10T14:37:26.428676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a29de0-fbe5850f-59528a35-d098ce81_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:26.438954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a29de0-fbe5850f-59528a35-d098ce81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.439360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:26.439382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2340
2025-10-10T14:37:26.439523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.439555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:26.439561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:26.439565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:26.440698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2340 sessionId:  describe result for acl check
2025-10-10T14:37:26.440746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:26.440754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:26.440757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:26.440764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602202347321259:8068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:26.441414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602202347321259:8068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:26.444309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602202347321259:8068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:26.449783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602202347321259:8068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:26.449807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602202347321259:8068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:26.449811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602202347321259:8068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:26.449821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:26.463827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:26.469951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:26.470254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:26.470260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:26.470275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:26.470340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:26.470384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602201565089925:10599]
2025-10-10T14:37:26.471048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:26.471469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:26.471551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:26.471933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:26.472004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.472012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.472013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.472014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.472016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.472017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.472019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.472020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.472022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.472024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.472025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.472027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.472028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.472035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.472048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.472053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.472059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.472063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.472068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.472073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.472077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.472082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.472087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.472092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.472096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.472102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.472110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.472119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.472127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.472139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.472145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.472152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.472162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.472168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.472173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.472184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.472190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.472200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.472206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.472217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.472222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.472231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.472238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.472249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.472254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.472274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.472286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.472292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.472302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.472308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.472318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.472324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.472377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:26.475156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:26.475522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:26.475537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:26.475540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:26.475545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:26.475562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2339 [2:7559602201565089925:10599]
2025-10-10T14:37:26.475583Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:26.475607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:26.475616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.475619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.475622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.475641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:26.475654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:26.475667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:26.475735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.475743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.475746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.475749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:26.475835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:26.475844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.475857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.475870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.475889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:26.475917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321338:8068], now have 1 active actors on pipe
2025-10-10T14:37:26.475926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321234:2438], now have 1 active actors on pipe
2025-10-10T14:37:26.475934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602201565089920:10599]
2025-10-10T14:37:26.475937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602201565089920:10599]
2025-10-10T14:37:26.475940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602201565089920:10599]
2025-10-10T14:37:26.475956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:26.475968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:26.475976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:26.475978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:26.475980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:26.475993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:26.475997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:26.476031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602201565089920:10599]
2025-10-10T14:37:26.476047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:26.476028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2339
2025-10-10T14:37:26.476067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:26.476080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2339
2025-10-10T14:37:26.477085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2340 partition: 0 MaxSeqNo: 40 sessionId: src_id|84134415-4966979d-d14d6ec7-6e9939f9_0
2025-10-10T14:37:26.477548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a29de0-fbe5850f-59528a35-d098ce81_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84134415-4966979d-d14d6ec7-6e9939f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:26.476161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.476171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.476204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84134415-4966979d-d14d6ec7-6e9939f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:26.476211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.476216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.476218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:26.476230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.476241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:26.476256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.476907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.476912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.476934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.480471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84134415-4966979d-d14d6ec7-6e9939f9_0] Write session: try to update token
2025-10-10T14:37:26.480490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84134415-4966979d-d14d6ec7-6e9939f9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:26.490944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:26.490962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:26.490973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602201565089920:10599]
2025-10-10T14:37:26.491030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:26.491031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:26.491219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:26.491380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:26.491520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:26.491668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:26.491865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:26.491907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:26.502463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId: src_id|84134415-4966979d-d14d6ec7-6e9939f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:26.505149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:26.505445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.505470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.505514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:26.505704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:26.510300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:26.510323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:26.510327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:26.510329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:26.510340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602201565089920:10599]
2025-10-10T14:37:26.510344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602201565089920:10599]
2025-10-10T14:37:26.510348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602201565089920:10599]
2025-10-10T14:37:26.510393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:26.510396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:26.510405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.510407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:26.510408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:26.510413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:26.510553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:26.528770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602202347321416:4939]
2025-10-10T14:37:26.529220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2339, pipe: [1:7559602202347321416:4939]
2025-10-10T14:37:26.641271Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:26.651329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.651363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.651566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.651630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.651700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.651764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.652099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.652105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.652183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.652246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.652311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.652381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.652425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.652428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.652505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.652564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.652629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.652692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.652736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.652741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.652815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.652885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.652954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.653020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.653064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.653067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.653140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.653202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.653266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.653664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.653724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.653736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.653808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.653876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.653947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.654019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.654073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.654081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.654199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.654262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.654341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.654409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.654459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.654462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.654538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.654599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.654664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.654727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.655914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602202347321416:4939]
2025-10-10T14:37:26.654769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.655970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:26.654772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.654845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.654906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.654974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.655038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.655083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.655086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.655160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:26.655224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:26.655338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:26.655403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:26.655464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:26.655468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:26.655552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321416:4939], now have 1 active actors on pipe
2025-10-10T14:37:26.656165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:26.656178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:26.656213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2340 reason: error at write: Disconnected sessionId: src_id|84134415-4966979d-d14d6ec7-6e9939f9_0
2025-10-10T14:37:26.656524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2340 sessionId: src_id|84134415-4966979d-d14d6ec7-6e9939f9_0 is DEAD
2025-10-10T14:37:26.657038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84134415-4966979d-d14d6ec7-6e9939f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:26.657048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84134415-4966979d-d14d6ec7-6e9939f9_0] Write session will restart in 0.005589s
2025-10-10T14:37:26.657075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84134415-4966979d-d14d6ec7-6e9939f9_0] Write session: Do CDS request
2025-10-10T14:37:26.657085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84134415-4966979d-d14d6ec7-6e9939f9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:26.656590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:26.665832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84134415-4966979d-d14d6ec7-6e9939f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.665946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:26.665966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2341
2025-10-10T14:37:26.666101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.666130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:26.666136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:26.666141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:26.666736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2341 sessionId:  describe result for acl check
2025-10-10T14:37:26.666764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:26.666766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:26.666768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:26.666773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602202347321460:8064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:26.667506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602202347321460:8064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:26.671990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602202347321460:8064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:26.672924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:26.675630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:26.675899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:26.675911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:26.675924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:26.676000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:26.676058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602201565090103:10601]
2025-10-10T14:37:26.676714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:26.677062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:26.677119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:26.677514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:26.677582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.677589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.677590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.677591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.677593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.677594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.677596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.677597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.677598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.677599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.677601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.677602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.677604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.677611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.677624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.677629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.677633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.677637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.677642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.677646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.677650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.677654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.677658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.677662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.677667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.677671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.677680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.677689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.677697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.677703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.677708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.677524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602202347321460:8064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:26.677547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602202347321460:8064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:26.677551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602202347321460:8064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:26.677561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:26.677714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.677726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.677732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.677737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.677742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.677747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.677752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.677757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.677762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.677767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.677772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.677776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.677781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.677785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.677790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.677795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.677800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.677805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.677809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.677814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.677818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.677871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:26.680475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:26.680830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:26.680845Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:26.680849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:26.680853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:26.680860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2340 [2:7559602201565090103:10601]
2025-10-10T14:37:26.680874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:26.680894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:26.680902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.680906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.680908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.680926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:26.680948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:26.680961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:26.681033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.681042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.681044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.681047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:26.681228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:26.681238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.681250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.681268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.681255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2340
2025-10-10T14:37:26.681257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2340
2025-10-10T14:37:26.681288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:26.681317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321591:8064], now have 1 active actors on pipe
2025-10-10T14:37:26.681326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321418:2438], now have 1 active actors on pipe
2025-10-10T14:37:26.681344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602201565090098:10601]
2025-10-10T14:37:26.681347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602201565090098:10601]
2025-10-10T14:37:26.681349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602201565090098:10601]
2025-10-10T14:37:26.681364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:26.681377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:26.681388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:26.681390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:26.681392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.681397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.681418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:26.681441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:26.681449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:26.681494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:26.681508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.681513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.681515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:26.681527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.681547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:26.681559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602201565090098:10601]
2025-10-10T14:37:26.681567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:26.681576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:26.681588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.681758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.681776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.681792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.681896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2341 partition: 0 MaxSeqNo: 40 sessionId: src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0
2025-10-10T14:37:26.685436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84134415-4966979d-d14d6ec7-6e9939f9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:26.688177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0] Write session: try to update token
2025-10-10T14:37:26.688196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:26.704771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId: src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:26.707228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:26.707249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:26.707253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:26.707255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:26.707281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602201565090098:10601]
2025-10-10T14:37:26.707285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602201565090098:10601]
2025-10-10T14:37:26.707290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602201565090098:10601]
2025-10-10T14:37:26.707345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:26.707355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.707357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:26.707362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:26.707365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:26.707370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:26.707518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:26.707613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:26.756053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602202347321608:4939]
2025-10-10T14:37:26.756418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2340, pipe: [1:7559602202347321608:4939]
2025-10-10T14:37:26.839755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:26.840412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.840424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.840479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321608:4939], now have 1 active actors on pipe
2025-10-10T14:37:26.841751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:26.842986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:26.842998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0] Write session will restart in 0.009346s
2025-10-10T14:37:26.843027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0] Write session: Do CDS request
2025-10-10T14:37:26.843034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:26.841614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:26.841631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602202347321608:4939]
2025-10-10T14:37:26.841683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:26.841687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:26.841796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2341 reason: error at write: Disconnected sessionId: src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0
2025-10-10T14:37:26.842021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2341 sessionId: src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0 is DEAD
2025-10-10T14:37:26.855625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.855698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:26.855720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2342
2025-10-10T14:37:26.855860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:26.855896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:26.855903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:26.855908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:26.856363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2342 sessionId:  describe result for acl check
2025-10-10T14:37:26.856391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:26.856395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:26.856397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:26.856403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602202347321630:8061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:26.856971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602202347321630:8061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:26.861790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602202347321630:8061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:26.869200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602202347321630:8061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:26.869226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602202347321630:8061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:26.869230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602202347321630:8061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:26.869239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:26.875250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:26.877912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:26.878147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:26.878160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:26.878172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:26.878226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:26.878273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602201565090297:10603]
2025-10-10T14:37:26.878925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:26.879208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:26.879253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:26.879596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:26.879655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.879662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.879664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.879665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.879666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.879668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.879669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.879670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.879672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.879674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.879675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.879676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.879677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.879683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.879696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.879701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.879705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.879709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.879714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.879718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.879722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.879727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.879731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.879735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.879740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.879744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.879751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.879760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:26.879767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.879773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:26.879777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.879784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:26.879789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.879794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:26.879799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.879805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:26.879809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.879815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:26.879820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.879825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:26.879838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.879844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:26.879849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.879856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:26.879860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.879866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:26.879871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.879877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.879882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.879887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.879892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.879898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.879941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:26.882513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:26.883115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:26.883132Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:26.883134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:26.883137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:26.883144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2341 [2:7559602201565090297:10603]
2025-10-10T14:37:26.883158Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:26.883175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:26.883185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.883190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.883192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.883211Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:26.883224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:26.883236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:26.883316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.883322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.883325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.883328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:26.883402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:26.883410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.883423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:26.883437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:26.883455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:26.883478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602201565090292:10603]
2025-10-10T14:37:26.883482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602201565090292:10603]
2025-10-10T14:37:26.883484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602201565090292:10603]
2025-10-10T14:37:26.883501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:26.883515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:26.883532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:26.883535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:26.883552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:26.883564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602201565090292:10603]
2025-10-10T14:37:26.883566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:26.883557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:26.883570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:26.883577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:26.883769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321613:2438], now have 1 active actors on pipe
2025-10-10T14:37:26.883781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321720:8061], now have 1 active actors on pipe
2025-10-10T14:37:26.883958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2341
2025-10-10T14:37:26.884005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2341
2025-10-10T14:37:26.884088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.884099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.884131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:26.884145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:26.884154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:26.884157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:26.884169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:26.884182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:26.884201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.884388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:26.884396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:26.884412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:26.884502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2342 partition: 0 MaxSeqNo: 40 sessionId: src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0
2025-10-10T14:37:26.884959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3afb6f-f27612db-b0e8772b-e6a632fa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:26.887707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0] Write session: try to update token
2025-10-10T14:37:26.887727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:26.903775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:26.903799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:26.905385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId: src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:26.903802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:26.903804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:26.903815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602201565090292:10603]
2025-10-10T14:37:26.903819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602201565090292:10603]
2025-10-10T14:37:26.903824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602201565090292:10603]
2025-10-10T14:37:26.903876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:26.903878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:26.903884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:26.903886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:26.903887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:26.903889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:26.904026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:26.908156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:26.945457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602202347321797:4939]
2025-10-10T14:37:26.945938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2341, pipe: [1:7559602202347321797:4939]
2025-10-10T14:37:27.024996Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:27.025367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.025391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.025455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602202347321797:4939], now have 1 active actors on pipe
2025-10-10T14:37:27.030039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:27.030139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:27.030167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:27.030258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2342 reason: error at write: Disconnected sessionId: src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0
2025-10-10T14:37:27.030482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2342 sessionId: src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0 is DEAD
2025-10-10T14:37:27.030690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:27.030674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602202347321797:4939]
2025-10-10T14:37:27.030703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0] Write session will restart in 0.006717s
2025-10-10T14:37:27.030711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:27.030737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0] Write session: Do CDS request
2025-10-10T14:37:27.030747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:27.038952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.039394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:27.039419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2343
2025-10-10T14:37:27.039558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.039599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:27.039609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:27.039613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:27.040148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2343 sessionId:  describe result for acl check
2025-10-10T14:37:27.040192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:27.040194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:27.040197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:27.040203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602206642289137:10240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:27.040791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602206642289137:10240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:27.043420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602206642289137:10240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:27.050317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602206642289137:10240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:27.050345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602206642289137:10240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:27.050349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602206642289137:10240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:27.050360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:27.059951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:27.063481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:27.063777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:27.063790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:27.063803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:27.063862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:27.063910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602205860057799:10618]
2025-10-10T14:37:27.064611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:27.065072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:27.065126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:27.065517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:27.065583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.065590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.065591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.065593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.065594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.065596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.065598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.065600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.065602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.065603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.065604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.065605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.065606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.065614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.065629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.065634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.065640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.065644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.065649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.065654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.065659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.065663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.065668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.065672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.065677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.065682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.065691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.065701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.065713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.065720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.065730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.065735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.065740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.065751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.065757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.065784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.065794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.065801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.065812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.065818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.065824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.065830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.065837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.065844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.065850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.065856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.065862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.065868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.065878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.065884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.065890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.065901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.065951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:27.071672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:27.072049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:27.072069Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:27.072072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:27.072076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:27.072083Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2342 [2:7559602205860057799:10618]
2025-10-10T14:37:27.072102Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:27.072123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:27.072132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.072136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.072139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.072158Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:27.072174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:27.072183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:27.072280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.072288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.072290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.072293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:27.072639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:27.072655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.072670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.072685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.072706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:27.072738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289122:2438], now have 1 active actors on pipe
2025-10-10T14:37:27.072749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289205:10240], now have 1 active actors on pipe
2025-10-10T14:37:27.072758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602205860057794:10618]
2025-10-10T14:37:27.072746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2342
2025-10-10T14:37:27.072760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602205860057794:10618]
2025-10-10T14:37:27.072762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602205860057794:10618]
2025-10-10T14:37:27.072780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:27.072788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:27.072792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:27.072800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:27.072806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:27.072832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:27.072842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:27.072882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2342
2025-10-10T14:37:27.072898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.072909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.072937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602205860057794:10618]
2025-10-10T14:37:27.072946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:27.072951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:27.072984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:27.073000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.073004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.073007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:27.073019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.073032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:27.073061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.073228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.073238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.073256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.073380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2343 partition: 0 MaxSeqNo: 40 sessionId: src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0
2025-10-10T14:37:27.073802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ce611d-f75cb3f-bf07b6e0-8e59cb50_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:27.076640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0] Write session: try to update token
2025-10-10T14:37:27.076659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:27.091632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId: src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:27.094282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:27.094663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.094699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.094754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:27.094881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:27.100377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:27.100402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:27.100406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:27.100409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:27.100419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602205860057794:10618]
2025-10-10T14:37:27.100424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602205860057794:10618]
2025-10-10T14:37:27.100428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602205860057794:10618]
2025-10-10T14:37:27.100492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:27.100500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:27.100504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:27.100505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:27.100513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.100516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:27.100674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:27.130028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602206642289303:4939]
2025-10-10T14:37:27.130469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2342, pipe: [1:7559602206642289303:4939]
2025-10-10T14:37:27.229370Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:27.238093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.238134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.238323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.238395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.238460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.238524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.238569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.238576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.238650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.238711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.238777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.238841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.238883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.238886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.238954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.239013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.239077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.239138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.239179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.239182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.239252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.239329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.239393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.239453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.239494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.239498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.239571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.239630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.239697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.239761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.239807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.239811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.239890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.239953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.240018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.240080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.240123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.240127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.240198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.240256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.240320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.240386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.240429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.240433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.240500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.240561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.240621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.240685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.240728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.240732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.240805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.240866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.240926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.240989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.241032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.241035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.241108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.241166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.241225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.241285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.241640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.241657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.241724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289303:4939], now have 1 active actors on pipe
2025-10-10T14:37:27.242083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:27.242179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:27.242188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:27.242235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2343 reason: error at write: Disconnected sessionId: src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0
2025-10-10T14:37:27.242394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602206642289303:4939]
2025-10-10T14:37:27.242463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2343 sessionId: src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0 is DEAD
2025-10-10T14:37:27.242652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:27.242665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0] Write session will restart in 0.006961s
2025-10-10T14:37:27.242690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0] Write session: Do CDS request
2025-10-10T14:37:27.242697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:27.243048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:27.252746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.253142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:27.253173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2344
2025-10-10T14:37:27.253346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.253387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:27.253400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:27.253405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:27.254041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2344 sessionId:  describe result for acl check
2025-10-10T14:37:27.254092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:27.254103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:27.254105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:27.254113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602206642289360:10245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:27.254704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602206642289360:10245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:27.257135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602206642289360:10245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:27.260981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602206642289360:10245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:27.261001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602206642289360:10245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:27.261005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602206642289360:10245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:27.261015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:27.262874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:27.266792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:27.267172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:27.267188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:27.267204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:27.267304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:27.267373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602205860057995:10622]
2025-10-10T14:37:27.268048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:27.268477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:27.268537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:27.268917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:27.268991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.268999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.269001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.269002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.269003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.269005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.269006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.269007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.269009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.269010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.269011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.269012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.269013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.269021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.269035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.269039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.269044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.269049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.269054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.269058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.269063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.269068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.269073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.269076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.269080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.269084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.269096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.269106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.269114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.269120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.269125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.269132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.269136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.269142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.269147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.269153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.269158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.269162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.269167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.269173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.269178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.269184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.269197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.269203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.269213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.269220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.269225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.269236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.269240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.269251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.269256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.269261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.269305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:27.272164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:27.272517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:27.272530Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:27.272532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:27.272537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:27.272544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2343 [2:7559602205860057995:10622]
2025-10-10T14:37:27.272558Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:27.272578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:27.272582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.272586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.272589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.272608Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:27.272620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:27.272633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:27.272699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.272706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.272707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.272710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:27.272793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:27.272801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.272812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.272823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.272848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:27.272877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289488:10245], now have 1 active actors on pipe
2025-10-10T14:37:27.272886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289318:2438], now have 1 active actors on pipe
2025-10-10T14:37:27.272894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602205860057990:10622]
2025-10-10T14:37:27.272901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602205860057990:10622]
2025-10-10T14:37:27.272903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602205860057990:10622]
2025-10-10T14:37:27.272917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:27.272936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:27.272951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:27.272956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:27.272958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:27.272958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:27.272961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:27.272989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602205860057990:10622]
2025-10-10T14:37:27.272998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:27.272949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2343
2025-10-10T14:37:27.272999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:27.272950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2343
2025-10-10T14:37:27.273029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.273039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.273078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:27.273091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.273095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.273102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:27.273121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.273138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:27.273160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.273325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.273349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.273367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.273471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2344 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0
2025-10-10T14:37:27.273975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4528c508-33ad56d-96c81b15-ee6dd2ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:27.277011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0] Write session: try to update token
2025-10-10T14:37:27.277032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:27.294801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId: src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:27.296356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:27.296377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:27.296381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:27.296383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:27.296393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602205860057990:10622]
2025-10-10T14:37:27.296398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602205860057990:10622]
2025-10-10T14:37:27.296403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602205860057990:10622]
2025-10-10T14:37:27.296443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:27.296448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:27.296453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:27.296456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:27.296464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.296468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:27.296625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:27.297659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:27.342925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602206642289503:4939]
2025-10-10T14:37:27.343408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2343, pipe: [1:7559602206642289503:4939]
2025-10-10T14:37:27.414963Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:27.415624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.415641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.415681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289503:4939], now have 1 active actors on pipe
2025-10-10T14:37:27.415896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:27.416135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:27.416169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:27.416277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2344 reason: error at write: Disconnected sessionId: src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0
2025-10-10T14:37:27.416500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2344 sessionId: src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0 is DEAD
2025-10-10T14:37:27.416693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:27.416705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0] Write session will restart in 0.006965s
2025-10-10T14:37:27.416732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0] Write session: Do CDS request
2025-10-10T14:37:27.416738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:27.416751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602206642289503:4939]
2025-10-10T14:37:27.416784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:27.425145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.425294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:27.425326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2345
2025-10-10T14:37:27.425550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.425597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:27.425603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:27.425608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:27.426069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2345 sessionId:  describe result for acl check
2025-10-10T14:37:27.426096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:27.426098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:27.426100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:27.426106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602206642289521:10249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:27.426736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602206642289521:10249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:27.430611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602206642289521:10249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:27.435417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602206642289521:10249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:27.435442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602206642289521:10249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:27.435446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602206642289521:10249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:27.435457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:27.448824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:27.452920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:27.453416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:27.453435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:27.453453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:27.453536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:27.453603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602205860058178:10624]
2025-10-10T14:37:27.454309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:27.454736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:27.454800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:27.455138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:27.455218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.455225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.455226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.455228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.455230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.455231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.455233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.455235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.455237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.455238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.455240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.455242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.455243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.455261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.455273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.455278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.455282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.455286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.455290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.455294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.455297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.455302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.455307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.455311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.455314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.455318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.455328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.455336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.455342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.455349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.455354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.455360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.455365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.455371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.455376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.455382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.455387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.455393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.455401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.455406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.455426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.455438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.455443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.455453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.455457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.455462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.455466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.455474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.455478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.455489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.455494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.455503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.455542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:27.458506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:27.458916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:27.458935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:27.458939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:27.458944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:27.458954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2344 [2:7559602205860058178:10624]
2025-10-10T14:37:27.458972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:27.458991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:27.458995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.458999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.459001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.459018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:27.459032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:27.459045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:27.459118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.459126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.459129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.459132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:27.459223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:27.459232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.459245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.459274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.459291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:27.459316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602205860058172:10624]
2025-10-10T14:37:27.459325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602205860058172:10624]
2025-10-10T14:37:27.459329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602205860058172:10624]
2025-10-10T14:37:27.459340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:27.459352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:27.459356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:27.459361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289678:10249], now have 1 active actors on pipe
2025-10-10T14:37:27.459363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:27.459370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:27.459386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:27.459396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:27.459402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289505:2438], now have 1 active actors on pipe
2025-10-10T14:37:27.459431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602205860058172:10624]
2025-10-10T14:37:27.459446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:27.459465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:27.459447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2344
2025-10-10T14:37:27.459495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2344
2025-10-10T14:37:27.459505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.459516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.459546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d57b069-cae77180-c65b6539-999808c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:27.459554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.459559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.459561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:27.459575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.459590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:27.459609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.459855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.459866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.459882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.460008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2345 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d57b069-cae77180-c65b6539-999808c2_0
2025-10-10T14:37:27.460463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b590a6a-a57f6836-e3998d7a-e9c3ce30_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d57b069-cae77180-c65b6539-999808c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:27.464051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d57b069-cae77180-c65b6539-999808c2_0] Write session: try to update token
2025-10-10T14:37:27.464073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d57b069-cae77180-c65b6539-999808c2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:27.478113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:27.478139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:27.478154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602205860058172:10624]
2025-10-10T14:37:27.478222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:27.478417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:27.478575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:27.478730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:27.478886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:27.479104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:27.479149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:27.479488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:27.487903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId: src_id|3d57b069-cae77180-c65b6539-999808c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:27.491240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:27.491700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.491732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.491789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:27.491962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:27.494058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:27.494080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:27.494083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:27.494084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:27.494093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602205860058172:10624]
2025-10-10T14:37:27.494096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602205860058172:10624]
2025-10-10T14:37:27.494099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602205860058172:10624]
2025-10-10T14:37:27.494147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:27.494156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.494154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:27.494158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:27.494162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:27.494167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:27.494289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:27.516846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602206642289693:4939]
2025-10-10T14:37:27.518289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2344, pipe: [1:7559602206642289693:4939]
2025-10-10T14:37:27.610795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:27.611361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289693:4939], now have 1 active actors on pipe
2025-10-10T14:37:27.619809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.619846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.620050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.620111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.620182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.620251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.620302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.620307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.620382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.620443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.620503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.620572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.620615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.620619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.620695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.620759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.620827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.620890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.620936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.620939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.621016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.621081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.621148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.621212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.621255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.621258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.624224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d57b069-cae77180-c65b6539-999808c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:27.624252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d57b069-cae77180-c65b6539-999808c2_0] Write session will restart in 0.008330s
2025-10-10T14:37:27.623728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:27.624280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d57b069-cae77180-c65b6539-999808c2_0] Write session: Do CDS request
2025-10-10T14:37:27.623751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:27.624286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d57b069-cae77180-c65b6539-999808c2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:27.623754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602206642289693:4939]
2025-10-10T14:37:27.623785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:27.623786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2345 reason: error at write: Disconnected sessionId: src_id|3d57b069-cae77180-c65b6539-999808c2_0
2025-10-10T14:37:27.624005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2345 sessionId: src_id|3d57b069-cae77180-c65b6539-999808c2_0 is DEAD
2025-10-10T14:37:27.621518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.621591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.621656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.621717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.621759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.621763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.621835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.621895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.621957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.622018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.622063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.622067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.622148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.622205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.622271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.622332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.622376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.622380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.622451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.622511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.622576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.622638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.622687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.622691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.622759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.622819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.622882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.622943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.622989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.622993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.623065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.623127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.623192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.623271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.623316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.623320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.624627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:27.633929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d57b069-cae77180-c65b6539-999808c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.635666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:27.635690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2346
2025-10-10T14:37:27.635940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.635975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:27.635981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:27.635986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:27.636535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2346 sessionId:  describe result for acl check
2025-10-10T14:37:27.636575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:27.636584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:27.636587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:27.636592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602206642289746:10253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:27.637209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602206642289746:10253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:27.640765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602206642289746:10253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:27.644338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:27.644392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602206642289746:10253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:27.644409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602206642289746:10253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:27.644413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602206642289746:10253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:27.644423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:27.648320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:27.648616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:27.648621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:27.648634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:27.648690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:27.648733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602205860058364:10626]
2025-10-10T14:37:27.649429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:27.649915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:27.649964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:27.650300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:27.650373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.650374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.650375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.650377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.650378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.650379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.650380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.650381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.650382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.650383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.650384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.650386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.650387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.650392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.650403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.650407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.650411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.650415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.650419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.650423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.650428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.650432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.650436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.650440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.650444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.650448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.650455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.650463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.650469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.650475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.650479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.650486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.650491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.650496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.650501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.650506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.650511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.650516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.650520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.650526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.650531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.650536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.650541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.650547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.650560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.650565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.650571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.650577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.650581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.650586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.650590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.650595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.650635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:27.654646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2345
2025-10-10T14:37:27.654650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2345
2025-10-10T14:37:27.655118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2346 partition: 0 MaxSeqNo: 40 sessionId: src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0
2025-10-10T14:37:27.655587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d57b069-cae77180-c65b6539-999808c2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:27.653880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:27.654210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:27.654216Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:27.654219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:27.654223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:27.654235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2345 [2:7559602205860058364:10626]
2025-10-10T14:37:27.654263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:27.654284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:27.654288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.654293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.654296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.654315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:27.654323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:27.654331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:27.654399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.654402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.654404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.654407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:27.654479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:27.654482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.654493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.654503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.654519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:27.654541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289870:10253], now have 1 active actors on pipe
2025-10-10T14:37:27.654545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289695:2438], now have 1 active actors on pipe
2025-10-10T14:37:27.654553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602205860058358:10626]
2025-10-10T14:37:27.654555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602205860058358:10626]
2025-10-10T14:37:27.654558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602205860058358:10626]
2025-10-10T14:37:27.654568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:27.654575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:27.654577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:27.654579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:27.654583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:27.654599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:27.654603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:27.654637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602205860058358:10626]
2025-10-10T14:37:27.654646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:27.654653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:27.654766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.654772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.654802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:27.654811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.654816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.654819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:27.654831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.654842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:27.654856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.655004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.655007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.655022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.658598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0] Write session: try to update token
2025-10-10T14:37:27.658620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:27.668200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:27.668228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:27.668240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602205860058358:10626]
2025-10-10T14:37:27.668291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:27.668296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:27.668648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:27.668939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:27.669247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:27.669517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:27.669922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:27.669993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:27.673432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId: src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:27.676045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:27.676524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.676546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.676579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:27.676678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:27.690710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:27.690734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:27.690738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:27.690741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:27.690753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602205860058358:10626]
2025-10-10T14:37:27.690759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602205860058358:10626]
2025-10-10T14:37:27.690764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602205860058358:10626]
2025-10-10T14:37:27.690824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:27.690835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.690838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:27.691011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:27.693755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:27.693777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:27.693783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:27.723750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602206642289883:4939]
2025-10-10T14:37:27.724176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2345, pipe: [1:7559602206642289883:4939]
2025-10-10T14:37:27.819325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:27.828690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.828725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.828928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.829002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.829074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.829143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.829675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.829691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.829765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.829835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.829905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.829980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.830195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.830210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.830282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.830345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.830415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.830480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.830527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.830534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.830603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.830668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.830732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.830798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.830843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.830850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.830915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.830978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.831042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.831106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.831151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.831158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.831225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.831298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.831362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.831424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.831471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.831478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.831543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.831604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.831673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.831737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.831809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.831817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.831882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.831945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.832009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.832074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.832119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.832126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.832190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.832251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.832313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.832384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.832433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.832439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.832511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:27.832587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:27.832655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:27.832724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:27.832772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:27.832783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:27.832863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289883:4939], now have 1 active actors on pipe
2025-10-10T14:37:27.833289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:27.833291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:27.833315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:27.833320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:27.833371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2346 reason: error at write: Disconnected sessionId: src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0
2025-10-10T14:37:27.833399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602206642289883:4939]
2025-10-10T14:37:27.833590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2346 sessionId: src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0 is DEAD
2025-10-10T14:37:27.833752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:27.833763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0] Write session will restart in 0.008621s
2025-10-10T14:37:27.833784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0] Write session: Do CDS request
2025-10-10T14:37:27.833789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:27.843935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.844045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:27.844071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2347
2025-10-10T14:37:27.844186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:27.844230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:27.844236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:27.844240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:27.844720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2347 sessionId:  describe result for acl check
2025-10-10T14:37:27.844767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:27.844774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:27.844776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:27.844782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602206642289908:10258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:27.845462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602206642289908:10258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:27.851273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602206642289908:10258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:27.854871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602206642289908:10258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:27.854893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602206642289908:10258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:27.854896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602206642289908:10258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:27.854914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:27.855295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:27.858329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:27.858587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:27.858600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:27.858611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:27.858663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:27.858715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602205860058549:10628]
2025-10-10T14:37:27.859484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:27.859946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:27.859998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:27.860366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:27.860436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.860442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.860444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.860445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.860446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.860448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.860449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.860451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.860452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.860454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.860455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.860456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.860458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.860464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.860477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.860482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.860487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.860491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.860496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.860501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.860505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.860509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.860514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.860519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.860524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.860528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.860536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.860546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:27.860553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.860560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:27.860565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.860571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:27.860577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.860582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:27.860588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.860594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:27.860608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.860614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:27.860620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.860626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:27.860663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.860670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:27.860676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.860683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:27.860689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.860695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:27.860700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.860706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.860717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.860723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.860728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.860734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.860781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:27.863625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:27.864038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:27.864044Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:27.864048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:27.864052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:27.864059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2346 [2:7559602205860058549:10628]
2025-10-10T14:37:27.864073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:27.864092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:27.864094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.864097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.864100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.864116Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:27.864124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:27.864131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:27.864211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.864214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.864217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.864219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:27.864296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:27.864300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.864311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:27.864324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:27.864340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:27.864357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602205860058543:10628]
2025-10-10T14:37:27.864360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602205860058543:10628]
2025-10-10T14:37:27.864362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602205860058543:10628]
2025-10-10T14:37:27.864372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:27.864386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:27.864393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:27.864396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:27.864401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:27.864404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:27.864409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:27.864431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602205860058543:10628]
2025-10-10T14:37:27.864434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:27.864436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:27.864443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642289893:2438], now have 1 active actors on pipe
2025-10-10T14:37:27.864447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642290069:10258], now have 1 active actors on pipe
2025-10-10T14:37:27.864636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.864643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.864681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:27.864690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:27.864695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:27.864698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:27.864711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:27.864724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:27.864738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.864536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2346
2025-10-10T14:37:27.864545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2346
2025-10-10T14:37:27.865067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:27.865082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:27.865099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:27.867861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2347 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0
2025-10-10T14:37:27.868334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec8b80c-58b28374-33bbad8e-9f026dd6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:27.871960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0] Write session: try to update token
2025-10-10T14:37:27.871986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:27.888024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:27.888068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:27.888074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:27.888077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:27.888093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602205860058543:10628]
2025-10-10T14:37:27.888100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602205860058543:10628]
2025-10-10T14:37:27.888106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602205860058543:10628]
2025-10-10T14:37:27.888180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:27.888182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:27.888192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:27.888196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:27.888207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:27.888213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:27.888385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:27.895673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId: src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:27.899071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:27.933654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602206642290082:4939]
2025-10-10T14:37:27.934464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2346, pipe: [1:7559602206642290082:4939]
2025-10-10T14:37:28.012181Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:28.012848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.012868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.012895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602206642290082:4939], now have 1 active actors on pipe
2025-10-10T14:37:28.013187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:28.013273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:28.013287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:28.013291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:28.013370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602206642290082:4939]
2025-10-10T14:37:28.013794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:28.013808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0] Write session will restart in 0.007985s
2025-10-10T14:37:28.013835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0] Write session: Do CDS request
2025-10-10T14:37:28.013841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:28.013395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2347 reason: error at write: Disconnected sessionId: src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0
2025-10-10T14:37:28.013613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2347 sessionId: src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0 is DEAD
2025-10-10T14:37:28.024170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.024360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:28.024389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2348
2025-10-10T14:37:28.024574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.024626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:28.024631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:28.024635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:28.025086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2348 sessionId:  describe result for acl check
2025-10-10T14:37:28.025123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:28.025126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:28.025128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:28.025134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602210937257402:10263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:28.025561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602210937257402:10263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:28.032245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602210937257402:10263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:28.034146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:28.036964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:28.037237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:28.037253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:28.037268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:28.037358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:28.037361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602210937257402:10263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:28.037403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602210155026061:10641]
2025-10-10T14:37:28.037381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602210937257402:10263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:28.037385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602210937257402:10263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:28.037396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:28.038047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:28.038423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:28.038481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:28.038818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:28.038900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.038907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.038908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.038909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.038911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.038912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.038914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.038915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.038917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.038918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.038919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.038921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.038922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.038928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.038941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.038945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.038949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.038953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.038956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.038960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.038964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.038968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.038972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.038976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.038980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.038984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.038993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.039002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.039010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.039015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.039023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.039029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.039035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.039041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.039046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.039051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.039056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.039062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.039066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.039072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.039084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.039089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.039095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.039103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.039107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.039117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.039122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.039127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.039135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.039140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.039145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.039150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.039195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:28.041962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:28.042486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:28.042503Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:28.042505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:28.042509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:28.042516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2347 [2:7559602210155026061:10641]
2025-10-10T14:37:28.042530Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:28.042548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:28.042552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.042555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.042558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.042575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:28.042589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:28.042599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:28.042662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.042671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.042673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.042676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:28.042750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:28.042760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.042773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.042793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.042816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:28.042844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257575:10263], now have 1 active actors on pipe
2025-10-10T14:37:28.042854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257379:2438], now have 1 active actors on pipe
2025-10-10T14:37:28.042863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602210155026056:10641]
2025-10-10T14:37:28.042869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602210155026056:10641]
2025-10-10T14:37:28.042872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602210155026056:10641]
2025-10-10T14:37:28.042889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:28.042908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:28.042931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:28.042939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:28.042964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602210155026056:10641]
2025-10-10T14:37:28.042973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:28.042991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:28.043008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:28.043011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:28.043019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:28.043353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2347
2025-10-10T14:37:28.043408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2347
2025-10-10T14:37:28.043438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.043453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.043492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d652d026-afc623f7-1b3822b2-f84707d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:28.043506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.043515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.043518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:28.043534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.043552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:28.043575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.043760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.043770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.043786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.043915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2348 partition: 0 MaxSeqNo: 40 sessionId: src_id|d652d026-afc623f7-1b3822b2-f84707d_0
2025-10-10T14:37:28.044355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ffb40dd-f5be38ba-1b938aab-95b7363a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d652d026-afc623f7-1b3822b2-f84707d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:28.047798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d652d026-afc623f7-1b3822b2-f84707d_0] Write session: try to update token
2025-10-10T14:37:28.047816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d652d026-afc623f7-1b3822b2-f84707d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:28.059620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:28.059647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:28.059659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602210155026056:10641]
2025-10-10T14:37:28.059722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:28.059923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:28.060099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.060325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.060574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.060820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:28.060874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:28.061040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:28.067326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId: src_id|d652d026-afc623f7-1b3822b2-f84707d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:28.070682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:28.071177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:28.070992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.071022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.071081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:28.079301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:28.079321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:28.079324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:28.079326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:28.079336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602210155026056:10641]
2025-10-10T14:37:28.079340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602210155026056:10641]
2025-10-10T14:37:28.079343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602210155026056:10641]
2025-10-10T14:37:28.079398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:28.079401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:28.079406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.079406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:28.079408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:28.079411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:28.079550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:28.113386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602210937257598:4939]
2025-10-10T14:37:28.113729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2347, pipe: [1:7559602210937257598:4939]
2025-10-10T14:37:28.200609Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:28.209375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.209407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.209595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.209663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.209728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.209794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.209843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.209852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.209930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.209997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.210065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.210136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.210277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.210290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.210360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.210425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.210490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.210558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.210603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.210606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.210677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.210743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.210811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.210884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.210931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.210938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.211006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.211073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.211141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.211205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.211261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.211269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.211338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.211399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.211463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.211531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.211578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.211590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.211656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.211720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.211788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.211851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.211895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.211903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.211973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.212034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.212099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.212163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.212212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.212220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.212290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.212354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.212418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.212485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.212531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.212540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.212609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.212673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.212740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.212806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.212853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.212860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.212925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257598:4939], now have 1 active actors on pipe
2025-10-10T14:37:28.213223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602210937257598:4939]
2025-10-10T14:37:28.213275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:28.213279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:28.213280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:28.213324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2348 reason: error at write: Disconnected sessionId: src_id|d652d026-afc623f7-1b3822b2-f84707d_0
2025-10-10T14:37:28.213562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2348 sessionId: src_id|d652d026-afc623f7-1b3822b2-f84707d_0 is DEAD
2025-10-10T14:37:28.213743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d652d026-afc623f7-1b3822b2-f84707d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:28.213755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d652d026-afc623f7-1b3822b2-f84707d_0] Write session will restart in 0.008458s
2025-10-10T14:37:28.213794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d652d026-afc623f7-1b3822b2-f84707d_0] Write session: Do CDS request
2025-10-10T14:37:28.213801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d652d026-afc623f7-1b3822b2-f84707d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:28.214119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:28.223948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d652d026-afc623f7-1b3822b2-f84707d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.224087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:28.224113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2349
2025-10-10T14:37:28.224281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.224318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:28.224325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:28.224329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:28.224920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2349 sessionId:  describe result for acl check
2025-10-10T14:37:28.224961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:28.224969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:28.224974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:28.224980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602210937257637:10276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:28.225731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602210937257637:10276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:28.228407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602210937257637:10276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:28.231451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602210937257637:10276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:28.231467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602210937257637:10276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:28.231471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602210937257637:10276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:28.231480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:28.232401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:28.234843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:28.235191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:28.235205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:28.235219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:28.235298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:28.235352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602210155026270:10647]
2025-10-10T14:37:28.236033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:28.236482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:28.236586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:28.236980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:28.237078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.237087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.237089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.237090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.237092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.237093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.237094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.237096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.237097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.237099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.237100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.237101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.237103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.237110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.237122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.237127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.237132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.237136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.237140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.237145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.237149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.237153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.237158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.237162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.237167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.237171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.237179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.237188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.237196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.237202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.237215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.237222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.237227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.237233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.237239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.237245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.237250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.237256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.237262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.237268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.237273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.237279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.237285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.237291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.237296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.237302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.237308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.237315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.237320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.237326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.237347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.237352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.237391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:28.240217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:28.240630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:28.240643Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:28.240647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:28.240651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:28.240660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2348 [2:7559602210155026270:10647]
2025-10-10T14:37:28.240675Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:28.240693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:28.240703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.240707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.240710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.240724Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:28.240731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:28.240738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:28.240810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.240820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.240823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.240826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:28.240899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:28.240908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.240920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.240932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.240961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:28.240980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257790:10276], now have 1 active actors on pipe
2025-10-10T14:37:28.240985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257601:2438], now have 1 active actors on pipe
2025-10-10T14:37:28.240993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602210155026265:10647]
2025-10-10T14:37:28.240996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602210155026265:10647]
2025-10-10T14:37:28.240999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602210155026265:10647]
2025-10-10T14:37:28.241014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:28.241028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:28.241039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:28.241044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:28.241047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:28.241053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:28.241056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:28.241082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602210155026265:10647]
2025-10-10T14:37:28.241098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:28.241072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2348
2025-10-10T14:37:28.241132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:28.241161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.241078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2348
2025-10-10T14:37:28.241165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.241190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c144d620-a33e001e-edc6fc02-262882ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:28.241203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.241207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.241210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:28.241220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.241236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:28.241255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.241530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.241548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.241573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.241720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2349 partition: 0 MaxSeqNo: 40 sessionId: src_id|c144d620-a33e001e-edc6fc02-262882ad_0
2025-10-10T14:37:28.242190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d652d026-afc623f7-1b3822b2-f84707d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c144d620-a33e001e-edc6fc02-262882ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:28.245193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c144d620-a33e001e-edc6fc02-262882ad_0] Write session: try to update token
2025-10-10T14:37:28.245211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c144d620-a33e001e-edc6fc02-262882ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:28.253724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:28.253748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:28.253759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602210155026265:10647]
2025-10-10T14:37:28.253807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:28.253812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:28.254025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:28.254203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.254377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.254553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.254793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:28.254843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:28.261004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId: src_id|c144d620-a33e001e-edc6fc02-262882ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:28.264328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:28.264716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.264742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.264792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:28.264877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:28.273858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:28.273884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:28.273887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:28.273889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:28.273901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602210155026265:10647]
2025-10-10T14:37:28.273905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602210155026265:10647]
2025-10-10T14:37:28.273910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602210155026265:10647]
2025-10-10T14:37:28.273966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:28.273976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.273982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:28.273980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:28.273990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:28.273995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:28.274143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:28.313605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602210937257804:4939]
2025-10-10T14:37:28.314024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2348, pipe: [1:7559602210937257804:4939]
2025-10-10T14:37:28.394245Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:28.404690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.404728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.404937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.405009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.405082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.405153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.409033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:28.409034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602210937257804:4939]
2025-10-10T14:37:28.409068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:28.409076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:28.409104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2349 reason: error at write: Disconnected sessionId: src_id|c144d620-a33e001e-edc6fc02-262882ad_0
2025-10-10T14:37:28.409636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c144d620-a33e001e-edc6fc02-262882ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:28.409651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c144d620-a33e001e-edc6fc02-262882ad_0] Write session will restart in 0.008342s
2025-10-10T14:37:28.409679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c144d620-a33e001e-edc6fc02-262882ad_0] Write session: Do CDS request
2025-10-10T14:37:28.409685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c144d620-a33e001e-edc6fc02-262882ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:28.405817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.405834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.405912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.405968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.406031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.406094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.406134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.406138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.406212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.406277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.406338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.406399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.406440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.406444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.406510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.406572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.406633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.406691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.406732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.409324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2349 sessionId: src_id|c144d620-a33e001e-edc6fc02-262882ad_0 is DEAD
2025-10-10T14:37:28.406735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.406802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.406860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.406920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.406979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.407018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.407021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.407087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.407145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.407202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.407282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.407325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.407331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.407399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.407455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.407518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.407578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.407617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.407620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.407688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.407742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.407799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.407860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.407901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.407905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.407967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.408022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.408078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.408139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.408178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.408181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.408245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.408300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.408358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.408417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.408456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.408459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.408546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257804:4939], now have 1 active actors on pipe
2025-10-10T14:37:28.410102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:28.422126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c144d620-a33e001e-edc6fc02-262882ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.426005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:28.426034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2350
2025-10-10T14:37:28.426245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.426285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:28.426309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:28.426324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:28.427173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2350 sessionId:  describe result for acl check
2025-10-10T14:37:28.427219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:28.427245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:28.427247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:28.427256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602210937257938:10280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:28.427762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602210937257938:10280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:28.432480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602210937257938:10280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:28.435422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:28.439129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602210937257938:10280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:28.439151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602210937257938:10280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:28.439155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602210937257938:10280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:28.439164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:28.438878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:28.439142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:28.439148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:28.439161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:28.439225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:28.439273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602210155026457:10649]
2025-10-10T14:37:28.439981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:28.440327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:28.440366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:28.440635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:28.440689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.440690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.440691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.440693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.440695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.440696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.440697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.440699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.440700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.440702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.440703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.440704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.440705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.440711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.440725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.440729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.440734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.440738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.440742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.440746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.440750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.440753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.440758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.440762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.440766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.440771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.440780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.440790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.440797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.440803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.440807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.440812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.440817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.440823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.440828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.440833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.440838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.440843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.440847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.440850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.440854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.440857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.440860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.440864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.440866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.440869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.440873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.440877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.440880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.440883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.440886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.440889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.440914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:28.445174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2349
2025-10-10T14:37:28.445202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2349
2025-10-10T14:37:28.444255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:28.444587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:28.444593Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:28.444596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:28.444601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:28.444610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2349 [2:7559602210155026457:10649]
2025-10-10T14:37:28.444625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:28.444645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:28.444649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.444653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.444656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.444677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:28.444686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:28.444695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:28.444765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.444768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.444770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.444773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:28.444852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:28.444856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.444868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.444878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.444894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:28.444917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602210155026451:10649]
2025-10-10T14:37:28.444920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602210155026451:10649]
2025-10-10T14:37:28.444922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602210155026451:10649]
2025-10-10T14:37:28.444938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:28.444958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257807:2438], now have 1 active actors on pipe
2025-10-10T14:37:28.444961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257987:10280], now have 1 active actors on pipe
2025-10-10T14:37:28.444970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:28.444970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:28.444973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:28.444975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:28.444986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:28.444989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:28.445025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602210155026451:10649]
2025-10-10T14:37:28.445036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:28.445062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:28.445344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.445354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.445392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edb82901-285ca8b9-dc12df24-c109f529_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:28.445402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.445407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.445410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:28.445424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.445439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:28.445457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.446330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2350 partition: 0 MaxSeqNo: 40 sessionId: src_id|edb82901-285ca8b9-dc12df24-c109f529_0
2025-10-10T14:37:28.446762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c144d620-a33e001e-edc6fc02-262882ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|edb82901-285ca8b9-dc12df24-c109f529_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:28.445952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.445969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.445992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.450057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edb82901-285ca8b9-dc12df24-c109f529_0] Write session: try to update token
2025-10-10T14:37:28.450075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edb82901-285ca8b9-dc12df24-c109f529_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:28.468340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId: src_id|edb82901-285ca8b9-dc12df24-c109f529_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:28.472178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:28.472816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.472842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.472892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:28.475123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:28.475144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:28.475148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:28.475150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:28.475159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602210155026451:10649]
2025-10-10T14:37:28.475164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602210155026451:10649]
2025-10-10T14:37:28.475167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602210155026451:10649]
2025-10-10T14:37:28.475216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:28.475224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.475243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:28.475390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:28.473073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:28.477530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:28.477546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:28.477551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:28.509171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602210937257998:4939]
2025-10-10T14:37:28.510501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2349, pipe: [1:7559602210937257998:4939]
2025-10-10T14:37:28.628541Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:28.637612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.637648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.637839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.641172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:28.641173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602210937257998:4939]
2025-10-10T14:37:28.641204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:28.641212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:28.641237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2350 reason: error at write: Disconnected sessionId: src_id|edb82901-285ca8b9-dc12df24-c109f529_0
2025-10-10T14:37:28.637918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.637993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.638070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.638119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.638124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.638201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.638262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.638327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.638391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.638435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.638439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.638513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.638576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.638637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.638704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.638745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.638748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.638816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.638877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.638941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.639000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.639044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.639047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.639116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.641443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2350 sessionId: src_id|edb82901-285ca8b9-dc12df24-c109f529_0 is DEAD
2025-10-10T14:37:28.639174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.639256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.639323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.639361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.639363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.639432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.639492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.639553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.639616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.639663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.639669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.639741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.639798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.639866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.639933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.639980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.639983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.640051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.640109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.640169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.640225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.640270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.640273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.640345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.640401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.640454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.640515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.640560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.640564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.640628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.640686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.640745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.640806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.640848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.640850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.640932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937257998:4939], now have 1 active actors on pipe
2025-10-10T14:37:28.642506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:28.645423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edb82901-285ca8b9-dc12df24-c109f529_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:28.645435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edb82901-285ca8b9-dc12df24-c109f529_0] Write session will restart in 0.009426s
2025-10-10T14:37:28.645461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edb82901-285ca8b9-dc12df24-c109f529_0] Write session: Do CDS request
2025-10-10T14:37:28.645468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edb82901-285ca8b9-dc12df24-c109f529_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:28.655971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edb82901-285ca8b9-dc12df24-c109f529_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.656046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:28.656072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2351
2025-10-10T14:37:28.656233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.656282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:28.656293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:28.656297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:28.656774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2351 sessionId:  describe result for acl check
2025-10-10T14:37:28.656815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:28.656822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:28.656825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:28.656832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602210937258088:10284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:28.657457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602210937258088:10284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:28.661000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:28.663683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602210937258088:10284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:28.663828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:28.664122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:28.664136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:28.664150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:28.664213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:28.664257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602210155026648:10651]
2025-10-10T14:37:28.664884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:28.665252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:28.665307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:28.665692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:28.665754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.665764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.665765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.665766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.665768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.665769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.665771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.665772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.665773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.665775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.665776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.665777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.665779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.665785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.665799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.665803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.665808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.665812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.665816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.665820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.665824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.665827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.665832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.665836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.665840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.665844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.665853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.665862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.665868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.665873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.665877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.665882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.665889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.665895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.665900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.665913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.665918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.665928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.665933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.665944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.665949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.665959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.665964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.665969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.665974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.665979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.665984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.665991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.666000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.666006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.666011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.666020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.666062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:28.668515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:28.668869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:28.668881Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:28.668884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:28.668888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:28.668894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2350 [2:7559602210155026648:10651]
2025-10-10T14:37:28.668907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:28.668926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:28.668935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.668939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.668945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.668962Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:28.668978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:28.668986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:28.669041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.669049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.669051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.669053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:28.669119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:28.669129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.669141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.669151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.669168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:28.669196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937258001:2438], now have 1 active actors on pipe
2025-10-10T14:37:28.669211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602210155026643:10651]
2025-10-10T14:37:28.669218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602210155026643:10651]
2025-10-10T14:37:28.669220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602210155026643:10651]
2025-10-10T14:37:28.669234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:28.669249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:28.669256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:28.669260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:28.669262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:28.669270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:28.669274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:28.669305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602210155026643:10651]
2025-10-10T14:37:28.669318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:28.669346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:28.669225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2350
2025-10-10T14:37:28.674747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602210937258088:10284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:28.674767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602210937258088:10284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:28.674771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602210937258088:10284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:28.674781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:28.676355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2350
2025-10-10T14:37:28.677049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2351 partition: 0 MaxSeqNo: 40 sessionId: src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0
2025-10-10T14:37:28.675364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937258189:10284], now have 1 active actors on pipe
2025-10-10T14:37:28.676484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.676494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.676539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:28.676553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.676559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.676563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:28.676579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.676599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:28.676631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.676921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.676926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.676954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.677521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edb82901-285ca8b9-dc12df24-c109f529_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:28.680368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0] Write session: try to update token
2025-10-10T14:37:28.680403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:28.687606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:28.687638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:28.687650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602210155026643:10651]
2025-10-10T14:37:28.687708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:28.687722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:28.687948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:28.688112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.688288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.688451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:28.688694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:28.688733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:28.697510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2351 sessionId: src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:28.700376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:28.702806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.702839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.702880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:28.703055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:28.710657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:28.710684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:28.710689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:28.710692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:28.710705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602210155026643:10651]
2025-10-10T14:37:28.710710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602210155026643:10651]
2025-10-10T14:37:28.710715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602210155026643:10651]
2025-10-10T14:37:28.710779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:28.710783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:28.710790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.710793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:28.710793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:28.710798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:28.710996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:28.741617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602210937258196:4939]
2025-10-10T14:37:28.743579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2350, pipe: [1:7559602210937258196:4939]
2025-10-10T14:37:28.838958Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:28.850634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.850676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.850914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.851006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.851101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.851191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.851281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.851293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.851391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.851472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.851554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.851643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.851707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.851718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.851812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.851899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.851986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.852072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.852136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.852145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.852242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.852348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.852437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.852527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.852590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.852604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.852695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.852775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.852860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.852950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.853021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.853034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.853134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.853212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.853298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.853414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.853484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.853495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.853598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.853687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.853791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.853883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.856218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:28.856237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0] Write session will restart in 0.009879s
2025-10-10T14:37:28.856271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0] Write session: Do CDS request
2025-10-10T14:37:28.855731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:28.855757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:28.856279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:28.855810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2351 reason: error at write: Disconnected sessionId: src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0
2025-10-10T14:37:28.856000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2351 sessionId: src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0 is DEAD
2025-10-10T14:37:28.856184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:28.856226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602210937258196:4939]
2025-10-10T14:37:28.853957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.853968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.854065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.854138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.854227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.854317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.854379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.854383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.854483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.854557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.854630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.854710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.854777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.854780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.854872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:28.854956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:28.855040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:28.855118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:28.855179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:28.855182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:28.855283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937258196:4939], now have 1 active actors on pipe
2025-10-10T14:37:28.857030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:28.869908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.873884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:28.873910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2352
2025-10-10T14:37:28.874124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:28.874174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:28.874185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:28.874191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:28.874785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2352 sessionId:  describe result for acl check
2025-10-10T14:37:28.874842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:28.874850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:28.874853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:28.874860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602210937258225:10289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:28.875547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602210937258225:10289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:28.880918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602210937258225:10289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:28.884882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602210937258225:10289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:28.884905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602210937258225:10289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:28.884909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602210937258225:10289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:28.884919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:28.888945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:28.893557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:28.893855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:28.893861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:28.893875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:28.893938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:28.893983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602210155026839:10653]
2025-10-10T14:37:28.894581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:28.894992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:28.895038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:28.895373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:28.895439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.895440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.895441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.895443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.895444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.895445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.895446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.895448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.895449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.895450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.895451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.895453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.895454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.895460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.895474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.895478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.895483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.895487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.895491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.895494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.895497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.895501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.895505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.895508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.895512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.895516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.895525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.895533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:28.895540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.895545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:28.895549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.895554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:28.895558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.895563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:28.895568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.895573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:28.895577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.895582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:28.895587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.895591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:28.895596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.895601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:28.895606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.895610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:28.895615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.895620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:28.895625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.895631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.895635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.895640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.895645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.895650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.895689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:28.899997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2351
2025-10-10T14:37:28.900067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2351
2025-10-10T14:37:28.899104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:28.899487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:28.899492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:28.899495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:28.899499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:28.899506Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2351 [2:7559602210155026839:10653]
2025-10-10T14:37:28.899521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:28.899540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:28.899544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.899547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.899550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.899569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:28.899577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:28.899585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:28.899651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.899654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.899656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.899658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:28.899747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:28.899751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.899761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:28.899772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:28.899787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:28.899809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602210155026834:10653]
2025-10-10T14:37:28.899812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602210155026834:10653]
2025-10-10T14:37:28.899814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602210155026834:10653]
2025-10-10T14:37:28.899824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:28.899838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:28.899843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937258206:2438], now have 1 active actors on pipe
2025-10-10T14:37:28.899845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:28.899848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:28.899850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:28.899865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:28.899869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:28.899875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937258363:10289], now have 1 active actors on pipe
2025-10-10T14:37:28.899900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602210155026834:10653]
2025-10-10T14:37:28.899912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:28.899922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:28.900175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.900181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.900212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:28.900220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:28.900225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:28.900229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:28.900259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:28.900272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:28.900287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.900478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:28.900492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:28.900509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:28.901082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84498b68-56e1c1eb-2f9868f8-2d3f99c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:28.900612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2352 partition: 0 MaxSeqNo: 40 sessionId: src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0
2025-10-10T14:37:28.903983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0] Write session: try to update token
2025-10-10T14:37:28.904009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:28.921998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:28.922029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:28.922034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:28.922038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:28.922052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602210155026834:10653]
2025-10-10T14:37:28.922059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602210155026834:10653]
2025-10-10T14:37:28.922066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602210155026834:10653]
2025-10-10T14:37:28.922132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:28.922139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:28.922147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:28.922149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:28.922152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:28.922154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:28.922453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:28.931597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2352 sessionId: src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:28.935292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:28.961455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602210937258400:4939]
2025-10-10T14:37:28.966146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2351, pipe: [1:7559602210937258400:4939]
2025-10-10T14:37:29.066895Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:29.067595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.067607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.067656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602210937258400:4939], now have 1 active actors on pipe
2025-10-10T14:37:29.068815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:29.068834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:29.068894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2352 reason: error at write: Disconnected sessionId: src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0
2025-10-10T14:37:29.069096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2352 sessionId: src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0 is DEAD
2025-10-10T14:37:29.069301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602210937258400:4939]
2025-10-10T14:37:29.069343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:29.069548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:29.070623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:29.070633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0] Write session will restart in 0.005398s
2025-10-10T14:37:29.070659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0] Write session: Do CDS request
2025-10-10T14:37:29.070669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:29.081832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.090073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:29.090099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2353
2025-10-10T14:37:29.090305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.090354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:29.090367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:29.090372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:29.090959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2353 sessionId:  describe result for acl check
2025-10-10T14:37:29.091002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:29.091010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:29.091013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:29.091019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602215232225730:10297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:29.094014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602215232225730:10297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:29.103528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602215232225730:10297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:29.109245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602215232225730:10297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:29.109271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602215232225730:10297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:29.109275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602215232225730:10297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:29.109284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:29.112263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:29.116511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:29.116836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:29.116849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:29.116863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:29.116930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:29.116981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602214449994359:10667]
2025-10-10T14:37:29.117656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:29.118073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:29.118136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:29.118520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:29.118605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.118612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.118614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.118615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.118616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.118618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.118619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.118620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.118622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.118623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.118624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.118625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.118626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.118633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.118646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.118651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.118655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.118659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.118664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.118668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.118672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.118676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.118682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.118686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.118690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.118694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.118702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.118712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.118719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.118725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.118733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.118751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.118757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.118763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.118769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.118774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.118780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.118785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.118790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.118795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.118798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.118804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.118810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.118815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.118820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.118826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.118831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.118844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.118848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.118854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.118864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.118869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.118910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:29.121814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:29.122149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:29.122175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:29.122178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:29.122182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:29.122190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2352 [2:7559602214449994359:10667]
2025-10-10T14:37:29.122204Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:29.122226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:29.122230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.122234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.122237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.122256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:29.122264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:29.122280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:29.122345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.122356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.122359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.122361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:29.122434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:29.122442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.122454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.122464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.122485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:29.122514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232225890:10297], now have 1 active actors on pipe
2025-10-10T14:37:29.122522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232225702:2438], now have 1 active actors on pipe
2025-10-10T14:37:29.122530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602214449994354:10667]
2025-10-10T14:37:29.122538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602214449994354:10667]
2025-10-10T14:37:29.122541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602214449994354:10667]
2025-10-10T14:37:29.122557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:29.122579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:29.122599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:29.122608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:29.122628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:29.122639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602214449994354:10667]
2025-10-10T14:37:29.122640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:29.122642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:29.122642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:29.122651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:29.122683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.122695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.122726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:29.122741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.122608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2352
2025-10-10T14:37:29.122745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.122670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2352
2025-10-10T14:37:29.122748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:29.122764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.122776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:29.122796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.123019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.123029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.123046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.123130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2353 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0
2025-10-10T14:37:29.123623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d45dc2-8977d06d-1abd9290-d93ca877_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:29.126626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0] Write session: try to update token
2025-10-10T14:37:29.126650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:29.134971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:29.134996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:29.135007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602214449994354:10667]
2025-10-10T14:37:29.135065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:29.135069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:29.135268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:29.135411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:29.135553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:29.135697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:29.135904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:29.135948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:29.146191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2353 sessionId: src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:29.149011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:29.149236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.149269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.149309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:29.149476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:29.155169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:29.155193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:29.155196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:29.155198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:29.155209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602214449994354:10667]
2025-10-10T14:37:29.155231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602214449994354:10667]
2025-10-10T14:37:29.155236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602214449994354:10667]
2025-10-10T14:37:29.155289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:29.155290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:29.155297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:29.155297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.155300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:29.155302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:29.155446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:29.169589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602215232225916:4939]
2025-10-10T14:37:29.169902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2352, pipe: [1:7559602215232225916:4939]
2025-10-10T14:37:29.272764Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:29.273314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232225916:4939], now have 1 active actors on pipe
2025-10-10T14:37:29.281879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.281913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.282114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.282192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.282269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.282337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.282385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.282394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.282472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.282547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.282614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.282683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.282723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.282726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.282801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.282864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.282930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.282998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.283043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.283046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.283120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.283197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.283280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.283351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.283397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.283402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.283474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.283535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.283612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.283676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.283715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.283718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.283790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.283847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.283907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.283970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.284017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.284020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.284093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.284149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.284210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.284269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.284313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.284317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.284386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.284452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.284523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.284594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.284642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.284645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.284717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.284772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.284839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.284901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.284946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.284949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.285023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.285087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.285157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.285221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.285266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.285268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.285997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:29.286145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:29.286173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:29.286206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2353 reason: error at write: Disconnected sessionId: src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0
2025-10-10T14:37:29.286487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2353 sessionId: src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0 is DEAD
2025-10-10T14:37:29.286580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:29.286593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0] Write session will restart in 0.008754s
2025-10-10T14:37:29.286622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0] Write session: Do CDS request
2025-10-10T14:37:29.286629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:29.286717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602215232225916:4939]
2025-10-10T14:37:29.286743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:29.297017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.297631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:29.297654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2354
2025-10-10T14:37:29.297827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.297882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:29.297889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:29.297899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:29.298682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2354 sessionId:  describe result for acl check
2025-10-10T14:37:29.298722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:29.298725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:29.298727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:29.298734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602215232225956:10307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:29.299396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602215232225956:10307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:29.306415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602215232225956:10307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:29.310766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:29.310983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602215232225956:10307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:29.311005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602215232225956:10307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:29.311008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602215232225956:10307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:29.311016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:29.313565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:29.313815Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:29.313826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:29.313840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:29.313901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:29.313943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602214449994570:10672]
2025-10-10T14:37:29.314581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:29.314910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:29.314956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:29.315304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:29.315361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.315369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.315370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.315371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.315372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.315373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.315375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.315376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.315377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.315378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.315380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.315381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.315382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.315388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.315401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.315406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.315410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.315414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.315419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.315423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.315428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.315432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.315437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.315441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.315445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.315449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.315456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.315465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.315472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.315478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.315488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.315493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.315497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.315507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.315512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.315522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.315527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.315532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.315537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.315542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.315547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.315552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.315561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.315567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.315572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.315577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.315582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.315587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.315593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.315598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.315603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.315608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.315650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:29.320871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:29.321677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:29.321682Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:29.321685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:29.321690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:29.321697Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2353 [2:7559602214449994570:10672]
2025-10-10T14:37:29.321712Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:29.321734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:29.321738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.321741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.321744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.321764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:29.321772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:29.321781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:29.321850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.321852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.321854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.321857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:29.321933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:29.321936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.321948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.321961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.321980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:29.322004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602214449994564:10672]
2025-10-10T14:37:29.322007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602214449994564:10672]
2025-10-10T14:37:29.322009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602214449994564:10672]
2025-10-10T14:37:29.322024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:29.322039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232225931:2438], now have 1 active actors on pipe
2025-10-10T14:37:29.322041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:29.322043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226114:10307], now have 1 active actors on pipe
2025-10-10T14:37:29.322044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:29.322046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:29.322052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:29.322066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:29.322070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:29.322107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602214449994564:10672]
2025-10-10T14:37:29.322114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:29.322118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:29.322589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2353
2025-10-10T14:37:29.322592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2353
2025-10-10T14:37:29.322670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.322686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.322732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:29.322748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.322757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.322760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:29.322773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.322804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:29.322827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.323036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.323046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.323078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.323232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2354 partition: 0 MaxSeqNo: 40 sessionId: src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0
2025-10-10T14:37:29.323645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0190dd8-76b8b7cd-31428141-74a4f85e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:29.327551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0] Write session: try to update token
2025-10-10T14:37:29.327583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:29.343081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:29.343100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:29.343103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:29.343105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:29.343115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602214449994564:10672]
2025-10-10T14:37:29.343121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602214449994564:10672]
2025-10-10T14:37:29.343125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602214449994564:10672]
2025-10-10T14:37:29.343171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:29.343175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:29.343179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:29.343183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:29.343183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.343186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:29.343334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:29.351829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2354 sessionId: src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:29.355090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:29.386727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602215232226127:4939]
2025-10-10T14:37:29.387289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2353, pipe: [1:7559602215232226127:4939]
2025-10-10T14:37:29.467263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:29.467332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602215232226127:4939]
2025-10-10T14:37:29.467373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:29.468137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:29.468149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0] Write session will restart in 0.008414s
2025-10-10T14:37:29.468177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0] Write session: Do CDS request
2025-10-10T14:37:29.468185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:29.467494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2354 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0
2025-10-10T14:37:29.467703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2354 sessionId: src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0 is DEAD
2025-10-10T14:37:29.465707Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:29.466438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.466450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.466476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226127:4939], now have 1 active actors on pipe
2025-10-10T14:37:29.466730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:29.477943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.478128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:29.478166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2355
2025-10-10T14:37:29.478346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.478396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:29.478408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:29.478413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:29.479147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2355 sessionId:  describe result for acl check
2025-10-10T14:37:29.479190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:29.479198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:29.479200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:29.479218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602215232226158:10311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:29.479902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602215232226158:10311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:29.485002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602215232226158:10311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:29.488740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602215232226158:10311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:29.488763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602215232226158:10311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:29.488768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602215232226158:10311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:29.488778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:29.489508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:29.492441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:29.492728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:29.492744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:29.492759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:29.492833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:29.492887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602214449994763:10674]
2025-10-10T14:37:29.493572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:29.493991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:29.494042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:29.494379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:29.494439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.494441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.494442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.494443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.494445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.494447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.494448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.494450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.494451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.494453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.494454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.494456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.494457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.494463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.494477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.494481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.494486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.494490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.494495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.494499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.494503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.494507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.494512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.494516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.494520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.494524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.494533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.494542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.494548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.494555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.494560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.494565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.494570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.494576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.494581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.494586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.494593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.494598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.494603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.494608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.494613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.494618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.494623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.494629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.494633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.494639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.494646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.494651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.494656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.494663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.494667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.494673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.494715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:29.497561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:29.498215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:29.498230Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:29.498233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:29.498237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:29.498243Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2354 [2:7559602214449994763:10674]
2025-10-10T14:37:29.498258Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:29.498277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:29.498285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.498289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.498292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.498308Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:29.498319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:29.498325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:29.498392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.498401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.498403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.498406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:29.498478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:29.498486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.498498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.498515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.498538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:29.498563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602214449994758:10674]
2025-10-10T14:37:29.498570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602214449994758:10674]
2025-10-10T14:37:29.498572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602214449994758:10674]
2025-10-10T14:37:29.498586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:29.498600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:29.498620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:29.498629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:29.498659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602214449994758:10674]
2025-10-10T14:37:29.498668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:29.498778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:29.498786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:29.498788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:29.498795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:29.499164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2354
2025-10-10T14:37:29.499243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2354
2025-10-10T14:37:29.499375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226311:10311], now have 1 active actors on pipe
2025-10-10T14:37:29.499387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226128:2438], now have 1 active actors on pipe
2025-10-10T14:37:29.499403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.499410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.499448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36b8b45a-b4f420fd-26096e77-347b3178_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:29.499461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.499466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.499469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:29.499480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.499496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:29.499516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.500032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.500044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.500061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.500187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2355 partition: 0 MaxSeqNo: 40 sessionId: src_id|36b8b45a-b4f420fd-26096e77-347b3178_0
2025-10-10T14:37:29.500649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1126927-18e14e57-2cf313ee-ad46a7f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|36b8b45a-b4f420fd-26096e77-347b3178_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:29.503985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b8b45a-b4f420fd-26096e77-347b3178_0] Write session: try to update token
2025-10-10T14:37:29.504004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b8b45a-b4f420fd-26096e77-347b3178_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:29.521541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:29.521562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:29.521566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:29.521568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:29.521579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602214449994758:10674]
2025-10-10T14:37:29.521585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602214449994758:10674]
2025-10-10T14:37:29.521589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602214449994758:10674]
2025-10-10T14:37:29.521640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:29.521649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.521651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:29.521801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:29.525121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:29.525142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:29.525147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:29.527905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2355 sessionId: src_id|36b8b45a-b4f420fd-26096e77-347b3178_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:29.531359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:29.569427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602215232226326:4939]
2025-10-10T14:37:29.572860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2354, pipe: [1:7559602215232226326:4939]
2025-10-10T14:37:29.638714Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:29.639075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.639090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.639137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226326:4939], now have 1 active actors on pipe
2025-10-10T14:37:29.639378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:29.639360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:29.639430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602215232226326:4939]
2025-10-10T14:37:29.639450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:29.639455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:29.639566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2355 reason: error at write: Disconnected sessionId: src_id|36b8b45a-b4f420fd-26096e77-347b3178_0
2025-10-10T14:37:29.639912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2355 sessionId: src_id|36b8b45a-b4f420fd-26096e77-347b3178_0 is DEAD
2025-10-10T14:37:29.639999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b8b45a-b4f420fd-26096e77-347b3178_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:29.640009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b8b45a-b4f420fd-26096e77-347b3178_0] Write session will restart in 0.009759s
2025-10-10T14:37:29.640036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b8b45a-b4f420fd-26096e77-347b3178_0] Write session: Do CDS request
2025-10-10T14:37:29.640043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b8b45a-b4f420fd-26096e77-347b3178_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:29.650902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36b8b45a-b4f420fd-26096e77-347b3178_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.651074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:29.651095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2356
2025-10-10T14:37:29.651223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.651258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:29.651269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:29.651273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:29.651707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2356 sessionId:  describe result for acl check
2025-10-10T14:37:29.651745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:29.651748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:29.651750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:29.651756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602215232226400:10315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:29.652334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602215232226400:10315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:29.656916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:29.659063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602215232226400:10315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:29.661766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:29.662008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:29.662019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:29.662032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:29.662087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:29.662134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602214449994956:10676]
2025-10-10T14:37:29.662727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:29.663118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:29.663176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:29.663567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:29.663624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.663625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.663627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.663628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.663629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.663631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.663632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.663633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.663635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.663636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.663637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.663639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.663641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.663647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.663661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.663666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.663670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.663674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.663679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.663683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.663688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.663692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.663697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.663701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.663705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.663710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.663718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.663730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.663736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.663743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.663761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.663767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.663773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.663778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.663784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.663789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.663794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.663800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.663806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.663811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.663824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.663830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.663852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.663858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.663863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.663869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.663874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.663880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.663885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.663890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.663895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.663901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.663951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:29.665956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602215232226400:10315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:29.665977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602215232226400:10315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:29.665982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602215232226400:10315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:29.665992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:29.667456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:29.667801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:29.667815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:29.667818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:29.667822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:29.667830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2355 [2:7559602214449994956:10676]
2025-10-10T14:37:29.667844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:29.667862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:29.667866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.667870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.667873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.667892Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:29.667901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:29.667910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:29.667976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.667979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.667981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.667984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:29.668065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:29.668068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.668080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.668092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.668122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:29.668145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226327:2438], now have 1 active actors on pipe
2025-10-10T14:37:29.668149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226518:10315], now have 1 active actors on pipe
2025-10-10T14:37:29.668156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602214449994951:10676]
2025-10-10T14:37:29.668159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602214449994951:10676]
2025-10-10T14:37:29.668162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602214449994951:10676]
2025-10-10T14:37:29.668178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:29.668194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:29.668201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:29.668203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:29.668206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:29.668213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:29.668217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:29.668247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602214449994951:10676]
2025-10-10T14:37:29.668250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:29.668212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2355
2025-10-10T14:37:29.668262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2355
2025-10-10T14:37:29.668253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:29.668419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.668440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.668478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|355a1edb-540d2305-1f9013f3-295fa467_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:29.668495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.668500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.668503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:29.668516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.668529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:29.668551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.668716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.668729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.668752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.668865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2356 partition: 0 MaxSeqNo: 40 sessionId: src_id|355a1edb-540d2305-1f9013f3-295fa467_0
2025-10-10T14:37:29.669321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36b8b45a-b4f420fd-26096e77-347b3178_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|355a1edb-540d2305-1f9013f3-295fa467_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:29.672398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|355a1edb-540d2305-1f9013f3-295fa467_0] Write session: try to update token
2025-10-10T14:37:29.672420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|355a1edb-540d2305-1f9013f3-295fa467_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:29.687574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:29.687599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:29.687609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602214449994951:10676]
2025-10-10T14:37:29.687658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:29.687666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:29.687843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:29.687993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:29.688132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:29.688265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:29.688462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:29.688511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:29.699978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2356 sessionId: src_id|355a1edb-540d2305-1f9013f3-295fa467_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:29.703769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:29.704056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.704084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.704143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:29.707248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:29.707271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:29.707275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:29.707277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:29.707289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602214449994951:10676]
2025-10-10T14:37:29.707294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602214449994951:10676]
2025-10-10T14:37:29.707299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602214449994951:10676]
2025-10-10T14:37:29.707346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:29.707352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:29.707356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:29.707358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:29.707367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.707370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:29.707511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:29.704281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:29.736408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602215232226528:4939]
2025-10-10T14:37:29.736750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2355, pipe: [1:7559602215232226528:4939]
2025-10-10T14:37:29.829271Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:29.838737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.838779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.838988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.839067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.839142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.839226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.839279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.839295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.839380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.839447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.839518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.839591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.839641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.839653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.839730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.839797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.839871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.839950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.840004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.840013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.840089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.840162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.840235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.840297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.840338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.840341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.840413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.840474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.840541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.840607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.840658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.840662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.840735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.840799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.840865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.840931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.840979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.840982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.841056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.841116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.841183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.841246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.841290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.841293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.841510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.841586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.841657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.841733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.841782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.841786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.841862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.841925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.841993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.842056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.842101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.842105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.842176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:29.842236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:29.842296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:29.842359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:29.842404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:29.842408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:29.842483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226528:4939], now have 1 active actors on pipe
2025-10-10T14:37:29.842804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602215232226528:4939]
2025-10-10T14:37:29.842825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:29.842831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:29.842852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:29.842866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2356 reason: error at write: Disconnected sessionId: src_id|355a1edb-540d2305-1f9013f3-295fa467_0
2025-10-10T14:37:29.843005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:29.843109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2356 sessionId: src_id|355a1edb-540d2305-1f9013f3-295fa467_0 is DEAD
2025-10-10T14:37:29.843284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355a1edb-540d2305-1f9013f3-295fa467_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:29.843296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355a1edb-540d2305-1f9013f3-295fa467_0] Write session will restart in 0.006241s
2025-10-10T14:37:29.843325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355a1edb-540d2305-1f9013f3-295fa467_0] Write session: Do CDS request
2025-10-10T14:37:29.843331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355a1edb-540d2305-1f9013f3-295fa467_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:29.850880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|355a1edb-540d2305-1f9013f3-295fa467_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.851021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:29.851046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2357
2025-10-10T14:37:29.851234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:29.851271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:29.851283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:29.851287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:29.851798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2357 sessionId:  describe result for acl check
2025-10-10T14:37:29.851838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:29.851844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:29.851846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:29.851852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602215232226553:10320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:29.852530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602215232226553:10320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:29.858296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602215232226553:10320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:29.866118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:29.866218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602215232226553:10320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:29.866240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602215232226553:10320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:29.866245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602215232226553:10320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:29.866254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:29.869439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:29.869687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:29.869700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:29.869712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:29.869778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:29.869820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602214449995154:10678]
2025-10-10T14:37:29.870408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:29.870767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:29.870845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:29.871210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:29.871293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.871302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.871303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.871305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.871306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.871307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.871309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.871310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.871311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.871312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.871314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.871315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.871316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.871323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.871337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.871342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.871347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.871351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.871355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.871360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.871364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.871368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.871373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.871377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.871381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.871385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.871394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.871404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:29.871411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.871417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:29.871423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.871429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:29.871433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.871438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:29.871443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.871449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:29.871453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.871459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:29.871464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.871470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:29.871476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.871481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:29.871487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.871492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:29.871498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.871503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:29.871509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.871515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.871520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.871527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.871532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.871538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.871595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:29.874217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:29.875289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2356
2025-10-10T14:37:29.875341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2356
2025-10-10T14:37:29.875834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2357 partition: 0 MaxSeqNo: 40 sessionId: src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0
2025-10-10T14:37:29.876259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|355a1edb-540d2305-1f9013f3-295fa467_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:29.878977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0] Write session: try to update token
2025-10-10T14:37:29.878995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:29.874929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:29.874945Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:29.874947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:29.874950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:29.874956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2356 [2:7559602214449995154:10678]
2025-10-10T14:37:29.874970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:29.874989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:29.874992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.874997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.874999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.875017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:29.875024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:29.875032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:29.875094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.875096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.875098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.875100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:29.875170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:29.875173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.875185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:29.875208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:29.875224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:29.875247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226723:10320], now have 1 active actors on pipe
2025-10-10T14:37:29.875251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226538:2438], now have 1 active actors on pipe
2025-10-10T14:37:29.875258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602214449995147:10678]
2025-10-10T14:37:29.875260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602214449995147:10678]
2025-10-10T14:37:29.875262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602214449995147:10678]
2025-10-10T14:37:29.875278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:29.875285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:29.875293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:29.875299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:29.875302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:29.875308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:29.875311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:29.875335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602214449995147:10678]
2025-10-10T14:37:29.875338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:29.875340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:29.875355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.875359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.875403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:29.875410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:29.875416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:29.875419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:29.875431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:29.875442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:29.875465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.875708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:29.875711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:29.875727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:29.895367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2357 sessionId: src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:29.898305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:29.898334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:29.898339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:29.898342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:29.898353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602214449995147:10678]
2025-10-10T14:37:29.898358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602214449995147:10678]
2025-10-10T14:37:29.898363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602214449995147:10678]
2025-10-10T14:37:29.898420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:29.898423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:29.898430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:29.898433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:29.898437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:29.898443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:29.898584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:29.898595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:29.942755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602215232226737:4939]
2025-10-10T14:37:29.943175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2356, pipe: [1:7559602215232226737:4939]
2025-10-10T14:37:30.021085Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:30.021359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.021376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.021421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602215232226737:4939], now have 1 active actors on pipe
2025-10-10T14:37:30.021681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:30.021701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:30.021770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602215232226737:4939]
2025-10-10T14:37:30.022256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:30.022270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0] Write session will restart in 0.009886s
2025-10-10T14:37:30.022296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0] Write session: Do CDS request
2025-10-10T14:37:30.022303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:30.021793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:30.021797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:30.021868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2357 reason: error at write: Disconnected sessionId: src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0
2025-10-10T14:37:30.022076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2357 sessionId: src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0 is DEAD
2025-10-10T14:37:30.033971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.034066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:30.034096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2358
2025-10-10T14:37:30.034263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.034328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:30.034339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:30.034346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:30.034905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2358 sessionId:  describe result for acl check
2025-10-10T14:37:30.034946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:30.034948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:30.034950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:30.034957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602219527194048:10324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:30.035575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602219527194048:10324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:30.039721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602219527194048:10324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:30.045570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602219527194048:10324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:30.045599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602219527194048:10324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:30.045602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602219527194048:10324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:30.045612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:30.051420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:30.055237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:30.055522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:30.055527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:30.055539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:30.055611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:30.055651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602218744962659:10686]
2025-10-10T14:37:30.056375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:30.057038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:30.057106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:30.057478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:30.057552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.057553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.057554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.057556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.057557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.057559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.057560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.057562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.057563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.057564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.057566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.057567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.057568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.057574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.057587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.057592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.057596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.057600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.057604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.057608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.057612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.057617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.057622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.057626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.057630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.057634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.057645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.057666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.057673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.057679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.057684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.057690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.057696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.057702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.057707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.057713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.057718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.057723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.057729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.057735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.057740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.057745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.057751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.057757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.057762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.057768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.057772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.057778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.057782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.057788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.057793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.057798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.057842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:30.060891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:30.061639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:30.061657Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:30.061659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:30.061664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:30.061672Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2357 [2:7559602218744962659:10686]
2025-10-10T14:37:30.061693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:30.061718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:30.061727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.061730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.061733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.061752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:30.061764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:30.061773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:30.061849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.061857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.061859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.061862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:30.061944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:30.061954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.061966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.061977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.061997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:30.062022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602218744962654:10686]
2025-10-10T14:37:30.062030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602218744962654:10686]
2025-10-10T14:37:30.062031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602218744962654:10686]
2025-10-10T14:37:30.062048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:30.062062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:30.062084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:30.062087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:30.062123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602218744962654:10686]
2025-10-10T14:37:30.062126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:30.062134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:30.062135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194146:10324], now have 1 active actors on pipe
2025-10-10T14:37:30.062138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:30.062139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194035:2438], now have 1 active actors on pipe
2025-10-10T14:37:30.062140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:30.062148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:30.062860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2357
2025-10-10T14:37:30.062901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2357
2025-10-10T14:37:30.063238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.063254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.063287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:30.063296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.063301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.063304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:30.063314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.063325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:30.063344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.063592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.063599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.063614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.063753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2358 partition: 0 MaxSeqNo: 40 sessionId: src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0
2025-10-10T14:37:30.064205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424f7c2c-8ee1b7c1-7d0ce807-43d234fe_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:30.066916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0] Write session: try to update token
2025-10-10T14:37:30.066935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:30.084313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:30.084341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:30.084345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:30.084347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:30.084359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602218744962654:10686]
2025-10-10T14:37:30.084365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602218744962654:10686]
2025-10-10T14:37:30.084369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602218744962654:10686]
2025-10-10T14:37:30.084424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:30.084432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.084435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:30.084439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:30.084447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:30.084452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:30.084590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:30.093414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2358 sessionId: src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:30.096812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:30.124350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602219527194235:4939]
2025-10-10T14:37:30.124824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2357, pipe: [1:7559602219527194235:4939]
2025-10-10T14:37:30.132638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:37:30.132668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-10-10T14:37:30.201762Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:30.202217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.202240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.202292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194235:4939], now have 1 active actors on pipe
2025-10-10T14:37:30.202539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:30.202614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:30.202636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:30.202698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2358 reason: error at write: Disconnected sessionId: src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0
2025-10-10T14:37:30.202907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2358 sessionId: src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0 is DEAD
2025-10-10T14:37:30.203046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:30.203059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0] Write session will restart in 0.007356s
2025-10-10T14:37:30.203084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0] Write session: Do CDS request
2025-10-10T14:37:30.203090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:30.203125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:30.203140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-10-10T14:37:30.203176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602219527194235:4939]
2025-10-10T14:37:30.211986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.212054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:30.212090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2359
2025-10-10T14:37:30.212241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.212289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:30.212302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:30.212307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:30.212782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2359 sessionId:  describe result for acl check
2025-10-10T14:37:30.212838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:30.212844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:30.212847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:30.212853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602219527194309:10337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:30.213478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602219527194309:10337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:30.216899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602219527194309:10337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:30.220107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602219527194309:10337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:30.220125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602219527194309:10337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:30.220129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602219527194309:10337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:30.220138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:30.221023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:30.223614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:30.223854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:30.223867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:30.223884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:30.223942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:30.223991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602218744962896:10698]
2025-10-10T14:37:30.224623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:30.227391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:30.227461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:30.227860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:30.227926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.227934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.227935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.227937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.227938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.227940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.227941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.227943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.227944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.227946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.227947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.227949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.227950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.227957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.227970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.227984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.227988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.227992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.227996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.228001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.228005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.228009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.228014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.228018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.228022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.228027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.228035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.228044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.228053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.228059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.228064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.228070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.228075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.228081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.228086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.228092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.228096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.228102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.228107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.228112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.228116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.228123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.228128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.228134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.228138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.228144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.228156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.228161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.228166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.228171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.228177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.228187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.228224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:30.241254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:30.241686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:30.241704Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:30.241707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:30.241712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:30.241720Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2358 [2:7559602218744962896:10698]
2025-10-10T14:37:30.241737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:30.241761Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:30.241765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.241769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.241771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.241793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:30.241800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:30.241809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:30.241921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.241935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.241937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.241940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:30.242034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:30.242047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.242062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.242074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.242090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:30.242128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194471:10337], now have 1 active actors on pipe
2025-10-10T14:37:30.242151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194276:2438], now have 1 active actors on pipe
2025-10-10T14:37:30.242169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602218744962891:10698]
2025-10-10T14:37:30.242179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602218744962891:10698]
2025-10-10T14:37:30.242181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602218744962891:10698]
2025-10-10T14:37:30.242198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:30.242218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:30.242240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:30.242243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:30.242245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:30.242246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:30.242251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:30.242217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2358
2025-10-10T14:37:30.242304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602218744962891:10698]
2025-10-10T14:37:30.242325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:30.242348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.242362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.242369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:30.242419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af3a88ca-583efe77-3570257d-a569e687_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:30.242304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2358
2025-10-10T14:37:30.242435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.242440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.242443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:30.242456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.242469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:30.242509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.242582Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:37:30.242673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.242681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.242697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.242804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2359 partition: 0 MaxSeqNo: 40 sessionId: src_id|af3a88ca-583efe77-3570257d-a569e687_0
2025-10-10T14:37:30.242827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 16 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:37:30.242861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:37:30.243223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4468aa5-c7becc21-2c46f861-68aa9ec9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|af3a88ca-583efe77-3570257d-a569e687_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:30.246204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3a88ca-583efe77-3570257d-a569e687_0] Write session: try to update token
2025-10-10T14:37:30.246225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3a88ca-583efe77-3570257d-a569e687_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:30.269084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2359 sessionId: src_id|af3a88ca-583efe77-3570257d-a569e687_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:30.271819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:30.272125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.272152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.274588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:30.274623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:30.274627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:30.274630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:30.274632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:30.274642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602218744962891:10698]
2025-10-10T14:37:30.274647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602218744962891:10698]
2025-10-10T14:37:30.274651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602218744962891:10698]
2025-10-10T14:37:30.274690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:30.274692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:30.274700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.274703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:30.274705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:30.274709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:30.274711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:30.274842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:30.303228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602219527194500:4939]
2025-10-10T14:37:30.303544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2358, pipe: [1:7559602219527194500:4939]
2025-10-10T14:37:30.396703Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:30.405985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.406030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.406243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.406320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.406395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.406472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.406526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.406540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.406617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.406689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.406763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.406842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.406893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.406904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.406983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.407061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.407133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.407217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.407263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.407266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.407342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.407408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.407474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.407542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.407587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.407591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.407667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.407729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.407792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.407857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.407902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.407905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.407980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.408045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.408109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.408173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.408216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.408219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.408297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.408366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.408436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.408502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.408545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.408551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.408620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.408682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.408745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.408809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.408854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.408857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.408926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.408984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.409052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.409118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.409163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.409166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.409246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:30.409311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:30.409605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:30.410196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602219527194500:4939]
2025-10-10T14:37:30.410252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:30.410252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:30.410260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:30.410317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2359 reason: error at write: Disconnected sessionId: src_id|af3a88ca-583efe77-3570257d-a569e687_0
2025-10-10T14:37:30.410656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2359 sessionId: src_id|af3a88ca-583efe77-3570257d-a569e687_0 is DEAD
2025-10-10T14:37:30.409692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:30.409744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:30.409747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:30.409827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194500:4939], now have 1 active actors on pipe
2025-10-10T14:37:30.411152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:30.413594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3a88ca-583efe77-3570257d-a569e687_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:30.413607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3a88ca-583efe77-3570257d-a569e687_0] Write session will restart in 0.005531s
2025-10-10T14:37:30.413637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3a88ca-583efe77-3570257d-a569e687_0] Write session: Do CDS request
2025-10-10T14:37:30.413643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3a88ca-583efe77-3570257d-a569e687_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:30.421841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af3a88ca-583efe77-3570257d-a569e687_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.421982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:30.422008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2360
2025-10-10T14:37:30.422186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.422222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:30.422235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:30.422241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:30.422785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2360 sessionId:  describe result for acl check
2025-10-10T14:37:30.422836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:30.422844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:30.422847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:30.422854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602219527194519:10342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:30.423507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602219527194519:10342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:30.426364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602219527194519:10342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:30.430170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602219527194519:10342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:30.430188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602219527194519:10342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:30.430192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602219527194519:10342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:30.430202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:30.436458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:30.439584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:30.439835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:30.439848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:30.439860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:30.439961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:30.440017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602218744963095:10701]
2025-10-10T14:37:30.440655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:30.441004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:30.441070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:30.441467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:30.441551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.441558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.441560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.441561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.441562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.441564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.441565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.441566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.441568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.441570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.441571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.441572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.441574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.441581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.441595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.441600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.441604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.441608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.441613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.441629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.441634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.441638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.441648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.441653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.441657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.441661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.441670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.441684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.441691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.441701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.441706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.441718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.441724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.441729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.441734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.441740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.441744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.441751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.441756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.441762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.441767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.441773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.441778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.441784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.441789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.441795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.441800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.441805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.441816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.441823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.441832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.441838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.441885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:30.444529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:30.444896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:30.444910Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:30.444913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:30.444917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:30.444925Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2359 [2:7559602218744963095:10701]
2025-10-10T14:37:30.444939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:30.444965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:30.444973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.444977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.444980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.444998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:30.445011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:30.445033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:30.445103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.445111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.445113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.445116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:30.445360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2359
2025-10-10T14:37:30.445369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2359
2025-10-10T14:37:30.445189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:30.445201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.445214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.445227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.445245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:30.445268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194592:10342], now have 1 active actors on pipe
2025-10-10T14:37:30.445272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194506:2438], now have 1 active actors on pipe
2025-10-10T14:37:30.445282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602218744963090:10701]
2025-10-10T14:37:30.445284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602218744963090:10701]
2025-10-10T14:37:30.445286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602218744963090:10701]
2025-10-10T14:37:30.445306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:30.445322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:30.445343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:30.445348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:30.445350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:30.445360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:30.445364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:30.445396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602218744963090:10701]
2025-10-10T14:37:30.445404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:30.445411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:30.445576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.445599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.445630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:30.445645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.445648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.445650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:30.445661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.445673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:30.445684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.445867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.445883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.445907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.446018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2360 partition: 0 MaxSeqNo: 40 sessionId: src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0
2025-10-10T14:37:30.446442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af3a88ca-583efe77-3570257d-a569e687_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:30.449238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0] Write session: try to update token
2025-10-10T14:37:30.449260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:30.465861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:30.465884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:30.465887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:30.465890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:30.465901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602218744963090:10701]
2025-10-10T14:37:30.465906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602218744963090:10701]
2025-10-10T14:37:30.465910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602218744963090:10701]
2025-10-10T14:37:30.465953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:30.465959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:30.465960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:30.465965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:30.465967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.465970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:30.466115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:30.465840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2360 sessionId: src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:30.468946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:30.510601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602219527194708:4939]
2025-10-10T14:37:30.511020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2359, pipe: [1:7559602219527194708:4939]
2025-10-10T14:37:30.587197Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:30.587815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.587829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.587883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194708:4939], now have 1 active actors on pipe
2025-10-10T14:37:30.588122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:30.590079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602219527194708:4939]
2025-10-10T14:37:30.590122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:30.590166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:30.590266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2360 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0
2025-10-10T14:37:30.590460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2360 sessionId: src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0 is DEAD
2025-10-10T14:37:30.591021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:30.591033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0] Write session will restart in 0.005728s
2025-10-10T14:37:30.591060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0] Write session: Do CDS request
2025-10-10T14:37:30.591068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:30.597925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.605428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:30.605455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2361
2025-10-10T14:37:30.605690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.605721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:30.605727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:30.605732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:30.606326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2361 sessionId:  describe result for acl check
2025-10-10T14:37:30.606365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:30.606377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:30.606379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:30.606387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602219527194718:10346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:30.607060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602219527194718:10346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:30.609539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602219527194718:10346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:30.615937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602219527194718:10346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:30.615959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602219527194718:10346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:30.615962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602219527194718:10346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:30.615970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:30.623814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:30.626532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:30.626784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:30.626805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:30.626817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:30.626890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:30.626956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602218744963294:10703]
2025-10-10T14:37:30.627691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:30.628184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:30.628254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:30.628656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:30.628748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.628756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.628758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.628759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.628761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.628763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.628764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.628766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.628767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.628769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.628771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.628773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.628775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.628781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.628794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.628799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.628804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.628810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.628815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.628819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.628824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.628829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.628835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.628840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.628845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.628850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.628859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.628869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.628890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.628903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.628909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.628923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.628934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.628941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.628946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.628951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.628964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.628970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.628991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.628997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.629001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.629014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.629019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.629024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.629032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.629040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.629046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.629057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.629062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.629073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.629079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.629084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.629124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:30.633978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:30.634398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:30.634416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:30.634420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:30.634425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:30.634434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2360 [2:7559602218744963294:10703]
2025-10-10T14:37:30.634449Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:30.634477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:30.634487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.634491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.634494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.634512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:30.634519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:30.634527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:30.634636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.634644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.634647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.634650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:30.634733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:30.634743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.634754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.634772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.634798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:30.634819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194709:2438], now have 1 active actors on pipe
2025-10-10T14:37:30.634829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194824:10346], now have 1 active actors on pipe
2025-10-10T14:37:30.634837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602218744963289:10703]
2025-10-10T14:37:30.634841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602218744963289:10703]
2025-10-10T14:37:30.634844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602218744963289:10703]
2025-10-10T14:37:30.634866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:30.634882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:30.634886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:30.634890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:30.634892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:30.634897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:30.634902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:30.634939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602218744963289:10703]
2025-10-10T14:37:30.634954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:30.634961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:30.636821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2360
2025-10-10T14:37:30.636876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2360
2025-10-10T14:37:30.637076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.637107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.637141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:30.637163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.637176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.637180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:30.637194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.637216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:30.637237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.638807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.638826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.638860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.639220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2361 partition: 0 MaxSeqNo: 40 sessionId: src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0
2025-10-10T14:37:30.641706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91fdf492-8e3e6219-a7cd851c-bded1f78_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:30.645261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0] Write session: try to update token
2025-10-10T14:37:30.645283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:30.660477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:30.660504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:30.660507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:30.660510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:30.660520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602218744963289:10703]
2025-10-10T14:37:30.660525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602218744963289:10703]
2025-10-10T14:37:30.660529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602218744963289:10703]
2025-10-10T14:37:30.660580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:30.660592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.660590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:30.660595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:30.660597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:30.660602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:30.660743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:30.666922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2361 sessionId: src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:30.669716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:30.688429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602219527194912:4939]
2025-10-10T14:37:30.688660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2360, pipe: [1:7559602219527194912:4939]
2025-10-10T14:37:30.778688Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:30.779373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.779390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.779438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194912:4939], now have 1 active actors on pipe
2025-10-10T14:37:30.779682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:30.779762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:30.779781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602219527194912:4939]
2025-10-10T14:37:30.779789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:30.779815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:30.779894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2361 reason: error at write: Disconnected sessionId: src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0
2025-10-10T14:37:30.780156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2361 sessionId: src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0 is DEAD
2025-10-10T14:37:30.780376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:30.780393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0] Write session will restart in 0.007500s
2025-10-10T14:37:30.780420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0] Write session: Do CDS request
2025-10-10T14:37:30.780427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:30.789870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.789877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:30.789904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2362
2025-10-10T14:37:30.790291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.790329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:30.790340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:30.790346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:30.790908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2362 sessionId:  describe result for acl check
2025-10-10T14:37:30.790954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:30.790963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:30.790966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:30.790973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602219527194929:10351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:30.791638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602219527194929:10351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:30.794543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602219527194929:10351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:30.798516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602219527194929:10351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:30.798552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602219527194929:10351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:30.798557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602219527194929:10351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:30.798566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:30.806562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:30.809938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:30.810212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:30.810223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:30.810236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:30.810308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:30.810359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602218744963494:10705]
2025-10-10T14:37:30.811024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:30.811551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:30.811615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:30.812011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:30.812088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.812094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.812096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.812097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.812099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.812100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.812102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.812103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.812105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.812106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.812107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.812109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.812110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.812117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.812132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.812136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.812141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.812145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.812149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.812154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.812158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.812162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.812167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.812172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.812176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.812180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.812189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.812198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.812205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.812210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.812214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.812219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.812224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.812229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.812235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.812239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.812244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.812250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.812256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.812262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.812268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.812274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.812280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.812285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.812291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.812296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.812302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.812310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.812322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.812328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.812333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.812339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.812383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:30.815244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:30.815618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:30.815634Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:30.815637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:30.815641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:30.815649Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2361 [2:7559602218744963494:10705]
2025-10-10T14:37:30.815666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:30.815687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:30.815691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.815709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.815712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.815733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:30.815747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:30.815756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:30.816738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2361
2025-10-10T14:37:30.816751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2361
2025-10-10T14:37:30.817283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2362 partition: 0 MaxSeqNo: 40 sessionId: src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0
2025-10-10T14:37:30.815837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.815844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.815846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.815848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:30.815919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:30.815922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.815934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.815945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.815963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:30.815986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602218744963489:10705]
2025-10-10T14:37:30.815989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602218744963489:10705]
2025-10-10T14:37:30.815992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602218744963489:10705]
2025-10-10T14:37:30.816001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:30.816017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:30.816034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:30.816037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:30.816075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602218744963489:10705]
2025-10-10T14:37:30.816078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:30.816337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:30.816340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:30.816342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:30.816349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:30.816618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194919:2438], now have 1 active actors on pipe
2025-10-10T14:37:30.816623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527194985:10351], now have 1 active actors on pipe
2025-10-10T14:37:30.816826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.816831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.816866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:30.816876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.816880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.816883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:30.816897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.816912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:30.816927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.817146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.817149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.817164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.818902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c2df6-5600cf1a-9fc6daab-8102643d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:30.821957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0] Write session: try to update token
2025-10-10T14:37:30.821980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:30.837769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2362 sessionId: src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:30.836679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:30.836706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:30.836710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:30.836712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:30.836723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602218744963489:10705]
2025-10-10T14:37:30.836729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602218744963489:10705]
2025-10-10T14:37:30.836734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602218744963489:10705]
2025-10-10T14:37:30.836793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:30.836803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.836805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:30.836808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:30.836816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:30.836821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:30.836961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:30.840775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:30.879721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602219527195126:4939]
2025-10-10T14:37:30.880082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2361, pipe: [1:7559602219527195126:4939]
2025-10-10T14:37:30.955220Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:30.955812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.955831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.955879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527195126:4939], now have 1 active actors on pipe
2025-10-10T14:37:30.956135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:30.956159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:30.956255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:30.956392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2362 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0
2025-10-10T14:37:30.956588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2362 sessionId: src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0 is DEAD
2025-10-10T14:37:30.956798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:30.956807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0] Write session will restart in 0.005488s
2025-10-10T14:37:30.956834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0] Write session: Do CDS request
2025-10-10T14:37:30.956841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:30.957144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602219527195126:4939]
2025-10-10T14:37:30.964000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.964119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:30.964147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2363
2025-10-10T14:37:30.964429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:30.964473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:30.964500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:30.964506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:30.964974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2363 sessionId:  describe result for acl check
2025-10-10T14:37:30.965018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:30.965019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:30.965022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:30.965028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602219527195145:10355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:30.965692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602219527195145:10355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:30.968975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602219527195145:10355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:30.972625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602219527195145:10355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:30.972649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602219527195145:10355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:30.972653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602219527195145:10355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:30.972673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:30.978222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:30.983759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:30.984048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:30.984060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:30.984075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:30.984141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:30.984193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602218744963695:10707]
2025-10-10T14:37:30.984900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:30.985548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:30.985619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:30.985992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:30.986062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.986063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.986064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.986066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.986067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.986068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.986070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.986071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.986072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.986074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.986075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.986076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.986078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.986085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.986101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.986106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.986110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.986115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.986119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.986123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.986128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.986133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.986138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.986142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.986146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.986150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.986160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.986169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:30.986186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.986198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:30.986203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.986216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:30.986224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.986229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:30.986236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.986242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:30.986252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.986258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:30.986267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.986273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:30.986283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.986289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:30.986295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.986302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:30.986310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.986317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:30.986326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.986332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.986342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.986353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.986361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.986371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.986430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:30.991851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:30.992310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:30.992325Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:30.992328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:30.992333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:30.992341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2362 [2:7559602218744963695:10707]
2025-10-10T14:37:30.992358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:30.992387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:30.992396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.992400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.992403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.992424Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:30.992438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:30.992446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:30.992534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.992545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.992548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.992551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:30.992629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:30.992637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:30.992651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:30.992667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:30.992689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:30.992712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602218744963690:10707]
2025-10-10T14:37:30.992720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602218744963690:10707]
2025-10-10T14:37:30.992723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602218744963690:10707]
2025-10-10T14:37:30.992735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:30.992757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:30.992779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:30.992787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:30.992806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:30.992827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:30.992830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602218744963690:10707]
2025-10-10T14:37:30.992830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:30.992833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:30.992839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:30.992844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527195130:2438], now have 1 active actors on pipe
2025-10-10T14:37:30.993010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2362
2025-10-10T14:37:30.993079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2362
2025-10-10T14:37:30.993139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602219527195310:10355], now have 1 active actors on pipe
2025-10-10T14:37:30.993324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.993364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.993398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:30.993412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:30.993421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:30.993424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:30.993439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:30.993458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:30.993477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.993757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:30.993773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:30.993790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:30.993954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2363 partition: 0 MaxSeqNo: 40 sessionId: src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0
2025-10-10T14:37:30.995780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe407b21-1e3d23e-3721c41b-c9d165d7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:30.998800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0] Write session: try to update token
2025-10-10T14:37:30.998827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:31.020072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2363 sessionId: src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:31.019045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:31.019071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:31.019074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:31.019076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:31.019089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602218744963690:10707]
2025-10-10T14:37:31.019094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602218744963690:10707]
2025-10-10T14:37:31.019102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602218744963690:10707]
2025-10-10T14:37:31.019155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:31.019156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:31.019163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:31.019163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.019167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:31.019167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:31.019333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:31.022836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:31.057423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602223822162628:4939]
2025-10-10T14:37:31.061743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2362, pipe: [1:7559602223822162628:4939]
2025-10-10T14:37:31.137538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:31.137822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.137840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.137902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822162628:4939], now have 1 active actors on pipe
2025-10-10T14:37:31.138097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:31.138139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602223822162628:4939]
2025-10-10T14:37:31.138174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:31.138203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:31.138210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:31.138319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2363 reason: error at write: Disconnected sessionId: src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0
2025-10-10T14:37:31.138562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2363 sessionId: src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0 is DEAD
2025-10-10T14:37:31.138730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:31.138741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0] Write session will restart in 0.005408s
2025-10-10T14:37:31.138780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0] Write session: Do CDS request
2025-10-10T14:37:31.138790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:31.145978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.146381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:31.146405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2364
2025-10-10T14:37:31.146633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.146675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:31.146687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:31.146691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:31.147147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2364 sessionId:  describe result for acl check
2025-10-10T14:37:31.147200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:31.147207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:31.147209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:31.147216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602223822162649:10359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:31.147811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602223822162649:10359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:31.152652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602223822162649:10359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:31.157230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602223822162649:10359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:31.157256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602223822162649:10359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:31.157260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602223822162649:10359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:31.157271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:31.166657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:31.169889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:31.170151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:31.170167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:31.170179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:31.170235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:31.170293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602223039931228:10721]
2025-10-10T14:37:31.170902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:31.171258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:31.171309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:31.171650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:31.171706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.171714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.171715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.171717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.171718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.171719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.171720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.171722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.171723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.171724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.171725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.171726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.171728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.171734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.171746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.171750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.171754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.171757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.171761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.171765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.171769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.171773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.171777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.171781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.171784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.171788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.171795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.171820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.171826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.171831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.171836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.171840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.171845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.171851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.171856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.171860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.171864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.171869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.171873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.171878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.171882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.171887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.171891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.171897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.171901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.171906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.171917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.171922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.171925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.171930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.171939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.171944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.171983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:31.174807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:31.175422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:31.175439Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:31.175442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:31.175447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:31.175455Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2363 [2:7559602223039931228:10721]
2025-10-10T14:37:31.175472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:31.175494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:31.175502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.175506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.175509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.175531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:31.175541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:31.175554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:31.175633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.175642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.175644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.175647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:31.175725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:31.175737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.175751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.175762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.175779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:31.175805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822162799:10359], now have 1 active actors on pipe
2025-10-10T14:37:31.175810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822162633:2438], now have 1 active actors on pipe
2025-10-10T14:37:31.175820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602223039931221:10721]
2025-10-10T14:37:31.175824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602223039931221:10721]
2025-10-10T14:37:31.175826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602223039931221:10721]
2025-10-10T14:37:31.175842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:31.175861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:31.175879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:31.175882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:31.175928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602223039931221:10721]
2025-10-10T14:37:31.175931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:31.175943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:31.175947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:31.175950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:31.175958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:31.176061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.176078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.176131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|558e0355-f143465d-4c81613a-805f4620_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:31.176145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.176151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.176158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:31.176173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.176193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:31.176226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.176528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.176541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.176562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.177155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c56fba4-9fc4281a-e0683f39-7e2f5502_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|558e0355-f143465d-4c81613a-805f4620_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:31.175906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2363
2025-10-10T14:37:31.175924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2363
2025-10-10T14:37:31.176717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2364 partition: 0 MaxSeqNo: 40 sessionId: src_id|558e0355-f143465d-4c81613a-805f4620_0
2025-10-10T14:37:31.179972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558e0355-f143465d-4c81613a-805f4620_0] Write session: try to update token
2025-10-10T14:37:31.179998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558e0355-f143465d-4c81613a-805f4620_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:31.194795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2364 sessionId: src_id|558e0355-f143465d-4c81613a-805f4620_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:31.194813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:31.194836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:31.194847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602223039931221:10721]
2025-10-10T14:37:31.194903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:31.194981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:31.195088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:31.195255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:31.195407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:31.195555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:31.195751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:31.195798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:31.197648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:31.197869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.197900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.197940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:31.198128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:31.208889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:31.208911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:31.208915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:31.208917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:31.208928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602223039931221:10721]
2025-10-10T14:37:31.208933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602223039931221:10721]
2025-10-10T14:37:31.208937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602223039931221:10721]
2025-10-10T14:37:31.208987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:31.208989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:31.208996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:31.208997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.208999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:31.209000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:31.209142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:31.238124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602223822162861:4939]
2025-10-10T14:37:31.238546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2363, pipe: [1:7559602223822162861:4939]
2025-10-10T14:37:31.324787Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:31.333936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.333974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.334166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.334240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.334309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.334383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.334434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.334439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.334509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.334566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.334630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.334693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.334733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.334737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.334811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.334868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.334924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.334987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.335025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.335031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.335101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.335159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.335233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.335296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.335338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.335341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.335417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.335479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.335539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.335604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.335649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.335652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.335719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.335778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.335834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.335896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.335939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.335942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.336014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.336070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.336131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.336191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.336230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.336233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.336303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.336358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.336421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.336479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.336521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.336524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.336597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.336658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.336719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.336777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.336825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.336828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.336897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.336951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.337011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.337073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.337110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.337115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.337208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822162861:4939], now have 1 active actors on pipe
2025-10-10T14:37:31.337650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:31.338013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e0355-f143465d-4c81613a-805f4620_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:31.338026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e0355-f143465d-4c81613a-805f4620_0] Write session will restart in 0.005537s
2025-10-10T14:37:31.338062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e0355-f143465d-4c81613a-805f4620_0] Write session: Do CDS request
2025-10-10T14:37:31.338069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e0355-f143465d-4c81613a-805f4620_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:31.337613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:31.337623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602223822162861:4939]
2025-10-10T14:37:31.337644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:31.337657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:31.337679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2364 reason: error at write: Disconnected sessionId: src_id|558e0355-f143465d-4c81613a-805f4620_0
2025-10-10T14:37:31.337851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2364 sessionId: src_id|558e0355-f143465d-4c81613a-805f4620_0 is DEAD
2025-10-10T14:37:31.344882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|558e0355-f143465d-4c81613a-805f4620_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.345015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:31.345037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2365
2025-10-10T14:37:31.345776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.345830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:31.345841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:31.345846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:31.346367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2365 sessionId:  describe result for acl check
2025-10-10T14:37:31.346415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:31.346423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:31.346425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:31.346431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602223822162893:10375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:31.347095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602223822162893:10375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:31.349934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602223822162893:10375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:31.356898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602223822162893:10375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:31.356925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602223822162893:10375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:31.356929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602223822162893:10375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:31.356939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:31.363057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:31.366054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:31.366308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:31.366319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:31.366331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:31.366391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:31.366441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602223039931450:10726]
2025-10-10T14:37:31.367074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:31.367416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:31.367478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:31.367860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:31.367918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.367924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.367926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.367927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.367928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.367929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.367931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.367932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.367933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.367934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.367935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.367936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.367938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.367944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.367958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.367962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.367967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.367971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.367975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.367978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.367983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.367986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.367990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.367993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.367997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.368000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.368011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.368021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.368028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.368033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.368038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.368043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.368048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.368053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.368063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.368068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.368080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.368086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.368091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.368096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.368101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.368106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.368111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.368117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.368121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.368127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.368131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.368137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.368141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.368146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.368150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.368156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.368194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:31.370861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:31.371966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:31.371985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:31.371987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:31.371992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:31.371998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2364 [2:7559602223039931450:10726]
2025-10-10T14:37:31.372017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:31.372038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:31.372047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.372051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.372054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.372074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:31.372091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:31.372100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:31.372167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.372175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.372177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.372180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:31.372252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:31.372263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.372276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.372289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.372307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:31.372329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822162973:10375], now have 1 active actors on pipe
2025-10-10T14:37:31.372338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822162877:2438], now have 1 active actors on pipe
2025-10-10T14:37:31.372348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602223039931445:10726]
2025-10-10T14:37:31.372354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602223039931445:10726]
2025-10-10T14:37:31.372356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602223039931445:10726]
2025-10-10T14:37:31.372370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:31.372384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:31.372386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:31.372390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:31.372392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:31.372406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:31.372410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:31.372447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602223039931445:10726]
2025-10-10T14:37:31.372459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:31.372467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:31.372493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2364
2025-10-10T14:37:31.372781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2364
2025-10-10T14:37:31.372851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.372870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.372904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:31.372920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.372925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.372928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:31.372941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.372954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:31.372971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.373197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.373213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.373237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.373348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2365 partition: 0 MaxSeqNo: 40 sessionId: src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0
2025-10-10T14:37:31.373758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|558e0355-f143465d-4c81613a-805f4620_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:31.377401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0] Write session: try to update token
2025-10-10T14:37:31.377425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:31.385953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:31.385977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:31.385989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602223039931445:10726]
2025-10-10T14:37:31.386040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:31.386050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:31.386223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:31.386378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:31.386529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:31.386673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:31.386907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:31.386956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:31.398278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2365 sessionId: src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:31.401657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:31.401966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.401996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.402055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:31.402176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:31.407279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:31.407311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:31.407315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:31.407319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:31.407333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602223039931445:10726]
2025-10-10T14:37:31.407339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602223039931445:10726]
2025-10-10T14:37:31.407344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602223039931445:10726]
2025-10-10T14:37:31.407411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:31.407429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.407433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:31.407431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:31.407442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:31.407449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:31.407592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:31.437778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602223822163084:4939]
2025-10-10T14:37:31.438271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2364, pipe: [1:7559602223822163084:4939]
2025-10-10T14:37:31.529090Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:31.538806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.538848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.539047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.539105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.539184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.539250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.539295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.539301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.539376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.539439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.539505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.539573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.539615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.539623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.539700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.539761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.539824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.539892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.539937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.539940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.540013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.540078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.540146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.540210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.540260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.540266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.540341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.540400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.540462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.540526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.540579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.540582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.540654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.540713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.540772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.540831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.540876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.540880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.540954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.541013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.541083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.541147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.541192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.541195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.541267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.541459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.541528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.541587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.541633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.541637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.541706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.541784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.541862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.541933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.541986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.541994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.542065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:31.542135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:31.542202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:31.542273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:31.542320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:31.542329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:31.542397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163084:4939], now have 1 active actors on pipe
2025-10-10T14:37:31.544083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:31.543939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:31.544009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:31.544012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:31.544046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2365 reason: error at write: Disconnected sessionId: src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0
2025-10-10T14:37:31.544249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2365 sessionId: src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0 is DEAD
2025-10-10T14:37:31.544771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602223822163084:4939]
2025-10-10T14:37:31.545752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:31.545786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0] Write session will restart in 0.005415s
2025-10-10T14:37:31.545813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0] Write session: Do CDS request
2025-10-10T14:37:31.545820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:31.553002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.553661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:31.553682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2366
2025-10-10T14:37:31.553895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.553939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:31.553965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:31.553970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:31.554610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2366 sessionId:  describe result for acl check
2025-10-10T14:37:31.554655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:31.554662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:31.554664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:31.554671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602223822163101:10379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:31.555292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602223822163101:10379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:31.560118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602223822163101:10379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:31.570048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:31.570109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602223822163101:10379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:31.570132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602223822163101:10379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:31.570136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602223822163101:10379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:31.570147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:31.573708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:31.574000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:31.574009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:31.574022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:31.574082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:31.574130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602223039931654:10728]
2025-10-10T14:37:31.574801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:31.575175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:31.575250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:31.575628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:31.575693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.575700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.575702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.575703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.575705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.575706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.575708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.575710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.575712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.575713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.575714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.575716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.575718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.575725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.575740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.575744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.575749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.575754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.575758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.575763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.575773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.575777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.575782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.575786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.575796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.575800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.575809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.575824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.575831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.575837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.575843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.575854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.575859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.575869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.575875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.575896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.575906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.575912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.575922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.575929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.575938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.575945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.575956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.575962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.575973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.575979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.575989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.575997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.576007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.576013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.576018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.576029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.576085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:31.578751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:31.579363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:31.579380Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:31.579383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:31.579387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:31.579394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2365 [2:7559602223039931654:10728]
2025-10-10T14:37:31.579409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:31.579430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:31.579434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.579439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.579442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.579461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:31.579471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:31.579479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:31.579551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.579559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.579561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.579565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:31.579638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:31.579647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.579660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.579678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.579702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:31.579812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2365
2025-10-10T14:37:31.579812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2365
2025-10-10T14:37:31.579732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163281:10379], now have 1 active actors on pipe
2025-10-10T14:37:31.579741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163086:2438], now have 1 active actors on pipe
2025-10-10T14:37:31.579750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602223039931647:10728]
2025-10-10T14:37:31.579753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602223039931647:10728]
2025-10-10T14:37:31.579756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602223039931647:10728]
2025-10-10T14:37:31.579769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:31.579786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:31.579790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:31.579794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:31.579796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:31.579804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:31.579808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:31.579845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602223039931647:10728]
2025-10-10T14:37:31.579849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:31.579854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:31.579882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.579888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.579928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:31.579936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.579941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.579944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:31.579957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.579969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:31.579995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.580163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.580172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.580188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.580294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2366 partition: 0 MaxSeqNo: 40 sessionId: src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0
2025-10-10T14:37:31.580714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa8dcf1-40c29610-b5731325-a5dd6576_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:31.583842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0] Write session: try to update token
2025-10-10T14:37:31.583865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:31.600078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:31.600106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:31.600110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:31.600112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:31.600122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602223039931647:10728]
2025-10-10T14:37:31.600128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602223039931647:10728]
2025-10-10T14:37:31.600133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602223039931647:10728]
2025-10-10T14:37:31.600189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:31.600204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.600211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:31.600353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:31.601406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:31.601426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:31.601431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:31.610626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2366 sessionId: src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:31.617784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:31.644641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602223822163293:4939]
2025-10-10T14:37:31.645192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2365, pipe: [1:7559602223822163293:4939]
2025-10-10T14:37:31.739414Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:31.739748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.739780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.739809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163293:4939], now have 1 active actors on pipe
2025-10-10T14:37:31.740070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:31.740179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:31.740193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:31.740206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:31.740244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602223822163293:4939]
2025-10-10T14:37:31.740313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2366 reason: error at write: Disconnected sessionId: src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0
2025-10-10T14:37:31.740504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2366 sessionId: src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0 is DEAD
2025-10-10T14:37:31.741248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:31.741260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0] Write session will restart in 0.006416s
2025-10-10T14:37:31.741288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0] Write session: Do CDS request
2025-10-10T14:37:31.741297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:31.749272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.749420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:31.749444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2367
2025-10-10T14:37:31.749676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.749711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:31.749718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:31.749722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:31.750247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2367 sessionId:  describe result for acl check
2025-10-10T14:37:31.750283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:31.750285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:31.750287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:31.750293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602223822163314:10384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:31.750932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602223822163314:10384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:31.760605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602223822163314:10384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:31.771255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602223822163314:10384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:31.771278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602223822163314:10384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:31.771283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602223822163314:10384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:31.771292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:31.776234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:31.779640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:31.779850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:31.779861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:31.779869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:31.779912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:31.779967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602223039931860:10730]
2025-10-10T14:37:31.780476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:31.780807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:31.780854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:31.781121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:31.781185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.781191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.781193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.781194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.781194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.781195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.781196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.781198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.781199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.781200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.781201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.781202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.781203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.781208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.781215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.781218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.781220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.781222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.781224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.781227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.781229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.781231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.781234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.781237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.781239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.781242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.781247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.781252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.781257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.781261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.781264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.781268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.781271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.781275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.781279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.781284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.781287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.781291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.781294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.781297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.781300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.781303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.781307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.781310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.781313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.781317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.781320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.781324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.781327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.781347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.781352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.781358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.781410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:31.784315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:31.784684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:31.784688Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:31.785104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2366
2025-10-10T14:37:31.784691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:31.784695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:31.784700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2366 [2:7559602223039931860:10730]
2025-10-10T14:37:31.784712Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:31.784725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:31.784727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.784730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.784732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.784744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:31.784750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:31.784755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:31.784819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.784822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.784825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.784827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:31.784898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:31.784901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.784911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.784921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.784937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:31.784955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602223039931855:10730]
2025-10-10T14:37:31.784958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602223039931855:10730]
2025-10-10T14:37:31.784961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602223039931855:10730]
2025-10-10T14:37:31.784972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:31.784978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:31.784981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:31.784984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:31.784987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:31.785004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:31.785007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:31.785018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163297:2438], now have 1 active actors on pipe
2025-10-10T14:37:31.785021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163482:10384], now have 1 active actors on pipe
2025-10-10T14:37:31.785043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602223039931855:10730]
2025-10-10T14:37:31.785051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:31.785061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:31.785230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.785234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.785258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:31.785265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.785268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.785270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:31.785279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.785288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:31.785298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.785206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2366
2025-10-10T14:37:31.785478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.785491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.785505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.785629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2367 partition: 0 MaxSeqNo: 40 sessionId: src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0
2025-10-10T14:37:31.786291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b7286a-6dee62c6-86bab77d-f7aa4089_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:31.793596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0] Write session: try to update token
2025-10-10T14:37:31.793622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:31.807853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:31.807884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:31.807888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:31.807890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:31.807903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602223039931855:10730]
2025-10-10T14:37:31.807910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602223039931855:10730]
2025-10-10T14:37:31.807914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602223039931855:10730]
2025-10-10T14:37:31.807971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:31.807977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:31.807985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:31.807989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.807992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:31.807992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:31.808142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:31.826901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2367 sessionId: src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:31.831989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:31.840290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602223822163514:4939]
2025-10-10T14:37:31.840612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2366, pipe: [1:7559602223822163514:4939]
2025-10-10T14:37:31.939826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:31.940431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.940441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.940461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163514:4939], now have 1 active actors on pipe
2025-10-10T14:37:31.940664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:31.941271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602223822163514:4939]
2025-10-10T14:37:31.941321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:31.941384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:31.941500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2367 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0
2025-10-10T14:37:31.941687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2367 sessionId: src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0 is DEAD
2025-10-10T14:37:31.941864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:31.941876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0] Write session will restart in 0.009642s
2025-10-10T14:37:31.941904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0] Write session: Do CDS request
2025-10-10T14:37:31.941911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:31.953133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.953261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:31.953286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2368
2025-10-10T14:37:31.953450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:31.953488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:31.953500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:31.953505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:31.954408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2368 sessionId:  describe result for acl check
2025-10-10T14:37:31.954454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:31.954462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:31.954466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:31.954472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602223822163535:10388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:31.955125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602223822163535:10388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:31.957455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602223822163535:10388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:31.961445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602223822163535:10388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:31.961466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602223822163535:10388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:31.961470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602223822163535:10388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:31.961479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:31.976167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:31.979066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:31.979344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:31.979360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:31.979373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:31.979434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:31.979491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602223039932066:10732]
2025-10-10T14:37:31.980127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:31.980478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:31.980558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:31.980929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:31.980992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.981000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.981001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.981003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.981004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.981005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.981007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.981008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.981009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.981010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.981012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.981013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.981014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.981021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.981034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.981038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.981043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.981047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.981051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.981065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.981069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.981073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.981078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.981082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.981086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.981091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.981099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.981108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:31.981115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.981120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:31.981125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.981131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:31.981135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.981141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:31.981146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.981151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:31.981156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.981161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:31.981170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.981175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:31.981186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.981192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:31.981197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.981203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:31.981207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.981213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:31.981218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.981223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.981233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.981238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.981259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.981269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.981310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:31.986616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:31.987401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:31.987420Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:31.987424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:31.987429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:31.987436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2367 [2:7559602223039932066:10732]
2025-10-10T14:37:31.987453Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:31.987475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:31.987479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.987483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.987486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.987506Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:31.987515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:31.987532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:31.987598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.987600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.987602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.987605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:31.987693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:31.987696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:31.987709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:31.987721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:31.987737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:31.987760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602223039932060:10732]
2025-10-10T14:37:31.987763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602223039932060:10732]
2025-10-10T14:37:31.987765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602223039932060:10732]
2025-10-10T14:37:31.987783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:31.987800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163596:10388], now have 1 active actors on pipe
2025-10-10T14:37:31.987804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602223822163516:2438], now have 1 active actors on pipe
2025-10-10T14:37:31.987803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:31.987808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:31.987811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:31.987814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:31.987830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:31.987833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:31.987878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602223039932060:10732]
2025-10-10T14:37:31.987889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:31.987904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:31.988457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2367
2025-10-10T14:37:31.988503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2367
2025-10-10T14:37:31.988662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.988678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.988731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88d029f0-63949824-279bb711-a8c30863_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:31.988747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:31.988753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:31.988756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:31.988770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:31.988786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:31.988805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.989047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:31.989056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:31.989073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:31.989192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2368 partition: 0 MaxSeqNo: 40 sessionId: src_id|88d029f0-63949824-279bb711-a8c30863_0
2025-10-10T14:37:31.989689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21890044-e30a9e0f-3852d7f4-f7e7e9aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|88d029f0-63949824-279bb711-a8c30863_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:31.992662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d029f0-63949824-279bb711-a8c30863_0] Write session: try to update token
2025-10-10T14:37:31.992682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d029f0-63949824-279bb711-a8c30863_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:32.003097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:32.003126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:32.003138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602223039932060:10732]
2025-10-10T14:37:32.003208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:32.003236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:32.003402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:32.003564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:32.003720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:32.003859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:32.004050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:32.004090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:32.015510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2368 sessionId: src_id|88d029f0-63949824-279bb711-a8c30863_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:32.018325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:32.018612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.018639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.018681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:32.019050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:32.030442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:32.030467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:32.030471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:32.030473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:32.030483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602223039932060:10732]
2025-10-10T14:37:32.030487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602223039932060:10732]
2025-10-10T14:37:32.030491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602223039932060:10732]
2025-10-10T14:37:32.030547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:32.030556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.030560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:32.030706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:32.032323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:32.032340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:32.032345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:32.041676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602228117131022:4939]
2025-10-10T14:37:32.045110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2367, pipe: [1:7559602228117131022:4939]
2025-10-10T14:37:32.154494Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:32.162911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.162947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.163126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.163202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.163266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.163342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.163390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.163399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.163477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.163541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.163614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.163682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.163731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.163742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.163816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.163872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.163934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.164004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.164046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.164056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.164125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.164195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.164267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.164327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.164368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.164374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.164437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.164505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.164574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.164642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.164688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.164696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.164763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.164828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.164897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.164961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.165012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.165019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.165085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.165145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.165214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.165292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.165361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.165371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.165452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.165521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.165598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.165669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.165716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.165719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.165790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.165847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.165910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.165976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.166023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.166025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.166094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:32.166158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:32.166220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:32.166282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:32.166322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:32.166325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:32.166395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131022:4939], now have 1 active actors on pipe
2025-10-10T14:37:32.167506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:32.166843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:32.166847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602228117131022:4939]
2025-10-10T14:37:32.166886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:32.166888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:32.166951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2368 reason: error at write: Disconnected sessionId: src_id|88d029f0-63949824-279bb711-a8c30863_0
2025-10-10T14:37:32.167167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2368 sessionId: src_id|88d029f0-63949824-279bb711-a8c30863_0 is DEAD
2025-10-10T14:37:32.169716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d029f0-63949824-279bb711-a8c30863_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:32.169724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d029f0-63949824-279bb711-a8c30863_0] Write session will restart in 0.006165s
2025-10-10T14:37:32.169752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d029f0-63949824-279bb711-a8c30863_0] Write session: Do CDS request
2025-10-10T14:37:32.169759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d029f0-63949824-279bb711-a8c30863_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:32.181821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88d029f0-63949824-279bb711-a8c30863_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.182440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:32.182466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2369
2025-10-10T14:37:32.189538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.189597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:32.189603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:32.189608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:32.190231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2369 sessionId:  describe result for acl check
2025-10-10T14:37:32.190302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:32.190309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:32.190311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:32.190318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602228117131113:10392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:32.190971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602228117131113:10392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:32.196474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602228117131113:10392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:32.199660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:32.199865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602228117131113:10392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:32.199887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602228117131113:10392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:32.199891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602228117131113:10392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:32.199900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:32.203487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:32.204208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:32.204224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:32.204241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:32.204338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:32.204379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602227334899616:10742]
2025-10-10T14:37:32.204964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:32.205354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:32.205404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:32.205706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:32.205757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.205758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.205759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.205760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.205761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.205763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.205764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.205765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.205766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.205767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.205768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.205769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.205770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.205776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.205790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.205793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.205796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.205800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.205804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.205808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.205811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.205815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.205818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.205822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.205826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.205830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.205837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.205845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.205851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.205856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.205860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.205864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.205868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.205874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.205878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.205882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.205887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.205892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.205897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.205902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.205906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.205911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.205917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.205921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.205925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.205931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.205936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.205941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.205945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.205950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.205954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.205959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.205998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:32.208831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:32.209153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:32.209158Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:32.209160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:32.209164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:32.209171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2368 [2:7559602227334899616:10742]
2025-10-10T14:37:32.209187Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:32.209221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:32.209224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.209227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.209229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.209247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:32.209254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:32.209263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:32.209320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.209323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.209325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.209343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:32.209422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:32.209425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.209435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.209445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.209462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:32.209483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131223:10392], now have 1 active actors on pipe
2025-10-10T14:37:32.209488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131025:2438], now have 1 active actors on pipe
2025-10-10T14:37:32.209496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602227334899610:10742]
2025-10-10T14:37:32.209500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602227334899610:10742]
2025-10-10T14:37:32.209502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602227334899610:10742]
2025-10-10T14:37:32.209517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:32.209532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:32.209534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:32.209540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:32.209543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:32.209548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:32.209551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:32.209576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602227334899610:10742]
2025-10-10T14:37:32.209594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:32.209626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:32.209745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.209758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.209791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a229ee11-83382b85-42f56187-7d3b9a98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:32.209804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.209813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.209816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:32.209828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.209839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:32.209853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.210040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.210048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.210064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.210733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88d029f0-63949824-279bb711-a8c30863_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a229ee11-83382b85-42f56187-7d3b9a98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:32.209586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2368
2025-10-10T14:37:32.209703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2368
2025-10-10T14:37:32.210302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2369 partition: 0 MaxSeqNo: 40 sessionId: src_id|a229ee11-83382b85-42f56187-7d3b9a98_0
2025-10-10T14:37:32.213640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a229ee11-83382b85-42f56187-7d3b9a98_0] Write session: try to update token
2025-10-10T14:37:32.213658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a229ee11-83382b85-42f56187-7d3b9a98_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:32.230824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:32.230850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:32.230854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:32.230856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:32.230867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602227334899610:10742]
2025-10-10T14:37:32.230871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602227334899610:10742]
2025-10-10T14:37:32.230875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602227334899610:10742]
2025-10-10T14:37:32.230933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:32.230947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.230950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:32.230974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:32.230998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:32.231003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:32.231102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:32.241351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2369 sessionId: src_id|a229ee11-83382b85-42f56187-7d3b9a98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:32.244301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:32.267231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602228117131251:4939]
2025-10-10T14:37:32.267673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2368, pipe: [1:7559602228117131251:4939]
2025-10-10T14:37:32.348579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:32.348598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:32.348672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2369 reason: error at write: Disconnected sessionId: src_id|a229ee11-83382b85-42f56187-7d3b9a98_0
2025-10-10T14:37:32.349048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a229ee11-83382b85-42f56187-7d3b9a98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:32.349064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a229ee11-83382b85-42f56187-7d3b9a98_0] Write session will restart in 0.006383s
2025-10-10T14:37:32.348851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2369 sessionId: src_id|a229ee11-83382b85-42f56187-7d3b9a98_0 is DEAD
2025-10-10T14:37:32.348955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:32.348969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602228117131251:4939]
2025-10-10T14:37:32.349092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a229ee11-83382b85-42f56187-7d3b9a98_0] Write session: Do CDS request
2025-10-10T14:37:32.349098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a229ee11-83382b85-42f56187-7d3b9a98_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:32.347273Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:32.348147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.348158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.348179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131251:4939], now have 1 active actors on pipe
2025-10-10T14:37:32.349996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:32.358037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a229ee11-83382b85-42f56187-7d3b9a98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.358406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:32.358426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2370
2025-10-10T14:37:32.358537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.358572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:32.358584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:32.358589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:32.358999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2370 sessionId:  describe result for acl check
2025-10-10T14:37:32.359027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:32.359029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:32.359031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:32.359037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602228117131288:10406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:32.359612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602228117131288:10406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:32.363782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602228117131288:10406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:32.367905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602228117131288:10406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:32.367931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602228117131288:10406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:32.367935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602228117131288:10406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:32.367946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:32.371574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:32.377421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:32.377725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:32.377731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:32.377744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:32.377808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:32.377858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602227334899831:10751]
2025-10-10T14:37:32.378521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:32.381900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:32.381997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:32.382396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:32.382470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.382472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.382473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.382475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.382476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.382478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.382480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.382481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.382482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.382484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.382485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.382486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.382488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.382496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.382509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.382514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.382518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.382522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.382526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.382529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.382532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.382537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.382542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.382546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.382549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.382553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.382563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.382576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.382584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.382590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.382595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.382601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.382605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.382613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.382619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.382624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.382629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.382635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.382641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.382646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.382652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.382657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.382662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.382668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.382673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.382679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.382687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.382693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.382698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.382704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.382710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.382716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.382774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:32.387353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:32.388033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:32.388052Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:32.388055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:32.388059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:32.388067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2369 [2:7559602227334899831:10751]
2025-10-10T14:37:32.388088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:32.388109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:32.388113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.388118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.388121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.388140Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:32.388154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:32.388168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:32.388247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.388255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.388260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.388263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:32.388344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:32.388353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.388367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.388386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.388410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:32.388438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602227334899825:10751]
2025-10-10T14:37:32.388447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602227334899825:10751]
2025-10-10T14:37:32.388449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602227334899825:10751]
2025-10-10T14:37:32.388464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:32.388480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:32.388498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:32.388507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:32.388548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602227334899825:10751]
2025-10-10T14:37:32.388557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:32.388917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:32.388928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:32.388939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:32.388951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:32.389566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131273:2438], now have 1 active actors on pipe
2025-10-10T14:37:32.389580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131457:10406], now have 1 active actors on pipe
2025-10-10T14:37:32.389524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2369
2025-10-10T14:37:32.389582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2369
2025-10-10T14:37:32.390183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.390208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.390251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:32.390272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.390284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.390288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:32.390303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.390329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:32.390355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.390642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.390652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.390669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.391278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a229ee11-83382b85-42f56187-7d3b9a98_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:32.390806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2370 partition: 0 MaxSeqNo: 40 sessionId: src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0
2025-10-10T14:37:32.394106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0] Write session: try to update token
2025-10-10T14:37:32.394126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:32.410062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:32.410090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:32.410094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:32.410097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:32.410109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602227334899825:10751]
2025-10-10T14:37:32.410115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602227334899825:10751]
2025-10-10T14:37:32.410120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602227334899825:10751]
2025-10-10T14:37:32.410184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:32.410194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.410197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:32.410384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:32.410697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:32.410705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:32.410711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:32.412769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2370 sessionId: src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:32.415586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:32.448980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602228117131485:4939]
2025-10-10T14:37:32.449310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2369, pipe: [1:7559602228117131485:4939]
2025-10-10T14:37:32.529818Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:32.530251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.530263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.530305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131485:4939], now have 1 active actors on pipe
2025-10-10T14:37:32.530567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:32.531194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:32.531204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602228117131485:4939]
2025-10-10T14:37:32.531240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:32.531333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2370 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0
2025-10-10T14:37:32.531546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2370 sessionId: src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0 is DEAD
2025-10-10T14:37:32.534082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:32.534100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0] Write session will restart in 0.009204s
2025-10-10T14:37:32.534127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0] Write session: Do CDS request
2025-10-10T14:37:32.534133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:32.544914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.545029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:32.545058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2371
2025-10-10T14:37:32.545233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.545267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:32.545273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:32.545277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:32.545862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2371 sessionId:  describe result for acl check
2025-10-10T14:37:32.545907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:32.545909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:32.545911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:32.545918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602228117131536:10410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:32.546476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602228117131536:10410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:32.549936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602228117131536:10410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:32.554271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602228117131536:10410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:32.554290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602228117131536:10410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:32.554293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602228117131536:10410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:32.554303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:32.554516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:32.557401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:32.557658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:32.557671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:32.557683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:32.557742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:32.557788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602227334900040:10753]
2025-10-10T14:37:32.558496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:32.558823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:32.558890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:32.559233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:32.559298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.559304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.559305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.559306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.559307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.559309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.559309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.559311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.559312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.559313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.559314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.559315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.559316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.559322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.559333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.559337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.559341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.559344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.559348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.559351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.559354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.559357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.559361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.559364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.559367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.559370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.559378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.559386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.559391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.559398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.559402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.559406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.559410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.559414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.559418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.559422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.559426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.559430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.559434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.559439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.559442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.559446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.559453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.559458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.559464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.559468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.559472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.559476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.559484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.559489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.559493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.559503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.559538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:32.562251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:32.562622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:32.562637Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:32.562640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:32.562644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:32.562652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2370 [2:7559602227334900040:10753]
2025-10-10T14:37:32.562666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:32.562688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:32.562691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.562694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.562697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.562716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:32.562725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:32.562734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:32.562803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.562813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.562816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.562818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:32.562888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:32.562904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.562918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.562935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.562957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:32.562984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602227334900034:10753]
2025-10-10T14:37:32.562992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602227334900034:10753]
2025-10-10T14:37:32.562994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602227334900034:10753]
2025-10-10T14:37:32.563004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:32.563013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:32.563023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:32.563026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:32.563028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:32.563038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:32.563041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:32.563054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131687:10410], now have 1 active actors on pipe
2025-10-10T14:37:32.563064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131488:2438], now have 1 active actors on pipe
2025-10-10T14:37:32.563091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602227334900034:10753]
2025-10-10T14:37:32.563104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:32.563317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2370
2025-10-10T14:37:32.563349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:32.563366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2370
2025-10-10T14:37:32.563544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.563559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.563590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51ce1db5-5c75623-7f829779-7aec0452_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:32.563600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.563604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.563607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:32.563620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.563634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:32.563649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.567180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2371 partition: 0 MaxSeqNo: 40 sessionId: src_id|51ce1db5-5c75623-7f829779-7aec0452_0
2025-10-10T14:37:32.566981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.566993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.567018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.572421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c4c3349-d27a9ec-576a2eb-51eabe42_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51ce1db5-5c75623-7f829779-7aec0452_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:32.575412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ce1db5-5c75623-7f829779-7aec0452_0] Write session: try to update token
2025-10-10T14:37:32.575437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ce1db5-5c75623-7f829779-7aec0452_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:32.587232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:32.587255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:32.587257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:32.587258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:32.587268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602227334900034:10753]
2025-10-10T14:37:32.587272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602227334900034:10753]
2025-10-10T14:37:32.587275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602227334900034:10753]
2025-10-10T14:37:32.587329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:32.587335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:32.587339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:32.587340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:32.587347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.587350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:32.587479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:32.610974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2371 sessionId: src_id|51ce1db5-5c75623-7f829779-7aec0452_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:32.613797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:32.631252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602228117131700:4939]
2025-10-10T14:37:32.631610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2370, pipe: [1:7559602228117131700:4939]
2025-10-10T14:37:32.704040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:32.704770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.704800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.704826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131700:4939], now have 1 active actors on pipe
2025-10-10T14:37:32.705064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:32.705144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:32.705148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:32.705179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:32.705205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602228117131700:4939]
2025-10-10T14:37:32.705259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2371 reason: error at write: Disconnected sessionId: src_id|51ce1db5-5c75623-7f829779-7aec0452_0
2025-10-10T14:37:32.705474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2371 sessionId: src_id|51ce1db5-5c75623-7f829779-7aec0452_0 is DEAD
2025-10-10T14:37:32.705675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ce1db5-5c75623-7f829779-7aec0452_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:32.705687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ce1db5-5c75623-7f829779-7aec0452_0] Write session will restart in 0.007784s
2025-10-10T14:37:32.705715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ce1db5-5c75623-7f829779-7aec0452_0] Write session: Do CDS request
2025-10-10T14:37:32.705738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ce1db5-5c75623-7f829779-7aec0452_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:32.714910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51ce1db5-5c75623-7f829779-7aec0452_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.715224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:32.715247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2372
2025-10-10T14:37:32.715401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.715461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:32.715482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:32.715487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:32.716267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2372 sessionId:  describe result for acl check
2025-10-10T14:37:32.716309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:32.716311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:32.716313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:32.716320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602228117131727:10414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:32.716893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602228117131727:10414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:32.719732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602228117131727:10414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:32.724142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602228117131727:10414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:32.724163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602228117131727:10414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:32.724168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602228117131727:10414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:32.724178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:32.726413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:32.729292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:32.729595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:32.729608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:32.729620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:32.729680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:32.729732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602227334900250:10755]
2025-10-10T14:37:32.730426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:32.730813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:32.730885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:32.731269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:32.731332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.731339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.731340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.731342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.731344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.731345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.731347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.731349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.731351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.731353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.731354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.731356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.731357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.731364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.731380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.731385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.731390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.731395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.731401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.731405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.731411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.731416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.731421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.731426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.731430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.731435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.731444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.731454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.731468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.731475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.731481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.731488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.731494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.731500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.731506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.731518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.731523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.731535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.731541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.731552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.731557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.731564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.731570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.731576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.731581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.731588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.731593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.731601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.731609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.731615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.731620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.731627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.731675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:32.734391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:32.734730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:32.734747Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:32.734750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:32.734754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:32.734762Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2371 [2:7559602227334900250:10755]
2025-10-10T14:37:32.734777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:32.734798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:32.734801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.734805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.734808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.734827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:32.734836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:32.734845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:32.734906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.734915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.734918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.734921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:32.734989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:32.734992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.735003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.735014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.735031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:32.735052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602227334900245:10755]
2025-10-10T14:37:32.735061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602227334900245:10755]
2025-10-10T14:37:32.735064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602227334900245:10755]
2025-10-10T14:37:32.735175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2371
2025-10-10T14:37:32.735188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2371
2025-10-10T14:37:32.735079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:32.735096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:32.735099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:32.735101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131702:2438], now have 1 active actors on pipe
2025-10-10T14:37:32.735101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:32.735107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131901:10414], now have 1 active actors on pipe
2025-10-10T14:37:32.735113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:32.735130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:32.735148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:32.735184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602227334900245:10755]
2025-10-10T14:37:32.735190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:32.735237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:32.735411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.735421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.735457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:32.735471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.735476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.735479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:32.735493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.735505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:32.735521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.735746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.735754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.735769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.735927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2372 partition: 0 MaxSeqNo: 40 sessionId: src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0
2025-10-10T14:37:32.736345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51ce1db5-5c75623-7f829779-7aec0452_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:32.739985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0] Write session: try to update token
2025-10-10T14:37:32.740011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:32.755988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:32.756007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:32.756011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:32.756013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:32.756024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602227334900245:10755]
2025-10-10T14:37:32.756029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602227334900245:10755]
2025-10-10T14:37:32.756033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602227334900245:10755]
2025-10-10T14:37:32.756088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:32.756091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:32.756096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:32.756101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.756104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:32.756106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:32.756254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:32.762570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2372 sessionId: src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:32.765393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:32.805353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602228117131923:4939]
2025-10-10T14:37:32.805769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2371, pipe: [1:7559602228117131923:4939]
2025-10-10T14:37:32.876286Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:32.877419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:32.877570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2372 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0
2025-10-10T14:37:32.877653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602228117131923:4939]
2025-10-10T14:37:32.877685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:32.877762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2372 sessionId: src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0 is DEAD
2025-10-10T14:37:32.878001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:32.878012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0] Write session will restart in 0.008780s
2025-10-10T14:37:32.878038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0] Write session: Do CDS request
2025-10-10T14:37:32.878044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:32.876941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.876956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.877003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131923:4939], now have 1 active actors on pipe
2025-10-10T14:37:32.877229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:32.887952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.888070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:32.888092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2373
2025-10-10T14:37:32.889636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:32.889689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:32.889697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:32.889702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:32.890209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2373 sessionId:  describe result for acl check
2025-10-10T14:37:32.890251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:32.890253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:32.890255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:32.890262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602228117131943:10419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:32.890890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602228117131943:10419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:32.896075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602228117131943:10419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:32.904503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602228117131943:10419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:32.904526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602228117131943:10419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:32.904530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602228117131943:10419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:32.904541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:32.914717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:32.919249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:32.919582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:32.919595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:32.919611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:32.919700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:32.919751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602227334900461:10757]
2025-10-10T14:37:32.920408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:32.920904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:32.920956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:32.921313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:32.921400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.921407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.921409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.921410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.921412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.921414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.921415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.921416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.921418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.921420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.921421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.921423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.921424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.921431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.921446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.921451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.921456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.921460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.921465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.921469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.921473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.921478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.921482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.921487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.921491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.921495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.921506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.921525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:32.921532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.921538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:32.921544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.921549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:32.921561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.921566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:32.921570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.921583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:32.921589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.921595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:32.921600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.921605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:32.921615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.921620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:32.921626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.921631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:32.921643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.921648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:32.921653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.921659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.921664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.921674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.921680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.921699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.921747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:32.924865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:32.925624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:32.925637Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:32.925640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:32.925644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:32.925651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2372 [2:7559602227334900461:10757]
2025-10-10T14:37:32.925666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:32.925687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:32.925691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.925694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.925697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.925718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:32.925732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:32.925742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:32.925820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.925827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.925829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.925832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:32.925902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:32.925913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.925924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:32.925937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:32.925954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:32.925983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117131928:2438], now have 1 active actors on pipe
2025-10-10T14:37:32.925987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117132025:10419], now have 1 active actors on pipe
2025-10-10T14:37:32.925995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602227334900456:10757]
2025-10-10T14:37:32.925998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602227334900456:10757]
2025-10-10T14:37:32.926001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602227334900456:10757]
2025-10-10T14:37:32.926014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:32.926093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2372
2025-10-10T14:37:32.926093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2372
2025-10-10T14:37:32.926030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:32.926033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:32.926041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:32.926043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:32.926050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:32.926053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:32.926094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602227334900456:10757]
2025-10-10T14:37:32.926105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:32.926149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:32.926388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.926398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.926431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57513153-88ecc388-d39e0581-cd250b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:32.926441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:32.926446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:32.926448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:32.926461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:32.926485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:32.926502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.926943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:32.926953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:32.926974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:32.927108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2373 partition: 0 MaxSeqNo: 40 sessionId: src_id|57513153-88ecc388-d39e0581-cd250b_0
2025-10-10T14:37:32.927592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3072bd3e-f6d365fc-bf80449f-5e5cf6bd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57513153-88ecc388-d39e0581-cd250b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:32.930804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57513153-88ecc388-d39e0581-cd250b_0] Write session: try to update token
2025-10-10T14:37:32.930830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57513153-88ecc388-d39e0581-cd250b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:32.948667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:32.948691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:32.948695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:32.948698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:32.948709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602227334900456:10757]
2025-10-10T14:37:32.948714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602227334900456:10757]
2025-10-10T14:37:32.948720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602227334900456:10757]
2025-10-10T14:37:32.948773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:32.948781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:32.948784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:32.948786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:32.948793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:32.948801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:32.948914Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:32.963677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2373 sessionId: src_id|57513153-88ecc388-d39e0581-cd250b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:32.966775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:32.977405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602228117132143:4939]
2025-10-10T14:37:32.977943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2372, pipe: [1:7559602228117132143:4939]
2025-10-10T14:37:33.064929Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:33.065245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.065258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.065283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602228117132143:4939], now have 1 active actors on pipe
2025-10-10T14:37:33.065551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:33.065689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:33.065691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602228117132143:4939]
2025-10-10T14:37:33.065721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:33.065811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2373 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57513153-88ecc388-d39e0581-cd250b_0
2025-10-10T14:37:33.066009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2373 sessionId: src_id|57513153-88ecc388-d39e0581-cd250b_0 is DEAD
2025-10-10T14:37:33.066144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57513153-88ecc388-d39e0581-cd250b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:33.066155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57513153-88ecc388-d39e0581-cd250b_0] Write session will restart in 0.007978s
2025-10-10T14:37:33.066190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57513153-88ecc388-d39e0581-cd250b_0] Write session: Do CDS request
2025-10-10T14:37:33.066197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57513153-88ecc388-d39e0581-cd250b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:33.077898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57513153-88ecc388-d39e0581-cd250b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.077969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:33.077989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2374
2025-10-10T14:37:33.078154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.078208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:33.078221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:33.078231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:33.078845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2374 sessionId:  describe result for acl check
2025-10-10T14:37:33.078888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:33.078896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:33.078898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:33.078905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602232412099499:10423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:33.079542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602232412099499:10423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:33.083510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602232412099499:10423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:33.087252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602232412099499:10423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:33.087271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602232412099499:10423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:33.087274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602232412099499:10423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:33.087283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:33.087450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:33.090800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:33.091053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:33.091059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:33.091071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:33.091126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:33.091184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602231629867971:10759]
2025-10-10T14:37:33.091905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:33.092303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:33.092348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:33.092692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:33.092757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.092764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.092766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.092767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.092769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.092770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.092772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.092773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.092774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.092776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.092777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.092778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.092780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.092786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.092801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.092806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.092811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.092815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.092819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.092824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.092829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.092833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.092838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.092843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.092847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.092852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.092860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.092870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.092877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.092883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.092888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.092894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.092900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.092906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.092911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.092917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.092923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.092928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.092933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.092939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.092943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.092957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.092963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.092969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.092975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.092981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.092986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.092994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.092999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.093005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.093011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.093017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.093077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:33.096056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:33.096767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:33.096779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:33.096782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:33.096786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:33.096793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2373 [2:7559602231629867971:10759]
2025-10-10T14:37:33.096805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:33.096824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:33.096832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.096835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.096838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.096855Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:33.096866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:33.096874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:33.096931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.096938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.096940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.096942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:33.097011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:33.097018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.097026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.097035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.097053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:33.097080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412099442:2438], now have 1 active actors on pipe
2025-10-10T14:37:33.097095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602231629867965:10759]
2025-10-10T14:37:33.097097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602231629867965:10759]
2025-10-10T14:37:33.097101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602231629867965:10759]
2025-10-10T14:37:33.097113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:33.097124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412099645:10423], now have 1 active actors on pipe
2025-10-10T14:37:33.097133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:33.097138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:33.097141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:33.097144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:33.097147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:33.097150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:33.097181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602231629867965:10759]
2025-10-10T14:37:33.097135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2373
2025-10-10T14:37:33.097192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:33.097205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2373
2025-10-10T14:37:33.097210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:33.097241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.097250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.097280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:33.097292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.097298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.097300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:33.097313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.097325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:33.097361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.097545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.097551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.097566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.097683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2374 partition: 0 MaxSeqNo: 40 sessionId: src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0
2025-10-10T14:37:33.098139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57513153-88ecc388-d39e0581-cd250b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:33.100887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0] Write session: try to update token
2025-10-10T14:37:33.100909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:33.116355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:33.116373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:33.116383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602231629867965:10759]
2025-10-10T14:37:33.116436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:33.116448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:33.116612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:33.116775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:33.116929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:33.117083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:33.117302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:33.117371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:33.117889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2374 sessionId: src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:33.120727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:33.121036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.121057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.121097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:33.121184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:33.128751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:33.128771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:33.128775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:33.128777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:33.128790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602231629867965:10759]
2025-10-10T14:37:33.128795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602231629867965:10759]
2025-10-10T14:37:33.128799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602231629867965:10759]
2025-10-10T14:37:33.128853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:33.128857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:33.128861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.128864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:33.128865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:33.128871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:33.129001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:33.165790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602232412099658:4939]
2025-10-10T14:37:33.166216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2373, pipe: [1:7559602232412099658:4939]
2025-10-10T14:37:33.244893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:33.254406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.254433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.254628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.254699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.254762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.254837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.254889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.254899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.254976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.255048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.255120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.255214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.255261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.255266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.255344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.255407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.255471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.255536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.255582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.255585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.255658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.255727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.255793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.255859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.255903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.255908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.255982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.256044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.256107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.256167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.256212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.256215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.256288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.256346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.256413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.256481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.256528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.256531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.256610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.256672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.256741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.256807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.256853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.256856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.256935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.256999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.257064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.257124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.257169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.257174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.257248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.257309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.257593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.258394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:33.258419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:33.258431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602232412099658:4939]
2025-10-10T14:37:33.258460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:33.258466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2374 reason: error at write: Disconnected sessionId: src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0
2025-10-10T14:37:33.258691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2374 sessionId: src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0 is DEAD
2025-10-10T14:37:33.258886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:33.258898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0] Write session will restart in 0.009024s
2025-10-10T14:37:33.258926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0] Write session: Do CDS request
2025-10-10T14:37:33.258942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:33.257675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.257732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.257735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.257815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:33.257879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:33.257943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:33.258007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:33.258053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:33.258055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:33.258127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412099658:4939], now have 1 active actors on pipe
2025-10-10T14:37:33.259425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:33.268970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.269122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:33.269149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2375
2025-10-10T14:37:33.269435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.269495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:33.269506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:33.269512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:33.270198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2375 sessionId:  describe result for acl check
2025-10-10T14:37:33.270249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:33.270261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:33.270263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:33.270272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602232412099700:10428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:33.270907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602232412099700:10428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:33.275483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602232412099700:10428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:33.280001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:33.280454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602232412099700:10428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:33.280477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602232412099700:10428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:33.280481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602232412099700:10428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:33.280491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:33.282508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:33.282780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:33.282791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:33.282804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:33.282859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:33.282905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602231629868227:10774]
2025-10-10T14:37:33.283566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:33.283952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:33.284022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:33.284388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:33.284474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.284481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.284482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.284484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.284485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.284487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.284488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.284489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.284491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.284492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.284493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.284495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.284496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.284503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.284517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.284521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.284525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.284529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.284533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.284537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.284540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.284544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.284549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.284553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.284557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.284560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.284570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.284578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.284584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.284590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.284594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.284609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.284613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.284619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.284624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.284636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.284641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.284646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.284656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.284661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.284665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.284671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.284675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.284681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.284685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.284691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.284695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.284707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.284712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.284722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.284727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.284732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.284777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:33.287780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:33.288282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:33.288296Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:33.288298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:33.288302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:33.288309Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2374 [2:7559602231629868227:10774]
2025-10-10T14:37:33.288324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:33.288348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:33.288356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.288360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.288363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.288382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:33.288398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:33.288407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:33.288478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.288487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.288490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.288493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:33.288568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:33.288577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.288590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.288602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.288809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2374
2025-10-10T14:37:33.288621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:33.288644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602231629868221:10774]
2025-10-10T14:37:33.288826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2374
2025-10-10T14:37:33.288646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602231629868221:10774]
2025-10-10T14:37:33.288649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602231629868221:10774]
2025-10-10T14:37:33.288658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:33.288675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:33.288680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:33.288683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:33.288686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:33.288692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:33.288695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:33.288742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412099675:2438], now have 1 active actors on pipe
2025-10-10T14:37:33.288746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602231629868221:10774]
2025-10-10T14:37:33.288758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:33.288764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412099877:10428], now have 1 active actors on pipe
2025-10-10T14:37:33.288783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:33.288918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.288923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.288956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:33.288965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.288970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.288972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:33.288988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.289008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:33.289029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.289201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.289211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.289228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.289354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2375 partition: 0 MaxSeqNo: 40 sessionId: src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0
2025-10-10T14:37:33.293534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5167d6f-66d12d37-79b3a04d-9e1e7227_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:33.296487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0] Write session: try to update token
2025-10-10T14:37:33.296514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:33.309118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:33.309139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:33.309143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:33.309145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:33.309156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602231629868221:10774]
2025-10-10T14:37:33.309160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602231629868221:10774]
2025-10-10T14:37:33.309164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602231629868221:10774]
2025-10-10T14:37:33.309214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:33.309216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:33.309222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:33.309225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.309227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:33.309228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:33.309388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:33.313202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2375 sessionId: src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:33.316428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:33.361401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602232412099902:4939]
2025-10-10T14:37:33.364950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2374, pipe: [1:7559602232412099902:4939]
2025-10-10T14:37:33.427507Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:33.427992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.428009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.428058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412099902:4939], now have 1 active actors on pipe
2025-10-10T14:37:33.428327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:33.428332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:33.428337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:33.428393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602232412099902:4939]
2025-10-10T14:37:33.428405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2375 reason: error at write: Disconnected sessionId: src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0
2025-10-10T14:37:33.428612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2375 sessionId: src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0 is DEAD
2025-10-10T14:37:33.428307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:33.429427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:33.429441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0] Write session will restart in 0.009407s
2025-10-10T14:37:33.429469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0] Write session: Do CDS request
2025-10-10T14:37:33.429478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:33.441941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.444334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:33.444364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2376
2025-10-10T14:37:33.444549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.444615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:33.444643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:33.444653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:33.445192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2376 sessionId:  describe result for acl check
2025-10-10T14:37:33.445249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:33.445257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:33.445259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:33.445266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602232412100076:10441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:33.445909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602232412100076:10441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:33.448861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:33.448899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602232412100076:10441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:33.452252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:33.452510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:33.452521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:33.452534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:33.452596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:33.452657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602231629868447:10778]
2025-10-10T14:37:33.452900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602232412100076:10441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:33.452921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602232412100076:10441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:33.452925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602232412100076:10441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:33.452934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:33.453387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:33.453825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:33.453875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:33.454221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:33.454282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.454291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.454293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.454294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.454296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.454297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.454298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.454300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.454301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.454303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.454304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.454306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.454307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.454314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.454329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.454333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.454338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.454342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.454347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.454351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.454355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.454360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.454365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.454369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.454373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.454378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.454397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.454407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.454414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.454420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.454425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.454431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.454436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.454441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.454448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.454461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.454466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.454472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.454478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.454483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.454489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.454495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.454499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.454505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.454510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.454516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.454522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.454527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.454532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.454538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.454543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.454549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.454592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:33.457286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:33.457668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:33.457686Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:33.457689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:33.457694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:33.457701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2375 [2:7559602231629868447:10778]
2025-10-10T14:37:33.457715Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:33.457739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:33.457747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.457751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.457753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.457771Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:33.457784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:33.457798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:33.457864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.457878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.457881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.457884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:33.458234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2375
2025-10-10T14:37:33.458249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2375
2025-10-10T14:37:33.458282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:33.458295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.458310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.458325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.458346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:33.458379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412099915:2438], now have 1 active actors on pipe
2025-10-10T14:37:33.458388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100120:10441], now have 1 active actors on pipe
2025-10-10T14:37:33.458409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.458415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.458436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602231629868442:10778]
2025-10-10T14:37:33.458444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602231629868442:10778]
2025-10-10T14:37:33.458446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602231629868442:10778]
2025-10-10T14:37:33.458461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:33.458473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:33.458482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:33.458483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:33.458485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:33.458499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:33.458503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:33.458525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:33.458538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.458544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.458551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:33.458564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.458580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:33.458619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602231629868442:10778]
2025-10-10T14:37:33.458633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:33.458649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.458649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:33.461250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.461268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.461321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.461497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2376 partition: 0 MaxSeqNo: 40 sessionId: src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0
2025-10-10T14:37:33.461919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65cfacb6-597c5ea0-f8c4ce72-b7ee861d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:33.464620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0] Write session: try to update token
2025-10-10T14:37:33.464637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:33.481839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:33.481856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:33.481859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:33.481861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:33.481871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602231629868442:10778]
2025-10-10T14:37:33.481875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602231629868442:10778]
2025-10-10T14:37:33.481878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602231629868442:10778]
2025-10-10T14:37:33.481925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:33.481932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:33.481940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:33.481940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.481943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:33.481944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:33.482083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:33.488191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2376 sessionId: src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:33.490898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:33.528800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602232412100133:4939]
2025-10-10T14:37:33.529098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2375, pipe: [1:7559602232412100133:4939]
2025-10-10T14:37:33.601032Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:33.601293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.601307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.601403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100133:4939], now have 1 active actors on pipe
2025-10-10T14:37:33.601599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:33.601814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:33.601934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0
2025-10-10T14:37:33.602149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2376 sessionId: src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0 is DEAD
2025-10-10T14:37:33.602161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602232412100133:4939]
2025-10-10T14:37:33.602185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:33.602553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:33.602563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0] Write session will restart in 0.006428s
2025-10-10T14:37:33.602590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0] Write session: Do CDS request
2025-10-10T14:37:33.602596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:33.609931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.610054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:33.610077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2377
2025-10-10T14:37:33.610219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.610256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:33.610268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:33.610272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:33.610738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2377 sessionId:  describe result for acl check
2025-10-10T14:37:33.610780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:33.610782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:33.610786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:33.610792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602232412100145:10445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:33.611398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602232412100145:10445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:33.613957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602232412100145:10445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:33.618201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602232412100145:10445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:33.618222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602232412100145:10445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:33.618226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602232412100145:10445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:33.618235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:33.624379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:33.627109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:33.627413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:33.627425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:33.627438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:33.627502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:33.627556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602231629868663:10780]
2025-10-10T14:37:33.628209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:33.628562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:33.628626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:33.628968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:33.629054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.629061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.629063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.629064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.629066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.629067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.629068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.629070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.629071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.629073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.629074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.629076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.629077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.629083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.629099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.629103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.629108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.629113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.629118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.629123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.629128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.629132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.629137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.629142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.629146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.629150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.629160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.629169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.629176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.629183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.629188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.629195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.629200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.629212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.629217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.629223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.629231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.629242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.629248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.629259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.629263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.629269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.629280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.629286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.629296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.629302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.629312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.629318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.629327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.629351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.629362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.629369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.629420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:33.632040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:33.632383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:33.632396Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:33.632398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:33.632402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:33.632411Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2376 [2:7559602231629868663:10780]
2025-10-10T14:37:33.632425Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:33.632443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:33.632446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.632449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.632452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.632470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:33.632478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:33.632487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:33.632553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.632561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.632563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.632565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:33.632643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:33.632653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.632664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.632674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.632689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:33.632715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100134:2438], now have 1 active actors on pipe
2025-10-10T14:37:33.632725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100227:10445], now have 1 active actors on pipe
2025-10-10T14:37:33.632733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602231629868658:10780]
2025-10-10T14:37:33.632735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602231629868658:10780]
2025-10-10T14:37:33.632738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602231629868658:10780]
2025-10-10T14:37:33.632754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:33.632770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:33.632778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:33.632784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:33.632786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:33.632793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:33.632796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:33.632821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602231629868658:10780]
2025-10-10T14:37:33.632838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:33.632859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:33.632855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2376
2025-10-10T14:37:33.632986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2376
2025-10-10T14:37:33.633181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.633193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.633231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:33.633245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.633250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.633252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:33.633264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.633275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:33.633296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.633513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.633526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.633545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.633664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2377 partition: 0 MaxSeqNo: 40 sessionId: src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0
2025-10-10T14:37:33.634126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22edc3b9-468ca8a-b0d82b36-63f1f519_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:33.637101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0] Write session: try to update token
2025-10-10T14:37:33.637121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:33.653155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:33.653179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:33.653182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:33.653184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:33.653194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602231629868658:10780]
2025-10-10T14:37:33.653199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602231629868658:10780]
2025-10-10T14:37:33.653203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602231629868658:10780]
2025-10-10T14:37:33.653258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:33.653265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.653271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:33.653443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:33.654274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2377 sessionId: src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:33.655277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:33.655299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:33.655304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:33.657091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:33.700923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602232412100353:4939]
2025-10-10T14:37:33.701323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2376, pipe: [1:7559602232412100353:4939]
2025-10-10T14:37:33.774896Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:33.775519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.775540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.775587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100353:4939], now have 1 active actors on pipe
2025-10-10T14:37:33.776001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:33.776002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:33.776019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602232412100353:4939]
2025-10-10T14:37:33.776051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:33.776053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:33.776143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2377 reason: error at write: Disconnected sessionId: src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0
2025-10-10T14:37:33.776545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:33.776555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0] Write session will restart in 0.005812s
2025-10-10T14:37:33.776582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0] Write session: Do CDS request
2025-10-10T14:37:33.776589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:33.776341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2377 sessionId: src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0 is DEAD
2025-10-10T14:37:33.783913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.784003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:33.784024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2378
2025-10-10T14:37:33.784212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.784252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:33.784264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:33.784269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:33.784804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2378 sessionId:  describe result for acl check
2025-10-10T14:37:33.784852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:33.784854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:33.784857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:33.784871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602232412100375:10450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:33.785518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602232412100375:10450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:33.788776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602232412100375:10450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:33.792622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602232412100375:10450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:33.792646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602232412100375:10450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:33.792650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602232412100375:10450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:33.792659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:33.796001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:33.799191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:33.799435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:33.799447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:33.799461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:33.799526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:33.799573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602231629868879:10782]
2025-10-10T14:37:33.800253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:33.800607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:33.800678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:33.801077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:33.801147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.801153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.801154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.801156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.801157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.801158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.801159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.801160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.801162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.801163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.801164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.801165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.801167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.801173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.801186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.801189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.801194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.801198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.801202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.801206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.801210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.801213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.801219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.801223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.801227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.801231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.801239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.801249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.801256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.801263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.801267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.801271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.801275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.801280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.801284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.801288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.801294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.801300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.801305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.801317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.801321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.801325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.801348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.801355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.801364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.801370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.801375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.801385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.801389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.801395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.801405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.801410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.801455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:33.804163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:33.804636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:33.804667Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:33.804669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:33.804673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:33.804680Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2377 [2:7559602231629868879:10782]
2025-10-10T14:37:33.804693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:33.804712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:33.804715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.804719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.804722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.804740Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:33.804752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:33.804760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:33.805092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.805106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.805108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.805111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:33.805187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:33.805196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.805209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.805225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.805248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:33.805273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100359:2438], now have 1 active actors on pipe
2025-10-10T14:37:33.805281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100525:10450], now have 1 active actors on pipe
2025-10-10T14:37:33.805290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602231629868874:10782]
2025-10-10T14:37:33.805292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602231629868874:10782]
2025-10-10T14:37:33.805295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602231629868874:10782]
2025-10-10T14:37:33.805309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:33.805341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:33.805349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:33.805353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:33.805355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:33.805368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:33.805373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:33.805402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602231629868874:10782]
2025-10-10T14:37:33.805409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:33.805442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:33.805443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2377
2025-10-10T14:37:33.805446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2377
2025-10-10T14:37:33.805668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.805679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.805714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:33.805733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.805742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.805745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:33.805759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.805787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:33.805811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.806059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.806067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.806083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.806211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2378 partition: 0 MaxSeqNo: 40 sessionId: src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0
2025-10-10T14:37:33.806637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f188aba6-4382d236-1f0207ad-f11aa6d3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:33.809572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0] Write session: try to update token
2025-10-10T14:37:33.809594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:33.824911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2378 sessionId: src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:33.824982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:33.825003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:33.825006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:33.825008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:33.825019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602231629868874:10782]
2025-10-10T14:37:33.825023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602231629868874:10782]
2025-10-10T14:37:33.825028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602231629868874:10782]
2025-10-10T14:37:33.825082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:33.825090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.825092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:33.825099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:33.825107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:33.825112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:33.825243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:33.828140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:33.876447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602232412100583:4939]
2025-10-10T14:37:33.876808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2377, pipe: [1:7559602232412100583:4939]
2025-10-10T14:37:33.940886Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:33.943549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.943577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.943649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100583:4939], now have 1 active actors on pipe
2025-10-10T14:37:33.943920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:33.944035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:33.944076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602232412100583:4939]
2025-10-10T14:37:33.944107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:33.944235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2378 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0
2025-10-10T14:37:33.944452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2378 sessionId: src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0 is DEAD
2025-10-10T14:37:33.944657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:33.944671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0] Write session will restart in 0.008448s
2025-10-10T14:37:33.944698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0] Write session: Do CDS request
2025-10-10T14:37:33.944718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:33.955499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.955606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:33.955632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2379
2025-10-10T14:37:33.955772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:33.955801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:33.955807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:33.955814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:33.956322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2379 sessionId:  describe result for acl check
2025-10-10T14:37:33.956382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:33.956384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:33.956390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:33.956396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602232412100604:10454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:33.957043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602232412100604:10454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:33.960856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602232412100604:10454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:33.967361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602232412100604:10454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:33.967387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602232412100604:10454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:33.967392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602232412100604:10454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:33.967402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:33.972638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:33.975301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:33.975568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:33.975581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:33.975594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:33.975653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:33.975702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602231629869096:10784]
2025-10-10T14:37:33.976388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:33.976745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:33.976792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:33.977144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:33.977203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.977208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.977210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.977211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.977213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.977214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.977216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.977217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.977218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.977220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.977222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.977223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.977224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.977230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.977244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.977249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.977254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.977258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.977263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.977267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.977272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.977276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.977281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.977286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.977290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.977294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.977303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.977311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:33.977319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.977325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:33.977346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.977352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:33.977357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.977368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:33.977373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.977379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:33.977389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.977396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:33.977406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.977412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:33.977418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.977428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:33.977436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.977445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:33.977450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.977456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:33.977465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.977470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.977474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.977479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.977483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.977493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.977537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:33.980287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:33.981082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2378
2025-10-10T14:37:33.981093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2378
2025-10-10T14:37:33.980615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:33.980630Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:33.980633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:33.980638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:33.980645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2378 [2:7559602231629869096:10784]
2025-10-10T14:37:33.980661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:33.980680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:33.980684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.980688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.980691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.980710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:33.980719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:33.980728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:33.980811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.980814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.980817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.980820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:33.980893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:33.980896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:33.980909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:33.980934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:33.980953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:33.980975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602231629869091:10784]
2025-10-10T14:37:33.980978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602231629869091:10784]
2025-10-10T14:37:33.980981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602231629869091:10784]
2025-10-10T14:37:33.980997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:33.981014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100747:10454], now have 1 active actors on pipe
2025-10-10T14:37:33.981019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602232412100584:2438], now have 1 active actors on pipe
2025-10-10T14:37:33.981019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:33.981024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:33.981027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:33.981027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:33.981045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:33.981048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:33.981084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602231629869091:10784]
2025-10-10T14:37:33.981095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:33.981120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:33.981136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.981142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.981176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:33.981185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:33.981189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:33.981192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:33.981204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:33.981215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:33.981231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.981418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:33.981427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:33.981455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:33.981689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2379 partition: 0 MaxSeqNo: 40 sessionId: src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0
2025-10-10T14:37:33.982132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e52a881-fce6edc1-710cb69b-1d30358e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:33.985740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0] Write session: try to update token
2025-10-10T14:37:33.985766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:33.993210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:33.993230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:33.993241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602231629869091:10784]
2025-10-10T14:37:33.993297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:33.993497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:33.993645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:33.993778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:33.993911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:33.994098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:33.994135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:33.994240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:34.014162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:34.014191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:34.014195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:34.014197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:34.014209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602231629869091:10784]
2025-10-10T14:37:34.014214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602231629869091:10784]
2025-10-10T14:37:34.014219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602231629869091:10784]
2025-10-10T14:37:34.014281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:34.014290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.014293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:34.014442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:34.012418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2379 sessionId: src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:34.015607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:34.015792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:34.015807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:34.015811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:34.044368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602236707068101:4939]
2025-10-10T14:37:34.044924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2378, pipe: [1:7559602236707068101:4939]
2025-10-10T14:37:34.135827Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:34.136432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.136450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.136476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068101:4939], now have 1 active actors on pipe
2025-10-10T14:37:34.136703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:34.136893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:34.136895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:34.136965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602236707068101:4939]
2025-10-10T14:37:34.137021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2379 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0
2025-10-10T14:37:34.137426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:34.137439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0] Write session will restart in 0.007945s
2025-10-10T14:37:34.137466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0] Write session: Do CDS request
2025-10-10T14:37:34.137473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:34.137224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2379 sessionId: src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0 is DEAD
2025-10-10T14:37:34.147052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.147193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:34.147219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2380
2025-10-10T14:37:34.147422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.147481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:34.147487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:34.147493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:34.148310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2380 sessionId:  describe result for acl check
2025-10-10T14:37:34.148362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:34.148364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:34.148367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:34.148373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602236707068118:10458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:34.149051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602236707068118:10458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:34.158162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602236707068118:10458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:34.163226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602236707068118:10458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:34.163254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602236707068118:10458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:34.163258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602236707068118:10458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:34.163268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:34.165673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:34.169950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:34.170202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:34.170216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:34.170227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:34.170278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:34.170340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602235924836612:10787]
2025-10-10T14:37:34.170975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:34.171382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:34.171461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:34.171826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:34.171893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.171901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.171903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.171904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.171905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.171906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.171907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.171909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.171910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.171911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.171912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.171914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.171915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.171920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.171931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.171935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.171940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.171944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.171948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.171951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.171956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.171960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.171965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.171969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.171972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.171976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.171986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.171995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.172001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.172007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.172013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.172018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.172024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.172029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.172035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.172041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.172045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.172051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.172056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.172062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.172066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.172072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.172077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.172084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.172091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.172097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.172103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.172108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.172113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.172119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.172124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.172130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.172170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:34.174800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:34.175664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:34.175679Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:34.175682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:34.175686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:34.175692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2379 [2:7559602235924836612:10787]
2025-10-10T14:37:34.175706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:34.175722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:34.175726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:34.175730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:34.175733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:34.175749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:34.175756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:34.175770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:34.175833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.175844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.175847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.175850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:34.175926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:34.175935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.175947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.175961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.175988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:34.176007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068311:10458], now have 1 active actors on pipe
2025-10-10T14:37:34.176017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068103:2438], now have 1 active actors on pipe
2025-10-10T14:37:34.176025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602235924836607:10787]
2025-10-10T14:37:34.176028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602235924836607:10787]
2025-10-10T14:37:34.176030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602235924836607:10787]
2025-10-10T14:37:34.176045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:34.176062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:34.176070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:34.176074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:34.176076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:34.176083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:34.176087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:34.176112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602235924836607:10787]
2025-10-10T14:37:34.176121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:34.176130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:34.176138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.176060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2379
2025-10-10T14:37:34.176142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.176104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2379
2025-10-10T14:37:34.176192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:34.176207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:34.176211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:34.176214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:34.176224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:34.176234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:34.176255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:34.176431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.176440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.176455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:34.176556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2380 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0
2025-10-10T14:37:34.177033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c11e01-2b3cd178-e2b72099-80a0488e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:34.180028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0] Write session: try to update token
2025-10-10T14:37:34.180049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:34.196681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:34.196701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:34.196706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:34.196708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:34.196720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602235924836607:10787]
2025-10-10T14:37:34.196726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602235924836607:10787]
2025-10-10T14:37:34.196732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602235924836607:10787]
2025-10-10T14:37:34.196788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:34.196794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:34.196804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.196806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:34.196807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:34.196819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:34.196985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:34.197433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2380 sessionId: src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:34.201132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:34.236914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602236707068325:4939]
2025-10-10T14:37:34.240901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2379, pipe: [1:7559602236707068325:4939]
2025-10-10T14:37:34.328462Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:34.329239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.329255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.329298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068325:4939], now have 1 active actors on pipe
2025-10-10T14:37:34.329849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:34.331371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:34.331432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:34.331525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2380 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0
2025-10-10T14:37:34.331702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2380 sessionId: src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0 is DEAD
2025-10-10T14:37:34.331878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602236707068325:4939]
2025-10-10T14:37:34.332110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:34.332125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0] Write session will restart in 0.009482s
2025-10-10T14:37:34.332152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0] Write session: Do CDS request
2025-10-10T14:37:34.332158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:34.343016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.343335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:34.343372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2381
2025-10-10T14:37:34.343514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.343559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:34.343570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:34.343574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:34.344055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2381 sessionId:  describe result for acl check
2025-10-10T14:37:34.344096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:34.344104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:34.344107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:34.344114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602236707068358:10463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:34.344722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602236707068358:10463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:34.348110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602236707068358:10463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:34.352565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602236707068358:10463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:34.352593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602236707068358:10463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:34.352597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602236707068358:10463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:34.352606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:34.357324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:34.360213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:34.360430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:34.360440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:34.360450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:34.360496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:34.360543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602235924836874:10801]
2025-10-10T14:37:34.361206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:34.361582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:34.361625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:34.361948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:34.362007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.362013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.362015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.362016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.362017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.362019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.362021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.362022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.362023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.362025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.362026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.362027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.362029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.362034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.362046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.362051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.362055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.362059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.362063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.362066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.362070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.362074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.362080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.362083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.362087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.362090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.362098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.362106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.362112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.362117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.362122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.362127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.362133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.362138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.362144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.362148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.362164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.362173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.362178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.362184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.362188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.362193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.362198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.362204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.362209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.362214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.362220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.362230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.362235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.362239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.362246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.362256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.362294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:34.364840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:34.365418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:34.365429Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:34.365431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:34.365435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:34.365441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2380 [2:7559602235924836874:10801]
2025-10-10T14:37:34.365456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:34.365471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:34.365474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:34.365478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:34.365481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:34.365496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:34.365501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:34.365507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:34.365559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.365564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.365566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.365568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:34.365621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:34.365626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.365638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.365652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.365671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:34.365687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602235924836869:10801]
2025-10-10T14:37:34.365694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602235924836869:10801]
2025-10-10T14:37:34.365697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602235924836869:10801]
2025-10-10T14:37:34.365714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:34.365731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068487:10463], now have 1 active actors on pipe
2025-10-10T14:37:34.365732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:34.365736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:34.365739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:34.365739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068344:2438], now have 1 active actors on pipe
2025-10-10T14:37:34.365747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:34.365761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:34.365769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:34.365821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2380
2025-10-10T14:37:34.365827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2380
2025-10-10T14:37:34.365793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602235924836869:10801]
2025-10-10T14:37:34.365803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:34.365839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:34.366029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.366040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.366067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:34.366078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:34.366082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:34.366088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:34.366099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:34.366113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:34.366129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:34.366323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.366331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.366346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:34.366471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2381 partition: 0 MaxSeqNo: 40 sessionId: src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0
2025-10-10T14:37:34.366944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea241aa0-c5f9b650-d77f9400-9d51750b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:34.369719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0] Write session: try to update token
2025-10-10T14:37:34.369740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:34.388065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:34.388086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:34.388090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:34.388092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:34.388102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602235924836869:10801]
2025-10-10T14:37:34.388107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602235924836869:10801]
2025-10-10T14:37:34.388112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602235924836869:10801]
2025-10-10T14:37:34.388168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:34.388169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:34.388176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:34.388176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.388179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:34.388180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:34.388321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:34.392822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2381 sessionId: src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:34.395881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:34.433411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602236707068585:4939]
2025-10-10T14:37:34.433992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2380, pipe: [1:7559602236707068585:4939]
2025-10-10T14:37:34.516409Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:34.516734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.516754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.516802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068585:4939], now have 1 active actors on pipe
2025-10-10T14:37:34.517055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:34.517282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:34.517411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2381 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0
2025-10-10T14:37:34.517575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2381 sessionId: src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0 is DEAD
2025-10-10T14:37:34.517729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602236707068585:4939]
2025-10-10T14:37:34.517745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:34.518067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:34.518075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0] Write session will restart in 0.006135s
2025-10-10T14:37:34.518098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0] Write session: Do CDS request
2025-10-10T14:37:34.518104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:34.525943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.526054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:34.526070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2382
2025-10-10T14:37:34.526236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.526286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:34.526298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:34.526303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:34.526918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2382 sessionId:  describe result for acl check
2025-10-10T14:37:34.526960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:34.526962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:34.526964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:34.526971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602236707068604:10476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:34.527612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602236707068604:10476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:34.533101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602236707068604:10476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:34.539368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602236707068604:10476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:34.539389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602236707068604:10476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:34.539394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602236707068604:10476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:34.539404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:34.543073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:34.546718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:34.547261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:34.547278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:34.547293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:34.547387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:34.547441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602235924837104:10805]
2025-10-10T14:37:34.548112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:34.551055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:34.551148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:34.551599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:34.551680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.551681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.551683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.551684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.551686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.551688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.551690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.551692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.551694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.551696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.551698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.551699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.551701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.551709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.551722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.551727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.551732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.551737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.551742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.551746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.551751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.551756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.551761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.551765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.551770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.551775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.551784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.551794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.551801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.551808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.551817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.551824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.551830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.551836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.551843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.551850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.551856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.551862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.551869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.551875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.551880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.551888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.551895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.551901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.551907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.551914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.551924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.551933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.551939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.551945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.551950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.551957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.552001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:34.562452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:34.563262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:34.563275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:34.563276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:34.563280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:34.563286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2381 [2:7559602235924837104:10805]
2025-10-10T14:37:34.563297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:34.563314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:34.563317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:34.563319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:34.563321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:34.563338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:34.563344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:34.563351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:34.563405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.563414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.563417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.563419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:34.563489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:34.563497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.563507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.563514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.563525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:34.563546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602235924837099:10805]
2025-10-10T14:37:34.563549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602235924837099:10805]
2025-10-10T14:37:34.563551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602235924837099:10805]
2025-10-10T14:37:34.563569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:34.563592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068776:10476], now have 1 active actors on pipe
2025-10-10T14:37:34.563604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068589:2438], now have 1 active actors on pipe
2025-10-10T14:37:34.563611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:34.563624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:34.563632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:34.563670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602235924837099:10805]
2025-10-10T14:37:34.563677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:34.563669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2381
2025-10-10T14:37:34.563670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2381
2025-10-10T14:37:34.563722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:34.563733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:34.563736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:34.563744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:34.563943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.563957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.563992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:34.564005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:34.564010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:34.564012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:34.564022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:34.564033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:34.564045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:34.564456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.564470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.564486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:34.564622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2382 partition: 0 MaxSeqNo: 40 sessionId: src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0
2025-10-10T14:37:34.565069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fbb80b-e72184d8-d10c7a3a-3b6c3ffd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:34.568111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0] Write session: try to update token
2025-10-10T14:37:34.568138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:34.576964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:34.576983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:34.576992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602235924837099:10805]
2025-10-10T14:37:34.577034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:34.577200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:34.577370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:34.577538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:34.577545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:34.577684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:34.577888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:34.577935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:34.595402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2382 sessionId: src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:34.595684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:34.595702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:34.595705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:34.595711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:34.595722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602235924837099:10805]
2025-10-10T14:37:34.595726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602235924837099:10805]
2025-10-10T14:37:34.595730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602235924837099:10805]
2025-10-10T14:37:34.595775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:34.595780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:34.595782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:34.595784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:34.595790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.595792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:34.595933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:34.598626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:34.617837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602236707068815:4939]
2025-10-10T14:37:34.618223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2381, pipe: [1:7559602236707068815:4939]
2025-10-10T14:37:34.728099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:34.728495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.728513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.728536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068815:4939], now have 1 active actors on pipe
2025-10-10T14:37:34.729073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:34.728974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602236707068815:4939]
2025-10-10T14:37:34.729015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:34.729018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:34.729095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2382 reason: error at write: Disconnected sessionId: src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0
2025-10-10T14:37:34.729287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2382 sessionId: src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0 is DEAD
2025-10-10T14:37:34.729299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:34.733284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:34.733300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0] Write session will restart in 0.006790s
2025-10-10T14:37:34.733346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0] Write session: Do CDS request
2025-10-10T14:37:34.733357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:34.745854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.746270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:34.746287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2383
2025-10-10T14:37:34.746621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.746679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:34.746686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:34.746691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:34.747447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2383 sessionId:  describe result for acl check
2025-10-10T14:37:34.747491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:34.747496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:34.747498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:34.747504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602236707068864:10480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:34.748113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602236707068864:10480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:34.754797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602236707068864:10480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:34.762549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602236707068864:10480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:34.762571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602236707068864:10480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:34.762575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602236707068864:10480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:34.762585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:34.771838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:34.777605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:34.778173Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:34.778188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:34.778205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:34.778286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:34.778338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602235924837325:10807]
2025-10-10T14:37:34.778965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:34.779499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:34.779557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:34.779905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:34.779980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.779986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.779987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.779988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.779989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.779991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.779992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.779994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.779995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.779996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.779997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.779999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.780000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.780007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.780020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.780024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.780028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.780031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.780035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.780039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.780042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.780046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.780051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.780054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.780058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.780061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.780070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.780079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.780086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.780092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.780122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.780133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.780138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.780143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.780148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.780153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.780157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.780162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.780167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.780172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.780178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.780183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.780188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.780193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.780198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.780203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.780207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.780212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.780216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.780222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.780226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.780231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.780273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:34.783625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:34.783937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:34.783951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:34.783954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:34.783959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:34.783965Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2382 [2:7559602235924837325:10807]
2025-10-10T14:37:34.783979Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:34.783996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:34.784005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:34.784008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:34.784012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:34.784028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:34.784036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:34.784051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:34.784111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.784113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.784115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.784118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:34.784200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:34.784203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.784215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.784226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.784241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:34.784264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707069010:10480], now have 1 active actors on pipe
2025-10-10T14:37:34.784268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707068821:2438], now have 1 active actors on pipe
2025-10-10T14:37:34.784276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602235924837320:10807]
2025-10-10T14:37:34.784279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602235924837320:10807]
2025-10-10T14:37:34.784281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602235924837320:10807]
2025-10-10T14:37:34.784298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:34.784311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:34.784321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:34.784326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:34.784326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:34.784328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:34.784330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:34.784355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602235924837320:10807]
2025-10-10T14:37:34.784364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:34.784374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:34.784876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2382
2025-10-10T14:37:34.784925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2382
2025-10-10T14:37:34.785313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.785327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.785376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:34.785390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:34.785405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:34.785411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:34.785425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:34.785443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:34.785468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:34.786091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.786113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.786145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:34.786295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2383 partition: 0 MaxSeqNo: 40 sessionId: src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0
2025-10-10T14:37:34.793464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|519b20d6-4a94bc17-591106f5-e3b04a19_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:34.796441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0] Write session: try to update token
2025-10-10T14:37:34.796463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:34.807697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:34.807713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:34.807724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602235924837320:10807]
2025-10-10T14:37:34.807775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:34.807949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:34.808097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:34.808251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:34.808394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:34.808601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:34.808656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:34.810466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:34.829289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602236707069053:4939]
2025-10-10T14:37:34.829745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707069053:4939], now have 1 active actors on pipe
2025-10-10T14:37:34.829917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2382, pipe: [1:7559602236707069053:4939]
2025-10-10T14:37:34.835293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2383 sessionId: src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:34.842452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:34.842473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:34.842477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:34.842480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:34.842491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602235924837320:10807]
2025-10-10T14:37:34.842499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602235924837320:10807]
2025-10-10T14:37:34.842503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602235924837320:10807]
2025-10-10T14:37:34.842567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:34.842576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.842578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:34.843853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:34.842732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:34.844034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:34.844050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:34.844057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:34.962077Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:34.962516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:34.962528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:34.962841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:34.962888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:34.962906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:34.962945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602236707069053:4939]
2025-10-10T14:37:34.962981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:34.963013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2383 reason: error at write: Disconnected sessionId: src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0
2025-10-10T14:37:34.963202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2383 sessionId: src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0 is DEAD
2025-10-10T14:37:34.963426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:34.963439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0] Write session will restart in 0.005805s
2025-10-10T14:37:34.963465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0] Write session: Do CDS request
2025-10-10T14:37:34.963472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:34.971011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.971103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:34.971118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2384
2025-10-10T14:37:34.971337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:34.971374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:34.971397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:34.971407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:34.971944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2384 sessionId:  describe result for acl check
2025-10-10T14:37:34.971986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:34.971992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:34.971994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:34.972000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602236707069074:10485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:34.972859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602236707069074:10485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:34.975781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602236707069074:10485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:34.980217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602236707069074:10485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:34.980235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602236707069074:10485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:34.980239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602236707069074:10485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:34.980248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:34.993666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:34.996655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:34.996923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:34.996929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:34.996942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:34.997005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:34.997049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602235924837547:10809]
2025-10-10T14:37:34.997702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:34.998070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:34.998113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:34.998433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:34.998493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.998495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.998496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.998497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.998498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.998499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.998501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.998502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.998503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.998504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.998505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.998506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.998507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.998513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.998526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.998529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.998533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.998537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.998540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.998544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.998547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.998551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.998555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.998559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.998562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.998565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.998574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.998582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:34.998589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.998593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:34.998598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.998602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:34.998606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.998611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:34.998615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.998620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:34.998624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.998629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:34.998634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.998638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:34.998642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.998647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:34.998652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.998657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:34.998663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.998668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:34.998672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.998677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:34.998685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.998690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:34.998694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.998699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:34.998751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:35.001441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:35.001847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:35.001859Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:35.001863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:35.001867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:35.001875Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2383 [2:7559602235924837547:10809]
2025-10-10T14:37:35.001891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:35.001911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:35.001914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.001918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.001929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.001948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:35.001959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:35.001975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:35.002036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.002045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.002047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.002049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:35.002121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:35.002137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.002154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.002171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.002193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:35.002222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707069059:2438], now have 1 active actors on pipe
2025-10-10T14:37:35.002230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602236707069132:10485], now have 1 active actors on pipe
2025-10-10T14:37:35.002238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602235924837542:10809]
2025-10-10T14:37:35.002240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602235924837542:10809]
2025-10-10T14:37:35.002242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602235924837542:10809]
2025-10-10T14:37:35.002256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:35.002276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:35.002281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:35.002284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:35.002287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:35.002292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:35.002296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:35.002330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602235924837542:10809]
2025-10-10T14:37:35.002344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:35.002350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:35.002354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2383
2025-10-10T14:37:35.002361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2383
2025-10-10T14:37:35.002503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.002518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.002567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:35.002582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.002587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.002590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:35.002614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.002634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:35.002649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.003162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2384 partition: 0 MaxSeqNo: 40 sessionId: src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0
2025-10-10T14:37:35.002968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.002981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.003013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.003602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2aa6d7b-b6fd4b85-f844b20e-453abe26_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:35.006431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0] Write session: try to update token
2025-10-10T14:37:35.006451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:35.014885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:35.014905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.014918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602235924837542:10809]
2025-10-10T14:37:35.014966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:35.014981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:35.015246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:35.015419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.015569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.015703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.015907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:35.015949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:35.025966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2384 sessionId: src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:35.028975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:35.029263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.029287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.029348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:35.029443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:35.036626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:35.036646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.036650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:35.036652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:35.036663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602235924837542:10809]
2025-10-10T14:37:35.036667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602235924837542:10809]
2025-10-10T14:37:35.036672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602235924837542:10809]
2025-10-10T14:37:35.036724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:35.036726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:35.036732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.036733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:35.036735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:35.036737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:35.036877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:35.063265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602241002036578:4939]
2025-10-10T14:37:35.063698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2383, pipe: [1:7559602241002036578:4939]
2025-10-10T14:37:35.155372Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:35.165718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.165753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.165946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.166013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.166074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.166139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.166185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.166194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.166273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.166328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.166390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.166457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.166501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.166505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.166582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.166643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.166706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.166769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.166811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.166814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.166888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.166952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.167017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.167096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.167139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.167142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.167212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.167271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.167337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.167397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.167443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.167445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.167519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.167582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.167644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.167711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.167761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.167765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.167837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.167905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.167974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.168040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.168085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.168089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.168160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.168220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.168280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.168343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.168391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.168398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.168471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.168530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.168592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.168659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.168707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.168710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.168785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.168847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.168914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.168982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.169027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.169030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.169106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002036578:4939], now have 1 active actors on pipe
2025-10-10T14:37:35.169645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602241002036578:4939]
2025-10-10T14:37:35.169645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:35.169694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:35.169699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:35.169734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2384 reason: error at write: Disconnected sessionId: src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0
2025-10-10T14:37:35.169919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2384 sessionId: src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0 is DEAD
2025-10-10T14:37:35.170323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:35.170336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0] Write session will restart in 0.008318s
2025-10-10T14:37:35.170362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0] Write session: Do CDS request
2025-10-10T14:37:35.170368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:35.170890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:35.180086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.180978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:35.180994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2385
2025-10-10T14:37:35.181184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.181216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:35.181226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:35.181230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:35.181844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2385 sessionId:  describe result for acl check
2025-10-10T14:37:35.181885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:35.181893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:35.181896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:35.181901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602241002036598:10489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:35.182557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602241002036598:10489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:35.185071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602241002036598:10489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:35.189979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602241002036598:10489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:35.189995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602241002036598:10489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:35.190000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602241002036598:10489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:35.190009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:35.195031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:35.198395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:35.198690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:35.198701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:35.198713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:35.198770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:35.198820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602240219805080:10812]
2025-10-10T14:37:35.199315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:35.199723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:35.199782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:35.200124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:35.200199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.200206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.200208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.200209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.200210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.200212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.200213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.200215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.200216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.200217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.200219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.200220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.200221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.200228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.200242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.200247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.200252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.200256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.200261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.200266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.200270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.200275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.200280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.200284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.200289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.200294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.200303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.200312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.200320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.200332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.200337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.200342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.200352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.200358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.200367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.200374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.200382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.200388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.200400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.200410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.200416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.200426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.200434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.200443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.200448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.200456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.200465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.200471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.200479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.200485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.200495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.200505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.200552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:35.203625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:35.204147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:35.204161Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:35.204164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:35.204169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:35.204177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2384 [2:7559602240219805080:10812]
2025-10-10T14:37:35.204191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:35.204208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:35.204212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.204215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.204218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.204237Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:35.204250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:35.204259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:35.204338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.204346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.204348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.204350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:35.204427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:35.204437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.204449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.204462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.204480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:35.204504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002036715:10489], now have 1 active actors on pipe
2025-10-10T14:37:35.204518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602240219805075:10812]
2025-10-10T14:37:35.204521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602240219805075:10812]
2025-10-10T14:37:35.204523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602240219805075:10812]
2025-10-10T14:37:35.204537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:35.204549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002036581:2438], now have 1 active actors on pipe
2025-10-10T14:37:35.204557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:35.204566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:35.204570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:35.204572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:35.204573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:35.204576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:35.204604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602240219805075:10812]
2025-10-10T14:37:35.204616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:35.204622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:35.204617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2384
2025-10-10T14:37:35.204693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2384
2025-10-10T14:37:35.204781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.204797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.204831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:35.204848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.204853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.204855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:35.204871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.204890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:35.204917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.205194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.205204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.205229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.205364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2385 partition: 0 MaxSeqNo: 40 sessionId: src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0
2025-10-10T14:37:35.205842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d4ce84c-9291f8b7-a5ffe7cb-853f13dc_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:35.208776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0] Write session: try to update token
2025-10-10T14:37:35.208799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:35.218831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:35.218857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.218870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602240219805075:10812]
2025-10-10T14:37:35.218942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:35.219224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:35.219419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.219569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.219706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.219910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:35.219957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:35.220066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:35.229167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2385 sessionId: src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:35.231949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:35.232650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.232677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.232723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:35.232881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:35.237949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:35.237972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.237976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:35.237978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:35.237991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602240219805075:10812]
2025-10-10T14:37:35.237996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602240219805075:10812]
2025-10-10T14:37:35.238001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602240219805075:10812]
2025-10-10T14:37:35.238076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:35.238090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.238092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:35.238097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:35.238100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:35.238105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:35.238255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:35.269617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602241002036820:4939]
2025-10-10T14:37:35.270059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2384, pipe: [1:7559602241002036820:4939]
2025-10-10T14:37:35.358919Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:35.367540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.367567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.367748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.367817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.367884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.367952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.368016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.368027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.368102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.368170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.368247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.368325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.368373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.368381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.368455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.368521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.368590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.368653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.368755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.368763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.368833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.368901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.368970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.369038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.369085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.369092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.369160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.369227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.369293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.369422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.369472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.369475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.369549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.369614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.369690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.369757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.369805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.369812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.369884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.369956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.370025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.370089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.370133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.370137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.370206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.370271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.370333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.370397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.370442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.370445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.370520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.370578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.370640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.370700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.370741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.370744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.370811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.370873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.370936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.371005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.371045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.371048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.371147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002036820:4939], now have 1 active actors on pipe
2025-10-10T14:37:35.371956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:35.373847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:35.373860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0] Write session will restart in 0.008025s
2025-10-10T14:37:35.373886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0] Write session: Do CDS request
2025-10-10T14:37:35.373892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:35.373419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602241002036820:4939]
2025-10-10T14:37:35.373460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:35.373509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2385 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0
2025-10-10T14:37:35.373706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2385 sessionId: src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0 is DEAD
2025-10-10T14:37:35.373830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:35.382889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.385562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:35.385579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2386
2025-10-10T14:37:35.385809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.385843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:35.385849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:35.385853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:35.386678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2386 sessionId:  describe result for acl check
2025-10-10T14:37:35.386727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:35.386729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:35.386732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:35.386738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602241002036859:10494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:35.387335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602241002036859:10494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:35.391423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602241002036859:10494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:35.397967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602241002036859:10494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:35.397986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602241002036859:10494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:35.397990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602241002036859:10494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:35.397999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:35.399575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:35.403825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:35.404123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:35.404137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:35.404153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:35.404229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:35.404283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602240219805337:10822]
2025-10-10T14:37:35.404969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:35.405489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:35.405570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:35.405944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:35.406024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.406030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.406032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.406033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.406035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.406036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.406038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.406039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.406041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.406042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.406043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.406045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.406046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.406054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.406069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.406074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.406078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.406082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.406086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.406090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.406093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.406097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.406101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.406106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.406110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.406114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.406124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.406147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.406162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.406168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.406174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.406180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.406185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.406192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.406197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.406202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.406207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.406212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.406218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.406224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.406234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.406241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.406246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.406252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.406262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.406269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.406279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.406285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.406290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.406296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.406302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.406308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.406357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:35.410828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2385
2025-10-10T14:37:35.410874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2385
2025-10-10T14:37:35.409819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:35.410346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:35.410353Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:35.410356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:35.410360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:35.410368Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2385 [2:7559602240219805337:10822]
2025-10-10T14:37:35.410383Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:35.410409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:35.410414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.410418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.410421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.410441Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:35.410450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:35.410458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:35.410529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.410532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.410534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.410537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:35.410617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:35.410620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.410634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.410646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.410662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:35.410686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037034:10494], now have 1 active actors on pipe
2025-10-10T14:37:35.410695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602240219805332:10822]
2025-10-10T14:37:35.410697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602240219805332:10822]
2025-10-10T14:37:35.410700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602240219805332:10822]
2025-10-10T14:37:35.410717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:35.410728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002036826:2438], now have 1 active actors on pipe
2025-10-10T14:37:35.410731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:35.410735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:35.410736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:35.410737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:35.410753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:35.410757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:35.410796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602240219805332:10822]
2025-10-10T14:37:35.410803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:35.410810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:35.412320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.412338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.412376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:35.412389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.412395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.412398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:35.412413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.412430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:35.412464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.413022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.413032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.413066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.413182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2386 partition: 0 MaxSeqNo: 40 sessionId: src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0
2025-10-10T14:37:35.413581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbdf9944-ab65d531-5f40c535-ec39fad2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:35.416420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0] Write session: try to update token
2025-10-10T14:37:35.416445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:35.425651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:35.425671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.425684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602240219805332:10822]
2025-10-10T14:37:35.425735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:35.425737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:35.425915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:35.426076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.426235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.426396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.426623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:35.426674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:35.435405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2386 sessionId: src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:35.438491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.438522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.438570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:35.437987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:35.438801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:35.447746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:35.447764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.447767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:35.447768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:35.447779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602240219805332:10822]
2025-10-10T14:37:35.447783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602240219805332:10822]
2025-10-10T14:37:35.447788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602240219805332:10822]
2025-10-10T14:37:35.447843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:35.447852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.447854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:35.447995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:35.449484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:35.449503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:35.449506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:35.473386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602241002037062:4939]
2025-10-10T14:37:35.473983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2385, pipe: [1:7559602241002037062:4939]
2025-10-10T14:37:35.571339Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:35.571847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037062:4939], now have 1 active actors on pipe
2025-10-10T14:37:35.581243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.581274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.581483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.581556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.581817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.581885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.582019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.582024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.582098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.582159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.582223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.582287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.582329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.582333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.582402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.582464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.582737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.582801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.582841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.582845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.582923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.582998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.583275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.583341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.583385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.583389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.583463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.583526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.583590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.583654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.583695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.583699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.583770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.583833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.584099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.584363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.584410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.584417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.584680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.584740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.584801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.584869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.584921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.584925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.584996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.585262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.585550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.585615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.585755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.585764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.585837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.586107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.586380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.586449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.586588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.586597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.586666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.586730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.586797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.586866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.586915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.586924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.587223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:35.587237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:35.587237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602241002037062:4939]
2025-10-10T14:37:35.587270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:35.587272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2386 reason: error at write: Disconnected sessionId: src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0
2025-10-10T14:37:35.587501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2386 sessionId: src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0 is DEAD
2025-10-10T14:37:35.587641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:35.587654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0] Write session will restart in 0.008943s
2025-10-10T14:37:35.587681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0] Write session: Do CDS request
2025-10-10T14:37:35.587687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:35.588418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:35.597924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.598295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:35.598318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2387
2025-10-10T14:37:35.598548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.598583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:35.598594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:35.598599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:35.599491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2387 sessionId:  describe result for acl check
2025-10-10T14:37:35.599528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:35.599532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:35.599534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:35.599540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602241002037105:10507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:35.600171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602241002037105:10507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:35.603439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602241002037105:10507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:35.607230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602241002037105:10507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:35.607244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602241002037105:10507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:35.607248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602241002037105:10507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:35.607258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:35.609050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:35.612084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:35.612424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:35.612439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:35.612453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:35.612514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:35.612567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602240219805569:10830]
2025-10-10T14:37:35.613217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:35.613622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:35.613684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:35.614037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:35.614113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.614120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.614121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.614122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.614123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.614124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.614126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.614127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.614128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.614129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.614131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.614132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.614133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.614141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.614155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.614160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.614166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.614170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.614174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.614178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.614182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.614186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.614191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.614194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.614198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.614201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.614210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.614219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.614240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.614251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.614255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.614260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.614264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.614269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.614274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.614278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.614283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.614293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.614299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.614308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.614314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.614320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.614325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.614333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.614338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.614344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.614349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.614355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.614363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.614369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.614374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.614384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.614427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:35.617137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:35.617831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:35.617849Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:35.617851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:35.617855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:35.617861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2386 [2:7559602240219805569:10830]
2025-10-10T14:37:35.617875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:35.617895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:35.617904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.617907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.617910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.617928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:35.617936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:35.617946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:35.618005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.618016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.618019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.618021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:35.618098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:35.618106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.618120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.618138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.618160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:35.618187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037290:10507], now have 1 active actors on pipe
2025-10-10T14:37:35.618195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037076:2438], now have 1 active actors on pipe
2025-10-10T14:37:35.618203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602240219805564:10830]
2025-10-10T14:37:35.618210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602240219805564:10830]
2025-10-10T14:37:35.618213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602240219805564:10830]
2025-10-10T14:37:35.618228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:35.618246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:35.618249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:35.618267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:35.618270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:35.618271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:35.618273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:35.618300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602240219805564:10830]
2025-10-10T14:37:35.618309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:35.618314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:35.618599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2386
2025-10-10T14:37:35.618635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2386
2025-10-10T14:37:35.618692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.618709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.618743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:35.618758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.618763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.618767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:35.618780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.618807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:35.618827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.619019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.619026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.619042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.619186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2387 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0
2025-10-10T14:37:35.619624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbc5bc55-e0966283-dbfa7aee-3f38e016_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:35.622470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0] Write session: try to update token
2025-10-10T14:37:35.622489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:35.640873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:35.640899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.640903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:35.640905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:35.640916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602240219805564:10830]
2025-10-10T14:37:35.640921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602240219805564:10830]
2025-10-10T14:37:35.640925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602240219805564:10830]
2025-10-10T14:37:35.640978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:35.640990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:35.640993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.640996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:35.640998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:35.641004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:35.641146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:35.645218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2387 sessionId: src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:35.647884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:35.687343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602241002037305:4939]
2025-10-10T14:37:35.687655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2386, pipe: [1:7559602241002037305:4939]
2025-10-10T14:37:35.762631Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:35.763083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.763102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.763155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037305:4939], now have 1 active actors on pipe
2025-10-10T14:37:35.763385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:35.763890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:35.763902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0] Write session will restart in 0.006524s
2025-10-10T14:37:35.763929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0] Write session: Do CDS request
2025-10-10T14:37:35.763409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:35.763946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:35.763423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:35.763467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:35.763501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2387 reason: error at write: Disconnected sessionId: src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0
2025-10-10T14:37:35.763542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602241002037305:4939]
2025-10-10T14:37:35.763728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2387 sessionId: src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0 is DEAD
2025-10-10T14:37:35.771909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.772043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:35.772063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2388
2025-10-10T14:37:35.772219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.772257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:35.772265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:35.772274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:35.772900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2388 sessionId:  describe result for acl check
2025-10-10T14:37:35.772951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:35.772953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:35.772955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:35.772961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602241002037327:10512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:35.773618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602241002037327:10512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:35.775989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602241002037327:10512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:35.779768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602241002037327:10512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:35.779794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602241002037327:10512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:35.779798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602241002037327:10512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:35.779807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:35.789533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:35.792309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:35.792591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:35.792602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:35.792615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:35.792679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:35.792733Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602240219805795:10832]
2025-10-10T14:37:35.793387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:35.793789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:35.793841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:35.794186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:35.794276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.794278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.794280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.794282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.794283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.794285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.794286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.794287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.794289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.794290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.794291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.794293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.794294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.794301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.794315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.794320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.794324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.794329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.794333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.794338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.794342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.794345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.794350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.794353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.794358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.794362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.794373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.794382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.794390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.794396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.794401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.794406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.794412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.794417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.794423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.794428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.794433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.794441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.794446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.794451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.794456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.794461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.794466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.794471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.794474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.794479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.794483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.794487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.794491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.794495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.794499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.794504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.794546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:35.797322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:35.798104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:35.798109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:35.798581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2387
2025-10-10T14:37:35.798112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:35.798117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:35.798124Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2387 [2:7559602240219805795:10832]
2025-10-10T14:37:35.798139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:35.798585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2387
2025-10-10T14:37:35.798159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:35.798164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.798168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.798170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.798190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:35.798200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:35.798209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:35.798280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.798282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.798284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.798287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:35.798363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:35.798366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.798380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.798392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.798408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:35.798433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037310:2438], now have 1 active actors on pipe
2025-10-10T14:37:35.798436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037395:10512], now have 1 active actors on pipe
2025-10-10T14:37:35.798444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602240219805790:10832]
2025-10-10T14:37:35.798446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602240219805790:10832]
2025-10-10T14:37:35.798449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602240219805790:10832]
2025-10-10T14:37:35.798465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:35.798481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:35.798497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:35.798501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:35.798531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602240219805790:10832]
2025-10-10T14:37:35.798534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:35.798560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:35.798564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:35.798565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:35.798573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:35.798738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.798746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.798795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:35.798815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:35.798820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:35.798822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:35.798835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:35.798853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:35.798890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.799119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.799129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.799149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:35.799291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2388 partition: 0 MaxSeqNo: 40 sessionId: src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0
2025-10-10T14:37:35.799766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f0a7cd1-df78c953-15c1cee5-4172bca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:35.802833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0] Write session: try to update token
2025-10-10T14:37:35.802854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:35.821204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:35.821228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.821245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602240219805790:10832]
2025-10-10T14:37:35.821319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:35.821325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:35.821615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:35.821778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.821931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.822085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:35.822298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:35.822353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:35.825367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2388 sessionId: src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:35.828181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:35.828450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.828477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.828537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:35.834909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:35.834933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:35.834938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:35.828654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:35.834941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:35.834955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602240219805790:10832]
2025-10-10T14:37:35.834961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602240219805790:10832]
2025-10-10T14:37:35.834969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602240219805790:10832]
2025-10-10T14:37:35.835025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:35.835036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.835039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:35.835040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:35.835047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:35.835051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:35.835226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:35.863545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602241002037547:4939]
2025-10-10T14:37:35.863990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2387, pipe: [1:7559602241002037547:4939]
2025-10-10T14:37:35.951124Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:35.960525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:35.960557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:35.960966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.961234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.961302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.961392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.961438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.961444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.961565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.961665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.961730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.961804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.961945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.961952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.962089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.962191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.962261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.962322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.962364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.962367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.962444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.962530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.962591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.962651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.962694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.962697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.962807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.962908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.963006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.963081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.963136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.963138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.963209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.963271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.963336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.963399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.963532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.963536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.963610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.963674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.963747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.963811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.963953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.963959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.964029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.964087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.964139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.964194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.964332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.964336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.964411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.964652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.964878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.964949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.965069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.965072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.965146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:35.965678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:35.965952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:35.966759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:35.966779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602241002037547:4939]
2025-10-10T14:37:35.966830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:35.966840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:35.966883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2388 reason: error at write: Disconnected sessionId: src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0
2025-10-10T14:37:35.967518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:35.967530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0] Write session will restart in 0.008179s
2025-10-10T14:37:35.967555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0] Write session: Do CDS request
2025-10-10T14:37:35.967561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:35.967114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2388 sessionId: src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0 is DEAD
2025-10-10T14:37:35.966226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:35.966366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:35.966369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:35.966450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037547:4939], now have 1 active actors on pipe
2025-10-10T14:37:35.967826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:35.976961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.981513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:35.981530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2389
2025-10-10T14:37:35.983005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:35.983055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:35.983062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:35.983102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:35.983877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2389 sessionId:  describe result for acl check
2025-10-10T14:37:35.983920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:35.983923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:35.983925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:35.983931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602241002037643:10516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:35.984560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602241002037643:10516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:35.989103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602241002037643:10516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:35.994559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:35.994352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602241002037643:10516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:35.994373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602241002037643:10516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:35.994377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602241002037643:10516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:35.994386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:35.997792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:35.998061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:35.998074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:35.998086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:35.998150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:35.998194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602240219806022:10834]
2025-10-10T14:37:35.998870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:35.999332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:35.999385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:35.999740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:35.999794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.999796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.999797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.999799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.999800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.999801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.999803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.999804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.999806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.999807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.999809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.999810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.999811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.999817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.999831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.999835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.999839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.999843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.999848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.999852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.999857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.999861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.999865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.999869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:35.999874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:35.999878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:35.999887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.999896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:35.999902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.999907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:35.999914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.999919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:35.999923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.999928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:35.999933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.999938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:35.999942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.999948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:35.999954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.999959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:35.999963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.999969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:35.999974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.999980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:35.999985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.999991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:35.999996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.000004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.000010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.000016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.000020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.000025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.000068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:36.002742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:36.003303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:36.003315Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:36.003318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:36.003334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:36.003342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2388 [2:7559602240219806022:10834]
2025-10-10T14:37:36.003359Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:36.003381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:36.003389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.003393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.003396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.003414Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:36.003427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:36.003436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:36.003518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.003526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.003529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.003531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:36.003601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:36.003609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.003622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.003639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.003660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:36.003689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037552:2438], now have 1 active actors on pipe
2025-10-10T14:37:36.003693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602241002037766:10516], now have 1 active actors on pipe
2025-10-10T14:37:36.003701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602240219806015:10834]
2025-10-10T14:37:36.003704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602240219806015:10834]
2025-10-10T14:37:36.003706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602240219806015:10834]
2025-10-10T14:37:36.003719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:36.003734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:36.003736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:36.003745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:36.003747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:36.003754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:36.003758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:36.003786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602240219806015:10834]
2025-10-10T14:37:36.003797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:36.003805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:36.003798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2388
2025-10-10T14:37:36.003837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2388
2025-10-10T14:37:36.003935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.003945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.003979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:36.003991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.003998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.004000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:36.004013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.004024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:36.004044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.004265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.004273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.004287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.004477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2389 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0
2025-10-10T14:37:36.004867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0708f5a-f3045411-e9bfc0d3-36ca8f96_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:36.007739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0] Write session: try to update token
2025-10-10T14:37:36.007762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:36.023635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:36.023658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:36.023662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:36.023664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:36.023675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602240219806015:10834]
2025-10-10T14:37:36.023680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602240219806015:10834]
2025-10-10T14:37:36.023684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602240219806015:10834]
2025-10-10T14:37:36.023741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:36.023739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:36.023749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.023751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:36.023760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:36.023764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:36.024250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:36.026739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2389 sessionId: src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:36.029406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:36.066816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602245297005076:4939]
2025-10-10T14:37:36.067113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2388, pipe: [1:7559602245297005076:4939]
2025-10-10T14:37:36.140753Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:36.141475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.141492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.141539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005076:4939], now have 1 active actors on pipe
2025-10-10T14:37:36.141849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:36.141845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602245297005076:4939]
2025-10-10T14:37:36.141855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:36.141893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:36.141897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:36.141963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2389 reason: error at write: Disconnected sessionId: src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0
2025-10-10T14:37:36.142194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2389 sessionId: src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0 is DEAD
2025-10-10T14:37:36.142378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:36.142386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0] Write session will restart in 0.007557s
2025-10-10T14:37:36.142412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0] Write session: Do CDS request
2025-10-10T14:37:36.142421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:36.150857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.150964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:36.150982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2390
2025-10-10T14:37:36.151156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.151190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:36.151200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:36.151205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:36.151676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2390 sessionId:  describe result for acl check
2025-10-10T14:37:36.151716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:36.151723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:36.151726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:36.151732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602245297005093:10520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:36.152366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602245297005093:10520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:36.156370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602245297005093:10520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:36.160254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602245297005093:10520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:36.160269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602245297005093:10520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:36.160273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602245297005093:10520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:36.160292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:36.164127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:36.167411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:36.167671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:36.167683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:36.167695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:36.167748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:36.167805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602244514773548:10837]
2025-10-10T14:37:36.168468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:36.168821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:36.168876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:36.169196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:36.169252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.169260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.169261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.169262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.169263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.169264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.169266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.169267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.169268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.169269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.169270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.169272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.169273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.169278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.169290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.169294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.169298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.169301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.169305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.169308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.169312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.169316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.169319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.169323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.169327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.169345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.169353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.169361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.169368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.169373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.169378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.169383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.169386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.169391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.169399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.169403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.169407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.169412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.169416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.169422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.169425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.169430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.169435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.169439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.169444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.169448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.169453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.169457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.169461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.169465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.169469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.169474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.169512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:36.172229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:36.172574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:36.172585Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:36.172587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:36.172591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:36.172598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2389 [2:7559602244514773548:10837]
2025-10-10T14:37:36.172610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:36.172628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:36.172636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.172639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.172641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.172659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:36.172667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:36.172675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:36.172737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.172745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.172747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.172750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:36.172826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:36.172833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.172843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.172853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.172872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:36.172897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602244514773543:10837]
2025-10-10T14:37:36.172899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602244514773543:10837]
2025-10-10T14:37:36.172901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602244514773543:10837]
2025-10-10T14:37:36.172911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:36.172926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:36.172929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:36.172942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:36.172944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:36.172944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:36.172947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:36.172957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005252:10520], now have 1 active actors on pipe
2025-10-10T14:37:36.172962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005078:2438], now have 1 active actors on pipe
2025-10-10T14:37:36.172984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602244514773543:10837]
2025-10-10T14:37:36.172992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:36.173015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:36.173053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2389
2025-10-10T14:37:36.173069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2389
2025-10-10T14:37:36.173194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.173205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.173240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:36.173253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.173257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.173263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:36.173275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.173285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:36.173307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.173552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.173560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.173575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.173662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2390 partition: 0 MaxSeqNo: 40 sessionId: src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0
2025-10-10T14:37:36.174084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0df6bd-305180c-9f257fa5-4c5eed1c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:36.176956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0] Write session: try to update token
2025-10-10T14:37:36.176976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:36.193830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2390 sessionId: src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:36.194800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:36.194823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:36.194826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:36.194828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:36.194839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602244514773543:10837]
2025-10-10T14:37:36.194845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602244514773543:10837]
2025-10-10T14:37:36.194850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602244514773543:10837]
2025-10-10T14:37:36.194905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:36.194908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:36.194917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.194920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:36.194921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:36.194924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:36.195093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:36.197121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:36.241846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602245297005310:4939]
2025-10-10T14:37:36.242239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2389, pipe: [1:7559602245297005310:4939]
2025-10-10T14:37:36.317991Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:36.318467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.318484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.318532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005310:4939], now have 1 active actors on pipe
2025-10-10T14:37:36.318774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:36.319259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:36.319346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2390 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0
2025-10-10T14:37:36.319545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2390 sessionId: src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0 is DEAD
2025-10-10T14:37:36.319682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:36.319692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0] Write session will restart in 0.008892s
2025-10-10T14:37:36.319719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0] Write session: Do CDS request
2025-10-10T14:37:36.319725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:36.319724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:36.319764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602245297005310:4939]
2025-10-10T14:37:36.329980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.330121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:36.330138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2391
2025-10-10T14:37:36.330281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.330318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:36.330323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:36.330327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:36.330931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2391 sessionId:  describe result for acl check
2025-10-10T14:37:36.330965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:36.330969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:36.330971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:36.330979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602245297005372:10525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:36.331649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602245297005372:10525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:36.334300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602245297005372:10525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:36.341891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:36.344918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:36.345180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:36.345194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:36.345207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:36.345266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:36.345320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602244514773788:10840]
2025-10-10T14:37:36.345267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602245297005372:10525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:36.345285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602245297005372:10525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:36.345290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602245297005372:10525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:36.345300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:36.345923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:36.346253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:36.346300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:36.346607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:36.346674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.346680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.346681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.346682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.346683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.346685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.346686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.346687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.346689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.346690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.346691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.346692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.346694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.346699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.346712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.346715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.346719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.346722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.346726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.346730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.346733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.346736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.346741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.346744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.346748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.346752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.346760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.346769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.346775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.346780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.346787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.346792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.346796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.346801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.346806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.346811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.346815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.346820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.346824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.346830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.346834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.346839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.346843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.346848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.346852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.346856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.346861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.346866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.346872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.346876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.346888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.346893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.346932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:36.349431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:36.350142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:36.350157Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:36.350159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:36.350163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:36.350169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2390 [2:7559602244514773788:10840]
2025-10-10T14:37:36.350183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:36.350206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:36.350213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.350217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.350219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.350236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:36.350248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:36.350258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:36.350320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.350327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.350329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.350331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:36.350407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:36.350419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.350430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.350440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.350455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:36.350477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005323:2438], now have 1 active actors on pipe
2025-10-10T14:37:36.350487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005548:10525], now have 1 active actors on pipe
2025-10-10T14:37:36.350496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602244514773783:10840]
2025-10-10T14:37:36.350499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602244514773783:10840]
2025-10-10T14:37:36.350502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602244514773783:10840]
2025-10-10T14:37:36.350518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:36.350533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:36.350550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:36.350552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:36.350556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:36.350536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2390
2025-10-10T14:37:36.350560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:36.350552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2390
2025-10-10T14:37:36.350562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:36.350583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602244514773783:10840]
2025-10-10T14:37:36.350587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:36.350600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:36.350622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.350632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.350665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:36.350677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.350681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.350683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:36.350695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.350706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:36.350724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.350886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.350901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.350941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.351112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2391 partition: 0 MaxSeqNo: 40 sessionId: src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0
2025-10-10T14:37:36.351524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f6c1b4-f21530c9-fc215b86-40b76ef1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:36.354491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0] Write session: try to update token
2025-10-10T14:37:36.354512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:36.370384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:36.370408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:36.370411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:36.370413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:36.370425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602244514773783:10840]
2025-10-10T14:37:36.370431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602244514773783:10840]
2025-10-10T14:37:36.370435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602244514773783:10840]
2025-10-10T14:37:36.370488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:36.370494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:36.370498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.370501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:36.370515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:36.370520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:36.371868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2391 sessionId: src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:36.374865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:36.370825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:36.420058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602245297005559:4939]
2025-10-10T14:37:36.420444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2390, pipe: [1:7559602245297005559:4939]
2025-10-10T14:37:36.496379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:36.497282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.497292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.498790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:36.498802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0] Write session will restart in 0.005918s
2025-10-10T14:37:36.498828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0] Write session: Do CDS request
2025-10-10T14:37:36.498835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:36.498226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:36.498296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602245297005559:4939]
2025-10-10T14:37:36.498318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:36.498321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:36.498404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2391 reason: error at write: Disconnected sessionId: src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0
2025-10-10T14:37:36.498609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2391 sessionId: src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0 is DEAD
2025-10-10T14:37:36.497739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005559:4939], now have 1 active actors on pipe
2025-10-10T14:37:36.498732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:36.506041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.509566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:36.509582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2392
2025-10-10T14:37:36.509787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.509822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:36.509828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:36.509832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:36.510230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2392 sessionId:  describe result for acl check
2025-10-10T14:37:36.510257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:36.510259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:36.510261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:36.510267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602245297005587:10537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:36.510861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602245297005587:10537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:36.514690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602245297005587:10537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:36.524788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602245297005587:10537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:36.524807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602245297005587:10537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:36.524811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602245297005587:10537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:36.524821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:36.530393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:36.533835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:36.534132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:36.534146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:36.534160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:36.534226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:36.534283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602244514774050:10853]
2025-10-10T14:37:36.535046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:36.535504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:36.535602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:36.536007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:36.536082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.536089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.536090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.536091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.536093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.536094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.536095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.536097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.536098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.536099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.536101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.536102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.536104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.536112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.536125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.536141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.536145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.536150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.536155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.536159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.536163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.536168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.536173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.536177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.536182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.536186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.536195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.536205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.536219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.536225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.536230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.536236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.536241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.536252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.536257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.536267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.536272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.536279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.536288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.536294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.536303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.536310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.536320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.536326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.536335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.536342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.536348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.536358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.536363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.536370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.536382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.536394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.536449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:36.540559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:36.541184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:36.541200Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:36.541203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:36.541208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:36.541215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2391 [2:7559602244514774050:10853]
2025-10-10T14:37:36.541230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:36.541251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:36.541254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.541258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.541261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.541279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:36.541294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:36.541308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:36.541393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.541405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.541407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.541410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:36.541488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:36.541496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.541511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.541531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.541550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:36.541579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005564:2438], now have 1 active actors on pipe
2025-10-10T14:37:36.541587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005737:10537], now have 1 active actors on pipe
2025-10-10T14:37:36.541596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602244514774045:10853]
2025-10-10T14:37:36.541603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602244514774045:10853]
2025-10-10T14:37:36.541606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602244514774045:10853]
2025-10-10T14:37:36.541622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:36.541640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:36.541642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:36.541651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:36.541654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:36.541660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:36.541664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:36.541703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602244514774045:10853]
2025-10-10T14:37:36.541712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:36.541653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2391
2025-10-10T14:37:36.541694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2391
2025-10-10T14:37:36.541897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:36.542046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.542060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.542095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:36.542119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.542127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.542130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:36.542143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.542162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:36.542185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.542654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.542668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.542704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.542847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2392 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0
2025-10-10T14:37:36.543316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8cdc65-8429b47f-cd309c24-864dfab7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:36.546313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0] Write session: try to update token
2025-10-10T14:37:36.546334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:36.562647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:36.562670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:36.562673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:36.562676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:36.562687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602244514774045:10853]
2025-10-10T14:37:36.562692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602244514774045:10853]
2025-10-10T14:37:36.562696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602244514774045:10853]
2025-10-10T14:37:36.562740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:36.562746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:36.562749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:36.562752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:36.562762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.562764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:36.562903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:36.570201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2392 sessionId: src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:36.572800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:36.601416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602245297005819:4939]
2025-10-10T14:37:36.613117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2391, pipe: [1:7559602245297005819:4939]
2025-10-10T14:37:36.690306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:36.691403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602245297005819:4939]
2025-10-10T14:37:36.691417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:36.691447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:36.691450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:36.691514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2392 reason: error at write: Disconnected sessionId: src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0
2025-10-10T14:37:36.691895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:36.691912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0] Write session will restart in 0.007383s
2025-10-10T14:37:36.690989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.691009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.691715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2392 sessionId: src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0 is DEAD
2025-10-10T14:37:36.691936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0] Write session: Do CDS request
2025-10-10T14:37:36.691943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:36.691033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005819:4939], now have 1 active actors on pipe
2025-10-10T14:37:36.691495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:36.700919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.701019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:36.701042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2393
2025-10-10T14:37:36.701166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.701202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:36.701209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:36.701225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:36.701662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2393 sessionId:  describe result for acl check
2025-10-10T14:37:36.701699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:36.701705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:36.701708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:36.701714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602245297005830:10544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:36.702317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602245297005830:10544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:36.704788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602245297005830:10544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:36.707642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602245297005830:10544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:36.707657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602245297005830:10544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:36.707661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602245297005830:10544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:36.707670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:36.722406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:36.726177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:36.726629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:36.726643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:36.726658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:36.726737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:36.726790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602244514774290:10857]
2025-10-10T14:37:36.727474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:36.727945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:36.728062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:36.728446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:36.728539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.728546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.728547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.728548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.728550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.728551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.728553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.728555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.728556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.728557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.728559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.728560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.728562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.728570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.728585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.728590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.728595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.728600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.728605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.728609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.728613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.728618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.728624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.728628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.728633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.728638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.728647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.728657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.728664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.728672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.728682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.728688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.728699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.728706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.728717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.728723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.728733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.728740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.728747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.728754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.728764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.728770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.728781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.728788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.728816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.728826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.728831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.728838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.728844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.728854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.728858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.728863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.728903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:36.735786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:36.736607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:36.736624Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:36.736627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:36.736631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:36.736639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2392 [2:7559602244514774290:10857]
2025-10-10T14:37:36.736656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:36.736678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:36.736688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.736693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.736695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.736715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:36.736723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:36.736737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:36.736806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.736815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.736817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.736820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:36.736902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:36.736911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.736924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.736939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.736953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:36.736983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005822:2438], now have 1 active actors on pipe
2025-10-10T14:37:36.736991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297005867:10544], now have 1 active actors on pipe
2025-10-10T14:37:36.736999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602244514774285:10857]
2025-10-10T14:37:36.737001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602244514774285:10857]
2025-10-10T14:37:36.737003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602244514774285:10857]
2025-10-10T14:37:36.737020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:36.737045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:36.737044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:36.737048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:36.737051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:36.737069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:36.737072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:36.737057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2392
2025-10-10T14:37:36.737114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602244514774285:10857]
2025-10-10T14:37:36.737126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:36.737104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2392
2025-10-10T14:37:36.737133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:36.737232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.737246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.737276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:36.737289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.737294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.737296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:36.737311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.737323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:36.737365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.737578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.737586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.737602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.737695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2393 partition: 0 MaxSeqNo: 40 sessionId: src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0
2025-10-10T14:37:36.738086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e4daf54-5ce1c4e0-128ea86b-c2e41e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:36.740822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0] Write session: try to update token
2025-10-10T14:37:36.740841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:36.756093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2393 sessionId: src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:36.758999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:36.759300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.759326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.759369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:36.759464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:36.762679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:36.762702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:36.762707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:36.762709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:36.762719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602244514774285:10857]
2025-10-10T14:37:36.762731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602244514774285:10857]
2025-10-10T14:37:36.762739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602244514774285:10857]
2025-10-10T14:37:36.762780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:36.762791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:36.762799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.762800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:36.762802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:36.762804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:36.763014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:36.789702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602245297006061:4939]
2025-10-10T14:37:36.790689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2392, pipe: [1:7559602245297006061:4939]
2025-10-10T14:37:36.887943Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:36.897115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.897150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.897410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.897478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.897551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.897623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.897670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.897681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.901185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:36.901194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602245297006061:4939]
2025-10-10T14:37:36.901237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:36.901241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:36.901276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2393 reason: error at write: Disconnected sessionId: src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0
2025-10-10T14:37:36.897755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.897820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.897881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.897948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.897989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.897992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.898102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.898193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.898294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.898356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.898400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.898403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.898471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.898613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.898735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.898884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.898922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.898926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.898997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.899071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.899133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.899261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.899310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.899313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.899383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.899437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.899497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.899558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.899599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.899602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.899671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.899732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.899797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.899859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.899903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.899907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.899975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.900034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.900093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.900152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.900210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.900213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.900279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.900335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.900395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.900457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.901498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2393 sessionId: src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0 is DEAD
2025-10-10T14:37:36.901714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:36.901726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0] Write session will restart in 0.007870s
2025-10-10T14:37:36.901753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0] Write session: Do CDS request
2025-10-10T14:37:36.901760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:36.900495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.900498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.900564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:36.900622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:36.900679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:36.900734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:36.900774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:36.900777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:36.900856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297006061:4939], now have 1 active actors on pipe
2025-10-10T14:37:36.902308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:36.910908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.912711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:36.912731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2394
2025-10-10T14:37:36.913068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:36.913105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:36.913111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:36.913116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:36.913613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2394 sessionId:  describe result for acl check
2025-10-10T14:37:36.913648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:36.913651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:36.913654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:36.913660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602245297006084:10549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:36.914320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602245297006084:10549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:36.932170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602245297006084:10549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:36.935637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602245297006084:10549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:36.935653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602245297006084:10549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:36.935657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602245297006084:10549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:36.935674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:36.940936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:36.944147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:36.944452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:36.944463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:36.944478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:36.944548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:36.944597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602244514774522:10859]
2025-10-10T14:37:36.945257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:36.945883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:36.945957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:36.946316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:36.946382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.946390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.946391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.946392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.946394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.946395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.946396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.946398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.946402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.946403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.946405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.946406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.946407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.946414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.946427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.946431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.946435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.946439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.946444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.946448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.946452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.946457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.946461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.946466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.946470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.946474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.946483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.946492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:36.946499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.946506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:36.946511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.946517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:36.946522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.946527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:36.946532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.946537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:36.946542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.946548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:36.946554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.946560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:36.946564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.946570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:36.946575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.946581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:36.946585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.946593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:36.946606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.946611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.946616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.946622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.946626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.946632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.946678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:36.952154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:36.952864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:36.952874Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:36.952876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:36.952879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:36.952885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2393 [2:7559602244514774522:10859]
2025-10-10T14:37:36.952899Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:36.952921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:36.952926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.952929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.952931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.952945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:36.952952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:36.952959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:36.953012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.953018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.953019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.953021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:36.953085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:36.953091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.953100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:36.953107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:36.953118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:36.953139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602244514774517:10859]
2025-10-10T14:37:36.953144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602244514774517:10859]
2025-10-10T14:37:36.953146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602244514774517:10859]
2025-10-10T14:37:36.953153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:36.953166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297006067:2438], now have 1 active actors on pipe
2025-10-10T14:37:36.953173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297006278:10549], now have 1 active actors on pipe
2025-10-10T14:37:36.953172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:36.953175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:36.953178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:36.953178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:36.953188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:36.953191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:36.953224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602244514774517:10859]
2025-10-10T14:37:36.953233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:36.953248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:36.953341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2393
2025-10-10T14:37:36.953402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2393
2025-10-10T14:37:36.953842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.953858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.953897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:36.953925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:36.953934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:36.953937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:36.953953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:36.953980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:36.954006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.954269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.954282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.954306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:36.954411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2394 partition: 0 MaxSeqNo: 40 sessionId: src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0
2025-10-10T14:37:36.954848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607c6246-764d584-e3b5c5c9-84ff9b93_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:36.957786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0] Write session: try to update token
2025-10-10T14:37:36.957810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:36.966422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:36.966440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:36.966449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602244514774517:10859]
2025-10-10T14:37:36.966506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:36.966637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:36.966868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:36.967016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:36.967169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:36.967320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:36.967596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:36.967643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:36.973459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2394 sessionId: src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:36.976071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:36.976285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:36.976307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:36.976347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:36.976454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:36.986229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:36.986251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:36.986255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:36.986257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:36.986268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602244514774517:10859]
2025-10-10T14:37:36.986272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602244514774517:10859]
2025-10-10T14:37:36.986276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602244514774517:10859]
2025-10-10T14:37:36.986328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:36.986341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:36.986344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:36.986347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:36.986348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:36.986353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:36.986492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:36.995564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602245297006304:4939]
2025-10-10T14:37:36.995842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2393, pipe: [1:7559602245297006304:4939]
2025-10-10T14:37:37.097808Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:37.098265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602245297006304:4939], now have 1 active actors on pipe
2025-10-10T14:37:37.105300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.105326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.105519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.105583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.105647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.105710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.105759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.105769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.105838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.105901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.106000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.106098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.106143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.106150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.106214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.106313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.106376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.106432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.106476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.106482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.106549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.106609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.106671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.106776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.106819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.106827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.106926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.107017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.107089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.107154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.107208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.107213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.107280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.107349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.107406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.107464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.107522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.107529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.107589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.107646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.107723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.107793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.107836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.107841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.107902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.107959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.108025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.108082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.108150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.108153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.108217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.108282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.108348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.108412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.108459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.108466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.108536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.108598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.108664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.108728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.108801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.108813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.109140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:37.109162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:37.109166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:37.109215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2394 reason: error at write: Disconnected sessionId: src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0
2025-10-10T14:37:37.109439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2394 sessionId: src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0 is DEAD
2025-10-10T14:37:37.109602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:37.109610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0] Write session will restart in 0.008829s
2025-10-10T14:37:37.109635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0] Write session: Do CDS request
2025-10-10T14:37:37.109643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:37.109766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602245297006304:4939]
2025-10-10T14:37:37.110118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:37.119947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.120018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:37.120043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2395
2025-10-10T14:37:37.120190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.120228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:37.120237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:37.120242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:37.120765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2395 sessionId:  describe result for acl check
2025-10-10T14:37:37.120807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:37.120816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:37.120819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:37.120825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602249591973635:10553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:37.121471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602249591973635:10553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:37.124562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602249591973635:10553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:37.128720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602249591973635:10553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:37.128734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602249591973635:10553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:37.128738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602249591973635:10553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:37.128747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:37.130761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:37.133416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:37.133735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:37.133749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:37.133762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:37.133843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:37.133892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602248809742053:10862]
2025-10-10T14:37:37.134539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:37.134856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:37.134902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:37.135250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:37.135309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.135316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.135317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.135318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.135320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.135321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.135322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.135324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.135325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.135326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.135328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.135329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.135330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.135337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.135351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.135355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.135360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.135364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.135368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.135372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.135376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.135380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.135385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.135390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.135394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.135397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.135406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.135415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.135423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.135429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.135433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.135439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.135443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.135449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.135453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.135458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.135468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.135473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.135479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.135489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.135493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.135499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.135504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.135514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.135518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.135528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.135534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.135539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.135544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.135553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.135557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.135562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.135609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:37.138112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:37.138455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:37.138467Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:37.138470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:37.138474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:37.138481Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2394 [2:7559602248809742053:10862]
2025-10-10T14:37:37.138494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:37.138525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:37.138533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.138537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.138540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.138558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:37.138571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:37.138580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:37.138640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.138646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.138648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.138651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:37.138736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:37.138744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.138755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.138772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.138794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:37.138824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591973603:2438], now have 1 active actors on pipe
2025-10-10T14:37:37.138828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591973822:10553], now have 1 active actors on pipe
2025-10-10T14:37:37.138836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602248809742048:10862]
2025-10-10T14:37:37.138842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602248809742048:10862]
2025-10-10T14:37:37.138845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602248809742048:10862]
2025-10-10T14:37:37.138859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:37.138874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:37.138875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:37.138879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:37.138868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2394
2025-10-10T14:37:37.138881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:37.138896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:37.138885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2394
2025-10-10T14:37:37.138899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:37.138949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.138960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.138976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602248809742048:10862]
2025-10-10T14:37:37.138987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:37.138993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:37.139021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:37.139034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.139037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.139040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:37.139063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.139075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:37.139104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.139300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.139309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.139325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.139449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2395 partition: 0 MaxSeqNo: 40 sessionId: src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0
2025-10-10T14:37:37.139879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4374f6-ca07b9ea-35ee6cf0-164c0812_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:37.142671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0] Write session: try to update token
2025-10-10T14:37:37.142689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:37.158574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:37.158591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:37.158594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:37.158596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:37.158607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602248809742048:10862]
2025-10-10T14:37:37.158611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602248809742048:10862]
2025-10-10T14:37:37.158615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602248809742048:10862]
2025-10-10T14:37:37.158635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2395 sessionId: src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:37.158672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:37.158685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.158685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:37.158687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:37.158693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:37.158698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:37.158866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:37.161560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:37.210074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602249591973841:4939]
2025-10-10T14:37:37.210323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2394, pipe: [1:7559602249591973841:4939]
2025-10-10T14:37:37.275452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:37.275903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.275934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.275983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591973841:4939], now have 1 active actors on pipe
2025-10-10T14:37:37.276282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:37.276344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:37.276335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602249591973841:4939]
2025-10-10T14:37:37.276362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:37.276365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:37.276418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2395 reason: error at write: Disconnected sessionId: src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0
2025-10-10T14:37:37.276633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2395 sessionId: src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0 is DEAD
2025-10-10T14:37:37.276837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:37.276847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0] Write session will restart in 0.006103s
2025-10-10T14:37:37.276872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0] Write session: Do CDS request
2025-10-10T14:37:37.276888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:37.283957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.284117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:37.284132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2396
2025-10-10T14:37:37.284276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.284338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:37.284349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:37.284356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:37.284817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2396 sessionId:  describe result for acl check
2025-10-10T14:37:37.284852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:37.284859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:37.284861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:37.284868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602249591973867:10558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:37.285509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602249591973867:10558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:37.290041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602249591973867:10558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:37.294599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602249591973867:10558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:37.294616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602249591973867:10558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:37.294620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602249591973867:10558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:37.294630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:37.299850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:37.302753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:37.302999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:37.303011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:37.303024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:37.303102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:37.303150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602248809742299:10865]
2025-10-10T14:37:37.303856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:37.304188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:37.304233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:37.304551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:37.304618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.304625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.304626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.304628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.304628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.304629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.304630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.304632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.304633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.304634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.304635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.304636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.304637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.304642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.304655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.304658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.304662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.304665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.304669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.304672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.304675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.304679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.304683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.304687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.304690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.304693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.304701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.304709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.304715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.304720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.304724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.304730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.304733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.304738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.304743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.304747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.304751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.304759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.304770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.304775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.304779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.304785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.304790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.304795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.304799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.304804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.304814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.304819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.304823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.304829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.304838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.304843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.304878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:37.307503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:37.307874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:37.307888Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:37.307891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:37.307896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:37.307904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2395 [2:7559602248809742299:10865]
2025-10-10T14:37:37.307919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:37.307953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:37.307957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.307961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.307963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.307981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:37.307996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:37.308009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:37.308419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.308431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.308433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.308436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:37.308510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:37.308518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.308533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.308551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.308579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:37.308606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602248809742294:10865]
2025-10-10T14:37:37.308613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602248809742294:10865]
2025-10-10T14:37:37.308615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602248809742294:10865]
2025-10-10T14:37:37.308632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:37.308652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591973854:2438], now have 1 active actors on pipe
2025-10-10T14:37:37.308653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:37.308658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:37.308660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:37.308661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591973996:10558], now have 1 active actors on pipe
2025-10-10T14:37:37.308671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:37.308688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:37.308696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:37.308723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602248809742294:10865]
2025-10-10T14:37:37.308737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:37.308778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2395
2025-10-10T14:37:37.308822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2395
2025-10-10T14:37:37.308847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:37.308966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.308983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.309022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:37.309037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.309041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.309043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:37.309057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.309074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:37.309110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.313609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.313628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.313665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.313807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2396 partition: 0 MaxSeqNo: 40 sessionId: src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0
2025-10-10T14:37:37.314201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd27b418-4a6b3573-5ab27520-3da9dc94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:37.316971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0] Write session: try to update token
2025-10-10T14:37:37.316995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:37.329822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:37.329850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:37.329854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:37.329856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:37.329881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602248809742294:10865]
2025-10-10T14:37:37.329886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602248809742294:10865]
2025-10-10T14:37:37.329891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602248809742294:10865]
2025-10-10T14:37:37.329949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:37.329965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.329968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:37.329970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:37.329977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:37.329985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:37.330136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:37.333845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2396 sessionId: src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:37.336529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:37.373894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602249591974092:4939]
2025-10-10T14:37:37.374155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2395, pipe: [1:7559602249591974092:4939]
2025-10-10T14:37:37.453814Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:37.454064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.454086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.454132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974092:4939], now have 1 active actors on pipe
2025-10-10T14:37:37.454339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:37.454325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:37.454376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:37.454380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:37.454382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602249591974092:4939]
2025-10-10T14:37:37.454445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2396 reason: error at write: Disconnected sessionId: src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0
2025-10-10T14:37:37.454659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2396 sessionId: src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0 is DEAD
2025-10-10T14:37:37.454822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:37.454840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0] Write session will restart in 0.006034s
2025-10-10T14:37:37.454865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0] Write session: Do CDS request
2025-10-10T14:37:37.454872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:37.461907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.462239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:37.462255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2397
2025-10-10T14:37:37.462478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.462514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:37.462519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:37.462526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:37.462934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2397 sessionId:  describe result for acl check
2025-10-10T14:37:37.462969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:37.462975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:37.462977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:37.462983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602249591974109:10562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:37.463605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602249591974109:10562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:37.466414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602249591974109:10562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:37.470513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602249591974109:10562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:37.470529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602249591974109:10562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:37.470532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602249591974109:10562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:37.470551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:37.487054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:37.492484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:37.492763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:37.492775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:37.492787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:37.492848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:37.492906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602248809742551:10873]
2025-10-10T14:37:37.493596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:37.494139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:37.494199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:37.494558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:37.494624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.494632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.494633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.494635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.494636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.494637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.494638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.494639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.494640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.494642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.494643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.494644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.494645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.494652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.494665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.494669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.494673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.494677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.494682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.494685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.494689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.494693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.494697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.494700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.494704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.494707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.494718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.494726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.494732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.494737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.494742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.494747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.494752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.494757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.494762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.494767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.494771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.494777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.494781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.494798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.494809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.494814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.494818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.494824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.494828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.494833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.494837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.494842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.494846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.494851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.494856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.494867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.494915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:37.497478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:37.497788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:37.497801Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:37.497804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:37.497807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:37.497814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2396 [2:7559602248809742551:10873]
2025-10-10T14:37:37.497825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:37.497843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:37.497846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.497849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.497852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.497869Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:37.497892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:37.497905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:37.497959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.497966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.497969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.497971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:37.498036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:37.498043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.498053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.498069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.498090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:37.498115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974221:10562], now have 1 active actors on pipe
2025-10-10T14:37:37.498123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974094:2438], now have 1 active actors on pipe
2025-10-10T14:37:37.498132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602248809742542:10873]
2025-10-10T14:37:37.498139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602248809742542:10873]
2025-10-10T14:37:37.498141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602248809742542:10873]
2025-10-10T14:37:37.498156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:37.498182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2396
2025-10-10T14:37:37.498198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2396
2025-10-10T14:37:37.498174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:37.498174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:37.498177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:37.498179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:37.498197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:37.498200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:37.498224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602248809742542:10873]
2025-10-10T14:37:37.498227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:37.498240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:37.498243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.498248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.498298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|850e4151-2a148cec-b7e859cf-1e334481_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:37.498308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.498312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.498314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:37.498325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.498334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:37.498352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.498673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.498687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.498705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.498848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2397 partition: 0 MaxSeqNo: 40 sessionId: src_id|850e4151-2a148cec-b7e859cf-1e334481_0
2025-10-10T14:37:37.499306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f38f031-2212c85b-19ff7ebf-4f51bbf1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|850e4151-2a148cec-b7e859cf-1e334481_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:37.502016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|850e4151-2a148cec-b7e859cf-1e334481_0] Write session: try to update token
2025-10-10T14:37:37.502035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|850e4151-2a148cec-b7e859cf-1e334481_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:37.518245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2397 sessionId: src_id|850e4151-2a148cec-b7e859cf-1e334481_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:37.520932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:37.521471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.521495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.521519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:37.521523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:37.521527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:37.521529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:37.521538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602248809742542:10873]
2025-10-10T14:37:37.521543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602248809742542:10873]
2025-10-10T14:37:37.521549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602248809742542:10873]
2025-10-10T14:37:37.521600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:37.521614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:37.521618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:37.521628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:37.521642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.521649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:37.521805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:37.554655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602249591974333:4939]
2025-10-10T14:37:37.554984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2396, pipe: [1:7559602249591974333:4939]
2025-10-10T14:37:37.639444Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:37.639729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:37.639798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974333:4939], now have 1 active actors on pipe
2025-10-10T14:37:37.639956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:37.640035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:37.640093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602249591974333:4939]
2025-10-10T14:37:37.652262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:37.652277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:37.652308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2397 reason: error at write: Disconnected sessionId: src_id|850e4151-2a148cec-b7e859cf-1e334481_0
2025-10-10T14:37:37.652487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2397 sessionId: src_id|850e4151-2a148cec-b7e859cf-1e334481_0 is DEAD
2025-10-10T14:37:37.652653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850e4151-2a148cec-b7e859cf-1e334481_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:37.652666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850e4151-2a148cec-b7e859cf-1e334481_0] Write session will restart in 0.008675s
2025-10-10T14:37:37.652693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850e4151-2a148cec-b7e859cf-1e334481_0] Write session: Do CDS request
2025-10-10T14:37:37.652700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850e4151-2a148cec-b7e859cf-1e334481_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:37.663053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|850e4151-2a148cec-b7e859cf-1e334481_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.663353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:37.663370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2398
2025-10-10T14:37:37.664121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.664172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:37.664178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:37.664183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:37.664693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2398 sessionId:  describe result for acl check
2025-10-10T14:37:37.664733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:37.664743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:37.664745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:37.664752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602249591974505:10575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:37.665385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602249591974505:10575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:37.668391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:37.668515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602249591974505:10575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:37.671490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:37.671732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:37.671744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:37.671756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:37.671817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:37.671961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602248809742808:10882]
2025-10-10T14:37:37.671896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602249591974505:10575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:37.671912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602249591974505:10575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:37.671916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602249591974505:10575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:37.671925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:37.672607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:37.672974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:37.673052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:37.673416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:37.673484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.673491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.673493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.673494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.673495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.673496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.673497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.673498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.673499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.673500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.673501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.673503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.673504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.673511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.673523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.673528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.673533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.673537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.673541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.673545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.673549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.673553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.673557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.673562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.673566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.673569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.673577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.673587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.673594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.673599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.673604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.673610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.673614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.673619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.673624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.673630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.673634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.673639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.673646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.673653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.673663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.673668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.673673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.673678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.673683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.673688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.673693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.673699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.673703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.673709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.673724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.673729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.673769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:37.676381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:37.677078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:37.677092Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:37.677094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:37.677098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:37.677105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2397 [2:7559602248809742808:10882]
2025-10-10T14:37:37.677120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:37.677138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:37.677146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.677150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.677152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.677170Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:37.677182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:37.677189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:37.677252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.677260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.677262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.677265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:37.677350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:37.677360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.677372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.677382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.677465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2397
2025-10-10T14:37:37.677504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2397
2025-10-10T14:37:37.677399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:37.677428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974361:2438], now have 1 active actors on pipe
2025-10-10T14:37:37.677432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974586:10575], now have 1 active actors on pipe
2025-10-10T14:37:37.677440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602248809742803:10882]
2025-10-10T14:37:37.677442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602248809742803:10882]
2025-10-10T14:37:37.677444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602248809742803:10882]
2025-10-10T14:37:37.677460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:37.677475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:37.677490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:37.677493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:37.677526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602248809742803:10882]
2025-10-10T14:37:37.677529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:37.677547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:37.677562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:37.677565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:37.677573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:37.677685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.677693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.677726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:37.677737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.677742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.677745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:37.677776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.677789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:37.677806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.677931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.677942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.677970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.678073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2398 partition: 0 MaxSeqNo: 40 sessionId: src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0
2025-10-10T14:37:37.681506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|850e4151-2a148cec-b7e859cf-1e334481_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:37.684255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0] Write session: try to update token
2025-10-10T14:37:37.684274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:37.697568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:37.697586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:37.697597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602248809742803:10882]
2025-10-10T14:37:37.697645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:37.697649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:37.697849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:37.698009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:37.698147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:37.698301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:37.698498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:37.698544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:37.706370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2398 sessionId: src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:37.709042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:37.709240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.709265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.709309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:37.709442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:37.716810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:37.716832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:37.716836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:37.716839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:37.716851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602248809742803:10882]
2025-10-10T14:37:37.716855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602248809742803:10882]
2025-10-10T14:37:37.716859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602248809742803:10882]
2025-10-10T14:37:37.716917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:37.716926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:37.716933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:37.716938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:37.716944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.716952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:37.717087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:37.740515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602249591974598:4939]
2025-10-10T14:37:37.740805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2397, pipe: [1:7559602249591974598:4939]
2025-10-10T14:37:37.849453Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:37.858310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.858345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.858536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.858608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.858683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.858764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.859304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.859322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.859395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.859460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.859533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.859605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.859651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.859659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.859727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.859794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.859866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.859934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.859980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.859988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.860055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.860164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.860234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.860300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.860363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.860370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.860444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.860514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.860584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.860660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.860711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.860715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.860824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.860894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.860954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.861015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.861077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.861081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.861154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.861222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.861292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.863000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:37.863013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602249591974598:4939]
2025-10-10T14:37:37.863540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:37.863548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0] Write session will restart in 0.008484s
2025-10-10T14:37:37.863576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0] Write session: Do CDS request
2025-10-10T14:37:37.863111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:37.863130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:37.863591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:37.863164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2398 reason: error at write: Disconnected sessionId: src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0
2025-10-10T14:37:37.863371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2398 sessionId: src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0 is DEAD
2025-10-10T14:37:37.861441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.861517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.861520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.861595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.861661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.861726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.861789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.861844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.861847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.861918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.861976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.862041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.862105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.862174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.862178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.862251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:37.862315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:37.862382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:37.862452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:37.862498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:37.862501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:37.862585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974598:4939], now have 1 active actors on pipe
2025-10-10T14:37:37.863379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:37.872920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.873039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:37.873055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2399
2025-10-10T14:37:37.873193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:37.873229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:37.873241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:37.873245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:37.873785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2399 sessionId:  describe result for acl check
2025-10-10T14:37:37.873823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:37.873830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:37.873832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:37.873839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602249591974629:10580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:37.874445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602249591974629:10580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:37.877421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602249591974629:10580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:37.882759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602249591974629:10580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:37.882779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602249591974629:10580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:37.882784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602249591974629:10580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:37.882793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:37.886852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:37.889778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:37.890000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:37.890012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:37.890026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:37.890083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:37.890127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602248809743048:10884]
2025-10-10T14:37:37.890793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:37.891134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:37.891178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:37.891490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:37.891559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.891567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.891568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.891569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.891570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.891570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.891572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.891573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.891575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.891576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.891577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.891578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.891579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.891584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.891597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.891601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.891605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.891609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.891614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.891618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.891622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.891626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.891631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.891634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.891638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.891642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.891652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.891661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:37.891670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.891675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:37.891679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.891683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:37.891688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.891692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:37.891696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.891701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:37.891705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.891710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:37.891719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.891724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:37.891728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.891732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:37.891736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.891740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:37.891749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.891754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:37.891758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.891763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.891767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.891776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.891781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.891787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.891833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:37.894405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:37.895190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:37.895202Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:37.895204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:37.895208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:37.895214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2398 [2:7559602248809743048:10884]
2025-10-10T14:37:37.895228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:37.895250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:37.895258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.895262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.895264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.895283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:37.895296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:37.895305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:37.895375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.895382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.895384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.895386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:37.895456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:37.895466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.895477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:37.895490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:37.895508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:37.895530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974800:10580], now have 1 active actors on pipe
2025-10-10T14:37:37.895533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974609:2438], now have 1 active actors on pipe
2025-10-10T14:37:37.895541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602248809743043:10884]
2025-10-10T14:37:37.895543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602248809743043:10884]
2025-10-10T14:37:37.895545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602248809743043:10884]
2025-10-10T14:37:37.895558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:37.895573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:37.895577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:37.895580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:37.895585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:37.895592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:37.895595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:37.895621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602248809743043:10884]
2025-10-10T14:37:37.895633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:37.895643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:37.895756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2398
2025-10-10T14:37:37.895782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2398
2025-10-10T14:37:37.895985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.895999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.896037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c3a187c-887729e5-3599783b-c7f1d910_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:37.896051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:37.896059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:37.896061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:37.896074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:37.896092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:37.896116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.896320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.896331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.896354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:37.896444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2399 partition: 0 MaxSeqNo: 40 sessionId: src_id|7c3a187c-887729e5-3599783b-c7f1d910_0
2025-10-10T14:37:37.896829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69dd1ab9-9734b8d4-36dc7c87-624473b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7c3a187c-887729e5-3599783b-c7f1d910_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:37.899831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c3a187c-887729e5-3599783b-c7f1d910_0] Write session: try to update token
2025-10-10T14:37:37.899851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c3a187c-887729e5-3599783b-c7f1d910_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:37.916010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2399 sessionId: src_id|7c3a187c-887729e5-3599783b-c7f1d910_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:37.918774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:37.920049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:37.920080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:37.920106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:37.920110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:37.920113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:37.920116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:37.920126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602248809743043:10884]
2025-10-10T14:37:37.920131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602248809743043:10884]
2025-10-10T14:37:37.920136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602248809743043:10884]
2025-10-10T14:37:37.920182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:37.920198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:37.920205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:37.920213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:37.920216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:37.920219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:37.920357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:37.963232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602249591974849:4939]
2025-10-10T14:37:37.963574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2398, pipe: [1:7559602249591974849:4939]
2025-10-10T14:37:38.036443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:38.036538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602249591974849:4939]
2025-10-10T14:37:38.036569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:38.035962Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:38.036262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:38.036326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602249591974849:4939], now have 1 active actors on pipe
2025-10-10T14:37:38.049001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:38.049015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:38.049043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2399 reason: error at write: Disconnected sessionId: src_id|7c3a187c-887729e5-3599783b-c7f1d910_0
2025-10-10T14:37:38.049192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2399 sessionId: src_id|7c3a187c-887729e5-3599783b-c7f1d910_0 is DEAD
2025-10-10T14:37:38.049380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c3a187c-887729e5-3599783b-c7f1d910_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:38.049393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c3a187c-887729e5-3599783b-c7f1d910_0] Write session will restart in 0.007354s
2025-10-10T14:37:38.049418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c3a187c-887729e5-3599783b-c7f1d910_0] Write session: Do CDS request
2025-10-10T14:37:38.049423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c3a187c-887729e5-3599783b-c7f1d910_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:38.057864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c3a187c-887729e5-3599783b-c7f1d910_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.057951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:38.057964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2400
2025-10-10T14:37:38.058174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.058212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:38.058223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:38.058227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:38.058781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2400 sessionId:  describe result for acl check
2025-10-10T14:37:38.058820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:38.058827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:38.058828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:38.058835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602253886942277:10584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:38.059426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602253886942277:10584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:38.062976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602253886942277:10584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:38.064289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:38.066982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:38.067331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:38.067345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:38.067359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:38.067356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602253886942277:10584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:38.067371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602253886942277:10584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:38.067375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602253886942277:10584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:38.067385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:38.067440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:38.067491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602253104710581:10886]
2025-10-10T14:37:38.068079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:38.068424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:38.068474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:38.068776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:38.068834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.068834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.068835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.068836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.068838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.068839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.068840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.068840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.068841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.068841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.068842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.068843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.068843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.068847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.068857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.068859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.068862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.068864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.068866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.068868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.068870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.068872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.068874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.068876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.068878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.068881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.068887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.068893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.068897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.068900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.068905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.068908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.068911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.068914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.068917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.068921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.068924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.068927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.068929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.068932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.068935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.068938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.068941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.068944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.068946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.068949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.068952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.068955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.068957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.068961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.068964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.068967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.068988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:38.071517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:38.072282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:38.072309Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:38.072312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:38.072317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:38.072325Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2399 [2:7559602253104710581:10886]
2025-10-10T14:37:38.072341Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:38.072360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:38.072363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.072366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.072369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.072388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:38.072397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:38.072413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:38.072477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.072486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.072488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.072491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:38.072573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:38.072582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.072594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.072607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.072626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:38.072654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942147:2438], now have 1 active actors on pipe
2025-10-10T14:37:38.072663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942378:10584], now have 1 active actors on pipe
2025-10-10T14:37:38.072670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602253104710576:10886]
2025-10-10T14:37:38.072673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602253104710576:10886]
2025-10-10T14:37:38.072675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602253104710576:10886]
2025-10-10T14:37:38.072689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:38.072712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:38.072718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:38.072723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:38.072726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:38.072733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:38.072737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:38.072764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2399
2025-10-10T14:37:38.072766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2399
2025-10-10T14:37:38.072766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602253104710576:10886]
2025-10-10T14:37:38.072781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:38.072790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:38.072824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.072829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.072862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|affb3e51-c92aaab2-86375d97-650793ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:38.072877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.072886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.072889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:38.072900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.072911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:38.072926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.073194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.073210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.073236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.073346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2400 partition: 0 MaxSeqNo: 40 sessionId: src_id|affb3e51-c92aaab2-86375d97-650793ae_0
2025-10-10T14:37:38.073781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c3a187c-887729e5-3599783b-c7f1d910_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|affb3e51-c92aaab2-86375d97-650793ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:38.076806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|affb3e51-c92aaab2-86375d97-650793ae_0] Write session: try to update token
2025-10-10T14:37:38.076825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|affb3e51-c92aaab2-86375d97-650793ae_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:38.095506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:38.095529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:38.095533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:38.095535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:38.095546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602253104710576:10886]
2025-10-10T14:37:38.095550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602253104710576:10886]
2025-10-10T14:37:38.095555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602253104710576:10886]
2025-10-10T14:37:38.095608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:38.095609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:38.095614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:38.095616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.095618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:38.095623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:38.095777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:38.096231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2400 sessionId: src_id|affb3e51-c92aaab2-86375d97-650793ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:38.099206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:38.136790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602253886942389:4939]
2025-10-10T14:37:38.137135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2399, pipe: [1:7559602253886942389:4939]
2025-10-10T14:37:38.210899Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:38.211234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.211250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.211297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942389:4939], now have 1 active actors on pipe
2025-10-10T14:37:38.211565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602253886942389:4939]
2025-10-10T14:37:38.211607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:38.211618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:38.211623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:38.211575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:38.212068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|affb3e51-c92aaab2-86375d97-650793ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:38.212080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|affb3e51-c92aaab2-86375d97-650793ae_0] Write session will restart in 0.005531s
2025-10-10T14:37:38.211689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2400 reason: error at write: Disconnected sessionId: src_id|affb3e51-c92aaab2-86375d97-650793ae_0
2025-10-10T14:37:38.211898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2400 sessionId: src_id|affb3e51-c92aaab2-86375d97-650793ae_0 is DEAD
2025-10-10T14:37:38.212124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|affb3e51-c92aaab2-86375d97-650793ae_0] Write session: Do CDS request
2025-10-10T14:37:38.212157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|affb3e51-c92aaab2-86375d97-650793ae_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:38.218964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|affb3e51-c92aaab2-86375d97-650793ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.219067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:38.219083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2401
2025-10-10T14:37:38.219301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.219351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:38.219361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:38.219366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:38.219812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2401 sessionId:  describe result for acl check
2025-10-10T14:37:38.219849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:38.219851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:38.219853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:38.219859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602253886942403:10588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:38.220458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602253886942403:10588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:38.225726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602253886942403:10588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:38.230629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602253886942403:10588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:38.230646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602253886942403:10588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:38.230650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602253886942403:10588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:38.230663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:38.237993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:38.241377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:38.241652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:38.241665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:38.241678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:38.241738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:38.241782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602253104710835:10890]
2025-10-10T14:37:38.242448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:38.242873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:38.242926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:38.243301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:38.243375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.243383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.243385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.243386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.243387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.243389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.243391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.243392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.243394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.243395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.243396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.243397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.243398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.243405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.243420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.243425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.243429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.243434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.243438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.243442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.243447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.243451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.243455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.243460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.243464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.243468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.243477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.243486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.243493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.243499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.243504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.243510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.243515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.243521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.243526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.243531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.243537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.243542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.243548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.243553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.243561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.243566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.243583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.243589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.243594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.243600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.243605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.243611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.243616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.243621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.243625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.243631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.243673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:38.246657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:38.247216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:38.247221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:38.247223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:38.247228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:38.247234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2400 [2:7559602253104710835:10890]
2025-10-10T14:37:38.247249Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:38.247269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:38.247273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.247277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.247279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.247298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:38.247307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:38.247316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:38.247377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.247379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.247381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.247384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:38.247467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:38.247470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.247483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.247495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.247515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:38.247537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602253104710830:10890]
2025-10-10T14:37:38.247539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602253104710830:10890]
2025-10-10T14:37:38.247542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602253104710830:10890]
2025-10-10T14:37:38.247550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:38.247565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:38.247565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:38.247569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:38.247571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:38.247583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:38.247586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:38.247598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942391:2438], now have 1 active actors on pipe
2025-10-10T14:37:38.247602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942536:10588], now have 1 active actors on pipe
2025-10-10T14:37:38.247629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602253104710830:10890]
2025-10-10T14:37:38.247638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:38.247644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:38.248306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2400
2025-10-10T14:37:38.248352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2400
2025-10-10T14:37:38.250994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.251015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.251068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:38.251083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.251089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.251092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:38.251107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.251125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:38.251146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.251449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.251454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.251473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.251747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2401 partition: 0 MaxSeqNo: 40 sessionId: src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0
2025-10-10T14:37:38.252346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|affb3e51-c92aaab2-86375d97-650793ae_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:38.255229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0] Write session: try to update token
2025-10-10T14:37:38.255248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:38.269718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:38.269742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:38.269745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:38.269748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:38.269758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602253104710830:10890]
2025-10-10T14:37:38.269762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602253104710830:10890]
2025-10-10T14:37:38.269770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602253104710830:10890]
2025-10-10T14:37:38.269811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:38.269821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:38.269828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.269830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:38.269831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:38.269834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:38.269997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:38.271699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2401 sessionId: src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:38.274399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:38.315707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602253886942645:4939]
2025-10-10T14:37:38.316077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2400, pipe: [1:7559602253886942645:4939]
2025-10-10T14:37:38.388080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:38.388492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.388509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.388551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942645:4939], now have 1 active actors on pipe
2025-10-10T14:37:38.388827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:38.388962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:38.389037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602253886942645:4939]
2025-10-10T14:37:38.389064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:38.389377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2401 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0
2025-10-10T14:37:38.389505Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:37:38.389605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2401 sessionId: src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0 is DEAD
2025-10-10T14:37:38.389782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:38.389794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0] Write session will restart in 0.009090s
2025-10-10T14:37:38.389742Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 24 consumer shared/user session shared/user_1_24_7560477778585456082_v1 is DEAD
2025-10-10T14:37:38.389818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0] Write session: Do CDS request
2025-10-10T14:37:38.389825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:38.389831Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:37:38.389909Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:37:38.389914Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:37:38.389921Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.005459s
2025-10-10T14:37:38.389936Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602172282543653:4932] disconnected; active server actors: 1
2025-10-10T14:37:38.389945Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602172282543653:4932] client user disconnected session shared/user_1_24_7560477778585456082_v1
2025-10-10T14:37:38.396772Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:37:38.397024Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:37:38.397039Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 25
2025-10-10T14:37:38.397533Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 25 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:37:38.397604Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:37:38.397718Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 auth for : user
2025-10-10T14:37:38.397889Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 Handle describe topics response
2025-10-10T14:37:38.397919Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 auth is DEAD
2025-10-10T14:37:38.397935Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:37:38.398198Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:37:38.398283Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602253886942664:10593] connected; active server actors: 1
2025-10-10T14:37:38.398296Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602253886942664:10593] session shared/user_1_25_4909973995709412205_v1
2025-10-10T14:37:38.398306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:37:38.398318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:37:38.398323Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_25_4909973995709412205_v1" (Sender=[1:7559602253886942659:10593], Pipe=[1:7559602253886942664:10593], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:37:38.398327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:37:38.398338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:37:38.398347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_25_4909973995709412205_v1" (Sender=[1:7559602253886942659:10593], Pipe=[1:7559602253886942664:10593], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:37:38.398362Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_25_4909973995709412205_v1" sender [1:7559602253886942659:10593] lock partition 0 for ReadingSession "shared/user_1_25_4909973995709412205_v1" (Sender=[1:7559602253886942659:10593], Pipe=[1:7559602253886942664:10593], Partitions=[], ActiveFamilyCount=1) generation 1 step 25
2025-10-10T14:37:38.398371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:37:38.398375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-10T14:37:38.398563Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 25 Session: "shared/user_1_25_4909973995709412205_v1" ClientId: "user" PipeClient { RawX1: 7559602253886942664 RawX2: 4503603922348385 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:37:38.398577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:37:38.398909Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_25_4909973995709412205_v1
2025-10-10T14:37:38.399832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.405536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:38.405552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2402
2025-10-10T14:37:38.409491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.409564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:38.409577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:38.409586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:38.410152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2402 sessionId:  describe result for acl check
2025-10-10T14:37:38.410189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:38.410193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:38.410196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:38.410203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602253886942733:10597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:38.410917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602253886942733:10597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:38.414257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602253886942733:10597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:38.418674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602253886942733:10597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:38.418689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602253886942733:10597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:38.418693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602253886942733:10597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:38.418702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:38.421393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:38.424523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:38.424757Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:38.424762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:38.424776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:38.424848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:38.424892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602253104711076:10892]
2025-10-10T14:37:38.425480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:38.425831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:38.425882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:38.426219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:38.426271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.426273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.426274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.426275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.426277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.426278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.426280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.426281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.426282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.426283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.426285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.426286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.426287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.426293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.426307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.426311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.426316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.426320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.426325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.426329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.426333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.426338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.426343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.426347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.426352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.426355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.426364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.426373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.426379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.426384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.426391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.426397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.426402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.426407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.426413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.426418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.426423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.426429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.426434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.426439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.426446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.426452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.426457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.426462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.426468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.426473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.426478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.426483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.426487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.426493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.426498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.426503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.426564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:38.429133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:38.429816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:38.429832Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:38.429834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:38.429838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:38.429846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2401 [2:7559602253104711076:10892]
2025-10-10T14:37:38.429862Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:38.429882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:38.429886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.429890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.429893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.429912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:38.429925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:38.429934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:38.430004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.430011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.430013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.430016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:38.430087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:38.430090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.430103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.430114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.430131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:38.430161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942667:10596], now have 1 active actors on pipe
2025-10-10T14:37:38.430173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942878:10597], now have 1 active actors on pipe
2025-10-10T14:37:38.430181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602253104711071:10892]
2025-10-10T14:37:38.430189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602253104711071:10892]
2025-10-10T14:37:38.430191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602253104711071:10892]
2025-10-10T14:37:38.430201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:38.430212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:38.430215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:38.430216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:38.430218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:38.430235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:38.430245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:38.430254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942647:2438], now have 1 active actors on pipe
2025-10-10T14:37:38.430280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602253104711071:10892]
2025-10-10T14:37:38.430292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:38.430308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:38.430562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2401, pipe: [1:7559602253886942667:10596]
2025-10-10T14:37:38.430598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2401
2025-10-10T14:37:38.430618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2401
2025-10-10T14:37:38.431257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.431272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.431288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_25_4909973995709412205_v1 on pipe: [1:7559602253886942667:10596]
2025-10-10T14:37:38.431311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.431314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.431330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.431337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.431340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:38.431360Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_25_4909973995709412205_v1
2025-10-10T14:37:38.431362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.431413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:38.431421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:37:38.431426Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:37:38.431499Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_25_4909973995709412205_v1:1 with generation 2401
2025-10-10T14:37:38.442454Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107058429 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:37:38.442477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:37:38.442567Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 sending to client partition status
2025-10-10T14:37:38.443294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2402 partition: 0 MaxSeqNo: 40 sessionId: src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0
2025-10-10T14:37:38.441428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:37:38.443590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4e8c78-5a5b6d2-3bb9b642-11364a2b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:38.441484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:37:38.441496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.441506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.441509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:38.441525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.441547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:38.441556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:37:38.441573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:37:38.441592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.443093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.443103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.443132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.446365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0] Write session: try to update token
2025-10-10T14:37:38.446383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:38.455733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:38.455755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:38.455768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602253104711071:10892]
2025-10-10T14:37:38.455825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:38.455826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:38.456016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:38.456168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:38.456314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:38.456459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:38.456683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:38.456733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:38.465386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2402 sessionId: src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:38.468244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:38.468528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.468557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.468602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:38.471116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:38.471135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:38.471138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:38.471140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:38.471151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602253104711071:10892]
2025-10-10T14:37:38.471156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602253104711071:10892]
2025-10-10T14:37:38.471159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602253104711071:10892]
2025-10-10T14:37:38.471209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:38.471215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:38.471223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:38.471223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.471226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:38.471227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:38.471419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:38.468743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:38.587153Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:38.595340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.595376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.595576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.595658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.595735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.595812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.595869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.595879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.595959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.596034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.596106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.596181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.596232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.596241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.596317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.596390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.596452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.596518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.596559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.596562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.596667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.596735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.596807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.596873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.596916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.596919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.596992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.597053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.597129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.597195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.597244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.597247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.597462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.597535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.597605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.597675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.597726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.597733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.597814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.597886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.597970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.598046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.598097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.598105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.598183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.598254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.598326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.598402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.598455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.598462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.598536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.598608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.598682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.598761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.598811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.598822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.598902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.598977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.599066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.599145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.599198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.599206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.600720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:38.600745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602253886942667:10596]
2025-10-10T14:37:38.600777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:38.600780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:38.600779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_25_4909973995709412205_v1
2025-10-10T14:37:38.600805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:38.600814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2402 reason: error at write: Disconnected sessionId: src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0
2025-10-10T14:37:38.600834Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_25_4909973995709412205_v1
2025-10-10T14:37:38.601155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:38.601171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0] Write session will restart in 0.006849s
2025-10-10T14:37:38.601196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0] Write session: Do CDS request
2025-10-10T14:37:38.601202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:38.601051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2402 sessionId: src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0 is DEAD
2025-10-10T14:37:38.608857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.608947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:38.608963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2403
2025-10-10T14:37:38.609102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.609136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:38.609147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:38.609151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:38.609620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2403 sessionId:  describe result for acl check
2025-10-10T14:37:38.609663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:38.609670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:38.609674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:38.609680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602253886942918:10601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:38.610226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602253886942918:10601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:38.613319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602253886942918:10601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:38.616859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602253886942918:10601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:38.616873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602253886942918:10601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:38.616876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602253886942918:10601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:38.616885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:38.620163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:38.622662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:38.622882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:38.622894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:38.622906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:38.622964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:38.623004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602253104711350:10905]
2025-10-10T14:37:38.623663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:38.623943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:38.623987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:38.624291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:38.624348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.624354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.624356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.624357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.624358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.624359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.624360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.624362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.624363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.624364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.624366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.624367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.624368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.624373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.624385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.624389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.624393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.624397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.624401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.624405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.624410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.624414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.624418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.624422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.624427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.624430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.624438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.624446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.624453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.624459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.624463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.624473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.624478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.624483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.624488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.624493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.624504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.624514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.624519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.624525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.624533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.624538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.624549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.624554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.624563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.624568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.624572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.624582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.624591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.624596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.624601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.624606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.624643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:38.626909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:38.627369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:38.627380Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:38.627381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:38.627384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:38.627388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2402 [2:7559602253104711350:10905]
2025-10-10T14:37:38.627398Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:38.627414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:38.627417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.627421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.627423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.627439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:38.627451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:38.627460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:38.627519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.627526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.627528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.627531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:38.627596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:38.627604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.627616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.627632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.627655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:38.627683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886943095:10601], now have 1 active actors on pipe
2025-10-10T14:37:38.627688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886942903:2438], now have 1 active actors on pipe
2025-10-10T14:37:38.627695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602253104711345:10905]
2025-10-10T14:37:38.627697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602253104711345:10905]
2025-10-10T14:37:38.627699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602253104711345:10905]
2025-10-10T14:37:38.627712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:38.627725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:38.627729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:38.627736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:38.627738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:38.627742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:38.627745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:38.627769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602253104711345:10905]
2025-10-10T14:37:38.627777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:38.627779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:38.627756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2402
2025-10-10T14:37:38.627801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.627803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2402
2025-10-10T14:37:38.627813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.627854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:38.627862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.627872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.627874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:38.627886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.627898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:38.627928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.628057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.628069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.628093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.628209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2403 partition: 0 MaxSeqNo: 40 sessionId: src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0
2025-10-10T14:37:38.628655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c453fd77-f9e5369d-d6cd02af-5da31e6f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:38.631612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0] Write session: try to update token
2025-10-10T14:37:38.631630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:38.646568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2403 sessionId: src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:38.647141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:38.647164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:38.647167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:38.647170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:38.647179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602253104711345:10905]
2025-10-10T14:37:38.647183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602253104711345:10905]
2025-10-10T14:37:38.647187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602253104711345:10905]
2025-10-10T14:37:38.647238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:38.647253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.647255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:38.647401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:38.647926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:38.647940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:38.647944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:38.649287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:38.701014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602253886943169:10596]
2025-10-10T14:37:38.701433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2402, pipe: [1:7559602253886943169:10596]
2025-10-10T14:37:38.767135Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:38.767996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.768016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.768064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886943169:10596], now have 1 active actors on pipe
2025-10-10T14:37:38.768296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:38.768875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:38.768887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0] Write session will restart in 0.009890s
2025-10-10T14:37:38.768926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0] Write session: Do CDS request
2025-10-10T14:37:38.768933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:38.768409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602253886943169:10596]
2025-10-10T14:37:38.768452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:38.768456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:38.768520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2403 reason: error at write: Disconnected sessionId: src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0
2025-10-10T14:37:38.768727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2403 sessionId: src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0 is DEAD
2025-10-10T14:37:38.768919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:38.785613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.785713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:38.785729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2404
2025-10-10T14:37:38.785900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.785944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:38.785950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:38.785956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:38.786531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2404 sessionId:  describe result for acl check
2025-10-10T14:37:38.786572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:38.786577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:38.786580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:38.786586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602253886943215:10615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:38.787165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602253886943215:10615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:38.791098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602253886943215:10615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:38.795262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602253886943215:10615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:38.795276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602253886943215:10615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:38.795279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602253886943215:10615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:38.795287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:38.803915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:38.807849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:38.808097Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:38.808110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:38.808122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:38.808183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:38.808233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602253104711599:10909]
2025-10-10T14:37:38.808896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:38.810442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:38.810533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:38.810919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:38.811020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.811029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.811030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.811032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.811033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.811035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.811036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.811037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.811040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.811041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.811043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.811044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.811045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.811054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.811069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.811073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.811079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.811083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.811087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.811091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.811096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.811100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.811105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.811109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.811114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.811118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.811128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.811138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:38.811145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.811151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:38.811157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.811163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:38.811167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.811172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:38.811178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.811183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:38.811196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.811202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:38.811211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.811216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:38.811221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.811226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:38.811231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.811237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:38.811242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.811247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:38.811252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.811256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.811261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.811271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.811276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.811286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.811329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:38.814025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:38.814849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:38.814873Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:38.814877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:38.814881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:38.814888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2403 [2:7559602253104711599:10909]
2025-10-10T14:37:38.814902Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:38.814921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:38.814925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.814929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.814931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.814949Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:38.814964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:38.814978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:38.815066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.815075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.815077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.815080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:38.815160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:38.815168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.815182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:38.815200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:38.815226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:38.815255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886943331:10615], now have 1 active actors on pipe
2025-10-10T14:37:38.815263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886943178:2438], now have 1 active actors on pipe
2025-10-10T14:37:38.815272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602253104711593:10909]
2025-10-10T14:37:38.815275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602253104711593:10909]
2025-10-10T14:37:38.815279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602253104711593:10909]
2025-10-10T14:37:38.815294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:38.815314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:38.815319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:38.815324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:38.815326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:38.815336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:38.815340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:38.815367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602253104711593:10909]
2025-10-10T14:37:38.815381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:38.815387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:38.815913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2403
2025-10-10T14:37:38.815990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2403
2025-10-10T14:37:38.816026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.816044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.816091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:38.816110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:38.816116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:38.816118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:38.816133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:38.816147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:38.816166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.816331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.816344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.816365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:38.816446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2404 partition: 0 MaxSeqNo: 40 sessionId: src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0
2025-10-10T14:37:38.816829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7020fc6-5bc23fb-a3777052-1d27c5aa_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:38.819775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0] Write session: try to update token
2025-10-10T14:37:38.819794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:38.828020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:38.828041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:38.828053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602253104711593:10909]
2025-10-10T14:37:38.828105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:38.828108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:38.828295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:38.828448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:38.828594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:38.828737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:38.828940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:38.828986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:38.835480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2404 sessionId: src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:38.838395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:38.838643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.838679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.838824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:38.838724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:38.846772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:38.846793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:38.846796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:38.846798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:38.846809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602253104711593:10909]
2025-10-10T14:37:38.846814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602253104711593:10909]
2025-10-10T14:37:38.846818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602253104711593:10909]
2025-10-10T14:37:38.846864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:38.846869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:38.846880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:38.846882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:38.846883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:38.846887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:38.847037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:38.868424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602253886943427:10596]
2025-10-10T14:37:38.868736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2403, pipe: [1:7559602253886943427:10596]
2025-10-10T14:37:38.962344Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:38.970583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:38.970620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:38.970816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.970887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.970955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.971036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.971084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.971093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.971171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.971240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.971306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.971378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.971817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.971829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.971900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.971966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.972030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.972102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.972142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.972147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.972223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.972287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.972352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.972417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.972459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.972462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.972529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.972588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.972652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.972755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.972795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.972799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.972871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.972931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.972994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.973056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.973117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.973120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.973189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.973250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.973313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.973520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.973574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.973583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.973658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.975451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:38.975465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0] Write session will restart in 0.005025s
2025-10-10T14:37:38.975491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0] Write session: Do CDS request
2025-10-10T14:37:38.975497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:38.975027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:38.975035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602253886943427:10596]
2025-10-10T14:37:38.975038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:38.975065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:38.973724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.975084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2404 reason: error at write: Disconnected sessionId: src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0
2025-10-10T14:37:38.973797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.975289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2404 sessionId: src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0 is DEAD
2025-10-10T14:37:38.973857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.973918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.973921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.973992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.974053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.974118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.974185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.974227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.974229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.974299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:38.974360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:38.974422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:38.974482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:38.974540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:38.974543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:38.974610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886943427:10596], now have 1 active actors on pipe
2025-10-10T14:37:38.975420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:38.981835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.981944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:38.981960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2405
2025-10-10T14:37:38.982098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:38.982137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:38.982150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:38.982154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:38.982593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2405 sessionId:  describe result for acl check
2025-10-10T14:37:38.982628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:38.982632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:38.982637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:38.982642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602253886943444:10619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:38.983263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602253886943444:10619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:38.986859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602253886943444:10619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:38.990794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602253886943444:10619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:38.990809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602253886943444:10619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:38.990813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602253886943444:10619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:38.990827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:38.996644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:38.999607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:38.999976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:38.999991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:39.000006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:39.000075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:39.000120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602253104711842:10911]
2025-10-10T14:37:39.000739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:39.001076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:39.001124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:39.001477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:39.001549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.001555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.001556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.001558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.001559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.001560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.001561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.001562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.001564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.001565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.001566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.001567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.001568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.001573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.001585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.001588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.001592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.001595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.001598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.001602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.001605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.001608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.001611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.001614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.001618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.001621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.001629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.001637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.001642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.001647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.001651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.001656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.001660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.001664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.001669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.001673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.001677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.001682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.001687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.001692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.001696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.001716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.001726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.001732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.001736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.001746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.001752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.001759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.001764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.001769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.001774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.001779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.001816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:39.004407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:39.005109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:39.005123Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:39.005125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:39.005129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:39.005136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2404 [2:7559602253104711842:10911]
2025-10-10T14:37:39.005148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:39.005166Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:39.005180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.005183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.005186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.005202Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:39.005211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:39.005219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:39.005279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.005286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.005288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.005291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:39.005380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:39.005389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.005402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.005414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.005435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:39.005458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886943431:2438], now have 1 active actors on pipe
2025-10-10T14:37:39.005468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602253886943571:10619], now have 1 active actors on pipe
2025-10-10T14:37:39.005475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602253104711837:10911]
2025-10-10T14:37:39.005478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602253104711837:10911]
2025-10-10T14:37:39.005480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602253104711837:10911]
2025-10-10T14:37:39.005493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:39.005509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:39.005524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:39.005527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:39.005528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:39.005532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:39.005535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:39.005554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602253104711837:10911]
2025-10-10T14:37:39.005557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:39.005560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:39.005670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2404
2025-10-10T14:37:39.005713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2404
2025-10-10T14:37:39.005780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.005797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.005833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:39.005860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.005870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.005873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:39.005886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.005917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:39.005941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.006324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.006335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.006353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.006467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2405 partition: 0 MaxSeqNo: 40 sessionId: src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0
2025-10-10T14:37:39.006891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e387bbd-3a5840d3-9ad02975-f238ecd6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:39.009631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0] Write session: try to update token
2025-10-10T14:37:39.009655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:39.017452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:39.017474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.017486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602253104711837:10911]
2025-10-10T14:37:39.017538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:39.017542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:39.017713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:39.017861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.018004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.018143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.018332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:39.018367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:39.024151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2405 sessionId: src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:39.026902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:39.027207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.027238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.027311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:39.027482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:39.035735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:39.035759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.035762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:39.035764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:39.035774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602253104711837:10911]
2025-10-10T14:37:39.035778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602253104711837:10911]
2025-10-10T14:37:39.035783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602253104711837:10911]
2025-10-10T14:37:39.035829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:39.035836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.035840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:39.035844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:39.035846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:39.035851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:39.035976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:39.075290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602258181910971:10596]
2025-10-10T14:37:39.075618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2404, pipe: [1:7559602258181910971:10596]
2025-10-10T14:37:39.150512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:39.160032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.160065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.160258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.160333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.160406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.160474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.160521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.160535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.160612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.160677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.160782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.160861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.160915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.160922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.160993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.161057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.161128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.161208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.161259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.161262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.161410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.161484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.161545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.161604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.161645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.161651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.161716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.161783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.161875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.161934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.161981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.161990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.162051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.162109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.162165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.162242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.162290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.162298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.162367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.162431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.162498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.164403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:39.164415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0] Write session will restart in 0.005496s
2025-10-10T14:37:39.164445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0] Write session: Do CDS request
2025-10-10T14:37:39.164451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:39.163924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:39.163932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:39.163951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:39.163986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2405 reason: error at write: Disconnected sessionId: src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0
2025-10-10T14:37:39.164193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602258181910971:10596]
2025-10-10T14:37:39.164228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2405 sessionId: src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0 is DEAD
2025-10-10T14:37:39.162570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.162636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.162639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.162708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.162759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.162817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.162878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.162918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.162920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.162993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.163070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.163129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.163188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.163229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.163230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.163296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.163349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.163403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.163456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.163495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.163497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.163559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181910971:10596], now have 1 active actors on pipe
2025-10-10T14:37:39.164746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:39.170920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.170970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:39.170989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2406
2025-10-10T14:37:39.171230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.171292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:39.171303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:39.171307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:39.171851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2406 sessionId:  describe result for acl check
2025-10-10T14:37:39.171891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:39.171893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:39.171895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:39.171901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602258181910986:10623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:39.172496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602258181910986:10623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:39.175206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602258181910986:10623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:39.179847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602258181910986:10623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:39.179864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602258181910986:10623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:39.179868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602258181910986:10623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:39.179877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:39.187024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:39.189630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:39.189855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:39.189867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:39.189879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:39.189940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:39.189992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602257399679384:10914]
2025-10-10T14:37:39.190593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:39.191082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:39.191130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:39.191453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:39.191517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.191524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.191525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.191526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.191528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.191529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.191530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.191531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.191532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.191533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.191535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.191536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.191538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.191544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.191556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.191561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.191565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.191569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.191573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.191577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.191581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.191586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.191590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.191594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.191598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.191602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.191610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.191619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.191626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.191631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.191638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.191643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.191647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.191653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.191658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.191663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.191668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.191674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.191684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.191690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.191699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.191704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.191708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.191718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.191722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.191733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.191737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.191742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.191747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.191756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.191761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.191766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.191806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:39.194440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:39.194787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:39.194803Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:39.194806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:39.194810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:39.194816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2405 [2:7559602257399679384:10914]
2025-10-10T14:37:39.194828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:39.194845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:39.194854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.194859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.194865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.194883Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:39.194897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:39.194905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:39.194967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.194977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.194979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.194982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:39.195062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:39.195067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.195079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.195089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.195126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:39.195154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911089:10623], now have 1 active actors on pipe
2025-10-10T14:37:39.195165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181910973:2438], now have 1 active actors on pipe
2025-10-10T14:37:39.195173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602257399679379:10914]
2025-10-10T14:37:39.195175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602257399679379:10914]
2025-10-10T14:37:39.195177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602257399679379:10914]
2025-10-10T14:37:39.195191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:39.195198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2405
2025-10-10T14:37:39.195207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:39.195209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:39.195226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:39.195228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:39.195231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2405
2025-10-10T14:37:39.195229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:39.195231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:39.195262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602257399679379:10914]
2025-10-10T14:37:39.195274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:39.195281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:39.195291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.195296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.195356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dbc09a6-66a54b5b-14459880-17523b94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:39.195369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.195374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.195381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:39.195392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.195408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:39.195430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.195609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.195618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.195633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.195728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2406 partition: 0 MaxSeqNo: 40 sessionId: src_id|7dbc09a6-66a54b5b-14459880-17523b94_0
2025-10-10T14:37:39.196129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2342a10a-ef22556c-3af593cc-2c7ee682_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7dbc09a6-66a54b5b-14459880-17523b94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:39.198867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbc09a6-66a54b5b-14459880-17523b94_0] Write session: try to update token
2025-10-10T14:37:39.198885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbc09a6-66a54b5b-14459880-17523b94_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:39.215237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:39.215259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.215262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:39.215263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:39.215275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602257399679379:10914]
2025-10-10T14:37:39.215280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602257399679379:10914]
2025-10-10T14:37:39.215284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602257399679379:10914]
2025-10-10T14:37:39.215335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:39.215352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.215355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:39.215357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:39.215383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:39.215388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:39.215504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:39.219025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2406 sessionId: src_id|7dbc09a6-66a54b5b-14459880-17523b94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:39.221810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:39.264210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602258181911221:10596]
2025-10-10T14:37:39.264627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2405, pipe: [1:7559602258181911221:10596]
2025-10-10T14:37:39.332920Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:39.333525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.333545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.333593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911221:10596], now have 1 active actors on pipe
2025-10-10T14:37:39.333826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:39.333899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:39.333913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:39.333993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2406 reason: error at write: Disconnected sessionId: src_id|7dbc09a6-66a54b5b-14459880-17523b94_0
2025-10-10T14:37:39.334185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2406 sessionId: src_id|7dbc09a6-66a54b5b-14459880-17523b94_0 is DEAD
2025-10-10T14:37:39.334364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:39.334398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602258181911221:10596]
2025-10-10T14:37:39.337588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbc09a6-66a54b5b-14459880-17523b94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:39.337599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbc09a6-66a54b5b-14459880-17523b94_0] Write session will restart in 0.006645s
2025-10-10T14:37:39.337624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbc09a6-66a54b5b-14459880-17523b94_0] Write session: Do CDS request
2025-10-10T14:37:39.337633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbc09a6-66a54b5b-14459880-17523b94_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:39.346845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbc09a6-66a54b5b-14459880-17523b94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.349661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:39.349677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2407
2025-10-10T14:37:39.349813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.349856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:39.349863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:39.349868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:39.350489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2407 sessionId:  describe result for acl check
2025-10-10T14:37:39.350532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:39.350534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:39.350536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:39.350543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602258181911296:10628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:39.351141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602258181911296:10628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:39.354388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602258181911296:10628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:39.357952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602258181911296:10628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:39.357966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602258181911296:10628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:39.357971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602258181911296:10628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:39.357980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:39.359764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:39.362729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:39.362957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:39.362968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:39.362979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:39.363042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:39.363082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602257399679641:10917]
2025-10-10T14:37:39.363714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:39.364058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:39.364099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:39.364413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:39.364468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.364472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.364473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.364474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.364476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.364477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.364478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.364479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.364480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.364481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.364483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.364484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.364485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.364490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.364503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.364507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.364510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.364514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.364518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.364522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.364525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.364529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.364533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.364537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.364541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.364544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.364553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.364560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.364567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.364572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.364579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.364583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.364588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.364593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.364598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.364603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.364608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.364613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.364617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.364621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.364625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.364631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.364635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.364640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.364643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.364648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.364658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.364663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.364668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.364676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.364681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.364691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.364729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:39.367377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:39.367734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:39.367750Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:39.367753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:39.367757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:39.367765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2406 [2:7559602257399679641:10917]
2025-10-10T14:37:39.367780Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:39.367798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:39.367802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.367806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.367811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.367830Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:39.367843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:39.367856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:39.367926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.367935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.367938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.367941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:39.368095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:39.368105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.368117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.368133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.368155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:39.368165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2406
2025-10-10T14:37:39.368187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2406
2025-10-10T14:37:39.368184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911469:10628], now have 1 active actors on pipe
2025-10-10T14:37:39.368195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911234:2438], now have 1 active actors on pipe
2025-10-10T14:37:39.368204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602257399679636:10917]
2025-10-10T14:37:39.368207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602257399679636:10917]
2025-10-10T14:37:39.368209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602257399679636:10917]
2025-10-10T14:37:39.368221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:39.368230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:39.368233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:39.368235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:39.368237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:39.368257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:39.368262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:39.368284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.368289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.368329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602257399679636:10917]
2025-10-10T14:37:39.368346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:39.368363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:39.368367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:39.368375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.368384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.368386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:39.368400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.368417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:39.368463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.368656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.368670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.368694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.368811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2407 partition: 0 MaxSeqNo: 40 sessionId: src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0
2025-10-10T14:37:39.369224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dbc09a6-66a54b5b-14459880-17523b94_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:39.372005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0] Write session: try to update token
2025-10-10T14:37:39.372025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:39.390873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:39.390897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.390900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:39.390903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:39.390914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602257399679636:10917]
2025-10-10T14:37:39.390919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602257399679636:10917]
2025-10-10T14:37:39.390923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602257399679636:10917]
2025-10-10T14:37:39.390978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:39.390987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.390990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:39.390967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2407 sessionId: src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:39.391020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:39.391026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:39.391030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:39.391156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:39.393708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:39.434665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602258181911483:10596]
2025-10-10T14:37:39.435123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2406, pipe: [1:7559602258181911483:10596]
2025-10-10T14:37:39.511773Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:39.512085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.512103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.512149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911483:10596], now have 1 active actors on pipe
2025-10-10T14:37:39.512523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:39.512751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:39.512839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2407 reason: status is not ok: tablet will be restarted right now sessionId: src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0
2025-10-10T14:37:39.512923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602258181911483:10596]
2025-10-10T14:37:39.512404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:39.513056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2407 sessionId: src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0 is DEAD
2025-10-10T14:37:39.513253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:39.513265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0] Write session will restart in 0.005202s
2025-10-10T14:37:39.513292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0] Write session: Do CDS request
2025-10-10T14:37:39.513298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:39.521862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.523259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:39.523276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2408
2025-10-10T14:37:39.523450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.523508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:39.523532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:39.523538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:39.524666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2408 sessionId:  describe result for acl check
2025-10-10T14:37:39.524716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:39.524718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:39.524720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:39.524727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602258181911525:10632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:39.525355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602258181911525:10632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:39.528672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602258181911525:10632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:39.533127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602258181911525:10632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:39.533145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602258181911525:10632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:39.533149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602258181911525:10632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:39.533159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:39.536782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:39.540042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:39.540330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:39.540336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:39.540350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:39.540422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:39.540468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602257399679887:10919]
2025-10-10T14:37:39.541154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:39.541614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:39.541695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:39.542055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:39.542134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.542135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.542137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.542139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.542140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.542141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.542143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.542144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.542145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.542147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.542148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.542149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.542151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.542158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.542172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.542177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.542181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.542185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.542189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.542193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.542196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.542200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.542205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.542209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.542213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.542217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.542229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.542239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.542246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.542253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.542259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.542265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.542270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.542276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.542281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.542286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.542291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.542296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.542301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.542305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.542312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.542318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.542323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.542329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.542334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.542339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.542344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.542368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.542376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.542382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.542387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.542392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.542439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:39.545077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:39.545459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:39.545478Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:39.545481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:39.545485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:39.545492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2407 [2:7559602257399679887:10919]
2025-10-10T14:37:39.545507Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:39.545526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:39.545529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.545534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.545537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.545554Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:39.545563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:39.545571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:39.545638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.545646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.545649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.545651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:39.545855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2407
2025-10-10T14:37:39.545909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2407
2025-10-10T14:37:39.545718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:39.545728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.545740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.545750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.545766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:39.545788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911484:2438], now have 1 active actors on pipe
2025-10-10T14:37:39.545792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911677:10632], now have 1 active actors on pipe
2025-10-10T14:37:39.545800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602257399679882:10919]
2025-10-10T14:37:39.545803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602257399679882:10919]
2025-10-10T14:37:39.545805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602257399679882:10919]
2025-10-10T14:37:39.545819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:39.545832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:39.545833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:39.545835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:39.545837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:39.545851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:39.545854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:39.545881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602257399679882:10919]
2025-10-10T14:37:39.545887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:39.545894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:39.546150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.546164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.546197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:39.546213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.546218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.546220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:39.546233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.546249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:39.546268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.546823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.546846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.546863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.547088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2408 partition: 0 MaxSeqNo: 40 sessionId: src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0
2025-10-10T14:37:39.547560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|653c3e9c-c9b41be1-ac844ab1-a8138151_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:39.550487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0] Write session: try to update token
2025-10-10T14:37:39.550512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:39.565313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2408 sessionId: src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:39.568029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:39.568620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.568646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.568670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:39.568674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.568679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:39.568682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:39.568690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602257399679882:10919]
2025-10-10T14:37:39.568699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602257399679882:10919]
2025-10-10T14:37:39.568703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602257399679882:10919]
2025-10-10T14:37:39.568746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:39.568763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:39.568771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.568774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:39.568778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:39.568778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:39.568922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:39.612872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602258181911735:10596]
2025-10-10T14:37:39.613059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2407, pipe: [1:7559602258181911735:10596]
2025-10-10T14:37:39.686906Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:39.687389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:39.687454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911735:10596], now have 1 active actors on pipe
2025-10-10T14:37:39.687563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:39.699648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602258181911735:10596]
2025-10-10T14:37:39.699679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:39.699781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:39.699790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:39.699818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2408 reason: error at write: Disconnected sessionId: src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0
2025-10-10T14:37:39.699974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2408 sessionId: src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0 is DEAD
2025-10-10T14:37:39.701539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:39.701550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0] Write session will restart in 0.009653s
2025-10-10T14:37:39.701574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0] Write session: Do CDS request
2025-10-10T14:37:39.701581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:39.713811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.716115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:39.716135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2409
2025-10-10T14:37:39.716281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.716319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:39.716325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:39.716329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:39.716797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2409 sessionId:  describe result for acl check
2025-10-10T14:37:39.716837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:39.716845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:39.716847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:39.716856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602258181911824:10642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:39.717457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602258181911824:10642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:39.720934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602258181911824:10642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:39.724395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602258181911824:10642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:39.724412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602258181911824:10642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:39.724415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602258181911824:10642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:39.724424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:39.726384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:39.729846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:39.730101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:39.730112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:39.730126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:39.730189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:39.730231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602257399680174:10932]
2025-10-10T14:37:39.730864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:39.731274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:39.731341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:39.731744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:39.731808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.731813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.731814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.731815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.731816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.731816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.731817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.731818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.731819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.731820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.731821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.731822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.731823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.731827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.731836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.731838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.731841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.731843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.731845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.731849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.731852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.731865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.731869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.731872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.731876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.731881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.731889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.731898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.731905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.731911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.731915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.731920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.731923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.731928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.731933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.731938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.731942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.731947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.731952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.731957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.731961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.731967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.731972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.731977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.731988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.731994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.732012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.732017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.732022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.732027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.732034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.732044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.732085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:39.735189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:39.735839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:39.735854Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:39.735857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:39.735862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:39.735870Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2408 [2:7559602257399680174:10932]
2025-10-10T14:37:39.735885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:39.735909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:39.735917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.735921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.735924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.735944Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:39.735957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:39.735970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:39.736046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.736055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.736057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.736060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:39.736135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:39.736144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.736158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.736177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.736201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:39.736229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911998:10642], now have 1 active actors on pipe
2025-10-10T14:37:39.736238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181911761:2438], now have 1 active actors on pipe
2025-10-10T14:37:39.736246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602257399680169:10932]
2025-10-10T14:37:39.736253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602257399680169:10932]
2025-10-10T14:37:39.736256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602257399680169:10932]
2025-10-10T14:37:39.736271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:39.736288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:39.736291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:39.736294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:39.736297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:39.736312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:39.736317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:39.736296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2408
2025-10-10T14:37:39.736331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2408
2025-10-10T14:37:39.736355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602257399680169:10932]
2025-10-10T14:37:39.736369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:39.736378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:39.736422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.736433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.736468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:39.736480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.736486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.736489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:39.736500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.736517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:39.736537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.736744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.736755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.736779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.736890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2409 partition: 0 MaxSeqNo: 40 sessionId: src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0
2025-10-10T14:37:39.737365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2dda92a3-30f65424-6dfa98a4-986adce5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:39.740146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0] Write session: try to update token
2025-10-10T14:37:39.740164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:39.754954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:39.754978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.755004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602257399680169:10932]
2025-10-10T14:37:39.755055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:39.755060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:39.755247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:39.755414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.755558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.755698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.755900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:39.755939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:39.757524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2409 sessionId: src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:39.760341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:39.760577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.760602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.760657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:39.760727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:39.773503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:39.773523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.773526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:39.773528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:39.773540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602257399680169:10932]
2025-10-10T14:37:39.773543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602257399680169:10932]
2025-10-10T14:37:39.773547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602257399680169:10932]
2025-10-10T14:37:39.773594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:39.773596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:39.773602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:39.773604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.773607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:39.773607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:39.773738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:39.799775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602258181912019:10596]
2025-10-10T14:37:39.800261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2408, pipe: [1:7559602258181912019:10596]
2025-10-10T14:37:39.888596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:39.897842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.897878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.898076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.898139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.898201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.898264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.898310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.898315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.898398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.898460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.898518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.898587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.898634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.898638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.898722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.898779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.898842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.898911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.898950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.898953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.899035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.899104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.899168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.899226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.899269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.899273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.899348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.899409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.899473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.899535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.899580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.899583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.899659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.899716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.899775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.899842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.899887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.899890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.899964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.900023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.900085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.900147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.900191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.900194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.900264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.900321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.900385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.900450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.900492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.900498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.900572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.900631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.900692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.900761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.900801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.900804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.900875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:39.900940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:39.901007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:39.901076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:39.901121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:39.901124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:39.901207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181912019:10596], now have 1 active actors on pipe
2025-10-10T14:37:39.901885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:39.901910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602258181912019:10596]
2025-10-10T14:37:39.901957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:39.901960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:39.901990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2409 reason: error at write: Disconnected sessionId: src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0
2025-10-10T14:37:39.902220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2409 sessionId: src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0 is DEAD
2025-10-10T14:37:39.902229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:39.905793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:39.905808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0] Write session will restart in 0.008887s
2025-10-10T14:37:39.905835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0] Write session: Do CDS request
2025-10-10T14:37:39.905842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:39.915949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.917675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:39.917692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2410
2025-10-10T14:37:39.917955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:39.917994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:39.918005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:39.918009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:39.918499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2410 sessionId:  describe result for acl check
2025-10-10T14:37:39.918539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:39.918547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:39.918549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:39.918555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602258181912074:10650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:39.919145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602258181912074:10650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:39.930197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602258181912074:10650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:39.933610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:39.934026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602258181912074:10650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:39.934044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602258181912074:10650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:39.934049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602258181912074:10650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:39.934058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:39.936900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:39.937164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:39.937169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:39.937182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:39.937241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:39.937281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602257399680422:10936]
2025-10-10T14:37:39.937987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:39.938695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:39.938762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:39.939130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:39.939203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.939216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.939218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.939219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.939221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.939222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.939224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.939225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.939226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.939227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.939229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.939230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.939232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.939238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.939253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.939256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.939260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.939263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.939267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.939270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.939274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.939278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.939282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.939285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.939289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.939293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.939302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.939310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:39.939317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.939323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:39.939328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.939334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:39.939354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.939365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:39.939369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.939374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:39.939378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.939383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:39.939387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.939392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:39.939397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.939402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:39.939409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.939420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:39.939424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.939429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:39.939442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.939447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.939451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.939456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.939461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.939466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.939509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:39.942354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:39.943123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:39.943140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:39.943142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:39.943147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:39.943154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2409 [2:7559602257399680422:10936]
2025-10-10T14:37:39.943169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:39.943189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:39.943198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.943202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.943205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.943224Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:39.943238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:39.943246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:39.943316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.943323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.943325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.943328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:39.943403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:39.943411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.943426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:39.943443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:39.943462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:39.943498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602257399680416:10936]
2025-10-10T14:37:39.943506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602257399680416:10936]
2025-10-10T14:37:39.943508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602257399680416:10936]
2025-10-10T14:37:39.943523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:39.943544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:39.943565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:39.943572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:39.943582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:39.943586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:39.943589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:39.943609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602257399680416:10936]
2025-10-10T14:37:39.943613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:39.943664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:39.943725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181912025:2438], now have 1 active actors on pipe
2025-10-10T14:37:39.943741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602258181912265:10650], now have 1 active actors on pipe
2025-10-10T14:37:39.943928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2409
2025-10-10T14:37:39.943985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2409
2025-10-10T14:37:39.944208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.944224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.944257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:39.944277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:39.944282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:39.944285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:39.944298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:39.944311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:39.944328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.944586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.944591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.944609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:39.944730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2410 partition: 0 MaxSeqNo: 40 sessionId: src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0
2025-10-10T14:37:39.945150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c054eb4-1ff2145e-97f0b2a5-571be1b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:39.947928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0] Write session: try to update token
2025-10-10T14:37:39.947948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:39.957074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:39.957095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.957106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602257399680416:10936]
2025-10-10T14:37:39.957159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:39.957370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:39.957508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.957644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.957778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:39.957965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:39.958008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:39.958225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:39.970621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2410 sessionId: src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:39.973248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:39.973606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:39.973634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:39.973685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:39.974208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:39.980569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:39.980595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:39.980599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:39.980601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:39.980613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602257399680416:10936]
2025-10-10T14:37:39.980618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602257399680416:10936]
2025-10-10T14:37:39.980622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602257399680416:10936]
2025-10-10T14:37:39.980675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:39.980687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:39.980689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:39.980718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:39.980724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:39.980728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:39.980831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:40.001514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602262476879572:10596]
2025-10-10T14:37:40.003266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2409, pipe: [1:7559602262476879572:10596]
2025-10-10T14:37:40.100018Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:40.109644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.109678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.109886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.109958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.110030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.110100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.110149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.110154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.110231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.110295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.110371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.110443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.110495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.110500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.110575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.110642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.110723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.110797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.110845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.110848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.110932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.111020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.111087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.111157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.111200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.111203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.111284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.111353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.111416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.111478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.111524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.111527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.111598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.111664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.111729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.111796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.111840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.111843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.111917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.111980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.112047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.112109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.112158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.112161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.112233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.112292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.112359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.112426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.112475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.112478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.112556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.112620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.112688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.112754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.112827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.112830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.112901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.112959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.113018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.113081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.113125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.113128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.113207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476879572:10596], now have 1 active actors on pipe
2025-10-10T14:37:40.113626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602262476879572:10596]
2025-10-10T14:37:40.113672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:40.113685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:40.113689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:40.113730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2410 reason: error at write: Disconnected sessionId: src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0
2025-10-10T14:37:40.113959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2410 sessionId: src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0 is DEAD
2025-10-10T14:37:40.114098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:40.114110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0] Write session will restart in 0.006846s
2025-10-10T14:37:40.114136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0] Write session: Do CDS request
2025-10-10T14:37:40.114142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:40.114858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:40.122024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.122081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:40.122097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2411
2025-10-10T14:37:40.122285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.122345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:40.122358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:40.122362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:40.122913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2411 sessionId:  describe result for acl check
2025-10-10T14:37:40.122953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:40.122955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:40.122957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:40.122964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602262476879587:10654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:40.123547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602262476879587:10654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:40.126514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602262476879587:10654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:40.132138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602262476879587:10654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:40.132155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602262476879587:10654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:40.132159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602262476879587:10654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:40.132168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:40.141306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:40.144533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:40.144803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:40.144819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:40.144834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:40.144905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:40.144956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602261694647969:10939]
2025-10-10T14:37:40.145617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:40.146159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:40.146219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:40.146555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:40.146635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.146648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.146649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.146650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.146652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.146653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.146654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.146655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.146657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.146658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.146659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.146661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.146662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.146669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.146684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.146689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.146694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.146698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.146703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.146707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.146710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.146715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.146719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.146723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.146727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.146731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.146741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.146750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.146757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.146763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.146769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.146774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.146779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.146793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.146798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.146804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.146809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.146815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.146819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.146825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.146829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.146833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.146838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.146843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.146847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.146852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.146857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.146863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.146868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.146874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.146879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.146884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.146924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:40.149608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:40.150011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:40.150027Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:40.150030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:40.150034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:40.150041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2410 [2:7559602261694647969:10939]
2025-10-10T14:37:40.150055Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:40.150074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:40.150083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.150086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.150089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.150107Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:40.150121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:40.150130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:40.150193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.150200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.150202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.150205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:40.150288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:40.150298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.150310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.150321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.150338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:40.150375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476879693:10654], now have 1 active actors on pipe
2025-10-10T14:37:40.150383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476879575:2438], now have 1 active actors on pipe
2025-10-10T14:37:40.150391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602261694647964:10939]
2025-10-10T14:37:40.150394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602261694647964:10939]
2025-10-10T14:37:40.150396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602261694647964:10939]
2025-10-10T14:37:40.150410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:40.150428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:40.150435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:40.150438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:40.150440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:40.150448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:40.150451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:40.150441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2410
2025-10-10T14:37:40.150446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2410
2025-10-10T14:37:40.150477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602261694647964:10939]
2025-10-10T14:37:40.150486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:40.150488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:40.150508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.150514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.150562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:40.150574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.150578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.150585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:40.150596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.150612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:40.150633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.150973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.150995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.151013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.151115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2411 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0
2025-10-10T14:37:40.151529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877033ba-ec79e34c-bc44aa41-a4c99ede_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:40.154248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0] Write session: try to update token
2025-10-10T14:37:40.154268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:40.175346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:40.175371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:40.175374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:40.175376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:40.175385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602261694647964:10939]
2025-10-10T14:37:40.175390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602261694647964:10939]
2025-10-10T14:37:40.175394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602261694647964:10939]
2025-10-10T14:37:40.175446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:40.175453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:40.175459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.175460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:40.175461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:40.175465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:40.175599Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:40.176749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2411 sessionId: src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:40.179711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:40.215101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602262476879828:10596]
2025-10-10T14:37:40.215639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2410, pipe: [1:7559602262476879828:10596]
2025-10-10T14:37:40.293029Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:40.293582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.293601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.293648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476879828:10596], now have 1 active actors on pipe
2025-10-10T14:37:40.294024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:40.294513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:40.294607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2411 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0
2025-10-10T14:37:40.294822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2411 sessionId: src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0 is DEAD
2025-10-10T14:37:40.294958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602262476879828:10596]
2025-10-10T14:37:40.294972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:40.297042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:40.297050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0] Write session will restart in 0.005098s
2025-10-10T14:37:40.297076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0] Write session: Do CDS request
2025-10-10T14:37:40.297082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:40.305997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.306569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:40.306584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2412
2025-10-10T14:37:40.306707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.306753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:40.306763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:40.306768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:40.307580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2412 sessionId:  describe result for acl check
2025-10-10T14:37:40.307619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:40.307626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:40.307628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:40.307634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602262476879857:10659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:40.308206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602262476879857:10659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:40.310785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602262476879857:10659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:40.314665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602262476879857:10659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:40.314679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602262476879857:10659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:40.314682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602262476879857:10659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:40.314691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:40.327789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:40.330899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:40.331172Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:40.331183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:40.331196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:40.331256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:40.331306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602261694648231:10942]
2025-10-10T14:37:40.331967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:40.332343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:40.332420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:40.332798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:40.332865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.332872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.332874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.332875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.332876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.332877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.332879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.332881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.332882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.332883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.332884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.332886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.332887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.332895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.332910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.332915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.332920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.332923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.332928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.332933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.332938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.332942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.332947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.332951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.332956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.332960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.332971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.332981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.332989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.333002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.333008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.333014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.333019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.333026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.333031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.333038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.333042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.333050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.333056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.333062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.333067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.333073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.333078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.333085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.333089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.333095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.333101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.333106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.333112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.333117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.333123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.333136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.333181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:40.336601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:40.336929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:40.336946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:40.336949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:40.336953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:40.336961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2411 [2:7559602261694648231:10942]
2025-10-10T14:37:40.336977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:40.336997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:40.337006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.337010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.337013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.337034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:40.337046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:40.337061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:40.337130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.337133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.337135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.337138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:40.337216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:40.337219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.337233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.337248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.337267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:40.337289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602261694648226:10942]
2025-10-10T14:37:40.337292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602261694648226:10942]
2025-10-10T14:37:40.337295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602261694648226:10942]
2025-10-10T14:37:40.337310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:40.337325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:40.337393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:40.337397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:40.337435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602261694648226:10942]
2025-10-10T14:37:40.337439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:40.337535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:40.337545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:40.337548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:40.337554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:40.337862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2411
2025-10-10T14:37:40.337897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2411
2025-10-10T14:37:40.338068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476879942:10659], now have 1 active actors on pipe
2025-10-10T14:37:40.338079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476879842:2438], now have 1 active actors on pipe
2025-10-10T14:37:40.338444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.338462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.338502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4cb220a-8095c669-c6292a4d-908d4820_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:40.338518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.338523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.338526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:40.338543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.338556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:40.338580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.344437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.344458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.344508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.344659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2412 partition: 0 MaxSeqNo: 40 sessionId: src_id|e4cb220a-8095c669-c6292a4d-908d4820_0
2025-10-10T14:37:40.345126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d416db4-a821ff8a-d10f37f1-1a5f3f2f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e4cb220a-8095c669-c6292a4d-908d4820_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:40.348025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cb220a-8095c669-c6292a4d-908d4820_0] Write session: try to update token
2025-10-10T14:37:40.348046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cb220a-8095c669-c6292a4d-908d4820_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:40.352266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:40.352288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:40.352299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602261694648226:10942]
2025-10-10T14:37:40.352352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:40.352353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:40.352531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:40.352677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:40.352814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:40.352954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:40.353156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:40.353202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:40.365882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2412 sessionId: src_id|e4cb220a-8095c669-c6292a4d-908d4820_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:40.368542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:40.369018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.369045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.369103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:40.370176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:40.372181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:40.372207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:40.372210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:40.372213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:40.372224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602261694648226:10942]
2025-10-10T14:37:40.372228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602261694648226:10942]
2025-10-10T14:37:40.372233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602261694648226:10942]
2025-10-10T14:37:40.372287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:40.372292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:40.372299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:40.372301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.372304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:40.372304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:40.372447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:40.397472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602262476880096:10596]
2025-10-10T14:37:40.397902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2411, pipe: [1:7559602262476880096:10596]
2025-10-10T14:37:40.495487Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:40.504728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.504771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.504975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.505053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.505116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.505180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.505223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.505229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.505307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.505419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.505497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.505572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.505631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.505645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.505717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.505781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.505855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.505921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.505967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.505975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.506044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.506112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.506181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.506256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.506301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.506309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.506375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.508869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602262476880096:10596]
2025-10-10T14:37:40.508910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:40.508951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:40.508954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:40.508990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2412 reason: error at write: Disconnected sessionId: src_id|e4cb220a-8095c669-c6292a4d-908d4820_0
2025-10-10T14:37:40.506436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.506507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.506569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.506610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.506614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.506685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.506751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.506814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.506880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.506929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.506933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.507020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.507081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.507145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.507209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.507257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.507260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.507328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.507383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.507446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.507509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.507553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.507556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.507626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.507684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.507746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.507808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.507855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.507859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.507931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:40.507991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:40.508055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:40.508115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:40.508160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:40.508163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:40.508254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880096:10596], now have 1 active actors on pipe
2025-10-10T14:37:40.509192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2412 sessionId: src_id|e4cb220a-8095c669-c6292a4d-908d4820_0 is DEAD
2025-10-10T14:37:40.509793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:40.513536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cb220a-8095c669-c6292a4d-908d4820_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:40.513559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cb220a-8095c669-c6292a4d-908d4820_0] Write session will restart in 0.005653s
2025-10-10T14:37:40.513591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cb220a-8095c669-c6292a4d-908d4820_0] Write session: Do CDS request
2025-10-10T14:37:40.513598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cb220a-8095c669-c6292a4d-908d4820_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:40.520947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cb220a-8095c669-c6292a4d-908d4820_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.521654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:40.521670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2413
2025-10-10T14:37:40.523925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.523990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:40.524002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:40.524007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:40.524516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2413 sessionId:  describe result for acl check
2025-10-10T14:37:40.524556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:40.524567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:40.524569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:40.524576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602262476880120:10663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:40.525192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602262476880120:10663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:40.529864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602262476880120:10663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:40.536667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602262476880120:10663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:40.536685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602262476880120:10663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:40.536689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602262476880120:10663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:40.536700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:40.542498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:40.545952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:40.546223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:40.546242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:40.546257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:40.546332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:40.546395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602261694648482:10944]
2025-10-10T14:37:40.547071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:40.547516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:40.547587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:40.547945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:40.548025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.548033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.548034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.548035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.548037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.548038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.548040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.548041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.548043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.548044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.548046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.548047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.548048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.548056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.548069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.548074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.548079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.548083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.548087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.548091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.548095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.548100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.548105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.548116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.548120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.548125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.548134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.548149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.548156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.548167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.548173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.548183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.548188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.548194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.548204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.548210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.548220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.548226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.548236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.548242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.548252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.548258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.548264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.548270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.548276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.548283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.548294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.548302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.548311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.548317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.548322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.548327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.548372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:40.551044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:40.551368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:40.551381Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:40.551383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:40.551388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:40.551394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2412 [2:7559602261694648482:10944]
2025-10-10T14:37:40.551407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:40.551426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:40.551434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.551437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.551440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.551458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:40.551481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:40.551488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:40.551551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.551560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.551562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.551565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:40.551635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:40.551642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.551653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.551667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.551687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:40.551715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880098:2438], now have 1 active actors on pipe
2025-10-10T14:37:40.551723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880286:10663], now have 1 active actors on pipe
2025-10-10T14:37:40.551731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602261694648477:10944]
2025-10-10T14:37:40.551738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602261694648477:10944]
2025-10-10T14:37:40.551740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602261694648477:10944]
2025-10-10T14:37:40.551755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:40.551776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:40.551792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:40.551796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:40.551827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602261694648477:10944]
2025-10-10T14:37:40.551837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:40.551809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2412
2025-10-10T14:37:40.551847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2412
2025-10-10T14:37:40.551893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:40.551905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:40.551910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:40.551918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:40.552329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.552345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.552392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:40.552409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.552414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.552418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:40.552431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.552450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:40.552467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.552684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.552695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.552714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.552825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2413 partition: 0 MaxSeqNo: 40 sessionId: src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0
2025-10-10T14:37:40.553435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4cb220a-8095c669-c6292a4d-908d4820_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:40.556024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0] Write session: try to update token
2025-10-10T14:37:40.556038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:40.575688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:40.575707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:40.575711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:40.575713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:40.575723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602261694648477:10944]
2025-10-10T14:37:40.575736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602261694648477:10944]
2025-10-10T14:37:40.575740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602261694648477:10944]
2025-10-10T14:37:40.575792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:40.575799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.575802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:40.575801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:40.575809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:40.575812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:40.575957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:40.576899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2413 sessionId: src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:40.579738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:40.609357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602262476880359:10596]
2025-10-10T14:37:40.620059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2412, pipe: [1:7559602262476880359:10596]
2025-10-10T14:37:40.694760Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:40.695530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.695550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.695602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880359:10596], now have 1 active actors on pipe
2025-10-10T14:37:40.695956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:40.695960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602262476880359:10596]
2025-10-10T14:37:40.695994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:40.695997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:40.696465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:40.696477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0] Write session will restart in 0.007293s
2025-10-10T14:37:40.696052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:40.696503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0] Write session: Do CDS request
2025-10-10T14:37:40.696519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:40.696077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2413 reason: error at write: Disconnected sessionId: src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0
2025-10-10T14:37:40.696290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2413 sessionId: src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0 is DEAD
2025-10-10T14:37:40.705031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.705089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:40.705107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2414
2025-10-10T14:37:40.705252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.705292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:40.705307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:40.705311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:40.705852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2414 sessionId:  describe result for acl check
2025-10-10T14:37:40.705892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:40.705900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:40.705902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:40.705909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602262476880379:10667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:40.706483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602262476880379:10667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:40.710413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602262476880379:10667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:40.714667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602262476880379:10667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:40.714681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602262476880379:10667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:40.714685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602262476880379:10667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:40.714694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:40.718893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:40.722261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:40.722515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:40.722528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:40.722543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:40.722625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:40.722669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602261694648767:10957]
2025-10-10T14:37:40.723364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:40.723744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:40.723802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:40.724182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:40.724251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.724261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.724263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.724264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.724266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.724268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.724269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.724271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.724273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.724274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.724276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.724277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.724279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.724286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.724299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.724304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.724309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.724313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.724318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.724323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.724327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.724332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.724337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.724342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.724347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.724351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.724360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.724369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.724376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.724383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.724388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.724394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.724399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.724413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.724419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.724430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.724435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.724446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.724451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.724463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.724472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.724478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.724488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.724495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.724518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.724528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.724534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.724540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.724545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.724551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.724556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.724562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.724618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:40.727910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:40.728267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:40.728283Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:40.728287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:40.728291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:40.728299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2413 [2:7559602261694648767:10957]
2025-10-10T14:37:40.728314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:40.728346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:40.728355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.728359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.728363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.728380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:40.728394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:40.728403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:40.728481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.728490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.728493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.728496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:40.728575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:40.728586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.728599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.728614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.728637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:40.728667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880517:10667], now have 1 active actors on pipe
2025-10-10T14:37:40.728676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880364:2438], now have 1 active actors on pipe
2025-10-10T14:37:40.728684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602261694648760:10957]
2025-10-10T14:37:40.728692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602261694648760:10957]
2025-10-10T14:37:40.728694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602261694648760:10957]
2025-10-10T14:37:40.728709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:40.728729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:40.728728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:40.728732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:40.728734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:40.728753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:40.728756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:40.728789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602261694648760:10957]
2025-10-10T14:37:40.728797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:40.728803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:40.729752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.729769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.729811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:40.729826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.729836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.729839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:40.729852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.729867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:40.729890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.731446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.731461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.731488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.729420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2413
2025-10-10T14:37:40.729453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2413
2025-10-10T14:37:40.734093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d3d5df-8dec7d1-2d1119f4-d278c3d1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:40.733670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2414 partition: 0 MaxSeqNo: 40 sessionId: src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0
2025-10-10T14:37:40.736902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0] Write session: try to update token
2025-10-10T14:37:40.736919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:40.751544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:40.751569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:40.751573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:40.751575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:40.751586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602261694648760:10957]
2025-10-10T14:37:40.751590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602261694648760:10957]
2025-10-10T14:37:40.751594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602261694648760:10957]
2025-10-10T14:37:40.751645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:40.751655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.751654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:40.751657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:40.751663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:40.751668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:40.751818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:40.757223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2414 sessionId: src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:40.759904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:40.796102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602262476880645:10596]
2025-10-10T14:37:40.796440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2413, pipe: [1:7559602262476880645:10596]
2025-10-10T14:37:40.873644Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:40.874424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.874447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.874802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602262476880645:10596]
2025-10-10T14:37:40.874838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:40.874839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:40.874843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:40.874913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2414 reason: error at write: Disconnected sessionId: src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0
2025-10-10T14:37:40.874499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880645:10596], now have 1 active actors on pipe
2025-10-10T14:37:40.874796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:40.875152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2414 sessionId: src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0 is DEAD
2025-10-10T14:37:40.877591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:40.877604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0] Write session will restart in 0.006513s
2025-10-10T14:37:40.877631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0] Write session: Do CDS request
2025-10-10T14:37:40.877640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:40.886288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.887123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:40.887137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2415
2025-10-10T14:37:40.887237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:40.887267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:40.887273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:40.887277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:40.888172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2415 sessionId:  describe result for acl check
2025-10-10T14:37:40.888213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:40.888215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:40.888217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:40.888225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602262476880676:10681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:40.888848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602262476880676:10681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:40.899245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602262476880676:10681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:40.906631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602262476880676:10681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:40.906651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602262476880676:10681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:40.906655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602262476880676:10681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:40.906665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:40.917442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:40.922087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:40.922404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:40.922410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:40.922424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:40.922507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:40.922551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602261694649027:10961]
2025-10-10T14:37:40.923231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:40.923719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:40.923821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:40.924260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:40.924354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.924365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.924367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.924368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.924370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.924372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.924374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.924375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.924377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.924380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.924382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.924383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.924384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.924393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.924408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.924412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.924417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.924421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.924426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.924430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.924435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.924440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.924445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.924449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.924453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.924457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.924468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.924485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:40.924499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.924505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:40.924511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.924518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:40.924523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.924530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:40.924536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.924543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:40.924548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.924559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:40.924565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.924571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:40.924581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.924588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:40.924614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.924625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:40.924631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.924637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:40.924643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.924649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.924654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.924660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.924666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.924672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.924725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:40.927642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:40.928140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:40.928159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:40.928162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:40.928167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:40.928175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2414 [2:7559602261694649027:10961]
2025-10-10T14:37:40.928191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:40.928213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:40.928222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.928226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.928229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.928250Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:40.928264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:40.928293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:40.928387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.928396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.928399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.928402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:40.928553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:40.928566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.928582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:40.928596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:40.928617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:40.928624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2414
2025-10-10T14:37:40.928664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2414
2025-10-10T14:37:40.928641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880846:10681], now have 1 active actors on pipe
2025-10-10T14:37:40.928652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880651:2438], now have 1 active actors on pipe
2025-10-10T14:37:40.928661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602261694649021:10961]
2025-10-10T14:37:40.928664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602261694649021:10961]
2025-10-10T14:37:40.928666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602261694649021:10961]
2025-10-10T14:37:40.928676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:40.928688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:40.928691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:40.928693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:40.928696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:40.928709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:40.928713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:40.928733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.928757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.928803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602261694649021:10961]
2025-10-10T14:37:40.928827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:40.928833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:40.928861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:40.928874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:40.928878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:40.928882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:40.928894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:40.928907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:40.928952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.929260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.929270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.929290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:40.929433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2415 partition: 0 MaxSeqNo: 40 sessionId: src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0
2025-10-10T14:37:40.929861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32bf3bcc-a9de0266-5c2bb3f0-9e7eef67_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:40.932965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0] Write session: try to update token
2025-10-10T14:37:40.932988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:40.951941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2415 sessionId: src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:40.954802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:40.955968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:40.956005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:40.956031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:40.956034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:40.956038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:40.956041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:40.956050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602261694649021:10961]
2025-10-10T14:37:40.956055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602261694649021:10961]
2025-10-10T14:37:40.956060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602261694649021:10961]
2025-10-10T14:37:40.956117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:40.956122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:40.956130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:40.956132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:40.956135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:40.956143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:40.956263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:40.974299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602262476880907:10596]
2025-10-10T14:37:40.974623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2414, pipe: [1:7559602262476880907:10596]
2025-10-10T14:37:41.072924Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:41.073732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:41.073807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602262476880907:10596], now have 1 active actors on pipe
2025-10-10T14:37:41.073899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:41.074401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602262476880907:10596]
2025-10-10T14:37:41.074435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:41.087235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:41.087249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:41.087280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2415 reason: error at write: Disconnected sessionId: src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0
2025-10-10T14:37:41.087611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:41.087633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0] Write session will restart in 0.009802s
2025-10-10T14:37:41.087661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0] Write session: Do CDS request
2025-10-10T14:37:41.087668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:41.087434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2415 sessionId: src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0 is DEAD
2025-10-10T14:37:41.102056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.102222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:41.102242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2416
2025-10-10T14:37:41.102378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.102413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:41.102426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:41.102431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:41.102946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2416 sessionId:  describe result for acl check
2025-10-10T14:37:41.102998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:41.103008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:41.103010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:41.103017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602266771848238:10685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:41.103610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602266771848238:10685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:41.109813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602266771848238:10685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:41.115436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602266771848238:10685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:41.115456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602266771848238:10685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:41.115460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602266771848238:10685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:41.115480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:41.118110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:41.122106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:41.122416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:41.122431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:41.122448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:41.122524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:41.122590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602265989616579:10963]
2025-10-10T14:37:41.123281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:41.123662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:41.123758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:41.124110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:41.124173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.124183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.124185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.124186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.124188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.124189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.124191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.124192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.124194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.124195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.124196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.124198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.124199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.124206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.124218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.124223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.124227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.124230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.124234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.124239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.124243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.124247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.124252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.124256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.124260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.124264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.124273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.124283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.124289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.124296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.124300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.124306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.124310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.124316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.124320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.124324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.124328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.124333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.124337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.124342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.124358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.124364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.124369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.124377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.124381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.124387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.124392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.124398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.124402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.124407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.124415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.124420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.124463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:41.127790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:41.128605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:41.128620Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:41.128622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:41.128626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:41.128633Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2415 [2:7559602265989616579:10963]
2025-10-10T14:37:41.128645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:41.128661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:41.128665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.128670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.128673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.128693Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:41.128706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:41.128714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:41.128784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.128791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.128793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.128796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:41.128872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:41.128875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.128888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.128897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.128913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:41.129073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2415
2025-10-10T14:37:41.129077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2415
2025-10-10T14:37:41.129875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2416 partition: 0 MaxSeqNo: 40 sessionId: src_id|908a9940-785a9bb-ec91726-87ffbbf8_0
2025-10-10T14:37:41.128939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771848444:10685], now have 1 active actors on pipe
2025-10-10T14:37:41.128949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771848206:2438], now have 1 active actors on pipe
2025-10-10T14:37:41.128957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602265989616573:10963]
2025-10-10T14:37:41.128959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602265989616573:10963]
2025-10-10T14:37:41.128961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602265989616573:10963]
2025-10-10T14:37:41.128975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:41.128992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:41.129000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:41.129004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:41.129006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:41.129008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:41.129011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:41.129049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602265989616573:10963]
2025-10-10T14:37:41.129057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:41.129062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:41.129254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.129262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.129314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|908a9940-785a9bb-ec91726-87ffbbf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:41.129325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.129361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.129363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:41.129377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.129392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:41.129411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.129703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.129709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.129731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.133461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e140d58-88a8d449-295db06d-e6fbc6e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|908a9940-785a9bb-ec91726-87ffbbf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:41.136337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908a9940-785a9bb-ec91726-87ffbbf8_0] Write session: try to update token
2025-10-10T14:37:41.136360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908a9940-785a9bb-ec91726-87ffbbf8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:41.146256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:41.146283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:41.146296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602265989616573:10963]
2025-10-10T14:37:41.146339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:41.146351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:41.146602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:41.146749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:41.146905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:41.147060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:41.147364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:41.147404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:41.154588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2416 sessionId: src_id|908a9940-785a9bb-ec91726-87ffbbf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:41.157636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:41.158140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.158167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.158213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:41.158396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:41.168699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:41.168719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:41.168722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:41.168725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:41.168738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602265989616573:10963]
2025-10-10T14:37:41.168743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602265989616573:10963]
2025-10-10T14:37:41.168748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602265989616573:10963]
2025-10-10T14:37:41.168798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:41.168800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:41.168807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:41.168807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.168810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:41.168811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:41.168941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:41.174478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602266771848463:10596]
2025-10-10T14:37:41.174902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2415, pipe: [1:7559602266771848463:10596]
2025-10-10T14:37:41.283908Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:41.284303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771848463:10596], now have 1 active actors on pipe
2025-10-10T14:37:41.293284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.293452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.293679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.293760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.293841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.293919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.294313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.294334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.294412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.294479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.294552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.294628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.294675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.294682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.294755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.294822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.294897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.294987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.295039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.295048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.295126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.295200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.295277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.295352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.295513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.295523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.295591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.295661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.295738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.295809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.295934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.295943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.296024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.296092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.296167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.296243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.296296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.296306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.296396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.296463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.296544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.296615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.296669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.296682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.296756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.296838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.296916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.296979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.297028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.297030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.297108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.297174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.297244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.297346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.297406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.297413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.297543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:41.297616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:41.297689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:41.297801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:41.297852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:41.297862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:41.298607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602266771848463:10596]
2025-10-10T14:37:41.298643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:41.298693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:41.298701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:41.298729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:41.299120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908a9940-785a9bb-ec91726-87ffbbf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:41.299132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908a9940-785a9bb-ec91726-87ffbbf8_0] Write session will restart in 0.009416s
2025-10-10T14:37:41.299160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908a9940-785a9bb-ec91726-87ffbbf8_0] Write session: Do CDS request
2025-10-10T14:37:41.299177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908a9940-785a9bb-ec91726-87ffbbf8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:41.298734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2416 reason: error at write: Disconnected sessionId: src_id|908a9940-785a9bb-ec91726-87ffbbf8_0
2025-10-10T14:37:41.298911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2416 sessionId: src_id|908a9940-785a9bb-ec91726-87ffbbf8_0 is DEAD
2025-10-10T14:37:41.309877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|908a9940-785a9bb-ec91726-87ffbbf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.310241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:41.310257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2417
2025-10-10T14:37:41.310402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.310446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:41.310453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:41.310459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:41.311058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2417 sessionId:  describe result for acl check
2025-10-10T14:37:41.311096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:41.311099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:41.311102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:41.311109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602266771848517:10690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:41.311680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602266771848517:10690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:41.315165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602266771848517:10690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:41.318788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602266771848517:10690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:41.318805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602266771848517:10690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:41.318809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602266771848517:10690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:41.318820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:41.322575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:41.325733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:41.326002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:41.326015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:41.326028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:41.326102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:41.326149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602265989616846:10967]
2025-10-10T14:37:41.326786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:41.327188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:41.327252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:41.327587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:41.327656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.327663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.327664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.327665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.327667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.327668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.327669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.327670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.327672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.327673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.327675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.327676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.327678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.327684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.327698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.327703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.327707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.327711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.327716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.327720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.327724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.327728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.327733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.327737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.327741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.327746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.327756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.327765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.327772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.327778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.327782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.327788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.327793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.327804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.327813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.327823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.327828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.327837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.327842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.327847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.327851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.327857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.327862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.327867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.327877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.327882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.327889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.327900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.327909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.327915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.327926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.327931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.327977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:41.330668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:41.331647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:41.331667Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:41.331669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:41.331674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:41.331681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2416 [2:7559602265989616846:10967]
2025-10-10T14:37:41.331695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:41.331713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:41.331722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.331726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.331728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.331747Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:41.331755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:41.331768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:41.331833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.331840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.331842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.331845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:41.331919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:41.331926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.331939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.331951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.331969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:41.332000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771848677:10690], now have 1 active actors on pipe
2025-10-10T14:37:41.332008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602265989616841:10967]
2025-10-10T14:37:41.332014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602265989616841:10967]
2025-10-10T14:37:41.332016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602265989616841:10967]
2025-10-10T14:37:41.332031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:41.332047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:41.332049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771848478:2438], now have 1 active actors on pipe
2025-10-10T14:37:41.332058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:41.332060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:41.332062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:41.332074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:41.332078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:41.332108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602265989616841:10967]
2025-10-10T14:37:41.332112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:41.332125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:41.332101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2416
2025-10-10T14:37:41.332148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.332161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.332205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:41.332103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2416
2025-10-10T14:37:41.332214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.332218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.332221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:41.332244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.332267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:41.332282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.332445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.332453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.332469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.332580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2417 partition: 0 MaxSeqNo: 40 sessionId: src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0
2025-10-10T14:37:41.332981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|908a9940-785a9bb-ec91726-87ffbbf8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:41.335740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0] Write session: try to update token
2025-10-10T14:37:41.335758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:41.350207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2417 sessionId: src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:41.352047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:41.352073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:41.352077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:41.352079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:41.352089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602265989616841:10967]
2025-10-10T14:37:41.352095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602265989616841:10967]
2025-10-10T14:37:41.352099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602265989616841:10967]
2025-10-10T14:37:41.352155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:41.352161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:41.352169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:41.352171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.352174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:41.352174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:41.352331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:41.353161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:41.398711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602266771848740:10596]
2025-10-10T14:37:41.399042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2416, pipe: [1:7559602266771848740:10596]
2025-10-10T14:37:41.474983Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:41.475303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.475322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.475373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771848740:10596], now have 1 active actors on pipe
2025-10-10T14:37:41.475982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:41.475771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:41.476458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:41.476470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0] Write session will restart in 0.007160s
2025-10-10T14:37:41.476497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0] Write session: Do CDS request
2025-10-10T14:37:41.476504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:41.476085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2417 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0
2025-10-10T14:37:41.476303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2417 sessionId: src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0 is DEAD
2025-10-10T14:37:41.476473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:41.476520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602266771848740:10596]
2025-10-10T14:37:41.484948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.485079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:41.485095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2418
2025-10-10T14:37:41.485259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.485298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:41.485309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:41.485313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:41.485875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2418 sessionId:  describe result for acl check
2025-10-10T14:37:41.485916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:41.485924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:41.485925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:41.485933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602266771848757:10696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:41.486518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602266771848757:10696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:41.499372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602266771848757:10696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:41.503437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602266771848757:10696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:41.503455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602266771848757:10696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:41.503459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602266771848757:10696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:41.503469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:41.505929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:41.509094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:41.509363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:41.509380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:41.509393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:41.509449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:41.509500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602265989617102:10969]
2025-10-10T14:37:41.510085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:41.510524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:41.510578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:41.510974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:41.511042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.511048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.511050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.511051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.511053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.511054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.511056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.511057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.511059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.511060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.511061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.511063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.511064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.511070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.511085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.511089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.511094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.511098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.511103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.511107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.511111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.511115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.511119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.511123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.511127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.511132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.511140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.511149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.511156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.511162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.511167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.511173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.511179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.511185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.511190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.511196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.511200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.511206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.511211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.511216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.511220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.511225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.511230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.511236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.511241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.511247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.511252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.511258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.511262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.511267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.511274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.511286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.511331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:41.513838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:41.514213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:41.514228Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:41.514231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:41.514235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:41.514242Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2417 [2:7559602265989617102:10969]
2025-10-10T14:37:41.514255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:41.514276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:41.514286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.514290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.514293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.514310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:41.514318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:41.514328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:41.514846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.514857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.514860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.514863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:41.514937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:41.514946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.514972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.514989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.515013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:41.515043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602265989617097:10969]
2025-10-10T14:37:41.515051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602265989617097:10969]
2025-10-10T14:37:41.515054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602265989617097:10969]
2025-10-10T14:37:41.515065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:41.515075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:41.515078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:41.515080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:41.515086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771848987:10696], now have 1 active actors on pipe
2025-10-10T14:37:41.515093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:41.515111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:41.515120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:41.515127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771848741:2438], now have 1 active actors on pipe
2025-10-10T14:37:41.515158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2417
2025-10-10T14:37:41.515193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2417
2025-10-10T14:37:41.515149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602265989617097:10969]
2025-10-10T14:37:41.515171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:41.515260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:41.515342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.515353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.515388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35b6bfd9-558df187-f6502273-78a701f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:41.515404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.515411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.515414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:41.515427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.515443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:41.515465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.515810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.515824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.515842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.515968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2418 partition: 0 MaxSeqNo: 40 sessionId: src_id|35b6bfd9-558df187-f6502273-78a701f1_0
2025-10-10T14:37:41.516390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b57602c-7e5d91d-fecdbaf8-e45406e8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35b6bfd9-558df187-f6502273-78a701f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:41.519334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b6bfd9-558df187-f6502273-78a701f1_0] Write session: try to update token
2025-10-10T14:37:41.519359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b6bfd9-558df187-f6502273-78a701f1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:41.536561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2418 sessionId: src_id|35b6bfd9-558df187-f6502273-78a701f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:41.538661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:41.538686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:41.538690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:41.538692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:41.538704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602265989617097:10969]
2025-10-10T14:37:41.538709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602265989617097:10969]
2025-10-10T14:37:41.538714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602265989617097:10969]
2025-10-10T14:37:41.538765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:41.538768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:41.538773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:41.538777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.538778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:41.538780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:41.538925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:41.539410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:41.576943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602266771849002:10596]
2025-10-10T14:37:41.577289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2417, pipe: [1:7559602266771849002:10596]
2025-10-10T14:37:41.663239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b6bfd9-558df187-f6502273-78a701f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:41.663255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b6bfd9-558df187-f6502273-78a701f1_0] Write session will restart in 0.006389s
2025-10-10T14:37:41.663289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b6bfd9-558df187-f6502273-78a701f1_0] Write session: Do CDS request
2025-10-10T14:37:41.663295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b6bfd9-558df187-f6502273-78a701f1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:41.662745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602266771849002:10596]
2025-10-10T14:37:41.662783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:41.662787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:41.662855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2418 reason: error at write: Disconnected sessionId: src_id|35b6bfd9-558df187-f6502273-78a701f1_0
2025-10-10T14:37:41.663058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2418 sessionId: src_id|35b6bfd9-558df187-f6502273-78a701f1_0 is DEAD
2025-10-10T14:37:41.663236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:41.661500Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:41.662063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.662075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.662125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771849002:10596], now have 1 active actors on pipe
2025-10-10T14:37:41.662516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:41.671568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35b6bfd9-558df187-f6502273-78a701f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.671689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:41.671704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2419
2025-10-10T14:37:41.672012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.672060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:41.672066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:41.672071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:41.672599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2419 sessionId:  describe result for acl check
2025-10-10T14:37:41.672644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:41.672650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:41.672652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:41.672657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602266771849012:10700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:41.673254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602266771849012:10700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:41.675690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602266771849012:10700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:41.679437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602266771849012:10700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:41.679452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602266771849012:10700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:41.679456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602266771849012:10700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:41.679467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:41.712932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:41.716767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:41.717058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:41.717072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:41.717086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:41.717158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:41.717212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602265989617372:10971]
2025-10-10T14:37:41.717895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:41.718310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:41.718366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:41.718730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:41.718792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.718794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.718795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.718796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.718797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.718799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.718800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.718801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.718802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.718804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.718805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.718806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.718807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.718814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.718825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.718829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.718832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.718836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.718839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.718843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.718847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.718850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.718854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.718858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.718862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.718866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.718874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.718882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.718888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.718893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.718898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.718903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.718907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.718912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.718917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.718922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.718926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.718931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.718936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.718941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.718944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.718966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.718970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.718975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.718980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.718985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.718990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.718995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.718999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.719005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.719009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.719014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.719057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:41.722071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:41.722847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:41.722861Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:41.722863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:41.722868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:41.722875Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2418 [2:7559602265989617372:10971]
2025-10-10T14:37:41.722889Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:41.722907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:41.722910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.722914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.722918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.722936Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:41.722963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:41.722977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:41.723045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.723054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.723056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.723059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:41.723132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:41.723140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.723154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.723170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.723186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:41.723213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602265989617366:10971]
2025-10-10T14:37:41.723223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602265989617366:10971]
2025-10-10T14:37:41.723225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602265989617366:10971]
2025-10-10T14:37:41.723235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:41.723245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:41.723248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:41.723250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:41.723252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:41.723268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:41.723271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:41.723283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771849049:10700], now have 1 active actors on pipe
2025-10-10T14:37:41.723287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771849004:2438], now have 1 active actors on pipe
2025-10-10T14:37:41.723325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602265989617366:10971]
2025-10-10T14:37:41.723333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:41.723341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:41.725517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2418
2025-10-10T14:37:41.725567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2418
2025-10-10T14:37:41.725622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.725645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.725696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:41.725716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.725726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.725729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:41.725754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.725778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:41.725812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.729588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.729610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.729652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.730385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2419 partition: 0 MaxSeqNo: 40 sessionId: src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0
2025-10-10T14:37:41.730815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35b6bfd9-558df187-f6502273-78a701f1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:41.733854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0] Write session: try to update token
2025-10-10T14:37:41.733875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:41.747823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:41.747855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:41.747859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:41.747861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:41.747870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602265989617366:10971]
2025-10-10T14:37:41.747876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602265989617366:10971]
2025-10-10T14:37:41.747879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602265989617366:10971]
2025-10-10T14:37:41.747924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:41.747936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.747938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:41.747963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:41.747969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:41.747978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:41.748069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:41.753157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2419 sessionId: src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:41.756105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:41.761902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602266771849267:10596]
2025-10-10T14:37:41.762245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2418, pipe: [1:7559602266771849267:10596]
2025-10-10T14:37:41.866212Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:41.867302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.867327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.867377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771849267:10596], now have 1 active actors on pipe
2025-10-10T14:37:41.867616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:41.867616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:41.867628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602266771849267:10596]
2025-10-10T14:37:41.867631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:41.867650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:41.867723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2419 reason: error at write: Disconnected sessionId: src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0
2025-10-10T14:37:41.867933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2419 sessionId: src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0 is DEAD
2025-10-10T14:37:41.868111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:41.868132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0] Write session will restart in 0.006634s
2025-10-10T14:37:41.868162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0] Write session: Do CDS request
2025-10-10T14:37:41.868174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:41.875987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.876099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:41.876117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2420
2025-10-10T14:37:41.876274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:41.876309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:41.876321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:41.876324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:41.876855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2420 sessionId:  describe result for acl check
2025-10-10T14:37:41.876899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:41.876906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:41.876908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:41.876915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602266771849317:10714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:41.877537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602266771849317:10714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:41.880482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602266771849317:10714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:41.885070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602266771849317:10714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:41.885087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602266771849317:10714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:41.885093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602266771849317:10714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:41.885102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:41.895024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:41.898145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:41.898603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:41.898608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:41.898622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:41.898680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:41.898727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602265989617657:10986]
2025-10-10T14:37:41.899462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:41.899763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:41.899807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:41.900155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:41.900210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.900216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.900217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.900218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.900219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.900221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.900222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.900223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.900225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.900226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.900227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.900228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.900229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.900235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.900248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.900253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.900257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.900261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.900266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.900270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.900274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.900278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.900282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.900286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.900291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.900294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.900302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.900311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:41.900317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.900323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:41.900329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.900335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:41.900339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.900344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:41.900349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.900354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:41.900359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.900364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:41.900369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.900375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:41.900380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.900386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:41.900391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.900397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:41.900405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.900411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:41.900420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.900425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.900430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.900439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.900444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.900449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.900496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:41.903076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:41.903711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:41.903726Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:41.903728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:41.903733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:41.903741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2419 [2:7559602265989617657:10986]
2025-10-10T14:37:41.903754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:41.903788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:41.903796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.903801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.903804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.903822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:41.903837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:41.903846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:41.903919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.903926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.903929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.903932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:41.904014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:41.904024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.904037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:41.904054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:41.904074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:41.904102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771849304:2438], now have 1 active actors on pipe
2025-10-10T14:37:41.904110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771849407:10714], now have 1 active actors on pipe
2025-10-10T14:37:41.904119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602265989617652:10986]
2025-10-10T14:37:41.904126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602265989617652:10986]
2025-10-10T14:37:41.904129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602265989617652:10986]
2025-10-10T14:37:41.904143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:41.904157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:41.904161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:41.904163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:41.904163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:41.904181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:41.904190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:41.904226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602265989617652:10986]
2025-10-10T14:37:41.904234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:41.904236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:41.904201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2419
2025-10-10T14:37:41.904207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2419
2025-10-10T14:37:41.904276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.904287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.904322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|822d1491-3dc284ea-737d122a-1d4150af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:41.904331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:41.904336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:41.904339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:41.904352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:41.904371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:41.904390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.904762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:41.904777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:41.904820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:41.904956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2420 partition: 0 MaxSeqNo: 40 sessionId: src_id|822d1491-3dc284ea-737d122a-1d4150af_0
2025-10-10T14:37:41.905401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ea3de71-e4401752-deef3c7e-cdac6e8c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|822d1491-3dc284ea-737d122a-1d4150af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:41.917652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822d1491-3dc284ea-737d122a-1d4150af_0] Write session: try to update token
2025-10-10T14:37:41.917682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822d1491-3dc284ea-737d122a-1d4150af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:41.924230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:41.924253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:41.924257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:41.924259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:41.924268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602265989617652:10986]
2025-10-10T14:37:41.924273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602265989617652:10986]
2025-10-10T14:37:41.924277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602265989617652:10986]
2025-10-10T14:37:41.924332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:41.924343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:41.924346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:41.924346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:41.924352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:41.924358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:41.924650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:41.935723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2420 sessionId: src_id|822d1491-3dc284ea-737d122a-1d4150af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:41.938759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:41.967555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602266771849565:10596]
2025-10-10T14:37:41.967992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2419, pipe: [1:7559602266771849565:10596]
2025-10-10T14:37:42.048091Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:42.048508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.048525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.048551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602266771849565:10596], now have 1 active actors on pipe
2025-10-10T14:37:42.048846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:42.048878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602266771849565:10596]
2025-10-10T14:37:42.048905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:42.049001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2420 reason: status is not ok: tablet will be restarted right now sessionId: src_id|822d1491-3dc284ea-737d122a-1d4150af_0
2025-10-10T14:37:42.048792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:42.049200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2420 sessionId: src_id|822d1491-3dc284ea-737d122a-1d4150af_0 is DEAD
2025-10-10T14:37:42.049372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822d1491-3dc284ea-737d122a-1d4150af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:42.049385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822d1491-3dc284ea-737d122a-1d4150af_0] Write session will restart in 0.005596s
2025-10-10T14:37:42.049411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822d1491-3dc284ea-737d122a-1d4150af_0] Write session: Do CDS request
2025-10-10T14:37:42.049417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822d1491-3dc284ea-737d122a-1d4150af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:42.055897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|822d1491-3dc284ea-737d122a-1d4150af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.056004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:42.056020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2421
2025-10-10T14:37:42.056214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.056266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:42.056277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:42.056281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:42.056758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2421 sessionId:  describe result for acl check
2025-10-10T14:37:42.056795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:42.056802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:42.056805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:42.056812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602271066816876:10718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:42.057521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602271066816876:10718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:42.059865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602271066816876:10718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:42.064160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602271066816876:10718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:42.064176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602271066816876:10718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:42.064179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602271066816876:10718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:42.064188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:42.072263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:42.075414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:42.076022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:42.076042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:42.076061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:42.076152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:42.076219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602270284585212:10988]
2025-10-10T14:37:42.076922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:42.077317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:42.077404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:42.077803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:42.077885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.077893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.077894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.077896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.077898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.077899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.077901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.077903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.077904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.077906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.077908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.077910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.077911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.077919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.077933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.077938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.077942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.077946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.077950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.077954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.077958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.077962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.077965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.077969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.077973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.077977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.077986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.077996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.078004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.078011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.078016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.078022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.078027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.078033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.078039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.078058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.078068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.078074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.078080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.078090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.078098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.078116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.078126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.078131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.078140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.078146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.078152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.078157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.078167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.078172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.078182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.078187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.078232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:42.081133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:42.081779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:42.081795Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:42.081797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:42.081802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:42.081809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2420 [2:7559602270284585212:10988]
2025-10-10T14:37:42.081823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:42.081844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:42.081847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.081851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.081854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.081872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:42.081886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:42.081893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:42.081964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.081973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.081975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.081978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:42.082071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:42.082081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.082092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.082103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.082119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:42.082149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066816992:10718], now have 1 active actors on pipe
2025-10-10T14:37:42.082159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066816863:2438], now have 1 active actors on pipe
2025-10-10T14:37:42.082167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602270284585207:10988]
2025-10-10T14:37:42.082170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602270284585207:10988]
2025-10-10T14:37:42.082172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602270284585207:10988]
2025-10-10T14:37:42.082185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:42.082200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:42.082216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:42.082224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:42.082233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:42.082237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:42.082240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:42.082262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602270284585207:10988]
2025-10-10T14:37:42.082273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:42.082273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:42.082314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.082326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.082363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:42.082376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.082380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.082383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:42.082393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.082404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:42.082422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.082600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.082616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.082641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.083204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|822d1491-3dc284ea-737d122a-1d4150af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:42.082261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2420
2025-10-10T14:37:42.082311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2420
2025-10-10T14:37:42.082758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2421 partition: 0 MaxSeqNo: 40 sessionId: src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0
2025-10-10T14:37:42.086175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0] Write session: try to update token
2025-10-10T14:37:42.086194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:42.101738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2421 sessionId: src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:42.102093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:42.102114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:42.102117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:42.102119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:42.102129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602270284585207:10988]
2025-10-10T14:37:42.102133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602270284585207:10988]
2025-10-10T14:37:42.102137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602270284585207:10988]
2025-10-10T14:37:42.102190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:42.102197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:42.102199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.102202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:42.102205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:42.102210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:42.102406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:42.104585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:42.148855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602271066817123:10596]
2025-10-10T14:37:42.149237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2420, pipe: [1:7559602271066817123:10596]
2025-10-10T14:37:42.225420Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:42.225860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.225871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.225925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817123:10596], now have 1 active actors on pipe
2025-10-10T14:37:42.226616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:42.226630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:42.226692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2421 reason: error at write: Disconnected sessionId: src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0
2025-10-10T14:37:42.226904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2421 sessionId: src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0 is DEAD
2025-10-10T14:37:42.227094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:42.227131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602271066817123:10596]
2025-10-10T14:37:42.226261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:42.229631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:42.229644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0] Write session will restart in 0.006755s
2025-10-10T14:37:42.229668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0] Write session: Do CDS request
2025-10-10T14:37:42.229678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:42.241929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.241971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:42.241988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2422
2025-10-10T14:37:42.242188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.242227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:42.242234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:42.242239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:42.242738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2422 sessionId:  describe result for acl check
2025-10-10T14:37:42.242770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:42.242772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:42.242774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:42.242781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602271066817137:10722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:42.243405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602271066817137:10722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:42.245780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602271066817137:10722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:42.254793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602271066817137:10722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:42.254810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602271066817137:10722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:42.254814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602271066817137:10722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:42.254823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:42.262273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:42.268973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:42.269638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:42.269655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:42.269672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:42.269775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:42.269829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602270284585486:10992]
2025-10-10T14:37:42.270499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:42.270920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:42.271002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:42.271378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:42.271448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.271455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.271457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.271459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.271460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.271462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.271463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.271465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.271467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.271469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.271470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.271472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.271473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.271481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.271496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.271501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.271505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.271510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.271514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.271519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.271522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.271527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.271530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.271534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.271539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.271543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.271553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.271562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.271575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.271581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.271592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.271598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.271603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.271614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.271620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.271630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.271635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.271640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.271646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.271656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.271662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.271673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.271678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.271684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.271689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.271696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.271701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.271712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.271717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.271723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.271729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.271744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.271788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:42.275637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:42.276185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:42.276207Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:42.276209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:42.276214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:42.276221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2421 [2:7559602270284585486:10992]
2025-10-10T14:37:42.276239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:42.276260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:42.276264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.276268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.276271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.276291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:42.276299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:42.276308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:42.276381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.276388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.276390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.276393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:42.276471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:42.276479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.276493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.276510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.276532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:42.276560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817125:2438], now have 1 active actors on pipe
2025-10-10T14:37:42.276568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817276:10722], now have 1 active actors on pipe
2025-10-10T14:37:42.276576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602270284585481:10992]
2025-10-10T14:37:42.276582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602270284585481:10992]
2025-10-10T14:37:42.276584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602270284585481:10992]
2025-10-10T14:37:42.276598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:42.276620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:42.276623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:42.276630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:42.276632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:42.276639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:42.276643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:42.276660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2421
2025-10-10T14:37:42.276720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2421
2025-10-10T14:37:42.276678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602270284585481:10992]
2025-10-10T14:37:42.276689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:42.276692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:42.276847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.276863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.276897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:42.276925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.276934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.276937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:42.276950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.276967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:42.276991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.277197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.277205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.277222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.277363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2422 partition: 0 MaxSeqNo: 40 sessionId: src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0
2025-10-10T14:37:42.281485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b0d902-2da2fa9-b1d9adfc-76269baf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:42.284460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0] Write session: try to update token
2025-10-10T14:37:42.284483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:42.304634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:42.304659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:42.304673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602270284585481:10992]
2025-10-10T14:37:42.304735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:42.308076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:42.308316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:42.308472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:42.308647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:42.308787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:42.309159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:42.309207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:42.319147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2422 sessionId: src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:42.321964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:42.322574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.322598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.322643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:42.323551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:42.327509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602271066817400:10596]
2025-10-10T14:37:42.327729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2421, pipe: [1:7559602271066817400:10596]
2025-10-10T14:37:42.327810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817400:10596], now have 1 active actors on pipe
2025-10-10T14:37:42.327836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:42.327839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:42.327843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:42.327846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:42.327856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602270284585481:10992]
2025-10-10T14:37:42.327860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602270284585481:10992]
2025-10-10T14:37:42.327864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602270284585481:10992]
2025-10-10T14:37:42.327902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:42.327909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:42.327912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:42.327913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:42.327920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.327923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:42.328060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:42.454342Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:42.464509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.464542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.464748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.464825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.464894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.464969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.465017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.465028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.465102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.465174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.465243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.465320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.468475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602271066817400:10596]
2025-10-10T14:37:42.468524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:42.468585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:42.468592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:42.468624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2422 reason: error at write: Disconnected sessionId: src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0
2025-10-10T14:37:42.468835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2422 sessionId: src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0 is DEAD
2025-10-10T14:37:42.468992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:42.469005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0] Write session will restart in 0.005424s
2025-10-10T14:37:42.469031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0] Write session: Do CDS request
2025-10-10T14:37:42.469038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:42.465457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.465469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.465549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.465611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.465678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.465742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.465783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.465789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.465862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.465928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.465991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.466055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.466101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.466104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.466179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.466243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.466308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.466375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.466418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.466422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.466493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.466552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.466661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.466761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.466804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.466809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.466884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.466958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.467025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.467087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.467129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.467136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.467206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.467267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.467328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.467386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.467427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.467431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.467501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.467561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.467624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.467686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.467822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.467825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.467898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.467956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.468015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.468076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.468116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.468119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.468557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:42.475993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.479301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:42.479319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2423
2025-10-10T14:37:42.479509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.479550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:42.479561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:42.479566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:42.480021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2423 sessionId:  describe result for acl check
2025-10-10T14:37:42.480057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:42.480064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:42.480069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:42.480076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602271066817415:10727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:42.481007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602271066817415:10727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:42.487193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602271066817415:10727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:42.497190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602271066817415:10727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:42.497221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602271066817415:10727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:42.497225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602271066817415:10727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:42.497236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:42.507280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:42.514901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:42.515200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:42.515206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:42.515221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:42.515289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:42.515331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602270284585747:10994]
2025-10-10T14:37:42.515880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:42.516187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:42.516240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:42.516543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:42.516607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.516608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.516609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.516611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.516612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.516614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.516616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.516617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.516619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.516620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.516621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.516623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.516624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.516629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.516641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.516644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.516647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.516651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.516656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.516660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.516664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.516668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.516673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.516677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.516680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.516684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.516692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.516701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.516707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.516712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.516718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.516723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.516727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.516732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.516737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.516742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.516747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.516752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.516756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.516762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.516766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.516770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.516774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.516782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.516786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.516792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.516796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.516801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.516806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.516811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.516815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.516820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.516858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:42.521526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:42.522470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:42.522489Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:42.522492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:42.522496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:42.522503Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2422 [2:7559602270284585747:10994]
2025-10-10T14:37:42.522518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:42.522539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:42.522548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.522552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.522555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.522576Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:42.522589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:42.522598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:42.522672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.522683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.522685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.522688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:42.522761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:42.522769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.522783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.522799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.522819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:42.522847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602270284585742:10994]
2025-10-10T14:37:42.522859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602270284585742:10994]
2025-10-10T14:37:42.522861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602270284585742:10994]
2025-10-10T14:37:42.522880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:42.522898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817557:10727], now have 1 active actors on pipe
2025-10-10T14:37:42.522906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817403:2438], now have 1 active actors on pipe
2025-10-10T14:37:42.522911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:42.522913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:42.522916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:42.522918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:42.522941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:42.522945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:42.522988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602270284585742:10994]
2025-10-10T14:37:42.522999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:42.523024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:42.522998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2422
2025-10-10T14:37:42.523036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2422
2025-10-10T14:37:42.523251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.523265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.523300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94c218eb-30b353b5-66d69113-fc488c47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:42.523314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.523323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.523326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:42.523339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.523356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:42.523373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.526056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.526072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.526109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.526686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d136d257-5fbecd28-1dcbe834-3cee85d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|94c218eb-30b353b5-66d69113-fc488c47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:42.526277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2423 partition: 0 MaxSeqNo: 40 sessionId: src_id|94c218eb-30b353b5-66d69113-fc488c47_0
2025-10-10T14:37:42.529600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c218eb-30b353b5-66d69113-fc488c47_0] Write session: try to update token
2025-10-10T14:37:42.529621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c218eb-30b353b5-66d69113-fc488c47_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:42.550284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:42.550304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:42.550308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:42.550310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:42.550322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602270284585742:10994]
2025-10-10T14:37:42.550326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602270284585742:10994]
2025-10-10T14:37:42.550330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602270284585742:10994]
2025-10-10T14:37:42.550390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:42.550399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.550403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:42.550537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:42.553933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:42.553947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:42.553953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:42.555342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2423 sessionId: src_id|94c218eb-30b353b5-66d69113-fc488c47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:42.558206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:42.568632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602271066817668:10596]
2025-10-10T14:37:42.568979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2422, pipe: [1:7559602271066817668:10596]
2025-10-10T14:37:42.677639Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:42.677918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.677929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.677976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817668:10596], now have 1 active actors on pipe
2025-10-10T14:37:42.678275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:42.678593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:42.678654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602271066817668:10596]
2025-10-10T14:37:42.678677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:42.678753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2423 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94c218eb-30b353b5-66d69113-fc488c47_0
2025-10-10T14:37:42.678974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2423 sessionId: src_id|94c218eb-30b353b5-66d69113-fc488c47_0 is DEAD
2025-10-10T14:37:42.679320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c218eb-30b353b5-66d69113-fc488c47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:42.679328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c218eb-30b353b5-66d69113-fc488c47_0] Write session will restart in 0.008026s
2025-10-10T14:37:42.679351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c218eb-30b353b5-66d69113-fc488c47_0] Write session: Do CDS request
2025-10-10T14:37:42.679357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c218eb-30b353b5-66d69113-fc488c47_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:42.689977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c218eb-30b353b5-66d69113-fc488c47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.690370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:42.690387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2424
2025-10-10T14:37:42.690587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.690622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:42.690629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:42.690632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:42.691373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2424 sessionId:  describe result for acl check
2025-10-10T14:37:42.691413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:42.691414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:42.691416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:42.691423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602271066817695:10731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:42.692028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602271066817695:10731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:42.695138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602271066817695:10731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:42.700617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602271066817695:10731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:42.700637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602271066817695:10731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:42.700641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602271066817695:10731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:42.700650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:42.712200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:42.715452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:42.715722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:42.715734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:42.715746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:42.715806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:42.715869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602270284586009:10996]
2025-10-10T14:37:42.716555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:42.716931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:42.716992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:42.717379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:42.717444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.717450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.717452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.717453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.717455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.717457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.717458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.717460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.717461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.717462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.717464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.717465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.717466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.717473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.717489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.717494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.717498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.717503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.717508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.717512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.717516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.717520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.717525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.717530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.717534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.717539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.717548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.717557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.717564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.717576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.717581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.717591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.717596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.717606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.717611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.717621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.717626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.717632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.717638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.717643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.717653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.717658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.717665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.717670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.717675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.717680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.717691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.717696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.717701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.717719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.717728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.717733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.717789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:42.720620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:42.721292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:42.721306Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:42.721308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:42.721313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:42.721320Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2423 [2:7559602270284586009:10996]
2025-10-10T14:37:42.721353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:42.721374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:42.721378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.721385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.721388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.721408Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:42.721416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:42.721425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:42.721496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.721507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.721509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.721511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:42.721851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:42.721861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.721875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.721890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.721919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:42.721948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602270284586004:10996]
2025-10-10T14:37:42.721950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602270284586004:10996]
2025-10-10T14:37:42.721953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602270284586004:10996]
2025-10-10T14:37:42.721973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:42.721989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:42.722007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:42.722007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:42.722011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:42.722014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:42.722016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:42.722053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602270284586004:10996]
2025-10-10T14:37:42.722062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:42.722071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:42.722085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817826:10731], now have 1 active actors on pipe
2025-10-10T14:37:42.722089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817670:2438], now have 1 active actors on pipe
2025-10-10T14:37:42.722730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2423
2025-10-10T14:37:42.722763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2423
2025-10-10T14:37:42.724509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.724525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.724566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8b949b0-919da60e-5b98a467-893bf705_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:42.724600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.724613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.724616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:42.724633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.724665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:42.724694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.724931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.724945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.724964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.725098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2424 partition: 0 MaxSeqNo: 40 sessionId: src_id|d8b949b0-919da60e-5b98a467-893bf705_0
2025-10-10T14:37:42.725915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c218eb-30b353b5-66d69113-fc488c47_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d8b949b0-919da60e-5b98a467-893bf705_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:42.729545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b949b0-919da60e-5b98a467-893bf705_0] Write session: try to update token
2025-10-10T14:37:42.729570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b949b0-919da60e-5b98a467-893bf705_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:42.743941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:42.743962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:42.743974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602270284586004:10996]
2025-10-10T14:37:42.744028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:42.744026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:42.744248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:42.744482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:42.744761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:42.745022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:42.745437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:42.745501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:42.750242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2424 sessionId: src_id|d8b949b0-919da60e-5b98a467-893bf705_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:42.753063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:42.755717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.755746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.755794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:42.756040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:42.763947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:42.763966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:42.763970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:42.763972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:42.763983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602270284586004:10996]
2025-10-10T14:37:42.763988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602270284586004:10996]
2025-10-10T14:37:42.763992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602270284586004:10996]
2025-10-10T14:37:42.764047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:42.764056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.764058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:42.764064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:42.764070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:42.764075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:42.764200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:42.778583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602271066817941:10596]
2025-10-10T14:37:42.778877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2423, pipe: [1:7559602271066817941:10596]
2025-10-10T14:37:42.889011Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:42.889763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817941:10596], now have 1 active actors on pipe
2025-10-10T14:37:42.898738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.898767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.898971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.899035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.899112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.899182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.899464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.899473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.899597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.899704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.899766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.899832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.899876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.899879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.899954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.900018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.900085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.900152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.900193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.900196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.900268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.900789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.900862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.900926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.900966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.900969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.901046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.901106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.901169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.901229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.901271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.901274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.901551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.901618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.901691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.901757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.901799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.901802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.901878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.901945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.902010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.902082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.902127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.902130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.902211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.902275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.902341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.902409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.902463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.902467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.902545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.902636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.902702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.902769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.902817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.902820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.902900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:42.902984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:42.903058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:42.903129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:42.903172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:42.903175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:42.904310Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:42.906866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:42.906947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2424 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8b949b0-919da60e-5b98a467-893bf705_0
2025-10-10T14:37:42.907386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b949b0-919da60e-5b98a467-893bf705_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:42.907404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b949b0-919da60e-5b98a467-893bf705_0] Write session will restart in 0.007546s
2025-10-10T14:37:42.907435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b949b0-919da60e-5b98a467-893bf705_0] Write session: Do CDS request
2025-10-10T14:37:42.907453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b949b0-919da60e-5b98a467-893bf705_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:42.907175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2424 sessionId: src_id|d8b949b0-919da60e-5b98a467-893bf705_0 is DEAD
2025-10-10T14:37:42.907385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602271066817941:10596]
2025-10-10T14:37:42.907402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:42.917280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b949b0-919da60e-5b98a467-893bf705_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.919876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:42.919893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2425
2025-10-10T14:37:42.920119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:42.920156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:42.920166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:42.920171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:42.920585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2425 sessionId:  describe result for acl check
2025-10-10T14:37:42.920617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:42.920626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:42.920628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:42.920635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602271066817988:10745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:42.921186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602271066817988:10745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:42.935105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602271066817988:10745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:42.939908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602271066817988:10745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:42.939931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602271066817988:10745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:42.939935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602271066817988:10745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:42.939946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:42.947612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:42.950748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:42.951224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:42.951240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:42.951257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:42.951347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:42.951394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602270284586312:11011]
2025-10-10T14:37:42.952096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:42.952619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:42.952696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:42.953061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:42.953172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.953174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.953176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.953177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.953178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.953180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.953181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.953183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.953184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.953186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.953187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.953189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.953189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.953197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.953224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.953228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.953232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.953236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.953240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.953244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.953248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.953252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.953257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.953261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.953264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.953268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.953277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.953287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:42.953294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.953300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:42.953306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.953310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:42.953315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.953319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:42.953323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.953344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:42.953350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.953355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:42.953359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.953363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:42.953367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.953372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:42.953377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.953382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:42.953395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.953400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:42.953405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.953410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.953413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.953418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.953422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.953427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.953478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:42.961290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:42.961640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:42.961656Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:42.961660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:42.961665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:42.961673Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2424 [2:7559602270284586312:11011]
2025-10-10T14:37:42.961689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:42.961723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:42.961733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.961737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.961740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.961761Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:42.961770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:42.961779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:42.961849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.961852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.961854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.961857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:42.961941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:42.961944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.961960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:42.961970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:42.961986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:42.962009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066817973:2438], now have 1 active actors on pipe
2025-10-10T14:37:42.962019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602270284586307:11011]
2025-10-10T14:37:42.962021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602270284586307:11011]
2025-10-10T14:37:42.962023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602270284586307:11011]
2025-10-10T14:37:42.962032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:42.962050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:42.962053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:42.962056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:42.962058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:42.962068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:42.962071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:42.962114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602271066818153:10745], now have 1 active actors on pipe
2025-10-10T14:37:42.962117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602270284586307:11011]
2025-10-10T14:37:42.962127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:42.962366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:42.962552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.962560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.962596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c03fec6b-1f4dae05-2d330e89-7876565_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:42.962606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:42.962611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:42.962614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:42.962627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:42.962641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:42.962658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.962907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:42.962915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:42.962944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:42.963581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8b949b0-919da60e-5b98a467-893bf705_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c03fec6b-1f4dae05-2d330e89-7876565_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:42.962209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2424
2025-10-10T14:37:42.962263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2424
2025-10-10T14:37:42.963087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2425 partition: 0 MaxSeqNo: 40 sessionId: src_id|c03fec6b-1f4dae05-2d330e89-7876565_0
2025-10-10T14:37:42.967165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c03fec6b-1f4dae05-2d330e89-7876565_0] Write session: try to update token
2025-10-10T14:37:42.967187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c03fec6b-1f4dae05-2d330e89-7876565_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:42.982551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:42.982572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:42.982576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:42.982578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:42.982589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602270284586307:11011]
2025-10-10T14:37:42.982594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602270284586307:11011]
2025-10-10T14:37:42.982598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602270284586307:11011]
2025-10-10T14:37:42.982649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:42.982653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:42.982654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:42.982659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:42.982661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:42.982663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:42.982822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:42.985873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2425 sessionId: src_id|c03fec6b-1f4dae05-2d330e89-7876565_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:42.988663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:43.007486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602275361785533:10596]
2025-10-10T14:37:43.008069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2424, pipe: [1:7559602275361785533:10596]
2025-10-10T14:37:43.103867Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:43.104644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.104663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.104713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361785533:10596], now have 1 active actors on pipe
2025-10-10T14:37:43.105143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:43.104960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602275361785533:10596]
2025-10-10T14:37:43.104983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:43.104989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:43.104995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:43.105073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2425 reason: error at write: Disconnected sessionId: src_id|c03fec6b-1f4dae05-2d330e89-7876565_0
2025-10-10T14:37:43.105361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2425 sessionId: src_id|c03fec6b-1f4dae05-2d330e89-7876565_0 is DEAD
2025-10-10T14:37:43.105522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c03fec6b-1f4dae05-2d330e89-7876565_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:43.105543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c03fec6b-1f4dae05-2d330e89-7876565_0] Write session will restart in 0.007768s
2025-10-10T14:37:43.105570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c03fec6b-1f4dae05-2d330e89-7876565_0] Write session: Do CDS request
2025-10-10T14:37:43.105580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c03fec6b-1f4dae05-2d330e89-7876565_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:43.115017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c03fec6b-1f4dae05-2d330e89-7876565_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.115070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:43.115087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2426
2025-10-10T14:37:43.115258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.115299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:43.115310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:43.115315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:43.116667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2426 sessionId:  describe result for acl check
2025-10-10T14:37:43.116718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:43.116725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:43.116727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:43.116734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602275361785561:10749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:43.117385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602275361785561:10749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:43.120491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602275361785561:10749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:43.123706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602275361785561:10749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:43.123723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602275361785561:10749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:43.123727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602275361785561:10749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:43.123736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:43.130388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:43.134229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:43.134546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:43.134557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:43.134572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:43.134637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:43.134683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602274579553874:11014]
2025-10-10T14:37:43.135367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:43.136228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:43.136292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:43.136614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:43.136698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.136704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.136705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.136707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.136708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.136710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.136712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.136713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.136714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.136715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.136717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.136718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.136719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.136726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.136739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.136743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.136747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.136751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.136754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.136758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.136762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.136766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.136770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.136774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.136777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.136781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.136791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.136800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.136807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.136812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.136830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.136840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.136845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.136849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.136858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.136863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.136867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.136872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.136877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.136882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.136885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.136890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.136898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.136903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.136912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.136918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.136942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.136947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.136951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.136956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.136960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.136965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.137005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:43.139886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:43.140323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:43.140342Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:43.140344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:43.140350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:43.140361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2425 [2:7559602274579553874:11014]
2025-10-10T14:37:43.140377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:43.140402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:43.140406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.140413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.140416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.140439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:43.140455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:43.140468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:43.140551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.140561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.140563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.140567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:43.140657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:43.140668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.140682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.140700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.140716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:43.140749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361785679:10749], now have 1 active actors on pipe
2025-10-10T14:37:43.140758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361785536:2438], now have 1 active actors on pipe
2025-10-10T14:37:43.140767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602274579553869:11014]
2025-10-10T14:37:43.140770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602274579553869:11014]
2025-10-10T14:37:43.140772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602274579553869:11014]
2025-10-10T14:37:43.140788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:43.140804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:43.140809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:43.140814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:43.140817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:43.140826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:43.140829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:43.140824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2425
2025-10-10T14:37:43.140877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602274579553869:11014]
2025-10-10T14:37:43.140826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2425
2025-10-10T14:37:43.140889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:43.140902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:43.141048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.141061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.141097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fd43753-968522a7-c38ec89c-cf900dab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:43.141107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.141111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.141114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:43.141128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.141142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:43.141160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.141352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.141363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.141381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.141610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2426 partition: 0 MaxSeqNo: 40 sessionId: src_id|3fd43753-968522a7-c38ec89c-cf900dab_0
2025-10-10T14:37:43.142065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c03fec6b-1f4dae05-2d330e89-7876565_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3fd43753-968522a7-c38ec89c-cf900dab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:43.145896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd43753-968522a7-c38ec89c-cf900dab_0] Write session: try to update token
2025-10-10T14:37:43.145926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd43753-968522a7-c38ec89c-cf900dab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:43.154086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:43.154106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:43.154123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602274579553869:11014]
2025-10-10T14:37:43.154189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:43.154194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:43.154555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:43.154813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:43.155185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:43.155390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:43.155862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:43.155930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:43.165423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2426 sessionId: src_id|3fd43753-968522a7-c38ec89c-cf900dab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:43.168179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:43.168534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.168561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.168625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:43.168748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:43.173818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:43.173837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:43.173841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:43.173843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:43.173854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602274579553869:11014]
2025-10-10T14:37:43.173859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602274579553869:11014]
2025-10-10T14:37:43.173863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602274579553869:11014]
2025-10-10T14:37:43.173917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:43.173931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.173934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:43.174078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:43.175381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:43.175397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:43.175402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:43.205081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602275361785804:10596]
2025-10-10T14:37:43.205575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2425, pipe: [1:7559602275361785804:10596]
2025-10-10T14:37:43.293681Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:43.303569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.303609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.303815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.303887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.303977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.304045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.304503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.304517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.304589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.304658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.304725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.304802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.304850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.304858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.304931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.305001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.305297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.305393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.305448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.305452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.305524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.305591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.305651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.305713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.305757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.305761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.305835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.305899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.305965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.306034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.306081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.306085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.306154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.306703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.306776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.306976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.307027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.307030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.307103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.307163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.307230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.307298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.307347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.307351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.307423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.307486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.307544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.307607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.307651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.307654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.307729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.307790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.307854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.307927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.307976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.307979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.308055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:43.308117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:43.308181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:43.308252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:43.308301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:43.308304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:43.308407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361785804:10596], now have 1 active actors on pipe
2025-10-10T14:37:43.310530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602275361785804:10596]
2025-10-10T14:37:43.310570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:43.310620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2426 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3fd43753-968522a7-c38ec89c-cf900dab_0
2025-10-10T14:37:43.310850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2426 sessionId: src_id|3fd43753-968522a7-c38ec89c-cf900dab_0 is DEAD
2025-10-10T14:37:43.311007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:43.309644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:43.313514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd43753-968522a7-c38ec89c-cf900dab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:43.313529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd43753-968522a7-c38ec89c-cf900dab_0] Write session will restart in 0.007233s
2025-10-10T14:37:43.313560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd43753-968522a7-c38ec89c-cf900dab_0] Write session: Do CDS request
2025-10-10T14:37:43.313575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd43753-968522a7-c38ec89c-cf900dab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:43.321958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd43753-968522a7-c38ec89c-cf900dab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.322064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:43.322082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2427
2025-10-10T14:37:43.322226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.322264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:43.322277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:43.322281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:43.322781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2427 sessionId:  describe result for acl check
2025-10-10T14:37:43.322823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:43.322825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:43.322827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:43.322834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602275361785827:10754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:43.323455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602275361785827:10754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:43.326077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602275361785827:10754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:43.329592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602275361785827:10754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:43.329608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602275361785827:10754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:43.329613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602275361785827:10754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:43.329622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:43.350345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:43.356280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:43.356886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:43.356902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:43.356922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:43.357013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:43.357063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602274579554151:11017]
2025-10-10T14:37:43.357681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:43.358055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:43.358103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:43.358432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:43.358504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.358510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.358512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.358513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.358515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.358516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.358518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.358519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.358521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.358522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.358524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.358525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.358527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.358533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.358547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.358551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.358556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.358560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.358565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.358569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.358573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.358577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.358582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.358585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.358589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.358594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.358603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.358611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.358619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.358625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.358630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.358636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.358640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.358646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.358650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.358655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.358659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.358664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.358670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.358675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.358681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.358688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.358696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.358701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.358705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.358716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.358721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.358727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.358736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.358742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.358747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.358757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.358798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:43.361880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:43.362240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:43.362252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:43.362255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:43.362260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:43.362267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2426 [2:7559602274579554151:11017]
2025-10-10T14:37:43.362281Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:43.362304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:43.362312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.362316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.362318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.362661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2426
2025-10-10T14:37:43.362710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2426
2025-10-10T14:37:43.362336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:43.362351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:43.362360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:43.362423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.362426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.362428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.362430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:43.362501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:43.362504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.362516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.362529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.362548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:43.362570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361785818:2438], now have 1 active actors on pipe
2025-10-10T14:37:43.362574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361785872:10754], now have 1 active actors on pipe
2025-10-10T14:37:43.362581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602274579554146:11017]
2025-10-10T14:37:43.362583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602274579554146:11017]
2025-10-10T14:37:43.362586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602274579554146:11017]
2025-10-10T14:37:43.362601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:43.362615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:43.362614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:43.362618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:43.362621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:43.362633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:43.362636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:43.362661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602274579554146:11017]
2025-10-10T14:37:43.362669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:43.362681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:43.362867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.362878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.362909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:43.362936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.362941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.362944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:43.362956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.362971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:43.362989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.365287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.365306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.365371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.366006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2427 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0
2025-10-10T14:37:43.366421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd43753-968522a7-c38ec89c-cf900dab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:43.369199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0] Write session: try to update token
2025-10-10T14:37:43.369216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:43.387843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:43.387862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:43.387866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:43.387869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:43.387880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602274579554146:11017]
2025-10-10T14:37:43.387885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602274579554146:11017]
2025-10-10T14:37:43.387890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602274579554146:11017]
2025-10-10T14:37:43.387942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:43.387951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.387955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:43.387953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:43.387960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:43.387965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:43.388098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:43.389702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2427 sessionId: src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:43.392444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:43.413411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602275361786087:10596]
2025-10-10T14:37:43.417577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2426, pipe: [1:7559602275361786087:10596]
2025-10-10T14:37:43.512351Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:43.512847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.512867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.512921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786087:10596], now have 1 active actors on pipe
2025-10-10T14:37:43.513198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:43.513165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:43.513172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602275361786087:10596]
2025-10-10T14:37:43.513200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:43.513203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:43.513273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2427 reason: error at write: Disconnected sessionId: src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0
2025-10-10T14:37:43.513483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2427 sessionId: src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0 is DEAD
2025-10-10T14:37:43.513756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:43.513768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0] Write session will restart in 0.008209s
2025-10-10T14:37:43.513794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0] Write session: Do CDS request
2025-10-10T14:37:43.513800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:43.522939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.523046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:43.523061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2428
2025-10-10T14:37:43.523195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.523242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:43.523248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:43.523253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:43.524284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2428 sessionId:  describe result for acl check
2025-10-10T14:37:43.524317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:43.524319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:43.524321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:43.524328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602275361786107:10758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:43.524868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602275361786107:10758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:43.530228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602275361786107:10758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:43.537888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602275361786107:10758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:43.537911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602275361786107:10758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:43.537915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602275361786107:10758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:43.537926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:43.544669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:43.548230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:43.548497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:43.548509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:43.548523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:43.548583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:43.548638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602274579554417:11019]
2025-10-10T14:37:43.549315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:43.549819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:43.549874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:43.550218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:43.550278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.550284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.550286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.550287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.550288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.550290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.550291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.550292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.550294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.550296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.550297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.550299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.550300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.550307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.550322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.550327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.550331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.550336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.550341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.550346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.550350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.550354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.550359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.550363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.550367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.550372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.550381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.550390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.550397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.550405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.550417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.550423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.550429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.550435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.550441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.550447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.550452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.550458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.550463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.550469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.550473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.550480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.550486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.550492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.550497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.550503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.550510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.550516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.550521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.550527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.550533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.550539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.550581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:43.554652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:43.555465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:43.555481Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:43.555486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:43.555490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:43.555498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2427 [2:7559602274579554417:11019]
2025-10-10T14:37:43.555512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:43.555533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:43.555536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.555540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.555543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.555562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:43.555571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:43.555580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:43.555644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.555652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.555654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.555657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:43.555731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:43.555739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.555751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.555766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.555790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:43.555819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786089:2438], now have 1 active actors on pipe
2025-10-10T14:37:43.555827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786284:10758], now have 1 active actors on pipe
2025-10-10T14:37:43.555835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602274579554412:11019]
2025-10-10T14:37:43.555838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602274579554412:11019]
2025-10-10T14:37:43.555841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602274579554412:11019]
2025-10-10T14:37:43.555857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:43.555877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:43.555895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:43.555898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:43.555913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:43.555917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:43.555919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:43.555931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602274579554412:11019]
2025-10-10T14:37:43.555940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:43.555958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:43.555885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2427
2025-10-10T14:37:43.555937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2427
2025-10-10T14:37:43.556082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.556093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.556141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:43.556156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.556166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.556169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:43.556182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.556199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:43.556236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.556397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.556405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.556421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.556515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2428 partition: 0 MaxSeqNo: 40 sessionId: src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0
2025-10-10T14:37:43.556917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a4fbe-37f4cb59-37ac381e-453b2261_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:43.559804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0] Write session: try to update token
2025-10-10T14:37:43.559827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:43.578583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2428 sessionId: src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:43.578959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:43.578981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:43.578985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:43.578987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:43.578997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602274579554412:11019]
2025-10-10T14:37:43.579002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602274579554412:11019]
2025-10-10T14:37:43.579006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602274579554412:11019]
2025-10-10T14:37:43.579060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:43.579073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.579077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:43.579221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:43.581310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:43.581600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:43.581615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:43.581620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:43.613152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602275361786360:10596]
2025-10-10T14:37:43.613625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2427, pipe: [1:7559602275361786360:10596]
2025-10-10T14:37:43.732591Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:43.733085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.733098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.733154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786360:10596], now have 1 active actors on pipe
2025-10-10T14:37:43.733694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:43.733751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602275361786360:10596]
2025-10-10T14:37:43.733792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:43.733869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0
2025-10-10T14:37:43.734055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2428 sessionId: src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0 is DEAD
2025-10-10T14:37:43.734206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:43.734462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:43.734471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0] Write session will restart in 0.007412s
2025-10-10T14:37:43.734496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0] Write session: Do CDS request
2025-10-10T14:37:43.734502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:43.742892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.744791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:43.744807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2429
2025-10-10T14:37:43.749427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.749497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:43.749505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:43.749510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:43.750086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2429 sessionId:  describe result for acl check
2025-10-10T14:37:43.750134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:43.750140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:43.750142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:43.750149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602275361786377:10762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:43.750818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602275361786377:10762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:43.752994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602275361786377:10762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:43.756314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602275361786377:10762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:43.756330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602275361786377:10762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:43.756335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602275361786377:10762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:43.756344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:43.773872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:43.777299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:43.777807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:43.777822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:43.777838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:43.777920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:43.777973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602274579554687:11021]
2025-10-10T14:37:43.778645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:43.782856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:43.782960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:43.783340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:43.783440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.783441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.783442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.783444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.783445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.783447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.783448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.783449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.783451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.783452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.783454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.783455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.783456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.783464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.783479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.783483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.783487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.783490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.783495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.783498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.783502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.783506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.783510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.783513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.783517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.783521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.783529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.783538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.783545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.783550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.783554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.783560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.783564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.783569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.783573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.783591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.783595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.783600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.783605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.783609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.783616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.783620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.783626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.783630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.783634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.783639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.783644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.783649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.783654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.783659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.783664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.783669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.783718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:43.787574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:43.788159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:43.788173Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:43.788176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:43.788181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:43.788188Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2428 [2:7559602274579554687:11021]
2025-10-10T14:37:43.788204Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:43.788226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:43.788236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.788239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.788242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.788261Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:43.788272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:43.788280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:43.788350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.788357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.788359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.788362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:43.788435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:43.788442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.788455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.788471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.788487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:43.788515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786408:10762], now have 1 active actors on pipe
2025-10-10T14:37:43.788525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786363:2438], now have 1 active actors on pipe
2025-10-10T14:37:43.788533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602274579554682:11021]
2025-10-10T14:37:43.788535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602274579554682:11021]
2025-10-10T14:37:43.788537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602274579554682:11021]
2025-10-10T14:37:43.788550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:43.788564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:43.788564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:43.788568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:43.788570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:43.788585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:43.788588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:43.788622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602274579554682:11021]
2025-10-10T14:37:43.788633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:43.788669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:43.788626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2428
2025-10-10T14:37:43.788669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2428
2025-10-10T14:37:43.788718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.788730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.788765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:43.788778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.788782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.788786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:43.788797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.788812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:43.788833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.789011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.789020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.789033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.789138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2429 partition: 0 MaxSeqNo: 40 sessionId: src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0
2025-10-10T14:37:43.789574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e1be4e4-7a5d0795-a15bd3d0-b64cc771_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:43.792545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0] Write session: try to update token
2025-10-10T14:37:43.792568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:43.813378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2429 sessionId: src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:43.814641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:43.814661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:43.814665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:43.814667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:43.814677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602274579554682:11021]
2025-10-10T14:37:43.814681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602274579554682:11021]
2025-10-10T14:37:43.814685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602274579554682:11021]
2025-10-10T14:37:43.814734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:43.814741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:43.814742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:43.814745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:43.814750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.814753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:43.814918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:43.816224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:43.837454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602275361786641:10596]
2025-10-10T14:37:43.839250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2428, pipe: [1:7559602275361786641:10596]
2025-10-10T14:37:43.933094Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:43.933408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.933422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.933463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786641:10596], now have 1 active actors on pipe
2025-10-10T14:37:43.933684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:43.933737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602275361786641:10596]
2025-10-10T14:37:43.933770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:43.933857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2429 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0
2025-10-10T14:37:43.934037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2429 sessionId: src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0 is DEAD
2025-10-10T14:37:43.934175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:43.934184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0] Write session will restart in 0.007357s
2025-10-10T14:37:43.934208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0] Write session: Do CDS request
2025-10-10T14:37:43.934214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:43.934199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:43.942999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.945614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:43.945641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2430
2025-10-10T14:37:43.945879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:43.945983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:43.945999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:43.946006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:43.946475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2430 sessionId:  describe result for acl check
2025-10-10T14:37:43.946520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:43.946524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:43.946526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:43.946532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602275361786669:10773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:43.947248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602275361786669:10773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:43.949712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602275361786669:10773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:43.957143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602275361786669:10773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:43.957160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602275361786669:10773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:43.957164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602275361786669:10773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:43.957173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:43.985452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:43.989195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:43.989476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:43.989493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:43.989505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:43.989568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:43.989615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602274579554993:11034]
2025-10-10T14:37:43.990272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:43.990701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:43.990752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:43.991103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:43.991174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.991181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.991183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.991184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.991185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.991186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.991188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.991189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.991190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.991192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.991193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.991195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.991196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.991203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.991217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.991222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.991226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.991231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.991236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.991241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.991246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.991250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.991255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.991259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.991262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.991266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.991277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.991286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:43.991294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.991299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:43.991305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.991316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:43.991321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.991328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:43.991337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.991343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:43.991349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.991354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:43.991363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.991369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:43.991375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.991384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:43.991389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.991409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:43.991416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.991422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:43.991426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.991431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.991437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.991442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.991446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.991453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.991489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:43.994221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:43.995050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:43.995064Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:43.995067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:43.995071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:43.995079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2429 [2:7559602274579554993:11034]
2025-10-10T14:37:43.995092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:43.995111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:43.995119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.995123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.995126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.995145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:43.995157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:43.995165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:43.995229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.995240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.995242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.995245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:43.995323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:43.995335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:43.995348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:43.995361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:43.995379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:43.995403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786700:10773], now have 1 active actors on pipe
2025-10-10T14:37:43.995407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602275361786659:2438], now have 1 active actors on pipe
2025-10-10T14:37:43.995415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602274579554988:11034]
2025-10-10T14:37:43.995418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602274579554988:11034]
2025-10-10T14:37:43.995421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602274579554988:11034]
2025-10-10T14:37:43.995435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:43.995450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:43.995474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:43.995477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:43.995510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602274579554988:11034]
2025-10-10T14:37:43.995513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:43.995559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:43.995562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:43.995565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:43.995571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:43.995669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2429
2025-10-10T14:37:43.995706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2429
2025-10-10T14:37:43.995994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.996008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.996046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:43.996060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:43.996065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:43.996068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:43.996081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:43.996093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:43.996112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.996312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:43.996323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:43.996347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:43.996435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2430 partition: 0 MaxSeqNo: 40 sessionId: src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0
2025-10-10T14:37:43.996831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a10b723-2c667ca3-cdc40b13-163516f1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:43.999813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0] Write session: try to update token
2025-10-10T14:37:43.999834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:44.022425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:44.022446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:44.022450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:44.022452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:44.022462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602274579554988:11034]
2025-10-10T14:37:44.022467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602274579554988:11034]
2025-10-10T14:37:44.022475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602274579554988:11034]
2025-10-10T14:37:44.022530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:44.022538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.022541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:44.022709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:44.025419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:44.025427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:44.025432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:44.026525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2430 sessionId: src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:44.029236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:44.033963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602279656754235:10596]
2025-10-10T14:37:44.034331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2429, pipe: [1:7559602279656754235:10596]
2025-10-10T14:37:44.142673Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:44.142986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.143001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.143050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754235:10596], now have 1 active actors on pipe
2025-10-10T14:37:44.143344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:44.143335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602279656754235:10596]
2025-10-10T14:37:44.143344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:44.143348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:44.143386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:44.143428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2430 reason: error at write: Disconnected sessionId: src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0
2025-10-10T14:37:44.143640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2430 sessionId: src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0 is DEAD
2025-10-10T14:37:44.144008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:44.144020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0] Write session will restart in 0.009955s
2025-10-10T14:37:44.144047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0] Write session: Do CDS request
2025-10-10T14:37:44.144055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:44.154949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.154990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:44.155006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2431
2025-10-10T14:37:44.155207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.155247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:44.155253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:44.155266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:44.155963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2431 sessionId:  describe result for acl check
2025-10-10T14:37:44.156002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:44.156008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:44.156010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:44.156017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602279656754290:10780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:44.156580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602279656754290:10780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:44.159404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602279656754290:10780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:44.163027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602279656754290:10780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:44.163042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602279656754290:10780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:44.163045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602279656754290:10780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:44.163054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:44.170343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:44.171029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:44.171276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:44.171289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:44.171302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:44.171356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:44.171402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602278874522560:11039]
2025-10-10T14:37:44.172089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:44.172417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:44.172471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:44.172851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:44.172910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.172917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.172918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.172919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.172921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.172922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.172923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.172924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.172926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.172927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.172928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.172929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.172930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.172936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.172949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.172952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.172956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.172959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.172964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.172968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.172971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.172975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.172980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.172983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.172987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.172991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.172998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.173006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.173012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.173017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.173021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.173026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.173030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.173035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.173040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.173045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.173048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.173053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.173059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.173063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.173068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.173072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.173080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.173084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.173088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.173092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.173097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.173102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.173106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.173111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.173115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.173119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.173157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:44.175677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:44.176213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:44.176224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:44.176227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:44.176231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:44.176238Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2430 [2:7559602278874522560:11039]
2025-10-10T14:37:44.176252Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:44.176268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:44.176276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.176280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.176282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.176300Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:44.176308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:44.176316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:44.176378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.176390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.176392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.176395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:44.176463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:44.176470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.176481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.176496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.176515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:44.176611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2430
2025-10-10T14:37:44.176672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2430
2025-10-10T14:37:44.176540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754237:2438], now have 1 active actors on pipe
2025-10-10T14:37:44.176547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754463:10780], now have 1 active actors on pipe
2025-10-10T14:37:44.176555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602278874522555:11039]
2025-10-10T14:37:44.176557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602278874522555:11039]
2025-10-10T14:37:44.176559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602278874522555:11039]
2025-10-10T14:37:44.176572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:44.176586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:44.176601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:44.176604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:44.176626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:44.176629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:44.176630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602278874522555:11039]
2025-10-10T14:37:44.176633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:44.176635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:44.176640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:44.176789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.176804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.176845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:44.176860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.176870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.176873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:44.176887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.176904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:44.176926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.177175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.177186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.177209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.177311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2431 partition: 0 MaxSeqNo: 40 sessionId: src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0
2025-10-10T14:37:44.177799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c2377b6-6485cb33-2f6dabf9-88d4bb0f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:44.180647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0] Write session: try to update token
2025-10-10T14:37:44.180664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:44.188484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:44.188497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:44.188510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602278874522555:11039]
2025-10-10T14:37:44.188564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:44.188605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:44.188758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:44.188895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:44.189051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:44.189189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:44.189416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:44.189452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:44.200769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2431 sessionId: src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:44.203815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:44.204084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.204104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.204158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:44.208956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:44.208973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:44.208977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:44.208979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:44.208994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602278874522555:11039]
2025-10-10T14:37:44.208997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602278874522555:11039]
2025-10-10T14:37:44.209001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602278874522555:11039]
2025-10-10T14:37:44.209049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:44.204265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:44.209056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:44.209060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.209063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:44.209068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:44.209072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:44.209197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:44.243940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602279656754510:10596]
2025-10-10T14:37:44.244231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2430, pipe: [1:7559602279656754510:10596]
2025-10-10T14:37:44.332080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:44.340646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.340673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.340859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.340929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.340992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.341054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.341093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.341098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.341172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.341230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.341291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.341481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.341524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.341528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.341599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.341662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.341722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.341782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.341824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.341827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.341937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.341998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.342058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.342119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.342158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.342162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.342232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.342291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.342355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.342418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.342460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.342463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.342530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.342585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.342648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.342708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.342751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.342754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.342824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.342882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.342960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.343023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.343066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.343069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.343161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.343220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.343278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.343347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.343409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.343412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.343480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.343540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.343602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.343661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.343706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.343710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.343777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.343833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.343889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.343948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.344005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.344008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.344078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754510:10596], now have 1 active actors on pipe
2025-10-10T14:37:44.345203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:44.345217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0] Write session will restart in 0.009403s
2025-10-10T14:37:44.345243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0] Write session: Do CDS request
2025-10-10T14:37:44.345249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:44.344404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602279656754510:10596]
2025-10-10T14:37:44.344432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:44.344620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:44.344623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:44.344658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2431 reason: error at write: Disconnected sessionId: src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0
2025-10-10T14:37:44.344876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2431 sessionId: src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0 is DEAD
2025-10-10T14:37:44.346138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:44.355909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.356283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:44.356297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2432
2025-10-10T14:37:44.356457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.356514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:44.356527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:44.356531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:44.357755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2432 sessionId:  describe result for acl check
2025-10-10T14:37:44.357795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:44.357800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:44.357802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:44.357809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602279656754549:10785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:44.358377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602279656754549:10785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:44.362006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602279656754549:10785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:44.365443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602279656754549:10785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:44.365458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602279656754549:10785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:44.365462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602279656754549:10785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:44.365473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:44.370462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:44.374097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:44.374345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:44.374359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:44.374371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:44.374432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:44.374479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602278874522842:11042]
2025-10-10T14:37:44.375153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:44.375513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:44.375579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:44.375919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:44.375986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.375993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.375994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.375996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.375997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.375998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.376000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.376001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.376002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.376004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.376005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.376007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.376008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.376015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.376029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.376034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.376038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.376042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.376047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.376051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.376055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.376060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.376065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.376070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.376074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.376079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.376088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.376103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.376115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.376121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.376126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.376131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.376137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.376142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.376149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.376154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.376163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.376169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.376180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.376185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.376194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.376200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.376207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.376217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.376223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.376233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.376238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.376248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.376253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.376263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.376268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.376274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.376325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:44.379014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:44.380071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:44.380089Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:44.380091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:44.380095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:44.380103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2431 [2:7559602278874522842:11042]
2025-10-10T14:37:44.380121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:44.380141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:44.380150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.380153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.380156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.380175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:44.380183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:44.380198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:44.380272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.380278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.380280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.380284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:44.380359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:44.380368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.380381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.380392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.380413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:44.380443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754524:2438], now have 1 active actors on pipe
2025-10-10T14:37:44.380448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754709:10785], now have 1 active actors on pipe
2025-10-10T14:37:44.380456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602278874522837:11042]
2025-10-10T14:37:44.380458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602278874522837:11042]
2025-10-10T14:37:44.380459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602278874522837:11042]
2025-10-10T14:37:44.380476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:44.380492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:44.380519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:44.380522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:44.380503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2431
2025-10-10T14:37:44.380559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602278874522837:11042]
2025-10-10T14:37:44.380533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2431
2025-10-10T14:37:44.380562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:44.380565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:44.380567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:44.380568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:44.380575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:44.380635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.380647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.380680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:44.380693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.380698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.380701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:44.380713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.380725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:44.380746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.380971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.380980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.380998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.381150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2432 partition: 0 MaxSeqNo: 40 sessionId: src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0
2025-10-10T14:37:44.381554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9bb6136-4d8018e1-d32f23fc-bf854dec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:44.384377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0] Write session: try to update token
2025-10-10T14:37:44.384399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:44.402949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:44.402972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:44.402976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:44.402978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:44.402990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602278874522837:11042]
2025-10-10T14:37:44.402995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602278874522837:11042]
2025-10-10T14:37:44.402999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602278874522837:11042]
2025-10-10T14:37:44.403053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:44.403057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:44.403061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.403064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:44.403064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:44.403072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:44.403211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:44.407472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2432 sessionId: src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:44.410478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:44.443614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602279656754798:10596]
2025-10-10T14:37:44.443967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2431, pipe: [1:7559602279656754798:10596]
2025-10-10T14:37:44.520821Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:44.521258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.521275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.521322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754798:10596], now have 1 active actors on pipe
2025-10-10T14:37:44.521575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:44.521634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:44.521709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602279656754798:10596]
2025-10-10T14:37:44.521735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:44.521832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2432 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0
2025-10-10T14:37:44.522059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2432 sessionId: src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0 is DEAD
2025-10-10T14:37:44.522188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:44.522199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0] Write session will restart in 0.006637s
2025-10-10T14:37:44.522222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0] Write session: Do CDS request
2025-10-10T14:37:44.522227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:44.529889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.529987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:44.530005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2433
2025-10-10T14:37:44.530199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.530241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:44.530253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:44.530257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:44.530879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2433 sessionId:  describe result for acl check
2025-10-10T14:37:44.530930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:44.530940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:44.530942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:44.530950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602279656754817:10789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:44.531576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602279656754817:10789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:44.534451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602279656754817:10789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:44.538995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602279656754817:10789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:44.539012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602279656754817:10789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:44.539016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602279656754817:10789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:44.539027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:44.545793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:44.549256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:44.549523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:44.549535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:44.549549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:44.549608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:44.549656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602278874523114:11044]
2025-10-10T14:37:44.550281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:44.550589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:44.550636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:44.550972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:44.551036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.551042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.551044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.551045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.551046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.551048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.551049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.551051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.551052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.551053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.551054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.551055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.551057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.551067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.551082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.551086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.551090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.551095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.551099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.551103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.551108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.551112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.551116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.551120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.551125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.551128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.551136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.551146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.551158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.551169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.551173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.551179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.551184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.551190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.551195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.551201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.551209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.551214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.551218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.551224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.551234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.551239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.551244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.551250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.551259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.551265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.551275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.551281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.551290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.551296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.551305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.551310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.551354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:44.553891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:44.554241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:44.554253Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:44.554256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:44.554261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:44.554268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2432 [2:7559602278874523114:11044]
2025-10-10T14:37:44.554282Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:44.554303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:44.554307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.554311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.554314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.554333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:44.554349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:44.554362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:44.554431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.554438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.554440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.554443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:44.554516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:44.554526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.554540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.554552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.554571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:44.554594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754800:2438], now have 1 active actors on pipe
2025-10-10T14:37:44.554603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656754936:10789], now have 1 active actors on pipe
2025-10-10T14:37:44.554612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602278874523109:11044]
2025-10-10T14:37:44.554615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602278874523109:11044]
2025-10-10T14:37:44.554617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602278874523109:11044]
2025-10-10T14:37:44.554633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:44.554655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:44.554659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:44.554662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:44.554664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:44.554677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:44.554681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:44.554712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602278874523109:11044]
2025-10-10T14:37:44.554668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2432
2025-10-10T14:37:44.554726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:44.554728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:44.554725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2432
2025-10-10T14:37:44.554775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.554787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.554818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|807281a6-e807909-eb5e88cb-9967bb6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:44.554827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.554832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.554834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:44.554847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.554858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:44.554873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.555109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.555119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.555138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.555298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2433 partition: 0 MaxSeqNo: 40 sessionId: src_id|807281a6-e807909-eb5e88cb-9967bb6a_0
2025-10-10T14:37:44.555749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75767a6f-fcfcf25-c9d8d5a9-bfb5387c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|807281a6-e807909-eb5e88cb-9967bb6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:44.558563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|807281a6-e807909-eb5e88cb-9967bb6a_0] Write session: try to update token
2025-10-10T14:37:44.558581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|807281a6-e807909-eb5e88cb-9967bb6a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:44.566582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:44.566597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:44.566609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602278874523109:11044]
2025-10-10T14:37:44.566665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:44.566665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:44.566849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:44.567017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:44.567169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:44.567306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:44.567500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:44.567540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:44.573715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2433 sessionId: src_id|807281a6-e807909-eb5e88cb-9967bb6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:44.576577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:44.576820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.576841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.576887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:44.576978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:44.585125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:44.585147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:44.585151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:44.585153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:44.585164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602278874523109:11044]
2025-10-10T14:37:44.585168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602278874523109:11044]
2025-10-10T14:37:44.585172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602278874523109:11044]
2025-10-10T14:37:44.585224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:44.585233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.585234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:44.585235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:44.585240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:44.585243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:44.585405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:44.621784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602279656755079:10596]
2025-10-10T14:37:44.622076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2432, pipe: [1:7559602279656755079:10596]
2025-10-10T14:37:44.707461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:44.716853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.716887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.717089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.717176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.717239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.717305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.717760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.717773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.717858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.717930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.717994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.718066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.718115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.718123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.718245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.718310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.718380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.718452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.718500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.718511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.718589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.718661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.718744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.718839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.718903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.718911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.718992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.719060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.719132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.719198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.719248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.719258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.719331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.721156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:44.721169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:44.721172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:44.721218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2433 reason: error at write: Disconnected sessionId: src_id|807281a6-e807909-eb5e88cb-9967bb6a_0
2025-10-10T14:37:44.721219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602279656755079:10596]
2025-10-10T14:37:44.719396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.719466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.719532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.719576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.719579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.719652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.719711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.719779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.719840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.719881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.719884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.719954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.720019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.720080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.720137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.720181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.720184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.720252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.720314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.720379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.720445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.720490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.720493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.720561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:44.720618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:44.720688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:44.720753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:44.720797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:44.720802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:44.720880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656755079:10596], now have 1 active actors on pipe
2025-10-10T14:37:44.721481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2433 sessionId: src_id|807281a6-e807909-eb5e88cb-9967bb6a_0 is DEAD
2025-10-10T14:37:44.721603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807281a6-e807909-eb5e88cb-9967bb6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:44.721611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807281a6-e807909-eb5e88cb-9967bb6a_0] Write session will restart in 0.005436s
2025-10-10T14:37:44.721643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807281a6-e807909-eb5e88cb-9967bb6a_0] Write session: Do CDS request
2025-10-10T14:37:44.721650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807281a6-e807909-eb5e88cb-9967bb6a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:44.721826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:44.729086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|807281a6-e807909-eb5e88cb-9967bb6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.729167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:44.729184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2434
2025-10-10T14:37:44.729286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.729346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:44.729359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:44.729364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:44.729923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2434 sessionId:  describe result for acl check
2025-10-10T14:37:44.729965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:44.729967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:44.729972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:44.729979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602279656755098:10793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:44.730540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602279656755098:10793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:44.734248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602279656755098:10793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:44.738454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602279656755098:10793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:44.738472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602279656755098:10793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:44.738476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602279656755098:10793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:44.738487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:44.744982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:44.748318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:44.748744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:44.748762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:44.748777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:44.748865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:44.748913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602278874523388:11046]
2025-10-10T14:37:44.749565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:44.749965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:44.750045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:44.750434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:44.750533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.750544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.750545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.750547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.750548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.750550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.750551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.750552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.750554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.750556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.750558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.750559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.750560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.750568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.750582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.750586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.750590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.750594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.750598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.750602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.750605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.750608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.750613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.750617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.750621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.750625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.750633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.750643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.750651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.750656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.750661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.750679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.750691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.750697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.750702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.750708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.750712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.750718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.750723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.750729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.750733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.750740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.750745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.750750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.750755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.750760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.750765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.750770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.750775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.750781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.750786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.750791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.750832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:44.754419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:44.755077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:44.755093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:44.755096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:44.755101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:44.755108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2433 [2:7559602278874523388:11046]
2025-10-10T14:37:44.755126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:44.755146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:44.755155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.755159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.755162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.755183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:44.755196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:44.755207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:44.755284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.755291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.755293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.755296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:44.755375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:44.755383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.755398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.755412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.755432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:44.755458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656755083:2438], now have 1 active actors on pipe
2025-10-10T14:37:44.755472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602278874523383:11046]
2025-10-10T14:37:44.755478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602278874523383:11046]
2025-10-10T14:37:44.755481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602278874523383:11046]
2025-10-10T14:37:44.755495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:44.755507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2433
2025-10-10T14:37:44.755510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:44.755517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:44.755520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:44.755522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:44.755535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:44.755538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:44.755546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656755229:10793], now have 1 active actors on pipe
2025-10-10T14:37:44.755569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2433
2025-10-10T14:37:44.755581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602278874523383:11046]
2025-10-10T14:37:44.755590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:44.755592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:44.755612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.755621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.755676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34fa63e9-49df3ad6-59230702-cec6738d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:44.755690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.755709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.755712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:44.755724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.755740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:44.755767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.756160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.756171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.756194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.756294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2434 partition: 0 MaxSeqNo: 40 sessionId: src_id|34fa63e9-49df3ad6-59230702-cec6738d_0
2025-10-10T14:37:44.756720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|807281a6-e807909-eb5e88cb-9967bb6a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|34fa63e9-49df3ad6-59230702-cec6738d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:44.759489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fa63e9-49df3ad6-59230702-cec6738d_0] Write session: try to update token
2025-10-10T14:37:44.759513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fa63e9-49df3ad6-59230702-cec6738d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:44.774551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2434 sessionId: src_id|34fa63e9-49df3ad6-59230702-cec6738d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:44.775684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:44.775702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:44.775705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:44.775708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:44.775718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602278874523383:11046]
2025-10-10T14:37:44.775724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602278874523383:11046]
2025-10-10T14:37:44.775728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602278874523383:11046]
2025-10-10T14:37:44.775778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:44.775786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.775793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:44.775946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:44.776005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:44.776017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:44.776023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:44.777493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:44.821437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602279656755368:10596]
2025-10-10T14:37:44.821760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2433, pipe: [1:7559602279656755368:10596]
2025-10-10T14:37:44.890824Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:44.891173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.891202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.891261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656755368:10596], now have 1 active actors on pipe
2025-10-10T14:37:44.891514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:44.892003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fa63e9-49df3ad6-59230702-cec6738d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:44.892016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fa63e9-49df3ad6-59230702-cec6738d_0] Write session will restart in 0.007807s
2025-10-10T14:37:44.892044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fa63e9-49df3ad6-59230702-cec6738d_0] Write session: Do CDS request
2025-10-10T14:37:44.892050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fa63e9-49df3ad6-59230702-cec6738d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:44.891504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:44.891520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:44.891537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602279656755368:10596]
2025-10-10T14:37:44.891571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:44.891583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2434 reason: error at write: Disconnected sessionId: src_id|34fa63e9-49df3ad6-59230702-cec6738d_0
2025-10-10T14:37:44.891794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2434 sessionId: src_id|34fa63e9-49df3ad6-59230702-cec6738d_0 is DEAD
2025-10-10T14:37:44.900888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fa63e9-49df3ad6-59230702-cec6738d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.900976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:44.900993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2435
2025-10-10T14:37:44.901121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:44.901151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:44.901157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:44.901161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:44.901562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2435 sessionId:  describe result for acl check
2025-10-10T14:37:44.901612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:44.901619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:44.901621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:44.901627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602279656755395:10798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:44.902222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602279656755395:10798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:44.905318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602279656755395:10798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:44.908658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602279656755395:10798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:44.908671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602279656755395:10798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:44.908675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602279656755395:10798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:44.908683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:44.913527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:44.916476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:44.916798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:44.916811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:44.916825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:44.916891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:44.916931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602278874523674:11048]
2025-10-10T14:37:44.917602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:44.917942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:44.918012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:44.918409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:44.918472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.918479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.918480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.918482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.918483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.918484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.918486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.918487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.918488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.918490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.918491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.918493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.918494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.918500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.918512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.918516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.918521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.918525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.918529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.918533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.918537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.918541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.918547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.918551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.918555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.918560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.918566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.918575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:44.918582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.918588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:44.918593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.918598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:44.918603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.918608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:44.918613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.918618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:44.918622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.918628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:44.918632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.918637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:44.918642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.918648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:44.918652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.918658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:44.918662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.918669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:44.918673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.918678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.918683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.918688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.918692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.918698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.918737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:44.921669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:44.922237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:44.922248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:44.922250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:44.922255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:44.922262Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2434 [2:7559602278874523674:11048]
2025-10-10T14:37:44.922274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:44.922294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:44.922297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.922301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.922303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.922323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:44.922340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:44.922348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:44.922410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.922417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.922419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.922422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:44.922492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:44.922501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.922513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:44.922524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:44.922545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:44.922568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656755554:10798], now have 1 active actors on pipe
2025-10-10T14:37:44.922577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656755370:2438], now have 1 active actors on pipe
2025-10-10T14:37:44.922585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602278874523669:11048]
2025-10-10T14:37:44.922588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602278874523669:11048]
2025-10-10T14:37:44.922591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602278874523669:11048]
2025-10-10T14:37:44.922604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:44.922624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:44.922643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:44.922642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:44.922647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:44.922649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:44.922651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:44.922686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602278874523669:11048]
2025-10-10T14:37:44.922693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:44.922698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:44.922659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2434
2025-10-10T14:37:44.922667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2434
2025-10-10T14:37:44.922723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.922732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.922773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:44.922786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:44.922795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:44.922797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:44.922808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:44.922819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:44.922839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.923029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:44.923037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:44.923053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:44.923144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2435 partition: 0 MaxSeqNo: 40 sessionId: src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0
2025-10-10T14:37:44.923593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fa63e9-49df3ad6-59230702-cec6738d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:44.926392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0] Write session: try to update token
2025-10-10T14:37:44.926413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:44.941324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2435 sessionId: src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:44.942495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:44.942516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:44.942519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:44.942521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:44.942531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602278874523669:11048]
2025-10-10T14:37:44.942536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602278874523669:11048]
2025-10-10T14:37:44.942539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602278874523669:11048]
2025-10-10T14:37:44.942591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:44.942594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:44.942603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:44.942605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:44.942606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:44.942610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:44.942751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:44.944111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:44.991450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602279656755660:10596]
2025-10-10T14:37:44.991808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2434, pipe: [1:7559602279656755660:10596]
2025-10-10T14:37:45.058724Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:45.059131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.059147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.059194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602279656755660:10596], now have 1 active actors on pipe
2025-10-10T14:37:45.059421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602279656755660:10596]
2025-10-10T14:37:45.059444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:45.059448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:45.059464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:45.059512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2435 reason: error at write: Disconnected sessionId: src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0
2025-10-10T14:37:45.059727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2435 sessionId: src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0 is DEAD
2025-10-10T14:37:45.059902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:45.059912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0] Write session will restart in 0.005341s
2025-10-10T14:37:45.059936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0] Write session: Do CDS request
2025-10-10T14:37:45.059943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:45.059460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:45.066947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.067041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:45.067057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2436
2025-10-10T14:37:45.067195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.067241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:45.067256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:45.067261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:45.067688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2436 sessionId:  describe result for acl check
2025-10-10T14:37:45.067725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:45.067731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:45.067733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:45.067739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602283951722985:10811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:45.068364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602283951722985:10811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:45.071526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602283951722985:10811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:45.075571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602283951722985:10811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:45.075586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602283951722985:10811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:45.075590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602283951722985:10811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:45.075599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:45.084073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:45.086956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:45.087218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:45.087232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:45.087245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:45.087310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:45.087377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602283169491271:11063]
2025-10-10T14:37:45.088015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:45.088451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:45.088532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:45.088877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:45.088967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.088975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.088976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.088977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.088978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.088980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.088981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.088982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.088984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.088985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.088986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.088987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.088988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.088995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.089008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.089012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.089017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.089021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.089025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.089029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.089034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.089038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.089042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.089046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.089050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.089054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.089065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.089074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.089081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.089088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.089096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.089101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.089105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.089111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.089116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.089121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.089125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.089131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.089136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.089142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.089147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.089152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.089161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.089185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.089191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.089196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.089201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.089206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.089210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.089217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.089230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.089235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.089272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:45.092235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:45.092766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:45.092777Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:45.092779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:45.092784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:45.092792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2435 [2:7559602283169491271:11063]
2025-10-10T14:37:45.092807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:45.092828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:45.092832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.092836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.092839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.092859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:45.092867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:45.092876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:45.092956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.092966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.092968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.092971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:45.093044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:45.093054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.093067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.093079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.093097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:45.093125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723092:10811], now have 1 active actors on pipe
2025-10-10T14:37:45.093129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951722972:2438], now have 1 active actors on pipe
2025-10-10T14:37:45.093137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602283169491264:11063]
2025-10-10T14:37:45.093140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602283169491264:11063]
2025-10-10T14:37:45.093142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602283169491264:11063]
2025-10-10T14:37:45.093157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:45.093176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:45.093193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:45.093196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:45.093200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:45.093204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:45.093205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:45.093234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602283169491264:11063]
2025-10-10T14:37:45.093247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:45.093253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:45.093209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2435
2025-10-10T14:37:45.093255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2435
2025-10-10T14:37:45.093477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.093490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.093526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:45.093536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.093541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.093544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:45.093558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.093581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:45.093599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.093853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.093861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.093880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.094005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2436 partition: 0 MaxSeqNo: 40 sessionId: src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0
2025-10-10T14:37:45.094514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9461784-47173e9d-2fced965-d8e3a8ca_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:45.097316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0] Write session: try to update token
2025-10-10T14:37:45.097359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:45.105647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:45.105667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:45.105679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602283169491264:11063]
2025-10-10T14:37:45.105724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:45.105732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:45.105916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:45.106068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.106219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.106357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.106547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:45.106592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:45.113834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2436 sessionId: src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:45.116877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:45.117145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.117170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.117216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:45.117321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:45.123815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:45.123833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:45.123837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:45.123838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:45.123850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602283169491264:11063]
2025-10-10T14:37:45.123854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602283169491264:11063]
2025-10-10T14:37:45.123857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602283169491264:11063]
2025-10-10T14:37:45.123905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:45.123911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:45.123912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:45.123918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:45.123919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.123921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:45.124062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:45.159351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602283951723249:10596]
2025-10-10T14:37:45.159709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2435, pipe: [1:7559602283951723249:10596]
2025-10-10T14:37:45.241946Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:45.251218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.251249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.251434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.251505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.251576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.251650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.251693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.251698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.251771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.251829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.251888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.251954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.251999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.252002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.252073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.252133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.252192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.252259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.252304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.252308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.252379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.252446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.252507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.252567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.252611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.252615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.252684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.252745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.252804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.252866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.252912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.252915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.252984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.253047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.253108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.253169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.253236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.253243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.253312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.253570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.253646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.253716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.253760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.253764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.253835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.253896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.253959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.254028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.254073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.254076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.254145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.254205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.254269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.254331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.254378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.254381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.254454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.254512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.254571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.254637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.254682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.254686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.254765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723249:10596], now have 1 active actors on pipe
2025-10-10T14:37:45.255676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:45.255691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0] Write session will restart in 0.009444s
2025-10-10T14:37:45.255717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0] Write session: Do CDS request
2025-10-10T14:37:45.255723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:45.255216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602283951723249:10596]
2025-10-10T14:37:45.255262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:45.255266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:45.255299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2436 reason: error at write: Disconnected sessionId: src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0
2025-10-10T14:37:45.255496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:45.255518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2436 sessionId: src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0 is DEAD
2025-10-10T14:37:45.256363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:45.266996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.267089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:45.267109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2437
2025-10-10T14:37:45.267307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.267358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:45.267370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:45.267375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:45.267822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2437 sessionId:  describe result for acl check
2025-10-10T14:37:45.267859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:45.267861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:45.267862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:45.267869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602283951723277:10815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:45.268423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602283951723277:10815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:45.271885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602283951723277:10815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:45.277087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602283951723277:10815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:45.277100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602283951723277:10815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:45.277104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602283951723277:10815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:45.277113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:45.282788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:45.285936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:45.286190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:45.286206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:45.286219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:45.286282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:45.286335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602283169491558:11067]
2025-10-10T14:37:45.287028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:45.287403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:45.287468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:45.287837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:45.287899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.287906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.287908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.287909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.287910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.287911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.287912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.287913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.287915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.287916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.287917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.287918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.287920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.287926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.287938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.287942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.287946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.287949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.287953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.287956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.287960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.287964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.287968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.287972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.287975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.287979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.287987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.287995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.288003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.288009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.288012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.288017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.288022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.288027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.288031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.288036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.288040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.288045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.288050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.288060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.288064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.288069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.288073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.288078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.288082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.288087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.288091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.288097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.288101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.288105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.288109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.288114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.288150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:45.290821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:45.291356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:45.291372Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:45.291376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:45.291380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:45.291387Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2436 [2:7559602283169491558:11067]
2025-10-10T14:37:45.291402Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:45.291426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:45.291430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.291440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.291443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.291464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:45.291478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:45.291500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:45.291577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.291586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.291588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.291591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:45.291669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:45.291676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.291691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.291705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.291724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:45.291747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723251:2438], now have 1 active actors on pipe
2025-10-10T14:37:45.291756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723444:10815], now have 1 active actors on pipe
2025-10-10T14:37:45.291765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602283169491553:11067]
2025-10-10T14:37:45.291772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602283169491553:11067]
2025-10-10T14:37:45.291775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602283169491553:11067]
2025-10-10T14:37:45.291791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:45.291810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:45.291817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:45.291820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:45.291822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:45.291829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:45.291833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:45.291868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602283169491553:11067]
2025-10-10T14:37:45.291889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:45.291862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2436
2025-10-10T14:37:45.291868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2436
2025-10-10T14:37:45.291922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:45.292099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.292105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.292137Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:45.292150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.292155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.292158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:45.292170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.292186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:45.292206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.292399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.292410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.292425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.292524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2437 partition: 0 MaxSeqNo: 40 sessionId: src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0
2025-10-10T14:37:45.297599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43ed7f39-b52ec865-7b322b2a-34be8d2a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:45.300675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0] Write session: try to update token
2025-10-10T14:37:45.300697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:45.304358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:45.304378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:45.304389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602283169491553:11067]
2025-10-10T14:37:45.304440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:45.304447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:45.304613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:45.304754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.304892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.305031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.305225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:45.305269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:45.316878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2437 sessionId: src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:45.319743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:45.320040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.320062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.320104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:45.320223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:45.326352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:45.326374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:45.326378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:45.326380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:45.326392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602283169491553:11067]
2025-10-10T14:37:45.326396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602283169491553:11067]
2025-10-10T14:37:45.326400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602283169491553:11067]
2025-10-10T14:37:45.326454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:45.326469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.326476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:45.326614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:45.329393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:45.329415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:45.329421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:45.355464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602283951723542:10596]
2025-10-10T14:37:45.355809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2436, pipe: [1:7559602283951723542:10596]
2025-10-10T14:37:45.446231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:45.454772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.454800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.454985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.455045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.455110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.455187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.455233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.455239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.455312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.455366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.455426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.455490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.455529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.455532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.455597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.455654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.455722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.455784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.455824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.455829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.455896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.455963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.456023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.456088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.456140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.456143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.456216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.456281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.456340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.456400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.456441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.456444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.456515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.456574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.456631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.456694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.456738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.456742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.456813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.456868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.456925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.456991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.457033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.457036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.457102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.457159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.457229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.457290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.457563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.457576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.457648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.457715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.457779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.457853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.457900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.457909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.457982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.458044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.458112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.458181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.458229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.458231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.458299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723542:10596], now have 1 active actors on pipe
2025-10-10T14:37:45.458601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602283951723542:10596]
2025-10-10T14:37:45.458629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:45.458649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:45.458652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:45.459092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:45.459102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0] Write session will restart in 0.009480s
2025-10-10T14:37:45.459128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0] Write session: Do CDS request
2025-10-10T14:37:45.459135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:45.458683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2437 reason: error at write: Disconnected sessionId: src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0
2025-10-10T14:37:45.458931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2437 sessionId: src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0 is DEAD
2025-10-10T14:37:45.459426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:45.469930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.470012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:45.470028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2438
2025-10-10T14:37:45.473020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.473071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:45.473077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:45.473081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:45.473543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2438 sessionId:  describe result for acl check
2025-10-10T14:37:45.473575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:45.473577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:45.473579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:45.473586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602283951723629:10820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:45.474293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602283951723629:10820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:45.478098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602283951723629:10820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:45.482120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602283951723629:10820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:45.482134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602283951723629:10820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:45.482137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602283951723629:10820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:45.482145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:45.485653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:45.488763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:45.488971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:45.488981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:45.488990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:45.489031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:45.489065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602283169491834:11069]
2025-10-10T14:37:45.489541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:45.489972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:45.490013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:45.490326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:45.490387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.490389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.490390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.490392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.490393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.490394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.490396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.490397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.490399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.490400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.490401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.490402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.490404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.490410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.490423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.490427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.490431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.490436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.490441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.490446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.490450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.490454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.490459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.490463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.490467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.490471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.490479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.490488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.490496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.490501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.490506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.490512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.490517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.490522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.490527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.490533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.490537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.490543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.490547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.490553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.490557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.490563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.490568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.490572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.490576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.490584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.490588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.490593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.490597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.490602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.490607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.490613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.490660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:45.493608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:45.494417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2437
2025-10-10T14:37:45.494417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2437
2025-10-10T14:37:45.495183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2438 partition: 0 MaxSeqNo: 40 sessionId: src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0
2025-10-10T14:37:45.495596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77e1f545-2c64e546-2cf078a0-91e1e323_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:45.493955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:45.493969Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:45.493972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:45.493977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:45.493983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2437 [2:7559602283169491834:11069]
2025-10-10T14:37:45.493998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:45.494018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:45.494021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.494025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.494027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.494047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:45.494065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:45.494076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:45.494149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.494151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.494153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.494156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:45.494233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:45.494237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.494249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.494272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.494290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:45.494314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723783:10820], now have 1 active actors on pipe
2025-10-10T14:37:45.494317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723544:2438], now have 1 active actors on pipe
2025-10-10T14:37:45.494326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602283169491829:11069]
2025-10-10T14:37:45.494338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602283169491829:11069]
2025-10-10T14:37:45.494341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602283169491829:11069]
2025-10-10T14:37:45.494353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:45.494369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:45.494385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:45.494390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:45.494400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:45.494402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:45.494405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:45.494424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602283169491829:11069]
2025-10-10T14:37:45.494427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:45.494472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:45.494647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.494652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.494684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:45.494708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.494713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.494716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:45.494729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.494743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:45.494758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.495009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.495016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.495042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.498586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0] Write session: try to update token
2025-10-10T14:37:45.498605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:45.518600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2438 sessionId: src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:45.519573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:45.519598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:45.519602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:45.519605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:45.519615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602283169491829:11069]
2025-10-10T14:37:45.519619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602283169491829:11069]
2025-10-10T14:37:45.519623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602283169491829:11069]
2025-10-10T14:37:45.519674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:45.519683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.519685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:45.519831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:45.521493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:45.521507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:45.521515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:45.521689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:45.558758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602283951723824:10596]
2025-10-10T14:37:45.559071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2437, pipe: [1:7559602283951723824:10596]
2025-10-10T14:37:45.657500Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:45.658182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.658195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.658245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723824:10596], now have 1 active actors on pipe
2025-10-10T14:37:45.658631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602283951723824:10596]
2025-10-10T14:37:45.658666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:45.658669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:45.658730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2438 reason: error at write: Disconnected sessionId: src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0
2025-10-10T14:37:45.658925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:45.658968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2438 sessionId: src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0 is DEAD
2025-10-10T14:37:45.658535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:45.661571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:45.661584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0] Write session will restart in 0.009991s
2025-10-10T14:37:45.661620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0] Write session: Do CDS request
2025-10-10T14:37:45.661631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:45.673069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.673155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:45.673181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2439
2025-10-10T14:37:45.673588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.673640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:45.673651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:45.673655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:45.675156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2439 sessionId:  describe result for acl check
2025-10-10T14:37:45.675194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:45.675199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:45.675202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:45.675209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602283951723899:10824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:45.675772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602283951723899:10824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:45.679151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602283951723899:10824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:45.686366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602283951723899:10824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:45.686386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602283951723899:10824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:45.686390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602283951723899:10824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:45.686408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:45.686401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:45.689780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:45.690036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:45.690048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:45.690060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:45.690130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:45.690173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602283169492111:11071]
2025-10-10T14:37:45.690823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:45.691204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:45.691261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:45.691585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:45.691642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.691648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.691649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.691650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.691652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.691653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.691655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.691665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.691667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.691668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.691669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.691671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.691672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.691678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.691692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.691696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.691700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.691704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.691708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.691712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.691716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.691720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.691725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.691728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.691732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.691736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.691744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.691752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.691758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.691763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.691768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.691772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.691776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.691781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.691786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.691790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.691794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.691799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.691803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.691807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.691819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.691824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.691828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.691833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.691837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.691842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.691846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.691851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.691855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.691860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.691864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.691869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.691910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:45.698914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:45.699267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:45.699284Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:45.699288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:45.699293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:45.699301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2438 [2:7559602283169492111:11071]
2025-10-10T14:37:45.699317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:45.699344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:45.699353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.699358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.699362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.699381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:45.699394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:45.699402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:45.699496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.699504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.699506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.699509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:45.699583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:45.699591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.699604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.699616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.699635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:45.699657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602283169492105:11071]
2025-10-10T14:37:45.699664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602283169492105:11071]
2025-10-10T14:37:45.699666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602283169492105:11071]
2025-10-10T14:37:45.699681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:45.699701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:45.699722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:45.699730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:45.699731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:45.699735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:45.699739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:45.699772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602283169492105:11071]
2025-10-10T14:37:45.699779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:45.699824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:45.699893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951723827:2438], now have 1 active actors on pipe
2025-10-10T14:37:45.699904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951724094:10824], now have 1 active actors on pipe
2025-10-10T14:37:45.701469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2438
2025-10-10T14:37:45.701526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2438
2025-10-10T14:37:45.702187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2439 partition: 0 MaxSeqNo: 40 sessionId: src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0
2025-10-10T14:37:45.701773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.701799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.701833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:45.701845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.701851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.701854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:45.701868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.701884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:45.701906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.702088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.702091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.702107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.702650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|495061c0-727b999c-2d5e63a8-32cb85b0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:45.705404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0] Write session: try to update token
2025-10-10T14:37:45.705425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:45.719157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:45.719179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:45.719192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602283169492105:11071]
2025-10-10T14:37:45.719249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:45.719457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:45.719622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.719790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.719944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:45.720154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:45.720204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:45.720453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:45.721437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2439 sessionId: src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:45.724065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:45.724331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.724355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.724398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:45.729385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:45.742431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:45.742454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:45.742458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:45.742460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:45.742471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602283169492105:11071]
2025-10-10T14:37:45.742477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602283169492105:11071]
2025-10-10T14:37:45.742482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602283169492105:11071]
2025-10-10T14:37:45.742538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:45.742548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:45.742552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.742555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:45.742556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:45.742561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:45.742703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:45.761415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602283951724109:10596]
2025-10-10T14:37:45.762111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2438, pipe: [1:7559602283951724109:10596]
2025-10-10T14:37:45.864324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:45.873681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.873713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.873909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.873971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.874035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.874100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.874153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.874159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.874239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.874323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.874392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.874457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.874499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.874502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.874573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.874638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.874705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.874779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.874823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.874827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.874919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.874991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.875061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.875128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.875175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.875178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.875254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.875319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.875387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.875456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.875502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.875505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.875582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.875649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.875714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.875779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.875827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.875831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.875907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.875966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.876033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.876096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.876142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.876145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.876215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.876275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.876334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.876395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.876441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.876444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.876512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.876569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.876635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.876699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.876742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.876745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.876818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:45.876881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:45.876943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:45.877004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:45.877044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:45.877047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:45.877127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951724109:10596], now have 1 active actors on pipe
2025-10-10T14:37:45.878974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:45.881520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:45.881543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:45.881589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602283951724109:10596]
2025-10-10T14:37:45.881604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2439 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0
2025-10-10T14:37:45.881829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2439 sessionId: src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0 is DEAD
2025-10-10T14:37:45.882191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:45.882203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0] Write session will restart in 0.009384s
2025-10-10T14:37:45.882238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0] Write session: Do CDS request
2025-10-10T14:37:45.882243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:45.892976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.893065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:45.893091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2440
2025-10-10T14:37:45.893234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:45.893279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:45.893291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:45.893296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:45.894012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2440 sessionId:  describe result for acl check
2025-10-10T14:37:45.894068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:45.894070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:45.894072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:45.894086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602283951724154:10829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:45.894669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602283951724154:10829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:45.898801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602283951724154:10829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:45.905136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602283951724154:10829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:45.905151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602283951724154:10829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:45.905155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602283951724154:10829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:45.905166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:45.908767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:45.911898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:45.912379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:45.912390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:45.912405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:45.912482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:45.912531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602283169492391:11073]
2025-10-10T14:37:45.913167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:45.913571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:45.913635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:45.914004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:45.914070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.914080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.914081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.914082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.914084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.914085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.914087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.914088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.914090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.914091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.914093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.914094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.914095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.914102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.914116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.914120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.914125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.914129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.914133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.914137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.914141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.914145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.914150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.914154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.914158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.914162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.914170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.914179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:45.914187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.914193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:45.914198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.914204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:45.914209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.914215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:45.914221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.914226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:45.914231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.914237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:45.914242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.914248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:45.914252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.914258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:45.914263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.914269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:45.914274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.914280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:45.914284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.914292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.914296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.914302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.914307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.914312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.914362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:45.917173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:45.917540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:45.917555Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:45.917557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:45.917562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:45.917584Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2439 [2:7559602283169492391:11073]
2025-10-10T14:37:45.917598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:45.917620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:45.917629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.917633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.917635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.917656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:45.917679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:45.917693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:45.917763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.917771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.917773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.917776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:45.917854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:45.917862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.917876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:45.917889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:45.917910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:45.917940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951724341:10829], now have 1 active actors on pipe
2025-10-10T14:37:45.917951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951724120:2438], now have 1 active actors on pipe
2025-10-10T14:37:45.917960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602283169492384:11073]
2025-10-10T14:37:45.917962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602283169492384:11073]
2025-10-10T14:37:45.917965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602283169492384:11073]
2025-10-10T14:37:45.917972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2439
2025-10-10T14:37:45.917975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2439
2025-10-10T14:37:45.917991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:45.918016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:45.918017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:45.918021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:45.918023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:45.918034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:45.918038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:45.918094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.918099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.918114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602283169492384:11073]
2025-10-10T14:37:45.918127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:45.918134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:45.918166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9550467-ac5f632d-b144011f-36397421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:45.918181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:45.918186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:45.918189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:45.918201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:45.918216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:45.918243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.918431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:45.918441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:45.918457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:45.918541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2440 partition: 0 MaxSeqNo: 40 sessionId: src_id|d9550467-ac5f632d-b144011f-36397421_0
2025-10-10T14:37:45.919003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b59025-5b73f6f1-24214c45-c23a56e2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d9550467-ac5f632d-b144011f-36397421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:45.921927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9550467-ac5f632d-b144011f-36397421_0] Write session: try to update token
2025-10-10T14:37:45.921950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9550467-ac5f632d-b144011f-36397421_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:45.943995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:45.944019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:45.944023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:45.944025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:45.944036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602283169492384:11073]
2025-10-10T14:37:45.944041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602283169492384:11073]
2025-10-10T14:37:45.944045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602283169492384:11073]
2025-10-10T14:37:45.944097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:45.944102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:45.944107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:45.944110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:45.944120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:45.944124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:45.944267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:45.944440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2440 sessionId: src_id|d9550467-ac5f632d-b144011f-36397421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:45.947499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:45.981678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602283951724402:10596]
2025-10-10T14:37:45.985593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2439, pipe: [1:7559602283951724402:10596]
2025-10-10T14:37:46.074196Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:46.074923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.074940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.074981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602283951724402:10596], now have 1 active actors on pipe
2025-10-10T14:37:46.077887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:46.077910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:46.077924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:46.077999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2440 reason: error at write: Disconnected sessionId: src_id|d9550467-ac5f632d-b144011f-36397421_0
2025-10-10T14:37:46.078099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:46.078145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602283951724402:10596]
2025-10-10T14:37:46.078204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2440 sessionId: src_id|d9550467-ac5f632d-b144011f-36397421_0 is DEAD
2025-10-10T14:37:46.081283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9550467-ac5f632d-b144011f-36397421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:46.081296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9550467-ac5f632d-b144011f-36397421_0] Write session will restart in 0.006273s
2025-10-10T14:37:46.081324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9550467-ac5f632d-b144011f-36397421_0] Write session: Do CDS request
2025-10-10T14:37:46.081354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9550467-ac5f632d-b144011f-36397421_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:46.088904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9550467-ac5f632d-b144011f-36397421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.088980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:46.088997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2441
2025-10-10T14:37:46.089532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.089580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:46.089586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:46.089591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:46.090099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2441 sessionId:  describe result for acl check
2025-10-10T14:37:46.090143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:46.090150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:46.090152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:46.090157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602288246691740:10842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:46.090601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602288246691740:10842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:46.093529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602288246691740:10842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:46.098060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602288246691740:10842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:46.098080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602288246691740:10842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:46.098084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602288246691740:10842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:46.098094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:46.130424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:46.134629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:46.134931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:46.134946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:46.134960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:46.135027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:46.135076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602287464460006:11088]
2025-10-10T14:37:46.135776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:46.136258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:46.136315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:46.136671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:46.136735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.136743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.136745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.136746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.136748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.136749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.136751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.136753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.136755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.136756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.136758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.136760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.136761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.136768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.136783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.136788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.136793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.136798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.136803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.136806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.136811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.136816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.136821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.136826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.136830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.136835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.136844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.136854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.136862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.136868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.136873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.136879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.136884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.136891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.136896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.136902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.136907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.136913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.136920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.136931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.136936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.136941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.136946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.136950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.136955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.136961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.136967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.136973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.136979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.136985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.136991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.136997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.137045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:46.141658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:46.142165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:46.142184Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:46.142187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:46.142192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:46.142204Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2440 [2:7559602287464460006:11088]
2025-10-10T14:37:46.142222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:46.142244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:46.142248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.142252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.142264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.142285Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:46.142293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:46.142303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:46.142375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.142384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.142386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.142390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:46.142472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:46.142482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.142497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.142515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.142540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:46.142563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602287464460001:11088]
2025-10-10T14:37:46.142571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602287464460001:11088]
2025-10-10T14:37:46.142574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602287464460001:11088]
2025-10-10T14:37:46.142591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:46.142612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:46.142636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:46.142644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:46.142689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602287464460001:11088]
2025-10-10T14:37:46.142697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:46.142792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:46.142800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:46.142805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:46.142811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:46.143146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246691726:2438], now have 1 active actors on pipe
2025-10-10T14:37:46.143157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246691767:10842], now have 1 active actors on pipe
2025-10-10T14:37:46.144149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.144166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.144205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:46.144224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.144236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.144239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:46.143847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2440
2025-10-10T14:37:46.144256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.143913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2440
2025-10-10T14:37:46.144279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:46.144309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.144629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.144642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.144666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.145153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2441 partition: 0 MaxSeqNo: 40 sessionId: src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0
2025-10-10T14:37:46.145633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9550467-ac5f632d-b144011f-36397421_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:46.148841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0] Write session: try to update token
2025-10-10T14:37:46.148869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:46.167585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:46.167607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:46.167610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:46.167613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:46.167625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602287464460001:11088]
2025-10-10T14:37:46.167631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602287464460001:11088]
2025-10-10T14:37:46.167636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602287464460001:11088]
2025-10-10T14:37:46.167710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:46.167719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.167730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:46.167884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:46.169931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:46.169950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:46.169955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:46.173885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2441 sessionId: src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:46.176943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:46.178199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602288246692007:10596]
2025-10-10T14:37:46.178495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2440, pipe: [1:7559602288246692007:10596]
2025-10-10T14:37:46.292259Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:46.293016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.293027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.293053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692007:10596], now have 1 active actors on pipe
2025-10-10T14:37:46.293347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:46.293417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602288246692007:10596]
2025-10-10T14:37:46.293489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:46.293494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:46.293575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2441 reason: error at write: Disconnected sessionId: src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0
2025-10-10T14:37:46.293815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2441 sessionId: src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0 is DEAD
2025-10-10T14:37:46.293677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:46.294221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:46.294240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0] Write session will restart in 0.005279s
2025-10-10T14:37:46.294267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0] Write session: Do CDS request
2025-10-10T14:37:46.294276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:46.300720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.301870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:46.301887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2442
2025-10-10T14:37:46.302025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.302054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:46.302060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:46.302065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:46.302628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2442 sessionId:  describe result for acl check
2025-10-10T14:37:46.302658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:46.302660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:46.302664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:46.302671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602288246692032:10847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:46.303307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602288246692032:10847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:46.308051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602288246692032:10847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:46.312324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602288246692032:10847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:46.312341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602288246692032:10847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:46.312345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602288246692032:10847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:46.312355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:46.326317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:46.329716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:46.330090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:46.330102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:46.330117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:46.330189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:46.330240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602287464460298:11092]
2025-10-10T14:37:46.330908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:46.331258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:46.331308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:46.331657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:46.331733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.331734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.331736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.331737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.331738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.331740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.331741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.331742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.331743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.331745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.331746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.331747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.331749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.331755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.331770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.331774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.331778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.331782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.331786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.331790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.331794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.331798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.331802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.331806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.331810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.331825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.331834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.331841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.331846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.331851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.331855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.331860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.331865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.331870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.331875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.331880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.331885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.331890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.331896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.331901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.331905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.331913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.331919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.331924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.331931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.331936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.331941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.331946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.331952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.331957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.331962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.332004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:46.334841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:46.335201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:46.335218Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:46.335221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:46.335225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:46.335234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2441 [2:7559602287464460298:11092]
2025-10-10T14:37:46.335252Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:46.335273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:46.335281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.335286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.335289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.335309Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:46.335322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:46.335337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:46.335418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.335426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.335428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.335431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:46.335509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:46.335516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.335529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.335545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.335568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:46.335596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692009:2438], now have 1 active actors on pipe
2025-10-10T14:37:46.335605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602287464460293:11092]
2025-10-10T14:37:46.335611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602287464460293:11092]
2025-10-10T14:37:46.335614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602287464460293:11092]
2025-10-10T14:37:46.335629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:46.335644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692076:10847], now have 1 active actors on pipe
2025-10-10T14:37:46.335654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:46.335657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:46.335658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:46.335660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:46.335674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:46.335682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:46.335690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2441
2025-10-10T14:37:46.335721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602287464460293:11092]
2025-10-10T14:37:46.335729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:46.335731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:46.335700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2441
2025-10-10T14:37:46.335763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.335773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.335817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:46.335828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.335833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.335840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:46.335852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.335867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:46.335890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.336075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.336082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.336098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.336187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2442 partition: 0 MaxSeqNo: 40 sessionId: src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0
2025-10-10T14:37:46.336633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a1c767-47f9a2b2-210ddeb-281af8f9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:46.339726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0] Write session: try to update token
2025-10-10T14:37:46.339750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:46.357594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:46.357616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:46.357620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:46.357622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:46.357635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602287464460293:11092]
2025-10-10T14:37:46.357639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602287464460293:11092]
2025-10-10T14:37:46.357644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602287464460293:11092]
2025-10-10T14:37:46.357705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:46.357710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:46.357716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.357719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:46.357725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:46.357729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:46.357928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:46.358488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2442 sessionId: src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:46.361254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:46.393829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602288246692308:10596]
2025-10-10T14:37:46.394125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2441, pipe: [1:7559602288246692308:10596]
2025-10-10T14:37:46.482985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:46.483685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.483699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.483755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692308:10596], now have 1 active actors on pipe
2025-10-10T14:37:46.484342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:46.484715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:46.484728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0] Write session will restart in 0.009549s
2025-10-10T14:37:46.484755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0] Write session: Do CDS request
2025-10-10T14:37:46.484764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:46.484131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:46.484198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602288246692308:10596]
2025-10-10T14:37:46.484233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:46.484236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:46.484297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2442 reason: error at write: Disconnected sessionId: src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0
2025-10-10T14:37:46.484514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2442 sessionId: src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0 is DEAD
2025-10-10T14:37:46.495944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.496067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:46.496085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2443
2025-10-10T14:37:46.496316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.496369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:46.496380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:46.496390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:46.496919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2443 sessionId:  describe result for acl check
2025-10-10T14:37:46.496957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:46.496964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:46.496969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:46.496975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602288246692326:10853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:46.497592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602288246692326:10853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:46.502573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602288246692326:10853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:46.512191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602288246692326:10853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:46.512211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602288246692326:10853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:46.512215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602288246692326:10853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:46.512224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:46.531284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:46.534809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:46.535113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:46.535126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:46.535139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:46.535208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:46.535255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602287464460579:11094]
2025-10-10T14:37:46.535783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:46.536214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:46.536277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:46.536639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:46.536689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.536694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.536695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.536695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.536696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.536698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.536699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.536700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.536701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.536701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.536702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.536703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.536704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.536709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.536718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.536721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.536723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.536726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.536729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.536731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.536734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.536736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.536739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.536741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.536744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.536746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.536754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.536760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.536764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.536768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.536771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.536775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.536778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.536782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.536785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.536789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.536792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.536795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.536799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.536802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.536807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.536811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.536814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.536820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.536826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.536832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.536837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.536842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.536846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.536851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.536856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.536861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.536896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:46.539892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:46.540864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:46.540878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:46.540881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:46.540885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:46.540893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2442 [2:7559602287464460579:11094]
2025-10-10T14:37:46.540908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:46.540940Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:46.540949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.540953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.540955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.540976Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:46.540989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:46.540998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:46.541085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.541093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.541095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.541098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:46.541177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:46.541185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.541200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.541214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.541236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:46.541268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602287464460574:11094]
2025-10-10T14:37:46.541273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602287464460574:11094]
2025-10-10T14:37:46.541275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602287464460574:11094]
2025-10-10T14:37:46.541289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:46.541314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692311:2438], now have 1 active actors on pipe
2025-10-10T14:37:46.541318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692460:10853], now have 1 active actors on pipe
2025-10-10T14:37:46.541476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:46.541501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:46.541504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:46.541521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:46.541533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:46.541536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:46.541567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602287464460574:11094]
2025-10-10T14:37:46.541583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:46.541591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:46.541736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2442
2025-10-10T14:37:46.541787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2442
2025-10-10T14:37:46.541839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.541852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.541896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|437b00c9-aab48505-119869cc-aa4a2600_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:46.541912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.541921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.541924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:46.541937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.541959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:46.541989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.542234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.542245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.542268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.542415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2443 partition: 0 MaxSeqNo: 40 sessionId: src_id|437b00c9-aab48505-119869cc-aa4a2600_0
2025-10-10T14:37:46.542906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6720a983-9e84e0e4-e4b94eac-ace0e967_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|437b00c9-aab48505-119869cc-aa4a2600_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:46.545970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437b00c9-aab48505-119869cc-aa4a2600_0] Write session: try to update token
2025-10-10T14:37:46.545999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437b00c9-aab48505-119869cc-aa4a2600_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:46.565831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:46.565854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:46.565858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:46.565860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:46.565872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602287464460574:11094]
2025-10-10T14:37:46.565877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602287464460574:11094]
2025-10-10T14:37:46.565882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602287464460574:11094]
2025-10-10T14:37:46.565938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:46.565937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:46.565945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:46.565947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.565949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:46.565950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:46.566107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:46.567346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2443 sessionId: src_id|437b00c9-aab48505-119869cc-aa4a2600_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:46.570287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:46.582228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602288246692595:10596]
2025-10-10T14:37:46.582509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2442, pipe: [1:7559602288246692595:10596]
2025-10-10T14:37:46.690096Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:46.690413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.690429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.690477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692595:10596], now have 1 active actors on pipe
2025-10-10T14:37:46.690713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:46.690874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602288246692595:10596]
2025-10-10T14:37:46.690924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:46.690968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:46.690977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:46.691049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2443 reason: error at write: Disconnected sessionId: src_id|437b00c9-aab48505-119869cc-aa4a2600_0
2025-10-10T14:37:46.691264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2443 sessionId: src_id|437b00c9-aab48505-119869cc-aa4a2600_0 is DEAD
2025-10-10T14:37:46.693384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437b00c9-aab48505-119869cc-aa4a2600_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:46.693397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437b00c9-aab48505-119869cc-aa4a2600_0] Write session will restart in 0.008700s
2025-10-10T14:37:46.693423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437b00c9-aab48505-119869cc-aa4a2600_0] Write session: Do CDS request
2025-10-10T14:37:46.693431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437b00c9-aab48505-119869cc-aa4a2600_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:46.702967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437b00c9-aab48505-119869cc-aa4a2600_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.703139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:46.703155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2444
2025-10-10T14:37:46.703322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.703360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:46.703371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:46.703375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:46.703876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2444 sessionId:  describe result for acl check
2025-10-10T14:37:46.703917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:46.703919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:46.703921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:46.703928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602288246692649:10857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:46.704507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602288246692649:10857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:46.709488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602288246692649:10857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:46.713316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602288246692649:10857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:46.713347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602288246692649:10857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:46.713351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602288246692649:10857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:46.713362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:46.716221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:46.718111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:46.718342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:46.718354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:46.718367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:46.718427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:46.718479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602287464460861:11096]
2025-10-10T14:37:46.719142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:46.719511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:46.719559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:46.719899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:46.719962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.719970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.719971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.719973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.719975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.719976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.719978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.719979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.719981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.719982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.719984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.719985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.719987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.719994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.720008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.720013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.720017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.720021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.720025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.720029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.720034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.720038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.720043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.720047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.720051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.720056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.720065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.720075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.720082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.720088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.720093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.720099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.720104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.720109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.720114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.720120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.720124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.720130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.720135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.720141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.720145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.720151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.720161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.720168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.720172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.720179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.720185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.720191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.720195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.720202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.720213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.720218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.720261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:46.723017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:46.723593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:46.723609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:46.723612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:46.723617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:46.723625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2443 [2:7559602287464460861:11096]
2025-10-10T14:37:46.723642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:46.723665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:46.723669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.723673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.723676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.723696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:46.723714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:46.723723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:46.723794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.723796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.723799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.723801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:46.723880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:46.723884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.723897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.723908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.723927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:46.723951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602287464460856:11096]
2025-10-10T14:37:46.723954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602287464460856:11096]
2025-10-10T14:37:46.723956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602287464460856:11096]
2025-10-10T14:37:46.723971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:46.723986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:46.724004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:46.724008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:46.724046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602287464460856:11096]
2025-10-10T14:37:46.724049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:46.724138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:46.724141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:46.724143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:46.724149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:46.724627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692869:10857], now have 1 active actors on pipe
2025-10-10T14:37:46.724638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692598:2438], now have 1 active actors on pipe
2025-10-10T14:37:46.724627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2443
2025-10-10T14:37:46.724639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2443
2025-10-10T14:37:46.724862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.724871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.724907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:46.724918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.724924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.724926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:46.724941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.724956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:46.724973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.725321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.725343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.725361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.725605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2444 partition: 0 MaxSeqNo: 40 sessionId: src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0
2025-10-10T14:37:46.726064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437b00c9-aab48505-119869cc-aa4a2600_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:46.728825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0] Write session: try to update token
2025-10-10T14:37:46.728844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:46.744002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2444 sessionId: src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:46.744942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:46.744966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:46.744970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:46.744972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:46.744982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602287464460856:11096]
2025-10-10T14:37:46.744987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602287464460856:11096]
2025-10-10T14:37:46.744990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602287464460856:11096]
2025-10-10T14:37:46.745047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:46.745061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.745064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:46.745213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:46.747041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:46.747200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:46.747219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:46.747224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:46.791123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602288246692888:10596]
2025-10-10T14:37:46.791432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2443, pipe: [1:7559602288246692888:10596]
2025-10-10T14:37:46.864076Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:46.864832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.864844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.864891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692888:10596], now have 1 active actors on pipe
2025-10-10T14:37:46.865146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:46.865162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:46.865173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:46.865236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2444 reason: error at write: Disconnected sessionId: src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0
2025-10-10T14:37:46.865239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602288246692888:10596]
2025-10-10T14:37:46.865444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:46.865488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2444 sessionId: src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0 is DEAD
2025-10-10T14:37:46.865643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:46.865652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0] Write session will restart in 0.008156s
2025-10-10T14:37:46.865690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0] Write session: Do CDS request
2025-10-10T14:37:46.865702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:46.874932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.875069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:46.875087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2445
2025-10-10T14:37:46.875229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:46.875266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:46.875277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:46.875281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:46.875787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2445 sessionId:  describe result for acl check
2025-10-10T14:37:46.875821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:46.875822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:46.875825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:46.875831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602288246692909:10862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:46.876416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602288246692909:10862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:46.879394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602288246692909:10862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:46.883869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602288246692909:10862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:46.883887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602288246692909:10862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:46.883891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602288246692909:10862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:46.883901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:46.893116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:46.896764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:46.897039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:46.897065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:46.897079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:46.897151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:46.897204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602287464461144:11098]
2025-10-10T14:37:46.897838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:46.898303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:46.898367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:46.898748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:46.898803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.898805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.898806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.898808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.898809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.898810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.898812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.898813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.898814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.898816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.898817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.898818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.898820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.898826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.898854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.898858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.898862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.898866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.898870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.898873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.898877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.898880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.898888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.898891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.898895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.898899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.898907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.898916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:46.898923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.898928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:46.898935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.898940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:46.898944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.898949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:46.898953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.898958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:46.898963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.898968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:46.898974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.898978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:46.898984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.898990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:46.898995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.899001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:46.899022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.899028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:46.899034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.899039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.899044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.899050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.899056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.899062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.899109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:46.906913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:46.907272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:46.907286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:46.907290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:46.907294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:46.907303Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2444 [2:7559602287464461144:11098]
2025-10-10T14:37:46.907321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:46.907344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:46.907355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.907360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.907363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.907384Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:46.907396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:46.907406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:46.907476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.907485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.907488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.907491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:46.907818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2444
2025-10-10T14:37:46.907843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2444
2025-10-10T14:37:46.907578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:46.907585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.907598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:46.907612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:46.907631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:46.907656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246693040:10862], now have 1 active actors on pipe
2025-10-10T14:37:46.907660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246692893:2438], now have 1 active actors on pipe
2025-10-10T14:37:46.907668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602287464461139:11098]
2025-10-10T14:37:46.907671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602287464461139:11098]
2025-10-10T14:37:46.907674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602287464461139:11098]
2025-10-10T14:37:46.907689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:46.907706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:46.907711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:46.907715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:46.907717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:46.907724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:46.907728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:46.907771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602287464461139:11098]
2025-10-10T14:37:46.907779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:46.907784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:46.908024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.908031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.908075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:46.908084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:46.908089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:46.908092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:46.908104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:46.908116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:46.908136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.916297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:46.916317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:46.916357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:46.916570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2445 partition: 0 MaxSeqNo: 40 sessionId: src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0
2025-10-10T14:37:46.917059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c72a06-6b848ba5-df9a4160-1f1e07d1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:46.920000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0] Write session: try to update token
2025-10-10T14:37:46.920029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:46.936961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:46.936985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:46.936990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:46.936992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:46.937003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602287464461139:11098]
2025-10-10T14:37:46.937007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602287464461139:11098]
2025-10-10T14:37:46.937012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602287464461139:11098]
2025-10-10T14:37:46.937070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:46.937078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:46.937081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:46.937084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:46.937092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:46.937097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:46.937255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:46.940673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2445 sessionId: src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:46.943759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:46.965186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602288246693180:10596]
2025-10-10T14:37:46.965763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2444, pipe: [1:7559602288246693180:10596]
2025-10-10T14:37:47.061734Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:47.063447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.063467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.063516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602288246693180:10596], now have 1 active actors on pipe
2025-10-10T14:37:47.063711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:47.064341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:47.064353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0] Write session will restart in 0.009802s
2025-10-10T14:37:47.064378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0] Write session: Do CDS request
2025-10-10T14:37:47.064386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:47.063896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:47.064000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0
2025-10-10T14:37:47.064189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2445 sessionId: src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0 is DEAD
2025-10-10T14:37:47.064370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602288246693180:10596]
2025-10-10T14:37:47.064385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:47.075981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.076089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:47.076120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2446
2025-10-10T14:37:47.076261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.076301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:47.076314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:47.076327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:47.077358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2446 sessionId:  describe result for acl check
2025-10-10T14:37:47.077398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:47.077404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:47.077406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:47.077412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602292541660520:10866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:47.077993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602292541660520:10866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:47.081148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602292541660520:10866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:47.085095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602292541660520:10866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:47.085112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602292541660520:10866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:47.085116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602292541660520:10866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:47.085126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:47.088422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:47.091594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:47.091992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:47.092007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:47.092021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:47.092096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:47.092138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602291759428759:11106]
2025-10-10T14:37:47.092802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:47.093142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:47.093189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:47.093547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:47.093606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.093624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.093625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.093627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.093628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.093630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.093631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.093632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.093634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.093635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.093636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.093638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.093639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.093646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.093661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.093665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.093670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.093675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.093679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.093683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.093687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.093691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.093696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.093700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.093704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.093708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.093716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.093728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.093735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.093741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.093761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.093767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.093772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.093778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.093784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.093789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.093793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.093799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.093803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.093807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.093811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.093816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.093822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.093828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.093832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.093838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.093843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.093849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.093854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.093859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.093864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.093870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.093922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:47.096705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:47.097051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:47.097065Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:47.097069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:47.097073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:47.097081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2445 [2:7559602291759428759:11106]
2025-10-10T14:37:47.097096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:47.097117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:47.097121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.097125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.097127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.097146Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:47.097168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:47.097182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:47.097609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.097619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.097622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.097625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:47.097708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:47.097716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.097728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.097745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.097767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:47.097796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541660707:10866], now have 1 active actors on pipe
2025-10-10T14:37:47.097809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602291759428754:11106]
2025-10-10T14:37:47.097812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602291759428754:11106]
2025-10-10T14:37:47.097814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602291759428754:11106]
2025-10-10T14:37:47.097830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:47.097846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541660479:2438], now have 1 active actors on pipe
2025-10-10T14:37:47.097850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:47.097854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:47.097855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:47.097857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:47.097871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:47.097880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:47.097914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602291759428754:11106]
2025-10-10T14:37:47.097925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:47.097950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:47.097964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.097969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.097912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2445
2025-10-10T14:37:47.097951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2445
2025-10-10T14:37:47.098002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:47.098015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.098020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.098023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:47.098034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.098049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:47.098073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.098257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.098265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.098282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.098370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2446 partition: 0 MaxSeqNo: 40 sessionId: src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0
2025-10-10T14:37:47.098793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a9c98c-45baddf0-601507f1-eb97df72_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:47.101585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0] Write session: try to update token
2025-10-10T14:37:47.101608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:47.117269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2446 sessionId: src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:47.118463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:47.118484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:47.118488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:47.118490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:47.118500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602291759428754:11106]
2025-10-10T14:37:47.118505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602291759428754:11106]
2025-10-10T14:37:47.118509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602291759428754:11106]
2025-10-10T14:37:47.118563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:47.118567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:47.118577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:47.118578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.118581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:47.118586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:47.118785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:47.120259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:47.164384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602292541660792:10596]
2025-10-10T14:37:47.164759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2445, pipe: [1:7559602292541660792:10596]
2025-10-10T14:37:47.234349Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:47.234917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.234935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.234988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541660792:10596], now have 1 active actors on pipe
2025-10-10T14:37:47.235220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:47.236161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:47.236176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0] Write session will restart in 0.007286s
2025-10-10T14:37:47.236218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0] Write session: Do CDS request
2025-10-10T14:37:47.236226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:47.235648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:47.235734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2446 reason: status is not ok: tablet will be restarted right now sessionId: src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0
2025-10-10T14:37:47.235966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2446 sessionId: src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0 is DEAD
2025-10-10T14:37:47.236155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:47.236192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602292541660792:10596]
2025-10-10T14:37:47.244954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.245085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:47.245105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2447
2025-10-10T14:37:47.245293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.245351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:47.245358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:47.245363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:47.245993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2447 sessionId:  describe result for acl check
2025-10-10T14:37:47.246032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:47.246037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:47.246039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:47.246047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602292541660809:10879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:47.246619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602292541660809:10879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:47.255941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602292541660809:10879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:47.262134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602292541660809:10879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:47.262153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602292541660809:10879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:47.262158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602292541660809:10879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:47.262169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:47.268601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:47.272082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:47.272424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:47.272437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:47.272450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:47.272520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:47.272568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602291759429063:11117]
2025-10-10T14:37:47.273239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:47.273583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:47.273632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:47.274002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:47.274060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.274066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.274066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.274067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.274068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.274069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.274070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.274071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.274072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.274073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.274074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.274075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.274076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.274081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.274090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.274093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.274096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.274098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.274101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.274104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.274106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.274108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.274111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.274113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.274115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.274118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.274124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.274130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.274136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.274142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.274147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.274153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.274159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.274164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.274168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.274172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.274175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.274178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.274182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.274185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.274188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.274191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.274194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.274198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.274202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.274206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.274209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.274212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.274215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.274218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.274222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.274225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.274249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:47.277013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:47.277921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:47.277933Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:47.277935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:47.277940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:47.277947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2446 [2:7559602291759429063:11117]
2025-10-10T14:37:47.277962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:47.277983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:47.277987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.277991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.277994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.278014Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:47.278028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:47.278040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:47.278119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.278126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.278129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.278131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:47.278203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:47.278211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.278223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.278234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.278252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:47.278277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541660980:10879], now have 1 active actors on pipe
2025-10-10T14:37:47.278285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541660793:2438], now have 1 active actors on pipe
2025-10-10T14:37:47.278293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602291759429058:11117]
2025-10-10T14:37:47.278296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602291759429058:11117]
2025-10-10T14:37:47.278298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602291759429058:11117]
2025-10-10T14:37:47.278317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:47.278333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:47.278351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:47.278359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:47.278404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602291759429058:11117]
2025-10-10T14:37:47.278379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2446
2025-10-10T14:37:47.278404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:47.278393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2446
2025-10-10T14:37:47.278408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:47.278410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:47.278412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:47.278417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:47.278478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.278489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.278524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:47.278536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.278540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.278542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:47.278555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.278571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:47.278590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.278790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.278798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.278814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.278914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2447 partition: 0 MaxSeqNo: 40 sessionId: src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0
2025-10-10T14:37:47.279408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|525a7b1f-3e08aa4c-504ed307-8e2ffdf3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:47.282388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0] Write session: try to update token
2025-10-10T14:37:47.282409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:47.300338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2447 sessionId: src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:47.301947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:47.301968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:47.301971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:47.301973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:47.301984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602291759429058:11117]
2025-10-10T14:37:47.301989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602291759429058:11117]
2025-10-10T14:37:47.301994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602291759429058:11117]
2025-10-10T14:37:47.302059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:47.302066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.302071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:47.302226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:47.303386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:47.305447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:47.305465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:47.305472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:47.336409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602292541661095:10596]
2025-10-10T14:37:47.336809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2446, pipe: [1:7559602292541661095:10596]
2025-10-10T14:37:47.428519Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:47.428846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.428863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.428911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661095:10596], now have 1 active actors on pipe
2025-10-10T14:37:47.429150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:47.429556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602292541661095:10596]
2025-10-10T14:37:47.429593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:47.429632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:47.430112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:47.430124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0] Write session will restart in 0.005322s
2025-10-10T14:37:47.430150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0] Write session: Do CDS request
2025-10-10T14:37:47.429731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2447 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0
2025-10-10T14:37:47.429954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2447 sessionId: src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0 is DEAD
2025-10-10T14:37:47.430156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:47.437098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.437161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:47.437177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2448
2025-10-10T14:37:47.437375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.437412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:47.437424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:47.437428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:47.437843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2448 sessionId:  describe result for acl check
2025-10-10T14:37:47.437872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:47.437874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:47.437876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:47.437883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602292541661110:10884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:47.438487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602292541661110:10884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:47.442084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602292541661110:10884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:47.454872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602292541661110:10884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:47.454891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602292541661110:10884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:47.454895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602292541661110:10884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:47.454906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:47.481397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:47.485530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:47.485799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:47.485811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:47.485824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:47.485891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:47.485944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602291759429349:11119]
2025-10-10T14:37:47.486621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:47.492238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:47.492332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:47.492743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:47.492809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.492811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.492813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.492814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.492816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.492818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.492820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.492821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.492823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.492824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.492826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.492827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.492829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.492836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.492851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.492856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.492860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.492865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.492869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.492874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.492879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.492883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.492888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.492893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.492897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.492901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.492913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.492923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.492930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.492936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.492942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.492948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.492953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.492959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.492965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.492970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.492976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.492982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.492987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.492993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.492999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.493007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.493012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.493018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.493023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.493029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.493035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.493040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.493046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.493052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.493056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.493062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.493108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:47.496195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:47.496933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:47.496951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:47.496955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:47.496960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:47.496968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2447 [2:7559602291759429349:11119]
2025-10-10T14:37:47.496984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:47.497006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:47.497015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.497019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.497022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.497042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:47.497056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:47.497070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:47.497148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.497156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.497159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.497162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:47.497234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:47.497243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.497257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.497271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.497295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:47.497324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661187:10884], now have 1 active actors on pipe
2025-10-10T14:37:47.497349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661097:2438], now have 1 active actors on pipe
2025-10-10T14:37:47.497364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602291759429343:11119]
2025-10-10T14:37:47.497368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602291759429343:11119]
2025-10-10T14:37:47.497371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602291759429343:11119]
2025-10-10T14:37:47.497390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:47.497410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:47.497420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2447
2025-10-10T14:37:47.497423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2447
2025-10-10T14:37:47.497432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:47.497443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:47.497484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602291759429343:11119]
2025-10-10T14:37:47.497487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:47.497493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:47.497498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:47.497502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:47.497510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:47.497671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.497685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.497728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:47.497744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.497753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.497756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:47.497770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.497789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:47.497810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.498070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.498081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.498099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.498264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2448 partition: 0 MaxSeqNo: 40 sessionId: src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0
2025-10-10T14:37:47.498672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25186dc6-d0b966e3-8ac5f82-2ef19db6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:47.501378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0] Write session: try to update token
2025-10-10T14:37:47.501398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:47.515631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:47.515651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:47.515663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602291759429343:11119]
2025-10-10T14:37:47.515719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:47.515721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:47.515906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:47.516068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.516212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.516360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.516565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:47.516609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:47.518205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2448 sessionId: src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:47.521422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:47.521673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.521694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.521754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:47.521892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:47.533625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602292541661387:10596]
2025-10-10T14:37:47.534093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2447, pipe: [1:7559602292541661387:10596]
2025-10-10T14:37:47.534758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661387:10596], now have 1 active actors on pipe
2025-10-10T14:37:47.534786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:47.534790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:47.534794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:47.534796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:47.534807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602291759429343:11119]
2025-10-10T14:37:47.534812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602291759429343:11119]
2025-10-10T14:37:47.534816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602291759429343:11119]
2025-10-10T14:37:47.534890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:47.534897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:47.534905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.534905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:47.534907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:47.534911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:47.535065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:47.656230Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:47.665017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.665056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.665249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.665313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.665490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.665568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.665618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.665628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.665704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.665773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.665843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.669000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:47.669017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602292541661387:10596]
2025-10-10T14:37:47.669061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:47.669064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:47.669098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2448 reason: error at write: Disconnected sessionId: src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0
2025-10-10T14:37:47.665916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.665969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.669371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2448 sessionId: src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0 is DEAD
2025-10-10T14:37:47.665972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.666040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.666100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.666167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.666239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.666281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.666284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.666357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.666422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.666486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.666578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.666621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.666624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.666700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.666765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.666849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.666915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.666960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.666962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.667034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.667097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.667165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.667235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.667282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.667285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.667360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.667427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.667498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.667564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.667621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.667627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.667711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.667773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.667839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.667905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.667948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.667951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.668025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.668086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.669518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:47.669537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0] Write session will restart in 0.007181s
2025-10-10T14:37:47.668150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.668215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.668259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.668262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.668334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.668393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.669564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0] Write session: Do CDS request
2025-10-10T14:37:47.668461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.668525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.668567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.668569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.669582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:47.670047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:47.677912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.677998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:47.678013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2449
2025-10-10T14:37:47.678188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.678242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:47.678252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:47.678256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:47.678759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2449 sessionId:  describe result for acl check
2025-10-10T14:37:47.678797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:47.678803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:47.678805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:47.678812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602292541661400:10888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:47.679409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602292541661400:10888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:47.681785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602292541661400:10888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:47.686698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602292541661400:10888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:47.686715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602292541661400:10888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:47.686719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602292541661400:10888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:47.686730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:47.697213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:47.701101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:47.701405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:47.701418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:47.701432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:47.701495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:47.701545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602291759429636:11121]
2025-10-10T14:37:47.702201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:47.702660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:47.702723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:47.703073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:47.703161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.703167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.703169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.703170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.703172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.703173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.703174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.703176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.703177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.703179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.703180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.703182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.703183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.703190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.703204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.703208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.703213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.703217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.703221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.703226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.703230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.703235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.703239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.703244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.703248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.703253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.703261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.703271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.703279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.703285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.703290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.703295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.703301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.703312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.703317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.703323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.703328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.703334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.703339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.703346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.703350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.703356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.703361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.703372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.703378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.703383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.703389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.703396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.703400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.703406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.703411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.703416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.703467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:47.706168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:47.707143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:47.707159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:47.707161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:47.707165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:47.707172Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2448 [2:7559602291759429636:11121]
2025-10-10T14:37:47.707191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:47.707212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:47.707216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.707220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.707223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.707242Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:47.707263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:47.707276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:47.707352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.707358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.707361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.707363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:47.707437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:47.707445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.707458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.707472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.707489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:47.707518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602291759429631:11121]
2025-10-10T14:37:47.707526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602291759429631:11121]
2025-10-10T14:37:47.707527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602291759429631:11121]
2025-10-10T14:37:47.707546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:47.707567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661468:10888], now have 1 active actors on pipe
2025-10-10T14:37:47.707574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:47.707582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:47.707591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:47.707593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:47.707594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:47.707595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:47.707600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661390:2438], now have 1 active actors on pipe
2025-10-10T14:37:47.707629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602291759429631:11121]
2025-10-10T14:37:47.707640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:47.707641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:47.707650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2448
2025-10-10T14:37:47.708052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2448
2025-10-10T14:37:47.708108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.708122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.708158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:47.708177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.708182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.708185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:47.708198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.708212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:47.708231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.708392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.708400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.708415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.708525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2449 partition: 0 MaxSeqNo: 40 sessionId: src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0
2025-10-10T14:37:47.709004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfefecb-71c3cbac-8bbea1bf-aa049900_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:47.712039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0] Write session: try to update token
2025-10-10T14:37:47.712058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:47.720359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:47.720378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:47.720390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602291759429631:11121]
2025-10-10T14:37:47.720442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:47.720447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:47.720647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:47.720806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.720963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.721115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.721702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:47.721756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:47.732819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2449 sessionId: src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:47.736106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:47.736729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:47.736416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.736444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.736501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:47.758423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:47.758445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:47.758450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:47.758453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:47.758467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602291759429631:11121]
2025-10-10T14:37:47.758475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602291759429631:11121]
2025-10-10T14:37:47.758479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602291759429631:11121]
2025-10-10T14:37:47.758529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:47.758538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.758540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:47.758687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:47.761765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:47.761780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:47.761784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:47.769025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602292541661684:10596]
2025-10-10T14:37:47.773582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2448, pipe: [1:7559602292541661684:10596]
2025-10-10T14:37:47.884581Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:47.893658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.893694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.893904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.893984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.894061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.894134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.894190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.894202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.894284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.894359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.894437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.894513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.894567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.894577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.894657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.894733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.894815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.894898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.894948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.894957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.895036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.895109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.895178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.895248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.895303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.895311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.895383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.895451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.895526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.895588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.895633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.895636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.895705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.895763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.895824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.895885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.895930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.895934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.896004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.896059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.896122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.896181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.896225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.896229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.896298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.896355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.896416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.896479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.896523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.896526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.896595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.896656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.896723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.896786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.896829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.896833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.896903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:47.896963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:47.897024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:47.897090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:47.897143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:47.897146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:47.897225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661684:10596], now have 1 active actors on pipe
2025-10-10T14:37:47.897563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602292541661684:10596]
2025-10-10T14:37:47.897596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:47.897606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:47.897610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:47.897658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2449 reason: error at write: Disconnected sessionId: src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0
2025-10-10T14:37:47.897872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2449 sessionId: src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0 is DEAD
2025-10-10T14:37:47.898043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:47.898054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0] Write session will restart in 0.007637s
2025-10-10T14:37:47.898082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0] Write session: Do CDS request
2025-10-10T14:37:47.898088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:47.898722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:47.906895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.907023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:47.907054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2450
2025-10-10T14:37:47.907216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:47.907267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:47.907283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:47.907288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:47.907823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2450 sessionId:  describe result for acl check
2025-10-10T14:37:47.907865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:47.907872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:47.907875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:47.907881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602292541661708:10893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:47.908545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602292541661708:10893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:47.913376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602292541661708:10893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:47.922042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602292541661708:10893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:47.922063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602292541661708:10893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:47.922067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602292541661708:10893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:47.922077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:47.925728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:47.929617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:47.930026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:47.930040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:47.930056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:47.930131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:47.930203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602291759429926:11123]
2025-10-10T14:37:47.930864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:47.931239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:47.931294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:47.931669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:47.931737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.931743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.931744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.931746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.931747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.931748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.931750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.931751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.931752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.931754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.931755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.931756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.931758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.931765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.931779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.931783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.931788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.931792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.931796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.931800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.931805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.931809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.931814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.931818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.931822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.931826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.931837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.931846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:47.931852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.931858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:47.931862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.931871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:47.931881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.931886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:47.931896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.931901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:47.931907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.931918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:47.931923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.931932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:47.931937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.931947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:47.931952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.931962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:47.931967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.931972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:47.931978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.931987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.931991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.932001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.932006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.932015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.932056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:47.934939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:47.935727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:47.935746Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:47.935749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:47.935753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:47.935761Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2449 [2:7559602291759429926:11123]
2025-10-10T14:37:47.935776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:47.935796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:47.935799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.935803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.935805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.935825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:47.935839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:47.935852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:47.935937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.935946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.935948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.935951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:47.936026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:47.936033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.936048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:47.936058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:47.936079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:47.936111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661693:2438], now have 1 active actors on pipe
2025-10-10T14:37:47.936115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661949:10893], now have 1 active actors on pipe
2025-10-10T14:37:47.936123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602291759429921:11123]
2025-10-10T14:37:47.936125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602291759429921:11123]
2025-10-10T14:37:47.936127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602291759429921:11123]
2025-10-10T14:37:47.936141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:47.936160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:47.936164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:47.936177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:47.936181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:47.936185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:47.936188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:47.936215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602291759429921:11123]
2025-10-10T14:37:47.936227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:47.936215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2449
2025-10-10T14:37:47.936262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:47.936269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2449
2025-10-10T14:37:47.936351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.936363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.936400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|474c56a7-f52432ef-b18aa36e-388e843_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:47.936415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:47.936420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:47.936422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:47.936435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:47.936448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:47.936477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.936688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.936696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.936714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:47.936819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2450 partition: 0 MaxSeqNo: 40 sessionId: src_id|474c56a7-f52432ef-b18aa36e-388e843_0
2025-10-10T14:37:47.937691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231c064a-7f8a8943-4921be7b-535cb7b8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|474c56a7-f52432ef-b18aa36e-388e843_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:47.940662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474c56a7-f52432ef-b18aa36e-388e843_0] Write session: try to update token
2025-10-10T14:37:47.940688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474c56a7-f52432ef-b18aa36e-388e843_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:47.948733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:47.948754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:47.948768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602291759429921:11123]
2025-10-10T14:37:47.948821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:47.948825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:47.949013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:47.949175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.949361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.949526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:47.949758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:47.949805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:47.959416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2450 sessionId: src_id|474c56a7-f52432ef-b18aa36e-388e843_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:47.962619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:47.962882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:47.962907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:47.962953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:47.963080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:47.971322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:47.971345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:47.971350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:47.971352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:47.971368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602291759429921:11123]
2025-10-10T14:37:47.971372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602291759429921:11123]
2025-10-10T14:37:47.971377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602291759429921:11123]
2025-10-10T14:37:47.971436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:47.971437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:47.971445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:47.971445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:47.971448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:47.971449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:47.971620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:47.997405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602292541661985:10596]
2025-10-10T14:37:48.000519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2449, pipe: [1:7559602292541661985:10596]
2025-10-10T14:37:48.092656Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:48.102788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.102830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.103014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.103077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.103141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.103209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.103252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.103258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.103328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.103389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.103451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.103524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.103565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.103569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.103643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.103702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.103762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.103823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.103864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.103867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.103940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.104004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.104064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.104125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.104166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.104169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.104240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.104301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.104360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.104419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.104457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.104460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.104529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.104586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.104648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.104715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.104757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.104760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.104826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.104890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.104953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.105014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.105056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.105059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.105128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.105186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.105247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.105308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.107082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:48.107096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:48.107130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2450 reason: error at write: Disconnected sessionId: src_id|474c56a7-f52432ef-b18aa36e-388e843_0
2025-10-10T14:37:48.107314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2450 sessionId: src_id|474c56a7-f52432ef-b18aa36e-388e843_0 is DEAD
2025-10-10T14:37:48.107496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:48.107531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602292541661985:10596]
2025-10-10T14:37:48.105623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.105634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.105705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.105765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.105828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.105892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.105934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.105937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.106009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:48.106095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:48.106157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:48.106221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:48.106264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:48.106267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:48.106388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602292541661985:10596], now have 1 active actors on pipe
2025-10-10T14:37:48.107786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:48.109565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c56a7-f52432ef-b18aa36e-388e843_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:48.109577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c56a7-f52432ef-b18aa36e-388e843_0] Write session will restart in 0.008553s
2025-10-10T14:37:48.109604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c56a7-f52432ef-b18aa36e-388e843_0] Write session: Do CDS request
2025-10-10T14:37:48.109610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c56a7-f52432ef-b18aa36e-388e843_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:48.121926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474c56a7-f52432ef-b18aa36e-388e843_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.121945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:48.121964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2451
2025-10-10T14:37:48.129423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.129491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:48.129497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:48.129502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:48.135352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2451 sessionId:  describe result for acl check
2025-10-10T14:37:48.135408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:48.135410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:48.135413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:48.135419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602296836629495:10897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:48.136029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602296836629495:10897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:48.139458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602296836629495:10897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:48.143222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602296836629495:10897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:48.143239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602296836629495:10897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:48.143243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602296836629495:10897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:48.143253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:48.142283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:48.146551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:48.146854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:48.146860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:48.146873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:48.146937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:48.146977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602296054397526:11132]
2025-10-10T14:37:48.147624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:48.148101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:48.148162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:48.148512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:48.148575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.148582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.148583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.148584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.148586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.148588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.148589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.148591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.148592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.148594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.148595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.148597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.148598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.148606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.148621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.148626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.148631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.148635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.148640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.148645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.148649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.148654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.148659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.148664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.148668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.148672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.148681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.148690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.148700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.148711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.148717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.148728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.148733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.148743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.148749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.148756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.148760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.148767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.148772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.148778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.148791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.148801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.148807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.148819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.148829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.148835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.148841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.148847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.148855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.148865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.148870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.148880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.148925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:48.156069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:48.157125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:48.157143Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:48.157145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:48.157150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:48.157157Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2450 [2:7559602296054397526:11132]
2025-10-10T14:37:48.157172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:48.157192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:48.157196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.157202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.157204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.157223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:48.157233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:48.157247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:48.157315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.157321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.157323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.157326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:48.157419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:48.157428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.157442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.157452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.157468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:48.157501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836629565:10897], now have 1 active actors on pipe
2025-10-10T14:37:48.157509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836629283:2438], now have 1 active actors on pipe
2025-10-10T14:37:48.157518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602296054397520:11132]
2025-10-10T14:37:48.157521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602296054397520:11132]
2025-10-10T14:37:48.157523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602296054397520:11132]
2025-10-10T14:37:48.157537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:48.157544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:48.157548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:48.157550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:48.157554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:48.157571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:48.157574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:48.157617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602296054397520:11132]
2025-10-10T14:37:48.157626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:48.157632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:48.157774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.157781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.157819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:48.157835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.157839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.157841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:48.157854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.157868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:48.157885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.158241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.158253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.158276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.158829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474c56a7-f52432ef-b18aa36e-388e843_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:48.157556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2450
2025-10-10T14:37:48.157597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2450
2025-10-10T14:37:48.158390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2451 partition: 0 MaxSeqNo: 40 sessionId: src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0
2025-10-10T14:37:48.162174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0] Write session: try to update token
2025-10-10T14:37:48.162197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:48.179910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2451 sessionId: src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:48.183165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:48.184208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:48.184231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:48.184234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:48.184236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:48.184245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602296054397520:11132]
2025-10-10T14:37:48.184250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602296054397520:11132]
2025-10-10T14:37:48.184254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602296054397520:11132]
2025-10-10T14:37:48.184312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:48.184330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.184330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:48.184333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:48.184336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:48.184341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:48.184482Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:48.207866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602296836629599:10596]
2025-10-10T14:37:48.208045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2450, pipe: [1:7559602296836629599:10596]
2025-10-10T14:37:48.300099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:48.300671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.300690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.300737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836629599:10596], now have 1 active actors on pipe
2025-10-10T14:37:48.300967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:48.300980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:48.300982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:48.300986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602296836629599:10596]
2025-10-10T14:37:48.301004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:48.301053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2451 reason: error at write: Disconnected sessionId: src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0
2025-10-10T14:37:48.301272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2451 sessionId: src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0 is DEAD
2025-10-10T14:37:48.301415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:48.301424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0] Write session will restart in 0.009776s
2025-10-10T14:37:48.301451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0] Write session: Do CDS request
2025-10-10T14:37:48.301457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:48.312895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.313024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:48.313041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2452
2025-10-10T14:37:48.313204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.313250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:48.313260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:48.313265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:48.313747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2452 sessionId:  describe result for acl check
2025-10-10T14:37:48.313788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:48.313795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:48.313796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:48.313803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602296836629652:10911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:48.314356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602296836629652:10911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:48.317868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602296836629652:10911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:48.321928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602296836629652:10911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:48.321945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602296836629652:10911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:48.321949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602296836629652:10911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:48.321960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:48.325669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:48.329173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:48.329442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:48.329457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:48.329470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:48.329531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:48.329580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602296054397853:11142]
2025-10-10T14:37:48.330312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:48.330664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:48.330729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:48.331105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:48.331169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.331171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.331172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.331173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.331175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.331177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.331178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.331179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.331181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.331182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.331184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.331185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.331186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.331193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.331207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.331212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.331217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.331221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.331226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.331230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.331234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.331239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.331244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.331248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.331253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.331258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.331266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.331275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.331282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.331289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.331294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.331299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.331304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.331310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.331315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.331321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.331326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.331332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.331337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.331344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.331349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.331355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.331360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.331365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.331369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.331376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.331381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.331386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.331392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.331397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.331403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.331409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.331455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:48.334148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:48.334801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:48.334841Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:48.334843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:48.334847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:48.334854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2451 [2:7559602296054397853:11142]
2025-10-10T14:37:48.334868Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:48.334887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:48.334895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.334899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.334901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.334919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:48.334932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:48.334945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:48.335018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.335026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.335028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.335031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:48.335104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:48.335112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.335125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.335142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.335165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:48.335193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836629841:10911], now have 1 active actors on pipe
2025-10-10T14:37:48.335202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836629601:2438], now have 1 active actors on pipe
2025-10-10T14:37:48.335210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602296054397848:11142]
2025-10-10T14:37:48.335217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602296054397848:11142]
2025-10-10T14:37:48.335220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602296054397848:11142]
2025-10-10T14:37:48.335234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:48.335253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:48.335267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:48.335270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:48.335271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:48.335272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:48.335274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:48.335261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2451
2025-10-10T14:37:48.335263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2451
2025-10-10T14:37:48.335304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602296054397848:11142]
2025-10-10T14:37:48.335312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:48.335324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:48.335333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.335343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.335398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:48.335411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.335416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.335419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:48.335432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.335444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:48.335467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.335677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.335690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.335714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.335810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2452 partition: 0 MaxSeqNo: 40 sessionId: src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0
2025-10-10T14:37:48.336235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a54f4ed-2611cccb-7a0931c6-e2c7eb6d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:48.339130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0] Write session: try to update token
2025-10-10T14:37:48.339149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:48.355535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:48.355556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:48.355560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:48.355562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:48.355573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602296054397848:11142]
2025-10-10T14:37:48.355577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602296054397848:11142]
2025-10-10T14:37:48.355582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602296054397848:11142]
2025-10-10T14:37:48.355640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:48.355647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:48.355656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.355659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:48.355667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:48.355671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:48.355813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:48.355526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2452 sessionId: src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:48.358362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:48.401388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602296836629908:10596]
2025-10-10T14:37:48.401695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2451, pipe: [1:7559602296836629908:10596]
2025-10-10T14:37:48.477532Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:48.478319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.478334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.478375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836629908:10596], now have 1 active actors on pipe
2025-10-10T14:37:48.478580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:48.478649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:48.478671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:48.478737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2452 reason: error at write: Disconnected sessionId: src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0
2025-10-10T14:37:48.478962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2452 sessionId: src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0 is DEAD
2025-10-10T14:37:48.479166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602296836629908:10596]
2025-10-10T14:37:48.479182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:48.481601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:48.481612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0] Write session will restart in 0.008890s
2025-10-10T14:37:48.481632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0] Write session: Do CDS request
2025-10-10T14:37:48.481639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:48.492825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.492893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:48.492911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2453
2025-10-10T14:37:48.493082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.493120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:48.493130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:48.493135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:48.493650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2453 sessionId:  describe result for acl check
2025-10-10T14:37:48.493700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:48.493706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:48.493708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:48.493714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602296836629940:10915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:48.494287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602296836629940:10915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:48.510817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602296836629940:10915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:48.514467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602296836629940:10915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:48.514495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602296836629940:10915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:48.514499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602296836629940:10915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:48.514509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:48.524917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:48.528450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:48.528712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:48.528724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:48.528737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:48.528798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:48.528848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602296054398144:11144]
2025-10-10T14:37:48.529567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:48.529926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:48.529985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:48.530355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:48.530420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.530427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.530428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.530430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.530431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.530433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.530435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.530436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.530437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.530439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.530440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.530442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.530443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.530450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.530465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.530470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.530475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.530480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.530485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.530490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.530495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.530499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.530504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.530509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.530513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.530518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.530526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.530535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.530550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.530557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.530562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.530568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.530573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.530579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.530584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.530590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.530595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.530602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.530608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.530615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.530620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.530626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.530633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.530639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.530646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.530656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.530661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.530666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.530671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.530676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.530680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.530689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.530726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:48.533357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:48.533871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:48.533883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:48.533886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:48.533898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:48.533906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2452 [2:7559602296054398144:11144]
2025-10-10T14:37:48.533922Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:48.533946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:48.533957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.533961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.533963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.533982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:48.533991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:48.534000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:48.534096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.534102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.534104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.534107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:48.534197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:48.534209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.534223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.534233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.534249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:48.534272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602296054398139:11144]
2025-10-10T14:37:48.534281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602296054398139:11144]
2025-10-10T14:37:48.534285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602296054398139:11144]
2025-10-10T14:37:48.534296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:48.534307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:48.534315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836630060:10915], now have 1 active actors on pipe
2025-10-10T14:37:48.534317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:48.534320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:48.534325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:48.534343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:48.534352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:48.534359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836629910:2438], now have 1 active actors on pipe
2025-10-10T14:37:48.534376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2452
2025-10-10T14:37:48.534399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602296054398139:11144]
2025-10-10T14:37:48.534420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:48.534388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2452
2025-10-10T14:37:48.534434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:48.534919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.534937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.534987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:48.535007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.535012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.535015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:48.535028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.535042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:48.535066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.535247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.535259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.535277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.535376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2453 partition: 0 MaxSeqNo: 40 sessionId: src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0
2025-10-10T14:37:48.535771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d925138-2f17392a-8ba7c9ea-2d4b0f9b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:48.538693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0] Write session: try to update token
2025-10-10T14:37:48.538715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:48.554319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:48.554338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:48.554342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:48.554344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:48.554356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602296054398139:11144]
2025-10-10T14:37:48.554361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602296054398139:11144]
2025-10-10T14:37:48.554366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602296054398139:11144]
2025-10-10T14:37:48.554420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:48.554429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.554428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:48.554432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:48.554441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:48.554446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:48.554581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:48.556709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2453 sessionId: src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:48.559546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:48.579560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602296836630205:10596]
2025-10-10T14:37:48.580384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2452, pipe: [1:7559602296836630205:10596]
2025-10-10T14:37:48.680655Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:48.681293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.681316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.681378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836630205:10596], now have 1 active actors on pipe
2025-10-10T14:37:48.681588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:48.681619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602296836630205:10596]
2025-10-10T14:37:48.681644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:48.681647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:48.681646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:48.681724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2453 reason: error at write: Disconnected sessionId: src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0
2025-10-10T14:37:48.681943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2453 sessionId: src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0 is DEAD
2025-10-10T14:37:48.682108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:48.682121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0] Write session will restart in 0.007740s
2025-10-10T14:37:48.682160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0] Write session: Do CDS request
2025-10-10T14:37:48.682169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:48.690987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.691153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:48.691170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2454
2025-10-10T14:37:48.691535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.691584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:48.691596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:48.691601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:48.692071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2454 sessionId:  describe result for acl check
2025-10-10T14:37:48.692110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:48.692115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:48.692118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:48.692134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602296836630228:10919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:48.692768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602296836630228:10919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:48.695939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602296836630228:10919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:48.700030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602296836630228:10919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:48.700048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602296836630228:10919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:48.700051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602296836630228:10919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:48.700061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:48.708458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:48.711878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:48.712191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:48.712204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:48.712220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:48.712294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:48.712353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602296054398436:11146]
2025-10-10T14:37:48.713028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:48.713412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:48.713464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:48.713812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:48.713881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.713887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.713888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.713889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.713890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.713892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.713893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.713894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.713896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.713897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.713898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.713900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.713901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.713908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.713923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.713927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.713931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.713935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.713940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.713944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.713949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.713952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.713956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.713960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.713965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.713969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.713977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.713988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.713998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.714004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.714007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.714012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.714016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.714023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.714028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.714035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.714039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.714045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.714051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.714057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.714067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.714074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.714078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.714084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.714093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.714099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.714108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.714115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.714121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.714126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.714134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.714140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.714190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:48.716978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:48.718504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2453
2025-10-10T14:37:48.718566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2453
2025-10-10T14:37:48.717538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:48.717553Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:48.717557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:48.717561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:48.717569Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2453 [2:7559602296054398436:11146]
2025-10-10T14:37:48.717585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:48.717604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:48.717608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.717612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.717614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.717634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:48.717642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:48.717650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:48.718207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.718211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.718214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.718217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:48.718295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:48.718297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.718308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.718314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.718329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:48.718352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602296054398431:11146]
2025-10-10T14:37:48.718355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602296054398431:11146]
2025-10-10T14:37:48.718357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602296054398431:11146]
2025-10-10T14:37:48.718367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:48.718381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:48.718385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:48.718386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:48.718389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:48.718402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:48.718405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:48.718418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836630208:2438], now have 1 active actors on pipe
2025-10-10T14:37:48.718421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836630358:10919], now have 1 active actors on pipe
2025-10-10T14:37:48.718461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602296054398431:11146]
2025-10-10T14:37:48.718469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:48.718483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:48.718676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.718682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.718734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:48.718743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.718748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.718751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:48.718767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.718780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:48.718816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.719052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.719064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.719083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.719180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2454 partition: 0 MaxSeqNo: 40 sessionId: src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0
2025-10-10T14:37:48.719599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81cfa39-1d76bdc3-b9f04809-1e805416_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:48.722775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0] Write session: try to update token
2025-10-10T14:37:48.722815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:48.738002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2454 sessionId: src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:48.740634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:48.740570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:48.740593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:48.740596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:48.740599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:48.740610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602296054398431:11146]
2025-10-10T14:37:48.740614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602296054398431:11146]
2025-10-10T14:37:48.740618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602296054398431:11146]
2025-10-10T14:37:48.740671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:48.740678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.740680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:48.740685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:48.740692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:48.740696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:48.740824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:48.781756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602296836630508:10596]
2025-10-10T14:37:48.782044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2453, pipe: [1:7559602296836630508:10596]
2025-10-10T14:37:48.859143Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:48.859737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.859758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.859809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836630508:10596], now have 1 active actors on pipe
2025-10-10T14:37:48.860100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:48.860108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:48.860110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602296836630508:10596]
2025-10-10T14:37:48.860136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:48.860139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:48.860220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2454 reason: error at write: Disconnected sessionId: src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0
2025-10-10T14:37:48.860464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2454 sessionId: src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0 is DEAD
2025-10-10T14:37:48.861437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:48.861460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0] Write session will restart in 0.007155s
2025-10-10T14:37:48.861488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0] Write session: Do CDS request
2025-10-10T14:37:48.861511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:48.869908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.873489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:48.873507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2455
2025-10-10T14:37:48.874851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:48.874895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:48.874902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:48.874906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:48.875407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2455 sessionId:  describe result for acl check
2025-10-10T14:37:48.875450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:48.875452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:48.875454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:48.875460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602296836630522:10924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:48.879196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602296836630522:10924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:48.883294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602296836630522:10924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:48.891322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602296836630522:10924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:48.891346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602296836630522:10924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:48.891350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602296836630522:10924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:48.891361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:48.910187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:48.913935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:48.914198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:48.914203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:48.914216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:48.914275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:48.914318Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602296054398729:11148]
2025-10-10T14:37:48.914964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:48.915320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:48.915367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:48.915727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:48.915780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.915782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.915783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.915784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.915785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.915786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.915788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.915789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.915790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.915792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.915793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.915794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.915796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.915803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.915817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.915822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.915825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.915829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.915834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.915838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.915842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.915846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.915850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.915855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.915859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.915863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.915873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.915882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:48.915888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.915894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:48.915899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.915904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:48.915908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.915913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:48.915918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.915924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:48.915928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.915934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:48.915939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.915945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:48.915949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.915955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:48.915959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.915964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:48.915968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.915976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:48.915981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.915986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.915990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.915996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.916001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.916006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.916046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:48.919295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:48.920956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2454
2025-10-10T14:37:48.921007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2454
2025-10-10T14:37:48.920148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:48.920163Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:48.920165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:48.920169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:48.920176Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2454 [2:7559602296054398729:11148]
2025-10-10T14:37:48.920191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:48.920211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:48.920215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.920219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.920222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.920240Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:48.920247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:48.920255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:48.920320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.920323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.920324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.920327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:48.920398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:48.920401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.920413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:48.920424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:48.920442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:48.920464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602296054398724:11148]
2025-10-10T14:37:48.920467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602296054398724:11148]
2025-10-10T14:37:48.920470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602296054398724:11148]
2025-10-10T14:37:48.920481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:48.920491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:48.920494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:48.920495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:48.920496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:48.920511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:48.920514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:48.920526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836630513:2438], now have 1 active actors on pipe
2025-10-10T14:37:48.920530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836630585:10924], now have 1 active actors on pipe
2025-10-10T14:37:48.920560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602296054398724:11148]
2025-10-10T14:37:48.920568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:48.921076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:48.921178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.921186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.921217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c25c9980-1e275810-1237df44-f8c24594_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:48.921227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:48.921231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:48.921234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:48.921249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:48.921263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:48.921278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.921560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:48.921564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:48.921582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:48.921718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2455 partition: 0 MaxSeqNo: 40 sessionId: src_id|c25c9980-1e275810-1237df44-f8c24594_0
2025-10-10T14:37:48.922158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ae837e-d0c3fdc5-9b0cd008-ed770581_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c25c9980-1e275810-1237df44-f8c24594_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:48.925148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c25c9980-1e275810-1237df44-f8c24594_0] Write session: try to update token
2025-10-10T14:37:48.925169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c25c9980-1e275810-1237df44-f8c24594_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:48.943721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:48.943744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:48.943748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:48.943750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:48.943761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602296054398724:11148]
2025-10-10T14:37:48.943766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602296054398724:11148]
2025-10-10T14:37:48.943771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602296054398724:11148]
2025-10-10T14:37:48.943824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:48.943830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:48.943836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:48.943838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:48.943839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:48.943843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:48.943987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:48.951638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2455 sessionId: src_id|c25c9980-1e275810-1237df44-f8c24594_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:48.954534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:48.958220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602296836630811:10596]
2025-10-10T14:37:48.965671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2454, pipe: [1:7559602296836630811:10596]
2025-10-10T14:37:49.064813Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:49.065297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.065306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.065507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602296836630811:10596], now have 1 active actors on pipe
2025-10-10T14:37:49.066455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:49.066903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:49.067067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2455 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c25c9980-1e275810-1237df44-f8c24594_0
2025-10-10T14:37:49.067245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2455 sessionId: src_id|c25c9980-1e275810-1237df44-f8c24594_0 is DEAD
2025-10-10T14:37:49.067455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:49.068609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25c9980-1e275810-1237df44-f8c24594_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:49.068623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25c9980-1e275810-1237df44-f8c24594_0] Write session will restart in 0.005316s
2025-10-10T14:37:49.067494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602296836630811:10596]
2025-10-10T14:37:49.068647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25c9980-1e275810-1237df44-f8c24594_0] Write session: Do CDS request
2025-10-10T14:37:49.068652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25c9980-1e275810-1237df44-f8c24594_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:49.074895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c25c9980-1e275810-1237df44-f8c24594_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.077724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:49.077739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2456
2025-10-10T14:37:49.077929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.077963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:49.077969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:49.077972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:49.078404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2456 sessionId:  describe result for acl check
2025-10-10T14:37:49.078433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:49.078435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:49.078437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:49.078443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602301131598125:10928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:49.079042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602301131598125:10928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:49.086590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602301131598125:10928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:49.090975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602301131598125:10928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:49.091001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602301131598125:10928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:49.091005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602301131598125:10928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:49.091016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:49.096891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:49.100343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:49.100618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:49.100630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:49.100643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:49.100704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:49.100757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602300349366320:11150]
2025-10-10T14:37:49.101471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:49.101796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:49.101846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:49.102197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:49.102255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.102264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.102266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.102267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.102269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.102270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.102272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.102273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.102275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.102276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.102278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.102279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.102280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.102287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.102302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.102307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.102313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.102317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.102322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.102327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.102332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.102336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.102342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.102346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.102350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.102355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.102364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.102373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.102381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.102388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.102393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.102398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.102404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.102410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.102416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.102422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.102427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.102433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.102439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.102445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.102450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.102456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.102470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.102477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.102482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.102490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.102495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.102500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.102508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.102514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.102525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.102530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.102578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:49.105124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:49.105637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:49.105655Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:49.105657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:49.105662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:49.105669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2455 [2:7559602300349366320:11150]
2025-10-10T14:37:49.105685Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:49.105706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:49.105710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.105715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.105718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.105737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:49.105751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:49.105761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:49.105840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.105848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.105850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.105853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:49.105929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:49.105937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.105950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.105969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.105987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:49.106013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131598110:2438], now have 1 active actors on pipe
2025-10-10T14:37:49.106021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131598273:10928], now have 1 active actors on pipe
2025-10-10T14:37:49.106030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602300349366315:11150]
2025-10-10T14:37:49.106033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602300349366315:11150]
2025-10-10T14:37:49.106035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602300349366315:11150]
2025-10-10T14:37:49.106050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:49.106072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:49.106073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:49.106078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:49.106081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:49.106095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:49.106098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:49.106131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602300349366315:11150]
2025-10-10T14:37:49.106139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:49.106103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2455
2025-10-10T14:37:49.106118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2455
2025-10-10T14:37:49.106155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:49.106167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.106172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.106221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:49.106247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.106255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.106258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:49.106271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.106287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:49.106316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.106523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.106534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.106551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.106693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2456 partition: 0 MaxSeqNo: 40 sessionId: src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0
2025-10-10T14:37:49.109635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c25c9980-1e275810-1237df44-f8c24594_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:49.112639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0] Write session: try to update token
2025-10-10T14:37:49.112666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:49.127217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:49.127238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:49.127242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:49.127244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:49.127255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602300349366315:11150]
2025-10-10T14:37:49.127259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602300349366315:11150]
2025-10-10T14:37:49.127265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602300349366315:11150]
2025-10-10T14:37:49.127324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:49.127341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.127344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:49.127499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:49.128205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:49.128220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:49.128225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:49.133174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2456 sessionId: src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:49.135983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:49.167315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602301131598408:10596]
2025-10-10T14:37:49.167584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2455, pipe: [1:7559602301131598408:10596]
2025-10-10T14:37:49.250569Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:49.251078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.251096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.251130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131598408:10596], now have 1 active actors on pipe
2025-10-10T14:37:49.251353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:49.251372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:49.251368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:49.251437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2456 reason: error at write: Disconnected sessionId: src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0
2025-10-10T14:37:49.251671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2456 sessionId: src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0 is DEAD
2025-10-10T14:37:49.251860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:49.251883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0] Write session will restart in 0.005997s
2025-10-10T14:37:49.251861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:49.251909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0] Write session: Do CDS request
2025-10-10T14:37:49.251916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:49.251909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602301131598408:10596]
2025-10-10T14:37:49.259111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.259200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:49.259216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2457
2025-10-10T14:37:49.259348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.259385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:49.259395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:49.259400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:49.259869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2457 sessionId:  describe result for acl check
2025-10-10T14:37:49.259914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:49.259925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:49.259928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:49.259938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602301131598435:10938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:49.260690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602301131598435:10938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:49.263565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602301131598435:10938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:49.267118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602301131598435:10938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:49.267137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602301131598435:10938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:49.267142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602301131598435:10938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:49.267152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:49.278610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:49.282154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:49.282413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:49.282425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:49.282438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:49.282498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:49.282551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602300349366669:11165]
2025-10-10T14:37:49.283204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:49.283583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:49.283666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:49.284019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:49.284085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.284092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.284093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.284095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.284096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.284097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.284099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.284100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.284101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.284103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.284104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.284105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.284107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.284113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.284127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.284131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.284135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.284140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.284144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.284148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.284152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.284156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.284161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.284165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.284169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.284174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.284182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.284191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.284198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.284204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.284209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.284214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.284220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.284225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.284230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.284235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.284239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.284245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.284250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.284255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.284265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.284270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.284277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.284288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.284294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.284304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.284308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.284314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.284323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.284328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.284336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.284346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.284399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:49.287023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:49.287799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:49.287814Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:49.287817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:49.287821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:49.287827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2456 [2:7559602300349366669:11165]
2025-10-10T14:37:49.287841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:49.287860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:49.287868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.287872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.287874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.287893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:49.287900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:49.287908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:49.287983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.287991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.287993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.287996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:49.288067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:49.288074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.288087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.288104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.288127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:49.288157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131598425:2438], now have 1 active actors on pipe
2025-10-10T14:37:49.288165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131598485:10938], now have 1 active actors on pipe
2025-10-10T14:37:49.288175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602300349366664:11165]
2025-10-10T14:37:49.288177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602300349366664:11165]
2025-10-10T14:37:49.288180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602300349366664:11165]
2025-10-10T14:37:49.288193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:49.288208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:49.288222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:49.288225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:49.288227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:49.288238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:49.288241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:49.288273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602300349366664:11165]
2025-10-10T14:37:49.288276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:49.288279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:49.288295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.288300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.288358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29801e50-124dc428-40a60633-96ea06fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:49.288366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.288370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.288373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:49.288384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.288395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:49.288414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.288567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.288570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.288586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.288222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2456
2025-10-10T14:37:49.288234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2456
2025-10-10T14:37:49.288668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2457 partition: 0 MaxSeqNo: 40 sessionId: src_id|29801e50-124dc428-40a60633-96ea06fd_0
2025-10-10T14:37:49.289080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7271308d-bcbe40fa-1de82ca0-82ef110c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29801e50-124dc428-40a60633-96ea06fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:49.291934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29801e50-124dc428-40a60633-96ea06fd_0] Write session: try to update token
2025-10-10T14:37:49.291955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29801e50-124dc428-40a60633-96ea06fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:49.307125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2457 sessionId: src_id|29801e50-124dc428-40a60633-96ea06fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:49.309205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:49.309226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:49.309229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:49.309231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:49.309246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602300349366664:11165]
2025-10-10T14:37:49.309252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602300349366664:11165]
2025-10-10T14:37:49.309256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602300349366664:11165]
2025-10-10T14:37:49.309315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:49.309318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:49.309327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:49.309344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.309347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:49.309367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:49.309511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:49.310183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:49.352349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602301131598742:10596]
2025-10-10T14:37:49.352869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2456, pipe: [1:7559602301131598742:10596]
2025-10-10T14:37:49.431506Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:49.432152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.432161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.432201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131598742:10596], now have 1 active actors on pipe
2025-10-10T14:37:49.432529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:49.432571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602301131598742:10596]
2025-10-10T14:37:49.432605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:49.432609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:49.432611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:49.432669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2457 reason: error at write: Disconnected sessionId: src_id|29801e50-124dc428-40a60633-96ea06fd_0
2025-10-10T14:37:49.432869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2457 sessionId: src_id|29801e50-124dc428-40a60633-96ea06fd_0 is DEAD
2025-10-10T14:37:49.433031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29801e50-124dc428-40a60633-96ea06fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:49.433058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29801e50-124dc428-40a60633-96ea06fd_0] Write session will restart in 0.007276s
2025-10-10T14:37:49.433083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29801e50-124dc428-40a60633-96ea06fd_0] Write session: Do CDS request
2025-10-10T14:37:49.433090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29801e50-124dc428-40a60633-96ea06fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:49.441921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29801e50-124dc428-40a60633-96ea06fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.442196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:49.442224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2458
2025-10-10T14:37:49.442419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.442458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:49.442472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:49.442476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:49.443128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2458 sessionId:  describe result for acl check
2025-10-10T14:37:49.443164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:49.443170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:49.443173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:49.443179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602301131598757:10945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:49.443760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602301131598757:10945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:49.457004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602301131598757:10945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:49.466858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602301131598757:10945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:49.466875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602301131598757:10945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:49.466878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602301131598757:10945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:49.466887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:49.476658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:49.483136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:49.483445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:49.483467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:49.483485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:49.483568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:49.483624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602300349366965:11169]
2025-10-10T14:37:49.484303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:49.484819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:49.484887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:49.485250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:49.485313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.485319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.485320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.485321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.485322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.485323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.485324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.485325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.485326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.485327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.485342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.485343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.485345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.485352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.485366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.485370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.485374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.485378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.485382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.485387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.485391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.485395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.485399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.485402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.485404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.485406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.485414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.485419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.485424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.485429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.485432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.485435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.485438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.485441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.485445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.485465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.485470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.485476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.485481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.485487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.485492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.485498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.485502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.485505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.485508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.485512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.485516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.485520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.485530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.485535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.485541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.485546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.485589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:49.490735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:49.491564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:49.491580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:49.491582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:49.491586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:49.491593Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2457 [2:7559602300349366965:11169]
2025-10-10T14:37:49.491609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:49.491631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:49.491635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.491640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.491643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.491662Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:49.491670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:49.491681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:49.491751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.491760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.491762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.491764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:49.491848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:49.491856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.491869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.491885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.491903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:49.491932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602300349366960:11169]
2025-10-10T14:37:49.491940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602300349366960:11169]
2025-10-10T14:37:49.491943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602300349366960:11169]
2025-10-10T14:37:49.491958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:49.491978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:49.491996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:49.491999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:49.492003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:49.492008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:49.492011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:49.492045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602300349366960:11169]
2025-10-10T14:37:49.492056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:49.492106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:49.492277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2457
2025-10-10T14:37:49.492321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2457
2025-10-10T14:37:49.492362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131598920:10945], now have 1 active actors on pipe
2025-10-10T14:37:49.492372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131598744:2438], now have 1 active actors on pipe
2025-10-10T14:37:49.492582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.492603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.492641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d965f63f-441c5f05-eb93dac-5253e93c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:49.492656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.492662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.492665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:49.492681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.492711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:49.492731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.497212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.497235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.497276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.497466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2458 partition: 0 MaxSeqNo: 40 sessionId: src_id|d965f63f-441c5f05-eb93dac-5253e93c_0
2025-10-10T14:37:49.501468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29801e50-124dc428-40a60633-96ea06fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d965f63f-441c5f05-eb93dac-5253e93c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:49.504359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d965f63f-441c5f05-eb93dac-5253e93c_0] Write session: try to update token
2025-10-10T14:37:49.504387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d965f63f-441c5f05-eb93dac-5253e93c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:49.513962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:49.513982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:49.513987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:49.513989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:49.513999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602300349366960:11169]
2025-10-10T14:37:49.514004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602300349366960:11169]
2025-10-10T14:37:49.514008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602300349366960:11169]
2025-10-10T14:37:49.514057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:49.514065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.514069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:49.514214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:49.518041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:49.518060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:49.518073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:49.531357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602301131599044:10596]
2025-10-10T14:37:49.531678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2457, pipe: [1:7559602301131599044:10596]
2025-10-10T14:37:49.541165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2458 sessionId: src_id|d965f63f-441c5f05-eb93dac-5253e93c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:49.544070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:49.654577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:49.654876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131599044:10596], now have 1 active actors on pipe
2025-10-10T14:37:49.654939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.654951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.655309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:49.655326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:49.655375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602301131599044:10596]
2025-10-10T14:37:49.655431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2458 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d965f63f-441c5f05-eb93dac-5253e93c_0
2025-10-10T14:37:49.655232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:49.655638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2458 sessionId: src_id|d965f63f-441c5f05-eb93dac-5253e93c_0 is DEAD
2025-10-10T14:37:49.655811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d965f63f-441c5f05-eb93dac-5253e93c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:49.655823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d965f63f-441c5f05-eb93dac-5253e93c_0] Write session will restart in 0.005176s
2025-10-10T14:37:49.655848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d965f63f-441c5f05-eb93dac-5253e93c_0] Write session: Do CDS request
2025-10-10T14:37:49.655854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d965f63f-441c5f05-eb93dac-5253e93c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:49.661836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d965f63f-441c5f05-eb93dac-5253e93c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.661944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:49.661959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2459
2025-10-10T14:37:49.662093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.662127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:49.662139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:49.662144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:49.662620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2459 sessionId:  describe result for acl check
2025-10-10T14:37:49.662661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:49.662668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:49.662669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:49.662675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602301131599060:10949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:49.663237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602301131599060:10949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:49.665694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602301131599060:10949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:49.668233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602301131599060:10949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:49.668250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602301131599060:10949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:49.668253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602301131599060:10949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:49.668262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:49.684541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:49.687787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:49.688040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:49.688051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:49.688063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:49.688121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:49.688164Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602300349367262:11171]
2025-10-10T14:37:49.688775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:49.689381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:49.689446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:49.689791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:49.689857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.689864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.689865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.689867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.689868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.689882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.689883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.689885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.689886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.689888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.689889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.689891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.689892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.689899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.689913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.689918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.689923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.689928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.689933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.689942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.689946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.689950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.689954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.689958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.689962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.689966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.689976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.689985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.689998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.690005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.690014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.690020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.690026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.690039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.690044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.690049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.690054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.690060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.690065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.690071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.690080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.690086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.690095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.690100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.690109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.690113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.690117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.690121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.690125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.690129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.690133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.690137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.690184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:49.692980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:49.693655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:49.693667Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:49.693669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:49.693673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:49.693680Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2458 [2:7559602300349367262:11171]
2025-10-10T14:37:49.693692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:49.693710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:49.693713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.693717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.693719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.693736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:49.693749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:49.693763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:49.693829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.693835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.693838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.693841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:49.693913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:49.693921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.693932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.693949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.693974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:49.694003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131599047:2438], now have 1 active actors on pipe
2025-10-10T14:37:49.694014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131599100:10949], now have 1 active actors on pipe
2025-10-10T14:37:49.694021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602300349367257:11171]
2025-10-10T14:37:49.694024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602300349367257:11171]
2025-10-10T14:37:49.694026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602300349367257:11171]
2025-10-10T14:37:49.694041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:49.694055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:49.694072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:49.694075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:49.694076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:49.694077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:49.694079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:49.694105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602300349367257:11171]
2025-10-10T14:37:49.694113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:49.694115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2458
2025-10-10T14:37:49.694128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2458
2025-10-10T14:37:49.694259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:49.694317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.694328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.694359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:49.694372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.694376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.694379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:49.694389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.694400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:49.694414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.694561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.694570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.694586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.694701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2459 partition: 0 MaxSeqNo: 40 sessionId: src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0
2025-10-10T14:37:49.695113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d965f63f-441c5f05-eb93dac-5253e93c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:49.697872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0] Write session: try to update token
2025-10-10T14:37:49.697890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:49.713554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:49.713575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:49.713579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:49.713581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:49.713591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602300349367257:11171]
2025-10-10T14:37:49.713596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602300349367257:11171]
2025-10-10T14:37:49.713599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602300349367257:11171]
2025-10-10T14:37:49.713655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:49.713663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.713665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:49.713807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:49.716185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2459 sessionId: src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:49.717495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:49.717513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:49.717518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:49.718944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:49.755609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602301131599346:10596]
2025-10-10T14:37:49.755966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2458, pipe: [1:7559602301131599346:10596]
2025-10-10T14:37:49.832873Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:49.833364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.833379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.833425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131599346:10596], now have 1 active actors on pipe
2025-10-10T14:37:49.833806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602301131599346:10596]
2025-10-10T14:37:49.833812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:49.833817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:49.833842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:49.833865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:49.833893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2459 reason: error at write: Disconnected sessionId: src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0
2025-10-10T14:37:49.834101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2459 sessionId: src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0 is DEAD
2025-10-10T14:37:49.837533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:49.837544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0] Write session will restart in 0.008894s
2025-10-10T14:37:49.837571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0] Write session: Do CDS request
2025-10-10T14:37:49.837577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:49.849778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.850389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:49.850405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2460
2025-10-10T14:37:49.850566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:49.850617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:49.850623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:49.850628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:49.851198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2460 sessionId:  describe result for acl check
2025-10-10T14:37:49.851239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:49.851246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:49.851248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:49.851257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602301131599465:10954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:49.851867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602301131599465:10954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:49.855985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602301131599465:10954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:49.859391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602301131599465:10954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:49.859405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602301131599465:10954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:49.859409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602301131599465:10954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:49.859417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:49.860412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:49.863542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:49.863782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:49.863795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:49.863809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:49.863866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:49.863915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602300349367560:11173]
2025-10-10T14:37:49.864600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:49.864992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:49.865040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:49.865399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:49.865466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.865472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.865474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.865475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.865477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.865478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.865480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.865482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.865483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.865485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.865486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.865488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.865489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.865496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.865508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.865513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.865518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.865523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.865527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.865532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.865536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.865541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.865546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.865550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.865554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.865558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.865567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.865577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:49.865584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.865591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:49.865596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.865602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:49.865607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.865613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:49.865618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.865624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:49.865629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.865635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:49.865640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.865644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:49.865648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.865653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:49.865657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.865662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:49.865674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.865681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:49.865691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.865697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.865706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.865711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.865716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.865726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.865771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:49.868944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:49.869909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:49.869928Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:49.869932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:49.869936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:49.869943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2459 [2:7559602300349367560:11173]
2025-10-10T14:37:49.869959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:49.869978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:49.869986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.869990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.869993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.870012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:49.870025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:49.870033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:49.870098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.870108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.870111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.870113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:49.870189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:49.870200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.870214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:49.870228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:49.870248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:49.870277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131599357:2438], now have 1 active actors on pipe
2025-10-10T14:37:49.870286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131599645:10954], now have 1 active actors on pipe
2025-10-10T14:37:49.870296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602300349367555:11173]
2025-10-10T14:37:49.870299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602300349367555:11173]
2025-10-10T14:37:49.870301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602300349367555:11173]
2025-10-10T14:37:49.870319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:49.870338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:49.870360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:49.870368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:49.870379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:49.870382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:49.870384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:49.870395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602300349367555:11173]
2025-10-10T14:37:49.870403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:49.870414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:49.870359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2459
2025-10-10T14:37:49.870433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2459
2025-10-10T14:37:49.870543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.870555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.870586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:49.870601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:49.870605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:49.870608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:49.870620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:49.870631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:49.870647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.870949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:49.870977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:49.871045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:49.871179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2460 partition: 0 MaxSeqNo: 40 sessionId: src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0
2025-10-10T14:37:49.873638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae94f4-ffb03798-df1668b-4f9810c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:49.876491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0] Write session: try to update token
2025-10-10T14:37:49.876508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:49.888282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:49.888303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:49.888315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602300349367555:11173]
2025-10-10T14:37:49.888369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:49.888381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:49.888559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:49.888717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:49.888861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:49.889004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:49.889200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:49.889244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:49.902380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:49.902413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:49.902416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:49.902418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:49.902431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602300349367555:11173]
2025-10-10T14:37:49.902435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602300349367555:11173]
2025-10-10T14:37:49.902439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602300349367555:11173]
2025-10-10T14:37:49.902474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2460 sessionId: src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:49.902492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:49.902491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:49.902497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:49.902503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:49.902503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:49.902506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:49.902644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:49.905315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:49.935227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602301131599658:10596]
2025-10-10T14:37:49.935624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2459, pipe: [1:7559602301131599658:10596]
2025-10-10T14:37:50.022705Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:50.023294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.023316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.023340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602301131599658:10596], now have 1 active actors on pipe
2025-10-10T14:37:50.023568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:50.023622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:50.023584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:50.023639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:50.023705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2460 reason: error at write: Disconnected sessionId: src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0
2025-10-10T14:37:50.023898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2460 sessionId: src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0 is DEAD
2025-10-10T14:37:50.024035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:50.024049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0] Write session will restart in 0.006456s
2025-10-10T14:37:50.024073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0] Write session: Do CDS request
2025-10-10T14:37:50.024079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:50.024051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602301131599658:10596]
2025-10-10T14:37:50.031993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.032057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:50.032075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2461
2025-10-10T14:37:50.032245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.032284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:50.032295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:50.032299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:50.032791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2461 sessionId:  describe result for acl check
2025-10-10T14:37:50.032846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:50.032853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:50.032855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:50.032862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602305426566972:10958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:50.033412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602305426566972:10958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:50.038316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602305426566972:10958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:50.043796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602305426566972:10958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:50.043825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602305426566972:10958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:50.043829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602305426566972:10958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:50.043839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:50.052053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:50.055415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:50.055874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:50.055887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:50.055902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:50.055975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:50.056021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602304644335155:11175]
2025-10-10T14:37:50.056694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:50.057032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:50.057078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:50.057422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:50.057489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.057496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.057497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.057498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.057500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.057501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.057502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.057504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.057505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.057507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.057508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.057510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.057511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.057517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.057532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.057537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.057542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.057547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.057551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.057556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.057560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.057565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.057570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.057574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.057579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.057583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.057593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.057602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.057609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.057616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.057621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.057627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.057631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.057635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.057640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.057645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.057650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.057655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.057660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.057666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.057671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.057677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.057682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.057688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.057692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.057698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.057705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.057717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.057722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.057729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.057734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.057738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.057780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:50.062604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:50.063232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:50.063248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:50.063251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:50.063255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:50.063262Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2460 [2:7559602304644335155:11175]
2025-10-10T14:37:50.063275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:50.063293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:50.063302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.063306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.063309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.063327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:50.063353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:50.063362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:50.063428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.063436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.063438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.063440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:50.063492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:50.063498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.063506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.063513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.063527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:50.063545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602304644335150:11175]
2025-10-10T14:37:50.063552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602304644335150:11175]
2025-10-10T14:37:50.063562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602304644335150:11175]
2025-10-10T14:37:50.063576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:50.063587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:50.063598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:50.063600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:50.063622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602304644335150:11175]
2025-10-10T14:37:50.063624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:50.063784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:50.063791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:50.063794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:50.063798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:50.064081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567110:10958], now have 1 active actors on pipe
2025-10-10T14:37:50.064090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426566957:2438], now have 1 active actors on pipe
2025-10-10T14:37:50.066462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2460
2025-10-10T14:37:50.066472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2460
2025-10-10T14:37:50.066843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.066861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.066905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c006432b-a8710147-6090066b-303b7d3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:50.066919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.066926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.066930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:50.066946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.066964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:50.066985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.067528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.067541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.067566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.067709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2461 partition: 0 MaxSeqNo: 40 sessionId: src_id|c006432b-a8710147-6090066b-303b7d3c_0
2025-10-10T14:37:50.068212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67c98d43-fb6ed316-138fc6a8-8c0f94d8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c006432b-a8710147-6090066b-303b7d3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:50.070991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c006432b-a8710147-6090066b-303b7d3c_0] Write session: try to update token
2025-10-10T14:37:50.071012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c006432b-a8710147-6090066b-303b7d3c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:50.086562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:50.086583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:50.086587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:50.086589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:50.086600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602304644335150:11175]
2025-10-10T14:37:50.086605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602304644335150:11175]
2025-10-10T14:37:50.086609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602304644335150:11175]
2025-10-10T14:37:50.086664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:50.086678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.086681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:50.086714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:50.086738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:50.086743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:50.086854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:50.094033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2461 sessionId: src_id|c006432b-a8710147-6090066b-303b7d3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:50.096844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:50.124258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602305426567259:10596]
2025-10-10T14:37:50.124541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2460, pipe: [1:7559602305426567259:10596]
2025-10-10T14:37:50.210224Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:50.210746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.210792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.210816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567259:10596], now have 1 active actors on pipe
2025-10-10T14:37:50.211091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:50.211108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602305426567259:10596]
2025-10-10T14:37:50.211136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:50.211224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2461 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c006432b-a8710147-6090066b-303b7d3c_0
2025-10-10T14:37:50.211046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:50.211432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2461 sessionId: src_id|c006432b-a8710147-6090066b-303b7d3c_0 is DEAD
2025-10-10T14:37:50.211601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c006432b-a8710147-6090066b-303b7d3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:50.211614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c006432b-a8710147-6090066b-303b7d3c_0] Write session will restart in 0.006871s
2025-10-10T14:37:50.211653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c006432b-a8710147-6090066b-303b7d3c_0] Write session: Do CDS request
2025-10-10T14:37:50.211660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c006432b-a8710147-6090066b-303b7d3c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:50.219866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c006432b-a8710147-6090066b-303b7d3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.219956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:50.219971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2462
2025-10-10T14:37:50.220122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.220171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:50.220183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:50.220187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:50.220657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2462 sessionId:  describe result for acl check
2025-10-10T14:37:50.220695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:50.220701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:50.220704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:50.220710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602305426567277:10962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:50.221314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602305426567277:10962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:50.228712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602305426567277:10962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:50.233302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602305426567277:10962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:50.233322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602305426567277:10962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:50.233327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602305426567277:10962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:50.233351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:50.240640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:50.244052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:50.244422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:50.244435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:50.244449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:50.244514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:50.244556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602304644335483:11178]
2025-10-10T14:37:50.245185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:50.245548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:50.245594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:50.245912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:50.245975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.245982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.245984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.245985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.245986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.245988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.245989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.245990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.245991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.245992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.245994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.245995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.245996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.246001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.246013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.246017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.246022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.246025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.246030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.246033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.246037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.246041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.246046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.246050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.246054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.246058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.246066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.246075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.246081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.246087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.246091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.246096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.246103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.246109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.246114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.246127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.246132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.246144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.246149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.246154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.246159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.246165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.246170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.246175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.246184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.246189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.246194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.246199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.246208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.246214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.246218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.246228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.246269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:50.249159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:50.249509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:50.249524Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:50.249526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:50.249530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:50.249537Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2461 [2:7559602304644335483:11178]
2025-10-10T14:37:50.249550Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:50.249568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:50.249571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.249575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.249578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.249594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:50.249608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:50.249624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:50.249683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.249690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.249693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.249695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:50.249763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:50.249772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.249796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.249809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.249900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2461
2025-10-10T14:37:50.249828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:50.249901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2461
2025-10-10T14:37:50.249855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567423:10962], now have 1 active actors on pipe
2025-10-10T14:37:50.249859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567262:2438], now have 1 active actors on pipe
2025-10-10T14:37:50.249866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602304644335472:11178]
2025-10-10T14:37:50.249869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602304644335472:11178]
2025-10-10T14:37:50.249872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602304644335472:11178]
2025-10-10T14:37:50.249887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:50.249901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:50.249912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:50.249915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:50.249917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:50.249918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:50.249922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:50.249961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602304644335472:11178]
2025-10-10T14:37:50.249969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:50.249993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:50.250004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.250008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.250040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:50.250052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.250056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.250063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:50.250074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.250089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:50.250110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.250295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.250310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.250337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.250433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2462 partition: 0 MaxSeqNo: 40 sessionId: src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0
2025-10-10T14:37:50.250858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c006432b-a8710147-6090066b-303b7d3c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:50.253649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0] Write session: try to update token
2025-10-10T14:37:50.253666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:50.261822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:50.261843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:50.261854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602304644335472:11178]
2025-10-10T14:37:50.261905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:50.261904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:50.262087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:50.262625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:50.263181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:50.263326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:50.264188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:50.264240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:50.268991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2462 sessionId: src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:50.273090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:50.273402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.273424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.273480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:50.273592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:50.280413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:50.280434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:50.280437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:50.280439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:50.280449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602304644335472:11178]
2025-10-10T14:37:50.280452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602304644335472:11178]
2025-10-10T14:37:50.280455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602304644335472:11178]
2025-10-10T14:37:50.280505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:50.280518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.280518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:50.280524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:50.280524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:50.280528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:50.280667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:50.311104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602305426567578:10596]
2025-10-10T14:37:50.311392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2461, pipe: [1:7559602305426567578:10596]
2025-10-10T14:37:50.396858Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:50.405270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.405303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.405501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.405570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.405646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.405709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.405756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.405764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.405841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.405914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.405987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.406058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.406101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.406105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.406172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.406227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.406284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.406345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.406388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.406392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.406459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.406518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.406588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.406647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.406684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.406686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.406751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.406828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.406889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.406949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.406992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.406996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.407072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.407133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.407194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.407255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.407300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.407303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.407376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.407439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.407510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.407576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.407618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.407621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.407694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.409513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:50.409530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0] Write session will restart in 0.006941s
2025-10-10T14:37:50.409557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0] Write session: Do CDS request
2025-10-10T14:37:50.409564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:50.407755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.407817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.407879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.407947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.407951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.408023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.408088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.408157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.408223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.408288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.408291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.408368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:50.408453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:50.408521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:50.408585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:50.408626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:50.408629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:50.408711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567578:10596], now have 1 active actors on pipe
2025-10-10T14:37:50.410102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:50.409033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:50.409056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:50.409089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2462 reason: error at write: Disconnected sessionId: src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0
2025-10-10T14:37:50.409102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:50.409161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602305426567578:10596]
2025-10-10T14:37:50.409345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2462 sessionId: src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0 is DEAD
2025-10-10T14:37:50.417910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.418084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:50.418103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2463
2025-10-10T14:37:50.418283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.418332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:50.418338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:50.418343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:50.418851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2463 sessionId:  describe result for acl check
2025-10-10T14:37:50.418894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:50.418900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:50.418903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:50.418910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602305426567618:10976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:50.419498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602305426567618:10976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:50.423464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602305426567618:10976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:50.428512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602305426567618:10976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:50.428531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602305426567618:10976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:50.428535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602305426567618:10976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:50.428547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:50.434707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:50.438241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:50.438481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:50.438495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:50.438507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:50.438586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:50.438637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602304644335810:11194]
2025-10-10T14:37:50.439286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:50.439593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:50.439644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:50.439980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:50.440049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.440056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.440057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.440058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.440059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.440061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.440062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.440063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.440064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.440066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.440067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.440068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.440070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.440076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.440091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.440095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.440100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.440104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.440108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.440113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.440117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.440121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.440126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.440131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.440135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.440139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.440147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.440163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.440174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.440181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.440190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.440197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.440206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.440212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.440217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.440223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.440232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.440238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.440247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.440252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.440261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.440267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.440274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.440285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.440290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.440295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.440302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.440308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.440313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.440320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.440330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.440335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.440385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:50.442738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:50.443607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:50.443628Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:50.443631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:50.443635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:50.443642Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2462 [2:7559602304644335810:11194]
2025-10-10T14:37:50.443656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:50.443674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:50.443688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.443692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.443694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.443711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:50.443719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:50.443727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:50.443789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.443797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.443799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.443802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:50.443875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:50.443884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.443897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.443912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.443931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:50.443958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567603:2438], now have 1 active actors on pipe
2025-10-10T14:37:50.443968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567775:10976], now have 1 active actors on pipe
2025-10-10T14:37:50.443977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602304644335805:11194]
2025-10-10T14:37:50.443983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602304644335805:11194]
2025-10-10T14:37:50.443985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602304644335805:11194]
2025-10-10T14:37:50.444000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:50.444025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:50.444032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:50.444040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:50.444029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2462
2025-10-10T14:37:50.444033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2462
2025-10-10T14:37:50.444044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:50.444050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:50.444053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:50.444079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602304644335805:11194]
2025-10-10T14:37:50.444083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:50.444085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:50.444112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.444124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.444164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:50.444177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.444181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.444188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:50.444200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.444212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:50.444234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.444440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.444453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.444477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.444592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2463 partition: 0 MaxSeqNo: 40 sessionId: src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0
2025-10-10T14:37:50.445003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cfb6c7d-69e89bc2-d81e093-d06be444_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:50.448025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0] Write session: try to update token
2025-10-10T14:37:50.448048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:50.463998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:50.464022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:50.464026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:50.464028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:50.464039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602304644335805:11194]
2025-10-10T14:37:50.464043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602304644335805:11194]
2025-10-10T14:37:50.464047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602304644335805:11194]
2025-10-10T14:37:50.464104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:50.464129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2463 sessionId: src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:50.464114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.464112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:50.464120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:50.464123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:50.464124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:50.464396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:50.466989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:50.509270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602305426567908:10596]
2025-10-10T14:37:50.511096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2462, pipe: [1:7559602305426567908:10596]
2025-10-10T14:37:50.580581Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:50.580875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.580890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.580935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567908:10596], now have 1 active actors on pipe
2025-10-10T14:37:50.581173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:50.581221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:50.581231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:50.581238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:50.581298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602305426567908:10596]
2025-10-10T14:37:50.581318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2463 reason: error at write: Disconnected sessionId: src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0
2025-10-10T14:37:50.581563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2463 sessionId: src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0 is DEAD
2025-10-10T14:37:50.581740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:50.581752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0] Write session will restart in 0.006811s
2025-10-10T14:37:50.581779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0] Write session: Do CDS request
2025-10-10T14:37:50.581787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:50.589889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.590040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:50.590059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2464
2025-10-10T14:37:50.590195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.590233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:50.590244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:50.590248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:50.590729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2464 sessionId:  describe result for acl check
2025-10-10T14:37:50.590777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:50.590782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:50.590784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:50.590790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602305426567925:10980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:50.591381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602305426567925:10980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:50.594957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602305426567925:10980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:50.601436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602305426567925:10980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:50.601453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602305426567925:10980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:50.601457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602305426567925:10980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:50.601467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:50.608006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:50.611895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:50.612174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:50.612188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:50.612200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:50.612261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:50.612304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602304644336113:11196]
2025-10-10T14:37:50.612988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:50.613414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:50.613479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:50.613836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:50.613934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.613942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.613943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.613944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.613946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.613947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.613948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.613949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.613951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.613952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.613953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.613954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.613956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.613963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.613977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.613981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.613986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.613989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.613993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.613998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.614003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.614007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.614012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.614016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.614020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.614024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.614032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.614041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.614047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.614053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.614058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.614063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.614068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.614074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.614080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.614086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.614091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.614097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.614103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.614109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.614114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.614126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.614132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.614142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.614148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.614158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.614163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.614173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.614177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.614183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.614187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.614197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.614242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:50.617220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:50.618169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:50.618186Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:50.618189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:50.618194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:50.618202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2463 [2:7559602304644336113:11196]
2025-10-10T14:37:50.618216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:50.618253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:50.618261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.618266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.618268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.618286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:50.618299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:50.618309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:50.618375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.618383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.618385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.618388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:50.618459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:50.618468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.618481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.618499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.618525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:50.618548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426567909:2438], now have 1 active actors on pipe
2025-10-10T14:37:50.618553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426568093:10980], now have 1 active actors on pipe
2025-10-10T14:37:50.618562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602304644336107:11196]
2025-10-10T14:37:50.618565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602304644336107:11196]
2025-10-10T14:37:50.618567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602304644336107:11196]
2025-10-10T14:37:50.618584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:50.618599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:50.618601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:50.618603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:50.618606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:50.618624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:50.618628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:50.618608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2463
2025-10-10T14:37:50.618658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602304644336107:11196]
2025-10-10T14:37:50.618670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:50.618659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2463
2025-10-10T14:37:50.618677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:50.618879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.618890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.618922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:50.618937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.618946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.618949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:50.618963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.618980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:50.618995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.619214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.619223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.619239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.619384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2464 partition: 0 MaxSeqNo: 40 sessionId: src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0
2025-10-10T14:37:50.621490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdff9c35-f2294562-845e8c0f-ab19d259_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:50.624351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0] Write session: try to update token
2025-10-10T14:37:50.624374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:50.639356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:50.639376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:50.639379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:50.639381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:50.639392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602304644336107:11196]
2025-10-10T14:37:50.639397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602304644336107:11196]
2025-10-10T14:37:50.639401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602304644336107:11196]
2025-10-10T14:37:50.639456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:50.639452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:50.639468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:50.639469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.639471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:50.639472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:50.639771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2464 sessionId: src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:50.639617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:50.642678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:50.681303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602305426568216:10596]
2025-10-10T14:37:50.681622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2463, pipe: [1:7559602305426568216:10596]
2025-10-10T14:37:50.761058Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:50.761389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.761408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.761456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426568216:10596], now have 1 active actors on pipe
2025-10-10T14:37:50.761803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602305426568216:10596]
2025-10-10T14:37:50.761821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:50.761858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:50.761861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:50.761936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2464 reason: error at write: Disconnected sessionId: src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0
2025-10-10T14:37:50.762160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2464 sessionId: src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0 is DEAD
2025-10-10T14:37:50.762352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:50.762364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0] Write session will restart in 0.008394s
2025-10-10T14:37:50.762394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0] Write session: Do CDS request
2025-10-10T14:37:50.762414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:50.762300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:50.771953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.772036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:50.772062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2465
2025-10-10T14:37:50.772254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.772293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:50.772302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:50.772306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:50.772839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2465 sessionId:  describe result for acl check
2025-10-10T14:37:50.772881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:50.772884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:50.772886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:50.772892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602305426568251:10985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:50.773503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602305426568251:10985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:50.776475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602305426568251:10985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:50.786199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602305426568251:10985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:50.786217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602305426568251:10985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:50.786223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602305426568251:10985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:50.786233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:50.788958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:50.792146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:50.792405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:50.792410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:50.792432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:50.792497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:50.792551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602304644336417:11198]
2025-10-10T14:37:50.793207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:50.793618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:50.793675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:50.794016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:50.794091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.794093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.794094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.794095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.794096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.794097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.794099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.794100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.794101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.794103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.794104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.794105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.794107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.794113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.794127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.794131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.794136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.794140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.794144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.794148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.794152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.794157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.794161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.794165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.794168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.794171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.794181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.794189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.794194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.794200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.794204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.794209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.794213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.794219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.794224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.794229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.794234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.794240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.794244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.794249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.794254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.794258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.794262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.794267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.794270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.794275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.794279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.794286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.794290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.794295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.794301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.794306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.794344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:50.797237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:50.798200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2464
2025-10-10T14:37:50.798221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2464
2025-10-10T14:37:50.798652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2465 partition: 0 MaxSeqNo: 40 sessionId: src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0
2025-10-10T14:37:50.799099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24b2ce2-43c42cf0-f06949e0-8b40dacd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:50.797883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:50.797894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:50.797896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:50.797898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:50.797904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2464 [2:7559602304644336417:11198]
2025-10-10T14:37:50.797913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:50.797926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:50.797929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.797933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.797935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.797952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:50.797960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:50.797968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:50.798018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.798019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.798021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.798022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:50.798089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:50.798092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.798099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.798106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.798116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:50.798132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426568517:10985], now have 1 active actors on pipe
2025-10-10T14:37:50.798139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602304644336412:11198]
2025-10-10T14:37:50.798142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602304644336412:11198]
2025-10-10T14:37:50.798144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602304644336412:11198]
2025-10-10T14:37:50.798158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:50.798166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:50.798168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426568220:2438], now have 1 active actors on pipe
2025-10-10T14:37:50.798169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:50.798170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:50.798176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:50.798192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:50.798195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:50.798219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602304644336412:11198]
2025-10-10T14:37:50.798222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:50.798223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:50.798240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.798245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.798301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:50.798308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.798312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.798315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:50.798326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.798336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:50.798353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.798532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.798540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.798573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.802138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0] Write session: try to update token
2025-10-10T14:37:50.802159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:50.822925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:50.822948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:50.822951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:50.822953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:50.822964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602304644336412:11198]
2025-10-10T14:37:50.822969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602304644336412:11198]
2025-10-10T14:37:50.822973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602304644336412:11198]
2025-10-10T14:37:50.823017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:50.823025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.823026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:50.823035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:50.823042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:50.823051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:50.823176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:50.826337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2465 sessionId: src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:50.829178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:50.862046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602305426568534:10596]
2025-10-10T14:37:50.862402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2464, pipe: [1:7559602305426568534:10596]
2025-10-10T14:37:50.944677Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:50.945184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.945202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.945247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426568534:10596], now have 1 active actors on pipe
2025-10-10T14:37:50.945600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:50.945916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602305426568534:10596]
2025-10-10T14:37:50.945950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:50.945986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:50.945989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:50.946048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2465 reason: error at write: Disconnected sessionId: src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0
2025-10-10T14:37:50.946238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2465 sessionId: src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0 is DEAD
2025-10-10T14:37:50.946696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:50.946707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0] Write session will restart in 0.005427s
2025-10-10T14:37:50.946734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0] Write session: Do CDS request
2025-10-10T14:37:50.946744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:50.953888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.954231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:50.954245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2466
2025-10-10T14:37:50.954444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:50.954504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:50.954515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:50.954519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:50.955014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2466 sessionId:  describe result for acl check
2025-10-10T14:37:50.955050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:50.955059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:50.955061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:50.955067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602305426568552:10989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:50.955641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602305426568552:10989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:50.957948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602305426568552:10989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:50.962936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602305426568552:10989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:50.962953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602305426568552:10989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:50.962958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602305426568552:10989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:50.962968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:50.979681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:50.983806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:50.984098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:50.984110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:50.984122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:50.984178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:50.984236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602304644336721:11200]
2025-10-10T14:37:50.984893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:50.985353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:50.985417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:50.985793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:50.985862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.985868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.985869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.985871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.985872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.985874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.985876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.985877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.985879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.985880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.985882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.985883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.985884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.985891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.985904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.985908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.985913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.985918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.985923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.985927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.985931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.985936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.985941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.985945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.985949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.985953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.985963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.985971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:50.985979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.985985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:50.985991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.985996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:50.986001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.986006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:50.986011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.986017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:50.986022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.986028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:50.986033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.986038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:50.986053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.986058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:50.986063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.986069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:50.986074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.986079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:50.986084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.986090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.986094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.986100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.986104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.986107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.986134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:50.988765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:50.989359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:50.989372Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:50.989375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:50.989378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:50.989387Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2465 [2:7559602304644336721:11200]
2025-10-10T14:37:50.989400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:50.989420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:50.989427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.989431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.989434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.989453Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:50.989465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:50.989473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:50.989535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.989542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.989544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.989547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:50.989617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:50.989625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:50.989635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:50.989648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:50.989665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:50.989688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602304644336716:11200]
2025-10-10T14:37:50.989695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602304644336716:11200]
2025-10-10T14:37:50.989697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602304644336716:11200]
2025-10-10T14:37:50.989708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:50.989723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426568625:10989], now have 1 active actors on pipe
2025-10-10T14:37:50.989730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:50.989733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:50.989736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:50.989735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:50.989752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:50.989755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:50.989761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602305426568536:2438], now have 1 active actors on pipe
2025-10-10T14:37:50.989796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602304644336716:11200]
2025-10-10T14:37:50.989805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:50.989833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:50.989812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2465
2025-10-10T14:37:50.989862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2465
2025-10-10T14:37:50.989941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.989954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.989993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:50.990007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:50.990013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:50.990021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:50.990035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:50.990048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:50.990071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.990227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:50.990236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:50.990252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:50.990385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2466 partition: 0 MaxSeqNo: 40 sessionId: src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0
2025-10-10T14:37:50.990855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c40869a-b02a3611-efa8c9e4-dfcb2d85_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:50.993782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0] Write session: try to update token
2025-10-10T14:37:50.993802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:51.008977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:51.009211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.009228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602304644336716:11200]
2025-10-10T14:37:51.009292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:51.009519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:51.009671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.009837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.009985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.010211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:51.010255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:51.010453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:51.012869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2466 sessionId: src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:51.015798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:51.016136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.016160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.016202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:51.016316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:51.023528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:51.023553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.023556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:51.023559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:51.023571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602304644336716:11200]
2025-10-10T14:37:51.023576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602304644336716:11200]
2025-10-10T14:37:51.023581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602304644336716:11200]
2025-10-10T14:37:51.023636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:51.023644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.023643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:51.023647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:51.023649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:51.023658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:51.023789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:51.045846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602309721536140:10596]
2025-10-10T14:37:51.046207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2465, pipe: [1:7559602309721536140:10596]
2025-10-10T14:37:51.144039Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:51.152906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.152946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.153136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.153202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.153270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.153361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.153411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.153421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.153493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.153558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.153623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.153694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.153745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.153753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.153828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.153893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.153965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.154039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.154088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.154095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.154171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.154244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.154322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.154394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.154445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.154453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.154525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.154589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.154653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.154719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.154779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.154786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.154856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.154922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.155021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.155087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.155135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.155142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.155209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.155275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.155346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.155411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.155457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.155463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.156837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602309721536140:10596]
2025-10-10T14:37:51.156839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:51.156844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:51.156869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:51.156877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2466 reason: error at write: Disconnected sessionId: src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0
2025-10-10T14:37:51.157100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2466 sessionId: src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0 is DEAD
2025-10-10T14:37:51.157237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:51.157251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0] Write session will restart in 0.007709s
2025-10-10T14:37:51.157290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0] Write session: Do CDS request
2025-10-10T14:37:51.157296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:51.155531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.155601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.155665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.155726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.155772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.155774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.155848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.155913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.155986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.156058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.156108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.156111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.156188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:51.156255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:51.156324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:51.156392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:51.156436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:51.156439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:51.156516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536140:10596], now have 1 active actors on pipe
2025-10-10T14:37:51.157763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:51.165906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.166030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:51.166051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2467
2025-10-10T14:37:51.166410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.166452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:51.166457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:51.166461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:51.166963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2467 sessionId:  describe result for acl check
2025-10-10T14:37:51.167001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:51.167004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:51.167006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:51.167012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602309721536158:10993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:51.167659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602309721536158:10993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:51.172303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602309721536158:10993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:51.176055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602309721536158:10993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:51.176074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602309721536158:10993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:51.176078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602309721536158:10993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:51.176087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:51.187253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:51.190788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:51.191947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:51.191971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:51.191985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:51.192066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:51.192124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602308939304333:11203]
2025-10-10T14:37:51.192772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:51.193113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:51.193185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:51.193544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:51.193612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.193621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.193622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.193623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.193624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.193625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.193626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.193627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.193632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.193633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.193634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.193635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.193636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.193643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.193656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.193660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.193664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.193669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.193673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.193677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.193681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.193684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.193688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.193692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.193696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.193699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.193708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.193718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.193724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.193731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.193735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.193740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.193745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.193750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.193756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.193761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.193765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.193771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.193776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.193782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.193786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.193792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.193797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.193803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.193808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.193815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.193821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.193828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.193840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.193846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.193851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.193856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.193899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:51.196389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:51.197075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:51.197092Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:51.197094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:51.197098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:51.197105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2466 [2:7559602308939304333:11203]
2025-10-10T14:37:51.197119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:51.197143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:51.197147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.197151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.197153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.197172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:51.197180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:51.197189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:51.197254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.197262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.197264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.197267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:51.197358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:51.197367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.197379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.197397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.197421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:51.197449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536272:10993], now have 1 active actors on pipe
2025-10-10T14:37:51.197458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536143:2438], now have 1 active actors on pipe
2025-10-10T14:37:51.197467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602308939304319:11203]
2025-10-10T14:37:51.197475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602308939304319:11203]
2025-10-10T14:37:51.197477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602308939304319:11203]
2025-10-10T14:37:51.197494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:51.197516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:51.197518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:51.197501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2466
2025-10-10T14:37:51.197521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:51.197523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:51.197506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2466
2025-10-10T14:37:51.197534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:51.197538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:51.197582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.197593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.197612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602308939304319:11203]
2025-10-10T14:37:51.197621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:51.197627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:51.197654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:51.197666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.197671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.197674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:51.197686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.197696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:51.197726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.197948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.197959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.197976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.198088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2467 partition: 0 MaxSeqNo: 40 sessionId: src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0
2025-10-10T14:37:51.198541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ec8eb-d323ac73-9dde32be-b7380d42_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:51.201467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0] Write session: try to update token
2025-10-10T14:37:51.201494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:51.216197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2467 sessionId: src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:51.217635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:51.217666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.217670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:51.217672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:51.217682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602308939304319:11203]
2025-10-10T14:37:51.217688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602308939304319:11203]
2025-10-10T14:37:51.217693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602308939304319:11203]
2025-10-10T14:37:51.217752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:51.217758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:51.217764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.217767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:51.217767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:51.217772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:51.217938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:51.219335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:51.256805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602309721536463:10596]
2025-10-10T14:37:51.257157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2466, pipe: [1:7559602309721536463:10596]
2025-10-10T14:37:51.337104Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:51.337670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.337687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.337734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536463:10596], now have 1 active actors on pipe
2025-10-10T14:37:51.337949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:51.337968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:51.338030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2467 reason: error at write: Disconnected sessionId: src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0
2025-10-10T14:37:51.338235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2467 sessionId: src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0 is DEAD
2025-10-10T14:37:51.338313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:51.338382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:51.338393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0] Write session will restart in 0.006981s
2025-10-10T14:37:51.338424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0] Write session: Do CDS request
2025-10-10T14:37:51.338429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:51.338421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:51.338466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602309721536463:10596]
2025-10-10T14:37:51.346809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.347028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:51.347042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2468
2025-10-10T14:37:51.347432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:51.347137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.347169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:51.347173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:51.347176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:51.347508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2468 sessionId:  describe result for acl check
2025-10-10T14:37:51.347534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:51.347536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:51.347537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:51.347542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602309721536515:11006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:51.348083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602309721536515:11006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:51.349301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:51.349522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:51.349533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:51.349545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:51.349593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:51.349632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602308939304433:11217]
2025-10-10T14:37:51.350227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:51.350271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602309721536515:11006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:51.350558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:51.350610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:51.350934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:51.350994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.351000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.351001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.351002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.351003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.351004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.351006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.351007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.351008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.351009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.351010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.351011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.351012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.351017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.351027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.351030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.351034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.351039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.351042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.351045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.351049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.351052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.351055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.351059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.351063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.351066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.351073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.351081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.351087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.351091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.351095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.351099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.351103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.351108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.351113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.351118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.351122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.351145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.351154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.351159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.351163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.351167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.351171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.351180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.351184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.351188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.351192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.351197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.351203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.351208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.351212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.351216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.351252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:51.353527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602309721536515:11006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:51.353537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602309721536515:11006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:51.353540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602309721536515:11006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:51.353547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:51.353606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:51.354049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:51.354061Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:51.354063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:51.354067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:51.354073Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2467 [2:7559602308939304433:11217]
2025-10-10T14:37:51.354087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:51.354105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:51.354112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.354116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.354118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.354135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:51.354147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:51.354158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:51.354208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.354213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.354215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.354216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:51.354269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:51.354277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.354287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.354300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.354313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:51.354333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536546:11006], now have 1 active actors on pipe
2025-10-10T14:37:51.354341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536492:2438], now have 1 active actors on pipe
2025-10-10T14:37:51.354349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602308939304428:11217]
2025-10-10T14:37:51.354354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602308939304428:11217]
2025-10-10T14:37:51.354356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602308939304428:11217]
2025-10-10T14:37:51.354371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:51.354356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2467
2025-10-10T14:37:51.354376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2467
2025-10-10T14:37:51.354388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:51.354399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:51.354401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:51.354404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:51.354409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:51.354410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:51.354423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602308939304428:11217]
2025-10-10T14:37:51.354425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:51.354427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:51.354437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.354444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.354482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:51.354491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.354499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.354503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:51.354515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.354529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:51.354549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.354644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.354646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.354657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.354717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2468 partition: 0 MaxSeqNo: 40 sessionId: src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0
2025-10-10T14:37:51.355058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8757b565-24c1134a-c8a2eb50-5dfe3182_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:51.357864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0] Write session: try to update token
2025-10-10T14:37:51.357885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:51.372824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2468 sessionId: src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:51.375249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:51.375272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.375276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:51.375280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:51.375289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602308939304428:11217]
2025-10-10T14:37:51.375293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602308939304428:11217]
2025-10-10T14:37:51.375297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602308939304428:11217]
2025-10-10T14:37:51.375353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:51.375357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:51.375361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.375363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:51.375364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:51.375367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:51.375507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:51.375843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:51.438542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602309721536565:10596]
2025-10-10T14:37:51.439215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2467, pipe: [1:7559602309721536565:10596]
2025-10-10T14:37:51.494665Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:51.494991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.495002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.495048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536565:10596], now have 1 active actors on pipe
2025-10-10T14:37:51.495316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:51.495636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:51.495647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:51.495698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2468 reason: error at write: Disconnected sessionId: src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0
2025-10-10T14:37:51.495704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:51.495749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602309721536565:10596]
2025-10-10T14:37:51.495860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2468 sessionId: src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0 is DEAD
2025-10-10T14:37:51.496072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:51.496085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0] Write session will restart in 0.006010s
2025-10-10T14:37:51.496126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0] Write session: Do CDS request
2025-10-10T14:37:51.496133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:51.503001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.503067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:51.503083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2469
2025-10-10T14:37:51.503260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.503314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:51.503326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:51.503331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:51.503809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2469 sessionId:  describe result for acl check
2025-10-10T14:37:51.503847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:51.503854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:51.503856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:51.503863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602309721536580:11013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:51.504455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602309721536580:11013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:51.506405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:51.509170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:51.508936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602309721536580:11013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:51.509423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:51.509437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:51.509451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:51.509518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:51.509565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602308939304499:11221]
2025-10-10T14:37:51.510140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:51.510788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:51.510861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:51.511229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:51.511310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.511312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.511313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.511315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.511316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.511317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.511318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.511322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.511324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.511325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.511327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.511328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.511329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.511337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.511350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.511354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.511358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.511362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.511365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.511369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.511373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.511376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.511380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.511384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.511388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.511392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.511402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.511412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.511420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.511426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.511432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.511438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.511442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.511448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.511455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.511460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.511464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.511470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.511478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.511484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.511489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.511494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.511499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.511504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.511508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.511514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.511518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.511523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.511528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.511533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.511537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.511542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.511585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:51.511990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602309721536580:11013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:51.512004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602309721536580:11013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:51.512007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602309721536580:11013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:51.512015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:51.514253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:51.514829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:51.514838Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:51.514841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:51.514845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:51.514865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2468 [2:7559602308939304499:11221]
2025-10-10T14:37:51.514880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:51.514899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:51.514902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.514908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.514910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.514927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:51.514935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:51.514943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:51.515007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.515009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.515011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.515014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:51.515085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:51.515088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.515100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.515112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.515128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:51.515149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536566:2438], now have 1 active actors on pipe
2025-10-10T14:37:51.515158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602308939304493:11221]
2025-10-10T14:37:51.515162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602308939304493:11221]
2025-10-10T14:37:51.515165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602308939304493:11221]
2025-10-10T14:37:51.515183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:51.515199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536621:11013], now have 1 active actors on pipe
2025-10-10T14:37:51.515202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:51.515204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:51.515206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:51.515208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:51.515221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:51.515224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:51.515256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602308939304493:11221]
2025-10-10T14:37:51.515265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:51.515278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:51.515584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.515591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.515626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9caab044-33becb8-6d8dec92-d9a4c648_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:51.515642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.515648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.515650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:51.515663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.515683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:51.515700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.515418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2468
2025-10-10T14:37:51.515449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2468
2025-10-10T14:37:51.515977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.515988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.516008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.516193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2469 partition: 0 MaxSeqNo: 40 sessionId: src_id|9caab044-33becb8-6d8dec92-d9a4c648_0
2025-10-10T14:37:51.516601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bfd9e40-80be4049-fc3cd7ed-422c660b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9caab044-33becb8-6d8dec92-d9a4c648_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:51.519491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9caab044-33becb8-6d8dec92-d9a4c648_0] Write session: try to update token
2025-10-10T14:37:51.519514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9caab044-33becb8-6d8dec92-d9a4c648_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:51.538958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:51.538984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.538988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:51.538990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:51.539000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602308939304493:11221]
2025-10-10T14:37:51.539004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602308939304493:11221]
2025-10-10T14:37:51.539008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602308939304493:11221]
2025-10-10T14:37:51.539059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:51.539060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:51.539071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.539073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:51.539075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:51.539078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:51.539212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:51.561158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2469 sessionId: src_id|9caab044-33becb8-6d8dec92-d9a4c648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:51.563942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:51.595233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602309721536629:10596]
2025-10-10T14:37:51.595633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2468, pipe: [1:7559602309721536629:10596]
2025-10-10T14:37:51.664451Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:51.664789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.664800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.664825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536629:10596], now have 1 active actors on pipe
2025-10-10T14:37:51.665128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602309721536629:10596]
2025-10-10T14:37:51.665173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:51.665177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:51.665254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2469 reason: error at write: Disconnected sessionId: src_id|9caab044-33becb8-6d8dec92-d9a4c648_0
2025-10-10T14:37:51.665477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2469 sessionId: src_id|9caab044-33becb8-6d8dec92-d9a4c648_0 is DEAD
2025-10-10T14:37:51.665689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:51.665431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:51.669254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caab044-33becb8-6d8dec92-d9a4c648_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:51.669270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caab044-33becb8-6d8dec92-d9a4c648_0] Write session will restart in 0.006846s
2025-10-10T14:37:51.669298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caab044-33becb8-6d8dec92-d9a4c648_0] Write session: Do CDS request
2025-10-10T14:37:51.669307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caab044-33becb8-6d8dec92-d9a4c648_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:51.677981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9caab044-33becb8-6d8dec92-d9a4c648_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.678419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:51.678445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2470
2025-10-10T14:37:51.678611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.678647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:51.678657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:51.678666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:51.679092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2470 sessionId:  describe result for acl check
2025-10-10T14:37:51.679131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:51.679138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:51.679141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:51.679148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602309721536654:11017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:51.679787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602309721536654:11017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:51.677551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:51.678244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:51.678438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:51.678443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:51.678455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:51.678508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:51.678560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602308939304558:11223]
2025-10-10T14:37:51.679256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:51.679585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:51.679623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:51.679951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:51.680013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.680014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.680015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.680016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.680018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.680019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.680021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.680022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.680024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.680025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.680026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.680028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.680029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.680036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.680051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.680057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.680062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.680066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.680071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.680076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.680080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.680085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.680089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.680094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.680098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.680103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.680111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.680120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.680127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.680133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.680139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.680145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.680150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.680156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.680162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.680168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.680173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.680178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.680184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.680190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.680195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.680201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.680206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.680212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.680216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.680222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.680228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.680234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.680238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.680244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.680250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.680255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.680299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:51.683220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:51.683561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:51.683575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:51.683578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:51.683582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:51.683589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2469 [2:7559602308939304558:11223]
2025-10-10T14:37:51.683605Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:51.683624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:51.683627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.683631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.683633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.683651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:51.683658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:51.683676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:51.683737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.683747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.683749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.683751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:51.683844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:51.683853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.683865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.683877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.683899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:51.683927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536630:2438], now have 1 active actors on pipe
2025-10-10T14:37:51.683941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602308939304553:11223]
2025-10-10T14:37:51.683943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602308939304553:11223]
2025-10-10T14:37:51.683945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602308939304553:11223]
2025-10-10T14:37:51.683960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:51.683982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:51.684004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:51.684016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:51.683931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2469
2025-10-10T14:37:51.683990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602309721536654:11017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:51.684046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602308939304553:11223]
2025-10-10T14:37:51.684054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:51.684077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:51.684087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:51.684090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:51.684097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:51.692416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602309721536654:11017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:51.692438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602309721536654:11017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:51.692443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602309721536654:11017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:51.692454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:51.692747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536691:11017], now have 1 active actors on pipe
2025-10-10T14:37:51.692815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2469
2025-10-10T14:37:51.692894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.692906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.692946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:51.692959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.692967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.692970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:51.692986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.693010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:51.693033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.693226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.693235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.693252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.693343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2470 partition: 0 MaxSeqNo: 40 sessionId: src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0
2025-10-10T14:37:51.693834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caab044-33becb8-6d8dec92-d9a4c648_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:51.696401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:51.696418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.696431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602308939304553:11223]
2025-10-10T14:37:51.696476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:51.696485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:51.696668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:51.696820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.696963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.697107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.697381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:51.697425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:51.698984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0] Write session: try to update token
2025-10-10T14:37:51.699008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:51.715079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:51.715102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.715106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:51.715112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:51.715124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602308939304553:11223]
2025-10-10T14:37:51.715128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602308939304553:11223]
2025-10-10T14:37:51.715133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602308939304553:11223]
2025-10-10T14:37:51.715187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:51.715191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:51.715196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.715198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:51.715199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:51.715203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:51.715340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:51.724244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2470 sessionId: src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:51.727093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:51.766288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602309721536696:10596]
2025-10-10T14:37:51.766604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2469, pipe: [1:7559602309721536696:10596]
2025-10-10T14:37:51.840493Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:51.840869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.840886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.840911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536696:10596], now have 1 active actors on pipe
2025-10-10T14:37:51.841155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:51.841315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602309721536696:10596]
2025-10-10T14:37:51.841360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:51.841398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:51.841401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:51.841487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2470 reason: error at write: Disconnected sessionId: src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0
2025-10-10T14:37:51.841703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2470 sessionId: src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0 is DEAD
2025-10-10T14:37:51.841950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:51.841967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0] Write session will restart in 0.009480s
2025-10-10T14:37:51.841996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0] Write session: Do CDS request
2025-10-10T14:37:51.842014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:51.854039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.856468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:51.856854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:51.856871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2471
2025-10-10T14:37:51.857060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:51.857101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:51.857111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:51.857116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:51.857816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2471 sessionId:  describe result for acl check
2025-10-10T14:37:51.857852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:51.857856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:51.857858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:51.857865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602309721536730:11022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:51.858437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602309721536730:11022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:51.858214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:51.858482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:51.858487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:51.858500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:51.858571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:51.858614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602308939304618:11225]
2025-10-10T14:37:51.859276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:51.859602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:51.859673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:51.860018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:51.860070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.860071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.860073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.860075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.860076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.860078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.860079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.860081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.860083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.860085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.860086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.860088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.860089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.860096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.860109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.860113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.860118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.860122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.860127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.860132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.860136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.860141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.860146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.860150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.860157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.860161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.860170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.860179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:51.860187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.860193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:51.860198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.860205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:51.860209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.860215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:51.860221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.860227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:51.860232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.860238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:51.860243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.860249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:51.860254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.860259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:51.860264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.860269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:51.860273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.860279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:51.860286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.860294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.860299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.860304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.860309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.860315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.860363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:51.860396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602309721536730:11022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:51.863019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:51.863362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:51.863376Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:51.863382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:51.863387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:51.863393Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2470 [2:7559602308939304618:11225]
2025-10-10T14:37:51.863409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:51.863427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:51.863430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.863434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.863437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.863454Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:51.863461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:51.863469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:51.863283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602309721536730:11022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:51.863299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602309721536730:11022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:51.863303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602309721536730:11022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:51.863312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:51.863730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2470
2025-10-10T14:37:51.863532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.863549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.863552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.863555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:51.863631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:51.863635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.863649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:51.863663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:51.863682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:51.863772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536705:2438], now have 1 active actors on pipe
2025-10-10T14:37:51.863781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602308939304613:11225]
2025-10-10T14:37:51.863783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602308939304613:11225]
2025-10-10T14:37:51.863786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602308939304613:11225]
2025-10-10T14:37:51.863804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:51.863819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:51.863835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:51.863839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:51.863852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:51.863856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:51.863858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:51.863870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602308939304613:11225]
2025-10-10T14:37:51.863874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:51.863876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:51.863942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536762:11022], now have 1 active actors on pipe
2025-10-10T14:37:51.864048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2470
2025-10-10T14:37:51.864145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.864156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.864186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:51.864195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:51.864199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:51.864201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:51.864213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:51.864225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:51.864244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.864400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.864410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.864426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:51.864514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2471 partition: 0 MaxSeqNo: 40 sessionId: src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0
2025-10-10T14:37:51.865021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c6fd2d-a13487a1-20d4439-206d185d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:51.868539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0] Write session: try to update token
2025-10-10T14:37:51.868564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:51.877871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:51.877895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.877906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602308939304613:11225]
2025-10-10T14:37:51.877961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:51.877995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:51.878161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:51.878308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.878455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.878612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:51.878837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:51.878896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:51.890631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2471 sessionId: src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:51.893383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:51.894287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:51.894320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:51.894366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:51.894641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:51.919540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:51.919563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:51.919567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:51.919569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:51.919582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602308939304613:11225]
2025-10-10T14:37:51.919586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602308939304613:11225]
2025-10-10T14:37:51.919591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602308939304613:11225]
2025-10-10T14:37:51.919642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:51.919653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:51.919656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:51.919795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:51.921488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:51.921503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:51.921507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:51.941394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602309721536770:10596]
2025-10-10T14:37:51.941798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2470, pipe: [1:7559602309721536770:10596]
2025-10-10T14:37:52.041870Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:7170 } ]
2025-10-10T14:37:52.050686Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:52.059826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.059861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.060059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.060144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.060209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.060276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.060319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.060324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.060401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.060462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.060528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.060594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.060646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.060650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.060727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.060786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.060850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.060911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.060955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.060960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.061036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.061098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.061161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.061225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.061266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.061270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.061504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.061576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.061642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.061708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.061753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.061757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.061827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.061884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.061945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.062008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.062053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.062056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.062137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.062198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.062264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.062324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.062366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.062369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.062446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.062506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.062568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.062635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.062688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.062691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.062780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.062842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.062907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.062970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.063012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.063015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.063088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.063148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.063209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.063273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.063315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.063319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.063413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602309721536770:10596], now have 1 active actors on pipe
2025-10-10T14:37:52.063956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:52.063932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:52.063986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:52.063990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:52.064030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2471 reason: error at write: Disconnected sessionId: src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0
2025-10-10T14:37:52.064277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2471 sessionId: src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0 is DEAD
2025-10-10T14:37:52.064287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602309721536770:10596]
2025-10-10T14:37:52.064729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:52.064750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0] Write session will restart in 0.007716s
2025-10-10T14:37:52.064777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0] Write session: Do CDS request
2025-10-10T14:37:52.064783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:52.074014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.077525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:52.077543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2472
2025-10-10T14:37:52.077759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.077799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:52.077805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:52.077809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:52.078250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:52.078268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2472 sessionId:  describe result for acl check
2025-10-10T14:37:52.078310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:52.078311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:52.078314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:52.078320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602314016504092:11026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:52.078920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602314016504092:11026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:52.080588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:52.080894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:52.080910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:52.080925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:52.080996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:52.081047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602313234271975:11227]
2025-10-10T14:37:52.081742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:52.082172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:52.082238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:52.082637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:52.082718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.082719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.082720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.082722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.082723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.082725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.082726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.082728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.082729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.082731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.082746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.082747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.082749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.082757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.082772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.082777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.082782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.082787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.082791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.082795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.082799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.082803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.082808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.082811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.082819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.082823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.082832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.082842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.082850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.082857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.082862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.082868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.082876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.082882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.082888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.082894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.082899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.082905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.082910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.082916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.082921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.082927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.082933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.082939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.082944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.082950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.082955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.082961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.082966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.082972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.082980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.082986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.083035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:52.089931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2471
2025-10-10T14:37:52.091033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602314016504092:11026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:52.088215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:52.089153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:52.089163Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:52.089166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:52.089173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:52.089180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2471 [2:7559602313234271975:11227]
2025-10-10T14:37:52.089200Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:52.089222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:52.089227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.089230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.089232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.089253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:52.089261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:52.089269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:52.089365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.089368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.089372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.089375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:52.089450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:52.089454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.089469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.089483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.089502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:52.089524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602313234271969:11227]
2025-10-10T14:37:52.089527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602313234271969:11227]
2025-10-10T14:37:52.089529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602313234271969:11227]
2025-10-10T14:37:52.089551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:52.089567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:52.089587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:52.089592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:52.089599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:52.089603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:52.089606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:52.089637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602313234271969:11227]
2025-10-10T14:37:52.089640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:52.089697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:52.089756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504069:2438], now have 1 active actors on pipe
2025-10-10T14:37:52.100053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a78af45e-b3a24f6d-ec9dcbcd-463673_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e4260918-1670824c-102af601-21bd8519_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:52.098273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602314016504092:11026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:52.098295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602314016504092:11026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:52.098299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602314016504092:11026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:52.098311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:52.098989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504129:11026], now have 1 active actors on pipe
2025-10-10T14:37:52.099040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2471
2025-10-10T14:37:52.099608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2472 partition: 0 MaxSeqNo: 40 sessionId: src_id|e4260918-1670824c-102af601-21bd8519_0
2025-10-10T14:37:52.099157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.099166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.099201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4260918-1670824c-102af601-21bd8519_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:52.099219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.099225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.099239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:52.099255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.099276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:52.099306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.099500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.099505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.099523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.103242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4260918-1670824c-102af601-21bd8519_0] Write session: try to update token
2025-10-10T14:37:52.103264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4260918-1670824c-102af601-21bd8519_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:52.106355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:52.106381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:52.106393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602313234271969:11227]
2025-10-10T14:37:52.106451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:52.106453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:52.106642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:52.106810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.106981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.107127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.107357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:52.107412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:52.122162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2472 sessionId: src_id|e4260918-1670824c-102af601-21bd8519_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:52.125243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:52.127689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.128239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:52.127728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.127777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:52.134411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:52.134444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:52.134448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:52.134450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:52.134462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602313234271969:11227]
2025-10-10T14:37:52.134471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602313234271969:11227]
2025-10-10T14:37:52.134475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602313234271969:11227]
2025-10-10T14:37:52.134534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:52.134533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:52.134541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:52.134542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.134545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:52.134545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:52.134698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:52.164033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602314016504133:10596]
2025-10-10T14:37:52.164374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2471, pipe: [1:7559602314016504133:10596]
2025-10-10T14:37:52.258313Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:52.267896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.267926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.268116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.268184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.268254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.268328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.268884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.268898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.268965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.269021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.269082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.269143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.269196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.269204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.269266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.269327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.269430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.269496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.269548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.269556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.269630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.269699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.269778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.269839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.269889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.269897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.269966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.270030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.270094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.270158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.270209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.270217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.270287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.270348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.270415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.270473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.270515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.270517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.270586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.270657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.270742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.270812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.270862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.270869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.270939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.271004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.271069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.271135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.271182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.271189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.271252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.271307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.271372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.271439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.271493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.271497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.271564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.271630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.271701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.271774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.271822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.271829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.271897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504133:10596], now have 1 active actors on pipe
2025-10-10T14:37:52.272452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:52.272467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:52.272503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2472 reason: error at write: Disconnected sessionId: src_id|e4260918-1670824c-102af601-21bd8519_0
2025-10-10T14:37:52.272673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:52.272724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2472 sessionId: src_id|e4260918-1670824c-102af601-21bd8519_0 is DEAD
2025-10-10T14:37:52.272730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602314016504133:10596]
2025-10-10T14:37:52.272527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:52.273552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4260918-1670824c-102af601-21bd8519_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:52.273564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4260918-1670824c-102af601-21bd8519_0] Write session will restart in 0.005132s
2025-10-10T14:37:52.273590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4260918-1670824c-102af601-21bd8519_0] Write session: Do CDS request
2025-10-10T14:37:52.273597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4260918-1670824c-102af601-21bd8519_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:52.279955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4260918-1670824c-102af601-21bd8519_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.280104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:52.280121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2473
2025-10-10T14:37:52.281566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.281613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:52.281622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:52.281626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:52.282386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2473 sessionId:  describe result for acl check
2025-10-10T14:37:52.282434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:52.282436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:52.282438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:52.282445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602314016504157:11030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:52.283070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602314016504157:11030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:52.286371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:52.287278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:52.287457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602314016504157:11030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:52.287507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:52.287520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:52.287533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:52.287595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:52.287644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602313234272053:11231]
2025-10-10T14:37:52.288259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:52.288677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:52.288728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:52.289068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:52.289148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.289155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.289157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.289158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.289159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.289160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.289162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.289163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.289165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.289166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.289168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.289169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.289171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.289177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.289192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.289196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.289201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.289205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.289209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.289214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.289218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.289225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.289230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.289234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.289242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.289246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.289254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.289263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.289272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.289277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.289282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.289287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.289291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.289297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.289305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.289310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.289315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.289321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.289325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.289344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.289356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.289362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.289367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.289373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.289377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.289383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.289398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.289404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.289409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.289414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.289420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.289425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.289479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:52.294427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602314016504157:11030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:52.294444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602314016504157:11030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:52.294448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602314016504157:11030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:52.294458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:52.295818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:52.296197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:52.296211Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:52.296217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:52.296222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:52.296229Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2472 [2:7559602313234272053:11231]
2025-10-10T14:37:52.296245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:52.296265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:52.296274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.296278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.296280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.296334Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:52.296350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:52.296359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:52.296428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.296435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.296437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.296440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:52.296523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:52.296535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.296548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.296560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.296578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:52.296607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504194:11030], now have 1 active actors on pipe
2025-10-10T14:37:52.296618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504136:2438], now have 1 active actors on pipe
2025-10-10T14:37:52.296625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602313234272048:11231]
2025-10-10T14:37:52.296632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602313234272048:11231]
2025-10-10T14:37:52.296633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602313234272048:11231]
2025-10-10T14:37:52.296650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:52.296668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:52.296670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:52.296680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:52.296683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:52.296687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:52.296691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:52.296734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602313234272048:11231]
2025-10-10T14:37:52.296752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:52.296763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:52.296690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2472
2025-10-10T14:37:52.296719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2472
2025-10-10T14:37:52.296976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.296993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.297028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43943dad-e6866045-e9e04a95-b7fe9626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:52.297043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.297048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.297051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:52.297064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.297090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:52.297113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.297301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.297307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.297411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.297537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2473 partition: 0 MaxSeqNo: 40 sessionId: src_id|43943dad-e6866045-e9e04a95-b7fe9626_0
2025-10-10T14:37:52.298041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4260918-1670824c-102af601-21bd8519_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|43943dad-e6866045-e9e04a95-b7fe9626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:52.300940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43943dad-e6866045-e9e04a95-b7fe9626_0] Write session: try to update token
2025-10-10T14:37:52.300965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43943dad-e6866045-e9e04a95-b7fe9626_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:52.319126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:52.319151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:52.319164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602313234272048:11231]
2025-10-10T14:37:52.319216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:52.319222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:52.319427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:52.319577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.319720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.319858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.320089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:52.320134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:52.321761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2473 sessionId: src_id|43943dad-e6866045-e9e04a95-b7fe9626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:52.324718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.324743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.324794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:52.324467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:52.324951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:52.364923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.364964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.365164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.365241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.365318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.369480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.370190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.370210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.370296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.370364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.370438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.370513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.370566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.370576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.370654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.370741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.370814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.370886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.370942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.370950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.371031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.371102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.371175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.371245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.371294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.371303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.371379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.371451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.371518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.371590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.371638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.371646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.371722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.371792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.371860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.371932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.372981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602314016504214:10596]
2025-10-10T14:37:52.371979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.373327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2472, pipe: [1:7559602314016504214:10596]
2025-10-10T14:37:52.371992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.372066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.372133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.372206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.372272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.372319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.372322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.372429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.372492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.372561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.372628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.372672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.372675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.372753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.372813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.372876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.372943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.372988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.372992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.373065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.373131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.373195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.373265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.373307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.373310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.377501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:52.377522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:52.377527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:52.377529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:52.377541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602313234272048:11231]
2025-10-10T14:37:52.377545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602313234272048:11231]
2025-10-10T14:37:52.377549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602313234272048:11231]
2025-10-10T14:37:52.377609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:52.377616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504214:10596], now have 1 active actors on pipe
2025-10-10T14:37:52.377626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:37:52.377634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:52.377638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:52.377702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.377732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.377736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:37:52.377778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:37:52.377796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:37:52.377805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:37:52.377808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:37:52.377812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:37:52.378245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:37:52.378278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:37:52.378289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:37:52.378294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:37:52.378302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:37:52.378305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:37:52.378868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:37:52.378895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:37:52.378902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:37:52.378905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:37:52.378908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:37:52.378911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:37:52.379737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:37:52.379772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:37:52.379779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:37:52.379783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:37:52.379786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:37:52.386385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:37:52.386430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:37:52.386451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760107072386
2025-10-10T14:37:52.386779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:37:52.386808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:37:52.386817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:37:52.386821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:37:52.386826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:37:52.386830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:37:52.387437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:37:52.387466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:37:52.387473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:37:52.387477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:37:52.387482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:37:52.387485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:37:52.388018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:37:52.388032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:37:52.388042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:37:52.388047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:37:52.388053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:37:52.388057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:37:52.388540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:37:52.388553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:37:52.388558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:37:52.393941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:37:52.393980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:37:52.393991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:37:52.393997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:37:52.394010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760107072388
2025-10-10T14:37:52.394358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:37:52.394377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:37:52.394386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:37:52.394390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:37:52.394394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:37:52.394398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:37:52.394942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:37:52.394957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:37:52.394962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:37:52.394969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:37:52.394972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:37:52.394976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:37:52.395488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:37:52.395501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.395622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760107072388
2025-10-10T14:37:52.400358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:52.400382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.400385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:52.400552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:52.516659Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:52.517042Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:37:52.517075Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:37:52.517086Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:37:52.517093Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:37:52.517440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:52.517857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:52.517920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2473 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43943dad-e6866045-e9e04a95-b7fe9626_0
2025-10-10T14:37:52.518103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2473 sessionId: src_id|43943dad-e6866045-e9e04a95-b7fe9626_0 is DEAD
2025-10-10T14:37:52.518248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:52.518285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602314016504214:10596]
2025-10-10T14:37:52.521445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43943dad-e6866045-e9e04a95-b7fe9626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:52.521459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43943dad-e6866045-e9e04a95-b7fe9626_0] Write session will restart in 0.006352s
2025-10-10T14:37:52.521487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43943dad-e6866045-e9e04a95-b7fe9626_0] Write session: Do CDS request
2025-10-10T14:37:52.521493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43943dad-e6866045-e9e04a95-b7fe9626_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:52.529926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43943dad-e6866045-e9e04a95-b7fe9626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.529973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:52.529990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2474
2025-10-10T14:37:52.530194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.530229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:52.530235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:52.530239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:52.530685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2474 sessionId:  describe result for acl check
2025-10-10T14:37:52.530716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:52.530718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:52.530720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:52.530739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602314016504252:11044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:52.531323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602314016504252:11044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:52.535707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602314016504252:11044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:52.538432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:52.540647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:52.540554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602314016504252:11044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:52.540572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602314016504252:11044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:52.540575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602314016504252:11044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:52.540586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:52.540911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:52.540929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:52.540943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:52.541008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:52.541064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602313234272154:11246]
2025-10-10T14:37:52.541718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:52.542096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:52.542157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:52.542519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:52.542588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.542597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.542599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.542604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.542606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.542608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.542609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.542611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.542612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.542614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.542615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.542617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.542618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.542626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.542644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.542648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.542652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.542657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.542662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.542666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.542670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.542674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.542679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.542683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.542687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.542691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.542699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.542709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.542716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.542746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.542751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.542757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.542762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.542769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.542774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.542781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.542786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.542792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.542797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.542803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.542808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.542814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.542821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.542827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.542832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.542838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.542842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.542847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.542851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.542868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.542873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.542878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.542920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:52.546710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2473
2025-10-10T14:37:52.546710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2473
2025-10-10T14:37:52.545920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:52.546280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:52.546286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:52.546289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:52.546294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:52.546301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2473 [2:7559602313234272154:11246]
2025-10-10T14:37:52.546317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:52.546337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:52.546340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.546345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.546349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.546369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:52.546378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:52.546387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:52.546453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.546459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.546462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.546465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:52.546581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:52.546585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.546598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.546612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.546633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:52.546658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504295:11044], now have 1 active actors on pipe
2025-10-10T14:37:52.546662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504243:2438], now have 1 active actors on pipe
2025-10-10T14:37:52.546670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602313234272149:11246]
2025-10-10T14:37:52.546673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602313234272149:11246]
2025-10-10T14:37:52.546674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602313234272149:11246]
2025-10-10T14:37:52.546690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:52.546703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:52.546706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:52.546707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:52.546709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:52.546743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:52.546747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:52.546787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602313234272149:11246]
2025-10-10T14:37:52.546795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:52.546802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:52.546820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.546826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.546883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f004c5-25ed3270-8720b74c-bcc16024_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:52.546892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.546896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.546899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:52.546911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.546922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:52.546945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.547217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.547226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.547242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.547342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2474 partition: 0 MaxSeqNo: 40 sessionId: src_id|3f004c5-25ed3270-8720b74c-bcc16024_0
2025-10-10T14:37:52.547803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43943dad-e6866045-e9e04a95-b7fe9626_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3f004c5-25ed3270-8720b74c-bcc16024_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:52.550901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f004c5-25ed3270-8720b74c-bcc16024_0] Write session: try to update token
2025-10-10T14:37:52.550925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f004c5-25ed3270-8720b74c-bcc16024_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:52.570580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:52.570521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2474 sessionId: src_id|3f004c5-25ed3270-8720b74c-bcc16024_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:52.573429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:52.570602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:52.570611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:52.570614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:52.570627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602313234272149:11246]
2025-10-10T14:37:52.570631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602313234272149:11246]
2025-10-10T14:37:52.570635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602313234272149:11246]
2025-10-10T14:37:52.570693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:52.570692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:52.570700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:52.570701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.570703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:52.570704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:52.570868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:52.617758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602314016504307:10596]
2025-10-10T14:37:52.619895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2473, pipe: [1:7559602314016504307:10596]
2025-10-10T14:37:52.697871Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:52.698227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.698242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.698298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504307:10596], now have 1 active actors on pipe
2025-10-10T14:37:52.698532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:52.699181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602314016504307:10596]
2025-10-10T14:37:52.699214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:52.699299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2474 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f004c5-25ed3270-8720b74c-bcc16024_0
2025-10-10T14:37:52.699675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f004c5-25ed3270-8720b74c-bcc16024_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:52.699685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f004c5-25ed3270-8720b74c-bcc16024_0] Write session will restart in 0.009219s
2025-10-10T14:37:52.699712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f004c5-25ed3270-8720b74c-bcc16024_0] Write session: Do CDS request
2025-10-10T14:37:52.699719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f004c5-25ed3270-8720b74c-bcc16024_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:52.699501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2474 sessionId: src_id|3f004c5-25ed3270-8720b74c-bcc16024_0 is DEAD
2025-10-10T14:37:52.699638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:52.710003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f004c5-25ed3270-8720b74c-bcc16024_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.713669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:52.713686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2475
2025-10-10T14:37:52.713854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.713894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:52.713900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:52.713905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:52.714144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:52.714348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2475 sessionId:  describe result for acl check
2025-10-10T14:37:52.714384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:52.714386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:52.714387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:52.714408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602314016504336:11048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:52.715026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602314016504336:11048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:52.717051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:52.717313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:52.717345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:52.717361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:52.717438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:52.717489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602313234272218:11248]
2025-10-10T14:37:52.717487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602314016504336:11048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:52.718121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:52.718746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:52.718827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:52.719241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:52.719316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.719325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.719327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.719328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.719329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.719331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.719332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.719333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.719336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.719337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.719339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.719340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.719342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.719350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.719364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.719368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.719373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.719377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.719380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.719384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.719387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.719391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.719397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.719401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.719406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.719410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.719418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.719429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.719435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.719441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.719449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.719454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.719459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.719464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.719469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.719474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.719478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.719484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.719489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.719495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.719500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.719505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.719511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.719516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.719521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.719526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.719531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.719537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.719541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.719546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.719551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.719556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.719599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:52.722222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602314016504336:11048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:52.722239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602314016504336:11048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:52.722245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602314016504336:11048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:52.722255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:52.722424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:52.722862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:52.722874Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:52.722876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:52.722880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:52.722887Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2474 [2:7559602313234272218:11248]
2025-10-10T14:37:52.722901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:52.722919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:52.722928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.722937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.722939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.722956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:52.722964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:52.722975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:52.723038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.723047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.723048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.723051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:52.723123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:52.723132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.723142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.723153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.723174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:52.723202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504368:11048], now have 1 active actors on pipe
2025-10-10T14:37:52.723206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504309:2438], now have 1 active actors on pipe
2025-10-10T14:37:52.723214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602313234272213:11248]
2025-10-10T14:37:52.723220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602313234272213:11248]
2025-10-10T14:37:52.723222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602313234272213:11248]
2025-10-10T14:37:52.723236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:52.723250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:52.723261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:52.723266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:52.723269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:52.723269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:52.723272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:52.723302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602313234272213:11248]
2025-10-10T14:37:52.723315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:52.723328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:52.723298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2474
2025-10-10T14:37:52.723302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2474
2025-10-10T14:37:52.723353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.723363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.723400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:52.723414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.723419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.723421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:52.723432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.723450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:52.723465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.723605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.723614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.723638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.723715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2475 partition: 0 MaxSeqNo: 40 sessionId: src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0
2025-10-10T14:37:52.724120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f004c5-25ed3270-8720b74c-bcc16024_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:52.727010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0] Write session: try to update token
2025-10-10T14:37:52.727031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:52.744224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2475 sessionId: src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:52.744596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:52.744614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:52.744625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602313234272213:11248]
2025-10-10T14:37:52.744684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:52.744707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:52.744875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:52.745033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.745181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.745345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:52.745739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:52.745792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:52.747199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:52.747440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.747457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.747506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:52.747611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:52.757174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:52.757199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:52.757203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:52.757205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:52.757220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602313234272213:11248]
2025-10-10T14:37:52.757224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602313234272213:11248]
2025-10-10T14:37:52.757228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602313234272213:11248]
2025-10-10T14:37:52.757277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:52.757287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:52.757290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.757293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:52.757294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:52.757299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:52.757471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:52.799456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602314016504381:10596]
2025-10-10T14:37:52.799864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2474, pipe: [1:7559602314016504381:10596]
2025-10-10T14:37:52.877849Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:52.887080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.887119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.887330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.887410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.887496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.887574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.887627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.887637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.887721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.887794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.887871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.887957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.888002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.888008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.888086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.888147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.888214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.888287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.888335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.888338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.888418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.888487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.888555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.888624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.888671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.888674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.888754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.888825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.888894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.888962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.889007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.889010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.889086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.889149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.889220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.889289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.889503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.889526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.891185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602314016504381:10596]
2025-10-10T14:37:52.891198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:52.891203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:52.891230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:52.891248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2475 reason: error at write: Disconnected sessionId: src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0
2025-10-10T14:37:52.891458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2475 sessionId: src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0 is DEAD
2025-10-10T14:37:52.889610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.889685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.889752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.889819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.889869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.889873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.889952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.890018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.890083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.890150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.890195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.890198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.890271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.890332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.890397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.890464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.890510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.890513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.890585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:52.890649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:52.890739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:52.890812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:52.890855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:52.890858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:52.890930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504381:10596], now have 1 active actors on pipe
2025-10-10T14:37:52.892115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:52.893578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:52.893592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0] Write session will restart in 0.006145s
2025-10-10T14:37:52.893618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0] Write session: Do CDS request
2025-10-10T14:37:52.893624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:52.900869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.900972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:52.900987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2476
2025-10-10T14:37:52.901575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:52.901618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:52.901641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:52.901645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:52.902135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2476 sessionId:  describe result for acl check
2025-10-10T14:37:52.902180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:52.902182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:52.902184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:52.902191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602314016504411:11053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:52.902797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602314016504411:11053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:52.903991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:52.905806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:52.906026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:52.906039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:52.906052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:52.906113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:52.906158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602313234272283:11250]
2025-10-10T14:37:52.906625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602314016504411:11053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:52.906765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:52.907068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:52.907120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:52.907461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:52.907560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.907568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.907569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.907572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.907573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.907574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.907575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.907576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.907577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.907579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.907580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.907581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.907582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.907589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.907602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.907605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.907610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.907613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.907617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.907621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.907625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.907628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.907633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.907636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.907640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.907644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.907654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.907663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:52.907670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.907675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:52.907680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.907693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:52.907698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.907703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:52.907708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.907719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:52.907723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.907728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:52.907734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.907743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:52.907747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.907752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:52.907761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.907766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:52.907769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.907775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:52.907784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.907790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.907793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.907803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.907808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.907812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.907855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:52.910204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602314016504411:11053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:52.910218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602314016504411:11053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:52.910222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602314016504411:11053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:52.910232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:52.910374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:52.910842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:52.910859Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:52.910875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:52.910879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:52.910888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2475 [2:7559602313234272283:11250]
2025-10-10T14:37:52.910902Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:52.910921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:52.910924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.910928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.910930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.910947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:52.910955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:52.910962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:52.911033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.911044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.911046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.911048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:52.911241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2475
2025-10-10T14:37:52.911246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2475
2025-10-10T14:37:52.911120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:52.911131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.911146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:52.911159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:52.911176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:52.911198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504387:2438], now have 1 active actors on pipe
2025-10-10T14:37:52.911202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504459:11053], now have 1 active actors on pipe
2025-10-10T14:37:52.911210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602313234272278:11250]
2025-10-10T14:37:52.911212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602313234272278:11250]
2025-10-10T14:37:52.911214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602313234272278:11250]
2025-10-10T14:37:52.911231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:52.911247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:52.911253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:52.911257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:52.911259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:52.911261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:52.911267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:52.911291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602313234272278:11250]
2025-10-10T14:37:52.911294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:52.911296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:52.911326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.911332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.911369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:52.911378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:52.911382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:52.911384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:52.911394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:52.911406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:52.911423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.911622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:52.911636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:52.911669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:52.911755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2476 partition: 0 MaxSeqNo: 40 sessionId: src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0
2025-10-10T14:37:52.912166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0c1570c-780af488-9ff06fed-16a8a8fd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:52.915238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0] Write session: try to update token
2025-10-10T14:37:52.915259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:52.931052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:52.931078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:52.931082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:52.931087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:52.931099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602313234272278:11250]
2025-10-10T14:37:52.931104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602313234272278:11250]
2025-10-10T14:37:52.931107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602313234272278:11250]
2025-10-10T14:37:52.931164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:52.931177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:52.931186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:52.931377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:52.931790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2476 sessionId: src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:52.934516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:52.934685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:52.934703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:52.934707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:52.991428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602314016504466:10596]
2025-10-10T14:37:52.991734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2475, pipe: [1:7559602314016504466:10596]
2025-10-10T14:37:53.057539Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:53.057899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.057917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.057967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602314016504466:10596], now have 1 active actors on pipe
2025-10-10T14:37:53.061131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:53.061727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602314016504466:10596]
2025-10-10T14:37:53.061737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:53.061827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2476 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0
2025-10-10T14:37:53.062010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:53.062045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2476 sessionId: src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0 is DEAD
2025-10-10T14:37:53.062389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:53.062401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0] Write session will restart in 0.008276s
2025-10-10T14:37:53.062429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0] Write session: Do CDS request
2025-10-10T14:37:53.062435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:53.071931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.072909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:53.072923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2477
2025-10-10T14:37:53.073595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.073639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:53.073650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:53.073655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:53.074141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2477 sessionId:  describe result for acl check
2025-10-10T14:37:53.074187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:53.074193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:53.074195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:53.074202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602318311471793:11057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:53.074363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:53.074784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602318311471793:11057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:53.076776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:53.077053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:53.077059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:53.077072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:53.077140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:53.077201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602317529239645:11252]
2025-10-10T14:37:53.077811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:53.077994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602318311471793:11057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:53.079304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:53.079382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:53.079801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:53.079880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.079886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.079887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.079888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.079890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.079892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.079893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.079895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.079896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.079898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.079899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.079900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.079901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.079909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.079923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.079927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.079932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.079936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.079940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.079944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.079948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.079952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.079958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.079961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.079965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.079968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.079977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.079983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.079987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.079991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.079996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.080001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.080005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.080011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.080016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.080021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.080024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.080030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.080035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.080040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.080045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.080050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.080056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.080061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.080066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.080077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.080082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.080087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.080091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.080096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.080101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.080106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.080157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:53.082790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:53.082834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602318311471793:11057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:53.082852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602318311471793:11057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:53.082856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602318311471793:11057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:53.082867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:53.083129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:53.083144Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:53.083150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:53.083158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:53.083165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2476 [2:7559602317529239645:11252]
2025-10-10T14:37:53.083179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:53.083198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:53.083201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.083205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.083208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.083227Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:53.083240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:53.083248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:53.083319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.083327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.083329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.083332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:53.083400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:53.083408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.083421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.083434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.083452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:53.083482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311471764:2438], now have 1 active actors on pipe
2025-10-10T14:37:53.083490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311471827:11057], now have 1 active actors on pipe
2025-10-10T14:37:53.083498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602317529239640:11252]
2025-10-10T14:37:53.083500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602317529239640:11252]
2025-10-10T14:37:53.083503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602317529239640:11252]
2025-10-10T14:37:53.083520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:53.083532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:53.083536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:53.083538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:53.083546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:53.083569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:53.083577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:53.083606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602317529239640:11252]
2025-10-10T14:37:53.083615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:53.083618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:53.083841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.083860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.083893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:53.083903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.083913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.083916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:53.083928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.083941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:53.083965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.084231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.084240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.084256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.084794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d63be74-8a3b3b16-73bb1af-4b88609d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:53.083454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2476
2025-10-10T14:37:53.083488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2476
2025-10-10T14:37:53.084388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2477 partition: 0 MaxSeqNo: 40 sessionId: src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0
2025-10-10T14:37:53.087657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0] Write session: try to update token
2025-10-10T14:37:53.087678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:53.095803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:53.095827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.095840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602317529239640:11252]
2025-10-10T14:37:53.095890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:53.095897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:53.096093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:53.096249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.096396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.096547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.096761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:53.096818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:53.106601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2477 sessionId: src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:53.109230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:53.109646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:53.109485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.109520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.109564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:53.114103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:53.114122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.114125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:53.114128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:53.114139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602317529239640:11252]
2025-10-10T14:37:53.114144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602317529239640:11252]
2025-10-10T14:37:53.114149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602317529239640:11252]
2025-10-10T14:37:53.114198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:53.114199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:53.114206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:53.114210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.114211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:53.114213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:53.114347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:53.162116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602318311471835:10596]
2025-10-10T14:37:53.162550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2476, pipe: [1:7559602318311471835:10596]
2025-10-10T14:37:53.235579Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:53.243433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.243464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.243634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.243706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.243777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.243849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.244228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.244239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.244316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.244381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.244446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.244516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.244560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.244566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.244636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.244698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.244763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.244831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.244883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.244891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.244963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.245028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.245090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.245158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.245204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.245211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.245279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.245360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.245424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.245488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.245532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.245539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.245609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.245672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.245736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.245799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.245847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.245854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.245925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.247691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602318311471835:10596]
2025-10-10T14:37:53.247726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:53.247728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:53.247732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:53.247778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2477 reason: error at write: Disconnected sessionId: src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0
2025-10-10T14:37:53.248024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2477 sessionId: src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0 is DEAD
2025-10-10T14:37:53.248158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:53.248170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0] Write session will restart in 0.009794s
2025-10-10T14:37:53.248211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0] Write session: Do CDS request
2025-10-10T14:37:53.248217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:53.245984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.246058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.246116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.246244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.246247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.246319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.246374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.246429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.246489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.246529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.246533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.246609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.246673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.246765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.246829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.246873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.246876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.246947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.247005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.247064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.247127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.247174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.247177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.247251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311471835:10596], now have 1 active actors on pipe
2025-10-10T14:37:53.247976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:53.258999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.259082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:53.259100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2478
2025-10-10T14:37:53.259221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:53.260917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:53.261249Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:53.261276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:53.261295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:53.261462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:53.261551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602317529239725:11256]
2025-10-10T14:37:53.261641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.261689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:53.261700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:53.261704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:53.262151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2478 sessionId:  describe result for acl check
2025-10-10T14:37:53.262186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:53.262188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:53.262190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:53.262196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602318311471868:11061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:53.262324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:53.262744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:53.262817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:53.262883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602318311471868:11061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:53.263224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:53.263289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.263295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.263297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.263298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.263299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.263301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.263302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.263303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.263305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.263306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.263307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.263308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.263310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.263316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.263331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.263335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.263339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.263343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.263348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.263351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.263356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.263360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.263365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.263369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.263373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.263377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.263387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.263396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.263403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.263409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.263413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.263417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.263421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.263426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.263430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.263436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.263440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.263445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.263449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.263455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.263459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.263464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.263469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.263474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.263479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.263485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.263489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.263494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.263498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.263503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.263508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.263513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.263553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:53.265846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602318311471868:11061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:53.265980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:53.266513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:53.266536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:53.266539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:53.266543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:53.266550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2477 [2:7559602317529239725:11256]
2025-10-10T14:37:53.266577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:53.266595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:53.266603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.266607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.266610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.266630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:53.266637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:53.266654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:53.266733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.266741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.266743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.266745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:53.266820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:53.266829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.266841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.266853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.266870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:53.266901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311471838:2438], now have 1 active actors on pipe
2025-10-10T14:37:53.266918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602317529239720:11256]
2025-10-10T14:37:53.266923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602317529239720:11256]
2025-10-10T14:37:53.266925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602317529239720:11256]
2025-10-10T14:37:53.266943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:53.266970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:53.266994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:53.267004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:53.267045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602317529239720:11256]
2025-10-10T14:37:53.267057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:53.267095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2477
2025-10-10T14:37:53.267109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:53.267121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:53.267123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:53.267134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:53.272493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602318311471868:11061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:53.272511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602318311471868:11061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:53.272515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602318311471868:11061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:53.272526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:53.273094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311471904:11061], now have 1 active actors on pipe
2025-10-10T14:37:53.273256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2477
2025-10-10T14:37:53.273380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.273400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.273442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93a2a37e-23a76328-d5a54303-2824bacd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:53.273462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.273477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.273484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:53.273515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.273546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:53.273570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.274208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2478 partition: 0 MaxSeqNo: 40 sessionId: src_id|93a2a37e-23a76328-d5a54303-2824bacd_0
2025-10-10T14:37:53.274612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9de2d1-75f0120a-446ef96b-b11257c4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|93a2a37e-23a76328-d5a54303-2824bacd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:53.274035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.274050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.274076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.277402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a2a37e-23a76328-d5a54303-2824bacd_0] Write session: try to update token
2025-10-10T14:37:53.277420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a2a37e-23a76328-d5a54303-2824bacd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:53.278761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:53.278784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.278797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602317529239720:11256]
2025-10-10T14:37:53.278851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:53.279060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:53.279234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.279416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.279647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.279913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:53.279961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:53.280264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:53.300091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:53.300125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.300130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:53.300132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:53.300147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602317529239720:11256]
2025-10-10T14:37:53.300153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602317529239720:11256]
2025-10-10T14:37:53.300158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602317529239720:11256]
2025-10-10T14:37:53.300240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:53.300237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:53.300248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:53.300254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:53.300256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.300258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:53.300439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:53.307016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2478 sessionId: src_id|93a2a37e-23a76328-d5a54303-2824bacd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:53.309785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:53.347834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602318311471920:10596]
2025-10-10T14:37:53.348140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2477, pipe: [1:7559602318311471920:10596]
2025-10-10T14:37:53.424158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:53.424454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.424475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.424500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311471920:10596], now have 1 active actors on pipe
2025-10-10T14:37:53.424924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:53.424988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602318311471920:10596]
2025-10-10T14:37:53.424993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:53.424998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:53.425108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2478 reason: error at write: Disconnected sessionId: src_id|93a2a37e-23a76328-d5a54303-2824bacd_0
2025-10-10T14:37:53.425522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a2a37e-23a76328-d5a54303-2824bacd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:53.425534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a2a37e-23a76328-d5a54303-2824bacd_0] Write session will restart in 0.009573s
2025-10-10T14:37:53.425563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a2a37e-23a76328-d5a54303-2824bacd_0] Write session: Do CDS request
2025-10-10T14:37:53.425570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a2a37e-23a76328-d5a54303-2824bacd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:53.425314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2478 sessionId: src_id|93a2a37e-23a76328-d5a54303-2824bacd_0 is DEAD
2025-10-10T14:37:53.426057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:53.435988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93a2a37e-23a76328-d5a54303-2824bacd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.436395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:53.436413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2479
2025-10-10T14:37:53.436683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.436719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:53.436724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:53.436729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:53.437225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2479 sessionId:  describe result for acl check
2025-10-10T14:37:53.437255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:53.437257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:53.437259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:53.437265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602318311471938:11066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:53.437947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602318311471938:11066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:53.441615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:53.441672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602318311471938:11066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:53.444224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:53.444455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:53.444467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:53.444479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:53.444530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:53.444578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602317529239808:11264]
2025-10-10T14:37:53.445233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:53.445988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:53.446042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:53.446376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:53.446438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.446444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.446445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.446447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.446448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.446449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.446451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.446452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.446454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.446455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.446457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.446458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.446460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.446465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.446477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.446481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.446485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.446490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.446494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.446499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.446503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.446507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.446511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.446515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.446519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.446523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.446533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.446541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.446548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.446553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.446567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.446572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.446583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.446588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.446599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.446604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.446608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.446618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.446623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.446633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.446637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.446647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.446652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.446658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.446662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.446668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.446677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.446682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.446691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.446696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.446719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.446726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.446772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:53.447548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602318311471938:11066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:53.447572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602318311471938:11066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:53.447575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602318311471938:11066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:53.447585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:53.449778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:53.450236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:53.450248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:53.450251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:53.450255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:53.450261Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2478 [2:7559602317529239808:11264]
2025-10-10T14:37:53.450274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:53.450291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:53.450298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.450302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.450304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.450324Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:53.450330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:53.450342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:53.450400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.450406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.450408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.450410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:53.450580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:53.450589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.450599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.450613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.450632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:53.450649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602317529239803:11264]
2025-10-10T14:37:53.450651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602317529239803:11264]
2025-10-10T14:37:53.450654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602317529239803:11264]
2025-10-10T14:37:53.450662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:53.450675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:53.450689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:53.450691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:53.450692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:53.450694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:53.450695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:53.450728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602317529239803:11264]
2025-10-10T14:37:53.450731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:53.450735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:53.450741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311471986:11066], now have 1 active actors on pipe
2025-10-10T14:37:53.450755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311471922:2438], now have 1 active actors on pipe
2025-10-10T14:37:53.450969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2478
2025-10-10T14:37:53.451000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2478
2025-10-10T14:37:53.451212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.451223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.451246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:53.451259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.451264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.451266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:53.451274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.451285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:53.451301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.451540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.451550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.451563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.451733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2479 partition: 0 MaxSeqNo: 40 sessionId: src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0
2025-10-10T14:37:53.452155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93a2a37e-23a76328-d5a54303-2824bacd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:53.455743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0] Write session: try to update token
2025-10-10T14:37:53.455764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:53.468012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:53.468036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.468045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602317529239803:11264]
2025-10-10T14:37:53.468095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:53.468106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:53.468290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:53.468449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.468601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.468761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.469094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:53.469126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:53.478473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2479 sessionId: src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:53.481219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:53.481574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.481606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.481638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:53.481745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:53.496291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:53.496319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.496323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:53.496324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:53.496336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602317529239803:11264]
2025-10-10T14:37:53.496340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602317529239803:11264]
2025-10-10T14:37:53.496345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602317529239803:11264]
2025-10-10T14:37:53.496387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:53.496396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.496398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:53.496554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:53.497526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:53.497544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:53.497550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:53.524940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602318311472019:10596]
2025-10-10T14:37:53.525659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2478, pipe: [1:7559602318311472019:10596]
2025-10-10T14:37:53.617240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:53.629110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.629146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.629514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.629599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.629682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.629755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.630206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.630212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.630307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.630381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.630463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.630540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.630598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.630601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.630693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.630781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.630861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.630934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.630992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.630995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.631083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.631159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.631233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.631316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.631370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.631373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.631459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.631529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.631599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.631669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.631728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.631731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.631819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.631889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.631969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.632044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.632099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.632102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.632184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.632252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.632333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.632404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.632461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.632464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.632548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.632616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.632693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.632768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.632822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.632825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.632906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.632973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.633048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.633119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.633176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.633179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.633260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.633594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.633677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.633747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.633802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.633805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.633888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311472019:10596], now have 1 active actors on pipe
2025-10-10T14:37:53.635878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:53.635472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:53.635540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:53.635544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:53.635576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2479 reason: error at write: Disconnected sessionId: src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0
2025-10-10T14:37:53.635775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2479 sessionId: src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0 is DEAD
2025-10-10T14:37:53.636242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602318311472019:10596]
2025-10-10T14:37:53.637474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:53.637489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0] Write session will restart in 0.007747s
2025-10-10T14:37:53.637517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0] Write session: Do CDS request
2025-10-10T14:37:53.637523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:53.646900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.648796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:53.647104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:53.647124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2480
2025-10-10T14:37:53.647301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.647348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:53.647354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:53.647358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:53.647928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2480 sessionId:  describe result for acl check
2025-10-10T14:37:53.647972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:53.647974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:53.647976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:53.647982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602318311472050:11079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:53.648591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602318311472050:11079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:53.650869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:53.651089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:53.651103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:53.651115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:53.651185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:53.651236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602317529239903:11273]
2025-10-10T14:37:53.651931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:53.652388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:53.652447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:53.652843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:53.652932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.652940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.652942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.652944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.652945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.652946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.652948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.652950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.652955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.652956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.652958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.652959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.652960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.652980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.652993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.652997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.653002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.653006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.653011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.653016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.653020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.653025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.653030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.653034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.653038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.653043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.653051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.653061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.653067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.653074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.653080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.653086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.653092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.653099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.653108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.653115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.653123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.653130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.653135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.653145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.653150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.653158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.653163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.653169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.653176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.653183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.653188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.653196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.653201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.653207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.653214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.653220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.653267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:53.655903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:53.655917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602318311472050:11079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:53.656305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:53.656323Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:53.656326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:53.656332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:53.656339Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2479 [2:7559602317529239903:11273]
2025-10-10T14:37:53.656352Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:53.656371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:53.656380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.656383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.656385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.656400Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:53.656409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:53.656421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:53.656488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.656496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.656498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.656501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:53.656585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:53.656593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.656606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.656624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.656647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:53.656670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311472021:2438], now have 1 active actors on pipe
2025-10-10T14:37:53.656686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602317529239897:11273]
2025-10-10T14:37:53.656689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602317529239897:11273]
2025-10-10T14:37:53.656691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602317529239897:11273]
2025-10-10T14:37:53.656701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:53.656714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:53.656714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:53.656717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:53.656719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:53.656732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:53.656735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:53.656768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602317529239897:11273]
2025-10-10T14:37:53.656782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:53.657314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:53.656675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2479
2025-10-10T14:37:53.667656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602318311472050:11079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:53.667689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602318311472050:11079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:53.667692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602318311472050:11079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:53.667703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:53.667998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311472090:11079], now have 1 active actors on pipe
2025-10-10T14:37:53.668040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2479
2025-10-10T14:37:53.668127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.668138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.668169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:53.668201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.668213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.668216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:53.668230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.668257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:53.668277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.668520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.668531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.668549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.668944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2480 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0
2025-10-10T14:37:53.669361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703b579e-99c001b4-7a8a6519-9b1fda65_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:53.672647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0] Write session: try to update token
2025-10-10T14:37:53.672669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:53.677825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:53.677850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.677853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:53.677856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:53.677866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602317529239897:11273]
2025-10-10T14:37:53.677871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602317529239897:11273]
2025-10-10T14:37:53.677876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602317529239897:11273]
2025-10-10T14:37:53.677927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:53.677932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:53.677941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.677945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:53.677953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:53.677959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:53.678116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:53.692625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2480 sessionId: src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:53.695937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:53.736432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602318311472094:10596]
2025-10-10T14:37:53.738566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2479, pipe: [1:7559602318311472094:10596]
2025-10-10T14:37:53.802948Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:53.803900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.803915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.803938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311472094:10596], now have 1 active actors on pipe
2025-10-10T14:37:53.804257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:53.804275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602318311472094:10596]
2025-10-10T14:37:53.804314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:53.804330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:53.804409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2480 reason: error at write: Disconnected sessionId: src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0
2025-10-10T14:37:53.804451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:53.804619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2480 sessionId: src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0 is DEAD
2025-10-10T14:37:53.804742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:53.804755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0] Write session will restart in 0.006792s
2025-10-10T14:37:53.804781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0] Write session: Do CDS request
2025-10-10T14:37:53.804791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:53.813006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.813067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:53.813086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2481
2025-10-10T14:37:53.813355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:53.813398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:53.813409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:53.813414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:53.813946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2481 sessionId:  describe result for acl check
2025-10-10T14:37:53.813984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:53.813987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:53.813989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:53.813995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602318311472131:11084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:53.814649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602318311472131:11084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:53.816937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:53.817446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602318311472131:11084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:53.819318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:53.819601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:53.819613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:53.819626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:53.819701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:53.819751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602317529239973:11275]
2025-10-10T14:37:53.820121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602318311472131:11084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:53.820137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602318311472131:11084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:53.820140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602318311472131:11084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:53.820152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:53.820459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:53.820790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:53.820843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:53.821173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:53.821242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.821250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.821252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.821253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.821255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.821257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.821258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.821259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.821261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.821262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.821264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.821266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.821267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.821274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.821287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.821292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.821297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.821301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.821306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.821310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.821315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.821319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.821325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.821345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.821350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.821355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.821363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.821372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:53.821379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.821385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:53.821391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.821397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:53.821404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.821410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:53.821415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.821421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:53.821427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.821440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:53.821462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.821473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:53.821478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.821484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:53.821489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.821494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:53.821499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.821505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:53.821514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.821520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.821525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.821531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.821536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.821541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.821595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:53.836618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:53.837016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:53.837032Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:53.837036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:53.837041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:53.837050Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2480 [2:7559602317529239973:11275]
2025-10-10T14:37:53.837072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:53.837098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:53.837106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.837110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.837116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.837139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:53.837153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:53.837160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:53.837232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.837240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.837245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.837248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:53.837350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:53.837357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.837369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:53.837383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:53.837398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:53.837418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311472164:11084], now have 1 active actors on pipe
2025-10-10T14:37:53.837426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311472102:2438], now have 1 active actors on pipe
2025-10-10T14:37:53.837434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602317529239968:11275]
2025-10-10T14:37:53.837436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602317529239968:11275]
2025-10-10T14:37:53.837438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602317529239968:11275]
2025-10-10T14:37:53.837451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:53.837462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:53.837465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:53.837468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:53.837470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:53.837484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:53.837491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:53.837529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602317529239968:11275]
2025-10-10T14:37:53.837540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:53.837568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:53.837629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2480
2025-10-10T14:37:53.837684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2480
2025-10-10T14:37:53.837833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.837846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.837879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:53.837892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:53.837901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:53.837903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:53.837914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:53.837930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:53.837963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.838461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.838482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.838515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:53.838825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2481 partition: 0 MaxSeqNo: 40 sessionId: src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0
2025-10-10T14:37:53.839293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e963ddf-9c3f51f3-9127669e-d16eb3ad_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:53.842505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0] Write session: try to update token
2025-10-10T14:37:53.842526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:53.851659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:53.851684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.851697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602317529239968:11275]
2025-10-10T14:37:53.851763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:53.852051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:53.852190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:53.852259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.852457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.852665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:53.852948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:53.852992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:53.863956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2481 sessionId: src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:53.866818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:53.867183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.867204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.867246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:53.867412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:53.871592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:53.871606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:53.871610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:53.871612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:53.871622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602317529239968:11275]
2025-10-10T14:37:53.871629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602317529239968:11275]
2025-10-10T14:37:53.871634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602317529239968:11275]
2025-10-10T14:37:53.871690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:53.871697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:53.871700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:53.871844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:53.872778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:53.872785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:53.872789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:53.904349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602318311472179:10596]
2025-10-10T14:37:53.904697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2480, pipe: [1:7559602318311472179:10596]
2025-10-10T14:37:53.985848Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:53.994923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:53.994956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:53.995153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.995231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.995295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.995359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.995401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.995406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.995481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.995546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.995604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.995667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.995713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.995715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.995782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.995841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.995908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.995975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.996022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.996025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.996105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.996169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.996234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.996294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.996332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.996336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.996403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.996461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.996525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.996589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.996958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.996963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.997034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.997093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.997155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.997219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.997262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.997269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.997545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.997613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.997674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.997735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.997774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.997778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.997849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.997911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.997973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.998035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.998079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.998082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.998153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.998213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.998271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.998330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.998374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.998378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.998465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:53.998522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:53.998576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:53.998636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:53.998678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:53.998680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:53.998765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602318311472179:10596], now have 1 active actors on pipe
2025-10-10T14:37:53.999889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:54.000670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602318311472179:10596]
2025-10-10T14:37:54.000697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:54.000732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:54.000767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2481 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0
2025-10-10T14:37:54.000956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2481 sessionId: src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0 is DEAD
2025-10-10T14:37:54.001651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:54.001665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0] Write session will restart in 0.006417s
2025-10-10T14:37:54.001691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0] Write session: Do CDS request
2025-10-10T14:37:54.001697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:54.009891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.010140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:54.010153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2482
2025-10-10T14:37:54.010320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.010351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:54.010355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:54.010358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:54.010860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2482 sessionId:  describe result for acl check
2025-10-10T14:37:54.010899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:54.010901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:54.010903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:54.010909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602322606439494:11088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:54.011476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602322606439494:11088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:54.014792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602322606439494:11088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:54.018453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:54.018964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602322606439494:11088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:54.018979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602322606439494:11088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:54.018983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602322606439494:11088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:54.018993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:54.020527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:54.020750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:54.020763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:54.020775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:54.020839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:54.020885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602321824207341:11277]
2025-10-10T14:37:54.021531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:54.021957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:54.022031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:54.022386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:54.022465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.022472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.022474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.022475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.022476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.022478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.022479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.022480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.022481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.022483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.022485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.022486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.022488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.022494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.022510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.022514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.022519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.022523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.022528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.022532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.022537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.022544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.022549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.022554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.022559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.022567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.022576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.022589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.022597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.022607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.022612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.022618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.022627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.022632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.022643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.022649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.022657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.022662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.022666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.022671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.022676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.022680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.022685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.022707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.022710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.022715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.022726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.022730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.022734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.022740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.022744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.022749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.022789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:54.026496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:54.026930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:54.026949Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:54.026952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:54.026957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:54.026964Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2481 [2:7559602321824207341:11277]
2025-10-10T14:37:54.026979Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:54.026997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:54.027001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.027005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.027007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.027026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:54.027034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:54.027043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:54.027107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.027114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.027115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.027117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:54.027173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:54.027178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.027187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.027193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.027203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:54.027223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602321824207335:11277]
2025-10-10T14:37:54.027230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602321824207335:11277]
2025-10-10T14:37:54.027231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602321824207335:11277]
2025-10-10T14:37:54.027238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:54.027248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:54.027257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:54.027259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:54.027266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:54.027270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:54.027273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:54.027283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602321824207335:11277]
2025-10-10T14:37:54.027289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:54.027297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:54.027304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439479:2438], now have 1 active actors on pipe
2025-10-10T14:37:54.027312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439539:11088], now have 1 active actors on pipe
2025-10-10T14:37:54.027392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2481
2025-10-10T14:37:54.027418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2481
2025-10-10T14:37:54.027887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.027904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.027942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1c23dde-7f610071-efc24d8-69e1fba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:54.027961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.027966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.027970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:54.027986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.028000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:54.028019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.028398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.028409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.028429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.028544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2482 partition: 0 MaxSeqNo: 40 sessionId: src_id|a1c23dde-7f610071-efc24d8-69e1fba_0
2025-10-10T14:37:54.028988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c2f5d2-52da1c07-6bc6ccb9-fd9b8ea3_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a1c23dde-7f610071-efc24d8-69e1fba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:54.032518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c23dde-7f610071-efc24d8-69e1fba_0] Write session: try to update token
2025-10-10T14:37:54.032545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c23dde-7f610071-efc24d8-69e1fba_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:54.048764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:54.048784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:54.048788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:54.048790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:54.048800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602321824207335:11277]
2025-10-10T14:37:54.048805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602321824207335:11277]
2025-10-10T14:37:54.048813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602321824207335:11277]
2025-10-10T14:37:54.048864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:54.048872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.048874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:54.049025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:54.049234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:54.049252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:54.049256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:54.058038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2482 sessionId: src_id|a1c23dde-7f610071-efc24d8-69e1fba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:54.060896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:54.100949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602322606439551:10596]
2025-10-10T14:37:54.101251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2481, pipe: [1:7559602322606439551:10596]
2025-10-10T14:37:54.171381Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:54.171711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.171729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.171781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439551:10596], now have 1 active actors on pipe
2025-10-10T14:37:54.172059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:54.172041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:54.172054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602322606439551:10596]
2025-10-10T14:37:54.172083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:54.172086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:54.172162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2482 reason: error at write: Disconnected sessionId: src_id|a1c23dde-7f610071-efc24d8-69e1fba_0
2025-10-10T14:37:54.172406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2482 sessionId: src_id|a1c23dde-7f610071-efc24d8-69e1fba_0 is DEAD
2025-10-10T14:37:54.172592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c23dde-7f610071-efc24d8-69e1fba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:54.172605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c23dde-7f610071-efc24d8-69e1fba_0] Write session will restart in 0.009761s
2025-10-10T14:37:54.172630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c23dde-7f610071-efc24d8-69e1fba_0] Write session: Do CDS request
2025-10-10T14:37:54.172637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c23dde-7f610071-efc24d8-69e1fba_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:54.183986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c23dde-7f610071-efc24d8-69e1fba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.184069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:54.184086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2483
2025-10-10T14:37:54.184272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.184340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:54.184356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:54.184361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:54.184825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2483 sessionId:  describe result for acl check
2025-10-10T14:37:54.184862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:54.184868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:54.184870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:54.184877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602322606439588:11092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:54.182766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:54.185361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602322606439588:11092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:54.184694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:54.184897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:54.184904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:54.184933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:54.184996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:54.185040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602321824207414:11280]
2025-10-10T14:37:54.185765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:54.186159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:54.186217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:54.186578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:54.186647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.186654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.186655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.186657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.186658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.186660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.186661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.186662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.186663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.186666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.186668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.186669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.186670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.186677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.186688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.186707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.186711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.186714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.186718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.186722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.186726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.186729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.186733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.186736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.186740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.186743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.186751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.186759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.186778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.186783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.186793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.186799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.186803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.186809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.186814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.186820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.186824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.186828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.186833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.186838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.186842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.186847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.186851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.186857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.186860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.186865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.186869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.186874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.186878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.186882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.186888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.186895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.186934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:54.187585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602322606439588:11092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:54.189325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:54.189675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:54.189688Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:54.189691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:54.189695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:54.189701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2482 [2:7559602321824207414:11280]
2025-10-10T14:37:54.189713Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:54.189730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:54.189737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.189740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.189744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.189760Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:54.189771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:54.189778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:54.189842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.189848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.189849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.189852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:54.189919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:54.189926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.189937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.189951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.189966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:54.189993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439553:2438], now have 1 active actors on pipe
2025-10-10T14:37:54.190001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602321824207408:11280]
2025-10-10T14:37:54.190007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602321824207408:11280]
2025-10-10T14:37:54.190009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602321824207408:11280]
2025-10-10T14:37:54.190021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:54.190035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:54.190041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:54.190045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:54.190048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:54.190055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:54.190058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:54.190079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602321824207408:11280]
2025-10-10T14:37:54.190089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:54.190095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:54.190104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2482
2025-10-10T14:37:54.190143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602322606439588:11092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:54.190188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602322606439588:11092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:54.190196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602322606439588:11092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:54.190204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:54.190410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2482
2025-10-10T14:37:54.190384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439622:11092], now have 1 active actors on pipe
2025-10-10T14:37:54.190477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.190489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.190517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:54.190529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.190538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.190540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:54.190551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.190566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:54.190586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.190802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.190809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.190822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.190917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2483 partition: 0 MaxSeqNo: 40 sessionId: src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0
2025-10-10T14:37:54.191298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c23dde-7f610071-efc24d8-69e1fba_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:54.194380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0] Write session: try to update token
2025-10-10T14:37:54.194402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:54.210012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:54.210036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:54.210040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:54.210042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:54.210053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602321824207408:11280]
2025-10-10T14:37:54.210058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602321824207408:11280]
2025-10-10T14:37:54.210065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602321824207408:11280]
2025-10-10T14:37:54.210118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:54.210129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:54.210133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.210135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:54.210137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:54.210156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:54.210291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:54.210771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2483 sessionId: src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:54.213529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:54.272492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602322606439629:10596]
2025-10-10T14:37:54.272915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2482, pipe: [1:7559602322606439629:10596]
2025-10-10T14:37:54.327338Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:54.327775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.327794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.327842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439629:10596], now have 1 active actors on pipe
2025-10-10T14:37:54.328107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:54.328089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:54.328161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:54.328164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:54.328176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602322606439629:10596]
2025-10-10T14:37:54.328233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2483 reason: error at write: Disconnected sessionId: src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0
2025-10-10T14:37:54.328457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2483 sessionId: src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0 is DEAD
2025-10-10T14:37:54.328610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:54.328619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0] Write session will restart in 0.006323s
2025-10-10T14:37:54.328647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0] Write session: Do CDS request
2025-10-10T14:37:54.328657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:54.335982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.336035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:54.336050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2484
2025-10-10T14:37:54.336244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.336294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:54.336305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:54.336309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:54.336828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2484 sessionId:  describe result for acl check
2025-10-10T14:37:54.336875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:54.336879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:54.336881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:54.336890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602322606439637:11096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:54.337511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602322606439637:11096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:54.343121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602322606439637:11096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:54.346747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602322606439637:11096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:54.346763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602322606439637:11096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:54.346767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602322606439637:11096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:54.346777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:54.350852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:54.353176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:54.353464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:54.353487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:54.353500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:54.353567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:54.353618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602321824207500:11283]
2025-10-10T14:37:54.354267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:54.354842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:54.354921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:54.355312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:54.355377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.355386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.355387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.355388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.355390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.355391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.355392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.355394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.355395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.355396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.355397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.355398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.355400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.355407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.355419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.355423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.355428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.355431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.355435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.355438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.355442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.355447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.355452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.355456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.355460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.355464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.355473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.355495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.355507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.355512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.355518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.355524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.355530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.355535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.355540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.355547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.355551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.355557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.355562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.355567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.355572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.355577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.355582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.355587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.355592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.355597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.355601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.355612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.355616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.355621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.355627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.355637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.355679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:54.358713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:54.359188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:54.359201Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:54.359204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:54.359209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:54.359218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2483 [2:7559602321824207500:11283]
2025-10-10T14:37:54.359235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:54.359264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:54.359268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.359271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.359274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.359292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:54.359299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:54.359310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:54.359376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.359378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.359379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.359382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:54.359458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:54.359723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2483
2025-10-10T14:37:54.359756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2483
2025-10-10T14:37:54.359461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.359473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.359485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.359501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:54.359526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602321824207495:11283]
2025-10-10T14:37:54.359528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602321824207495:11283]
2025-10-10T14:37:54.359530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602321824207495:11283]
2025-10-10T14:37:54.359539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:54.359552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:54.359555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:54.359556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:54.359558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:54.359570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:54.359573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:54.359588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439688:11096], now have 1 active actors on pipe
2025-10-10T14:37:54.359592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439630:2438], now have 1 active actors on pipe
2025-10-10T14:37:54.359624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602321824207495:11283]
2025-10-10T14:37:54.359631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:54.359938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:54.360021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.360034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.360079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b4323b-126f451-60b8c371-387ea4f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:54.360097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.360106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.360108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:54.360126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.360143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:54.360173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.360820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.360831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.360861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.360979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2484 partition: 0 MaxSeqNo: 40 sessionId: src_id|1b4323b-126f451-60b8c371-387ea4f2_0
2025-10-10T14:37:54.361515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb52ab-5919f1c3-b84f90b4-ed7be4af_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1b4323b-126f451-60b8c371-387ea4f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:54.369126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4323b-126f451-60b8c371-387ea4f2_0] Write session: try to update token
2025-10-10T14:37:54.369166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4323b-126f451-60b8c371-387ea4f2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:54.382831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:54.382852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:54.382856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:54.382861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:54.382873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602321824207495:11283]
2025-10-10T14:37:54.382877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602321824207495:11283]
2025-10-10T14:37:54.382881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602321824207495:11283]
2025-10-10T14:37:54.382938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:54.382946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.382948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:54.382951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:54.382960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:54.382965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:54.383124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:54.390769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2484 sessionId: src_id|1b4323b-126f451-60b8c371-387ea4f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:54.393485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:54.427630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602322606439719:10596]
2025-10-10T14:37:54.428006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2483, pipe: [1:7559602322606439719:10596]
2025-10-10T14:37:54.502108Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:54.502427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.502442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.502466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439719:10596], now have 1 active actors on pipe
2025-10-10T14:37:54.503086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:54.503131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602322606439719:10596]
2025-10-10T14:37:54.503166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:54.503243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2484 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b4323b-126f451-60b8c371-387ea4f2_0
2025-10-10T14:37:54.503457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2484 sessionId: src_id|1b4323b-126f451-60b8c371-387ea4f2_0 is DEAD
2025-10-10T14:37:54.503510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:54.503698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4323b-126f451-60b8c371-387ea4f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:54.503711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4323b-126f451-60b8c371-387ea4f2_0] Write session will restart in 0.008865s
2025-10-10T14:37:54.503736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4323b-126f451-60b8c371-387ea4f2_0] Write session: Do CDS request
2025-10-10T14:37:54.503743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4323b-126f451-60b8c371-387ea4f2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:54.513882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4323b-126f451-60b8c371-387ea4f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.514234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:54.514249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2485
2025-10-10T14:37:54.514915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:54.515395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.515446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:54.515453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:54.515457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:54.516142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2485 sessionId:  describe result for acl check
2025-10-10T14:37:54.516175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:54.516182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:54.516183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:54.516190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602322606439763:11102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:54.516605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:54.516806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:54.516816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:54.516829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:54.516887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:54.516937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602321824207585:11291]
2025-10-10T14:37:54.516642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602322606439763:11102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:54.517582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:54.517904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:54.517967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:54.518327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:54.518381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.518382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.518383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.518384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.518385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.518386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.518387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.518388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.518390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.518391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.518392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.518393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.518395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.518400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.518411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.518415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.518418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.518425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.518429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.518433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.518436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.518440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.518444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.518447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.518451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.518454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.518461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.518469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.518475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.518480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.518484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.518489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.518493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.518499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.518503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.518508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.518511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.518516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.518520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.518525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.518530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.518534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.518539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.518544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.518547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.518552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.518557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.518561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.518567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.518571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.518577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.518581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.518616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:54.518982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602322606439763:11102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:54.521283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:54.521717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:54.521734Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:54.521736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:54.521740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:54.521745Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2484 [2:7559602321824207585:11291]
2025-10-10T14:37:54.521757Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:54.521787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:54.521795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.521798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.521801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.521818Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:54.521825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:54.521837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:54.521893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.521899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.521901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.521903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:54.521969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:54.521978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.521988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.521998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.522012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:54.522033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602321824207580:11291]
2025-10-10T14:37:54.522035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602321824207580:11291]
2025-10-10T14:37:54.522037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602321824207580:11291]
2025-10-10T14:37:54.522046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:54.522054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:54.522057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:54.522058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:54.522065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439720:2438], now have 1 active actors on pipe
2025-10-10T14:37:54.522071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:54.522085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:54.522088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:54.522111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602321824207580:11291]
2025-10-10T14:37:54.522121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:54.522141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:54.522095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602322606439763:11102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:54.522109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602322606439763:11102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:54.522112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602322606439763:11102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:54.522120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:54.522305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2484
2025-10-10T14:37:54.522600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439804:11102], now have 1 active actors on pipe
2025-10-10T14:37:54.522671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2484
2025-10-10T14:37:54.522749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.522757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.522786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:54.522799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.522811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.522813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:54.522825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.522839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:54.522860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.523038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.523049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.523074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.523175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2485 partition: 0 MaxSeqNo: 40 sessionId: src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0
2025-10-10T14:37:54.523561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4323b-126f451-60b8c371-387ea4f2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:54.526422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0] Write session: try to update token
2025-10-10T14:37:54.526446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:54.537501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:54.537518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:54.537529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602321824207580:11291]
2025-10-10T14:37:54.537576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:54.537581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:54.537787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:54.537934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:54.538096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:54.538242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:54.538445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:54.538484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:54.545918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2485 sessionId: src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:54.548692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:54.549008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.549033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.549077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:54.549183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:54.556630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:54.556651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:54.556656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:54.556658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:54.556669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602321824207580:11291]
2025-10-10T14:37:54.556673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602321824207580:11291]
2025-10-10T14:37:54.556678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602321824207580:11291]
2025-10-10T14:37:54.556726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:54.556728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:54.556733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:54.556736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:54.556742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.556744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:54.556889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:54.605403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602322606439827:10596]
2025-10-10T14:37:54.609415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2484, pipe: [1:7559602322606439827:10596]
2025-10-10T14:37:54.675119Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:54.683830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.683862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.684060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.684130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.684208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.684275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.684548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.684561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.684636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.684704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.684774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.684841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.684888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.684897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.684966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.685029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.685090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.685157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.685204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.685211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.685282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.685372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.685440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.685507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.685555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.685565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.685634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.685704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.685770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.685837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.685889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.685898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.685969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.686036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.686101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.686167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.686216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.686226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.686296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.686363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.686431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.686497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.686547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.686554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.686627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.686704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.686768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.686831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.686877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.686888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.686958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.687023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.687088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.687153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.687200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.687207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.687279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:54.687341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:54.687407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:54.687472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:54.687522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:54.687530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:54.687601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439827:10596], now have 1 active actors on pipe
2025-10-10T14:37:54.687863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:54.687884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:54.687919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2485 reason: error at write: Disconnected sessionId: src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0
2025-10-10T14:37:54.688125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2485 sessionId: src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0 is DEAD
2025-10-10T14:37:54.688291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:54.688304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0] Write session will restart in 0.006627s
2025-10-10T14:37:54.688331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0] Write session: Do CDS request
2025-10-10T14:37:54.688338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:54.688327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:54.688398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602322606439827:10596]
2025-10-10T14:37:54.688605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:54.695976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.696076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:54.696092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2486
2025-10-10T14:37:54.696244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.696283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:54.696294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:54.696299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:54.696816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2486 sessionId:  describe result for acl check
2025-10-10T14:37:54.696867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:54.696874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:54.696876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:54.696882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602322606439867:11114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:54.697481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602322606439867:11114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:54.698154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:54.699922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:54.700177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:54.700192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:54.700205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:54.700269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:54.700316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602321824207687:11300]
2025-10-10T14:37:54.700587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602322606439867:11114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:54.700958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:54.701292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:54.701368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:54.701685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:54.701742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.701748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.701749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.701750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.701751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.701752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.701753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.701753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.701754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.701755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.701755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.701756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.701757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.701762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.701771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.701774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.701779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.701783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.701787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.701790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.701794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.701798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.701803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.701807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.701811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.701816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.701823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.701832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.701838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.701845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.701850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.701856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.701859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.701862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.701865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.701868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.701871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.701874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.701878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.701881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.701884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.701888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.701891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.701894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.701896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.701899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.701902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.701905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.701907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.701910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.701915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.701918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.701940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:54.704425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:54.704424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602322606439867:11114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:54.704453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602322606439867:11114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:54.704457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602322606439867:11114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:54.704467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:54.704736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:54.704749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:54.704752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:54.704755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:54.704762Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2485 [2:7559602321824207687:11300]
2025-10-10T14:37:54.704774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:54.704795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:54.704805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.704808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.704811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.704827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:54.704835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:54.704842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:54.704903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.704909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.704912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.704914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:54.704981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:54.704990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.705001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.705012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.705030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:54.705057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439832:2438], now have 1 active actors on pipe
2025-10-10T14:37:54.705069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439904:11114], now have 1 active actors on pipe
2025-10-10T14:37:54.705076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602321824207681:11300]
2025-10-10T14:37:54.705083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602321824207681:11300]
2025-10-10T14:37:54.705085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602321824207681:11300]
2025-10-10T14:37:54.705093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:54.705076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2485
2025-10-10T14:37:54.705107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:54.705113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:54.705116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:54.705082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2485
2025-10-10T14:37:54.705118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:54.705128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:54.705132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:54.705171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.705182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.705196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602321824207681:11300]
2025-10-10T14:37:54.705204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:54.705211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:54.705233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:54.705245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.705249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.705251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:54.705261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.705271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:54.705296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.705486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.705502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.705541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.705644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2486 partition: 0 MaxSeqNo: 40 sessionId: src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0
2025-10-10T14:37:54.706073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235ab01a-406c4ec6-2a1070a8-1f77e87a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:54.708880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0] Write session: try to update token
2025-10-10T14:37:54.708900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:54.723941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2486 sessionId: src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:54.725416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:54.725438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:54.725442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:54.725444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:54.725454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602321824207681:11300]
2025-10-10T14:37:54.725459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602321824207681:11300]
2025-10-10T14:37:54.725463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602321824207681:11300]
2025-10-10T14:37:54.725516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:54.725518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:54.725525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:54.725529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.725529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:54.725532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:54.725720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:54.726889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:54.789451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602322606439916:10596]
2025-10-10T14:37:54.790230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2485, pipe: [1:7559602322606439916:10596]
2025-10-10T14:37:54.842905Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:54.843274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.843293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.843342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439916:10596], now have 1 active actors on pipe
2025-10-10T14:37:54.844109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:54.845498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:54.845510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602322606439916:10596]
2025-10-10T14:37:54.845539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:54.845623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2486 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0
2025-10-10T14:37:54.846367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:54.846379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0] Write session will restart in 0.006235s
2025-10-10T14:37:54.846403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0] Write session: Do CDS request
2025-10-10T14:37:54.846409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:54.845831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2486 sessionId: src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0 is DEAD
2025-10-10T14:37:54.858069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.858143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:54.858162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2487
2025-10-10T14:37:54.858339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:54.858372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:54.858378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:54.858382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:54.858883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2487 sessionId:  describe result for acl check
2025-10-10T14:37:54.858917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:54.858920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:54.858921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:54.858929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602322606439941:11119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:54.859537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602322606439941:11119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:54.861824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602322606439941:11119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:54.863886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:54.865822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:54.866065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:54.866078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:54.866090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:54.866151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:54.866201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602321824207763:11302]
2025-10-10T14:37:54.866115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602322606439941:11119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:54.866132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602322606439941:11119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:54.866136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602322606439941:11119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:54.866144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:54.866861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:54.867481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:54.867551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:54.867952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:54.868013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.868019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.868020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.868022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.868023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.868047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.868049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.868051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.868053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.868054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.868055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.868056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.868058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.868065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.868078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.868082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.868087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.868090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.868095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.868098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.868101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.868104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.868108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.868112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.868116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.868120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.868129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.868137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:54.868143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.868149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:54.868154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.868159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:54.868185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.868196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:54.868202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.868207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:54.868213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.868219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:54.868224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.868229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:54.868233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.868238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:54.868242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.868247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:54.868251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.868258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:54.868262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.868267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.868286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.868297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.868302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.868306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.868350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:54.874026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:54.874466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:54.874481Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:54.874484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:54.874489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:54.874497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2486 [2:7559602321824207763:11302]
2025-10-10T14:37:54.874513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:54.874533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:54.874544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.874550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.874553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.874572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:54.874581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:54.874593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:54.874662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.874670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.874672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.874685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:54.874759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:54.874767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.874779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:54.874794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:54.874815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:54.874845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439998:11119], now have 1 active actors on pipe
2025-10-10T14:37:54.874854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606439920:2438], now have 1 active actors on pipe
2025-10-10T14:37:54.874862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602321824207758:11302]
2025-10-10T14:37:54.874865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602321824207758:11302]
2025-10-10T14:37:54.874867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602321824207758:11302]
2025-10-10T14:37:54.874880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:54.874897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:54.874914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:54.874917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:54.874924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:54.874928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:54.874930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:54.874957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602321824207758:11302]
2025-10-10T14:37:54.874971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:54.875009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:54.874964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2486
2025-10-10T14:37:54.874992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2486
2025-10-10T14:37:54.875045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.875056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.875089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:54.875104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:54.875111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:54.875113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:54.875125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:54.875140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:54.875162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.875324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.875332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.875349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:54.875455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2487 partition: 0 MaxSeqNo: 40 sessionId: src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0
2025-10-10T14:37:54.875870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2abd14c-46ce7351-d7f3d8b0-f17cf4cd_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:54.878728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0] Write session: try to update token
2025-10-10T14:37:54.878748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:54.886998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:54.887017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:54.887029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602321824207758:11302]
2025-10-10T14:37:54.887082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:54.887273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:54.887416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:54.887552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:54.887701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:54.887910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:54.887955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:54.888746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:54.897267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2487 sessionId: src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:54.900089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:54.901170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:54.901195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:54.901251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:54.901538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:54.934776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:54.934799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:54.934803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:54.934805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:54.934824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602321824207758:11302]
2025-10-10T14:37:54.934827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602321824207758:11302]
2025-10-10T14:37:54.934832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602321824207758:11302]
2025-10-10T14:37:54.934885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:54.934893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:54.934895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:54.935033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:54.937473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:54.937491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:54.937495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:54.945768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602322606440009:10596]
2025-10-10T14:37:54.946117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2486, pipe: [1:7559602322606440009:10596]
2025-10-10T14:37:55.057584Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:55.065870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.065902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.066087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.066153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.066219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.066281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.066326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.066334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.066397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.066461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.066521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.066603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.066657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.066665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.066756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.066823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.066893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.066961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.067007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.067014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.067081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.067146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.067209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.067272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.067316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.067323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.067392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.067453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.067525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.067594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.067642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.067648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.067719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.067784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.067849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.067916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.067963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.067970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.068041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.068107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.068172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.068236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.068281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.068289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.068358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.068420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.068481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.068549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.068598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.068605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.068675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.068735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.068797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.068858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.068908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.068917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.068981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:55.069046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:55.069115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:55.069184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:55.069672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602322606440009:10596]
2025-10-10T14:37:55.069726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:55.069729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:55.069772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2487 reason: error at write: Disconnected sessionId: src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0
2025-10-10T14:37:55.069973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2487 sessionId: src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0 is DEAD
2025-10-10T14:37:55.069983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:55.070441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:55.070452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0] Write session will restart in 0.007528s
2025-10-10T14:37:55.070477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0] Write session: Do CDS request
2025-10-10T14:37:55.070484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:55.069228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:55.069241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:55.069303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602322606440009:10596], now have 1 active actors on pipe
2025-10-10T14:37:55.070531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:55.079041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.079477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:55.079496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2488
2025-10-10T14:37:55.079683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.079725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:55.079738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:55.079743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:55.080373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2488 sessionId:  describe result for acl check
2025-10-10T14:37:55.080414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:55.080417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:55.080419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:55.080426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602326901407344:11123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:55.081264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602326901407344:11123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:55.083336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:55.084343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:55.084595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:55.084609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:55.084624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:55.084712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:55.084777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602326119175136:11304]
2025-10-10T14:37:55.084488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602326901407344:11123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:55.085433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:55.086120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:55.086181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:55.086533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:55.086614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.086620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.086622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.086623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.086624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.086626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.086627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.086628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.086630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.086631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.086632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.086633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.086634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.086641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.086653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.086657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.086661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.086665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.086669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.086685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.086688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.086692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.086696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.086700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.086703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.086706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.086715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.086726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.086733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.086739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.086742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.086747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.086763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.086768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.086772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.086777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.086787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.086792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.086797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.086802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.086807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.086812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.086817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.086827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.086832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.086837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.086841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.086847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.086851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.086856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.086863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.086867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.086905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:55.089572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:55.089926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:55.089938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:55.089942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:55.089946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:55.089953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2487 [2:7559602326119175136:11304]
2025-10-10T14:37:55.089967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:55.089988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:55.089998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.090001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.090003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.090019Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:55.090027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:55.090034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:55.090092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.090099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.090101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.089628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602326901407344:11123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:55.090103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:55.089646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602326901407344:11123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:55.089650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602326901407344:11123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:55.089660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:55.090171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:55.090178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.090188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.090199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.090220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:55.090241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602326119175130:11304]
2025-10-10T14:37:55.090248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602326119175130:11304]
2025-10-10T14:37:55.090249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602326119175130:11304]
2025-10-10T14:37:55.090259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:55.090273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:55.090293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:55.090300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:55.090326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602326119175130:11304]
2025-10-10T14:37:55.090332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:55.090365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407308:2438], now have 1 active actors on pipe
2025-10-10T14:37:55.090440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:55.090451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:55.090455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:55.090463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:55.090560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407380:11123], now have 1 active actors on pipe
2025-10-10T14:37:55.091026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2487
2025-10-10T14:37:55.091065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2487
2025-10-10T14:37:55.091416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.091431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.091477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:55.091492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.091498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.091500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:55.091512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.091528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:55.091562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.092170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.092182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.092203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.093049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2488 partition: 0 MaxSeqNo: 40 sessionId: src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0
2025-10-10T14:37:55.093482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bb7bbe6-878cb115-732d2397-d47e43c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:55.096382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0] Write session: try to update token
2025-10-10T14:37:55.096405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:55.112042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:55.112073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:55.112077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:55.112079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:55.112091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602326119175130:11304]
2025-10-10T14:37:55.112098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602326119175130:11304]
2025-10-10T14:37:55.112103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602326119175130:11304]
2025-10-10T14:37:55.112163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:55.112172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.112174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:55.112357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:55.113455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:55.113461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:55.113465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:55.122389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2488 sessionId: src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:55.125501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:55.173442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602326901407388:10596]
2025-10-10T14:37:55.177806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2487, pipe: [1:7559602326901407388:10596]
2025-10-10T14:37:55.234545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:55.235033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.235051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.235077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407388:10596], now have 1 active actors on pipe
2025-10-10T14:37:55.235326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:55.235453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:55.235507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:55.235589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2488 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0
2025-10-10T14:37:55.235679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602326901407388:10596]
2025-10-10T14:37:55.235782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2488 sessionId: src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0 is DEAD
2025-10-10T14:37:55.237446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:55.237460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0] Write session will restart in 0.009437s
2025-10-10T14:37:55.237489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0] Write session: Do CDS request
2025-10-10T14:37:55.237497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:55.247948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.248311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:55.248329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2489
2025-10-10T14:37:55.248449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.248488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:55.248495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:55.248499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:55.249071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2489 sessionId:  describe result for acl check
2025-10-10T14:37:55.249113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:55.249120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:55.249122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:55.249129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602326901407406:11127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:55.249777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602326901407406:11127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:55.252143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602326901407406:11127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:55.256298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602326901407406:11127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:55.256315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602326901407406:11127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:55.256319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602326901407406:11127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:55.256329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:55.259079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:55.260862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:55.261125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:55.261140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:55.261155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:55.261216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:55.261269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602326119175229:11307]
2025-10-10T14:37:55.261903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:55.262351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:55.262427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:55.262821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:55.262887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.262894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.262896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.262897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.262898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.262900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.262901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.262903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.262905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.262907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.262908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.262912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.262914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.262922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.262936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.262940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.262945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.262949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.262954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.262959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.262962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.262967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.262971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.262974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.262979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.262983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.262993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.263003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.263009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.263016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.263022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.263028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.263033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.263038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.263043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.263049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.263054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.263060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.263065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.263071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.263077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.263082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.263089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.263095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.263100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.263106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.263113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.263118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.263124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.263130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.263136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.263142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.263185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:55.268847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:55.269508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:55.269523Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:55.269526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:55.269534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:55.269543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2488 [2:7559602326119175229:11307]
2025-10-10T14:37:55.269561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:55.269585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:55.269598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.269603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.269607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.269632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:55.269653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:55.269664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:55.269751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.269761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.269763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.269766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:55.270016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:55.270035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.270050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.270042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2488
2025-10-10T14:37:55.270065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.270084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:55.270112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407390:2438], now have 1 active actors on pipe
2025-10-10T14:37:55.270117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407457:11127], now have 1 active actors on pipe
2025-10-10T14:37:55.270100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2488
2025-10-10T14:37:55.270133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602326119175223:11307]
2025-10-10T14:37:55.270145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602326119175223:11307]
2025-10-10T14:37:55.270148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602326119175223:11307]
2025-10-10T14:37:55.270164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:55.270177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:55.270190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:55.270195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:55.270198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:55.270210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:55.270221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:55.270241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.270251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.270318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602326119175223:11307]
2025-10-10T14:37:55.270339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:55.270369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:55.270384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.270389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.270393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:55.270397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:55.270407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.270429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:55.270493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.270778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.270795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.270822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.271331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2489 partition: 0 MaxSeqNo: 40 sessionId: src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0
2025-10-10T14:37:55.271763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d6653e6-a8f609bb-c7d3a6c0-ab4bf6f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:55.274779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0] Write session: try to update token
2025-10-10T14:37:55.274802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:55.295595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:55.295622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:55.295625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:55.295628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:55.295639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602326119175223:11307]
2025-10-10T14:37:55.295644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602326119175223:11307]
2025-10-10T14:37:55.295650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602326119175223:11307]
2025-10-10T14:37:55.295703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:55.295707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:55.295710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:55.295715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:55.295716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.295719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:55.295876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:55.300143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2489 sessionId: src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:55.302990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:55.335392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602326901407473:10596]
2025-10-10T14:37:55.335809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2488, pipe: [1:7559602326901407473:10596]
2025-10-10T14:37:55.420388Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:55.420735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.420760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.420814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407473:10596], now have 1 active actors on pipe
2025-10-10T14:37:55.421073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:55.421853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:55.421919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:55.422059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2489 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0
2025-10-10T14:37:55.422288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2489 sessionId: src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0 is DEAD
2025-10-10T14:37:55.422443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602326901407473:10596]
2025-10-10T14:37:55.422836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:55.422847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0] Write session will restart in 0.008574s
2025-10-10T14:37:55.422874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0] Write session: Do CDS request
2025-10-10T14:37:55.422881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:55.432967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.433541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:55.433556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2490
2025-10-10T14:37:55.434019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.434057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:55.434063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:55.434067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:55.434475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2490 sessionId:  describe result for acl check
2025-10-10T14:37:55.434504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:55.434505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:55.434508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:55.434514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602326901407499:11132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:55.435095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602326901407499:11132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:55.445113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602326901407499:11132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:55.454389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:55.460909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:55.461205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:55.461222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:55.461238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:55.461349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:55.461094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602326901407499:11132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:55.461114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602326901407499:11132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:55.461118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602326901407499:11132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:55.461129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:55.461405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602326119175309:11310]
2025-10-10T14:37:55.462081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:55.463190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:55.463253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:55.463634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:55.463705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.463706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.463708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.463710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.463711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.463713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.463714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.463716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.463718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.463719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.463721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.463723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.463724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.463732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.463748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.463756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.463761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.463766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.463770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.463774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.463778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.463782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.463786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.463789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.463792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.463796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.463805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.463814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.463820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.463825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.463829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.463835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.463839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.463845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.463850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.463856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.463861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.463869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.463874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.463880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.463884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.463890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.463896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.463901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.463906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.463912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.463919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.463925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.463930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.463935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.463942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.463947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.463990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:55.467201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:55.467573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:55.467590Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:55.467593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:55.467597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:55.467604Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2489 [2:7559602326119175309:11310]
2025-10-10T14:37:55.467620Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:55.468605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2489
2025-10-10T14:37:55.468605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2489
2025-10-10T14:37:55.467646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:55.467656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.467660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.467662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.467681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:55.467690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:55.467701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:55.467764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.467766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.467770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.467773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:55.467843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:55.467846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.467859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.467872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.467888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:55.467910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602326119175304:11310]
2025-10-10T14:37:55.467912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602326119175304:11310]
2025-10-10T14:37:55.467914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602326119175304:11310]
2025-10-10T14:37:55.467929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:55.467945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:55.467961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:55.467964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:55.467997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602326119175304:11310]
2025-10-10T14:37:55.467999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:55.468206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:55.468209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:55.468211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:55.468218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:55.469234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407488:2438], now have 1 active actors on pipe
2025-10-10T14:37:55.469249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407558:11132], now have 1 active actors on pipe
2025-10-10T14:37:55.469263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.469270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.469305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bc69507-527cead5-a357e2a-581edba5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:55.469322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.469347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.469350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:55.469364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.469385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:55.469409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.473672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.473692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.473732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.474687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1030175d-754c17ab-7165c710-bd9fd2a4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5bc69507-527cead5-a357e2a-581edba5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:55.474218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2490 partition: 0 MaxSeqNo: 40 sessionId: src_id|5bc69507-527cead5-a357e2a-581edba5_0
2025-10-10T14:37:55.477417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc69507-527cead5-a357e2a-581edba5_0] Write session: try to update token
2025-10-10T14:37:55.477433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc69507-527cead5-a357e2a-581edba5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:55.493709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:55.493734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:55.493738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:55.493745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:55.493757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602326119175304:11310]
2025-10-10T14:37:55.493760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602326119175304:11310]
2025-10-10T14:37:55.493764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602326119175304:11310]
2025-10-10T14:37:55.493820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:55.493826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:55.493833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.493834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:55.493836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:55.493839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:55.493987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:55.500242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2490 sessionId: src_id|5bc69507-527cead5-a357e2a-581edba5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:55.503236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:55.523463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602326901407570:10596]
2025-10-10T14:37:55.529552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2489, pipe: [1:7559602326901407570:10596]
2025-10-10T14:37:55.611662Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:55.611973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.611982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.612025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407570:10596], now have 1 active actors on pipe
2025-10-10T14:37:55.613552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:55.615902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc69507-527cead5-a357e2a-581edba5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:55.615914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc69507-527cead5-a357e2a-581edba5_0] Write session will restart in 0.007127s
2025-10-10T14:37:55.615938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc69507-527cead5-a357e2a-581edba5_0] Write session: Do CDS request
2025-10-10T14:37:55.615944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc69507-527cead5-a357e2a-581edba5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:55.614783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:55.614840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602326901407570:10596]
2025-10-10T14:37:55.614862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:55.614948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2490 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5bc69507-527cead5-a357e2a-581edba5_0
2025-10-10T14:37:55.615163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2490 sessionId: src_id|5bc69507-527cead5-a357e2a-581edba5_0 is DEAD
2025-10-10T14:37:55.625869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc69507-527cead5-a357e2a-581edba5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.632592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:55.629889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:55.629917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2491
2025-10-10T14:37:55.630102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.630159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:55.630164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:55.630168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:55.630910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2491 sessionId:  describe result for acl check
2025-10-10T14:37:55.630943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:55.630945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:55.630947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:55.630954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602326901407627:11142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:55.631540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602326901407627:11142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:55.635172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:55.635411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:55.635426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:55.635439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:55.635501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:55.635552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602326119175421:11323]
2025-10-10T14:37:55.634203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602326901407627:11142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:55.636267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:55.636724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:55.636789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:55.637171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:55.637250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.637261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.637262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.637264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.637265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.637267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.637268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.637270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.637271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.637272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.637274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.637275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.637276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.637285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.637299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.637304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.637308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.637315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.637319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.637323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.637327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.637350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.637353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.637357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.637361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.637365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.637374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.637383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.637390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.637395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.637400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.637406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.637410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.637414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.637418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.637422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.637426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.637431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.637435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.637442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.637446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.637450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.637455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.637462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.637466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.637470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.637475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.637480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.637486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.637491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.637495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.637499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.637541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:55.638524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602326901407627:11142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:55.638540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602326901407627:11142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:55.638544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602326901407627:11142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:55.638552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:55.641227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:55.641774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:55.641791Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:55.641794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:55.641798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:55.641805Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2490 [2:7559602326119175421:11323]
2025-10-10T14:37:55.641820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:55.641838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:55.641843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.641847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.641849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.641868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:55.641883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:55.641890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:55.641958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.641968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.641970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.641973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:55.642042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:55.642051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.642064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.642078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.642103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:55.642134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407670:11142], now have 1 active actors on pipe
2025-10-10T14:37:55.642145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407590:2438], now have 1 active actors on pipe
2025-10-10T14:37:55.642153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602326119175416:11323]
2025-10-10T14:37:55.642156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602326119175416:11323]
2025-10-10T14:37:55.642158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602326119175416:11323]
2025-10-10T14:37:55.642171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:55.642188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:55.642200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:55.642203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:55.642205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:55.642212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:55.642216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:55.642250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602326119175416:11323]
2025-10-10T14:37:55.642259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:55.642260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:55.642285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.642295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.642201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2490
2025-10-10T14:37:55.642235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2490
2025-10-10T14:37:55.642339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:55.642353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.642357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.642361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:55.642374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.642385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:55.642407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.642722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.642732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.642749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.642943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2491 partition: 0 MaxSeqNo: 40 sessionId: src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0
2025-10-10T14:37:55.643398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bc69507-527cead5-a357e2a-581edba5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:55.646217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0] Write session: try to update token
2025-10-10T14:37:55.646241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:55.662463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:55.662483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:55.662487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:55.662489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:55.662500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602326119175416:11323]
2025-10-10T14:37:55.662505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602326119175416:11323]
2025-10-10T14:37:55.662509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602326119175416:11323]
2025-10-10T14:37:55.662567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:55.662571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:55.662579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.662582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:55.662584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:55.662589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:55.662767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:55.665254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2491 sessionId: src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:55.667917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:55.714781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602326901407679:10596]
2025-10-10T14:37:55.715126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2490, pipe: [1:7559602326901407679:10596]
2025-10-10T14:37:55.780587Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:55.780917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.780935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.780985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407679:10596], now have 1 active actors on pipe
2025-10-10T14:37:55.781342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602326901407679:10596]
2025-10-10T14:37:55.781348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:55.781353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:55.781372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:55.781422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2491 reason: error at write: Disconnected sessionId: src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0
2025-10-10T14:37:55.781842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:55.781407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:55.781869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0] Write session will restart in 0.005775s
2025-10-10T14:37:55.781911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0] Write session: Do CDS request
2025-10-10T14:37:55.781918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:55.781617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2491 sessionId: src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0 is DEAD
2025-10-10T14:37:55.788892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.789008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:55.789022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2492
2025-10-10T14:37:55.789125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.789165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:55.789172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:55.789176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:55.789604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2492 sessionId:  describe result for acl check
2025-10-10T14:37:55.789644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:55.789658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:55.789660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:55.789668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602326901407701:11150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:55.790251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602326901407701:11150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:55.793482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602326901407701:11150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:55.793994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:55.797017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:55.797279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:55.797285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:55.797300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:55.797391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:55.797431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602326119175508:11327]
2025-10-10T14:37:55.798042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:55.798382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:55.798428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:55.798706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:55.798758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.798764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.798765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.798766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.798767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.798769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.798770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.798771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.798772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.798773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.798774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.798775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.798776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.798783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.798798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.798802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.798806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.798810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.798815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.798821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.798825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.798829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.798834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.798838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.798840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.798844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.798853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.798862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.798868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.798874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.798878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.798884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.798890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.798895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.798900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.798713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602326901407701:11150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:55.798730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602326901407701:11150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:55.798734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602326901407701:11150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:55.798743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:55.798906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.798910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.798914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.798917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.798920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.798923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.798926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.798929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.798933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.798935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.798938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.798941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.798944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.798948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.798952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.798955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.798958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.798984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:55.803188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:55.803520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:55.803535Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:55.803537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:55.803541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:55.803548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2491 [2:7559602326119175508:11327]
2025-10-10T14:37:55.803562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:55.803581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:55.803587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.803591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.803594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.803613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:55.803621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:55.803629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:55.803697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.803708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.803710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.803713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:55.803795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:55.803804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.803827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.803845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.803872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:55.803898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602326119175502:11327]
2025-10-10T14:37:55.803905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602326119175502:11327]
2025-10-10T14:37:55.803907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602326119175502:11327]
2025-10-10T14:37:55.803922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:55.803943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:55.803964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:55.803966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:55.803970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:55.803971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:55.803973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:55.804005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602326119175502:11327]
2025-10-10T14:37:55.804012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:55.804330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2491
2025-10-10T14:37:55.804375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2491
2025-10-10T14:37:55.804053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:55.804273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407686:2438], now have 1 active actors on pipe
2025-10-10T14:37:55.804278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407761:11150], now have 1 active actors on pipe
2025-10-10T14:37:55.804479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.804485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.804518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbd086-85c008b0-75a6f388-d50fda10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:55.804528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.804533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.804536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:55.804550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.804578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:55.804594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.804885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.804899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.804923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.808197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2492 partition: 0 MaxSeqNo: 40 sessionId: src_id|fbd086-85c008b0-75a6f388-d50fda10_0
2025-10-10T14:37:55.808710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26cb1873-30ae281b-a0637fcc-4e2a6cd6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fbd086-85c008b0-75a6f388-d50fda10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:55.811677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd086-85c008b0-75a6f388-d50fda10_0] Write session: try to update token
2025-10-10T14:37:55.811697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd086-85c008b0-75a6f388-d50fda10_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:55.835751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:55.835773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:55.835777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:55.835780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:55.835791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602326119175502:11327]
2025-10-10T14:37:55.835797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602326119175502:11327]
2025-10-10T14:37:55.835806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602326119175502:11327]
2025-10-10T14:37:55.835858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:55.835861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:55.835865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:55.835869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:55.835869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.835872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:55.836020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:55.844387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2492 sessionId: src_id|fbd086-85c008b0-75a6f388-d50fda10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:55.846996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:55.881663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602326901407774:10596]
2025-10-10T14:37:55.882070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2491, pipe: [1:7559602326901407774:10596]
2025-10-10T14:37:55.960003Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:55.960358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.960371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.960428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407774:10596], now have 1 active actors on pipe
2025-10-10T14:37:55.960770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602326901407774:10596]
2025-10-10T14:37:55.960797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:55.960829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:55.960894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2492 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fbd086-85c008b0-75a6f388-d50fda10_0
2025-10-10T14:37:55.961071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2492 sessionId: src_id|fbd086-85c008b0-75a6f388-d50fda10_0 is DEAD
2025-10-10T14:37:55.961395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd086-85c008b0-75a6f388-d50fda10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:55.961404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd086-85c008b0-75a6f388-d50fda10_0] Write session will restart in 0.005900s
2025-10-10T14:37:55.961422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd086-85c008b0-75a6f388-d50fda10_0] Write session: Do CDS request
2025-10-10T14:37:55.961427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd086-85c008b0-75a6f388-d50fda10_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:55.960717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:55.968876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd086-85c008b0-75a6f388-d50fda10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.969132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:55.969150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2493
2025-10-10T14:37:55.969263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:55.969314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:55.969326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:55.969342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:55.971082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2493 sessionId:  describe result for acl check
2025-10-10T14:37:55.971123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:55.971129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:55.971134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:55.971139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602326901407786:11154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:55.971738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602326901407786:11154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:55.974016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602326901407786:11154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:55.978005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602326901407786:11154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:55.978021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602326901407786:11154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:55.978025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602326901407786:11154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:55.978034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:55.981082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:55.981952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:55.982182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:55.982215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:55.982230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:55.982301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:55.982350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602326119175592:11329]
2025-10-10T14:37:55.982995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:55.983354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:55.983412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:55.983792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:55.983864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.983873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.983874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.983876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.983877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.983878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.983880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.983881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.983882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.983884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.983885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.983886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.983887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.983895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.983908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.983912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.983917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.983920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.983924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.983928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.983936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.983940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.983947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.983952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.983956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.983960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.983970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.983979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:55.983987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.983994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:55.983999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.984005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:55.984009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.984015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:55.984022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.984028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:55.984033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.984039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:55.984044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.984050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:55.984055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.984061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:55.984066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.984073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:55.984079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.984085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:55.984089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.984095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.984099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.984104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.984109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.984118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.984162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:55.986793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:55.987264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:55.987278Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:55.987281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:55.987285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:55.987292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2492 [2:7559602326119175592:11329]
2025-10-10T14:37:55.987307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:55.987341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:55.987352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.987357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.987359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.987377Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:55.987385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:55.987396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:55.987466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.987474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.987476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.987479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:55.987554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:55.987563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:55.987576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:55.987589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:55.987614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:55.987643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407820:11154], now have 1 active actors on pipe
2025-10-10T14:37:55.987652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602326901407778:2438], now have 1 active actors on pipe
2025-10-10T14:37:55.987659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602326119175587:11329]
2025-10-10T14:37:55.987662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602326119175587:11329]
2025-10-10T14:37:55.987665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602326119175587:11329]
2025-10-10T14:37:55.987681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:55.987695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:55.987716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:55.987718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:55.987722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:55.987671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2492
2025-10-10T14:37:55.987726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:55.987680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2492
2025-10-10T14:37:55.987728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:55.987752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602326119175587:11329]
2025-10-10T14:37:55.987755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:55.987759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:55.987787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.987797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.987836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:55.987848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:55.987851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:55.987854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:55.987868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:55.987883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:55.987910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.988115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:55.988128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:55.988168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:55.988285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2493 partition: 0 MaxSeqNo: 40 sessionId: src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0
2025-10-10T14:37:55.988693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd086-85c008b0-75a6f388-d50fda10_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:55.991494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0] Write session: try to update token
2025-10-10T14:37:55.991511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:56.008428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:56.008450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:56.008453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:56.008456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:56.008467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602326119175587:11329]
2025-10-10T14:37:56.008472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602326119175587:11329]
2025-10-10T14:37:56.008476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602326119175587:11329]
2025-10-10T14:37:56.008523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:56.008531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:56.008539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:56.008540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.008542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:56.008543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:56.009081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:56.010208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2493 sessionId: src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:56.017962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:56.060891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602331196375158:10596]
2025-10-10T14:37:56.061215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2492, pipe: [1:7559602331196375158:10596]
2025-10-10T14:37:56.134358Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:56.134685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.134701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.134748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375158:10596], now have 1 active actors on pipe
2025-10-10T14:37:56.134933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:56.134949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:56.134988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:56.135013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2493 reason: error at write: Disconnected sessionId: src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0
2025-10-10T14:37:56.135045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602331196375158:10596]
2025-10-10T14:37:56.135229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2493 sessionId: src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0 is DEAD
2025-10-10T14:37:56.136383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:56.137666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:56.137678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0] Write session will restart in 0.007679s
2025-10-10T14:37:56.137717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0] Write session: Do CDS request
2025-10-10T14:37:56.137727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:56.147018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.147596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:56.147838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:56.147855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2494
2025-10-10T14:37:56.148004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.148052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:56.148062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:56.148067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:56.148568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2494 sessionId:  describe result for acl check
2025-10-10T14:37:56.148601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:56.148608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:56.148611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:56.148627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602331196375236:11158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:56.148686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:56.148902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:56.148913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:56.148927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:56.148996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:56.149042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602330414142972:11332]
2025-10-10T14:37:56.149228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602331196375236:11158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:56.149739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:56.150159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:56.150228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:56.150604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:56.150683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.150688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.150690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.150691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.150692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.150694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.150695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.150696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.150698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.150699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.150700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.150703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.150704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.150711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.150722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.150726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.150729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.150732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.150736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.150740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.150743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.150747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.150751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.150754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.150758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.150761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.150769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.150778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.150785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.150790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.150793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.150798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.150803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.150807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.150812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.150817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.150821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.150826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.150830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.150835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.150847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.150853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.150859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.150864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.150868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.150872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.150879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.150883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.150889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.150893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.150897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.150901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.150938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:56.151488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602331196375236:11158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:56.153377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:56.153927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:56.153940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:56.153943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:56.153947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:56.153954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2493 [2:7559602330414142972:11332]
2025-10-10T14:37:56.153969Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:56.153989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:56.153993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.153996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.153999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.154034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:56.154043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:56.154051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:56.154121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.154123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.154125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.154128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:56.154203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:56.154211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.154225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.154243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.154267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:56.154308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375162:2438], now have 1 active actors on pipe
2025-10-10T14:37:56.154317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602330414142967:11332]
2025-10-10T14:37:56.154319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602330414142967:11332]
2025-10-10T14:37:56.154321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602330414142967:11332]
2025-10-10T14:37:56.154335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:56.154353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:56.154353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:56.154357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:56.154360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:56.154377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:56.154384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:56.154419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602330414142967:11332]
2025-10-10T14:37:56.154430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:56.154436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:56.155068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375268:11158], now have 1 active actors on pipe
2025-10-10T14:37:56.155134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.155146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.155194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6063c1b0-a181ec6-87a8cc81-95826289_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:56.155208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.155212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.155217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:56.155229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.155246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:56.155270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.155482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.155492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.155521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.156084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4d5aa2-21e48256-226b31cb-eabc22f6_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6063c1b0-a181ec6-87a8cc81-95826289_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:56.154462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602331196375236:11158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:56.154479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602331196375236:11158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:56.154483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602331196375236:11158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:56.154492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:56.154876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2493
2025-10-10T14:37:56.155056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2493
2025-10-10T14:37:56.155632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2494 partition: 0 MaxSeqNo: 40 sessionId: src_id|6063c1b0-a181ec6-87a8cc81-95826289_0
2025-10-10T14:37:56.158951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6063c1b0-a181ec6-87a8cc81-95826289_0] Write session: try to update token
2025-10-10T14:37:56.158970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6063c1b0-a181ec6-87a8cc81-95826289_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:56.175296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:56.175327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:56.175331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:56.175333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:56.175346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602330414142967:11332]
2025-10-10T14:37:56.175351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602330414142967:11332]
2025-10-10T14:37:56.175354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602330414142967:11332]
2025-10-10T14:37:56.175409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:56.175414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:56.175421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:56.175423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.175426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:56.175428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:56.175577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:56.174254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2494 sessionId: src_id|6063c1b0-a181ec6-87a8cc81-95826289_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:56.176959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:56.237429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602331196375277:10596]
2025-10-10T14:37:56.237817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2493, pipe: [1:7559602331196375277:10596]
2025-10-10T14:37:56.303077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:56.303084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:56.303097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:56.303148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602331196375277:10596]
2025-10-10T14:37:56.303168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2494 reason: error at write: Disconnected sessionId: src_id|6063c1b0-a181ec6-87a8cc81-95826289_0
2025-10-10T14:37:56.303298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2494 sessionId: src_id|6063c1b0-a181ec6-87a8cc81-95826289_0 is DEAD
2025-10-10T14:37:56.302400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:56.302759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.302770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.302816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375277:10596], now have 1 active actors on pipe
2025-10-10T14:37:56.303078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:56.305545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6063c1b0-a181ec6-87a8cc81-95826289_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:56.305578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6063c1b0-a181ec6-87a8cc81-95826289_0] Write session will restart in 0.006649s
2025-10-10T14:37:56.305613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6063c1b0-a181ec6-87a8cc81-95826289_0] Write session: Do CDS request
2025-10-10T14:37:56.305620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6063c1b0-a181ec6-87a8cc81-95826289_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:56.313898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6063c1b0-a181ec6-87a8cc81-95826289_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.313966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:56.313984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2495
2025-10-10T14:37:56.314123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.314167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:56.314174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:56.314178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:56.314824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2495 sessionId:  describe result for acl check
2025-10-10T14:37:56.314860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:56.314863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:56.314865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:56.314874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602331196375350:11162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:56.315455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602331196375350:11162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:56.314350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:56.315360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:56.315563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:56.315568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:56.315580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:56.315631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:56.315692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602330414143067:11335]
2025-10-10T14:37:56.316325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:56.316729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:56.316770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:56.317090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:56.317143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.317144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.317145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.317146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.317147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.317148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.317149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.317151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.317152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.317153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.317154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.317155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.317156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.317163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.317176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.317181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.317185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.317190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.317194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.317199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.317203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.317207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.317212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.317218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.317222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.317226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.317233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.317243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.317249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.317255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.317259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.317265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.317269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.317275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.317280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.317286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.317290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.317296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.317301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.317308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.317312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.317320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.317324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.317349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.317355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.317361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.317366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.317372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.317381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.317386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.317393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.317398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.317443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:56.317835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602331196375350:11162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:56.319984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:56.320473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:56.320494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:56.320497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:56.320502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:56.320508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2494 [2:7559602330414143067:11335]
2025-10-10T14:37:56.320519Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:56.320537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:56.320540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.320543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.320547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.320563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:56.320576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:56.320583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:56.320636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602331196375350:11162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:56.320651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602331196375350:11162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:56.320655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602331196375350:11162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:56.320663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:56.320646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.320657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.320659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.320662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:56.320735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:56.320738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.320752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.320765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.320793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:56.320821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2494
2025-10-10T14:37:56.320821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375278:2438], now have 1 active actors on pipe
2025-10-10T14:37:56.320840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602330414143062:11335]
2025-10-10T14:37:56.320843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602330414143062:11335]
2025-10-10T14:37:56.320846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602330414143062:11335]
2025-10-10T14:37:56.320860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:56.320874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:56.320887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:56.320890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:56.320892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:56.320898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:56.320902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:56.320961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602330414143062:11335]
2025-10-10T14:37:56.320974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:56.320971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2494
2025-10-10T14:37:56.320980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375384:11162], now have 1 active actors on pipe
2025-10-10T14:37:56.320984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:56.321078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.321089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.321121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd8918fc-96e61045-3842e201-c8614c17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:56.321135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.321145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.321148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:56.321159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.321174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:56.321193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.321399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.321412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.321437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.321538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2495 partition: 0 MaxSeqNo: 40 sessionId: src_id|dd8918fc-96e61045-3842e201-c8614c17_0
2025-10-10T14:37:56.321948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6063c1b0-a181ec6-87a8cc81-95826289_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|dd8918fc-96e61045-3842e201-c8614c17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:56.325454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8918fc-96e61045-3842e201-c8614c17_0] Write session: try to update token
2025-10-10T14:37:56.325477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8918fc-96e61045-3842e201-c8614c17_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:56.340857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:56.340880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:56.340886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:56.340888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:56.340899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602330414143062:11335]
2025-10-10T14:37:56.340904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602330414143062:11335]
2025-10-10T14:37:56.340908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602330414143062:11335]
2025-10-10T14:37:56.340967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:56.340976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.340985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:56.341008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:56.341015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:56.341020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:56.341127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:56.344421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2495 sessionId: src_id|dd8918fc-96e61045-3842e201-c8614c17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:56.347123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:56.403411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602331196375407:10596]
2025-10-10T14:37:56.403881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2494, pipe: [1:7559602331196375407:10596]
2025-10-10T14:37:56.468457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:56.468486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602331196375407:10596]
2025-10-10T14:37:56.468521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:56.468524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:56.467829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:56.468137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.468148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.468192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375407:10596], now have 1 active actors on pipe
2025-10-10T14:37:56.468387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:56.468952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8918fc-96e61045-3842e201-c8614c17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:56.468963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8918fc-96e61045-3842e201-c8614c17_0] Write session will restart in 0.008221s
2025-10-10T14:37:56.468980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8918fc-96e61045-3842e201-c8614c17_0] Write session: Do CDS request
2025-10-10T14:37:56.468985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8918fc-96e61045-3842e201-c8614c17_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:56.468591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2495 reason: error at write: Disconnected sessionId: src_id|dd8918fc-96e61045-3842e201-c8614c17_0
2025-10-10T14:37:56.468811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2495 sessionId: src_id|dd8918fc-96e61045-3842e201-c8614c17_0 is DEAD
2025-10-10T14:37:56.478876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8918fc-96e61045-3842e201-c8614c17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.478962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:56.478980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2496
2025-10-10T14:37:56.479141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.479178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:56.479184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:56.479188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:56.479726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2496 sessionId:  describe result for acl check
2025-10-10T14:37:56.479764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:56.479771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:56.479774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:56.479781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602331196375476:11169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:56.480368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602331196375476:11169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:56.482983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602331196375476:11169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:56.483342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:56.483971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:56.484194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:56.484199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:56.484212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:56.484268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:56.484306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602330414143153:11337]
2025-10-10T14:37:56.484938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:56.485282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:56.485345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:56.485717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:56.485770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.485771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.485772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.485774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.485775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.485776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.485777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.485779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.485780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.485781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.485782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.485783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.485784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.485791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.485804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.485809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.485813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.485818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.485821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.485825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.485830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.485834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.485838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.485842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.485846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.485851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.485857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.485866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.485874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.485880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.485887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.485893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.485898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.485904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.485909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.485915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.485920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.485926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.485930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.485936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.485941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.485947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.485953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.485960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.485964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.485971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.485975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.485981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.485986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.485992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.485998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.486003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.486044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:56.486185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602331196375476:11169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:56.486198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602331196375476:11169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:56.486202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602331196375476:11169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:56.486211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:56.488702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:56.489174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:56.489179Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:56.489182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:56.489186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:56.489193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2495 [2:7559602330414143153:11337]
2025-10-10T14:37:56.489211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:56.489231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:56.489234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.489238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.489240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.489257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:56.489267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:56.489275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:56.489362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.489364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.489366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.489369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:56.489443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:56.489446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.489458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.489471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.489487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:56.489509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375408:2438], now have 1 active actors on pipe
2025-10-10T14:37:56.489512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375514:11169], now have 1 active actors on pipe
2025-10-10T14:37:56.489522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602330414143148:11337]
2025-10-10T14:37:56.489536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602330414143148:11337]
2025-10-10T14:37:56.489538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602330414143148:11337]
2025-10-10T14:37:56.489552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:56.489567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:56.489585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:56.489590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:56.489594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:56.489597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:56.489598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:56.489617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602330414143148:11337]
2025-10-10T14:37:56.489620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:56.489622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:56.489569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2495
2025-10-10T14:37:56.489609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2495
2025-10-10T14:37:56.489916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.489927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.489970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:56.490014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.490019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.490022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:56.490033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.490045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:56.490061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.490223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.490230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.490257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.490345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2496 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0
2025-10-10T14:37:56.490874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8918fc-96e61045-3842e201-c8614c17_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:56.493573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0] Write session: try to update token
2025-10-10T14:37:56.493595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:56.518504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:56.518529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:56.518533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:56.518535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:56.518547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602330414143148:11337]
2025-10-10T14:37:56.518552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602330414143148:11337]
2025-10-10T14:37:56.518556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602330414143148:11337]
2025-10-10T14:37:56.518611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:56.518619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.518622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:56.518625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:56.518633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:56.518639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:56.518780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:56.521138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2496 sessionId: src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:56.523857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:56.569497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602331196375523:10596]
2025-10-10T14:37:56.569873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2495, pipe: [1:7559602331196375523:10596]
2025-10-10T14:37:56.632745Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:56.633455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.633473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.633521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375523:10596], now have 1 active actors on pipe
2025-10-10T14:37:56.633685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:56.637984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602331196375523:10596]
2025-10-10T14:37:56.638023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:56.638082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:56.638182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2496 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0
2025-10-10T14:37:56.638420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2496 sessionId: src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0 is DEAD
2025-10-10T14:37:56.642556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:56.642572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0] Write session will restart in 0.008088s
2025-10-10T14:37:56.642598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0] Write session: Do CDS request
2025-10-10T14:37:56.642604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:56.653826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.654098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:56.654115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2497
2025-10-10T14:37:56.654290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.654320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:56.654325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:56.654329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:56.654951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2497 sessionId:  describe result for acl check
2025-10-10T14:37:56.654980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:56.654981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:56.654983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:56.654990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602331196375610:11179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:56.655522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602331196375610:11179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:56.659112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602331196375610:11179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:56.665042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602331196375610:11179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:56.665060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602331196375610:11179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:56.665064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602331196375610:11179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:56.665076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:56.661953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:56.665125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:56.665443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:56.665461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:56.665476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:56.665561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:56.665719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602330414143252:11345]
2025-10-10T14:37:56.666363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:56.666717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:56.666761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:56.667068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:56.667127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.667128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.667129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.667130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.667132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.667133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.667134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.667135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.667136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.667137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.667139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.667140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.667141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.667147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.667158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.667162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.667165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.667169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.667173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.667176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.667179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.667183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.667186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.667190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.667193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.667196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.667203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.667212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.667219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.667224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.667230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.667236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.667240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.667245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.667250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.667255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.667260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.667265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.667269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.667276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.667279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.667284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.667288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.667293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.667296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.667300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.667304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.667309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.667312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.667317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.667320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.667325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.667360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:56.671105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2496
2025-10-10T14:37:56.671155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2496
2025-10-10T14:37:56.669985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:56.670702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:56.670707Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:56.670709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:56.670712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:56.670718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2496 [2:7559602330414143252:11345]
2025-10-10T14:37:56.670730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:56.670747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:56.670751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.670753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.670756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.670771Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:56.670779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:56.670785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:56.670842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.670843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.670845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.670847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:56.670918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:56.670921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.670933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.670944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.670959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:56.670982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375524:2438], now have 1 active actors on pipe
2025-10-10T14:37:56.670990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602330414143247:11345]
2025-10-10T14:37:56.670992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602330414143247:11345]
2025-10-10T14:37:56.670994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602330414143247:11345]
2025-10-10T14:37:56.671009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:56.671017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375641:11179], now have 1 active actors on pipe
2025-10-10T14:37:56.671020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:56.671023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:56.671025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:56.671025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:56.671040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:56.671044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:56.671070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602330414143247:11345]
2025-10-10T14:37:56.671077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:56.671082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:56.671260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.671267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.671298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|729c7a7f-652fde67-6de599f0-e5d56065_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:56.671308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.671312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.671314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:56.671326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.671338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:56.671353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.671670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.671674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.671691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.671817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2497 partition: 0 MaxSeqNo: 40 sessionId: src_id|729c7a7f-652fde67-6de599f0-e5d56065_0
2025-10-10T14:37:56.677494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f03f74-3df192c0-7c0de32-8c3702d2_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|729c7a7f-652fde67-6de599f0-e5d56065_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:56.680260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729c7a7f-652fde67-6de599f0-e5d56065_0] Write session: try to update token
2025-10-10T14:37:56.680276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729c7a7f-652fde67-6de599f0-e5d56065_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:56.687752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:56.687775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:56.687786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602330414143247:11345]
2025-10-10T14:37:56.687837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:56.687839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:56.688041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:56.688192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:56.688340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:56.688502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:56.688735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:56.688779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:56.700842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2497 sessionId: src_id|729c7a7f-652fde67-6de599f0-e5d56065_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:56.703619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:56.704037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.704065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.704107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:56.704254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:56.712389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:56.712412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:56.712416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:56.712418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:56.712431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602330414143247:11345]
2025-10-10T14:37:56.712436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602330414143247:11345]
2025-10-10T14:37:56.712440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602330414143247:11345]
2025-10-10T14:37:56.712497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:56.712507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.712510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:56.712509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:56.712516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:56.712521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:56.712648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:56.738260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602331196375665:10596]
2025-10-10T14:37:56.738583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2496, pipe: [1:7559602331196375665:10596]
2025-10-10T14:37:56.835852Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:56.844545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.844578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.844758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.844820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.844883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.844953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.845064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.845075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.845143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.845210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.845273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.845764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.845817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.845827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.845894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.845956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.846022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.846088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.846132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.846145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.846207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.846272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.846401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.846467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.846511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.846518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.846581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.846650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.846715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.846777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.846822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.846832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.846897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.846960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.847022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.847084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.847128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.847137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.847216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.847269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.847332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.847395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.847440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.847451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.847518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.847581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.847641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.847703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.847745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.847752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.847814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.847874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.847940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.848004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.848054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.848062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.848127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:56.848186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:56.848245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:56.848308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:56.848351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:56.848358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:56.848425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375665:10596], now have 1 active actors on pipe
2025-10-10T14:37:56.848726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:56.848753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602331196375665:10596]
2025-10-10T14:37:56.848785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:56.848788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:56.848834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2497 reason: error at write: Disconnected sessionId: src_id|729c7a7f-652fde67-6de599f0-e5d56065_0
2025-10-10T14:37:56.849076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2497 sessionId: src_id|729c7a7f-652fde67-6de599f0-e5d56065_0 is DEAD
2025-10-10T14:37:56.849127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:56.849254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729c7a7f-652fde67-6de599f0-e5d56065_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:56.849261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729c7a7f-652fde67-6de599f0-e5d56065_0] Write session will restart in 0.009751s
2025-10-10T14:37:56.849285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729c7a7f-652fde67-6de599f0-e5d56065_0] Write session: Do CDS request
2025-10-10T14:37:56.849291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729c7a7f-652fde67-6de599f0-e5d56065_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:56.858913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:56.859665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:56.859902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|729c7a7f-652fde67-6de599f0-e5d56065_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.859999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:56.860026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2498
2025-10-10T14:37:56.860189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:56.860232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:56.860242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:56.860247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:56.860708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2498 sessionId:  describe result for acl check
2025-10-10T14:37:56.860751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:56.860753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:56.859920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:56.860755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:56.859934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:56.859948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:56.860003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:56.860059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602330414143363:11354]
2025-10-10T14:37:56.860761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602331196375753:11187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:56.860726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:56.861011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:56.861060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:56.861316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602331196375753:11187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:56.861417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:56.861491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.861501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.861502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.861504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.861505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.861506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.861508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.861509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.861511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.861512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.861513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.861515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.861516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.861522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.861535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.861539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.861545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.861552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.861557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.861562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.861566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.861570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.861575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.861580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.861584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.861589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.861596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.861605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:56.861611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.861618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:56.861622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.861627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:56.861642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.861648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:56.861653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.861659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:56.861663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.861669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:56.861674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.861680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:56.861685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.861691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:56.861696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.861702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:56.861706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.861712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:56.861717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.861722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.861727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.861733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.861738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.861743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.861782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:56.864212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:56.864345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602331196375753:11187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:56.864602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:56.864614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:56.864617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:56.864620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:56.864626Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2497 [2:7559602330414143363:11354]
2025-10-10T14:37:56.864640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:56.864656Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:56.864664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.864668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.864670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.864688Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:56.864701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:56.864708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:56.864764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.864772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.864774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.864776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:56.864848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:56.864856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.864870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:56.864883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:56.864905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:56.864932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375677:2438], now have 1 active actors on pipe
2025-10-10T14:37:56.864945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602330414143358:11354]
2025-10-10T14:37:56.864947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602330414143358:11354]
2025-10-10T14:37:56.864949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602330414143358:11354]
2025-10-10T14:37:56.864962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:56.864981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:56.864983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:56.864966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2497
2025-10-10T14:37:56.864995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:56.864997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:56.865000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:56.865001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:56.865026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602330414143358:11354]
2025-10-10T14:37:56.865034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:56.865062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:56.870242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602331196375753:11187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:56.870259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602331196375753:11187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:56.870264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602331196375753:11187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:56.870273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:56.870515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375791:11187], now have 1 active actors on pipe
2025-10-10T14:37:56.870577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2497
2025-10-10T14:37:56.870971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.870984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.871020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:56.871038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:56.871049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:56.871052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:56.871067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:56.871091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:56.871114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.871320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.871329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.871346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:56.871455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2498 partition: 0 MaxSeqNo: 40 sessionId: src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0
2025-10-10T14:37:56.871896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|729c7a7f-652fde67-6de599f0-e5d56065_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:56.874908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0] Write session: try to update token
2025-10-10T14:37:56.874928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:56.876879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:56.876899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:56.876910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602330414143358:11354]
2025-10-10T14:37:56.876951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:56.876959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:56.877156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:56.877311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:56.877489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:56.877642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:56.877860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:56.877901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:56.890851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2498 sessionId: src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:56.893725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:56.893964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:56.893987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:56.894031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:56.894155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:56.896791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:56.896816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:56.896819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:56.896822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:56.896835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602330414143358:11354]
2025-10-10T14:37:56.896839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602330414143358:11354]
2025-10-10T14:37:56.896843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602330414143358:11354]
2025-10-10T14:37:56.896902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:56.896908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:56.896914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:56.896915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:56.896917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:56.896918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:56.897072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:56.948682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602331196375794:10596]
2025-10-10T14:37:56.949590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2497, pipe: [1:7559602331196375794:10596]
2025-10-10T14:37:57.018577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:57.027496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.027533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.027743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.027812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.027881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.027952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.028137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.028143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.028221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.028279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.028345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.028431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.028470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.028473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.028565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.028617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.028672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.028726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.028763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.028766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.028827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.028887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.028954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.029027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.029066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.029068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.029135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.029189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.029246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.029304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.029404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.029410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.029488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.029549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.029625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.029697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.029747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.029756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.029832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.029897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.029985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.030057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.030103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.030110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.030191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.030253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.030318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.030382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.030429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.030436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.030503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.030828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.030894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.030963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.031010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.031017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.031082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:57.031144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:57.031211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:57.031277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:57.031323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:57.031330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:57.031396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602331196375794:10596], now have 1 active actors on pipe
2025-10-10T14:37:57.032203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:57.032216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:57.032263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602331196375794:10596]
2025-10-10T14:37:57.032283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:57.032285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:57.032310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2498 reason: error at write: Disconnected sessionId: src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0
2025-10-10T14:37:57.032479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2498 sessionId: src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0 is DEAD
2025-10-10T14:37:57.032857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:57.032864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0] Write session will restart in 0.008551s
2025-10-10T14:37:57.032884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0] Write session: Do CDS request
2025-10-10T14:37:57.032890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:57.042830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.043109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:57.043127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2499
2025-10-10T14:37:57.043744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.043793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:57.043800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:57.043804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:57.044316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2499 sessionId:  describe result for acl check
2025-10-10T14:37:57.044350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:57.044358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:57.044361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:57.044370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602335491343103:11191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:57.044965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602335491343103:11191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:57.049018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602335491343103:11191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:57.052353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602335491343103:11191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:57.052371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602335491343103:11191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:57.052375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602335491343103:11191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:57.052385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:57.054342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:57.054832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:57.055043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:57.055064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:57.055079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:57.055150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:57.055201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602334709110749:11356]
2025-10-10T14:37:57.055786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:57.056584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:57.056642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:57.056989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:57.057090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.057099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.057101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.057102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.057103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.057105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.057106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.057107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.057108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.057110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.057111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.057114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.057115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.057122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.057135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.057139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.057142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.057146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.057149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.057153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.057156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.057160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.057163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.057167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.057170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.057174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.057183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.057192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.057199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.057204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.057209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.057214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.057220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.057225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.057230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.057235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.057239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.057245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.057250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.057254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.057258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.057263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.057269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.057274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.057278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.057283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.057287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.057291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.057295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.057300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.057304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.057309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.057373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:57.059918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:57.060400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:57.060419Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:57.060421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:57.060425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:57.060431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2498 [2:7559602334709110749:11356]
2025-10-10T14:37:57.060445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:57.060469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:57.060477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.060481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.060485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.060503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:57.060515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:57.060526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:57.060595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.060602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.060603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.060605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:57.060675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:57.060684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.060697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.060712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.060732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:57.060760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343092:2438], now have 1 active actors on pipe
2025-10-10T14:37:57.060771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343196:11191], now have 1 active actors on pipe
2025-10-10T14:37:57.060779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602334709110744:11356]
2025-10-10T14:37:57.060782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602334709110744:11356]
2025-10-10T14:37:57.060784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602334709110744:11356]
2025-10-10T14:37:57.060799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:57.060818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:57.060822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:57.060826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:57.060828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:57.060835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:57.060838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:57.060844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2498
2025-10-10T14:37:57.060845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2498
2025-10-10T14:37:57.060864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602334709110744:11356]
2025-10-10T14:37:57.060879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:57.060881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:57.060911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.060923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.060965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:57.060979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.060983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.060985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:57.061000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.061017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:57.061049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.061246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.061259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.061282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.061413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2499 partition: 0 MaxSeqNo: 40 sessionId: src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0
2025-10-10T14:37:57.061807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2ad3b0-9048cfc6-9588eda-ca24a77b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:57.064775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0] Write session: try to update token
2025-10-10T14:37:57.064798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:57.081160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:57.081180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:57.081184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:57.081186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:57.081199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602334709110744:11356]
2025-10-10T14:37:57.081204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602334709110744:11356]
2025-10-10T14:37:57.081208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602334709110744:11356]
2025-10-10T14:37:57.081259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:57.081261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:57.081270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.081276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:57.081285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:57.081289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:57.081438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:57.085059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2499 sessionId: src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:57.087765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:57.132025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602335491343210:10596]
2025-10-10T14:37:57.135496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2498, pipe: [1:7559602335491343210:10596]
2025-10-10T14:37:57.202775Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:57.203209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.203239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.203289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343210:10596], now have 1 active actors on pipe
2025-10-10T14:37:57.203542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:57.203570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:57.203594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602335491343210:10596]
2025-10-10T14:37:57.203599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:57.203625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:57.203669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2499 reason: error at write: Disconnected sessionId: src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0
2025-10-10T14:37:57.203909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2499 sessionId: src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0 is DEAD
2025-10-10T14:37:57.204059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:57.204071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0] Write session will restart in 0.008909s
2025-10-10T14:37:57.204097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0] Write session: Do CDS request
2025-10-10T14:37:57.204108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:57.213504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:57.213899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.213941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:57.213958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2500
2025-10-10T14:37:57.214140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.214182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:57.214204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:57.214209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:57.214760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:57.214794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2500 sessionId:  describe result for acl check
2025-10-10T14:37:57.214836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:57.214838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:57.214840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:57.214845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602335491343290:11195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:57.214979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:57.214992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:57.215014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:57.215074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:57.215123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602334709110838:11359]
2025-10-10T14:37:57.215424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602335491343290:11195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:57.215736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:57.216109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:57.216169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:57.216503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:57.216564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.216570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.216571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.216572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.216573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.216576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.216577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.216578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.216579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.216580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.216582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.216583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.216584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.216590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.216602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.216606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.216611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.216615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.216619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.216623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.216627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.216631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.216635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.216639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.216643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.216647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.216654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.216663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.216670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.216675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.216680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.216685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.216690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.216695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.216700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.216707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.216712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.216717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.216722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.216727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.216731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.216736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.216743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.216747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.216750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.216755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.216760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.216765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.216771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.216781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.216785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.216791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.216819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:57.219705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:57.220067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:57.220081Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:57.220083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:57.220087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:57.220094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2499 [2:7559602334709110838:11359]
2025-10-10T14:37:57.220110Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:57.220130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:57.220134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.220137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.220139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.220156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:57.220163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:57.220173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:57.220233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.220242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.220243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.220246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:57.220317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:57.220337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.220350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.220363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.220380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:57.220406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602334709110833:11359]
2025-10-10T14:37:57.220414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602334709110833:11359]
2025-10-10T14:37:57.220416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602334709110833:11359]
2025-10-10T14:37:57.220431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:57.220451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:57.220469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:57.220478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:57.220506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602334709110833:11359]
2025-10-10T14:37:57.220514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:57.220559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:57.220568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:57.220571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:57.220578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:57.221328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343212:2438], now have 1 active actors on pipe
2025-10-10T14:37:57.221433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2499
2025-10-10T14:37:57.222855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602335491343290:11195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:57.229900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602335491343290:11195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:57.229919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602335491343290:11195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:57.229932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602335491343290:11195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:57.229949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:57.230288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343328:11195], now have 1 active actors on pipe
2025-10-10T14:37:57.230376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2499
2025-10-10T14:37:57.230489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.230506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.230556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac105ce0-fd997360-30d03966-d334c53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:57.230575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.230581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.230587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:57.230611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.230647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:57.230677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.230900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.230915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.230940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.231039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2500 partition: 0 MaxSeqNo: 40 sessionId: src_id|ac105ce0-fd997360-30d03966-d334c53_0
2025-10-10T14:37:57.231472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26bb7a98-3e0b87ef-8806cbb4-d9b68104_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ac105ce0-fd997360-30d03966-d334c53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:57.234491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac105ce0-fd997360-30d03966-d334c53_0] Write session: try to update token
2025-10-10T14:37:57.234512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac105ce0-fd997360-30d03966-d334c53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:57.240370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:57.240394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:57.240398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:57.240400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:57.240410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602334709110833:11359]
2025-10-10T14:37:57.240415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602334709110833:11359]
2025-10-10T14:37:57.240419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602334709110833:11359]
2025-10-10T14:37:57.240472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:57.240479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:57.240486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:57.240488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.240491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:57.240491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:57.240624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:57.251089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2500 sessionId: src_id|ac105ce0-fd997360-30d03966-d334c53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:57.253795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:57.303513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602335491343331:10596]
2025-10-10T14:37:57.303808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2499, pipe: [1:7559602335491343331:10596]
2025-10-10T14:37:57.359050Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:57.359434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.359458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.359484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343331:10596], now have 1 active actors on pipe
2025-10-10T14:37:57.359731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602335491343331:10596]
2025-10-10T14:37:57.359767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:57.360241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:57.359971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:57.359982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:57.360065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2500 reason: error at write: Disconnected sessionId: src_id|ac105ce0-fd997360-30d03966-d334c53_0
2025-10-10T14:37:57.360258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2500 sessionId: src_id|ac105ce0-fd997360-30d03966-d334c53_0 is DEAD
2025-10-10T14:37:57.365482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac105ce0-fd997360-30d03966-d334c53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:57.365496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac105ce0-fd997360-30d03966-d334c53_0] Write session will restart in 0.007588s
2025-10-10T14:37:57.365523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac105ce0-fd997360-30d03966-d334c53_0] Write session: Do CDS request
2025-10-10T14:37:57.365530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac105ce0-fd997360-30d03966-d334c53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:57.372210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:57.373932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac105ce0-fd997360-30d03966-d334c53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.374064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:57.374084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2501
2025-10-10T14:37:57.374274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.374308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:57.374328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:57.374337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:57.373298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:57.373552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:57.373557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:57.373571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:57.373629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:57.373669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602334709110941:11362]
2025-10-10T14:37:57.374294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:57.374620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:57.374692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:57.374849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2501 sessionId:  describe result for acl check
2025-10-10T14:37:57.375014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:57.375086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.375093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.375095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.375096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.375097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.375099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.375100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.375101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.375105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.375107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.375108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.375109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.375110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.375116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.375129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.375133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.375137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.375141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.375145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.375149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.375154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.375158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.375162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.375166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.375170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.375174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.375182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.375191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.375197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.375202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.375206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.375211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.375216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.375221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.375226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.375232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.375236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.375241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.375246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.375258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.375263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.375268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.375275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.375281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.375287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.375292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.375300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.375305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.375313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.375318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.375321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.375326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.375368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:57.374887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:57.374893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:57.374896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:57.374902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602335491343426:11200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:57.375498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602335491343426:11200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:57.378036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602335491343426:11200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:57.380032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:57.380424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:57.380438Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:57.380441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:57.380445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:57.380452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2500 [2:7559602334709110941:11362]
2025-10-10T14:37:57.380467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:57.380487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:57.380491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.380494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.380497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.380515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:57.380524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:57.380532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:57.380596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.380603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.380605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.380608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:57.380684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:57.380693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.380705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.380720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.380742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:57.381029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2500
2025-10-10T14:37:57.380766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343344:2438], now have 1 active actors on pipe
2025-10-10T14:37:57.380778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602334709110936:11362]
2025-10-10T14:37:57.380781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602334709110936:11362]
2025-10-10T14:37:57.380783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602334709110936:11362]
2025-10-10T14:37:57.380797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:57.380810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:57.380826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:57.380829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:57.380839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:57.380842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:57.380844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:57.380860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602334709110936:11362]
2025-10-10T14:37:57.380863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:57.380864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:57.381702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343458:11200], now have 1 active actors on pipe
2025-10-10T14:37:57.381724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.381729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.381760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:57.381776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.381787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.381789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:57.381803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.381822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:57.381838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.382042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.382053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.381224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602335491343426:11200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:57.381238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602335491343426:11200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:57.381241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602335491343426:11200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:57.381251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:57.381653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2500
2025-10-10T14:37:57.382071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.382195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2501 partition: 0 MaxSeqNo: 40 sessionId: src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0
2025-10-10T14:37:57.382607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac105ce0-fd997360-30d03966-d334c53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:57.385630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0] Write session: try to update token
2025-10-10T14:37:57.385651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:57.401353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:57.401377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:57.401381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:57.401383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:57.401394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602334709110936:11362]
2025-10-10T14:37:57.401399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602334709110936:11362]
2025-10-10T14:37:57.401403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602334709110936:11362]
2025-10-10T14:37:57.401457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:57.401460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:57.401466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.401468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:57.401469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:57.401473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:57.401627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:57.404482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2501 sessionId: src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:57.407780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:57.465431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602335491343464:10596]
2025-10-10T14:37:57.465860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2500, pipe: [1:7559602335491343464:10596]
2025-10-10T14:37:57.524538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:57.524915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.524927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.524980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343464:10596], now have 1 active actors on pipe
2025-10-10T14:37:57.527277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:57.527293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0] Write session will restart in 0.009259s
2025-10-10T14:37:57.527319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0] Write session: Do CDS request
2025-10-10T14:37:57.527326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:57.528640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:57.529149Z :ERROR: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:37:57.529265Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:37:57.529270Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:37:57.529279Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Reconnecting session to cluster  in 0.006915s
2025-10-10T14:37:57.526779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602335491343464:10596]
2025-10-10T14:37:57.526810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:57.526850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:57.526854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:57.526917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2501 reason: error at write: Disconnected sessionId: src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0
2025-10-10T14:37:57.527107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2501 sessionId: src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0 is DEAD
2025-10-10T14:37:57.527326Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:37:57.527770Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 25 consumer shared/user session shared/user_1_25_4909973995709412205_v1 is DEAD
2025-10-10T14:37:57.528436Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602253886942664:10593] disconnected; active server actors: 1
2025-10-10T14:37:57.528441Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602253886942664:10593] client user disconnected session shared/user_1_25_4909973995709412205_v1
2025-10-10T14:37:57.536771Z :DEBUG: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Successfully connected. Initializing session
2025-10-10T14:37:57.537743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.538339Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] [] Got InitResponse. ReadSessionId: shared/user_1_26_8283312721166257727_v1
2025-10-10T14:37:57.537293Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:37:57.537307Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 26
2025-10-10T14:37:57.537521Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 26 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:37:57.537579Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 read init: from# ipv6:[::1]:37328, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:37:57.537677Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 auth for : user
2025-10-10T14:37:57.537898Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 Handle describe topics response
2025-10-10T14:37:57.537921Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 auth is DEAD
2025-10-10T14:37:57.537937Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:37:57.538257Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:37:57.538414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:57.538418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2502
2025-10-10T14:37:57.538707Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559602335491343500:11204] connected; active server actors: 1
2025-10-10T14:37:57.538737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.538762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:57.538768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:57.538772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:57.538900Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559602335491343500:11204] session shared/user_1_26_8283312721166257727_v1
2025-10-10T14:37:57.538910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:37:57.538922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:37:57.538930Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_26_8283312721166257727_v1" (Sender=[1:7559602335491343497:11204], Pipe=[1:7559602335491343500:11204], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:37:57.538934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:37:57.538951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:37:57.538961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_26_8283312721166257727_v1" (Sender=[1:7559602335491343497:11204], Pipe=[1:7559602335491343500:11204], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:37:57.538973Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_26_8283312721166257727_v1" sender [1:7559602335491343497:11204] lock partition 0 for ReadingSession "shared/user_1_26_8283312721166257727_v1" (Sender=[1:7559602335491343497:11204], Pipe=[1:7559602335491343500:11204], Partitions=[], ActiveFamilyCount=1) generation 1 step 26
2025-10-10T14:37:57.538981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:37:57.538986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000032s
2025-10-10T14:37:57.539211Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 26 Session: "shared/user_1_26_8283312721166257727_v1" ClientId: "user" PipeClient { RawX1: 7559602335491343500 RawX2: 4503603922348996 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:37:57.539228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:37:57.539445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2502 sessionId:  describe result for acl check
2025-10-10T14:37:57.539467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:57.539469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:57.539471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:57.539479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602335491343507:11207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:57.540064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602335491343507:11207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:57.546110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602335491343507:11207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:57.548961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:57.550529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:57.550783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:57.550789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:57.550801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:57.550860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:57.550905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602334709111033:11364]
2025-10-10T14:37:57.551469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:57.551961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:57.552008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:57.552318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:57.552380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.552381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.552383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.552384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.552386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.552387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.552389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.552390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.552392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.552393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.552395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.552396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.552397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.552405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.552419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.552424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.552429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.552433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.552437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.552442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.552447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.552451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.552456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.552460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.552464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.552471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.552480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.552489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.552497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.552503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.552508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.552514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.552518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.552525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.552533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.552539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.552545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.552550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.552555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.552561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.552566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.552572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.552576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.552583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.552588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.552594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.552599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.552605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.552613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.552619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.552624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.552629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.552694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:57.556309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:57.556843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:57.556849Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:57.556851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:57.556856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:57.556864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2501 [2:7559602334709111033:11364]
2025-10-10T14:37:57.556880Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:57.556899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:57.556904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.556907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.556910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.556927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:57.556936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:57.556945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:57.557008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.557011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.557013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.557015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:57.557085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:57.557088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.557101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.557114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.557135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:57.557155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602334709111027:11364]
2025-10-10T14:37:57.557158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602334709111027:11364]
2025-10-10T14:37:57.557160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602334709111027:11364]
2025-10-10T14:37:57.557173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:57.557187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:57.557205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:57.557208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:57.557240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602334709111027:11364]
2025-10-10T14:37:57.557242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:57.557481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:57.557490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:57.557493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:57.557500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:57.558003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2501, pipe: [1:7559602335491343506:11209]
2025-10-10T14:37:57.558036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2501
2025-10-10T14:37:57.557901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343506:11209], now have 1 active actors on pipe
2025-10-10T14:37:57.557915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343465:2438], now have 1 active actors on pipe
2025-10-10T14:37:57.558257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.558264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.558279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_26_8283312721166257727_v1 on pipe: [1:7559602335491343506:11209]
2025-10-10T14:37:57.558302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.558310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.558318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:57.558341Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_26_8283312721166257727_v1
2025-10-10T14:37:57.558344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.558374Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:37:57.558438Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_26_8283312721166257727_v1:1 with generation 2501
2025-10-10T14:37:57.565915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602335491343507:11207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:57.565934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602335491343507:11207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:57.565938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602335491343507:11207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:57.565949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:57.566062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:37:57.566101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:37:57.566113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.566117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.566119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.566132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:37:57.566160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:37:57.566443Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 40 WriteTimestampMS: 1760106661000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760107077555 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:37:57.566464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 40 readOffset 0 committedOffset 0
2025-10-10T14:37:57.566504Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 sending to client partition status
2025-10-10T14:37:57.566640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343591:11207], now have 1 active actors on pipe
2025-10-10T14:37:57.566745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2501
2025-10-10T14:37:57.566855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.566865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.566897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:57.566905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.566910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.566913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:57.566926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.566940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:57.566950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.567703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.567717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.567739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.567898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2502 partition: 0 MaxSeqNo: 40 sessionId: src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0
2025-10-10T14:37:57.568247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c2657c-663b3602-6f01a1ce-cbac9fce_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:57.570989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0] Write session: try to update token
2025-10-10T14:37:57.571009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:57.583040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:57.583062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:57.583066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:57.583068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:57.583082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602334709111027:11364]
2025-10-10T14:37:57.583087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602334709111027:11364]
2025-10-10T14:37:57.583092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602334709111027:11364]
2025-10-10T14:37:57.583146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:57.583154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.583154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:57.583157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:57.583164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:57.583168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:57.583341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:57.599546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2502 sessionId: src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:57.602319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:57.704602Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:57.705835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602335491343506:11209]
2025-10-10T14:37:57.705878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:57.705961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2502 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0
2025-10-10T14:37:57.705568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.706173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2502 sessionId: src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0 is DEAD
2025-10-10T14:37:57.705587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.705802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_26_8283312721166257727_v1
2025-10-10T14:37:57.705810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:57.706371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:57.706081Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_26_8283312721166257727_v1
2025-10-10T14:37:57.709486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:57.709497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0] Write session will restart in 0.008000s
2025-10-10T14:37:57.709528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0] Write session: Do CDS request
2025-10-10T14:37:57.709539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:57.715425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:57.716043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:57.716274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:57.716286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:57.716297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:57.716362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:57.716405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602334709111140:11372]
2025-10-10T14:37:57.717015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:57.717315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:57.717372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:57.717710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:57.717771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.717777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.717778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.717779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.717780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.717781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.717782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.717783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.717785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.717788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.717789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.717791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.717792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.717798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.717810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.717814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.717818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.717822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.717826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.717830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.717834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.717837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.717842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.717845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.717849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.717853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.717862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.717871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.717877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.717883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.717893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.717898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.717902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.717913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.717918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.717923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.717927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.717932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.717937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.717942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.717947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.717958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.717962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.717967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.717978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.717983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.717992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.717997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.718001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.718010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.718015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.718020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.718063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:57.718942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.721463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:57.721478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2503
2025-10-10T14:37:57.721628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:57.722068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:57.722085Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:57.722088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:57.722092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:57.722100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2502 [2:7559602334709111140:11372]
2025-10-10T14:37:57.722188Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:57.722212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:57.722220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.722225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.722227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.722245Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:57.722259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:57.722270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:57.722335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.722340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.722342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.722345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:57.722413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:57.722421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.722434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.722451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.722525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2502
2025-10-10T14:37:57.722474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:57.722505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343608:2438], now have 1 active actors on pipe
2025-10-10T14:37:57.722513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602334709111135:11372]
2025-10-10T14:37:57.722515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602334709111135:11372]
2025-10-10T14:37:57.722517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602334709111135:11372]
2025-10-10T14:37:57.722530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:57.722543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:57.722545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:57.722547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:57.722549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:57.722563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:57.722567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:57.722649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602334709111135:11372]
2025-10-10T14:37:57.722653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:57.722676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:57.725450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.725514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:57.725519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:57.725524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:57.725932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2503 sessionId:  describe result for acl check
2025-10-10T14:37:57.725960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:57.725961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:57.725963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:57.725968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602335491343700:11218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:57.726522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602335491343700:11218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:57.729050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602335491343700:11218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:57.735432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602335491343700:11218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:57.735453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602335491343700:11218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:57.735457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602335491343700:11218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:57.735467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:57.736042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343725:11218], now have 1 active actors on pipe
2025-10-10T14:37:57.736106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2502
2025-10-10T14:37:57.736224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.736245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.736298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efe77070-943b0358-3159f0d3-80e623d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:57.736315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.736326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.736329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:57.736345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.736370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:57.736399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.736690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.736701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.736719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.736850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2503 partition: 0 MaxSeqNo: 40 sessionId: src_id|efe77070-943b0358-3159f0d3-80e623d_0
2025-10-10T14:37:57.737263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceffd8ea-22c0e6e8-19302c6e-7a7b0c8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|efe77070-943b0358-3159f0d3-80e623d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:57.740115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe77070-943b0358-3159f0d3-80e623d_0] Write session: try to update token
2025-10-10T14:37:57.740136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe77070-943b0358-3159f0d3-80e623d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:57.741974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:57.741993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:57.741997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:57.741999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:57.742009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602334709111135:11372]
2025-10-10T14:37:57.742014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602334709111135:11372]
2025-10-10T14:37:57.742017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602334709111135:11372]
2025-10-10T14:37:57.742069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:57.742084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.742084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:57.742087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:57.742092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:57.742097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:57.742229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:57.757839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2503 sessionId: src_id|efe77070-943b0358-3159f0d3-80e623d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:57.760483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:57.805747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602335491343747:11209]
2025-10-10T14:37:57.805998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2502, pipe: [1:7559602335491343747:11209]
2025-10-10T14:37:57.860303Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:57.860894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.860913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.860938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343747:11209], now have 1 active actors on pipe
2025-10-10T14:37:57.861181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:57.861210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:57.861210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602335491343747:11209]
2025-10-10T14:37:57.861232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:57.861276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2503 reason: error at write: Disconnected sessionId: src_id|efe77070-943b0358-3159f0d3-80e623d_0
2025-10-10T14:37:57.861507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2503 sessionId: src_id|efe77070-943b0358-3159f0d3-80e623d_0 is DEAD
2025-10-10T14:37:57.861211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:57.865516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe77070-943b0358-3159f0d3-80e623d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:57.865527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe77070-943b0358-3159f0d3-80e623d_0] Write session will restart in 0.007794s
2025-10-10T14:37:57.865551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe77070-943b0358-3159f0d3-80e623d_0] Write session: Do CDS request
2025-10-10T14:37:57.865558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe77070-943b0358-3159f0d3-80e623d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:57.872351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:57.873278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:57.873517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:57.873530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:57.873542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:57.873599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:57.873642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602334709111258:11381]
2025-10-10T14:37:57.874283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:57.874570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:57.874609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:57.874929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe77070-943b0358-3159f0d3-80e623d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.874929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:57.874982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.874988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.874989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.874990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.874991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.874993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.874994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.874996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.874998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:57.874997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.875014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2504
2025-10-10T14:37:57.874998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.874999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.875000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.875002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.875008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.875020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.875024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.875028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.875032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.875036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.875040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.875044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.875048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.875052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.875057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.875061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.875067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.875074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.875083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:57.875089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.875095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:57.875099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.875103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:57.875108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.875113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:57.875118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.875122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:57.875127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.875132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:57.875136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.875141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:57.875146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.875151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:57.875157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.875163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:57.875167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.875172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:57.875176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.875188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.875192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.875201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.875205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.875210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.875248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:57.877547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:57.877540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:57.877597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:57.877607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:57.877612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:57.877996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:57.878009Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:57.878013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:57.878017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:57.878023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2503 [2:7559602334709111258:11381]
2025-10-10T14:37:57.878035Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:57.878043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2504 sessionId:  describe result for acl check
2025-10-10T14:37:57.878057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:57.878065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.878069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.878071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.878078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:57.878085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:57.878087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:57.878092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602335491343838:11226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:57.878101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:57.878114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:57.878122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:57.878180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.878187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.878189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.878191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:57.878262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:57.878271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.878283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:57.878293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:57.878308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:57.878335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343751:2438], now have 1 active actors on pipe
2025-10-10T14:37:57.878349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602334709111252:11381]
2025-10-10T14:37:57.878355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602334709111252:11381]
2025-10-10T14:37:57.878358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602334709111252:11381]
2025-10-10T14:37:57.878373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:57.878371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2503
2025-10-10T14:37:57.878380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:57.878383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:57.878385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:57.878391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:57.878408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:57.878410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:57.878440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602334709111252:11381]
2025-10-10T14:37:57.878451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:57.878456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:57.878672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602335491343838:11226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:57.880951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602335491343838:11226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:57.887508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602335491343838:11226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:57.887525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602335491343838:11226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:57.887528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602335491343838:11226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:57.887539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:57.887789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343871:11226], now have 1 active actors on pipe
2025-10-10T14:37:57.887851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2503
2025-10-10T14:37:57.887923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.887938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.887982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:57.887999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:57.888007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:57.888010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:57.888022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:57.888041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:57.888062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.888238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:57.888254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:57.888280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:57.888398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2504 partition: 0 MaxSeqNo: 40 sessionId: src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0
2025-10-10T14:37:57.888795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe77070-943b0358-3159f0d3-80e623d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:57.891507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0] Write session: try to update token
2025-10-10T14:37:57.891528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:57.895906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:57.895927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:57.895940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602334709111252:11381]
2025-10-10T14:37:57.896000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:57.896000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:57.896195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:57.896348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:57.896506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:57.896659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:57.896861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:57.896905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:57.907073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2504 sessionId: src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:57.907751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:57.907775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:57.907780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:57.907783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:57.907795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602334709111252:11381]
2025-10-10T14:37:57.907800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602334709111252:11381]
2025-10-10T14:37:57.907805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602334709111252:11381]
2025-10-10T14:37:57.907859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:57.907863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:57.907870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:57.907872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:57.907875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:57.907878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:57.908027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:57.909757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:57.961560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602335491343874:11209]
2025-10-10T14:37:57.962003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2503, pipe: [1:7559602335491343874:11209]
2025-10-10T14:37:58.027779Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:58.028179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.028196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.028221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602335491343874:11209], now have 1 active actors on pipe
2025-10-10T14:37:58.028599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:58.028616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:58.028661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602335491343874:11209]
2025-10-10T14:37:58.028682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:58.028693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2504 reason: error at write: Disconnected sessionId: src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0
2025-10-10T14:37:58.028902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2504 sessionId: src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0 is DEAD
2025-10-10T14:37:58.029092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:58.029103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0] Write session will restart in 0.007109s
2025-10-10T14:37:58.029130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0] Write session: Do CDS request
2025-10-10T14:37:58.029137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:58.028659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:58.037876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.037956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:58.037975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2505
2025-10-10T14:37:58.038133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.038180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:58.038192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:58.038197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:58.038712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2505 sessionId:  describe result for acl check
2025-10-10T14:37:58.038750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:58.038756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:58.038758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:58.038765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602339786311251:11230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:58.039382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602339786311251:11230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:58.039786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:58.041169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:58.041402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:58.041416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:58.041430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:58.041495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:58.041535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602339004078648:11383]
2025-10-10T14:37:58.041804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602339786311251:11230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:58.042141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:58.042596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:58.042675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:58.043022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:58.043094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.043101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.043102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.043103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.043105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.043106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.043107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.043108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.043109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.043111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.043112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.043113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.043114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.043121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.043134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.043138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.043141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.043145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.043149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.043152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.043156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.043160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.043164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.043167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.043171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.043174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.043182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.043191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.043198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.043204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.043208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.043214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.043218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.043226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.043230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.043241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.043245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.043250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.043259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.043265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.043269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.043273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.043279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.043284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.043292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.043297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.043303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.043309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.043313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.043317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.043322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.043326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.043370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:58.045999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602339786311251:11230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:58.046016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602339786311251:11230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:58.046020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602339786311251:11230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:58.046029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:58.046053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:58.046424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:58.046437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:58.046440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:58.046445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:58.046451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2504 [2:7559602339004078648:11383]
2025-10-10T14:37:58.046465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:58.046482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:58.046485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.046489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.046492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.046513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:58.046520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:58.046528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:58.046585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.046593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.046595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.046599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:58.046680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:58.046688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.046701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.046713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.046736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:58.046764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602339004078642:11383]
2025-10-10T14:37:58.046771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602339004078642:11383]
2025-10-10T14:37:58.046774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602339004078642:11383]
2025-10-10T14:37:58.046783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:58.046793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:58.046796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:58.046798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:58.046799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:58.046815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:58.046823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:58.046834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311171:2438], now have 1 active actors on pipe
2025-10-10T14:37:58.046840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311287:11230], now have 1 active actors on pipe
2025-10-10T14:37:58.046863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602339004078642:11383]
2025-10-10T14:37:58.046871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:58.046935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:58.046903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2504
2025-10-10T14:37:58.046936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2504
2025-10-10T14:37:58.047157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.047172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.047203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:58.047217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.047222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.047224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:58.047235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.047247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:58.047261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.047999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.048014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.048037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.048195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2505 partition: 0 MaxSeqNo: 40 sessionId: src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0
2025-10-10T14:37:58.048623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|467990bc-818538cd-9fc2cd6d-2d381d6f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:58.051504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0] Write session: try to update token
2025-10-10T14:37:58.051526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:58.066427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2505 sessionId: src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:58.067807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:58.067836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:58.067840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:58.067842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:58.067855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602339004078642:11383]
2025-10-10T14:37:58.067860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602339004078642:11383]
2025-10-10T14:37:58.067864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602339004078642:11383]
2025-10-10T14:37:58.069300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:58.067920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:58.067937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.067940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:58.067997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:58.068005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:58.068009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:58.068095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:58.129241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602339786311295:11209]
2025-10-10T14:37:58.129653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2504, pipe: [1:7559602339786311295:11209]
2025-10-10T14:37:58.185421Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:58.185875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.185892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.185932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311295:11209], now have 1 active actors on pipe
2025-10-10T14:37:58.186184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:58.186173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:58.186177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602339786311295:11209]
2025-10-10T14:37:58.186212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:58.186215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:58.186291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2505 reason: error at write: Disconnected sessionId: src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0
2025-10-10T14:37:58.186498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2505 sessionId: src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0 is DEAD
2025-10-10T14:37:58.186683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:58.186696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0] Write session will restart in 0.007067s
2025-10-10T14:37:58.186725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0] Write session: Do CDS request
2025-10-10T14:37:58.186732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:58.195020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.195076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:58.195093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2506
2025-10-10T14:37:58.195276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.195330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:58.195341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:58.195346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:58.196153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2506 sessionId:  describe result for acl check
2025-10-10T14:37:58.196195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:58.196197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:58.196199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:58.196206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602339786311308:11234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:58.196867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602339786311308:11234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:58.198896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602339786311308:11234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:58.203028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602339786311308:11234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:58.203046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602339786311308:11234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:58.203050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602339786311308:11234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:58.203060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:58.203325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:58.204519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:58.204733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:58.204744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:58.204757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:58.204812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:58.204859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602339004078746:11386]
2025-10-10T14:37:58.205524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:58.205803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:58.205846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:58.206180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:58.206238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.206246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.206248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.206249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.206251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.206252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.206254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.206256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.206257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.206258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.206260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.206261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.206263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.206269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.206284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.206289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.206294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.206299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.206304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.206309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.206313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.206318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.206323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.206328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.206332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.206337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.206344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.206354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.206360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.206369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.206374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.206380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.206385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.206391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.206396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.206402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.206413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.206419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.206424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.206435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.206439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.206446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.206456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.206462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.206467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.206473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.206477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.206483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.206488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.206494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.206500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.206513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.206558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:58.209028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:58.209497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:58.209508Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:58.209509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:58.209513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:58.209522Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2505 [2:7559602339004078746:11386]
2025-10-10T14:37:58.209542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:58.209568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:58.209571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.209575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.209578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.209596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:58.209609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:58.209616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:58.209687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.209695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.209698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.209700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:58.209770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:58.209779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.209791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.209802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.209823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:58.209852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311409:11234], now have 1 active actors on pipe
2025-10-10T14:37:58.209860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311296:2438], now have 1 active actors on pipe
2025-10-10T14:37:58.209869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602339004078740:11386]
2025-10-10T14:37:58.209872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602339004078740:11386]
2025-10-10T14:37:58.209875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602339004078740:11386]
2025-10-10T14:37:58.209891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:58.209905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:58.209913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:58.209916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:58.209919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:58.209929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:58.209937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:58.209922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2505
2025-10-10T14:37:58.209924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2505
2025-10-10T14:37:58.209964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602339004078740:11386]
2025-10-10T14:37:58.209976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:58.209983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:58.209996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.210006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.210056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:58.210070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.210074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.210076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:58.210088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.210099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:58.210116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.210354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.210368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.210392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.210519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2506 partition: 0 MaxSeqNo: 40 sessionId: src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0
2025-10-10T14:37:58.210967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb7fb3a2-e43089db-e6ad3f76-1b584285_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:58.213925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0] Write session: try to update token
2025-10-10T14:37:58.213947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:58.231654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2506 sessionId: src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:58.234012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:58.234035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:58.234039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:58.234042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:58.234054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602339004078740:11386]
2025-10-10T14:37:58.234059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602339004078740:11386]
2025-10-10T14:37:58.234064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602339004078740:11386]
2025-10-10T14:37:58.234117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:58.234120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:58.234125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.234127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:58.234131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:58.234132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:58.234270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:58.234268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:58.286549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602339786311421:11209]
2025-10-10T14:37:58.286880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2505, pipe: [1:7559602339786311421:11209]
2025-10-10T14:37:58.349778Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:58.350110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.350126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.350176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311421:11209], now have 1 active actors on pipe
2025-10-10T14:37:58.350418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:58.350448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:58.350463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:58.350467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602339786311421:11209]
2025-10-10T14:37:58.350489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:58.350530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2506 reason: error at write: Disconnected sessionId: src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0
2025-10-10T14:37:58.350748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2506 sessionId: src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0 is DEAD
2025-10-10T14:37:58.350936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:58.350949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0] Write session will restart in 0.009202s
2025-10-10T14:37:58.350978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0] Write session: Do CDS request
2025-10-10T14:37:58.350988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:58.360452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:58.361764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:58.361911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.361976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:58.361992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:58.361991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2507
2025-10-10T14:37:58.362007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:58.362020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:58.362091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:58.362140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602339004078852:11389]
2025-10-10T14:37:58.362136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.362194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:58.362200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:58.362204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:58.362805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:58.363142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:58.363205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:58.362726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2507 sessionId:  describe result for acl check
2025-10-10T14:37:58.362762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:58.362764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:58.362766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:58.362771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602339786311519:11239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:58.363298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602339786311519:11239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:58.363582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:58.363672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.363680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.363681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.363682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.363683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.363685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.363696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.363697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.363698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.363699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.363700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.363702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.363703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.363710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.363721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.363726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.363731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.363735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.363739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.363743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.363746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.363750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.363755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.363758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.363763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.363767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.363774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.363783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.363789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.363795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.363799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.363804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.363808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.363813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.363817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.363822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.363826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.363831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.363836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.363857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.363867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.363872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.363881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.363886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.363891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.363896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.363902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.363913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.363917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.363922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.363933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.363938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.363977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:58.365914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602339786311519:11239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:58.366524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:58.366940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:58.366956Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:58.366960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:58.366965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:58.366972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2506 [2:7559602339004078852:11389]
2025-10-10T14:37:58.366986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:58.367005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:58.367009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.367013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.367017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.367035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:58.367043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:58.367067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:58.367317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2506
2025-10-10T14:37:58.367130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.367141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.367144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.367146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:58.367224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:58.367228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.367241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.367255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.367274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:58.367298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311422:2438], now have 1 active actors on pipe
2025-10-10T14:37:58.367308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602339004078847:11389]
2025-10-10T14:37:58.367311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602339004078847:11389]
2025-10-10T14:37:58.367313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602339004078847:11389]
2025-10-10T14:37:58.367331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:58.367346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:58.367353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:58.367355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:58.367357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:58.367365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:58.367369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:58.367394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602339004078847:11389]
2025-10-10T14:37:58.367402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:58.367407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:58.372634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602339786311519:11239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:58.372650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602339786311519:11239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:58.372654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602339786311519:11239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:58.372663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:58.372934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311557:11239], now have 1 active actors on pipe
2025-10-10T14:37:58.372991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2506
2025-10-10T14:37:58.373076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.373104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.373143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:58.373161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.373180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.373188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:58.373203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.373228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:58.373253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.373479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.373493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.373518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.377467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2507 partition: 0 MaxSeqNo: 40 sessionId: src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0
2025-10-10T14:37:58.377876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ddb7c2-dfaaa647-7318fbd5-ce990a0e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:58.379050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:58.379071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:58.379083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602339004078847:11389]
2025-10-10T14:37:58.379128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:58.379134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:58.379334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:58.379490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:58.379669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:58.379823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:58.380039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:58.380087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:58.380595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0] Write session: try to update token
2025-10-10T14:37:58.380611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:58.401173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2507 sessionId: src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:58.401251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:58.401272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:58.401279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:58.401281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:58.401292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602339004078847:11389]
2025-10-10T14:37:58.401296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602339004078847:11389]
2025-10-10T14:37:58.401303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602339004078847:11389]
2025-10-10T14:37:58.401402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:58.401416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.401419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:58.401561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:58.401583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:58.401597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:58.401601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:58.403979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:58.450365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602339786311560:11209]
2025-10-10T14:37:58.450655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2506, pipe: [1:7559602339786311560:11209]
2025-10-10T14:37:58.519786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:58.520270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.520288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.520312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311560:11209], now have 1 active actors on pipe
2025-10-10T14:37:58.520581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602339786311560:11209]
2025-10-10T14:37:58.520620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:58.520623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:58.520625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:58.520701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2507 reason: error at write: Disconnected sessionId: src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0
2025-10-10T14:37:58.521079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:58.521092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0] Write session will restart in 0.007859s
2025-10-10T14:37:58.521118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0] Write session: Do CDS request
2025-10-10T14:37:58.521135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:58.520917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2507 sessionId: src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0 is DEAD
2025-10-10T14:37:58.520553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:58.529983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.530068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:58.530085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2508
2025-10-10T14:37:58.530246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.530293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:58.530299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:58.530304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:58.530763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2508 sessionId:  describe result for acl check
2025-10-10T14:37:58.530801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:58.530803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:58.530805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:58.530811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602339786311593:11243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:58.531404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602339786311593:11243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:58.533842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602339786311593:11243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:58.536792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602339786311593:11243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:58.536808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602339786311593:11243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:58.536813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602339786311593:11243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:58.536822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:58.536861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:58.538127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:58.538341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:58.538352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:58.538363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:58.538416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:58.538471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602339004078951:11391]
2025-10-10T14:37:58.539039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:58.539311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:58.539353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:58.539603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:58.539646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.539652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.539653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.539653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.539654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.539655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.539656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.539657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.539657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.539658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.539659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.539660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.539660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.539664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.539673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.539676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.539678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.539680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.539683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.539685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.539687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.539689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.539691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.539694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.539696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.539698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.539703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.539709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.539714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.539718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.539721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.539725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.539729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.539732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.539735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.539738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.539740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.539743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.539746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.539749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.539752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.539755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.539758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.539761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.539763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.539766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.539770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.539773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.539776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.539779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.539782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.539785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.539808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:58.542285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:58.542635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:58.542650Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:58.542653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:58.542658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:58.542665Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2507 [2:7559602339004078951:11391]
2025-10-10T14:37:58.542678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:58.542697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:58.542700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.542703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.542709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.542726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:58.542739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:58.542753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:58.542820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.542827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.542829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.542832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:58.543001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:58.543010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.543023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.543036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.543055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:58.543042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2507
2025-10-10T14:37:58.543079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2507
2025-10-10T14:37:58.543084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311676:11243], now have 1 active actors on pipe
2025-10-10T14:37:58.543094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311561:2438], now have 1 active actors on pipe
2025-10-10T14:37:58.543101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602339004078945:11391]
2025-10-10T14:37:58.543103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602339004078945:11391]
2025-10-10T14:37:58.543105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602339004078945:11391]
2025-10-10T14:37:58.543115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:58.543126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:58.543129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:58.543130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:58.543130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:58.543146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:58.543150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:58.543167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.543177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.543221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602339004078945:11391]
2025-10-10T14:37:58.543234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:58.543251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:58.543253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:58.543261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.543266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.543268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:58.543281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.543295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:58.543327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.543537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.543547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.543562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.543666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2508 partition: 0 MaxSeqNo: 40 sessionId: src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0
2025-10-10T14:37:58.544106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e6f1404-642ab403-47a80426-1ab3ef80_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:58.547056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0] Write session: try to update token
2025-10-10T14:37:58.547078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:58.562039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2508 sessionId: src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:58.564812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:58.564905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:58.564924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:58.564928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:58.564930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:58.564940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602339004078945:11391]
2025-10-10T14:37:58.564945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602339004078945:11391]
2025-10-10T14:37:58.564950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602339004078945:11391]
2025-10-10T14:37:58.564996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:58.565004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.565012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:58.565014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.565017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:58.565034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:58.565049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.565056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:58.565203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:58.620891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602339786311689:11209]
2025-10-10T14:37:58.621117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2507, pipe: [1:7559602339786311689:11209]
2025-10-10T14:37:58.682814Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:58.683197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311689:11209], now have 1 active actors on pipe
2025-10-10T14:37:58.683413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:58.683520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602339786311689:11209]
2025-10-10T14:37:58.683570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:58.683632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:58.683665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2508 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0
2025-10-10T14:37:58.683865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2508 sessionId: src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0 is DEAD
2025-10-10T14:37:58.684235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:58.684249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0] Write session will restart in 0.007581s
2025-10-10T14:37:58.684274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0] Write session: Do CDS request
2025-10-10T14:37:58.684281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:58.692907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.692971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:58.692988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2509
2025-10-10T14:37:58.693135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.693116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:58.693174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:58.693183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:58.693188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:58.693652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2509 sessionId:  describe result for acl check
2025-10-10T14:37:58.693689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:58.693696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:58.693698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:58.693706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602339786311775:11247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:58.694163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:58.694319Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:58.694328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:58.694337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:58.694395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:58.694384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602339786311775:11247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:58.694501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602339004079048:11393]
2025-10-10T14:37:58.695003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:58.695503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:58.695552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:58.695910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:58.695980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.695989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.695991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.695992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.695993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.695995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.695996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.695998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.695999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.696000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.696002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.696003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.696004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.696010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.696022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.696027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.696031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.696035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.696040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.696044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.696048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.696052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.696057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.696063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.696067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.696071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.696079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.696087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.696094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.696099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.696108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.696113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.696118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.696123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.696129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.696134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.696138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.696143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.696148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.696153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.696158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.696163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.696174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.696180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.696189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.696195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.696200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.696209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.696213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.696219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.696228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.696233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.696276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:58.696647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602339786311775:11247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:58.698676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:58.699039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:58.699067Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:58.699069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:58.699077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:58.699084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2508 [2:7559602339004079048:11393]
2025-10-10T14:37:58.699098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:58.699115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:58.699118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.699122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.699124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.699143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:58.699156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:58.699163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:58.699228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.699235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.699237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.699240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:58.699313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:58.699321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.699332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.699346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.699366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:58.699395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311690:2438], now have 1 active actors on pipe
2025-10-10T14:37:58.699419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602339004079042:11393]
2025-10-10T14:37:58.699426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602339004079042:11393]
2025-10-10T14:37:58.699429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602339004079042:11393]
2025-10-10T14:37:58.699413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602339786311775:11247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:58.699442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602339786311775:11247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:58.699446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602339786311775:11247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:58.699455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:58.699479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2508
2025-10-10T14:37:58.699486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:58.699501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:58.699504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:58.699506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:58.699511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:58.699528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:58.699531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:58.699662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2508
2025-10-10T14:37:58.699565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602339004079042:11393]
2025-10-10T14:37:58.699568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:58.699570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:58.699615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311809:11247], now have 1 active actors on pipe
2025-10-10T14:37:58.699712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.699723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.699756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db314f12-329757af-3ad9154a-7a7976ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:58.699769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.699773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.699775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:58.699799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.699815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:58.699836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.699969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.699979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.699996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.700117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2509 partition: 0 MaxSeqNo: 40 sessionId: src_id|db314f12-329757af-3ad9154a-7a7976ab_0
2025-10-10T14:37:58.700490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3657fd09-6bf9d56c-755cdc51-6ed155f7_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|db314f12-329757af-3ad9154a-7a7976ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:58.703262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db314f12-329757af-3ad9154a-7a7976ab_0] Write session: try to update token
2025-10-10T14:37:58.703279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db314f12-329757af-3ad9154a-7a7976ab_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:58.719322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:58.719345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:58.719352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:58.719354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:58.719365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602339004079042:11393]
2025-10-10T14:37:58.719370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602339004079042:11393]
2025-10-10T14:37:58.719374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602339004079042:11393]
2025-10-10T14:37:58.719428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:58.719441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.719445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:58.719449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:58.719466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:58.719471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:58.719590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:58.722247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2509 sessionId: src_id|db314f12-329757af-3ad9154a-7a7976ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:58.725196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:58.783658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602339786311835:11209]
2025-10-10T14:37:58.783960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2508, pipe: [1:7559602339786311835:11209]
2025-10-10T14:37:58.835410Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:58.835799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.835814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.835863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311835:11209], now have 1 active actors on pipe
2025-10-10T14:37:58.836148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:58.836163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:58.836188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:58.836194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:58.836236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602339786311835:11209]
2025-10-10T14:37:58.836281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2509 reason: error at write: Disconnected sessionId: src_id|db314f12-329757af-3ad9154a-7a7976ab_0
2025-10-10T14:37:58.836506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2509 sessionId: src_id|db314f12-329757af-3ad9154a-7a7976ab_0 is DEAD
2025-10-10T14:37:58.836659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db314f12-329757af-3ad9154a-7a7976ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:58.836669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db314f12-329757af-3ad9154a-7a7976ab_0] Write session will restart in 0.005774s
2025-10-10T14:37:58.836694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db314f12-329757af-3ad9154a-7a7976ab_0] Write session: Do CDS request
2025-10-10T14:37:58.836704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db314f12-329757af-3ad9154a-7a7976ab_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:58.844045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db314f12-329757af-3ad9154a-7a7976ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.844049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:58.844075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2510
2025-10-10T14:37:58.844244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:58.844284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:58.844295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:58.844310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:58.844861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2510 sessionId:  describe result for acl check
2025-10-10T14:37:58.844901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:58.844910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:58.844913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:58.844919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602339786311923:11261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:58.845552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602339786311923:11261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:58.847798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:58.848231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602339786311923:11261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:58.849153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:58.849494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:58.849507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:58.849522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:58.849589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:58.849641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602339004079186:11408]
2025-10-10T14:37:58.850297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:58.850627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:58.850674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:58.851015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:58.851072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.851079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.851080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.851082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.851084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.851085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.851086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.851087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.851089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.851090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.851093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.851094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.851096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.851102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.851115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.851120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.851125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.851129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.851134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.851143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.851148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.851152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.851157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.851162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.851167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.851171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.851178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.851188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:58.851195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.851206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:58.851217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.851223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:58.851234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.851240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:58.851249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.851255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:58.851263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.851269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:58.851279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.851285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:58.851289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.851295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:58.851303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.851308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:58.851313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.851323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:58.851329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.851338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.851343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.851353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.851358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.851368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.851409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:58.851446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602339786311923:11261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:58.851470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602339786311923:11261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:58.851474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602339786311923:11261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:58.851483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:58.853910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:58.854264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:58.854278Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:58.854281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:58.854285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:58.854292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2509 [2:7559602339004079186:11408]
2025-10-10T14:37:58.854305Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:58.854326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:58.854329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.854333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.854336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.854354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:58.854361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:58.854369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:58.854424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.854431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.854433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.854436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:58.854502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:58.854509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.854522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:58.854539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:58.854566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:58.854588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311969:11261], now have 1 active actors on pipe
2025-10-10T14:37:58.854592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311850:2438], now have 1 active actors on pipe
2025-10-10T14:37:58.854612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602339004079179:11408]
2025-10-10T14:37:58.854615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602339004079179:11408]
2025-10-10T14:37:58.854617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602339004079179:11408]
2025-10-10T14:37:58.854639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2509
2025-10-10T14:37:58.854640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2509
2025-10-10T14:37:58.854630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:58.854643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:58.854643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:58.854646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:58.854648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:58.854660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:58.854663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:58.854700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602339004079179:11408]
2025-10-10T14:37:58.854705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:58.854710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:58.854720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.854725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.854779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71062061-af894ae3-14831209-d74395f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:58.854792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:58.854797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:58.854800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:58.854810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:58.854821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:58.854838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.854991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.855000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.855040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:58.855127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2510 partition: 0 MaxSeqNo: 40 sessionId: src_id|71062061-af894ae3-14831209-d74395f4_0
2025-10-10T14:37:58.855542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db314f12-329757af-3ad9154a-7a7976ab_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|71062061-af894ae3-14831209-d74395f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:58.858229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71062061-af894ae3-14831209-d74395f4_0] Write session: try to update token
2025-10-10T14:37:58.858249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71062061-af894ae3-14831209-d74395f4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:58.874729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:58.874753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:58.874756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:58.874758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:58.874769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602339004079179:11408]
2025-10-10T14:37:58.874774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602339004079179:11408]
2025-10-10T14:37:58.874779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602339004079179:11408]
2025-10-10T14:37:58.874835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:58.874834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:58.874841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:58.874845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:58.874851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:58.874854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:58.875003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:58.875841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2510 sessionId: src_id|71062061-af894ae3-14831209-d74395f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:58.878562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:58.936306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602339786311979:11209]
2025-10-10T14:37:58.937592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2509, pipe: [1:7559602339786311979:11209]
2025-10-10T14:37:58.991578Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:58.991943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:58.991960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:58.992008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311979:11209], now have 1 active actors on pipe
2025-10-10T14:37:58.992255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:58.992284Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:58.992273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:58.992282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:58.992340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602339786311979:11209]
2025-10-10T14:37:58.992344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2510 reason: error at write: Disconnected sessionId: src_id|71062061-af894ae3-14831209-d74395f4_0
2025-10-10T14:37:58.992523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2510 sessionId: src_id|71062061-af894ae3-14831209-d74395f4_0 is DEAD
2025-10-10T14:37:58.992691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71062061-af894ae3-14831209-d74395f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:58.992703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71062061-af894ae3-14831209-d74395f4_0] Write session will restart in 0.006336s
2025-10-10T14:37:58.992729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71062061-af894ae3-14831209-d74395f4_0] Write session: Do CDS request
2025-10-10T14:37:58.992735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71062061-af894ae3-14831209-d74395f4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:58.999924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71062061-af894ae3-14831209-d74395f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.000047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:59.000064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2511
2025-10-10T14:37:59.000225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.000281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:59.000304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:59.000308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:59.000822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2511 sessionId:  describe result for acl check
2025-10-10T14:37:59.000861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:59.000865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:59.000868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:59.000874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602344081279309:11265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:59.001518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602344081279309:11265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:59.003887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602344081279309:11265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:59.005581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:59.006768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:59.007148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:59.007162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:59.007176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:59.007255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:59.007324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602343299046582:11410]
2025-10-10T14:37:59.007586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602344081279309:11265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:59.007603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602344081279309:11265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:59.007608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602344081279309:11265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:59.007619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:59.008049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:59.008390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:59.008438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:59.008784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:59.008855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.008862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.008863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.008865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.008866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.008869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.008883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.008885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.008886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.008890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.008892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.008893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.008895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.008901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.008914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.008925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.008929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.008933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.008937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.008941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.008946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.008951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.008956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.008961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.008970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.008975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.008983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.008996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.009003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.009010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.009018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.009024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.009029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.009040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.009046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.009056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.009061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.009071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.009077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.009087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.009098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.009104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.009114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.009124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.009129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.009139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.009145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.009150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.009156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.009166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.009182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.009191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.009235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:59.011945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:59.012437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:59.012452Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:59.012454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:59.012459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:59.012465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2510 [2:7559602343299046582:11410]
2025-10-10T14:37:59.012481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:59.012497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:59.012508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.012515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.012522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.012537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:59.012552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:59.012559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:59.012632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.012641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.012644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.012646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:59.012770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:59.012782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.012794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.012814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.012841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:59.012873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602339786311980:2438], now have 1 active actors on pipe
2025-10-10T14:37:59.012887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279393:11265], now have 1 active actors on pipe
2025-10-10T14:37:59.012898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602343299046577:11410]
2025-10-10T14:37:59.012910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602343299046577:11410]
2025-10-10T14:37:59.012913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602343299046577:11410]
2025-10-10T14:37:59.012913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2510
2025-10-10T14:37:59.012935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:59.012952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:59.012956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:59.012959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:59.012964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:59.012985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:59.012988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:59.012924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2510
2025-10-10T14:37:59.013051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.013067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.013082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602343299046577:11410]
2025-10-10T14:37:59.013098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:59.013126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:59.013140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:59.013150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.013162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.013165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:59.013177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.013198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:59.013253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.013547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.013559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.013583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.013911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2511 partition: 0 MaxSeqNo: 40 sessionId: src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0
2025-10-10T14:37:59.014405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71062061-af894ae3-14831209-d74395f4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:59.017150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0] Write session: try to update token
2025-10-10T14:37:59.017170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:59.032737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2511 sessionId: src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:59.035686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:59.033872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:59.033900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:59.033904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:59.033906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:59.033918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602343299046577:11410]
2025-10-10T14:37:59.033925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602343299046577:11410]
2025-10-10T14:37:59.033930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602343299046577:11410]
2025-10-10T14:37:59.033988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:59.033990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:59.033998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:59.034000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.034003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:59.034003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:59.034179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:59.092455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602344081279406:11209]
2025-10-10T14:37:59.092820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2510, pipe: [1:7559602344081279406:11209]
2025-10-10T14:37:59.156819Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:59.157194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.157215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.157265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279406:11209], now have 1 active actors on pipe
2025-10-10T14:37:59.157521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:59.157556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:59.157619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:59.157709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2511 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0
2025-10-10T14:37:59.157894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602344081279406:11209]
2025-10-10T14:37:59.158099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:59.158107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0] Write session will restart in 0.009607s
2025-10-10T14:37:59.157928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2511 sessionId: src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0 is DEAD
2025-10-10T14:37:59.158133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0] Write session: Do CDS request
2025-10-10T14:37:59.158141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:59.168928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.168324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:59.169048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:59.169076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2512
2025-10-10T14:37:59.169230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.169265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:59.169284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:59.169297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:59.169301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:59.169508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:59.169526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:59.169540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:59.169619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:59.169680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602343299046684:11413]
2025-10-10T14:37:59.169854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2512 sessionId:  describe result for acl check
2025-10-10T14:37:59.169903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:59.169905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:59.169907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:59.169915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602344081279498:11269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:59.170299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:59.170698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602344081279498:11269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:59.170737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:59.170796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:59.171103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:59.171152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.171157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.171158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.171159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.171160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.171161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.171161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.171162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.171163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.171164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.171165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.171166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.171167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.171171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.171179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.171182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.171184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.171187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.171189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.171192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.171194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.171196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.171199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.171202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.171204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.171206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.171211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.171217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.171222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.171226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.171229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.171232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.171235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.171240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.171243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.171246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.171249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.171252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.171255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.171258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.171261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.171264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.171267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.171270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.171273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.171277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.171281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.171284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.171286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.171289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.171292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.171295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.171319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:59.173195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602344081279498:11269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:59.174534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:59.175031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:59.175046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:59.175049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:59.175053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:59.175060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2511 [2:7559602343299046684:11413]
2025-10-10T14:37:59.175086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:59.175106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:59.175116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.175120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.175122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.175145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:59.175159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:59.175167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:59.175234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.175243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.175246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.175249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:59.175319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:59.175328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.175341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.175357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.175373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:59.175397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602343299046679:11413]
2025-10-10T14:37:59.175409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602343299046679:11413]
2025-10-10T14:37:59.175412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602343299046679:11413]
2025-10-10T14:37:59.175428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:59.175445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:59.175467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:59.175475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:59.175509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602343299046679:11413]
2025-10-10T14:37:59.175518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:59.175646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:59.175657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:59.175658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:59.175665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:59.175891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279407:2438], now have 1 active actors on pipe
2025-10-10T14:37:59.176676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2511
2025-10-10T14:37:59.178998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602344081279498:11269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:59.179013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602344081279498:11269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:59.179017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602344081279498:11269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:59.179026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:59.179318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2511
2025-10-10T14:37:59.179327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279535:11269], now have 1 active actors on pipe
2025-10-10T14:37:59.179373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.179381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.179430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:59.179449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.179457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.179466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:59.179481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.179516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:59.179544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.179770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.179784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.179804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.179906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2512 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0
2025-10-10T14:37:59.181191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8ae83d1-ca7b77df-93bd3096-374b7ac4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:59.184031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0] Write session: try to update token
2025-10-10T14:37:59.184054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:59.198841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:59.198870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:59.198874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:59.198877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:59.198888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602343299046679:11413]
2025-10-10T14:37:59.198893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602343299046679:11413]
2025-10-10T14:37:59.198896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602343299046679:11413]
2025-10-10T14:37:59.198944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:59.198947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:59.198949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:59.198953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:59.198955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.198957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:59.199095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:59.202929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2512 sessionId: src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:59.205566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:59.258428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602344081279539:11209]
2025-10-10T14:37:59.258859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2511, pipe: [1:7559602344081279539:11209]
2025-10-10T14:37:59.316353Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:59.316787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.316820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.316885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279539:11209], now have 1 active actors on pipe
2025-10-10T14:37:59.317205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602344081279539:11209]
2025-10-10T14:37:59.317252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:59.317255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:59.317348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2512 reason: error at write: Disconnected sessionId: src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0
2025-10-10T14:37:59.317568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2512 sessionId: src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0 is DEAD
2025-10-10T14:37:59.317203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:59.317707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:59.317973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:59.317985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0] Write session will restart in 0.005613s
2025-10-10T14:37:59.318012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0] Write session: Do CDS request
2025-10-10T14:37:59.318018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:59.329853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.330022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:59.330038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2513
2025-10-10T14:37:59.330209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.330255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:59.330259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:59.330263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:59.330656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2513 sessionId:  describe result for acl check
2025-10-10T14:37:59.330698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:59.330700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:59.330702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:59.330708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602344081279607:11273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:59.331394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602344081279607:11273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:59.335660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602344081279607:11273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:59.337761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:59.339087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:59.339315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:59.339328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:59.339341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:59.339400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:59.339447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602343299046799:11416]
2025-10-10T14:37:59.339653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602344081279607:11273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:59.339673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602344081279607:11273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:59.339678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602344081279607:11273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:59.339689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:59.340041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:59.340476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:59.340542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:59.340851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:59.340918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.340925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.340926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.340928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.340929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.340930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.340931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.340933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.340935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.340936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.340937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.340938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.340940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.340945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.340957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.340961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.340964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.340968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.340974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.340978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.340981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.340984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.340988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.340991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.340994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.340997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.341005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.341013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.341019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.341024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.341028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.341032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.341035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.341040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.341044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.341048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.341052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.341056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.341060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.341064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.341068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.341073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.341077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.341081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.341085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.341089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.341093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.341098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.341102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.341108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.341111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.341116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.341149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:59.343816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:59.344262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:59.344277Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:59.344279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:59.344284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:59.344290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2512 [2:7559602343299046799:11416]
2025-10-10T14:37:59.344304Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:59.344323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:59.344331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.344335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.344338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.344355Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:59.344367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:59.344375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:59.344442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.344450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.344452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.344455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:59.344532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:59.344539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.344551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.344567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.344583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:59.344611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279659:11273], now have 1 active actors on pipe
2025-10-10T14:37:59.344621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279540:2438], now have 1 active actors on pipe
2025-10-10T14:37:59.344629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602343299046794:11416]
2025-10-10T14:37:59.344632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602343299046794:11416]
2025-10-10T14:37:59.344634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602343299046794:11416]
2025-10-10T14:37:59.344648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:59.344664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:59.344663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:59.344667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:59.344670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:59.344684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:59.344688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:59.344722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602343299046794:11416]
2025-10-10T14:37:59.344732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:59.344739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:59.344881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2512
2025-10-10T14:37:59.344918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2512
2025-10-10T14:37:59.344974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.344987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.345024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:59.345039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.345043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.345046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:59.345058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.345074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:59.345090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.345276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.345288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.345303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.345427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2513 partition: 0 MaxSeqNo: 40 sessionId: src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0
2025-10-10T14:37:59.345852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f29bb47-9d703c6e-3740db5-6662ff13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:59.348836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0] Write session: try to update token
2025-10-10T14:37:59.348859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:59.365727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:59.365748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:59.365757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602343299046794:11416]
2025-10-10T14:37:59.365801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:59.365832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:59.365971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:59.366111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:59.366258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:59.366385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:59.366581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:59.366637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:59.368159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2513 sessionId: src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:59.371307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.371326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.371361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:59.370768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:59.371547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:59.409617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.409649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.409854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.409917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.409980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.410037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.410537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.410542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.410627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.410686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.410745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.410807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.410846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.410849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.410921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.410976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.411035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.411094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.411132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.411153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.411222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.411283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.411341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.411399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.411440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.411443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.411527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.411588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.411647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.411706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.411752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.411755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.411823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.411882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.411941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.412000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.412038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.412041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.412106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.412162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.412221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.412282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.412323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.412326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.412396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.412453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.412515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.412590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.412631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.412634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.412699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.412755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.412814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.412879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.412920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.412922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.412991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.413048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.413114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.413188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.413229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.413232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.413875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:37:59.413969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.414006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.414009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-10T14:37:59.414057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:37:59.414081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T14:37:59.414091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T14:37:59.414094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T14:37:59.414097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T14:37:59.414550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-10T14:37:59.414583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:37:59.414606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T14:37:59.414610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T14:37:59.414614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T14:37:59.414618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T14:37:59.415594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-10T14:37:59.415625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:37:59.415634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-10T14:37:59.415637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-10T14:37:59.415641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-10T14:37:59.415644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-10T14:37:59.416244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-10T14:37:59.416273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:37:59.416284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-10T14:37:59.416289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-10T14:37:59.416296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-10T14:37:59.417560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602344081279684:11209]
2025-10-10T14:37:59.418024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2512, pipe: [1:7559602344081279684:11209]
2025-10-10T14:37:59.417862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-10T14:37:59.417891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-10T14:37:59.417909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760107079417
2025-10-10T14:37:59.418105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-10T14:37:59.418117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:37:59.418124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-10T14:37:59.418128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-10T14:37:59.418134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-10T14:37:59.418138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-10T14:37:59.418716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-10T14:37:59.418734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:37:59.418742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-10T14:37:59.418747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-10T14:37:59.418750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-10T14:37:59.418754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-10T14:37:59.419299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-10T14:37:59.419315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:37:59.419321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-10T14:37:59.419325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-10T14:37:59.419333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-10T14:37:59.419337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-10T14:37:59.419874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-10T14:37:59.419886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:37:59.419892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-10T14:37:59.421124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-10T14:37:59.421131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-10T14:37:59.421140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-10T14:37:59.421144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-10T14:37:59.421154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760107079421
2025-10-10T14:37:59.421531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-10T14:37:59.421546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:37:59.421552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-10T14:37:59.421556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-10T14:37:59.421560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-10T14:37:59.421563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-10T14:37:59.422064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 3994397 count 2 nextOffset 49 batches 8
2025-10-10T14:37:59.422079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:37:59.422085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-10T14:37:59.422091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-10T14:37:59.422096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-10T14:37:59.422101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-10T14:37:59.422606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 1 PackedSize 6247595 count 3 nextOffset 50 batches 12
2025-10-10T14:37:59.422618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.422739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,3 HeadOffset 40 endOffset 40 curOffset 50 d0000000000_00000000000000000047_00001_0000000003_00011? size 6247585 WTime 1760107079422
2025-10-10T14:37:59.425559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279684:11209], now have 1 active actors on pipe
2025-10-10T14:37:59.425569Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:37:59.425588Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-10T14:37:59.425596Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-10T14:37:59.425605Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 3 size 6247585
2025-10-10T14:37:59.425619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:59.425622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:59.425625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:59.425628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:59.425636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602343299046794:11416]
2025-10-10T14:37:59.425640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602343299046794:11416]
2025-10-10T14:37:59.425644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602343299046794:11416]
2025-10-10T14:37:59.425739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:59.425745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.425747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:59.425882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:59.428269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:59.428288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:59.428293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:59.547117Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:59.548432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:59.548493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2513 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0
2025-10-10T14:37:59.547987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:59.548564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:59.548632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602344081279684:11209]
2025-10-10T14:37:59.548781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2513 sessionId: src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0 is DEAD
2025-10-10T14:37:59.548868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:37:59.548881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0] Write session will restart in 0.005503s
2025-10-10T14:37:59.548908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0] Write session: Do CDS request
2025-10-10T14:37:59.548915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:59.552772Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [17bc54ddd16ff28f] Result# TEvPutResult {Id# [72075186224037892:2512:1:2:1:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-10T14:37:59.552814Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2512:1:2:3:6247585:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:37:59.553031Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:2512:1:2:2:7988760:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-10T14:37:59.556021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.556134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:59.556150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2514
2025-10-10T14:37:59.556294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.556335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:59.556341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:59.556344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:59.556848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2514 sessionId:  describe result for acl check
2025-10-10T14:37:59.556889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:59.556891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:59.556894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:59.556900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602344081279703:11278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:59.557526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602344081279703:11278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:59.559923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602344081279703:11278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:59.562694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602344081279703:11278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:59.562720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602344081279703:11278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:59.562724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602344081279703:11278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:59.562734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:59.563629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:59.564707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:59.564944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:59.564956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:59.564979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:59.565038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:59.565090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602343299046907:11418]
2025-10-10T14:37:59.565748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:59.566096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:59.566159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:59.566519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:59.566611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.566621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.566622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.566623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.566625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.566627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.566628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.566629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.566631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.566632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.566633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.566635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.566636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.566643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.566657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.566662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.566666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.566670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.566675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.566679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.566683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.566688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.566694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.566698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.566702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.566707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.566715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.566724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.566732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.566737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.566742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.566748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.566753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.566764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.566769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.566779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.566784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.566789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.566794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.566800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.566804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.566811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.566820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.566826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.566830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.566840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.566845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.566850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.566854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.566860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.566869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.566874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.566919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:59.569378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:59.569842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:59.569859Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:59.569861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:59.569865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:59.569872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2513 [2:7559602343299046907:11418]
2025-10-10T14:37:59.569886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:59.569907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:59.569911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.569915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.569917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.569941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:59.569958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:59.569966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:59.570031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.570038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.570040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.570043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:59.570116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:59.570126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.570139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.570149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.570166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:59.570192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602343299046902:11418]
2025-10-10T14:37:59.570200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602343299046902:11418]
2025-10-10T14:37:59.570202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602343299046902:11418]
2025-10-10T14:37:59.570213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:59.570226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:59.570229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:59.570230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:59.570233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:59.570246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:59.570249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:59.570261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279807:11278], now have 1 active actors on pipe
2025-10-10T14:37:59.570270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279688:2438], now have 1 active actors on pipe
2025-10-10T14:37:59.570299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602343299046902:11418]
2025-10-10T14:37:59.570312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:59.570319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:59.570327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2513
2025-10-10T14:37:59.570400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2513
2025-10-10T14:37:59.570446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.570456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.570490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:59.570504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.570508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.570510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:59.570523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.570535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:59.570554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.570791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.570804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.570843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.570941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2514 partition: 0 MaxSeqNo: 40 sessionId: src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0
2025-10-10T14:37:59.571363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e17221db-9cd9772f-9a6884ca-cf638ad0_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:59.574091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0] Write session: try to update token
2025-10-10T14:37:59.574110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:59.590155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2514 sessionId: src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:59.591622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:59.591643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:59.591648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:59.591650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:59.591661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602343299046902:11418]
2025-10-10T14:37:59.591665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602343299046902:11418]
2025-10-10T14:37:59.591670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602343299046902:11418]
2025-10-10T14:37:59.591720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:59.591731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.591736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:59.591738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:59.591745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:59.591750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:59.591888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:59.592909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:59.648949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602344081279820:11209]
2025-10-10T14:37:59.649520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2513, pipe: [1:7559602344081279820:11209]
2025-10-10T14:37:59.709633Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:59.710014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.710029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.710107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279820:11209], now have 1 active actors on pipe
2025-10-10T14:37:59.710350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602344081279820:11209]
2025-10-10T14:37:59.710376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:59.710380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:59.710392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:59.710466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2514 reason: error at write: Disconnected sessionId: src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0
2025-10-10T14:37:59.710870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:59.710892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0] Write session will restart in 0.007951s
2025-10-10T14:37:59.710487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:59.710919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0] Write session: Do CDS request
2025-10-10T14:37:59.710926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:59.710759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2514 sessionId: src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0 is DEAD
2025-10-10T14:37:59.721390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.722262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:59.722281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2515
2025-10-10T14:37:59.722433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.722477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:59.722490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:59.722501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:59.723103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2515 sessionId:  describe result for acl check
2025-10-10T14:37:59.723142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:59.723151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:59.723154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:59.723160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602344081279914:11282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:59.723764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602344081279914:11282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:59.723968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:59.726494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602344081279914:11282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:59.728219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:59.728489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:59.728494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:59.728508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:59.728606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:59.728704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602343299047010:11420]
2025-10-10T14:37:59.729068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602344081279914:11282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:59.729086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602344081279914:11282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:59.729090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602344081279914:11282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:59.729099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:59.729313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:59.737686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:59.737814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:59.738259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:59.738362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.738373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.738375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.738376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.738378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.738380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.738381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.738383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.738385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.738386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.738387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.738389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.738390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.738399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.738417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.738422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.738426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.738430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.738435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.738440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.738444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.738448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.738452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.738455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.738459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.738462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.738473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.738483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.738491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.738498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.738504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.738516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.738521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.738528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.738535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.738545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.738551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.738556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.738568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.738574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.738596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.738608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.738616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.738628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.738633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.738648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.738655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.738661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.738666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.738672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.738678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.738686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.738740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:59.742386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:59.742934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:59.742952Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:59.742954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:59.742959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:59.742968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2514 [2:7559602343299047010:11420]
2025-10-10T14:37:59.742987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:59.743017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:59.743025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.743030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.743033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.743054Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:59.743070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:59.743080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:59.743160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.743163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.743165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.743168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:59.743250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:59.743253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.743268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.743282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.743300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:59.743324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602343299047004:11420]
2025-10-10T14:37:59.743327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602343299047004:11420]
2025-10-10T14:37:59.743329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602343299047004:11420]
2025-10-10T14:37:59.743344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:59.743360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:59.743378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:59.743383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:59.743424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602343299047004:11420]
2025-10-10T14:37:59.743427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:59.747410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:59.747431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:59.747433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:59.747446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:59.748547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279944:11282], now have 1 active actors on pipe
2025-10-10T14:37:59.748567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279822:2438], now have 1 active actors on pipe
2025-10-10T14:37:59.748636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2514
2025-10-10T14:37:59.748676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2514
2025-10-10T14:37:59.749107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.749124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.749168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:59.749203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.749214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.749217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:59.749233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.749258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:59.749289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.752941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.752966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.753007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.753124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2515 partition: 0 MaxSeqNo: 40 sessionId: src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0
2025-10-10T14:37:59.753592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c06e52-3e7a58d2-c4dbf94a-e6b54960_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:59.756457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0] Write session: try to update token
2025-10-10T14:37:59.756482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:59.774695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2515 sessionId: src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:59.777607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:59.781615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.781647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.781733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:59.783899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:59.783926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:59.783931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:59.783935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:59.784009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602343299047004:11420]
2025-10-10T14:37:59.784027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602343299047004:11420]
2025-10-10T14:37:59.784030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602343299047004:11420]
2025-10-10T14:37:59.784085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:59.784092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:59.784094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.784096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:59.784100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:59.784108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:59.784266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:37:59.781845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:59.810224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602344081279960:11209]
2025-10-10T14:37:59.810830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2514, pipe: [1:7559602344081279960:11209]
2025-10-10T14:37:59.907328Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:37:59.916470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.916508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.916726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.916801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.916872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.916941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.917536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.917557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.917661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.917756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.917835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.917910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.918137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.918141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.918225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.918294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.918363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.918436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.918479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.918482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.918556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.918648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.918715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.918784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.918831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.918835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.918909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.918970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.919036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.919106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.919150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.919153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.919234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.919297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.919370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.919448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.919499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.919502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.919589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.919666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.919746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.919823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.919872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.919890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.919967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.920035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.920108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.920183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.920236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.920255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.920338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.920428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.920520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.920613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.920661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.920665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.920747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:37:59.920822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:37:59.920902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:37:59.920976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:37:59.921026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:37:59.921029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:37:59.921106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279960:11209], now have 1 active actors on pipe
2025-10-10T14:37:59.921437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:37:59.921456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:37:59.921495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2515 reason: error at write: Disconnected sessionId: src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0
2025-10-10T14:37:59.921902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602344081279960:11209]
2025-10-10T14:37:59.921931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:37:59.922135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2515 sessionId: src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0 is DEAD
2025-10-10T14:37:59.921798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:37:59.922280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:37:59.922289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0] Write session will restart in 0.008084s
2025-10-10T14:37:59.922308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0] Write session: Do CDS request
2025-10-10T14:37:59.922313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:37:59.932029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.932919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:37:59.932938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2516
2025-10-10T14:37:59.933121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:37:59.933161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:37:59.933173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:37:59.933177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:37:59.933621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2516 sessionId:  describe result for acl check
2025-10-10T14:37:59.933661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:37:59.933664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:37:59.933666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:37:59.933673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602344081280007:11296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:37:59.934303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602344081280007:11296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:37:59.937778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602344081280007:11296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:37:59.941963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:37:59.942110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602344081280007:11296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:37:59.942128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602344081280007:11296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:37:59.942132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602344081280007:11296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:37:59.942142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:37:59.943273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:37:59.943491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:37:59.943506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:37:59.943519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:37:59.943582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:37:59.943629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602343299047154:11435]
2025-10-10T14:37:59.944237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:37:59.944571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:37:59.944621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:37:59.945003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:37:59.945091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.945098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.945100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.945101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.945103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.945104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.945105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.945107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.945109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.945110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.945111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.945113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.945114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.945120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.945134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.945139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.945143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.945147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.945152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.945156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.945160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.945165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.945168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.945173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.945177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.945181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.945190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.945199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:37:59.945206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.945213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:37:59.945218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.945224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:37:59.945230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.945235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:37:59.945247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.945253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:37:59.945258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.945264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:37:59.945270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.945275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:37:59.945287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.945293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:37:59.945302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.945308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:37:59.945317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.945324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:37:59.945355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.945370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.945375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.945381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.945386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.945392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.945436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:37:59.947967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:37:59.948346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:37:59.948361Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:37:59.948364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:37:59.948370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:37:59.948378Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2515 [2:7559602343299047154:11435]
2025-10-10T14:37:59.948392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:37:59.948410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:37:59.948418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.948422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.948424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.948442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:37:59.948454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:37:59.948463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:37:59.948521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.948530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.948532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.948535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:37:59.948619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:37:59.948628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.948640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:37:59.948659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:37:59.948682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:37:59.948769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2515
2025-10-10T14:37:59.948815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2515
2025-10-10T14:37:59.948709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081279992:2438], now have 1 active actors on pipe
2025-10-10T14:37:59.948721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602344081280111:11296], now have 1 active actors on pipe
2025-10-10T14:37:59.948730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602343299047148:11435]
2025-10-10T14:37:59.948732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602343299047148:11435]
2025-10-10T14:37:59.948735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602343299047148:11435]
2025-10-10T14:37:59.948749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:37:59.948761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:37:59.948765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:37:59.948767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:37:59.948767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:37:59.948786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:37:59.948790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:37:59.948814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602343299047148:11435]
2025-10-10T14:37:59.948818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:37:59.948820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:37:59.948949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.948964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.948995Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:37:59.949005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:37:59.949014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:37:59.949016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:37:59.949031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:37:59.949048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:37:59.949064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.949255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.949273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.949299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:37:59.949880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae90a94c-d22740fa-3da15328-ca99fe1e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:37:59.949470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2516 partition: 0 MaxSeqNo: 40 sessionId: src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0
2025-10-10T14:37:59.952693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0] Write session: try to update token
2025-10-10T14:37:59.952711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:37:59.961235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:37:59.961260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:59.961271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602343299047148:11435]
2025-10-10T14:37:59.961344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:37:59.961345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:37:59.961550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:37:59.961713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:59.961847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:59.961983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:37:59.962179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:37:59.962218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:37:59.969586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2516 sessionId: src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:37:59.972256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:37:59.972496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:37:59.972527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:37:59.972573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:37:59.972659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:37:59.979019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:37:59.979046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:37:59.979049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:37:59.979050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:37:59.979063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602343299047148:11435]
2025-10-10T14:37:59.979066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602343299047148:11435]
2025-10-10T14:37:59.979071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602343299047148:11435]
2025-10-10T14:37:59.979112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:37:59.979123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:37:59.979124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:37:59.979126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:37:59.979131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:37:59.979139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:37:59.979263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:00.022392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602348376247419:11209]
2025-10-10T14:38:00.022690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2515, pipe: [1:7559602348376247419:11209]
2025-10-10T14:38:00.097080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:00.105866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.105904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.106099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.106173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.106248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.106318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.106659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.106680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.106755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.106813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.106889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.106964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.107005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.107007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.107084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.107148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.107215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.107285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.107329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.107333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.107411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.107477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.107541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.107607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.107647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.107651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.107730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.107790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.107848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.107910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.107950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.107953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.108021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.108076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.108133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.108198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.108238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.108241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.108311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.108368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.108434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.108496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.108542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.108545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.108605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.108662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.108723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.108783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.108826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.108828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.108888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.108942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.109004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.109070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.109111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.109113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.109173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:00.109228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:00.109291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:00.109613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:00.109667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:00.109675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:00.109740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247419:11209], now have 1 active actors on pipe
2025-10-10T14:38:00.110068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:00.110082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602348376247419:11209]
2025-10-10T14:38:00.110119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:00.110122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:00.110168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2516 reason: error at write: Disconnected sessionId: src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0
2025-10-10T14:38:00.110471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2516 sessionId: src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0 is DEAD
2025-10-10T14:38:00.110564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:00.110591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0] Write session will restart in 0.007069s
2025-10-10T14:38:00.110589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:00.110632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0] Write session: Do CDS request
2025-10-10T14:38:00.110639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:00.118965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.119067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:00.119086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2517
2025-10-10T14:38:00.119238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.119283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:00.119290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:00.119294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:00.119815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2517 sessionId:  describe result for acl check
2025-10-10T14:38:00.119862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:00.119869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:00.119871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:00.119878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602348376247513:11300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:00.120549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602348376247513:11300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:00.120736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:00.122270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:00.122504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:00.122514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:00.122527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:00.122603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:00.122647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602347594014557:11437]
2025-10-10T14:38:00.123232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:00.123516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:00.123561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:00.123640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602348376247513:11300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:00.123838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:00.123899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.123905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.123907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.123908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.123909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.123910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.123912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.123913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.123914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.123915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.123917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.123918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.123919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.123925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.123949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.123954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.123958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.123963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.123967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.123971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.123976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.123980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.123985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.123989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.123993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.123997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.124004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.124013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.124020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.124026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.124030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.124035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.124039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.124045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.124049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.124055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.124065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.124071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.124076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.124081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.124091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.124096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.124100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.124111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.124116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.124121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.124131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.124136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.124144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.124149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.124153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.124163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.124200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:00.126642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602348376247513:11300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:00.126657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602348376247513:11300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:00.126661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602348376247513:11300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:00.126670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:00.126735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:00.127124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:00.127139Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:00.127141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:00.127145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:00.127152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2516 [2:7559602347594014557:11437]
2025-10-10T14:38:00.127169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:00.127187Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:00.127191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.127195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.127197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.127215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:00.127236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:00.127244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:00.127324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.127332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.127334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.127337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:00.127402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:00.127411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.127422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.127432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.127448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:00.127476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247422:2438], now have 1 active actors on pipe
2025-10-10T14:38:00.127485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247550:11300], now have 1 active actors on pipe
2025-10-10T14:38:00.127493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602347594014551:11437]
2025-10-10T14:38:00.127495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602347594014551:11437]
2025-10-10T14:38:00.127497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602347594014551:11437]
2025-10-10T14:38:00.127512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:00.127528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:00.127523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2516
2025-10-10T14:38:00.127543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:00.127531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2516
2025-10-10T14:38:00.127548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:00.127552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:00.127555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:00.127557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:00.127578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602347594014551:11437]
2025-10-10T14:38:00.127581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:00.127583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:00.127607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.127618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.127654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96aca519-62f5f016-6a481f8c-8a049835_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:00.127669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.127674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.127677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:00.127689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.127700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:00.127718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.127874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.127884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.127902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.128001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2517 partition: 0 MaxSeqNo: 40 sessionId: src_id|96aca519-62f5f016-6a481f8c-8a049835_0
2025-10-10T14:38:00.128484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a443bf20-559c443a-1fd2b3c9-482264e1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|96aca519-62f5f016-6a481f8c-8a049835_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:00.131934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96aca519-62f5f016-6a481f8c-8a049835_0] Write session: try to update token
2025-10-10T14:38:00.131966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96aca519-62f5f016-6a481f8c-8a049835_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:00.133072Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:38:00.132736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:38:00.132778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-10-10T14:38:00.133365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 17 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:38:00.133398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:38:00.147958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:00.147984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:00.147988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:00.147990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:00.148002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602347594014551:11437]
2025-10-10T14:38:00.148008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602347594014551:11437]
2025-10-10T14:38:00.148012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602347594014551:11437]
2025-10-10T14:38:00.148071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:00.148084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:00.148087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:00.148091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:00.148098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.148105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:00.148254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:00.150583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2517 sessionId: src_id|96aca519-62f5f016-6a481f8c-8a049835_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:00.153876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:00.210106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602348376247563:11209]
2025-10-10T14:38:00.210804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2516, pipe: [1:7559602348376247563:11209]
2025-10-10T14:38:00.272131Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:00.272438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.272456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.272505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247563:11209], now have 1 active actors on pipe
2025-10-10T14:38:00.272747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:00.272840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602348376247563:11209]
2025-10-10T14:38:00.272841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:00.272891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:00.272907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-10T14:38:00.272951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2517 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96aca519-62f5f016-6a481f8c-8a049835_0
2025-10-10T14:38:00.273177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2517 sessionId: src_id|96aca519-62f5f016-6a481f8c-8a049835_0 is DEAD
2025-10-10T14:38:00.273321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96aca519-62f5f016-6a481f8c-8a049835_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:00.273346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96aca519-62f5f016-6a481f8c-8a049835_0] Write session will restart in 0.007258s
2025-10-10T14:38:00.273377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96aca519-62f5f016-6a481f8c-8a049835_0] Write session: Do CDS request
2025-10-10T14:38:00.273384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96aca519-62f5f016-6a481f8c-8a049835_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:00.281910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96aca519-62f5f016-6a481f8c-8a049835_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.282027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:00.282045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2518
2025-10-10T14:38:00.282230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.282276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:00.282287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:00.282313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:00.282842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2518 sessionId:  describe result for acl check
2025-10-10T14:38:00.282883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:00.282885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:00.282887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:00.282895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602348376247645:11304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:00.283488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602348376247645:11304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:00.285168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:00.285964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602348376247645:11304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:00.286589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:00.286791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:00.286803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:00.286815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:00.286867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:00.286917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602347594014677:11441]
2025-10-10T14:38:00.287523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:00.287897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:00.287954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:00.288314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:00.288393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.288401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.288402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.288403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.288404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.288405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.288406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.288408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.288409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.288410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.288411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.288413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.288414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.288420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.288432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.288436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.288440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.288443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.288447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.288451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.288455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.288459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.288463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.288466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.288469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.288473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.288481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.288489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.288496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.288501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.288506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.288511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.288516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.288520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.288525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.288530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.288534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.288549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.288554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.288560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.288564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.288569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.288574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.288580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.288584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.288589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.288594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.288600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.288604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.288609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.288614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.288619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.288637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602348376247645:11304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:00.288660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:00.288651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602348376247645:11304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:00.288655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602348376247645:11304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:00.288664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:00.291250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:00.291608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:00.291624Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:00.291627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:00.291631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:00.291638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2517 [2:7559602347594014677:11441]
2025-10-10T14:38:00.291653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:00.291677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:00.291680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.291684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.291686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.291705Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:00.291718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:00.291727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:00.291803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.291811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.291813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.291816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:00.291887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:00.291897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.291910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.291927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.291950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:00.291978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247567:2438], now have 1 active actors on pipe
2025-10-10T14:38:00.291989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247694:11304], now have 1 active actors on pipe
2025-10-10T14:38:00.291996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602347594014672:11441]
2025-10-10T14:38:00.291999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602347594014672:11441]
2025-10-10T14:38:00.292001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602347594014672:11441]
2025-10-10T14:38:00.292015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:00.292032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:00.292032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:00.292036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:00.292038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:00.292054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:00.292058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:00.292090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602347594014672:11441]
2025-10-10T14:38:00.292100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:00.292103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:00.292089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2517
2025-10-10T14:38:00.292142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2517
2025-10-10T14:38:00.292222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.292235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.292302Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 80296142 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:38:00.292349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:00.292362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.292366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.292373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:00.292385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.292400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:00.292419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.292540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 18 DataSize: 80296142 UsedReserveSize: 0
2025-10-10T14:38:00.292577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:38:00.292677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.292696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.292731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.292812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2518 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0
2025-10-10T14:38:00.293176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96aca519-62f5f016-6a481f8c-8a049835_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:00.296105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0] Write session: try to update token
2025-10-10T14:38:00.296130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:00.312548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:00.312573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:00.312577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:00.312580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:00.312591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602347594014672:11441]
2025-10-10T14:38:00.312597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602347594014672:11441]
2025-10-10T14:38:00.312601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602347594014672:11441]
2025-10-10T14:38:00.312656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:00.312661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:00.312663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:00.312668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:00.312669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.312672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:00.312854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:00.313254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2518 sessionId: src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:00.316363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:00.372950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602348376247719:11209]
2025-10-10T14:38:00.373317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2517, pipe: [1:7559602348376247719:11209]
2025-10-10T14:38:00.436467Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:00.436940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.436965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.437015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247719:11209], now have 1 active actors on pipe
2025-10-10T14:38:00.437240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:00.437244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:00.437266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602348376247719:11209]
2025-10-10T14:38:00.437303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:00.437306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:00.437386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2518 reason: error at write: Disconnected sessionId: src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0
2025-10-10T14:38:00.437623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2518 sessionId: src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0 is DEAD
2025-10-10T14:38:00.437769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:00.437781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0] Write session will restart in 0.006225s
2025-10-10T14:38:00.437821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0] Write session: Do CDS request
2025-10-10T14:38:00.437828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:00.444953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.445093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:00.445111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2519
2025-10-10T14:38:00.445279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.445352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:00.445363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:00.445371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:00.445877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2519 sessionId:  describe result for acl check
2025-10-10T14:38:00.445924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:00.445931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:00.445933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:00.445940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602348376247797:11309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:00.446580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602348376247797:11309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:00.448280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:00.449078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602348376247797:11309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:00.449433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:00.449651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:00.449671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:00.449684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:00.449746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:00.449798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602347594014786:11445]
2025-10-10T14:38:00.450484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:00.450951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:00.451012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:00.451336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:00.451391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.451397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.451398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.451400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.451401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.451403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.451404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.451405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.451406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.451408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.451409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.451410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.451411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.451417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.451430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.451434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.451438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.451442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.451447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.451451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.451455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.451459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.451463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.451467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.451471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.451475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.451482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.451491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.451497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.451503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.451508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.451513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.451517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.451522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.451527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.451532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.451536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.451541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.451546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.451552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.451556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.451562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.451567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.451578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.451582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.451588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.451598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.451603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.451607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.451613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.451622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.451628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.451674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:00.451942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602348376247797:11309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:00.451956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602348376247797:11309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:00.451959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602348376247797:11309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:00.451968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:00.454092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:00.454445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:00.454461Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:00.454464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:00.454468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:00.454475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2518 [2:7559602347594014786:11445]
2025-10-10T14:38:00.454489Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:00.454507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:00.454516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.454519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.454522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.454539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:00.454552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:00.454559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:00.454633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.454639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.454641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.454644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:00.454713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:00.454721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.454743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.454757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.454778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:00.454807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247853:11309], now have 1 active actors on pipe
2025-10-10T14:38:00.454815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247723:2438], now have 1 active actors on pipe
2025-10-10T14:38:00.454823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602347594014780:11445]
2025-10-10T14:38:00.454825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602347594014780:11445]
2025-10-10T14:38:00.454828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602347594014780:11445]
2025-10-10T14:38:00.454844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:00.454859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2518
2025-10-10T14:38:00.454859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:00.454879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:00.454883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:00.454889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:00.454892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:00.454894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:00.454912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602347594014780:11445]
2025-10-10T14:38:00.454919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:00.454929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:00.454904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2518
2025-10-10T14:38:00.454954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.454963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.454997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:00.455010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.455014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.455020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:00.455032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.455047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:00.455070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.455270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.455292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.455316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.455435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2519 partition: 0 MaxSeqNo: 40 sessionId: src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0
2025-10-10T14:38:00.455866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f6d061-eaf95738-6b5108bd-ac36dbdf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:00.458642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0] Write session: try to update token
2025-10-10T14:38:00.458662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:00.473676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2519 sessionId: src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:00.476617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:00.475611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:00.475635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:00.475639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:00.475641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:00.475652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602347594014780:11445]
2025-10-10T14:38:00.475658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602347594014780:11445]
2025-10-10T14:38:00.475667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602347594014780:11445]
2025-10-10T14:38:00.475717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:00.475724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:00.475725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:00.475729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:00.475734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.475736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:00.475885Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:00.537318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602348376247861:11209]
2025-10-10T14:38:00.537823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2518, pipe: [1:7559602348376247861:11209]
2025-10-10T14:38:00.596376Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:00.596865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.596876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.596925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247861:11209], now have 1 active actors on pipe
2025-10-10T14:38:00.597171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:00.597280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602348376247861:11209]
2025-10-10T14:38:00.597588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:00.597611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:00.597685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2519 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0
2025-10-10T14:38:00.597889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2519 sessionId: src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0 is DEAD
2025-10-10T14:38:00.598084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:00.598097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0] Write session will restart in 0.005086s
2025-10-10T14:38:00.598136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0] Write session: Do CDS request
2025-10-10T14:38:00.598144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:00.604988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.605043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:00.605061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2520
2025-10-10T14:38:00.605211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.605241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:00.605245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:00.605252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:00.605727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2520 sessionId:  describe result for acl check
2025-10-10T14:38:00.605778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:00.605781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:00.605783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:00.605790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602348376247924:11313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:00.606428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602348376247924:11313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:00.608641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602348376247924:11313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:00.608956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:00.610179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:00.610397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:00.610415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:00.610429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:00.610470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:00.610506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602347594014895:11447]
2025-10-10T14:38:00.610963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:00.611175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602348376247924:11313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:00.611190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602348376247924:11313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:00.611194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602348376247924:11313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:00.611203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:00.611240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:00.611278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:00.611526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:00.611573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.611578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.611578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.611579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.611580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.611581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.611582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.611583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.611583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.611584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.611585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.611586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.611586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.611590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.611599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.611602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.611604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.611607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.611609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.611612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.611615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.611617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.611619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.611622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.611624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.611626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.611632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.611638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.611642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.611646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.611649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.611652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.611655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.611658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.611661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.611664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.611668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.611671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.611676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.611679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.611682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.611685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.611688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.611691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.611694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.611697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.611701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.611704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.611706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.611710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.611713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.611716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.611739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:00.614110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:00.614456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:00.614471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:00.614475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:00.614478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:00.614484Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2519 [2:7559602347594014895:11447]
2025-10-10T14:38:00.614493Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:00.614509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:00.614512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.614515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.614516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.614531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:00.614539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:00.614545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:00.614626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.614628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.614629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.614631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:00.614690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:00.614694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.614706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.614719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.614896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2519
2025-10-10T14:38:00.614933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2519
2025-10-10T14:38:00.614736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:00.614758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602347594014889:11447]
2025-10-10T14:38:00.614760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602347594014889:11447]
2025-10-10T14:38:00.614761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602347594014889:11447]
2025-10-10T14:38:00.614773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:00.614786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:00.614787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:00.614789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:00.614791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:00.615437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2520 partition: 0 MaxSeqNo: 40 sessionId: src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0
2025-10-10T14:38:00.614803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:00.614806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:00.614817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247991:11313], now have 1 active actors on pipe
2025-10-10T14:38:00.614822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376247862:2438], now have 1 active actors on pipe
2025-10-10T14:38:00.614844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602347594014889:11447]
2025-10-10T14:38:00.614852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:00.614856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:00.615015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.615022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.615057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:00.615066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.615070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.615073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:00.615084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.615095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:00.615113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.615264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.615298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.615314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.615990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a590810c-878d4f9c-9fbacb30-f5df8b60_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:00.618979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0] Write session: try to update token
2025-10-10T14:38:00.619002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:00.636800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2520 sessionId: src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:00.638794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:00.638814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:00.638817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:00.638819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:00.638830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602347594014889:11447]
2025-10-10T14:38:00.638835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602347594014889:11447]
2025-10-10T14:38:00.638839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602347594014889:11447]
2025-10-10T14:38:00.638892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:00.638907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.638909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:00.639058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:00.639062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:00.639065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:00.639160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:00.639672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:00.697579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602348376248001:11209]
2025-10-10T14:38:00.697957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2519, pipe: [1:7559602348376248001:11209]
2025-10-10T14:38:00.764497Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:00.764844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.764857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.764909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376248001:11209], now have 1 active actors on pipe
2025-10-10T14:38:00.765309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:00.766037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602348376248001:11209]
2025-10-10T14:38:00.766076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:00.766151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2520 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0
2025-10-10T14:38:00.766354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2520 sessionId: src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0 is DEAD
2025-10-10T14:38:00.766618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:00.769562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:00.769577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0] Write session will restart in 0.006579s
2025-10-10T14:38:00.769606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0] Write session: Do CDS request
2025-10-10T14:38:00.769613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:00.777930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.778286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:00.778304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2521
2025-10-10T14:38:00.778440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.778471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:00.778477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:00.778482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:00.779023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2521 sessionId:  describe result for acl check
2025-10-10T14:38:00.779061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:00.779066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:00.779070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:00.779078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602348376248017:11318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:00.779712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602348376248017:11318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:00.782340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602348376248017:11318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:00.785474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602348376248017:11318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:00.785491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602348376248017:11318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:00.785495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602348376248017:11318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:00.785505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:00.790657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:00.792181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:00.792393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:00.792406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:00.792420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:00.792473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:00.792523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602347594015006:11449]
2025-10-10T14:38:00.793173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:00.793621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:00.793674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:00.794016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:00.794078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.794079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.794081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.794082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.794083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.794085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.794087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.794089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.794090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.794092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.794093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.794094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.794096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.794103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.794117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.794122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.794126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.794130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.794135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.794139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.794143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.794148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.794152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.794156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.794161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.794165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.794174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.794184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.794191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.794197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.794202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.794208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.794212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.794218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.794223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.794228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.794234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.794240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.794245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.794251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.794255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.794261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.794266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.794272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.794277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.794283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.794288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.794294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.794298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.794304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.794309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.794315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.794360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:00.797309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:00.797670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:00.797681Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:00.797683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:00.797686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:00.797692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2520 [2:7559602347594015006:11449]
2025-10-10T14:38:00.797703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:00.797719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:00.797721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.797724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.797727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.797739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:00.797744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:00.797751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:00.797814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.797816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.797818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.797820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:00.797884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:00.797887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.797899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.797910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.797927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:00.797946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602347594015001:11449]
2025-10-10T14:38:00.797948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602347594015001:11449]
2025-10-10T14:38:00.797950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602347594015001:11449]
2025-10-10T14:38:00.797961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:00.797973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:00.797985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:00.797987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:00.798010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602347594015001:11449]
2025-10-10T14:38:00.798012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:00.798107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:00.798109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:00.798110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:00.798114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:00.798631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376248002:2438], now have 1 active actors on pipe
2025-10-10T14:38:00.798639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376248062:11318], now have 1 active actors on pipe
2025-10-10T14:38:00.798655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.798659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.798684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|360d780b-73604118-949bc778-fc6a198e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:00.798691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.798695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.798697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:00.798706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.798716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:00.798726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.798329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2520
2025-10-10T14:38:00.798372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2520
2025-10-10T14:38:00.800816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.800833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.800858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.800990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2521 partition: 0 MaxSeqNo: 40 sessionId: src_id|360d780b-73604118-949bc778-fc6a198e_0
2025-10-10T14:38:00.801385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d541f6c-429fd9c6-fd8e321-1d864997_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|360d780b-73604118-949bc778-fc6a198e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:00.804215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|360d780b-73604118-949bc778-fc6a198e_0] Write session: try to update token
2025-10-10T14:38:00.804234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|360d780b-73604118-949bc778-fc6a198e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:00.823438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:00.823466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:00.823470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:00.823473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:00.823485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602347594015001:11449]
2025-10-10T14:38:00.823491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602347594015001:11449]
2025-10-10T14:38:00.823496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602347594015001:11449]
2025-10-10T14:38:00.823559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:00.823558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:00.823568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.823571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:00.823573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:00.823578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:00.823726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:00.824152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2521 sessionId: src_id|360d780b-73604118-949bc778-fc6a198e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:00.827004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:00.869437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602348376248151:11209]
2025-10-10T14:38:00.870516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2520, pipe: [1:7559602348376248151:11209]
2025-10-10T14:38:00.953688Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:00.954076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.954087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.954135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376248151:11209], now have 1 active actors on pipe
2025-10-10T14:38:00.954525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:00.954602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602348376248151:11209]
2025-10-10T14:38:00.954623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:00.954626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:00.954710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2521 reason: error at write: Disconnected sessionId: src_id|360d780b-73604118-949bc778-fc6a198e_0
2025-10-10T14:38:00.954925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2521 sessionId: src_id|360d780b-73604118-949bc778-fc6a198e_0 is DEAD
2025-10-10T14:38:00.955359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360d780b-73604118-949bc778-fc6a198e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:00.955368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360d780b-73604118-949bc778-fc6a198e_0] Write session will restart in 0.005692s
2025-10-10T14:38:00.955394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360d780b-73604118-949bc778-fc6a198e_0] Write session: Do CDS request
2025-10-10T14:38:00.955400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360d780b-73604118-949bc778-fc6a198e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:00.954652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:00.961892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|360d780b-73604118-949bc778-fc6a198e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.962002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:00.962017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2522
2025-10-10T14:38:00.962644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:00.962692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:00.962698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:00.962702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:00.963148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2522 sessionId:  describe result for acl check
2025-10-10T14:38:00.963175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:00.963177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:00.963179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:00.963185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602348376248195:11331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:00.963786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602348376248195:11331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:00.967798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602348376248195:11331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:00.968953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:00.970228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:00.970546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:00.970571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:00.970584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:00.970649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:00.970693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602347594015154:11464]
2025-10-10T14:38:00.971356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:00.971695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:00.971749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:00.972106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:00.972162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.972167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.972168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.972169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.972170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.972170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.972171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.972172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.972173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.972173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.972174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.972175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.972175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.972180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.972190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.972193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.972195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.972198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.972200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.972202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.972204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.972206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.972209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.972211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.972213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.972215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.972223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.972229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:00.972234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.972240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:00.972243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.972246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:00.972249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.972252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:00.972255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.972258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:00.972261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.972264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:00.972267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.972270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:00.972273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.972276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:00.972279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.972283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:00.972285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.972289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:00.972291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.972294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.972297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.972300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.972302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.972306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.972329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:00.974856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602348376248195:11331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:00.974875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602348376248195:11331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:00.974880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602348376248195:11331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:00.974891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:00.975505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:00.976007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:00.976023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:00.976026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:00.976030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:00.976037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2521 [2:7559602347594015154:11464]
2025-10-10T14:38:00.976052Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:00.976071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:00.976083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.976088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.976090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.976109Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:00.976119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:00.976127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:00.976190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.976198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.976200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.976203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:00.976275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:00.976283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.976295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:00.976310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:00.976333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:00.976362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376248180:2438], now have 1 active actors on pipe
2025-10-10T14:38:00.976370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602348376248311:11331], now have 1 active actors on pipe
2025-10-10T14:38:00.976379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602347594015148:11464]
2025-10-10T14:38:00.976386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602347594015148:11464]
2025-10-10T14:38:00.976389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602347594015148:11464]
2025-10-10T14:38:00.976406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:00.976393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2521
2025-10-10T14:38:00.976423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:00.976408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2521
2025-10-10T14:38:00.976426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:00.976427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:00.976429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:00.976458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:00.976462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:00.976513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.976522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.976538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602347594015148:11464]
2025-10-10T14:38:00.976552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:00.976574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:00.976591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:00.976599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:00.976603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:00.976606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:00.976621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:00.976632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:00.976656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.977012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:00.977029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:00.977052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:00.977190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2522 partition: 0 MaxSeqNo: 40 sessionId: src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0
2025-10-10T14:38:00.977633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|360d780b-73604118-949bc778-fc6a198e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:00.980387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0] Write session: try to update token
2025-10-10T14:38:00.980405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:00.997750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:00.997775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:00.997781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:00.997783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:00.997795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602347594015148:11464]
2025-10-10T14:38:00.997800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602347594015148:11464]
2025-10-10T14:38:00.997804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602347594015148:11464]
2025-10-10T14:38:00.997859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:00.997874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:00.997876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:00.998025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:00.998089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:00.998104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:00.998109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:00.995620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2522 sessionId: src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:00.998406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:01.052405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602352671215614:11209]
2025-10-10T14:38:01.052773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2521, pipe: [1:7559602352671215614:11209]
2025-10-10T14:38:01.119044Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:01.119403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.119423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.119475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671215614:11209], now have 1 active actors on pipe
2025-10-10T14:38:01.119730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:01.119748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:01.119763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:01.119765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602352671215614:11209]
2025-10-10T14:38:01.119787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:01.119830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2522 reason: error at write: Disconnected sessionId: src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0
2025-10-10T14:38:01.120023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2522 sessionId: src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0 is DEAD
2025-10-10T14:38:01.120196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:01.120208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0] Write session will restart in 0.005735s
2025-10-10T14:38:01.120234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0] Write session: Do CDS request
2025-10-10T14:38:01.120253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:01.129890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.130062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:01.130081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2523
2025-10-10T14:38:01.130414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.130453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:01.130460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:01.130464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:01.130947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2523 sessionId:  describe result for acl check
2025-10-10T14:38:01.130985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:01.130990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:01.130992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:01.130999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602352671215714:11335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:01.131633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602352671215714:11335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:01.132948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:01.134138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602352671215714:11335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:01.136441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:01.136715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:01.136721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:01.136736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:01.136797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:01.136839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602351888982564:11467]
2025-10-10T14:38:01.137514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:01.137780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602352671215714:11335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:01.137805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602352671215714:11335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:01.137809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602352671215714:11335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:01.137819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:01.138083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:01.138140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:01.138504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:01.138589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.138591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.138592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.138594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.138595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.138597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.138599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.138600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.138602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.138604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.138605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.138607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.138609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.138616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.138630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.138635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.138639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.138644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.138650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.138654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.138658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.138663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.138667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.138672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.138676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.138681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.138689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.138699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.138706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.138712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.138717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.138723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.138728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.138734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.138739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.138747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.138752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.138759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.138764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.138769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.138774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.138779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.138783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.138789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.138793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.138799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.138804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.138809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.138814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.138820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.138827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.138833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.138870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:01.141572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:01.142026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:01.142031Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:01.142035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:01.142039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:01.142047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2522 [2:7559602351888982564:11467]
2025-10-10T14:38:01.142491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2522
2025-10-10T14:38:01.142062Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:01.142082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:01.142498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2522
2025-10-10T14:38:01.142086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.142089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.142092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.142112Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:01.142124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:01.142133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:01.142196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.142198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.142202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.142204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:01.142282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:01.142285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.142299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.142313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.142331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:01.142352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602351888982559:11467]
2025-10-10T14:38:01.142354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602351888982559:11467]
2025-10-10T14:38:01.142356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602351888982559:11467]
2025-10-10T14:38:01.142365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:01.142381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:01.142381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:01.142385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:01.142387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:01.142399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:01.142403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:01.142418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671215749:11335], now have 1 active actors on pipe
2025-10-10T14:38:01.142422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671215617:2438], now have 1 active actors on pipe
2025-10-10T14:38:01.142452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602351888982559:11467]
2025-10-10T14:38:01.142463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:01.142484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:01.142714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.142731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.142783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|922fc369-859455ee-3e73ae6b-36d43433_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:01.142801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.142810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.142815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:01.142836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.142855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:01.142879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.143113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.143125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.143147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.143249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2523 partition: 0 MaxSeqNo: 40 sessionId: src_id|922fc369-859455ee-3e73ae6b-36d43433_0
2025-10-10T14:38:01.143682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70203c0-b7bfa47d-a6ae9fed-610e2a7d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|922fc369-859455ee-3e73ae6b-36d43433_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:01.146678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922fc369-859455ee-3e73ae6b-36d43433_0] Write session: try to update token
2025-10-10T14:38:01.146701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922fc369-859455ee-3e73ae6b-36d43433_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:01.167941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:01.167962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:01.167966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:01.167968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:01.167978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602351888982559:11467]
2025-10-10T14:38:01.167983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602351888982559:11467]
2025-10-10T14:38:01.167987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602351888982559:11467]
2025-10-10T14:38:01.168047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:01.168062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.168061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:01.168065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:01.168068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:01.168077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:01.168215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:01.171750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2523 sessionId: src_id|922fc369-859455ee-3e73ae6b-36d43433_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:01.174619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:01.219801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602352671215759:11209]
2025-10-10T14:38:01.220139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2522, pipe: [1:7559602352671215759:11209]
2025-10-10T14:38:01.288855Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:01.289496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.289523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.289581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671215759:11209], now have 1 active actors on pipe
2025-10-10T14:38:01.290018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:01.289849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:01.289856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:01.289875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:01.289923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602352671215759:11209]
2025-10-10T14:38:01.289973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2523 reason: error at write: Disconnected sessionId: src_id|922fc369-859455ee-3e73ae6b-36d43433_0
2025-10-10T14:38:01.290201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2523 sessionId: src_id|922fc369-859455ee-3e73ae6b-36d43433_0 is DEAD
2025-10-10T14:38:01.290359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922fc369-859455ee-3e73ae6b-36d43433_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:01.290368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922fc369-859455ee-3e73ae6b-36d43433_0] Write session will restart in 0.008975s
2025-10-10T14:38:01.290400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922fc369-859455ee-3e73ae6b-36d43433_0] Write session: Do CDS request
2025-10-10T14:38:01.290409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922fc369-859455ee-3e73ae6b-36d43433_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:01.300880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922fc369-859455ee-3e73ae6b-36d43433_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.301541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:01.301566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2524
2025-10-10T14:38:01.301715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.301758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:01.301770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:01.301774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:01.302937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2524 sessionId:  describe result for acl check
2025-10-10T14:38:01.302991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:01.302995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:01.302998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:01.303005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602352671215837:11339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:01.303660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602352671215837:11339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:01.306708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602352671215837:11339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:01.306936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:01.308610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:01.308906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:01.308918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:01.308931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:01.308991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:01.309033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602351888982689:11470]
2025-10-10T14:38:01.309671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:01.310067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:01.310128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:01.310513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:01.310596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.310597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.310598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.310600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.310601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.310602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.310603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.310605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.310606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.310608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.310609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.310610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.310611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.310618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.310631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.310635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.310639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.310643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.310647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.310651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.310655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.310659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.310663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.310667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.310671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.310675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.310683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.310692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.310699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.310705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.310709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.310715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.310720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.310726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.310731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.310737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.310744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.310750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.310755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.310761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.310766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.310772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.310777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.310783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.310787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.310793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.310797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.310803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.310808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.310814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.310821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.310827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.310868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:01.309657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602352671215837:11339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:01.309672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602352671215837:11339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:01.309676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602352671215837:11339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:01.309685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:01.314158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:01.314727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:01.314740Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:01.314742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:01.314746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:01.314752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2523 [2:7559602351888982689:11470]
2025-10-10T14:38:01.314766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:01.314785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:01.314793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.314796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.314799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.314816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:01.314831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:01.314839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:01.314899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.314906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.314908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.314911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:01.314980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:01.314988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.314999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.315014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.315033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:01.315059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602351888982684:11470]
2025-10-10T14:38:01.315065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602351888982684:11470]
2025-10-10T14:38:01.315067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602351888982684:11470]
2025-10-10T14:38:01.315085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:01.315105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671215893:11339], now have 1 active actors on pipe
2025-10-10T14:38:01.315116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671215760:2438], now have 1 active actors on pipe
2025-10-10T14:38:01.315119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:01.315124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:01.315125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:01.315126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:01.315140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:01.315143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:01.315171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602351888982684:11470]
2025-10-10T14:38:01.315179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:01.315190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:01.315309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.315320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.315355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65c81566-b8aab875-c01cb0a8-f367490f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:01.315363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.315366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.315368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:01.315380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.315392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:01.315406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.315671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.315685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.315705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.315212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2523
2025-10-10T14:38:01.315244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2523
2025-10-10T14:38:01.315810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2524 partition: 0 MaxSeqNo: 40 sessionId: src_id|65c81566-b8aab875-c01cb0a8-f367490f_0
2025-10-10T14:38:01.316511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922fc369-859455ee-3e73ae6b-36d43433_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|65c81566-b8aab875-c01cb0a8-f367490f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:01.319412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c81566-b8aab875-c01cb0a8-f367490f_0] Write session: try to update token
2025-10-10T14:38:01.319437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c81566-b8aab875-c01cb0a8-f367490f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:01.336433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2524 sessionId: src_id|65c81566-b8aab875-c01cb0a8-f367490f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:01.339355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:01.339395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:01.339419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:01.339422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:01.339424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:01.339434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602351888982684:11470]
2025-10-10T14:38:01.339439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602351888982684:11470]
2025-10-10T14:38:01.339443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602351888982684:11470]
2025-10-10T14:38:01.339494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:01.339504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.339507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:01.339520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:01.339527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:01.339532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:01.339645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:01.390303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602352671215929:11209]
2025-10-10T14:38:01.390674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2523, pipe: [1:7559602352671215929:11209]
2025-10-10T14:38:01.475491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:01.475779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.475792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.475840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671215929:11209], now have 1 active actors on pipe
2025-10-10T14:38:01.476372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:01.477128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602352671215929:11209]
2025-10-10T14:38:01.477175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:01.477833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c81566-b8aab875-c01cb0a8-f367490f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:01.477846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c81566-b8aab875-c01cb0a8-f367490f_0] Write session will restart in 0.009724s
2025-10-10T14:38:01.477878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c81566-b8aab875-c01cb0a8-f367490f_0] Write session: Do CDS request
2025-10-10T14:38:01.477885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c81566-b8aab875-c01cb0a8-f367490f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:01.477251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2524 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65c81566-b8aab875-c01cb0a8-f367490f_0
2025-10-10T14:38:01.477391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:01.477471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2524 sessionId: src_id|65c81566-b8aab875-c01cb0a8-f367490f_0 is DEAD
2025-10-10T14:38:01.489973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65c81566-b8aab875-c01cb0a8-f367490f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.490130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:01.490148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2525
2025-10-10T14:38:01.490349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.490387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:01.490393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:01.490396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:01.491111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2525 sessionId:  describe result for acl check
2025-10-10T14:38:01.491146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:01.491150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:01.491152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:01.491160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602352671216001:11353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:01.491795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602352671216001:11353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:01.494636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602352671216001:11353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:01.498219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602352671216001:11353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:01.498233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602352671216001:11353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:01.498237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602352671216001:11353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:01.498254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:01.506868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:01.509152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:01.509494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:01.509506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:01.509521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:01.509598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:01.509808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602351888982804:11472]
2025-10-10T14:38:01.510506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:01.510885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:01.510942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:01.511292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:01.511371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.511378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.511380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.511382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.511383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.511385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.511387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.511389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.511390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.511391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.511393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.511394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.511396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.511406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.511423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.511428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.511433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.511438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.511442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.511447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.511451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.511456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.511461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.511465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.511470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.511474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.511483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.511493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.511502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.511508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.511514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.511520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.511524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.511531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.511539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.511552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.511556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.511562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.511567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.511573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.511578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.511584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.511590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.511600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.511607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.511612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.511617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.511623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.511628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.511635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.511645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.511651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.511696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:01.515251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:01.515696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:01.515715Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:01.515718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:01.515722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:01.515730Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2524 [2:7559602351888982804:11472]
2025-10-10T14:38:01.515746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:01.515767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:01.515771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.515775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.515777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.515797Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:01.515807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:01.515822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:01.515899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.515906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.515908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.515911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:01.515987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:01.515994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.516006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.516014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.516024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:01.516053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602351888982799:11472]
2025-10-10T14:38:01.516055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602351888982799:11472]
2025-10-10T14:38:01.516057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602351888982799:11472]
2025-10-10T14:38:01.516067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:01.516076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:01.516080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:01.516082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:01.516090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671216059:11353], now have 1 active actors on pipe
2025-10-10T14:38:01.516096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:01.516112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:01.516120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:01.516127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671215932:2438], now have 1 active actors on pipe
2025-10-10T14:38:01.516161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602351888982799:11472]
2025-10-10T14:38:01.516173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:01.516180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:01.517466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2524
2025-10-10T14:38:01.517501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2524
2025-10-10T14:38:01.517549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.517564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.517623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d70f91a1-54122a7-891bd733-bf730e87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:01.517638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.517645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.517647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:01.517662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.517677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:01.517694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.517961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.517970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.517992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.518106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2525 partition: 0 MaxSeqNo: 40 sessionId: src_id|d70f91a1-54122a7-891bd733-bf730e87_0
2025-10-10T14:38:01.518597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65c81566-b8aab875-c01cb0a8-f367490f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d70f91a1-54122a7-891bd733-bf730e87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:01.521284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Write session: try to update token
2025-10-10T14:38:01.521302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:01.540440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2525 sessionId: src_id|d70f91a1-54122a7-891bd733-bf730e87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:01.541489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:01.541503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:01.541507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:01.541509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:01.541519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602351888982799:11472]
2025-10-10T14:38:01.541524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602351888982799:11472]
2025-10-10T14:38:01.541527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602351888982799:11472]
2025-10-10T14:38:01.541600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:01.541599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:01.541607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:01.541611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:01.541614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.541617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:01.541771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:01.543276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:01.577184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602352671216074:11209]
2025-10-10T14:38:01.581963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2524, pipe: [1:7559602352671216074:11209]
2025-10-10T14:38:01.659955Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:01.660303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.660318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.660367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671216074:11209], now have 1 active actors on pipe
2025-10-10T14:38:01.660703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:01.661194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 142 BytesWritten: 90112070 MessagesWritten: 40 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 20275218 MessagesInflight: 10 }
2025-10-10T14:38:01.660667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602352671216074:11209]
2025-10-10T14:38:01.661234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:01.660706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:01.661239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Write session will restart in 0.006508s
2025-10-10T14:38:01.660709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:01.660771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:01.660813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2525 reason: error at write: Disconnected sessionId: src_id|d70f91a1-54122a7-891bd733-bf730e87_0
2025-10-10T14:38:01.661027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2525 sessionId: src_id|d70f91a1-54122a7-891bd733-bf730e87_0 is DEAD
2025-10-10T14:38:01.661267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Write session: Do CDS request
2025-10-10T14:38:01.661273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:01.668963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.669072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:01.669091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2526
2025-10-10T14:38:01.669242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.669291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:01.669300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:01.669311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:01.670076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2526 sessionId:  describe result for acl check
2025-10-10T14:38:01.670129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:01.670136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:01.670141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:01.670148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602352671216159:11357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:01.670984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602352671216159:11357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:01.672385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:01.674416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:01.674742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:01.674754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:01.674768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:01.674832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:01.674878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602351888982919:11474]
2025-10-10T14:38:01.675242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602352671216159:11357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:01.675535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:01.676279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:01.676329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:01.676672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:01.676732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.676739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.676740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.676741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.676743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.676744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.676746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.676747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.676750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.676751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.676753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.676754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.676755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.676762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.676776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.676780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.676785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.676789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.676793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.676798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.676802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.676807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.676811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.676816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.676820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.676824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.676832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.676841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.676849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.676859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.676864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.676871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.676876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.676885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.676898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.676908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.676913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.676919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.676928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.676935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.676944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.676950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.676955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.676960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.676964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.676970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.676974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.676979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.676983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.676990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.677001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.677007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.677050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:01.680088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:01.680187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602352671216159:11357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:01.680204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602352671216159:11357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:01.680209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602352671216159:11357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:01.680218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:01.680595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:01.680607Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:01.680610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:01.680613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:01.680619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2525 [2:7559602351888982919:11474]
2025-10-10T14:38:01.680633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:01.680651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:01.680655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.680659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.680661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.680679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:01.680698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:01.680706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:01.680778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.680785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.680787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.680790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:01.680860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:01.680868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.680879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.680895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.680910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:01.680937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671216213:11357], now have 1 active actors on pipe
2025-10-10T14:38:01.680945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671216077:2438], now have 1 active actors on pipe
2025-10-10T14:38:01.680953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602351888982913:11474]
2025-10-10T14:38:01.680957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602351888982913:11474]
2025-10-10T14:38:01.680958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602351888982913:11474]
2025-10-10T14:38:01.680973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:01.680991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:01.680983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2525
2025-10-10T14:38:01.681009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:01.681016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:01.681013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2525
2025-10-10T14:38:01.681040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602351888982913:11474]
2025-10-10T14:38:01.681047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:01.681080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:01.681088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:01.681090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:01.681098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:01.681147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.681157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.681188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|805e0d65-bc090e09-86708f95-138b1d86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:01.681204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.681210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.681212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:01.681223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.681240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:01.681258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.681768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.681780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.681801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.681907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2526 partition: 0 MaxSeqNo: 40 sessionId: src_id|805e0d65-bc090e09-86708f95-138b1d86_0
2025-10-10T14:38:01.685302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d70f91a1-54122a7-891bd733-bf730e87_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|805e0d65-bc090e09-86708f95-138b1d86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:01.699620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805e0d65-bc090e09-86708f95-138b1d86_0] Write session: try to update token
2025-10-10T14:38:01.699648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805e0d65-bc090e09-86708f95-138b1d86_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:01.702069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:01.702085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:01.702097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602351888982913:11474]
2025-10-10T14:38:01.702149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:01.702157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:01.702341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:01.702489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:01.702641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:01.702779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:01.703027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:01.703065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:01.715687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2526 sessionId: src_id|805e0d65-bc090e09-86708f95-138b1d86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:01.718289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:01.720113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.720142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.720171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:01.720175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:01.720179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:01.720181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:01.720193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602351888982913:11474]
2025-10-10T14:38:01.720197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602351888982913:11474]
2025-10-10T14:38:01.720204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602351888982913:11474]
2025-10-10T14:38:01.720251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:01.720258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:01.720263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:01.720265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:01.720273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.720276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:01.720408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:01.760982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602352671216221:11209]
2025-10-10T14:38:01.761301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2525, pipe: [1:7559602352671216221:11209]
2025-10-10T14:38:01.837582Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:01.837901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:01.837941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671216221:11209], now have 1 active actors on pipe
2025-10-10T14:38:01.838082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:01.838184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602352671216221:11209]
2025-10-10T14:38:01.838213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:01.838213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:01.838217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:01.838316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2526 reason: error at write: Disconnected sessionId: src_id|805e0d65-bc090e09-86708f95-138b1d86_0
2025-10-10T14:38:01.838504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2526 sessionId: src_id|805e0d65-bc090e09-86708f95-138b1d86_0 is DEAD
2025-10-10T14:38:01.841380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e0d65-bc090e09-86708f95-138b1d86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:01.841394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e0d65-bc090e09-86708f95-138b1d86_0] Write session will restart in 0.006819s
2025-10-10T14:38:01.841421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e0d65-bc090e09-86708f95-138b1d86_0] Write session: Do CDS request
2025-10-10T14:38:01.841428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e0d65-bc090e09-86708f95-138b1d86_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:01.851802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:01.853370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:01.853717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:01.853732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:01.853748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:01.853821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:01.853835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|805e0d65-bc090e09-86708f95-138b1d86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.853865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602351888983037:11476]
2025-10-10T14:38:01.853960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:01.853978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2527
2025-10-10T14:38:01.854145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:01.854176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:01.854187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:01.854191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:01.854532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:01.854689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2527 sessionId:  describe result for acl check
2025-10-10T14:38:01.854726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:01.854732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:01.854734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:01.854740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602352671216337:11362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:01.854868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:01.854927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:01.855312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:01.855347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602352671216337:11362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:01.855385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.855391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.855392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.855393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.855395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.855396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.855398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.855399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.855401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.855402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.855403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.855405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.855406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.855413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.855425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.855428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.855433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.855437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.855441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.855446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.855449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.855452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.855456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.855460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.855463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.855467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.855481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.855490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:01.855498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.855504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:01.855511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.855517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:01.855522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.855527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:01.855534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.855546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:01.855552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.855557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:01.855561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.855566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:01.855572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.855576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:01.855580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.855585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:01.855589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.855593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:01.855598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.855603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.855608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.855613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.855618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.855623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.855662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:01.857979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602352671216337:11362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:01.859376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:01.859774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:01.859792Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:01.859795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:01.859799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:01.859806Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2526 [2:7559602351888983037:11476]
2025-10-10T14:38:01.859825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:01.859850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:01.859860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.859863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.859866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.859886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:01.859894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:01.859906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:01.859972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.859979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.859981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.859984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:01.860055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:01.860063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.860077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:01.860090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:01.860109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:01.860140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671216231:2438], now have 1 active actors on pipe
2025-10-10T14:38:01.860148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602351888983032:11476]
2025-10-10T14:38:01.860151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602351888983032:11476]
2025-10-10T14:38:01.860154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602351888983032:11476]
2025-10-10T14:38:01.860167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:01.860182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:01.860182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:01.860190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:01.860193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:01.860201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:01.860206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:01.860211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2526
2025-10-10T14:38:01.860239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602351888983032:11476]
2025-10-10T14:38:01.860250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:01.860251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:01.861878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602352671216337:11362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:01.861892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602352671216337:11362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:01.861896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602352671216337:11362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:01.861905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:01.862141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671216374:11362], now have 1 active actors on pipe
2025-10-10T14:38:01.862239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2526
2025-10-10T14:38:01.862366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.862378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.862411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32d52454-a8ee546a-6846ee04-2a105b63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:01.862427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:01.862438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:01.862441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:01.862455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:01.862476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:01.862499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.862748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.862756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.862775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:01.862874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2527 partition: 0 MaxSeqNo: 40 sessionId: src_id|32d52454-a8ee546a-6846ee04-2a105b63_0
2025-10-10T14:38:01.863272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|805e0d65-bc090e09-86708f95-138b1d86_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|32d52454-a8ee546a-6846ee04-2a105b63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:01.866193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32d52454-a8ee546a-6846ee04-2a105b63_0] Write session: try to update token
2025-10-10T14:38:01.866216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32d52454-a8ee546a-6846ee04-2a105b63_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:01.882359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2527 sessionId: src_id|32d52454-a8ee546a-6846ee04-2a105b63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:01.885118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:01.886825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:01.886847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:01.886871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:01.886875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:01.886879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:01.886881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:01.886890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602351888983032:11476]
2025-10-10T14:38:01.886895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602351888983032:11476]
2025-10-10T14:38:01.886898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602351888983032:11476]
2025-10-10T14:38:01.886943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:01.886957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:01.886961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:01.886962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:01.886970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:01.886974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:01.887110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:01.938225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602352671216377:11209]
2025-10-10T14:38:01.938608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2526, pipe: [1:7559602352671216377:11209]
2025-10-10T14:38:02.007568Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:02.007956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:02.008036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602352671216377:11209], now have 1 active actors on pipe
2025-10-10T14:38:02.008132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:02.009117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602352671216377:11209]
2025-10-10T14:38:02.009159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:02.023190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:02.023698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d52454-a8ee546a-6846ee04-2a105b63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:02.023711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d52454-a8ee546a-6846ee04-2a105b63_0] Write session will restart in 0.009535s
2025-10-10T14:38:02.023737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d52454-a8ee546a-6846ee04-2a105b63_0] Write session: Do CDS request
2025-10-10T14:38:02.023744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d52454-a8ee546a-6846ee04-2a105b63_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:02.023197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:02.023210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:02.023232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2527 reason: error at write: Disconnected sessionId: src_id|32d52454-a8ee546a-6846ee04-2a105b63_0
2025-10-10T14:38:02.023374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2527 sessionId: src_id|32d52454-a8ee546a-6846ee04-2a105b63_0 is DEAD
2025-10-10T14:38:02.031289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:02.031600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:02.031613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:02.031628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:02.031708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:02.031760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602356183950488:11491]
2025-10-10T14:38:02.032420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:02.032753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:02.032806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:02.033158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:02.033245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.033252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.033253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.033255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.033256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.033257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.033259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.033260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.033261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.033263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.033264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.033265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.033266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.033274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.033289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.033293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.033298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.033302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.033307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.033311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.033316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.033319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.033344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.033348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.033352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.033356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.033365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.033374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.033381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.033387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.033391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.033400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.033406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.033411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.033416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.033422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.033427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.033433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.033438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.033444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.033449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.033455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.033461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.033467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.033471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.033476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.033481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.033486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.033491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.033496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.033501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.033507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.033547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:02.034797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32d52454-a8ee546a-6846ee04-2a105b63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.035599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:02.035617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2528
2025-10-10T14:38:02.035792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.035822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:02.035830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:02.035834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:02.036185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2528 sessionId:  describe result for acl check
2025-10-10T14:38:02.036216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:02.036221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:02.036222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:02.036228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602356966183812:11375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:02.036844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602356966183812:11375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:02.036375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:02.037288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2527
2025-10-10T14:38:02.036800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:02.036807Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:02.036810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:02.036814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:02.036820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2527 [2:7559602356183950488:11491]
2025-10-10T14:38:02.036836Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:02.036855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:02.036859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.036862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.036865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.036885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:02.036894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:02.036902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:02.036966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.036968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.036970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.036973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:02.037052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:02.037056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.037069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.037082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.037100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:02.037124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966183702:2438], now have 1 active actors on pipe
2025-10-10T14:38:02.037132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602356183950483:11491]
2025-10-10T14:38:02.037134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602356183950483:11491]
2025-10-10T14:38:02.037137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602356183950483:11491]
2025-10-10T14:38:02.037150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:02.037165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:02.037167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:02.037170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:02.037171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:02.037182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:02.037185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:02.037221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602356183950483:11491]
2025-10-10T14:38:02.037229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:02.037244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:02.039690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602356966183812:11375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:02.045247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602356966183812:11375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:02.045264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602356966183812:11375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:02.045268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602356966183812:11375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:02.045278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:02.045566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966183842:11375], now have 1 active actors on pipe
2025-10-10T14:38:02.045685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2527
2025-10-10T14:38:02.045772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.045786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.045821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:02.045841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.045852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.045857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:02.045877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.045901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:02.045925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.046103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.046110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.046129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.046204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2528 partition: 0 MaxSeqNo: 40 sessionId: src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0
2025-10-10T14:38:02.046624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d52454-a8ee546a-6846ee04-2a105b63_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:02.049486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0] Write session: try to update token
2025-10-10T14:38:02.049507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:02.059556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:02.059575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.059579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:02.059583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:02.059597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602356183950483:11491]
2025-10-10T14:38:02.059602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602356183950483:11491]
2025-10-10T14:38:02.059606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602356183950483:11491]
2025-10-10T14:38:02.059660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:02.059665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:02.059672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.059672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:02.059675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:02.059677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:02.059844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:02.064898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2528 sessionId: src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:02.067708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:02.107113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602356966183845:11209]
2025-10-10T14:38:02.107524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2527, pipe: [1:7559602356966183845:11209]
2025-10-10T14:38:02.177357Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:02.177722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.177738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.177788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966183845:11209], now have 1 active actors on pipe
2025-10-10T14:38:02.178046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:02.178714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:02.178725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0] Write session will restart in 0.006642s
2025-10-10T14:38:02.178752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0] Write session: Do CDS request
2025-10-10T14:38:02.178759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:02.178013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:02.178031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:02.178117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2528 reason: error at write: Disconnected sessionId: src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0
2025-10-10T14:38:02.178318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2528 sessionId: src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0 is DEAD
2025-10-10T14:38:02.178362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:02.178409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602356966183845:11209]
2025-10-10T14:38:02.186932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.187160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:02.187178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2529
2025-10-10T14:38:02.187276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.187314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:02.187319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:02.187324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:02.187796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2529 sessionId:  describe result for acl check
2025-10-10T14:38:02.187834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:02.187836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:02.187838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:02.187845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602356966183951:11379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:02.188395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602356966183951:11379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:02.189449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:02.190590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602356966183951:11379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:02.191408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:02.191772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:02.191785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:02.191800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:02.191870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:02.191912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602356183950608:11494]
2025-10-10T14:38:02.192569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:02.192873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:02.192915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:02.193272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:02.193342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.193349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.193350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.193351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.193353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.193354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.193356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.193357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.193358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.193360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.193361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.193362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.193363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.193370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.193383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.193386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.193390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.193393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.193397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.193401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.193404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.193408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.193412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.193416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.193420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.193424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.193431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.193440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.193447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.193453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.193457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.193463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.193468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.193474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.193480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.193486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.193491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.193496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.193501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.193506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.193511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.193517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.193521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.193539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.193544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.193549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.193555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.193560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.193565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.193571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.193576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.193582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.193623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:02.196484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:02.196922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:02.196935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:02.196937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:02.196942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:02.196950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2528 [2:7559602356183950608:11494]
2025-10-10T14:38:02.196968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:02.196987Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:02.196997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.197002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.197005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.197023Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:02.197047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:02.197055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:02.197119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.197136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.197138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.197141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:02.197219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:02.197227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.197241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.197258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.197279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:02.197303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966183848:2438], now have 1 active actors on pipe
2025-10-10T14:38:02.197316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602356183950602:11494]
2025-10-10T14:38:02.197319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602356183950602:11494]
2025-10-10T14:38:02.197322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602356183950602:11494]
2025-10-10T14:38:02.197350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:02.197365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:02.197368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:02.197371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:02.197371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:02.197387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:02.197390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:02.197427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602356183950602:11494]
2025-10-10T14:38:02.197439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:02.197452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:02.197448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2528
2025-10-10T14:38:02.199201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602356966183951:11379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:02.199218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602356966183951:11379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:02.199222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602356966183951:11379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:02.199232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:02.199502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966183991:11379], now have 1 active actors on pipe
2025-10-10T14:38:02.199560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2528
2025-10-10T14:38:02.199617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.199629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.199664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa829124-798481b1-6f5c27e-a72950b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:02.199681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.199686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.199690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:02.199704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.199727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:02.199748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.199966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.199986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.200005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.200093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2529 partition: 0 MaxSeqNo: 40 sessionId: src_id|fa829124-798481b1-6f5c27e-a72950b5_0
2025-10-10T14:38:02.200562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e4297c-47edce7e-b79d0bcc-f19156b1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fa829124-798481b1-6f5c27e-a72950b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:02.203546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa829124-798481b1-6f5c27e-a72950b5_0] Write session: try to update token
2025-10-10T14:38:02.203568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa829124-798481b1-6f5c27e-a72950b5_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:02.209680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:02.209702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.209714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602356183950602:11494]
2025-10-10T14:38:02.209773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:02.209779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:02.209993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:02.210168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.210331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.210489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.210715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:02.210768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:02.220347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2529 sessionId: src_id|fa829124-798481b1-6f5c27e-a72950b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:02.223241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:02.223479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.223503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.223544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:02.223615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:02.228884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:02.228906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.228910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:02.228912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:02.228923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602356183950602:11494]
2025-10-10T14:38:02.228928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602356183950602:11494]
2025-10-10T14:38:02.228932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602356183950602:11494]
2025-10-10T14:38:02.228983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:02.228984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:02.228992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:02.228992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.228995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:02.228997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:02.229153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:02.278638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602356966183995:11209]
2025-10-10T14:38:02.278996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2528, pipe: [1:7559602356966183995:11209]
2025-10-10T14:38:02.371429Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:02.382384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.382415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.382596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.382655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.382738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.382806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.383217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.383221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.383293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.383354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.383419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.383482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.383529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.383533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.383609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.383667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.383731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.383793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.383837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.383840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.383915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.383984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.384052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.384118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.384164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.384167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.384239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.384342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.384439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.384499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.384537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.384543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.384617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.384676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.384739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.384805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.384855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.384858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.384934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.384993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.385056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.385120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.385160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.385162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.385226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.385276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.385381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.385452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.385498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.385501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.385572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.385630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.385703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.385775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.385823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.385831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.385900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.385965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.386029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.386093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.386153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.386156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.386230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966183995:11209], now have 1 active actors on pipe
2025-10-10T14:38:02.386812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:02.387607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa829124-798481b1-6f5c27e-a72950b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:02.387617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa829124-798481b1-6f5c27e-a72950b5_0] Write session will restart in 0.009511s
2025-10-10T14:38:02.387643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa829124-798481b1-6f5c27e-a72950b5_0] Write session: Do CDS request
2025-10-10T14:38:02.387650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa829124-798481b1-6f5c27e-a72950b5_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:02.387142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:02.387200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602356966183995:11209]
2025-10-10T14:38:02.387225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:02.387228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:02.387257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2529 reason: error at write: Disconnected sessionId: src_id|fa829124-798481b1-6f5c27e-a72950b5_0
2025-10-10T14:38:02.387446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2529 sessionId: src_id|fa829124-798481b1-6f5c27e-a72950b5_0 is DEAD
2025-10-10T14:38:02.400194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:02.401467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:02.401711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:02.401725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:02.401739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:02.401805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:02.401854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602356183950739:11497]
2025-10-10T14:38:02.401882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa829124-798481b1-6f5c27e-a72950b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.402022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:02.402038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2530
2025-10-10T14:38:02.402183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.402214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:02.402226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:02.402230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:02.402497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:02.402729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2530 sessionId:  describe result for acl check
2025-10-10T14:38:02.402764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:02.402770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:02.402772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:02.402778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602356966184119:11384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:02.402892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:02.402945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:02.403281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:02.403363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.403378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602356966184119:11384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:02.403376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.403377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.403378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.403380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.403382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.403383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.403385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.403386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.403387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.403389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.403390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.403392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.403400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.403414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.403419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.403423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.403428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.403432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.403437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.403441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.403445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.403450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.403453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.403458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.403462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.403470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.403479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.403486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.403492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.403497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.403503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.403509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.403514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.403519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.403525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.403530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.403536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.403542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.403548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.403554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.403559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.403564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.403571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.403575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.403581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.403587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.403593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.403598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.403604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.403609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.403614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.403656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:02.405628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602356966184119:11384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:02.406479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:02.407099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:02.407112Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:02.407115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:02.407119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:02.407126Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2529 [2:7559602356183950739:11497]
2025-10-10T14:38:02.407141Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:02.407160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:02.407169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.407173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.407175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.407193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:02.407205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:02.407218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:02.407276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.407283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.407285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.407288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:02.407362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:02.407371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.407382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.407394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.407414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:02.407442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184010:2438], now have 1 active actors on pipe
2025-10-10T14:38:02.407455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602356183950734:11497]
2025-10-10T14:38:02.407457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602356183950734:11497]
2025-10-10T14:38:02.407459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602356183950734:11497]
2025-10-10T14:38:02.407473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:02.407494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:02.407498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:02.407502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:02.407504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:02.407515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:02.407519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:02.407548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602356183950734:11497]
2025-10-10T14:38:02.407560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:02.407565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:02.407676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2529
2025-10-10T14:38:02.413136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602356966184119:11384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:02.413155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602356966184119:11384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:02.413159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602356966184119:11384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:02.413170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:02.413543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184153:11384], now have 1 active actors on pipe
2025-10-10T14:38:02.413595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2529
2025-10-10T14:38:02.413773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.413790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.413828Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:02.413857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.413870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.413873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:02.413891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.413931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:02.413957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.414180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.414191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.414209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.414297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2530 partition: 0 MaxSeqNo: 40 sessionId: src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0
2025-10-10T14:38:02.414773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa829124-798481b1-6f5c27e-a72950b5_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:02.417758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0] Write session: try to update token
2025-10-10T14:38:02.417782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:02.422515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:02.422553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.422567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602356183950734:11497]
2025-10-10T14:38:02.422630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:02.422634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:02.422860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:02.423028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.423189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.423348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.423566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:02.423609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:02.436566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2530 sessionId: src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:02.439609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:02.439912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.439945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.439991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:02.440101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:02.444340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:02.444361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.444364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:02.444366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:02.444378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602356183950734:11497]
2025-10-10T14:38:02.444381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602356183950734:11497]
2025-10-10T14:38:02.444385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602356183950734:11497]
2025-10-10T14:38:02.444437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:02.444438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:02.444445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.444446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:02.444447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:02.444450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:02.444594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:02.487510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602356966184158:11209]
2025-10-10T14:38:02.491301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2529, pipe: [1:7559602356966184158:11209]
2025-10-10T14:38:02.562658Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:02.571279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.571306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.571487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.571562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.571629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.571700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.571749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.571758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.571832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.571903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.571972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.572043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.572230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.572244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.572319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.572389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.572455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.572525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.572571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.572579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.572651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.572723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.572790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.572861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.572909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.572916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.572985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.573048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.573117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.573185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.573229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.573236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.573308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.573393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.573460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.573540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.573591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.573598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.573696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.573763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.573835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.573905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.573973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.573980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.574052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.574120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.574193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.574262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.574313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.574323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.574396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.575328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:02.575345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:02.575350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602356966184158:11209]
2025-10-10T14:38:02.575375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:02.575381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2530 reason: error at write: Disconnected sessionId: src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0
2025-10-10T14:38:02.575632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2530 sessionId: src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0 is DEAD
2025-10-10T14:38:02.576025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:02.576035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0] Write session will restart in 0.006248s
2025-10-10T14:38:02.576069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0] Write session: Do CDS request
2025-10-10T14:38:02.576075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:02.574466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.574554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.574625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.574667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.574670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.574744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:02.574807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:02.574875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:02.574942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:02.574987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:02.574989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:02.575062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184158:11209], now have 1 active actors on pipe
2025-10-10T14:38:02.576142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:02.583944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.584039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:02.584055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2531
2025-10-10T14:38:02.584186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.584223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:02.584233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:02.584237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:02.584681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2531 sessionId:  describe result for acl check
2025-10-10T14:38:02.584718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:02.584724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:02.584727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:02.584733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602356966184242:11388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:02.585743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602356966184242:11388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:02.587646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:02.588527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602356966184242:11388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:02.589106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:02.589362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:02.589374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:02.589387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:02.589463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:02.589509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602356183950859:11499]
2025-10-10T14:38:02.590193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:02.590547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:02.590608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:02.590984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:02.591047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.591053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.591054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.591056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.591057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.591059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.591060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.591061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.591063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.591064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.591065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.591066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.591067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.591074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.591086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.591091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.591095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.591099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.591103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.591107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.591112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.591116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.591121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.591125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.591140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.591145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.591152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.591124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602356966184242:11388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:02.591139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602356966184242:11388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:02.591143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602356966184242:11388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:02.591161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.591173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.591153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:02.591178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.591183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.591193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.591200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.591210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.591216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.591225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.591230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.591240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.591245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.591255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.591259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.591269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.591273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.591283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.591288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.591299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.591305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.591316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.591320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.591330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.591336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.591345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.591393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:02.593772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:02.594142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:02.594153Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:02.594155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:02.594159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:02.594165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2530 [2:7559602356183950859:11499]
2025-10-10T14:38:02.594178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:02.594195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:02.594203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.594206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.594208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.594227Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:02.594237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:02.594246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:02.594312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.594318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.594320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.594322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:02.594389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:02.594396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.594408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.594422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.594440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:02.594468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184160:2438], now have 1 active actors on pipe
2025-10-10T14:38:02.594479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184299:11388], now have 1 active actors on pipe
2025-10-10T14:38:02.594487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602356183950853:11499]
2025-10-10T14:38:02.594488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602356183950853:11499]
2025-10-10T14:38:02.594504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602356183950853:11499]
2025-10-10T14:38:02.594503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2530
2025-10-10T14:38:02.594519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2530
2025-10-10T14:38:02.594520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:02.594556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:02.594572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:02.594581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:02.594604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602356183950853:11499]
2025-10-10T14:38:02.594607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:02.594744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:02.594753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:02.594756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:02.594763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:02.594859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.594874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.594912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66026d97-82b6fefb-2d075975-5f61c476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:02.594927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.594932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.594934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:02.594949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.594962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:02.594984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.595237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.595248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.595271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.595398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2531 partition: 0 MaxSeqNo: 40 sessionId: src_id|66026d97-82b6fefb-2d075975-5f61c476_0
2025-10-10T14:38:02.595802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c1d8d0-b7bb6026-6ce6a0b4-84fd0010_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|66026d97-82b6fefb-2d075975-5f61c476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:02.598551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66026d97-82b6fefb-2d075975-5f61c476_0] Write session: try to update token
2025-10-10T14:38:02.598569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66026d97-82b6fefb-2d075975-5f61c476_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:02.614661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:02.614678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.614681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:02.614684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:02.614695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602356183950853:11499]
2025-10-10T14:38:02.614704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602356183950853:11499]
2025-10-10T14:38:02.614708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602356183950853:11499]
2025-10-10T14:38:02.614758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:02.614767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.614770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:02.614774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:02.614777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:02.614782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:02.614938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:02.617223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2531 sessionId: src_id|66026d97-82b6fefb-2d075975-5f61c476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:02.619962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:02.677465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602356966184310:11209]
2025-10-10T14:38:02.677761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2530, pipe: [1:7559602356966184310:11209]
2025-10-10T14:38:02.734207Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:02.734589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.734605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.734657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184310:11209], now have 1 active actors on pipe
2025-10-10T14:38:02.735030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:02.735361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:02.735421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:02.735424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:02.735491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2531 reason: error at write: Disconnected sessionId: src_id|66026d97-82b6fefb-2d075975-5f61c476_0
2025-10-10T14:38:02.735720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2531 sessionId: src_id|66026d97-82b6fefb-2d075975-5f61c476_0 is DEAD
2025-10-10T14:38:02.735904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602356966184310:11209]
2025-10-10T14:38:02.737550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66026d97-82b6fefb-2d075975-5f61c476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:02.737562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66026d97-82b6fefb-2d075975-5f61c476_0] Write session will restart in 0.006381s
2025-10-10T14:38:02.737589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66026d97-82b6fefb-2d075975-5f61c476_0] Write session: Do CDS request
2025-10-10T14:38:02.737598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66026d97-82b6fefb-2d075975-5f61c476_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:02.744875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66026d97-82b6fefb-2d075975-5f61c476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.745339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:02.745359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2532
2025-10-10T14:38:02.745506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.745547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:02.745558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:02.745561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:02.746089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2532 sessionId:  describe result for acl check
2025-10-10T14:38:02.746129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:02.746136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:02.746138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:02.746144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602356966184326:11392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:02.746757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602356966184326:11392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:02.750057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602356966184326:11392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:02.753417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602356966184326:11392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:02.753431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602356966184326:11392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:02.753435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602356966184326:11392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:02.753444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:02.754126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:02.755608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:02.755780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:02.755791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:02.755800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:02.755859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:02.755895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602356183950981:11501]
2025-10-10T14:38:02.756393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:02.756866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:02.756949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:02.757305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:02.757405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.757414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.757415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.757416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.757418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.757419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.757421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.757422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.757423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.757425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.757426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.757427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.757428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.757436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.757450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.757455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.757460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.757465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.757469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.757474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.757478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.757482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.757487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.757491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.757495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.757499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.757508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.757518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.757525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.757532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.757537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.757543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.757547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.757554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.757559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.757565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.757570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.757575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.757580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.757586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.757591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.757597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.757603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.757610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.757614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.757621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.757627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.757633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.757644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.757650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.757661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.757667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.757715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:02.760404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:02.760964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:02.760996Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:02.761000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:02.761005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:02.761012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2531 [2:7559602356183950981:11501]
2025-10-10T14:38:02.761027Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:02.761046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:02.761055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.761059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.761063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.761084Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:02.761097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:02.761112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:02.761188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.761196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.761198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.761201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:02.761287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:02.761297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.761311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.761383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.761408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:02.761432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602356183950976:11501]
2025-10-10T14:38:02.761441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602356183950976:11501]
2025-10-10T14:38:02.761444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602356183950976:11501]
2025-10-10T14:38:02.761455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:02.761463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:02.761466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:02.761468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:02.761478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:02.761496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:02.761506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:02.761519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184451:11392], now have 1 active actors on pipe
2025-10-10T14:38:02.761528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184311:2438], now have 1 active actors on pipe
2025-10-10T14:38:02.761560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602356183950976:11501]
2025-10-10T14:38:02.761575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:02.761607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:02.761601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2531
2025-10-10T14:38:02.761652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2531
2025-10-10T14:38:02.761759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.761771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.761808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f645bde6-5ab87395-bf13ff62-f3772223_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:02.761824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.761830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.761834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:02.761847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.761864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:02.761905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.762225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.762238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.762259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.762383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2532 partition: 0 MaxSeqNo: 40 sessionId: src_id|f645bde6-5ab87395-bf13ff62-f3772223_0
2025-10-10T14:38:02.762896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66026d97-82b6fefb-2d075975-5f61c476_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f645bde6-5ab87395-bf13ff62-f3772223_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:02.766449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f645bde6-5ab87395-bf13ff62-f3772223_0] Write session: try to update token
2025-10-10T14:38:02.766473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f645bde6-5ab87395-bf13ff62-f3772223_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:02.781995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:02.782016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.782019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:02.782022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:02.782036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602356183950976:11501]
2025-10-10T14:38:02.782041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602356183950976:11501]
2025-10-10T14:38:02.782045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602356183950976:11501]
2025-10-10T14:38:02.782095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:02.782098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:02.782106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.782109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:02.782109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:02.782117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:02.782263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:02.782836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2532 sessionId: src_id|f645bde6-5ab87395-bf13ff62-f3772223_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:02.785696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:02.818511Z :INFO: [/Root] [/Root] [23a57a65-af840be0-96de6577-cf5cbc2e] Counters: { Errors: 25 CurrentSessionLifetimeMs: 421571 BytesRead: 33792020 MessagesRead: 15 BytesReadCompressed: 33792020 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 6758406 BytesInflightTotal: 9011208 MessagesInflight: 4 }
2025-10-10T14:38:02.836427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602356966184472:11209]
2025-10-10T14:38:02.836850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2531, pipe: [1:7559602356966184472:11209]
2025-10-10T14:38:02.901260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:02.901640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.901656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.901703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184472:11209], now have 1 active actors on pipe
2025-10-10T14:38:02.901984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:02.903139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f645bde6-5ab87395-bf13ff62-f3772223_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:02.903152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f645bde6-5ab87395-bf13ff62-f3772223_0] Write session will restart in 0.005610s
2025-10-10T14:38:02.903177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f645bde6-5ab87395-bf13ff62-f3772223_0] Write session: Do CDS request
2025-10-10T14:38:02.903183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f645bde6-5ab87395-bf13ff62-f3772223_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:02.902648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602356966184472:11209]
2025-10-10T14:38:02.902688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:02.902767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2532 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f645bde6-5ab87395-bf13ff62-f3772223_0
2025-10-10T14:38:02.902961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2532 sessionId: src_id|f645bde6-5ab87395-bf13ff62-f3772223_0 is DEAD
2025-10-10T14:38:02.903130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:02.913875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f645bde6-5ab87395-bf13ff62-f3772223_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.914261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:02.914277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2533
2025-10-10T14:38:02.914413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:02.914474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:02.914480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:02.914485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:02.914956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2533 sessionId:  describe result for acl check
2025-10-10T14:38:02.914994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:02.914996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:02.914998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:02.915006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602356966184580:11397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:02.915596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602356966184580:11397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:02.916251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:02.917875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:02.918079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:02.918091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:02.918104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:02.918159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:02.917914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602356966184580:11397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:02.918200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602356183951102:11503]
2025-10-10T14:38:02.918866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:02.919178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:02.919218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:02.919539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:02.919594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.919601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.919602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.919604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.919605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.919607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.919608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.919610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.919611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.919612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.919614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.919615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.919617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.919623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.919637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.919642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.919647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.919651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.919656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.919661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.919665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.919670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.919675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.919680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.919684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.919701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.919712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.919722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:02.919733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.919740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:02.919745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.919751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:02.919755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.919762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:02.919767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.919773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:02.919777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.919784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:02.919789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.919795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:02.919800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.919806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:02.919812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.919819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:02.919824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.919830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:02.919841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.919848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.919854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.919865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.919873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.919879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.919922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:02.920177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602356966184580:11397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:02.920191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602356966184580:11397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:02.920195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602356966184580:11397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:02.920213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:02.922421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:02.922825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:02.922842Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:02.922845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:02.922848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:02.922855Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2532 [2:7559602356183951102:11503]
2025-10-10T14:38:02.922869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:02.922887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:02.922912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.922916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.922920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.922937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:02.922945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:02.922954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:02.923016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.923019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.923021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.923024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:02.923094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:02.923098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.923111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:02.923124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:02.923142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:02.923164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602356183951097:11503]
2025-10-10T14:38:02.923166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602356183951097:11503]
2025-10-10T14:38:02.923170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602356183951097:11503]
2025-10-10T14:38:02.923180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:02.923196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:02.923199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:02.923202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:02.923205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:02.923213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:02.923217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:02.923228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184618:11397], now have 1 active actors on pipe
2025-10-10T14:38:02.923232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602356966184473:2438], now have 1 active actors on pipe
2025-10-10T14:38:02.923259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602356183951097:11503]
2025-10-10T14:38:02.923270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:02.923287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:02.923424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2532
2025-10-10T14:38:02.923456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2532
2025-10-10T14:38:02.924444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2533 partition: 0 MaxSeqNo: 40 sessionId: src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0
2025-10-10T14:38:02.924845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f645bde6-5ab87395-bf13ff62-f3772223_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:02.927662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0] Write session: try to update token
2025-10-10T14:38:02.927686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:02.923862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.923876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.923921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:02.923930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:02.923934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:02.923937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:02.923950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:02.923962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:02.923978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.924327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.924332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.924349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:02.935799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:02.935819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.935833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602356183951097:11503]
2025-10-10T14:38:02.935895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:02.935896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:02.936084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:02.936242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.936387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.936532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:02.936827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:02.936881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:02.947590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2533 sessionId: src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:02.950269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:02.950656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:02.950676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:02.950718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:02.950885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:02.955044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:02.955070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:02.955074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:02.955076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:02.955088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602356183951097:11503]
2025-10-10T14:38:02.955092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602356183951097:11503]
2025-10-10T14:38:02.955097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602356183951097:11503]
2025-10-10T14:38:02.955145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:02.955145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:02.955152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:02.955156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:02.955161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:02.955164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:02.955296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:03.002571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602361261151935:11209]
2025-10-10T14:38:03.002866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2532, pipe: [1:7559602361261151935:11209]
2025-10-10T14:38:03.072936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:03.081593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.081621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.081816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.081886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.081963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.082040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.082412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.082429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.082501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.082581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.082645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.082716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.082762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.082771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.082844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.082911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.082981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.083050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.083095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.083103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.083172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.083240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.083313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.083381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.083434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.083444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.083518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.083593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.083666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.083744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.083798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.083805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.083885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.083955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.084027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.084095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.084141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.084149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.084224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.084289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.084358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.084424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.084470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.084476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.084548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.084611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.084677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.084747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.084795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.084802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.084875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.084949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.085017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.085090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.085139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.085146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.085218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.085285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.085394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.085470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.085535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.085541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.085608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261151935:11209], now have 1 active actors on pipe
2025-10-10T14:38:03.085892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602361261151935:11209]
2025-10-10T14:38:03.085889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:03.085905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:03.085932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:03.085943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2533 reason: error at write: Disconnected sessionId: src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0
2025-10-10T14:38:03.086181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2533 sessionId: src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0 is DEAD
2025-10-10T14:38:03.086334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:03.086345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0] Write session will restart in 0.005971s
2025-10-10T14:38:03.086371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0] Write session: Do CDS request
2025-10-10T14:38:03.086378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:03.086496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:03.093862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.093989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:03.094002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2534
2025-10-10T14:38:03.094177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.094215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:03.094237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:03.094242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:03.094782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2534 sessionId:  describe result for acl check
2025-10-10T14:38:03.094823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:03.094830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:03.094832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:03.094839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602361261152025:11410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:03.095476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602361261152025:11410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:03.097839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602361261152025:11410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:03.098221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:03.100157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:03.100440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:03.100453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:03.100465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:03.100521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:03.100579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602360478918558:11518]
2025-10-10T14:38:03.101117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602361261152025:11410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:03.101132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602361261152025:11410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:03.101136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602361261152025:11410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:03.101156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:03.101250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:03.101656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:03.101711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:03.102064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:03.102124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.102131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.102133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.102134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.102135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.102136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.102138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.102139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.102141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.102142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.102143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.102145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.102146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.102153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.102167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.102171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.102175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.102179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.102183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.102187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.102191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.102195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.102200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.102203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.102207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.102211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.102219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.102229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.102235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.102242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.102246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.102251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.102256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.102262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.102266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.102271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.102276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.102281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.102286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.102292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.102296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.102301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.102306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.102312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.102316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.102322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.102328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.102333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.102337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.102343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.102348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.102359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.102408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:03.104968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:03.105315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:03.105345Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:03.105348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:03.105352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:03.105359Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2533 [2:7559602360478918558:11518]
2025-10-10T14:38:03.105373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:03.105395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:03.105399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.105402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.105405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.105440Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:03.105448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:03.105457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:03.105518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.105526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.105528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.105531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:03.105608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:03.105616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.105628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.105645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.105666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:03.105688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602360478918553:11518]
2025-10-10T14:38:03.105695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602360478918553:11518]
2025-10-10T14:38:03.105698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602360478918553:11518]
2025-10-10T14:38:03.105708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:03.105725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:03.105746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:03.105753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:03.105756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:03.105760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:03.105762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:03.105785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602360478918553:11518]
2025-10-10T14:38:03.105788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:03.105791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:03.105801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261151950:2438], now have 1 active actors on pipe
2025-10-10T14:38:03.105805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152088:11410], now have 1 active actors on pipe
2025-10-10T14:38:03.105862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2533
2025-10-10T14:38:03.105875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2533
2025-10-10T14:38:03.106091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.106104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.106135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:03.106150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.106158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.106160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:03.106173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.106191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:03.106211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.106431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.106440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.106457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.106593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2534 partition: 0 MaxSeqNo: 40 sessionId: src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0
2025-10-10T14:38:03.107050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3d3198-ea413090-3027ddbc-25ea3867_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:03.109813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0] Write session: try to update token
2025-10-10T14:38:03.109832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:03.124828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2534 sessionId: src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:03.126037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:03.126058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:03.126061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:03.126063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:03.126073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602360478918553:11518]
2025-10-10T14:38:03.126078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602360478918553:11518]
2025-10-10T14:38:03.126082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602360478918553:11518]
2025-10-10T14:38:03.126135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:03.126148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.126152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:03.126271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:03.126284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:03.126288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:03.126295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:03.127606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:03.185911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602361261152100:11209]
2025-10-10T14:38:03.186276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2533, pipe: [1:7559602361261152100:11209]
2025-10-10T14:38:03.242699Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:03.243199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.243213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.243253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152100:11209], now have 1 active actors on pipe
2025-10-10T14:38:03.243958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:03.243963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602361261152100:11209]
2025-10-10T14:38:03.243982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:03.243985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:03.244038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2534 reason: error at write: Disconnected sessionId: src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0
2025-10-10T14:38:03.244205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2534 sessionId: src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0 is DEAD
2025-10-10T14:38:03.243662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:03.245545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:03.245561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0] Write session will restart in 0.008191s
2025-10-10T14:38:03.245582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0] Write session: Do CDS request
2025-10-10T14:38:03.245588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:03.254862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.254946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:03.254961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2535
2025-10-10T14:38:03.255552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.255588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:03.255594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:03.255599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:03.256125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2535 sessionId:  describe result for acl check
2025-10-10T14:38:03.256157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:03.256160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:03.256161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:03.256168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602361261152154:11414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:03.256782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602361261152154:11414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:03.260084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602361261152154:11414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:03.262966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602361261152154:11414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:03.262982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602361261152154:11414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:03.262986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602361261152154:11414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:03.262995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:03.263138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:03.264998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:03.265250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:03.265264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:03.265277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:03.265400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:03.265454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602360478918684:11521]
2025-10-10T14:38:03.266088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:03.266481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:03.266544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:03.266877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:03.266926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.266927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.266928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.266929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.266931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.266932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.266933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.266935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.266936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.266937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.266938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.266939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.266940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.266948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.266961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.266965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.266969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.266973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.266977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.266981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.266985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.266989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.266993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.266997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.267000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.267004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.267011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.267020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.267026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.267031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.267037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.267042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.267046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.267051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.267056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.267062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.267066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.267071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.267075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.267081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.267085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.267091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.267096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.267101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.267105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.267110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.267115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.267120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.267124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.267129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.267135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.267140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.267179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:03.270282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:03.270663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:03.270681Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:03.270685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:03.270689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:03.270697Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2534 [2:7559602360478918684:11521]
2025-10-10T14:38:03.270715Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:03.270734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:03.270738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.270742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.270745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.270764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:03.270775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:03.270783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:03.270842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.270844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.270846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.270849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:03.270922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:03.270925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.270937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.270948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.270966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:03.270986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602360478918678:11521]
2025-10-10T14:38:03.270988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602360478918678:11521]
2025-10-10T14:38:03.270990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602360478918678:11521]
2025-10-10T14:38:03.271008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:03.271028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:03.271035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:03.271038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:03.271040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:03.271043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:03.271046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:03.271080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602360478918678:11521]
2025-10-10T14:38:03.271084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:03.271089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:03.271103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152242:11414], now have 1 active actors on pipe
2025-10-10T14:38:03.271113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152102:2438], now have 1 active actors on pipe
2025-10-10T14:38:03.271331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2534
2025-10-10T14:38:03.271371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2534
2025-10-10T14:38:03.271822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.271834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.271866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:03.271875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.271879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.271882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:03.271895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.271909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:03.271925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.272390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.272398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.272417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.272565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2535 partition: 0 MaxSeqNo: 40 sessionId: src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0
2025-10-10T14:38:03.273448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22ae1f07-cbfec46a-16c177b2-3dc34440_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:03.276438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0] Write session: try to update token
2025-10-10T14:38:03.276459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:03.283857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:03.283875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:03.283885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602360478918678:11521]
2025-10-10T14:38:03.283931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:03.284055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:03.284092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:03.284226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:03.284415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:03.284561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:03.285136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:03.285198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:03.307110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:03.307128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:03.307131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:03.307133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:03.307142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602360478918678:11521]
2025-10-10T14:38:03.307146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602360478918678:11521]
2025-10-10T14:38:03.307150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602360478918678:11521]
2025-10-10T14:38:03.307200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:03.307206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.307207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:03.307206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:03.307213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:03.307219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:03.307340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:03.306871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2535 sessionId: src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:03.309591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:03.344147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602361261152256:11209]
2025-10-10T14:38:03.344457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2534, pipe: [1:7559602361261152256:11209]
2025-10-10T14:38:03.425306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:03.425720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.425735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.425762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152256:11209], now have 1 active actors on pipe
2025-10-10T14:38:03.426361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602361261152256:11209]
2025-10-10T14:38:03.426397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:03.426400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:03.426458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2535 reason: error at write: Disconnected sessionId: src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0
2025-10-10T14:38:03.426655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2535 sessionId: src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0 is DEAD
2025-10-10T14:38:03.426808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:03.427483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:03.430122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:03.430136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0] Write session will restart in 0.005057s
2025-10-10T14:38:03.430162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0] Write session: Do CDS request
2025-10-10T14:38:03.430169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:03.441870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.442590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:03.442608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2536
2025-10-10T14:38:03.442781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.442816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:03.442821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:03.442825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:03.443255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2536 sessionId:  describe result for acl check
2025-10-10T14:38:03.443292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:03.443294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:03.443296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:03.443302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602361261152286:11419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:03.443848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602361261152286:11419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:03.447744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602361261152286:11419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:03.452520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602361261152286:11419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:03.452539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602361261152286:11419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:03.452543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602361261152286:11419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:03.452554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:03.460779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:03.462077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:03.462321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:03.462326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:03.462336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:03.462381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:03.462416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602360478918820:11524]
2025-10-10T14:38:03.462924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:03.463489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:03.463547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:03.463879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:03.463962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.463968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.463970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.463971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.463973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.463974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.463975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.463977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.463978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.463981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.463982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.463984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.463985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.463994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.464008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.464012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.464016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.464021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.464026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.464031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.464035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.464040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.464045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.464049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.464053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.464058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.464067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.464077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.464083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.464093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.464096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.464102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.464106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.464112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.464117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.464123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.464128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.464134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.464140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.464147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.464152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.464158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.464163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.464169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.464175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.464181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.464186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.464193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.464198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.464208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.464214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.464222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.464261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:03.472076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:03.472605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:03.472618Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:03.472621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:03.472625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:03.472633Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2535 [2:7559602360478918820:11524]
2025-10-10T14:38:03.472652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:03.472679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:03.472690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.472693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.472696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.472716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:03.472724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:03.472733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:03.472803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.472806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.472808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.472811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:03.473062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:03.473065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.473079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.473094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.473113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:03.473140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152375:11419], now have 1 active actors on pipe
2025-10-10T14:38:03.473143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152270:2438], now have 1 active actors on pipe
2025-10-10T14:38:03.473153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602360478918815:11524]
2025-10-10T14:38:03.473156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602360478918815:11524]
2025-10-10T14:38:03.473158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602360478918815:11524]
2025-10-10T14:38:03.473176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:03.473193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:03.473209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:03.473212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:03.473260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602360478918815:11524]
2025-10-10T14:38:03.473262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:03.473277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:03.473284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:03.473286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:03.473292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:03.474782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.474800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.474857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f84d8712-f426a857-3dda963b-f9787aec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:03.474875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.474885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.474889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:03.474903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.474924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:03.474953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.475216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.475225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.475243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.475811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f6bfa3b-c6627e25-70e33b16-409c2829_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f84d8712-f426a857-3dda963b-f9787aec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:03.474658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2535
2025-10-10T14:38:03.474695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2535
2025-10-10T14:38:03.475348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2536 partition: 0 MaxSeqNo: 40 sessionId: src_id|f84d8712-f426a857-3dda963b-f9787aec_0
2025-10-10T14:38:03.478748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d8712-f426a857-3dda963b-f9787aec_0] Write session: try to update token
2025-10-10T14:38:03.478770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d8712-f426a857-3dda963b-f9787aec_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:03.494392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:03.494413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:03.494417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:03.494419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:03.494430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602360478918815:11524]
2025-10-10T14:38:03.494434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602360478918815:11524]
2025-10-10T14:38:03.494439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602360478918815:11524]
2025-10-10T14:38:03.494492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:03.494498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.494501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:03.494530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:03.494545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:03.494550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:03.494656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:03.503425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2536 sessionId: src_id|f84d8712-f426a857-3dda963b-f9787aec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:03.506616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:03.526351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602361261152425:11209]
2025-10-10T14:38:03.526629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2535, pipe: [1:7559602361261152425:11209]
2025-10-10T14:38:03.618936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:03.619256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.619272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.619296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152425:11209], now have 1 active actors on pipe
2025-10-10T14:38:03.619561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:03.619726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:03.619736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602361261152425:11209]
2025-10-10T14:38:03.619746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:03.619766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:03.619813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2536 reason: error at write: Disconnected sessionId: src_id|f84d8712-f426a857-3dda963b-f9787aec_0
2025-10-10T14:38:03.620033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2536 sessionId: src_id|f84d8712-f426a857-3dda963b-f9787aec_0 is DEAD
2025-10-10T14:38:03.621426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d8712-f426a857-3dda963b-f9787aec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:03.621440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d8712-f426a857-3dda963b-f9787aec_0] Write session will restart in 0.008959s
2025-10-10T14:38:03.621465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d8712-f426a857-3dda963b-f9787aec_0] Write session: Do CDS request
2025-10-10T14:38:03.621474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d8712-f426a857-3dda963b-f9787aec_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:03.630591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:03.631986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d8712-f426a857-3dda963b-f9787aec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.632003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:03.632083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:03.632099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2537
2025-10-10T14:38:03.632265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.632322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:03.632336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:03.632304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:03.632331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:03.632335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:03.632351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:03.632429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:03.632475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602360478918944:11526]
2025-10-10T14:38:03.632812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2537 sessionId:  describe result for acl check
2025-10-10T14:38:03.632853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:03.632860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:03.632861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:03.632867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602361261152542:11423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:03.633103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:03.633445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:03.633449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602361261152542:11423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:03.633503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:03.633854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:03.633943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.633950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.633951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.633952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.633954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.633955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.633956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.633957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.633959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.633960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.633961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.633963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.633964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.633971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.633983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.633987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.633991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.633995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.633998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.634001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.634005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.634009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.634013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.634017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.634020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.634024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.634033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.634044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.634051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.634057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.634062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.634068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.634073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.634078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.634084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.634092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.634096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.634101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.634107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.634113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.634125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.634130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.634136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.634141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.634145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.634150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.634155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.634164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.634169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.634174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.634179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.634184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.634227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:03.635924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602361261152542:11423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:03.636675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:03.637003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:03.637015Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:03.637018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:03.637022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:03.637027Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2536 [2:7559602360478918944:11526]
2025-10-10T14:38:03.637041Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:03.637059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:03.637067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.637071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.637074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.637091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:03.637099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:03.637111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:03.637181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.637188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.637191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.637193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:03.637273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:03.637280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.637291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.637306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.637327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:03.637410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152427:2438], now have 1 active actors on pipe
2025-10-10T14:38:03.637424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602360478918938:11526]
2025-10-10T14:38:03.637428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602360478918938:11526]
2025-10-10T14:38:03.637430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602360478918938:11526]
2025-10-10T14:38:03.637443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:03.637460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:03.637463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:03.637464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:03.637465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:03.637480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:03.637488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:03.637455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2536
2025-10-10T14:38:03.637515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602360478918938:11526]
2025-10-10T14:38:03.637525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:03.637531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:03.642823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602361261152542:11423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:03.642842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602361261152542:11423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:03.642845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602361261152542:11423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:03.642856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:03.643158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152580:11423], now have 1 active actors on pipe
2025-10-10T14:38:03.643210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2536
2025-10-10T14:38:03.643309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.643327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.643379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:03.643397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.643403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.643407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:03.643423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.643452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:03.643480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.643734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.643747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.643773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.643896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2537 partition: 0 MaxSeqNo: 40 sessionId: src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0
2025-10-10T14:38:03.644339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d8712-f426a857-3dda963b-f9787aec_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:03.647207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0] Write session: try to update token
2025-10-10T14:38:03.647228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:03.649122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:03.649142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:03.649155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602360478918938:11526]
2025-10-10T14:38:03.649206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:03.649273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:03.649398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:03.649541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:03.649683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:03.649818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:03.650008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:03.650049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:03.662481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2537 sessionId: src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:03.665363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:03.665679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.665714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.665756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:03.665911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:03.667958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:03.667977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:03.667981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:03.667983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:03.667994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602360478918938:11526]
2025-10-10T14:38:03.667998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602360478918938:11526]
2025-10-10T14:38:03.668002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602360478918938:11526]
2025-10-10T14:38:03.668052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:03.668059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:03.668065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:03.668068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.668070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:03.668072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:03.668219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:03.719877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602361261152583:11209]
2025-10-10T14:38:03.720200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2536, pipe: [1:7559602361261152583:11209]
2025-10-10T14:38:03.793722Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:03.803107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.803137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.803334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.803412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.803488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.803561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.803624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.803629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.803712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.803778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.803848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.803918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.803962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.803965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.804041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.804110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.804177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.804248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.804621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.804626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.804702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.804769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.804837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.804907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.804954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.804958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.805036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.805104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.805175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.805248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.805294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.805296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.805544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.805616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.805683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.805748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.805792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.805795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.805872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.805941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.806014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.806083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.806131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.806135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.806214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.806278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.806343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.806411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.806465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.806468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.806565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.806631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.806698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.806766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.806812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.806815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.806901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:03.806978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:03.807058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:03.807140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:03.807191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:03.807194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:03.807275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152583:11209], now have 1 active actors on pipe
2025-10-10T14:38:03.808361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:03.809039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602361261152583:11209]
2025-10-10T14:38:03.809063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:03.809066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:03.809070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:03.809102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2537 reason: error at write: Disconnected sessionId: src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0
2025-10-10T14:38:03.809436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2537 sessionId: src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0 is DEAD
2025-10-10T14:38:03.810354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:03.810367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0] Write session will restart in 0.005299s
2025-10-10T14:38:03.810392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0] Write session: Do CDS request
2025-10-10T14:38:03.810399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:03.816925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.817036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:03.817065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2538
2025-10-10T14:38:03.817226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.817289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:03.817300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:03.817307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:03.817828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2538 sessionId:  describe result for acl check
2025-10-10T14:38:03.817876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:03.817883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:03.817886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:03.817893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602361261152608:11428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:03.818530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602361261152608:11428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:03.822007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602361261152608:11428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:03.824436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:03.826540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:03.826792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:03.826805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:03.826819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:03.826887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602361261152608:11428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:03.826905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602361261152608:11428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:03.826909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602361261152608:11428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:03.826918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:03.826889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:03.826969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602360478919070:11528]
2025-10-10T14:38:03.827479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:03.827848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:03.827884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:03.828123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:03.828178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.828179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.828180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.828181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.828182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.828183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.828183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.828184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.828185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.828186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.828187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.828188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.828188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.828193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.828203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.828205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.828207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.828210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.828212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.828215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.828217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.828220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.828222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.828225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.828227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.828229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.828235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.828241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.828246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.828250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.828253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.828256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.828260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.828263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.828265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.828269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.828272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.828276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.828281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.828286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.828291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.828296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.828301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.828307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.828312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.828316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.828319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.828322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.828325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.828328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.828331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.828335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.828358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:03.831200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:03.831525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:03.831539Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:03.831542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:03.831545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:03.831551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2537 [2:7559602360478919070:11528]
2025-10-10T14:38:03.831564Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:03.831578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:03.831582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.831586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.831588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.831604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:03.831616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:03.831625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:03.831683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.831689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.831691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.831693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:03.831759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:03.831765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.831773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.831780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.831790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:03.831809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602360478919065:11528]
2025-10-10T14:38:03.831814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602360478919065:11528]
2025-10-10T14:38:03.831815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602360478919065:11528]
2025-10-10T14:38:03.831826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:03.831838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:03.831851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:03.831858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:03.831872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:03.831879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:03.831880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:03.831888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602360478919065:11528]
2025-10-10T14:38:03.831892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:03.831938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:03.832086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152738:11428], now have 1 active actors on pipe
2025-10-10T14:38:03.832094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152593:2438], now have 1 active actors on pipe
2025-10-10T14:38:03.832206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2537
2025-10-10T14:38:03.832247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2537
2025-10-10T14:38:03.832395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.832404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.832432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:03.832440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:03.832443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:03.832446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:03.832456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:03.832468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:03.832481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.832686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.832694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.832708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:03.832826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2538 partition: 0 MaxSeqNo: 40 sessionId: src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0
2025-10-10T14:38:03.834262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff85ccf-cb860746-91dec8b2-b91cebb1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:03.837154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0] Write session: try to update token
2025-10-10T14:38:03.837175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:03.860400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:03.860420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:03.860424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:03.860427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:03.860441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602360478919065:11528]
2025-10-10T14:38:03.860444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602360478919065:11528]
2025-10-10T14:38:03.860448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602360478919065:11528]
2025-10-10T14:38:03.860492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:03.860499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.860500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:03.860516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:03.860527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:03.860535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:03.860636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:03.863619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2538 sessionId: src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:03.866208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:03.909368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602361261152752:11209]
2025-10-10T14:38:03.909698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2537, pipe: [1:7559602361261152752:11209]
2025-10-10T14:38:03.980966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:03.981599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:03.981619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:03.981673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152752:11209], now have 1 active actors on pipe
2025-10-10T14:38:03.981956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602361261152752:11209]
2025-10-10T14:38:03.981966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:03.981981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:03.981987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:03.981978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:03.982049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2538 reason: error at write: Disconnected sessionId: src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0
2025-10-10T14:38:03.982253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2538 sessionId: src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0 is DEAD
2025-10-10T14:38:03.985568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:03.985581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0] Write session will restart in 0.008014s
2025-10-10T14:38:03.985606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0] Write session: Do CDS request
2025-10-10T14:38:03.985629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:03.994919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.994966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:03.994983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2539
2025-10-10T14:38:03.995133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:03.995170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:03.995180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:03.995184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:03.995632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2539 sessionId:  describe result for acl check
2025-10-10T14:38:03.995674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:03.995681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:03.995683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:03.995689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602361261152873:11432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:03.995948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:03.996258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602361261152873:11432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:03.997544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:03.997758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:03.997770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:03.997783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:03.997843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:03.998224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602361261152873:11432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:03.997901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602360478919197:11530]
2025-10-10T14:38:03.998562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:03.998845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:03.998890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:03.999225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:03.999287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.999293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.999294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.999295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.999297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.999298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.999299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.999301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.999302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.999303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.999305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.999306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.999307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.999313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.999326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.999331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.999335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.999340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.999344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.999349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.999353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.999357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.999362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.999366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.999370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.999375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.999382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.999391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:03.999398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.999404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:03.999409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.999414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:03.999419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.999425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:03.999433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.999439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:03.999444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.999449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:03.999456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.999463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:03.999473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.999478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:03.999488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.999494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:03.999498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.999504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:03.999509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.999519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:03.999523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.999529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:03.999539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.999544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:03.999592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:04.002021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602361261152873:11432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:04.002036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602361261152873:11432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:04.002040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602361261152873:11432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:04.002049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:04.002110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:04.002453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:04.002466Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:04.002469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:04.002472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:04.002480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2538 [2:7559602360478919197:11530]
2025-10-10T14:38:04.002504Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:04.002523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:04.002531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.002535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.002537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.002554Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:04.002567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:04.002574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:04.002638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.002646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.002648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.002651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:04.002720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:04.002727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.002737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.002748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.002769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:04.002794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120200:11432], now have 1 active actors on pipe
2025-10-10T14:38:04.002802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602361261152757:2438], now have 1 active actors on pipe
2025-10-10T14:38:04.002809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602360478919192:11530]
2025-10-10T14:38:04.002812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602360478919192:11530]
2025-10-10T14:38:04.002814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602360478919192:11530]
2025-10-10T14:38:04.002833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:04.002853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:04.002850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2538
2025-10-10T14:38:04.002854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2538
2025-10-10T14:38:04.002877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:04.002886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:04.002889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:04.002891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:04.002894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:04.002913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602360478919192:11530]
2025-10-10T14:38:04.002917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:04.002927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:04.002933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.002937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.002990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:04.003004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.003008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.003010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:04.003022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.003033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:04.003057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.003238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.003246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.003262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.003706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2539 partition: 0 MaxSeqNo: 40 sessionId: src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0
2025-10-10T14:38:04.004089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1625d0-63115cc0-a2e1f52-21c8728a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:04.007056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0] Write session: try to update token
2025-10-10T14:38:04.007078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:04.023228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:04.023251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.023255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:04.023257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:04.023268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602360478919192:11530]
2025-10-10T14:38:04.023274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602360478919192:11530]
2025-10-10T14:38:04.023278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602360478919192:11530]
2025-10-10T14:38:04.023333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:04.023348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.023351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:04.023349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:04.023369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:04.023375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:04.023950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2539 sessionId: src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:04.023499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:04.026700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:04.081846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602365556120223:11209]
2025-10-10T14:38:04.082049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2538, pipe: [1:7559602365556120223:11209]
2025-10-10T14:38:04.140868Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:04.141289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.141307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.141376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120223:11209], now have 1 active actors on pipe
2025-10-10T14:38:04.141640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:04.141668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:04.141682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:04.141690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:04.141747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2539 reason: error at write: Disconnected sessionId: src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0
2025-10-10T14:38:04.141749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602365556120223:11209]
2025-10-10T14:38:04.141951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2539 sessionId: src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0 is DEAD
2025-10-10T14:38:04.142123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:04.142131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0] Write session will restart in 0.006179s
2025-10-10T14:38:04.142158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0] Write session: Do CDS request
2025-10-10T14:38:04.142164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:04.149960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.150123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:04.150142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2540
2025-10-10T14:38:04.150286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.150326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:04.150341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:04.150346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:04.150822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2540 sessionId:  describe result for acl check
2025-10-10T14:38:04.150864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:04.150871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:04.150873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:04.150880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602365556120282:11445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:04.151512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602365556120282:11445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:04.155027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602365556120282:11445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:04.155769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:04.157230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:04.157456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:04.157468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:04.157479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:04.157534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:04.157589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602364773886662:11546]
2025-10-10T14:38:04.157734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602365556120282:11445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:04.157748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602365556120282:11445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:04.157752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602365556120282:11445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:04.157760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:04.158408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:04.158687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:04.158732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:04.159083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:04.159143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.159149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.159150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.159151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.159152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.159154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.159155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.159156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.159157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.159158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.159160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.159161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.159162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.159169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.159184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.159188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.159192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.159196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.159201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.159205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.159209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.159213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.159217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.159221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.159226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.159229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.159237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.159246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.159253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.159258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.159264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.159270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.159274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.159280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.159285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.159290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.159295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.159300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.159305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.159310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.159316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.159322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.159327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.159332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.159337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.159342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.159349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.159363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.159367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.159373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.159378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.159383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.159424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:04.162182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:04.162603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:04.162615Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:04.162618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:04.162622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:04.162630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2539 [2:7559602364773886662:11546]
2025-10-10T14:38:04.162644Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:04.162664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:04.162673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.162677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.162680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.162697Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:04.162705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:04.162714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:04.162773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.162781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.162783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.162786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:04.162972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2539
2025-10-10T14:38:04.162992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2539
2025-10-10T14:38:04.163025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:04.163037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.163049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.163062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.163079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:04.163103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120235:2438], now have 1 active actors on pipe
2025-10-10T14:38:04.163114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120380:11445], now have 1 active actors on pipe
2025-10-10T14:38:04.163134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.163143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.163162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602364773886657:11546]
2025-10-10T14:38:04.163170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602364773886657:11546]
2025-10-10T14:38:04.163173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602364773886657:11546]
2025-10-10T14:38:04.163186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:04.163201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:04.163202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:04.163205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:04.163207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:04.163220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:04.163223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:04.163244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:04.163257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.163261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.163263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:04.163275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.163291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:04.163326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602364773886657:11546]
2025-10-10T14:38:04.163347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:04.163358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:04.163365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.163545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.163555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.163574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.163670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2540 partition: 0 MaxSeqNo: 40 sessionId: src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0
2025-10-10T14:38:04.164166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83279b39-b681b46a-ac81302f-dc43b1a1_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:04.167092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0] Write session: try to update token
2025-10-10T14:38:04.167110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:04.175361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:04.175383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.175394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602364773886657:11546]
2025-10-10T14:38:04.175440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:04.175449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:04.175628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:04.175779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.175919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.176065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.176274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:04.176310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:04.183589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2540 sessionId: src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:04.186581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:04.186880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.186907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.186956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:04.187089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:04.194379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:04.194399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.194402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:04.194404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:04.194416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602364773886657:11546]
2025-10-10T14:38:04.194420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602364773886657:11546]
2025-10-10T14:38:04.194424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602364773886657:11546]
2025-10-10T14:38:04.194477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:04.194487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:04.194503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.194505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:04.194506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:04.194522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:04.194642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:04.242147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602365556120391:11209]
2025-10-10T14:38:04.242447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2539, pipe: [1:7559602365556120391:11209]
2025-10-10T14:38:04.323350Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:04.333486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.333518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.333724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.333793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.333866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.333937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.333985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.333991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.334069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.334137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.334216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.334288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.334332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.334336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.334416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.334483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.334565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.334634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.334680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.334684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.334759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.334824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.334889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.334956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.334997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.335001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.335075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.335142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.335215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.335288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.335333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.335336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.335407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.335474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.335543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.335638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.335698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.335702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.335817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.335916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.335982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.336054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.336099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.336103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.336180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.336245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.336315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.336383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.336426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.336429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.336508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.336572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.336639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.336705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.336748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.336751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.336827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:04.336892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:04.336955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:04.337018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:04.337061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:04.337065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:04.337150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120391:11209], now have 1 active actors on pipe
2025-10-10T14:38:04.338032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:04.338090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602365556120391:11209]
2025-10-10T14:38:04.338451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:04.338462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:04.338511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2540 reason: error at write: Disconnected sessionId: src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0
2025-10-10T14:38:04.338734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2540 sessionId: src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0 is DEAD
2025-10-10T14:38:04.338858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:04.341852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:04.341866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0] Write session will restart in 0.009432s
2025-10-10T14:38:04.341893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0] Write session: Do CDS request
2025-10-10T14:38:04.341903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:04.353122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.357505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:04.357521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2541
2025-10-10T14:38:04.357756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.357791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:04.357797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:04.357801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:04.358329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2541 sessionId:  describe result for acl check
2025-10-10T14:38:04.358378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:04.358380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:04.358382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:04.358389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602365556120496:11449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:04.359083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602365556120496:11449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:04.365927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:04.368752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:04.368989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:04.368995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:04.369008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:04.369063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:04.369105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602364773886805:11549]
2025-10-10T14:38:04.369776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:04.370099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602365556120496:11449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:04.370112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:04.370159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:04.370506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:04.370562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.370563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.370565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.370566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.370568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.370569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.370570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.370571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.370572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.370574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.370575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.370576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.370578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.370585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.370600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.370604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.370609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.370614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.370619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.370623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.370627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.370631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.370636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.370641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.370645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.370649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.370658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.370667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.370675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.370681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.370686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.370692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.370715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.370721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.370726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.370732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.370738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.370745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.370750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.370757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.370763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.370769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.370775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.370781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.370786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.370793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.370798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.370804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.370810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.370816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.370821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.370827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.370873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:04.374047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602365556120496:11449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:04.374065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602365556120496:11449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:04.374069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602365556120496:11449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:04.374080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:04.374767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2540
2025-10-10T14:38:04.374796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2540
2025-10-10T14:38:04.373981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:04.374351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:04.374357Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:04.374360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:04.374365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:04.374373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2540 [2:7559602364773886805:11549]
2025-10-10T14:38:04.374389Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:04.374408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:04.374411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.374415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.374418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.374438Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:04.374445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:04.374453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:04.374532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.374534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.374536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.374539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:04.374616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:04.374619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.374632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.374644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.374663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:04.374687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120546:11449], now have 1 active actors on pipe
2025-10-10T14:38:04.374692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120394:2438], now have 1 active actors on pipe
2025-10-10T14:38:04.374699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602364773886799:11549]
2025-10-10T14:38:04.374702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602364773886799:11549]
2025-10-10T14:38:04.374704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602364773886799:11549]
2025-10-10T14:38:04.374721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:04.374734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:04.374736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:04.374738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:04.374740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:04.374754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:04.374757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:04.374786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602364773886799:11549]
2025-10-10T14:38:04.374789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:04.374799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:04.374820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.374825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.374863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:04.374872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.374876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.374878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:04.374889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.374900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:04.374916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.375181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.375197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.375214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.375876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2541 partition: 0 MaxSeqNo: 40 sessionId: src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0
2025-10-10T14:38:04.376270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bae88df-8ea554f9-d1f74450-7fd40a53_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:04.379099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0] Write session: try to update token
2025-10-10T14:38:04.379120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:04.389479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:04.389510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.389522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602364773886799:11549]
2025-10-10T14:38:04.389575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:04.389758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:04.389907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.390050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.390185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.390378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:04.390422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:04.390832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:04.412786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2541 sessionId: src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:04.415985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:04.417704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.417730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.417762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:04.417766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.417769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:04.417772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:04.417782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602364773886799:11549]
2025-10-10T14:38:04.417786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602364773886799:11549]
2025-10-10T14:38:04.417790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602364773886799:11549]
2025-10-10T14:38:04.417850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:04.417861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.417863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:04.417867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:04.417874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:04.417878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:04.418005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:04.436719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602365556120565:11209]
2025-10-10T14:38:04.437258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2540, pipe: [1:7559602365556120565:11209]
2025-10-10T14:38:04.546605Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:04.546881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:04.546927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120565:11209], now have 1 active actors on pipe
2025-10-10T14:38:04.547052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:04.547229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:04.547286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602365556120565:11209]
2025-10-10T14:38:04.559836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:04.559852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0] Write session will restart in 0.006116s
2025-10-10T14:38:04.559877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0] Write session: Do CDS request
2025-10-10T14:38:04.559884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:04.559478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:04.559495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:04.559524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2541 reason: error at write: Disconnected sessionId: src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0
2025-10-10T14:38:04.559696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2541 sessionId: src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0 is DEAD
2025-10-10T14:38:04.566956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.567329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:04.567347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2542
2025-10-10T14:38:04.567480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.567516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:04.567523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:04.567526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:04.568220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:04.568056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2542 sessionId:  describe result for acl check
2025-10-10T14:38:04.568105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:04.568109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:04.568111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:04.568118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602365556120689:11454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:04.568707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602365556120689:11454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:04.570041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:04.570282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:04.570296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:04.570308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:04.570363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:04.570408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602364773886937:11551]
2025-10-10T14:38:04.571010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:04.571429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:04.571495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:04.571851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:04.571939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.571945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.571946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.571947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.571949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.571951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.571952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.571953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.571955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.571956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.571958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.571959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.571960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.571967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.571979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.571984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.571988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.571992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.571997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.572001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.572005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.572009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.572013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.572017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.572021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.572026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.572034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.572042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.572051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.572061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.572066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.572072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.572082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.572088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.572093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.571863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602365556120689:11454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:04.572098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.572107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.572112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.572118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.572125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.572130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.572136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.572145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.572150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.572154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.572164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.572169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.572174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.572183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.572189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.572194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.572204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.572246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:04.574766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:04.575210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:04.575223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:04.575225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:04.575229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:04.575236Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2541 [2:7559602364773886937:11551]
2025-10-10T14:38:04.575249Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:04.575269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:04.575278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.575283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.575285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.575305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:04.575317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:04.575326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:04.575388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.575396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.575398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.575401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:04.575472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:04.575491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.575502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.575513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.575532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:04.575566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120569:2438], now have 1 active actors on pipe
2025-10-10T14:38:04.575580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602364773886932:11551]
2025-10-10T14:38:04.575591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602364773886932:11551]
2025-10-10T14:38:04.575593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602364773886932:11551]
2025-10-10T14:38:04.575607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:04.575613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:04.575617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:04.575619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:04.575622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:04.575640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:04.575644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:04.575151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602365556120689:11454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:04.575168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602365556120689:11454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:04.575172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602365556120689:11454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:04.575182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:04.575569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2541
2025-10-10T14:38:04.575676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602364773886932:11551]
2025-10-10T14:38:04.575689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:04.575710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:04.575895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120724:11454], now have 1 active actors on pipe
2025-10-10T14:38:04.575863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2541
2025-10-10T14:38:04.575933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.575943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.575973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:04.575986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.575991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.575994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:04.576006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.576023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:04.576042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.576230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.576241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.576265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.576387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2542 partition: 0 MaxSeqNo: 40 sessionId: src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0
2025-10-10T14:38:04.576817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0377830-8603f52d-5a61bcdb-3f8a954f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:04.579535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0] Write session: try to update token
2025-10-10T14:38:04.579554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:04.596458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:04.596480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.596484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:04.596486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:04.596496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602364773886932:11551]
2025-10-10T14:38:04.596501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602364773886932:11551]
2025-10-10T14:38:04.596506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602364773886932:11551]
2025-10-10T14:38:04.596556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:04.596565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.596571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:04.596573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:04.596578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:04.596583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:04.596721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:04.599491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2542 sessionId: src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:04.602384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:04.647630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602365556120733:11209]
2025-10-10T14:38:04.648083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2541, pipe: [1:7559602365556120733:11209]
2025-10-10T14:38:04.724005Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:04.724488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.724527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.724585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120733:11209], now have 1 active actors on pipe
2025-10-10T14:38:04.724869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:04.724831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:04.724897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602365556120733:11209]
2025-10-10T14:38:04.724915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:04.724919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:04.724985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2542 reason: error at write: Disconnected sessionId: src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0
2025-10-10T14:38:04.725311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2542 sessionId: src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0 is DEAD
2025-10-10T14:38:04.725494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:04.725505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0] Write session will restart in 0.005723s
2025-10-10T14:38:04.725531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0] Write session: Do CDS request
2025-10-10T14:38:04.725541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:04.733931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.734016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:04.734034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2543
2025-10-10T14:38:04.734224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.734259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:04.734263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:04.734267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:04.734743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2543 sessionId:  describe result for acl check
2025-10-10T14:38:04.734781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:04.734783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:04.734787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:04.734795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602365556120742:11458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:04.735445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602365556120742:11458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:04.739018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602365556120742:11458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:04.744862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602365556120742:11458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:04.744884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602365556120742:11458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:04.744887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602365556120742:11458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:04.744897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:04.747521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:04.748995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:04.749220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:04.749233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:04.749246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:04.749312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:04.749379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602364773887070:11553]
2025-10-10T14:38:04.750051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:04.750405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:04.750518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:04.750953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:04.751045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.751052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.751053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.751054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.751056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.751057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.751058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.751060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.751061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.751062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.751063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.751064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.751066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.751073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.751087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.751091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.751095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.751100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.751104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.751108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.751113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.751117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.751122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.751126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.751130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.751134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.751152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.751161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.751167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.751178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.751184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.751194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.751199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.751204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.751214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.751219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.751229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.751234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.751239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.751245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.751250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.751255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.751260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.751265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.751269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.751275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.751285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.751290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.751295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.751306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.751310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.751321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.751370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:04.754065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:04.754715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:04.754728Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:04.754731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:04.754735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:04.754743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2542 [2:7559602364773887070:11553]
2025-10-10T14:38:04.754756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:04.754775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:04.754788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.754792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.754795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.754814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:04.754822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:04.754830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:04.754899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.754907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.754909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.754912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:04.754984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:04.754994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.755006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.755018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.755032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:04.755056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120862:11458], now have 1 active actors on pipe
2025-10-10T14:38:04.755069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120735:2438], now have 1 active actors on pipe
2025-10-10T14:38:04.755077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602364773887065:11553]
2025-10-10T14:38:04.755084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602364773887065:11553]
2025-10-10T14:38:04.755088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602364773887065:11553]
2025-10-10T14:38:04.755103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:04.755125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:04.755147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:04.755155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:04.755151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2542
2025-10-10T14:38:04.755156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2542
2025-10-10T14:38:04.755187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602364773887065:11553]
2025-10-10T14:38:04.755195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:04.755196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:04.755199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:04.755201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:04.755208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:04.755294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.755307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.755355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:04.755364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.755368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.755370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:04.755383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.755399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:04.755420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.755662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.755674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.755692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.755839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2543 partition: 0 MaxSeqNo: 40 sessionId: src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0
2025-10-10T14:38:04.756305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a246f8-6dc08185-c17f834c-b3a7b48b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:04.759109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0] Write session: try to update token
2025-10-10T14:38:04.759129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:04.767376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:04.767394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.767404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602364773887065:11553]
2025-10-10T14:38:04.767453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:04.767467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:04.767628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:04.767776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.767918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.768056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:04.768354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:04.768399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:04.785887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:04.785905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.785907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:04.785909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:04.785920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602364773887065:11553]
2025-10-10T14:38:04.785928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602364773887065:11553]
2025-10-10T14:38:04.785931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602364773887065:11553]
2025-10-10T14:38:04.785976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:04.785983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.785984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:04.786122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:04.787456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:04.787468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:04.787472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:04.798558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2543 sessionId: src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:04.801318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:04.825158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602365556120901:11209]
2025-10-10T14:38:04.825640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2542, pipe: [1:7559602365556120901:11209]
2025-10-10T14:38:04.911329Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:04.911757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.911776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.911803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120901:11209], now have 1 active actors on pipe
2025-10-10T14:38:04.912075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:04.912546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:04.912655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2543 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0
2025-10-10T14:38:04.912824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2543 sessionId: src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0 is DEAD
2025-10-10T14:38:04.912952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:04.912994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602365556120901:11209]
2025-10-10T14:38:04.917447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:04.917463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0] Write session will restart in 0.008205s
2025-10-10T14:38:04.917492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0] Write session: Do CDS request
2025-10-10T14:38:04.917499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:04.928574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.928774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:04.928792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2544
2025-10-10T14:38:04.929029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:04.929066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:04.929072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:04.929080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:04.929881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2544 sessionId:  describe result for acl check
2025-10-10T14:38:04.929921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:04.929928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:04.929930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:04.929937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602365556120923:11463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:04.930635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602365556120923:11463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:04.934134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602365556120923:11463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:04.938520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602365556120923:11463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:04.938541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602365556120923:11463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:04.938545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602365556120923:11463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:04.938562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:04.942770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:04.948274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:04.948559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:04.948572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:04.948586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:04.948658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:04.948713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602364773887204:11555]
2025-10-10T14:38:04.949381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:04.949855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:04.949922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:04.950271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:04.950362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.950364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.950365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.950366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.950368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.950369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.950370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.950372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.950374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.950375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.950377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.950378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.950379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.950387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.950400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.950404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.950408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.950412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.950416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.950420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.950424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.950428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.950432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.950436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.950439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.950443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.950453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.950461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:04.950469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.950490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:04.950496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.950501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:04.950506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.950511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:04.950517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.950522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:04.950527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.950532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:04.950537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.950542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:04.950548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.950553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:04.950559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.950565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:04.950572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.950577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:04.950582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.950591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.950598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.950604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.950609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.950614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.950657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:04.958613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:04.959230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:04.959243Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:04.959246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:04.959251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:04.959258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2543 [2:7559602364773887204:11555]
2025-10-10T14:38:04.959274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:04.959294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:04.959304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.959308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.959310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.959332Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:04.959346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:04.959360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:04.959445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.959453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.959456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.959459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:04.959535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:04.959545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.959558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:04.959570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:04.959588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:04.959614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556121020:11463], now have 1 active actors on pipe
2025-10-10T14:38:04.959618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602365556120907:2438], now have 1 active actors on pipe
2025-10-10T14:38:04.959628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602364773887199:11555]
2025-10-10T14:38:04.959630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602364773887199:11555]
2025-10-10T14:38:04.959633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602364773887199:11555]
2025-10-10T14:38:04.959647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:04.959666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:04.959715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2543
2025-10-10T14:38:04.959770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2543
2025-10-10T14:38:04.959670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:04.959674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:04.959677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:04.959681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:04.959687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:04.959729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602364773887199:11555]
2025-10-10T14:38:04.959734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:04.959739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:04.960124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.960130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.960193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:04.960209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:04.960214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:04.960217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:04.960229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:04.960243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:04.960265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.960537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:04.960547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:04.960578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:04.960744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2544 partition: 0 MaxSeqNo: 40 sessionId: src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0
2025-10-10T14:38:04.962989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffe3d5c7-989f1676-46ec5208-726b861c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:04.965964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0] Write session: try to update token
2025-10-10T14:38:04.965986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:04.980459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:04.980485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:04.980489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:04.980491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:04.980502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602364773887199:11555]
2025-10-10T14:38:04.980507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602364773887199:11555]
2025-10-10T14:38:04.980513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602364773887199:11555]
2025-10-10T14:38:04.980570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:04.980577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:04.980579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:04.980583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:04.980587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:04.980589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:04.980742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:04.982916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2544 sessionId: src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:04.985618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:05.012203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602369851088366:11209]
2025-10-10T14:38:05.012509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2543, pipe: [1:7559602369851088366:11209]
2025-10-10T14:38:05.103525Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:05.104180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.104200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.104248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088366:11209], now have 1 active actors on pipe
2025-10-10T14:38:05.106061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:05.108518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:05.108534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:05.108599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2544 reason: error at write: Disconnected sessionId: src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0
2025-10-10T14:38:05.108802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2544 sessionId: src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0 is DEAD
2025-10-10T14:38:05.108876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602369851088366:11209]
2025-10-10T14:38:05.108892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:05.112803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:05.112817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0] Write session will restart in 0.009246s
2025-10-10T14:38:05.112841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0] Write session: Do CDS request
2025-10-10T14:38:05.112850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:05.124249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.124310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:05.124330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2545
2025-10-10T14:38:05.124498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.124569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:05.124580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:05.124586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:05.125115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2545 sessionId:  describe result for acl check
2025-10-10T14:38:05.125154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:05.125162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:05.125164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:05.125171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602369851088417:11473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:05.125796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602369851088417:11473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:05.129058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602369851088417:11473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:05.133271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:05.134932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:05.135135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:05.135148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:05.135159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:05.135211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:05.135256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602369068854665:11564]
2025-10-10T14:38:05.135418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602369851088417:11473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:05.135434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602369851088417:11473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:05.135438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602369851088417:11473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:05.135446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:05.135898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:05.136187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:05.136231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:05.136667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:05.136737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.136743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.136744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.136745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.136747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.136748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.136749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.136750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.136752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.136753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.136754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.136756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.136757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.136763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.136775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.136779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.136788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.136792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.136796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.136800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.136803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.136812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.136822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.136826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.136830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.136834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.136841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.136855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.136865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.136871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.136880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.136885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.136890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.136897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.136908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.136917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.136926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.136933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.136942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.136952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.136956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.136965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.136971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.136980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.136988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.136993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.137001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.137005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.137012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.137017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.137021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.137030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.137066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:05.139714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:05.140157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:05.140168Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:05.140170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:05.140174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:05.140181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2544 [2:7559602369068854665:11564]
2025-10-10T14:38:05.140198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:05.140215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:05.140224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.140228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.140230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.140248Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:05.140256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:05.140268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:05.140350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.140357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.140358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.140361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:05.140428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:05.140436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.140448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.140458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.140473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:05.140501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088377:2438], now have 1 active actors on pipe
2025-10-10T14:38:05.140505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088534:11473], now have 1 active actors on pipe
2025-10-10T14:38:05.140512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602369068854648:11564]
2025-10-10T14:38:05.140519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602369068854648:11564]
2025-10-10T14:38:05.140522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602369068854648:11564]
2025-10-10T14:38:05.140535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:05.140545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:05.140547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:05.140549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:05.140554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:05.140571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:05.140579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:05.140580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2544
2025-10-10T14:38:05.140612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602369068854648:11564]
2025-10-10T14:38:05.140619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:05.140633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:05.140656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.140638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2544
2025-10-10T14:38:05.140663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.140695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:05.140708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.140712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.140714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:05.140726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.140738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:05.140753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.140877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.140884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.140898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.140970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2545 partition: 0 MaxSeqNo: 40 sessionId: src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0
2025-10-10T14:38:05.141429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe9b14d-bb6d11a3-585a06e6-c1f96f72_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:05.144387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0] Write session: try to update token
2025-10-10T14:38:05.144412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:05.159029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:05.159047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:05.159058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602369068854648:11564]
2025-10-10T14:38:05.159093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:05.159110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:05.159302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:05.159468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:05.159601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:05.159740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:05.159962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:05.159999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:05.164826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2545 sessionId: src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:05.167750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:05.167992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.168013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.168055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:05.168149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:05.177674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:05.177697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:05.177703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:05.177705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:05.177717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602369068854648:11564]
2025-10-10T14:38:05.177721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602369068854648:11564]
2025-10-10T14:38:05.177724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602369068854648:11564]
2025-10-10T14:38:05.177776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:05.177790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.177792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:05.177953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:05.181072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:05.181091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:05.181096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:05.209300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602369851088558:11209]
2025-10-10T14:38:05.209586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2544, pipe: [1:7559602369851088558:11209]
2025-10-10T14:38:05.292007Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:05.300421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.300451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.300605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.300665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.300730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.300802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.300846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.300854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.300933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.300992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.301057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.301126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.301169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.301171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.301247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.301310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.301508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.301582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.301628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.301631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.301708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.301773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.301846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.301918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.301967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.301970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.302046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.302109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.302175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.302247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.302294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.302296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.302373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.302439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.302530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.302597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.302642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.302645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.302720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.302788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.302855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.302923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.302971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.302974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.303048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.303116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.303183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.303245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.303288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.303292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.303366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.303424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.303485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.303551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.303597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.303600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.303669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.303729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.303790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.303858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.303913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.303916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.303976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088558:11209], now have 1 active actors on pipe
2025-10-10T14:38:05.306123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:05.306138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0] Write session will restart in 0.006344s
2025-10-10T14:38:05.306169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0] Write session: Do CDS request
2025-10-10T14:38:05.306176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:05.305639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602369851088558:11209]
2025-10-10T14:38:05.305678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:05.305729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:05.305732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:05.305763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2545 reason: error at write: Disconnected sessionId: src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0
2025-10-10T14:38:05.305962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2545 sessionId: src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0 is DEAD
2025-10-10T14:38:05.305668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:05.317892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.321723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:05.321736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2546
2025-10-10T14:38:05.325726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.325778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:05.325784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:05.325790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:05.326293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2546 sessionId:  describe result for acl check
2025-10-10T14:38:05.326320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:05.326321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:05.326322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:05.326327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602369851088655:11480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:05.327289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602369851088655:11480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:05.336607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:05.340662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602369851088655:11480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:05.339585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:05.339912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:05.339918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:05.339932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:05.339999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:05.340044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602369068854820:11574]
2025-10-10T14:38:05.340713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:05.341552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:05.341624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:05.341985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:05.342068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.342069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.342071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.342072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.342073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.342075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.342076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.342078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.342079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.342080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.342081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.342083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.342084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.342091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.342104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.342108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.342112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.342115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.342119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.342123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.342127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.342130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.342135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.342138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.342142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.342145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.342155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.342165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.342172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.342178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.342183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.342189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.342194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.342200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.342205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.342210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.342214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.342220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.342225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.342230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.342235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.342240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.342245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.342250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.342255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.342263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.342268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.342273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.342278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.342284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.342289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.342295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.342339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:05.351352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602369851088655:11480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:05.351372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602369851088655:11480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:05.351377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602369851088655:11480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:05.351387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:05.353735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:05.354068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:05.354074Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:05.354077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:05.354081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:05.354088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2545 [2:7559602369068854820:11574]
2025-10-10T14:38:05.354104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:05.354122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:05.354126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.354130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.354133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.354152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:05.354161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:05.354170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:05.354240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.354243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.354245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.354248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:05.354326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:05.354329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.354341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.354354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.354372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:05.354395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602369068854815:11574]
2025-10-10T14:38:05.354398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602369068854815:11574]
2025-10-10T14:38:05.354400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602369068854815:11574]
2025-10-10T14:38:05.354417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:05.354433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:05.354448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:05.354452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:05.354526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602369068854815:11574]
2025-10-10T14:38:05.354529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:05.354753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:05.354759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:05.354762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:05.354768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:05.355848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088717:11480], now have 1 active actors on pipe
2025-10-10T14:38:05.355864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088560:2438], now have 1 active actors on pipe
2025-10-10T14:38:05.355882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.355888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.355922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:05.355931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.355936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.355938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:05.355952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.355966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:05.355983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.356592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.356599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.356618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.357200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a3f2b2-7aa3f6b9-245cb8b4-89da97e4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:05.355531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2545
2025-10-10T14:38:05.355558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2545
2025-10-10T14:38:05.356789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2546 partition: 0 MaxSeqNo: 40 sessionId: src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0
2025-10-10T14:38:05.359979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0] Write session: try to update token
2025-10-10T14:38:05.359997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:05.390514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2546 sessionId: src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:05.393035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:05.393556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.393582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.393640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:05.393783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:05.395473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:05.395488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:05.395490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:05.395491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:05.395499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602369068854815:11574]
2025-10-10T14:38:05.395503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602369068854815:11574]
2025-10-10T14:38:05.395506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602369068854815:11574]
2025-10-10T14:38:05.395545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:05.395553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.395555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:05.395687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:05.397547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:05.397557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:05.397561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:05.408140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602369851088737:11209]
2025-10-10T14:38:05.410843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2545, pipe: [1:7559602369851088737:11209]
2025-10-10T14:38:05.513156Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:05.513604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088737:11209], now have 1 active actors on pipe
2025-10-10T14:38:05.521596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.521623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.521804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.521869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.521935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.521999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.522043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.522053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.522118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.522183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.522247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.522318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.522363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.522371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.522442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.522518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.522583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.522653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.522700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.522708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.522775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.522839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.522902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.522968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.523012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.523020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.523085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.523145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.523207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.523274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.523333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.523341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.523411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.523472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.523539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.523603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.523648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.523657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.523724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.523786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.523850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.523916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.523961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.523969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.524036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.524097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.524161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.524225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.524272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.524281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.524351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.524410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.524473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.524537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.524582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.524585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.524649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:05.525292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602369851088737:11209]
2025-10-10T14:38:05.525297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:05.525301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:05.525323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:05.525350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2546 reason: error at write: Disconnected sessionId: src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0
2025-10-10T14:38:05.524713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:05.524792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:05.524852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:05.524893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:05.524895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:05.525580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2546 sessionId: src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0 is DEAD
2025-10-10T14:38:05.525728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:05.525737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0] Write session will restart in 0.009477s
2025-10-10T14:38:05.525762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0] Write session: Do CDS request
2025-10-10T14:38:05.525768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:05.526673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:05.536909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.536976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:05.536996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2547
2025-10-10T14:38:05.537158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.537203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:05.537209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:05.537214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:05.537701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2547 sessionId:  describe result for acl check
2025-10-10T14:38:05.537737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:05.537746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:05.537748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:05.537754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602369851088756:11485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:05.538321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602369851088756:11485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:05.541804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602369851088756:11485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:05.544850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:05.546405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:05.546489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602369851088756:11485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:05.546507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602369851088756:11485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:05.546511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602369851088756:11485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:05.546522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:05.546648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:05.546661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:05.546674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:05.546738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:05.546786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602369068854957:11576]
2025-10-10T14:38:05.547460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:05.547800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:05.547878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:05.548244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:05.548326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.548334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.548336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.548337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.548338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.548340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.548341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.548342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.548343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.548345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.548346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.548347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.548348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.548355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.548368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.548372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.548376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.548379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.548382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.548386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.548389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.548392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.548396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.548400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.548403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.548408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.548417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.548426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.548432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.548438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.548443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.548449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.548453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.548459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.548464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.548469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.548473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.548479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.548485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.548491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.548501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.548506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.548511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.548516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.548522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.548527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.548532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.548538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.548543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.548548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.548553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.548559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.548617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:05.551216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:05.551583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:05.551598Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:05.551601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:05.551605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:05.551611Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2546 [2:7559602369068854957:11576]
2025-10-10T14:38:05.551625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:05.551645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:05.551655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.551669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.551672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.551690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:05.551700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:05.551712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:05.551774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.551779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.551781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.551784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:05.551853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:05.551862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.551874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.551886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.551903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:05.551930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088740:2438], now have 1 active actors on pipe
2025-10-10T14:38:05.551934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088894:11485], now have 1 active actors on pipe
2025-10-10T14:38:05.551942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602369068854952:11576]
2025-10-10T14:38:05.551944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602369068854952:11576]
2025-10-10T14:38:05.551946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602369068854952:11576]
2025-10-10T14:38:05.551965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:05.551980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:05.551993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:05.552002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:05.552005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:05.552006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:05.551992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2546
2025-10-10T14:38:05.552008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:05.552002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2546
2025-10-10T14:38:05.552036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602369068854952:11576]
2025-10-10T14:38:05.552044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:05.552062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:05.552082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.552091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.552125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:05.552137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.552142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.552145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:05.552156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.552170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:05.552183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.552303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.552310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.552326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.552405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2547 partition: 0 MaxSeqNo: 40 sessionId: src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0
2025-10-10T14:38:05.552797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aed4a225-f2f2879a-988d95a3-3ef213ef_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:05.555702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0] Write session: try to update token
2025-10-10T14:38:05.555724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:05.571662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:05.571679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:05.571683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:05.571685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:05.571695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602369068854952:11576]
2025-10-10T14:38:05.571699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602369068854952:11576]
2025-10-10T14:38:05.571703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602369068854952:11576]
2025-10-10T14:38:05.571755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:05.571764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:05.571766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:05.571768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:05.571774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.571780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:05.571919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:05.572224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2547 sessionId: src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:05.575040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:05.625579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602369851088905:11209]
2025-10-10T14:38:05.625939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2546, pipe: [1:7559602369851088905:11209]
2025-10-10T14:38:05.690296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:05.690551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.690560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.690606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088905:11209], now have 1 active actors on pipe
2025-10-10T14:38:05.690925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:05.691036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:05.691042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602369851088905:11209]
2025-10-10T14:38:05.691063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:05.691068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:05.691141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2547 reason: error at write: Disconnected sessionId: src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0
2025-10-10T14:38:05.691332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2547 sessionId: src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0 is DEAD
2025-10-10T14:38:05.692471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:05.692483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0] Write session will restart in 0.005038s
2025-10-10T14:38:05.692519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0] Write session: Do CDS request
2025-10-10T14:38:05.692526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:05.700622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.700720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:05.700740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2548
2025-10-10T14:38:05.700883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.700952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:05.700964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:05.700980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:05.701526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2548 sessionId:  describe result for acl check
2025-10-10T14:38:05.701580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:05.701588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:05.701594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:05.701604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602369851088922:11489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:05.702232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602369851088922:11489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:05.705259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602369851088922:11489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:05.708264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602369851088922:11489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:05.708291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602369851088922:11489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:05.708295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602369851088922:11489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:05.708304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:05.725345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:05.727115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:05.727369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:05.727375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:05.727387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:05.727446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:05.727490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602369068855095:11578]
2025-10-10T14:38:05.728090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:05.728502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:05.728549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:05.728852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:05.728925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.728926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.728927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.728929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.728930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.728932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.728933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.728934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.728936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.728937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.728939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.728940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.728941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.728947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.728960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.728963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.728967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.728970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.728974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.728977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.728981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.728984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.728988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.728992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.728995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.728999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.729008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.729016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.729022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.729027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.729032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.729036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.729041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.729045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.729049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.729054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.729058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.729063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.729070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.729074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.729078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.729083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.729088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.729093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.729096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.729101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.729104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.729109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.729115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.729119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.729123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.729128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.729164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:05.734451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2547
2025-10-10T14:38:05.733573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:05.733953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:05.734500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2547
2025-10-10T14:38:05.733958Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:05.733962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:05.733967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:05.733986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2547 [2:7559602369068855095:11578]
2025-10-10T14:38:05.734002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:05.734025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:05.734029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.734033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.734036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.734056Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:05.734065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:05.734074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:05.734146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.734149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.734152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.734155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:05.734235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:05.734239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.734253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.734265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.734284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:05.734308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088989:11489], now have 1 active actors on pipe
2025-10-10T14:38:05.734312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851088907:2438], now have 1 active actors on pipe
2025-10-10T14:38:05.734335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602369068855090:11578]
2025-10-10T14:38:05.734338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602369068855090:11578]
2025-10-10T14:38:05.734341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602369068855090:11578]
2025-10-10T14:38:05.734359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:05.734376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:05.734397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:05.734400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:05.734443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602369068855090:11578]
2025-10-10T14:38:05.734446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:05.734821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:05.734829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:05.734831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:05.734839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:05.735189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.735200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.735236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:05.735247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.735253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.735255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:05.735268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.735282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:05.735300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.735609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.735619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.735638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.735809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2548 partition: 0 MaxSeqNo: 40 sessionId: src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0
2025-10-10T14:38:05.736325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980c525d-8b02b61-c04cb528-49dd9bdf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:05.739331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0] Write session: try to update token
2025-10-10T14:38:05.739357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:05.758313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2548 sessionId: src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:05.757084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:05.757109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:05.757112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:05.757114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:05.757125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602369068855090:11578]
2025-10-10T14:38:05.757130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602369068855090:11578]
2025-10-10T14:38:05.757135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602369068855090:11578]
2025-10-10T14:38:05.757191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:05.757196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:05.757199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.757201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:05.757203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:05.757209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:05.757379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:05.761154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:05.789902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602369851089080:11209]
2025-10-10T14:38:05.790288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2547, pipe: [1:7559602369851089080:11209]
2025-10-10T14:38:05.878922Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:05.879416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.879434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.879480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851089080:11209], now have 1 active actors on pipe
2025-10-10T14:38:05.879657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:05.880237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:05.880249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0] Write session will restart in 0.005133s
2025-10-10T14:38:05.880276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0] Write session: Do CDS request
2025-10-10T14:38:05.880282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:05.879685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602369851089080:11209]
2025-10-10T14:38:05.879729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:05.879817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0
2025-10-10T14:38:05.880036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2548 sessionId: src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0 is DEAD
2025-10-10T14:38:05.880228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:05.886975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.887016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:05.887032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2549
2025-10-10T14:38:05.887293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:05.887343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:05.887355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:05.887359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:05.887869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2549 sessionId:  describe result for acl check
2025-10-10T14:38:05.887908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:05.887917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:05.887919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:05.887926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602369851089135:11494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:05.888543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602369851089135:11494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:05.891346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602369851089135:11494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:05.893517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:05.895044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:05.894939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602369851089135:11494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:05.894954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602369851089135:11494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:05.894958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602369851089135:11494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:05.894967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:05.895295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:05.895307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:05.895320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:05.895376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:05.895422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602369068855233:11580]
2025-10-10T14:38:05.896002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:05.896341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:05.896412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:05.896784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:05.896854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.896860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.896861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.896863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.896864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.896865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.896867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.896868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.896870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.896871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.896872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.896873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.896875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.896882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.896897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.896902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.896907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.896912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.896917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.896922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.896926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.896930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.896935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.896938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.896942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.896946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.896955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.896965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:05.896972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.896978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:05.896982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.896988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:05.896994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.897000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:05.897006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.897012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:05.897024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.897030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:05.897036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.897042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:05.897047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.897053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:05.897059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.897065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:05.897070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.897081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:05.897087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.897099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.897109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.897116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.897125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.897131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.897196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:05.899921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:05.900294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:05.900309Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:05.900312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:05.900317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:05.900324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2548 [2:7559602369068855233:11580]
2025-10-10T14:38:05.900342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:05.900363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:05.900366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.900370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.900373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.900392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:05.900406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:05.900421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:05.900493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.900503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.900506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.900509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:05.900589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:05.900601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.900616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:05.900629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:05.900646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:05.900674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851089086:2438], now have 1 active actors on pipe
2025-10-10T14:38:05.900683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851089242:11494], now have 1 active actors on pipe
2025-10-10T14:38:05.900691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602369068855227:11580]
2025-10-10T14:38:05.900694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602369068855227:11580]
2025-10-10T14:38:05.900697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602369068855227:11580]
2025-10-10T14:38:05.900712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:05.900730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:05.900749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:05.900754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:05.900754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:05.900756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:05.900759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:05.900743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2548
2025-10-10T14:38:05.900746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2548
2025-10-10T14:38:05.900797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602369068855227:11580]
2025-10-10T14:38:05.900808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:05.900810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:05.900843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.900849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.900890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:05.900898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:05.900902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:05.900905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:05.900916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:05.900928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:05.900954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.901123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:05.901133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:05.901150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:05.901241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2549 partition: 0 MaxSeqNo: 40 sessionId: src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0
2025-10-10T14:38:05.904934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3340e03-8f205995-3c40c666-4e8c6c6c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:05.907893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0] Write session: try to update token
2025-10-10T14:38:05.907916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:05.920526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:05.920547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:05.920551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:05.920553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:05.920563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602369068855227:11580]
2025-10-10T14:38:05.920569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602369068855227:11580]
2025-10-10T14:38:05.920573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602369068855227:11580]
2025-10-10T14:38:05.920606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:05.920610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:05.920614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:05.920617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:05.920625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:05.920628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:05.920774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:05.922644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2549 sessionId: src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:05.925396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:05.979869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602369851089253:11209]
2025-10-10T14:38:05.980148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2548, pipe: [1:7559602369851089253:11209]
2025-10-10T14:38:06.039057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:06.039546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.039558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.039608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602369851089253:11209], now have 1 active actors on pipe
2025-10-10T14:38:06.040181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602369851089253:11209]
2025-10-10T14:38:06.040216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:06.040251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:06.039874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:06.040324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2549 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0
2025-10-10T14:38:06.040509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2549 sessionId: src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0 is DEAD
2025-10-10T14:38:06.045440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:06.045458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0] Write session will restart in 0.007208s
2025-10-10T14:38:06.045487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0] Write session: Do CDS request
2025-10-10T14:38:06.045494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:06.054003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.057742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:06.057758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2550
2025-10-10T14:38:06.057943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.057994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:06.058000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:06.058006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:06.058521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2550 sessionId:  describe result for acl check
2025-10-10T14:38:06.058562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:06.058569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:06.058571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:06.058579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602374146056615:11498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:06.059171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602374146056615:11498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:06.061969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602374146056615:11498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:06.063069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:06.064509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:06.064731Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:06.064745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:06.064757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:06.064815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:06.064855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602373363822667:11582]
2025-10-10T14:38:06.064933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602374146056615:11498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:06.064950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602374146056615:11498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:06.064954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602374146056615:11498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:06.064962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:06.065480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:06.065795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:06.065863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:06.066229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:06.066309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.066318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.066320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.066321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.066322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.066323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.066324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.066325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.066327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.066328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.066329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.066330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.066331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.066337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.066352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.066357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.066361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.066364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.066368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.066371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.066375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.066380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.066384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.066388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.066391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.066394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.066403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.066422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.066429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.066435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.066440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.066445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.066450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.066467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.066472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.066477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.066482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.066488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.066500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.066506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.066511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.066516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.066521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.066534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.066539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.066549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.066554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.066564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.066568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.066574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.066583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.066589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.066636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:06.069194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:06.069642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:06.069656Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:06.069658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:06.069662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:06.069668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2549 [2:7559602373363822667:11582]
2025-10-10T14:38:06.069680Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:06.069697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:06.069705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.069709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.069711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.069738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:06.069749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:06.069757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:06.069810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.069816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.069819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.069822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:06.069888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:06.069895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.069908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.069919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.069935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:06.069960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146056709:11498], now have 1 active actors on pipe
2025-10-10T14:38:06.069968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146056551:2438], now have 1 active actors on pipe
2025-10-10T14:38:06.069975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602373363822662:11582]
2025-10-10T14:38:06.069977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602373363822662:11582]
2025-10-10T14:38:06.069980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602373363822662:11582]
2025-10-10T14:38:06.069994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:06.070012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:06.070016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:06.070026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:06.070028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:06.070028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:06.070031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:06.070054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602373363822662:11582]
2025-10-10T14:38:06.070065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:06.070069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:06.070045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2549
2025-10-10T14:38:06.070086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2549
2025-10-10T14:38:06.070117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.070125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.070158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:06.070169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.070174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.070180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:06.070191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.070201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:06.070219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.070435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.070447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.070480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.070788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2550 partition: 0 MaxSeqNo: 40 sessionId: src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0
2025-10-10T14:38:06.071192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a20e94e7-7d0bc3b7-faffd926-f692932b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:06.073936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0] Write session: try to update token
2025-10-10T14:38:06.073955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:06.082508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:06.082529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:06.082540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602373363822662:11582]
2025-10-10T14:38:06.082596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:06.082779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:06.082922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:06.083058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:06.083202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:06.083395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:06.083437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:06.083569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:06.088709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2550 sessionId: src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:06.091324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:06.091702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.091732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.091773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:06.091934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:06.102680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:06.102701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:06.102705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:06.102707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:06.102719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602373363822662:11582]
2025-10-10T14:38:06.102725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602373363822662:11582]
2025-10-10T14:38:06.102729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602373363822662:11582]
2025-10-10T14:38:06.102782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:06.102791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:06.102797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:06.102809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:06.102812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.102815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:06.102957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:06.140112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602374146056720:11209]
2025-10-10T14:38:06.140417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2549, pipe: [1:7559602374146056720:11209]
2025-10-10T14:38:06.225954Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:06.234968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.235001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.235186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.235249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.235307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.235369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.235410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.235420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.235494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.235550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.235611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.235674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.235718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.235721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.235791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.235849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.235908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.235969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.236014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.236017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.236084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.236144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.236205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.236268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.236309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.236312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.236382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.236441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.236503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.236564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.236603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.236606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.236676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.236735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.236794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.236854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.236898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.236901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.236968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.237028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.237089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.237151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.237192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.237198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.237268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.237569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.237639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.237698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.237740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.237744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.237812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.237869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.237929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.237989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.238030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.238033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.238110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.238165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.238227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.238290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.238331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.238334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.238408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146056720:11209], now have 1 active actors on pipe
2025-10-10T14:38:06.240065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:06.240081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:06.240112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2550 reason: error at write: Disconnected sessionId: src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0
2025-10-10T14:38:06.240321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2550 sessionId: src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0 is DEAD
2025-10-10T14:38:06.240472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602374146056720:11209]
2025-10-10T14:38:06.240609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:06.239987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:06.240821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:06.240833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0] Write session will restart in 0.005106s
2025-10-10T14:38:06.240860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0] Write session: Do CDS request
2025-10-10T14:38:06.240866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:06.247011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.247744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:06.247761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2551
2025-10-10T14:38:06.250094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.250161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:06.250174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:06.250178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:06.250641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2551 sessionId:  describe result for acl check
2025-10-10T14:38:06.250679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:06.250684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:06.250687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:06.250694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602374146056761:11511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:06.251303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602374146056761:11511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:06.254578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602374146056761:11511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:06.259909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602374146056761:11511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:06.259925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602374146056761:11511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:06.259929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602374146056761:11511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:06.259939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:06.263639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:06.265359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:06.265569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:06.265584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:06.265597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:06.265652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:06.265700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602373363822849:11598]
2025-10-10T14:38:06.266347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:06.266685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:06.266730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:06.267056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:06.267112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.267119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.267120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.267121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.267123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.267124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.267126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.267127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.267129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.267130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.267131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.267133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.267134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.267141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.267154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.267159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.267163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.267167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.267172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.267175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.267180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.267185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.267189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.267194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.267199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.267203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.267211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.267221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.267232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.267238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.267246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.267252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.267261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.267266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.267271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.267277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.267288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.267298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.267303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.267309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.267314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.267324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.267329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.267335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.267345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.267351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.267358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.267363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.267373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.267378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.267383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.267388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.267428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:06.270123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:06.270697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:06.270712Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:06.270716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:06.270721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:06.270728Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2550 [2:7559602373363822849:11598]
2025-10-10T14:38:06.270744Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:06.270764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:06.270772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.270776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.270779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.270799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:06.270813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:06.270822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:06.270893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.270902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.270904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.270907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:06.270981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:06.270993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.271006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.271023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.271042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:06.271073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146056879:11511], now have 1 active actors on pipe
2025-10-10T14:38:06.271077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146056751:2438], now have 1 active actors on pipe
2025-10-10T14:38:06.271086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602373363822844:11598]
2025-10-10T14:38:06.271089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602373363822844:11598]
2025-10-10T14:38:06.271091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602373363822844:11598]
2025-10-10T14:38:06.271103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:06.271129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:06.271147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:06.271151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:06.271162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:06.271170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:06.271172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:06.271183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602373363822844:11598]
2025-10-10T14:38:06.271187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:06.271189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:06.271182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2550
2025-10-10T14:38:06.271183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2550
2025-10-10T14:38:06.271390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.271402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.271438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cc08972-d754ceff-dba761e5-32454d9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:06.271452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.271457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.271460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:06.271474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.271492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:06.271509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.271723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.271731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.271746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.271879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2551 partition: 0 MaxSeqNo: 40 sessionId: src_id|9cc08972-d754ceff-dba761e5-32454d9e_0
2025-10-10T14:38:06.272344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbaceb71-8cd1d741-248eddf8-f923dc1e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|9cc08972-d754ceff-dba761e5-32454d9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:06.275630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc08972-d754ceff-dba761e5-32454d9e_0] Write session: try to update token
2025-10-10T14:38:06.275658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc08972-d754ceff-dba761e5-32454d9e_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:06.292249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:06.292271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:06.292274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:06.292276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:06.292287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602373363822844:11598]
2025-10-10T14:38:06.292292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602373363822844:11598]
2025-10-10T14:38:06.292296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602373363822844:11598]
2025-10-10T14:38:06.292350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:06.292358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.292356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:06.292360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:06.292363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:06.292368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:06.292501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:06.298111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2551 sessionId: src_id|9cc08972-d754ceff-dba761e5-32454d9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:06.301177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:06.340824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602374146056915:11209]
2025-10-10T14:38:06.341226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2550, pipe: [1:7559602374146056915:11209]
2025-10-10T14:38:06.419577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:06.420144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.420157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.420218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146056915:11209], now have 1 active actors on pipe
2025-10-10T14:38:06.420580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602374146056915:11209]
2025-10-10T14:38:06.420617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:06.420678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:06.420686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:06.420766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2551 reason: error at write: Disconnected sessionId: src_id|9cc08972-d754ceff-dba761e5-32454d9e_0
2025-10-10T14:38:06.420983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2551 sessionId: src_id|9cc08972-d754ceff-dba761e5-32454d9e_0 is DEAD
2025-10-10T14:38:06.420588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:06.421155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc08972-d754ceff-dba761e5-32454d9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:06.421168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc08972-d754ceff-dba761e5-32454d9e_0] Write session will restart in 0.006674s
2025-10-10T14:38:06.421196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc08972-d754ceff-dba761e5-32454d9e_0] Write session: Do CDS request
2025-10-10T14:38:06.421205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc08972-d754ceff-dba761e5-32454d9e_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:06.428828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc08972-d754ceff-dba761e5-32454d9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.429186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:06.429205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2552
2025-10-10T14:38:06.429359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.429392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:06.429398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:06.429404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:06.429970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2552 sessionId:  describe result for acl check
2025-10-10T14:38:06.430006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:06.430008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:06.430010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:06.430016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602374146056947:11518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:06.430685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602374146056947:11518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:06.435276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602374146056947:11518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:06.439937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602374146056947:11518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:06.439954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602374146056947:11518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:06.439959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602374146056947:11518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:06.439968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:06.441633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:06.443051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:06.443258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:06.443271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:06.443283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:06.443339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:06.443397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602373363823002:11601]
2025-10-10T14:38:06.444040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:06.444309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:06.444350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:06.444667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:06.444728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.444735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.444737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.444738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.444739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.444741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.444742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.444743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.444744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.444746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.444747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.444748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.444749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.444755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.444769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.444773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.444777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.444782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.444786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.444790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.444794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.444798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.444802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.444805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.444810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.444814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.444822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.444830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.444837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.444843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.444847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.444851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.444856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.444862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.444866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.444873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.444877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.444883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.444887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.444892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.444897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.444903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.444908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.444913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.444918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.444924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.444930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.444941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.444946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.444956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.444960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.444970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.445012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:06.447652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:06.448251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:06.448264Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:06.448267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:06.448271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:06.448277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2551 [2:7559602373363823002:11601]
2025-10-10T14:38:06.448292Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:06.448683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2551
2025-10-10T14:38:06.448717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2551
2025-10-10T14:38:06.448312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:06.448324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.448327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.448330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.448358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:06.448366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:06.448374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:06.448440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.448443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.448445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.448447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:06.448521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:06.448525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.448536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.448546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.448561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:06.448587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146056932:2438], now have 1 active actors on pipe
2025-10-10T14:38:06.448590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057088:11518], now have 1 active actors on pipe
2025-10-10T14:38:06.448598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602373363822997:11601]
2025-10-10T14:38:06.448601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602373363822997:11601]
2025-10-10T14:38:06.448603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602373363822997:11601]
2025-10-10T14:38:06.448618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:06.448633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:06.448649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:06.448652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:06.448677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602373363822997:11601]
2025-10-10T14:38:06.448680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:06.448712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:06.448716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:06.448719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:06.448727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:06.448924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.448930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.448967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:06.448983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.448987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.448991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:06.449004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.449021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:06.449044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.449246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.449256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.449273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.449373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2552 partition: 0 MaxSeqNo: 40 sessionId: src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0
2025-10-10T14:38:06.449763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc08972-d754ceff-dba761e5-32454d9e_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:06.452509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0] Write session: try to update token
2025-10-10T14:38:06.452529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:06.468640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:06.468662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:06.468665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:06.468667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:06.468678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602373363822997:11601]
2025-10-10T14:38:06.468683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602373363822997:11601]
2025-10-10T14:38:06.468687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602373363822997:11601]
2025-10-10T14:38:06.468739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:06.468747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.468750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:06.468809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:06.468825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:06.468829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:06.468901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:06.468960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2552 sessionId: src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:06.471737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:06.520509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602374146057103:11209]
2025-10-10T14:38:06.520779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2551, pipe: [1:7559602374146057103:11209]
2025-10-10T14:38:06.595758Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:06.596249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.596267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.596320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057103:11209], now have 1 active actors on pipe
2025-10-10T14:38:06.596643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:06.596660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:06.596737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2552 reason: error at write: Disconnected sessionId: src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0
2025-10-10T14:38:06.596975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2552 sessionId: src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0 is DEAD
2025-10-10T14:38:06.597019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602374146057103:11209]
2025-10-10T14:38:06.597044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:06.597349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:06.597364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0] Write session will restart in 0.006840s
2025-10-10T14:38:06.597397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0] Write session: Do CDS request
2025-10-10T14:38:06.597403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:06.596611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:06.605918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.605951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:06.605967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2553
2025-10-10T14:38:06.606196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.606252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:06.606263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:06.606268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:06.606745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2553 sessionId:  describe result for acl check
2025-10-10T14:38:06.606780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:06.606787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:06.606788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:06.606809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602374146057130:11522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:06.607398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602374146057130:11522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:06.609989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602374146057130:11522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:06.614109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:06.613973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602374146057130:11522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:06.614002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602374146057130:11522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:06.614006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602374146057130:11522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:06.614017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:06.614958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:06.615123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:06.615128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:06.615138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:06.615178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:06.615206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602373363823144:11603]
2025-10-10T14:38:06.615628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:06.616042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:06.616080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:06.616302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:06.616339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.616340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.616341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.616342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.616343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.616345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.616346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.616347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.616348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.616350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.616351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.616352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.616354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.616359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.616371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.616375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.616378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.616382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.616386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.616390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.616393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.616397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.616401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.616416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.616418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.616420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.616428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.616433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.616438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.616441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.616444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.616447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.616449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.616453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.616456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.616459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.616461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.616465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.616467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.616470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.616473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.616477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.616480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.616483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.616485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.616488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.616491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.616494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.616497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.616500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.616504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.616507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.616529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:06.619079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:06.619624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:06.619635Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:06.619637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:06.619641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:06.619647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2552 [2:7559602373363823144:11603]
2025-10-10T14:38:06.619659Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:06.619677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:06.619680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.619683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.619686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.619702Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:06.619715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:06.619727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:06.619781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.619791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.619793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.619796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:06.619862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:06.619869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.619880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.619890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.619904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:06.619928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057263:11522], now have 1 active actors on pipe
2025-10-10T14:38:06.619938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057104:2438], now have 1 active actors on pipe
2025-10-10T14:38:06.619945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602373363823137:11603]
2025-10-10T14:38:06.619947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602373363823137:11603]
2025-10-10T14:38:06.619949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602373363823137:11603]
2025-10-10T14:38:06.619963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:06.619981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:06.619997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:06.620004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:06.620020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:06.620027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602373363823137:11603]
2025-10-10T14:38:06.620029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:06.620031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:06.620033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:06.620041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:06.619997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2552
2025-10-10T14:38:06.620020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2552
2025-10-10T14:38:06.620077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.620087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.620117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:06.620129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.620132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.620135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:06.620145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.620157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:06.620174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.620517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.620529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.620554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.620670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2553 partition: 0 MaxSeqNo: 40 sessionId: src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0
2025-10-10T14:38:06.621087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57190104-5e17b8ea-d2327f00-8864e9b4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:06.623791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0] Write session: try to update token
2025-10-10T14:38:06.623812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:06.632180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:06.632202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:06.632214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602373363823137:11603]
2025-10-10T14:38:06.632266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:06.632270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:06.632451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:06.632597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:06.632737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:06.632882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:06.633091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:06.633133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:06.648999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2553 sessionId: src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:06.652280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:06.652537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.652563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.652609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:06.652688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:06.654760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:06.654780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:06.654784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:06.654786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:06.654798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602373363823137:11603]
2025-10-10T14:38:06.654803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602373363823137:11603]
2025-10-10T14:38:06.654808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602373363823137:11603]
2025-10-10T14:38:06.654857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:06.654862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:06.654866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:06.654867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:06.654875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.654878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:06.655023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:06.701408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602374146057277:11209]
2025-10-10T14:38:06.701906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2552, pipe: [1:7559602374146057277:11209]
2025-10-10T14:38:06.774513Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:06.782665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.782695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.782862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.782914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.782971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.783035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.783073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.783077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.783146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.783206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.783268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.783329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.783368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.783371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.783433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.783489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.783553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.783610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.783653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.783656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.783719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.783784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.783848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.783912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.783950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.783954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.784033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.784091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.784153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.784214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.784256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.784259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.784327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.784385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.784448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.784510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.784553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.784557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.784625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.784687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.784756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.784830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.784876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.784879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.784958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.785021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.785088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.785153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.785195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.785198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.785276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.785586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.785655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.786517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:06.786521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:06.786526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:06.786561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2553 reason: error at write: Disconnected sessionId: src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0
2025-10-10T14:38:06.786580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602374146057277:11209]
2025-10-10T14:38:06.786797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2553 sessionId: src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0 is DEAD
2025-10-10T14:38:06.786943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:06.786955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0] Write session will restart in 0.007762s
2025-10-10T14:38:06.786981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0] Write session: Do CDS request
2025-10-10T14:38:06.786987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:06.785721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.785766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.785769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.785842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:06.785900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:06.785961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:06.786028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:06.786073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:06.786078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:06.786147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057277:11209], now have 1 active actors on pipe
2025-10-10T14:38:06.787340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:06.795907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.796025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:06.796041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2554
2025-10-10T14:38:06.796258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.796297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:06.796313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:06.796318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:06.796799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2554 sessionId:  describe result for acl check
2025-10-10T14:38:06.796834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:06.796845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:06.796847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:06.796854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602374146057317:11527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:06.797454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602374146057317:11527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:06.800553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602374146057317:11527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:06.804384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602374146057317:11527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:06.804401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602374146057317:11527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:06.804405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602374146057317:11527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:06.804414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:06.804619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:06.805878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:06.806079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:06.806091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:06.806102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:06.806161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:06.806206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602373363823287:11605]
2025-10-10T14:38:06.806702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:06.807000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:06.807037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:06.807328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:06.807405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.807412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.807414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.807415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.807416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.807417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.807419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.807420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.807422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.807423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.807425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.807426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.807427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.807433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.807446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.807450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.807455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.807459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.807463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.807467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.807472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.807476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.807481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.807485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.807489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.807493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.807500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.807509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.807516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.807522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.807527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.807532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.807537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.807543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.807548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.807553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.807557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.807561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.807566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.807571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.807582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.807588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.807593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.807599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.807603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.807611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.807615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.807621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.807629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.807640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.807644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.807650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.807687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:06.810424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:06.810997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:06.811004Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:06.811006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:06.811010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:06.811017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2553 [2:7559602373363823287:11605]
2025-10-10T14:38:06.811030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:06.811066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:06.811069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.811074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.811077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.811094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:06.811102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:06.811110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:06.811168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.811170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.811172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.811175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:06.811249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:06.811252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.811264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.811275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.811293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:06.811326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602373363823281:11605]
2025-10-10T14:38:06.811329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602373363823281:11605]
2025-10-10T14:38:06.811331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602373363823281:11605]
2025-10-10T14:38:06.811344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:06.811361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:06.811378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:06.811381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:06.811405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602373363823281:11605]
2025-10-10T14:38:06.811407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:06.811557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:06.811561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:06.811562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:06.811570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:06.811870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057444:11527], now have 1 active actors on pipe
2025-10-10T14:38:06.811880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057284:2438], now have 1 active actors on pipe
2025-10-10T14:38:06.813598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2553
2025-10-10T14:38:06.813625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2553
2025-10-10T14:38:06.813837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.813846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.813873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b35bb43-54cbb0af-694276e3-220cd311_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:06.813881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.813886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.813887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:06.813900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.813912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:06.813926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.817575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.817584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.817606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.817760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2554 partition: 0 MaxSeqNo: 40 sessionId: src_id|3b35bb43-54cbb0af-694276e3-220cd311_0
2025-10-10T14:38:06.818110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7422f7-c47c57fb-f57cb0f8-bd3ab7cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|3b35bb43-54cbb0af-694276e3-220cd311_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:06.820623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b35bb43-54cbb0af-694276e3-220cd311_0] Write session: try to update token
2025-10-10T14:38:06.820638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b35bb43-54cbb0af-694276e3-220cd311_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:06.838907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:06.838928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:06.838932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:06.838934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:06.838945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602373363823281:11605]
2025-10-10T14:38:06.838950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602373363823281:11605]
2025-10-10T14:38:06.838955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602373363823281:11605]
2025-10-10T14:38:06.839007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:06.839006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:06.839012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:06.839016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:06.839020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.839022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:06.839158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:06.840049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2554 sessionId: src_id|3b35bb43-54cbb0af-694276e3-220cd311_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:06.842744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:06.886605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602374146057460:11209]
2025-10-10T14:38:06.887059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2553, pipe: [1:7559602374146057460:11209]
2025-10-10T14:38:06.954244Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:06.954675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.954695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.954741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057460:11209], now have 1 active actors on pipe
2025-10-10T14:38:06.955217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:06.957315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:06.957816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b35bb43-54cbb0af-694276e3-220cd311_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:06.957828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b35bb43-54cbb0af-694276e3-220cd311_0] Write session will restart in 0.007264s
2025-10-10T14:38:06.957855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b35bb43-54cbb0af-694276e3-220cd311_0] Write session: Do CDS request
2025-10-10T14:38:06.957862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b35bb43-54cbb0af-694276e3-220cd311_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:06.957438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b35bb43-54cbb0af-694276e3-220cd311_0
2025-10-10T14:38:06.957650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2554 sessionId: src_id|3b35bb43-54cbb0af-694276e3-220cd311_0 is DEAD
2025-10-10T14:38:06.957830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602374146057460:11209]
2025-10-10T14:38:06.957845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:06.965895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b35bb43-54cbb0af-694276e3-220cd311_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.966156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:06.966174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2555
2025-10-10T14:38:06.966295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:06.966331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:06.966337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:06.966341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:06.966824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2555 sessionId:  describe result for acl check
2025-10-10T14:38:06.966859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:06.966865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:06.966867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:06.966873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602374146057520:11531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:06.967421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602374146057520:11531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:06.970472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602374146057520:11531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:06.972825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:06.973355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602374146057520:11531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:06.973372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602374146057520:11531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:06.973376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602374146057520:11531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:06.973385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:06.974928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:06.975131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:06.975143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:06.975155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:06.975208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:06.975252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602373363823431:11607]
2025-10-10T14:38:06.975761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:06.976031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:06.976076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:06.976385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:06.976442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.976448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.976450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.976451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.976452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.976453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.976455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.976459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.976461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.976462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.976463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.976464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.976465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.976471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.976485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.976489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.976493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.976498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.976502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.976505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.976509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.976513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.976518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.976522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.976526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.976530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.976537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.976545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:06.976552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.976566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:06.976571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.976576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:06.976581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.976586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:06.976591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.976598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:06.976602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.976607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:06.976612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.976617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:06.976622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.976626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:06.976631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.976636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:06.976641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.976646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:06.976651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.976655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.976660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.976666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.976671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.976676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.976716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:06.979369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:06.979751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:06.979763Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:06.979766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:06.979770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:06.979776Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2554 [2:7559602373363823431:11607]
2025-10-10T14:38:06.979790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:06.979808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:06.979814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.979818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.979821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.979838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:06.979847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:06.979855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:06.979915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.979926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.979928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.979931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:06.980000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:06.980010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:06.980022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:06.980036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:06.980153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2554
2025-10-10T14:38:06.980205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2554
2025-10-10T14:38:06.980072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:06.980102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057470:2438], now have 1 active actors on pipe
2025-10-10T14:38:06.980106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602374146057627:11531], now have 1 active actors on pipe
2025-10-10T14:38:06.980114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602373363823425:11607]
2025-10-10T14:38:06.980126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602373363823425:11607]
2025-10-10T14:38:06.980130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602373363823425:11607]
2025-10-10T14:38:06.980144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:06.980159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:06.980177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:06.980181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:06.980189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:06.980192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:06.980194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:06.980206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602373363823425:11607]
2025-10-10T14:38:06.980209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:06.980214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:06.980234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.980239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.980276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:06.980284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:06.980288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:06.980291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:06.980302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:06.980315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:06.980333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.980808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:06.980814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:06.980846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:06.980992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2555 partition: 0 MaxSeqNo: 40 sessionId: src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0
2025-10-10T14:38:06.981425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b35bb43-54cbb0af-694276e3-220cd311_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:06.984229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0] Write session: try to update token
2025-10-10T14:38:06.984246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:06.999408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2555 sessionId: src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:07.000168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:07.000186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:07.000190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:07.000192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:07.000202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602373363823425:11607]
2025-10-10T14:38:07.000207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602373363823425:11607]
2025-10-10T14:38:07.000211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602373363823425:11607]
2025-10-10T14:38:07.000256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:07.000259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:07.000262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:07.000266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:07.000267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.000270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:07.000412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:07.002153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:07.058163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602378441024937:11209]
2025-10-10T14:38:07.058508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2554, pipe: [1:7559602378441024937:11209]
2025-10-10T14:38:07.114224Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:07.114609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.114626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.114672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441024937:11209], now have 1 active actors on pipe
2025-10-10T14:38:07.115100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:07.115010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602378441024937:11209]
2025-10-10T14:38:07.115050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:07.115053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:07.115055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:07.115124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2555 reason: error at write: Disconnected sessionId: src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0
2025-10-10T14:38:07.115324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2555 sessionId: src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0 is DEAD
2025-10-10T14:38:07.115767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:07.115777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0] Write session will restart in 0.005674s
2025-10-10T14:38:07.115803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0] Write session: Do CDS request
2025-10-10T14:38:07.115810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:07.122958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.123008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:07.123039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2556
2025-10-10T14:38:07.123229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.123266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:07.123272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:07.123275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:07.123804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2556 sessionId:  describe result for acl check
2025-10-10T14:38:07.123847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:07.123855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:07.123857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:07.123864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602378441024954:11535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:07.124460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602378441024954:11535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:07.128380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602378441024954:11535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:07.136948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602378441024954:11535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:07.136966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602378441024954:11535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:07.136971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602378441024954:11535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:07.136981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:07.141379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:07.143412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:07.143639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:07.143652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:07.143665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:07.143726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:07.143774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602377658790874:11610]
2025-10-10T14:38:07.144418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:07.144938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:07.144991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:07.145321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:07.145417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.145425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.145427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.145428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.145429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.145431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.145432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.145434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.145436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.145437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.145439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.145440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.145441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.145448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.145462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.145466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.145470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.145474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.145478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.145482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.145490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.145494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.145499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.145503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.145507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.145512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.145522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.145531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.145538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.145548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.145553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.145563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.145568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.145578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.145584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.145594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.145598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.145604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.145614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.145620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.145628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.145634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.145644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.145650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.145655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.145664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.145669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.145679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.145684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.145695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.145701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.145711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.145754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:07.148956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:07.149557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:07.149575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:07.149578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:07.149582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:07.149591Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2555 [2:7559602377658790874:11610]
2025-10-10T14:38:07.149606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:07.149628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:07.149632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.149636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.149639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.149659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:07.149672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:07.149681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:07.149757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.149764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.149766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.149769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:07.149846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:07.149854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.149867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.149881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.149903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:07.149930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602377658790868:11610]
2025-10-10T14:38:07.149937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602377658790868:11610]
2025-10-10T14:38:07.149940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602377658790868:11610]
2025-10-10T14:38:07.149954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:07.149974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:07.149995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:07.150004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:07.150041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602377658790868:11610]
2025-10-10T14:38:07.150049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:07.150185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:07.150197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:07.150199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:07.150205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:07.150510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025081:11535], now have 1 active actors on pipe
2025-10-10T14:38:07.150520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441024938:2438], now have 1 active actors on pipe
2025-10-10T14:38:07.150925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2555
2025-10-10T14:38:07.150960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2555
2025-10-10T14:38:07.151348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.151365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.151404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba5a816f-f67594a7-40768e95-91cc3253_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:07.151424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.151434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.151438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:07.151453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.151473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:07.151496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.151784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.151793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.151808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.151939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2556 partition: 0 MaxSeqNo: 40 sessionId: src_id|ba5a816f-f67594a7-40768e95-91cc3253_0
2025-10-10T14:38:07.153467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63a9ba79-2b95ced6-424b24d9-da676caf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ba5a816f-f67594a7-40768e95-91cc3253_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:07.156313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5a816f-f67594a7-40768e95-91cc3253_0] Write session: try to update token
2025-10-10T14:38:07.156336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5a816f-f67594a7-40768e95-91cc3253_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:07.176237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:07.176257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:07.176265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:07.176267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:07.176277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602377658790868:11610]
2025-10-10T14:38:07.176282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602377658790868:11610]
2025-10-10T14:38:07.176286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602377658790868:11610]
2025-10-10T14:38:07.176336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:07.176344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.176346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:07.176499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:07.174766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2556 sessionId: src_id|ba5a816f-f67594a7-40768e95-91cc3253_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:07.177527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:07.177674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:07.177688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:07.177693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:07.215278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602378441025127:11209]
2025-10-10T14:38:07.217672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2555, pipe: [1:7559602378441025127:11209]
2025-10-10T14:38:07.293917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:07.294323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.294336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.294386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025127:11209], now have 1 active actors on pipe
2025-10-10T14:38:07.294655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:07.295386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:07.295422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:07.295477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602378441025127:11209]
2025-10-10T14:38:07.295516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2556 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba5a816f-f67594a7-40768e95-91cc3253_0
2025-10-10T14:38:07.295695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2556 sessionId: src_id|ba5a816f-f67594a7-40768e95-91cc3253_0 is DEAD
2025-10-10T14:38:07.301697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5a816f-f67594a7-40768e95-91cc3253_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:07.301715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5a816f-f67594a7-40768e95-91cc3253_0] Write session will restart in 0.008011s
2025-10-10T14:38:07.301747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5a816f-f67594a7-40768e95-91cc3253_0] Write session: Do CDS request
2025-10-10T14:38:07.301755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5a816f-f67594a7-40768e95-91cc3253_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:07.313834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5a816f-f67594a7-40768e95-91cc3253_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.314195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:07.314214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2557
2025-10-10T14:38:07.317543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.317604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:07.317611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:07.317616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:07.318321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2557 sessionId:  describe result for acl check
2025-10-10T14:38:07.318361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:07.318363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:07.318365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:07.318372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602378441025246:11548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:07.318956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602378441025246:11548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:07.322869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602378441025246:11548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:07.324928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:07.327212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602378441025246:11548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:07.327229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602378441025246:11548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:07.327233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602378441025246:11548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:07.327243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:07.326877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:07.327366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:07.327372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:07.327390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:07.327477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:07.327521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602377658791069:11625]
2025-10-10T14:38:07.328119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:07.328466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:07.328533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:07.328876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:07.328953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.328958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.328959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.328960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.328961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.328962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.328962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.328963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.328964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.328965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.328966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.328966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.328967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.328972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.328982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.328984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.328987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.328989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.328992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.328994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.328997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.328999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.329002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.329004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.329007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.329009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.329018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.329024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.329028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.329032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.329035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.329038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.329041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.329045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.329048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.329052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.329056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.329059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.329062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.329066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.329068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.329072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.329075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.329078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.329081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.329084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.329088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.329091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.329094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.329098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.329102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.329105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.329132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:07.332686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2556
2025-10-10T14:38:07.332731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2556
2025-10-10T14:38:07.331666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:07.332190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:07.332196Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:07.332199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:07.332203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:07.332210Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2556 [2:7559602377658791069:11625]
2025-10-10T14:38:07.332229Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:07.333485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2557 partition: 0 MaxSeqNo: 40 sessionId: src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0
2025-10-10T14:38:07.334629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5a816f-f67594a7-40768e95-91cc3253_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:07.332249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:07.332253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.332257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.332260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.332279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:07.332288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:07.332296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:07.332366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.332368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.332370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.332373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:07.332455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:07.332458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.332471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.332483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.332501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:07.332523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025142:2438], now have 1 active actors on pipe
2025-10-10T14:38:07.332526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025304:11548], now have 1 active actors on pipe
2025-10-10T14:38:07.332535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602377658791063:11625]
2025-10-10T14:38:07.332537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602377658791063:11625]
2025-10-10T14:38:07.332539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602377658791063:11625]
2025-10-10T14:38:07.332553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:07.332568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:07.332575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:07.332578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:07.332581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:07.332585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:07.332588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:07.332623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602377658791063:11625]
2025-10-10T14:38:07.332634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:07.332641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:07.332853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.332859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.332892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:07.332903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.332907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.332909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:07.332922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.332936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:07.332951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.333292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.333296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.333312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.337395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0] Write session: try to update token
2025-10-10T14:38:07.337415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:07.356212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:07.356237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:07.356240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:07.356242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:07.356253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602377658791063:11625]
2025-10-10T14:38:07.356259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602377658791063:11625]
2025-10-10T14:38:07.356263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602377658791063:11625]
2025-10-10T14:38:07.356317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:07.356316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:07.356332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.356333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:07.356335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:07.356337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:07.356484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:07.366277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2557 sessionId: src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:07.368824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:07.393499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602378441025316:11209]
2025-10-10T14:38:07.393843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2556, pipe: [1:7559602378441025316:11209]
2025-10-10T14:38:07.473324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:07.473702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.473717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.473742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025316:11209], now have 1 active actors on pipe
2025-10-10T14:38:07.473947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:07.474037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:07.474046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602378441025316:11209]
2025-10-10T14:38:07.474075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:07.474169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2557 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0
2025-10-10T14:38:07.474410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2557 sessionId: src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0 is DEAD
2025-10-10T14:38:07.474630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:07.474643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0] Write session will restart in 0.006585s
2025-10-10T14:38:07.474668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0] Write session: Do CDS request
2025-10-10T14:38:07.474675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:07.482984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.483032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:07.483066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2558
2025-10-10T14:38:07.483246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.483291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:07.483297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:07.483301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:07.483823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2558 sessionId:  describe result for acl check
2025-10-10T14:38:07.483858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:07.483860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:07.483862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:07.483869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602378441025426:11553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:07.484478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602378441025426:11553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:07.486703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602378441025426:11553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:07.486898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:07.488872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:07.489114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:07.489127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:07.489139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:07.489209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:07.489252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602377658791216:11628]
2025-10-10T14:38:07.489917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:07.490362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:07.490448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:07.490571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602378441025426:11553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:07.490589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602378441025426:11553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:07.490593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602378441025426:11553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:07.490603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:07.490823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:07.490935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.490942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.490943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.490945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.490945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.490946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.490947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.490949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.490950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.490951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.490952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.490953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.490954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.490960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.490974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.490977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.490981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.490984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.490989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.490992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.490996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.491000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.491005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.491009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.491013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.491018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.491027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.491036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.491043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.491048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.491052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.491058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.491061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.491066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.491071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.491076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.491087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.491092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.491098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.491108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.491114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.491124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.491130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.491139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.491143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.491147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.491152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.491161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.491165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.491170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.491176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.491188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.491229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:07.493678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:07.494208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:07.494222Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:07.494224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:07.494228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:07.494235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2557 [2:7559602377658791216:11628]
2025-10-10T14:38:07.494250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:07.494268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:07.494272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.494275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.494278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.494296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:07.494309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:07.494322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:07.494404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.494412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.494415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.494417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:07.494500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:07.494508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.494521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.494531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.494548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:07.494577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025497:11553], now have 1 active actors on pipe
2025-10-10T14:38:07.494592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602377658791211:11628]
2025-10-10T14:38:07.494594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602377658791211:11628]
2025-10-10T14:38:07.494597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602377658791211:11628]
2025-10-10T14:38:07.494606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:07.494625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:07.494628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:07.494635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:07.494638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:07.494644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:07.494648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:07.494654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025330:2438], now have 1 active actors on pipe
2025-10-10T14:38:07.494691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.494696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.494711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602377658791211:11628]
2025-10-10T14:38:07.494619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2557
2025-10-10T14:38:07.494678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2557
2025-10-10T14:38:07.494715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:07.494726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:07.494751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:07.494760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.494766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.494769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:07.494781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.494798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:07.494830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.495028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.495038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.495057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.495145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2558 partition: 0 MaxSeqNo: 40 sessionId: src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0
2025-10-10T14:38:07.495613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f129033c-ee5302d5-f323f4d8-8e9fde5f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:07.498321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0] Write session: try to update token
2025-10-10T14:38:07.498341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:07.515332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:07.515354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:07.515358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:07.515360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:07.515371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602377658791211:11628]
2025-10-10T14:38:07.515376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602377658791211:11628]
2025-10-10T14:38:07.515381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602377658791211:11628]
2025-10-10T14:38:07.515437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:07.515445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.515449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:07.515477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:07.515493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:07.515497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:07.517953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2558 sessionId: src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:07.520900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:07.515595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:07.574259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602378441025507:11209]
2025-10-10T14:38:07.574668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2557, pipe: [1:7559602378441025507:11209]
2025-10-10T14:38:07.644926Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:07.645446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.645465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.645517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025507:11209], now have 1 active actors on pipe
2025-10-10T14:38:07.646263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:07.646277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0] Write session will restart in 0.008718s
2025-10-10T14:38:07.646305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0] Write session: Do CDS request
2025-10-10T14:38:07.646311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:07.645841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:07.645843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:07.645858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:07.645917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2558 reason: error at write: Disconnected sessionId: src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0
2025-10-10T14:38:07.646089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2558 sessionId: src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0 is DEAD
2025-10-10T14:38:07.646113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:07.646155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602378441025507:11209]
2025-10-10T14:38:07.655932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.656062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:07.656080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2559
2025-10-10T14:38:07.656234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.656286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:07.656292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:07.656300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:07.656799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2559 sessionId:  describe result for acl check
2025-10-10T14:38:07.656840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:07.656850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:07.656854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:07.656860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602378441025522:11557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:07.657496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602378441025522:11557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:07.660228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602378441025522:11557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:07.663396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602378441025522:11557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:07.663419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602378441025522:11557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:07.663423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602378441025522:11557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:07.663432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:07.664755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:07.666301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:07.666565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:07.666577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:07.666589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:07.666647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:07.666692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602377658791365:11630]
2025-10-10T14:38:07.667126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:07.667420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:07.667460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:07.667785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:07.667853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.667864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.667866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.667867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.667868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.667870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.667871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.667872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.667874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.667875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.667876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.667877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.667879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.667885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.667898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.667902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.667907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.667911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.667915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.667919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.667923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.667927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.667932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.667936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.667940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.667944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.667952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.667962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.667968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.667974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.667978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.667983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.667989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.667994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.668001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.668007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.668010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.668015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.668019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.668024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.668029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.668035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.668045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.668050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.668054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.668058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.668062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.668067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.668076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.668081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.668087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.668098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.668142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:07.670577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:07.670906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:07.670924Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:07.670927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:07.670931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:07.670938Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2558 [2:7559602377658791365:11630]
2025-10-10T14:38:07.670952Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:07.670970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:07.670973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.670977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.670980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.670996Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:07.671005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:07.671013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:07.671069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.671072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.671074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.671077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:07.671152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:07.671156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.671168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.671179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.671196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:07.671219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602377658791360:11630]
2025-10-10T14:38:07.671221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602377658791360:11630]
2025-10-10T14:38:07.671223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602377658791360:11630]
2025-10-10T14:38:07.671239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:07.671256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:07.671272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:07.671276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:07.671294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:07.671297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:07.671299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:07.671300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602377658791360:11630]
2025-10-10T14:38:07.671302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:07.671307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:07.671433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025672:11557], now have 1 active actors on pipe
2025-10-10T14:38:07.671438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025508:2438], now have 1 active actors on pipe
2025-10-10T14:38:07.671643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2558
2025-10-10T14:38:07.671656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2558
2025-10-10T14:38:07.671968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.671990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.672030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:07.672044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.672057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.672060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:07.672073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.672086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:07.672103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.672276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.672285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.672302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.672414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2559 partition: 0 MaxSeqNo: 40 sessionId: src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0
2025-10-10T14:38:07.672842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|768ed16a-4db75cfc-73bd928d-df8ae124_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:07.675668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0] Write session: try to update token
2025-10-10T14:38:07.675686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:07.691581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2559 sessionId: src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:07.693440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:07.693461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:07.693464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:07.693467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:07.693477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602377658791360:11630]
2025-10-10T14:38:07.693482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602377658791360:11630]
2025-10-10T14:38:07.693487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602377658791360:11630]
2025-10-10T14:38:07.693541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:07.693550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.693552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:07.693626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:07.693637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:07.693643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:07.693708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:07.694302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:07.753439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602378441025687:11209]
2025-10-10T14:38:07.754623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2558, pipe: [1:7559602378441025687:11209]
2025-10-10T14:38:07.813695Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:07.814120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.814135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.814183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025687:11209], now have 1 active actors on pipe
2025-10-10T14:38:07.814430Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:07.814860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602378441025687:11209]
2025-10-10T14:38:07.814895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:07.814931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:07.815001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2559 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0
2025-10-10T14:38:07.815193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2559 sessionId: src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0 is DEAD
2025-10-10T14:38:07.815402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:07.815415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0] Write session will restart in 0.006281s
2025-10-10T14:38:07.815443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0] Write session: Do CDS request
2025-10-10T14:38:07.815449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:07.822932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.823067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:07.823085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2560
2025-10-10T14:38:07.823207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.823246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:07.823256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:07.823260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:07.823760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2560 sessionId:  describe result for acl check
2025-10-10T14:38:07.823808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:07.823815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:07.823817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:07.823824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602378441025726:11562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:07.824453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602378441025726:11562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:07.828273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602378441025726:11562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:07.830851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:07.831010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602378441025726:11562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:07.831026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602378441025726:11562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:07.831030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602378441025726:11562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:07.831039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:07.831327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:07.831520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:07.831532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:07.831544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:07.831594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:07.831638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602377658791514:11632]
2025-10-10T14:38:07.832234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:07.832699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:07.832742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:07.833051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:07.833112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.833119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.833120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.833121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.833123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.833124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.833125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.833126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.833127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.833128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.833129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.833131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.833132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.833137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.833150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.833154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.833158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.833162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.833166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.833170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.833174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.833178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.833183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.833187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.833190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.833194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.833202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.833212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.833218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.833223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.833233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.833238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.833242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.833247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.833252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.833256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.833260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.833265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.833269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.833274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.833278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.833283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.833288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.833293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.833298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.833303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.833313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.833319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.833328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.833356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.833361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.833370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.833405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:07.835864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:07.836199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:07.836211Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:07.836213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:07.836217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:07.836223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2559 [2:7559602377658791514:11632]
2025-10-10T14:38:07.836237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:07.836260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:07.836268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.836272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.836275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.836292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:07.836304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:07.836317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:07.836381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.836388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.836390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.836392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:07.836459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:07.836467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.836479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.836495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.836528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:07.836562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2559
2025-10-10T14:38:07.836558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025693:2438], now have 1 active actors on pipe
2025-10-10T14:38:07.836562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2559
2025-10-10T14:38:07.836562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025860:11562], now have 1 active actors on pipe
2025-10-10T14:38:07.836570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602377658791507:11632]
2025-10-10T14:38:07.836572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602377658791507:11632]
2025-10-10T14:38:07.836575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602377658791507:11632]
2025-10-10T14:38:07.836584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:07.836599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:07.836614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:07.836615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:07.836617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:07.836618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:07.836619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:07.836679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.836689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.836703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602377658791507:11632]
2025-10-10T14:38:07.836718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:07.836750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:07.836752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:07.836760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.836764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.836767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:07.836778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.836789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:07.836814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.836953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.836960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.836975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.837083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2560 partition: 0 MaxSeqNo: 40 sessionId: src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0
2025-10-10T14:38:07.837525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6a1fab3-9e587a3a-f516474f-b742549a_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:07.840474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0] Write session: try to update token
2025-10-10T14:38:07.840500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:07.855916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:07.855936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:07.855939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:07.855941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:07.855964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602377658791507:11632]
2025-10-10T14:38:07.855970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602377658791507:11632]
2025-10-10T14:38:07.855975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602377658791507:11632]
2025-10-10T14:38:07.856023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:07.856028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:07.856030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.856033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:07.856048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:07.856051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:07.856163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:07.858343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2560 sessionId: src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:07.860988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:07.915178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602378441025876:11209]
2025-10-10T14:38:07.915630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2559, pipe: [1:7559602378441025876:11209]
2025-10-10T14:38:07.970473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:07.970989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.971006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.971052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025876:11209], now have 1 active actors on pipe
2025-10-10T14:38:07.971283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:07.971638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:07.971709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:07.971814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2560 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0
2025-10-10T14:38:07.972185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:07.972195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0] Write session will restart in 0.005769s
2025-10-10T14:38:07.972220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0] Write session: Do CDS request
2025-10-10T14:38:07.972226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:07.971973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602378441025876:11209]
2025-10-10T14:38:07.972029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2560 sessionId: src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0 is DEAD
2025-10-10T14:38:07.978938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.979040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:07.979058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2561
2025-10-10T14:38:07.979204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:07.979239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:07.979249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:07.979253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:07.979729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2561 sessionId:  describe result for acl check
2025-10-10T14:38:07.979778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:07.979787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:07.979789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:07.979795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602378441025913:11566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:07.980400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602378441025913:11566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:07.983214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602378441025913:11566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:07.985503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602378441025913:11566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:07.985517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602378441025913:11566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:07.985521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602378441025913:11566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:07.985532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:07.986238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:07.987759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:07.987988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:07.988001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:07.988014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:07.988072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:07.988111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602377658791665:11634]
2025-10-10T14:38:07.988727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:07.989186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:07.989236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:07.989623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:07.989688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.989689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.989690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.989692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.989693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.989695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.989696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.989697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.989699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.989700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.989701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.989702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.989704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.989710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.989723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.989728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.989732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.989735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.989740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.989744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.989748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.989752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.989756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.989760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.989763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.989767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.989775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.989784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:07.989791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.989797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:07.989802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.989807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:07.989811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.989816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:07.989823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.989827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:07.989831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.989836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:07.989841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.989861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:07.989866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.989870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:07.989875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.989881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:07.989885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.989890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:07.989895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.989900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.989905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.989910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.989915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.989919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.989961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:07.993073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:07.993632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:07.993650Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:07.993739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:07.993750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:07.993756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2560 [2:7559602377658791665:11634]
2025-10-10T14:38:07.993770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:07.993788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:07.993797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.993801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.993803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.993820Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:07.993828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:07.993841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:07.993901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.993903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.993906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.993908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:07.993976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:07.993980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:07.993993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:07.994006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:07.994025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:07.994058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602377658791660:11634]
2025-10-10T14:38:07.994061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602377658791660:11634]
2025-10-10T14:38:07.994063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602377658791660:11634]
2025-10-10T14:38:07.994076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:07.994093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:07.994108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:07.994112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:07.994139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602377658791660:11634]
2025-10-10T14:38:07.994142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:07.994221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:07.994222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:07.994225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:07.994232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:07.994626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441025880:2438], now have 1 active actors on pipe
2025-10-10T14:38:07.994636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602378441026047:11566], now have 1 active actors on pipe
2025-10-10T14:38:07.995292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2560
2025-10-10T14:38:07.995308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2560
2025-10-10T14:38:07.995483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.995497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.995532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3d93c7e-7d239cb4-be329b76-5967257_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:07.995542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:07.995547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:07.995550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:07.995564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:07.995579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:07.995597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.995908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:07.995915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:07.995931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:07.996090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2561 partition: 0 MaxSeqNo: 40 sessionId: src_id|c3d93c7e-7d239cb4-be329b76-5967257_0
2025-10-10T14:38:07.996490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2028642d-ebd68096-f8437c2e-6bf4b4f8_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c3d93c7e-7d239cb4-be329b76-5967257_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:07.999144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3d93c7e-7d239cb4-be329b76-5967257_0] Write session: try to update token
2025-10-10T14:38:07.999162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3d93c7e-7d239cb4-be329b76-5967257_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:08.016741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:08.016763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:08.016766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:08.016768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:08.016778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602377658791660:11634]
2025-10-10T14:38:08.016784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602377658791660:11634]
2025-10-10T14:38:08.016787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602377658791660:11634]
2025-10-10T14:38:08.016841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:08.016842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:08.016849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:08.016850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.016852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:08.016857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:08.017002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:08.022922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId: src_id|c3d93c7e-7d239cb4-be329b76-5967257_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:08.025708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:08.071890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602382735993361:11209]
2025-10-10T14:38:08.072226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2560, pipe: [1:7559602382735993361:11209]
2025-10-10T14:38:08.138766Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:08.139166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.139177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.139225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993361:11209], now have 1 active actors on pipe
2025-10-10T14:38:08.139635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602382735993361:11209]
2025-10-10T14:38:08.139668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:08.139680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:08.139685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:08.139752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2561 reason: error at write: Disconnected sessionId: src_id|c3d93c7e-7d239cb4-be329b76-5967257_0
2025-10-10T14:38:08.139490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:08.139978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2561 sessionId: src_id|c3d93c7e-7d239cb4-be329b76-5967257_0 is DEAD
2025-10-10T14:38:08.140361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3d93c7e-7d239cb4-be329b76-5967257_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:08.140372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3d93c7e-7d239cb4-be329b76-5967257_0] Write session will restart in 0.008462s
2025-10-10T14:38:08.140392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3d93c7e-7d239cb4-be329b76-5967257_0] Write session: Do CDS request
2025-10-10T14:38:08.140397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3d93c7e-7d239cb4-be329b76-5967257_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:08.152265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3d93c7e-7d239cb4-be329b76-5967257_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.152645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:08.152663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2562
2025-10-10T14:38:08.152893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.152931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:08.152938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:08.152942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:08.153529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2562 sessionId:  describe result for acl check
2025-10-10T14:38:08.153566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:08.153569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:08.153571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:08.153578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602382735993436:11570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:08.154179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602382735993436:11570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:08.156703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602382735993436:11570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:08.162820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602382735993436:11570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:08.162838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602382735993436:11570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:08.162842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602382735993436:11570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:08.162852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:08.170405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:08.175475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:08.175774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:08.175786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:08.175800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:08.175865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:08.175921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602381953759114:11637]
2025-10-10T14:38:08.176607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:08.177113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:08.177180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:08.177608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:08.177702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.177709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.177710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.177712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.177714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.177716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.177717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.177719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.177721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.177723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.177724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.177726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.177728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.177735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.177750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.177755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.177760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.177765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.177770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.177775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.177780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.177796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.177807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.177811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.177816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.177820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.177832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.177847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.177859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.177866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.177876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.177883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.177892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.177898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.177909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.177916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.177926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.177933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.177943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.177949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.177954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.177961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.177967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.177978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.177983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.177994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.178002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.178013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.178018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.178029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.178035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.178041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.178088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:08.183819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:08.184400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:08.184414Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:08.184417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:08.184421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:08.184428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2561 [2:7559602381953759114:11637]
2025-10-10T14:38:08.184444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:08.184465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:08.184469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.184473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.184475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.184496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:08.184504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:08.184513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:08.184580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.184589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.184592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.184595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:08.184664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:08.184673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.184686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.184705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.184724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:08.184752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602381953759109:11637]
2025-10-10T14:38:08.184760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602381953759109:11637]
2025-10-10T14:38:08.184763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602381953759109:11637]
2025-10-10T14:38:08.184779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:08.184800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:08.184818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:08.184822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:08.184823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:08.184825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:08.184827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:08.184864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602381953759109:11637]
2025-10-10T14:38:08.185161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2561
2025-10-10T14:38:08.184867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:08.184923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:08.185195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2561
2025-10-10T14:38:08.185056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993507:11570], now have 1 active actors on pipe
2025-10-10T14:38:08.185060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993363:2438], now have 1 active actors on pipe
2025-10-10T14:38:08.185376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.185390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.185428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:08.185442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.185446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.185449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:08.185473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.185487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:08.185507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.185831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.185840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.185861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.186065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2562 partition: 0 MaxSeqNo: 40 sessionId: src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0
2025-10-10T14:38:08.186543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3d93c7e-7d239cb4-be329b76-5967257_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:08.189426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0] Write session: try to update token
2025-10-10T14:38:08.189447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:08.207545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:08.207580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:08.207586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:08.207589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:08.207605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602381953759109:11637]
2025-10-10T14:38:08.207612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602381953759109:11637]
2025-10-10T14:38:08.207625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602381953759109:11637]
2025-10-10T14:38:08.207692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:08.207692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:08.207700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:08.207705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:08.207713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.207717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:08.207980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:08.212053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId: src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:08.215374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:08.239829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602382735993544:11209]
2025-10-10T14:38:08.240200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2561, pipe: [1:7559602382735993544:11209]
2025-10-10T14:38:08.326398Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:08.326740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.326751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.326793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993544:11209], now have 1 active actors on pipe
2025-10-10T14:38:08.327023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:08.327764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602382735993544:11209]
2025-10-10T14:38:08.327795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:08.327827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:08.327896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2562 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0
2025-10-10T14:38:08.328103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2562 sessionId: src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0 is DEAD
2025-10-10T14:38:08.333452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:08.333469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0] Write session will restart in 0.005629s
2025-10-10T14:38:08.333497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0] Write session: Do CDS request
2025-10-10T14:38:08.333504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:08.341887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.342118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:08.342149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2563
2025-10-10T14:38:08.342308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.342357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:08.342367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:08.342372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:08.342935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2563 sessionId:  describe result for acl check
2025-10-10T14:38:08.342989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:08.342996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:08.342998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:08.343005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602382735993663:11583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:08.343793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602382735993663:11583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:08.345938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602382735993663:11583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:08.348038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:08.349321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:08.349444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602382735993663:11583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:08.349459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602382735993663:11583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:08.349462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602382735993663:11583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:08.349471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:08.349546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:08.349560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:08.349573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:08.349633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:08.349676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602381953759315:11653]
2025-10-10T14:38:08.350354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:08.351104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:08.351157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:08.351511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:08.351591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.351598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.351599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.351600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.351601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.351603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.351604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.351605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.351606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.351607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.351609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.351610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.351611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.351617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.351630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.351634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.351638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.351642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.351646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.351649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.351653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.351656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.351660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.351665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.351668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.351672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.351680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.351690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.351696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.351702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.351706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.351711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.351716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.351721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.351726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.351730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.351735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.351740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.351745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.351757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.351764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.351774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.351779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.351785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.351793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.351798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.351802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.351812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.351816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.351821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.351826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.351835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.351874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:08.354311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:08.354847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:08.354866Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:08.354869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:08.354875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:08.354897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2562 [2:7559602381953759315:11653]
2025-10-10T14:38:08.354910Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:08.354926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:08.354934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.354938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.354940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.354958Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:08.354970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:08.354978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:08.355041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.355049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.355051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.355053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:08.355124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:08.355134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.355147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.355165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.355179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:08.355200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993740:11583], now have 1 active actors on pipe
2025-10-10T14:38:08.355204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993567:2438], now have 1 active actors on pipe
2025-10-10T14:38:08.355211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602381953759310:11653]
2025-10-10T14:38:08.355213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602381953759310:11653]
2025-10-10T14:38:08.355214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602381953759310:11653]
2025-10-10T14:38:08.355231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:08.355242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:08.355246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:08.355248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:08.355251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:08.355267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:08.355275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:08.355254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2562
2025-10-10T14:38:08.355296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2562
2025-10-10T14:38:08.355299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602381953759310:11653]
2025-10-10T14:38:08.355310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:08.355313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:08.355329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.355334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.355390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:08.355399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.355405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.355408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:08.355419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.355430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:08.355452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.355761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.355772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.355794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.355986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2563 partition: 0 MaxSeqNo: 40 sessionId: src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0
2025-10-10T14:38:08.357449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef624e8f-8dfe77a4-1f61585b-baeb8e4c_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:08.360143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0] Write session: try to update token
2025-10-10T14:38:08.360161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:08.376909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:08.376935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:08.376940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:08.376942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:08.376952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602381953759310:11653]
2025-10-10T14:38:08.376958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602381953759310:11653]
2025-10-10T14:38:08.376963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602381953759310:11653]
2025-10-10T14:38:08.377011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:08.377019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:08.377026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:08.377030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:08.377031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.377034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:08.377187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:08.386514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId: src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:08.389200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:08.426705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602382735993763:11209]
2025-10-10T14:38:08.427072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2562, pipe: [1:7559602382735993763:11209]
2025-10-10T14:38:08.502808Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:08.503187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.503211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.503240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993763:11209], now have 1 active actors on pipe
2025-10-10T14:38:08.503507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:08.503978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:08.503992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0] Write session will restart in 0.009298s
2025-10-10T14:38:08.503487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:08.503489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:08.504019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0] Write session: Do CDS request
2025-10-10T14:38:08.503504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:08.503550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602382735993763:11209]
2025-10-10T14:38:08.504026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:08.503570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2563 reason: error at write: Disconnected sessionId: src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0
2025-10-10T14:38:08.503790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2563 sessionId: src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0 is DEAD
2025-10-10T14:38:08.517750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.517832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:08.517849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2564
2025-10-10T14:38:08.518002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.518046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:08.518058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:08.518063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:08.518321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:08.518498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2564 sessionId:  describe result for acl check
2025-10-10T14:38:08.518534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:08.518536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:08.518537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:08.518543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602382735993907:11588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:08.519110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602382735993907:11588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:08.520443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:08.520730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:08.520745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:08.520759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:08.520838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:08.520881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602381953759468:11655]
2025-10-10T14:38:08.521529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:08.521582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602382735993907:11588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:08.521852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:08.521916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:08.522277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:08.522347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.522357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.522358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.522359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.522360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.522361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.522363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.522364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.522365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.522367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.522368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.522369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.522370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.522376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.522391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.522395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.522399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.522403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.522423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.522426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.522429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.522433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.522438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.522442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.522446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.522450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.522459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.522467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.522474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.522480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.522484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.522491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.522496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.522501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.522507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.522513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.522518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.522524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.522529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.522535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.522540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.522546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.522551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.522557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.522563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.522568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.522573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.522579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.522583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.522588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.522593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.522599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.522643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:08.525573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:08.526108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:08.526123Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:08.526126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:08.526131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:08.526137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2563 [2:7559602381953759468:11655]
2025-10-10T14:38:08.526150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:08.526169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:08.526178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.526182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.526185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.526204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:08.526216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:08.526227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:08.526292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.526302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.526304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.526307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:08.526373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:08.526381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.526393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.526422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.526393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602382735993907:11588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:08.526428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602382735993907:11588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:08.526432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602382735993907:11588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:08.526440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:08.526445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:08.526474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993766:2438], now have 1 active actors on pipe
2025-10-10T14:38:08.526486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602381953759463:11655]
2025-10-10T14:38:08.526489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602381953759463:11655]
2025-10-10T14:38:08.526492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602381953759463:11655]
2025-10-10T14:38:08.526506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:08.526521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:08.526539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:08.526540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:08.526543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:08.526545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:08.526548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:08.526574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602381953759463:11655]
2025-10-10T14:38:08.526586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:08.526611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:08.526780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993941:11588], now have 1 active actors on pipe
2025-10-10T14:38:08.526587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2563
2025-10-10T14:38:08.526863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2563
2025-10-10T14:38:08.527331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.527348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.527381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|283ab3cd-9ee84011-a743addd-2152913_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:08.527396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.527400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.527402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:08.527417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.527429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:08.527449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.528574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.528590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.528625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.528751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2564 partition: 0 MaxSeqNo: 40 sessionId: src_id|283ab3cd-9ee84011-a743addd-2152913_0
2025-10-10T14:38:08.529247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e95c77e6-9f6f984c-d824a158-e2b496f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|283ab3cd-9ee84011-a743addd-2152913_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:08.532212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283ab3cd-9ee84011-a743addd-2152913_0] Write session: try to update token
2025-10-10T14:38:08.532231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283ab3cd-9ee84011-a743addd-2152913_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:08.548405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:08.548435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:08.548439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:08.548442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:08.548454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602381953759463:11655]
2025-10-10T14:38:08.548459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602381953759463:11655]
2025-10-10T14:38:08.548464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602381953759463:11655]
2025-10-10T14:38:08.548511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:08.548521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:08.548528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:08.548532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:08.548540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.548542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:08.548711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:08.549078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId: src_id|283ab3cd-9ee84011-a743addd-2152913_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:08.551894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:08.603827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602382735993948:11209]
2025-10-10T14:38:08.604683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2563, pipe: [1:7559602382735993948:11209]
2025-10-10T14:38:08.664826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:08.665221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.665237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.665286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993948:11209], now have 1 active actors on pipe
2025-10-10T14:38:08.665561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:08.665600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602382735993948:11209]
2025-10-10T14:38:08.665632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:08.665642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:08.665713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2564 reason: error at write: Disconnected sessionId: src_id|283ab3cd-9ee84011-a743addd-2152913_0
2025-10-10T14:38:08.665791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:08.665959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2564 sessionId: src_id|283ab3cd-9ee84011-a743addd-2152913_0 is DEAD
2025-10-10T14:38:08.666138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283ab3cd-9ee84011-a743addd-2152913_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:08.666149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283ab3cd-9ee84011-a743addd-2152913_0] Write session will restart in 0.006507s
2025-10-10T14:38:08.666186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283ab3cd-9ee84011-a743addd-2152913_0] Write session: Do CDS request
2025-10-10T14:38:08.666193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283ab3cd-9ee84011-a743addd-2152913_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:08.673907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283ab3cd-9ee84011-a743addd-2152913_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.674011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:08.674030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2565
2025-10-10T14:38:08.674158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.674200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:08.674212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:08.674216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:08.674803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2565 sessionId:  describe result for acl check
2025-10-10T14:38:08.674852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:08.674854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:08.674856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:08.674862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602382735993987:11592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:08.675470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602382735993987:11592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:08.677989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602382735993987:11592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:08.680705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602382735993987:11592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:08.680577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:08.680720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602382735993987:11592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:08.680724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602382735993987:11592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:08.680733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:08.682351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:08.682770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:08.682785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:08.682800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:08.682870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:08.682919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602381953759623:11657]
2025-10-10T14:38:08.683564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:08.683917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:08.683965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:08.684280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:08.684332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.684337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.684338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.684338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.684339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.684340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.684341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.684342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.684343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.684344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.684346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.684347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.684348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.684354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.684369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.684374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.684378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.684382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.684387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.684391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.684394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.684396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.684399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.684401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.684403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.684405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.684414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.684437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.684441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.684445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.684449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.684455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.684460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.684466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.684474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.684480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.684485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.684490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.684495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.684501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.684506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.684512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.684515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.684518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.684521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.684524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.684527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.684530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.684533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.684536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.684538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.684542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.684565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:08.687260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:08.687841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:08.687856Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:08.688354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2564
2025-10-10T14:38:08.687862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:08.688384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2564
2025-10-10T14:38:08.687865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:08.687874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2564 [2:7559602381953759623:11657]
2025-10-10T14:38:08.687887Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:08.687906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:08.687909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.687913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.687916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.687935Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:08.687943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:08.687951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:08.688014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.688016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.688018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.688021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:08.688094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:08.688096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.688109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.688121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.688138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:08.688159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602381953759617:11657]
2025-10-10T14:38:08.688162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602381953759617:11657]
2025-10-10T14:38:08.688164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602381953759617:11657]
2025-10-10T14:38:08.688179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:08.688197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:08.688204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:08.688209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:08.688211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:08.688214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:08.688218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:08.688243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602381953759617:11657]
2025-10-10T14:38:08.688246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:08.688256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:08.688274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735993950:2438], now have 1 active actors on pipe
2025-10-10T14:38:08.688277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735994122:11592], now have 1 active actors on pipe
2025-10-10T14:38:08.688504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.688512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.688555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:08.688570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.688580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.688582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:08.688594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.688613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:08.688628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.688807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.688816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.688831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.688920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2565 partition: 0 MaxSeqNo: 40 sessionId: src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0
2025-10-10T14:38:08.689327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283ab3cd-9ee84011-a743addd-2152913_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:08.692430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0] Write session: try to update token
2025-10-10T14:38:08.692452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:08.707475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId: src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:08.708133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:08.708158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:08.708162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:08.708164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:08.708173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602381953759617:11657]
2025-10-10T14:38:08.708178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602381953759617:11657]
2025-10-10T14:38:08.708183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602381953759617:11657]
2025-10-10T14:38:08.708235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:08.708237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:08.708245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:08.708247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.708250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:08.708264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:08.708410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:08.710266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:08.765660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602382735994135:11209]
2025-10-10T14:38:08.766113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2564, pipe: [1:7559602382735994135:11209]
2025-10-10T14:38:08.825487Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:08.825968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.825985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.826029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735994135:11209], now have 1 active actors on pipe
2025-10-10T14:38:08.826266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:08.826692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:08.826701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0] Write session will restart in 0.009080s
2025-10-10T14:38:08.826723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0] Write session: Do CDS request
2025-10-10T14:38:08.826728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:08.826278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:08.826293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:08.826303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:08.826362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602382735994135:11209]
2025-10-10T14:38:08.826372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2565 reason: error at write: Disconnected sessionId: src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0
2025-10-10T14:38:08.826574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2565 sessionId: src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0 is DEAD
2025-10-10T14:38:08.837311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.837427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:08.837444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2566
2025-10-10T14:38:08.837636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.837675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:08.837686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:08.837690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:08.838232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2566 sessionId:  describe result for acl check
2025-10-10T14:38:08.838288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:08.838294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:08.838296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:08.838307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602382735994286:11597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:08.838913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602382735994286:11597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:08.839430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:08.841029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602382735994286:11597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:08.841086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:08.841304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:08.841316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:08.841342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:08.841404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:08.841448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602381953759777:11659]
2025-10-10T14:38:08.842115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:08.842489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:08.842537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:08.843035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:08.843107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.843116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.843117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.843118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.843120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.843121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.843123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.843124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.843126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.843127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.843129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.843130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.843131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.843139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.843154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.843158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.843163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.843167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.843171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.843176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.843180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.843184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.843189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.843194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.843198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.843202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.843210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.843220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.843227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.843233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.843238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.843256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.843261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.843267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.843272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.843278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.843288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.843294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.843300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.843306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.843315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.843321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.843327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.843340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.843345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.843350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.843364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.843370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.843379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.843385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.843390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.843395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.843443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:08.843695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602382735994286:11597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:08.843710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602382735994286:11597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:08.843727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602382735994286:11597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:08.843736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:08.846007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:08.846489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:08.846501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:08.846504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:08.846508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:08.846515Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2565 [2:7559602381953759777:11659]
2025-10-10T14:38:08.846529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:08.846547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:08.846558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.846563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.846565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.846582Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:08.846590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:08.846597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:08.846660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.846666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.846669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.846671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:08.846742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:08.846750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.846760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.846772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.846793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:08.846819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735994322:11597], now have 1 active actors on pipe
2025-10-10T14:38:08.846828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735994141:2438], now have 1 active actors on pipe
2025-10-10T14:38:08.846836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602381953759772:11659]
2025-10-10T14:38:08.846839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602381953759772:11659]
2025-10-10T14:38:08.846841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602381953759772:11659]
2025-10-10T14:38:08.846854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:08.846873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:08.846874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:08.846876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:08.846878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:08.846892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:08.846899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:08.846907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2565
2025-10-10T14:38:08.846926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602381953759772:11659]
2025-10-10T14:38:08.846935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:08.846912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2565
2025-10-10T14:38:08.846936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:08.846966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.846976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.847017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f174c33d-271e0939-f2b1099d-35575eac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:08.847030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:08.847036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:08.847038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:08.847050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:08.847065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:08.847090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.847217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.847224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.847239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:08.847312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2566 partition: 0 MaxSeqNo: 40 sessionId: src_id|f174c33d-271e0939-f2b1099d-35575eac_0
2025-10-10T14:38:08.847668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb0ac1-98d5fb65-6e62ab7-8aef8115_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f174c33d-271e0939-f2b1099d-35575eac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:08.850488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f174c33d-271e0939-f2b1099d-35575eac_0] Write session: try to update token
2025-10-10T14:38:08.850506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f174c33d-271e0939-f2b1099d-35575eac_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:08.866357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:08.866380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:08.866383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:08.866384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:08.866395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602381953759772:11659]
2025-10-10T14:38:08.866415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602381953759772:11659]
2025-10-10T14:38:08.866420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602381953759772:11659]
2025-10-10T14:38:08.866461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:08.866468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.866467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:08.866470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:08.866475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:08.866479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:08.866593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:08.868584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId: src_id|f174c33d-271e0939-f2b1099d-35575eac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:08.871149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:08.926443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602382735994329:11209]
2025-10-10T14:38:08.926770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2565, pipe: [1:7559602382735994329:11209]
2025-10-10T14:38:08.982102Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:08.982417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:08.982434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:08.982476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735994329:11209], now have 1 active actors on pipe
2025-10-10T14:38:08.982720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:08.982732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:08.982750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:08.982809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2566 reason: error at write: Disconnected sessionId: src_id|f174c33d-271e0939-f2b1099d-35575eac_0
2025-10-10T14:38:08.983151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f174c33d-271e0939-f2b1099d-35575eac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:08.983163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f174c33d-271e0939-f2b1099d-35575eac_0] Write session will restart in 0.007785s
2025-10-10T14:38:08.983188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f174c33d-271e0939-f2b1099d-35575eac_0] Write session: Do CDS request
2025-10-10T14:38:08.983210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f174c33d-271e0939-f2b1099d-35575eac_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:08.982995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2566 sessionId: src_id|f174c33d-271e0939-f2b1099d-35575eac_0 is DEAD
2025-10-10T14:38:08.983177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602382735994329:11209]
2025-10-10T14:38:08.983205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:08.992039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f174c33d-271e0939-f2b1099d-35575eac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.992026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:08.992044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2567
2025-10-10T14:38:08.992275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:08.992336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:08.992348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:08.992352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:08.992939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2567 sessionId:  describe result for acl check
2025-10-10T14:38:08.992988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:08.992990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:08.992991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:08.992998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602382735994447:11601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:08.993579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602382735994447:11601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:08.995329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:08.996223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602382735994447:11601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:08.997043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:08.997365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:08.997380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:08.997397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:08.997472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:08.997520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602381953759933:11661]
2025-10-10T14:38:08.998176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:08.998472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:08.998533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:08.998780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602382735994447:11601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:08.998794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602382735994447:11601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:08.998798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602382735994447:11601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:08.998806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:08.998895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:08.998983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.998991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.998992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.998993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.998995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.998996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.998997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.998998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.999000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.999001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.999003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.999004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.999005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.999012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.999026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.999030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.999035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.999039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.999043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.999047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.999051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.999056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.999060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.999065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.999069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.999073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.999082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.999090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:08.999098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.999103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:08.999108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.999113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:08.999118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.999124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:08.999128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.999134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:08.999138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.999145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:08.999157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.999162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:08.999167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.999172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:08.999177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.999184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:08.999194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.999199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:08.999204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.999214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:08.999218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.999229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:08.999234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.999244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:08.999288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:09.001797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:09.002310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:09.002328Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:09.002330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:09.002334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:09.002341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2566 [2:7559602381953759933:11661]
2025-10-10T14:38:09.002352Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:09.002370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:09.002377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.002381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.002384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.002416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:09.002427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:09.002435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:09.002497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.002504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.002506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.002508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:09.002576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:09.002585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.002597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.002607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.002625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:09.002650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735994507:11601], now have 1 active actors on pipe
2025-10-10T14:38:09.002659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602382735994330:2438], now have 1 active actors on pipe
2025-10-10T14:38:09.002666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602381953759928:11661]
2025-10-10T14:38:09.002668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602381953759928:11661]
2025-10-10T14:38:09.002670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602381953759928:11661]
2025-10-10T14:38:09.002683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:09.002700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:09.002708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:09.002711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:09.002714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:09.002720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:09.002723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:09.002747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602381953759928:11661]
2025-10-10T14:38:09.002757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:09.002753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2566
2025-10-10T14:38:09.002760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:09.002759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2566
2025-10-10T14:38:09.002802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.002811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.002847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:09.002859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.002863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.002865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:09.002875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.002891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:09.003005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.003180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.003193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.003216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.003302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2567 partition: 0 MaxSeqNo: 40 sessionId: src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0
2025-10-10T14:38:09.003724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f174c33d-271e0939-f2b1099d-35575eac_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:09.006462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0] Write session: try to update token
2025-10-10T14:38:09.006482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:09.024326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:09.024352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.024364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602381953759928:11661]
2025-10-10T14:38:09.024424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:09.024424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:09.024639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:09.024805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.024962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.025126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.025367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:09.025412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:09.028291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId: src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:09.031062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:09.031294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.031328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.031372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:09.031465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:09.036656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:09.036676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.036680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:09.036682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:09.036696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602381953759928:11661]
2025-10-10T14:38:09.036700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602381953759928:11661]
2025-10-10T14:38:09.036704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602381953759928:11661]
2025-10-10T14:38:09.036756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:09.036776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.036779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:09.036807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:09.036814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:09.036820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:09.036928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:09.083088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602387030961812:11209]
2025-10-10T14:38:09.083396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2566, pipe: [1:7559602387030961812:11209]
2025-10-10T14:38:09.153891Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:09.162566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.162594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.162781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.162845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.162920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.162998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.163053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.163063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.163141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.163205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.163271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.163345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.163394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.163402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.163480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.163543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.163608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.163689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.163736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.163739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.163809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.163893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.163962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.164030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.164080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.164089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.164159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.164225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.164291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.164363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.164409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.164416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.164485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.164553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.164617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.164686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.164735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.164743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.164810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.164880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.164942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.165010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.165059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.165066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.165135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.165199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.165262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.165326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.165392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.165395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.165467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.165525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.165594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.165668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.165718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.165725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.165800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.165868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.165934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.166001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.166048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.166058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.166130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030961812:11209], now have 1 active actors on pipe
2025-10-10T14:38:09.166381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:09.166413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:09.166451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2567 reason: error at write: Disconnected sessionId: src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0
2025-10-10T14:38:09.166677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2567 sessionId: src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0 is DEAD
2025-10-10T14:38:09.166844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:09.166895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602387030961812:11209]
2025-10-10T14:38:09.167342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:09.169439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:09.169453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0] Write session will restart in 0.007356s
2025-10-10T14:38:09.169481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0] Write session: Do CDS request
2025-10-10T14:38:09.169488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:09.177964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.178019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:09.178038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2568
2025-10-10T14:38:09.178187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.178224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:09.178241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:09.178250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:09.178803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2568 sessionId:  describe result for acl check
2025-10-10T14:38:09.178856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:09.178858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:09.178860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:09.178869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602387030961885:11605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:09.179605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602387030961885:11605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:09.182955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602387030961885:11605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:09.184515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:09.186790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:09.186852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602387030961885:11605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:09.186870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602387030961885:11605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:09.186874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602387030961885:11605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:09.186884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:09.187037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:09.187050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:09.187064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:09.187125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:09.187180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602386248727388:11664]
2025-10-10T14:38:09.187807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:09.188141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:09.188197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:09.188539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:09.188598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.188605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.188606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.188607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.188608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.188609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.188610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.188612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.188613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.188615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.188617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.188618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.188619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.188625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.188638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.188642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.188646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.188649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.188653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.188657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.188661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.188666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.188671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.188674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.188679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.188683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.188692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.188700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.188708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.188713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.188717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.188724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.188728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.188734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.188739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.188744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.188748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.188753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.188764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.188769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.188780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.188785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.188790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.188799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.188803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.188809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.188817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.188822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.188827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.188832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.188836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.188842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.188881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:09.191554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:09.191887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:09.191901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:09.191903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:09.191908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:09.191914Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2567 [2:7559602386248727388:11664]
2025-10-10T14:38:09.191928Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:09.191947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:09.191955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.191958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.191961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.191978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:09.191986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:09.191993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:09.192062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.192068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.192070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.192073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:09.192139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:09.192146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.192159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.192171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.192192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:09.192219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030961815:2438], now have 1 active actors on pipe
2025-10-10T14:38:09.192227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030961990:11605], now have 1 active actors on pipe
2025-10-10T14:38:09.192235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602386248727383:11664]
2025-10-10T14:38:09.192237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602386248727383:11664]
2025-10-10T14:38:09.192239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602386248727383:11664]
2025-10-10T14:38:09.192252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:09.192264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:09.192271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:09.192273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:09.192275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:09.192286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:09.192290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:09.192324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602386248727383:11664]
2025-10-10T14:38:09.192335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:09.192340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:09.192793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2567
2025-10-10T14:38:09.192836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2567
2025-10-10T14:38:09.193491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2568 partition: 0 MaxSeqNo: 40 sessionId: src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0
2025-10-10T14:38:09.193022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.193034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.193068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:09.193076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.193079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.193083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:09.193094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.193106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:09.193120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.193276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.193279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.193293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.197447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b9c0bf4-532f5c13-b83e3819-73f20139_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:09.200189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0] Write session: try to update token
2025-10-10T14:38:09.200212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:09.206636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:09.206664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.206675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602386248727383:11664]
2025-10-10T14:38:09.206737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:09.206749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:09.206961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:09.207124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.207289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.207442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.207700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:09.207739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:09.221816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId: src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:09.224580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:09.224796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:09.224820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.224824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:09.224826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:09.224836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602386248727383:11664]
2025-10-10T14:38:09.224841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602386248727383:11664]
2025-10-10T14:38:09.224843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602386248727383:11664]
2025-10-10T14:38:09.224887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.224878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:09.224896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.224901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:09.224906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:09.224919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:09.224927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.224929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:09.225062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:09.266934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602387030962001:11209]
2025-10-10T14:38:09.267275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2567, pipe: [1:7559602387030962001:11209]
2025-10-10T14:38:09.342996Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:09.343378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962001:11209], now have 1 active actors on pipe
2025-10-10T14:38:09.343633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:09.344009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:09.344060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602387030962001:11209]
2025-10-10T14:38:09.344078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:09.344165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2568 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0
2025-10-10T14:38:09.344384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2568 sessionId: src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0 is DEAD
2025-10-10T14:38:09.344536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:09.344549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0] Write session will restart in 0.006364s
2025-10-10T14:38:09.344574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0] Write session: Do CDS request
2025-10-10T14:38:09.344580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:09.351958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.352038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:09.352067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2569
2025-10-10T14:38:09.352235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.352286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:09.352291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:09.352297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:09.352694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2569 sessionId:  describe result for acl check
2025-10-10T14:38:09.352723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:09.352726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:09.352728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:09.352735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602387030962069:11615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:09.353312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602387030962069:11615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:09.356004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602387030962069:11615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:09.358440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:09.360115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:09.360333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:09.360343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:09.360355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:09.360378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602387030962069:11615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:09.360394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602387030962069:11615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:09.360398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602387030962069:11615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:09.360404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:09.360406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:09.360448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602386248727571:11673]
2025-10-10T14:38:09.361072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:09.361326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:09.361385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:09.361696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:09.361751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.361757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.361758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.361759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.361760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.361761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.361762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.361763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.361764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.361766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.361767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.361768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.361769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.361774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.361785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.361789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.361793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.361797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.361801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.361804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.361808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.361812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.361816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.361820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.361824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.361827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.361834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.361841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.361847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.361853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.361857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.361865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.361869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.361874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.361880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.361885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.361889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.361894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.361898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.361903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.361907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.361912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.361917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.361921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.361925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.361930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.361934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.361939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.361942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.361947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.361951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.361956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.361994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:09.364770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:09.365463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:09.365475Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:09.365478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:09.365482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:09.365488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2568 [2:7559602386248727571:11673]
2025-10-10T14:38:09.365500Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:09.365525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:09.365529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.365533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.365535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.365876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2568
2025-10-10T14:38:09.365922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2568
2025-10-10T14:38:09.365553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:09.365566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:09.365574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:09.365636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.365638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.365640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.365643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:09.365722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:09.365726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.365738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.365750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.365768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:09.365790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962016:2438], now have 1 active actors on pipe
2025-10-10T14:38:09.365794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962192:11615], now have 1 active actors on pipe
2025-10-10T14:38:09.365802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602386248727566:11673]
2025-10-10T14:38:09.365805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602386248727566:11673]
2025-10-10T14:38:09.365807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602386248727566:11673]
2025-10-10T14:38:09.365820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:09.365834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:09.365837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:09.365841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:09.365843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:09.365851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:09.365855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:09.365882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602386248727566:11673]
2025-10-10T14:38:09.365890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:09.365891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:09.366254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.366275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.366305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:09.366318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.366323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.366325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:09.366336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.366348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:09.366363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.366594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.366603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.366617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.366714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2569 partition: 0 MaxSeqNo: 40 sessionId: src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0
2025-10-10T14:38:09.367156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56dd659a-6c2fd151-9e01d18d-f3b955cf_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:09.370045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0] Write session: try to update token
2025-10-10T14:38:09.370065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:09.378198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:09.378224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.378233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602386248727566:11673]
2025-10-10T14:38:09.378269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:09.378282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:09.378515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:09.378664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.378805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.378949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:09.379575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:09.379641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:09.391085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId: src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:09.393775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:09.393996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.394020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.394074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:09.394162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:09.396808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:09.396827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.396831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:09.396833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:09.396846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602386248727566:11673]
2025-10-10T14:38:09.396850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602386248727566:11673]
2025-10-10T14:38:09.396854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602386248727566:11673]
2025-10-10T14:38:09.396902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:09.396901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:09.396908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:09.396913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:09.396915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.396917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:09.397054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:09.444097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602387030962227:11209]
2025-10-10T14:38:09.444571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2568, pipe: [1:7559602387030962227:11209]
2025-10-10T14:38:09.515552Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:09.524759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.524796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.525003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.525082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.525163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.525248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.525688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.525706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.525786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.525849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.525911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.525981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.526025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.526029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.526108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.526170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.526234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.526295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.526340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.526343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.526433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.526495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.526559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.526621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.526664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.526668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.526743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.526805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.526869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.529465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:09.528977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602387030962227:11209]
2025-10-10T14:38:09.529485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0] Write session will restart in 0.008719s
2025-10-10T14:38:09.529030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:09.529033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:09.529066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2569 reason: error at write: Disconnected sessionId: src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0
2025-10-10T14:38:09.529267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2569 sessionId: src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0 is DEAD
2025-10-10T14:38:09.529405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:09.529526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0] Write session: Do CDS request
2025-10-10T14:38:09.529533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:09.526936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.526981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.526984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.527055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.527118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.527182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.527245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.527289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.527292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.527371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.527429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.527497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.527565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.527617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.527620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.527691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.527749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.527808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.527869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.527912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.527915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.527987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.528049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.528111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.528181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.528228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.528231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.528304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:09.528364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:09.528430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:09.528493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:09.528544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:09.528548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:09.528621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962227:11209], now have 1 active actors on pipe
2025-10-10T14:38:09.529993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:09.540029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.540105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:09.540122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2570
2025-10-10T14:38:09.541610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.541663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:09.541672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:09.541676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:09.542249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2570 sessionId:  describe result for acl check
2025-10-10T14:38:09.542295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:09.542303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:09.542307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:09.542314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602387030962328:11623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:09.542941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602387030962328:11623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:09.546370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:09.546487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602387030962328:11623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:09.548111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:09.548352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:09.548370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:09.548384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:09.548454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:09.548504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602386248727755:11682]
2025-10-10T14:38:09.549141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602387030962328:11623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:09.549156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602387030962328:11623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:09.549160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602387030962328:11623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:09.549146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:09.549168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:09.549575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:09.549626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:09.549989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:09.550049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.550056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.550057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.550058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.550060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.550061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.550062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.550063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.550064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.550065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.550067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.550068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.550069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.550076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.550089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.550093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.550098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.550102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.550105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.550109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.550114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.550118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.550122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.550127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.550131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.550135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.550143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.550152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.550159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.550165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.550171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.550176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.550180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.550184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.550188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.550192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.550196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.550201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.550210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.550222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.550225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.550230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.550235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.550239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.550244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.550249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.550253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.550257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.550261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.550265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.550269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.550285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.550326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:09.552869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:09.553508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:09.553521Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:09.553523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:09.553541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:09.553549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2569 [2:7559602386248727755:11682]
2025-10-10T14:38:09.553564Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:09.553591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:09.553595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.553598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.553601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.553631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:09.553647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:09.553655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:09.553722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.553730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.553731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.553734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:09.553806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:09.553815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.553830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.553842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.553861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:09.553888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962230:2438], now have 1 active actors on pipe
2025-10-10T14:38:09.553898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962406:11623], now have 1 active actors on pipe
2025-10-10T14:38:09.553906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602386248727750:11682]
2025-10-10T14:38:09.553909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602386248727750:11682]
2025-10-10T14:38:09.553911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602386248727750:11682]
2025-10-10T14:38:09.553926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:09.553947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:09.553945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:09.553949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:09.553952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:09.553963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:09.553966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:09.553964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2569
2025-10-10T14:38:09.553969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2569
2025-10-10T14:38:09.553998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602386248727750:11682]
2025-10-10T14:38:09.554008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:09.554010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:09.554024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.554029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.554091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51f18703-30890abf-6758efc2-7852a879_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:09.554104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.554113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.554116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:09.554128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.554141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:09.554160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.554328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.554337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.554351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.554468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2570 partition: 0 MaxSeqNo: 40 sessionId: src_id|51f18703-30890abf-6758efc2-7852a879_0
2025-10-10T14:38:09.554910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55bf6b57-e6dfd2d1-82535d83-c1088b6d_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|51f18703-30890abf-6758efc2-7852a879_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:09.557977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f18703-30890abf-6758efc2-7852a879_0] Write session: try to update token
2025-10-10T14:38:09.557996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f18703-30890abf-6758efc2-7852a879_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:09.573448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId: src_id|51f18703-30890abf-6758efc2-7852a879_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:09.576166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:09.574955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:09.574980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.574985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:09.574987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:09.574996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602386248727750:11682]
2025-10-10T14:38:09.575001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602386248727750:11682]
2025-10-10T14:38:09.575005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602386248727750:11682]
2025-10-10T14:38:09.575060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:09.575069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.575071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:09.575217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:09.575359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:09.575365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:09.575370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:09.630876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602387030962417:11209]
2025-10-10T14:38:09.631219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2569, pipe: [1:7559602387030962417:11209]
2025-10-10T14:38:09.693093Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:09.693624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.693644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.693690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962417:11209], now have 1 active actors on pipe
2025-10-10T14:38:09.694176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:09.694105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:09.694178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:09.694181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:09.694257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2570 reason: error at write: Disconnected sessionId: src_id|51f18703-30890abf-6758efc2-7852a879_0
2025-10-10T14:38:09.694464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2570 sessionId: src_id|51f18703-30890abf-6758efc2-7852a879_0 is DEAD
2025-10-10T14:38:09.694620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602387030962417:11209]
2025-10-10T14:38:09.697578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f18703-30890abf-6758efc2-7852a879_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:09.697592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f18703-30890abf-6758efc2-7852a879_0] Write session will restart in 0.006368s
2025-10-10T14:38:09.697619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f18703-30890abf-6758efc2-7852a879_0] Write session: Do CDS request
2025-10-10T14:38:09.697626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f18703-30890abf-6758efc2-7852a879_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:09.704979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f18703-30890abf-6758efc2-7852a879_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.705377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:09.705395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2571
2025-10-10T14:38:09.706161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.706204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:09.706210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:09.706214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:09.706797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2571 sessionId:  describe result for acl check
2025-10-10T14:38:09.706829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:09.706831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:09.706833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:09.706839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602387030962476:11627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:09.707461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602387030962476:11627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:09.712985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602387030962476:11627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:09.712726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:09.714509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:09.714756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:09.714763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:09.714777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:09.714840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:09.714881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602386248727915:11684]
2025-10-10T14:38:09.715480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:09.715635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602387030962476:11627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:09.715652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602387030962476:11627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:09.715657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602387030962476:11627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:09.715667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:09.715968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:09.716028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:09.716402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:09.716469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.716475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.716477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.716478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.716479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.716480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.716482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.716483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.716485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.716488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.716489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.716491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.716493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.716499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.716523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.716527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.716536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.716540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.716543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.716547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.716550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.716554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.716557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.716561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.716565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.716569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.716577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.716587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.716598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.716604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.716613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.716618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.716621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.716632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.716637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.716647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.716651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.716655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.716665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.716670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.716673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.716678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.716688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.716694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.716703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.716708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.716713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.716718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.716723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.716728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.716732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.716739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.716787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:09.719283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:09.719652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:09.719666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:09.719668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:09.719672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:09.719678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2570 [2:7559602386248727915:11684]
2025-10-10T14:38:09.719693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:09.719721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:09.719729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.719733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.719736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.719754Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:09.719761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:09.719769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:09.719836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.719844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.719846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.719849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:09.720111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2570
2025-10-10T14:38:09.720128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:09.720138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.720149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.720127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2570
2025-10-10T14:38:09.720162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.720181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:09.720207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962421:2438], now have 1 active actors on pipe
2025-10-10T14:38:09.720215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962602:11627], now have 1 active actors on pipe
2025-10-10T14:38:09.720236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.720246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.720270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602386248727910:11684]
2025-10-10T14:38:09.720279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602386248727910:11684]
2025-10-10T14:38:09.720282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602386248727910:11684]
2025-10-10T14:38:09.720297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:09.720313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:09.720330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:09.720333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:09.720332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:09.720336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:09.720338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:09.720357Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e37dae6b-45e02876-973388a1-94a29a9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:09.720365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.720370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.720372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:09.720383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.720395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:09.720429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602386248727910:11684]
2025-10-10T14:38:09.720437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:09.720444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:09.720449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.720661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.720676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.720711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.720810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2571 partition: 0 MaxSeqNo: 40 sessionId: src_id|e37dae6b-45e02876-973388a1-94a29a9b_0
2025-10-10T14:38:09.721260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f18703-30890abf-6758efc2-7852a879_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|e37dae6b-45e02876-973388a1-94a29a9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:09.723971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37dae6b-45e02876-973388a1-94a29a9b_0] Write session: try to update token
2025-10-10T14:38:09.723991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37dae6b-45e02876-973388a1-94a29a9b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:09.741743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:09.741767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.741771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:09.741773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:09.741783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602386248727910:11684]
2025-10-10T14:38:09.741788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602386248727910:11684]
2025-10-10T14:38:09.741793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602386248727910:11684]
2025-10-10T14:38:09.741846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:09.741854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.741857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:09.745102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId: src_id|e37dae6b-45e02876-973388a1-94a29a9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:09.742012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:09.745589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:09.745615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:09.745621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:09.748135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:09.795026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602387030962618:11209]
2025-10-10T14:38:09.795844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2570, pipe: [1:7559602387030962618:11209]
2025-10-10T14:38:09.867346Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:09.867771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.867783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.867834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962618:11209], now have 1 active actors on pipe
2025-10-10T14:38:09.868187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:09.868844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37dae6b-45e02876-973388a1-94a29a9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:09.868858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37dae6b-45e02876-973388a1-94a29a9b_0] Write session will restart in 0.007689s
2025-10-10T14:38:09.868884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37dae6b-45e02876-973388a1-94a29a9b_0] Write session: Do CDS request
2025-10-10T14:38:09.868891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37dae6b-45e02876-973388a1-94a29a9b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:09.868296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:09.868369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602387030962618:11209]
2025-10-10T14:38:09.868390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:09.868393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:09.868471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2571 reason: error at write: Disconnected sessionId: src_id|e37dae6b-45e02876-973388a1-94a29a9b_0
2025-10-10T14:38:09.868656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2571 sessionId: src_id|e37dae6b-45e02876-973388a1-94a29a9b_0 is DEAD
2025-10-10T14:38:09.882038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37dae6b-45e02876-973388a1-94a29a9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.882233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:09.882252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2572
2025-10-10T14:38:09.882458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:09.882491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:09.882497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:09.882501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:09.883006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2572 sessionId:  describe result for acl check
2025-10-10T14:38:09.883037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:09.883039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:09.883042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:09.883050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602387030962674:11632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:09.883652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602387030962674:11632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:09.886111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602387030962674:11632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:09.889638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602387030962674:11632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:09.889655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602387030962674:11632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:09.889659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602387030962674:11632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:09.889668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:09.895512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:09.897357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:09.897576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:09.897588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:09.897600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:09.897655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:09.897701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602386248728077:11686]
2025-10-10T14:38:09.898356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:09.898722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:09.898770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:09.899110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:09.899168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.899174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.899176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.899177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.899179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.899180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.899182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.899184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.899185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.899186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.899188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.899189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.899190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.899197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.899213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.899218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.899222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.899227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.899231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.899235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.899239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.899243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.899248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.899251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.899254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.899257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.899265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.899273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:09.899279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.899285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:09.899291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.899297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:09.899301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.899306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:09.899319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.899325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:09.899330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.899340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:09.899346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.899358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:09.899363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.899374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:09.899379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.899389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:09.899394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.899400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:09.899410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.899416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.899426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.899432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.899442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.899448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.899491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:09.901993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:09.902575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:09.902593Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:09.902596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:09.902600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:09.902607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2571 [2:7559602386248728077:11686]
2025-10-10T14:38:09.902623Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:09.902643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:09.902646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.902650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.902652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.902671Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:09.902680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:09.902688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:09.902750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.902753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.902755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.902757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:09.902830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:09.902834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.902847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:09.902859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:09.903401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2571
2025-10-10T14:38:09.903413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2571
2025-10-10T14:38:09.902879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:09.902901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602386248728072:11686]
2025-10-10T14:38:09.902905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602386248728072:11686]
2025-10-10T14:38:09.902907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602386248728072:11686]
2025-10-10T14:38:09.902921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:09.902937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:09.902956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:09.902960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:09.902994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602386248728072:11686]
2025-10-10T14:38:09.902997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:09.903072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:09.903074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:09.903076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:09.903083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:09.903276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962760:11632], now have 1 active actors on pipe
2025-10-10T14:38:09.903283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962623:2438], now have 1 active actors on pipe
2025-10-10T14:38:09.903513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.903528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.903566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:09.903575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:09.903581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:09.903583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:09.903606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:09.903628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:09.903645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.903845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:09.903856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:09.903878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:09.904380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37dae6b-45e02876-973388a1-94a29a9b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:09.903978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2572 partition: 0 MaxSeqNo: 40 sessionId: src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0
2025-10-10T14:38:09.907232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0] Write session: try to update token
2025-10-10T14:38:09.907254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:09.923934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId: src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:09.923180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:09.923202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:09.923206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:09.923208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:09.923218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602386248728072:11686]
2025-10-10T14:38:09.923223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602386248728072:11686]
2025-10-10T14:38:09.923227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602386248728072:11686]
2025-10-10T14:38:09.923281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:09.923288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:09.923287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:09.923291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:09.923294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:09.923302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:09.923447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:09.926675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:09.968755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602387030962814:11209]
2025-10-10T14:38:09.969066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2571, pipe: [1:7559602387030962814:11209]
2025-10-10T14:38:10.042344Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:10.042680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.042699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.042747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602387030962814:11209], now have 1 active actors on pipe
2025-10-10T14:38:10.043005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:10.043685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:10.043696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0] Write session will restart in 0.009253s
2025-10-10T14:38:10.043723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0] Write session: Do CDS request
2025-10-10T14:38:10.043730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:10.043024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:10.043028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602387030962814:11209]
2025-10-10T14:38:10.043042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:10.043051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:10.043310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2572 reason: error at write: Disconnected sessionId: src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0
2025-10-10T14:38:10.043505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2572 sessionId: src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0 is DEAD
2025-10-10T14:38:10.054043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.054097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:10.054130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2573
2025-10-10T14:38:10.054291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.054343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:10.054354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:10.054358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:10.054827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2573 sessionId:  describe result for acl check
2025-10-10T14:38:10.054867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:10.054874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:10.054878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:10.054886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602391325930240:11636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:10.055514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602391325930240:11636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:10.057649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:10.058011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602391325930240:11636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:10.059789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:10.060017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:10.060034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:10.060048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:10.060135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:10.060184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602390543695534:11688]
2025-10-10T14:38:10.060747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602391325930240:11636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:10.060763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602391325930240:11636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:10.060767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602391325930240:11636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:10.060776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:10.060824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:10.061189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:10.061256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:10.061619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:10.061714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.061721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.061723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.061724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.061726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.061727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.061728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.061730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.061731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.061733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.061734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.061735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.061737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.061743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.061756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.061760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.061764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.061768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.061772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.061776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.061781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.061785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.061790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.061795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.061799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.061803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.061811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.061820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.061827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.061834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.061846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.061853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.061862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.061867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.061877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.061882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.061889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.061894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.061899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.061903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.061912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.061918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.061926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.061931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.061936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.061940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.061953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.061958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.061963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.061968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.061973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.061977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.062012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:10.064611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:10.065365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:10.065379Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:10.065382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:10.065387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:10.065394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2572 [2:7559602390543695534:11688]
2025-10-10T14:38:10.065408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:10.065429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:10.065432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.065436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.065439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.065457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:10.065471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:10.065484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:10.065553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.065563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.065565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.065568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:10.065642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:10.065651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.065665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.065683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.065707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:10.065730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930112:2438], now have 1 active actors on pipe
2025-10-10T14:38:10.065739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930293:11636], now have 1 active actors on pipe
2025-10-10T14:38:10.065748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602390543695529:11688]
2025-10-10T14:38:10.065755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602390543695529:11688]
2025-10-10T14:38:10.065758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602390543695529:11688]
2025-10-10T14:38:10.065776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:10.065799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:10.065817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:10.065826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:10.065813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2572
2025-10-10T14:38:10.065837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2572
2025-10-10T14:38:10.065853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602390543695529:11688]
2025-10-10T14:38:10.065862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:10.065898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:10.065917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:10.065919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:10.065926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:10.066077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.066092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.066128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:10.066142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.066151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.066154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:10.066167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.066183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:10.066204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.066424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.066435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.066455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.066557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2573 partition: 0 MaxSeqNo: 40 sessionId: src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0
2025-10-10T14:38:10.067002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b08bba8-7bc83ac6-d334bd55-f1eeeb8b_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:10.069790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0] Write session: try to update token
2025-10-10T14:38:10.069809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:10.077575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:10.077600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:10.077610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602390543695529:11688]
2025-10-10T14:38:10.077658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:10.077849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:10.077995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:10.078168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:10.078319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:10.078536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:10.078575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:10.078732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:10.085668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId: src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:10.088391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:10.088613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.088641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.088686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:10.088807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:10.096137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:10.096165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:10.096169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:10.096171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:10.096183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602390543695529:11688]
2025-10-10T14:38:10.096187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602390543695529:11688]
2025-10-10T14:38:10.096192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602390543695529:11688]
2025-10-10T14:38:10.096240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:10.096243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:10.096251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.096254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:10.096255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:10.096259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:10.096397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:10.143635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602391325930304:11209]
2025-10-10T14:38:10.144023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2572, pipe: [1:7559602391325930304:11209]
2025-10-10T14:38:10.217489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:10.226206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.226240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.226436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.226503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.226573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.226651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.226705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.226721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.226801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.226858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.226925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.226989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.227034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.227039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.227111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.227170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.227231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.227294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.227335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.227338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.227409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.227476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.227546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.227615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.227657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.227660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.227731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.227798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.227866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.227936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.227980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.227983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.228056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.228123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.228189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.228253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.228297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.228300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.228374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.228437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.228505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.228570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.228613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.228615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.228687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.228750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.228812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.228876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.228925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.228928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.229001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.229063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.229127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.229200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.229242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.229245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.229319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.229617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.229694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.229766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.229807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.229809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.229881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930304:11209], now have 1 active actors on pipe
2025-10-10T14:38:10.231001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:10.233437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:10.233451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602391325930304:11209]
2025-10-10T14:38:10.233472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:10.233498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2573 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0
2025-10-10T14:38:10.233694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2573 sessionId: src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0 is DEAD
2025-10-10T14:38:10.237590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:10.237604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0] Write session will restart in 0.007887s
2025-10-10T14:38:10.237634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0] Write session: Do CDS request
2025-10-10T14:38:10.237640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:10.246968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.247056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:10.247075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2574
2025-10-10T14:38:10.247333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.247387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:10.247393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:10.247401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:10.247987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2574 sessionId:  describe result for acl check
2025-10-10T14:38:10.248019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:10.248021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:10.248023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:10.248029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602391325930427:11640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:10.249291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602391325930427:11640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:10.252031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602391325930427:11640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:10.254579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:10.254859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602391325930427:11640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:10.254875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602391325930427:11640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:10.254879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602391325930427:11640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:10.254889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:10.255016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:10.255216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:10.255228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:10.255240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:10.255292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:10.255338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602390543695700:11691]
2025-10-10T14:38:10.255916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:10.256570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:10.256620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:10.256930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:10.257003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.257012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.257013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.257014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.257015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.257016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.257017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.257018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.257019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.257020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.257022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.257023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.257024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.257031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.257055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.257059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.257062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.257065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.257069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.257073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.257076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.257079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.257083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.257087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.257090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.257093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.257102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.257111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.257117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.257122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.257126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.257131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.257135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.257141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.257145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.257150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.257155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.257159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.257164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.257168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.257172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.257177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.257182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.257186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.257192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.257196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.257200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.257205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.257209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.257214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.257218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.257223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.257257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:10.259809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:10.260376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:10.260391Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:10.260394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:10.260397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:10.260403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2573 [2:7559602390543695700:11691]
2025-10-10T14:38:10.260417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:10.260437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:10.260449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.260453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.260456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.260474Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:10.260482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:10.260490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:10.260552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.260558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.260560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.260564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:10.260642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:10.260651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.260664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.260679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.260697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:10.260723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602390543695695:11691]
2025-10-10T14:38:10.260731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602390543695695:11691]
2025-10-10T14:38:10.260734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602390543695695:11691]
2025-10-10T14:38:10.260744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:10.260755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:10.260760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:10.260778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:10.260783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:10.260785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:10.260786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:10.260797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930486:11640], now have 1 active actors on pipe
2025-10-10T14:38:10.260801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930309:2438], now have 1 active actors on pipe
2025-10-10T14:38:10.260823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602390543695695:11691]
2025-10-10T14:38:10.260835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:10.260846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2573
2025-10-10T14:38:10.260860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2573
2025-10-10T14:38:10.260858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:10.261020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.261026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.261065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a35140f3-534278a0-4b94c3ff-1458705f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:10.261075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.261079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.261081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:10.261094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.261105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:10.261121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.261380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.261393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.261419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.261541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2574 partition: 0 MaxSeqNo: 40 sessionId: src_id|a35140f3-534278a0-4b94c3ff-1458705f_0
2025-10-10T14:38:10.261961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6cb3373-286b2ff1-6c295972-76bd8c13_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|a35140f3-534278a0-4b94c3ff-1458705f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:10.264807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35140f3-534278a0-4b94c3ff-1458705f_0] Write session: try to update token
2025-10-10T14:38:10.264824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35140f3-534278a0-4b94c3ff-1458705f_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:10.282630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:10.282659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:10.282663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:10.282665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:10.282676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602390543695695:11691]
2025-10-10T14:38:10.282681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602390543695695:11691]
2025-10-10T14:38:10.282686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602390543695695:11691]
2025-10-10T14:38:10.282745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:10.282759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.282762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:10.282904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:10.285457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:10.285483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:10.285488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:10.291766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId: src_id|a35140f3-534278a0-4b94c3ff-1458705f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:10.294419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:10.333411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602391325930497:11209]
2025-10-10T14:38:10.333792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2573, pipe: [1:7559602391325930497:11209]
2025-10-10T14:38:10.401275Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:10.401689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.401709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.401734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930497:11209], now have 1 active actors on pipe
2025-10-10T14:38:10.401945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:10.405449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602391325930497:11209]
2025-10-10T14:38:10.405503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:10.405586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2574 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a35140f3-534278a0-4b94c3ff-1458705f_0
2025-10-10T14:38:10.405959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35140f3-534278a0-4b94c3ff-1458705f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:38:10.405971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35140f3-534278a0-4b94c3ff-1458705f_0] Write session will restart in 0.007391s
2025-10-10T14:38:10.405997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35140f3-534278a0-4b94c3ff-1458705f_0] Write session: Do CDS request
2025-10-10T14:38:10.406003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35140f3-534278a0-4b94c3ff-1458705f_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:10.405798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2574 sessionId: src_id|a35140f3-534278a0-4b94c3ff-1458705f_0 is DEAD
2025-10-10T14:38:10.406060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:10.415125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a35140f3-534278a0-4b94c3ff-1458705f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.416360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:10.416381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2575
2025-10-10T14:38:10.416518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.416553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:10.416564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:10.416568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:10.417548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2575 sessionId:  describe result for acl check
2025-10-10T14:38:10.417590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:10.417596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:10.417598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:10.417606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602391325930576:11651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:10.418155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602391325930576:11651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:10.423115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602391325930576:11651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:10.429248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602391325930576:11651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:10.429267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602391325930576:11651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:10.429297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602391325930576:11651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:10.429307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:10.431277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:10.433594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:10.434135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:10.434152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:10.434169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:10.434259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:10.434309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602390543695908:11700]
2025-10-10T14:38:10.434972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:10.435388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:10.435458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:10.435829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:10.435907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.435909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.435910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.435911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.435913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.435914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.435916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.435917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.435918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.435920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.435921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.435923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.435924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.435932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.435944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.435949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.435953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.435957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.435962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.435967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.435971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.435975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.435979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.435984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.435988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.435993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.436000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.436010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.436018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.436024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.436029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.436034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.436038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.436043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.436049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.436054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.436058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.436063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.436069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.436073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.436078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.436083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.436088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.436094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.436097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.436103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.436108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.436113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.436117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.436123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.436128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.436133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.436176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:10.439250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:10.439844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:10.439862Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:10.439864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:10.439869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:10.439876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2574 [2:7559602390543695908:11700]
2025-10-10T14:38:10.439890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:10.439910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:10.439921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.439925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.439928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.439947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:10.439955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:10.439965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:10.440031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.440038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.440057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.440065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:10.440138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:10.440146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.440160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.440173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.440191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:10.440216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930514:2438], now have 1 active actors on pipe
2025-10-10T14:38:10.440220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930702:11651], now have 1 active actors on pipe
2025-10-10T14:38:10.440228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602390543695902:11700]
2025-10-10T14:38:10.440230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602390543695902:11700]
2025-10-10T14:38:10.440233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602390543695902:11700]
2025-10-10T14:38:10.440246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:10.440262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:10.440282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:10.440291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:10.440329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602390543695902:11700]
2025-10-10T14:38:10.440336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:10.440467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2574
2025-10-10T14:38:10.440505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2574
2025-10-10T14:38:10.440368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:10.440376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:10.440378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:10.440394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:10.440692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.440703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.440738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:10.440752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.440757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.440760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:10.440773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.440789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:10.440805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.441285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.441294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.441310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.441656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2575 partition: 0 MaxSeqNo: 40 sessionId: src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0
2025-10-10T14:38:10.442101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a35140f3-534278a0-4b94c3ff-1458705f_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:10.445257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0] Write session: try to update token
2025-10-10T14:38:10.445284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:10.460917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:10.460937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:10.460940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:10.460943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:10.460952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602390543695902:11700]
2025-10-10T14:38:10.460957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602390543695902:11700]
2025-10-10T14:38:10.460961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602390543695902:11700]
2025-10-10T14:38:10.461014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:10.461026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.461028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:10.461020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:10.461039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:10.461043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:10.461172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:10.462314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId: src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:10.465258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:10.505669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602391325930729:11209]
2025-10-10T14:38:10.505951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2574, pipe: [1:7559602391325930729:11209]
2025-10-10T14:38:10.579625Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:10.579869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.579877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.579918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930729:11209], now have 1 active actors on pipe
2025-10-10T14:38:10.580279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:10.580283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:10.580298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:10.580302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:10.580340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602391325930729:11209]
2025-10-10T14:38:10.580371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2575 reason: error at write: Disconnected sessionId: src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0
2025-10-10T14:38:10.580709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:10.580721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0] Write session will restart in 0.009709s
2025-10-10T14:38:10.580747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0] Write session: Do CDS request
2025-10-10T14:38:10.580754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:10.580572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2575 sessionId: src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0 is DEAD
2025-10-10T14:38:10.592076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.592428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:10.592443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2576
2025-10-10T14:38:10.592562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.592597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:10.592608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:10.592613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:10.593139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2576 sessionId:  describe result for acl check
2025-10-10T14:38:10.593181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:10.593183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:10.593185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:10.593192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602391325930821:11658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:10.593798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602391325930821:11658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:10.596708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:10.599026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:10.599153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602391325930821:11658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:10.599242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:10.599254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:10.599267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:10.599325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:10.599369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602390543696079:11709]
2025-10-10T14:38:10.599990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:10.600327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:10.600371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:10.600722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:10.600788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.600793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.600795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.600796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.600797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.600798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.600799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.600801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.600802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.600803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.600804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.600806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.600807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.600812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.600826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.600839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.600843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.600847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.600852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.600856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.600860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.600864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.600868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.600872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.600876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.600880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.600888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.600897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.600903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.600909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.600914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.600919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.600923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.600929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.600933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.600939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.600944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.600949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.600954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.600959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.600963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.600968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.600972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.600978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.600983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.600988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.600993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.600998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.601003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.601008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.601014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.601020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.601060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:10.607318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:10.607360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602391325930821:11658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:10.607380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602391325930821:11658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:10.607384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602391325930821:11658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:10.607395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:10.607949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:10.607959Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:10.607961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:10.607965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:10.607972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2575 [2:7559602390543696079:11709]
2025-10-10T14:38:10.607982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:10.607998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:10.608000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.608002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.608004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.608017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:10.608022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:10.608030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:10.608085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.608090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.608092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.608094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:10.608148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:10.608159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.608172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.608185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.608206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:10.608229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930730:2438], now have 1 active actors on pipe
2025-10-10T14:38:10.608235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930917:11658], now have 1 active actors on pipe
2025-10-10T14:38:10.608243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602390543696074:11709]
2025-10-10T14:38:10.608246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602390543696074:11709]
2025-10-10T14:38:10.608248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602390543696074:11709]
2025-10-10T14:38:10.608262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:10.608277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:10.608280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:10.608285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:10.608288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:10.608291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:10.608294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:10.608322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602390543696074:11709]
2025-10-10T14:38:10.608334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:10.608349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:10.608360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2575
2025-10-10T14:38:10.608397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2575
2025-10-10T14:38:10.608483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.608491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.608518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c12607cd-b7107537-53e15af5-646780c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:10.608528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.608531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.608534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:10.608556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.608567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:10.608586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.608780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.608790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.608809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.608925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2576 partition: 0 MaxSeqNo: 40 sessionId: src_id|c12607cd-b7107537-53e15af5-646780c9_0
2025-10-10T14:38:10.609352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5008b0ac-673d8db4-bf0a1a38-8fd2d5db_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c12607cd-b7107537-53e15af5-646780c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:10.612125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c12607cd-b7107537-53e15af5-646780c9_0] Write session: try to update token
2025-10-10T14:38:10.612144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c12607cd-b7107537-53e15af5-646780c9_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:10.631891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:10.631907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:10.631911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:10.631913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:10.631924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602390543696074:11709]
2025-10-10T14:38:10.631929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602390543696074:11709]
2025-10-10T14:38:10.631933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602390543696074:11709]
2025-10-10T14:38:10.631981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:10.631986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:10.631990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.631992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:10.631992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:10.631997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:10.632135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:10.633993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId: src_id|c12607cd-b7107537-53e15af5-646780c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:10.636715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:10.680537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602391325930926:11209]
2025-10-10T14:38:10.680832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2575, pipe: [1:7559602391325930926:11209]
2025-10-10T14:38:10.748263Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:10.748953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:10.748986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602391325930926:11209]
2025-10-10T14:38:10.749013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:10.749016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:10.748613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.748629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.748668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930926:11209], now have 1 active actors on pipe
2025-10-10T14:38:10.749040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:10.749503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c12607cd-b7107537-53e15af5-646780c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:10.749514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c12607cd-b7107537-53e15af5-646780c9_0] Write session will restart in 0.007068s
2025-10-10T14:38:10.749539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c12607cd-b7107537-53e15af5-646780c9_0] Write session: Do CDS request
2025-10-10T14:38:10.749545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c12607cd-b7107537-53e15af5-646780c9_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:10.749096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2576 reason: error at write: Disconnected sessionId: src_id|c12607cd-b7107537-53e15af5-646780c9_0
2025-10-10T14:38:10.749349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2576 sessionId: src_id|c12607cd-b7107537-53e15af5-646780c9_0 is DEAD
2025-10-10T14:38:10.758008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c12607cd-b7107537-53e15af5-646780c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.758070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:10.758085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2577
2025-10-10T14:38:10.758372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.758412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:10.758418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:10.758422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:10.758860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2577 sessionId:  describe result for acl check
2025-10-10T14:38:10.758897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:10.758906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:10.758908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:10.758914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602391325930979:11662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:10.759463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602391325930979:11662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:10.762604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602391325930979:11662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:10.765944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602391325930979:11662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:10.765961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602391325930979:11662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:10.765965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602391325930979:11662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:10.765974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:10.766600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:10.768705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:10.769016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:10.769026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:10.769038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:10.769111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:10.769155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602390543696246:11711]
2025-10-10T14:38:10.769802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:10.770296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:10.770351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:10.770703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:10.770773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.770780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.770781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.770782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.770784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.770785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.770786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.770788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.770789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.770790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.770791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.770792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.770794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.770800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.770815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.770820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.770824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.770829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.770833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.770837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.770841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.770846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.770850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.770854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.770858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.770862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.770871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.770880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.770888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.770894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.770899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.770905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.770909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.770920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.770925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.770931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.770936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.770941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.770947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.770958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.770963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.770972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.770978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.770988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.770992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.770997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.771002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.771009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.771017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.771022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.771031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.771035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.771081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:10.773711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:10.774217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:10.774232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:10.774235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:10.774239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:10.774249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2576 [2:7559602390543696246:11711]
2025-10-10T14:38:10.774262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:10.774282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:10.774291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.774308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.774311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.774331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:10.774348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:10.774356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:10.774433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.774442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.774444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.774447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:10.774521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:10.774528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.774541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.774558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.774580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:10.774608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325931109:11662], now have 1 active actors on pipe
2025-10-10T14:38:10.774617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325930927:2438], now have 1 active actors on pipe
2025-10-10T14:38:10.774624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602390543696241:11711]
2025-10-10T14:38:10.774627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602390543696241:11711]
2025-10-10T14:38:10.774629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602390543696241:11711]
2025-10-10T14:38:10.774642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:10.774656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:10.774660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:10.774668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:10.774671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:10.774675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:10.774679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:10.774710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602390543696241:11711]
2025-10-10T14:38:10.774717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:10.774722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:10.774725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2576
2025-10-10T14:38:10.774761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2576
2025-10-10T14:38:10.774910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.774921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.774961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5f3643f-1532460-d7877be5-4076bf99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:10.774974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.774980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.774983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:10.774995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.775011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:10.775042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.775271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.775283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.775318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.775452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2577 partition: 0 MaxSeqNo: 40 sessionId: src_id|f5f3643f-1532460-d7877be5-4076bf99_0
2025-10-10T14:38:10.775925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c12607cd-b7107537-53e15af5-646780c9_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|f5f3643f-1532460-d7877be5-4076bf99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:10.779511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f3643f-1532460-d7877be5-4076bf99_0] Write session: try to update token
2025-10-10T14:38:10.779533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f3643f-1532460-d7877be5-4076bf99_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:10.789665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:38:10.789683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:10.789697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559602390543696241:11711]
2025-10-10T14:38:10.789752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:38:10.789949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:38:10.790085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:10.790220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:10.790392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:38:10.790591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:38:10.790632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760106661313 queuesize 0 startOffset 0
2025-10-10T14:38:10.791551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:38:10.796387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId: src_id|f5f3643f-1532460-d7877be5-4076bf99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:10.799550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.799326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:10.799583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.799626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:10.799732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:10.808959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:10.808974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:10.808981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:10.808983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:10.808995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602390543696241:11711]
2025-10-10T14:38:10.808999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602390543696241:11711]
2025-10-10T14:38:10.809003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602390543696241:11711]
2025-10-10T14:38:10.809056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:10.809051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:10.809067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.809068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:10.809070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:10.809073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:10.809207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:10.849019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602391325931131:11209]
2025-10-10T14:38:10.849388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2576, pipe: [1:7559602391325931131:11209]
2025-10-10T14:38:10.925643Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:10.934198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.934226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.934429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.934500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.934565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.934637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.934684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.934698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.934784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.934846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.934909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.934979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.935023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.935026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.935100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.935163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.935234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.935300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.935343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.935346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.935422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.935484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.935559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.935625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.935668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.935671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.935751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.935817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.935885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.935948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.935997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.936000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.936074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.936138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.936202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.936265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.936305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.936308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.936388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.936455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.936529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.936599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.936644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.936647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.936725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.936789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.936857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.936921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.936964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.936967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.937053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.937118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.937188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.937260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.937305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.937308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.937659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:10.937729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:10.937805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:10.937885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:10.938355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:10.938384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:10.938421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602391325931131:11209]
2025-10-10T14:38:10.938432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2577 reason: error at write: Disconnected sessionId: src_id|f5f3643f-1532460-d7877be5-4076bf99_0
2025-10-10T14:38:10.938441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:10.938654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2577 sessionId: src_id|f5f3643f-1532460-d7877be5-4076bf99_0 is DEAD
2025-10-10T14:38:10.938813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f3643f-1532460-d7877be5-4076bf99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:10.938824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f3643f-1532460-d7877be5-4076bf99_0] Write session will restart in 0.007787s
2025-10-10T14:38:10.938848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f3643f-1532460-d7877be5-4076bf99_0] Write session: Do CDS request
2025-10-10T14:38:10.938854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f3643f-1532460-d7877be5-4076bf99_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:10.937936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:10.937945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:10.938023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325931131:11209], now have 1 active actors on pipe
2025-10-10T14:38:10.939417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:10.949483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f3643f-1532460-d7877be5-4076bf99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.950736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:10.950757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2578
2025-10-10T14:38:10.951960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:10.952016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:10.952028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:10.952033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:10.952934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2578 sessionId:  describe result for acl check
2025-10-10T14:38:10.952974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:10.952977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:10.952979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:10.952987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602391325931250:11667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:10.953640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602391325931250:11667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:10.956872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:10.956873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602391325931250:11667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:10.958964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:10.959182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:10.959192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:10.959205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:10.959263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:10.959308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602390543696412:11713]
2025-10-10T14:38:10.959932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:10.960256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:10.960300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:10.960644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:10.960711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.960712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.960713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.960715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.960716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.960717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.960718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.960720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.960721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.960722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.960723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.960725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.960726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.960731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.960745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.960750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.960754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.960758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.960762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.960766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.960770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.960774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.960779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.960783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.960787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.960791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.960799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.960807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:10.960814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.960819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:10.960824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.960828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:10.960832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.960837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:10.960842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.960849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:10.960853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.960858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:10.960863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.960868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:10.960873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.960877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:10.960882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.960888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:10.960892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.960897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:10.960901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.960905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.960909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.960914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.960919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.960925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.960965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:10.963932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602391325931250:11667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:10.963952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602391325931250:11667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:10.963957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602391325931250:11667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:10.963966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:10.965420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:10.965765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:10.965777Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:10.965779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:10.965784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:10.965790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2577 [2:7559602390543696412:11713]
2025-10-10T14:38:10.965807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:10.965826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:10.965837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.965841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.965844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.965863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:10.965871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:10.965879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:10.965940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.965947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.965949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.965952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:10.966023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:10.966031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.966043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:10.966060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:10.966079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:10.966113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325931322:11667], now have 1 active actors on pipe
2025-10-10T14:38:10.966121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602391325931133:2438], now have 1 active actors on pipe
2025-10-10T14:38:10.966128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602390543696407:11713]
2025-10-10T14:38:10.966130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602390543696407:11713]
2025-10-10T14:38:10.966133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602390543696407:11713]
2025-10-10T14:38:10.966148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:10.966169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:10.966156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2577
2025-10-10T14:38:10.966173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:10.966173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2577
2025-10-10T14:38:10.966185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:10.966188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:10.966193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:10.966196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:10.966219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602390543696407:11713]
2025-10-10T14:38:10.966223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:10.966225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:10.966243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.966248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.966303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:10.966311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:10.966315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:10.966317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:10.966329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:10.966341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:10.966383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.966553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.966562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.966578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:10.966648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2578 partition: 0 MaxSeqNo: 40 sessionId: src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0
2025-10-10T14:38:10.967074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5f3643f-1532460-d7877be5-4076bf99_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:10.969850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0] Write session: try to update token
2025-10-10T14:38:10.969868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:10.986327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId: src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:10.989025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:10.989234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:10.989257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:10.991156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:10.991192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:10.991195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:10.991199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:10.991201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:10.991210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602390543696407:11713]
2025-10-10T14:38:10.991214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602390543696407:11713]
2025-10-10T14:38:10.991218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602390543696407:11713]
2025-10-10T14:38:10.991250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:10.991260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:10.991262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:10.991267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:10.991269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:10.991271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:10.991290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:10.991443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:11.038457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602395620898626:11209]
2025-10-10T14:38:11.042170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2577, pipe: [1:7559602395620898626:11209]
2025-10-10T14:38:11.117729Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:11.127065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.127098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.127305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.127375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.127452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.127524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.128087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.128104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.128194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.128266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.128355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.128437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.128490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.128499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.128575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.128643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.128714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.128782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.128837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.128845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.128923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.128994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.129065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.129145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.129193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.129201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.129285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.129384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.129462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.129533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.129581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.129588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.129658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.129731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.129799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.129865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.129917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.129927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.129992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.130049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.130113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.130171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.130216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.130222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.130289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.130347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.130423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.130486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.130530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.130535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.130600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.130658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.130718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.130778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.130834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.130836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.130906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.130969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.131033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.131098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.131146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.131153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.131230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620898626:11209], now have 1 active actors on pipe
2025-10-10T14:38:11.131476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:11.131541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:11.131562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:11.131601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2578 reason: error at write: Disconnected sessionId: src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0
2025-10-10T14:38:11.131686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602395620898626:11209]
2025-10-10T14:38:11.131843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2578 sessionId: src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0 is DEAD
2025-10-10T14:38:11.131843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:11.131974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:11.131984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0] Write session will restart in 0.005825s
2025-10-10T14:38:11.132011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0] Write session: Do CDS request
2025-10-10T14:38:11.132017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:11.138915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.138987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:11.139004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2579
2025-10-10T14:38:11.139145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.139201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:11.139214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:11.139218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:11.139716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2579 sessionId:  describe result for acl check
2025-10-10T14:38:11.139753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:11.139755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:11.139758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:11.139764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602395620898657:11671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:11.140340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602395620898657:11671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:11.144307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602395620898657:11671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:11.147277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602395620898657:11671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:11.147294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602395620898657:11671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:11.147298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602395620898657:11671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:11.147307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:11.148933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:11.150803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:11.151030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:11.151042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:11.151064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:11.151119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:11.151164Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602394838663879:11716]
2025-10-10T14:38:11.151804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:11.152178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:11.152246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:11.152613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:11.152713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.152725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.152726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.152728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.152729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.152731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.152732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.152733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.152735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.152736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.152738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.152739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.152740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.152748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.152762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.152767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.152771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.152775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.152778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.152782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.152786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.152790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.152796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.152800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.152804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.152808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.152818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.152826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.152834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.152839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.152845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.152850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.152854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.152859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.152865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.152871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.152876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.152881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.152886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.152892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.152897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.152909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.152915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.152925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.152930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.152940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 1 size 1229162 so 0 eo 33 d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.152947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.152953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 3 size 5223531 so 0 eo 36 d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.152958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.152963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.152973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.152978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 2253220 so 0 eo 40 d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.153019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:38:11.155584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 40 key 32,1 valuesize 1229162 expected 1229162
2025-10-10T14:38:11.155992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:38:11.156003Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:38:11.156005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:38:11.156009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:38:11.156019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2578 [2:7559602394838663879:11716]
2025-10-10T14:38:11.156033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 40 Head Offset 40 PartNo 0 PackedSize 0 count 0 nextOffset 40 batches 0
SYNC INIT sourceId  src_id seqNo 40 offset 39
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00000_0000000001_00004? size 2253220
2025-10-10T14:38:11.156049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:38:11.156051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.156053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.156055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.156071Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 40 offset: 39 MaxOffset: 40
2025-10-10T14:38:11.156084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:38:11.156098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:38:11.156169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.156176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.156178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.156181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 14236367 bytes
2025-10-10T14:38:11.156252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T14:38:11.156258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.156269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.156281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.156297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T14:38:11.156325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620898628:2438], now have 1 active actors on pipe
2025-10-10T14:38:11.156332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620898811:11671], now have 1 active actors on pipe
2025-10-10T14:38:11.156340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 3 count 3 parts_count 9 actorID [2:7559602394838663874:11716]
2025-10-10T14:38:11.156346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 3 parts_count 12 actorID [2:7559602394838663874:11716]
2025-10-10T14:38:11.156348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 0 count 1 parts_count 4 actorID [2:7559602394838663874:11716]
2025-10-10T14:38:11.156362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-10T14:38:11.156379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 3 count 3 parts_count 9
2025-10-10T14:38:11.156380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 40 max time lag 0ms effective offset 0
2025-10-10T14:38:11.156388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 3 parts_count 12
2025-10-10T14:38:11.156390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 0 count 1 parts_count 4
2025-10-10T14:38:11.156396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 40
2025-10-10T14:38:11.156399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:38:11.156375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2578
2025-10-10T14:38:11.156373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2578
2025-10-10T14:38:11.156435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559602394838663874:11716]
2025-10-10T14:38:11.156446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:38:11.156452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:38:11.156465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.156475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.156527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:38:11.156541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:38:11.156545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:38:11.156548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:38:11.156561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:38:11.156572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:38:11.156592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.156798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.156808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.156826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:38:11.156934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2579 partition: 0 MaxSeqNo: 40 sessionId: src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0
2025-10-10T14:38:11.157398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c17ba6f9-a98c1a24-768e2f61-79469fa4_0] Write session established. Init response: last_sequence_number: 40 session_id: "src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:38:11.160238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0] Write session: try to update token
2025-10-10T14:38:11.160256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0] Send 10 message(s) (0 left), first sequence number is 41
2025-10-10T14:38:11.176648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId: src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:38:11.179598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:38:11.179860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.179881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.181676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-10T14:38:11.181690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:38:11.181695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:38:11.181697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:38:11.181706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 3 size 5223531 actorID [2:7559602394838663874:11716]
2025-10-10T14:38:11.181711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7559602394838663874:11716]
2025-10-10T14:38:11.181716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 2253220 actorID [2:7559602394838663874:11716]
2025-10-10T14:38:11.181763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:38:11.181777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-10T14:38:11.181785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:38:11.181790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-10T14:38:11.181793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.181795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T14:38:11.181795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:38:11.181937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:38:11.181925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:38:11.231992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 40 InitDone 1 WaitForData 0, pipe: [1:7559602395620898826:11209]
2025-10-10T14:38:11.233372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2578, pipe: [1:7559602395620898826:11209]
2025-10-10T14:38:11.301152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=33;Head.PackedSize=1229162;NewHead.Offset=33;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x14B20E3F)
??+0 (0x14B20DE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15885CED)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1498 (0x2482267A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x2481AADE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x24932F5A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+4727 (0x24934A77)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x247B3E49)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15831988)
2025-10-10T14:38:11.310333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:38:11.310375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:38:11.310569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.310633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.310710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.310777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.310830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.310844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.310919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.310982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.311045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.311117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.311162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.311165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.311237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.311295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.311361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.311429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.311474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.311477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.311553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.311619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.311683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.311752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.311799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.311802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.311874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.311933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.311995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.312057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.312101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.312104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.312182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.312239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.312302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.312365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.312408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.312411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.312485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.312545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.312610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.312675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.312716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.312725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.312800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.312855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.312913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.312971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.313011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.313014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.313079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.313138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.313197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.313268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.313323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.313326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.313629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-10T14:38:11.313696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-10T14:38:11.313763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-10T14:38:11.315136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:38:11.315149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0] Write session will restart in 0.007828s
2025-10-10T14:38:11.315176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0] Write session: Do CDS request
2025-10-10T14:38:11.315183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0] Start write session. Will connect to endpoint: localhost:15287
2025-10-10T14:38:11.314702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:38:11.314717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:38:11.314753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2579 reason: error at write: Disconnected sessionId: src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0
2025-10-10T14:38:11.314963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2579 sessionId: src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0 is DEAD
2025-10-10T14:38:11.315134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_8283312721166257727_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559602395620898826:11209]
2025-10-10T14:38:11.315148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:38:11.313830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-10T14:38:11.313891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-10T14:38:11.313894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-10T14:38:11.313962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559602395620898826:11209], now have 1 active actors on pipe
2025-10-10T14:38:11.315407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:38:11.323956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260cd8e1-d7fb18ed-3dd274fb-3c43c4bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.324065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:38:11.324092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2580
2025-10-10T14:38:11.324470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:38:11.324515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37328
2025-10-10T14:38:11.324537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37328 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:38:11.324541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:38:11.325014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2580 sessionId:  describe result for acl check
2025-10-10T14:38:11.325047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:38:11.325048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:38:11.325050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:38:11.325058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559602395620898841:11675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:38:11.325749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559602395620898841:11675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:38:11.329805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559602395620898841:11675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:38:11.342966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559602395620898841:11675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:38:11.342984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559602395620898841:11675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:38:11.342989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559602395620898841:11675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:38:11.342999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:38:11.346725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:38:11.349298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:38:11.349621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:38:11.349634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:38:11.349649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:38:11.349727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:38:11.349773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559602394838664061:11718]
2025-10-10T14:38:11.350452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:38:11.350787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:38:11.350876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:38:11.351269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:38:11.351354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.351355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.351357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.351358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.351360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.351361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.351363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.351364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.351366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.351367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.351368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.351370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.351371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.351378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:38:11.351392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:38:11.351396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:38:11.351400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:38:11.351405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:38:11.351409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:38:11.351414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:38:11.351416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-10T14:38:11.351418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-10T14:38:11.351421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-10T14:38:11.351423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000033_00003_0000000003_00009?
2025-10-10T14:38:11.351425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012?
2025-10-10T14:38:11.351427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00000_0000000001_00004?
2025-10-10T14:38:11.351437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662